2024-09-13T16:53:19.719 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T16:53:19.746 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T16:53:19.847 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903864 branch: wip-rishabh-testing-20240910.100730-reef description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/fs/norstats}} email: null first_in_suite: false job_id: '7903864' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240910.100730-reef ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client dirsize rbytes: false client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 subvols: create: 2 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 kclient: client.0: mount_subvol_num: 1 rbytes: false selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240910.100730-reef sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 6439 sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 sleep_before_teardown: 0 subset: 964/1024 suite: fs suite_branch: wip-rishabh-testing-20240910.100730-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi087.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBwRwMClcPOvn9XRr1uumzjiDFg0icG1I4/6cwDwmJhGvEpuLP2k0h1xZFTPitaXWCaVLbtRt3d1X9I3CM/C2pA= smithi118.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKfP3djfDpSP8q/ZkYxkHRVJdpReWgtd5NLmYlsky1gCn9l8kb8rQW0Y0h0IfyyPYh0FOFwWeRSxL5Htqfmorjk= smithi149.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA2EuRlgWKDRSNVDgwh0cxgZMIzqLPdBzNoV2OsaPHvLt1UGYxnssdBcL4Y31ND5QZNeA4woVOg64sd2wcomIBE= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - fs/norstats teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_14:42:16 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T16:53:19.847 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa; will attempt to use it 2024-09-13T16:53:19.848 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa/tasks 2024-09-13T16:53:19.848 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T16:53:19.850 INFO:teuthology.task.internal:Checking packages... 2024-09-13T16:53:19.872 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3' 2024-09-13T16:53:19.873 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T16:53:19.873 INFO:teuthology.packaging:ref: None 2024-09-13T16:53:19.873 INFO:teuthology.packaging:tag: None 2024-09-13T16:53:19.873 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240910.100730-reef 2024-09-13T16:53:19.873 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T16:53:19.873 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240910.100730-reef 2024-09-13T16:53:20.029 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-860.g6c6b083f 2024-09-13T16:53:20.031 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T16:53:20.037 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T16:53:20.037 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T16:53:20.044 INFO:teuthology.task.internal:Saving configuration 2024-09-13T16:53:20.064 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T16:53:20.071 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T16:53:20.105 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi087.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903864', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 16:47:41.536566', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBwRwMClcPOvn9XRr1uumzjiDFg0icG1I4/6cwDwmJhGvEpuLP2k0h1xZFTPitaXWCaVLbtRt3d1X9I3CM/C2pA='} 2024-09-13T16:53:20.138 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903864', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 16:47:41.534200', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKfP3djfDpSP8q/ZkYxkHRVJdpReWgtd5NLmYlsky1gCn9l8kb8rQW0Y0h0IfyyPYh0FOFwWeRSxL5Htqfmorjk='} 2024-09-13T16:53:20.170 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903864', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 16:47:41.535466', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA2EuRlgWKDRSNVDgwh0cxgZMIzqLPdBzNoV2OsaPHvLt1UGYxnssdBcL4Y31ND5QZNeA4woVOg64sd2wcomIBE='} 2024-09-13T16:53:20.171 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T16:53:20.177 INFO:teuthology.task.internal:roles: ubuntu@smithi087.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-13T16:53:20.177 INFO:teuthology.task.internal:roles: ubuntu@smithi118.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-13T16:53:20.177 INFO:teuthology.task.internal:roles: ubuntu@smithi149.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-13T16:53:20.177 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T16:53:20.297 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f65d341fbe0>, signals=[15]) 2024-09-13T16:53:20.297 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T16:53:20.303 INFO:teuthology.task.internal:Opening connections... 2024-09-13T16:53:20.303 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T16:53:20.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:53:20.392 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi118.front.sepia.ceph.com 2024-09-13T16:53:20.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:53:20.479 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi149.front.sepia.ceph.com 2024-09-13T16:53:20.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:53:20.565 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T16:53:20.572 DEBUG:teuthology.orchestra.run.smithi087:> uname -m 2024-09-13T16:53:20.591 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64 2024-09-13T16:53:20.591 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2024-09-13T16:53:20.649 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="CentOS Stream" 2024-09-13T16:53:20.649 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="9" 2024-09-13T16:53:20.649 INFO:teuthology.orchestra.run.smithi087.stdout:ID="centos" 2024-09-13T16:53:20.649 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE="rhel fedora" 2024-09-13T16:53:20.649 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="9" 2024-09-13T16:53:20.649 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM_ID="platform:el9" 2024-09-13T16:53:20.649 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T16:53:20.650 INFO:teuthology.orchestra.run.smithi087.stdout:ANSI_COLOR="0;31" 2024-09-13T16:53:20.650 INFO:teuthology.orchestra.run.smithi087.stdout:LOGO="fedora-logo-icon" 2024-09-13T16:53:20.650 INFO:teuthology.orchestra.run.smithi087.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T16:53:20.650 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://centos.org/" 2024-09-13T16:53:20.650 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T16:53:20.650 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T16:53:20.650 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T16:53:20.651 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2024-09-13T16:53:20.680 DEBUG:teuthology.orchestra.run.smithi118:> uname -m 2024-09-13T16:53:20.699 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2024-09-13T16:53:20.699 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2024-09-13T16:53:20.757 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="CentOS Stream" 2024-09-13T16:53:20.757 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="9" 2024-09-13T16:53:20.757 INFO:teuthology.orchestra.run.smithi118.stdout:ID="centos" 2024-09-13T16:53:20.757 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="rhel fedora" 2024-09-13T16:53:20.757 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="9" 2024-09-13T16:53:20.757 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el9" 2024-09-13T16:53:20.757 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T16:53:20.757 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2024-09-13T16:53:20.757 INFO:teuthology.orchestra.run.smithi118.stdout:LOGO="fedora-logo-icon" 2024-09-13T16:53:20.757 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T16:53:20.758 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://centos.org/" 2024-09-13T16:53:20.758 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T16:53:20.758 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T16:53:20.758 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T16:53:20.758 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2024-09-13T16:53:20.788 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2024-09-13T16:53:20.807 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2024-09-13T16:53:20.807 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2024-09-13T16:53:20.865 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream" 2024-09-13T16:53:20.865 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="9" 2024-09-13T16:53:20.866 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos" 2024-09-13T16:53:20.866 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora" 2024-09-13T16:53:20.866 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="9" 2024-09-13T16:53:20.866 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el9" 2024-09-13T16:53:20.866 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T16:53:20.866 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2024-09-13T16:53:20.866 INFO:teuthology.orchestra.run.smithi149.stdout:LOGO="fedora-logo-icon" 2024-09-13T16:53:20.866 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T16:53:20.866 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/" 2024-09-13T16:53:20.866 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T16:53:20.866 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T16:53:20.866 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T16:53:20.867 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2024-09-13T16:53:20.896 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T16:53:20.910 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T16:53:20.922 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T16:53:20.923 DEBUG:teuthology.orchestra.run.smithi087:> test '!' -e /home/ubuntu/cephtest 2024-09-13T16:53:20.926 DEBUG:teuthology.orchestra.run.smithi118:> test '!' -e /home/ubuntu/cephtest 2024-09-13T16:53:20.929 DEBUG:teuthology.orchestra.run.smithi149:> test '!' -e /home/ubuntu/cephtest 2024-09-13T16:53:20.946 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T16:53:20.953 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T16:53:20.953 DEBUG:teuthology.orchestra.run.smithi087:> test -z $(ls -A /var/lib/ceph) 2024-09-13T16:53:20.983 DEBUG:teuthology.orchestra.run.smithi118:> test -z $(ls -A /var/lib/ceph) 2024-09-13T16:53:20.986 DEBUG:teuthology.orchestra.run.smithi149:> test -z $(ls -A /var/lib/ceph) 2024-09-13T16:53:21.091 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T16:53:21.194 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T16:53:21.213 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-13T16:53:21.213 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-13T16:53:21.213 DEBUG:teuthology.orchestra.run.smithi087:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T16:53:21.214 DEBUG:teuthology.orchestra.run.smithi118:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T16:53:21.214 DEBUG:teuthology.orchestra.run.smithi149:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T16:53:21.231 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:53:21.232 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2024-09-13T16:53:21.233 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:53:21.233 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:53:21.234 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2024-09-13T16:53:21.234 DEBUG:teuthology.orchestra.run.smithi118:> uname -r 2024-09-13T16:53:21.290 INFO:teuthology.orchestra.run.smithi149.stdout:5.14.0-503.el9.x86_64 2024-09-13T16:53:21.290 INFO:teuthology.task.kernel:Running kernel on smithi149: 5.14.0-503.el9.x86_64 2024-09-13T16:53:21.290 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum install -y kernel 2024-09-13T16:53:21.293 INFO:teuthology.orchestra.run.smithi087.stdout:5.14.0-503.el9.x86_64 2024-09-13T16:53:21.293 INFO:teuthology.orchestra.run.smithi118.stdout:5.14.0-503.el9.x86_64 2024-09-13T16:53:21.293 INFO:teuthology.task.kernel:Running kernel on smithi087: 5.14.0-503.el9.x86_64 2024-09-13T16:53:21.293 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum install -y kernel 2024-09-13T16:53:21.293 INFO:teuthology.task.kernel:Running kernel on smithi118: 5.14.0-503.el9.x86_64 2024-09-13T16:53:21.294 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum install -y kernel 2024-09-13T16:53:23.626 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-13T16:53:23.949 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-13T16:53:25.866 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-13T16:53:26.351 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - BaseOS 2.5 MB/s | 8.2 MB 00:03 2024-09-13T16:53:27.126 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - AppStream 8.6 MB/s | 20 MB 00:02 2024-09-13T16:53:30.402 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - AppStream 6.9 MB/s | 20 MB 00:02 2024-09-13T16:53:31.059 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - CRB 4.7 MB/s | 6.5 MB 00:01 2024-09-13T16:53:32.576 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 19 kB 00:00 2024-09-13T16:53:33.027 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 6.5 MB 00:02 2024-09-13T16:53:34.080 INFO:teuthology.orchestra.run.smithi118.stdout:Extra Packages for Enterprise Linux 16 MB/s | 23 MB 00:01 2024-09-13T16:53:34.527 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - Extras packages 67 kB/s | 19 kB 00:00 2024-09-13T16:53:34.736 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-13T16:53:35.481 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-13T16:53:36.529 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 19 kB 00:00 2024-09-13T16:53:37.900 INFO:teuthology.orchestra.run.smithi087.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-13T16:53:39.553 INFO:teuthology.orchestra.run.smithi118.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-13T16:53:40.979 INFO:teuthology.orchestra.run.smithi149.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-13T16:53:41.600 INFO:teuthology.orchestra.run.smithi118.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T16:53:41.600 INFO:teuthology.orchestra.run.smithi118.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T16:53:41.699 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-09-13T16:53:41.710 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-13T16:53:41.710 INFO:teuthology.orchestra.run.smithi118.stdout: Package Architecture Version Repository Size 2024-09-13T16:53:41.710 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-13T16:53:41.710 INFO:teuthology.orchestra.run.smithi118.stdout:Installing: 2024-09-13T16:53:41.710 INFO:teuthology.orchestra.run.smithi118.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T16:53:41.710 INFO:teuthology.orchestra.run.smithi118.stdout:Installing dependencies: 2024-09-13T16:53:41.710 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T16:53:41.710 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T16:53:41.710 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T16:53:41.711 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-13T16:53:41.711 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2024-09-13T16:53:41.711 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-09-13T16:53:41.711 INFO:teuthology.orchestra.run.smithi118.stdout:Install 4 Packages 2024-09-13T16:53:41.711 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-13T16:53:41.711 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 79 M 2024-09-13T16:53:41.711 INFO:teuthology.orchestra.run.smithi118.stdout:Installed size: 126 M 2024-09-13T16:53:41.711 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2024-09-13T16:53:41.829 INFO:teuthology.orchestra.run.smithi118.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 237 kB/s | 23 kB 00:00 2024-09-13T16:53:42.271 INFO:teuthology.orchestra.run.smithi118.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-09-13T16:53:42.754 INFO:teuthology.orchestra.run.smithi118.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 34 MB/s | 35 MB 00:01 2024-09-13T16:53:43.002 INFO:teuthology.orchestra.run.smithi149.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T16:53:43.002 INFO:teuthology.orchestra.run.smithi149.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T16:53:43.029 INFO:teuthology.orchestra.run.smithi118.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 24 MB/s | 29 MB 00:01 2024-09-13T16:53:43.030 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:53:43.030 INFO:teuthology.orchestra.run.smithi118.stdout:Total 60 MB/s | 79 MB 00:01 2024-09-13T16:53:43.093 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-13T16:53:43.099 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T16:53:43.099 INFO:teuthology.orchestra.run.smithi149.stdout: Package Architecture Version Repository Size 2024-09-13T16:53:43.099 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T16:53:43.099 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-13T16:53:43.099 INFO:teuthology.orchestra.run.smithi149.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T16:53:43.099 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-09-13T16:53:43.099 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T16:53:43.099 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T16:53:43.100 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T16:53:43.100 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T16:53:43.100 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-13T16:53:43.100 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T16:53:43.100 INFO:teuthology.orchestra.run.smithi149.stdout:Install 4 Packages 2024-09-13T16:53:43.100 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T16:53:43.100 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 79 M 2024-09-13T16:53:43.101 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 126 M 2024-09-13T16:53:43.101 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-13T16:53:43.288 INFO:teuthology.orchestra.run.smithi149.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 262 kB/s | 23 kB 00:00 2024-09-13T16:53:43.372 INFO:teuthology.orchestra.run.smithi087.stdout:lab-extras 44 kB/s | 1.7 kB 00:00 2024-09-13T16:53:43.711 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2024-09-13T16:53:44.071 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2024-09-13T16:53:44.071 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2024-09-13T16:53:44.380 INFO:teuthology.orchestra.run.smithi149.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 13 MB/s | 16 MB 00:01 2024-09-13T16:53:44.956 INFO:teuthology.orchestra.run.smithi149.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 20 MB/s | 35 MB 00:01 2024-09-13T16:53:45.050 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2024-09-13T16:53:45.050 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2024-09-13T16:53:45.222 INFO:teuthology.orchestra.run.smithi149.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 15 MB/s | 29 MB 00:01 2024-09-13T16:53:45.223 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:53:45.223 INFO:teuthology.orchestra.run.smithi149.stdout:Total 37 MB/s | 79 MB 00:02 2024-09-13T16:53:45.370 INFO:teuthology.orchestra.run.smithi087.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T16:53:45.370 INFO:teuthology.orchestra.run.smithi087.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T16:53:45.471 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-09-13T16:53:45.478 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-13T16:53:45.478 INFO:teuthology.orchestra.run.smithi087.stdout: Package Architecture Version Repository Size 2024-09-13T16:53:45.478 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-13T16:53:45.478 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-09-13T16:53:45.478 INFO:teuthology.orchestra.run.smithi087.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T16:53:45.478 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-09-13T16:53:45.478 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T16:53:45.478 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T16:53:45.478 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T16:53:45.478 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T16:53:45.478 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-09-13T16:53:45.478 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-13T16:53:45.478 INFO:teuthology.orchestra.run.smithi087.stdout:Install 4 Packages 2024-09-13T16:53:45.479 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T16:53:45.479 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 79 M 2024-09-13T16:53:45.479 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 126 M 2024-09-13T16:53:45.479 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-09-13T16:53:45.904 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-13T16:53:46.040 INFO:teuthology.orchestra.run.smithi087.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 43 kB/s | 23 kB 00:00 2024-09-13T16:53:46.279 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-13T16:53:46.280 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-13T16:53:47.007 INFO:teuthology.orchestra.run.smithi087.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 10 MB/s | 16 MB 00:01 2024-09-13T16:53:47.267 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-13T16:53:47.267 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-13T16:53:47.480 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2024-09-13T16:53:47.607 INFO:teuthology.orchestra.run.smithi087.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 16 MB/s | 35 MB 00:02 2024-09-13T16:53:48.157 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T16:53:48.237 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T16:53:48.316 INFO:teuthology.orchestra.run.smithi087.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 13 MB/s | 29 MB 00:02 2024-09-13T16:53:48.316 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-09-13T16:53:48.317 INFO:teuthology.orchestra.run.smithi087.stdout:Total 28 MB/s | 79 MB 00:02 2024-09-13T16:53:49.003 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-09-13T16:53:49.355 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-09-13T16:53:49.355 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-09-13T16:53:49.748 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-13T16:53:50.302 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-09-13T16:53:50.302 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-09-13T16:53:50.447 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T16:53:50.539 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T16:53:51.042 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T16:53:51.168 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T16:53:52.742 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-09-13T16:53:53.372 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T16:53:53.402 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T16:53:53.485 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T16:53:53.518 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T16:53:55.983 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T16:53:56.227 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T16:53:56.282 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T16:53:56.421 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T16:53:58.383 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T16:53:58.460 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T16:54:01.086 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T16:54:01.291 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T16:54:01.404 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T16:54:03.302 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T16:54:06.298 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T16:54:39.626 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T16:54:39.666 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T16:54:39.939 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T16:54:39.939 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T16:54:39.939 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T16:54:39.939 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T16:54:40.792 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T16:54:40.793 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-13T16:54:40.793 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2024-09-13T16:54:40.793 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T16:54:40.793 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T16:54:40.793 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T16:54:40.793 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T16:54:40.793 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-13T16:54:40.793 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-09-13T16:54:41.129 DEBUG:teuthology.orchestra.run.smithi118:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T16:54:41.212 INFO:teuthology.orchestra.run.smithi118.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T16:54:41.212 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T16:54:41.212 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T16:54:41.212 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T16:54:41.212 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T16:54:41.213 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-13T16:54:41.213 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi118.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T16:54:41.213 DEBUG:teuthology.orchestra.run.smithi118:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T16:54:41.272 INFO:teuthology.orchestra.run.smithi118.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T16:54:41.272 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T16:54:41.272 DEBUG:teuthology.orchestra.run.smithi118:> sudo rpm -qi grub2-tools 2024-09-13T16:54:41.304 INFO:teuthology.orchestra.run.smithi118.stdout:Name : grub2-tools 2024-09-13T16:54:41.304 INFO:teuthology.orchestra.run.smithi118.stdout:Epoch : 1 2024-09-13T16:54:41.305 INFO:teuthology.orchestra.run.smithi118.stdout:Version : 2.06 2024-09-13T16:54:41.305 INFO:teuthology.orchestra.run.smithi118.stdout:Release : 82.el9 2024-09-13T16:54:41.305 INFO:teuthology.orchestra.run.smithi118.stdout:Architecture: x86_64 2024-09-13T16:54:41.305 INFO:teuthology.orchestra.run.smithi118.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T16:54:41.305 INFO:teuthology.orchestra.run.smithi118.stdout:Group : Unspecified 2024-09-13T16:54:41.305 INFO:teuthology.orchestra.run.smithi118.stdout:Size : 8274670 2024-09-13T16:54:41.305 INFO:teuthology.orchestra.run.smithi118.stdout:License : GPLv3+ 2024-09-13T16:54:41.305 INFO:teuthology.orchestra.run.smithi118.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T16:54:41.305 INFO:teuthology.orchestra.run.smithi118.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T16:54:41.305 INFO:teuthology.orchestra.run.smithi118.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T16:54:41.305 INFO:teuthology.orchestra.run.smithi118.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T16:54:41.305 INFO:teuthology.orchestra.run.smithi118.stdout:Packager : builder@centos.org 2024-09-13T16:54:41.305 INFO:teuthology.orchestra.run.smithi118.stdout:Vendor : CentOS 2024-09-13T16:54:41.306 INFO:teuthology.orchestra.run.smithi118.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T16:54:41.306 INFO:teuthology.orchestra.run.smithi118.stdout:Summary : Support tools for GRUB. 2024-09-13T16:54:41.306 INFO:teuthology.orchestra.run.smithi118.stdout:Description : 2024-09-13T16:54:41.306 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-13T16:54:41.306 INFO:teuthology.orchestra.run.smithi118.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T16:54:41.306 INFO:teuthology.orchestra.run.smithi118.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T16:54:41.306 INFO:teuthology.orchestra.run.smithi118.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T16:54:41.306 INFO:teuthology.orchestra.run.smithi118.stdout:hardware devices. 2024-09-13T16:54:41.306 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-13T16:54:41.306 INFO:teuthology.orchestra.run.smithi118.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T16:54:41.307 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T16:54:41.307 INFO:teuthology.task.kernel:Updating grub on smithi118 to boot 5.14.0-505.el9.x86_64 2024-09-13T16:54:41.307 DEBUG:teuthology.orchestra.run.smithi118:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T16:54:41.438 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T16:54:41.477 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T16:54:41.824 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T16:54:41.824 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T16:54:41.824 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T16:54:41.825 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T16:54:42.045 INFO:teuthology.orchestra.run.smithi118.stderr:Generating grub configuration file ... 2024-09-13T16:54:42.690 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T16:54:42.690 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T16:54:42.690 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-13T16:54:42.690 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T16:54:42.690 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T16:54:42.690 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T16:54:42.690 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T16:54:42.690 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T16:54:42.690 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-13T16:54:43.063 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T16:54:43.151 INFO:teuthology.orchestra.run.smithi149.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T16:54:43.151 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T16:54:43.151 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T16:54:43.151 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T16:54:43.151 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T16:54:43.151 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2024-09-13T16:54:43.151 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi149.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T16:54:43.151 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T16:54:43.212 INFO:teuthology.orchestra.run.smithi149.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T16:54:43.212 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T16:54:43.212 DEBUG:teuthology.orchestra.run.smithi149:> sudo rpm -qi grub2-tools 2024-09-13T16:54:43.245 INFO:teuthology.orchestra.run.smithi149.stdout:Name : grub2-tools 2024-09-13T16:54:43.245 INFO:teuthology.orchestra.run.smithi149.stdout:Epoch : 1 2024-09-13T16:54:43.245 INFO:teuthology.orchestra.run.smithi149.stdout:Version : 2.06 2024-09-13T16:54:43.245 INFO:teuthology.orchestra.run.smithi149.stdout:Release : 82.el9 2024-09-13T16:54:43.245 INFO:teuthology.orchestra.run.smithi149.stdout:Architecture: x86_64 2024-09-13T16:54:43.245 INFO:teuthology.orchestra.run.smithi149.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T16:54:43.245 INFO:teuthology.orchestra.run.smithi149.stdout:Group : Unspecified 2024-09-13T16:54:43.245 INFO:teuthology.orchestra.run.smithi149.stdout:Size : 8274670 2024-09-13T16:54:43.245 INFO:teuthology.orchestra.run.smithi149.stdout:License : GPLv3+ 2024-09-13T16:54:43.246 INFO:teuthology.orchestra.run.smithi149.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T16:54:43.246 INFO:teuthology.orchestra.run.smithi149.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T16:54:43.246 INFO:teuthology.orchestra.run.smithi149.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T16:54:43.246 INFO:teuthology.orchestra.run.smithi149.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T16:54:43.246 INFO:teuthology.orchestra.run.smithi149.stdout:Packager : builder@centos.org 2024-09-13T16:54:43.246 INFO:teuthology.orchestra.run.smithi149.stdout:Vendor : CentOS 2024-09-13T16:54:43.246 INFO:teuthology.orchestra.run.smithi149.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T16:54:43.246 INFO:teuthology.orchestra.run.smithi149.stdout:Summary : Support tools for GRUB. 2024-09-13T16:54:43.246 INFO:teuthology.orchestra.run.smithi149.stdout:Description : 2024-09-13T16:54:43.246 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T16:54:43.246 INFO:teuthology.orchestra.run.smithi149.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T16:54:43.246 INFO:teuthology.orchestra.run.smithi149.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T16:54:43.246 INFO:teuthology.orchestra.run.smithi149.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T16:54:43.246 INFO:teuthology.orchestra.run.smithi149.stdout:hardware devices. 2024-09-13T16:54:43.247 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T16:54:43.247 INFO:teuthology.orchestra.run.smithi149.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T16:54:43.247 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T16:54:43.248 INFO:teuthology.task.kernel:Updating grub on smithi149 to boot 5.14.0-505.el9.x86_64 2024-09-13T16:54:43.248 DEBUG:teuthology.orchestra.run.smithi149:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T16:54:43.384 INFO:teuthology.orchestra.run.smithi118.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T16:54:43.416 INFO:teuthology.orchestra.run.smithi118.stderr:done 2024-09-13T16:54:43.418 DEBUG:teuthology.orchestra.run.smithi118:> mktemp 2024-09-13T16:54:43.433 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.uGqgzvr9og 2024-09-13T16:54:43.433 DEBUG:teuthology.orchestra.run.smithi118:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.uGqgzvr9og 2024-09-13T16:54:43.500 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.uGqgzvr9og 2024-09-13T16:54:43.646 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.uGqgzvr9og is 6KB 2024-09-13T16:54:43.695 DEBUG:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.uGqgzvr9og 2024-09-13T16:54:43.710 DEBUG:teuthology.orchestra.run.smithi118:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T16:54:43.779 INFO:teuthology.orchestra.run.smithi118.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T16:54:43.779 INFO:teuthology.orchestra.run.smithi118.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T16:54:43.780 INFO:teuthology.orchestra.run.smithi118.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T16:54:43.780 INFO:teuthology.orchestra.run.smithi118.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T16:54:43.781 DEBUG:teuthology.orchestra.run.smithi118:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T16:54:43.893 INFO:teuthology.orchestra.run.smithi149.stderr:Generating grub configuration file ... 2024-09-13T16:54:43.931 DEBUG:teuthology.orchestra.run.smithi118:> sudo shutdown -r now 2024-09-13T16:54:44.691 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T16:54:44.732 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T16:54:45.105 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T16:54:45.105 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T16:54:45.105 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T16:54:45.105 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T16:54:45.285 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[40398]) leaked on vgs invocation. Parent PID 22683: grub2-probe 2024-09-13T16:54:45.285 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[50897]) leaked on vgs invocation. Parent PID 22683: grub2-probe 2024-09-13T16:54:45.317 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[40398]) leaked on vgs invocation. Parent PID 22683: grub2-probe 2024-09-13T16:54:45.317 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[50897]) leaked on vgs invocation. Parent PID 22683: grub2-probe 2024-09-13T16:54:45.489 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[40398]) leaked on vgs invocation. Parent PID 22731: grub2-probe 2024-09-13T16:54:45.489 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[50897]) leaked on vgs invocation. Parent PID 22731: grub2-probe 2024-09-13T16:54:45.524 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[40398]) leaked on vgs invocation. Parent PID 22731: grub2-probe 2024-09-13T16:54:45.524 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[50897]) leaked on vgs invocation. Parent PID 22731: grub2-probe 2024-09-13T16:54:45.662 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[40398]) leaked on vgs invocation. Parent PID 22779: grub2-probe 2024-09-13T16:54:45.662 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[50897]) leaked on vgs invocation. Parent PID 22779: grub2-probe 2024-09-13T16:54:45.701 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[40398]) leaked on vgs invocation. Parent PID 22779: grub2-probe 2024-09-13T16:54:45.701 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[50897]) leaked on vgs invocation. Parent PID 22779: grub2-probe 2024-09-13T16:54:45.852 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[40398]) leaked on vgs invocation. Parent PID 22827: grub2-probe 2024-09-13T16:54:45.852 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[50897]) leaked on vgs invocation. Parent PID 22827: grub2-probe 2024-09-13T16:54:45.883 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[40398]) leaked on vgs invocation. Parent PID 22827: grub2-probe 2024-09-13T16:54:45.883 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[50897]) leaked on vgs invocation. Parent PID 22827: grub2-probe 2024-09-13T16:54:45.917 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T16:54:45.918 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T16:54:45.918 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-09-13T16:54:45.918 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T16:54:45.918 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T16:54:45.918 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T16:54:45.918 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T16:54:45.918 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T16:54:45.918 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-09-13T16:54:46.091 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[40398]) leaked on vgs invocation. Parent PID 22875: grub2-probe 2024-09-13T16:54:46.091 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[50897]) leaked on vgs invocation. Parent PID 22875: grub2-probe 2024-09-13T16:54:46.121 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[40398]) leaked on vgs invocation. Parent PID 22875: grub2-probe 2024-09-13T16:54:46.121 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[50897]) leaked on vgs invocation. Parent PID 22875: grub2-probe 2024-09-13T16:54:46.279 DEBUG:teuthology.orchestra.run.smithi087:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T16:54:46.280 INFO:teuthology.orchestra.run.smithi149.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T16:54:46.303 INFO:teuthology.orchestra.run.smithi149.stderr:done 2024-09-13T16:54:46.306 DEBUG:teuthology.orchestra.run.smithi149:> mktemp 2024-09-13T16:54:46.324 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.hFvAzovRl4 2024-09-13T16:54:46.325 DEBUG:teuthology.orchestra.run.smithi149:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.hFvAzovRl4 2024-09-13T16:54:46.368 INFO:teuthology.orchestra.run.smithi087.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T16:54:46.368 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T16:54:46.369 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T16:54:46.369 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T16:54:46.369 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T16:54:46.369 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-13T16:54:46.369 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi087.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T16:54:46.369 DEBUG:teuthology.orchestra.run.smithi087:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T16:54:46.427 INFO:teuthology.orchestra.run.smithi087.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T16:54:46.428 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T16:54:46.428 DEBUG:teuthology.orchestra.run.smithi087:> sudo rpm -qi grub2-tools 2024-09-13T16:54:46.429 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0666 /tmp/tmp.hFvAzovRl4 2024-09-13T16:54:46.470 INFO:teuthology.orchestra.run.smithi087.stdout:Name : grub2-tools 2024-09-13T16:54:46.470 INFO:teuthology.orchestra.run.smithi087.stdout:Epoch : 1 2024-09-13T16:54:46.470 INFO:teuthology.orchestra.run.smithi087.stdout:Version : 2.06 2024-09-13T16:54:46.470 INFO:teuthology.orchestra.run.smithi087.stdout:Release : 82.el9 2024-09-13T16:54:46.470 INFO:teuthology.orchestra.run.smithi087.stdout:Architecture: x86_64 2024-09-13T16:54:46.470 INFO:teuthology.orchestra.run.smithi087.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T16:54:46.470 INFO:teuthology.orchestra.run.smithi087.stdout:Group : Unspecified 2024-09-13T16:54:46.471 INFO:teuthology.orchestra.run.smithi087.stdout:Size : 8274670 2024-09-13T16:54:46.471 INFO:teuthology.orchestra.run.smithi087.stdout:License : GPLv3+ 2024-09-13T16:54:46.471 INFO:teuthology.orchestra.run.smithi087.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T16:54:46.471 INFO:teuthology.orchestra.run.smithi087.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T16:54:46.471 INFO:teuthology.orchestra.run.smithi087.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T16:54:46.471 INFO:teuthology.orchestra.run.smithi087.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T16:54:46.471 INFO:teuthology.orchestra.run.smithi087.stdout:Packager : builder@centos.org 2024-09-13T16:54:46.471 INFO:teuthology.orchestra.run.smithi087.stdout:Vendor : CentOS 2024-09-13T16:54:46.471 INFO:teuthology.orchestra.run.smithi087.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T16:54:46.471 INFO:teuthology.orchestra.run.smithi087.stdout:Summary : Support tools for GRUB. 2024-09-13T16:54:46.471 INFO:teuthology.orchestra.run.smithi087.stdout:Description : 2024-09-13T16:54:46.471 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T16:54:46.471 INFO:teuthology.orchestra.run.smithi087.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T16:54:46.471 INFO:teuthology.orchestra.run.smithi087.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T16:54:46.471 INFO:teuthology.orchestra.run.smithi087.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T16:54:46.472 INFO:teuthology.orchestra.run.smithi087.stdout:hardware devices. 2024-09-13T16:54:46.472 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T16:54:46.472 INFO:teuthology.orchestra.run.smithi087.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T16:54:46.473 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T16:54:46.473 INFO:teuthology.task.kernel:Updating grub on smithi087 to boot 5.14.0-505.el9.x86_64 2024-09-13T16:54:46.473 DEBUG:teuthology.orchestra.run.smithi087:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T16:54:46.520 DEBUG:teuthology.orchestra.remote:smithi149:/tmp/tmp.hFvAzovRl4 is 6KB 2024-09-13T16:54:46.568 DEBUG:teuthology.orchestra.run.smithi149:> rm -fr /tmp/tmp.hFvAzovRl4 2024-09-13T16:54:46.583 DEBUG:teuthology.orchestra.run.smithi149:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T16:54:46.646 INFO:teuthology.orchestra.run.smithi149.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T16:54:46.646 INFO:teuthology.orchestra.run.smithi149.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T16:54:46.646 INFO:teuthology.orchestra.run.smithi149.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T16:54:46.647 INFO:teuthology.orchestra.run.smithi149.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T16:54:46.648 DEBUG:teuthology.orchestra.run.smithi149:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T16:54:46.803 DEBUG:teuthology.orchestra.run.smithi149:> sudo shutdown -r now 2024-09-13T16:54:47.129 INFO:teuthology.orchestra.run.smithi087.stderr:Generating grub configuration file ... 2024-09-13T16:54:48.456 INFO:teuthology.orchestra.run.smithi087.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T16:54:48.483 INFO:teuthology.orchestra.run.smithi087.stderr:done 2024-09-13T16:54:48.486 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2024-09-13T16:54:48.529 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.VVmYr0oW0e 2024-09-13T16:54:48.530 DEBUG:teuthology.orchestra.run.smithi087:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.VVmYr0oW0e 2024-09-13T16:54:48.614 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.VVmYr0oW0e 2024-09-13T16:54:48.772 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.VVmYr0oW0e is 6KB 2024-09-13T16:54:48.798 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.VVmYr0oW0e 2024-09-13T16:54:48.813 DEBUG:teuthology.orchestra.run.smithi087:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T16:54:48.877 INFO:teuthology.orchestra.run.smithi087.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T16:54:48.877 INFO:teuthology.orchestra.run.smithi087.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T16:54:48.877 INFO:teuthology.orchestra.run.smithi087.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T16:54:48.877 INFO:teuthology.orchestra.run.smithi087.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T16:54:48.878 DEBUG:teuthology.orchestra.run.smithi087:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T16:54:49.023 DEBUG:teuthology.orchestra.run.smithi087:> sudo shutdown -r now 2024-09-13T16:55:13.957 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-13T16:55:13.958 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-09-13T16:55:13.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:55:16.808 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-09-13T16:55:16.808 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-13T16:55:16.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:55:19.028 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-13T16:55:19.029 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-13T16:55:19.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:55:32.413 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-09-13T16:55:35.233 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-09-13T16:55:41.420 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-09-13T16:55:41.421 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:55:44.237 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-13T16:55:44.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:55:44.509 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-09-13T16:55:47.325 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-09-13T16:55:56.517 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-09-13T16:55:56.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:55:59.326 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-13T16:55:59.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:56:19.081 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T16:56:28.089 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-13T16:56:28.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:56:28.473 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-09-13T16:56:28.851 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-13T16:56:28.851 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-13T16:56:28.852 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2024-09-13T16:56:28.866 INFO:teuthology.orchestra.run.smithi087.stdout:5.14.0-505.el9.x86_64 2024-09-13T16:56:28.867 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T16:56:28.867 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T16:56:28.867 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T16:56:29.868 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-13T16:56:29.868 DEBUG:teuthology.orchestra.run.smithi087:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T16:56:29.950 INFO:teuthology.orchestra.run.smithi087.stdout:ttyS1 2024-09-13T16:56:29.972 DEBUG:teuthology.parallel:result is None 2024-09-13T16:56:31.121 DEBUG:teuthology.orchestra.run.smithi149:> true 2024-09-13T16:56:31.543 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-13T16:56:31.742 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-505.el9.x86_64"... 2024-09-13T16:56:31.743 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2024-09-13T16:56:31.759 INFO:teuthology.orchestra.run.smithi149.stdout:5.14.0-505.el9.x86_64 2024-09-13T16:56:31.760 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T16:56:31.760 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T16:56:31.760 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T16:56:32.761 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-09-13T16:56:32.761 DEBUG:teuthology.orchestra.run.smithi149:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T16:56:32.856 INFO:teuthology.orchestra.run.smithi149.stdout:ttyS1 2024-09-13T16:56:32.889 DEBUG:teuthology.parallel:result is None 2024-09-13T16:56:56.533 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T16:57:11.534 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-09-13T16:57:11.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T16:57:11.998 DEBUG:teuthology.orchestra.run.smithi118:> true 2024-09-13T16:57:12.357 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-09-13T16:57:12.357 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-13T16:57:12.357 DEBUG:teuthology.orchestra.run.smithi118:> uname -r 2024-09-13T16:57:12.375 INFO:teuthology.orchestra.run.smithi118.stdout:5.14.0-505.el9.x86_64 2024-09-13T16:57:12.376 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T16:57:12.376 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T16:57:12.376 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T16:57:13.376 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-13T16:57:13.377 DEBUG:teuthology.orchestra.run.smithi118:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T16:57:13.447 INFO:teuthology.orchestra.run.smithi118.stdout:ttyS1 2024-09-13T16:57:13.468 DEBUG:teuthology.parallel:result is None 2024-09-13T16:57:13.469 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T16:57:13.477 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T16:57:13.478 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T16:57:13.481 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T16:57:13.484 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T16:57:13.504 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T16:57:13.512 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T16:57:13.520 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T16:57:13.520 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T16:57:13.542 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T16:57:13.544 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T16:57:13.607 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T16:57:13.620 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T16:57:13.620 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T16:57:13.623 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T16:57:13.625 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T16:57:13.658 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T16:57:13.660 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T16:57:13.662 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T16:57:13.669 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T16:57:13.673 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T16:57:13.674 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T16:57:13.676 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T16:57:13.685 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T16:57:13.685 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T16:57:13.719 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T16:57:13.722 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T16:57:13.749 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T16:57:13.763 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T16:57:13.763 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T16:57:13.789 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T16:57:13.791 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T16:57:13.807 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T16:57:13.896 DEBUG:teuthology.orchestra.run.smithi087:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T16:57:13.937 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T16:57:14.026 DEBUG:teuthology.orchestra.run.smithi087:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T16:57:14.060 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T16:57:14.060 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T16:57:14.126 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T16:57:14.181 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T16:57:14.229 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T16:57:14.323 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T16:57:14.358 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-13T16:57:14.358 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T16:57:14.425 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T16:57:14.478 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T16:57:14.535 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T16:57:14.586 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T16:57:14.621 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-13T16:57:14.621 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T16:57:14.688 DEBUG:teuthology.orchestra.run.smithi087:> sudo service rsyslog restart 2024-09-13T16:57:14.692 DEBUG:teuthology.orchestra.run.smithi118:> sudo service rsyslog restart 2024-09-13T16:57:14.695 DEBUG:teuthology.orchestra.run.smithi149:> sudo service rsyslog restart 2024-09-13T16:57:14.739 INFO:teuthology.orchestra.run.smithi118.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T16:57:14.744 INFO:teuthology.orchestra.run.smithi087.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T16:57:14.777 INFO:teuthology.orchestra.run.smithi149.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T16:57:15.145 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T16:57:15.153 INFO:teuthology.task.internal:Starting timer... 2024-09-13T16:57:15.153 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T16:57:15.169 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T16:57:15.181 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-13T16:57:15.181 DEBUG:teuthology.orchestra.run.smithi087:> sudo service auditd rotate 2024-09-13T16:57:15.245 INFO:teuthology.orchestra.run.smithi087.stdout:Rotating logs: 2024-09-13T16:57:15.247 DEBUG:teuthology.orchestra.run.smithi118:> sudo service auditd rotate 2024-09-13T16:57:15.314 INFO:teuthology.orchestra.run.smithi118.stdout:Rotating logs: 2024-09-13T16:57:15.316 DEBUG:teuthology.orchestra.run.smithi149:> sudo service auditd rotate 2024-09-13T16:57:15.369 INFO:teuthology.orchestra.run.smithi149.stdout:Rotating logs: 2024-09-13T16:57:15.371 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T16:57:15.371 DEBUG:teuthology.orchestra.run.smithi087:> /usr/sbin/getenforce 2024-09-13T16:57:15.393 INFO:teuthology.orchestra.run.smithi087.stdout:Permissive 2024-09-13T16:57:15.393 DEBUG:teuthology.orchestra.run.smithi118:> /usr/sbin/getenforce 2024-09-13T16:57:15.426 INFO:teuthology.orchestra.run.smithi118.stdout:Permissive 2024-09-13T16:57:15.426 DEBUG:teuthology.orchestra.run.smithi149:> /usr/sbin/getenforce 2024-09-13T16:57:15.446 INFO:teuthology.orchestra.run.smithi149.stdout:Permissive 2024-09-13T16:57:15.446 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi087.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi118.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi149.front.sepia.ceph.com': 'permissive'} 2024-09-13T16:57:15.447 DEBUG:teuthology.orchestra.run.smithi087:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T16:57:15.474 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:57:15.474 DEBUG:teuthology.orchestra.run.smithi118:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T16:57:15.505 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:57:15.506 DEBUG:teuthology.orchestra.run.smithi149:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T16:57:15.533 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T16:57:15.533 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T16:57:15.534 DEBUG:teuthology.orchestra.run.smithi087:> sudo /usr/sbin/setenforce permissive 2024-09-13T16:57:15.571 DEBUG:teuthology.orchestra.run.smithi118:> sudo /usr/sbin/setenforce permissive 2024-09-13T16:57:15.605 DEBUG:teuthology.orchestra.run.smithi149:> sudo /usr/sbin/setenforce permissive 2024-09-13T16:57:15.639 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T16:57:15.649 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T16:57:15.661 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T16:57:15.662 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi087.front.sepia.ceph.com,smithi118.front.sepia.ceph.com,smithi149.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T17:01:12.662 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi087.front.sepia.ceph.com'), Remote(name='ubuntu@smithi118.front.sepia.ceph.com'), Remote(name='ubuntu@smithi149.front.sepia.ceph.com')] 2024-09-13T17:01:12.664 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-13T17:01:12.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:01:12.752 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-09-13T17:01:12.832 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-13T17:01:12.833 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-09-13T17:01:12.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:01:12.919 DEBUG:teuthology.orchestra.run.smithi118:> true 2024-09-13T17:01:13.003 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-09-13T17:01:13.003 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-13T17:01:13.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:01:13.090 DEBUG:teuthology.orchestra.run.smithi149:> true 2024-09-13T17:01:13.170 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-13T17:01:13.171 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T17:01:13.182 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T17:01:13.182 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T17:01:13.182 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T17:01:13.185 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T17:01:13.185 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T17:01:13.187 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T17:01:13.187 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T17:01:13.214 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T17:01:13.219 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T17:01:13.230 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T17:01:13.234 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T17:01:13.242 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T17:01:13.255 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: ntpd: command not found 2024-09-13T17:01:13.257 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T17:01:13.261 INFO:teuthology.orchestra.run.smithi118.stderr:sudo: ntpd: command not found 2024-09-13T17:01:13.267 INFO:teuthology.orchestra.run.smithi087.stdout:506 Cannot talk to daemon 2024-09-13T17:01:13.273 INFO:teuthology.orchestra.run.smithi118.stdout:506 Cannot talk to daemon 2024-09-13T17:01:13.281 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T17:01:13.282 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: ntpd: command not found 2024-09-13T17:01:13.288 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T17:01:13.294 INFO:teuthology.orchestra.run.smithi149.stdout:506 Cannot talk to daemon 2024-09-13T17:01:13.296 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T17:01:13.302 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T17:01:13.309 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T17:01:13.323 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T17:01:13.357 INFO:teuthology.orchestra.run.smithi087.stderr:bash: line 1: ntpq: command not found 2024-09-13T17:01:13.360 INFO:teuthology.orchestra.run.smithi118.stderr:bash: line 1: ntpq: command not found 2024-09-13T17:01:13.360 INFO:teuthology.orchestra.run.smithi087.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T17:01:13.360 INFO:teuthology.orchestra.run.smithi087.stdout:=============================================================================== 2024-09-13T17:01:13.361 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:01:13.361 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:01:13.361 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:01:13.361 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:01:13.363 INFO:teuthology.orchestra.run.smithi118.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T17:01:13.363 INFO:teuthology.orchestra.run.smithi118.stdout:=============================================================================== 2024-09-13T17:01:13.363 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:01:13.363 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:01:13.363 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:01:13.363 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:01:13.380 INFO:teuthology.orchestra.run.smithi149.stderr:bash: line 1: ntpq: command not found 2024-09-13T17:01:13.383 INFO:teuthology.orchestra.run.smithi149.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T17:01:13.383 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================== 2024-09-13T17:01:13.383 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:01:13.383 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:01:13.383 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:01:13.383 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:01:13.384 INFO:teuthology.run_tasks:Running task install... 2024-09-13T17:01:13.393 DEBUG:teuthology.task.install:project ceph 2024-09-13T17:01:13.393 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}} 2024-09-13T17:01:13.393 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'} 2024-09-13T17:01:13.394 INFO:teuthology.task.install:Using flavor: default 2024-09-13T17:01:13.399 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T17:01:13.399 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-09-13T17:01:13.400 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'tag': None, 'wait_for_package': False} 2024-09-13T17:01:13.400 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:01:13.403 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'tag': None, 'wait_for_package': False} 2024-09-13T17:01:13.403 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:01:13.404 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'tag': None, 'wait_for_package': False} 2024-09-13T17:01:13.404 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:01:13.561 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/ 2024-09-13T17:01:13.561 INFO:teuthology.task.install.rpm:Package version is 18.2.4-860.g6c6b083f 2024-09-13T17:01:13.573 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/ 2024-09-13T17:01:13.573 INFO:teuthology.task.install.rpm:Package version is 18.2.4-860.g6c6b083f 2024-09-13T17:01:13.575 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/ 2024-09-13T17:01:13.575 INFO:teuthology.task.install.rpm:Package version is 18.2.4-860.g6c6b083f 2024-09-13T17:01:13.681 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T17:01:13.681 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T17:01:13.681 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T17:01:13.691 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T17:01:13.692 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-13T17:01:13.692 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T17:01:13.702 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T17:01:13.702 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-13T17:01:13.702 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T17:01:13.706 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-13T17:01:13.707 DEBUG:teuthology.orchestra.run.smithi087:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T17:01:13.718 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-13T17:01:13.718 DEBUG:teuthology.orchestra.run.smithi149:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T17:01:13.728 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-13T17:01:13.728 DEBUG:teuthology.orchestra.run.smithi118:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T17:01:13.773 DEBUG:teuthology.orchestra.run.smithi087:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T17:01:13.785 DEBUG:teuthology.orchestra.run.smithi149:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T17:01:13.793 DEBUG:teuthology.orchestra.run.smithi118:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T17:01:13.848 DEBUG:teuthology.orchestra.run.smithi087:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T17:01:13.860 DEBUG:teuthology.orchestra.run.smithi149:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T17:01:13.867 DEBUG:teuthology.orchestra.run.smithi118:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T17:01:13.911 INFO:teuthology.orchestra.run.smithi087.stdout:check_obsoletes = 1 2024-09-13T17:01:13.913 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum clean all 2024-09-13T17:01:13.924 INFO:teuthology.orchestra.run.smithi149.stdout:check_obsoletes = 1 2024-09-13T17:01:13.925 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum clean all 2024-09-13T17:01:13.931 INFO:teuthology.orchestra.run.smithi118.stdout:check_obsoletes = 1 2024-09-13T17:01:13.932 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum clean all 2024-09-13T17:01:14.157 INFO:teuthology.orchestra.run.smithi118.stdout:45 files removed 2024-09-13T17:01:14.158 INFO:teuthology.orchestra.run.smithi149.stdout:45 files removed 2024-09-13T17:01:14.172 INFO:teuthology.orchestra.run.smithi087.stdout:45 files removed 2024-09-13T17:01:14.185 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-13T17:01:14.188 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-13T17:01:14.200 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-13T17:01:14.738 INFO:teuthology.orchestra.run.smithi118.stdout:ceph packages for x86_64 291 kB/s | 78 kB 00:00 2024-09-13T17:01:14.747 INFO:teuthology.orchestra.run.smithi087.stdout:ceph packages for x86_64 296 kB/s | 78 kB 00:00 2024-09-13T17:01:14.759 INFO:teuthology.orchestra.run.smithi149.stdout:ceph packages for x86_64 279 kB/s | 78 kB 00:00 2024-09-13T17:01:15.021 INFO:teuthology.orchestra.run.smithi118.stdout:ceph noarch packages 48 kB/s | 11 kB 00:00 2024-09-13T17:01:15.023 INFO:teuthology.orchestra.run.smithi087.stdout:ceph noarch packages 49 kB/s | 11 kB 00:00 2024-09-13T17:01:15.043 INFO:teuthology.orchestra.run.smithi149.stdout:ceph noarch packages 48 kB/s | 11 kB 00:00 2024-09-13T17:01:15.282 INFO:teuthology.orchestra.run.smithi087.stdout:ceph source packages 8.3 kB/s | 1.9 kB 00:00 2024-09-13T17:01:15.297 INFO:teuthology.orchestra.run.smithi118.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-13T17:01:15.319 INFO:teuthology.orchestra.run.smithi149.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-13T17:01:16.244 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - BaseOS 9.3 MB/s | 8.2 MB 00:00 2024-09-13T17:01:16.472 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - BaseOS 7.2 MB/s | 8.2 MB 00:01 2024-09-13T17:01:17.798 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - BaseOS 3.3 MB/s | 8.2 MB 00:02 2024-09-13T17:01:18.465 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-13T17:01:23.841 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 6.5 MB 00:01 2024-09-13T17:01:25.359 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 19 kB 00:00 2024-09-13T17:01:25.636 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - AppStream 2.5 MB/s | 20 MB 00:08 2024-09-13T17:01:26.497 INFO:teuthology.orchestra.run.smithi118.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-13T17:01:27.069 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - AppStream 2.5 MB/s | 20 MB 00:08 2024-09-13T17:01:30.604 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - CRB 5.7 MB/s | 6.5 MB 00:01 2024-09-13T17:01:31.325 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-13T17:01:33.072 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 19 kB 00:01 2024-09-13T17:01:35.034 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - Extras packages 7.5 kB/s | 19 kB 00:02 2024-09-13T17:01:36.059 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 7.9 MB/s | 23 MB 00:02 2024-09-13T17:01:36.405 INFO:teuthology.orchestra.run.smithi087.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-13T17:01:38.060 INFO:teuthology.orchestra.run.smithi118.stdout:lab-extras 278 B/s | 1.7 kB 00:06 2024-09-13T17:01:40.487 INFO:teuthology.orchestra.run.smithi118.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T17:01:40.488 INFO:teuthology.orchestra.run.smithi118.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T17:01:40.498 INFO:teuthology.orchestra.run.smithi118.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-13T17:01:40.499 INFO:teuthology.orchestra.run.smithi118.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-13T17:01:40.500 INFO:teuthology.orchestra.run.smithi118.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-13T17:01:40.501 INFO:teuthology.orchestra.run.smithi118.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-13T17:01:40.503 INFO:teuthology.orchestra.run.smithi118.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-13T17:01:40.505 INFO:teuthology.orchestra.run.smithi118.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-13T17:01:40.506 INFO:teuthology.orchestra.run.smithi118.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-13T17:01:40.565 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-09-13T17:01:40.594 INFO:teuthology.orchestra.run.smithi118.stdout:====================================================================================== 2024-09-13T17:01:40.594 INFO:teuthology.orchestra.run.smithi118.stdout: Package Arch Version Repository Size 2024-09-13T17:01:40.594 INFO:teuthology.orchestra.run.smithi118.stdout:====================================================================================== 2024-09-13T17:01:40.594 INFO:teuthology.orchestra.run.smithi118.stdout:Installing: 2024-09-13T17:01:40.594 INFO:teuthology.orchestra.run.smithi118.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-13T17:01:40.594 INFO:teuthology.orchestra.run.smithi118.stdout: ceph x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 6.5 k 2024-09-13T17:01:40.594 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 5.1 M 2024-09-13T17:01:40.595 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 852 k 2024-09-13T17:01:40.595 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 142 k 2024-09-13T17:01:40.595 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 1.5 M 2024-09-13T17:01:40.595 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 139 k 2024-09-13T17:01:40.595 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-dashboard noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 3.5 M 2024-09-13T17:01:40.595 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 7.4 M 2024-09-13T17:01:40.595 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-rook noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 49 k 2024-09-13T17:01:40.595 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-radosgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 7.7 M 2024-09-13T17:01:40.595 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-test x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 40 M 2024-09-13T17:01:40.595 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-volume noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 264 k 2024-09-13T17:01:40.595 INFO:teuthology.orchestra.run.smithi118.stdout: cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 226 k 2024-09-13T17:01:40.595 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 224 k 2024-09-13T17:01:40.595 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-top noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 18 k 2024-09-13T17:01:40.596 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-13T17:01:40.596 INFO:teuthology.orchestra.run.smithi118.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-13T17:01:40.596 INFO:teuthology.orchestra.run.smithi118.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-13T17:01:40.596 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 31 k 2024-09-13T17:01:40.596 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 712 k 2024-09-13T17:01:40.596 INFO:teuthology.orchestra.run.smithi118.stdout: librados-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 127 k 2024-09-13T17:01:40.596 INFO:teuthology.orchestra.run.smithi118.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-13T17:01:40.596 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-13T17:01:40.596 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-13T17:01:40.596 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-13T17:01:40.596 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-13T17:01:40.597 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-13T17:01:40.597 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cephfs x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 162 k 2024-09-13T17:01:40.597 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rados x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 321 k 2024-09-13T17:01:40.597 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 301 k 2024-09-13T17:01:40.597 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 99 k 2024-09-13T17:01:40.597 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 87 k 2024-09-13T17:01:40.597 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T17:01:40.597 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-nbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 172 k 2024-09-13T17:01:40.597 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-13T17:01:40.597 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrading: 2024-09-13T17:01:40.597 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-13T17:01:40.597 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-13T17:01:40.597 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-13T17:01:40.598 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-13T17:01:40.598 INFO:teuthology.orchestra.run.smithi118.stdout: librados2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.3 M 2024-09-13T17:01:40.598 INFO:teuthology.orchestra.run.smithi118.stdout: librbd1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T17:01:40.598 INFO:teuthology.orchestra.run.smithi118.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-13T17:01:40.598 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-13T17:01:40.598 INFO:teuthology.orchestra.run.smithi118.stdout:Installing dependencies: 2024-09-13T17:01:40.598 INFO:teuthology.orchestra.run.smithi118.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-13T17:01:40.598 INFO:teuthology.orchestra.run.smithi118.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T17:01:40.598 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 18 M 2024-09-13T17:01:40.598 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-grafana-dashboards noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 24 k 2024-09-13T17:01:40.598 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mds x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 2.1 M 2024-09-13T17:01:40.598 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-modules-core noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 246 k 2024-09-13T17:01:40.598 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mon x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.7 M 2024-09-13T17:01:40.599 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-osd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 17 M 2024-09-13T17:01:40.599 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-prometheus-alerts noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 16 k 2024-09-13T17:01:40.599 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-selinux x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 25 k 2024-09-13T17:01:40.599 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T17:01:40.599 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T17:01:40.599 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T17:01:40.599 INFO:teuthology.orchestra.run.smithi118.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T17:01:40.599 INFO:teuthology.orchestra.run.smithi118.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T17:01:40.599 INFO:teuthology.orchestra.run.smithi118.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T17:01:40.599 INFO:teuthology.orchestra.run.smithi118.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T17:01:40.599 INFO:teuthology.orchestra.run.smithi118.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T17:01:40.599 INFO:teuthology.orchestra.run.smithi118.stdout: libcephsqlite x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 166 k 2024-09-13T17:01:40.599 INFO:teuthology.orchestra.run.smithi118.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T17:01:40.600 INFO:teuthology.orchestra.run.smithi118.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T17:01:40.600 INFO:teuthology.orchestra.run.smithi118.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T17:01:40.600 INFO:teuthology.orchestra.run.smithi118.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T17:01:40.600 INFO:teuthology.orchestra.run.smithi118.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T17:01:40.600 INFO:teuthology.orchestra.run.smithi118.stdout: libradosstriper1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 478 k 2024-09-13T17:01:40.600 INFO:teuthology.orchestra.run.smithi118.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T17:01:40.600 INFO:teuthology.orchestra.run.smithi118.stdout: librgw2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.5 M 2024-09-13T17:01:40.600 INFO:teuthology.orchestra.run.smithi118.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T17:01:40.600 INFO:teuthology.orchestra.run.smithi118.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-13T17:01:40.600 INFO:teuthology.orchestra.run.smithi118.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T17:01:40.600 INFO:teuthology.orchestra.run.smithi118.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T17:01:40.600 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T17:01:40.601 INFO:teuthology.orchestra.run.smithi118.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T17:01:40.601 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-13T17:01:40.601 INFO:teuthology.orchestra.run.smithi118.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T17:01:40.601 INFO:teuthology.orchestra.run.smithi118.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T17:01:40.601 INFO:teuthology.orchestra.run.smithi118.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T17:01:40.601 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T17:01:40.601 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 45 k 2024-09-13T17:01:40.601 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 129 k 2024-09-13T17:01:40.601 INFO:teuthology.orchestra.run.smithi118.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T17:01:40.601 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T17:01:40.601 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T17:01:40.601 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T17:01:40.601 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T17:01:40.601 INFO:teuthology.orchestra.run.smithi118.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T17:01:40.602 INFO:teuthology.orchestra.run.smithi118.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T17:01:40.602 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T17:01:40.602 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T17:01:40.602 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T17:01:40.602 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T17:01:40.602 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T17:01:40.602 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T17:01:40.602 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T17:01:40.602 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T17:01:40.602 INFO:teuthology.orchestra.run.smithi118.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T17:01:40.602 INFO:teuthology.orchestra.run.smithi118.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T17:01:40.602 INFO:teuthology.orchestra.run.smithi118.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T17:01:40.603 INFO:teuthology.orchestra.run.smithi118.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T17:01:40.603 INFO:teuthology.orchestra.run.smithi118.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T17:01:40.603 INFO:teuthology.orchestra.run.smithi118.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T17:01:40.603 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T17:01:40.603 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T17:01:40.603 INFO:teuthology.orchestra.run.smithi118.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T17:01:40.603 INFO:teuthology.orchestra.run.smithi118.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T17:01:40.603 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T17:01:40.603 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T17:01:40.603 INFO:teuthology.orchestra.run.smithi118.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T17:01:40.603 INFO:teuthology.orchestra.run.smithi118.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T17:01:40.603 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T17:01:40.603 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T17:01:40.603 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T17:01:40.604 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T17:01:40.604 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T17:01:40.604 INFO:teuthology.orchestra.run.smithi118.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T17:01:40.604 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T17:01:40.604 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T17:01:40.604 INFO:teuthology.orchestra.run.smithi118.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T17:01:40.604 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T17:01:40.604 INFO:teuthology.orchestra.run.smithi118.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T17:01:40.604 INFO:teuthology.orchestra.run.smithi118.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T17:01:40.604 INFO:teuthology.orchestra.run.smithi118.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T17:01:40.604 INFO:teuthology.orchestra.run.smithi118.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T17:01:40.604 INFO:teuthology.orchestra.run.smithi118.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T17:01:40.604 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T17:01:40.605 INFO:teuthology.orchestra.run.smithi118.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T17:01:40.605 INFO:teuthology.orchestra.run.smithi118.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T17:01:40.605 INFO:teuthology.orchestra.run.smithi118.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T17:01:40.605 INFO:teuthology.orchestra.run.smithi118.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T17:01:40.605 INFO:teuthology.orchestra.run.smithi118.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T17:01:40.605 INFO:teuthology.orchestra.run.smithi118.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T17:01:40.605 INFO:teuthology.orchestra.run.smithi118.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-13T17:01:40.605 INFO:teuthology.orchestra.run.smithi118.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T17:01:40.605 INFO:teuthology.orchestra.run.smithi118.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-13T17:01:40.605 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-13T17:01:40.605 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2024-09-13T17:01:40.605 INFO:teuthology.orchestra.run.smithi118.stdout:====================================================================================== 2024-09-13T17:01:40.605 INFO:teuthology.orchestra.run.smithi118.stdout:Install 130 Packages 2024-09-13T17:01:40.606 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrade 8 Packages 2024-09-13T17:01:40.606 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-13T17:01:40.606 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 203 M 2024-09-13T17:01:40.606 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2024-09-13T17:01:41.287 INFO:teuthology.orchestra.run.smithi118.stdout:(1/138): ceph-18.2.4-860.g6c6b083f.el9.x86_64.r 48 kB/s | 6.5 kB 00:00 2024-09-13T17:01:41.528 INFO:teuthology.orchestra.run.smithi118.stdout:(2/138): ceph-fuse-18.2.4-860.g6c6b083f.el9.x86 3.4 MB/s | 852 kB 00:00 2024-09-13T17:01:41.556 INFO:teuthology.orchestra.run.smithi149.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-13T17:01:41.629 INFO:teuthology.orchestra.run.smithi118.stdout:(3/138): ceph-base-18.2.4-860.g6c6b083f.el9.x86 11 MB/s | 5.1 MB 00:00 2024-09-13T17:01:41.654 INFO:teuthology.orchestra.run.smithi118.stdout:(4/138): ceph-immutable-object-cache-18.2.4-860 1.1 MB/s | 142 kB 00:00 2024-09-13T17:01:41.721 INFO:teuthology.orchestra.run.smithi118.stdout:(5/138): ceph-mds-18.2.4-860.g6c6b083f.el9.x86_ 23 MB/s | 2.1 MB 00:00 2024-09-13T17:01:41.786 INFO:teuthology.orchestra.run.smithi087.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-09-13T17:01:41.946 INFO:teuthology.orchestra.run.smithi118.stdout:(6/138): ceph-mgr-18.2.4-860.g6c6b083f.el9.x86_ 5.0 MB/s | 1.5 MB 00:00 2024-09-13T17:01:42.122 INFO:teuthology.orchestra.run.smithi118.stdout:(7/138): ceph-common-18.2.4-860.g6c6b083f.el9.x 19 MB/s | 18 MB 00:00 2024-09-13T17:01:42.269 INFO:teuthology.orchestra.run.smithi118.stdout:(8/138): ceph-mon-18.2.4-860.g6c6b083f.el9.x86_ 8.5 MB/s | 4.7 MB 00:00 2024-09-13T17:01:42.335 INFO:teuthology.orchestra.run.smithi118.stdout:(9/138): ceph-selinux-18.2.4-860.g6c6b083f.el9. 428 kB/s | 25 kB 00:00 2024-09-13T17:01:42.481 INFO:teuthology.orchestra.run.smithi118.stdout:(10/138): ceph-radosgw-18.2.4-860.g6c6b083f.el9 22 MB/s | 7.7 MB 00:00 2024-09-13T17:01:42.540 INFO:teuthology.orchestra.run.smithi118.stdout:(11/138): cephfs-mirror-18.2.4-860.g6c6b083f.el 3.8 MB/s | 224 kB 00:00 2024-09-13T17:01:42.607 INFO:teuthology.orchestra.run.smithi118.stdout:(12/138): libcephfs-devel-18.2.4-860.g6c6b083f. 468 kB/s | 31 kB 00:00 2024-09-13T17:01:42.682 INFO:teuthology.orchestra.run.smithi118.stdout:(13/138): libcephfs2-18.2.4-860.g6c6b083f.el9.x 9.3 MB/s | 712 kB 00:00 2024-09-13T17:01:42.757 INFO:teuthology.orchestra.run.smithi118.stdout:(14/138): libcephsqlite-18.2.4-860.g6c6b083f.el 2.2 MB/s | 166 kB 00:00 2024-09-13T17:01:42.824 INFO:teuthology.orchestra.run.smithi118.stdout:(15/138): librados-devel-18.2.4-860.g6c6b083f.e 1.9 MB/s | 127 kB 00:00 2024-09-13T17:01:42.908 INFO:teuthology.orchestra.run.smithi118.stdout:(16/138): libradosstriper1-18.2.4-860.g6c6b083f 5.6 MB/s | 478 kB 00:00 2024-09-13T17:01:43.150 INFO:teuthology.orchestra.run.smithi118.stdout:(17/138): librgw2-18.2.4-860.g6c6b083f.el9.x86_ 18 MB/s | 4.5 MB 00:00 2024-09-13T17:01:43.200 INFO:teuthology.orchestra.run.smithi118.stdout:(18/138): python3-ceph-argparse-18.2.4-860.g6c6 904 kB/s | 45 kB 00:00 2024-09-13T17:01:43.267 INFO:teuthology.orchestra.run.smithi118.stdout:(19/138): python3-ceph-common-18.2.4-860.g6c6b0 1.9 MB/s | 129 kB 00:00 2024-09-13T17:01:43.334 INFO:teuthology.orchestra.run.smithi118.stdout:(20/138): python3-cephfs-18.2.4-860.g6c6b083f.e 2.4 MB/s | 162 kB 00:00 2024-09-13T17:01:43.409 INFO:teuthology.orchestra.run.smithi118.stdout:(21/138): python3-rados-18.2.4-860.g6c6b083f.el 4.2 MB/s | 321 kB 00:00 2024-09-13T17:01:43.835 INFO:teuthology.orchestra.run.smithi118.stdout:(22/138): ceph-test-18.2.4-860.g6c6b083f.el9.x8 26 MB/s | 40 MB 00:01 2024-09-13T17:01:43.860 INFO:teuthology.orchestra.run.smithi118.stdout:(23/138): python3-rbd-18.2.4-860.g6c6b083f.el9. 668 kB/s | 301 kB 00:00 2024-09-13T17:01:43.885 INFO:teuthology.orchestra.run.smithi118.stdout:(24/138): python3-rgw-18.2.4-860.g6c6b083f.el9. 1.9 MB/s | 99 kB 00:00 2024-09-13T17:01:43.911 INFO:teuthology.orchestra.run.smithi118.stdout:(25/138): rbd-fuse-18.2.4-860.g6c6b083f.el9.x86 1.7 MB/s | 87 kB 00:00 2024-09-13T17:01:43.919 INFO:teuthology.orchestra.run.smithi149.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T17:01:43.920 INFO:teuthology.orchestra.run.smithi149.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T17:01:43.932 INFO:teuthology.orchestra.run.smithi149.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-13T17:01:43.933 INFO:teuthology.orchestra.run.smithi149.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-13T17:01:43.934 INFO:teuthology.orchestra.run.smithi149.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-13T17:01:43.935 INFO:teuthology.orchestra.run.smithi149.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-13T17:01:43.937 INFO:teuthology.orchestra.run.smithi149.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-13T17:01:43.940 INFO:teuthology.orchestra.run.smithi149.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-13T17:01:43.941 INFO:teuthology.orchestra.run.smithi149.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-13T17:01:43.978 INFO:teuthology.orchestra.run.smithi118.stdout:(26/138): rbd-nbd-18.2.4-860.g6c6b083f.el9.x86_ 2.5 MB/s | 172 kB 00:00 2024-09-13T17:01:44.002 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-13T17:01:44.018 INFO:teuthology.orchestra.run.smithi149.stdout:====================================================================================== 2024-09-13T17:01:44.018 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-09-13T17:01:44.018 INFO:teuthology.orchestra.run.smithi149.stdout:====================================================================================== 2024-09-13T17:01:44.018 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-13T17:01:44.018 INFO:teuthology.orchestra.run.smithi149.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-13T17:01:44.019 INFO:teuthology.orchestra.run.smithi149.stdout: ceph x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 6.5 k 2024-09-13T17:01:44.019 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 5.1 M 2024-09-13T17:01:44.019 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 852 k 2024-09-13T17:01:44.019 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 142 k 2024-09-13T17:01:44.019 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 1.5 M 2024-09-13T17:01:44.019 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 139 k 2024-09-13T17:01:44.019 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 3.5 M 2024-09-13T17:01:44.019 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 7.4 M 2024-09-13T17:01:44.019 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 49 k 2024-09-13T17:01:44.019 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 7.7 M 2024-09-13T17:01:44.019 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 40 M 2024-09-13T17:01:44.019 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-volume noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 264 k 2024-09-13T17:01:44.019 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 226 k 2024-09-13T17:01:44.019 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 224 k 2024-09-13T17:01:44.020 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-top noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 18 k 2024-09-13T17:01:44.020 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-13T17:01:44.020 INFO:teuthology.orchestra.run.smithi149.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-13T17:01:44.020 INFO:teuthology.orchestra.run.smithi149.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-13T17:01:44.020 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 31 k 2024-09-13T17:01:44.020 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 712 k 2024-09-13T17:01:44.020 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 127 k 2024-09-13T17:01:44.020 INFO:teuthology.orchestra.run.smithi149.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-13T17:01:44.020 INFO:teuthology.orchestra.run.smithi149.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-13T17:01:44.020 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-13T17:01:44.020 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-13T17:01:44.020 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-13T17:01:44.021 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-13T17:01:44.021 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 162 k 2024-09-13T17:01:44.021 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 321 k 2024-09-13T17:01:44.021 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 301 k 2024-09-13T17:01:44.021 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 99 k 2024-09-13T17:01:44.021 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 87 k 2024-09-13T17:01:44.021 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T17:01:44.021 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 172 k 2024-09-13T17:01:44.021 INFO:teuthology.orchestra.run.smithi149.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-13T17:01:44.021 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrading: 2024-09-13T17:01:44.021 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-13T17:01:44.021 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-13T17:01:44.021 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-13T17:01:44.022 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-13T17:01:44.022 INFO:teuthology.orchestra.run.smithi149.stdout: librados2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.3 M 2024-09-13T17:01:44.022 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T17:01:44.022 INFO:teuthology.orchestra.run.smithi149.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-13T17:01:44.022 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-13T17:01:44.022 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-09-13T17:01:44.022 INFO:teuthology.orchestra.run.smithi149.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-13T17:01:44.022 INFO:teuthology.orchestra.run.smithi149.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T17:01:44.022 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 18 M 2024-09-13T17:01:44.022 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 24 k 2024-09-13T17:01:44.022 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 2.1 M 2024-09-13T17:01:44.022 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 246 k 2024-09-13T17:01:44.022 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.7 M 2024-09-13T17:01:44.022 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 17 M 2024-09-13T17:01:44.023 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 16 k 2024-09-13T17:01:44.023 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 25 k 2024-09-13T17:01:44.023 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T17:01:44.023 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T17:01:44.023 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T17:01:44.023 INFO:teuthology.orchestra.run.smithi149.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T17:01:44.023 INFO:teuthology.orchestra.run.smithi149.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T17:01:44.023 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T17:01:44.023 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T17:01:44.023 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T17:01:44.023 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 166 k 2024-09-13T17:01:44.023 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T17:01:44.023 INFO:teuthology.orchestra.run.smithi149.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T17:01:44.024 INFO:teuthology.orchestra.run.smithi149.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T17:01:44.024 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T17:01:44.024 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T17:01:44.024 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 478 k 2024-09-13T17:01:44.024 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T17:01:44.024 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.5 M 2024-09-13T17:01:44.024 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T17:01:44.024 INFO:teuthology.orchestra.run.smithi149.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-13T17:01:44.024 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T17:01:44.024 INFO:teuthology.orchestra.run.smithi149.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T17:01:44.024 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T17:01:44.024 INFO:teuthology.orchestra.run.smithi149.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T17:01:44.024 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-13T17:01:44.025 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T17:01:44.025 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T17:01:44.025 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T17:01:44.025 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T17:01:44.025 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 45 k 2024-09-13T17:01:44.025 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 129 k 2024-09-13T17:01:44.025 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T17:01:44.025 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T17:01:44.025 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T17:01:44.025 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T17:01:44.025 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T17:01:44.025 INFO:teuthology.orchestra.run.smithi149.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T17:01:44.025 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T17:01:44.026 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T17:01:44.026 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T17:01:44.026 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T17:01:44.026 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T17:01:44.026 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T17:01:44.026 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T17:01:44.026 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T17:01:44.026 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T17:01:44.026 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T17:01:44.026 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T17:01:44.026 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T17:01:44.026 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T17:01:44.027 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T17:01:44.027 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T17:01:44.027 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T17:01:44.027 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T17:01:44.027 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T17:01:44.027 INFO:teuthology.orchestra.run.smithi149.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T17:01:44.027 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T17:01:44.027 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T17:01:44.027 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T17:01:44.027 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T17:01:44.027 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T17:01:44.027 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T17:01:44.027 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T17:01:44.027 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T17:01:44.028 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T17:01:44.028 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T17:01:44.028 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T17:01:44.028 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T17:01:44.028 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T17:01:44.028 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T17:01:44.028 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T17:01:44.028 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T17:01:44.028 INFO:teuthology.orchestra.run.smithi149.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T17:01:44.028 INFO:teuthology.orchestra.run.smithi149.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T17:01:44.028 INFO:teuthology.orchestra.run.smithi149.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T17:01:44.029 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T17:01:44.029 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T17:01:44.029 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T17:01:44.029 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T17:01:44.029 INFO:teuthology.orchestra.run.smithi149.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T17:01:44.029 INFO:teuthology.orchestra.run.smithi149.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T17:01:44.029 INFO:teuthology.orchestra.run.smithi149.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T17:01:44.029 INFO:teuthology.orchestra.run.smithi149.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-13T17:01:44.029 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T17:01:44.029 INFO:teuthology.orchestra.run.smithi149.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-13T17:01:44.029 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T17:01:44.029 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-13T17:01:44.029 INFO:teuthology.orchestra.run.smithi149.stdout:====================================================================================== 2024-09-13T17:01:44.029 INFO:teuthology.orchestra.run.smithi149.stdout:Install 130 Packages 2024-09-13T17:01:44.030 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrade 8 Packages 2024-09-13T17:01:44.030 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T17:01:44.030 INFO:teuthology.orchestra.run.smithi118.stdout:(27/138): rbd-mirror-18.2.4-860.g6c6b083f.el9.x 21 MB/s | 3.0 MB 00:00 2024-09-13T17:01:44.030 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 203 M 2024-09-13T17:01:44.031 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-13T17:01:44.053 INFO:teuthology.orchestra.run.smithi118.stdout:(28/138): ceph-grafana-dashboards-18.2.4-860.g6 325 kB/s | 24 kB 00:00 2024-09-13T17:01:44.078 INFO:teuthology.orchestra.run.smithi118.stdout:(29/138): ceph-mgr-cephadm-18.2.4-860.g6c6b083f 2.7 MB/s | 139 kB 00:00 2024-09-13T17:01:44.163 INFO:teuthology.orchestra.run.smithi087.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T17:01:44.164 INFO:teuthology.orchestra.run.smithi087.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T17:01:44.174 INFO:teuthology.orchestra.run.smithi087.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-13T17:01:44.175 INFO:teuthology.orchestra.run.smithi087.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-13T17:01:44.176 INFO:teuthology.orchestra.run.smithi087.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-13T17:01:44.177 INFO:teuthology.orchestra.run.smithi087.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-13T17:01:44.179 INFO:teuthology.orchestra.run.smithi087.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-13T17:01:44.181 INFO:teuthology.orchestra.run.smithi087.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-13T17:01:44.182 INFO:teuthology.orchestra.run.smithi087.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-13T17:01:44.241 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-09-13T17:01:44.259 INFO:teuthology.orchestra.run.smithi087.stdout:====================================================================================== 2024-09-13T17:01:44.259 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-09-13T17:01:44.259 INFO:teuthology.orchestra.run.smithi087.stdout:====================================================================================== 2024-09-13T17:01:44.259 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-09-13T17:01:44.259 INFO:teuthology.orchestra.run.smithi087.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-13T17:01:44.259 INFO:teuthology.orchestra.run.smithi087.stdout: ceph x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 6.5 k 2024-09-13T17:01:44.259 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 5.1 M 2024-09-13T17:01:44.260 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 852 k 2024-09-13T17:01:44.260 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 142 k 2024-09-13T17:01:44.260 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 1.5 M 2024-09-13T17:01:44.260 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 139 k 2024-09-13T17:01:44.260 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 3.5 M 2024-09-13T17:01:44.260 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 7.4 M 2024-09-13T17:01:44.260 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-rook noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 49 k 2024-09-13T17:01:44.260 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-radosgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 7.7 M 2024-09-13T17:01:44.260 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-test x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 40 M 2024-09-13T17:01:44.260 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-volume noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 264 k 2024-09-13T17:01:44.260 INFO:teuthology.orchestra.run.smithi087.stdout: cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 226 k 2024-09-13T17:01:44.260 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 224 k 2024-09-13T17:01:44.260 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-top noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 18 k 2024-09-13T17:01:44.260 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-13T17:01:44.261 INFO:teuthology.orchestra.run.smithi087.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-13T17:01:44.261 INFO:teuthology.orchestra.run.smithi087.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-13T17:01:44.261 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 31 k 2024-09-13T17:01:44.261 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 712 k 2024-09-13T17:01:44.261 INFO:teuthology.orchestra.run.smithi087.stdout: librados-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 127 k 2024-09-13T17:01:44.261 INFO:teuthology.orchestra.run.smithi087.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-13T17:01:44.261 INFO:teuthology.orchestra.run.smithi087.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-13T17:01:44.261 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-13T17:01:44.261 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-13T17:01:44.261 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-13T17:01:44.261 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-13T17:01:44.263 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cephfs x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 162 k 2024-09-13T17:01:44.263 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 321 k 2024-09-13T17:01:44.263 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 301 k 2024-09-13T17:01:44.263 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 99 k 2024-09-13T17:01:44.264 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 87 k 2024-09-13T17:01:44.264 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T17:01:44.264 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-nbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 172 k 2024-09-13T17:01:44.264 INFO:teuthology.orchestra.run.smithi087.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-13T17:01:44.264 INFO:teuthology.orchestra.run.smithi087.stdout:Upgrading: 2024-09-13T17:01:44.264 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-13T17:01:44.264 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-13T17:01:44.264 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-13T17:01:44.264 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-13T17:01:44.264 INFO:teuthology.orchestra.run.smithi087.stdout: librados2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.3 M 2024-09-13T17:01:44.264 INFO:teuthology.orchestra.run.smithi087.stdout: librbd1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T17:01:44.264 INFO:teuthology.orchestra.run.smithi087.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-13T17:01:44.264 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-13T17:01:44.265 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-09-13T17:01:44.265 INFO:teuthology.orchestra.run.smithi087.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-13T17:01:44.265 INFO:teuthology.orchestra.run.smithi087.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T17:01:44.265 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 18 M 2024-09-13T17:01:44.265 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-grafana-dashboards noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 24 k 2024-09-13T17:01:44.265 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mds x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 2.1 M 2024-09-13T17:01:44.265 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 246 k 2024-09-13T17:01:44.265 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mon x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.7 M 2024-09-13T17:01:44.265 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-osd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 17 M 2024-09-13T17:01:44.265 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-prometheus-alerts noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 16 k 2024-09-13T17:01:44.265 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-selinux x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 25 k 2024-09-13T17:01:44.265 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T17:01:44.265 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T17:01:44.266 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T17:01:44.266 INFO:teuthology.orchestra.run.smithi087.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T17:01:44.266 INFO:teuthology.orchestra.run.smithi087.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T17:01:44.266 INFO:teuthology.orchestra.run.smithi087.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T17:01:44.266 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T17:01:44.266 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T17:01:44.266 INFO:teuthology.orchestra.run.smithi087.stdout: libcephsqlite x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 166 k 2024-09-13T17:01:44.266 INFO:teuthology.orchestra.run.smithi087.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T17:01:44.266 INFO:teuthology.orchestra.run.smithi087.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T17:01:44.266 INFO:teuthology.orchestra.run.smithi087.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T17:01:44.266 INFO:teuthology.orchestra.run.smithi087.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T17:01:44.266 INFO:teuthology.orchestra.run.smithi087.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T17:01:44.266 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 478 k 2024-09-13T17:01:44.267 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T17:01:44.267 INFO:teuthology.orchestra.run.smithi087.stdout: librgw2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.5 M 2024-09-13T17:01:44.267 INFO:teuthology.orchestra.run.smithi087.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T17:01:44.267 INFO:teuthology.orchestra.run.smithi087.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-13T17:01:44.267 INFO:teuthology.orchestra.run.smithi087.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T17:01:44.267 INFO:teuthology.orchestra.run.smithi087.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T17:01:44.267 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T17:01:44.267 INFO:teuthology.orchestra.run.smithi087.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T17:01:44.267 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-13T17:01:44.267 INFO:teuthology.orchestra.run.smithi087.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T17:01:44.267 INFO:teuthology.orchestra.run.smithi087.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T17:01:44.267 INFO:teuthology.orchestra.run.smithi087.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T17:01:44.267 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T17:01:44.267 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-argparse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 45 k 2024-09-13T17:01:44.267 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 129 k 2024-09-13T17:01:44.268 INFO:teuthology.orchestra.run.smithi087.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T17:01:44.268 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T17:01:44.268 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T17:01:44.268 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T17:01:44.268 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T17:01:44.268 INFO:teuthology.orchestra.run.smithi087.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T17:01:44.268 INFO:teuthology.orchestra.run.smithi087.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T17:01:44.268 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T17:01:44.268 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T17:01:44.268 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T17:01:44.268 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T17:01:44.268 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T17:01:44.268 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T17:01:44.268 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T17:01:44.269 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T17:01:44.269 INFO:teuthology.orchestra.run.smithi087.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T17:01:44.269 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T17:01:44.269 INFO:teuthology.orchestra.run.smithi087.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T17:01:44.269 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T17:01:44.269 INFO:teuthology.orchestra.run.smithi087.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T17:01:44.269 INFO:teuthology.orchestra.run.smithi087.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T17:01:44.269 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T17:01:44.269 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T17:01:44.269 INFO:teuthology.orchestra.run.smithi087.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T17:01:44.269 INFO:teuthology.orchestra.run.smithi087.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T17:01:44.269 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T17:01:44.269 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T17:01:44.269 INFO:teuthology.orchestra.run.smithi087.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T17:01:44.270 INFO:teuthology.orchestra.run.smithi087.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T17:01:44.270 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T17:01:44.270 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T17:01:44.270 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T17:01:44.270 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T17:01:44.270 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T17:01:44.270 INFO:teuthology.orchestra.run.smithi087.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T17:01:44.270 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T17:01:44.270 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T17:01:44.270 INFO:teuthology.orchestra.run.smithi087.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T17:01:44.270 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T17:01:44.270 INFO:teuthology.orchestra.run.smithi087.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T17:01:44.270 INFO:teuthology.orchestra.run.smithi087.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T17:01:44.270 INFO:teuthology.orchestra.run.smithi087.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T17:01:44.270 INFO:teuthology.orchestra.run.smithi087.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T17:01:44.270 INFO:teuthology.orchestra.run.smithi087.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T17:01:44.271 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T17:01:44.271 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T17:01:44.271 INFO:teuthology.orchestra.run.smithi087.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T17:01:44.271 INFO:teuthology.orchestra.run.smithi087.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T17:01:44.271 INFO:teuthology.orchestra.run.smithi087.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T17:01:44.271 INFO:teuthology.orchestra.run.smithi087.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T17:01:44.271 INFO:teuthology.orchestra.run.smithi087.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T17:01:44.271 INFO:teuthology.orchestra.run.smithi087.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-13T17:01:44.271 INFO:teuthology.orchestra.run.smithi087.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T17:01:44.271 INFO:teuthology.orchestra.run.smithi087.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-13T17:01:44.271 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:01:44.271 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-09-13T17:01:44.271 INFO:teuthology.orchestra.run.smithi087.stdout:====================================================================================== 2024-09-13T17:01:44.271 INFO:teuthology.orchestra.run.smithi087.stdout:Install 130 Packages 2024-09-13T17:01:44.271 INFO:teuthology.orchestra.run.smithi087.stdout:Upgrade 8 Packages 2024-09-13T17:01:44.271 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:01:44.272 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 203 M 2024-09-13T17:01:44.272 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-09-13T17:01:44.296 INFO:teuthology.orchestra.run.smithi118.stdout:(30/138): ceph-osd-18.2.4-860.g6c6b083f.el9.x86 7.0 MB/s | 17 MB 00:02 2024-09-13T17:01:44.396 INFO:teuthology.orchestra.run.smithi118.stdout:(31/138): ceph-mgr-dashboard-18.2.4-860.g6c6b08 10 MB/s | 3.5 MB 00:00 2024-09-13T17:01:44.422 INFO:teuthology.orchestra.run.smithi118.stdout:(32/138): ceph-mgr-modules-core-18.2.4-860.g6c6 1.9 MB/s | 246 kB 00:00 2024-09-13T17:01:44.447 INFO:teuthology.orchestra.run.smithi118.stdout:(33/138): ceph-mgr-rook-18.2.4-860.g6c6b083f.el 979 kB/s | 49 kB 00:00 2024-09-13T17:01:44.462 INFO:teuthology.orchestra.run.smithi087.stdout:(1/138): ceph-18.2.4-860.g6c6b083f.el9.x86_64.r 54 kB/s | 6.5 kB 00:00 2024-09-13T17:01:44.472 INFO:teuthology.orchestra.run.smithi118.stdout:(34/138): ceph-prometheus-alerts-18.2.4-860.g6c 329 kB/s | 16 kB 00:00 2024-09-13T17:01:44.497 INFO:teuthology.orchestra.run.smithi118.stdout:(35/138): ceph-volume-18.2.4-860.g6c6b083f.el9. 5.1 MB/s | 264 kB 00:00 2024-09-13T17:01:44.531 INFO:teuthology.orchestra.run.smithi118.stdout:(36/138): cephadm-18.2.4-860.g6c6b083f.el9.noar 3.8 MB/s | 226 kB 00:00 2024-09-13T17:01:44.556 INFO:teuthology.orchestra.run.smithi118.stdout:(37/138): cephfs-top-18.2.4-860.g6c6b083f.el9.n 313 kB/s | 18 kB 00:00 2024-09-13T17:01:44.655 INFO:teuthology.orchestra.run.smithi087.stdout:(2/138): ceph-fuse-18.2.4-860.g6c6b083f.el9.x86 4.3 MB/s | 852 kB 00:00 2024-09-13T17:01:44.682 INFO:teuthology.orchestra.run.smithi118.stdout:(38/138): ceph-mgr-diskprediction-local-18.2.4- 12 MB/s | 7.4 MB 00:00 2024-09-13T17:01:44.764 INFO:teuthology.orchestra.run.smithi087.stdout:(3/138): ceph-immutable-object-cache-18.2.4-860 1.3 MB/s | 142 kB 00:00 2024-09-13T17:01:44.798 INFO:teuthology.orchestra.run.smithi118.stdout:(39/138): fuse-2.9.9-16.el9.x86_64.rpm 299 kB/s | 80 kB 00:00 2024-09-13T17:01:44.838 INFO:teuthology.orchestra.run.smithi087.stdout:(4/138): ceph-base-18.2.4-860.g6c6b083f.el9.x86 10 MB/s | 5.1 MB 00:00 2024-09-13T17:01:44.874 INFO:teuthology.orchestra.run.smithi149.stdout:(1/138): ceph-18.2.4-860.g6c6b083f.el9.x86_64.r 34 kB/s | 6.5 kB 00:00 2024-09-13T17:01:44.907 INFO:teuthology.orchestra.run.smithi118.stdout:(40/138): libquadmath-11.5.0-2.el9.x86_64.rpm 849 kB/s | 191 kB 00:00 2024-09-13T17:01:44.930 INFO:teuthology.orchestra.run.smithi087.stdout:(5/138): ceph-mgr-18.2.4-860.g6c6b083f.el9.x86_ 16 MB/s | 1.5 MB 00:00 2024-09-13T17:01:44.933 INFO:teuthology.orchestra.run.smithi118.stdout:(41/138): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.9 MB/s | 253 kB 00:00 2024-09-13T17:01:44.958 INFO:teuthology.orchestra.run.smithi118.stdout:(42/138): libgfortran-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 801 kB 00:00 2024-09-13T17:01:44.989 INFO:teuthology.orchestra.run.smithi087.stdout:(6/138): ceph-mds-18.2.4-860.g6c6b083f.el9.x86_ 9.4 MB/s | 2.1 MB 00:00 2024-09-13T17:01:44.991 INFO:teuthology.orchestra.run.smithi118.stdout:(43/138): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-13T17:01:45.017 INFO:teuthology.orchestra.run.smithi118.stdout:(44/138): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-13T17:01:45.075 INFO:teuthology.orchestra.run.smithi118.stdout:(45/138): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-13T17:01:45.101 INFO:teuthology.orchestra.run.smithi118.stdout:(46/138): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-09-13T17:01:45.143 INFO:teuthology.orchestra.run.smithi118.stdout:(47/138): python3-cryptography-36.0.1-4.el9.x86 5.2 MB/s | 1.2 MB 00:00 2024-09-13T17:01:45.222 INFO:teuthology.orchestra.run.smithi087.stdout:(7/138): ceph-mon-18.2.4-860.g6c6b083f.el9.x86_ 16 MB/s | 4.7 MB 00:00 2024-09-13T17:01:45.285 INFO:teuthology.orchestra.run.smithi118.stdout:(48/138): boost-program-options-1.75.0-8.el9.x8 755 kB/s | 107 kB 00:00 2024-09-13T17:01:45.335 INFO:teuthology.orchestra.run.smithi118.stdout:(49/138): elfutils-libelf-devel-0.191-4.el9.x86 435 kB/s | 22 kB 00:00 2024-09-13T17:01:45.394 INFO:teuthology.orchestra.run.smithi118.stdout:(50/138): automake-1.16.2-8.el9.noarch.rpm 2.1 MB/s | 689 kB 00:00 2024-09-13T17:01:45.397 INFO:teuthology.orchestra.run.smithi087.stdout:(8/138): ceph-common-18.2.4-860.g6c6b083f.el9.x 17 MB/s | 18 MB 00:01 2024-09-13T17:01:45.427 INFO:teuthology.orchestra.run.smithi118.stdout:(51/138): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 943 kB 00:00 2024-09-13T17:01:45.439 INFO:teuthology.orchestra.run.smithi087.stdout:(9/138): ceph-selinux-18.2.4-860.g6c6b083f.el9. 607 kB/s | 25 kB 00:00 2024-09-13T17:01:45.452 INFO:teuthology.orchestra.run.smithi118.stdout:(52/138): flexiblas-3.0.4-8.el9.x86_64.rpm 560 kB/s | 33 kB 00:00 2024-09-13T17:01:45.478 INFO:teuthology.orchestra.run.smithi118.stdout:(53/138): flex-2.6.4-9.el9.x86_64.rpm 2.1 MB/s | 313 kB 00:00 2024-09-13T17:01:45.503 INFO:teuthology.orchestra.run.smithi118.stdout:(54/138): flexiblas-openblas-openmp-3.0.4-8.el9 361 kB/s | 18 kB 00:00 2024-09-13T17:01:45.520 INFO:teuthology.orchestra.run.smithi118.stdout:(55/138): libaio-devel-0.3.111-13.el9.x86_64.rp 266 kB/s | 11 kB 00:00 2024-09-13T17:01:45.562 INFO:teuthology.orchestra.run.smithi118.stdout:(56/138): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-13T17:01:45.587 INFO:teuthology.orchestra.run.smithi118.stdout:(57/138): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-09-13T17:01:45.633 INFO:teuthology.orchestra.run.smithi149.stdout:(2/138): ceph-fuse-18.2.4-860.g6c6b083f.el9.x86 1.1 MB/s | 852 kB 00:00 2024-09-13T17:01:45.648 INFO:teuthology.orchestra.run.smithi087.stdout:(10/138): ceph-radosgw-18.2.4-860.g6c6b083f.el9 18 MB/s | 7.7 MB 00:00 2024-09-13T17:01:45.723 INFO:teuthology.orchestra.run.smithi087.stdout:(11/138): cephfs-mirror-18.2.4-860.g6c6b083f.el 2.9 MB/s | 224 kB 00:00 2024-09-13T17:01:45.738 INFO:teuthology.orchestra.run.smithi118.stdout:(58/138): libtool-2.4.6-46.el9.x86_64.rpm 3.8 MB/s | 581 kB 00:00 2024-09-13T17:01:45.758 INFO:teuthology.orchestra.run.smithi149.stdout:(3/138): ceph-immutable-object-cache-18.2.4-860 1.1 MB/s | 142 kB 00:00 2024-09-13T17:01:45.771 INFO:teuthology.orchestra.run.smithi118.stdout:(59/138): librdkafka-1.6.1-102.el9.x86_64.rpm 3.1 MB/s | 662 kB 00:00 2024-09-13T17:01:45.790 INFO:teuthology.orchestra.run.smithi087.stdout:(12/138): libcephfs-devel-18.2.4-860.g6c6b083f. 466 kB/s | 31 kB 00:00 2024-09-13T17:01:45.797 INFO:teuthology.orchestra.run.smithi118.stdout:(60/138): libuuid-devel-2.37.4-20.el9.x86_64.rp 416 kB/s | 24 kB 00:00 2024-09-13T17:01:45.822 INFO:teuthology.orchestra.run.smithi118.stdout:(61/138): libzstd-devel-1.5.1-2.el9.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-09-13T17:01:45.872 INFO:teuthology.orchestra.run.smithi118.stdout:(62/138): openblas-0.3.26-2.el9.x86_64.rpm 772 kB/s | 38 kB 00:00 2024-09-13T17:01:45.890 INFO:teuthology.orchestra.run.smithi087.stdout:(13/138): libcephfs2-18.2.4-860.g6c6b083f.el9.x 7.0 MB/s | 712 kB 00:00 2024-09-13T17:01:45.898 INFO:teuthology.orchestra.run.smithi118.stdout:(63/138): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-13T17:01:45.974 INFO:teuthology.orchestra.run.smithi087.stdout:(14/138): libcephsqlite-18.2.4-860.g6c6b083f.el 1.9 MB/s | 166 kB 00:00 2024-09-13T17:01:46.006 INFO:teuthology.orchestra.run.smithi118.stdout:(64/138): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.2 MB/s | 3.0 MB 00:00 2024-09-13T17:01:46.049 INFO:teuthology.orchestra.run.smithi087.stdout:(15/138): librados-devel-18.2.4-860.g6c6b083f.e 1.7 MB/s | 127 kB 00:00 2024-09-13T17:01:46.141 INFO:teuthology.orchestra.run.smithi087.stdout:(16/138): libradosstriper1-18.2.4-860.g6c6b083f 5.1 MB/s | 478 kB 00:00 2024-09-13T17:01:46.298 INFO:teuthology.orchestra.run.smithi118.stdout:(65/138): postgresql-13.16-1.el9.x86_64.rpm 5.4 MB/s | 1.6 MB 00:00 2024-09-13T17:01:46.333 INFO:teuthology.orchestra.run.smithi087.stdout:(17/138): ceph-osd-18.2.4-860.g6c6b083f.el9.x86 12 MB/s | 17 MB 00:01 2024-09-13T17:01:46.392 INFO:teuthology.orchestra.run.smithi087.stdout:(18/138): python3-ceph-argparse-18.2.4-860.g6c6 776 kB/s | 45 kB 00:00 2024-09-13T17:01:46.450 INFO:teuthology.orchestra.run.smithi087.stdout:(19/138): librgw2-18.2.4-860.g6c6b083f.el9.x86_ 14 MB/s | 4.5 MB 00:00 2024-09-13T17:01:46.476 INFO:teuthology.orchestra.run.smithi087.stdout:(20/138): python3-ceph-common-18.2.4-860.g6c6b0 1.5 MB/s | 129 kB 00:00 2024-09-13T17:01:46.490 INFO:teuthology.orchestra.run.smithi118.stdout:(66/138): postgresql-contrib-13.16-1.el9.x86_64 4.6 MB/s | 910 kB 00:00 2024-09-13T17:01:46.509 INFO:teuthology.orchestra.run.smithi087.stdout:(21/138): python3-cephfs-18.2.4-860.g6c6b083f.e 2.7 MB/s | 162 kB 00:00 2024-09-13T17:01:46.534 INFO:teuthology.orchestra.run.smithi087.stdout:(22/138): python3-rados-18.2.4-860.g6c6b083f.el 5.4 MB/s | 321 kB 00:00 2024-09-13T17:01:46.549 INFO:teuthology.orchestra.run.smithi118.stdout:(67/138): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-13T17:01:46.568 INFO:teuthology.orchestra.run.smithi087.stdout:(23/138): python3-rbd-18.2.4-860.g6c6b083f.el9. 5.0 MB/s | 301 kB 00:00 2024-09-13T17:01:46.593 INFO:teuthology.orchestra.run.smithi087.stdout:(24/138): python3-rgw-18.2.4-860.g6c6b083f.el9. 1.7 MB/s | 99 kB 00:00 2024-09-13T17:01:46.627 INFO:teuthology.orchestra.run.smithi087.stdout:(25/138): rbd-fuse-18.2.4-860.g6c6b083f.el9.x86 1.5 MB/s | 87 kB 00:00 2024-09-13T17:01:46.719 INFO:teuthology.orchestra.run.smithi087.stdout:(26/138): rbd-nbd-18.2.4-860.g6c6b083f.el9.x86_ 1.8 MB/s | 172 kB 00:00 2024-09-13T17:01:46.861 INFO:teuthology.orchestra.run.smithi087.stdout:(27/138): ceph-grafana-dashboards-18.2.4-860.g6 172 kB/s | 24 kB 00:00 2024-09-13T17:01:46.893 INFO:teuthology.orchestra.run.smithi118.stdout:(68/138): openblas-openmp-0.3.26-2.el9.x86_64.r 4.8 MB/s | 4.9 MB 00:01 2024-09-13T17:01:46.961 INFO:teuthology.orchestra.run.smithi087.stdout:(28/138): rbd-mirror-18.2.4-860.g6c6b083f.el9.x 8.1 MB/s | 3.0 MB 00:00 2024-09-13T17:01:46.966 INFO:teuthology.orchestra.run.smithi118.stdout:(69/138): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.1 MB/s | 4.4 MB 00:01 2024-09-13T17:01:46.987 INFO:teuthology.orchestra.run.smithi087.stdout:(29/138): ceph-mgr-cephadm-18.2.4-860.g6c6b083f 1.1 MB/s | 139 kB 00:00 2024-09-13T17:01:47.050 INFO:teuthology.orchestra.run.smithi118.stdout:(70/138): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-13T17:01:47.133 INFO:teuthology.orchestra.run.smithi118.stdout:(71/138): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-13T17:01:47.184 INFO:teuthology.orchestra.run.smithi118.stdout:(72/138): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-09-13T17:01:47.208 INFO:teuthology.orchestra.run.smithi149.stdout:(4/138): ceph-common-18.2.4-860.g6c6b083f.el9.x 7.3 MB/s | 18 MB 00:02 2024-09-13T17:01:47.234 INFO:teuthology.orchestra.run.smithi118.stdout:(73/138): python3-jsonpointer-2.0-4.el9.noarch. 384 kB/s | 19 kB 00:00 2024-09-13T17:01:47.250 INFO:teuthology.orchestra.run.smithi149.stdout:(5/138): ceph-mds-18.2.4-860.g6c6b083f.el9.x86_ 1.4 MB/s | 2.1 MB 00:01 2024-09-13T17:01:47.301 INFO:teuthology.orchestra.run.smithi118.stdout:(74/138): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-09-13T17:01:47.334 INFO:teuthology.orchestra.run.smithi149.stdout:(6/138): ceph-mgr-18.2.4-860.g6c6b083f.el9.x86_ 12 MB/s | 1.5 MB 00:00 2024-09-13T17:01:47.354 INFO:teuthology.orchestra.run.smithi087.stdout:(30/138): ceph-test-18.2.4-860.g6c6b083f.el9.x8 21 MB/s | 40 MB 00:01 2024-09-13T17:01:47.418 INFO:teuthology.orchestra.run.smithi118.stdout:(75/138): postgresql-server-13.16-1.el9.x86_64. 6.6 MB/s | 5.8 MB 00:00 2024-09-13T17:01:47.437 INFO:teuthology.orchestra.run.smithi087.stdout:(31/138): ceph-mgr-dashboard-18.2.4-860.g6c6b08 7.4 MB/s | 3.5 MB 00:00 2024-09-13T17:01:47.443 INFO:teuthology.orchestra.run.smithi118.stdout:(76/138): python3-markupsafe-1.1.1-12.el9.x86_6 244 kB/s | 35 kB 00:00 2024-09-13T17:01:47.462 INFO:teuthology.orchestra.run.smithi087.stdout:(32/138): ceph-mgr-modules-core-18.2.4-860.g6c6 2.2 MB/s | 246 kB 00:00 2024-09-13T17:01:47.496 INFO:teuthology.orchestra.run.smithi087.stdout:(33/138): ceph-mgr-rook-18.2.4-860.g6c6b083f.el 849 kB/s | 49 kB 00:00 2024-09-13T17:01:47.521 INFO:teuthology.orchestra.run.smithi087.stdout:(34/138): ceph-prometheus-alerts-18.2.4-860.g6c 281 kB/s | 16 kB 00:00 2024-09-13T17:01:47.527 INFO:teuthology.orchestra.run.smithi118.stdout:(77/138): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-09-13T17:01:47.563 INFO:teuthology.orchestra.run.smithi087.stdout:(35/138): ceph-volume-18.2.4-860.g6c6b083f.el9. 3.9 MB/s | 264 kB 00:00 2024-09-13T17:01:47.589 INFO:teuthology.orchestra.run.smithi087.stdout:(36/138): cephadm-18.2.4-860.g6c6b083f.el9.noar 3.3 MB/s | 226 kB 00:00 2024-09-13T17:01:47.611 INFO:teuthology.orchestra.run.smithi118.stdout:(78/138): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-09-13T17:01:47.614 INFO:teuthology.orchestra.run.smithi087.stdout:(37/138): cephfs-top-18.2.4-860.g6c6b083f.el9.n 365 kB/s | 18 kB 00:00 2024-09-13T17:01:47.661 INFO:teuthology.orchestra.run.smithi118.stdout:(79/138): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-13T17:01:47.706 INFO:teuthology.orchestra.run.smithi087.stdout:(38/138): ceph-mgr-diskprediction-local-18.2.4- 10 MB/s | 7.4 MB 00:00 2024-09-13T17:01:47.711 INFO:teuthology.orchestra.run.smithi118.stdout:(80/138): python3-prettytable-0.7.2-27.el9.noar 846 kB/s | 42 kB 00:00 2024-09-13T17:01:47.770 INFO:teuthology.orchestra.run.smithi118.stdout:(81/138): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-09-13T17:01:47.854 INFO:teuthology.orchestra.run.smithi118.stdout:(82/138): python3-pyasn1-modules-0.4.8-6.el9.no 3.3 MB/s | 279 kB 00:00 2024-09-13T17:01:47.937 INFO:teuthology.orchestra.run.smithi118.stdout:(83/138): python3-babel-2.9.1-2.el9.noarch.rpm 5.7 MB/s | 6.0 MB 00:01 2024-09-13T17:01:47.951 INFO:teuthology.orchestra.run.smithi149.stdout:(7/138): ceph-osd-18.2.4-860.g6c6b083f.el9.x86_ 27 MB/s | 17 MB 00:00 2024-09-13T17:01:47.962 INFO:teuthology.orchestra.run.smithi118.stdout:(84/138): python3-pytz-2021.1-5.el9.noarch.rpm 469 kB/s | 51 kB 00:00 2024-09-13T17:01:47.980 INFO:teuthology.orchestra.run.smithi118.stdout:(85/138): python3-requests-oauthlib-1.3.0-12.el 1.2 MB/s | 54 kB 00:00 2024-09-13T17:01:48.018 INFO:teuthology.orchestra.run.smithi149.stdout:(8/138): ceph-base-18.2.4-860.g6c6b083f.el9.x86 1.5 MB/s | 5.1 MB 00:03 2024-09-13T17:01:48.077 INFO:teuthology.orchestra.run.smithi149.stdout:(9/138): ceph-selinux-18.2.4-860.g6c6b083f.el9. 431 kB/s | 25 kB 00:00 2024-09-13T17:01:48.080 INFO:teuthology.orchestra.run.smithi118.stdout:(86/138): python3-numpy-1.20.1-5.el9.x86_64.rpm 7.7 MB/s | 5.1 MB 00:00 2024-09-13T17:01:48.081 INFO:teuthology.orchestra.run.smithi087.stdout:(39/138): fuse-2.9.9-16.el9.x86_64.rpm 162 kB/s | 80 kB 00:00 2024-09-13T17:01:48.097 INFO:teuthology.orchestra.run.smithi118.stdout:(87/138): python3-toml-0.10.2-6.el9.noarch.rpm 356 kB/s | 42 kB 00:00 2024-09-13T17:01:48.139 INFO:teuthology.orchestra.run.smithi118.stdout:(88/138): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-13T17:01:48.156 INFO:teuthology.orchestra.run.smithi118.stdout:(89/138): uuid-1.6.2-55.el9.x86_64.rpm 987 kB/s | 58 kB 00:00 2024-09-13T17:01:48.190 INFO:teuthology.orchestra.run.smithi118.stdout:(90/138): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-09-13T17:01:48.215 INFO:teuthology.orchestra.run.smithi118.stdout:(91/138): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-13T17:01:48.227 INFO:teuthology.orchestra.run.smithi149.stdout:(10/138): ceph-radosgw-18.2.4-860.g6c6b083f.el9 28 MB/s | 7.7 MB 00:00 2024-09-13T17:01:48.248 INFO:teuthology.orchestra.run.smithi118.stdout:(92/138): zlib-devel-1.2.11-41.el9.x86_64.rpm 767 kB/s | 45 kB 00:00 2024-09-13T17:01:48.256 INFO:teuthology.orchestra.run.smithi087.stdout:(40/138): libquadmath-11.5.0-2.el9.x86_64.rpm 347 kB/s | 191 kB 00:00 2024-09-13T17:01:48.277 INFO:teuthology.orchestra.run.smithi149.stdout:(11/138): cephfs-mirror-18.2.4-860.g6c6b083f.el 4.4 MB/s | 224 kB 00:00 2024-09-13T17:01:48.282 INFO:teuthology.orchestra.run.smithi118.stdout:(93/138): fmt-8.1.1-5.el9.x86_64.rpm 1.6 MB/s | 111 kB 00:00 2024-09-13T17:01:48.324 INFO:teuthology.orchestra.run.smithi118.stdout:(94/138): gperftools-libs-2.9.1-3.el9.x86_64.rp 4.1 MB/s | 308 kB 00:00 2024-09-13T17:01:48.327 INFO:teuthology.orchestra.run.smithi149.stdout:(12/138): libcephfs-devel-18.2.4-860.g6c6b083f. 623 kB/s | 31 kB 00:00 2024-09-13T17:01:48.349 INFO:teuthology.orchestra.run.smithi118.stdout:(95/138): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-13T17:01:48.373 INFO:teuthology.orchestra.run.smithi087.stdout:(41/138): python3-cffi-1.14.5-5.el9.x86_64.rpm 867 kB/s | 253 kB 00:00 2024-09-13T17:01:48.375 INFO:teuthology.orchestra.run.smithi118.stdout:(96/138): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-13T17:01:48.377 INFO:teuthology.orchestra.run.smithi149.stdout:(13/138): libcephfs2-18.2.4-860.g6c6b083f.el9.x 14 MB/s | 712 kB 00:00 2024-09-13T17:01:48.409 INFO:teuthology.orchestra.run.smithi118.stdout:(97/138): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-13T17:01:48.428 INFO:teuthology.orchestra.run.smithi149.stdout:(14/138): libcephsqlite-18.2.4-860.g6c6b083f.el 3.3 MB/s | 166 kB 00:00 2024-09-13T17:01:48.465 INFO:teuthology.orchestra.run.smithi087.stdout:(42/138): libgfortran-11.5.0-2.el9.x86_64.rpm 941 kB/s | 801 kB 00:00 2024-09-13T17:01:48.478 INFO:teuthology.orchestra.run.smithi149.stdout:(15/138): librados-devel-18.2.4-860.g6c6b083f.e 2.5 MB/s | 127 kB 00:00 2024-09-13T17:01:48.484 INFO:teuthology.orchestra.run.smithi118.stdout:(98/138): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-13T17:01:48.490 INFO:teuthology.orchestra.run.smithi087.stdout:(43/138): python3-ply-3.11-14.el9.noarch.rpm 910 kB/s | 106 kB 00:00 2024-09-13T17:01:48.537 INFO:teuthology.orchestra.run.smithi149.stdout:(16/138): libradosstriper1-18.2.4-860.g6c6b083f 8.0 MB/s | 478 kB 00:00 2024-09-13T17:01:48.542 INFO:teuthology.orchestra.run.smithi118.stdout:(99/138): python3-asyncssh-2.13.2-5.el9.noarch. 9.2 MB/s | 548 kB 00:00 2024-09-13T17:01:48.568 INFO:teuthology.orchestra.run.smithi118.stdout:(100/138): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-13T17:01:48.591 INFO:teuthology.orchestra.run.smithi087.stdout:(44/138): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-13T17:01:48.624 INFO:teuthology.orchestra.run.smithi087.stdout:(45/138): python3-requests-2.25.1-8.el9.noarch. 935 kB/s | 125 kB 00:00 2024-09-13T17:01:48.635 INFO:teuthology.orchestra.run.smithi118.stdout:(101/138): libarrow-9.0.0-11.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-13T17:01:48.660 INFO:teuthology.orchestra.run.smithi118.stdout:(102/138): python3-cachetools-4.2.4-1.el9.noarc 351 kB/s | 32 kB 00:00 2024-09-13T17:01:48.685 INFO:teuthology.orchestra.run.smithi118.stdout:(103/138): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-13T17:01:48.704 INFO:teuthology.orchestra.run.smithi149.stdout:(17/138): librgw2-18.2.4-860.g6c6b083f.el9.x86_ 27 MB/s | 4.5 MB 00:00 2024-09-13T17:01:48.708 INFO:teuthology.orchestra.run.smithi087.stdout:(46/138): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-13T17:01:48.711 INFO:teuthology.orchestra.run.smithi118.stdout:(104/138): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-13T17:01:48.736 INFO:teuthology.orchestra.run.smithi118.stdout:(105/138): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-13T17:01:48.746 INFO:teuthology.orchestra.run.smithi149.stdout:(18/138): python3-ceph-argparse-18.2.4-860.g6c6 1.1 MB/s | 45 kB 00:00 2024-09-13T17:01:48.770 INFO:teuthology.orchestra.run.smithi118.stdout:(106/138): python3-jaraco-8.2.1-3.el9.noarch.rp 320 kB/s | 11 kB 00:00 2024-09-13T17:01:48.795 INFO:teuthology.orchestra.run.smithi118.stdout:(107/138): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-13T17:01:48.796 INFO:teuthology.orchestra.run.smithi149.stdout:(19/138): python3-ceph-common-18.2.4-860.g6c6b0 2.5 MB/s | 129 kB 00:00 2024-09-13T17:01:48.820 INFO:teuthology.orchestra.run.smithi118.stdout:(108/138): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-09-13T17:01:48.845 INFO:teuthology.orchestra.run.smithi118.stdout:(109/138): python3-jaraco-collections-3.0.0-8.e 460 kB/s | 23 kB 00:00 2024-09-13T17:01:48.846 INFO:teuthology.orchestra.run.smithi149.stdout:(20/138): python3-cephfs-18.2.4-860.g6c6b083f.e 3.2 MB/s | 162 kB 00:00 2024-09-13T17:01:48.871 INFO:teuthology.orchestra.run.smithi118.stdout:(110/138): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-09-13T17:01:48.883 INFO:teuthology.orchestra.run.smithi087.stdout:(47/138): automake-1.16.2-8.el9.noarch.rpm 2.6 MB/s | 689 kB 00:00 2024-09-13T17:01:48.896 INFO:teuthology.orchestra.run.smithi118.stdout:(111/138): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-09-13T17:01:48.916 INFO:teuthology.orchestra.run.smithi087.stdout:(48/138): python3-cryptography-36.0.1-4.el9.x86 1.9 MB/s | 1.2 MB 00:00 2024-09-13T17:01:48.922 INFO:teuthology.orchestra.run.smithi118.stdout:(112/138): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-13T17:01:48.950 INFO:teuthology.orchestra.run.smithi087.stdout:(49/138): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-09-13T17:01:48.955 INFO:teuthology.orchestra.run.smithi118.stdout:(113/138): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-13T17:01:48.989 INFO:teuthology.orchestra.run.smithi118.stdout:(114/138): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-09-13T17:01:49.014 INFO:teuthology.orchestra.run.smithi118.stdout:(115/138): python3-natsort-7.1.1-5.el9.noarch.r 986 kB/s | 58 kB 00:00 2024-09-13T17:01:49.025 INFO:teuthology.orchestra.run.smithi149.stdout:(21/138): ceph-mon-18.2.4-860.g6c6b083f.el9.x86 2.6 MB/s | 4.7 MB 00:01 2024-09-13T17:01:49.034 INFO:teuthology.orchestra.run.smithi087.stdout:(50/138): elfutils-libelf-devel-0.191-4.el9.x86 186 kB/s | 22 kB 00:00 2024-09-13T17:01:49.039 INFO:teuthology.orchestra.run.smithi118.stdout:(116/138): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-09-13T17:01:49.059 INFO:teuthology.orchestra.run.smithi087.stdout:(51/138): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-13T17:01:49.065 INFO:teuthology.orchestra.run.smithi118.stdout:(117/138): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-13T17:01:49.080 INFO:teuthology.orchestra.run.smithi149.stdout:(22/138): python3-rados-18.2.4-860.g6c6b083f.el 1.3 MB/s | 321 kB 00:00 2024-09-13T17:01:49.090 INFO:teuthology.orchestra.run.smithi118.stdout:(118/138): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-13T17:01:49.093 INFO:teuthology.orchestra.run.smithi087.stdout:(52/138): bison-3.7.4-5.el9.x86_64.rpm 2.4 MB/s | 943 kB 00:00 2024-09-13T17:01:49.106 INFO:teuthology.orchestra.run.smithi149.stdout:(23/138): python3-rbd-18.2.4-860.g6c6b083f.el9. 3.7 MB/s | 301 kB 00:00 2024-09-13T17:01:49.115 INFO:teuthology.orchestra.run.smithi118.stdout:(119/138): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-13T17:01:49.118 INFO:teuthology.orchestra.run.smithi087.stdout:(53/138): flexiblas-3.0.4-8.el9.x86_64.rpm 391 kB/s | 33 kB 00:00 2024-09-13T17:01:49.131 INFO:teuthology.orchestra.run.smithi149.stdout:(24/138): python3-rgw-18.2.4-860.g6c6b083f.el9. 1.9 MB/s | 99 kB 00:00 2024-09-13T17:01:49.141 INFO:teuthology.orchestra.run.smithi118.stdout:(120/138): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-13T17:01:49.143 INFO:teuthology.orchestra.run.smithi087.stdout:(54/138): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-13T17:01:49.156 INFO:teuthology.orchestra.run.smithi149.stdout:(25/138): rbd-fuse-18.2.4-860.g6c6b083f.el9.x86 1.7 MB/s | 87 kB 00:00 2024-09-13T17:01:49.166 INFO:teuthology.orchestra.run.smithi118.stdout:(121/138): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-13T17:01:49.168 INFO:teuthology.orchestra.run.smithi087.stdout:(55/138): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-13T17:01:49.192 INFO:teuthology.orchestra.run.smithi118.stdout:(122/138): python3-tempora-5.0.0-2.el9.noarch.r 710 kB/s | 36 kB 00:00 2024-09-13T17:01:49.206 INFO:teuthology.orchestra.run.smithi149.stdout:(26/138): rbd-nbd-18.2.4-860.g6c6b083f.el9.x86_ 3.4 MB/s | 172 kB 00:00 2024-09-13T17:01:49.210 INFO:teuthology.orchestra.run.smithi087.stdout:(56/138): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-13T17:01:49.217 INFO:teuthology.orchestra.run.smithi118.stdout:(123/138): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-13T17:01:49.242 INFO:teuthology.orchestra.run.smithi118.stdout:(124/138): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-13T17:01:49.244 INFO:teuthology.orchestra.run.smithi087.stdout:(57/138): librabbitmq-0.11.0-7.el9.x86_64.rpm 600 kB/s | 45 kB 00:00 2024-09-13T17:01:49.248 INFO:teuthology.orchestra.run.smithi149.stdout:(27/138): ceph-grafana-dashboards-18.2.4-860.g6 589 kB/s | 24 kB 00:00 2024-09-13T17:01:49.267 INFO:teuthology.orchestra.run.smithi118.stdout:(125/138): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-13T17:01:49.293 INFO:teuthology.orchestra.run.smithi118.stdout:(126/138): python3-zc-lockfile-2.0-10.el9.noarc 799 kB/s | 20 kB 00:00 2024-09-13T17:01:49.307 INFO:teuthology.orchestra.run.smithi149.stdout:(28/138): ceph-mgr-cephadm-18.2.4-860.g6c6b083f 2.3 MB/s | 139 kB 00:00 2024-09-13T17:01:49.326 INFO:teuthology.orchestra.run.smithi118.stdout:(127/138): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-09-13T17:01:49.336 INFO:teuthology.orchestra.run.smithi087.stdout:(58/138): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-09-13T17:01:49.352 INFO:teuthology.orchestra.run.smithi118.stdout:(128/138): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-13T17:01:49.395 INFO:teuthology.orchestra.run.smithi087.stdout:(59/138): libuuid-devel-2.37.4-20.el9.x86_64.rp 422 kB/s | 24 kB 00:00 2024-09-13T17:01:49.427 INFO:teuthology.orchestra.run.smithi118.stdout:(129/138): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-13T17:01:49.445 INFO:teuthology.orchestra.run.smithi087.stdout:(60/138): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.7 MB/s | 3.0 MB 00:00 2024-09-13T17:01:49.449 INFO:teuthology.orchestra.run.smithi149.stdout:(29/138): ceph-mgr-dashboard-18.2.4-860.g6c6b08 25 MB/s | 3.5 MB 00:00 2024-09-13T17:01:49.470 INFO:teuthology.orchestra.run.smithi087.stdout:(61/138): libzstd-devel-1.5.1-2.el9.x86_64.rpm 629 kB/s | 47 kB 00:00 2024-09-13T17:01:49.504 INFO:teuthology.orchestra.run.smithi087.stdout:(62/138): libtool-2.4.6-46.el9.x86_64.rpm 2.2 MB/s | 581 kB 00:00 2024-09-13T17:01:49.529 INFO:teuthology.orchestra.run.smithi087.stdout:(63/138): openblas-0.3.26-2.el9.x86_64.rpm 659 kB/s | 38 kB 00:00 2024-09-13T17:01:49.554 INFO:teuthology.orchestra.run.smithi087.stdout:(64/138): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-13T17:01:49.700 INFO:teuthology.orchestra.run.smithi149.stdout:(30/138): ceph-mgr-diskprediction-local-18.2.4- 30 MB/s | 7.4 MB 00:00 2024-09-13T17:01:49.738 INFO:teuthology.orchestra.run.smithi087.stdout:(65/138): postgresql-13.16-1.el9.x86_64.rpm 8.7 MB/s | 1.6 MB 00:00 2024-09-13T17:01:49.750 INFO:teuthology.orchestra.run.smithi149.stdout:(31/138): ceph-mgr-modules-core-18.2.4-860.g6c6 4.8 MB/s | 246 kB 00:00 2024-09-13T17:01:49.769 INFO:teuthology.orchestra.run.smithi118.stdout:(130/138): librbd1-18.2.4-860.g6c6b083f.el9.x86 8.8 MB/s | 3.0 MB 00:00 2024-09-13T17:01:49.800 INFO:teuthology.orchestra.run.smithi149.stdout:(32/138): ceph-mgr-rook-18.2.4-860.g6c6b083f.el 990 kB/s | 49 kB 00:00 2024-09-13T17:01:49.850 INFO:teuthology.orchestra.run.smithi149.stdout:(33/138): ceph-prometheus-alerts-18.2.4-860.g6c 330 kB/s | 16 kB 00:00 2024-09-13T17:01:49.863 INFO:teuthology.orchestra.run.smithi087.stdout:(66/138): openssl-devel-3.2.2-6.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-13T17:01:49.869 INFO:teuthology.orchestra.run.smithi118.stdout:(131/138): librados2-18.2.4-860.g6c6b083f.el9.x 6.4 MB/s | 3.3 MB 00:00 2024-09-13T17:01:49.986 INFO:teuthology.orchestra.run.smithi149.stdout:(34/138): ceph-volume-18.2.4-860.g6c6b083f.el9. 1.9 MB/s | 264 kB 00:00 2024-09-13T17:01:50.005 INFO:teuthology.orchestra.run.smithi087.stdout:(67/138): postgresql-contrib-13.16-1.el9.x86_64 3.3 MB/s | 910 kB 00:00 2024-09-13T17:01:50.031 INFO:teuthology.orchestra.run.smithi087.stdout:(68/138): postgresql-private-libs-13.16-1.el9.x 823 kB/s | 137 kB 00:00 2024-09-13T17:01:50.035 INFO:teuthology.orchestra.run.smithi149.stdout:(35/138): rbd-mirror-18.2.4-860.g6c6b083f.el9.x 3.3 MB/s | 3.0 MB 00:00 2024-09-13T17:01:50.060 INFO:teuthology.orchestra.run.smithi149.stdout:(36/138): cephadm-18.2.4-860.g6c6b083f.el9.noar 3.0 MB/s | 226 kB 00:00 2024-09-13T17:01:50.085 INFO:teuthology.orchestra.run.smithi149.stdout:(37/138): cephfs-top-18.2.4-860.g6c6b083f.el9.n 364 kB/s | 18 kB 00:00 2024-09-13T17:01:50.131 INFO:teuthology.orchestra.run.smithi087.stdout:(69/138): openblas-openmp-0.3.26-2.el9.x86_64.r 7.9 MB/s | 4.9 MB 00:00 2024-09-13T17:01:50.152 INFO:teuthology.orchestra.run.smithi149.stdout:(38/138): fuse-2.9.9-16.el9.x86_64.rpm 870 kB/s | 80 kB 00:00 2024-09-13T17:01:50.189 INFO:teuthology.orchestra.run.smithi087.stdout:(70/138): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-13T17:01:50.202 INFO:teuthology.orchestra.run.smithi149.stdout:(39/138): libgfortran-11.5.0-2.el9.x86_64.rpm 6.7 MB/s | 801 kB 00:00 2024-09-13T17:01:50.248 INFO:teuthology.orchestra.run.smithi087.stdout:(71/138): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-13T17:01:50.253 INFO:teuthology.orchestra.run.smithi149.stdout:(40/138): libquadmath-11.5.0-2.el9.x86_64.rpm 1.9 MB/s | 191 kB 00:00 2024-09-13T17:01:50.278 INFO:teuthology.orchestra.run.smithi118.stdout:(132/138): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.0 MB/s | 16 MB 00:02 2024-09-13T17:01:50.306 INFO:teuthology.orchestra.run.smithi087.stdout:(72/138): python3-jsonpatch-1.21-16.el9.noarch. 439 kB/s | 26 kB 00:00 2024-09-13T17:01:50.311 INFO:teuthology.orchestra.run.smithi149.stdout:(41/138): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-13T17:01:50.328 INFO:teuthology.orchestra.run.smithi118.stdout:(133/138): NetworkManager-1.49.90-1.el9.x86_64. 4.2 MB/s | 2.3 MB 00:00 2024-09-13T17:01:50.365 INFO:teuthology.orchestra.run.smithi087.stdout:(73/138): python3-jsonpointer-2.0-4.el9.noarch. 329 kB/s | 19 kB 00:00 2024-09-13T17:01:50.370 INFO:teuthology.orchestra.run.smithi118.stdout:(134/138): NetworkManager-libnm-1.49.90-1.el9.x 3.6 MB/s | 1.8 MB 00:00 2024-09-13T17:01:50.395 INFO:teuthology.orchestra.run.smithi149.stdout:(42/138): python3-cryptography-36.0.1-4.el9.x86 8.7 MB/s | 1.2 MB 00:00 2024-09-13T17:01:50.395 INFO:teuthology.orchestra.run.smithi118.stdout:(135/138): NetworkManager-tui-1.49.90-1.el9.x86 3.6 MB/s | 249 kB 00:00 2024-09-13T17:01:50.420 INFO:teuthology.orchestra.run.smithi149.stdout:(43/138): python3-ply-3.11-14.el9.noarch.rpm 981 kB/s | 106 kB 00:00 2024-09-13T17:01:50.421 INFO:teuthology.orchestra.run.smithi118.stdout:(136/138): NetworkManager-team-1.49.90-1.el9.x8 286 kB/s | 41 kB 00:00 2024-09-13T17:01:50.441 INFO:teuthology.orchestra.run.smithi087.stdout:(74/138): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-13T17:01:50.466 INFO:teuthology.orchestra.run.smithi087.stdout:(75/138): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-09-13T17:01:50.491 INFO:teuthology.orchestra.run.smithi087.stdout:(76/138): python3-markupsafe-1.1.1-12.el9.x86_6 693 kB/s | 35 kB 00:00 2024-09-13T17:01:50.529 INFO:teuthology.orchestra.run.smithi149.stdout:(44/138): python3-pycparser-2.20-6.el9.noarch.r 1.0 MB/s | 135 kB 00:00 2024-09-13T17:01:50.554 INFO:teuthology.orchestra.run.smithi118.stdout:(137/138): openssl-3.2.2-6.el9.x86_64.rpm 7.4 MB/s | 1.4 MB 00:00 2024-09-13T17:01:50.566 INFO:teuthology.orchestra.run.smithi087.stdout:(77/138): postgresql-server-13.16-1.el9.x86_64. 10 MB/s | 5.8 MB 00:00 2024-09-13T17:01:50.571 INFO:teuthology.orchestra.run.smithi149.stdout:(45/138): python3-requests-2.25.1-8.el9.noarch. 831 kB/s | 125 kB 00:00 2024-09-13T17:01:50.591 INFO:teuthology.orchestra.run.smithi087.stdout:(78/138): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-09-13T17:01:50.625 INFO:teuthology.orchestra.run.smithi087.stdout:(79/138): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-13T17:01:50.650 INFO:teuthology.orchestra.run.smithi087.stdout:(80/138): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-13T17:01:50.654 INFO:teuthology.orchestra.run.smithi149.stdout:(46/138): python3-urllib3-1.26.5-6.el9.noarch.r 1.7 MB/s | 215 kB 00:00 2024-09-13T17:01:50.663 INFO:teuthology.orchestra.run.smithi118.stdout:(138/138): openssl-libs-3.2.2-6.el9.x86_64.rpm 9.0 MB/s | 2.4 MB 00:00 2024-09-13T17:01:50.668 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2024-09-13T17:01:50.668 INFO:teuthology.orchestra.run.smithi118.stdout:Total 20 MB/s | 203 MB 00:10 2024-09-13T17:01:50.684 INFO:teuthology.orchestra.run.smithi087.stdout:(81/138): python3-prettytable-0.7.2-27.el9.noar 724 kB/s | 42 kB 00:00 2024-09-13T17:01:50.709 INFO:teuthology.orchestra.run.smithi087.stdout:(82/138): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-09-13T17:01:50.743 INFO:teuthology.orchestra.run.smithi087.stdout:(83/138): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-13T17:01:50.747 INFO:teuthology.orchestra.run.smithi149.stdout:(47/138): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2024-09-13T17:01:50.759 INFO:teuthology.orchestra.run.smithi087.stdout:(84/138): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-13T17:01:50.788 INFO:teuthology.orchestra.run.smithi149.stdout:(48/138): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-09-13T17:01:50.793 INFO:teuthology.orchestra.run.smithi087.stdout:(85/138): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-13T17:01:50.831 INFO:teuthology.orchestra.run.smithi149.stdout:(49/138): elfutils-libelf-devel-0.191-4.el9.x86 521 kB/s | 22 kB 00:00 2024-09-13T17:01:50.864 INFO:teuthology.orchestra.run.smithi149.stdout:(50/138): bison-3.7.4-5.el9.x86_64.rpm 4.4 MB/s | 943 kB 00:00 2024-09-13T17:01:50.885 INFO:teuthology.orchestra.run.smithi087.stdout:(86/138): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-13T17:01:50.889 INFO:teuthology.orchestra.run.smithi149.stdout:(51/138): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-09-13T17:01:50.906 INFO:teuthology.orchestra.run.smithi149.stdout:(52/138): flexiblas-3.0.4-8.el9.x86_64.rpm 782 kB/s | 33 kB 00:00 2024-09-13T17:01:50.910 INFO:teuthology.orchestra.run.smithi087.stdout:(87/138): python3-toml-0.10.2-6.el9.noarch.rpm 355 kB/s | 42 kB 00:00 2024-09-13T17:01:50.940 INFO:teuthology.orchestra.run.smithi149.stdout:(53/138): flexiblas-openblas-openmp-3.0.4-8.el9 548 kB/s | 18 kB 00:00 2024-09-13T17:01:50.944 INFO:teuthology.orchestra.run.smithi087.stdout:(88/138): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-13T17:01:50.970 INFO:teuthology.orchestra.run.smithi087.stdout:(89/138): uuid-1.6.2-55.el9.x86_64.rpm 985 kB/s | 58 kB 00:00 2024-09-13T17:01:50.999 INFO:teuthology.orchestra.run.smithi149.stdout:(54/138): flexiblas-netlib-3.0.4-8.el9.x86_64.r 28 MB/s | 3.0 MB 00:00 2024-09-13T17:01:51.003 INFO:teuthology.orchestra.run.smithi087.stdout:(90/138): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.6 MB/s | 96 kB 00:00 2024-09-13T17:01:51.016 INFO:teuthology.orchestra.run.smithi149.stdout:(55/138): libaio-devel-0.3.111-13.el9.x86_64.rp 148 kB/s | 11 kB 00:00 2024-09-13T17:01:51.028 INFO:teuthology.orchestra.run.smithi087.stdout:(91/138): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-13T17:01:51.041 INFO:teuthology.orchestra.run.smithi149.stdout:(56/138): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 160 kB 00:00 2024-09-13T17:01:51.062 INFO:teuthology.orchestra.run.smithi087.stdout:(92/138): zlib-devel-1.2.11-41.el9.x86_64.rpm 764 kB/s | 45 kB 00:00 2024-09-13T17:01:51.066 INFO:teuthology.orchestra.run.smithi149.stdout:(57/138): librabbitmq-0.11.0-7.el9.x86_64.rpm 901 kB/s | 45 kB 00:00 2024-09-13T17:01:51.096 INFO:teuthology.orchestra.run.smithi087.stdout:(93/138): fmt-8.1.1-5.el9.x86_64.rpm 1.6 MB/s | 111 kB 00:00 2024-09-13T17:01:51.100 INFO:teuthology.orchestra.run.smithi149.stdout:(58/138): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-13T17:01:51.125 INFO:teuthology.orchestra.run.smithi149.stdout:(59/138): libtool-2.4.6-46.el9.x86_64.rpm 9.7 MB/s | 581 kB 00:00 2024-09-13T17:01:51.138 INFO:teuthology.orchestra.run.smithi087.stdout:(94/138): gperftools-libs-2.9.1-3.el9.x86_64.rp 4.1 MB/s | 308 kB 00:00 2024-09-13T17:01:51.150 INFO:teuthology.orchestra.run.smithi149.stdout:(60/138): libuuid-devel-2.37.4-20.el9.x86_64.rp 487 kB/s | 24 kB 00:00 2024-09-13T17:01:51.176 INFO:teuthology.orchestra.run.smithi149.stdout:(61/138): libzstd-devel-1.5.1-2.el9.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-09-13T17:01:51.188 INFO:teuthology.orchestra.run.smithi087.stdout:(95/138): libarrow-doc-9.0.0-11.el9.noarch.rpm 524 kB/s | 26 kB 00:00 2024-09-13T17:01:51.201 INFO:teuthology.orchestra.run.smithi149.stdout:(62/138): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-13T17:01:51.213 INFO:teuthology.orchestra.run.smithi087.stdout:(96/138): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-13T17:01:51.235 INFO:teuthology.orchestra.run.smithi149.stdout:(63/138): openblas-0.3.26-2.el9.x86_64.rpm 660 kB/s | 38 kB 00:00 2024-09-13T17:01:51.238 INFO:teuthology.orchestra.run.smithi087.stdout:(97/138): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-13T17:01:51.305 INFO:teuthology.orchestra.run.smithi087.stdout:(98/138): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-13T17:01:51.327 INFO:teuthology.orchestra.run.smithi149.stdout:(64/138): openblas-openmp-0.3.26-2.el9.x86_64.r 39 MB/s | 4.9 MB 00:00 2024-09-13T17:01:51.356 INFO:teuthology.orchestra.run.smithi087.stdout:(99/138): python3-asyncssh-2.13.2-5.el9.noarch. 11 MB/s | 548 kB 00:00 2024-09-13T17:01:51.402 INFO:teuthology.orchestra.run.smithi149.stdout:(65/138): openssl-devel-3.2.2-6.el9.x86_64.rpm 27 MB/s | 4.4 MB 00:00 2024-09-13T17:01:51.444 INFO:teuthology.orchestra.run.smithi149.stdout:(66/138): postgresql-13.16-1.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-13T17:01:51.478 INFO:teuthology.orchestra.run.smithi149.stdout:(67/138): postgresql-contrib-13.16-1.el9.x86_64 12 MB/s | 910 kB 00:00 2024-09-13T17:01:51.503 INFO:teuthology.orchestra.run.smithi149.stdout:(68/138): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-13T17:01:51.514 INFO:teuthology.orchestra.run.smithi087.stdout:(100/138): python3-scipy-1.6.2-8.el9.x86_64.rpm 22 MB/s | 16 MB 00:00 2024-09-13T17:01:51.540 INFO:teuthology.orchestra.run.smithi087.stdout:(101/138): python3-bcrypt-3.2.2-1.el9.x86_64.rp 236 kB/s | 43 kB 00:00 2024-09-13T17:01:51.573 INFO:teuthology.orchestra.run.smithi087.stdout:(102/138): python3-certifi-2023.05.07-4.el9.noa 539 kB/s | 14 kB 00:00 2024-09-13T17:01:51.629 INFO:teuthology.orchestra.run.smithi149.stdout:(69/138): postgresql-server-13.16-1.el9.x86_64. 38 MB/s | 5.8 MB 00:00 2024-09-13T17:01:51.648 INFO:teuthology.orchestra.run.smithi087.stdout:(103/138): libarrow-9.0.0-11.el9.x86_64.rpm 8.0 MB/s | 4.4 MB 00:00 2024-09-13T17:01:51.674 INFO:teuthology.orchestra.run.smithi087.stdout:(104/138): python3-cachetools-4.2.4-1.el9.noarc 203 kB/s | 32 kB 00:00 2024-09-13T17:01:51.699 INFO:teuthology.orchestra.run.smithi087.stdout:(105/138): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2024-09-13T17:01:51.712 INFO:teuthology.orchestra.run.smithi149.stdout:(70/138): python3-babel-2.9.1-2.el9.noarch.rpm 29 MB/s | 6.0 MB 00:00 2024-09-13T17:01:51.724 INFO:teuthology.orchestra.run.smithi087.stdout:(106/138): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-13T17:01:51.728 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2024-09-13T17:01:51.738 INFO:teuthology.orchestra.run.smithi149.stdout:(71/138): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-13T17:01:51.749 INFO:teuthology.orchestra.run.smithi087.stdout:(107/138): python3-jaraco-classes-3.2.1-5.el9.n 708 kB/s | 18 kB 00:00 2024-09-13T17:01:51.763 INFO:teuthology.orchestra.run.smithi149.stdout:(72/138): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-09-13T17:01:51.775 INFO:teuthology.orchestra.run.smithi087.stdout:(108/138): python3-google-auth-2.34.0-1.el9.noa 2.1 MB/s | 220 kB 00:00 2024-09-13T17:01:51.788 INFO:teuthology.orchestra.run.smithi149.stdout:(73/138): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-09-13T17:01:51.800 INFO:teuthology.orchestra.run.smithi087.stdout:(109/138): python3-cherrypy-18.6.1-2.el9.noarch 2.3 MB/s | 358 kB 00:00 2024-09-13T17:01:51.813 INFO:teuthology.orchestra.run.smithi149.stdout:(74/138): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-13T17:01:51.825 INFO:teuthology.orchestra.run.smithi087.stdout:(110/138): python3-jaraco-collections-3.0.0-8.e 307 kB/s | 23 kB 00:00 2024-09-13T17:01:51.839 INFO:teuthology.orchestra.run.smithi149.stdout:(75/138): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-13T17:01:51.850 INFO:teuthology.orchestra.run.smithi087.stdout:(111/138): python3-jaraco-functools-3.5.0-2.el9 257 kB/s | 19 kB 00:00 2024-09-13T17:01:51.864 INFO:teuthology.orchestra.run.smithi149.stdout:(76/138): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-09-13T17:01:51.871 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2024-09-13T17:01:51.871 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2024-09-13T17:01:51.892 INFO:teuthology.orchestra.run.smithi087.stdout:(112/138): python3-jaraco-text-3.2.0-6.el9.noar 294 kB/s | 20 kB 00:00 2024-09-13T17:01:51.906 INFO:teuthology.orchestra.run.smithi149.stdout:(77/138): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.9 MB/s | 250 kB 00:00 2024-09-13T17:01:51.918 INFO:teuthology.orchestra.run.smithi087.stdout:(113/138): python3-logutils-0.3.5-21.el9.noarch 693 kB/s | 46 kB 00:00 2024-09-13T17:01:51.943 INFO:teuthology.orchestra.run.smithi087.stdout:(114/138): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-09-13T17:01:51.968 INFO:teuthology.orchestra.run.smithi087.stdout:(115/138): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-13T17:01:51.981 INFO:teuthology.orchestra.run.smithi149.stdout:(78/138): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 5.1 MB 00:00 2024-09-13T17:01:51.993 INFO:teuthology.orchestra.run.smithi087.stdout:(116/138): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-09-13T17:01:52.015 INFO:teuthology.orchestra.run.smithi149.stdout:(79/138): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-09-13T17:01:52.018 INFO:teuthology.orchestra.run.smithi087.stdout:(117/138): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-13T17:01:52.040 INFO:teuthology.orchestra.run.smithi149.stdout:(80/138): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-13T17:01:52.044 INFO:teuthology.orchestra.run.smithi087.stdout:(118/138): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-13T17:01:52.065 INFO:teuthology.orchestra.run.smithi149.stdout:(81/138): python3-prettytable-0.7.2-27.el9.noar 839 kB/s | 42 kB 00:00 2024-09-13T17:01:52.069 INFO:teuthology.orchestra.run.smithi087.stdout:(119/138): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-13T17:01:52.091 INFO:teuthology.orchestra.run.smithi149.stdout:(82/138): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-13T17:01:52.095 INFO:teuthology.orchestra.run.smithi087.stdout:(120/138): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-13T17:01:52.120 INFO:teuthology.orchestra.run.smithi087.stdout:(121/138): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-13T17:01:52.124 INFO:teuthology.orchestra.run.smithi149.stdout:(83/138): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-13T17:01:52.141 INFO:teuthology.orchestra.run.smithi149.stdout:(84/138): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-13T17:01:52.145 INFO:teuthology.orchestra.run.smithi087.stdout:(122/138): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-13T17:01:52.158 INFO:teuthology.orchestra.run.smithi149.stdout:(85/138): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-09-13T17:01:52.171 INFO:teuthology.orchestra.run.smithi087.stdout:(123/138): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-13T17:01:52.192 INFO:teuthology.orchestra.run.smithi149.stdout:(86/138): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 42 kB 00:00 2024-09-13T17:01:52.212 INFO:teuthology.orchestra.run.smithi087.stdout:(124/138): python3-kubernetes-26.1.0-2.el9.noar 2.6 MB/s | 1.0 MB 00:00 2024-09-13T17:01:52.234 INFO:teuthology.orchestra.run.smithi149.stdout:(87/138): socat-1.7.4.1-6.el9.x86_64.rpm 7.2 MB/s | 304 kB 00:00 2024-09-13T17:01:52.237 INFO:teuthology.orchestra.run.smithi087.stdout:(125/138): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-09-13T17:01:52.263 INFO:teuthology.orchestra.run.smithi087.stdout:(126/138): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-13T17:01:52.276 INFO:teuthology.orchestra.run.smithi149.stdout:(88/138): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-09-13T17:01:52.288 INFO:teuthology.orchestra.run.smithi087.stdout:(127/138): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-09-13T17:01:52.313 INFO:teuthology.orchestra.run.smithi087.stdout:(128/138): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-13T17:01:52.318 INFO:teuthology.orchestra.run.smithi149.stdout:(89/138): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 2.3 MB/s | 96 kB 00:00 2024-09-13T17:01:52.339 INFO:teuthology.orchestra.run.smithi087.stdout:(129/138): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-13T17:01:52.397 INFO:teuthology.orchestra.run.smithi087.stdout:(130/138): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-13T17:01:52.494 INFO:teuthology.orchestra.run.smithi149.stdout:(90/138): python3-scipy-1.6.2-8.el9.x86_64.rpm 46 MB/s | 16 MB 00:00 2024-09-13T17:01:52.519 INFO:teuthology.orchestra.run.smithi149.stdout:(91/138): xmlstarlet-1.6.1-20.el9.x86_64.rpm 318 kB/s | 64 kB 00:00 2024-09-13T17:01:52.544 INFO:teuthology.orchestra.run.smithi149.stdout:(92/138): zlib-devel-1.2.11-41.el9.x86_64.rpm 900 kB/s | 45 kB 00:00 2024-09-13T17:01:52.589 INFO:teuthology.orchestra.run.smithi087.stdout:(131/138): librbd1-18.2.4-860.g6c6b083f.el9.x86 12 MB/s | 3.0 MB 00:00 2024-09-13T17:01:52.594 INFO:teuthology.orchestra.run.smithi149.stdout:(93/138): fmt-8.1.1-5.el9.x86_64.rpm 1.4 MB/s | 111 kB 00:00 2024-09-13T17:01:52.636 INFO:teuthology.orchestra.run.smithi149.stdout:(94/138): gperftools-libs-2.9.1-3.el9.x86_64.rp 3.3 MB/s | 308 kB 00:00 2024-09-13T17:01:52.648 INFO:teuthology.orchestra.run.smithi087.stdout:(132/138): librados2-18.2.4-860.g6c6b083f.el9.x 9.9 MB/s | 3.3 MB 00:00 2024-09-13T17:01:52.662 INFO:teuthology.orchestra.run.smithi149.stdout:(95/138): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-13T17:01:52.687 INFO:teuthology.orchestra.run.smithi149.stdout:(96/138): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-13T17:01:52.712 INFO:teuthology.orchestra.run.smithi149.stdout:(97/138): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-13T17:01:52.779 INFO:teuthology.orchestra.run.smithi149.stdout:(98/138): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-13T17:01:52.838 INFO:teuthology.orchestra.run.smithi149.stdout:(99/138): python3-asyncssh-2.13.2-5.el9.noarch. 9.2 MB/s | 548 kB 00:00 2024-09-13T17:01:52.848 INFO:teuthology.orchestra.run.smithi087.stdout:(133/138): NetworkManager-team-1.49.90-1.el9.x8 204 kB/s | 41 kB 00:00 2024-09-13T17:01:52.863 INFO:teuthology.orchestra.run.smithi149.stdout:(100/138): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-13T17:01:52.888 INFO:teuthology.orchestra.run.smithi149.stdout:(101/138): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-13T17:01:52.914 INFO:teuthology.orchestra.run.smithi149.stdout:(102/138): python3-certifi-2023.05.07-4.el9.noa 566 kB/s | 14 kB 00:00 2024-09-13T17:01:52.956 INFO:teuthology.orchestra.run.smithi149.stdout:(103/138): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-13T17:01:53.023 INFO:teuthology.orchestra.run.smithi149.stdout:(104/138): libarrow-9.0.0-11.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-09-13T17:01:53.056 INFO:teuthology.orchestra.run.smithi149.stdout:(105/138): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2024-09-13T17:01:53.082 INFO:teuthology.orchestra.run.smithi149.stdout:(106/138): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-13T17:01:53.107 INFO:teuthology.orchestra.run.smithi149.stdout:(107/138): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-13T17:01:53.132 INFO:teuthology.orchestra.run.smithi087.stdout:(134/138): NetworkManager-tui-1.49.90-1.el9.x86 878 kB/s | 249 kB 00:00 2024-09-13T17:01:53.132 INFO:teuthology.orchestra.run.smithi149.stdout:(108/138): python3-jaraco-classes-3.2.1-5.el9.n 710 kB/s | 18 kB 00:00 2024-09-13T17:01:53.158 INFO:teuthology.orchestra.run.smithi149.stdout:(109/138): python3-jaraco-collections-3.0.0-8.e 459 kB/s | 23 kB 00:00 2024-09-13T17:01:53.183 INFO:teuthology.orchestra.run.smithi149.stdout:(110/138): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-09-13T17:01:53.208 INFO:teuthology.orchestra.run.smithi149.stdout:(111/138): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-13T17:01:53.242 INFO:teuthology.orchestra.run.smithi149.stdout:(112/138): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-13T17:01:53.275 INFO:teuthology.orchestra.run.smithi149.stdout:(113/138): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-13T17:01:53.317 INFO:teuthology.orchestra.run.smithi149.stdout:(114/138): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-09-13T17:01:53.342 INFO:teuthology.orchestra.run.smithi149.stdout:(115/138): python3-natsort-7.1.1-5.el9.noarch.r 862 kB/s | 58 kB 00:00 2024-09-13T17:01:53.368 INFO:teuthology.orchestra.run.smithi149.stdout:(116/138): python3-portend-3.1.0-2.el9.noarch.r 652 kB/s | 16 kB 00:00 2024-09-13T17:01:53.393 INFO:teuthology.orchestra.run.smithi149.stdout:(117/138): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-13T17:01:53.418 INFO:teuthology.orchestra.run.smithi149.stdout:(118/138): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-13T17:01:53.435 INFO:teuthology.orchestra.run.smithi149.stdout:(119/138): python3-repoze-lru-0.7-16.el9.noarch 735 kB/s | 31 kB 00:00 2024-09-13T17:01:53.449 INFO:teuthology.orchestra.run.smithi087.stdout:(135/138): NetworkManager-1.49.90-1.el9.x86_64. 2.2 MB/s | 2.3 MB 00:01 2024-09-13T17:01:53.461 INFO:teuthology.orchestra.run.smithi149.stdout:(120/138): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-13T17:01:53.489 INFO:teuthology.orchestra.run.smithi149.stdout:(121/138): python3-routes-2.5.1-5.el9.noarch.rp 2.6 MB/s | 188 kB 00:00 2024-09-13T17:01:53.514 INFO:teuthology.orchestra.run.smithi149.stdout:(122/138): python3-tempora-5.0.0-2.el9.noarch.r 678 kB/s | 36 kB 00:00 2024-09-13T17:01:53.524 INFO:teuthology.orchestra.run.smithi087.stdout:(136/138): openssl-3.2.2-6.el9.x86_64.rpm 3.5 MB/s | 1.4 MB 00:00 2024-09-13T17:01:53.548 INFO:teuthology.orchestra.run.smithi149.stdout:(123/138): python3-typing-extensions-4.12.2-2.e 1.2 MB/s | 74 kB 00:00 2024-09-13T17:01:53.566 INFO:teuthology.orchestra.run.smithi087.stdout:(137/138): NetworkManager-libnm-1.49.90-1.el9.x 1.8 MB/s | 1.8 MB 00:00 2024-09-13T17:01:53.573 INFO:teuthology.orchestra.run.smithi149.stdout:(124/138): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-13T17:01:53.598 INFO:teuthology.orchestra.run.smithi149.stdout:(125/138): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-13T17:01:53.624 INFO:teuthology.orchestra.run.smithi149.stdout:(126/138): python3-zc-lockfile-2.0-10.el9.noarc 797 kB/s | 20 kB 00:00 2024-09-13T17:01:53.649 INFO:teuthology.orchestra.run.smithi149.stdout:(127/138): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-13T17:01:53.676 INFO:teuthology.orchestra.run.smithi149.stdout:(128/138): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-13T17:01:53.707 INFO:teuthology.orchestra.run.smithi087.stdout:(138/138): openssl-libs-3.2.2-6.el9.x86_64.rpm 9.3 MB/s | 2.4 MB 00:00 2024-09-13T17:01:53.714 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-09-13T17:01:53.714 INFO:teuthology.orchestra.run.smithi087.stdout:Total 21 MB/s | 203 MB 00:09 2024-09-13T17:01:53.724 INFO:teuthology.orchestra.run.smithi149.stdout:(129/138): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-13T17:01:53.920 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2024-09-13T17:01:53.920 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2024-09-13T17:01:53.975 INFO:teuthology.orchestra.run.smithi149.stdout:(130/138): librbd1-18.2.4-860.g6c6b083f.el9.x86 12 MB/s | 3.0 MB 00:00 2024-09-13T17:01:54.359 INFO:teuthology.orchestra.run.smithi149.stdout:(131/138): librados2-18.2.4-860.g6c6b083f.el9.x 4.8 MB/s | 3.3 MB 00:00 2024-09-13T17:01:54.546 INFO:teuthology.orchestra.run.smithi149.stdout:(132/138): NetworkManager-1.49.90-1.el9.x86_64. 4.1 MB/s | 2.3 MB 00:00 2024-09-13T17:01:54.634 INFO:teuthology.orchestra.run.smithi149.stdout:(133/138): NetworkManager-team-1.49.90-1.el9.x8 465 kB/s | 41 kB 00:00 2024-09-13T17:01:54.726 INFO:teuthology.orchestra.run.smithi149.stdout:(134/138): NetworkManager-libnm-1.49.90-1.el9.x 4.9 MB/s | 1.8 MB 00:00 2024-09-13T17:01:54.764 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-09-13T17:01:54.801 INFO:teuthology.orchestra.run.smithi149.stdout:(135/138): NetworkManager-tui-1.49.90-1.el9.x86 1.5 MB/s | 249 kB 00:00 2024-09-13T17:01:54.877 INFO:teuthology.orchestra.run.smithi149.stdout:(136/138): openssl-3.2.2-6.el9.x86_64.rpm 9.0 MB/s | 1.4 MB 00:00 2024-09-13T17:01:54.907 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-09-13T17:01:54.907 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-09-13T17:01:55.527 INFO:teuthology.orchestra.run.smithi149.stdout:(137/138): ceph-test-18.2.4-860.g6c6b083f.el9.x 5.3 MB/s | 40 MB 00:07 2024-09-13T17:01:55.643 INFO:teuthology.orchestra.run.smithi149.stdout:(138/138): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.8 MB/s | 2.4 MB 00:00 2024-09-13T17:01:55.650 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-13T17:01:55.650 INFO:teuthology.orchestra.run.smithi149.stdout:Total 17 MB/s | 203 MB 00:11 2024-09-13T17:01:56.764 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-13T17:01:56.915 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-13T17:01:56.915 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-13T17:01:56.977 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-09-13T17:01:56.978 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-09-13T17:01:58.960 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-13T17:01:58.961 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-13T17:01:59.479 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2024-09-13T17:01:59.617 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/146 2024-09-13T17:01:59.717 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/146 2024-09-13T17:01:59.940 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/146 2024-09-13T17:01:59.990 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/146 2024-09-13T17:02:00.023 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/146 2024-09-13T17:02:00.091 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/146 2024-09-13T17:02:00.416 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/146 2024-09-13T17:02:00.574 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T17:02:00.696 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T17:02:00.734 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T17:02:00.824 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T17:02:00.855 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T17:02:01.015 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/146 2024-09-13T17:02:01.069 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/146 2024-09-13T17:02:01.114 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T17:02:01.214 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T17:02:01.248 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T17:02:01.457 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T17:02:01.628 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 15/146 2024-09-13T17:02:01.746 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T17:02:01.813 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T17:02:02.101 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T17:02:02.143 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/146 2024-09-13T17:02:02.177 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/146 2024-09-13T17:02:02.241 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/146 2024-09-13T17:02:02.276 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/146 2024-09-13T17:02:02.305 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/146 2024-09-13T17:02:02.374 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/146 2024-09-13T17:02:02.426 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 23/146 2024-09-13T17:02:02.466 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 24/146 2024-09-13T17:02:02.496 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-09-13T17:02:02.521 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 25/146 2024-09-13T17:02:02.595 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 26/146 2024-09-13T17:02:02.627 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/146 2024-09-13T17:02:02.629 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 27/146 2024-09-13T17:02:02.670 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/146 2024-09-13T17:02:02.673 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 28/146 2024-09-13T17:02:02.736 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/146 2024-09-13T17:02:02.746 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 29/146 2024-09-13T17:02:02.768 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/146 2024-09-13T17:02:02.794 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/146 2024-09-13T17:02:02.845 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/146 2024-09-13T17:02:02.887 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/146 2024-09-13T17:02:02.957 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/146 2024-09-13T17:02:03.277 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/146 2024-09-13T17:02:03.387 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T17:02:03.491 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/146 2024-09-13T17:02:03.513 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T17:02:03.547 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T17:02:03.578 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/146 2024-09-13T17:02:03.617 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 34/146 2024-09-13T17:02:03.637 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T17:02:03.654 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 35/146 2024-09-13T17:02:03.676 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T17:02:03.704 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/146 2024-09-13T17:02:03.846 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/146 2024-09-13T17:02:03.888 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 37/146 2024-09-13T17:02:03.897 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/146 2024-09-13T17:02:03.925 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T17:02:03.939 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 38/146 2024-09-13T17:02:04.026 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T17:02:04.045 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : re2-1:20211101-20.el9.x86_64 39/146 2024-09-13T17:02:04.051 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T17:02:04.084 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 40/146 2024-09-13T17:02:04.139 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/146 2024-09-13T17:02:04.211 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/146 2024-09-13T17:02:04.244 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 43/146 2024-09-13T17:02:04.275 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T17:02:04.288 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/146 2024-09-13T17:02:04.344 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/146 2024-09-13T17:02:04.397 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/146 2024-09-13T17:02:04.406 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 15/146 2024-09-13T17:02:04.439 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/146 2024-09-13T17:02:04.503 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T17:02:04.573 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/146 2024-09-13T17:02:04.599 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T17:02:04.616 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/146 2024-09-13T17:02:04.657 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/146 2024-09-13T17:02:04.758 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/146 2024-09-13T17:02:04.792 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 52/146 2024-09-13T17:02:04.804 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-13T17:02:04.850 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/146 2024-09-13T17:02:04.881 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/146 2024-09-13T17:02:04.882 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 54/146 2024-09-13T17:02:04.897 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T17:02:04.909 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 55/146 2024-09-13T17:02:04.926 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/146 2024-09-13T17:02:04.934 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : fmt-8.1.1-5.el9.x86_64 56/146 2024-09-13T17:02:04.937 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/146 2024-09-13T17:02:04.963 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 57/146 2024-09-13T17:02:04.979 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/146 2024-09-13T17:02:04.997 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 58/146 2024-09-13T17:02:04.998 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/146 2024-09-13T17:02:05.033 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : uuid-1.6.2-55.el9.x86_64 59/146 2024-09-13T17:02:05.040 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/146 2024-09-13T17:02:05.044 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/146 2024-09-13T17:02:05.065 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/146 2024-09-13T17:02:05.072 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 60/146 2024-09-13T17:02:05.078 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/146 2024-09-13T17:02:05.106 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/146 2024-09-13T17:02:05.107 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 61/146 2024-09-13T17:02:05.119 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/146 2024-09-13T17:02:05.140 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 62/146 2024-09-13T17:02:05.183 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/146 2024-09-13T17:02:05.190 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 63/146 2024-09-13T17:02:05.233 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 64/146 2024-09-13T17:02:05.245 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 23/146 2024-09-13T17:02:05.276 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 24/146 2024-09-13T17:02:05.320 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 25/146 2024-09-13T17:02:05.394 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 26/146 2024-09-13T17:02:05.411 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 65/146 2024-09-13T17:02:05.430 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 27/146 2024-09-13T17:02:05.442 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/146 2024-09-13T17:02:05.481 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 28/146 2024-09-13T17:02:05.490 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 66/146 2024-09-13T17:02:05.556 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 29/146 2024-09-13T17:02:05.558 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T17:02:05.587 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/146 2024-09-13T17:02:05.637 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 68/146 2024-09-13T17:02:05.685 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T17:02:05.707 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/146 2024-09-13T17:02:05.718 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T17:02:05.759 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/146 2024-09-13T17:02:05.809 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T17:02:05.839 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T17:02:06.017 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/146 2024-09-13T17:02:06.078 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/146 2024-09-13T17:02:06.105 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T17:02:06.215 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T17:02:06.239 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T17:02:06.298 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/146 2024-09-13T17:02:06.342 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 69/146 2024-09-13T17:02:06.389 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/146 2024-09-13T17:02:06.392 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 70/146 2024-09-13T17:02:06.434 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 71/146 2024-09-13T17:02:06.435 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 34/146 2024-09-13T17:02:06.472 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 35/146 2024-09-13T17:02:06.496 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T17:02:06.514 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/146 2024-09-13T17:02:06.526 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 72/146 2024-09-13T17:02:06.572 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 73/146 2024-09-13T17:02:06.603 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 15/146 2024-09-13T17:02:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 37/146 2024-09-13T17:02:06.720 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T17:02:06.722 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 38/146 2024-09-13T17:02:06.755 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openblas-0.3.26-2.el9.x86_64 74/146 2024-09-13T17:02:06.795 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 75/146 2024-09-13T17:02:06.805 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T17:02:06.830 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : re2-1:20211101-20.el9.x86_64 39/146 2024-09-13T17:02:06.867 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 40/146 2024-09-13T17:02:06.872 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 76/146 2024-09-13T17:02:06.923 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/146 2024-09-13T17:02:07.003 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/146 2024-09-13T17:02:07.044 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 43/146 2024-09-13T17:02:07.077 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T17:02:07.080 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/146 2024-09-13T17:02:07.109 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/146 2024-09-13T17:02:07.126 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/146 2024-09-13T17:02:07.143 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/146 2024-09-13T17:02:07.171 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/146 2024-09-13T17:02:07.213 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/146 2024-09-13T17:02:07.217 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/146 2024-09-13T17:02:07.259 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/146 2024-09-13T17:02:07.287 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/146 2024-09-13T17:02:07.349 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/146 2024-09-13T17:02:07.355 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/146 2024-09-13T17:02:07.390 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/146 2024-09-13T17:02:07.409 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 23/146 2024-09-13T17:02:07.439 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/146 2024-09-13T17:02:07.440 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 24/146 2024-09-13T17:02:07.484 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 25/146 2024-09-13T17:02:07.510 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 77/146 2024-09-13T17:02:07.542 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/146 2024-09-13T17:02:07.559 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 26/146 2024-09-13T17:02:07.583 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 52/146 2024-09-13T17:02:07.594 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 27/146 2024-09-13T17:02:07.623 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/146 2024-09-13T17:02:07.638 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 28/146 2024-09-13T17:02:07.651 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T17:02:07.656 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 54/146 2024-09-13T17:02:07.683 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 55/146 2024-09-13T17:02:07.712 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 29/146 2024-09-13T17:02:07.716 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : fmt-8.1.1-5.el9.x86_64 56/146 2024-09-13T17:02:07.746 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 57/146 2024-09-13T17:02:07.779 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 58/146 2024-09-13T17:02:07.815 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : uuid-1.6.2-55.el9.x86_64 59/146 2024-09-13T17:02:07.854 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 60/146 2024-09-13T17:02:07.861 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/146 2024-09-13T17:02:07.896 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 61/146 2024-09-13T17:02:07.914 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/146 2024-09-13T17:02:07.930 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 62/146 2024-09-13T17:02:07.971 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 63/146 2024-09-13T17:02:08.006 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 64/146 2024-09-13T17:02:08.041 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 65/146 2024-09-13T17:02:08.087 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 66/146 2024-09-13T17:02:08.184 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/146 2024-09-13T17:02:08.242 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 68/146 2024-09-13T17:02:08.447 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/146 2024-09-13T17:02:08.545 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/146 2024-09-13T17:02:08.591 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 34/146 2024-09-13T17:02:08.629 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 35/146 2024-09-13T17:02:08.671 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/146 2024-09-13T17:02:08.841 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 37/146 2024-09-13T17:02:08.904 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 38/146 2024-09-13T17:02:08.907 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T17:02:08.956 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 69/146 2024-09-13T17:02:09.009 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 70/146 2024-09-13T17:02:09.012 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : re2-1:20211101-20.el9.x86_64 39/146 2024-09-13T17:02:09.022 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 80/146 2024-09-13T17:02:09.043 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 71/146 2024-09-13T17:02:09.049 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 40/146 2024-09-13T17:02:09.050 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 81/146 2024-09-13T17:02:09.083 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 82/146 2024-09-13T17:02:09.104 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/146 2024-09-13T17:02:09.142 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 72/146 2024-09-13T17:02:09.185 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/146 2024-09-13T17:02:09.185 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 73/146 2024-09-13T17:02:09.226 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 43/146 2024-09-13T17:02:09.262 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/146 2024-09-13T17:02:09.309 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/146 2024-09-13T17:02:09.362 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/146 2024-09-13T17:02:09.369 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openblas-0.3.26-2.el9.x86_64 74/146 2024-09-13T17:02:09.396 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 83/146 2024-09-13T17:02:09.404 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/146 2024-09-13T17:02:09.408 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 75/146 2024-09-13T17:02:09.446 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T17:02:09.487 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 76/146 2024-09-13T17:02:09.520 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T17:02:09.540 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/146 2024-09-13T17:02:09.559 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 85/146 2024-09-13T17:02:09.589 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/146 2024-09-13T17:02:09.595 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 86/146 2024-09-13T17:02:09.630 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/146 2024-09-13T17:02:09.734 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/146 2024-09-13T17:02:09.765 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 52/146 2024-09-13T17:02:09.806 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/146 2024-09-13T17:02:09.847 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 54/146 2024-09-13T17:02:09.874 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 55/146 2024-09-13T17:02:09.907 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : fmt-8.1.1-5.el9.x86_64 56/146 2024-09-13T17:02:09.936 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 57/146 2024-09-13T17:02:09.970 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 58/146 2024-09-13T17:02:09.999 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 87/146 2024-09-13T17:02:10.006 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : uuid-1.6.2-55.el9.x86_64 59/146 2024-09-13T17:02:10.032 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T17:02:10.036 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 60/146 2024-09-13T17:02:10.071 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 61/146 2024-09-13T17:02:10.105 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 62/146 2024-09-13T17:02:10.105 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T17:02:10.125 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 77/146 2024-09-13T17:02:10.127 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 89/146 2024-09-13T17:02:10.146 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 63/146 2024-09-13T17:02:10.181 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 64/146 2024-09-13T17:02:10.219 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 65/146 2024-09-13T17:02:10.247 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T17:02:10.266 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 66/146 2024-09-13T17:02:10.364 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/146 2024-09-13T17:02:10.590 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 68/146 2024-09-13T17:02:11.317 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 69/146 2024-09-13T17:02:11.385 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 70/146 2024-09-13T17:02:11.419 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 71/146 2024-09-13T17:02:11.495 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T17:02:11.517 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 72/146 2024-09-13T17:02:11.569 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 73/146 2024-09-13T17:02:11.586 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 80/146 2024-09-13T17:02:11.615 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 81/146 2024-09-13T17:02:11.648 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 82/146 2024-09-13T17:02:11.756 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-0.3.26-2.el9.x86_64 74/146 2024-09-13T17:02:11.792 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 75/146 2024-09-13T17:02:11.871 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 76/146 2024-09-13T17:02:11.957 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 83/146 2024-09-13T17:02:12.002 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T17:02:12.057 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T17:02:12.093 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T17:02:12.099 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T17:02:12.124 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 85/146 2024-09-13T17:02:12.159 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 86/146 2024-09-13T17:02:12.536 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 77/146 2024-09-13T17:02:12.568 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 87/146 2024-09-13T17:02:12.596 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T17:02:12.631 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T17:02:12.657 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T17:02:12.667 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T17:02:12.670 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T17:02:12.690 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 89/146 2024-09-13T17:02:12.765 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T17:02:12.766 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T17:02:12.766 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T17:02:12.766 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-13T17:02:12.804 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T17:02:13.926 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T17:02:14.007 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 80/146 2024-09-13T17:02:14.035 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 81/146 2024-09-13T17:02:14.068 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 82/146 2024-09-13T17:02:14.368 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 83/146 2024-09-13T17:02:14.414 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T17:02:14.497 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T17:02:14.527 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 85/146 2024-09-13T17:02:14.564 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 86/146 2024-09-13T17:02:14.697 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T17:02:14.728 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T17:02:14.969 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 87/146 2024-09-13T17:02:14.992 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T17:02:15.063 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T17:02:15.111 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 89/146 2024-09-13T17:02:15.250 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T17:02:15.290 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T17:02:15.391 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T17:02:15.391 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T17:02:15.391 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T17:02:15.392 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:02:15.441 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T17:02:17.200 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T17:02:17.233 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T17:02:17.790 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T17:02:17.827 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T17:02:17.928 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T17:02:17.928 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T17:02:17.928 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T17:02:17.928 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T17:02:17.971 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T17:02:24.801 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T17:02:24.801 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /sys 2024-09-13T17:02:24.801 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /proc 2024-09-13T17:02:24.802 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /mnt 2024-09-13T17:02:24.802 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /var/tmp 2024-09-13T17:02:24.802 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /home 2024-09-13T17:02:24.802 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /root 2024-09-13T17:02:24.802 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /tmp 2024-09-13T17:02:24.802 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-13T17:02:24.985 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T17:02:25.000 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T17:02:25.000 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:02:25.000 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T17:02:25.000 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-13T17:02:26.463 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T17:02:26.489 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T17:02:26.489 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:02:26.489 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T17:02:26.489 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T17:02:26.489 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T17:02:26.489 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-13T17:02:26.697 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T17:02:26.720 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T17:02:26.720 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:02:26.720 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T17:02:26.720 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T17:02:26.720 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T17:02:26.720 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-13T17:02:26.772 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T17:02:26.772 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /sys 2024-09-13T17:02:26.772 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /proc 2024-09-13T17:02:26.772 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /mnt 2024-09-13T17:02:26.772 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /var/tmp 2024-09-13T17:02:26.772 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /home 2024-09-13T17:02:26.772 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /root 2024-09-13T17:02:26.772 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /tmp 2024-09-13T17:02:26.772 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:02:26.932 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T17:02:26.948 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T17:02:26.948 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:02:26.948 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T17:02:26.948 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:02:27.164 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T17:02:27.187 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T17:02:27.187 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:02:27.187 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T17:02:27.187 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T17:02:27.187 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T17:02:27.187 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-13T17:02:27.294 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : automake-1.16.2-8.el9.noarch 97/146 2024-09-13T17:02:27.351 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ply-3.11-14.el9.noarch 98/146 2024-09-13T17:02:27.406 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 99/146 2024-09-13T17:02:27.589 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 100/146 2024-09-13T17:02:27.641 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 101/146 2024-09-13T17:02:27.717 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 102/146 2024-09-13T17:02:27.813 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 103/146 2024-09-13T17:02:27.952 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/146 2024-09-13T17:02:27.999 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 105/146 2024-09-13T17:02:28.039 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 106/146 2024-09-13T17:02:28.067 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : fuse-2.9.9-16.el9.x86_64 107/146 2024-09-13T17:02:28.435 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T17:02:28.447 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T17:02:28.461 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T17:02:28.461 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:02:28.461 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T17:02:28.462 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T17:02:28.462 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T17:02:28.462 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:02:28.482 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T17:02:28.511 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 109/146 2024-09-13T17:02:28.574 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 110/146 2024-09-13T17:02:28.597 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T17:02:28.669 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T17:02:28.692 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T17:02:28.692 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:02:28.692 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T17:02:28.692 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T17:02:28.692 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T17:02:28.692 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:02:29.137 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T17:02:29.159 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T17:02:29.159 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:02:29.159 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T17:02:29.160 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T17:02:29.160 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T17:02:29.160 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:02:29.266 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : automake-1.16.2-8.el9.noarch 97/146 2024-09-13T17:02:29.323 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ply-3.11-14.el9.noarch 98/146 2024-09-13T17:02:29.378 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 99/146 2024-09-13T17:02:29.546 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T17:02:29.546 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /sys 2024-09-13T17:02:29.546 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /proc 2024-09-13T17:02:29.546 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /mnt 2024-09-13T17:02:29.547 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /var/tmp 2024-09-13T17:02:29.547 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /home 2024-09-13T17:02:29.547 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /root 2024-09-13T17:02:29.547 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /tmp 2024-09-13T17:02:29.547 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T17:02:29.563 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 100/146 2024-09-13T17:02:29.620 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 101/146 2024-09-13T17:02:29.638 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T17:02:29.690 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 102/146 2024-09-13T17:02:29.699 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T17:02:29.726 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T17:02:29.743 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T17:02:29.743 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:02:29.743 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T17:02:29.743 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T17:02:29.778 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 103/146 2024-09-13T17:02:29.919 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/146 2024-09-13T17:02:29.970 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 105/146 2024-09-13T17:02:30.002 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 106/146 2024-09-13T17:02:30.029 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : fuse-2.9.9-16.el9.x86_64 107/146 2024-09-13T17:02:30.477 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T17:02:30.503 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T17:02:30.532 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 109/146 2024-09-13T17:02:30.603 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 110/146 2024-09-13T17:02:30.649 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T17:02:30.660 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T17:02:30.708 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T17:02:30.809 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T17:02:31.015 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 114/146 2024-09-13T17:02:31.044 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T17:02:31.067 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T17:02:31.067 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:02:31.068 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T17:02:31.068 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T17:02:31.068 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T17:02:31.068 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-13T17:02:31.111 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T17:02:31.123 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T17:02:31.213 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T17:02:31.216 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 117/146 2024-09-13T17:02:31.240 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T17:02:31.240 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:02:31.240 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T17:02:31.240 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T17:02:31.240 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T17:02:31.240 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T17:02:31.271 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 118/146 2024-09-13T17:02:31.447 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T17:02:31.470 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T17:02:31.470 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:02:31.471 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T17:02:31.471 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T17:02:31.471 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T17:02:31.471 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T17:02:31.683 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T17:02:31.719 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T17:02:31.914 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T17:02:31.938 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T17:02:31.938 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:02:31.938 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T17:02:31.938 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T17:02:31.938 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T17:02:31.938 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T17:02:32.019 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libtool-2.4.6-46.el9.x86_64 119/146 2024-09-13T17:02:32.044 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : automake-1.16.2-8.el9.noarch 97/146 2024-09-13T17:02:32.047 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T17:02:32.071 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T17:02:32.071 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:02:32.071 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T17:02:32.071 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T17:02:32.071 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T17:02:32.071 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-13T17:02:32.101 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ply-3.11-14.el9.noarch 98/146 2024-09-13T17:02:32.123 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T17:02:32.146 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T17:02:32.146 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:02:32.146 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T17:02:32.146 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-13T17:02:32.165 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 99/146 2024-09-13T17:02:32.199 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T17:02:32.222 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T17:02:32.222 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:02:32.222 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-13T17:02:32.222 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T17:02:32.222 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T17:02:32.222 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-13T17:02:32.358 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 100/146 2024-09-13T17:02:32.415 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 101/146 2024-09-13T17:02:32.483 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 102/146 2024-09-13T17:02:32.525 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T17:02:32.547 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T17:02:32.548 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:02:32.548 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T17:02:32.548 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T17:02:32.548 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T17:02:32.548 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-13T17:02:32.573 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 103/146 2024-09-13T17:02:32.674 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T17:02:32.703 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T17:02:32.727 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/146 2024-09-13T17:02:32.765 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 105/146 2024-09-13T17:02:32.797 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 106/146 2024-09-13T17:02:32.804 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T17:02:32.824 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : fuse-2.9.9-16.el9.x86_64 107/146 2024-09-13T17:02:32.971 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 114/146 2024-09-13T17:02:32.997 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T17:02:33.020 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T17:02:33.021 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:02:33.021 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T17:02:33.021 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T17:02:33.021 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T17:02:33.021 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:02:33.072 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T17:02:33.083 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T17:02:33.179 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 117/146 2024-09-13T17:02:33.214 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T17:02:33.240 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T17:02:33.245 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 118/146 2024-09-13T17:02:33.277 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 109/146 2024-09-13T17:02:33.341 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 110/146 2024-09-13T17:02:33.372 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T17:02:33.970 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libtool-2.4.6-46.el9.x86_64 119/146 2024-09-13T17:02:34.008 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T17:02:34.031 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T17:02:34.031 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:02:34.031 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T17:02:34.031 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T17:02:34.032 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T17:02:34.032 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:02:34.075 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T17:02:34.098 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T17:02:34.098 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:02:34.098 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T17:02:34.098 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:02:34.143 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T17:02:34.166 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T17:02:34.166 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:02:34.166 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-13T17:02:34.166 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T17:02:34.166 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T17:02:34.166 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:02:34.422 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T17:02:34.460 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T17:02:34.482 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T17:02:34.483 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T17:02:34.483 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:02:34.483 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T17:02:34.483 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T17:02:34.483 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T17:02:34.483 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:02:35.453 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T17:02:35.483 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T17:02:35.586 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T17:02:35.759 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 114/146 2024-09-13T17:02:35.785 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T17:02:35.809 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T17:02:35.809 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:02:35.809 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T17:02:35.809 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T17:02:35.810 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T17:02:35.810 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T17:02:35.860 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T17:02:35.873 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T17:02:35.966 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 117/146 2024-09-13T17:02:36.049 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 118/146 2024-09-13T17:02:36.245 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 124/146 2024-09-13T17:02:36.286 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 125/146 2024-09-13T17:02:36.327 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 126/146 2024-09-13T17:02:36.359 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 127/146 2024-09-13T17:02:36.547 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 128/146 2024-09-13T17:02:36.616 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 129/146 2024-09-13T17:02:36.647 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 130/146 2024-09-13T17:02:36.676 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 131/146 2024-09-13T17:02:36.724 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 132/146 2024-09-13T17:02:36.771 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libtool-2.4.6-46.el9.x86_64 119/146 2024-09-13T17:02:36.804 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T17:02:36.828 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T17:02:36.828 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:02:36.828 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T17:02:36.828 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T17:02:36.828 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T17:02:36.828 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T17:02:36.880 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T17:02:36.903 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T17:02:36.904 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:02:36.904 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T17:02:36.904 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T17:02:36.948 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T17:02:36.971 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T17:02:36.971 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:02:36.971 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-13T17:02:36.971 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T17:02:36.971 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T17:02:36.971 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T17:02:37.265 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T17:02:37.289 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T17:02:37.289 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:02:37.289 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T17:02:37.289 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T17:02:37.290 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T17:02:37.290 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T17:02:37.302 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T17:02:37.355 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T17:02:37.374 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T17:02:38.155 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 124/146 2024-09-13T17:02:38.196 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 125/146 2024-09-13T17:02:38.199 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 134/146 2024-09-13T17:02:38.237 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 126/146 2024-09-13T17:02:38.269 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 127/146 2024-09-13T17:02:38.286 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 135/146 2024-09-13T17:02:38.335 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 136/146 2024-09-13T17:02:38.429 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flex-2.6.4-9.el9.x86_64 137/146 2024-09-13T17:02:38.464 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : bison-3.7.4-5.el9.x86_64 138/146 2024-09-13T17:02:38.474 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 128/146 2024-09-13T17:02:38.489 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 139/146 2024-09-13T17:02:38.516 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/146 2024-09-13T17:02:38.516 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T17:02:38.542 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 129/146 2024-09-13T17:02:38.573 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 130/146 2024-09-13T17:02:38.592 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T17:02:38.592 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T17:02:38.602 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 131/146 2024-09-13T17:02:38.640 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 132/146 2024-09-13T17:02:38.676 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T17:02:38.709 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 143/146 2024-09-13T17:02:38.716 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T17:02:38.716 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T17:02:38.904 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T17:02:38.904 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T17:02:38.988 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T17:02:39.051 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T17:02:39.293 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T17:02:39.330 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T17:02:39.350 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T17:02:40.180 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 134/146 2024-09-13T17:02:40.276 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 135/146 2024-09-13T17:02:40.357 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 136/146 2024-09-13T17:02:40.443 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flex-2.6.4-9.el9.x86_64 137/146 2024-09-13T17:02:40.479 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : bison-3.7.4-5.el9.x86_64 138/146 2024-09-13T17:02:40.504 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 139/146 2024-09-13T17:02:40.530 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/146 2024-09-13T17:02:40.530 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T17:02:40.614 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T17:02:40.614 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T17:02:40.698 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T17:02:40.723 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 143/146 2024-09-13T17:02:40.728 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T17:02:40.729 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T17:02:40.908 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T17:02:40.908 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T17:02:40.985 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 124/146 2024-09-13T17:02:40.992 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T17:02:41.027 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 125/146 2024-09-13T17:02:41.057 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T17:02:41.067 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 126/146 2024-09-13T17:02:41.099 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 127/146 2024-09-13T17:02:41.297 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 128/146 2024-09-13T17:02:41.339 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 129/146 2024-09-13T17:02:41.370 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 130/146 2024-09-13T17:02:41.399 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 131/146 2024-09-13T17:02:41.445 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 132/146 2024-09-13T17:02:42.090 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T17:02:42.127 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T17:02:42.148 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T17:02:43.013 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 134/146 2024-09-13T17:02:43.099 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 135/146 2024-09-13T17:02:43.149 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 136/146 2024-09-13T17:02:43.250 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flex-2.6.4-9.el9.x86_64 137/146 2024-09-13T17:02:43.286 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : bison-3.7.4-5.el9.x86_64 138/146 2024-09-13T17:02:43.311 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 139/146 2024-09-13T17:02:43.346 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/146 2024-09-13T17:02:43.346 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T17:02:43.430 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T17:02:43.430 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T17:02:43.514 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T17:02:43.538 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 143/146 2024-09-13T17:02:43.545 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T17:02:43.545 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T17:02:43.724 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T17:02:43.724 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T17:02:43.818 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T17:02:43.889 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T17:02:45.623 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T17:02:45.623 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 1/146 2024-09-13T17:02:45.623 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2/146 2024-09-13T17:02:45.623 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 3/146 2024-09-13T17:02:45.623 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 4/146 2024-09-13T17:02:45.623 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 5/146 2024-09-13T17:02:45.623 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 6/146 2024-09-13T17:02:45.624 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 7/146 2024-09-13T17:02:45.624 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T17:02:45.624 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T17:02:45.624 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T17:02:45.624 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 11/146 2024-09-13T17:02:45.624 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 12/146 2024-09-13T17:02:45.624 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T17:02:45.624 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 14/146 2024-09-13T17:02:45.624 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 15/146 2024-09-13T17:02:45.624 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 16/146 2024-09-13T17:02:45.624 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 17/146 2024-09-13T17:02:45.624 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 18/146 2024-09-13T17:02:45.624 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 19/146 2024-09-13T17:02:45.625 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 20/146 2024-09-13T17:02:45.625 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 21/146 2024-09-13T17:02:45.625 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 22/146 2024-09-13T17:02:45.625 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 23/146 2024-09-13T17:02:45.625 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 24/146 2024-09-13T17:02:45.625 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 25/146 2024-09-13T17:02:45.625 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 26/146 2024-09-13T17:02:45.625 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 27/146 2024-09-13T17:02:45.625 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 28/146 2024-09-13T17:02:45.625 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 29/146 2024-09-13T17:02:45.625 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 30/146 2024-09-13T17:02:45.625 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 31/146 2024-09-13T17:02:45.625 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 32/146 2024-09-13T17:02:45.626 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 33/146 2024-09-13T17:02:45.626 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 34/146 2024-09-13T17:02:45.626 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 35/146 2024-09-13T17:02:45.626 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 36/146 2024-09-13T17:02:45.626 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 37/146 2024-09-13T17:02:45.626 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 38/146 2024-09-13T17:02:45.626 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/146 2024-09-13T17:02:45.626 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 40/146 2024-09-13T17:02:45.626 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 41/146 2024-09-13T17:02:45.626 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/146 2024-09-13T17:02:45.626 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/146 2024-09-13T17:02:45.626 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/146 2024-09-13T17:02:45.626 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/146 2024-09-13T17:02:45.627 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/146 2024-09-13T17:02:45.627 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/146 2024-09-13T17:02:45.627 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/146 2024-09-13T17:02:45.627 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/146 2024-09-13T17:02:45.627 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 50/146 2024-09-13T17:02:45.627 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 51/146 2024-09-13T17:02:45.627 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flex-2.6.4-9.el9.x86_64 52/146 2024-09-13T17:02:45.627 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 53/146 2024-09-13T17:02:45.627 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 54/146 2024-09-13T17:02:45.627 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 55/146 2024-09-13T17:02:45.627 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 56/146 2024-09-13T17:02:45.627 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/146 2024-09-13T17:02:45.628 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/146 2024-09-13T17:02:45.628 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/146 2024-09-13T17:02:45.628 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 60/146 2024-09-13T17:02:45.628 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 61/146 2024-09-13T17:02:45.628 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 62/146 2024-09-13T17:02:45.628 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 63/146 2024-09-13T17:02:45.628 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 64/146 2024-09-13T17:02:45.628 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 65/146 2024-09-13T17:02:45.628 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 66/146 2024-09-13T17:02:45.628 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : postgresql-13.16-1.el9.x86_64 67/146 2024-09-13T17:02:45.628 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 68/146 2024-09-13T17:02:45.628 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 69/146 2024-09-13T17:02:45.629 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 70/146 2024-09-13T17:02:45.629 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 71/146 2024-09-13T17:02:45.629 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 72/146 2024-09-13T17:02:45.629 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 73/146 2024-09-13T17:02:45.629 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 74/146 2024-09-13T17:02:45.629 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 75/146 2024-09-13T17:02:45.629 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 76/146 2024-09-13T17:02:45.629 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 77/146 2024-09-13T17:02:45.629 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T17:02:45.630 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T17:02:45.630 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 80/146 2024-09-13T17:02:45.630 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 81/146 2024-09-13T17:02:45.630 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 82/146 2024-09-13T17:02:45.630 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 83/146 2024-09-13T17:02:45.630 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 84/146 2024-09-13T17:02:45.630 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 85/146 2024-09-13T17:02:45.630 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/146 2024-09-13T17:02:45.630 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 87/146 2024-09-13T17:02:45.630 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 88/146 2024-09-13T17:02:45.630 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/146 2024-09-13T17:02:45.630 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 90/146 2024-09-13T17:02:45.630 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 91/146 2024-09-13T17:02:45.631 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 92/146 2024-09-13T17:02:45.631 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 93/146 2024-09-13T17:02:45.631 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 94/146 2024-09-13T17:02:45.631 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 95/146 2024-09-13T17:02:45.631 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 96/146 2024-09-13T17:02:45.631 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 97/146 2024-09-13T17:02:45.631 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/146 2024-09-13T17:02:45.631 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/146 2024-09-13T17:02:45.631 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 100/146 2024-09-13T17:02:45.631 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 101/146 2024-09-13T17:02:45.631 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/146 2024-09-13T17:02:45.632 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/146 2024-09-13T17:02:45.632 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 104/146 2024-09-13T17:02:45.632 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/146 2024-09-13T17:02:45.632 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/146 2024-09-13T17:02:45.632 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 107/146 2024-09-13T17:02:45.632 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/146 2024-09-13T17:02:45.632 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/146 2024-09-13T17:02:45.632 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/146 2024-09-13T17:02:45.632 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/146 2024-09-13T17:02:45.632 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/146 2024-09-13T17:02:45.632 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 113/146 2024-09-13T17:02:45.632 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 114/146 2024-09-13T17:02:45.633 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 115/146 2024-09-13T17:02:45.633 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 116/146 2024-09-13T17:02:45.633 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 117/146 2024-09-13T17:02:45.633 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 118/146 2024-09-13T17:02:45.633 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/146 2024-09-13T17:02:45.633 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 120/146 2024-09-13T17:02:45.633 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 121/146 2024-09-13T17:02:45.633 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 122/146 2024-09-13T17:02:45.633 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 123/146 2024-09-13T17:02:45.633 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 124/146 2024-09-13T17:02:45.633 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 125/146 2024-09-13T17:02:45.633 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 126/146 2024-09-13T17:02:45.633 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 127/146 2024-09-13T17:02:45.634 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 128/146 2024-09-13T17:02:45.634 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : re2-1:20211101-20.el9.x86_64 129/146 2024-09-13T17:02:45.634 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 130/146 2024-09-13T17:02:45.634 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 131/146 2024-09-13T17:02:45.634 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 132/146 2024-09-13T17:02:45.634 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 133/146 2024-09-13T17:02:45.634 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 134/146 2024-09-13T17:02:45.634 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 135/146 2024-09-13T17:02:45.634 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 136/146 2024-09-13T17:02:45.634 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 137/146 2024-09-13T17:02:45.634 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 138/146 2024-09-13T17:02:45.634 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 139/146 2024-09-13T17:02:45.634 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 140/146 2024-09-13T17:02:45.634 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 141/146 2024-09-13T17:02:45.635 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 142/146 2024-09-13T17:02:45.635 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 143/146 2024-09-13T17:02:45.635 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 144/146 2024-09-13T17:02:45.635 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 145/146 2024-09-13T17:02:46.395 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T17:02:46.395 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 1/146 2024-09-13T17:02:46.395 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2/146 2024-09-13T17:02:46.396 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 3/146 2024-09-13T17:02:46.396 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 4/146 2024-09-13T17:02:46.396 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 5/146 2024-09-13T17:02:46.396 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 6/146 2024-09-13T17:02:46.397 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 7/146 2024-09-13T17:02:46.397 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T17:02:46.397 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T17:02:46.397 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T17:02:46.397 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 11/146 2024-09-13T17:02:46.397 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 12/146 2024-09-13T17:02:46.398 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T17:02:46.398 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 14/146 2024-09-13T17:02:46.398 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 15/146 2024-09-13T17:02:46.398 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 16/146 2024-09-13T17:02:46.398 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 17/146 2024-09-13T17:02:46.398 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 18/146 2024-09-13T17:02:46.398 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 19/146 2024-09-13T17:02:46.398 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 20/146 2024-09-13T17:02:46.398 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 21/146 2024-09-13T17:02:46.398 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 22/146 2024-09-13T17:02:46.398 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 23/146 2024-09-13T17:02:46.398 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 24/146 2024-09-13T17:02:46.399 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 25/146 2024-09-13T17:02:46.399 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 26/146 2024-09-13T17:02:46.399 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 27/146 2024-09-13T17:02:46.411 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 28/146 2024-09-13T17:02:46.411 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 29/146 2024-09-13T17:02:46.411 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 30/146 2024-09-13T17:02:46.412 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 31/146 2024-09-13T17:02:46.412 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 32/146 2024-09-13T17:02:46.412 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 33/146 2024-09-13T17:02:46.412 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 34/146 2024-09-13T17:02:46.412 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 35/146 2024-09-13T17:02:46.412 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 36/146 2024-09-13T17:02:46.412 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 37/146 2024-09-13T17:02:46.412 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 38/146 2024-09-13T17:02:46.412 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/146 2024-09-13T17:02:46.412 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 40/146 2024-09-13T17:02:46.412 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 41/146 2024-09-13T17:02:46.413 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/146 2024-09-13T17:02:46.413 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/146 2024-09-13T17:02:46.413 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/146 2024-09-13T17:02:46.413 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/146 2024-09-13T17:02:46.413 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/146 2024-09-13T17:02:46.413 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/146 2024-09-13T17:02:46.413 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/146 2024-09-13T17:02:46.413 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/146 2024-09-13T17:02:46.413 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 50/146 2024-09-13T17:02:46.413 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 51/146 2024-09-13T17:02:46.414 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flex-2.6.4-9.el9.x86_64 52/146 2024-09-13T17:02:46.414 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 53/146 2024-09-13T17:02:46.414 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 54/146 2024-09-13T17:02:46.414 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 55/146 2024-09-13T17:02:46.414 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 56/146 2024-09-13T17:02:46.414 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/146 2024-09-13T17:02:46.414 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/146 2024-09-13T17:02:46.414 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/146 2024-09-13T17:02:46.414 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 60/146 2024-09-13T17:02:46.414 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 61/146 2024-09-13T17:02:46.414 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 62/146 2024-09-13T17:02:46.414 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 63/146 2024-09-13T17:02:46.414 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 64/146 2024-09-13T17:02:46.415 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 65/146 2024-09-13T17:02:46.415 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 66/146 2024-09-13T17:02:46.415 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : postgresql-13.16-1.el9.x86_64 67/146 2024-09-13T17:02:46.415 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 68/146 2024-09-13T17:02:46.415 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 69/146 2024-09-13T17:02:46.415 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 70/146 2024-09-13T17:02:46.415 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 71/146 2024-09-13T17:02:46.415 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 72/146 2024-09-13T17:02:46.415 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 73/146 2024-09-13T17:02:46.415 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 74/146 2024-09-13T17:02:46.415 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 75/146 2024-09-13T17:02:46.415 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 76/146 2024-09-13T17:02:46.415 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 77/146 2024-09-13T17:02:46.416 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T17:02:46.416 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T17:02:46.416 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 80/146 2024-09-13T17:02:46.416 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 81/146 2024-09-13T17:02:46.416 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 82/146 2024-09-13T17:02:46.416 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 83/146 2024-09-13T17:02:46.416 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 84/146 2024-09-13T17:02:46.416 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 85/146 2024-09-13T17:02:46.416 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/146 2024-09-13T17:02:46.416 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 87/146 2024-09-13T17:02:46.416 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 88/146 2024-09-13T17:02:46.416 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/146 2024-09-13T17:02:46.416 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 90/146 2024-09-13T17:02:46.417 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 91/146 2024-09-13T17:02:46.417 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 92/146 2024-09-13T17:02:46.417 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 93/146 2024-09-13T17:02:46.417 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 94/146 2024-09-13T17:02:46.417 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 95/146 2024-09-13T17:02:46.417 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 96/146 2024-09-13T17:02:46.417 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 97/146 2024-09-13T17:02:46.417 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/146 2024-09-13T17:02:46.417 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/146 2024-09-13T17:02:46.417 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 100/146 2024-09-13T17:02:46.417 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 101/146 2024-09-13T17:02:46.417 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/146 2024-09-13T17:02:46.417 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/146 2024-09-13T17:02:46.417 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 104/146 2024-09-13T17:02:46.418 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/146 2024-09-13T17:02:46.418 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/146 2024-09-13T17:02:46.418 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 107/146 2024-09-13T17:02:46.418 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/146 2024-09-13T17:02:46.418 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/146 2024-09-13T17:02:46.418 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/146 2024-09-13T17:02:46.418 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/146 2024-09-13T17:02:46.418 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/146 2024-09-13T17:02:46.418 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 113/146 2024-09-13T17:02:46.418 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 114/146 2024-09-13T17:02:46.418 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 115/146 2024-09-13T17:02:46.419 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 116/146 2024-09-13T17:02:46.419 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 117/146 2024-09-13T17:02:46.419 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 118/146 2024-09-13T17:02:46.419 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/146 2024-09-13T17:02:46.419 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 120/146 2024-09-13T17:02:46.419 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 121/146 2024-09-13T17:02:46.419 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 122/146 2024-09-13T17:02:46.419 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 123/146 2024-09-13T17:02:46.419 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 124/146 2024-09-13T17:02:46.419 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 125/146 2024-09-13T17:02:46.419 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 126/146 2024-09-13T17:02:46.419 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 127/146 2024-09-13T17:02:46.419 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 128/146 2024-09-13T17:02:46.419 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : re2-1:20211101-20.el9.x86_64 129/146 2024-09-13T17:02:46.420 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 130/146 2024-09-13T17:02:46.420 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 131/146 2024-09-13T17:02:46.420 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 132/146 2024-09-13T17:02:46.420 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 133/146 2024-09-13T17:02:46.420 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 134/146 2024-09-13T17:02:46.420 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 135/146 2024-09-13T17:02:46.420 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 136/146 2024-09-13T17:02:46.420 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 137/146 2024-09-13T17:02:46.420 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 138/146 2024-09-13T17:02:46.420 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 139/146 2024-09-13T17:02:46.420 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 140/146 2024-09-13T17:02:46.420 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 141/146 2024-09-13T17:02:46.420 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 142/146 2024-09-13T17:02:46.421 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 143/146 2024-09-13T17:02:46.421 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 144/146 2024-09-13T17:02:46.421 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 145/146 2024-09-13T17:02:48.087 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T17:02:48.087 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-13T17:02:48.088 INFO:teuthology.orchestra.run.smithi118.stdout:Upgraded: 2024-09-13T17:02:48.088 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-13T17:02:48.088 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-13T17:02:48.088 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-13T17:02:48.088 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-13T17:02:48.088 INFO:teuthology.orchestra.run.smithi118.stdout: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.088 INFO:teuthology.orchestra.run.smithi118.stdout: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.088 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-13T17:02:48.088 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-13T17:02:48.088 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2024-09-13T17:02:48.088 INFO:teuthology.orchestra.run.smithi118.stdout: automake-1.16.2-8.el9.noarch 2024-09-13T17:02:48.088 INFO:teuthology.orchestra.run.smithi118.stdout: bison-3.7.4-5.el9.x86_64 2024-09-13T17:02:48.089 INFO:teuthology.orchestra.run.smithi118.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T17:02:48.089 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.089 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.089 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.089 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.089 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:02:48.089 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-immutable-object-cache-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.089 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.089 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.089 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:02:48.089 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:02:48.090 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:02:48.090 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:02:48.090 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:02:48.090 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.090 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.090 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:02:48.090 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.090 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.090 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.090 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:02:48.090 INFO:teuthology.orchestra.run.smithi118.stdout: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:02:48.091 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.091 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:02:48.091 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-13T17:02:48.091 INFO:teuthology.orchestra.run.smithi118.stdout: flex-2.6.4-9.el9.x86_64 2024-09-13T17:02:48.091 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T17:02:48.091 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T17:02:48.091 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T17:02:48.091 INFO:teuthology.orchestra.run.smithi118.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T17:02:48.091 INFO:teuthology.orchestra.run.smithi118.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-13T17:02:48.091 INFO:teuthology.orchestra.run.smithi118.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T17:02:48.092 INFO:teuthology.orchestra.run.smithi118.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-13T17:02:48.092 INFO:teuthology.orchestra.run.smithi118.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T17:02:48.092 INFO:teuthology.orchestra.run.smithi118.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T17:02:48.092 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.092 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.092 INFO:teuthology.orchestra.run.smithi118.stdout: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.092 INFO:teuthology.orchestra.run.smithi118.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T17:02:48.092 INFO:teuthology.orchestra.run.smithi118.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T17:02:48.092 INFO:teuthology.orchestra.run.smithi118.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T17:02:48.092 INFO:teuthology.orchestra.run.smithi118.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T17:02:48.092 INFO:teuthology.orchestra.run.smithi118.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T17:02:48.093 INFO:teuthology.orchestra.run.smithi118.stdout: librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.093 INFO:teuthology.orchestra.run.smithi118.stdout: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.093 INFO:teuthology.orchestra.run.smithi118.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T17:02:48.093 INFO:teuthology.orchestra.run.smithi118.stdout: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.093 INFO:teuthology.orchestra.run.smithi118.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-13T17:02:48.093 INFO:teuthology.orchestra.run.smithi118.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T17:02:48.093 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-13T17:02:48.093 INFO:teuthology.orchestra.run.smithi118.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-13T17:02:48.093 INFO:teuthology.orchestra.run.smithi118.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T17:02:48.093 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T17:02:48.094 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T17:02:48.094 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-13T17:02:48.094 INFO:teuthology.orchestra.run.smithi118.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T17:02:48.094 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-13.16-1.el9.x86_64 2024-09-13T17:02:48.094 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-13T17:02:48.094 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-13T17:02:48.094 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-13T17:02:48.094 INFO:teuthology.orchestra.run.smithi118.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T17:02:48.094 INFO:teuthology.orchestra.run.smithi118.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T17:02:48.094 INFO:teuthology.orchestra.run.smithi118.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T17:02:48.094 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T17:02:48.094 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.095 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.095 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.095 INFO:teuthology.orchestra.run.smithi118.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T17:02:48.095 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T17:02:48.095 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T17:02:48.095 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T17:02:48.095 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T17:02:48.095 INFO:teuthology.orchestra.run.smithi118.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T17:02:48.095 INFO:teuthology.orchestra.run.smithi118.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T17:02:48.095 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T17:02:48.095 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T17:02:48.095 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T17:02:48.095 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T17:02:48.096 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T17:02:48.096 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T17:02:48.096 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T17:02:48.096 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T17:02:48.096 INFO:teuthology.orchestra.run.smithi118.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T17:02:48.096 INFO:teuthology.orchestra.run.smithi118.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T17:02:48.096 INFO:teuthology.orchestra.run.smithi118.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T17:02:48.096 INFO:teuthology.orchestra.run.smithi118.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T17:02:48.096 INFO:teuthology.orchestra.run.smithi118.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T17:02:48.096 INFO:teuthology.orchestra.run.smithi118.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T17:02:48.096 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T17:02:48.097 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T17:02:48.097 INFO:teuthology.orchestra.run.smithi118.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T17:02:48.097 INFO:teuthology.orchestra.run.smithi118.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T17:02:48.097 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T17:02:48.097 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T17:02:48.097 INFO:teuthology.orchestra.run.smithi118.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T17:02:48.097 INFO:teuthology.orchestra.run.smithi118.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T17:02:48.097 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T17:02:48.097 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T17:02:48.097 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T17:02:48.097 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T17:02:48.098 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T17:02:48.098 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.098 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.098 INFO:teuthology.orchestra.run.smithi118.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T17:02:48.098 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T17:02:48.098 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T17:02:48.098 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.098 INFO:teuthology.orchestra.run.smithi118.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T17:02:48.098 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T17:02:48.098 INFO:teuthology.orchestra.run.smithi118.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T17:02:48.098 INFO:teuthology.orchestra.run.smithi118.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T17:02:48.099 INFO:teuthology.orchestra.run.smithi118.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T17:02:48.099 INFO:teuthology.orchestra.run.smithi118.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T17:02:48.099 INFO:teuthology.orchestra.run.smithi118.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T17:02:48.099 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T17:02:48.099 INFO:teuthology.orchestra.run.smithi118.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T17:02:48.099 INFO:teuthology.orchestra.run.smithi118.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T17:02:48.099 INFO:teuthology.orchestra.run.smithi118.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T17:02:48.099 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.099 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.099 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.099 INFO:teuthology.orchestra.run.smithi118.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T17:02:48.099 INFO:teuthology.orchestra.run.smithi118.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T17:02:48.099 INFO:teuthology.orchestra.run.smithi118.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T17:02:48.100 INFO:teuthology.orchestra.run.smithi118.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-13T17:02:48.100 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-13T17:02:48.100 INFO:teuthology.orchestra.run.smithi118.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T17:02:48.100 INFO:teuthology.orchestra.run.smithi118.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-13T17:02:48.100 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-09-13T17:02:48.100 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-09-13T17:02:48.484 DEBUG:teuthology.parallel:result is None 2024-09-13T17:02:48.986 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T17:02:48.986 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:02:48.987 INFO:teuthology.orchestra.run.smithi087.stdout:Upgraded: 2024-09-13T17:02:48.987 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-13T17:02:48.987 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-13T17:02:48.987 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-13T17:02:48.987 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-13T17:02:48.987 INFO:teuthology.orchestra.run.smithi087.stdout: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.987 INFO:teuthology.orchestra.run.smithi087.stdout: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.987 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-13T17:02:48.987 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-13T17:02:48.988 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-09-13T17:02:48.988 INFO:teuthology.orchestra.run.smithi087.stdout: automake-1.16.2-8.el9.noarch 2024-09-13T17:02:48.988 INFO:teuthology.orchestra.run.smithi087.stdout: bison-3.7.4-5.el9.x86_64 2024-09-13T17:02:48.988 INFO:teuthology.orchestra.run.smithi087.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T17:02:48.988 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.988 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.988 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.988 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.988 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:02:48.988 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-immutable-object-cache-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.988 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.989 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.989 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:02:48.989 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:02:48.989 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:02:48.989 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:02:48.989 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:02:48.989 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.989 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.989 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:02:48.990 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.990 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.990 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.990 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:02:48.990 INFO:teuthology.orchestra.run.smithi087.stdout: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:02:48.990 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.990 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:02:48.990 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-13T17:02:48.990 INFO:teuthology.orchestra.run.smithi087.stdout: flex-2.6.4-9.el9.x86_64 2024-09-13T17:02:48.990 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T17:02:48.990 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T17:02:48.991 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T17:02:48.991 INFO:teuthology.orchestra.run.smithi087.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T17:02:48.991 INFO:teuthology.orchestra.run.smithi087.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-13T17:02:48.991 INFO:teuthology.orchestra.run.smithi087.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T17:02:48.991 INFO:teuthology.orchestra.run.smithi087.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-13T17:02:48.991 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T17:02:48.991 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T17:02:48.991 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.991 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.992 INFO:teuthology.orchestra.run.smithi087.stdout: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.992 INFO:teuthology.orchestra.run.smithi087.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T17:02:48.992 INFO:teuthology.orchestra.run.smithi087.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T17:02:48.992 INFO:teuthology.orchestra.run.smithi087.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T17:02:48.992 INFO:teuthology.orchestra.run.smithi087.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T17:02:48.992 INFO:teuthology.orchestra.run.smithi087.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T17:02:48.993 INFO:teuthology.orchestra.run.smithi087.stdout: librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.993 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.993 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T17:02:48.993 INFO:teuthology.orchestra.run.smithi087.stdout: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.993 INFO:teuthology.orchestra.run.smithi087.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-13T17:02:48.993 INFO:teuthology.orchestra.run.smithi087.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T17:02:48.993 INFO:teuthology.orchestra.run.smithi087.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-13T17:02:48.993 INFO:teuthology.orchestra.run.smithi087.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-13T17:02:48.993 INFO:teuthology.orchestra.run.smithi087.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T17:02:48.993 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T17:02:48.994 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T17:02:48.994 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-13T17:02:48.994 INFO:teuthology.orchestra.run.smithi087.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T17:02:48.994 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-13.16-1.el9.x86_64 2024-09-13T17:02:48.994 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-13T17:02:48.994 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-13T17:02:48.994 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-13T17:02:48.994 INFO:teuthology.orchestra.run.smithi087.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T17:02:48.994 INFO:teuthology.orchestra.run.smithi087.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T17:02:48.994 INFO:teuthology.orchestra.run.smithi087.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T17:02:48.995 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T17:02:48.995 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.995 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.995 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.995 INFO:teuthology.orchestra.run.smithi087.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T17:02:48.995 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T17:02:48.995 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T17:02:48.995 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T17:02:48.995 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T17:02:48.996 INFO:teuthology.orchestra.run.smithi087.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T17:02:48.996 INFO:teuthology.orchestra.run.smithi087.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T17:02:48.996 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T17:02:48.996 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T17:02:48.996 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T17:02:48.996 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T17:02:48.996 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T17:02:48.996 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T17:02:48.996 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T17:02:48.997 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T17:02:48.997 INFO:teuthology.orchestra.run.smithi087.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T17:02:48.997 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T17:02:48.997 INFO:teuthology.orchestra.run.smithi087.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T17:02:48.997 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T17:02:48.997 INFO:teuthology.orchestra.run.smithi087.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T17:02:48.997 INFO:teuthology.orchestra.run.smithi087.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T17:02:48.997 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T17:02:48.997 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T17:02:48.997 INFO:teuthology.orchestra.run.smithi087.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T17:02:48.998 INFO:teuthology.orchestra.run.smithi087.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T17:02:48.998 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T17:02:48.998 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T17:02:48.998 INFO:teuthology.orchestra.run.smithi087.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T17:02:48.998 INFO:teuthology.orchestra.run.smithi087.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T17:02:48.998 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T17:02:48.998 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T17:02:48.998 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T17:02:48.998 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T17:02:48.998 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T17:02:48.998 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.998 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T17:02:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T17:02:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T17:02:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T17:02:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T17:02:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T17:02:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T17:02:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T17:02:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T17:02:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T17:02:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T17:02:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T17:02:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T17:02:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T17:02:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T17:02:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T17:02:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T17:02:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-13T17:02:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-13T17:02:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T17:02:49.001 INFO:teuthology.orchestra.run.smithi087.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-13T17:02:49.001 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:02:49.001 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-09-13T17:02:49.306 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T17:02:49.306 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 1/146 2024-09-13T17:02:49.306 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2/146 2024-09-13T17:02:49.307 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 3/146 2024-09-13T17:02:49.307 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 4/146 2024-09-13T17:02:49.307 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 5/146 2024-09-13T17:02:49.307 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 6/146 2024-09-13T17:02:49.307 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 7/146 2024-09-13T17:02:49.307 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T17:02:49.307 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T17:02:49.307 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T17:02:49.307 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 11/146 2024-09-13T17:02:49.307 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 12/146 2024-09-13T17:02:49.307 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T17:02:49.307 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 14/146 2024-09-13T17:02:49.308 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 15/146 2024-09-13T17:02:49.308 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 16/146 2024-09-13T17:02:49.308 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 17/146 2024-09-13T17:02:49.308 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 18/146 2024-09-13T17:02:49.308 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 19/146 2024-09-13T17:02:49.308 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 20/146 2024-09-13T17:02:49.308 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 21/146 2024-09-13T17:02:49.308 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 22/146 2024-09-13T17:02:49.308 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 23/146 2024-09-13T17:02:49.308 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 24/146 2024-09-13T17:02:49.308 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 25/146 2024-09-13T17:02:49.308 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 26/146 2024-09-13T17:02:49.308 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 27/146 2024-09-13T17:02:49.309 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 28/146 2024-09-13T17:02:49.309 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 29/146 2024-09-13T17:02:49.309 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 30/146 2024-09-13T17:02:49.309 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 31/146 2024-09-13T17:02:49.309 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 32/146 2024-09-13T17:02:49.309 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 33/146 2024-09-13T17:02:49.309 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 34/146 2024-09-13T17:02:49.309 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 35/146 2024-09-13T17:02:49.309 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 36/146 2024-09-13T17:02:49.309 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 37/146 2024-09-13T17:02:49.309 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 38/146 2024-09-13T17:02:49.309 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/146 2024-09-13T17:02:49.309 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 40/146 2024-09-13T17:02:49.310 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 41/146 2024-09-13T17:02:49.310 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/146 2024-09-13T17:02:49.310 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/146 2024-09-13T17:02:49.310 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/146 2024-09-13T17:02:49.310 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/146 2024-09-13T17:02:49.310 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/146 2024-09-13T17:02:49.310 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/146 2024-09-13T17:02:49.310 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/146 2024-09-13T17:02:49.310 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/146 2024-09-13T17:02:49.310 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 50/146 2024-09-13T17:02:49.310 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 51/146 2024-09-13T17:02:49.310 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flex-2.6.4-9.el9.x86_64 52/146 2024-09-13T17:02:49.310 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 53/146 2024-09-13T17:02:49.311 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 54/146 2024-09-13T17:02:49.311 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 55/146 2024-09-13T17:02:49.311 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 56/146 2024-09-13T17:02:49.311 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/146 2024-09-13T17:02:49.311 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/146 2024-09-13T17:02:49.311 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/146 2024-09-13T17:02:49.311 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 60/146 2024-09-13T17:02:49.311 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 61/146 2024-09-13T17:02:49.311 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 62/146 2024-09-13T17:02:49.311 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 63/146 2024-09-13T17:02:49.311 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 64/146 2024-09-13T17:02:49.311 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 65/146 2024-09-13T17:02:49.311 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 66/146 2024-09-13T17:02:49.312 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : postgresql-13.16-1.el9.x86_64 67/146 2024-09-13T17:02:49.312 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 68/146 2024-09-13T17:02:49.312 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 69/146 2024-09-13T17:02:49.312 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 70/146 2024-09-13T17:02:49.312 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 71/146 2024-09-13T17:02:49.312 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 72/146 2024-09-13T17:02:49.312 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 73/146 2024-09-13T17:02:49.312 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 74/146 2024-09-13T17:02:49.312 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 75/146 2024-09-13T17:02:49.312 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 76/146 2024-09-13T17:02:49.312 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 77/146 2024-09-13T17:02:49.312 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T17:02:49.312 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T17:02:49.313 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 80/146 2024-09-13T17:02:49.313 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 81/146 2024-09-13T17:02:49.313 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 82/146 2024-09-13T17:02:49.313 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 83/146 2024-09-13T17:02:49.313 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 84/146 2024-09-13T17:02:49.313 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 85/146 2024-09-13T17:02:49.313 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/146 2024-09-13T17:02:49.313 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 87/146 2024-09-13T17:02:49.313 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 88/146 2024-09-13T17:02:49.313 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/146 2024-09-13T17:02:49.313 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 90/146 2024-09-13T17:02:49.313 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 91/146 2024-09-13T17:02:49.313 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 92/146 2024-09-13T17:02:49.314 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 93/146 2024-09-13T17:02:49.314 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 94/146 2024-09-13T17:02:49.314 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 95/146 2024-09-13T17:02:49.314 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 96/146 2024-09-13T17:02:49.314 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 97/146 2024-09-13T17:02:49.314 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/146 2024-09-13T17:02:49.314 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/146 2024-09-13T17:02:49.314 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 100/146 2024-09-13T17:02:49.314 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 101/146 2024-09-13T17:02:49.314 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/146 2024-09-13T17:02:49.314 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/146 2024-09-13T17:02:49.315 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 104/146 2024-09-13T17:02:49.315 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/146 2024-09-13T17:02:49.315 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/146 2024-09-13T17:02:49.315 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 107/146 2024-09-13T17:02:49.315 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/146 2024-09-13T17:02:49.315 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/146 2024-09-13T17:02:49.315 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/146 2024-09-13T17:02:49.315 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/146 2024-09-13T17:02:49.315 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/146 2024-09-13T17:02:49.315 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 113/146 2024-09-13T17:02:49.315 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 114/146 2024-09-13T17:02:49.315 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 115/146 2024-09-13T17:02:49.316 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 116/146 2024-09-13T17:02:49.316 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 117/146 2024-09-13T17:02:49.316 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 118/146 2024-09-13T17:02:49.316 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/146 2024-09-13T17:02:49.316 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 120/146 2024-09-13T17:02:49.316 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 121/146 2024-09-13T17:02:49.316 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 122/146 2024-09-13T17:02:49.316 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 123/146 2024-09-13T17:02:49.316 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 124/146 2024-09-13T17:02:49.316 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 125/146 2024-09-13T17:02:49.316 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 126/146 2024-09-13T17:02:49.316 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 127/146 2024-09-13T17:02:49.316 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 128/146 2024-09-13T17:02:49.317 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : re2-1:20211101-20.el9.x86_64 129/146 2024-09-13T17:02:49.317 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 130/146 2024-09-13T17:02:49.317 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 131/146 2024-09-13T17:02:49.317 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 132/146 2024-09-13T17:02:49.317 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 133/146 2024-09-13T17:02:49.317 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 134/146 2024-09-13T17:02:49.317 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 135/146 2024-09-13T17:02:49.317 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 136/146 2024-09-13T17:02:49.317 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 137/146 2024-09-13T17:02:49.317 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 138/146 2024-09-13T17:02:49.317 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 139/146 2024-09-13T17:02:49.317 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 140/146 2024-09-13T17:02:49.318 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 141/146 2024-09-13T17:02:49.318 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 142/146 2024-09-13T17:02:49.318 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 143/146 2024-09-13T17:02:49.318 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 144/146 2024-09-13T17:02:49.318 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 145/146 2024-09-13T17:02:49.361 DEBUG:teuthology.parallel:result is None 2024-09-13T17:02:51.911 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T17:02:51.911 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T17:02:51.911 INFO:teuthology.orchestra.run.smithi149.stdout:Upgraded: 2024-09-13T17:02:51.911 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-13T17:02:51.911 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-13T17:02:51.911 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-13T17:02:51.912 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-13T17:02:51.912 INFO:teuthology.orchestra.run.smithi149.stdout: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:51.912 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:51.912 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-13T17:02:51.912 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-13T17:02:51.912 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-13T17:02:51.912 INFO:teuthology.orchestra.run.smithi149.stdout: automake-1.16.2-8.el9.noarch 2024-09-13T17:02:51.912 INFO:teuthology.orchestra.run.smithi149.stdout: bison-3.7.4-5.el9.x86_64 2024-09-13T17:02:51.912 INFO:teuthology.orchestra.run.smithi149.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T17:02:51.912 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:51.912 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:51.913 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:51.913 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:51.913 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:02:51.913 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:51.913 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:51.913 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:51.913 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:02:51.913 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:02:51.913 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:02:51.913 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:02:51.913 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:02:51.913 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:51.913 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:51.914 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:02:51.914 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:51.914 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:51.914 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:51.914 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:02:51.914 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:02:51.914 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:51.914 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:02:51.914 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-13T17:02:51.914 INFO:teuthology.orchestra.run.smithi149.stdout: flex-2.6.4-9.el9.x86_64 2024-09-13T17:02:51.914 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T17:02:51.914 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T17:02:51.915 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T17:02:51.915 INFO:teuthology.orchestra.run.smithi149.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T17:02:51.915 INFO:teuthology.orchestra.run.smithi149.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-13T17:02:51.915 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T17:02:51.915 INFO:teuthology.orchestra.run.smithi149.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-13T17:02:51.915 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T17:02:51.915 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T17:02:51.915 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:51.915 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:51.915 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:51.915 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T17:02:51.915 INFO:teuthology.orchestra.run.smithi149.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T17:02:51.915 INFO:teuthology.orchestra.run.smithi149.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T17:02:51.916 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T17:02:51.916 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T17:02:51.916 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:51.916 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:51.916 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T17:02:51.916 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:51.916 INFO:teuthology.orchestra.run.smithi149.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-13T17:02:51.916 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T17:02:51.916 INFO:teuthology.orchestra.run.smithi149.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-13T17:02:51.916 INFO:teuthology.orchestra.run.smithi149.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-13T17:02:51.916 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T17:02:51.916 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T17:02:51.916 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T17:02:51.917 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-13T17:02:51.917 INFO:teuthology.orchestra.run.smithi149.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T17:02:51.917 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-13.16-1.el9.x86_64 2024-09-13T17:02:51.917 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-13T17:02:51.917 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-13T17:02:51.917 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-13T17:02:51.917 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T17:02:51.917 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T17:02:51.917 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T17:02:51.917 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T17:02:51.917 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:51.917 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:51.917 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:51.918 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T17:02:51.918 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T17:02:51.918 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T17:02:51.918 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T17:02:51.918 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T17:02:51.918 INFO:teuthology.orchestra.run.smithi149.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T17:02:51.918 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T17:02:51.918 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T17:02:51.918 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T17:02:51.918 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T17:02:51.918 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T17:02:51.918 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T17:02:51.918 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T17:02:51.919 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T17:02:51.919 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T17:02:51.919 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T17:02:51.919 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T17:02:51.919 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T17:02:51.919 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T17:02:51.919 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T17:02:51.919 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T17:02:51.919 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T17:02:51.919 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T17:02:51.919 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T17:02:51.919 INFO:teuthology.orchestra.run.smithi149.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T17:02:51.919 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T17:02:51.920 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T17:02:51.920 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T17:02:51.920 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T17:02:51.920 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T17:02:51.920 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T17:02:51.920 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T17:02:51.920 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T17:02:51.920 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T17:02:51.920 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:51.920 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:51.920 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T17:02:51.920 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T17:02:51.920 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T17:02:51.921 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:51.921 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T17:02:51.921 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T17:02:51.921 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T17:02:51.921 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T17:02:51.921 INFO:teuthology.orchestra.run.smithi149.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T17:02:51.921 INFO:teuthology.orchestra.run.smithi149.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T17:02:51.921 INFO:teuthology.orchestra.run.smithi149.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T17:02:51.921 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T17:02:51.921 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T17:02:51.921 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T17:02:51.921 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T17:02:51.921 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:51.922 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:51.922 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:02:51.922 INFO:teuthology.orchestra.run.smithi149.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T17:02:51.922 INFO:teuthology.orchestra.run.smithi149.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T17:02:51.922 INFO:teuthology.orchestra.run.smithi149.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T17:02:51.922 INFO:teuthology.orchestra.run.smithi149.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-13T17:02:51.922 INFO:teuthology.orchestra.run.smithi149.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-13T17:02:51.922 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T17:02:51.922 INFO:teuthology.orchestra.run.smithi149.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-13T17:02:51.922 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T17:02:51.923 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-13T17:02:52.291 DEBUG:teuthology.parallel:result is None 2024-09-13T17:02:52.292 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:02:52.452 DEBUG:teuthology.orchestra.run.smithi087:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T17:02:52.479 INFO:teuthology.orchestra.run.smithi087.stdout:18.2.4-860.g6c6b083f.el9 2024-09-13T17:02:52.480 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860.g6c6b083f.el9 2024-09-13T17:02:52.480 INFO:teuthology.task.install:The correct ceph version 18.2.4-860.g6c6b083f is installed. 2024-09-13T17:02:52.482 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:02:52.633 DEBUG:teuthology.orchestra.run.smithi118:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T17:02:52.659 INFO:teuthology.orchestra.run.smithi118.stdout:18.2.4-860.g6c6b083f.el9 2024-09-13T17:02:52.659 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860.g6c6b083f.el9 2024-09-13T17:02:52.659 INFO:teuthology.task.install:The correct ceph version 18.2.4-860.g6c6b083f is installed. 2024-09-13T17:02:52.661 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:02:52.812 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T17:02:52.837 INFO:teuthology.orchestra.run.smithi149.stdout:18.2.4-860.g6c6b083f.el9 2024-09-13T17:02:52.837 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860.g6c6b083f.el9 2024-09-13T17:02:52.837 INFO:teuthology.task.install:The correct ceph version 18.2.4-860.g6c6b083f is installed. 2024-09-13T17:02:52.840 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T17:02:52.841 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T17:02:52.841 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T17:02:52.873 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-13T17:02:52.873 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T17:02:52.905 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-13T17:02:52.905 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T17:02:52.935 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T17:02:52.936 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T17:02:52.936 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T17:02:52.965 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T17:02:53.034 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-13T17:02:53.034 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T17:02:53.063 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T17:02:53.132 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-13T17:02:53.132 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T17:02:53.160 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T17:02:53.226 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T17:02:53.226 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T17:02:53.226 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T17:02:53.255 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T17:02:53.323 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-13T17:02:53.323 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T17:02:53.350 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T17:02:53.417 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-13T17:02:53.417 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T17:02:53.444 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T17:02:53.511 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T17:02:53.511 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T17:02:53.511 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T17:02:53.539 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T17:02:53.607 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-13T17:02:53.607 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T17:02:53.634 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T17:02:53.701 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-13T17:02:53.701 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T17:02:53.729 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T17:02:53.796 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-13T17:02:53.892 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client dirsize rbytes': False, 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'subvols': {'create': 2}} 2024-09-13T17:02:53.892 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:02:53.893 INFO:tasks.cephadm:Cluster fsid is 043d5bae-71f2-11ef-bceb-c7b262605968 2024-09-13T17:02:53.893 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-13T17:02:53.893 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.87', 'mon.b': '172.21.15.118', 'mon.c': '172.21.15.149'} 2024-09-13T17:02:53.893 INFO:tasks.cephadm:First mon is mon.a on smithi087 2024-09-13T17:02:53.893 INFO:tasks.cephadm:First mgr is x 2024-09-13T17:02:53.893 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-13T17:02:53.893 DEBUG:teuthology.orchestra.run.smithi087:> sudo hostname $(hostname -s) 2024-09-13T17:02:53.923 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname $(hostname -s) 2024-09-13T17:02:53.951 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname $(hostname -s) 2024-09-13T17:02:53.978 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-13T17:02:53.978 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:02:54.136 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82954/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.2.4-860-g6c6b083f', 'node_name': '172.21.4.58+omani008', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '18.2.4-860.g6c6b083f'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-10 17:57:22.919627', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240910.100730-reef', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/', 'archs': ['arm64', 'x86_64', 'source'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82954/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.2.4-860-g6c6b083f', 'node_name': '172.21.5.40+adami10', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '18.2.4-860.g6c6b083f'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-10 13:55:29.568955', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240910.100730-reef', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-13T17:02:54.286 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-rishabh-testing-20240910.100730-reef, sha1 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:02:54.288 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/x86_64/flavors/default/cephadm 2024-09-13T17:02:54.288 DEBUG:teuthology.orchestra.run.smithi087:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T17:02:54.632 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r--. 1 ubuntu ubuntu 217223 Sep 13 17:02 /home/ubuntu/cephtest/cephadm 2024-09-13T17:02:54.633 DEBUG:teuthology.orchestra.run.smithi118:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T17:02:54.978 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r--. 1 ubuntu ubuntu 217223 Sep 13 17:02 /home/ubuntu/cephtest/cephadm 2024-09-13T17:02:54.979 DEBUG:teuthology.orchestra.run.smithi149:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T17:02:55.317 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r--. 1 ubuntu ubuntu 217223 Sep 13 17:02 /home/ubuntu/cephtest/cephadm 2024-09-13T17:02:55.318 DEBUG:teuthology.orchestra.run.smithi087:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T17:02:55.337 DEBUG:teuthology.orchestra.run.smithi118:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T17:02:55.357 DEBUG:teuthology.orchestra.run.smithi149:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T17:02:55.391 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 on all hosts... 2024-09-13T17:02:55.391 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 pull 2024-09-13T17:02:55.394 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 pull 2024-09-13T17:02:55.399 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 pull 2024-09-13T17:02:56.923 INFO:teuthology.orchestra.run.smithi087.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3... 2024-09-13T17:02:56.993 INFO:teuthology.orchestra.run.smithi149.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3... 2024-09-13T17:02:57.136 INFO:teuthology.orchestra.run.smithi118.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3... 2024-09-13T17:03:25.302 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-13T17:03:25.303 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:03:25.303 INFO:teuthology.orchestra.run.smithi118.stdout: "image_id": "8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61", 2024-09-13T17:03:25.303 INFO:teuthology.orchestra.run.smithi118.stdout: "repo_digests": [ 2024-09-13T17:03:25.303 INFO:teuthology.orchestra.run.smithi118.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256" 2024-09-13T17:03:25.303 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-09-13T17:03:25.303 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-13T17:03:34.307 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-13T17:03:34.308 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:03:34.308 INFO:teuthology.orchestra.run.smithi149.stdout: "image_id": "8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61", 2024-09-13T17:03:34.308 INFO:teuthology.orchestra.run.smithi149.stdout: "repo_digests": [ 2024-09-13T17:03:34.308 INFO:teuthology.orchestra.run.smithi149.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256" 2024-09-13T17:03:34.308 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-13T17:03:34.308 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-13T17:03:48.711 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:03:48.712 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:03:48.712 INFO:teuthology.orchestra.run.smithi087.stdout: "image_id": "8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61", 2024-09-13T17:03:48.712 INFO:teuthology.orchestra.run.smithi087.stdout: "repo_digests": [ 2024-09-13T17:03:48.712 INFO:teuthology.orchestra.run.smithi087.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256" 2024-09-13T17:03:48.712 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-13T17:03:48.712 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:03:48.730 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /etc/ceph 2024-09-13T17:03:48.776 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /etc/ceph 2024-09-13T17:03:48.810 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /etc/ceph 2024-09-13T17:03:48.843 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 777 /etc/ceph 2024-09-13T17:03:48.868 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 777 /etc/ceph 2024-09-13T17:03:48.899 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 777 /etc/ceph 2024-09-13T17:03:48.926 INFO:tasks.cephadm:Writing seed config... 2024-09-13T17:03:48.927 INFO:tasks.cephadm: override: [client] client dirsize rbytes = False 2024-09-13T17:03:48.928 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-13T17:03:48.928 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-13T17:03:48.928 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-13T17:03:48.928 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-13T17:03:48.928 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-13T17:03:48.928 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-13T17:03:48.928 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-13T17:03:48.928 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-13T17:03:48.928 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-13T17:03:48.928 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-13T17:03:48.928 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-13T17:03:48.929 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-13T17:03:48.929 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-13T17:03:48.929 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-13T17:03:48.929 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-13T17:03:48.929 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-13T17:03:48.929 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-13T17:03:48.929 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-13T17:03:48.929 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-13T17:03:48.929 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-13T17:03:48.929 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-13T17:03:48.929 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-09-13T17:03:48.929 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-13T17:03:48.929 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-13T17:03:48.929 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-13T17:03:48.929 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-13T17:03:48.930 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-13T17:03:48.930 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-13T17:03:48.930 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-13T17:03:48.930 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-13T17:03:48.930 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-13T17:03:48.930 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-13T17:03:48.930 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-13T17:03:48.930 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-13T17:03:48.930 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-13T17:03:48.930 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-13T17:03:48.930 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-13T17:03:48.930 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-13T17:03:48.930 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-13T17:03:48.931 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-13T17:03:48.931 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-13T17:03:48.931 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-13T17:03:48.931 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-13T17:03:48.931 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-13T17:03:48.931 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-13T17:03:48.931 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-13T17:03:48.932 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T17:03:48.932 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-13T17:03:48.947 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 043d5bae-71f2-11ef-bceb-c7b262605968 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client dirsize rbytes = False client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-13T17:03:48.948 DEBUG:teuthology.orchestra.run.smithi087:mon.a> sudo journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mon.a.service 2024-09-13T17:03:48.990 DEBUG:teuthology.orchestra.run.smithi087:mgr.x> sudo journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mgr.x.service 2024-09-13T17:03:49.032 INFO:tasks.cephadm:Bootstrapping... 2024-09-13T17:03:49.033 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -v bootstrap --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.87 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-13T17:03:49.183 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-09-13T17:03:49.184 INFO:teuthology.orchestra.run.smithi087.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', '-v', 'bootstrap', '--fsid', '043d5bae-71f2-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.87', '--skip-admin-label'] 2024-09-13T17:03:49.207 INFO:teuthology.orchestra.run.smithi087.stdout:/bin/podman: stdout 5.2.2 2024-09-13T17:03:49.207 INFO:teuthology.orchestra.run.smithi087.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-13T17:03:49.208 INFO:teuthology.orchestra.run.smithi087.stdout:Verifying podman|docker is present... 2024-09-13T17:03:49.229 INFO:teuthology.orchestra.run.smithi087.stdout:/bin/podman: stdout 5.2.2 2024-09-13T17:03:49.229 INFO:teuthology.orchestra.run.smithi087.stdout:Verifying lvm2 is present... 2024-09-13T17:03:49.229 INFO:teuthology.orchestra.run.smithi087.stdout:Verifying time synchronization is in place... 2024-09-13T17:03:49.237 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T17:03:49.237 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T17:03:49.243 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T17:03:49.243 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout inactive 2024-09-13T17:03:49.250 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout enabled 2024-09-13T17:03:49.256 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout active 2024-09-13T17:03:49.256 INFO:teuthology.orchestra.run.smithi087.stdout:Unit chronyd.service is enabled and running 2024-09-13T17:03:49.256 INFO:teuthology.orchestra.run.smithi087.stdout:Repeating the final host check... 2024-09-13T17:03:49.277 INFO:teuthology.orchestra.run.smithi087.stdout:/bin/podman: stdout 5.2.2 2024-09-13T17:03:49.277 INFO:teuthology.orchestra.run.smithi087.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-13T17:03:49.277 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl is present 2024-09-13T17:03:49.278 INFO:teuthology.orchestra.run.smithi087.stdout:lvcreate is present 2024-09-13T17:03:49.284 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T17:03:49.284 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T17:03:49.290 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T17:03:49.291 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout inactive 2024-09-13T17:03:49.297 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout enabled 2024-09-13T17:03:49.303 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout active 2024-09-13T17:03:49.303 INFO:teuthology.orchestra.run.smithi087.stdout:Unit chronyd.service is enabled and running 2024-09-13T17:03:49.303 INFO:teuthology.orchestra.run.smithi087.stdout:Host looks OK 2024-09-13T17:03:49.303 INFO:teuthology.orchestra.run.smithi087.stdout:Cluster fsid: 043d5bae-71f2-11ef-bceb-c7b262605968 2024-09-13T17:03:49.303 INFO:teuthology.orchestra.run.smithi087.stdout:Acquiring lock 140370825100880 on /run/cephadm/043d5bae-71f2-11ef-bceb-c7b262605968.lock 2024-09-13T17:03:49.303 INFO:teuthology.orchestra.run.smithi087.stdout:Lock 140370825100880 acquired on /run/cephadm/043d5bae-71f2-11ef-bceb-c7b262605968.lock 2024-09-13T17:03:49.304 INFO:teuthology.orchestra.run.smithi087.stdout:Verifying IP 172.21.15.87 port 3300 ... 2024-09-13T17:03:49.304 INFO:teuthology.orchestra.run.smithi087.stdout:Verifying IP 172.21.15.87 port 6789 ... 2024-09-13T17:03:49.304 INFO:teuthology.orchestra.run.smithi087.stdout:Base mon IP(s) is [172.21.15.87:3300, 172.21.15.87:6789], mon addrv is [v2:172.21.15.87:3300,v1:172.21.15.87:6789] 2024-09-13T17:03:49.307 INFO:teuthology.orchestra.run.smithi087.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.87 metric 100 2024-09-13T17:03:49.307 INFO:teuthology.orchestra.run.smithi087.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.87 metric 100 2024-09-13T17:03:49.310 INFO:teuthology.orchestra.run.smithi087.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-13T17:03:49.310 INFO:teuthology.orchestra.run.smithi087.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-13T17:03:49.310 INFO:teuthology.orchestra.run.smithi087.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-13T17:03:49.313 INFO:teuthology.orchestra.run.smithi087.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-13T17:03:49.313 INFO:teuthology.orchestra.run.smithi087.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-13T17:03:49.313 INFO:teuthology.orchestra.run.smithi087.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T17:03:49.313 INFO:teuthology.orchestra.run.smithi087.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-13T17:03:49.313 INFO:teuthology.orchestra.run.smithi087.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link noprefixroute 2024-09-13T17:03:49.313 INFO:teuthology.orchestra.run.smithi087.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T17:03:49.314 INFO:teuthology.orchestra.run.smithi087.stdout:Mon IP `172.21.15.87` is in CIDR network `172.21.0.0/20` 2024-09-13T17:03:49.314 INFO:teuthology.orchestra.run.smithi087.stdout:Mon IP `172.21.15.87` is in CIDR network `172.21.0.0/20` 2024-09-13T17:03:49.314 INFO:teuthology.orchestra.run.smithi087.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-13T17:03:49.314 INFO:teuthology.orchestra.run.smithi087.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-13T17:03:49.315 INFO:teuthology.orchestra.run.smithi087.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3... 2024-09-13T17:03:49.789 INFO:teuthology.orchestra.run.smithi087.stdout:/bin/podman: stdout 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 2024-09-13T17:03:49.789 INFO:teuthology.orchestra.run.smithi087.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3... 2024-09-13T17:03:49.789 INFO:teuthology.orchestra.run.smithi087.stdout:/bin/podman: stderr Getting image source signatures 2024-09-13T17:03:49.789 INFO:teuthology.orchestra.run.smithi087.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-13T17:03:49.789 INFO:teuthology.orchestra.run.smithi087.stdout:/bin/podman: stderr Copying blob sha256:cdfdf789b01393b98d7733e02a8d993977e2aa05d922747269d27c845cd4920c 2024-09-13T17:03:49.789 INFO:teuthology.orchestra.run.smithi087.stdout:/bin/podman: stderr Copying config sha256:8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 2024-09-13T17:03:49.790 INFO:teuthology.orchestra.run.smithi087.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-13T17:03:50.710 INFO:teuthology.orchestra.run.smithi087.stdout:ceph: stdout ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable) 2024-09-13T17:03:50.710 INFO:teuthology.orchestra.run.smithi087.stdout:Ceph version: ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable) 2024-09-13T17:03:50.710 INFO:teuthology.orchestra.run.smithi087.stdout:Extracting ceph user uid/gid from container image... 2024-09-13T17:03:51.690 INFO:teuthology.orchestra.run.smithi087.stdout:stat: stdout 167 167 2024-09-13T17:03:51.690 INFO:teuthology.orchestra.run.smithi087.stdout:Creating initial keys... 2024-09-13T17:03:52.706 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph-authtool: stdout AQB4cORm7dNQARAASJ2oRSwx5aQxsQmmFXc2mA== 2024-09-13T17:03:53.643 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph-authtool: stdout AQB5cORmaT8yAxAAmEXFwwowoH1A0LblVWU51g== 2024-09-13T17:03:54.565 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph-authtool: stdout AQB5cORmnBQkORAAoOi0L/X7gMLZQ20VEmfLhQ== 2024-09-13T17:03:54.565 INFO:teuthology.orchestra.run.smithi087.stdout:Creating initial monmap... 2024-09-13T17:03:55.446 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T17:03:55.446 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-09-13T17:03:55.446 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 043d5bae-71f2-11ef-bceb-c7b262605968 2024-09-13T17:03:55.447 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T17:03:55.447 INFO:teuthology.orchestra.run.smithi087.stdout:monmaptool for a [v2:172.21.15.87:3300,v1:172.21.15.87:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T17:03:55.447 INFO:teuthology.orchestra.run.smithi087.stdout:setting min_mon_release = pacific 2024-09-13T17:03:55.447 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/monmaptool: set fsid to 043d5bae-71f2-11ef-bceb-c7b262605968 2024-09-13T17:03:55.447 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T17:03:55.447 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:03:55.447 INFO:teuthology.orchestra.run.smithi087.stdout:Creating mon... 2024-09-13T17:03:56.434 INFO:teuthology.orchestra.run.smithi087.stdout:create mon.a on 2024-09-13T17:03:56.651 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-13T17:03:56.800 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-13T17:03:56.977 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-043d5bae-71f2-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-043d5bae-71f2-11ef-bceb-c7b262605968.target. 2024-09-13T17:03:56.978 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-043d5bae-71f2-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-043d5bae-71f2-11ef-bceb-c7b262605968.target. 2024-09-13T17:03:57.199 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mon.a 2024-09-13T17:03:57.199 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stderr Failed to reset failed state of unit ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-13T17:03:57.364 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-043d5bae-71f2-11ef-bceb-c7b262605968.target.wants/ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-043d5bae-71f2-11ef-bceb-c7b262605968@.service. 2024-09-13T17:03:57.855 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:03:57 smithi087 podman[30548]: 2024-09-13 17:03:57.814401433 +0000 UTC m=+0.326846983 container start 752cf36bb26cff60ff81e9f6b30456890af90aaf23574b9d357599fe8c2144e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-13T17:03:57.909 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T17:03:57.909 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout disabled 2024-09-13T17:03:57.916 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T17:03:57.916 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout inactive 2024-09-13T17:03:57.916 INFO:teuthology.orchestra.run.smithi087.stdout:firewalld.service is not enabled 2024-09-13T17:03:57.916 INFO:teuthology.orchestra.run.smithi087.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T17:03:57.916 INFO:teuthology.orchestra.run.smithi087.stdout:Waiting for mon to start... 2024-09-13T17:03:57.916 INFO:teuthology.orchestra.run.smithi087.stdout:Waiting for mon... 2024-09-13T17:03:58.128 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:03:57 smithi087 ceph-mon[30567]: mkfs 043d5bae-71f2-11ef-bceb-c7b262605968 2024-09-13T17:03:58.128 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:03:57 smithi087 ceph-mon[30567]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-13T17:03:58.128 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:03:57 smithi087 bash[30548]: 752cf36bb26cff60ff81e9f6b30456890af90aaf23574b9d357599fe8c2144e6 2024-09-13T17:03:58.128 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:03:57 smithi087 systemd[1]: Started Ceph mon.a for 043d5bae-71f2-11ef-bceb-c7b262605968. 2024-09-13T17:03:58.951 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:03:58 smithi087 ceph-mon[30567]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-13T17:03:58.951 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:03:58 smithi087 ceph-mon[30567]: monmap e1: 1 mons at {a=[v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T17:03:58.952 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:03:58 smithi087 ceph-mon[30567]: fsmap 2024-09-13T17:03:58.952 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:03:58 smithi087 ceph-mon[30567]: osdmap e1: 0 total, 0 up, 0 in 2024-09-13T17:03:58.952 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:03:58 smithi087 ceph-mon[30567]: mgrmap e1: no daemons active 2024-09-13T17:03:58.952 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:03:58 smithi087 ceph-mon[30567]: from='client.? 172.21.15.87:0/894143619' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-13T17:03:58.967 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout cluster: 2024-09-13T17:03:58.967 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout id: 043d5bae-71f2-11ef-bceb-c7b262605968 2024-09-13T17:03:58.967 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-13T17:03:58.968 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-09-13T17:03:58.968 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout services: 2024-09-13T17:03:58.968 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.541867s) 2024-09-13T17:03:58.968 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-13T17:03:58.968 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-13T17:03:58.969 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-09-13T17:03:58.969 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout data: 2024-09-13T17:03:58.969 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-13T17:03:58.969 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-13T17:03:58.969 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-13T17:03:58.969 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout pgs: 2024-09-13T17:03:58.970 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-09-13T17:03:58.970 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.323+0000 7f0884831640 1 Processor -- start 2024-09-13T17:03:58.970 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.323+0000 7f0884831640 1 -- start start 2024-09-13T17:03:58.970 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.324+0000 7f0884831640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f088007bd80 0x7f088007a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:58.970 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.324+0000 7f0884831640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088007a770 con 0x7f088007bd80 2024-09-13T17:03:58.971 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.324+0000 7f087e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f088007bd80 0x7f088007a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:58.971 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.324+0000 7f087e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f088007bd80 0x7f088007a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:36060/0 (socket says 172.21.15.87:36060) 2024-09-13T17:03:58.971 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.324+0000 7f087e59c640 1 -- 172.21.15.87:0/1899367753 learned_addr learned my addr 172.21.15.87:0/1899367753 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:03:58.971 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.324+0000 7f087e59c640 1 -- 172.21.15.87:0/1899367753 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f088007a8b0 con 0x7f088007bd80 2024-09-13T17:03:58.971 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.326+0000 7f087e59c640 1 --2- 172.21.15.87:0/1899367753 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f088007bd80 0x7f088007a230 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0870009820 tx=0x7f087002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bef27af9470f798 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:58.971 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.326+0000 7f087d59a640 1 -- 172.21.15.87:0/1899367753 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0870032440 con 0x7f088007bd80 2024-09-13T17:03:58.971 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.326+0000 7f087d59a640 1 -- 172.21.15.87:0/1899367753 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08700325a0 con 0x7f088007bd80 2024-09-13T17:03:58.971 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.326+0000 7f087d59a640 1 -- 172.21.15.87:0/1899367753 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0870032860 con 0x7f088007bd80 2024-09-13T17:03:58.971 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.327+0000 7f0884831640 1 -- 172.21.15.87:0/1899367753 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f088007bd80 msgr2=0x7f088007a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:58.971 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.327+0000 7f0884831640 1 --2- 172.21.15.87:0/1899367753 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f088007bd80 0x7f088007a230 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0870009820 tx=0x7f087002a300 comp rx=0 tx=0).stop 2024-09-13T17:03:58.971 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.327+0000 7f0884831640 1 -- 172.21.15.87:0/1899367753 shutdown_connections 2024-09-13T17:03:58.971 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.327+0000 7f0884831640 1 --2- 172.21.15.87:0/1899367753 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f088007bd80 0x7f088007a230 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:58.972 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.327+0000 7f0884831640 1 -- 172.21.15.87:0/1899367753 >> 172.21.15.87:0/1899367753 conn(0x7f0880100f40 msgr2=0x7f0880103360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:58.972 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.327+0000 7f0884831640 1 -- 172.21.15.87:0/1899367753 shutdown_connections 2024-09-13T17:03:58.972 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.327+0000 7f0884831640 1 -- 172.21.15.87:0/1899367753 wait complete. 2024-09-13T17:03:58.972 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.328+0000 7f0884831640 1 Processor -- start 2024-09-13T17:03:58.972 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.328+0000 7f0884831640 1 -- start start 2024-09-13T17:03:58.972 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.328+0000 7f0884831640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f088007bd80 0x7f088019ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:58.972 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.328+0000 7f0884831640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088019b380 con 0x7f088007bd80 2024-09-13T17:03:58.972 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.328+0000 7f087e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f088007bd80 0x7f088019ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:58.972 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.328+0000 7f087e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f088007bd80 0x7f088019ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:36070/0 (socket says 172.21.15.87:36070) 2024-09-13T17:03:58.972 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.328+0000 7f087e59c640 1 -- 172.21.15.87:0/894143619 learned_addr learned my addr 172.21.15.87:0/894143619 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:03:58.972 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.328+0000 7f087e59c640 1 -- 172.21.15.87:0/894143619 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08700094d0 con 0x7f088007bd80 2024-09-13T17:03:58.973 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.329+0000 7f087e59c640 1 --2- 172.21.15.87:0/894143619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f088007bd80 0x7f088019ae40 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f08700090b0 tx=0x7f08700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:58.973 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.329+0000 7f086f7fe640 1 -- 172.21.15.87:0/894143619 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f08700308d0 con 0x7f088007bd80 2024-09-13T17:03:58.973 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.329+0000 7f086f7fe640 1 -- 172.21.15.87:0/894143619 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0870030a30 con 0x7f088007bd80 2024-09-13T17:03:58.973 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.329+0000 7f0884831640 1 -- 172.21.15.87:0/894143619 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f088019b580 con 0x7f088007bd80 2024-09-13T17:03:58.973 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.329+0000 7f086f7fe640 1 -- 172.21.15.87:0/894143619 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0870030d10 con 0x7f088007bd80 2024-09-13T17:03:58.973 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.329+0000 7f0884831640 1 -- 172.21.15.87:0/894143619 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f088019ba20 con 0x7f088007bd80 2024-09-13T17:03:58.973 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.329+0000 7f086f7fe640 1 -- 172.21.15.87:0/894143619 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f0870039040 con 0x7f088007bd80 2024-09-13T17:03:58.973 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.329+0000 7f086f7fe640 1 -- 172.21.15.87:0/894143619 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0870046870 con 0x7f088007bd80 2024-09-13T17:03:58.973 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.330+0000 7f0884831640 1 -- 172.21.15.87:0/894143619 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f088007a2b0 con 0x7f088007bd80 2024-09-13T17:03:58.973 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.332+0000 7f086f7fe640 1 -- 172.21.15.87:0/894143619 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f0870037070 con 0x7f088007bd80 2024-09-13T17:03:58.974 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.390+0000 7f0884831640 1 -- 172.21.15.87:0/894143619 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f088007ad80 con 0x7f088007bd80 2024-09-13T17:03:58.974 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.390+0000 7f086f7fe640 1 -- 172.21.15.87:0/894143619 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7f0870046a80 con 0x7f088007bd80 2024-09-13T17:03:58.974 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.391+0000 7f0884831640 1 -- 172.21.15.87:0/894143619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f088007bd80 msgr2=0x7f088019ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:58.974 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.391+0000 7f0884831640 1 --2- 172.21.15.87:0/894143619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f088007bd80 0x7f088019ae40 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f08700090b0 tx=0x7f08700046c0 comp rx=0 tx=0).stop 2024-09-13T17:03:58.974 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.391+0000 7f0884831640 1 -- 172.21.15.87:0/894143619 shutdown_connections 2024-09-13T17:03:58.974 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.391+0000 7f0884831640 1 --2- 172.21.15.87:0/894143619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f088007bd80 0x7f088019ae40 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:58.974 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.391+0000 7f0884831640 1 -- 172.21.15.87:0/894143619 >> 172.21.15.87:0/894143619 conn(0x7f0880100f40 msgr2=0x7f08801020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:58.974 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.391+0000 7f0884831640 1 -- 172.21.15.87:0/894143619 shutdown_connections 2024-09-13T17:03:58.974 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:58.391+0000 7f0884831640 1 -- 172.21.15.87:0/894143619 wait complete. 2024-09-13T17:03:58.974 INFO:teuthology.orchestra.run.smithi087.stdout:mon is available 2024-09-13T17:03:58.974 INFO:teuthology.orchestra.run.smithi087.stdout:Assimilating anything we can from ceph.conf... 2024-09-13T17:03:59.974 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:03:59 smithi087 ceph-mon[30567]: from='client.? 172.21.15.87:0/931326515' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-13T17:03:59.975 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:03:59 smithi087 ceph-mon[30567]: from='client.? 172.21.15.87:0/931326515' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-13T17:03:59.983 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-09-13T17:03:59.983 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T17:03:59.983 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout fsid = 043d5bae-71f2-11ef-bceb-c7b262605968 2024-09-13T17:03:59.983 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.87:3300,v1:172.21.15.87:6789] 2024-09-13T17:03:59.983 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T17:03:59.983 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T17:03:59.983 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T17:03:59.983 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T17:03:59.983 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-09-13T17:03:59.983 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T17:03:59.984 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T17:03:59.984 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-09-13T17:03:59.984 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T17:03:59.984 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-13T17:03:59.984 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-13T17:03:59.984 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-13T17:03:59.984 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T17:03:59.984 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T17:03:59.984 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.337+0000 7f3819af0640 1 Processor -- start 2024-09-13T17:03:59.984 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.337+0000 7f3819af0640 1 -- start start 2024-09-13T17:03:59.984 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.338+0000 7f3819af0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38141045a0 0x7f38141049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:59.984 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.338+0000 7f3819af0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3814104f70 con 0x7f38141045a0 2024-09-13T17:03:59.984 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.338+0000 7f38137fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38141045a0 0x7f38141049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:59.985 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.338+0000 7f38137fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38141045a0 0x7f38141049a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51108/0 (socket says 172.21.15.87:51108) 2024-09-13T17:03:59.985 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.338+0000 7f38137fe640 1 -- 172.21.15.87:0/2782994398 learned_addr learned my addr 172.21.15.87:0/2782994398 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:03:59.985 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.338+0000 7f38137fe640 1 -- 172.21.15.87:0/2782994398 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3814105750 con 0x7f38141045a0 2024-09-13T17:03:59.985 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.339+0000 7f38137fe640 1 --2- 172.21.15.87:0/2782994398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38141045a0 0x7f38141049a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3804009820 tx=0x7f380402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=935595dee270d222 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:59.985 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.339+0000 7f3812ffd640 1 -- 172.21.15.87:0/2782994398 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f380402ae70 con 0x7f38141045a0 2024-09-13T17:03:59.985 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.339+0000 7f3812ffd640 1 -- 172.21.15.87:0/2782994398 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3804032440 con 0x7f38141045a0 2024-09-13T17:03:59.985 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.339+0000 7f3812ffd640 1 -- 172.21.15.87:0/2782994398 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3804032700 con 0x7f38141045a0 2024-09-13T17:03:59.985 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.339+0000 7f3819af0640 1 -- 172.21.15.87:0/2782994398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38141045a0 msgr2=0x7f38141049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:59.985 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.339+0000 7f3819af0640 1 --2- 172.21.15.87:0/2782994398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38141045a0 0x7f38141049a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3804009820 tx=0x7f380402a270 comp rx=0 tx=0).stop 2024-09-13T17:03:59.985 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.339+0000 7f3819af0640 1 -- 172.21.15.87:0/2782994398 shutdown_connections 2024-09-13T17:03:59.985 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.339+0000 7f3819af0640 1 --2- 172.21.15.87:0/2782994398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38141045a0 0x7f38141049a0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:59.985 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.339+0000 7f3819af0640 1 -- 172.21.15.87:0/2782994398 >> 172.21.15.87:0/2782994398 conn(0x7f38140ffd70 msgr2=0x7f3814102190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:59.986 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.339+0000 7f3819af0640 1 -- 172.21.15.87:0/2782994398 shutdown_connections 2024-09-13T17:03:59.986 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.339+0000 7f3819af0640 1 -- 172.21.15.87:0/2782994398 wait complete. 2024-09-13T17:03:59.986 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.340+0000 7f3819af0640 1 Processor -- start 2024-09-13T17:03:59.986 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.340+0000 7f3819af0640 1 -- start start 2024-09-13T17:03:59.986 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.340+0000 7f3819af0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38141045a0 0x7f3814198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:03:59.986 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.340+0000 7f3819af0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38141990d0 con 0x7f38141045a0 2024-09-13T17:03:59.986 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.340+0000 7f38137fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38141045a0 0x7f3814198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:03:59.986 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.340+0000 7f38137fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38141045a0 0x7f3814198b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51118/0 (socket says 172.21.15.87:51118) 2024-09-13T17:03:59.986 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.340+0000 7f38137fe640 1 -- 172.21.15.87:0/931326515 learned_addr learned my addr 172.21.15.87:0/931326515 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:03:59.986 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.341+0000 7f38137fe640 1 -- 172.21.15.87:0/931326515 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38040094d0 con 0x7f38141045a0 2024-09-13T17:03:59.986 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.341+0000 7f38137fe640 1 --2- 172.21.15.87:0/931326515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38141045a0 0x7f3814198b90 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f38040090b0 tx=0x7f38040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:03:59.986 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.341+0000 7f38117fa640 1 -- 172.21.15.87:0/931326515 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38040308d0 con 0x7f38141045a0 2024-09-13T17:03:59.986 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.341+0000 7f38117fa640 1 -- 172.21.15.87:0/931326515 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3804030a30 con 0x7f38141045a0 2024-09-13T17:03:59.987 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.341+0000 7f3819af0640 1 -- 172.21.15.87:0/931326515 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38141992d0 con 0x7f38141045a0 2024-09-13T17:03:59.987 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.341+0000 7f38117fa640 1 -- 172.21.15.87:0/931326515 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3804030cf0 con 0x7f38141045a0 2024-09-13T17:03:59.987 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.341+0000 7f3819af0640 1 -- 172.21.15.87:0/931326515 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3814199770 con 0x7f38141045a0 2024-09-13T17:03:59.987 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.341+0000 7f38117fa640 1 -- 172.21.15.87:0/931326515 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f3804039040 con 0x7f38141045a0 2024-09-13T17:03:59.987 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.341+0000 7f38117fa640 1 -- 172.21.15.87:0/931326515 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3804046910 con 0x7f38141045a0 2024-09-13T17:03:59.987 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.342+0000 7f3819af0640 1 -- 172.21.15.87:0/931326515 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3814106290 con 0x7f38141045a0 2024-09-13T17:03:59.987 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.344+0000 7f38117fa640 1 -- 172.21.15.87:0/931326515 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f3804037070 con 0x7f38141045a0 2024-09-13T17:03:59.987 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.400+0000 7f3819af0640 1 -- 172.21.15.87:0/931326515 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f38141928e0 con 0x7f38141045a0 2024-09-13T17:03:59.987 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.403+0000 7f38117fa640 1 -- 172.21.15.87:0/931326515 <== mon.0 v2:172.21.15.87:3300/0 7 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f380404f8b0 con 0x7f38141045a0 2024-09-13T17:03:59.987 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.403+0000 7f38117fa640 1 -- 172.21.15.87:0/931326515 <== mon.0 v2:172.21.15.87:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f3804053e10 con 0x7f38141045a0 2024-09-13T17:03:59.987 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.404+0000 7f3819af0640 1 -- 172.21.15.87:0/931326515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38141045a0 msgr2=0x7f3814198b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:03:59.987 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.404+0000 7f3819af0640 1 --2- 172.21.15.87:0/931326515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38141045a0 0x7f3814198b90 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f38040090b0 tx=0x7f38040046c0 comp rx=0 tx=0).stop 2024-09-13T17:03:59.988 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.404+0000 7f3819af0640 1 -- 172.21.15.87:0/931326515 shutdown_connections 2024-09-13T17:03:59.988 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.404+0000 7f3819af0640 1 --2- 172.21.15.87:0/931326515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38141045a0 0x7f3814198b90 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:03:59.988 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.404+0000 7f3819af0640 1 -- 172.21.15.87:0/931326515 >> 172.21.15.87:0/931326515 conn(0x7f38140ffd70 msgr2=0x7f381418fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:03:59.988 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.405+0000 7f3819af0640 1 -- 172.21.15.87:0/931326515 shutdown_connections 2024-09-13T17:03:59.988 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:03:59.405+0000 7f3819af0640 1 -- 172.21.15.87:0/931326515 wait complete. 2024-09-13T17:03:59.988 INFO:teuthology.orchestra.run.smithi087.stdout:Generating new minimal ceph.conf... 2024-09-13T17:04:01.029 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.393+0000 7fb289aa6640 1 Processor -- start 2024-09-13T17:04:01.029 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.393+0000 7fb289aa6640 1 -- start start 2024-09-13T17:04:01.029 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.393+0000 7fb289aa6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2841045a0 0x7fb2841049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:01.029 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.393+0000 7fb289aa6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb284104f70 con 0x7fb2841045a0 2024-09-13T17:04:01.029 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.393+0000 7fb2837fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2841045a0 0x7fb2841049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:01.029 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.393+0000 7fb2837fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2841045a0 0x7fb2841049a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51120/0 (socket says 172.21.15.87:51120) 2024-09-13T17:04:01.029 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.393+0000 7fb2837fe640 1 -- 172.21.15.87:0/1443047421 learned_addr learned my addr 172.21.15.87:0/1443047421 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:01.029 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.393+0000 7fb2837fe640 1 -- 172.21.15.87:0/1443047421 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2841057a0 con 0x7fb2841045a0 2024-09-13T17:04:01.029 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.394+0000 7fb2837fe640 1 --2- 172.21.15.87:0/1443047421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2841045a0 0x7fb2841049a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb274009820 tx=0x7fb27402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f95b099faa417a2a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:01.030 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.394+0000 7fb2827fc640 1 -- 172.21.15.87:0/1443047421 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb27402ae70 con 0x7fb2841045a0 2024-09-13T17:04:01.030 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.394+0000 7fb2827fc640 1 -- 172.21.15.87:0/1443047421 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb2740328d0 con 0x7fb2841045a0 2024-09-13T17:04:01.030 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.394+0000 7fb2827fc640 1 -- 172.21.15.87:0/1443047421 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2740308a0 con 0x7fb2841045a0 2024-09-13T17:04:01.030 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.395+0000 7fb289aa6640 1 -- 172.21.15.87:0/1443047421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2841045a0 msgr2=0x7fb2841049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:01.030 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.395+0000 7fb289aa6640 1 --2- 172.21.15.87:0/1443047421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2841045a0 0x7fb2841049a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb274009820 tx=0x7fb27402a270 comp rx=0 tx=0).stop 2024-09-13T17:04:01.030 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.395+0000 7fb289aa6640 1 -- 172.21.15.87:0/1443047421 shutdown_connections 2024-09-13T17:04:01.030 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.395+0000 7fb289aa6640 1 --2- 172.21.15.87:0/1443047421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2841045a0 0x7fb2841049a0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:01.030 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.395+0000 7fb289aa6640 1 -- 172.21.15.87:0/1443047421 >> 172.21.15.87:0/1443047421 conn(0x7fb2840ffe10 msgr2=0x7fb284102230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:01.030 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.395+0000 7fb289aa6640 1 -- 172.21.15.87:0/1443047421 shutdown_connections 2024-09-13T17:04:01.030 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.395+0000 7fb289aa6640 1 -- 172.21.15.87:0/1443047421 wait complete. 2024-09-13T17:04:01.030 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.395+0000 7fb289aa6640 1 Processor -- start 2024-09-13T17:04:01.030 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.396+0000 7fb289aa6640 1 -- start start 2024-09-13T17:04:01.030 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.396+0000 7fb289aa6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2841045a0 0x7fb284199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:01.031 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.396+0000 7fb289aa6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb284199940 con 0x7fb2841045a0 2024-09-13T17:04:01.031 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.396+0000 7fb2837fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2841045a0 0x7fb284199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:01.031 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.396+0000 7fb2837fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2841045a0 0x7fb284199400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51136/0 (socket says 172.21.15.87:51136) 2024-09-13T17:04:01.031 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.396+0000 7fb2837fe640 1 -- 172.21.15.87:0/2048237328 learned_addr learned my addr 172.21.15.87:0/2048237328 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:01.031 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.396+0000 7fb2837fe640 1 -- 172.21.15.87:0/2048237328 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2740094d0 con 0x7fb2841045a0 2024-09-13T17:04:01.031 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.396+0000 7fb2837fe640 1 --2- 172.21.15.87:0/2048237328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2841045a0 0x7fb284199400 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb27402a790 tx=0x7fb274030d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:01.031 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.396+0000 7fb280ff9640 1 -- 172.21.15.87:0/2048237328 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb274032d80 con 0x7fb2841045a0 2024-09-13T17:04:01.031 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.396+0000 7fb280ff9640 1 -- 172.21.15.87:0/2048237328 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb27403b8c0 con 0x7fb2841045a0 2024-09-13T17:04:01.031 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.396+0000 7fb280ff9640 1 -- 172.21.15.87:0/2048237328 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb27403a6e0 con 0x7fb2841045a0 2024-09-13T17:04:01.031 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.396+0000 7fb289aa6640 1 -- 172.21.15.87:0/2048237328 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb284199b40 con 0x7fb2841045a0 2024-09-13T17:04:01.031 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.396+0000 7fb289aa6640 1 -- 172.21.15.87:0/2048237328 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb284199fe0 con 0x7fb2841045a0 2024-09-13T17:04:01.031 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.397+0000 7fb280ff9640 1 -- 172.21.15.87:0/2048237328 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fb274039040 con 0x7fb2841045a0 2024-09-13T17:04:01.031 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.397+0000 7fb280ff9640 1 -- 172.21.15.87:0/2048237328 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb27404c350 con 0x7fb2841045a0 2024-09-13T17:04:01.031 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.398+0000 7fb289aa6640 1 -- 172.21.15.87:0/2048237328 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb284193600 con 0x7fb2841045a0 2024-09-13T17:04:01.032 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.400+0000 7fb280ff9640 1 -- 172.21.15.87:0/2048237328 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fb274049060 con 0x7fb2841045a0 2024-09-13T17:04:01.032 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.456+0000 7fb289aa6640 1 -- 172.21.15.87:0/2048237328 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fb284108c30 con 0x7fb2841045a0 2024-09-13T17:04:01.032 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.456+0000 7fb280ff9640 1 -- 172.21.15.87:0/2048237328 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7fb27403f070 con 0x7fb2841045a0 2024-09-13T17:04:01.032 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.457+0000 7fb289aa6640 1 -- 172.21.15.87:0/2048237328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2841045a0 msgr2=0x7fb284199400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:01.032 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.457+0000 7fb289aa6640 1 --2- 172.21.15.87:0/2048237328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2841045a0 0x7fb284199400 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb27402a790 tx=0x7fb274030d90 comp rx=0 tx=0).stop 2024-09-13T17:04:01.032 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.457+0000 7fb289aa6640 1 -- 172.21.15.87:0/2048237328 shutdown_connections 2024-09-13T17:04:01.032 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.457+0000 7fb289aa6640 1 --2- 172.21.15.87:0/2048237328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2841045a0 0x7fb284199400 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:01.032 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.457+0000 7fb289aa6640 1 -- 172.21.15.87:0/2048237328 >> 172.21.15.87:0/2048237328 conn(0x7fb2840ffe10 msgr2=0x7fb284100cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:01.032 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.457+0000 7fb289aa6640 1 -- 172.21.15.87:0/2048237328 shutdown_connections 2024-09-13T17:04:01.032 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:00.457+0000 7fb289aa6640 1 -- 172.21.15.87:0/2048237328 wait complete. 2024-09-13T17:04:01.032 INFO:teuthology.orchestra.run.smithi087.stdout:Restarting the monitor... 2024-09-13T17:04:01.046 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:00 smithi087 ceph-mon[30567]: from='client.? 172.21.15.87:0/2048237328' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:04:01.302 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:01 smithi087 systemd[1]: Stopping Ceph mon.a for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:04:01.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:01 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mon-a[30563]: 2024-09-13T17:04:01.300+0000 7f0410075640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:04:01.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:01 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mon-a[30563]: 2024-09-13T17:04:01.300+0000 7f0410075640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-13T17:04:01.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:01 smithi087 podman[30810]: 2024-09-13 17:04:01.545609886 +0000 UTC m=+0.359465337 container died 752cf36bb26cff60ff81e9f6b30456890af90aaf23574b9d357599fe8c2144e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True) 2024-09-13T17:04:02.200 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:01 smithi087 podman[30810]: 2024-09-13 17:04:01.849591519 +0000 UTC m=+0.663446959 container cleanup 752cf36bb26cff60ff81e9f6b30456890af90aaf23574b9d357599fe8c2144e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mon-a, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-13T17:04:02.200 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:01 smithi087 bash[30810]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mon-a 2024-09-13T17:04:02.201 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 podman[30822]: 2024-09-13 17:04:02.000281266 +0000 UTC m=+0.450683933 container remove 752cf36bb26cff60ff81e9f6b30456890af90aaf23574b9d357599fe8c2144e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mon-a, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-13T17:04:02.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 systemd[1]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-13T17:04:02.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 systemd[1]: Stopped Ceph mon.a for 043d5bae-71f2-11ef-bceb-c7b262605968. 2024-09-13T17:04:02.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 systemd[1]: Starting Ceph mon.a for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:04:02.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 podman[30915]: 2024-09-13 17:04:02.434389357 +0000 UTC m=+0.107037129 container create 054de9f0e33b3baae2fa0339fe4bd245f6837e484c96a3bf1ff372b2e82f0bee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mon-a, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:04:02.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 podman[30915]: 2024-09-13 17:04:02.343111886 +0000 UTC m=+0.015759670 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:04:02.736 INFO:teuthology.orchestra.run.smithi087.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-13T17:04:02.838 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 podman[30915]: 2024-09-13 17:04:02.645091428 +0000 UTC m=+0.317739199 container init 054de9f0e33b3baae2fa0339fe4bd245f6837e484c96a3bf1ff372b2e82f0bee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-13T17:04:02.838 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 podman[30915]: 2024-09-13 17:04:02.648287101 +0000 UTC m=+0.320934873 container start 054de9f0e33b3baae2fa0339fe4bd245f6837e484c96a3bf1ff372b2e82f0bee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mon-a, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:04:02.839 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T17:04:02.839 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable), process ceph-mon, pid 2 2024-09-13T17:04:02.839 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: pidfile_write: ignore empty --pid-file 2024-09-13T17:04:02.839 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: load: jerasure load: lrc 2024-09-13T17:04:02.839 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: RocksDB version: 7.9.2 2024-09-13T17:04:02.839 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Git sha 0 2024-09-13T17:04:02.839 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Compile date 2024-09-10 12:59:06 2024-09-13T17:04:02.839 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: DB SUMMARY 2024-09-13T17:04:02.839 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: DB Session ID: 8ZWSMIJD3CZEGLALC4JB 2024-09-13T17:04:02.839 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: CURRENT file: CURRENT 2024-09-13T17:04:02.839 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T17:04:02.839 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-13T17:04:02.840 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-13T17:04:02.840 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 100255 ; 2024-09-13T17:04:02.840 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.error_if_exists: 0 2024-09-13T17:04:02.840 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.create_if_missing: 0 2024-09-13T17:04:02.840 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.paranoid_checks: 1 2024-09-13T17:04:02.840 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T17:04:02.840 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T17:04:02.840 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T17:04:02.840 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.env: 0x557ea2acfbc0 2024-09-13T17:04:02.840 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T17:04:02.841 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.info_log: 0x557ea3472be0 2024-09-13T17:04:02.841 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T17:04:02.842 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.statistics: (nil) 2024-09-13T17:04:02.842 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.use_fsync: 0 2024-09-13T17:04:02.842 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.max_log_file_size: 0 2024-09-13T17:04:02.842 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T17:04:02.842 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T17:04:02.843 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T17:04:02.843 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T17:04:02.843 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.allow_fallocate: 1 2024-09-13T17:04:02.843 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T17:04:02.843 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T17:04:02.843 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.use_direct_reads: 0 2024-09-13T17:04:02.843 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T17:04:02.843 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T17:04:02.843 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.db_log_dir: 2024-09-13T17:04:02.843 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.wal_dir: 2024-09-13T17:04:02.843 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T17:04:02.843 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T17:04:02.843 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T17:04:02.844 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T17:04:02.844 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T17:04:02.844 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T17:04:02.844 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T17:04:02.844 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T17:04:02.844 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.write_buffer_manager: 0x557ea3480320 2024-09-13T17:04:02.844 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T17:04:02.844 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T17:04:02.844 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T17:04:02.844 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T17:04:02.845 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T17:04:02.845 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T17:04:02.845 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T17:04:02.845 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T17:04:02.845 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.unordered_write: 0 2024-09-13T17:04:02.848 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T17:04:02.848 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T17:04:02.848 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T17:04:02.848 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T17:04:02.848 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.row_cache: None 2024-09-13T17:04:02.848 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.wal_filter: None 2024-09-13T17:04:02.848 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T17:04:02.848 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T17:04:02.848 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.two_write_queues: 0 2024-09-13T17:04:02.849 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T17:04:02.849 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.wal_compression: 0 2024-09-13T17:04:02.849 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.atomic_flush: 0 2024-09-13T17:04:02.849 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T17:04:02.849 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T17:04:02.849 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T17:04:02.849 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.log_readahead_size: 0 2024-09-13T17:04:02.849 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T17:04:02.849 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T17:04:02.849 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T17:04:02.849 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T17:04:02.849 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T17:04:02.849 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T17:04:02.849 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T17:04:02.850 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.max_background_jobs: 2 2024-09-13T17:04:02.850 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.max_background_compactions: -1 2024-09-13T17:04:02.850 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.max_subcompactions: 1 2024-09-13T17:04:02.850 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T17:04:02.850 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T17:04:02.850 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T17:04:02.850 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T17:04:02.850 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T17:04:02.850 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T17:04:02.850 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T17:04:02.850 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T17:04:02.850 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.max_open_files: -1 2024-09-13T17:04:02.850 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T17:04:02.850 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T17:04:02.850 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T17:04:02.851 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T17:04:02.851 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.max_background_flushes: -1 2024-09-13T17:04:02.851 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Compression algorithms supported: 2024-09-13T17:04:02.851 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: kZSTD supported: 0 2024-09-13T17:04:02.851 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: kXpressCompression supported: 0 2024-09-13T17:04:02.851 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: kBZip2Compression supported: 0 2024-09-13T17:04:02.851 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T17:04:02.851 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: kLZ4Compression supported: 1 2024-09-13T17:04:02.851 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: kZlibCompression supported: 1 2024-09-13T17:04:02.851 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T17:04:02.851 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: kSnappyCompression supported: 1 2024-09-13T17:04:02.851 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T17:04:02.851 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T17:04:02.851 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-13T17:04:02.852 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T17:04:02.852 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T17:04:02.852 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.merge_operator: 2024-09-13T17:04:02.852 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.compaction_filter: None 2024-09-13T17:04:02.852 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T17:04:02.852 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T17:04:02.852 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T17:04:02.852 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T17:04:02.852 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557ea34727e0) 2024-09-13T17:04:02.852 INFO:journalctl@ceph.mon.a.smithi087.stdout: cache_index_and_filter_blocks: 1 2024-09-13T17:04:02.852 INFO:journalctl@ceph.mon.a.smithi087.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T17:04:02.852 INFO:journalctl@ceph.mon.a.smithi087.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T17:04:02.852 INFO:journalctl@ceph.mon.a.smithi087.stdout: pin_top_level_index_and_filter: 1 2024-09-13T17:04:02.852 INFO:journalctl@ceph.mon.a.smithi087.stdout: index_type: 0 2024-09-13T17:04:02.853 INFO:journalctl@ceph.mon.a.smithi087.stdout: data_block_index_type: 0 2024-09-13T17:04:02.853 INFO:journalctl@ceph.mon.a.smithi087.stdout: index_shortening: 1 2024-09-13T17:04:02.853 INFO:journalctl@ceph.mon.a.smithi087.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T17:04:02.853 INFO:journalctl@ceph.mon.a.smithi087.stdout: checksum: 4 2024-09-13T17:04:02.853 INFO:journalctl@ceph.mon.a.smithi087.stdout: no_block_cache: 0 2024-09-13T17:04:02.853 INFO:journalctl@ceph.mon.a.smithi087.stdout: block_cache: 0x557ea3467350 2024-09-13T17:04:02.853 INFO:journalctl@ceph.mon.a.smithi087.stdout: block_cache_name: BinnedLRUCache 2024-09-13T17:04:02.853 INFO:journalctl@ceph.mon.a.smithi087.stdout: block_cache_options: 2024-09-13T17:04:02.853 INFO:journalctl@ceph.mon.a.smithi087.stdout: capacity : 536870912 2024-09-13T17:04:02.853 INFO:journalctl@ceph.mon.a.smithi087.stdout: num_shard_bits : 4 2024-09-13T17:04:02.853 INFO:journalctl@ceph.mon.a.smithi087.stdout: strict_capacity_limit : 0 2024-09-13T17:04:02.853 INFO:journalctl@ceph.mon.a.smithi087.stdout: high_pri_pool_ratio: 0.000 2024-09-13T17:04:02.853 INFO:journalctl@ceph.mon.a.smithi087.stdout: block_cache_compressed: (nil) 2024-09-13T17:04:02.853 INFO:journalctl@ceph.mon.a.smithi087.stdout: persistent_cache: (nil) 2024-09-13T17:04:02.854 INFO:journalctl@ceph.mon.a.smithi087.stdout: block_size: 4096 2024-09-13T17:04:02.854 INFO:journalctl@ceph.mon.a.smithi087.stdout: block_size_deviation: 10 2024-09-13T17:04:02.854 INFO:journalctl@ceph.mon.a.smithi087.stdout: block_restart_interval: 16 2024-09-13T17:04:02.854 INFO:journalctl@ceph.mon.a.smithi087.stdout: index_block_restart_interval: 1 2024-09-13T17:04:02.854 INFO:journalctl@ceph.mon.a.smithi087.stdout: metadata_block_size: 4096 2024-09-13T17:04:02.854 INFO:journalctl@ceph.mon.a.smithi087.stdout: partition_filters: 0 2024-09-13T17:04:02.854 INFO:journalctl@ceph.mon.a.smithi087.stdout: use_delta_encoding: 1 2024-09-13T17:04:02.854 INFO:journalctl@ceph.mon.a.smithi087.stdout: filter_policy: bloomfilter 2024-09-13T17:04:02.854 INFO:journalctl@ceph.mon.a.smithi087.stdout: whole_key_filtering: 1 2024-09-13T17:04:02.854 INFO:journalctl@ceph.mon.a.smithi087.stdout: verify_compression: 0 2024-09-13T17:04:02.854 INFO:journalctl@ceph.mon.a.smithi087.stdout: read_amp_bytes_per_bit: 0 2024-09-13T17:04:02.854 INFO:journalctl@ceph.mon.a.smithi087.stdout: format_version: 5 2024-09-13T17:04:02.854 INFO:journalctl@ceph.mon.a.smithi087.stdout: enable_index_compression: 1 2024-09-13T17:04:02.854 INFO:journalctl@ceph.mon.a.smithi087.stdout: block_align: 0 2024-09-13T17:04:02.855 INFO:journalctl@ceph.mon.a.smithi087.stdout: max_auto_readahead_size: 262144 2024-09-13T17:04:02.855 INFO:journalctl@ceph.mon.a.smithi087.stdout: prepopulate_block_cache: 0 2024-09-13T17:04:02.855 INFO:journalctl@ceph.mon.a.smithi087.stdout: initial_auto_readahead_size: 8192 2024-09-13T17:04:02.855 INFO:journalctl@ceph.mon.a.smithi087.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T17:04:02.855 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T17:04:02.855 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T17:04:02.855 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.compression: NoCompression 2024-09-13T17:04:02.855 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T17:04:02.855 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T17:04:02.855 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T17:04:02.855 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.num_levels: 7 2024-09-13T17:04:02.855 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T17:04:02.855 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T17:04:02.855 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T17:04:02.856 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T17:04:02.856 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T17:04:02.856 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T17:04:02.856 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T17:04:02.856 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T17:04:02.856 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T17:04:02.856 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T17:04:02.856 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T17:04:02.856 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T17:04:02.856 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T17:04:02.856 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T17:04:02.856 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T17:04:02.856 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T17:04:02.856 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T17:04:02.856 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T17:04:02.857 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T17:04:02.857 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T17:04:02.857 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T17:04:02.857 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T17:04:02.857 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T17:04:02.857 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T17:04:02.857 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T17:04:02.857 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T17:04:02.857 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T17:04:02.857 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T17:04:02.857 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T17:04:02.857 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T17:04:02.857 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T17:04:02.857 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T17:04:02.858 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T17:04:02.858 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T17:04:02.858 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T17:04:02.858 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T17:04:02.858 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T17:04:02.858 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T17:04:02.858 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T17:04:02.858 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T17:04:02.858 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T17:04:02.858 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T17:04:02.858 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T17:04:02.858 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T17:04:02.858 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T17:04:02.858 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T17:04:02.858 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T17:04:02.859 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T17:04:02.859 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T17:04:02.859 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T17:04:02.859 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T17:04:02.859 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T17:04:02.859 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T17:04:02.859 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T17:04:02.859 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.inplace_update_support: 0 2024-09-13T17:04:02.859 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T17:04:02.859 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T17:04:02.859 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T17:04:02.859 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T17:04:02.860 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.bloom_locality: 0 2024-09-13T17:04:02.860 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.max_successive_merges: 0 2024-09-13T17:04:02.860 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T17:04:02.860 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T17:04:02.860 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T17:04:02.860 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T17:04:02.860 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.ttl: 2592000 2024-09-13T17:04:02.860 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T17:04:02.860 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T17:04:02.860 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T17:04:02.860 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.enable_blob_files: false 2024-09-13T17:04:02.860 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.min_blob_size: 0 2024-09-13T17:04:02.861 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T17:04:02.861 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T17:04:02.861 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T17:04:02.861 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T17:04:02.861 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T17:04:02.861 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T17:04:02.861 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T17:04:02.861 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T17:04:02.861 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-13T17:04:02.861 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-13T17:04:02.861 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: efa4b0de-8546-4865-99e5-d88cb8659984 2024-09-13T17:04:02.861 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726247042676628, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-13T17:04:02.861 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-13T17:04:02.861 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726247042677651, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 95363, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 320, "table_properties": {"data_size": 93329, "index_size": 290, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13993, "raw_average_key_size": 50, "raw_value_size": 85743, "raw_average_value_size": 307, "num_data_blocks": 11, "num_entries": 279, "num_filter_entries": 279, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726247042, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "efa4b0de-8546-4865-99e5-d88cb8659984", "db_session_id": "8ZWSMIJD3CZEGLALC4JB", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-13T17:04:02.862 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726247042677746, "job": 1, "event": "recovery_finished"} 2024-09-13T17:04:02.862 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-13T17:04:02.862 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T17:04:02.862 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x557ea3492e00 2024-09-13T17:04:02.862 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: DB pointer 0x557ea3586000 2024-09-13T17:04:02.862 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T17:04:02.862 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T17:04:02.862 INFO:journalctl@ceph.mon.a.smithi087.stdout: ** DB Stats ** 2024-09-13T17:04:02.862 INFO:journalctl@ceph.mon.a.smithi087.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T17:04:02.862 INFO:journalctl@ceph.mon.a.smithi087.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T17:04:02.862 INFO:journalctl@ceph.mon.a.smithi087.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T17:04:02.862 INFO:journalctl@ceph.mon.a.smithi087.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T17:04:02.862 INFO:journalctl@ceph.mon.a.smithi087.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T17:04:02.863 INFO:journalctl@ceph.mon.a.smithi087.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T17:04:02.863 INFO:journalctl@ceph.mon.a.smithi087.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T17:04:02.863 INFO:journalctl@ceph.mon.a.smithi087.stdout: 2024-09-13T17:04:02.863 INFO:journalctl@ceph.mon.a.smithi087.stdout: ** Compaction Stats [default] ** 2024-09-13T17:04:02.863 INFO:journalctl@ceph.mon.a.smithi087.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T17:04:02.863 INFO:journalctl@ceph.mon.a.smithi087.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T17:04:02.863 INFO:journalctl@ceph.mon.a.smithi087.stdout: L0 2/0 94.99 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 135.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T17:04:02.863 INFO:journalctl@ceph.mon.a.smithi087.stdout: Sum 2/0 94.99 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 135.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T17:04:02.863 INFO:journalctl@ceph.mon.a.smithi087.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 135.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T17:04:02.863 INFO:journalctl@ceph.mon.a.smithi087.stdout: 2024-09-13T17:04:02.863 INFO:journalctl@ceph.mon.a.smithi087.stdout: ** Compaction Stats [default] ** 2024-09-13T17:04:02.863 INFO:journalctl@ceph.mon.a.smithi087.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T17:04:02.863 INFO:journalctl@ceph.mon.a.smithi087.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T17:04:02.864 INFO:journalctl@ceph.mon.a.smithi087.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 135.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T17:04:02.864 INFO:journalctl@ceph.mon.a.smithi087.stdout: 2024-09-13T17:04:02.864 INFO:journalctl@ceph.mon.a.smithi087.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T17:04:02.864 INFO:journalctl@ceph.mon.a.smithi087.stdout: 2024-09-13T17:04:02.864 INFO:journalctl@ceph.mon.a.smithi087.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T17:04:02.864 INFO:journalctl@ceph.mon.a.smithi087.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-13T17:04:02.864 INFO:journalctl@ceph.mon.a.smithi087.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T17:04:02.864 INFO:journalctl@ceph.mon.a.smithi087.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T17:04:02.864 INFO:journalctl@ceph.mon.a.smithi087.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T17:04:02.864 INFO:journalctl@ceph.mon.a.smithi087.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T17:04:02.864 INFO:journalctl@ceph.mon.a.smithi087.stdout: Cumulative compaction: 0.00 GB write, 29.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T17:04:02.864 INFO:journalctl@ceph.mon.a.smithi087.stdout: Interval compaction: 0.00 GB write, 29.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T17:04:02.864 INFO:journalctl@ceph.mon.a.smithi087.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T17:04:02.865 INFO:journalctl@ceph.mon.a.smithi087.stdout: Block cache BinnedLRUCache@0x557ea3467350#2 capacity: 512.00 MB usage: 1.39 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-09-13T17:04:02.865 INFO:journalctl@ceph.mon.a.smithi087.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-13T17:04:02.865 INFO:journalctl@ceph.mon.a.smithi087.stdout: 2024-09-13T17:04:02.865 INFO:journalctl@ceph.mon.a.smithi087.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T17:04:02.865 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: starting mon.a rank 0 at public addrs [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] at bind addrs [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 043d5bae-71f2-11ef-bceb-c7b262605968 2024-09-13T17:04:02.865 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: mon.a@-1(???) e1 preinit fsid 043d5bae-71f2-11ef-bceb-c7b262605968 2024-09-13T17:04:02.865 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: mon.a@-1(???).mds e1 new map 2024-09-13T17:04:02.865 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: mon.a@-1(???).mds e1 print_map 2024-09-13T17:04:02.865 INFO:journalctl@ceph.mon.a.smithi087.stdout: e1 2024-09-13T17:04:02.865 INFO:journalctl@ceph.mon.a.smithi087.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T17:04:02.865 INFO:journalctl@ceph.mon.a.smithi087.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:04:02.865 INFO:journalctl@ceph.mon.a.smithi087.stdout: legacy client fscid: -1 2024-09-13T17:04:02.865 INFO:journalctl@ceph.mon.a.smithi087.stdout: 2024-09-13T17:04:02.865 INFO:journalctl@ceph.mon.a.smithi087.stdout: No filesystems configured 2024-09-13T17:04:02.866 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-13T17:04:02.866 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T17:04:02.866 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T17:04:02.866 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T17:04:02.866 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-13T17:04:02.866 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 bash[30915]: 054de9f0e33b3baae2fa0339fe4bd245f6837e484c96a3bf1ff372b2e82f0bee 2024-09-13T17:04:02.866 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 systemd[1]: Started Ceph mon.a for 043d5bae-71f2-11ef-bceb-c7b262605968. 2024-09-13T17:04:02.866 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-13T17:04:02.866 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: monmap e1: 1 mons at {a=[v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T17:04:02.866 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: fsmap 2024-09-13T17:04:02.866 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: osdmap e1: 0 total, 0 up, 0 in 2024-09-13T17:04:02.866 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:02 smithi087 ceph-mon[30934]: mgrmap e1: no daemons active 2024-09-13T17:04:03.767 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.204+0000 7f66b1e23640 1 Processor -- start 2024-09-13T17:04:03.767 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.204+0000 7f66b1e23640 1 -- start start 2024-09-13T17:04:03.767 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.204+0000 7f66b1e23640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66ac1056f0 0x7f66ac105af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:03.767 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.204+0000 7f66b1e23640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac1060c0 con 0x7f66ac1056f0 2024-09-13T17:04:03.767 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.204+0000 7f66ab7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66ac1056f0 0x7f66ac105af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:03.767 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.204+0000 7f66ab7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66ac1056f0 0x7f66ac105af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51142/0 (socket says 172.21.15.87:51142) 2024-09-13T17:04:03.767 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.204+0000 7f66ab7fe640 1 -- 172.21.15.87:0/1047433149 learned_addr learned my addr 172.21.15.87:0/1047433149 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:03.767 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.205+0000 7f66ab7fe640 1 -- 172.21.15.87:0/1047433149 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ac1068a0 con 0x7f66ac1056f0 2024-09-13T17:04:03.767 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.207+0000 7f66ab7fe640 1 --2- 172.21.15.87:0/1047433149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66ac1056f0 0x7f66ac105af0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f669c009820 tx=0x7f669c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36a0e4f39fab8438 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:03.768 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.207+0000 7f66aaffd640 1 -- 172.21.15.87:0/1047433149 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f669c02ae70 con 0x7f66ac1056f0 2024-09-13T17:04:03.768 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.207+0000 7f66aaffd640 1 -- 172.21.15.87:0/1047433149 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f669c0328d0 con 0x7f66ac1056f0 2024-09-13T17:04:03.768 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.207+0000 7f66aaffd640 1 -- 172.21.15.87:0/1047433149 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f669c0308a0 con 0x7f66ac1056f0 2024-09-13T17:04:03.768 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.207+0000 7f66b1e23640 1 -- 172.21.15.87:0/1047433149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66ac1056f0 msgr2=0x7f66ac105af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:03.768 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.207+0000 7f66b1e23640 1 --2- 172.21.15.87:0/1047433149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66ac1056f0 0x7f66ac105af0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f669c009820 tx=0x7f669c02a270 comp rx=0 tx=0).stop 2024-09-13T17:04:03.768 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.207+0000 7f66b1e23640 1 -- 172.21.15.87:0/1047433149 shutdown_connections 2024-09-13T17:04:03.768 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.207+0000 7f66b1e23640 1 --2- 172.21.15.87:0/1047433149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66ac1056f0 0x7f66ac105af0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:03.768 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.207+0000 7f66b1e23640 1 -- 172.21.15.87:0/1047433149 >> 172.21.15.87:0/1047433149 conn(0x7f66ac100f40 msgr2=0x7f66ac103360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:03.768 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.208+0000 7f66b1e23640 1 -- 172.21.15.87:0/1047433149 shutdown_connections 2024-09-13T17:04:03.768 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.208+0000 7f66b1e23640 1 -- 172.21.15.87:0/1047433149 wait complete. 2024-09-13T17:04:03.768 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.208+0000 7f66b1e23640 1 Processor -- start 2024-09-13T17:04:03.768 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.208+0000 7f66b1e23640 1 -- start start 2024-09-13T17:04:03.768 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.208+0000 7f66b1e23640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66ac1056f0 0x7f66ac19b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:03.769 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.208+0000 7f66b1e23640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac19bb30 con 0x7f66ac1056f0 2024-09-13T17:04:03.769 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.208+0000 7f66ab7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66ac1056f0 0x7f66ac19b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:03.769 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.208+0000 7f66ab7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66ac1056f0 0x7f66ac19b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51154/0 (socket says 172.21.15.87:51154) 2024-09-13T17:04:03.769 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.208+0000 7f66ab7fe640 1 -- 172.21.15.87:0/1109588913 learned_addr learned my addr 172.21.15.87:0/1109588913 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:03.769 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.209+0000 7f66ab7fe640 1 -- 172.21.15.87:0/1109588913 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669c0094d0 con 0x7f66ac1056f0 2024-09-13T17:04:03.769 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.209+0000 7f66ab7fe640 1 --2- 172.21.15.87:0/1109588913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66ac1056f0 0x7f66ac19b5f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f669c006f10 tx=0x7f669c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:03.769 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.209+0000 7f66a97fa640 1 -- 172.21.15.87:0/1109588913 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f669c032d80 con 0x7f66ac1056f0 2024-09-13T17:04:03.769 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.209+0000 7f66a97fa640 1 -- 172.21.15.87:0/1109588913 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f669c03b8c0 con 0x7f66ac1056f0 2024-09-13T17:04:03.769 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.209+0000 7f66b1e23640 1 -- 172.21.15.87:0/1109588913 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66ac19bd30 con 0x7f66ac1056f0 2024-09-13T17:04:03.769 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.209+0000 7f66a97fa640 1 -- 172.21.15.87:0/1109588913 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f669c03a5a0 con 0x7f66ac1056f0 2024-09-13T17:04:03.769 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.209+0000 7f66b1e23640 1 -- 172.21.15.87:0/1109588913 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66ac19c1d0 con 0x7f66ac1056f0 2024-09-13T17:04:03.769 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.209+0000 7f66a97fa640 1 -- 172.21.15.87:0/1109588913 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f669c039040 con 0x7f66ac1056f0 2024-09-13T17:04:03.769 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.209+0000 7f66a97fa640 1 -- 172.21.15.87:0/1109588913 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f669c042360 con 0x7f66ac1056f0 2024-09-13T17:04:03.770 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.210+0000 7f66b1e23640 1 -- 172.21.15.87:0/1109588913 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66ac109ad0 con 0x7f66ac1056f0 2024-09-13T17:04:03.770 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.212+0000 7f66a97fa640 1 -- 172.21.15.87:0/1109588913 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f669c049060 con 0x7f66ac1056f0 2024-09-13T17:04:03.770 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.268+0000 7f66b1e23640 1 -- 172.21.15.87:0/1109588913 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f66ac109c90 con 0x7f66ac1056f0 2024-09-13T17:04:03.770 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.270+0000 7f66a97fa640 1 -- 172.21.15.87:0/1109588913 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f669c03f070 con 0x7f66ac1056f0 2024-09-13T17:04:03.770 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.271+0000 7f66b1e23640 1 -- 172.21.15.87:0/1109588913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66ac1056f0 msgr2=0x7f66ac19b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:03.770 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.271+0000 7f66b1e23640 1 --2- 172.21.15.87:0/1109588913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66ac1056f0 0x7f66ac19b5f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f669c006f10 tx=0x7f669c032670 comp rx=0 tx=0).stop 2024-09-13T17:04:03.770 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.271+0000 7f66b1e23640 1 -- 172.21.15.87:0/1109588913 shutdown_connections 2024-09-13T17:04:03.770 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.271+0000 7f66b1e23640 1 --2- 172.21.15.87:0/1109588913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66ac1056f0 0x7f66ac19b5f0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:03.770 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.271+0000 7f66b1e23640 1 -- 172.21.15.87:0/1109588913 >> 172.21.15.87:0/1109588913 conn(0x7f66ac100f40 msgr2=0x7f66ac101a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:03.770 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.271+0000 7f66b1e23640 1 -- 172.21.15.87:0/1109588913 shutdown_connections 2024-09-13T17:04:03.770 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:03.271+0000 7f66b1e23640 1 -- 172.21.15.87:0/1109588913 wait complete. 2024-09-13T17:04:03.770 INFO:teuthology.orchestra.run.smithi087.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-13T17:04:03.785 INFO:teuthology.orchestra.run.smithi087.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-13T17:04:03.785 INFO:teuthology.orchestra.run.smithi087.stdout:Creating mgr... 2024-09-13T17:04:03.785 INFO:teuthology.orchestra.run.smithi087.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-13T17:04:03.786 INFO:teuthology.orchestra.run.smithi087.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-13T17:04:04.030 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mgr.x 2024-09-13T17:04:04.030 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stderr Failed to reset failed state of unit ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-13T17:04:04.174 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-043d5bae-71f2-11ef-bceb-c7b262605968.target.wants/ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-043d5bae-71f2-11ef-bceb-c7b262605968@.service. 2024-09-13T17:04:04.387 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:04 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1109588913' entity='client.admin' 2024-09-13T17:04:04.674 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:04 smithi087 podman[31143]: 2024-09-13 17:04:04.575135566 +0000 UTC m=+0.278499938 container start 0002ab02071596fa8d36f83e50cce0868983ca1cbeca35595a4b5635cedc7611 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-13T17:04:04.674 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:04 smithi087 bash[31143]: 0002ab02071596fa8d36f83e50cce0868983ca1cbeca35595a4b5635cedc7611 2024-09-13T17:04:04.687 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T17:04:04.687 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout disabled 2024-09-13T17:04:04.695 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T17:04:04.695 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout inactive 2024-09-13T17:04:04.695 INFO:teuthology.orchestra.run.smithi087.stdout:firewalld.service is not enabled 2024-09-13T17:04:04.695 INFO:teuthology.orchestra.run.smithi087.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T17:04:04.703 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T17:04:04.703 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout disabled 2024-09-13T17:04:04.710 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T17:04:04.710 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout inactive 2024-09-13T17:04:04.710 INFO:teuthology.orchestra.run.smithi087.stdout:firewalld.service is not enabled 2024-09-13T17:04:04.711 INFO:teuthology.orchestra.run.smithi087.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-13T17:04:04.711 INFO:teuthology.orchestra.run.smithi087.stdout:Waiting for mgr to start... 2024-09-13T17:04:04.711 INFO:teuthology.orchestra.run.smithi087.stdout:Waiting for mgr... 2024-09-13T17:04:04.945 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:04 smithi087 systemd[1]: Started Ceph mgr.x for 043d5bae-71f2-11ef-bceb-c7b262605968. 2024-09-13T17:04:04.945 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:04 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:04.693+0000 7fabcbcf8040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T17:04:04.945 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:04 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:04.754+0000 7fabcbcf8040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T17:04:04.945 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:04 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:04.903+0000 7fabcbcf8040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T17:04:05.206 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:04 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:04.974+0000 7fabcbcf8040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T17:04:05.207 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:05 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:05.121+0000 7fabcbcf8040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:04:05.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:05 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1981086359' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T17:04:05.479 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:05 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:05.269+0000 7fabcbcf8040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T17:04:05.754 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:05 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:05.584+0000 7fabcbcf8040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T17:04:05.754 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:05 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:05.645+0000 7fabcbcf8040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T17:04:05.768 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-09-13T17:04:05.768 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout { 2024-09-13T17:04:05.768 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "fsid": "043d5bae-71f2-11ef-bceb-c7b262605968", 2024-09-13T17:04:05.768 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T17:04:05.768 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T17:04:05.768 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T17:04:05.769 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T17:04:05.769 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:04:05.769 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T17:04:05.769 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T17:04:05.769 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 0 2024-09-13T17:04:05.769 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout ], 2024-09-13T17:04:05.769 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T17:04:05.769 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "a" 2024-09-13T17:04:05.769 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout ], 2024-09-13T17:04:05.769 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-13T17:04:05.770 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T17:04:05.770 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T17:04:05.770 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T17:04:05.770 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T17:04:05.770 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:04:05.770 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T17:04:05.770 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T17:04:05.770 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T17:04:05.770 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T17:04:05.770 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T17:04:05.770 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T17:04:05.770 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T17:04:05.771 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T17:04:05.771 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:04:05.771 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T17:04:05.771 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T17:04:05.771 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T17:04:05.771 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T17:04:05.772 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T17:04:05.772 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T17:04:05.772 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T17:04:05.773 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T17:04:05.773 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T17:04:05.773 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:04:05.773 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T17:04:05.773 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T17:04:05.773 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T17:04:05.773 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T17:04:05.773 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:04:05.773 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T17:04:05.773 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-13T17:04:05.773 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T17:04:05.773 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T17:04:05.773 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T17:04:05.774 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T17:04:05.774 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T17:04:05.774 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout ], 2024-09-13T17:04:05.774 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T17:04:05.774 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:04:05.774 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T17:04:05.774 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T17:04:05.774 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T17:03:57.852574+0000", 2024-09-13T17:04:05.774 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T17:04:05.774 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:04:05.774 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T17:04:05.774 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout } 2024-09-13T17:04:05.774 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.135+0000 7f49dffc3640 1 Processor -- start 2024-09-13T17:04:05.774 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.136+0000 7f49dffc3640 1 -- start start 2024-09-13T17:04:05.775 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.136+0000 7f49dffc3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49d81045d0 0x7f49d81049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:05.775 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.136+0000 7f49dffc3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d8104fa0 con 0x7f49d81045d0 2024-09-13T17:04:05.775 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.136+0000 7f49ddd5f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49d81045d0 0x7f49d81049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:05.775 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.136+0000 7f49ddd5f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49d81045d0 0x7f49d81049d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51178/0 (socket says 172.21.15.87:51178) 2024-09-13T17:04:05.775 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.136+0000 7f49ddd5f640 1 -- 172.21.15.87:0/2169481223 learned_addr learned my addr 172.21.15.87:0/2169481223 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:05.775 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.137+0000 7f49ddd5f640 1 -- 172.21.15.87:0/2169481223 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d8105780 con 0x7f49d81045d0 2024-09-13T17:04:05.775 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.137+0000 7f49ddd5f640 1 --2- 172.21.15.87:0/2169481223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49d81045d0 0x7f49d81049d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f49d4009820 tx=0x7f49d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=615bd2402123329c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:05.775 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.137+0000 7f49dcd5d640 1 -- 172.21.15.87:0/2169481223 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49d402ae70 con 0x7f49d81045d0 2024-09-13T17:04:05.775 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.138+0000 7f49dcd5d640 1 -- 172.21.15.87:0/2169481223 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f49d40328d0 con 0x7f49d81045d0 2024-09-13T17:04:05.775 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.138+0000 7f49dcd5d640 1 -- 172.21.15.87:0/2169481223 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49d40308a0 con 0x7f49d81045d0 2024-09-13T17:04:05.775 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.138+0000 7f49dffc3640 1 -- 172.21.15.87:0/2169481223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49d81045d0 msgr2=0x7f49d81049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:05.775 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.138+0000 7f49dffc3640 1 --2- 172.21.15.87:0/2169481223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49d81045d0 0x7f49d81049d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f49d4009820 tx=0x7f49d402a270 comp rx=0 tx=0).stop 2024-09-13T17:04:05.776 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.139+0000 7f49dffc3640 1 -- 172.21.15.87:0/2169481223 shutdown_connections 2024-09-13T17:04:05.776 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.139+0000 7f49dffc3640 1 --2- 172.21.15.87:0/2169481223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49d81045d0 0x7f49d81049d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:05.776 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.139+0000 7f49dffc3640 1 -- 172.21.15.87:0/2169481223 >> 172.21.15.87:0/2169481223 conn(0x7f49d80ffda0 msgr2=0x7f49d81021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:05.776 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.139+0000 7f49dffc3640 1 -- 172.21.15.87:0/2169481223 shutdown_connections 2024-09-13T17:04:05.776 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.139+0000 7f49dffc3640 1 -- 172.21.15.87:0/2169481223 wait complete. 2024-09-13T17:04:05.776 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.139+0000 7f49dffc3640 1 Processor -- start 2024-09-13T17:04:05.776 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.139+0000 7f49dffc3640 1 -- start start 2024-09-13T17:04:05.776 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.139+0000 7f49dffc3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49d81045d0 0x7f49d8079980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:05.776 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.139+0000 7f49dffc3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d8079ec0 con 0x7f49d81045d0 2024-09-13T17:04:05.777 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.140+0000 7f49ddd5f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49d81045d0 0x7f49d8079980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:05.777 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.140+0000 7f49ddd5f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49d81045d0 0x7f49d8079980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51182/0 (socket says 172.21.15.87:51182) 2024-09-13T17:04:05.777 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.140+0000 7f49ddd5f640 1 -- 172.21.15.87:0/1981086359 learned_addr learned my addr 172.21.15.87:0/1981086359 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:05.777 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.140+0000 7f49ddd5f640 1 -- 172.21.15.87:0/1981086359 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d40094d0 con 0x7f49d81045d0 2024-09-13T17:04:05.777 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.140+0000 7f49ddd5f640 1 --2- 172.21.15.87:0/1981086359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49d81045d0 0x7f49d8079980 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f49d402a790 tx=0x7f49d4030d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:05.777 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.140+0000 7f49ceffd640 1 -- 172.21.15.87:0/1981086359 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49d4032d80 con 0x7f49d81045d0 2024-09-13T17:04:05.777 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.140+0000 7f49ceffd640 1 -- 172.21.15.87:0/1981086359 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f49d403b8c0 con 0x7f49d81045d0 2024-09-13T17:04:05.777 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.140+0000 7f49ceffd640 1 -- 172.21.15.87:0/1981086359 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49d403a500 con 0x7f49d81045d0 2024-09-13T17:04:05.777 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.140+0000 7f49dffc3640 1 -- 172.21.15.87:0/1981086359 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49d819c1b0 con 0x7f49d81045d0 2024-09-13T17:04:05.778 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.140+0000 7f49dffc3640 1 -- 172.21.15.87:0/1981086359 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d819c650 con 0x7f49d81045d0 2024-09-13T17:04:05.778 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.140+0000 7f49ceffd640 1 -- 172.21.15.87:0/1981086359 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f49d4039040 con 0x7f49d81045d0 2024-09-13T17:04:05.778 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.141+0000 7f49ceffd640 1 -- 172.21.15.87:0/1981086359 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f49d404c350 con 0x7f49d81045d0 2024-09-13T17:04:05.778 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.141+0000 7f49dffc3640 1 -- 172.21.15.87:0/1981086359 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49d81089b0 con 0x7f49d81045d0 2024-09-13T17:04:05.778 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.143+0000 7f49ceffd640 1 -- 172.21.15.87:0/1981086359 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f49d4044e60 con 0x7f49d81045d0 2024-09-13T17:04:05.778 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.204+0000 7f49dffc3640 1 -- 172.21.15.87:0/1981086359 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f49d819c890 con 0x7f49d81045d0 2024-09-13T17:04:05.778 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.205+0000 7f49ceffd640 1 -- 172.21.15.87:0/1981086359 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f49d4049060 con 0x7f49d81045d0 2024-09-13T17:04:05.778 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.206+0000 7f49dffc3640 1 -- 172.21.15.87:0/1981086359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49d81045d0 msgr2=0x7f49d8079980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:05.778 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.206+0000 7f49dffc3640 1 --2- 172.21.15.87:0/1981086359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49d81045d0 0x7f49d8079980 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f49d402a790 tx=0x7f49d4030d90 comp rx=0 tx=0).stop 2024-09-13T17:04:05.778 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.206+0000 7f49dffc3640 1 -- 172.21.15.87:0/1981086359 shutdown_connections 2024-09-13T17:04:05.778 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.206+0000 7f49dffc3640 1 --2- 172.21.15.87:0/1981086359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49d81045d0 0x7f49d8079980 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:05.778 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.206+0000 7f49dffc3640 1 -- 172.21.15.87:0/1981086359 >> 172.21.15.87:0/1981086359 conn(0x7f49d80ffda0 msgr2=0x7f49d81009c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:05.778 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.206+0000 7f49dffc3640 1 -- 172.21.15.87:0/1981086359 shutdown_connections 2024-09-13T17:04:05.778 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:05.206+0000 7f49dffc3640 1 -- 172.21.15.87:0/1981086359 wait complete. 2024-09-13T17:04:05.778 INFO:teuthology.orchestra.run.smithi087.stdout:mgr not available, waiting (1/15)... 2024-09-13T17:04:06.228 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:05 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:05.832+0000 7fabcbcf8040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T17:04:06.978 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:06 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:06.694+0000 7fabcbcf8040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T17:04:06.979 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:06 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:06.763+0000 7fabcbcf8040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T17:04:07.724 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:07 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:07.471+0000 7fabcbcf8040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T17:04:07.724 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:07 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:07.584+0000 7fabcbcf8040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T17:04:07.725 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:07 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:07.722+0000 7fabcbcf8040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:04:07.978 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:07 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:07.785+0000 7fabcbcf8040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T17:04:07.979 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:07 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:07.935+0000 7fabcbcf8040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T17:04:08.285 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:08 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:08.005+0000 7fabcbcf8040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T17:04:08.285 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:08 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:08.065+0000 7fabcbcf8040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T17:04:08.285 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:08 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:08.227+0000 7fabcbcf8040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T17:04:08.569 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:08 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/966007446' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T17:04:08.569 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:08 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:08.298+0000 7fabcbcf8040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T17:04:08.569 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:08 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:08.364+0000 7fabcbcf8040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T17:04:08.569 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:08 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:08.446+0000 7fabcbcf8040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T17:04:08.569 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:08 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:08.508+0000 7fabcbcf8040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T17:04:08.569 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:08 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:08.566+0000 7fabcbcf8040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T17:04:08.824 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-09-13T17:04:08.824 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout { 2024-09-13T17:04:08.824 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "fsid": "043d5bae-71f2-11ef-bceb-c7b262605968", 2024-09-13T17:04:08.824 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T17:04:08.824 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T17:04:08.824 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T17:04:08.824 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T17:04:08.824 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:04:08.824 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T17:04:08.825 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T17:04:08.825 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 0 2024-09-13T17:04:08.825 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout ], 2024-09-13T17:04:08.825 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T17:04:08.825 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "a" 2024-09-13T17:04:08.825 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout ], 2024-09-13T17:04:08.825 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-13T17:04:08.825 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T17:04:08.825 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T17:04:08.825 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T17:04:08.825 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T17:04:08.825 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:04:08.826 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T17:04:08.826 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T17:04:08.826 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T17:04:08.826 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T17:04:08.826 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T17:04:08.826 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T17:04:08.826 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T17:04:08.826 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T17:04:08.826 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:04:08.826 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T17:04:08.826 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T17:04:08.826 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T17:04:08.826 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T17:04:08.827 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T17:04:08.827 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T17:04:08.827 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T17:04:08.827 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T17:04:08.827 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T17:04:08.827 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:04:08.827 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T17:04:08.827 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T17:04:08.827 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T17:04:08.827 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T17:04:08.827 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:04:08.827 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T17:04:08.827 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-13T17:04:08.828 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T17:04:08.828 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T17:04:08.828 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T17:04:08.828 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T17:04:08.828 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T17:04:08.828 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout ], 2024-09-13T17:04:08.828 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T17:04:08.828 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:04:08.828 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T17:04:08.828 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T17:04:08.828 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T17:03:57.852574+0000", 2024-09-13T17:04:08.828 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T17:04:08.828 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:04:08.829 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T17:04:08.829 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout } 2024-09-13T17:04:08.829 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.165+0000 7f96a713b640 1 Processor -- start 2024-09-13T17:04:08.829 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.165+0000 7f96a713b640 1 -- start start 2024-09-13T17:04:08.829 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.165+0000 7f96a713b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a0103950 0x7f96a0103d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:08.829 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.165+0000 7f96a713b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a0104320 con 0x7f96a0103950 2024-09-13T17:04:08.829 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.165+0000 7f96a4ed7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a0103950 0x7f96a0103d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:08.829 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.166+0000 7f96a4ed7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a0103950 0x7f96a0103d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51186/0 (socket says 172.21.15.87:51186) 2024-09-13T17:04:08.829 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.166+0000 7f96a4ed7640 1 -- 172.21.15.87:0/1382850617 learned_addr learned my addr 172.21.15.87:0/1382850617 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:08.829 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.166+0000 7f96a4ed7640 1 -- 172.21.15.87:0/1382850617 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a0104460 con 0x7f96a0103950 2024-09-13T17:04:08.829 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.166+0000 7f96a4ed7640 1 --2- 172.21.15.87:0/1382850617 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a0103950 0x7f96a0103d50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9694009820 tx=0x7f969402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ce62edec486192b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:08.829 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.167+0000 7f969f7fe640 1 -- 172.21.15.87:0/1382850617 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f969402ae70 con 0x7f96a0103950 2024-09-13T17:04:08.830 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.167+0000 7f969f7fe640 1 -- 172.21.15.87:0/1382850617 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f96940328d0 con 0x7f96a0103950 2024-09-13T17:04:08.830 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.167+0000 7f969f7fe640 1 -- 172.21.15.87:0/1382850617 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f96940308a0 con 0x7f96a0103950 2024-09-13T17:04:08.830 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.167+0000 7f96a713b640 1 -- 172.21.15.87:0/1382850617 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a0103950 msgr2=0x7f96a0103d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:08.830 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.167+0000 7f96a713b640 1 --2- 172.21.15.87:0/1382850617 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a0103950 0x7f96a0103d50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9694009820 tx=0x7f969402a270 comp rx=0 tx=0).stop 2024-09-13T17:04:08.830 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.167+0000 7f96a713b640 1 -- 172.21.15.87:0/1382850617 shutdown_connections 2024-09-13T17:04:08.830 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.167+0000 7f96a713b640 1 --2- 172.21.15.87:0/1382850617 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a0103950 0x7f96a0103d50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:08.830 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.167+0000 7f96a713b640 1 -- 172.21.15.87:0/1382850617 >> 172.21.15.87:0/1382850617 conn(0x7f96a00ff4c0 msgr2=0x7f96a01018e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:08.830 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.167+0000 7f96a713b640 1 -- 172.21.15.87:0/1382850617 shutdown_connections 2024-09-13T17:04:08.830 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.167+0000 7f96a713b640 1 -- 172.21.15.87:0/1382850617 wait complete. 2024-09-13T17:04:08.830 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.168+0000 7f96a713b640 1 Processor -- start 2024-09-13T17:04:08.830 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.168+0000 7f96a713b640 1 -- start start 2024-09-13T17:04:08.830 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.168+0000 7f96a713b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a0103950 0x7f96a0199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:08.831 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.168+0000 7f96a713b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a0199970 con 0x7f96a0103950 2024-09-13T17:04:08.831 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.168+0000 7f96a4ed7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a0103950 0x7f96a0199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:08.831 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.168+0000 7f96a4ed7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a0103950 0x7f96a0199430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51194/0 (socket says 172.21.15.87:51194) 2024-09-13T17:04:08.831 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.168+0000 7f96a4ed7640 1 -- 172.21.15.87:0/966007446 learned_addr learned my addr 172.21.15.87:0/966007446 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:08.831 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.168+0000 7f96a4ed7640 1 -- 172.21.15.87:0/966007446 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96940094d0 con 0x7f96a0103950 2024-09-13T17:04:08.831 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.168+0000 7f96a4ed7640 1 --2- 172.21.15.87:0/966007446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a0103950 0x7f96a0199430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f96940305b0 tx=0x7f9694032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:08.831 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.169+0000 7f969dffb640 1 -- 172.21.15.87:0/966007446 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9694032c50 con 0x7f96a0103950 2024-09-13T17:04:08.831 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.169+0000 7f969dffb640 1 -- 172.21.15.87:0/966007446 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9694032db0 con 0x7f96a0103950 2024-09-13T17:04:08.831 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.169+0000 7f96a713b640 1 -- 172.21.15.87:0/966007446 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a0199b70 con 0x7f96a0103950 2024-09-13T17:04:08.831 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.169+0000 7f969dffb640 1 -- 172.21.15.87:0/966007446 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f969403a6c0 con 0x7f96a0103950 2024-09-13T17:04:08.831 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.169+0000 7f96a713b640 1 -- 172.21.15.87:0/966007446 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a019a010 con 0x7f96a0103950 2024-09-13T17:04:08.831 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.169+0000 7f969dffb640 1 -- 172.21.15.87:0/966007446 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f9694039040 con 0x7f96a0103950 2024-09-13T17:04:08.831 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.169+0000 7f969dffb640 1 -- 172.21.15.87:0/966007446 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9694042360 con 0x7f96a0103950 2024-09-13T17:04:08.832 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.170+0000 7f96a713b640 1 -- 172.21.15.87:0/966007446 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a0103dd0 con 0x7f96a0103950 2024-09-13T17:04:08.832 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.172+0000 7f969dffb640 1 -- 172.21.15.87:0/966007446 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f9694049060 con 0x7f96a0103950 2024-09-13T17:04:08.832 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.232+0000 7f96a713b640 1 -- 172.21.15.87:0/966007446 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f96a0109b30 con 0x7f96a0103950 2024-09-13T17:04:08.832 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.232+0000 7f969dffb640 1 -- 172.21.15.87:0/966007446 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f969403f070 con 0x7f96a0103950 2024-09-13T17:04:08.832 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.233+0000 7f96a713b640 1 -- 172.21.15.87:0/966007446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a0103950 msgr2=0x7f96a0199430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:08.832 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.233+0000 7f96a713b640 1 --2- 172.21.15.87:0/966007446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a0103950 0x7f96a0199430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f96940305b0 tx=0x7f9694032670 comp rx=0 tx=0).stop 2024-09-13T17:04:08.832 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.233+0000 7f96a713b640 1 -- 172.21.15.87:0/966007446 shutdown_connections 2024-09-13T17:04:08.832 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.233+0000 7f96a713b640 1 --2- 172.21.15.87:0/966007446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a0103950 0x7f96a0199430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:08.832 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.233+0000 7f96a713b640 1 -- 172.21.15.87:0/966007446 >> 172.21.15.87:0/966007446 conn(0x7f96a00ff4c0 msgr2=0x7f96a01000e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:08.832 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.233+0000 7f96a713b640 1 -- 172.21.15.87:0/966007446 shutdown_connections 2024-09-13T17:04:08.832 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:08.233+0000 7f96a713b640 1 -- 172.21.15.87:0/966007446 wait complete. 2024-09-13T17:04:08.832 INFO:teuthology.orchestra.run.smithi087.stdout:mgr not available, waiting (2/15)... 2024-09-13T17:04:09.729 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:09 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:09.349+0000 7fabcbcf8040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T17:04:09.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:09 smithi087 ceph-mon[30934]: Activating manager daemon x 2024-09-13T17:04:09.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:09 smithi087 ceph-mon[30934]: mgrmap e2: x(active, starting, since 0.00296897s) 2024-09-13T17:04:09.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:09 smithi087 ceph-mon[30934]: from='mgr.14100 172.21.15.87:0/1373008428' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T17:04:09.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:09 smithi087 ceph-mon[30934]: from='mgr.14100 172.21.15.87:0/1373008428' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T17:04:09.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:09 smithi087 ceph-mon[30934]: from='mgr.14100 172.21.15.87:0/1373008428' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T17:04:09.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:09 smithi087 ceph-mon[30934]: from='mgr.14100 172.21.15.87:0/1373008428' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:04:09.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:09 smithi087 ceph-mon[30934]: from='mgr.14100 172.21.15.87:0/1373008428' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-13T17:04:09.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:09 smithi087 ceph-mon[30934]: Manager daemon x is now available 2024-09-13T17:04:09.730 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:09 smithi087 ceph-mon[30934]: from='mgr.14100 172.21.15.87:0/1373008428' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-13T17:04:09.730 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:09 smithi087 ceph-mon[30934]: from='mgr.14100 172.21.15.87:0/1373008428' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-13T17:04:09.730 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:09 smithi087 ceph-mon[30934]: from='mgr.14100 172.21.15.87:0/1373008428' entity='mgr.x' 2024-09-13T17:04:09.730 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:09 smithi087 ceph-mon[30934]: from='mgr.14100 172.21.15.87:0/1373008428' entity='mgr.x' 2024-09-13T17:04:09.730 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:09 smithi087 ceph-mon[30934]: from='mgr.14100 172.21.15.87:0/1373008428' entity='mgr.x' 2024-09-13T17:04:11.462 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:11 smithi087 ceph-mon[30934]: mgrmap e3: x(active, since 1.00613s) 2024-09-13T17:04:11.965 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-09-13T17:04:11.966 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout { 2024-09-13T17:04:11.966 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "fsid": "043d5bae-71f2-11ef-bceb-c7b262605968", 2024-09-13T17:04:11.966 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T17:04:11.966 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T17:04:11.966 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T17:04:11.966 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T17:04:11.966 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:04:11.966 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T17:04:11.966 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T17:04:11.966 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 0 2024-09-13T17:04:11.966 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout ], 2024-09-13T17:04:11.966 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T17:04:11.967 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "a" 2024-09-13T17:04:11.967 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout ], 2024-09-13T17:04:11.967 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-13T17:04:11.967 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T17:04:11.967 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T17:04:11.967 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T17:04:11.967 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T17:04:11.967 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:04:11.967 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T17:04:11.967 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T17:04:11.967 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T17:04:11.967 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T17:04:11.967 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T17:04:11.967 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T17:04:11.968 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T17:04:11.968 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T17:04:11.968 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:04:11.968 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T17:04:11.968 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T17:04:11.968 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T17:04:11.968 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T17:04:11.968 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T17:04:11.968 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T17:04:11.968 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T17:04:11.968 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T17:04:11.968 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T17:04:11.968 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:04:11.969 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T17:04:11.969 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T17:04:11.969 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T17:04:11.969 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T17:04:11.969 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:04:11.969 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T17:04:11.969 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T17:04:11.969 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T17:04:11.969 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T17:04:11.969 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T17:04:11.969 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T17:04:11.969 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T17:04:11.969 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout ], 2024-09-13T17:04:11.969 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T17:04:11.970 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:04:11.970 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T17:04:11.970 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T17:04:11.970 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T17:03:57.852574+0000", 2024-09-13T17:04:11.970 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T17:04:11.970 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:04:11.970 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T17:04:11.970 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout } 2024-09-13T17:04:11.970 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.208+0000 7f34816e0640 1 Processor -- start 2024-09-13T17:04:11.970 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.208+0000 7f34816e0640 1 -- start start 2024-09-13T17:04:11.970 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.208+0000 7f34816e0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f347c106150 0x7f347c108540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:11.970 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.208+0000 7f34816e0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347c079d80 con 0x7f347c106150 2024-09-13T17:04:11.970 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.208+0000 7f347affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f347c106150 0x7f347c108540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:11.970 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.208+0000 7f347affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f347c106150 0x7f347c108540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35190/0 (socket says 172.21.15.87:35190) 2024-09-13T17:04:11.971 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.208+0000 7f347affd640 1 -- 172.21.15.87:0/2316216325 learned_addr learned my addr 172.21.15.87:0/2316216325 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:11.971 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.209+0000 7f347affd640 1 -- 172.21.15.87:0/2316216325 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f347c108a80 con 0x7f347c106150 2024-09-13T17:04:11.971 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.209+0000 7f347affd640 1 --2- 172.21.15.87:0/2316216325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f347c106150 0x7f347c108540 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f346c009820 tx=0x7f346c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4ce93daf9639b8d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:11.971 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.209+0000 7f3479ffb640 1 -- 172.21.15.87:0/2316216325 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f346c02ae70 con 0x7f347c106150 2024-09-13T17:04:11.971 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.209+0000 7f3479ffb640 1 -- 172.21.15.87:0/2316216325 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f346c0328d0 con 0x7f347c106150 2024-09-13T17:04:11.971 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.209+0000 7f3479ffb640 1 -- 172.21.15.87:0/2316216325 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f346c0308a0 con 0x7f347c106150 2024-09-13T17:04:11.971 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.210+0000 7f34816e0640 1 -- 172.21.15.87:0/2316216325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f347c106150 msgr2=0x7f347c108540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:11.971 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.210+0000 7f34816e0640 1 --2- 172.21.15.87:0/2316216325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f347c106150 0x7f347c108540 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f346c009820 tx=0x7f346c02a270 comp rx=0 tx=0).stop 2024-09-13T17:04:11.971 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.210+0000 7f34816e0640 1 -- 172.21.15.87:0/2316216325 shutdown_connections 2024-09-13T17:04:11.971 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.210+0000 7f34816e0640 1 --2- 172.21.15.87:0/2316216325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f347c106150 0x7f347c108540 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:11.971 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.210+0000 7f34816e0640 1 -- 172.21.15.87:0/2316216325 >> 172.21.15.87:0/2316216325 conn(0x7f347c0ffd70 msgr2=0x7f347c102190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:11.971 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.210+0000 7f34816e0640 1 -- 172.21.15.87:0/2316216325 shutdown_connections 2024-09-13T17:04:11.971 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.210+0000 7f34816e0640 1 -- 172.21.15.87:0/2316216325 wait complete. 2024-09-13T17:04:11.971 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.211+0000 7f34816e0640 1 Processor -- start 2024-09-13T17:04:11.972 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.211+0000 7f34816e0640 1 -- start start 2024-09-13T17:04:11.972 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.211+0000 7f34816e0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f347c106150 0x7f347c1993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:11.972 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.211+0000 7f34816e0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347c199900 con 0x7f347c106150 2024-09-13T17:04:11.972 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.211+0000 7f347affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f347c106150 0x7f347c1993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:11.972 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.211+0000 7f347affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f347c106150 0x7f347c1993c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35206/0 (socket says 172.21.15.87:35206) 2024-09-13T17:04:11.972 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.211+0000 7f347affd640 1 -- 172.21.15.87:0/4228325676 learned_addr learned my addr 172.21.15.87:0/4228325676 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:11.972 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.211+0000 7f347affd640 1 -- 172.21.15.87:0/4228325676 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346c0094d0 con 0x7f347c106150 2024-09-13T17:04:11.972 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.212+0000 7f347affd640 1 --2- 172.21.15.87:0/4228325676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f347c106150 0x7f347c1993c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f346c006f10 tx=0x7f346c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:11.972 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.212+0000 7f3463fff640 1 -- 172.21.15.87:0/4228325676 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f346c032d80 con 0x7f347c106150 2024-09-13T17:04:11.972 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.212+0000 7f34816e0640 1 -- 172.21.15.87:0/4228325676 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f347c199b00 con 0x7f347c106150 2024-09-13T17:04:11.972 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.212+0000 7f3463fff640 1 -- 172.21.15.87:0/4228325676 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f346c03b8c0 con 0x7f347c106150 2024-09-13T17:04:11.972 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.212+0000 7f3463fff640 1 -- 172.21.15.87:0/4228325676 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f346c03a5c0 con 0x7f347c106150 2024-09-13T17:04:11.972 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.212+0000 7f34816e0640 1 -- 172.21.15.87:0/4228325676 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f347c199fa0 con 0x7f347c106150 2024-09-13T17:04:11.973 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.213+0000 7f3463fff640 1 -- 172.21.15.87:0/4228325676 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 3) v1 ==== 45424+0+0 (secure 0 0 0) 0x7f346c039040 con 0x7f347c106150 2024-09-13T17:04:11.973 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.213+0000 7f3463fff640 1 --2- 172.21.15.87:0/4228325676 >> [v2:172.21.15.87:6800/1587363880,v1:172.21.15.87:6801/1587363880] conn(0x7f34640384b0 0x7f346403a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:11.973 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.213+0000 7f34816e0640 1 -- 172.21.15.87:0/4228325676 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f347c109840 con 0x7f347c106150 2024-09-13T17:04:11.973 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.213+0000 7f3463fff640 1 -- 172.21.15.87:0/4228325676 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f346c06b790 con 0x7f347c106150 2024-09-13T17:04:11.973 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.213+0000 7f347a7fc640 1 --2- 172.21.15.87:0/4228325676 >> [v2:172.21.15.87:6800/1587363880,v1:172.21.15.87:6801/1587363880] conn(0x7f34640384b0 0x7f346403a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:11.973 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.214+0000 7f347a7fc640 1 --2- 172.21.15.87:0/4228325676 >> [v2:172.21.15.87:6800/1587363880,v1:172.21.15.87:6801/1587363880] conn(0x7f34640384b0 0x7f346403a970 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f34700098c0 tx=0x7f3470006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:11.973 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.218+0000 7f3463fff640 1 -- 172.21.15.87:0/4228325676 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f346c03f020 con 0x7f347c106150 2024-09-13T17:04:11.973 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.358+0000 7f3463fff640 1 -- 172.21.15.87:0/4228325676 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mgrmap(e 4) v1 ==== 45530+0+0 (secure 0 0 0) 0x7f346c03a810 con 0x7f347c106150 2024-09-13T17:04:11.973 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.449+0000 7f34816e0640 1 -- 172.21.15.87:0/4228325676 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f347c19c8e0 con 0x7f347c106150 2024-09-13T17:04:11.973 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.449+0000 7f3463fff640 1 -- 172.21.15.87:0/4228325676 <== mon.0 v2:172.21.15.87:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1237 (secure 0 0 0) 0x7f346c037030 con 0x7f347c106150 2024-09-13T17:04:11.974 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.451+0000 7f34816e0640 1 -- 172.21.15.87:0/4228325676 >> [v2:172.21.15.87:6800/1587363880,v1:172.21.15.87:6801/1587363880] conn(0x7f34640384b0 msgr2=0x7f346403a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:11.974 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.451+0000 7f34816e0640 1 --2- 172.21.15.87:0/4228325676 >> [v2:172.21.15.87:6800/1587363880,v1:172.21.15.87:6801/1587363880] conn(0x7f34640384b0 0x7f346403a970 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f34700098c0 tx=0x7f3470006db0 comp rx=0 tx=0).stop 2024-09-13T17:04:11.974 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.451+0000 7f34816e0640 1 -- 172.21.15.87:0/4228325676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f347c106150 msgr2=0x7f347c1993c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:11.974 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.451+0000 7f34816e0640 1 --2- 172.21.15.87:0/4228325676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f347c106150 0x7f347c1993c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f346c006f10 tx=0x7f346c032670 comp rx=0 tx=0).stop 2024-09-13T17:04:11.974 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.451+0000 7f34816e0640 1 -- 172.21.15.87:0/4228325676 shutdown_connections 2024-09-13T17:04:11.974 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.451+0000 7f34816e0640 1 --2- 172.21.15.87:0/4228325676 >> [v2:172.21.15.87:6800/1587363880,v1:172.21.15.87:6801/1587363880] conn(0x7f34640384b0 0x7f346403a970 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:11.974 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.451+0000 7f34816e0640 1 --2- 172.21.15.87:0/4228325676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f347c106150 0x7f347c1993c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:11.974 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.451+0000 7f34816e0640 1 -- 172.21.15.87:0/4228325676 >> 172.21.15.87:0/4228325676 conn(0x7f347c0ffd70 msgr2=0x7f347c1009e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:11.974 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.451+0000 7f34816e0640 1 -- 172.21.15.87:0/4228325676 shutdown_connections 2024-09-13T17:04:11.974 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:11.451+0000 7f34816e0640 1 -- 172.21.15.87:0/4228325676 wait complete. 2024-09-13T17:04:11.974 INFO:teuthology.orchestra.run.smithi087.stdout:mgr is available 2024-09-13T17:04:12.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:12 smithi087 ceph-mon[30934]: mgrmap e4: x(active, since 2s) 2024-09-13T17:04:12.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:12 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/4228325676' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T17:04:13.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:13 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2520425833' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-13T17:04:16.135 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-09-13T17:04:16.135 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T17:04:16.135 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout fsid = 043d5bae-71f2-11ef-bceb-c7b262605968 2024-09-13T17:04:16.136 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T17:04:16.136 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T17:04:16.136 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T17:04:16.136 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T17:04:16.136 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-09-13T17:04:16.136 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T17:04:16.136 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T17:04:16.136 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-09-13T17:04:16.137 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T17:04:16.137 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-13T17:04:16.137 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-13T17:04:16.137 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-13T17:04:16.137 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T17:04:16.137 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T17:04:16.137 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.335+0000 7fdf538c2640 1 Processor -- start 2024-09-13T17:04:16.137 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.335+0000 7fdf538c2640 1 -- start start 2024-09-13T17:04:16.137 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.335+0000 7fdf538c2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf4c1056f0 0x7fdf4c105af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:16.137 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.335+0000 7fdf538c2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4c1060c0 con 0x7fdf4c1056f0 2024-09-13T17:04:16.137 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.335+0000 7fdf5165e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf4c1056f0 0x7fdf4c105af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:16.138 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.336+0000 7fdf5165e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf4c1056f0 0x7fdf4c105af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35218/0 (socket says 172.21.15.87:35218) 2024-09-13T17:04:16.138 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.336+0000 7fdf5165e640 1 -- 172.21.15.87:0/3724279019 learned_addr learned my addr 172.21.15.87:0/3724279019 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:16.138 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.336+0000 7fdf5165e640 1 -- 172.21.15.87:0/3724279019 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf4c1068a0 con 0x7fdf4c1056f0 2024-09-13T17:04:16.138 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.337+0000 7fdf5165e640 1 --2- 172.21.15.87:0/3724279019 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf4c1056f0 0x7fdf4c105af0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdf48009820 tx=0x7fdf4802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b876dd9325c1518b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:16.138 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.337+0000 7fdf43fff640 1 -- 172.21.15.87:0/3724279019 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf4802ae70 con 0x7fdf4c1056f0 2024-09-13T17:04:16.138 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.337+0000 7fdf43fff640 1 -- 172.21.15.87:0/3724279019 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdf480328d0 con 0x7fdf4c1056f0 2024-09-13T17:04:16.138 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.337+0000 7fdf43fff640 1 -- 172.21.15.87:0/3724279019 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf480308a0 con 0x7fdf4c1056f0 2024-09-13T17:04:16.138 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.337+0000 7fdf538c2640 1 -- 172.21.15.87:0/3724279019 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf4c1056f0 msgr2=0x7fdf4c105af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:16.138 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.337+0000 7fdf538c2640 1 --2- 172.21.15.87:0/3724279019 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf4c1056f0 0x7fdf4c105af0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdf48009820 tx=0x7fdf4802a270 comp rx=0 tx=0).stop 2024-09-13T17:04:16.138 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.337+0000 7fdf538c2640 1 -- 172.21.15.87:0/3724279019 shutdown_connections 2024-09-13T17:04:16.138 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.337+0000 7fdf538c2640 1 --2- 172.21.15.87:0/3724279019 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf4c1056f0 0x7fdf4c105af0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:16.138 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.337+0000 7fdf538c2640 1 -- 172.21.15.87:0/3724279019 >> 172.21.15.87:0/3724279019 conn(0x7fdf4c100f40 msgr2=0x7fdf4c103360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:16.139 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.338+0000 7fdf538c2640 1 -- 172.21.15.87:0/3724279019 shutdown_connections 2024-09-13T17:04:16.139 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.338+0000 7fdf538c2640 1 -- 172.21.15.87:0/3724279019 wait complete. 2024-09-13T17:04:16.139 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.338+0000 7fdf538c2640 1 Processor -- start 2024-09-13T17:04:16.139 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.338+0000 7fdf538c2640 1 -- start start 2024-09-13T17:04:16.139 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.338+0000 7fdf538c2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf4c1056f0 0x7fdf4c1993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:16.139 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.338+0000 7fdf538c2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4c199930 con 0x7fdf4c1056f0 2024-09-13T17:04:16.139 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.338+0000 7fdf5165e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf4c1056f0 0x7fdf4c1993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:16.140 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.339+0000 7fdf5165e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf4c1056f0 0x7fdf4c1993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35230/0 (socket says 172.21.15.87:35230) 2024-09-13T17:04:16.140 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.339+0000 7fdf5165e640 1 -- 172.21.15.87:0/2520425833 learned_addr learned my addr 172.21.15.87:0/2520425833 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:16.140 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.339+0000 7fdf5165e640 1 -- 172.21.15.87:0/2520425833 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf480094d0 con 0x7fdf4c1056f0 2024-09-13T17:04:16.140 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.339+0000 7fdf5165e640 1 --2- 172.21.15.87:0/2520425833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf4c1056f0 0x7fdf4c1993f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdf48006f10 tx=0x7fdf48032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:16.140 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.339+0000 7fdf427fc640 1 -- 172.21.15.87:0/2520425833 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf48032d80 con 0x7fdf4c1056f0 2024-09-13T17:04:16.140 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.339+0000 7fdf427fc640 1 -- 172.21.15.87:0/2520425833 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdf4803b8c0 con 0x7fdf4c1056f0 2024-09-13T17:04:16.141 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.339+0000 7fdf538c2640 1 -- 172.21.15.87:0/2520425833 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf4c199b30 con 0x7fdf4c1056f0 2024-09-13T17:04:16.141 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.339+0000 7fdf427fc640 1 -- 172.21.15.87:0/2520425833 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf4803a5a0 con 0x7fdf4c1056f0 2024-09-13T17:04:16.141 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.339+0000 7fdf538c2640 1 -- 172.21.15.87:0/2520425833 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf4c199fd0 con 0x7fdf4c1056f0 2024-09-13T17:04:16.141 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.340+0000 7fdf427fc640 1 -- 172.21.15.87:0/2520425833 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 4) v1 ==== 45530+0+0 (secure 0 0 0) 0x7fdf48039040 con 0x7fdf4c1056f0 2024-09-13T17:04:16.141 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.340+0000 7fdf427fc640 1 --2- 172.21.15.87:0/2520425833 >> [v2:172.21.15.87:6800/1587363880,v1:172.21.15.87:6801/1587363880] conn(0x7fdf38038620 0x7fdf3803aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:16.141 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.340+0000 7fdf427fc640 1 -- 172.21.15.87:0/2520425833 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fdf4806b8b0 con 0x7fdf4c1056f0 2024-09-13T17:04:16.141 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.340+0000 7fdf538c2640 1 -- 172.21.15.87:0/2520425833 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf4c109ad0 con 0x7fdf4c1056f0 2024-09-13T17:04:16.141 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.340+0000 7fdf50e5d640 1 --2- 172.21.15.87:0/2520425833 >> [v2:172.21.15.87:6800/1587363880,v1:172.21.15.87:6801/1587363880] conn(0x7fdf38038620 0x7fdf3803aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:16.141 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.341+0000 7fdf50e5d640 1 --2- 172.21.15.87:0/2520425833 >> [v2:172.21.15.87:6800/1587363880,v1:172.21.15.87:6801/1587363880] conn(0x7fdf38038620 0x7fdf3803aae0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c0098c0 tx=0x7fdf3c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:16.142 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.345+0000 7fdf427fc640 1 -- 172.21.15.87:0/2520425833 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdf4803f020 con 0x7fdf4c1056f0 2024-09-13T17:04:16.142 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.506+0000 7fdf538c2640 1 -- 172.21.15.87:0/2520425833 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fdf4c19c8b0 con 0x7fdf4c1056f0 2024-09-13T17:04:16.142 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.507+0000 7fdf427fc640 1 -- 172.21.15.87:0/2520425833 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7fdf48053020 con 0x7fdf4c1056f0 2024-09-13T17:04:16.142 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.509+0000 7fdf538c2640 1 -- 172.21.15.87:0/2520425833 >> [v2:172.21.15.87:6800/1587363880,v1:172.21.15.87:6801/1587363880] conn(0x7fdf38038620 msgr2=0x7fdf3803aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:16.142 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.509+0000 7fdf538c2640 1 --2- 172.21.15.87:0/2520425833 >> [v2:172.21.15.87:6800/1587363880,v1:172.21.15.87:6801/1587363880] conn(0x7fdf38038620 0x7fdf3803aae0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c0098c0 tx=0x7fdf3c006db0 comp rx=0 tx=0).stop 2024-09-13T17:04:16.142 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.510+0000 7fdf538c2640 1 -- 172.21.15.87:0/2520425833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf4c1056f0 msgr2=0x7fdf4c1993f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:16.142 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.510+0000 7fdf538c2640 1 --2- 172.21.15.87:0/2520425833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf4c1056f0 0x7fdf4c1993f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdf48006f10 tx=0x7fdf48032670 comp rx=0 tx=0).stop 2024-09-13T17:04:16.142 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.510+0000 7fdf538c2640 1 -- 172.21.15.87:0/2520425833 shutdown_connections 2024-09-13T17:04:16.142 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.510+0000 7fdf538c2640 1 --2- 172.21.15.87:0/2520425833 >> [v2:172.21.15.87:6800/1587363880,v1:172.21.15.87:6801/1587363880] conn(0x7fdf38038620 0x7fdf3803aae0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:16.142 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.510+0000 7fdf538c2640 1 --2- 172.21.15.87:0/2520425833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf4c1056f0 0x7fdf4c1993f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:16.142 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.510+0000 7fdf538c2640 1 -- 172.21.15.87:0/2520425833 >> 172.21.15.87:0/2520425833 conn(0x7fdf4c100f40 msgr2=0x7fdf4c101ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:16.142 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.510+0000 7fdf538c2640 1 -- 172.21.15.87:0/2520425833 shutdown_connections 2024-09-13T17:04:16.142 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:12.510+0000 7fdf538c2640 1 -- 172.21.15.87:0/2520425833 wait complete. 2024-09-13T17:04:16.142 INFO:teuthology.orchestra.run.smithi087.stdout:Enabling cephadm module... 2024-09-13T17:04:19.718 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:19 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2942734865' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-13T17:04:19.719 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:19 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: ignoring --setuser ceph since I am not root 2024-09-13T17:04:19.719 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:19 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: ignoring --setgroup ceph since I am not root 2024-09-13T17:04:19.719 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:19 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:19.515+0000 7fcd5e8d6040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T17:04:19.719 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:19 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:19.571+0000 7fcd5e8d6040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T17:04:19.719 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:19 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:19.716+0000 7fcd5e8d6040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T17:04:19.978 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:19 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:19.782+0000 7fcd5e8d6040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T17:04:19.979 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:19 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:19.925+0000 7fcd5e8d6040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:04:20.370 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:20 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:20.064+0000 7fcd5e8d6040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T17:04:20.370 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:20 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:20.368+0000 7fcd5e8d6040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T17:04:20.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:20 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2942734865' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-13T17:04:20.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:20 smithi087 ceph-mon[30934]: mgrmap e5: x(active, since 10s) 2024-09-13T17:04:20.729 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:20 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:20.429+0000 7fcd5e8d6040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T17:04:20.729 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:20 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:20.610+0000 7fcd5e8d6040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T17:04:21.729 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:21 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:21.475+0000 7fcd5e8d6040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T17:04:21.729 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:21 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:21.540+0000 7fcd5e8d6040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T17:04:22.500 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:22 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:22.245+0000 7fcd5e8d6040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T17:04:22.500 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:22 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:22.358+0000 7fcd5e8d6040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T17:04:22.771 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:22 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:22.498+0000 7fcd5e8d6040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:04:22.772 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:22 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:22.558+0000 7fcd5e8d6040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T17:04:22.772 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:22 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:22.703+0000 7fcd5e8d6040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T17:04:22.772 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:22 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:22.769+0000 7fcd5e8d6040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T17:04:23.049 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:22 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:22.828+0000 7fcd5e8d6040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T17:04:23.049 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:22 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:22.982+0000 7fcd5e8d6040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T17:04:23.049 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:23 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:23.046+0000 7fcd5e8d6040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T17:04:23.311 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:23 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:23.112+0000 7fcd5e8d6040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T17:04:23.311 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:23 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:23.193+0000 7fcd5e8d6040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T17:04:23.311 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:23 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:23.251+0000 7fcd5e8d6040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T17:04:23.311 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:23 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:23.308+0000 7fcd5e8d6040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T17:04:24.478 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:24 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:24.080+0000 7fcd5e8d6040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T17:04:24.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:24 smithi087 ceph-mon[30934]: Active manager daemon x restarted 2024-09-13T17:04:24.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:24 smithi087 ceph-mon[30934]: Activating manager daemon x 2024-09-13T17:04:24.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:24 smithi087 ceph-mon[30934]: osdmap e2: 0 total, 0 up, 0 in 2024-09-13T17:04:24.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:24 smithi087 ceph-mon[30934]: mgrmap e6: x(active, starting, since 0.00362377s) 2024-09-13T17:04:24.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:24 smithi087 ceph-mon[30934]: from='mgr.14118 172.21.15.87:0/296842519' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:04:24.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:24 smithi087 ceph-mon[30934]: from='mgr.14118 172.21.15.87:0/296842519' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-13T17:04:24.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:24 smithi087 ceph-mon[30934]: from='mgr.14118 172.21.15.87:0/296842519' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T17:04:24.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:24 smithi087 ceph-mon[30934]: from='mgr.14118 172.21.15.87:0/296842519' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T17:04:24.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:24 smithi087 ceph-mon[30934]: from='mgr.14118 172.21.15.87:0/296842519' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T17:04:24.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:24 smithi087 ceph-mon[30934]: Manager daemon x is now available 2024-09-13T17:04:24.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:24 smithi087 ceph-mon[30934]: from='mgr.14118 172.21.15.87:0/296842519' entity='mgr.x' 2024-09-13T17:04:24.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:24 smithi087 ceph-mon[30934]: from='mgr.14118 172.21.15.87:0/296842519' entity='mgr.x' 2024-09-13T17:04:24.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:24 smithi087 ceph-mon[30934]: from='mgr.14118 172.21.15.87:0/296842519' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:04:24.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:24 smithi087 ceph-mon[30934]: from='mgr.14118 172.21.15.87:0/296842519' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:04:24.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:24 smithi087 ceph-mon[30934]: from='mgr.14118 172.21.15.87:0/296842519' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-13T17:04:24.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:24 smithi087 ceph-mon[30934]: from='mgr.14118 172.21.15.87:0/296842519' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-13T17:04:24.733 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.111+0000 7f93c97a3640 1 Processor -- start 2024-09-13T17:04:24.733 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.111+0000 7f93c97a3640 1 -- start start 2024-09-13T17:04:24.733 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.111+0000 7f93c97a3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93c4106210 0x7f93c4108600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:24.733 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.111+0000 7f93c97a3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c4079d80 con 0x7f93c4106210 2024-09-13T17:04:24.733 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.111+0000 7f93c2ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93c4106210 0x7f93c4108600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:24.734 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.111+0000 7f93c2ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93c4106210 0x7f93c4108600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51224/0 (socket says 172.21.15.87:51224) 2024-09-13T17:04:24.734 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.111+0000 7f93c2ffd640 1 -- 172.21.15.87:0/1701068885 learned_addr learned my addr 172.21.15.87:0/1701068885 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:24.734 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.111+0000 7f93c2ffd640 1 -- 172.21.15.87:0/1701068885 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c4108b40 con 0x7f93c4106210 2024-09-13T17:04:24.734 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.112+0000 7f93c2ffd640 1 --2- 172.21.15.87:0/1701068885 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93c4106210 0x7f93c4108600 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f93b4009820 tx=0x7f93b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c7a8ca851693dd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:24.734 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.112+0000 7f93c1ffb640 1 -- 172.21.15.87:0/1701068885 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93b402ae70 con 0x7f93c4106210 2024-09-13T17:04:24.734 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.113+0000 7f93c1ffb640 1 -- 172.21.15.87:0/1701068885 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f93b40328d0 con 0x7f93c4106210 2024-09-13T17:04:24.734 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.113+0000 7f93c1ffb640 1 -- 172.21.15.87:0/1701068885 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93b40308a0 con 0x7f93c4106210 2024-09-13T17:04:24.734 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.113+0000 7f93c97a3640 1 -- 172.21.15.87:0/1701068885 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93c4106210 msgr2=0x7f93c4108600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:24.734 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.113+0000 7f93c97a3640 1 --2- 172.21.15.87:0/1701068885 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93c4106210 0x7f93c4108600 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f93b4009820 tx=0x7f93b402a270 comp rx=0 tx=0).stop 2024-09-13T17:04:24.734 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.113+0000 7f93c97a3640 1 -- 172.21.15.87:0/1701068885 shutdown_connections 2024-09-13T17:04:24.734 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.113+0000 7f93c97a3640 1 --2- 172.21.15.87:0/1701068885 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93c4106210 0x7f93c4108600 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:24.734 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.113+0000 7f93c97a3640 1 -- 172.21.15.87:0/1701068885 >> 172.21.15.87:0/1701068885 conn(0x7f93c40ffe30 msgr2=0x7f93c4102250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:24.735 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.113+0000 7f93c97a3640 1 -- 172.21.15.87:0/1701068885 shutdown_connections 2024-09-13T17:04:24.735 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.113+0000 7f93c97a3640 1 -- 172.21.15.87:0/1701068885 wait complete. 2024-09-13T17:04:24.735 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.114+0000 7f93c97a3640 1 Processor -- start 2024-09-13T17:04:24.735 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.114+0000 7f93c97a3640 1 -- start start 2024-09-13T17:04:24.735 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.114+0000 7f93c97a3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93c4106210 0x7f93c41993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:24.735 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.114+0000 7f93c97a3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c4199920 con 0x7f93c4106210 2024-09-13T17:04:24.735 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.114+0000 7f93c2ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93c4106210 0x7f93c41993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:24.735 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.114+0000 7f93c2ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93c4106210 0x7f93c41993e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51228/0 (socket says 172.21.15.87:51228) 2024-09-13T17:04:24.735 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.114+0000 7f93c2ffd640 1 -- 172.21.15.87:0/2942734865 learned_addr learned my addr 172.21.15.87:0/2942734865 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:24.735 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.115+0000 7f93c2ffd640 1 -- 172.21.15.87:0/2942734865 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b40094d0 con 0x7f93c4106210 2024-09-13T17:04:24.735 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.115+0000 7f93c2ffd640 1 --2- 172.21.15.87:0/2942734865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93c4106210 0x7f93c41993e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f93b4000c00 tx=0x7f93b4030d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:24.735 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.115+0000 7f93abfff640 1 -- 172.21.15.87:0/2942734865 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93b4032d80 con 0x7f93c4106210 2024-09-13T17:04:24.735 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.115+0000 7f93abfff640 1 -- 172.21.15.87:0/2942734865 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f93b403b8c0 con 0x7f93c4106210 2024-09-13T17:04:24.735 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.115+0000 7f93abfff640 1 -- 172.21.15.87:0/2942734865 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93b403a640 con 0x7f93c4106210 2024-09-13T17:04:24.736 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.115+0000 7f93c97a3640 1 -- 172.21.15.87:0/2942734865 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c4199b20 con 0x7f93c4106210 2024-09-13T17:04:24.736 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.115+0000 7f93c97a3640 1 -- 172.21.15.87:0/2942734865 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c4199fc0 con 0x7f93c4106210 2024-09-13T17:04:24.736 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.116+0000 7f93abfff640 1 -- 172.21.15.87:0/2942734865 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 4) v1 ==== 45530+0+0 (secure 0 0 0) 0x7f93b4039040 con 0x7f93c4106210 2024-09-13T17:04:24.736 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.116+0000 7f93abfff640 1 --2- 172.21.15.87:0/2942734865 >> [v2:172.21.15.87:6800/1587363880,v1:172.21.15.87:6801/1587363880] conn(0x7f93ac0385d0 0x7f93ac03aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:24.736 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.116+0000 7f93c97a3640 1 -- 172.21.15.87:0/2942734865 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93c4109890 con 0x7f93c4106210 2024-09-13T17:04:24.736 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.116+0000 7f93abfff640 1 -- 172.21.15.87:0/2942734865 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f93b406b730 con 0x7f93c4106210 2024-09-13T17:04:24.736 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.116+0000 7f93c27fc640 1 --2- 172.21.15.87:0/2942734865 >> [v2:172.21.15.87:6800/1587363880,v1:172.21.15.87:6801/1587363880] conn(0x7f93ac0385d0 0x7f93ac03aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:24.736 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.117+0000 7f93c27fc640 1 --2- 172.21.15.87:0/2942734865 >> [v2:172.21.15.87:6800/1587363880,v1:172.21.15.87:6801/1587363880] conn(0x7f93ac0385d0 0x7f93ac03aa90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f93b80098c0 tx=0x7f93b8006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:24.736 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.121+0000 7f93abfff640 1 -- 172.21.15.87:0/2942734865 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f93b403f080 con 0x7f93c4106210 2024-09-13T17:04:24.736 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.328+0000 7f93c97a3640 1 -- 172.21.15.87:0/2942734865 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f93c4109ad0 con 0x7f93c4106210 2024-09-13T17:04:24.736 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.380+0000 7f93abfff640 1 -- 172.21.15.87:0/2942734865 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f93b40412c0 con 0x7f93c4106210 2024-09-13T17:04:24.736 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.381+0000 7f93abfff640 1 -- 172.21.15.87:0/2942734865 <== mon.0 v2:172.21.15.87:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f93b4031970 con 0x7f93c4106210 2024-09-13T17:04:24.736 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.383+0000 7f93c97a3640 1 -- 172.21.15.87:0/2942734865 >> [v2:172.21.15.87:6800/1587363880,v1:172.21.15.87:6801/1587363880] conn(0x7f93ac0385d0 msgr2=0x7f93ac03aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:24.737 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.383+0000 7f93c97a3640 1 --2- 172.21.15.87:0/2942734865 >> [v2:172.21.15.87:6800/1587363880,v1:172.21.15.87:6801/1587363880] conn(0x7f93ac0385d0 0x7f93ac03aa90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f93b80098c0 tx=0x7f93b8006db0 comp rx=0 tx=0).stop 2024-09-13T17:04:24.737 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.383+0000 7f93c97a3640 1 -- 172.21.15.87:0/2942734865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93c4106210 msgr2=0x7f93c41993e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:24.737 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.383+0000 7f93c97a3640 1 --2- 172.21.15.87:0/2942734865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93c4106210 0x7f93c41993e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f93b4000c00 tx=0x7f93b4030d90 comp rx=0 tx=0).stop 2024-09-13T17:04:24.737 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.383+0000 7f93c97a3640 1 -- 172.21.15.87:0/2942734865 shutdown_connections 2024-09-13T17:04:24.737 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.383+0000 7f93c97a3640 1 --2- 172.21.15.87:0/2942734865 >> [v2:172.21.15.87:6800/1587363880,v1:172.21.15.87:6801/1587363880] conn(0x7f93ac0385d0 0x7f93ac03aa90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:24.737 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.383+0000 7f93c97a3640 1 --2- 172.21.15.87:0/2942734865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93c4106210 0x7f93c41993e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:24.737 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.383+0000 7f93c97a3640 1 -- 172.21.15.87:0/2942734865 >> 172.21.15.87:0/2942734865 conn(0x7f93c40ffe30 msgr2=0x7f93c4100a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:24.737 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.384+0000 7f93c97a3640 1 -- 172.21.15.87:0/2942734865 shutdown_connections 2024-09-13T17:04:24.737 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:19.384+0000 7f93c97a3640 1 -- 172.21.15.87:0/2942734865 wait complete. 2024-09-13T17:04:25.300 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:25 smithi087 ceph-mon[30934]: Found migration_current of "None". Setting to last migration. 2024-09-13T17:04:25.300 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:25 smithi087 ceph-mon[30934]: from='mgr.14118 172.21.15.87:0/296842519' entity='mgr.x' 2024-09-13T17:04:25.301 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:25 smithi087 ceph-mon[30934]: from='mgr.14118 172.21.15.87:0/296842519' entity='mgr.x' 2024-09-13T17:04:25.301 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:25 smithi087 ceph-mon[30934]: mgrmap e7: x(active, since 1.01013s) 2024-09-13T17:04:26.132 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:25 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:25.712+0000 7fccc65b6640 -1 log_channel(cephadm) log [ERR] : [13/Sep/2024:17:04:25] ENGINE Error in HTTPServer.serve 2024-09-13T17:04:26.132 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:25 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: Traceback (most recent call last): 2024-09-13T17:04:26.132 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:25 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T17:04:26.132 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:25 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: self._connections.run(self.expiration_interval) 2024-09-13T17:04:26.133 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:25 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T17:04:26.133 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:25 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: self._run(expiration_interval) 2024-09-13T17:04:26.133 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:25 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T17:04:26.133 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:25 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T17:04:26.133 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:25 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T17:04:26.133 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:25 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T17:04:26.133 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:25 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T17:04:26.133 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:25 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: s = self.context.wrap_socket( 2024-09-13T17:04:26.133 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:25 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T17:04:26.133 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:25 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: return self.sslsocket_class._create( 2024-09-13T17:04:26.133 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:25 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T17:04:26.134 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:25 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: self.do_handshake() 2024-09-13T17:04:26.134 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:25 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T17:04:26.134 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:25 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: self._sslobj.do_handshake() 2024-09-13T17:04:26.134 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:25 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T17:04:26.134 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:25 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:26.416 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:26 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/596421925' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-13T17:04:26.416 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:26 smithi087 ceph-mon[30934]: from='mgr.14118 172.21.15.87:0/296842519' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:04:26.424 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout { 2024-09-13T17:04:26.424 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 7, 2024-09-13T17:04:26.425 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T17:04:26.425 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-13T17:04:26.425 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T17:04:26.425 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout } 2024-09-13T17:04:26.425 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.079+0000 7fb87ccac640 1 Processor -- start 2024-09-13T17:04:26.425 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.079+0000 7fb87ccac640 1 -- start start 2024-09-13T17:04:26.425 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.080+0000 7fb87ccac640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8781045d0 0x7fb8781049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:26.425 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.080+0000 7fb87ccac640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb878104fa0 con 0x7fb8781045d0 2024-09-13T17:04:26.425 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.080+0000 7fb87659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8781045d0 0x7fb8781049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:26.425 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.080+0000 7fb87659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8781045d0 0x7fb8781049d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51312/0 (socket says 172.21.15.87:51312) 2024-09-13T17:04:26.425 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.080+0000 7fb87659c640 1 -- 172.21.15.87:0/2862442073 learned_addr learned my addr 172.21.15.87:0/2862442073 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:26.425 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.080+0000 7fb87659c640 1 -- 172.21.15.87:0/2862442073 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb878105780 con 0x7fb8781045d0 2024-09-13T17:04:26.425 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.081+0000 7fb87659c640 1 --2- 172.21.15.87:0/2862442073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8781045d0 0x7fb8781049d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb868009820 tx=0x7fb86802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91f384584d1fec56 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:26.426 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.081+0000 7fb875d9b640 1 -- 172.21.15.87:0/2862442073 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb86802ae70 con 0x7fb8781045d0 2024-09-13T17:04:26.426 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.081+0000 7fb875d9b640 1 -- 172.21.15.87:0/2862442073 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb8680328d0 con 0x7fb8781045d0 2024-09-13T17:04:26.426 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.081+0000 7fb875d9b640 1 -- 172.21.15.87:0/2862442073 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb8680308a0 con 0x7fb8781045d0 2024-09-13T17:04:26.426 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.082+0000 7fb87ccac640 1 -- 172.21.15.87:0/2862442073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8781045d0 msgr2=0x7fb8781049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:26.426 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.082+0000 7fb87ccac640 1 --2- 172.21.15.87:0/2862442073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8781045d0 0x7fb8781049d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb868009820 tx=0x7fb86802a270 comp rx=0 tx=0).stop 2024-09-13T17:04:26.426 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.082+0000 7fb87ccac640 1 -- 172.21.15.87:0/2862442073 shutdown_connections 2024-09-13T17:04:26.426 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.082+0000 7fb87ccac640 1 --2- 172.21.15.87:0/2862442073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8781045d0 0x7fb8781049d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:26.426 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.082+0000 7fb87ccac640 1 -- 172.21.15.87:0/2862442073 >> 172.21.15.87:0/2862442073 conn(0x7fb8780ffda0 msgr2=0x7fb8781021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:26.426 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.082+0000 7fb87ccac640 1 -- 172.21.15.87:0/2862442073 shutdown_connections 2024-09-13T17:04:26.426 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.082+0000 7fb87ccac640 1 -- 172.21.15.87:0/2862442073 wait complete. 2024-09-13T17:04:26.426 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.082+0000 7fb87ccac640 1 Processor -- start 2024-09-13T17:04:26.426 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.082+0000 7fb87ccac640 1 -- start start 2024-09-13T17:04:26.426 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.083+0000 7fb87ccac640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8781045d0 0x7fb878199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:26.427 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.083+0000 7fb87ccac640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8781999c0 con 0x7fb8781045d0 2024-09-13T17:04:26.427 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.083+0000 7fb87659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8781045d0 0x7fb878199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:26.427 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.083+0000 7fb87659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8781045d0 0x7fb878199480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51322/0 (socket says 172.21.15.87:51322) 2024-09-13T17:04:26.427 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.083+0000 7fb87659c640 1 -- 172.21.15.87:0/596421925 learned_addr learned my addr 172.21.15.87:0/596421925 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:26.427 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.083+0000 7fb87659c640 1 -- 172.21.15.87:0/596421925 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8680094d0 con 0x7fb8781045d0 2024-09-13T17:04:26.427 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.083+0000 7fb87659c640 1 --2- 172.21.15.87:0/596421925 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8781045d0 0x7fb878199480 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb86802a790 tx=0x7fb868030d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:26.427 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.083+0000 7fb86f7fe640 1 -- 172.21.15.87:0/596421925 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb868032d80 con 0x7fb8781045d0 2024-09-13T17:04:26.427 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.083+0000 7fb87ccac640 1 -- 172.21.15.87:0/596421925 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb878199bc0 con 0x7fb8781045d0 2024-09-13T17:04:26.427 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.083+0000 7fb86f7fe640 1 -- 172.21.15.87:0/596421925 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb86803b8c0 con 0x7fb8781045d0 2024-09-13T17:04:26.427 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.083+0000 7fb86f7fe640 1 -- 172.21.15.87:0/596421925 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb86803a500 con 0x7fb8781045d0 2024-09-13T17:04:26.427 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.083+0000 7fb87ccac640 1 -- 172.21.15.87:0/596421925 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb87819a060 con 0x7fb8781045d0 2024-09-13T17:04:26.427 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.084+0000 7fb86f7fe640 1 -- 172.21.15.87:0/596421925 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 6) v1 ==== 45308+0+0 (secure 0 0 0) 0x7fb868039040 con 0x7fb8781045d0 2024-09-13T17:04:26.427 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.085+0000 7fb87ccac640 1 -- 172.21.15.87:0/596421925 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8781935e0 con 0x7fb8781045d0 2024-09-13T17:04:26.427 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.085+0000 7fb86f7fe640 1 -- 172.21.15.87:0/596421925 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb86803be10 con 0x7fb8781045d0 2024-09-13T17:04:26.428 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.090+0000 7fb86f7fe640 1 -- 172.21.15.87:0/596421925 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb86803f020 con 0x7fb8781045d0 2024-09-13T17:04:26.428 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.091+0000 7fb86f7fe640 1 -- 172.21.15.87:0/596421925 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mgrmap(e 7) v1 ==== 45435+0+0 (secure 0 0 0) 0x7fb86805aaf0 con 0x7fb8781045d0 2024-09-13T17:04:26.428 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.092+0000 7fb86f7fe640 1 --2- 172.21.15.87:0/596421925 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7fb8640393c0 0x7fb86403b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:26.428 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.092+0000 7fb86ffff640 1 --2- 172.21.15.87:0/596421925 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7fb8640393c0 0x7fb86403b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:26.428 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.092+0000 7fb86ffff640 1 --2- 172.21.15.87:0/596421925 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7fb8640393c0 0x7fb86403b7b0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fb8600098c0 tx=0x7fb860006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:26.428 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.299+0000 7fb87ccac640 1 -- 172.21.15.87:0/596421925 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fb878108ba0 con 0x7fb8781045d0 2024-09-13T17:04:26.428 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.299+0000 7fb86f7fe640 1 -- 172.21.15.87:0/596421925 <== mon.0 v2:172.21.15.87:3300/0 8 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v7) v1 ==== 56+0+88 (secure 0 0 0) 0x7fb86803f070 con 0x7fb8781045d0 2024-09-13T17:04:26.428 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.301+0000 7fb87ccac640 1 -- 172.21.15.87:0/596421925 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7fb8640393c0 msgr2=0x7fb86403b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:26.428 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.301+0000 7fb87ccac640 1 --2- 172.21.15.87:0/596421925 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7fb8640393c0 0x7fb86403b7b0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fb8600098c0 tx=0x7fb860006db0 comp rx=0 tx=0).stop 2024-09-13T17:04:26.428 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.301+0000 7fb87ccac640 1 -- 172.21.15.87:0/596421925 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8781045d0 msgr2=0x7fb878199480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:26.429 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.301+0000 7fb87ccac640 1 --2- 172.21.15.87:0/596421925 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8781045d0 0x7fb878199480 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb86802a790 tx=0x7fb868030d90 comp rx=0 tx=0).stop 2024-09-13T17:04:26.429 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.302+0000 7fb87ccac640 1 -- 172.21.15.87:0/596421925 shutdown_connections 2024-09-13T17:04:26.429 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.302+0000 7fb87ccac640 1 --2- 172.21.15.87:0/596421925 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7fb8640393c0 0x7fb86403b7b0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:26.429 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.302+0000 7fb87ccac640 1 --2- 172.21.15.87:0/596421925 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8781045d0 0x7fb878199480 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:26.429 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.302+0000 7fb87ccac640 1 -- 172.21.15.87:0/596421925 >> 172.21.15.87:0/596421925 conn(0x7fb8780ffda0 msgr2=0x7fb878100d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:26.429 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.302+0000 7fb87ccac640 1 -- 172.21.15.87:0/596421925 shutdown_connections 2024-09-13T17:04:26.429 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:25.302+0000 7fb87ccac640 1 -- 172.21.15.87:0/596421925 wait complete. 2024-09-13T17:04:26.429 INFO:teuthology.orchestra.run.smithi087.stdout:Waiting for the mgr to restart... 2024-09-13T17:04:26.429 INFO:teuthology.orchestra.run.smithi087.stdout:Waiting for mgr epoch 7... 2024-09-13T17:04:27.422 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:27 smithi087 ceph-mon[30934]: [13/Sep/2024:17:04:25] ENGINE Bus STARTING 2024-09-13T17:04:27.422 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:27 smithi087 ceph-mon[30934]: [13/Sep/2024:17:04:25] ENGINE Serving on http://172.21.15.87:8765 2024-09-13T17:04:27.422 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:27 smithi087 ceph-mon[30934]: [13/Sep/2024:17:04:25] ENGINE Serving on https://172.21.15.87:7150 2024-09-13T17:04:27.422 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:27 smithi087 ceph-mon[30934]: [13/Sep/2024:17:04:25] ENGINE Bus STARTED 2024-09-13T17:04:27.423 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:27 smithi087 ceph-mon[30934]: [13/Sep/2024:17:04:25] ENGINE Error in HTTPServer.serve 2024-09-13T17:04:27.423 INFO:journalctl@ceph.mon.a.smithi087.stdout: Traceback (most recent call last): 2024-09-13T17:04:27.423 INFO:journalctl@ceph.mon.a.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T17:04:27.423 INFO:journalctl@ceph.mon.a.smithi087.stdout: self._connections.run(self.expiration_interval) 2024-09-13T17:04:27.423 INFO:journalctl@ceph.mon.a.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T17:04:27.423 INFO:journalctl@ceph.mon.a.smithi087.stdout: self._run(expiration_interval) 2024-09-13T17:04:27.424 INFO:journalctl@ceph.mon.a.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T17:04:27.424 INFO:journalctl@ceph.mon.a.smithi087.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T17:04:27.424 INFO:journalctl@ceph.mon.a.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T17:04:27.424 INFO:journalctl@ceph.mon.a.smithi087.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T17:04:27.424 INFO:journalctl@ceph.mon.a.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T17:04:27.424 INFO:journalctl@ceph.mon.a.smithi087.stdout: s = self.context.wrap_socket( 2024-09-13T17:04:27.425 INFO:journalctl@ceph.mon.a.smithi087.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T17:04:27.425 INFO:journalctl@ceph.mon.a.smithi087.stdout: return self.sslsocket_class._create( 2024-09-13T17:04:27.425 INFO:journalctl@ceph.mon.a.smithi087.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T17:04:27.425 INFO:journalctl@ceph.mon.a.smithi087.stdout: self.do_handshake() 2024-09-13T17:04:27.425 INFO:journalctl@ceph.mon.a.smithi087.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T17:04:27.425 INFO:journalctl@ceph.mon.a.smithi087.stdout: self._sslobj.do_handshake() 2024-09-13T17:04:27.426 INFO:journalctl@ceph.mon.a.smithi087.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T17:04:27.426 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:27 smithi087 ceph-mon[30934]: mgrmap e8: x(active, since 2s) 2024-09-13T17:04:27.437 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout { 2024-09-13T17:04:27.437 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 8, 2024-09-13T17:04:27.437 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T17:04:27.437 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout } 2024-09-13T17:04:27.438 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.817+0000 7f0e3e93d640 1 Processor -- start 2024-09-13T17:04:27.438 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.817+0000 7f0e3e93d640 1 -- start start 2024-09-13T17:04:27.438 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.817+0000 7f0e3e93d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e381056f0 0x7f0e38105af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:27.438 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.817+0000 7f0e3e93d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e381060c0 con 0x7f0e381056f0 2024-09-13T17:04:27.438 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.818+0000 7f0e37fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e381056f0 0x7f0e38105af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:27.438 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.818+0000 7f0e37fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e381056f0 0x7f0e38105af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51324/0 (socket says 172.21.15.87:51324) 2024-09-13T17:04:27.439 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.818+0000 7f0e37fff640 1 -- 172.21.15.87:0/4104343159 learned_addr learned my addr 172.21.15.87:0/4104343159 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:27.439 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.818+0000 7f0e37fff640 1 -- 172.21.15.87:0/4104343159 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e381068a0 con 0x7f0e381056f0 2024-09-13T17:04:27.439 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.818+0000 7f0e37fff640 1 --2- 172.21.15.87:0/4104343159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e381056f0 0x7f0e38105af0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0e28009820 tx=0x7f0e2802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45ea497d9955c517 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:27.439 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.819+0000 7f0e36ffd640 1 -- 172.21.15.87:0/4104343159 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e2802ae70 con 0x7f0e381056f0 2024-09-13T17:04:27.439 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.819+0000 7f0e36ffd640 1 -- 172.21.15.87:0/4104343159 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0e280328d0 con 0x7f0e381056f0 2024-09-13T17:04:27.439 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.819+0000 7f0e36ffd640 1 -- 172.21.15.87:0/4104343159 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e280308a0 con 0x7f0e381056f0 2024-09-13T17:04:27.440 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.819+0000 7f0e3e93d640 1 -- 172.21.15.87:0/4104343159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e381056f0 msgr2=0x7f0e38105af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:27.440 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.819+0000 7f0e3e93d640 1 --2- 172.21.15.87:0/4104343159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e381056f0 0x7f0e38105af0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0e28009820 tx=0x7f0e2802a270 comp rx=0 tx=0).stop 2024-09-13T17:04:27.440 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.819+0000 7f0e3e93d640 1 -- 172.21.15.87:0/4104343159 shutdown_connections 2024-09-13T17:04:27.440 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.819+0000 7f0e3e93d640 1 --2- 172.21.15.87:0/4104343159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e381056f0 0x7f0e38105af0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:27.440 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.819+0000 7f0e3e93d640 1 -- 172.21.15.87:0/4104343159 >> 172.21.15.87:0/4104343159 conn(0x7f0e38100f40 msgr2=0x7f0e38103360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:27.441 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.819+0000 7f0e3e93d640 1 -- 172.21.15.87:0/4104343159 shutdown_connections 2024-09-13T17:04:27.441 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.819+0000 7f0e3e93d640 1 -- 172.21.15.87:0/4104343159 wait complete. 2024-09-13T17:04:27.441 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.820+0000 7f0e3e93d640 1 Processor -- start 2024-09-13T17:04:27.442 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.820+0000 7f0e3e93d640 1 -- start start 2024-09-13T17:04:27.442 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.820+0000 7f0e3e93d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e381056f0 0x7f0e381993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:27.442 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.820+0000 7f0e3e93d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e38199930 con 0x7f0e381056f0 2024-09-13T17:04:27.442 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.821+0000 7f0e37fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e381056f0 0x7f0e381993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:27.442 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.821+0000 7f0e37fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e381056f0 0x7f0e381993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51334/0 (socket says 172.21.15.87:51334) 2024-09-13T17:04:27.443 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.821+0000 7f0e37fff640 1 -- 172.21.15.87:0/1692989186 learned_addr learned my addr 172.21.15.87:0/1692989186 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:27.443 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.821+0000 7f0e37fff640 1 -- 172.21.15.87:0/1692989186 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e280094d0 con 0x7f0e381056f0 2024-09-13T17:04:27.443 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.821+0000 7f0e37fff640 1 --2- 172.21.15.87:0/1692989186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e381056f0 0x7f0e381993f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0e28006f10 tx=0x7f0e28032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:27.443 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.821+0000 7f0e357fa640 1 -- 172.21.15.87:0/1692989186 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e28032d80 con 0x7f0e381056f0 2024-09-13T17:04:27.443 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.821+0000 7f0e357fa640 1 -- 172.21.15.87:0/1692989186 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0e2803b8c0 con 0x7f0e381056f0 2024-09-13T17:04:27.443 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.821+0000 7f0e3e93d640 1 -- 172.21.15.87:0/1692989186 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e38199b30 con 0x7f0e381056f0 2024-09-13T17:04:27.443 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.821+0000 7f0e357fa640 1 -- 172.21.15.87:0/1692989186 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e2803a5a0 con 0x7f0e381056f0 2024-09-13T17:04:27.444 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.821+0000 7f0e3e93d640 1 -- 172.21.15.87:0/1692989186 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e38199fd0 con 0x7f0e381056f0 2024-09-13T17:04:27.444 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.822+0000 7f0e357fa640 1 -- 172.21.15.87:0/1692989186 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f0e28039040 con 0x7f0e381056f0 2024-09-13T17:04:27.444 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.822+0000 7f0e357fa640 1 --2- 172.21.15.87:0/1692989186 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f0e20038670 0x7f0e2003ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:27.444 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.822+0000 7f0e3e93d640 1 -- 172.21.15.87:0/1692989186 --> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0e38109ad0 con 0x7f0e20038670 2024-09-13T17:04:27.444 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.822+0000 7f0e357fa640 1 -- 172.21.15.87:0/1692989186 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f0e2806b830 con 0x7f0e381056f0 2024-09-13T17:04:27.444 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.822+0000 7f0e377fe640 1 --2- 172.21.15.87:0/1692989186 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f0e20038670 0x7f0e2003ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:27.445 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.823+0000 7f0e377fe640 1 --2- 172.21.15.87:0/1692989186 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f0e20038670 0x7f0e2003ab30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0098c0 tx=0x7f0e2c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:27.445 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.823+0000 7f0e357fa640 1 -- 172.21.15.87:0/1692989186 <== mgr.14118 v2:172.21.15.87:6800/4144176457 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f0e38109ad0 con 0x7f0e20038670 2024-09-13T17:04:27.445 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.828+0000 7f0e3e93d640 1 -- 172.21.15.87:0/1692989186 --> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f0e38109c40 con 0x7f0e20038670 2024-09-13T17:04:27.445 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.828+0000 7f0e357fa640 1 -- 172.21.15.87:0/1692989186 <== mgr.14118 v2:172.21.15.87:6800/4144176457 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f0e38109c40 con 0x7f0e20038670 2024-09-13T17:04:27.445 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.829+0000 7f0e3e93d640 1 -- 172.21.15.87:0/1692989186 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f0e20038670 msgr2=0x7f0e2003ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:27.445 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.829+0000 7f0e3e93d640 1 --2- 172.21.15.87:0/1692989186 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f0e20038670 0x7f0e2003ab30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0098c0 tx=0x7f0e2c006db0 comp rx=0 tx=0).stop 2024-09-13T17:04:27.446 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.829+0000 7f0e3e93d640 1 -- 172.21.15.87:0/1692989186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e381056f0 msgr2=0x7f0e381993f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:27.446 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.829+0000 7f0e3e93d640 1 --2- 172.21.15.87:0/1692989186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e381056f0 0x7f0e381993f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0e28006f10 tx=0x7f0e28032670 comp rx=0 tx=0).stop 2024-09-13T17:04:27.446 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.829+0000 7f0e3e93d640 1 -- 172.21.15.87:0/1692989186 shutdown_connections 2024-09-13T17:04:27.446 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.829+0000 7f0e3e93d640 1 --2- 172.21.15.87:0/1692989186 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f0e20038670 0x7f0e2003ab30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:27.446 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.829+0000 7f0e3e93d640 1 --2- 172.21.15.87:0/1692989186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e381056f0 0x7f0e381993f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:27.446 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.829+0000 7f0e3e93d640 1 -- 172.21.15.87:0/1692989186 >> 172.21.15.87:0/1692989186 conn(0x7f0e38100f40 msgr2=0x7f0e38101ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:27.447 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.829+0000 7f0e3e93d640 1 -- 172.21.15.87:0/1692989186 shutdown_connections 2024-09-13T17:04:27.447 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:26.829+0000 7f0e3e93d640 1 -- 172.21.15.87:0/1692989186 wait complete. 2024-09-13T17:04:27.447 INFO:teuthology.orchestra.run.smithi087.stdout:mgr epoch 7 is available 2024-09-13T17:04:27.447 INFO:teuthology.orchestra.run.smithi087.stdout:Setting orchestrator backend to cephadm... 2024-09-13T17:04:28.328 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:28 smithi087 ceph-mon[30934]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-13T17:04:28.328 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:28 smithi087 ceph-mon[30934]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-13T17:04:28.328 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:28 smithi087 ceph-mon[30934]: from='mgr.14118 172.21.15.87:0/296842519' entity='mgr.x' 2024-09-13T17:04:28.328 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:28 smithi087 ceph-mon[30934]: from='mgr.14118 172.21.15.87:0/296842519' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:04:28.539 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.851+0000 7f3169fd4640 1 Processor -- start 2024-09-13T17:04:28.544 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.851+0000 7f3169fd4640 1 -- start start 2024-09-13T17:04:28.545 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.852+0000 7f3169fd4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31641056f0 0x7f3164105af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:28.545 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.852+0000 7f3169fd4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31641060c0 con 0x7f31641056f0 2024-09-13T17:04:28.545 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.852+0000 7f31637fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31641056f0 0x7f3164105af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:28.545 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.852+0000 7f31637fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31641056f0 0x7f3164105af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51350/0 (socket says 172.21.15.87:51350) 2024-09-13T17:04:28.545 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.852+0000 7f31637fe640 1 -- 172.21.15.87:0/3905427257 learned_addr learned my addr 172.21.15.87:0/3905427257 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:28.545 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.852+0000 7f31637fe640 1 -- 172.21.15.87:0/3905427257 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31641068a0 con 0x7f31641056f0 2024-09-13T17:04:28.545 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.853+0000 7f31637fe640 1 --2- 172.21.15.87:0/3905427257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31641056f0 0x7f3164105af0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3154009820 tx=0x7f315402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71f76bdb8db83d18 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:28.545 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.853+0000 7f3162ffd640 1 -- 172.21.15.87:0/3905427257 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f315402ae70 con 0x7f31641056f0 2024-09-13T17:04:28.545 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.853+0000 7f3162ffd640 1 -- 172.21.15.87:0/3905427257 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f31540328d0 con 0x7f31641056f0 2024-09-13T17:04:28.545 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.853+0000 7f3162ffd640 1 -- 172.21.15.87:0/3905427257 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f31540308a0 con 0x7f31641056f0 2024-09-13T17:04:28.545 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.854+0000 7f3169fd4640 1 -- 172.21.15.87:0/3905427257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31641056f0 msgr2=0x7f3164105af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:28.545 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.854+0000 7f3169fd4640 1 --2- 172.21.15.87:0/3905427257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31641056f0 0x7f3164105af0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3154009820 tx=0x7f315402a270 comp rx=0 tx=0).stop 2024-09-13T17:04:28.546 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.854+0000 7f3169fd4640 1 -- 172.21.15.87:0/3905427257 shutdown_connections 2024-09-13T17:04:28.546 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.854+0000 7f3169fd4640 1 --2- 172.21.15.87:0/3905427257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31641056f0 0x7f3164105af0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:28.546 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.854+0000 7f3169fd4640 1 -- 172.21.15.87:0/3905427257 >> 172.21.15.87:0/3905427257 conn(0x7f3164100f40 msgr2=0x7f3164103360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:28.546 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.854+0000 7f3169fd4640 1 -- 172.21.15.87:0/3905427257 shutdown_connections 2024-09-13T17:04:28.546 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.854+0000 7f3169fd4640 1 -- 172.21.15.87:0/3905427257 wait complete. 2024-09-13T17:04:28.546 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.855+0000 7f3169fd4640 1 Processor -- start 2024-09-13T17:04:28.546 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.855+0000 7f3169fd4640 1 -- start start 2024-09-13T17:04:28.546 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.855+0000 7f3169fd4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31641056f0 0x7f31641993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:28.546 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.855+0000 7f3169fd4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3164199930 con 0x7f31641056f0 2024-09-13T17:04:28.546 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.855+0000 7f31637fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31641056f0 0x7f31641993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:28.546 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.855+0000 7f31637fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31641056f0 0x7f31641993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51358/0 (socket says 172.21.15.87:51358) 2024-09-13T17:04:28.546 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.855+0000 7f31637fe640 1 -- 172.21.15.87:0/1696312929 learned_addr learned my addr 172.21.15.87:0/1696312929 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:28.546 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.855+0000 7f31637fe640 1 -- 172.21.15.87:0/1696312929 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31540094d0 con 0x7f31641056f0 2024-09-13T17:04:28.546 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.855+0000 7f31637fe640 1 --2- 172.21.15.87:0/1696312929 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31641056f0 0x7f31641993f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f315402a790 tx=0x7f3154030d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:28.547 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.855+0000 7f31617fa640 1 -- 172.21.15.87:0/1696312929 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3154032d80 con 0x7f31641056f0 2024-09-13T17:04:28.547 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.855+0000 7f31617fa640 1 -- 172.21.15.87:0/1696312929 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f315403b8c0 con 0x7f31641056f0 2024-09-13T17:04:28.547 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.856+0000 7f3169fd4640 1 -- 172.21.15.87:0/1696312929 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3164199b30 con 0x7f31641056f0 2024-09-13T17:04:28.547 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.856+0000 7f31617fa640 1 -- 172.21.15.87:0/1696312929 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f315403a6e0 con 0x7f31641056f0 2024-09-13T17:04:28.547 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.856+0000 7f3169fd4640 1 -- 172.21.15.87:0/1696312929 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3164199fd0 con 0x7f31641056f0 2024-09-13T17:04:28.547 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.856+0000 7f31617fa640 1 -- 172.21.15.87:0/1696312929 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f3154039040 con 0x7f31641056f0 2024-09-13T17:04:28.547 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.857+0000 7f31617fa640 1 --2- 172.21.15.87:0/1696312929 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f3150038620 0x7f315003aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:28.547 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.857+0000 7f31617fa640 1 -- 172.21.15.87:0/1696312929 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f315406b6b0 con 0x7f31641056f0 2024-09-13T17:04:28.547 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.857+0000 7f315bfff640 1 --2- 172.21.15.87:0/1696312929 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f3150038620 0x7f315003aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:28.547 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.857+0000 7f3169fd4640 1 -- 172.21.15.87:0/1696312929 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3164105b70 con 0x7f31641056f0 2024-09-13T17:04:28.547 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.857+0000 7f315bfff640 1 --2- 172.21.15.87:0/1696312929 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f3150038620 0x7f315003aae0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f314c0098c0 tx=0x7f314c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:28.547 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:27.862+0000 7f31617fa640 1 -- 172.21.15.87:0/1696312929 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3154037080 con 0x7f31641056f0 2024-09-13T17:04:28.547 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.037+0000 7f3169fd4640 1 -- 172.21.15.87:0/1696312929 --> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f31641021f0 con 0x7f3150038620 2024-09-13T17:04:28.548 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.045+0000 7f31617fa640 1 -- 172.21.15.87:0/1696312929 <== mgr.14118 v2:172.21.15.87:6800/4144176457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f31641021f0 con 0x7f3150038620 2024-09-13T17:04:28.548 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.048+0000 7f3169fd4640 1 -- 172.21.15.87:0/1696312929 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f3150038620 msgr2=0x7f315003aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:28.548 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.048+0000 7f3169fd4640 1 --2- 172.21.15.87:0/1696312929 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f3150038620 0x7f315003aae0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f314c0098c0 tx=0x7f314c006db0 comp rx=0 tx=0).stop 2024-09-13T17:04:28.548 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.048+0000 7f3169fd4640 1 -- 172.21.15.87:0/1696312929 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31641056f0 msgr2=0x7f31641993f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:28.548 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.048+0000 7f3169fd4640 1 --2- 172.21.15.87:0/1696312929 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31641056f0 0x7f31641993f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f315402a790 tx=0x7f3154030d90 comp rx=0 tx=0).stop 2024-09-13T17:04:28.548 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.048+0000 7f3169fd4640 1 -- 172.21.15.87:0/1696312929 shutdown_connections 2024-09-13T17:04:28.548 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.048+0000 7f3169fd4640 1 --2- 172.21.15.87:0/1696312929 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f3150038620 0x7f315003aae0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:28.548 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.048+0000 7f3169fd4640 1 --2- 172.21.15.87:0/1696312929 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31641056f0 0x7f31641993f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:28.548 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.048+0000 7f3169fd4640 1 -- 172.21.15.87:0/1696312929 >> 172.21.15.87:0/1696312929 conn(0x7f3164100f40 msgr2=0x7f3164101ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:28.548 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.048+0000 7f3169fd4640 1 -- 172.21.15.87:0/1696312929 shutdown_connections 2024-09-13T17:04:28.548 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.048+0000 7f3169fd4640 1 -- 172.21.15.87:0/1696312929 wait complete. 2024-09-13T17:04:29.228 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:29 smithi087 ceph-mon[30934]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:04:29.683 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-13T17:04:29.683 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.924+0000 7f4601768640 1 Processor -- start 2024-09-13T17:04:29.683 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.924+0000 7f4601768640 1 -- start start 2024-09-13T17:04:29.684 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.924+0000 7f4601768640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45fc105b90 0x7f45fc105f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:29.684 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.924+0000 7f4601768640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc106560 con 0x7f45fc105b90 2024-09-13T17:04:29.684 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.924+0000 7f45faffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45fc105b90 0x7f45fc105f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:29.684 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.924+0000 7f45faffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45fc105b90 0x7f45fc105f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51374/0 (socket says 172.21.15.87:51374) 2024-09-13T17:04:29.684 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.924+0000 7f45faffd640 1 -- 172.21.15.87:0/4163481977 learned_addr learned my addr 172.21.15.87:0/4163481977 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:29.684 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.924+0000 7f45faffd640 1 -- 172.21.15.87:0/4163481977 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45fc1047f0 con 0x7f45fc105b90 2024-09-13T17:04:29.684 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.925+0000 7f45faffd640 1 --2- 172.21.15.87:0/4163481977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45fc105b90 0x7f45fc105f90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f45ec009820 tx=0x7f45ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bde06538b6be30e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:29.684 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.925+0000 7f45fa7fc640 1 -- 172.21.15.87:0/4163481977 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45ec02ae70 con 0x7f45fc105b90 2024-09-13T17:04:29.684 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.925+0000 7f45fa7fc640 1 -- 172.21.15.87:0/4163481977 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f45ec0328d0 con 0x7f45fc105b90 2024-09-13T17:04:29.684 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.925+0000 7f45fa7fc640 1 -- 172.21.15.87:0/4163481977 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45ec0308a0 con 0x7f45fc105b90 2024-09-13T17:04:29.684 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.926+0000 7f4601768640 1 -- 172.21.15.87:0/4163481977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45fc105b90 msgr2=0x7f45fc105f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:29.684 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.926+0000 7f4601768640 1 --2- 172.21.15.87:0/4163481977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45fc105b90 0x7f45fc105f90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f45ec009820 tx=0x7f45ec02a270 comp rx=0 tx=0).stop 2024-09-13T17:04:29.685 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.926+0000 7f4601768640 1 -- 172.21.15.87:0/4163481977 shutdown_connections 2024-09-13T17:04:29.685 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.926+0000 7f4601768640 1 --2- 172.21.15.87:0/4163481977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45fc105b90 0x7f45fc105f90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:29.685 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.926+0000 7f4601768640 1 -- 172.21.15.87:0/4163481977 >> 172.21.15.87:0/4163481977 conn(0x7f45fc0ff510 msgr2=0x7f45fc101930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:29.685 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.926+0000 7f4601768640 1 -- 172.21.15.87:0/4163481977 shutdown_connections 2024-09-13T17:04:29.685 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.926+0000 7f4601768640 1 -- 172.21.15.87:0/4163481977 wait complete. 2024-09-13T17:04:29.685 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.927+0000 7f4601768640 1 Processor -- start 2024-09-13T17:04:29.685 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.927+0000 7f4601768640 1 -- start start 2024-09-13T17:04:29.685 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.927+0000 7f4601768640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45fc105b90 0x7f45fc104160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:29.685 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.927+0000 7f4601768640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc1046a0 con 0x7f45fc105b90 2024-09-13T17:04:29.685 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.927+0000 7f45faffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45fc105b90 0x7f45fc104160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:29.685 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.927+0000 7f45faffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45fc105b90 0x7f45fc104160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51390/0 (socket says 172.21.15.87:51390) 2024-09-13T17:04:29.685 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.927+0000 7f45faffd640 1 -- 172.21.15.87:0/896537822 learned_addr learned my addr 172.21.15.87:0/896537822 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:29.686 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.927+0000 7f45faffd640 1 -- 172.21.15.87:0/896537822 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ec0094d0 con 0x7f45fc105b90 2024-09-13T17:04:29.686 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.927+0000 7f45faffd640 1 --2- 172.21.15.87:0/896537822 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45fc105b90 0x7f45fc104160 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f45ec006f10 tx=0x7f45ec032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:29.686 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.928+0000 7f45f8ff9640 1 -- 172.21.15.87:0/896537822 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45ec032d80 con 0x7f45fc105b90 2024-09-13T17:04:29.686 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.928+0000 7f45f8ff9640 1 -- 172.21.15.87:0/896537822 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f45ec03b8c0 con 0x7f45fc105b90 2024-09-13T17:04:29.686 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.928+0000 7f4601768640 1 -- 172.21.15.87:0/896537822 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45fc105670 con 0x7f45fc105b90 2024-09-13T17:04:29.686 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.928+0000 7f45f8ff9640 1 -- 172.21.15.87:0/896537822 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45ec03a5a0 con 0x7f45fc105b90 2024-09-13T17:04:29.686 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.928+0000 7f4601768640 1 -- 172.21.15.87:0/896537822 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45fc19c5f0 con 0x7f45fc105b90 2024-09-13T17:04:29.686 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.928+0000 7f45f8ff9640 1 -- 172.21.15.87:0/896537822 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f45ec039040 con 0x7f45fc105b90 2024-09-13T17:04:29.686 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.929+0000 7f45f8ff9640 1 --2- 172.21.15.87:0/896537822 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f45e8038670 0x7f45e803ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:29.686 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.929+0000 7f4601768640 1 -- 172.21.15.87:0/896537822 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45fc108a30 con 0x7f45fc105b90 2024-09-13T17:04:29.686 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.929+0000 7f45f8ff9640 1 -- 172.21.15.87:0/896537822 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f45ec06b980 con 0x7f45fc105b90 2024-09-13T17:04:29.686 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.929+0000 7f45f27fc640 1 --2- 172.21.15.87:0/896537822 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f45e8038670 0x7f45e803ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:29.686 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.929+0000 7f45f27fc640 1 --2- 172.21.15.87:0/896537822 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f45e8038670 0x7f45e803ab30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f45e40098c0 tx=0x7f45e4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:29.687 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:28.933+0000 7f45f8ff9640 1 -- 172.21.15.87:0/896537822 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f45ec09be20 con 0x7f45fc105b90 2024-09-13T17:04:29.687 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:29.094+0000 7f4601768640 1 -- 172.21.15.87:0/896537822 --> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f45fc1007c0 con 0x7f45e8038670 2024-09-13T17:04:29.687 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:29.095+0000 7f45f8ff9640 1 -- 172.21.15.87:0/896537822 <== mgr.14118 v2:172.21.15.87:6800/4144176457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f45fc1007c0 con 0x7f45e8038670 2024-09-13T17:04:29.687 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:29.097+0000 7f4601768640 1 -- 172.21.15.87:0/896537822 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f45e8038670 msgr2=0x7f45e803ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:29.687 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:29.097+0000 7f4601768640 1 --2- 172.21.15.87:0/896537822 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f45e8038670 0x7f45e803ab30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f45e40098c0 tx=0x7f45e4006db0 comp rx=0 tx=0).stop 2024-09-13T17:04:29.687 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:29.097+0000 7f4601768640 1 -- 172.21.15.87:0/896537822 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45fc105b90 msgr2=0x7f45fc104160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:29.687 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:29.097+0000 7f4601768640 1 --2- 172.21.15.87:0/896537822 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45fc105b90 0x7f45fc104160 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f45ec006f10 tx=0x7f45ec032670 comp rx=0 tx=0).stop 2024-09-13T17:04:29.687 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:29.097+0000 7f4601768640 1 -- 172.21.15.87:0/896537822 shutdown_connections 2024-09-13T17:04:29.687 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:29.097+0000 7f4601768640 1 --2- 172.21.15.87:0/896537822 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f45e8038670 0x7f45e803ab30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:29.687 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:29.097+0000 7f4601768640 1 --2- 172.21.15.87:0/896537822 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45fc105b90 0x7f45fc104160 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:29.687 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:29.097+0000 7f4601768640 1 -- 172.21.15.87:0/896537822 >> 172.21.15.87:0/896537822 conn(0x7f45fc0ff510 msgr2=0x7f45fc1000b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:29.687 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:29.098+0000 7f4601768640 1 -- 172.21.15.87:0/896537822 shutdown_connections 2024-09-13T17:04:29.687 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:29.098+0000 7f4601768640 1 -- 172.21.15.87:0/896537822 wait complete. 2024-09-13T17:04:29.688 INFO:teuthology.orchestra.run.smithi087.stdout:Generating ssh key... 2024-09-13T17:04:30.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:30 smithi087 ceph-mon[30934]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:04:30.824 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:30 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: Generating public/private rsa key pair. 2024-09-13T17:04:30.824 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:30 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: Your identification has been saved in /tmp/tmpxvqu8m2c/key 2024-09-13T17:04:30.824 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:30 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: Your public key has been saved in /tmp/tmpxvqu8m2c/key.pub 2024-09-13T17:04:30.824 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:30 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: The key fingerprint is: 2024-09-13T17:04:30.825 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:30 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: SHA256:19MZtxio2LmA6zLQvO+pu8B/jk9PvzSYWOkhSyl4T0g ceph-043d5bae-71f2-11ef-bceb-c7b262605968 2024-09-13T17:04:30.825 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:30 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: The key's randomart image is: 2024-09-13T17:04:30.825 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:30 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: +---[RSA 3072]----+ 2024-09-13T17:04:30.825 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:30 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: | | 2024-09-13T17:04:30.825 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:30 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: | . | 2024-09-13T17:04:30.825 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:30 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: | E . .. .| 2024-09-13T17:04:30.825 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:30 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: | o . o + o. .o+.| 2024-09-13T17:04:30.825 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:30 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: | .o+ * *S+. o.o. | 2024-09-13T17:04:30.825 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:30 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: |...o= B =.. . | 2024-09-13T17:04:30.825 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:30 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: | o. .* = + | 2024-09-13T17:04:30.825 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:30 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: | o++.+ o . | 2024-09-13T17:04:30.825 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:30 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: | *%B . o. | 2024-09-13T17:04:30.825 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:30 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: +----[SHA256]-----+ 2024-09-13T17:04:31.132 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.084+0000 7fdd7ef66640 1 Processor -- start 2024-09-13T17:04:31.132 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.084+0000 7fdd7ef66640 1 -- start start 2024-09-13T17:04:31.132 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.084+0000 7fdd7ef66640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd781056f0 0x7fdd78105af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:31.132 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.084+0000 7fdd7ef66640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd781060c0 con 0x7fdd781056f0 2024-09-13T17:04:31.132 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.084+0000 7fdd7cd02640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd781056f0 0x7fdd78105af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:31.132 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.084+0000 7fdd7cd02640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd781056f0 0x7fdd78105af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38670/0 (socket says 172.21.15.87:38670) 2024-09-13T17:04:31.133 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.084+0000 7fdd7cd02640 1 -- 172.21.15.87:0/467734105 learned_addr learned my addr 172.21.15.87:0/467734105 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:31.133 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.085+0000 7fdd7cd02640 1 -- 172.21.15.87:0/467734105 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd781068a0 con 0x7fdd781056f0 2024-09-13T17:04:31.133 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.085+0000 7fdd7cd02640 1 --2- 172.21.15.87:0/467734105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd781056f0 0x7fdd78105af0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c009820 tx=0x7fdd6c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86fe95dacc4876ac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:31.133 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.086+0000 7fdd777fe640 1 -- 172.21.15.87:0/467734105 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd6c02ae70 con 0x7fdd781056f0 2024-09-13T17:04:31.133 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.086+0000 7fdd777fe640 1 -- 172.21.15.87:0/467734105 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdd6c0328d0 con 0x7fdd781056f0 2024-09-13T17:04:31.133 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.086+0000 7fdd777fe640 1 -- 172.21.15.87:0/467734105 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd6c0308a0 con 0x7fdd781056f0 2024-09-13T17:04:31.133 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.086+0000 7fdd7ef66640 1 -- 172.21.15.87:0/467734105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd781056f0 msgr2=0x7fdd78105af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:31.133 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.086+0000 7fdd7ef66640 1 --2- 172.21.15.87:0/467734105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd781056f0 0x7fdd78105af0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c009820 tx=0x7fdd6c02a270 comp rx=0 tx=0).stop 2024-09-13T17:04:31.133 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.086+0000 7fdd7ef66640 1 -- 172.21.15.87:0/467734105 shutdown_connections 2024-09-13T17:04:31.133 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.086+0000 7fdd7ef66640 1 --2- 172.21.15.87:0/467734105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd781056f0 0x7fdd78105af0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:31.133 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.086+0000 7fdd7ef66640 1 -- 172.21.15.87:0/467734105 >> 172.21.15.87:0/467734105 conn(0x7fdd78100f40 msgr2=0x7fdd78103360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:31.133 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.086+0000 7fdd7ef66640 1 -- 172.21.15.87:0/467734105 shutdown_connections 2024-09-13T17:04:31.133 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.086+0000 7fdd7ef66640 1 -- 172.21.15.87:0/467734105 wait complete. 2024-09-13T17:04:31.134 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.087+0000 7fdd7ef66640 1 Processor -- start 2024-09-13T17:04:31.134 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.087+0000 7fdd7ef66640 1 -- start start 2024-09-13T17:04:31.134 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.087+0000 7fdd7ef66640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd781056f0 0x7fdd781993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:31.134 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.087+0000 7fdd7ef66640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd78199930 con 0x7fdd781056f0 2024-09-13T17:04:31.134 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.087+0000 7fdd7cd02640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd781056f0 0x7fdd781993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:31.134 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.087+0000 7fdd7cd02640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd781056f0 0x7fdd781993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38674/0 (socket says 172.21.15.87:38674) 2024-09-13T17:04:31.134 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.087+0000 7fdd7cd02640 1 -- 172.21.15.87:0/3910338474 learned_addr learned my addr 172.21.15.87:0/3910338474 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:31.134 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.087+0000 7fdd7cd02640 1 -- 172.21.15.87:0/3910338474 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd6c0094d0 con 0x7fdd781056f0 2024-09-13T17:04:31.134 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.088+0000 7fdd7cd02640 1 --2- 172.21.15.87:0/3910338474 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd781056f0 0x7fdd781993f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c02a790 tx=0x7fdd6c030d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:31.134 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.088+0000 7fdd75ffb640 1 -- 172.21.15.87:0/3910338474 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd6c032d80 con 0x7fdd781056f0 2024-09-13T17:04:31.134 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.088+0000 7fdd75ffb640 1 -- 172.21.15.87:0/3910338474 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdd6c03b8c0 con 0x7fdd781056f0 2024-09-13T17:04:31.134 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.088+0000 7fdd7ef66640 1 -- 172.21.15.87:0/3910338474 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd78199b30 con 0x7fdd781056f0 2024-09-13T17:04:31.134 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.088+0000 7fdd75ffb640 1 -- 172.21.15.87:0/3910338474 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd6c03a6e0 con 0x7fdd781056f0 2024-09-13T17:04:31.134 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.088+0000 7fdd7ef66640 1 -- 172.21.15.87:0/3910338474 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd78199fd0 con 0x7fdd781056f0 2024-09-13T17:04:31.135 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.089+0000 7fdd75ffb640 1 -- 172.21.15.87:0/3910338474 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fdd6c039040 con 0x7fdd781056f0 2024-09-13T17:04:31.135 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.089+0000 7fdd7ef66640 1 -- 172.21.15.87:0/3910338474 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd78109ad0 con 0x7fdd781056f0 2024-09-13T17:04:31.135 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.089+0000 7fdd75ffb640 1 --2- 172.21.15.87:0/3910338474 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7fdd68038620 0x7fdd6803aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:31.135 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.089+0000 7fdd75ffb640 1 -- 172.21.15.87:0/3910338474 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fdd6c06b710 con 0x7fdd781056f0 2024-09-13T17:04:31.135 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.089+0000 7fdd77fff640 1 --2- 172.21.15.87:0/3910338474 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7fdd68038620 0x7fdd6803aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:31.135 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.090+0000 7fdd77fff640 1 --2- 172.21.15.87:0/3910338474 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7fdd68038620 0x7fdd6803aae0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdd640098c0 tx=0x7fdd64006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:31.135 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.094+0000 7fdd75ffb640 1 -- 172.21.15.87:0/3910338474 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdd6c04b4e0 con 0x7fdd781056f0 2024-09-13T17:04:31.135 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.260+0000 7fdd7ef66640 1 -- 172.21.15.87:0/3910338474 --> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd781021c0 con 0x7fdd68038620 2024-09-13T17:04:31.135 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.520+0000 7fdd75ffb640 1 -- 172.21.15.87:0/3910338474 <== mgr.14118 v2:172.21.15.87:6800/4144176457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fdd781021c0 con 0x7fdd68038620 2024-09-13T17:04:31.135 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.522+0000 7fdd7ef66640 1 -- 172.21.15.87:0/3910338474 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7fdd68038620 msgr2=0x7fdd6803aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:31.135 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.522+0000 7fdd7ef66640 1 --2- 172.21.15.87:0/3910338474 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7fdd68038620 0x7fdd6803aae0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdd640098c0 tx=0x7fdd64006db0 comp rx=0 tx=0).stop 2024-09-13T17:04:31.135 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.522+0000 7fdd7ef66640 1 -- 172.21.15.87:0/3910338474 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd781056f0 msgr2=0x7fdd781993f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:31.135 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.522+0000 7fdd7ef66640 1 --2- 172.21.15.87:0/3910338474 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd781056f0 0x7fdd781993f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c02a790 tx=0x7fdd6c030d90 comp rx=0 tx=0).stop 2024-09-13T17:04:31.135 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.522+0000 7fdd7ef66640 1 -- 172.21.15.87:0/3910338474 shutdown_connections 2024-09-13T17:04:31.136 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.522+0000 7fdd7ef66640 1 --2- 172.21.15.87:0/3910338474 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7fdd68038620 0x7fdd6803aae0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:31.136 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.522+0000 7fdd7ef66640 1 --2- 172.21.15.87:0/3910338474 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd781056f0 0x7fdd781993f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:31.136 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.522+0000 7fdd7ef66640 1 -- 172.21.15.87:0/3910338474 >> 172.21.15.87:0/3910338474 conn(0x7fdd78100f40 msgr2=0x7fdd78101ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:31.136 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.522+0000 7fdd7ef66640 1 -- 172.21.15.87:0/3910338474 shutdown_connections 2024-09-13T17:04:31.136 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:30.522+0000 7fdd7ef66640 1 -- 172.21.15.87:0/3910338474 wait complete. 2024-09-13T17:04:31.427 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:31 smithi087 ceph-mon[30934]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:04:31.427 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:31 smithi087 ceph-mon[30934]: Generating ssh key... 2024-09-13T17:04:31.427 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:31 smithi087 ceph-mon[30934]: from='mgr.14118 172.21.15.87:0/296842519' entity='mgr.x' 2024-09-13T17:04:31.427 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:31 smithi087 ceph-mon[30934]: from='mgr.14118 172.21.15.87:0/296842519' entity='mgr.x' 2024-09-13T17:04:32.272 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD5I1q8ufKZkvmR2eNk52XeTWiNf0avzcdVSYYjZSc9IWdiC2jA46Q8S5St34oyKtOMJJiuk3pCeQTKU1iV88yYkFlRzs8pMTVB2mO3YuLjWXCrbjdOuQ/RyxnJw5wBbdbFgH2bmmkU0ea90ALM4nJbtw4nfmL5mKXQ3FhyllHPYArm+uT8LuFr95yfiepuYcyQsa4b2HjDsFAA/R7tXty2kYr4iCfc+xpkzRMzsOivmry3sXPAj87K2fvDZ+r5PulqsQ3TFy+3ZO8n3/8P52hJNnvOEwiRFuaFTDW0hM6Wcl82HuKb9FufjuM6mHodtcQ+1wAvrVBxknGIBZtS9wiYPc0TOX0NqfMePPJGCZD6zWKebTmXHO44JRZmeoZyMSgy/3oMmLBudmEduhdR1Mog4UL7b2+YjwPSGFTt2AK6qza7+FmwPHqRry/YwcpLxBQSN5EGBNOIR6XVEdeqGx6oyjhnO6YUNWSURHPli/uo4wdIjKi3XfaN24WicUCA4qM= ceph-043d5bae-71f2-11ef-bceb-c7b262605968 2024-09-13T17:04:32.272 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.501+0000 7fe25bfa5640 1 Processor -- start 2024-09-13T17:04:32.272 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.501+0000 7fe25bfa5640 1 -- start start 2024-09-13T17:04:32.272 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.502+0000 7fe25bfa5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2541045d0 0x7fe2541049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:32.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.502+0000 7fe25bfa5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe254104fa0 con 0x7fe2541045d0 2024-09-13T17:04:32.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.502+0000 7fe259d41640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2541045d0 0x7fe2541049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:32.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.502+0000 7fe259d41640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2541045d0 0x7fe2541049d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38678/0 (socket says 172.21.15.87:38678) 2024-09-13T17:04:32.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.502+0000 7fe259d41640 1 -- 172.21.15.87:0/3532814805 learned_addr learned my addr 172.21.15.87:0/3532814805 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:32.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.502+0000 7fe259d41640 1 -- 172.21.15.87:0/3532814805 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe254105780 con 0x7fe2541045d0 2024-09-13T17:04:32.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.503+0000 7fe259d41640 1 --2- 172.21.15.87:0/3532814805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2541045d0 0x7fe2541049d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe250009820 tx=0x7fe25002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98bf0ea1ebf2356 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:32.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.503+0000 7fe258d3f640 1 -- 172.21.15.87:0/3532814805 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe25002ae70 con 0x7fe2541045d0 2024-09-13T17:04:32.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.503+0000 7fe258d3f640 1 -- 172.21.15.87:0/3532814805 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe2500328d0 con 0x7fe2541045d0 2024-09-13T17:04:32.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.503+0000 7fe258d3f640 1 -- 172.21.15.87:0/3532814805 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2500308a0 con 0x7fe2541045d0 2024-09-13T17:04:32.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.503+0000 7fe25bfa5640 1 -- 172.21.15.87:0/3532814805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2541045d0 msgr2=0x7fe2541049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:32.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.503+0000 7fe25bfa5640 1 --2- 172.21.15.87:0/3532814805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2541045d0 0x7fe2541049d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe250009820 tx=0x7fe25002a270 comp rx=0 tx=0).stop 2024-09-13T17:04:32.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.503+0000 7fe25bfa5640 1 -- 172.21.15.87:0/3532814805 shutdown_connections 2024-09-13T17:04:32.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.503+0000 7fe25bfa5640 1 --2- 172.21.15.87:0/3532814805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2541045d0 0x7fe2541049d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:32.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.503+0000 7fe25bfa5640 1 -- 172.21.15.87:0/3532814805 >> 172.21.15.87:0/3532814805 conn(0x7fe2540ffda0 msgr2=0x7fe2541021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:32.274 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.504+0000 7fe25bfa5640 1 -- 172.21.15.87:0/3532814805 shutdown_connections 2024-09-13T17:04:32.274 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.504+0000 7fe25bfa5640 1 -- 172.21.15.87:0/3532814805 wait complete. 2024-09-13T17:04:32.274 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.504+0000 7fe25bfa5640 1 Processor -- start 2024-09-13T17:04:32.274 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.504+0000 7fe25bfa5640 1 -- start start 2024-09-13T17:04:32.274 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.504+0000 7fe25bfa5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2541045d0 0x7fe254199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:32.274 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.504+0000 7fe25bfa5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2541999a0 con 0x7fe2541045d0 2024-09-13T17:04:32.274 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.504+0000 7fe259d41640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2541045d0 0x7fe254199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:32.274 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.504+0000 7fe259d41640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2541045d0 0x7fe254199460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38690/0 (socket says 172.21.15.87:38690) 2024-09-13T17:04:32.274 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.504+0000 7fe259d41640 1 -- 172.21.15.87:0/3550496241 learned_addr learned my addr 172.21.15.87:0/3550496241 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:32.274 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.505+0000 7fe259d41640 1 -- 172.21.15.87:0/3550496241 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2500094d0 con 0x7fe2541045d0 2024-09-13T17:04:32.274 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.505+0000 7fe259d41640 1 --2- 172.21.15.87:0/3550496241 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2541045d0 0x7fe254199460 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe25002a790 tx=0x7fe250030d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:32.274 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.505+0000 7fe24affd640 1 -- 172.21.15.87:0/3550496241 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe250032d80 con 0x7fe2541045d0 2024-09-13T17:04:32.275 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.505+0000 7fe24affd640 1 -- 172.21.15.87:0/3550496241 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe25003b8c0 con 0x7fe2541045d0 2024-09-13T17:04:32.275 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.505+0000 7fe25bfa5640 1 -- 172.21.15.87:0/3550496241 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe254199ba0 con 0x7fe2541045d0 2024-09-13T17:04:32.275 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.505+0000 7fe24affd640 1 -- 172.21.15.87:0/3550496241 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe25003a500 con 0x7fe2541045d0 2024-09-13T17:04:32.275 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.505+0000 7fe25bfa5640 1 -- 172.21.15.87:0/3550496241 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe25419a040 con 0x7fe2541045d0 2024-09-13T17:04:32.275 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.506+0000 7fe24affd640 1 -- 172.21.15.87:0/3550496241 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fe250039040 con 0x7fe2541045d0 2024-09-13T17:04:32.275 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.506+0000 7fe25bfa5640 1 -- 172.21.15.87:0/3550496241 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2541089b0 con 0x7fe2541045d0 2024-09-13T17:04:32.275 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.506+0000 7fe24affd640 1 --2- 172.21.15.87:0/3550496241 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7fe240038620 0x7fe24003aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:32.275 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.506+0000 7fe24affd640 1 -- 172.21.15.87:0/3550496241 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe25006b620 con 0x7fe2541045d0 2024-09-13T17:04:32.275 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.506+0000 7fe259540640 1 --2- 172.21.15.87:0/3550496241 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7fe240038620 0x7fe24003aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:32.275 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.507+0000 7fe259540640 1 --2- 172.21.15.87:0/3550496241 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7fe240038620 0x7fe24003aae0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe2440098c0 tx=0x7fe244006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:32.275 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.510+0000 7fe24affd640 1 -- 172.21.15.87:0/3550496241 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe25004b300 con 0x7fe2541045d0 2024-09-13T17:04:32.275 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.672+0000 7fe25bfa5640 1 -- 172.21.15.87:0/3550496241 --> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fe2541010d0 con 0x7fe240038620 2024-09-13T17:04:32.275 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.673+0000 7fe24affd640 1 -- 172.21.15.87:0/3550496241 <== mgr.14118 v2:172.21.15.87:6800/4144176457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fe2541010d0 con 0x7fe240038620 2024-09-13T17:04:32.276 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.675+0000 7fe25bfa5640 1 -- 172.21.15.87:0/3550496241 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7fe240038620 msgr2=0x7fe24003aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:32.276 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.675+0000 7fe25bfa5640 1 --2- 172.21.15.87:0/3550496241 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7fe240038620 0x7fe24003aae0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe2440098c0 tx=0x7fe244006db0 comp rx=0 tx=0).stop 2024-09-13T17:04:32.276 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.675+0000 7fe25bfa5640 1 -- 172.21.15.87:0/3550496241 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2541045d0 msgr2=0x7fe254199460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:32.276 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.675+0000 7fe25bfa5640 1 --2- 172.21.15.87:0/3550496241 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2541045d0 0x7fe254199460 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe25002a790 tx=0x7fe250030d90 comp rx=0 tx=0).stop 2024-09-13T17:04:32.276 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.675+0000 7fe25bfa5640 1 -- 172.21.15.87:0/3550496241 shutdown_connections 2024-09-13T17:04:32.276 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.675+0000 7fe25bfa5640 1 --2- 172.21.15.87:0/3550496241 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7fe240038620 0x7fe24003aae0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:32.276 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.675+0000 7fe25bfa5640 1 --2- 172.21.15.87:0/3550496241 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2541045d0 0x7fe254199460 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:32.276 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.675+0000 7fe25bfa5640 1 -- 172.21.15.87:0/3550496241 >> 172.21.15.87:0/3550496241 conn(0x7fe2540ffda0 msgr2=0x7fe2541009c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:32.276 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.675+0000 7fe25bfa5640 1 -- 172.21.15.87:0/3550496241 shutdown_connections 2024-09-13T17:04:32.276 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:31.675+0000 7fe25bfa5640 1 -- 172.21.15.87:0/3550496241 wait complete. 2024-09-13T17:04:32.276 INFO:teuthology.orchestra.run.smithi087.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-13T17:04:32.276 INFO:teuthology.orchestra.run.smithi087.stdout:Adding key to root@localhost authorized_keys... 2024-09-13T17:04:32.277 INFO:teuthology.orchestra.run.smithi087.stdout:Adding host smithi087... 2024-09-13T17:04:32.592 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:32 smithi087 ceph-mon[30934]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:04:33.642 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:33 smithi087 ceph-mon[30934]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi087", "addr": "172.21.15.87", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:04:34.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:34 smithi087 ceph-mon[30934]: Deploying cephadm binary to smithi087 2024-09-13T17:04:35.980 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout Added host 'smithi087' with addr '172.21.15.87' 2024-09-13T17:04:35.980 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.678+0000 7fd741848640 1 Processor -- start 2024-09-13T17:04:35.980 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.678+0000 7fd741848640 1 -- start start 2024-09-13T17:04:35.980 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.678+0000 7fd741848640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd73c1045b0 0x7fd73c1049b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:35.980 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.678+0000 7fd741848640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c104f80 con 0x7fd73c1045b0 2024-09-13T17:04:35.980 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.678+0000 7fd73affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd73c1045b0 0x7fd73c1049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:35.980 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.678+0000 7fd73affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd73c1045b0 0x7fd73c1049b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38704/0 (socket says 172.21.15.87:38704) 2024-09-13T17:04:35.980 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.678+0000 7fd73affd640 1 -- 172.21.15.87:0/985397485 learned_addr learned my addr 172.21.15.87:0/985397485 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:35.980 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.678+0000 7fd73affd640 1 -- 172.21.15.87:0/985397485 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd73c1057b0 con 0x7fd73c1045b0 2024-09-13T17:04:35.980 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.679+0000 7fd73affd640 1 --2- 172.21.15.87:0/985397485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd73c1045b0 0x7fd73c1049b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd72c009820 tx=0x7fd72c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c05e7dddf5d67a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:35.980 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.679+0000 7fd73a7fc640 1 -- 172.21.15.87:0/985397485 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd72c02ae70 con 0x7fd73c1045b0 2024-09-13T17:04:35.980 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.679+0000 7fd73a7fc640 1 -- 172.21.15.87:0/985397485 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd72c0328d0 con 0x7fd73c1045b0 2024-09-13T17:04:35.981 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.679+0000 7fd73a7fc640 1 -- 172.21.15.87:0/985397485 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd72c0308a0 con 0x7fd73c1045b0 2024-09-13T17:04:35.981 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.680+0000 7fd741848640 1 -- 172.21.15.87:0/985397485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd73c1045b0 msgr2=0x7fd73c1049b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:35.981 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.680+0000 7fd741848640 1 --2- 172.21.15.87:0/985397485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd73c1045b0 0x7fd73c1049b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd72c009820 tx=0x7fd72c02a270 comp rx=0 tx=0).stop 2024-09-13T17:04:35.981 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.680+0000 7fd741848640 1 -- 172.21.15.87:0/985397485 shutdown_connections 2024-09-13T17:04:35.981 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.680+0000 7fd741848640 1 --2- 172.21.15.87:0/985397485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd73c1045b0 0x7fd73c1049b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:35.981 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.680+0000 7fd741848640 1 -- 172.21.15.87:0/985397485 >> 172.21.15.87:0/985397485 conn(0x7fd73c0ffda0 msgr2=0x7fd73c1021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:35.981 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.680+0000 7fd741848640 1 -- 172.21.15.87:0/985397485 shutdown_connections 2024-09-13T17:04:35.981 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.680+0000 7fd741848640 1 -- 172.21.15.87:0/985397485 wait complete. 2024-09-13T17:04:35.981 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.681+0000 7fd741848640 1 Processor -- start 2024-09-13T17:04:35.981 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.681+0000 7fd741848640 1 -- start start 2024-09-13T17:04:35.981 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.681+0000 7fd741848640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd73c1045b0 0x7fd73c19b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:35.981 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.681+0000 7fd741848640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c19bb80 con 0x7fd73c1045b0 2024-09-13T17:04:35.981 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.681+0000 7fd73affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd73c1045b0 0x7fd73c19b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:35.982 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.681+0000 7fd73affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd73c1045b0 0x7fd73c19b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38718/0 (socket says 172.21.15.87:38718) 2024-09-13T17:04:35.982 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.681+0000 7fd73affd640 1 -- 172.21.15.87:0/1655312575 learned_addr learned my addr 172.21.15.87:0/1655312575 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:35.982 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.681+0000 7fd73affd640 1 -- 172.21.15.87:0/1655312575 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72c0094d0 con 0x7fd73c1045b0 2024-09-13T17:04:35.982 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.681+0000 7fd73affd640 1 --2- 172.21.15.87:0/1655312575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd73c1045b0 0x7fd73c19b640 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd72c006f10 tx=0x7fd72c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:35.982 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.682+0000 7fd740846640 1 -- 172.21.15.87:0/1655312575 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd72c032d80 con 0x7fd73c1045b0 2024-09-13T17:04:35.982 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.682+0000 7fd741848640 1 -- 172.21.15.87:0/1655312575 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd73c19bd80 con 0x7fd73c1045b0 2024-09-13T17:04:35.982 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.682+0000 7fd740846640 1 -- 172.21.15.87:0/1655312575 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd72c03b8c0 con 0x7fd73c1045b0 2024-09-13T17:04:35.982 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.682+0000 7fd740846640 1 -- 172.21.15.87:0/1655312575 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd72c03a5a0 con 0x7fd73c1045b0 2024-09-13T17:04:35.982 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.682+0000 7fd741848640 1 -- 172.21.15.87:0/1655312575 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd73c19c220 con 0x7fd73c1045b0 2024-09-13T17:04:35.982 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.683+0000 7fd740846640 1 -- 172.21.15.87:0/1655312575 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fd72c039040 con 0x7fd73c1045b0 2024-09-13T17:04:35.982 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.683+0000 7fd740846640 1 --2- 172.21.15.87:0/1655312575 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7fd728038670 0x7fd72803ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:35.982 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.683+0000 7fd740846640 1 -- 172.21.15.87:0/1655312575 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd72c06b850 con 0x7fd73c1045b0 2024-09-13T17:04:35.982 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.683+0000 7fd733fff640 1 --2- 172.21.15.87:0/1655312575 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7fd728038670 0x7fd72803ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:35.983 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.683+0000 7fd741848640 1 -- 172.21.15.87:0/1655312575 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd73c1049b0 con 0x7fd73c1045b0 2024-09-13T17:04:35.983 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.683+0000 7fd733fff640 1 --2- 172.21.15.87:0/1655312575 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7fd728038670 0x7fd72803ab30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd7240098c0 tx=0x7fd724006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:35.983 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.688+0000 7fd740846640 1 -- 172.21.15.87:0/1655312575 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd72c037080 con 0x7fd73c1045b0 2024-09-13T17:04:35.983 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:32.858+0000 7fd741848640 1 -- 172.21.15.87:0/1655312575 --> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi087", "addr": "172.21.15.87", "target": ["mon-mgr", ""]}) v1 -- 0x7fd73c02c480 con 0x7fd728038670 2024-09-13T17:04:35.983 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:35.447+0000 7fd740846640 1 -- 172.21.15.87:0/1655312575 <== mgr.14118 v2:172.21.15.87:6800/4144176457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fd73c02c480 con 0x7fd728038670 2024-09-13T17:04:35.983 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:35.451+0000 7fd741848640 1 -- 172.21.15.87:0/1655312575 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7fd728038670 msgr2=0x7fd72803ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:35.983 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:35.451+0000 7fd741848640 1 --2- 172.21.15.87:0/1655312575 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7fd728038670 0x7fd72803ab30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd7240098c0 tx=0x7fd724006db0 comp rx=0 tx=0).stop 2024-09-13T17:04:35.983 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:35.451+0000 7fd741848640 1 -- 172.21.15.87:0/1655312575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd73c1045b0 msgr2=0x7fd73c19b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:35.983 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:35.451+0000 7fd741848640 1 --2- 172.21.15.87:0/1655312575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd73c1045b0 0x7fd73c19b640 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd72c006f10 tx=0x7fd72c032670 comp rx=0 tx=0).stop 2024-09-13T17:04:35.983 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:35.451+0000 7fd741848640 1 -- 172.21.15.87:0/1655312575 shutdown_connections 2024-09-13T17:04:35.983 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:35.451+0000 7fd741848640 1 --2- 172.21.15.87:0/1655312575 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7fd728038670 0x7fd72803ab30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:35.983 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:35.451+0000 7fd741848640 1 --2- 172.21.15.87:0/1655312575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd73c1045b0 0x7fd73c19b640 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:35.983 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:35.451+0000 7fd741848640 1 -- 172.21.15.87:0/1655312575 >> 172.21.15.87:0/1655312575 conn(0x7fd73c0ffda0 msgr2=0x7fd73c100520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:35.983 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:35.451+0000 7fd741848640 1 -- 172.21.15.87:0/1655312575 shutdown_connections 2024-09-13T17:04:35.984 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:35.451+0000 7fd741848640 1 -- 172.21.15.87:0/1655312575 wait complete. 2024-09-13T17:04:35.984 INFO:teuthology.orchestra.run.smithi087.stdout:Deploying unmanaged mon service... 2024-09-13T17:04:36.626 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:36 smithi087 ceph-mon[30934]: from='mgr.14118 172.21.15.87:0/296842519' entity='mgr.x' 2024-09-13T17:04:36.626 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:36 smithi087 ceph-mon[30934]: Added host smithi087 2024-09-13T17:04:36.626 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:36 smithi087 ceph-mon[30934]: from='mgr.14118 172.21.15.87:0/296842519' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:04:37.550 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-13T17:04:37.550 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.370+0000 7f009b7f2640 1 Processor -- start 2024-09-13T17:04:37.550 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.370+0000 7f009b7f2640 1 -- start start 2024-09-13T17:04:37.550 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.371+0000 7f009b7f2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0094106120 0x7f0094108510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:37.550 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.371+0000 7f009b7f2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0094079de0 con 0x7f0094106120 2024-09-13T17:04:37.550 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.371+0000 7f009958e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0094106120 0x7f0094108510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:37.550 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.371+0000 7f009958e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0094106120 0x7f0094108510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38732/0 (socket says 172.21.15.87:38732) 2024-09-13T17:04:37.551 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.371+0000 7f009958e640 1 -- 172.21.15.87:0/4195539013 learned_addr learned my addr 172.21.15.87:0/4195539013 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:37.551 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.371+0000 7f009958e640 1 -- 172.21.15.87:0/4195539013 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0094108a50 con 0x7f0094106120 2024-09-13T17:04:37.551 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.372+0000 7f009958e640 1 --2- 172.21.15.87:0/4195539013 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0094106120 0x7f0094108510 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0090009820 tx=0x7f009002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f944adca34a27a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:37.551 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.372+0000 7f008bfff640 1 -- 172.21.15.87:0/4195539013 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f009002ae70 con 0x7f0094106120 2024-09-13T17:04:37.551 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.372+0000 7f008bfff640 1 -- 172.21.15.87:0/4195539013 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f00900328d0 con 0x7f0094106120 2024-09-13T17:04:37.551 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.372+0000 7f008bfff640 1 -- 172.21.15.87:0/4195539013 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00900308a0 con 0x7f0094106120 2024-09-13T17:04:37.551 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.372+0000 7f009b7f2640 1 -- 172.21.15.87:0/4195539013 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0094106120 msgr2=0x7f0094108510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:37.551 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.372+0000 7f009b7f2640 1 --2- 172.21.15.87:0/4195539013 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0094106120 0x7f0094108510 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0090009820 tx=0x7f009002a270 comp rx=0 tx=0).stop 2024-09-13T17:04:37.551 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.373+0000 7f009b7f2640 1 -- 172.21.15.87:0/4195539013 shutdown_connections 2024-09-13T17:04:37.551 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.373+0000 7f009b7f2640 1 --2- 172.21.15.87:0/4195539013 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0094106120 0x7f0094108510 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:37.551 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.373+0000 7f009b7f2640 1 -- 172.21.15.87:0/4195539013 >> 172.21.15.87:0/4195539013 conn(0x7f00940ffda0 msgr2=0x7f00941021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:37.552 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.373+0000 7f009b7f2640 1 -- 172.21.15.87:0/4195539013 shutdown_connections 2024-09-13T17:04:37.552 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.373+0000 7f009b7f2640 1 -- 172.21.15.87:0/4195539013 wait complete. 2024-09-13T17:04:37.552 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.373+0000 7f009b7f2640 1 Processor -- start 2024-09-13T17:04:37.552 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.373+0000 7f009b7f2640 1 -- start start 2024-09-13T17:04:37.552 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.374+0000 7f009b7f2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0094106120 0x7f00941993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:37.552 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.374+0000 7f009b7f2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0094199930 con 0x7f0094106120 2024-09-13T17:04:37.552 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.374+0000 7f009958e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0094106120 0x7f00941993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:37.552 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.374+0000 7f009958e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0094106120 0x7f00941993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38736/0 (socket says 172.21.15.87:38736) 2024-09-13T17:04:37.552 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.374+0000 7f009958e640 1 -- 172.21.15.87:0/785156255 learned_addr learned my addr 172.21.15.87:0/785156255 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:37.552 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.374+0000 7f009958e640 1 -- 172.21.15.87:0/785156255 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00900094d0 con 0x7f0094106120 2024-09-13T17:04:37.552 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.374+0000 7f009958e640 1 --2- 172.21.15.87:0/785156255 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0094106120 0x7f00941993f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0090006f10 tx=0x7f0090032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:37.553 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.374+0000 7f008a7fc640 1 -- 172.21.15.87:0/785156255 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0090032d80 con 0x7f0094106120 2024-09-13T17:04:37.553 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.374+0000 7f008a7fc640 1 -- 172.21.15.87:0/785156255 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f009003b8c0 con 0x7f0094106120 2024-09-13T17:04:37.553 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.374+0000 7f009b7f2640 1 -- 172.21.15.87:0/785156255 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0094199b30 con 0x7f0094106120 2024-09-13T17:04:37.553 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.374+0000 7f008a7fc640 1 -- 172.21.15.87:0/785156255 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f009003a5c0 con 0x7f0094106120 2024-09-13T17:04:37.553 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.374+0000 7f009b7f2640 1 -- 172.21.15.87:0/785156255 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0094199fd0 con 0x7f0094106120 2024-09-13T17:04:37.553 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.375+0000 7f008a7fc640 1 -- 172.21.15.87:0/785156255 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f0090039040 con 0x7f0094106120 2024-09-13T17:04:37.553 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.375+0000 7f009b7f2640 1 -- 172.21.15.87:0/785156255 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0094109870 con 0x7f0094106120 2024-09-13T17:04:37.553 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.375+0000 7f008a7fc640 1 --2- 172.21.15.87:0/785156255 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f0080038670 0x7f008003ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:37.553 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.375+0000 7f008a7fc640 1 -- 172.21.15.87:0/785156255 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f009006b850 con 0x7f0094106120 2024-09-13T17:04:37.554 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.376+0000 7f0098d8d640 1 --2- 172.21.15.87:0/785156255 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f0080038670 0x7f008003ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:37.554 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.376+0000 7f0098d8d640 1 --2- 172.21.15.87:0/785156255 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f0080038670 0x7f008003ab30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f00840098c0 tx=0x7f0084006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:37.554 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.380+0000 7f008a7fc640 1 -- 172.21.15.87:0/785156255 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f009004b710 con 0x7f0094106120 2024-09-13T17:04:37.554 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.570+0000 7f009b7f2640 1 -- 172.21.15.87:0/785156255 --> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f0094101120 con 0x7f0080038670 2024-09-13T17:04:37.554 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.575+0000 7f008a7fc640 1 -- 172.21.15.87:0/785156255 <== mgr.14118 v2:172.21.15.87:6800/4144176457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f0094101120 con 0x7f0080038670 2024-09-13T17:04:37.554 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.577+0000 7f009b7f2640 1 -- 172.21.15.87:0/785156255 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f0080038670 msgr2=0x7f008003ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:37.554 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.577+0000 7f009b7f2640 1 --2- 172.21.15.87:0/785156255 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f0080038670 0x7f008003ab30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f00840098c0 tx=0x7f0084006db0 comp rx=0 tx=0).stop 2024-09-13T17:04:37.554 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.577+0000 7f009b7f2640 1 -- 172.21.15.87:0/785156255 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0094106120 msgr2=0x7f00941993f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:37.554 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.577+0000 7f009b7f2640 1 --2- 172.21.15.87:0/785156255 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0094106120 0x7f00941993f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0090006f10 tx=0x7f0090032670 comp rx=0 tx=0).stop 2024-09-13T17:04:37.554 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.577+0000 7f009b7f2640 1 -- 172.21.15.87:0/785156255 shutdown_connections 2024-09-13T17:04:37.554 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.577+0000 7f009b7f2640 1 --2- 172.21.15.87:0/785156255 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f0080038670 0x7f008003ab30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:37.554 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.577+0000 7f009b7f2640 1 --2- 172.21.15.87:0/785156255 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0094106120 0x7f00941993f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:37.555 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.577+0000 7f009b7f2640 1 -- 172.21.15.87:0/785156255 >> 172.21.15.87:0/785156255 conn(0x7f00940ffda0 msgr2=0x7f0094100a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:37.555 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.577+0000 7f009b7f2640 1 -- 172.21.15.87:0/785156255 shutdown_connections 2024-09-13T17:04:37.555 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:36.577+0000 7f009b7f2640 1 -- 172.21.15.87:0/785156255 wait complete. 2024-09-13T17:04:37.555 INFO:teuthology.orchestra.run.smithi087.stdout:Deploying unmanaged mgr service... 2024-09-13T17:04:37.828 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:37 smithi087 ceph-mon[30934]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:04:37.828 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:37 smithi087 ceph-mon[30934]: Saving service mon spec with placement count:5 2024-09-13T17:04:37.828 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:37 smithi087 ceph-mon[30934]: from='mgr.14118 172.21.15.87:0/296842519' entity='mgr.x' 2024-09-13T17:04:38.917 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-13T17:04:38.917 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.905+0000 7f95d2110640 1 Processor -- start 2024-09-13T17:04:38.917 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.905+0000 7f95d2110640 1 -- start start 2024-09-13T17:04:38.917 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.905+0000 7f95d2110640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95cc103990 0x7f95cc103d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:38.917 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.905+0000 7f95d2110640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc104360 con 0x7f95cc103990 2024-09-13T17:04:38.917 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.905+0000 7f95cb7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95cc103990 0x7f95cc103d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:38.917 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.905+0000 7f95cb7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95cc103990 0x7f95cc103d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38742/0 (socket says 172.21.15.87:38742) 2024-09-13T17:04:38.917 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.905+0000 7f95cb7fe640 1 -- 172.21.15.87:0/2305898276 learned_addr learned my addr 172.21.15.87:0/2305898276 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:38.917 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.905+0000 7f95cb7fe640 1 -- 172.21.15.87:0/2305898276 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95cc1044a0 con 0x7f95cc103990 2024-09-13T17:04:38.917 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.906+0000 7f95cb7fe640 1 --2- 172.21.15.87:0/2305898276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95cc103990 0x7f95cc103d90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f95bc009820 tx=0x7f95bc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b8c56dca7064bec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:38.918 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.906+0000 7f95ca7fc640 1 -- 172.21.15.87:0/2305898276 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95bc02ae70 con 0x7f95cc103990 2024-09-13T17:04:38.918 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.906+0000 7f95ca7fc640 1 -- 172.21.15.87:0/2305898276 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f95bc0328d0 con 0x7f95cc103990 2024-09-13T17:04:38.918 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.906+0000 7f95ca7fc640 1 -- 172.21.15.87:0/2305898276 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95bc0308a0 con 0x7f95cc103990 2024-09-13T17:04:38.918 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.907+0000 7f95d2110640 1 -- 172.21.15.87:0/2305898276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95cc103990 msgr2=0x7f95cc103d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:38.918 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.907+0000 7f95d2110640 1 --2- 172.21.15.87:0/2305898276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95cc103990 0x7f95cc103d90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f95bc009820 tx=0x7f95bc02a270 comp rx=0 tx=0).stop 2024-09-13T17:04:38.918 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.907+0000 7f95d2110640 1 -- 172.21.15.87:0/2305898276 shutdown_connections 2024-09-13T17:04:38.918 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.907+0000 7f95d2110640 1 --2- 172.21.15.87:0/2305898276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95cc103990 0x7f95cc103d90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:38.918 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.907+0000 7f95d2110640 1 -- 172.21.15.87:0/2305898276 >> 172.21.15.87:0/2305898276 conn(0x7f95cc0ff4e0 msgr2=0x7f95cc101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:38.918 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.907+0000 7f95d2110640 1 -- 172.21.15.87:0/2305898276 shutdown_connections 2024-09-13T17:04:38.918 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.907+0000 7f95d2110640 1 -- 172.21.15.87:0/2305898276 wait complete. 2024-09-13T17:04:38.918 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.908+0000 7f95d2110640 1 Processor -- start 2024-09-13T17:04:38.918 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.908+0000 7f95d2110640 1 -- start start 2024-09-13T17:04:38.919 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.908+0000 7f95d2110640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95cc103990 0x7f95cc199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:38.919 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.908+0000 7f95d2110640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc199980 con 0x7f95cc103990 2024-09-13T17:04:38.919 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.908+0000 7f95cb7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95cc103990 0x7f95cc199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:38.919 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.908+0000 7f95cb7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95cc103990 0x7f95cc199440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38758/0 (socket says 172.21.15.87:38758) 2024-09-13T17:04:38.919 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.908+0000 7f95cb7fe640 1 -- 172.21.15.87:0/493703134 learned_addr learned my addr 172.21.15.87:0/493703134 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:38.919 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.908+0000 7f95cb7fe640 1 -- 172.21.15.87:0/493703134 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95bc0094d0 con 0x7f95cc103990 2024-09-13T17:04:38.919 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.908+0000 7f95cb7fe640 1 --2- 172.21.15.87:0/493703134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95cc103990 0x7f95cc199440 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f95bc02a790 tx=0x7f95bc030d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:38.919 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.909+0000 7f95c8ff9640 1 -- 172.21.15.87:0/493703134 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95bc032d80 con 0x7f95cc103990 2024-09-13T17:04:38.919 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.909+0000 7f95c8ff9640 1 -- 172.21.15.87:0/493703134 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f95bc03b8c0 con 0x7f95cc103990 2024-09-13T17:04:38.919 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.909+0000 7f95d2110640 1 -- 172.21.15.87:0/493703134 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95cc199b80 con 0x7f95cc103990 2024-09-13T17:04:38.919 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.909+0000 7f95c8ff9640 1 -- 172.21.15.87:0/493703134 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95bc03a6e0 con 0x7f95cc103990 2024-09-13T17:04:38.919 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.909+0000 7f95d2110640 1 -- 172.21.15.87:0/493703134 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95cc19a020 con 0x7f95cc103990 2024-09-13T17:04:38.919 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.910+0000 7f95c8ff9640 1 -- 172.21.15.87:0/493703134 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f95bc039040 con 0x7f95cc103990 2024-09-13T17:04:38.920 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.910+0000 7f95d2110640 1 -- 172.21.15.87:0/493703134 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95cc109ba0 con 0x7f95cc103990 2024-09-13T17:04:38.920 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.910+0000 7f95c8ff9640 1 --2- 172.21.15.87:0/493703134 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f95b4038620 0x7f95b403aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:38.920 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.910+0000 7f95c8ff9640 1 -- 172.21.15.87:0/493703134 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f95bc06b6f0 con 0x7f95cc103990 2024-09-13T17:04:38.920 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.910+0000 7f95caffd640 1 --2- 172.21.15.87:0/493703134 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f95b4038620 0x7f95b403aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:38.920 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.910+0000 7f95caffd640 1 --2- 172.21.15.87:0/493703134 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f95b4038620 0x7f95b403aae0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f95c00098c0 tx=0x7f95c0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:38.920 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:37.914+0000 7f95c8ff9640 1 -- 172.21.15.87:0/493703134 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f95bc04b300 con 0x7f95cc103990 2024-09-13T17:04:38.920 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:38.087+0000 7f95d2110640 1 -- 172.21.15.87:0/493703134 --> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f95cc19c960 con 0x7f95b4038620 2024-09-13T17:04:38.920 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:38.091+0000 7f95c8ff9640 1 -- 172.21.15.87:0/493703134 <== mgr.14118 v2:172.21.15.87:6800/4144176457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f95cc19c960 con 0x7f95b4038620 2024-09-13T17:04:38.920 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:38.093+0000 7f95d2110640 1 -- 172.21.15.87:0/493703134 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f95b4038620 msgr2=0x7f95b403aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:38.920 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:38.093+0000 7f95d2110640 1 --2- 172.21.15.87:0/493703134 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f95b4038620 0x7f95b403aae0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f95c00098c0 tx=0x7f95c0006db0 comp rx=0 tx=0).stop 2024-09-13T17:04:38.920 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:38.093+0000 7f95d2110640 1 -- 172.21.15.87:0/493703134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95cc103990 msgr2=0x7f95cc199440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:38.920 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:38.093+0000 7f95d2110640 1 --2- 172.21.15.87:0/493703134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95cc103990 0x7f95cc199440 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f95bc02a790 tx=0x7f95bc030d90 comp rx=0 tx=0).stop 2024-09-13T17:04:38.921 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:38.093+0000 7f95d2110640 1 -- 172.21.15.87:0/493703134 shutdown_connections 2024-09-13T17:04:38.921 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:38.093+0000 7f95d2110640 1 --2- 172.21.15.87:0/493703134 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f95b4038620 0x7f95b403aae0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:38.921 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:38.093+0000 7f95d2110640 1 --2- 172.21.15.87:0/493703134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95cc103990 0x7f95cc199440 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:38.921 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:38.093+0000 7f95d2110640 1 -- 172.21.15.87:0/493703134 >> 172.21.15.87:0/493703134 conn(0x7f95cc0ff4e0 msgr2=0x7f95cc100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:38.921 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:38.094+0000 7f95d2110640 1 -- 172.21.15.87:0/493703134 shutdown_connections 2024-09-13T17:04:38.921 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:38.094+0000 7f95d2110640 1 -- 172.21.15.87:0/493703134 wait complete. 2024-09-13T17:04:39.303 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:39 smithi087 ceph-mon[30934]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:04:39.304 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:39 smithi087 ceph-mon[30934]: Saving service mgr spec with placement count:2 2024-09-13T17:04:39.304 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:39 smithi087 ceph-mon[30934]: from='mgr.14118 172.21.15.87:0/296842519' entity='mgr.x' 2024-09-13T17:04:39.304 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:39 smithi087 ceph-mon[30934]: from='mgr.14118 172.21.15.87:0/296842519' entity='mgr.x' 2024-09-13T17:04:39.304 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:39 smithi087 ceph-mon[30934]: from='mgr.14118 172.21.15.87:0/296842519' entity='mgr.x' 2024-09-13T17:04:40.283 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.307+0000 7f6485760640 1 Processor -- start 2024-09-13T17:04:40.283 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.307+0000 7f6485760640 1 -- start start 2024-09-13T17:04:40.283 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.307+0000 7f6485760640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64801045d0 0x7f64801049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:40.283 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.307+0000 7f6485760640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6480104fa0 con 0x7f64801045d0 2024-09-13T17:04:40.283 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.308+0000 7f647effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64801045d0 0x7f64801049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:40.283 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.308+0000 7f647effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64801045d0 0x7f64801049d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46166/0 (socket says 172.21.15.87:46166) 2024-09-13T17:04:40.284 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.308+0000 7f647effd640 1 -- 172.21.15.87:0/1613532604 learned_addr learned my addr 172.21.15.87:0/1613532604 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:40.284 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.308+0000 7f647effd640 1 -- 172.21.15.87:0/1613532604 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6480105780 con 0x7f64801045d0 2024-09-13T17:04:40.284 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.309+0000 7f647effd640 1 --2- 172.21.15.87:0/1613532604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64801045d0 0x7f64801049d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6470009820 tx=0x7f647002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c6e34761cb639c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:40.284 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.309+0000 7f647e7fc640 1 -- 172.21.15.87:0/1613532604 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f647002ae70 con 0x7f64801045d0 2024-09-13T17:04:40.284 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.309+0000 7f647e7fc640 1 -- 172.21.15.87:0/1613532604 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f64700328f0 con 0x7f64801045d0 2024-09-13T17:04:40.284 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.309+0000 7f647e7fc640 1 -- 172.21.15.87:0/1613532604 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6470030850 con 0x7f64801045d0 2024-09-13T17:04:40.284 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.309+0000 7f6485760640 1 -- 172.21.15.87:0/1613532604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64801045d0 msgr2=0x7f64801049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:40.284 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.309+0000 7f6485760640 1 --2- 172.21.15.87:0/1613532604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64801045d0 0x7f64801049d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6470009820 tx=0x7f647002a270 comp rx=0 tx=0).stop 2024-09-13T17:04:40.284 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.309+0000 7f6485760640 1 -- 172.21.15.87:0/1613532604 shutdown_connections 2024-09-13T17:04:40.284 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.309+0000 7f6485760640 1 --2- 172.21.15.87:0/1613532604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64801045d0 0x7f64801049d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:40.284 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.309+0000 7f6485760640 1 -- 172.21.15.87:0/1613532604 >> 172.21.15.87:0/1613532604 conn(0x7f64800ffda0 msgr2=0x7f64801021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:40.284 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.309+0000 7f6485760640 1 -- 172.21.15.87:0/1613532604 shutdown_connections 2024-09-13T17:04:40.284 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.309+0000 7f6485760640 1 -- 172.21.15.87:0/1613532604 wait complete. 2024-09-13T17:04:40.284 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.310+0000 7f6485760640 1 Processor -- start 2024-09-13T17:04:40.285 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.310+0000 7f6485760640 1 -- start start 2024-09-13T17:04:40.285 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.310+0000 7f6485760640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64801045d0 0x7f64801994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:40.285 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.310+0000 7f6485760640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6480199a30 con 0x7f64801045d0 2024-09-13T17:04:40.285 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.310+0000 7f647effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64801045d0 0x7f64801994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:40.285 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.310+0000 7f647effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64801045d0 0x7f64801994f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46180/0 (socket says 172.21.15.87:46180) 2024-09-13T17:04:40.285 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.310+0000 7f647effd640 1 -- 172.21.15.87:0/2530107177 learned_addr learned my addr 172.21.15.87:0/2530107177 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:40.285 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.311+0000 7f647effd640 1 -- 172.21.15.87:0/2530107177 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64700094d0 con 0x7f64801045d0 2024-09-13T17:04:40.285 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.311+0000 7f647effd640 1 --2- 172.21.15.87:0/2530107177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64801045d0 0x7f64801994f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6470030560 tx=0x7f6470030d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:40.285 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.311+0000 7f647cff9640 1 -- 172.21.15.87:0/2530107177 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6470032da0 con 0x7f64801045d0 2024-09-13T17:04:40.285 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.311+0000 7f647cff9640 1 -- 172.21.15.87:0/2530107177 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f647003b8e0 con 0x7f64801045d0 2024-09-13T17:04:40.285 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.311+0000 7f6485760640 1 -- 172.21.15.87:0/2530107177 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6480199c30 con 0x7f64801045d0 2024-09-13T17:04:40.285 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.311+0000 7f647cff9640 1 -- 172.21.15.87:0/2530107177 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f647003a660 con 0x7f64801045d0 2024-09-13T17:04:40.286 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.311+0000 7f6485760640 1 -- 172.21.15.87:0/2530107177 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f648019a0d0 con 0x7f64801045d0 2024-09-13T17:04:40.286 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.312+0000 7f647cff9640 1 -- 172.21.15.87:0/2530107177 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f6470039040 con 0x7f64801045d0 2024-09-13T17:04:40.286 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.312+0000 7f647cff9640 1 --2- 172.21.15.87:0/2530107177 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f646c038670 0x7f646c03ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:40.286 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.312+0000 7f647cff9640 1 -- 172.21.15.87:0/2530107177 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f647006b940 con 0x7f64801045d0 2024-09-13T17:04:40.286 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.312+0000 7f6485760640 1 -- 172.21.15.87:0/2530107177 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64801935e0 con 0x7f64801045d0 2024-09-13T17:04:40.286 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.312+0000 7f64767fc640 1 --2- 172.21.15.87:0/2530107177 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f646c038670 0x7f646c03ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:40.286 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.313+0000 7f64767fc640 1 --2- 172.21.15.87:0/2530107177 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f646c038670 0x7f646c03ab30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f64680098c0 tx=0x7f6468006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:40.286 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.317+0000 7f647cff9640 1 -- 172.21.15.87:0/2530107177 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6470037070 con 0x7f64801045d0 2024-09-13T17:04:40.286 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.517+0000 7f6485760640 1 -- 172.21.15.87:0/2530107177 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f6480108980 con 0x7f64801045d0 2024-09-13T17:04:40.286 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.523+0000 7f647cff9640 1 -- 172.21.15.87:0/2530107177 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f647003f030 con 0x7f64801045d0 2024-09-13T17:04:40.286 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.525+0000 7f6485760640 1 -- 172.21.15.87:0/2530107177 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f646c038670 msgr2=0x7f646c03ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:40.286 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.525+0000 7f6485760640 1 --2- 172.21.15.87:0/2530107177 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f646c038670 0x7f646c03ab30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f64680098c0 tx=0x7f6468006db0 comp rx=0 tx=0).stop 2024-09-13T17:04:40.286 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.526+0000 7f6485760640 1 -- 172.21.15.87:0/2530107177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64801045d0 msgr2=0x7f64801994f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:40.287 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.526+0000 7f6485760640 1 --2- 172.21.15.87:0/2530107177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64801045d0 0x7f64801994f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6470030560 tx=0x7f6470030d90 comp rx=0 tx=0).stop 2024-09-13T17:04:40.287 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.526+0000 7f6485760640 1 -- 172.21.15.87:0/2530107177 shutdown_connections 2024-09-13T17:04:40.287 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.526+0000 7f6485760640 1 --2- 172.21.15.87:0/2530107177 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f646c038670 0x7f646c03ab30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:40.287 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.526+0000 7f6485760640 1 --2- 172.21.15.87:0/2530107177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64801045d0 0x7f64801994f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:40.287 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.526+0000 7f6485760640 1 -- 172.21.15.87:0/2530107177 >> 172.21.15.87:0/2530107177 conn(0x7f64800ffda0 msgr2=0x7f6480100d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:40.287 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.526+0000 7f6485760640 1 -- 172.21.15.87:0/2530107177 shutdown_connections 2024-09-13T17:04:40.287 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:39.526+0000 7f6485760640 1 -- 172.21.15.87:0/2530107177 wait complete. 2024-09-13T17:04:40.636 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:40 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2530107177' entity='client.admin' 2024-09-13T17:04:41.567 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.715+0000 7f59b51ec640 1 Processor -- start 2024-09-13T17:04:41.567 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.715+0000 7f59b51ec640 1 -- start start 2024-09-13T17:04:41.567 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.716+0000 7f59b51ec640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59b0105750 0x7f59b0105b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:41.567 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.716+0000 7f59b51ec640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b0106120 con 0x7f59b0105750 2024-09-13T17:04:41.567 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.716+0000 7f59aed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59b0105750 0x7f59b0105b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:41.567 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.716+0000 7f59aed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59b0105750 0x7f59b0105b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46192/0 (socket says 172.21.15.87:46192) 2024-09-13T17:04:41.567 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.716+0000 7f59aed9d640 1 -- 172.21.15.87:0/433722863 learned_addr learned my addr 172.21.15.87:0/433722863 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:41.567 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.716+0000 7f59aed9d640 1 -- 172.21.15.87:0/433722863 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b01068b0 con 0x7f59b0105750 2024-09-13T17:04:41.567 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.717+0000 7f59aed9d640 1 --2- 172.21.15.87:0/433722863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59b0105750 0x7f59b0105b50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f59a0009820 tx=0x7f59a002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a406e9db73ada164 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:41.567 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.717+0000 7f59ae59c640 1 -- 172.21.15.87:0/433722863 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59a002ae70 con 0x7f59b0105750 2024-09-13T17:04:41.568 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.717+0000 7f59ae59c640 1 -- 172.21.15.87:0/433722863 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f59a00328f0 con 0x7f59b0105750 2024-09-13T17:04:41.568 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.717+0000 7f59ae59c640 1 -- 172.21.15.87:0/433722863 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59a0030850 con 0x7f59b0105750 2024-09-13T17:04:41.568 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.717+0000 7f59b51ec640 1 -- 172.21.15.87:0/433722863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59b0105750 msgr2=0x7f59b0105b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:41.568 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.717+0000 7f59b51ec640 1 --2- 172.21.15.87:0/433722863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59b0105750 0x7f59b0105b50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f59a0009820 tx=0x7f59a002a270 comp rx=0 tx=0).stop 2024-09-13T17:04:41.568 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.717+0000 7f59b51ec640 1 -- 172.21.15.87:0/433722863 shutdown_connections 2024-09-13T17:04:41.568 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.717+0000 7f59b51ec640 1 --2- 172.21.15.87:0/433722863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59b0105750 0x7f59b0105b50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:41.568 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.717+0000 7f59b51ec640 1 -- 172.21.15.87:0/433722863 >> 172.21.15.87:0/433722863 conn(0x7f59b0100f00 msgr2=0x7f59b0103320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:41.568 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.717+0000 7f59b51ec640 1 -- 172.21.15.87:0/433722863 shutdown_connections 2024-09-13T17:04:41.568 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.717+0000 7f59b51ec640 1 -- 172.21.15.87:0/433722863 wait complete. 2024-09-13T17:04:41.568 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.718+0000 7f59b51ec640 1 Processor -- start 2024-09-13T17:04:41.568 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.718+0000 7f59b51ec640 1 -- start start 2024-09-13T17:04:41.568 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.718+0000 7f59b51ec640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59b0105750 0x7f59b0199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:41.568 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.718+0000 7f59b51ec640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b0199970 con 0x7f59b0105750 2024-09-13T17:04:41.569 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.718+0000 7f59aed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59b0105750 0x7f59b0199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:41.569 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.718+0000 7f59aed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59b0105750 0x7f59b0199430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46208/0 (socket says 172.21.15.87:46208) 2024-09-13T17:04:41.569 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.718+0000 7f59aed9d640 1 -- 172.21.15.87:0/4047710181 learned_addr learned my addr 172.21.15.87:0/4047710181 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:41.569 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.719+0000 7f59aed9d640 1 -- 172.21.15.87:0/4047710181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a00094d0 con 0x7f59b0105750 2024-09-13T17:04:41.569 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.719+0000 7f59aed9d640 1 --2- 172.21.15.87:0/4047710181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59b0105750 0x7f59b0199430 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f59a0030560 tx=0x7f59a0030d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:41.569 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.719+0000 7f59acd99640 1 -- 172.21.15.87:0/4047710181 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59a0032da0 con 0x7f59b0105750 2024-09-13T17:04:41.569 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.719+0000 7f59acd99640 1 -- 172.21.15.87:0/4047710181 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f59a003b8e0 con 0x7f59b0105750 2024-09-13T17:04:41.569 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.719+0000 7f59b51ec640 1 -- 172.21.15.87:0/4047710181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b0199b70 con 0x7f59b0105750 2024-09-13T17:04:41.569 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.719+0000 7f59b51ec640 1 -- 172.21.15.87:0/4047710181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b019a010 con 0x7f59b0105750 2024-09-13T17:04:41.569 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.719+0000 7f59acd99640 1 -- 172.21.15.87:0/4047710181 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59a003a800 con 0x7f59b0105750 2024-09-13T17:04:41.569 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.720+0000 7f59acd99640 1 -- 172.21.15.87:0/4047710181 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f59a0039040 con 0x7f59b0105750 2024-09-13T17:04:41.569 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.720+0000 7f59b51ec640 1 -- 172.21.15.87:0/4047710181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b0109ae0 con 0x7f59b0105750 2024-09-13T17:04:41.569 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.720+0000 7f59acd99640 1 --2- 172.21.15.87:0/4047710181 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f599c038620 0x7f599c03aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:41.569 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.720+0000 7f59acd99640 1 -- 172.21.15.87:0/4047710181 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f59a006b9e0 con 0x7f59b0105750 2024-09-13T17:04:41.570 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.720+0000 7f59a7fff640 1 --2- 172.21.15.87:0/4047710181 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f599c038620 0x7f599c03aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:41.570 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.721+0000 7f59a7fff640 1 --2- 172.21.15.87:0/4047710181 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f599c038620 0x7f599c03aae0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f59980098c0 tx=0x7f5998006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:41.570 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.725+0000 7f59acd99640 1 -- 172.21.15.87:0/4047710181 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f59a004b4e0 con 0x7f59b0105750 2024-09-13T17:04:41.570 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.891+0000 7f59b51ec640 1 -- 172.21.15.87:0/4047710181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f59b0109d20 con 0x7f59b0105750 2024-09-13T17:04:41.570 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.897+0000 7f59acd99640 1 -- 172.21.15.87:0/4047710181 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f59a0037070 con 0x7f59b0105750 2024-09-13T17:04:41.570 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.899+0000 7f59b51ec640 1 -- 172.21.15.87:0/4047710181 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f599c038620 msgr2=0x7f599c03aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:41.570 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.899+0000 7f59b51ec640 1 --2- 172.21.15.87:0/4047710181 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f599c038620 0x7f599c03aae0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f59980098c0 tx=0x7f5998006db0 comp rx=0 tx=0).stop 2024-09-13T17:04:41.570 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.899+0000 7f59b51ec640 1 -- 172.21.15.87:0/4047710181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59b0105750 msgr2=0x7f59b0199430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:41.570 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.899+0000 7f59b51ec640 1 --2- 172.21.15.87:0/4047710181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59b0105750 0x7f59b0199430 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f59a0030560 tx=0x7f59a0030d90 comp rx=0 tx=0).stop 2024-09-13T17:04:41.570 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.899+0000 7f59b51ec640 1 -- 172.21.15.87:0/4047710181 shutdown_connections 2024-09-13T17:04:41.570 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.899+0000 7f59b51ec640 1 --2- 172.21.15.87:0/4047710181 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f599c038620 0x7f599c03aae0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:41.570 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.899+0000 7f59b51ec640 1 --2- 172.21.15.87:0/4047710181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59b0105750 0x7f59b0199430 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:41.570 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.899+0000 7f59b51ec640 1 -- 172.21.15.87:0/4047710181 >> 172.21.15.87:0/4047710181 conn(0x7f59b0100f00 msgr2=0x7f59b0101b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:41.570 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.899+0000 7f59b51ec640 1 -- 172.21.15.87:0/4047710181 shutdown_connections 2024-09-13T17:04:41.571 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:40.899+0000 7f59b51ec640 1 -- 172.21.15.87:0/4047710181 wait complete. 2024-09-13T17:04:41.571 INFO:teuthology.orchestra.run.smithi087.stdout:Enabling the dashboard module... 2024-09-13T17:04:42.228 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:41 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/4047710181' entity='client.admin' 2024-09-13T17:04:42.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:41 smithi087 ceph-mon[30934]: from='mgr.14118 172.21.15.87:0/296842519' entity='mgr.x' 2024-09-13T17:04:43.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:43 smithi087 ceph-mon[30934]: from='mgr.14118 172.21.15.87:0/296842519' entity='mgr.x' 2024-09-13T17:04:43.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:43 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3968120910' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-13T17:04:43.479 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:43 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: ignoring --setuser ceph since I am not root 2024-09-13T17:04:43.479 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:43 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: ignoring --setgroup ceph since I am not root 2024-09-13T17:04:43.479 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:43 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:43.350+0000 7effdf56f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T17:04:43.479 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:43 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:43.406+0000 7effdf56f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T17:04:43.871 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:43 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:43.557+0000 7effdf56f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T17:04:43.871 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:43 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:43.621+0000 7effdf56f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T17:04:43.871 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:43 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:43.763+0000 7effdf56f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:04:44.122 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.019+0000 7f1f7e94c640 1 Processor -- start 2024-09-13T17:04:44.122 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.019+0000 7f1f7e94c640 1 -- start start 2024-09-13T17:04:44.122 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.019+0000 7f1f7e94c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f78106180 0x7f1f78108570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:44.122 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.019+0000 7f1f7e94c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f78079d80 con 0x7f1f78106180 2024-09-13T17:04:44.122 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.019+0000 7f1f77fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f78106180 0x7f1f78108570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:44.122 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.019+0000 7f1f77fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f78106180 0x7f1f78108570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46218/0 (socket says 172.21.15.87:46218) 2024-09-13T17:04:44.122 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.019+0000 7f1f77fff640 1 -- 172.21.15.87:0/2946189562 learned_addr learned my addr 172.21.15.87:0/2946189562 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:44.123 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.019+0000 7f1f77fff640 1 -- 172.21.15.87:0/2946189562 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f78108ab0 con 0x7f1f78106180 2024-09-13T17:04:44.123 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.020+0000 7f1f77fff640 1 --2- 172.21.15.87:0/2946189562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f78106180 0x7f1f78108570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1f68009820 tx=0x7f1f6802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f14d7bac66bc0a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:44.123 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.021+0000 7f1f76ffd640 1 -- 172.21.15.87:0/2946189562 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f6802ae70 con 0x7f1f78106180 2024-09-13T17:04:44.123 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.021+0000 7f1f76ffd640 1 -- 172.21.15.87:0/2946189562 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1f680328f0 con 0x7f1f78106180 2024-09-13T17:04:44.123 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.021+0000 7f1f76ffd640 1 -- 172.21.15.87:0/2946189562 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f68030850 con 0x7f1f78106180 2024-09-13T17:04:44.123 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.021+0000 7f1f7e94c640 1 -- 172.21.15.87:0/2946189562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f78106180 msgr2=0x7f1f78108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:44.123 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.021+0000 7f1f7e94c640 1 --2- 172.21.15.87:0/2946189562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f78106180 0x7f1f78108570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1f68009820 tx=0x7f1f6802a270 comp rx=0 tx=0).stop 2024-09-13T17:04:44.123 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.021+0000 7f1f7e94c640 1 -- 172.21.15.87:0/2946189562 shutdown_connections 2024-09-13T17:04:44.123 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.021+0000 7f1f7e94c640 1 --2- 172.21.15.87:0/2946189562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f78106180 0x7f1f78108570 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:44.123 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.021+0000 7f1f7e94c640 1 -- 172.21.15.87:0/2946189562 >> 172.21.15.87:0/2946189562 conn(0x7f1f780ffda0 msgr2=0x7f1f781021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:44.123 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.022+0000 7f1f7e94c640 1 -- 172.21.15.87:0/2946189562 shutdown_connections 2024-09-13T17:04:44.123 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.022+0000 7f1f7e94c640 1 -- 172.21.15.87:0/2946189562 wait complete. 2024-09-13T17:04:44.123 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.022+0000 7f1f7e94c640 1 Processor -- start 2024-09-13T17:04:44.124 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.022+0000 7f1f7e94c640 1 -- start start 2024-09-13T17:04:44.124 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.022+0000 7f1f7e94c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f78106180 0x7f1f781993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:44.124 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.022+0000 7f1f7e94c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f78199930 con 0x7f1f78106180 2024-09-13T17:04:44.124 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.023+0000 7f1f77fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f78106180 0x7f1f781993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:44.124 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.023+0000 7f1f77fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f78106180 0x7f1f781993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46234/0 (socket says 172.21.15.87:46234) 2024-09-13T17:04:44.124 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.023+0000 7f1f77fff640 1 -- 172.21.15.87:0/3968120910 learned_addr learned my addr 172.21.15.87:0/3968120910 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:44.124 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.023+0000 7f1f77fff640 1 -- 172.21.15.87:0/3968120910 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f680094d0 con 0x7f1f78106180 2024-09-13T17:04:44.124 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.023+0000 7f1f77fff640 1 --2- 172.21.15.87:0/3968120910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f78106180 0x7f1f781993f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1f68000c00 tx=0x7f1f68030d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:44.124 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.023+0000 7f1f757fa640 1 -- 172.21.15.87:0/3968120910 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f68032da0 con 0x7f1f78106180 2024-09-13T17:04:44.124 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.023+0000 7f1f7e94c640 1 -- 172.21.15.87:0/3968120910 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f78199b30 con 0x7f1f78106180 2024-09-13T17:04:44.124 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.023+0000 7f1f757fa640 1 -- 172.21.15.87:0/3968120910 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1f6803b8e0 con 0x7f1f78106180 2024-09-13T17:04:44.124 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.023+0000 7f1f757fa640 1 -- 172.21.15.87:0/3968120910 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f6803a780 con 0x7f1f78106180 2024-09-13T17:04:44.124 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.023+0000 7f1f7e94c640 1 -- 172.21.15.87:0/3968120910 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f78199fd0 con 0x7f1f78106180 2024-09-13T17:04:44.125 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.024+0000 7f1f757fa640 1 -- 172.21.15.87:0/3968120910 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f1f68039040 con 0x7f1f78106180 2024-09-13T17:04:44.125 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.025+0000 7f1f7e94c640 1 -- 172.21.15.87:0/3968120910 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f781098b0 con 0x7f1f78106180 2024-09-13T17:04:44.125 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.025+0000 7f1f757fa640 1 --2- 172.21.15.87:0/3968120910 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f1f60038620 0x7f1f6003aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:44.125 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.025+0000 7f1f757fa640 1 -- 172.21.15.87:0/3968120910 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f1f6806b990 con 0x7f1f78106180 2024-09-13T17:04:44.125 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.025+0000 7f1f777fe640 1 --2- 172.21.15.87:0/3968120910 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f1f60038620 0x7f1f6003aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:44.125 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.025+0000 7f1f777fe640 1 --2- 172.21.15.87:0/3968120910 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f1f60038620 0x7f1f6003aae0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0098c0 tx=0x7f1f6c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:44.125 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.030+0000 7f1f757fa640 1 -- 172.21.15.87:0/3968120910 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1f6804b8f0 con 0x7f1f78106180 2024-09-13T17:04:44.125 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:42.251+0000 7f1f7e94c640 1 -- 172.21.15.87:0/3968120910 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f1f78109af0 con 0x7f1f78106180 2024-09-13T17:04:44.125 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:43.203+0000 7f1f757fa640 1 -- 172.21.15.87:0/3968120910 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f1f680313a0 con 0x7f1f78106180 2024-09-13T17:04:44.125 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:43.205+0000 7f1f757fa640 1 -- 172.21.15.87:0/3968120910 <== mon.0 v2:172.21.15.87:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f1f680319c0 con 0x7f1f78106180 2024-09-13T17:04:44.126 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:43.207+0000 7f1f7e94c640 1 -- 172.21.15.87:0/3968120910 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f1f60038620 msgr2=0x7f1f6003aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:44.126 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:43.207+0000 7f1f7e94c640 1 --2- 172.21.15.87:0/3968120910 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f1f60038620 0x7f1f6003aae0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0098c0 tx=0x7f1f6c006db0 comp rx=0 tx=0).stop 2024-09-13T17:04:44.126 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:43.208+0000 7f1f7e94c640 1 -- 172.21.15.87:0/3968120910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f78106180 msgr2=0x7f1f781993f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:44.126 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:43.208+0000 7f1f7e94c640 1 --2- 172.21.15.87:0/3968120910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f78106180 0x7f1f781993f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1f68000c00 tx=0x7f1f68030d90 comp rx=0 tx=0).stop 2024-09-13T17:04:44.126 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:43.208+0000 7f1f7e94c640 1 -- 172.21.15.87:0/3968120910 shutdown_connections 2024-09-13T17:04:44.126 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:43.208+0000 7f1f7e94c640 1 --2- 172.21.15.87:0/3968120910 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f1f60038620 0x7f1f6003aae0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:44.126 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:43.208+0000 7f1f7e94c640 1 --2- 172.21.15.87:0/3968120910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f78106180 0x7f1f781993f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:44.126 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:43.208+0000 7f1f7e94c640 1 -- 172.21.15.87:0/3968120910 >> 172.21.15.87:0/3968120910 conn(0x7f1f780ffda0 msgr2=0x7f1f781009c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:44.126 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:43.208+0000 7f1f7e94c640 1 -- 172.21.15.87:0/3968120910 shutdown_connections 2024-09-13T17:04:44.126 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:43.208+0000 7f1f7e94c640 1 -- 172.21.15.87:0/3968120910 wait complete. 2024-09-13T17:04:44.207 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:43 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:43.905+0000 7effdf56f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T17:04:44.473 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:44 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3968120910' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-13T17:04:44.473 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:44 smithi087 ceph-mon[30934]: mgrmap e9: x(active, since 19s) 2024-09-13T17:04:44.473 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:44 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:44.222+0000 7effdf56f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T17:04:44.473 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:44 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:44.285+0000 7effdf56f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T17:04:44.473 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:44 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:44.472+0000 7effdf56f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T17:04:45.270 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout { 2024-09-13T17:04:45.270 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-13T17:04:45.270 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T17:04:45.270 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-13T17:04:45.270 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T17:04:45.270 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout } 2024-09-13T17:04:45.270 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.508+0000 7f68b405a640 1 Processor -- start 2024-09-13T17:04:45.270 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.509+0000 7f68b405a640 1 -- start start 2024-09-13T17:04:45.270 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.509+0000 7f68b405a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68ac1045d0 0x7f68ac1049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:45.270 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.509+0000 7f68b405a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ac104fa0 con 0x7f68ac1045d0 2024-09-13T17:04:45.270 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.509+0000 7f68b1df6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68ac1045d0 0x7f68ac1049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:45.271 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.509+0000 7f68b1df6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68ac1045d0 0x7f68ac1049d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46276/0 (socket says 172.21.15.87:46276) 2024-09-13T17:04:45.271 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.509+0000 7f68b1df6640 1 -- 172.21.15.87:0/827464549 learned_addr learned my addr 172.21.15.87:0/827464549 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:45.271 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.509+0000 7f68b1df6640 1 -- 172.21.15.87:0/827464549 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ac105780 con 0x7f68ac1045d0 2024-09-13T17:04:45.271 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.510+0000 7f68b1df6640 1 --2- 172.21.15.87:0/827464549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68ac1045d0 0x7f68ac1049d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f68a8009820 tx=0x7f68a802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcdbc2374bebfd94 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:45.271 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.510+0000 7f68b0df4640 1 -- 172.21.15.87:0/827464549 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f68a802ae70 con 0x7f68ac1045d0 2024-09-13T17:04:45.271 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.510+0000 7f68b0df4640 1 -- 172.21.15.87:0/827464549 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f68a80328f0 con 0x7f68ac1045d0 2024-09-13T17:04:45.271 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.510+0000 7f68b0df4640 1 -- 172.21.15.87:0/827464549 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f68a8030850 con 0x7f68ac1045d0 2024-09-13T17:04:45.271 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.511+0000 7f68b405a640 1 -- 172.21.15.87:0/827464549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68ac1045d0 msgr2=0x7f68ac1049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:45.271 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.511+0000 7f68b405a640 1 --2- 172.21.15.87:0/827464549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68ac1045d0 0x7f68ac1049d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f68a8009820 tx=0x7f68a802a270 comp rx=0 tx=0).stop 2024-09-13T17:04:45.271 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.511+0000 7f68b405a640 1 -- 172.21.15.87:0/827464549 shutdown_connections 2024-09-13T17:04:45.271 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.511+0000 7f68b405a640 1 --2- 172.21.15.87:0/827464549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68ac1045d0 0x7f68ac1049d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:45.271 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.511+0000 7f68b405a640 1 -- 172.21.15.87:0/827464549 >> 172.21.15.87:0/827464549 conn(0x7f68ac0ffda0 msgr2=0x7f68ac1021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:45.271 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.511+0000 7f68b405a640 1 -- 172.21.15.87:0/827464549 shutdown_connections 2024-09-13T17:04:45.272 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.511+0000 7f68b405a640 1 -- 172.21.15.87:0/827464549 wait complete. 2024-09-13T17:04:45.272 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.512+0000 7f68b405a640 1 Processor -- start 2024-09-13T17:04:45.272 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.512+0000 7f68b405a640 1 -- start start 2024-09-13T17:04:45.272 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.512+0000 7f68b405a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68ac1045d0 0x7f68ac19b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:45.272 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.512+0000 7f68b405a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ac19bbf0 con 0x7f68ac1045d0 2024-09-13T17:04:45.272 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.512+0000 7f68b1df6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68ac1045d0 0x7f68ac19b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:45.272 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.512+0000 7f68b1df6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68ac1045d0 0x7f68ac19b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46288/0 (socket says 172.21.15.87:46288) 2024-09-13T17:04:45.272 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.512+0000 7f68b1df6640 1 -- 172.21.15.87:0/3379362632 learned_addr learned my addr 172.21.15.87:0/3379362632 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:45.272 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.512+0000 7f68b1df6640 1 -- 172.21.15.87:0/3379362632 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a80094d0 con 0x7f68ac1045d0 2024-09-13T17:04:45.272 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.512+0000 7f68b1df6640 1 --2- 172.21.15.87:0/3379362632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68ac1045d0 0x7f68ac19b6b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f68a8030560 tx=0x7f68a8030d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:45.272 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.512+0000 7f68a2ffd640 1 -- 172.21.15.87:0/3379362632 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f68a8032da0 con 0x7f68ac1045d0 2024-09-13T17:04:45.272 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.512+0000 7f68a2ffd640 1 -- 172.21.15.87:0/3379362632 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f68a803b8e0 con 0x7f68ac1045d0 2024-09-13T17:04:45.272 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.512+0000 7f68a2ffd640 1 -- 172.21.15.87:0/3379362632 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f68a803a660 con 0x7f68ac1045d0 2024-09-13T17:04:45.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.513+0000 7f68b405a640 1 -- 172.21.15.87:0/3379362632 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68ac19bdf0 con 0x7f68ac1045d0 2024-09-13T17:04:45.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.513+0000 7f68b405a640 1 -- 172.21.15.87:0/3379362632 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68ac19c290 con 0x7f68ac1045d0 2024-09-13T17:04:45.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.514+0000 7f68b405a640 1 -- 172.21.15.87:0/3379362632 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68ac1959e0 con 0x7f68ac1045d0 2024-09-13T17:04:45.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.514+0000 7f68a2ffd640 1 -- 172.21.15.87:0/3379362632 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f68a8039040 con 0x7f68ac1045d0 2024-09-13T17:04:45.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.514+0000 7f68a2ffd640 1 --2- 172.21.15.87:0/3379362632 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f68980386c0 0x7f689803ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:45.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.514+0000 7f68a2ffd640 1 -- 172.21.15.87:0/3379362632 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f68a806b970 con 0x7f68ac1045d0 2024-09-13T17:04:45.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.514+0000 7f68b15f5640 1 -- 172.21.15.87:0/3379362632 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f68980386c0 msgr2=0x7f689803ab80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/4144176457 2024-09-13T17:04:45.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.515+0000 7f68b15f5640 1 --2- 172.21.15.87:0/3379362632 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f68980386c0 0x7f689803ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:04:45.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.519+0000 7f68a2ffd640 1 -- 172.21.15.87:0/3379362632 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f68a8031580 con 0x7f68ac1045d0 2024-09-13T17:04:45.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.716+0000 7f68b15f5640 1 -- 172.21.15.87:0/3379362632 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f68980386c0 msgr2=0x7f689803ab80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/4144176457 2024-09-13T17:04:45.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.716+0000 7f68b15f5640 1 --2- 172.21.15.87:0/3379362632 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f68980386c0 0x7f689803ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T17:04:45.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.725+0000 7f68b405a640 1 -- 172.21.15.87:0/3379362632 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f68ac108bd0 con 0x7f68ac1045d0 2024-09-13T17:04:45.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.725+0000 7f68a2ffd640 1 -- 172.21.15.87:0/3379362632 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7f68a803f070 con 0x7f68ac1045d0 2024-09-13T17:04:45.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.728+0000 7f68b405a640 1 -- 172.21.15.87:0/3379362632 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f68980386c0 msgr2=0x7f689803ab80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:04:45.274 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.728+0000 7f68b405a640 1 --2- 172.21.15.87:0/3379362632 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f68980386c0 0x7f689803ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:45.274 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.728+0000 7f68b405a640 1 -- 172.21.15.87:0/3379362632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68ac1045d0 msgr2=0x7f68ac19b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:45.274 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.728+0000 7f68b405a640 1 --2- 172.21.15.87:0/3379362632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68ac1045d0 0x7f68ac19b6b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f68a8030560 tx=0x7f68a8030d90 comp rx=0 tx=0).stop 2024-09-13T17:04:45.274 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.728+0000 7f68b405a640 1 -- 172.21.15.87:0/3379362632 shutdown_connections 2024-09-13T17:04:45.274 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.728+0000 7f68b405a640 1 --2- 172.21.15.87:0/3379362632 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f68980386c0 0x7f689803ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:45.274 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.728+0000 7f68b405a640 1 --2- 172.21.15.87:0/3379362632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68ac1045d0 0x7f68ac19b6b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:45.274 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.728+0000 7f68b405a640 1 -- 172.21.15.87:0/3379362632 >> 172.21.15.87:0/3379362632 conn(0x7f68ac0ffda0 msgr2=0x7f68ac100d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:45.274 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.728+0000 7f68b405a640 1 -- 172.21.15.87:0/3379362632 shutdown_connections 2024-09-13T17:04:45.274 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:44.728+0000 7f68b405a640 1 -- 172.21.15.87:0/3379362632 wait complete. 2024-09-13T17:04:45.274 INFO:teuthology.orchestra.run.smithi087.stdout:Waiting for the mgr to restart... 2024-09-13T17:04:45.274 INFO:teuthology.orchestra.run.smithi087.stdout:Waiting for mgr epoch 9... 2024-09-13T17:04:45.357 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:45 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3379362632' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-13T17:04:45.647 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:45 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:45.355+0000 7effdf56f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T17:04:45.647 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:45 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:45.423+0000 7effdf56f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T17:04:46.384 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:46 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:46.133+0000 7effdf56f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T17:04:46.384 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:46 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:46.245+0000 7effdf56f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T17:04:46.653 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:46 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:46.383+0000 7effdf56f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:04:46.654 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:46 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:46.443+0000 7effdf56f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T17:04:46.654 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:46 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:46.586+0000 7effdf56f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T17:04:46.654 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:46 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:46.652+0000 7effdf56f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T17:04:46.928 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:46 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:46.711+0000 7effdf56f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T17:04:46.928 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:46 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:46.863+0000 7effdf56f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T17:04:46.928 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:46 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:46.927+0000 7effdf56f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T17:04:47.189 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:46 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:46.992+0000 7effdf56f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T17:04:47.190 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:47 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:47.073+0000 7effdf56f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T17:04:47.190 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:47 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:47.131+0000 7effdf56f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T17:04:47.190 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:47 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:47.188+0000 7effdf56f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T17:04:48.437 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:48 smithi087 ceph-mon[30934]: Active manager daemon x restarted 2024-09-13T17:04:48.437 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:48 smithi087 ceph-mon[30934]: Activating manager daemon x 2024-09-13T17:04:48.437 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:48 smithi087 ceph-mon[30934]: osdmap e3: 0 total, 0 up, 0 in 2024-09-13T17:04:48.437 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:48 smithi087 ceph-mon[30934]: mgrmap e10: x(active, starting, since 0.00331226s) 2024-09-13T17:04:48.437 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:48 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:04:48.437 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:48 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-13T17:04:48.438 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:48 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T17:04:48.438 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:48 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T17:04:48.438 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:48 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T17:04:48.438 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:48 smithi087 ceph-mon[30934]: Manager daemon x is now available 2024-09-13T17:04:48.438 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:48 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:04:48.438 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:48 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-13T17:04:48.438 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:48 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-13T17:04:48.438 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:47 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:47.987+0000 7effdf56f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T17:04:49.470 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:49 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:49.176+0000 7eff459f9640 -1 log_channel(cephadm) log [ERR] : [13/Sep/2024:17:04:49] ENGINE Error in HTTPServer.serve 2024-09-13T17:04:49.471 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:49 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: Traceback (most recent call last): 2024-09-13T17:04:49.471 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:49 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T17:04:49.471 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:49 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: self._connections.run(self.expiration_interval) 2024-09-13T17:04:49.471 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:49 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T17:04:49.471 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:49 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: self._run(expiration_interval) 2024-09-13T17:04:49.471 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:49 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T17:04:49.471 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:49 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T17:04:49.471 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:49 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T17:04:49.471 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:49 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T17:04:49.471 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:49 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T17:04:49.471 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:49 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: s = self.context.wrap_socket( 2024-09-13T17:04:49.471 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:49 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T17:04:49.472 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:49 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: return self.sslsocket_class._create( 2024-09-13T17:04:49.472 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:49 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T17:04:49.472 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:49 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: self.do_handshake() 2024-09-13T17:04:49.472 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:49 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T17:04:49.472 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:49 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: self._sslobj.do_handshake() 2024-09-13T17:04:49.472 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:49 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T17:04:49.472 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:04:49 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:04:49.754 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout { 2024-09-13T17:04:49.754 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-13T17:04:49.755 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T17:04:49.755 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout } 2024-09-13T17:04:49.755 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.655+0000 7f44d069a640 1 Processor -- start 2024-09-13T17:04:49.755 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.655+0000 7f44d069a640 1 -- start start 2024-09-13T17:04:49.755 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.655+0000 7f44d069a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44c8106140 0x7f44c8108530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:49.755 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.655+0000 7f44d069a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c8079d90 con 0x7f44c8106140 2024-09-13T17:04:49.755 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.655+0000 7f44ce436640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44c8106140 0x7f44c8108530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:49.755 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.655+0000 7f44ce436640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44c8106140 0x7f44c8108530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46300/0 (socket says 172.21.15.87:46300) 2024-09-13T17:04:49.755 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.655+0000 7f44ce436640 1 -- 172.21.15.87:0/1149772273 learned_addr learned my addr 172.21.15.87:0/1149772273 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:49.755 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.655+0000 7f44ce436640 1 -- 172.21.15.87:0/1149772273 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c8108a70 con 0x7f44c8106140 2024-09-13T17:04:49.756 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.656+0000 7f44ce436640 1 --2- 172.21.15.87:0/1149772273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44c8106140 0x7f44c8108530 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f44c4009820 tx=0x7f44c402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7737366036cadbed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:49.756 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.656+0000 7f44cd434640 1 -- 172.21.15.87:0/1149772273 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44c402ae70 con 0x7f44c8106140 2024-09-13T17:04:49.756 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.656+0000 7f44cd434640 1 -- 172.21.15.87:0/1149772273 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f44c40328f0 con 0x7f44c8106140 2024-09-13T17:04:49.756 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.656+0000 7f44cd434640 1 -- 172.21.15.87:0/1149772273 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44c4030850 con 0x7f44c8106140 2024-09-13T17:04:49.756 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.657+0000 7f44d069a640 1 -- 172.21.15.87:0/1149772273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44c8106140 msgr2=0x7f44c8108530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:49.756 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.657+0000 7f44d069a640 1 --2- 172.21.15.87:0/1149772273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44c8106140 0x7f44c8108530 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f44c4009820 tx=0x7f44c402a270 comp rx=0 tx=0).stop 2024-09-13T17:04:49.756 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.657+0000 7f44d069a640 1 -- 172.21.15.87:0/1149772273 shutdown_connections 2024-09-13T17:04:49.756 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.657+0000 7f44d069a640 1 --2- 172.21.15.87:0/1149772273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44c8106140 0x7f44c8108530 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:49.756 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.657+0000 7f44d069a640 1 -- 172.21.15.87:0/1149772273 >> 172.21.15.87:0/1149772273 conn(0x7f44c80ffda0 msgr2=0x7f44c81021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:49.756 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.657+0000 7f44d069a640 1 -- 172.21.15.87:0/1149772273 shutdown_connections 2024-09-13T17:04:49.756 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.657+0000 7f44d069a640 1 -- 172.21.15.87:0/1149772273 wait complete. 2024-09-13T17:04:49.756 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.658+0000 7f44d069a640 1 Processor -- start 2024-09-13T17:04:49.757 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.658+0000 7f44d069a640 1 -- start start 2024-09-13T17:04:49.757 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.658+0000 7f44d069a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44c8106140 0x7f44c8199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:49.757 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.658+0000 7f44d069a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c8199960 con 0x7f44c8106140 2024-09-13T17:04:49.757 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.658+0000 7f44ce436640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44c8106140 0x7f44c8199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:49.757 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.658+0000 7f44ce436640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44c8106140 0x7f44c8199420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46310/0 (socket says 172.21.15.87:46310) 2024-09-13T17:04:49.757 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.658+0000 7f44ce436640 1 -- 172.21.15.87:0/2175517103 learned_addr learned my addr 172.21.15.87:0/2175517103 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:49.757 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.658+0000 7f44ce436640 1 -- 172.21.15.87:0/2175517103 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c40094d0 con 0x7f44c8106140 2024-09-13T17:04:49.757 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.659+0000 7f44ce436640 1 --2- 172.21.15.87:0/2175517103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44c8106140 0x7f44c8199420 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f44c4030560 tx=0x7f44c4030d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:49.757 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.659+0000 7f44bf7fe640 1 -- 172.21.15.87:0/2175517103 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44c4032da0 con 0x7f44c8106140 2024-09-13T17:04:49.757 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.659+0000 7f44bf7fe640 1 -- 172.21.15.87:0/2175517103 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f44c403b8e0 con 0x7f44c8106140 2024-09-13T17:04:49.757 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.659+0000 7f44d069a640 1 -- 172.21.15.87:0/2175517103 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44c8199b60 con 0x7f44c8106140 2024-09-13T17:04:49.757 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.659+0000 7f44d069a640 1 -- 172.21.15.87:0/2175517103 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c819a000 con 0x7f44c8106140 2024-09-13T17:04:49.757 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.660+0000 7f44bf7fe640 1 -- 172.21.15.87:0/2175517103 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44c403a660 con 0x7f44c8106140 2024-09-13T17:04:49.757 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.660+0000 7f44bf7fe640 1 -- 172.21.15.87:0/2175517103 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f44c4039040 con 0x7f44c8106140 2024-09-13T17:04:49.758 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.660+0000 7f44bf7fe640 1 --2- 172.21.15.87:0/2175517103 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f44b40386c0 0x7f44b403ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:49.758 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.660+0000 7f44bf7fe640 1 -- 172.21.15.87:0/2175517103 --> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f44b403b290 con 0x7f44b40386c0 2024-09-13T17:04:49.758 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.660+0000 7f44bf7fe640 1 -- 172.21.15.87:0/2175517103 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f44c406c9b0 con 0x7f44c8106140 2024-09-13T17:04:49.758 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.660+0000 7f44cdc35640 1 -- 172.21.15.87:0/2175517103 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f44b40386c0 msgr2=0x7f44b403ab80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/4144176457 2024-09-13T17:04:49.758 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.660+0000 7f44cdc35640 1 --2- 172.21.15.87:0/2175517103 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f44b40386c0 0x7f44b403ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:04:49.758 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.861+0000 7f44cdc35640 1 -- 172.21.15.87:0/2175517103 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f44b40386c0 msgr2=0x7f44b403ab80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/4144176457 2024-09-13T17:04:49.758 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:45.861+0000 7f44cdc35640 1 --2- 172.21.15.87:0/2175517103 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f44b40386c0 0x7f44b403ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T17:04:49.758 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:46.262+0000 7f44cdc35640 1 -- 172.21.15.87:0/2175517103 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f44b40386c0 msgr2=0x7f44b403ab80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/4144176457 2024-09-13T17:04:49.758 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:46.262+0000 7f44cdc35640 1 --2- 172.21.15.87:0/2175517103 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f44b40386c0 0x7f44b403ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T17:04:49.758 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:47.063+0000 7f44cdc35640 1 -- 172.21.15.87:0/2175517103 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f44b40386c0 msgr2=0x7f44b403ab80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/4144176457 2024-09-13T17:04:49.758 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:47.063+0000 7f44cdc35640 1 --2- 172.21.15.87:0/2175517103 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f44b40386c0 0x7f44b403ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T17:04:49.758 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:47.990+0000 7f44bf7fe640 1 -- 172.21.15.87:0/2175517103 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mgrmap(e 10) v1 ==== 45321+0+0 (secure 0 0 0) 0x7f44c406b7e0 con 0x7f44c8106140 2024-09-13T17:04:49.758 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:47.991+0000 7f44bf7fe640 1 -- 172.21.15.87:0/2175517103 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f44b40386c0 msgr2=0x7f44b403ab80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:04:49.759 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:47.991+0000 7f44bf7fe640 1 --2- 172.21.15.87:0/2175517103 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f44b40386c0 0x7f44b403ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:49.759 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:48.991+0000 7f44bf7fe640 1 -- 172.21.15.87:0/2175517103 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mgrmap(e 11) v1 ==== 45448+0+0 (secure 0 0 0) 0x7f44c4044450 con 0x7f44c8106140 2024-09-13T17:04:49.759 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:48.992+0000 7f44bf7fe640 1 --2- 172.21.15.87:0/2175517103 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f44b403bfb0 0x7f44b403e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:49.759 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:48.992+0000 7f44bf7fe640 1 -- 172.21.15.87:0/2175517103 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f44b403b290 con 0x7f44b403bfb0 2024-09-13T17:04:49.759 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:48.993+0000 7f44cdc35640 1 --2- 172.21.15.87:0/2175517103 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f44b403bfb0 0x7f44b403e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:49.759 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:48.993+0000 7f44cdc35640 1 --2- 172.21.15.87:0/2175517103 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f44b403bfb0 0x7f44b403e3a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f44b8003980 tx=0x7f44b8006e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:49.759 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:48.994+0000 7f44bf7fe640 1 -- 172.21.15.87:0/2175517103 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f44b403b290 con 0x7f44b403bfb0 2024-09-13T17:04:49.759 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:48.999+0000 7f44d069a640 1 -- 172.21.15.87:0/2175517103 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f44ac0025a0 con 0x7f44b403bfb0 2024-09-13T17:04:49.759 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:48.999+0000 7f44bf7fe640 1 -- 172.21.15.87:0/2175517103 <== mgr.14150 v2:172.21.15.87:6800/701043027 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f44ac0025a0 con 0x7f44b403bfb0 2024-09-13T17:04:49.759 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:49.000+0000 7f44d069a640 1 -- 172.21.15.87:0/2175517103 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f44b403bfb0 msgr2=0x7f44b403e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:49.759 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:49.000+0000 7f44d069a640 1 --2- 172.21.15.87:0/2175517103 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f44b403bfb0 0x7f44b403e3a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f44b8003980 tx=0x7f44b8006e10 comp rx=0 tx=0).stop 2024-09-13T17:04:49.759 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:49.000+0000 7f44d069a640 1 -- 172.21.15.87:0/2175517103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44c8106140 msgr2=0x7f44c8199420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:49.760 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:49.000+0000 7f44d069a640 1 --2- 172.21.15.87:0/2175517103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44c8106140 0x7f44c8199420 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f44c4030560 tx=0x7f44c4030d90 comp rx=0 tx=0).stop 2024-09-13T17:04:49.760 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:49.000+0000 7f44d069a640 1 -- 172.21.15.87:0/2175517103 shutdown_connections 2024-09-13T17:04:49.760 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:49.000+0000 7f44d069a640 1 --2- 172.21.15.87:0/2175517103 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f44b403bfb0 0x7f44b403e3a0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:49.760 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:49.000+0000 7f44d069a640 1 --2- 172.21.15.87:0/2175517103 >> [v2:172.21.15.87:6800/4144176457,v1:172.21.15.87:6801/4144176457] conn(0x7f44b40386c0 0x7f44b403ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:49.760 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:49.000+0000 7f44d069a640 1 --2- 172.21.15.87:0/2175517103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44c8106140 0x7f44c8199420 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:49.760 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:49.000+0000 7f44d069a640 1 -- 172.21.15.87:0/2175517103 >> 172.21.15.87:0/2175517103 conn(0x7f44c80ffda0 msgr2=0x7f44c8100a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:49.761 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:49.000+0000 7f44d069a640 1 -- 172.21.15.87:0/2175517103 shutdown_connections 2024-09-13T17:04:49.761 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:49.000+0000 7f44d069a640 1 -- 172.21.15.87:0/2175517103 wait complete. 2024-09-13T17:04:49.761 INFO:teuthology.orchestra.run.smithi087.stdout:mgr epoch 9 is available 2024-09-13T17:04:49.761 INFO:teuthology.orchestra.run.smithi087.stdout:Generating a dashboard self-signed certificate... 2024-09-13T17:04:50.005 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:49 smithi087 ceph-mon[30934]: [13/Sep/2024:17:04:48] ENGINE Bus STARTING 2024-09-13T17:04:50.005 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:49 smithi087 ceph-mon[30934]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-13T17:04:50.005 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:49 smithi087 ceph-mon[30934]: mgrmap e11: x(active, since 1.00575s) 2024-09-13T17:04:50.005 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:49 smithi087 ceph-mon[30934]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-13T17:04:50.005 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:49 smithi087 ceph-mon[30934]: [13/Sep/2024:17:04:49] ENGINE Serving on http://172.21.15.87:8765 2024-09-13T17:04:50.005 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:49 smithi087 ceph-mon[30934]: [13/Sep/2024:17:04:49] ENGINE Serving on https://172.21.15.87:7150 2024-09-13T17:04:50.006 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:49 smithi087 ceph-mon[30934]: [13/Sep/2024:17:04:49] ENGINE Bus STARTED 2024-09-13T17:04:50.006 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:49 smithi087 ceph-mon[30934]: [13/Sep/2024:17:04:49] ENGINE Error in HTTPServer.serve 2024-09-13T17:04:50.006 INFO:journalctl@ceph.mon.a.smithi087.stdout: Traceback (most recent call last): 2024-09-13T17:04:50.006 INFO:journalctl@ceph.mon.a.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T17:04:50.006 INFO:journalctl@ceph.mon.a.smithi087.stdout: self._connections.run(self.expiration_interval) 2024-09-13T17:04:50.006 INFO:journalctl@ceph.mon.a.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T17:04:50.006 INFO:journalctl@ceph.mon.a.smithi087.stdout: self._run(expiration_interval) 2024-09-13T17:04:50.006 INFO:journalctl@ceph.mon.a.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T17:04:50.006 INFO:journalctl@ceph.mon.a.smithi087.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T17:04:50.006 INFO:journalctl@ceph.mon.a.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T17:04:50.006 INFO:journalctl@ceph.mon.a.smithi087.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T17:04:50.006 INFO:journalctl@ceph.mon.a.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T17:04:50.006 INFO:journalctl@ceph.mon.a.smithi087.stdout: s = self.context.wrap_socket( 2024-09-13T17:04:50.006 INFO:journalctl@ceph.mon.a.smithi087.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T17:04:50.007 INFO:journalctl@ceph.mon.a.smithi087.stdout: return self.sslsocket_class._create( 2024-09-13T17:04:50.007 INFO:journalctl@ceph.mon.a.smithi087.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T17:04:50.007 INFO:journalctl@ceph.mon.a.smithi087.stdout: self.do_handshake() 2024-09-13T17:04:50.007 INFO:journalctl@ceph.mon.a.smithi087.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T17:04:50.007 INFO:journalctl@ceph.mon.a.smithi087.stdout: self._sslobj.do_handshake() 2024-09-13T17:04:50.007 INFO:journalctl@ceph.mon.a.smithi087.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T17:04:50.007 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:04:50.984 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-13T17:04:50.984 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.199+0000 7fb9fa329640 1 Processor -- start 2024-09-13T17:04:50.984 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.199+0000 7fb9fa329640 1 -- start start 2024-09-13T17:04:50.984 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.199+0000 7fb9fa329640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9f4104ae0 0x7fb9f4104ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:50.985 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.199+0000 7fb9fa329640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f41054b0 con 0x7fb9f4104ae0 2024-09-13T17:04:50.985 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.199+0000 7fb9f3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9f4104ae0 0x7fb9f4104ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:50.985 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.199+0000 7fb9f3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9f4104ae0 0x7fb9f4104ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54364/0 (socket says 172.21.15.87:54364) 2024-09-13T17:04:50.985 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.199+0000 7fb9f3fff640 1 -- 172.21.15.87:0/1384303513 learned_addr learned my addr 172.21.15.87:0/1384303513 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:50.985 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.199+0000 7fb9f3fff640 1 -- 172.21.15.87:0/1384303513 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f4105800 con 0x7fb9f4104ae0 2024-09-13T17:04:50.985 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.200+0000 7fb9f3fff640 1 --2- 172.21.15.87:0/1384303513 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9f4104ae0 0x7fb9f4104ee0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4009820 tx=0x7fb9e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9303955d55dedc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:50.985 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.200+0000 7fb9f37fe640 1 -- 172.21.15.87:0/1384303513 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9e402ae70 con 0x7fb9f4104ae0 2024-09-13T17:04:50.985 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.200+0000 7fb9f37fe640 1 -- 172.21.15.87:0/1384303513 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb9e40328f0 con 0x7fb9f4104ae0 2024-09-13T17:04:50.985 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.200+0000 7fb9f37fe640 1 -- 172.21.15.87:0/1384303513 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9e4030850 con 0x7fb9f4104ae0 2024-09-13T17:04:50.985 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.201+0000 7fb9fa329640 1 -- 172.21.15.87:0/1384303513 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9f4104ae0 msgr2=0x7fb9f4104ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:50.985 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.201+0000 7fb9fa329640 1 --2- 172.21.15.87:0/1384303513 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9f4104ae0 0x7fb9f4104ee0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4009820 tx=0x7fb9e402a270 comp rx=0 tx=0).stop 2024-09-13T17:04:50.985 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.201+0000 7fb9fa329640 1 -- 172.21.15.87:0/1384303513 shutdown_connections 2024-09-13T17:04:50.986 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.201+0000 7fb9fa329640 1 --2- 172.21.15.87:0/1384303513 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9f4104ae0 0x7fb9f4104ee0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:50.986 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.201+0000 7fb9fa329640 1 -- 172.21.15.87:0/1384303513 >> 172.21.15.87:0/1384303513 conn(0x7fb9f40ff510 msgr2=0x7fb9f4101930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:50.986 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.201+0000 7fb9fa329640 1 -- 172.21.15.87:0/1384303513 shutdown_connections 2024-09-13T17:04:50.986 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.201+0000 7fb9fa329640 1 -- 172.21.15.87:0/1384303513 wait complete. 2024-09-13T17:04:50.986 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.201+0000 7fb9fa329640 1 Processor -- start 2024-09-13T17:04:50.986 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.202+0000 7fb9fa329640 1 -- start start 2024-09-13T17:04:50.986 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.202+0000 7fb9fa329640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9f4104ae0 0x7fb9f4198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:50.986 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.202+0000 7fb9fa329640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f4198870 con 0x7fb9f4104ae0 2024-09-13T17:04:50.986 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.202+0000 7fb9f3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9f4104ae0 0x7fb9f4198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:50.986 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.202+0000 7fb9f3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9f4104ae0 0x7fb9f4198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54378/0 (socket says 172.21.15.87:54378) 2024-09-13T17:04:50.986 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.202+0000 7fb9f3fff640 1 -- 172.21.15.87:0/334220328 learned_addr learned my addr 172.21.15.87:0/334220328 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:50.986 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.202+0000 7fb9f3fff640 1 -- 172.21.15.87:0/334220328 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e40094d0 con 0x7fb9f4104ae0 2024-09-13T17:04:50.986 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.202+0000 7fb9f3fff640 1 --2- 172.21.15.87:0/334220328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9f4104ae0 0x7fb9f4198330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4030560 tx=0x7fb9e4030d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:50.987 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.202+0000 7fb9f1ffb640 1 -- 172.21.15.87:0/334220328 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9e4032da0 con 0x7fb9f4104ae0 2024-09-13T17:04:50.987 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.202+0000 7fb9f1ffb640 1 -- 172.21.15.87:0/334220328 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb9e403b8e0 con 0x7fb9f4104ae0 2024-09-13T17:04:50.987 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.202+0000 7fb9fa329640 1 -- 172.21.15.87:0/334220328 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f4198a70 con 0x7fb9f4104ae0 2024-09-13T17:04:50.987 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.202+0000 7fb9f1ffb640 1 -- 172.21.15.87:0/334220328 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9e403a800 con 0x7fb9f4104ae0 2024-09-13T17:04:50.987 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.202+0000 7fb9fa329640 1 -- 172.21.15.87:0/334220328 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f4198f10 con 0x7fb9f4104ae0 2024-09-13T17:04:50.987 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.203+0000 7fb9f1ffb640 1 -- 172.21.15.87:0/334220328 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 11) v1 ==== 45448+0+0 (secure 0 0 0) 0x7fb9e4039040 con 0x7fb9f4104ae0 2024-09-13T17:04:50.987 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.203+0000 7fb9f1ffb640 1 --2- 172.21.15.87:0/334220328 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb9e0038550 0x7fb9e003aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:50.987 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.203+0000 7fb9fa329640 1 -- 172.21.15.87:0/334220328 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9f4108a30 con 0x7fb9f4104ae0 2024-09-13T17:04:50.987 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.203+0000 7fb9f1ffb640 1 -- 172.21.15.87:0/334220328 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb9e406b9a0 con 0x7fb9f4104ae0 2024-09-13T17:04:50.987 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.203+0000 7fb9ebfff640 1 --2- 172.21.15.87:0/334220328 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb9e0038550 0x7fb9e003aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:50.987 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.204+0000 7fb9ebfff640 1 --2- 172.21.15.87:0/334220328 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb9e0038550 0x7fb9e003aa10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0098c0 tx=0x7fb9dc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:50.987 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.208+0000 7fb9f1ffb640 1 -- 172.21.15.87:0/334220328 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb9e403f020 con 0x7fb9f4104ae0 2024-09-13T17:04:50.987 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.354+0000 7fb9f1ffb640 1 -- 172.21.15.87:0/334220328 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7fb9e4066820 con 0x7fb9f4104ae0 2024-09-13T17:04:50.988 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.396+0000 7fb9fa329640 1 -- 172.21.15.87:0/334220328 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9f419b7f0 con 0x7fb9e0038550 2024-09-13T17:04:50.988 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.445+0000 7fb9f1ffb640 1 -- 172.21.15.87:0/334220328 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fb9f419b7f0 con 0x7fb9e0038550 2024-09-13T17:04:50.988 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.448+0000 7fb9fa329640 1 -- 172.21.15.87:0/334220328 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb9e0038550 msgr2=0x7fb9e003aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:50.988 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.448+0000 7fb9fa329640 1 --2- 172.21.15.87:0/334220328 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb9e0038550 0x7fb9e003aa10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0098c0 tx=0x7fb9dc006db0 comp rx=0 tx=0).stop 2024-09-13T17:04:50.988 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.448+0000 7fb9fa329640 1 -- 172.21.15.87:0/334220328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9f4104ae0 msgr2=0x7fb9f4198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:50.988 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.448+0000 7fb9fa329640 1 --2- 172.21.15.87:0/334220328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9f4104ae0 0x7fb9f4198330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4030560 tx=0x7fb9e4030d90 comp rx=0 tx=0).stop 2024-09-13T17:04:50.988 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.448+0000 7fb9fa329640 1 -- 172.21.15.87:0/334220328 shutdown_connections 2024-09-13T17:04:50.988 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.448+0000 7fb9fa329640 1 --2- 172.21.15.87:0/334220328 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb9e0038550 0x7fb9e003aa10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:50.988 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.448+0000 7fb9fa329640 1 --2- 172.21.15.87:0/334220328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9f4104ae0 0x7fb9f4198330 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:50.988 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.448+0000 7fb9fa329640 1 -- 172.21.15.87:0/334220328 >> 172.21.15.87:0/334220328 conn(0x7fb9f40ff510 msgr2=0x7fb9f41000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:50.988 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.448+0000 7fb9fa329640 1 -- 172.21.15.87:0/334220328 shutdown_connections 2024-09-13T17:04:50.988 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:50.448+0000 7fb9fa329640 1 -- 172.21.15.87:0/334220328 wait complete. 2024-09-13T17:04:50.988 INFO:teuthology.orchestra.run.smithi087.stdout:Creating initial admin user... 2024-09-13T17:04:51.447 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:51 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:04:51.447 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:51 smithi087 ceph-mon[30934]: mgrmap e12: x(active, since 2s) 2024-09-13T17:04:51.447 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:51 smithi087 ceph-mon[30934]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:04:51.447 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:51 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:04:51.447 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:51 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:04:52.956 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$pBYk4lTQT4P9zzcLc8Tlq.mLZ/Qk83V//1xiGKE8JHzWlq.I1G3aO", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726247091, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-13T17:04:52.956 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.349+0000 7f3129713640 1 Processor -- start 2024-09-13T17:04:52.956 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.349+0000 7f3129713640 1 -- start start 2024-09-13T17:04:52.956 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.350+0000 7f3129713640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31241056f0 0x7f3124105af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:52.956 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.350+0000 7f3129713640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3124106030 con 0x7f31241056f0 2024-09-13T17:04:52.956 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.350+0000 7f3122ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31241056f0 0x7f3124105af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:52.956 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.350+0000 7f3122ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31241056f0 0x7f3124105af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54390/0 (socket says 172.21.15.87:54390) 2024-09-13T17:04:52.957 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.350+0000 7f3122ffd640 1 -- 172.21.15.87:0/3751381536 learned_addr learned my addr 172.21.15.87:0/3751381536 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:52.957 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.350+0000 7f3122ffd640 1 -- 172.21.15.87:0/3751381536 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3124106170 con 0x7f31241056f0 2024-09-13T17:04:52.957 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.351+0000 7f3122ffd640 1 --2- 172.21.15.87:0/3751381536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31241056f0 0x7f3124105af0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f311c009820 tx=0x7f311c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca1beb603587898d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:52.957 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.351+0000 7f3121ffb640 1 -- 172.21.15.87:0/3751381536 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f311c02ae70 con 0x7f31241056f0 2024-09-13T17:04:52.957 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.351+0000 7f3121ffb640 1 -- 172.21.15.87:0/3751381536 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f311c0328f0 con 0x7f31241056f0 2024-09-13T17:04:52.957 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.351+0000 7f3121ffb640 1 -- 172.21.15.87:0/3751381536 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f311c030850 con 0x7f31241056f0 2024-09-13T17:04:52.957 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.351+0000 7f3129713640 1 -- 172.21.15.87:0/3751381536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31241056f0 msgr2=0x7f3124105af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:52.957 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.351+0000 7f3129713640 1 --2- 172.21.15.87:0/3751381536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31241056f0 0x7f3124105af0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f311c009820 tx=0x7f311c02a270 comp rx=0 tx=0).stop 2024-09-13T17:04:52.957 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.351+0000 7f3129713640 1 -- 172.21.15.87:0/3751381536 shutdown_connections 2024-09-13T17:04:52.957 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.351+0000 7f3129713640 1 --2- 172.21.15.87:0/3751381536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31241056f0 0x7f3124105af0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:52.958 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.351+0000 7f3129713640 1 -- 172.21.15.87:0/3751381536 >> 172.21.15.87:0/3751381536 conn(0x7f3124100ee0 msgr2=0x7f3124103360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:52.958 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.352+0000 7f3129713640 1 -- 172.21.15.87:0/3751381536 shutdown_connections 2024-09-13T17:04:52.958 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.352+0000 7f3129713640 1 -- 172.21.15.87:0/3751381536 wait complete. 2024-09-13T17:04:52.958 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.352+0000 7f3129713640 1 Processor -- start 2024-09-13T17:04:52.958 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.352+0000 7f3129713640 1 -- start start 2024-09-13T17:04:52.958 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.352+0000 7f3129713640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31241056f0 0x7f3124199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:52.958 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.352+0000 7f3129713640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3124199990 con 0x7f31241056f0 2024-09-13T17:04:52.958 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.352+0000 7f3122ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31241056f0 0x7f3124199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:52.958 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.353+0000 7f3122ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31241056f0 0x7f3124199450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54402/0 (socket says 172.21.15.87:54402) 2024-09-13T17:04:52.958 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.353+0000 7f3122ffd640 1 -- 172.21.15.87:0/254508543 learned_addr learned my addr 172.21.15.87:0/254508543 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:52.958 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.353+0000 7f3122ffd640 1 -- 172.21.15.87:0/254508543 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f311c0094d0 con 0x7f31241056f0 2024-09-13T17:04:52.958 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.353+0000 7f3122ffd640 1 --2- 172.21.15.87:0/254508543 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31241056f0 0x7f3124199450 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f311c030560 tx=0x7f311c030d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:52.959 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.353+0000 7f311bfff640 1 -- 172.21.15.87:0/254508543 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f311c032da0 con 0x7f31241056f0 2024-09-13T17:04:52.959 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.353+0000 7f311bfff640 1 -- 172.21.15.87:0/254508543 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f311c03b8e0 con 0x7f31241056f0 2024-09-13T17:04:52.959 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.353+0000 7f3129713640 1 -- 172.21.15.87:0/254508543 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3124199b90 con 0x7f31241056f0 2024-09-13T17:04:52.959 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.353+0000 7f311bfff640 1 -- 172.21.15.87:0/254508543 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f311c03a760 con 0x7f31241056f0 2024-09-13T17:04:52.959 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.353+0000 7f3129713640 1 -- 172.21.15.87:0/254508543 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f312419a030 con 0x7f31241056f0 2024-09-13T17:04:52.959 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.354+0000 7f3129713640 1 -- 172.21.15.87:0/254508543 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3124107560 con 0x7f31241056f0 2024-09-13T17:04:52.959 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.354+0000 7f311bfff640 1 -- 172.21.15.87:0/254508543 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f311c039040 con 0x7f31241056f0 2024-09-13T17:04:52.959 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.354+0000 7f311bfff640 1 --2- 172.21.15.87:0/254508543 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3110038670 0x7f311003ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:52.959 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.354+0000 7f311bfff640 1 -- 172.21.15.87:0/254508543 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f311c06bcc0 con 0x7f31241056f0 2024-09-13T17:04:52.959 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.354+0000 7f31227fc640 1 --2- 172.21.15.87:0/254508543 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3110038670 0x7f311003ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:52.959 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.355+0000 7f31227fc640 1 --2- 172.21.15.87:0/254508543 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3110038670 0x7f311003ab30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f310c0098c0 tx=0x7f310c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:52.959 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.359+0000 7f311bfff640 1 -- 172.21.15.87:0/254508543 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f311c031b50 con 0x7f31241056f0 2024-09-13T17:04:52.959 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.537+0000 7f3129713640 1 -- 172.21.15.87:0/254508543 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f3124061900 con 0x7f3110038670 2024-09-13T17:04:52.960 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.763+0000 7f311bfff640 1 -- 172.21.15.87:0/254508543 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f3124061900 con 0x7f3110038670 2024-09-13T17:04:52.960 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.765+0000 7f3129713640 1 -- 172.21.15.87:0/254508543 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3110038670 msgr2=0x7f311003ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:52.960 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.765+0000 7f3129713640 1 --2- 172.21.15.87:0/254508543 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3110038670 0x7f311003ab30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f310c0098c0 tx=0x7f310c006db0 comp rx=0 tx=0).stop 2024-09-13T17:04:52.960 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.765+0000 7f3129713640 1 -- 172.21.15.87:0/254508543 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31241056f0 msgr2=0x7f3124199450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:52.960 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.765+0000 7f3129713640 1 --2- 172.21.15.87:0/254508543 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31241056f0 0x7f3124199450 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f311c030560 tx=0x7f311c030d90 comp rx=0 tx=0).stop 2024-09-13T17:04:52.960 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.765+0000 7f3129713640 1 -- 172.21.15.87:0/254508543 shutdown_connections 2024-09-13T17:04:52.960 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.765+0000 7f3129713640 1 --2- 172.21.15.87:0/254508543 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3110038670 0x7f311003ab30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:52.960 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.765+0000 7f3129713640 1 --2- 172.21.15.87:0/254508543 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31241056f0 0x7f3124199450 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:52.960 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.765+0000 7f3129713640 1 -- 172.21.15.87:0/254508543 >> 172.21.15.87:0/254508543 conn(0x7f3124100ee0 msgr2=0x7f3124101ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:52.960 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.765+0000 7f3129713640 1 -- 172.21.15.87:0/254508543 shutdown_connections 2024-09-13T17:04:52.960 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:51.765+0000 7f3129713640 1 -- 172.21.15.87:0/254508543 wait complete. 2024-09-13T17:04:52.960 INFO:teuthology.orchestra.run.smithi087.stdout:Fetching dashboard port number... 2024-09-13T17:04:53.073 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:52 smithi087 ceph-mon[30934]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:04:53.073 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:52 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:04:54.092 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:53 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3471934693' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-13T17:04:54.208 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 8443 2024-09-13T17:04:54.208 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.385+0000 7f525a1b0640 1 Processor -- start 2024-09-13T17:04:54.208 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.385+0000 7f525a1b0640 1 -- start start 2024-09-13T17:04:54.208 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.385+0000 7f525a1b0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52541056f0 0x7f5254105af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:54.209 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.385+0000 7f525a1b0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52541060c0 con 0x7f52541056f0 2024-09-13T17:04:54.209 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.385+0000 7f52537fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52541056f0 0x7f5254105af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:54.209 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.385+0000 7f52537fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52541056f0 0x7f5254105af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54414/0 (socket says 172.21.15.87:54414) 2024-09-13T17:04:54.209 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.385+0000 7f52537fe640 1 -- 172.21.15.87:0/1849355677 learned_addr learned my addr 172.21.15.87:0/1849355677 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:54.209 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.385+0000 7f52537fe640 1 -- 172.21.15.87:0/1849355677 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52541068a0 con 0x7f52541056f0 2024-09-13T17:04:54.210 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.386+0000 7f52537fe640 1 --2- 172.21.15.87:0/1849355677 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52541056f0 0x7f5254105af0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5244009820 tx=0x7f524402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68d93a8577beeef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:54.210 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.386+0000 7f52527fc640 1 -- 172.21.15.87:0/1849355677 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f524402ae70 con 0x7f52541056f0 2024-09-13T17:04:54.210 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.386+0000 7f52527fc640 1 -- 172.21.15.87:0/1849355677 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f52440328f0 con 0x7f52541056f0 2024-09-13T17:04:54.210 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.386+0000 7f52527fc640 1 -- 172.21.15.87:0/1849355677 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5244030850 con 0x7f52541056f0 2024-09-13T17:04:54.210 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.387+0000 7f525a1b0640 1 -- 172.21.15.87:0/1849355677 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52541056f0 msgr2=0x7f5254105af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:54.211 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.387+0000 7f525a1b0640 1 --2- 172.21.15.87:0/1849355677 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52541056f0 0x7f5254105af0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5244009820 tx=0x7f524402a270 comp rx=0 tx=0).stop 2024-09-13T17:04:54.211 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.387+0000 7f525a1b0640 1 -- 172.21.15.87:0/1849355677 shutdown_connections 2024-09-13T17:04:54.211 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.387+0000 7f525a1b0640 1 --2- 172.21.15.87:0/1849355677 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52541056f0 0x7f5254105af0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:54.211 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.387+0000 7f525a1b0640 1 -- 172.21.15.87:0/1849355677 >> 172.21.15.87:0/1849355677 conn(0x7f5254100f40 msgr2=0x7f5254103360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:54.211 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.387+0000 7f525a1b0640 1 -- 172.21.15.87:0/1849355677 shutdown_connections 2024-09-13T17:04:54.212 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.387+0000 7f525a1b0640 1 -- 172.21.15.87:0/1849355677 wait complete. 2024-09-13T17:04:54.212 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.388+0000 7f525a1b0640 1 Processor -- start 2024-09-13T17:04:54.212 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.388+0000 7f525a1b0640 1 -- start start 2024-09-13T17:04:54.212 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.388+0000 7f525a1b0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52541056f0 0x7f5254199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:54.212 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.388+0000 7f525a1b0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5254199960 con 0x7f52541056f0 2024-09-13T17:04:54.213 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.388+0000 7f52537fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52541056f0 0x7f5254199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:54.213 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.388+0000 7f52537fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52541056f0 0x7f5254199420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54420/0 (socket says 172.21.15.87:54420) 2024-09-13T17:04:54.213 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.388+0000 7f52537fe640 1 -- 172.21.15.87:0/3471934693 learned_addr learned my addr 172.21.15.87:0/3471934693 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:54.213 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.388+0000 7f52537fe640 1 -- 172.21.15.87:0/3471934693 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52440094d0 con 0x7f52541056f0 2024-09-13T17:04:54.213 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.388+0000 7f52537fe640 1 --2- 172.21.15.87:0/3471934693 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52541056f0 0x7f5254199420 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5244030560 tx=0x7f5244030d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:54.213 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.389+0000 7f5250ff9640 1 -- 172.21.15.87:0/3471934693 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5244032da0 con 0x7f52541056f0 2024-09-13T17:04:54.213 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.389+0000 7f5250ff9640 1 -- 172.21.15.87:0/3471934693 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f524403b8e0 con 0x7f52541056f0 2024-09-13T17:04:54.213 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.389+0000 7f525a1b0640 1 -- 172.21.15.87:0/3471934693 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5254199b60 con 0x7f52541056f0 2024-09-13T17:04:54.213 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.389+0000 7f5250ff9640 1 -- 172.21.15.87:0/3471934693 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f524403a800 con 0x7f52541056f0 2024-09-13T17:04:54.214 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.389+0000 7f525a1b0640 1 -- 172.21.15.87:0/3471934693 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f525419a000 con 0x7f52541056f0 2024-09-13T17:04:54.214 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.390+0000 7f5250ff9640 1 -- 172.21.15.87:0/3471934693 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f5244039040 con 0x7f52541056f0 2024-09-13T17:04:54.214 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.390+0000 7f525a1b0640 1 -- 172.21.15.87:0/3471934693 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5254109ad0 con 0x7f52541056f0 2024-09-13T17:04:54.214 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.390+0000 7f5250ff9640 1 --2- 172.21.15.87:0/3471934693 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f523c038670 0x7f523c03ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:54.214 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.390+0000 7f5250ff9640 1 -- 172.21.15.87:0/3471934693 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f524406bb50 con 0x7f52541056f0 2024-09-13T17:04:54.214 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.390+0000 7f5252ffd640 1 --2- 172.21.15.87:0/3471934693 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f523c038670 0x7f523c03ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:54.214 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.390+0000 7f5252ffd640 1 --2- 172.21.15.87:0/3471934693 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f523c038670 0x7f523c03ab30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f52480098c0 tx=0x7f5248006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:54.214 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.395+0000 7f5250ff9640 1 -- 172.21.15.87:0/3471934693 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f524404b6c0 con 0x7f52541056f0 2024-09-13T17:04:54.214 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.557+0000 7f525a1b0640 1 -- 172.21.15.87:0/3471934693 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f5254109d10 con 0x7f52541056f0 2024-09-13T17:04:54.215 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.557+0000 7f5250ff9640 1 -- 172.21.15.87:0/3471934693 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f5244037070 con 0x7f52541056f0 2024-09-13T17:04:54.215 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.559+0000 7f525a1b0640 1 -- 172.21.15.87:0/3471934693 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f523c038670 msgr2=0x7f523c03ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:54.215 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.559+0000 7f525a1b0640 1 --2- 172.21.15.87:0/3471934693 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f523c038670 0x7f523c03ab30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f52480098c0 tx=0x7f5248006db0 comp rx=0 tx=0).stop 2024-09-13T17:04:54.215 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.559+0000 7f525a1b0640 1 -- 172.21.15.87:0/3471934693 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52541056f0 msgr2=0x7f5254199420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:54.215 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.559+0000 7f525a1b0640 1 --2- 172.21.15.87:0/3471934693 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52541056f0 0x7f5254199420 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5244030560 tx=0x7f5244030d90 comp rx=0 tx=0).stop 2024-09-13T17:04:54.215 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.559+0000 7f525a1b0640 1 -- 172.21.15.87:0/3471934693 shutdown_connections 2024-09-13T17:04:54.216 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.559+0000 7f525a1b0640 1 --2- 172.21.15.87:0/3471934693 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f523c038670 0x7f523c03ab30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:54.216 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.559+0000 7f525a1b0640 1 --2- 172.21.15.87:0/3471934693 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52541056f0 0x7f5254199420 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:54.216 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.559+0000 7f525a1b0640 1 -- 172.21.15.87:0/3471934693 >> 172.21.15.87:0/3471934693 conn(0x7f5254100f40 msgr2=0x7f5254101b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:54.216 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.560+0000 7f525a1b0640 1 -- 172.21.15.87:0/3471934693 shutdown_connections 2024-09-13T17:04:54.216 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:53.560+0000 7f525a1b0640 1 -- 172.21.15.87:0/3471934693 wait complete. 2024-09-13T17:04:54.216 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T17:04:54.216 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout disabled 2024-09-13T17:04:54.218 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T17:04:54.218 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout inactive 2024-09-13T17:04:54.218 INFO:teuthology.orchestra.run.smithi087.stdout:firewalld.service is not enabled 2024-09-13T17:04:54.218 INFO:teuthology.orchestra.run.smithi087.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-13T17:04:54.220 INFO:teuthology.orchestra.run.smithi087.stdout:Ceph Dashboard is now available at: 2024-09-13T17:04:54.220 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:04:54.220 INFO:teuthology.orchestra.run.smithi087.stdout: URL: https://smithi087.front.sepia.ceph.com:8443/ 2024-09-13T17:04:54.220 INFO:teuthology.orchestra.run.smithi087.stdout: User: admin 2024-09-13T17:04:54.220 INFO:teuthology.orchestra.run.smithi087.stdout: Password: 8meg6ytq26 2024-09-13T17:04:54.220 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:04:54.221 INFO:teuthology.orchestra.run.smithi087.stdout:Saving cluster configuration to /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/config directory 2024-09-13T17:04:54.221 INFO:teuthology.orchestra.run.smithi087.stdout:Enabling autotune for osd_memory_target 2024-09-13T17:04:55.486 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.599+0000 7fb1eb5e5640 1 Processor -- start 2024-09-13T17:04:55.486 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.599+0000 7fb1eb5e5640 1 -- start start 2024-09-13T17:04:55.486 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.599+0000 7fb1eb5e5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1e4106150 0x7fb1e4108540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:55.486 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.599+0000 7fb1eb5e5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e4079da0 con 0x7fb1e4106150 2024-09-13T17:04:55.486 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.600+0000 7fb1e9381640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1e4106150 0x7fb1e4108540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:55.486 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.600+0000 7fb1e9381640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1e4106150 0x7fb1e4108540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54422/0 (socket says 172.21.15.87:54422) 2024-09-13T17:04:55.486 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.600+0000 7fb1e9381640 1 -- 172.21.15.87:0/2139381651 learned_addr learned my addr 172.21.15.87:0/2139381651 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:55.486 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.600+0000 7fb1e9381640 1 -- 172.21.15.87:0/2139381651 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e4108a80 con 0x7fb1e4106150 2024-09-13T17:04:55.486 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.601+0000 7fb1e9381640 1 --2- 172.21.15.87:0/2139381651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1e4106150 0x7fb1e4108540 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0009820 tx=0x7fb1e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee71dbc630639ff4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:55.486 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.601+0000 7fb1dbfff640 1 -- 172.21.15.87:0/2139381651 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb1e002ae70 con 0x7fb1e4106150 2024-09-13T17:04:55.486 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.601+0000 7fb1dbfff640 1 -- 172.21.15.87:0/2139381651 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb1e00328f0 con 0x7fb1e4106150 2024-09-13T17:04:55.487 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.601+0000 7fb1dbfff640 1 -- 172.21.15.87:0/2139381651 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb1e0030850 con 0x7fb1e4106150 2024-09-13T17:04:55.487 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.601+0000 7fb1eb5e5640 1 -- 172.21.15.87:0/2139381651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1e4106150 msgr2=0x7fb1e4108540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:55.487 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.601+0000 7fb1eb5e5640 1 --2- 172.21.15.87:0/2139381651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1e4106150 0x7fb1e4108540 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0009820 tx=0x7fb1e002a270 comp rx=0 tx=0).stop 2024-09-13T17:04:55.487 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.601+0000 7fb1eb5e5640 1 -- 172.21.15.87:0/2139381651 shutdown_connections 2024-09-13T17:04:55.487 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.601+0000 7fb1eb5e5640 1 --2- 172.21.15.87:0/2139381651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1e4106150 0x7fb1e4108540 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:55.487 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.601+0000 7fb1eb5e5640 1 -- 172.21.15.87:0/2139381651 >> 172.21.15.87:0/2139381651 conn(0x7fb1e40ffe10 msgr2=0x7fb1e4102230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:55.487 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.602+0000 7fb1eb5e5640 1 -- 172.21.15.87:0/2139381651 shutdown_connections 2024-09-13T17:04:55.487 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.602+0000 7fb1eb5e5640 1 -- 172.21.15.87:0/2139381651 wait complete. 2024-09-13T17:04:55.487 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.602+0000 7fb1eb5e5640 1 Processor -- start 2024-09-13T17:04:55.487 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.602+0000 7fb1eb5e5640 1 -- start start 2024-09-13T17:04:55.488 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.602+0000 7fb1eb5e5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1e4106150 0x7fb1e4199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:55.488 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.602+0000 7fb1eb5e5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e4199950 con 0x7fb1e4106150 2024-09-13T17:04:55.488 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.602+0000 7fb1e9381640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1e4106150 0x7fb1e4199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:55.488 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.602+0000 7fb1e9381640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1e4106150 0x7fb1e4199410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54436/0 (socket says 172.21.15.87:54436) 2024-09-13T17:04:55.488 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.602+0000 7fb1e9381640 1 -- 172.21.15.87:0/2937580040 learned_addr learned my addr 172.21.15.87:0/2937580040 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:55.488 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.603+0000 7fb1e9381640 1 -- 172.21.15.87:0/2937580040 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e00094d0 con 0x7fb1e4106150 2024-09-13T17:04:55.488 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.603+0000 7fb1e9381640 1 --2- 172.21.15.87:0/2937580040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1e4106150 0x7fb1e4199410 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0030560 tx=0x7fb1e0030d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:55.488 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.603+0000 7fb1da7fc640 1 -- 172.21.15.87:0/2937580040 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb1e0032da0 con 0x7fb1e4106150 2024-09-13T17:04:55.488 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.603+0000 7fb1da7fc640 1 -- 172.21.15.87:0/2937580040 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb1e003b8e0 con 0x7fb1e4106150 2024-09-13T17:04:55.488 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.603+0000 7fb1eb5e5640 1 -- 172.21.15.87:0/2937580040 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e4199b50 con 0x7fb1e4106150 2024-09-13T17:04:55.488 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.603+0000 7fb1da7fc640 1 -- 172.21.15.87:0/2937580040 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb1e003a760 con 0x7fb1e4106150 2024-09-13T17:04:55.488 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.603+0000 7fb1eb5e5640 1 -- 172.21.15.87:0/2937580040 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e4199ff0 con 0x7fb1e4106150 2024-09-13T17:04:55.489 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.604+0000 7fb1da7fc640 1 -- 172.21.15.87:0/2937580040 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7fb1e0039040 con 0x7fb1e4106150 2024-09-13T17:04:55.489 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.604+0000 7fb1eb5e5640 1 -- 172.21.15.87:0/2937580040 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e4109880 con 0x7fb1e4106150 2024-09-13T17:04:55.489 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.604+0000 7fb1da7fc640 1 --2- 172.21.15.87:0/2937580040 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb1d00386c0 0x7fb1d003ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:55.489 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.604+0000 7fb1da7fc640 1 -- 172.21.15.87:0/2937580040 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb1e006bc90 con 0x7fb1e4106150 2024-09-13T17:04:55.489 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.604+0000 7fb1e8b80640 1 --2- 172.21.15.87:0/2937580040 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb1d00386c0 0x7fb1d003ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:55.489 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.605+0000 7fb1e8b80640 1 --2- 172.21.15.87:0/2937580040 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb1d00386c0 0x7fb1d003ab80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb1d40098c0 tx=0x7fb1d4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:55.489 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.609+0000 7fb1da7fc640 1 -- 172.21.15.87:0/2937580040 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb1e0031d70 con 0x7fb1e4106150 2024-09-13T17:04:55.489 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.764+0000 7fb1da7fc640 1 -- 172.21.15.87:0/2937580040 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fb1e004bd00 con 0x7fb1e4106150 2024-09-13T17:04:55.489 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.773+0000 7fb1eb5e5640 1 -- 172.21.15.87:0/2937580040 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7fb1e4109ac0 con 0x7fb1e4106150 2024-09-13T17:04:55.489 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.774+0000 7fb1da7fc640 1 -- 172.21.15.87:0/2937580040 <== mon.0 v2:172.21.15.87:3300/0 8 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7fb1e003f070 con 0x7fb1e4106150 2024-09-13T17:04:55.489 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.776+0000 7fb1eb5e5640 1 -- 172.21.15.87:0/2937580040 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb1d00386c0 msgr2=0x7fb1d003ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:55.489 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.776+0000 7fb1eb5e5640 1 --2- 172.21.15.87:0/2937580040 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb1d00386c0 0x7fb1d003ab80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb1d40098c0 tx=0x7fb1d4006db0 comp rx=0 tx=0).stop 2024-09-13T17:04:55.489 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.776+0000 7fb1eb5e5640 1 -- 172.21.15.87:0/2937580040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1e4106150 msgr2=0x7fb1e4199410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:55.490 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.776+0000 7fb1eb5e5640 1 --2- 172.21.15.87:0/2937580040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1e4106150 0x7fb1e4199410 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0030560 tx=0x7fb1e0030d90 comp rx=0 tx=0).stop 2024-09-13T17:04:55.490 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.776+0000 7fb1eb5e5640 1 -- 172.21.15.87:0/2937580040 shutdown_connections 2024-09-13T17:04:55.490 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.776+0000 7fb1eb5e5640 1 --2- 172.21.15.87:0/2937580040 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb1d00386c0 0x7fb1d003ab80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:55.490 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.776+0000 7fb1eb5e5640 1 --2- 172.21.15.87:0/2937580040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1e4106150 0x7fb1e4199410 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:55.490 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.776+0000 7fb1eb5e5640 1 -- 172.21.15.87:0/2937580040 >> 172.21.15.87:0/2937580040 conn(0x7fb1e40ffe10 msgr2=0x7fb1e41009f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:55.490 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.776+0000 7fb1eb5e5640 1 -- 172.21.15.87:0/2937580040 shutdown_connections 2024-09-13T17:04:55.490 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:54.776+0000 7fb1eb5e5640 1 -- 172.21.15.87:0/2937580040 wait complete. 2024-09-13T17:04:56.113 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:55 smithi087 ceph-mon[30934]: mgrmap e13: x(active, since 6s) 2024-09-13T17:04:56.640 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.855+0000 7f093d95b640 1 Processor -- start 2024-09-13T17:04:56.640 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.855+0000 7f093d95b640 1 -- start start 2024-09-13T17:04:56.640 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.855+0000 7f093d95b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09381045a0 0x7f09381049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:56.640 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.855+0000 7f093d95b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0938104f70 con 0x7f09381045a0 2024-09-13T17:04:56.641 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.855+0000 7f0936ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09381045a0 0x7f09381049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:56.641 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.855+0000 7f0936ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09381045a0 0x7f09381049a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54450/0 (socket says 172.21.15.87:54450) 2024-09-13T17:04:56.641 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.855+0000 7f0936ffd640 1 -- 172.21.15.87:0/1903558003 learned_addr learned my addr 172.21.15.87:0/1903558003 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:56.641 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.856+0000 7f0936ffd640 1 -- 172.21.15.87:0/1903558003 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09381057a0 con 0x7f09381045a0 2024-09-13T17:04:56.641 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.856+0000 7f0936ffd640 1 --2- 172.21.15.87:0/1903558003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09381045a0 0x7f09381049a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0928009820 tx=0x7f092802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c96dfaa981197d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:56.641 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.856+0000 7f09367fc640 1 -- 172.21.15.87:0/1903558003 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f092802ae70 con 0x7f09381045a0 2024-09-13T17:04:56.641 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.856+0000 7f09367fc640 1 -- 172.21.15.87:0/1903558003 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f09280328f0 con 0x7f09381045a0 2024-09-13T17:04:56.641 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.856+0000 7f09367fc640 1 -- 172.21.15.87:0/1903558003 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0928030850 con 0x7f09381045a0 2024-09-13T17:04:56.641 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.857+0000 7f093d95b640 1 -- 172.21.15.87:0/1903558003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09381045a0 msgr2=0x7f09381049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:56.641 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.857+0000 7f093d95b640 1 --2- 172.21.15.87:0/1903558003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09381045a0 0x7f09381049a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0928009820 tx=0x7f092802a270 comp rx=0 tx=0).stop 2024-09-13T17:04:56.641 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.857+0000 7f093d95b640 1 -- 172.21.15.87:0/1903558003 shutdown_connections 2024-09-13T17:04:56.641 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.857+0000 7f093d95b640 1 --2- 172.21.15.87:0/1903558003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09381045a0 0x7f09381049a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:56.641 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.857+0000 7f093d95b640 1 -- 172.21.15.87:0/1903558003 >> 172.21.15.87:0/1903558003 conn(0x7f09380ffe10 msgr2=0x7f0938102230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:56.642 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.857+0000 7f093d95b640 1 -- 172.21.15.87:0/1903558003 shutdown_connections 2024-09-13T17:04:56.642 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.857+0000 7f093d95b640 1 -- 172.21.15.87:0/1903558003 wait complete. 2024-09-13T17:04:56.642 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.858+0000 7f093d95b640 1 Processor -- start 2024-09-13T17:04:56.642 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.858+0000 7f093d95b640 1 -- start start 2024-09-13T17:04:56.642 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.858+0000 7f093d95b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09381045a0 0x7f093818f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:56.642 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.858+0000 7f093d95b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093818fc50 con 0x7f09381045a0 2024-09-13T17:04:56.642 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.858+0000 7f0936ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09381045a0 0x7f093818f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:56.642 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.858+0000 7f0936ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09381045a0 0x7f093818f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54464/0 (socket says 172.21.15.87:54464) 2024-09-13T17:04:56.642 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.858+0000 7f0936ffd640 1 -- 172.21.15.87:0/1422790350 learned_addr learned my addr 172.21.15.87:0/1422790350 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:56.642 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.858+0000 7f0936ffd640 1 -- 172.21.15.87:0/1422790350 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09280094d0 con 0x7f09381045a0 2024-09-13T17:04:56.642 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.858+0000 7f0936ffd640 1 --2- 172.21.15.87:0/1422790350 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09381045a0 0x7f093818f710 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f092802a790 tx=0x7f0928030d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:56.642 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.859+0000 7f093c959640 1 -- 172.21.15.87:0/1422790350 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0928032da0 con 0x7f09381045a0 2024-09-13T17:04:56.642 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.859+0000 7f093c959640 1 -- 172.21.15.87:0/1422790350 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f092803b8e0 con 0x7f09381045a0 2024-09-13T17:04:56.643 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.859+0000 7f093d95b640 1 -- 172.21.15.87:0/1422790350 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f093818de90 con 0x7f09381045a0 2024-09-13T17:04:56.643 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.859+0000 7f093c959640 1 -- 172.21.15.87:0/1422790350 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f092803a6e0 con 0x7f09381045a0 2024-09-13T17:04:56.643 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.859+0000 7f093d95b640 1 -- 172.21.15.87:0/1422790350 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f093818e330 con 0x7f09381045a0 2024-09-13T17:04:56.643 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.859+0000 7f093c959640 1 -- 172.21.15.87:0/1422790350 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f0928039040 con 0x7f09381045a0 2024-09-13T17:04:56.643 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.860+0000 7f093c959640 1 --2- 172.21.15.87:0/1422790350 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0924038760 0x7f092403ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:56.643 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.860+0000 7f093c959640 1 -- 172.21.15.87:0/1422790350 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f092806bcd0 con 0x7f09381045a0 2024-09-13T17:04:56.643 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.860+0000 7f093d95b640 1 -- 172.21.15.87:0/1422790350 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0938104a20 con 0x7f09381045a0 2024-09-13T17:04:56.643 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.860+0000 7f092e7fc640 1 --2- 172.21.15.87:0/1422790350 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0924038760 0x7f092403ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:56.643 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.860+0000 7f092e7fc640 1 --2- 172.21.15.87:0/1422790350 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0924038760 0x7f092403ac20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f09200098c0 tx=0x7f0920006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:56.643 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:55.864+0000 7f093c959640 1 -- 172.21.15.87:0/1422790350 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f092803f020 con 0x7f09381045a0 2024-09-13T17:04:56.643 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:56.111+0000 7f093d95b640 1 -- 172.21.15.87:0/1422790350 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f09381089d0 con 0x7f09381045a0 2024-09-13T17:04:56.643 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:56.116+0000 7f093c959640 1 -- 172.21.15.87:0/1422790350 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7f0928037070 con 0x7f09381045a0 2024-09-13T17:04:56.643 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-13T17:04:56.644 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:56.118+0000 7f093d95b640 1 -- 172.21.15.87:0/1422790350 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0924038760 msgr2=0x7f092403ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:56.644 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:56.118+0000 7f093d95b640 1 --2- 172.21.15.87:0/1422790350 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0924038760 0x7f092403ac20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f09200098c0 tx=0x7f0920006db0 comp rx=0 tx=0).stop 2024-09-13T17:04:56.644 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:56.118+0000 7f093d95b640 1 -- 172.21.15.87:0/1422790350 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09381045a0 msgr2=0x7f093818f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:56.644 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:56.118+0000 7f093d95b640 1 --2- 172.21.15.87:0/1422790350 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09381045a0 0x7f093818f710 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f092802a790 tx=0x7f0928030d90 comp rx=0 tx=0).stop 2024-09-13T17:04:56.644 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:56.118+0000 7f093d95b640 1 -- 172.21.15.87:0/1422790350 shutdown_connections 2024-09-13T17:04:56.644 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:56.118+0000 7f093d95b640 1 --2- 172.21.15.87:0/1422790350 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0924038760 0x7f092403ac20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:56.644 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:56.119+0000 7f093d95b640 1 --2- 172.21.15.87:0/1422790350 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09381045a0 0x7f093818f710 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:56.644 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:56.119+0000 7f093d95b640 1 -- 172.21.15.87:0/1422790350 >> 172.21.15.87:0/1422790350 conn(0x7f09380ffe10 msgr2=0x7f0938100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:56.644 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:56.119+0000 7f093d95b640 1 -- 172.21.15.87:0/1422790350 shutdown_connections 2024-09-13T17:04:56.644 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-13T17:04:56.119+0000 7f093d95b640 1 -- 172.21.15.87:0/1422790350 wait complete. 2024-09-13T17:04:56.644 INFO:teuthology.orchestra.run.smithi087.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-13T17:04:56.644 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:04:56.644 INFO:teuthology.orchestra.run.smithi087.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-13T17:04:56.645 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:04:56.645 INFO:teuthology.orchestra.run.smithi087.stdout:Or, if you are only running a single cluster on this host: 2024-09-13T17:04:56.645 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:04:56.645 INFO:teuthology.orchestra.run.smithi087.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-13T17:04:56.645 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:04:56.645 INFO:teuthology.orchestra.run.smithi087.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-13T17:04:56.645 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:04:56.645 INFO:teuthology.orchestra.run.smithi087.stdout: ceph telemetry on 2024-09-13T17:04:56.645 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:04:56.645 INFO:teuthology.orchestra.run.smithi087.stdout:For more information see: 2024-09-13T17:04:56.645 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:04:56.645 INFO:teuthology.orchestra.run.smithi087.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-13T17:04:56.645 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:04:56.645 INFO:teuthology.orchestra.run.smithi087.stdout:Bootstrap complete. 2024-09-13T17:04:56.673 INFO:tasks.cephadm:Fetching config... 2024-09-13T17:04:56.673 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T17:04:56.673 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-13T17:04:56.690 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-13T17:04:56.690 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T17:04:56.690 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-13T17:04:56.746 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-13T17:04:56.746 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T17:04:56.746 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-13T17:04:56.811 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-13T17:04:56.811 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T17:04:56.812 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-13T17:04:56.867 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-13T17:04:56.868 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD5I1q8ufKZkvmR2eNk52XeTWiNf0avzcdVSYYjZSc9IWdiC2jA46Q8S5St34oyKtOMJJiuk3pCeQTKU1iV88yYkFlRzs8pMTVB2mO3YuLjWXCrbjdOuQ/RyxnJw5wBbdbFgH2bmmkU0ea90ALM4nJbtw4nfmL5mKXQ3FhyllHPYArm+uT8LuFr95yfiepuYcyQsa4b2HjDsFAA/R7tXty2kYr4iCfc+xpkzRMzsOivmry3sXPAj87K2fvDZ+r5PulqsQ3TFy+3ZO8n3/8P52hJNnvOEwiRFuaFTDW0hM6Wcl82HuKb9FufjuM6mHodtcQ+1wAvrVBxknGIBZtS9wiYPc0TOX0NqfMePPJGCZD6zWKebTmXHO44JRZmeoZyMSgy/3oMmLBudmEduhdR1Mog4UL7b2+YjwPSGFTt2AK6qza7+FmwPHqRry/YwcpLxBQSN5EGBNOIR6XVEdeqGx6oyjhnO6YUNWSURHPli/uo4wdIjKi3XfaN24WicUCA4qM= ceph-043d5bae-71f2-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T17:04:56.941 INFO:teuthology.orchestra.run.smithi087.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD5I1q8ufKZkvmR2eNk52XeTWiNf0avzcdVSYYjZSc9IWdiC2jA46Q8S5St34oyKtOMJJiuk3pCeQTKU1iV88yYkFlRzs8pMTVB2mO3YuLjWXCrbjdOuQ/RyxnJw5wBbdbFgH2bmmkU0ea90ALM4nJbtw4nfmL5mKXQ3FhyllHPYArm+uT8LuFr95yfiepuYcyQsa4b2HjDsFAA/R7tXty2kYr4iCfc+xpkzRMzsOivmry3sXPAj87K2fvDZ+r5PulqsQ3TFy+3ZO8n3/8P52hJNnvOEwiRFuaFTDW0hM6Wcl82HuKb9FufjuM6mHodtcQ+1wAvrVBxknGIBZtS9wiYPc0TOX0NqfMePPJGCZD6zWKebTmXHO44JRZmeoZyMSgy/3oMmLBudmEduhdR1Mog4UL7b2+YjwPSGFTt2AK6qza7+FmwPHqRry/YwcpLxBQSN5EGBNOIR6XVEdeqGx6oyjhnO6YUNWSURHPli/uo4wdIjKi3XfaN24WicUCA4qM= ceph-043d5bae-71f2-11ef-bceb-c7b262605968 2024-09-13T17:04:56.952 DEBUG:teuthology.orchestra.run.smithi118:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD5I1q8ufKZkvmR2eNk52XeTWiNf0avzcdVSYYjZSc9IWdiC2jA46Q8S5St34oyKtOMJJiuk3pCeQTKU1iV88yYkFlRzs8pMTVB2mO3YuLjWXCrbjdOuQ/RyxnJw5wBbdbFgH2bmmkU0ea90ALM4nJbtw4nfmL5mKXQ3FhyllHPYArm+uT8LuFr95yfiepuYcyQsa4b2HjDsFAA/R7tXty2kYr4iCfc+xpkzRMzsOivmry3sXPAj87K2fvDZ+r5PulqsQ3TFy+3ZO8n3/8P52hJNnvOEwiRFuaFTDW0hM6Wcl82HuKb9FufjuM6mHodtcQ+1wAvrVBxknGIBZtS9wiYPc0TOX0NqfMePPJGCZD6zWKebTmXHO44JRZmeoZyMSgy/3oMmLBudmEduhdR1Mog4UL7b2+YjwPSGFTt2AK6qza7+FmwPHqRry/YwcpLxBQSN5EGBNOIR6XVEdeqGx6oyjhnO6YUNWSURHPli/uo4wdIjKi3XfaN24WicUCA4qM= ceph-043d5bae-71f2-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T17:04:57.069 INFO:teuthology.orchestra.run.smithi118.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD5I1q8ufKZkvmR2eNk52XeTWiNf0avzcdVSYYjZSc9IWdiC2jA46Q8S5St34oyKtOMJJiuk3pCeQTKU1iV88yYkFlRzs8pMTVB2mO3YuLjWXCrbjdOuQ/RyxnJw5wBbdbFgH2bmmkU0ea90ALM4nJbtw4nfmL5mKXQ3FhyllHPYArm+uT8LuFr95yfiepuYcyQsa4b2HjDsFAA/R7tXty2kYr4iCfc+xpkzRMzsOivmry3sXPAj87K2fvDZ+r5PulqsQ3TFy+3ZO8n3/8P52hJNnvOEwiRFuaFTDW0hM6Wcl82HuKb9FufjuM6mHodtcQ+1wAvrVBxknGIBZtS9wiYPc0TOX0NqfMePPJGCZD6zWKebTmXHO44JRZmeoZyMSgy/3oMmLBudmEduhdR1Mog4UL7b2+YjwPSGFTt2AK6qza7+FmwPHqRry/YwcpLxBQSN5EGBNOIR6XVEdeqGx6oyjhnO6YUNWSURHPli/uo4wdIjKi3XfaN24WicUCA4qM= ceph-043d5bae-71f2-11ef-bceb-c7b262605968 2024-09-13T17:04:57.083 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD5I1q8ufKZkvmR2eNk52XeTWiNf0avzcdVSYYjZSc9IWdiC2jA46Q8S5St34oyKtOMJJiuk3pCeQTKU1iV88yYkFlRzs8pMTVB2mO3YuLjWXCrbjdOuQ/RyxnJw5wBbdbFgH2bmmkU0ea90ALM4nJbtw4nfmL5mKXQ3FhyllHPYArm+uT8LuFr95yfiepuYcyQsa4b2HjDsFAA/R7tXty2kYr4iCfc+xpkzRMzsOivmry3sXPAj87K2fvDZ+r5PulqsQ3TFy+3ZO8n3/8P52hJNnvOEwiRFuaFTDW0hM6Wcl82HuKb9FufjuM6mHodtcQ+1wAvrVBxknGIBZtS9wiYPc0TOX0NqfMePPJGCZD6zWKebTmXHO44JRZmeoZyMSgy/3oMmLBudmEduhdR1Mog4UL7b2+YjwPSGFTt2AK6qza7+FmwPHqRry/YwcpLxBQSN5EGBNOIR6XVEdeqGx6oyjhnO6YUNWSURHPli/uo4wdIjKi3XfaN24WicUCA4qM= ceph-043d5bae-71f2-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T17:04:57.198 INFO:teuthology.orchestra.run.smithi149.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD5I1q8ufKZkvmR2eNk52XeTWiNf0avzcdVSYYjZSc9IWdiC2jA46Q8S5St34oyKtOMJJiuk3pCeQTKU1iV88yYkFlRzs8pMTVB2mO3YuLjWXCrbjdOuQ/RyxnJw5wBbdbFgH2bmmkU0ea90ALM4nJbtw4nfmL5mKXQ3FhyllHPYArm+uT8LuFr95yfiepuYcyQsa4b2HjDsFAA/R7tXty2kYr4iCfc+xpkzRMzsOivmry3sXPAj87K2fvDZ+r5PulqsQ3TFy+3ZO8n3/8P52hJNnvOEwiRFuaFTDW0hM6Wcl82HuKb9FufjuM6mHodtcQ+1wAvrVBxknGIBZtS9wiYPc0TOX0NqfMePPJGCZD6zWKebTmXHO44JRZmeoZyMSgy/3oMmLBudmEduhdR1Mog4UL7b2+YjwPSGFTt2AK6qza7+FmwPHqRry/YwcpLxBQSN5EGBNOIR6XVEdeqGx6oyjhnO6YUNWSURHPli/uo4wdIjKi3XfaN24WicUCA4qM= ceph-043d5bae-71f2-11ef-bceb-c7b262605968 2024-09-13T17:04:57.203 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:04:57 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1422790350' entity='client.admin' 2024-09-13T17:04:57.212 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-13T17:04:57.410 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:04:59.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.664+0000 7fa753b8c640 1 -- 172.21.15.87:0/3937582458 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa74c0fe6f0 msgr2=0x7fa74c0feaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:59.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.664+0000 7fa753b8c640 1 --2- 172.21.15.87:0/3937582458 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa74c0fe6f0 0x7fa74c0feaf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa748009880 tx=0x7fa74802a5d0 comp rx=0 tx=0).stop 2024-09-13T17:04:59.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.664+0000 7fa753b8c640 1 -- 172.21.15.87:0/3937582458 shutdown_connections 2024-09-13T17:04:59.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.664+0000 7fa753b8c640 1 --2- 172.21.15.87:0/3937582458 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa74c0fe6f0 0x7fa74c0feaf0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:59.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.664+0000 7fa753b8c640 1 -- 172.21.15.87:0/3937582458 >> 172.21.15.87:0/3937582458 conn(0x7fa74c0f9e80 msgr2=0x7fa74c0fc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:59.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.664+0000 7fa753b8c640 1 -- 172.21.15.87:0/3937582458 shutdown_connections 2024-09-13T17:04:59.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.664+0000 7fa753b8c640 1 -- 172.21.15.87:0/3937582458 wait complete. 2024-09-13T17:04:59.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.665+0000 7fa753b8c640 1 Processor -- start 2024-09-13T17:04:59.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.665+0000 7fa753b8c640 1 -- start start 2024-09-13T17:04:59.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.665+0000 7fa753b8c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa74c0fe6f0 0x7fa74c105da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:59.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.665+0000 7fa753b8c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c1062e0 con 0x7fa74c0fe6f0 2024-09-13T17:04:59.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.665+0000 7fa751928640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa74c0fe6f0 0x7fa74c105da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:59.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.665+0000 7fa751928640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa74c0fe6f0 0x7fa74c105da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35256/0 (socket says 172.21.15.87:35256) 2024-09-13T17:04:59.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.665+0000 7fa751928640 1 -- 172.21.15.87:0/4228697974 learned_addr learned my addr 172.21.15.87:0/4228697974 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:04:59.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.665+0000 7fa751928640 1 -- 172.21.15.87:0/4228697974 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa748009560 con 0x7fa74c0fe6f0 2024-09-13T17:04:59.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.666+0000 7fa751928640 1 --2- 172.21.15.87:0/4228697974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa74c0fe6f0 0x7fa74c105da0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa748009230 tx=0x7fa748005230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:59.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.666+0000 7fa742ffd640 1 -- 172.21.15.87:0/4228697974 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa748004c00 con 0x7fa74c0fe6f0 2024-09-13T17:04:59.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.666+0000 7fa742ffd640 1 -- 172.21.15.87:0/4228697974 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa748003aa0 con 0x7fa74c0fe6f0 2024-09-13T17:04:59.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.666+0000 7fa753b8c640 1 -- 172.21.15.87:0/4228697974 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa74c1044d0 con 0x7fa74c0fe6f0 2024-09-13T17:04:59.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.667+0000 7fa742ffd640 1 -- 172.21.15.87:0/4228697974 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa74803ca50 con 0x7fa74c0fe6f0 2024-09-13T17:04:59.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.667+0000 7fa753b8c640 1 -- 172.21.15.87:0/4228697974 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa74c104970 con 0x7fa74c0fe6f0 2024-09-13T17:04:59.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.667+0000 7fa742ffd640 1 -- 172.21.15.87:0/4228697974 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fa74803cc90 con 0x7fa74c0fe6f0 2024-09-13T17:04:59.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.667+0000 7fa742ffd640 1 --2- 172.21.15.87:0/4228697974 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa738038760 0x7fa73803ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:04:59.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.667+0000 7fa742ffd640 1 -- 172.21.15.87:0/4228697974 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fa748003c10 con 0x7fa74c0fe6f0 2024-09-13T17:04:59.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.667+0000 7fa751127640 1 --2- 172.21.15.87:0/4228697974 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa738038760 0x7fa73803ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:04:59.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.668+0000 7fa753b8c640 1 -- 172.21.15.87:0/4228697974 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa74c068970 con 0x7fa74c0fe6f0 2024-09-13T17:04:59.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.668+0000 7fa751127640 1 --2- 172.21.15.87:0/4228697974 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa738038760 0x7fa73803ac20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0098c0 tx=0x7fa73c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:04:59.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.672+0000 7fa742ffd640 1 -- 172.21.15.87:0/4228697974 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa748035080 con 0x7fa74c0fe6f0 2024-09-13T17:04:59.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.842+0000 7fa753b8c640 1 -- 172.21.15.87:0/4228697974 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fa74c0feb70 con 0x7fa74c0fe6f0 2024-09-13T17:04:59.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.845+0000 7fa742ffd640 1 -- 172.21.15.87:0/4228697974 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fa748040020 con 0x7fa74c0fe6f0 2024-09-13T17:04:59.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.848+0000 7fa753b8c640 1 -- 172.21.15.87:0/4228697974 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa738038760 msgr2=0x7fa73803ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:59.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.848+0000 7fa753b8c640 1 --2- 172.21.15.87:0/4228697974 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa738038760 0x7fa73803ac20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0098c0 tx=0x7fa73c006db0 comp rx=0 tx=0).stop 2024-09-13T17:04:59.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.848+0000 7fa753b8c640 1 -- 172.21.15.87:0/4228697974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa74c0fe6f0 msgr2=0x7fa74c105da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:04:59.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.848+0000 7fa753b8c640 1 --2- 172.21.15.87:0/4228697974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa74c0fe6f0 0x7fa74c105da0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa748009230 tx=0x7fa748005230 comp rx=0 tx=0).stop 2024-09-13T17:04:59.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.848+0000 7fa753b8c640 1 -- 172.21.15.87:0/4228697974 shutdown_connections 2024-09-13T17:04:59.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.848+0000 7fa753b8c640 1 --2- 172.21.15.87:0/4228697974 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa738038760 0x7fa73803ac20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:59.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.848+0000 7fa753b8c640 1 --2- 172.21.15.87:0/4228697974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa74c0fe6f0 0x7fa74c105da0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:04:59.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.848+0000 7fa753b8c640 1 -- 172.21.15.87:0/4228697974 >> 172.21.15.87:0/4228697974 conn(0x7fa74c0f9e80 msgr2=0x7fa74c0fa5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:04:59.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.848+0000 7fa753b8c640 1 -- 172.21.15.87:0/4228697974 shutdown_connections 2024-09-13T17:04:59.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:04:59.848+0000 7fa753b8c640 1 -- 172.21.15.87:0/4228697974 wait complete. 2024-09-13T17:05:00.454 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:00 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:00.454 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:00 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:00.454 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:00 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi087", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:05:00.454 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:00 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:00.454 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:00 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:05:00.454 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:00 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:00.454 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:00 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/4228697974' entity='client.admin' 2024-09-13T17:05:00.454 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:00 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:05:00.455 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:00 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:00.610 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-13T17:05:00.610 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-13T17:05:00.995 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:05:02.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.749+0000 7f2f02aee640 1 -- 172.21.15.87:0/2250697486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2efc0fe6e0 msgr2=0x7f2efc0feae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:02.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.749+0000 7f2f02aee640 1 --2- 172.21.15.87:0/2250697486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2efc0fe6e0 0x7f2efc0feae0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0009880 tx=0x7f2ef002a5d0 comp rx=0 tx=0).stop 2024-09-13T17:05:02.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.749+0000 7f2f02aee640 1 -- 172.21.15.87:0/2250697486 shutdown_connections 2024-09-13T17:05:02.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.749+0000 7f2f02aee640 1 --2- 172.21.15.87:0/2250697486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2efc0fe6e0 0x7f2efc0feae0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:02.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.749+0000 7f2f02aee640 1 -- 172.21.15.87:0/2250697486 >> 172.21.15.87:0/2250697486 conn(0x7f2efc0f9e90 msgr2=0x7f2efc0fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:02.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.749+0000 7f2f02aee640 1 -- 172.21.15.87:0/2250697486 shutdown_connections 2024-09-13T17:05:02.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.749+0000 7f2f02aee640 1 -- 172.21.15.87:0/2250697486 wait complete. 2024-09-13T17:05:02.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.749+0000 7f2f02aee640 1 Processor -- start 2024-09-13T17:05:02.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.749+0000 7f2f02aee640 1 -- start start 2024-09-13T17:05:02.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.750+0000 7f2f02aee640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2efc0fe6e0 0x7f2efc193ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:02.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.750+0000 7f2f02aee640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc1940e0 con 0x7f2efc0fe6e0 2024-09-13T17:05:02.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.750+0000 7f2f0088a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2efc0fe6e0 0x7f2efc193ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:02.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.750+0000 7f2f0088a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2efc0fe6e0 0x7f2efc193ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35284/0 (socket says 172.21.15.87:35284) 2024-09-13T17:05:02.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.750+0000 7f2f0088a640 1 -- 172.21.15.87:0/1634069160 learned_addr learned my addr 172.21.15.87:0/1634069160 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:05:02.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.750+0000 7f2f0088a640 1 -- 172.21.15.87:0/1634069160 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef0009560 con 0x7f2efc0fe6e0 2024-09-13T17:05:02.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.750+0000 7f2f0088a640 1 --2- 172.21.15.87:0/1634069160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2efc0fe6e0 0x7f2efc193ba0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0009230 tx=0x7f2ef0005230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:02.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.750+0000 7f2ef9ffb640 1 -- 172.21.15.87:0/1634069160 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ef0004c00 con 0x7f2efc0fe6e0 2024-09-13T17:05:02.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.750+0000 7f2ef9ffb640 1 -- 172.21.15.87:0/1634069160 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2ef0003aa0 con 0x7f2efc0fe6e0 2024-09-13T17:05:02.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.750+0000 7f2f02aee640 1 -- 172.21.15.87:0/1634069160 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2efc1942e0 con 0x7f2efc0fe6e0 2024-09-13T17:05:02.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.750+0000 7f2ef9ffb640 1 -- 172.21.15.87:0/1634069160 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ef003ca50 con 0x7f2efc0fe6e0 2024-09-13T17:05:02.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.750+0000 7f2f02aee640 1 -- 172.21.15.87:0/1634069160 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2efc194780 con 0x7f2efc0fe6e0 2024-09-13T17:05:02.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.751+0000 7f2ef9ffb640 1 -- 172.21.15.87:0/1634069160 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f2ef003cbd0 con 0x7f2efc0fe6e0 2024-09-13T17:05:02.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.751+0000 7f2ef9ffb640 1 --2- 172.21.15.87:0/1634069160 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2eec038760 0x7f2eec03ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:02.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.751+0000 7f2ef9ffb640 1 -- 172.21.15.87:0/1634069160 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f2ef006c5d0 con 0x7f2efc0fe6e0 2024-09-13T17:05:02.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.751+0000 7f2f02aee640 1 -- 172.21.15.87:0/1634069160 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2efc0feb60 con 0x7f2efc0fe6e0 2024-09-13T17:05:02.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.752+0000 7f2efbfff640 1 --2- 172.21.15.87:0/1634069160 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2eec038760 0x7f2eec03ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:02.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.752+0000 7f2efbfff640 1 --2- 172.21.15.87:0/1634069160 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2eec038760 0x7f2eec03ac20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2ee80098c0 tx=0x7f2ee8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:02.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.756+0000 7f2ef9ffb640 1 -- 172.21.15.87:0/1634069160 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2ef0035080 con 0x7f2efc0fe6e0 2024-09-13T17:05:02.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.921+0000 7f2f02aee640 1 -- 172.21.15.87:0/1634069160 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f2efc0608f0 con 0x7f2eec038760 2024-09-13T17:05:02.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.925+0000 7f2ef9ffb640 1 -- 172.21.15.87:0/1634069160 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2efc0608f0 con 0x7f2eec038760 2024-09-13T17:05:02.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.927+0000 7f2f02aee640 1 -- 172.21.15.87:0/1634069160 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2eec038760 msgr2=0x7f2eec03ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:02.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.927+0000 7f2f02aee640 1 --2- 172.21.15.87:0/1634069160 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2eec038760 0x7f2eec03ac20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2ee80098c0 tx=0x7f2ee8006db0 comp rx=0 tx=0).stop 2024-09-13T17:05:02.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.927+0000 7f2f02aee640 1 -- 172.21.15.87:0/1634069160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2efc0fe6e0 msgr2=0x7f2efc193ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:02.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.927+0000 7f2f02aee640 1 --2- 172.21.15.87:0/1634069160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2efc0fe6e0 0x7f2efc193ba0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0009230 tx=0x7f2ef0005230 comp rx=0 tx=0).stop 2024-09-13T17:05:02.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.927+0000 7f2f02aee640 1 -- 172.21.15.87:0/1634069160 shutdown_connections 2024-09-13T17:05:02.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.927+0000 7f2f02aee640 1 --2- 172.21.15.87:0/1634069160 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2eec038760 0x7f2eec03ac20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:02.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.927+0000 7f2f02aee640 1 --2- 172.21.15.87:0/1634069160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2efc0fe6e0 0x7f2efc193ba0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:02.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.927+0000 7f2f02aee640 1 -- 172.21.15.87:0/1634069160 >> 172.21.15.87:0/1634069160 conn(0x7f2efc0f9e90 msgr2=0x7f2efc0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:02.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.927+0000 7f2f02aee640 1 -- 172.21.15.87:0/1634069160 shutdown_connections 2024-09-13T17:05:02.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:02.927+0000 7f2f02aee640 1 -- 172.21.15.87:0/1634069160 wait complete. 2024-09-13T17:05:03.674 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi118 2024-09-13T17:05:03.674 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-13T17:05:03.674 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/etc/ceph/ceph.conf 2024-09-13T17:05:03.693 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-13T17:05:03.693 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:05:03.750 INFO:tasks.cephadm:Adding host smithi118 to orchestrator... 2024-09-13T17:05:03.751 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph orch host add smithi118 2024-09-13T17:05:03.944 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:05:04.181 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:03 smithi087 ceph-mon[30934]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:05:04.181 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:03 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:04.181 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:03 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:05:04.181 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:03 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:04.181 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:03 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:05:04.181 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:03 smithi087 ceph-mon[30934]: Updating smithi087:/etc/ceph/ceph.conf 2024-09-13T17:05:04.181 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:03 smithi087 ceph-mon[30934]: Updating smithi087:/var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:05:04.181 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:03 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:04.181 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:03 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:04.182 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:03 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:05.145 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:04 smithi087 ceph-mon[30934]: Updating smithi087:/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:05:05.145 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:04 smithi087 ceph-mon[30934]: Updating smithi087:/var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T17:05:05.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:05.344+0000 7fc18eb5d640 1 -- 172.21.15.87:0/3699148672 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc188105830 msgr2=0x7fc188105c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:05.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:05.344+0000 7fc18eb5d640 1 --2- 172.21.15.87:0/3699148672 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc188105830 0x7fc188105c10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc178009880 tx=0x7fc17802a5d0 comp rx=0 tx=0).stop 2024-09-13T17:05:05.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:05.344+0000 7fc18eb5d640 1 -- 172.21.15.87:0/3699148672 shutdown_connections 2024-09-13T17:05:05.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:05.345+0000 7fc18eb5d640 1 --2- 172.21.15.87:0/3699148672 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc188105830 0x7fc188105c10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:05.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:05.345+0000 7fc18eb5d640 1 -- 172.21.15.87:0/3699148672 >> 172.21.15.87:0/3699148672 conn(0x7fc188076500 msgr2=0x7fc188076910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:05.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:05.345+0000 7fc18eb5d640 1 -- 172.21.15.87:0/3699148672 shutdown_connections 2024-09-13T17:05:05.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:05.345+0000 7fc18eb5d640 1 -- 172.21.15.87:0/3699148672 wait complete. 2024-09-13T17:05:05.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:05.345+0000 7fc18eb5d640 1 Processor -- start 2024-09-13T17:05:05.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:05.345+0000 7fc18eb5d640 1 -- start start 2024-09-13T17:05:05.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:05.345+0000 7fc18eb5d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc188105830 0x7fc188194ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:05.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:05.345+0000 7fc18eb5d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc188195530 con 0x7fc188105830 2024-09-13T17:05:05.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:05.345+0000 7fc18c8f9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc188105830 0x7fc188194ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:05.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:05.345+0000 7fc18c8f9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc188105830 0x7fc188194ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35308/0 (socket says 172.21.15.87:35308) 2024-09-13T17:05:05.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:05.345+0000 7fc18c8f9640 1 -- 172.21.15.87:0/282325383 learned_addr learned my addr 172.21.15.87:0/282325383 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:05:05.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:05.346+0000 7fc18c8f9640 1 -- 172.21.15.87:0/282325383 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc178009560 con 0x7fc188105830 2024-09-13T17:05:05.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:05.346+0000 7fc18c8f9640 1 --2- 172.21.15.87:0/282325383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc188105830 0x7fc188194ff0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc178009230 tx=0x7fc178004e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:05.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:05.346+0000 7fc185ffb640 1 -- 172.21.15.87:0/282325383 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1780054a0 con 0x7fc188105830 2024-09-13T17:05:05.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:05.346+0000 7fc18eb5d640 1 -- 172.21.15.87:0/282325383 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc188195790 con 0x7fc188105830 2024-09-13T17:05:05.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:05.346+0000 7fc185ffb640 1 -- 172.21.15.87:0/282325383 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc178005600 con 0x7fc188105830 2024-09-13T17:05:05.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:05.346+0000 7fc185ffb640 1 -- 172.21.15.87:0/282325383 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc17803c840 con 0x7fc188105830 2024-09-13T17:05:05.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:05.346+0000 7fc18eb5d640 1 -- 172.21.15.87:0/282325383 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc188195c10 con 0x7fc188105830 2024-09-13T17:05:05.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:05.347+0000 7fc185ffb640 1 -- 172.21.15.87:0/282325383 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fc17803cb00 con 0x7fc188105830 2024-09-13T17:05:05.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:05.347+0000 7fc185ffb640 1 --2- 172.21.15.87:0/282325383 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc170038710 0x7fc17003abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:05.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:05.347+0000 7fc185ffb640 1 -- 172.21.15.87:0/282325383 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc17806c3d0 con 0x7fc188105830 2024-09-13T17:05:05.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:05.347+0000 7fc18eb5d640 1 -- 172.21.15.87:0/282325383 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc188100ed0 con 0x7fc188105830 2024-09-13T17:05:05.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:05.347+0000 7fc187fff640 1 --2- 172.21.15.87:0/282325383 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc170038710 0x7fc17003abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:05.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:05.348+0000 7fc187fff640 1 --2- 172.21.15.87:0/282325383 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc170038710 0x7fc17003abd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc17c0098c0 tx=0x7fc17c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:05.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:05.352+0000 7fc185ffb640 1 -- 172.21.15.87:0/282325383 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc178035080 con 0x7fc188105830 2024-09-13T17:05:05.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:05.516+0000 7fc18eb5d640 1 -- 172.21.15.87:0/282325383 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi118", "target": ["mon-mgr", ""]}) v1 -- 0x7fc188109b60 con 0x7fc170038710 2024-09-13T17:05:06.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:06 smithi087 ceph-mon[30934]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi118", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:05:07.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:07 smithi087 ceph-mon[30934]: Deploying cephadm binary to smithi118 2024-09-13T17:05:08.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:08.230+0000 7fc185ffb640 1 -- 172.21.15.87:0/282325383 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fc188109b60 con 0x7fc170038710 2024-09-13T17:05:08.231 INFO:teuthology.orchestra.run.smithi087.stdout:Added host 'smithi118' with addr '172.21.15.118' 2024-09-13T17:05:08.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:08.232+0000 7fc18eb5d640 1 -- 172.21.15.87:0/282325383 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc170038710 msgr2=0x7fc17003abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:08.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:08.232+0000 7fc18eb5d640 1 --2- 172.21.15.87:0/282325383 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc170038710 0x7fc17003abd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc17c0098c0 tx=0x7fc17c006db0 comp rx=0 tx=0).stop 2024-09-13T17:05:08.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:08.232+0000 7fc18eb5d640 1 -- 172.21.15.87:0/282325383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc188105830 msgr2=0x7fc188194ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:08.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:08.232+0000 7fc18eb5d640 1 --2- 172.21.15.87:0/282325383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc188105830 0x7fc188194ff0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc178009230 tx=0x7fc178004e50 comp rx=0 tx=0).stop 2024-09-13T17:05:08.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:08.232+0000 7fc18eb5d640 1 -- 172.21.15.87:0/282325383 shutdown_connections 2024-09-13T17:05:08.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:08.232+0000 7fc18eb5d640 1 --2- 172.21.15.87:0/282325383 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc170038710 0x7fc17003abd0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:08.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:08.232+0000 7fc18eb5d640 1 --2- 172.21.15.87:0/282325383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc188105830 0x7fc188194ff0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:08.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:08.232+0000 7fc18eb5d640 1 -- 172.21.15.87:0/282325383 >> 172.21.15.87:0/282325383 conn(0x7fc188076500 msgr2=0x7fc1880fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:08.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:08.232+0000 7fc18eb5d640 1 -- 172.21.15.87:0/282325383 shutdown_connections 2024-09-13T17:05:08.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:08.232+0000 7fc18eb5d640 1 -- 172.21.15.87:0/282325383 wait complete. 2024-09-13T17:05:08.833 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-13T17:05:09.023 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:05:09.406 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:09 smithi087 ceph-mon[30934]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:09.406 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:09 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:09.406 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:09 smithi087 ceph-mon[30934]: Added host smithi118 2024-09-13T17:05:09.407 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:09 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:05:09.407 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:09 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:09.407 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:09 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:10.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.399+0000 7f3e2bb85640 1 -- 172.21.15.87:0/3012663271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e240fe720 msgr2=0x7f3e240feb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:10.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.399+0000 7f3e2bb85640 1 --2- 172.21.15.87:0/3012663271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e240fe720 0x7f3e240feb00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3e20009880 tx=0x7f3e2002a5d0 comp rx=0 tx=0).stop 2024-09-13T17:05:10.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.399+0000 7f3e2bb85640 1 -- 172.21.15.87:0/3012663271 shutdown_connections 2024-09-13T17:05:10.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.399+0000 7f3e2bb85640 1 --2- 172.21.15.87:0/3012663271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e240fe720 0x7f3e240feb00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:10.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.399+0000 7f3e2bb85640 1 -- 172.21.15.87:0/3012663271 >> 172.21.15.87:0/3012663271 conn(0x7f3e240fa440 msgr2=0x7f3e240fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:10.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.399+0000 7f3e2bb85640 1 -- 172.21.15.87:0/3012663271 shutdown_connections 2024-09-13T17:05:10.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.399+0000 7f3e2bb85640 1 -- 172.21.15.87:0/3012663271 wait complete. 2024-09-13T17:05:10.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.400+0000 7f3e2bb85640 1 Processor -- start 2024-09-13T17:05:10.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.400+0000 7f3e2bb85640 1 -- start start 2024-09-13T17:05:10.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.400+0000 7f3e2bb85640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e240fe720 0x7f3e2419b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:10.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.400+0000 7f3e2bb85640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2419bb90 con 0x7f3e240fe720 2024-09-13T17:05:10.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.400+0000 7f3e29921640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e240fe720 0x7f3e2419b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:10.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.400+0000 7f3e29921640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e240fe720 0x7f3e2419b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:36550/0 (socket says 172.21.15.87:36550) 2024-09-13T17:05:10.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.400+0000 7f3e29921640 1 -- 172.21.15.87:0/2330891028 learned_addr learned my addr 172.21.15.87:0/2330891028 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:05:10.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.401+0000 7f3e29921640 1 -- 172.21.15.87:0/2330891028 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e20009560 con 0x7f3e240fe720 2024-09-13T17:05:10.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.401+0000 7f3e29921640 1 --2- 172.21.15.87:0/2330891028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e240fe720 0x7f3e2419b650 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3e20009230 tx=0x7f3e20004e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:10.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.401+0000 7f3e1affd640 1 -- 172.21.15.87:0/2330891028 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e20005390 con 0x7f3e240fe720 2024-09-13T17:05:10.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.401+0000 7f3e1affd640 1 -- 172.21.15.87:0/2330891028 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3e200054f0 con 0x7f3e240fe720 2024-09-13T17:05:10.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.401+0000 7f3e2bb85640 1 -- 172.21.15.87:0/2330891028 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e2419bd90 con 0x7f3e240fe720 2024-09-13T17:05:10.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.401+0000 7f3e1affd640 1 -- 172.21.15.87:0/2330891028 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e2003c7f0 con 0x7f3e240fe720 2024-09-13T17:05:10.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.401+0000 7f3e2bb85640 1 -- 172.21.15.87:0/2330891028 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e2419c1b0 con 0x7f3e240fe720 2024-09-13T17:05:10.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.402+0000 7f3e1affd640 1 -- 172.21.15.87:0/2330891028 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f3e200035f0 con 0x7f3e240fe720 2024-09-13T17:05:10.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.402+0000 7f3e2bb85640 1 -- 172.21.15.87:0/2330891028 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e240687a0 con 0x7f3e240fe720 2024-09-13T17:05:10.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.402+0000 7f3e1affd640 1 --2- 172.21.15.87:0/2330891028 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3e10038760 0x7f3e1003ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:10.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.402+0000 7f3e1affd640 1 -- 172.21.15.87:0/2330891028 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f3e2006c3d0 con 0x7f3e240fe720 2024-09-13T17:05:10.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.402+0000 7f3e29120640 1 --2- 172.21.15.87:0/2330891028 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3e10038760 0x7f3e1003ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:10.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.403+0000 7f3e29120640 1 --2- 172.21.15.87:0/2330891028 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3e10038760 0x7f3e1003ac20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3e140098c0 tx=0x7f3e14006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:10.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.407+0000 7f3e1affd640 1 -- 172.21.15.87:0/2330891028 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3e2003a540 con 0x7f3e240fe720 2024-09-13T17:05:10.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.576+0000 7f3e2bb85640 1 -- 172.21.15.87:0/2330891028 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3e24110230 con 0x7f3e10038760 2024-09-13T17:05:10.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.577+0000 7f3e1affd640 1 -- 172.21.15.87:0/2330891028 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f3e24110230 con 0x7f3e10038760 2024-09-13T17:05:10.578 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:05:10.578 INFO:teuthology.orchestra.run.smithi087.stdout:[{"addr": "172.21.15.87", "hostname": "smithi087", "labels": [], "status": ""}, {"addr": "172.21.15.118", "hostname": "smithi118", "labels": [], "status": ""}] 2024-09-13T17:05:10.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.579+0000 7f3e2bb85640 1 -- 172.21.15.87:0/2330891028 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3e10038760 msgr2=0x7f3e1003ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:10.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.579+0000 7f3e2bb85640 1 --2- 172.21.15.87:0/2330891028 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3e10038760 0x7f3e1003ac20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3e140098c0 tx=0x7f3e14006db0 comp rx=0 tx=0).stop 2024-09-13T17:05:10.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.579+0000 7f3e2bb85640 1 -- 172.21.15.87:0/2330891028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e240fe720 msgr2=0x7f3e2419b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:10.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.579+0000 7f3e2bb85640 1 --2- 172.21.15.87:0/2330891028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e240fe720 0x7f3e2419b650 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3e20009230 tx=0x7f3e20004e10 comp rx=0 tx=0).stop 2024-09-13T17:05:10.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.579+0000 7f3e2bb85640 1 -- 172.21.15.87:0/2330891028 shutdown_connections 2024-09-13T17:05:10.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.579+0000 7f3e2bb85640 1 --2- 172.21.15.87:0/2330891028 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3e10038760 0x7f3e1003ac20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:10.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.579+0000 7f3e2bb85640 1 --2- 172.21.15.87:0/2330891028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e240fe720 0x7f3e2419b650 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:10.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.579+0000 7f3e2bb85640 1 -- 172.21.15.87:0/2330891028 >> 172.21.15.87:0/2330891028 conn(0x7f3e240fa440 msgr2=0x7f3e240fbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:10.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.579+0000 7f3e2bb85640 1 -- 172.21.15.87:0/2330891028 shutdown_connections 2024-09-13T17:05:10.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:10.579+0000 7f3e2bb85640 1 -- 172.21.15.87:0/2330891028 wait complete. 2024-09-13T17:05:10.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:10 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:10.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:10 smithi087 ceph-mon[30934]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:11.144 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi149 2024-09-13T17:05:11.144 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-13T17:05:11.144 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/etc/ceph/ceph.conf 2024-09-13T17:05:11.163 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-13T17:05:11.163 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:05:11.222 INFO:tasks.cephadm:Adding host smithi149 to orchestrator... 2024-09-13T17:05:11.222 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph orch host add smithi149 2024-09-13T17:05:11.410 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:05:11.827 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:11 smithi087 ceph-mon[30934]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:05:12.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:12.946+0000 7fab2a0a9640 1 -- 172.21.15.87:0/1339789747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab24105830 msgr2=0x7fab24105c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:12.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:12.946+0000 7fab2a0a9640 1 --2- 172.21.15.87:0/1339789747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab24105830 0x7fab24105c10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fab14009c20 tx=0x7fab1402aa90 comp rx=0 tx=0).stop 2024-09-13T17:05:12.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:12.946+0000 7fab2a0a9640 1 -- 172.21.15.87:0/1339789747 shutdown_connections 2024-09-13T17:05:12.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:12.946+0000 7fab2a0a9640 1 --2- 172.21.15.87:0/1339789747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab24105830 0x7fab24105c10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:12.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:12.946+0000 7fab2a0a9640 1 -- 172.21.15.87:0/1339789747 >> 172.21.15.87:0/1339789747 conn(0x7fab24076500 msgr2=0x7fab24076910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:12.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:12.946+0000 7fab2a0a9640 1 -- 172.21.15.87:0/1339789747 shutdown_connections 2024-09-13T17:05:12.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:12.946+0000 7fab2a0a9640 1 -- 172.21.15.87:0/1339789747 wait complete. 2024-09-13T17:05:12.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:12.947+0000 7fab2a0a9640 1 Processor -- start 2024-09-13T17:05:12.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:12.947+0000 7fab2a0a9640 1 -- start start 2024-09-13T17:05:12.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:12.947+0000 7fab2a0a9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab24105830 0x7fab24194ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:12.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:12.947+0000 7fab2a0a9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab24195530 con 0x7fab24105830 2024-09-13T17:05:12.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:12.947+0000 7fab237fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab24105830 0x7fab24194ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:12.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:12.947+0000 7fab237fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab24105830 0x7fab24194ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:36564/0 (socket says 172.21.15.87:36564) 2024-09-13T17:05:12.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:12.947+0000 7fab237fe640 1 -- 172.21.15.87:0/4079110479 learned_addr learned my addr 172.21.15.87:0/4079110479 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:05:12.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:12.948+0000 7fab237fe640 1 -- 172.21.15.87:0/4079110479 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab14009900 con 0x7fab24105830 2024-09-13T17:05:12.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:12.948+0000 7fab237fe640 1 --2- 172.21.15.87:0/4079110479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab24105830 0x7fab24194ff0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fab1402b080 tx=0x7fab14003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:12.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:12.948+0000 7fab20ff9640 1 -- 172.21.15.87:0/4079110479 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab1403e070 con 0x7fab24105830 2024-09-13T17:05:12.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:12.948+0000 7fab2a0a9640 1 -- 172.21.15.87:0/4079110479 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab24195790 con 0x7fab24105830 2024-09-13T17:05:12.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:12.948+0000 7fab20ff9640 1 -- 172.21.15.87:0/4079110479 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fab1402fb90 con 0x7fab24105830 2024-09-13T17:05:12.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:12.948+0000 7fab20ff9640 1 -- 172.21.15.87:0/4079110479 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fab14004700 con 0x7fab24105830 2024-09-13T17:05:12.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:12.948+0000 7fab2a0a9640 1 -- 172.21.15.87:0/4079110479 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab24195c10 con 0x7fab24105830 2024-09-13T17:05:12.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:12.949+0000 7fab20ff9640 1 -- 172.21.15.87:0/4079110479 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fab1400a040 con 0x7fab24105830 2024-09-13T17:05:12.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:12.949+0000 7fab20ff9640 1 --2- 172.21.15.87:0/4079110479 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fab0c038710 0x7fab0c03abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:12.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:12.949+0000 7fab20ff9640 1 -- 172.21.15.87:0/4079110479 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fab1406c570 con 0x7fab24105830 2024-09-13T17:05:12.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:12.949+0000 7fab2a0a9640 1 -- 172.21.15.87:0/4079110479 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab24100ed0 con 0x7fab24105830 2024-09-13T17:05:12.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:12.949+0000 7fab22ffd640 1 --2- 172.21.15.87:0/4079110479 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fab0c038710 0x7fab0c03abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:12.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:12.950+0000 7fab22ffd640 1 --2- 172.21.15.87:0/4079110479 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fab0c038710 0x7fab0c03abd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fab180098c0 tx=0x7fab18006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:12.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:12.954+0000 7fab20ff9640 1 -- 172.21.15.87:0/4079110479 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fab14033020 con 0x7fab24105830 2024-09-13T17:05:13.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:13.126+0000 7fab2a0a9640 1 -- 172.21.15.87:0/4079110479 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi149", "target": ["mon-mgr", ""]}) v1 -- 0x7fab24109b30 con 0x7fab0c038710 2024-09-13T17:05:13.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:13 smithi087 ceph-mon[30934]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:13.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:13 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:13.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:13 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:13.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:13 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:13.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:13 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:13.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:13 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi118", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:05:13.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:13 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:13.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:13 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:05:13.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:13 smithi087 ceph-mon[30934]: Updating smithi118:/etc/ceph/ceph.conf 2024-09-13T17:05:13.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:13 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:13.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:13 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:13.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:13 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:14.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:14 smithi087 ceph-mon[30934]: Updating smithi118:/var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:05:14.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:14 smithi087 ceph-mon[30934]: Updating smithi118:/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:05:14.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:14 smithi087 ceph-mon[30934]: Updating smithi118:/var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T17:05:14.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:14 smithi087 ceph-mon[30934]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi149", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:05:15.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:15 smithi087 ceph-mon[30934]: Deploying cephadm binary to smithi149 2024-09-13T17:05:15.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:15 smithi087 ceph-mon[30934]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:15.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:15.695+0000 7fab20ff9640 1 -- 172.21.15.87:0/4079110479 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fab24109b30 con 0x7fab0c038710 2024-09-13T17:05:15.697 INFO:teuthology.orchestra.run.smithi087.stdout:Added host 'smithi149' with addr '172.21.15.149' 2024-09-13T17:05:15.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:15.699+0000 7fab2a0a9640 1 -- 172.21.15.87:0/4079110479 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fab0c038710 msgr2=0x7fab0c03abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:15.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:15.699+0000 7fab2a0a9640 1 --2- 172.21.15.87:0/4079110479 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fab0c038710 0x7fab0c03abd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fab180098c0 tx=0x7fab18006db0 comp rx=0 tx=0).stop 2024-09-13T17:05:15.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:15.699+0000 7fab2a0a9640 1 -- 172.21.15.87:0/4079110479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab24105830 msgr2=0x7fab24194ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:15.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:15.699+0000 7fab2a0a9640 1 --2- 172.21.15.87:0/4079110479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab24105830 0x7fab24194ff0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fab1402b080 tx=0x7fab14003f80 comp rx=0 tx=0).stop 2024-09-13T17:05:15.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:15.699+0000 7fab2a0a9640 1 -- 172.21.15.87:0/4079110479 shutdown_connections 2024-09-13T17:05:15.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:15.699+0000 7fab2a0a9640 1 --2- 172.21.15.87:0/4079110479 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fab0c038710 0x7fab0c03abd0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:15.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:15.699+0000 7fab2a0a9640 1 --2- 172.21.15.87:0/4079110479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab24105830 0x7fab24194ff0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:15.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:15.699+0000 7fab2a0a9640 1 -- 172.21.15.87:0/4079110479 >> 172.21.15.87:0/4079110479 conn(0x7fab24076500 msgr2=0x7fab240fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:15.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:15.699+0000 7fab2a0a9640 1 -- 172.21.15.87:0/4079110479 shutdown_connections 2024-09-13T17:05:15.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:15.699+0000 7fab2a0a9640 1 -- 172.21.15.87:0/4079110479 wait complete. 2024-09-13T17:05:16.299 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-13T17:05:16.489 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:05:16.940 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:16 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:16.940 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:16 smithi087 ceph-mon[30934]: Added host smithi149 2024-09-13T17:05:16.940 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:16 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:05:16.940 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:16 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:16.940 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:16 smithi087 ceph-mon[30934]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:16.940 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:16 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:18.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:17.998+0000 7f597b010640 1 -- 172.21.15.87:0/599508345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5974105810 msgr2=0x7f5974105bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:18.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:17.998+0000 7f597b010640 1 --2- 172.21.15.87:0/599508345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5974105810 0x7f5974105bf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5970009880 tx=0x7f597002a5d0 comp rx=0 tx=0).stop 2024-09-13T17:05:18.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:17.998+0000 7f597b010640 1 -- 172.21.15.87:0/599508345 shutdown_connections 2024-09-13T17:05:18.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:17.998+0000 7f597b010640 1 --2- 172.21.15.87:0/599508345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5974105810 0x7f5974105bf0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:18.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:17.998+0000 7f597b010640 1 -- 172.21.15.87:0/599508345 >> 172.21.15.87:0/599508345 conn(0x7f59740f9b10 msgr2=0x7f59740fbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:18.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:17.998+0000 7f597b010640 1 -- 172.21.15.87:0/599508345 shutdown_connections 2024-09-13T17:05:18.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:17.998+0000 7f597b010640 1 -- 172.21.15.87:0/599508345 wait complete. 2024-09-13T17:05:18.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:17.999+0000 7f597b010640 1 Processor -- start 2024-09-13T17:05:18.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:17.999+0000 7f597b010640 1 -- start start 2024-09-13T17:05:18.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:17.999+0000 7f597b010640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5974105810 0x7f5974195090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:18.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:17.999+0000 7f597b010640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59741955d0 con 0x7f5974105810 2024-09-13T17:05:18.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:17.999+0000 7f5978dac640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5974105810 0x7f5974195090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:18.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:17.999+0000 7f5978dac640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5974105810 0x7f5974195090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:36584/0 (socket says 172.21.15.87:36584) 2024-09-13T17:05:18.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:17.999+0000 7f5978dac640 1 -- 172.21.15.87:0/3444266622 learned_addr learned my addr 172.21.15.87:0/3444266622 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:05:18.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:18.000+0000 7f5978dac640 1 -- 172.21.15.87:0/3444266622 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5970009560 con 0x7f5974105810 2024-09-13T17:05:18.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:18.000+0000 7f5978dac640 1 --2- 172.21.15.87:0/3444266622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5974105810 0x7f5974195090 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5970009230 tx=0x7f5970004e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:18.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:18.000+0000 7f5969ffb640 1 -- 172.21.15.87:0/3444266622 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5970005390 con 0x7f5974105810 2024-09-13T17:05:18.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:18.000+0000 7f5969ffb640 1 -- 172.21.15.87:0/3444266622 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f59700054f0 con 0x7f5974105810 2024-09-13T17:05:18.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:18.000+0000 7f597b010640 1 -- 172.21.15.87:0/3444266622 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5974195830 con 0x7f5974105810 2024-09-13T17:05:18.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:18.000+0000 7f5969ffb640 1 -- 172.21.15.87:0/3444266622 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f597003c790 con 0x7f5974105810 2024-09-13T17:05:18.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:18.000+0000 7f597b010640 1 -- 172.21.15.87:0/3444266622 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5974195cb0 con 0x7f5974105810 2024-09-13T17:05:18.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:18.001+0000 7f5969ffb640 1 -- 172.21.15.87:0/3444266622 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f597003ca50 con 0x7f5974105810 2024-09-13T17:05:18.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:18.001+0000 7f597b010640 1 -- 172.21.15.87:0/3444266622 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5974100f00 con 0x7f5974105810 2024-09-13T17:05:18.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:18.001+0000 7f5969ffb640 1 --2- 172.21.15.87:0/3444266622 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f595c038710 0x7f595c03abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:18.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:18.001+0000 7f5969ffb640 1 -- 172.21.15.87:0/3444266622 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f597006c3a0 con 0x7f5974105810 2024-09-13T17:05:18.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:18.001+0000 7f596bfff640 1 --2- 172.21.15.87:0/3444266622 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f595c038710 0x7f595c03abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:18.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:18.002+0000 7f596bfff640 1 --2- 172.21.15.87:0/3444266622 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f595c038710 0x7f595c03abd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f59640098c0 tx=0x7f5964006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:18.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:18.006+0000 7f5969ffb640 1 -- 172.21.15.87:0/3444266622 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f597004d350 con 0x7f5974105810 2024-09-13T17:05:18.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:18.173+0000 7f597b010640 1 -- 172.21.15.87:0/3444266622 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5974109af0 con 0x7f595c038710 2024-09-13T17:05:18.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:18.174+0000 7f5969ffb640 1 -- 172.21.15.87:0/3444266622 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+240 (secure 0 0 0) 0x7f5974109af0 con 0x7f595c038710 2024-09-13T17:05:18.175 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:05:18.175 INFO:teuthology.orchestra.run.smithi087.stdout:[{"addr": "172.21.15.87", "hostname": "smithi087", "labels": [], "status": ""}, {"addr": "172.21.15.118", "hostname": "smithi118", "labels": [], "status": ""}, {"addr": "172.21.15.149", "hostname": "smithi149", "labels": [], "status": ""}] 2024-09-13T17:05:18.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:18.176+0000 7f597b010640 1 -- 172.21.15.87:0/3444266622 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f595c038710 msgr2=0x7f595c03abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:18.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:18.176+0000 7f597b010640 1 --2- 172.21.15.87:0/3444266622 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f595c038710 0x7f595c03abd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f59640098c0 tx=0x7f5964006db0 comp rx=0 tx=0).stop 2024-09-13T17:05:18.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:18.176+0000 7f597b010640 1 -- 172.21.15.87:0/3444266622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5974105810 msgr2=0x7f5974195090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:18.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:18.176+0000 7f597b010640 1 --2- 172.21.15.87:0/3444266622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5974105810 0x7f5974195090 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5970009230 tx=0x7f5970004e10 comp rx=0 tx=0).stop 2024-09-13T17:05:18.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:18.176+0000 7f597b010640 1 -- 172.21.15.87:0/3444266622 shutdown_connections 2024-09-13T17:05:18.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:18.176+0000 7f597b010640 1 --2- 172.21.15.87:0/3444266622 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f595c038710 0x7f595c03abd0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:18.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:18.176+0000 7f597b010640 1 --2- 172.21.15.87:0/3444266622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5974105810 0x7f5974195090 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:18.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:18.176+0000 7f597b010640 1 -- 172.21.15.87:0/3444266622 >> 172.21.15.87:0/3444266622 conn(0x7f59740f9b10 msgr2=0x7f59740f9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:18.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:18.176+0000 7f597b010640 1 -- 172.21.15.87:0/3444266622 shutdown_connections 2024-09-13T17:05:18.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:18.176+0000 7f597b010640 1 -- 172.21.15.87:0/3444266622 wait complete. 2024-09-13T17:05:18.452 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:17 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:18.812 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-13T17:05:18.813 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-13T17:05:19.010 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:05:19.130 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:18 smithi087 ceph-mon[30934]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:19.130 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:18 smithi087 ceph-mon[30934]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:05:20.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.364+0000 7f0fbd577640 1 -- 172.21.15.87:0/3725554399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0fb8104650 msgr2=0x7f0fb8104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:20.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.364+0000 7f0fbd577640 1 --2- 172.21.15.87:0/3725554399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0fb8104650 0x7f0fb8104a30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8009c20 tx=0x7f0fa802aa90 comp rx=0 tx=0).stop 2024-09-13T17:05:20.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.364+0000 7f0fbd577640 1 -- 172.21.15.87:0/3725554399 shutdown_connections 2024-09-13T17:05:20.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.364+0000 7f0fbd577640 1 --2- 172.21.15.87:0/3725554399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0fb8104650 0x7f0fb8104a30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:20.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.364+0000 7f0fbd577640 1 -- 172.21.15.87:0/3725554399 >> 172.21.15.87:0/3725554399 conn(0x7f0fb8075490 msgr2=0x7f0fb80fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:20.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.364+0000 7f0fbd577640 1 -- 172.21.15.87:0/3725554399 shutdown_connections 2024-09-13T17:05:20.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.364+0000 7f0fbd577640 1 -- 172.21.15.87:0/3725554399 wait complete. 2024-09-13T17:05:20.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.365+0000 7f0fbd577640 1 Processor -- start 2024-09-13T17:05:20.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.365+0000 7f0fbd577640 1 -- start start 2024-09-13T17:05:20.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.365+0000 7f0fbd577640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0fb8104650 0x7f0fb8195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:20.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.365+0000 7f0fbd577640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb8068670 con 0x7f0fb8104650 2024-09-13T17:05:20.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.366+0000 7f0fb6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0fb8104650 0x7f0fb8195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:20.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.366+0000 7f0fb6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0fb8104650 0x7f0fb8195ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54736/0 (socket says 172.21.15.87:54736) 2024-09-13T17:05:20.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.366+0000 7f0fb6ffd640 1 -- 172.21.15.87:0/1192086475 learned_addr learned my addr 172.21.15.87:0/1192086475 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:05:20.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.366+0000 7f0fb6ffd640 1 -- 172.21.15.87:0/1192086475 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa8009900 con 0x7f0fb8104650 2024-09-13T17:05:20.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.366+0000 7f0fb6ffd640 1 --2- 172.21.15.87:0/1192086475 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0fb8104650 0x7f0fb8195ec0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0fa802b080 tx=0x7f0fa8003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:20.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.366+0000 7f0faffff640 1 -- 172.21.15.87:0/1192086475 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fa803e070 con 0x7f0fb8104650 2024-09-13T17:05:20.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.366+0000 7f0faffff640 1 -- 172.21.15.87:0/1192086475 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0fa802fb90 con 0x7f0fb8104650 2024-09-13T17:05:20.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.366+0000 7f0fbd577640 1 -- 172.21.15.87:0/1192086475 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fb8196460 con 0x7f0fb8104650 2024-09-13T17:05:20.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.366+0000 7f0faffff640 1 -- 172.21.15.87:0/1192086475 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fa8004700 con 0x7f0fb8104650 2024-09-13T17:05:20.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.366+0000 7f0fbd577640 1 -- 172.21.15.87:0/1192086475 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb81968e0 con 0x7f0fb8104650 2024-09-13T17:05:20.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.367+0000 7f0faffff640 1 -- 172.21.15.87:0/1192086475 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f0fa800a040 con 0x7f0fb8104650 2024-09-13T17:05:20.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.367+0000 7f0faffff640 1 --2- 172.21.15.87:0/1192086475 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0fa4038710 0x7f0fa403abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:20.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.367+0000 7f0fbd577640 1 -- 172.21.15.87:0/1192086475 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fb80ffd90 con 0x7f0fb8104650 2024-09-13T17:05:20.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.367+0000 7f0faffff640 1 -- 172.21.15.87:0/1192086475 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0fa806c5d0 con 0x7f0fb8104650 2024-09-13T17:05:20.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.367+0000 7f0fb67fc640 1 --2- 172.21.15.87:0/1192086475 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0fa4038710 0x7f0fa403abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:20.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.368+0000 7f0fb67fc640 1 --2- 172.21.15.87:0/1192086475 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0fa4038710 0x7f0fa403abd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0fa00098c0 tx=0x7f0fa0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:20.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.372+0000 7f0faffff640 1 -- 172.21.15.87:0/1192086475 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0fa8048080 con 0x7f0fb8104650 2024-09-13T17:05:20.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.564+0000 7f0fbd577640 1 -- 172.21.15.87:0/1192086475 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f0fb8067de0 con 0x7f0fb8104650 2024-09-13T17:05:20.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.791+0000 7f0faffff640 1 -- 172.21.15.87:0/1192086475 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f0fa8033030 con 0x7f0fb8104650 2024-09-13T17:05:20.793 INFO:teuthology.orchestra.run.smithi087.stderr:adjusted tunables profile to default 2024-09-13T17:05:20.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.793+0000 7f0fbd577640 1 -- 172.21.15.87:0/1192086475 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0fa4038710 msgr2=0x7f0fa403abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:20.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.793+0000 7f0fbd577640 1 --2- 172.21.15.87:0/1192086475 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0fa4038710 0x7f0fa403abd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0fa00098c0 tx=0x7f0fa0006db0 comp rx=0 tx=0).stop 2024-09-13T17:05:20.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.793+0000 7f0fbd577640 1 -- 172.21.15.87:0/1192086475 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0fb8104650 msgr2=0x7f0fb8195ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:20.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.793+0000 7f0fbd577640 1 --2- 172.21.15.87:0/1192086475 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0fb8104650 0x7f0fb8195ec0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0fa802b080 tx=0x7f0fa8003f80 comp rx=0 tx=0).stop 2024-09-13T17:05:20.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.794+0000 7f0fbd577640 1 -- 172.21.15.87:0/1192086475 shutdown_connections 2024-09-13T17:05:20.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.794+0000 7f0fbd577640 1 --2- 172.21.15.87:0/1192086475 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0fa4038710 0x7f0fa403abd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:20.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.794+0000 7f0fbd577640 1 --2- 172.21.15.87:0/1192086475 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0fb8104650 0x7f0fb8195ec0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:20.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.794+0000 7f0fbd577640 1 -- 172.21.15.87:0/1192086475 >> 172.21.15.87:0/1192086475 conn(0x7f0fb8075490 msgr2=0x7f0fb80fb760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:20.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.794+0000 7f0fbd577640 1 -- 172.21.15.87:0/1192086475 shutdown_connections 2024-09-13T17:05:20.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:20.794+0000 7f0fbd577640 1 -- 172.21.15.87:0/1192086475 wait complete. 2024-09-13T17:05:20.832 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:20 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:20.832 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:20 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:20.832 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:20 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:20.832 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:20 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:20.832 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:20 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:05:20.832 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:20 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:20.832 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:20 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:05:20.832 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:20 smithi087 ceph-mon[30934]: Updating smithi149:/etc/ceph/ceph.conf 2024-09-13T17:05:20.832 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:20 smithi087 ceph-mon[30934]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:20.832 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:20 smithi087 ceph-mon[30934]: Updating smithi149:/var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:05:20.832 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:20 smithi087 ceph-mon[30934]: Updating smithi149:/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:05:20.833 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:20 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1192086475' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-13T17:05:20.833 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:20 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:20.833 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:20 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:20.833 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:20 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:21.392 INFO:tasks.cephadm:Adding mon.a on smithi087 2024-09-13T17:05:21.392 INFO:tasks.cephadm:Adding mon.b on smithi118 2024-09-13T17:05:21.393 INFO:tasks.cephadm:Adding mon.c on smithi149 2024-09-13T17:05:21.393 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi087:172.21.15.87=a;smithi118:172.21.15.118=b;smithi149:172.21.15.149=c' 2024-09-13T17:05:21.584 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:05:22.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:21 smithi087 ceph-mon[30934]: Updating smithi149:/var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T17:05:22.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:21 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1192086475' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-13T17:05:22.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:21 smithi087 ceph-mon[30934]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T17:05:22.977 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:22.974+0000 7f6e9e845640 1 -- 172.21.15.149:0/320693471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e98104670 msgr2=0x7f6e98104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:22.977 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:22.974+0000 7f6e9e845640 1 --2- 172.21.15.149:0/320693471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e98104670 0x7f6e98104a50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6e88009880 tx=0x7f6e8802a5d0 comp rx=0 tx=0).stop 2024-09-13T17:05:22.978 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:22.974+0000 7f6e9e845640 1 -- 172.21.15.149:0/320693471 shutdown_connections 2024-09-13T17:05:22.978 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:22.974+0000 7f6e9e845640 1 --2- 172.21.15.149:0/320693471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e98104670 0x7f6e98104a50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:22.978 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:22.974+0000 7f6e9e845640 1 -- 172.21.15.149:0/320693471 >> 172.21.15.149:0/320693471 conn(0x7f6e980fa3b0 msgr2=0x7f6e980fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:22.978 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:22.974+0000 7f6e9e845640 1 -- 172.21.15.149:0/320693471 shutdown_connections 2024-09-13T17:05:22.978 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:22.974+0000 7f6e9e845640 1 -- 172.21.15.149:0/320693471 wait complete. 2024-09-13T17:05:22.978 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:22.974+0000 7f6e9e845640 1 Processor -- start 2024-09-13T17:05:22.978 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:22.975+0000 7f6e9e845640 1 -- start start 2024-09-13T17:05:22.978 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:22.975+0000 7f6e9e845640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e98104670 0x7f6e98195e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:22.978 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:22.975+0000 7f6e9e845640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e98068e90 con 0x7f6e98104670 2024-09-13T17:05:22.978 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:22.975+0000 7f6e97fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e98104670 0x7f6e98195e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:22.978 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:22.975+0000 7f6e97fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e98104670 0x7f6e98195e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.149:40850/0 (socket says 172.21.15.149:40850) 2024-09-13T17:05:22.978 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:22.975+0000 7f6e97fff640 1 -- 172.21.15.149:0/1557340596 learned_addr learned my addr 172.21.15.149:0/1557340596 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-13T17:05:22.978 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:22.975+0000 7f6e97fff640 1 -- 172.21.15.149:0/1557340596 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e88009560 con 0x7f6e98104670 2024-09-13T17:05:22.979 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:22.976+0000 7f6e97fff640 1 --2- 172.21.15.149:0/1557340596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e98104670 0x7f6e98195e20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6e88009230 tx=0x7f6e88004e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:22.979 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:22.976+0000 7f6e957fa640 1 -- 172.21.15.149:0/1557340596 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e88005390 con 0x7f6e98104670 2024-09-13T17:05:22.979 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:22.976+0000 7f6e9e845640 1 -- 172.21.15.149:0/1557340596 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e981963c0 con 0x7f6e98104670 2024-09-13T17:05:22.979 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:22.976+0000 7f6e957fa640 1 -- 172.21.15.149:0/1557340596 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6e880054f0 con 0x7f6e98104670 2024-09-13T17:05:22.979 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:22.976+0000 7f6e957fa640 1 -- 172.21.15.149:0/1557340596 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e8803c7f0 con 0x7f6e98104670 2024-09-13T17:05:22.979 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:22.976+0000 7f6e9e845640 1 -- 172.21.15.149:0/1557340596 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e98196840 con 0x7f6e98104670 2024-09-13T17:05:22.980 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:22.977+0000 7f6e957fa640 1 -- 172.21.15.149:0/1557340596 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f6e880035f0 con 0x7f6e98104670 2024-09-13T17:05:22.980 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:22.977+0000 7f6e9e845640 1 -- 172.21.15.149:0/1557340596 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e980ffdb0 con 0x7f6e98104670 2024-09-13T17:05:22.980 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:22.977+0000 7f6e957fa640 1 --2- 172.21.15.149:0/1557340596 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f6e80038710 0x7f6e8003abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:22.980 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:22.977+0000 7f6e957fa640 1 -- 172.21.15.149:0/1557340596 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f6e8806c510 con 0x7f6e98104670 2024-09-13T17:05:22.980 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:22.977+0000 7f6e977fe640 1 --2- 172.21.15.149:0/1557340596 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f6e80038710 0x7f6e8003abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:22.980 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:22.978+0000 7f6e977fe640 1 --2- 172.21.15.149:0/1557340596 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f6e80038710 0x7f6e8003abd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c0098c0 tx=0x7f6e8c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:22.983 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:22.982+0000 7f6e957fa640 1 -- 172.21.15.149:0/1557340596 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6e8803a540 con 0x7f6e98104670 2024-09-13T17:05:23.159 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:23.157+0000 7f6e9e845640 1 -- 172.21.15.149:0/1557340596 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi087:172.21.15.87=a;smithi118:172.21.15.118=b;smithi149:172.21.15.149=c", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e98196c00 con 0x7f6e80038710 2024-09-13T17:05:23.166 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:23.165+0000 7f6e957fa640 1 -- 172.21.15.149:0/1557340596 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f6e98196c00 con 0x7f6e80038710 2024-09-13T17:05:23.166 INFO:teuthology.orchestra.run.smithi149.stdout:Scheduled mon update... 2024-09-13T17:05:23.168 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:23.167+0000 7f6e9e845640 1 -- 172.21.15.149:0/1557340596 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f6e80038710 msgr2=0x7f6e8003abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:23.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:23.167+0000 7f6e9e845640 1 --2- 172.21.15.149:0/1557340596 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f6e80038710 0x7f6e8003abd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c0098c0 tx=0x7f6e8c006db0 comp rx=0 tx=0).stop 2024-09-13T17:05:23.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:23.167+0000 7f6e9e845640 1 -- 172.21.15.149:0/1557340596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e98104670 msgr2=0x7f6e98195e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:23.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:23.167+0000 7f6e9e845640 1 --2- 172.21.15.149:0/1557340596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e98104670 0x7f6e98195e20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6e88009230 tx=0x7f6e88004e10 comp rx=0 tx=0).stop 2024-09-13T17:05:23.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:23.167+0000 7f6e9e845640 1 -- 172.21.15.149:0/1557340596 shutdown_connections 2024-09-13T17:05:23.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:23.167+0000 7f6e9e845640 1 --2- 172.21.15.149:0/1557340596 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f6e80038710 0x7f6e8003abd0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:23.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:23.167+0000 7f6e9e845640 1 --2- 172.21.15.149:0/1557340596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e98104670 0x7f6e98195e20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:23.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:23.167+0000 7f6e9e845640 1 -- 172.21.15.149:0/1557340596 >> 172.21.15.149:0/1557340596 conn(0x7f6e980fa3b0 msgr2=0x7f6e98102180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:23.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:23.167+0000 7f6e9e845640 1 -- 172.21.15.149:0/1557340596 shutdown_connections 2024-09-13T17:05:23.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:23.167+0000 7f6e9e845640 1 -- 172.21.15.149:0/1557340596 wait complete. 2024-09-13T17:05:23.228 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:22 smithi087 ceph-mon[30934]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:23.868 DEBUG:teuthology.orchestra.run.smithi118:mon.b> sudo journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mon.b.service 2024-09-13T17:05:23.871 DEBUG:teuthology.orchestra.run.smithi149:mon.c> sudo journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mon.c.service 2024-09-13T17:05:23.874 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-13T17:05:23.874 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T17:05:24.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:24 smithi087 ceph-mon[30934]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi087:172.21.15.87=a;smithi118:172.21.15.118=b;smithi149:172.21.15.149=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:05:24.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:24 smithi087 ceph-mon[30934]: Saving service mon spec with placement smithi087:172.21.15.87=a;smithi118:172.21.15.118=b;smithi149:172.21.15.149=c;count:3 2024-09-13T17:05:24.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:24 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:24.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:24 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:05:24.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:24 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:24.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:24 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:05:24.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:24 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:24.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:24 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T17:05:24.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:24 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:24.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:24 smithi087 ceph-mon[30934]: Deploying daemon mon.c on smithi149 2024-09-13T17:05:24.890 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:05:25.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:25 smithi087 ceph-mon[30934]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:27.439 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.434+0000 7f49c6434640 1 -- 172.21.15.149:0/173268289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49c0100970 msgr2=0x7f49c0100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:27.439 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.434+0000 7f49c6434640 1 --2- 172.21.15.149:0/173268289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49c0100970 0x7f49c0100d50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f49b0009880 tx=0x7f49b002a670 comp rx=0 tx=0).stop 2024-09-13T17:05:27.439 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.434+0000 7f49c6434640 1 -- 172.21.15.149:0/173268289 shutdown_connections 2024-09-13T17:05:27.439 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.434+0000 7f49c6434640 1 --2- 172.21.15.149:0/173268289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49c0100970 0x7f49c0100d50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:27.439 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.434+0000 7f49c6434640 1 -- 172.21.15.149:0/173268289 >> 172.21.15.149:0/173268289 conn(0x7f49c0075490 msgr2=0x7f49c00fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:27.439 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.434+0000 7f49c6434640 1 -- 172.21.15.149:0/173268289 shutdown_connections 2024-09-13T17:05:27.440 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.434+0000 7f49c6434640 1 -- 172.21.15.149:0/173268289 wait complete. 2024-09-13T17:05:27.440 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.435+0000 7f49c6434640 1 Processor -- start 2024-09-13T17:05:27.440 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.435+0000 7f49c6434640 1 -- start start 2024-09-13T17:05:27.440 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.435+0000 7f49c6434640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49c0100970 0x7f49c0197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:27.440 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.435+0000 7f49c6434640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c0197870 con 0x7f49c0100970 2024-09-13T17:05:27.440 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.436+0000 7f49bffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49c0100970 0x7f49c0197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:27.440 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.436+0000 7f49bffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49c0100970 0x7f49c0197330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.149:60034/0 (socket says 172.21.15.149:60034) 2024-09-13T17:05:27.440 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.436+0000 7f49bffff640 1 -- 172.21.15.149:0/1150147644 learned_addr learned my addr 172.21.15.149:0/1150147644 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-13T17:05:27.440 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.436+0000 7f49bffff640 1 -- 172.21.15.149:0/1150147644 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b0009560 con 0x7f49c0100970 2024-09-13T17:05:27.440 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.436+0000 7f49bffff640 1 --2- 172.21.15.149:0/1150147644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49c0100970 0x7f49c0197330 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f49b0009230 tx=0x7f49b0004e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:27.440 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.436+0000 7f49bd7fa640 1 -- 172.21.15.149:0/1150147644 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49b0005390 con 0x7f49c0100970 2024-09-13T17:05:27.441 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.436+0000 7f49bd7fa640 1 -- 172.21.15.149:0/1150147644 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f49b00054f0 con 0x7f49c0100970 2024-09-13T17:05:27.441 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.436+0000 7f49c6434640 1 -- 172.21.15.149:0/1150147644 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c0197a70 con 0x7f49c0100970 2024-09-13T17:05:27.441 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.436+0000 7f49bd7fa640 1 -- 172.21.15.149:0/1150147644 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49b003c7f0 con 0x7f49c0100970 2024-09-13T17:05:27.441 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.436+0000 7f49c6434640 1 -- 172.21.15.149:0/1150147644 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c0197e90 con 0x7f49c0100970 2024-09-13T17:05:27.441 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.437+0000 7f49bd7fa640 1 -- 172.21.15.149:0/1150147644 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f49b00035f0 con 0x7f49c0100970 2024-09-13T17:05:27.441 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.437+0000 7f49c6434640 1 -- 172.21.15.149:0/1150147644 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c0067f20 con 0x7f49c0100970 2024-09-13T17:05:27.441 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.438+0000 7f49bd7fa640 1 --2- 172.21.15.149:0/1150147644 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f49a8038710 0x7f49a803abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:27.441 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.438+0000 7f49bd7fa640 1 -- 172.21.15.149:0/1150147644 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f49b006c4d0 con 0x7f49c0100970 2024-09-13T17:05:27.441 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.438+0000 7f49bf7fe640 1 --2- 172.21.15.149:0/1150147644 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f49a8038710 0x7f49a803abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:27.441 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.438+0000 7f49bf7fe640 1 --2- 172.21.15.149:0/1150147644 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f49a8038710 0x7f49a803abd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f49b40098c0 tx=0x7f49b4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:27.443 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.443+0000 7f49bd7fa640 1 -- 172.21.15.149:0/1150147644 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f49b003a540 con 0x7f49c0100970 2024-09-13T17:05:27.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:27 smithi087 ceph-mon[30934]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:27.692 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.691+0000 7f49c6434640 1 -- 172.21.15.149:0/1150147644 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f49c01987b0 con 0x7f49c0100970 2024-09-13T17:05:27.692 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.691+0000 7f49bd7fa640 1 -- 172.21.15.149:0/1150147644 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+736 (secure 0 0 0) 0x7f49b0040070 con 0x7f49c0100970 2024-09-13T17:05:27.692 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T17:05:27.693 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"043d5bae-71f2-11ef-bceb-c7b262605968","modified":"2024-09-13T17:03:54.878463Z","created":"2024-09-13T17:03:54.878463Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:3300","nonce":0},{"type":"v1","addr":"172.21.15.87:6789","nonce":0}]},"addr":"172.21.15.87:6789/0","public_addr":"172.21.15.87:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T17:05:27.693 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-13T17:05:27.694 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.693+0000 7f49c6434640 1 -- 172.21.15.149:0/1150147644 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f49a8038710 msgr2=0x7f49a803abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:27.695 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.693+0000 7f49c6434640 1 --2- 172.21.15.149:0/1150147644 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f49a8038710 0x7f49a803abd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f49b40098c0 tx=0x7f49b4006db0 comp rx=0 tx=0).stop 2024-09-13T17:05:27.695 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.693+0000 7f49c6434640 1 -- 172.21.15.149:0/1150147644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49c0100970 msgr2=0x7f49c0197330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:27.695 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.693+0000 7f49c6434640 1 --2- 172.21.15.149:0/1150147644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49c0100970 0x7f49c0197330 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f49b0009230 tx=0x7f49b0004e10 comp rx=0 tx=0).stop 2024-09-13T17:05:27.695 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.694+0000 7f49c6434640 1 -- 172.21.15.149:0/1150147644 shutdown_connections 2024-09-13T17:05:27.695 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.694+0000 7f49c6434640 1 --2- 172.21.15.149:0/1150147644 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f49a8038710 0x7f49a803abd0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:27.695 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.694+0000 7f49c6434640 1 --2- 172.21.15.149:0/1150147644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49c0100970 0x7f49c0197330 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:27.695 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.694+0000 7f49c6434640 1 -- 172.21.15.149:0/1150147644 >> 172.21.15.149:0/1150147644 conn(0x7f49c0075490 msgr2=0x7f49c01069b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:27.695 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.694+0000 7f49c6434640 1 -- 172.21.15.149:0/1150147644 shutdown_connections 2024-09-13T17:05:27.695 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:27.694+0000 7f49c6434640 1 -- 172.21.15.149:0/1150147644 wait complete. 2024-09-13T17:05:28.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:28 smithi087 ceph-mon[30934]: from='client.? 172.21.15.149:0/1150147644' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T17:05:28.785 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-13T17:05:28.785 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-13T17:05:28.785 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-13T17:05:28.785 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-13T17:05:28.786 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-13T17:05:28.786 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-13T17:05:28.786 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T17:05:28.786 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T17:05:28.786 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T17:05:28.786 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: Deploying cephadm binary to smithi149 2024-09-13T17:05:28.786 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:28.786 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:28.786 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: Added host smithi149 2024-09-13T17:05:28.786 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:05:28.786 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:28.786 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:28.786 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:28.786 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:28.787 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:28.787 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:05:28.787 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:28.787 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:28.787 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:28.787 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:28.787 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:05:28.787 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:28.787 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:05:28.787 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: Updating smithi149:/etc/ceph/ceph.conf 2024-09-13T17:05:28.787 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:28.787 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: Updating smithi149:/var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:05:28.787 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: Updating smithi149:/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:05:28.788 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1192086475' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-13T17:05:28.788 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:28.788 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:28.788 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:28.788 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: Updating smithi149:/var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T17:05:28.788 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1192086475' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-13T17:05:28.788 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T17:05:28.788 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:28.788 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi087:172.21.15.87=a;smithi118:172.21.15.118=b;smithi149:172.21.15.149=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:05:28.788 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: Saving service mon spec with placement smithi087:172.21.15.87=a;smithi118:172.21.15.118=b;smithi149:172.21.15.149=c;count:3 2024-09-13T17:05:28.788 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:28.788 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:05:28.788 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:28.789 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:05:28.789 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:28.789 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T17:05:28.789 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:28.789 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: Deploying daemon mon.c on smithi149 2024-09-13T17:05:28.789 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:28.789 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:28.789 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: from='client.? 172.21.15.149:0/1150147644' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T17:05:28.789 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 ceph-mon[35496]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-13T17:05:29.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 bash[35476]: f9fefcd4622c323a60752030255606df2081fda0addfe004adea3ca0e7415aa4 2024-09-13T17:05:29.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:28 smithi149 systemd[1]: Started Ceph mon.c for 043d5bae-71f2-11ef-bceb-c7b262605968. 2024-09-13T17:05:29.279 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-13T17:05:29.279 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T17:05:29.486 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T17:05:33.862 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.860+0000 7f5542133640 1 -- 172.21.15.149:0/3354105664 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5524003530 msgr2=0x7f55240059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:33.862 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.860+0000 7f5542133640 1 --2- 172.21.15.149:0/3354105664 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5524003530 0x7f55240059c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f553c100d10 tx=0x7f552c02bc80 comp rx=0 tx=0).stop 2024-09-13T17:05:33.863 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.860+0000 7f5542133640 1 -- 172.21.15.149:0/3354105664 shutdown_connections 2024-09-13T17:05:33.863 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.860+0000 7f5542133640 1 --2- 172.21.15.149:0/3354105664 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5524003530 0x7f55240059c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:33.863 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.860+0000 7f5542133640 1 -- 172.21.15.149:0/3354105664 >> 172.21.15.149:0/3354105664 conn(0x7f553c0fb540 msgr2=0x7f553c0fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:33.863 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.860+0000 7f5542133640 1 -- 172.21.15.149:0/3354105664 shutdown_connections 2024-09-13T17:05:33.863 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.860+0000 7f5542133640 1 -- 172.21.15.149:0/3354105664 wait complete. 2024-09-13T17:05:33.864 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.861+0000 7f5542133640 1 Processor -- start 2024-09-13T17:05:33.864 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.861+0000 7f5542133640 1 -- start start 2024-09-13T17:05:33.864 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.862+0000 7f5542133640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5524003530 0x7f553c195140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:33.865 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.862+0000 7f5542133640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f553c195680 0x7f553c199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:33.865 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.862+0000 7f5542133640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553c195bf0 con 0x7f553c195680 2024-09-13T17:05:33.865 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.862+0000 7f5542133640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553c195d60 con 0x7f5524003530 2024-09-13T17:05:33.865 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.862+0000 7f553b7fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5524003530 0x7f553c195140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:33.865 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.862+0000 7f553b7fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5524003530 0x7f553c195140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:57404/0 (socket says 172.21.15.149:57404) 2024-09-13T17:05:33.865 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.862+0000 7f553b7fe640 1 -- 172.21.15.149:0/3936811496 learned_addr learned my addr 172.21.15.149:0/3936811496 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-13T17:05:33.865 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.862+0000 7f553affd640 1 --2- 172.21.15.149:0/3936811496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f553c195680 0x7f553c199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:33.865 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.862+0000 7f553b7fe640 1 -- 172.21.15.149:0/3936811496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5524003530 msgr2=0x7f553c195140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-13T17:05:33.865 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.862+0000 7f553b7fe640 1 -- 172.21.15.149:0/3936811496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5524003530 msgr2=0x7f553c195140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T17:05:33.865 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.862+0000 7f553b7fe640 1 --2- 172.21.15.149:0/3936811496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5524003530 0x7f553c195140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:05:33.865 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.862+0000 7f553b7fe640 1 --2- 172.21.15.149:0/3936811496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5524003530 0x7f553c195140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:05:33.865 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.862+0000 7f553affd640 1 -- 172.21.15.149:0/3936811496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5524003530 msgr2=0x7f553c195140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:05:33.865 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.862+0000 7f553affd640 1 --2- 172.21.15.149:0/3936811496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5524003530 0x7f553c195140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:33.866 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.862+0000 7f553affd640 1 -- 172.21.15.149:0/3936811496 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f552c009a20 con 0x7f553c195680 2024-09-13T17:05:33.866 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.863+0000 7f553affd640 1 --2- 172.21.15.149:0/3936811496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f553c195680 0x7f553c199a80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f553000b3d0 tx=0x7f553000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:33.867 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.863+0000 7f5538ff9640 1 -- 172.21.15.149:0/3936811496 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f5530011630 con 0x7f553c195680 2024-09-13T17:05:33.867 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.863+0000 7f5538ff9640 1 -- 172.21.15.149:0/3936811496 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5530011c40 con 0x7f553c195680 2024-09-13T17:05:33.867 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.863+0000 7f5538ff9640 1 -- 172.21.15.149:0/3936811496 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f5530010cf0 con 0x7f553c195680 2024-09-13T17:05:33.867 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.863+0000 7f5542133640 1 -- 172.21.15.149:0/3936811496 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f553c199fc0 con 0x7f553c195680 2024-09-13T17:05:33.867 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.863+0000 7f5542133640 1 -- 172.21.15.149:0/3936811496 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f553c19a510 con 0x7f553c195680 2024-09-13T17:05:33.867 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.864+0000 7f5538ff9640 1 -- 172.21.15.149:0/3936811496 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f553001a400 con 0x7f553c195680 2024-09-13T17:05:33.867 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.864+0000 7f5538ff9640 1 --2- 172.21.15.149:0/3936811496 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f5528038540 0x7f552803aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:33.867 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.864+0000 7f5542133640 1 -- 172.21.15.149:0/3936811496 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f553c0fde10 con 0x7f553c195680 2024-09-13T17:05:33.867 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.864+0000 7f5538ff9640 1 -- 172.21.15.149:0/3936811496 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f553004af20 con 0x7f553c195680 2024-09-13T17:05:33.867 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.865+0000 7f553b7fe640 1 --2- 172.21.15.149:0/3936811496 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f5528038540 0x7f552803aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:33.867 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.865+0000 7f553b7fe640 1 --2- 172.21.15.149:0/3936811496 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f5528038540 0x7f552803aa00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f552c0113f0 tx=0x7f552c0094c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:33.871 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:33.870+0000 7f5538ff9640 1 -- 172.21.15.149:0/3936811496 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f55300193b0 con 0x7f553c195680 2024-09-13T17:05:34.097 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:34.096+0000 7f5542133640 1 -- 172.21.15.149:0/3936811496 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f553c19a8e0 con 0x7f553c195680 2024-09-13T17:05:34.098 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:34.096+0000 7f5538ff9640 1 -- 172.21.15.149:0/3936811496 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1006 (secure 0 0 0) 0x7f55300172c0 con 0x7f553c195680 2024-09-13T17:05:34.098 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T17:05:34.098 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":2,"fsid":"043d5bae-71f2-11ef-bceb-c7b262605968","modified":"2024-09-13T17:05:28.789037Z","created":"2024-09-13T17:03:54.878463Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:3300","nonce":0},{"type":"v1","addr":"172.21.15.87:6789","nonce":0}]},"addr":"172.21.15.87:6789/0","public_addr":"172.21.15.87:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-13T17:05:34.098 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 2 2024-09-13T17:05:34.100 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:34.098+0000 7f5542133640 1 -- 172.21.15.149:0/3936811496 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f5528038540 msgr2=0x7f552803aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:34.100 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:34.098+0000 7f5542133640 1 --2- 172.21.15.149:0/3936811496 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f5528038540 0x7f552803aa00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f552c0113f0 tx=0x7f552c0094c0 comp rx=0 tx=0).stop 2024-09-13T17:05:34.100 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:34.098+0000 7f5542133640 1 -- 172.21.15.149:0/3936811496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f553c195680 msgr2=0x7f553c199a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:34.101 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:34.098+0000 7f5542133640 1 --2- 172.21.15.149:0/3936811496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f553c195680 0x7f553c199a80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f553000b3d0 tx=0x7f553000b890 comp rx=0 tx=0).stop 2024-09-13T17:05:34.101 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:34.098+0000 7f5542133640 1 -- 172.21.15.149:0/3936811496 shutdown_connections 2024-09-13T17:05:34.101 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:34.098+0000 7f5542133640 1 --2- 172.21.15.149:0/3936811496 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f5528038540 0x7f552803aa00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:34.101 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:34.098+0000 7f5542133640 1 --2- 172.21.15.149:0/3936811496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f553c195680 0x7f553c199a80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:34.101 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:34.098+0000 7f5542133640 1 --2- 172.21.15.149:0/3936811496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5524003530 0x7f553c195140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:34.101 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:34.098+0000 7f5542133640 1 -- 172.21.15.149:0/3936811496 >> 172.21.15.149:0/3936811496 conn(0x7f553c0fb540 msgr2=0x7f553c103390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:34.101 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:34.098+0000 7f5542133640 1 -- 172.21.15.149:0/3936811496 shutdown_connections 2024-09-13T17:05:34.101 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:34.098+0000 7f5542133640 1 -- 172.21.15.149:0/3936811496 wait complete. 2024-09-13T17:05:34.110 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:33 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:05:34.110 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:33 smithi149 ceph-mon[35496]: mon.a calling monitor election 2024-09-13T17:05:34.110 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:33 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:05:34.110 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:33 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:05:34.110 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:33 smithi149 ceph-mon[35496]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:34.110 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:33 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:05:34.110 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:33 smithi149 ceph-mon[35496]: mon.c calling monitor election 2024-09-13T17:05:34.110 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:33 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:05:34.110 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:33 smithi149 ceph-mon[35496]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:34.110 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:33 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:05:34.111 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:33 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:05:34.111 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:33 smithi149 ceph-mon[35496]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T17:05:34.111 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:33 smithi149 ceph-mon[35496]: monmap e2: 2 mons at {a=[v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0],c=[v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T17:05:34.111 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:33 smithi149 ceph-mon[35496]: fsmap 2024-09-13T17:05:34.111 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:33 smithi149 ceph-mon[35496]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T17:05:34.111 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:33 smithi149 ceph-mon[35496]: mgrmap e13: x(active, since 45s) 2024-09-13T17:05:34.111 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:33 smithi149 ceph-mon[35496]: overall HEALTH_OK 2024-09-13T17:05:34.111 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:33 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:34.111 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:33 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:34.111 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:33 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:34.111 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:33 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T17:05:34.111 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:33 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:34.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:33 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:05:34.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:33 smithi087 ceph-mon[30934]: mon.a calling monitor election 2024-09-13T17:05:34.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:33 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:05:34.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:33 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:05:34.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:33 smithi087 ceph-mon[30934]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:34.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:33 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:05:34.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:33 smithi087 ceph-mon[30934]: mon.c calling monitor election 2024-09-13T17:05:34.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:33 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:05:34.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:33 smithi087 ceph-mon[30934]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:34.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:33 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:05:34.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:33 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:05:34.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:33 smithi087 ceph-mon[30934]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T17:05:34.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:33 smithi087 ceph-mon[30934]: monmap e2: 2 mons at {a=[v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0],c=[v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T17:05:34.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:33 smithi087 ceph-mon[30934]: fsmap 2024-09-13T17:05:34.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:33 smithi087 ceph-mon[30934]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T17:05:34.231 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:33 smithi087 ceph-mon[30934]: mgrmap e13: x(active, since 45s) 2024-09-13T17:05:34.231 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:33 smithi087 ceph-mon[30934]: overall HEALTH_OK 2024-09-13T17:05:34.231 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:33 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:34.231 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:33 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:34.231 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:33 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:34.231 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:33 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T17:05:34.231 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:33 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:35.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:34 smithi149 ceph-mon[35496]: Deploying daemon mon.b on smithi118 2024-09-13T17:05:35.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:34 smithi149 ceph-mon[35496]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:35.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:34 smithi149 ceph-mon[35496]: from='client.? 172.21.15.149:0/3936811496' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T17:05:35.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:34 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:05:35.228 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:34 smithi087 ceph-mon[30934]: Deploying daemon mon.b on smithi118 2024-09-13T17:05:35.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:34 smithi087 ceph-mon[30934]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:35.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:34 smithi087 ceph-mon[30934]: from='client.? 172.21.15.149:0/3936811496' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T17:05:35.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:34 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:05:35.646 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-13T17:05:35.646 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T17:05:35.853 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T17:05:36.229 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:05:35 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:05:35.788+0000 7eff7ec3e640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-13T17:05:37.165 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:37 smithi149 ceph-mon[35496]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:37.366 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.360+0000 7f2e9684c640 1 -- 172.21.15.149:0/3590785804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e90104790 msgr2=0x7f2e90104b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:37.366 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.360+0000 7f2e9684c640 1 --2- 172.21.15.149:0/3590785804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e90104790 0x7f2e90104b70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2e80009880 tx=0x7f2e8002a5d0 comp rx=0 tx=0).stop 2024-09-13T17:05:37.366 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.360+0000 7f2e9684c640 1 -- 172.21.15.149:0/3590785804 shutdown_connections 2024-09-13T17:05:37.366 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.360+0000 7f2e9684c640 1 --2- 172.21.15.149:0/3590785804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e90104790 0x7f2e90104b70 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:37.366 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.360+0000 7f2e9684c640 1 -- 172.21.15.149:0/3590785804 >> 172.21.15.149:0/3590785804 conn(0x7f2e900fa490 msgr2=0x7f2e900fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:37.366 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.360+0000 7f2e9684c640 1 -- 172.21.15.149:0/3590785804 shutdown_connections 2024-09-13T17:05:37.366 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.360+0000 7f2e9684c640 1 -- 172.21.15.149:0/3590785804 wait complete. 2024-09-13T17:05:37.366 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.360+0000 7f2e9684c640 1 Processor -- start 2024-09-13T17:05:37.366 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.361+0000 7f2e9684c640 1 -- start start 2024-09-13T17:05:37.366 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.361+0000 7f2e9684c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e90104790 0x7f2e901960a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:37.366 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.361+0000 7f2e9684c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e901965e0 0x7f2e90196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:37.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.361+0000 7f2e9684c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e90069390 con 0x7f2e90104790 2024-09-13T17:05:37.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.361+0000 7f2e9684c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9019f110 con 0x7f2e901965e0 2024-09-13T17:05:37.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.361+0000 7f2e87fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e901965e0 0x7f2e90196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:37.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.361+0000 7f2e87fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e901965e0 0x7f2e90196a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:57416/0 (socket says 172.21.15.149:57416) 2024-09-13T17:05:37.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.361+0000 7f2e87fff640 1 -- 172.21.15.149:0/2834525632 learned_addr learned my addr 172.21.15.149:0/2834525632 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-13T17:05:37.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.361+0000 7f2e8ffff640 1 --2- 172.21.15.149:0/2834525632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e90104790 0x7f2e901960a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:37.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.361+0000 7f2e87fff640 1 -- 172.21.15.149:0/2834525632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e901965e0 msgr2=0x7f2e90196a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-13T17:05:37.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.361+0000 7f2e87fff640 1 -- 172.21.15.149:0/2834525632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e901965e0 msgr2=0x7f2e90196a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T17:05:37.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.361+0000 7f2e87fff640 1 --2- 172.21.15.149:0/2834525632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e901965e0 0x7f2e90196a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:05:37.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.361+0000 7f2e87fff640 1 --2- 172.21.15.149:0/2834525632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e901965e0 0x7f2e90196a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:05:37.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.361+0000 7f2e8ffff640 1 -- 172.21.15.149:0/2834525632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e901965e0 msgr2=0x7f2e90196a40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:05:37.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.361+0000 7f2e8ffff640 1 --2- 172.21.15.149:0/2834525632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e901965e0 0x7f2e90196a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:37.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.361+0000 7f2e8ffff640 1 -- 172.21.15.149:0/2834525632 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e80009560 con 0x7f2e90104790 2024-09-13T17:05:37.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.362+0000 7f2e8ffff640 1 --2- 172.21.15.149:0/2834525632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e90104790 0x7f2e901960a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2e80009880 tx=0x7f2e80004c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:37.368 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.362+0000 7f2e8dffb640 1 -- 172.21.15.149:0/2834525632 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f2e800052d0 con 0x7f2e90104790 2024-09-13T17:05:37.368 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.362+0000 7f2e9684c640 1 -- 172.21.15.149:0/2834525632 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e9019f370 con 0x7f2e90104790 2024-09-13T17:05:37.368 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.362+0000 7f2e8dffb640 1 -- 172.21.15.149:0/2834525632 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2e80005430 con 0x7f2e90104790 2024-09-13T17:05:37.368 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.362+0000 7f2e8dffb640 1 -- 172.21.15.149:0/2834525632 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f2e8003b5d0 con 0x7f2e90104790 2024-09-13T17:05:37.368 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.362+0000 7f2e9684c640 1 -- 172.21.15.149:0/2834525632 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e9019f8c0 con 0x7f2e90104790 2024-09-13T17:05:37.368 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.363+0000 7f2e8dffb640 1 -- 172.21.15.149:0/2834525632 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f2e800035f0 con 0x7f2e90104790 2024-09-13T17:05:37.368 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.363+0000 7f2e9684c640 1 -- 172.21.15.149:0/2834525632 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e900ffed0 con 0x7f2e90104790 2024-09-13T17:05:37.368 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.363+0000 7f2e8dffb640 1 --2- 172.21.15.149:0/2834525632 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2e7c0384f0 0x7f2e7c03a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:37.368 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.363+0000 7f2e8dffb640 1 -- 172.21.15.149:0/2834525632 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f2e8006c020 con 0x7f2e90104790 2024-09-13T17:05:37.368 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.363+0000 7f2e87fff640 1 --2- 172.21.15.149:0/2834525632 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2e7c0384f0 0x7f2e7c03a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:37.368 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.364+0000 7f2e87fff640 1 --2- 172.21.15.149:0/2834525632 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2e7c0384f0 0x7f2e7c03a9b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2e78009100 tx=0x7f2e78008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:37.370 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.368+0000 7f2e8dffb640 1 -- 172.21.15.149:0/2834525632 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2e80039530 con 0x7f2e90104790 2024-09-13T17:05:37.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:37 smithi087 ceph-mon[30934]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:37.592 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.590+0000 7f2e9684c640 1 -- 172.21.15.149:0/2834525632 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2e90104bf0 con 0x7f2e90104790 2024-09-13T17:05:37.593 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.591+0000 7f2e8dffb640 1 -- 172.21.15.149:0/2834525632 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1006 (secure 0 0 0) 0x7f2e80049030 con 0x7f2e90104790 2024-09-13T17:05:37.593 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T17:05:37.593 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":2,"fsid":"043d5bae-71f2-11ef-bceb-c7b262605968","modified":"2024-09-13T17:05:28.789037Z","created":"2024-09-13T17:03:54.878463Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:3300","nonce":0},{"type":"v1","addr":"172.21.15.87:6789","nonce":0}]},"addr":"172.21.15.87:6789/0","public_addr":"172.21.15.87:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-13T17:05:37.593 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 2 2024-09-13T17:05:37.595 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.593+0000 7f2e9684c640 1 -- 172.21.15.149:0/2834525632 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2e7c0384f0 msgr2=0x7f2e7c03a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:37.595 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.593+0000 7f2e9684c640 1 --2- 172.21.15.149:0/2834525632 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2e7c0384f0 0x7f2e7c03a9b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2e78009100 tx=0x7f2e78008040 comp rx=0 tx=0).stop 2024-09-13T17:05:37.595 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.593+0000 7f2e9684c640 1 -- 172.21.15.149:0/2834525632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e90104790 msgr2=0x7f2e901960a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:37.595 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.593+0000 7f2e9684c640 1 --2- 172.21.15.149:0/2834525632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e90104790 0x7f2e901960a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2e80009880 tx=0x7f2e80004c60 comp rx=0 tx=0).stop 2024-09-13T17:05:37.595 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.593+0000 7f2e9684c640 1 -- 172.21.15.149:0/2834525632 shutdown_connections 2024-09-13T17:05:37.595 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.593+0000 7f2e9684c640 1 --2- 172.21.15.149:0/2834525632 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2e7c0384f0 0x7f2e7c03a9b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:37.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.593+0000 7f2e9684c640 1 --2- 172.21.15.149:0/2834525632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e901965e0 0x7f2e90196a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:37.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.593+0000 7f2e9684c640 1 --2- 172.21.15.149:0/2834525632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e90104790 0x7f2e901960a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:37.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.593+0000 7f2e9684c640 1 -- 172.21.15.149:0/2834525632 >> 172.21.15.149:0/2834525632 conn(0x7f2e900fa490 msgr2=0x7f2e900fbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:37.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.593+0000 7f2e9684c640 1 -- 172.21.15.149:0/2834525632 shutdown_connections 2024-09-13T17:05:37.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:37.593+0000 7f2e9684c640 1 -- 172.21.15.149:0/2834525632 wait complete. 2024-09-13T17:05:37.692 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 podman[34354]: 2024-09-13 17:05:37.669751973 +0000 UTC m=+0.343553372 container start 01f3bc8e7b81b84c48285ca54c8b81e077f160c3906efe2898202528ff5cb196 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mon-b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-13T17:05:38.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T17:05:38.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable), process ceph-mon, pid 2 2024-09-13T17:05:38.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: pidfile_write: ignore empty --pid-file 2024-09-13T17:05:38.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: load: jerasure load: lrc 2024-09-13T17:05:38.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: RocksDB version: 7.9.2 2024-09-13T17:05:38.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Git sha 0 2024-09-13T17:05:38.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Compile date 2024-09-10 12:59:06 2024-09-13T17:05:38.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: DB SUMMARY 2024-09-13T17:05:38.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: DB Session ID: 04WSTXB5EMJWWWXIMJYJ 2024-09-13T17:05:38.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: CURRENT file: CURRENT 2024-09-13T17:05:38.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T17:05:38.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-13T17:05:38.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-13T17:05:38.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-13T17:05:38.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.error_if_exists: 0 2024-09-13T17:05:38.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.create_if_missing: 0 2024-09-13T17:05:38.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.paranoid_checks: 1 2024-09-13T17:05:38.115 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T17:05:38.115 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T17:05:38.115 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T17:05:38.115 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.env: 0x5642a5712bc0 2024-09-13T17:05:38.115 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T17:05:38.115 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.info_log: 0x5642a7060be0 2024-09-13T17:05:38.115 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T17:05:38.115 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.statistics: (nil) 2024-09-13T17:05:38.115 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.use_fsync: 0 2024-09-13T17:05:38.115 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.max_log_file_size: 0 2024-09-13T17:05:38.115 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T17:05:38.115 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T17:05:38.116 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T17:05:38.116 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T17:05:38.116 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.allow_fallocate: 1 2024-09-13T17:05:38.116 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T17:05:38.116 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T17:05:38.116 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.use_direct_reads: 0 2024-09-13T17:05:38.116 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T17:05:38.116 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T17:05:38.116 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.db_log_dir: 2024-09-13T17:05:38.116 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.wal_dir: 2024-09-13T17:05:38.116 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T17:05:38.118 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T17:05:38.118 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T17:05:38.118 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T17:05:38.118 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T17:05:38.118 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T17:05:38.118 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T17:05:38.118 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T17:05:38.118 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.write_buffer_manager: 0x5642a706e320 2024-09-13T17:05:38.118 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T17:05:38.119 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T17:05:38.119 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T17:05:38.119 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T17:05:38.119 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T17:05:38.119 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T17:05:38.119 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T17:05:38.119 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T17:05:38.119 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.unordered_write: 0 2024-09-13T17:05:38.119 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T17:05:38.119 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T17:05:38.119 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T17:05:38.119 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T17:05:38.119 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.row_cache: None 2024-09-13T17:05:38.119 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.wal_filter: None 2024-09-13T17:05:38.120 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T17:05:38.120 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T17:05:38.120 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.two_write_queues: 0 2024-09-13T17:05:38.120 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T17:05:38.120 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.wal_compression: 0 2024-09-13T17:05:38.120 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.atomic_flush: 0 2024-09-13T17:05:38.120 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T17:05:38.120 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T17:05:38.120 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T17:05:38.120 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.log_readahead_size: 0 2024-09-13T17:05:38.120 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T17:05:38.120 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T17:05:38.120 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T17:05:38.120 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T17:05:38.121 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T17:05:38.121 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T17:05:38.121 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T17:05:38.121 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.max_background_jobs: 2 2024-09-13T17:05:38.121 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.max_background_compactions: -1 2024-09-13T17:05:38.121 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.max_subcompactions: 1 2024-09-13T17:05:38.121 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T17:05:38.121 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T17:05:38.121 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T17:05:38.121 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T17:05:38.121 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T17:05:38.121 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T17:05:38.121 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T17:05:38.121 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T17:05:38.122 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.max_open_files: -1 2024-09-13T17:05:38.122 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T17:05:38.122 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T17:05:38.122 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T17:05:38.122 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T17:05:38.122 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.max_background_flushes: -1 2024-09-13T17:05:38.122 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Compression algorithms supported: 2024-09-13T17:05:38.122 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: kZSTD supported: 0 2024-09-13T17:05:38.122 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: kXpressCompression supported: 0 2024-09-13T17:05:38.122 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: kBZip2Compression supported: 0 2024-09-13T17:05:38.122 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T17:05:38.122 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: kLZ4Compression supported: 1 2024-09-13T17:05:38.122 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: kZlibCompression supported: 1 2024-09-13T17:05:38.122 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T17:05:38.123 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: kSnappyCompression supported: 1 2024-09-13T17:05:38.123 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T17:05:38.123 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T17:05:38.123 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-13T17:05:38.123 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T17:05:38.123 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T17:05:38.123 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.merge_operator: 2024-09-13T17:05:38.123 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.compaction_filter: None 2024-09-13T17:05:38.123 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T17:05:38.123 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T17:05:38.123 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T17:05:38.123 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T17:05:38.123 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5642a70607e0) 2024-09-13T17:05:38.123 INFO:journalctl@ceph.mon.b.smithi118.stdout: cache_index_and_filter_blocks: 1 2024-09-13T17:05:38.124 INFO:journalctl@ceph.mon.b.smithi118.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T17:05:38.124 INFO:journalctl@ceph.mon.b.smithi118.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T17:05:38.124 INFO:journalctl@ceph.mon.b.smithi118.stdout: pin_top_level_index_and_filter: 1 2024-09-13T17:05:38.124 INFO:journalctl@ceph.mon.b.smithi118.stdout: index_type: 0 2024-09-13T17:05:38.124 INFO:journalctl@ceph.mon.b.smithi118.stdout: data_block_index_type: 0 2024-09-13T17:05:38.124 INFO:journalctl@ceph.mon.b.smithi118.stdout: index_shortening: 1 2024-09-13T17:05:38.124 INFO:journalctl@ceph.mon.b.smithi118.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T17:05:38.124 INFO:journalctl@ceph.mon.b.smithi118.stdout: checksum: 4 2024-09-13T17:05:38.124 INFO:journalctl@ceph.mon.b.smithi118.stdout: no_block_cache: 0 2024-09-13T17:05:38.124 INFO:journalctl@ceph.mon.b.smithi118.stdout: block_cache: 0x5642a70551f0 2024-09-13T17:05:38.124 INFO:journalctl@ceph.mon.b.smithi118.stdout: block_cache_name: BinnedLRUCache 2024-09-13T17:05:38.124 INFO:journalctl@ceph.mon.b.smithi118.stdout: block_cache_options: 2024-09-13T17:05:38.124 INFO:journalctl@ceph.mon.b.smithi118.stdout: capacity : 536870912 2024-09-13T17:05:38.124 INFO:journalctl@ceph.mon.b.smithi118.stdout: num_shard_bits : 4 2024-09-13T17:05:38.125 INFO:journalctl@ceph.mon.b.smithi118.stdout: strict_capacity_limit : 0 2024-09-13T17:05:38.125 INFO:journalctl@ceph.mon.b.smithi118.stdout: high_pri_pool_ratio: 0.000 2024-09-13T17:05:38.125 INFO:journalctl@ceph.mon.b.smithi118.stdout: block_cache_compressed: (nil) 2024-09-13T17:05:38.125 INFO:journalctl@ceph.mon.b.smithi118.stdout: persistent_cache: (nil) 2024-09-13T17:05:38.125 INFO:journalctl@ceph.mon.b.smithi118.stdout: block_size: 4096 2024-09-13T17:05:38.125 INFO:journalctl@ceph.mon.b.smithi118.stdout: block_size_deviation: 10 2024-09-13T17:05:38.125 INFO:journalctl@ceph.mon.b.smithi118.stdout: block_restart_interval: 16 2024-09-13T17:05:38.125 INFO:journalctl@ceph.mon.b.smithi118.stdout: index_block_restart_interval: 1 2024-09-13T17:05:38.125 INFO:journalctl@ceph.mon.b.smithi118.stdout: metadata_block_size: 4096 2024-09-13T17:05:38.125 INFO:journalctl@ceph.mon.b.smithi118.stdout: partition_filters: 0 2024-09-13T17:05:38.125 INFO:journalctl@ceph.mon.b.smithi118.stdout: use_delta_encoding: 1 2024-09-13T17:05:38.125 INFO:journalctl@ceph.mon.b.smithi118.stdout: filter_policy: bloomfilter 2024-09-13T17:05:38.125 INFO:journalctl@ceph.mon.b.smithi118.stdout: whole_key_filtering: 1 2024-09-13T17:05:38.125 INFO:journalctl@ceph.mon.b.smithi118.stdout: verify_compression: 0 2024-09-13T17:05:38.126 INFO:journalctl@ceph.mon.b.smithi118.stdout: read_amp_bytes_per_bit: 0 2024-09-13T17:05:38.126 INFO:journalctl@ceph.mon.b.smithi118.stdout: format_version: 5 2024-09-13T17:05:38.126 INFO:journalctl@ceph.mon.b.smithi118.stdout: enable_index_compression: 1 2024-09-13T17:05:38.126 INFO:journalctl@ceph.mon.b.smithi118.stdout: block_align: 0 2024-09-13T17:05:38.126 INFO:journalctl@ceph.mon.b.smithi118.stdout: max_auto_readahead_size: 262144 2024-09-13T17:05:38.126 INFO:journalctl@ceph.mon.b.smithi118.stdout: prepopulate_block_cache: 0 2024-09-13T17:05:38.126 INFO:journalctl@ceph.mon.b.smithi118.stdout: initial_auto_readahead_size: 8192 2024-09-13T17:05:38.126 INFO:journalctl@ceph.mon.b.smithi118.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T17:05:38.126 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T17:05:38.126 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T17:05:38.126 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.compression: NoCompression 2024-09-13T17:05:38.126 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T17:05:38.126 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T17:05:38.126 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T17:05:38.126 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.num_levels: 7 2024-09-13T17:05:38.127 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T17:05:38.127 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T17:05:38.127 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T17:05:38.127 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T17:05:38.127 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T17:05:38.127 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T17:05:38.127 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T17:05:38.127 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T17:05:38.127 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T17:05:38.127 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T17:05:38.127 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T17:05:38.127 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T17:05:38.127 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T17:05:38.128 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T17:05:38.128 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T17:05:38.128 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T17:05:38.128 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T17:05:38.128 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T17:05:38.128 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T17:05:38.128 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T17:05:38.128 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T17:05:38.128 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T17:05:38.128 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T17:05:38.128 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T17:05:38.128 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T17:05:38.128 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T17:05:38.128 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T17:05:38.129 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T17:05:38.129 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T17:05:38.129 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T17:05:38.129 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T17:05:38.129 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T17:05:38.129 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T17:05:38.129 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T17:05:38.129 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T17:05:38.129 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T17:05:38.129 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T17:05:38.129 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T17:05:38.129 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T17:05:38.129 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T17:05:38.129 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T17:05:38.130 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T17:05:38.130 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T17:05:38.130 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T17:05:38.130 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T17:05:38.130 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T17:05:38.130 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T17:05:38.130 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T17:05:38.130 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T17:05:38.130 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T17:05:38.130 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T17:05:38.130 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T17:05:38.130 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T17:05:38.130 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T17:05:38.130 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.inplace_update_support: 0 2024-09-13T17:05:38.131 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T17:05:38.131 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T17:05:38.131 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T17:05:38.131 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T17:05:38.131 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.bloom_locality: 0 2024-09-13T17:05:38.131 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.max_successive_merges: 0 2024-09-13T17:05:38.131 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T17:05:38.131 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T17:05:38.131 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T17:05:38.131 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T17:05:38.131 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.ttl: 2592000 2024-09-13T17:05:38.131 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T17:05:38.131 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T17:05:38.131 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T17:05:38.132 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.enable_blob_files: false 2024-09-13T17:05:38.132 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.min_blob_size: 0 2024-09-13T17:05:38.132 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T17:05:38.132 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T17:05:38.132 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T17:05:38.132 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T17:05:38.132 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T17:05:38.132 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T17:05:38.132 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T17:05:38.132 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T17:05:38.132 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-13T17:05:38.132 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-13T17:05:38.132 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 334223a9-70ee-4fc1-a9e2-acb28d992565 2024-09-13T17:05:38.133 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726247137697031, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-13T17:05:38.133 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-13T17:05:38.133 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726247137697423, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726247137, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "334223a9-70ee-4fc1-a9e2-acb28d992565", "db_session_id": "04WSTXB5EMJWWWXIMJYJ", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-13T17:05:38.133 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726247137697514, "job": 1, "event": "recovery_finished"} 2024-09-13T17:05:38.133 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-13T17:05:38.133 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T17:05:38.133 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5642a7080e00 2024-09-13T17:05:38.133 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: DB pointer 0x5642a7174000 2024-09-13T17:05:38.133 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T17:05:38.133 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T17:05:38.133 INFO:journalctl@ceph.mon.b.smithi118.stdout: ** DB Stats ** 2024-09-13T17:05:38.133 INFO:journalctl@ceph.mon.b.smithi118.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T17:05:38.133 INFO:journalctl@ceph.mon.b.smithi118.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T17:05:38.134 INFO:journalctl@ceph.mon.b.smithi118.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T17:05:38.134 INFO:journalctl@ceph.mon.b.smithi118.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T17:05:38.134 INFO:journalctl@ceph.mon.b.smithi118.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T17:05:38.134 INFO:journalctl@ceph.mon.b.smithi118.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T17:05:38.134 INFO:journalctl@ceph.mon.b.smithi118.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T17:05:38.134 INFO:journalctl@ceph.mon.b.smithi118.stdout: 2024-09-13T17:05:38.134 INFO:journalctl@ceph.mon.b.smithi118.stdout: ** Compaction Stats [default] ** 2024-09-13T17:05:38.134 INFO:journalctl@ceph.mon.b.smithi118.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T17:05:38.134 INFO:journalctl@ceph.mon.b.smithi118.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T17:05:38.134 INFO:journalctl@ceph.mon.b.smithi118.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T17:05:38.134 INFO:journalctl@ceph.mon.b.smithi118.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T17:05:38.134 INFO:journalctl@ceph.mon.b.smithi118.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T17:05:38.134 INFO:journalctl@ceph.mon.b.smithi118.stdout: 2024-09-13T17:05:38.134 INFO:journalctl@ceph.mon.b.smithi118.stdout: ** Compaction Stats [default] ** 2024-09-13T17:05:38.135 INFO:journalctl@ceph.mon.b.smithi118.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T17:05:38.135 INFO:journalctl@ceph.mon.b.smithi118.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T17:05:38.135 INFO:journalctl@ceph.mon.b.smithi118.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T17:05:38.135 INFO:journalctl@ceph.mon.b.smithi118.stdout: 2024-09-13T17:05:38.135 INFO:journalctl@ceph.mon.b.smithi118.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T17:05:38.135 INFO:journalctl@ceph.mon.b.smithi118.stdout: 2024-09-13T17:05:38.135 INFO:journalctl@ceph.mon.b.smithi118.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T17:05:38.135 INFO:journalctl@ceph.mon.b.smithi118.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-13T17:05:38.135 INFO:journalctl@ceph.mon.b.smithi118.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T17:05:38.135 INFO:journalctl@ceph.mon.b.smithi118.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T17:05:38.135 INFO:journalctl@ceph.mon.b.smithi118.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T17:05:38.135 INFO:journalctl@ceph.mon.b.smithi118.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T17:05:38.135 INFO:journalctl@ceph.mon.b.smithi118.stdout: Cumulative compaction: 0.00 GB write, 0.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T17:05:38.135 INFO:journalctl@ceph.mon.b.smithi118.stdout: Interval compaction: 0.00 GB write, 0.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T17:05:38.136 INFO:journalctl@ceph.mon.b.smithi118.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T17:05:38.136 INFO:journalctl@ceph.mon.b.smithi118.stdout: Block cache BinnedLRUCache@0x5642a70551f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 7e-06 secs_since: 0 2024-09-13T17:05:38.136 INFO:journalctl@ceph.mon.b.smithi118.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-13T17:05:38.136 INFO:journalctl@ceph.mon.b.smithi118.stdout: 2024-09-13T17:05:38.136 INFO:journalctl@ceph.mon.b.smithi118.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T17:05:38.136 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-13T17:05:38.136 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: using public_addr v2:172.21.15.118:0/0 -> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2024-09-13T17:05:38.136 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: starting mon.b rank -1 at public addrs [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] at bind addrs [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 043d5bae-71f2-11ef-bceb-c7b262605968 2024-09-13T17:05:38.136 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: mon.b@-1(???) e0 preinit fsid 043d5bae-71f2-11ef-bceb-c7b262605968 2024-09-13T17:05:38.136 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: mon.b@-1(synchronizing).mds e1 new map 2024-09-13T17:05:38.136 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-13T17:05:38.136 INFO:journalctl@ceph.mon.b.smithi118.stdout: e1 2024-09-13T17:05:38.136 INFO:journalctl@ceph.mon.b.smithi118.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T17:05:38.136 INFO:journalctl@ceph.mon.b.smithi118.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:05:38.137 INFO:journalctl@ceph.mon.b.smithi118.stdout: legacy client fscid: -1 2024-09-13T17:05:38.137 INFO:journalctl@ceph.mon.b.smithi118.stdout: 2024-09-13T17:05:38.137 INFO:journalctl@ceph.mon.b.smithi118.stdout: No filesystems configured 2024-09-13T17:05:38.137 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-13T17:05:38.137 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-13T17:05:38.137 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-13T17:05:38.137 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-13T17:05:38.137 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-13T17:05:38.137 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-13T17:05:38.137 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-13T17:05:38.137 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T17:05:38.137 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T17:05:38.137 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T17:05:38.138 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: Deploying cephadm binary to smithi149 2024-09-13T17:05:38.138 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:38.138 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:38.138 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: Added host smithi149 2024-09-13T17:05:38.138 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:05:38.138 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:38.138 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:38.138 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:38.138 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:38.138 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:38.138 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:05:38.138 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:38.138 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:38.138 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:38.138 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:38.139 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:05:38.139 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:38.139 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:05:38.139 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: Updating smithi149:/etc/ceph/ceph.conf 2024-09-13T17:05:38.139 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:38.139 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: Updating smithi149:/var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:05:38.139 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: Updating smithi149:/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:05:38.139 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1192086475' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-13T17:05:38.139 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:38.139 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:38.139 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:38.139 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: Updating smithi149:/var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T17:05:38.139 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1192086475' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-13T17:05:38.140 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T17:05:38.140 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:38.140 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi087:172.21.15.87=a;smithi118:172.21.15.118=b;smithi149:172.21.15.149=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:05:38.140 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: Saving service mon spec with placement smithi087:172.21.15.87=a;smithi118:172.21.15.118=b;smithi149:172.21.15.149=c;count:3 2024-09-13T17:05:38.140 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:38.140 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:05:38.140 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:38.140 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:05:38.140 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:38.140 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T17:05:38.140 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:38.140 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: Deploying daemon mon.c on smithi149 2024-09-13T17:05:38.140 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:38.140 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:38.141 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='client.? 172.21.15.149:0/1150147644' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T17:05:38.141 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:05:38.141 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: mon.a calling monitor election 2024-09-13T17:05:38.141 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:05:38.141 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:05:38.141 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:38.141 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:05:38.141 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: mon.c calling monitor election 2024-09-13T17:05:38.141 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:05:38.141 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:38.141 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:05:38.141 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:05:38.141 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T17:05:38.141 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: monmap e2: 2 mons at {a=[v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0],c=[v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T17:05:38.142 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: fsmap 2024-09-13T17:05:38.142 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T17:05:38.142 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: mgrmap e13: x(active, since 45s) 2024-09-13T17:05:38.142 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: overall HEALTH_OK 2024-09-13T17:05:38.142 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:38.142 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:38.142 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:38.142 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T17:05:38.142 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:38.142 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: Deploying daemon mon.b on smithi118 2024-09-13T17:05:38.142 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:38.142 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='client.? 172.21.15.149:0/3936811496' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T17:05:38.142 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:05:38.142 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:38.143 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 ceph-mon[34374]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-13T17:05:38.143 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 bash[34354]: 01f3bc8e7b81b84c48285ca54c8b81e077f160c3906efe2898202528ff5cb196 2024-09-13T17:05:38.143 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:37 smithi118 systemd[1]: Started Ceph mon.b for 043d5bae-71f2-11ef-bceb-c7b262605968. 2024-09-13T17:05:39.145 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-13T17:05:39.145 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T17:05:39.355 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T17:05:43.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:42 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:05:43.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:42 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:05:43.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:42 smithi149 ceph-mon[35496]: mon.a calling monitor election 2024-09-13T17:05:43.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:42 smithi149 ceph-mon[35496]: mon.c calling monitor election 2024-09-13T17:05:43.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:42 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:05:43.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:42 smithi149 ceph-mon[35496]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:43.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:42 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:05:43.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:42 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:05:43.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:42 smithi149 ceph-mon[35496]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:43.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:42 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:05:43.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:42 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:05:43.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:42 smithi149 ceph-mon[35496]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:43.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:42 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:05:43.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:42 smithi149 ceph-mon[35496]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T17:05:43.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:42 smithi149 ceph-mon[35496]: monmap e3: 3 mons at {a=[v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0],b=[v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0],c=[v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T17:05:43.094 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:42 smithi149 ceph-mon[35496]: fsmap 2024-09-13T17:05:43.094 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:42 smithi149 ceph-mon[35496]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T17:05:43.094 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:42 smithi149 ceph-mon[35496]: mgrmap e13: x(active, since 54s) 2024-09-13T17:05:43.094 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:42 smithi149 ceph-mon[35496]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-09-13T17:05:43.094 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:42 smithi149 ceph-mon[35496]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-13T17:05:43.094 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:42 smithi149 ceph-mon[35496]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-13T17:05:43.094 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:42 smithi149 ceph-mon[35496]: mon.b (rank 2) addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] is down (out of quorum) 2024-09-13T17:05:43.094 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:42 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:43.094 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:42 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:43.094 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:42 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:43.094 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:42 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:43.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:42 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:05:43.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:42 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:05:43.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:42 smithi087 ceph-mon[30934]: mon.a calling monitor election 2024-09-13T17:05:43.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:42 smithi087 ceph-mon[30934]: mon.c calling monitor election 2024-09-13T17:05:43.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:42 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:05:43.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:42 smithi087 ceph-mon[30934]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:43.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:42 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:05:43.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:42 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:05:43.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:42 smithi087 ceph-mon[30934]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:43.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:42 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:05:43.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:42 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:05:43.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:42 smithi087 ceph-mon[30934]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:43.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:42 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:05:43.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:42 smithi087 ceph-mon[30934]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T17:05:43.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:42 smithi087 ceph-mon[30934]: monmap e3: 3 mons at {a=[v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0],b=[v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0],c=[v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T17:05:43.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:42 smithi087 ceph-mon[30934]: fsmap 2024-09-13T17:05:43.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:42 smithi087 ceph-mon[30934]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T17:05:43.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:42 smithi087 ceph-mon[30934]: mgrmap e13: x(active, since 54s) 2024-09-13T17:05:43.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:42 smithi087 ceph-mon[30934]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-09-13T17:05:43.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:42 smithi087 ceph-mon[30934]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-13T17:05:43.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:42 smithi087 ceph-mon[30934]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-13T17:05:43.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:42 smithi087 ceph-mon[30934]: mon.b (rank 2) addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] is down (out of quorum) 2024-09-13T17:05:43.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:42 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:43.231 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:42 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:43.231 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:42 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:43.231 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:42 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:43.817 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.815+0000 7f8ebbe8a640 1 -- 172.21.15.149:0/679766246 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ea0003530 msgr2=0x7f8ea00059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:43.817 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.815+0000 7f8ebbe8a640 1 --2- 172.21.15.149:0/679766246 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ea0003530 0x7f8ea00059c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4075a10 tx=0x7f8eb002bc80 comp rx=0 tx=0).stop 2024-09-13T17:05:43.817 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.815+0000 7f8ebbe8a640 1 -- 172.21.15.149:0/679766246 shutdown_connections 2024-09-13T17:05:43.817 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.815+0000 7f8ebbe8a640 1 --2- 172.21.15.149:0/679766246 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ea0003530 0x7f8ea00059c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:43.817 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.815+0000 7f8ebbe8a640 1 -- 172.21.15.149:0/679766246 >> 172.21.15.149:0/679766246 conn(0x7f8eb4074620 msgr2=0x7f8eb4074a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:43.817 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.815+0000 7f8ebbe8a640 1 -- 172.21.15.149:0/679766246 shutdown_connections 2024-09-13T17:05:43.817 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.815+0000 7f8ebbe8a640 1 -- 172.21.15.149:0/679766246 wait complete. 2024-09-13T17:05:43.820 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.815+0000 7f8ebbe8a640 1 Processor -- start 2024-09-13T17:05:43.820 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.815+0000 7f8ebbe8a640 1 -- start start 2024-09-13T17:05:43.820 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.816+0000 7f8ebbe8a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ea0003530 0x7f8eb4194180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:43.820 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.816+0000 7f8ebbe8a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8eb41946c0 0x7f8eb4198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:43.820 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.816+0000 7f8ebbe8a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8eb4199000 0x7f8eb41994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:43.820 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.816+0000 7f8ebbe8a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb4194d90 con 0x7f8ea0003530 2024-09-13T17:05:43.820 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.816+0000 7f8ebbe8a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb41a0d70 con 0x7f8eb41946c0 2024-09-13T17:05:43.820 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.816+0000 7f8ebbe8a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb41a0eb0 con 0x7f8eb4199000 2024-09-13T17:05:43.820 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.816+0000 7f8eba427640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8eb4199000 0x7f8eb41994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:43.820 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.816+0000 7f8eb9c26640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ea0003530 0x7f8eb4194180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:43.821 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.816+0000 7f8eba427640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8eb4199000 0x7f8eb41994b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:51140/0 (socket says 172.21.15.149:51140) 2024-09-13T17:05:43.821 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.816+0000 7f8eba427640 1 -- 172.21.15.149:0/2387115659 learned_addr learned my addr 172.21.15.149:0/2387115659 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-13T17:05:43.821 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.816+0000 7f8eb9425640 1 --2- 172.21.15.149:0/2387115659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8eb41946c0 0x7f8eb4198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:43.821 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.816+0000 7f8eb9425640 1 -- 172.21.15.149:0/2387115659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8eb41946c0 msgr2=0x7f8eb4198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-13T17:05:43.821 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.816+0000 7f8eb9425640 1 -- 172.21.15.149:0/2387115659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8eb41946c0 msgr2=0x7f8eb4198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T17:05:43.821 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.816+0000 7f8eb9425640 1 --2- 172.21.15.149:0/2387115659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8eb41946c0 0x7f8eb4198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:05:43.821 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.816+0000 7f8eb9425640 1 --2- 172.21.15.149:0/2387115659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8eb41946c0 0x7f8eb4198ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:05:43.821 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.816+0000 7f8eb9c26640 1 -- 172.21.15.149:0/2387115659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8eb4199000 msgr2=0x7f8eb41994b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:43.821 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.816+0000 7f8eb9c26640 1 --2- 172.21.15.149:0/2387115659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8eb4199000 0x7f8eb41994b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:43.821 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.816+0000 7f8eb9c26640 1 -- 172.21.15.149:0/2387115659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8eb41946c0 msgr2=0x7f8eb4198ac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:05:43.824 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.816+0000 7f8eb9c26640 1 --2- 172.21.15.149:0/2387115659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8eb41946c0 0x7f8eb4198ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:43.824 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.816+0000 7f8eb9c26640 1 -- 172.21.15.149:0/2387115659 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb0009a20 con 0x7f8ea0003530 2024-09-13T17:05:43.824 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.816+0000 7f8eba427640 1 --2- 172.21.15.149:0/2387115659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8eb4199000 0x7f8eb41994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:05:43.824 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.816+0000 7f8eb9c26640 1 --2- 172.21.15.149:0/2387115659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ea0003530 0x7f8eb4194180 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4075a10 tx=0x7f8eb002ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:43.824 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.817+0000 7f8eaaffd640 1 -- 172.21.15.149:0/2387115659 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb0004df0 con 0x7f8ea0003530 2024-09-13T17:05:43.824 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.817+0000 7f8eaaffd640 1 -- 172.21.15.149:0/2387115659 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8eb002d940 con 0x7f8ea0003530 2024-09-13T17:05:43.824 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.817+0000 7f8ebbe8a640 1 -- 172.21.15.149:0/2387115659 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb41a1100 con 0x7f8ea0003530 2024-09-13T17:05:43.824 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.817+0000 7f8eaaffd640 1 -- 172.21.15.149:0/2387115659 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb0005670 con 0x7f8ea0003530 2024-09-13T17:05:43.824 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.817+0000 7f8ebbe8a640 1 -- 172.21.15.149:0/2387115659 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb41a1650 con 0x7f8ea0003530 2024-09-13T17:05:43.825 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.818+0000 7f8eaaffd640 1 -- 172.21.15.149:0/2387115659 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f8eb000a040 con 0x7f8ea0003530 2024-09-13T17:05:43.825 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.818+0000 7f8ebbe8a640 1 -- 172.21.15.149:0/2387115659 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb40fffc0 con 0x7f8ea0003530 2024-09-13T17:05:43.825 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.818+0000 7f8eaaffd640 1 --2- 172.21.15.149:0/2387115659 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f8e98038b90 0x7f8e9803b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:43.825 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.818+0000 7f8eaaffd640 1 -- 172.21.15.149:0/2387115659 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f8eb006cc20 con 0x7f8ea0003530 2024-09-13T17:05:43.825 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.818+0000 7f8eb9425640 1 --2- 172.21.15.149:0/2387115659 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f8e98038b90 0x7f8e9803b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:43.825 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.819+0000 7f8eb9425640 1 --2- 172.21.15.149:0/2387115659 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f8e98038b90 0x7f8e9803b050 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4006fd0 tx=0x7f8ea4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:43.825 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:43.823+0000 7f8eaaffd640 1 -- 172.21.15.149:0/2387115659 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8eb0036360 con 0x7f8ea0003530 2024-09-13T17:05:44.065 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:44.063+0000 7f8ebbe8a640 1 -- 172.21.15.149:0/2387115659 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8eb418de40 con 0x7f8ea0003530 2024-09-13T17:05:44.065 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:43 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:05:44.065 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:43 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:44.065 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:43 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:05:44.066 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:44.063+0000 7f8eaaffd640 1 -- 172.21.15.149:0/2387115659 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1274 (secure 0 0 0) 0x7f8eb0033090 con 0x7f8ea0003530 2024-09-13T17:05:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T17:05:44.066 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":3,"fsid":"043d5bae-71f2-11ef-bceb-c7b262605968","modified":"2024-09-13T17:05:37.720989Z","created":"2024-09-13T17:03:54.878463Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:3300","nonce":0},{"type":"v1","addr":"172.21.15.87:6789","nonce":0}]},"addr":"172.21.15.87:6789/0","public_addr":"172.21.15.87:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:3300","nonce":0},{"type":"v1","addr":"172.21.15.118:6789","nonce":0}]},"addr":"172.21.15.118:6789/0","public_addr":"172.21.15.118:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-13T17:05:44.066 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 3 2024-09-13T17:05:44.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:44.066+0000 7f8ebbe8a640 1 -- 172.21.15.149:0/2387115659 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f8e98038b90 msgr2=0x7f8e9803b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:44.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:44.066+0000 7f8ebbe8a640 1 --2- 172.21.15.149:0/2387115659 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f8e98038b90 0x7f8e9803b050 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4006fd0 tx=0x7f8ea4008040 comp rx=0 tx=0).stop 2024-09-13T17:05:44.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:44.066+0000 7f8ebbe8a640 1 -- 172.21.15.149:0/2387115659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ea0003530 msgr2=0x7f8eb4194180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:44.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:44.066+0000 7f8ebbe8a640 1 --2- 172.21.15.149:0/2387115659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ea0003530 0x7f8eb4194180 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4075a10 tx=0x7f8eb002ebd0 comp rx=0 tx=0).stop 2024-09-13T17:05:44.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:44.066+0000 7f8ebbe8a640 1 -- 172.21.15.149:0/2387115659 shutdown_connections 2024-09-13T17:05:44.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:44.066+0000 7f8ebbe8a640 1 --2- 172.21.15.149:0/2387115659 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f8e98038b90 0x7f8e9803b050 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:44.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:44.066+0000 7f8ebbe8a640 1 --2- 172.21.15.149:0/2387115659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8eb4199000 0x7f8eb41994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:44.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:44.066+0000 7f8ebbe8a640 1 --2- 172.21.15.149:0/2387115659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8eb41946c0 0x7f8eb4198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:44.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:44.066+0000 7f8ebbe8a640 1 --2- 172.21.15.149:0/2387115659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ea0003530 0x7f8eb4194180 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:44.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:44.066+0000 7f8ebbe8a640 1 -- 172.21.15.149:0/2387115659 >> 172.21.15.149:0/2387115659 conn(0x7f8eb4074620 msgr2=0x7f8eb4102ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:44.068 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:44.066+0000 7f8ebbe8a640 1 -- 172.21.15.149:0/2387115659 shutdown_connections 2024-09-13T17:05:44.069 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:44.066+0000 7f8ebbe8a640 1 -- 172.21.15.149:0/2387115659 wait complete. 2024-09-13T17:05:44.228 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:43 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:05:44.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:43 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:44.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:43 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:05:44.733 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-13T17:05:44.734 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-13T17:05:44.996 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:44 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:05:44.996 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:44 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:05:44.996 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:44 smithi118 ceph-mon[34374]: mon.a calling monitor election 2024-09-13T17:05:44.996 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:44 smithi118 ceph-mon[34374]: mon.c calling monitor election 2024-09-13T17:05:44.996 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:44 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:05:44.996 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:44 smithi118 ceph-mon[34374]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:44.997 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:44 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:05:44.997 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:44 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:05:44.997 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:44 smithi118 ceph-mon[34374]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:44.997 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:44 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:05:44.997 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:44 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:05:44.997 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:44 smithi118 ceph-mon[34374]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:44.997 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:44 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:05:44.997 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:44 smithi118 ceph-mon[34374]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T17:05:44.997 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:44 smithi118 ceph-mon[34374]: monmap e3: 3 mons at {a=[v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0],b=[v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0],c=[v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T17:05:44.997 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:44 smithi118 ceph-mon[34374]: fsmap 2024-09-13T17:05:44.997 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:44 smithi118 ceph-mon[34374]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T17:05:44.997 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:44 smithi118 ceph-mon[34374]: mgrmap e13: x(active, since 54s) 2024-09-13T17:05:44.998 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:44 smithi118 ceph-mon[34374]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-09-13T17:05:44.998 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:44 smithi118 ceph-mon[34374]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-13T17:05:44.998 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:44 smithi118 ceph-mon[34374]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-13T17:05:44.998 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:44 smithi118 ceph-mon[34374]: mon.b (rank 2) addr [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] is down (out of quorum) 2024-09-13T17:05:44.998 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:44 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:44.998 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:44 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:44.998 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:44 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:44.998 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:44 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:44.998 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:44 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:05:44.998 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:44 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:44.998 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:44 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:05:45.322 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:05:45.771 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:45 smithi087 ceph-mon[30934]: mon.b calling monitor election 2024-09-13T17:05:45.771 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:45 smithi087 ceph-mon[30934]: Reconfiguring mon.a (unknown last config time)... 2024-09-13T17:05:45.771 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:45 smithi087 ceph-mon[30934]: Reconfiguring daemon mon.a on smithi087 2024-09-13T17:05:45.771 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:45 smithi087 ceph-mon[30934]: mon.b calling monitor election 2024-09-13T17:05:45.771 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:45 smithi087 ceph-mon[30934]: mon.c calling monitor election 2024-09-13T17:05:45.771 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:45 smithi087 ceph-mon[30934]: mon.a calling monitor election 2024-09-13T17:05:45.771 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:45 smithi087 ceph-mon[30934]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-13T17:05:45.772 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:45 smithi087 ceph-mon[30934]: monmap e3: 3 mons at {a=[v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0],b=[v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0],c=[v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T17:05:45.772 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:45 smithi087 ceph-mon[30934]: fsmap 2024-09-13T17:05:45.772 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:45 smithi087 ceph-mon[30934]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T17:05:45.772 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:45 smithi087 ceph-mon[30934]: mgrmap e13: x(active, since 56s) 2024-09-13T17:05:45.772 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:45 smithi087 ceph-mon[30934]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-13T17:05:45.772 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:45 smithi087 ceph-mon[30934]: Cluster is now healthy 2024-09-13T17:05:45.772 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:45 smithi087 ceph-mon[30934]: overall HEALTH_OK 2024-09-13T17:05:45.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:45 smithi149 ceph-mon[35496]: mon.b calling monitor election 2024-09-13T17:05:45.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:45 smithi149 ceph-mon[35496]: Reconfiguring mon.a (unknown last config time)... 2024-09-13T17:05:45.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:45 smithi149 ceph-mon[35496]: Reconfiguring daemon mon.a on smithi087 2024-09-13T17:05:45.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:45 smithi149 ceph-mon[35496]: mon.b calling monitor election 2024-09-13T17:05:45.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:45 smithi149 ceph-mon[35496]: mon.c calling monitor election 2024-09-13T17:05:45.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:45 smithi149 ceph-mon[35496]: mon.a calling monitor election 2024-09-13T17:05:45.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:45 smithi149 ceph-mon[35496]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-13T17:05:45.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:45 smithi149 ceph-mon[35496]: monmap e3: 3 mons at {a=[v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0],b=[v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0],c=[v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T17:05:45.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:45 smithi149 ceph-mon[35496]: fsmap 2024-09-13T17:05:45.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:45 smithi149 ceph-mon[35496]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T17:05:45.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:45 smithi149 ceph-mon[35496]: mgrmap e13: x(active, since 56s) 2024-09-13T17:05:45.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:45 smithi149 ceph-mon[35496]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-13T17:05:45.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:45 smithi149 ceph-mon[35496]: Cluster is now healthy 2024-09-13T17:05:45.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:45 smithi149 ceph-mon[35496]: overall HEALTH_OK 2024-09-13T17:05:45.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:45 smithi118 ceph-mon[34374]: mon.b calling monitor election 2024-09-13T17:05:45.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:45 smithi118 ceph-mon[34374]: Reconfiguring mon.a (unknown last config time)... 2024-09-13T17:05:45.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:45 smithi118 ceph-mon[34374]: Reconfiguring daemon mon.a on smithi087 2024-09-13T17:05:45.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:45 smithi118 ceph-mon[34374]: mon.b calling monitor election 2024-09-13T17:05:45.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:45 smithi118 ceph-mon[34374]: mon.c calling monitor election 2024-09-13T17:05:45.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:45 smithi118 ceph-mon[34374]: mon.a calling monitor election 2024-09-13T17:05:45.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:45 smithi118 ceph-mon[34374]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-13T17:05:45.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:45 smithi118 ceph-mon[34374]: monmap e3: 3 mons at {a=[v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0],b=[v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0],c=[v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T17:05:45.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:45 smithi118 ceph-mon[34374]: fsmap 2024-09-13T17:05:45.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:45 smithi118 ceph-mon[34374]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T17:05:45.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:45 smithi118 ceph-mon[34374]: mgrmap e13: x(active, since 56s) 2024-09-13T17:05:45.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:45 smithi118 ceph-mon[34374]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-13T17:05:45.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:45 smithi118 ceph-mon[34374]: Cluster is now healthy 2024-09-13T17:05:45.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:45 smithi118 ceph-mon[34374]: overall HEALTH_OK 2024-09-13T17:05:46.938 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:46 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:46.938 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:46 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:46.938 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:46 smithi087 ceph-mon[30934]: Reconfiguring mon.b (monmap changed)... 2024-09-13T17:05:46.938 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:46 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T17:05:46.938 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:46 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T17:05:46.938 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:46 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:46.938 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:46 smithi087 ceph-mon[30934]: Reconfiguring daemon mon.b on smithi118 2024-09-13T17:05:46.938 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:46 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:05:46.938 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:46 smithi087 ceph-mon[30934]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:47.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:46 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:47.033 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:46 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:47.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:46 smithi118 ceph-mon[34374]: Reconfiguring mon.b (monmap changed)... 2024-09-13T17:05:47.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:46 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T17:05:47.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:46 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T17:05:47.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:46 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:47.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:46 smithi118 ceph-mon[34374]: Reconfiguring daemon mon.b on smithi118 2024-09-13T17:05:47.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:46 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:05:47.034 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:46 smithi118 ceph-mon[34374]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:47.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:46 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:47.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:46 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:47.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:46 smithi149 ceph-mon[35496]: Reconfiguring mon.b (monmap changed)... 2024-09-13T17:05:47.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:46 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T17:05:47.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:46 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T17:05:47.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:46 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:47.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:46 smithi149 ceph-mon[35496]: Reconfiguring daemon mon.b on smithi118 2024-09-13T17:05:47.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:46 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:05:47.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:46 smithi149 ceph-mon[35496]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:47.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.161+0000 7f7c7fe7a640 1 -- 172.21.15.87:0/241454647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c78105110 msgr2=0x7f7c7810cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:47.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.161+0000 7f7c7fe7a640 1 --2- 172.21.15.87:0/241454647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c78105110 0x7f7c7810cc90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7c70009cd0 tx=0x7f7c7002a8e0 comp rx=0 tx=0).stop 2024-09-13T17:05:47.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.161+0000 7f7c7fe7a640 1 -- 172.21.15.87:0/241454647 shutdown_connections 2024-09-13T17:05:47.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.161+0000 7f7c7fe7a640 1 --2- 172.21.15.87:0/241454647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c78105110 0x7f7c7810cc90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:47.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.161+0000 7f7c7fe7a640 1 --2- 172.21.15.87:0/241454647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c78100990 0x7f7c781049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:47.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.161+0000 7f7c7fe7a640 1 --2- 172.21.15.87:0/241454647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c780fffe0 0x7f7c781003c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:47.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.161+0000 7f7c7fe7a640 1 -- 172.21.15.87:0/241454647 >> 172.21.15.87:0/241454647 conn(0x7f7c780fbae0 msgr2=0x7f7c780fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:47.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.162+0000 7f7c7fe7a640 1 -- 172.21.15.87:0/241454647 shutdown_connections 2024-09-13T17:05:47.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.162+0000 7f7c7fe7a640 1 -- 172.21.15.87:0/241454647 wait complete. 2024-09-13T17:05:47.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.162+0000 7f7c7fe7a640 1 Processor -- start 2024-09-13T17:05:47.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.162+0000 7f7c7fe7a640 1 -- start start 2024-09-13T17:05:47.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.163+0000 7f7c7fe7a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c780fffe0 0x7f7c78196200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:47.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.163+0000 7f7c7fe7a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c78100990 0x7f7c78196740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:47.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.163+0000 7f7c7fe7a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c78105110 0x7f7c7819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:47.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.163+0000 7f7c7fe7a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7819b140 con 0x7f7c78100990 2024-09-13T17:05:47.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.163+0000 7f7c7fe7a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7819b2b0 con 0x7f7c780fffe0 2024-09-13T17:05:47.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.163+0000 7f7c7fe7a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7819b420 con 0x7f7c78105110 2024-09-13T17:05:47.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.163+0000 7f7c7d415640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c78100990 0x7f7c78196740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:47.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.163+0000 7f7c7d415640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c78100990 0x7f7c78196740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37058/0 (socket says 172.21.15.87:37058) 2024-09-13T17:05:47.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.163+0000 7f7c7d415640 1 -- 172.21.15.87:0/3786976837 learned_addr learned my addr 172.21.15.87:0/3786976837 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:05:47.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.163+0000 7f7c7dc16640 1 --2- 172.21.15.87:0/3786976837 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c780fffe0 0x7f7c78196200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:47.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.163+0000 7f7c7e417640 1 --2- 172.21.15.87:0/3786976837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c78105110 0x7f7c7819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:47.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.163+0000 7f7c7d415640 1 -- 172.21.15.87:0/3786976837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c78105110 msgr2=0x7f7c7819ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:47.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.163+0000 7f7c7d415640 1 --2- 172.21.15.87:0/3786976837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c78105110 0x7f7c7819ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:47.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.163+0000 7f7c7d415640 1 -- 172.21.15.87:0/3786976837 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c780fffe0 msgr2=0x7f7c78196200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:47.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.163+0000 7f7c7d415640 1 --2- 172.21.15.87:0/3786976837 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c780fffe0 0x7f7c78196200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:47.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.163+0000 7f7c7d415640 1 -- 172.21.15.87:0/3786976837 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c70009900 con 0x7f7c78100990 2024-09-13T17:05:47.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.163+0000 7f7c7d415640 1 --2- 172.21.15.87:0/3786976837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c78100990 0x7f7c78196740 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c00d950 tx=0x7f7c6c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:47.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.163+0000 7f7c6affd640 1 -- 172.21.15.87:0/3786976837 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c009a30 con 0x7f7c78100990 2024-09-13T17:05:47.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.163+0000 7f7c6affd640 1 -- 172.21.15.87:0/3786976837 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7c6c0044d0 con 0x7f7c78100990 2024-09-13T17:05:47.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.163+0000 7f7c7fe7a640 1 -- 172.21.15.87:0/3786976837 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c7819b700 con 0x7f7c78100990 2024-09-13T17:05:47.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.163+0000 7f7c6affd640 1 -- 172.21.15.87:0/3786976837 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c0047a0 con 0x7f7c78100990 2024-09-13T17:05:47.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.163+0000 7f7c7fe7a640 1 -- 172.21.15.87:0/3786976837 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c781a2fc0 con 0x7f7c78100990 2024-09-13T17:05:47.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.164+0000 7f7c6affd640 1 -- 172.21.15.87:0/3786976837 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f7c6c004900 con 0x7f7c78100990 2024-09-13T17:05:47.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.165+0000 7f7c7fe7a640 1 -- 172.21.15.87:0/3786976837 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c781014c0 con 0x7f7c78100990 2024-09-13T17:05:47.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.165+0000 7f7c6affd640 1 --2- 172.21.15.87:0/3786976837 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f7c64038930 0x7f7c6403adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:47.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.165+0000 7f7c6affd640 1 -- 172.21.15.87:0/3786976837 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f7c6c04acf0 con 0x7f7c78100990 2024-09-13T17:05:47.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.165+0000 7f7c7dc16640 1 --2- 172.21.15.87:0/3786976837 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f7c64038930 0x7f7c6403adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:47.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.165+0000 7f7c7dc16640 1 --2- 172.21.15.87:0/3786976837 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f7c64038930 0x7f7c6403adf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7c7400bbe0 tx=0x7f7c7400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:47.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.169+0000 7f7c6affd640 1 -- 172.21.15.87:0/3786976837 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7c6c00f830 con 0x7f7c78100990 2024-09-13T17:05:47.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.332+0000 7f7c7fe7a640 1 -- 172.21.15.87:0/3786976837 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f7c7810fdb0 con 0x7f7c78100990 2024-09-13T17:05:47.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.332+0000 7f7c6affd640 1 -- 172.21.15.87:0/3786976837 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+275 (secure 0 0 0) 0x7f7c6c00f830 con 0x7f7c78100990 2024-09-13T17:05:47.335 INFO:teuthology.orchestra.run.smithi087.stdout:# minimal ceph.conf for 043d5bae-71f2-11ef-bceb-c7b262605968 2024-09-13T17:05:47.335 INFO:teuthology.orchestra.run.smithi087.stdout:[global] 2024-09-13T17:05:47.335 INFO:teuthology.orchestra.run.smithi087.stdout: fsid = 043d5bae-71f2-11ef-bceb-c7b262605968 2024-09-13T17:05:47.335 INFO:teuthology.orchestra.run.smithi087.stdout: mon_host = [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-13T17:05:47.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.334+0000 7f7c7fe7a640 1 -- 172.21.15.87:0/3786976837 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f7c64038930 msgr2=0x7f7c6403adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:47.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.334+0000 7f7c7fe7a640 1 --2- 172.21.15.87:0/3786976837 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f7c64038930 0x7f7c6403adf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7c7400bbe0 tx=0x7f7c7400b390 comp rx=0 tx=0).stop 2024-09-13T17:05:47.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.334+0000 7f7c7fe7a640 1 -- 172.21.15.87:0/3786976837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c78100990 msgr2=0x7f7c78196740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:47.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.334+0000 7f7c7fe7a640 1 --2- 172.21.15.87:0/3786976837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c78100990 0x7f7c78196740 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c00d950 tx=0x7f7c6c00de10 comp rx=0 tx=0).stop 2024-09-13T17:05:47.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.334+0000 7f7c7fe7a640 1 -- 172.21.15.87:0/3786976837 shutdown_connections 2024-09-13T17:05:47.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.334+0000 7f7c7fe7a640 1 --2- 172.21.15.87:0/3786976837 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f7c64038930 0x7f7c6403adf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:47.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.334+0000 7f7c7fe7a640 1 --2- 172.21.15.87:0/3786976837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c78105110 0x7f7c7819ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:47.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.334+0000 7f7c7fe7a640 1 --2- 172.21.15.87:0/3786976837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c78100990 0x7f7c78196740 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:47.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.334+0000 7f7c7fe7a640 1 --2- 172.21.15.87:0/3786976837 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c780fffe0 0x7f7c78196200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:47.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.334+0000 7f7c7fe7a640 1 -- 172.21.15.87:0/3786976837 >> 172.21.15.87:0/3786976837 conn(0x7f7c780fbae0 msgr2=0x7f7c780fcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:47.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.335+0000 7f7c7fe7a640 1 -- 172.21.15.87:0/3786976837 shutdown_connections 2024-09-13T17:05:47.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:47.335+0000 7f7c7fe7a640 1 -- 172.21.15.87:0/3786976837 wait complete. 2024-09-13T17:05:47.951 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-13T17:05:47.951 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T17:05:47.951 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T17:05:47.978 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T17:05:47.978 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:05:48.044 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-13T17:05:48.044 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T17:05:48.078 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-13T17:05:48.078 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:05:48.149 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-13T17:05:48.149 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T17:05:48.181 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-13T17:05:48.181 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:05:48.228 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:47 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:48.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:47 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:48.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:47 smithi087 ceph-mon[30934]: Reconfiguring mon.c (monmap changed)... 2024-09-13T17:05:48.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:47 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T17:05:48.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:47 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T17:05:48.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:47 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:48.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:47 smithi087 ceph-mon[30934]: Reconfiguring daemon mon.c on smithi149 2024-09-13T17:05:48.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:47 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3786976837' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:48.244 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:47 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:48.245 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:47 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:48.245 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:47 smithi149 ceph-mon[35496]: Reconfiguring mon.c (monmap changed)... 2024-09-13T17:05:48.245 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:47 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T17:05:48.245 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:47 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T17:05:48.245 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:47 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:48.245 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:47 smithi149 ceph-mon[35496]: Reconfiguring daemon mon.c on smithi149 2024-09-13T17:05:48.245 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:47 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3786976837' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:48.248 INFO:tasks.cephadm:Adding mgr.x on smithi087 2024-09-13T17:05:48.248 INFO:tasks.cephadm:Adding mgr.y on smithi118 2024-09-13T17:05:48.249 INFO:tasks.cephadm:Adding mgr.z on smithi149 2024-09-13T17:05:48.249 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi087=x;smithi118=y;smithi149=z' 2024-09-13T17:05:48.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:47 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:48.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:47 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:48.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:47 smithi118 ceph-mon[34374]: Reconfiguring mon.c (monmap changed)... 2024-09-13T17:05:48.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:47 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T17:05:48.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:47 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T17:05:48.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:47 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:48.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:47 smithi118 ceph-mon[34374]: Reconfiguring daemon mon.c on smithi149 2024-09-13T17:05:48.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:47 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3786976837' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:48.480 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T17:05:49.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:49 smithi087 ceph-mon[30934]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:49.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:49.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:49.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:05:49.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:49.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:05:49.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:49.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:49 smithi149 ceph-mon[35496]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:49.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:49.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:49.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:05:49.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:49.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:05:49.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:49.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:49 smithi118 ceph-mon[34374]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:49.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:49.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:49.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:05:49.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:49.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:05:49.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:50.025 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.022+0000 7f50b1f08640 1 -- 172.21.15.149:0/1987699075 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50ac0fed00 msgr2=0x7f50ac0ff100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:50.026 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.022+0000 7f50b1f08640 1 --2- 172.21.15.149:0/1987699075 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50ac0fed00 0x7f50ac0ff100 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f509c009900 tx=0x7f509c02a410 comp rx=0 tx=0).stop 2024-09-13T17:05:50.026 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.022+0000 7f50b1f08640 1 -- 172.21.15.149:0/1987699075 shutdown_connections 2024-09-13T17:05:50.026 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.022+0000 7f50b1f08640 1 --2- 172.21.15.149:0/1987699075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50ac1008c0 0x7f50ac107150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:50.026 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.022+0000 7f50b1f08640 1 --2- 172.21.15.149:0/1987699075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50ac0fff00 0x7f50ac100380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:50.026 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.022+0000 7f50b1f08640 1 --2- 172.21.15.149:0/1987699075 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50ac0fed00 0x7f50ac0ff100 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:50.026 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.022+0000 7f50b1f08640 1 -- 172.21.15.149:0/1987699075 >> 172.21.15.149:0/1987699075 conn(0x7f50ac0fa490 msgr2=0x7f50ac0fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:50.026 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.022+0000 7f50b1f08640 1 -- 172.21.15.149:0/1987699075 shutdown_connections 2024-09-13T17:05:50.026 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.022+0000 7f50b1f08640 1 -- 172.21.15.149:0/1987699075 wait complete. 2024-09-13T17:05:50.026 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.022+0000 7f50b1f08640 1 Processor -- start 2024-09-13T17:05:50.026 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.022+0000 7f50b1f08640 1 -- start start 2024-09-13T17:05:50.026 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.023+0000 7f50b1f08640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50ac0fed00 0x7f50ac102c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:50.026 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.023+0000 7f50b1f08640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50ac0fff00 0x7f50ac1012e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:50.027 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.023+0000 7f50b1f08640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50ac1008c0 0x7f50ac101820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:50.027 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.023+0000 7f50b1f08640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ac101f20 con 0x7f50ac0fed00 2024-09-13T17:05:50.027 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.023+0000 7f50b1f08640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ac102090 con 0x7f50ac0fff00 2024-09-13T17:05:50.027 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.023+0000 7f50b1f08640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ac19fee0 con 0x7f50ac1008c0 2024-09-13T17:05:50.027 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.023+0000 7f50abfff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50ac1008c0 0x7f50ac101820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:50.027 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.023+0000 7f50abfff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50ac1008c0 0x7f50ac101820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:51148/0 (socket says 172.21.15.149:51148) 2024-09-13T17:05:50.027 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.023+0000 7f50abfff640 1 -- 172.21.15.149:0/3705114860 learned_addr learned my addr 172.21.15.149:0/3705114860 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-13T17:05:50.027 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.023+0000 7f50ab7fe640 1 --2- 172.21.15.149:0/3705114860 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50ac0fed00 0x7f50ac102c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:50.027 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.023+0000 7f50abfff640 1 -- 172.21.15.149:0/3705114860 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50ac0fff00 msgr2=0x7f50ac1012e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T17:05:50.027 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.023+0000 7f50abfff640 1 --2- 172.21.15.149:0/3705114860 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50ac0fff00 0x7f50ac1012e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:50.027 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.023+0000 7f50abfff640 1 -- 172.21.15.149:0/3705114860 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50ac0fed00 msgr2=0x7f50ac102c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:50.027 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.023+0000 7f50abfff640 1 --2- 172.21.15.149:0/3705114860 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50ac0fed00 0x7f50ac102c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:50.027 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.023+0000 7f50abfff640 1 -- 172.21.15.149:0/3705114860 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509c009560 con 0x7f50ac1008c0 2024-09-13T17:05:50.028 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.023+0000 7f50ab7fe640 1 --2- 172.21.15.149:0/3705114860 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50ac0fed00 0x7f50ac102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:05:50.028 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.023+0000 7f50abfff640 1 --2- 172.21.15.149:0/3705114860 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50ac1008c0 0x7f50ac101820 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f50a4009fd0 tx=0x7f50a400b260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:50.028 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.023+0000 7f50a8ff9640 1 -- 172.21.15.149:0/3705114860 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a400bea0 con 0x7f50ac1008c0 2024-09-13T17:05:50.028 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.023+0000 7f50b1f08640 1 -- 172.21.15.149:0/3705114860 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50ac1a0140 con 0x7f50ac1008c0 2024-09-13T17:05:50.028 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.023+0000 7f50a8ff9640 1 -- 172.21.15.149:0/3705114860 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f50a4009940 con 0x7f50ac1008c0 2024-09-13T17:05:50.028 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.024+0000 7f50a8ff9640 1 -- 172.21.15.149:0/3705114860 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a40106c0 con 0x7f50ac1008c0 2024-09-13T17:05:50.028 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.024+0000 7f50b1f08640 1 -- 172.21.15.149:0/3705114860 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50ac1a05f0 con 0x7f50ac1008c0 2024-09-13T17:05:50.029 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.024+0000 7f50a8ff9640 1 -- 172.21.15.149:0/3705114860 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f50a4010820 con 0x7f50ac1008c0 2024-09-13T17:05:50.029 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.025+0000 7f50a8ff9640 1 --2- 172.21.15.149:0/3705114860 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f5094038930 0x7f509403adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:50.029 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.025+0000 7f50a8ff9640 1 -- 172.21.15.149:0/3705114860 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f50a4003de0 con 0x7f50ac1008c0 2024-09-13T17:05:50.029 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.025+0000 7f50b1f08640 1 -- 172.21.15.149:0/3705114860 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50ac10a5f0 con 0x7f50ac1008c0 2024-09-13T17:05:50.029 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.025+0000 7f50ab7fe640 1 --2- 172.21.15.149:0/3705114860 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f5094038930 0x7f509403adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:50.029 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.025+0000 7f50ab7fe640 1 --2- 172.21.15.149:0/3705114860 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f5094038930 0x7f509403adf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f509c0057c0 tx=0x7f509c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:50.031 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.030+0000 7f50a8ff9640 1 -- 172.21.15.149:0/3705114860 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f50a40228f0 con 0x7f50ac1008c0 2024-09-13T17:05:50.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.205+0000 7f50b1f08640 1 -- 172.21.15.149:0/3705114860 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi087=x;smithi118=y;smithi149=z", "target": ["mon-mgr", ""]}) v1 -- 0x7f50ac068f20 con 0x7f5094038930 2024-09-13T17:05:50.212 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.210+0000 7f50a8ff9640 1 -- 172.21.15.149:0/3705114860 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f50ac068f20 con 0x7f5094038930 2024-09-13T17:05:50.212 INFO:teuthology.orchestra.run.smithi149.stdout:Scheduled mgr update... 2024-09-13T17:05:50.214 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.212+0000 7f50b1f08640 1 -- 172.21.15.149:0/3705114860 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f5094038930 msgr2=0x7f509403adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:50.214 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.212+0000 7f50b1f08640 1 --2- 172.21.15.149:0/3705114860 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f5094038930 0x7f509403adf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f509c0057c0 tx=0x7f509c031400 comp rx=0 tx=0).stop 2024-09-13T17:05:50.214 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.212+0000 7f50b1f08640 1 -- 172.21.15.149:0/3705114860 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50ac1008c0 msgr2=0x7f50ac101820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:50.214 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.212+0000 7f50b1f08640 1 --2- 172.21.15.149:0/3705114860 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50ac1008c0 0x7f50ac101820 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f50a4009fd0 tx=0x7f50a400b260 comp rx=0 tx=0).stop 2024-09-13T17:05:50.214 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.212+0000 7f50b1f08640 1 -- 172.21.15.149:0/3705114860 shutdown_connections 2024-09-13T17:05:50.214 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.212+0000 7f50b1f08640 1 --2- 172.21.15.149:0/3705114860 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f5094038930 0x7f509403adf0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:50.214 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.212+0000 7f50b1f08640 1 --2- 172.21.15.149:0/3705114860 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50ac1008c0 0x7f50ac101820 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:50.215 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.212+0000 7f50b1f08640 1 --2- 172.21.15.149:0/3705114860 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50ac0fff00 0x7f50ac1012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:50.215 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.212+0000 7f50b1f08640 1 --2- 172.21.15.149:0/3705114860 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50ac0fed00 0x7f50ac102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:50.215 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.212+0000 7f50b1f08640 1 -- 172.21.15.149:0/3705114860 >> 172.21.15.149:0/3705114860 conn(0x7f50ac0fa490 msgr2=0x7f50ac068810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:50.215 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.212+0000 7f50b1f08640 1 -- 172.21.15.149:0/3705114860 shutdown_connections 2024-09-13T17:05:50.215 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:05:50.212+0000 7f50b1f08640 1 -- 172.21.15.149:0/3705114860 wait complete. 2024-09-13T17:05:50.825 DEBUG:teuthology.orchestra.run.smithi118:mgr.y> sudo journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mgr.y.service 2024-09-13T17:05:50.828 DEBUG:teuthology.orchestra.run.smithi149:mgr.z> sudo journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mgr.z.service 2024-09-13T17:05:50.830 INFO:tasks.cephadm:Deploying OSDs... 2024-09-13T17:05:50.831 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T17:05:50.831 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T17:05:50.847 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T17:05:50.847 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_1 2024-09-13T17:05:50.903 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T17:05:50.903 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:05:50.904 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-13T17:05:50.904 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:05:50.904 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T17:05:50.904 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-09-13 17:05:00.534687829 +0000 2024-09-13T17:05:50.904 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-09-13 17:00:43.838308415 +0000 2024-09-13T17:05:50.904 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-09-13 17:00:43.838308415 +0000 2024-09-13T17:05:50.904 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-09-13 17:00:43.838308415 +0000 2024-09-13T17:05:50.904 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T17:05:50.968 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-09-13T17:05:50.968 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-09-13T17:05:50.968 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000215917 s, 2.4 MB/s 2024-09-13T17:05:50.969 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T17:05:51.027 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_2 2024-09-13T17:05:51.082 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T17:05:51.082 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:05:51.082 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-13T17:05:51.082 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:05:51.082 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T17:05:51.082 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-09-13 17:05:00.567687047 +0000 2024-09-13T17:05:51.082 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-09-13 17:00:44.159300859 +0000 2024-09-13T17:05:51.082 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-09-13 17:00:44.159300859 +0000 2024-09-13T17:05:51.082 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-09-13 17:00:44.159300859 +0000 2024-09-13T17:05:51.083 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T17:05:51.144 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-09-13T17:05:51.144 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-09-13T17:05:51.144 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000193915 s, 2.6 MB/s 2024-09-13T17:05:51.145 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T17:05:51.202 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_3 2024-09-13T17:05:51.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:51 smithi087 ceph-mon[30934]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:51.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:51 smithi087 ceph-mon[30934]: from='client.24112 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi087=x;smithi118=y;smithi149=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:05:51.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:51 smithi087 ceph-mon[30934]: Saving service mgr spec with placement smithi087=x;smithi118=y;smithi149=z;count:3 2024-09-13T17:05:51.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:51 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:51.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:51 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:05:51.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:51 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:51.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:51 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:05:51.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:51 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:51.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:51 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T17:05:51.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:51 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T17:05:51.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:51 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T17:05:51.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:51 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:51.244 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T17:05:51.244 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:05:51.244 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-13T17:05:51.244 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:05:51.244 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T17:05:51.245 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-09-13 17:05:00.600686265 +0000 2024-09-13T17:05:51.245 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-09-13 17:00:44.487293139 +0000 2024-09-13T17:05:51.245 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-09-13 17:00:44.487293139 +0000 2024-09-13T17:05:51.245 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-09-13 17:00:44.487293139 +0000 2024-09-13T17:05:51.245 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T17:05:51.308 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-09-13T17:05:51.308 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-09-13T17:05:51.308 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000196445 s, 2.6 MB/s 2024-09-13T17:05:51.309 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T17:05:51.366 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_4 2024-09-13T17:05:51.421 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T17:05:51.421 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:05:51.421 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-13T17:05:51.421 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:05:51.421 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T17:05:51.421 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-09-13 17:05:00.634685459 +0000 2024-09-13T17:05:51.421 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-09-13 17:00:44.819285324 +0000 2024-09-13T17:05:51.421 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-09-13 17:00:44.819285324 +0000 2024-09-13T17:05:51.421 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-09-13 17:00:44.819285324 +0000 2024-09-13T17:05:51.422 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T17:05:51.484 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-09-13T17:05:51.484 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-09-13T17:05:51.484 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.00019779 s, 2.6 MB/s 2024-09-13T17:05:51.485 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T17:05:51.542 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-09-13T17:05:51.542 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T17:05:51.561 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T17:05:51.561 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_1 2024-09-13T17:05:51.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:51 smithi149 ceph-mon[35496]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:51.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:51 smithi149 ceph-mon[35496]: from='client.24112 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi087=x;smithi118=y;smithi149=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:05:51.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:51 smithi149 ceph-mon[35496]: Saving service mgr spec with placement smithi087=x;smithi118=y;smithi149=z;count:3 2024-09-13T17:05:51.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:51 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:51.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:51 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:05:51.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:51 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:51.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:51 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:05:51.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:51 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:51.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:51 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T17:05:51.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:51 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T17:05:51.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:51 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T17:05:51.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:51 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:51.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:51 smithi118 ceph-mon[34374]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:51.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:51 smithi118 ceph-mon[34374]: from='client.24112 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi087=x;smithi118=y;smithi149=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:05:51.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:51 smithi118 ceph-mon[34374]: Saving service mgr spec with placement smithi087=x;smithi118=y;smithi149=z;count:3 2024-09-13T17:05:51.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:51 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:51.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:51 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:05:51.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:51 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:51.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:51 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:05:51.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:51 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:51.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:51 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T17:05:51.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:51 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T17:05:51.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:51 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T17:05:51.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:51 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:51.621 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T17:05:51.621 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:05:51.622 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-13T17:05:51.622 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:05:51.622 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T17:05:51.622 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-09-13 17:05:37.152313737 +0000 2024-09-13T17:05:51.622 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-09-13 17:00:44.198959689 +0000 2024-09-13T17:05:51.622 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-09-13 17:00:44.198959689 +0000 2024-09-13T17:05:51.622 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-09-13 17:00:44.198959689 +0000 2024-09-13T17:05:51.622 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T17:05:51.689 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-09-13T17:05:51.689 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-09-13T17:05:51.689 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000102362 s, 5.0 MB/s 2024-09-13T17:05:51.690 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T17:05:51.747 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_2 2024-09-13T17:05:51.804 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T17:05:51.805 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:05:51.805 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-13T17:05:51.805 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:05:51.805 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T17:05:51.805 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-09-13 17:05:37.153313714 +0000 2024-09-13T17:05:51.805 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-09-13 17:00:44.526952060 +0000 2024-09-13T17:05:51.805 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-09-13 17:00:44.526952060 +0000 2024-09-13T17:05:51.805 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-09-13 17:00:44.526952060 +0000 2024-09-13T17:05:51.805 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T17:05:51.870 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-09-13T17:05:51.870 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-09-13T17:05:51.870 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 9.9109e-05 s, 5.2 MB/s 2024-09-13T17:05:51.871 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T17:05:51.929 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_3 2024-09-13T17:05:51.985 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T17:05:51.985 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:05:51.986 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-13T17:05:51.986 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:05:51.986 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T17:05:51.986 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-09-13 17:05:37.153313714 +0000 2024-09-13T17:05:51.986 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-09-13 17:00:44.844944663 +0000 2024-09-13T17:05:51.986 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-09-13 17:00:44.844944663 +0000 2024-09-13T17:05:51.986 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-09-13 17:00:44.844944663 +0000 2024-09-13T17:05:51.986 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T17:05:52.051 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-09-13T17:05:52.051 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-09-13T17:05:52.051 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000115222 s, 4.4 MB/s 2024-09-13T17:05:52.053 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T17:05:52.110 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_4 2024-09-13T17:05:52.167 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T17:05:52.167 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:05:52.167 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-13T17:05:52.168 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:05:52.168 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T17:05:52.168 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-09-13 17:05:37.153313714 +0000 2024-09-13T17:05:52.168 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-09-13 17:00:45.163937243 +0000 2024-09-13T17:05:52.168 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-09-13 17:00:45.163937243 +0000 2024-09-13T17:05:52.168 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-09-13 17:00:45.163937243 +0000 2024-09-13T17:05:52.168 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T17:05:52.232 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-09-13T17:05:52.232 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-09-13T17:05:52.232 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000111963 s, 4.6 MB/s 2024-09-13T17:05:52.233 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T17:05:52.291 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-13T17:05:52.291 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T17:05:52.308 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T17:05:52.308 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_1 2024-09-13T17:05:52.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:52 smithi149 ceph-mon[35496]: Deploying daemon mgr.z on smithi149 2024-09-13T17:05:52.357 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T17:05:52.357 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:05:52.357 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 800 Links: 1 2024-09-13T17:05:52.357 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:05:52.357 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T17:05:52.357 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-09-13 17:05:52.276562340 +0000 2024-09-13T17:05:52.357 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-09-13 17:00:52.991727320 +0000 2024-09-13T17:05:52.357 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-09-13 17:00:52.991727320 +0000 2024-09-13T17:05:52.358 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-09-13 17:00:52.991727320 +0000 2024-09-13T17:05:52.358 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T17:05:52.362 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:52 smithi118 ceph-mon[34374]: Deploying daemon mgr.z on smithi149 2024-09-13T17:05:52.425 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-09-13T17:05:52.425 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-09-13T17:05:52.425 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000232401 s, 2.2 MB/s 2024-09-13T17:05:52.427 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T17:05:52.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:52 smithi087 ceph-mon[30934]: Deploying daemon mgr.z on smithi149 2024-09-13T17:05:52.484 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_2 2024-09-13T17:05:52.540 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T17:05:52.540 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:05:52.540 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 821 Links: 1 2024-09-13T17:05:52.540 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:05:52.540 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T17:05:52.540 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-09-13 17:05:52.276562340 +0000 2024-09-13T17:05:52.540 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-09-13 17:00:53.303721674 +0000 2024-09-13T17:05:52.540 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-09-13 17:00:53.303721674 +0000 2024-09-13T17:05:52.540 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-09-13 17:00:53.303721674 +0000 2024-09-13T17:05:52.541 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T17:05:52.601 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:05:52 smithi149 podman[37311]: 2024-09-13 17:05:52.585958264 +0000 UTC m=+0.135648877 container create 5de72e2b7f589d5c5b6ea2f70002a8bf0cf9b71b1464f92c89b6defc5690378f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-13T17:05:52.604 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-09-13T17:05:52.604 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-09-13T17:05:52.604 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000217316 s, 2.4 MB/s 2024-09-13T17:05:52.605 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T17:05:52.662 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_3 2024-09-13T17:05:52.718 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T17:05:52.719 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:05:52.719 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 838 Links: 1 2024-09-13T17:05:52.719 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:05:52.719 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T17:05:52.719 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-09-13 17:05:52.276562340 +0000 2024-09-13T17:05:52.719 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-09-13 17:00:53.631715737 +0000 2024-09-13T17:05:52.719 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-09-13 17:00:53.631715737 +0000 2024-09-13T17:05:52.719 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-09-13 17:00:53.631715737 +0000 2024-09-13T17:05:52.719 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T17:05:52.791 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-09-13T17:05:52.791 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-09-13T17:05:52.791 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000190901 s, 2.7 MB/s 2024-09-13T17:05:52.792 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T17:05:52.849 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_4 2024-09-13T17:05:52.881 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:05:52 smithi149 podman[37311]: 2024-09-13 17:05:52.80541601 +0000 UTC m=+0.355106616 container init 5de72e2b7f589d5c5b6ea2f70002a8bf0cf9b71b1464f92c89b6defc5690378f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:05:52.881 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:05:52 smithi149 podman[37311]: 2024-09-13 17:05:52.808247923 +0000 UTC m=+0.357938532 container start 5de72e2b7f589d5c5b6ea2f70002a8bf0cf9b71b1464f92c89b6defc5690378f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:05:52.881 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:05:52 smithi149 ceph-mgr[37436]: -- 172.21.15.149:0/1723768727 <== mon.1 v2:172.21.15.149:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556ad717cd00 con 0x556ad7151400 2024-09-13T17:05:52.897 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T17:05:52.897 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:05:52.897 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 859 Links: 1 2024-09-13T17:05:52.897 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:05:52.897 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T17:05:52.898 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-09-13 17:05:52.277562322 +0000 2024-09-13T17:05:52.898 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-09-13 17:00:53.947710019 +0000 2024-09-13T17:05:52.898 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-09-13 17:00:53.947710019 +0000 2024-09-13T17:05:52.898 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-09-13 17:00:53.947710019 +0000 2024-09-13T17:05:52.898 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T17:05:52.963 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-09-13T17:05:52.964 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-09-13T17:05:52.964 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.00024881 s, 2.1 MB/s 2024-09-13T17:05:52.965 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T17:05:53.022 INFO:tasks.cephadm:Deploying osd.0 on smithi087 with /dev/vg_nvme/lv_4... 2024-09-13T17:05:53.022 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-09-13T17:05:53.151 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:05:52 smithi149 bash[37311]: 5de72e2b7f589d5c5b6ea2f70002a8bf0cf9b71b1464f92c89b6defc5690378f 2024-09-13T17:05:53.151 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:05:52 smithi149 systemd[1]: Started Ceph mgr.z for 043d5bae-71f2-11ef-bceb-c7b262605968. 2024-09-13T17:05:53.151 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:05:52 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:05:52.935+0000 7fc905c94040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T17:05:53.151 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:05:52 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:05:52.996+0000 7fc905c94040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T17:05:53.151 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:05:53 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:05:53.149+0000 7fc905c94040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T17:05:53.229 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:05:53.349 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:53 smithi087 ceph-mon[30934]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:53.350 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:53 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:53.350 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:53 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:53.350 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:53 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:53.350 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:53 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T17:05:53.350 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:53 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T17:05:53.350 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:53 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T17:05:53.350 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:53 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:53.502 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:05:53 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:05:53.215+0000 7fc905c94040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T17:05:53.503 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:05:53 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:05:53.362+0000 7fc905c94040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:05:53.503 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:05:53 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:05:53.500+0000 7fc905c94040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T17:05:53.503 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:53 smithi149 ceph-mon[35496]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:53.503 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:53 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:53.503 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:53 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:53.503 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:53 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:53.503 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:53 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T17:05:53.503 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:53 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T17:05:53.504 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:53 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T17:05:53.504 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:53 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:53.536 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:53 smithi118 ceph-mon[34374]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:53.536 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:53 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:53.536 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:53 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:53.536 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:53 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:53.536 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:53 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T17:05:53.537 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:53 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T17:05:53.537 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:53 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T17:05:53.537 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:53 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:54.092 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:05:53 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:05:53.809+0000 7fc905c94040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T17:05:54.092 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:05:53 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:05:53.869+0000 7fc905c94040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T17:05:54.092 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:05:54 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:05:54.051+0000 7fc905c94040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T17:05:54.375 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:54 smithi087 ceph-mon[30934]: Deploying daemon mgr.y on smithi118 2024-09-13T17:05:54.478 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:54 smithi118 ceph-mon[34374]: Deploying daemon mgr.y on smithi118 2024-09-13T17:05:54.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:54 smithi149 ceph-mon[35496]: Deploying daemon mgr.y on smithi118 2024-09-13T17:05:54.723 INFO:teuthology.orchestra.run.smithi087.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-09-13T17:05:54.804 INFO:teuthology.orchestra.run.smithi087.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-09-13T17:05:54.821 INFO:teuthology.orchestra.run.smithi087.stderr: stderr: 10+0 records in 2024-09-13T17:05:54.821 INFO:teuthology.orchestra.run.smithi087.stderr:10+0 records out 2024-09-13T17:05:54.821 INFO:teuthology.orchestra.run.smithi087.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0150117 s, 699 MB/s 2024-09-13T17:05:54.821 INFO:teuthology.orchestra.run.smithi087.stderr:--> Zapping successful for: 2024-09-13T17:05:54.853 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:05:54 smithi118 systemd[1]: Starting Ceph mgr.y for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:05:55.113 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:05:54 smithi118 podman[35756]: 2024-09-13 17:05:54.852883678 +0000 UTC m=+0.106659113 container create fd5d227353d9c915ca4ad60b9a466defe0d46559fbb26c86c6bc8f6faaa0c7c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T17:05:55.113 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:05:54 smithi118 podman[35756]: 2024-09-13 17:05:54.762535564 +0000 UTC m=+0.016311006 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:05:55.113 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:05:55 smithi118 podman[35756]: 2024-09-13 17:05:55.055328148 +0000 UTC m=+0.309103582 container init fd5d227353d9c915ca4ad60b9a466defe0d46559fbb26c86c6bc8f6faaa0c7c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-13T17:05:55.113 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:05:55 smithi118 podman[35756]: 2024-09-13 17:05:55.058064578 +0000 UTC m=+0.311840012 container start fd5d227353d9c915ca4ad60b9a466defe0d46559fbb26c86c6bc8f6faaa0c7c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-13T17:05:55.113 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:05:55 smithi118 ceph-mgr[35775]: -- 172.21.15.118:0/607912385 <== mon.2 v2:172.21.15.118:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c4674a6d00 con 0x55c46747a800 2024-09-13T17:05:55.226 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:05:54 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:05:54.925+0000 7fc905c94040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T17:05:55.227 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:05:54 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:05:54.989+0000 7fc905c94040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T17:05:55.370 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:55 smithi087 ceph-mon[30934]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:55.371 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi087:vg_nvme/lv_4 2024-09-13T17:05:55.472 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:55 smithi118 ceph-mon[34374]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:55.472 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:05:55 smithi118 bash[35756]: fd5d227353d9c915ca4ad60b9a466defe0d46559fbb26c86c6bc8f6faaa0c7c6 2024-09-13T17:05:55.472 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:05:55 smithi118 systemd[1]: Started Ceph mgr.y for 043d5bae-71f2-11ef-bceb-c7b262605968. 2024-09-13T17:05:55.472 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:05:55 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:05:55.178+0000 7f0799b32040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T17:05:55.472 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:05:55 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:05:55.245+0000 7f0799b32040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T17:05:55.472 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:05:55 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:05:55.401+0000 7f0799b32040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T17:05:55.472 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:05:55 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:05:55.469+0000 7f0799b32040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T17:05:55.560 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:05:55.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:55 smithi149 ceph-mon[35496]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:55.780 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:05:55 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:05:55.630+0000 7f0799b32040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:05:55.780 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:05:55 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:05:55.778+0000 7f0799b32040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T17:05:56.022 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:05:55 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:05:55.757+0000 7fc905c94040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T17:05:56.022 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:05:55 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:05:55.871+0000 7fc905c94040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T17:05:56.023 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:05:56 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:05:56.021+0000 7fc905c94040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:05:56.304 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:56 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:56.304 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:56 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:56.304 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:56 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:56.304 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:56 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:56.305 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:56 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:05:56.305 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:05:56 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:05:56.083+0000 7fc905c94040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T17:05:56.305 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:05:56 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:05:56.233+0000 7fc905c94040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T17:05:56.305 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:05:56 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:05:56.303+0000 7fc905c94040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T17:05:56.350 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:05:56 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:05:56.098+0000 7f0799b32040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T17:05:56.350 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:05:56 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:05:56.159+0000 7f0799b32040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T17:05:56.351 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:56 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:56.351 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:56 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:56.351 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:56 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:56.351 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:56 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:56.351 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:56 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:05:56.539 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:56 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:56.539 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:56 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:56.539 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:56 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:56.539 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:56 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:56.540 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:56 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:05:56.592 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:05:56 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:05:56.366+0000 7fc905c94040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T17:05:56.592 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:05:56 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:05:56.529+0000 7fc905c94040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T17:05:56.612 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:05:56 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:05:56.348+0000 7f0799b32040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T17:05:56.859 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:05:56 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:05:56.595+0000 7fc905c94040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T17:05:56.860 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:05:56 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:05:56.660+0000 7fc905c94040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T17:05:56.860 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:05:56 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:05:56.741+0000 7fc905c94040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T17:05:56.860 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:05:56 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:05:56.800+0000 7fc905c94040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T17:05:56.860 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:05:56 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:05:56.858+0000 7fc905c94040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T17:05:57.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.041+0000 7f3862861640 1 -- 172.21.15.87:0/99245389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f385c100f60 msgr2=0x7f385c1013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:57.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.041+0000 7f3862861640 1 --2- 172.21.15.87:0/99245389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f385c100f60 0x7f385c1013e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3844009900 tx=0x7f384402a410 comp rx=0 tx=0).stop 2024-09-13T17:05:57.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.041+0000 7f3862861640 1 -- 172.21.15.87:0/99245389 shutdown_connections 2024-09-13T17:05:57.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.041+0000 7f3862861640 1 --2- 172.21.15.87:0/99245389 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f385c101920 0x7f385c108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:57.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.041+0000 7f3862861640 1 --2- 172.21.15.87:0/99245389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f385c100f60 0x7f385c1013e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:57.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.041+0000 7f3862861640 1 --2- 172.21.15.87:0/99245389 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f385c0ffe00 0x7f385c100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:57.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.041+0000 7f3862861640 1 -- 172.21.15.87:0/99245389 >> 172.21.15.87:0/99245389 conn(0x7f385c0fb5d0 msgr2=0x7f385c0fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:05:57.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.041+0000 7f3862861640 1 -- 172.21.15.87:0/99245389 shutdown_connections 2024-09-13T17:05:57.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.041+0000 7f3862861640 1 -- 172.21.15.87:0/99245389 wait complete. 2024-09-13T17:05:57.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.041+0000 7f3862861640 1 Processor -- start 2024-09-13T17:05:57.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.041+0000 7f3862861640 1 -- start start 2024-09-13T17:05:57.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.042+0000 7f3862861640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f385c0ffe00 0x7f385c074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:57.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.042+0000 7f3862861640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f385c100f60 0x7f385c0728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:57.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.042+0000 7f3862861640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f385c101920 0x7f385c072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:57.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.042+0000 7f3862861640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385c073570 con 0x7f385c100f60 2024-09-13T17:05:57.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.042+0000 7f3862861640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385c0736e0 con 0x7f385c0ffe00 2024-09-13T17:05:57.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.042+0000 7f3862861640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385c19fdf0 con 0x7f385c101920 2024-09-13T17:05:57.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.042+0000 7f3853fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f385c100f60 0x7f385c0728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:57.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.042+0000 7f385bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f385c0ffe00 0x7f385c074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:57.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.042+0000 7f385bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f385c0ffe00 0x7f385c074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.87:44256/0 (socket says 172.21.15.87:44256) 2024-09-13T17:05:57.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.042+0000 7f385bfff640 1 -- 172.21.15.87:0/3431860283 learned_addr learned my addr 172.21.15.87:0/3431860283 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:05:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.042+0000 7f3853fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f385c100f60 0x7f385c0728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50310/0 (socket says 172.21.15.87:50310) 2024-09-13T17:05:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.042+0000 7f3860dfe640 1 --2- 172.21.15.87:0/3431860283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f385c101920 0x7f385c072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.042+0000 7f3853fff640 1 -- 172.21.15.87:0/3431860283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f385c101920 msgr2=0x7f385c072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.042+0000 7f3853fff640 1 --2- 172.21.15.87:0/3431860283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f385c101920 0x7f385c072de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.042+0000 7f3853fff640 1 -- 172.21.15.87:0/3431860283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f385c0ffe00 msgr2=0x7f385c074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:05:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.042+0000 7f3853fff640 1 --2- 172.21.15.87:0/3431860283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f385c0ffe00 0x7f385c074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:05:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.042+0000 7f3853fff640 1 -- 172.21.15.87:0/3431860283 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3844009560 con 0x7f385c100f60 2024-09-13T17:05:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.042+0000 7f385bfff640 1 --2- 172.21.15.87:0/3431860283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f385c0ffe00 0x7f385c074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:05:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.042+0000 7f3853fff640 1 --2- 172.21.15.87:0/3431860283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f385c100f60 0x7f385c0728a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3844009230 tx=0x7f3844004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.042+0000 7f3859ffb640 1 -- 172.21.15.87:0/3431860283 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38440035f0 con 0x7f385c100f60 2024-09-13T17:05:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.042+0000 7f3862861640 1 -- 172.21.15.87:0/3431860283 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f385c1a0040 con 0x7f385c100f60 2024-09-13T17:05:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.042+0000 7f3859ffb640 1 -- 172.21.15.87:0/3431860283 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3844003c00 con 0x7f385c100f60 2024-09-13T17:05:57.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.042+0000 7f3859ffb640 1 -- 172.21.15.87:0/3431860283 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384403ccf0 con 0x7f385c100f60 2024-09-13T17:05:57.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.042+0000 7f3862861640 1 -- 172.21.15.87:0/3431860283 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f385c1a0530 con 0x7f385c100f60 2024-09-13T17:05:57.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.043+0000 7f3859ffb640 1 -- 172.21.15.87:0/3431860283 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f384403b3d0 con 0x7f385c100f60 2024-09-13T17:05:57.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.043+0000 7f3859ffb640 1 --2- 172.21.15.87:0/3431860283 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3848038930 0x7f384803adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:05:57.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.043+0000 7f3859ffb640 1 -- 172.21.15.87:0/3431860283 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f384406c100 con 0x7f385c100f60 2024-09-13T17:05:57.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.044+0000 7f385bfff640 1 --2- 172.21.15.87:0/3431860283 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3848038930 0x7f384803adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:05:57.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.044+0000 7f3862861640 1 -- 172.21.15.87:0/3431860283 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f385c107260 con 0x7f385c100f60 2024-09-13T17:05:57.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.044+0000 7f385bfff640 1 --2- 172.21.15.87:0/3431860283 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3848038930 0x7f384803adf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f384c005fd0 tx=0x7f384c00b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:05:57.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.048+0000 7f3859ffb640 1 -- 172.21.15.87:0/3431860283 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3844040020 con 0x7f385c100f60 2024-09-13T17:05:57.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:57.224+0000 7f3862861640 1 -- 172.21.15.87:0/3431860283 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f385c0608f0 con 0x7f3848038930 2024-09-13T17:05:57.462 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:57 smithi087 ceph-mon[30934]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:57.462 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:57 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:57.462 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:57 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:57.463 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:57 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:57.463 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:57 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:57.463 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:57 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:57.463 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:57 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:05:57.463 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:57 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:57.463 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:57 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T17:05:57.463 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:57 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T17:05:57.463 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:57 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:57.463 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:57 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:05:57.463 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:57 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:05:57.464 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:57 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:57.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:57 smithi149 ceph-mon[35496]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:57.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:57 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:57.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:57 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:57.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:57 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:57.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:57 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:57.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:57 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:57.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:57 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:05:57.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:57 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:57.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:57 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T17:05:57.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:57 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T17:05:57.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:57 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:57.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:57 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:05:57.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:57 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:05:57.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:57 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:57.613 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:05:57 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:05:57.212+0000 7f0799b32040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T17:05:57.613 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:05:57 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:05:57.278+0000 7f0799b32040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T17:05:57.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:57 smithi118 ceph-mon[34374]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:57.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:57 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:57.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:57 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:57.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:57 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:57.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:57 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:57.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:57 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:57.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:57 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:05:57.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:57 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:57.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:57 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T17:05:57.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:57 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T17:05:57.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:57 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:57.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:57 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:05:57.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:57 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:05:57.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:57 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:58.092 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:05:57 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:05:57.631+0000 7fc905c94040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T17:05:58.244 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:05:57 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:05:57.985+0000 7f0799b32040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T17:05:58.244 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:05:58 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:05:58.098+0000 7f0799b32040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T17:05:58.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:05:58.246+0000 7f3859ffb640 1 -- 172.21.15.87:0/3431860283 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mgrmap(e 14) v1 ==== 90707+0+0 (secure 0 0 0) 0x7f384403ba50 con 0x7f385c100f60 2024-09-13T17:05:58.514 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:05:58 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:05:58.242+0000 7f0799b32040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:05:58.515 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:05:58 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:05:58.302+0000 7f0799b32040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T17:05:58.515 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:05:58 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:05:58.447+0000 7f0799b32040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T17:05:58.515 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:05:58 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:05:58.513+0000 7f0799b32040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T17:05:58.515 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:58 smithi118 ceph-mon[34374]: Reconfiguring mgr.x (unknown last config time)... 2024-09-13T17:05:58.515 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:58 smithi118 ceph-mon[34374]: Reconfiguring daemon mgr.x on smithi087 2024-09-13T17:05:58.515 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:58 smithi118 ceph-mon[34374]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:05:58.515 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:58 smithi118 ceph-mon[34374]: Standby manager daemon z started 2024-09-13T17:05:58.515 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:58 smithi118 ceph-mon[34374]: from='mgr.? 172.21.15.149:0/2191458618' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-13T17:05:58.515 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:58 smithi118 ceph-mon[34374]: from='mgr.? 172.21.15.149:0/2191458618' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T17:05:58.515 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:58 smithi118 ceph-mon[34374]: from='mgr.? 172.21.15.149:0/2191458618' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-13T17:05:58.515 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:58 smithi118 ceph-mon[34374]: from='mgr.? 172.21.15.149:0/2191458618' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T17:05:58.516 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:58 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:58.516 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:58 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:58.516 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:58 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:58.516 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:58 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:05:58.516 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:58 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:58.516 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:58 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:05:58.516 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:58 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:58.568 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:58 smithi087 ceph-mon[30934]: Reconfiguring mgr.x (unknown last config time)... 2024-09-13T17:05:58.569 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:58 smithi087 ceph-mon[30934]: Reconfiguring daemon mgr.x on smithi087 2024-09-13T17:05:58.569 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:58 smithi087 ceph-mon[30934]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:05:58.569 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:58 smithi087 ceph-mon[30934]: Standby manager daemon z started 2024-09-13T17:05:58.569 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:58 smithi087 ceph-mon[30934]: from='mgr.? 172.21.15.149:0/2191458618' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-13T17:05:58.569 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:58 smithi087 ceph-mon[30934]: from='mgr.? 172.21.15.149:0/2191458618' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T17:05:58.569 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:58 smithi087 ceph-mon[30934]: from='mgr.? 172.21.15.149:0/2191458618' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-13T17:05:58.569 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:58 smithi087 ceph-mon[30934]: from='mgr.? 172.21.15.149:0/2191458618' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T17:05:58.569 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:58 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:58.569 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:58 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:58.569 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:58 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:58.569 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:58 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:05:58.569 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:58 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:58.570 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:58 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:05:58.570 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:58 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:58.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:58 smithi149 ceph-mon[35496]: Reconfiguring mgr.x (unknown last config time)... 2024-09-13T17:05:58.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:58 smithi149 ceph-mon[35496]: Reconfiguring daemon mgr.x on smithi087 2024-09-13T17:05:58.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:58 smithi149 ceph-mon[35496]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:05:58.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:58 smithi149 ceph-mon[35496]: Standby manager daemon z started 2024-09-13T17:05:58.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:58 smithi149 ceph-mon[35496]: from='mgr.? 172.21.15.149:0/2191458618' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-13T17:05:58.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:58 smithi149 ceph-mon[35496]: from='mgr.? 172.21.15.149:0/2191458618' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T17:05:58.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:58 smithi149 ceph-mon[35496]: from='mgr.? 172.21.15.149:0/2191458618' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-13T17:05:58.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:58 smithi149 ceph-mon[35496]: from='mgr.? 172.21.15.149:0/2191458618' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T17:05:58.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:58 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:58.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:58 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:58.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:58 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:58.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:58 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:05:58.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:58 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:05:58.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:58 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:05:58.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:58 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:05:58.788 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:05:58 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:05:58.572+0000 7f0799b32040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T17:05:58.789 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:05:58 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:05:58.724+0000 7f0799b32040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T17:05:58.789 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:05:58 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:05:58.787+0000 7f0799b32040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T17:05:59.050 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:05:58 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:05:58.853+0000 7f0799b32040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T17:05:59.050 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:05:58 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:05:58.934+0000 7f0799b32040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T17:05:59.050 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:05:58 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:05:58.992+0000 7f0799b32040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T17:05:59.050 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:05:59 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:05:59.049+0000 7f0799b32040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T17:05:59.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:59 smithi118 ceph-mon[34374]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:59.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:59 smithi118 ceph-mon[34374]: mgrmap e14: x(active, since 70s), standbys: z 2024-09-13T17:05:59.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:05:59 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-13T17:05:59.454 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:59 smithi087 ceph-mon[30934]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:59.454 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:59 smithi087 ceph-mon[30934]: mgrmap e14: x(active, since 70s), standbys: z 2024-09-13T17:05:59.454 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:05:59 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-13T17:05:59.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:59 smithi149 ceph-mon[35496]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:05:59.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:59 smithi149 ceph-mon[35496]: mgrmap e14: x(active, since 70s), standbys: z 2024-09-13T17:05:59.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:05:59 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-13T17:06:00.113 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:05:59 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:05:59.816+0000 7f0799b32040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T17:06:00.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:06:00.256+0000 7f3859ffb640 1 -- 172.21.15.87:0/3431860283 <== mon.0 v2:172.21.15.87:3300/0 8 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7f3844039360 con 0x7f385c100f60 2024-09-13T17:06:00.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:00 smithi149 ceph-mon[35496]: Standby manager daemon y started 2024-09-13T17:06:00.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:00 smithi149 ceph-mon[35496]: from='mgr.? 172.21.15.118:0/41057605' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-13T17:06:00.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:00 smithi149 ceph-mon[35496]: from='mgr.? 172.21.15.118:0/41057605' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T17:06:00.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:00 smithi149 ceph-mon[35496]: from='mgr.? 172.21.15.118:0/41057605' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-13T17:06:00.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:00 smithi149 ceph-mon[35496]: from='mgr.? 172.21.15.118:0/41057605' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T17:06:00.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:00 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/38285473' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "58250283-85c0-416e-abdd-1fc5a7ff0c27"}]: dispatch 2024-09-13T17:06:00.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:00 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/38285473' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "58250283-85c0-416e-abdd-1fc5a7ff0c27"}]': finished 2024-09-13T17:06:00.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:00 smithi149 ceph-mon[35496]: osdmap e5: 1 total, 0 up, 1 in 2024-09-13T17:06:00.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:00 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:06:00.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:00 smithi118 ceph-mon[34374]: Standby manager daemon y started 2024-09-13T17:06:00.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:00 smithi118 ceph-mon[34374]: from='mgr.? 172.21.15.118:0/41057605' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-13T17:06:00.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:00 smithi118 ceph-mon[34374]: from='mgr.? 172.21.15.118:0/41057605' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T17:06:00.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:00 smithi118 ceph-mon[34374]: from='mgr.? 172.21.15.118:0/41057605' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-13T17:06:00.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:00 smithi118 ceph-mon[34374]: from='mgr.? 172.21.15.118:0/41057605' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T17:06:00.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:00 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/38285473' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "58250283-85c0-416e-abdd-1fc5a7ff0c27"}]: dispatch 2024-09-13T17:06:00.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:00 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/38285473' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "58250283-85c0-416e-abdd-1fc5a7ff0c27"}]': finished 2024-09-13T17:06:00.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:00 smithi118 ceph-mon[34374]: osdmap e5: 1 total, 0 up, 1 in 2024-09-13T17:06:00.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:00 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:06:00.629 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:00 smithi087 ceph-mon[30934]: Standby manager daemon y started 2024-09-13T17:06:00.629 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:00 smithi087 ceph-mon[30934]: from='mgr.? 172.21.15.118:0/41057605' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-13T17:06:00.629 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:00 smithi087 ceph-mon[30934]: from='mgr.? 172.21.15.118:0/41057605' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T17:06:00.629 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:00 smithi087 ceph-mon[30934]: from='mgr.? 172.21.15.118:0/41057605' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-13T17:06:00.629 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:00 smithi087 ceph-mon[30934]: from='mgr.? 172.21.15.118:0/41057605' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T17:06:00.629 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:00 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/38285473' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "58250283-85c0-416e-abdd-1fc5a7ff0c27"}]: dispatch 2024-09-13T17:06:00.629 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:00 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/38285473' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "58250283-85c0-416e-abdd-1fc5a7ff0c27"}]': finished 2024-09-13T17:06:00.629 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:00 smithi087 ceph-mon[30934]: osdmap e5: 1 total, 0 up, 1 in 2024-09-13T17:06:00.629 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:00 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:06:01.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:01 smithi149 ceph-mon[35496]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:06:01.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:01 smithi149 ceph-mon[35496]: mgrmap e15: x(active, since 72s), standbys: y, z 2024-09-13T17:06:01.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:01 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-13T17:06:01.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:01 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/749385316' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:06:01.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:01 smithi118 ceph-mon[34374]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:06:01.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:01 smithi118 ceph-mon[34374]: mgrmap e15: x(active, since 72s), standbys: y, z 2024-09-13T17:06:01.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:01 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-13T17:06:01.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:01 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/749385316' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:06:01.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:01 smithi087 ceph-mon[30934]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:06:01.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:01 smithi087 ceph-mon[30934]: mgrmap e15: x(active, since 72s), standbys: y, z 2024-09-13T17:06:01.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:01 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-13T17:06:01.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:01 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/749385316' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:06:03.541 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:03 smithi087 ceph-mon[30934]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:06:03.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:03 smithi149 ceph-mon[35496]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:06:03.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:03 smithi118 ceph-mon[34374]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:06:05.287 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:05 smithi087 ceph-mon[30934]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:06:05.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:05 smithi149 ceph-mon[35496]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:06:05.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:05 smithi118 ceph-mon[34374]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:06:07.304 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:07 smithi087 ceph-mon[30934]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:06:07.304 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:07 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T17:06:07.305 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:07 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:06:07.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:07 smithi149 ceph-mon[35496]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:06:07.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:07 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T17:06:07.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:07 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:06:07.612 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:07 smithi118 ceph-mon[34374]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:06:07.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:07 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T17:06:07.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:07 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:06:08.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:08 smithi087 ceph-mon[30934]: Deploying daemon osd.0 on smithi087 2024-09-13T17:06:08.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:08 smithi149 ceph-mon[35496]: Deploying daemon osd.0 on smithi087 2024-09-13T17:06:08.633 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:08 smithi118 ceph-mon[34374]: Deploying daemon osd.0 on smithi087 2024-09-13T17:06:09.427 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:09 smithi087 ceph-mon[30934]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:06:09.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:09 smithi149 ceph-mon[35496]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:06:09.612 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:09 smithi118 ceph-mon[34374]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:06:11.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:11 smithi149 ceph-mon[35496]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:06:11.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:11 smithi118 ceph-mon[34374]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:06:11.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:11 smithi087 ceph-mon[30934]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:06:12.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:12 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:06:12.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:12 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:12.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:12 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:12.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:12 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:06:12.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:12 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:12.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:12 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:12.612 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:12 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:06:12.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:12 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:12.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:12 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:13.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:13 smithi087 ceph-mon[30934]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:06:13.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:13 smithi149 ceph-mon[35496]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:06:13.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:13 smithi118 ceph-mon[34374]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:06:14.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:06:14.066+0000 7f3859ffb640 1 -- 172.21.15.87:0/3431860283 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f385c0608f0 con 0x7f3848038930 2024-09-13T17:06:14.068 INFO:teuthology.orchestra.run.smithi087.stdout:Created osd(s) 0 on host 'smithi087' 2024-09-13T17:06:14.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:06:14.068+0000 7f3862861640 1 -- 172.21.15.87:0/3431860283 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3848038930 msgr2=0x7f384803adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:14.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:06:14.068+0000 7f3862861640 1 --2- 172.21.15.87:0/3431860283 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3848038930 0x7f384803adf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f384c005fd0 tx=0x7f384c00b4a0 comp rx=0 tx=0).stop 2024-09-13T17:06:14.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:06:14.068+0000 7f3862861640 1 -- 172.21.15.87:0/3431860283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f385c100f60 msgr2=0x7f385c0728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:14.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:06:14.068+0000 7f3862861640 1 --2- 172.21.15.87:0/3431860283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f385c100f60 0x7f385c0728a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3844009230 tx=0x7f3844004270 comp rx=0 tx=0).stop 2024-09-13T17:06:14.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:06:14.068+0000 7f3862861640 1 -- 172.21.15.87:0/3431860283 shutdown_connections 2024-09-13T17:06:14.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:06:14.068+0000 7f3862861640 1 --2- 172.21.15.87:0/3431860283 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3848038930 0x7f384803adf0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:14.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:06:14.068+0000 7f3862861640 1 --2- 172.21.15.87:0/3431860283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f385c101920 0x7f385c072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:14.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:06:14.068+0000 7f3862861640 1 --2- 172.21.15.87:0/3431860283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f385c100f60 0x7f385c0728a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:14.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:06:14.068+0000 7f3862861640 1 --2- 172.21.15.87:0/3431860283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f385c0ffe00 0x7f385c074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:14.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:06:14.068+0000 7f3862861640 1 -- 172.21.15.87:0/3431860283 >> 172.21.15.87:0/3431860283 conn(0x7f385c0fb5d0 msgr2=0x7f385c104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:14.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:06:14.068+0000 7f3862861640 1 -- 172.21.15.87:0/3431860283 shutdown_connections 2024-09-13T17:06:14.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:06:14.068+0000 7f3862861640 1 -- 172.21.15.87:0/3431860283 wait complete. 2024-09-13T17:06:14.932 DEBUG:teuthology.orchestra.run.smithi087:osd.0> sudo journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.0.service 2024-09-13T17:06:14.935 INFO:tasks.cephadm:Deploying osd.1 on smithi118 with /dev/vg_nvme/lv_4... 2024-09-13T17:06:14.935 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-09-13T17:06:15.136 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T17:06:15.228 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:15 smithi087 ceph-mon[30934]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:06:15.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:15 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:15.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:15 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:15.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:15 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:15.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:15 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:15.256 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:15 smithi118 ceph-mon[34374]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:06:15.257 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:15 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:15.257 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:15 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:15.257 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:15 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:15.257 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:15 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:15.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:15 smithi149 ceph-mon[35496]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:06:15.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:15 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:15.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:15 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:15.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:15 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:15.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:15 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:15.729 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 13 17:06:15 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-0[45551]: 2024-09-13T17:06:15.420+0000 7f37be265640 -1 osd.0 0 log_to_monitors true 2024-09-13T17:06:16.240 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:16 smithi118 ceph-mon[34374]: from='osd.0 [v2:172.21.15.87:6802/1316956138,v1:172.21.15.87:6803/1316956138]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T17:06:16.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:16 smithi149 ceph-mon[35496]: from='osd.0 [v2:172.21.15.87:6802/1316956138,v1:172.21.15.87:6803/1316956138]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T17:06:16.376 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:16 smithi087 ceph-mon[30934]: from='osd.0 [v2:172.21.15.87:6802/1316956138,v1:172.21.15.87:6803/1316956138]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T17:06:16.867 INFO:teuthology.orchestra.run.smithi118.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-09-13T17:06:16.958 INFO:teuthology.orchestra.run.smithi118.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-09-13T17:06:16.968 INFO:teuthology.orchestra.run.smithi118.stderr: stderr: 10+0 records in 2024-09-13T17:06:16.968 INFO:teuthology.orchestra.run.smithi118.stderr:10+0 records out 2024-09-13T17:06:16.969 INFO:teuthology.orchestra.run.smithi118.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00851857 s, 1.2 GB/s 2024-09-13T17:06:16.969 INFO:teuthology.orchestra.run.smithi118.stderr:--> Zapping successful for: 2024-09-13T17:06:17.131 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:17 smithi118 ceph-mon[34374]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:06:17.131 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:17 smithi118 ceph-mon[34374]: from='osd.0 [v2:172.21.15.87:6802/1316956138,v1:172.21.15.87:6803/1316956138]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T17:06:17.131 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:17 smithi118 ceph-mon[34374]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T17:06:17.131 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:17 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:06:17.131 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:17 smithi118 ceph-mon[34374]: from='osd.0 [v2:172.21.15.87:6802/1316956138,v1:172.21.15.87:6803/1316956138]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-13T17:06:17.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:17 smithi149 ceph-mon[35496]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:06:17.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:17 smithi149 ceph-mon[35496]: from='osd.0 [v2:172.21.15.87:6802/1316956138,v1:172.21.15.87:6803/1316956138]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T17:06:17.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:17 smithi149 ceph-mon[35496]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T17:06:17.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:17 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:06:17.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:17 smithi149 ceph-mon[35496]: from='osd.0 [v2:172.21.15.87:6802/1316956138,v1:172.21.15.87:6803/1316956138]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-13T17:06:17.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:17 smithi087 ceph-mon[30934]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:06:17.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:17 smithi087 ceph-mon[30934]: from='osd.0 [v2:172.21.15.87:6802/1316956138,v1:172.21.15.87:6803/1316956138]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T17:06:17.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:17 smithi087 ceph-mon[30934]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T17:06:17.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:17 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:06:17.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:17 smithi087 ceph-mon[30934]: from='osd.0 [v2:172.21.15.87:6802/1316956138,v1:172.21.15.87:6803/1316956138]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-13T17:06:17.627 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi118:vg_nvme/lv_4 2024-09-13T17:06:17.817 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 13 17:06:17 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-0[45551]: 2024-09-13T17:06:17.489+0000 7f37ba1e6640 -1 osd.0 0 waiting for initial osdmap 2024-09-13T17:06:17.817 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 13 17:06:17 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-0[45551]: 2024-09-13T17:06:17.492+0000 7f37b2007640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:06:17.822 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T17:06:18.197 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:18 smithi118 ceph-mon[34374]: from='osd.0 [v2:172.21.15.87:6802/1316956138,v1:172.21.15.87:6803/1316956138]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-09-13T17:06:18.197 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:18 smithi118 ceph-mon[34374]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T17:06:18.197 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:18 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:06:18.198 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:18 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:06:18.198 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:18 smithi118 ceph-mon[34374]: from='osd.0 [v2:172.21.15.87:6802/1316956138,v1:172.21.15.87:6803/1316956138]' entity='osd.0' 2024-09-13T17:06:18.198 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:18 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:18.198 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:18 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:18.198 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:18 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:06:18.198 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:18 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:18.198 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:18 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:06:18.198 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:18 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:06:18.198 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:18 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:18.198 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:18 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:06:18.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:18 smithi149 ceph-mon[35496]: from='osd.0 [v2:172.21.15.87:6802/1316956138,v1:172.21.15.87:6803/1316956138]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-09-13T17:06:18.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:18 smithi149 ceph-mon[35496]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T17:06:18.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:18 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:06:18.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:18 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:06:18.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:18 smithi149 ceph-mon[35496]: from='osd.0 [v2:172.21.15.87:6802/1316956138,v1:172.21.15.87:6803/1316956138]' entity='osd.0' 2024-09-13T17:06:18.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:18 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:18.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:18 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:18.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:18 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:06:18.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:18 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:18.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:18 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:06:18.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:18 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:06:18.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:18 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:18.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:18 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:06:18.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:18 smithi087 ceph-mon[30934]: from='osd.0 [v2:172.21.15.87:6802/1316956138,v1:172.21.15.87:6803/1316956138]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-09-13T17:06:18.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:18 smithi087 ceph-mon[30934]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T17:06:18.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:18 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:06:18.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:18 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:06:18.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:18 smithi087 ceph-mon[30934]: from='osd.0 [v2:172.21.15.87:6802/1316956138,v1:172.21.15.87:6803/1316956138]' entity='osd.0' 2024-09-13T17:06:18.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:18 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:18.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:18 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:18.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:18 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:06:18.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:18 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:18.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:18 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:06:18.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:18 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:06:18.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:18 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:18.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:18 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:06:19.291 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:19 smithi118 ceph-mon[34374]: purged_snaps scrub starts 2024-09-13T17:06:19.291 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:19 smithi118 ceph-mon[34374]: purged_snaps scrub ok 2024-09-13T17:06:19.291 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:19 smithi118 ceph-mon[34374]: Detected new or changed devices on smithi087 2024-09-13T17:06:19.291 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:19 smithi118 ceph-mon[34374]: Adjusting osd_memory_target on smithi087 to 17088M 2024-09-13T17:06:19.292 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:19 smithi118 ceph-mon[34374]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:06:19.292 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:19 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:06:19.292 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:19 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:06:19.292 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:19 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:06:19.292 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:19 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:19.292 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:19 smithi118 ceph-mon[34374]: osd.0 [v2:172.21.15.87:6802/1316956138,v1:172.21.15.87:6803/1316956138] boot 2024-09-13T17:06:19.292 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:19 smithi118 ceph-mon[34374]: osdmap e8: 1 total, 1 up, 1 in 2024-09-13T17:06:19.292 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:19 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:06:19.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.295+0000 7f6cc4769640 1 -- 172.21.15.118:0/829089316 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6cbc1008d0 msgr2=0x7f6cbc107160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:19.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.295+0000 7f6cc4769640 1 --2- 172.21.15.118:0/829089316 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6cbc1008d0 0x7f6cbc107160 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4009ca0 tx=0x7f6cb402a8c0 comp rx=0 tx=0).stop 2024-09-13T17:06:19.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.296+0000 7f6cc4769640 1 -- 172.21.15.118:0/829089316 shutdown_connections 2024-09-13T17:06:19.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.296+0000 7f6cc4769640 1 --2- 172.21.15.118:0/829089316 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6cbc1008d0 0x7f6cbc107160 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:19.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.296+0000 7f6cc4769640 1 --2- 172.21.15.118:0/829089316 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6cbc0fff10 0x7f6cbc100390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:19.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.296+0000 7f6cc4769640 1 --2- 172.21.15.118:0/829089316 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6cbc0fed10 0x7f6cbc0ff110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:19.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.296+0000 7f6cc4769640 1 -- 172.21.15.118:0/829089316 >> 172.21.15.118:0/829089316 conn(0x7f6cbc0fa4c0 msgr2=0x7f6cbc0fc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:19.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.296+0000 7f6cc4769640 1 -- 172.21.15.118:0/829089316 shutdown_connections 2024-09-13T17:06:19.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.296+0000 7f6cc4769640 1 -- 172.21.15.118:0/829089316 wait complete. 2024-09-13T17:06:19.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.296+0000 7f6cc4769640 1 Processor -- start 2024-09-13T17:06:19.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.296+0000 7f6cc4769640 1 -- start start 2024-09-13T17:06:19.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.296+0000 7f6cc4769640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6cbc0fed10 0x7f6cbc0692c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:19.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.296+0000 7f6cc4769640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6cbc0fff10 0x7f6cbc19aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:19.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.296+0000 7f6cc4769640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6cbc1008d0 0x7f6cbc19d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:19.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.296+0000 7f6cc4769640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc19d8a0 con 0x7f6cbc0fed10 2024-09-13T17:06:19.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.296+0000 7f6cc4769640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc19da10 con 0x7f6cbc1008d0 2024-09-13T17:06:19.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.296+0000 7f6cc4769640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc19dbd0 con 0x7f6cbc0fff10 2024-09-13T17:06:19.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.296+0000 7f6cc2d06640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6cbc1008d0 0x7f6cbc19d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:19.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.297+0000 7f6cc1d04640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6cbc0fff10 0x7f6cbc19aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:19.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.297+0000 7f6cc2505640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6cbc0fed10 0x7f6cbc0692c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:19.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.297+0000 7f6cc1d04640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6cbc0fff10 0x7f6cbc19aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.118:49352/0 (socket says 172.21.15.118:49352) 2024-09-13T17:06:19.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.297+0000 7f6cc2d06640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6cbc1008d0 0x7f6cbc19d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54382/0 (socket says 172.21.15.118:54382) 2024-09-13T17:06:19.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.297+0000 7f6cc1d04640 1 -- 172.21.15.118:0/453135771 learned_addr learned my addr 172.21.15.118:0/453135771 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-13T17:06:19.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.297+0000 7f6cc1d04640 1 -- 172.21.15.118:0/453135771 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6cbc1008d0 msgr2=0x7f6cbc19d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:19.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.297+0000 7f6cc1d04640 1 --2- 172.21.15.118:0/453135771 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6cbc1008d0 0x7f6cbc19d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:19.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.297+0000 7f6cc1d04640 1 -- 172.21.15.118:0/453135771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6cbc0fed10 msgr2=0x7f6cbc0692c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:19.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.297+0000 7f6cc1d04640 1 --2- 172.21.15.118:0/453135771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6cbc0fed10 0x7f6cbc0692c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:19.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.297+0000 7f6cc1d04640 1 -- 172.21.15.118:0/453135771 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb4009900 con 0x7f6cbc0fff10 2024-09-13T17:06:19.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.297+0000 7f6cc1d04640 1 --2- 172.21.15.118:0/453135771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6cbc0fff10 0x7f6cbc19aac0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6cb800d950 tx=0x7f6cb800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:19.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.297+0000 7f6cb37fe640 1 -- 172.21.15.118:0/453135771 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8009c30 con 0x7f6cbc0fff10 2024-09-13T17:06:19.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.297+0000 7f6cc4769640 1 -- 172.21.15.118:0/453135771 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cbc19deb0 con 0x7f6cbc0fff10 2024-09-13T17:06:19.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.297+0000 7f6cb37fe640 1 -- 172.21.15.118:0/453135771 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6cb8009d90 con 0x7f6cbc0fff10 2024-09-13T17:06:19.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.297+0000 7f6cb37fe640 1 -- 172.21.15.118:0/453135771 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb800f6b0 con 0x7f6cbc0fff10 2024-09-13T17:06:19.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.297+0000 7f6cc4769640 1 -- 172.21.15.118:0/453135771 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cbc19e370 con 0x7f6cbc0fff10 2024-09-13T17:06:19.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.298+0000 7f6cc4769640 1 -- 172.21.15.118:0/453135771 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cbc1061b0 con 0x7f6cbc0fff10 2024-09-13T17:06:19.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.299+0000 7f6cb37fe640 1 -- 172.21.15.118:0/453135771 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7f6cb8010aa0 con 0x7f6cbc0fff10 2024-09-13T17:06:19.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.300+0000 7f6cb37fe640 1 --2- 172.21.15.118:0/453135771 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f6ca80a0ff0 0x7f6ca80a34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:19.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.300+0000 7f6cb37fe640 1 -- 172.21.15.118:0/453135771 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1767+0+0 (secure 0 0 0) 0x7f6cb80caa60 con 0x7f6cbc0fff10 2024-09-13T17:06:19.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.300+0000 7f6cc2505640 1 --2- 172.21.15.118:0/453135771 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f6ca80a0ff0 0x7f6ca80a34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:19.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.300+0000 7f6cc2505640 1 --2- 172.21.15.118:0/453135771 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f6ca80a0ff0 0x7f6ca80a34b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc069800 tx=0x7f6cac005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:19.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.303+0000 7f6cb37fe640 1 -- 172.21.15.118:0/453135771 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6cb8095d10 con 0x7f6cbc0fff10 2024-09-13T17:06:19.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:19 smithi149 ceph-mon[35496]: purged_snaps scrub starts 2024-09-13T17:06:19.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:19 smithi149 ceph-mon[35496]: purged_snaps scrub ok 2024-09-13T17:06:19.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:19 smithi149 ceph-mon[35496]: Detected new or changed devices on smithi087 2024-09-13T17:06:19.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:19 smithi149 ceph-mon[35496]: Adjusting osd_memory_target on smithi087 to 17088M 2024-09-13T17:06:19.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:19 smithi149 ceph-mon[35496]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:06:19.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:19 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:06:19.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:19 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:06:19.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:19 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:06:19.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:19 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:19.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:19 smithi149 ceph-mon[35496]: osd.0 [v2:172.21.15.87:6802/1316956138,v1:172.21.15.87:6803/1316956138] boot 2024-09-13T17:06:19.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:19 smithi149 ceph-mon[35496]: osdmap e8: 1 total, 1 up, 1 in 2024-09-13T17:06:19.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:19 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:06:19.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:19.472+0000 7f6cc4769640 1 -- 172.21.15.118:0/453135771 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f6cbc02c480 con 0x7f6ca80a0ff0 2024-09-13T17:06:19.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:19 smithi087 ceph-mon[30934]: purged_snaps scrub starts 2024-09-13T17:06:19.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:19 smithi087 ceph-mon[30934]: purged_snaps scrub ok 2024-09-13T17:06:19.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:19 smithi087 ceph-mon[30934]: Detected new or changed devices on smithi087 2024-09-13T17:06:19.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:19 smithi087 ceph-mon[30934]: Adjusting osd_memory_target on smithi087 to 17088M 2024-09-13T17:06:19.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:19 smithi087 ceph-mon[30934]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:06:19.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:19 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:06:19.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:19 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:06:19.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:19 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:06:19.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:19 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:19.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:19 smithi087 ceph-mon[30934]: osd.0 [v2:172.21.15.87:6802/1316956138,v1:172.21.15.87:6803/1316956138] boot 2024-09-13T17:06:19.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:19 smithi087 ceph-mon[30934]: osdmap e8: 1 total, 1 up, 1 in 2024-09-13T17:06:19.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:19 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:06:20.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:20 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:06:20.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:20 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:06:20.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:20 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:06:20.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:20 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:06:20.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:20 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:06:20.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:20 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:06:20.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:20 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:06:20.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:20 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:06:20.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:20 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:06:21.348 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:21 smithi118 ceph-mon[34374]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:06:21.348 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:21 smithi118 ceph-mon[34374]: pgmap v44: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:06:21.348 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:21 smithi118 ceph-mon[34374]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T17:06:21.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:21 smithi087 ceph-mon[30934]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:06:21.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:21 smithi087 ceph-mon[30934]: pgmap v44: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:06:21.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:21 smithi087 ceph-mon[30934]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T17:06:21.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:21 smithi149 ceph-mon[35496]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:06:21.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:21 smithi149 ceph-mon[35496]: pgmap v44: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:06:21.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:21 smithi149 ceph-mon[35496]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T17:06:22.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:22 smithi118 ceph-mon[34374]: from='client.? 172.21.15.118:0/4031393869' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b9d49969-94b1-4262-b4ff-db0a8e3331af"}]: dispatch 2024-09-13T17:06:22.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:22 smithi118 ceph-mon[34374]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b9d49969-94b1-4262-b4ff-db0a8e3331af"}]: dispatch 2024-09-13T17:06:22.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:22 smithi118 ceph-mon[34374]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b9d49969-94b1-4262-b4ff-db0a8e3331af"}]': finished 2024-09-13T17:06:22.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:22 smithi118 ceph-mon[34374]: osdmap e10: 2 total, 1 up, 2 in 2024-09-13T17:06:22.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:22 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:06:22.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:22 smithi087 ceph-mon[30934]: from='client.? 172.21.15.118:0/4031393869' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b9d49969-94b1-4262-b4ff-db0a8e3331af"}]: dispatch 2024-09-13T17:06:22.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:22 smithi087 ceph-mon[30934]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b9d49969-94b1-4262-b4ff-db0a8e3331af"}]: dispatch 2024-09-13T17:06:22.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:22 smithi087 ceph-mon[30934]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b9d49969-94b1-4262-b4ff-db0a8e3331af"}]': finished 2024-09-13T17:06:22.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:22 smithi087 ceph-mon[30934]: osdmap e10: 2 total, 1 up, 2 in 2024-09-13T17:06:22.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:22 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:06:22.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:22 smithi149 ceph-mon[35496]: from='client.? 172.21.15.118:0/4031393869' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b9d49969-94b1-4262-b4ff-db0a8e3331af"}]: dispatch 2024-09-13T17:06:22.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:22 smithi149 ceph-mon[35496]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b9d49969-94b1-4262-b4ff-db0a8e3331af"}]: dispatch 2024-09-13T17:06:22.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:22 smithi149 ceph-mon[35496]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b9d49969-94b1-4262-b4ff-db0a8e3331af"}]': finished 2024-09-13T17:06:22.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:22 smithi149 ceph-mon[35496]: osdmap e10: 2 total, 1 up, 2 in 2024-09-13T17:06:22.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:22 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:06:23.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:23 smithi118 ceph-mon[34374]: pgmap v47: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:06:23.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:23 smithi118 ceph-mon[34374]: from='client.? 172.21.15.118:0/2692908395' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:06:23.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:23 smithi087 ceph-mon[30934]: pgmap v47: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:06:23.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:23 smithi087 ceph-mon[30934]: from='client.? 172.21.15.118:0/2692908395' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:06:23.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:23 smithi149 ceph-mon[35496]: pgmap v47: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:06:23.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:23 smithi149 ceph-mon[35496]: from='client.? 172.21.15.118:0/2692908395' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:06:25.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:25 smithi118 ceph-mon[34374]: pgmap v48: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:06:25.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:25 smithi087 ceph-mon[30934]: pgmap v48: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:06:25.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:25 smithi149 ceph-mon[35496]: pgmap v48: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:06:27.178 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:27 smithi118 ceph-mon[34374]: pgmap v49: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:06:27.394 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:27 smithi149 ceph-mon[35496]: pgmap v49: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:06:27.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:27 smithi087 ceph-mon[30934]: pgmap v49: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:06:29.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:29 smithi118 ceph-mon[34374]: pgmap v50: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:06:29.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:29 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T17:06:29.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:29 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:06:29.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:29 smithi118 ceph-mon[34374]: Deploying daemon osd.1 on smithi118 2024-09-13T17:06:29.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:29 smithi087 ceph-mon[30934]: pgmap v50: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:06:29.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:29 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T17:06:29.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:29 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:06:29.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:29 smithi087 ceph-mon[30934]: Deploying daemon osd.1 on smithi118 2024-09-13T17:06:29.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:29 smithi149 ceph-mon[35496]: pgmap v50: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:06:29.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:29 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T17:06:29.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:29 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:06:29.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:29 smithi149 ceph-mon[35496]: Deploying daemon osd.1 on smithi118 2024-09-13T17:06:31.291 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:31 smithi118 ceph-mon[34374]: pgmap v51: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:06:31.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:31 smithi087 ceph-mon[30934]: pgmap v51: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:06:31.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:31 smithi149 ceph-mon[35496]: pgmap v51: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:06:33.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:33 smithi118 ceph-mon[34374]: pgmap v52: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:06:33.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:33 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:06:33.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:33 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:33.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:33 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:33.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:33 smithi087 ceph-mon[30934]: pgmap v52: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:06:33.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:33 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:06:33.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:33 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:33.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:33 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:33.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:33 smithi149 ceph-mon[35496]: pgmap v52: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:06:33.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:33 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:06:33.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:33 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:33.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:33 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:35.341 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:35 smithi118 ceph-mon[34374]: pgmap v53: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:06:35.341 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:35 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:35.341 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:35 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:35.341 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:35 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:06:35.341 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:35 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:06:35.342 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:35 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:35.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:35 smithi087 ceph-mon[30934]: pgmap v53: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:06:35.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:35 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:35.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:35 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:35.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:35 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:06:35.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:35 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:06:35.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:35 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:35.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:35 smithi149 ceph-mon[35496]: pgmap v53: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:06:35.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:35 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:35.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:35 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:35.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:35 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:06:35.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:35 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:06:35.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:35 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:36.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:36.244+0000 7f6cb37fe640 1 -- 172.21.15.118:0/453135771 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6cbc02c480 con 0x7f6ca80a0ff0 2024-09-13T17:06:36.247 INFO:teuthology.orchestra.run.smithi118.stdout:Created osd(s) 1 on host 'smithi118' 2024-09-13T17:06:36.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:36.246+0000 7f6cc4769640 1 -- 172.21.15.118:0/453135771 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f6ca80a0ff0 msgr2=0x7f6ca80a34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:36.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:36.246+0000 7f6cc4769640 1 --2- 172.21.15.118:0/453135771 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f6ca80a0ff0 0x7f6ca80a34b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc069800 tx=0x7f6cac005f90 comp rx=0 tx=0).stop 2024-09-13T17:06:36.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:36.246+0000 7f6cc4769640 1 -- 172.21.15.118:0/453135771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6cbc0fff10 msgr2=0x7f6cbc19aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:36.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:36.246+0000 7f6cc4769640 1 --2- 172.21.15.118:0/453135771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6cbc0fff10 0x7f6cbc19aac0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6cb800d950 tx=0x7f6cb800de10 comp rx=0 tx=0).stop 2024-09-13T17:06:36.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:36.247+0000 7f6cc4769640 1 -- 172.21.15.118:0/453135771 shutdown_connections 2024-09-13T17:06:36.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:36.247+0000 7f6cc4769640 1 --2- 172.21.15.118:0/453135771 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f6ca80a0ff0 0x7f6ca80a34b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:36.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:36.247+0000 7f6cc4769640 1 --2- 172.21.15.118:0/453135771 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6cbc1008d0 0x7f6cbc19d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:36.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:36.247+0000 7f6cc4769640 1 --2- 172.21.15.118:0/453135771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6cbc0fff10 0x7f6cbc19aac0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:36.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:36.247+0000 7f6cc4769640 1 --2- 172.21.15.118:0/453135771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6cbc0fed10 0x7f6cbc0692c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:36.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:36.247+0000 7f6cc4769640 1 -- 172.21.15.118:0/453135771 >> 172.21.15.118:0/453135771 conn(0x7f6cbc0fa4c0 msgr2=0x7f6cbc103380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:36.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:36.247+0000 7f6cc4769640 1 -- 172.21.15.118:0/453135771 shutdown_connections 2024-09-13T17:06:36.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:06:36.247+0000 7f6cc4769640 1 -- 172.21.15.118:0/453135771 wait complete. 2024-09-13T17:06:36.912 DEBUG:teuthology.orchestra.run.smithi118:osd.1> sudo journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.1.service 2024-09-13T17:06:36.915 INFO:tasks.cephadm:Deploying osd.2 on smithi149 with /dev/vg_nvme/lv_4... 2024-09-13T17:06:36.915 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-09-13T17:06:37.120 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T17:06:37.134 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:37 smithi118 ceph-mon[34374]: pgmap v54: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:06:37.134 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:06:37.134 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:37.134 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:37.135 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:37 smithi118 ceph-mon[34374]: from='osd.1 [v2:172.21.15.118:6800/3352566727,v1:172.21.15.118:6801/3352566727]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T17:06:37.135 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:37 smithi118 ceph-mon[34374]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T17:06:37.241 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:37 smithi149 ceph-mon[35496]: pgmap v54: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:06:37.241 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:37 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:06:37.241 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:37 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:37.241 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:37 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:37.242 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:37 smithi149 ceph-mon[35496]: from='osd.1 [v2:172.21.15.118:6800/3352566727,v1:172.21.15.118:6801/3352566727]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T17:06:37.242 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:37 smithi149 ceph-mon[35496]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T17:06:37.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:37 smithi087 ceph-mon[30934]: pgmap v54: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:06:37.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:37 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:06:37.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:37 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:37.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:37 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:37.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:37 smithi087 ceph-mon[30934]: from='osd.1 [v2:172.21.15.118:6800/3352566727,v1:172.21.15.118:6801/3352566727]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T17:06:37.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:37 smithi087 ceph-mon[30934]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T17:06:38.482 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:38 smithi149 ceph-mon[35496]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T17:06:38.482 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:38 smithi149 ceph-mon[35496]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T17:06:38.482 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:38 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:06:38.482 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:38 smithi149 ceph-mon[35496]: from='osd.1 [v2:172.21.15.118:6800/3352566727,v1:172.21.15.118:6801/3352566727]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2024-09-13T17:06:38.482 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:38 smithi149 ceph-mon[35496]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2024-09-13T17:06:38.495 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:38 smithi118 ceph-mon[34374]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T17:06:38.495 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:38 smithi118 ceph-mon[34374]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T17:06:38.495 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:38 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:06:38.495 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:38 smithi118 ceph-mon[34374]: from='osd.1 [v2:172.21.15.118:6800/3352566727,v1:172.21.15.118:6801/3352566727]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2024-09-13T17:06:38.495 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:38 smithi118 ceph-mon[34374]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2024-09-13T17:06:38.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:38 smithi087 ceph-mon[30934]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T17:06:38.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:38 smithi087 ceph-mon[30934]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T17:06:38.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:38 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:06:38.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:38 smithi087 ceph-mon[30934]: from='osd.1 [v2:172.21.15.118:6800/3352566727,v1:172.21.15.118:6801/3352566727]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2024-09-13T17:06:38.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:38 smithi087 ceph-mon[30934]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2024-09-13T17:06:38.848 INFO:teuthology.orchestra.run.smithi149.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-09-13T17:06:38.863 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 13 17:06:38 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-1[38870]: 2024-09-13T17:06:38.668+0000 7fc91a299640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T17:06:38.863 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 13 17:06:38 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-1[38870]: 2024-09-13T17:06:38.672+0000 7fc9120ba640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:06:38.933 INFO:teuthology.orchestra.run.smithi149.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-09-13T17:06:38.947 INFO:teuthology.orchestra.run.smithi149.stderr: stderr: 10+0 records in 2024-09-13T17:06:38.947 INFO:teuthology.orchestra.run.smithi149.stderr:10+0 records out 2024-09-13T17:06:38.947 INFO:teuthology.orchestra.run.smithi149.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0128559 s, 816 MB/s 2024-09-13T17:06:38.947 INFO:teuthology.orchestra.run.smithi149.stderr:--> Zapping successful for: 2024-09-13T17:06:39.423 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:39 smithi118 ceph-mon[34374]: pgmap v56: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:06:39.423 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:39 smithi118 ceph-mon[34374]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2024-09-13T17:06:39.423 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:39 smithi118 ceph-mon[34374]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T17:06:39.423 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:39 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:06:39.423 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:39 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:06:39.423 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:39 smithi118 ceph-mon[34374]: from='osd.1 ' entity='osd.1' 2024-09-13T17:06:39.519 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:39 smithi149 ceph-mon[35496]: pgmap v56: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:06:39.519 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:39 smithi149 ceph-mon[35496]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2024-09-13T17:06:39.519 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:39 smithi149 ceph-mon[35496]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T17:06:39.520 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:39 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:06:39.520 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:39 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:06:39.520 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:39 smithi149 ceph-mon[35496]: from='osd.1 ' entity='osd.1' 2024-09-13T17:06:39.542 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi149:vg_nvme/lv_4 2024-09-13T17:06:39.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:39 smithi087 ceph-mon[30934]: pgmap v56: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:06:39.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:39 smithi087 ceph-mon[30934]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2024-09-13T17:06:39.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:39 smithi087 ceph-mon[30934]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T17:06:39.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:39 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:06:39.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:39 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:06:39.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:39 smithi087 ceph-mon[30934]: from='osd.1 ' entity='osd.1' 2024-09-13T17:06:39.751 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T17:06:40.567 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:40 smithi149 ceph-mon[35496]: purged_snaps scrub starts 2024-09-13T17:06:40.567 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:40 smithi149 ceph-mon[35496]: purged_snaps scrub ok 2024-09-13T17:06:40.567 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:40 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:06:40.567 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:40 smithi149 ceph-mon[35496]: osd.1 [v2:172.21.15.118:6800/3352566727,v1:172.21.15.118:6801/3352566727] boot 2024-09-13T17:06:40.567 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:40 smithi149 ceph-mon[35496]: osdmap e13: 2 total, 2 up, 2 in 2024-09-13T17:06:40.568 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:40 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:06:40.568 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:40 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:40.568 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:40 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:40.568 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:40 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:06:40.568 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:40 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:40.568 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:40 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:06:40.568 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:40 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:06:40.568 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:40 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:40.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:40 smithi118 ceph-mon[34374]: purged_snaps scrub starts 2024-09-13T17:06:40.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:40 smithi118 ceph-mon[34374]: purged_snaps scrub ok 2024-09-13T17:06:40.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:40 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:06:40.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:40 smithi118 ceph-mon[34374]: osd.1 [v2:172.21.15.118:6800/3352566727,v1:172.21.15.118:6801/3352566727] boot 2024-09-13T17:06:40.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:40 smithi118 ceph-mon[34374]: osdmap e13: 2 total, 2 up, 2 in 2024-09-13T17:06:40.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:40 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:06:40.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:40 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:40.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:40 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:40.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:40 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:06:40.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:40 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:40.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:40 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:06:40.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:40 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:06:40.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:40 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:40.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:40 smithi087 ceph-mon[30934]: purged_snaps scrub starts 2024-09-13T17:06:40.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:40 smithi087 ceph-mon[30934]: purged_snaps scrub ok 2024-09-13T17:06:40.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:40 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:06:40.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:40 smithi087 ceph-mon[30934]: osd.1 [v2:172.21.15.118:6800/3352566727,v1:172.21.15.118:6801/3352566727] boot 2024-09-13T17:06:40.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:40 smithi087 ceph-mon[30934]: osdmap e13: 2 total, 2 up, 2 in 2024-09-13T17:06:40.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:40 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:06:40.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:40 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:40.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:40 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:40.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:40 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:06:40.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:40 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:40.730 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:40 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:06:40.730 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:40 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:06:40.730 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:40 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:41.404 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.402+0000 7ffa181fa640 1 -- 172.21.15.149:0/965519678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa101008c0 msgr2=0x7ffa10107150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:41.405 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.402+0000 7ffa181fa640 1 --2- 172.21.15.149:0/965519678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa101008c0 0x7ffa10107150 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ffa08009ca0 tx=0x7ffa0802a8c0 comp rx=0 tx=0).stop 2024-09-13T17:06:41.405 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.402+0000 7ffa181fa640 1 -- 172.21.15.149:0/965519678 shutdown_connections 2024-09-13T17:06:41.405 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.402+0000 7ffa181fa640 1 --2- 172.21.15.149:0/965519678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa101008c0 0x7ffa10107150 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:41.405 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.402+0000 7ffa181fa640 1 --2- 172.21.15.149:0/965519678 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa100fff00 0x7ffa10100380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:41.405 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.402+0000 7ffa181fa640 1 --2- 172.21.15.149:0/965519678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa100fed00 0x7ffa100ff100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:41.405 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.402+0000 7ffa181fa640 1 -- 172.21.15.149:0/965519678 >> 172.21.15.149:0/965519678 conn(0x7ffa100fa490 msgr2=0x7ffa100fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:41.405 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.402+0000 7ffa181fa640 1 -- 172.21.15.149:0/965519678 shutdown_connections 2024-09-13T17:06:41.405 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.402+0000 7ffa181fa640 1 -- 172.21.15.149:0/965519678 wait complete. 2024-09-13T17:06:41.407 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.403+0000 7ffa181fa640 1 Processor -- start 2024-09-13T17:06:41.407 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.403+0000 7ffa181fa640 1 -- start start 2024-09-13T17:06:41.407 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.403+0000 7ffa181fa640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa100fed00 0x7ffa10069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:41.407 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.403+0000 7ffa181fa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa100fff00 0x7ffa1019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:41.407 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.403+0000 7ffa181fa640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa101008c0 0x7ffa1019d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:41.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.403+0000 7ffa181fa640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1019d860 con 0x7ffa100fff00 2024-09-13T17:06:41.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.403+0000 7ffa181fa640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1019d9d0 con 0x7ffa100fed00 2024-09-13T17:06:41.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.403+0000 7ffa181fa640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1019db90 con 0x7ffa101008c0 2024-09-13T17:06:41.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.404+0000 7ffa16797640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa101008c0 0x7ffa1019d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:41.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.404+0000 7ffa16797640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa101008c0 0x7ffa1019d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45614/0 (socket says 172.21.15.149:45614) 2024-09-13T17:06:41.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.404+0000 7ffa16797640 1 -- 172.21.15.149:0/965535944 learned_addr learned my addr 172.21.15.149:0/965535944 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-13T17:06:41.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.404+0000 7ffa15795640 1 --2- 172.21.15.149:0/965535944 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa100fff00 0x7ffa1019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:41.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.404+0000 7ffa15f96640 1 --2- 172.21.15.149:0/965535944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa100fed00 0x7ffa10069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:41.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.404+0000 7ffa16797640 1 -- 172.21.15.149:0/965535944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa100fed00 msgr2=0x7ffa10069280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:41.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.404+0000 7ffa16797640 1 --2- 172.21.15.149:0/965535944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa100fed00 0x7ffa10069280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:41.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.404+0000 7ffa16797640 1 -- 172.21.15.149:0/965535944 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa100fff00 msgr2=0x7ffa1019aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:41.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.404+0000 7ffa16797640 1 --2- 172.21.15.149:0/965535944 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa100fff00 0x7ffa1019aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:41.409 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.404+0000 7ffa16797640 1 -- 172.21.15.149:0/965535944 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa08009900 con 0x7ffa101008c0 2024-09-13T17:06:41.409 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.404+0000 7ffa15795640 1 --2- 172.21.15.149:0/965535944 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa100fff00 0x7ffa1019aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:06:41.409 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.404+0000 7ffa16797640 1 --2- 172.21.15.149:0/965535944 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa101008c0 0x7ffa1019d080 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffa0802aeb0 tx=0x7ffa08003c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:41.409 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.404+0000 7ffa06ffd640 1 -- 172.21.15.149:0/965535944 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa080307c0 con 0x7ffa101008c0 2024-09-13T17:06:41.409 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.404+0000 7ffa06ffd640 1 -- 172.21.15.149:0/965535944 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffa08040070 con 0x7ffa101008c0 2024-09-13T17:06:41.409 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.404+0000 7ffa181fa640 1 -- 172.21.15.149:0/965535944 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa1019ddb0 con 0x7ffa101008c0 2024-09-13T17:06:41.409 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.404+0000 7ffa06ffd640 1 -- 172.21.15.149:0/965535944 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa080046c0 con 0x7ffa101008c0 2024-09-13T17:06:41.409 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.404+0000 7ffa181fa640 1 -- 172.21.15.149:0/965535944 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa1019e2b0 con 0x7ffa101008c0 2024-09-13T17:06:41.409 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.405+0000 7ffa181fa640 1 -- 172.21.15.149:0/965535944 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa101060a0 con 0x7ffa101008c0 2024-09-13T17:06:41.410 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.406+0000 7ffa06ffd640 1 -- 172.21.15.149:0/965535944 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7ffa08042030 con 0x7ffa101008c0 2024-09-13T17:06:41.410 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.407+0000 7ffa06ffd640 1 --2- 172.21.15.149:0/965535944 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff9fc0a0ff0 0x7ff9fc0a34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:06:41.410 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.407+0000 7ffa06ffd640 1 -- 172.21.15.149:0/965535944 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2309+0+0 (secure 0 0 0) 0x7ffa080ecaa0 con 0x7ffa101008c0 2024-09-13T17:06:41.410 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.407+0000 7ffa15f96640 1 --2- 172.21.15.149:0/965535944 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff9fc0a0ff0 0x7ff9fc0a34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:06:41.410 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.408+0000 7ffa15f96640 1 --2- 172.21.15.149:0/965535944 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff9fc0a0ff0 0x7ff9fc0a34b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c0058c0 tx=0x7ffa0c005c80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:06:41.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.411+0000 7ffa06ffd640 1 -- 172.21.15.149:0/965535944 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ffa080b7a80 con 0x7ffa101008c0 2024-09-13T17:06:41.585 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:41.582+0000 7ffa181fa640 1 -- 172.21.15.149:0/965535944 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa1002c450 con 0x7ff9fc0a0ff0 2024-09-13T17:06:41.585 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:41 smithi149 ceph-mon[35496]: Detected new or changed devices on smithi118 2024-09-13T17:06:41.585 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:41 smithi149 ceph-mon[35496]: Adjusting osd_memory_target on smithi118 to 17088M 2024-09-13T17:06:41.585 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:41 smithi149 ceph-mon[35496]: pgmap v59: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:06:41.585 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:41 smithi149 ceph-mon[35496]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T17:06:41.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:41 smithi118 ceph-mon[34374]: Detected new or changed devices on smithi118 2024-09-13T17:06:41.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:41 smithi118 ceph-mon[34374]: Adjusting osd_memory_target on smithi118 to 17088M 2024-09-13T17:06:41.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:41 smithi118 ceph-mon[34374]: pgmap v59: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:06:41.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:41 smithi118 ceph-mon[34374]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T17:06:41.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:41 smithi087 ceph-mon[30934]: Detected new or changed devices on smithi118 2024-09-13T17:06:41.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:41 smithi087 ceph-mon[30934]: Adjusting osd_memory_target on smithi118 to 17088M 2024-09-13T17:06:41.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:41 smithi087 ceph-mon[30934]: pgmap v59: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:06:41.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:41 smithi087 ceph-mon[30934]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T17:06:42.585 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:42 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:06:42.585 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:42 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:06:42.585 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:42 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:06:42.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:42 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:06:42.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:42 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:06:42.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:42 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:06:42.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:42 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:06:42.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:42 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:06:42.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:42 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:06:43.490 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:43 smithi149 ceph-mon[35496]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:06:43.490 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:43 smithi149 ceph-mon[35496]: pgmap v61: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:06:43.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:43 smithi118 ceph-mon[34374]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:06:43.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:43 smithi118 ceph-mon[34374]: pgmap v61: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:06:43.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:43 smithi087 ceph-mon[30934]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:06:43.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:43 smithi087 ceph-mon[30934]: pgmap v61: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:06:44.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:44 smithi149 ceph-mon[35496]: from='client.? 172.21.15.149:0/2395242812' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba64549e-d736-426f-b466-f569af5f16d3"}]: dispatch 2024-09-13T17:06:44.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:44 smithi149 ceph-mon[35496]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba64549e-d736-426f-b466-f569af5f16d3"}]: dispatch 2024-09-13T17:06:44.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:44 smithi149 ceph-mon[35496]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ba64549e-d736-426f-b466-f569af5f16d3"}]': finished 2024-09-13T17:06:44.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:44 smithi149 ceph-mon[35496]: osdmap e15: 3 total, 2 up, 3 in 2024-09-13T17:06:44.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:44 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:06:44.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:44 smithi118 ceph-mon[34374]: from='client.? 172.21.15.149:0/2395242812' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba64549e-d736-426f-b466-f569af5f16d3"}]: dispatch 2024-09-13T17:06:44.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:44 smithi118 ceph-mon[34374]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba64549e-d736-426f-b466-f569af5f16d3"}]: dispatch 2024-09-13T17:06:44.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:44 smithi118 ceph-mon[34374]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ba64549e-d736-426f-b466-f569af5f16d3"}]': finished 2024-09-13T17:06:44.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:44 smithi118 ceph-mon[34374]: osdmap e15: 3 total, 2 up, 3 in 2024-09-13T17:06:44.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:44 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:06:44.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:44 smithi087 ceph-mon[30934]: from='client.? 172.21.15.149:0/2395242812' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba64549e-d736-426f-b466-f569af5f16d3"}]: dispatch 2024-09-13T17:06:44.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:44 smithi087 ceph-mon[30934]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba64549e-d736-426f-b466-f569af5f16d3"}]: dispatch 2024-09-13T17:06:44.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:44 smithi087 ceph-mon[30934]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ba64549e-d736-426f-b466-f569af5f16d3"}]': finished 2024-09-13T17:06:44.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:44 smithi087 ceph-mon[30934]: osdmap e15: 3 total, 2 up, 3 in 2024-09-13T17:06:44.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:44 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:06:45.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:45 smithi149 ceph-mon[35496]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:06:45.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:45 smithi149 ceph-mon[35496]: from='client.? 172.21.15.149:0/3926063562' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:06:45.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:45 smithi118 ceph-mon[34374]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:06:45.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:45 smithi118 ceph-mon[34374]: from='client.? 172.21.15.149:0/3926063562' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:06:45.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:45 smithi087 ceph-mon[30934]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:06:45.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:45 smithi087 ceph-mon[30934]: from='client.? 172.21.15.149:0/3926063562' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:06:47.531 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:47 smithi087 ceph-mon[30934]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:06:47.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:47 smithi149 ceph-mon[35496]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:06:47.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:47 smithi118 ceph-mon[34374]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:06:49.557 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:49 smithi149 ceph-mon[35496]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:06:49.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:49 smithi118 ceph-mon[34374]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:06:49.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:49 smithi087 ceph-mon[30934]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:06:51.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:51 smithi149 ceph-mon[35496]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:06:51.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:51 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T17:06:51.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:51 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:06:51.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:51 smithi118 ceph-mon[34374]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:06:51.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:51 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T17:06:51.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:51 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:06:51.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:51 smithi087 ceph-mon[30934]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:06:51.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:51 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T17:06:51.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:51 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:06:52.407 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:52 smithi149 ceph-mon[35496]: Deploying daemon osd.2 on smithi149 2024-09-13T17:06:52.408 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:52 smithi149 ceph-mon[35496]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:06:52.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:52 smithi118 ceph-mon[34374]: Deploying daemon osd.2 on smithi149 2024-09-13T17:06:52.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:52 smithi118 ceph-mon[34374]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:06:52.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:52 smithi087 ceph-mon[30934]: Deploying daemon osd.2 on smithi149 2024-09-13T17:06:52.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:52 smithi087 ceph-mon[30934]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:06:55.241 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:55 smithi149 ceph-mon[35496]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:06:55.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:55 smithi118 ceph-mon[34374]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:06:55.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:55 smithi087 ceph-mon[30934]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:06:56.150 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:56 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:06:56.151 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:56 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:56.151 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:56 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:56.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:56 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:06:56.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:56 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:56.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:56 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:56.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:56 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:06:56.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:56 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:56.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:56 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:57.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:57 smithi149 ceph-mon[35496]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:06:57.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:57 smithi118 ceph-mon[34374]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:06:57.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:57 smithi087 ceph-mon[30934]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:06:59.027 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:59.026+0000 7ffa06ffd640 1 -- 172.21.15.149:0/965535944 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ffa1002c450 con 0x7ff9fc0a0ff0 2024-09-13T17:06:59.027 INFO:teuthology.orchestra.run.smithi149.stdout:Created osd(s) 2 on host 'smithi149' 2024-09-13T17:06:59.029 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:59.028+0000 7ffa181fa640 1 -- 172.21.15.149:0/965535944 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff9fc0a0ff0 msgr2=0x7ff9fc0a34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:59.029 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:59.028+0000 7ffa181fa640 1 --2- 172.21.15.149:0/965535944 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff9fc0a0ff0 0x7ff9fc0a34b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c0058c0 tx=0x7ffa0c005c80 comp rx=0 tx=0).stop 2024-09-13T17:06:59.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:59.028+0000 7ffa181fa640 1 -- 172.21.15.149:0/965535944 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa101008c0 msgr2=0x7ffa1019d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:06:59.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:59.028+0000 7ffa181fa640 1 --2- 172.21.15.149:0/965535944 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa101008c0 0x7ffa1019d080 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffa0802aeb0 tx=0x7ffa08003c20 comp rx=0 tx=0).stop 2024-09-13T17:06:59.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:59.028+0000 7ffa181fa640 1 -- 172.21.15.149:0/965535944 shutdown_connections 2024-09-13T17:06:59.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:59.028+0000 7ffa181fa640 1 --2- 172.21.15.149:0/965535944 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff9fc0a0ff0 0x7ff9fc0a34b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:59.028+0000 7ffa181fa640 1 --2- 172.21.15.149:0/965535944 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa101008c0 0x7ffa1019d080 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:59.028+0000 7ffa181fa640 1 --2- 172.21.15.149:0/965535944 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa100fff00 0x7ffa1019aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:59.028+0000 7ffa181fa640 1 --2- 172.21.15.149:0/965535944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa100fed00 0x7ffa10069280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:06:59.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:59.028+0000 7ffa181fa640 1 -- 172.21.15.149:0/965535944 >> 172.21.15.149:0/965535944 conn(0x7ffa100fa490 msgr2=0x7ffa10103270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:06:59.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:59.029+0000 7ffa181fa640 1 -- 172.21.15.149:0/965535944 shutdown_connections 2024-09-13T17:06:59.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:06:59.029+0000 7ffa181fa640 1 -- 172.21.15.149:0/965535944 wait complete. 2024-09-13T17:06:59.255 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:58 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:59.255 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:58 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:59.255 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:58 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:06:59.255 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:58 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:06:59.255 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:58 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:59.255 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:06:58 smithi087 ceph-mon[30934]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:06:59.335 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:58 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:59.335 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:58 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:59.335 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:58 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:06:59.336 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:58 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:06:59.336 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:58 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:59.336 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:06:58 smithi149 ceph-mon[35496]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:06:59.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:58 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:59.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:58 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:59.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:58 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:06:59.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:58 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:06:59.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:58 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:06:59.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:06:58 smithi118 ceph-mon[34374]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:06:59.691 DEBUG:teuthology.orchestra.run.smithi149:osd.2> sudo journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.2.service 2024-09-13T17:06:59.693 INFO:tasks.cephadm:Deploying osd.3 on smithi087 with /dev/vg_nvme/lv_3... 2024-09-13T17:06:59.693 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-09-13T17:06:59.903 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:07:00.275 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:00 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:07:00.275 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:00 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:00.276 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:00 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:00.276 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:00 smithi087 ceph-mon[30934]: from='osd.2 [v2:172.21.15.149:6800/2774581686,v1:172.21.15.149:6801/2774581686]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T17:07:00.276 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:00 smithi087 ceph-mon[30934]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T17:07:00.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:00 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:07:00.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:00 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:00.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:00 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:00.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:00 smithi149 ceph-mon[35496]: from='osd.2 [v2:172.21.15.149:6800/2774581686,v1:172.21.15.149:6801/2774581686]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T17:07:00.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:00 smithi149 ceph-mon[35496]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T17:07:00.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:00 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:07:00.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:00 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:00.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:00 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:00.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:00 smithi118 ceph-mon[34374]: from='osd.2 [v2:172.21.15.149:6800/2774581686,v1:172.21.15.149:6801/2774581686]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T17:07:00.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:00 smithi118 ceph-mon[34374]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T17:07:01.158 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:01 smithi149 ceph-mon[35496]: pgmap v71: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:07:01.158 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:01 smithi149 ceph-mon[35496]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T17:07:01.158 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:01 smithi149 ceph-mon[35496]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T17:07:01.158 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:01 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:07:01.158 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:01 smithi149 ceph-mon[35496]: from='osd.2 [v2:172.21.15.149:6800/2774581686,v1:172.21.15.149:6801/2774581686]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T17:07:01.158 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:01 smithi149 ceph-mon[35496]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T17:07:01.159 INFO:journalctl@ceph.osd.2.smithi149.stdout:Sep 13 17:07:01 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-2[40664]: 2024-09-13T17:07:01.040+0000 7fe79b319640 -1 osd.2 0 waiting for initial osdmap 2024-09-13T17:07:01.159 INFO:journalctl@ceph.osd.2.smithi149.stdout:Sep 13 17:07:01 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-2[40664]: 2024-09-13T17:07:01.043+0000 7fe797142640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:07:01.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:01 smithi118 ceph-mon[34374]: pgmap v71: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:07:01.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:01 smithi118 ceph-mon[34374]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T17:07:01.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:01 smithi118 ceph-mon[34374]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T17:07:01.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:01 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:07:01.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:01 smithi118 ceph-mon[34374]: from='osd.2 [v2:172.21.15.149:6800/2774581686,v1:172.21.15.149:6801/2774581686]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T17:07:01.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:01 smithi118 ceph-mon[34374]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T17:07:01.400 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:01 smithi087 ceph-mon[30934]: pgmap v71: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:07:01.400 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:01 smithi087 ceph-mon[30934]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T17:07:01.400 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:01 smithi087 ceph-mon[30934]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T17:07:01.400 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:01 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:07:01.400 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:01 smithi087 ceph-mon[30934]: from='osd.2 [v2:172.21.15.149:6800/2774581686,v1:172.21.15.149:6801/2774581686]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T17:07:01.400 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:01 smithi087 ceph-mon[30934]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T17:07:01.783 INFO:teuthology.orchestra.run.smithi087.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-09-13T17:07:01.862 INFO:teuthology.orchestra.run.smithi087.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-09-13T17:07:01.876 INFO:teuthology.orchestra.run.smithi087.stderr: stderr: 10+0 records in 2024-09-13T17:07:01.876 INFO:teuthology.orchestra.run.smithi087.stderr:10+0 records out 2024-09-13T17:07:01.876 INFO:teuthology.orchestra.run.smithi087.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0118203 s, 887 MB/s 2024-09-13T17:07:01.876 INFO:teuthology.orchestra.run.smithi087.stderr:--> Zapping successful for: 2024-09-13T17:07:02.181 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:02 smithi149 ceph-mon[35496]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-09-13T17:07:02.181 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:02 smithi149 ceph-mon[35496]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T17:07:02.181 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:02 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:07:02.182 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:02 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:07:02.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:02 smithi118 ceph-mon[34374]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-09-13T17:07:02.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:02 smithi118 ceph-mon[34374]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T17:07:02.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:02 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:07:02.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:02 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:07:02.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:02 smithi087 ceph-mon[30934]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-09-13T17:07:02.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:02 smithi087 ceph-mon[30934]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T17:07:02.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:02 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:07:02.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:02 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:07:02.557 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi087:vg_nvme/lv_3 2024-09-13T17:07:02.780 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:07:03.123 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:03 smithi087 ceph-mon[30934]: purged_snaps scrub starts 2024-09-13T17:07:03.123 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:03 smithi087 ceph-mon[30934]: purged_snaps scrub ok 2024-09-13T17:07:03.123 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:03 smithi087 ceph-mon[30934]: pgmap v74: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:07:03.123 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:03 smithi087 ceph-mon[30934]: osd.2 [v2:172.21.15.149:6800/2774581686,v1:172.21.15.149:6801/2774581686] boot 2024-09-13T17:07:03.123 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:03 smithi087 ceph-mon[30934]: osdmap e18: 3 total, 3 up, 3 in 2024-09-13T17:07:03.123 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:03 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:07:03.124 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:03 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-13T17:07:03.124 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:03 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:03.124 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:03 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:03.124 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:03 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:07:03.124 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:03 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:03.124 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:03 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:03.124 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:03 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:07:03.124 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:03 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:03.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:03 smithi149 ceph-mon[35496]: purged_snaps scrub starts 2024-09-13T17:07:03.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:03 smithi149 ceph-mon[35496]: purged_snaps scrub ok 2024-09-13T17:07:03.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:03 smithi149 ceph-mon[35496]: pgmap v74: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:07:03.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:03 smithi149 ceph-mon[35496]: osd.2 [v2:172.21.15.149:6800/2774581686,v1:172.21.15.149:6801/2774581686] boot 2024-09-13T17:07:03.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:03 smithi149 ceph-mon[35496]: osdmap e18: 3 total, 3 up, 3 in 2024-09-13T17:07:03.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:03 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:07:03.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:03 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-13T17:07:03.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:03 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:03.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:03 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:03.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:03 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:07:03.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:03 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:03.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:03 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:03.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:03 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:07:03.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:03 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:03.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:03 smithi118 ceph-mon[34374]: purged_snaps scrub starts 2024-09-13T17:07:03.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:03 smithi118 ceph-mon[34374]: purged_snaps scrub ok 2024-09-13T17:07:03.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:03 smithi118 ceph-mon[34374]: pgmap v74: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:07:03.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:03 smithi118 ceph-mon[34374]: osd.2 [v2:172.21.15.149:6800/2774581686,v1:172.21.15.149:6801/2774581686] boot 2024-09-13T17:07:03.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:03 smithi118 ceph-mon[34374]: osdmap e18: 3 total, 3 up, 3 in 2024-09-13T17:07:03.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:03 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:07:03.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:03 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-13T17:07:03.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:03 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:03.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:03 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:03.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:03 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:07:03.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:03 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:03.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:03 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:03.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:03 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:07:03.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:03 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:04.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:04 smithi087 ceph-mon[30934]: Detected new or changed devices on smithi149 2024-09-13T17:07:04.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:04 smithi087 ceph-mon[30934]: Adjusting osd_memory_target on smithi149 to 5815M 2024-09-13T17:07:04.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:04 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-13T17:07:04.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:04 smithi087 ceph-mon[30934]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T17:07:04.210 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:04 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T17:07:04.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:04 smithi149 ceph-mon[35496]: Detected new or changed devices on smithi149 2024-09-13T17:07:04.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:04 smithi149 ceph-mon[35496]: Adjusting osd_memory_target on smithi149 to 5815M 2024-09-13T17:07:04.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:04 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-13T17:07:04.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:04 smithi149 ceph-mon[35496]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T17:07:04.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:04 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T17:07:04.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:04 smithi118 ceph-mon[34374]: Detected new or changed devices on smithi149 2024-09-13T17:07:04.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:04 smithi118 ceph-mon[34374]: Adjusting osd_memory_target on smithi149 to 5815M 2024-09-13T17:07:04.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:04 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-13T17:07:04.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:04 smithi118 ceph-mon[34374]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T17:07:04.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:04 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T17:07:04.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.421+0000 7f788c551640 1 -- 172.21.15.87:0/2052994488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7884100f70 msgr2=0x7f78841013f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:04.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.421+0000 7f788c551640 1 --2- 172.21.15.87:0/2052994488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7884100f70 0x7f78841013f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7874009900 tx=0x7f787402a410 comp rx=0 tx=0).stop 2024-09-13T17:07:04.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.421+0000 7f788c551640 1 -- 172.21.15.87:0/2052994488 shutdown_connections 2024-09-13T17:07:04.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.421+0000 7f788c551640 1 --2- 172.21.15.87:0/2052994488 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7884101930 0x7f7884108250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:04.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.421+0000 7f788c551640 1 --2- 172.21.15.87:0/2052994488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7884100f70 0x7f78841013f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:04.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.421+0000 7f788c551640 1 --2- 172.21.15.87:0/2052994488 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78840ffe10 0x7f7884100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:04.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.421+0000 7f788c551640 1 -- 172.21.15.87:0/2052994488 >> 172.21.15.87:0/2052994488 conn(0x7f78840fb5a0 msgr2=0x7f78840fd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:04.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.421+0000 7f788c551640 1 -- 172.21.15.87:0/2052994488 shutdown_connections 2024-09-13T17:07:04.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.421+0000 7f788c551640 1 -- 172.21.15.87:0/2052994488 wait complete. 2024-09-13T17:07:04.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.421+0000 7f788c551640 1 Processor -- start 2024-09-13T17:07:04.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.422+0000 7f788c551640 1 -- start start 2024-09-13T17:07:04.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.422+0000 7f788c551640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78840ffe10 0x7f7884074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:04.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.422+0000 7f788c551640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7884100f70 0x7f78840728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:04.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.422+0000 7f788c551640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7884101930 0x7f7884072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:04.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.422+0000 7f788c551640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7884073570 con 0x7f7884101930 2024-09-13T17:07:04.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.422+0000 7f788c551640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78840736e0 con 0x7f78840ffe10 2024-09-13T17:07:04.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.422+0000 7f788c551640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788419fdc0 con 0x7f7884100f70 2024-09-13T17:07:04.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.422+0000 7f788aaee640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7884101930 0x7f7884072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:04.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.422+0000 7f788aaee640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7884101930 0x7f7884072de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40008/0 (socket says 172.21.15.87:40008) 2024-09-13T17:07:04.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.422+0000 7f788aaee640 1 -- 172.21.15.87:0/2273447808 learned_addr learned my addr 172.21.15.87:0/2273447808 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:07:04.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.422+0000 7f788a2ed640 1 --2- 172.21.15.87:0/2273447808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78840ffe10 0x7f7884074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:04.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.422+0000 7f7889aec640 1 --2- 172.21.15.87:0/2273447808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7884100f70 0x7f78840728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:04.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.422+0000 7f788aaee640 1 -- 172.21.15.87:0/2273447808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7884100f70 msgr2=0x7f78840728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:04.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.422+0000 7f788aaee640 1 --2- 172.21.15.87:0/2273447808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7884100f70 0x7f78840728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:04.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.422+0000 7f788aaee640 1 -- 172.21.15.87:0/2273447808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78840ffe10 msgr2=0x7f7884074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:04.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.422+0000 7f788aaee640 1 --2- 172.21.15.87:0/2273447808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78840ffe10 0x7f7884074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:04.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.422+0000 7f788aaee640 1 -- 172.21.15.87:0/2273447808 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7874009560 con 0x7f7884101930 2024-09-13T17:07:04.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.422+0000 7f788a2ed640 1 --2- 172.21.15.87:0/2273447808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78840ffe10 0x7f7884074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:07:04.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.422+0000 7f788aaee640 1 --2- 172.21.15.87:0/2273447808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7884101930 0x7f7884072de0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f787c00eb00 tx=0x7f787c009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:04.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.422+0000 7f787b7fe640 1 -- 172.21.15.87:0/2273447808 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c00ce10 con 0x7f7884101930 2024-09-13T17:07:04.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.422+0000 7f787b7fe640 1 -- 172.21.15.87:0/2273447808 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f787c005020 con 0x7f7884101930 2024-09-13T17:07:04.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.423+0000 7f788c551640 1 -- 172.21.15.87:0/2273447808 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78841a0070 con 0x7f7884101930 2024-09-13T17:07:04.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.423+0000 7f787b7fe640 1 -- 172.21.15.87:0/2273447808 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c0116b0 con 0x7f7884101930 2024-09-13T17:07:04.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.423+0000 7f788c551640 1 -- 172.21.15.87:0/2273447808 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78841a0570 con 0x7f7884101930 2024-09-13T17:07:04.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.424+0000 7f788c551640 1 -- 172.21.15.87:0/2273447808 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7884107290 con 0x7f7884101930 2024-09-13T17:07:04.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.425+0000 7f787b7fe640 1 -- 172.21.15.87:0/2273447808 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7f787c005190 con 0x7f7884101930 2024-09-13T17:07:04.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.425+0000 7f787b7fe640 1 --2- 172.21.15.87:0/2273447808 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f78700a0ff0 0x7f78700a34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:04.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.425+0000 7f788a2ed640 1 --2- 172.21.15.87:0/2273447808 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f78700a0ff0 0x7f78700a34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:04.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.425+0000 7f787b7fe640 1 -- 172.21.15.87:0/2273447808 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3237+0+0 (secure 0 0 0) 0x7f787c0cba40 con 0x7f7884101930 2024-09-13T17:07:04.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.426+0000 7f788a2ed640 1 --2- 172.21.15.87:0/2273447808 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f78700a0ff0 0x7f78700a34b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f78800058c0 tx=0x7f7880005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:04.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.429+0000 7f787b7fe640 1 -- 172.21.15.87:0/2273447808 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f787c096680 con 0x7f7884101930 2024-09-13T17:07:04.478 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 13 17:07:04 smithi087 sudo[50046]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T17:07:04.479 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 13 17:07:04 smithi087 sudo[50046]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T17:07:04.479 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 13 17:07:04 smithi087 sudo[50046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T17:07:04.479 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 13 17:07:04 smithi087 sudo[50046]: pam_unix(sudo:session): session closed for user root 2024-09-13T17:07:04.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:04.605+0000 7f788c551640 1 -- 172.21.15.87:0/2273447808 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f788402c480 con 0x7f78700a0ff0 2024-09-13T17:07:04.973 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 13 17:07:04 smithi087 sudo[50120]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T17:07:04.973 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 13 17:07:04 smithi087 sudo[50120]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T17:07:04.973 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 13 17:07:04 smithi087 sudo[50120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T17:07:04.973 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 13 17:07:04 smithi087 sudo[50120]: pam_unix(sudo:session): session closed for user root 2024-09-13T17:07:05.196 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:05 smithi118 ceph-mon[34374]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:07:05.197 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:05 smithi118 ceph-mon[34374]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T17:07:05.197 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:05 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T17:07:05.197 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:05 smithi118 ceph-mon[34374]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T17:07:05.197 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:05 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:07:05.197 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:05 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:07:05.197 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:05 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:05.197 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:05 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:05.197 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 13 17:07:04 smithi118 sudo[42958]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T17:07:05.197 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 13 17:07:04 smithi118 sudo[42958]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T17:07:05.197 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 13 17:07:04 smithi118 sudo[42958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T17:07:05.198 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 13 17:07:04 smithi118 sudo[42958]: pam_unix(sudo:session): session closed for user root 2024-09-13T17:07:05.198 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 13 17:07:05 smithi118 sudo[42961]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T17:07:05.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:05 smithi087 ceph-mon[30934]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:07:05.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:05 smithi087 ceph-mon[30934]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T17:07:05.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:05 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T17:07:05.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:05 smithi087 ceph-mon[30934]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T17:07:05.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:05 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:07:05.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:05 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:07:05.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:05 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:05.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:05 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:05.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:05 smithi149 ceph-mon[35496]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:07:05.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:05 smithi149 ceph-mon[35496]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T17:07:05.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:05 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T17:07:05.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:05 smithi149 ceph-mon[35496]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T17:07:05.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:05 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:07:05.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:05 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:07:05.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:05 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:05.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:05 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:05.613 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 13 17:07:05 smithi118 sudo[42961]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T17:07:05.613 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 13 17:07:05 smithi118 sudo[42961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T17:07:05.613 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 13 17:07:05 smithi118 sudo[42961]: pam_unix(sudo:session): session closed for user root 2024-09-13T17:07:05.722 INFO:journalctl@ceph.osd.2.smithi149.stdout:Sep 13 17:07:05 smithi149 sudo[44693]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T17:07:05.722 INFO:journalctl@ceph.osd.2.smithi149.stdout:Sep 13 17:07:05 smithi149 sudo[44693]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T17:07:05.722 INFO:journalctl@ceph.osd.2.smithi149.stdout:Sep 13 17:07:05 smithi149 sudo[44693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T17:07:05.722 INFO:journalctl@ceph.osd.2.smithi149.stdout:Sep 13 17:07:05 smithi149 sudo[44693]: pam_unix(sudo:session): session closed for user root 2024-09-13T17:07:05.722 INFO:journalctl@ceph.osd.2.smithi149.stdout:Sep 13 17:07:05 smithi149 sudo[44696]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T17:07:06.092 INFO:journalctl@ceph.osd.2.smithi149.stdout:Sep 13 17:07:05 smithi149 sudo[44696]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T17:07:06.092 INFO:journalctl@ceph.osd.2.smithi149.stdout:Sep 13 17:07:05 smithi149 sudo[44696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T17:07:06.092 INFO:journalctl@ceph.osd.2.smithi149.stdout:Sep 13 17:07:05 smithi149 sudo[44696]: pam_unix(sudo:session): session closed for user root 2024-09-13T17:07:06.228 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:05 smithi087 sudo[50225]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T17:07:06.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:05 smithi087 sudo[50225]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T17:07:06.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:05 smithi087 sudo[50225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T17:07:06.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:06 smithi087 sudo[50225]: pam_unix(sudo:session): session closed for user root 2024-09-13T17:07:06.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:06 smithi118 ceph-mon[34374]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:07:06.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:06 smithi118 ceph-mon[34374]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T17:07:06.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:06 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:06.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:06 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:06.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:06 smithi118 ceph-mon[34374]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T17:07:06.616 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:06 smithi087 sudo[50239]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T17:07:06.616 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:06 smithi087 sudo[50239]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T17:07:06.616 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:06 smithi087 sudo[50239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T17:07:06.616 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:06 smithi087 sudo[50239]: pam_unix(sudo:session): session closed for user root 2024-09-13T17:07:06.616 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:06 smithi087 ceph-mon[30934]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:07:06.616 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:06 smithi087 ceph-mon[30934]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T17:07:06.616 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:06 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:06.616 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:06 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:06.616 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:06 smithi087 ceph-mon[30934]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T17:07:06.754 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:06 smithi149 sudo[44699]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T17:07:06.754 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:06 smithi149 sudo[44699]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T17:07:06.754 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:06 smithi149 sudo[44699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T17:07:06.754 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:06 smithi149 sudo[44699]: pam_unix(sudo:session): session closed for user root 2024-09-13T17:07:06.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:06.769+0000 7f787b7fe640 1 -- 172.21.15.87:0/2273447808 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f787c096a50 con 0x7f7884101930 2024-09-13T17:07:07.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:06 smithi149 sudo[44702]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T17:07:07.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:06 smithi149 sudo[44702]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T17:07:07.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:06 smithi149 sudo[44702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T17:07:07.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:06 smithi149 sudo[44702]: pam_unix(sudo:session): session closed for user root 2024-09-13T17:07:07.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:06 smithi149 ceph-mon[35496]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:07:07.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:06 smithi149 ceph-mon[35496]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T17:07:07.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:06 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:07.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:06 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:07.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:06 smithi149 ceph-mon[35496]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T17:07:07.251 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:06 smithi118 sudo[42976]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T17:07:07.251 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:06 smithi118 sudo[42976]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T17:07:07.251 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:07 smithi118 sudo[42976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T17:07:07.252 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:07 smithi118 sudo[42976]: pam_unix(sudo:session): session closed for user root 2024-09-13T17:07:07.530 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:07 smithi087 ceph-mon[30934]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:07:07.530 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:07 smithi087 ceph-mon[30934]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T17:07:07.530 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:07 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:07:07.530 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:07 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:07:07.531 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:07 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:07:07.531 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:07 smithi087 ceph-mon[30934]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T17:07:07.531 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:07 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:07:07.531 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:07 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:07:07.531 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:07 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:07:07.531 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:07 smithi087 ceph-mon[30934]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T17:07:07.531 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:07 smithi087 ceph-mon[30934]: Cluster is now healthy 2024-09-13T17:07:07.531 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:07 smithi087 ceph-mon[30934]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T17:07:07.531 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:07 smithi087 ceph-mon[30934]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T17:07:07.531 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:07 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:07:07.531 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:07 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:07:07.531 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:07 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:07:07.532 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:07 smithi087 ceph-mon[30934]: mgrmap e16: x(active, since 2m), standbys: y, z 2024-09-13T17:07:07.532 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:07 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1985253315' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d5553e5-371b-49fd-976b-9e72a97a2f79"}]: dispatch 2024-09-13T17:07:07.532 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:07 smithi087 ceph-mon[30934]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T17:07:07.532 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:07 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1985253315' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3d5553e5-371b-49fd-976b-9e72a97a2f79"}]': finished 2024-09-13T17:07:07.532 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:07 smithi087 ceph-mon[30934]: osdmap e22: 4 total, 3 up, 4 in 2024-09-13T17:07:07.532 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:07 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:07:07.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:07 smithi149 ceph-mon[35496]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:07:07.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:07 smithi149 ceph-mon[35496]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T17:07:07.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:07 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:07:07.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:07 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:07:07.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:07 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:07:07.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:07 smithi149 ceph-mon[35496]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T17:07:07.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:07 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:07:07.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:07 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:07:07.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:07 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:07:07.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:07 smithi149 ceph-mon[35496]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T17:07:07.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:07 smithi149 ceph-mon[35496]: Cluster is now healthy 2024-09-13T17:07:07.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:07 smithi149 ceph-mon[35496]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T17:07:07.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:07 smithi149 ceph-mon[35496]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T17:07:07.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:07 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:07:07.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:07 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:07:07.594 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:07 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:07:07.594 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:07 smithi149 ceph-mon[35496]: mgrmap e16: x(active, since 2m), standbys: y, z 2024-09-13T17:07:07.594 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:07 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1985253315' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d5553e5-371b-49fd-976b-9e72a97a2f79"}]: dispatch 2024-09-13T17:07:07.594 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:07 smithi149 ceph-mon[35496]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T17:07:07.594 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:07 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1985253315' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3d5553e5-371b-49fd-976b-9e72a97a2f79"}]': finished 2024-09-13T17:07:07.594 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:07 smithi149 ceph-mon[35496]: osdmap e22: 4 total, 3 up, 4 in 2024-09-13T17:07:07.594 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:07 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:07:07.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:07 smithi118 sudo[42979]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T17:07:07.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:07 smithi118 sudo[42979]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T17:07:07.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:07 smithi118 sudo[42979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T17:07:07.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:07 smithi118 sudo[42979]: pam_unix(sudo:session): session closed for user root 2024-09-13T17:07:07.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:07 smithi118 ceph-mon[34374]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:07:07.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:07 smithi118 ceph-mon[34374]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T17:07:07.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:07 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:07:07.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:07 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:07:07.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:07 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:07:07.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:07 smithi118 ceph-mon[34374]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T17:07:07.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:07 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:07:07.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:07 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:07:07.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:07 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:07:07.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:07 smithi118 ceph-mon[34374]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T17:07:07.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:07 smithi118 ceph-mon[34374]: Cluster is now healthy 2024-09-13T17:07:07.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:07 smithi118 ceph-mon[34374]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T17:07:07.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:07 smithi118 ceph-mon[34374]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T17:07:07.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:07 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:07:07.615 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:07 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:07:07.615 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:07 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:07:07.615 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:07 smithi118 ceph-mon[34374]: mgrmap e16: x(active, since 2m), standbys: y, z 2024-09-13T17:07:07.615 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:07 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1985253315' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d5553e5-371b-49fd-976b-9e72a97a2f79"}]: dispatch 2024-09-13T17:07:07.615 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:07 smithi118 ceph-mon[34374]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T17:07:07.615 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:07 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1985253315' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3d5553e5-371b-49fd-976b-9e72a97a2f79"}]': finished 2024-09-13T17:07:07.615 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:07 smithi118 ceph-mon[34374]: osdmap e22: 4 total, 3 up, 4 in 2024-09-13T17:07:07.615 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:07 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:07:08.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:08 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3942236057' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:07:08.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:08 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3942236057' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:07:08.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:08 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3942236057' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:07:09.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:09 smithi149 ceph-mon[35496]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:07:09.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:09 smithi118 ceph-mon[34374]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:07:09.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:09 smithi087 ceph-mon[30934]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:07:11.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:11 smithi087 ceph-mon[30934]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:07:11.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:11 smithi149 ceph-mon[35496]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:07:11.612 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:11 smithi118 ceph-mon[34374]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:07:12.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:12 smithi087 ceph-mon[30934]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-13T17:07:12.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:12 smithi149 ceph-mon[35496]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-13T17:07:12.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:12 smithi118 ceph-mon[34374]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-13T17:07:15.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:15 smithi087 ceph-mon[30934]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 98 KiB/s wr, 7 op/s 2024-09-13T17:07:15.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:15 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T17:07:15.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:15 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:15.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:15 smithi087 ceph-mon[30934]: Deploying daemon osd.3 on smithi087 2024-09-13T17:07:15.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:15 smithi149 ceph-mon[35496]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 98 KiB/s wr, 7 op/s 2024-09-13T17:07:15.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:15 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T17:07:15.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:15 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:15.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:15 smithi149 ceph-mon[35496]: Deploying daemon osd.3 on smithi087 2024-09-13T17:07:15.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:15 smithi118 ceph-mon[34374]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 98 KiB/s wr, 7 op/s 2024-09-13T17:07:15.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:15 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T17:07:15.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:15 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:15.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:15 smithi118 ceph-mon[34374]: Deploying daemon osd.3 on smithi087 2024-09-13T17:07:17.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:17 smithi087 ceph-mon[30934]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-13T17:07:17.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:17 smithi149 ceph-mon[35496]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-13T17:07:17.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:17 smithi118 ceph-mon[34374]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-13T17:07:19.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:19 smithi149 ceph-mon[35496]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 73 KiB/s wr, 5 op/s 2024-09-13T17:07:19.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:19 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:07:19.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:19 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:19.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:19 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:19.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:19 smithi118 ceph-mon[34374]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 73 KiB/s wr, 5 op/s 2024-09-13T17:07:19.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:19 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:07:19.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:19 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:19.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:19 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:19.457 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:19 smithi087 ceph-mon[30934]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 73 KiB/s wr, 5 op/s 2024-09-13T17:07:19.457 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:19 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:07:19.457 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:19 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:19.457 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:19 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:21.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:21 smithi149 ceph-mon[35496]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-13T17:07:21.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:21 smithi118 ceph-mon[34374]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-13T17:07:21.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:21 smithi087 ceph-mon[30934]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-13T17:07:22.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:22.564+0000 7f787b7fe640 1 -- 172.21.15.87:0/2273447808 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f788402c480 con 0x7f78700a0ff0 2024-09-13T17:07:22.566 INFO:teuthology.orchestra.run.smithi087.stdout:Created osd(s) 3 on host 'smithi087' 2024-09-13T17:07:22.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:22.567+0000 7f788c551640 1 -- 172.21.15.87:0/2273447808 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f78700a0ff0 msgr2=0x7f78700a34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:22.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:22.567+0000 7f788c551640 1 --2- 172.21.15.87:0/2273447808 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f78700a0ff0 0x7f78700a34b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f78800058c0 tx=0x7f7880005850 comp rx=0 tx=0).stop 2024-09-13T17:07:22.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:22.567+0000 7f788c551640 1 -- 172.21.15.87:0/2273447808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7884101930 msgr2=0x7f7884072de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:22.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:22.567+0000 7f788c551640 1 --2- 172.21.15.87:0/2273447808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7884101930 0x7f7884072de0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f787c00eb00 tx=0x7f787c009f60 comp rx=0 tx=0).stop 2024-09-13T17:07:22.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:22.567+0000 7f788c551640 1 -- 172.21.15.87:0/2273447808 shutdown_connections 2024-09-13T17:07:22.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:22.568+0000 7f788c551640 1 --2- 172.21.15.87:0/2273447808 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f78700a0ff0 0x7f78700a34b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:22.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:22.568+0000 7f788c551640 1 --2- 172.21.15.87:0/2273447808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7884101930 0x7f7884072de0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:22.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:22.568+0000 7f788c551640 1 --2- 172.21.15.87:0/2273447808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7884100f70 0x7f78840728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:22.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:22.568+0000 7f788c551640 1 --2- 172.21.15.87:0/2273447808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78840ffe10 0x7f7884074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:22.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:22.568+0000 7f788c551640 1 -- 172.21.15.87:0/2273447808 >> 172.21.15.87:0/2273447808 conn(0x7f78840fb5a0 msgr2=0x7f7884104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:22.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:22.568+0000 7f788c551640 1 -- 172.21.15.87:0/2273447808 shutdown_connections 2024-09-13T17:07:22.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:07:22.568+0000 7f788c551640 1 -- 172.21.15.87:0/2273447808 wait complete. 2024-09-13T17:07:22.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:22 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:22.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:22 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:22.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:22 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:22.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:22 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:07:22.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:22 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:22.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:22 smithi149 ceph-mon[35496]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-13T17:07:22.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:22 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:22.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:22 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:22.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:22 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:22.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:22 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:07:22.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:22 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:22.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:22 smithi118 ceph-mon[34374]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-13T17:07:22.876 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:22 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:22.876 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:22 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:22.876 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:22 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:22.876 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:22 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:07:22.876 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:22 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:22.876 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:22 smithi087 ceph-mon[30934]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-13T17:07:23.214 DEBUG:teuthology.orchestra.run.smithi087:osd.3> sudo journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.3.service 2024-09-13T17:07:23.216 INFO:tasks.cephadm:Deploying osd.4 on smithi118 with /dev/vg_nvme/lv_3... 2024-09-13T17:07:23.217 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-09-13T17:07:23.426 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T17:07:23.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:23 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:07:23.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:23 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:23.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:23 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:23.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:23 smithi087 ceph-mon[30934]: from='osd.3 [v2:172.21.15.87:6810/3306119066,v1:172.21.15.87:6811/3306119066]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T17:07:23.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:23 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:07:23.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:23 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:23.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:23 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:23.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:23 smithi149 ceph-mon[35496]: from='osd.3 [v2:172.21.15.87:6810/3306119066,v1:172.21.15.87:6811/3306119066]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T17:07:23.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:23 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:07:23.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:23 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:23.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:23 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:23.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:23 smithi118 ceph-mon[34374]: from='osd.3 [v2:172.21.15.87:6810/3306119066,v1:172.21.15.87:6811/3306119066]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T17:07:24.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:24 smithi087 ceph-mon[30934]: from='osd.3 [v2:172.21.15.87:6810/3306119066,v1:172.21.15.87:6811/3306119066]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T17:07:24.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:24 smithi087 ceph-mon[30934]: osdmap e23: 4 total, 3 up, 4 in 2024-09-13T17:07:24.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:24 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:07:24.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:24 smithi087 ceph-mon[30934]: from='osd.3 [v2:172.21.15.87:6810/3306119066,v1:172.21.15.87:6811/3306119066]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-13T17:07:24.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:24 smithi087 ceph-mon[30934]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:07:24.730 INFO:journalctl@ceph.osd.3.smithi087.stdout:Sep 13 17:07:24 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-3[52306]: 2024-09-13T17:07:24.576+0000 7f85b8c90640 -1 osd.3 0 waiting for initial osdmap 2024-09-13T17:07:24.730 INFO:journalctl@ceph.osd.3.smithi087.stdout:Sep 13 17:07:24 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-3[52306]: 2024-09-13T17:07:24.580+0000 7f85b4ab9640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:07:24.782 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:24 smithi118 ceph-mon[34374]: from='osd.3 [v2:172.21.15.87:6810/3306119066,v1:172.21.15.87:6811/3306119066]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T17:07:24.782 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:24 smithi118 ceph-mon[34374]: osdmap e23: 4 total, 3 up, 4 in 2024-09-13T17:07:24.782 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:24 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:07:24.782 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:24 smithi118 ceph-mon[34374]: from='osd.3 [v2:172.21.15.87:6810/3306119066,v1:172.21.15.87:6811/3306119066]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-13T17:07:24.782 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:24 smithi118 ceph-mon[34374]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:07:24.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:24 smithi149 ceph-mon[35496]: from='osd.3 [v2:172.21.15.87:6810/3306119066,v1:172.21.15.87:6811/3306119066]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T17:07:24.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:24 smithi149 ceph-mon[35496]: osdmap e23: 4 total, 3 up, 4 in 2024-09-13T17:07:24.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:24 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:07:24.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:24 smithi149 ceph-mon[35496]: from='osd.3 [v2:172.21.15.87:6810/3306119066,v1:172.21.15.87:6811/3306119066]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-13T17:07:24.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:24 smithi149 ceph-mon[35496]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:07:25.182 INFO:teuthology.orchestra.run.smithi118.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-09-13T17:07:25.294 INFO:teuthology.orchestra.run.smithi118.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-09-13T17:07:25.305 INFO:teuthology.orchestra.run.smithi118.stderr: stderr: 10+0 records in 2024-09-13T17:07:25.305 INFO:teuthology.orchestra.run.smithi118.stderr:10+0 records out 2024-09-13T17:07:25.305 INFO:teuthology.orchestra.run.smithi118.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0084437 s, 1.2 GB/s 2024-09-13T17:07:25.305 INFO:teuthology.orchestra.run.smithi118.stderr:--> Zapping successful for: 2024-09-13T17:07:25.687 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:25 smithi118 ceph-mon[34374]: from='osd.3 [v2:172.21.15.87:6810/3306119066,v1:172.21.15.87:6811/3306119066]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-09-13T17:07:25.687 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:25 smithi118 ceph-mon[34374]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T17:07:25.687 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:25 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:07:25.687 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:25 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:07:25.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:25 smithi087 ceph-mon[30934]: from='osd.3 [v2:172.21.15.87:6810/3306119066,v1:172.21.15.87:6811/3306119066]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-09-13T17:07:25.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:25 smithi087 ceph-mon[30934]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T17:07:25.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:25 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:07:25.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:25 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:07:25.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:25 smithi149 ceph-mon[35496]: from='osd.3 [v2:172.21.15.87:6810/3306119066,v1:172.21.15.87:6811/3306119066]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-09-13T17:07:25.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:25 smithi149 ceph-mon[35496]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T17:07:25.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:25 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:07:25.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:25 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:07:26.018 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi118:vg_nvme/lv_3 2024-09-13T17:07:26.215 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T17:07:26.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:26 smithi118 ceph-mon[34374]: purged_snaps scrub starts 2024-09-13T17:07:26.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:26 smithi118 ceph-mon[34374]: purged_snaps scrub ok 2024-09-13T17:07:26.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:26 smithi118 ceph-mon[34374]: osd.3 [v2:172.21.15.87:6810/3306119066,v1:172.21.15.87:6811/3306119066] boot 2024-09-13T17:07:26.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:26 smithi118 ceph-mon[34374]: osdmap e25: 4 total, 4 up, 4 in 2024-09-13T17:07:26.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:26 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:07:26.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:26 smithi118 ceph-mon[34374]: pgmap v94: 1 pgs: 1 peering; 577 KiB data, 118 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:07:26.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:26 smithi118 ceph-mon[34374]: Detected new or changed devices on smithi087 2024-09-13T17:07:26.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:26 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:26.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:26 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:26.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:26 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:07:26.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:26 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:07:26.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:26 smithi118 ceph-mon[34374]: Adjusting osd_memory_target on smithi087 to 8544M 2024-09-13T17:07:26.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:26 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:26.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:26 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:26.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:26 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:07:26.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:26 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:26.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:26 smithi149 ceph-mon[35496]: purged_snaps scrub starts 2024-09-13T17:07:26.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:26 smithi149 ceph-mon[35496]: purged_snaps scrub ok 2024-09-13T17:07:26.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:26 smithi149 ceph-mon[35496]: osd.3 [v2:172.21.15.87:6810/3306119066,v1:172.21.15.87:6811/3306119066] boot 2024-09-13T17:07:26.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:26 smithi149 ceph-mon[35496]: osdmap e25: 4 total, 4 up, 4 in 2024-09-13T17:07:26.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:26 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:07:26.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:26 smithi149 ceph-mon[35496]: pgmap v94: 1 pgs: 1 peering; 577 KiB data, 118 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:07:26.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:26 smithi149 ceph-mon[35496]: Detected new or changed devices on smithi087 2024-09-13T17:07:26.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:26 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:26.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:26 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:26.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:26 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:07:26.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:26 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:07:26.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:26 smithi149 ceph-mon[35496]: Adjusting osd_memory_target on smithi087 to 8544M 2024-09-13T17:07:26.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:26 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:26.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:26 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:26.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:26 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:07:26.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:26 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:26.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:26 smithi087 ceph-mon[30934]: purged_snaps scrub starts 2024-09-13T17:07:26.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:26 smithi087 ceph-mon[30934]: purged_snaps scrub ok 2024-09-13T17:07:26.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:26 smithi087 ceph-mon[30934]: osd.3 [v2:172.21.15.87:6810/3306119066,v1:172.21.15.87:6811/3306119066] boot 2024-09-13T17:07:26.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:26 smithi087 ceph-mon[30934]: osdmap e25: 4 total, 4 up, 4 in 2024-09-13T17:07:26.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:26 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:07:26.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:26 smithi087 ceph-mon[30934]: pgmap v94: 1 pgs: 1 peering; 577 KiB data, 118 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:07:26.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:26 smithi087 ceph-mon[30934]: Detected new or changed devices on smithi087 2024-09-13T17:07:26.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:26 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:26.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:26 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:26.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:26 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:07:26.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:26 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:07:26.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:26 smithi087 ceph-mon[30934]: Adjusting osd_memory_target on smithi087 to 8544M 2024-09-13T17:07:26.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:26 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:26.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:26 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:26.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:26 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:07:26.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:26 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:27.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.739+0000 7fd0bede9640 1 -- 172.21.15.118:0/1513087195 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0b8100890 msgr2=0x7fd0b8102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:27.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.739+0000 7fd0bede9640 1 --2- 172.21.15.118:0/1513087195 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0b8100890 0x7fd0b8102c80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac009900 tx=0x7fd0ac02a410 comp rx=0 tx=0).stop 2024-09-13T17:07:27.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.739+0000 7fd0bede9640 1 -- 172.21.15.118:0/1513087195 shutdown_connections 2024-09-13T17:07:27.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.739+0000 7fd0bede9640 1 --2- 172.21.15.118:0/1513087195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0b8105af0 0x7fd0b8107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:27.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.739+0000 7fd0bede9640 1 --2- 172.21.15.118:0/1513087195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0b81031c0 0x7fd0b81055b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:27.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.739+0000 7fd0bede9640 1 --2- 172.21.15.118:0/1513087195 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0b8100890 0x7fd0b8102c80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:27.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.739+0000 7fd0bede9640 1 -- 172.21.15.118:0/1513087195 >> 172.21.15.118:0/1513087195 conn(0x7fd0b80fa490 msgr2=0x7fd0b80fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:27.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.739+0000 7fd0bede9640 1 -- 172.21.15.118:0/1513087195 shutdown_connections 2024-09-13T17:07:27.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.739+0000 7fd0bede9640 1 -- 172.21.15.118:0/1513087195 wait complete. 2024-09-13T17:07:27.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.740+0000 7fd0bede9640 1 Processor -- start 2024-09-13T17:07:27.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.740+0000 7fd0bede9640 1 -- start start 2024-09-13T17:07:27.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.740+0000 7fd0bede9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0b8100890 0x7fd0b81001f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:27.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.740+0000 7fd0bede9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0b81031c0 0x7fd0b80fe840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:27.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.740+0000 7fd0bede9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0b8105af0 0x7fd0b80fed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:27.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.740+0000 7fd0bede9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b80ff510 con 0x7fd0b8105af0 2024-09-13T17:07:27.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.740+0000 7fd0bede9640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b80ff680 con 0x7fd0b8100890 2024-09-13T17:07:27.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.740+0000 7fd0bede9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b819fe20 con 0x7fd0b81031c0 2024-09-13T17:07:27.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.740+0000 7fd0bcb85640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0b8100890 0x7fd0b81001f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:27.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.740+0000 7fd0bcb85640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0b8100890 0x7fd0b81001f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:52872/0 (socket says 172.21.15.118:52872) 2024-09-13T17:07:27.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.740+0000 7fd0bcb85640 1 -- 172.21.15.118:0/4243306206 learned_addr learned my addr 172.21.15.118:0/4243306206 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-13T17:07:27.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.740+0000 7fd0bd386640 1 --2- 172.21.15.118:0/4243306206 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0b8105af0 0x7fd0b80fed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:27.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.740+0000 7fd0b7fff640 1 --2- 172.21.15.118:0/4243306206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0b81031c0 0x7fd0b80fe840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:27.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.741+0000 7fd0bcb85640 1 -- 172.21.15.118:0/4243306206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0b81031c0 msgr2=0x7fd0b80fe840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:27.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.741+0000 7fd0bcb85640 1 --2- 172.21.15.118:0/4243306206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0b81031c0 0x7fd0b80fe840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:27.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.741+0000 7fd0bcb85640 1 -- 172.21.15.118:0/4243306206 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0b8105af0 msgr2=0x7fd0b80fed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:27.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.741+0000 7fd0bcb85640 1 --2- 172.21.15.118:0/4243306206 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0b8105af0 0x7fd0b80fed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:27.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.741+0000 7fd0bcb85640 1 -- 172.21.15.118:0/4243306206 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ac009560 con 0x7fd0b8100890 2024-09-13T17:07:27.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.741+0000 7fd0bcb85640 1 --2- 172.21.15.118:0/4243306206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0b8100890 0x7fd0b81001f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac031460 tx=0x7fd0ac004430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:27.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.741+0000 7fd0b5ffb640 1 -- 172.21.15.118:0/4243306206 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac003800 con 0x7fd0b8100890 2024-09-13T17:07:27.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.741+0000 7fd0b5ffb640 1 -- 172.21.15.118:0/4243306206 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd0ac003e10 con 0x7fd0b8100890 2024-09-13T17:07:27.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.741+0000 7fd0bede9640 1 -- 172.21.15.118:0/4243306206 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b81a0070 con 0x7fd0b8100890 2024-09-13T17:07:27.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.741+0000 7fd0b5ffb640 1 -- 172.21.15.118:0/4243306206 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac03b3d0 con 0x7fd0b8100890 2024-09-13T17:07:27.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.741+0000 7fd0bede9640 1 -- 172.21.15.118:0/4243306206 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b81a0590 con 0x7fd0b8100890 2024-09-13T17:07:27.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.742+0000 7fd0bede9640 1 -- 172.21.15.118:0/4243306206 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0b80fbf80 con 0x7fd0b8100890 2024-09-13T17:07:27.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.743+0000 7fd0b5ffb640 1 -- 172.21.15.118:0/4243306206 <== mon.2 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd0ac03c470 con 0x7fd0b8100890 2024-09-13T17:07:27.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.744+0000 7fd0b5ffb640 1 --2- 172.21.15.118:0/4243306206 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd0a80a1080 0x7fd0a80a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:27.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.744+0000 7fd0b5ffb640 1 -- 172.21.15.118:0/4243306206 <== mon.2 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 3698+0+0 (secure 0 0 0) 0x7fd0ac0ec550 con 0x7fd0b8100890 2024-09-13T17:07:27.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.744+0000 7fd0b7fff640 1 --2- 172.21.15.118:0/4243306206 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd0a80a1080 0x7fd0a80a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:27.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.745+0000 7fd0b7fff640 1 --2- 172.21.15.118:0/4243306206 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd0a80a1080 0x7fd0a80a3540 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd0b80fff70 tx=0x7fd0a4005c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:27.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.748+0000 7fd0b5ffb640 1 -- 172.21.15.118:0/4243306206 <== mon.2 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd0ac0b6ee0 con 0x7fd0b8100890 2024-09-13T17:07:27.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:27 smithi149 ceph-mon[35496]: osdmap e26: 4 total, 4 up, 4 in 2024-09-13T17:07:27.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:27 smithi118 ceph-mon[34374]: osdmap e26: 4 total, 4 up, 4 in 2024-09-13T17:07:27.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:27.921+0000 7fd0bede9640 1 -- 172.21.15.118:0/4243306206 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0b802c450 con 0x7fd0a80a1080 2024-09-13T17:07:27.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:27 smithi087 ceph-mon[30934]: osdmap e26: 4 total, 4 up, 4 in 2024-09-13T17:07:28.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:28 smithi149 ceph-mon[35496]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T17:07:28.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:28 smithi149 ceph-mon[35496]: from='client.24203 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:07:28.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:28 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:07:28.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:28 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:07:28.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:28 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:28.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:28 smithi149 ceph-mon[35496]: pgmap v97: 1 pgs: 1 peering; 577 KiB data, 118 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:07:28.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:28 smithi118 ceph-mon[34374]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T17:07:28.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:28 smithi118 ceph-mon[34374]: from='client.24203 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:07:28.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:28 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:07:28.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:28 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:07:28.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:28 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:28.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:28 smithi118 ceph-mon[34374]: pgmap v97: 1 pgs: 1 peering; 577 KiB data, 118 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:07:28.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:28 smithi087 ceph-mon[30934]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T17:07:28.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:28 smithi087 ceph-mon[30934]: from='client.24203 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:07:28.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:28 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:07:28.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:28 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:07:28.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:28 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:28.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:28 smithi087 ceph-mon[30934]: pgmap v97: 1 pgs: 1 peering; 577 KiB data, 118 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:07:29.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:29 smithi118 ceph-mon[34374]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T17:07:29.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:29 smithi087 ceph-mon[30934]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T17:07:30.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:29 smithi149 ceph-mon[35496]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T17:07:30.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:30 smithi087 ceph-mon[30934]: osdmap e29: 4 total, 4 up, 4 in 2024-09-13T17:07:30.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:30 smithi087 ceph-mon[30934]: pgmap v100: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:07:30.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:30 smithi087 ceph-mon[30934]: from='client.? 172.21.15.118:0/1113867801' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2fbe0e27-34ec-42a6-9962-f1d8202b3159"}]: dispatch 2024-09-13T17:07:30.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:30 smithi087 ceph-mon[30934]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2fbe0e27-34ec-42a6-9962-f1d8202b3159"}]: dispatch 2024-09-13T17:07:30.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:30 smithi087 ceph-mon[30934]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2fbe0e27-34ec-42a6-9962-f1d8202b3159"}]': finished 2024-09-13T17:07:30.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:30 smithi087 ceph-mon[30934]: osdmap e30: 5 total, 4 up, 5 in 2024-09-13T17:07:30.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:30 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:07:30.778 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:30 smithi118 ceph-mon[34374]: osdmap e29: 4 total, 4 up, 4 in 2024-09-13T17:07:30.778 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:30 smithi118 ceph-mon[34374]: pgmap v100: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:07:30.778 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:30 smithi118 ceph-mon[34374]: from='client.? 172.21.15.118:0/1113867801' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2fbe0e27-34ec-42a6-9962-f1d8202b3159"}]: dispatch 2024-09-13T17:07:30.778 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:30 smithi118 ceph-mon[34374]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2fbe0e27-34ec-42a6-9962-f1d8202b3159"}]: dispatch 2024-09-13T17:07:30.779 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:30 smithi118 ceph-mon[34374]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2fbe0e27-34ec-42a6-9962-f1d8202b3159"}]': finished 2024-09-13T17:07:30.779 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:30 smithi118 ceph-mon[34374]: osdmap e30: 5 total, 4 up, 5 in 2024-09-13T17:07:30.779 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:30 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:07:31.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:30 smithi149 ceph-mon[35496]: osdmap e29: 4 total, 4 up, 4 in 2024-09-13T17:07:31.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:30 smithi149 ceph-mon[35496]: pgmap v100: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:07:31.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:30 smithi149 ceph-mon[35496]: from='client.? 172.21.15.118:0/1113867801' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2fbe0e27-34ec-42a6-9962-f1d8202b3159"}]: dispatch 2024-09-13T17:07:31.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:30 smithi149 ceph-mon[35496]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2fbe0e27-34ec-42a6-9962-f1d8202b3159"}]: dispatch 2024-09-13T17:07:31.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:30 smithi149 ceph-mon[35496]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2fbe0e27-34ec-42a6-9962-f1d8202b3159"}]': finished 2024-09-13T17:07:31.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:30 smithi149 ceph-mon[35496]: osdmap e30: 5 total, 4 up, 5 in 2024-09-13T17:07:31.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:30 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:07:31.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:31 smithi118 ceph-mon[34374]: from='client.? 172.21.15.118:0/460356544' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:07:31.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:31 smithi087 ceph-mon[30934]: from='client.? 172.21.15.118:0/460356544' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:07:32.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:31 smithi149 ceph-mon[35496]: from='client.? 172.21.15.118:0/460356544' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:07:32.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:32 smithi118 ceph-mon[34374]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 130 KiB/s, 0 objects/s recovering 2024-09-13T17:07:32.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:32 smithi087 ceph-mon[30934]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 130 KiB/s, 0 objects/s recovering 2024-09-13T17:07:33.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:32 smithi149 ceph-mon[35496]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 130 KiB/s, 0 objects/s recovering 2024-09-13T17:07:35.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:35 smithi149 ceph-mon[35496]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T17:07:35.362 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:35 smithi118 ceph-mon[34374]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T17:07:35.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:35 smithi087 ceph-mon[30934]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T17:07:37.274 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:37 smithi118 ceph-mon[34374]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-13T17:07:37.274 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T17:07:37.274 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:37 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:37.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:37 smithi149 ceph-mon[35496]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-13T17:07:37.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:37 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T17:07:37.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:37 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:37.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:37 smithi087 ceph-mon[30934]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-13T17:07:37.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:37 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T17:07:37.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:37 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:38.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:38 smithi149 ceph-mon[35496]: Deploying daemon osd.4 on smithi118 2024-09-13T17:07:38.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:38 smithi118 ceph-mon[34374]: Deploying daemon osd.4 on smithi118 2024-09-13T17:07:38.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:38 smithi087 ceph-mon[30934]: Deploying daemon osd.4 on smithi118 2024-09-13T17:07:39.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:39 smithi149 ceph-mon[35496]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-13T17:07:39.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:39 smithi118 ceph-mon[34374]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-13T17:07:39.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:39 smithi087 ceph-mon[30934]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-13T17:07:41.254 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:41 smithi118 ceph-mon[34374]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T17:07:41.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:41 smithi149 ceph-mon[35496]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T17:07:41.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:41 smithi087 ceph-mon[30934]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T17:07:43.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:43 smithi149 ceph-mon[35496]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-13T17:07:43.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:43 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:07:43.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:43 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:43.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:43 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:43.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:43 smithi118 ceph-mon[34374]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-13T17:07:43.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:43 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:07:43.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:43 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:43.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:43 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:43.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:43 smithi087 ceph-mon[30934]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-13T17:07:43.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:43 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:07:43.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:43 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:43.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:43 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:45.192 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:45 smithi118 ceph-mon[34374]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:07:45.192 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:45 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:45.192 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:45 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:45.192 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:45 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:45.192 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:45 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:07:45.192 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:45 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:45.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:45 smithi087 ceph-mon[30934]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:07:45.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:45 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:45.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:45 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:45.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:45 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:45.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:45 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:07:45.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:45 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:45.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:45.508+0000 7fd0b5ffb640 1 -- 172.21.15.118:0/4243306206 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd0b802c450 con 0x7fd0a80a1080 2024-09-13T17:07:45.509 INFO:teuthology.orchestra.run.smithi118.stdout:Created osd(s) 4 on host 'smithi118' 2024-09-13T17:07:45.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:45.510+0000 7fd0bede9640 1 -- 172.21.15.118:0/4243306206 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd0a80a1080 msgr2=0x7fd0a80a3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:45.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:45.510+0000 7fd0bede9640 1 --2- 172.21.15.118:0/4243306206 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd0a80a1080 0x7fd0a80a3540 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd0b80fff70 tx=0x7fd0a4005c60 comp rx=0 tx=0).stop 2024-09-13T17:07:45.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:45.510+0000 7fd0bede9640 1 -- 172.21.15.118:0/4243306206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0b8100890 msgr2=0x7fd0b81001f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:45.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:45.510+0000 7fd0bede9640 1 --2- 172.21.15.118:0/4243306206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0b8100890 0x7fd0b81001f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac031460 tx=0x7fd0ac004430 comp rx=0 tx=0).stop 2024-09-13T17:07:45.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:45.510+0000 7fd0bede9640 1 -- 172.21.15.118:0/4243306206 shutdown_connections 2024-09-13T17:07:45.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:45.510+0000 7fd0bede9640 1 --2- 172.21.15.118:0/4243306206 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd0a80a1080 0x7fd0a80a3540 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:45.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:45.510+0000 7fd0bede9640 1 --2- 172.21.15.118:0/4243306206 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0b8105af0 0x7fd0b80fed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:45.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:45.510+0000 7fd0bede9640 1 --2- 172.21.15.118:0/4243306206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0b81031c0 0x7fd0b80fe840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:45.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:45.510+0000 7fd0bede9640 1 --2- 172.21.15.118:0/4243306206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0b8100890 0x7fd0b81001f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:45.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:45.510+0000 7fd0bede9640 1 -- 172.21.15.118:0/4243306206 >> 172.21.15.118:0/4243306206 conn(0x7fd0b80fa490 msgr2=0x7fd0b81011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:45.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:45.510+0000 7fd0bede9640 1 -- 172.21.15.118:0/4243306206 shutdown_connections 2024-09-13T17:07:45.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:07:45.510+0000 7fd0bede9640 1 -- 172.21.15.118:0/4243306206 wait complete. 2024-09-13T17:07:45.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:45 smithi149 ceph-mon[35496]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:07:45.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:45 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:45.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:45 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:45.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:45 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:45.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:45 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:07:45.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:45 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:46.179 DEBUG:teuthology.orchestra.run.smithi118:osd.4> sudo journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.4.service 2024-09-13T17:07:46.181 INFO:tasks.cephadm:Deploying osd.5 on smithi149 with /dev/vg_nvme/lv_3... 2024-09-13T17:07:46.181 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-09-13T17:07:46.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:46 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:07:46.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:46 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:46.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:46 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:46.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:46 smithi118 ceph-mon[34374]: from='osd.4 [v2:172.21.15.118:6808/3342349890,v1:172.21.15.118:6809/3342349890]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T17:07:46.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:46 smithi118 ceph-mon[34374]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T17:07:46.390 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T17:07:46.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:46 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:07:46.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:46 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:46.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:46 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:46.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:46 smithi087 ceph-mon[30934]: from='osd.4 [v2:172.21.15.118:6808/3342349890,v1:172.21.15.118:6809/3342349890]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T17:07:46.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:46 smithi087 ceph-mon[30934]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T17:07:46.511 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:46 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:07:46.511 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:46 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:46.511 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:46 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:46.512 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:46 smithi149 ceph-mon[35496]: from='osd.4 [v2:172.21.15.118:6808/3342349890,v1:172.21.15.118:6809/3342349890]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T17:07:46.512 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:46 smithi149 ceph-mon[35496]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T17:07:47.339 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:47 smithi118 ceph-mon[34374]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:07:47.339 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:47 smithi118 ceph-mon[34374]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T17:07:47.339 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:47 smithi118 ceph-mon[34374]: osdmap e31: 5 total, 4 up, 5 in 2024-09-13T17:07:47.339 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:47 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:07:47.339 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:47 smithi118 ceph-mon[34374]: from='osd.4 [v2:172.21.15.118:6808/3342349890,v1:172.21.15.118:6809/3342349890]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2024-09-13T17:07:47.339 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:47 smithi118 ceph-mon[34374]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2024-09-13T17:07:47.380 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:47 smithi087 ceph-mon[30934]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:07:47.380 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:47 smithi087 ceph-mon[30934]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T17:07:47.380 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:47 smithi087 ceph-mon[30934]: osdmap e31: 5 total, 4 up, 5 in 2024-09-13T17:07:47.380 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:47 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:07:47.380 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:47 smithi087 ceph-mon[30934]: from='osd.4 [v2:172.21.15.118:6808/3342349890,v1:172.21.15.118:6809/3342349890]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2024-09-13T17:07:47.381 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:47 smithi087 ceph-mon[30934]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2024-09-13T17:07:47.494 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:47 smithi149 ceph-mon[35496]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:07:47.494 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:47 smithi149 ceph-mon[35496]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T17:07:47.494 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:47 smithi149 ceph-mon[35496]: osdmap e31: 5 total, 4 up, 5 in 2024-09-13T17:07:47.494 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:47 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:07:47.494 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:47 smithi149 ceph-mon[35496]: from='osd.4 [v2:172.21.15.118:6808/3342349890,v1:172.21.15.118:6809/3342349890]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2024-09-13T17:07:47.494 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:47 smithi149 ceph-mon[35496]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2024-09-13T17:07:48.197 INFO:teuthology.orchestra.run.smithi149.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-09-13T17:07:48.243 INFO:journalctl@ceph.osd.4.smithi118.stdout:Sep 13 17:07:47 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-4[45770]: 2024-09-13T17:07:47.938+0000 7fde61bba640 -1 osd.4 0 waiting for initial osdmap 2024-09-13T17:07:48.243 INFO:journalctl@ceph.osd.4.smithi118.stdout:Sep 13 17:07:47 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-4[45770]: 2024-09-13T17:07:47.945+0000 7fde599db640 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:07:48.303 INFO:teuthology.orchestra.run.smithi149.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-09-13T17:07:48.317 INFO:teuthology.orchestra.run.smithi149.stderr: stderr: 10+0 records in 2024-09-13T17:07:48.317 INFO:teuthology.orchestra.run.smithi149.stderr:10+0 records out 2024-09-13T17:07:48.317 INFO:teuthology.orchestra.run.smithi149.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.01164 s, 901 MB/s 2024-09-13T17:07:48.317 INFO:teuthology.orchestra.run.smithi149.stderr:--> Zapping successful for: 2024-09-13T17:07:48.649 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:48 smithi087 ceph-mon[30934]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2024-09-13T17:07:48.650 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:48 smithi087 ceph-mon[30934]: osdmap e32: 5 total, 4 up, 5 in 2024-09-13T17:07:48.650 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:48 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:07:48.650 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:48 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:07:48.650 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:48 smithi087 ceph-mon[30934]: from='osd.4 ' entity='osd.4' 2024-09-13T17:07:48.650 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:48 smithi087 ceph-mon[30934]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:07:48.650 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:48 smithi149 ceph-mon[35496]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2024-09-13T17:07:48.650 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:48 smithi149 ceph-mon[35496]: osdmap e32: 5 total, 4 up, 5 in 2024-09-13T17:07:48.650 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:48 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:07:48.651 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:48 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:07:48.651 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:48 smithi149 ceph-mon[35496]: from='osd.4 ' entity='osd.4' 2024-09-13T17:07:48.651 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:48 smithi149 ceph-mon[35496]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:07:48.851 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:48 smithi118 ceph-mon[34374]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2024-09-13T17:07:48.852 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:48 smithi118 ceph-mon[34374]: osdmap e32: 5 total, 4 up, 5 in 2024-09-13T17:07:48.852 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:48 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:07:48.852 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:48 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:07:48.852 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:48 smithi118 ceph-mon[34374]: from='osd.4 ' entity='osd.4' 2024-09-13T17:07:48.852 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:48 smithi118 ceph-mon[34374]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:07:49.009 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi149:vg_nvme/lv_3 2024-09-13T17:07:49.216 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T17:07:49.588 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:49 smithi149 ceph-mon[35496]: purged_snaps scrub starts 2024-09-13T17:07:49.588 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:49 smithi149 ceph-mon[35496]: purged_snaps scrub ok 2024-09-13T17:07:49.588 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:07:49.588 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:49 smithi149 ceph-mon[35496]: Detected new or changed devices on smithi118 2024-09-13T17:07:49.588 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:49.588 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:49.588 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:07:49.588 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:07:49.589 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:49 smithi149 ceph-mon[35496]: Adjusting osd_memory_target on smithi118 to 8544M 2024-09-13T17:07:49.589 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:49.589 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:49.589 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:07:49.589 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:49.589 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:49 smithi149 ceph-mon[35496]: osd.4 [v2:172.21.15.118:6808/3342349890,v1:172.21.15.118:6809/3342349890] boot 2024-09-13T17:07:49.589 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:49 smithi149 ceph-mon[35496]: osdmap e33: 5 total, 5 up, 5 in 2024-09-13T17:07:49.589 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:07:49.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:49 smithi118 ceph-mon[34374]: purged_snaps scrub starts 2024-09-13T17:07:49.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:49 smithi118 ceph-mon[34374]: purged_snaps scrub ok 2024-09-13T17:07:49.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:07:49.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:49 smithi118 ceph-mon[34374]: Detected new or changed devices on smithi118 2024-09-13T17:07:49.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:49.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:49.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:07:49.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:07:49.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:49 smithi118 ceph-mon[34374]: Adjusting osd_memory_target on smithi118 to 8544M 2024-09-13T17:07:49.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:49.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:49.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:07:49.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:49.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:49 smithi118 ceph-mon[34374]: osd.4 [v2:172.21.15.118:6808/3342349890,v1:172.21.15.118:6809/3342349890] boot 2024-09-13T17:07:49.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:49 smithi118 ceph-mon[34374]: osdmap e33: 5 total, 5 up, 5 in 2024-09-13T17:07:49.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:07:49.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:49 smithi087 ceph-mon[30934]: purged_snaps scrub starts 2024-09-13T17:07:49.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:49 smithi087 ceph-mon[30934]: purged_snaps scrub ok 2024-09-13T17:07:49.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:07:49.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:49 smithi087 ceph-mon[30934]: Detected new or changed devices on smithi118 2024-09-13T17:07:49.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:49.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:49.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:07:49.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:07:49.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:49 smithi087 ceph-mon[30934]: Adjusting osd_memory_target on smithi118 to 8544M 2024-09-13T17:07:49.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:49.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:49.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:07:49.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:07:49.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:49 smithi087 ceph-mon[30934]: osd.4 [v2:172.21.15.118:6808/3342349890,v1:172.21.15.118:6809/3342349890] boot 2024-09-13T17:07:49.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:49 smithi087 ceph-mon[30934]: osdmap e33: 5 total, 5 up, 5 in 2024-09-13T17:07:49.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:07:50.744 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.725+0000 7f02aedae640 1 -- 172.21.15.149:0/334604517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02a80fff10 msgr2=0x7f02a8100390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:50.744 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.725+0000 7f02aedae640 1 --2- 172.21.15.149:0/334604517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02a80fff10 0x7f02a8100390 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0294009900 tx=0x7f029402a410 comp rx=0 tx=0).stop 2024-09-13T17:07:50.744 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.725+0000 7f02aedae640 1 -- 172.21.15.149:0/334604517 shutdown_connections 2024-09-13T17:07:50.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.725+0000 7f02aedae640 1 --2- 172.21.15.149:0/334604517 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02a81008d0 0x7f02a8107160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.725+0000 7f02aedae640 1 --2- 172.21.15.149:0/334604517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02a80fff10 0x7f02a8100390 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.725+0000 7f02aedae640 1 --2- 172.21.15.149:0/334604517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02a80fed10 0x7f02a80ff110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.725+0000 7f02aedae640 1 -- 172.21.15.149:0/334604517 >> 172.21.15.149:0/334604517 conn(0x7f02a80fa4c0 msgr2=0x7f02a80fc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:07:50.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.725+0000 7f02aedae640 1 -- 172.21.15.149:0/334604517 shutdown_connections 2024-09-13T17:07:50.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.725+0000 7f02aedae640 1 -- 172.21.15.149:0/334604517 wait complete. 2024-09-13T17:07:50.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.726+0000 7f02aedae640 1 Processor -- start 2024-09-13T17:07:50.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.726+0000 7f02aedae640 1 -- start start 2024-09-13T17:07:50.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.726+0000 7f02aedae640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02a80fed10 0x7f02a8195df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:50.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.726+0000 7f02aedae640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02a80fff10 0x7f02a8196330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:50.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.726+0000 7f02aedae640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02a81008d0 0x7f02a819d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:50.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.726+0000 7f02aedae640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a819d8a0 con 0x7f02a80fff10 2024-09-13T17:07:50.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.726+0000 7f02aedae640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a819da10 con 0x7f02a81008d0 2024-09-13T17:07:50.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.726+0000 7f02aedae640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a819dbd0 con 0x7f02a80fed10 2024-09-13T17:07:50.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.726+0000 7f02acb4a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02a80fed10 0x7f02a8195df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:50.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.726+0000 7f02acb4a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02a80fed10 0x7f02a8195df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:44610/0 (socket says 172.21.15.149:44610) 2024-09-13T17:07:50.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.726+0000 7f02acb4a640 1 -- 172.21.15.149:0/898405265 learned_addr learned my addr 172.21.15.149:0/898405265 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-13T17:07:50.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.727+0000 7f02a7fff640 1 --2- 172.21.15.149:0/898405265 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02a80fff10 0x7f02a8196330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:50.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.727+0000 7f02acb4a640 1 -- 172.21.15.149:0/898405265 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02a81008d0 msgr2=0x7f02a819d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:50.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.727+0000 7f02acb4a640 1 --2- 172.21.15.149:0/898405265 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02a81008d0 0x7f02a819d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.727+0000 7f02acb4a640 1 -- 172.21.15.149:0/898405265 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02a80fff10 msgr2=0x7f02a8196330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:07:50.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.727+0000 7f02acb4a640 1 --2- 172.21.15.149:0/898405265 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02a80fff10 0x7f02a8196330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:07:50.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.727+0000 7f02acb4a640 1 -- 172.21.15.149:0/898405265 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0294009560 con 0x7f02a80fed10 2024-09-13T17:07:50.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.727+0000 7f02acb4a640 1 --2- 172.21.15.149:0/898405265 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02a80fed10 0x7f02a8195df0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f029c00c970 tx=0x7f029c00ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:50.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.727+0000 7f02a5ffb640 1 -- 172.21.15.149:0/898405265 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029c004220 con 0x7f02a80fed10 2024-09-13T17:07:50.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.727+0000 7f02a5ffb640 1 -- 172.21.15.149:0/898405265 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f029c007e60 con 0x7f02a80fed10 2024-09-13T17:07:50.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.727+0000 7f02aedae640 1 -- 172.21.15.149:0/898405265 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a819deb0 con 0x7f02a80fed10 2024-09-13T17:07:50.747 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.727+0000 7f02a5ffb640 1 -- 172.21.15.149:0/898405265 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029c004a00 con 0x7f02a80fed10 2024-09-13T17:07:50.747 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.727+0000 7f02aedae640 1 -- 172.21.15.149:0/898405265 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a819e270 con 0x7f02a80fed10 2024-09-13T17:07:50.747 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.728+0000 7f02aedae640 1 -- 172.21.15.149:0/898405265 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a81062a0 con 0x7f02a80fed10 2024-09-13T17:07:50.747 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.729+0000 7f02a5ffb640 1 -- 172.21.15.149:0/898405265 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f029c0079b0 con 0x7f02a80fed10 2024-09-13T17:07:50.747 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.730+0000 7f02a5ffb640 1 --2- 172.21.15.149:0/898405265 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f02980a10b0 0x7f02980a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:07:50.747 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.730+0000 7f02a5ffb640 1 -- 172.21.15.149:0/898405265 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4101+0+0 (secure 0 0 0) 0x7f029c0cb5f0 con 0x7f02a80fed10 2024-09-13T17:07:50.747 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.730+0000 7f02a7fff640 1 --2- 172.21.15.149:0/898405265 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f02980a10b0 0x7f02980a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:07:50.747 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.731+0000 7f02a7fff640 1 --2- 172.21.15.149:0/898405265 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f02980a10b0 0x7f02980a3570 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0294006010 tx=0x7f0294031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:07:50.747 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.734+0000 7f02a5ffb640 1 -- 172.21.15.149:0/898405265 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f029c095df0 con 0x7f02a80fed10 2024-09-13T17:07:50.911 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:07:50.911+0000 7f02aedae640 1 -- 172.21.15.149:0/898405265 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f02a802c590 con 0x7f02980a10b0 2024-09-13T17:07:51.228 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:50 smithi087 ceph-mon[30934]: osdmap e34: 5 total, 5 up, 5 in 2024-09-13T17:07:51.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:50 smithi087 ceph-mon[30934]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 153 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:07:51.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:50 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:07:51.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:50 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:07:51.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:50 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:51.271 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:50 smithi149 ceph-mon[35496]: osdmap e34: 5 total, 5 up, 5 in 2024-09-13T17:07:51.271 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:50 smithi149 ceph-mon[35496]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 153 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:07:51.271 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:50 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:07:51.271 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:50 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:07:51.271 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:50 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:51.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:50 smithi118 ceph-mon[34374]: osdmap e34: 5 total, 5 up, 5 in 2024-09-13T17:07:51.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:50 smithi118 ceph-mon[34374]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 153 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:07:51.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:50 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:07:51.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:50 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:07:51.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:50 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:07:52.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:51 smithi087 ceph-mon[30934]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:07:52.292 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:51 smithi149 ceph-mon[35496]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:07:52.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:51 smithi118 ceph-mon[34374]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:07:53.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:52 smithi087 ceph-mon[30934]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 153 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:07:53.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:52 smithi149 ceph-mon[35496]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 153 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:07:53.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:52 smithi118 ceph-mon[34374]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 153 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:07:54.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:53 smithi087 ceph-mon[30934]: from='client.? 172.21.15.149:0/2308246002' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "53c14519-6170-4b5a-a79d-4835882d7bec"}]: dispatch 2024-09-13T17:07:54.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:53 smithi087 ceph-mon[30934]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "53c14519-6170-4b5a-a79d-4835882d7bec"}]: dispatch 2024-09-13T17:07:54.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:53 smithi087 ceph-mon[30934]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "53c14519-6170-4b5a-a79d-4835882d7bec"}]': finished 2024-09-13T17:07:54.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:53 smithi087 ceph-mon[30934]: osdmap e35: 6 total, 5 up, 6 in 2024-09-13T17:07:54.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:53 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:07:54.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:53 smithi087 ceph-mon[30934]: from='client.? 172.21.15.149:0/3781641446' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:07:54.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:53 smithi149 ceph-mon[35496]: from='client.? 172.21.15.149:0/2308246002' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "53c14519-6170-4b5a-a79d-4835882d7bec"}]: dispatch 2024-09-13T17:07:54.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:53 smithi149 ceph-mon[35496]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "53c14519-6170-4b5a-a79d-4835882d7bec"}]: dispatch 2024-09-13T17:07:54.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:53 smithi149 ceph-mon[35496]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "53c14519-6170-4b5a-a79d-4835882d7bec"}]': finished 2024-09-13T17:07:54.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:53 smithi149 ceph-mon[35496]: osdmap e35: 6 total, 5 up, 6 in 2024-09-13T17:07:54.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:53 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:07:54.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:53 smithi149 ceph-mon[35496]: from='client.? 172.21.15.149:0/3781641446' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:07:54.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:53 smithi118 ceph-mon[34374]: from='client.? 172.21.15.149:0/2308246002' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "53c14519-6170-4b5a-a79d-4835882d7bec"}]: dispatch 2024-09-13T17:07:54.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:53 smithi118 ceph-mon[34374]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "53c14519-6170-4b5a-a79d-4835882d7bec"}]: dispatch 2024-09-13T17:07:54.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:53 smithi118 ceph-mon[34374]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "53c14519-6170-4b5a-a79d-4835882d7bec"}]': finished 2024-09-13T17:07:54.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:53 smithi118 ceph-mon[34374]: osdmap e35: 6 total, 5 up, 6 in 2024-09-13T17:07:54.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:53 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:07:54.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:53 smithi118 ceph-mon[34374]: from='client.? 172.21.15.149:0/3781641446' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:07:55.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:54 smithi087 ceph-mon[30934]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 153 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:07:55.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:54 smithi149 ceph-mon[35496]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 153 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:07:55.362 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:54 smithi118 ceph-mon[34374]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 153 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:07:57.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:57 smithi149 ceph-mon[35496]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:07:57.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:57 smithi118 ceph-mon[34374]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:07:57.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:57 smithi087 ceph-mon[30934]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:07:59.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:07:59 smithi149 ceph-mon[35496]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:07:59.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:07:59 smithi118 ceph-mon[34374]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:07:59.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:07:59 smithi087 ceph-mon[30934]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:08:01.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:01 smithi149 ceph-mon[35496]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:08:01.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:01 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T17:08:01.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:01 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:01.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:01 smithi149 ceph-mon[35496]: Deploying daemon osd.5 on smithi149 2024-09-13T17:08:01.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:01 smithi118 ceph-mon[34374]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:08:01.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:01 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T17:08:01.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:01 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:01.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:01 smithi118 ceph-mon[34374]: Deploying daemon osd.5 on smithi149 2024-09-13T17:08:01.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:01 smithi087 ceph-mon[30934]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:08:01.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:01 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T17:08:01.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:01 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:01.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:01 smithi087 ceph-mon[30934]: Deploying daemon osd.5 on smithi149 2024-09-13T17:08:03.316 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:03 smithi149 ceph-mon[35496]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:08:03.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:03 smithi118 ceph-mon[34374]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:08:03.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:03 smithi087 ceph-mon[30934]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:08:05.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:05 smithi118 ceph-mon[34374]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:08:05.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:05 smithi087 ceph-mon[30934]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:08:05.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:05 smithi149 ceph-mon[35496]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:08:06.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:06 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:08:06.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:06 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:06.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:06 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:06.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:06 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:08:06.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:06 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:06.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:06 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:06.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:06 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:08:06.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:06 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:06.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:06 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:07.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:07 smithi149 ceph-mon[35496]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:08:07.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:07 smithi118 ceph-mon[34374]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:08:07.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:07 smithi087 ceph-mon[30934]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:08:08.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:08:08.923+0000 7f02a5ffb640 1 -- 172.21.15.149:0/898405265 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f02a802c590 con 0x7f02980a10b0 2024-09-13T17:08:08.925 INFO:teuthology.orchestra.run.smithi149.stdout:Created osd(s) 5 on host 'smithi149' 2024-09-13T17:08:08.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:08:08.926+0000 7f02aedae640 1 -- 172.21.15.149:0/898405265 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f02980a10b0 msgr2=0x7f02980a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:08.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:08:08.926+0000 7f02aedae640 1 --2- 172.21.15.149:0/898405265 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f02980a10b0 0x7f02980a3570 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0294006010 tx=0x7f0294031400 comp rx=0 tx=0).stop 2024-09-13T17:08:08.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:08:08.926+0000 7f02aedae640 1 -- 172.21.15.149:0/898405265 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02a80fed10 msgr2=0x7f02a8195df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:08.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:08:08.926+0000 7f02aedae640 1 --2- 172.21.15.149:0/898405265 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02a80fed10 0x7f02a8195df0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f029c00c970 tx=0x7f029c00ce30 comp rx=0 tx=0).stop 2024-09-13T17:08:08.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:08:08.926+0000 7f02aedae640 1 -- 172.21.15.149:0/898405265 shutdown_connections 2024-09-13T17:08:08.928 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:08:08.926+0000 7f02aedae640 1 --2- 172.21.15.149:0/898405265 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f02980a10b0 0x7f02980a3570 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:08.928 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:08:08.926+0000 7f02aedae640 1 --2- 172.21.15.149:0/898405265 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02a81008d0 0x7f02a819d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:08.928 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:08:08.926+0000 7f02aedae640 1 --2- 172.21.15.149:0/898405265 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02a80fff10 0x7f02a8196330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:08.928 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:08:08.926+0000 7f02aedae640 1 --2- 172.21.15.149:0/898405265 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02a80fed10 0x7f02a8195df0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:08.928 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:08:08.926+0000 7f02aedae640 1 -- 172.21.15.149:0/898405265 >> 172.21.15.149:0/898405265 conn(0x7f02a80fa4c0 msgr2=0x7f02a8103470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:08.928 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:08:08.926+0000 7f02aedae640 1 -- 172.21.15.149:0/898405265 shutdown_connections 2024-09-13T17:08:08.928 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:08:08.926+0000 7f02aedae640 1 -- 172.21.15.149:0/898405265 wait complete. 2024-09-13T17:08:09.216 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:08 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:09.216 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:08 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:09.216 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:08 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:09.216 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:08 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:08:09.217 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:08 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:09.217 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:08 smithi149 ceph-mon[35496]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:08:09.217 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:08 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:08:09.217 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:08 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:09.217 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:08 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:09.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:08 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:09.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:08 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:09.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:08 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:09.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:08 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:08:09.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:08 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:09.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:08 smithi087 ceph-mon[30934]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:08:09.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:08 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:08:09.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:08 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:09.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:08 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:09.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:08 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:09.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:08 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:09.365 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:08 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:09.365 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:08 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:08:09.365 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:08 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:09.365 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:08 smithi118 ceph-mon[34374]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:08:09.365 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:08 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:08:09.365 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:08 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:09.365 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:08 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:09.667 DEBUG:teuthology.orchestra.run.smithi149:osd.5> sudo journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.5.service 2024-09-13T17:08:09.670 INFO:tasks.cephadm:Deploying osd.6 on smithi087 with /dev/vg_nvme/lv_2... 2024-09-13T17:08:09.670 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-09-13T17:08:09.875 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:08:10.207 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:09 smithi149 ceph-mon[35496]: from='osd.5 [v2:172.21.15.149:6808/3468867124,v1:172.21.15.149:6809/3468867124]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T17:08:10.207 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:09 smithi149 ceph-mon[35496]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T17:08:10.256 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:09 smithi087 ceph-mon[30934]: from='osd.5 [v2:172.21.15.149:6808/3468867124,v1:172.21.15.149:6809/3468867124]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T17:08:10.256 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:09 smithi087 ceph-mon[30934]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T17:08:10.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:09 smithi118 ceph-mon[34374]: from='osd.5 [v2:172.21.15.149:6808/3468867124,v1:172.21.15.149:6809/3468867124]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T17:08:10.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:09 smithi118 ceph-mon[34374]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T17:08:11.084 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:11 smithi149 ceph-mon[35496]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T17:08:11.084 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:11 smithi149 ceph-mon[35496]: osdmap e36: 6 total, 5 up, 6 in 2024-09-13T17:08:11.084 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:11 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:08:11.084 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:11 smithi149 ceph-mon[35496]: from='osd.5 [v2:172.21.15.149:6808/3468867124,v1:172.21.15.149:6809/3468867124]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T17:08:11.084 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:11 smithi149 ceph-mon[35496]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T17:08:11.084 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:11 smithi149 ceph-mon[35496]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:08:11.264 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:11 smithi087 ceph-mon[30934]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T17:08:11.264 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:11 smithi087 ceph-mon[30934]: osdmap e36: 6 total, 5 up, 6 in 2024-09-13T17:08:11.264 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:11 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:08:11.265 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:11 smithi087 ceph-mon[30934]: from='osd.5 [v2:172.21.15.149:6808/3468867124,v1:172.21.15.149:6809/3468867124]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T17:08:11.265 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:11 smithi087 ceph-mon[30934]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T17:08:11.265 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:11 smithi087 ceph-mon[30934]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:08:11.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:11 smithi118 ceph-mon[34374]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T17:08:11.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:11 smithi118 ceph-mon[34374]: osdmap e36: 6 total, 5 up, 6 in 2024-09-13T17:08:11.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:11 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:08:11.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:11 smithi118 ceph-mon[34374]: from='osd.5 [v2:172.21.15.149:6808/3468867124,v1:172.21.15.149:6809/3468867124]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T17:08:11.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:11 smithi118 ceph-mon[34374]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T17:08:11.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:11 smithi118 ceph-mon[34374]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:08:11.752 INFO:teuthology.orchestra.run.smithi087.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-09-13T17:08:11.807 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:08:11 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5[47547]: 2024-09-13T17:08:11.412+0000 7f351cc7f640 -1 osd.5 0 waiting for initial osdmap 2024-09-13T17:08:11.808 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:08:11 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5[47547]: 2024-09-13T17:08:11.421+0000 7f3514aa0640 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:08:11.840 INFO:teuthology.orchestra.run.smithi087.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-09-13T17:08:11.856 INFO:teuthology.orchestra.run.smithi087.stderr: stderr: 10+0 records in 2024-09-13T17:08:11.856 INFO:teuthology.orchestra.run.smithi087.stderr:10+0 records out 2024-09-13T17:08:11.856 INFO:teuthology.orchestra.run.smithi087.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.013509 s, 776 MB/s 2024-09-13T17:08:11.856 INFO:teuthology.orchestra.run.smithi087.stderr:--> Zapping successful for: 2024-09-13T17:08:12.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:12 smithi149 ceph-mon[35496]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-09-13T17:08:12.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:12 smithi149 ceph-mon[35496]: osdmap e37: 6 total, 5 up, 6 in 2024-09-13T17:08:12.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:12 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:08:12.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:12 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:08:12.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:12 smithi149 ceph-mon[35496]: from='osd.5 ' entity='osd.5' 2024-09-13T17:08:12.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:12 smithi149 ceph-mon[35496]: osd.5 [v2:172.21.15.149:6808/3468867124,v1:172.21.15.149:6809/3468867124] boot 2024-09-13T17:08:12.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:12 smithi149 ceph-mon[35496]: osdmap e38: 6 total, 6 up, 6 in 2024-09-13T17:08:12.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:12 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:08:12.152 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:12 smithi087 ceph-mon[30934]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-09-13T17:08:12.152 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:12 smithi087 ceph-mon[30934]: osdmap e37: 6 total, 5 up, 6 in 2024-09-13T17:08:12.152 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:12 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:08:12.152 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:12 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:08:12.152 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:12 smithi087 ceph-mon[30934]: from='osd.5 ' entity='osd.5' 2024-09-13T17:08:12.152 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:12 smithi087 ceph-mon[30934]: osd.5 [v2:172.21.15.149:6808/3468867124,v1:172.21.15.149:6809/3468867124] boot 2024-09-13T17:08:12.152 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:12 smithi087 ceph-mon[30934]: osdmap e38: 6 total, 6 up, 6 in 2024-09-13T17:08:12.152 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:12 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:08:12.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:12 smithi118 ceph-mon[34374]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-09-13T17:08:12.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:12 smithi118 ceph-mon[34374]: osdmap e37: 6 total, 5 up, 6 in 2024-09-13T17:08:12.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:12 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:08:12.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:12 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:08:12.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:12 smithi118 ceph-mon[34374]: from='osd.5 ' entity='osd.5' 2024-09-13T17:08:12.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:12 smithi118 ceph-mon[34374]: osd.5 [v2:172.21.15.149:6808/3468867124,v1:172.21.15.149:6809/3468867124] boot 2024-09-13T17:08:12.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:12 smithi118 ceph-mon[34374]: osdmap e38: 6 total, 6 up, 6 in 2024-09-13T17:08:12.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:12 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:08:12.448 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi087:vg_nvme/lv_2 2024-09-13T17:08:12.653 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:08:13.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:13 smithi149 ceph-mon[35496]: purged_snaps scrub starts 2024-09-13T17:08:13.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:13 smithi149 ceph-mon[35496]: purged_snaps scrub ok 2024-09-13T17:08:13.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:13 smithi149 ceph-mon[35496]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:08:13.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:13 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:13.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:13 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:13.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:13 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:08:13.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:13 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:08:13.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:13 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:13.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:13 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:13.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:13 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:08:13.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:13 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:13.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:13 smithi149 ceph-mon[35496]: osdmap e39: 6 total, 6 up, 6 in 2024-09-13T17:08:13.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:13 smithi118 ceph-mon[34374]: purged_snaps scrub starts 2024-09-13T17:08:13.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:13 smithi118 ceph-mon[34374]: purged_snaps scrub ok 2024-09-13T17:08:13.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:13 smithi118 ceph-mon[34374]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:08:13.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:13 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:13.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:13 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:13.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:13 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:08:13.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:13 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:08:13.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:13 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:13.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:13 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:13.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:13 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:08:13.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:13 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:13.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:13 smithi118 ceph-mon[34374]: osdmap e39: 6 total, 6 up, 6 in 2024-09-13T17:08:13.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:13 smithi087 ceph-mon[30934]: purged_snaps scrub starts 2024-09-13T17:08:13.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:13 smithi087 ceph-mon[30934]: purged_snaps scrub ok 2024-09-13T17:08:13.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:13 smithi087 ceph-mon[30934]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:08:13.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:13 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:13.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:13 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:13.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:13 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:08:13.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:13 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:08:13.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:13 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:13.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:13 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:13.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:13 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:08:13.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:13 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:13.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:13 smithi087 ceph-mon[30934]: osdmap e39: 6 total, 6 up, 6 in 2024-09-13T17:08:14.202 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:14 smithi087 ceph-mon[30934]: Detected new or changed devices on smithi149 2024-09-13T17:08:14.202 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:14 smithi087 ceph-mon[30934]: Adjusting osd_memory_target on smithi149 to 2907M 2024-09-13T17:08:14.202 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:14 smithi087 ceph-mon[30934]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T17:08:14.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:14 smithi149 ceph-mon[35496]: Detected new or changed devices on smithi149 2024-09-13T17:08:14.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:14 smithi149 ceph-mon[35496]: Adjusting osd_memory_target on smithi149 to 2907M 2024-09-13T17:08:14.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:14 smithi149 ceph-mon[35496]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T17:08:14.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:14 smithi118 ceph-mon[34374]: Detected new or changed devices on smithi149 2024-09-13T17:08:14.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:14 smithi118 ceph-mon[34374]: Adjusting osd_memory_target on smithi149 to 2907M 2024-09-13T17:08:14.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:14 smithi118 ceph-mon[34374]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T17:08:14.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.409+0000 7f342c565640 1 -- 172.21.15.87:0/2135379163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34240fece0 msgr2=0x7f34240ff0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:14.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.409+0000 7f342c565640 1 --2- 172.21.15.87:0/2135379163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34240fece0 0x7f34240ff0e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3420009900 tx=0x7f342002a410 comp rx=0 tx=0).stop 2024-09-13T17:08:14.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.409+0000 7f342c565640 1 -- 172.21.15.87:0/2135379163 shutdown_connections 2024-09-13T17:08:14.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.409+0000 7f342c565640 1 --2- 172.21.15.87:0/2135379163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34241008a0 0x7f3424107130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:14.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.409+0000 7f342c565640 1 --2- 172.21.15.87:0/2135379163 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34240ffee0 0x7f3424100360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:14.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.409+0000 7f342c565640 1 --2- 172.21.15.87:0/2135379163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34240fece0 0x7f34240ff0e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:14.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.409+0000 7f342c565640 1 -- 172.21.15.87:0/2135379163 >> 172.21.15.87:0/2135379163 conn(0x7f34240fa490 msgr2=0x7f34240fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:14.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.409+0000 7f342c565640 1 -- 172.21.15.87:0/2135379163 shutdown_connections 2024-09-13T17:08:14.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.409+0000 7f342c565640 1 -- 172.21.15.87:0/2135379163 wait complete. 2024-09-13T17:08:14.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.410+0000 7f342c565640 1 Processor -- start 2024-09-13T17:08:14.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.410+0000 7f342c565640 1 -- start start 2024-09-13T17:08:14.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.410+0000 7f342c565640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34240fece0 0x7f3424195df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:14.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.410+0000 7f342c565640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34240ffee0 0x7f3424196330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:14.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.410+0000 7f342c565640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34241008a0 0x7f342419d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:14.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.410+0000 7f342c565640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342419d8f0 con 0x7f34241008a0 2024-09-13T17:08:14.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.410+0000 7f342c565640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342419da60 con 0x7f34240fece0 2024-09-13T17:08:14.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.410+0000 7f342c565640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342419dc20 con 0x7f34240ffee0 2024-09-13T17:08:14.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.410+0000 7f342ab02640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34241008a0 0x7f342419d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:14.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.410+0000 7f342ab02640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34241008a0 0x7f342419d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54750/0 (socket says 172.21.15.87:54750) 2024-09-13T17:08:14.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.410+0000 7f342ab02640 1 -- 172.21.15.87:0/285820514 learned_addr learned my addr 172.21.15.87:0/285820514 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:08:14.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.410+0000 7f342a301640 1 --2- 172.21.15.87:0/285820514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34240fece0 0x7f3424195df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:14.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.410+0000 7f3429b00640 1 --2- 172.21.15.87:0/285820514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34240ffee0 0x7f3424196330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:14.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.410+0000 7f342ab02640 1 -- 172.21.15.87:0/285820514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34240ffee0 msgr2=0x7f3424196330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:14.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.410+0000 7f342ab02640 1 --2- 172.21.15.87:0/285820514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34240ffee0 0x7f3424196330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:14.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.410+0000 7f342ab02640 1 -- 172.21.15.87:0/285820514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34240fece0 msgr2=0x7f3424195df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:14.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.410+0000 7f342ab02640 1 --2- 172.21.15.87:0/285820514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34240fece0 0x7f3424195df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:14.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.410+0000 7f342ab02640 1 -- 172.21.15.87:0/285820514 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3420009560 con 0x7f34241008a0 2024-09-13T17:08:14.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.410+0000 7f342ab02640 1 --2- 172.21.15.87:0/285820514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34241008a0 0x7f342419d3b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f341c00cce0 tx=0x7f341c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:14.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.410+0000 7f341b7fe640 1 -- 172.21.15.87:0/285820514 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c00f450 con 0x7f34241008a0 2024-09-13T17:08:14.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.411+0000 7f341b7fe640 1 -- 172.21.15.87:0/285820514 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f341c00fa60 con 0x7f34241008a0 2024-09-13T17:08:14.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.411+0000 7f342c565640 1 -- 172.21.15.87:0/285820514 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f342419df00 con 0x7f34241008a0 2024-09-13T17:08:14.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.411+0000 7f341b7fe640 1 -- 172.21.15.87:0/285820514 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c018b10 con 0x7f34241008a0 2024-09-13T17:08:14.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.411+0000 7f342c565640 1 -- 172.21.15.87:0/285820514 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f342419e3a0 con 0x7f34241008a0 2024-09-13T17:08:14.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.412+0000 7f342c565640 1 -- 172.21.15.87:0/285820514 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f342410a640 con 0x7f34241008a0 2024-09-13T17:08:14.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.413+0000 7f341b7fe640 1 -- 172.21.15.87:0/285820514 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f341c00fbd0 con 0x7f34241008a0 2024-09-13T17:08:14.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.413+0000 7f341b7fe640 1 --2- 172.21.15.87:0/285820514 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f34100a10b0 0x7f34100a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:14.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.413+0000 7f341b7fe640 1 -- 172.21.15.87:0/285820514 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4562+0+0 (secure 0 0 0) 0x7f341c0cbe10 con 0x7f34241008a0 2024-09-13T17:08:14.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.413+0000 7f342a301640 1 --2- 172.21.15.87:0/285820514 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f34100a10b0 0x7f34100a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:14.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.414+0000 7f342a301640 1 --2- 172.21.15.87:0/285820514 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f34100a10b0 0x7f34100a3570 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f34200057c0 tx=0x7f3420005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:14.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.418+0000 7f341b7fe640 1 -- 172.21.15.87:0/285820514 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f341c096440 con 0x7f34241008a0 2024-09-13T17:08:14.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:14.588+0000 7f342c565640 1 -- 172.21.15.87:0/285820514 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f342419e620 con 0x7f34100a10b0 2024-09-13T17:08:15.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:15 smithi087 ceph-mon[30934]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:08:15.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:15 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:08:15.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:15 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:08:15.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:15 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:15.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:15 smithi149 ceph-mon[35496]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:08:15.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:15 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:08:15.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:15 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:08:15.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:15 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:15.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:15 smithi118 ceph-mon[34374]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:08:15.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:15 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:08:15.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:15 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:08:15.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:15 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:16.162 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:16 smithi087 ceph-mon[30934]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:08:16.162 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:16 smithi087 ceph-mon[30934]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T17:08:16.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:16 smithi149 ceph-mon[35496]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:08:16.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:16 smithi149 ceph-mon[35496]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T17:08:16.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:16 smithi118 ceph-mon[34374]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:08:16.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:16 smithi118 ceph-mon[34374]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T17:08:17.345 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:17 smithi149 ceph-mon[35496]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T17:08:17.345 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:17 smithi149 ceph-mon[35496]: pgmap v136: 1 pgs: 1 peering; 577 KiB data, 209 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-13T17:08:17.345 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:17 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/937260974' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3951b32-db77-4b8b-9de0-f05e03d13f25"}]: dispatch 2024-09-13T17:08:17.345 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:17 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/937260974' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d3951b32-db77-4b8b-9de0-f05e03d13f25"}]': finished 2024-09-13T17:08:17.345 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:17 smithi149 ceph-mon[35496]: osdmap e43: 7 total, 6 up, 7 in 2024-09-13T17:08:17.345 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:17 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:08:17.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:17 smithi118 ceph-mon[34374]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T17:08:17.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:17 smithi118 ceph-mon[34374]: pgmap v136: 1 pgs: 1 peering; 577 KiB data, 209 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-13T17:08:17.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:17 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/937260974' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3951b32-db77-4b8b-9de0-f05e03d13f25"}]: dispatch 2024-09-13T17:08:17.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:17 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/937260974' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d3951b32-db77-4b8b-9de0-f05e03d13f25"}]': finished 2024-09-13T17:08:17.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:17 smithi118 ceph-mon[34374]: osdmap e43: 7 total, 6 up, 7 in 2024-09-13T17:08:17.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:17 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:08:17.390 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:17 smithi087 ceph-mon[30934]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T17:08:17.390 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:17 smithi087 ceph-mon[30934]: pgmap v136: 1 pgs: 1 peering; 577 KiB data, 209 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-13T17:08:17.390 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:17 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/937260974' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3951b32-db77-4b8b-9de0-f05e03d13f25"}]: dispatch 2024-09-13T17:08:17.390 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:17 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/937260974' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d3951b32-db77-4b8b-9de0-f05e03d13f25"}]': finished 2024-09-13T17:08:17.390 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:17 smithi087 ceph-mon[30934]: osdmap e43: 7 total, 6 up, 7 in 2024-09-13T17:08:17.390 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:17 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:08:18.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:18 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/443940061' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:08:18.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:18 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/443940061' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:08:18.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:18 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/443940061' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:08:19.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:19 smithi149 ceph-mon[35496]: pgmap v138: 1 pgs: 1 peering; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 134 KiB/s, 0 objects/s recovering 2024-09-13T17:08:19.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:19 smithi118 ceph-mon[34374]: pgmap v138: 1 pgs: 1 peering; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 134 KiB/s, 0 objects/s recovering 2024-09-13T17:08:19.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:19 smithi087 ceph-mon[30934]: pgmap v138: 1 pgs: 1 peering; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 134 KiB/s, 0 objects/s recovering 2024-09-13T17:08:21.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:21 smithi149 ceph-mon[35496]: pgmap v139: 1 pgs: 1 peering; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T17:08:21.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:21 smithi118 ceph-mon[34374]: pgmap v139: 1 pgs: 1 peering; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T17:08:21.427 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:21 smithi087 ceph-mon[30934]: pgmap v139: 1 pgs: 1 peering; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T17:08:23.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:23 smithi149 ceph-mon[35496]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-13T17:08:23.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:23 smithi118 ceph-mon[34374]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-13T17:08:23.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:23 smithi087 ceph-mon[30934]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-13T17:08:24.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:24 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-13T17:08:24.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:24 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:24.368 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:24 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-13T17:08:24.368 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:24 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:24.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:24 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-13T17:08:24.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:24 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:25.344 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:25 smithi087 ceph-mon[30934]: Deploying daemon osd.6 on smithi087 2024-09-13T17:08:25.345 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:25 smithi087 ceph-mon[30934]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:08:25.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:25 smithi118 ceph-mon[34374]: Deploying daemon osd.6 on smithi087 2024-09-13T17:08:25.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:25 smithi118 ceph-mon[34374]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:08:25.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:25 smithi149 ceph-mon[35496]: Deploying daemon osd.6 on smithi087 2024-09-13T17:08:25.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:25 smithi149 ceph-mon[35496]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:08:27.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:27 smithi118 ceph-mon[34374]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:08:27.384 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:27 smithi087 ceph-mon[30934]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:08:27.394 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:27 smithi149 ceph-mon[35496]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:08:29.359 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:29 smithi087 ceph-mon[30934]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:08:29.359 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:29 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:08:29.359 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:29 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:29.359 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:29 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:29.362 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:29 smithi118 ceph-mon[34374]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:08:29.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:29 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:08:29.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:29 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:29.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:29 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:29.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:29 smithi149 ceph-mon[35496]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:08:29.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:29 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:08:29.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:29 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:29.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:29 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:31.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:31 smithi087 ceph-mon[30934]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:08:31.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:31 smithi118 ceph-mon[34374]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:08:31.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:31 smithi149 ceph-mon[35496]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:08:32.172 INFO:teuthology.orchestra.run.smithi087.stdout:Created osd(s) 6 on host 'smithi087' 2024-09-13T17:08:32.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:32.170+0000 7f341b7fe640 1 -- 172.21.15.87:0/285820514 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f342419e620 con 0x7f34100a10b0 2024-09-13T17:08:32.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:32.172+0000 7f342c565640 1 -- 172.21.15.87:0/285820514 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f34100a10b0 msgr2=0x7f34100a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:32.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:32.172+0000 7f342c565640 1 --2- 172.21.15.87:0/285820514 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f34100a10b0 0x7f34100a3570 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f34200057c0 tx=0x7f3420005a20 comp rx=0 tx=0).stop 2024-09-13T17:08:32.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:32.172+0000 7f342c565640 1 -- 172.21.15.87:0/285820514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34241008a0 msgr2=0x7f342419d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:32.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:32.172+0000 7f342c565640 1 --2- 172.21.15.87:0/285820514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34241008a0 0x7f342419d3b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f341c00cce0 tx=0x7f341c00a620 comp rx=0 tx=0).stop 2024-09-13T17:08:32.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:32.172+0000 7f342c565640 1 -- 172.21.15.87:0/285820514 shutdown_connections 2024-09-13T17:08:32.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:32.172+0000 7f342c565640 1 --2- 172.21.15.87:0/285820514 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f34100a10b0 0x7f34100a3570 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:32.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:32.172+0000 7f342c565640 1 --2- 172.21.15.87:0/285820514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34241008a0 0x7f342419d3b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:32.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:32.172+0000 7f342c565640 1 --2- 172.21.15.87:0/285820514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34240ffee0 0x7f3424196330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:32.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:32.172+0000 7f342c565640 1 --2- 172.21.15.87:0/285820514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34240fece0 0x7f3424195df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:32.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:32.172+0000 7f342c565640 1 -- 172.21.15.87:0/285820514 >> 172.21.15.87:0/285820514 conn(0x7f34240fa490 msgr2=0x7f3424067f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:32.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:32.172+0000 7f342c565640 1 -- 172.21.15.87:0/285820514 shutdown_connections 2024-09-13T17:08:32.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:08:32.172+0000 7f342c565640 1 -- 172.21.15.87:0/285820514 wait complete. 2024-09-13T17:08:32.812 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:32 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:32.812 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:32 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:32.812 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:32 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:32.812 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:32 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:08:32.812 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:32 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:32.812 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:32 smithi087 ceph-mon[30934]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:08:32.812 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:32 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:08:32.812 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:32 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:32.812 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:32 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:32.838 DEBUG:teuthology.orchestra.run.smithi087:osd.6> sudo journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.6.service 2024-09-13T17:08:32.840 INFO:tasks.cephadm:Deploying osd.7 on smithi118 with /dev/vg_nvme/lv_2... 2024-09-13T17:08:32.840 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-09-13T17:08:32.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:32 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:32.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:32 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:32.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:32 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:32.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:32 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:08:32.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:32 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:32.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:32 smithi149 ceph-mon[35496]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:08:32.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:32 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:08:32.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:32 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:32.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:32 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:32.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:32 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:32.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:32 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:32.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:32 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:32.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:32 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:08:32.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:32 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:32.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:32 smithi118 ceph-mon[34374]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:08:32.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:32 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:08:32.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:32 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:32.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:32 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:33.055 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T17:08:33.829 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:33 smithi118 ceph-mon[34374]: from='osd.6 [v2:172.21.15.87:6818/326563617,v1:172.21.15.87:6819/326563617]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-13T17:08:33.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:33 smithi149 ceph-mon[35496]: from='osd.6 [v2:172.21.15.87:6818/326563617,v1:172.21.15.87:6819/326563617]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-13T17:08:33.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:33 smithi087 ceph-mon[30934]: from='osd.6 [v2:172.21.15.87:6818/326563617,v1:172.21.15.87:6819/326563617]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-13T17:08:34.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:34 smithi118 ceph-mon[34374]: from='osd.6 [v2:172.21.15.87:6818/326563617,v1:172.21.15.87:6819/326563617]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-13T17:08:34.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:34 smithi118 ceph-mon[34374]: osdmap e44: 7 total, 6 up, 7 in 2024-09-13T17:08:34.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:34 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:08:34.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:34 smithi118 ceph-mon[34374]: from='osd.6 [v2:172.21.15.87:6818/326563617,v1:172.21.15.87:6819/326563617]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-13T17:08:34.784 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:34 smithi118 ceph-mon[34374]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:08:34.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:34 smithi149 ceph-mon[35496]: from='osd.6 [v2:172.21.15.87:6818/326563617,v1:172.21.15.87:6819/326563617]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-13T17:08:34.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:34 smithi149 ceph-mon[35496]: osdmap e44: 7 total, 6 up, 7 in 2024-09-13T17:08:34.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:34 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:08:34.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:34 smithi149 ceph-mon[35496]: from='osd.6 [v2:172.21.15.87:6818/326563617,v1:172.21.15.87:6819/326563617]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-13T17:08:34.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:34 smithi149 ceph-mon[35496]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:08:34.913 INFO:teuthology.orchestra.run.smithi118.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-09-13T17:08:34.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:34 smithi087 ceph-mon[30934]: from='osd.6 [v2:172.21.15.87:6818/326563617,v1:172.21.15.87:6819/326563617]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-13T17:08:34.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:34 smithi087 ceph-mon[30934]: osdmap e44: 7 total, 6 up, 7 in 2024-09-13T17:08:34.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:34 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:08:34.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:34 smithi087 ceph-mon[30934]: from='osd.6 [v2:172.21.15.87:6818/326563617,v1:172.21.15.87:6819/326563617]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-13T17:08:34.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:34 smithi087 ceph-mon[30934]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:08:34.980 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:08:34 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6[58766]: 2024-09-13T17:08:34.582+0000 7f9161706640 -1 osd.6 0 waiting for initial osdmap 2024-09-13T17:08:34.980 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:08:34 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6[58766]: 2024-09-13T17:08:34.590+0000 7f915d52f640 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:08:34.996 INFO:teuthology.orchestra.run.smithi118.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-09-13T17:08:35.006 INFO:teuthology.orchestra.run.smithi118.stderr: stderr: 10+0 records in 2024-09-13T17:08:35.006 INFO:teuthology.orchestra.run.smithi118.stderr:10+0 records out 2024-09-13T17:08:35.006 INFO:teuthology.orchestra.run.smithi118.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00837669 s, 1.3 GB/s 2024-09-13T17:08:35.006 INFO:teuthology.orchestra.run.smithi118.stderr:--> Zapping successful for: 2024-09-13T17:08:35.714 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:35 smithi118 ceph-mon[34374]: from='osd.6 [v2:172.21.15.87:6818/326563617,v1:172.21.15.87:6819/326563617]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-09-13T17:08:35.714 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:35 smithi118 ceph-mon[34374]: osdmap e45: 7 total, 6 up, 7 in 2024-09-13T17:08:35.714 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:35 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:08:35.714 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:35 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:08:35.735 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi118:vg_nvme/lv_2 2024-09-13T17:08:35.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:35 smithi149 ceph-mon[35496]: from='osd.6 [v2:172.21.15.87:6818/326563617,v1:172.21.15.87:6819/326563617]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-09-13T17:08:35.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:35 smithi149 ceph-mon[35496]: osdmap e45: 7 total, 6 up, 7 in 2024-09-13T17:08:35.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:35 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:08:35.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:35 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:08:35.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:35 smithi087 ceph-mon[30934]: from='osd.6 [v2:172.21.15.87:6818/326563617,v1:172.21.15.87:6819/326563617]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-09-13T17:08:35.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:35 smithi087 ceph-mon[30934]: osdmap e45: 7 total, 6 up, 7 in 2024-09-13T17:08:35.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:35 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:08:35.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:35 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:08:35.979 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T17:08:36.829 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:36 smithi118 ceph-mon[34374]: purged_snaps scrub starts 2024-09-13T17:08:36.829 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:36 smithi118 ceph-mon[34374]: purged_snaps scrub ok 2024-09-13T17:08:36.829 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:36 smithi118 ceph-mon[34374]: osd.6 [v2:172.21.15.87:6818/326563617,v1:172.21.15.87:6819/326563617] boot 2024-09-13T17:08:36.830 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:36 smithi118 ceph-mon[34374]: osdmap e46: 7 total, 7 up, 7 in 2024-09-13T17:08:36.830 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:36 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:08:36.830 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:36 smithi118 ceph-mon[34374]: Detected new or changed devices on smithi087 2024-09-13T17:08:36.830 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:36 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:36.830 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:36 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:36.830 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:36 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:08:36.830 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:36 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:08:36.830 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:36 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:08:36.830 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:36 smithi118 ceph-mon[34374]: Adjusting osd_memory_target on smithi087 to 5696M 2024-09-13T17:08:36.830 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:36 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:36.830 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:36 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:36.830 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:36 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:08:36.830 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:36 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:36.830 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:36 smithi118 ceph-mon[34374]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:36.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:36 smithi149 ceph-mon[35496]: purged_snaps scrub starts 2024-09-13T17:08:36.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:36 smithi149 ceph-mon[35496]: purged_snaps scrub ok 2024-09-13T17:08:36.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:36 smithi149 ceph-mon[35496]: osd.6 [v2:172.21.15.87:6818/326563617,v1:172.21.15.87:6819/326563617] boot 2024-09-13T17:08:36.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:36 smithi149 ceph-mon[35496]: osdmap e46: 7 total, 7 up, 7 in 2024-09-13T17:08:36.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:36 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:08:36.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:36 smithi149 ceph-mon[35496]: Detected new or changed devices on smithi087 2024-09-13T17:08:36.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:36 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:36.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:36 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:36.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:36 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:08:36.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:36 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:08:36.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:36 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:08:36.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:36 smithi149 ceph-mon[35496]: Adjusting osd_memory_target on smithi087 to 5696M 2024-09-13T17:08:36.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:36 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:36.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:36 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:36.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:36 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:08:36.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:36 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:36.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:36 smithi149 ceph-mon[35496]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:36.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:36 smithi087 ceph-mon[30934]: purged_snaps scrub starts 2024-09-13T17:08:36.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:36 smithi087 ceph-mon[30934]: purged_snaps scrub ok 2024-09-13T17:08:36.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:36 smithi087 ceph-mon[30934]: osd.6 [v2:172.21.15.87:6818/326563617,v1:172.21.15.87:6819/326563617] boot 2024-09-13T17:08:36.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:36 smithi087 ceph-mon[30934]: osdmap e46: 7 total, 7 up, 7 in 2024-09-13T17:08:36.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:36 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:08:36.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:36 smithi087 ceph-mon[30934]: Detected new or changed devices on smithi087 2024-09-13T17:08:36.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:36 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:36.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:36 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:36.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:36 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:08:36.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:36 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:08:36.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:36 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:08:36.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:36 smithi087 ceph-mon[30934]: Adjusting osd_memory_target on smithi087 to 5696M 2024-09-13T17:08:36.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:36 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:36.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:36 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:36.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:36 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:08:36.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:36 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:36.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:36 smithi087 ceph-mon[30934]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:37.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.613+0000 7f4603998640 1 -- 172.21.15.118:0/3844866134 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45fc1031a0 msgr2=0x7f45fc105590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:37.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.613+0000 7f4603998640 1 --2- 172.21.15.118:0/3844866134 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45fc1031a0 0x7f45fc105590 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f45f0009900 tx=0x7f45f002a410 comp rx=0 tx=0).stop 2024-09-13T17:08:37.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.613+0000 7f4603998640 1 -- 172.21.15.118:0/3844866134 shutdown_connections 2024-09-13T17:08:37.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.613+0000 7f4603998640 1 --2- 172.21.15.118:0/3844866134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45fc105ad0 0x7f45fc107f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.613+0000 7f4603998640 1 --2- 172.21.15.118:0/3844866134 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45fc1031a0 0x7f45fc105590 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.613+0000 7f4603998640 1 --2- 172.21.15.118:0/3844866134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45fc100870 0x7f45fc102c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.613+0000 7f4603998640 1 -- 172.21.15.118:0/3844866134 >> 172.21.15.118:0/3844866134 conn(0x7f45fc0fa490 msgr2=0x7f45fc0fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:37.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.613+0000 7f4603998640 1 -- 172.21.15.118:0/3844866134 shutdown_connections 2024-09-13T17:08:37.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.613+0000 7f4603998640 1 -- 172.21.15.118:0/3844866134 wait complete. 2024-09-13T17:08:37.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.613+0000 7f4603998640 1 Processor -- start 2024-09-13T17:08:37.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.613+0000 7f4603998640 1 -- start start 2024-09-13T17:08:37.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.614+0000 7f4603998640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45fc100870 0x7f45fc195d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:37.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.614+0000 7f4603998640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45fc1031a0 0x7f45fc196240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:37.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.614+0000 7f4603998640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45fc105ad0 0x7f45fc19d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:37.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.614+0000 7f4603998640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc19d7f0 con 0x7f45fc100870 2024-09-13T17:08:37.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.614+0000 7f4603998640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc19d960 con 0x7f45fc105ad0 2024-09-13T17:08:37.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.614+0000 7f4603998640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc19db20 con 0x7f45fc1031a0 2024-09-13T17:08:37.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.614+0000 7f4601f35640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45fc105ad0 0x7f45fc19d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:37.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.614+0000 7f4601f35640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45fc105ad0 0x7f45fc19d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35566/0 (socket says 172.21.15.118:35566) 2024-09-13T17:08:37.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.614+0000 7f4601f35640 1 -- 172.21.15.118:0/3372295850 learned_addr learned my addr 172.21.15.118:0/3372295850 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-13T17:08:37.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.614+0000 7f4601734640 1 --2- 172.21.15.118:0/3372295850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45fc100870 0x7f45fc195d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:37.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.614+0000 7f4600f33640 1 --2- 172.21.15.118:0/3372295850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45fc1031a0 0x7f45fc196240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:37.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.614+0000 7f4601f35640 1 -- 172.21.15.118:0/3372295850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45fc1031a0 msgr2=0x7f45fc196240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:37.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.614+0000 7f4601f35640 1 --2- 172.21.15.118:0/3372295850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45fc1031a0 0x7f45fc196240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.614+0000 7f4601f35640 1 -- 172.21.15.118:0/3372295850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45fc100870 msgr2=0x7f45fc195d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:37.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.614+0000 7f4601f35640 1 --2- 172.21.15.118:0/3372295850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45fc100870 0x7f45fc195d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:37.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.614+0000 7f4601f35640 1 -- 172.21.15.118:0/3372295850 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f0009560 con 0x7f45fc105ad0 2024-09-13T17:08:37.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.614+0000 7f4600f33640 1 --2- 172.21.15.118:0/3372295850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45fc1031a0 0x7f45fc196240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:08:37.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.614+0000 7f4601f35640 1 --2- 172.21.15.118:0/3372295850 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45fc105ad0 0x7f45fc19d280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f45f400d750 tx=0x7f45f400dc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:37.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.614+0000 7f45fa7fc640 1 -- 172.21.15.118:0/3372295850 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f4009bd0 con 0x7f45fc105ad0 2024-09-13T17:08:37.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.614+0000 7f4603998640 1 -- 172.21.15.118:0/3372295850 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45fc19de00 con 0x7f45fc105ad0 2024-09-13T17:08:37.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.614+0000 7f45fa7fc640 1 -- 172.21.15.118:0/3372295850 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f45f400de60 con 0x7f45fc105ad0 2024-09-13T17:08:37.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.614+0000 7f45fa7fc640 1 -- 172.21.15.118:0/3372295850 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f4004dd0 con 0x7f45fc105ad0 2024-09-13T17:08:37.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.614+0000 7f4603998640 1 -- 172.21.15.118:0/3372295850 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45fc19e220 con 0x7f45fc105ad0 2024-09-13T17:08:37.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.615+0000 7f4603998640 1 -- 172.21.15.118:0/3372295850 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45fc0fbf80 con 0x7f45fc105ad0 2024-09-13T17:08:37.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.616+0000 7f45fa7fc640 1 -- 172.21.15.118:0/3372295850 <== mon.2 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f45f4009d30 con 0x7f45fc105ad0 2024-09-13T17:08:37.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.617+0000 7f45fa7fc640 1 --2- 172.21.15.118:0/3372295850 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f45e40a1080 0x7f45e40a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:08:37.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.617+0000 7f45fa7fc640 1 -- 172.21.15.118:0/3372295850 <== mon.2 v2:172.21.15.118:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 4965+0+0 (secure 0 0 0) 0x7f45f40cb6b0 con 0x7f45fc105ad0 2024-09-13T17:08:37.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.617+0000 7f4601734640 1 --2- 172.21.15.118:0/3372295850 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f45e40a1080 0x7f45e40a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:08:37.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.618+0000 7f4601734640 1 --2- 172.21.15.118:0/3372295850 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f45e40a1080 0x7f45e40a3540 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f45ec007350 tx=0x7f45ec0072e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:08:37.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.621+0000 7f45fa7fc640 1 -- 172.21.15.118:0/3372295850 <== mon.2 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f45f4095b30 con 0x7f45fc105ad0 2024-09-13T17:08:37.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:37.795+0000 7f4603998640 1 -- 172.21.15.118:0/3372295850 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f45fc02c4f0 con 0x7f45e40a1080 2024-09-13T17:08:37.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:37 smithi087 ceph-mon[30934]: osdmap e47: 7 total, 7 up, 7 in 2024-09-13T17:08:38.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:37 smithi149 ceph-mon[35496]: osdmap e47: 7 total, 7 up, 7 in 2024-09-13T17:08:38.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:37 smithi118 ceph-mon[34374]: osdmap e47: 7 total, 7 up, 7 in 2024-09-13T17:08:38.830 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:38 smithi118 ceph-mon[34374]: from='client.24254 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:08:38.830 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:38 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:08:38.830 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:38 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:08:38.830 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:38 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:38.830 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:38 smithi118 ceph-mon[34374]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:38.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:38 smithi087 ceph-mon[30934]: from='client.24254 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:08:38.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:38 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:08:38.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:38 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:08:38.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:38 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:38.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:38 smithi087 ceph-mon[30934]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:39.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:38 smithi149 ceph-mon[35496]: from='client.24254 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:08:39.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:38 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:08:39.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:38 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:08:39.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:38 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:39.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:38 smithi149 ceph-mon[35496]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:41.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:41 smithi149 ceph-mon[35496]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:41.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:41 smithi149 ceph-mon[35496]: from='client.? 172.21.15.118:0/477092270' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d46dab7-a8bf-4e3e-b5c0-43860d336bdd"}]: dispatch 2024-09-13T17:08:41.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:41 smithi149 ceph-mon[35496]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d46dab7-a8bf-4e3e-b5c0-43860d336bdd"}]: dispatch 2024-09-13T17:08:41.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:41 smithi149 ceph-mon[35496]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4d46dab7-a8bf-4e3e-b5c0-43860d336bdd"}]': finished 2024-09-13T17:08:41.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:41 smithi149 ceph-mon[35496]: osdmap e48: 8 total, 7 up, 8 in 2024-09-13T17:08:41.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:41 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T17:08:41.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:41 smithi149 ceph-mon[35496]: from='client.? 172.21.15.118:0/4200107084' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:08:41.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:41 smithi118 ceph-mon[34374]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:41.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:41 smithi118 ceph-mon[34374]: from='client.? 172.21.15.118:0/477092270' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d46dab7-a8bf-4e3e-b5c0-43860d336bdd"}]: dispatch 2024-09-13T17:08:41.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:41 smithi118 ceph-mon[34374]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d46dab7-a8bf-4e3e-b5c0-43860d336bdd"}]: dispatch 2024-09-13T17:08:41.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:41 smithi118 ceph-mon[34374]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4d46dab7-a8bf-4e3e-b5c0-43860d336bdd"}]': finished 2024-09-13T17:08:41.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:41 smithi118 ceph-mon[34374]: osdmap e48: 8 total, 7 up, 8 in 2024-09-13T17:08:41.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:41 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T17:08:41.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:41 smithi118 ceph-mon[34374]: from='client.? 172.21.15.118:0/4200107084' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:08:41.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:41 smithi087 ceph-mon[30934]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:41.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:41 smithi087 ceph-mon[30934]: from='client.? 172.21.15.118:0/477092270' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d46dab7-a8bf-4e3e-b5c0-43860d336bdd"}]: dispatch 2024-09-13T17:08:41.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:41 smithi087 ceph-mon[30934]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d46dab7-a8bf-4e3e-b5c0-43860d336bdd"}]: dispatch 2024-09-13T17:08:41.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:41 smithi087 ceph-mon[30934]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4d46dab7-a8bf-4e3e-b5c0-43860d336bdd"}]': finished 2024-09-13T17:08:41.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:41 smithi087 ceph-mon[30934]: osdmap e48: 8 total, 7 up, 8 in 2024-09-13T17:08:41.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:41 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T17:08:41.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:41 smithi087 ceph-mon[30934]: from='client.? 172.21.15.118:0/4200107084' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:08:43.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:43 smithi149 ceph-mon[35496]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:43.362 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:43 smithi118 ceph-mon[34374]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:43.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:43 smithi087 ceph-mon[30934]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:45.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:45 smithi118 ceph-mon[34374]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:45.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:45 smithi087 ceph-mon[30934]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:45.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:45 smithi149 ceph-mon[35496]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:47.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:47 smithi118 ceph-mon[34374]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:47.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:47 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-13T17:08:47.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:47 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:47.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:47 smithi087 ceph-mon[30934]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:47.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:47 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-13T17:08:47.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:47 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:47.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:47 smithi149 ceph-mon[35496]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:47.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:47 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-13T17:08:47.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:47 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:48.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:48 smithi118 ceph-mon[34374]: Deploying daemon osd.7 on smithi118 2024-09-13T17:08:48.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:48 smithi087 ceph-mon[30934]: Deploying daemon osd.7 on smithi118 2024-09-13T17:08:48.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:48 smithi149 ceph-mon[35496]: Deploying daemon osd.7 on smithi118 2024-09-13T17:08:49.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:49 smithi118 ceph-mon[34374]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:49.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:49 smithi087 ceph-mon[30934]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:49.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:49 smithi149 ceph-mon[35496]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:51.317 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:51 smithi118 ceph-mon[34374]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:51.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:51 smithi087 ceph-mon[30934]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:51.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:51 smithi149 ceph-mon[35496]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:53.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:53 smithi118 ceph-mon[34374]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:53.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:53 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:08:53.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:53 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:53.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:53 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:53.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:53 smithi087 ceph-mon[30934]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:53.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:53 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:08:53.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:53 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:53.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:53 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:53.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:53 smithi149 ceph-mon[35496]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:53.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:53 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:08:53.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:53 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:53.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:53 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:55.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:55 smithi118 ceph-mon[34374]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:55.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:55 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:55.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:55 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:55.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:55 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:55.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:55 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:08:55.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:55 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:55.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:55.472+0000 7f45fa7fc640 1 -- 172.21.15.118:0/3372295850 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f45fc02c4f0 con 0x7f45e40a1080 2024-09-13T17:08:55.474 INFO:teuthology.orchestra.run.smithi118.stdout:Created osd(s) 7 on host 'smithi118' 2024-09-13T17:08:55.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:55.474+0000 7f4603998640 1 -- 172.21.15.118:0/3372295850 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f45e40a1080 msgr2=0x7f45e40a3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:55.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:55.474+0000 7f4603998640 1 --2- 172.21.15.118:0/3372295850 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f45e40a1080 0x7f45e40a3540 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f45ec007350 tx=0x7f45ec0072e0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:55.474+0000 7f4603998640 1 -- 172.21.15.118:0/3372295850 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45fc105ad0 msgr2=0x7f45fc19d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:08:55.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:55.474+0000 7f4603998640 1 --2- 172.21.15.118:0/3372295850 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45fc105ad0 0x7f45fc19d280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f45f400d750 tx=0x7f45f400dc10 comp rx=0 tx=0).stop 2024-09-13T17:08:55.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:55.474+0000 7f4603998640 1 -- 172.21.15.118:0/3372295850 shutdown_connections 2024-09-13T17:08:55.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:55.474+0000 7f4603998640 1 --2- 172.21.15.118:0/3372295850 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f45e40a1080 0x7f45e40a3540 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:55.474+0000 7f4603998640 1 --2- 172.21.15.118:0/3372295850 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45fc105ad0 0x7f45fc19d280 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:55.474+0000 7f4603998640 1 --2- 172.21.15.118:0/3372295850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45fc1031a0 0x7f45fc196240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:55.474+0000 7f4603998640 1 --2- 172.21.15.118:0/3372295850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45fc100870 0x7f45fc195d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:08:55.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:55.474+0000 7f4603998640 1 -- 172.21.15.118:0/3372295850 >> 172.21.15.118:0/3372295850 conn(0x7f45fc0fa490 msgr2=0x7f45fc1012f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:08:55.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:55.475+0000 7f4603998640 1 -- 172.21.15.118:0/3372295850 shutdown_connections 2024-09-13T17:08:55.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:08:55.475+0000 7f4603998640 1 -- 172.21.15.118:0/3372295850 wait complete. 2024-09-13T17:08:55.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:55 smithi087 ceph-mon[30934]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:55.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:55 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:55.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:55 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:55.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:55 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:55.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:55 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:08:55.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:55 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:55.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:55 smithi149 ceph-mon[35496]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:55.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:55 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:55.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:55 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:55.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:55 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:08:55.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:55 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:08:55.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:55 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:56.172 DEBUG:teuthology.orchestra.run.smithi118:osd.7> sudo journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.7.service 2024-09-13T17:08:56.175 INFO:tasks.cephadm:Deploying osd.8 on smithi149 with /dev/vg_nvme/lv_2... 2024-09-13T17:08:56.175 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-09-13T17:08:56.384 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T17:08:56.418 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:56 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:08:56.418 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:56 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:56.418 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:56 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:56.419 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:56 smithi118 ceph-mon[34374]: from='osd.7 [v2:172.21.15.118:6816/1690268990,v1:172.21.15.118:6817/1690268990]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T17:08:56.419 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:56 smithi118 ceph-mon[34374]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T17:08:56.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:56 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:08:56.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:56 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:56.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:56 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:56.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:56 smithi087 ceph-mon[30934]: from='osd.7 [v2:172.21.15.118:6816/1690268990,v1:172.21.15.118:6817/1690268990]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T17:08:56.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:56 smithi087 ceph-mon[30934]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T17:08:56.505 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:56 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:08:56.505 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:56 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:56.505 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:56 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:08:56.505 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:56 smithi149 ceph-mon[35496]: from='osd.7 [v2:172.21.15.118:6816/1690268990,v1:172.21.15.118:6817/1690268990]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T17:08:56.505 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:56 smithi149 ceph-mon[35496]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T17:08:57.464 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:57 smithi118 ceph-mon[34374]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:57.465 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:57 smithi118 ceph-mon[34374]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-13T17:08:57.465 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:57 smithi118 ceph-mon[34374]: osdmap e49: 8 total, 7 up, 8 in 2024-09-13T17:08:57.465 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:57 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T17:08:57.465 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:57 smithi118 ceph-mon[34374]: from='osd.7 [v2:172.21.15.118:6816/1690268990,v1:172.21.15.118:6817/1690268990]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2024-09-13T17:08:57.465 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:57 smithi118 ceph-mon[34374]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2024-09-13T17:08:57.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:57 smithi087 ceph-mon[30934]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:57.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:57 smithi087 ceph-mon[30934]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-13T17:08:57.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:57 smithi087 ceph-mon[30934]: osdmap e49: 8 total, 7 up, 8 in 2024-09-13T17:08:57.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:57 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T17:08:57.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:57 smithi087 ceph-mon[30934]: from='osd.7 [v2:172.21.15.118:6816/1690268990,v1:172.21.15.118:6817/1690268990]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2024-09-13T17:08:57.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:57 smithi087 ceph-mon[30934]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2024-09-13T17:08:57.573 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:57 smithi149 ceph-mon[35496]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:57.573 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:57 smithi149 ceph-mon[35496]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-13T17:08:57.573 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:57 smithi149 ceph-mon[35496]: osdmap e49: 8 total, 7 up, 8 in 2024-09-13T17:08:57.573 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:57 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T17:08:57.573 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:57 smithi149 ceph-mon[35496]: from='osd.7 [v2:172.21.15.118:6816/1690268990,v1:172.21.15.118:6817/1690268990]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2024-09-13T17:08:57.573 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:57 smithi149 ceph-mon[35496]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2024-09-13T17:08:57.717 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:08:57 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:08:57.482+0000 7f4782a10640 -1 osd.7 0 waiting for initial osdmap 2024-09-13T17:08:57.717 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:08:57 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:08:57.493+0000 7f477e839640 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:08:58.221 INFO:teuthology.orchestra.run.smithi149.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-09-13T17:08:58.320 INFO:teuthology.orchestra.run.smithi149.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-09-13T17:08:58.333 INFO:teuthology.orchestra.run.smithi149.stderr: stderr: 10+0 records in 2024-09-13T17:08:58.333 INFO:teuthology.orchestra.run.smithi149.stderr:10+0 records out 2024-09-13T17:08:58.333 INFO:teuthology.orchestra.run.smithi149.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.011592 s, 905 MB/s 2024-09-13T17:08:58.334 INFO:teuthology.orchestra.run.smithi149.stderr:--> Zapping successful for: 2024-09-13T17:08:58.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:58 smithi118 ceph-mon[34374]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2024-09-13T17:08:58.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:58 smithi118 ceph-mon[34374]: osdmap e50: 8 total, 7 up, 8 in 2024-09-13T17:08:58.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:58 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T17:08:58.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:58 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T17:08:58.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:58 smithi118 ceph-mon[34374]: osd.7 [v2:172.21.15.118:6816/1690268990,v1:172.21.15.118:6817/1690268990] boot 2024-09-13T17:08:58.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:58 smithi118 ceph-mon[34374]: osdmap e51: 8 total, 8 up, 8 in 2024-09-13T17:08:58.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:58 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T17:08:58.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:58 smithi118 ceph-mon[34374]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:58.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:58 smithi087 ceph-mon[30934]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2024-09-13T17:08:58.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:58 smithi087 ceph-mon[30934]: osdmap e50: 8 total, 7 up, 8 in 2024-09-13T17:08:58.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:58 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T17:08:58.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:58 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T17:08:58.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:58 smithi087 ceph-mon[30934]: osd.7 [v2:172.21.15.118:6816/1690268990,v1:172.21.15.118:6817/1690268990] boot 2024-09-13T17:08:58.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:58 smithi087 ceph-mon[30934]: osdmap e51: 8 total, 8 up, 8 in 2024-09-13T17:08:58.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:58 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T17:08:58.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:58 smithi087 ceph-mon[30934]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:58.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:58 smithi149 ceph-mon[35496]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2024-09-13T17:08:58.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:58 smithi149 ceph-mon[35496]: osdmap e50: 8 total, 7 up, 8 in 2024-09-13T17:08:58.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:58 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T17:08:58.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:58 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T17:08:58.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:58 smithi149 ceph-mon[35496]: osd.7 [v2:172.21.15.118:6816/1690268990,v1:172.21.15.118:6817/1690268990] boot 2024-09-13T17:08:58.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:58 smithi149 ceph-mon[35496]: osdmap e51: 8 total, 8 up, 8 in 2024-09-13T17:08:58.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:58 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T17:08:58.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:58 smithi149 ceph-mon[35496]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:08:59.019 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi149:vg_nvme/lv_2 2024-09-13T17:08:59.230 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T17:09:00.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:59 smithi149 ceph-mon[35496]: purged_snaps scrub starts 2024-09-13T17:09:00.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:59 smithi149 ceph-mon[35496]: purged_snaps scrub ok 2024-09-13T17:09:00.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:59 smithi149 ceph-mon[35496]: osdmap e52: 8 total, 8 up, 8 in 2024-09-13T17:09:00.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:59 smithi149 ceph-mon[35496]: Detected new or changed devices on smithi118 2024-09-13T17:09:00.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:59 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:00.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:59 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:00.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:59 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:09:00.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:59 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:09:00.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:59 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:09:00.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:59 smithi149 ceph-mon[35496]: Adjusting osd_memory_target on smithi118 to 5696M 2024-09-13T17:09:00.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:59 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:00.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:59 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:00.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:59 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:09:00.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:08:59 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:00.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:59 smithi118 ceph-mon[34374]: purged_snaps scrub starts 2024-09-13T17:09:00.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:59 smithi118 ceph-mon[34374]: purged_snaps scrub ok 2024-09-13T17:09:00.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:59 smithi118 ceph-mon[34374]: osdmap e52: 8 total, 8 up, 8 in 2024-09-13T17:09:00.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:59 smithi118 ceph-mon[34374]: Detected new or changed devices on smithi118 2024-09-13T17:09:00.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:59 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:00.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:59 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:00.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:59 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:09:00.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:59 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:09:00.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:59 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:09:00.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:59 smithi118 ceph-mon[34374]: Adjusting osd_memory_target on smithi118 to 5696M 2024-09-13T17:09:00.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:59 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:00.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:59 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:00.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:59 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:09:00.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:08:59 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:00.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:59 smithi087 ceph-mon[30934]: purged_snaps scrub starts 2024-09-13T17:09:00.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:59 smithi087 ceph-mon[30934]: purged_snaps scrub ok 2024-09-13T17:09:00.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:59 smithi087 ceph-mon[30934]: osdmap e52: 8 total, 8 up, 8 in 2024-09-13T17:09:00.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:59 smithi087 ceph-mon[30934]: Detected new or changed devices on smithi118 2024-09-13T17:09:00.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:59 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:00.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:59 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:00.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:59 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:09:00.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:59 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:09:00.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:59 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:09:00.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:59 smithi087 ceph-mon[30934]: Adjusting osd_memory_target on smithi118 to 5696M 2024-09-13T17:09:00.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:59 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:00.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:59 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:00.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:59 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:09:00.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:08:59 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:01.024 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:00 smithi149 ceph-mon[35496]: osdmap e53: 8 total, 8 up, 8 in 2024-09-13T17:09:01.024 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:00 smithi149 ceph-mon[35496]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:01.049 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.023+0000 7fca3a8bf640 1 -- 172.21.15.149:0/3286716926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca340ffed0 msgr2=0x7fca34100350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:01.050 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.023+0000 7fca3a8bf640 1 --2- 172.21.15.149:0/3286716926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca340ffed0 0x7fca34100350 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fca1c009900 tx=0x7fca1c02a410 comp rx=0 tx=0).stop 2024-09-13T17:09:01.050 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.023+0000 7fca3a8bf640 1 -- 172.21.15.149:0/3286716926 shutdown_connections 2024-09-13T17:09:01.050 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.023+0000 7fca3a8bf640 1 --2- 172.21.15.149:0/3286716926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca34100890 0x7fca34107120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:01.050 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.023+0000 7fca3a8bf640 1 --2- 172.21.15.149:0/3286716926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca340ffed0 0x7fca34100350 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:01.050 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.023+0000 7fca3a8bf640 1 --2- 172.21.15.149:0/3286716926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca340fecd0 0x7fca340ff0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:01.051 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.023+0000 7fca3a8bf640 1 -- 172.21.15.149:0/3286716926 >> 172.21.15.149:0/3286716926 conn(0x7fca340fa480 msgr2=0x7fca340fc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:01.051 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.023+0000 7fca3a8bf640 1 -- 172.21.15.149:0/3286716926 shutdown_connections 2024-09-13T17:09:01.051 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.023+0000 7fca3a8bf640 1 -- 172.21.15.149:0/3286716926 wait complete. 2024-09-13T17:09:01.051 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.023+0000 7fca3a8bf640 1 Processor -- start 2024-09-13T17:09:01.051 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.024+0000 7fca3a8bf640 1 -- start start 2024-09-13T17:09:01.051 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.024+0000 7fca3a8bf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca340fecd0 0x7fca34195e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:01.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.024+0000 7fca3a8bf640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca340ffed0 0x7fca34196350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:01.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.024+0000 7fca3a8bf640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca34100890 0x7fca3419d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:01.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.024+0000 7fca3a8bf640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3419d910 con 0x7fca340fecd0 2024-09-13T17:09:01.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.024+0000 7fca3a8bf640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3419da80 con 0x7fca34100890 2024-09-13T17:09:01.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.024+0000 7fca3a8bf640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3419dc40 con 0x7fca340ffed0 2024-09-13T17:09:01.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.024+0000 7fca2bfff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca340ffed0 0x7fca34196350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:01.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.024+0000 7fca2bfff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca340ffed0 0x7fca34196350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36144/0 (socket says 172.21.15.149:36144) 2024-09-13T17:09:01.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.024+0000 7fca2bfff640 1 -- 172.21.15.149:0/3221267032 learned_addr learned my addr 172.21.15.149:0/3221267032 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-13T17:09:01.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.024+0000 7fca33fff640 1 --2- 172.21.15.149:0/3221267032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca340fecd0 0x7fca34195e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:01.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.024+0000 7fca38e5c640 1 --2- 172.21.15.149:0/3221267032 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca34100890 0x7fca3419d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:01.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.024+0000 7fca2bfff640 1 -- 172.21.15.149:0/3221267032 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca34100890 msgr2=0x7fca3419d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:01.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.024+0000 7fca2bfff640 1 --2- 172.21.15.149:0/3221267032 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca34100890 0x7fca3419d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:01.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.024+0000 7fca2bfff640 1 -- 172.21.15.149:0/3221267032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca340fecd0 msgr2=0x7fca34195e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:01.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.024+0000 7fca2bfff640 1 --2- 172.21.15.149:0/3221267032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca340fecd0 0x7fca34195e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:01.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.024+0000 7fca2bfff640 1 -- 172.21.15.149:0/3221267032 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca1c009560 con 0x7fca340ffed0 2024-09-13T17:09:01.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.024+0000 7fca33fff640 1 --2- 172.21.15.149:0/3221267032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca340fecd0 0x7fca34195e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:01.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.024+0000 7fca2bfff640 1 --2- 172.21.15.149:0/3221267032 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca340ffed0 0x7fca34196350 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fca1c031460 tx=0x7fca1c004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:01.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.024+0000 7fca31ffb640 1 -- 172.21.15.149:0/3221267032 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c0035f0 con 0x7fca340ffed0 2024-09-13T17:09:01.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.024+0000 7fca31ffb640 1 -- 172.21.15.149:0/3221267032 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fca1c003c00 con 0x7fca340ffed0 2024-09-13T17:09:01.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.024+0000 7fca31ffb640 1 -- 172.21.15.149:0/3221267032 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c03cda0 con 0x7fca340ffed0 2024-09-13T17:09:01.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.025+0000 7fca3a8bf640 1 -- 172.21.15.149:0/3221267032 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca3419dec0 con 0x7fca340ffed0 2024-09-13T17:09:01.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.025+0000 7fca3a8bf640 1 -- 172.21.15.149:0/3221267032 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca3419e280 con 0x7fca340ffed0 2024-09-13T17:09:01.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.026+0000 7fca3a8bf640 1 -- 172.21.15.149:0/3221267032 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca3410a5a0 con 0x7fca340ffed0 2024-09-13T17:09:01.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.027+0000 7fca31ffb640 1 -- 172.21.15.149:0/3221267032 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fca1c03c570 con 0x7fca340ffed0 2024-09-13T17:09:01.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.027+0000 7fca31ffb640 1 --2- 172.21.15.149:0/3221267032 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fca200a10b0 0x7fca200a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:01.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.027+0000 7fca31ffb640 1 -- 172.21.15.149:0/3221267032 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5397+0+0 (secure 0 0 0) 0x7fca1c0ed0b0 con 0x7fca340ffed0 2024-09-13T17:09:01.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.028+0000 7fca33fff640 1 --2- 172.21.15.149:0/3221267032 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fca200a10b0 0x7fca200a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:01.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.028+0000 7fca33fff640 1 --2- 172.21.15.149:0/3221267032 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fca200a10b0 0x7fca200a3570 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fca340ffd30 tx=0x7fca24005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:01.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.031+0000 7fca31ffb640 1 -- 172.21.15.149:0/3221267032 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fca1c0b73a0 con 0x7fca340ffed0 2024-09-13T17:09:01.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:00 smithi118 ceph-mon[34374]: osdmap e53: 8 total, 8 up, 8 in 2024-09-13T17:09:01.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:00 smithi118 ceph-mon[34374]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:01.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:01.203+0000 7fca3a8bf640 1 -- 172.21.15.149:0/3221267032 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fca3419e470 con 0x7fca200a10b0 2024-09-13T17:09:01.228 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:00 smithi087 ceph-mon[30934]: osdmap e53: 8 total, 8 up, 8 in 2024-09-13T17:09:01.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:00 smithi087 ceph-mon[30934]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:01.836 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:01 smithi149 ceph-mon[35496]: osdmap e54: 8 total, 8 up, 8 in 2024-09-13T17:09:01.836 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:01 smithi149 ceph-mon[35496]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:09:01.836 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:01 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:09:01.836 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:01 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:09:01.836 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:01 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:02.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:01 smithi118 ceph-mon[34374]: osdmap e54: 8 total, 8 up, 8 in 2024-09-13T17:09:02.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:01 smithi118 ceph-mon[34374]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:09:02.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:01 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:09:02.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:01 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:09:02.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:01 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:02.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:01 smithi087 ceph-mon[30934]: osdmap e54: 8 total, 8 up, 8 in 2024-09-13T17:09:02.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:01 smithi087 ceph-mon[30934]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:09:02.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:01 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:09:02.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:01 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:09:02.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:01 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:02.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:02 smithi149 ceph-mon[35496]: osdmap e55: 8 total, 8 up, 8 in 2024-09-13T17:09:02.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:02 smithi149 ceph-mon[35496]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:03.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:02 smithi118 ceph-mon[34374]: osdmap e55: 8 total, 8 up, 8 in 2024-09-13T17:09:03.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:02 smithi118 ceph-mon[34374]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:03.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:02 smithi087 ceph-mon[30934]: osdmap e55: 8 total, 8 up, 8 in 2024-09-13T17:09:03.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:02 smithi087 ceph-mon[30934]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:04.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:03 smithi149 ceph-mon[35496]: from='client.? 172.21.15.149:0/2870466452' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5a015a7d-60a3-4412-96af-1b61d2ad51f1"}]: dispatch 2024-09-13T17:09:04.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:03 smithi149 ceph-mon[35496]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5a015a7d-60a3-4412-96af-1b61d2ad51f1"}]: dispatch 2024-09-13T17:09:04.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:03 smithi149 ceph-mon[35496]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5a015a7d-60a3-4412-96af-1b61d2ad51f1"}]': finished 2024-09-13T17:09:04.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:03 smithi149 ceph-mon[35496]: osdmap e56: 9 total, 8 up, 9 in 2024-09-13T17:09:04.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:03 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:09:04.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:03 smithi118 ceph-mon[34374]: from='client.? 172.21.15.149:0/2870466452' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5a015a7d-60a3-4412-96af-1b61d2ad51f1"}]: dispatch 2024-09-13T17:09:04.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:03 smithi118 ceph-mon[34374]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5a015a7d-60a3-4412-96af-1b61d2ad51f1"}]: dispatch 2024-09-13T17:09:04.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:03 smithi118 ceph-mon[34374]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5a015a7d-60a3-4412-96af-1b61d2ad51f1"}]': finished 2024-09-13T17:09:04.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:03 smithi118 ceph-mon[34374]: osdmap e56: 9 total, 8 up, 9 in 2024-09-13T17:09:04.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:03 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:09:04.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:03 smithi087 ceph-mon[30934]: from='client.? 172.21.15.149:0/2870466452' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5a015a7d-60a3-4412-96af-1b61d2ad51f1"}]: dispatch 2024-09-13T17:09:04.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:03 smithi087 ceph-mon[30934]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5a015a7d-60a3-4412-96af-1b61d2ad51f1"}]: dispatch 2024-09-13T17:09:04.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:03 smithi087 ceph-mon[30934]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5a015a7d-60a3-4412-96af-1b61d2ad51f1"}]': finished 2024-09-13T17:09:04.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:03 smithi087 ceph-mon[30934]: osdmap e56: 9 total, 8 up, 9 in 2024-09-13T17:09:04.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:03 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:09:05.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:04 smithi149 ceph-mon[35496]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:05.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:04 smithi149 ceph-mon[35496]: from='client.? 172.21.15.149:0/2261263878' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:09:05.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:04 smithi118 ceph-mon[34374]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:05.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:04 smithi118 ceph-mon[34374]: from='client.? 172.21.15.149:0/2261263878' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:09:05.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:04 smithi087 ceph-mon[30934]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:05.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:04 smithi087 ceph-mon[30934]: from='client.? 172.21.15.149:0/2261263878' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:09:07.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:07 smithi149 ceph-mon[35496]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:07.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:07 smithi118 ceph-mon[34374]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:07.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:07 smithi087 ceph-mon[30934]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:09.265 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:09 smithi149 ceph-mon[35496]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:09.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:09 smithi118 ceph-mon[34374]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:09.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:09 smithi087 ceph-mon[30934]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:11.334 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:11 smithi149 ceph-mon[35496]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:11.334 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:11 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-13T17:09:11.334 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:11 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:11.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:11 smithi118 ceph-mon[34374]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:11.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:11 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-13T17:09:11.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:11 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:11.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:11 smithi087 ceph-mon[30934]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:11.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:11 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-13T17:09:11.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:11 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:12.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:12 smithi149 ceph-mon[35496]: Deploying daemon osd.8 on smithi149 2024-09-13T17:09:12.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:12 smithi118 ceph-mon[34374]: Deploying daemon osd.8 on smithi149 2024-09-13T17:09:12.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:12 smithi087 ceph-mon[30934]: Deploying daemon osd.8 on smithi149 2024-09-13T17:09:13.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:13 smithi118 ceph-mon[34374]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:13.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:13 smithi087 ceph-mon[30934]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:13.488 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:13 smithi149 ceph-mon[35496]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:15.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:15 smithi118 ceph-mon[34374]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:15.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:15 smithi087 ceph-mon[30934]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:15.480 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:15 smithi149 ceph-mon[35496]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:16.476 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:16 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:09:16.476 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:16 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:16.476 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:16 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:16.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:16 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:09:16.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:16 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:16.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:16 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:16.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:16 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:09:16.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:16 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:16.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:16 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:17.380 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:17 smithi087 ceph-mon[30934]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:17.582 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:17 smithi149 ceph-mon[35496]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:17.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:17 smithi118 ceph-mon[34374]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:19.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:19 smithi149 ceph-mon[35496]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:19.390 INFO:teuthology.orchestra.run.smithi149.stdout:Created osd(s) 8 on host 'smithi149' 2024-09-13T17:09:19.391 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:19.388+0000 7fca31ffb640 1 -- 172.21.15.149:0/3221267032 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fca3419e470 con 0x7fca200a10b0 2024-09-13T17:09:19.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:19.390+0000 7fca3a8bf640 1 -- 172.21.15.149:0/3221267032 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fca200a10b0 msgr2=0x7fca200a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:19.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:19.390+0000 7fca3a8bf640 1 --2- 172.21.15.149:0/3221267032 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fca200a10b0 0x7fca200a3570 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fca340ffd30 tx=0x7fca24005f90 comp rx=0 tx=0).stop 2024-09-13T17:09:19.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:19.390+0000 7fca3a8bf640 1 -- 172.21.15.149:0/3221267032 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca340ffed0 msgr2=0x7fca34196350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:19.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:19.390+0000 7fca3a8bf640 1 --2- 172.21.15.149:0/3221267032 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca340ffed0 0x7fca34196350 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fca1c031460 tx=0x7fca1c004270 comp rx=0 tx=0).stop 2024-09-13T17:09:19.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:19.390+0000 7fca3a8bf640 1 -- 172.21.15.149:0/3221267032 shutdown_connections 2024-09-13T17:09:19.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:19.390+0000 7fca3a8bf640 1 --2- 172.21.15.149:0/3221267032 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fca200a10b0 0x7fca200a3570 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:19.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:19.390+0000 7fca3a8bf640 1 --2- 172.21.15.149:0/3221267032 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca34100890 0x7fca3419d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:19.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:19.390+0000 7fca3a8bf640 1 --2- 172.21.15.149:0/3221267032 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca340ffed0 0x7fca34196350 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:19.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:19.390+0000 7fca3a8bf640 1 --2- 172.21.15.149:0/3221267032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca340fecd0 0x7fca34195e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:19.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:19.390+0000 7fca3a8bf640 1 -- 172.21.15.149:0/3221267032 >> 172.21.15.149:0/3221267032 conn(0x7fca340fa480 msgr2=0x7fca340687d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:19.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:19.390+0000 7fca3a8bf640 1 -- 172.21.15.149:0/3221267032 shutdown_connections 2024-09-13T17:09:19.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:09:19.390+0000 7fca3a8bf640 1 -- 172.21.15.149:0/3221267032 wait complete. 2024-09-13T17:09:19.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:19 smithi087 ceph-mon[30934]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:19.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:19 smithi118 ceph-mon[34374]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:20.107 DEBUG:teuthology.orchestra.run.smithi149:osd.8> sudo journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.8.service 2024-09-13T17:09:20.110 INFO:tasks.cephadm:Deploying osd.9 on smithi087 with /dev/vg_nvme/lv_1... 2024-09-13T17:09:20.110 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-09-13T17:09:20.321 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:09:20.442 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:20 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:20.442 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:20 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:20.442 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:20 smithi087 ceph-mon[30934]: from='osd.8 [v2:172.21.15.149:6816/1558675380,v1:172.21.15.149:6817/1558675380]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T17:09:20.442 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:20 smithi087 ceph-mon[30934]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T17:09:20.443 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:20 smithi087 ceph-mon[30934]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:20.443 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:20 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:20.443 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:20 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:20.662 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:20 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:20.662 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:20 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:20.662 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:20 smithi149 ceph-mon[35496]: from='osd.8 [v2:172.21.15.149:6816/1558675380,v1:172.21.15.149:6817/1558675380]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T17:09:20.662 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:20 smithi149 ceph-mon[35496]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T17:09:20.662 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:20 smithi149 ceph-mon[35496]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:20.662 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:20 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:20.662 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:20 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:20.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:20 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:20.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:20 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:20.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:20 smithi118 ceph-mon[34374]: from='osd.8 [v2:172.21.15.149:6816/1558675380,v1:172.21.15.149:6817/1558675380]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T17:09:20.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:20 smithi118 ceph-mon[34374]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T17:09:20.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:20 smithi118 ceph-mon[34374]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:20.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:20 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:20.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:20 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:21.723 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:21 smithi149 ceph-mon[35496]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-13T17:09:21.723 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:21 smithi149 ceph-mon[35496]: osdmap e57: 9 total, 8 up, 9 in 2024-09-13T17:09:21.723 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:21 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:09:21.723 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:21 smithi149 ceph-mon[35496]: from='osd.8 [v2:172.21.15.149:6816/1558675380,v1:172.21.15.149:6817/1558675380]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T17:09:21.723 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:21 smithi149 ceph-mon[35496]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T17:09:21.724 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:09:21 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:09:21.410+0000 7f32f34ed640 -1 osd.8 0 waiting for initial osdmap 2024-09-13T17:09:21.724 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:09:21 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:09:21.421+0000 7f32ef316640 -1 osd.8 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:09:21.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:21 smithi087 ceph-mon[30934]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-13T17:09:21.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:21 smithi087 ceph-mon[30934]: osdmap e57: 9 total, 8 up, 9 in 2024-09-13T17:09:21.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:21 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:09:21.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:21 smithi087 ceph-mon[30934]: from='osd.8 [v2:172.21.15.149:6816/1558675380,v1:172.21.15.149:6817/1558675380]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T17:09:21.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:21 smithi087 ceph-mon[30934]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T17:09:21.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:21 smithi118 ceph-mon[34374]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-13T17:09:21.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:21 smithi118 ceph-mon[34374]: osdmap e57: 9 total, 8 up, 9 in 2024-09-13T17:09:21.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:21 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:09:21.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:21 smithi118 ceph-mon[34374]: from='osd.8 [v2:172.21.15.149:6816/1558675380,v1:172.21.15.149:6817/1558675380]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T17:09:21.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:21 smithi118 ceph-mon[34374]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T17:09:22.141 INFO:teuthology.orchestra.run.smithi087.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-09-13T17:09:22.221 INFO:teuthology.orchestra.run.smithi087.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-09-13T17:09:22.235 INFO:teuthology.orchestra.run.smithi087.stderr: stderr: 10+0 records in 2024-09-13T17:09:22.235 INFO:teuthology.orchestra.run.smithi087.stderr:10+0 records out 2024-09-13T17:09:22.235 INFO:teuthology.orchestra.run.smithi087.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0116871 s, 897 MB/s 2024-09-13T17:09:22.235 INFO:teuthology.orchestra.run.smithi087.stderr:--> Zapping successful for: 2024-09-13T17:09:22.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:22 smithi087 ceph-mon[30934]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-09-13T17:09:22.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:22 smithi087 ceph-mon[30934]: osdmap e58: 9 total, 8 up, 9 in 2024-09-13T17:09:22.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:22 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:09:22.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:22 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:09:22.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:22 smithi087 ceph-mon[30934]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:22.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:22 smithi149 ceph-mon[35496]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-09-13T17:09:22.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:22 smithi149 ceph-mon[35496]: osdmap e58: 9 total, 8 up, 9 in 2024-09-13T17:09:22.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:22 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:09:22.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:22 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:09:22.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:22 smithi149 ceph-mon[35496]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:22.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:22 smithi118 ceph-mon[34374]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-09-13T17:09:22.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:22 smithi118 ceph-mon[34374]: osdmap e58: 9 total, 8 up, 9 in 2024-09-13T17:09:22.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:22 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:09:22.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:22 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:09:22.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:22 smithi118 ceph-mon[34374]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:09:22.924 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi087:vg_nvme/lv_1 2024-09-13T17:09:23.120 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:09:23.534 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:23 smithi087 ceph-mon[30934]: purged_snaps scrub starts 2024-09-13T17:09:23.535 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:23 smithi087 ceph-mon[30934]: purged_snaps scrub ok 2024-09-13T17:09:23.535 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:23 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:09:23.535 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:23 smithi087 ceph-mon[30934]: osd.8 [v2:172.21.15.149:6816/1558675380,v1:172.21.15.149:6817/1558675380] boot 2024-09-13T17:09:23.535 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:23 smithi087 ceph-mon[30934]: osdmap e59: 9 total, 9 up, 9 in 2024-09-13T17:09:23.535 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:23 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:09:23.536 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:23 smithi087 ceph-mon[30934]: osdmap e60: 9 total, 9 up, 9 in 2024-09-13T17:09:23.536 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:23 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:23.536 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:23 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:23.536 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:23 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:09:23.536 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:23 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:09:23.536 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:23 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:09:23.537 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:23 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:23.537 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:23 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:23.537 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:23 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:09:23.537 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:23 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:23.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:23 smithi149 ceph-mon[35496]: purged_snaps scrub starts 2024-09-13T17:09:23.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:23 smithi149 ceph-mon[35496]: purged_snaps scrub ok 2024-09-13T17:09:23.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:23 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:09:23.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:23 smithi149 ceph-mon[35496]: osd.8 [v2:172.21.15.149:6816/1558675380,v1:172.21.15.149:6817/1558675380] boot 2024-09-13T17:09:23.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:23 smithi149 ceph-mon[35496]: osdmap e59: 9 total, 9 up, 9 in 2024-09-13T17:09:23.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:23 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:09:23.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:23 smithi149 ceph-mon[35496]: osdmap e60: 9 total, 9 up, 9 in 2024-09-13T17:09:23.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:23 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:23.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:23 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:23.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:23 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:09:23.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:23 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:09:23.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:23 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:09:23.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:23 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:23.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:23 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:23.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:23 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:09:23.594 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:23 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:23.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:23 smithi118 ceph-mon[34374]: purged_snaps scrub starts 2024-09-13T17:09:23.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:23 smithi118 ceph-mon[34374]: purged_snaps scrub ok 2024-09-13T17:09:23.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:23 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:09:23.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:23 smithi118 ceph-mon[34374]: osd.8 [v2:172.21.15.149:6816/1558675380,v1:172.21.15.149:6817/1558675380] boot 2024-09-13T17:09:23.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:23 smithi118 ceph-mon[34374]: osdmap e59: 9 total, 9 up, 9 in 2024-09-13T17:09:23.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:23 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:09:23.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:23 smithi118 ceph-mon[34374]: osdmap e60: 9 total, 9 up, 9 in 2024-09-13T17:09:23.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:23 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:23.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:23 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:23.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:23 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:09:23.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:23 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:09:23.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:23 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:09:23.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:23 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:23.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:23 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:23.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:23 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:09:23.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:23 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:24.609 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:24 smithi087 ceph-mon[30934]: Detected new or changed devices on smithi149 2024-09-13T17:09:24.609 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:24 smithi087 ceph-mon[30934]: Adjusting osd_memory_target on smithi149 to 1938M 2024-09-13T17:09:24.609 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:24 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:09:24.609 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:24 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:24.610 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:24 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:09:24.610 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:24 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:24.610 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:24 smithi087 ceph-mon[30934]: osdmap e61: 9 total, 9 up, 9 in 2024-09-13T17:09:24.610 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:24 smithi087 ceph-mon[30934]: pgmap v189: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-13T17:09:24.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:24 smithi149 ceph-mon[35496]: Detected new or changed devices on smithi149 2024-09-13T17:09:24.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:24 smithi149 ceph-mon[35496]: Adjusting osd_memory_target on smithi149 to 1938M 2024-09-13T17:09:24.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:24 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:09:24.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:24 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:24.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:24 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:09:24.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:24 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:24.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:24 smithi149 ceph-mon[35496]: osdmap e61: 9 total, 9 up, 9 in 2024-09-13T17:09:24.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:24 smithi149 ceph-mon[35496]: pgmap v189: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-13T17:09:24.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.827+0000 7ff12b26b640 1 -- 172.21.15.87:0/687840088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff124100f60 msgr2=0x7ff1241013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:24.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.827+0000 7ff12b26b640 1 --2- 172.21.15.87:0/687840088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff124100f60 0x7ff1241013e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff114009900 tx=0x7ff11402a410 comp rx=0 tx=0).stop 2024-09-13T17:09:24.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.827+0000 7ff12b26b640 1 -- 172.21.15.87:0/687840088 shutdown_connections 2024-09-13T17:09:24.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.827+0000 7ff12b26b640 1 --2- 172.21.15.87:0/687840088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff124101920 0x7ff124108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.827+0000 7ff12b26b640 1 --2- 172.21.15.87:0/687840088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff124100f60 0x7ff1241013e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.827+0000 7ff12b26b640 1 --2- 172.21.15.87:0/687840088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1240ffe00 0x7ff124100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.827+0000 7ff12b26b640 1 -- 172.21.15.87:0/687840088 >> 172.21.15.87:0/687840088 conn(0x7ff1240fb590 msgr2=0x7ff1240fd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:24.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.827+0000 7ff12b26b640 1 -- 172.21.15.87:0/687840088 shutdown_connections 2024-09-13T17:09:24.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.827+0000 7ff12b26b640 1 -- 172.21.15.87:0/687840088 wait complete. 2024-09-13T17:09:24.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.828+0000 7ff12b26b640 1 Processor -- start 2024-09-13T17:09:24.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.828+0000 7ff12b26b640 1 -- start start 2024-09-13T17:09:24.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.828+0000 7ff12b26b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1240ffe00 0x7ff124195d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:24.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.828+0000 7ff12b26b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff124100f60 0x7ff124196270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:24.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.828+0000 7ff12b26b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff124101920 0x7ff12419d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:24.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.828+0000 7ff12b26b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12419d820 con 0x7ff1240ffe00 2024-09-13T17:09:24.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.828+0000 7ff12b26b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12419d990 con 0x7ff124100f60 2024-09-13T17:09:24.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.828+0000 7ff12b26b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12419db50 con 0x7ff124101920 2024-09-13T17:09:24.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.828+0000 7ff129007640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1240ffe00 0x7ff124195d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:24.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.828+0000 7ff129007640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1240ffe00 0x7ff124195d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57206/0 (socket says 172.21.15.87:57206) 2024-09-13T17:09:24.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.828+0000 7ff129007640 1 -- 172.21.15.87:0/1157771328 learned_addr learned my addr 172.21.15.87:0/1157771328 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:09:24.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.828+0000 7ff128806640 1 --2- 172.21.15.87:0/1157771328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff124100f60 0x7ff124196270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:24.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.828+0000 7ff129808640 1 --2- 172.21.15.87:0/1157771328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff124101920 0x7ff12419d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:24.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.828+0000 7ff129007640 1 -- 172.21.15.87:0/1157771328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff124101920 msgr2=0x7ff12419d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:24.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.828+0000 7ff129007640 1 --2- 172.21.15.87:0/1157771328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff124101920 0x7ff12419d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.828+0000 7ff129007640 1 -- 172.21.15.87:0/1157771328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff124100f60 msgr2=0x7ff124196270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:24.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.828+0000 7ff129007640 1 --2- 172.21.15.87:0/1157771328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff124100f60 0x7ff124196270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:24.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.828+0000 7ff129007640 1 -- 172.21.15.87:0/1157771328 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff114009560 con 0x7ff1240ffe00 2024-09-13T17:09:24.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.828+0000 7ff128806640 1 --2- 172.21.15.87:0/1157771328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff124100f60 0x7ff124196270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:09:24.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.829+0000 7ff129007640 1 --2- 172.21.15.87:0/1157771328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1240ffe00 0x7ff124195d30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff12000c920 tx=0x7ff12000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:24.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.829+0000 7ff11a7fc640 1 -- 172.21.15.87:0/1157771328 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff120007c70 con 0x7ff1240ffe00 2024-09-13T17:09:24.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.829+0000 7ff11a7fc640 1 -- 172.21.15.87:0/1157771328 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff120007dd0 con 0x7ff1240ffe00 2024-09-13T17:09:24.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.829+0000 7ff12b26b640 1 -- 172.21.15.87:0/1157771328 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff12419de30 con 0x7ff1240ffe00 2024-09-13T17:09:24.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.829+0000 7ff11a7fc640 1 -- 172.21.15.87:0/1157771328 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1200187c0 con 0x7ff1240ffe00 2024-09-13T17:09:24.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.829+0000 7ff12b26b640 1 -- 172.21.15.87:0/1157771328 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff12419e240 con 0x7ff1240ffe00 2024-09-13T17:09:24.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.830+0000 7ff12b26b640 1 -- 172.21.15.87:0/1157771328 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff124107230 con 0x7ff1240ffe00 2024-09-13T17:09:24.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.831+0000 7ff11a7fc640 1 -- 172.21.15.87:0/1157771328 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff12000f450 con 0x7ff1240ffe00 2024-09-13T17:09:24.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.831+0000 7ff11a7fc640 1 --2- 172.21.15.87:0/1157771328 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff1100a1080 0x7ff1100a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:24.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.832+0000 7ff128806640 1 --2- 172.21.15.87:0/1157771328 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff1100a1080 0x7ff1100a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:24.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.832+0000 7ff11a7fc640 1 -- 172.21.15.87:0/1157771328 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5829+0+0 (secure 0 0 0) 0x7ff1200cc0e0 con 0x7ff1240ffe00 2024-09-13T17:09:24.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.832+0000 7ff128806640 1 --2- 172.21.15.87:0/1157771328 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff1100a1080 0x7ff1100a3540 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff1140057c0 tx=0x7ff114031420 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:24.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:24.836+0000 7ff11a7fc640 1 -- 172.21.15.87:0/1157771328 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff120096220 con 0x7ff1240ffe00 2024-09-13T17:09:24.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:24 smithi118 ceph-mon[34374]: Detected new or changed devices on smithi149 2024-09-13T17:09:24.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:24 smithi118 ceph-mon[34374]: Adjusting osd_memory_target on smithi149 to 1938M 2024-09-13T17:09:24.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:24 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:09:24.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:24 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:24.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:24 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:09:24.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:24 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:24.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:24 smithi118 ceph-mon[34374]: osdmap e61: 9 total, 9 up, 9 in 2024-09-13T17:09:24.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:24 smithi118 ceph-mon[34374]: pgmap v189: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-13T17:09:25.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:25.007+0000 7ff12b26b640 1 -- 172.21.15.87:0/1157771328 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff12402c550 con 0x7ff1100a1080 2024-09-13T17:09:25.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:25 smithi087 ceph-mon[30934]: osdmap e62: 9 total, 9 up, 9 in 2024-09-13T17:09:25.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:25 smithi087 ceph-mon[30934]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:09:25.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:25 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:09:25.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:25 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:09:25.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:25 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:26.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:25 smithi149 ceph-mon[35496]: osdmap e62: 9 total, 9 up, 9 in 2024-09-13T17:09:26.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:25 smithi149 ceph-mon[35496]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:09:26.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:25 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:09:26.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:25 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:09:26.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:25 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:26.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:25 smithi118 ceph-mon[34374]: osdmap e62: 9 total, 9 up, 9 in 2024-09-13T17:09:26.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:25 smithi118 ceph-mon[34374]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:09:26.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:25 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:09:26.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:25 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:09:26.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:25 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:27.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:26 smithi149 ceph-mon[35496]: osdmap e63: 9 total, 9 up, 9 in 2024-09-13T17:09:27.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:26 smithi149 ceph-mon[35496]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-13T17:09:27.112 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:26 smithi118 ceph-mon[34374]: osdmap e63: 9 total, 9 up, 9 in 2024-09-13T17:09:27.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:26 smithi118 ceph-mon[34374]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-13T17:09:27.144 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:26 smithi087 ceph-mon[30934]: osdmap e63: 9 total, 9 up, 9 in 2024-09-13T17:09:27.144 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:26 smithi087 ceph-mon[30934]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-13T17:09:27.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:27 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2229081599' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "248c0b6e-4c4e-4c63-a0dd-e4cdf3b997a7"}]: dispatch 2024-09-13T17:09:27.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:27 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2229081599' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "248c0b6e-4c4e-4c63-a0dd-e4cdf3b997a7"}]': finished 2024-09-13T17:09:27.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:27 smithi087 ceph-mon[30934]: osdmap e64: 10 total, 9 up, 10 in 2024-09-13T17:09:27.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:27 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T17:09:28.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:27 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2229081599' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "248c0b6e-4c4e-4c63-a0dd-e4cdf3b997a7"}]: dispatch 2024-09-13T17:09:28.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:27 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2229081599' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "248c0b6e-4c4e-4c63-a0dd-e4cdf3b997a7"}]': finished 2024-09-13T17:09:28.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:27 smithi149 ceph-mon[35496]: osdmap e64: 10 total, 9 up, 10 in 2024-09-13T17:09:28.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:27 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T17:09:28.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:27 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2229081599' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "248c0b6e-4c4e-4c63-a0dd-e4cdf3b997a7"}]: dispatch 2024-09-13T17:09:28.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:27 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2229081599' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "248c0b6e-4c4e-4c63-a0dd-e4cdf3b997a7"}]': finished 2024-09-13T17:09:28.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:27 smithi118 ceph-mon[34374]: osdmap e64: 10 total, 9 up, 10 in 2024-09-13T17:09:28.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:27 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T17:09:28.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:28 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1285161727' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:09:28.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:28 smithi087 ceph-mon[30934]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-13T17:09:29.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:28 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1285161727' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:09:29.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:28 smithi149 ceph-mon[35496]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-13T17:09:29.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:28 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1285161727' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:09:29.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:28 smithi118 ceph-mon[34374]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-13T17:09:31.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:31 smithi087 ceph-mon[30934]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T17:09:31.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:31 smithi118 ceph-mon[34374]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T17:09:31.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:31 smithi149 ceph-mon[35496]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T17:09:33.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:33 smithi118 ceph-mon[34374]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-13T17:09:33.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:33 smithi087 ceph-mon[30934]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-13T17:09:33.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:33 smithi149 ceph-mon[35496]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-13T17:09:35.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:35 smithi118 ceph-mon[34374]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-13T17:09:35.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:35 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-13T17:09:35.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:35 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:35.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:35 smithi087 ceph-mon[30934]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-13T17:09:35.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:35 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-13T17:09:35.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:35 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:35.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:35 smithi149 ceph-mon[35496]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-13T17:09:35.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:35 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-13T17:09:35.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:35 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:36.228 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:36 smithi087 ceph-mon[30934]: Deploying daemon osd.9 on smithi087 2024-09-13T17:09:36.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:36 smithi118 ceph-mon[34374]: Deploying daemon osd.9 on smithi087 2024-09-13T17:09:36.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:36 smithi149 ceph-mon[35496]: Deploying daemon osd.9 on smithi087 2024-09-13T17:09:37.228 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:37 smithi087 ceph-mon[30934]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T17:09:37.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:37 smithi118 ceph-mon[34374]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T17:09:37.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:37 smithi149 ceph-mon[35496]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T17:09:39.382 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:39 smithi087 ceph-mon[30934]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-13T17:09:39.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:39 smithi149 ceph-mon[35496]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-13T17:09:39.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:39 smithi118 ceph-mon[34374]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-13T17:09:40.370 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:40 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:09:40.370 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:40 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:40.370 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:40 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:40.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:40 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:09:40.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:40 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:40.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:40 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:40.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:40 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:09:40.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:40 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:40.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:40 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:41.373 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:41 smithi087 ceph-mon[30934]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-13T17:09:41.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:41 smithi149 ceph-mon[35496]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-13T17:09:41.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:41 smithi118 ceph-mon[34374]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-13T17:09:43.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:43 smithi087 ceph-mon[30934]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-13T17:09:43.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:43 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:43.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:43 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:43.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:43 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:43.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:43 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:09:43.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:43 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:43.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:43.538+0000 7ff11a7fc640 1 -- 172.21.15.87:0/1157771328 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff12402c550 con 0x7ff1100a1080 2024-09-13T17:09:43.540 INFO:teuthology.orchestra.run.smithi087.stdout:Created osd(s) 9 on host 'smithi087' 2024-09-13T17:09:43.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:43.540+0000 7ff12b26b640 1 -- 172.21.15.87:0/1157771328 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff1100a1080 msgr2=0x7ff1100a3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:43.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:43.540+0000 7ff12b26b640 1 --2- 172.21.15.87:0/1157771328 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff1100a1080 0x7ff1100a3540 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff1140057c0 tx=0x7ff114031420 comp rx=0 tx=0).stop 2024-09-13T17:09:43.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:43.540+0000 7ff12b26b640 1 -- 172.21.15.87:0/1157771328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1240ffe00 msgr2=0x7ff124195d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:43.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:43.540+0000 7ff12b26b640 1 --2- 172.21.15.87:0/1157771328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1240ffe00 0x7ff124195d30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff12000c920 tx=0x7ff12000cde0 comp rx=0 tx=0).stop 2024-09-13T17:09:43.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:43.540+0000 7ff12b26b640 1 -- 172.21.15.87:0/1157771328 shutdown_connections 2024-09-13T17:09:43.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:43.541+0000 7ff12b26b640 1 --2- 172.21.15.87:0/1157771328 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff1100a1080 0x7ff1100a3540 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:43.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:43.541+0000 7ff12b26b640 1 --2- 172.21.15.87:0/1157771328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff124101920 0x7ff12419d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:43.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:43.541+0000 7ff12b26b640 1 --2- 172.21.15.87:0/1157771328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff124100f60 0x7ff124196270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:43.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:43.541+0000 7ff12b26b640 1 --2- 172.21.15.87:0/1157771328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1240ffe00 0x7ff124195d30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:43.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:43.541+0000 7ff12b26b640 1 -- 172.21.15.87:0/1157771328 >> 172.21.15.87:0/1157771328 conn(0x7ff1240fb590 msgr2=0x7ff124104400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:43.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:43.541+0000 7ff12b26b640 1 -- 172.21.15.87:0/1157771328 shutdown_connections 2024-09-13T17:09:43.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:09:43.541+0000 7ff12b26b640 1 -- 172.21.15.87:0/1157771328 wait complete. 2024-09-13T17:09:43.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:43 smithi149 ceph-mon[35496]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-13T17:09:43.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:43 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:43.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:43 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:43.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:43 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:43.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:43 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:09:43.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:43 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:43.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:43 smithi118 ceph-mon[34374]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-13T17:09:43.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:43 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:43.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:43 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:43.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:43 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:43.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:43 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:09:43.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:43 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:44.179 DEBUG:teuthology.orchestra.run.smithi087:osd.9> sudo journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.9.service 2024-09-13T17:09:44.179 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:44 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:09:44.179 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:44 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:44.179 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:44 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:44.180 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:44 smithi087 ceph-mon[30934]: from='osd.9 [v2:172.21.15.87:6826/1453934262,v1:172.21.15.87:6827/1453934262]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-13T17:09:44.182 INFO:tasks.cephadm:Deploying osd.10 on smithi118 with /dev/vg_nvme/lv_1... 2024-09-13T17:09:44.182 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-09-13T17:09:44.386 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T17:09:44.506 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:44 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:09:44.506 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:44 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:44.507 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:44 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:44.507 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:44 smithi118 ceph-mon[34374]: from='osd.9 [v2:172.21.15.87:6826/1453934262,v1:172.21.15.87:6827/1453934262]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-13T17:09:44.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:44 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:09:44.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:44 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:44.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:44 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:44.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:44 smithi149 ceph-mon[35496]: from='osd.9 [v2:172.21.15.87:6826/1453934262,v1:172.21.15.87:6827/1453934262]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-13T17:09:45.464 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:45 smithi118 ceph-mon[34374]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-13T17:09:45.464 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:45 smithi118 ceph-mon[34374]: from='osd.9 [v2:172.21.15.87:6826/1453934262,v1:172.21.15.87:6827/1453934262]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-13T17:09:45.464 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:45 smithi118 ceph-mon[34374]: osdmap e65: 10 total, 9 up, 10 in 2024-09-13T17:09:45.464 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:45 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T17:09:45.464 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:45 smithi118 ceph-mon[34374]: from='osd.9 [v2:172.21.15.87:6826/1453934262,v1:172.21.15.87:6827/1453934262]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-13T17:09:45.472 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:45 smithi087 ceph-mon[30934]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-13T17:09:45.472 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:45 smithi087 ceph-mon[30934]: from='osd.9 [v2:172.21.15.87:6826/1453934262,v1:172.21.15.87:6827/1453934262]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-13T17:09:45.472 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:45 smithi087 ceph-mon[30934]: osdmap e65: 10 total, 9 up, 10 in 2024-09-13T17:09:45.472 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:45 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T17:09:45.473 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:45 smithi087 ceph-mon[30934]: from='osd.9 [v2:172.21.15.87:6826/1453934262,v1:172.21.15.87:6827/1453934262]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-13T17:09:45.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:45 smithi149 ceph-mon[35496]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-13T17:09:45.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:45 smithi149 ceph-mon[35496]: from='osd.9 [v2:172.21.15.87:6826/1453934262,v1:172.21.15.87:6827/1453934262]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-13T17:09:45.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:45 smithi149 ceph-mon[35496]: osdmap e65: 10 total, 9 up, 10 in 2024-09-13T17:09:45.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:45 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T17:09:45.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:45 smithi149 ceph-mon[35496]: from='osd.9 [v2:172.21.15.87:6826/1453934262,v1:172.21.15.87:6827/1453934262]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-13T17:09:46.043 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:09:45 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:09:45.976+0000 7fca72dac640 -1 osd.9 0 waiting for initial osdmap 2024-09-13T17:09:46.043 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:09:45 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:09:45.990+0000 7fca6abcd640 -1 osd.9 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:09:46.140 INFO:teuthology.orchestra.run.smithi118.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-09-13T17:09:46.224 INFO:teuthology.orchestra.run.smithi118.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-09-13T17:09:46.234 INFO:teuthology.orchestra.run.smithi118.stderr: stderr: 10+0 records in 2024-09-13T17:09:46.234 INFO:teuthology.orchestra.run.smithi118.stderr:10+0 records out 2024-09-13T17:09:46.234 INFO:teuthology.orchestra.run.smithi118.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00863906 s, 1.2 GB/s 2024-09-13T17:09:46.234 INFO:teuthology.orchestra.run.smithi118.stderr:--> Zapping successful for: 2024-09-13T17:09:46.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:46 smithi149 ceph-mon[35496]: from='osd.9 [v2:172.21.15.87:6826/1453934262,v1:172.21.15.87:6827/1453934262]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-09-13T17:09:46.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:46 smithi149 ceph-mon[35496]: osdmap e66: 10 total, 9 up, 10 in 2024-09-13T17:09:46.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:46 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T17:09:46.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:46 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T17:09:46.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:46 smithi149 ceph-mon[35496]: from='osd.9 [v2:172.21.15.87:6826/1453934262,v1:172.21.15.87:6827/1453934262]' entity='osd.9' 2024-09-13T17:09:46.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:46 smithi149 ceph-mon[35496]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-13T17:09:46.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:46 smithi118 ceph-mon[34374]: from='osd.9 [v2:172.21.15.87:6826/1453934262,v1:172.21.15.87:6827/1453934262]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-09-13T17:09:46.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:46 smithi118 ceph-mon[34374]: osdmap e66: 10 total, 9 up, 10 in 2024-09-13T17:09:46.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:46 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T17:09:46.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:46 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T17:09:46.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:46 smithi118 ceph-mon[34374]: from='osd.9 [v2:172.21.15.87:6826/1453934262,v1:172.21.15.87:6827/1453934262]' entity='osd.9' 2024-09-13T17:09:46.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:46 smithi118 ceph-mon[34374]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-13T17:09:46.880 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:46 smithi087 ceph-mon[30934]: from='osd.9 [v2:172.21.15.87:6826/1453934262,v1:172.21.15.87:6827/1453934262]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-09-13T17:09:46.880 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:46 smithi087 ceph-mon[30934]: osdmap e66: 10 total, 9 up, 10 in 2024-09-13T17:09:46.880 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:46 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T17:09:46.880 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:46 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T17:09:46.881 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:46 smithi087 ceph-mon[30934]: from='osd.9 [v2:172.21.15.87:6826/1453934262,v1:172.21.15.87:6827/1453934262]' entity='osd.9' 2024-09-13T17:09:46.881 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:46 smithi087 ceph-mon[30934]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-13T17:09:46.934 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi118:vg_nvme/lv_1 2024-09-13T17:09:47.131 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T17:09:47.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:47 smithi149 ceph-mon[35496]: purged_snaps scrub starts 2024-09-13T17:09:47.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:47 smithi149 ceph-mon[35496]: purged_snaps scrub ok 2024-09-13T17:09:47.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:47 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T17:09:47.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:47 smithi149 ceph-mon[35496]: osd.9 [v2:172.21.15.87:6826/1453934262,v1:172.21.15.87:6827/1453934262] boot 2024-09-13T17:09:47.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:47 smithi149 ceph-mon[35496]: osdmap e67: 10 total, 10 up, 10 in 2024-09-13T17:09:47.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:47 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T17:09:47.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:47 smithi149 ceph-mon[35496]: Detected new or changed devices on smithi087 2024-09-13T17:09:47.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:47 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:47.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:47 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:47.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:47 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:09:47.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:47 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:09:47.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:47 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:09:47.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:47 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:09:47.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:47 smithi149 ceph-mon[35496]: Adjusting osd_memory_target on smithi087 to 4272M 2024-09-13T17:09:47.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:47 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:47.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:47 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:47.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:47 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:09:47.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:47 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:47.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:47 smithi118 ceph-mon[34374]: purged_snaps scrub starts 2024-09-13T17:09:47.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:47 smithi118 ceph-mon[34374]: purged_snaps scrub ok 2024-09-13T17:09:47.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:47 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T17:09:47.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:47 smithi118 ceph-mon[34374]: osd.9 [v2:172.21.15.87:6826/1453934262,v1:172.21.15.87:6827/1453934262] boot 2024-09-13T17:09:47.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:47 smithi118 ceph-mon[34374]: osdmap e67: 10 total, 10 up, 10 in 2024-09-13T17:09:47.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:47 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T17:09:47.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:47 smithi118 ceph-mon[34374]: Detected new or changed devices on smithi087 2024-09-13T17:09:47.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:47 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:47.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:47 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:47.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:47 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:09:47.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:47 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:09:47.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:47 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:09:47.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:47 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:09:47.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:47 smithi118 ceph-mon[34374]: Adjusting osd_memory_target on smithi087 to 4272M 2024-09-13T17:09:47.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:47 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:47.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:47 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:47.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:47 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:09:47.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:47 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:47.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:47 smithi087 ceph-mon[30934]: purged_snaps scrub starts 2024-09-13T17:09:47.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:47 smithi087 ceph-mon[30934]: purged_snaps scrub ok 2024-09-13T17:09:47.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:47 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T17:09:47.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:47 smithi087 ceph-mon[30934]: osd.9 [v2:172.21.15.87:6826/1453934262,v1:172.21.15.87:6827/1453934262] boot 2024-09-13T17:09:47.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:47 smithi087 ceph-mon[30934]: osdmap e67: 10 total, 10 up, 10 in 2024-09-13T17:09:47.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:47 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T17:09:47.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:47 smithi087 ceph-mon[30934]: Detected new or changed devices on smithi087 2024-09-13T17:09:47.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:47 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:47.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:47 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:47.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:47 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:09:47.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:47 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:09:47.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:47 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:09:47.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:47 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:09:47.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:47 smithi087 ceph-mon[30934]: Adjusting osd_memory_target on smithi087 to 4272M 2024-09-13T17:09:47.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:47 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:47.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:47 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:47.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:47 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:09:47.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:47 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:09:48.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:48 smithi118 ceph-mon[34374]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-13T17:09:48.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.713+0000 7f2258353640 1 -- 172.21.15.118:0/1225136604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2250105b90 msgr2=0x7f2250107f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:48.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.713+0000 7f2258353640 1 --2- 172.21.15.118:0/1225136604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2250105b90 0x7f2250107f80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2248009ca0 tx=0x7f224802a8c0 comp rx=0 tx=0).stop 2024-09-13T17:09:48.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.713+0000 7f2258353640 1 -- 172.21.15.118:0/1225136604 shutdown_connections 2024-09-13T17:09:48.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.713+0000 7f2258353640 1 --2- 172.21.15.118:0/1225136604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2250105b90 0x7f2250107f80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:48.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.713+0000 7f2258353640 1 --2- 172.21.15.118:0/1225136604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2250103260 0x7f2250105650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:48.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.713+0000 7f2258353640 1 --2- 172.21.15.118:0/1225136604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2250100930 0x7f2250102d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:48.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.713+0000 7f2258353640 1 -- 172.21.15.118:0/1225136604 >> 172.21.15.118:0/1225136604 conn(0x7f22500fa490 msgr2=0x7f22500fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:09:48.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.713+0000 7f2258353640 1 -- 172.21.15.118:0/1225136604 shutdown_connections 2024-09-13T17:09:48.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.713+0000 7f2258353640 1 -- 172.21.15.118:0/1225136604 wait complete. 2024-09-13T17:09:48.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.714+0000 7f2258353640 1 Processor -- start 2024-09-13T17:09:48.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.714+0000 7f2258353640 1 -- start start 2024-09-13T17:09:48.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.714+0000 7f2258353640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2250100930 0x7f2250195d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:48.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.714+0000 7f2258353640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2250103260 0x7f2250196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:48.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.714+0000 7f2258353640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2250105b90 0x7f225019d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:48.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.714+0000 7f2258353640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225019d850 con 0x7f2250103260 2024-09-13T17:09:48.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.714+0000 7f2258353640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225019d9c0 con 0x7f2250105b90 2024-09-13T17:09:48.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.714+0000 7f2258353640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225019db80 con 0x7f2250100930 2024-09-13T17:09:48.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.714+0000 7f22568f0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2250105b90 0x7f225019d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:48.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.714+0000 7f22568f0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2250105b90 0x7f225019d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55150/0 (socket says 172.21.15.118:55150) 2024-09-13T17:09:48.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.714+0000 7f22568f0640 1 -- 172.21.15.118:0/3383316782 learned_addr learned my addr 172.21.15.118:0/3383316782 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-09-13T17:09:48.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.714+0000 7f22558ee640 1 --2- 172.21.15.118:0/3383316782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2250103260 0x7f2250196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:48.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.714+0000 7f22560ef640 1 --2- 172.21.15.118:0/3383316782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2250100930 0x7f2250195d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:48.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.714+0000 7f22568f0640 1 -- 172.21.15.118:0/3383316782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2250100930 msgr2=0x7f2250195d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:48.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.714+0000 7f22568f0640 1 --2- 172.21.15.118:0/3383316782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2250100930 0x7f2250195d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:48.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.715+0000 7f22568f0640 1 -- 172.21.15.118:0/3383316782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2250103260 msgr2=0x7f2250196290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:09:48.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.715+0000 7f22568f0640 1 --2- 172.21.15.118:0/3383316782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2250103260 0x7f2250196290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:09:48.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.715+0000 7f22568f0640 1 -- 172.21.15.118:0/3383316782 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2248009900 con 0x7f2250105b90 2024-09-13T17:09:48.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.715+0000 7f22560ef640 1 --2- 172.21.15.118:0/3383316782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2250100930 0x7f2250195d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:09:48.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.715+0000 7f22568f0640 1 --2- 172.21.15.118:0/3383316782 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2250105b90 0x7f225019d310 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f22480097b0 tx=0x7f2248003c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:48.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.715+0000 7f22477fe640 1 -- 172.21.15.118:0/3383316782 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22480307c0 con 0x7f2250105b90 2024-09-13T17:09:48.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.715+0000 7f22477fe640 1 -- 172.21.15.118:0/3383316782 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2248040070 con 0x7f2250105b90 2024-09-13T17:09:48.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.715+0000 7f2258353640 1 -- 172.21.15.118:0/3383316782 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f225019de00 con 0x7f2250105b90 2024-09-13T17:09:48.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.715+0000 7f22477fe640 1 -- 172.21.15.118:0/3383316782 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2248004540 con 0x7f2250105b90 2024-09-13T17:09:48.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.715+0000 7f2258353640 1 -- 172.21.15.118:0/3383316782 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f225019e2d0 con 0x7f2250105b90 2024-09-13T17:09:48.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.716+0000 7f2258353640 1 -- 172.21.15.118:0/3383316782 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22500fbf80 con 0x7f2250105b90 2024-09-13T17:09:48.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.717+0000 7f22477fe640 1 -- 172.21.15.118:0/3383316782 <== mon.2 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2248042030 con 0x7f2250105b90 2024-09-13T17:09:48.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.718+0000 7f22477fe640 1 --2- 172.21.15.118:0/3383316782 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f223c0a1130 0x7f223c0a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:09:48.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.718+0000 7f22477fe640 1 -- 172.21.15.118:0/3383316782 <== mon.2 v2:172.21.15.118:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f22480ed7b0 con 0x7f2250105b90 2024-09-13T17:09:48.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.718+0000 7f22560ef640 1 --2- 172.21.15.118:0/3383316782 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f223c0a1130 0x7f223c0a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:09:48.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.718+0000 7f22560ef640 1 --2- 172.21.15.118:0/3383316782 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f223c0a1130 0x7f223c0a35f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f224c005d00 tx=0x7f224c005ed0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:09:48.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.721+0000 7f22477fe640 1 -- 172.21.15.118:0/3383316782 <== mon.2 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f22480b7740 con 0x7f2250105b90 2024-09-13T17:09:48.812 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:48 smithi087 ceph-mon[30934]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-13T17:09:48.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:48 smithi149 ceph-mon[35496]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-13T17:09:48.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:09:48.891+0000 7f2258353640 1 -- 172.21.15.118:0/3383316782 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f225002c4f0 con 0x7f223c0a1130 2024-09-13T17:09:49.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:49 smithi149 ceph-mon[35496]: osdmap e68: 10 total, 10 up, 10 in 2024-09-13T17:09:49.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:49 smithi149 ceph-mon[35496]: from='client.24317 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:09:49.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:09:49.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:09:49.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:49.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:49 smithi118 ceph-mon[34374]: osdmap e68: 10 total, 10 up, 10 in 2024-09-13T17:09:49.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:49 smithi118 ceph-mon[34374]: from='client.24317 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:09:49.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:09:49.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:09:49.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:49.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:49 smithi087 ceph-mon[30934]: osdmap e68: 10 total, 10 up, 10 in 2024-09-13T17:09:49.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:49 smithi087 ceph-mon[30934]: from='client.24317 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:09:49.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:09:49.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:09:49.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:50.828 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:50 smithi118 ceph-mon[34374]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-13T17:09:50.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:50 smithi149 ceph-mon[35496]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-13T17:09:50.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:50 smithi087 ceph-mon[30934]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-13T17:09:51.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:51 smithi118 ceph-mon[34374]: from='client.? 172.21.15.118:0/3002222501' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "24238714-e737-4371-b5d5-0cd3395f09bd"}]: dispatch 2024-09-13T17:09:51.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:51 smithi118 ceph-mon[34374]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "24238714-e737-4371-b5d5-0cd3395f09bd"}]: dispatch 2024-09-13T17:09:51.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:51 smithi118 ceph-mon[34374]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "24238714-e737-4371-b5d5-0cd3395f09bd"}]': finished 2024-09-13T17:09:51.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:51 smithi118 ceph-mon[34374]: osdmap e69: 11 total, 10 up, 11 in 2024-09-13T17:09:51.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:51 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T17:09:51.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:51 smithi149 ceph-mon[35496]: from='client.? 172.21.15.118:0/3002222501' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "24238714-e737-4371-b5d5-0cd3395f09bd"}]: dispatch 2024-09-13T17:09:51.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:51 smithi149 ceph-mon[35496]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "24238714-e737-4371-b5d5-0cd3395f09bd"}]: dispatch 2024-09-13T17:09:51.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:51 smithi149 ceph-mon[35496]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "24238714-e737-4371-b5d5-0cd3395f09bd"}]': finished 2024-09-13T17:09:51.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:51 smithi149 ceph-mon[35496]: osdmap e69: 11 total, 10 up, 11 in 2024-09-13T17:09:51.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:51 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T17:09:51.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:51 smithi087 ceph-mon[30934]: from='client.? 172.21.15.118:0/3002222501' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "24238714-e737-4371-b5d5-0cd3395f09bd"}]: dispatch 2024-09-13T17:09:51.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:51 smithi087 ceph-mon[30934]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "24238714-e737-4371-b5d5-0cd3395f09bd"}]: dispatch 2024-09-13T17:09:51.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:51 smithi087 ceph-mon[30934]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "24238714-e737-4371-b5d5-0cd3395f09bd"}]': finished 2024-09-13T17:09:51.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:51 smithi087 ceph-mon[30934]: osdmap e69: 11 total, 10 up, 11 in 2024-09-13T17:09:51.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:51 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T17:09:52.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:52 smithi149 ceph-mon[35496]: from='client.? 172.21.15.118:0/3606420266' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:09:52.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:52 smithi149 ceph-mon[35496]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-13T17:09:52.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:52 smithi118 ceph-mon[34374]: from='client.? 172.21.15.118:0/3606420266' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:09:52.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:52 smithi118 ceph-mon[34374]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-13T17:09:52.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:52 smithi087 ceph-mon[30934]: from='client.? 172.21.15.118:0/3606420266' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:09:52.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:52 smithi087 ceph-mon[30934]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-13T17:09:55.277 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:55 smithi118 ceph-mon[34374]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-13T17:09:55.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:55 smithi087 ceph-mon[30934]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-13T17:09:55.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:55 smithi149 ceph-mon[35496]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-13T17:09:57.247 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:57 smithi118 ceph-mon[34374]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-13T17:09:57.394 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:57 smithi149 ceph-mon[35496]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-13T17:09:57.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:57 smithi087 ceph-mon[30934]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-13T17:09:58.333 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:58 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-13T17:09:58.333 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:58 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:58.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:58 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-13T17:09:58.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:58 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:58.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:58 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-13T17:09:58.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:58 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:09:59.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:59 smithi118 ceph-mon[34374]: Deploying daemon osd.10 on smithi118 2024-09-13T17:09:59.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:09:59 smithi118 ceph-mon[34374]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-13T17:09:59.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:59 smithi087 ceph-mon[30934]: Deploying daemon osd.10 on smithi118 2024-09-13T17:09:59.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:09:59 smithi087 ceph-mon[30934]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-13T17:09:59.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:59 smithi149 ceph-mon[35496]: Deploying daemon osd.10 on smithi118 2024-09-13T17:09:59.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:09:59 smithi149 ceph-mon[35496]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-13T17:10:00.259 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:00 smithi118 ceph-mon[34374]: overall HEALTH_OK 2024-09-13T17:10:00.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:00 smithi087 ceph-mon[30934]: overall HEALTH_OK 2024-09-13T17:10:00.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:00 smithi149 ceph-mon[35496]: overall HEALTH_OK 2024-09-13T17:10:01.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:01 smithi118 ceph-mon[34374]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-13T17:10:01.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:01 smithi087 ceph-mon[30934]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-13T17:10:01.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:01 smithi149 ceph-mon[35496]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-13T17:10:03.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:03 smithi087 ceph-mon[30934]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-13T17:10:03.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:03 smithi149 ceph-mon[35496]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-13T17:10:03.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:03 smithi118 ceph-mon[34374]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-13T17:10:04.350 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:04 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:10:04.350 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:04 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:04.350 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:04 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:04.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:04 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:10:04.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:04 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:04.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:04 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:04.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:04 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:10:04.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:04 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:04.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:04 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:05.547 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:05 smithi118 ceph-mon[34374]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-13T17:10:05.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:05 smithi149 ceph-mon[35496]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-13T17:10:05.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:05 smithi087 ceph-mon[30934]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-13T17:10:06.424 INFO:teuthology.orchestra.run.smithi118.stdout:Created osd(s) 10 on host 'smithi118' 2024-09-13T17:10:06.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:10:06.423+0000 7f22477fe640 1 -- 172.21.15.118:0/3383316782 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f225002c4f0 con 0x7f223c0a1130 2024-09-13T17:10:06.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:10:06.426+0000 7f2258353640 1 -- 172.21.15.118:0/3383316782 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f223c0a1130 msgr2=0x7f223c0a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:06.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:10:06.426+0000 7f2258353640 1 --2- 172.21.15.118:0/3383316782 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f223c0a1130 0x7f223c0a35f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f224c005d00 tx=0x7f224c005ed0 comp rx=0 tx=0).stop 2024-09-13T17:10:06.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:10:06.426+0000 7f2258353640 1 -- 172.21.15.118:0/3383316782 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2250105b90 msgr2=0x7f225019d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:06.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:10:06.426+0000 7f2258353640 1 --2- 172.21.15.118:0/3383316782 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2250105b90 0x7f225019d310 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f22480097b0 tx=0x7f2248003c20 comp rx=0 tx=0).stop 2024-09-13T17:10:06.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:10:06.426+0000 7f2258353640 1 -- 172.21.15.118:0/3383316782 shutdown_connections 2024-09-13T17:10:06.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:10:06.426+0000 7f2258353640 1 --2- 172.21.15.118:0/3383316782 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f223c0a1130 0x7f223c0a35f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:06.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:10:06.426+0000 7f2258353640 1 --2- 172.21.15.118:0/3383316782 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2250105b90 0x7f225019d310 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:06.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:10:06.426+0000 7f2258353640 1 --2- 172.21.15.118:0/3383316782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2250103260 0x7f2250196290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:06.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:10:06.426+0000 7f2258353640 1 --2- 172.21.15.118:0/3383316782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2250100930 0x7f2250195d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:06.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:10:06.426+0000 7f2258353640 1 -- 172.21.15.118:0/3383316782 >> 172.21.15.118:0/3383316782 conn(0x7f22500fa490 msgr2=0x7f22501013b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:06.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:10:06.426+0000 7f2258353640 1 -- 172.21.15.118:0/3383316782 shutdown_connections 2024-09-13T17:10:06.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-09-13T17:10:06.426+0000 7f2258353640 1 -- 172.21.15.118:0/3383316782 wait complete. 2024-09-13T17:10:07.064 DEBUG:teuthology.orchestra.run.smithi118:osd.10> sudo journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.10.service 2024-09-13T17:10:07.066 INFO:tasks.cephadm:Deploying osd.11 on smithi149 with /dev/vg_nvme/lv_1... 2024-09-13T17:10:07.067 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-09-13T17:10:07.279 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T17:10:07.365 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:07 smithi118 ceph-mon[34374]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-13T17:10:07.365 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:07 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:07.365 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:07 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:07.365 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:07 smithi118 ceph-mon[34374]: from='osd.10 [v2:172.21.15.118:6824/1034318850,v1:172.21.15.118:6825/1034318850]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T17:10:07.365 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:07 smithi118 ceph-mon[34374]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T17:10:07.365 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:07 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:07.366 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:07 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:07.366 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:10:07 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:10:07.166+0000 7f466fd44640 -1 osd.10 0 log_to_monitors true 2024-09-13T17:10:07.400 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:07 smithi149 ceph-mon[35496]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-13T17:10:07.401 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:07 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:07.401 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:07 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:07.401 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:07 smithi149 ceph-mon[35496]: from='osd.10 [v2:172.21.15.118:6824/1034318850,v1:172.21.15.118:6825/1034318850]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T17:10:07.401 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:07 smithi149 ceph-mon[35496]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T17:10:07.401 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:07 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:07.401 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:07 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:07.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:07 smithi087 ceph-mon[30934]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-13T17:10:07.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:07 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:07.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:07 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:07.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:07 smithi087 ceph-mon[30934]: from='osd.10 [v2:172.21.15.118:6824/1034318850,v1:172.21.15.118:6825/1034318850]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T17:10:07.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:07 smithi087 ceph-mon[30934]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T17:10:07.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:07 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:07.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:07 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:08.686 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:08 smithi149 ceph-mon[35496]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-13T17:10:08.686 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:08 smithi149 ceph-mon[35496]: osdmap e70: 11 total, 10 up, 11 in 2024-09-13T17:10:08.686 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:08 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T17:10:08.686 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:08 smithi149 ceph-mon[35496]: from='osd.10 [v2:172.21.15.118:6824/1034318850,v1:172.21.15.118:6825/1034318850]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2024-09-13T17:10:08.686 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:08 smithi149 ceph-mon[35496]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2024-09-13T17:10:08.687 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:08 smithi149 ceph-mon[35496]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-13T17:10:08.709 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:08 smithi118 ceph-mon[34374]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-13T17:10:08.709 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:08 smithi118 ceph-mon[34374]: osdmap e70: 11 total, 10 up, 11 in 2024-09-13T17:10:08.709 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:08 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T17:10:08.709 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:08 smithi118 ceph-mon[34374]: from='osd.10 [v2:172.21.15.118:6824/1034318850,v1:172.21.15.118:6825/1034318850]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2024-09-13T17:10:08.709 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:08 smithi118 ceph-mon[34374]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2024-09-13T17:10:08.709 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:08 smithi118 ceph-mon[34374]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-13T17:10:08.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:08 smithi087 ceph-mon[30934]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-13T17:10:08.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:08 smithi087 ceph-mon[30934]: osdmap e70: 11 total, 10 up, 11 in 2024-09-13T17:10:08.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:08 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T17:10:08.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:08 smithi087 ceph-mon[30934]: from='osd.10 [v2:172.21.15.118:6824/1034318850,v1:172.21.15.118:6825/1034318850]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2024-09-13T17:10:08.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:08 smithi087 ceph-mon[30934]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2024-09-13T17:10:08.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:08 smithi087 ceph-mon[30934]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-13T17:10:09.049 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:10:08 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:10:08.833+0000 7f466c4dc640 -1 osd.10 0 waiting for initial osdmap 2024-09-13T17:10:09.049 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:10:08 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:10:08.848+0000 7f4663ae6640 -1 osd.10 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:10:09.133 INFO:teuthology.orchestra.run.smithi149.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-09-13T17:10:09.215 INFO:teuthology.orchestra.run.smithi149.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-09-13T17:10:09.229 INFO:teuthology.orchestra.run.smithi149.stderr: stderr: 10+0 records in 2024-09-13T17:10:09.229 INFO:teuthology.orchestra.run.smithi149.stderr:10+0 records out 2024-09-13T17:10:09.229 INFO:teuthology.orchestra.run.smithi149.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115867 s, 905 MB/s 2024-09-13T17:10:09.229 INFO:teuthology.orchestra.run.smithi149.stderr:--> Zapping successful for: 2024-09-13T17:10:09.518 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:09 smithi149 ceph-mon[35496]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2024-09-13T17:10:09.519 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:09 smithi149 ceph-mon[35496]: osdmap e71: 11 total, 10 up, 11 in 2024-09-13T17:10:09.519 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:09 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T17:10:09.519 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:09 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T17:10:09.519 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:09 smithi149 ceph-mon[35496]: from='osd.10 ' entity='osd.10' 2024-09-13T17:10:09.519 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:09 smithi149 ceph-mon[35496]: osd.10 [v2:172.21.15.118:6824/1034318850,v1:172.21.15.118:6825/1034318850] boot 2024-09-13T17:10:09.519 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:09 smithi149 ceph-mon[35496]: osdmap e72: 11 total, 11 up, 11 in 2024-09-13T17:10:09.519 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:09 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T17:10:09.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:09 smithi087 ceph-mon[30934]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2024-09-13T17:10:09.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:09 smithi087 ceph-mon[30934]: osdmap e71: 11 total, 10 up, 11 in 2024-09-13T17:10:09.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:09 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T17:10:09.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:09 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T17:10:09.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:09 smithi087 ceph-mon[30934]: from='osd.10 ' entity='osd.10' 2024-09-13T17:10:09.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:09 smithi087 ceph-mon[30934]: osd.10 [v2:172.21.15.118:6824/1034318850,v1:172.21.15.118:6825/1034318850] boot 2024-09-13T17:10:09.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:09 smithi087 ceph-mon[30934]: osdmap e72: 11 total, 11 up, 11 in 2024-09-13T17:10:09.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:09 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T17:10:09.730 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:09 smithi118 ceph-mon[34374]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2024-09-13T17:10:09.730 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:09 smithi118 ceph-mon[34374]: osdmap e71: 11 total, 10 up, 11 in 2024-09-13T17:10:09.730 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:09 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T17:10:09.730 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:09 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T17:10:09.730 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:09 smithi118 ceph-mon[34374]: from='osd.10 ' entity='osd.10' 2024-09-13T17:10:09.730 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:09 smithi118 ceph-mon[34374]: osd.10 [v2:172.21.15.118:6824/1034318850,v1:172.21.15.118:6825/1034318850] boot 2024-09-13T17:10:09.730 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:09 smithi118 ceph-mon[34374]: osdmap e72: 11 total, 11 up, 11 in 2024-09-13T17:10:09.730 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:09 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T17:10:09.935 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi149:vg_nvme/lv_1 2024-09-13T17:10:10.136 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T17:10:10.508 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:10 smithi149 ceph-mon[35496]: purged_snaps scrub starts 2024-09-13T17:10:10.509 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:10 smithi149 ceph-mon[35496]: purged_snaps scrub ok 2024-09-13T17:10:10.509 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:10 smithi149 ceph-mon[35496]: pgmap v223: 1 pgs: 1 peering; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-13T17:10:10.509 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:10 smithi149 ceph-mon[35496]: osdmap e73: 11 total, 11 up, 11 in 2024-09-13T17:10:10.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:10 smithi087 ceph-mon[30934]: purged_snaps scrub starts 2024-09-13T17:10:10.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:10 smithi087 ceph-mon[30934]: purged_snaps scrub ok 2024-09-13T17:10:10.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:10 smithi087 ceph-mon[30934]: pgmap v223: 1 pgs: 1 peering; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-13T17:10:10.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:10 smithi087 ceph-mon[30934]: osdmap e73: 11 total, 11 up, 11 in 2024-09-13T17:10:10.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:10 smithi118 ceph-mon[34374]: purged_snaps scrub starts 2024-09-13T17:10:10.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:10 smithi118 ceph-mon[34374]: purged_snaps scrub ok 2024-09-13T17:10:10.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:10 smithi118 ceph-mon[34374]: pgmap v223: 1 pgs: 1 peering; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-13T17:10:10.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:10 smithi118 ceph-mon[34374]: osdmap e73: 11 total, 11 up, 11 in 2024-09-13T17:10:11.716 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.696+0000 7f4fbdf62640 1 -- 172.21.15.149:0/3336927039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fb8100890 msgr2=0x7f4fb8102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:11.716 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.696+0000 7f4fbdf62640 1 --2- 172.21.15.149:0/3336927039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fb8100890 0x7f4fb8102c80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8009ca0 tx=0x7f4fa802a8c0 comp rx=0 tx=0).stop 2024-09-13T17:10:11.716 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.696+0000 7f4fbdf62640 1 -- 172.21.15.149:0/3336927039 shutdown_connections 2024-09-13T17:10:11.716 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.697+0000 7f4fbdf62640 1 --2- 172.21.15.149:0/3336927039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4fb8105af0 0x7f4fb8107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:11.716 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.697+0000 7f4fbdf62640 1 --2- 172.21.15.149:0/3336927039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fb81031c0 0x7f4fb81055b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:11.716 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.697+0000 7f4fbdf62640 1 --2- 172.21.15.149:0/3336927039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fb8100890 0x7f4fb8102c80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:11.717 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.697+0000 7f4fbdf62640 1 -- 172.21.15.149:0/3336927039 >> 172.21.15.149:0/3336927039 conn(0x7f4fb80fa490 msgr2=0x7f4fb80fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:11.717 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.697+0000 7f4fbdf62640 1 -- 172.21.15.149:0/3336927039 shutdown_connections 2024-09-13T17:10:11.717 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.697+0000 7f4fbdf62640 1 -- 172.21.15.149:0/3336927039 wait complete. 2024-09-13T17:10:11.717 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.697+0000 7f4fbdf62640 1 Processor -- start 2024-09-13T17:10:11.717 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.697+0000 7f4fbdf62640 1 -- start start 2024-09-13T17:10:11.717 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.697+0000 7f4fbdf62640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4fb8100890 0x7f4fb81001f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:11.717 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.698+0000 7f4fbdf62640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fb81031c0 0x7f4fb80fe840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:11.717 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.698+0000 7f4fbdf62640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fb8105af0 0x7f4fb80fed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:11.717 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.698+0000 7f4fbdf62640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb80ff510 con 0x7f4fb8100890 2024-09-13T17:10:11.717 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.698+0000 7f4fbdf62640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb80ff680 con 0x7f4fb8105af0 2024-09-13T17:10:11.717 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.698+0000 7f4fbdf62640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb819fe20 con 0x7f4fb81031c0 2024-09-13T17:10:11.718 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.698+0000 7f4fb6ffd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fb81031c0 0x7f4fb80fe840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:11.718 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.698+0000 7f4fb6ffd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fb81031c0 0x7f4fb80fe840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36150/0 (socket says 172.21.15.149:36150) 2024-09-13T17:10:11.718 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.698+0000 7f4fb6ffd640 1 -- 172.21.15.149:0/3902829133 learned_addr learned my addr 172.21.15.149:0/3902829133 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-13T17:10:11.718 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.698+0000 7f4fb7fff640 1 --2- 172.21.15.149:0/3902829133 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fb8105af0 0x7f4fb80fed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:11.718 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.698+0000 7f4fb77fe640 1 --2- 172.21.15.149:0/3902829133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4fb8100890 0x7f4fb81001f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:11.718 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.698+0000 7f4fb6ffd640 1 -- 172.21.15.149:0/3902829133 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fb8105af0 msgr2=0x7f4fb80fed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:11.718 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.698+0000 7f4fb6ffd640 1 --2- 172.21.15.149:0/3902829133 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fb8105af0 0x7f4fb80fed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:11.718 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.698+0000 7f4fb6ffd640 1 -- 172.21.15.149:0/3902829133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4fb8100890 msgr2=0x7f4fb81001f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:11.718 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.698+0000 7f4fb6ffd640 1 --2- 172.21.15.149:0/3902829133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4fb8100890 0x7f4fb81001f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:11.718 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.698+0000 7f4fb6ffd640 1 -- 172.21.15.149:0/3902829133 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa8009900 con 0x7f4fb81031c0 2024-09-13T17:10:11.718 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.698+0000 7f4fb77fe640 1 --2- 172.21.15.149:0/3902829133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4fb8100890 0x7f4fb81001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:10:11.719 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.698+0000 7f4fb6ffd640 1 --2- 172.21.15.149:0/3902829133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fb81031c0 0x7f4fb80fe840 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4fac00d770 tx=0x7f4fac00dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:11.719 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.698+0000 7f4fb4ff9640 1 -- 172.21.15.149:0/3902829133 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac009c30 con 0x7f4fb81031c0 2024-09-13T17:10:11.719 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.698+0000 7f4fb4ff9640 1 -- 172.21.15.149:0/3902829133 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4fac00de80 con 0x7f4fb81031c0 2024-09-13T17:10:11.719 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.698+0000 7f4fbdf62640 1 -- 172.21.15.149:0/3902829133 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb81a00d0 con 0x7f4fb81031c0 2024-09-13T17:10:11.719 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.698+0000 7f4fb4ff9640 1 -- 172.21.15.149:0/3902829133 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac004e70 con 0x7f4fb81031c0 2024-09-13T17:10:11.719 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.698+0000 7f4fbdf62640 1 -- 172.21.15.149:0/3902829133 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb81a05d0 con 0x7f4fb81031c0 2024-09-13T17:10:11.719 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.699+0000 7f4fbdf62640 1 -- 172.21.15.149:0/3902829133 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb80fbf80 con 0x7f4fb81031c0 2024-09-13T17:10:11.719 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.700+0000 7f4fb4ff9640 1 -- 172.21.15.149:0/3902829133 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4fac005020 con 0x7f4fb81031c0 2024-09-13T17:10:11.719 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.701+0000 7f4fb4ff9640 1 --2- 172.21.15.149:0/3902829133 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f4fa00a1100 0x7f4fa00a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:11.719 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.701+0000 7f4fb4ff9640 1 -- 172.21.15.149:0/3902829133 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6723+0+0 (secure 0 0 0) 0x7f4fac0cbba0 con 0x7f4fb81031c0 2024-09-13T17:10:11.719 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.702+0000 7f4fb77fe640 1 --2- 172.21.15.149:0/3902829133 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f4fa00a1100 0x7f4fa00a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:11.720 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.702+0000 7f4fb77fe640 1 --2- 172.21.15.149:0/3902829133 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f4fa00a1100 0x7f4fa00a35c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8006010 tx=0x7f4fa8009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:11.720 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.706+0000 7f4fb4ff9640 1 -- 172.21.15.149:0/3902829133 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4fac095960 con 0x7f4fb81031c0 2024-09-13T17:10:11.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:11 smithi149 ceph-mon[35496]: Detected new or changed devices on smithi118 2024-09-13T17:10:11.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:11 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:11.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:11 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:11.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:11 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:10:11.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:11 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:10:11.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:11 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:10:11.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:11 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:10:11.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:11 smithi149 ceph-mon[35496]: Adjusting osd_memory_target on smithi118 to 4272M 2024-09-13T17:10:11.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:11 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:11.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:11 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:11.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:11 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:10:11.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:11 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:11.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:11 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:10:11.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:11 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:11.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:11 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:10:11.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:11 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:11.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:11 smithi149 ceph-mon[35496]: osdmap e74: 11 total, 11 up, 11 in 2024-09-13T17:10:11.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:11 smithi118 ceph-mon[34374]: Detected new or changed devices on smithi118 2024-09-13T17:10:11.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:11 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:11.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:11 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:11.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:11 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:10:11.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:11 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:10:11.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:11 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:10:11.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:11 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:10:11.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:11 smithi118 ceph-mon[34374]: Adjusting osd_memory_target on smithi118 to 4272M 2024-09-13T17:10:11.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:11 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:11.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:11 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:11.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:11 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:10:11.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:11 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:11.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:11 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:10:11.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:11 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:11.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:11 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:10:11.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:11 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:11.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:11 smithi118 ceph-mon[34374]: osdmap e74: 11 total, 11 up, 11 in 2024-09-13T17:10:11.879 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:11.877+0000 7f4fbdf62640 1 -- 172.21.15.149:0/3902829133 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f4fb802c450 con 0x7f4fa00a1100 2024-09-13T17:10:11.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:11 smithi087 ceph-mon[30934]: Detected new or changed devices on smithi118 2024-09-13T17:10:11.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:11 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:11.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:11 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:11.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:11 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:10:11.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:11 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:10:11.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:11 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:10:11.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:11 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:10:11.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:11 smithi087 ceph-mon[30934]: Adjusting osd_memory_target on smithi118 to 4272M 2024-09-13T17:10:11.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:11 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:11.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:11 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:11.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:11 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:10:11.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:11 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:11.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:11 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:10:11.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:11 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:11.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:11 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:10:11.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:11 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:11.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:11 smithi087 ceph-mon[30934]: osdmap e74: 11 total, 11 up, 11 in 2024-09-13T17:10:12.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:12 smithi149 ceph-mon[35496]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:10:12.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:12 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:10:12.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:12 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:10:12.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:12 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:12.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:12 smithi149 ceph-mon[35496]: pgmap v226: 1 pgs: 1 peering; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-13T17:10:12.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:12 smithi149 ceph-mon[35496]: osdmap e75: 11 total, 11 up, 11 in 2024-09-13T17:10:12.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:12 smithi118 ceph-mon[34374]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:10:12.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:12 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:10:12.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:12 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:10:12.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:12 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:12.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:12 smithi118 ceph-mon[34374]: pgmap v226: 1 pgs: 1 peering; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-13T17:10:12.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:12 smithi118 ceph-mon[34374]: osdmap e75: 11 total, 11 up, 11 in 2024-09-13T17:10:12.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:12 smithi087 ceph-mon[30934]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:10:12.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:12 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:10:12.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:12 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:10:12.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:12 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:12.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:12 smithi087 ceph-mon[30934]: pgmap v226: 1 pgs: 1 peering; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-13T17:10:12.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:12 smithi087 ceph-mon[30934]: osdmap e75: 11 total, 11 up, 11 in 2024-09-13T17:10:14.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:14 smithi087 ceph-mon[30934]: osdmap e76: 11 total, 11 up, 11 in 2024-09-13T17:10:14.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:14 smithi087 ceph-mon[30934]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-13T17:10:14.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:14 smithi087 ceph-mon[30934]: from='client.? 172.21.15.149:0/1883852593' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "409dd3bf-5154-4dea-8708-7de7f9e2e793"}]: dispatch 2024-09-13T17:10:14.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:14 smithi087 ceph-mon[30934]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "409dd3bf-5154-4dea-8708-7de7f9e2e793"}]: dispatch 2024-09-13T17:10:14.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:14 smithi087 ceph-mon[30934]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "409dd3bf-5154-4dea-8708-7de7f9e2e793"}]': finished 2024-09-13T17:10:14.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:14 smithi087 ceph-mon[30934]: osdmap e77: 12 total, 11 up, 12 in 2024-09-13T17:10:14.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:14 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T17:10:14.835 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:14 smithi149 ceph-mon[35496]: osdmap e76: 11 total, 11 up, 11 in 2024-09-13T17:10:14.835 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:14 smithi149 ceph-mon[35496]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-13T17:10:14.835 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:14 smithi149 ceph-mon[35496]: from='client.? 172.21.15.149:0/1883852593' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "409dd3bf-5154-4dea-8708-7de7f9e2e793"}]: dispatch 2024-09-13T17:10:14.835 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:14 smithi149 ceph-mon[35496]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "409dd3bf-5154-4dea-8708-7de7f9e2e793"}]: dispatch 2024-09-13T17:10:14.835 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:14 smithi149 ceph-mon[35496]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "409dd3bf-5154-4dea-8708-7de7f9e2e793"}]': finished 2024-09-13T17:10:14.835 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:14 smithi149 ceph-mon[35496]: osdmap e77: 12 total, 11 up, 12 in 2024-09-13T17:10:14.836 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:14 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T17:10:14.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:14 smithi118 ceph-mon[34374]: osdmap e76: 11 total, 11 up, 11 in 2024-09-13T17:10:14.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:14 smithi118 ceph-mon[34374]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-13T17:10:14.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:14 smithi118 ceph-mon[34374]: from='client.? 172.21.15.149:0/1883852593' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "409dd3bf-5154-4dea-8708-7de7f9e2e793"}]: dispatch 2024-09-13T17:10:14.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:14 smithi118 ceph-mon[34374]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "409dd3bf-5154-4dea-8708-7de7f9e2e793"}]: dispatch 2024-09-13T17:10:14.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:14 smithi118 ceph-mon[34374]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "409dd3bf-5154-4dea-8708-7de7f9e2e793"}]': finished 2024-09-13T17:10:14.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:14 smithi118 ceph-mon[34374]: osdmap e77: 12 total, 11 up, 12 in 2024-09-13T17:10:14.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:14 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T17:10:15.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:15 smithi087 ceph-mon[30934]: from='client.? 172.21.15.149:0/1410315912' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:10:15.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:15 smithi149 ceph-mon[35496]: from='client.? 172.21.15.149:0/1410315912' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:10:15.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:15 smithi118 ceph-mon[34374]: from='client.? 172.21.15.149:0/1410315912' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:10:16.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:16 smithi087 ceph-mon[30934]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 125 KiB/s, 0 objects/s recovering 2024-09-13T17:10:16.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:16 smithi149 ceph-mon[35496]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 125 KiB/s, 0 objects/s recovering 2024-09-13T17:10:16.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:16 smithi118 ceph-mon[34374]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 125 KiB/s, 0 objects/s recovering 2024-09-13T17:10:19.229 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:19 smithi149 ceph-mon[35496]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T17:10:19.362 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:19 smithi118 ceph-mon[34374]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T17:10:19.432 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:19 smithi087 ceph-mon[30934]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T17:10:21.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:21 smithi118 ceph-mon[34374]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-13T17:10:21.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:21 smithi087 ceph-mon[30934]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-13T17:10:21.551 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:21 smithi149 ceph-mon[35496]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-13T17:10:22.221 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:22 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-13T17:10:22.221 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:22 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:22.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:22 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-13T17:10:22.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:22 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:22.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:22 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-13T17:10:22.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:22 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:23.325 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:23 smithi149 ceph-mon[35496]: Deploying daemon osd.11 on smithi149 2024-09-13T17:10:23.325 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:23 smithi149 ceph-mon[35496]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-13T17:10:23.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:23 smithi087 ceph-mon[30934]: Deploying daemon osd.11 on smithi149 2024-09-13T17:10:23.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:23 smithi087 ceph-mon[30934]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-13T17:10:23.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:23 smithi118 ceph-mon[34374]: Deploying daemon osd.11 on smithi149 2024-09-13T17:10:23.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:23 smithi118 ceph-mon[34374]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-13T17:10:25.406 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:25 smithi149 ceph-mon[35496]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-13T17:10:25.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:25 smithi087 ceph-mon[30934]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-13T17:10:25.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:25 smithi118 ceph-mon[34374]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-13T17:10:27.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:27 smithi149 ceph-mon[35496]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-13T17:10:27.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:27 smithi087 ceph-mon[30934]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-13T17:10:27.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:27 smithi118 ceph-mon[34374]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-13T17:10:28.464 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:28 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:10:28.465 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:28 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:28.465 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:28 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:28.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:28 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:10:28.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:28 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:28.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:28 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:28.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:28 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:10:28.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:28 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:28.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:28 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:29.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:29 smithi149 ceph-mon[35496]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-13T17:10:29.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:29 smithi087 ceph-mon[30934]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-13T17:10:29.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:29 smithi118 ceph-mon[34374]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-13T17:10:30.997 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:30.996+0000 7f4fb4ff9640 1 -- 172.21.15.149:0/3902829133 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f4fb802c450 con 0x7f4fa00a1100 2024-09-13T17:10:30.997 INFO:teuthology.orchestra.run.smithi149.stdout:Created osd(s) 11 on host 'smithi149' 2024-09-13T17:10:30.999 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:30.999+0000 7f4fbdf62640 1 -- 172.21.15.149:0/3902829133 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f4fa00a1100 msgr2=0x7f4fa00a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:31.000 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:30.999+0000 7f4fbdf62640 1 --2- 172.21.15.149:0/3902829133 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f4fa00a1100 0x7f4fa00a35c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8006010 tx=0x7f4fa8009360 comp rx=0 tx=0).stop 2024-09-13T17:10:31.000 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:30.999+0000 7f4fbdf62640 1 -- 172.21.15.149:0/3902829133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fb81031c0 msgr2=0x7f4fb80fe840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:31.000 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:30.999+0000 7f4fbdf62640 1 --2- 172.21.15.149:0/3902829133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fb81031c0 0x7f4fb80fe840 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4fac00d770 tx=0x7f4fac00dc30 comp rx=0 tx=0).stop 2024-09-13T17:10:31.000 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:30.999+0000 7f4fbdf62640 1 -- 172.21.15.149:0/3902829133 shutdown_connections 2024-09-13T17:10:31.000 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:30.999+0000 7f4fbdf62640 1 --2- 172.21.15.149:0/3902829133 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f4fa00a1100 0x7f4fa00a35c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:31.000 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:30.999+0000 7f4fbdf62640 1 --2- 172.21.15.149:0/3902829133 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fb8105af0 0x7f4fb80fed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:31.000 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:30.999+0000 7f4fbdf62640 1 --2- 172.21.15.149:0/3902829133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fb81031c0 0x7f4fb80fe840 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:31.000 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:30.999+0000 7f4fbdf62640 1 --2- 172.21.15.149:0/3902829133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4fb8100890 0x7f4fb81001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:31.000 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:30.999+0000 7f4fbdf62640 1 -- 172.21.15.149:0/3902829133 >> 172.21.15.149:0/3902829133 conn(0x7f4fb80fa490 msgr2=0x7f4fb81011f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:31.000 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:30.999+0000 7f4fbdf62640 1 -- 172.21.15.149:0/3902829133 shutdown_connections 2024-09-13T17:10:31.001 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:30.999+0000 7f4fbdf62640 1 -- 172.21.15.149:0/3902829133 wait complete. 2024-09-13T17:10:31.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:31 smithi149 ceph-mon[35496]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-13T17:10:31.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:31 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:31.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:31 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:31.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:31 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:31.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:31 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:10:31.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:31 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:31.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:31 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:10:31.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:31 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:31.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:31 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:31.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:31 smithi149 ceph-mon[35496]: from='osd.11 [v2:172.21.15.149:6824/271000465,v1:172.21.15.149:6825/271000465]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T17:10:31.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:31 smithi149 ceph-mon[35496]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T17:10:31.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:31 smithi087 ceph-mon[30934]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-13T17:10:31.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:31 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:31.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:31 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:31.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:31 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:31.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:31 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:10:31.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:31 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:31.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:31 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:10:31.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:31 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:31.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:31 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:31.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:31 smithi087 ceph-mon[30934]: from='osd.11 [v2:172.21.15.149:6824/271000465,v1:172.21.15.149:6825/271000465]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T17:10:31.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:31 smithi087 ceph-mon[30934]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T17:10:31.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:31 smithi118 ceph-mon[34374]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-13T17:10:31.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:31 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:31.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:31 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:31.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:31 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:31.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:31 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:10:31.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:31 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:31.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:31 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:10:31.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:31 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:31.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:31 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:31.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:31 smithi118 ceph-mon[34374]: from='osd.11 [v2:172.21.15.149:6824/271000465,v1:172.21.15.149:6825/271000465]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T17:10:31.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:31 smithi118 ceph-mon[34374]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T17:10:31.715 DEBUG:teuthology.orchestra.run.smithi149:osd.11> sudo journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.11.service 2024-09-13T17:10:31.718 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-13T17:10:31.718 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-13T17:10:31.926 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:10:33.184 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:33 smithi087 ceph-mon[30934]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-13T17:10:33.185 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:33 smithi087 ceph-mon[30934]: osdmap e78: 12 total, 11 up, 12 in 2024-09-13T17:10:33.185 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:33 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T17:10:33.185 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:33 smithi087 ceph-mon[30934]: from='osd.11 [v2:172.21.15.149:6824/271000465,v1:172.21.15.149:6825/271000465]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T17:10:33.185 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:33 smithi087 ceph-mon[30934]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T17:10:33.185 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:33 smithi087 ceph-mon[30934]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-13T17:10:33.223 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:33 smithi149 ceph-mon[35496]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-13T17:10:33.224 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:33 smithi149 ceph-mon[35496]: osdmap e78: 12 total, 11 up, 12 in 2024-09-13T17:10:33.224 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:33 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T17:10:33.224 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:33 smithi149 ceph-mon[35496]: from='osd.11 [v2:172.21.15.149:6824/271000465,v1:172.21.15.149:6825/271000465]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T17:10:33.224 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:33 smithi149 ceph-mon[35496]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T17:10:33.224 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:33 smithi149 ceph-mon[35496]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-13T17:10:33.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:33 smithi118 ceph-mon[34374]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-13T17:10:33.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:33 smithi118 ceph-mon[34374]: osdmap e78: 12 total, 11 up, 12 in 2024-09-13T17:10:33.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:33 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T17:10:33.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:33 smithi118 ceph-mon[34374]: from='osd.11 [v2:172.21.15.149:6824/271000465,v1:172.21.15.149:6825/271000465]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T17:10:33.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:33 smithi118 ceph-mon[34374]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T17:10:33.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:33 smithi118 ceph-mon[34374]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-13T17:10:33.486 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:10:33 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:10:33.421+0000 7fe16d5da640 -1 osd.11 0 waiting for initial osdmap 2024-09-13T17:10:33.486 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:10:33 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:10:33.436+0000 7fe1653fb640 -1 osd.11 79 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:10:33.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.673+0000 7f2323be4640 1 -- 172.21.15.87:0/3600706904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f231c0ffe00 msgr2=0x7f231c100200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:33.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.673+0000 7f2323be4640 1 --2- 172.21.15.87:0/3600706904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f231c0ffe00 0x7f231c100200 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2318009900 tx=0x7f231802a410 comp rx=0 tx=0).stop 2024-09-13T17:10:33.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.673+0000 7f2323be4640 1 -- 172.21.15.87:0/3600706904 shutdown_connections 2024-09-13T17:10:33.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.673+0000 7f2323be4640 1 --2- 172.21.15.87:0/3600706904 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f231c101920 0x7f231c108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:33.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.673+0000 7f2323be4640 1 --2- 172.21.15.87:0/3600706904 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f231c100f60 0x7f231c1013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:33.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.673+0000 7f2323be4640 1 --2- 172.21.15.87:0/3600706904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f231c0ffe00 0x7f231c100200 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:33.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.673+0000 7f2323be4640 1 -- 172.21.15.87:0/3600706904 >> 172.21.15.87:0/3600706904 conn(0x7f231c0fb590 msgr2=0x7f231c0fd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:33.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.673+0000 7f2323be4640 1 -- 172.21.15.87:0/3600706904 shutdown_connections 2024-09-13T17:10:33.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.673+0000 7f2323be4640 1 -- 172.21.15.87:0/3600706904 wait complete. 2024-09-13T17:10:33.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.674+0000 7f2323be4640 1 Processor -- start 2024-09-13T17:10:33.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.674+0000 7f2323be4640 1 -- start start 2024-09-13T17:10:33.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.674+0000 7f2323be4640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f231c0ffe00 0x7f231c195e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:33.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.674+0000 7f2323be4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f231c100f60 0x7f231c196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:33.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.674+0000 7f2323be4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f231c101920 0x7f231c19d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:33.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.674+0000 7f2323be4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231c19d8e0 con 0x7f231c101920 2024-09-13T17:10:33.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.674+0000 7f2323be4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231c19da50 con 0x7f231c100f60 2024-09-13T17:10:33.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.674+0000 7f2323be4640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231c19dc10 con 0x7f231c0ffe00 2024-09-13T17:10:33.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.674+0000 7f2322181640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f231c101920 0x7f231c19d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:33.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.674+0000 7f2322181640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f231c101920 0x7f231c19d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41048/0 (socket says 172.21.15.87:41048) 2024-09-13T17:10:33.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.674+0000 7f2321980640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f231c0ffe00 0x7f231c195e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:33.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.674+0000 7f2322181640 1 -- 172.21.15.87:0/251820039 learned_addr learned my addr 172.21.15.87:0/251820039 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:10:33.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.674+0000 7f232117f640 1 --2- 172.21.15.87:0/251820039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f231c100f60 0x7f231c196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:33.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.675+0000 7f2322181640 1 -- 172.21.15.87:0/251820039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f231c0ffe00 msgr2=0x7f231c195e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:33.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.675+0000 7f2322181640 1 --2- 172.21.15.87:0/251820039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f231c0ffe00 0x7f231c195e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:33.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.675+0000 7f2322181640 1 -- 172.21.15.87:0/251820039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f231c100f60 msgr2=0x7f231c196370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:33.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.675+0000 7f2322181640 1 --2- 172.21.15.87:0/251820039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f231c100f60 0x7f231c196370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:33.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.675+0000 7f2322181640 1 -- 172.21.15.87:0/251820039 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2318009560 con 0x7f231c101920 2024-09-13T17:10:33.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.675+0000 7f2322181640 1 --2- 172.21.15.87:0/251820039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f231c101920 0x7f231c19d3a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f231400b970 tx=0x7f231400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:33.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.675+0000 7f2312ffd640 1 -- 172.21.15.87:0/251820039 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231400cb40 con 0x7f231c101920 2024-09-13T17:10:33.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.675+0000 7f2312ffd640 1 -- 172.21.15.87:0/251820039 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f231400cca0 con 0x7f231c101920 2024-09-13T17:10:33.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.675+0000 7f2323be4640 1 -- 172.21.15.87:0/251820039 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f231c19def0 con 0x7f231c101920 2024-09-13T17:10:33.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.675+0000 7f2312ffd640 1 -- 172.21.15.87:0/251820039 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23140076e0 con 0x7f231c101920 2024-09-13T17:10:33.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.675+0000 7f2323be4640 1 -- 172.21.15.87:0/251820039 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f231c19e3e0 con 0x7f231c101920 2024-09-13T17:10:33.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.676+0000 7f2323be4640 1 -- 172.21.15.87:0/251820039 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f231c107240 con 0x7f231c101920 2024-09-13T17:10:33.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.678+0000 7f2312ffd640 1 -- 172.21.15.87:0/251820039 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2314014440 con 0x7f231c101920 2024-09-13T17:10:33.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.678+0000 7f2312ffd640 1 --2- 172.21.15.87:0/251820039 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f23080a1130 0x7f23080a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:33.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.679+0000 7f2321980640 1 --2- 172.21.15.87:0/251820039 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f23080a1130 0x7f23080a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:33.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.679+0000 7f2312ffd640 1 -- 172.21.15.87:0/251820039 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f23140cbfa0 con 0x7f231c101920 2024-09-13T17:10:33.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.679+0000 7f2321980640 1 --2- 172.21.15.87:0/251820039 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f23080a1130 0x7f23080a35f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2318031460 tx=0x7f23180058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:33.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.682+0000 7f2312ffd640 1 -- 172.21.15.87:0/251820039 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2314095da0 con 0x7f231c101920 2024-09-13T17:10:33.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.849+0000 7f2323be4640 1 -- 172.21.15.87:0/251820039 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f231c10b960 con 0x7f231c101920 2024-09-13T17:10:33.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.849+0000 7f2312ffd640 1 -- 172.21.15.87:0/251820039 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v79) v1 ==== 74+0+133 (secure 0 0 0) 0x7f23140993c0 con 0x7f231c101920 2024-09-13T17:10:33.851 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:10:33.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.851+0000 7f2323be4640 1 -- 172.21.15.87:0/251820039 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f23080a1130 msgr2=0x7f23080a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:33.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.851+0000 7f2323be4640 1 --2- 172.21.15.87:0/251820039 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f23080a1130 0x7f23080a35f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2318031460 tx=0x7f23180058d0 comp rx=0 tx=0).stop 2024-09-13T17:10:33.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.851+0000 7f2323be4640 1 -- 172.21.15.87:0/251820039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f231c101920 msgr2=0x7f231c19d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:33.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.851+0000 7f2323be4640 1 --2- 172.21.15.87:0/251820039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f231c101920 0x7f231c19d3a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f231400b970 tx=0x7f231400be30 comp rx=0 tx=0).stop 2024-09-13T17:10:33.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.851+0000 7f2323be4640 1 -- 172.21.15.87:0/251820039 shutdown_connections 2024-09-13T17:10:33.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.851+0000 7f2323be4640 1 --2- 172.21.15.87:0/251820039 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f23080a1130 0x7f23080a35f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:33.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.851+0000 7f2323be4640 1 --2- 172.21.15.87:0/251820039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f231c101920 0x7f231c19d3a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:33.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.851+0000 7f2323be4640 1 --2- 172.21.15.87:0/251820039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f231c100f60 0x7f231c196370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:33.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.851+0000 7f2323be4640 1 --2- 172.21.15.87:0/251820039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f231c0ffe00 0x7f231c195e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:33.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.851+0000 7f2323be4640 1 -- 172.21.15.87:0/251820039 >> 172.21.15.87:0/251820039 conn(0x7f231c0fb590 msgr2=0x7f231c104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:33.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.851+0000 7f2323be4640 1 -- 172.21.15.87:0/251820039 shutdown_connections 2024-09-13T17:10:33.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:33.851+0000 7f2323be4640 1 -- 172.21.15.87:0/251820039 wait complete. 2024-09-13T17:10:34.322 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:34 smithi149 ceph-mon[35496]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-09-13T17:10:34.323 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:34 smithi149 ceph-mon[35496]: osdmap e79: 12 total, 11 up, 12 in 2024-09-13T17:10:34.323 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:34 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T17:10:34.323 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:34 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T17:10:34.323 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:34 smithi149 ceph-mon[35496]: from='osd.11 ' entity='osd.11' 2024-09-13T17:10:34.323 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:34 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/251820039' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T17:10:34.347 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:34 smithi087 ceph-mon[30934]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-09-13T17:10:34.347 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:34 smithi087 ceph-mon[30934]: osdmap e79: 12 total, 11 up, 12 in 2024-09-13T17:10:34.347 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:34 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T17:10:34.347 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:34 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T17:10:34.347 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:34 smithi087 ceph-mon[30934]: from='osd.11 ' entity='osd.11' 2024-09-13T17:10:34.347 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:34 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/251820039' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T17:10:34.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:34 smithi118 ceph-mon[34374]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-09-13T17:10:34.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:34 smithi118 ceph-mon[34374]: osdmap e79: 12 total, 11 up, 12 in 2024-09-13T17:10:34.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:34 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T17:10:34.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:34 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T17:10:34.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:34 smithi118 ceph-mon[34374]: from='osd.11 ' entity='osd.11' 2024-09-13T17:10:34.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:34 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/251820039' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T17:10:34.556 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":79,"num_osds":12,"num_up_osds":11,"osd_up_since":1726247409,"num_in_osds":12,"osd_in_since":1726247414,"num_remapped_pgs":0} 2024-09-13T17:10:35.228 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:35 smithi087 ceph-mon[30934]: purged_snaps scrub starts 2024-09-13T17:10:35.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:35 smithi087 ceph-mon[30934]: purged_snaps scrub ok 2024-09-13T17:10:35.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:35 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T17:10:35.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:35 smithi087 ceph-mon[30934]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-13T17:10:35.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:35 smithi087 ceph-mon[30934]: osd.11 [v2:172.21.15.149:6824/271000465,v1:172.21.15.149:6825/271000465] boot 2024-09-13T17:10:35.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:35 smithi087 ceph-mon[30934]: osdmap e80: 12 total, 12 up, 12 in 2024-09-13T17:10:35.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:35 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T17:10:35.264 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:35 smithi118 ceph-mon[34374]: purged_snaps scrub starts 2024-09-13T17:10:35.264 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:35 smithi118 ceph-mon[34374]: purged_snaps scrub ok 2024-09-13T17:10:35.265 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:35 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T17:10:35.265 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:35 smithi118 ceph-mon[34374]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-13T17:10:35.265 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:35 smithi118 ceph-mon[34374]: osd.11 [v2:172.21.15.149:6824/271000465,v1:172.21.15.149:6825/271000465] boot 2024-09-13T17:10:35.265 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:35 smithi118 ceph-mon[34374]: osdmap e80: 12 total, 12 up, 12 in 2024-09-13T17:10:35.265 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:35 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T17:10:35.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:35 smithi149 ceph-mon[35496]: purged_snaps scrub starts 2024-09-13T17:10:35.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:35 smithi149 ceph-mon[35496]: purged_snaps scrub ok 2024-09-13T17:10:35.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:35 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T17:10:35.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:35 smithi149 ceph-mon[35496]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-13T17:10:35.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:35 smithi149 ceph-mon[35496]: osd.11 [v2:172.21.15.149:6824/271000465,v1:172.21.15.149:6825/271000465] boot 2024-09-13T17:10:35.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:35 smithi149 ceph-mon[35496]: osdmap e80: 12 total, 12 up, 12 in 2024-09-13T17:10:35.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:35 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T17:10:35.558 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-13T17:10:35.759 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:10:36.224 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:36 smithi087 ceph-mon[30934]: Detected new or changed devices on smithi149 2024-09-13T17:10:36.224 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:36 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:36.224 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:36 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:36.224 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:36 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:10:36.224 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:36 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:10:36.224 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:36 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:10:36.224 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:36 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:10:36.224 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:36 smithi087 ceph-mon[30934]: Adjusting osd_memory_target on smithi149 to 1453M 2024-09-13T17:10:36.224 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:36 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:36.224 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:36 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:36.224 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:36 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:10:36.224 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:36 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:36.225 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:36 smithi087 ceph-mon[30934]: osdmap e81: 12 total, 12 up, 12 in 2024-09-13T17:10:36.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:36 smithi149 ceph-mon[35496]: Detected new or changed devices on smithi149 2024-09-13T17:10:36.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:36 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:36.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:36 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:36.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:36 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:10:36.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:36 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:10:36.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:36 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:10:36.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:36 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:10:36.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:36 smithi149 ceph-mon[35496]: Adjusting osd_memory_target on smithi149 to 1453M 2024-09-13T17:10:36.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:36 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:36.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:36 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:36.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:36 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:10:36.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:36 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:36.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:36 smithi149 ceph-mon[35496]: osdmap e81: 12 total, 12 up, 12 in 2024-09-13T17:10:36.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:36 smithi118 ceph-mon[34374]: Detected new or changed devices on smithi149 2024-09-13T17:10:36.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:36 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:36.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:36 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:36.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:36 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:10:36.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:36 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:10:36.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:36 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:10:36.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:36 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:10:36.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:36 smithi118 ceph-mon[34374]: Adjusting osd_memory_target on smithi149 to 1453M 2024-09-13T17:10:36.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:36 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:36.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:36 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:36.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:36 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:10:36.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:36 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:36.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:36 smithi118 ceph-mon[34374]: osdmap e81: 12 total, 12 up, 12 in 2024-09-13T17:10:37.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:37 smithi087 ceph-mon[30934]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:37.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:37 smithi149 ceph-mon[35496]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:37.362 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:37 smithi118 ceph-mon[34374]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:37.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.412+0000 7f285f939640 1 -- 172.21.15.87:0/2667464221 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2858101b10 msgr2=0x7f28581083a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:37.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.412+0000 7f285f939640 1 --2- 172.21.15.87:0/2667464221 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2858101b10 0x7f28581083a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2850009ca0 tx=0x7f285002a8c0 comp rx=0 tx=0).stop 2024-09-13T17:10:37.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.412+0000 7f285f939640 1 -- 172.21.15.87:0/2667464221 shutdown_connections 2024-09-13T17:10:37.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.412+0000 7f285f939640 1 --2- 172.21.15.87:0/2667464221 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2858101b10 0x7f28581083a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:37.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.412+0000 7f285f939640 1 --2- 172.21.15.87:0/2667464221 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2858101150 0x7f28581015d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:37.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.412+0000 7f285f939640 1 --2- 172.21.15.87:0/2667464221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f28580fe0d0 0x7f28580fe4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:37.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.412+0000 7f285f939640 1 -- 172.21.15.87:0/2667464221 >> 172.21.15.87:0/2667464221 conn(0x7f28580f9c20 msgr2=0x7f28580fc040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:37.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.413+0000 7f285f939640 1 -- 172.21.15.87:0/2667464221 shutdown_connections 2024-09-13T17:10:37.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.413+0000 7f285f939640 1 -- 172.21.15.87:0/2667464221 wait complete. 2024-09-13T17:10:37.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.413+0000 7f285f939640 1 Processor -- start 2024-09-13T17:10:37.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.413+0000 7f285f939640 1 -- start start 2024-09-13T17:10:37.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.413+0000 7f285f939640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f28580fe0d0 0x7f2858195d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:37.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.413+0000 7f285f939640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2858101150 0x7f2858196280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:37.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.413+0000 7f285f939640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2858101b10 0x7f285819d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:37.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.413+0000 7f285f939640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285819d7e0 con 0x7f2858101150 2024-09-13T17:10:37.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.413+0000 7f285f939640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285819d950 con 0x7f2858101b10 2024-09-13T17:10:37.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.413+0000 7f285f939640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285819db10 con 0x7f28580fe0d0 2024-09-13T17:10:37.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.413+0000 7f285ced4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2858101150 0x7f2858196280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:37.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.413+0000 7f285ced4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2858101150 0x7f2858196280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41064/0 (socket says 172.21.15.87:41064) 2024-09-13T17:10:37.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.413+0000 7f285ced4640 1 -- 172.21.15.87:0/3904873650 learned_addr learned my addr 172.21.15.87:0/3904873650 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:10:37.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.413+0000 7f285ded6640 1 --2- 172.21.15.87:0/3904873650 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2858101b10 0x7f285819d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:37.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.413+0000 7f285d6d5640 1 --2- 172.21.15.87:0/3904873650 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f28580fe0d0 0x7f2858195d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:37.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.414+0000 7f285ced4640 1 -- 172.21.15.87:0/3904873650 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f28580fe0d0 msgr2=0x7f2858195d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:37.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.414+0000 7f285ced4640 1 --2- 172.21.15.87:0/3904873650 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f28580fe0d0 0x7f2858195d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:37.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.414+0000 7f285ced4640 1 -- 172.21.15.87:0/3904873650 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2858101b10 msgr2=0x7f285819d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:37.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.414+0000 7f285ced4640 1 --2- 172.21.15.87:0/3904873650 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2858101b10 0x7f285819d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:37.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.414+0000 7f285ced4640 1 -- 172.21.15.87:0/3904873650 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2850009900 con 0x7f2858101150 2024-09-13T17:10:37.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.414+0000 7f285ced4640 1 --2- 172.21.15.87:0/3904873650 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2858101150 0x7f2858196280 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f285400e9f0 tx=0x7f285400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:37.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.414+0000 7f284e7fc640 1 -- 172.21.15.87:0/3904873650 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2854009700 con 0x7f2858101150 2024-09-13T17:10:37.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.414+0000 7f285f939640 1 -- 172.21.15.87:0/3904873650 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f285819ddf0 con 0x7f2858101150 2024-09-13T17:10:37.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.414+0000 7f284e7fc640 1 -- 172.21.15.87:0/3904873650 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f285400cd80 con 0x7f2858101150 2024-09-13T17:10:37.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.414+0000 7f284e7fc640 1 -- 172.21.15.87:0/3904873650 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2854018840 con 0x7f2858101150 2024-09-13T17:10:37.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.414+0000 7f285f939640 1 -- 172.21.15.87:0/3904873650 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f285819e210 con 0x7f2858101150 2024-09-13T17:10:37.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.415+0000 7f285f939640 1 -- 172.21.15.87:0/3904873650 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28580fe540 con 0x7f2858101150 2024-09-13T17:10:37.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.416+0000 7f284e7fc640 1 -- 172.21.15.87:0/3904873650 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f28540189a0 con 0x7f2858101150 2024-09-13T17:10:37.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.417+0000 7f284e7fc640 1 --2- 172.21.15.87:0/3904873650 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f28440a1080 0x7f28440a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:37.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.417+0000 7f285d6d5640 1 --2- 172.21.15.87:0/3904873650 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f28440a1080 0x7f28440a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:37.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.417+0000 7f284e7fc640 1 -- 172.21.15.87:0/3904873650 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f2854014070 con 0x7f2858101150 2024-09-13T17:10:37.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.417+0000 7f285d6d5640 1 --2- 172.21.15.87:0/3904873650 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f28440a1080 0x7f28440a3540 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f28581971d0 tx=0x7f284800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:37.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.420+0000 7f284e7fc640 1 -- 172.21.15.87:0/3904873650 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f28540966e0 con 0x7f2858101150 2024-09-13T17:10:37.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.583+0000 7f285f939640 1 -- 172.21.15.87:0/3904873650 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f28581073a0 con 0x7f2858101150 2024-09-13T17:10:37.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.583+0000 7f284e7fc640 1 -- 172.21.15.87:0/3904873650 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v81) v1 ==== 74+0+133 (secure 0 0 0) 0x7f2854099d00 con 0x7f2858101150 2024-09-13T17:10:37.586 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:10:37.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.585+0000 7f285f939640 1 -- 172.21.15.87:0/3904873650 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f28440a1080 msgr2=0x7f28440a3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:37.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.585+0000 7f285f939640 1 --2- 172.21.15.87:0/3904873650 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f28440a1080 0x7f28440a3540 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f28581971d0 tx=0x7f284800b390 comp rx=0 tx=0).stop 2024-09-13T17:10:37.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.585+0000 7f285f939640 1 -- 172.21.15.87:0/3904873650 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2858101150 msgr2=0x7f2858196280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:37.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.585+0000 7f285f939640 1 --2- 172.21.15.87:0/3904873650 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2858101150 0x7f2858196280 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f285400e9f0 tx=0x7f285400eeb0 comp rx=0 tx=0).stop 2024-09-13T17:10:37.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.585+0000 7f285f939640 1 -- 172.21.15.87:0/3904873650 shutdown_connections 2024-09-13T17:10:37.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.585+0000 7f285f939640 1 --2- 172.21.15.87:0/3904873650 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f28440a1080 0x7f28440a3540 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:37.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.585+0000 7f285f939640 1 --2- 172.21.15.87:0/3904873650 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2858101b10 0x7f285819d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:37.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.585+0000 7f285f939640 1 --2- 172.21.15.87:0/3904873650 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2858101150 0x7f2858196280 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:37.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.585+0000 7f285f939640 1 --2- 172.21.15.87:0/3904873650 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f28580fe0d0 0x7f2858195d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:37.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.585+0000 7f285f939640 1 -- 172.21.15.87:0/3904873650 >> 172.21.15.87:0/3904873650 conn(0x7f28580f9c20 msgr2=0x7f2858104570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:37.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.585+0000 7f285f939640 1 -- 172.21.15.87:0/3904873650 shutdown_connections 2024-09-13T17:10:37.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:37.585+0000 7f285f939640 1 -- 172.21.15.87:0/3904873650 wait complete. 2024-09-13T17:10:38.228 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:38 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3904873650' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T17:10:38.309 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":81,"num_osds":12,"num_up_osds":12,"osd_up_since":1726247434,"num_in_osds":12,"osd_in_since":1726247414,"num_remapped_pgs":0} 2024-09-13T17:10:38.310 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T17:10:38.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:38 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3904873650' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T17:10:38.362 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:38 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3904873650' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T17:10:38.503 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:10:39.228 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:39 smithi087 ceph-mon[30934]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:39.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:39 smithi149 ceph-mon[35496]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:39.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:39 smithi118 ceph-mon[34374]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:40.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.192+0000 7f214a02a640 1 -- 172.21.15.87:0/1474338445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2144101880 msgr2=0x7f2144109d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:40.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.192+0000 7f214a02a640 1 --2- 172.21.15.87:0/1474338445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2144101880 0x7f2144109d70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2138009900 tx=0x7f213802a480 comp rx=0 tx=0).stop 2024-09-13T17:10:40.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.192+0000 7f214a02a640 1 -- 172.21.15.87:0/1474338445 shutdown_connections 2024-09-13T17:10:40.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.192+0000 7f214a02a640 1 --2- 172.21.15.87:0/1474338445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f214410a390 0x7f214410c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:40.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.192+0000 7f214a02a640 1 --2- 172.21.15.87:0/1474338445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2144101880 0x7f2144109d70 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:40.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.192+0000 7f214a02a640 1 --2- 172.21.15.87:0/1474338445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2144100f60 0x7f2144101340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:40.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.192+0000 7f214a02a640 1 -- 172.21.15.87:0/1474338445 >> 172.21.15.87:0/1474338445 conn(0x7f21440fa9a0 msgr2=0x7f21440fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:40.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.192+0000 7f214a02a640 1 -- 172.21.15.87:0/1474338445 shutdown_connections 2024-09-13T17:10:40.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.192+0000 7f214a02a640 1 -- 172.21.15.87:0/1474338445 wait complete. 2024-09-13T17:10:40.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.193+0000 7f214a02a640 1 Processor -- start 2024-09-13T17:10:40.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.193+0000 7f214a02a640 1 -- start start 2024-09-13T17:10:40.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.193+0000 7f214a02a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2144100f60 0x7f2144196410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:40.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.193+0000 7f214a02a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2144101880 0x7f2144196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:40.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.193+0000 7f214a02a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f214410a390 0x7f214419ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:40.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.193+0000 7f214a02a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214419b350 con 0x7f214410a390 2024-09-13T17:10:40.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.193+0000 7f214a02a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214419b4c0 con 0x7f2144100f60 2024-09-13T17:10:40.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.193+0000 7f214a02a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214419b630 con 0x7f2144101880 2024-09-13T17:10:40.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.194+0000 7f2143fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f214410a390 0x7f214419ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:40.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.194+0000 7f2143fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f214410a390 0x7f214419ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57364/0 (socket says 172.21.15.87:57364) 2024-09-13T17:10:40.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.194+0000 7f2143fff640 1 -- 172.21.15.87:0/483435819 learned_addr learned my addr 172.21.15.87:0/483435819 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:10:40.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.194+0000 7f2142ffd640 1 --2- 172.21.15.87:0/483435819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2144101880 0x7f2144196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:40.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.194+0000 7f21437fe640 1 --2- 172.21.15.87:0/483435819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2144100f60 0x7f2144196410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:40.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.194+0000 7f2143fff640 1 -- 172.21.15.87:0/483435819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2144101880 msgr2=0x7f2144196950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:40.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.194+0000 7f2143fff640 1 --2- 172.21.15.87:0/483435819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2144101880 0x7f2144196950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:40.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.194+0000 7f2143fff640 1 -- 172.21.15.87:0/483435819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2144100f60 msgr2=0x7f2144196410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:40.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.194+0000 7f2143fff640 1 --2- 172.21.15.87:0/483435819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2144100f60 0x7f2144196410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:40.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.194+0000 7f2143fff640 1 -- 172.21.15.87:0/483435819 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2138009560 con 0x7f214410a390 2024-09-13T17:10:40.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.194+0000 7f2143fff640 1 --2- 172.21.15.87:0/483435819 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f214410a390 0x7f214419ad50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f213c00b970 tx=0x7f213c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:40.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.194+0000 7f2140ff9640 1 -- 172.21.15.87:0/483435819 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c00cb40 con 0x7f214410a390 2024-09-13T17:10:40.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.194+0000 7f2140ff9640 1 -- 172.21.15.87:0/483435819 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f213c00cca0 con 0x7f214410a390 2024-09-13T17:10:40.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.194+0000 7f214a02a640 1 -- 172.21.15.87:0/483435819 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f214419b910 con 0x7f214410a390 2024-09-13T17:10:40.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.194+0000 7f2140ff9640 1 -- 172.21.15.87:0/483435819 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c0076e0 con 0x7f214410a390 2024-09-13T17:10:40.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.194+0000 7f214a02a640 1 -- 172.21.15.87:0/483435819 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f214419bbc0 con 0x7f214410a390 2024-09-13T17:10:40.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.195+0000 7f214a02a640 1 -- 172.21.15.87:0/483435819 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2144069000 con 0x7f214410a390 2024-09-13T17:10:40.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.196+0000 7f2140ff9640 1 -- 172.21.15.87:0/483435819 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f213c014440 con 0x7f214410a390 2024-09-13T17:10:40.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.197+0000 7f2140ff9640 1 --2- 172.21.15.87:0/483435819 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f212c0a1080 0x7f212c0a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:40.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.197+0000 7f21437fe640 1 --2- 172.21.15.87:0/483435819 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f212c0a1080 0x7f212c0a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:40.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.197+0000 7f2140ff9640 1 -- 172.21.15.87:0/483435819 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f213c0cbb80 con 0x7f214410a390 2024-09-13T17:10:40.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.197+0000 7f21437fe640 1 --2- 172.21.15.87:0/483435819 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f212c0a1080 0x7f212c0a3540 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2134009890 tx=0x7f2134008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:40.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.201+0000 7f2140ff9640 1 -- 172.21.15.87:0/483435819 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f213c095860 con 0x7f214410a390 2024-09-13T17:10:40.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.365+0000 7f214a02a640 1 -- 172.21.15.87:0/483435819 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21441013c0 con 0x7f214410a390 2024-09-13T17:10:40.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.366+0000 7f2140ff9640 1 -- 172.21.15.87:0/483435819 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+18433 (secure 0 0 0) 0x7f213c098e80 con 0x7f214410a390 2024-09-13T17:10:40.368 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:10:40.368 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":81,"fsid":"043d5bae-71f2-11ef-bceb-c7b262605968","created":"2024-09-13T17:03:57.852010+0000","modified":"2024-09-13T17:10:36.006538+0000","last_up_change":"2024-09-13T17:10:34.423548+0000","last_in_change":"2024-09-13T17:10:14.228123+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:07:02.286400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"58250283-85c0-416e-abdd-1fc5a7ff0c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6803","nonce":1316956138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6805","nonce":1316956138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6809","nonce":1316956138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6807","nonce":1316956138}]},"public_addr":"172.21.15.87:6803/1316956138","cluster_addr":"172.21.15.87:6805/1316956138","heartbeat_back_addr":"172.21.15.87:6809/1316956138","heartbeat_front_addr":"172.21.15.87:6807/1316956138","state":["exists","up"]},{"osd":1,"uuid":"b9d49969-94b1-4262-b4ff-db0a8e3331af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6801","nonce":3352566727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6803","nonce":3352566727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6807","nonce":3352566727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6805","nonce":3352566727}]},"public_addr":"172.21.15.118:6801/3352566727","cluster_addr":"172.21.15.118:6803/3352566727","heartbeat_back_addr":"172.21.15.118:6807/3352566727","heartbeat_front_addr":"172.21.15.118:6805/3352566727","state":["exists","up"]},{"osd":2,"uuid":"ba64549e-d736-426f-b466-f569af5f16d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6801","nonce":2774581686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6803","nonce":2774581686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6807","nonce":2774581686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6805","nonce":2774581686}]},"public_addr":"172.21.15.149:6801/2774581686","cluster_addr":"172.21.15.149:6803/2774581686","heartbeat_back_addr":"172.21.15.149:6807/2774581686","heartbeat_front_addr":"172.21.15.149:6805/2774581686","state":["exists","up"]},{"osd":3,"uuid":"3d5553e5-371b-49fd-976b-9e72a97a2f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6811","nonce":3306119066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6813","nonce":3306119066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6817","nonce":3306119066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6815","nonce":3306119066}]},"public_addr":"172.21.15.87:6811/3306119066","cluster_addr":"172.21.15.87:6813/3306119066","heartbeat_back_addr":"172.21.15.87:6817/3306119066","heartbeat_front_addr":"172.21.15.87:6815/3306119066","state":["exists","up"]},{"osd":4,"uuid":"2fbe0e27-34ec-42a6-9962-f1d8202b3159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6809","nonce":3342349890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6811","nonce":3342349890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6815","nonce":3342349890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6813","nonce":3342349890}]},"public_addr":"172.21.15.118:6809/3342349890","cluster_addr":"172.21.15.118:6811/3342349890","heartbeat_back_addr":"172.21.15.118:6815/3342349890","heartbeat_front_addr":"172.21.15.118:6813/3342349890","state":["exists","up"]},{"osd":5,"uuid":"53c14519-6170-4b5a-a79d-4835882d7bec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6809","nonce":3468867124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6811","nonce":3468867124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6815","nonce":3468867124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6813","nonce":3468867124}]},"public_addr":"172.21.15.149:6809/3468867124","cluster_addr":"172.21.15.149:6811/3468867124","heartbeat_back_addr":"172.21.15.149:6815/3468867124","heartbeat_front_addr":"172.21.15.149:6813/3468867124","state":["exists","up"]},{"osd":6,"uuid":"d3951b32-db77-4b8b-9de0-f05e03d13f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6819","nonce":326563617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6821","nonce":326563617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6825","nonce":326563617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6823","nonce":326563617}]},"public_addr":"172.21.15.87:6819/326563617","cluster_addr":"172.21.15.87:6821/326563617","heartbeat_back_addr":"172.21.15.87:6825/326563617","heartbeat_front_addr":"172.21.15.87:6823/326563617","state":["exists","up"]},{"osd":7,"uuid":"4d46dab7-a8bf-4e3e-b5c0-43860d336bdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6817","nonce":1690268990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6819","nonce":1690268990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6823","nonce":1690268990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6821","nonce":1690268990}]},"public_addr":"172.21.15.118:6817/1690268990","cluster_addr":"172.21.15.118:6819/1690268990","heartbeat_back_addr":"172.21.15.118:6823/1690268990","heartbeat_front_addr":"172.21.15.118:6821/1690268990","state":["exists","up"]},{"osd":8,"uuid":"5a015a7d-60a3-4412-96af-1b61d2ad51f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6817","nonce":1558675380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6819","nonce":1558675380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6823","nonce":1558675380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6821","nonce":1558675380}]},"public_addr":"172.21.15.149:6817/1558675380","cluster_addr":"172.21.15.149:6819/1558675380","heartbeat_back_addr":"172.21.15.149:6823/1558675380","heartbeat_front_addr":"172.21.15.149:6821/1558675380","state":["exists","up"]},{"osd":9,"uuid":"248c0b6e-4c4e-4c63-a0dd-e4cdf3b997a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6827","nonce":1453934262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6829","nonce":1453934262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6833","nonce":1453934262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6831","nonce":1453934262}]},"public_addr":"172.21.15.87:6827/1453934262","cluster_addr":"172.21.15.87:6829/1453934262","heartbeat_back_addr":"172.21.15.87:6833/1453934262","heartbeat_front_addr":"172.21.15.87:6831/1453934262","state":["exists","up"]},{"osd":10,"uuid":"24238714-e737-4371-b5d5-0cd3395f09bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6825","nonce":1034318850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6827","nonce":1034318850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6831","nonce":1034318850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6829","nonce":1034318850}]},"public_addr":"172.21.15.118:6825/1034318850","cluster_addr":"172.21.15.118:6827/1034318850","heartbeat_back_addr":"172.21.15.118:6831/1034318850","heartbeat_front_addr":"172.21.15.118:6829/1034318850","state":["exists","up"]},{"osd":11,"uuid":"409dd3bf-5154-4dea-8708-7de7f9e2e793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6825","nonce":271000465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6827","nonce":271000465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6831","nonce":271000465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6829","nonce":271000465}]},"public_addr":"172.21.15.149:6825/271000465","cluster_addr":"172.21.15.149:6827/271000465","heartbeat_back_addr":"172.21.15.149:6831/271000465","heartbeat_front_addr":"172.21.15.149:6829/271000465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:16.382664+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:37.914250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:00.425876+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:23.960183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:47.004088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:10.214345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:33.719221+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:57.099599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:20.971881+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:44.827167+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:08.135516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:32.085853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/586423689":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6801/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6800/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/3270371628":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/515676743":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/1475107314":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/553289143":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/3403361612":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6801/1587363880":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6800/1587363880":"2024-09-14T17:04:24.083789+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:10:40.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.368+0000 7f214a02a640 1 -- 172.21.15.87:0/483435819 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f212c0a1080 msgr2=0x7f212c0a3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:40.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.368+0000 7f214a02a640 1 --2- 172.21.15.87:0/483435819 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f212c0a1080 0x7f212c0a3540 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2134009890 tx=0x7f2134008040 comp rx=0 tx=0).stop 2024-09-13T17:10:40.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.368+0000 7f214a02a640 1 -- 172.21.15.87:0/483435819 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f214410a390 msgr2=0x7f214419ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:40.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.368+0000 7f214a02a640 1 --2- 172.21.15.87:0/483435819 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f214410a390 0x7f214419ad50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f213c00b970 tx=0x7f213c00be30 comp rx=0 tx=0).stop 2024-09-13T17:10:40.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.368+0000 7f214a02a640 1 -- 172.21.15.87:0/483435819 shutdown_connections 2024-09-13T17:10:40.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.368+0000 7f214a02a640 1 --2- 172.21.15.87:0/483435819 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f212c0a1080 0x7f212c0a3540 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:40.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.368+0000 7f214a02a640 1 --2- 172.21.15.87:0/483435819 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f214410a390 0x7f214419ad50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:40.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.368+0000 7f214a02a640 1 --2- 172.21.15.87:0/483435819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2144101880 0x7f2144196950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:40.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.368+0000 7f214a02a640 1 --2- 172.21.15.87:0/483435819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2144100f60 0x7f2144196410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:40.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.368+0000 7f214a02a640 1 -- 172.21.15.87:0/483435819 >> 172.21.15.87:0/483435819 conn(0x7f21440fa9a0 msgr2=0x7f21440fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:40.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.368+0000 7f214a02a640 1 -- 172.21.15.87:0/483435819 shutdown_connections 2024-09-13T17:10:40.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:40.368+0000 7f214a02a640 1 -- 172.21.15.87:0/483435819 wait complete. 2024-09-13T17:10:41.070 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:07:02.286400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:10:41.070 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-13T17:10:41.267 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:10:41.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:41 smithi118 ceph-mon[34374]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:41.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:41 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/483435819' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:10:41.387 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:41 smithi087 ceph-mon[30934]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:41.387 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:41 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/483435819' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:10:41.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:41 smithi149 ceph-mon[35496]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:41.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:41 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/483435819' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:10:43.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:42.999+0000 7f28f14ca640 1 -- 172.21.15.87:0/1047629515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28ec100990 msgr2=0x7f28ec1049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:43.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:42.999+0000 7f28f14ca640 1 --2- 172.21.15.87:0/1047629515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28ec100990 0x7f28ec1049e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f28d4009930 tx=0x7f28d402a420 comp rx=0 tx=0).stop 2024-09-13T17:10:43.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:42.999+0000 7f28f14ca640 1 -- 172.21.15.87:0/1047629515 shutdown_connections 2024-09-13T17:10:43.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:42.999+0000 7f28f14ca640 1 --2- 172.21.15.87:0/1047629515 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f28ec105110 0x7f28ec10cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:43.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:42.999+0000 7f28f14ca640 1 --2- 172.21.15.87:0/1047629515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28ec100990 0x7f28ec1049e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:43.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:42.999+0000 7f28f14ca640 1 --2- 172.21.15.87:0/1047629515 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28ec0fffe0 0x7f28ec1003c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:43.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:42.999+0000 7f28f14ca640 1 -- 172.21.15.87:0/1047629515 >> 172.21.15.87:0/1047629515 conn(0x7f28ec0fbae0 msgr2=0x7f28ec0fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:43.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:42.999+0000 7f28f14ca640 1 -- 172.21.15.87:0/1047629515 shutdown_connections 2024-09-13T17:10:43.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:42.999+0000 7f28f14ca640 1 -- 172.21.15.87:0/1047629515 wait complete. 2024-09-13T17:10:43.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.000+0000 7f28f14ca640 1 Processor -- start 2024-09-13T17:10:43.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.000+0000 7f28f14ca640 1 -- start start 2024-09-13T17:10:43.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.000+0000 7f28f14ca640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28ec0fffe0 0x7f28ec1985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:43.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.000+0000 7f28f14ca640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28ec100990 0x7f28ec198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:43.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.000+0000 7f28f14ca640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f28ec105110 0x7f28ec19ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:43.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.000+0000 7f28f14ca640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec19d490 con 0x7f28ec0fffe0 2024-09-13T17:10:43.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.000+0000 7f28f14ca640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec19d600 con 0x7f28ec100990 2024-09-13T17:10:43.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.000+0000 7f28f14ca640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec19d770 con 0x7f28ec105110 2024-09-13T17:10:43.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.000+0000 7f28eaffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28ec0fffe0 0x7f28ec1985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:43.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.000+0000 7f28eaffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28ec0fffe0 0x7f28ec1985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57370/0 (socket says 172.21.15.87:57370) 2024-09-13T17:10:43.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.000+0000 7f28eaffd640 1 -- 172.21.15.87:0/1431401316 learned_addr learned my addr 172.21.15.87:0/1431401316 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:10:43.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.000+0000 7f28eb7fe640 1 --2- 172.21.15.87:0/1431401316 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f28ec105110 0x7f28ec19ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:43.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.001+0000 7f28e3fff640 1 --2- 172.21.15.87:0/1431401316 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28ec100990 0x7f28ec198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:43.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.001+0000 7f28eaffd640 1 -- 172.21.15.87:0/1431401316 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f28ec105110 msgr2=0x7f28ec19ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:43.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.001+0000 7f28eaffd640 1 --2- 172.21.15.87:0/1431401316 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f28ec105110 0x7f28ec19ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:43.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.001+0000 7f28eaffd640 1 -- 172.21.15.87:0/1431401316 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28ec100990 msgr2=0x7f28ec198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:43.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.001+0000 7f28eaffd640 1 --2- 172.21.15.87:0/1431401316 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28ec100990 0x7f28ec198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:43.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.001+0000 7f28eaffd640 1 -- 172.21.15.87:0/1431401316 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d4009560 con 0x7f28ec0fffe0 2024-09-13T17:10:43.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.001+0000 7f28e3fff640 1 --2- 172.21.15.87:0/1431401316 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28ec100990 0x7f28ec198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:10:43.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.001+0000 7f28eaffd640 1 --2- 172.21.15.87:0/1431401316 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28ec0fffe0 0x7f28ec1985a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f28dc00b4a0 tx=0x7f28dc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:43.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.001+0000 7f28e8ff9640 1 -- 172.21.15.87:0/1431401316 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28dc010610 con 0x7f28ec0fffe0 2024-09-13T17:10:43.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.001+0000 7f28e8ff9640 1 -- 172.21.15.87:0/1431401316 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f28dc010c20 con 0x7f28ec0fffe0 2024-09-13T17:10:43.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.001+0000 7f28e8ff9640 1 -- 172.21.15.87:0/1431401316 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28dc017d50 con 0x7f28ec0fffe0 2024-09-13T17:10:43.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.001+0000 7f28f14ca640 1 -- 172.21.15.87:0/1431401316 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28ec19da50 con 0x7f28ec0fffe0 2024-09-13T17:10:43.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.001+0000 7f28f14ca640 1 -- 172.21.15.87:0/1431401316 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28ec19dd00 con 0x7f28ec0fffe0 2024-09-13T17:10:43.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.002+0000 7f28f14ca640 1 -- 172.21.15.87:0/1431401316 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28ec1014c0 con 0x7f28ec0fffe0 2024-09-13T17:10:43.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.003+0000 7f28e8ff9640 1 -- 172.21.15.87:0/1431401316 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f28dc010770 con 0x7f28ec0fffe0 2024-09-13T17:10:43.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.004+0000 7f28e8ff9640 1 --2- 172.21.15.87:0/1431401316 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f28d80a1080 0x7f28d80a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:43.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.004+0000 7f28e3fff640 1 --2- 172.21.15.87:0/1431401316 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f28d80a1080 0x7f28d80a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:43.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.004+0000 7f28e8ff9640 1 -- 172.21.15.87:0/1431401316 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f28dc0cbce0 con 0x7f28ec0fffe0 2024-09-13T17:10:43.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.004+0000 7f28e3fff640 1 --2- 172.21.15.87:0/1431401316 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f28d80a1080 0x7f28d80a3540 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f28d40057c0 tx=0x7f28d4005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:43.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.008+0000 7f28e8ff9640 1 -- 172.21.15.87:0/1431401316 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f28dc095910 con 0x7f28ec0fffe0 2024-09-13T17:10:43.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.171+0000 7f28f14ca640 1 -- 172.21.15.87:0/1431401316 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f28ec19dc40 con 0x7f28ec0fffe0 2024-09-13T17:10:43.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.172+0000 7f28e8ff9640 1 -- 172.21.15.87:0/1431401316 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f28dc098f30 con 0x7f28ec0fffe0 2024-09-13T17:10:43.174 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-09-13T17:10:43.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.173+0000 7f28f14ca640 1 -- 172.21.15.87:0/1431401316 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f28d80a1080 msgr2=0x7f28d80a3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:43.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.173+0000 7f28f14ca640 1 --2- 172.21.15.87:0/1431401316 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f28d80a1080 0x7f28d80a3540 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f28d40057c0 tx=0x7f28d4005a40 comp rx=0 tx=0).stop 2024-09-13T17:10:43.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.173+0000 7f28f14ca640 1 -- 172.21.15.87:0/1431401316 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28ec0fffe0 msgr2=0x7f28ec1985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:43.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.173+0000 7f28f14ca640 1 --2- 172.21.15.87:0/1431401316 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28ec0fffe0 0x7f28ec1985a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f28dc00b4a0 tx=0x7f28dc00b960 comp rx=0 tx=0).stop 2024-09-13T17:10:43.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.173+0000 7f28f14ca640 1 -- 172.21.15.87:0/1431401316 shutdown_connections 2024-09-13T17:10:43.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.173+0000 7f28f14ca640 1 --2- 172.21.15.87:0/1431401316 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f28d80a1080 0x7f28d80a3540 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:43.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.173+0000 7f28f14ca640 1 --2- 172.21.15.87:0/1431401316 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f28ec105110 0x7f28ec19ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:43.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.173+0000 7f28f14ca640 1 --2- 172.21.15.87:0/1431401316 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28ec100990 0x7f28ec198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:43.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.173+0000 7f28f14ca640 1 --2- 172.21.15.87:0/1431401316 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28ec0fffe0 0x7f28ec1985a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:43.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.173+0000 7f28f14ca640 1 -- 172.21.15.87:0/1431401316 >> 172.21.15.87:0/1431401316 conn(0x7f28ec0fbae0 msgr2=0x7f28ec0fcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:43.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.174+0000 7f28f14ca640 1 -- 172.21.15.87:0/1431401316 shutdown_connections 2024-09-13T17:10:43.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:43.174+0000 7f28f14ca640 1 -- 172.21.15.87:0/1431401316 wait complete. 2024-09-13T17:10:43.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:43 smithi118 ceph-mon[34374]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:43.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:43 smithi087 ceph-mon[30934]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:43.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:43 smithi149 ceph-mon[35496]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:43.821 INFO:tasks.cephadm:Adding mds.a on smithi087 2024-09-13T17:10:43.821 INFO:tasks.cephadm:Adding mds.d on smithi087 2024-09-13T17:10:43.821 INFO:tasks.cephadm:Adding mds.g on smithi087 2024-09-13T17:10:43.821 INFO:tasks.cephadm:Adding mds.j on smithi087 2024-09-13T17:10:43.821 INFO:tasks.cephadm:Adding mds.b on smithi118 2024-09-13T17:10:43.821 INFO:tasks.cephadm:Adding mds.e on smithi118 2024-09-13T17:10:43.821 INFO:tasks.cephadm:Adding mds.h on smithi118 2024-09-13T17:10:43.821 INFO:tasks.cephadm:Adding mds.k on smithi118 2024-09-13T17:10:43.821 INFO:tasks.cephadm:Adding mds.c on smithi149 2024-09-13T17:10:43.821 INFO:tasks.cephadm:Adding mds.f on smithi149 2024-09-13T17:10:43.822 INFO:tasks.cephadm:Adding mds.i on smithi149 2024-09-13T17:10:43.822 INFO:tasks.cephadm:Adding mds.l on smithi149 2024-09-13T17:10:43.822 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi087=a;smithi087=d;smithi087=g;smithi087=j;smithi118=b;smithi118=e;smithi118=h;smithi118=k;smithi149=c;smithi149=f;smithi149=i;smithi149=l' 2024-09-13T17:10:44.033 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T17:10:44.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:44 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1431401316' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:10:44.386 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:44 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1431401316' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:10:44.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:44 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1431401316' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:10:45.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:45 smithi118 ceph-mon[34374]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:45.375 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:45 smithi149 ceph-mon[35496]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:45.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:45 smithi087 ceph-mon[30934]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:45.743 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.725+0000 7f7a1d38d640 1 -- 172.21.15.149:0/1551752775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a180fff10 msgr2=0x7f7a18100390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:45.744 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.725+0000 7f7a1d38d640 1 --2- 172.21.15.149:0/1551752775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a180fff10 0x7f7a18100390 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c009900 tx=0x7f7a0c02a410 comp rx=0 tx=0).stop 2024-09-13T17:10:45.744 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.725+0000 7f7a1d38d640 1 -- 172.21.15.149:0/1551752775 shutdown_connections 2024-09-13T17:10:45.744 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.725+0000 7f7a1d38d640 1 --2- 172.21.15.149:0/1551752775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a181008d0 0x7f7a18107160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.744 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.725+0000 7f7a1d38d640 1 --2- 172.21.15.149:0/1551752775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a180fff10 0x7f7a18100390 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.744 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.725+0000 7f7a1d38d640 1 --2- 172.21.15.149:0/1551752775 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a180fed10 0x7f7a180ff110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.744 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.725+0000 7f7a1d38d640 1 -- 172.21.15.149:0/1551752775 >> 172.21.15.149:0/1551752775 conn(0x7f7a180fa4c0 msgr2=0x7f7a180fc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:45.744 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.725+0000 7f7a1d38d640 1 -- 172.21.15.149:0/1551752775 shutdown_connections 2024-09-13T17:10:45.744 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.725+0000 7f7a1d38d640 1 -- 172.21.15.149:0/1551752775 wait complete. 2024-09-13T17:10:45.744 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.726+0000 7f7a1d38d640 1 Processor -- start 2024-09-13T17:10:45.744 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.726+0000 7f7a1d38d640 1 -- start start 2024-09-13T17:10:45.744 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.726+0000 7f7a1d38d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a180fed10 0x7f7a18069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:45.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.726+0000 7f7a1d38d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a180fff10 0x7f7a1819ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:45.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.726+0000 7f7a1d38d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a181008d0 0x7f7a1819d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:45.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.726+0000 7f7a1d38d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1819d950 con 0x7f7a181008d0 2024-09-13T17:10:45.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.726+0000 7f7a1d38d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1819dac0 con 0x7f7a180fed10 2024-09-13T17:10:45.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.726+0000 7f7a1d38d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1819dc80 con 0x7f7a180fff10 2024-09-13T17:10:45.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.726+0000 7f7a167fc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a180fff10 0x7f7a1819ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:45.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.726+0000 7f7a167fc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a180fff10 0x7f7a1819ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:35196/0 (socket says 172.21.15.149:35196) 2024-09-13T17:10:45.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.726+0000 7f7a167fc640 1 -- 172.21.15.149:0/4051902183 learned_addr learned my addr 172.21.15.149:0/4051902183 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-13T17:10:45.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.726+0000 7f7a16ffd640 1 --2- 172.21.15.149:0/4051902183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a180fed10 0x7f7a18069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:45.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.726+0000 7f7a167fc640 1 -- 172.21.15.149:0/4051902183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a180fed10 msgr2=0x7f7a18069280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:45.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.726+0000 7f7a167fc640 1 --2- 172.21.15.149:0/4051902183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a180fed10 0x7f7a18069280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.726+0000 7f7a177fe640 1 --2- 172.21.15.149:0/4051902183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a181008d0 0x7f7a1819d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:45.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.726+0000 7f7a167fc640 1 -- 172.21.15.149:0/4051902183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a181008d0 msgr2=0x7f7a1819d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:45.745 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.727+0000 7f7a167fc640 1 --2- 172.21.15.149:0/4051902183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a181008d0 0x7f7a1819d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.727+0000 7f7a167fc640 1 -- 172.21.15.149:0/4051902183 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0c009560 con 0x7f7a180fff10 2024-09-13T17:10:45.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.727+0000 7f7a16ffd640 1 --2- 172.21.15.149:0/4051902183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a180fed10 0x7f7a18069280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:10:45.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.727+0000 7f7a167fc640 1 --2- 172.21.15.149:0/4051902183 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a180fff10 0x7f7a1819ab50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c031460 tx=0x7f7a0c004360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:45.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.727+0000 7f79fffff640 1 -- 172.21.15.149:0/4051902183 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c003800 con 0x7f7a180fff10 2024-09-13T17:10:45.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.727+0000 7f79fffff640 1 -- 172.21.15.149:0/4051902183 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7a0c003e10 con 0x7f7a180fff10 2024-09-13T17:10:45.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.727+0000 7f7a1d38d640 1 -- 172.21.15.149:0/4051902183 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a1819dea0 con 0x7f7a180fff10 2024-09-13T17:10:45.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.727+0000 7f79fffff640 1 -- 172.21.15.149:0/4051902183 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c03b3d0 con 0x7f7a180fff10 2024-09-13T17:10:45.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.727+0000 7f7a1d38d640 1 -- 172.21.15.149:0/4051902183 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a1819e2b0 con 0x7f7a180fff10 2024-09-13T17:10:45.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.728+0000 7f7a1d38d640 1 -- 172.21.15.149:0/4051902183 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a181061a0 con 0x7f7a180fff10 2024-09-13T17:10:45.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.729+0000 7f79fffff640 1 -- 172.21.15.149:0/4051902183 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f7a0c03c700 con 0x7f7a180fff10 2024-09-13T17:10:45.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.730+0000 7f79fffff640 1 --2- 172.21.15.149:0/4051902183 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f7a000a1080 0x7f7a000a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:45.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.730+0000 7f79fffff640 1 -- 172.21.15.149:0/4051902183 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f7a0c0ed2a0 con 0x7f7a180fff10 2024-09-13T17:10:45.746 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.730+0000 7f7a16ffd640 1 --2- 172.21.15.149:0/4051902183 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f7a000a1080 0x7f7a000a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:45.747 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.731+0000 7f7a16ffd640 1 --2- 172.21.15.149:0/4051902183 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f7a000a1080 0x7f7a000a3540 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7a180ffd70 tx=0x7f7a08005e70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:45.747 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.734+0000 7f79fffff640 1 -- 172.21.15.149:0/4051902183 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7a0c0b6ed0 con 0x7f7a180fff10 2024-09-13T17:10:45.907 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.906+0000 7f7a1d38d640 1 -- 172.21.15.149:0/4051902183 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi087=a;smithi087=d;smithi087=g;smithi087=j;smithi118=b;smithi118=e;smithi118=h;smithi118=k;smithi149=c;smithi149=f;smithi149=i;smithi149=l", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a1802c550 con 0x7f7a000a1080 2024-09-13T17:10:45.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.913+0000 7f79fffff640 1 -- 172.21.15.149:0/4051902183 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f7a1802c550 con 0x7f7a000a1080 2024-09-13T17:10:45.914 INFO:teuthology.orchestra.run.smithi149.stdout:Scheduled mds.all update... 2024-09-13T17:10:45.916 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.915+0000 7f7a1d38d640 1 -- 172.21.15.149:0/4051902183 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f7a000a1080 msgr2=0x7f7a000a3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:45.916 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.915+0000 7f7a1d38d640 1 --2- 172.21.15.149:0/4051902183 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f7a000a1080 0x7f7a000a3540 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7a180ffd70 tx=0x7f7a08005e70 comp rx=0 tx=0).stop 2024-09-13T17:10:45.916 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.915+0000 7f7a1d38d640 1 -- 172.21.15.149:0/4051902183 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a180fff10 msgr2=0x7f7a1819ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:45.916 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.915+0000 7f7a1d38d640 1 --2- 172.21.15.149:0/4051902183 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a180fff10 0x7f7a1819ab50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c031460 tx=0x7f7a0c004360 comp rx=0 tx=0).stop 2024-09-13T17:10:45.916 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.915+0000 7f7a1d38d640 1 -- 172.21.15.149:0/4051902183 shutdown_connections 2024-09-13T17:10:45.916 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.915+0000 7f7a1d38d640 1 --2- 172.21.15.149:0/4051902183 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f7a000a1080 0x7f7a000a3540 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.916 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.915+0000 7f7a1d38d640 1 --2- 172.21.15.149:0/4051902183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a181008d0 0x7f7a1819d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.916 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.915+0000 7f7a1d38d640 1 --2- 172.21.15.149:0/4051902183 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a180fff10 0x7f7a1819ab50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.915+0000 7f7a1d38d640 1 --2- 172.21.15.149:0/4051902183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a180fed10 0x7f7a18069280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:45.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.915+0000 7f7a1d38d640 1 -- 172.21.15.149:0/4051902183 >> 172.21.15.149:0/4051902183 conn(0x7f7a180fa4c0 msgr2=0x7f7a18103370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:45.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.915+0000 7f7a1d38d640 1 -- 172.21.15.149:0/4051902183 shutdown_connections 2024-09-13T17:10:45.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T17:10:45.915+0000 7f7a1d38d640 1 -- 172.21.15.149:0/4051902183 wait complete. 2024-09-13T17:10:46.646 DEBUG:teuthology.orchestra.run.smithi087:mds.a> sudo journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.a.service 2024-09-13T17:10:46.649 DEBUG:teuthology.orchestra.run.smithi087:mds.d> sudo journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.d.service 2024-09-13T17:10:46.691 DEBUG:teuthology.orchestra.run.smithi087:mds.g> sudo journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.g.service 2024-09-13T17:10:46.735 DEBUG:teuthology.orchestra.run.smithi087:mds.j> sudo journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.j.service 2024-09-13T17:10:46.778 DEBUG:teuthology.orchestra.run.smithi118:mds.b> sudo journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.b.service 2024-09-13T17:10:46.780 DEBUG:teuthology.orchestra.run.smithi118:mds.e> sudo journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.e.service 2024-09-13T17:10:46.823 DEBUG:teuthology.orchestra.run.smithi118:mds.h> sudo journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.h.service 2024-09-13T17:10:46.867 DEBUG:teuthology.orchestra.run.smithi118:mds.k> sudo journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.k.service 2024-09-13T17:10:46.910 DEBUG:teuthology.orchestra.run.smithi149:mds.c> sudo journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.c.service 2024-09-13T17:10:46.913 DEBUG:teuthology.orchestra.run.smithi149:mds.f> sudo journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.f.service 2024-09-13T17:10:46.957 DEBUG:teuthology.orchestra.run.smithi149:mds.i> sudo journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.i.service 2024-09-13T17:10:46.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:46 smithi087 ceph-mon[30934]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi087=a;smithi087=d;smithi087=g;smithi087=j;smithi118=b;smithi118=e;smithi118=h;smithi118=k;smithi149=c;smithi149=f;smithi149=i;smithi149=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:10:46.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:46 smithi087 ceph-mon[30934]: Saving service mds.all spec with placement smithi087=a;smithi087=d;smithi087=g;smithi087=j;smithi118=b;smithi118=e;smithi118=h;smithi118=k;smithi149=c;smithi149=f;smithi149=i;smithi149=l;count:12 2024-09-13T17:10:46.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:46 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:46.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:46 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:10:46.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:46 smithi087 ceph-mon[30934]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:46.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:46 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:46.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:46 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:10:46.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:46 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:46.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:46 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:10:46.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:46 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:10:46.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:46 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:46.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:46 smithi087 ceph-mon[30934]: Deploying daemon mds.l on smithi149 2024-09-13T17:10:47.000 DEBUG:teuthology.orchestra.run.smithi149:mds.l> sudo journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.l.service 2024-09-13T17:10:47.042 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-13T17:10:47.043 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:10:47.097 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:46 smithi149 ceph-mon[35496]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi087=a;smithi087=d;smithi087=g;smithi087=j;smithi118=b;smithi118=e;smithi118=h;smithi118=k;smithi149=c;smithi149=f;smithi149=i;smithi149=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:10:47.098 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:46 smithi149 ceph-mon[35496]: Saving service mds.all spec with placement smithi087=a;smithi087=d;smithi087=g;smithi087=j;smithi118=b;smithi118=e;smithi118=h;smithi118=k;smithi149=c;smithi149=f;smithi149=i;smithi149=l;count:12 2024-09-13T17:10:47.098 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:46 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:47.098 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:46 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:10:47.098 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:46 smithi149 ceph-mon[35496]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:47.098 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:46 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:47.098 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:46 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:10:47.098 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:46 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:47.098 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:46 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:10:47.098 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:46 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:10:47.098 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:46 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:47.098 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:46 smithi149 ceph-mon[35496]: Deploying daemon mds.l on smithi149 2024-09-13T17:10:47.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:46 smithi118 ceph-mon[34374]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi087=a;smithi087=d;smithi087=g;smithi087=j;smithi118=b;smithi118=e;smithi118=h;smithi118=k;smithi149=c;smithi149=f;smithi149=i;smithi149=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:10:47.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:46 smithi118 ceph-mon[34374]: Saving service mds.all spec with placement smithi087=a;smithi087=d;smithi087=g;smithi087=j;smithi118=b;smithi118=e;smithi118=h;smithi118=k;smithi149=c;smithi149=f;smithi149=i;smithi149=l;count:12 2024-09-13T17:10:47.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:46 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:47.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:46 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:10:47.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:46 smithi118 ceph-mon[34374]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:47.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:46 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:47.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:46 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:10:47.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:46 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:47.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:46 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:10:47.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:46 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:10:47.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:46 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:47.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:46 smithi118 ceph-mon[34374]: Deploying daemon mds.l on smithi149 2024-09-13T17:10:47.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.145+0000 7feeab6b1640 1 -- 172.21.15.87:0/2934263993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feea40feca0 msgr2=0x7feea40ff0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:47.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.145+0000 7feeab6b1640 1 --2- 172.21.15.87:0/2934263993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feea40feca0 0x7feea40ff0a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fee94009900 tx=0x7fee9402a410 comp rx=0 tx=0).stop 2024-09-13T17:10:47.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.145+0000 7feeab6b1640 1 -- 172.21.15.87:0/2934263993 shutdown_connections 2024-09-13T17:10:47.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.145+0000 7feeab6b1640 1 --2- 172.21.15.87:0/2934263993 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feea4100850 0x7feea41070e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.145+0000 7feeab6b1640 1 --2- 172.21.15.87:0/2934263993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feea40ffe90 0x7feea4100310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.145+0000 7feeab6b1640 1 --2- 172.21.15.87:0/2934263993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feea40feca0 0x7feea40ff0a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.145+0000 7feeab6b1640 1 -- 172.21.15.87:0/2934263993 >> 172.21.15.87:0/2934263993 conn(0x7feea40fa400 msgr2=0x7feea40fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:47.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.145+0000 7feeab6b1640 1 -- 172.21.15.87:0/2934263993 shutdown_connections 2024-09-13T17:10:47.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.145+0000 7feeab6b1640 1 -- 172.21.15.87:0/2934263993 wait complete. 2024-09-13T17:10:47.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.146+0000 7feeab6b1640 1 Processor -- start 2024-09-13T17:10:47.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.146+0000 7feeab6b1640 1 -- start start 2024-09-13T17:10:47.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.146+0000 7feeab6b1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feea40feca0 0x7feea40691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:47.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.146+0000 7feeab6b1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feea40ffe90 0x7feea419aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:47.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.146+0000 7feeab6b1640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feea4100850 0x7feea419d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:47.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.146+0000 7feeab6b1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea419d8d0 con 0x7feea40feca0 2024-09-13T17:10:47.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.146+0000 7feeab6b1640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea419da40 con 0x7feea40ffe90 2024-09-13T17:10:47.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.146+0000 7feeab6b1640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea419dc00 con 0x7feea4100850 2024-09-13T17:10:47.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.146+0000 7feea944d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feea40feca0 0x7feea40691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:47.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.146+0000 7feea944d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feea40feca0 0x7feea40691a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57380/0 (socket says 172.21.15.87:57380) 2024-09-13T17:10:47.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.146+0000 7feea944d640 1 -- 172.21.15.87:0/3894737417 learned_addr learned my addr 172.21.15.87:0/3894737417 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:10:47.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.146+0000 7feea8c4c640 1 --2- 172.21.15.87:0/3894737417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feea40ffe90 0x7feea419aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:47.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.146+0000 7feea9c4e640 1 --2- 172.21.15.87:0/3894737417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feea4100850 0x7feea419d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:47.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.146+0000 7feea944d640 1 -- 172.21.15.87:0/3894737417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feea4100850 msgr2=0x7feea419d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:47.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.146+0000 7feea944d640 1 --2- 172.21.15.87:0/3894737417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feea4100850 0x7feea419d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.146+0000 7feea944d640 1 -- 172.21.15.87:0/3894737417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feea40ffe90 msgr2=0x7feea419aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:47.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.146+0000 7feea944d640 1 --2- 172.21.15.87:0/3894737417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feea40ffe90 0x7feea419aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.146+0000 7feea944d640 1 -- 172.21.15.87:0/3894737417 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee94009560 con 0x7feea40feca0 2024-09-13T17:10:47.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.146+0000 7feea944d640 1 --2- 172.21.15.87:0/3894737417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feea40feca0 0x7feea40691a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fee9402aa00 tx=0x7fee94004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:47.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.147+0000 7fee9a7fc640 1 -- 172.21.15.87:0/3894737417 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee94003a00 con 0x7feea40feca0 2024-09-13T17:10:47.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.147+0000 7fee9a7fc640 1 -- 172.21.15.87:0/3894737417 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fee94003b60 con 0x7feea40feca0 2024-09-13T17:10:47.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.147+0000 7feeab6b1640 1 -- 172.21.15.87:0/3894737417 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea419de20 con 0x7feea40feca0 2024-09-13T17:10:47.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.147+0000 7fee9a7fc640 1 -- 172.21.15.87:0/3894737417 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9403a3c0 con 0x7feea40feca0 2024-09-13T17:10:47.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.147+0000 7feeab6b1640 1 -- 172.21.15.87:0/3894737417 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea419e240 con 0x7feea40feca0 2024-09-13T17:10:47.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.148+0000 7feeab6b1640 1 -- 172.21.15.87:0/3894737417 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea40ff0a0 con 0x7feea40feca0 2024-09-13T17:10:47.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.150+0000 7fee9a7fc640 1 -- 172.21.15.87:0/3894737417 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fee9403b460 con 0x7feea40feca0 2024-09-13T17:10:47.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.150+0000 7fee9a7fc640 1 --2- 172.21.15.87:0/3894737417 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fee900a1110 0x7fee900a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:47.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.150+0000 7feea8c4c640 1 --2- 172.21.15.87:0/3894737417 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fee900a1110 0x7fee900a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:47.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.150+0000 7fee9a7fc640 1 -- 172.21.15.87:0/3894737417 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fee940ed4f0 con 0x7feea40feca0 2024-09-13T17:10:47.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.151+0000 7feea8c4c640 1 --2- 172.21.15.87:0/3894737417 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fee900a1110 0x7fee900a35d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7feea4068f10 tx=0x7feea000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:47.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.153+0000 7fee9a7fc640 1 -- 172.21.15.87:0/3894737417 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fee940b7120 con 0x7feea40feca0 2024-09-13T17:10:47.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.320+0000 7feeab6b1640 1 -- 172.21.15.87:0/3894737417 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feea410a680 con 0x7feea40feca0 2024-09-13T17:10:47.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.321+0000 7fee9a7fc640 1 -- 172.21.15.87:0/3894737417 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+18433 (secure 0 0 0) 0x7fee940ba740 con 0x7feea40feca0 2024-09-13T17:10:47.323 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:10:47.323 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":81,"fsid":"043d5bae-71f2-11ef-bceb-c7b262605968","created":"2024-09-13T17:03:57.852010+0000","modified":"2024-09-13T17:10:36.006538+0000","last_up_change":"2024-09-13T17:10:34.423548+0000","last_in_change":"2024-09-13T17:10:14.228123+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:07:02.286400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"58250283-85c0-416e-abdd-1fc5a7ff0c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6803","nonce":1316956138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6805","nonce":1316956138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6809","nonce":1316956138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6807","nonce":1316956138}]},"public_addr":"172.21.15.87:6803/1316956138","cluster_addr":"172.21.15.87:6805/1316956138","heartbeat_back_addr":"172.21.15.87:6809/1316956138","heartbeat_front_addr":"172.21.15.87:6807/1316956138","state":["exists","up"]},{"osd":1,"uuid":"b9d49969-94b1-4262-b4ff-db0a8e3331af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6801","nonce":3352566727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6803","nonce":3352566727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6807","nonce":3352566727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6805","nonce":3352566727}]},"public_addr":"172.21.15.118:6801/3352566727","cluster_addr":"172.21.15.118:6803/3352566727","heartbeat_back_addr":"172.21.15.118:6807/3352566727","heartbeat_front_addr":"172.21.15.118:6805/3352566727","state":["exists","up"]},{"osd":2,"uuid":"ba64549e-d736-426f-b466-f569af5f16d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6801","nonce":2774581686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6803","nonce":2774581686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6807","nonce":2774581686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6805","nonce":2774581686}]},"public_addr":"172.21.15.149:6801/2774581686","cluster_addr":"172.21.15.149:6803/2774581686","heartbeat_back_addr":"172.21.15.149:6807/2774581686","heartbeat_front_addr":"172.21.15.149:6805/2774581686","state":["exists","up"]},{"osd":3,"uuid":"3d5553e5-371b-49fd-976b-9e72a97a2f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6811","nonce":3306119066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6813","nonce":3306119066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6817","nonce":3306119066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6815","nonce":3306119066}]},"public_addr":"172.21.15.87:6811/3306119066","cluster_addr":"172.21.15.87:6813/3306119066","heartbeat_back_addr":"172.21.15.87:6817/3306119066","heartbeat_front_addr":"172.21.15.87:6815/3306119066","state":["exists","up"]},{"osd":4,"uuid":"2fbe0e27-34ec-42a6-9962-f1d8202b3159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6809","nonce":3342349890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6811","nonce":3342349890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6815","nonce":3342349890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6813","nonce":3342349890}]},"public_addr":"172.21.15.118:6809/3342349890","cluster_addr":"172.21.15.118:6811/3342349890","heartbeat_back_addr":"172.21.15.118:6815/3342349890","heartbeat_front_addr":"172.21.15.118:6813/3342349890","state":["exists","up"]},{"osd":5,"uuid":"53c14519-6170-4b5a-a79d-4835882d7bec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6809","nonce":3468867124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6811","nonce":3468867124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6815","nonce":3468867124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6813","nonce":3468867124}]},"public_addr":"172.21.15.149:6809/3468867124","cluster_addr":"172.21.15.149:6811/3468867124","heartbeat_back_addr":"172.21.15.149:6815/3468867124","heartbeat_front_addr":"172.21.15.149:6813/3468867124","state":["exists","up"]},{"osd":6,"uuid":"d3951b32-db77-4b8b-9de0-f05e03d13f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6819","nonce":326563617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6821","nonce":326563617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6825","nonce":326563617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6823","nonce":326563617}]},"public_addr":"172.21.15.87:6819/326563617","cluster_addr":"172.21.15.87:6821/326563617","heartbeat_back_addr":"172.21.15.87:6825/326563617","heartbeat_front_addr":"172.21.15.87:6823/326563617","state":["exists","up"]},{"osd":7,"uuid":"4d46dab7-a8bf-4e3e-b5c0-43860d336bdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6817","nonce":1690268990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6819","nonce":1690268990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6823","nonce":1690268990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6821","nonce":1690268990}]},"public_addr":"172.21.15.118:6817/1690268990","cluster_addr":"172.21.15.118:6819/1690268990","heartbeat_back_addr":"172.21.15.118:6823/1690268990","heartbeat_front_addr":"172.21.15.118:6821/1690268990","state":["exists","up"]},{"osd":8,"uuid":"5a015a7d-60a3-4412-96af-1b61d2ad51f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6817","nonce":1558675380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6819","nonce":1558675380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6823","nonce":1558675380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6821","nonce":1558675380}]},"public_addr":"172.21.15.149:6817/1558675380","cluster_addr":"172.21.15.149:6819/1558675380","heartbeat_back_addr":"172.21.15.149:6823/1558675380","heartbeat_front_addr":"172.21.15.149:6821/1558675380","state":["exists","up"]},{"osd":9,"uuid":"248c0b6e-4c4e-4c63-a0dd-e4cdf3b997a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6827","nonce":1453934262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6829","nonce":1453934262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6833","nonce":1453934262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6831","nonce":1453934262}]},"public_addr":"172.21.15.87:6827/1453934262","cluster_addr":"172.21.15.87:6829/1453934262","heartbeat_back_addr":"172.21.15.87:6833/1453934262","heartbeat_front_addr":"172.21.15.87:6831/1453934262","state":["exists","up"]},{"osd":10,"uuid":"24238714-e737-4371-b5d5-0cd3395f09bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6825","nonce":1034318850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6827","nonce":1034318850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6831","nonce":1034318850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6829","nonce":1034318850}]},"public_addr":"172.21.15.118:6825/1034318850","cluster_addr":"172.21.15.118:6827/1034318850","heartbeat_back_addr":"172.21.15.118:6831/1034318850","heartbeat_front_addr":"172.21.15.118:6829/1034318850","state":["exists","up"]},{"osd":11,"uuid":"409dd3bf-5154-4dea-8708-7de7f9e2e793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6825","nonce":271000465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6827","nonce":271000465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6831","nonce":271000465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6829","nonce":271000465}]},"public_addr":"172.21.15.149:6825/271000465","cluster_addr":"172.21.15.149:6827/271000465","heartbeat_back_addr":"172.21.15.149:6831/271000465","heartbeat_front_addr":"172.21.15.149:6829/271000465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:16.382664+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:37.914250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:00.425876+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:23.960183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:47.004088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:10.214345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:33.719221+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:57.099599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:20.971881+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:44.827167+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:08.135516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:32.085853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/586423689":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6801/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6800/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/3270371628":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/515676743":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/1475107314":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/553289143":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/3403361612":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6801/1587363880":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6800/1587363880":"2024-09-14T17:04:24.083789+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:10:47.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.323+0000 7feeab6b1640 1 -- 172.21.15.87:0/3894737417 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fee900a1110 msgr2=0x7fee900a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:47.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.323+0000 7feeab6b1640 1 --2- 172.21.15.87:0/3894737417 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fee900a1110 0x7fee900a35d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7feea4068f10 tx=0x7feea000a2d0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.323+0000 7feeab6b1640 1 -- 172.21.15.87:0/3894737417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feea40feca0 msgr2=0x7feea40691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:47.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.323+0000 7feeab6b1640 1 --2- 172.21.15.87:0/3894737417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feea40feca0 0x7feea40691a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fee9402aa00 tx=0x7fee94004340 comp rx=0 tx=0).stop 2024-09-13T17:10:47.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.323+0000 7feeab6b1640 1 -- 172.21.15.87:0/3894737417 shutdown_connections 2024-09-13T17:10:47.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.323+0000 7feeab6b1640 1 --2- 172.21.15.87:0/3894737417 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fee900a1110 0x7fee900a35d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.323+0000 7feeab6b1640 1 --2- 172.21.15.87:0/3894737417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feea4100850 0x7feea419d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.323+0000 7feeab6b1640 1 --2- 172.21.15.87:0/3894737417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feea40ffe90 0x7feea419aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.323+0000 7feeab6b1640 1 --2- 172.21.15.87:0/3894737417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feea40feca0 0x7feea40691a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.323+0000 7feeab6b1640 1 -- 172.21.15.87:0/3894737417 >> 172.21.15.87:0/3894737417 conn(0x7feea40fa400 msgr2=0x7feea4103350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:47.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.323+0000 7feeab6b1640 1 -- 172.21.15.87:0/3894737417 shutdown_connections 2024-09-13T17:10:47.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.323+0000 7feeab6b1640 1 -- 172.21.15.87:0/3894737417 wait complete. 2024-09-13T17:10:47.335 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:07:02.286400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:10:47.336 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:10:47.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.436+0000 7f5b6fc8e640 1 -- 172.21.15.87:0/2356456978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b680ffe70 msgr2=0x7f5b681002f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:47.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.436+0000 7f5b6fc8e640 1 --2- 172.21.15.87:0/2356456978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b680ffe70 0x7f5b681002f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5b58009900 tx=0x7f5b5802a410 comp rx=0 tx=0).stop 2024-09-13T17:10:47.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.436+0000 7f5b6fc8e640 1 -- 172.21.15.87:0/2356456978 shutdown_connections 2024-09-13T17:10:47.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.436+0000 7f5b6fc8e640 1 --2- 172.21.15.87:0/2356456978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b68100830 0x7f5b681070c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.436+0000 7f5b6fc8e640 1 --2- 172.21.15.87:0/2356456978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b680ffe70 0x7f5b681002f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.436+0000 7f5b6fc8e640 1 --2- 172.21.15.87:0/2356456978 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b680fec80 0x7f5b680ff080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.436+0000 7f5b6fc8e640 1 -- 172.21.15.87:0/2356456978 >> 172.21.15.87:0/2356456978 conn(0x7f5b680fa3e0 msgr2=0x7f5b680fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:47.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.436+0000 7f5b6fc8e640 1 -- 172.21.15.87:0/2356456978 shutdown_connections 2024-09-13T17:10:47.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.436+0000 7f5b6fc8e640 1 -- 172.21.15.87:0/2356456978 wait complete. 2024-09-13T17:10:47.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.437+0000 7f5b6fc8e640 1 Processor -- start 2024-09-13T17:10:47.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.437+0000 7f5b6fc8e640 1 -- start start 2024-09-13T17:10:47.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.437+0000 7f5b6fc8e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b680fec80 0x7f5b68195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:47.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.437+0000 7f5b6fc8e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b680ffe70 0x7f5b68196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:47.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.437+0000 7f5b6fc8e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b68100830 0x7f5b6819d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:47.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.437+0000 7f5b6fc8e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6819d8b0 con 0x7f5b680fec80 2024-09-13T17:10:47.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.437+0000 7f5b6fc8e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6819da20 con 0x7f5b680ffe70 2024-09-13T17:10:47.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.437+0000 7f5b6fc8e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6819dbe0 con 0x7f5b68100830 2024-09-13T17:10:47.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.437+0000 7f5b6da2a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b680fec80 0x7f5b68195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:47.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.437+0000 7f5b6da2a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b680fec80 0x7f5b68195dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57402/0 (socket says 172.21.15.87:57402) 2024-09-13T17:10:47.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.437+0000 7f5b6da2a640 1 -- 172.21.15.87:0/132861692 learned_addr learned my addr 172.21.15.87:0/132861692 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:10:47.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.437+0000 7f5b6d229640 1 --2- 172.21.15.87:0/132861692 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b680ffe70 0x7f5b68196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:47.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.437+0000 7f5b6e22b640 1 --2- 172.21.15.87:0/132861692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b68100830 0x7f5b6819d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:47.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.437+0000 7f5b6da2a640 1 -- 172.21.15.87:0/132861692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b68100830 msgr2=0x7f5b6819d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:47.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.437+0000 7f5b6da2a640 1 --2- 172.21.15.87:0/132861692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b68100830 0x7f5b6819d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.437+0000 7f5b6da2a640 1 -- 172.21.15.87:0/132861692 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b680ffe70 msgr2=0x7f5b68196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:47.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.437+0000 7f5b6da2a640 1 --2- 172.21.15.87:0/132861692 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b680ffe70 0x7f5b68196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.437+0000 7f5b6da2a640 1 -- 172.21.15.87:0/132861692 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b58009560 con 0x7f5b680fec80 2024-09-13T17:10:47.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.438+0000 7f5b6da2a640 1 --2- 172.21.15.87:0/132861692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b680fec80 0x7f5b68195dc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5b6400c970 tx=0x7f5b6400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:47.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.438+0000 7f5b5effd640 1 -- 172.21.15.87:0/132861692 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b64004220 con 0x7f5b680fec80 2024-09-13T17:10:47.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.438+0000 7f5b5effd640 1 -- 172.21.15.87:0/132861692 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5b64007e60 con 0x7f5b680fec80 2024-09-13T17:10:47.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.438+0000 7f5b6fc8e640 1 -- 172.21.15.87:0/132861692 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b6819dec0 con 0x7f5b680fec80 2024-09-13T17:10:47.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.438+0000 7f5b5effd640 1 -- 172.21.15.87:0/132861692 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b64003ea0 con 0x7f5b680fec80 2024-09-13T17:10:47.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.438+0000 7f5b6fc8e640 1 -- 172.21.15.87:0/132861692 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b6819e2e0 con 0x7f5b680fec80 2024-09-13T17:10:47.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.439+0000 7f5b6fc8e640 1 -- 172.21.15.87:0/132861692 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b6810a570 con 0x7f5b680fec80 2024-09-13T17:10:47.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.440+0000 7f5b5effd640 1 -- 172.21.15.87:0/132861692 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5b640079b0 con 0x7f5b680fec80 2024-09-13T17:10:47.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.440+0000 7f5b5effd640 1 --2- 172.21.15.87:0/132861692 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f5b540a1090 0x7f5b540a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:47.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.440+0000 7f5b6d229640 1 --2- 172.21.15.87:0/132861692 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f5b540a1090 0x7f5b540a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:47.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.440+0000 7f5b5effd640 1 -- 172.21.15.87:0/132861692 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f5b640cc080 con 0x7f5b680fec80 2024-09-13T17:10:47.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.441+0000 7f5b6d229640 1 --2- 172.21.15.87:0/132861692 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f5b540a1090 0x7f5b540a3550 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5b58031460 tx=0x7f5b580058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:47.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.444+0000 7f5b5effd640 1 -- 172.21.15.87:0/132861692 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5b64095d60 con 0x7f5b680fec80 2024-09-13T17:10:47.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.606+0000 7f5b6fc8e640 1 -- 172.21.15.87:0/132861692 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5b6819e850 con 0x7f5b680fec80 2024-09-13T17:10:47.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.607+0000 7f5b5effd640 1 -- 172.21.15.87:0/132861692 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5b64099380 con 0x7f5b680fec80 2024-09-13T17:10:47.608 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-09-13T17:10:47.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.609+0000 7f5b6fc8e640 1 -- 172.21.15.87:0/132861692 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f5b540a1090 msgr2=0x7f5b540a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:47.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.609+0000 7f5b6fc8e640 1 --2- 172.21.15.87:0/132861692 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f5b540a1090 0x7f5b540a3550 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5b58031460 tx=0x7f5b580058d0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.609+0000 7f5b6fc8e640 1 -- 172.21.15.87:0/132861692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b680fec80 msgr2=0x7f5b68195dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:47.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.609+0000 7f5b6fc8e640 1 --2- 172.21.15.87:0/132861692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b680fec80 0x7f5b68195dc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5b6400c970 tx=0x7f5b6400ce30 comp rx=0 tx=0).stop 2024-09-13T17:10:47.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.609+0000 7f5b6fc8e640 1 -- 172.21.15.87:0/132861692 shutdown_connections 2024-09-13T17:10:47.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.609+0000 7f5b6fc8e640 1 --2- 172.21.15.87:0/132861692 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f5b540a1090 0x7f5b540a3550 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.609+0000 7f5b6fc8e640 1 --2- 172.21.15.87:0/132861692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b68100830 0x7f5b6819d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.609+0000 7f5b6fc8e640 1 --2- 172.21.15.87:0/132861692 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b680ffe70 0x7f5b68196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.609+0000 7f5b6fc8e640 1 --2- 172.21.15.87:0/132861692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b680fec80 0x7f5b68195dc0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.609+0000 7f5b6fc8e640 1 -- 172.21.15.87:0/132861692 >> 172.21.15.87:0/132861692 conn(0x7f5b680fa3e0 msgr2=0x7f5b680685b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:47.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.609+0000 7f5b6fc8e640 1 -- 172.21.15.87:0/132861692 shutdown_connections 2024-09-13T17:10:47.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.609+0000 7f5b6fc8e640 1 -- 172.21.15.87:0/132861692 wait complete. 2024-09-13T17:10:47.621 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:10:47.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.718+0000 7f5d87819640 1 -- 172.21.15.87:0/1010886130 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d80100880 msgr2=0x7f5d80102c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:47.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.718+0000 7f5d87819640 1 --2- 172.21.15.87:0/1010886130 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d80100880 0x7f5d80102c70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5d70009900 tx=0x7f5d7002a410 comp rx=0 tx=0).stop 2024-09-13T17:10:47.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.718+0000 7f5d87819640 1 -- 172.21.15.87:0/1010886130 shutdown_connections 2024-09-13T17:10:47.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.718+0000 7f5d87819640 1 --2- 172.21.15.87:0/1010886130 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d80105ae0 0x7f5d80107ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.718+0000 7f5d87819640 1 --2- 172.21.15.87:0/1010886130 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d801031b0 0x7f5d801055a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.718+0000 7f5d87819640 1 --2- 172.21.15.87:0/1010886130 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d80100880 0x7f5d80102c70 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.718+0000 7f5d87819640 1 -- 172.21.15.87:0/1010886130 >> 172.21.15.87:0/1010886130 conn(0x7f5d800fa420 msgr2=0x7f5d800fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:47.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.718+0000 7f5d87819640 1 -- 172.21.15.87:0/1010886130 shutdown_connections 2024-09-13T17:10:47.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.718+0000 7f5d87819640 1 -- 172.21.15.87:0/1010886130 wait complete. 2024-09-13T17:10:47.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.719+0000 7f5d87819640 1 Processor -- start 2024-09-13T17:10:47.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.719+0000 7f5d87819640 1 -- start start 2024-09-13T17:10:47.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.719+0000 7f5d87819640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d80100880 0x7f5d80195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:47.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.719+0000 7f5d87819640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d801031b0 0x7f5d801963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:47.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.719+0000 7f5d87819640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d80105ae0 0x7f5d8019d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:47.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.719+0000 7f5d87819640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8019d980 con 0x7f5d801031b0 2024-09-13T17:10:47.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.719+0000 7f5d87819640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8019daf0 con 0x7f5d80105ae0 2024-09-13T17:10:47.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.719+0000 7f5d87819640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8019dcb0 con 0x7f5d80100880 2024-09-13T17:10:47.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.719+0000 7f5d84db4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d801031b0 0x7f5d801963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:47.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.719+0000 7f5d84db4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d801031b0 0x7f5d801963d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57426/0 (socket says 172.21.15.87:57426) 2024-09-13T17:10:47.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.719+0000 7f5d84db4640 1 -- 172.21.15.87:0/966216465 learned_addr learned my addr 172.21.15.87:0/966216465 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:10:47.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.719+0000 7f5d855b5640 1 --2- 172.21.15.87:0/966216465 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d80100880 0x7f5d80195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:47.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.719+0000 7f5d85db6640 1 --2- 172.21.15.87:0/966216465 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d80105ae0 0x7f5d8019d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:47.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.719+0000 7f5d84db4640 1 -- 172.21.15.87:0/966216465 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d80100880 msgr2=0x7f5d80195e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:47.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.719+0000 7f5d84db4640 1 --2- 172.21.15.87:0/966216465 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d80100880 0x7f5d80195e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.719+0000 7f5d84db4640 1 -- 172.21.15.87:0/966216465 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d80105ae0 msgr2=0x7f5d8019d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:47.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.719+0000 7f5d84db4640 1 --2- 172.21.15.87:0/966216465 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d80105ae0 0x7f5d8019d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.719+0000 7f5d84db4640 1 -- 172.21.15.87:0/966216465 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d70009560 con 0x7f5d801031b0 2024-09-13T17:10:47.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.719+0000 7f5d84db4640 1 --2- 172.21.15.87:0/966216465 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d801031b0 0x7f5d801963d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00d740 tx=0x7f5d7c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:47.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.720+0000 7f5d767fc640 1 -- 172.21.15.87:0/966216465 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c009c30 con 0x7f5d801031b0 2024-09-13T17:10:47.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.720+0000 7f5d767fc640 1 -- 172.21.15.87:0/966216465 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5d7c00de50 con 0x7f5d801031b0 2024-09-13T17:10:47.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.720+0000 7f5d87819640 1 -- 172.21.15.87:0/966216465 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d8019df90 con 0x7f5d801031b0 2024-09-13T17:10:47.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.720+0000 7f5d767fc640 1 -- 172.21.15.87:0/966216465 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c004e40 con 0x7f5d801031b0 2024-09-13T17:10:47.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.720+0000 7f5d87819640 1 -- 172.21.15.87:0/966216465 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d8019e3c0 con 0x7f5d801031b0 2024-09-13T17:10:47.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.721+0000 7f5d87819640 1 -- 172.21.15.87:0/966216465 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d800fbf10 con 0x7f5d801031b0 2024-09-13T17:10:47.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.722+0000 7f5d767fc640 1 -- 172.21.15.87:0/966216465 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5d7c004fa0 con 0x7f5d801031b0 2024-09-13T17:10:47.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.722+0000 7f5d767fc640 1 --2- 172.21.15.87:0/966216465 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f5d6c0a1090 0x7f5d6c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:47.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.722+0000 7f5d855b5640 1 --2- 172.21.15.87:0/966216465 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f5d6c0a1090 0x7f5d6c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:47.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.722+0000 7f5d767fc640 1 -- 172.21.15.87:0/966216465 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f5d7c0cbd50 con 0x7f5d801031b0 2024-09-13T17:10:47.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.723+0000 7f5d855b5640 1 --2- 172.21.15.87:0/966216465 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f5d6c0a1090 0x7f5d6c0a3550 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5d70000c00 tx=0x7f5d70031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:47.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.726+0000 7f5d767fc640 1 -- 172.21.15.87:0/966216465 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5d7c0cf030 con 0x7f5d801031b0 2024-09-13T17:10:47.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.922+0000 7f5d87819640 1 -- 172.21.15.87:0/966216465 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d8010b6a0 con 0x7f5d801031b0 2024-09-13T17:10:47.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.922+0000 7f5d767fc640 1 -- 172.21.15.87:0/966216465 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+501 (secure 0 0 0) 0x7f5d7c0994c0 con 0x7f5d801031b0 2024-09-13T17:10:47.925 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:10:47.925 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-13T17:10:47.926 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 1 2024-09-13T17:10:47.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.924+0000 7f5d87819640 1 -- 172.21.15.87:0/966216465 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f5d6c0a1090 msgr2=0x7f5d6c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:47.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.924+0000 7f5d87819640 1 --2- 172.21.15.87:0/966216465 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f5d6c0a1090 0x7f5d6c0a3550 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5d70000c00 tx=0x7f5d70031400 comp rx=0 tx=0).stop 2024-09-13T17:10:47.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.924+0000 7f5d87819640 1 -- 172.21.15.87:0/966216465 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d801031b0 msgr2=0x7f5d801963d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:47.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.924+0000 7f5d87819640 1 --2- 172.21.15.87:0/966216465 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d801031b0 0x7f5d801963d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00d740 tx=0x7f5d7c00dc00 comp rx=0 tx=0).stop 2024-09-13T17:10:47.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.924+0000 7f5d87819640 1 -- 172.21.15.87:0/966216465 shutdown_connections 2024-09-13T17:10:47.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.924+0000 7f5d87819640 1 --2- 172.21.15.87:0/966216465 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f5d6c0a1090 0x7f5d6c0a3550 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.924+0000 7f5d87819640 1 --2- 172.21.15.87:0/966216465 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d80105ae0 0x7f5d8019d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.924+0000 7f5d87819640 1 --2- 172.21.15.87:0/966216465 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d801031b0 0x7f5d801963d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.924+0000 7f5d87819640 1 --2- 172.21.15.87:0/966216465 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d80100880 0x7f5d80195e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:47.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.924+0000 7f5d87819640 1 -- 172.21.15.87:0/966216465 >> 172.21.15.87:0/966216465 conn(0x7f5d800fa420 msgr2=0x7f5d801012a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:47.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.925+0000 7f5d87819640 1 -- 172.21.15.87:0/966216465 shutdown_connections 2024-09-13T17:10:47.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:47.925+0000 7f5d87819640 1 -- 172.21.15.87:0/966216465 wait complete. 2024-09-13T17:10:48.198 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:47 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3894737417' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:10:48.198 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:47 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/132861692' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:10:48.228 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:47 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3894737417' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:10:48.228 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:47 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/132861692' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:10:48.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:47 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3894737417' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:10:48.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:47 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/132861692' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:10:48.592 INFO:journalctl@ceph.mds.l.smithi149.stdout:Sep 13 17:10:48 smithi149 systemd[1]: Starting Ceph mds.l for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:10:48.842 INFO:journalctl@ceph.mds.l.smithi149.stdout:Sep 13 17:10:48 smithi149 podman[65269]: 2024-09-13 17:10:48.49412185 +0000 UTC m=+0.016310540 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:10:48.842 INFO:journalctl@ceph.mds.l.smithi149.stdout:Sep 13 17:10:48 smithi149 podman[65269]: 2024-09-13 17:10:48.609308107 +0000 UTC m=+0.131496830 container create f4a6ee081929566154f8bf833ef4dce990760ea38b74cca85fd834cf9cdca594 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T17:10:49.228 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:48 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/966216465' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:10:49.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:48 smithi087 ceph-mon[30934]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:49.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:48 smithi087 ceph-mon[30934]: mds.? [v2:172.21.15.149:6832/3204144514,v1:172.21.15.149:6833/3204144514] up:boot 2024-09-13T17:10:49.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:48 smithi087 ceph-mon[30934]: fsmap 1 up:standby 2024-09-13T17:10:49.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:48 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-13T17:10:49.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:48 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/966216465' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:10:49.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:48 smithi149 ceph-mon[35496]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:49.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:48 smithi149 ceph-mon[35496]: mds.? [v2:172.21.15.149:6832/3204144514,v1:172.21.15.149:6833/3204144514] up:boot 2024-09-13T17:10:49.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:48 smithi149 ceph-mon[35496]: fsmap 1 up:standby 2024-09-13T17:10:49.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:48 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-13T17:10:49.342 INFO:journalctl@ceph.mds.l.smithi149.stdout:Sep 13 17:10:48 smithi149 podman[65269]: 2024-09-13 17:10:48.845147782 +0000 UTC m=+0.367336459 container init f4a6ee081929566154f8bf833ef4dce990760ea38b74cca85fd834cf9cdca594 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-l, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True) 2024-09-13T17:10:49.343 INFO:journalctl@ceph.mds.l.smithi149.stdout:Sep 13 17:10:48 smithi149 podman[65269]: 2024-09-13 17:10:48.848027204 +0000 UTC m=+0.370215882 container start f4a6ee081929566154f8bf833ef4dce990760ea38b74cca85fd834cf9cdca594 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-l, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-13T17:10:49.343 INFO:journalctl@ceph.mds.l.smithi149.stdout:Sep 13 17:10:48 smithi149 ceph-mds[65288]: -- 172.21.15.149:0/1780864637 <== mon.1 v2:172.21.15.149:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55bfb031ed00 con 0x55bfb02f2800 2024-09-13T17:10:49.343 INFO:journalctl@ceph.mds.l.smithi149.stdout:Sep 13 17:10:48 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-l[65284]: starting mds.l at 2024-09-13T17:10:49.343 INFO:journalctl@ceph.mds.l.smithi149.stdout:Sep 13 17:10:48 smithi149 bash[65269]: f4a6ee081929566154f8bf833ef4dce990760ea38b74cca85fd834cf9cdca594 2024-09-13T17:10:49.343 INFO:journalctl@ceph.mds.l.smithi149.stdout:Sep 13 17:10:48 smithi149 systemd[1]: Started Ceph mds.l for 043d5bae-71f2-11ef-bceb-c7b262605968. 2024-09-13T17:10:49.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:48 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/966216465' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:10:49.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:48 smithi118 ceph-mon[34374]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:49.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:48 smithi118 ceph-mon[34374]: mds.? [v2:172.21.15.149:6832/3204144514,v1:172.21.15.149:6833/3204144514] up:boot 2024-09-13T17:10:49.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:48 smithi118 ceph-mon[34374]: fsmap 1 up:standby 2024-09-13T17:10:49.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:48 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-13T17:10:49.937 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:10:50.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.039+0000 7f711939d640 1 -- 172.21.15.87:0/3220775774 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71140ffc80 msgr2=0x7f7114100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:50.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.039+0000 7f711939d640 1 --2- 172.21.15.87:0/3220775774 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71140ffc80 0x7f7114100100 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7108009900 tx=0x7f710802a410 comp rx=0 tx=0).stop 2024-09-13T17:10:50.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.039+0000 7f711939d640 1 -- 172.21.15.87:0/3220775774 shutdown_connections 2024-09-13T17:10:50.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.039+0000 7f711939d640 1 --2- 172.21.15.87:0/3220775774 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7114100640 0x7f7114106ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:50.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.040+0000 7f711939d640 1 --2- 172.21.15.87:0/3220775774 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71140ffc80 0x7f7114100100 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:50.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.040+0000 7f711939d640 1 --2- 172.21.15.87:0/3220775774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71140fea90 0x7f71140fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:50.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.040+0000 7f711939d640 1 -- 172.21.15.87:0/3220775774 >> 172.21.15.87:0/3220775774 conn(0x7f71140fa1f0 msgr2=0x7f71140fc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:50.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.040+0000 7f711939d640 1 -- 172.21.15.87:0/3220775774 shutdown_connections 2024-09-13T17:10:50.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.040+0000 7f711939d640 1 -- 172.21.15.87:0/3220775774 wait complete. 2024-09-13T17:10:50.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.040+0000 7f711939d640 1 Processor -- start 2024-09-13T17:10:50.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.040+0000 7f711939d640 1 -- start start 2024-09-13T17:10:50.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.040+0000 7f711939d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71140fea90 0x7f7114194ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:50.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.040+0000 7f711939d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71140ffc80 0x7f7114195010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:50.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.040+0000 7f711939d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7114100640 0x7f711419c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:50.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.040+0000 7f711939d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711419c5c0 con 0x7f71140ffc80 2024-09-13T17:10:50.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.040+0000 7f711939d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711419c730 con 0x7f71140fea90 2024-09-13T17:10:50.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.040+0000 7f711939d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711419c8f0 con 0x7f7114100640 2024-09-13T17:10:50.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.041+0000 7f71137fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71140ffc80 0x7f7114195010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:50.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.041+0000 7f71137fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71140ffc80 0x7f7114195010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54992/0 (socket says 172.21.15.87:54992) 2024-09-13T17:10:50.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.041+0000 7f71137fe640 1 -- 172.21.15.87:0/2525189910 learned_addr learned my addr 172.21.15.87:0/2525189910 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:10:50.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.041+0000 7f7113fff640 1 --2- 172.21.15.87:0/2525189910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71140fea90 0x7f7114194ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:50.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.041+0000 7f7118b9c640 1 --2- 172.21.15.87:0/2525189910 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7114100640 0x7f711419c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:50.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.041+0000 7f71137fe640 1 -- 172.21.15.87:0/2525189910 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7114100640 msgr2=0x7f711419c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:50.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.041+0000 7f71137fe640 1 --2- 172.21.15.87:0/2525189910 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7114100640 0x7f711419c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:50.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.041+0000 7f71137fe640 1 -- 172.21.15.87:0/2525189910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71140fea90 msgr2=0x7f7114194ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:50.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.041+0000 7f71137fe640 1 --2- 172.21.15.87:0/2525189910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71140fea90 0x7f7114194ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:50.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.041+0000 7f71137fe640 1 -- 172.21.15.87:0/2525189910 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7108009560 con 0x7f71140ffc80 2024-09-13T17:10:50.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.041+0000 7f7113fff640 1 --2- 172.21.15.87:0/2525189910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71140fea90 0x7f7114194ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:10:50.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.041+0000 7f71137fe640 1 --2- 172.21.15.87:0/2525189910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71140ffc80 0x7f7114195010 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7108005940 tx=0x7f7108004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:50.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.041+0000 7f71117fa640 1 -- 172.21.15.87:0/2525189910 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7108003800 con 0x7f71140ffc80 2024-09-13T17:10:50.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.041+0000 7f71117fa640 1 -- 172.21.15.87:0/2525189910 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7108003e10 con 0x7f71140ffc80 2024-09-13T17:10:50.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.041+0000 7f71117fa640 1 -- 172.21.15.87:0/2525189910 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710803b3d0 con 0x7f71140ffc80 2024-09-13T17:10:50.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.041+0000 7f711939d640 1 -- 172.21.15.87:0/2525189910 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f711419cb70 con 0x7f71140ffc80 2024-09-13T17:10:50.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.041+0000 7f711939d640 1 -- 172.21.15.87:0/2525189910 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f711419cfd0 con 0x7f71140ffc80 2024-09-13T17:10:50.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.043+0000 7f711939d640 1 -- 172.21.15.87:0/2525189910 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7114105f60 con 0x7f71140ffc80 2024-09-13T17:10:50.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.044+0000 7f71117fa640 1 -- 172.21.15.87:0/2525189910 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f710803c470 con 0x7f71140ffc80 2024-09-13T17:10:50.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.044+0000 7f71117fa640 1 --2- 172.21.15.87:0/2525189910 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f70fc0a1090 0x7f70fc0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:50.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.044+0000 7f7113fff640 1 --2- 172.21.15.87:0/2525189910 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f70fc0a1090 0x7f70fc0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:50.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.044+0000 7f71117fa640 1 -- 172.21.15.87:0/2525189910 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f71080ed2f0 con 0x7f71140ffc80 2024-09-13T17:10:50.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.045+0000 7f7113fff640 1 --2- 172.21.15.87:0/2525189910 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f70fc0a1090 0x7f70fc0a3550 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f71140ffae0 tx=0x7f710400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:50.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.048+0000 7f71117fa640 1 -- 172.21.15.87:0/2525189910 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f71080b6f20 con 0x7f71140ffc80 2024-09-13T17:10:50.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:50.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:50.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:50.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:10:50.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:10:50.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:50.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:49 smithi087 ceph-mon[30934]: Deploying daemon mds.k on smithi118 2024-09-13T17:10:50.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.252+0000 7f711939d640 1 -- 172.21.15.87:0/2525189910 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f711410a3a0 con 0x7f71140ffc80 2024-09-13T17:10:50.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.252+0000 7f71117fa640 1 -- 172.21.15.87:0/2525189910 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1260 (secure 0 0 0) 0x7f71080ba540 con 0x7f71140ffc80 2024-09-13T17:10:50.253 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:10:50.253 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-09-13T17:10:50.253 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 2 2024-09-13T17:10:50.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.254+0000 7f711939d640 1 -- 172.21.15.87:0/2525189910 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f70fc0a1090 msgr2=0x7f70fc0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:50.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.254+0000 7f711939d640 1 --2- 172.21.15.87:0/2525189910 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f70fc0a1090 0x7f70fc0a3550 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f71140ffae0 tx=0x7f710400a2d0 comp rx=0 tx=0).stop 2024-09-13T17:10:50.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.254+0000 7f711939d640 1 -- 172.21.15.87:0/2525189910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71140ffc80 msgr2=0x7f7114195010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:50.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.254+0000 7f711939d640 1 --2- 172.21.15.87:0/2525189910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71140ffc80 0x7f7114195010 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7108005940 tx=0x7f7108004430 comp rx=0 tx=0).stop 2024-09-13T17:10:50.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.254+0000 7f711939d640 1 -- 172.21.15.87:0/2525189910 shutdown_connections 2024-09-13T17:10:50.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.254+0000 7f711939d640 1 --2- 172.21.15.87:0/2525189910 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f70fc0a1090 0x7f70fc0a3550 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:50.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.254+0000 7f711939d640 1 --2- 172.21.15.87:0/2525189910 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7114100640 0x7f711419c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:50.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.254+0000 7f711939d640 1 --2- 172.21.15.87:0/2525189910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71140ffc80 0x7f7114195010 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:50.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.254+0000 7f711939d640 1 --2- 172.21.15.87:0/2525189910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71140fea90 0x7f7114194ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:50.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.254+0000 7f711939d640 1 -- 172.21.15.87:0/2525189910 >> 172.21.15.87:0/2525189910 conn(0x7f71140fa1f0 msgr2=0x7f7114103130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:50.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.254+0000 7f711939d640 1 -- 172.21.15.87:0/2525189910 shutdown_connections 2024-09-13T17:10:50.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:50.254+0000 7f711939d640 1 -- 172.21.15.87:0/2525189910 wait complete. 2024-09-13T17:10:50.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:50.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:50.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:50.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:10:50.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:10:50.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:50.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:49 smithi149 ceph-mon[35496]: Deploying daemon mds.k on smithi118 2024-09-13T17:10:50.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:50.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:50.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:50.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:10:50.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:10:50.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:50.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:49 smithi118 ceph-mon[34374]: Deploying daemon mds.k on smithi118 2024-09-13T17:10:51.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:50 smithi118 ceph-mon[34374]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:51.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:50 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2525189910' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:10:51.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:50 smithi149 ceph-mon[35496]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:51.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:50 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2525189910' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:10:51.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:50 smithi087 ceph-mon[30934]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:51.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:50 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2525189910' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:10:51.863 INFO:journalctl@ceph.mds.k.smithi118.stdout:Sep 13 17:10:51 smithi118 systemd[1]: Started Ceph mds.k for 043d5bae-71f2-11ef-bceb-c7b262605968. 2024-09-13T17:10:52.266 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:10:52.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.371+0000 7feb7ea53640 1 -- 172.21.15.87:0/102838510 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb781008a0 msgr2=0x7feb78102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:52.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.371+0000 7feb7ea53640 1 --2- 172.21.15.87:0/102838510 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb781008a0 0x7feb78102c90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7feb68009900 tx=0x7feb6802a410 comp rx=0 tx=0).stop 2024-09-13T17:10:52.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.371+0000 7feb7ea53640 1 -- 172.21.15.87:0/102838510 shutdown_connections 2024-09-13T17:10:52.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.371+0000 7feb7ea53640 1 --2- 172.21.15.87:0/102838510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb78105b00 0x7feb78107ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:52.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.371+0000 7feb7ea53640 1 --2- 172.21.15.87:0/102838510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb781031d0 0x7feb781055c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:52.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.371+0000 7feb7ea53640 1 --2- 172.21.15.87:0/102838510 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb781008a0 0x7feb78102c90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:52.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.371+0000 7feb7ea53640 1 -- 172.21.15.87:0/102838510 >> 172.21.15.87:0/102838510 conn(0x7feb780fa440 msgr2=0x7feb780fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:52.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.371+0000 7feb7ea53640 1 -- 172.21.15.87:0/102838510 shutdown_connections 2024-09-13T17:10:52.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.371+0000 7feb7ea53640 1 -- 172.21.15.87:0/102838510 wait complete. 2024-09-13T17:10:52.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.372+0000 7feb7ea53640 1 Processor -- start 2024-09-13T17:10:52.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.372+0000 7feb7ea53640 1 -- start start 2024-09-13T17:10:52.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.372+0000 7feb7ea53640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb781008a0 0x7feb78100210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:52.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.372+0000 7feb7ea53640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb781031d0 0x7feb780fe850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:52.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.372+0000 7feb7ea53640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb78105b00 0x7feb780fed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:52.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.372+0000 7feb7ea53640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb780ff4f0 con 0x7feb78105b00 2024-09-13T17:10:52.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.372+0000 7feb7ea53640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb780ff660 con 0x7feb781031d0 2024-09-13T17:10:52.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.372+0000 7feb7ea53640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7819ff20 con 0x7feb781008a0 2024-09-13T17:10:52.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.372+0000 7feb7cff0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb78105b00 0x7feb780fed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:52.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.372+0000 7feb7cff0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb78105b00 0x7feb780fed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55004/0 (socket says 172.21.15.87:55004) 2024-09-13T17:10:52.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.372+0000 7feb7cff0640 1 -- 172.21.15.87:0/729106140 learned_addr learned my addr 172.21.15.87:0/729106140 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:10:52.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.372+0000 7feb77fff640 1 --2- 172.21.15.87:0/729106140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb781008a0 0x7feb78100210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:52.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.372+0000 7feb6ffff640 1 --2- 172.21.15.87:0/729106140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb781031d0 0x7feb780fe850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:52.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.372+0000 7feb7cff0640 1 -- 172.21.15.87:0/729106140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb781008a0 msgr2=0x7feb78100210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:52.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.372+0000 7feb7cff0640 1 --2- 172.21.15.87:0/729106140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb781008a0 0x7feb78100210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:52.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.372+0000 7feb7cff0640 1 -- 172.21.15.87:0/729106140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb781031d0 msgr2=0x7feb780fe850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:52.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.372+0000 7feb7cff0640 1 --2- 172.21.15.87:0/729106140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb781031d0 0x7feb780fe850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:52.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.372+0000 7feb7cff0640 1 -- 172.21.15.87:0/729106140 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb68009560 con 0x7feb78105b00 2024-09-13T17:10:52.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.372+0000 7feb6ffff640 1 --2- 172.21.15.87:0/729106140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb781031d0 0x7feb780fe850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:10:52.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.372+0000 7feb7cff0640 1 --2- 172.21.15.87:0/729106140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb78105b00 0x7feb780fed90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7feb7000ba10 tx=0x7feb7000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:52.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.373+0000 7feb75ffb640 1 -- 172.21.15.87:0/729106140 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7000cb40 con 0x7feb78105b00 2024-09-13T17:10:52.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.373+0000 7feb75ffb640 1 -- 172.21.15.87:0/729106140 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7feb7000cca0 con 0x7feb78105b00 2024-09-13T17:10:52.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.373+0000 7feb7ea53640 1 -- 172.21.15.87:0/729106140 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb781a01d0 con 0x7feb78105b00 2024-09-13T17:10:52.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.373+0000 7feb75ffb640 1 -- 172.21.15.87:0/729106140 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb70012640 con 0x7feb78105b00 2024-09-13T17:10:52.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.373+0000 7feb7ea53640 1 -- 172.21.15.87:0/729106140 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb781a07b0 con 0x7feb78105b00 2024-09-13T17:10:52.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.374+0000 7feb7ea53640 1 -- 172.21.15.87:0/729106140 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb780fbf30 con 0x7feb78105b00 2024-09-13T17:10:52.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.375+0000 7feb75ffb640 1 -- 172.21.15.87:0/729106140 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7feb70014440 con 0x7feb78105b00 2024-09-13T17:10:52.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.375+0000 7feb75ffb640 1 --2- 172.21.15.87:0/729106140 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7feb640a1110 0x7feb640a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:52.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.375+0000 7feb77fff640 1 --2- 172.21.15.87:0/729106140 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7feb640a1110 0x7feb640a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:52.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.375+0000 7feb75ffb640 1 -- 172.21.15.87:0/729106140 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7feb700cbc70 con 0x7feb78105b00 2024-09-13T17:10:52.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.376+0000 7feb77fff640 1 --2- 172.21.15.87:0/729106140 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7feb640a1110 0x7feb640a35d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7feb68006010 tx=0x7feb68031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:52.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.379+0000 7feb75ffb640 1 -- 172.21.15.87:0/729106140 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7feb700958a0 con 0x7feb78105b00 2024-09-13T17:10:52.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.576+0000 7feb7ea53640 1 -- 172.21.15.87:0/729106140 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb7810b780 con 0x7feb78105b00 2024-09-13T17:10:52.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.577+0000 7feb75ffb640 1 -- 172.21.15.87:0/729106140 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2020 (secure 0 0 0) 0x7feb70095030 con 0x7feb78105b00 2024-09-13T17:10:52.578 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:10:52.578 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-09-13T17:10:52.578 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 3 2024-09-13T17:10:52.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.579+0000 7feb7ea53640 1 -- 172.21.15.87:0/729106140 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7feb640a1110 msgr2=0x7feb640a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:52.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.579+0000 7feb7ea53640 1 --2- 172.21.15.87:0/729106140 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7feb640a1110 0x7feb640a35d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7feb68006010 tx=0x7feb68031400 comp rx=0 tx=0).stop 2024-09-13T17:10:52.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.579+0000 7feb7ea53640 1 -- 172.21.15.87:0/729106140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb78105b00 msgr2=0x7feb780fed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:52.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.579+0000 7feb7ea53640 1 --2- 172.21.15.87:0/729106140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb78105b00 0x7feb780fed90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7feb7000ba10 tx=0x7feb7000bed0 comp rx=0 tx=0).stop 2024-09-13T17:10:52.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.579+0000 7feb7ea53640 1 -- 172.21.15.87:0/729106140 shutdown_connections 2024-09-13T17:10:52.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.579+0000 7feb7ea53640 1 --2- 172.21.15.87:0/729106140 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7feb640a1110 0x7feb640a35d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:52.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.579+0000 7feb7ea53640 1 --2- 172.21.15.87:0/729106140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb78105b00 0x7feb780fed90 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:52.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.579+0000 7feb7ea53640 1 --2- 172.21.15.87:0/729106140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb781031d0 0x7feb780fe850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:52.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.579+0000 7feb7ea53640 1 --2- 172.21.15.87:0/729106140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb781008a0 0x7feb78100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:52.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.579+0000 7feb7ea53640 1 -- 172.21.15.87:0/729106140 >> 172.21.15.87:0/729106140 conn(0x7feb780fa440 msgr2=0x7feb781012a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:52.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.579+0000 7feb7ea53640 1 -- 172.21.15.87:0/729106140 shutdown_connections 2024-09-13T17:10:52.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:52.579+0000 7feb7ea53640 1 -- 172.21.15.87:0/729106140 wait complete. 2024-09-13T17:10:52.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:52 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:52.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:52 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:52.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:52 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:52.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:52 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:10:52.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:52 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:10:52.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:52 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:52.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:52 smithi087 ceph-mon[30934]: Deploying daemon mds.j on smithi087 2024-09-13T17:10:52.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:52 smithi087 ceph-mon[30934]: mds.? [v2:172.21.15.118:6832/1988216966,v1:172.21.15.118:6833/1988216966] up:boot 2024-09-13T17:10:52.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:52 smithi087 ceph-mon[30934]: fsmap 2 up:standby 2024-09-13T17:10:52.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:52 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-13T17:10:52.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:52 smithi087 ceph-mon[30934]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:52.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:52 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/729106140' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:10:53.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:52 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:53.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:52 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:53.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:52 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:53.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:52 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:10:53.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:52 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:10:53.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:52 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:53.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:52 smithi149 ceph-mon[35496]: Deploying daemon mds.j on smithi087 2024-09-13T17:10:53.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:52 smithi149 ceph-mon[35496]: mds.? [v2:172.21.15.118:6832/1988216966,v1:172.21.15.118:6833/1988216966] up:boot 2024-09-13T17:10:53.094 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:52 smithi149 ceph-mon[35496]: fsmap 2 up:standby 2024-09-13T17:10:53.094 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:52 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-13T17:10:53.094 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:52 smithi149 ceph-mon[35496]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:53.094 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:52 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/729106140' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:10:53.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:52 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:53.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:52 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:53.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:52 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:53.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:52 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:10:53.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:52 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:10:53.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:52 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:53.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:52 smithi118 ceph-mon[34374]: Deploying daemon mds.j on smithi087 2024-09-13T17:10:53.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:52 smithi118 ceph-mon[34374]: mds.? [v2:172.21.15.118:6832/1988216966,v1:172.21.15.118:6833/1988216966] up:boot 2024-09-13T17:10:53.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:52 smithi118 ceph-mon[34374]: fsmap 2 up:standby 2024-09-13T17:10:53.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:52 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-13T17:10:53.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:52 smithi118 ceph-mon[34374]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:53.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:52 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/729106140' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:10:53.870 INFO:journalctl@ceph.mds.j.smithi087.stdout:Sep 13 17:10:53 smithi087 systemd[1]: Starting Ceph mds.j for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:10:54.155 INFO:journalctl@ceph.mds.j.smithi087.stdout:Sep 13 17:10:53 smithi087 podman[71034]: 2024-09-13 17:10:53.771353125 +0000 UTC m=+0.015908709 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:10:54.155 INFO:journalctl@ceph.mds.j.smithi087.stdout:Sep 13 17:10:53 smithi087 podman[71034]: 2024-09-13 17:10:53.896618898 +0000 UTC m=+0.141174472 container create 256bdb11cf6fcee006a1659432a96cb6a7c0f8e3706824ff21fc76af605843b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-j, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-13T17:10:54.155 INFO:journalctl@ceph.mds.j.smithi087.stdout:Sep 13 17:10:54 smithi087 podman[71034]: 2024-09-13 17:10:54.15479254 +0000 UTC m=+0.399348117 container init 256bdb11cf6fcee006a1659432a96cb6a7c0f8e3706824ff21fc76af605843b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-j, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-13T17:10:54.481 INFO:journalctl@ceph.mds.j.smithi087.stdout:Sep 13 17:10:54 smithi087 podman[71034]: 2024-09-13 17:10:54.157781352 +0000 UTC m=+0.402336935 container start 256bdb11cf6fcee006a1659432a96cb6a7c0f8e3706824ff21fc76af605843b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-j, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-13T17:10:54.481 INFO:journalctl@ceph.mds.j.smithi087.stdout:Sep 13 17:10:54 smithi087 ceph-mds[71053]: -- 172.21.15.87:0/3951780902 <== mon.0 v2:172.21.15.87:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55622f270d00 con 0x55622f244800 2024-09-13T17:10:54.481 INFO:journalctl@ceph.mds.j.smithi087.stdout:Sep 13 17:10:54 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-j[71049]: starting mds.j at 2024-09-13T17:10:54.481 INFO:journalctl@ceph.mds.j.smithi087.stdout:Sep 13 17:10:54 smithi087 bash[71034]: 256bdb11cf6fcee006a1659432a96cb6a7c0f8e3706824ff21fc76af605843b5 2024-09-13T17:10:54.481 INFO:journalctl@ceph.mds.j.smithi087.stdout:Sep 13 17:10:54 smithi087 systemd[1]: Started Ceph mds.j for 043d5bae-71f2-11ef-bceb-c7b262605968. 2024-09-13T17:10:54.591 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:10:54.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.693+0000 7f3b260f0640 1 -- 172.21.15.87:0/2453261640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b20100850 msgr2=0x7f3b201070e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:54.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.693+0000 7f3b260f0640 1 --2- 172.21.15.87:0/2453261640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b20100850 0x7f3b201070e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3b18009ca0 tx=0x7f3b1802a8c0 comp rx=0 tx=0).stop 2024-09-13T17:10:54.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.693+0000 7f3b260f0640 1 -- 172.21.15.87:0/2453261640 shutdown_connections 2024-09-13T17:10:54.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.693+0000 7f3b260f0640 1 --2- 172.21.15.87:0/2453261640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b20100850 0x7f3b201070e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:54.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.693+0000 7f3b260f0640 1 --2- 172.21.15.87:0/2453261640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b200ffe90 0x7f3b20100310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:54.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.693+0000 7f3b260f0640 1 --2- 172.21.15.87:0/2453261640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b200feca0 0x7f3b200ff0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:54.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.693+0000 7f3b260f0640 1 -- 172.21.15.87:0/2453261640 >> 172.21.15.87:0/2453261640 conn(0x7f3b200fa400 msgr2=0x7f3b200fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:54.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.693+0000 7f3b260f0640 1 -- 172.21.15.87:0/2453261640 shutdown_connections 2024-09-13T17:10:54.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.693+0000 7f3b260f0640 1 -- 172.21.15.87:0/2453261640 wait complete. 2024-09-13T17:10:54.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.694+0000 7f3b260f0640 1 Processor -- start 2024-09-13T17:10:54.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.694+0000 7f3b260f0640 1 -- start start 2024-09-13T17:10:54.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.694+0000 7f3b260f0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b200feca0 0x7f3b200691e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:54.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.694+0000 7f3b260f0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b200ffe90 0x7f3b2019aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:54.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.694+0000 7f3b260f0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b20100850 0x7f3b2019d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:54.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.694+0000 7f3b260f0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2019d870 con 0x7f3b20100850 2024-09-13T17:10:54.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.694+0000 7f3b260f0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2019d9e0 con 0x7f3b200feca0 2024-09-13T17:10:54.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.694+0000 7f3b260f0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2019dba0 con 0x7f3b200ffe90 2024-09-13T17:10:54.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.694+0000 7f3b1ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b20100850 0x7f3b2019d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:54.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.694+0000 7f3b1ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b20100850 0x7f3b2019d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55050/0 (socket says 172.21.15.87:55050) 2024-09-13T17:10:54.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.694+0000 7f3b1ffff640 1 -- 172.21.15.87:0/2931019683 learned_addr learned my addr 172.21.15.87:0/2931019683 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:10:54.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.694+0000 7f3b1effd640 1 --2- 172.21.15.87:0/2931019683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b200ffe90 0x7f3b2019aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:54.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.694+0000 7f3b1f7fe640 1 --2- 172.21.15.87:0/2931019683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b200feca0 0x7f3b200691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:54.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.694+0000 7f3b1ffff640 1 -- 172.21.15.87:0/2931019683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b200ffe90 msgr2=0x7f3b2019aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:54.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.694+0000 7f3b1ffff640 1 --2- 172.21.15.87:0/2931019683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b200ffe90 0x7f3b2019aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:54.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.694+0000 7f3b1ffff640 1 -- 172.21.15.87:0/2931019683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b200feca0 msgr2=0x7f3b200691e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:54.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.694+0000 7f3b1ffff640 1 --2- 172.21.15.87:0/2931019683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b200feca0 0x7f3b200691e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:54.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.694+0000 7f3b1ffff640 1 -- 172.21.15.87:0/2931019683 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b18009900 con 0x7f3b20100850 2024-09-13T17:10:54.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.694+0000 7f3b1f7fe640 1 --2- 172.21.15.87:0/2931019683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b200feca0 0x7f3b200691e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:10:54.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.695+0000 7f3b1ffff640 1 --2- 172.21.15.87:0/2931019683 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b20100850 0x7f3b2019d0e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3b180097b0 tx=0x7f3b18031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:54.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.695+0000 7f3b1cff9640 1 -- 172.21.15.87:0/2931019683 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1802f310 con 0x7f3b20100850 2024-09-13T17:10:54.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.695+0000 7f3b260f0640 1 -- 172.21.15.87:0/2931019683 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b2019de20 con 0x7f3b20100850 2024-09-13T17:10:54.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.695+0000 7f3b1cff9640 1 -- 172.21.15.87:0/2931019683 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3b18040070 con 0x7f3b20100850 2024-09-13T17:10:54.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.695+0000 7f3b1cff9640 1 -- 172.21.15.87:0/2931019683 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b18004560 con 0x7f3b20100850 2024-09-13T17:10:54.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.695+0000 7f3b260f0640 1 -- 172.21.15.87:0/2931019683 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b2019e2a0 con 0x7f3b20100850 2024-09-13T17:10:54.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.696+0000 7f3b260f0640 1 -- 172.21.15.87:0/2931019683 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b20106180 con 0x7f3b20100850 2024-09-13T17:10:54.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.697+0000 7f3b1cff9640 1 -- 172.21.15.87:0/2931019683 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3b18042030 con 0x7f3b20100850 2024-09-13T17:10:54.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.698+0000 7f3b1cff9640 1 --2- 172.21.15.87:0/2931019683 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3b080a1090 0x7f3b080a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:54.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.698+0000 7f3b1f7fe640 1 --2- 172.21.15.87:0/2931019683 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3b080a1090 0x7f3b080a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:54.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.698+0000 7f3b1cff9640 1 -- 172.21.15.87:0/2931019683 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f3b180edbc0 con 0x7f3b20100850 2024-09-13T17:10:54.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.698+0000 7f3b1f7fe640 1 --2- 172.21.15.87:0/2931019683 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3b080a1090 0x7f3b080a3550 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3b200ffcf0 tx=0x7f3b14005e70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:54.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.702+0000 7f3b1cff9640 1 -- 172.21.15.87:0/2931019683 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3b180b7910 con 0x7f3b20100850 2024-09-13T17:10:54.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.905+0000 7f3b260f0640 1 -- 172.21.15.87:0/2931019683 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b20105bf0 con 0x7f3b20100850 2024-09-13T17:10:54.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.905+0000 7f3b1cff9640 1 -- 172.21.15.87:0/2931019683 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2020 (secure 0 0 0) 0x7f3b180baf30 con 0x7f3b20100850 2024-09-13T17:10:54.907 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:10:54.907 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-09-13T17:10:54.907 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 3 2024-09-13T17:10:54.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.907+0000 7f3b260f0640 1 -- 172.21.15.87:0/2931019683 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3b080a1090 msgr2=0x7f3b080a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:54.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.907+0000 7f3b260f0640 1 --2- 172.21.15.87:0/2931019683 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3b080a1090 0x7f3b080a3550 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3b200ffcf0 tx=0x7f3b14005e70 comp rx=0 tx=0).stop 2024-09-13T17:10:54.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.907+0000 7f3b260f0640 1 -- 172.21.15.87:0/2931019683 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b20100850 msgr2=0x7f3b2019d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:54.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.907+0000 7f3b260f0640 1 --2- 172.21.15.87:0/2931019683 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b20100850 0x7f3b2019d0e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3b180097b0 tx=0x7f3b18031700 comp rx=0 tx=0).stop 2024-09-13T17:10:54.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.907+0000 7f3b260f0640 1 -- 172.21.15.87:0/2931019683 shutdown_connections 2024-09-13T17:10:54.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.907+0000 7f3b260f0640 1 --2- 172.21.15.87:0/2931019683 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3b080a1090 0x7f3b080a3550 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:54.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.907+0000 7f3b260f0640 1 --2- 172.21.15.87:0/2931019683 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b20100850 0x7f3b2019d0e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:54.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.907+0000 7f3b260f0640 1 --2- 172.21.15.87:0/2931019683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b200ffe90 0x7f3b2019aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:54.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.907+0000 7f3b260f0640 1 --2- 172.21.15.87:0/2931019683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b200feca0 0x7f3b200691e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:54.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.907+0000 7f3b260f0640 1 -- 172.21.15.87:0/2931019683 >> 172.21.15.87:0/2931019683 conn(0x7f3b200fa400 msgr2=0x7f3b20103350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:54.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.907+0000 7f3b260f0640 1 -- 172.21.15.87:0/2931019683 shutdown_connections 2024-09-13T17:10:54.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:54.907+0000 7f3b260f0640 1 -- 172.21.15.87:0/2931019683 wait complete. 2024-09-13T17:10:55.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:55 smithi149 ceph-mon[35496]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:55.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:55 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:55.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:55 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:55.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:55 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:55.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:55 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:10:55.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:55 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:10:55.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:55 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:55.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:55 smithi149 ceph-mon[35496]: Deploying daemon mds.d on smithi087 2024-09-13T17:10:55.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:55 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2931019683' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:10:55.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:55 smithi149 ceph-mon[35496]: mds.? [v2:172.21.15.87:6834/3554185199,v1:172.21.15.87:6835/3554185199] up:boot 2024-09-13T17:10:55.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:55 smithi149 ceph-mon[35496]: fsmap 3 up:standby 2024-09-13T17:10:55.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:55 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-13T17:10:55.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:55 smithi118 ceph-mon[34374]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:55.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:55 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:55.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:55 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:55.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:55 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:55.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:55 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:10:55.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:55 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:10:55.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:55 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:55.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:55 smithi118 ceph-mon[34374]: Deploying daemon mds.d on smithi087 2024-09-13T17:10:55.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:55 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2931019683' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:10:55.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:55 smithi118 ceph-mon[34374]: mds.? [v2:172.21.15.87:6834/3554185199,v1:172.21.15.87:6835/3554185199] up:boot 2024-09-13T17:10:55.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:55 smithi118 ceph-mon[34374]: fsmap 3 up:standby 2024-09-13T17:10:55.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:55 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-13T17:10:55.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:55 smithi087 ceph-mon[30934]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:55.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:55 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:55.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:55 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:55.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:55 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:55.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:55 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:10:55.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:55 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:10:55.730 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:55 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:55.730 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:55 smithi087 ceph-mon[30934]: Deploying daemon mds.d on smithi087 2024-09-13T17:10:55.730 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:55 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2931019683' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:10:55.730 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:55 smithi087 ceph-mon[30934]: mds.? [v2:172.21.15.87:6834/3554185199,v1:172.21.15.87:6835/3554185199] up:boot 2024-09-13T17:10:55.730 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:55 smithi087 ceph-mon[30934]: fsmap 3 up:standby 2024-09-13T17:10:55.730 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:55 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-13T17:10:56.479 INFO:journalctl@ceph.mds.d.smithi087.stdout:Sep 13 17:10:56 smithi087 systemd[1]: Starting Ceph mds.d for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:10:56.800 INFO:journalctl@ceph.mds.d.smithi087.stdout:Sep 13 17:10:56 smithi087 podman[71375]: 2024-09-13 17:10:56.497319629 +0000 UTC m=+0.110614183 container create ed1ef8cca1171f1b97e33c63df85db970736c9c96ed1a63f8a5b36851815d51f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-d, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-13T17:10:56.801 INFO:journalctl@ceph.mds.d.smithi087.stdout:Sep 13 17:10:56 smithi087 podman[71375]: 2024-09-13 17:10:56.403050099 +0000 UTC m=+0.016344653 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:10:56.801 INFO:journalctl@ceph.mds.d.smithi087.stdout:Sep 13 17:10:56 smithi087 podman[71375]: 2024-09-13 17:10:56.800029303 +0000 UTC m=+0.413323856 container init ed1ef8cca1171f1b97e33c63df85db970736c9c96ed1a63f8a5b36851815d51f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-d, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-13T17:10:56.920 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:10:57.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.026+0000 7f49a800d640 1 -- 172.21.15.87:0/347177709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49a00feca0 msgr2=0x7f49a00ff0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:57.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.026+0000 7f49a800d640 1 --2- 172.21.15.87:0/347177709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49a00feca0 0x7f49a00ff0a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4998009900 tx=0x7f499802a410 comp rx=0 tx=0).stop 2024-09-13T17:10:57.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.026+0000 7f49a800d640 1 -- 172.21.15.87:0/347177709 shutdown_connections 2024-09-13T17:10:57.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.026+0000 7f49a800d640 1 --2- 172.21.15.87:0/347177709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49a0100850 0x7f49a01070e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.026+0000 7f49a800d640 1 --2- 172.21.15.87:0/347177709 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49a00ffe90 0x7f49a0100310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.026+0000 7f49a800d640 1 --2- 172.21.15.87:0/347177709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49a00feca0 0x7f49a00ff0a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.026+0000 7f49a800d640 1 -- 172.21.15.87:0/347177709 >> 172.21.15.87:0/347177709 conn(0x7f49a00fa440 msgr2=0x7f49a00fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:57.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.026+0000 7f49a800d640 1 -- 172.21.15.87:0/347177709 shutdown_connections 2024-09-13T17:10:57.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.026+0000 7f49a800d640 1 -- 172.21.15.87:0/347177709 wait complete. 2024-09-13T17:10:57.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.026+0000 7f49a800d640 1 Processor -- start 2024-09-13T17:10:57.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.026+0000 7f49a800d640 1 -- start start 2024-09-13T17:10:57.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.027+0000 7f49a800d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49a00feca0 0x7f49a0195da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:57.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.027+0000 7f49a800d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49a00ffe90 0x7f49a01962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:57.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.027+0000 7f49a800d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49a0100850 0x7f49a019d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:57.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.027+0000 7f49a800d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a019d880 con 0x7f49a0100850 2024-09-13T17:10:57.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.027+0000 7f49a800d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a019d9f0 con 0x7f49a00ffe90 2024-09-13T17:10:57.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.027+0000 7f49a800d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a019dbb0 con 0x7f49a00feca0 2024-09-13T17:10:57.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.027+0000 7f49a65aa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49a0100850 0x7f49a019d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:57.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.027+0000 7f49a65aa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49a0100850 0x7f49a019d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55078/0 (socket says 172.21.15.87:55078) 2024-09-13T17:10:57.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.027+0000 7f49a65aa640 1 -- 172.21.15.87:0/820872974 learned_addr learned my addr 172.21.15.87:0/820872974 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:10:57.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.027+0000 7f49a5da9640 1 --2- 172.21.15.87:0/820872974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49a00feca0 0x7f49a0195da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:57.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.027+0000 7f49a55a8640 1 --2- 172.21.15.87:0/820872974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49a00ffe90 0x7f49a01962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:57.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.027+0000 7f49a65aa640 1 -- 172.21.15.87:0/820872974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49a00feca0 msgr2=0x7f49a0195da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:57.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.027+0000 7f49a65aa640 1 --2- 172.21.15.87:0/820872974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49a00feca0 0x7f49a0195da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.027+0000 7f49a65aa640 1 -- 172.21.15.87:0/820872974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49a00ffe90 msgr2=0x7f49a01962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:57.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.027+0000 7f49a65aa640 1 --2- 172.21.15.87:0/820872974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49a00ffe90 0x7f49a01962e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.027+0000 7f49a65aa640 1 -- 172.21.15.87:0/820872974 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4998009560 con 0x7f49a0100850 2024-09-13T17:10:57.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.027+0000 7f49a65aa640 1 --2- 172.21.15.87:0/820872974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49a0100850 0x7f49a019d310 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f499000eaa0 tx=0x7f499000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:57.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.027+0000 7f499effd640 1 -- 172.21.15.87:0/820872974 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499000cdb0 con 0x7f49a0100850 2024-09-13T17:10:57.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.027+0000 7f49a800d640 1 -- 172.21.15.87:0/820872974 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a019de90 con 0x7f49a0100850 2024-09-13T17:10:57.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.027+0000 7f499effd640 1 -- 172.21.15.87:0/820872974 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4990005020 con 0x7f49a0100850 2024-09-13T17:10:57.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.027+0000 7f499effd640 1 -- 172.21.15.87:0/820872974 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49900116d0 con 0x7f49a0100850 2024-09-13T17:10:57.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.027+0000 7f49a800d640 1 -- 172.21.15.87:0/820872974 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a019e2b0 con 0x7f49a0100850 2024-09-13T17:10:57.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.028+0000 7f49a800d640 1 -- 172.21.15.87:0/820872974 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49a0106120 con 0x7f49a0100850 2024-09-13T17:10:57.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.029+0000 7f499effd640 1 -- 172.21.15.87:0/820872974 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4990005190 con 0x7f49a0100850 2024-09-13T17:10:57.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.030+0000 7f499effd640 1 --2- 172.21.15.87:0/820872974 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f49880a1090 0x7f49880a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:57.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.030+0000 7f49a5da9640 1 --2- 172.21.15.87:0/820872974 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f49880a1090 0x7f49880a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:57.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.030+0000 7f499effd640 1 -- 172.21.15.87:0/820872974 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f49900cc550 con 0x7f49a0100850 2024-09-13T17:10:57.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.030+0000 7f49a5da9640 1 --2- 172.21.15.87:0/820872974 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f49880a1090 0x7f49880a3550 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4998005940 tx=0x7f49980058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:57.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.034+0000 7f499effd640 1 -- 172.21.15.87:0/820872974 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f49900961a0 con 0x7f49a0100850 2024-09-13T17:10:57.228 INFO:journalctl@ceph.mds.d.smithi087.stdout:Sep 13 17:10:56 smithi087 podman[71375]: 2024-09-13 17:10:56.802964483 +0000 UTC m=+0.416259048 container start ed1ef8cca1171f1b97e33c63df85db970736c9c96ed1a63f8a5b36851815d51f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-d, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T17:10:57.229 INFO:journalctl@ceph.mds.d.smithi087.stdout:Sep 13 17:10:56 smithi087 ceph-mds[71394]: -- 172.21.15.87:0/3729449119 <== mon.0 v2:172.21.15.87:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5601bb0d4d00 con 0x5601bb0a8800 2024-09-13T17:10:57.229 INFO:journalctl@ceph.mds.d.smithi087.stdout:Sep 13 17:10:56 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-d[71390]: starting mds.d at 2024-09-13T17:10:57.229 INFO:journalctl@ceph.mds.d.smithi087.stdout:Sep 13 17:10:56 smithi087 bash[71375]: ed1ef8cca1171f1b97e33c63df85db970736c9c96ed1a63f8a5b36851815d51f 2024-09-13T17:10:57.229 INFO:journalctl@ceph.mds.d.smithi087.stdout:Sep 13 17:10:56 smithi087 systemd[1]: Started Ceph mds.d for 043d5bae-71f2-11ef-bceb-c7b262605968. 2024-09-13T17:10:57.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.230+0000 7f49a800d640 1 -- 172.21.15.87:0/820872974 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f49a002c480 con 0x7f49a0100850 2024-09-13T17:10:57.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.230+0000 7f499effd640 1 -- 172.21.15.87:0/820872974 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2777 (secure 0 0 0) 0x7f499001faf0 con 0x7f49a0100850 2024-09-13T17:10:57.231 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:10:57.231 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-09-13T17:10:57.232 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 4 2024-09-13T17:10:57.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.232+0000 7f49a800d640 1 -- 172.21.15.87:0/820872974 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f49880a1090 msgr2=0x7f49880a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:57.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.232+0000 7f49a800d640 1 --2- 172.21.15.87:0/820872974 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f49880a1090 0x7f49880a3550 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4998005940 tx=0x7f49980058d0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.232+0000 7f49a800d640 1 -- 172.21.15.87:0/820872974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49a0100850 msgr2=0x7f49a019d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:57.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.232+0000 7f49a800d640 1 --2- 172.21.15.87:0/820872974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49a0100850 0x7f49a019d310 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f499000eaa0 tx=0x7f499000ef60 comp rx=0 tx=0).stop 2024-09-13T17:10:57.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.232+0000 7f49a800d640 1 -- 172.21.15.87:0/820872974 shutdown_connections 2024-09-13T17:10:57.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.232+0000 7f49a800d640 1 --2- 172.21.15.87:0/820872974 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f49880a1090 0x7f49880a3550 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.232+0000 7f49a800d640 1 --2- 172.21.15.87:0/820872974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49a0100850 0x7f49a019d310 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.232+0000 7f49a800d640 1 --2- 172.21.15.87:0/820872974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49a00ffe90 0x7f49a01962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.232+0000 7f49a800d640 1 --2- 172.21.15.87:0/820872974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49a00feca0 0x7f49a0195da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:57.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.232+0000 7f49a800d640 1 -- 172.21.15.87:0/820872974 >> 172.21.15.87:0/820872974 conn(0x7f49a00fa440 msgr2=0x7f49a01032f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:57.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.232+0000 7f49a800d640 1 -- 172.21.15.87:0/820872974 shutdown_connections 2024-09-13T17:10:57.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:57.232+0000 7f49a800d640 1 -- 172.21.15.87:0/820872974 wait complete. 2024-09-13T17:10:57.590 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:57 smithi118 ceph-mon[34374]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:57.591 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:57 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:57.591 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:57 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:57.591 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:57 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:57.591 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:57 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:10:57.591 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:57 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:10:57.591 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:57 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:57.591 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:57 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/820872974' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:10:57.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:57 smithi149 ceph-mon[35496]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:57.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:57 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:57.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:57 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:57.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:57 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:57.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:57 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:10:57.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:57 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:10:57.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:57 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:57.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:57 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/820872974' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:10:57.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:57 smithi087 ceph-mon[30934]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:57.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:57 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:57.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:57 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:57.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:57 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:10:57.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:57 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:10:57.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:57 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:10:57.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:57 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:10:57.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:57 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/820872974' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:10:58.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:58 smithi149 ceph-mon[35496]: Deploying daemon mds.e on smithi118 2024-09-13T17:10:58.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:58 smithi149 ceph-mon[35496]: mds.? [v2:172.21.15.87:6836/321170197,v1:172.21.15.87:6837/321170197] up:boot 2024-09-13T17:10:58.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:58 smithi149 ceph-mon[35496]: fsmap 4 up:standby 2024-09-13T17:10:58.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:58 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-13T17:10:58.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:58 smithi118 ceph-mon[34374]: Deploying daemon mds.e on smithi118 2024-09-13T17:10:58.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:58 smithi118 ceph-mon[34374]: mds.? [v2:172.21.15.87:6836/321170197,v1:172.21.15.87:6837/321170197] up:boot 2024-09-13T17:10:58.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:58 smithi118 ceph-mon[34374]: fsmap 4 up:standby 2024-09-13T17:10:58.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:58 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-13T17:10:58.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:58 smithi087 ceph-mon[30934]: Deploying daemon mds.e on smithi118 2024-09-13T17:10:58.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:58 smithi087 ceph-mon[30934]: mds.? [v2:172.21.15.87:6836/321170197,v1:172.21.15.87:6837/321170197] up:boot 2024-09-13T17:10:58.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:58 smithi087 ceph-mon[30934]: fsmap 4 up:standby 2024-09-13T17:10:58.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:58 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-13T17:10:59.113 INFO:journalctl@ceph.mds.e.smithi118.stdout:Sep 13 17:10:58 smithi118 systemd[1]: Starting Ceph mds.e for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:10:59.245 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:10:59.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.358+0000 7ff4baa6c640 1 -- 172.21.15.87:0/706905279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff4b4100f90 msgr2=0x7ff4b4101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:59.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.358+0000 7ff4baa6c640 1 --2- 172.21.15.87:0/706905279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff4b4100f90 0x7ff4b4101410 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4009900 tx=0x7ff4a402a410 comp rx=0 tx=0).stop 2024-09-13T17:10:59.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.359+0000 7ff4baa6c640 1 -- 172.21.15.87:0/706905279 shutdown_connections 2024-09-13T17:10:59.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.359+0000 7ff4baa6c640 1 --2- 172.21.15.87:0/706905279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4b4101950 0x7ff4b41081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:59.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.359+0000 7ff4baa6c640 1 --2- 172.21.15.87:0/706905279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff4b4100f90 0x7ff4b4101410 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:59.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.359+0000 7ff4baa6c640 1 --2- 172.21.15.87:0/706905279 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4b40ffda0 0x7ff4b41001a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:59.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.359+0000 7ff4baa6c640 1 -- 172.21.15.87:0/706905279 >> 172.21.15.87:0/706905279 conn(0x7ff4b40fb520 msgr2=0x7ff4b40fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:59.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.359+0000 7ff4baa6c640 1 -- 172.21.15.87:0/706905279 shutdown_connections 2024-09-13T17:10:59.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.359+0000 7ff4baa6c640 1 -- 172.21.15.87:0/706905279 wait complete. 2024-09-13T17:10:59.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.359+0000 7ff4baa6c640 1 Processor -- start 2024-09-13T17:10:59.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.359+0000 7ff4baa6c640 1 -- start start 2024-09-13T17:10:59.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.359+0000 7ff4baa6c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4b40ffda0 0x7ff4b4195d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:59.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.359+0000 7ff4baa6c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff4b4100f90 0x7ff4b4196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:59.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.359+0000 7ff4baa6c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4b4101950 0x7ff4b419d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:59.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.359+0000 7ff4baa6c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b419d7f0 con 0x7ff4b4100f90 2024-09-13T17:10:59.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.359+0000 7ff4baa6c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b419d960 con 0x7ff4b40ffda0 2024-09-13T17:10:59.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.359+0000 7ff4baa6c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b419db20 con 0x7ff4b4101950 2024-09-13T17:10:59.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.359+0000 7ff4abfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff4b4100f90 0x7ff4b4196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:59.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.359+0000 7ff4abfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff4b4100f90 0x7ff4b4196250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41976/0 (socket says 172.21.15.87:41976) 2024-09-13T17:10:59.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.359+0000 7ff4abfff640 1 -- 172.21.15.87:0/691786619 learned_addr learned my addr 172.21.15.87:0/691786619 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:10:59.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.360+0000 7ff4b8808640 1 --2- 172.21.15.87:0/691786619 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4b40ffda0 0x7ff4b4195d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:59.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.360+0000 7ff4b9009640 1 --2- 172.21.15.87:0/691786619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4b4101950 0x7ff4b419d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:59.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.360+0000 7ff4abfff640 1 -- 172.21.15.87:0/691786619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4b4101950 msgr2=0x7ff4b419d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:59.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.360+0000 7ff4abfff640 1 --2- 172.21.15.87:0/691786619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4b4101950 0x7ff4b419d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:59.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.360+0000 7ff4abfff640 1 -- 172.21.15.87:0/691786619 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4b40ffda0 msgr2=0x7ff4b4195d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:59.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.360+0000 7ff4abfff640 1 --2- 172.21.15.87:0/691786619 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4b40ffda0 0x7ff4b4195d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:59.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.360+0000 7ff4abfff640 1 -- 172.21.15.87:0/691786619 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a4009560 con 0x7ff4b4100f90 2024-09-13T17:10:59.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.360+0000 7ff4abfff640 1 --2- 172.21.15.87:0/691786619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff4b4100f90 0x7ff4b4196250 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4031460 tx=0x7ff4a4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:59.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.360+0000 7ff4a9ffb640 1 -- 172.21.15.87:0/691786619 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a40035f0 con 0x7ff4b4100f90 2024-09-13T17:10:59.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.360+0000 7ff4a9ffb640 1 -- 172.21.15.87:0/691786619 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff4a4003c00 con 0x7ff4b4100f90 2024-09-13T17:10:59.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.360+0000 7ff4baa6c640 1 -- 172.21.15.87:0/691786619 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b419dda0 con 0x7ff4b4100f90 2024-09-13T17:10:59.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.360+0000 7ff4a9ffb640 1 -- 172.21.15.87:0/691786619 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a403cda0 con 0x7ff4b4100f90 2024-09-13T17:10:59.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.360+0000 7ff4baa6c640 1 -- 172.21.15.87:0/691786619 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b419e1e0 con 0x7ff4b4100f90 2024-09-13T17:10:59.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.361+0000 7ff4baa6c640 1 -- 172.21.15.87:0/691786619 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b4107250 con 0x7ff4b4100f90 2024-09-13T17:10:59.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.362+0000 7ff4a9ffb640 1 -- 172.21.15.87:0/691786619 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff4a403c570 con 0x7ff4b4100f90 2024-09-13T17:10:59.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.363+0000 7ff4a9ffb640 1 --2- 172.21.15.87:0/691786619 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff49c0a1110 0x7ff49c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:10:59.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.363+0000 7ff4b8808640 1 --2- 172.21.15.87:0/691786619 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff49c0a1110 0x7ff49c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:10:59.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.363+0000 7ff4a9ffb640 1 -- 172.21.15.87:0/691786619 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff4a40ed430 con 0x7ff4b4100f90 2024-09-13T17:10:59.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.363+0000 7ff4b8808640 1 --2- 172.21.15.87:0/691786619 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff49c0a1110 0x7ff49c0a35d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff4b41971e0 tx=0x7ff4b0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:10:59.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.367+0000 7ff4a9ffb640 1 -- 172.21.15.87:0/691786619 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff4a40b6fd0 con 0x7ff4b4100f90 2024-09-13T17:10:59.385 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:10:59 smithi118 ceph-mon[34374]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:59.385 INFO:journalctl@ceph.mds.e.smithi118.stdout:Sep 13 17:10:59 smithi118 podman[63905]: 2024-09-13 17:10:59.020593104 +0000 UTC m=+0.015645589 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:10:59.385 INFO:journalctl@ceph.mds.e.smithi118.stdout:Sep 13 17:10:59 smithi118 podman[63905]: 2024-09-13 17:10:59.138830939 +0000 UTC m=+0.133883430 container create c5b82dd49f06bc2b2b81be6fe184fb74a68a0bc5fc6e1c606f6219b16bd471c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-e, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-13T17:10:59.385 INFO:journalctl@ceph.mds.e.smithi118.stdout:Sep 13 17:10:59 smithi118 podman[63905]: 2024-09-13 17:10:59.383413812 +0000 UTC m=+0.378466296 container init c5b82dd49f06bc2b2b81be6fe184fb74a68a0bc5fc6e1c606f6219b16bd471c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-e, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True) 2024-09-13T17:10:59.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.572+0000 7ff4baa6c640 1 -- 172.21.15.87:0/691786619 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4b410b690 con 0x7ff4b4100f90 2024-09-13T17:10:59.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.573+0000 7ff4a9ffb640 1 -- 172.21.15.87:0/691786619 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3531 (secure 0 0 0) 0x7ff4a404ade0 con 0x7ff4b4100f90 2024-09-13T17:10:59.574 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:10:59.574 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-09-13T17:10:59.574 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 5 2024-09-13T17:10:59.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.575+0000 7ff4baa6c640 1 -- 172.21.15.87:0/691786619 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff49c0a1110 msgr2=0x7ff49c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:59.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.575+0000 7ff4baa6c640 1 --2- 172.21.15.87:0/691786619 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff49c0a1110 0x7ff49c0a35d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff4b41971e0 tx=0x7ff4b0005f90 comp rx=0 tx=0).stop 2024-09-13T17:10:59.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.575+0000 7ff4baa6c640 1 -- 172.21.15.87:0/691786619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff4b4100f90 msgr2=0x7ff4b4196250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:10:59.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.575+0000 7ff4baa6c640 1 --2- 172.21.15.87:0/691786619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff4b4100f90 0x7ff4b4196250 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4031460 tx=0x7ff4a4004270 comp rx=0 tx=0).stop 2024-09-13T17:10:59.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.575+0000 7ff4baa6c640 1 -- 172.21.15.87:0/691786619 shutdown_connections 2024-09-13T17:10:59.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.575+0000 7ff4baa6c640 1 --2- 172.21.15.87:0/691786619 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff49c0a1110 0x7ff49c0a35d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:59.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.575+0000 7ff4baa6c640 1 --2- 172.21.15.87:0/691786619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4b4101950 0x7ff4b419d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:59.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.575+0000 7ff4baa6c640 1 --2- 172.21.15.87:0/691786619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff4b4100f90 0x7ff4b4196250 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:59.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.575+0000 7ff4baa6c640 1 --2- 172.21.15.87:0/691786619 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4b40ffda0 0x7ff4b4195d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:10:59.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.575+0000 7ff4baa6c640 1 -- 172.21.15.87:0/691786619 >> 172.21.15.87:0/691786619 conn(0x7ff4b40fb520 msgr2=0x7ff4b4104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:10:59.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.575+0000 7ff4baa6c640 1 -- 172.21.15.87:0/691786619 shutdown_connections 2024-09-13T17:10:59.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:10:59.575+0000 7ff4baa6c640 1 -- 172.21.15.87:0/691786619 wait complete. 2024-09-13T17:10:59.589 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:10:59 smithi087 ceph-mon[30934]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:59.591 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:10:59 smithi149 ceph-mon[35496]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:10:59.863 INFO:journalctl@ceph.mds.e.smithi118.stdout:Sep 13 17:10:59 smithi118 podman[63905]: 2024-09-13 17:10:59.386290355 +0000 UTC m=+0.381342847 container start c5b82dd49f06bc2b2b81be6fe184fb74a68a0bc5fc6e1c606f6219b16bd471c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-e, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-13T17:10:59.863 INFO:journalctl@ceph.mds.e.smithi118.stdout:Sep 13 17:10:59 smithi118 ceph-mds[63924]: -- 172.21.15.118:0/3972370456 <== mon.2 v2:172.21.15.118:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558fd7514d00 con 0x558fd74e8800 2024-09-13T17:10:59.863 INFO:journalctl@ceph.mds.e.smithi118.stdout:Sep 13 17:10:59 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-e[63920]: starting mds.e at 2024-09-13T17:10:59.863 INFO:journalctl@ceph.mds.e.smithi118.stdout:Sep 13 17:10:59 smithi118 bash[63905]: c5b82dd49f06bc2b2b81be6fe184fb74a68a0bc5fc6e1c606f6219b16bd471c3 2024-09-13T17:10:59.863 INFO:journalctl@ceph.mds.e.smithi118.stdout:Sep 13 17:10:59 smithi118 systemd[1]: Started Ceph mds.e for 043d5bae-71f2-11ef-bceb-c7b262605968. 2024-09-13T17:11:00.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:00 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:00.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:00 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:00.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:00 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:00.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:00 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:11:00.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:00 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:11:00.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:00 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:11:00.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:00 smithi087 ceph-mon[30934]: Deploying daemon mds.f on smithi149 2024-09-13T17:11:00.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:00 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/691786619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:00.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:00 smithi087 ceph-mon[30934]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:00.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:00 smithi087 ceph-mon[30934]: mds.? [v2:172.21.15.118:6834/4187230685,v1:172.21.15.118:6835/4187230685] up:boot 2024-09-13T17:11:00.730 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:00 smithi087 ceph-mon[30934]: fsmap 5 up:standby 2024-09-13T17:11:00.730 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:00 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-13T17:11:00.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:00 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:00.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:00 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:00.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:00 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:00.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:00 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:11:00.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:00 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:11:00.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:00 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:11:00.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:00 smithi149 ceph-mon[35496]: Deploying daemon mds.f on smithi149 2024-09-13T17:11:00.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:00 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/691786619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:00.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:00 smithi149 ceph-mon[35496]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:00.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:00 smithi149 ceph-mon[35496]: mds.? [v2:172.21.15.118:6834/4187230685,v1:172.21.15.118:6835/4187230685] up:boot 2024-09-13T17:11:00.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:00 smithi149 ceph-mon[35496]: fsmap 5 up:standby 2024-09-13T17:11:00.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:00 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-13T17:11:00.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:00 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:00.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:00 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:00.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:00 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:00.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:00 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:11:00.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:00 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:11:00.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:00 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:11:00.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:00 smithi118 ceph-mon[34374]: Deploying daemon mds.f on smithi149 2024-09-13T17:11:00.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:00 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/691786619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:00.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:00 smithi118 ceph-mon[34374]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:00.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:00 smithi118 ceph-mon[34374]: mds.? [v2:172.21.15.118:6834/4187230685,v1:172.21.15.118:6835/4187230685] up:boot 2024-09-13T17:11:00.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:00 smithi118 ceph-mon[34374]: fsmap 5 up:standby 2024-09-13T17:11:00.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:00 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-13T17:11:01.591 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:11:01.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.701+0000 7fcf167b5640 1 -- 172.21.15.87:0/1248175155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf100744f0 msgr2=0x7fcf10072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:01.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.701+0000 7fcf167b5640 1 --2- 172.21.15.87:0/1248175155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf100744f0 0x7fcf10072940 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcf00009900 tx=0x7fcf0002a410 comp rx=0 tx=0).stop 2024-09-13T17:11:01.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.701+0000 7fcf167b5640 1 -- 172.21.15.87:0/1248175155 shutdown_connections 2024-09-13T17:11:01.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.701+0000 7fcf167b5640 1 --2- 172.21.15.87:0/1248175155 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf1010c370 0x7fcf1010e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:01.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.701+0000 7fcf167b5640 1 --2- 172.21.15.87:0/1248175155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf10072f10 0x7fcf10073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:01.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.701+0000 7fcf167b5640 1 --2- 172.21.15.87:0/1248175155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf100744f0 0x7fcf10072940 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:01.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.701+0000 7fcf167b5640 1 -- 172.21.15.87:0/1248175155 >> 172.21.15.87:0/1248175155 conn(0x7fcf100fb520 msgr2=0x7fcf100fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:01.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.701+0000 7fcf167b5640 1 -- 172.21.15.87:0/1248175155 shutdown_connections 2024-09-13T17:11:01.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.701+0000 7fcf167b5640 1 -- 172.21.15.87:0/1248175155 wait complete. 2024-09-13T17:11:01.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.701+0000 7fcf167b5640 1 Processor -- start 2024-09-13T17:11:01.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.701+0000 7fcf167b5640 1 -- start start 2024-09-13T17:11:01.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.702+0000 7fcf167b5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf10072f10 0x7fcf1019c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:01.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.702+0000 7fcf167b5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf100744f0 0x7fcf1019c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:01.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.702+0000 7fcf167b5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf1010c370 0x7fcf101a3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:01.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.702+0000 7fcf167b5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf101a3ea0 con 0x7fcf100744f0 2024-09-13T17:11:01.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.702+0000 7fcf167b5640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf101a4010 con 0x7fcf10072f10 2024-09-13T17:11:01.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.702+0000 7fcf167b5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf101a41d0 con 0x7fcf1010c370 2024-09-13T17:11:01.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.702+0000 7fcf0f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf100744f0 0x7fcf1019c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:01.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.702+0000 7fcf0f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf100744f0 0x7fcf1019c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42008/0 (socket says 172.21.15.87:42008) 2024-09-13T17:11:01.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.702+0000 7fcf0f7fe640 1 -- 172.21.15.87:0/3422138282 learned_addr learned my addr 172.21.15.87:0/3422138282 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:01.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.702+0000 7fcf0ffff640 1 --2- 172.21.15.87:0/3422138282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf10072f10 0x7fcf1019c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:01.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.702+0000 7fcf14d52640 1 --2- 172.21.15.87:0/3422138282 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf1010c370 0x7fcf101a3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:01.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.702+0000 7fcf0f7fe640 1 -- 172.21.15.87:0/3422138282 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf1010c370 msgr2=0x7fcf101a3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:01.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.702+0000 7fcf0f7fe640 1 --2- 172.21.15.87:0/3422138282 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf1010c370 0x7fcf101a3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:01.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.702+0000 7fcf0f7fe640 1 -- 172.21.15.87:0/3422138282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf10072f10 msgr2=0x7fcf1019c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:01.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.702+0000 7fcf0f7fe640 1 --2- 172.21.15.87:0/3422138282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf10072f10 0x7fcf1019c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:01.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.702+0000 7fcf0f7fe640 1 -- 172.21.15.87:0/3422138282 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf00009560 con 0x7fcf100744f0 2024-09-13T17:11:01.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.702+0000 7fcf0f7fe640 1 --2- 172.21.15.87:0/3422138282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf100744f0 0x7fcf1019c8f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcf0400d770 tx=0x7fcf0400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:01.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.702+0000 7fcf0d7fa640 1 -- 172.21.15.87:0/3422138282 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf04009c30 con 0x7fcf100744f0 2024-09-13T17:11:01.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.703+0000 7fcf0d7fa640 1 -- 172.21.15.87:0/3422138282 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcf0400de80 con 0x7fcf100744f0 2024-09-13T17:11:01.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.703+0000 7fcf167b5640 1 -- 172.21.15.87:0/3422138282 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf101a44b0 con 0x7fcf100744f0 2024-09-13T17:11:01.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.703+0000 7fcf0d7fa640 1 -- 172.21.15.87:0/3422138282 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf04004e00 con 0x7fcf100744f0 2024-09-13T17:11:01.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.703+0000 7fcf167b5640 1 -- 172.21.15.87:0/3422138282 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf101a4970 con 0x7fcf100744f0 2024-09-13T17:11:01.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.704+0000 7fcf167b5640 1 -- 172.21.15.87:0/3422138282 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf10111c60 con 0x7fcf100744f0 2024-09-13T17:11:01.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.705+0000 7fcf0d7fa640 1 -- 172.21.15.87:0/3422138282 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fcf04004f60 con 0x7fcf100744f0 2024-09-13T17:11:01.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.705+0000 7fcf0d7fa640 1 --2- 172.21.15.87:0/3422138282 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fcef80a1090 0x7fcef80a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:01.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.705+0000 7fcf0ffff640 1 --2- 172.21.15.87:0/3422138282 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fcef80a1090 0x7fcef80a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:01.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.705+0000 7fcf0d7fa640 1 -- 172.21.15.87:0/3422138282 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fcf040cbed0 con 0x7fcf100744f0 2024-09-13T17:11:01.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.706+0000 7fcf0ffff640 1 --2- 172.21.15.87:0/3422138282 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fcef80a1090 0x7fcef80a3550 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcf00031460 tx=0x7fcf000058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:01.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.709+0000 7fcf0d7fa640 1 -- 172.21.15.87:0/3422138282 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcf04095b00 con 0x7fcf100744f0 2024-09-13T17:11:01.751 INFO:journalctl@ceph.mds.f.smithi149.stdout:Sep 13 17:11:01 smithi149 systemd[1]: Starting Ceph mds.f for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:11:01.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.908+0000 7fcf167b5640 1 -- 172.21.15.87:0/3422138282 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf10111df0 con 0x7fcf100744f0 2024-09-13T17:11:01.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.908+0000 7fcf0d7fa640 1 -- 172.21.15.87:0/3422138282 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4291 (secure 0 0 0) 0x7fcf04099120 con 0x7fcf100744f0 2024-09-13T17:11:01.909 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:11:01.909 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-09-13T17:11:01.910 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 6 2024-09-13T17:11:01.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.910+0000 7fcf167b5640 1 -- 172.21.15.87:0/3422138282 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fcef80a1090 msgr2=0x7fcef80a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:01.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.910+0000 7fcf167b5640 1 --2- 172.21.15.87:0/3422138282 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fcef80a1090 0x7fcef80a3550 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcf00031460 tx=0x7fcf000058d0 comp rx=0 tx=0).stop 2024-09-13T17:11:01.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.910+0000 7fcf167b5640 1 -- 172.21.15.87:0/3422138282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf100744f0 msgr2=0x7fcf1019c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:01.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.910+0000 7fcf167b5640 1 --2- 172.21.15.87:0/3422138282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf100744f0 0x7fcf1019c8f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcf0400d770 tx=0x7fcf0400dc30 comp rx=0 tx=0).stop 2024-09-13T17:11:01.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.910+0000 7fcf167b5640 1 -- 172.21.15.87:0/3422138282 shutdown_connections 2024-09-13T17:11:01.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.910+0000 7fcf167b5640 1 --2- 172.21.15.87:0/3422138282 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fcef80a1090 0x7fcef80a3550 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:01.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.910+0000 7fcf167b5640 1 --2- 172.21.15.87:0/3422138282 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf1010c370 0x7fcf101a3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:01.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.910+0000 7fcf167b5640 1 --2- 172.21.15.87:0/3422138282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf100744f0 0x7fcf1019c8f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:01.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.910+0000 7fcf167b5640 1 --2- 172.21.15.87:0/3422138282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf10072f10 0x7fcf1019c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:01.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.910+0000 7fcf167b5640 1 -- 172.21.15.87:0/3422138282 >> 172.21.15.87:0/3422138282 conn(0x7fcf100fb520 msgr2=0x7fcf100fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:01.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.910+0000 7fcf167b5640 1 -- 172.21.15.87:0/3422138282 shutdown_connections 2024-09-13T17:11:01.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:01.910+0000 7fcf167b5640 1 -- 172.21.15.87:0/3422138282 wait complete. 2024-09-13T17:11:02.009 INFO:journalctl@ceph.mds.f.smithi149.stdout:Sep 13 17:11:01 smithi149 podman[65575]: 2024-09-13 17:11:01.653183322 +0000 UTC m=+0.015938182 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:11:02.010 INFO:journalctl@ceph.mds.f.smithi149.stdout:Sep 13 17:11:01 smithi149 podman[65575]: 2024-09-13 17:11:01.773044812 +0000 UTC m=+0.135799721 container create cd23e64839faf25d0052c40e56808474d9663c53e554b2b59610d311af15c015 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-13T17:11:02.010 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:01 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3422138282' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:02.228 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:01 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3422138282' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:02.342 INFO:journalctl@ceph.mds.f.smithi149.stdout:Sep 13 17:11:02 smithi149 podman[65575]: 2024-09-13 17:11:02.009203028 +0000 UTC m=+0.371957881 container init cd23e64839faf25d0052c40e56808474d9663c53e554b2b59610d311af15c015 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-13T17:11:02.342 INFO:journalctl@ceph.mds.f.smithi149.stdout:Sep 13 17:11:02 smithi149 podman[65575]: 2024-09-13 17:11:02.012364168 +0000 UTC m=+0.375119021 container start cd23e64839faf25d0052c40e56808474d9663c53e554b2b59610d311af15c015 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-f, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-13T17:11:02.342 INFO:journalctl@ceph.mds.f.smithi149.stdout:Sep 13 17:11:02 smithi149 ceph-mds[65594]: -- 172.21.15.149:0/1923111997 <== mon.1 v2:172.21.15.149:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5635f6e98d00 con 0x5635f6e6d400 2024-09-13T17:11:02.342 INFO:journalctl@ceph.mds.f.smithi149.stdout:Sep 13 17:11:02 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-f[65590]: starting mds.f at 2024-09-13T17:11:02.343 INFO:journalctl@ceph.mds.f.smithi149.stdout:Sep 13 17:11:02 smithi149 bash[65575]: cd23e64839faf25d0052c40e56808474d9663c53e554b2b59610d311af15c015 2024-09-13T17:11:02.343 INFO:journalctl@ceph.mds.f.smithi149.stdout:Sep 13 17:11:02 smithi149 systemd[1]: Started Ceph mds.f for 043d5bae-71f2-11ef-bceb-c7b262605968. 2024-09-13T17:11:02.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:01 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3422138282' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:03.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:03 smithi087 ceph-mon[30934]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:03.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:03 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:03.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:03 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:03.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:03 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:03.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:03 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:11:03.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:03 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:11:03.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:03 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:11:03.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:03 smithi087 ceph-mon[30934]: Deploying daemon mds.c on smithi149 2024-09-13T17:11:03.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:03 smithi087 ceph-mon[30934]: mds.? [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] up:boot 2024-09-13T17:11:03.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:03 smithi087 ceph-mon[30934]: fsmap 6 up:standby 2024-09-13T17:11:03.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:03 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T17:11:03.560 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:03 smithi149 ceph-mon[35496]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:03.560 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:03 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:03.560 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:03 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:03.560 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:03 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:03.560 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:03 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:11:03.560 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:03 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:11:03.560 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:03 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:11:03.561 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:03 smithi149 ceph-mon[35496]: Deploying daemon mds.c on smithi149 2024-09-13T17:11:03.561 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:03 smithi149 ceph-mon[35496]: mds.? [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] up:boot 2024-09-13T17:11:03.561 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:03 smithi149 ceph-mon[35496]: fsmap 6 up:standby 2024-09-13T17:11:03.561 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:03 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T17:11:03.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:03 smithi118 ceph-mon[34374]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:03.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:03 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:03.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:03 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:03.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:03 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:03.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:03 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:11:03.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:03 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:11:03.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:03 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:11:03.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:03 smithi118 ceph-mon[34374]: Deploying daemon mds.c on smithi149 2024-09-13T17:11:03.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:03 smithi118 ceph-mon[34374]: mds.? [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] up:boot 2024-09-13T17:11:03.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:03 smithi118 ceph-mon[34374]: fsmap 6 up:standby 2024-09-13T17:11:03.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:03 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T17:11:03.924 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:11:04.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.034+0000 7f381a43a640 1 -- 172.21.15.87:0/1891166856 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38140fecb0 msgr2=0x7f38140ff0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:04.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.034+0000 7f381a43a640 1 --2- 172.21.15.87:0/1891166856 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38140fecb0 0x7f38140ff0b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3804009900 tx=0x7f380402a410 comp rx=0 tx=0).stop 2024-09-13T17:11:04.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.034+0000 7f381a43a640 1 -- 172.21.15.87:0/1891166856 shutdown_connections 2024-09-13T17:11:04.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.034+0000 7f381a43a640 1 --2- 172.21.15.87:0/1891166856 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3814100860 0x7f38141070f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:04.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.034+0000 7f381a43a640 1 --2- 172.21.15.87:0/1891166856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38140ffea0 0x7f3814100320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:04.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.034+0000 7f381a43a640 1 --2- 172.21.15.87:0/1891166856 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38140fecb0 0x7f38140ff0b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:04.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.034+0000 7f381a43a640 1 -- 172.21.15.87:0/1891166856 >> 172.21.15.87:0/1891166856 conn(0x7f38140fa430 msgr2=0x7f38140fc850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:04.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.034+0000 7f381a43a640 1 -- 172.21.15.87:0/1891166856 shutdown_connections 2024-09-13T17:11:04.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.034+0000 7f381a43a640 1 -- 172.21.15.87:0/1891166856 wait complete. 2024-09-13T17:11:04.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.034+0000 7f381a43a640 1 Processor -- start 2024-09-13T17:11:04.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.034+0000 7f381a43a640 1 -- start start 2024-09-13T17:11:04.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.035+0000 7f381a43a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38140fecb0 0x7f3814195da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:04.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.035+0000 7f381a43a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38140ffea0 0x7f38141962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:04.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.035+0000 7f381a43a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3814100860 0x7f381419d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:04.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.035+0000 7f381a43a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381419d880 con 0x7f3814100860 2024-09-13T17:11:04.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.035+0000 7f381a43a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381419d9f0 con 0x7f38140fecb0 2024-09-13T17:11:04.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.035+0000 7f381a43a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381419dbb0 con 0x7f38140ffea0 2024-09-13T17:11:04.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.035+0000 7f38189d7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3814100860 0x7f381419d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:04.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.035+0000 7f38189d7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3814100860 0x7f381419d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42030/0 (socket says 172.21.15.87:42030) 2024-09-13T17:11:04.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.035+0000 7f38189d7640 1 -- 172.21.15.87:0/3212931959 learned_addr learned my addr 172.21.15.87:0/3212931959 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:04.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.035+0000 7f3813fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38140fecb0 0x7f3814195da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:04.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.035+0000 7f38137fe640 1 --2- 172.21.15.87:0/3212931959 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38140ffea0 0x7f38141962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:04.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.035+0000 7f38189d7640 1 -- 172.21.15.87:0/3212931959 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38140ffea0 msgr2=0x7f38141962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:04.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.035+0000 7f38189d7640 1 --2- 172.21.15.87:0/3212931959 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38140ffea0 0x7f38141962e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:04.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.035+0000 7f38189d7640 1 -- 172.21.15.87:0/3212931959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38140fecb0 msgr2=0x7f3814195da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:04.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.035+0000 7f38189d7640 1 --2- 172.21.15.87:0/3212931959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38140fecb0 0x7f3814195da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:04.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.035+0000 7f38189d7640 1 -- 172.21.15.87:0/3212931959 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3804009560 con 0x7f3814100860 2024-09-13T17:11:04.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.035+0000 7f38189d7640 1 --2- 172.21.15.87:0/3212931959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3814100860 0x7f381419d310 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f380c00cad0 tx=0x7f380c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:04.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.035+0000 7f38117fa640 1 -- 172.21.15.87:0/3212931959 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c00ae20 con 0x7f3814100860 2024-09-13T17:11:04.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.035+0000 7f38117fa640 1 -- 172.21.15.87:0/3212931959 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f380c005020 con 0x7f3814100860 2024-09-13T17:11:04.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.035+0000 7f381a43a640 1 -- 172.21.15.87:0/3212931959 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f381419de90 con 0x7f3814100860 2024-09-13T17:11:04.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.035+0000 7f38117fa640 1 -- 172.21.15.87:0/3212931959 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c00f690 con 0x7f3814100860 2024-09-13T17:11:04.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.035+0000 7f381a43a640 1 -- 172.21.15.87:0/3212931959 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f381419e260 con 0x7f3814100860 2024-09-13T17:11:04.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.036+0000 7f381a43a640 1 -- 172.21.15.87:0/3212931959 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f381410a5a0 con 0x7f3814100860 2024-09-13T17:11:04.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.038+0000 7f38117fa640 1 -- 172.21.15.87:0/3212931959 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f380c005190 con 0x7f3814100860 2024-09-13T17:11:04.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.038+0000 7f38117fa640 1 --2- 172.21.15.87:0/3212931959 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f38000a1090 0x7f38000a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:04.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.038+0000 7f3813fff640 1 --2- 172.21.15.87:0/3212931959 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f38000a1090 0x7f38000a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:04.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.038+0000 7f38117fa640 1 -- 172.21.15.87:0/3212931959 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f380c0cc780 con 0x7f3814100860 2024-09-13T17:11:04.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.039+0000 7f3813fff640 1 --2- 172.21.15.87:0/3212931959 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f38000a1090 0x7f38000a3550 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3804005940 tx=0x7f38040058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:04.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.041+0000 7f38117fa640 1 -- 172.21.15.87:0/3212931959 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f380c0963d0 con 0x7f3814100860 2024-09-13T17:11:04.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.244+0000 7f381a43a640 1 -- 172.21.15.87:0/3212931959 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f381410a780 con 0x7f3814100860 2024-09-13T17:11:04.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.244+0000 7f38117fa640 1 -- 172.21.15.87:0/3212931959 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5051 (secure 0 0 0) 0x7f380c098300 con 0x7f3814100860 2024-09-13T17:11:04.245 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:11:04.245 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[]} 2024-09-13T17:11:04.246 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 7 2024-09-13T17:11:04.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.246+0000 7f381a43a640 1 -- 172.21.15.87:0/3212931959 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f38000a1090 msgr2=0x7f38000a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:04.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.246+0000 7f381a43a640 1 --2- 172.21.15.87:0/3212931959 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f38000a1090 0x7f38000a3550 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3804005940 tx=0x7f38040058d0 comp rx=0 tx=0).stop 2024-09-13T17:11:04.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.246+0000 7f381a43a640 1 -- 172.21.15.87:0/3212931959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3814100860 msgr2=0x7f381419d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:04.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.246+0000 7f381a43a640 1 --2- 172.21.15.87:0/3212931959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3814100860 0x7f381419d310 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f380c00cad0 tx=0x7f380c00cf90 comp rx=0 tx=0).stop 2024-09-13T17:11:04.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.246+0000 7f381a43a640 1 -- 172.21.15.87:0/3212931959 shutdown_connections 2024-09-13T17:11:04.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.246+0000 7f381a43a640 1 --2- 172.21.15.87:0/3212931959 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f38000a1090 0x7f38000a3550 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:04.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.246+0000 7f381a43a640 1 --2- 172.21.15.87:0/3212931959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3814100860 0x7f381419d310 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:04.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.246+0000 7f381a43a640 1 --2- 172.21.15.87:0/3212931959 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38140ffea0 0x7f38141962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:04.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.246+0000 7f381a43a640 1 --2- 172.21.15.87:0/3212931959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38140fecb0 0x7f3814195da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:04.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.246+0000 7f381a43a640 1 -- 172.21.15.87:0/3212931959 >> 172.21.15.87:0/3212931959 conn(0x7f38140fa430 msgr2=0x7f3814068660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:04.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.246+0000 7f381a43a640 1 -- 172.21.15.87:0/3212931959 shutdown_connections 2024-09-13T17:11:04.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:04.246+0000 7f381a43a640 1 -- 172.21.15.87:0/3212931959 wait complete. 2024-09-13T17:11:04.266 INFO:journalctl@ceph.mds.c.smithi149.stdout:Sep 13 17:11:04 smithi149 systemd[1]: Starting Ceph mds.c for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:11:04.533 INFO:journalctl@ceph.mds.c.smithi149.stdout:Sep 13 17:11:04 smithi149 podman[65879]: 2024-09-13 17:11:04.167777707 +0000 UTC m=+0.017536502 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:11:04.533 INFO:journalctl@ceph.mds.c.smithi149.stdout:Sep 13 17:11:04 smithi149 podman[65879]: 2024-09-13 17:11:04.280426252 +0000 UTC m=+0.130185039 container create 3df041b80a227ad83f9094e397e79ef0afb97d2b929d8f8c3b903bab537963a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-c, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:11:04.533 INFO:journalctl@ceph.mds.c.smithi149.stdout:Sep 13 17:11:04 smithi149 podman[65879]: 2024-09-13 17:11:04.533088492 +0000 UTC m=+0.382847278 container init 3df041b80a227ad83f9094e397e79ef0afb97d2b929d8f8c3b903bab537963a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-c, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-13T17:11:04.842 INFO:journalctl@ceph.mds.c.smithi149.stdout:Sep 13 17:11:04 smithi149 podman[65879]: 2024-09-13 17:11:04.53622309 +0000 UTC m=+0.385981887 container start 3df041b80a227ad83f9094e397e79ef0afb97d2b929d8f8c3b903bab537963a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-13T17:11:04.842 INFO:journalctl@ceph.mds.c.smithi149.stdout:Sep 13 17:11:04 smithi149 ceph-mds[65898]: -- 172.21.15.149:0/3978074337 <== mon.1 v2:172.21.15.149:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d318346d00 con 0x55d31831b000 2024-09-13T17:11:04.843 INFO:journalctl@ceph.mds.c.smithi149.stdout:Sep 13 17:11:04 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-c[65894]: starting mds.c at 2024-09-13T17:11:04.843 INFO:journalctl@ceph.mds.c.smithi149.stdout:Sep 13 17:11:04 smithi149 bash[65879]: 3df041b80a227ad83f9094e397e79ef0afb97d2b929d8f8c3b903bab537963a6 2024-09-13T17:11:04.843 INFO:journalctl@ceph.mds.c.smithi149.stdout:Sep 13 17:11:04 smithi149 systemd[1]: Started Ceph mds.c for 043d5bae-71f2-11ef-bceb-c7b262605968. 2024-09-13T17:11:05.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:05 smithi118 ceph-mon[34374]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:05.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:05 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3212931959' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:05.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:05 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:05.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:05 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:05.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:05 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:05.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:05 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:11:05.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:05 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:11:05.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:05 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:11:05.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:05 smithi087 ceph-mon[30934]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:05.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:05 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3212931959' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:05.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:05 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:05.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:05 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:05.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:05 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:05.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:05 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:11:05.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:05 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:11:05.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:05 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:11:05.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:05 smithi149 ceph-mon[35496]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:05.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:05 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3212931959' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:05.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:05 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:05.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:05 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:05.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:05 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:05.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:05 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:11:05.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:05 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:11:05.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:05 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:11:06.259 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:11:06.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.368+0000 7fc956faa640 1 -- 172.21.15.87:0/3123363640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc950100850 msgr2=0x7fc9501070e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:06.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.368+0000 7fc956faa640 1 --2- 172.21.15.87:0/3123363640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc950100850 0x7fc9501070e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc948009ca0 tx=0x7fc94802a8c0 comp rx=0 tx=0).stop 2024-09-13T17:11:06.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.368+0000 7fc956faa640 1 -- 172.21.15.87:0/3123363640 shutdown_connections 2024-09-13T17:11:06.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.368+0000 7fc956faa640 1 --2- 172.21.15.87:0/3123363640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc950100850 0x7fc9501070e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:06.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.368+0000 7fc956faa640 1 --2- 172.21.15.87:0/3123363640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9500ffe90 0x7fc950100310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:06.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.368+0000 7fc956faa640 1 --2- 172.21.15.87:0/3123363640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9500feca0 0x7fc9500ff0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:06.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.368+0000 7fc956faa640 1 -- 172.21.15.87:0/3123363640 >> 172.21.15.87:0/3123363640 conn(0x7fc9500fa440 msgr2=0x7fc9500fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:06.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.368+0000 7fc956faa640 1 -- 172.21.15.87:0/3123363640 shutdown_connections 2024-09-13T17:11:06.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.368+0000 7fc956faa640 1 -- 172.21.15.87:0/3123363640 wait complete. 2024-09-13T17:11:06.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.368+0000 7fc956faa640 1 Processor -- start 2024-09-13T17:11:06.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.368+0000 7fc956faa640 1 -- start start 2024-09-13T17:11:06.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.368+0000 7fc956faa640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9500feca0 0x7fc950102c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:06.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.368+0000 7fc956faa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9500ffe90 0x7fc950101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:06.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.368+0000 7fc956faa640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc950100850 0x7fc9501017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:06.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.368+0000 7fc956faa640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc950101f10 con 0x7fc9500ffe90 2024-09-13T17:11:06.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.368+0000 7fc956faa640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc950102080 con 0x7fc9500feca0 2024-09-13T17:11:06.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.368+0000 7fc956faa640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95019fda0 con 0x7fc950100850 2024-09-13T17:11:06.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.369+0000 7fc94ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9500ffe90 0x7fc950101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:06.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.369+0000 7fc94ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9500ffe90 0x7fc950101270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42046/0 (socket says 172.21.15.87:42046) 2024-09-13T17:11:06.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.369+0000 7fc94ffff640 1 -- 172.21.15.87:0/3539034105 learned_addr learned my addr 172.21.15.87:0/3539034105 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:06.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.369+0000 7fc954d46640 1 --2- 172.21.15.87:0/3539034105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9500feca0 0x7fc950102c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:06.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.369+0000 7fc955547640 1 --2- 172.21.15.87:0/3539034105 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc950100850 0x7fc9501017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:06.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.369+0000 7fc94ffff640 1 -- 172.21.15.87:0/3539034105 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc950100850 msgr2=0x7fc9501017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:06.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.369+0000 7fc94ffff640 1 --2- 172.21.15.87:0/3539034105 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc950100850 0x7fc9501017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:06.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.369+0000 7fc94ffff640 1 -- 172.21.15.87:0/3539034105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9500feca0 msgr2=0x7fc950102c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:06.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.369+0000 7fc94ffff640 1 --2- 172.21.15.87:0/3539034105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9500feca0 0x7fc950102c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:06.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.369+0000 7fc94ffff640 1 -- 172.21.15.87:0/3539034105 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc948009900 con 0x7fc9500ffe90 2024-09-13T17:11:06.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.369+0000 7fc94ffff640 1 --2- 172.21.15.87:0/3539034105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9500ffe90 0x7fc950101270 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc93c00d980 tx=0x7fc93c00de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:06.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.369+0000 7fc94dffb640 1 -- 172.21.15.87:0/3539034105 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c009a30 con 0x7fc9500ffe90 2024-09-13T17:11:06.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.369+0000 7fc94dffb640 1 -- 172.21.15.87:0/3539034105 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc93c0044d0 con 0x7fc9500ffe90 2024-09-13T17:11:06.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.369+0000 7fc956faa640 1 -- 172.21.15.87:0/3539034105 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc95019fff0 con 0x7fc9500ffe90 2024-09-13T17:11:06.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.369+0000 7fc94dffb640 1 -- 172.21.15.87:0/3539034105 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c0047a0 con 0x7fc9500ffe90 2024-09-13T17:11:06.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.369+0000 7fc956faa640 1 -- 172.21.15.87:0/3539034105 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9501a0520 con 0x7fc9500ffe90 2024-09-13T17:11:06.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.370+0000 7fc956faa640 1 -- 172.21.15.87:0/3539034105 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc95010a590 con 0x7fc9500ffe90 2024-09-13T17:11:06.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.371+0000 7fc94dffb640 1 -- 172.21.15.87:0/3539034105 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc93c004020 con 0x7fc9500ffe90 2024-09-13T17:11:06.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.372+0000 7fc94dffb640 1 --2- 172.21.15.87:0/3539034105 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc9400a1110 0x7fc9400a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:06.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.372+0000 7fc954d46640 1 --2- 172.21.15.87:0/3539034105 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc9400a1110 0x7fc9400a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:06.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.372+0000 7fc94dffb640 1 -- 172.21.15.87:0/3539034105 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc93c0cbdd0 con 0x7fc9500ffe90 2024-09-13T17:11:06.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.373+0000 7fc954d46640 1 --2- 172.21.15.87:0/3539034105 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc9400a1110 0x7fc9400a35d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc9500ffcf0 tx=0x7fc944005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:06.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.376+0000 7fc94dffb640 1 -- 172.21.15.87:0/3539034105 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc93c095a00 con 0x7fc9500ffe90 2024-09-13T17:11:06.437 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:06 smithi118 ceph-mon[34374]: Deploying daemon mds.h on smithi118 2024-09-13T17:11:06.437 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:06 smithi118 ceph-mon[34374]: mds.? [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] up:boot 2024-09-13T17:11:06.437 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:06 smithi118 ceph-mon[34374]: fsmap 7 up:standby 2024-09-13T17:11:06.437 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:06 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T17:11:06.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:06 smithi087 ceph-mon[30934]: Deploying daemon mds.h on smithi118 2024-09-13T17:11:06.481 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:06 smithi087 ceph-mon[30934]: mds.? [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] up:boot 2024-09-13T17:11:06.481 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:06 smithi087 ceph-mon[30934]: fsmap 7 up:standby 2024-09-13T17:11:06.481 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:06 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T17:11:06.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.573+0000 7fc956faa640 1 -- 172.21.15.87:0/3539034105 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc95010a770 con 0x7fc9500ffe90 2024-09-13T17:11:06.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.573+0000 7fc94dffb640 1 -- 172.21.15.87:0/3539034105 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+5811 (secure 0 0 0) 0x7fc93c099020 con 0x7fc9500ffe90 2024-09-13T17:11:06.574 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:11:06.575 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8}],"filesystems":[]} 2024-09-13T17:11:06.575 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 8 2024-09-13T17:11:06.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.575+0000 7fc956faa640 1 -- 172.21.15.87:0/3539034105 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc9400a1110 msgr2=0x7fc9400a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:06.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.575+0000 7fc956faa640 1 --2- 172.21.15.87:0/3539034105 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc9400a1110 0x7fc9400a35d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc9500ffcf0 tx=0x7fc944005f90 comp rx=0 tx=0).stop 2024-09-13T17:11:06.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.575+0000 7fc956faa640 1 -- 172.21.15.87:0/3539034105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9500ffe90 msgr2=0x7fc950101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:06.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.575+0000 7fc956faa640 1 --2- 172.21.15.87:0/3539034105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9500ffe90 0x7fc950101270 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc93c00d980 tx=0x7fc93c00de40 comp rx=0 tx=0).stop 2024-09-13T17:11:06.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.575+0000 7fc956faa640 1 -- 172.21.15.87:0/3539034105 shutdown_connections 2024-09-13T17:11:06.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.575+0000 7fc956faa640 1 --2- 172.21.15.87:0/3539034105 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc9400a1110 0x7fc9400a35d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:06.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.575+0000 7fc956faa640 1 --2- 172.21.15.87:0/3539034105 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc950100850 0x7fc9501017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:06.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.575+0000 7fc956faa640 1 --2- 172.21.15.87:0/3539034105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9500ffe90 0x7fc950101270 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:06.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.575+0000 7fc956faa640 1 --2- 172.21.15.87:0/3539034105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9500feca0 0x7fc950102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:06.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.575+0000 7fc956faa640 1 -- 172.21.15.87:0/3539034105 >> 172.21.15.87:0/3539034105 conn(0x7fc9500fa440 msgr2=0x7fc950067610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:06.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.575+0000 7fc956faa640 1 -- 172.21.15.87:0/3539034105 shutdown_connections 2024-09-13T17:11:06.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:06.575+0000 7fc956faa640 1 -- 172.21.15.87:0/3539034105 wait complete. 2024-09-13T17:11:06.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:06 smithi149 ceph-mon[35496]: Deploying daemon mds.h on smithi118 2024-09-13T17:11:06.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:06 smithi149 ceph-mon[35496]: mds.? [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] up:boot 2024-09-13T17:11:06.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:06 smithi149 ceph-mon[35496]: fsmap 7 up:standby 2024-09-13T17:11:06.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:06 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T17:11:07.084 INFO:journalctl@ceph.mds.h.smithi118.stdout:Sep 13 17:11:07 smithi118 podman[64220]: 2024-09-13 17:11:07.080407589 +0000 UTC m=+0.362812842 container init 9de8deadcdc3a7dc8da01cad5dacfc276342028f60990c2621586f9587105d99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-h, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:11:07.084 INFO:journalctl@ceph.mds.h.smithi118.stdout:Sep 13 17:11:07 smithi118 podman[64220]: 2024-09-13 17:11:07.08322567 +0000 UTC m=+0.365630928 container start 9de8deadcdc3a7dc8da01cad5dacfc276342028f60990c2621586f9587105d99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-h, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-13T17:11:07.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:07 smithi118 ceph-mon[34374]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:07.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:07 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3539034105' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:07.363 INFO:journalctl@ceph.mds.h.smithi118.stdout:Sep 13 17:11:07 smithi118 ceph-mds[64240]: -- 172.21.15.118:0/451130581 <== mon.2 v2:172.21.15.118:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b858b42d00 con 0x55b858b17000 2024-09-13T17:11:07.363 INFO:journalctl@ceph.mds.h.smithi118.stdout:Sep 13 17:11:07 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-h[64236]: starting mds.h at 2024-09-13T17:11:07.363 INFO:journalctl@ceph.mds.h.smithi118.stdout:Sep 13 17:11:07 smithi118 bash[64220]: 9de8deadcdc3a7dc8da01cad5dacfc276342028f60990c2621586f9587105d99 2024-09-13T17:11:07.363 INFO:journalctl@ceph.mds.h.smithi118.stdout:Sep 13 17:11:07 smithi118 systemd[1]: Started Ceph mds.h for 043d5bae-71f2-11ef-bceb-c7b262605968. 2024-09-13T17:11:07.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:07 smithi087 ceph-mon[30934]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:07.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:07 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3539034105' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:07.588 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:07 smithi149 ceph-mon[35496]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:07.588 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:07 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3539034105' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:08.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:08 smithi087 ceph-mon[30934]: mds.? [v2:172.21.15.118:6836/923553321,v1:172.21.15.118:6837/923553321] up:boot 2024-09-13T17:11:08.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:08 smithi087 ceph-mon[30934]: fsmap 8 up:standby 2024-09-13T17:11:08.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:08 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T17:11:08.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:08 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:08.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:08 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:08.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:08 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:08.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:08 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:11:08.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:08 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:11:08.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:08 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:11:08.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:08 smithi087 ceph-mon[30934]: Deploying daemon mds.i on smithi149 2024-09-13T17:11:08.588 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:11:08.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:08 smithi149 ceph-mon[35496]: mds.? [v2:172.21.15.118:6836/923553321,v1:172.21.15.118:6837/923553321] up:boot 2024-09-13T17:11:08.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:08 smithi149 ceph-mon[35496]: fsmap 8 up:standby 2024-09-13T17:11:08.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:08 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T17:11:08.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:08 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:08.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:08 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:08.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:08 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:08.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:08 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:11:08.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:08 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:11:08.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:08 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:11:08.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:08 smithi149 ceph-mon[35496]: Deploying daemon mds.i on smithi149 2024-09-13T17:11:08.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:08 smithi118 ceph-mon[34374]: mds.? [v2:172.21.15.118:6836/923553321,v1:172.21.15.118:6837/923553321] up:boot 2024-09-13T17:11:08.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:08 smithi118 ceph-mon[34374]: fsmap 8 up:standby 2024-09-13T17:11:08.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:08 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T17:11:08.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:08 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:08.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:08 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:08.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:08 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:08.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:08 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:11:08.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:08 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:11:08.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:08 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:11:08.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:08 smithi118 ceph-mon[34374]: Deploying daemon mds.i on smithi149 2024-09-13T17:11:08.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.701+0000 7f43778d0640 1 -- 172.21.15.87:0/3820683840 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43700feca0 msgr2=0x7f43700ff0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:08.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.701+0000 7f43778d0640 1 --2- 172.21.15.87:0/3820683840 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43700feca0 0x7f43700ff0a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f436c009900 tx=0x7f436c02a410 comp rx=0 tx=0).stop 2024-09-13T17:11:08.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.701+0000 7f43778d0640 1 -- 172.21.15.87:0/3820683840 shutdown_connections 2024-09-13T17:11:08.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.701+0000 7f43778d0640 1 --2- 172.21.15.87:0/3820683840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4370100850 0x7f43701070e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:08.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.701+0000 7f43778d0640 1 --2- 172.21.15.87:0/3820683840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43700ffe90 0x7f4370100310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:08.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.701+0000 7f43778d0640 1 --2- 172.21.15.87:0/3820683840 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43700feca0 0x7f43700ff0a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:08.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.701+0000 7f43778d0640 1 -- 172.21.15.87:0/3820683840 >> 172.21.15.87:0/3820683840 conn(0x7f43700fa440 msgr2=0x7f43700fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:08.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.701+0000 7f43778d0640 1 -- 172.21.15.87:0/3820683840 shutdown_connections 2024-09-13T17:11:08.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.701+0000 7f43778d0640 1 -- 172.21.15.87:0/3820683840 wait complete. 2024-09-13T17:11:08.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.701+0000 7f43778d0640 1 Processor -- start 2024-09-13T17:11:08.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.701+0000 7f43778d0640 1 -- start start 2024-09-13T17:11:08.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.702+0000 7f43778d0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43700feca0 0x7f4370195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:08.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.702+0000 7f43778d0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43700ffe90 0x7f43701962f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:08.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.702+0000 7f43778d0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4370100850 0x7f437019d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:08.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.702+0000 7f43778d0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437019d890 con 0x7f43700feca0 2024-09-13T17:11:08.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.702+0000 7f43778d0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437019da00 con 0x7f4370100850 2024-09-13T17:11:08.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.702+0000 7f43778d0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437019dbc0 con 0x7f43700ffe90 2024-09-13T17:11:08.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.702+0000 7f437566c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43700feca0 0x7f4370195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:08.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.702+0000 7f437566c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43700feca0 0x7f4370195db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42068/0 (socket says 172.21.15.87:42068) 2024-09-13T17:11:08.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.702+0000 7f437566c640 1 -- 172.21.15.87:0/2858406859 learned_addr learned my addr 172.21.15.87:0/2858406859 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:08.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.702+0000 7f4375e6d640 1 --2- 172.21.15.87:0/2858406859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4370100850 0x7f437019d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:08.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.702+0000 7f4374e6b640 1 --2- 172.21.15.87:0/2858406859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43700ffe90 0x7f43701962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:08.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.702+0000 7f437566c640 1 -- 172.21.15.87:0/2858406859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43700ffe90 msgr2=0x7f43701962f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:08.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.702+0000 7f437566c640 1 --2- 172.21.15.87:0/2858406859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43700ffe90 0x7f43701962f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:08.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.702+0000 7f437566c640 1 -- 172.21.15.87:0/2858406859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4370100850 msgr2=0x7f437019d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:08.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.702+0000 7f437566c640 1 --2- 172.21.15.87:0/2858406859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4370100850 0x7f437019d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:08.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.702+0000 7f437566c640 1 -- 172.21.15.87:0/2858406859 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f436c009560 con 0x7f43700feca0 2024-09-13T17:11:08.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.702+0000 7f437566c640 1 --2- 172.21.15.87:0/2858406859 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43700feca0 0x7f4370195db0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f436c031460 tx=0x7f436c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:08.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.702+0000 7f43667fc640 1 -- 172.21.15.87:0/2858406859 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c003800 con 0x7f43700feca0 2024-09-13T17:11:08.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.702+0000 7f43667fc640 1 -- 172.21.15.87:0/2858406859 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f436c003e10 con 0x7f43700feca0 2024-09-13T17:11:08.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.703+0000 7f43667fc640 1 -- 172.21.15.87:0/2858406859 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c03b3d0 con 0x7f43700feca0 2024-09-13T17:11:08.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.703+0000 7f43778d0640 1 -- 172.21.15.87:0/2858406859 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f437019de40 con 0x7f43700feca0 2024-09-13T17:11:08.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.703+0000 7f43778d0640 1 -- 172.21.15.87:0/2858406859 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f437019e200 con 0x7f43700feca0 2024-09-13T17:11:08.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.703+0000 7f43778d0640 1 -- 172.21.15.87:0/2858406859 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43700ff110 con 0x7f43700feca0 2024-09-13T17:11:08.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.705+0000 7f43667fc640 1 -- 172.21.15.87:0/2858406859 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f436c03c470 con 0x7f43700feca0 2024-09-13T17:11:08.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.705+0000 7f43667fc640 1 --2- 172.21.15.87:0/2858406859 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f435c0a1110 0x7f435c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:08.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.705+0000 7f4374e6b640 1 --2- 172.21.15.87:0/2858406859 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f435c0a1110 0x7f435c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:08.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.705+0000 7f43667fc640 1 -- 172.21.15.87:0/2858406859 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f436c0ed2a0 con 0x7f43700feca0 2024-09-13T17:11:08.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.706+0000 7f4374e6b640 1 --2- 172.21.15.87:0/2858406859 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f435c0a1110 0x7f435c0a35d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4360009890 tx=0x7f4360008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:08.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.709+0000 7f43667fc640 1 -- 172.21.15.87:0/2858406859 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f43700ff110 con 0x7f43700feca0 2024-09-13T17:11:08.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.904+0000 7f43778d0640 1 -- 172.21.15.87:0/2858406859 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43701061d0 con 0x7f43700feca0 2024-09-13T17:11:08.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.904+0000 7f43667fc640 1 -- 172.21.15.87:0/2858406859 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6568 (secure 0 0 0) 0x7f436c0ba960 con 0x7f43700feca0 2024-09-13T17:11:08.907 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:11:08.907 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24446,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8}],"filesystems":[]} 2024-09-13T17:11:08.907 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 9 2024-09-13T17:11:08.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.906+0000 7f43778d0640 1 -- 172.21.15.87:0/2858406859 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f435c0a1110 msgr2=0x7f435c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:08.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.906+0000 7f43778d0640 1 --2- 172.21.15.87:0/2858406859 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f435c0a1110 0x7f435c0a35d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4360009890 tx=0x7f4360008040 comp rx=0 tx=0).stop 2024-09-13T17:11:08.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.906+0000 7f43778d0640 1 -- 172.21.15.87:0/2858406859 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43700feca0 msgr2=0x7f4370195db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:08.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.906+0000 7f43778d0640 1 --2- 172.21.15.87:0/2858406859 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43700feca0 0x7f4370195db0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f436c031460 tx=0x7f436c004430 comp rx=0 tx=0).stop 2024-09-13T17:11:08.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.906+0000 7f43778d0640 1 -- 172.21.15.87:0/2858406859 shutdown_connections 2024-09-13T17:11:08.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.906+0000 7f43778d0640 1 --2- 172.21.15.87:0/2858406859 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f435c0a1110 0x7f435c0a35d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:08.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.906+0000 7f43778d0640 1 --2- 172.21.15.87:0/2858406859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4370100850 0x7f437019d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:08.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.906+0000 7f43778d0640 1 --2- 172.21.15.87:0/2858406859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43700ffe90 0x7f43701962f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:08.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.906+0000 7f43778d0640 1 --2- 172.21.15.87:0/2858406859 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43700feca0 0x7f4370195db0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:08.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.906+0000 7f43778d0640 1 -- 172.21.15.87:0/2858406859 >> 172.21.15.87:0/2858406859 conn(0x7f43700fa440 msgr2=0x7f4370103350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:08.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.906+0000 7f43778d0640 1 -- 172.21.15.87:0/2858406859 shutdown_connections 2024-09-13T17:11:08.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:08.907+0000 7f43778d0640 1 -- 172.21.15.87:0/2858406859 wait complete. 2024-09-13T17:11:09.246 INFO:journalctl@ceph.mds.i.smithi149.stdout:Sep 13 17:11:09 smithi149 systemd[1]: Starting Ceph mds.i for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:11:09.502 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:09 smithi149 ceph-mon[35496]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:09.502 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:09 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2858406859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:09.502 INFO:journalctl@ceph.mds.i.smithi149.stdout:Sep 13 17:11:09 smithi149 podman[66183]: 2024-09-13 17:11:09.273900625 +0000 UTC m=+0.016535633 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:11:09.502 INFO:journalctl@ceph.mds.i.smithi149.stdout:Sep 13 17:11:09 smithi149 podman[66183]: 2024-09-13 17:11:09.377729943 +0000 UTC m=+0.120364945 container create 364b088f43260f135872ee8755482b43622c33ccd07bf1d55c07eba4da3280e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-i, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:11:09.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:09 smithi118 ceph-mon[34374]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:09.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:09 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2858406859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:09.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:09 smithi087 ceph-mon[30934]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:09.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:09 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2858406859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:10.092 INFO:journalctl@ceph.mds.i.smithi149.stdout:Sep 13 17:11:09 smithi149 podman[66183]: 2024-09-13 17:11:09.622765871 +0000 UTC m=+0.365400879 container init 364b088f43260f135872ee8755482b43622c33ccd07bf1d55c07eba4da3280e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-i, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux ) 2024-09-13T17:11:10.092 INFO:journalctl@ceph.mds.i.smithi149.stdout:Sep 13 17:11:09 smithi149 podman[66183]: 2024-09-13 17:11:09.625772 +0000 UTC m=+0.368407005 container start 364b088f43260f135872ee8755482b43622c33ccd07bf1d55c07eba4da3280e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-i, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T17:11:10.092 INFO:journalctl@ceph.mds.i.smithi149.stdout:Sep 13 17:11:09 smithi149 ceph-mds[66202]: -- 172.21.15.149:0/3142944167 <== mon.1 v2:172.21.15.149:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5622af274d00 con 0x5622af249400 2024-09-13T17:11:10.092 INFO:journalctl@ceph.mds.i.smithi149.stdout:Sep 13 17:11:09 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-i[66198]: starting mds.i at 2024-09-13T17:11:10.092 INFO:journalctl@ceph.mds.i.smithi149.stdout:Sep 13 17:11:09 smithi149 bash[66183]: 364b088f43260f135872ee8755482b43622c33ccd07bf1d55c07eba4da3280e5 2024-09-13T17:11:10.092 INFO:journalctl@ceph.mds.i.smithi149.stdout:Sep 13 17:11:09 smithi149 systemd[1]: Started Ceph mds.i for 043d5bae-71f2-11ef-bceb-c7b262605968. 2024-09-13T17:11:10.920 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:11:11.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.021+0000 7fc8d2925640 1 -- 172.21.15.87:0/2015717401 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8cc101970 msgr2=0x7fc8cc108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:11.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.021+0000 7fc8d2925640 1 --2- 172.21.15.87:0/2015717401 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8cc101970 0x7fc8cc108200 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4009ca0 tx=0x7fc8c402a8c0 comp rx=0 tx=0).stop 2024-09-13T17:11:11.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.021+0000 7fc8d2925640 1 -- 172.21.15.87:0/2015717401 shutdown_connections 2024-09-13T17:11:11.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.022+0000 7fc8d2925640 1 --2- 172.21.15.87:0/2015717401 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8cc101970 0x7fc8cc108200 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:11.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.022+0000 7fc8d2925640 1 --2- 172.21.15.87:0/2015717401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8cc100fb0 0x7fc8cc101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:11.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.022+0000 7fc8d2925640 1 --2- 172.21.15.87:0/2015717401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8cc0ffdc0 0x7fc8cc1001c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:11.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.022+0000 7fc8d2925640 1 -- 172.21.15.87:0/2015717401 >> 172.21.15.87:0/2015717401 conn(0x7fc8cc0fb520 msgr2=0x7fc8cc0fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:11.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.022+0000 7fc8d2925640 1 -- 172.21.15.87:0/2015717401 shutdown_connections 2024-09-13T17:11:11.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.022+0000 7fc8d2925640 1 -- 172.21.15.87:0/2015717401 wait complete. 2024-09-13T17:11:11.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.022+0000 7fc8d2925640 1 Processor -- start 2024-09-13T17:11:11.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.022+0000 7fc8d2925640 1 -- start start 2024-09-13T17:11:11.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.022+0000 7fc8d2925640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8cc0ffdc0 0x7fc8cc195cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:11.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.022+0000 7fc8d2925640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8cc100fb0 0x7fc8cc1961f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:11.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.022+0000 7fc8d2925640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8cc101970 0x7fc8cc19d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:11.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.022+0000 7fc8d2925640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc19d7c0 con 0x7fc8cc100fb0 2024-09-13T17:11:11.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.022+0000 7fc8d2925640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc19d930 con 0x7fc8cc101970 2024-09-13T17:11:11.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.022+0000 7fc8d2925640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc19daf0 con 0x7fc8cc0ffdc0 2024-09-13T17:11:11.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.022+0000 7fc8c3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8cc100fb0 0x7fc8cc1961f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:11.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.022+0000 7fc8c3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8cc100fb0 0x7fc8cc1961f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54750/0 (socket says 172.21.15.87:54750) 2024-09-13T17:11:11.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.022+0000 7fc8c3fff640 1 -- 172.21.15.87:0/3657396709 learned_addr learned my addr 172.21.15.87:0/3657396709 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:11.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.023+0000 7fc8cbfff640 1 --2- 172.21.15.87:0/3657396709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8cc0ffdc0 0x7fc8cc195cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:11.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.023+0000 7fc8d0ec2640 1 --2- 172.21.15.87:0/3657396709 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8cc101970 0x7fc8cc19d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:11.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.023+0000 7fc8c3fff640 1 -- 172.21.15.87:0/3657396709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8cc0ffdc0 msgr2=0x7fc8cc195cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:11.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.023+0000 7fc8c3fff640 1 --2- 172.21.15.87:0/3657396709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8cc0ffdc0 0x7fc8cc195cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:11.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.023+0000 7fc8c3fff640 1 -- 172.21.15.87:0/3657396709 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8cc101970 msgr2=0x7fc8cc19d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:11.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.023+0000 7fc8c3fff640 1 --2- 172.21.15.87:0/3657396709 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8cc101970 0x7fc8cc19d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:11.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.023+0000 7fc8c3fff640 1 -- 172.21.15.87:0/3657396709 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c4009900 con 0x7fc8cc100fb0 2024-09-13T17:11:11.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.023+0000 7fc8d0ec2640 1 --2- 172.21.15.87:0/3657396709 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8cc101970 0x7fc8cc19d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:11:11.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.023+0000 7fc8cbfff640 1 --2- 172.21.15.87:0/3657396709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8cc0ffdc0 0x7fc8cc195cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:11:11.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.023+0000 7fc8c3fff640 1 --2- 172.21.15.87:0/3657396709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8cc100fb0 0x7fc8cc1961f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc8b400c970 tx=0x7fc8b400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:11.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.023+0000 7fc8c9ffb640 1 -- 172.21.15.87:0/3657396709 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4007bb0 con 0x7fc8cc100fb0 2024-09-13T17:11:11.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.023+0000 7fc8d2925640 1 -- 172.21.15.87:0/3657396709 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8cc19ddd0 con 0x7fc8cc100fb0 2024-09-13T17:11:11.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.023+0000 7fc8c9ffb640 1 -- 172.21.15.87:0/3657396709 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc8b4007d10 con 0x7fc8cc100fb0 2024-09-13T17:11:11.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.023+0000 7fc8c9ffb640 1 -- 172.21.15.87:0/3657396709 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4004e80 con 0x7fc8cc100fb0 2024-09-13T17:11:11.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.023+0000 7fc8d2925640 1 -- 172.21.15.87:0/3657396709 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8cc19e230 con 0x7fc8cc100fb0 2024-09-13T17:11:11.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.024+0000 7fc8d2925640 1 -- 172.21.15.87:0/3657396709 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8cc107150 con 0x7fc8cc100fb0 2024-09-13T17:11:11.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.025+0000 7fc8c9ffb640 1 -- 172.21.15.87:0/3657396709 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc8b4005020 con 0x7fc8cc100fb0 2024-09-13T17:11:11.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.026+0000 7fc8c9ffb640 1 --2- 172.21.15.87:0/3657396709 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc8b80a1090 0x7fc8b80a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:11.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.026+0000 7fc8cbfff640 1 --2- 172.21.15.87:0/3657396709 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc8b80a1090 0x7fc8b80a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:11.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.026+0000 7fc8c9ffb640 1 -- 172.21.15.87:0/3657396709 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc8b40cc210 con 0x7fc8cc100fb0 2024-09-13T17:11:11.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.026+0000 7fc8cbfff640 1 --2- 172.21.15.87:0/3657396709 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc8b80a1090 0x7fc8b80a3550 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0058c0 tx=0x7fc8bc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:11.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.030+0000 7fc8c9ffb640 1 -- 172.21.15.87:0/3657396709 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc8b4095e40 con 0x7fc8cc100fb0 2024-09-13T17:11:11.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:10 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:11.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:10 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:11.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:10 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:11.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:10 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:11:11.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:10 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:11:11.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:10 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:11:11.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:10 smithi149 ceph-mon[35496]: Deploying daemon mds.g on smithi087 2024-09-13T17:11:11.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:10 smithi149 ceph-mon[35496]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:11.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:10 smithi149 ceph-mon[35496]: mds.? [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] up:boot 2024-09-13T17:11:11.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:10 smithi149 ceph-mon[35496]: fsmap 9 up:standby 2024-09-13T17:11:11.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:10 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T17:11:11.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:10 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:11.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:10 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:11.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:10 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:11.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:10 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:11:11.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:10 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:11:11.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:10 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:11:11.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:10 smithi118 ceph-mon[34374]: Deploying daemon mds.g on smithi087 2024-09-13T17:11:11.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:10 smithi118 ceph-mon[34374]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:11.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:10 smithi118 ceph-mon[34374]: mds.? [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] up:boot 2024-09-13T17:11:11.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:10 smithi118 ceph-mon[34374]: fsmap 9 up:standby 2024-09-13T17:11:11.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:10 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T17:11:11.137 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:10 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:11.137 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:10 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:11.137 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:10 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:11.137 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:10 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:11:11.137 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:10 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:11:11.138 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:10 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:11:11.138 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:10 smithi087 ceph-mon[30934]: Deploying daemon mds.g on smithi087 2024-09-13T17:11:11.138 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:10 smithi087 ceph-mon[30934]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:11.138 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:10 smithi087 ceph-mon[30934]: mds.? [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] up:boot 2024-09-13T17:11:11.138 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:10 smithi087 ceph-mon[30934]: fsmap 9 up:standby 2024-09-13T17:11:11.138 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:10 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T17:11:11.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.227+0000 7fc8d2925640 1 -- 172.21.15.87:0/3657396709 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8cc02c480 con 0x7fc8cc100fb0 2024-09-13T17:11:11.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.228+0000 7fc8c9ffb640 1 -- 172.21.15.87:0/3657396709 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7330 (secure 0 0 0) 0x7fc8b4099460 con 0x7fc8cc100fb0 2024-09-13T17:11:11.230 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:11:11.230 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24446,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24499,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2024-09-13T17:11:11.230 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 10 2024-09-13T17:11:11.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.230+0000 7fc8d2925640 1 -- 172.21.15.87:0/3657396709 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc8b80a1090 msgr2=0x7fc8b80a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:11.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.230+0000 7fc8d2925640 1 --2- 172.21.15.87:0/3657396709 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc8b80a1090 0x7fc8b80a3550 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0058c0 tx=0x7fc8bc005850 comp rx=0 tx=0).stop 2024-09-13T17:11:11.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.230+0000 7fc8d2925640 1 -- 172.21.15.87:0/3657396709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8cc100fb0 msgr2=0x7fc8cc1961f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:11.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.230+0000 7fc8d2925640 1 --2- 172.21.15.87:0/3657396709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8cc100fb0 0x7fc8cc1961f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc8b400c970 tx=0x7fc8b400ce30 comp rx=0 tx=0).stop 2024-09-13T17:11:11.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.230+0000 7fc8d2925640 1 -- 172.21.15.87:0/3657396709 shutdown_connections 2024-09-13T17:11:11.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.230+0000 7fc8d2925640 1 --2- 172.21.15.87:0/3657396709 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc8b80a1090 0x7fc8b80a3550 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:11.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.230+0000 7fc8d2925640 1 --2- 172.21.15.87:0/3657396709 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8cc101970 0x7fc8cc19d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:11.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.230+0000 7fc8d2925640 1 --2- 172.21.15.87:0/3657396709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8cc100fb0 0x7fc8cc1961f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:11.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.230+0000 7fc8d2925640 1 --2- 172.21.15.87:0/3657396709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8cc0ffdc0 0x7fc8cc195cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:11.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.230+0000 7fc8d2925640 1 -- 172.21.15.87:0/3657396709 >> 172.21.15.87:0/3657396709 conn(0x7fc8cc0fb520 msgr2=0x7fc8cc104320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:11.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.230+0000 7fc8d2925640 1 -- 172.21.15.87:0/3657396709 shutdown_connections 2024-09-13T17:11:11.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:11.230+0000 7fc8d2925640 1 -- 172.21.15.87:0/3657396709 wait complete. 2024-09-13T17:11:11.751 INFO:journalctl@ceph.mds.g.smithi087.stdout:Sep 13 17:11:11 smithi087 systemd[1]: Starting Ceph mds.g for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:11:12.039 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:11 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3657396709' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:12.039 INFO:journalctl@ceph.mds.g.smithi087.stdout:Sep 13 17:11:11 smithi087 podman[71967]: 2024-09-13 17:11:11.796075411 +0000 UTC m=+0.016078818 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:11:12.039 INFO:journalctl@ceph.mds.g.smithi087.stdout:Sep 13 17:11:11 smithi087 podman[71967]: 2024-09-13 17:11:11.926025982 +0000 UTC m=+0.146029435 container create c72bb8e972b5bc083389d569403429b9f2cc529ec7174a59be70d0978737de68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=) 2024-09-13T17:11:12.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:11 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3657396709' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:12.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:11 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3657396709' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:12.479 INFO:journalctl@ceph.mds.g.smithi087.stdout:Sep 13 17:11:12 smithi087 podman[71967]: 2024-09-13 17:11:12.186912303 +0000 UTC m=+0.406915711 container init c72bb8e972b5bc083389d569403429b9f2cc529ec7174a59be70d0978737de68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-g, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-13T17:11:12.479 INFO:journalctl@ceph.mds.g.smithi087.stdout:Sep 13 17:11:12 smithi087 podman[71967]: 2024-09-13 17:11:12.189887732 +0000 UTC m=+0.409891141 container start c72bb8e972b5bc083389d569403429b9f2cc529ec7174a59be70d0978737de68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-g, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-13T17:11:12.479 INFO:journalctl@ceph.mds.g.smithi087.stdout:Sep 13 17:11:12 smithi087 ceph-mds[71986]: -- 172.21.15.87:0/2332899856 <== mon.0 v2:172.21.15.87:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5569b315cd00 con 0x5569b3130800 2024-09-13T17:11:12.479 INFO:journalctl@ceph.mds.g.smithi087.stdout:Sep 13 17:11:12 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-g[71982]: starting mds.g at 2024-09-13T17:11:12.479 INFO:journalctl@ceph.mds.g.smithi087.stdout:Sep 13 17:11:12 smithi087 bash[71967]: c72bb8e972b5bc083389d569403429b9f2cc529ec7174a59be70d0978737de68 2024-09-13T17:11:12.479 INFO:journalctl@ceph.mds.g.smithi087.stdout:Sep 13 17:11:12 smithi087 systemd[1]: Started Ceph mds.g for 043d5bae-71f2-11ef-bceb-c7b262605968. 2024-09-13T17:11:13.245 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:11:13.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.350+0000 7fb76b19d640 1 -- 172.21.15.87:0/413975864 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb764101780 msgr2=0x7fb764108010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:13.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.350+0000 7fb76b19d640 1 --2- 172.21.15.87:0/413975864 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb764101780 0x7fb764108010 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb75c009ca0 tx=0x7fb75c02a8c0 comp rx=0 tx=0).stop 2024-09-13T17:11:13.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.350+0000 7fb76b19d640 1 -- 172.21.15.87:0/413975864 shutdown_connections 2024-09-13T17:11:13.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.350+0000 7fb76b19d640 1 --2- 172.21.15.87:0/413975864 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb764101780 0x7fb764108010 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:13.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.350+0000 7fb76b19d640 1 --2- 172.21.15.87:0/413975864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb764100dc0 0x7fb764101240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:13.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.350+0000 7fb76b19d640 1 --2- 172.21.15.87:0/413975864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7640ffbd0 0x7fb7640fffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:13.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.350+0000 7fb76b19d640 1 -- 172.21.15.87:0/413975864 >> 172.21.15.87:0/413975864 conn(0x7fb7640fb330 msgr2=0x7fb7640fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:13.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.350+0000 7fb76b19d640 1 -- 172.21.15.87:0/413975864 shutdown_connections 2024-09-13T17:11:13.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.350+0000 7fb76b19d640 1 -- 172.21.15.87:0/413975864 wait complete. 2024-09-13T17:11:13.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.351+0000 7fb76b19d640 1 Processor -- start 2024-09-13T17:11:13.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.351+0000 7fb76b19d640 1 -- start start 2024-09-13T17:11:13.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.351+0000 7fb76b19d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7640ffbd0 0x7fb764074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:13.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.351+0000 7fb76b19d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb764100dc0 0x7fb7640728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:13.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.351+0000 7fb76b19d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb764101780 0x7fb764072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:13.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.351+0000 7fb76b19d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb764073540 con 0x7fb764100dc0 2024-09-13T17:11:13.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.351+0000 7fb76b19d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7640736b0 con 0x7fb764101780 2024-09-13T17:11:13.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.351+0000 7fb76b19d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb76419fc30 con 0x7fb7640ffbd0 2024-09-13T17:11:13.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.351+0000 7fb76999a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb764100dc0 0x7fb7640728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:13.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.351+0000 7fb76999a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb764100dc0 0x7fb7640728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54788/0 (socket says 172.21.15.87:54788) 2024-09-13T17:11:13.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.351+0000 7fb76999a640 1 -- 172.21.15.87:0/688613503 learned_addr learned my addr 172.21.15.87:0/688613503 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:13.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.351+0000 7fb76a19b640 1 --2- 172.21.15.87:0/688613503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7640ffbd0 0x7fb764074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:13.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.351+0000 7fb76a99c640 1 --2- 172.21.15.87:0/688613503 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb764101780 0x7fb764072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:13.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.351+0000 7fb76999a640 1 -- 172.21.15.87:0/688613503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7640ffbd0 msgr2=0x7fb764074260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:13.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.351+0000 7fb76999a640 1 --2- 172.21.15.87:0/688613503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7640ffbd0 0x7fb764074260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:13.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.351+0000 7fb76999a640 1 -- 172.21.15.87:0/688613503 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb764101780 msgr2=0x7fb764072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:13.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.351+0000 7fb76999a640 1 --2- 172.21.15.87:0/688613503 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb764101780 0x7fb764072de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:13.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.351+0000 7fb76999a640 1 -- 172.21.15.87:0/688613503 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75c009900 con 0x7fb764100dc0 2024-09-13T17:11:13.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.351+0000 7fb76a99c640 1 --2- 172.21.15.87:0/688613503 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb764101780 0x7fb764072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:11:13.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.352+0000 7fb76999a640 1 --2- 172.21.15.87:0/688613503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb764100dc0 0x7fb7640728a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb76000b4d0 tx=0x7fb76000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:13.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.352+0000 7fb75b7fe640 1 -- 172.21.15.87:0/688613503 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb760010870 con 0x7fb764100dc0 2024-09-13T17:11:13.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.352+0000 7fb76b19d640 1 -- 172.21.15.87:0/688613503 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb76419fee0 con 0x7fb764100dc0 2024-09-13T17:11:13.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.352+0000 7fb75b7fe640 1 -- 172.21.15.87:0/688613503 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb760010e80 con 0x7fb764100dc0 2024-09-13T17:11:13.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.352+0000 7fb75b7fe640 1 -- 172.21.15.87:0/688613503 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb760017360 con 0x7fb764100dc0 2024-09-13T17:11:13.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.352+0000 7fb76b19d640 1 -- 172.21.15.87:0/688613503 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7641a0360 con 0x7fb764100dc0 2024-09-13T17:11:13.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.353+0000 7fb76b19d640 1 -- 172.21.15.87:0/688613503 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb764107000 con 0x7fb764100dc0 2024-09-13T17:11:13.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.354+0000 7fb75b7fe640 1 -- 172.21.15.87:0/688613503 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb7600109d0 con 0x7fb764100dc0 2024-09-13T17:11:13.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.354+0000 7fb75b7fe640 1 --2- 172.21.15.87:0/688613503 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb7500a1090 0x7fb7500a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:13.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.355+0000 7fb75b7fe640 1 -- 172.21.15.87:0/688613503 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb7600cc200 con 0x7fb764100dc0 2024-09-13T17:11:13.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.355+0000 7fb76a19b640 1 --2- 172.21.15.87:0/688613503 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb7500a1090 0x7fb7500a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:13.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.355+0000 7fb76a19b640 1 --2- 172.21.15.87:0/688613503 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb7500a1090 0x7fb7500a3550 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb754005fd0 tx=0x7fb75400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:13.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.358+0000 7fb75b7fe640 1 -- 172.21.15.87:0/688613503 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb760095e30 con 0x7fb764100dc0 2024-09-13T17:11:13.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.564+0000 7fb76b19d640 1 -- 172.21.15.87:0/688613503 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb76410b750 con 0x7fb764100dc0 2024-09-13T17:11:13.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.564+0000 7fb75b7fe640 1 -- 172.21.15.87:0/688613503 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8088 (secure 0 0 0) 0x7fb760099450 con 0x7fb764100dc0 2024-09-13T17:11:13.567 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:11:13.567 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24446,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24499,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2024-09-13T17:11:13.567 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 11 2024-09-13T17:11:13.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.566+0000 7fb76b19d640 1 -- 172.21.15.87:0/688613503 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb7500a1090 msgr2=0x7fb7500a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:13.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.566+0000 7fb76b19d640 1 --2- 172.21.15.87:0/688613503 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb7500a1090 0x7fb7500a3550 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb754005fd0 tx=0x7fb75400b390 comp rx=0 tx=0).stop 2024-09-13T17:11:13.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.566+0000 7fb76b19d640 1 -- 172.21.15.87:0/688613503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb764100dc0 msgr2=0x7fb7640728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:13.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.566+0000 7fb76b19d640 1 --2- 172.21.15.87:0/688613503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb764100dc0 0x7fb7640728a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb76000b4d0 tx=0x7fb76000b990 comp rx=0 tx=0).stop 2024-09-13T17:11:13.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.566+0000 7fb76b19d640 1 -- 172.21.15.87:0/688613503 shutdown_connections 2024-09-13T17:11:13.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.566+0000 7fb76b19d640 1 --2- 172.21.15.87:0/688613503 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb7500a1090 0x7fb7500a3550 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:13.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.566+0000 7fb76b19d640 1 --2- 172.21.15.87:0/688613503 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb764101780 0x7fb764072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:13.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.566+0000 7fb76b19d640 1 --2- 172.21.15.87:0/688613503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb764100dc0 0x7fb7640728a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:13.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.566+0000 7fb76b19d640 1 --2- 172.21.15.87:0/688613503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7640ffbd0 0x7fb764074260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:13.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.566+0000 7fb76b19d640 1 -- 172.21.15.87:0/688613503 >> 172.21.15.87:0/688613503 conn(0x7fb7640fb330 msgr2=0x7fb7641041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:13.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.566+0000 7fb76b19d640 1 -- 172.21.15.87:0/688613503 shutdown_connections 2024-09-13T17:11:13.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:13.566+0000 7fb76b19d640 1 -- 172.21.15.87:0/688613503 wait complete. 2024-09-13T17:11:13.578 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:13 smithi087 ceph-mon[30934]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:13.578 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:13 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:13.578 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:13 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:13.578 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:13 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:13.579 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:13 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:11:13.579 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:13 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:11:13.579 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:13 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:11:13.579 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:13 smithi087 ceph-mon[30934]: Deploying daemon mds.a on smithi087 2024-09-13T17:11:13.579 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:13 smithi087 ceph-mon[30934]: mds.? [v2:172.21.15.87:6838/1687006028,v1:172.21.15.87:6839/1687006028] up:boot 2024-09-13T17:11:13.579 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:13 smithi087 ceph-mon[30934]: fsmap 10 up:standby 2024-09-13T17:11:13.579 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:13 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-13T17:11:13.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:13 smithi149 ceph-mon[35496]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:13.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:13 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:13.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:13 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:13.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:13 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:13.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:13 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:11:13.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:13 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:11:13.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:13 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:11:13.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:13 smithi149 ceph-mon[35496]: Deploying daemon mds.a on smithi087 2024-09-13T17:11:13.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:13 smithi149 ceph-mon[35496]: mds.? [v2:172.21.15.87:6838/1687006028,v1:172.21.15.87:6839/1687006028] up:boot 2024-09-13T17:11:13.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:13 smithi149 ceph-mon[35496]: fsmap 10 up:standby 2024-09-13T17:11:13.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:13 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-13T17:11:13.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:13 smithi118 ceph-mon[34374]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:13.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:13 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:13.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:13 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:13.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:13 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:13.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:13 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:11:13.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:13 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:11:13.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:13 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:11:13.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:13 smithi118 ceph-mon[34374]: Deploying daemon mds.a on smithi087 2024-09-13T17:11:13.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:13 smithi118 ceph-mon[34374]: mds.? [v2:172.21.15.87:6838/1687006028,v1:172.21.15.87:6839/1687006028] up:boot 2024-09-13T17:11:13.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:13 smithi118 ceph-mon[34374]: fsmap 10 up:standby 2024-09-13T17:11:13.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:13 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-13T17:11:14.512 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:14 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/688613503' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:14.512 INFO:journalctl@ceph.mds.a.smithi087.stdout:Sep 13 17:11:14 smithi087 podman[72321]: 2024-09-13 17:11:14.49569372 +0000 UTC m=+0.141302431 container create 3b4b3dcc0e8702a6956665c9a97dc46b3145c1b91dbd37f007bf012079bb9cc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-a, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2) 2024-09-13T17:11:14.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:14 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/688613503' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:14.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:14 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/688613503' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:15.229 INFO:journalctl@ceph.mds.a.smithi087.stdout:Sep 13 17:11:14 smithi087 podman[72321]: 2024-09-13 17:11:14.806885802 +0000 UTC m=+0.452494513 container init 3b4b3dcc0e8702a6956665c9a97dc46b3145c1b91dbd37f007bf012079bb9cc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-a, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0) 2024-09-13T17:11:15.229 INFO:journalctl@ceph.mds.a.smithi087.stdout:Sep 13 17:11:14 smithi087 podman[72321]: 2024-09-13 17:11:14.809773157 +0000 UTC m=+0.455381878 container start 3b4b3dcc0e8702a6956665c9a97dc46b3145c1b91dbd37f007bf012079bb9cc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-a, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-13T17:11:15.229 INFO:journalctl@ceph.mds.a.smithi087.stdout:Sep 13 17:11:14 smithi087 ceph-mds[72342]: -- 172.21.15.87:0/852722915 <== mon.0 v2:172.21.15.87:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5639a574cd00 con 0x5639a5721400 2024-09-13T17:11:15.229 INFO:journalctl@ceph.mds.a.smithi087.stdout:Sep 13 17:11:14 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-a[72338]: starting mds.a at 2024-09-13T17:11:15.229 INFO:journalctl@ceph.mds.a.smithi087.stdout:Sep 13 17:11:14 smithi087 bash[72321]: 3b4b3dcc0e8702a6956665c9a97dc46b3145c1b91dbd37f007bf012079bb9cc6 2024-09-13T17:11:15.229 INFO:journalctl@ceph.mds.a.smithi087.stdout:Sep 13 17:11:14 smithi087 systemd[1]: Started Ceph mds.a for 043d5bae-71f2-11ef-bceb-c7b262605968. 2024-09-13T17:11:15.581 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:11:15.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:15 smithi149 ceph-mon[35496]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:15.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:15 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:15.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:15 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:15.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:15 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:15.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:15 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:11:15.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:15 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:11:15.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:15 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:11:15.605 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:15 smithi087 ceph-mon[30934]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:15.605 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:15 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:15.605 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:15 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:15.605 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:15 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:15.605 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:15 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:11:15.605 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:15 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:11:15.606 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:15 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:11:15.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:15 smithi118 ceph-mon[34374]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:15.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:15 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:15.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:15 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:15.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:15 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:15.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:15 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T17:11:15.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:15 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T17:11:15.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:15 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:11:15.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.682+0000 7f504ed53640 1 -- 172.21.15.87:0/4233152498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5048100f60 msgr2=0x7f50481033d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:15.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.682+0000 7f504ed53640 1 --2- 172.21.15.87:0/4233152498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5048100f60 0x7f50481033d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f503c009900 tx=0x7f503c02a410 comp rx=0 tx=0).stop 2024-09-13T17:11:15.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.683+0000 7f504ed53640 1 -- 172.21.15.87:0/4233152498 shutdown_connections 2024-09-13T17:11:15.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.683+0000 7f504ed53640 1 --2- 172.21.15.87:0/4233152498 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5048103910 0x7f5048103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:15.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.683+0000 7f504ed53640 1 --2- 172.21.15.87:0/4233152498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5048100f60 0x7f50481033d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:15.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.683+0000 7f504ed53640 1 --2- 172.21.15.87:0/4233152498 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50480fe610 0x7f5048100a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:15.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.683+0000 7f504ed53640 1 -- 172.21.15.87:0/4233152498 >> 172.21.15.87:0/4233152498 conn(0x7f50480fa440 msgr2=0x7f50480fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:15.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.683+0000 7f504ed53640 1 -- 172.21.15.87:0/4233152498 shutdown_connections 2024-09-13T17:11:15.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.683+0000 7f504ed53640 1 -- 172.21.15.87:0/4233152498 wait complete. 2024-09-13T17:11:15.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.683+0000 7f504ed53640 1 Processor -- start 2024-09-13T17:11:15.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.683+0000 7f504ed53640 1 -- start start 2024-09-13T17:11:15.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.683+0000 7f504ed53640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50480fe610 0x7f504819c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:15.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.683+0000 7f504ed53640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5048100f60 0x7f504819c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:15.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.683+0000 7f504ed53640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5048103910 0x7f50481a3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:15.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.683+0000 7f504ed53640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50481a3ea0 con 0x7f5048103910 2024-09-13T17:11:15.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.683+0000 7f504ed53640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50481a4010 con 0x7f5048100f60 2024-09-13T17:11:15.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.683+0000 7f504ed53640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50481a41d0 con 0x7f50480fe610 2024-09-13T17:11:15.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.683+0000 7f504d2f0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5048103910 0x7f50481a3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:15.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.684+0000 7f5047fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5048100f60 0x7f504819c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:15.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.684+0000 7f504d2f0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5048103910 0x7f50481a3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54822/0 (socket says 172.21.15.87:54822) 2024-09-13T17:11:15.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.684+0000 7f504d2f0640 1 -- 172.21.15.87:0/278267633 learned_addr learned my addr 172.21.15.87:0/278267633 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:15.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.684+0000 7f504caef640 1 --2- 172.21.15.87:0/278267633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50480fe610 0x7f504819c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:15.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.684+0000 7f504d2f0640 1 -- 172.21.15.87:0/278267633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50480fe610 msgr2=0x7f504819c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:15.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.684+0000 7f504d2f0640 1 --2- 172.21.15.87:0/278267633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50480fe610 0x7f504819c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:15.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.684+0000 7f504d2f0640 1 -- 172.21.15.87:0/278267633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5048100f60 msgr2=0x7f504819c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:15.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.684+0000 7f504d2f0640 1 --2- 172.21.15.87:0/278267633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5048100f60 0x7f504819c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:15.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.684+0000 7f504d2f0640 1 -- 172.21.15.87:0/278267633 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f503c009560 con 0x7f5048103910 2024-09-13T17:11:15.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.684+0000 7f504d2f0640 1 --2- 172.21.15.87:0/278267633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5048103910 0x7f50481a3960 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f504000cad0 tx=0x7f504000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:15.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.684+0000 7f5045ffb640 1 -- 172.21.15.87:0/278267633 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504000ae20 con 0x7f5048103910 2024-09-13T17:11:15.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.684+0000 7f5045ffb640 1 -- 172.21.15.87:0/278267633 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5040005020 con 0x7f5048103910 2024-09-13T17:11:15.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.684+0000 7f504ed53640 1 -- 172.21.15.87:0/278267633 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50481a44b0 con 0x7f5048103910 2024-09-13T17:11:15.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.684+0000 7f5045ffb640 1 -- 172.21.15.87:0/278267633 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504000f690 con 0x7f5048103910 2024-09-13T17:11:15.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.684+0000 7f504ed53640 1 -- 172.21.15.87:0/278267633 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50481a4940 con 0x7f5048103910 2024-09-13T17:11:15.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.685+0000 7f504ed53640 1 -- 172.21.15.87:0/278267633 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50480fbf30 con 0x7f5048103910 2024-09-13T17:11:15.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.686+0000 7f5045ffb640 1 -- 172.21.15.87:0/278267633 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5040005190 con 0x7f5048103910 2024-09-13T17:11:15.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.687+0000 7f5045ffb640 1 --2- 172.21.15.87:0/278267633 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f50300a1090 0x7f50300a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:15.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.687+0000 7f504caef640 1 --2- 172.21.15.87:0/278267633 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f50300a1090 0x7f50300a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:15.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.687+0000 7f5045ffb640 1 -- 172.21.15.87:0/278267633 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f50400cc490 con 0x7f5048103910 2024-09-13T17:11:15.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.687+0000 7f504caef640 1 --2- 172.21.15.87:0/278267633 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f50300a1090 0x7f50300a3550 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5038009b60 tx=0x7f5038005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:15.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.691+0000 7f5045ffb640 1 -- 172.21.15.87:0/278267633 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f50400960c0 con 0x7f5048103910 2024-09-13T17:11:15.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.887+0000 7f504ed53640 1 -- 172.21.15.87:0/278267633 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5048111c40 con 0x7f5048103910 2024-09-13T17:11:15.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.887+0000 7f5045ffb640 1 -- 172.21.15.87:0/278267633 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+8846 (secure 0 0 0) 0x7f50400996e0 con 0x7f5048103910 2024-09-13T17:11:15.890 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:11:15.890 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/3674545180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":3674545180},{"type":"v1","addr":"172.21.15.87:6841","nonce":3674545180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24446,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24499,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2024-09-13T17:11:15.890 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 12 2024-09-13T17:11:15.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.889+0000 7f504ed53640 1 -- 172.21.15.87:0/278267633 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f50300a1090 msgr2=0x7f50300a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:15.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.889+0000 7f504ed53640 1 --2- 172.21.15.87:0/278267633 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f50300a1090 0x7f50300a3550 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5038009b60 tx=0x7f5038005f90 comp rx=0 tx=0).stop 2024-09-13T17:11:15.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.889+0000 7f504ed53640 1 -- 172.21.15.87:0/278267633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5048103910 msgr2=0x7f50481a3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:15.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.889+0000 7f504ed53640 1 --2- 172.21.15.87:0/278267633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5048103910 0x7f50481a3960 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f504000cad0 tx=0x7f504000cf90 comp rx=0 tx=0).stop 2024-09-13T17:11:15.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.889+0000 7f504ed53640 1 -- 172.21.15.87:0/278267633 shutdown_connections 2024-09-13T17:11:15.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.889+0000 7f504ed53640 1 --2- 172.21.15.87:0/278267633 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f50300a1090 0x7f50300a3550 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:15.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.889+0000 7f504ed53640 1 --2- 172.21.15.87:0/278267633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5048103910 0x7f50481a3960 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:15.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.889+0000 7f504ed53640 1 --2- 172.21.15.87:0/278267633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5048100f60 0x7f504819c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:15.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.889+0000 7f504ed53640 1 --2- 172.21.15.87:0/278267633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50480fe610 0x7f504819c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:15.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.889+0000 7f504ed53640 1 -- 172.21.15.87:0/278267633 >> 172.21.15.87:0/278267633 conn(0x7f50480fa440 msgr2=0x7f50480ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:15.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.889+0000 7f504ed53640 1 -- 172.21.15.87:0/278267633 shutdown_connections 2024-09-13T17:11:15.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:15.889+0000 7f504ed53640 1 -- 172.21.15.87:0/278267633 wait complete. 2024-09-13T17:11:16.421 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:16 smithi118 ceph-mon[34374]: Deploying daemon mds.b on smithi118 2024-09-13T17:11:16.421 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:16 smithi118 ceph-mon[34374]: mds.? [v2:172.21.15.87:6840/3674545180,v1:172.21.15.87:6841/3674545180] up:boot 2024-09-13T17:11:16.421 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:16 smithi118 ceph-mon[34374]: fsmap 11 up:standby 2024-09-13T17:11:16.421 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:16 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-13T17:11:16.421 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:16 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/278267633' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:16.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:16 smithi149 ceph-mon[35496]: Deploying daemon mds.b on smithi118 2024-09-13T17:11:16.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:16 smithi149 ceph-mon[35496]: mds.? [v2:172.21.15.87:6840/3674545180,v1:172.21.15.87:6841/3674545180] up:boot 2024-09-13T17:11:16.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:16 smithi149 ceph-mon[35496]: fsmap 11 up:standby 2024-09-13T17:11:16.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:16 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-13T17:11:16.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:16 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/278267633' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:16.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:16 smithi087 ceph-mon[30934]: Deploying daemon mds.b on smithi118 2024-09-13T17:11:16.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:16 smithi087 ceph-mon[30934]: mds.? [v2:172.21.15.87:6840/3674545180,v1:172.21.15.87:6841/3674545180] up:boot 2024-09-13T17:11:16.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:16 smithi087 ceph-mon[30934]: fsmap 11 up:standby 2024-09-13T17:11:16.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:16 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-13T17:11:16.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:16 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/278267633' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:17.092 INFO:journalctl@ceph.mds.b.smithi118.stdout:Sep 13 17:11:17 smithi118 podman[64530]: 2024-09-13 17:11:16.967379913 +0000 UTC m=+0.015847819 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:11:17.092 INFO:journalctl@ceph.mds.b.smithi118.stdout:Sep 13 17:11:17 smithi118 podman[64530]: 2024-09-13 17:11:17.091200454 +0000 UTC m=+0.139668351 container create ba93741e9051a42f055e926b854db3955bb643824e1379182dfdeae6313291a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-b, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-13T17:11:17.362 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:17 smithi118 ceph-mon[34374]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:17.362 INFO:journalctl@ceph.mds.b.smithi118.stdout:Sep 13 17:11:17 smithi118 podman[64530]: 2024-09-13 17:11:17.335745001 +0000 UTC m=+0.384212898 container init ba93741e9051a42f055e926b854db3955bb643824e1379182dfdeae6313291a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-13T17:11:17.362 INFO:journalctl@ceph.mds.b.smithi118.stdout:Sep 13 17:11:17 smithi118 podman[64530]: 2024-09-13 17:11:17.338736877 +0000 UTC m=+0.387204785 container start ba93741e9051a42f055e926b854db3955bb643824e1379182dfdeae6313291a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-b, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-13T17:11:17.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:17 smithi149 ceph-mon[35496]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:17.613 INFO:journalctl@ceph.mds.b.smithi118.stdout:Sep 13 17:11:17 smithi118 ceph-mds[64550]: -- 172.21.15.118:0/370252031 <== mon.2 v2:172.21.15.118:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5644d859ed00 con 0x5644d8573000 2024-09-13T17:11:17.613 INFO:journalctl@ceph.mds.b.smithi118.stdout:Sep 13 17:11:17 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-b[64546]: starting mds.b at 2024-09-13T17:11:17.613 INFO:journalctl@ceph.mds.b.smithi118.stdout:Sep 13 17:11:17 smithi118 bash[64530]: ba93741e9051a42f055e926b854db3955bb643824e1379182dfdeae6313291a7 2024-09-13T17:11:17.613 INFO:journalctl@ceph.mds.b.smithi118.stdout:Sep 13 17:11:17 smithi118 systemd[1]: Started Ceph mds.b for 043d5bae-71f2-11ef-bceb-c7b262605968. 2024-09-13T17:11:17.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:17 smithi087 ceph-mon[30934]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:17.903 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:11:18.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.005+0000 7f2adfb45640 1 -- 172.21.15.87:0/1341411784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ad80feca0 msgr2=0x7f2ad80ff0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:18.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.005+0000 7f2adfb45640 1 --2- 172.21.15.87:0/1341411784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ad80feca0 0x7f2ad80ff0a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4009900 tx=0x7f2ad402a410 comp rx=0 tx=0).stop 2024-09-13T17:11:18.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.005+0000 7f2adfb45640 1 -- 172.21.15.87:0/1341411784 shutdown_connections 2024-09-13T17:11:18.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.005+0000 7f2adfb45640 1 --2- 172.21.15.87:0/1341411784 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ad8100850 0x7f2ad81070e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:18.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.005+0000 7f2adfb45640 1 --2- 172.21.15.87:0/1341411784 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ad80ffe90 0x7f2ad8100310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:18.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.005+0000 7f2adfb45640 1 --2- 172.21.15.87:0/1341411784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ad80feca0 0x7f2ad80ff0a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:18.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.005+0000 7f2adfb45640 1 -- 172.21.15.87:0/1341411784 >> 172.21.15.87:0/1341411784 conn(0x7f2ad80fa440 msgr2=0x7f2ad80fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:18.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.005+0000 7f2adfb45640 1 -- 172.21.15.87:0/1341411784 shutdown_connections 2024-09-13T17:11:18.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.005+0000 7f2adfb45640 1 -- 172.21.15.87:0/1341411784 wait complete. 2024-09-13T17:11:18.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.006+0000 7f2adfb45640 1 Processor -- start 2024-09-13T17:11:18.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.006+0000 7f2adfb45640 1 -- start start 2024-09-13T17:11:18.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.006+0000 7f2adfb45640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ad80feca0 0x7f2ad8195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:18.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.006+0000 7f2adfb45640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ad80ffe90 0x7f2ad81962f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:18.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.006+0000 7f2adfb45640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ad8100850 0x7f2ad819d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:18.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.006+0000 7f2adfb45640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad819d890 con 0x7f2ad80feca0 2024-09-13T17:11:18.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.006+0000 7f2adfb45640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad819da00 con 0x7f2ad8100850 2024-09-13T17:11:18.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.006+0000 7f2adfb45640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad819dbc0 con 0x7f2ad80ffe90 2024-09-13T17:11:18.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.006+0000 7f2add8e1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ad80feca0 0x7f2ad8195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:18.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.006+0000 7f2add8e1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ad80feca0 0x7f2ad8195db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54832/0 (socket says 172.21.15.87:54832) 2024-09-13T17:11:18.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.006+0000 7f2add8e1640 1 -- 172.21.15.87:0/4104817258 learned_addr learned my addr 172.21.15.87:0/4104817258 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:18.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.006+0000 7f2add0e0640 1 --2- 172.21.15.87:0/4104817258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ad80ffe90 0x7f2ad81962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:18.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.007+0000 7f2ade0e2640 1 --2- 172.21.15.87:0/4104817258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ad8100850 0x7f2ad819d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:18.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.007+0000 7f2add8e1640 1 -- 172.21.15.87:0/4104817258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ad80ffe90 msgr2=0x7f2ad81962f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:18.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.007+0000 7f2add8e1640 1 --2- 172.21.15.87:0/4104817258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ad80ffe90 0x7f2ad81962f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:18.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.007+0000 7f2add8e1640 1 -- 172.21.15.87:0/4104817258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ad8100850 msgr2=0x7f2ad819d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:18.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.007+0000 7f2add8e1640 1 --2- 172.21.15.87:0/4104817258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ad8100850 0x7f2ad819d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:18.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.007+0000 7f2add8e1640 1 -- 172.21.15.87:0/4104817258 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad4009560 con 0x7f2ad80feca0 2024-09-13T17:11:18.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.007+0000 7f2add8e1640 1 --2- 172.21.15.87:0/4104817258 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ad80feca0 0x7f2ad8195db0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4031460 tx=0x7f2ad4004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:18.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.007+0000 7f2aceffd640 1 -- 172.21.15.87:0/4104817258 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4003800 con 0x7f2ad80feca0 2024-09-13T17:11:18.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.007+0000 7f2aceffd640 1 -- 172.21.15.87:0/4104817258 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2ad4003e10 con 0x7f2ad80feca0 2024-09-13T17:11:18.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.007+0000 7f2aceffd640 1 -- 172.21.15.87:0/4104817258 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad403b3d0 con 0x7f2ad80feca0 2024-09-13T17:11:18.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.007+0000 7f2adfb45640 1 -- 172.21.15.87:0/4104817258 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad819de40 con 0x7f2ad80feca0 2024-09-13T17:11:18.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.007+0000 7f2adfb45640 1 -- 172.21.15.87:0/4104817258 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad819e200 con 0x7f2ad80feca0 2024-09-13T17:11:18.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.008+0000 7f2adfb45640 1 -- 172.21.15.87:0/4104817258 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad80ff110 con 0x7f2ad80feca0 2024-09-13T17:11:18.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.009+0000 7f2aceffd640 1 -- 172.21.15.87:0/4104817258 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2ad403c6e0 con 0x7f2ad80feca0 2024-09-13T17:11:18.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.010+0000 7f2aceffd640 1 --2- 172.21.15.87:0/4104817258 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2ac40a1110 0x7f2ac40a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:18.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.010+0000 7f2add0e0640 1 --2- 172.21.15.87:0/4104817258 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2ac40a1110 0x7f2ac40a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:18.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.010+0000 7f2aceffd640 1 -- 172.21.15.87:0/4104817258 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f2ad40ed260 con 0x7f2ad80feca0 2024-09-13T17:11:18.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.010+0000 7f2add0e0640 1 --2- 172.21.15.87:0/4104817258 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2ac40a1110 0x7f2ac40a35d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8009990 tx=0x7f2ac8009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:18.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.014+0000 7f2aceffd640 1 -- 172.21.15.87:0/4104817258 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2ad80ff110 con 0x7f2ad80feca0 2024-09-13T17:11:18.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.216+0000 7f2adfb45640 1 -- 172.21.15.87:0/4104817258 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ad81061d0 con 0x7f2ad80feca0 2024-09-13T17:11:18.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.217+0000 7f2aceffd640 1 -- 172.21.15.87:0/4104817258 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+8846 (secure 0 0 0) 0x7f2ad40b6e00 con 0x7f2ad80feca0 2024-09-13T17:11:18.219 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:11:18.219 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/3674545180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":3674545180},{"type":"v1","addr":"172.21.15.87:6841","nonce":3674545180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24446,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24499,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2024-09-13T17:11:18.219 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 12 2024-09-13T17:11:18.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.219+0000 7f2adfb45640 1 -- 172.21.15.87:0/4104817258 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2ac40a1110 msgr2=0x7f2ac40a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:18.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.219+0000 7f2adfb45640 1 --2- 172.21.15.87:0/4104817258 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2ac40a1110 0x7f2ac40a35d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8009990 tx=0x7f2ac8009110 comp rx=0 tx=0).stop 2024-09-13T17:11:18.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.219+0000 7f2adfb45640 1 -- 172.21.15.87:0/4104817258 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ad80feca0 msgr2=0x7f2ad8195db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:18.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.219+0000 7f2adfb45640 1 --2- 172.21.15.87:0/4104817258 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ad80feca0 0x7f2ad8195db0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4031460 tx=0x7f2ad4004430 comp rx=0 tx=0).stop 2024-09-13T17:11:18.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.219+0000 7f2adfb45640 1 -- 172.21.15.87:0/4104817258 shutdown_connections 2024-09-13T17:11:18.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.219+0000 7f2adfb45640 1 --2- 172.21.15.87:0/4104817258 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2ac40a1110 0x7f2ac40a35d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:18.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.219+0000 7f2adfb45640 1 --2- 172.21.15.87:0/4104817258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ad8100850 0x7f2ad819d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:18.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.219+0000 7f2adfb45640 1 --2- 172.21.15.87:0/4104817258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ad80ffe90 0x7f2ad81962f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:18.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.219+0000 7f2adfb45640 1 --2- 172.21.15.87:0/4104817258 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ad80feca0 0x7f2ad8195db0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:18.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.219+0000 7f2adfb45640 1 -- 172.21.15.87:0/4104817258 >> 172.21.15.87:0/4104817258 conn(0x7f2ad80fa440 msgr2=0x7f2ad8103350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:18.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.219+0000 7f2adfb45640 1 -- 172.21.15.87:0/4104817258 shutdown_connections 2024-09-13T17:11:18.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:18.219+0000 7f2adfb45640 1 -- 172.21.15.87:0/4104817258 wait complete. 2024-09-13T17:11:18.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:18 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:18.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:18 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:18.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:18 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:18.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:18 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:18.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:18 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:18.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:18 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:11:18.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:18 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:18.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:18 smithi087 ceph-mon[30934]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:18.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:18 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/4104817258' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:18.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:18 smithi087 ceph-mon[30934]: mds.? [v2:172.21.15.118:6838/3052680456,v1:172.21.15.118:6839/3052680456] up:boot 2024-09-13T17:11:18.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:18 smithi087 ceph-mon[30934]: fsmap 12 up:standby 2024-09-13T17:11:18.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:18 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T17:11:18.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:18 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:18.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:18 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:18.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:18 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:18.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:18 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:18.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:18 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:18.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:18 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:11:18.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:18 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:18.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:18 smithi149 ceph-mon[35496]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:18.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:18 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/4104817258' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:18.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:18 smithi149 ceph-mon[35496]: mds.? [v2:172.21.15.118:6838/3052680456,v1:172.21.15.118:6839/3052680456] up:boot 2024-09-13T17:11:18.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:18 smithi149 ceph-mon[35496]: fsmap 12 up:standby 2024-09-13T17:11:18.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:18 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T17:11:18.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:18 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:18.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:18 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:18.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:18 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:18.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:18 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:18.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:18 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:18.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:18 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:11:18.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:18 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:18.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:18 smithi118 ceph-mon[34374]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:18.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:18 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/4104817258' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:18.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:18 smithi118 ceph-mon[34374]: mds.? [v2:172.21.15.118:6838/3052680456,v1:172.21.15.118:6839/3052680456] up:boot 2024-09-13T17:11:18.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:18 smithi118 ceph-mon[34374]: fsmap 12 up:standby 2024-09-13T17:11:18.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:18 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T17:11:20.006 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:19 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:20.006 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:19 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:20.006 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:19 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:20.007 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:19 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:20.007 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:19 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:20.007 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:19 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:20.007 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:19 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:11:20.007 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:19 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:11:20.007 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:19 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:20.007 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:19 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:11:20.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:19 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:20.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:19 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:20.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:19 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:20.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:19 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:20.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:19 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:20.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:19 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:20.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:19 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:11:20.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:19 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:11:20.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:19 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:20.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:19 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:11:20.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:19 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:20.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:19 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:20.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:19 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:20.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:19 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:20.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:19 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:20.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:19 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:20.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:19 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:11:20.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:19 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:11:20.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:19 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:20.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:19 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:11:20.233 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:11:20.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.339+0000 7f446f9fb640 1 -- 172.21.15.87:0/2598922938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44680ffe90 msgr2=0x7f4468100310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:20.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.339+0000 7f446f9fb640 1 --2- 172.21.15.87:0/2598922938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44680ffe90 0x7f4468100310 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4458009900 tx=0x7f445802a410 comp rx=0 tx=0).stop 2024-09-13T17:11:20.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.339+0000 7f446f9fb640 1 -- 172.21.15.87:0/2598922938 shutdown_connections 2024-09-13T17:11:20.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.339+0000 7f446f9fb640 1 --2- 172.21.15.87:0/2598922938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4468100850 0x7f44681070e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:20.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.339+0000 7f446f9fb640 1 --2- 172.21.15.87:0/2598922938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44680ffe90 0x7f4468100310 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:20.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.339+0000 7f446f9fb640 1 --2- 172.21.15.87:0/2598922938 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44680feca0 0x7f44680ff0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:20.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.339+0000 7f446f9fb640 1 -- 172.21.15.87:0/2598922938 >> 172.21.15.87:0/2598922938 conn(0x7f44680fa440 msgr2=0x7f44680fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:20.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.339+0000 7f446f9fb640 1 -- 172.21.15.87:0/2598922938 shutdown_connections 2024-09-13T17:11:20.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.339+0000 7f446f9fb640 1 -- 172.21.15.87:0/2598922938 wait complete. 2024-09-13T17:11:20.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.340+0000 7f446f9fb640 1 Processor -- start 2024-09-13T17:11:20.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.340+0000 7f446f9fb640 1 -- start start 2024-09-13T17:11:20.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.340+0000 7f446f9fb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44680feca0 0x7f4468194c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:20.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.340+0000 7f446f9fb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44680ffe90 0x7f44681951c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:20.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.340+0000 7f446f9fb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4468100850 0x7f446819c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:20.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.340+0000 7f446f9fb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446819c790 con 0x7f44680feca0 2024-09-13T17:11:20.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.340+0000 7f446f9fb640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446819c900 con 0x7f44680ffe90 2024-09-13T17:11:20.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.340+0000 7f446f9fb640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446819cac0 con 0x7f4468100850 2024-09-13T17:11:20.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.340+0000 7f446d797640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44680feca0 0x7f4468194c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:20.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.340+0000 7f446d797640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44680feca0 0x7f4468194c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57980/0 (socket says 172.21.15.87:57980) 2024-09-13T17:11:20.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.340+0000 7f446d797640 1 -- 172.21.15.87:0/3946789783 learned_addr learned my addr 172.21.15.87:0/3946789783 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:20.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.340+0000 7f446df98640 1 --2- 172.21.15.87:0/3946789783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4468100850 0x7f446819c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:20.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.340+0000 7f446cf96640 1 --2- 172.21.15.87:0/3946789783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44680ffe90 0x7f44681951c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:20.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.340+0000 7f446d797640 1 -- 172.21.15.87:0/3946789783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4468100850 msgr2=0x7f446819c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:20.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.340+0000 7f446d797640 1 --2- 172.21.15.87:0/3946789783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4468100850 0x7f446819c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:20.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.340+0000 7f446d797640 1 -- 172.21.15.87:0/3946789783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44680ffe90 msgr2=0x7f44681951c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:20.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.340+0000 7f446d797640 1 --2- 172.21.15.87:0/3946789783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44680ffe90 0x7f44681951c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:20.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.340+0000 7f446d797640 1 -- 172.21.15.87:0/3946789783 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4458009560 con 0x7f44680feca0 2024-09-13T17:11:20.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.341+0000 7f446d797640 1 --2- 172.21.15.87:0/3946789783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44680feca0 0x7f4468194c80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f446400d950 tx=0x7f446400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:20.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.341+0000 7f445e7fc640 1 -- 172.21.15.87:0/3946789783 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4464009c30 con 0x7f44680feca0 2024-09-13T17:11:20.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.341+0000 7f446f9fb640 1 -- 172.21.15.87:0/3946789783 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f446819cda0 con 0x7f44680feca0 2024-09-13T17:11:20.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.341+0000 7f445e7fc640 1 -- 172.21.15.87:0/3946789783 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4464009d90 con 0x7f44680feca0 2024-09-13T17:11:20.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.341+0000 7f445e7fc640 1 -- 172.21.15.87:0/3946789783 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446400f7e0 con 0x7f44680feca0 2024-09-13T17:11:20.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.341+0000 7f446f9fb640 1 -- 172.21.15.87:0/3946789783 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f446819d1c0 con 0x7f44680feca0 2024-09-13T17:11:20.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.342+0000 7f446f9fb640 1 -- 172.21.15.87:0/3946789783 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44681061d0 con 0x7f44680feca0 2024-09-13T17:11:20.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.343+0000 7f445e7fc640 1 -- 172.21.15.87:0/3946789783 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4464010460 con 0x7f44680feca0 2024-09-13T17:11:20.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.344+0000 7f445e7fc640 1 --2- 172.21.15.87:0/3946789783 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f44540a1090 0x7f44540a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:20.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.344+0000 7f446cf96640 1 --2- 172.21.15.87:0/3946789783 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f44540a1090 0x7f44540a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:20.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.344+0000 7f445e7fc640 1 -- 172.21.15.87:0/3946789783 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f44640cc120 con 0x7f44680feca0 2024-09-13T17:11:20.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.344+0000 7f446cf96640 1 --2- 172.21.15.87:0/3946789783 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f44540a1090 0x7f44540a3550 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4458031460 tx=0x7f44580058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:20.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.347+0000 7f445e7fc640 1 -- 172.21.15.87:0/3946789783 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4464095cb0 con 0x7f44680feca0 2024-09-13T17:11:20.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.566+0000 7f446f9fb640 1 -- 172.21.15.87:0/3946789783 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f446810a590 con 0x7f44680feca0 2024-09-13T17:11:20.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.566+0000 7f445e7fc640 1 -- 172.21.15.87:0/3946789783 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+9607 (secure 0 0 0) 0x7f44640992d0 con 0x7f44680feca0 2024-09-13T17:11:20.569 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:11:20.569 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/3674545180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":3674545180},{"type":"v1","addr":"172.21.15.87:6841","nonce":3674545180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24446,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24470,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6839/3052680456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3052680456},{"type":"v1","addr":"172.21.15.118:6839","nonce":3052680456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24499,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2024-09-13T17:11:20.569 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 13 2024-09-13T17:11:20.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.568+0000 7f446f9fb640 1 -- 172.21.15.87:0/3946789783 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f44540a1090 msgr2=0x7f44540a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:20.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.568+0000 7f446f9fb640 1 --2- 172.21.15.87:0/3946789783 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f44540a1090 0x7f44540a3550 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4458031460 tx=0x7f44580058d0 comp rx=0 tx=0).stop 2024-09-13T17:11:20.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.568+0000 7f446f9fb640 1 -- 172.21.15.87:0/3946789783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44680feca0 msgr2=0x7f4468194c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:20.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.568+0000 7f446f9fb640 1 --2- 172.21.15.87:0/3946789783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44680feca0 0x7f4468194c80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f446400d950 tx=0x7f446400de10 comp rx=0 tx=0).stop 2024-09-13T17:11:20.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.568+0000 7f446f9fb640 1 -- 172.21.15.87:0/3946789783 shutdown_connections 2024-09-13T17:11:20.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.568+0000 7f446f9fb640 1 --2- 172.21.15.87:0/3946789783 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f44540a1090 0x7f44540a3550 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:20.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.568+0000 7f446f9fb640 1 --2- 172.21.15.87:0/3946789783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4468100850 0x7f446819c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:20.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.568+0000 7f446f9fb640 1 --2- 172.21.15.87:0/3946789783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44680ffe90 0x7f44681951c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:20.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.568+0000 7f446f9fb640 1 --2- 172.21.15.87:0/3946789783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44680feca0 0x7f4468194c80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:20.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.568+0000 7f446f9fb640 1 -- 172.21.15.87:0/3946789783 >> 172.21.15.87:0/3946789783 conn(0x7f44680fa440 msgr2=0x7f44681033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:20.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.569+0000 7f446f9fb640 1 -- 172.21.15.87:0/3946789783 shutdown_connections 2024-09-13T17:11:20.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.569+0000 7f446f9fb640 1 -- 172.21.15.87:0/3946789783 wait complete. 2024-09-13T17:11:20.582 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:11:20.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.692+0000 7f2bbca80640 1 -- 172.21.15.87:0/728397507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bb80feca0 msgr2=0x7f2bb80ff0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:20.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.692+0000 7f2bbca80640 1 --2- 172.21.15.87:0/728397507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bb80feca0 0x7f2bb80ff0a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0009ca0 tx=0x7f2bb002a8c0 comp rx=0 tx=0).stop 2024-09-13T17:11:20.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.693+0000 7f2bbca80640 1 -- 172.21.15.87:0/728397507 shutdown_connections 2024-09-13T17:11:20.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.693+0000 7f2bbca80640 1 --2- 172.21.15.87:0/728397507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2bb8100850 0x7f2bb81070e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:20.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.693+0000 7f2bbca80640 1 --2- 172.21.15.87:0/728397507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bb80ffe90 0x7f2bb8100310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:20.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.693+0000 7f2bbca80640 1 --2- 172.21.15.87:0/728397507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bb80feca0 0x7f2bb80ff0a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:20.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.693+0000 7f2bbca80640 1 -- 172.21.15.87:0/728397507 >> 172.21.15.87:0/728397507 conn(0x7f2bb80fa440 msgr2=0x7f2bb80fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:20.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.693+0000 7f2bbca80640 1 -- 172.21.15.87:0/728397507 shutdown_connections 2024-09-13T17:11:20.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.693+0000 7f2bbca80640 1 -- 172.21.15.87:0/728397507 wait complete. 2024-09-13T17:11:20.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.693+0000 7f2bbca80640 1 Processor -- start 2024-09-13T17:11:20.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.693+0000 7f2bbca80640 1 -- start start 2024-09-13T17:11:20.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.693+0000 7f2bbca80640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bb80feca0 0x7f2bb8195e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:20.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.694+0000 7f2bbca80640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bb80ffe90 0x7f2bb8196350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:20.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.694+0000 7f2bbca80640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2bb8100850 0x7f2bb819d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:20.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.694+0000 7f2bbca80640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb819d8b0 con 0x7f2bb80ffe90 2024-09-13T17:11:20.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.694+0000 7f2bbca80640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb819da20 con 0x7f2bb8100850 2024-09-13T17:11:20.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.694+0000 7f2bbca80640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb819dbe0 con 0x7f2bb80feca0 2024-09-13T17:11:20.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.694+0000 7f2bb5d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bb80ffe90 0x7f2bb8196350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:20.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.694+0000 7f2bb5d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bb80ffe90 0x7f2bb8196350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57986/0 (socket says 172.21.15.87:57986) 2024-09-13T17:11:20.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.694+0000 7f2bb5d9b640 1 -- 172.21.15.87:0/2496119181 learned_addr learned my addr 172.21.15.87:0/2496119181 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:20.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.694+0000 7f2bb659c640 1 --2- 172.21.15.87:0/2496119181 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bb80feca0 0x7f2bb8195e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:20.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.694+0000 7f2bb6d9d640 1 --2- 172.21.15.87:0/2496119181 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2bb8100850 0x7f2bb819d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:20.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.694+0000 7f2bb5d9b640 1 -- 172.21.15.87:0/2496119181 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bb80feca0 msgr2=0x7f2bb8195e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:20.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.694+0000 7f2bb5d9b640 1 --2- 172.21.15.87:0/2496119181 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bb80feca0 0x7f2bb8195e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:20.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.694+0000 7f2bb5d9b640 1 -- 172.21.15.87:0/2496119181 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2bb8100850 msgr2=0x7f2bb819d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:20.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.694+0000 7f2bb5d9b640 1 --2- 172.21.15.87:0/2496119181 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2bb8100850 0x7f2bb819d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:20.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.694+0000 7f2bb5d9b640 1 -- 172.21.15.87:0/2496119181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb0009900 con 0x7f2bb80ffe90 2024-09-13T17:11:20.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.694+0000 7f2bb5d9b640 1 --2- 172.21.15.87:0/2496119181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bb80ffe90 0x7f2bb8196350 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000d770 tx=0x7f2ba000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:20.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.694+0000 7f2baf7fe640 1 -- 172.21.15.87:0/2496119181 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0009c30 con 0x7f2bb80ffe90 2024-09-13T17:11:20.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.694+0000 7f2bbca80640 1 -- 172.21.15.87:0/2496119181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb819dec0 con 0x7f2bb80ffe90 2024-09-13T17:11:20.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.694+0000 7f2baf7fe640 1 -- 172.21.15.87:0/2496119181 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2ba000de80 con 0x7f2bb80ffe90 2024-09-13T17:11:20.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.694+0000 7f2baf7fe640 1 -- 172.21.15.87:0/2496119181 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0004e00 con 0x7f2bb80ffe90 2024-09-13T17:11:20.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.694+0000 7f2bbca80640 1 -- 172.21.15.87:0/2496119181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb819e2f0 con 0x7f2bb80ffe90 2024-09-13T17:11:20.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.695+0000 7f2bbca80640 1 -- 172.21.15.87:0/2496119181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bb8106d60 con 0x7f2bb80ffe90 2024-09-13T17:11:20.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.696+0000 7f2baf7fe640 1 -- 172.21.15.87:0/2496119181 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2ba0004f60 con 0x7f2bb80ffe90 2024-09-13T17:11:20.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.697+0000 7f2baf7fe640 1 --2- 172.21.15.87:0/2496119181 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2ba40a1090 0x7f2ba40a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:20.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.697+0000 7f2bb659c640 1 --2- 172.21.15.87:0/2496119181 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2ba40a1090 0x7f2ba40a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:20.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.697+0000 7f2baf7fe640 1 -- 172.21.15.87:0/2496119181 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f2ba00cc1c0 con 0x7f2bb80ffe90 2024-09-13T17:11:20.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.698+0000 7f2bb659c640 1 --2- 172.21.15.87:0/2496119181 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2ba40a1090 0x7f2ba40a3550 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0006010 tx=0x7f2bb0031be0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:20.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.700+0000 7f2baf7fe640 1 -- 172.21.15.87:0/2496119181 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2ba0095ea0 con 0x7f2bb80ffe90 2024-09-13T17:11:20.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.868+0000 7f2bbca80640 1 -- 172.21.15.87:0/2496119181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2bb802c3e0 con 0x7f2bb80ffe90 2024-09-13T17:11:20.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.869+0000 7f2baf7fe640 1 -- 172.21.15.87:0/2496119181 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+18433 (secure 0 0 0) 0x7f2ba0020090 con 0x7f2bb80ffe90 2024-09-13T17:11:20.872 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:11:20.872 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":81,"fsid":"043d5bae-71f2-11ef-bceb-c7b262605968","created":"2024-09-13T17:03:57.852010+0000","modified":"2024-09-13T17:10:36.006538+0000","last_up_change":"2024-09-13T17:10:34.423548+0000","last_in_change":"2024-09-13T17:10:14.228123+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:07:02.286400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"58250283-85c0-416e-abdd-1fc5a7ff0c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6803","nonce":1316956138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6805","nonce":1316956138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6809","nonce":1316956138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6807","nonce":1316956138}]},"public_addr":"172.21.15.87:6803/1316956138","cluster_addr":"172.21.15.87:6805/1316956138","heartbeat_back_addr":"172.21.15.87:6809/1316956138","heartbeat_front_addr":"172.21.15.87:6807/1316956138","state":["exists","up"]},{"osd":1,"uuid":"b9d49969-94b1-4262-b4ff-db0a8e3331af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6801","nonce":3352566727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6803","nonce":3352566727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6807","nonce":3352566727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6805","nonce":3352566727}]},"public_addr":"172.21.15.118:6801/3352566727","cluster_addr":"172.21.15.118:6803/3352566727","heartbeat_back_addr":"172.21.15.118:6807/3352566727","heartbeat_front_addr":"172.21.15.118:6805/3352566727","state":["exists","up"]},{"osd":2,"uuid":"ba64549e-d736-426f-b466-f569af5f16d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6801","nonce":2774581686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6803","nonce":2774581686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6807","nonce":2774581686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6805","nonce":2774581686}]},"public_addr":"172.21.15.149:6801/2774581686","cluster_addr":"172.21.15.149:6803/2774581686","heartbeat_back_addr":"172.21.15.149:6807/2774581686","heartbeat_front_addr":"172.21.15.149:6805/2774581686","state":["exists","up"]},{"osd":3,"uuid":"3d5553e5-371b-49fd-976b-9e72a97a2f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6811","nonce":3306119066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6813","nonce":3306119066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6817","nonce":3306119066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6815","nonce":3306119066}]},"public_addr":"172.21.15.87:6811/3306119066","cluster_addr":"172.21.15.87:6813/3306119066","heartbeat_back_addr":"172.21.15.87:6817/3306119066","heartbeat_front_addr":"172.21.15.87:6815/3306119066","state":["exists","up"]},{"osd":4,"uuid":"2fbe0e27-34ec-42a6-9962-f1d8202b3159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6809","nonce":3342349890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6811","nonce":3342349890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6815","nonce":3342349890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6813","nonce":3342349890}]},"public_addr":"172.21.15.118:6809/3342349890","cluster_addr":"172.21.15.118:6811/3342349890","heartbeat_back_addr":"172.21.15.118:6815/3342349890","heartbeat_front_addr":"172.21.15.118:6813/3342349890","state":["exists","up"]},{"osd":5,"uuid":"53c14519-6170-4b5a-a79d-4835882d7bec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6809","nonce":3468867124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6811","nonce":3468867124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6815","nonce":3468867124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6813","nonce":3468867124}]},"public_addr":"172.21.15.149:6809/3468867124","cluster_addr":"172.21.15.149:6811/3468867124","heartbeat_back_addr":"172.21.15.149:6815/3468867124","heartbeat_front_addr":"172.21.15.149:6813/3468867124","state":["exists","up"]},{"osd":6,"uuid":"d3951b32-db77-4b8b-9de0-f05e03d13f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6819","nonce":326563617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6821","nonce":326563617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6825","nonce":326563617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6823","nonce":326563617}]},"public_addr":"172.21.15.87:6819/326563617","cluster_addr":"172.21.15.87:6821/326563617","heartbeat_back_addr":"172.21.15.87:6825/326563617","heartbeat_front_addr":"172.21.15.87:6823/326563617","state":["exists","up"]},{"osd":7,"uuid":"4d46dab7-a8bf-4e3e-b5c0-43860d336bdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6817","nonce":1690268990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6819","nonce":1690268990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6823","nonce":1690268990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6821","nonce":1690268990}]},"public_addr":"172.21.15.118:6817/1690268990","cluster_addr":"172.21.15.118:6819/1690268990","heartbeat_back_addr":"172.21.15.118:6823/1690268990","heartbeat_front_addr":"172.21.15.118:6821/1690268990","state":["exists","up"]},{"osd":8,"uuid":"5a015a7d-60a3-4412-96af-1b61d2ad51f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6817","nonce":1558675380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6819","nonce":1558675380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6823","nonce":1558675380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6821","nonce":1558675380}]},"public_addr":"172.21.15.149:6817/1558675380","cluster_addr":"172.21.15.149:6819/1558675380","heartbeat_back_addr":"172.21.15.149:6823/1558675380","heartbeat_front_addr":"172.21.15.149:6821/1558675380","state":["exists","up"]},{"osd":9,"uuid":"248c0b6e-4c4e-4c63-a0dd-e4cdf3b997a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6827","nonce":1453934262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6829","nonce":1453934262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6833","nonce":1453934262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6831","nonce":1453934262}]},"public_addr":"172.21.15.87:6827/1453934262","cluster_addr":"172.21.15.87:6829/1453934262","heartbeat_back_addr":"172.21.15.87:6833/1453934262","heartbeat_front_addr":"172.21.15.87:6831/1453934262","state":["exists","up"]},{"osd":10,"uuid":"24238714-e737-4371-b5d5-0cd3395f09bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6825","nonce":1034318850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6827","nonce":1034318850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6831","nonce":1034318850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6829","nonce":1034318850}]},"public_addr":"172.21.15.118:6825/1034318850","cluster_addr":"172.21.15.118:6827/1034318850","heartbeat_back_addr":"172.21.15.118:6831/1034318850","heartbeat_front_addr":"172.21.15.118:6829/1034318850","state":["exists","up"]},{"osd":11,"uuid":"409dd3bf-5154-4dea-8708-7de7f9e2e793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6825","nonce":271000465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6827","nonce":271000465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6831","nonce":271000465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6829","nonce":271000465}]},"public_addr":"172.21.15.149:6825/271000465","cluster_addr":"172.21.15.149:6827/271000465","heartbeat_back_addr":"172.21.15.149:6831/271000465","heartbeat_front_addr":"172.21.15.149:6829/271000465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:16.382664+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:37.914250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:00.425876+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:23.960183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:47.004088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:10.214345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:33.719221+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:57.099599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:20.971881+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:44.827167+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:08.135516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:32.085853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/586423689":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6801/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6800/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/3270371628":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/515676743":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/1475107314":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/553289143":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/3403361612":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6801/1587363880":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6800/1587363880":"2024-09-14T17:04:24.083789+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:11:20.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.871+0000 7f2bbca80640 1 -- 172.21.15.87:0/2496119181 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2ba40a1090 msgr2=0x7f2ba40a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:20.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.871+0000 7f2bbca80640 1 --2- 172.21.15.87:0/2496119181 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2ba40a1090 0x7f2ba40a3550 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0006010 tx=0x7f2bb0031be0 comp rx=0 tx=0).stop 2024-09-13T17:11:20.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.871+0000 7f2bbca80640 1 -- 172.21.15.87:0/2496119181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bb80ffe90 msgr2=0x7f2bb8196350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:20.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.871+0000 7f2bbca80640 1 --2- 172.21.15.87:0/2496119181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bb80ffe90 0x7f2bb8196350 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000d770 tx=0x7f2ba000dc30 comp rx=0 tx=0).stop 2024-09-13T17:11:20.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.871+0000 7f2bbca80640 1 -- 172.21.15.87:0/2496119181 shutdown_connections 2024-09-13T17:11:20.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.871+0000 7f2bbca80640 1 --2- 172.21.15.87:0/2496119181 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2ba40a1090 0x7f2ba40a3550 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:20.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.871+0000 7f2bbca80640 1 --2- 172.21.15.87:0/2496119181 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2bb8100850 0x7f2bb819d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:20.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.871+0000 7f2bbca80640 1 --2- 172.21.15.87:0/2496119181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bb80ffe90 0x7f2bb8196350 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:20.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.871+0000 7f2bbca80640 1 --2- 172.21.15.87:0/2496119181 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bb80feca0 0x7f2bb8195e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:20.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.871+0000 7f2bbca80640 1 -- 172.21.15.87:0/2496119181 >> 172.21.15.87:0/2496119181 conn(0x7f2bb80fa440 msgr2=0x7f2bb80fc5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:20.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.871+0000 7f2bbca80640 1 -- 172.21.15.87:0/2496119181 shutdown_connections 2024-09-13T17:11:20.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.871+0000 7f2bbca80640 1 -- 172.21.15.87:0/2496119181 wait complete. 2024-09-13T17:11:20.884 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:07:02.286400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:11:20.885 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:11:20.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.985+0000 7f30a877d640 1 -- 172.21.15.87:0/4058014265 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30a00fec70 msgr2=0x7f30a00ff070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:20.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.985+0000 7f30a877d640 1 --2- 172.21.15.87:0/4058014265 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30a00fec70 0x7f30a00ff070 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3098009900 tx=0x7f309802a410 comp rx=0 tx=0).stop 2024-09-13T17:11:20.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.985+0000 7f30a877d640 1 -- 172.21.15.87:0/4058014265 shutdown_connections 2024-09-13T17:11:20.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.985+0000 7f30a877d640 1 --2- 172.21.15.87:0/4058014265 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30a0100820 0x7f30a01070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:20.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.985+0000 7f30a877d640 1 --2- 172.21.15.87:0/4058014265 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30a00ffe60 0x7f30a01002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:20.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.985+0000 7f30a877d640 1 --2- 172.21.15.87:0/4058014265 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30a00fec70 0x7f30a00ff070 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:20.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.985+0000 7f30a877d640 1 -- 172.21.15.87:0/4058014265 >> 172.21.15.87:0/4058014265 conn(0x7f30a00fa3d0 msgr2=0x7f30a00fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:20.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.985+0000 7f30a877d640 1 -- 172.21.15.87:0/4058014265 shutdown_connections 2024-09-13T17:11:20.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.985+0000 7f30a877d640 1 -- 172.21.15.87:0/4058014265 wait complete. 2024-09-13T17:11:20.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.985+0000 7f30a877d640 1 Processor -- start 2024-09-13T17:11:20.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.985+0000 7f30a877d640 1 -- start start 2024-09-13T17:11:20.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.985+0000 7f30a877d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30a00fec70 0x7f30a00690e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:20.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.985+0000 7f30a877d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30a00ffe60 0x7f30a019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:20.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.985+0000 7f30a877d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30a0100820 0x7f30a019d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:20.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.985+0000 7f30a877d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a019d940 con 0x7f30a00fec70 2024-09-13T17:11:20.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.985+0000 7f30a877d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a019dab0 con 0x7f30a00ffe60 2024-09-13T17:11:20.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.985+0000 7f30a877d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a019dc70 con 0x7f30a0100820 2024-09-13T17:11:20.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.986+0000 7f30a6519640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30a00fec70 0x7f30a00690e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:20.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.986+0000 7f30a6519640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30a00fec70 0x7f30a00690e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57998/0 (socket says 172.21.15.87:57998) 2024-09-13T17:11:20.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.986+0000 7f30a6519640 1 -- 172.21.15.87:0/370106396 learned_addr learned my addr 172.21.15.87:0/370106396 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:20.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.986+0000 7f30a6d1a640 1 --2- 172.21.15.87:0/370106396 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30a0100820 0x7f30a019d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:20.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.986+0000 7f30a5d18640 1 --2- 172.21.15.87:0/370106396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30a00ffe60 0x7f30a019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:20.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.986+0000 7f30a6519640 1 -- 172.21.15.87:0/370106396 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30a0100820 msgr2=0x7f30a019d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:20.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.986+0000 7f30a6519640 1 --2- 172.21.15.87:0/370106396 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30a0100820 0x7f30a019d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:20.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.986+0000 7f30a6519640 1 -- 172.21.15.87:0/370106396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30a00ffe60 msgr2=0x7f30a019ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:20.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.986+0000 7f30a6519640 1 --2- 172.21.15.87:0/370106396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30a00ffe60 0x7f30a019ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:20.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.986+0000 7f30a6519640 1 -- 172.21.15.87:0/370106396 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3098009560 con 0x7f30a00fec70 2024-09-13T17:11:20.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.986+0000 7f30a6d1a640 1 --2- 172.21.15.87:0/370106396 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30a0100820 0x7f30a019d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:11:20.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.986+0000 7f30a6519640 1 --2- 172.21.15.87:0/370106396 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30a00fec70 0x7f30a00690e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3098031460 tx=0x7f30980042d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:20.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.986+0000 7f309f7fe640 1 -- 172.21.15.87:0/370106396 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30980044c0 con 0x7f30a00fec70 2024-09-13T17:11:20.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.986+0000 7f309f7fe640 1 -- 172.21.15.87:0/370106396 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3098003cb0 con 0x7f30a00fec70 2024-09-13T17:11:20.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.986+0000 7f30a877d640 1 -- 172.21.15.87:0/370106396 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a019de90 con 0x7f30a00fec70 2024-09-13T17:11:20.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.986+0000 7f309f7fe640 1 -- 172.21.15.87:0/370106396 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309803ce60 con 0x7f30a00fec70 2024-09-13T17:11:20.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.986+0000 7f30a877d640 1 -- 172.21.15.87:0/370106396 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a019e2b0 con 0x7f30a00fec70 2024-09-13T17:11:20.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.987+0000 7f30a877d640 1 -- 172.21.15.87:0/370106396 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30a0106140 con 0x7f30a00fec70 2024-09-13T17:11:20.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.989+0000 7f309f7fe640 1 -- 172.21.15.87:0/370106396 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f309803c600 con 0x7f30a00fec70 2024-09-13T17:11:20.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.990+0000 7f309f7fe640 1 --2- 172.21.15.87:0/370106396 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f30880a1090 0x7f30880a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:20.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.990+0000 7f30a5d18640 1 --2- 172.21.15.87:0/370106396 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f30880a1090 0x7f30880a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:20.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.990+0000 7f309f7fe640 1 -- 172.21.15.87:0/370106396 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f30980ed600 con 0x7f30a00fec70 2024-09-13T17:11:20.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.990+0000 7f30a5d18640 1 --2- 172.21.15.87:0/370106396 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f30880a1090 0x7f30880a3550 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3094005fd0 tx=0x7f3094005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:20.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:20.993+0000 7f309f7fe640 1 -- 172.21.15.87:0/370106396 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f30980b7230 con 0x7f30a00fec70 2024-09-13T17:11:21.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.155+0000 7f30a877d640 1 -- 172.21.15.87:0/370106396 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f30a010a7b0 con 0x7f30a00fec70 2024-09-13T17:11:21.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.156+0000 7f309f7fe640 1 -- 172.21.15.87:0/370106396 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f30980ba850 con 0x7f30a00fec70 2024-09-13T17:11:21.158 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-09-13T17:11:21.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.158+0000 7f30a877d640 1 -- 172.21.15.87:0/370106396 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f30880a1090 msgr2=0x7f30880a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:21.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.158+0000 7f30a877d640 1 --2- 172.21.15.87:0/370106396 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f30880a1090 0x7f30880a3550 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3094005fd0 tx=0x7f3094005850 comp rx=0 tx=0).stop 2024-09-13T17:11:21.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.158+0000 7f30a877d640 1 -- 172.21.15.87:0/370106396 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30a00fec70 msgr2=0x7f30a00690e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:21.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.158+0000 7f30a877d640 1 --2- 172.21.15.87:0/370106396 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30a00fec70 0x7f30a00690e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3098031460 tx=0x7f30980042d0 comp rx=0 tx=0).stop 2024-09-13T17:11:21.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.158+0000 7f30a877d640 1 -- 172.21.15.87:0/370106396 shutdown_connections 2024-09-13T17:11:21.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.158+0000 7f30a877d640 1 --2- 172.21.15.87:0/370106396 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f30880a1090 0x7f30880a3550 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:21.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.158+0000 7f30a877d640 1 --2- 172.21.15.87:0/370106396 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30a0100820 0x7f30a019d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:21.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.158+0000 7f30a877d640 1 --2- 172.21.15.87:0/370106396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30a00ffe60 0x7f30a019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:21.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.158+0000 7f30a877d640 1 --2- 172.21.15.87:0/370106396 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30a00fec70 0x7f30a00690e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:21.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.158+0000 7f30a877d640 1 -- 172.21.15.87:0/370106396 >> 172.21.15.87:0/370106396 conn(0x7f30a00fa3d0 msgr2=0x7f30a0103310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:21.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.158+0000 7f30a877d640 1 -- 172.21.15.87:0/370106396 shutdown_connections 2024-09-13T17:11:21.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.158+0000 7f30a877d640 1 -- 172.21.15.87:0/370106396 wait complete. 2024-09-13T17:11:21.169 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:20 smithi087 ceph-mon[30934]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:21.169 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:20 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:21.169 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:20 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:21.169 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:20 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3946789783' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:21.169 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:20 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:21.170 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:20 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:21.170 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:20 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:21.170 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:20 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:21.170 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:20 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:11:21.170 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:20 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:11:21.170 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:20 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:21.170 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:20 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2496119181' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:11:21.171 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T17:11:21.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.269+0000 7f2179b76640 1 -- 172.21.15.87:0/638308414 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21740feca0 msgr2=0x7f21740ff0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:21.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.269+0000 7f2179b76640 1 --2- 172.21.15.87:0/638308414 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21740feca0 0x7f21740ff0a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2164009900 tx=0x7f216402a410 comp rx=0 tx=0).stop 2024-09-13T17:11:21.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.269+0000 7f2179b76640 1 -- 172.21.15.87:0/638308414 shutdown_connections 2024-09-13T17:11:21.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.269+0000 7f2179b76640 1 --2- 172.21.15.87:0/638308414 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2174100850 0x7f21741070e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:21.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.269+0000 7f2179b76640 1 --2- 172.21.15.87:0/638308414 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21740ffe90 0x7f2174100310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:21.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.269+0000 7f2179b76640 1 --2- 172.21.15.87:0/638308414 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21740feca0 0x7f21740ff0a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:21.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.269+0000 7f2179b76640 1 -- 172.21.15.87:0/638308414 >> 172.21.15.87:0/638308414 conn(0x7f21740fa440 msgr2=0x7f21740fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:21.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.269+0000 7f2179b76640 1 -- 172.21.15.87:0/638308414 shutdown_connections 2024-09-13T17:11:21.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.269+0000 7f2179b76640 1 -- 172.21.15.87:0/638308414 wait complete. 2024-09-13T17:11:21.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.269+0000 7f2179b76640 1 Processor -- start 2024-09-13T17:11:21.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.269+0000 7f2179b76640 1 -- start start 2024-09-13T17:11:21.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.270+0000 7f2179b76640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21740feca0 0x7f2174068110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:21.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.270+0000 7f2179b76640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21740ffe90 0x7f217419aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:21.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.270+0000 7f2179b76640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2174100850 0x7f217419d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:21.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.270+0000 7f2179b76640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217419d8d0 con 0x7f21740ffe90 2024-09-13T17:11:21.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.270+0000 7f2179b76640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217419da40 con 0x7f2174100850 2024-09-13T17:11:21.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.270+0000 7f2179b76640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217419dc00 con 0x7f21740feca0 2024-09-13T17:11:21.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.270+0000 7f216bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21740ffe90 0x7f217419aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:21.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.270+0000 7f216bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21740ffe90 0x7f217419aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58016/0 (socket says 172.21.15.87:58016) 2024-09-13T17:11:21.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.270+0000 7f216bfff640 1 -- 172.21.15.87:0/2666736926 learned_addr learned my addr 172.21.15.87:0/2666736926 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:21.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.270+0000 7f2173fff640 1 --2- 172.21.15.87:0/2666736926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2174100850 0x7f217419d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:21.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.270+0000 7f21737fe640 1 --2- 172.21.15.87:0/2666736926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21740feca0 0x7f2174068110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:21.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.270+0000 7f216bfff640 1 -- 172.21.15.87:0/2666736926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21740feca0 msgr2=0x7f2174068110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:21.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.270+0000 7f216bfff640 1 --2- 172.21.15.87:0/2666736926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21740feca0 0x7f2174068110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:21.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.270+0000 7f216bfff640 1 -- 172.21.15.87:0/2666736926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2174100850 msgr2=0x7f217419d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:21.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.270+0000 7f216bfff640 1 --2- 172.21.15.87:0/2666736926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2174100850 0x7f217419d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:21.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.270+0000 7f216bfff640 1 -- 172.21.15.87:0/2666736926 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2164009560 con 0x7f21740ffe90 2024-09-13T17:11:21.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.270+0000 7f2173fff640 1 --2- 172.21.15.87:0/2666736926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2174100850 0x7f217419d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:11:21.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.270+0000 7f216bfff640 1 --2- 172.21.15.87:0/2666736926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21740ffe90 0x7f217419aad0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f215c00c890 tx=0x7f215c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:21.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.270+0000 7f21717fa640 1 -- 172.21.15.87:0/2666736926 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c004220 con 0x7f21740ffe90 2024-09-13T17:11:21.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.270+0000 7f2179b76640 1 -- 172.21.15.87:0/2666736926 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f217419de80 con 0x7f21740ffe90 2024-09-13T17:11:21.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.270+0000 7f21717fa640 1 -- 172.21.15.87:0/2666736926 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f215c007e60 con 0x7f21740ffe90 2024-09-13T17:11:21.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.270+0000 7f21717fa640 1 -- 172.21.15.87:0/2666736926 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c004a00 con 0x7f21740ffe90 2024-09-13T17:11:21.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.270+0000 7f2179b76640 1 -- 172.21.15.87:0/2666736926 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f217419e350 con 0x7f21740ffe90 2024-09-13T17:11:21.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.271+0000 7f2179b76640 1 -- 172.21.15.87:0/2666736926 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2174106170 con 0x7f21740ffe90 2024-09-13T17:11:21.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.272+0000 7f21717fa640 1 -- 172.21.15.87:0/2666736926 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f215c0079b0 con 0x7f21740ffe90 2024-09-13T17:11:21.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.273+0000 7f21717fa640 1 --2- 172.21.15.87:0/2666736926 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f21600a1090 0x7f21600a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:21.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.273+0000 7f21737fe640 1 --2- 172.21.15.87:0/2666736926 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f21600a1090 0x7f21600a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:21.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.273+0000 7f21717fa640 1 -- 172.21.15.87:0/2666736926 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f215c0cc560 con 0x7f21740ffe90 2024-09-13T17:11:21.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.273+0000 7f21737fe640 1 --2- 172.21.15.87:0/2666736926 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f21600a1090 0x7f21600a3550 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2164031460 tx=0x7f2164000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:21.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.276+0000 7f21717fa640 1 -- 172.21.15.87:0/2666736926 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f215c096190 con 0x7f21740ffe90 2024-09-13T17:11:21.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:20 smithi149 ceph-mon[35496]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:21.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:20 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:21.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:20 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:21.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:20 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3946789783' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:21.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:20 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:21.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:20 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:21.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:20 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:21.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:20 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:21.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:20 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:11:21.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:20 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:11:21.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:20 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:21.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:20 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2496119181' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:11:21.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:20 smithi118 ceph-mon[34374]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:21.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:20 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:21.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:20 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:21.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:20 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3946789783' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:21.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:20 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:21.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:20 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:21.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:20 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:21.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:20 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:21.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:20 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:11:21.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:20 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:11:21.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:20 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:11:21.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:20 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2496119181' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:11:21.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.441+0000 7f2179b76640 1 -- 172.21.15.87:0/2666736926 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f217410a590 con 0x7f21740ffe90 2024-09-13T17:11:21.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.441+0000 7f21717fa640 1 -- 172.21.15.87:0/2666736926 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v81) v1 ==== 84+0+65 (secure 0 0 0) 0x7f215c0997b0 con 0x7f21740ffe90 2024-09-13T17:11:21.444 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:11:21.444 INFO:teuthology.orchestra.run.smithi087.stdout:[ 2024-09-13T17:11:21.444 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:11:21.444 INFO:teuthology.orchestra.run.smithi087.stdout: "poolnum": 1, 2024-09-13T17:11:21.444 INFO:teuthology.orchestra.run.smithi087.stdout: "poolname": ".mgr" 2024-09-13T17:11:21.444 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:11:21.444 INFO:teuthology.orchestra.run.smithi087.stdout:] 2024-09-13T17:11:21.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.443+0000 7f2179b76640 1 -- 172.21.15.87:0/2666736926 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f21600a1090 msgr2=0x7f21600a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:21.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.443+0000 7f2179b76640 1 --2- 172.21.15.87:0/2666736926 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f21600a1090 0x7f21600a3550 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2164031460 tx=0x7f2164000bc0 comp rx=0 tx=0).stop 2024-09-13T17:11:21.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.443+0000 7f2179b76640 1 -- 172.21.15.87:0/2666736926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21740ffe90 msgr2=0x7f217419aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:21.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.443+0000 7f2179b76640 1 --2- 172.21.15.87:0/2666736926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21740ffe90 0x7f217419aad0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f215c00c890 tx=0x7f215c00cd50 comp rx=0 tx=0).stop 2024-09-13T17:11:21.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.444+0000 7f2179b76640 1 -- 172.21.15.87:0/2666736926 shutdown_connections 2024-09-13T17:11:21.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.444+0000 7f2179b76640 1 --2- 172.21.15.87:0/2666736926 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f21600a1090 0x7f21600a3550 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:21.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.444+0000 7f2179b76640 1 --2- 172.21.15.87:0/2666736926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2174100850 0x7f217419d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:21.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.444+0000 7f2179b76640 1 --2- 172.21.15.87:0/2666736926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21740ffe90 0x7f217419aad0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:21.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.444+0000 7f2179b76640 1 --2- 172.21.15.87:0/2666736926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21740feca0 0x7f2174068110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:21.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.444+0000 7f2179b76640 1 -- 172.21.15.87:0/2666736926 >> 172.21.15.87:0/2666736926 conn(0x7f21740fa440 msgr2=0x7f2174103340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:21.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.444+0000 7f2179b76640 1 -- 172.21.15.87:0/2666736926 shutdown_connections 2024-09-13T17:11:21.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.444+0000 7f2179b76640 1 -- 172.21.15.87:0/2666736926 wait complete. 2024-09-13T17:11:21.456 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T17:11:21.456 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T17:11:21.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.557+0000 7feb44711640 1 -- 172.21.15.87:0/3759548437 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb3c103130 msgr2=0x7feb3c105520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:21.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.557+0000 7feb44711640 1 --2- 172.21.15.87:0/3759548437 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb3c103130 0x7feb3c105520 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7feb2c009900 tx=0x7feb2c02a410 comp rx=0 tx=0).stop 2024-09-13T17:11:21.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.557+0000 7feb44711640 1 -- 172.21.15.87:0/3759548437 shutdown_connections 2024-09-13T17:11:21.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.557+0000 7feb44711640 1 --2- 172.21.15.87:0/3759548437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb3c105a60 0x7feb3c107ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:21.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.557+0000 7feb44711640 1 --2- 172.21.15.87:0/3759548437 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb3c103130 0x7feb3c105520 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:21.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.557+0000 7feb44711640 1 --2- 172.21.15.87:0/3759548437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb3c100800 0x7feb3c102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:21.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.557+0000 7feb44711640 1 -- 172.21.15.87:0/3759548437 >> 172.21.15.87:0/3759548437 conn(0x7feb3c0fa3e0 msgr2=0x7feb3c0fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:21.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.557+0000 7feb44711640 1 -- 172.21.15.87:0/3759548437 shutdown_connections 2024-09-13T17:11:21.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.557+0000 7feb44711640 1 -- 172.21.15.87:0/3759548437 wait complete. 2024-09-13T17:11:21.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.558+0000 7feb44711640 1 Processor -- start 2024-09-13T17:11:21.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.558+0000 7feb44711640 1 -- start start 2024-09-13T17:11:21.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.558+0000 7feb44711640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb3c100800 0x7feb3c195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:21.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.558+0000 7feb44711640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb3c103130 0x7feb3c1963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:21.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.558+0000 7feb44711640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb3c105a60 0x7feb3c19d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:21.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.558+0000 7feb44711640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c19d900 con 0x7feb3c105a60 2024-09-13T17:11:21.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.558+0000 7feb44711640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c19da70 con 0x7feb3c100800 2024-09-13T17:11:21.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.558+0000 7feb44711640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c19dc30 con 0x7feb3c103130 2024-09-13T17:11:21.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.558+0000 7feb42cae640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb3c105a60 0x7feb3c19d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:21.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.558+0000 7feb42cae640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb3c105a60 0x7feb3c19d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58042/0 (socket says 172.21.15.87:58042) 2024-09-13T17:11:21.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.558+0000 7feb42cae640 1 -- 172.21.15.87:0/1675901850 learned_addr learned my addr 172.21.15.87:0/1675901850 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:21.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.558+0000 7feb41cac640 1 --2- 172.21.15.87:0/1675901850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb3c103130 0x7feb3c1963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:21.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.558+0000 7feb424ad640 1 --2- 172.21.15.87:0/1675901850 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb3c100800 0x7feb3c195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:21.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.558+0000 7feb42cae640 1 -- 172.21.15.87:0/1675901850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb3c103130 msgr2=0x7feb3c1963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:21.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.558+0000 7feb42cae640 1 --2- 172.21.15.87:0/1675901850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb3c103130 0x7feb3c1963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:21.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.558+0000 7feb42cae640 1 -- 172.21.15.87:0/1675901850 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb3c100800 msgr2=0x7feb3c195e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:21.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.558+0000 7feb42cae640 1 --2- 172.21.15.87:0/1675901850 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb3c100800 0x7feb3c195e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:21.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.558+0000 7feb42cae640 1 -- 172.21.15.87:0/1675901850 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb2c009560 con 0x7feb3c105a60 2024-09-13T17:11:21.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.558+0000 7feb41cac640 1 --2- 172.21.15.87:0/1675901850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb3c103130 0x7feb3c1963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:11:21.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.558+0000 7feb424ad640 1 --2- 172.21.15.87:0/1675901850 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb3c100800 0x7feb3c195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:11:21.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.558+0000 7feb42cae640 1 --2- 172.21.15.87:0/1675901850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb3c105a60 0x7feb3c19d3c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7feb3400e9d0 tx=0x7feb3400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:21.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.558+0000 7feb337fe640 1 -- 172.21.15.87:0/1675901850 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3400cd80 con 0x7feb3c105a60 2024-09-13T17:11:21.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.558+0000 7feb337fe640 1 -- 172.21.15.87:0/1675901850 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7feb34005020 con 0x7feb3c105a60 2024-09-13T17:11:21.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.559+0000 7feb44711640 1 -- 172.21.15.87:0/1675901850 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb3c19df10 con 0x7feb3c105a60 2024-09-13T17:11:21.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.559+0000 7feb337fe640 1 -- 172.21.15.87:0/1675901850 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb340116d0 con 0x7feb3c105a60 2024-09-13T17:11:21.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.559+0000 7feb44711640 1 -- 172.21.15.87:0/1675901850 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb3c19e3e0 con 0x7feb3c105a60 2024-09-13T17:11:21.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.560+0000 7feb44711640 1 -- 172.21.15.87:0/1675901850 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb3c0fbed0 con 0x7feb3c105a60 2024-09-13T17:11:21.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.561+0000 7feb337fe640 1 -- 172.21.15.87:0/1675901850 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7feb34005190 con 0x7feb3c105a60 2024-09-13T17:11:21.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.561+0000 7feb337fe640 1 --2- 172.21.15.87:0/1675901850 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7feb280a1110 0x7feb280a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:21.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.562+0000 7feb424ad640 1 --2- 172.21.15.87:0/1675901850 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7feb280a1110 0x7feb280a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:21.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.562+0000 7feb337fe640 1 -- 172.21.15.87:0/1675901850 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7feb340cca30 con 0x7feb3c105a60 2024-09-13T17:11:21.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.562+0000 7feb424ad640 1 --2- 172.21.15.87:0/1675901850 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7feb280a1110 0x7feb280a35d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7feb380058c0 tx=0x7feb38005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:21.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.564+0000 7feb337fe640 1 -- 172.21.15.87:0/1675901850 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7feb340966e0 con 0x7feb3c105a60 2024-09-13T17:11:21.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.730+0000 7feb44711640 1 -- 172.21.15.87:0/1675901850 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7feb3c10b660 con 0x7feb3c105a60 2024-09-13T17:11:21.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.979+0000 7feb337fe640 1 -- 172.21.15.87:0/1675901850 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v82) v1 ==== 138+0+0 (secure 0 0 0) 0x7feb34099d00 con 0x7feb3c105a60 2024-09-13T17:11:21.981 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_metadata' created 2024-09-13T17:11:21.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.982+0000 7feb44711640 1 -- 172.21.15.87:0/1675901850 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7feb280a1110 msgr2=0x7feb280a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:21.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.982+0000 7feb44711640 1 --2- 172.21.15.87:0/1675901850 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7feb280a1110 0x7feb280a35d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7feb380058c0 tx=0x7feb38005ec0 comp rx=0 tx=0).stop 2024-09-13T17:11:21.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.982+0000 7feb44711640 1 -- 172.21.15.87:0/1675901850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb3c105a60 msgr2=0x7feb3c19d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:21.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.982+0000 7feb44711640 1 --2- 172.21.15.87:0/1675901850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb3c105a60 0x7feb3c19d3c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7feb3400e9d0 tx=0x7feb3400ee90 comp rx=0 tx=0).stop 2024-09-13T17:11:21.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.982+0000 7feb44711640 1 -- 172.21.15.87:0/1675901850 shutdown_connections 2024-09-13T17:11:21.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.982+0000 7feb44711640 1 --2- 172.21.15.87:0/1675901850 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7feb280a1110 0x7feb280a35d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:21.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.982+0000 7feb44711640 1 --2- 172.21.15.87:0/1675901850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb3c105a60 0x7feb3c19d3c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:21.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.982+0000 7feb44711640 1 --2- 172.21.15.87:0/1675901850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb3c103130 0x7feb3c1963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:21.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.982+0000 7feb44711640 1 --2- 172.21.15.87:0/1675901850 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb3c100800 0x7feb3c195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:21.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.982+0000 7feb44711640 1 -- 172.21.15.87:0/1675901850 >> 172.21.15.87:0/1675901850 conn(0x7feb3c0fa3e0 msgr2=0x7feb3c101120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:21.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.982+0000 7feb44711640 1 -- 172.21.15.87:0/1675901850 shutdown_connections 2024-09-13T17:11:21.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:21.983+0000 7feb44711640 1 -- 172.21.15.87:0/1675901850 wait complete. 2024-09-13T17:11:21.996 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-13T17:11:22.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.100+0000 7f43636a6640 1 -- 172.21.15.87:0/3249807719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f435c0fec70 msgr2=0x7f435c0ff070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:22.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.100+0000 7f43636a6640 1 --2- 172.21.15.87:0/3249807719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f435c0fec70 0x7f435c0ff070 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4358009900 tx=0x7f435802a410 comp rx=0 tx=0).stop 2024-09-13T17:11:22.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.100+0000 7f43636a6640 1 -- 172.21.15.87:0/3249807719 shutdown_connections 2024-09-13T17:11:22.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.100+0000 7f43636a6640 1 --2- 172.21.15.87:0/3249807719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f435c100820 0x7f435c1070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:22.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.100+0000 7f43636a6640 1 --2- 172.21.15.87:0/3249807719 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f435c0ffe60 0x7f435c1002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:22.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.100+0000 7f43636a6640 1 --2- 172.21.15.87:0/3249807719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f435c0fec70 0x7f435c0ff070 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:22.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.100+0000 7f43636a6640 1 -- 172.21.15.87:0/3249807719 >> 172.21.15.87:0/3249807719 conn(0x7f435c0fa3d0 msgr2=0x7f435c0fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:22.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.100+0000 7f43636a6640 1 -- 172.21.15.87:0/3249807719 shutdown_connections 2024-09-13T17:11:22.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.100+0000 7f43636a6640 1 -- 172.21.15.87:0/3249807719 wait complete. 2024-09-13T17:11:22.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.101+0000 7f43636a6640 1 Processor -- start 2024-09-13T17:11:22.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.101+0000 7f43636a6640 1 -- start start 2024-09-13T17:11:22.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.101+0000 7f43636a6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f435c0fec70 0x7f435c197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:22.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.101+0000 7f43636a6640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f435c0ffe60 0x7f435c1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:22.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.101+0000 7f43636a6640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f435c100820 0x7f435c19f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:22.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.101+0000 7f43636a6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435c19fa90 con 0x7f435c0fec70 2024-09-13T17:11:22.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.101+0000 7f43636a6640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435c19fc00 con 0x7f435c0ffe60 2024-09-13T17:11:22.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.101+0000 7f43636a6640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435c19fdc0 con 0x7f435c100820 2024-09-13T17:11:22.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.101+0000 7f4361442640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f435c0fec70 0x7f435c197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:22.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.101+0000 7f4361442640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f435c0fec70 0x7f435c197fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58062/0 (socket says 172.21.15.87:58062) 2024-09-13T17:11:22.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.101+0000 7f4361442640 1 -- 172.21.15.87:0/687377387 learned_addr learned my addr 172.21.15.87:0/687377387 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:22.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.101+0000 7f4360c41640 1 --2- 172.21.15.87:0/687377387 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f435c0ffe60 0x7f435c1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:22.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.101+0000 7f4361442640 1 -- 172.21.15.87:0/687377387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f435c100820 msgr2=0x7f435c19f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:22.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.101+0000 7f4361442640 1 --2- 172.21.15.87:0/687377387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f435c100820 0x7f435c19f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:22.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.101+0000 7f4361442640 1 -- 172.21.15.87:0/687377387 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f435c0ffe60 msgr2=0x7f435c1984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:22.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.101+0000 7f4361442640 1 --2- 172.21.15.87:0/687377387 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f435c0ffe60 0x7f435c1984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:22.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.101+0000 7f4361442640 1 -- 172.21.15.87:0/687377387 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4358009560 con 0x7f435c0fec70 2024-09-13T17:11:22.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.101+0000 7f4361442640 1 --2- 172.21.15.87:0/687377387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f435c0fec70 0x7f435c197fa0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4358031460 tx=0x7f4358004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:22.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.101+0000 7f43527fc640 1 -- 172.21.15.87:0/687377387 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4358003800 con 0x7f435c0fec70 2024-09-13T17:11:22.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.101+0000 7f43527fc640 1 -- 172.21.15.87:0/687377387 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4358003e10 con 0x7f435c0fec70 2024-09-13T17:11:22.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.101+0000 7f43636a6640 1 -- 172.21.15.87:0/687377387 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f435c1a0040 con 0x7f435c0fec70 2024-09-13T17:11:22.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.101+0000 7f43527fc640 1 -- 172.21.15.87:0/687377387 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435803b3d0 con 0x7f435c0fec70 2024-09-13T17:11:22.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.102+0000 7f43636a6640 1 -- 172.21.15.87:0/687377387 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f435c1a0540 con 0x7f435c0fec70 2024-09-13T17:11:22.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.102+0000 7f43636a6640 1 -- 172.21.15.87:0/687377387 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f435c10a560 con 0x7f435c0fec70 2024-09-13T17:11:22.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.103+0000 7f43527fc640 1 -- 172.21.15.87:0/687377387 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f435803c470 con 0x7f435c0fec70 2024-09-13T17:11:22.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.104+0000 7f43527fc640 1 --2- 172.21.15.87:0/687377387 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f43480a1110 0x7f43480a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:22.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.104+0000 7f4360c41640 1 --2- 172.21.15.87:0/687377387 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f43480a1110 0x7f43480a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:22.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.104+0000 7f43527fc640 1 -- 172.21.15.87:0/687377387 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7497+0+0 (secure 0 0 0) 0x7f43580ed840 con 0x7f435c0fec70 2024-09-13T17:11:22.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.105+0000 7f4360c41640 1 --2- 172.21.15.87:0/687377387 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f43480a1110 0x7f43480a35d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f434c005fd0 tx=0x7f434c005e20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:22.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.107+0000 7f43527fc640 1 -- 172.21.15.87:0/687377387 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f43580b7300 con 0x7f435c0fec70 2024-09-13T17:11:22.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:21 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/370106396' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:11:22.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:21 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2666736926' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-13T17:11:22.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:21 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1675901850' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-13T17:11:22.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.270+0000 7f43636a6640 1 -- 172.21.15.87:0/687377387 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f435c10a7a0 con 0x7f435c0fec70 2024-09-13T17:11:22.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:21 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/370106396' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:11:22.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:21 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2666736926' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-13T17:11:22.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:21 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1675901850' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-13T17:11:22.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:21 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/370106396' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:11:22.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:21 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2666736926' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-13T17:11:22.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:21 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1675901850' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-13T17:11:22.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.983+0000 7f43527fc640 1 -- 172.21.15.87:0/687377387 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v83) v1 ==== 171+0+0 (secure 0 0 0) 0x7f43580ba920 con 0x7f435c0fec70 2024-09-13T17:11:22.985 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_data' created 2024-09-13T17:11:22.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.986+0000 7f43636a6640 1 -- 172.21.15.87:0/687377387 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f43480a1110 msgr2=0x7f43480a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:22.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.986+0000 7f43636a6640 1 --2- 172.21.15.87:0/687377387 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f43480a1110 0x7f43480a35d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f434c005fd0 tx=0x7f434c005e20 comp rx=0 tx=0).stop 2024-09-13T17:11:22.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.986+0000 7f43636a6640 1 -- 172.21.15.87:0/687377387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f435c0fec70 msgr2=0x7f435c197fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:22.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.986+0000 7f43636a6640 1 --2- 172.21.15.87:0/687377387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f435c0fec70 0x7f435c197fa0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4358031460 tx=0x7f4358004430 comp rx=0 tx=0).stop 2024-09-13T17:11:22.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.987+0000 7f43636a6640 1 -- 172.21.15.87:0/687377387 shutdown_connections 2024-09-13T17:11:22.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.987+0000 7f43636a6640 1 --2- 172.21.15.87:0/687377387 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f43480a1110 0x7f43480a35d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:22.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.987+0000 7f43636a6640 1 --2- 172.21.15.87:0/687377387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f435c100820 0x7f435c19f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:22.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.987+0000 7f43636a6640 1 --2- 172.21.15.87:0/687377387 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f435c0ffe60 0x7f435c1984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:22.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.987+0000 7f43636a6640 1 --2- 172.21.15.87:0/687377387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f435c0fec70 0x7f435c197fa0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:22.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.987+0000 7f43636a6640 1 -- 172.21.15.87:0/687377387 >> 172.21.15.87:0/687377387 conn(0x7f435c0fa3d0 msgr2=0x7f435c068570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:22.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.987+0000 7f43636a6640 1 -- 172.21.15.87:0/687377387 shutdown_connections 2024-09-13T17:11:22.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:22.987+0000 7f43636a6640 1 -- 172.21.15.87:0/687377387 wait complete. 2024-09-13T17:11:23.007 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T17:11:23.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.106+0000 7fd83cce9640 1 -- 172.21.15.87:0/518229253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8380ffe70 msgr2=0x7fd8381002f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:23.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.106+0000 7fd83cce9640 1 --2- 172.21.15.87:0/518229253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8380ffe70 0x7fd8381002f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd82c009900 tx=0x7fd82c02a410 comp rx=0 tx=0).stop 2024-09-13T17:11:23.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.106+0000 7fd83cce9640 1 -- 172.21.15.87:0/518229253 shutdown_connections 2024-09-13T17:11:23.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.106+0000 7fd83cce9640 1 --2- 172.21.15.87:0/518229253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd838100830 0x7fd8381070c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:23.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.106+0000 7fd83cce9640 1 --2- 172.21.15.87:0/518229253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8380ffe70 0x7fd8381002f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:23.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.106+0000 7fd83cce9640 1 --2- 172.21.15.87:0/518229253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8380fec80 0x7fd8380ff080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:23.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.106+0000 7fd83cce9640 1 -- 172.21.15.87:0/518229253 >> 172.21.15.87:0/518229253 conn(0x7fd8380fa3e0 msgr2=0x7fd8380fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:23.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.106+0000 7fd83cce9640 1 -- 172.21.15.87:0/518229253 shutdown_connections 2024-09-13T17:11:23.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.106+0000 7fd83cce9640 1 -- 172.21.15.87:0/518229253 wait complete. 2024-09-13T17:11:23.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.107+0000 7fd83cce9640 1 Processor -- start 2024-09-13T17:11:23.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.107+0000 7fd83cce9640 1 -- start start 2024-09-13T17:11:23.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.107+0000 7fd83cce9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8380fec80 0x7fd838109400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:23.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.107+0000 7fd83cce9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8380ffe70 0x7fd838107a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:23.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.107+0000 7fd83cce9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd838100830 0x7fd838107f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:23.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.107+0000 7fd83cce9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8381086e0 con 0x7fd8380ffe70 2024-09-13T17:11:23.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.107+0000 7fd83cce9640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd838108850 con 0x7fd8380fec80 2024-09-13T17:11:23.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.107+0000 7fd83cce9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83819fee0 con 0x7fd838100830 2024-09-13T17:11:23.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.107+0000 7fd835d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8380ffe70 0x7fd838107a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:23.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.107+0000 7fd835d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8380ffe70 0x7fd838107a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58074/0 (socket says 172.21.15.87:58074) 2024-09-13T17:11:23.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.107+0000 7fd835d9b640 1 -- 172.21.15.87:0/1302540102 learned_addr learned my addr 172.21.15.87:0/1302540102 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:23.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.107+0000 7fd83659c640 1 --2- 172.21.15.87:0/1302540102 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8380fec80 0x7fd838109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:23.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.107+0000 7fd836d9d640 1 --2- 172.21.15.87:0/1302540102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd838100830 0x7fd838107f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:23.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.107+0000 7fd835d9b640 1 -- 172.21.15.87:0/1302540102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd838100830 msgr2=0x7fd838107f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:23.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.107+0000 7fd835d9b640 1 --2- 172.21.15.87:0/1302540102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd838100830 0x7fd838107f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:23.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.107+0000 7fd835d9b640 1 -- 172.21.15.87:0/1302540102 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8380fec80 msgr2=0x7fd838109400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:23.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.107+0000 7fd835d9b640 1 --2- 172.21.15.87:0/1302540102 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8380fec80 0x7fd838109400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:23.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.107+0000 7fd835d9b640 1 -- 172.21.15.87:0/1302540102 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c009560 con 0x7fd8380ffe70 2024-09-13T17:11:23.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.107+0000 7fd83659c640 1 --2- 172.21.15.87:0/1302540102 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8380fec80 0x7fd838109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:11:23.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.108+0000 7fd835d9b640 1 --2- 172.21.15.87:0/1302540102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8380ffe70 0x7fd838107a40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd82c0056f0 tx=0x7fd82c004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:23.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.108+0000 7fd8277fe640 1 -- 172.21.15.87:0/1302540102 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c003a00 con 0x7fd8380ffe70 2024-09-13T17:11:23.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.108+0000 7fd83cce9640 1 -- 172.21.15.87:0/1302540102 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8381a0130 con 0x7fd8380ffe70 2024-09-13T17:11:23.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.108+0000 7fd8277fe640 1 -- 172.21.15.87:0/1302540102 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd82c03b460 con 0x7fd8380ffe70 2024-09-13T17:11:23.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.108+0000 7fd8277fe640 1 -- 172.21.15.87:0/1302540102 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c03a620 con 0x7fd8380ffe70 2024-09-13T17:11:23.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.108+0000 7fd83cce9640 1 -- 172.21.15.87:0/1302540102 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8381a05e0 con 0x7fd8380ffe70 2024-09-13T17:11:23.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.109+0000 7fd83cce9640 1 -- 172.21.15.87:0/1302540102 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8381061a0 con 0x7fd8380ffe70 2024-09-13T17:11:23.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.110+0000 7fd8277fe640 1 -- 172.21.15.87:0/1302540102 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd82c03b5d0 con 0x7fd8380ffe70 2024-09-13T17:11:23.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.111+0000 7fd8277fe640 1 --2- 172.21.15.87:0/1302540102 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd8200a1090 0x7fd8200a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:23.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.111+0000 7fd83659c640 1 --2- 172.21.15.87:0/1302540102 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd8200a1090 0x7fd8200a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:23.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.111+0000 7fd8277fe640 1 -- 172.21.15.87:0/1302540102 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7879+0+0 (secure 0 0 0) 0x7fd82c0edb50 con 0x7fd8380ffe70 2024-09-13T17:11:23.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.111+0000 7fd83659c640 1 --2- 172.21.15.87:0/1302540102 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd8200a1090 0x7fd8200a3550 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd8380ffcd0 tx=0x7fd828008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:23.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.114+0000 7fd8277fe640 1 -- 172.21.15.87:0/1302540102 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd82c0b7490 con 0x7fd8380ffe70 2024-09-13T17:11:23.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.311+0000 7fd83cce9640 1 -- 172.21.15.87:0/1302540102 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd83810b900 con 0x7fd8380ffe70 2024-09-13T17:11:23.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.319+0000 7fd8277fe640 1 -- 172.21.15.87:0/1302540102 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd82c0410c0 con 0x7fd8380ffe70 2024-09-13T17:11:23.321 INFO:teuthology.orchestra.run.smithi087.stderr:new fs with metadata pool 2 and data pool 3 2024-09-13T17:11:23.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.325+0000 7fd83cce9640 1 -- 172.21.15.87:0/1302540102 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd8200a1090 msgr2=0x7fd8200a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:23.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.325+0000 7fd83cce9640 1 --2- 172.21.15.87:0/1302540102 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd8200a1090 0x7fd8200a3550 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd8380ffcd0 tx=0x7fd828008040 comp rx=0 tx=0).stop 2024-09-13T17:11:23.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.325+0000 7fd83cce9640 1 -- 172.21.15.87:0/1302540102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8380ffe70 msgr2=0x7fd838107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:23.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.325+0000 7fd83cce9640 1 --2- 172.21.15.87:0/1302540102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8380ffe70 0x7fd838107a40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd82c0056f0 tx=0x7fd82c004360 comp rx=0 tx=0).stop 2024-09-13T17:11:23.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.328+0000 7fd83cce9640 1 -- 172.21.15.87:0/1302540102 shutdown_connections 2024-09-13T17:11:23.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.328+0000 7fd83cce9640 1 --2- 172.21.15.87:0/1302540102 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd8200a1090 0x7fd8200a3550 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:23.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.328+0000 7fd83cce9640 1 --2- 172.21.15.87:0/1302540102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd838100830 0x7fd838107f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:23.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.328+0000 7fd83cce9640 1 --2- 172.21.15.87:0/1302540102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8380ffe70 0x7fd838107a40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:23.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.328+0000 7fd83cce9640 1 --2- 172.21.15.87:0/1302540102 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8380fec80 0x7fd838109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:23.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.328+0000 7fd83cce9640 1 -- 172.21.15.87:0/1302540102 >> 172.21.15.87:0/1302540102 conn(0x7fd8380fa3e0 msgr2=0x7fd838103370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:23.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.328+0000 7fd83cce9640 1 -- 172.21.15.87:0/1302540102 shutdown_connections 2024-09-13T17:11:23.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.328+0000 7fd83cce9640 1 -- 172.21.15.87:0/1302540102 wait complete. 2024-09-13T17:11:23.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:22 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1675901850' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-13T17:11:23.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:22 smithi149 ceph-mon[35496]: osdmap e82: 12 total, 12 up, 12 in 2024-09-13T17:11:23.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:22 smithi149 ceph-mon[35496]: pgmap v269: 33 pgs: 5 creating+peering, 27 unknown, 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:23.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:22 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/687377387' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-13T17:11:23.348 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:22 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1675901850' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-13T17:11:23.348 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:22 smithi087 ceph-mon[30934]: osdmap e82: 12 total, 12 up, 12 in 2024-09-13T17:11:23.348 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:22 smithi087 ceph-mon[30934]: pgmap v269: 33 pgs: 5 creating+peering, 27 unknown, 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:23.348 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:22 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/687377387' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-13T17:11:23.349 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-13T17:11:23.349 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-13T17:11:23.362 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:22 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1675901850' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-13T17:11:23.362 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:22 smithi118 ceph-mon[34374]: osdmap e82: 12 total, 12 up, 12 in 2024-09-13T17:11:23.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:22 smithi118 ceph-mon[34374]: pgmap v269: 33 pgs: 5 creating+peering, 27 unknown, 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:11:23.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:22 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/687377387' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-13T17:11:23.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.450+0000 7f7877133640 1 -- 172.21.15.87:0/2234090218 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7870103130 msgr2=0x7f7870105520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:23.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.450+0000 7f7877133640 1 --2- 172.21.15.87:0/2234090218 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7870103130 0x7f7870105520 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7860009900 tx=0x7f786002a410 comp rx=0 tx=0).stop 2024-09-13T17:11:23.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.450+0000 7f7877133640 1 -- 172.21.15.87:0/2234090218 shutdown_connections 2024-09-13T17:11:23.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.450+0000 7f7877133640 1 --2- 172.21.15.87:0/2234090218 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7870105a60 0x7f7870107ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:23.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.450+0000 7f7877133640 1 --2- 172.21.15.87:0/2234090218 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7870103130 0x7f7870105520 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:23.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.450+0000 7f7877133640 1 --2- 172.21.15.87:0/2234090218 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7870100800 0x7f7870102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:23.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.450+0000 7f7877133640 1 -- 172.21.15.87:0/2234090218 >> 172.21.15.87:0/2234090218 conn(0x7f78700fa3e0 msgr2=0x7f78700fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:23.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.450+0000 7f7877133640 1 -- 172.21.15.87:0/2234090218 shutdown_connections 2024-09-13T17:11:23.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.450+0000 7f7877133640 1 -- 172.21.15.87:0/2234090218 wait complete. 2024-09-13T17:11:23.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.451+0000 7f7877133640 1 Processor -- start 2024-09-13T17:11:23.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.451+0000 7f7877133640 1 -- start start 2024-09-13T17:11:23.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.451+0000 7f7877133640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7870100800 0x7f7870195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:23.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.451+0000 7f7877133640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7870103130 0x7f78701963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:23.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.451+0000 7f7877133640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7870105a60 0x7f787019d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:23.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.451+0000 7f7877133640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787019d950 con 0x7f7870100800 2024-09-13T17:11:23.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.451+0000 7f7877133640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787019dac0 con 0x7f7870103130 2024-09-13T17:11:23.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.451+0000 7f7877133640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787019dc80 con 0x7f7870105a60 2024-09-13T17:11:23.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.451+0000 7f7874ecf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7870100800 0x7f7870195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:23.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.451+0000 7f7874ecf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7870100800 0x7f7870195e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58090/0 (socket says 172.21.15.87:58090) 2024-09-13T17:11:23.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.451+0000 7f7874ecf640 1 -- 172.21.15.87:0/3397109393 learned_addr learned my addr 172.21.15.87:0/3397109393 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:23.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.451+0000 7f7874ecf640 1 -- 172.21.15.87:0/3397109393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7870105a60 msgr2=0x7f787019d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:23.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.451+0000 7f7874ecf640 1 --2- 172.21.15.87:0/3397109393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7870105a60 0x7f787019d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:23.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.451+0000 7f7874ecf640 1 -- 172.21.15.87:0/3397109393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7870103130 msgr2=0x7f78701963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:23.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.451+0000 7f7874ecf640 1 --2- 172.21.15.87:0/3397109393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7870103130 0x7f78701963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:23.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.451+0000 7f7874ecf640 1 -- 172.21.15.87:0/3397109393 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7860009560 con 0x7f7870100800 2024-09-13T17:11:23.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.452+0000 7f7874ecf640 1 --2- 172.21.15.87:0/3397109393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7870100800 0x7f7870195e60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f786c00d950 tx=0x7f786c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:23.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.452+0000 7f7865ffb640 1 -- 172.21.15.87:0/3397109393 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c009c30 con 0x7f7870100800 2024-09-13T17:11:23.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.452+0000 7f7865ffb640 1 -- 172.21.15.87:0/3397109393 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f786c009d90 con 0x7f7870100800 2024-09-13T17:11:23.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.452+0000 7f7877133640 1 -- 172.21.15.87:0/3397109393 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f787019df60 con 0x7f7870100800 2024-09-13T17:11:23.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.452+0000 7f7865ffb640 1 -- 172.21.15.87:0/3397109393 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c00f6b0 con 0x7f7870100800 2024-09-13T17:11:23.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.452+0000 7f7877133640 1 -- 172.21.15.87:0/3397109393 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f787019e430 con 0x7f7870100800 2024-09-13T17:11:23.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.453+0000 7f7877133640 1 -- 172.21.15.87:0/3397109393 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7870103510 con 0x7f7870100800 2024-09-13T17:11:23.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.454+0000 7f7865ffb640 1 -- 172.21.15.87:0/3397109393 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f786c010aa0 con 0x7f7870100800 2024-09-13T17:11:23.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.454+0000 7f7865ffb640 1 --2- 172.21.15.87:0/3397109393 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f78580a1110 0x7f78580a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:23.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.455+0000 7f7867fff640 1 --2- 172.21.15.87:0/3397109393 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f78580a1110 0x7f78580a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:23.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.455+0000 7f7865ffb640 1 -- 172.21.15.87:0/3397109393 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f786c0cc490 con 0x7f7870100800 2024-09-13T17:11:23.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.455+0000 7f7867fff640 1 --2- 172.21.15.87:0/3397109393 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f78580a1110 0x7f78580a35d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f786002a930 tx=0x7f7860000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:23.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.459+0000 7f7865ffb640 1 -- 172.21.15.87:0/3397109393 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f786c095d70 con 0x7f7870100800 2024-09-13T17:11:23.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:23.628+0000 7f7877133640 1 -- 172.21.15.87:0/3397109393 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f78700fbed0 con 0x7f7870100800 2024-09-13T17:11:24.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.327+0000 7f7865ffb640 1 -- 172.21.15.87:0/3397109393 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v85) v1 ==== 157+0+0 (secure 0 0 0) 0x7f786c099390 con 0x7f7870100800 2024-09-13T17:11:24.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.330+0000 7f7877133640 1 -- 172.21.15.87:0/3397109393 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f78580a1110 msgr2=0x7f78580a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:24.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.330+0000 7f7877133640 1 --2- 172.21.15.87:0/3397109393 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f78580a1110 0x7f78580a35d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f786002a930 tx=0x7f7860000bc0 comp rx=0 tx=0).stop 2024-09-13T17:11:24.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.330+0000 7f7877133640 1 -- 172.21.15.87:0/3397109393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7870100800 msgr2=0x7f7870195e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:24.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.330+0000 7f7877133640 1 --2- 172.21.15.87:0/3397109393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7870100800 0x7f7870195e60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f786c00d950 tx=0x7f786c00de10 comp rx=0 tx=0).stop 2024-09-13T17:11:24.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.330+0000 7f7877133640 1 -- 172.21.15.87:0/3397109393 shutdown_connections 2024-09-13T17:11:24.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.330+0000 7f7877133640 1 --2- 172.21.15.87:0/3397109393 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f78580a1110 0x7f78580a35d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:24.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.330+0000 7f7877133640 1 --2- 172.21.15.87:0/3397109393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7870105a60 0x7f787019d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:24.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.330+0000 7f7877133640 1 --2- 172.21.15.87:0/3397109393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7870103130 0x7f78701963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:24.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.330+0000 7f7877133640 1 --2- 172.21.15.87:0/3397109393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7870100800 0x7f7870195e60 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:24.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.330+0000 7f7877133640 1 -- 172.21.15.87:0/3397109393 >> 172.21.15.87:0/3397109393 conn(0x7f78700fa3e0 msgr2=0x7f7870101140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:24.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.330+0000 7f7877133640 1 -- 172.21.15.87:0/3397109393 shutdown_connections 2024-09-13T17:11:24.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.330+0000 7f7877133640 1 -- 172.21.15.87:0/3397109393 wait complete. 2024-09-13T17:11:24.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:23 smithi149 ceph-mon[35496]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T17:11:24.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:23 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/687377387' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-13T17:11:24.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:23 smithi149 ceph-mon[35496]: osdmap e83: 12 total, 12 up, 12 in 2024-09-13T17:11:24.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:23 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1302540102' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-13T17:11:24.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:23 smithi149 ceph-mon[35496]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-13T17:11:24.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:23 smithi149 ceph-mon[35496]: osdmap e84: 12 total, 12 up, 12 in 2024-09-13T17:11:24.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:23 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1302540102' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-13T17:11:24.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:23 smithi149 ceph-mon[35496]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-13T17:11:24.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:23 smithi149 ceph-mon[35496]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-13T17:11:24.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:23 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3397109393' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-13T17:11:24.343 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:23 smithi087 ceph-mon[30934]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T17:11:24.343 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:23 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/687377387' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-13T17:11:24.343 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:23 smithi087 ceph-mon[30934]: osdmap e83: 12 total, 12 up, 12 in 2024-09-13T17:11:24.343 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:23 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1302540102' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-13T17:11:24.343 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:23 smithi087 ceph-mon[30934]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-13T17:11:24.343 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:23 smithi087 ceph-mon[30934]: osdmap e84: 12 total, 12 up, 12 in 2024-09-13T17:11:24.344 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:23 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1302540102' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-13T17:11:24.344 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:23 smithi087 ceph-mon[30934]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-13T17:11:24.344 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:23 smithi087 ceph-mon[30934]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-13T17:11:24.344 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:23 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3397109393' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-13T17:11:24.345 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T17:11:24.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:23 smithi118 ceph-mon[34374]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T17:11:24.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:23 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/687377387' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-13T17:11:24.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:23 smithi118 ceph-mon[34374]: osdmap e83: 12 total, 12 up, 12 in 2024-09-13T17:11:24.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:23 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1302540102' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-13T17:11:24.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:23 smithi118 ceph-mon[34374]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-13T17:11:24.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:23 smithi118 ceph-mon[34374]: osdmap e84: 12 total, 12 up, 12 in 2024-09-13T17:11:24.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:23 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1302540102' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-13T17:11:24.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:23 smithi118 ceph-mon[34374]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-13T17:11:24.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:23 smithi118 ceph-mon[34374]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-13T17:11:24.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:23 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3397109393' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-13T17:11:24.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.451+0000 7f56303ae640 1 -- 172.21.15.87:0/456788515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56280fe7d0 msgr2=0x7f5628108380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:24.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.451+0000 7f56303ae640 1 --2- 172.21.15.87:0/456788515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56280fe7d0 0x7f5628108380 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5620009ca0 tx=0x7f562002a8c0 comp rx=0 tx=0).stop 2024-09-13T17:11:24.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.451+0000 7f56303ae640 1 -- 172.21.15.87:0/456788515 shutdown_connections 2024-09-13T17:11:24.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.451+0000 7f56303ae640 1 --2- 172.21.15.87:0/456788515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56280fe7d0 0x7f5628108380 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:24.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.451+0000 7f56303ae640 1 --2- 172.21.15.87:0/456788515 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56280fde10 0x7f56280fe290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:24.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.451+0000 7f56303ae640 1 --2- 172.21.15.87:0/456788515 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56281013a0 0x7f56281017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:24.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.451+0000 7f56303ae640 1 -- 172.21.15.87:0/456788515 >> 172.21.15.87:0/456788515 conn(0x7f56280f9bc0 msgr2=0x7f56280fbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:24.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.451+0000 7f56303ae640 1 -- 172.21.15.87:0/456788515 shutdown_connections 2024-09-13T17:11:24.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.451+0000 7f56303ae640 1 -- 172.21.15.87:0/456788515 wait complete. 2024-09-13T17:11:24.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.452+0000 7f56303ae640 1 Processor -- start 2024-09-13T17:11:24.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.452+0000 7f56303ae640 1 -- start start 2024-09-13T17:11:24.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.452+0000 7f56303ae640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56280fde10 0x7f5628195d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:24.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.452+0000 7f56303ae640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56280fe7d0 0x7f5628196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:24.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.452+0000 7f56303ae640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56281013a0 0x7f562819d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:24.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.452+0000 7f56303ae640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562819d830 con 0x7f56280fe7d0 2024-09-13T17:11:24.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.452+0000 7f56303ae640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562819d9a0 con 0x7f56281013a0 2024-09-13T17:11:24.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.452+0000 7f56303ae640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562819db60 con 0x7f56280fde10 2024-09-13T17:11:24.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.452+0000 7f562d949640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56280fe7d0 0x7f5628196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:24.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.452+0000 7f562d949640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56280fe7d0 0x7f5628196290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58102/0 (socket says 172.21.15.87:58102) 2024-09-13T17:11:24.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.452+0000 7f562d949640 1 -- 172.21.15.87:0/46286432 learned_addr learned my addr 172.21.15.87:0/46286432 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:24.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.452+0000 7f562e94b640 1 --2- 172.21.15.87:0/46286432 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56281013a0 0x7f562819d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:24.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.452+0000 7f562d949640 1 -- 172.21.15.87:0/46286432 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56280fde10 msgr2=0x7f5628195d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:24.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.452+0000 7f562d949640 1 --2- 172.21.15.87:0/46286432 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56280fde10 0x7f5628195d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:24.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.452+0000 7f562d949640 1 -- 172.21.15.87:0/46286432 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56281013a0 msgr2=0x7f562819d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:24.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.452+0000 7f562d949640 1 --2- 172.21.15.87:0/46286432 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56281013a0 0x7f562819d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:24.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.452+0000 7f562d949640 1 -- 172.21.15.87:0/46286432 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5620009900 con 0x7f56280fe7d0 2024-09-13T17:11:24.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.452+0000 7f562e94b640 1 --2- 172.21.15.87:0/46286432 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56281013a0 0x7f562819d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:11:24.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.452+0000 7f562d949640 1 --2- 172.21.15.87:0/46286432 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56280fe7d0 0x7f5628196290 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f561800c920 tx=0x7f561800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:24.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.453+0000 7f561f7fe640 1 -- 172.21.15.87:0/46286432 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5618007c70 con 0x7f56280fe7d0 2024-09-13T17:11:24.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.453+0000 7f561f7fe640 1 -- 172.21.15.87:0/46286432 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5618007dd0 con 0x7f56280fe7d0 2024-09-13T17:11:24.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.453+0000 7f561f7fe640 1 -- 172.21.15.87:0/46286432 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56180187c0 con 0x7f56280fe7d0 2024-09-13T17:11:24.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.453+0000 7f56303ae640 1 -- 172.21.15.87:0/46286432 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f562819de40 con 0x7f56280fe7d0 2024-09-13T17:11:24.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.453+0000 7f56303ae640 1 -- 172.21.15.87:0/46286432 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f562819e2c0 con 0x7f56280fe7d0 2024-09-13T17:11:24.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.454+0000 7f56303ae640 1 -- 172.21.15.87:0/46286432 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56281073a0 con 0x7f56280fe7d0 2024-09-13T17:11:24.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.455+0000 7f561f7fe640 1 -- 172.21.15.87:0/46286432 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f561800f450 con 0x7f56280fe7d0 2024-09-13T17:11:24.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.455+0000 7f561f7fe640 1 --2- 172.21.15.87:0/46286432 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f56140a1110 0x7f56140a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:24.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.455+0000 7f562e14a640 1 --2- 172.21.15.87:0/46286432 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f56140a1110 0x7f56140a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:24.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.456+0000 7f561f7fe640 1 -- 172.21.15.87:0/46286432 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8205+0+0 (secure 0 0 0) 0x7f56180ccd60 con 0x7f56280fe7d0 2024-09-13T17:11:24.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.456+0000 7f562e14a640 1 --2- 172.21.15.87:0/46286432 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f56140a1110 0x7f56140a35d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5624005fd0 tx=0x7f5624005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:24.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.459+0000 7f561f7fe640 1 -- 172.21.15.87:0/46286432 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5618096590 con 0x7f56280fe7d0 2024-09-13T17:11:24.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:24.623+0000 7f56303ae640 1 -- 172.21.15.87:0/46286432 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f562810b670 con 0x7f56280fe7d0 2024-09-13T17:11:25.592 INFO:journalctl@ceph.mds.i.smithi149.stdout:Sep 13 17:11:25 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-i[66198]: 2024-09-13T17:11:25.253+0000 7fa75e296640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:11:25.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:25 smithi149 ceph-mon[35496]: pgmap v272: 97 pgs: 12 creating+peering, 60 unknown, 25 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 3 op/s 2024-09-13T17:11:25.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:25 smithi149 ceph-mon[35496]: mds.? [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] up:active 2024-09-13T17:11:25.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:25 smithi149 ceph-mon[35496]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-13T17:11:25.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:25 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3397109393' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-13T17:11:25.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:25 smithi149 ceph-mon[35496]: osdmap e85: 12 total, 12 up, 12 in 2024-09-13T17:11:25.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:25 smithi149 ceph-mon[35496]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-13T17:11:25.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:25 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/46286432' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-13T17:11:25.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:25 smithi149 ceph-mon[35496]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T17:11:25.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:25 smithi149 ceph-mon[35496]: Cluster is now healthy 2024-09-13T17:11:25.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:25 smithi118 ceph-mon[34374]: pgmap v272: 97 pgs: 12 creating+peering, 60 unknown, 25 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 3 op/s 2024-09-13T17:11:25.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:25 smithi118 ceph-mon[34374]: mds.? [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] up:active 2024-09-13T17:11:25.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:25 smithi118 ceph-mon[34374]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-13T17:11:25.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:25 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3397109393' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-13T17:11:25.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:25 smithi118 ceph-mon[34374]: osdmap e85: 12 total, 12 up, 12 in 2024-09-13T17:11:25.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:25 smithi118 ceph-mon[34374]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-13T17:11:25.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:25 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/46286432' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-13T17:11:25.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:25 smithi118 ceph-mon[34374]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T17:11:25.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:25 smithi118 ceph-mon[34374]: Cluster is now healthy 2024-09-13T17:11:25.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:25 smithi087 ceph-mon[30934]: pgmap v272: 97 pgs: 12 creating+peering, 60 unknown, 25 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 3 op/s 2024-09-13T17:11:25.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:25 smithi087 ceph-mon[30934]: mds.? [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] up:active 2024-09-13T17:11:25.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:25 smithi087 ceph-mon[30934]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-13T17:11:25.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:25 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3397109393' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-13T17:11:25.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:25 smithi087 ceph-mon[30934]: osdmap e85: 12 total, 12 up, 12 in 2024-09-13T17:11:25.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:25 smithi087 ceph-mon[30934]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-13T17:11:25.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:25 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/46286432' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-13T17:11:25.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:25 smithi087 ceph-mon[30934]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T17:11:25.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:25 smithi087 ceph-mon[30934]: Cluster is now healthy 2024-09-13T17:11:26.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.335+0000 7f561f7fe640 1 -- 172.21.15.87:0/46286432 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v87) v1 ==== 228+0+0 (secure 0 0 0) 0x7f5618094e60 con 0x7f56280fe7d0 2024-09-13T17:11:26.338 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_data_ec' created 2024-09-13T17:11:26.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.339+0000 7f56303ae640 1 -- 172.21.15.87:0/46286432 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f56140a1110 msgr2=0x7f56140a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:26.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.339+0000 7f56303ae640 1 --2- 172.21.15.87:0/46286432 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f56140a1110 0x7f56140a35d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5624005fd0 tx=0x7f5624005c70 comp rx=0 tx=0).stop 2024-09-13T17:11:26.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.339+0000 7f56303ae640 1 -- 172.21.15.87:0/46286432 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56280fe7d0 msgr2=0x7f5628196290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:26.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.339+0000 7f56303ae640 1 --2- 172.21.15.87:0/46286432 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56280fe7d0 0x7f5628196290 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f561800c920 tx=0x7f561800cde0 comp rx=0 tx=0).stop 2024-09-13T17:11:26.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.339+0000 7f56303ae640 1 -- 172.21.15.87:0/46286432 shutdown_connections 2024-09-13T17:11:26.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.339+0000 7f56303ae640 1 --2- 172.21.15.87:0/46286432 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f56140a1110 0x7f56140a35d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:26.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.339+0000 7f56303ae640 1 --2- 172.21.15.87:0/46286432 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56281013a0 0x7f562819d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:26.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.339+0000 7f56303ae640 1 --2- 172.21.15.87:0/46286432 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56280fe7d0 0x7f5628196290 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:26.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.339+0000 7f56303ae640 1 --2- 172.21.15.87:0/46286432 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56280fde10 0x7f5628195d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:26.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.339+0000 7f56303ae640 1 -- 172.21.15.87:0/46286432 >> 172.21.15.87:0/46286432 conn(0x7f56280f9bc0 msgr2=0x7f5628104570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:26.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.339+0000 7f56303ae640 1 -- 172.21.15.87:0/46286432 shutdown_connections 2024-09-13T17:11:26.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.340+0000 7f56303ae640 1 -- 172.21.15.87:0/46286432 wait complete. 2024-09-13T17:11:26.356 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-13T17:11:26.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.459+0000 7f4c189d5640 1 -- 172.21.15.87:0/3005730744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c14100830 msgr2=0x7f4c141070c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:26.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.459+0000 7f4c189d5640 1 --2- 172.21.15.87:0/3005730744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c14100830 0x7f4c141070c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4c04009ca0 tx=0x7f4c0402a8c0 comp rx=0 tx=0).stop 2024-09-13T17:11:26.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.459+0000 7f4c189d5640 1 -- 172.21.15.87:0/3005730744 shutdown_connections 2024-09-13T17:11:26.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.459+0000 7f4c189d5640 1 --2- 172.21.15.87:0/3005730744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c14100830 0x7f4c141070c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:26.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.459+0000 7f4c189d5640 1 --2- 172.21.15.87:0/3005730744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c140ffe70 0x7f4c141002f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:26.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.459+0000 7f4c189d5640 1 --2- 172.21.15.87:0/3005730744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c140fec80 0x7f4c140ff080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:26.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.459+0000 7f4c189d5640 1 -- 172.21.15.87:0/3005730744 >> 172.21.15.87:0/3005730744 conn(0x7f4c140fa3e0 msgr2=0x7f4c140fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:26.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.459+0000 7f4c189d5640 1 -- 172.21.15.87:0/3005730744 shutdown_connections 2024-09-13T17:11:26.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.459+0000 7f4c189d5640 1 -- 172.21.15.87:0/3005730744 wait complete. 2024-09-13T17:11:26.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.459+0000 7f4c189d5640 1 Processor -- start 2024-09-13T17:11:26.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.459+0000 7f4c189d5640 1 -- start start 2024-09-13T17:11:26.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.460+0000 7f4c189d5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c140fec80 0x7f4c14069120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:26.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.460+0000 7f4c189d5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c140ffe70 0x7f4c1419aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:26.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.460+0000 7f4c189d5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c14100830 0x7f4c1419d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:26.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.460+0000 7f4c189d5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1419d880 con 0x7f4c14100830 2024-09-13T17:11:26.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.460+0000 7f4c189d5640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1419d9f0 con 0x7f4c140fec80 2024-09-13T17:11:26.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.460+0000 7f4c189d5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1419dbb0 con 0x7f4c140ffe70 2024-09-13T17:11:26.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.460+0000 7f4c12d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c14100830 0x7f4c1419d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:26.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.460+0000 7f4c12d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c14100830 0x7f4c1419d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58130/0 (socket says 172.21.15.87:58130) 2024-09-13T17:11:26.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.460+0000 7f4c12d9d640 1 -- 172.21.15.87:0/3689387654 learned_addr learned my addr 172.21.15.87:0/3689387654 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:26.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.460+0000 7f4c11d9b640 1 --2- 172.21.15.87:0/3689387654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c140ffe70 0x7f4c1419aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:26.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.460+0000 7f4c1259c640 1 --2- 172.21.15.87:0/3689387654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c140fec80 0x7f4c14069120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:26.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.460+0000 7f4c12d9d640 1 -- 172.21.15.87:0/3689387654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c140ffe70 msgr2=0x7f4c1419aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:26.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.460+0000 7f4c12d9d640 1 --2- 172.21.15.87:0/3689387654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c140ffe70 0x7f4c1419aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:26.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.460+0000 7f4c12d9d640 1 -- 172.21.15.87:0/3689387654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c140fec80 msgr2=0x7f4c14069120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:26.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.460+0000 7f4c12d9d640 1 --2- 172.21.15.87:0/3689387654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c140fec80 0x7f4c14069120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:26.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.460+0000 7f4c12d9d640 1 -- 172.21.15.87:0/3689387654 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c04009900 con 0x7f4c14100830 2024-09-13T17:11:26.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.460+0000 7f4c12d9d640 1 --2- 172.21.15.87:0/3689387654 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c14100830 0x7f4c1419d0a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4c0402aeb0 tx=0x7f4c04003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:26.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.460+0000 7f4c0b7fe640 1 -- 172.21.15.87:0/3689387654 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c040307c0 con 0x7f4c14100830 2024-09-13T17:11:26.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.460+0000 7f4c189d5640 1 -- 172.21.15.87:0/3689387654 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c1419ddd0 con 0x7f4c14100830 2024-09-13T17:11:26.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.460+0000 7f4c0b7fe640 1 -- 172.21.15.87:0/3689387654 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4c04040070 con 0x7f4c14100830 2024-09-13T17:11:26.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.460+0000 7f4c0b7fe640 1 -- 172.21.15.87:0/3689387654 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c04004580 con 0x7f4c14100830 2024-09-13T17:11:26.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.460+0000 7f4c189d5640 1 -- 172.21.15.87:0/3689387654 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c1419e250 con 0x7f4c14100830 2024-09-13T17:11:26.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.462+0000 7f4c189d5640 1 -- 172.21.15.87:0/3689387654 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c140ff080 con 0x7f4c14100830 2024-09-13T17:11:26.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.462+0000 7f4c0b7fe640 1 -- 172.21.15.87:0/3689387654 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4c04042030 con 0x7f4c14100830 2024-09-13T17:11:26.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.463+0000 7f4c0b7fe640 1 --2- 172.21.15.87:0/3689387654 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f4c000a1090 0x7f4c000a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:26.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.463+0000 7f4c1259c640 1 --2- 172.21.15.87:0/3689387654 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f4c000a1090 0x7f4c000a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:26.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.463+0000 7f4c0b7fe640 1 -- 172.21.15.87:0/3689387654 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8698+0+0 (secure 0 0 0) 0x7f4c040ee370 con 0x7f4c14100830 2024-09-13T17:11:26.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.463+0000 7f4c1259c640 1 --2- 172.21.15.87:0/3689387654 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f4c000a1090 0x7f4c000a3550 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c005fd0 tx=0x7f4c0c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:26.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.467+0000 7f4c0b7fe640 1 -- 172.21.15.87:0/3689387654 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4c040b7930 con 0x7f4c14100830 2024-09-13T17:11:26.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:26 smithi149 ceph-mon[35496]: osdmap e86: 12 total, 12 up, 12 in 2024-09-13T17:11:26.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:26 smithi149 ceph-mon[35496]: pgmap v275: 97 pgs: 12 creating+peering, 7 unknown, 78 active+clean; 578 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 7 op/s 2024-09-13T17:11:26.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:26 smithi118 ceph-mon[34374]: osdmap e86: 12 total, 12 up, 12 in 2024-09-13T17:11:26.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:26 smithi118 ceph-mon[34374]: pgmap v275: 97 pgs: 12 creating+peering, 7 unknown, 78 active+clean; 578 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 7 op/s 2024-09-13T17:11:26.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:26.630+0000 7f4c189d5640 1 -- 172.21.15.87:0/3689387654 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f4c141060e0 con 0x7f4c14100830 2024-09-13T17:11:26.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:26 smithi087 ceph-mon[30934]: osdmap e86: 12 total, 12 up, 12 in 2024-09-13T17:11:26.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:26 smithi087 ceph-mon[30934]: pgmap v275: 97 pgs: 12 creating+peering, 7 unknown, 78 active+clean; 578 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 7 op/s 2024-09-13T17:11:27.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.341+0000 7f4c0b7fe640 1 -- 172.21.15.87:0/3689387654 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v88) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4c040baf50 con 0x7f4c14100830 2024-09-13T17:11:27.343 INFO:teuthology.orchestra.run.smithi087.stderr:set pool 4 allow_ec_overwrites to true 2024-09-13T17:11:27.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.345+0000 7f4c189d5640 1 -- 172.21.15.87:0/3689387654 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f4c000a1090 msgr2=0x7f4c000a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:27.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.345+0000 7f4c189d5640 1 --2- 172.21.15.87:0/3689387654 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f4c000a1090 0x7f4c000a3550 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c005fd0 tx=0x7f4c0c005850 comp rx=0 tx=0).stop 2024-09-13T17:11:27.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.345+0000 7f4c189d5640 1 -- 172.21.15.87:0/3689387654 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c14100830 msgr2=0x7f4c1419d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:27.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.345+0000 7f4c189d5640 1 --2- 172.21.15.87:0/3689387654 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c14100830 0x7f4c1419d0a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4c0402aeb0 tx=0x7f4c04003c20 comp rx=0 tx=0).stop 2024-09-13T17:11:27.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.345+0000 7f4c189d5640 1 -- 172.21.15.87:0/3689387654 shutdown_connections 2024-09-13T17:11:27.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.345+0000 7f4c189d5640 1 --2- 172.21.15.87:0/3689387654 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f4c000a1090 0x7f4c000a3550 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:27.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.345+0000 7f4c189d5640 1 --2- 172.21.15.87:0/3689387654 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c14100830 0x7f4c1419d0a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:27.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.345+0000 7f4c189d5640 1 --2- 172.21.15.87:0/3689387654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c140ffe70 0x7f4c1419aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:27.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.345+0000 7f4c189d5640 1 --2- 172.21.15.87:0/3689387654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c140fec80 0x7f4c14069120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:27.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.345+0000 7f4c189d5640 1 -- 172.21.15.87:0/3689387654 >> 172.21.15.87:0/3689387654 conn(0x7f4c140fa3e0 msgr2=0x7f4c141032b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:27.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.346+0000 7f4c189d5640 1 -- 172.21.15.87:0/3689387654 shutdown_connections 2024-09-13T17:11:27.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.346+0000 7f4c189d5640 1 -- 172.21.15.87:0/3689387654 wait complete. 2024-09-13T17:11:27.369 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-13T17:11:27.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.470+0000 7fdf5479c640 1 -- 172.21.15.87:0/1709049405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf4c0fec60 msgr2=0x7fdf4c0ff060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:27.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.470+0000 7fdf5479c640 1 --2- 172.21.15.87:0/1709049405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf4c0fec60 0x7fdf4c0ff060 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdf48009900 tx=0x7fdf4802a410 comp rx=0 tx=0).stop 2024-09-13T17:11:27.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.470+0000 7fdf5479c640 1 -- 172.21.15.87:0/1709049405 shutdown_connections 2024-09-13T17:11:27.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.470+0000 7fdf5479c640 1 --2- 172.21.15.87:0/1709049405 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf4c100810 0x7fdf4c1070a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:27.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.470+0000 7fdf5479c640 1 --2- 172.21.15.87:0/1709049405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf4c0ffe50 0x7fdf4c1002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:27.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.470+0000 7fdf5479c640 1 --2- 172.21.15.87:0/1709049405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf4c0fec60 0x7fdf4c0ff060 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:27.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.470+0000 7fdf5479c640 1 -- 172.21.15.87:0/1709049405 >> 172.21.15.87:0/1709049405 conn(0x7fdf4c0fa3e0 msgr2=0x7fdf4c0fc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:27.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.470+0000 7fdf5479c640 1 -- 172.21.15.87:0/1709049405 shutdown_connections 2024-09-13T17:11:27.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.470+0000 7fdf5479c640 1 -- 172.21.15.87:0/1709049405 wait complete. 2024-09-13T17:11:27.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.471+0000 7fdf5479c640 1 Processor -- start 2024-09-13T17:11:27.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.471+0000 7fdf5479c640 1 -- start start 2024-09-13T17:11:27.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.471+0000 7fdf5479c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf4c0fec60 0x7fdf4c195eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:27.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.471+0000 7fdf5479c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf4c0ffe50 0x7fdf4c1963f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:27.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.471+0000 7fdf5479c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf4c100810 0x7fdf4c19d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:27.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.471+0000 7fdf5479c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4c19d9a0 con 0x7fdf4c0fec60 2024-09-13T17:11:27.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.471+0000 7fdf5479c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4c19db10 con 0x7fdf4c0ffe50 2024-09-13T17:11:27.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.471+0000 7fdf5479c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4c19dcd0 con 0x7fdf4c100810 2024-09-13T17:11:27.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.471+0000 7fdf52538640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf4c0fec60 0x7fdf4c195eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:27.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.471+0000 7fdf52538640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf4c0fec60 0x7fdf4c195eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58156/0 (socket says 172.21.15.87:58156) 2024-09-13T17:11:27.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.471+0000 7fdf52538640 1 -- 172.21.15.87:0/3198431325 learned_addr learned my addr 172.21.15.87:0/3198431325 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:27.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.471+0000 7fdf51d37640 1 --2- 172.21.15.87:0/3198431325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf4c0ffe50 0x7fdf4c1963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:27.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.472+0000 7fdf52d39640 1 --2- 172.21.15.87:0/3198431325 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf4c100810 0x7fdf4c19d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:27.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.472+0000 7fdf52538640 1 -- 172.21.15.87:0/3198431325 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf4c100810 msgr2=0x7fdf4c19d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:27.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.472+0000 7fdf52538640 1 --2- 172.21.15.87:0/3198431325 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf4c100810 0x7fdf4c19d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:27.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.472+0000 7fdf52538640 1 -- 172.21.15.87:0/3198431325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf4c0ffe50 msgr2=0x7fdf4c1963f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:27.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.472+0000 7fdf52538640 1 --2- 172.21.15.87:0/3198431325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf4c0ffe50 0x7fdf4c1963f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:27.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.472+0000 7fdf52538640 1 -- 172.21.15.87:0/3198431325 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf48009560 con 0x7fdf4c0fec60 2024-09-13T17:11:27.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.472+0000 7fdf51d37640 1 --2- 172.21.15.87:0/3198431325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf4c0ffe50 0x7fdf4c1963f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:11:27.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.472+0000 7fdf52538640 1 --2- 172.21.15.87:0/3198431325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf4c0fec60 0x7fdf4c195eb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdf48005ec0 tx=0x7fdf48003e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:27.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.472+0000 7fdf437fe640 1 -- 172.21.15.87:0/3198431325 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf480327a0 con 0x7fdf4c0fec60 2024-09-13T17:11:27.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.472+0000 7fdf437fe640 1 -- 172.21.15.87:0/3198431325 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdf48032db0 con 0x7fdf4c0fec60 2024-09-13T17:11:27.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.472+0000 7fdf437fe640 1 -- 172.21.15.87:0/3198431325 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4803b3d0 con 0x7fdf4c0fec60 2024-09-13T17:11:27.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.472+0000 7fdf5479c640 1 -- 172.21.15.87:0/3198431325 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf4c19df50 con 0x7fdf4c0fec60 2024-09-13T17:11:27.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.472+0000 7fdf5479c640 1 -- 172.21.15.87:0/3198431325 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf4c19e340 con 0x7fdf4c0fec60 2024-09-13T17:11:27.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.473+0000 7fdf5479c640 1 -- 172.21.15.87:0/3198431325 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf4c1060e0 con 0x7fdf4c0fec60 2024-09-13T17:11:27.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.474+0000 7fdf437fe640 1 -- 172.21.15.87:0/3198431325 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fdf4803c670 con 0x7fdf4c0fec60 2024-09-13T17:11:27.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.474+0000 7fdf437fe640 1 --2- 172.21.15.87:0/3198431325 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fdf380a1090 0x7fdf380a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:27.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.475+0000 7fdf51d37640 1 --2- 172.21.15.87:0/3198431325 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fdf380a1090 0x7fdf380a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:27.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.475+0000 7fdf437fe640 1 -- 172.21.15.87:0/3198431325 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8698+0+0 (secure 0 0 0) 0x7fdf480ed920 con 0x7fdf4c0fec60 2024-09-13T17:11:27.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.475+0000 7fdf51d37640 1 --2- 172.21.15.87:0/3198431325 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fdf380a1090 0x7fdf380a3550 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c1973c0 tx=0x7fdf3c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:27.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.478+0000 7fdf437fe640 1 -- 172.21.15.87:0/3198431325 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdf480b6f70 con 0x7fdf4c0fec60 2024-09-13T17:11:27.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:27 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/46286432' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-13T17:11:27.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:27 smithi149 ceph-mon[35496]: osdmap e87: 12 total, 12 up, 12 in 2024-09-13T17:11:27.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:27 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3689387654' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-13T17:11:27.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:27 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/46286432' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-13T17:11:27.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:27 smithi118 ceph-mon[34374]: osdmap e87: 12 total, 12 up, 12 in 2024-09-13T17:11:27.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:27 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3689387654' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-13T17:11:27.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.677+0000 7fdf5479c640 1 -- 172.21.15.87:0/3198431325 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fdf4c02c520 con 0x7fdf4c0fec60 2024-09-13T17:11:27.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.683+0000 7fdf437fe640 1 -- 172.21.15.87:0/3198431325 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) v1 ==== 137+0+0 (secure 0 0 0) 0x7fdf4804a0b0 con 0x7fdf4c0fec60 2024-09-13T17:11:27.686 INFO:teuthology.orchestra.run.smithi087.stderr:added data pool 4 to fsmap 2024-09-13T17:11:27.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.685+0000 7fdf5479c640 1 -- 172.21.15.87:0/3198431325 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fdf380a1090 msgr2=0x7fdf380a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:27.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.685+0000 7fdf5479c640 1 --2- 172.21.15.87:0/3198431325 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fdf380a1090 0x7fdf380a3550 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c1973c0 tx=0x7fdf3c008040 comp rx=0 tx=0).stop 2024-09-13T17:11:27.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.685+0000 7fdf5479c640 1 -- 172.21.15.87:0/3198431325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf4c0fec60 msgr2=0x7fdf4c195eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:27.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.685+0000 7fdf5479c640 1 --2- 172.21.15.87:0/3198431325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf4c0fec60 0x7fdf4c195eb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdf48005ec0 tx=0x7fdf48003e00 comp rx=0 tx=0).stop 2024-09-13T17:11:27.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.685+0000 7fdf5479c640 1 -- 172.21.15.87:0/3198431325 shutdown_connections 2024-09-13T17:11:27.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.685+0000 7fdf5479c640 1 --2- 172.21.15.87:0/3198431325 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fdf380a1090 0x7fdf380a3550 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:27.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.685+0000 7fdf5479c640 1 --2- 172.21.15.87:0/3198431325 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf4c100810 0x7fdf4c19d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:27.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.685+0000 7fdf5479c640 1 --2- 172.21.15.87:0/3198431325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf4c0ffe50 0x7fdf4c1963f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:27.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.685+0000 7fdf5479c640 1 --2- 172.21.15.87:0/3198431325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf4c0fec60 0x7fdf4c195eb0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:27.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.685+0000 7fdf5479c640 1 -- 172.21.15.87:0/3198431325 >> 172.21.15.87:0/3198431325 conn(0x7fdf4c0fa3e0 msgr2=0x7fdf4c1032b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:27.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.685+0000 7fdf5479c640 1 -- 172.21.15.87:0/3198431325 shutdown_connections 2024-09-13T17:11:27.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.685+0000 7fdf5479c640 1 -- 172.21.15.87:0/3198431325 wait complete. 2024-09-13T17:11:27.697 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:27 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/46286432' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-13T17:11:27.697 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:27 smithi087 ceph-mon[30934]: osdmap e87: 12 total, 12 up, 12 in 2024-09-13T17:11:27.697 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:27 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3689387654' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-13T17:11:27.698 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:11:27.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.794+0000 7fcae4f25640 1 -- 172.21.15.87:0/2197582462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcae0100850 msgr2=0x7fcae01070e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:27.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.794+0000 7fcae4f25640 1 --2- 172.21.15.87:0/2197582462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcae0100850 0x7fcae01070e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcad8009ca0 tx=0x7fcad802a8c0 comp rx=0 tx=0).stop 2024-09-13T17:11:27.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.794+0000 7fcae4f25640 1 -- 172.21.15.87:0/2197582462 shutdown_connections 2024-09-13T17:11:27.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.794+0000 7fcae4f25640 1 --2- 172.21.15.87:0/2197582462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcae0100850 0x7fcae01070e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:27.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.794+0000 7fcae4f25640 1 --2- 172.21.15.87:0/2197582462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcae00ffe90 0x7fcae0100310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:27.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.794+0000 7fcae4f25640 1 --2- 172.21.15.87:0/2197582462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcae00feca0 0x7fcae00ff0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:27.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.794+0000 7fcae4f25640 1 -- 172.21.15.87:0/2197582462 >> 172.21.15.87:0/2197582462 conn(0x7fcae00fa440 msgr2=0x7fcae00fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:27.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.795+0000 7fcae4f25640 1 -- 172.21.15.87:0/2197582462 shutdown_connections 2024-09-13T17:11:27.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.795+0000 7fcae4f25640 1 -- 172.21.15.87:0/2197582462 wait complete. 2024-09-13T17:11:27.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.795+0000 7fcae4f25640 1 Processor -- start 2024-09-13T17:11:27.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.795+0000 7fcae4f25640 1 -- start start 2024-09-13T17:11:27.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.795+0000 7fcae4f25640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcae00feca0 0x7fcae0068150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:27.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.795+0000 7fcae4f25640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcae00ffe90 0x7fcae019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:27.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.795+0000 7fcae4f25640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcae0100850 0x7fcae019d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:27.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.795+0000 7fcae4f25640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae019d860 con 0x7fcae00ffe90 2024-09-13T17:11:27.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.795+0000 7fcae4f25640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae019d9d0 con 0x7fcae00feca0 2024-09-13T17:11:27.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.795+0000 7fcae4f25640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae019db90 con 0x7fcae0100850 2024-09-13T17:11:27.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.795+0000 7fcaddd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcae00ffe90 0x7fcae019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:27.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.796+0000 7fcaddd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcae00ffe90 0x7fcae019aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58184/0 (socket says 172.21.15.87:58184) 2024-09-13T17:11:27.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.796+0000 7fcaddd9b640 1 -- 172.21.15.87:0/1585817288 learned_addr learned my addr 172.21.15.87:0/1585817288 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:27.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.796+0000 7fcaded9d640 1 --2- 172.21.15.87:0/1585817288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcae0100850 0x7fcae019d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:27.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.796+0000 7fcade59c640 1 --2- 172.21.15.87:0/1585817288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcae00feca0 0x7fcae0068150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:27.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.796+0000 7fcaddd9b640 1 -- 172.21.15.87:0/1585817288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcae0100850 msgr2=0x7fcae019d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:27.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.796+0000 7fcaddd9b640 1 --2- 172.21.15.87:0/1585817288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcae0100850 0x7fcae019d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:27.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.796+0000 7fcaddd9b640 1 -- 172.21.15.87:0/1585817288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcae00feca0 msgr2=0x7fcae0068150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:27.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.796+0000 7fcaddd9b640 1 --2- 172.21.15.87:0/1585817288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcae00feca0 0x7fcae0068150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:27.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.796+0000 7fcaddd9b640 1 -- 172.21.15.87:0/1585817288 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad8009900 con 0x7fcae00ffe90 2024-09-13T17:11:27.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.796+0000 7fcaded9d640 1 --2- 172.21.15.87:0/1585817288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcae0100850 0x7fcae019d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:11:27.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.796+0000 7fcaddd9b640 1 --2- 172.21.15.87:0/1585817288 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcae00ffe90 0x7fcae019aa80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fcad400b4a0 tx=0x7fcad400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:27.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.796+0000 7fcacf7fe640 1 -- 172.21.15.87:0/1585817288 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad4010610 con 0x7fcae00ffe90 2024-09-13T17:11:27.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.796+0000 7fcacf7fe640 1 -- 172.21.15.87:0/1585817288 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcad4010c20 con 0x7fcae00ffe90 2024-09-13T17:11:27.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.796+0000 7fcae4f25640 1 -- 172.21.15.87:0/1585817288 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae019de70 con 0x7fcae00ffe90 2024-09-13T17:11:27.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.796+0000 7fcacf7fe640 1 -- 172.21.15.87:0/1585817288 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad4017d50 con 0x7fcae00ffe90 2024-09-13T17:11:27.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.796+0000 7fcae4f25640 1 -- 172.21.15.87:0/1585817288 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae019e2a0 con 0x7fcae00ffe90 2024-09-13T17:11:27.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.797+0000 7fcae4f25640 1 -- 172.21.15.87:0/1585817288 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae0106100 con 0x7fcae00ffe90 2024-09-13T17:11:27.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.798+0000 7fcacf7fe640 1 -- 172.21.15.87:0/1585817288 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fcad4010770 con 0x7fcae00ffe90 2024-09-13T17:11:27.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.799+0000 7fcacf7fe640 1 --2- 172.21.15.87:0/1585817288 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fcac80a1090 0x7fcac80a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:27.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.799+0000 7fcade59c640 1 --2- 172.21.15.87:0/1585817288 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fcac80a1090 0x7fcac80a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:27.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.799+0000 7fcacf7fe640 1 -- 172.21.15.87:0/1585817288 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fcad40cc1a0 con 0x7fcae00ffe90 2024-09-13T17:11:27.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.799+0000 7fcade59c640 1 --2- 172.21.15.87:0/1585817288 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fcac80a1090 0x7fcac80a3550 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcad0005fd0 tx=0x7fcad0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:27.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:27.803+0000 7fcacf7fe640 1 -- 172.21.15.87:0/1585817288 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcad40957e0 con 0x7fcae00ffe90 2024-09-13T17:11:28.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.007+0000 7fcae4f25640 1 -- 172.21.15.87:0/1585817288 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcae010a7b0 con 0x7fcae00ffe90 2024-09-13T17:11:28.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.007+0000 7fcacf7fe640 1 -- 172.21.15.87:0/1585817288 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+10816 (secure 0 0 0) 0x7fcad4098e00 con 0x7fcae00ffe90 2024-09-13T17:11:28.009 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:11:28.010 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/3674545180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":3674545180},{"type":"v1","addr":"172.21.15.87:6841","nonce":3674545180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24446,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24470,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6839/3052680456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3052680456},{"type":"v1","addr":"172.21.15.118:6839","nonce":3052680456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:11:23.313609+0000","modified":"2024-09-13T17:11:27.679767+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24499},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T17:11:28.010 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 17 2024-09-13T17:11:28.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.009+0000 7fcae4f25640 1 -- 172.21.15.87:0/1585817288 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fcac80a1090 msgr2=0x7fcac80a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:28.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.009+0000 7fcae4f25640 1 --2- 172.21.15.87:0/1585817288 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fcac80a1090 0x7fcac80a3550 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcad0005fd0 tx=0x7fcad0005850 comp rx=0 tx=0).stop 2024-09-13T17:11:28.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.009+0000 7fcae4f25640 1 -- 172.21.15.87:0/1585817288 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcae00ffe90 msgr2=0x7fcae019aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:28.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.009+0000 7fcae4f25640 1 --2- 172.21.15.87:0/1585817288 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcae00ffe90 0x7fcae019aa80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fcad400b4a0 tx=0x7fcad400b960 comp rx=0 tx=0).stop 2024-09-13T17:11:28.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.009+0000 7fcae4f25640 1 -- 172.21.15.87:0/1585817288 shutdown_connections 2024-09-13T17:11:28.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.009+0000 7fcae4f25640 1 --2- 172.21.15.87:0/1585817288 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fcac80a1090 0x7fcac80a3550 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:28.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.009+0000 7fcae4f25640 1 --2- 172.21.15.87:0/1585817288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcae0100850 0x7fcae019d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:28.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.009+0000 7fcae4f25640 1 --2- 172.21.15.87:0/1585817288 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcae00ffe90 0x7fcae019aa80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:28.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.009+0000 7fcae4f25640 1 --2- 172.21.15.87:0/1585817288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcae00feca0 0x7fcae0068150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:28.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.009+0000 7fcae4f25640 1 -- 172.21.15.87:0/1585817288 >> 172.21.15.87:0/1585817288 conn(0x7fcae00fa440 msgr2=0x7fcae01032d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:28.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.009+0000 7fcae4f25640 1 -- 172.21.15.87:0/1585817288 shutdown_connections 2024-09-13T17:11:28.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.009+0000 7fcae4f25640 1 -- 172.21.15.87:0/1585817288 wait complete. 2024-09-13T17:11:28.023 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:11:28.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.120+0000 7f256ae6b640 1 -- 172.21.15.87:0/1667420615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25640ff850 msgr2=0x7f2564107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:28.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.120+0000 7f256ae6b640 1 --2- 172.21.15.87:0/1667420615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25640ff850 0x7f2564107110 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f254c009900 tx=0x7f254c02a410 comp rx=0 tx=0).stop 2024-09-13T17:11:28.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.120+0000 7f256ae6b640 1 -- 172.21.15.87:0/1667420615 shutdown_connections 2024-09-13T17:11:28.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.120+0000 7f256ae6b640 1 --2- 172.21.15.87:0/1667420615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25640ff850 0x7f2564107110 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:28.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.120+0000 7f256ae6b640 1 --2- 172.21.15.87:0/1667420615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25640feeb0 0x7f25640ff310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:28.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.120+0000 7f256ae6b640 1 --2- 172.21.15.87:0/1667420615 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2564100260 0x7f2564100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:28.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.120+0000 7f256ae6b640 1 -- 172.21.15.87:0/1667420615 >> 172.21.15.87:0/1667420615 conn(0x7f25640f9bb0 msgr2=0x7f25640fbfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:28.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.120+0000 7f256ae6b640 1 -- 172.21.15.87:0/1667420615 shutdown_connections 2024-09-13T17:11:28.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.120+0000 7f256ae6b640 1 -- 172.21.15.87:0/1667420615 wait complete. 2024-09-13T17:11:28.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.120+0000 7f256ae6b640 1 Processor -- start 2024-09-13T17:11:28.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.120+0000 7f256ae6b640 1 -- start start 2024-09-13T17:11:28.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.121+0000 7f256ae6b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25640feeb0 0x7f2564109590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:28.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.121+0000 7f256ae6b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25640ff850 0x7f2564107bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:28.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.121+0000 7f256ae6b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2564100260 0x7f2564108110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:28.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.121+0000 7f256ae6b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2564108870 con 0x7f2564100260 2024-09-13T17:11:28.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.121+0000 7f256ae6b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25641089e0 con 0x7f25640ff850 2024-09-13T17:11:28.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.121+0000 7f256ae6b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256419fdf0 con 0x7f25640feeb0 2024-09-13T17:11:28.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.121+0000 7f2569408640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2564100260 0x7f2564108110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:28.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.121+0000 7f2569408640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2564100260 0x7f2564108110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58212/0 (socket says 172.21.15.87:58212) 2024-09-13T17:11:28.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.121+0000 7f2569408640 1 -- 172.21.15.87:0/3741943443 learned_addr learned my addr 172.21.15.87:0/3741943443 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:28.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.121+0000 7f2568c07640 1 --2- 172.21.15.87:0/3741943443 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25640feeb0 0x7f2564109590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:28.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.121+0000 7f2563fff640 1 --2- 172.21.15.87:0/3741943443 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25640ff850 0x7f2564107bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:28.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.121+0000 7f2569408640 1 -- 172.21.15.87:0/3741943443 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25640feeb0 msgr2=0x7f2564109590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:28.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.121+0000 7f2569408640 1 --2- 172.21.15.87:0/3741943443 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25640feeb0 0x7f2564109590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:28.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.121+0000 7f2569408640 1 -- 172.21.15.87:0/3741943443 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25640ff850 msgr2=0x7f2564107bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:28.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.121+0000 7f2569408640 1 --2- 172.21.15.87:0/3741943443 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25640ff850 0x7f2564107bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:28.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.121+0000 7f2569408640 1 -- 172.21.15.87:0/3741943443 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f254c009560 con 0x7f2564100260 2024-09-13T17:11:28.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.121+0000 7f2563fff640 1 --2- 172.21.15.87:0/3741943443 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25640ff850 0x7f2564107bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:11:28.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.121+0000 7f2569408640 1 --2- 172.21.15.87:0/3741943443 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2564100260 0x7f2564108110 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f254c0057c0 tx=0x7f254c0042d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:28.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.121+0000 7f2561ffb640 1 -- 172.21.15.87:0/3741943443 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c003a00 con 0x7f2564100260 2024-09-13T17:11:28.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.121+0000 7f2561ffb640 1 -- 172.21.15.87:0/3741943443 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f254c0044c0 con 0x7f2564100260 2024-09-13T17:11:28.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.121+0000 7f2561ffb640 1 -- 172.21.15.87:0/3741943443 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c03a3c0 con 0x7f2564100260 2024-09-13T17:11:28.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.121+0000 7f256ae6b640 1 -- 172.21.15.87:0/3741943443 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25641a0040 con 0x7f2564100260 2024-09-13T17:11:28.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.122+0000 7f256ae6b640 1 -- 172.21.15.87:0/3741943443 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25641a04a0 con 0x7f2564100260 2024-09-13T17:11:28.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.123+0000 7f256ae6b640 1 -- 172.21.15.87:0/3741943443 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25641061b0 con 0x7f2564100260 2024-09-13T17:11:28.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.124+0000 7f2561ffb640 1 -- 172.21.15.87:0/3741943443 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f254c03b6f0 con 0x7f2564100260 2024-09-13T17:11:28.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.124+0000 7f2561ffb640 1 --2- 172.21.15.87:0/3741943443 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f25500a1090 0x7f25500a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:28.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.125+0000 7f2568c07640 1 --2- 172.21.15.87:0/3741943443 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f25500a1090 0x7f25500a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:28.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.125+0000 7f2561ffb640 1 -- 172.21.15.87:0/3741943443 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f254c0ed8e0 con 0x7f2564100260 2024-09-13T17:11:28.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.125+0000 7f2568c07640 1 --2- 172.21.15.87:0/3741943443 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f25500a1090 0x7f25500a3550 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f255c0058c0 tx=0x7f255c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:28.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.129+0000 7f2561ffb640 1 -- 172.21.15.87:0/3741943443 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f254c0b6e80 con 0x7f2564100260 2024-09-13T17:11:28.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.292+0000 7f256ae6b640 1 -- 172.21.15.87:0/3741943443 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2564105c20 con 0x7f2564100260 2024-09-13T17:11:28.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.294+0000 7f2561ffb640 1 -- 172.21.15.87:0/3741943443 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+23971 (secure 0 0 0) 0x7f254c041090 con 0x7f2564100260 2024-09-13T17:11:28.296 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:11:28.296 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":89,"fsid":"043d5bae-71f2-11ef-bceb-c7b262605968","created":"2024-09-13T17:03:57.852010+0000","modified":"2024-09-13T17:11:27.679526+0000","last_up_change":"2024-09-13T17:10:34.423548+0000","last_in_change":"2024-09-13T17:10:14.228123+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:07:02.286400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:11:21.965141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:11:22.504345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:11:25.565163+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58250283-85c0-416e-abdd-1fc5a7ff0c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6803","nonce":1316956138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6805","nonce":1316956138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6809","nonce":1316956138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6807","nonce":1316956138}]},"public_addr":"172.21.15.87:6803/1316956138","cluster_addr":"172.21.15.87:6805/1316956138","heartbeat_back_addr":"172.21.15.87:6809/1316956138","heartbeat_front_addr":"172.21.15.87:6807/1316956138","state":["exists","up"]},{"osd":1,"uuid":"b9d49969-94b1-4262-b4ff-db0a8e3331af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6801","nonce":3352566727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6803","nonce":3352566727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6807","nonce":3352566727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6805","nonce":3352566727}]},"public_addr":"172.21.15.118:6801/3352566727","cluster_addr":"172.21.15.118:6803/3352566727","heartbeat_back_addr":"172.21.15.118:6807/3352566727","heartbeat_front_addr":"172.21.15.118:6805/3352566727","state":["exists","up"]},{"osd":2,"uuid":"ba64549e-d736-426f-b466-f569af5f16d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6801","nonce":2774581686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6803","nonce":2774581686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6807","nonce":2774581686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6805","nonce":2774581686}]},"public_addr":"172.21.15.149:6801/2774581686","cluster_addr":"172.21.15.149:6803/2774581686","heartbeat_back_addr":"172.21.15.149:6807/2774581686","heartbeat_front_addr":"172.21.15.149:6805/2774581686","state":["exists","up"]},{"osd":3,"uuid":"3d5553e5-371b-49fd-976b-9e72a97a2f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6811","nonce":3306119066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6813","nonce":3306119066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6817","nonce":3306119066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6815","nonce":3306119066}]},"public_addr":"172.21.15.87:6811/3306119066","cluster_addr":"172.21.15.87:6813/3306119066","heartbeat_back_addr":"172.21.15.87:6817/3306119066","heartbeat_front_addr":"172.21.15.87:6815/3306119066","state":["exists","up"]},{"osd":4,"uuid":"2fbe0e27-34ec-42a6-9962-f1d8202b3159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6809","nonce":3342349890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6811","nonce":3342349890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6815","nonce":3342349890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6813","nonce":3342349890}]},"public_addr":"172.21.15.118:6809/3342349890","cluster_addr":"172.21.15.118:6811/3342349890","heartbeat_back_addr":"172.21.15.118:6815/3342349890","heartbeat_front_addr":"172.21.15.118:6813/3342349890","state":["exists","up"]},{"osd":5,"uuid":"53c14519-6170-4b5a-a79d-4835882d7bec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6809","nonce":3468867124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6811","nonce":3468867124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6815","nonce":3468867124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6813","nonce":3468867124}]},"public_addr":"172.21.15.149:6809/3468867124","cluster_addr":"172.21.15.149:6811/3468867124","heartbeat_back_addr":"172.21.15.149:6815/3468867124","heartbeat_front_addr":"172.21.15.149:6813/3468867124","state":["exists","up"]},{"osd":6,"uuid":"d3951b32-db77-4b8b-9de0-f05e03d13f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6819","nonce":326563617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6821","nonce":326563617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6825","nonce":326563617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6823","nonce":326563617}]},"public_addr":"172.21.15.87:6819/326563617","cluster_addr":"172.21.15.87:6821/326563617","heartbeat_back_addr":"172.21.15.87:6825/326563617","heartbeat_front_addr":"172.21.15.87:6823/326563617","state":["exists","up"]},{"osd":7,"uuid":"4d46dab7-a8bf-4e3e-b5c0-43860d336bdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6817","nonce":1690268990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6819","nonce":1690268990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6823","nonce":1690268990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6821","nonce":1690268990}]},"public_addr":"172.21.15.118:6817/1690268990","cluster_addr":"172.21.15.118:6819/1690268990","heartbeat_back_addr":"172.21.15.118:6823/1690268990","heartbeat_front_addr":"172.21.15.118:6821/1690268990","state":["exists","up"]},{"osd":8,"uuid":"5a015a7d-60a3-4412-96af-1b61d2ad51f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6817","nonce":1558675380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6819","nonce":1558675380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6823","nonce":1558675380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6821","nonce":1558675380}]},"public_addr":"172.21.15.149:6817/1558675380","cluster_addr":"172.21.15.149:6819/1558675380","heartbeat_back_addr":"172.21.15.149:6823/1558675380","heartbeat_front_addr":"172.21.15.149:6821/1558675380","state":["exists","up"]},{"osd":9,"uuid":"248c0b6e-4c4e-4c63-a0dd-e4cdf3b997a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6827","nonce":1453934262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6829","nonce":1453934262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6833","nonce":1453934262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6831","nonce":1453934262}]},"public_addr":"172.21.15.87:6827/1453934262","cluster_addr":"172.21.15.87:6829/1453934262","heartbeat_back_addr":"172.21.15.87:6833/1453934262","heartbeat_front_addr":"172.21.15.87:6831/1453934262","state":["exists","up"]},{"osd":10,"uuid":"24238714-e737-4371-b5d5-0cd3395f09bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6825","nonce":1034318850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6827","nonce":1034318850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6831","nonce":1034318850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6829","nonce":1034318850}]},"public_addr":"172.21.15.118:6825/1034318850","cluster_addr":"172.21.15.118:6827/1034318850","heartbeat_back_addr":"172.21.15.118:6831/1034318850","heartbeat_front_addr":"172.21.15.118:6829/1034318850","state":["exists","up"]},{"osd":11,"uuid":"409dd3bf-5154-4dea-8708-7de7f9e2e793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6825","nonce":271000465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6827","nonce":271000465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6831","nonce":271000465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6829","nonce":271000465}]},"public_addr":"172.21.15.149:6825/271000465","cluster_addr":"172.21.15.149:6827/271000465","heartbeat_back_addr":"172.21.15.149:6831/271000465","heartbeat_front_addr":"172.21.15.149:6829/271000465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:16.382664+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:37.914250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:00.425876+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:23.960183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:47.004088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:10.214345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:33.719221+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:57.099599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:20.971881+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:44.827167+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:08.135516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:32.085853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/586423689":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6801/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6800/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/3270371628":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/515676743":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/1475107314":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/553289143":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/3403361612":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6801/1587363880":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6800/1587363880":"2024-09-14T17:04:24.083789+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:11:28.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.296+0000 7f256ae6b640 1 -- 172.21.15.87:0/3741943443 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f25500a1090 msgr2=0x7f25500a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:28.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.296+0000 7f256ae6b640 1 --2- 172.21.15.87:0/3741943443 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f25500a1090 0x7f25500a3550 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f255c0058c0 tx=0x7f255c00a2d0 comp rx=0 tx=0).stop 2024-09-13T17:11:28.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.296+0000 7f256ae6b640 1 -- 172.21.15.87:0/3741943443 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2564100260 msgr2=0x7f2564108110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:28.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.296+0000 7f256ae6b640 1 --2- 172.21.15.87:0/3741943443 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2564100260 0x7f2564108110 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f254c0057c0 tx=0x7f254c0042d0 comp rx=0 tx=0).stop 2024-09-13T17:11:28.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.296+0000 7f256ae6b640 1 -- 172.21.15.87:0/3741943443 shutdown_connections 2024-09-13T17:11:28.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.296+0000 7f256ae6b640 1 --2- 172.21.15.87:0/3741943443 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f25500a1090 0x7f25500a3550 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:28.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.296+0000 7f256ae6b640 1 --2- 172.21.15.87:0/3741943443 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2564100260 0x7f2564108110 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:28.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.296+0000 7f256ae6b640 1 --2- 172.21.15.87:0/3741943443 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25640ff850 0x7f2564107bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:28.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.296+0000 7f256ae6b640 1 --2- 172.21.15.87:0/3741943443 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25640feeb0 0x7f2564109590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:28.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.296+0000 7f256ae6b640 1 -- 172.21.15.87:0/3741943443 >> 172.21.15.87:0/3741943443 conn(0x7f25640f9bb0 msgr2=0x7f2564103380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:28.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.296+0000 7f256ae6b640 1 -- 172.21.15.87:0/3741943443 shutdown_connections 2024-09-13T17:11:28.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.296+0000 7f256ae6b640 1 -- 172.21.15.87:0/3741943443 wait complete. 2024-09-13T17:11:28.310 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:11:28.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.406+0000 7f660ddae640 1 -- 172.21.15.87:0/895938815 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66081031c0 msgr2=0x7f66081055b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:28.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.406+0000 7f660ddae640 1 --2- 172.21.15.87:0/895938815 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66081031c0 0x7f66081055b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f65f0009900 tx=0x7f65f002a410 comp rx=0 tx=0).stop 2024-09-13T17:11:28.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.406+0000 7f660ddae640 1 -- 172.21.15.87:0/895938815 shutdown_connections 2024-09-13T17:11:28.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.406+0000 7f660ddae640 1 --2- 172.21.15.87:0/895938815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6608105af0 0x7f6608107f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:28.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.406+0000 7f660ddae640 1 --2- 172.21.15.87:0/895938815 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66081031c0 0x7f66081055b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:28.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.406+0000 7f660ddae640 1 --2- 172.21.15.87:0/895938815 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6608100890 0x7f6608102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:28.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.406+0000 7f660ddae640 1 -- 172.21.15.87:0/895938815 >> 172.21.15.87:0/895938815 conn(0x7f66080fa430 msgr2=0x7f66080fc850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:28.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.406+0000 7f660ddae640 1 -- 172.21.15.87:0/895938815 shutdown_connections 2024-09-13T17:11:28.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.406+0000 7f660ddae640 1 -- 172.21.15.87:0/895938815 wait complete. 2024-09-13T17:11:28.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.406+0000 7f660ddae640 1 Processor -- start 2024-09-13T17:11:28.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.407+0000 7f660ddae640 1 -- start start 2024-09-13T17:11:28.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.407+0000 7f660ddae640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6608100890 0x7f6608195e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:28.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.407+0000 7f660ddae640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66081031c0 0x7f66081963c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:28.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.407+0000 7f660ddae640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6608105af0 0x7f660819d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:28.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.407+0000 7f660ddae640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660819d970 con 0x7f66081031c0 2024-09-13T17:11:28.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.407+0000 7f660ddae640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660819dae0 con 0x7f6608100890 2024-09-13T17:11:28.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.407+0000 7f660ddae640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660819dca0 con 0x7f6608105af0 2024-09-13T17:11:28.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.407+0000 7f65fffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66081031c0 0x7f66081963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:28.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.407+0000 7f65fffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66081031c0 0x7f66081963c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58224/0 (socket says 172.21.15.87:58224) 2024-09-13T17:11:28.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.407+0000 7f65fffff640 1 -- 172.21.15.87:0/899920315 learned_addr learned my addr 172.21.15.87:0/899920315 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:28.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.407+0000 7f6607fff640 1 --2- 172.21.15.87:0/899920315 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6608105af0 0x7f660819d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:28.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.407+0000 7f66077fe640 1 --2- 172.21.15.87:0/899920315 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6608100890 0x7f6608195e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:28.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.407+0000 7f65fffff640 1 -- 172.21.15.87:0/899920315 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6608105af0 msgr2=0x7f660819d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:28.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.407+0000 7f65fffff640 1 --2- 172.21.15.87:0/899920315 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6608105af0 0x7f660819d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:28.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.407+0000 7f65fffff640 1 -- 172.21.15.87:0/899920315 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6608100890 msgr2=0x7f6608195e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:28.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.407+0000 7f65fffff640 1 --2- 172.21.15.87:0/899920315 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6608100890 0x7f6608195e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:28.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.407+0000 7f65fffff640 1 -- 172.21.15.87:0/899920315 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f0009560 con 0x7f66081031c0 2024-09-13T17:11:28.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.407+0000 7f66077fe640 1 --2- 172.21.15.87:0/899920315 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6608100890 0x7f6608195e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:11:28.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.407+0000 7f65fffff640 1 --2- 172.21.15.87:0/899920315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66081031c0 0x7f66081963c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f65f0031460 tx=0x7f65f0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:28.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.407+0000 7f66057fa640 1 -- 172.21.15.87:0/899920315 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f00035f0 con 0x7f66081031c0 2024-09-13T17:11:28.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.407+0000 7f660ddae640 1 -- 172.21.15.87:0/899920315 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f660819df20 con 0x7f66081031c0 2024-09-13T17:11:28.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.407+0000 7f66057fa640 1 -- 172.21.15.87:0/899920315 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f65f0003c00 con 0x7f66081031c0 2024-09-13T17:11:28.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.407+0000 7f66057fa640 1 -- 172.21.15.87:0/899920315 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f003cd20 con 0x7f66081031c0 2024-09-13T17:11:28.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.407+0000 7f660ddae640 1 -- 172.21.15.87:0/899920315 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f660819e340 con 0x7f66081031c0 2024-09-13T17:11:28.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.408+0000 7f660ddae640 1 -- 172.21.15.87:0/899920315 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66080fbf20 con 0x7f66081031c0 2024-09-13T17:11:28.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.410+0000 7f66057fa640 1 -- 172.21.15.87:0/899920315 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f65f003c470 con 0x7f66081031c0 2024-09-13T17:11:28.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.410+0000 7f66057fa640 1 --2- 172.21.15.87:0/899920315 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f65f40a1090 0x7f65f40a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:28.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.410+0000 7f66077fe640 1 --2- 172.21.15.87:0/899920315 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f65f40a1090 0x7f65f40a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:28.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.410+0000 7f66057fa640 1 -- 172.21.15.87:0/899920315 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f65f00edda0 con 0x7f66081031c0 2024-09-13T17:11:28.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.411+0000 7f66077fe640 1 --2- 172.21.15.87:0/899920315 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f65f40a1090 0x7f65f40a3550 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f65f8009c20 tx=0x7f65f8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:28.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.413+0000 7f66057fa640 1 -- 172.21.15.87:0/899920315 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f65f00b7340 con 0x7f66081031c0 2024-09-13T17:11:28.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.576+0000 7f660ddae640 1 -- 172.21.15.87:0/899920315 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f660810b690 con 0x7f66081031c0 2024-09-13T17:11:28.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.577+0000 7f66057fa640 1 -- 172.21.15.87:0/899920315 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+23971 (secure 0 0 0) 0x7f65f004a090 con 0x7f66081031c0 2024-09-13T17:11:28.579 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:11:28.579 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":89,"fsid":"043d5bae-71f2-11ef-bceb-c7b262605968","created":"2024-09-13T17:03:57.852010+0000","modified":"2024-09-13T17:11:27.679526+0000","last_up_change":"2024-09-13T17:10:34.423548+0000","last_in_change":"2024-09-13T17:10:14.228123+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:07:02.286400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:11:21.965141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:11:22.504345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:11:25.565163+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58250283-85c0-416e-abdd-1fc5a7ff0c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6803","nonce":1316956138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6805","nonce":1316956138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6809","nonce":1316956138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6807","nonce":1316956138}]},"public_addr":"172.21.15.87:6803/1316956138","cluster_addr":"172.21.15.87:6805/1316956138","heartbeat_back_addr":"172.21.15.87:6809/1316956138","heartbeat_front_addr":"172.21.15.87:6807/1316956138","state":["exists","up"]},{"osd":1,"uuid":"b9d49969-94b1-4262-b4ff-db0a8e3331af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6801","nonce":3352566727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6803","nonce":3352566727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6807","nonce":3352566727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6805","nonce":3352566727}]},"public_addr":"172.21.15.118:6801/3352566727","cluster_addr":"172.21.15.118:6803/3352566727","heartbeat_back_addr":"172.21.15.118:6807/3352566727","heartbeat_front_addr":"172.21.15.118:6805/3352566727","state":["exists","up"]},{"osd":2,"uuid":"ba64549e-d736-426f-b466-f569af5f16d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6801","nonce":2774581686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6803","nonce":2774581686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6807","nonce":2774581686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6805","nonce":2774581686}]},"public_addr":"172.21.15.149:6801/2774581686","cluster_addr":"172.21.15.149:6803/2774581686","heartbeat_back_addr":"172.21.15.149:6807/2774581686","heartbeat_front_addr":"172.21.15.149:6805/2774581686","state":["exists","up"]},{"osd":3,"uuid":"3d5553e5-371b-49fd-976b-9e72a97a2f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6811","nonce":3306119066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6813","nonce":3306119066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6817","nonce":3306119066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6815","nonce":3306119066}]},"public_addr":"172.21.15.87:6811/3306119066","cluster_addr":"172.21.15.87:6813/3306119066","heartbeat_back_addr":"172.21.15.87:6817/3306119066","heartbeat_front_addr":"172.21.15.87:6815/3306119066","state":["exists","up"]},{"osd":4,"uuid":"2fbe0e27-34ec-42a6-9962-f1d8202b3159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6809","nonce":3342349890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6811","nonce":3342349890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6815","nonce":3342349890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6813","nonce":3342349890}]},"public_addr":"172.21.15.118:6809/3342349890","cluster_addr":"172.21.15.118:6811/3342349890","heartbeat_back_addr":"172.21.15.118:6815/3342349890","heartbeat_front_addr":"172.21.15.118:6813/3342349890","state":["exists","up"]},{"osd":5,"uuid":"53c14519-6170-4b5a-a79d-4835882d7bec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6809","nonce":3468867124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6811","nonce":3468867124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6815","nonce":3468867124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6813","nonce":3468867124}]},"public_addr":"172.21.15.149:6809/3468867124","cluster_addr":"172.21.15.149:6811/3468867124","heartbeat_back_addr":"172.21.15.149:6815/3468867124","heartbeat_front_addr":"172.21.15.149:6813/3468867124","state":["exists","up"]},{"osd":6,"uuid":"d3951b32-db77-4b8b-9de0-f05e03d13f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6819","nonce":326563617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6821","nonce":326563617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6825","nonce":326563617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6823","nonce":326563617}]},"public_addr":"172.21.15.87:6819/326563617","cluster_addr":"172.21.15.87:6821/326563617","heartbeat_back_addr":"172.21.15.87:6825/326563617","heartbeat_front_addr":"172.21.15.87:6823/326563617","state":["exists","up"]},{"osd":7,"uuid":"4d46dab7-a8bf-4e3e-b5c0-43860d336bdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6817","nonce":1690268990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6819","nonce":1690268990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6823","nonce":1690268990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6821","nonce":1690268990}]},"public_addr":"172.21.15.118:6817/1690268990","cluster_addr":"172.21.15.118:6819/1690268990","heartbeat_back_addr":"172.21.15.118:6823/1690268990","heartbeat_front_addr":"172.21.15.118:6821/1690268990","state":["exists","up"]},{"osd":8,"uuid":"5a015a7d-60a3-4412-96af-1b61d2ad51f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6817","nonce":1558675380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6819","nonce":1558675380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6823","nonce":1558675380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6821","nonce":1558675380}]},"public_addr":"172.21.15.149:6817/1558675380","cluster_addr":"172.21.15.149:6819/1558675380","heartbeat_back_addr":"172.21.15.149:6823/1558675380","heartbeat_front_addr":"172.21.15.149:6821/1558675380","state":["exists","up"]},{"osd":9,"uuid":"248c0b6e-4c4e-4c63-a0dd-e4cdf3b997a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6827","nonce":1453934262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6829","nonce":1453934262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6833","nonce":1453934262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6831","nonce":1453934262}]},"public_addr":"172.21.15.87:6827/1453934262","cluster_addr":"172.21.15.87:6829/1453934262","heartbeat_back_addr":"172.21.15.87:6833/1453934262","heartbeat_front_addr":"172.21.15.87:6831/1453934262","state":["exists","up"]},{"osd":10,"uuid":"24238714-e737-4371-b5d5-0cd3395f09bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6825","nonce":1034318850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6827","nonce":1034318850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6831","nonce":1034318850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6829","nonce":1034318850}]},"public_addr":"172.21.15.118:6825/1034318850","cluster_addr":"172.21.15.118:6827/1034318850","heartbeat_back_addr":"172.21.15.118:6831/1034318850","heartbeat_front_addr":"172.21.15.118:6829/1034318850","state":["exists","up"]},{"osd":11,"uuid":"409dd3bf-5154-4dea-8708-7de7f9e2e793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6825","nonce":271000465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6827","nonce":271000465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6831","nonce":271000465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6829","nonce":271000465}]},"public_addr":"172.21.15.149:6825/271000465","cluster_addr":"172.21.15.149:6827/271000465","heartbeat_back_addr":"172.21.15.149:6831/271000465","heartbeat_front_addr":"172.21.15.149:6829/271000465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:16.382664+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:37.914250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:00.425876+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:23.960183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:47.004088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:10.214345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:33.719221+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:57.099599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:20.971881+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:44.827167+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:08.135516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:32.085853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/586423689":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6801/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6800/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/3270371628":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/515676743":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/1475107314":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/553289143":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/3403361612":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6801/1587363880":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6800/1587363880":"2024-09-14T17:04:24.083789+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:11:28.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.580+0000 7f660ddae640 1 -- 172.21.15.87:0/899920315 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f65f40a1090 msgr2=0x7f65f40a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:28.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.580+0000 7f660ddae640 1 --2- 172.21.15.87:0/899920315 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f65f40a1090 0x7f65f40a3550 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f65f8009c20 tx=0x7f65f8005f90 comp rx=0 tx=0).stop 2024-09-13T17:11:28.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.580+0000 7f660ddae640 1 -- 172.21.15.87:0/899920315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66081031c0 msgr2=0x7f66081963c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:28.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.580+0000 7f660ddae640 1 --2- 172.21.15.87:0/899920315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66081031c0 0x7f66081963c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f65f0031460 tx=0x7f65f0004270 comp rx=0 tx=0).stop 2024-09-13T17:11:28.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.580+0000 7f660ddae640 1 -- 172.21.15.87:0/899920315 shutdown_connections 2024-09-13T17:11:28.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.580+0000 7f660ddae640 1 --2- 172.21.15.87:0/899920315 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f65f40a1090 0x7f65f40a3550 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:28.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.580+0000 7f660ddae640 1 --2- 172.21.15.87:0/899920315 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6608105af0 0x7f660819d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:28.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.580+0000 7f660ddae640 1 --2- 172.21.15.87:0/899920315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66081031c0 0x7f66081963c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:28.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.580+0000 7f660ddae640 1 --2- 172.21.15.87:0/899920315 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6608100890 0x7f6608195e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:28.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.580+0000 7f660ddae640 1 -- 172.21.15.87:0/899920315 >> 172.21.15.87:0/899920315 conn(0x7f66080fa430 msgr2=0x7f66081026d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:28.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.580+0000 7f660ddae640 1 -- 172.21.15.87:0/899920315 shutdown_connections 2024-09-13T17:11:28.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.580+0000 7f660ddae640 1 -- 172.21.15.87:0/899920315 wait complete. 2024-09-13T17:11:28.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:28 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3689387654' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-13T17:11:28.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:28 smithi149 ceph-mon[35496]: osdmap e88: 12 total, 12 up, 12 in 2024-09-13T17:11:28.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:28 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3198431325' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-13T17:11:28.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:28 smithi149 ceph-mon[35496]: osdmap e89: 12 total, 12 up, 12 in 2024-09-13T17:11:28.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:28 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3198431325' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-13T17:11:28.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:28 smithi149 ceph-mon[35496]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-13T17:11:28.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:28 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1585817288' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:28.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:28 smithi149 ceph-mon[35496]: pgmap v279: 129 pgs: 4 creating+peering, 20 unknown, 105 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 6 op/s 2024-09-13T17:11:28.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:28 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3741943443' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:11:28.593 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:28 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3689387654' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-13T17:11:28.593 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:28 smithi087 ceph-mon[30934]: osdmap e88: 12 total, 12 up, 12 in 2024-09-13T17:11:28.593 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:28 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3198431325' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-13T17:11:28.593 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:28 smithi087 ceph-mon[30934]: osdmap e89: 12 total, 12 up, 12 in 2024-09-13T17:11:28.593 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:28 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3198431325' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-13T17:11:28.594 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:28 smithi087 ceph-mon[30934]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-13T17:11:28.594 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:28 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1585817288' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:28.594 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:28 smithi087 ceph-mon[30934]: pgmap v279: 129 pgs: 4 creating+peering, 20 unknown, 105 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 6 op/s 2024-09-13T17:11:28.594 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:28 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3741943443' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:11:28.613 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:11:28.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:28 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3689387654' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-13T17:11:28.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:28 smithi118 ceph-mon[34374]: osdmap e88: 12 total, 12 up, 12 in 2024-09-13T17:11:28.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:28 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3198431325' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-13T17:11:28.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:28 smithi118 ceph-mon[34374]: osdmap e89: 12 total, 12 up, 12 in 2024-09-13T17:11:28.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:28 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3198431325' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-13T17:11:28.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:28 smithi118 ceph-mon[34374]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-13T17:11:28.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:28 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1585817288' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:28.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:28 smithi118 ceph-mon[34374]: pgmap v279: 129 pgs: 4 creating+peering, 20 unknown, 105 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 6 op/s 2024-09-13T17:11:28.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:28 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3741943443' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:11:28.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.711+0000 7ff48e765640 1 -- 172.21.15.87:0/364707793 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff488105a80 msgr2=0x7ff488107ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:28.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.711+0000 7ff48e765640 1 --2- 172.21.15.87:0/364707793 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff488105a80 0x7ff488107ef0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff480009ca0 tx=0x7ff48002a8c0 comp rx=0 tx=0).stop 2024-09-13T17:11:28.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.711+0000 7ff48e765640 1 -- 172.21.15.87:0/364707793 shutdown_connections 2024-09-13T17:11:28.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.711+0000 7ff48e765640 1 --2- 172.21.15.87:0/364707793 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff488105a80 0x7ff488107ef0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:28.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.711+0000 7ff48e765640 1 --2- 172.21.15.87:0/364707793 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff488103150 0x7ff488105540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:28.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.711+0000 7ff48e765640 1 --2- 172.21.15.87:0/364707793 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff488100820 0x7ff488102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:28.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.711+0000 7ff48e765640 1 -- 172.21.15.87:0/364707793 >> 172.21.15.87:0/364707793 conn(0x7ff4880fa400 msgr2=0x7ff4880fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:28.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.711+0000 7ff48e765640 1 -- 172.21.15.87:0/364707793 shutdown_connections 2024-09-13T17:11:28.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.711+0000 7ff48e765640 1 -- 172.21.15.87:0/364707793 wait complete. 2024-09-13T17:11:28.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.712+0000 7ff48e765640 1 Processor -- start 2024-09-13T17:11:28.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.712+0000 7ff48e765640 1 -- start start 2024-09-13T17:11:28.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.712+0000 7ff48e765640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff488100820 0x7ff488195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:28.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.712+0000 7ff48e765640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff488103150 0x7ff488196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:28.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.712+0000 7ff48e765640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff488105a80 0x7ff48819d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:28.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.712+0000 7ff48e765640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48819d8f0 con 0x7ff488105a80 2024-09-13T17:11:28.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.712+0000 7ff48e765640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48819da60 con 0x7ff488103150 2024-09-13T17:11:28.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.712+0000 7ff48e765640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48819dc20 con 0x7ff488100820 2024-09-13T17:11:28.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.712+0000 7ff48cd02640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff488105a80 0x7ff48819d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:28.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.712+0000 7ff487fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff488100820 0x7ff488195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:28.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.712+0000 7ff48cd02640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff488105a80 0x7ff48819d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58244/0 (socket says 172.21.15.87:58244) 2024-09-13T17:11:28.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.712+0000 7ff48cd02640 1 -- 172.21.15.87:0/4087031934 learned_addr learned my addr 172.21.15.87:0/4087031934 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:28.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.713+0000 7ff48cd02640 1 -- 172.21.15.87:0/4087031934 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff488100820 msgr2=0x7ff488195e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:28.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.713+0000 7ff48cd02640 1 --2- 172.21.15.87:0/4087031934 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff488100820 0x7ff488195e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:28.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.713+0000 7ff48cd02640 1 -- 172.21.15.87:0/4087031934 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff488103150 msgr2=0x7ff488196340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:28.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.713+0000 7ff48cd02640 1 --2- 172.21.15.87:0/4087031934 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff488103150 0x7ff488196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:28.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.713+0000 7ff48cd02640 1 -- 172.21.15.87:0/4087031934 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff480009900 con 0x7ff488105a80 2024-09-13T17:11:28.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.713+0000 7ff48cd02640 1 --2- 172.21.15.87:0/4087031934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff488105a80 0x7ff48819d3b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff48002aeb0 tx=0x7ff480031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:28.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.713+0000 7ff4857fa640 1 -- 172.21.15.87:0/4087031934 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48002f310 con 0x7ff488105a80 2024-09-13T17:11:28.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.713+0000 7ff4857fa640 1 -- 172.21.15.87:0/4087031934 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff480040070 con 0x7ff488105a80 2024-09-13T17:11:28.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.713+0000 7ff48e765640 1 -- 172.21.15.87:0/4087031934 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff48819dea0 con 0x7ff488105a80 2024-09-13T17:11:28.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.713+0000 7ff4857fa640 1 -- 172.21.15.87:0/4087031934 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff480004560 con 0x7ff488105a80 2024-09-13T17:11:28.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.713+0000 7ff48e765640 1 -- 172.21.15.87:0/4087031934 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff48819e380 con 0x7ff488105a80 2024-09-13T17:11:28.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.714+0000 7ff48e765640 1 -- 172.21.15.87:0/4087031934 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4880fbef0 con 0x7ff488105a80 2024-09-13T17:11:28.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.715+0000 7ff4857fa640 1 -- 172.21.15.87:0/4087031934 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff480042030 con 0x7ff488105a80 2024-09-13T17:11:28.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.716+0000 7ff4857fa640 1 --2- 172.21.15.87:0/4087031934 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff4700a1090 0x7ff4700a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:28.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.716+0000 7ff487fff640 1 --2- 172.21.15.87:0/4087031934 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff4700a1090 0x7ff4700a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:28.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.716+0000 7ff4857fa640 1 -- 172.21.15.87:0/4087031934 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7ff4800ee2f0 con 0x7ff488105a80 2024-09-13T17:11:28.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.716+0000 7ff487fff640 1 --2- 172.21.15.87:0/4087031934 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff4700a1090 0x7ff4700a3550 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff478005fd0 tx=0x7ff47800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:28.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.720+0000 7ff4857fa640 1 -- 172.21.15.87:0/4087031934 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff4800b7890 con 0x7ff488105a80 2024-09-13T17:11:28.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.916+0000 7ff48e765640 1 -- 172.21.15.87:0/4087031934 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4880fb960 con 0x7ff488105a80 2024-09-13T17:11:28.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.916+0000 7ff4857fa640 1 -- 172.21.15.87:0/4087031934 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+10816 (secure 0 0 0) 0x7ff4800baeb0 con 0x7ff488105a80 2024-09-13T17:11:28.917 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:11:28.917 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/3674545180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":3674545180},{"type":"v1","addr":"172.21.15.87:6841","nonce":3674545180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24446,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24470,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6839/3052680456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3052680456},{"type":"v1","addr":"172.21.15.118:6839","nonce":3052680456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:11:23.313609+0000","modified":"2024-09-13T17:11:27.679767+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24499},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T17:11:28.918 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 17 2024-09-13T17:11:28.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.918+0000 7ff48e765640 1 -- 172.21.15.87:0/4087031934 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff4700a1090 msgr2=0x7ff4700a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:28.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.918+0000 7ff48e765640 1 --2- 172.21.15.87:0/4087031934 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff4700a1090 0x7ff4700a3550 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff478005fd0 tx=0x7ff47800b390 comp rx=0 tx=0).stop 2024-09-13T17:11:28.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.918+0000 7ff48e765640 1 -- 172.21.15.87:0/4087031934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff488105a80 msgr2=0x7ff48819d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:28.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.918+0000 7ff48e765640 1 --2- 172.21.15.87:0/4087031934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff488105a80 0x7ff48819d3b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff48002aeb0 tx=0x7ff480031700 comp rx=0 tx=0).stop 2024-09-13T17:11:28.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.918+0000 7ff48e765640 1 -- 172.21.15.87:0/4087031934 shutdown_connections 2024-09-13T17:11:28.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.918+0000 7ff48e765640 1 --2- 172.21.15.87:0/4087031934 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff4700a1090 0x7ff4700a3550 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:28.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.918+0000 7ff48e765640 1 --2- 172.21.15.87:0/4087031934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff488105a80 0x7ff48819d3b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:28.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.918+0000 7ff48e765640 1 --2- 172.21.15.87:0/4087031934 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff488103150 0x7ff488196340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:28.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.918+0000 7ff48e765640 1 --2- 172.21.15.87:0/4087031934 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff488100820 0x7ff488195e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:28.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.918+0000 7ff48e765640 1 -- 172.21.15.87:0/4087031934 >> 172.21.15.87:0/4087031934 conn(0x7ff4880fa400 msgr2=0x7ff488101080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:28.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.918+0000 7ff48e765640 1 -- 172.21.15.87:0/4087031934 shutdown_connections 2024-09-13T17:11:28.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:28.918+0000 7ff48e765640 1 -- 172.21.15.87:0/4087031934 wait complete. 2024-09-13T17:11:28.930 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:11:29.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.028+0000 7fd0e1096640 1 -- 172.21.15.87:0/1373472799 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0dc100fa0 msgr2=0x7fd0dc101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:29.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.028+0000 7fd0e1096640 1 --2- 172.21.15.87:0/1373472799 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0dc100fa0 0x7fd0dc101420 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd0d0009900 tx=0x7fd0d002a410 comp rx=0 tx=0).stop 2024-09-13T17:11:29.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.028+0000 7fd0e1096640 1 -- 172.21.15.87:0/1373472799 shutdown_connections 2024-09-13T17:11:29.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.028+0000 7fd0e1096640 1 --2- 172.21.15.87:0/1373472799 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0dc101960 0x7fd0dc1081f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.028+0000 7fd0e1096640 1 --2- 172.21.15.87:0/1373472799 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0dc100fa0 0x7fd0dc101420 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.028+0000 7fd0e1096640 1 --2- 172.21.15.87:0/1373472799 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0dc0ffdb0 0x7fd0dc1001b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.028+0000 7fd0e1096640 1 -- 172.21.15.87:0/1373472799 >> 172.21.15.87:0/1373472799 conn(0x7fd0dc0fb510 msgr2=0x7fd0dc0fd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:29.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.028+0000 7fd0e1096640 1 -- 172.21.15.87:0/1373472799 shutdown_connections 2024-09-13T17:11:29.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.028+0000 7fd0e1096640 1 -- 172.21.15.87:0/1373472799 wait complete. 2024-09-13T17:11:29.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.029+0000 7fd0e1096640 1 Processor -- start 2024-09-13T17:11:29.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.029+0000 7fd0e1096640 1 -- start start 2024-09-13T17:11:29.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.029+0000 7fd0e1096640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0dc0ffdb0 0x7fd0dc195da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:29.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.029+0000 7fd0e1096640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0dc100fa0 0x7fd0dc1962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:29.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.029+0000 7fd0e1096640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0dc101960 0x7fd0dc19d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:29.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.029+0000 7fd0e1096640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc19d880 con 0x7fd0dc0ffdb0 2024-09-13T17:11:29.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.029+0000 7fd0e1096640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc19d9f0 con 0x7fd0dc100fa0 2024-09-13T17:11:29.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.029+0000 7fd0e1096640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc19dbb0 con 0x7fd0dc101960 2024-09-13T17:11:29.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.029+0000 7fd0dad9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0dc0ffdb0 0x7fd0dc195da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:29.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.029+0000 7fd0dad9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0dc0ffdb0 0x7fd0dc195da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58258/0 (socket says 172.21.15.87:58258) 2024-09-13T17:11:29.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.030+0000 7fd0dad9d640 1 -- 172.21.15.87:0/603179154 learned_addr learned my addr 172.21.15.87:0/603179154 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:29.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.030+0000 7fd0db59e640 1 --2- 172.21.15.87:0/603179154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0dc101960 0x7fd0dc19d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:29.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.030+0000 7fd0da59c640 1 --2- 172.21.15.87:0/603179154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0dc100fa0 0x7fd0dc1962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:29.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.030+0000 7fd0dad9d640 1 -- 172.21.15.87:0/603179154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0dc101960 msgr2=0x7fd0dc19d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:29.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.030+0000 7fd0dad9d640 1 --2- 172.21.15.87:0/603179154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0dc101960 0x7fd0dc19d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.030+0000 7fd0dad9d640 1 -- 172.21.15.87:0/603179154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0dc100fa0 msgr2=0x7fd0dc1962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:29.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.030+0000 7fd0dad9d640 1 --2- 172.21.15.87:0/603179154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0dc100fa0 0x7fd0dc1962e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.030+0000 7fd0dad9d640 1 -- 172.21.15.87:0/603179154 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d0009560 con 0x7fd0dc0ffdb0 2024-09-13T17:11:29.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.030+0000 7fd0dad9d640 1 --2- 172.21.15.87:0/603179154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0dc0ffdb0 0x7fd0dc195da0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc00ea80 tx=0x7fd0cc00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:29.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.030+0000 7fd0c3fff640 1 -- 172.21.15.87:0/603179154 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc00ce40 con 0x7fd0dc0ffdb0 2024-09-13T17:11:29.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.030+0000 7fd0c3fff640 1 -- 172.21.15.87:0/603179154 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd0cc011920 con 0x7fd0dc0ffdb0 2024-09-13T17:11:29.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.030+0000 7fd0e1096640 1 -- 172.21.15.87:0/603179154 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0dc19de90 con 0x7fd0dc0ffdb0 2024-09-13T17:11:29.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.030+0000 7fd0c3fff640 1 -- 172.21.15.87:0/603179154 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc01aa70 con 0x7fd0dc0ffdb0 2024-09-13T17:11:29.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.030+0000 7fd0e1096640 1 -- 172.21.15.87:0/603179154 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0dc19e2b0 con 0x7fd0dc0ffdb0 2024-09-13T17:11:29.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.031+0000 7fd0e1096640 1 -- 172.21.15.87:0/603179154 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0dc107290 con 0x7fd0dc0ffdb0 2024-09-13T17:11:29.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.032+0000 7fd0c3fff640 1 -- 172.21.15.87:0/603179154 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd0cc011a90 con 0x7fd0dc0ffdb0 2024-09-13T17:11:29.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.033+0000 7fd0c3fff640 1 --2- 172.21.15.87:0/603179154 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd0c40a1090 0x7fd0c40a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:29.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.033+0000 7fd0da59c640 1 --2- 172.21.15.87:0/603179154 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd0c40a1090 0x7fd0c40a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:29.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.033+0000 7fd0c3fff640 1 -- 172.21.15.87:0/603179154 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fd0cc0cd0f0 con 0x7fd0dc0ffdb0 2024-09-13T17:11:29.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.033+0000 7fd0da59c640 1 --2- 172.21.15.87:0/603179154 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd0c40a1090 0x7fd0c40a3550 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd0d002a930 tx=0x7fd0d0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:29.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.037+0000 7fd0c3fff640 1 -- 172.21.15.87:0/603179154 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd0cc096600 con 0x7fd0dc0ffdb0 2024-09-13T17:11:29.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.201+0000 7fd0e1096640 1 -- 172.21.15.87:0/603179154 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0dc10b6a0 con 0x7fd0dc0ffdb0 2024-09-13T17:11:29.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.202+0000 7fd0c3fff640 1 -- 172.21.15.87:0/603179154 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+23971 (secure 0 0 0) 0x7fd0cc098530 con 0x7fd0dc0ffdb0 2024-09-13T17:11:29.204 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:11:29.204 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":89,"fsid":"043d5bae-71f2-11ef-bceb-c7b262605968","created":"2024-09-13T17:03:57.852010+0000","modified":"2024-09-13T17:11:27.679526+0000","last_up_change":"2024-09-13T17:10:34.423548+0000","last_in_change":"2024-09-13T17:10:14.228123+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:07:02.286400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:11:21.965141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:11:22.504345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:11:25.565163+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58250283-85c0-416e-abdd-1fc5a7ff0c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6803","nonce":1316956138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6805","nonce":1316956138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6809","nonce":1316956138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6807","nonce":1316956138}]},"public_addr":"172.21.15.87:6803/1316956138","cluster_addr":"172.21.15.87:6805/1316956138","heartbeat_back_addr":"172.21.15.87:6809/1316956138","heartbeat_front_addr":"172.21.15.87:6807/1316956138","state":["exists","up"]},{"osd":1,"uuid":"b9d49969-94b1-4262-b4ff-db0a8e3331af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6801","nonce":3352566727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6803","nonce":3352566727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6807","nonce":3352566727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6805","nonce":3352566727}]},"public_addr":"172.21.15.118:6801/3352566727","cluster_addr":"172.21.15.118:6803/3352566727","heartbeat_back_addr":"172.21.15.118:6807/3352566727","heartbeat_front_addr":"172.21.15.118:6805/3352566727","state":["exists","up"]},{"osd":2,"uuid":"ba64549e-d736-426f-b466-f569af5f16d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6801","nonce":2774581686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6803","nonce":2774581686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6807","nonce":2774581686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6805","nonce":2774581686}]},"public_addr":"172.21.15.149:6801/2774581686","cluster_addr":"172.21.15.149:6803/2774581686","heartbeat_back_addr":"172.21.15.149:6807/2774581686","heartbeat_front_addr":"172.21.15.149:6805/2774581686","state":["exists","up"]},{"osd":3,"uuid":"3d5553e5-371b-49fd-976b-9e72a97a2f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6811","nonce":3306119066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6813","nonce":3306119066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6817","nonce":3306119066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6815","nonce":3306119066}]},"public_addr":"172.21.15.87:6811/3306119066","cluster_addr":"172.21.15.87:6813/3306119066","heartbeat_back_addr":"172.21.15.87:6817/3306119066","heartbeat_front_addr":"172.21.15.87:6815/3306119066","state":["exists","up"]},{"osd":4,"uuid":"2fbe0e27-34ec-42a6-9962-f1d8202b3159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6809","nonce":3342349890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6811","nonce":3342349890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6815","nonce":3342349890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6813","nonce":3342349890}]},"public_addr":"172.21.15.118:6809/3342349890","cluster_addr":"172.21.15.118:6811/3342349890","heartbeat_back_addr":"172.21.15.118:6815/3342349890","heartbeat_front_addr":"172.21.15.118:6813/3342349890","state":["exists","up"]},{"osd":5,"uuid":"53c14519-6170-4b5a-a79d-4835882d7bec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6809","nonce":3468867124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6811","nonce":3468867124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6815","nonce":3468867124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6813","nonce":3468867124}]},"public_addr":"172.21.15.149:6809/3468867124","cluster_addr":"172.21.15.149:6811/3468867124","heartbeat_back_addr":"172.21.15.149:6815/3468867124","heartbeat_front_addr":"172.21.15.149:6813/3468867124","state":["exists","up"]},{"osd":6,"uuid":"d3951b32-db77-4b8b-9de0-f05e03d13f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6819","nonce":326563617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6821","nonce":326563617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6825","nonce":326563617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6823","nonce":326563617}]},"public_addr":"172.21.15.87:6819/326563617","cluster_addr":"172.21.15.87:6821/326563617","heartbeat_back_addr":"172.21.15.87:6825/326563617","heartbeat_front_addr":"172.21.15.87:6823/326563617","state":["exists","up"]},{"osd":7,"uuid":"4d46dab7-a8bf-4e3e-b5c0-43860d336bdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6817","nonce":1690268990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6819","nonce":1690268990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6823","nonce":1690268990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6821","nonce":1690268990}]},"public_addr":"172.21.15.118:6817/1690268990","cluster_addr":"172.21.15.118:6819/1690268990","heartbeat_back_addr":"172.21.15.118:6823/1690268990","heartbeat_front_addr":"172.21.15.118:6821/1690268990","state":["exists","up"]},{"osd":8,"uuid":"5a015a7d-60a3-4412-96af-1b61d2ad51f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6817","nonce":1558675380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6819","nonce":1558675380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6823","nonce":1558675380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6821","nonce":1558675380}]},"public_addr":"172.21.15.149:6817/1558675380","cluster_addr":"172.21.15.149:6819/1558675380","heartbeat_back_addr":"172.21.15.149:6823/1558675380","heartbeat_front_addr":"172.21.15.149:6821/1558675380","state":["exists","up"]},{"osd":9,"uuid":"248c0b6e-4c4e-4c63-a0dd-e4cdf3b997a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6827","nonce":1453934262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6829","nonce":1453934262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6833","nonce":1453934262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6831","nonce":1453934262}]},"public_addr":"172.21.15.87:6827/1453934262","cluster_addr":"172.21.15.87:6829/1453934262","heartbeat_back_addr":"172.21.15.87:6833/1453934262","heartbeat_front_addr":"172.21.15.87:6831/1453934262","state":["exists","up"]},{"osd":10,"uuid":"24238714-e737-4371-b5d5-0cd3395f09bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6825","nonce":1034318850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6827","nonce":1034318850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6831","nonce":1034318850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6829","nonce":1034318850}]},"public_addr":"172.21.15.118:6825/1034318850","cluster_addr":"172.21.15.118:6827/1034318850","heartbeat_back_addr":"172.21.15.118:6831/1034318850","heartbeat_front_addr":"172.21.15.118:6829/1034318850","state":["exists","up"]},{"osd":11,"uuid":"409dd3bf-5154-4dea-8708-7de7f9e2e793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6825","nonce":271000465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6827","nonce":271000465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6831","nonce":271000465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6829","nonce":271000465}]},"public_addr":"172.21.15.149:6825/271000465","cluster_addr":"172.21.15.149:6827/271000465","heartbeat_back_addr":"172.21.15.149:6831/271000465","heartbeat_front_addr":"172.21.15.149:6829/271000465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:16.382664+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:37.914250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:00.425876+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:23.960183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:47.004088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:10.214345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:33.719221+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:57.099599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:20.971881+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:44.827167+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:08.135516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:32.085853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/586423689":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6801/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6800/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/3270371628":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/515676743":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/1475107314":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/553289143":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/3403361612":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6801/1587363880":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6800/1587363880":"2024-09-14T17:04:24.083789+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:11:29.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.205+0000 7fd0e1096640 1 -- 172.21.15.87:0/603179154 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd0c40a1090 msgr2=0x7fd0c40a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:29.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.205+0000 7fd0e1096640 1 --2- 172.21.15.87:0/603179154 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd0c40a1090 0x7fd0c40a3550 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd0d002a930 tx=0x7fd0d0000bc0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.205+0000 7fd0e1096640 1 -- 172.21.15.87:0/603179154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0dc0ffdb0 msgr2=0x7fd0dc195da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:29.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.205+0000 7fd0e1096640 1 --2- 172.21.15.87:0/603179154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0dc0ffdb0 0x7fd0dc195da0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc00ea80 tx=0x7fd0cc00ef40 comp rx=0 tx=0).stop 2024-09-13T17:11:29.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.205+0000 7fd0e1096640 1 -- 172.21.15.87:0/603179154 shutdown_connections 2024-09-13T17:11:29.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.205+0000 7fd0e1096640 1 --2- 172.21.15.87:0/603179154 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd0c40a1090 0x7fd0c40a3550 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.205+0000 7fd0e1096640 1 --2- 172.21.15.87:0/603179154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0dc101960 0x7fd0dc19d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.205+0000 7fd0e1096640 1 --2- 172.21.15.87:0/603179154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0dc100fa0 0x7fd0dc1962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.205+0000 7fd0e1096640 1 --2- 172.21.15.87:0/603179154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0dc0ffdb0 0x7fd0dc195da0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.205+0000 7fd0e1096640 1 -- 172.21.15.87:0/603179154 >> 172.21.15.87:0/603179154 conn(0x7fd0dc0fb510 msgr2=0x7fd0dc104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:29.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.205+0000 7fd0e1096640 1 -- 172.21.15.87:0/603179154 shutdown_connections 2024-09-13T17:11:29.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.205+0000 7fd0e1096640 1 -- 172.21.15.87:0/603179154 wait complete. 2024-09-13T17:11:29.217 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T17:11:23.313609+0000', 'modified': '2024-09-13T17:11:27.679767+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24499}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24499': {'gid': 24499, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.149:6839/2938961956', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6838', 'nonce': 2938961956}, {'type': 'v1', 'addr': '172.21.15.149:6839', 'nonce': 2938961956}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-09-13T17:11:29.217 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T17:11:29.217 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-09-13T17:11:29.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.316+0000 7f48846e5640 1 -- 172.21.15.87:0/3571495875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f487c0fffb0 msgr2=0x7f487c106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:29.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.316+0000 7f48846e5640 1 --2- 172.21.15.87:0/3571495875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f487c0fffb0 0x7f487c106840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f487400adb0 tx=0x7f487402b7a0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.316+0000 7f48846e5640 1 -- 172.21.15.87:0/3571495875 shutdown_connections 2024-09-13T17:11:29.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.316+0000 7f48846e5640 1 --2- 172.21.15.87:0/3571495875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f487c0fffb0 0x7f487c106840 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.316+0000 7f48846e5640 1 --2- 172.21.15.87:0/3571495875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f487c0ff5f0 0x7f487c0ffa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.316+0000 7f48846e5640 1 --2- 172.21.15.87:0/3571495875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f487c0fe400 0x7f487c0fe800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.316+0000 7f48846e5640 1 -- 172.21.15.87:0/3571495875 >> 172.21.15.87:0/3571495875 conn(0x7f487c0f9b60 msgr2=0x7f487c0fbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:29.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.316+0000 7f48846e5640 1 -- 172.21.15.87:0/3571495875 shutdown_connections 2024-09-13T17:11:29.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.316+0000 7f48846e5640 1 -- 172.21.15.87:0/3571495875 wait complete. 2024-09-13T17:11:29.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.317+0000 7f48846e5640 1 Processor -- start 2024-09-13T17:11:29.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.317+0000 7f48846e5640 1 -- start start 2024-09-13T17:11:29.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.317+0000 7f48846e5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f487c0fe400 0x7f487c102390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:29.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.317+0000 7f48846e5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f487c0ff5f0 0x7f487c1009d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:29.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.317+0000 7f48846e5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f487c0fffb0 0x7f487c100f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:29.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.317+0000 7f48846e5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c101670 con 0x7f487c0ff5f0 2024-09-13T17:11:29.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.317+0000 7f48846e5640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c1017e0 con 0x7f487c0fe400 2024-09-13T17:11:29.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.317+0000 7f48846e5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c19fd70 con 0x7f487c0fffb0 2024-09-13T17:11:29.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.317+0000 7f4881c80640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f487c0ff5f0 0x7f487c1009d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:29.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.317+0000 7f4881c80640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f487c0ff5f0 0x7f487c1009d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46340/0 (socket says 172.21.15.87:46340) 2024-09-13T17:11:29.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.317+0000 7f4881c80640 1 -- 172.21.15.87:0/602474731 learned_addr learned my addr 172.21.15.87:0/602474731 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:29.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.317+0000 7f4882481640 1 --2- 172.21.15.87:0/602474731 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f487c0fe400 0x7f487c102390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:29.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.317+0000 7f4882c82640 1 --2- 172.21.15.87:0/602474731 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f487c0fffb0 0x7f487c100f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:29.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.317+0000 7f4881c80640 1 -- 172.21.15.87:0/602474731 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f487c0fffb0 msgr2=0x7f487c100f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:29.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.317+0000 7f4881c80640 1 --2- 172.21.15.87:0/602474731 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f487c0fffb0 0x7f487c100f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.318+0000 7f4881c80640 1 -- 172.21.15.87:0/602474731 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f487c0fe400 msgr2=0x7f487c102390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:29.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.318+0000 7f4881c80640 1 --2- 172.21.15.87:0/602474731 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f487c0fe400 0x7f487c102390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.318+0000 7f4881c80640 1 -- 172.21.15.87:0/602474731 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487400aa10 con 0x7f487c0ff5f0 2024-09-13T17:11:29.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.318+0000 7f4881c80640 1 --2- 172.21.15.87:0/602474731 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f487c0ff5f0 0x7f487c1009d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f486c00d980 tx=0x7f486c00de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:29.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.318+0000 7f48737fe640 1 -- 172.21.15.87:0/602474731 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c009a30 con 0x7f487c0ff5f0 2024-09-13T17:11:29.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.318+0000 7f48737fe640 1 -- 172.21.15.87:0/602474731 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f486c0044d0 con 0x7f487c0ff5f0 2024-09-13T17:11:29.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.318+0000 7f48846e5640 1 -- 172.21.15.87:0/602474731 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f487c19ffc0 con 0x7f487c0ff5f0 2024-09-13T17:11:29.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.318+0000 7f48737fe640 1 -- 172.21.15.87:0/602474731 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c0047a0 con 0x7f487c0ff5f0 2024-09-13T17:11:29.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.318+0000 7f48846e5640 1 -- 172.21.15.87:0/602474731 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f487c1a04f0 con 0x7f487c0ff5f0 2024-09-13T17:11:29.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.321+0000 7f4887407740 1 Processor -- start 2024-09-13T17:11:29.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.321+0000 7f4887407740 1 -- start start 2024-09-13T17:11:29.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.321+0000 7f48737fe640 1 -- 172.21.15.87:0/602474731 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f486c004020 con 0x7f487c0ff5f0 2024-09-13T17:11:29.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.321+0000 7f4887407740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b201826500 0x55b201826900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:29.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.321+0000 7f4887407740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b201826e40 0x55b20182b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:29.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.321+0000 7f4887407740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b20182bed0 0x55b20182e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:29.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.321+0000 7f4887407740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2017817c0 con 0x55b20182bed0 2024-09-13T17:11:29.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.321+0000 7f4887407740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b201790b70 con 0x55b201826e40 2024-09-13T17:11:29.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.321+0000 7f4887407740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20178e300 con 0x55b201826500 2024-09-13T17:11:29.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.321+0000 7f4881c80640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b20182bed0 0x55b20182e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:29.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.321+0000 7f4881c80640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b20182bed0 0x55b20182e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46346/0 (socket says 172.21.15.87:46346) 2024-09-13T17:11:29.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.321+0000 7f4881c80640 1 -- 172.21.15.87:0/3272538070 learned_addr learned my addr 172.21.15.87:0/3272538070 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:29.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.321+0000 7f4882481640 1 --2- 172.21.15.87:0/3272538070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b201826e40 0x55b20182b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:29.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.321+0000 7f4882c82640 1 --2- 172.21.15.87:0/3272538070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b201826500 0x55b201826900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:29.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.321+0000 7f4881c80640 1 -- 172.21.15.87:0/3272538070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b201826500 msgr2=0x55b201826900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:11:29.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.321+0000 7f4881c80640 1 --2- 172.21.15.87:0/3272538070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b201826500 0x55b201826900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.321+0000 7f4881c80640 1 -- 172.21.15.87:0/3272538070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b201826e40 msgr2=0x55b20182b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:11:29.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.321+0000 7f4881c80640 1 --2- 172.21.15.87:0/3272538070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b201826e40 0x55b20182b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.322+0000 7f4881c80640 1 -- 172.21.15.87:0/3272538070 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2017164b0 con 0x55b20182bed0 2024-09-13T17:11:29.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.322+0000 7f4882c82640 1 --2- 172.21.15.87:0/3272538070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b201826500 0x55b201826900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:11:29.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.322+0000 7f4881c80640 1 --2- 172.21.15.87:0/3272538070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b20182bed0 0x55b20182e390 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f486c0d2410 tx=0x7f486c0d28d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afd7da9ac945435e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:29.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.322+0000 7f48737fe640 1 --2- 172.21.15.87:0/602474731 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f48680a1110 0x7f48680a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:29.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.322+0000 7f4882c82640 1 --2- 172.21.15.87:0/602474731 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f48680a1110 0x7f48680a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:29.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.322+0000 7f4870ff9640 1 -- 172.21.15.87:0/3272538070 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c095a00 con 0x55b20182bed0 2024-09-13T17:11:29.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.322+0000 7f48737fe640 1 -- 172.21.15.87:0/602474731 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f486c0cc460 con 0x7f487c0ff5f0 2024-09-13T17:11:29.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.322+0000 7f4870ff9640 1 -- 172.21.15.87:0/3272538070 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f486c099490 con 0x55b20182bed0 2024-09-13T17:11:29.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.322+0000 7f4870ff9640 1 -- 172.21.15.87:0/3272538070 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c099200 con 0x55b20182bed0 2024-09-13T17:11:29.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.323+0000 7f4887407740 1 -- 172.21.15.87:0/3272538070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b20182bed0 msgr2=0x55b20182e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:29.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.323+0000 7f4887407740 1 --2- 172.21.15.87:0/3272538070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b20182bed0 0x55b20182e390 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f486c0d2410 tx=0x7f486c0d28d0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.323+0000 7f4882c82640 1 --2- 172.21.15.87:0/602474731 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f48680a1110 0x7f48680a35d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4874031040 tx=0x7f487400a910 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:29.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.323+0000 7f4887407740 1 -- 172.21.15.87:0/3272538070 shutdown_connections 2024-09-13T17:11:29.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.323+0000 7f4887407740 1 --2- 172.21.15.87:0/3272538070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b20182bed0 0x55b20182e390 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.323+0000 7f4887407740 1 --2- 172.21.15.87:0/3272538070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b201826e40 0x55b20182b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.323+0000 7f4887407740 1 --2- 172.21.15.87:0/3272538070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b201826500 0x55b201826900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.323+0000 7f4887407740 1 -- 172.21.15.87:0/3272538070 >> 172.21.15.87:0/3272538070 conn(0x55b201821b70 msgr2=0x55b201821f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:29.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.323+0000 7f4887407740 1 -- 172.21.15.87:0/3272538070 shutdown_connections 2024-09-13T17:11:29.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.323+0000 7f4887407740 1 -- 172.21.15.87:0/3272538070 wait complete. 2024-09-13T17:11:29.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.323+0000 7f4887407740 1 -- start start 2024-09-13T17:11:29.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.323+0000 7f4887407740 1 Processor -- start 2024-09-13T17:11:29.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.323+0000 7f4887407740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b201826500 0x55b2018301d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:29.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.323+0000 7f4887407740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b201826e40 0x55b201830710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:29.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.323+0000 7f4887407740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b20182bed0 0x55b201837700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:29.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.323+0000 7f4887407740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b201789bf0 con 0x55b201826500 2024-09-13T17:11:29.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.323+0000 7f4887407740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b201748250 con 0x55b201826e40 2024-09-13T17:11:29.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.323+0000 7f4887407740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b201747ef0 con 0x55b20182bed0 2024-09-13T17:11:29.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.323+0000 7f4887407740 10 client.0 _ll_register_callbacks cb 0x55b20177a740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:11:29.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.323+0000 7f4882481640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b201826500 0x55b2018301d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:29.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.324+0000 7f4882481640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b201826500 0x55b2018301d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46362/0 (socket says 172.21.15.87:46362) 2024-09-13T17:11:29.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.324+0000 7f4882481640 1 -- 172.21.15.87:0/3100499036 learned_addr learned my addr 172.21.15.87:0/3100499036 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:29.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.324+0000 7f4881c80640 1 --2- 172.21.15.87:0/3100499036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b201826e40 0x55b201830710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:29.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.324+0000 7f4882c82640 1 --2- 172.21.15.87:0/3100499036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b20182bed0 0x55b201837700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:29.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.324+0000 7f4882481640 1 -- 172.21.15.87:0/3100499036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b20182bed0 msgr2=0x55b201837700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:11:29.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.324+0000 7f4882481640 1 --2- 172.21.15.87:0/3100499036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b20182bed0 0x55b201837700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.324+0000 7f4882481640 1 -- 172.21.15.87:0/3100499036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b201826e40 msgr2=0x55b201830710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:11:29.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.324+0000 7f4882481640 1 --2- 172.21.15.87:0/3100499036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b201826e40 0x55b201830710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.324+0000 7f4882481640 1 -- 172.21.15.87:0/3100499036 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f487c1a04f0 con 0x55b201826500 2024-09-13T17:11:29.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.324+0000 7f4882481640 1 --2- 172.21.15.87:0/3100499036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b201826500 0x55b2018301d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f48780126e0 tx=0x7f4878012ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=776d1a67da0e9ccf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:29.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.324+0000 7f4865ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:11:29.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.324+0000 7f4865ffb640 1 -- 172.21.15.87:0/3100499036 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4878017070 con 0x55b201826500 2024-09-13T17:11:29.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.324+0000 7f4865ffb640 1 -- 172.21.15.87:0/3100499036 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f48780121d0 con 0x55b201826500 2024-09-13T17:11:29.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.324+0000 7f4887407740 1 -- 172.21.15.87:0/3100499036 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b20147d3c0 con 0x55b201826500 2024-09-13T17:11:29.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.324+0000 7f4865ffb640 1 -- 172.21.15.87:0/3100499036 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4878004050 con 0x55b201826500 2024-09-13T17:11:29.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.324+0000 7f4887407740 10 client.14751 fetch_fsmap learned FSMap version 17 2024-09-13T17:11:29.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.324+0000 7f4887407740 1 -- 172.21.15.87:0/3100499036 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) v3 -- 0x55b201788270 con 0x55b201826500 2024-09-13T17:11:29.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.324+0000 7f4865ffb640 1 -- 172.21.15.87:0/3100499036 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55b20147d3c0 con 0x55b201826500 2024-09-13T17:11:29.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.325+0000 7f4865ffb640 1 -- 172.21.15.87:0/3100499036 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 17) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f4878003710 con 0x55b201826500 2024-09-13T17:11:29.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.325+0000 7f4887407740 10 client.14751 fetch_fsmap finished waiting for FSMap version 17 2024-09-13T17:11:29.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.325+0000 7f4887407740 10 client.14751 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-13T17:11:29.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.325+0000 7f4887407740 20 client.14751 populate_metadata read hostname 'smithi087' 2024-09-13T17:11:29.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.325+0000 7f4887407740 1 --2- 172.21.15.87:0/3100499036 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b20183c670 0x55b201840810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:29.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.325+0000 7f4887407740 4 client.14751 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:11:29.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.325+0000 7f4887407740 1 -- 172.21.15.87:0/3100499036 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b20148e6c0 con 0x55b20183c670 2024-09-13T17:11:29.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.325+0000 7f4881c80640 1 --2- 172.21.15.87:0/3100499036 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b20183c670 0x55b201840810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:29.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.325+0000 7f4865ffb640 10 client.14751 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:11:29.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.325+0000 7f4881c80640 1 --2- 172.21.15.87:0/3100499036 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b20183c670 0x55b201840810 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80752d88982e5244 server_cookie=34d56d2dfc90d2ca in_seq=0 out_seq=0 2024-09-13T17:11:29.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.326+0000 7f4865ffb640 1 -- 172.21.15.87:0/3100499036 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55b20148e6c0 con 0x55b20183c670 2024-09-13T17:11:29.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.326+0000 7f4865ffb640 10 client.14751 handle_command_reply: tid=0 2024-09-13T17:11:29.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.326+0000 7f4887407740 1 client.14751 shutdown 2024-09-13T17:11:29.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.326+0000 7f4887407740 1 -- 172.21.15.87:0/3100499036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b201826500 msgr2=0x55b2018301d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:29.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.326+0000 7f4887407740 1 --2- 172.21.15.87:0/3100499036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b201826500 0x55b2018301d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f48780126e0 tx=0x7f4878012ba0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.326+0000 7f4887407740 1 -- 172.21.15.87:0/3100499036 shutdown_connections 2024-09-13T17:11:29.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.326+0000 7f4887407740 1 --2- 172.21.15.87:0/3100499036 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b20183c670 0x55b201840810 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.326+0000 7f4887407740 1 --2- 172.21.15.87:0/3100499036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b20182bed0 0x55b201837700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.326+0000 7f4887407740 1 --2- 172.21.15.87:0/3100499036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b201826e40 0x55b201830710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.326+0000 7f4865ffb640 0 client.14751 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:11:29.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.326+0000 7f4887407740 1 --2- 172.21.15.87:0/3100499036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b201826500 0x55b2018301d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.326+0000 7f4887407740 1 -- 172.21.15.87:0/3100499036 >> 172.21.15.87:0/3100499036 conn(0x55b201821b70 msgr2=0x55b201823380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:29.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.326+0000 7f4887407740 1 -- 172.21.15.87:0/3100499036 shutdown_connections 2024-09-13T17:11:29.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.326+0000 7f4887407740 1 -- 172.21.15.87:0/3100499036 wait complete. 2024-09-13T17:11:29.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.326+0000 7f4887407740 20 client.14751 trim_cache size 0 max 16384 2024-09-13T17:11:29.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.341+0000 7f4887407740 1 Processor -- start 2024-09-13T17:11:29.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.341+0000 7f4887407740 1 -- start start 2024-09-13T17:11:29.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.341+0000 7f4887407740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b201826500 0x55b20182ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:29.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.341+0000 7f4887407740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b201826e40 0x55b201837620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:29.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.341+0000 7f4887407740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b20182bed0 0x55b2018304c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:29.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.341+0000 7f4887407740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20182fda0 con 0x55b20182bed0 2024-09-13T17:11:29.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.341+0000 7f4887407740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20170d460 con 0x55b201826500 2024-09-13T17:11:29.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.341+0000 7f4887407740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b201782990 con 0x55b201826e40 2024-09-13T17:11:29.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.341+0000 7f4882c82640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b20182bed0 0x55b2018304c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:29.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.341+0000 7f4882c82640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b20182bed0 0x55b2018304c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46376/0 (socket says 172.21.15.87:46376) 2024-09-13T17:11:29.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.341+0000 7f4882c82640 1 -- 172.21.15.87:0/3759194568 learned_addr learned my addr 172.21.15.87:0/3759194568 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:29.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.341+0000 7f4881c80640 1 --2- 172.21.15.87:0/3759194568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b201826e40 0x55b201837620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:29.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.341+0000 7f4882481640 1 --2- 172.21.15.87:0/3759194568 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b201826500 0x55b20182ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:29.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.341+0000 7f4882c82640 1 -- 172.21.15.87:0/3759194568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b201826e40 msgr2=0x55b201837620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:11:29.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.341+0000 7f4882c82640 1 --2- 172.21.15.87:0/3759194568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b201826e40 0x55b201837620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.341+0000 7f4882c82640 1 -- 172.21.15.87:0/3759194568 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b201826500 msgr2=0x55b20182ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:11:29.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.341+0000 7f4882c82640 1 --2- 172.21.15.87:0/3759194568 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b201826500 0x55b20182ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.342+0000 7f4882c82640 1 -- 172.21.15.87:0/3759194568 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b20172a5f0 con 0x55b20182bed0 2024-09-13T17:11:29.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.342+0000 7f4882c82640 1 --2- 172.21.15.87:0/3759194568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b20182bed0 0x55b2018304c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4874032890 tx=0x7f4874040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc7beae6650cc31 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:29.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.343+0000 7f48717fa640 1 -- 172.21.15.87:0/3759194568 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4874004040 con 0x55b20182bed0 2024-09-13T17:11:29.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.344+0000 7f48717fa640 1 -- 172.21.15.87:0/3759194568 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4874042070 con 0x55b20182bed0 2024-09-13T17:11:29.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.344+0000 7f48717fa640 1 -- 172.21.15.87:0/3759194568 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4874030ab0 con 0x55b20182bed0 2024-09-13T17:11:29.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.344+0000 7f4887407740 1 -- 172.21.15.87:0/3759194568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b20182bed0 msgr2=0x55b2018304c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:29.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.344+0000 7f4887407740 1 --2- 172.21.15.87:0/3759194568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b20182bed0 0x55b2018304c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4874032890 tx=0x7f4874040000 comp rx=0 tx=0).stop 2024-09-13T17:11:29.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.344+0000 7f4887407740 1 -- 172.21.15.87:0/3759194568 shutdown_connections 2024-09-13T17:11:29.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.344+0000 7f4887407740 1 --2- 172.21.15.87:0/3759194568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b20182bed0 0x55b2018304c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.344+0000 7f4887407740 1 --2- 172.21.15.87:0/3759194568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b201826e40 0x55b201837620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.344+0000 7f4887407740 1 --2- 172.21.15.87:0/3759194568 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b201826500 0x55b20182ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.344+0000 7f4887407740 1 -- 172.21.15.87:0/3759194568 >> 172.21.15.87:0/3759194568 conn(0x55b201821b70 msgr2=0x55b201827d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:29.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.344+0000 7f4887407740 1 -- 172.21.15.87:0/3759194568 shutdown_connections 2024-09-13T17:11:29.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.344+0000 7f4887407740 1 -- 172.21.15.87:0/3759194568 wait complete. 2024-09-13T17:11:29.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.344+0000 7f4887407740 1 -- start start 2024-09-13T17:11:29.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.345+0000 7f4887407740 1 Processor -- start 2024-09-13T17:11:29.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.345+0000 7f4887407740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b201826500 0x55b2018320c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:29.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.345+0000 7f4887407740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b201826e40 0x55b2018375e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:29.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.345+0000 7f4887407740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b20182bed0 0x55b201832640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:29.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.345+0000 7f4887407740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b201832d40 con 0x55b20182bed0 2024-09-13T17:11:29.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.345+0000 7f4887407740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b201892500 con 0x55b201826e40 2024-09-13T17:11:29.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.345+0000 7f4887407740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2018926c0 con 0x55b201826500 2024-09-13T17:11:29.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.345+0000 7f4887407740 10 client.0 _ll_register_callbacks cb 0x7f486c0cfdd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:11:29.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.345+0000 7f4882c82640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b20182bed0 0x55b201832640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:29.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.345+0000 7f4882c82640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b20182bed0 0x55b201832640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46386/0 (socket says 172.21.15.87:46386) 2024-09-13T17:11:29.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.345+0000 7f4882c82640 1 -- 172.21.15.87:0/1557006081 learned_addr learned my addr 172.21.15.87:0/1557006081 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:29.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.345+0000 7f4882481640 1 --2- 172.21.15.87:0/1557006081 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b201826500 0x55b2018320c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:29.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.345+0000 7f4881c80640 1 --2- 172.21.15.87:0/1557006081 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b201826e40 0x55b2018375e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:29.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.345+0000 7f4882c82640 1 -- 172.21.15.87:0/1557006081 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b201826500 msgr2=0x55b2018320c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:11:29.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.345+0000 7f4882c82640 1 --2- 172.21.15.87:0/1557006081 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b201826500 0x55b2018320c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.345+0000 7f4882c82640 1 -- 172.21.15.87:0/1557006081 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b201826e40 msgr2=0x55b2018375e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:11:29.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.345+0000 7f4882c82640 1 --2- 172.21.15.87:0/1557006081 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b201826e40 0x55b2018375e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.345+0000 7f4882c82640 1 -- 172.21.15.87:0/1557006081 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f487c107140 con 0x55b20182bed0 2024-09-13T17:11:29.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.345+0000 7f4882c82640 1 --2- 172.21.15.87:0/1557006081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b20182bed0 0x55b201832640 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4874005e30 tx=0x7f487400a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0016a8fb9f3916b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:29.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.345+0000 7f4865ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:11:29.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.345+0000 7f4865ffb640 1 -- 172.21.15.87:0/1557006081 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487405a070 con 0x55b20182bed0 2024-09-13T17:11:29.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.345+0000 7f4865ffb640 1 -- 172.21.15.87:0/1557006081 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f4874044070 con 0x55b20182bed0 2024-09-13T17:11:29.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.345+0000 7f4887407740 1 -- 172.21.15.87:0/1557006081 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f486c099490 con 0x55b20182bed0 2024-09-13T17:11:29.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.346+0000 7f4865ffb640 1 -- 172.21.15.87:0/1557006081 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4874032660 con 0x55b20182bed0 2024-09-13T17:11:29.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.346+0000 7f4887407740 10 client.14757 fetch_fsmap learned FSMap version 17 2024-09-13T17:11:29.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.346+0000 7f4887407740 1 -- 172.21.15.87:0/1557006081 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) v3 -- 0x55b20174fd00 con 0x55b20182bed0 2024-09-13T17:11:29.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.346+0000 7f4865ffb640 1 -- 172.21.15.87:0/1557006081 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f486c099490 con 0x55b20182bed0 2024-09-13T17:11:29.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.346+0000 7f4865ffb640 1 -- 172.21.15.87:0/1557006081 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 17) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f4874052020 con 0x55b20182bed0 2024-09-13T17:11:29.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.346+0000 7f4887407740 10 client.14757 fetch_fsmap finished waiting for FSMap version 17 2024-09-13T17:11:29.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.346+0000 7f4887407740 10 client.14757 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-13T17:11:29.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.346+0000 7f4887407740 20 client.14757 populate_metadata read hostname 'smithi087' 2024-09-13T17:11:29.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.346+0000 7f4887407740 1 --2- 172.21.15.87:0/1557006081 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b2018970a0 0x55b201893a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:29.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.346+0000 7f4887407740 4 client.14757 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:11:29.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.346+0000 7f4887407740 1 -- 172.21.15.87:0/1557006081 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b2014e1d10 con 0x55b2018970a0 2024-09-13T17:11:29.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.346+0000 7f4882481640 1 --2- 172.21.15.87:0/1557006081 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b2018970a0 0x55b201893a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:29.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.347+0000 7f4865ffb640 10 client.14757 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:11:29.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.347+0000 7f4882481640 1 --2- 172.21.15.87:0/1557006081 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b2018970a0 0x55b201893a30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d85746cb32882fa server_cookie=42ca0332ae090f34 in_seq=0 out_seq=0 2024-09-13T17:11:29.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.347+0000 7f4865ffb640 1 -- 172.21.15.87:0/1557006081 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55b2014e1d10 con 0x55b2018970a0 2024-09-13T17:11:29.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.347+0000 7f4865ffb640 10 client.14757 handle_command_reply: tid=0 2024-09-13T17:11:29.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.347+0000 7f4887407740 1 client.14757 shutdown 2024-09-13T17:11:29.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.347+0000 7f4887407740 1 -- 172.21.15.87:0/1557006081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b20182bed0 msgr2=0x55b201832640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:29.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.347+0000 7f4887407740 1 --2- 172.21.15.87:0/1557006081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b20182bed0 0x55b201832640 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4874005e30 tx=0x7f487400a6d0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.347+0000 7f4887407740 1 -- 172.21.15.87:0/1557006081 shutdown_connections 2024-09-13T17:11:29.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.347+0000 7f4887407740 1 --2- 172.21.15.87:0/1557006081 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b2018970a0 0x55b201893a30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.347+0000 7f4887407740 1 --2- 172.21.15.87:0/1557006081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b20182bed0 0x55b201832640 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.347+0000 7f4887407740 1 --2- 172.21.15.87:0/1557006081 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b201826e40 0x55b2018375e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.347+0000 7f4865ffb640 0 client.14757 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:11:29.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.347+0000 7f4887407740 1 --2- 172.21.15.87:0/1557006081 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b201826500 0x55b2018320c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.347+0000 7f4887407740 1 -- 172.21.15.87:0/1557006081 >> 172.21.15.87:0/1557006081 conn(0x55b201821b70 msgr2=0x55b20182af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:29.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.347+0000 7f4887407740 1 -- 172.21.15.87:0/1557006081 shutdown_connections 2024-09-13T17:11:29.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.347+0000 7f4887407740 1 -- 172.21.15.87:0/1557006081 wait complete. 2024-09-13T17:11:29.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.347+0000 7f4887407740 20 client.14757 trim_cache size 0 max 16384 2024-09-13T17:11:29.354 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:11:29.354 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_fsid": "043d5bae-71f2-11ef-bceb-c7b262605968", 2024-09-13T17:11:29.354 INFO:teuthology.orchestra.run.smithi087.stdout: "whoami": 0, 2024-09-13T17:11:29.354 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 24499, 2024-09-13T17:11:29.354 INFO:teuthology.orchestra.run.smithi087.stdout: "want_state": "up:active", 2024-09-13T17:11:29.354 INFO:teuthology.orchestra.run.smithi087.stdout: "state": "up:active", 2024-09-13T17:11:29.354 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs", 2024-09-13T17:11:29.354 INFO:teuthology.orchestra.run.smithi087.stdout: "rank_uptime": 6.0306499279999999, 2024-09-13T17:11:29.354 INFO:teuthology.orchestra.run.smithi087.stdout: "mdsmap_epoch": 17, 2024-09-13T17:11:29.355 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch": 89, 2024-09-13T17:11:29.355 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch_barrier": 88, 2024-09-13T17:11:29.355 INFO:teuthology.orchestra.run.smithi087.stdout: "uptime": 19.696139604999999 2024-09-13T17:11:29.355 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:11:29.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.347+0000 7f48846e5640 1 -- 172.21.15.87:0/602474731 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f48680a1110 msgr2=0x7f48680a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:29.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.347+0000 7f48846e5640 1 --2- 172.21.15.87:0/602474731 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f48680a1110 0x7f48680a35d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4874031040 tx=0x7f487400a910 comp rx=0 tx=0).stop 2024-09-13T17:11:29.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.347+0000 7f48846e5640 1 -- 172.21.15.87:0/602474731 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f487c0ff5f0 msgr2=0x7f487c1009d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:29.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.347+0000 7f48846e5640 1 --2- 172.21.15.87:0/602474731 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f487c0ff5f0 0x7f487c1009d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f486c00d980 tx=0x7f486c00de40 comp rx=0 tx=0).stop 2024-09-13T17:11:29.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.348+0000 7f48846e5640 1 -- 172.21.15.87:0/602474731 shutdown_connections 2024-09-13T17:11:29.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.348+0000 7f48846e5640 1 --2- 172.21.15.87:0/602474731 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f48680a1110 0x7f48680a35d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.348+0000 7f48846e5640 1 --2- 172.21.15.87:0/602474731 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f487c0fffb0 0x7f487c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.348+0000 7f48846e5640 1 --2- 172.21.15.87:0/602474731 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f487c0ff5f0 0x7f487c1009d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.348+0000 7f48846e5640 1 --2- 172.21.15.87:0/602474731 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f487c0fe400 0x7f487c102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:29.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.348+0000 7f48846e5640 1 -- 172.21.15.87:0/602474731 >> 172.21.15.87:0/602474731 conn(0x7f487c0f9b60 msgr2=0x7f487c104b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:29.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.348+0000 7f48846e5640 1 -- 172.21.15.87:0/602474731 shutdown_connections 2024-09-13T17:11:29.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:29.348+0000 7f48846e5640 1 -- 172.21.15.87:0/602474731 wait complete. 2024-09-13T17:11:29.359 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T17:11:29.359 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:11:29.359 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-13T17:11:29.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:29 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/899920315' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:11:29.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:29 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/4087031934' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:29.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:29 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/603179154' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:11:29.551 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:11:29.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:29 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/899920315' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:11:29.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:29 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/4087031934' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:29.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:29 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/603179154' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:11:29.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:29 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/899920315' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:11:29.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:29 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/4087031934' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:29.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:29 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/603179154' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:11:30.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:30 smithi118 ceph-mon[34374]: pgmap v280: 129 pgs: 4 creating+peering, 6 unknown, 119 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 3 op/s 2024-09-13T17:11:30.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:30 smithi087 ceph-mon[30934]: pgmap v280: 129 pgs: 4 creating+peering, 6 unknown, 119 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 3 op/s 2024-09-13T17:11:30.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:30 smithi149 ceph-mon[35496]: pgmap v280: 129 pgs: 4 creating+peering, 6 unknown, 119 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 3 op/s 2024-09-13T17:11:31.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.228+0000 7f68b6492640 1 -- 172.21.15.87:0/1170472493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68b01050f0 msgr2=0x7f68b010cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:31.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.228+0000 7f68b6492640 1 --2- 172.21.15.87:0/1170472493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68b01050f0 0x7f68b010cc70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f68a8009cd0 tx=0x7f68a802a8e0 comp rx=0 tx=0).stop 2024-09-13T17:11:31.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.228+0000 7f68b6492640 1 -- 172.21.15.87:0/1170472493 shutdown_connections 2024-09-13T17:11:31.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.228+0000 7f68b6492640 1 --2- 172.21.15.87:0/1170472493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68b01050f0 0x7f68b010cc70 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:31.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.228+0000 7f68b6492640 1 --2- 172.21.15.87:0/1170472493 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68b0100970 0x7f68b01049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:31.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.228+0000 7f68b6492640 1 --2- 172.21.15.87:0/1170472493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68b00fffc0 0x7f68b01003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:31.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.228+0000 7f68b6492640 1 -- 172.21.15.87:0/1170472493 >> 172.21.15.87:0/1170472493 conn(0x7f68b00fbaa0 msgr2=0x7f68b00fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:31.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.228+0000 7f68b6492640 1 -- 172.21.15.87:0/1170472493 shutdown_connections 2024-09-13T17:11:31.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.228+0000 7f68b6492640 1 -- 172.21.15.87:0/1170472493 wait complete. 2024-09-13T17:11:31.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.229+0000 7f68b6492640 1 Processor -- start 2024-09-13T17:11:31.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.229+0000 7f68b6492640 1 -- start start 2024-09-13T17:11:31.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.229+0000 7f68b6492640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68b00fffc0 0x7f68b01962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:31.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.229+0000 7f68b6492640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68b0100970 0x7f68b0196820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:31.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.229+0000 7f68b6492640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68b01050f0 0x7f68b019ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:31.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.229+0000 7f68b6492640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b019b220 con 0x7f68b00fffc0 2024-09-13T17:11:31.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.229+0000 7f68b6492640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b019b390 con 0x7f68b0100970 2024-09-13T17:11:31.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.229+0000 7f68b6492640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b019b500 con 0x7f68b01050f0 2024-09-13T17:11:31.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.229+0000 7f68affff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68b00fffc0 0x7f68b01962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:31.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.229+0000 7f68affff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68b00fffc0 0x7f68b01962e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46406/0 (socket says 172.21.15.87:46406) 2024-09-13T17:11:31.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.229+0000 7f68affff640 1 -- 172.21.15.87:0/844478349 learned_addr learned my addr 172.21.15.87:0/844478349 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:31.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.229+0000 7f68b4a2f640 1 --2- 172.21.15.87:0/844478349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68b01050f0 0x7f68b019ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:31.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.229+0000 7f68a7fff640 1 --2- 172.21.15.87:0/844478349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68b0100970 0x7f68b0196820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:31.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.229+0000 7f68affff640 1 -- 172.21.15.87:0/844478349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68b01050f0 msgr2=0x7f68b019ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:31.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.229+0000 7f68affff640 1 --2- 172.21.15.87:0/844478349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68b01050f0 0x7f68b019ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:31.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.229+0000 7f68affff640 1 -- 172.21.15.87:0/844478349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68b0100970 msgr2=0x7f68b0196820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:31.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.229+0000 7f68affff640 1 --2- 172.21.15.87:0/844478349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68b0100970 0x7f68b0196820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:31.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.229+0000 7f68affff640 1 -- 172.21.15.87:0/844478349 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a8009900 con 0x7f68b00fffc0 2024-09-13T17:11:31.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.229+0000 7f68a7fff640 1 --2- 172.21.15.87:0/844478349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68b0100970 0x7f68b0196820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:11:31.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.229+0000 7f68affff640 1 --2- 172.21.15.87:0/844478349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68b00fffc0 0x7f68b01962e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f68a000d770 tx=0x7f68a000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:31.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.230+0000 7f68adffb640 1 -- 172.21.15.87:0/844478349 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a0009c30 con 0x7f68b00fffc0 2024-09-13T17:11:31.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.230+0000 7f68adffb640 1 -- 172.21.15.87:0/844478349 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f68a000de80 con 0x7f68b00fffc0 2024-09-13T17:11:31.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.230+0000 7f68adffb640 1 -- 172.21.15.87:0/844478349 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a0004e00 con 0x7f68b00fffc0 2024-09-13T17:11:31.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.230+0000 7f68b6492640 1 -- 172.21.15.87:0/844478349 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b019b7e0 con 0x7f68b00fffc0 2024-09-13T17:11:31.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.230+0000 7f68b6492640 1 -- 172.21.15.87:0/844478349 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b01a30a0 con 0x7f68b00fffc0 2024-09-13T17:11:31.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.231+0000 7f68b6492640 1 -- 172.21.15.87:0/844478349 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68b01014a0 con 0x7f68b00fffc0 2024-09-13T17:11:31.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.232+0000 7f68adffb640 1 -- 172.21.15.87:0/844478349 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f68a0004f60 con 0x7f68b00fffc0 2024-09-13T17:11:31.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.232+0000 7f68adffb640 1 --2- 172.21.15.87:0/844478349 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f689c0a1080 0x7f689c0a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:31.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.232+0000 7f68a7fff640 1 --2- 172.21.15.87:0/844478349 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f689c0a1080 0x7f689c0a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:31.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.232+0000 7f68adffb640 1 -- 172.21.15.87:0/844478349 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f68a00cc560 con 0x7f68b00fffc0 2024-09-13T17:11:31.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.233+0000 7f68a7fff640 1 --2- 172.21.15.87:0/844478349 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f689c0a1080 0x7f689c0a3540 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6898005fd0 tx=0x7f68980094d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:31.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.236+0000 7f68adffb640 1 -- 172.21.15.87:0/844478349 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f68a0095b00 con 0x7f68b00fffc0 2024-09-13T17:11:31.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.439+0000 7f68b6492640 1 -- 172.21.15.87:0/844478349 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f68b0108330 con 0x7f68b00fffc0 2024-09-13T17:11:31.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.440+0000 7f68adffb640 1 -- 172.21.15.87:0/844478349 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+88 (secure 0 0 0) 0x7f68a0020070 con 0x7f68b00fffc0 2024-09-13T17:11:31.441 INFO:teuthology.orchestra.run.smithi087.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T17:11:31.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.442+0000 7f68b6492640 1 -- 172.21.15.87:0/844478349 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f689c0a1080 msgr2=0x7f689c0a3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:31.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.442+0000 7f68b6492640 1 --2- 172.21.15.87:0/844478349 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f689c0a1080 0x7f689c0a3540 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6898005fd0 tx=0x7f68980094d0 comp rx=0 tx=0).stop 2024-09-13T17:11:31.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.442+0000 7f68b6492640 1 -- 172.21.15.87:0/844478349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68b00fffc0 msgr2=0x7f68b01962e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:31.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.442+0000 7f68b6492640 1 --2- 172.21.15.87:0/844478349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68b00fffc0 0x7f68b01962e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f68a000d770 tx=0x7f68a000dc30 comp rx=0 tx=0).stop 2024-09-13T17:11:31.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.442+0000 7f68b6492640 1 -- 172.21.15.87:0/844478349 shutdown_connections 2024-09-13T17:11:31.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.442+0000 7f68b6492640 1 --2- 172.21.15.87:0/844478349 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f689c0a1080 0x7f689c0a3540 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:31.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.442+0000 7f68b6492640 1 --2- 172.21.15.87:0/844478349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68b01050f0 0x7f68b019ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:31.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.442+0000 7f68b6492640 1 --2- 172.21.15.87:0/844478349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68b0100970 0x7f68b0196820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:31.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.442+0000 7f68b6492640 1 --2- 172.21.15.87:0/844478349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68b00fffc0 0x7f68b01962e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:31.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.442+0000 7f68b6492640 1 -- 172.21.15.87:0/844478349 >> 172.21.15.87:0/844478349 conn(0x7f68b00fbaa0 msgr2=0x7f68b00fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:31.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.442+0000 7f68b6492640 1 -- 172.21.15.87:0/844478349 shutdown_connections 2024-09-13T17:11:31.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:31.442+0000 7f68b6492640 1 -- 172.21.15.87:0/844478349 wait complete. 2024-09-13T17:11:31.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:31 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/844478349' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T17:11:31.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:31 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/844478349' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T17:11:31.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:31 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/844478349' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T17:11:32.159 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T17:11:32.159 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:11:32.159 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2024-09-13T17:11:32.160 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-13T17:11:32.160 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:11:32.160 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T17:11:32.160 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:11:32.160 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:11:32.160 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-13T17:11:32.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:11:32.161 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2024-09-13T17:11:32.178 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:11:32.178 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:11:32.178 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:11:32.178 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:11:32.178 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-09-13T17:11:32.178 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:11:32.178 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:11:32.178 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2024-09-13T17:11:32.179 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2024-09-13T17:11:32.179 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:11:32.179 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2024-09-13T17:11:32.179 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2024-09-13T17:11:32.179 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:11:32.179 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:11:32.179 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:11:32.179 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:11:32.179 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T17:11:32.179 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42294sec preferred_lft 42294sec 2024-09-13T17:11:32.180 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link noprefixroute 2024-09-13T17:11:32.180 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:11:32.180 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T17:11:32.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:11:32.181 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-09-13T17:11:32.181 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-09-13T17:11:32.181 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add name ceph-brx type bridge 2024-09-13T17:11:32.181 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip addr flush dev ceph-brx 2024-09-13T17:11:32.181 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set ceph-brx up 2024-09-13T17:11:32.182 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T17:11:32.182 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-09-13T17:11:32.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:11:32.351 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:11:32.376 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-09-13T17:11:32.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:11:32.378 DEBUG:teuthology.orchestra.run.smithi087:> route 2024-09-13T17:11:32.442 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2024-09-13T17:11:32.442 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:11:32.443 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:11:32.443 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T17:11:32.443 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:11:32.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:11:32.443 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-09-13T17:11:32.443 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-09-13T17:11:32.443 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:11:32.444 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:11:32.444 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:11:32.444 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-09-13T17:11:32.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:11:32.689 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-09-13T17:11:32.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:11:32.706 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list-id 2024-09-13T17:11:32.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:11:32.760 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-09-13T17:11:32.760 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-09-13T17:11:32.761 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-13T17:11:32.761 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-13T17:11:32.761 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-09-13T17:11:32.823 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:32 smithi087 ceph-mon[30934]: pgmap v281: 129 pgs: 129 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 2 op/s 2024-09-13T17:11:32.839 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-13T17:11:32.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:11:32.840 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-09-13T17:11:32.840 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-09-13T17:11:32.840 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-13T17:11:32.840 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T17:11:32.840 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-13T17:11:32.840 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-13T17:11:32.840 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-13T17:11:32.840 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-09-13T17:11:32.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:32 smithi149 ceph-mon[35496]: pgmap v281: 129 pgs: 129 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 2 op/s 2024-09-13T17:11:32.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:32 smithi118 ceph-mon[34374]: pgmap v281: 129 pgs: 129 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 2 op/s 2024-09-13T17:11:32.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:11:32.968 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-09-13T17:11:32.968 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-09-13T17:11:32.968 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2024-09-13T17:11:32.968 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T17:11:32.969 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-09-13T17:11:33.005 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-13T17:11:33.005 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:11:33.005 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:11:33.061 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-13T17:11:33.061 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:11:33.061 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:11:33.116 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T17:11:33.183 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:11:33.183 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:11:33.248 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:11:33.249 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:11:33.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:11:33.249 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T17:11:33.305 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:11:33.305 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-13T17:11:33.351 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T17:11:33.375 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:11:33.376 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:11:33.440 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:11:33.440 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:11:33.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:11:33.441 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T17:11:33.462 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi087.stderr:2024-09-13T17:11:33.461+0000 7f9e15819480 -1 init, newargv = 0x5555871024e0 newargc=15 2024-09-13T17:11:33.462 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi087.stderr:ceph-fuse[74494]: starting ceph client 2024-09-13T17:11:33.467 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi087.stderr:ceph-fuse[74494]: starting fuse 2024-09-13T17:11:33.477 INFO:teuthology.orchestra.run.smithi087.stdout:120 2024-09-13T17:11:33.477 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-13T17:11:33.478 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:11:33.478 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2024-09-13T17:11:33.478 DEBUG:teuthology.orchestra.run.smithi087:> import re 2024-09-13T17:11:33.478 DEBUG:teuthology.orchestra.run.smithi087:> import os 2024-09-13T17:11:33.478 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2024-09-13T17:11:33.478 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T17:11:33.478 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2024-09-13T17:11:33.478 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-13T17:11:33.478 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2024-09-13T17:11:33.478 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-13T17:11:33.479 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T17:11:33.479 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2024-09-13T17:11:33.479 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2024-09-13T17:11:33.479 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2024-09-13T17:11:33.479 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2024-09-13T17:11:33.479 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T17:11:33.479 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2024-09-13T17:11:33.479 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:11:33.479 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:11:33.479 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:11:33.479 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2024-09-13T17:11:33.479 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2024-09-13T17:11:33.479 DEBUG:teuthology.orchestra.run.smithi087:> return f 2024-09-13T17:11:33.480 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:11:33.480 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T17:11:33.480 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.admin")) 2024-09-13T17:11:33.480 DEBUG:teuthology.orchestra.run.smithi087:> ' 2024-09-13T17:11:33.592 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.admin.74494.asok 2024-09-13T17:11:33.779 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.74494.asok 2024-09-13T17:11:33.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:11:33.779 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.74494.asok status 2024-09-13T17:11:33.911 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:11:33.911 INFO:teuthology.orchestra.run.smithi087.stdout: "metadata": { 2024-09-13T17:11:33.911 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:11:33.912 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:11:33.912 INFO:teuthology.orchestra.run.smithi087.stdout: "entity_id": "admin", 2024-09-13T17:11:33.912 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": "smithi087", 2024-09-13T17:11:33.912 INFO:teuthology.orchestra.run.smithi087.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-13T17:11:33.912 INFO:teuthology.orchestra.run.smithi087.stdout: "pid": "74494", 2024-09-13T17:11:33.912 INFO:teuthology.orchestra.run.smithi087.stdout: "root": "/" 2024-09-13T17:11:33.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:11:33.912 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_count": 0, 2024-09-13T17:11:33.912 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_pinned_count": 0, 2024-09-13T17:11:33.912 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 14769, 2024-09-13T17:11:33.912 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2024-09-13T17:11:33.913 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2024-09-13T17:11:33.913 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2024-09-13T17:11:33.913 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 14769 2024-09-13T17:11:33.913 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:11:33.913 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-09-13T17:11:33.913 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-13T17:11:33.913 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:11:33.913 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1155561011 2024-09-13T17:11:33.913 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:11:33.914 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:11:33.914 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-09-13T17:11:33.914 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-13T17:11:33.914 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:11:33.914 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1155561011 2024-09-13T17:11:33.914 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:11:33.914 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.14769 192.168.0.1:0/1155561011", 2024-09-13T17:11:33.914 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "192.168.0.1:0/1155561011", 2024-09-13T17:11:33.914 INFO:teuthology.orchestra.run.smithi087.stdout: "inode_count": 1, 2024-09-13T17:11:33.914 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_epoch": 17, 2024-09-13T17:11:33.915 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch": 89, 2024-09-13T17:11:33.915 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:11:33.915 INFO:teuthology.orchestra.run.smithi087.stdout: "blocklisted": false, 2024-09-13T17:11:33.915 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs" 2024-09-13T17:11:33.915 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:11:33.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:11:33.920 DEBUG:teuthology.orchestra.run.smithi087:> stat --file-system '--printf=%T 2024-09-13T17:11:33.920 DEBUG:teuthology.orchestra.run.smithi087:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:11:33.937 INFO:teuthology.orchestra.run.smithi087.stdout:fuseblk 2024-09-13T17:11:33.937 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:11:33.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:11:33.938 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:11:34.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:11:34.004 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-13T17:11:34.077 INFO:teuthology.orchestra.run.smithi087.stdout:# file: . 2024-09-13T17:11:34.077 INFO:teuthology.orchestra.run.smithi087.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-13T17:11:34.077 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:11:34.077 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T17:11:34.077 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:11:34.134 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:11:34.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.271+0000 7fe91a99c640 1 -- 172.21.15.87:0/965065928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe914103180 msgr2=0x7fe914105570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:34.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.271+0000 7fe91a99c640 1 --2- 172.21.15.87:0/965065928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe914103180 0x7fe914105570 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe908009900 tx=0x7fe90802a410 comp rx=0 tx=0).stop 2024-09-13T17:11:34.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.271+0000 7fe91a99c640 1 -- 172.21.15.87:0/965065928 shutdown_connections 2024-09-13T17:11:34.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.271+0000 7fe91a99c640 1 --2- 172.21.15.87:0/965065928 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe914105ab0 0x7fe914107f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.271+0000 7fe91a99c640 1 --2- 172.21.15.87:0/965065928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe914103180 0x7fe914105570 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.271+0000 7fe91a99c640 1 --2- 172.21.15.87:0/965065928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe914100850 0x7fe914102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.271+0000 7fe91a99c640 1 -- 172.21.15.87:0/965065928 >> 172.21.15.87:0/965065928 conn(0x7fe9140fa430 msgr2=0x7fe9140fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:34.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.272+0000 7fe91a99c640 1 -- 172.21.15.87:0/965065928 shutdown_connections 2024-09-13T17:11:34.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.272+0000 7fe91a99c640 1 -- 172.21.15.87:0/965065928 wait complete. 2024-09-13T17:11:34.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.272+0000 7fe91a99c640 1 Processor -- start 2024-09-13T17:11:34.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.272+0000 7fe91a99c640 1 -- start start 2024-09-13T17:11:34.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.272+0000 7fe91a99c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe914100850 0x7fe914195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:34.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.272+0000 7fe91a99c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe914103180 0x7fe9141963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:34.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.272+0000 7fe91a99c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe914105ab0 0x7fe91419d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:34.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.272+0000 7fe91a99c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91419d950 con 0x7fe914100850 2024-09-13T17:11:34.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.272+0000 7fe91a99c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91419dac0 con 0x7fe914105ab0 2024-09-13T17:11:34.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.272+0000 7fe91a99c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91419dc80 con 0x7fe914103180 2024-09-13T17:11:34.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.272+0000 7fe913fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe914100850 0x7fe914195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:34.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.273+0000 7fe913fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe914100850 0x7fe914195e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46428/0 (socket says 172.21.15.87:46428) 2024-09-13T17:11:34.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.273+0000 7fe913fff640 1 -- 172.21.15.87:0/2002006258 learned_addr learned my addr 172.21.15.87:0/2002006258 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:34.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.273+0000 7fe9137fe640 1 --2- 172.21.15.87:0/2002006258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe914103180 0x7fe9141963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:34.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.273+0000 7fe918f39640 1 --2- 172.21.15.87:0/2002006258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe914105ab0 0x7fe91419d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:34.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.273+0000 7fe913fff640 1 -- 172.21.15.87:0/2002006258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe914103180 msgr2=0x7fe9141963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:34.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.273+0000 7fe913fff640 1 --2- 172.21.15.87:0/2002006258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe914103180 0x7fe9141963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.273+0000 7fe913fff640 1 -- 172.21.15.87:0/2002006258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe914105ab0 msgr2=0x7fe91419d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:34.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.273+0000 7fe913fff640 1 --2- 172.21.15.87:0/2002006258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe914105ab0 0x7fe91419d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.273+0000 7fe913fff640 1 -- 172.21.15.87:0/2002006258 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe908009560 con 0x7fe914100850 2024-09-13T17:11:34.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.273+0000 7fe913fff640 1 --2- 172.21.15.87:0/2002006258 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe914100850 0x7fe914195e60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe90400d770 tx=0x7fe90400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:34.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.273+0000 7fe9117fa640 1 -- 172.21.15.87:0/2002006258 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe904009c30 con 0x7fe914100850 2024-09-13T17:11:34.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.273+0000 7fe9117fa640 1 -- 172.21.15.87:0/2002006258 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe90400de80 con 0x7fe914100850 2024-09-13T17:11:34.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.273+0000 7fe91a99c640 1 -- 172.21.15.87:0/2002006258 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe91419df60 con 0x7fe914100850 2024-09-13T17:11:34.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.273+0000 7fe9117fa640 1 -- 172.21.15.87:0/2002006258 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe904004e00 con 0x7fe914100850 2024-09-13T17:11:34.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.273+0000 7fe91a99c640 1 -- 172.21.15.87:0/2002006258 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe91419e380 con 0x7fe914100850 2024-09-13T17:11:34.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.274+0000 7fe91a99c640 1 -- 172.21.15.87:0/2002006258 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9140fbf20 con 0x7fe914100850 2024-09-13T17:11:34.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.275+0000 7fe9117fa640 1 -- 172.21.15.87:0/2002006258 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe904004f60 con 0x7fe914100850 2024-09-13T17:11:34.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.276+0000 7fe9117fa640 1 --2- 172.21.15.87:0/2002006258 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe8fc0a1110 0x7fe8fc0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:34.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.276+0000 7fe9137fe640 1 --2- 172.21.15.87:0/2002006258 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe8fc0a1110 0x7fe8fc0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:34.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.276+0000 7fe9117fa640 1 -- 172.21.15.87:0/2002006258 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fe9040cc870 con 0x7fe914100850 2024-09-13T17:11:34.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.276+0000 7fe9137fe640 1 --2- 172.21.15.87:0/2002006258 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe8fc0a1110 0x7fe8fc0a35d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe90802aa00 tx=0x7fe908031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:34.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.279+0000 7fe9117fa640 1 -- 172.21.15.87:0/2002006258 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe904095f40 con 0x7fe914100850 2024-09-13T17:11:34.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.442+0000 7fe91a99c640 1 -- 172.21.15.87:0/2002006258 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9140fb990 con 0x7fe914100850 2024-09-13T17:11:34.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.444+0000 7fe9117fa640 1 -- 172.21.15.87:0/2002006258 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+23971 (secure 0 0 0) 0x7fe904017070 con 0x7fe914100850 2024-09-13T17:11:34.445 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:11:34.445 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":89,"fsid":"043d5bae-71f2-11ef-bceb-c7b262605968","created":"2024-09-13T17:03:57.852010+0000","modified":"2024-09-13T17:11:27.679526+0000","last_up_change":"2024-09-13T17:10:34.423548+0000","last_in_change":"2024-09-13T17:10:14.228123+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:07:02.286400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:11:21.965141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:11:22.504345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:11:25.565163+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58250283-85c0-416e-abdd-1fc5a7ff0c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6803","nonce":1316956138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6805","nonce":1316956138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6809","nonce":1316956138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6807","nonce":1316956138}]},"public_addr":"172.21.15.87:6803/1316956138","cluster_addr":"172.21.15.87:6805/1316956138","heartbeat_back_addr":"172.21.15.87:6809/1316956138","heartbeat_front_addr":"172.21.15.87:6807/1316956138","state":["exists","up"]},{"osd":1,"uuid":"b9d49969-94b1-4262-b4ff-db0a8e3331af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6801","nonce":3352566727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6803","nonce":3352566727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6807","nonce":3352566727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6805","nonce":3352566727}]},"public_addr":"172.21.15.118:6801/3352566727","cluster_addr":"172.21.15.118:6803/3352566727","heartbeat_back_addr":"172.21.15.118:6807/3352566727","heartbeat_front_addr":"172.21.15.118:6805/3352566727","state":["exists","up"]},{"osd":2,"uuid":"ba64549e-d736-426f-b466-f569af5f16d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6801","nonce":2774581686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6803","nonce":2774581686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6807","nonce":2774581686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6805","nonce":2774581686}]},"public_addr":"172.21.15.149:6801/2774581686","cluster_addr":"172.21.15.149:6803/2774581686","heartbeat_back_addr":"172.21.15.149:6807/2774581686","heartbeat_front_addr":"172.21.15.149:6805/2774581686","state":["exists","up"]},{"osd":3,"uuid":"3d5553e5-371b-49fd-976b-9e72a97a2f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6811","nonce":3306119066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6813","nonce":3306119066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6817","nonce":3306119066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6815","nonce":3306119066}]},"public_addr":"172.21.15.87:6811/3306119066","cluster_addr":"172.21.15.87:6813/3306119066","heartbeat_back_addr":"172.21.15.87:6817/3306119066","heartbeat_front_addr":"172.21.15.87:6815/3306119066","state":["exists","up"]},{"osd":4,"uuid":"2fbe0e27-34ec-42a6-9962-f1d8202b3159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6809","nonce":3342349890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6811","nonce":3342349890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6815","nonce":3342349890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6813","nonce":3342349890}]},"public_addr":"172.21.15.118:6809/3342349890","cluster_addr":"172.21.15.118:6811/3342349890","heartbeat_back_addr":"172.21.15.118:6815/3342349890","heartbeat_front_addr":"172.21.15.118:6813/3342349890","state":["exists","up"]},{"osd":5,"uuid":"53c14519-6170-4b5a-a79d-4835882d7bec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6809","nonce":3468867124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6811","nonce":3468867124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6815","nonce":3468867124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6813","nonce":3468867124}]},"public_addr":"172.21.15.149:6809/3468867124","cluster_addr":"172.21.15.149:6811/3468867124","heartbeat_back_addr":"172.21.15.149:6815/3468867124","heartbeat_front_addr":"172.21.15.149:6813/3468867124","state":["exists","up"]},{"osd":6,"uuid":"d3951b32-db77-4b8b-9de0-f05e03d13f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6819","nonce":326563617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6821","nonce":326563617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6825","nonce":326563617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6823","nonce":326563617}]},"public_addr":"172.21.15.87:6819/326563617","cluster_addr":"172.21.15.87:6821/326563617","heartbeat_back_addr":"172.21.15.87:6825/326563617","heartbeat_front_addr":"172.21.15.87:6823/326563617","state":["exists","up"]},{"osd":7,"uuid":"4d46dab7-a8bf-4e3e-b5c0-43860d336bdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6817","nonce":1690268990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6819","nonce":1690268990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6823","nonce":1690268990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6821","nonce":1690268990}]},"public_addr":"172.21.15.118:6817/1690268990","cluster_addr":"172.21.15.118:6819/1690268990","heartbeat_back_addr":"172.21.15.118:6823/1690268990","heartbeat_front_addr":"172.21.15.118:6821/1690268990","state":["exists","up"]},{"osd":8,"uuid":"5a015a7d-60a3-4412-96af-1b61d2ad51f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6817","nonce":1558675380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6819","nonce":1558675380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6823","nonce":1558675380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6821","nonce":1558675380}]},"public_addr":"172.21.15.149:6817/1558675380","cluster_addr":"172.21.15.149:6819/1558675380","heartbeat_back_addr":"172.21.15.149:6823/1558675380","heartbeat_front_addr":"172.21.15.149:6821/1558675380","state":["exists","up"]},{"osd":9,"uuid":"248c0b6e-4c4e-4c63-a0dd-e4cdf3b997a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6827","nonce":1453934262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6829","nonce":1453934262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6833","nonce":1453934262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6831","nonce":1453934262}]},"public_addr":"172.21.15.87:6827/1453934262","cluster_addr":"172.21.15.87:6829/1453934262","heartbeat_back_addr":"172.21.15.87:6833/1453934262","heartbeat_front_addr":"172.21.15.87:6831/1453934262","state":["exists","up"]},{"osd":10,"uuid":"24238714-e737-4371-b5d5-0cd3395f09bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6825","nonce":1034318850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6827","nonce":1034318850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6831","nonce":1034318850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6829","nonce":1034318850}]},"public_addr":"172.21.15.118:6825/1034318850","cluster_addr":"172.21.15.118:6827/1034318850","heartbeat_back_addr":"172.21.15.118:6831/1034318850","heartbeat_front_addr":"172.21.15.118:6829/1034318850","state":["exists","up"]},{"osd":11,"uuid":"409dd3bf-5154-4dea-8708-7de7f9e2e793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6825","nonce":271000465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6827","nonce":271000465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6831","nonce":271000465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6829","nonce":271000465}]},"public_addr":"172.21.15.149:6825/271000465","cluster_addr":"172.21.15.149:6827/271000465","heartbeat_back_addr":"172.21.15.149:6831/271000465","heartbeat_front_addr":"172.21.15.149:6829/271000465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:16.382664+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:37.914250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:00.425876+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:23.960183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:47.004088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:10.214345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:33.719221+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:57.099599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:20.971881+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:44.827167+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:08.135516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:32.085853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/586423689":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6801/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6800/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/3270371628":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/515676743":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/1475107314":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/553289143":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/3403361612":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6801/1587363880":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6800/1587363880":"2024-09-14T17:04:24.083789+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:11:34.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.446+0000 7fe91a99c640 1 -- 172.21.15.87:0/2002006258 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe8fc0a1110 msgr2=0x7fe8fc0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:34.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.446+0000 7fe91a99c640 1 --2- 172.21.15.87:0/2002006258 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe8fc0a1110 0x7fe8fc0a35d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe90802aa00 tx=0x7fe908031400 comp rx=0 tx=0).stop 2024-09-13T17:11:34.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.446+0000 7fe91a99c640 1 -- 172.21.15.87:0/2002006258 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe914100850 msgr2=0x7fe914195e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:34.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.446+0000 7fe91a99c640 1 --2- 172.21.15.87:0/2002006258 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe914100850 0x7fe914195e60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe90400d770 tx=0x7fe90400dc30 comp rx=0 tx=0).stop 2024-09-13T17:11:34.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.446+0000 7fe91a99c640 1 -- 172.21.15.87:0/2002006258 shutdown_connections 2024-09-13T17:11:34.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.446+0000 7fe91a99c640 1 --2- 172.21.15.87:0/2002006258 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe8fc0a1110 0x7fe8fc0a35d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.446+0000 7fe91a99c640 1 --2- 172.21.15.87:0/2002006258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe914105ab0 0x7fe91419d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.446+0000 7fe91a99c640 1 --2- 172.21.15.87:0/2002006258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe914103180 0x7fe9141963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.446+0000 7fe91a99c640 1 --2- 172.21.15.87:0/2002006258 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe914100850 0x7fe914195e60 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.446+0000 7fe91a99c640 1 -- 172.21.15.87:0/2002006258 >> 172.21.15.87:0/2002006258 conn(0x7fe9140fa430 msgr2=0x7fe914101130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:34.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.446+0000 7fe91a99c640 1 -- 172.21.15.87:0/2002006258 shutdown_connections 2024-09-13T17:11:34.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.446+0000 7fe91a99c640 1 -- 172.21.15.87:0/2002006258 wait complete. 2024-09-13T17:11:34.458 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:07:02.286400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:11:21.965141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:11:22.504345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:11:25.565163+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:11:34.459 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:11:34.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.559+0000 7f258d553640 1 -- 172.21.15.87:0/1371402620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25881002a0 msgr2=0x7f25881006a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:34.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.559+0000 7f258d553640 1 --2- 172.21.15.87:0/1371402620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25881002a0 0x7f25881006a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2578009900 tx=0x7f257802a410 comp rx=0 tx=0).stop 2024-09-13T17:11:34.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.559+0000 7f258d553640 1 -- 172.21.15.87:0/1371402620 shutdown_connections 2024-09-13T17:11:34.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.559+0000 7f258d553640 1 --2- 172.21.15.87:0/1371402620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25880ff8b0 0x7f2588107150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.559+0000 7f258d553640 1 --2- 172.21.15.87:0/1371402620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25880feef0 0x7f25880ff370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.559+0000 7f258d553640 1 --2- 172.21.15.87:0/1371402620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25881002a0 0x7f25881006a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.559+0000 7f258d553640 1 -- 172.21.15.87:0/1371402620 >> 172.21.15.87:0/1371402620 conn(0x7f25880f9b70 msgr2=0x7f25880fbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:34.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.559+0000 7f258d553640 1 -- 172.21.15.87:0/1371402620 shutdown_connections 2024-09-13T17:11:34.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.559+0000 7f258d553640 1 -- 172.21.15.87:0/1371402620 wait complete. 2024-09-13T17:11:34.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.559+0000 7f258d553640 1 Processor -- start 2024-09-13T17:11:34.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.559+0000 7f258d553640 1 -- start start 2024-09-13T17:11:34.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.560+0000 7f258d553640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25880feef0 0x7f25880fe950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:34.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.560+0000 7f258d553640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25880ff8b0 0x7f258819cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:34.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.560+0000 7f258d553640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25881002a0 0x7f258819f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:34.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.560+0000 7f258d553640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258819faf0 con 0x7f25880feef0 2024-09-13T17:11:34.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.560+0000 7f258d553640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258819fc60 con 0x7f25881002a0 2024-09-13T17:11:34.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.560+0000 7f258d553640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258819fe20 con 0x7f25880ff8b0 2024-09-13T17:11:34.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.560+0000 7f2586ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25880feef0 0x7f25880fe950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:34.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.560+0000 7f2586ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25880feef0 0x7f25880fe950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46434/0 (socket says 172.21.15.87:46434) 2024-09-13T17:11:34.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.560+0000 7f2586ffd640 1 -- 172.21.15.87:0/3660264884 learned_addr learned my addr 172.21.15.87:0/3660264884 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:34.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.560+0000 7f257e7fc640 1 --2- 172.21.15.87:0/3660264884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25880ff8b0 0x7f258819cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:34.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.560+0000 7f25877fe640 1 --2- 172.21.15.87:0/3660264884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25881002a0 0x7f258819f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:34.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.560+0000 7f2586ffd640 1 -- 172.21.15.87:0/3660264884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25880ff8b0 msgr2=0x7f258819cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:34.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.560+0000 7f2586ffd640 1 --2- 172.21.15.87:0/3660264884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25880ff8b0 0x7f258819cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.560+0000 7f2586ffd640 1 -- 172.21.15.87:0/3660264884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25881002a0 msgr2=0x7f258819f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:34.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.560+0000 7f2586ffd640 1 --2- 172.21.15.87:0/3660264884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25881002a0 0x7f258819f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.560+0000 7f2586ffd640 1 -- 172.21.15.87:0/3660264884 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2578009560 con 0x7f25880feef0 2024-09-13T17:11:34.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.560+0000 7f257e7fc640 1 --2- 172.21.15.87:0/3660264884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25880ff8b0 0x7f258819cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:11:34.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.560+0000 7f2586ffd640 1 --2- 172.21.15.87:0/3660264884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25880feef0 0x7f25880fe950 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2578031460 tx=0x7f25780042d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:34.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.560+0000 7f2584ff9640 1 -- 172.21.15.87:0/3660264884 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25780044c0 con 0x7f25880feef0 2024-09-13T17:11:34.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.560+0000 7f2584ff9640 1 -- 172.21.15.87:0/3660264884 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2578003cb0 con 0x7f25880feef0 2024-09-13T17:11:34.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.560+0000 7f258d553640 1 -- 172.21.15.87:0/3660264884 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25881a0040 con 0x7f25880feef0 2024-09-13T17:11:34.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.560+0000 7f2584ff9640 1 -- 172.21.15.87:0/3660264884 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257803ce60 con 0x7f25880feef0 2024-09-13T17:11:34.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.560+0000 7f258d553640 1 -- 172.21.15.87:0/3660264884 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25881a04f0 con 0x7f25880feef0 2024-09-13T17:11:34.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.561+0000 7f258d553640 1 -- 172.21.15.87:0/3660264884 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25880ff370 con 0x7f25880feef0 2024-09-13T17:11:34.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.563+0000 7f2584ff9640 1 -- 172.21.15.87:0/3660264884 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f257803c600 con 0x7f25880feef0 2024-09-13T17:11:34.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.563+0000 7f2584ff9640 1 --2- 172.21.15.87:0/3660264884 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f25740a10c0 0x7f25740a3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:34.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.564+0000 7f257e7fc640 1 --2- 172.21.15.87:0/3660264884 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f25740a10c0 0x7f25740a3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:34.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.564+0000 7f2584ff9640 1 -- 172.21.15.87:0/3660264884 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f25780ed8f0 con 0x7f25880feef0 2024-09-13T17:11:34.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.564+0000 7f257e7fc640 1 --2- 172.21.15.87:0/3660264884 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f25740a10c0 0x7f25740a3580 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2570005d00 tx=0x7f2570005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:34.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.567+0000 7f2584ff9640 1 -- 172.21.15.87:0/3660264884 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f25780b6e90 con 0x7f25880feef0 2024-09-13T17:11:34.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.728+0000 7f258d553640 1 -- 172.21.15.87:0/3660264884 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f258810a7d0 con 0x7f25880feef0 2024-09-13T17:11:34.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.729+0000 7f2584ff9640 1 -- 172.21.15.87:0/3660264884 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7f257804a0a0 con 0x7f25880feef0 2024-09-13T17:11:34.730 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-09-13T17:11:34.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.730+0000 7f258d553640 1 -- 172.21.15.87:0/3660264884 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f25740a10c0 msgr2=0x7f25740a3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:34.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.730+0000 7f258d553640 1 --2- 172.21.15.87:0/3660264884 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f25740a10c0 0x7f25740a3580 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2570005d00 tx=0x7f2570005c90 comp rx=0 tx=0).stop 2024-09-13T17:11:34.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.730+0000 7f258d553640 1 -- 172.21.15.87:0/3660264884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25880feef0 msgr2=0x7f25880fe950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:34.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.730+0000 7f258d553640 1 --2- 172.21.15.87:0/3660264884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25880feef0 0x7f25880fe950 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2578031460 tx=0x7f25780042d0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.731+0000 7f258d553640 1 -- 172.21.15.87:0/3660264884 shutdown_connections 2024-09-13T17:11:34.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.731+0000 7f258d553640 1 --2- 172.21.15.87:0/3660264884 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f25740a10c0 0x7f25740a3580 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.731+0000 7f258d553640 1 --2- 172.21.15.87:0/3660264884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25881002a0 0x7f258819f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.731+0000 7f258d553640 1 --2- 172.21.15.87:0/3660264884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25880ff8b0 0x7f258819cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.731+0000 7f258d553640 1 --2- 172.21.15.87:0/3660264884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25880feef0 0x7f25880fe950 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.731+0000 7f258d553640 1 -- 172.21.15.87:0/3660264884 >> 172.21.15.87:0/3660264884 conn(0x7f25880f9b70 msgr2=0x7f25881033c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:34.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.731+0000 7f258d553640 1 -- 172.21.15.87:0/3660264884 shutdown_connections 2024-09-13T17:11:34.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.731+0000 7f258d553640 1 -- 172.21.15.87:0/3660264884 wait complete. 2024-09-13T17:11:34.743 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:11:34.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.843+0000 7f7ff2bae640 1 -- 172.21.15.87:0/848780826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fec100810 msgr2=0x7f7fec1070a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:34.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.843+0000 7f7ff2bae640 1 --2- 172.21.15.87:0/848780826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fec100810 0x7f7fec1070a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4009ca0 tx=0x7f7fe402a8c0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.843+0000 7f7ff2bae640 1 -- 172.21.15.87:0/848780826 shutdown_connections 2024-09-13T17:11:34.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.843+0000 7f7ff2bae640 1 --2- 172.21.15.87:0/848780826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fec100810 0x7f7fec1070a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.843+0000 7f7ff2bae640 1 --2- 172.21.15.87:0/848780826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7fec0ffe50 0x7f7fec1002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.843+0000 7f7ff2bae640 1 --2- 172.21.15.87:0/848780826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fec0fec60 0x7f7fec0ff060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.843+0000 7f7ff2bae640 1 -- 172.21.15.87:0/848780826 >> 172.21.15.87:0/848780826 conn(0x7f7fec0fa3e0 msgr2=0x7f7fec0fc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:34.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.843+0000 7f7ff2bae640 1 -- 172.21.15.87:0/848780826 shutdown_connections 2024-09-13T17:11:34.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.844+0000 7f7ff2bae640 1 -- 172.21.15.87:0/848780826 wait complete. 2024-09-13T17:11:34.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.844+0000 7f7ff2bae640 1 Processor -- start 2024-09-13T17:11:34.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.844+0000 7f7ff2bae640 1 -- start start 2024-09-13T17:11:34.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.844+0000 7f7ff2bae640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fec0fec60 0x7f7fec195d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:34.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.844+0000 7f7ff2bae640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fec0ffe50 0x7f7fec1962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:34.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.844+0000 7f7ff2bae640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7fec100810 0x7f7fec19d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:34.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.844+0000 7f7ff2bae640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec19d820 con 0x7f7fec0fec60 2024-09-13T17:11:34.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.844+0000 7f7ff2bae640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec19d990 con 0x7f7fec100810 2024-09-13T17:11:34.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.844+0000 7f7ff2bae640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec19db50 con 0x7f7fec0ffe50 2024-09-13T17:11:34.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.844+0000 7f7ff094a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fec0fec60 0x7f7fec195d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:34.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.844+0000 7f7ff094a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fec0fec60 0x7f7fec195d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46442/0 (socket says 172.21.15.87:46442) 2024-09-13T17:11:34.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.844+0000 7f7ff094a640 1 -- 172.21.15.87:0/2032900828 learned_addr learned my addr 172.21.15.87:0/2032900828 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:34.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.844+0000 7f7fe3fff640 1 --2- 172.21.15.87:0/2032900828 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fec0ffe50 0x7f7fec1962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:34.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.845+0000 7f7ff094a640 1 -- 172.21.15.87:0/2032900828 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fec0ffe50 msgr2=0x7f7fec1962d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:34.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.845+0000 7f7ff094a640 1 --2- 172.21.15.87:0/2032900828 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fec0ffe50 0x7f7fec1962d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.845+0000 7f7ff094a640 1 -- 172.21.15.87:0/2032900828 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7fec100810 msgr2=0x7f7fec19d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:34.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.845+0000 7f7ff094a640 1 --2- 172.21.15.87:0/2032900828 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7fec100810 0x7f7fec19d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:34.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.845+0000 7f7ff094a640 1 -- 172.21.15.87:0/2032900828 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe4009900 con 0x7f7fec0fec60 2024-09-13T17:11:34.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.845+0000 7f7fe3fff640 1 --2- 172.21.15.87:0/2032900828 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fec0ffe50 0x7f7fec1962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:11:34.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.845+0000 7f7ff094a640 1 --2- 172.21.15.87:0/2032900828 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fec0fec60 0x7f7fec195d90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7fe800e9c0 tx=0x7f7fe800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:34.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.845+0000 7f7fe1ffb640 1 -- 172.21.15.87:0/2032900828 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe8009700 con 0x7f7fec0fec60 2024-09-13T17:11:34.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.845+0000 7f7fe1ffb640 1 -- 172.21.15.87:0/2032900828 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7fe80044d0 con 0x7f7fec0fec60 2024-09-13T17:11:34.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.845+0000 7f7ff2bae640 1 -- 172.21.15.87:0/2032900828 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fec19de30 con 0x7f7fec0fec60 2024-09-13T17:11:34.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.845+0000 7f7fe1ffb640 1 -- 172.21.15.87:0/2032900828 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe8010430 con 0x7f7fec0fec60 2024-09-13T17:11:34.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.845+0000 7f7ff2bae640 1 -- 172.21.15.87:0/2032900828 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fec19e2b0 con 0x7f7fec0fec60 2024-09-13T17:11:34.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.846+0000 7f7ff2bae640 1 -- 172.21.15.87:0/2032900828 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fec10a550 con 0x7f7fec0fec60 2024-09-13T17:11:34.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.847+0000 7f7fe1ffb640 1 -- 172.21.15.87:0/2032900828 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f7fe8003f30 con 0x7f7fec0fec60 2024-09-13T17:11:34.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.848+0000 7f7fe1ffb640 1 --2- 172.21.15.87:0/2032900828 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f7fd40a1110 0x7f7fd40a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:34.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.848+0000 7f7fe3fff640 1 --2- 172.21.15.87:0/2032900828 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f7fd40a1110 0x7f7fd40a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:34.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.848+0000 7f7fe1ffb640 1 -- 172.21.15.87:0/2032900828 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f7fe8014070 con 0x7f7fec0fec60 2024-09-13T17:11:34.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.848+0000 7f7fe3fff640 1 --2- 172.21.15.87:0/2032900828 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f7fd40a1110 0x7f7fd40a35d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc0058c0 tx=0x7f7fdc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:34.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:34.852+0000 7f7fe1ffb640 1 -- 172.21.15.87:0/2032900828 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7fe80964f0 con 0x7f7fec0fec60 2024-09-13T17:11:35.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.014+0000 7f7ff2bae640 1 -- 172.21.15.87:0/2032900828 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7fec19e530 con 0x7f7fec0fec60 2024-09-13T17:11:35.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.015+0000 7f7fe1ffb640 1 -- 172.21.15.87:0/2032900828 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7fe8098420 con 0x7f7fec0fec60 2024-09-13T17:11:35.016 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-09-13T17:11:35.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.017+0000 7f7ff2bae640 1 -- 172.21.15.87:0/2032900828 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f7fd40a1110 msgr2=0x7f7fd40a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:35.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.017+0000 7f7ff2bae640 1 --2- 172.21.15.87:0/2032900828 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f7fd40a1110 0x7f7fd40a35d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc0058c0 tx=0x7f7fdc005850 comp rx=0 tx=0).stop 2024-09-13T17:11:35.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.017+0000 7f7ff2bae640 1 -- 172.21.15.87:0/2032900828 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fec0fec60 msgr2=0x7f7fec195d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:35.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.017+0000 7f7ff2bae640 1 --2- 172.21.15.87:0/2032900828 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fec0fec60 0x7f7fec195d90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7fe800e9c0 tx=0x7f7fe800ee80 comp rx=0 tx=0).stop 2024-09-13T17:11:35.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.017+0000 7f7ff2bae640 1 -- 172.21.15.87:0/2032900828 shutdown_connections 2024-09-13T17:11:35.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.017+0000 7f7ff2bae640 1 --2- 172.21.15.87:0/2032900828 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f7fd40a1110 0x7f7fd40a35d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.017+0000 7f7ff2bae640 1 --2- 172.21.15.87:0/2032900828 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7fec100810 0x7f7fec19d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.017+0000 7f7ff2bae640 1 --2- 172.21.15.87:0/2032900828 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fec0ffe50 0x7f7fec1962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.017+0000 7f7ff2bae640 1 --2- 172.21.15.87:0/2032900828 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fec0fec60 0x7f7fec195d90 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.017+0000 7f7ff2bae640 1 -- 172.21.15.87:0/2032900828 >> 172.21.15.87:0/2032900828 conn(0x7f7fec0fa3e0 msgr2=0x7f7fec0675a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:35.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.017+0000 7f7ff2bae640 1 -- 172.21.15.87:0/2032900828 shutdown_connections 2024-09-13T17:11:35.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.017+0000 7f7ff2bae640 1 -- 172.21.15.87:0/2032900828 wait complete. 2024-09-13T17:11:35.029 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:11:35.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.128+0000 7f5bb10d7640 1 -- 172.21.15.87:0/378515556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bac103170 msgr2=0x7f5bac105560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:35.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.128+0000 7f5bb10d7640 1 --2- 172.21.15.87:0/378515556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bac103170 0x7f5bac105560 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0009900 tx=0x7f5ba002a410 comp rx=0 tx=0).stop 2024-09-13T17:11:35.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.128+0000 7f5bb10d7640 1 -- 172.21.15.87:0/378515556 shutdown_connections 2024-09-13T17:11:35.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.128+0000 7f5bb10d7640 1 --2- 172.21.15.87:0/378515556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5bac105aa0 0x7f5bac107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.128+0000 7f5bb10d7640 1 --2- 172.21.15.87:0/378515556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bac103170 0x7f5bac105560 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.128+0000 7f5bb10d7640 1 --2- 172.21.15.87:0/378515556 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5bac100840 0x7f5bac102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.128+0000 7f5bb10d7640 1 -- 172.21.15.87:0/378515556 >> 172.21.15.87:0/378515556 conn(0x7f5bac0fa3e0 msgr2=0x7f5bac0fc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:35.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.129+0000 7f5bb10d7640 1 -- 172.21.15.87:0/378515556 shutdown_connections 2024-09-13T17:11:35.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.129+0000 7f5bb10d7640 1 -- 172.21.15.87:0/378515556 wait complete. 2024-09-13T17:11:35.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.129+0000 7f5bb10d7640 1 Processor -- start 2024-09-13T17:11:35.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.129+0000 7f5bb10d7640 1 -- start start 2024-09-13T17:11:35.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.130+0000 7f5bb10d7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5bac100840 0x7f5bac195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:35.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.130+0000 7f5bb10d7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bac103170 0x7f5bac196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:35.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.130+0000 7f5bb10d7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5bac105aa0 0x7f5bac19d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:35.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.130+0000 7f5bb10d7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bac19d8f0 con 0x7f5bac103170 2024-09-13T17:11:35.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.130+0000 7f5bb10d7640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bac19da60 con 0x7f5bac105aa0 2024-09-13T17:11:35.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.130+0000 7f5bb10d7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bac19dc20 con 0x7f5bac100840 2024-09-13T17:11:35.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.130+0000 7f5baa59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bac103170 0x7f5bac196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:35.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.130+0000 7f5baa59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bac103170 0x7f5bac196340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46466/0 (socket says 172.21.15.87:46466) 2024-09-13T17:11:35.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.130+0000 7f5baa59c640 1 -- 172.21.15.87:0/4060994253 learned_addr learned my addr 172.21.15.87:0/4060994253 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:35.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.130+0000 7f5baad9d640 1 --2- 172.21.15.87:0/4060994253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5bac100840 0x7f5bac195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:35.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.130+0000 7f5bab59e640 1 --2- 172.21.15.87:0/4060994253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5bac105aa0 0x7f5bac19d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:35.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.130+0000 7f5baa59c640 1 -- 172.21.15.87:0/4060994253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5bac100840 msgr2=0x7f5bac195e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:35.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.130+0000 7f5baa59c640 1 --2- 172.21.15.87:0/4060994253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5bac100840 0x7f5bac195e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.130+0000 7f5baa59c640 1 -- 172.21.15.87:0/4060994253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5bac105aa0 msgr2=0x7f5bac19d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:35.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.130+0000 7f5baa59c640 1 --2- 172.21.15.87:0/4060994253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5bac105aa0 0x7f5bac19d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.130+0000 7f5baa59c640 1 -- 172.21.15.87:0/4060994253 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba0009560 con 0x7f5bac103170 2024-09-13T17:11:35.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.130+0000 7f5bab59e640 1 --2- 172.21.15.87:0/4060994253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5bac105aa0 0x7f5bac19d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:11:35.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.130+0000 7f5baa59c640 1 --2- 172.21.15.87:0/4060994253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bac103170 0x7f5bac196340 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0031460 tx=0x7f5ba0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:35.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.130+0000 7f5b93fff640 1 -- 172.21.15.87:0/4060994253 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba00035f0 con 0x7f5bac103170 2024-09-13T17:11:35.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.130+0000 7f5b93fff640 1 -- 172.21.15.87:0/4060994253 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5ba0003c00 con 0x7f5bac103170 2024-09-13T17:11:35.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.130+0000 7f5b93fff640 1 -- 172.21.15.87:0/4060994253 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba003cd20 con 0x7f5bac103170 2024-09-13T17:11:35.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.130+0000 7f5bb10d7640 1 -- 172.21.15.87:0/4060994253 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bac19dea0 con 0x7f5bac103170 2024-09-13T17:11:35.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.130+0000 7f5bb10d7640 1 -- 172.21.15.87:0/4060994253 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bac19e270 con 0x7f5bac103170 2024-09-13T17:11:35.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.131+0000 7f5bb10d7640 1 -- 172.21.15.87:0/4060994253 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bac0fbed0 con 0x7f5bac103170 2024-09-13T17:11:35.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.133+0000 7f5b93fff640 1 -- 172.21.15.87:0/4060994253 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5ba003c470 con 0x7f5bac103170 2024-09-13T17:11:35.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.133+0000 7f5b93fff640 1 --2- 172.21.15.87:0/4060994253 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f5b940a1090 0x7f5b940a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:35.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.133+0000 7f5baad9d640 1 --2- 172.21.15.87:0/4060994253 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f5b940a1090 0x7f5b940a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:35.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.133+0000 7f5b93fff640 1 -- 172.21.15.87:0/4060994253 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f5ba00eddb0 con 0x7f5bac103170 2024-09-13T17:11:35.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.134+0000 7f5baad9d640 1 --2- 172.21.15.87:0/4060994253 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f5b940a1090 0x7f5b940a3550 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c005fd0 tx=0x7f5b9c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:35.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.136+0000 7f5b93fff640 1 -- 172.21.15.87:0/4060994253 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5ba00b7350 con 0x7f5bac103170 2024-09-13T17:11:35.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.297+0000 7f5bb10d7640 1 -- 172.21.15.87:0/4060994253 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5bac02c3e0 con 0x7f5bac103170 2024-09-13T17:11:35.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.298+0000 7f5b93fff640 1 -- 172.21.15.87:0/4060994253 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5ba004a0a0 con 0x7f5bac103170 2024-09-13T17:11:35.299 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-09-13T17:11:35.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.300+0000 7f5bb10d7640 1 -- 172.21.15.87:0/4060994253 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f5b940a1090 msgr2=0x7f5b940a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:35.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.300+0000 7f5bb10d7640 1 --2- 172.21.15.87:0/4060994253 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f5b940a1090 0x7f5b940a3550 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c005fd0 tx=0x7f5b9c00b390 comp rx=0 tx=0).stop 2024-09-13T17:11:35.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.300+0000 7f5bb10d7640 1 -- 172.21.15.87:0/4060994253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bac103170 msgr2=0x7f5bac196340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:35.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.300+0000 7f5bb10d7640 1 --2- 172.21.15.87:0/4060994253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bac103170 0x7f5bac196340 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0031460 tx=0x7f5ba0004270 comp rx=0 tx=0).stop 2024-09-13T17:11:35.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.300+0000 7f5bb10d7640 1 -- 172.21.15.87:0/4060994253 shutdown_connections 2024-09-13T17:11:35.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.300+0000 7f5bb10d7640 1 --2- 172.21.15.87:0/4060994253 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f5b940a1090 0x7f5b940a3550 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.300+0000 7f5bb10d7640 1 --2- 172.21.15.87:0/4060994253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5bac105aa0 0x7f5bac19d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.300+0000 7f5bb10d7640 1 --2- 172.21.15.87:0/4060994253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bac103170 0x7f5bac196340 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.300+0000 7f5bb10d7640 1 --2- 172.21.15.87:0/4060994253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5bac100840 0x7f5bac195e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.300+0000 7f5bb10d7640 1 -- 172.21.15.87:0/4060994253 >> 172.21.15.87:0/4060994253 conn(0x7f5bac0fa3e0 msgr2=0x7f5bac101100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:35.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.300+0000 7f5bb10d7640 1 -- 172.21.15.87:0/4060994253 shutdown_connections 2024-09-13T17:11:35.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.300+0000 7f5bb10d7640 1 -- 172.21.15.87:0/4060994253 wait complete. 2024-09-13T17:11:35.310 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:35 smithi087 ceph-mon[30934]: pgmap v282: 129 pgs: 129 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 1 op/s 2024-09-13T17:11:35.310 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:35 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2002006258' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:11:35.311 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:35 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3660264884' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:11:35.311 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:35 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2032900828' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:11:35.312 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:11:35.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.415+0000 7fea65d95640 1 -- 172.21.15.87:0/1434549069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea60103120 msgr2=0x7fea60105510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:35.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.415+0000 7fea65d95640 1 --2- 172.21.15.87:0/1434549069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea60103120 0x7fea60105510 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fea54009900 tx=0x7fea5402a410 comp rx=0 tx=0).stop 2024-09-13T17:11:35.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.415+0000 7fea65d95640 1 -- 172.21.15.87:0/1434549069 shutdown_connections 2024-09-13T17:11:35.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.415+0000 7fea65d95640 1 --2- 172.21.15.87:0/1434549069 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea60105a50 0x7fea60107ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.415+0000 7fea65d95640 1 --2- 172.21.15.87:0/1434549069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea60103120 0x7fea60105510 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.415+0000 7fea65d95640 1 --2- 172.21.15.87:0/1434549069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea601007f0 0x7fea60102be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.415+0000 7fea65d95640 1 -- 172.21.15.87:0/1434549069 >> 172.21.15.87:0/1434549069 conn(0x7fea600fa3d0 msgr2=0x7fea600fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:35.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.415+0000 7fea65d95640 1 -- 172.21.15.87:0/1434549069 shutdown_connections 2024-09-13T17:11:35.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.415+0000 7fea65d95640 1 -- 172.21.15.87:0/1434549069 wait complete. 2024-09-13T17:11:35.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.416+0000 7fea65d95640 1 Processor -- start 2024-09-13T17:11:35.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.416+0000 7fea65d95640 1 -- start start 2024-09-13T17:11:35.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.416+0000 7fea65d95640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea601007f0 0x7fea60195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:35.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.416+0000 7fea65d95640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea60103120 0x7fea601962f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:35.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.416+0000 7fea65d95640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea60105a50 0x7fea6019d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:35.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.416+0000 7fea65d95640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6019d8a0 con 0x7fea60105a50 2024-09-13T17:11:35.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.416+0000 7fea65d95640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6019da10 con 0x7fea60103120 2024-09-13T17:11:35.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.416+0000 7fea65d95640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6019dbd0 con 0x7fea601007f0 2024-09-13T17:11:35.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.416+0000 7fea5ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea60105a50 0x7fea6019d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:35.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.416+0000 7fea5ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea60105a50 0x7fea6019d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46490/0 (socket says 172.21.15.87:46490) 2024-09-13T17:11:35.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.416+0000 7fea5ffff640 1 -- 172.21.15.87:0/4145237716 learned_addr learned my addr 172.21.15.87:0/4145237716 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:35.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.416+0000 7fea5ffff640 1 -- 172.21.15.87:0/4145237716 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea601007f0 msgr2=0x7fea60195db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:35.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.416+0000 7fea5ffff640 1 --2- 172.21.15.87:0/4145237716 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea601007f0 0x7fea60195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.416+0000 7fea5ffff640 1 -- 172.21.15.87:0/4145237716 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea60103120 msgr2=0x7fea601962f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:35.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.416+0000 7fea5effd640 1 --2- 172.21.15.87:0/4145237716 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea60103120 0x7fea601962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:35.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.416+0000 7fea5ffff640 1 --2- 172.21.15.87:0/4145237716 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea60103120 0x7fea601962f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.416+0000 7fea5ffff640 1 -- 172.21.15.87:0/4145237716 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea54009560 con 0x7fea60105a50 2024-09-13T17:11:35.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.417+0000 7fea5ffff640 1 --2- 172.21.15.87:0/4145237716 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea60105a50 0x7fea6019d360 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fea5800c970 tx=0x7fea5800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:35.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.417+0000 7fea5cff9640 1 -- 172.21.15.87:0/4145237716 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea58007bb0 con 0x7fea60105a50 2024-09-13T17:11:35.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.417+0000 7fea5cff9640 1 -- 172.21.15.87:0/4145237716 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fea58007d10 con 0x7fea60105a50 2024-09-13T17:11:35.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.417+0000 7fea65d95640 1 -- 172.21.15.87:0/4145237716 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea6019deb0 con 0x7fea60105a50 2024-09-13T17:11:35.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.417+0000 7fea5cff9640 1 -- 172.21.15.87:0/4145237716 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea58018660 con 0x7fea60105a50 2024-09-13T17:11:35.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.417+0000 7fea65d95640 1 -- 172.21.15.87:0/4145237716 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea6019e2e0 con 0x7fea60105a50 2024-09-13T17:11:35.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.418+0000 7fea65d95640 1 -- 172.21.15.87:0/4145237716 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea600fbec0 con 0x7fea60105a50 2024-09-13T17:11:35.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.419+0000 7fea5cff9640 1 -- 172.21.15.87:0/4145237716 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fea5800f450 con 0x7fea60105a50 2024-09-13T17:11:35.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.420+0000 7fea5cff9640 1 --2- 172.21.15.87:0/4145237716 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fea480a1090 0x7fea480a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:35.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.420+0000 7fea5f7fe640 1 --2- 172.21.15.87:0/4145237716 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fea480a1090 0x7fea480a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:35.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.420+0000 7fea5cff9640 1 -- 172.21.15.87:0/4145237716 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fea580ccbd0 con 0x7fea60105a50 2024-09-13T17:11:35.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.420+0000 7fea5f7fe640 1 --2- 172.21.15.87:0/4145237716 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fea480a1090 0x7fea480a3550 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fea50005fd0 tx=0x7fea500094b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:35.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.424+0000 7fea5cff9640 1 -- 172.21.15.87:0/4145237716 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fea58096170 con 0x7fea60105a50 2024-09-13T17:11:35.566 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:35 smithi118 ceph-mon[34374]: pgmap v282: 129 pgs: 129 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 1 op/s 2024-09-13T17:11:35.566 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:35 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2002006258' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:11:35.566 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:35 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3660264884' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:11:35.567 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:35 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2032900828' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:11:35.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.585+0000 7fea65d95640 1 -- 172.21.15.87:0/4145237716 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fea6010b990 con 0x7fea60105a50 2024-09-13T17:11:35.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.586+0000 7fea5cff9640 1 -- 172.21.15.87:0/4145237716 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v89) v1 ==== 103+0+11 (secure 0 0 0) 0x7fea58099790 con 0x7fea60105a50 2024-09-13T17:11:35.587 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-09-13T17:11:35.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.588+0000 7fea65d95640 1 -- 172.21.15.87:0/4145237716 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fea480a1090 msgr2=0x7fea480a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:35.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.588+0000 7fea65d95640 1 --2- 172.21.15.87:0/4145237716 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fea480a1090 0x7fea480a3550 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fea50005fd0 tx=0x7fea500094b0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.588+0000 7fea65d95640 1 -- 172.21.15.87:0/4145237716 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea60105a50 msgr2=0x7fea6019d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:35.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.588+0000 7fea65d95640 1 --2- 172.21.15.87:0/4145237716 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea60105a50 0x7fea6019d360 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fea5800c970 tx=0x7fea5800ce30 comp rx=0 tx=0).stop 2024-09-13T17:11:35.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.588+0000 7fea65d95640 1 -- 172.21.15.87:0/4145237716 shutdown_connections 2024-09-13T17:11:35.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.588+0000 7fea65d95640 1 --2- 172.21.15.87:0/4145237716 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fea480a1090 0x7fea480a3550 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.588+0000 7fea65d95640 1 --2- 172.21.15.87:0/4145237716 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea60105a50 0x7fea6019d360 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.588+0000 7fea65d95640 1 --2- 172.21.15.87:0/4145237716 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea60103120 0x7fea601962f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.588+0000 7fea65d95640 1 --2- 172.21.15.87:0/4145237716 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea601007f0 0x7fea60195db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.588+0000 7fea65d95640 1 -- 172.21.15.87:0/4145237716 >> 172.21.15.87:0/4145237716 conn(0x7fea600fa3d0 msgr2=0x7fea601011b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:35.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.588+0000 7fea65d95640 1 -- 172.21.15.87:0/4145237716 shutdown_connections 2024-09-13T17:11:35.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.588+0000 7fea65d95640 1 -- 172.21.15.87:0/4145237716 wait complete. 2024-09-13T17:11:35.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:35 smithi149 ceph-mon[35496]: pgmap v282: 129 pgs: 129 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 1 op/s 2024-09-13T17:11:35.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:35 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2002006258' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:11:35.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:35 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3660264884' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:11:35.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:35 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2032900828' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:11:35.600 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:11:35.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.698+0000 7f53006e5640 1 -- 172.21.15.87:0/2228661490 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52f80fecb0 msgr2=0x7f52f80ff0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:35.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.698+0000 7f53006e5640 1 --2- 172.21.15.87:0/2228661490 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52f80fecb0 0x7f52f80ff0b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f52f4009900 tx=0x7f52f402a3f0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.698+0000 7f53006e5640 1 -- 172.21.15.87:0/2228661490 shutdown_connections 2024-09-13T17:11:35.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.698+0000 7f53006e5640 1 --2- 172.21.15.87:0/2228661490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52f8100860 0x7f52f81070f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.698+0000 7f53006e5640 1 --2- 172.21.15.87:0/2228661490 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52f80ffea0 0x7f52f8100320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.698+0000 7f53006e5640 1 --2- 172.21.15.87:0/2228661490 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52f80fecb0 0x7f52f80ff0b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.698+0000 7f53006e5640 1 -- 172.21.15.87:0/2228661490 >> 172.21.15.87:0/2228661490 conn(0x7f52f80fa430 msgr2=0x7f52f80fc850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:35.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.698+0000 7f53006e5640 1 -- 172.21.15.87:0/2228661490 shutdown_connections 2024-09-13T17:11:35.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.698+0000 7f53006e5640 1 -- 172.21.15.87:0/2228661490 wait complete. 2024-09-13T17:11:35.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.699+0000 7f53006e5640 1 Processor -- start 2024-09-13T17:11:35.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.699+0000 7f53006e5640 1 -- start start 2024-09-13T17:11:35.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.699+0000 7f53006e5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52f80fecb0 0x7f52f8195d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:35.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.699+0000 7f53006e5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52f80ffea0 0x7f52f8196280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:35.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.699+0000 7f53006e5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52f8100860 0x7f52f819d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:35.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.699+0000 7f53006e5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f819d820 con 0x7f52f80ffea0 2024-09-13T17:11:35.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.699+0000 7f53006e5640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f819d990 con 0x7f52f80fecb0 2024-09-13T17:11:35.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.699+0000 7f53006e5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f819db50 con 0x7f52f8100860 2024-09-13T17:11:35.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.699+0000 7f52fdc80640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52f80ffea0 0x7f52f8196280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:35.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.699+0000 7f52fdc80640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52f80ffea0 0x7f52f8196280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46506/0 (socket says 172.21.15.87:46506) 2024-09-13T17:11:35.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.699+0000 7f52fdc80640 1 -- 172.21.15.87:0/2036451997 learned_addr learned my addr 172.21.15.87:0/2036451997 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:35.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.699+0000 7f52fe481640 1 --2- 172.21.15.87:0/2036451997 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52f80fecb0 0x7f52f8195d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:35.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.699+0000 7f52fec82640 1 --2- 172.21.15.87:0/2036451997 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52f8100860 0x7f52f819d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:35.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.699+0000 7f52fdc80640 1 -- 172.21.15.87:0/2036451997 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52f8100860 msgr2=0x7f52f819d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:35.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.699+0000 7f52fdc80640 1 --2- 172.21.15.87:0/2036451997 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52f8100860 0x7f52f819d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.699+0000 7f52fdc80640 1 -- 172.21.15.87:0/2036451997 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52f80fecb0 msgr2=0x7f52f8195d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:35.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.699+0000 7f52fdc80640 1 --2- 172.21.15.87:0/2036451997 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52f80fecb0 0x7f52f8195d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.699+0000 7f52fdc80640 1 -- 172.21.15.87:0/2036451997 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f4009560 con 0x7f52f80ffea0 2024-09-13T17:11:35.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.699+0000 7f52fec82640 1 --2- 172.21.15.87:0/2036451997 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52f8100860 0x7f52f819d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:11:35.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.700+0000 7f52fdc80640 1 --2- 172.21.15.87:0/2036451997 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52f80ffea0 0x7f52f8196280 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f52e800c920 tx=0x7f52e800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:35.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.700+0000 7f52ef7fe640 1 -- 172.21.15.87:0/2036451997 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e8007c70 con 0x7f52f80ffea0 2024-09-13T17:11:35.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.700+0000 7f52ef7fe640 1 -- 172.21.15.87:0/2036451997 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f52e8007dd0 con 0x7f52f80ffea0 2024-09-13T17:11:35.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.700+0000 7f53006e5640 1 -- 172.21.15.87:0/2036451997 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f819de30 con 0x7f52f80ffea0 2024-09-13T17:11:35.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.700+0000 7f52ef7fe640 1 -- 172.21.15.87:0/2036451997 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e80187c0 con 0x7f52f80ffea0 2024-09-13T17:11:35.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.700+0000 7f53006e5640 1 -- 172.21.15.87:0/2036451997 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f819e250 con 0x7f52f80ffea0 2024-09-13T17:11:35.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.701+0000 7f53006e5640 1 -- 172.21.15.87:0/2036451997 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f8106160 con 0x7f52f80ffea0 2024-09-13T17:11:35.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.703+0000 7f52ef7fe640 1 -- 172.21.15.87:0/2036451997 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f52e800f450 con 0x7f52f80ffea0 2024-09-13T17:11:35.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.703+0000 7f52ef7fe640 1 --2- 172.21.15.87:0/2036451997 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f52e40a1090 0x7f52e40a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:35.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.703+0000 7f52ef7fe640 1 -- 172.21.15.87:0/2036451997 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f52e80ccf50 con 0x7f52f80ffea0 2024-09-13T17:11:35.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.703+0000 7f52fe481640 1 --2- 172.21.15.87:0/2036451997 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f52e40a1090 0x7f52e40a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:35.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.704+0000 7f52fe481640 1 --2- 172.21.15.87:0/2036451997 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f52e40a1090 0x7f52e40a3550 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f52f402a910 tx=0x7f52f4031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:35.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.706+0000 7f52ef7fe640 1 -- 172.21.15.87:0/2036451997 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f52e80964f0 con 0x7f52f80ffea0 2024-09-13T17:11:35.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.877+0000 7f53006e5640 1 -- 172.21.15.87:0/2036451997 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f52f810b6b0 con 0x7f52f80ffea0 2024-09-13T17:11:35.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.877+0000 7f52ef7fe640 1 -- 172.21.15.87:0/2036451997 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v89) v1 ==== 81+0+589 (secure 0 0 0) 0x7f52e8099b10 con 0x7f52f80ffea0 2024-09-13T17:11:35.879 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/586423689 2024-09-14T17:04:47.990078+0000 2024-09-13T17:11:35.879 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6801/4144176457 2024-09-14T17:04:47.990078+0000 2024-09-13T17:11:35.879 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6800/4144176457 2024-09-14T17:04:47.990078+0000 2024-09-13T17:11:35.879 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/3270371628 2024-09-14T17:04:47.990078+0000 2024-09-13T17:11:35.879 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/515676743 2024-09-14T17:04:47.990078+0000 2024-09-13T17:11:35.879 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/1475107314 2024-09-14T17:04:24.083789+0000 2024-09-13T17:11:35.879 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/553289143 2024-09-14T17:04:24.083789+0000 2024-09-13T17:11:35.879 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/3403361612 2024-09-14T17:04:24.083789+0000 2024-09-13T17:11:35.879 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6801/1587363880 2024-09-14T17:04:24.083789+0000 2024-09-13T17:11:35.879 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6800/1587363880 2024-09-14T17:04:24.083789+0000 2024-09-13T17:11:35.879 INFO:teuthology.orchestra.run.smithi087.stderr:listed 10 entries 2024-09-13T17:11:35.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.879+0000 7f53006e5640 1 -- 172.21.15.87:0/2036451997 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f52e40a1090 msgr2=0x7f52e40a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:35.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.879+0000 7f53006e5640 1 --2- 172.21.15.87:0/2036451997 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f52e40a1090 0x7f52e40a3550 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f52f402a910 tx=0x7f52f4031400 comp rx=0 tx=0).stop 2024-09-13T17:11:35.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.879+0000 7f53006e5640 1 -- 172.21.15.87:0/2036451997 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52f80ffea0 msgr2=0x7f52f8196280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:35.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.879+0000 7f53006e5640 1 --2- 172.21.15.87:0/2036451997 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52f80ffea0 0x7f52f8196280 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f52e800c920 tx=0x7f52e800cde0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.879+0000 7f53006e5640 1 -- 172.21.15.87:0/2036451997 shutdown_connections 2024-09-13T17:11:35.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.879+0000 7f53006e5640 1 --2- 172.21.15.87:0/2036451997 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f52e40a1090 0x7f52e40a3550 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.879+0000 7f53006e5640 1 --2- 172.21.15.87:0/2036451997 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52f8100860 0x7f52f819d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.879+0000 7f53006e5640 1 --2- 172.21.15.87:0/2036451997 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52f80ffea0 0x7f52f8196280 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.879+0000 7f53006e5640 1 --2- 172.21.15.87:0/2036451997 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52f80fecb0 0x7f52f8195d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:35.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.879+0000 7f53006e5640 1 -- 172.21.15.87:0/2036451997 >> 172.21.15.87:0/2036451997 conn(0x7f52f80fa430 msgr2=0x7f52f8103330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:35.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.879+0000 7f53006e5640 1 -- 172.21.15.87:0/2036451997 shutdown_connections 2024-09-13T17:11:35.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:35.879+0000 7f53006e5640 1 -- 172.21.15.87:0/2036451997 wait complete. 2024-09-13T17:11:35.891 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T17:11:35.891 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:11:35.909 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:11:36.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.047+0000 7fa357583640 1 -- 172.21.15.87:0/2945167931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3500fe070 msgr2=0x7fa3500fe470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:36.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.047+0000 7fa357583640 1 --2- 172.21.15.87:0/2945167931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3500fe070 0x7fa3500fe470 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa340009900 tx=0x7fa34002a410 comp rx=0 tx=0).stop 2024-09-13T17:11:36.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.047+0000 7fa357583640 1 -- 172.21.15.87:0/2945167931 shutdown_connections 2024-09-13T17:11:36.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.047+0000 7fa357583640 1 --2- 172.21.15.87:0/2945167931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa350101a00 0x7fa350108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:36.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.047+0000 7fa357583640 1 --2- 172.21.15.87:0/2945167931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa350101040 0x7fa3501014c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:36.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.047+0000 7fa357583640 1 --2- 172.21.15.87:0/2945167931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3500fe070 0x7fa3500fe470 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:36.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.047+0000 7fa357583640 1 -- 172.21.15.87:0/2945167931 >> 172.21.15.87:0/2945167931 conn(0x7fa3500f9bb0 msgr2=0x7fa3500fbfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:36.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.047+0000 7fa357583640 1 -- 172.21.15.87:0/2945167931 shutdown_connections 2024-09-13T17:11:36.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.047+0000 7fa357583640 1 -- 172.21.15.87:0/2945167931 wait complete. 2024-09-13T17:11:36.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.048+0000 7fa357583640 1 Processor -- start 2024-09-13T17:11:36.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.048+0000 7fa357583640 1 -- start start 2024-09-13T17:11:36.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.048+0000 7fa357583640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3500fe070 0x7fa350195de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:36.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.048+0000 7fa357583640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa350101040 0x7fa350196320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:36.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.048+0000 7fa357583640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa350101a00 0x7fa35019d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:36.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.048+0000 7fa357583640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35019d8d0 con 0x7fa3500fe070 2024-09-13T17:11:36.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.048+0000 7fa357583640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35019da40 con 0x7fa350101040 2024-09-13T17:11:36.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.048+0000 7fa357583640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35019dc00 con 0x7fa350101a00 2024-09-13T17:11:36.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.048+0000 7fa35531f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3500fe070 0x7fa350195de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:36.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.048+0000 7fa35531f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3500fe070 0x7fa350195de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46528/0 (socket says 172.21.15.87:46528) 2024-09-13T17:11:36.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.048+0000 7fa35531f640 1 -- 172.21.15.87:0/3186041912 learned_addr learned my addr 172.21.15.87:0/3186041912 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:36.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.048+0000 7fa355b20640 1 --2- 172.21.15.87:0/3186041912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa350101a00 0x7fa35019d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:36.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.048+0000 7fa354b1e640 1 --2- 172.21.15.87:0/3186041912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa350101040 0x7fa350196320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:36.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.048+0000 7fa35531f640 1 -- 172.21.15.87:0/3186041912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa350101a00 msgr2=0x7fa35019d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:36.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.048+0000 7fa35531f640 1 --2- 172.21.15.87:0/3186041912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa350101a00 0x7fa35019d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:36.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.048+0000 7fa35531f640 1 -- 172.21.15.87:0/3186041912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa350101040 msgr2=0x7fa350196320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:36.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.048+0000 7fa35531f640 1 --2- 172.21.15.87:0/3186041912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa350101040 0x7fa350196320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:36.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.048+0000 7fa35531f640 1 -- 172.21.15.87:0/3186041912 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa340009560 con 0x7fa3500fe070 2024-09-13T17:11:36.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.048+0000 7fa354b1e640 1 --2- 172.21.15.87:0/3186041912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa350101040 0x7fa350196320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:11:36.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.048+0000 7fa35531f640 1 --2- 172.21.15.87:0/3186041912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3500fe070 0x7fa350195de0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa34002aa00 tx=0x7fa3400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:36.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.048+0000 7fa3467fc640 1 -- 172.21.15.87:0/3186041912 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa340003a00 con 0x7fa3500fe070 2024-09-13T17:11:36.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.049+0000 7fa3467fc640 1 -- 172.21.15.87:0/3186041912 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa3400044e0 con 0x7fa3500fe070 2024-09-13T17:11:36.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.049+0000 7fa357583640 1 -- 172.21.15.87:0/3186041912 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa35019de80 con 0x7fa3500fe070 2024-09-13T17:11:36.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.049+0000 7fa3467fc640 1 -- 172.21.15.87:0/3186041912 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34003a3c0 con 0x7fa3500fe070 2024-09-13T17:11:36.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.049+0000 7fa357583640 1 -- 172.21.15.87:0/3186041912 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa35019e250 con 0x7fa3500fe070 2024-09-13T17:11:36.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.049+0000 7fa357583640 1 -- 172.21.15.87:0/3186041912 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa350107370 con 0x7fa3500fe070 2024-09-13T17:11:36.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.050+0000 7fa3467fc640 1 -- 172.21.15.87:0/3186041912 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa340003b60 con 0x7fa3500fe070 2024-09-13T17:11:36.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.051+0000 7fa3467fc640 1 --2- 172.21.15.87:0/3186041912 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa33c0a1090 0x7fa33c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:36.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.051+0000 7fa354b1e640 1 --2- 172.21.15.87:0/3186041912 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa33c0a1090 0x7fa33c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:36.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.051+0000 7fa3467fc640 1 -- 172.21.15.87:0/3186041912 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fa3400ed900 con 0x7fa3500fe070 2024-09-13T17:11:36.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.052+0000 7fa354b1e640 1 --2- 172.21.15.87:0/3186041912 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa33c0a1090 0x7fa33c0a3550 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa3501972f0 tx=0x7fa34c005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:36.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.055+0000 7fa3467fc640 1 -- 172.21.15.87:0/3186041912 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa3400b6ea0 con 0x7fa3500fe070 2024-09-13T17:11:36.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.222+0000 7fa357583640 1 -- 172.21.15.87:0/3186041912 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa35002c480 con 0x7fa3500fe070 2024-09-13T17:11:36.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.223+0000 7fa3467fc640 1 -- 172.21.15.87:0/3186041912 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+23971 (secure 0 0 0) 0x7fa340041090 con 0x7fa3500fe070 2024-09-13T17:11:36.224 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:11:36.225 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":89,"fsid":"043d5bae-71f2-11ef-bceb-c7b262605968","created":"2024-09-13T17:03:57.852010+0000","modified":"2024-09-13T17:11:27.679526+0000","last_up_change":"2024-09-13T17:10:34.423548+0000","last_in_change":"2024-09-13T17:10:14.228123+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:07:02.286400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:11:21.965141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:11:22.504345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:11:25.565163+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58250283-85c0-416e-abdd-1fc5a7ff0c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6803","nonce":1316956138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6805","nonce":1316956138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6809","nonce":1316956138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6807","nonce":1316956138}]},"public_addr":"172.21.15.87:6803/1316956138","cluster_addr":"172.21.15.87:6805/1316956138","heartbeat_back_addr":"172.21.15.87:6809/1316956138","heartbeat_front_addr":"172.21.15.87:6807/1316956138","state":["exists","up"]},{"osd":1,"uuid":"b9d49969-94b1-4262-b4ff-db0a8e3331af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6801","nonce":3352566727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6803","nonce":3352566727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6807","nonce":3352566727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6805","nonce":3352566727}]},"public_addr":"172.21.15.118:6801/3352566727","cluster_addr":"172.21.15.118:6803/3352566727","heartbeat_back_addr":"172.21.15.118:6807/3352566727","heartbeat_front_addr":"172.21.15.118:6805/3352566727","state":["exists","up"]},{"osd":2,"uuid":"ba64549e-d736-426f-b466-f569af5f16d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6801","nonce":2774581686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6803","nonce":2774581686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6807","nonce":2774581686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6805","nonce":2774581686}]},"public_addr":"172.21.15.149:6801/2774581686","cluster_addr":"172.21.15.149:6803/2774581686","heartbeat_back_addr":"172.21.15.149:6807/2774581686","heartbeat_front_addr":"172.21.15.149:6805/2774581686","state":["exists","up"]},{"osd":3,"uuid":"3d5553e5-371b-49fd-976b-9e72a97a2f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6811","nonce":3306119066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6813","nonce":3306119066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6817","nonce":3306119066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6815","nonce":3306119066}]},"public_addr":"172.21.15.87:6811/3306119066","cluster_addr":"172.21.15.87:6813/3306119066","heartbeat_back_addr":"172.21.15.87:6817/3306119066","heartbeat_front_addr":"172.21.15.87:6815/3306119066","state":["exists","up"]},{"osd":4,"uuid":"2fbe0e27-34ec-42a6-9962-f1d8202b3159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6809","nonce":3342349890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6811","nonce":3342349890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6815","nonce":3342349890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6813","nonce":3342349890}]},"public_addr":"172.21.15.118:6809/3342349890","cluster_addr":"172.21.15.118:6811/3342349890","heartbeat_back_addr":"172.21.15.118:6815/3342349890","heartbeat_front_addr":"172.21.15.118:6813/3342349890","state":["exists","up"]},{"osd":5,"uuid":"53c14519-6170-4b5a-a79d-4835882d7bec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6809","nonce":3468867124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6811","nonce":3468867124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6815","nonce":3468867124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6813","nonce":3468867124}]},"public_addr":"172.21.15.149:6809/3468867124","cluster_addr":"172.21.15.149:6811/3468867124","heartbeat_back_addr":"172.21.15.149:6815/3468867124","heartbeat_front_addr":"172.21.15.149:6813/3468867124","state":["exists","up"]},{"osd":6,"uuid":"d3951b32-db77-4b8b-9de0-f05e03d13f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6819","nonce":326563617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6821","nonce":326563617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6825","nonce":326563617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6823","nonce":326563617}]},"public_addr":"172.21.15.87:6819/326563617","cluster_addr":"172.21.15.87:6821/326563617","heartbeat_back_addr":"172.21.15.87:6825/326563617","heartbeat_front_addr":"172.21.15.87:6823/326563617","state":["exists","up"]},{"osd":7,"uuid":"4d46dab7-a8bf-4e3e-b5c0-43860d336bdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6817","nonce":1690268990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6819","nonce":1690268990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6823","nonce":1690268990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6821","nonce":1690268990}]},"public_addr":"172.21.15.118:6817/1690268990","cluster_addr":"172.21.15.118:6819/1690268990","heartbeat_back_addr":"172.21.15.118:6823/1690268990","heartbeat_front_addr":"172.21.15.118:6821/1690268990","state":["exists","up"]},{"osd":8,"uuid":"5a015a7d-60a3-4412-96af-1b61d2ad51f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6817","nonce":1558675380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6819","nonce":1558675380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6823","nonce":1558675380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6821","nonce":1558675380}]},"public_addr":"172.21.15.149:6817/1558675380","cluster_addr":"172.21.15.149:6819/1558675380","heartbeat_back_addr":"172.21.15.149:6823/1558675380","heartbeat_front_addr":"172.21.15.149:6821/1558675380","state":["exists","up"]},{"osd":9,"uuid":"248c0b6e-4c4e-4c63-a0dd-e4cdf3b997a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6827","nonce":1453934262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6829","nonce":1453934262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6833","nonce":1453934262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6831","nonce":1453934262}]},"public_addr":"172.21.15.87:6827/1453934262","cluster_addr":"172.21.15.87:6829/1453934262","heartbeat_back_addr":"172.21.15.87:6833/1453934262","heartbeat_front_addr":"172.21.15.87:6831/1453934262","state":["exists","up"]},{"osd":10,"uuid":"24238714-e737-4371-b5d5-0cd3395f09bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6825","nonce":1034318850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6827","nonce":1034318850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6831","nonce":1034318850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6829","nonce":1034318850}]},"public_addr":"172.21.15.118:6825/1034318850","cluster_addr":"172.21.15.118:6827/1034318850","heartbeat_back_addr":"172.21.15.118:6831/1034318850","heartbeat_front_addr":"172.21.15.118:6829/1034318850","state":["exists","up"]},{"osd":11,"uuid":"409dd3bf-5154-4dea-8708-7de7f9e2e793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6825","nonce":271000465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6827","nonce":271000465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6831","nonce":271000465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6829","nonce":271000465}]},"public_addr":"172.21.15.149:6825/271000465","cluster_addr":"172.21.15.149:6827/271000465","heartbeat_back_addr":"172.21.15.149:6831/271000465","heartbeat_front_addr":"172.21.15.149:6829/271000465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:16.382664+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:37.914250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:00.425876+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:23.960183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:47.004088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:10.214345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:33.719221+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:57.099599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:20.971881+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:44.827167+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:08.135516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:32.085853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/586423689":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6801/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6800/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/3270371628":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/515676743":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/1475107314":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/553289143":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/3403361612":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6801/1587363880":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6800/1587363880":"2024-09-14T17:04:24.083789+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:11:36.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.225+0000 7fa357583640 1 -- 172.21.15.87:0/3186041912 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa33c0a1090 msgr2=0x7fa33c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:36.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.225+0000 7fa357583640 1 --2- 172.21.15.87:0/3186041912 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa33c0a1090 0x7fa33c0a3550 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa3501972f0 tx=0x7fa34c005d30 comp rx=0 tx=0).stop 2024-09-13T17:11:36.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.225+0000 7fa357583640 1 -- 172.21.15.87:0/3186041912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3500fe070 msgr2=0x7fa350195de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:36.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.225+0000 7fa357583640 1 --2- 172.21.15.87:0/3186041912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3500fe070 0x7fa350195de0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa34002aa00 tx=0x7fa3400042f0 comp rx=0 tx=0).stop 2024-09-13T17:11:36.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.225+0000 7fa357583640 1 -- 172.21.15.87:0/3186041912 shutdown_connections 2024-09-13T17:11:36.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.225+0000 7fa357583640 1 --2- 172.21.15.87:0/3186041912 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa33c0a1090 0x7fa33c0a3550 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:36.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.225+0000 7fa357583640 1 --2- 172.21.15.87:0/3186041912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa350101a00 0x7fa35019d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:36.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.225+0000 7fa357583640 1 --2- 172.21.15.87:0/3186041912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa350101040 0x7fa350196320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:36.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.225+0000 7fa357583640 1 --2- 172.21.15.87:0/3186041912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3500fe070 0x7fa350195de0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:36.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.225+0000 7fa357583640 1 -- 172.21.15.87:0/3186041912 >> 172.21.15.87:0/3186041912 conn(0x7fa3500f9bb0 msgr2=0x7fa350104540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:36.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.226+0000 7fa357583640 1 -- 172.21.15.87:0/3186041912 shutdown_connections 2024-09-13T17:11:36.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.226+0000 7fa357583640 1 -- 172.21.15.87:0/3186041912 wait complete. 2024-09-13T17:11:36.228 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:36 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/4060994253' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:11:36.228 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:36 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/4145237716' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:11:36.228 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:36 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2036451997' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T17:11:36.238 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:07:02.286400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:11:21.965141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:11:22.504345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:11:25.565163+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:11:36.238 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:11:36.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.339+0000 7f58ccc90640 1 -- 172.21.15.87:0/1075801775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58c80fec80 msgr2=0x7f58c80ff080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:36.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.339+0000 7f58ccc90640 1 --2- 172.21.15.87:0/1075801775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58c80fec80 0x7f58c80ff080 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f58b8009900 tx=0x7f58b802a410 comp rx=0 tx=0).stop 2024-09-13T17:11:36.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.339+0000 7f58ccc90640 1 -- 172.21.15.87:0/1075801775 shutdown_connections 2024-09-13T17:11:36.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.339+0000 7f58ccc90640 1 --2- 172.21.15.87:0/1075801775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58c8100830 0x7f58c81070c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:36.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.339+0000 7f58ccc90640 1 --2- 172.21.15.87:0/1075801775 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58c80ffe70 0x7f58c81002f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:36.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.339+0000 7f58ccc90640 1 --2- 172.21.15.87:0/1075801775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58c80fec80 0x7f58c80ff080 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:36.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.339+0000 7f58ccc90640 1 -- 172.21.15.87:0/1075801775 >> 172.21.15.87:0/1075801775 conn(0x7f58c80fa3e0 msgr2=0x7f58c80fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:36.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.339+0000 7f58ccc90640 1 -- 172.21.15.87:0/1075801775 shutdown_connections 2024-09-13T17:11:36.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.339+0000 7f58ccc90640 1 -- 172.21.15.87:0/1075801775 wait complete. 2024-09-13T17:11:36.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.339+0000 7f58ccc90640 1 Processor -- start 2024-09-13T17:11:36.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.339+0000 7f58ccc90640 1 -- start start 2024-09-13T17:11:36.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.340+0000 7f58ccc90640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58c80fec80 0x7f58c8198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:36.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.340+0000 7f58ccc90640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58c80ffe70 0x7f58c8198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:36.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.340+0000 7f58ccc90640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58c8100830 0x7f58c819f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:36.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.340+0000 7f58ccc90640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c819fb00 con 0x7f58c80ffe70 2024-09-13T17:11:36.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.340+0000 7f58ccc90640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c819fc70 con 0x7f58c8100830 2024-09-13T17:11:36.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.340+0000 7f58ccc90640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c819fe30 con 0x7f58c80fec80 2024-09-13T17:11:36.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.340+0000 7f58c5d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58c80ffe70 0x7f58c8198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:36.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.340+0000 7f58c5d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58c80ffe70 0x7f58c8198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46538/0 (socket says 172.21.15.87:46538) 2024-09-13T17:11:36.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.340+0000 7f58c5d9b640 1 -- 172.21.15.87:0/2755719125 learned_addr learned my addr 172.21.15.87:0/2755719125 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:36.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.340+0000 7f58c659c640 1 --2- 172.21.15.87:0/2755719125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58c80fec80 0x7f58c8198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:36.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.340+0000 7f58c6d9d640 1 --2- 172.21.15.87:0/2755719125 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58c8100830 0x7f58c819f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:36.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.340+0000 7f58c5d9b640 1 -- 172.21.15.87:0/2755719125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58c80fec80 msgr2=0x7f58c8198010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:36.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.340+0000 7f58c5d9b640 1 --2- 172.21.15.87:0/2755719125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58c80fec80 0x7f58c8198010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:36.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.340+0000 7f58c5d9b640 1 -- 172.21.15.87:0/2755719125 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58c8100830 msgr2=0x7f58c819f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:36.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.340+0000 7f58c5d9b640 1 --2- 172.21.15.87:0/2755719125 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58c8100830 0x7f58c819f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:36.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.340+0000 7f58c5d9b640 1 -- 172.21.15.87:0/2755719125 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b8009560 con 0x7f58c80ffe70 2024-09-13T17:11:36.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.340+0000 7f58c5d9b640 1 --2- 172.21.15.87:0/2755719125 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58c80ffe70 0x7f58c8198550 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f58bc00c890 tx=0x7f58bc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:36.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.340+0000 7f58b77fe640 1 -- 172.21.15.87:0/2755719125 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc004220 con 0x7f58c80ffe70 2024-09-13T17:11:36.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.340+0000 7f58b77fe640 1 -- 172.21.15.87:0/2755719125 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f58bc007e60 con 0x7f58c80ffe70 2024-09-13T17:11:36.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.340+0000 7f58b77fe640 1 -- 172.21.15.87:0/2755719125 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc004a00 con 0x7f58c80ffe70 2024-09-13T17:11:36.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.340+0000 7f58ccc90640 1 -- 172.21.15.87:0/2755719125 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c81a0110 con 0x7f58c80ffe70 2024-09-13T17:11:36.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.340+0000 7f58ccc90640 1 -- 172.21.15.87:0/2755719125 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c81a0620 con 0x7f58c80ffe70 2024-09-13T17:11:36.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.341+0000 7f58ccc90640 1 -- 172.21.15.87:0/2755719125 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58c810a590 con 0x7f58c80ffe70 2024-09-13T17:11:36.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.342+0000 7f58b77fe640 1 -- 172.21.15.87:0/2755719125 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f58bc0079b0 con 0x7f58c80ffe70 2024-09-13T17:11:36.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.343+0000 7f58b77fe640 1 --2- 172.21.15.87:0/2755719125 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f58b00a1110 0x7f58b00a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:36.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.343+0000 7f58c659c640 1 --2- 172.21.15.87:0/2755719125 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f58b00a1110 0x7f58b00a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:36.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.343+0000 7f58b77fe640 1 -- 172.21.15.87:0/2755719125 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f58bc0cc860 con 0x7f58c80ffe70 2024-09-13T17:11:36.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.343+0000 7f58c659c640 1 --2- 172.21.15.87:0/2755719125 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f58b00a1110 0x7f58b00a35d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f58b80057c0 tx=0x7f58b8031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:36.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.347+0000 7f58b77fe640 1 -- 172.21.15.87:0/2755719125 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f58bc095e00 con 0x7f58c80ffe70 2024-09-13T17:11:36.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.508+0000 7f58ccc90640 1 -- 172.21.15.87:0/2755719125 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f58c81a08a0 con 0x7f58c80ffe70 2024-09-13T17:11:36.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.509+0000 7f58b77fe640 1 -- 172.21.15.87:0/2755719125 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7f58bc01d020 con 0x7f58c80ffe70 2024-09-13T17:11:36.510 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-09-13T17:11:36.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.510+0000 7f58ccc90640 1 -- 172.21.15.87:0/2755719125 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f58b00a1110 msgr2=0x7f58b00a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:36.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.510+0000 7f58ccc90640 1 --2- 172.21.15.87:0/2755719125 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f58b00a1110 0x7f58b00a35d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f58b80057c0 tx=0x7f58b8031400 comp rx=0 tx=0).stop 2024-09-13T17:11:36.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.510+0000 7f58ccc90640 1 -- 172.21.15.87:0/2755719125 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58c80ffe70 msgr2=0x7f58c8198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:36.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.510+0000 7f58ccc90640 1 --2- 172.21.15.87:0/2755719125 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58c80ffe70 0x7f58c8198550 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f58bc00c890 tx=0x7f58bc00cd50 comp rx=0 tx=0).stop 2024-09-13T17:11:36.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.511+0000 7f58ccc90640 1 -- 172.21.15.87:0/2755719125 shutdown_connections 2024-09-13T17:11:36.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.511+0000 7f58ccc90640 1 --2- 172.21.15.87:0/2755719125 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f58b00a1110 0x7f58b00a35d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:36.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.511+0000 7f58ccc90640 1 --2- 172.21.15.87:0/2755719125 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58c8100830 0x7f58c819f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:36.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.511+0000 7f58ccc90640 1 --2- 172.21.15.87:0/2755719125 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58c80ffe70 0x7f58c8198550 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:36.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.511+0000 7f58ccc90640 1 --2- 172.21.15.87:0/2755719125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58c80fec80 0x7f58c8198010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:36.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.511+0000 7f58ccc90640 1 -- 172.21.15.87:0/2755719125 >> 172.21.15.87:0/2755719125 conn(0x7f58c80fa3e0 msgr2=0x7f58c80685e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:36.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.511+0000 7f58ccc90640 1 -- 172.21.15.87:0/2755719125 shutdown_connections 2024-09-13T17:11:36.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.511+0000 7f58ccc90640 1 -- 172.21.15.87:0/2755719125 wait complete. 2024-09-13T17:11:36.523 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:11:36.578 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:36 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/4060994253' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:11:36.578 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:36 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/4145237716' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:11:36.578 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:36 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2036451997' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T17:11:36.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:36 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/4060994253' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:11:36.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:36 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/4145237716' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:11:36.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:36 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2036451997' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T17:11:36.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.623+0000 7f1d4d365640 1 -- 172.21.15.87:0/1940301727 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d480fec60 msgr2=0x7f1d480ff060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:36.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.623+0000 7f1d4d365640 1 --2- 172.21.15.87:0/1940301727 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d480fec60 0x7f1d480ff060 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1d38009ca0 tx=0x7f1d3802a8c0 comp rx=0 tx=0).stop 2024-09-13T17:11:36.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.624+0000 7f1d4d365640 1 -- 172.21.15.87:0/1940301727 shutdown_connections 2024-09-13T17:11:36.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.624+0000 7f1d4d365640 1 --2- 172.21.15.87:0/1940301727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d48100810 0x7f1d481070a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:36.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.624+0000 7f1d4d365640 1 --2- 172.21.15.87:0/1940301727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d480ffe50 0x7f1d481002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:36.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.624+0000 7f1d4d365640 1 --2- 172.21.15.87:0/1940301727 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d480fec60 0x7f1d480ff060 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:36.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.624+0000 7f1d4d365640 1 -- 172.21.15.87:0/1940301727 >> 172.21.15.87:0/1940301727 conn(0x7f1d480fa3e0 msgr2=0x7f1d480fc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:36.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.624+0000 7f1d4d365640 1 -- 172.21.15.87:0/1940301727 shutdown_connections 2024-09-13T17:11:36.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.624+0000 7f1d4d365640 1 -- 172.21.15.87:0/1940301727 wait complete. 2024-09-13T17:11:36.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.624+0000 7f1d4d365640 1 Processor -- start 2024-09-13T17:11:36.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.624+0000 7f1d4d365640 1 -- start start 2024-09-13T17:11:36.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.624+0000 7f1d4d365640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d480fec60 0x7f1d48194b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:36.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.624+0000 7f1d4d365640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d480ffe50 0x7f1d481950d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:36.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.624+0000 7f1d4d365640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d48100810 0x7f1d4819c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:36.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.624+0000 7f1d4d365640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4819c680 con 0x7f1d480fec60 2024-09-13T17:11:36.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.624+0000 7f1d4d365640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4819c7f0 con 0x7f1d48100810 2024-09-13T17:11:36.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.624+0000 7f1d4d365640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4819c9b0 con 0x7f1d480ffe50 2024-09-13T17:11:36.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.625+0000 7f1d46ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d480fec60 0x7f1d48194b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:36.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.625+0000 7f1d46ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d480fec60 0x7f1d48194b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46570/0 (socket says 172.21.15.87:46570) 2024-09-13T17:11:36.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.625+0000 7f1d46ffd640 1 -- 172.21.15.87:0/2210536310 learned_addr learned my addr 172.21.15.87:0/2210536310 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:36.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.625+0000 7f1d467fc640 1 --2- 172.21.15.87:0/2210536310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d480ffe50 0x7f1d481950d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:36.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.625+0000 7f1d477fe640 1 --2- 172.21.15.87:0/2210536310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d48100810 0x7f1d4819c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:36.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.625+0000 7f1d46ffd640 1 -- 172.21.15.87:0/2210536310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d480ffe50 msgr2=0x7f1d481950d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:36.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.625+0000 7f1d46ffd640 1 --2- 172.21.15.87:0/2210536310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d480ffe50 0x7f1d481950d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:36.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.625+0000 7f1d46ffd640 1 -- 172.21.15.87:0/2210536310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d48100810 msgr2=0x7f1d4819c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:36.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.625+0000 7f1d46ffd640 1 --2- 172.21.15.87:0/2210536310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d48100810 0x7f1d4819c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:36.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.625+0000 7f1d46ffd640 1 -- 172.21.15.87:0/2210536310 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d38009900 con 0x7f1d480fec60 2024-09-13T17:11:36.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.625+0000 7f1d477fe640 1 --2- 172.21.15.87:0/2210536310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d48100810 0x7f1d4819c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:11:36.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.625+0000 7f1d46ffd640 1 --2- 172.21.15.87:0/2210536310 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d480fec60 0x7f1d48194b90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1d38003ba0 tx=0x7f1d38003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:36.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.625+0000 7f1d2ffff640 1 -- 172.21.15.87:0/2210536310 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3802f310 con 0x7f1d480fec60 2024-09-13T17:11:36.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.625+0000 7f1d4d365640 1 -- 172.21.15.87:0/2210536310 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d4819cc30 con 0x7f1d480fec60 2024-09-13T17:11:36.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.625+0000 7f1d2ffff640 1 -- 172.21.15.87:0/2210536310 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1d38040070 con 0x7f1d480fec60 2024-09-13T17:11:36.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.625+0000 7f1d2ffff640 1 -- 172.21.15.87:0/2210536310 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d38004790 con 0x7f1d480fec60 2024-09-13T17:11:36.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.625+0000 7f1d4d365640 1 -- 172.21.15.87:0/2210536310 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d4819d140 con 0x7f1d480fec60 2024-09-13T17:11:36.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.626+0000 7f1d4d365640 1 -- 172.21.15.87:0/2210536310 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d481060a0 con 0x7f1d480fec60 2024-09-13T17:11:36.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.627+0000 7f1d2ffff640 1 -- 172.21.15.87:0/2210536310 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1d38042030 con 0x7f1d480fec60 2024-09-13T17:11:36.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.628+0000 7f1d2ffff640 1 --2- 172.21.15.87:0/2210536310 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f1d300a1090 0x7f1d300a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:36.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.628+0000 7f1d467fc640 1 --2- 172.21.15.87:0/2210536310 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f1d300a1090 0x7f1d300a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:36.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.628+0000 7f1d2ffff640 1 -- 172.21.15.87:0/2210536310 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f1d380ee360 con 0x7f1d480fec60 2024-09-13T17:11:36.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.628+0000 7f1d467fc640 1 --2- 172.21.15.87:0/2210536310 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f1d300a1090 0x7f1d300a3550 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1d481960a0 tx=0x7f1d3c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:36.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.632+0000 7f1d2ffff640 1 -- 172.21.15.87:0/2210536310 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1d380b7900 con 0x7f1d480fec60 2024-09-13T17:11:36.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.794+0000 7f1d4d365640 1 -- 172.21.15.87:0/2210536310 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1d4802c410 con 0x7f1d480fec60 2024-09-13T17:11:36.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.794+0000 7f1d2ffff640 1 -- 172.21.15.87:0/2210536310 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1d380baf20 con 0x7f1d480fec60 2024-09-13T17:11:36.985 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-09-13T17:11:36.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.796+0000 7f1d4d365640 1 -- 172.21.15.87:0/2210536310 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f1d300a1090 msgr2=0x7f1d300a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:36.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.796+0000 7f1d4d365640 1 --2- 172.21.15.87:0/2210536310 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f1d300a1090 0x7f1d300a3550 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1d481960a0 tx=0x7f1d3c00a2d0 comp rx=0 tx=0).stop 2024-09-13T17:11:36.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.796+0000 7f1d4d365640 1 -- 172.21.15.87:0/2210536310 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d480fec60 msgr2=0x7f1d48194b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:36.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.796+0000 7f1d4d365640 1 --2- 172.21.15.87:0/2210536310 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d480fec60 0x7f1d48194b90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1d38003ba0 tx=0x7f1d38003bd0 comp rx=0 tx=0).stop 2024-09-13T17:11:36.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.796+0000 7f1d4d365640 1 -- 172.21.15.87:0/2210536310 shutdown_connections 2024-09-13T17:11:36.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.796+0000 7f1d4d365640 1 --2- 172.21.15.87:0/2210536310 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f1d300a1090 0x7f1d300a3550 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:36.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.796+0000 7f1d4d365640 1 --2- 172.21.15.87:0/2210536310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d48100810 0x7f1d4819c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:36.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.796+0000 7f1d4d365640 1 --2- 172.21.15.87:0/2210536310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d480ffe50 0x7f1d481950d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:36.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.796+0000 7f1d4d365640 1 --2- 172.21.15.87:0/2210536310 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d480fec60 0x7f1d48194b90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:36.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.796+0000 7f1d4d365640 1 -- 172.21.15.87:0/2210536310 >> 172.21.15.87:0/2210536310 conn(0x7f1d480fa3e0 msgr2=0x7f1d48103270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:36.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.796+0000 7f1d4d365640 1 -- 172.21.15.87:0/2210536310 shutdown_connections 2024-09-13T17:11:36.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:36.796+0000 7f1d4d365640 1 -- 172.21.15.87:0/2210536310 wait complete. 2024-09-13T17:11:36.988 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:11:37.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.088+0000 7f2d6cd9c640 1 -- 172.21.15.87:0/1165370009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d680ffe60 msgr2=0x7f2d681002e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:37.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.088+0000 7f2d6cd9c640 1 --2- 172.21.15.87:0/1165370009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d680ffe60 0x7f2d681002e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2d50009900 tx=0x7f2d5002a410 comp rx=0 tx=0).stop 2024-09-13T17:11:37.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.088+0000 7f2d6cd9c640 1 -- 172.21.15.87:0/1165370009 shutdown_connections 2024-09-13T17:11:37.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.088+0000 7f2d6cd9c640 1 --2- 172.21.15.87:0/1165370009 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d68100820 0x7f2d681070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:37.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.088+0000 7f2d6cd9c640 1 --2- 172.21.15.87:0/1165370009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d680ffe60 0x7f2d681002e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:37.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.088+0000 7f2d6cd9c640 1 --2- 172.21.15.87:0/1165370009 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d680fec70 0x7f2d680ff070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:37.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.088+0000 7f2d6cd9c640 1 -- 172.21.15.87:0/1165370009 >> 172.21.15.87:0/1165370009 conn(0x7f2d680fa3d0 msgr2=0x7f2d680fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:37.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.088+0000 7f2d6cd9c640 1 -- 172.21.15.87:0/1165370009 shutdown_connections 2024-09-13T17:11:37.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.088+0000 7f2d6cd9c640 1 -- 172.21.15.87:0/1165370009 wait complete. 2024-09-13T17:11:37.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.089+0000 7f2d6cd9c640 1 Processor -- start 2024-09-13T17:11:37.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.089+0000 7f2d6cd9c640 1 -- start start 2024-09-13T17:11:37.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.089+0000 7f2d6cd9c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d680fec70 0x7f2d680690e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:37.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.089+0000 7f2d6cd9c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d680ffe60 0x7f2d6819ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:37.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.089+0000 7f2d6cd9c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d68100820 0x7f2d6819f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:37.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.089+0000 7f2d6cd9c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6819fae0 con 0x7f2d680ffe60 2024-09-13T17:11:37.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.089+0000 7f2d6cd9c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6819fc50 con 0x7f2d68100820 2024-09-13T17:11:37.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.089+0000 7f2d6cd9c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6819fe10 con 0x7f2d680fec70 2024-09-13T17:11:37.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.090+0000 7f2d5dd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d680ffe60 0x7f2d6819ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:37.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.090+0000 7f2d5dd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d680ffe60 0x7f2d6819ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46580/0 (socket says 172.21.15.87:46580) 2024-09-13T17:11:37.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.090+0000 7f2d5dd9b640 1 -- 172.21.15.87:0/712858691 learned_addr learned my addr 172.21.15.87:0/712858691 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:37.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.090+0000 7f2d66d9d640 1 --2- 172.21.15.87:0/712858691 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d68100820 0x7f2d6819f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:37.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.090+0000 7f2d6659c640 1 --2- 172.21.15.87:0/712858691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d680fec70 0x7f2d680690e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:37.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.090+0000 7f2d5dd9b640 1 -- 172.21.15.87:0/712858691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d680fec70 msgr2=0x7f2d680690e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:37.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.090+0000 7f2d5dd9b640 1 --2- 172.21.15.87:0/712858691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d680fec70 0x7f2d680690e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:37.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.090+0000 7f2d5dd9b640 1 -- 172.21.15.87:0/712858691 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d68100820 msgr2=0x7f2d6819f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:37.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.090+0000 7f2d5dd9b640 1 --2- 172.21.15.87:0/712858691 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d68100820 0x7f2d6819f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:37.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.090+0000 7f2d5dd9b640 1 -- 172.21.15.87:0/712858691 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d50009560 con 0x7f2d680ffe60 2024-09-13T17:11:37.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.090+0000 7f2d5dd9b640 1 --2- 172.21.15.87:0/712858691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d680ffe60 0x7f2d6819ced0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2d50031460 tx=0x7f2d50004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:37.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.090+0000 7f2d5ffff640 1 -- 172.21.15.87:0/712858691 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d50003800 con 0x7f2d680ffe60 2024-09-13T17:11:37.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.090+0000 7f2d6cd9c640 1 -- 172.21.15.87:0/712858691 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d681a0030 con 0x7f2d680ffe60 2024-09-13T17:11:37.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.090+0000 7f2d5ffff640 1 -- 172.21.15.87:0/712858691 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2d50003e10 con 0x7f2d680ffe60 2024-09-13T17:11:37.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.090+0000 7f2d5ffff640 1 -- 172.21.15.87:0/712858691 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5003b3d0 con 0x7f2d680ffe60 2024-09-13T17:11:37.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.090+0000 7f2d6cd9c640 1 -- 172.21.15.87:0/712858691 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d681a0530 con 0x7f2d680ffe60 2024-09-13T17:11:37.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.091+0000 7f2d6cd9c640 1 -- 172.21.15.87:0/712858691 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d68106150 con 0x7f2d680ffe60 2024-09-13T17:11:37.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.092+0000 7f2d5ffff640 1 -- 172.21.15.87:0/712858691 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2d5003c700 con 0x7f2d680ffe60 2024-09-13T17:11:37.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.093+0000 7f2d5ffff640 1 --2- 172.21.15.87:0/712858691 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2d540a10c0 0x7f2d540a3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:37.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.093+0000 7f2d6659c640 1 --2- 172.21.15.87:0/712858691 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2d540a10c0 0x7f2d540a3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:37.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.093+0000 7f2d5ffff640 1 -- 172.21.15.87:0/712858691 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f2d500edc20 con 0x7f2d680ffe60 2024-09-13T17:11:37.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.093+0000 7f2d6659c640 1 --2- 172.21.15.87:0/712858691 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2d540a10c0 0x7f2d540a3580 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2d680ffcc0 tx=0x7f2d5800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:37.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.096+0000 7f2d5ffff640 1 -- 172.21.15.87:0/712858691 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2d500b7390 con 0x7f2d680ffe60 2024-09-13T17:11:37.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.259+0000 7f2d6cd9c640 1 -- 172.21.15.87:0/712858691 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2d6810a560 con 0x7f2d680ffe60 2024-09-13T17:11:37.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.260+0000 7f2d5ffff640 1 -- 172.21.15.87:0/712858691 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2d500400a0 con 0x7f2d680ffe60 2024-09-13T17:11:37.261 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-09-13T17:11:37.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.262+0000 7f2d6cd9c640 1 -- 172.21.15.87:0/712858691 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2d540a10c0 msgr2=0x7f2d540a3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:37.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.262+0000 7f2d6cd9c640 1 --2- 172.21.15.87:0/712858691 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2d540a10c0 0x7f2d540a3580 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2d680ffcc0 tx=0x7f2d5800b390 comp rx=0 tx=0).stop 2024-09-13T17:11:37.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.262+0000 7f2d6cd9c640 1 -- 172.21.15.87:0/712858691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d680ffe60 msgr2=0x7f2d6819ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:37.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.262+0000 7f2d6cd9c640 1 --2- 172.21.15.87:0/712858691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d680ffe60 0x7f2d6819ced0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2d50031460 tx=0x7f2d50004360 comp rx=0 tx=0).stop 2024-09-13T17:11:37.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.262+0000 7f2d6cd9c640 1 -- 172.21.15.87:0/712858691 shutdown_connections 2024-09-13T17:11:37.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.262+0000 7f2d6cd9c640 1 --2- 172.21.15.87:0/712858691 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2d540a10c0 0x7f2d540a3580 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:37.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.262+0000 7f2d6cd9c640 1 --2- 172.21.15.87:0/712858691 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d68100820 0x7f2d6819f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:37.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.262+0000 7f2d6cd9c640 1 --2- 172.21.15.87:0/712858691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d680ffe60 0x7f2d6819ced0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:37.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.262+0000 7f2d6cd9c640 1 --2- 172.21.15.87:0/712858691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d680fec70 0x7f2d680690e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:37.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.262+0000 7f2d6cd9c640 1 -- 172.21.15.87:0/712858691 >> 172.21.15.87:0/712858691 conn(0x7f2d680fa3d0 msgr2=0x7f2d68103320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:37.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.262+0000 7f2d6cd9c640 1 -- 172.21.15.87:0/712858691 shutdown_connections 2024-09-13T17:11:37.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.262+0000 7f2d6cd9c640 1 -- 172.21.15.87:0/712858691 wait complete. 2024-09-13T17:11:37.274 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:11:37.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.373+0000 7fcf6fc72640 1 -- 172.21.15.87:0/1663235698 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf680ffe70 msgr2=0x7fcf681002f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:37.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.373+0000 7fcf6fc72640 1 --2- 172.21.15.87:0/1663235698 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf680ffe70 0x7fcf681002f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fcf58009900 tx=0x7fcf5802a410 comp rx=0 tx=0).stop 2024-09-13T17:11:37.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.373+0000 7fcf6fc72640 1 -- 172.21.15.87:0/1663235698 shutdown_connections 2024-09-13T17:11:37.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.373+0000 7fcf6fc72640 1 --2- 172.21.15.87:0/1663235698 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf68100830 0x7fcf681070c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:37.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.373+0000 7fcf6fc72640 1 --2- 172.21.15.87:0/1663235698 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf680ffe70 0x7fcf681002f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:37.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.373+0000 7fcf6fc72640 1 --2- 172.21.15.87:0/1663235698 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf680fec80 0x7fcf680ff080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:37.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.373+0000 7fcf6fc72640 1 -- 172.21.15.87:0/1663235698 >> 172.21.15.87:0/1663235698 conn(0x7fcf680fa3e0 msgr2=0x7fcf680fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:37.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.374+0000 7fcf6fc72640 1 -- 172.21.15.87:0/1663235698 shutdown_connections 2024-09-13T17:11:37.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.374+0000 7fcf6fc72640 1 -- 172.21.15.87:0/1663235698 wait complete. 2024-09-13T17:11:37.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.374+0000 7fcf6fc72640 1 Processor -- start 2024-09-13T17:11:37.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.374+0000 7fcf6fc72640 1 -- start start 2024-09-13T17:11:37.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.374+0000 7fcf6fc72640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf680fec80 0x7fcf68194c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:37.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.374+0000 7fcf6fc72640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf680ffe70 0x7fcf681951b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:37.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.374+0000 7fcf6fc72640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf68100830 0x7fcf6819c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:37.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.374+0000 7fcf6fc72640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6819c780 con 0x7fcf680fec80 2024-09-13T17:11:37.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.374+0000 7fcf6fc72640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6819c8f0 con 0x7fcf680ffe70 2024-09-13T17:11:37.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.374+0000 7fcf6fc72640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6819cab0 con 0x7fcf68100830 2024-09-13T17:11:37.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.374+0000 7fcf6da0e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf680fec80 0x7fcf68194c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:37.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.374+0000 7fcf6da0e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf680fec80 0x7fcf68194c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46588/0 (socket says 172.21.15.87:46588) 2024-09-13T17:11:37.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.374+0000 7fcf6da0e640 1 -- 172.21.15.87:0/299554971 learned_addr learned my addr 172.21.15.87:0/299554971 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:37.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.375+0000 7fcf6d20d640 1 --2- 172.21.15.87:0/299554971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf680ffe70 0x7fcf681951b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:37.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.375+0000 7fcf6da0e640 1 -- 172.21.15.87:0/299554971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf68100830 msgr2=0x7fcf6819c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:37.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.375+0000 7fcf6da0e640 1 --2- 172.21.15.87:0/299554971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf68100830 0x7fcf6819c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:37.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.375+0000 7fcf6da0e640 1 -- 172.21.15.87:0/299554971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf680ffe70 msgr2=0x7fcf681951b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:37.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.375+0000 7fcf6da0e640 1 --2- 172.21.15.87:0/299554971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf680ffe70 0x7fcf681951b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:37.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.375+0000 7fcf6da0e640 1 -- 172.21.15.87:0/299554971 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf58009560 con 0x7fcf680fec80 2024-09-13T17:11:37.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.375+0000 7fcf6da0e640 1 --2- 172.21.15.87:0/299554971 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf680fec80 0x7fcf68194c70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcf6400e9c0 tx=0x7fcf6400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:37.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.375+0000 7fcf5effd640 1 -- 172.21.15.87:0/299554971 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf64009700 con 0x7fcf680fec80 2024-09-13T17:11:37.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.375+0000 7fcf5effd640 1 -- 172.21.15.87:0/299554971 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcf640044d0 con 0x7fcf680fec80 2024-09-13T17:11:37.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.375+0000 7fcf6fc72640 1 -- 172.21.15.87:0/299554971 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf6819cd90 con 0x7fcf680fec80 2024-09-13T17:11:37.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.375+0000 7fcf5effd640 1 -- 172.21.15.87:0/299554971 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf64010430 con 0x7fcf680fec80 2024-09-13T17:11:37.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.375+0000 7fcf6fc72640 1 -- 172.21.15.87:0/299554971 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf6819d210 con 0x7fcf680fec80 2024-09-13T17:11:37.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.376+0000 7fcf6fc72640 1 -- 172.21.15.87:0/299554971 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf68106180 con 0x7fcf680fec80 2024-09-13T17:11:37.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.377+0000 7fcf5effd640 1 -- 172.21.15.87:0/299554971 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fcf64003f30 con 0x7fcf680fec80 2024-09-13T17:11:37.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.378+0000 7fcf5effd640 1 --2- 172.21.15.87:0/299554971 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fcf540a1090 0x7fcf540a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:37.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.378+0000 7fcf6d20d640 1 --2- 172.21.15.87:0/299554971 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fcf540a1090 0x7fcf540a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:37.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.378+0000 7fcf5effd640 1 -- 172.21.15.87:0/299554971 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fcf64014070 con 0x7fcf680fec80 2024-09-13T17:11:37.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.378+0000 7fcf6d20d640 1 --2- 172.21.15.87:0/299554971 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fcf540a1090 0x7fcf540a3550 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcf58000c00 tx=0x7fcf58031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:37.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.382+0000 7fcf5effd640 1 -- 172.21.15.87:0/299554971 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcf64096500 con 0x7fcf680fec80 2024-09-13T17:11:37.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:37 smithi087 ceph-mon[30934]: pgmap v283: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 1 op/s 2024-09-13T17:11:37.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:37 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3186041912' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:11:37.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:37 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2755719125' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:11:37.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:37 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2210536310' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:11:37.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.543+0000 7fcf6fc72640 1 -- 172.21.15.87:0/299554971 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fcf6802c4b0 con 0x7fcf680fec80 2024-09-13T17:11:37.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.544+0000 7fcf5effd640 1 -- 172.21.15.87:0/299554971 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v89) v1 ==== 103+0+11 (secure 0 0 0) 0x7fcf64099b20 con 0x7fcf680fec80 2024-09-13T17:11:37.545 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-09-13T17:11:37.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.546+0000 7fcf6fc72640 1 -- 172.21.15.87:0/299554971 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fcf540a1090 msgr2=0x7fcf540a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:37.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.546+0000 7fcf6fc72640 1 --2- 172.21.15.87:0/299554971 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fcf540a1090 0x7fcf540a3550 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcf58000c00 tx=0x7fcf58031400 comp rx=0 tx=0).stop 2024-09-13T17:11:37.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.546+0000 7fcf6fc72640 1 -- 172.21.15.87:0/299554971 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf680fec80 msgr2=0x7fcf68194c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:37.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.546+0000 7fcf6fc72640 1 --2- 172.21.15.87:0/299554971 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf680fec80 0x7fcf68194c70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcf6400e9c0 tx=0x7fcf6400ee80 comp rx=0 tx=0).stop 2024-09-13T17:11:37.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.546+0000 7fcf6fc72640 1 -- 172.21.15.87:0/299554971 shutdown_connections 2024-09-13T17:11:37.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.546+0000 7fcf6fc72640 1 --2- 172.21.15.87:0/299554971 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fcf540a1090 0x7fcf540a3550 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:37.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.546+0000 7fcf6fc72640 1 --2- 172.21.15.87:0/299554971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf68100830 0x7fcf6819c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.546+0000 7fcf6fc72640 1 --2- 172.21.15.87:0/299554971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf680ffe70 0x7fcf681951b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.546+0000 7fcf6fc72640 1 --2- 172.21.15.87:0/299554971 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf680fec80 0x7fcf68194c70 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.546+0000 7fcf6fc72640 1 -- 172.21.15.87:0/299554971 >> 172.21.15.87:0/299554971 conn(0x7fcf680fa3e0 msgr2=0x7fcf68103350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.546+0000 7fcf6fc72640 1 -- 172.21.15.87:0/299554971 shutdown_connections 2024-09-13T17:11:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.546+0000 7fcf6fc72640 1 -- 172.21.15.87:0/299554971 wait complete. 2024-09-13T17:11:37.558 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:11:37.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:37 smithi149 ceph-mon[35496]: pgmap v283: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 1 op/s 2024-09-13T17:11:37.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:37 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3186041912' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:11:37.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:37 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2755719125' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:11:37.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:37 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2210536310' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:11:37.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:37 smithi118 ceph-mon[34374]: pgmap v283: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 1 op/s 2024-09-13T17:11:37.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:37 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3186041912' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:11:37.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:37 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2755719125' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:11:37.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:37 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2210536310' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:11:37.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.656+0000 7fd26965a640 1 -- 172.21.15.87:0/1422486894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd264100f80 msgr2=0x7fd264101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:37.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.656+0000 7fd26965a640 1 --2- 172.21.15.87:0/1422486894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd264100f80 0x7fd264101400 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd24c009900 tx=0x7fd24c02a410 comp rx=0 tx=0).stop 2024-09-13T17:11:37.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.656+0000 7fd26965a640 1 -- 172.21.15.87:0/1422486894 shutdown_connections 2024-09-13T17:11:37.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.656+0000 7fd26965a640 1 --2- 172.21.15.87:0/1422486894 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd264101940 0x7fd2641081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:37.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.656+0000 7fd26965a640 1 --2- 172.21.15.87:0/1422486894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd264100f80 0x7fd264101400 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:37.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.656+0000 7fd26965a640 1 --2- 172.21.15.87:0/1422486894 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2640ffd90 0x7fd264100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:37.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.656+0000 7fd26965a640 1 -- 172.21.15.87:0/1422486894 >> 172.21.15.87:0/1422486894 conn(0x7fd2640fb510 msgr2=0x7fd2640fd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:37.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.656+0000 7fd26965a640 1 -- 172.21.15.87:0/1422486894 shutdown_connections 2024-09-13T17:11:37.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.656+0000 7fd26965a640 1 -- 172.21.15.87:0/1422486894 wait complete. 2024-09-13T17:11:37.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.657+0000 7fd26965a640 1 Processor -- start 2024-09-13T17:11:37.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.657+0000 7fd26965a640 1 -- start start 2024-09-13T17:11:37.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.657+0000 7fd26965a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2640ffd90 0x7fd264195cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:37.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.657+0000 7fd26965a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd264100f80 0x7fd264196230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:37.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.657+0000 7fd26965a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd264101940 0x7fd26419d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:37.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.657+0000 7fd26965a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd26419d7d0 con 0x7fd264100f80 2024-09-13T17:11:37.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.657+0000 7fd26965a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd26419d940 con 0x7fd2640ffd90 2024-09-13T17:11:37.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.657+0000 7fd26965a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd26419db00 con 0x7fd264101940 2024-09-13T17:11:37.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.657+0000 7fd25a7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd264100f80 0x7fd264196230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:37.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.657+0000 7fd25a7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd264100f80 0x7fd264196230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46598/0 (socket says 172.21.15.87:46598) 2024-09-13T17:11:37.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.657+0000 7fd25a7fc640 1 -- 172.21.15.87:0/3822281736 learned_addr learned my addr 172.21.15.87:0/3822281736 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:37.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.658+0000 7fd262ffd640 1 --2- 172.21.15.87:0/3822281736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2640ffd90 0x7fd264195cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:37.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.658+0000 7fd2637fe640 1 --2- 172.21.15.87:0/3822281736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd264101940 0x7fd26419d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:37.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.658+0000 7fd25a7fc640 1 -- 172.21.15.87:0/3822281736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd264101940 msgr2=0x7fd26419d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:37.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.658+0000 7fd25a7fc640 1 --2- 172.21.15.87:0/3822281736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd264101940 0x7fd26419d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:37.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.658+0000 7fd25a7fc640 1 -- 172.21.15.87:0/3822281736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2640ffd90 msgr2=0x7fd264195cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:37.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.658+0000 7fd25a7fc640 1 --2- 172.21.15.87:0/3822281736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2640ffd90 0x7fd264195cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:37.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.658+0000 7fd25a7fc640 1 -- 172.21.15.87:0/3822281736 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24c009560 con 0x7fd264100f80 2024-09-13T17:11:37.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.658+0000 7fd25a7fc640 1 --2- 172.21.15.87:0/3822281736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd264100f80 0x7fd264196230 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd24c031460 tx=0x7fd24c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:37.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.658+0000 7fd260ff9640 1 -- 172.21.15.87:0/3822281736 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24c0035f0 con 0x7fd264100f80 2024-09-13T17:11:37.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.658+0000 7fd26965a640 1 -- 172.21.15.87:0/3822281736 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd26419dd80 con 0x7fd264100f80 2024-09-13T17:11:37.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.658+0000 7fd260ff9640 1 -- 172.21.15.87:0/3822281736 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd24c003c00 con 0x7fd264100f80 2024-09-13T17:11:37.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.658+0000 7fd260ff9640 1 -- 172.21.15.87:0/3822281736 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24c03cda0 con 0x7fd264100f80 2024-09-13T17:11:37.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.658+0000 7fd26965a640 1 -- 172.21.15.87:0/3822281736 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd26419e1d0 con 0x7fd264100f80 2024-09-13T17:11:37.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.659+0000 7fd26965a640 1 -- 172.21.15.87:0/3822281736 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2641071a0 con 0x7fd264100f80 2024-09-13T17:11:37.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.660+0000 7fd260ff9640 1 -- 172.21.15.87:0/3822281736 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd24c03c570 con 0x7fd264100f80 2024-09-13T17:11:37.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.661+0000 7fd260ff9640 1 --2- 172.21.15.87:0/3822281736 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd2500a1090 0x7fd2500a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:37.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.661+0000 7fd260ff9640 1 -- 172.21.15.87:0/3822281736 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fd24c0eda90 con 0x7fd264100f80 2024-09-13T17:11:37.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.661+0000 7fd262ffd640 1 --2- 172.21.15.87:0/3822281736 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd2500a1090 0x7fd2500a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:37.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.662+0000 7fd262ffd640 1 --2- 172.21.15.87:0/3822281736 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd2500a1090 0x7fd2500a3550 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd2641971c0 tx=0x7fd254005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:37.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.665+0000 7fd260ff9640 1 -- 172.21.15.87:0/3822281736 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd24c0b6fa0 con 0x7fd264100f80 2024-09-13T17:11:37.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.838+0000 7fd26965a640 1 -- 172.21.15.87:0/3822281736 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd26410b680 con 0x7fd264100f80 2024-09-13T17:11:37.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.839+0000 7fd260ff9640 1 -- 172.21.15.87:0/3822281736 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v89) v1 ==== 81+0+589 (secure 0 0 0) 0x7fd26410b680 con 0x7fd264100f80 2024-09-13T17:11:37.840 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/586423689 2024-09-14T17:04:47.990078+0000 2024-09-13T17:11:37.840 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6801/4144176457 2024-09-14T17:04:47.990078+0000 2024-09-13T17:11:37.840 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6800/4144176457 2024-09-14T17:04:47.990078+0000 2024-09-13T17:11:37.840 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/3270371628 2024-09-14T17:04:47.990078+0000 2024-09-13T17:11:37.841 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/515676743 2024-09-14T17:04:47.990078+0000 2024-09-13T17:11:37.841 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/1475107314 2024-09-14T17:04:24.083789+0000 2024-09-13T17:11:37.841 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/553289143 2024-09-14T17:04:24.083789+0000 2024-09-13T17:11:37.841 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/3403361612 2024-09-14T17:04:24.083789+0000 2024-09-13T17:11:37.841 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6801/1587363880 2024-09-14T17:04:24.083789+0000 2024-09-13T17:11:37.841 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6800/1587363880 2024-09-14T17:04:24.083789+0000 2024-09-13T17:11:37.842 INFO:teuthology.orchestra.run.smithi087.stderr:listed 10 entries 2024-09-13T17:11:37.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.841+0000 7fd26965a640 1 -- 172.21.15.87:0/3822281736 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd2500a1090 msgr2=0x7fd2500a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:37.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.841+0000 7fd26965a640 1 --2- 172.21.15.87:0/3822281736 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd2500a1090 0x7fd2500a3550 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd2641971c0 tx=0x7fd254005f90 comp rx=0 tx=0).stop 2024-09-13T17:11:37.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.841+0000 7fd26965a640 1 -- 172.21.15.87:0/3822281736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd264100f80 msgr2=0x7fd264196230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:37.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.841+0000 7fd26965a640 1 --2- 172.21.15.87:0/3822281736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd264100f80 0x7fd264196230 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd24c031460 tx=0x7fd24c004270 comp rx=0 tx=0).stop 2024-09-13T17:11:37.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.841+0000 7fd26965a640 1 -- 172.21.15.87:0/3822281736 shutdown_connections 2024-09-13T17:11:37.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.841+0000 7fd26965a640 1 --2- 172.21.15.87:0/3822281736 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd2500a1090 0x7fd2500a3550 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:37.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.841+0000 7fd26965a640 1 --2- 172.21.15.87:0/3822281736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd264101940 0x7fd26419d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:37.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.841+0000 7fd26965a640 1 --2- 172.21.15.87:0/3822281736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd264100f80 0x7fd264196230 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:37.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.841+0000 7fd26965a640 1 --2- 172.21.15.87:0/3822281736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2640ffd90 0x7fd264195cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:37.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.841+0000 7fd26965a640 1 -- 172.21.15.87:0/3822281736 >> 172.21.15.87:0/3822281736 conn(0x7fd2640fb510 msgr2=0x7fd264104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:37.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.841+0000 7fd26965a640 1 -- 172.21.15.87:0/3822281736 shutdown_connections 2024-09-13T17:11:37.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:37.841+0000 7fd26965a640 1 -- 172.21.15.87:0/3822281736 wait complete. 2024-09-13T17:11:37.852 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi087.front.sepia.ceph.com... 2024-09-13T17:11:37.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:11:37.853 DEBUG:teuthology.orchestra.run.smithi087:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:11:37.876 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi087.stderr:ceph-fuse[74494]: fuse finished with error 0 and tester_r 0 2024-09-13T17:11:37.878 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:11:38.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:38 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/712858691' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:11:38.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:38 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/299554971' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:11:38.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:38 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3822281736' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T17:11:38.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:38 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/712858691' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:11:38.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:38 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/299554971' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:11:38.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:38 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3822281736' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T17:11:38.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:38 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/712858691' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:11:38.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:38 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/299554971' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:11:38.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:38 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3822281736' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T17:11:39.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:39 smithi087 ceph-mon[30934]: pgmap v284: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s wr, 0 op/s 2024-09-13T17:11:39.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:39 smithi149 ceph-mon[35496]: pgmap v284: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s wr, 0 op/s 2024-09-13T17:11:39.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:39 smithi118 ceph-mon[34374]: pgmap v284: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s wr, 0 op/s 2024-09-13T17:11:41.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:41 smithi087 ceph-mon[30934]: pgmap v285: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-13T17:11:41.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:41 smithi149 ceph-mon[35496]: pgmap v285: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-13T17:11:41.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:41 smithi118 ceph-mon[34374]: pgmap v285: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-13T17:11:43.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:43 smithi087 ceph-mon[30934]: pgmap v286: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-13T17:11:43.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:43 smithi149 ceph-mon[35496]: pgmap v286: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-13T17:11:43.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:43 smithi118 ceph-mon[34374]: pgmap v286: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-13T17:11:43.980 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T17:11:43.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:11:43.981 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-13T17:11:44.014 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:11:44.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.164+0000 7f0c1a508640 1 -- 172.21.15.87:0/2187708965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c140ffe90 msgr2=0x7f0c14100310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:44.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.164+0000 7f0c1a508640 1 --2- 172.21.15.87:0/2187708965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c140ffe90 0x7f0c14100310 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc009900 tx=0x7f0bfc02a410 comp rx=0 tx=0).stop 2024-09-13T17:11:44.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.164+0000 7f0c1a508640 1 -- 172.21.15.87:0/2187708965 shutdown_connections 2024-09-13T17:11:44.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.164+0000 7f0c1a508640 1 --2- 172.21.15.87:0/2187708965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c14100850 0x7f0c141070e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:44.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.164+0000 7f0c1a508640 1 --2- 172.21.15.87:0/2187708965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c140ffe90 0x7f0c14100310 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:44.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.164+0000 7f0c1a508640 1 --2- 172.21.15.87:0/2187708965 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c140feca0 0x7f0c140ff0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:44.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.164+0000 7f0c1a508640 1 -- 172.21.15.87:0/2187708965 >> 172.21.15.87:0/2187708965 conn(0x7f0c140fa440 msgr2=0x7f0c140fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:44.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.164+0000 7f0c1a508640 1 -- 172.21.15.87:0/2187708965 shutdown_connections 2024-09-13T17:11:44.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.164+0000 7f0c1a508640 1 -- 172.21.15.87:0/2187708965 wait complete. 2024-09-13T17:11:44.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.164+0000 7f0c1a508640 1 Processor -- start 2024-09-13T17:11:44.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.164+0000 7f0c1a508640 1 -- start start 2024-09-13T17:11:44.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.164+0000 7f0c1a508640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c140feca0 0x7f0c14194cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:44.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.164+0000 7f0c1a508640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c140ffe90 0x7f0c14195230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:44.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.164+0000 7f0c1a508640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c14100850 0x7f0c1419c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:44.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.165+0000 7f0c1a508640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1419c7d0 con 0x7f0c14100850 2024-09-13T17:11:44.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.165+0000 7f0c1a508640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1419c940 con 0x7f0c140ffe90 2024-09-13T17:11:44.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.165+0000 7f0c1a508640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1419cb00 con 0x7f0c140feca0 2024-09-13T17:11:44.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.165+0000 7f0c18aa5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c14100850 0x7f0c1419c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:44.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.165+0000 7f0c18aa5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c14100850 0x7f0c1419c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44618/0 (socket says 172.21.15.87:44618) 2024-09-13T17:11:44.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.165+0000 7f0c18aa5640 1 -- 172.21.15.87:0/3036149010 learned_addr learned my addr 172.21.15.87:0/3036149010 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:44.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.165+0000 7f0c13fff640 1 --2- 172.21.15.87:0/3036149010 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c140feca0 0x7f0c14194cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:44.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.165+0000 7f0c0bfff640 1 --2- 172.21.15.87:0/3036149010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c140ffe90 0x7f0c14195230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:44.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.165+0000 7f0c18aa5640 1 -- 172.21.15.87:0/3036149010 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c140feca0 msgr2=0x7f0c14194cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:44.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.165+0000 7f0c18aa5640 1 --2- 172.21.15.87:0/3036149010 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c140feca0 0x7f0c14194cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:44.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.165+0000 7f0c18aa5640 1 -- 172.21.15.87:0/3036149010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c140ffe90 msgr2=0x7f0c14195230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:44.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.165+0000 7f0c18aa5640 1 --2- 172.21.15.87:0/3036149010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c140ffe90 0x7f0c14195230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:44.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.165+0000 7f0c18aa5640 1 -- 172.21.15.87:0/3036149010 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bfc009560 con 0x7f0c14100850 2024-09-13T17:11:44.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.165+0000 7f0c18aa5640 1 --2- 172.21.15.87:0/3036149010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c14100850 0x7f0c1419c260 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c007cb0 tx=0x7f0c0c00e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:44.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.165+0000 7f0c11ffb640 1 -- 172.21.15.87:0/3036149010 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c011070 con 0x7f0c14100850 2024-09-13T17:11:44.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.165+0000 7f0c1a508640 1 -- 172.21.15.87:0/3036149010 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c14067600 con 0x7f0c14100850 2024-09-13T17:11:44.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.165+0000 7f0c11ffb640 1 -- 172.21.15.87:0/3036149010 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0c0c00c2e0 con 0x7f0c14100850 2024-09-13T17:11:44.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.165+0000 7f0c11ffb640 1 -- 172.21.15.87:0/3036149010 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c00ad00 con 0x7f0c14100850 2024-09-13T17:11:44.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.165+0000 7f0c1a508640 1 -- 172.21.15.87:0/3036149010 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c14067b10 con 0x7f0c14100850 2024-09-13T17:11:44.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.166+0000 7f0c1a508640 1 -- 172.21.15.87:0/3036149010 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c140ff080 con 0x7f0c14100850 2024-09-13T17:11:44.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.167+0000 7f0c11ffb640 1 -- 172.21.15.87:0/3036149010 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0c0c00eb30 con 0x7f0c14100850 2024-09-13T17:11:44.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.168+0000 7f0c11ffb640 1 --2- 172.21.15.87:0/3036149010 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0c000a1090 0x7f0c000a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:44.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.168+0000 7f0c13fff640 1 --2- 172.21.15.87:0/3036149010 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0c000a1090 0x7f0c000a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:44.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.168+0000 7f0c11ffb640 1 -- 172.21.15.87:0/3036149010 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f0c0c0ce610 con 0x7f0c14100850 2024-09-13T17:11:44.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.168+0000 7f0c13fff640 1 --2- 172.21.15.87:0/3036149010 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0c000a1090 0x7f0c000a3550 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0c141961c0 tx=0x7f0c04009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:44.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.172+0000 7f0c11ffb640 1 -- 172.21.15.87:0/3036149010 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0c0c097b20 con 0x7f0c14100850 2024-09-13T17:11:44.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.338+0000 7f0c1a508640 1 -- 172.21.15.87:0/3036149010 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c14105b70 con 0x7f0c14100850 2024-09-13T17:11:44.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.340+0000 7f0c11ffb640 1 -- 172.21.15.87:0/3036149010 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+23971 (secure 0 0 0) 0x7f0c0c0b9e60 con 0x7f0c14100850 2024-09-13T17:11:44.341 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:11:44.341 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":89,"fsid":"043d5bae-71f2-11ef-bceb-c7b262605968","created":"2024-09-13T17:03:57.852010+0000","modified":"2024-09-13T17:11:27.679526+0000","last_up_change":"2024-09-13T17:10:34.423548+0000","last_in_change":"2024-09-13T17:10:14.228123+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:07:02.286400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:11:21.965141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:11:22.504345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:11:25.565163+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58250283-85c0-416e-abdd-1fc5a7ff0c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6803","nonce":1316956138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6805","nonce":1316956138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6809","nonce":1316956138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6807","nonce":1316956138}]},"public_addr":"172.21.15.87:6803/1316956138","cluster_addr":"172.21.15.87:6805/1316956138","heartbeat_back_addr":"172.21.15.87:6809/1316956138","heartbeat_front_addr":"172.21.15.87:6807/1316956138","state":["exists","up"]},{"osd":1,"uuid":"b9d49969-94b1-4262-b4ff-db0a8e3331af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6801","nonce":3352566727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6803","nonce":3352566727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6807","nonce":3352566727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6805","nonce":3352566727}]},"public_addr":"172.21.15.118:6801/3352566727","cluster_addr":"172.21.15.118:6803/3352566727","heartbeat_back_addr":"172.21.15.118:6807/3352566727","heartbeat_front_addr":"172.21.15.118:6805/3352566727","state":["exists","up"]},{"osd":2,"uuid":"ba64549e-d736-426f-b466-f569af5f16d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6801","nonce":2774581686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6803","nonce":2774581686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6807","nonce":2774581686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6805","nonce":2774581686}]},"public_addr":"172.21.15.149:6801/2774581686","cluster_addr":"172.21.15.149:6803/2774581686","heartbeat_back_addr":"172.21.15.149:6807/2774581686","heartbeat_front_addr":"172.21.15.149:6805/2774581686","state":["exists","up"]},{"osd":3,"uuid":"3d5553e5-371b-49fd-976b-9e72a97a2f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6811","nonce":3306119066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6813","nonce":3306119066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6817","nonce":3306119066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6815","nonce":3306119066}]},"public_addr":"172.21.15.87:6811/3306119066","cluster_addr":"172.21.15.87:6813/3306119066","heartbeat_back_addr":"172.21.15.87:6817/3306119066","heartbeat_front_addr":"172.21.15.87:6815/3306119066","state":["exists","up"]},{"osd":4,"uuid":"2fbe0e27-34ec-42a6-9962-f1d8202b3159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6809","nonce":3342349890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6811","nonce":3342349890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6815","nonce":3342349890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6813","nonce":3342349890}]},"public_addr":"172.21.15.118:6809/3342349890","cluster_addr":"172.21.15.118:6811/3342349890","heartbeat_back_addr":"172.21.15.118:6815/3342349890","heartbeat_front_addr":"172.21.15.118:6813/3342349890","state":["exists","up"]},{"osd":5,"uuid":"53c14519-6170-4b5a-a79d-4835882d7bec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6809","nonce":3468867124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6811","nonce":3468867124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6815","nonce":3468867124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6813","nonce":3468867124}]},"public_addr":"172.21.15.149:6809/3468867124","cluster_addr":"172.21.15.149:6811/3468867124","heartbeat_back_addr":"172.21.15.149:6815/3468867124","heartbeat_front_addr":"172.21.15.149:6813/3468867124","state":["exists","up"]},{"osd":6,"uuid":"d3951b32-db77-4b8b-9de0-f05e03d13f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6819","nonce":326563617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6821","nonce":326563617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6825","nonce":326563617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6823","nonce":326563617}]},"public_addr":"172.21.15.87:6819/326563617","cluster_addr":"172.21.15.87:6821/326563617","heartbeat_back_addr":"172.21.15.87:6825/326563617","heartbeat_front_addr":"172.21.15.87:6823/326563617","state":["exists","up"]},{"osd":7,"uuid":"4d46dab7-a8bf-4e3e-b5c0-43860d336bdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6817","nonce":1690268990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6819","nonce":1690268990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6823","nonce":1690268990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6821","nonce":1690268990}]},"public_addr":"172.21.15.118:6817/1690268990","cluster_addr":"172.21.15.118:6819/1690268990","heartbeat_back_addr":"172.21.15.118:6823/1690268990","heartbeat_front_addr":"172.21.15.118:6821/1690268990","state":["exists","up"]},{"osd":8,"uuid":"5a015a7d-60a3-4412-96af-1b61d2ad51f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6817","nonce":1558675380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6819","nonce":1558675380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6823","nonce":1558675380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6821","nonce":1558675380}]},"public_addr":"172.21.15.149:6817/1558675380","cluster_addr":"172.21.15.149:6819/1558675380","heartbeat_back_addr":"172.21.15.149:6823/1558675380","heartbeat_front_addr":"172.21.15.149:6821/1558675380","state":["exists","up"]},{"osd":9,"uuid":"248c0b6e-4c4e-4c63-a0dd-e4cdf3b997a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6827","nonce":1453934262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6829","nonce":1453934262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6833","nonce":1453934262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6831","nonce":1453934262}]},"public_addr":"172.21.15.87:6827/1453934262","cluster_addr":"172.21.15.87:6829/1453934262","heartbeat_back_addr":"172.21.15.87:6833/1453934262","heartbeat_front_addr":"172.21.15.87:6831/1453934262","state":["exists","up"]},{"osd":10,"uuid":"24238714-e737-4371-b5d5-0cd3395f09bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6825","nonce":1034318850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6827","nonce":1034318850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6831","nonce":1034318850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6829","nonce":1034318850}]},"public_addr":"172.21.15.118:6825/1034318850","cluster_addr":"172.21.15.118:6827/1034318850","heartbeat_back_addr":"172.21.15.118:6831/1034318850","heartbeat_front_addr":"172.21.15.118:6829/1034318850","state":["exists","up"]},{"osd":11,"uuid":"409dd3bf-5154-4dea-8708-7de7f9e2e793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6825","nonce":271000465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6827","nonce":271000465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6831","nonce":271000465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6829","nonce":271000465}]},"public_addr":"172.21.15.149:6825/271000465","cluster_addr":"172.21.15.149:6827/271000465","heartbeat_back_addr":"172.21.15.149:6831/271000465","heartbeat_front_addr":"172.21.15.149:6829/271000465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:16.382664+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:37.914250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:00.425876+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:23.960183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:47.004088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:10.214345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:33.719221+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:57.099599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:20.971881+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:44.827167+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:08.135516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:32.085853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/586423689":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6801/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6800/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/3270371628":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/515676743":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/1475107314":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/553289143":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/3403361612":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6801/1587363880":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6800/1587363880":"2024-09-14T17:04:24.083789+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:11:44.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.342+0000 7f0c1a508640 1 -- 172.21.15.87:0/3036149010 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0c000a1090 msgr2=0x7f0c000a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:44.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.342+0000 7f0c1a508640 1 --2- 172.21.15.87:0/3036149010 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0c000a1090 0x7f0c000a3550 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0c141961c0 tx=0x7f0c04009110 comp rx=0 tx=0).stop 2024-09-13T17:11:44.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.342+0000 7f0c1a508640 1 -- 172.21.15.87:0/3036149010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c14100850 msgr2=0x7f0c1419c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:44.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.342+0000 7f0c1a508640 1 --2- 172.21.15.87:0/3036149010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c14100850 0x7f0c1419c260 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c007cb0 tx=0x7f0c0c00e420 comp rx=0 tx=0).stop 2024-09-13T17:11:44.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.342+0000 7f0c1a508640 1 -- 172.21.15.87:0/3036149010 shutdown_connections 2024-09-13T17:11:44.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.342+0000 7f0c1a508640 1 --2- 172.21.15.87:0/3036149010 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0c000a1090 0x7f0c000a3550 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:44.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.342+0000 7f0c1a508640 1 --2- 172.21.15.87:0/3036149010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c14100850 0x7f0c1419c260 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:44.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.342+0000 7f0c1a508640 1 --2- 172.21.15.87:0/3036149010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c140ffe90 0x7f0c14195230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:44.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.342+0000 7f0c1a508640 1 --2- 172.21.15.87:0/3036149010 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c140feca0 0x7f0c14194cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:44.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.342+0000 7f0c1a508640 1 -- 172.21.15.87:0/3036149010 >> 172.21.15.87:0/3036149010 conn(0x7f0c140fa440 msgr2=0x7f0c141032d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:44.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.342+0000 7f0c1a508640 1 -- 172.21.15.87:0/3036149010 shutdown_connections 2024-09-13T17:11:44.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.342+0000 7f0c1a508640 1 -- 172.21.15.87:0/3036149010 wait complete. 2024-09-13T17:11:44.355 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:11:44.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.452+0000 7fc9c35d4640 1 -- 172.21.15.87:0/712036218 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9bc0feca0 msgr2=0x7fc9bc0ff0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:44.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.452+0000 7fc9c35d4640 1 --2- 172.21.15.87:0/712036218 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9bc0feca0 0x7fc9bc0ff0a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0009900 tx=0x7fc9b002a410 comp rx=0 tx=0).stop 2024-09-13T17:11:44.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.453+0000 7fc9c35d4640 1 -- 172.21.15.87:0/712036218 shutdown_connections 2024-09-13T17:11:44.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.453+0000 7fc9c35d4640 1 --2- 172.21.15.87:0/712036218 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9bc100850 0x7fc9bc1070e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:44.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.453+0000 7fc9c35d4640 1 --2- 172.21.15.87:0/712036218 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9bc0ffe90 0x7fc9bc100310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:44.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.453+0000 7fc9c35d4640 1 --2- 172.21.15.87:0/712036218 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9bc0feca0 0x7fc9bc0ff0a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:44.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.453+0000 7fc9c35d4640 1 -- 172.21.15.87:0/712036218 >> 172.21.15.87:0/712036218 conn(0x7fc9bc0fa440 msgr2=0x7fc9bc0fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:44.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.453+0000 7fc9c35d4640 1 -- 172.21.15.87:0/712036218 shutdown_connections 2024-09-13T17:11:44.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.453+0000 7fc9c35d4640 1 -- 172.21.15.87:0/712036218 wait complete. 2024-09-13T17:11:44.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.453+0000 7fc9c35d4640 1 Processor -- start 2024-09-13T17:11:44.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.453+0000 7fc9c35d4640 1 -- start start 2024-09-13T17:11:44.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.453+0000 7fc9c35d4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9bc0feca0 0x7fc9bc068110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:44.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.453+0000 7fc9c35d4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9bc0ffe90 0x7fc9bc19aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:44.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.453+0000 7fc9c35d4640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9bc100850 0x7fc9bc19d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:44.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.453+0000 7fc9c35d4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc19d8d0 con 0x7fc9bc0feca0 2024-09-13T17:11:44.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.453+0000 7fc9c35d4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc19da40 con 0x7fc9bc0ffe90 2024-09-13T17:11:44.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.453+0000 7fc9c35d4640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc19dc00 con 0x7fc9bc100850 2024-09-13T17:11:44.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.453+0000 7fc9c1370640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9bc0feca0 0x7fc9bc068110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:44.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.453+0000 7fc9c1370640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9bc0feca0 0x7fc9bc068110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44640/0 (socket says 172.21.15.87:44640) 2024-09-13T17:11:44.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.454+0000 7fc9c1370640 1 -- 172.21.15.87:0/2396538115 learned_addr learned my addr 172.21.15.87:0/2396538115 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:44.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.454+0000 7fc9c1b71640 1 --2- 172.21.15.87:0/2396538115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9bc100850 0x7fc9bc19d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:44.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.454+0000 7fc9c0b6f640 1 --2- 172.21.15.87:0/2396538115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9bc0ffe90 0x7fc9bc19aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:44.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.454+0000 7fc9c1370640 1 -- 172.21.15.87:0/2396538115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9bc100850 msgr2=0x7fc9bc19d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:44.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.454+0000 7fc9c1370640 1 --2- 172.21.15.87:0/2396538115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9bc100850 0x7fc9bc19d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:44.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.454+0000 7fc9c1370640 1 -- 172.21.15.87:0/2396538115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9bc0ffe90 msgr2=0x7fc9bc19aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:44.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.454+0000 7fc9c1370640 1 --2- 172.21.15.87:0/2396538115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9bc0ffe90 0x7fc9bc19aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:44.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.454+0000 7fc9c1370640 1 -- 172.21.15.87:0/2396538115 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b0009560 con 0x7fc9bc0feca0 2024-09-13T17:11:44.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.454+0000 7fc9c1b71640 1 --2- 172.21.15.87:0/2396538115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9bc100850 0x7fc9bc19d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:11:44.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.454+0000 7fc9c1370640 1 --2- 172.21.15.87:0/2396538115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9bc0feca0 0x7fc9bc068110 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0031460 tx=0x7fc9b0004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:44.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.454+0000 7fc9ae7fc640 1 -- 172.21.15.87:0/2396538115 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0003800 con 0x7fc9bc0feca0 2024-09-13T17:11:44.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.454+0000 7fc9ae7fc640 1 -- 172.21.15.87:0/2396538115 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc9b0003e10 con 0x7fc9bc0feca0 2024-09-13T17:11:44.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.454+0000 7fc9c35d4640 1 -- 172.21.15.87:0/2396538115 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9bc19de20 con 0x7fc9bc0feca0 2024-09-13T17:11:44.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.454+0000 7fc9ae7fc640 1 -- 172.21.15.87:0/2396538115 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b003b3d0 con 0x7fc9bc0feca0 2024-09-13T17:11:44.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.454+0000 7fc9c35d4640 1 -- 172.21.15.87:0/2396538115 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9bc19e210 con 0x7fc9bc0feca0 2024-09-13T17:11:44.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.455+0000 7fc9c35d4640 1 -- 172.21.15.87:0/2396538115 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9bc1060e0 con 0x7fc9bc0feca0 2024-09-13T17:11:44.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.456+0000 7fc9ae7fc640 1 -- 172.21.15.87:0/2396538115 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc9b003c470 con 0x7fc9bc0feca0 2024-09-13T17:11:44.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.457+0000 7fc9ae7fc640 1 --2- 172.21.15.87:0/2396538115 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc9a80a1090 0x7fc9a80a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:44.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.457+0000 7fc9ae7fc640 1 -- 172.21.15.87:0/2396538115 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fc9b00ed9d0 con 0x7fc9bc0feca0 2024-09-13T17:11:44.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.457+0000 7fc9c0b6f640 1 --2- 172.21.15.87:0/2396538115 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc9a80a1090 0x7fc9a80a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:44.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.457+0000 7fc9c0b6f640 1 --2- 172.21.15.87:0/2396538115 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc9a80a1090 0x7fc9a80a3550 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc067e80 tx=0x7fc9b8005cc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:44.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.461+0000 7fc9ae7fc640 1 -- 172.21.15.87:0/2396538115 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc9b00b6f70 con 0x7fc9bc0feca0 2024-09-13T17:11:44.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.624+0000 7fc9c35d4640 1 -- 172.21.15.87:0/2396538115 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9bc10a840 con 0x7fc9bc0feca0 2024-09-13T17:11:44.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.625+0000 7fc9ae7fc640 1 -- 172.21.15.87:0/2396538115 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+23971 (secure 0 0 0) 0x7fc9b004a090 con 0x7fc9bc0feca0 2024-09-13T17:11:44.626 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:11:44.626 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":89,"fsid":"043d5bae-71f2-11ef-bceb-c7b262605968","created":"2024-09-13T17:03:57.852010+0000","modified":"2024-09-13T17:11:27.679526+0000","last_up_change":"2024-09-13T17:10:34.423548+0000","last_in_change":"2024-09-13T17:10:14.228123+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:07:02.286400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:11:21.965141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:11:22.504345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:11:25.565163+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58250283-85c0-416e-abdd-1fc5a7ff0c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6803","nonce":1316956138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6805","nonce":1316956138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6809","nonce":1316956138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6807","nonce":1316956138}]},"public_addr":"172.21.15.87:6803/1316956138","cluster_addr":"172.21.15.87:6805/1316956138","heartbeat_back_addr":"172.21.15.87:6809/1316956138","heartbeat_front_addr":"172.21.15.87:6807/1316956138","state":["exists","up"]},{"osd":1,"uuid":"b9d49969-94b1-4262-b4ff-db0a8e3331af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6801","nonce":3352566727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6803","nonce":3352566727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6807","nonce":3352566727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6805","nonce":3352566727}]},"public_addr":"172.21.15.118:6801/3352566727","cluster_addr":"172.21.15.118:6803/3352566727","heartbeat_back_addr":"172.21.15.118:6807/3352566727","heartbeat_front_addr":"172.21.15.118:6805/3352566727","state":["exists","up"]},{"osd":2,"uuid":"ba64549e-d736-426f-b466-f569af5f16d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6801","nonce":2774581686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6803","nonce":2774581686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6807","nonce":2774581686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6805","nonce":2774581686}]},"public_addr":"172.21.15.149:6801/2774581686","cluster_addr":"172.21.15.149:6803/2774581686","heartbeat_back_addr":"172.21.15.149:6807/2774581686","heartbeat_front_addr":"172.21.15.149:6805/2774581686","state":["exists","up"]},{"osd":3,"uuid":"3d5553e5-371b-49fd-976b-9e72a97a2f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6811","nonce":3306119066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6813","nonce":3306119066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6817","nonce":3306119066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6815","nonce":3306119066}]},"public_addr":"172.21.15.87:6811/3306119066","cluster_addr":"172.21.15.87:6813/3306119066","heartbeat_back_addr":"172.21.15.87:6817/3306119066","heartbeat_front_addr":"172.21.15.87:6815/3306119066","state":["exists","up"]},{"osd":4,"uuid":"2fbe0e27-34ec-42a6-9962-f1d8202b3159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6809","nonce":3342349890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6811","nonce":3342349890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6815","nonce":3342349890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6813","nonce":3342349890}]},"public_addr":"172.21.15.118:6809/3342349890","cluster_addr":"172.21.15.118:6811/3342349890","heartbeat_back_addr":"172.21.15.118:6815/3342349890","heartbeat_front_addr":"172.21.15.118:6813/3342349890","state":["exists","up"]},{"osd":5,"uuid":"53c14519-6170-4b5a-a79d-4835882d7bec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6809","nonce":3468867124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6811","nonce":3468867124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6815","nonce":3468867124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6813","nonce":3468867124}]},"public_addr":"172.21.15.149:6809/3468867124","cluster_addr":"172.21.15.149:6811/3468867124","heartbeat_back_addr":"172.21.15.149:6815/3468867124","heartbeat_front_addr":"172.21.15.149:6813/3468867124","state":["exists","up"]},{"osd":6,"uuid":"d3951b32-db77-4b8b-9de0-f05e03d13f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6819","nonce":326563617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6821","nonce":326563617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6825","nonce":326563617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6823","nonce":326563617}]},"public_addr":"172.21.15.87:6819/326563617","cluster_addr":"172.21.15.87:6821/326563617","heartbeat_back_addr":"172.21.15.87:6825/326563617","heartbeat_front_addr":"172.21.15.87:6823/326563617","state":["exists","up"]},{"osd":7,"uuid":"4d46dab7-a8bf-4e3e-b5c0-43860d336bdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6817","nonce":1690268990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6819","nonce":1690268990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6823","nonce":1690268990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6821","nonce":1690268990}]},"public_addr":"172.21.15.118:6817/1690268990","cluster_addr":"172.21.15.118:6819/1690268990","heartbeat_back_addr":"172.21.15.118:6823/1690268990","heartbeat_front_addr":"172.21.15.118:6821/1690268990","state":["exists","up"]},{"osd":8,"uuid":"5a015a7d-60a3-4412-96af-1b61d2ad51f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6817","nonce":1558675380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6819","nonce":1558675380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6823","nonce":1558675380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6821","nonce":1558675380}]},"public_addr":"172.21.15.149:6817/1558675380","cluster_addr":"172.21.15.149:6819/1558675380","heartbeat_back_addr":"172.21.15.149:6823/1558675380","heartbeat_front_addr":"172.21.15.149:6821/1558675380","state":["exists","up"]},{"osd":9,"uuid":"248c0b6e-4c4e-4c63-a0dd-e4cdf3b997a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6827","nonce":1453934262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6829","nonce":1453934262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6833","nonce":1453934262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6831","nonce":1453934262}]},"public_addr":"172.21.15.87:6827/1453934262","cluster_addr":"172.21.15.87:6829/1453934262","heartbeat_back_addr":"172.21.15.87:6833/1453934262","heartbeat_front_addr":"172.21.15.87:6831/1453934262","state":["exists","up"]},{"osd":10,"uuid":"24238714-e737-4371-b5d5-0cd3395f09bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6825","nonce":1034318850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6827","nonce":1034318850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6831","nonce":1034318850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6829","nonce":1034318850}]},"public_addr":"172.21.15.118:6825/1034318850","cluster_addr":"172.21.15.118:6827/1034318850","heartbeat_back_addr":"172.21.15.118:6831/1034318850","heartbeat_front_addr":"172.21.15.118:6829/1034318850","state":["exists","up"]},{"osd":11,"uuid":"409dd3bf-5154-4dea-8708-7de7f9e2e793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6825","nonce":271000465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6827","nonce":271000465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6831","nonce":271000465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6829","nonce":271000465}]},"public_addr":"172.21.15.149:6825/271000465","cluster_addr":"172.21.15.149:6827/271000465","heartbeat_back_addr":"172.21.15.149:6831/271000465","heartbeat_front_addr":"172.21.15.149:6829/271000465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:16.382664+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:37.914250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:00.425876+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:23.960183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:47.004088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:10.214345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:33.719221+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:57.099599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:20.971881+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:44.827167+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:08.135516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:32.085853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/586423689":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6801/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6800/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/3270371628":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/515676743":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/1475107314":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/553289143":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/3403361612":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6801/1587363880":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6800/1587363880":"2024-09-14T17:04:24.083789+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:11:44.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.627+0000 7fc9c35d4640 1 -- 172.21.15.87:0/2396538115 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc9a80a1090 msgr2=0x7fc9a80a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:44.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.627+0000 7fc9c35d4640 1 --2- 172.21.15.87:0/2396538115 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc9a80a1090 0x7fc9a80a3550 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc067e80 tx=0x7fc9b8005cc0 comp rx=0 tx=0).stop 2024-09-13T17:11:44.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.627+0000 7fc9c35d4640 1 -- 172.21.15.87:0/2396538115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9bc0feca0 msgr2=0x7fc9bc068110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:44.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.627+0000 7fc9c35d4640 1 --2- 172.21.15.87:0/2396538115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9bc0feca0 0x7fc9bc068110 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0031460 tx=0x7fc9b0004430 comp rx=0 tx=0).stop 2024-09-13T17:11:44.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.627+0000 7fc9c35d4640 1 -- 172.21.15.87:0/2396538115 shutdown_connections 2024-09-13T17:11:44.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.627+0000 7fc9c35d4640 1 --2- 172.21.15.87:0/2396538115 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc9a80a1090 0x7fc9a80a3550 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:44.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.627+0000 7fc9c35d4640 1 --2- 172.21.15.87:0/2396538115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9bc100850 0x7fc9bc19d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:44.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.627+0000 7fc9c35d4640 1 --2- 172.21.15.87:0/2396538115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9bc0ffe90 0x7fc9bc19aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:44.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.627+0000 7fc9c35d4640 1 --2- 172.21.15.87:0/2396538115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9bc0feca0 0x7fc9bc068110 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:44.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.627+0000 7fc9c35d4640 1 -- 172.21.15.87:0/2396538115 >> 172.21.15.87:0/2396538115 conn(0x7fc9bc0fa440 msgr2=0x7fc9bc1032b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:44.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.627+0000 7fc9c35d4640 1 -- 172.21.15.87:0/2396538115 shutdown_connections 2024-09-13T17:11:44.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.627+0000 7fc9c35d4640 1 -- 172.21.15.87:0/2396538115 wait complete. 2024-09-13T17:11:44.639 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T17:11:44.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.740+0000 7f7de4a09640 1 -- 172.21.15.87:0/880160051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7de0100f60 msgr2=0x7f7de01013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:44.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.740+0000 7f7de4a09640 1 --2- 172.21.15.87:0/880160051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7de0100f60 0x7f7de01013e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4009900 tx=0x7f7dd402a410 comp rx=0 tx=0).stop 2024-09-13T17:11:44.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.740+0000 7f7de4a09640 1 -- 172.21.15.87:0/880160051 shutdown_connections 2024-09-13T17:11:44.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.740+0000 7f7de4a09640 1 --2- 172.21.15.87:0/880160051 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7de0101920 0x7f7de01081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:44.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.740+0000 7f7de4a09640 1 --2- 172.21.15.87:0/880160051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7de0100f60 0x7f7de01013e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:44.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.740+0000 7f7de4a09640 1 --2- 172.21.15.87:0/880160051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7de00ffd70 0x7f7de0100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:44.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.740+0000 7f7de4a09640 1 -- 172.21.15.87:0/880160051 >> 172.21.15.87:0/880160051 conn(0x7f7de00fb4d0 msgr2=0x7f7de00fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:44.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.740+0000 7f7de4a09640 1 -- 172.21.15.87:0/880160051 shutdown_connections 2024-09-13T17:11:44.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.740+0000 7f7de4a09640 1 -- 172.21.15.87:0/880160051 wait complete. 2024-09-13T17:11:44.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.741+0000 7f7de4a09640 1 Processor -- start 2024-09-13T17:11:44.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.741+0000 7f7de4a09640 1 -- start start 2024-09-13T17:11:44.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.741+0000 7f7de4a09640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7de00ffd70 0x7f7de0074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:44.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.741+0000 7f7de4a09640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7de0100f60 0x7f7de00728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:44.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.741+0000 7f7de4a09640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7de0101920 0x7f7de0072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:44.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.741+0000 7f7de4a09640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de0073540 con 0x7f7de0101920 2024-09-13T17:11:44.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.741+0000 7f7de4a09640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de00736b0 con 0x7f7de00ffd70 2024-09-13T17:11:44.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.741+0000 7f7de4a09640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de019fdf0 con 0x7f7de0100f60 2024-09-13T17:11:44.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.741+0000 7f7dded9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7de0101920 0x7f7de0072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:44.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.741+0000 7f7dded9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7de0101920 0x7f7de0072de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44670/0 (socket says 172.21.15.87:44670) 2024-09-13T17:11:44.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.741+0000 7f7dded9d640 1 -- 172.21.15.87:0/827683029 learned_addr learned my addr 172.21.15.87:0/827683029 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:44.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.741+0000 7f7dde59c640 1 --2- 172.21.15.87:0/827683029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7de00ffd70 0x7f7de0074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:44.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.741+0000 7f7dddd9b640 1 --2- 172.21.15.87:0/827683029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7de0100f60 0x7f7de00728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:44.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.741+0000 7f7dded9d640 1 -- 172.21.15.87:0/827683029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7de0100f60 msgr2=0x7f7de00728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:44.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.741+0000 7f7dded9d640 1 --2- 172.21.15.87:0/827683029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7de0100f60 0x7f7de00728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:44.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.741+0000 7f7dded9d640 1 -- 172.21.15.87:0/827683029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7de00ffd70 msgr2=0x7f7de0074260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:44.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.741+0000 7f7dded9d640 1 --2- 172.21.15.87:0/827683029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7de00ffd70 0x7f7de0074260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:44.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.741+0000 7f7dded9d640 1 -- 172.21.15.87:0/827683029 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd4009560 con 0x7f7de0101920 2024-09-13T17:11:44.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.741+0000 7f7dde59c640 1 --2- 172.21.15.87:0/827683029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7de00ffd70 0x7f7de0074260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:11:44.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.741+0000 7f7dded9d640 1 --2- 172.21.15.87:0/827683029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7de0101920 0x7f7de0072de0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7dd800b9a0 tx=0x7f7dd800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:44.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.741+0000 7f7dcf7fe640 1 -- 172.21.15.87:0/827683029 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd800cba0 con 0x7f7de0101920 2024-09-13T17:11:44.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.741+0000 7f7dcf7fe640 1 -- 172.21.15.87:0/827683029 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7dd800cd00 con 0x7f7de0101920 2024-09-13T17:11:44.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.742+0000 7f7de4a09640 1 -- 172.21.15.87:0/827683029 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de01a00a0 con 0x7f7de0101920 2024-09-13T17:11:44.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.742+0000 7f7dcf7fe640 1 -- 172.21.15.87:0/827683029 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd8007660 con 0x7f7de0101920 2024-09-13T17:11:44.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.742+0000 7f7de4a09640 1 -- 172.21.15.87:0/827683029 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de01a0580 con 0x7f7de0101920 2024-09-13T17:11:44.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.742+0000 7f7de4a09640 1 -- 172.21.15.87:0/827683029 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de0107220 con 0x7f7de0101920 2024-09-13T17:11:44.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.744+0000 7f7dcf7fe640 1 -- 172.21.15.87:0/827683029 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f7dd8014440 con 0x7f7de0101920 2024-09-13T17:11:44.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.744+0000 7f7dcf7fe640 1 --2- 172.21.15.87:0/827683029 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f7dc80a1090 0x7f7dc80a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:44.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.744+0000 7f7dde59c640 1 --2- 172.21.15.87:0/827683029 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f7dc80a1090 0x7f7dc80a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:44.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.744+0000 7f7dcf7fe640 1 -- 172.21.15.87:0/827683029 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f7dd80cc890 con 0x7f7de0101920 2024-09-13T17:11:44.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.745+0000 7f7dde59c640 1 --2- 172.21.15.87:0/827683029 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f7dc80a1090 0x7f7dc80a3550 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7de0100dc0 tx=0x7f7dd000a560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:44.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.747+0000 7f7dcf7fe640 1 -- 172.21.15.87:0/827683029 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7dd8095e30 con 0x7f7de0101920 2024-09-13T17:11:44.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:44.942+0000 7f7de4a09640 1 -- 172.21.15.87:0/827683029 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7de010b910 con 0x7f7de0101920 2024-09-13T17:11:45.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.155+0000 7f7dcf7fe640 1 -- 172.21.15.87:0/827683029 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7dd8099450 con 0x7f7de0101920 2024-09-13T17:11:45.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.157+0000 7f7de4a09640 1 -- 172.21.15.87:0/827683029 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f7dc80a1090 msgr2=0x7f7dc80a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:45.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.157+0000 7f7de4a09640 1 --2- 172.21.15.87:0/827683029 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f7dc80a1090 0x7f7dc80a3550 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7de0100dc0 tx=0x7f7dd000a560 comp rx=0 tx=0).stop 2024-09-13T17:11:45.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.157+0000 7f7de4a09640 1 -- 172.21.15.87:0/827683029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7de0101920 msgr2=0x7f7de0072de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:45.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.157+0000 7f7de4a09640 1 --2- 172.21.15.87:0/827683029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7de0101920 0x7f7de0072de0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7dd800b9a0 tx=0x7f7dd800be60 comp rx=0 tx=0).stop 2024-09-13T17:11:45.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.157+0000 7f7de4a09640 1 -- 172.21.15.87:0/827683029 shutdown_connections 2024-09-13T17:11:45.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.157+0000 7f7de4a09640 1 --2- 172.21.15.87:0/827683029 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f7dc80a1090 0x7f7dc80a3550 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:45.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.157+0000 7f7de4a09640 1 --2- 172.21.15.87:0/827683029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7de0101920 0x7f7de0072de0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:45.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.157+0000 7f7de4a09640 1 --2- 172.21.15.87:0/827683029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7de0100f60 0x7f7de00728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:45.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.157+0000 7f7de4a09640 1 --2- 172.21.15.87:0/827683029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7de00ffd70 0x7f7de0074260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:45.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.157+0000 7f7de4a09640 1 -- 172.21.15.87:0/827683029 >> 172.21.15.87:0/827683029 conn(0x7f7de00fb4d0 msgr2=0x7f7de01043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:45.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.157+0000 7f7de4a09640 1 -- 172.21.15.87:0/827683029 shutdown_connections 2024-09-13T17:11:45.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.157+0000 7f7de4a09640 1 -- 172.21.15.87:0/827683029 wait complete. 2024-09-13T17:11:45.169 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-09-13T17:11:45.169 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-09-13T17:11:45.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.271+0000 7f63ca08e640 1 -- 172.21.15.87:0/868793372 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63c40fec60 msgr2=0x7f63c40ff060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:45.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.271+0000 7f63ca08e640 1 --2- 172.21.15.87:0/868793372 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63c40fec60 0x7f63c40ff060 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f63ac009900 tx=0x7f63ac02a410 comp rx=0 tx=0).stop 2024-09-13T17:11:45.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.271+0000 7f63ca08e640 1 -- 172.21.15.87:0/868793372 shutdown_connections 2024-09-13T17:11:45.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.271+0000 7f63ca08e640 1 --2- 172.21.15.87:0/868793372 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63c4100810 0x7f63c41070a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:45.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.271+0000 7f63ca08e640 1 --2- 172.21.15.87:0/868793372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63c40ffe50 0x7f63c41002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:45.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.271+0000 7f63ca08e640 1 --2- 172.21.15.87:0/868793372 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63c40fec60 0x7f63c40ff060 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:45.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.271+0000 7f63ca08e640 1 -- 172.21.15.87:0/868793372 >> 172.21.15.87:0/868793372 conn(0x7f63c40fa3e0 msgr2=0x7f63c40fc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:45.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.271+0000 7f63ca08e640 1 -- 172.21.15.87:0/868793372 shutdown_connections 2024-09-13T17:11:45.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.271+0000 7f63ca08e640 1 -- 172.21.15.87:0/868793372 wait complete. 2024-09-13T17:11:45.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.271+0000 7f63ca08e640 1 Processor -- start 2024-09-13T17:11:45.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.271+0000 7f63ca08e640 1 -- start start 2024-09-13T17:11:45.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.272+0000 7f63ca08e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63c40fec60 0x7f63c4195d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:45.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.272+0000 7f63ca08e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63c40ffe50 0x7f63c4196270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:45.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.272+0000 7f63ca08e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63c4100810 0x7f63c419d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:45.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.272+0000 7f63ca08e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c419d810 con 0x7f63c40fec60 2024-09-13T17:11:45.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.272+0000 7f63ca08e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c419d980 con 0x7f63c4100810 2024-09-13T17:11:45.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.272+0000 7f63ca08e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c419db40 con 0x7f63c40ffe50 2024-09-13T17:11:45.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.272+0000 7f63c37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63c40fec60 0x7f63c4195d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:45.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.272+0000 7f63c37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63c40fec60 0x7f63c4195d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44684/0 (socket says 172.21.15.87:44684) 2024-09-13T17:11:45.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.272+0000 7f63c37fe640 1 -- 172.21.15.87:0/2132328325 learned_addr learned my addr 172.21.15.87:0/2132328325 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:45.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.272+0000 7f63c2ffd640 1 --2- 172.21.15.87:0/2132328325 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63c40ffe50 0x7f63c4196270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:45.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.272+0000 7f63c3fff640 1 --2- 172.21.15.87:0/2132328325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63c4100810 0x7f63c419d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:45.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.272+0000 7f63c37fe640 1 -- 172.21.15.87:0/2132328325 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63c40ffe50 msgr2=0x7f63c4196270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:45.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.272+0000 7f63c37fe640 1 --2- 172.21.15.87:0/2132328325 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63c40ffe50 0x7f63c4196270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:45.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.272+0000 7f63c37fe640 1 -- 172.21.15.87:0/2132328325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63c4100810 msgr2=0x7f63c419d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:45.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.272+0000 7f63c37fe640 1 --2- 172.21.15.87:0/2132328325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63c4100810 0x7f63c419d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:45.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.272+0000 7f63c37fe640 1 -- 172.21.15.87:0/2132328325 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ac009560 con 0x7f63c40fec60 2024-09-13T17:11:45.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.272+0000 7f63c37fe640 1 --2- 172.21.15.87:0/2132328325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63c40fec60 0x7f63c4195d30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f63ac031460 tx=0x7f63ac0042d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:45.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.272+0000 7f63c0ff9640 1 -- 172.21.15.87:0/2132328325 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac0044c0 con 0x7f63c40fec60 2024-09-13T17:11:45.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.272+0000 7f63ca08e640 1 -- 172.21.15.87:0/2132328325 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c419ddc0 con 0x7f63c40fec60 2024-09-13T17:11:45.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.272+0000 7f63c0ff9640 1 -- 172.21.15.87:0/2132328325 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f63ac003cb0 con 0x7f63c40fec60 2024-09-13T17:11:45.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.272+0000 7f63c0ff9640 1 -- 172.21.15.87:0/2132328325 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac03ce60 con 0x7f63c40fec60 2024-09-13T17:11:45.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.272+0000 7f63ca08e640 1 -- 172.21.15.87:0/2132328325 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c419e200 con 0x7f63c40fec60 2024-09-13T17:11:45.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.273+0000 7f63ca08e640 1 -- 172.21.15.87:0/2132328325 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c4106230 con 0x7f63c40fec60 2024-09-13T17:11:45.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.274+0000 7f63c0ff9640 1 -- 172.21.15.87:0/2132328325 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f63ac03c600 con 0x7f63c40fec60 2024-09-13T17:11:45.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.275+0000 7f63c0ff9640 1 --2- 172.21.15.87:0/2132328325 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f63b00a1090 0x7f63b00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:45.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.275+0000 7f63c2ffd640 1 --2- 172.21.15.87:0/2132328325 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f63b00a1090 0x7f63b00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:45.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.276+0000 7f63c0ff9640 1 -- 172.21.15.87:0/2132328325 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f63ac0ed980 con 0x7f63c40fec60 2024-09-13T17:11:45.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.276+0000 7f63c2ffd640 1 --2- 172.21.15.87:0/2132328325 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f63b00a1090 0x7f63b00a3550 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f63b4005d00 tx=0x7f63b4005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:45.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.279+0000 7f63c0ff9640 1 -- 172.21.15.87:0/2132328325 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f63ac0b6e90 con 0x7f63c40fec60 2024-09-13T17:11:45.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:45.474+0000 7f63ca08e640 1 -- 172.21.15.87:0/2132328325 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f63c402c480 con 0x7f63c40fec60 2024-09-13T17:11:45.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:45 smithi087 ceph-mon[30934]: pgmap v287: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-13T17:11:45.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:45 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3036149010' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:11:45.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:45 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2396538115' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:11:45.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:45 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/827683029' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-13T17:11:45.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:45 smithi149 ceph-mon[35496]: pgmap v287: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-13T17:11:45.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:45 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3036149010' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:11:45.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:45 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2396538115' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:11:45.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:45 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/827683029' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-13T17:11:45.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:45 smithi118 ceph-mon[34374]: pgmap v287: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-13T17:11:45.616 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:45 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3036149010' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:11:45.617 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:45 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2396538115' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:11:45.617 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:45 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/827683029' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-13T17:11:46.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.161+0000 7f63c0ff9640 1 -- 172.21.15.87:0/2132328325 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v19) v1 ==== 105+0+0 (secure 0 0 0) 0x7f63ac04a0b0 con 0x7f63c40fec60 2024-09-13T17:11:46.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.163+0000 7f63ca08e640 1 -- 172.21.15.87:0/2132328325 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f63b00a1090 msgr2=0x7f63b00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:46.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.163+0000 7f63ca08e640 1 --2- 172.21.15.87:0/2132328325 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f63b00a1090 0x7f63b00a3550 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f63b4005d00 tx=0x7f63b4005c50 comp rx=0 tx=0).stop 2024-09-13T17:11:46.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.163+0000 7f63ca08e640 1 -- 172.21.15.87:0/2132328325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63c40fec60 msgr2=0x7f63c4195d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:46.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.163+0000 7f63ca08e640 1 --2- 172.21.15.87:0/2132328325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63c40fec60 0x7f63c4195d30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f63ac031460 tx=0x7f63ac0042d0 comp rx=0 tx=0).stop 2024-09-13T17:11:46.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.163+0000 7f63ca08e640 1 -- 172.21.15.87:0/2132328325 shutdown_connections 2024-09-13T17:11:46.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.163+0000 7f63ca08e640 1 --2- 172.21.15.87:0/2132328325 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f63b00a1090 0x7f63b00a3550 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:46.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.163+0000 7f63ca08e640 1 --2- 172.21.15.87:0/2132328325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63c4100810 0x7f63c419d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:46.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.163+0000 7f63ca08e640 1 --2- 172.21.15.87:0/2132328325 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63c40ffe50 0x7f63c4196270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:46.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.163+0000 7f63ca08e640 1 --2- 172.21.15.87:0/2132328325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63c40fec60 0x7f63c4195d30 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:46.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.163+0000 7f63ca08e640 1 -- 172.21.15.87:0/2132328325 >> 172.21.15.87:0/2132328325 conn(0x7f63c40fa3e0 msgr2=0x7f63c4103400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:46.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.163+0000 7f63ca08e640 1 -- 172.21.15.87:0/2132328325 shutdown_connections 2024-09-13T17:11:46.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.163+0000 7f63ca08e640 1 -- 172.21.15.87:0/2132328325 wait complete. 2024-09-13T17:11:46.180 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-09-13T17:11:46.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.282+0000 7f1d8f219640 1 -- 172.21.15.87:0/2581975757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d88105a50 msgr2=0x7f1d88107ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:46.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.282+0000 7f1d8f219640 1 --2- 172.21.15.87:0/2581975757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d88105a50 0x7f1d88107ec0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1d80009ca0 tx=0x7f1d8002a8c0 comp rx=0 tx=0).stop 2024-09-13T17:11:46.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.282+0000 7f1d8f219640 1 -- 172.21.15.87:0/2581975757 shutdown_connections 2024-09-13T17:11:46.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.282+0000 7f1d8f219640 1 --2- 172.21.15.87:0/2581975757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d88105a50 0x7f1d88107ec0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:46.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.282+0000 7f1d8f219640 1 --2- 172.21.15.87:0/2581975757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d88103120 0x7f1d88105510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:46.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.282+0000 7f1d8f219640 1 --2- 172.21.15.87:0/2581975757 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d881007f0 0x7f1d88102be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:46.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.282+0000 7f1d8f219640 1 -- 172.21.15.87:0/2581975757 >> 172.21.15.87:0/2581975757 conn(0x7f1d880fa3d0 msgr2=0x7f1d880fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:46.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.282+0000 7f1d8f219640 1 -- 172.21.15.87:0/2581975757 shutdown_connections 2024-09-13T17:11:46.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.282+0000 7f1d8f219640 1 -- 172.21.15.87:0/2581975757 wait complete. 2024-09-13T17:11:46.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.283+0000 7f1d8f219640 1 Processor -- start 2024-09-13T17:11:46.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.283+0000 7f1d8f219640 1 -- start start 2024-09-13T17:11:46.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.283+0000 7f1d8f219640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d881007f0 0x7f1d88195cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:46.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.283+0000 7f1d8f219640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d88103120 0x7f1d88196230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:46.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.283+0000 7f1d8f219640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d88105a50 0x7f1d8819d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:46.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.283+0000 7f1d8f219640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8819d7d0 con 0x7f1d881007f0 2024-09-13T17:11:46.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.283+0000 7f1d8f219640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8819d940 con 0x7f1d88105a50 2024-09-13T17:11:46.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.283+0000 7f1d8f219640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8819db00 con 0x7f1d88103120 2024-09-13T17:11:46.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.283+0000 7f1d8cfb5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d881007f0 0x7f1d88195cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:46.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.283+0000 7f1d8cfb5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d881007f0 0x7f1d88195cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44704/0 (socket says 172.21.15.87:44704) 2024-09-13T17:11:46.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.283+0000 7f1d8cfb5640 1 -- 172.21.15.87:0/502764335 learned_addr learned my addr 172.21.15.87:0/502764335 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:46.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.283+0000 7f1d7ffff640 1 --2- 172.21.15.87:0/502764335 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d88103120 0x7f1d88196230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:46.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.283+0000 7f1d8cfb5640 1 -- 172.21.15.87:0/502764335 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d88103120 msgr2=0x7f1d88196230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:46.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.283+0000 7f1d8cfb5640 1 --2- 172.21.15.87:0/502764335 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d88103120 0x7f1d88196230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:46.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.283+0000 7f1d8d7b6640 1 --2- 172.21.15.87:0/502764335 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d88105a50 0x7f1d8819d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:46.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.283+0000 7f1d8cfb5640 1 -- 172.21.15.87:0/502764335 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d88105a50 msgr2=0x7f1d8819d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:46.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.283+0000 7f1d8cfb5640 1 --2- 172.21.15.87:0/502764335 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d88105a50 0x7f1d8819d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:46.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.283+0000 7f1d8cfb5640 1 -- 172.21.15.87:0/502764335 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d80009900 con 0x7f1d881007f0 2024-09-13T17:11:46.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.283+0000 7f1d8d7b6640 1 --2- 172.21.15.87:0/502764335 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d88105a50 0x7f1d8819d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:11:46.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.284+0000 7f1d8cfb5640 1 --2- 172.21.15.87:0/502764335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d881007f0 0x7f1d88195cf0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1d8400d770 tx=0x7f1d8400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:46.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.284+0000 7f1d7dffb640 1 -- 172.21.15.87:0/502764335 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d84009c30 con 0x7f1d881007f0 2024-09-13T17:11:46.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.284+0000 7f1d7dffb640 1 -- 172.21.15.87:0/502764335 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1d8400de80 con 0x7f1d881007f0 2024-09-13T17:11:46.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.284+0000 7f1d8f219640 1 -- 172.21.15.87:0/502764335 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d8819dde0 con 0x7f1d881007f0 2024-09-13T17:11:46.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.284+0000 7f1d7dffb640 1 -- 172.21.15.87:0/502764335 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d84004e00 con 0x7f1d881007f0 2024-09-13T17:11:46.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.284+0000 7f1d8f219640 1 -- 172.21.15.87:0/502764335 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d8819e150 con 0x7f1d881007f0 2024-09-13T17:11:46.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.285+0000 7f1d8f219640 1 -- 172.21.15.87:0/502764335 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d88103500 con 0x7f1d881007f0 2024-09-13T17:11:46.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.286+0000 7f1d7dffb640 1 -- 172.21.15.87:0/502764335 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1d84004f60 con 0x7f1d881007f0 2024-09-13T17:11:46.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.286+0000 7f1d7dffb640 1 --2- 172.21.15.87:0/502764335 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f1d700a1090 0x7f1d700a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:46.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.287+0000 7f1d7dffb640 1 -- 172.21.15.87:0/502764335 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f1d840cc6a0 con 0x7f1d881007f0 2024-09-13T17:11:46.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.287+0000 7f1d7ffff640 1 --2- 172.21.15.87:0/502764335 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f1d700a1090 0x7f1d700a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:46.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.287+0000 7f1d7ffff640 1 --2- 172.21.15.87:0/502764335 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f1d700a1090 0x7f1d700a3550 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1d78005e10 tx=0x7f1d78005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:46.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.291+0000 7f1d7dffb640 1 -- 172.21.15.87:0/502764335 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1d84095bb0 con 0x7f1d881007f0 2024-09-13T17:11:46.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:46 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/827683029' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-13T17:11:46.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:46 smithi087 ceph-mon[30934]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-13T17:11:46.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:46 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2132328325' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-13T17:11:46.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:46.489+0000 7f1d8f219640 1 -- 172.21.15.87:0/502764335 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f1d8810b650 con 0x7f1d881007f0 2024-09-13T17:11:46.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:46 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/827683029' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-13T17:11:46.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:46 smithi149 ceph-mon[35496]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-13T17:11:46.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:46 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2132328325' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-13T17:11:46.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:46 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/827683029' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-13T17:11:46.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:46 smithi118 ceph-mon[34374]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-13T17:11:46.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:46 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2132328325' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-13T17:11:47.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.167+0000 7f1d7dffb640 1 -- 172.21.15.87:0/502764335 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v21) v1 ==== 121+0+0 (secure 0 0 0) 0x7f1d84097ae0 con 0x7f1d881007f0 2024-09-13T17:11:47.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.170+0000 7f1d8f219640 1 -- 172.21.15.87:0/502764335 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f1d700a1090 msgr2=0x7f1d700a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:47.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.170+0000 7f1d8f219640 1 --2- 172.21.15.87:0/502764335 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f1d700a1090 0x7f1d700a3550 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1d78005e10 tx=0x7f1d78005da0 comp rx=0 tx=0).stop 2024-09-13T17:11:47.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.170+0000 7f1d8f219640 1 -- 172.21.15.87:0/502764335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d881007f0 msgr2=0x7f1d88195cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:47.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.170+0000 7f1d8f219640 1 --2- 172.21.15.87:0/502764335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d881007f0 0x7f1d88195cf0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1d8400d770 tx=0x7f1d8400dc30 comp rx=0 tx=0).stop 2024-09-13T17:11:47.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.170+0000 7f1d8f219640 1 -- 172.21.15.87:0/502764335 shutdown_connections 2024-09-13T17:11:47.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.170+0000 7f1d8f219640 1 --2- 172.21.15.87:0/502764335 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f1d700a1090 0x7f1d700a3550 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:47.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.170+0000 7f1d8f219640 1 --2- 172.21.15.87:0/502764335 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d88105a50 0x7f1d8819d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:47.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.170+0000 7f1d8f219640 1 --2- 172.21.15.87:0/502764335 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d88103120 0x7f1d88196230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:47.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.170+0000 7f1d8f219640 1 --2- 172.21.15.87:0/502764335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d881007f0 0x7f1d88195cf0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:47.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.170+0000 7f1d8f219640 1 -- 172.21.15.87:0/502764335 >> 172.21.15.87:0/502764335 conn(0x7f1d880fa3d0 msgr2=0x7f1d88101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:47.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.170+0000 7f1d8f219640 1 -- 172.21.15.87:0/502764335 shutdown_connections 2024-09-13T17:11:47.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.170+0000 7f1d8f219640 1 -- 172.21.15.87:0/502764335 wait complete. 2024-09-13T17:11:47.200 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-09-13T17:11:47.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.305+0000 7f3883a3a640 1 -- 172.21.15.87:0/3416773675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f387c100820 msgr2=0x7f387c1070b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:47.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.305+0000 7f3883a3a640 1 --2- 172.21.15.87:0/3416773675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f387c100820 0x7f387c1070b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3874009ca0 tx=0x7f387402a8c0 comp rx=0 tx=0).stop 2024-09-13T17:11:47.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.305+0000 7f3883a3a640 1 -- 172.21.15.87:0/3416773675 shutdown_connections 2024-09-13T17:11:47.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.305+0000 7f3883a3a640 1 --2- 172.21.15.87:0/3416773675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f387c100820 0x7f387c1070b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:47.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.305+0000 7f3883a3a640 1 --2- 172.21.15.87:0/3416773675 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f387c0ffe60 0x7f387c1002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:47.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.305+0000 7f3883a3a640 1 --2- 172.21.15.87:0/3416773675 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f387c0fec70 0x7f387c0ff070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:47.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.305+0000 7f3883a3a640 1 -- 172.21.15.87:0/3416773675 >> 172.21.15.87:0/3416773675 conn(0x7f387c0fa3d0 msgr2=0x7f387c0fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:47.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.305+0000 7f3883a3a640 1 -- 172.21.15.87:0/3416773675 shutdown_connections 2024-09-13T17:11:47.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.305+0000 7f3883a3a640 1 -- 172.21.15.87:0/3416773675 wait complete. 2024-09-13T17:11:47.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.306+0000 7f3883a3a640 1 Processor -- start 2024-09-13T17:11:47.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.306+0000 7f3883a3a640 1 -- start start 2024-09-13T17:11:47.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.306+0000 7f3883a3a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f387c0fec70 0x7f387c197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:47.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.306+0000 7f3883a3a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f387c0ffe60 0x7f387c198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:47.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.306+0000 7f3883a3a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f387c100820 0x7f387c19f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:47.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.306+0000 7f3883a3a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387c19f9e0 con 0x7f387c100820 2024-09-13T17:11:47.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.306+0000 7f3883a3a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387c19fb50 con 0x7f387c0fec70 2024-09-13T17:11:47.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.306+0000 7f3883a3a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387c19fd10 con 0x7f387c0ffe60 2024-09-13T17:11:47.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.306+0000 7f3881fd7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f387c100820 0x7f387c19f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:47.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.306+0000 7f3881fd7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f387c100820 0x7f387c19f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44736/0 (socket says 172.21.15.87:44736) 2024-09-13T17:11:47.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.306+0000 7f3881fd7640 1 -- 172.21.15.87:0/21108757 learned_addr learned my addr 172.21.15.87:0/21108757 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:47.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.306+0000 7f38817d6640 1 --2- 172.21.15.87:0/21108757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f387c0fec70 0x7f387c197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:47.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.306+0000 7f3881fd7640 1 -- 172.21.15.87:0/21108757 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f387c0ffe60 msgr2=0x7f387c198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:47.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.306+0000 7f3881fd7640 1 --2- 172.21.15.87:0/21108757 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f387c0ffe60 0x7f387c198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:47.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.306+0000 7f3881fd7640 1 -- 172.21.15.87:0/21108757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f387c0fec70 msgr2=0x7f387c197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:47.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.306+0000 7f3881fd7640 1 --2- 172.21.15.87:0/21108757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f387c0fec70 0x7f387c197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:47.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.306+0000 7f3881fd7640 1 -- 172.21.15.87:0/21108757 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3874009900 con 0x7f387c100820 2024-09-13T17:11:47.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.306+0000 7f3881fd7640 1 --2- 172.21.15.87:0/21108757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f387c100820 0x7f387c19f4a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f387402aeb0 tx=0x7f3874003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:47.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.306+0000 7f38727fc640 1 -- 172.21.15.87:0/21108757 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38740307c0 con 0x7f387c100820 2024-09-13T17:11:47.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.306+0000 7f38727fc640 1 -- 172.21.15.87:0/21108757 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3874040070 con 0x7f387c100820 2024-09-13T17:11:47.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.306+0000 7f3883a3a640 1 -- 172.21.15.87:0/21108757 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f387c19ff90 con 0x7f387c100820 2024-09-13T17:11:47.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.306+0000 7f38727fc640 1 -- 172.21.15.87:0/21108757 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3874004580 con 0x7f387c100820 2024-09-13T17:11:47.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.307+0000 7f3883a3a640 1 -- 172.21.15.87:0/21108757 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f387c1a0470 con 0x7f387c100820 2024-09-13T17:11:47.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.307+0000 7f3883a3a640 1 -- 172.21.15.87:0/21108757 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f387c10a560 con 0x7f387c100820 2024-09-13T17:11:47.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.309+0000 7f38727fc640 1 -- 172.21.15.87:0/21108757 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3874042030 con 0x7f387c100820 2024-09-13T17:11:47.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.309+0000 7f38727fc640 1 --2- 172.21.15.87:0/21108757 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f38680a1090 0x7f38680a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:47.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.309+0000 7f38817d6640 1 --2- 172.21.15.87:0/21108757 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f38680a1090 0x7f38680a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:47.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.309+0000 7f38727fc640 1 -- 172.21.15.87:0/21108757 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f38740ee5c0 con 0x7f387c100820 2024-09-13T17:11:47.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.310+0000 7f38817d6640 1 --2- 172.21.15.87:0/21108757 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f38680a1090 0x7f38680a3550 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3878005d00 tx=0x7f3878005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:47.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.312+0000 7f38727fc640 1 -- 172.21.15.87:0/21108757 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f38740b7b60 con 0x7f387c100820 2024-09-13T17:11:47.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:47 smithi087 ceph-mon[30934]: pgmap v288: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-13T17:11:47.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:47 smithi087 ceph-mon[30934]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T17:11:47.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:47 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2132328325' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-13T17:11:47.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:47 smithi087 ceph-mon[30934]: daemon mds.c assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T17:11:47.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:47 smithi087 ceph-mon[30934]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-13T17:11:47.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:47 smithi087 ceph-mon[30934]: fsmap cephfs:2 {0=i=up:active,1=c=up:creating} 10 up:standby 2024-09-13T17:11:47.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:47 smithi087 ceph-mon[30934]: daemon mds.c is now active in filesystem cephfs as rank 1 2024-09-13T17:11:47.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:47 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/502764335' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T17:11:47.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.512+0000 7f3883a3a640 1 -- 172.21.15.87:0/21108757 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f387c10a740 con 0x7f387c100820 2024-09-13T17:11:47.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:47 smithi149 ceph-mon[35496]: pgmap v288: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-13T17:11:47.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:47 smithi149 ceph-mon[35496]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T17:11:47.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:47 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2132328325' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-13T17:11:47.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:47 smithi149 ceph-mon[35496]: daemon mds.c assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T17:11:47.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:47 smithi149 ceph-mon[35496]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-13T17:11:47.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:47 smithi149 ceph-mon[35496]: fsmap cephfs:2 {0=i=up:active,1=c=up:creating} 10 up:standby 2024-09-13T17:11:47.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:47 smithi149 ceph-mon[35496]: daemon mds.c is now active in filesystem cephfs as rank 1 2024-09-13T17:11:47.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:47 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/502764335' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T17:11:47.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:47 smithi118 ceph-mon[34374]: pgmap v288: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-13T17:11:47.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:47 smithi118 ceph-mon[34374]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T17:11:47.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:47 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2132328325' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-13T17:11:47.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:47 smithi118 ceph-mon[34374]: daemon mds.c assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T17:11:47.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:47 smithi118 ceph-mon[34374]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-13T17:11:47.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:47 smithi118 ceph-mon[34374]: fsmap cephfs:2 {0=i=up:active,1=c=up:creating} 10 up:standby 2024-09-13T17:11:47.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:47 smithi118 ceph-mon[34374]: daemon mds.c is now active in filesystem cephfs as rank 1 2024-09-13T17:11:47.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:47 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/502764335' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T17:11:47.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.783+0000 7f38727fc640 1 -- 172.21.15.87:0/21108757 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v23) v1 ==== 115+0+0 (secure 0 0 0) 0x7f38740bb180 con 0x7f387c100820 2024-09-13T17:11:47.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.786+0000 7f3883a3a640 1 -- 172.21.15.87:0/21108757 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f38680a1090 msgr2=0x7f38680a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:47.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.786+0000 7f3883a3a640 1 --2- 172.21.15.87:0/21108757 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f38680a1090 0x7f38680a3550 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3878005d00 tx=0x7f3878005c50 comp rx=0 tx=0).stop 2024-09-13T17:11:47.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.786+0000 7f3883a3a640 1 -- 172.21.15.87:0/21108757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f387c100820 msgr2=0x7f387c19f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:47.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.786+0000 7f3883a3a640 1 --2- 172.21.15.87:0/21108757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f387c100820 0x7f387c19f4a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f387402aeb0 tx=0x7f3874003c20 comp rx=0 tx=0).stop 2024-09-13T17:11:47.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.786+0000 7f3883a3a640 1 -- 172.21.15.87:0/21108757 shutdown_connections 2024-09-13T17:11:47.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.786+0000 7f3883a3a640 1 --2- 172.21.15.87:0/21108757 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f38680a1090 0x7f38680a3550 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:47.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.786+0000 7f3883a3a640 1 --2- 172.21.15.87:0/21108757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f387c100820 0x7f387c19f4a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:47.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.786+0000 7f3883a3a640 1 --2- 172.21.15.87:0/21108757 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f387c0ffe60 0x7f387c198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:47.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.786+0000 7f3883a3a640 1 --2- 172.21.15.87:0/21108757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f387c0fec70 0x7f387c197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:47.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.786+0000 7f3883a3a640 1 -- 172.21.15.87:0/21108757 >> 172.21.15.87:0/21108757 conn(0x7f387c0fa3d0 msgr2=0x7f387c0685a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:47.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.786+0000 7f3883a3a640 1 -- 172.21.15.87:0/21108757 shutdown_connections 2024-09-13T17:11:47.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.786+0000 7f3883a3a640 1 -- 172.21.15.87:0/21108757 wait complete. 2024-09-13T17:11:47.798 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-09-13T17:11:47.799 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-09-13T17:11:47.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.899+0000 7ff4116fe640 1 -- 172.21.15.87:0/3820196999 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff40c100810 msgr2=0x7ff40c1070a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:47.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.899+0000 7ff4116fe640 1 --2- 172.21.15.87:0/3820196999 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff40c100810 0x7ff40c1070a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff404009ca0 tx=0x7ff40402a8c0 comp rx=0 tx=0).stop 2024-09-13T17:11:47.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.899+0000 7ff4116fe640 1 -- 172.21.15.87:0/3820196999 shutdown_connections 2024-09-13T17:11:47.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.899+0000 7ff4116fe640 1 --2- 172.21.15.87:0/3820196999 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff40c100810 0x7ff40c1070a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:47.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.899+0000 7ff4116fe640 1 --2- 172.21.15.87:0/3820196999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff40c0ffe50 0x7ff40c1002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:47.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.899+0000 7ff4116fe640 1 --2- 172.21.15.87:0/3820196999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff40c0fec60 0x7ff40c0ff060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:47.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.899+0000 7ff4116fe640 1 -- 172.21.15.87:0/3820196999 >> 172.21.15.87:0/3820196999 conn(0x7ff40c0fa3e0 msgr2=0x7ff40c0fc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:47.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.899+0000 7ff4116fe640 1 -- 172.21.15.87:0/3820196999 shutdown_connections 2024-09-13T17:11:47.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.900+0000 7ff4116fe640 1 -- 172.21.15.87:0/3820196999 wait complete. 2024-09-13T17:11:47.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.900+0000 7ff4116fe640 1 Processor -- start 2024-09-13T17:11:47.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.900+0000 7ff4116fe640 1 -- start start 2024-09-13T17:11:47.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.900+0000 7ff4116fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff40c0fec60 0x7ff40c102de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:47.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.900+0000 7ff4116fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff40c0ffe50 0x7ff40c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:47.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.900+0000 7ff4116fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff40c100810 0x7ff40c101960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:47.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.900+0000 7ff4116fe640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c1020c0 con 0x7ff40c0ffe50 2024-09-13T17:11:47.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.900+0000 7ff4116fe640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c102230 con 0x7ff40c100810 2024-09-13T17:11:47.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.900+0000 7ff4116fe640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c19fda0 con 0x7ff40c0fec60 2024-09-13T17:11:47.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.900+0000 7ff40a7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff40c0ffe50 0x7ff40c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:47.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.901+0000 7ff40a7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff40c0ffe50 0x7ff40c101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44758/0 (socket says 172.21.15.87:44758) 2024-09-13T17:11:47.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.901+0000 7ff40a7fc640 1 -- 172.21.15.87:0/2171273608 learned_addr learned my addr 172.21.15.87:0/2171273608 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:47.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.901+0000 7ff40b7fe640 1 --2- 172.21.15.87:0/2171273608 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff40c100810 0x7ff40c101960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:47.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.901+0000 7ff40affd640 1 --2- 172.21.15.87:0/2171273608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff40c0fec60 0x7ff40c102de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:47.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.901+0000 7ff40a7fc640 1 -- 172.21.15.87:0/2171273608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff40c0fec60 msgr2=0x7ff40c102de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:47.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.901+0000 7ff40a7fc640 1 --2- 172.21.15.87:0/2171273608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff40c0fec60 0x7ff40c102de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:47.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.901+0000 7ff40a7fc640 1 -- 172.21.15.87:0/2171273608 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff40c100810 msgr2=0x7ff40c101960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:47.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.901+0000 7ff40a7fc640 1 --2- 172.21.15.87:0/2171273608 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff40c100810 0x7ff40c101960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:47.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.901+0000 7ff40a7fc640 1 -- 172.21.15.87:0/2171273608 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff404009900 con 0x7ff40c0ffe50 2024-09-13T17:11:47.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.901+0000 7ff40a7fc640 1 --2- 172.21.15.87:0/2171273608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff40c0ffe50 0x7ff40c101420 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc00d980 tx=0x7ff3fc00de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:47.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.901+0000 7ff3f3fff640 1 -- 172.21.15.87:0/2171273608 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc009c30 con 0x7ff40c0ffe50 2024-09-13T17:11:47.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.901+0000 7ff3f3fff640 1 -- 172.21.15.87:0/2171273608 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff3fc00b660 con 0x7ff40c0ffe50 2024-09-13T17:11:47.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.901+0000 7ff4116fe640 1 -- 172.21.15.87:0/2171273608 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff40c19fff0 con 0x7ff40c0ffe50 2024-09-13T17:11:47.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.901+0000 7ff3f3fff640 1 -- 172.21.15.87:0/2171273608 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc00f620 con 0x7ff40c0ffe50 2024-09-13T17:11:47.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.901+0000 7ff4116fe640 1 -- 172.21.15.87:0/2171273608 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40c1a0520 con 0x7ff40c0ffe50 2024-09-13T17:11:47.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.902+0000 7ff4116fe640 1 -- 172.21.15.87:0/2171273608 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff40c10a5a0 con 0x7ff40c0ffe50 2024-09-13T17:11:47.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.903+0000 7ff3f3fff640 1 -- 172.21.15.87:0/2171273608 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff3fc010460 con 0x7ff40c0ffe50 2024-09-13T17:11:47.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.904+0000 7ff3f3fff640 1 --2- 172.21.15.87:0/2171273608 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff3f40a1110 0x7ff3f40a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:47.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.904+0000 7ff40affd640 1 --2- 172.21.15.87:0/2171273608 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff3f40a1110 0x7ff3f40a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:47.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.904+0000 7ff3f3fff640 1 -- 172.21.15.87:0/2171273608 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7ff3fc0cc9c0 con 0x7ff40c0ffe50 2024-09-13T17:11:47.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.904+0000 7ff40affd640 1 --2- 172.21.15.87:0/2171273608 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff3f40a1110 0x7ff3f40a35d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff400005fd0 tx=0x7ff400005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:47.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:47.908+0000 7ff3f3fff640 1 -- 172.21.15.87:0/2171273608 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff3fc095f60 con 0x7ff40c0ffe50 2024-09-13T17:11:48.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.100+0000 7ff4116fe640 1 -- 172.21.15.87:0/2171273608 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7ff40c067cb0 con 0x7ff3f40a1110 2024-09-13T17:11:48.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.123+0000 7ff3f3fff640 1 -- 172.21.15.87:0/2171273608 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ff40c067cb0 con 0x7ff3f40a1110 2024-09-13T17:11:48.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.125+0000 7ff4116fe640 1 -- 172.21.15.87:0/2171273608 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff3f40a1110 msgr2=0x7ff3f40a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:48.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.125+0000 7ff4116fe640 1 --2- 172.21.15.87:0/2171273608 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff3f40a1110 0x7ff3f40a35d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff400005fd0 tx=0x7ff400005850 comp rx=0 tx=0).stop 2024-09-13T17:11:48.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.125+0000 7ff4116fe640 1 -- 172.21.15.87:0/2171273608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff40c0ffe50 msgr2=0x7ff40c101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:48.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.125+0000 7ff4116fe640 1 --2- 172.21.15.87:0/2171273608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff40c0ffe50 0x7ff40c101420 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc00d980 tx=0x7ff3fc00de40 comp rx=0 tx=0).stop 2024-09-13T17:11:48.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.125+0000 7ff4116fe640 1 -- 172.21.15.87:0/2171273608 shutdown_connections 2024-09-13T17:11:48.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.125+0000 7ff4116fe640 1 --2- 172.21.15.87:0/2171273608 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff3f40a1110 0x7ff3f40a35d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:48.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.125+0000 7ff4116fe640 1 --2- 172.21.15.87:0/2171273608 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff40c100810 0x7ff40c101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:48.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.125+0000 7ff4116fe640 1 --2- 172.21.15.87:0/2171273608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff40c0ffe50 0x7ff40c101420 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:48.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.125+0000 7ff4116fe640 1 --2- 172.21.15.87:0/2171273608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff40c0fec60 0x7ff40c102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:48.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.125+0000 7ff4116fe640 1 -- 172.21.15.87:0/2171273608 >> 172.21.15.87:0/2171273608 conn(0x7ff40c0fa3e0 msgr2=0x7ff40c0675a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:48.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.125+0000 7ff4116fe640 1 -- 172.21.15.87:0/2171273608 shutdown_connections 2024-09-13T17:11:48.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.125+0000 7ff4116fe640 1 -- 172.21.15.87:0/2171273608 wait complete. 2024-09-13T17:11:48.137 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-13T17:11:48.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.241+0000 7f57e0157640 1 -- 172.21.15.87:0/238846918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57d8100810 msgr2=0x7f57d81070a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:48.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.241+0000 7f57e0157640 1 --2- 172.21.15.87:0/238846918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57d8100810 0x7f57d81070a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f57d0009ca0 tx=0x7f57d002a8c0 comp rx=0 tx=0).stop 2024-09-13T17:11:48.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.241+0000 7f57e0157640 1 -- 172.21.15.87:0/238846918 shutdown_connections 2024-09-13T17:11:48.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.241+0000 7f57e0157640 1 --2- 172.21.15.87:0/238846918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57d8100810 0x7f57d81070a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:48.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.241+0000 7f57e0157640 1 --2- 172.21.15.87:0/238846918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57d80ffe50 0x7f57d81002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:48.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.241+0000 7f57e0157640 1 --2- 172.21.15.87:0/238846918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57d80fec60 0x7f57d80ff060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:48.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.241+0000 7f57e0157640 1 -- 172.21.15.87:0/238846918 >> 172.21.15.87:0/238846918 conn(0x7f57d80fa3e0 msgr2=0x7f57d80fc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:48.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.241+0000 7f57e0157640 1 -- 172.21.15.87:0/238846918 shutdown_connections 2024-09-13T17:11:48.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.241+0000 7f57e0157640 1 -- 172.21.15.87:0/238846918 wait complete. 2024-09-13T17:11:48.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.241+0000 7f57e0157640 1 Processor -- start 2024-09-13T17:11:48.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.241+0000 7f57e0157640 1 -- start start 2024-09-13T17:11:48.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.241+0000 7f57e0157640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57d80fec60 0x7f57d8068110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:48.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.241+0000 7f57e0157640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57d80ffe50 0x7f57d819aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:48.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.241+0000 7f57e0157640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57d8100810 0x7f57d819d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:48.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.241+0000 7f57e0157640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d819d840 con 0x7f57d80fec60 2024-09-13T17:11:48.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.241+0000 7f57e0157640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d819d9b0 con 0x7f57d8100810 2024-09-13T17:11:48.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.241+0000 7f57e0157640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d819db70 con 0x7f57d80ffe50 2024-09-13T17:11:48.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.241+0000 7f57ddef3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57d80fec60 0x7f57d8068110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:48.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.242+0000 7f57ddef3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57d80fec60 0x7f57d8068110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44790/0 (socket says 172.21.15.87:44790) 2024-09-13T17:11:48.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.242+0000 7f57ddef3640 1 -- 172.21.15.87:0/1010750750 learned_addr learned my addr 172.21.15.87:0/1010750750 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:48.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.242+0000 7f57dd6f2640 1 --2- 172.21.15.87:0/1010750750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57d80ffe50 0x7f57d819aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:48.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.242+0000 7f57ddef3640 1 -- 172.21.15.87:0/1010750750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57d80ffe50 msgr2=0x7f57d819aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:48.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.242+0000 7f57ddef3640 1 --2- 172.21.15.87:0/1010750750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57d80ffe50 0x7f57d819aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:48.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.242+0000 7f57ddef3640 1 -- 172.21.15.87:0/1010750750 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57d8100810 msgr2=0x7f57d819d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:48.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.242+0000 7f57de6f4640 1 --2- 172.21.15.87:0/1010750750 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57d8100810 0x7f57d819d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:48.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.242+0000 7f57ddef3640 1 --2- 172.21.15.87:0/1010750750 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57d8100810 0x7f57d819d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:48.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.242+0000 7f57ddef3640 1 -- 172.21.15.87:0/1010750750 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d0009900 con 0x7f57d80fec60 2024-09-13T17:11:48.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.242+0000 7f57ddef3640 1 --2- 172.21.15.87:0/1010750750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57d80fec60 0x7f57d8068110 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f57d400d950 tx=0x7f57d400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:48.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.242+0000 7f57ceffd640 1 -- 172.21.15.87:0/1010750750 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d4009c30 con 0x7f57d80fec60 2024-09-13T17:11:48.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.242+0000 7f57ceffd640 1 -- 172.21.15.87:0/1010750750 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f57d4009d90 con 0x7f57d80fec60 2024-09-13T17:11:48.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.242+0000 7f57ceffd640 1 -- 172.21.15.87:0/1010750750 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d400f7e0 con 0x7f57d80fec60 2024-09-13T17:11:48.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.242+0000 7f57e0157640 1 -- 172.21.15.87:0/1010750750 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d819ddf0 con 0x7f57d80fec60 2024-09-13T17:11:48.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.242+0000 7f57e0157640 1 -- 172.21.15.87:0/1010750750 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d819e270 con 0x7f57d80fec60 2024-09-13T17:11:48.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.243+0000 7f57e0157640 1 -- 172.21.15.87:0/1010750750 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57d8106110 con 0x7f57d80fec60 2024-09-13T17:11:48.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.245+0000 7f57ceffd640 1 -- 172.21.15.87:0/1010750750 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f57d4010460 con 0x7f57d80fec60 2024-09-13T17:11:48.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.246+0000 7f57ceffd640 1 --2- 172.21.15.87:0/1010750750 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f57c40a1110 0x7f57c40a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:48.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.246+0000 7f57dd6f2640 1 --2- 172.21.15.87:0/1010750750 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f57c40a1110 0x7f57c40a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:48.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.246+0000 7f57ceffd640 1 -- 172.21.15.87:0/1010750750 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f57d40cca80 con 0x7f57d80fec60 2024-09-13T17:11:48.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.246+0000 7f57dd6f2640 1 --2- 172.21.15.87:0/1010750750 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f57c40a1110 0x7f57c40a35d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f57d8067e80 tx=0x7f57c800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:48.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.249+0000 7f57ceffd640 1 -- 172.21.15.87:0/1010750750 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f57d40960a0 con 0x7f57d80fec60 2024-09-13T17:11:48.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.438+0000 7f57e0157640 1 -- 172.21.15.87:0/1010750750 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7f57d802c520 con 0x7f57c40a1110 2024-09-13T17:11:48.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.462+0000 7f57ceffd640 1 -- 172.21.15.87:0/1010750750 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f57d802c520 con 0x7f57c40a1110 2024-09-13T17:11:48.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.464+0000 7f57e0157640 1 -- 172.21.15.87:0/1010750750 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f57c40a1110 msgr2=0x7f57c40a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:48.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.464+0000 7f57e0157640 1 --2- 172.21.15.87:0/1010750750 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f57c40a1110 0x7f57c40a35d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f57d8067e80 tx=0x7f57c800b410 comp rx=0 tx=0).stop 2024-09-13T17:11:48.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.464+0000 7f57e0157640 1 -- 172.21.15.87:0/1010750750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57d80fec60 msgr2=0x7f57d8068110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:48.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.464+0000 7f57e0157640 1 --2- 172.21.15.87:0/1010750750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57d80fec60 0x7f57d8068110 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f57d400d950 tx=0x7f57d400de10 comp rx=0 tx=0).stop 2024-09-13T17:11:48.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.464+0000 7f57e0157640 1 -- 172.21.15.87:0/1010750750 shutdown_connections 2024-09-13T17:11:48.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.464+0000 7f57e0157640 1 --2- 172.21.15.87:0/1010750750 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f57c40a1110 0x7f57c40a35d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:48.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.464+0000 7f57e0157640 1 --2- 172.21.15.87:0/1010750750 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57d8100810 0x7f57d819d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:48.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.464+0000 7f57e0157640 1 --2- 172.21.15.87:0/1010750750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57d80ffe50 0x7f57d819aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:48.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.464+0000 7f57e0157640 1 --2- 172.21.15.87:0/1010750750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57d80fec60 0x7f57d8068110 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:48.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.464+0000 7f57e0157640 1 -- 172.21.15.87:0/1010750750 >> 172.21.15.87:0/1010750750 conn(0x7f57d80fa3e0 msgr2=0x7f57d81032e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:48.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.464+0000 7f57e0157640 1 -- 172.21.15.87:0/1010750750 shutdown_connections 2024-09-13T17:11:48.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.464+0000 7f57e0157640 1 -- 172.21.15.87:0/1010750750 wait complete. 2024-09-13T17:11:48.474 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:11:48 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:11:48.105+0000 7eff4ba85640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:11:48.474 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:11:48 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:11:48.105+0000 7eff4ba85640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:11:48.474 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:11:48 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:11:48.105+0000 7eff4ba85640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:11:48.475 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:11:48 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:11:48.105+0000 7eff4ba85640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:11:48.475 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:11:48 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:11:48.105+0000 7eff4ba85640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:11:48.475 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:48 smithi087 ceph-mon[30934]: mds.? [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] up:active 2024-09-13T17:11:48.475 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:48 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/502764335' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-13T17:11:48.475 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:48 smithi087 ceph-mon[30934]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-13T17:11:48.475 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:48 smithi087 ceph-mon[30934]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T17:11:48.475 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:48 smithi087 ceph-mon[30934]: Cluster is now healthy 2024-09-13T17:11:48.476 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:48 smithi087 ceph-mon[30934]: fsmap cephfs:2 {0=i=up:active,1=c=up:active} 10 up:standby 2024-09-13T17:11:48.476 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:48 smithi087 ceph-mon[30934]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:creating} 9 up:standby 2024-09-13T17:11:48.476 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:48 smithi087 ceph-mon[30934]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-09-13T17:11:48.476 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:48 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/21108757' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-13T17:11:48.476 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:48 smithi087 ceph-mon[30934]: mds.? [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] up:active 2024-09-13T17:11:48.476 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:48 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/21108757' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-13T17:11:48.476 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:48 smithi087 ceph-mon[30934]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:11:48.476 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:48 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-13T17:11:48.476 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:48 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.d", "id": [1, 9]}]: dispatch 2024-09-13T17:11:48.476 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:48 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]: dispatch 2024-09-13T17:11:48.476 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:48 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-09-13T17:11:48.476 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:48 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8, 5, 7]}]: dispatch 2024-09-13T17:11:48.477 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:48 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 6, 5, 8]}]: dispatch 2024-09-13T17:11:48.477 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:48 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-09-13T17:11:48.477 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:48 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]: dispatch 2024-09-13T17:11:48.478 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-13T17:11:48.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.580+0000 7fdab6176640 1 -- 172.21.15.87:0/1819476019 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdab01008a0 msgr2=0x7fdab0102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:48.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.580+0000 7fdab6176640 1 --2- 172.21.15.87:0/1819476019 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdab01008a0 0x7fdab0102c90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0009ca0 tx=0x7fdaa002a8c0 comp rx=0 tx=0).stop 2024-09-13T17:11:48.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.580+0000 7fdab6176640 1 -- 172.21.15.87:0/1819476019 shutdown_connections 2024-09-13T17:11:48.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.580+0000 7fdab6176640 1 --2- 172.21.15.87:0/1819476019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdab0105b00 0x7fdab0107ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:48.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.580+0000 7fdab6176640 1 --2- 172.21.15.87:0/1819476019 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdab01031d0 0x7fdab01055c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:48.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.580+0000 7fdab6176640 1 --2- 172.21.15.87:0/1819476019 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdab01008a0 0x7fdab0102c90 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:48.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.580+0000 7fdab6176640 1 -- 172.21.15.87:0/1819476019 >> 172.21.15.87:0/1819476019 conn(0x7fdab00fa3e0 msgr2=0x7fdab00fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:48.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.580+0000 7fdab6176640 1 -- 172.21.15.87:0/1819476019 shutdown_connections 2024-09-13T17:11:48.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.580+0000 7fdab6176640 1 -- 172.21.15.87:0/1819476019 wait complete. 2024-09-13T17:11:48.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.580+0000 7fdab6176640 1 Processor -- start 2024-09-13T17:11:48.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.581+0000 7fdab6176640 1 -- start start 2024-09-13T17:11:48.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.581+0000 7fdab6176640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdab01008a0 0x7fdab0195e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:48.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.581+0000 7fdab6176640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdab01031d0 0x7fdab0196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:48.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.581+0000 7fdab6176640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdab0105b00 0x7fdab019d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:48.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.581+0000 7fdab6176640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab019d920 con 0x7fdab0105b00 2024-09-13T17:11:48.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.581+0000 7fdab6176640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab019da90 con 0x7fdab01008a0 2024-09-13T17:11:48.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.581+0000 7fdab6176640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab019dc50 con 0x7fdab01031d0 2024-09-13T17:11:48.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.581+0000 7fdaaffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdab0105b00 0x7fdab019d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:48.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.581+0000 7fdaaffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdab0105b00 0x7fdab019d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44806/0 (socket says 172.21.15.87:44806) 2024-09-13T17:11:48.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.581+0000 7fdaaffff640 1 -- 172.21.15.87:0/635258806 learned_addr learned my addr 172.21.15.87:0/635258806 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:48.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.581+0000 7fdaaf7fe640 1 --2- 172.21.15.87:0/635258806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdab01008a0 0x7fdab0195e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:48.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.581+0000 7fdaaeffd640 1 --2- 172.21.15.87:0/635258806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdab01031d0 0x7fdab0196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:48.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.581+0000 7fdaaffff640 1 -- 172.21.15.87:0/635258806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdab01031d0 msgr2=0x7fdab0196370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:48.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.581+0000 7fdaaffff640 1 --2- 172.21.15.87:0/635258806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdab01031d0 0x7fdab0196370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:48.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.581+0000 7fdaaffff640 1 -- 172.21.15.87:0/635258806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdab01008a0 msgr2=0x7fdab0195e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:48.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.581+0000 7fdaaffff640 1 --2- 172.21.15.87:0/635258806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdab01008a0 0x7fdab0195e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:48.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.581+0000 7fdaaffff640 1 -- 172.21.15.87:0/635258806 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa0009900 con 0x7fdab0105b00 2024-09-13T17:11:48.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.581+0000 7fdaaffff640 1 --2- 172.21.15.87:0/635258806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdab0105b00 0x7fdab019d3e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdaa800d950 tx=0x7fdaa800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:48.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.581+0000 7fdaacff9640 1 -- 172.21.15.87:0/635258806 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa8009c30 con 0x7fdab0105b00 2024-09-13T17:11:48.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.582+0000 7fdaacff9640 1 -- 172.21.15.87:0/635258806 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdaa8009d90 con 0x7fdab0105b00 2024-09-13T17:11:48.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.582+0000 7fdab6176640 1 -- 172.21.15.87:0/635258806 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdab019df30 con 0x7fdab0105b00 2024-09-13T17:11:48.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.582+0000 7fdaacff9640 1 -- 172.21.15.87:0/635258806 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa800f5e0 con 0x7fdab0105b00 2024-09-13T17:11:48.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.582+0000 7fdab6176640 1 -- 172.21.15.87:0/635258806 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab019e360 con 0x7fdab0105b00 2024-09-13T17:11:48.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.583+0000 7fdab6176640 1 -- 172.21.15.87:0/635258806 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdab00fbed0 con 0x7fdab0105b00 2024-09-13T17:11:48.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.584+0000 7fdaacff9640 1 -- 172.21.15.87:0/635258806 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fdaa80109a0 con 0x7fdab0105b00 2024-09-13T17:11:48.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.584+0000 7fdaacff9640 1 --2- 172.21.15.87:0/635258806 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fda9c0a1090 0x7fda9c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:48.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.584+0000 7fdaaf7fe640 1 --2- 172.21.15.87:0/635258806 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fda9c0a1090 0x7fda9c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:48.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.585+0000 7fdaacff9640 1 -- 172.21.15.87:0/635258806 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fdaa80cc6a0 con 0x7fdab0105b00 2024-09-13T17:11:48.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.585+0000 7fdaaf7fe640 1 --2- 172.21.15.87:0/635258806 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fda9c0a1090 0x7fda9c0a3550 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0000f80 tx=0x7fdaa0031be0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:48.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.587+0000 7fdaacff9640 1 -- 172.21.15.87:0/635258806 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdaa8095cf0 con 0x7fdab0105b00 2024-09-13T17:11:48.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:48 smithi149 ceph-mon[35496]: mds.? [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] up:active 2024-09-13T17:11:48.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:48 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/502764335' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-13T17:11:48.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:48 smithi149 ceph-mon[35496]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-13T17:11:48.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:48 smithi149 ceph-mon[35496]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T17:11:48.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:48 smithi149 ceph-mon[35496]: Cluster is now healthy 2024-09-13T17:11:48.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:48 smithi149 ceph-mon[35496]: fsmap cephfs:2 {0=i=up:active,1=c=up:active} 10 up:standby 2024-09-13T17:11:48.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:48 smithi149 ceph-mon[35496]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:creating} 9 up:standby 2024-09-13T17:11:48.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:48 smithi149 ceph-mon[35496]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-09-13T17:11:48.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:48 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/21108757' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-13T17:11:48.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:48 smithi149 ceph-mon[35496]: mds.? [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] up:active 2024-09-13T17:11:48.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:48 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/21108757' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-13T17:11:48.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:48 smithi149 ceph-mon[35496]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:11:48.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:48 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-13T17:11:48.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:48 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.d", "id": [1, 9]}]: dispatch 2024-09-13T17:11:48.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:48 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]: dispatch 2024-09-13T17:11:48.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:48 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-09-13T17:11:48.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:48 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8, 5, 7]}]: dispatch 2024-09-13T17:11:48.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:48 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 6, 5, 8]}]: dispatch 2024-09-13T17:11:48.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:48 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-09-13T17:11:48.594 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:48 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]: dispatch 2024-09-13T17:11:48.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:48 smithi118 ceph-mon[34374]: mds.? [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] up:active 2024-09-13T17:11:48.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:48 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/502764335' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-13T17:11:48.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:48 smithi118 ceph-mon[34374]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-13T17:11:48.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:48 smithi118 ceph-mon[34374]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T17:11:48.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:48 smithi118 ceph-mon[34374]: Cluster is now healthy 2024-09-13T17:11:48.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:48 smithi118 ceph-mon[34374]: fsmap cephfs:2 {0=i=up:active,1=c=up:active} 10 up:standby 2024-09-13T17:11:48.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:48 smithi118 ceph-mon[34374]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:creating} 9 up:standby 2024-09-13T17:11:48.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:48 smithi118 ceph-mon[34374]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-09-13T17:11:48.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:48 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/21108757' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-13T17:11:48.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:48 smithi118 ceph-mon[34374]: mds.? [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] up:active 2024-09-13T17:11:48.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:48 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/21108757' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-13T17:11:48.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:48 smithi118 ceph-mon[34374]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:11:48.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:48 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-13T17:11:48.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:48 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.d", "id": [1, 9]}]: dispatch 2024-09-13T17:11:48.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:48 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]: dispatch 2024-09-13T17:11:48.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:48 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-09-13T17:11:48.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:48 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8, 5, 7]}]: dispatch 2024-09-13T17:11:48.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:48 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 6, 5, 8]}]: dispatch 2024-09-13T17:11:48.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:48 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-09-13T17:11:48.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:48 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]: dispatch 2024-09-13T17:11:48.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.776+0000 7fdab6176640 1 -- 172.21.15.87:0/635258806 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7fdab002c480 con 0x7fda9c0a1090 2024-09-13T17:11:48.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.781+0000 7fdaacff9640 1 -- 172.21.15.87:0/635258806 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7fdab002c480 con 0x7fda9c0a1090 2024-09-13T17:11:48.782 INFO:teuthology.orchestra.run.smithi087.stdout:/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b 2024-09-13T17:11:48.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.783+0000 7fdab6176640 1 -- 172.21.15.87:0/635258806 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fda9c0a1090 msgr2=0x7fda9c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:48.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.783+0000 7fdab6176640 1 --2- 172.21.15.87:0/635258806 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fda9c0a1090 0x7fda9c0a3550 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0000f80 tx=0x7fdaa0031be0 comp rx=0 tx=0).stop 2024-09-13T17:11:48.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.783+0000 7fdab6176640 1 -- 172.21.15.87:0/635258806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdab0105b00 msgr2=0x7fdab019d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:48.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.783+0000 7fdab6176640 1 --2- 172.21.15.87:0/635258806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdab0105b00 0x7fdab019d3e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdaa800d950 tx=0x7fdaa800de10 comp rx=0 tx=0).stop 2024-09-13T17:11:48.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.783+0000 7fdab6176640 1 -- 172.21.15.87:0/635258806 shutdown_connections 2024-09-13T17:11:48.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.783+0000 7fdab6176640 1 --2- 172.21.15.87:0/635258806 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fda9c0a1090 0x7fda9c0a3550 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:48.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.783+0000 7fdab6176640 1 --2- 172.21.15.87:0/635258806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdab0105b00 0x7fdab019d3e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:48.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.783+0000 7fdab6176640 1 --2- 172.21.15.87:0/635258806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdab01031d0 0x7fdab0196370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:48.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.783+0000 7fdab6176640 1 --2- 172.21.15.87:0/635258806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdab01008a0 0x7fdab0195e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:48.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.783+0000 7fdab6176640 1 -- 172.21.15.87:0/635258806 >> 172.21.15.87:0/635258806 conn(0x7fdab00fa3e0 msgr2=0x7fdab01011c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:48.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.783+0000 7fdab6176640 1 -- 172.21.15.87:0/635258806 shutdown_connections 2024-09-13T17:11:48.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.783+0000 7fdab6176640 1 -- 172.21.15.87:0/635258806 wait complete. 2024-09-13T17:11:48.798 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-13T17:11:48.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.903+0000 7fe3ec8d7640 1 -- 172.21.15.87:0/1499738852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3e8101920 msgr2=0x7fe3e81081b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:48.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.903+0000 7fe3ec8d7640 1 --2- 172.21.15.87:0/1499738852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3e8101920 0x7fe3e81081b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0009ca0 tx=0x7fe3e002a8c0 comp rx=0 tx=0).stop 2024-09-13T17:11:48.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.903+0000 7fe3ec8d7640 1 -- 172.21.15.87:0/1499738852 shutdown_connections 2024-09-13T17:11:48.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.903+0000 7fe3ec8d7640 1 --2- 172.21.15.87:0/1499738852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3e8101920 0x7fe3e81081b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:48.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.903+0000 7fe3ec8d7640 1 --2- 172.21.15.87:0/1499738852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3e8100f60 0x7fe3e81013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:48.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.903+0000 7fe3ec8d7640 1 --2- 172.21.15.87:0/1499738852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3e80ffd70 0x7fe3e8100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:48.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.903+0000 7fe3ec8d7640 1 -- 172.21.15.87:0/1499738852 >> 172.21.15.87:0/1499738852 conn(0x7fe3e80fb4d0 msgr2=0x7fe3e80fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:48.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.903+0000 7fe3ec8d7640 1 -- 172.21.15.87:0/1499738852 shutdown_connections 2024-09-13T17:11:48.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.903+0000 7fe3ec8d7640 1 -- 172.21.15.87:0/1499738852 wait complete. 2024-09-13T17:11:48.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.904+0000 7fe3ec8d7640 1 Processor -- start 2024-09-13T17:11:48.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.904+0000 7fe3ec8d7640 1 -- start start 2024-09-13T17:11:48.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.904+0000 7fe3ec8d7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3e80ffd70 0x7fe3e8074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:48.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.904+0000 7fe3ec8d7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3e8100f60 0x7fe3e80728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:48.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.904+0000 7fe3ec8d7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3e8101920 0x7fe3e8072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:48.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.904+0000 7fe3ec8d7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e8073540 con 0x7fe3e80ffd70 2024-09-13T17:11:48.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.904+0000 7fe3ec8d7640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e80736b0 con 0x7fe3e8101920 2024-09-13T17:11:48.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.904+0000 7fe3ec8d7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e819fd60 con 0x7fe3e8100f60 2024-09-13T17:11:48.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.904+0000 7fe3e659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3e80ffd70 0x7fe3e8074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:48.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.904+0000 7fe3e659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3e80ffd70 0x7fe3e8074260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44832/0 (socket says 172.21.15.87:44832) 2024-09-13T17:11:48.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.904+0000 7fe3e659c640 1 -- 172.21.15.87:0/1542460046 learned_addr learned my addr 172.21.15.87:0/1542460046 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:48.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.904+0000 7fe3e5d9b640 1 --2- 172.21.15.87:0/1542460046 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3e8100f60 0x7fe3e80728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:48.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.904+0000 7fe3e6d9d640 1 --2- 172.21.15.87:0/1542460046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3e8101920 0x7fe3e8072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:48.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.904+0000 7fe3e659c640 1 -- 172.21.15.87:0/1542460046 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3e8100f60 msgr2=0x7fe3e80728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:48.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.904+0000 7fe3e659c640 1 --2- 172.21.15.87:0/1542460046 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3e8100f60 0x7fe3e80728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:48.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.904+0000 7fe3e659c640 1 -- 172.21.15.87:0/1542460046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3e8101920 msgr2=0x7fe3e8072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:48.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.904+0000 7fe3e659c640 1 --2- 172.21.15.87:0/1542460046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3e8101920 0x7fe3e8072de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:48.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.904+0000 7fe3e659c640 1 -- 172.21.15.87:0/1542460046 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e0009900 con 0x7fe3e80ffd70 2024-09-13T17:11:48.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.904+0000 7fe3e5d9b640 1 --2- 172.21.15.87:0/1542460046 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3e8100f60 0x7fe3e80728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:11:48.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.905+0000 7fe3e659c640 1 --2- 172.21.15.87:0/1542460046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3e80ffd70 0x7fe3e8074260 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe3d800c9a0 tx=0x7fe3d800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:48.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.905+0000 7fe3d77fe640 1 -- 172.21.15.87:0/1542460046 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d8004220 con 0x7fe3e80ffd70 2024-09-13T17:11:48.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.905+0000 7fe3d77fe640 1 -- 172.21.15.87:0/1542460046 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe3d8007e60 con 0x7fe3e80ffd70 2024-09-13T17:11:48.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.905+0000 7fe3ec8d7640 1 -- 172.21.15.87:0/1542460046 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3e819ffb0 con 0x7fe3e80ffd70 2024-09-13T17:11:48.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.905+0000 7fe3d77fe640 1 -- 172.21.15.87:0/1542460046 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d800f450 con 0x7fe3e80ffd70 2024-09-13T17:11:48.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.905+0000 7fe3ec8d7640 1 -- 172.21.15.87:0/1542460046 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3e81a0430 con 0x7fe3e80ffd70 2024-09-13T17:11:48.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.906+0000 7fe3ec8d7640 1 -- 172.21.15.87:0/1542460046 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3e81071b0 con 0x7fe3e80ffd70 2024-09-13T17:11:48.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.907+0000 7fe3d77fe640 1 -- 172.21.15.87:0/1542460046 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fe3d8004380 con 0x7fe3e80ffd70 2024-09-13T17:11:48.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.908+0000 7fe3d77fe640 1 --2- 172.21.15.87:0/1542460046 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe3d00a1120 0x7fe3d00a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:48.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.908+0000 7fe3e5d9b640 1 --2- 172.21.15.87:0/1542460046 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe3d00a1120 0x7fe3d00a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:48.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.908+0000 7fe3d77fe640 1 -- 172.21.15.87:0/1542460046 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8978+0+0 (secure 0 0 0) 0x7fe3d80cce90 con 0x7fe3e80ffd70 2024-09-13T17:11:48.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.908+0000 7fe3e5d9b640 1 --2- 172.21.15.87:0/1542460046 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe3d00a1120 0x7fe3d00a35e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc0058c0 tx=0x7fe3dc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:48.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:48.912+0000 7fe3d77fe640 1 -- 172.21.15.87:0/1542460046 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe3d80961d0 con 0x7fe3e80ffd70 2024-09-13T17:11:49.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.098+0000 7fe3ec8d7640 1 -- 172.21.15.87:0/1542460046 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3e802c4c0 con 0x7fe3d00a1120 2024-09-13T17:11:49.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.121+0000 7fe3d77fe640 1 -- 172.21.15.87:0/1542460046 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe3e802c4c0 con 0x7fe3d00a1120 2024-09-13T17:11:49.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.123+0000 7fe3ec8d7640 1 -- 172.21.15.87:0/1542460046 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe3d00a1120 msgr2=0x7fe3d00a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:49.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.123+0000 7fe3ec8d7640 1 --2- 172.21.15.87:0/1542460046 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe3d00a1120 0x7fe3d00a35e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc0058c0 tx=0x7fe3dc005850 comp rx=0 tx=0).stop 2024-09-13T17:11:49.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.123+0000 7fe3ec8d7640 1 -- 172.21.15.87:0/1542460046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3e80ffd70 msgr2=0x7fe3e8074260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:49.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.123+0000 7fe3ec8d7640 1 --2- 172.21.15.87:0/1542460046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3e80ffd70 0x7fe3e8074260 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe3d800c9a0 tx=0x7fe3d800ce60 comp rx=0 tx=0).stop 2024-09-13T17:11:49.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.123+0000 7fe3ec8d7640 1 -- 172.21.15.87:0/1542460046 shutdown_connections 2024-09-13T17:11:49.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.123+0000 7fe3ec8d7640 1 --2- 172.21.15.87:0/1542460046 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe3d00a1120 0x7fe3d00a35e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:49.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.123+0000 7fe3ec8d7640 1 --2- 172.21.15.87:0/1542460046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3e8101920 0x7fe3e8072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:49.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.123+0000 7fe3ec8d7640 1 --2- 172.21.15.87:0/1542460046 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3e8100f60 0x7fe3e80728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:49.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.123+0000 7fe3ec8d7640 1 --2- 172.21.15.87:0/1542460046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3e80ffd70 0x7fe3e8074260 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:49.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.123+0000 7fe3ec8d7640 1 -- 172.21.15.87:0/1542460046 >> 172.21.15.87:0/1542460046 conn(0x7fe3e80fb4d0 msgr2=0x7fe3e8104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:49.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.123+0000 7fe3ec8d7640 1 -- 172.21.15.87:0/1542460046 shutdown_connections 2024-09-13T17:11:49.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.123+0000 7fe3ec8d7640 1 -- 172.21.15.87:0/1542460046 wait complete. 2024-09-13T17:11:49.135 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-13T17:11:49.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.241+0000 7f182035e640 1 -- 172.21.15.87:0/2070590555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18180fec60 msgr2=0x7f18180ff060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:49.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.241+0000 7f182035e640 1 --2- 172.21.15.87:0/2070590555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18180fec60 0x7f18180ff060 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1808009900 tx=0x7f180802a410 comp rx=0 tx=0).stop 2024-09-13T17:11:49.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.241+0000 7f182035e640 1 -- 172.21.15.87:0/2070590555 shutdown_connections 2024-09-13T17:11:49.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.241+0000 7f182035e640 1 --2- 172.21.15.87:0/2070590555 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1818100810 0x7f18181070a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:49.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.241+0000 7f182035e640 1 --2- 172.21.15.87:0/2070590555 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18180ffe50 0x7f18181002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:49.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.241+0000 7f182035e640 1 --2- 172.21.15.87:0/2070590555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18180fec60 0x7f18180ff060 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:49.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.241+0000 7f182035e640 1 -- 172.21.15.87:0/2070590555 >> 172.21.15.87:0/2070590555 conn(0x7f18180fa3e0 msgr2=0x7f18180fc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:49.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.241+0000 7f182035e640 1 -- 172.21.15.87:0/2070590555 shutdown_connections 2024-09-13T17:11:49.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.241+0000 7f182035e640 1 -- 172.21.15.87:0/2070590555 wait complete. 2024-09-13T17:11:49.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.242+0000 7f182035e640 1 Processor -- start 2024-09-13T17:11:49.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.242+0000 7f182035e640 1 -- start start 2024-09-13T17:11:49.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.242+0000 7f182035e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18180fec60 0x7f1818068110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:49.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.242+0000 7f182035e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18180ffe50 0x7f181819aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:49.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.242+0000 7f182035e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1818100810 0x7f181819d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:49.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.242+0000 7f182035e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181819d8d0 con 0x7f18180ffe50 2024-09-13T17:11:49.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.242+0000 7f182035e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181819da40 con 0x7f18180fec60 2024-09-13T17:11:49.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.242+0000 7f182035e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181819dc00 con 0x7f1818100810 2024-09-13T17:11:49.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.242+0000 7f181d8f9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18180ffe50 0x7f181819aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:49.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.242+0000 7f181d8f9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18180ffe50 0x7f181819aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45468/0 (socket says 172.21.15.87:45468) 2024-09-13T17:11:49.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.242+0000 7f181d8f9640 1 -- 172.21.15.87:0/4152282093 learned_addr learned my addr 172.21.15.87:0/4152282093 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:49.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.242+0000 7f181e0fa640 1 --2- 172.21.15.87:0/4152282093 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18180fec60 0x7f1818068110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:49.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.242+0000 7f181e8fb640 1 --2- 172.21.15.87:0/4152282093 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1818100810 0x7f181819d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:49.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.242+0000 7f181d8f9640 1 -- 172.21.15.87:0/4152282093 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1818100810 msgr2=0x7f181819d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:49.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.242+0000 7f181d8f9640 1 --2- 172.21.15.87:0/4152282093 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1818100810 0x7f181819d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:49.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.242+0000 7f181d8f9640 1 -- 172.21.15.87:0/4152282093 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18180fec60 msgr2=0x7f1818068110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:49.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.242+0000 7f181d8f9640 1 --2- 172.21.15.87:0/4152282093 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18180fec60 0x7f1818068110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:49.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.242+0000 7f181d8f9640 1 -- 172.21.15.87:0/4152282093 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1808009560 con 0x7f18180ffe50 2024-09-13T17:11:49.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.242+0000 7f181d8f9640 1 --2- 172.21.15.87:0/4152282093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18180ffe50 0x7f181819aad0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f181400e9f0 tx=0x7f181400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:49.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.243+0000 7f180f7fe640 1 -- 172.21.15.87:0/4152282093 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1814009720 con 0x7f18180ffe50 2024-09-13T17:11:49.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.243+0000 7f182035e640 1 -- 172.21.15.87:0/4152282093 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f181819de80 con 0x7f18180ffe50 2024-09-13T17:11:49.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.243+0000 7f180f7fe640 1 -- 172.21.15.87:0/4152282093 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f181400cd80 con 0x7f18180ffe50 2024-09-13T17:11:49.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.243+0000 7f180f7fe640 1 -- 172.21.15.87:0/4152282093 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1814010430 con 0x7f18180ffe50 2024-09-13T17:11:49.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.243+0000 7f182035e640 1 -- 172.21.15.87:0/4152282093 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f181819e300 con 0x7f18180ffe50 2024-09-13T17:11:49.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.244+0000 7f182035e640 1 -- 172.21.15.87:0/4152282093 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18181060e0 con 0x7f18180ffe50 2024-09-13T17:11:49.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.246+0000 7f180f7fe640 1 -- 172.21.15.87:0/4152282093 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f1814005000 con 0x7f18180ffe50 2024-09-13T17:11:49.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.246+0000 7f180f7fe640 1 --2- 172.21.15.87:0/4152282093 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f18040a1120 0x7f18040a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:49.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.246+0000 7f180f7fe640 1 -- 172.21.15.87:0/4152282093 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8978+0+0 (secure 0 0 0) 0x7f1814014070 con 0x7f18180ffe50 2024-09-13T17:11:49.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.246+0000 7f181e0fa640 1 --2- 172.21.15.87:0/4152282093 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f18040a1120 0x7f18040a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:49.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.247+0000 7f181e0fa640 1 --2- 172.21.15.87:0/4152282093 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f18040a1120 0x7f18040a35e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1808005940 tx=0x7f18080058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:49.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.249+0000 7f180f7fe640 1 -- 172.21.15.87:0/4152282093 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1814096670 con 0x7f18180ffe50 2024-09-13T17:11:49.399 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:49 smithi087 ceph-mon[30934]: pgmap v289: 129 pgs: 129 active+clean; 583 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s rd, 426 B/s wr, 2 op/s 2024-09-13T17:11:49.399 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:49 smithi087 ceph-mon[30934]: from='client.14883 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:11:49.400 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:49 smithi087 ceph-mon[30934]: mgrmap e17: x(active, since 7m), standbys: y, z 2024-09-13T17:11:49.400 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-13T17:11:49.400 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.d", "id": [1, 9]}]': finished 2024-09-13T17:11:49.400 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2024-09-13T17:11:49.400 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-13T17:11:49.400 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8, 5, 7]}]': finished 2024-09-13T17:11:49.400 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 6, 5, 8]}]': finished 2024-09-13T17:11:49.400 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-13T17:11:49.400 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]': finished 2024-09-13T17:11:49.400 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:49 smithi087 ceph-mon[30934]: osdmap e90: 12 total, 12 up, 12 in 2024-09-13T17:11:49.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.441+0000 7f182035e640 1 -- 172.21.15.87:0/4152282093 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f181802c450 con 0x7f18040a1120 2024-09-13T17:11:49.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.445+0000 7f180f7fe640 1 -- 172.21.15.87:0/4152282093 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7f181802c450 con 0x7f18040a1120 2024-09-13T17:11:49.446 INFO:teuthology.orchestra.run.smithi087.stdout:/volumes/qa/sv_1/15a65fce-e084-4ac8-bc58-8fd819bc20b2 2024-09-13T17:11:49.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.447+0000 7f182035e640 1 -- 172.21.15.87:0/4152282093 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f18040a1120 msgr2=0x7f18040a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:49.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.447+0000 7f182035e640 1 --2- 172.21.15.87:0/4152282093 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f18040a1120 0x7f18040a35e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1808005940 tx=0x7f18080058d0 comp rx=0 tx=0).stop 2024-09-13T17:11:49.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.447+0000 7f182035e640 1 -- 172.21.15.87:0/4152282093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18180ffe50 msgr2=0x7f181819aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:49.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.447+0000 7f182035e640 1 --2- 172.21.15.87:0/4152282093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18180ffe50 0x7f181819aad0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f181400e9f0 tx=0x7f181400edf0 comp rx=0 tx=0).stop 2024-09-13T17:11:49.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.447+0000 7f182035e640 1 -- 172.21.15.87:0/4152282093 shutdown_connections 2024-09-13T17:11:49.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.447+0000 7f182035e640 1 --2- 172.21.15.87:0/4152282093 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f18040a1120 0x7f18040a35e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:49.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.447+0000 7f182035e640 1 --2- 172.21.15.87:0/4152282093 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1818100810 0x7f181819d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:49.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.447+0000 7f182035e640 1 --2- 172.21.15.87:0/4152282093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18180ffe50 0x7f181819aad0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:49.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.447+0000 7f182035e640 1 --2- 172.21.15.87:0/4152282093 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18180fec60 0x7f1818068110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:49.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.447+0000 7f182035e640 1 -- 172.21.15.87:0/4152282093 >> 172.21.15.87:0/4152282093 conn(0x7f18180fa3e0 msgr2=0x7f18181032b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:49.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.447+0000 7f182035e640 1 -- 172.21.15.87:0/4152282093 shutdown_connections 2024-09-13T17:11:49.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.447+0000 7f182035e640 1 -- 172.21.15.87:0/4152282093 wait complete. 2024-09-13T17:11:49.459 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:11:49.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.562+0000 7ff410b45640 1 -- 172.21.15.87:0/4098097393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff40c1008c0 msgr2=0x7ff40c102cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:49.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.562+0000 7ff410b45640 1 --2- 172.21.15.87:0/4098097393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff40c1008c0 0x7ff40c102cb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc009900 tx=0x7ff3fc02a410 comp rx=0 tx=0).stop 2024-09-13T17:11:49.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.562+0000 7ff410b45640 1 -- 172.21.15.87:0/4098097393 shutdown_connections 2024-09-13T17:11:49.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.562+0000 7ff410b45640 1 --2- 172.21.15.87:0/4098097393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff40c105b20 0x7ff40c107f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:49.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.562+0000 7ff410b45640 1 --2- 172.21.15.87:0/4098097393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff40c1031f0 0x7ff40c1055e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:49.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.562+0000 7ff410b45640 1 --2- 172.21.15.87:0/4098097393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff40c1008c0 0x7ff40c102cb0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:49.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.562+0000 7ff410b45640 1 -- 172.21.15.87:0/4098097393 >> 172.21.15.87:0/4098097393 conn(0x7ff40c0fa440 msgr2=0x7ff40c0fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:49.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.562+0000 7ff410b45640 1 -- 172.21.15.87:0/4098097393 shutdown_connections 2024-09-13T17:11:49.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.562+0000 7ff410b45640 1 -- 172.21.15.87:0/4098097393 wait complete. 2024-09-13T17:11:49.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.563+0000 7ff410b45640 1 Processor -- start 2024-09-13T17:11:49.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.563+0000 7ff410b45640 1 -- start start 2024-09-13T17:11:49.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.563+0000 7ff410b45640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff40c1008c0 0x7ff40c198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:49.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.563+0000 7ff410b45640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff40c1031f0 0x7ff40c1985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:49.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.563+0000 7ff410b45640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff40c105b20 0x7ff40c19f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:49.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.563+0000 7ff410b45640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c19fb50 con 0x7ff40c1008c0 2024-09-13T17:11:49.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.563+0000 7ff410b45640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c19fcc0 con 0x7ff40c105b20 2024-09-13T17:11:49.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.563+0000 7ff410b45640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c19fe80 con 0x7ff40c1031f0 2024-09-13T17:11:49.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.563+0000 7ff40a59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff40c1008c0 0x7ff40c198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:49.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.563+0000 7ff40a59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff40c1008c0 0x7ff40c198060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45480/0 (socket says 172.21.15.87:45480) 2024-09-13T17:11:49.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.563+0000 7ff40a59c640 1 -- 172.21.15.87:0/2151712949 learned_addr learned my addr 172.21.15.87:0/2151712949 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:49.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.563+0000 7ff403fff640 1 --2- 172.21.15.87:0/2151712949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff40c1031f0 0x7ff40c1985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:49.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.564+0000 7ff40ad9d640 1 --2- 172.21.15.87:0/2151712949 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff40c105b20 0x7ff40c19f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:49.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.564+0000 7ff40a59c640 1 -- 172.21.15.87:0/2151712949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff40c1031f0 msgr2=0x7ff40c1985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:49.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.564+0000 7ff40a59c640 1 --2- 172.21.15.87:0/2151712949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff40c1031f0 0x7ff40c1985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:49.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.564+0000 7ff40a59c640 1 -- 172.21.15.87:0/2151712949 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff40c105b20 msgr2=0x7ff40c19f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:49.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.564+0000 7ff40a59c640 1 --2- 172.21.15.87:0/2151712949 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff40c105b20 0x7ff40c19f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:49.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.564+0000 7ff40a59c640 1 -- 172.21.15.87:0/2151712949 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3fc009560 con 0x7ff40c1008c0 2024-09-13T17:11:49.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.564+0000 7ff40a59c640 1 --2- 172.21.15.87:0/2151712949 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff40c1008c0 0x7ff40c198060 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc031460 tx=0x7ff3fc004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:49.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.564+0000 7ff4037fe640 1 -- 172.21.15.87:0/2151712949 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc003800 con 0x7ff40c1008c0 2024-09-13T17:11:49.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.564+0000 7ff410b45640 1 -- 172.21.15.87:0/2151712949 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff40c1a0100 con 0x7ff40c1008c0 2024-09-13T17:11:49.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.564+0000 7ff4037fe640 1 -- 172.21.15.87:0/2151712949 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff3fc003e10 con 0x7ff40c1008c0 2024-09-13T17:11:49.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.564+0000 7ff4037fe640 1 -- 172.21.15.87:0/2151712949 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc03b3d0 con 0x7ff40c1008c0 2024-09-13T17:11:49.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.564+0000 7ff410b45640 1 -- 172.21.15.87:0/2151712949 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40c1a0600 con 0x7ff40c1008c0 2024-09-13T17:11:49.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.565+0000 7ff410b45640 1 -- 172.21.15.87:0/2151712949 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff40c107610 con 0x7ff40c1008c0 2024-09-13T17:11:49.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.566+0000 7ff4037fe640 1 -- 172.21.15.87:0/2151712949 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7ff3fc03c700 con 0x7ff40c1008c0 2024-09-13T17:11:49.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.567+0000 7ff4037fe640 1 --2- 172.21.15.87:0/2151712949 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff3f80a1120 0x7ff3f80a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:49.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.567+0000 7ff403fff640 1 --2- 172.21.15.87:0/2151712949 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff3f80a1120 0x7ff3f80a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:49.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.567+0000 7ff4037fe640 1 -- 172.21.15.87:0/2151712949 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8978+0+0 (secure 0 0 0) 0x7ff3fc0edb10 con 0x7ff40c1008c0 2024-09-13T17:11:49.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.568+0000 7ff403fff640 1 --2- 172.21.15.87:0/2151712949 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff3f80a1120 0x7ff3f80a35e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff40c199570 tx=0x7ff3f400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:49.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.571+0000 7ff4037fe640 1 -- 172.21.15.87:0/2151712949 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff3fc0b6e50 con 0x7ff40c1008c0 2024-09-13T17:11:49.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:49 smithi149 ceph-mon[35496]: pgmap v289: 129 pgs: 129 active+clean; 583 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s rd, 426 B/s wr, 2 op/s 2024-09-13T17:11:49.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:49 smithi149 ceph-mon[35496]: from='client.14883 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:11:49.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:49 smithi149 ceph-mon[35496]: mgrmap e17: x(active, since 7m), standbys: y, z 2024-09-13T17:11:49.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-13T17:11:49.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.d", "id": [1, 9]}]': finished 2024-09-13T17:11:49.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2024-09-13T17:11:49.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-13T17:11:49.594 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8, 5, 7]}]': finished 2024-09-13T17:11:49.594 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 6, 5, 8]}]': finished 2024-09-13T17:11:49.594 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-13T17:11:49.594 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]': finished 2024-09-13T17:11:49.594 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:49 smithi149 ceph-mon[35496]: osdmap e90: 12 total, 12 up, 12 in 2024-09-13T17:11:49.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:49 smithi118 ceph-mon[34374]: pgmap v289: 129 pgs: 129 active+clean; 583 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s rd, 426 B/s wr, 2 op/s 2024-09-13T17:11:49.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:49 smithi118 ceph-mon[34374]: from='client.14883 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:11:49.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:49 smithi118 ceph-mon[34374]: mgrmap e17: x(active, since 7m), standbys: y, z 2024-09-13T17:11:49.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-13T17:11:49.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.d", "id": [1, 9]}]': finished 2024-09-13T17:11:49.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2024-09-13T17:11:49.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-13T17:11:49.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8, 5, 7]}]': finished 2024-09-13T17:11:49.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 6, 5, 8]}]': finished 2024-09-13T17:11:49.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-13T17:11:49.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]': finished 2024-09-13T17:11:49.615 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:49 smithi118 ceph-mon[34374]: osdmap e90: 12 total, 12 up, 12 in 2024-09-13T17:11:49.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.786+0000 7ff410b45640 1 -- 172.21.15.87:0/2151712949 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff40c107080 con 0x7ff40c1008c0 2024-09-13T17:11:49.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.787+0000 7ff4037fe640 1 -- 172.21.15.87:0/2151712949 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10877 (secure 0 0 0) 0x7ff3fc04a090 con 0x7ff40c1008c0 2024-09-13T17:11:49.788 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:11:49.788 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/3674545180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":3674545180},{"type":"v1","addr":"172.21.15.87:6841","nonce":3674545180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:11:23.313609+0000","modified":"2024-09-13T17:11:47.780404+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24484,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6839/3052680456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3052680456},{"type":"v1","addr":"172.21.15.118:6839","nonce":3052680456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:11:49.789 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 23 2024-09-13T17:11:49.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.791+0000 7ff410b45640 1 -- 172.21.15.87:0/2151712949 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff3f80a1120 msgr2=0x7ff3f80a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:49.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.791+0000 7ff410b45640 1 --2- 172.21.15.87:0/2151712949 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff3f80a1120 0x7ff3f80a35e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff40c199570 tx=0x7ff3f400b390 comp rx=0 tx=0).stop 2024-09-13T17:11:49.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.791+0000 7ff410b45640 1 -- 172.21.15.87:0/2151712949 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff40c1008c0 msgr2=0x7ff40c198060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:49.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.791+0000 7ff410b45640 1 --2- 172.21.15.87:0/2151712949 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff40c1008c0 0x7ff40c198060 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc031460 tx=0x7ff3fc004360 comp rx=0 tx=0).stop 2024-09-13T17:11:49.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.791+0000 7ff410b45640 1 -- 172.21.15.87:0/2151712949 shutdown_connections 2024-09-13T17:11:49.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.791+0000 7ff410b45640 1 --2- 172.21.15.87:0/2151712949 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff3f80a1120 0x7ff3f80a35e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:49.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.791+0000 7ff410b45640 1 --2- 172.21.15.87:0/2151712949 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff40c105b20 0x7ff40c19f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:49.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.791+0000 7ff410b45640 1 --2- 172.21.15.87:0/2151712949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff40c1031f0 0x7ff40c1985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:49.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.791+0000 7ff410b45640 1 --2- 172.21.15.87:0/2151712949 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff40c1008c0 0x7ff40c198060 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:49.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.791+0000 7ff410b45640 1 -- 172.21.15.87:0/2151712949 >> 172.21.15.87:0/2151712949 conn(0x7ff40c0fa440 msgr2=0x7ff40c1000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:49.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.791+0000 7ff410b45640 1 -- 172.21.15.87:0/2151712949 shutdown_connections 2024-09-13T17:11:49.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.791+0000 7ff410b45640 1 -- 172.21.15.87:0/2151712949 wait complete. 2024-09-13T17:11:49.809 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:11:49.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.909+0000 7fc27179c640 1 -- 172.21.15.87:0/3999198348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc26c100850 msgr2=0x7fc26c1070e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:49.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.909+0000 7fc27179c640 1 --2- 172.21.15.87:0/3999198348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc26c100850 0x7fc26c1070e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc25c009ca0 tx=0x7fc25c02a8c0 comp rx=0 tx=0).stop 2024-09-13T17:11:49.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.909+0000 7fc27179c640 1 -- 172.21.15.87:0/3999198348 shutdown_connections 2024-09-13T17:11:49.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.909+0000 7fc27179c640 1 --2- 172.21.15.87:0/3999198348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc26c100850 0x7fc26c1070e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.909+0000 7fc27179c640 1 --2- 172.21.15.87:0/3999198348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc26c0ffe90 0x7fc26c100310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.909+0000 7fc27179c640 1 --2- 172.21.15.87:0/3999198348 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc26c0feca0 0x7fc26c0ff0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.909+0000 7fc27179c640 1 -- 172.21.15.87:0/3999198348 >> 172.21.15.87:0/3999198348 conn(0x7fc26c0fa400 msgr2=0x7fc26c0fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.909+0000 7fc27179c640 1 -- 172.21.15.87:0/3999198348 shutdown_connections 2024-09-13T17:11:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.909+0000 7fc27179c640 1 -- 172.21.15.87:0/3999198348 wait complete. 2024-09-13T17:11:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.910+0000 7fc27179c640 1 Processor -- start 2024-09-13T17:11:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.910+0000 7fc27179c640 1 -- start start 2024-09-13T17:11:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.910+0000 7fc27179c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc26c0feca0 0x7fc26c109560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.910+0000 7fc27179c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc26c0ffe90 0x7fc26c107ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.910+0000 7fc27179c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc26c100850 0x7fc26c1080e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.910+0000 7fc27179c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c108840 con 0x7fc26c0feca0 2024-09-13T17:11:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.910+0000 7fc27179c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c1089b0 con 0x7fc26c0ffe90 2024-09-13T17:11:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.910+0000 7fc27179c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c19fdf0 con 0x7fc26c100850 2024-09-13T17:11:49.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.910+0000 7fc26affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc26c0feca0 0x7fc26c109560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:49.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.910+0000 7fc26affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc26c0feca0 0x7fc26c109560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45500/0 (socket says 172.21.15.87:45500) 2024-09-13T17:11:49.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.910+0000 7fc26affd640 1 -- 172.21.15.87:0/467167976 learned_addr learned my addr 172.21.15.87:0/467167976 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:49.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.911+0000 7fc26b7fe640 1 --2- 172.21.15.87:0/467167976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc26c100850 0x7fc26c1080e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:49.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.911+0000 7fc26a7fc640 1 --2- 172.21.15.87:0/467167976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc26c0ffe90 0x7fc26c107ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:49.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.911+0000 7fc26affd640 1 -- 172.21.15.87:0/467167976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc26c100850 msgr2=0x7fc26c1080e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:49.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.911+0000 7fc26affd640 1 --2- 172.21.15.87:0/467167976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc26c100850 0x7fc26c1080e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:49.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.911+0000 7fc26affd640 1 -- 172.21.15.87:0/467167976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc26c0ffe90 msgr2=0x7fc26c107ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:49.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.911+0000 7fc26affd640 1 --2- 172.21.15.87:0/467167976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc26c0ffe90 0x7fc26c107ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:49.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.911+0000 7fc26affd640 1 -- 172.21.15.87:0/467167976 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc25c009900 con 0x7fc26c0feca0 2024-09-13T17:11:49.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.911+0000 7fc26affd640 1 --2- 172.21.15.87:0/467167976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc26c0feca0 0x7fc26c109560 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc26400b480 tx=0x7fc26400b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:49.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.911+0000 7fc263fff640 1 -- 172.21.15.87:0/467167976 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc264010870 con 0x7fc26c0feca0 2024-09-13T17:11:49.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.911+0000 7fc263fff640 1 -- 172.21.15.87:0/467167976 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc264010e80 con 0x7fc26c0feca0 2024-09-13T17:11:49.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.911+0000 7fc27179c640 1 -- 172.21.15.87:0/467167976 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc26c1a00a0 con 0x7fc26c0feca0 2024-09-13T17:11:49.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.911+0000 7fc263fff640 1 -- 172.21.15.87:0/467167976 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc264017360 con 0x7fc26c0feca0 2024-09-13T17:11:49.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.911+0000 7fc27179c640 1 -- 172.21.15.87:0/467167976 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc26c1a05b0 con 0x7fc26c0feca0 2024-09-13T17:11:49.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.912+0000 7fc27179c640 1 -- 172.21.15.87:0/467167976 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc26c106130 con 0x7fc26c0feca0 2024-09-13T17:11:49.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.914+0000 7fc263fff640 1 -- 172.21.15.87:0/467167976 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fc2640109d0 con 0x7fc26c0feca0 2024-09-13T17:11:49.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.915+0000 7fc263fff640 1 --2- 172.21.15.87:0/467167976 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc2580a1120 0x7fc2580a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:49.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.915+0000 7fc26a7fc640 1 --2- 172.21.15.87:0/467167976 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc2580a1120 0x7fc2580a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:49.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.915+0000 7fc263fff640 1 -- 172.21.15.87:0/467167976 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8978+0+0 (secure 0 0 0) 0x7fc2640cc6d0 con 0x7fc26c0feca0 2024-09-13T17:11:49.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.915+0000 7fc26a7fc640 1 --2- 172.21.15.87:0/467167976 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc2580a1120 0x7fc2580a35e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc26c1092d0 tx=0x7fc25400a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:49.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:49.919+0000 7fc263fff640 1 -- 172.21.15.87:0/467167976 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc264095bb0 con 0x7fc26c0feca0 2024-09-13T17:11:50.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.089+0000 7fc27179c640 1 -- 172.21.15.87:0/467167976 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc26c105ba0 con 0x7fc26c0feca0 2024-09-13T17:11:50.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.091+0000 7fc263fff640 1 -- 172.21.15.87:0/467167976 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+24383 (secure 0 0 0) 0x7fc2640991d0 con 0x7fc26c0feca0 2024-09-13T17:11:50.092 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:11:50.092 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":91,"fsid":"043d5bae-71f2-11ef-bceb-c7b262605968","created":"2024-09-13T17:03:57.852010+0000","modified":"2024-09-13T17:11:49.788058+0000","last_up_change":"2024-09-13T17:10:34.423548+0000","last_in_change":"2024-09-13T17:10:14.228123+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:07:02.286400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:11:21.965141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:11:22.504345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:11:25.565163+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58250283-85c0-416e-abdd-1fc5a7ff0c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6803","nonce":1316956138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6805","nonce":1316956138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6809","nonce":1316956138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6807","nonce":1316956138}]},"public_addr":"172.21.15.87:6803/1316956138","cluster_addr":"172.21.15.87:6805/1316956138","heartbeat_back_addr":"172.21.15.87:6809/1316956138","heartbeat_front_addr":"172.21.15.87:6807/1316956138","state":["exists","up"]},{"osd":1,"uuid":"b9d49969-94b1-4262-b4ff-db0a8e3331af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6801","nonce":3352566727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6803","nonce":3352566727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6807","nonce":3352566727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6805","nonce":3352566727}]},"public_addr":"172.21.15.118:6801/3352566727","cluster_addr":"172.21.15.118:6803/3352566727","heartbeat_back_addr":"172.21.15.118:6807/3352566727","heartbeat_front_addr":"172.21.15.118:6805/3352566727","state":["exists","up"]},{"osd":2,"uuid":"ba64549e-d736-426f-b466-f569af5f16d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6801","nonce":2774581686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6803","nonce":2774581686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6807","nonce":2774581686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6805","nonce":2774581686}]},"public_addr":"172.21.15.149:6801/2774581686","cluster_addr":"172.21.15.149:6803/2774581686","heartbeat_back_addr":"172.21.15.149:6807/2774581686","heartbeat_front_addr":"172.21.15.149:6805/2774581686","state":["exists","up"]},{"osd":3,"uuid":"3d5553e5-371b-49fd-976b-9e72a97a2f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6811","nonce":3306119066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6813","nonce":3306119066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6817","nonce":3306119066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6815","nonce":3306119066}]},"public_addr":"172.21.15.87:6811/3306119066","cluster_addr":"172.21.15.87:6813/3306119066","heartbeat_back_addr":"172.21.15.87:6817/3306119066","heartbeat_front_addr":"172.21.15.87:6815/3306119066","state":["exists","up"]},{"osd":4,"uuid":"2fbe0e27-34ec-42a6-9962-f1d8202b3159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6809","nonce":3342349890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6811","nonce":3342349890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6815","nonce":3342349890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6813","nonce":3342349890}]},"public_addr":"172.21.15.118:6809/3342349890","cluster_addr":"172.21.15.118:6811/3342349890","heartbeat_back_addr":"172.21.15.118:6815/3342349890","heartbeat_front_addr":"172.21.15.118:6813/3342349890","state":["exists","up"]},{"osd":5,"uuid":"53c14519-6170-4b5a-a79d-4835882d7bec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6809","nonce":3468867124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6811","nonce":3468867124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6815","nonce":3468867124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6813","nonce":3468867124}]},"public_addr":"172.21.15.149:6809/3468867124","cluster_addr":"172.21.15.149:6811/3468867124","heartbeat_back_addr":"172.21.15.149:6815/3468867124","heartbeat_front_addr":"172.21.15.149:6813/3468867124","state":["exists","up"]},{"osd":6,"uuid":"d3951b32-db77-4b8b-9de0-f05e03d13f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6819","nonce":326563617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6821","nonce":326563617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6825","nonce":326563617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6823","nonce":326563617}]},"public_addr":"172.21.15.87:6819/326563617","cluster_addr":"172.21.15.87:6821/326563617","heartbeat_back_addr":"172.21.15.87:6825/326563617","heartbeat_front_addr":"172.21.15.87:6823/326563617","state":["exists","up"]},{"osd":7,"uuid":"4d46dab7-a8bf-4e3e-b5c0-43860d336bdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6817","nonce":1690268990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6819","nonce":1690268990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6823","nonce":1690268990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6821","nonce":1690268990}]},"public_addr":"172.21.15.118:6817/1690268990","cluster_addr":"172.21.15.118:6819/1690268990","heartbeat_back_addr":"172.21.15.118:6823/1690268990","heartbeat_front_addr":"172.21.15.118:6821/1690268990","state":["exists","up"]},{"osd":8,"uuid":"5a015a7d-60a3-4412-96af-1b61d2ad51f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6817","nonce":1558675380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6819","nonce":1558675380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6823","nonce":1558675380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6821","nonce":1558675380}]},"public_addr":"172.21.15.149:6817/1558675380","cluster_addr":"172.21.15.149:6819/1558675380","heartbeat_back_addr":"172.21.15.149:6823/1558675380","heartbeat_front_addr":"172.21.15.149:6821/1558675380","state":["exists","up"]},{"osd":9,"uuid":"248c0b6e-4c4e-4c63-a0dd-e4cdf3b997a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6827","nonce":1453934262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6829","nonce":1453934262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6833","nonce":1453934262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6831","nonce":1453934262}]},"public_addr":"172.21.15.87:6827/1453934262","cluster_addr":"172.21.15.87:6829/1453934262","heartbeat_back_addr":"172.21.15.87:6833/1453934262","heartbeat_front_addr":"172.21.15.87:6831/1453934262","state":["exists","up"]},{"osd":10,"uuid":"24238714-e737-4371-b5d5-0cd3395f09bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6825","nonce":1034318850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6827","nonce":1034318850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6831","nonce":1034318850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6829","nonce":1034318850}]},"public_addr":"172.21.15.118:6825/1034318850","cluster_addr":"172.21.15.118:6827/1034318850","heartbeat_back_addr":"172.21.15.118:6831/1034318850","heartbeat_front_addr":"172.21.15.118:6829/1034318850","state":["exists","up"]},{"osd":11,"uuid":"409dd3bf-5154-4dea-8708-7de7f9e2e793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6825","nonce":271000465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6827","nonce":271000465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6831","nonce":271000465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6829","nonce":271000465}]},"public_addr":"172.21.15.149:6825/271000465","cluster_addr":"172.21.15.149:6827/271000465","heartbeat_back_addr":"172.21.15.149:6831/271000465","heartbeat_front_addr":"172.21.15.149:6829/271000465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:16.382664+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:37.914250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:00.425876+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:23.960183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:47.004088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:10.214345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:33.719221+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:57.099599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:20.971881+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:44.827167+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:08.135516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:32.085853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"3.d","mappings":[{"from":1,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8},{"from":5,"to":7}]},{"pgid":"3.28","mappings":[{"from":3,"to":6},{"from":5,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/586423689":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6801/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6800/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/3270371628":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/515676743":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/1475107314":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/553289143":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/3403361612":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6801/1587363880":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6800/1587363880":"2024-09-14T17:04:24.083789+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:11:50.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.093+0000 7fc27179c640 1 -- 172.21.15.87:0/467167976 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc2580a1120 msgr2=0x7fc2580a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:50.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.093+0000 7fc27179c640 1 --2- 172.21.15.87:0/467167976 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc2580a1120 0x7fc2580a35e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc26c1092d0 tx=0x7fc25400a4c0 comp rx=0 tx=0).stop 2024-09-13T17:11:50.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.093+0000 7fc27179c640 1 -- 172.21.15.87:0/467167976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc26c0feca0 msgr2=0x7fc26c109560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:50.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.093+0000 7fc27179c640 1 --2- 172.21.15.87:0/467167976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc26c0feca0 0x7fc26c109560 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc26400b480 tx=0x7fc26400b940 comp rx=0 tx=0).stop 2024-09-13T17:11:50.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.093+0000 7fc27179c640 1 -- 172.21.15.87:0/467167976 shutdown_connections 2024-09-13T17:11:50.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.093+0000 7fc27179c640 1 --2- 172.21.15.87:0/467167976 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc2580a1120 0x7fc2580a35e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:50.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.093+0000 7fc27179c640 1 --2- 172.21.15.87:0/467167976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc26c100850 0x7fc26c1080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:50.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.093+0000 7fc27179c640 1 --2- 172.21.15.87:0/467167976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc26c0ffe90 0x7fc26c107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:50.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.093+0000 7fc27179c640 1 --2- 172.21.15.87:0/467167976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc26c0feca0 0x7fc26c109560 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:50.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.093+0000 7fc27179c640 1 -- 172.21.15.87:0/467167976 >> 172.21.15.87:0/467167976 conn(0x7fc26c0fa400 msgr2=0x7fc26c103300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:50.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.093+0000 7fc27179c640 1 -- 172.21.15.87:0/467167976 shutdown_connections 2024-09-13T17:11:50.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.093+0000 7fc27179c640 1 -- 172.21.15.87:0/467167976 wait complete. 2024-09-13T17:11:50.105 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T17:11:50.105 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:11:50.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.204+0000 7fc169096640 1 -- 172.21.15.87:0/2214039482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1640feca0 msgr2=0x7fc1640ff0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:50.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.204+0000 7fc169096640 1 --2- 172.21.15.87:0/2214039482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1640feca0 0x7fc1640ff0a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc154009900 tx=0x7fc15402a410 comp rx=0 tx=0).stop 2024-09-13T17:11:50.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.204+0000 7fc169096640 1 -- 172.21.15.87:0/2214039482 shutdown_connections 2024-09-13T17:11:50.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.204+0000 7fc169096640 1 --2- 172.21.15.87:0/2214039482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc164100850 0x7fc1641070e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:50.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.204+0000 7fc169096640 1 --2- 172.21.15.87:0/2214039482 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1640ffe90 0x7fc164100310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:50.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.204+0000 7fc169096640 1 --2- 172.21.15.87:0/2214039482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1640feca0 0x7fc1640ff0a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:50.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.204+0000 7fc169096640 1 -- 172.21.15.87:0/2214039482 >> 172.21.15.87:0/2214039482 conn(0x7fc1640fa440 msgr2=0x7fc1640fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:50.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.204+0000 7fc169096640 1 -- 172.21.15.87:0/2214039482 shutdown_connections 2024-09-13T17:11:50.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.204+0000 7fc169096640 1 -- 172.21.15.87:0/2214039482 wait complete. 2024-09-13T17:11:50.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.205+0000 7fc169096640 1 Processor -- start 2024-09-13T17:11:50.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.205+0000 7fc169096640 1 -- start start 2024-09-13T17:11:50.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.205+0000 7fc169096640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1640feca0 0x7fc164109560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:50.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.205+0000 7fc169096640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1640ffe90 0x7fc164107ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:50.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.205+0000 7fc169096640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc164100850 0x7fc1641080e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:50.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.205+0000 7fc169096640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc164108840 con 0x7fc164100850 2024-09-13T17:11:50.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.205+0000 7fc169096640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1641089b0 con 0x7fc1640feca0 2024-09-13T17:11:50.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.205+0000 7fc169096640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16419feb0 con 0x7fc1640ffe90 2024-09-13T17:11:50.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.205+0000 7fc16359e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc164100850 0x7fc1641080e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:50.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.205+0000 7fc16359e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc164100850 0x7fc1641080e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45510/0 (socket says 172.21.15.87:45510) 2024-09-13T17:11:50.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.205+0000 7fc16359e640 1 -- 172.21.15.87:0/603605444 learned_addr learned my addr 172.21.15.87:0/603605444 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:50.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.206+0000 7fc162d9d640 1 --2- 172.21.15.87:0/603605444 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1640feca0 0x7fc164109560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:50.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.206+0000 7fc16259c640 1 --2- 172.21.15.87:0/603605444 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1640ffe90 0x7fc164107ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:50.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.206+0000 7fc16359e640 1 -- 172.21.15.87:0/603605444 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1640ffe90 msgr2=0x7fc164107ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:50.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.206+0000 7fc16359e640 1 --2- 172.21.15.87:0/603605444 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1640ffe90 0x7fc164107ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:50.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.206+0000 7fc16359e640 1 -- 172.21.15.87:0/603605444 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1640feca0 msgr2=0x7fc164109560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:50.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.206+0000 7fc16359e640 1 --2- 172.21.15.87:0/603605444 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1640feca0 0x7fc164109560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:50.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.206+0000 7fc16359e640 1 -- 172.21.15.87:0/603605444 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc154009560 con 0x7fc164100850 2024-09-13T17:11:50.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.206+0000 7fc162d9d640 1 --2- 172.21.15.87:0/603605444 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1640feca0 0x7fc164109560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:11:50.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.206+0000 7fc16259c640 1 --2- 172.21.15.87:0/603605444 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1640ffe90 0x7fc164107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:11:50.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.206+0000 7fc16359e640 1 --2- 172.21.15.87:0/603605444 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc164100850 0x7fc1641080e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc15c00db20 tx=0x7fc15c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:50.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.206+0000 7fc14bfff640 1 -- 172.21.15.87:0/603605444 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15c00bea0 con 0x7fc164100850 2024-09-13T17:11:50.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.206+0000 7fc14bfff640 1 -- 172.21.15.87:0/603605444 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc15c009940 con 0x7fc164100850 2024-09-13T17:11:50.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.206+0000 7fc169096640 1 -- 172.21.15.87:0/603605444 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1641a0160 con 0x7fc164100850 2024-09-13T17:11:50.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.206+0000 7fc14bfff640 1 -- 172.21.15.87:0/603605444 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15c0106c0 con 0x7fc164100850 2024-09-13T17:11:50.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.206+0000 7fc169096640 1 -- 172.21.15.87:0/603605444 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1641a0620 con 0x7fc164100850 2024-09-13T17:11:50.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.207+0000 7fc169096640 1 -- 172.21.15.87:0/603605444 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc164106220 con 0x7fc164100850 2024-09-13T17:11:50.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.208+0000 7fc14bfff640 1 -- 172.21.15.87:0/603605444 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fc15c004a40 con 0x7fc164100850 2024-09-13T17:11:50.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.209+0000 7fc14bfff640 1 --2- 172.21.15.87:0/603605444 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc14c0a1120 0x7fc14c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:50.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.209+0000 7fc162d9d640 1 --2- 172.21.15.87:0/603605444 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc14c0a1120 0x7fc14c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:50.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.209+0000 7fc14bfff640 1 -- 172.21.15.87:0/603605444 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8978+0+0 (secure 0 0 0) 0x7fc15c0ccba0 con 0x7fc164100850 2024-09-13T17:11:50.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.209+0000 7fc162d9d640 1 --2- 172.21.15.87:0/603605444 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc14c0a1120 0x7fc14c0a35e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc154006010 tx=0x7fc154000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:50.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.216+0000 7fc14bfff640 1 -- 172.21.15.87:0/603605444 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc15c095ee0 con 0x7fc164100850 2024-09-13T17:11:50.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.382+0000 7fc169096640 1 -- 172.21.15.87:0/603605444 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc1640608f0 con 0x7fc14c0a1120 2024-09-13T17:11:50.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.394+0000 7fc14bfff640 1 -- 172.21.15.87:0/603605444 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+424210 (secure 0 0 0) 0x7fc1640608f0 con 0x7fc14c0a1120 2024-09-13T17:11:50.401 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:11:50.403 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-13T17:11:50.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.398+0000 7fc169096640 1 -- 172.21.15.87:0/603605444 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc14c0a1120 msgr2=0x7fc14c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:50.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.398+0000 7fc169096640 1 --2- 172.21.15.87:0/603605444 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc14c0a1120 0x7fc14c0a35e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc154006010 tx=0x7fc154000bc0 comp rx=0 tx=0).stop 2024-09-13T17:11:50.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.398+0000 7fc169096640 1 -- 172.21.15.87:0/603605444 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc164100850 msgr2=0x7fc1641080e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:50.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.398+0000 7fc169096640 1 --2- 172.21.15.87:0/603605444 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc164100850 0x7fc1641080e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc15c00db20 tx=0x7fc15c00b260 comp rx=0 tx=0).stop 2024-09-13T17:11:50.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.398+0000 7fc169096640 1 -- 172.21.15.87:0/603605444 shutdown_connections 2024-09-13T17:11:50.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.398+0000 7fc169096640 1 --2- 172.21.15.87:0/603605444 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc14c0a1120 0x7fc14c0a35e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:50.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.398+0000 7fc169096640 1 --2- 172.21.15.87:0/603605444 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc164100850 0x7fc1641080e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:50.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.398+0000 7fc169096640 1 --2- 172.21.15.87:0/603605444 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1640ffe90 0x7fc164107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:50.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.398+0000 7fc169096640 1 --2- 172.21.15.87:0/603605444 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1640feca0 0x7fc164109560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:50.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.398+0000 7fc169096640 1 -- 172.21.15.87:0/603605444 >> 172.21.15.87:0/603605444 conn(0x7fc1640fa440 msgr2=0x7fc1641033f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:50.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.398+0000 7fc169096640 1 -- 172.21.15.87:0/603605444 shutdown_connections 2024-09-13T17:11:50.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.398+0000 7fc169096640 1 -- 172.21.15.87:0/603605444 wait complete. 2024-09-13T17:11:50.410 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:50 smithi087 ceph-mon[30934]: from='client.14895 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:11:50.410 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:50 smithi087 ceph-mon[30934]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:11:50.410 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:50 smithi087 ceph-mon[30934]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:11:50.410 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:50 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2151712949' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:50.410 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:50 smithi087 ceph-mon[30934]: osdmap e91: 12 total, 12 up, 12 in 2024-09-13T17:11:50.410 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:50 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/467167976' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:11:50.411 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-09-13T17:11:50.074276+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":634361,"num_objects":56,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":159,"num_read_kb":159,"num_write":307,"num_write_kb":3021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376888,"kb_used_data":11704,"kb_used_omap":18,"kb_used_meta":365037,"kb_avail":1124564936,"statfs":{"total":1151940427776,"available":1151554494464,"internally_reserved":0,"allocated":11984896,"data_stored":7591761,"data_compressed":261610,"data_compressed_allocated":348160,"data_compressed_original":2195456,"omap_allocated":19109,"internal_metadata":373798235},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":39400,"num_objects":32,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":23,"num_read_kb":40,"num_write":78,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002224"},"pg_stats":[{"pgid":"2.1f","version":"89'9","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.181045+0000","last_change":"2024-09-13T17:11:22.998997+0000","last_active":"2024-09-13T17:11:47.181045+0000","last_peered":"2024-09-13T17:11:47.181045+0000","last_clean":"2024-09-13T17:11:47.181045+0000","last_became_active":"2024-09-13T17:11:22.998674+0000","last_became_peered":"2024-09-13T17:11:22.998674+0000","last_unstale":"2024-09-13T17:11:47.181045+0000","last_undegraded":"2024-09-13T17:11:47.181045+0000","last_fullsized":"2024-09-13T17:11:47.181045+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:30:50.554788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.348929+0000","last_change":"2024-09-13T17:11:23.340108+0000","last_active":"2024-09-13T17:11:27.348929+0000","last_peered":"2024-09-13T17:11:27.348929+0000","last_clean":"2024-09-13T17:11:27.348929+0000","last_became_active":"2024-09-13T17:11:23.339832+0000","last_became_peered":"2024-09-13T17:11:23.339832+0000","last_unstale":"2024-09-13T17:11:27.348929+0000","last_undegraded":"2024-09-13T17:11:27.348929+0000","last_fullsized":"2024-09-13T17:11:27.348929+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:40.969448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.683504+0000","last_change":"2024-09-13T17:11:27.358090+0000","last_active":"2024-09-13T17:11:27.683504+0000","last_peered":"2024-09-13T17:11:27.683504+0000","last_clean":"2024-09-13T17:11:27.683504+0000","last_became_active":"2024-09-13T17:11:27.357725+0000","last_became_peered":"2024-09-13T17:11:27.357725+0000","last_unstale":"2024-09-13T17:11:27.683504+0000","last_undegraded":"2024-09-13T17:11:27.683504+0000","last_fullsized":"2024-09-13T17:11:27.683504+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:51.617457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'1","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.349083+0000","last_change":"2024-09-13T17:11:23.000779+0000","last_active":"2024-09-13T17:11:27.349083+0000","last_peered":"2024-09-13T17:11:27.349083+0000","last_clean":"2024-09-13T17:11:27.349083+0000","last_became_active":"2024-09-13T17:11:23.000511+0000","last_became_peered":"2024-09-13T17:11:23.000511+0000","last_unstale":"2024-09-13T17:11:27.349083+0000","last_undegraded":"2024-09-13T17:11:27.349083+0000","last_fullsized":"2024-09-13T17:11:27.349083+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:09.802392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.833095+0000","last_change":"2024-09-13T17:11:23.333948+0000","last_active":"2024-09-13T17:11:27.833095+0000","last_peered":"2024-09-13T17:11:27.833095+0000","last_clean":"2024-09-13T17:11:27.833095+0000","last_became_active":"2024-09-13T17:11:23.333679+0000","last_became_peered":"2024-09-13T17:11:23.333679+0000","last_unstale":"2024-09-13T17:11:27.833095+0000","last_undegraded":"2024-09-13T17:11:27.833095+0000","last_fullsized":"2024-09-13T17:11:27.833095+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:10.265157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537784+0000","last_change":"2024-09-13T17:11:27.353767+0000","last_active":"2024-09-13T17:11:29.537784+0000","last_peered":"2024-09-13T17:11:29.537784+0000","last_clean":"2024-09-13T17:11:29.537784+0000","last_became_active":"2024-09-13T17:11:27.353448+0000","last_became_peered":"2024-09-13T17:11:27.353448+0000","last_unstale":"2024-09-13T17:11:29.537784+0000","last_undegraded":"2024-09-13T17:11:29.537784+0000","last_fullsized":"2024-09-13T17:11:29.537784+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:15.948099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.178059+0000","last_change":"2024-09-13T17:11:22.999879+0000","last_active":"2024-09-13T17:11:47.178059+0000","last_peered":"2024-09-13T17:11:47.178059+0000","last_clean":"2024-09-13T17:11:47.178059+0000","last_became_active":"2024-09-13T17:11:22.999577+0000","last_became_peered":"2024-09-13T17:11:22.999577+0000","last_unstale":"2024-09-13T17:11:47.178059+0000","last_undegraded":"2024-09-13T17:11:47.178059+0000","last_fullsized":"2024-09-13T17:11:47.178059+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:48.485532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.346469+0000","last_change":"2024-09-13T17:11:23.339026+0000","last_active":"2024-09-13T17:11:27.346469+0000","last_peered":"2024-09-13T17:11:27.346469+0000","last_clean":"2024-09-13T17:11:27.346469+0000","last_became_active":"2024-09-13T17:11:23.338745+0000","last_became_peered":"2024-09-13T17:11:23.338745+0000","last_unstale":"2024-09-13T17:11:27.346469+0000","last_undegraded":"2024-09-13T17:11:27.346469+0000","last_fullsized":"2024-09-13T17:11:27.346469+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:27.455418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537867+0000","last_change":"2024-09-13T17:11:27.363137+0000","last_active":"2024-09-13T17:11:29.537867+0000","last_peered":"2024-09-13T17:11:29.537867+0000","last_clean":"2024-09-13T17:11:29.537867+0000","last_became_active":"2024-09-13T17:11:27.362621+0000","last_became_peered":"2024-09-13T17:11:27.362621+0000","last_unstale":"2024-09-13T17:11:29.537867+0000","last_undegraded":"2024-09-13T17:11:29.537867+0000","last_fullsized":"2024-09-13T17:11:29.537867+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:35:51.492630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.352962+0000","last_change":"2024-09-13T17:11:22.998066+0000","last_active":"2024-09-13T17:11:27.352962+0000","last_peered":"2024-09-13T17:11:27.352962+0000","last_clean":"2024-09-13T17:11:27.352962+0000","last_became_active":"2024-09-13T17:11:22.997741+0000","last_became_peered":"2024-09-13T17:11:22.997741+0000","last_unstale":"2024-09-13T17:11:27.352962+0000","last_undegraded":"2024-09-13T17:11:27.352962+0000","last_fullsized":"2024-09-13T17:11:27.352962+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:00.353453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.357913+0000","last_change":"2024-09-13T17:11:23.336778+0000","last_active":"2024-09-13T17:11:27.357913+0000","last_peered":"2024-09-13T17:11:27.357913+0000","last_clean":"2024-09-13T17:11:27.357913+0000","last_became_active":"2024-09-13T17:11:23.336491+0000","last_became_peered":"2024-09-13T17:11:23.336491+0000","last_unstale":"2024-09-13T17:11:27.357913+0000","last_undegraded":"2024-09-13T17:11:27.357913+0000","last_fullsized":"2024-09-13T17:11:27.357913+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:02.045912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537823+0000","last_change":"2024-09-13T17:11:27.361454+0000","last_active":"2024-09-13T17:11:29.537823+0000","last_peered":"2024-09-13T17:11:29.537823+0000","last_clean":"2024-09-13T17:11:29.537823+0000","last_became_active":"2024-09-13T17:11:27.360980+0000","last_became_peered":"2024-09-13T17:11:27.360980+0000","last_unstale":"2024-09-13T17:11:29.537823+0000","last_undegraded":"2024-09-13T17:11:29.537823+0000","last_fullsized":"2024-09-13T17:11:29.537823+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:36.036426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345699+0000","last_change":"2024-09-13T17:11:23.334073+0000","last_active":"2024-09-13T17:11:27.345699+0000","last_peered":"2024-09-13T17:11:27.345699+0000","last_clean":"2024-09-13T17:11:27.345699+0000","last_became_active":"2024-09-13T17:11:23.333628+0000","last_became_peered":"2024-09-13T17:11:23.333628+0000","last_unstale":"2024-09-13T17:11:27.345699+0000","last_undegraded":"2024-09-13T17:11:27.345699+0000","last_fullsized":"2024-09-13T17:11:27.345699+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:18.561346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:46.174718+0000","last_change":"2024-09-13T17:11:22.999115+0000","last_active":"2024-09-13T17:11:46.174718+0000","last_peered":"2024-09-13T17:11:46.174718+0000","last_clean":"2024-09-13T17:11:46.174718+0000","last_became_active":"2024-09-13T17:11:22.998798+0000","last_became_peered":"2024-09-13T17:11:22.998798+0000","last_unstale":"2024-09-13T17:11:46.174718+0000","last_undegraded":"2024-09-13T17:11:46.174718+0000","last_fullsized":"2024-09-13T17:11:46.174718+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:25.263755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537935+0000","last_change":"2024-09-13T17:11:27.355472+0000","last_active":"2024-09-13T17:11:29.537935+0000","last_peered":"2024-09-13T17:11:29.537935+0000","last_clean":"2024-09-13T17:11:29.537935+0000","last_became_active":"2024-09-13T17:11:27.355065+0000","last_became_peered":"2024-09-13T17:11:27.355065+0000","last_unstale":"2024-09-13T17:11:29.537935+0000","last_undegraded":"2024-09-13T17:11:29.537935+0000","last_fullsized":"2024-09-13T17:11:29.537935+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:03.881097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.350859+0000","last_change":"2024-09-13T17:11:23.340268+0000","last_active":"2024-09-13T17:11:27.350859+0000","last_peered":"2024-09-13T17:11:27.350859+0000","last_clean":"2024-09-13T17:11:27.350859+0000","last_became_active":"2024-09-13T17:11:23.339977+0000","last_became_peered":"2024-09-13T17:11:23.339977+0000","last_unstale":"2024-09-13T17:11:27.350859+0000","last_undegraded":"2024-09-13T17:11:27.350859+0000","last_fullsized":"2024-09-13T17:11:27.350859+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:21.067899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.352398+0000","last_change":"2024-09-13T17:11:23.000858+0000","last_active":"2024-09-13T17:11:27.352398+0000","last_peered":"2024-09-13T17:11:27.352398+0000","last_clean":"2024-09-13T17:11:27.352398+0000","last_became_active":"2024-09-13T17:11:23.000536+0000","last_became_peered":"2024-09-13T17:11:23.000536+0000","last_unstale":"2024-09-13T17:11:27.352398+0000","last_undegraded":"2024-09-13T17:11:27.352398+0000","last_fullsized":"2024-09-13T17:11:27.352398+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:28.798579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801541+0000","last_change":"2024-09-13T17:11:27.354018+0000","last_active":"2024-09-13T17:11:48.801541+0000","last_peered":"2024-09-13T17:11:48.801541+0000","last_clean":"2024-09-13T17:11:48.801541+0000","last_became_active":"2024-09-13T17:11:27.353519+0000","last_became_peered":"2024-09-13T17:11:27.353519+0000","last_unstale":"2024-09-13T17:11:48.801541+0000","last_undegraded":"2024-09-13T17:11:48.801541+0000","last_fullsized":"2024-09-13T17:11:48.801541+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:55.227851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801000+0000","last_change":"2024-09-13T17:11:23.335798+0000","last_active":"2024-09-13T17:11:48.801000+0000","last_peered":"2024-09-13T17:11:48.801000+0000","last_clean":"2024-09-13T17:11:48.801000+0000","last_became_active":"2024-09-13T17:11:23.335445+0000","last_became_peered":"2024-09-13T17:11:23.335445+0000","last_unstale":"2024-09-13T17:11:48.801000+0000","last_undegraded":"2024-09-13T17:11:48.801000+0000","last_fullsized":"2024-09-13T17:11:48.801000+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:53.242067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.349338+0000","last_change":"2024-09-13T17:11:22.994118+0000","last_active":"2024-09-13T17:11:27.349338+0000","last_peered":"2024-09-13T17:11:27.349338+0000","last_clean":"2024-09-13T17:11:27.349338+0000","last_became_active":"2024-09-13T17:11:22.993801+0000","last_became_peered":"2024-09-13T17:11:22.993801+0000","last_unstale":"2024-09-13T17:11:27.349338+0000","last_undegraded":"2024-09-13T17:11:27.349338+0000","last_fullsized":"2024-09-13T17:11:27.349338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:01.382130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.557452+0000","last_change":"2024-09-13T17:11:27.358795+0000","last_active":"2024-09-13T17:11:27.557452+0000","last_peered":"2024-09-13T17:11:27.557452+0000","last_clean":"2024-09-13T17:11:27.557452+0000","last_became_active":"2024-09-13T17:11:27.358166+0000","last_became_peered":"2024-09-13T17:11:27.358166+0000","last_unstale":"2024-09-13T17:11:27.557452+0000","last_undegraded":"2024-09-13T17:11:27.557452+0000","last_fullsized":"2024-09-13T17:11:27.557452+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:23.787842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.353077+0000","last_change":"2024-09-13T17:11:23.340671+0000","last_active":"2024-09-13T17:11:27.353077+0000","last_peered":"2024-09-13T17:11:27.353077+0000","last_clean":"2024-09-13T17:11:27.353077+0000","last_became_active":"2024-09-13T17:11:23.340360+0000","last_became_peered":"2024-09-13T17:11:23.340360+0000","last_unstale":"2024-09-13T17:11:27.353077+0000","last_undegraded":"2024-09-13T17:11:27.353077+0000","last_fullsized":"2024-09-13T17:11:27.353077+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:17.875171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344679+0000","last_change":"2024-09-13T17:11:22.993039+0000","last_active":"2024-09-13T17:11:27.344679+0000","last_peered":"2024-09-13T17:11:27.344679+0000","last_clean":"2024-09-13T17:11:27.344679+0000","last_became_active":"2024-09-13T17:11:22.992701+0000","last_became_peered":"2024-09-13T17:11:22.992701+0000","last_unstale":"2024-09-13T17:11:27.344679+0000","last_undegraded":"2024-09-13T17:11:27.344679+0000","last_fullsized":"2024-09-13T17:11:27.344679+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:28.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537946+0000","last_change":"2024-09-13T17:11:27.363834+0000","last_active":"2024-09-13T17:11:29.537946+0000","last_peered":"2024-09-13T17:11:29.537946+0000","last_clean":"2024-09-13T17:11:29.537946+0000","last_became_active":"2024-09-13T17:11:27.363425+0000","last_became_peered":"2024-09-13T17:11:27.363425+0000","last_unstale":"2024-09-13T17:11:29.537946+0000","last_undegraded":"2024-09-13T17:11:29.537946+0000","last_fullsized":"2024-09-13T17:11:29.537946+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:37.389881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832858+0000","last_change":"2024-09-13T17:11:23.337423+0000","last_active":"2024-09-13T17:11:27.832858+0000","last_peered":"2024-09-13T17:11:27.832858+0000","last_clean":"2024-09-13T17:11:27.832858+0000","last_became_active":"2024-09-13T17:11:23.337167+0000","last_became_peered":"2024-09-13T17:11:23.337167+0000","last_unstale":"2024-09-13T17:11:27.832858+0000","last_undegraded":"2024-09-13T17:11:27.832858+0000","last_fullsized":"2024-09-13T17:11:27.832858+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:28.540283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:46.175903+0000","last_change":"2024-09-13T17:11:23.000486+0000","last_active":"2024-09-13T17:11:46.175903+0000","last_peered":"2024-09-13T17:11:46.175903+0000","last_clean":"2024-09-13T17:11:46.175903+0000","last_became_active":"2024-09-13T17:11:23.000158+0000","last_became_peered":"2024-09-13T17:11:23.000158+0000","last_unstale":"2024-09-13T17:11:46.175903+0000","last_undegraded":"2024-09-13T17:11:46.175903+0000","last_fullsized":"2024-09-13T17:11:46.175903+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:42.635037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.683527+0000","last_change":"2024-09-13T17:11:27.355058+0000","last_active":"2024-09-13T17:11:27.683527+0000","last_peered":"2024-09-13T17:11:27.683527+0000","last_clean":"2024-09-13T17:11:27.683527+0000","last_became_active":"2024-09-13T17:11:27.354726+0000","last_became_peered":"2024-09-13T17:11:27.354726+0000","last_unstale":"2024-09-13T17:11:27.683527+0000","last_undegraded":"2024-09-13T17:11:27.683527+0000","last_fullsized":"2024-09-13T17:11:27.683527+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:58.450122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.353872+0000","last_change":"2024-09-13T17:11:23.337245+0000","last_active":"2024-09-13T17:11:27.353872+0000","last_peered":"2024-09-13T17:11:27.353872+0000","last_clean":"2024-09-13T17:11:27.353872+0000","last_became_active":"2024-09-13T17:11:23.336956+0000","last_became_peered":"2024-09-13T17:11:23.336956+0000","last_unstale":"2024-09-13T17:11:27.353872+0000","last_undegraded":"2024-09-13T17:11:27.353872+0000","last_fullsized":"2024-09-13T17:11:27.353872+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:46.876149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'3","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.179427+0000","last_change":"2024-09-13T17:11:22.999942+0000","last_active":"2024-09-13T17:11:47.179427+0000","last_peered":"2024-09-13T17:11:47.179427+0000","last_clean":"2024-09-13T17:11:47.179427+0000","last_became_active":"2024-09-13T17:11:22.999653+0000","last_became_peered":"2024-09-13T17:11:22.999653+0000","last_unstale":"2024-09-13T17:11:47.179427+0000","last_undegraded":"2024-09-13T17:11:47.179427+0000","last_fullsized":"2024-09-13T17:11:47.179427+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:29.400939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832619+0000","last_change":"2024-09-13T17:11:27.356479+0000","last_active":"2024-09-13T17:11:27.832619+0000","last_peered":"2024-09-13T17:11:27.832619+0000","last_clean":"2024-09-13T17:11:27.832619+0000","last_became_active":"2024-09-13T17:11:27.356052+0000","last_became_peered":"2024-09-13T17:11:27.356052+0000","last_unstale":"2024-09-13T17:11:27.832619+0000","last_undegraded":"2024-09-13T17:11:27.832619+0000","last_fullsized":"2024-09-13T17:11:27.832619+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:42.173376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344659+0000","last_change":"2024-09-13T17:11:23.333786+0000","last_active":"2024-09-13T17:11:27.344659+0000","last_peered":"2024-09-13T17:11:27.344659+0000","last_clean":"2024-09-13T17:11:27.344659+0000","last_became_active":"2024-09-13T17:11:23.333472+0000","last_became_peered":"2024-09-13T17:11:23.333472+0000","last_unstale":"2024-09-13T17:11:27.344659+0000","last_undegraded":"2024-09-13T17:11:27.344659+0000","last_fullsized":"2024-09-13T17:11:27.344659+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:41.633228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:46.175724+0000","last_change":"2024-09-13T17:11:22.998646+0000","last_active":"2024-09-13T17:11:46.175724+0000","last_peered":"2024-09-13T17:11:46.175724+0000","last_clean":"2024-09-13T17:11:46.175724+0000","last_became_active":"2024-09-13T17:11:22.998291+0000","last_became_peered":"2024-09-13T17:11:22.998291+0000","last_unstale":"2024-09-13T17:11:46.175724+0000","last_undegraded":"2024-09-13T17:11:46.175724+0000","last_fullsized":"2024-09-13T17:11:46.175724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:20.658436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801089+0000","last_change":"2024-09-13T17:11:27.361174+0000","last_active":"2024-09-13T17:11:48.801089+0000","last_peered":"2024-09-13T17:11:48.801089+0000","last_clean":"2024-09-13T17:11:48.801089+0000","last_became_active":"2024-09-13T17:11:27.360737+0000","last_became_peered":"2024-09-13T17:11:27.360737+0000","last_unstale":"2024-09-13T17:11:48.801089+0000","last_undegraded":"2024-09-13T17:11:48.801089+0000","last_fullsized":"2024-09-13T17:11:48.801089+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:00.941364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.834435+0000","last_change":"2024-09-13T17:11:23.338545+0000","last_active":"2024-09-13T17:11:27.834435+0000","last_peered":"2024-09-13T17:11:27.834435+0000","last_clean":"2024-09-13T17:11:27.834435+0000","last_became_active":"2024-09-13T17:11:23.338246+0000","last_became_peered":"2024-09-13T17:11:23.338246+0000","last_unstale":"2024-09-13T17:11:27.834435+0000","last_undegraded":"2024-09-13T17:11:27.834435+0000","last_fullsized":"2024-09-13T17:11:27.834435+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:18.966658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.341243+0000","last_change":"2024-09-13T17:11:22.993497+0000","last_active":"2024-09-13T17:11:27.341243+0000","last_peered":"2024-09-13T17:11:27.341243+0000","last_clean":"2024-09-13T17:11:27.341243+0000","last_became_active":"2024-09-13T17:11:22.993165+0000","last_became_peered":"2024-09-13T17:11:22.993165+0000","last_unstale":"2024-09-13T17:11:27.341243+0000","last_undegraded":"2024-09-13T17:11:27.341243+0000","last_fullsized":"2024-09-13T17:11:27.341243+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:20.997834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832905+0000","last_change":"2024-09-13T17:11:27.364652+0000","last_active":"2024-09-13T17:11:27.832905+0000","last_peered":"2024-09-13T17:11:27.832905+0000","last_clean":"2024-09-13T17:11:27.832905+0000","last_became_active":"2024-09-13T17:11:27.364245+0000","last_became_peered":"2024-09-13T17:11:27.364245+0000","last_unstale":"2024-09-13T17:11:27.832905+0000","last_undegraded":"2024-09-13T17:11:27.832905+0000","last_fullsized":"2024-09-13T17:11:27.832905+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:23.048289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.834356+0000","last_change":"2024-09-13T17:11:23.335649+0000","last_active":"2024-09-13T17:11:27.834356+0000","last_peered":"2024-09-13T17:11:27.834356+0000","last_clean":"2024-09-13T17:11:27.834356+0000","last_became_active":"2024-09-13T17:11:23.335364+0000","last_became_peered":"2024-09-13T17:11:23.335364+0000","last_unstale":"2024-09-13T17:11:27.834356+0000","last_undegraded":"2024-09-13T17:11:27.834356+0000","last_fullsized":"2024-09-13T17:11:27.834356+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.447947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.684957+0000","last_change":"2024-09-13T17:11:23.003188+0000","last_active":"2024-09-13T17:11:27.684957+0000","last_peered":"2024-09-13T17:11:27.684957+0000","last_clean":"2024-09-13T17:11:27.684957+0000","last_became_active":"2024-09-13T17:11:23.002858+0000","last_became_peered":"2024-09-13T17:11:23.002858+0000","last_unstale":"2024-09-13T17:11:27.684957+0000","last_undegraded":"2024-09-13T17:11:27.684957+0000","last_fullsized":"2024-09-13T17:11:27.684957+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:34.153326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832969+0000","last_change":"2024-09-13T17:11:27.353320+0000","last_active":"2024-09-13T17:11:27.832969+0000","last_peered":"2024-09-13T17:11:27.832969+0000","last_clean":"2024-09-13T17:11:27.832969+0000","last_became_active":"2024-09-13T17:11:27.352947+0000","last_became_peered":"2024-09-13T17:11:27.352947+0000","last_unstale":"2024-09-13T17:11:27.832969+0000","last_undegraded":"2024-09-13T17:11:27.832969+0000","last_fullsized":"2024-09-13T17:11:27.832969+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:04.619618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.354952+0000","last_change":"2024-09-13T17:11:23.330128+0000","last_active":"2024-09-13T17:11:27.354952+0000","last_peered":"2024-09-13T17:11:27.354952+0000","last_clean":"2024-09-13T17:11:27.354952+0000","last_became_active":"2024-09-13T17:11:23.329266+0000","last_became_peered":"2024-09-13T17:11:23.329266+0000","last_unstale":"2024-09-13T17:11:27.354952+0000","last_undegraded":"2024-09-13T17:11:27.354952+0000","last_fullsized":"2024-09-13T17:11:27.354952+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:36.275352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344307+0000","last_change":"2024-09-13T17:11:23.003495+0000","last_active":"2024-09-13T17:11:27.344307+0000","last_peered":"2024-09-13T17:11:27.344307+0000","last_clean":"2024-09-13T17:11:27.344307+0000","last_became_active":"2024-09-13T17:11:23.003186+0000","last_became_peered":"2024-09-13T17:11:23.003186+0000","last_unstale":"2024-09-13T17:11:27.344307+0000","last_undegraded":"2024-09-13T17:11:27.344307+0000","last_fullsized":"2024-09-13T17:11:27.344307+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:23.353587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832748+0000","last_change":"2024-09-13T17:11:27.362233+0000","last_active":"2024-09-13T17:11:27.832748+0000","last_peered":"2024-09-13T17:11:27.832748+0000","last_clean":"2024-09-13T17:11:27.832748+0000","last_became_active":"2024-09-13T17:11:27.361814+0000","last_became_peered":"2024-09-13T17:11:27.361814+0000","last_unstale":"2024-09-13T17:11:27.832748+0000","last_undegraded":"2024-09-13T17:11:27.832748+0000","last_fullsized":"2024-09-13T17:11:27.832748+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:20.723366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344130+0000","last_change":"2024-09-13T17:11:23.332870+0000","last_active":"2024-09-13T17:11:27.344130+0000","last_peered":"2024-09-13T17:11:27.344130+0000","last_clean":"2024-09-13T17:11:27.344130+0000","last_became_active":"2024-09-13T17:11:23.332583+0000","last_became_peered":"2024-09-13T17:11:23.332583+0000","last_unstale":"2024-09-13T17:11:27.344130+0000","last_undegraded":"2024-09-13T17:11:27.344130+0000","last_fullsized":"2024-09-13T17:11:27.344130+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:22.607666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.176932+0000","last_change":"2024-09-13T17:11:23.001932+0000","last_active":"2024-09-13T17:11:47.176932+0000","last_peered":"2024-09-13T17:11:47.176932+0000","last_clean":"2024-09-13T17:11:47.176932+0000","last_became_active":"2024-09-13T17:11:23.001642+0000","last_became_peered":"2024-09-13T17:11:23.001642+0000","last_unstale":"2024-09-13T17:11:47.176932+0000","last_undegraded":"2024-09-13T17:11:47.176932+0000","last_fullsized":"2024-09-13T17:11:47.176932+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:05.976897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.360313+0000","last_change":"2024-09-13T17:11:27.359679+0000","last_active":"2024-09-13T17:11:27.360313+0000","last_peered":"2024-09-13T17:11:27.360313+0000","last_clean":"2024-09-13T17:11:27.360313+0000","last_became_active":"2024-09-13T17:11:27.359268+0000","last_became_peered":"2024-09-13T17:11:27.359268+0000","last_unstale":"2024-09-13T17:11:27.360313+0000","last_undegraded":"2024-09-13T17:11:27.360313+0000","last_fullsized":"2024-09-13T17:11:27.360313+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:48.154917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.350643+0000","last_change":"2024-09-13T17:11:23.340031+0000","last_active":"2024-09-13T17:11:27.350643+0000","last_peered":"2024-09-13T17:11:27.350643+0000","last_clean":"2024-09-13T17:11:27.350643+0000","last_became_active":"2024-09-13T17:11:23.339768+0000","last_became_peered":"2024-09-13T17:11:23.339768+0000","last_unstale":"2024-09-13T17:11:27.350643+0000","last_undegraded":"2024-09-13T17:11:27.350643+0000","last_fullsized":"2024-09-13T17:11:27.350643+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:22.360526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.788033+0000","last_change":"2024-09-13T17:11:22.995060+0000","last_active":"2024-09-13T17:11:47.788033+0000","last_peered":"2024-09-13T17:11:47.788033+0000","last_clean":"2024-09-13T17:11:47.788033+0000","last_became_active":"2024-09-13T17:11:22.991949+0000","last_became_peered":"2024-09-13T17:11:22.991949+0000","last_unstale":"2024-09-13T17:11:47.788033+0000","last_undegraded":"2024-09-13T17:11:47.788033+0000","last_fullsized":"2024-09-13T17:11:47.788033+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:44.716753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":338,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345590+0000","last_change":"2024-09-13T17:10:13.439723+0000","last_active":"2024-09-13T17:11:27.345590+0000","last_peered":"2024-09-13T17:11:27.345590+0000","last_clean":"2024-09-13T17:11:27.345590+0000","last_became_active":"2024-09-13T17:10:13.439290+0000","last_became_peered":"2024-09-13T17:10:13.439290+0000","last_unstale":"2024-09-13T17:11:27.345590+0000","last_undegraded":"2024-09-13T17:11:27.345590+0000","last_fullsized":"2024-09-13T17:11:27.345590+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:03.041486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:03.041486+0000","last_clean_scrub_stamp":"2024-09-13T17:07:03.041486+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:08.673571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:28.497337+0000","last_change":"2024-09-13T17:11:27.361028+0000","last_active":"2024-09-13T17:11:28.497337+0000","last_peered":"2024-09-13T17:11:28.497337+0000","last_clean":"2024-09-13T17:11:28.497337+0000","last_became_active":"2024-09-13T17:11:27.360630+0000","last_became_peered":"2024-09-13T17:11:27.360630+0000","last_unstale":"2024-09-13T17:11:28.497337+0000","last_undegraded":"2024-09-13T17:11:28.497337+0000","last_fullsized":"2024-09-13T17:11:28.497337+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:40:40.860443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.346553+0000","last_change":"2024-09-13T17:11:23.346138+0000","last_active":"2024-09-13T17:11:27.346553+0000","last_peered":"2024-09-13T17:11:27.346553+0000","last_clean":"2024-09-13T17:11:27.346553+0000","last_became_active":"2024-09-13T17:11:23.345855+0000","last_became_peered":"2024-09-13T17:11:23.345855+0000","last_unstale":"2024-09-13T17:11:27.346553+0000","last_undegraded":"2024-09-13T17:11:27.346553+0000","last_fullsized":"2024-09-13T17:11:27.346553+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:02.391726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":2,"reported_epoch":90,"state":"peering","last_fresh":"2024-09-13T17:11:27.684094+0000","last_change":"2024-09-13T17:11:49.540357+0000","last_active":"2024-09-13T17:11:49.540357+0000","last_peered":"2024-09-13T17:11:27.684094+0000","last_clean":"2024-09-13T17:11:27.684094+0000","last_became_active":"2024-09-13T17:11:23.003102+0000","last_became_peered":"2024-09-13T17:11:23.003102+0000","last_unstale":"2024-09-13T17:11:27.684094+0000","last_undegraded":"2024-09-13T17:11:27.684094+0000","last_fullsized":"2024-09-13T17:11:27.684094+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:08.827045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832402+0000","last_change":"2024-09-13T17:11:27.360372+0000","last_active":"2024-09-13T17:11:27.832402+0000","last_peered":"2024-09-13T17:11:27.832402+0000","last_clean":"2024-09-13T17:11:27.832402+0000","last_became_active":"2024-09-13T17:11:27.359990+0000","last_became_peered":"2024-09-13T17:11:27.359990+0000","last_unstale":"2024-09-13T17:11:27.832402+0000","last_undegraded":"2024-09-13T17:11:27.832402+0000","last_fullsized":"2024-09-13T17:11:27.832402+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:26.970317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344659+0000","last_change":"2024-09-13T17:11:23.336269+0000","last_active":"2024-09-13T17:11:27.344659+0000","last_peered":"2024-09-13T17:11:27.344659+0000","last_clean":"2024-09-13T17:11:27.344659+0000","last_became_active":"2024-09-13T17:11:23.335921+0000","last_became_peered":"2024-09-13T17:11:23.335921+0000","last_unstale":"2024-09-13T17:11:27.344659+0000","last_undegraded":"2024-09-13T17:11:27.344659+0000","last_fullsized":"2024-09-13T17:11:27.344659+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:43.035927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.358089+0000","last_change":"2024-09-13T17:11:23.002491+0000","last_active":"2024-09-13T17:11:27.358089+0000","last_peered":"2024-09-13T17:11:27.358089+0000","last_clean":"2024-09-13T17:11:27.358089+0000","last_became_active":"2024-09-13T17:11:23.002178+0000","last_became_peered":"2024-09-13T17:11:23.002178+0000","last_unstale":"2024-09-13T17:11:27.358089+0000","last_undegraded":"2024-09-13T17:11:27.358089+0000","last_fullsized":"2024-09-13T17:11:27.358089+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:06.056639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.108773+0000","last_change":"2024-09-13T17:11:27.355153+0000","last_active":"2024-09-13T17:11:29.108773+0000","last_peered":"2024-09-13T17:11:29.108773+0000","last_clean":"2024-09-13T17:11:29.108773+0000","last_became_active":"2024-09-13T17:11:27.354701+0000","last_became_peered":"2024-09-13T17:11:27.354701+0000","last_unstale":"2024-09-13T17:11:29.108773+0000","last_undegraded":"2024-09-13T17:11:29.108773+0000","last_fullsized":"2024-09-13T17:11:29.108773+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:34.924402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345209+0000","last_change":"2024-09-13T17:11:23.342067+0000","last_active":"2024-09-13T17:11:27.345209+0000","last_peered":"2024-09-13T17:11:27.345209+0000","last_clean":"2024-09-13T17:11:27.345209+0000","last_became_active":"2024-09-13T17:11:23.341736+0000","last_became_peered":"2024-09-13T17:11:23.341736+0000","last_unstale":"2024-09-13T17:11:27.345209+0000","last_undegraded":"2024-09-13T17:11:27.345209+0000","last_fullsized":"2024-09-13T17:11:27.345209+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:03.114638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345020+0000","last_change":"2024-09-13T17:11:23.002849+0000","last_active":"2024-09-13T17:11:27.345020+0000","last_peered":"2024-09-13T17:11:27.345020+0000","last_clean":"2024-09-13T17:11:27.345020+0000","last_became_active":"2024-09-13T17:11:23.002562+0000","last_became_peered":"2024-09-13T17:11:23.002562+0000","last_unstale":"2024-09-13T17:11:27.345020+0000","last_undegraded":"2024-09-13T17:11:27.345020+0000","last_fullsized":"2024-09-13T17:11:27.345020+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:11:24.650510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.360269+0000","last_change":"2024-09-13T17:11:27.359343+0000","last_active":"2024-09-13T17:11:27.360269+0000","last_peered":"2024-09-13T17:11:27.360269+0000","last_clean":"2024-09-13T17:11:27.360269+0000","last_became_active":"2024-09-13T17:11:27.358628+0000","last_became_peered":"2024-09-13T17:11:27.358628+0000","last_unstale":"2024-09-13T17:11:27.360269+0000","last_undegraded":"2024-09-13T17:11:27.360269+0000","last_fullsized":"2024-09-13T17:11:27.360269+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:39.584184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801190+0000","last_change":"2024-09-13T17:11:23.333111+0000","last_active":"2024-09-13T17:11:48.801190+0000","last_peered":"2024-09-13T17:11:48.801190+0000","last_clean":"2024-09-13T17:11:48.801190+0000","last_became_active":"2024-09-13T17:11:23.332734+0000","last_became_peered":"2024-09-13T17:11:23.332734+0000","last_unstale":"2024-09-13T17:11:48.801190+0000","last_undegraded":"2024-09-13T17:11:48.801190+0000","last_fullsized":"2024-09-13T17:11:48.801190+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:44.628106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"84'1","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832752+0000","last_change":"2024-09-13T17:11:23.000759+0000","last_active":"2024-09-13T17:11:27.832752+0000","last_peered":"2024-09-13T17:11:27.832752+0000","last_clean":"2024-09-13T17:11:27.832752+0000","last_became_active":"2024-09-13T17:11:23.000463+0000","last_became_peered":"2024-09-13T17:11:23.000463+0000","last_unstale":"2024-09-13T17:11:27.832752+0000","last_undegraded":"2024-09-13T17:11:27.832752+0000","last_fullsized":"2024-09-13T17:11:27.832752+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:59.077194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.364961+0000","last_change":"2024-09-13T17:11:27.363076+0000","last_active":"2024-09-13T17:11:27.364961+0000","last_peered":"2024-09-13T17:11:27.364961+0000","last_clean":"2024-09-13T17:11:27.364961+0000","last_became_active":"2024-09-13T17:11:27.362642+0000","last_became_peered":"2024-09-13T17:11:27.362642+0000","last_unstale":"2024-09-13T17:11:27.364961+0000","last_undegraded":"2024-09-13T17:11:27.364961+0000","last_fullsized":"2024-09-13T17:11:27.364961+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:25.494875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.355452+0000","last_change":"2024-09-13T17:11:23.336703+0000","last_active":"2024-09-13T17:11:27.355452+0000","last_peered":"2024-09-13T17:11:27.355452+0000","last_clean":"2024-09-13T17:11:27.355452+0000","last_became_active":"2024-09-13T17:11:23.336349+0000","last_became_peered":"2024-09-13T17:11:23.336349+0000","last_unstale":"2024-09-13T17:11:27.355452+0000","last_undegraded":"2024-09-13T17:11:27.355452+0000","last_fullsized":"2024-09-13T17:11:27.355452+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:28.671438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.178750+0000","last_change":"2024-09-13T17:11:22.994382+0000","last_active":"2024-09-13T17:11:47.178750+0000","last_peered":"2024-09-13T17:11:47.178750+0000","last_clean":"2024-09-13T17:11:47.178750+0000","last_became_active":"2024-09-13T17:11:22.994037+0000","last_became_peered":"2024-09-13T17:11:22.994037+0000","last_unstale":"2024-09-13T17:11:47.178750+0000","last_undegraded":"2024-09-13T17:11:47.178750+0000","last_fullsized":"2024-09-13T17:11:47.178750+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:10.763757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.833042+0000","last_change":"2024-09-13T17:11:27.354351+0000","last_active":"2024-09-13T17:11:27.833042+0000","last_peered":"2024-09-13T17:11:27.833042+0000","last_clean":"2024-09-13T17:11:27.833042+0000","last_became_active":"2024-09-13T17:11:27.353715+0000","last_became_peered":"2024-09-13T17:11:27.353715+0000","last_unstale":"2024-09-13T17:11:27.833042+0000","last_undegraded":"2024-09-13T17:11:27.833042+0000","last_fullsized":"2024-09-13T17:11:27.833042+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:18.335183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345355+0000","last_change":"2024-09-13T17:11:23.341743+0000","last_active":"2024-09-13T17:11:27.345355+0000","last_peered":"2024-09-13T17:11:27.345355+0000","last_clean":"2024-09-13T17:11:27.345355+0000","last_became_active":"2024-09-13T17:11:23.341200+0000","last_became_peered":"2024-09-13T17:11:23.341200+0000","last_unstale":"2024-09-13T17:11:27.345355+0000","last_undegraded":"2024-09-13T17:11:27.345355+0000","last_fullsized":"2024-09-13T17:11:27.345355+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:41.854013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'3","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.800911+0000","last_change":"2024-09-13T17:11:22.997571+0000","last_active":"2024-09-13T17:11:48.800911+0000","last_peered":"2024-09-13T17:11:48.800911+0000","last_clean":"2024-09-13T17:11:48.800911+0000","last_became_active":"2024-09-13T17:11:22.997238+0000","last_became_peered":"2024-09-13T17:11:22.997238+0000","last_unstale":"2024-09-13T17:11:48.800911+0000","last_undegraded":"2024-09-13T17:11:48.800911+0000","last_fullsized":"2024-09-13T17:11:48.800911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:34.533004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.557470+0000","last_change":"2024-09-13T17:11:27.356892+0000","last_active":"2024-09-13T17:11:27.557470+0000","last_peered":"2024-09-13T17:11:27.557470+0000","last_clean":"2024-09-13T17:11:27.557470+0000","last_became_active":"2024-09-13T17:11:27.356136+0000","last_became_peered":"2024-09-13T17:11:27.356136+0000","last_unstale":"2024-09-13T17:11:27.557470+0000","last_undegraded":"2024-09-13T17:11:27.557470+0000","last_fullsized":"2024-09-13T17:11:27.557470+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:23.207064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345098+0000","last_change":"2024-09-13T17:11:23.337666+0000","last_active":"2024-09-13T17:11:27.345098+0000","last_peered":"2024-09-13T17:11:27.345098+0000","last_clean":"2024-09-13T17:11:27.345098+0000","last_became_active":"2024-09-13T17:11:23.337185+0000","last_became_peered":"2024-09-13T17:11:23.337185+0000","last_unstale":"2024-09-13T17:11:27.345098+0000","last_undegraded":"2024-09-13T17:11:27.345098+0000","last_fullsized":"2024-09-13T17:11:27.345098+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:51.266709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:46.175759+0000","last_change":"2024-09-13T17:11:23.005075+0000","last_active":"2024-09-13T17:11:46.175759+0000","last_peered":"2024-09-13T17:11:46.175759+0000","last_clean":"2024-09-13T17:11:46.175759+0000","last_became_active":"2024-09-13T17:11:23.004778+0000","last_became_peered":"2024-09-13T17:11:23.004778+0000","last_unstale":"2024-09-13T17:11:46.175759+0000","last_undegraded":"2024-09-13T17:11:46.175759+0000","last_fullsized":"2024-09-13T17:11:46.175759+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:06.763552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801204+0000","last_change":"2024-09-13T17:11:27.353601+0000","last_active":"2024-09-13T17:11:48.801204+0000","last_peered":"2024-09-13T17:11:48.801204+0000","last_clean":"2024-09-13T17:11:48.801204+0000","last_became_active":"2024-09-13T17:11:27.353190+0000","last_became_peered":"2024-09-13T17:11:27.353190+0000","last_unstale":"2024-09-13T17:11:48.801204+0000","last_undegraded":"2024-09-13T17:11:48.801204+0000","last_fullsized":"2024-09-13T17:11:48.801204+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:24.645552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344760+0000","last_change":"2024-09-13T17:11:23.333592+0000","last_active":"2024-09-13T17:11:27.344760+0000","last_peered":"2024-09-13T17:11:27.344760+0000","last_clean":"2024-09-13T17:11:27.344760+0000","last_became_active":"2024-09-13T17:11:23.333306+0000","last_became_peered":"2024-09-13T17:11:23.333306+0000","last_unstale":"2024-09-13T17:11:27.344760+0000","last_undegraded":"2024-09-13T17:11:27.344760+0000","last_fullsized":"2024-09-13T17:11:27.344760+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:26.813987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.177595+0000","last_change":"2024-09-13T17:11:23.005619+0000","last_active":"2024-09-13T17:11:47.177595+0000","last_peered":"2024-09-13T17:11:47.177595+0000","last_clean":"2024-09-13T17:11:47.177595+0000","last_became_active":"2024-09-13T17:11:23.005077+0000","last_became_peered":"2024-09-13T17:11:23.005077+0000","last_unstale":"2024-09-13T17:11:47.177595+0000","last_undegraded":"2024-09-13T17:11:47.177595+0000","last_fullsized":"2024-09-13T17:11:47.177595+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:51.739773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.365375+0000","last_change":"2024-09-13T17:11:27.364603+0000","last_active":"2024-09-13T17:11:27.365375+0000","last_peered":"2024-09-13T17:11:27.365375+0000","last_clean":"2024-09-13T17:11:27.365375+0000","last_became_active":"2024-09-13T17:11:27.364226+0000","last_became_peered":"2024-09-13T17:11:27.364226+0000","last_unstale":"2024-09-13T17:11:27.365375+0000","last_undegraded":"2024-09-13T17:11:27.365375+0000","last_fullsized":"2024-09-13T17:11:27.365375+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:56.802016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.352784+0000","last_change":"2024-09-13T17:11:23.338657+0000","last_active":"2024-09-13T17:11:27.352784+0000","last_peered":"2024-09-13T17:11:27.352784+0000","last_clean":"2024-09-13T17:11:27.352784+0000","last_became_active":"2024-09-13T17:11:23.338377+0000","last_became_peered":"2024-09-13T17:11:23.338377+0000","last_unstale":"2024-09-13T17:11:27.352784+0000","last_undegraded":"2024-09-13T17:11:27.352784+0000","last_fullsized":"2024-09-13T17:11:27.352784+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:52.412887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'23","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.114064+0000","last_change":"2024-09-13T17:11:22.998541+0000","last_active":"2024-09-13T17:11:49.114064+0000","last_peered":"2024-09-13T17:11:49.114064+0000","last_clean":"2024-09-13T17:11:49.114064+0000","last_became_active":"2024-09-13T17:11:22.998132+0000","last_became_peered":"2024-09-13T17:11:22.998132+0000","last_unstale":"2024-09-13T17:11:49.114064+0000","last_undegraded":"2024-09-13T17:11:49.114064+0000","last_fullsized":"2024-09-13T17:11:49.114064+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:16.777772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40425,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":26,"num_write":24,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.557394+0000","last_change":"2024-09-13T17:11:27.361917+0000","last_active":"2024-09-13T17:11:27.557394+0000","last_peered":"2024-09-13T17:11:27.557394+0000","last_clean":"2024-09-13T17:11:27.557394+0000","last_became_active":"2024-09-13T17:11:27.361503+0000","last_became_peered":"2024-09-13T17:11:27.361503+0000","last_unstale":"2024-09-13T17:11:27.557394+0000","last_undegraded":"2024-09-13T17:11:27.557394+0000","last_fullsized":"2024-09-13T17:11:27.557394+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:52.959017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.346573+0000","last_change":"2024-09-13T17:11:23.343648+0000","last_active":"2024-09-13T17:11:27.346573+0000","last_peered":"2024-09-13T17:11:27.346573+0000","last_clean":"2024-09-13T17:11:27.346573+0000","last_became_active":"2024-09-13T17:11:23.343183+0000","last_became_peered":"2024-09-13T17:11:23.343183+0000","last_unstale":"2024-09-13T17:11:27.346573+0000","last_undegraded":"2024-09-13T17:11:27.346573+0000","last_fullsized":"2024-09-13T17:11:27.346573+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:32:49.585628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.833035+0000","last_change":"2024-09-13T17:11:23.004059+0000","last_active":"2024-09-13T17:11:27.833035+0000","last_peered":"2024-09-13T17:11:27.833035+0000","last_clean":"2024-09-13T17:11:27.833035+0000","last_became_active":"2024-09-13T17:11:23.003248+0000","last_became_peered":"2024-09-13T17:11:23.003248+0000","last_unstale":"2024-09-13T17:11:27.833035+0000","last_undegraded":"2024-09-13T17:11:27.833035+0000","last_fullsized":"2024-09-13T17:11:27.833035+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:05.496872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537877+0000","last_change":"2024-09-13T17:11:27.362880+0000","last_active":"2024-09-13T17:11:29.537877+0000","last_peered":"2024-09-13T17:11:29.537877+0000","last_clean":"2024-09-13T17:11:29.537877+0000","last_became_active":"2024-09-13T17:11:27.362471+0000","last_became_peered":"2024-09-13T17:11:27.362471+0000","last_unstale":"2024-09-13T17:11:29.537877+0000","last_undegraded":"2024-09-13T17:11:29.537877+0000","last_fullsized":"2024-09-13T17:11:29.537877+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:49.964606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"peering","last_fresh":"2024-09-13T17:11:48.798762+0000","last_change":"2024-09-13T17:11:48.798906+0000","last_active":"2024-09-13T17:11:48.798762+0000","last_peered":"2024-09-13T17:11:27.833117+0000","last_clean":"2024-09-13T17:11:27.833117+0000","last_became_active":"2024-09-13T17:11:23.332871+0000","last_became_peered":"2024-09-13T17:11:23.332871+0000","last_unstale":"2024-09-13T17:11:48.798762+0000","last_undegraded":"2024-09-13T17:11:48.798762+0000","last_fullsized":"2024-09-13T17:11:48.798762+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:27.370999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,7],"acting":[0,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,5,7,8],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:46.176492+0000","last_change":"2024-09-13T17:11:22.999158+0000","last_active":"2024-09-13T17:11:46.176492+0000","last_peered":"2024-09-13T17:11:46.176492+0000","last_clean":"2024-09-13T17:11:46.176492+0000","last_became_active":"2024-09-13T17:11:22.998795+0000","last_became_peered":"2024-09-13T17:11:22.998795+0000","last_unstale":"2024-09-13T17:11:46.176492+0000","last_undegraded":"2024-09-13T17:11:46.176492+0000","last_fullsized":"2024-09-13T17:11:46.176492+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:23.880769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.557331+0000","last_change":"2024-09-13T17:11:27.358105+0000","last_active":"2024-09-13T17:11:27.557331+0000","last_peered":"2024-09-13T17:11:27.557331+0000","last_clean":"2024-09-13T17:11:27.557331+0000","last_became_active":"2024-09-13T17:11:27.357740+0000","last_became_peered":"2024-09-13T17:11:27.357740+0000","last_unstale":"2024-09-13T17:11:27.557331+0000","last_undegraded":"2024-09-13T17:11:27.557331+0000","last_fullsized":"2024-09-13T17:11:27.557331+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:44.837353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345210+0000","last_change":"2024-09-13T17:11:23.338736+0000","last_active":"2024-09-13T17:11:27.345210+0000","last_peered":"2024-09-13T17:11:27.345210+0000","last_clean":"2024-09-13T17:11:27.345210+0000","last_became_active":"2024-09-13T17:11:23.338462+0000","last_became_peered":"2024-09-13T17:11:23.338462+0000","last_unstale":"2024-09-13T17:11:27.345210+0000","last_undegraded":"2024-09-13T17:11:27.345210+0000","last_fullsized":"2024-09-13T17:11:27.345210+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:49.221314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'3","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.800595+0000","last_change":"2024-09-13T17:11:23.001966+0000","last_active":"2024-09-13T17:11:48.800595+0000","last_peered":"2024-09-13T17:11:48.800595+0000","last_clean":"2024-09-13T17:11:48.800595+0000","last_became_active":"2024-09-13T17:11:23.001565+0000","last_became_peered":"2024-09-13T17:11:23.001565+0000","last_unstale":"2024-09-13T17:11:48.800595+0000","last_undegraded":"2024-09-13T17:11:48.800595+0000","last_fullsized":"2024-09-13T17:11:48.800595+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:47.240702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.833316+0000","last_change":"2024-09-13T17:11:27.360896+0000","last_active":"2024-09-13T17:11:27.833316+0000","last_peered":"2024-09-13T17:11:27.833316+0000","last_clean":"2024-09-13T17:11:27.833316+0000","last_became_active":"2024-09-13T17:11:27.360552+0000","last_became_peered":"2024-09-13T17:11:27.360552+0000","last_unstale":"2024-09-13T17:11:27.833316+0000","last_undegraded":"2024-09-13T17:11:27.833316+0000","last_fullsized":"2024-09-13T17:11:27.833316+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:08.726724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.108810+0000","last_change":"2024-09-13T17:11:27.356317+0000","last_active":"2024-09-13T17:11:29.108810+0000","last_peered":"2024-09-13T17:11:29.108810+0000","last_clean":"2024-09-13T17:11:29.108810+0000","last_became_active":"2024-09-13T17:11:27.355863+0000","last_became_peered":"2024-09-13T17:11:27.355863+0000","last_unstale":"2024-09-13T17:11:29.108810+0000","last_undegraded":"2024-09-13T17:11:29.108810+0000","last_fullsized":"2024-09-13T17:11:29.108810+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:29.356048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.557362+0000","last_change":"2024-09-13T17:11:23.344929+0000","last_active":"2024-09-13T17:11:27.557362+0000","last_peered":"2024-09-13T17:11:27.557362+0000","last_clean":"2024-09-13T17:11:27.557362+0000","last_became_active":"2024-09-13T17:11:23.344627+0000","last_became_peered":"2024-09-13T17:11:23.344627+0000","last_unstale":"2024-09-13T17:11:27.557362+0000","last_undegraded":"2024-09-13T17:11:27.557362+0000","last_fullsized":"2024-09-13T17:11:27.557362+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:15.049627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832206+0000","last_change":"2024-09-13T17:11:23.002539+0000","last_active":"2024-09-13T17:11:27.832206+0000","last_peered":"2024-09-13T17:11:27.832206+0000","last_clean":"2024-09-13T17:11:27.832206+0000","last_became_active":"2024-09-13T17:11:23.002206+0000","last_became_peered":"2024-09-13T17:11:23.002206+0000","last_unstale":"2024-09-13T17:11:27.832206+0000","last_undegraded":"2024-09-13T17:11:27.832206+0000","last_fullsized":"2024-09-13T17:11:27.832206+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:57.708167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801253+0000","last_change":"2024-09-13T17:11:27.362667+0000","last_active":"2024-09-13T17:11:48.801253+0000","last_peered":"2024-09-13T17:11:48.801253+0000","last_clean":"2024-09-13T17:11:48.801253+0000","last_became_active":"2024-09-13T17:11:27.362293+0000","last_became_peered":"2024-09-13T17:11:27.362293+0000","last_unstale":"2024-09-13T17:11:48.801253+0000","last_undegraded":"2024-09-13T17:11:48.801253+0000","last_fullsized":"2024-09-13T17:11:48.801253+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:24.446951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.349858+0000","last_change":"2024-09-13T17:11:23.335823+0000","last_active":"2024-09-13T17:11:27.349858+0000","last_peered":"2024-09-13T17:11:27.349858+0000","last_clean":"2024-09-13T17:11:27.349858+0000","last_became_active":"2024-09-13T17:11:23.335491+0000","last_became_peered":"2024-09-13T17:11:23.335491+0000","last_unstale":"2024-09-13T17:11:27.349858+0000","last_undegraded":"2024-09-13T17:11:27.349858+0000","last_fullsized":"2024-09-13T17:11:27.349858+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:42.172559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344221+0000","last_change":"2024-09-13T17:11:22.999477+0000","last_active":"2024-09-13T17:11:27.344221+0000","last_peered":"2024-09-13T17:11:27.344221+0000","last_clean":"2024-09-13T17:11:27.344221+0000","last_became_active":"2024-09-13T17:11:22.999175+0000","last_became_peered":"2024-09-13T17:11:22.999175+0000","last_unstale":"2024-09-13T17:11:27.344221+0000","last_undegraded":"2024-09-13T17:11:27.344221+0000","last_fullsized":"2024-09-13T17:11:27.344221+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:03.817508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.178558+0000","last_change":"2024-09-13T17:11:23.001737+0000","last_active":"2024-09-13T17:11:47.178558+0000","last_peered":"2024-09-13T17:11:47.178558+0000","last_clean":"2024-09-13T17:11:47.178558+0000","last_became_active":"2024-09-13T17:11:23.001296+0000","last_became_peered":"2024-09-13T17:11:23.001296+0000","last_unstale":"2024-09-13T17:11:47.178558+0000","last_undegraded":"2024-09-13T17:11:47.178558+0000","last_fullsized":"2024-09-13T17:11:47.178558+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:08.671244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.356028+0000","last_change":"2024-09-13T17:11:23.337738+0000","last_active":"2024-09-13T17:11:27.356028+0000","last_peered":"2024-09-13T17:11:27.356028+0000","last_clean":"2024-09-13T17:11:27.356028+0000","last_became_active":"2024-09-13T17:11:23.337411+0000","last_became_peered":"2024-09-13T17:11:23.337411+0000","last_unstale":"2024-09-13T17:11:27.356028+0000","last_undegraded":"2024-09-13T17:11:27.356028+0000","last_fullsized":"2024-09-13T17:11:27.356028+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:02.355706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.683948+0000","last_change":"2024-09-13T17:11:27.363174+0000","last_active":"2024-09-13T17:11:27.683948+0000","last_peered":"2024-09-13T17:11:27.683948+0000","last_clean":"2024-09-13T17:11:27.683948+0000","last_became_active":"2024-09-13T17:11:27.362158+0000","last_became_peered":"2024-09-13T17:11:27.362158+0000","last_unstale":"2024-09-13T17:11:27.683948+0000","last_undegraded":"2024-09-13T17:11:27.683948+0000","last_fullsized":"2024-09-13T17:11:27.683948+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:49:52.892616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'5","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:46.177022+0000","last_change":"2024-09-13T17:11:23.000544+0000","last_active":"2024-09-13T17:11:46.177022+0000","last_peered":"2024-09-13T17:11:46.177022+0000","last_clean":"2024-09-13T17:11:46.177022+0000","last_became_active":"2024-09-13T17:11:23.000233+0000","last_became_peered":"2024-09-13T17:11:23.000233+0000","last_unstale":"2024-09-13T17:11:46.177022+0000","last_undegraded":"2024-09-13T17:11:46.177022+0000","last_fullsized":"2024-09-13T17:11:46.177022+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:04.745950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.352666+0000","last_change":"2024-09-13T17:11:23.340104+0000","last_active":"2024-09-13T17:11:27.352666+0000","last_peered":"2024-09-13T17:11:27.352666+0000","last_clean":"2024-09-13T17:11:27.352666+0000","last_became_active":"2024-09-13T17:11:23.339826+0000","last_became_peered":"2024-09-13T17:11:23.339826+0000","last_unstale":"2024-09-13T17:11:27.352666+0000","last_undegraded":"2024-09-13T17:11:27.352666+0000","last_fullsized":"2024-09-13T17:11:27.352666+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:03.101547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.683859+0000","last_change":"2024-09-13T17:11:27.360848+0000","last_active":"2024-09-13T17:11:27.683859+0000","last_peered":"2024-09-13T17:11:27.683859+0000","last_clean":"2024-09-13T17:11:27.683859+0000","last_became_active":"2024-09-13T17:11:27.360416+0000","last_became_peered":"2024-09-13T17:11:27.360416+0000","last_unstale":"2024-09-13T17:11:27.683859+0000","last_undegraded":"2024-09-13T17:11:27.683859+0000","last_fullsized":"2024-09-13T17:11:27.683859+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:06.857649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.800926+0000","last_change":"2024-09-13T17:11:23.334723+0000","last_active":"2024-09-13T17:11:48.800926+0000","last_peered":"2024-09-13T17:11:48.800926+0000","last_clean":"2024-09-13T17:11:48.800926+0000","last_became_active":"2024-09-13T17:11:23.334433+0000","last_became_peered":"2024-09-13T17:11:23.334433+0000","last_unstale":"2024-09-13T17:11:48.800926+0000","last_undegraded":"2024-09-13T17:11:48.800926+0000","last_fullsized":"2024-09-13T17:11:48.800926+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:08.657151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.352210+0000","last_change":"2024-09-13T17:11:23.334882+0000","last_active":"2024-09-13T17:11:27.352210+0000","last_peered":"2024-09-13T17:11:27.352210+0000","last_clean":"2024-09-13T17:11:27.352210+0000","last_became_active":"2024-09-13T17:11:23.334610+0000","last_became_peered":"2024-09-13T17:11:23.334610+0000","last_unstale":"2024-09-13T17:11:27.352210+0000","last_undegraded":"2024-09-13T17:11:27.352210+0000","last_fullsized":"2024-09-13T17:11:27.352210+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:03.932181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.351982+0000","last_change":"2024-09-13T17:11:23.334076+0000","last_active":"2024-09-13T17:11:27.351982+0000","last_peered":"2024-09-13T17:11:27.351982+0000","last_clean":"2024-09-13T17:11:27.351982+0000","last_became_active":"2024-09-13T17:11:23.333801+0000","last_became_peered":"2024-09-13T17:11:23.333801+0000","last_unstale":"2024-09-13T17:11:27.351982+0000","last_undegraded":"2024-09-13T17:11:27.351982+0000","last_fullsized":"2024-09-13T17:11:27.351982+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:07.113045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832811+0000","last_change":"2024-09-13T17:11:23.332306+0000","last_active":"2024-09-13T17:11:27.832811+0000","last_peered":"2024-09-13T17:11:27.832811+0000","last_clean":"2024-09-13T17:11:27.832811+0000","last_became_active":"2024-09-13T17:11:23.331913+0000","last_became_peered":"2024-09-13T17:11:23.331913+0000","last_unstale":"2024-09-13T17:11:27.832811+0000","last_undegraded":"2024-09-13T17:11:27.832811+0000","last_fullsized":"2024-09-13T17:11:27.832811+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:02.927286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344550+0000","last_change":"2024-09-13T17:11:23.335512+0000","last_active":"2024-09-13T17:11:27.344550+0000","last_peered":"2024-09-13T17:11:27.344550+0000","last_clean":"2024-09-13T17:11:27.344550+0000","last_became_active":"2024-09-13T17:11:23.335201+0000","last_became_peered":"2024-09-13T17:11:23.335201+0000","last_unstale":"2024-09-13T17:11:27.344550+0000","last_undegraded":"2024-09-13T17:11:27.344550+0000","last_fullsized":"2024-09-13T17:11:27.344550+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:17.263819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801579+0000","last_change":"2024-09-13T17:11:23.341204+0000","last_active":"2024-09-13T17:11:48.801579+0000","last_peered":"2024-09-13T17:11:48.801579+0000","last_clean":"2024-09-13T17:11:48.801579+0000","last_became_active":"2024-09-13T17:11:23.339848+0000","last_became_peered":"2024-09-13T17:11:23.339848+0000","last_unstale":"2024-09-13T17:11:48.801579+0000","last_undegraded":"2024-09-13T17:11:48.801579+0000","last_fullsized":"2024-09-13T17:11:48.801579+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:15:09.480651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.353662+0000","last_change":"2024-09-13T17:11:23.334741+0000","last_active":"2024-09-13T17:11:27.353662+0000","last_peered":"2024-09-13T17:11:27.353662+0000","last_clean":"2024-09-13T17:11:27.353662+0000","last_became_active":"2024-09-13T17:11:23.334459+0000","last_became_peered":"2024-09-13T17:11:23.334459+0000","last_unstale":"2024-09-13T17:11:27.353662+0000","last_undegraded":"2024-09-13T17:11:27.353662+0000","last_fullsized":"2024-09-13T17:11:27.353662+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:52.379735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.353786+0000","last_change":"2024-09-13T17:11:23.337869+0000","last_active":"2024-09-13T17:11:27.353786+0000","last_peered":"2024-09-13T17:11:27.353786+0000","last_clean":"2024-09-13T17:11:27.353786+0000","last_became_active":"2024-09-13T17:11:23.337581+0000","last_became_peered":"2024-09-13T17:11:23.337581+0000","last_unstale":"2024-09-13T17:11:27.353786+0000","last_undegraded":"2024-09-13T17:11:27.353786+0000","last_fullsized":"2024-09-13T17:11:27.353786+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:49.407474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.354864+0000","last_change":"2024-09-13T17:11:23.337034+0000","last_active":"2024-09-13T17:11:27.354864+0000","last_peered":"2024-09-13T17:11:27.354864+0000","last_clean":"2024-09-13T17:11:27.354864+0000","last_became_active":"2024-09-13T17:11:23.334863+0000","last_became_peered":"2024-09-13T17:11:23.334863+0000","last_unstale":"2024-09-13T17:11:27.354864+0000","last_undegraded":"2024-09-13T17:11:27.354864+0000","last_fullsized":"2024-09-13T17:11:27.354864+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:05.820989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.349144+0000","last_change":"2024-09-13T17:11:23.336713+0000","last_active":"2024-09-13T17:11:27.349144+0000","last_peered":"2024-09-13T17:11:27.349144+0000","last_clean":"2024-09-13T17:11:27.349144+0000","last_became_active":"2024-09-13T17:11:23.336431+0000","last_became_peered":"2024-09-13T17:11:23.336431+0000","last_unstale":"2024-09-13T17:11:27.349144+0000","last_undegraded":"2024-09-13T17:11:27.349144+0000","last_fullsized":"2024-09-13T17:11:27.349144+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:52.709483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345023+0000","last_change":"2024-09-13T17:11:23.340385+0000","last_active":"2024-09-13T17:11:27.345023+0000","last_peered":"2024-09-13T17:11:27.345023+0000","last_clean":"2024-09-13T17:11:27.345023+0000","last_became_active":"2024-09-13T17:11:23.340068+0000","last_became_peered":"2024-09-13T17:11:23.340068+0000","last_unstale":"2024-09-13T17:11:27.345023+0000","last_undegraded":"2024-09-13T17:11:27.345023+0000","last_fullsized":"2024-09-13T17:11:27.345023+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:17.795222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345000+0000","last_change":"2024-09-13T17:11:23.329214+0000","last_active":"2024-09-13T17:11:27.345000+0000","last_peered":"2024-09-13T17:11:27.345000+0000","last_clean":"2024-09-13T17:11:27.345000+0000","last_became_active":"2024-09-13T17:11:23.328747+0000","last_became_peered":"2024-09-13T17:11:23.328747+0000","last_unstale":"2024-09-13T17:11:27.345000+0000","last_undegraded":"2024-09-13T17:11:27.345000+0000","last_fullsized":"2024-09-13T17:11:27.345000+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:11.233652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801419+0000","last_change":"2024-09-13T17:11:23.339854+0000","last_active":"2024-09-13T17:11:48.801419+0000","last_peered":"2024-09-13T17:11:48.801419+0000","last_clean":"2024-09-13T17:11:48.801419+0000","last_became_active":"2024-09-13T17:11:23.339565+0000","last_became_peered":"2024-09-13T17:11:23.339565+0000","last_unstale":"2024-09-13T17:11:48.801419+0000","last_undegraded":"2024-09-13T17:11:48.801419+0000","last_fullsized":"2024-09-13T17:11:48.801419+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:37.161135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.353415+0000","last_change":"2024-09-13T17:11:23.342562+0000","last_active":"2024-09-13T17:11:27.353415+0000","last_peered":"2024-09-13T17:11:27.353415+0000","last_clean":"2024-09-13T17:11:27.353415+0000","last_became_active":"2024-09-13T17:11:23.342256+0000","last_became_peered":"2024-09-13T17:11:23.342256+0000","last_unstale":"2024-09-13T17:11:27.353415+0000","last_undegraded":"2024-09-13T17:11:27.353415+0000","last_fullsized":"2024-09-13T17:11:27.353415+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:30.788242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.557424+0000","last_change":"2024-09-13T17:11:23.342436+0000","last_active":"2024-09-13T17:11:27.557424+0000","last_peered":"2024-09-13T17:11:27.557424+0000","last_clean":"2024-09-13T17:11:27.557424+0000","last_became_active":"2024-09-13T17:11:23.342157+0000","last_became_peered":"2024-09-13T17:11:23.342157+0000","last_unstale":"2024-09-13T17:11:27.557424+0000","last_undegraded":"2024-09-13T17:11:27.557424+0000","last_fullsized":"2024-09-13T17:11:27.557424+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:56.550875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801559+0000","last_change":"2024-09-13T17:11:23.341660+0000","last_active":"2024-09-13T17:11:48.801559+0000","last_peered":"2024-09-13T17:11:48.801559+0000","last_clean":"2024-09-13T17:11:48.801559+0000","last_became_active":"2024-09-13T17:11:23.341102+0000","last_became_peered":"2024-09-13T17:11:23.341102+0000","last_unstale":"2024-09-13T17:11:48.801559+0000","last_undegraded":"2024-09-13T17:11:48.801559+0000","last_fullsized":"2024-09-13T17:11:48.801559+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:00.546907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345956+0000","last_change":"2024-09-13T17:11:23.338064+0000","last_active":"2024-09-13T17:11:27.345956+0000","last_peered":"2024-09-13T17:11:27.345956+0000","last_clean":"2024-09-13T17:11:27.345956+0000","last_became_active":"2024-09-13T17:11:23.337748+0000","last_became_peered":"2024-09-13T17:11:23.337748+0000","last_unstale":"2024-09-13T17:11:27.345956+0000","last_undegraded":"2024-09-13T17:11:27.345956+0000","last_fullsized":"2024-09-13T17:11:27.345956+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:14.281629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832520+0000","last_change":"2024-09-13T17:11:23.335684+0000","last_active":"2024-09-13T17:11:27.832520+0000","last_peered":"2024-09-13T17:11:27.832520+0000","last_clean":"2024-09-13T17:11:27.832520+0000","last_became_active":"2024-09-13T17:11:23.335364+0000","last_became_peered":"2024-09-13T17:11:23.335364+0000","last_unstale":"2024-09-13T17:11:27.832520+0000","last_undegraded":"2024-09-13T17:11:27.832520+0000","last_fullsized":"2024-09-13T17:11:27.832520+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:02.288009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832521+0000","last_change":"2024-09-13T17:11:23.340881+0000","last_active":"2024-09-13T17:11:27.832521+0000","last_peered":"2024-09-13T17:11:27.832521+0000","last_clean":"2024-09-13T17:11:27.832521+0000","last_became_active":"2024-09-13T17:11:23.340575+0000","last_became_peered":"2024-09-13T17:11:23.340575+0000","last_unstale":"2024-09-13T17:11:27.832521+0000","last_undegraded":"2024-09-13T17:11:27.832521+0000","last_fullsized":"2024-09-13T17:11:27.832521+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:40.757703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344905+0000","last_change":"2024-09-13T17:11:23.329039+0000","last_active":"2024-09-13T17:11:27.344905+0000","last_peered":"2024-09-13T17:11:27.344905+0000","last_clean":"2024-09-13T17:11:27.344905+0000","last_became_active":"2024-09-13T17:11:23.328324+0000","last_became_peered":"2024-09-13T17:11:23.328324+0000","last_unstale":"2024-09-13T17:11:27.344905+0000","last_undegraded":"2024-09-13T17:11:27.344905+0000","last_fullsized":"2024-09-13T17:11:27.344905+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:37.882596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.833586+0000","last_change":"2024-09-13T17:11:23.345229+0000","last_active":"2024-09-13T17:11:27.833586+0000","last_peered":"2024-09-13T17:11:27.833586+0000","last_clean":"2024-09-13T17:11:27.833586+0000","last_became_active":"2024-09-13T17:11:23.344883+0000","last_became_peered":"2024-09-13T17:11:23.344883+0000","last_unstale":"2024-09-13T17:11:27.833586+0000","last_undegraded":"2024-09-13T17:11:27.833586+0000","last_fullsized":"2024-09-13T17:11:27.833586+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:47.983382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.346617+0000","last_change":"2024-09-13T17:11:23.346338+0000","last_active":"2024-09-13T17:11:27.346617+0000","last_peered":"2024-09-13T17:11:27.346617+0000","last_clean":"2024-09-13T17:11:27.346617+0000","last_became_active":"2024-09-13T17:11:23.344777+0000","last_became_peered":"2024-09-13T17:11:23.344777+0000","last_unstale":"2024-09-13T17:11:27.346617+0000","last_undegraded":"2024-09-13T17:11:27.346617+0000","last_fullsized":"2024-09-13T17:11:27.346617+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:23.650174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"peering","last_fresh":"2024-09-13T17:11:48.800882+0000","last_change":"2024-09-13T17:11:48.801055+0000","last_active":"2024-09-13T17:11:48.800882+0000","last_peered":"2024-09-13T17:11:27.834681+0000","last_clean":"2024-09-13T17:11:27.834681+0000","last_became_active":"2024-09-13T17:11:23.334660+0000","last_became_peered":"2024-09-13T17:11:23.334660+0000","last_unstale":"2024-09-13T17:11:48.800882+0000","last_undegraded":"2024-09-13T17:11:48.800882+0000","last_fullsized":"2024-09-13T17:11:48.800882+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:32.110092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,4,9],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344818+0000","last_change":"2024-09-13T17:11:23.340478+0000","last_active":"2024-09-13T17:11:27.344818+0000","last_peered":"2024-09-13T17:11:27.344818+0000","last_clean":"2024-09-13T17:11:27.344818+0000","last_became_active":"2024-09-13T17:11:23.339916+0000","last_became_peered":"2024-09-13T17:11:23.339916+0000","last_unstale":"2024-09-13T17:11:27.344818+0000","last_undegraded":"2024-09-13T17:11:27.344818+0000","last_fullsized":"2024-09-13T17:11:27.344818+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:09.477626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.349777+0000","last_change":"2024-09-13T17:11:23.340882+0000","last_active":"2024-09-13T17:11:27.349777+0000","last_peered":"2024-09-13T17:11:27.349777+0000","last_clean":"2024-09-13T17:11:27.349777+0000","last_became_active":"2024-09-13T17:11:23.340413+0000","last_became_peered":"2024-09-13T17:11:23.340413+0000","last_unstale":"2024-09-13T17:11:27.349777+0000","last_undegraded":"2024-09-13T17:11:27.349777+0000","last_fullsized":"2024-09-13T17:11:27.349777+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:49.040015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344555+0000","last_change":"2024-09-13T17:11:23.345551+0000","last_active":"2024-09-13T17:11:27.344555+0000","last_peered":"2024-09-13T17:11:27.344555+0000","last_clean":"2024-09-13T17:11:27.344555+0000","last_became_active":"2024-09-13T17:11:23.345195+0000","last_became_peered":"2024-09-13T17:11:23.345195+0000","last_unstale":"2024-09-13T17:11:27.344555+0000","last_undegraded":"2024-09-13T17:11:27.344555+0000","last_fullsized":"2024-09-13T17:11:27.344555+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:00.856969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"peering","last_fresh":"2024-09-13T17:11:48.799086+0000","last_change":"2024-09-13T17:11:48.799241+0000","last_active":"2024-09-13T17:11:48.799086+0000","last_peered":"2024-09-13T17:11:27.834170+0000","last_clean":"2024-09-13T17:11:27.834170+0000","last_became_active":"2024-09-13T17:11:23.334061+0000","last_became_peered":"2024-09-13T17:11:23.334061+0000","last_unstale":"2024-09-13T17:11:48.799086+0000","last_undegraded":"2024-09-13T17:11:48.799086+0000","last_fullsized":"2024-09-13T17:11:48.799086+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:40.383855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,7,9],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.353081+0000","last_change":"2024-09-13T17:11:23.340286+0000","last_active":"2024-09-13T17:11:27.353081+0000","last_peered":"2024-09-13T17:11:27.353081+0000","last_clean":"2024-09-13T17:11:27.353081+0000","last_became_active":"2024-09-13T17:11:23.339756+0000","last_became_peered":"2024-09-13T17:11:23.339756+0000","last_unstale":"2024-09-13T17:11:27.353081+0000","last_undegraded":"2024-09-13T17:11:27.353081+0000","last_fullsized":"2024-09-13T17:11:27.353081+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:00.463087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.833501+0000","last_change":"2024-09-13T17:11:23.339818+0000","last_active":"2024-09-13T17:11:27.833501+0000","last_peered":"2024-09-13T17:11:27.833501+0000","last_clean":"2024-09-13T17:11:27.833501+0000","last_became_active":"2024-09-13T17:11:23.339501+0000","last_became_peered":"2024-09-13T17:11:23.339501+0000","last_unstale":"2024-09-13T17:11:27.833501+0000","last_undegraded":"2024-09-13T17:11:27.833501+0000","last_fullsized":"2024-09-13T17:11:27.833501+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:36.904004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832723+0000","last_change":"2024-09-13T17:11:23.334388+0000","last_active":"2024-09-13T17:11:27.832723+0000","last_peered":"2024-09-13T17:11:27.832723+0000","last_clean":"2024-09-13T17:11:27.832723+0000","last_became_active":"2024-09-13T17:11:23.333953+0000","last_became_peered":"2024-09-13T17:11:23.333953+0000","last_unstale":"2024-09-13T17:11:27.832723+0000","last_undegraded":"2024-09-13T17:11:27.832723+0000","last_fullsized":"2024-09-13T17:11:27.832723+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:33.929173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832701+0000","last_change":"2024-09-13T17:11:23.338259+0000","last_active":"2024-09-13T17:11:27.832701+0000","last_peered":"2024-09-13T17:11:27.832701+0000","last_clean":"2024-09-13T17:11:27.832701+0000","last_became_active":"2024-09-13T17:11:23.337979+0000","last_became_peered":"2024-09-13T17:11:23.337979+0000","last_unstale":"2024-09-13T17:11:27.832701+0000","last_undegraded":"2024-09-13T17:11:27.832701+0000","last_fullsized":"2024-09-13T17:11:27.832701+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:55.750255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801517+0000","last_change":"2024-09-13T17:11:23.337899+0000","last_active":"2024-09-13T17:11:48.801517+0000","last_peered":"2024-09-13T17:11:48.801517+0000","last_clean":"2024-09-13T17:11:48.801517+0000","last_became_active":"2024-09-13T17:11:23.337626+0000","last_became_peered":"2024-09-13T17:11:23.337626+0000","last_unstale":"2024-09-13T17:11:48.801517+0000","last_undegraded":"2024-09-13T17:11:48.801517+0000","last_fullsized":"2024-09-13T17:11:48.801517+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:14.654852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":43759,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":23,"num_read_kb":40,"num_write":124,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":58679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285958,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383698,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":995328,"data_stored":499901,"data_compressed":17667,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.35499999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.497}]},{"osd":2,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.58199999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.41799999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.50900000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.67700000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":9,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.52000000000000002}]},{"osd":10,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.60599999999999998}]}]},{"osd":10,"up_from":72,"seq":309237645334,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":1105920,"data_stored":1118312,"data_compressed":51052,"data_compressed_allocated":65536,"data_compressed_original":630784,"omap_allocated":1597,"internal_metadata":36043203},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.52200000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.374},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.39700000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.624},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.60899999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.54500000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.443}]},{"osd":6,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.70999999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.51200000000000001}]},{"osd":8,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.50900000000000001}]},{"osd":9,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.67500000000000004}]},{"osd":11,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.746}]}]},{"osd":9,"up_from":67,"seq":287762808858,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":978944,"data_stored":477347,"data_compressed":11720,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1597,"internal_metadata":31848899},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.315}]},{"osd":1,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.503},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.39100000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.40799999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.27100000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.51300000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.39900000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.49299999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.66500000000000004}]},{"osd":8,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.54200000000000004}]},{"osd":10,"last update":"Fri Sep 13 17:11:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.55700000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]}]},{"osd":8,"up_from":59,"seq":253403070496,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":477301,"data_compressed":11720,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67600000000000005,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.65500000000000003,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.67500000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54300000000000004,"15min":0.54400000000000004},"min":{"1min":0.34599999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71799999999999997,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.79900000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.41899999999999998,"15min":0.41799999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.63100000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.441,"15min":0.438},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70899999999999996,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.68999999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.73899999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.81299999999999994}]},{"osd":5,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.753},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53400000000000003,"15min":0.53600000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76700000000000002,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.78000000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.64400000000000002,"15min":0.64900000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.85999999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64700000000000002,"15min":0.64600000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92200000000000004,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90900000000000003,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.94999999999999996}]},{"osd":9,"last update":"Fri Sep 13 17:10:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.873},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.84699999999999998}]},{"osd":10,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.92900000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]}]},{"osd":7,"up_from":51,"seq":219043332132,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":1069019,"data_compressed":48079,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1587,"internal_metadata":27654605},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.39700000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.66200000000000003,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.35799999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.52500000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.35999999999999999,"15min":0.35399999999999998},"min":{"1min":0.25800000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.34999999999999998,"15min":0.34399999999999997},"min":{"1min":0.32200000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.623}]},{"osd":2,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52800000000000002,"15min":0.52100000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.502},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.51400000000000001,"15min":0.50700000000000001},"min":{"1min":0.39100000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.52200000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.51000000000000001,"15min":0.502},"min":{"1min":0.38100000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67500000000000004,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.53400000000000003},"min":{"1min":0.42899999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.81200000000000006}]},{"osd":4,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46200000000000002,"15min":0.45700000000000002},"min":{"1min":0.29899999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.442,"15min":0.439},"min":{"1min":0.31900000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.44500000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.56899999999999995,"15min":0.56200000000000006},"min":{"1min":0.5,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57499999999999996,"15min":0.57199999999999995},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.47799999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.44700000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.59799999999999998,"15min":0.58699999999999997},"min":{"1min":0.45600000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.86599999999999999}]},{"osd":8,"last update":"Fri Sep 13 17:11:31 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.63600000000000001,"15min":0.628},"min":{"1min":0.504,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.65300000000000002,"15min":0.64200000000000002},"min":{"1min":0.47899999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.70299999999999996}]},{"osd":9,"last update":"Fri Sep 13 17:10:49 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.78900000000000003}]},{"osd":10,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.74299999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]}]},{"osd":6,"up_from":46,"seq":197568495656,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":476563,"data_compressed":11720,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.34200000000000003,"15min":0.33500000000000002},"min":{"1min":0.23400000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.373,"15min":0.36899999999999999},"min":{"1min":0.26500000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.57399999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.29899999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.74199999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.63600000000000001,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.47399999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68999999999999995,"5min":1.095,"15min":1.095},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54100000000000004,"15min":0.52600000000000002},"min":{"1min":0.35899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.77300000000000002,"5min":0.877,"15min":0.877},"last":0.67700000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.42199999999999999,"15min":0.41599999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.626,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41799999999999998,"15min":0.41199999999999998},"min":{"1min":0.28199999999999997,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58599999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.40999999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51000000000000001,"15min":0.502},"min":{"1min":0.41199999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71699999999999997,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.39200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76100000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.59599999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.70599999999999996,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59599999999999997,"15min":0.60299999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.73999999999999999,"5min":1.131,"15min":1.131},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.436},{"interface":"front","average":{"1min":0.628,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.71199999999999997}]},{"osd":8,"last update":"Fri Sep 13 17:11:28 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.623,"15min":0.627},"min":{"1min":0.42399999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.85899999999999999,"5min":0.874,"15min":0.874},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.69799999999999995}]},{"osd":9,"last update":"Fri Sep 13 17:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.63300000000000001}]},{"osd":10,"last update":"Fri Sep 13 17:11:12 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.74299999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]}]},{"osd":5,"up_from":38,"seq":163208757293,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":1036288,"data_stored":1068028,"data_compressed":48079,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48399999999999999,"15min":0.47599999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67300000000000004,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48799999999999999,"15min":0.47999999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69499999999999995,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.56299999999999994}]},{"osd":1,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55100000000000005,"15min":0.54400000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68600000000000005,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.371,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.67600000000000005,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.58099999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.377,"15min":0.371},"min":{"1min":0.23499999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.58699999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.378,"15min":0.372},"min":{"1min":0.253,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.59099999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.39700000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50700000000000001,"15min":0.501},"min":{"1min":0.30199999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.69599999999999995,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.63800000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.67300000000000004}]},{"osd":4,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73099999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56999999999999995,"15min":0.56000000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.629}]},{"osd":6,"last update":"Fri Sep 13 17:11:41 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.75},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56100000000000005,"15min":0.56000000000000005},"min":{"1min":0.39100000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.74199999999999999,"5min":0.749,"15min":0.749},"last":0.74199999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.46400000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.44,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.71599999999999997}]},{"osd":8,"last update":"Fri Sep 13 17:11:26 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52500000000000002,"15min":0.53100000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69199999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55800000000000005,"15min":0.56599999999999995},"min":{"1min":0.39800000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.70299999999999996,"5min":0.747,"15min":0.747},"last":0.52000000000000002}]},{"osd":9,"last update":"Fri Sep 13 17:10:47 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.81000000000000005}]},{"osd":10,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.77800000000000002}]}]},{"osd":4,"up_from":33,"seq":141733920819,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36176,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708976,"statfs":{"total":95995035648,"available":95957991424,"internally_reserved":0,"allocated":987136,"data_stored":490408,"data_compressed":14693,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":0.71699999999999997,"15min":0.59099999999999997},"min":{"1min":0.42399999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":15.369999999999999,"5min":15.369999999999999,"15min":15.369999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":1.4950000000000001,"5min":0.68200000000000005,"15min":0.54400000000000004},"min":{"1min":0.45900000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":15.416,"5min":15.416,"15min":15.416},"last":0.35399999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.36499999999999999,"15min":0.35899999999999999},"min":{"1min":0.25900000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38600000000000001},"min":{"1min":0.28699999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.60099999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.34799999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":0.74099999999999999,"15min":0.61699999999999999},"min":{"1min":0.379,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":15.401,"5min":15.401,"15min":15.401},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.52900000000000003,"15min":0.51900000000000002},"min":{"1min":0.39500000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.745,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.47599999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53900000000000003,"15min":0.54900000000000004},"min":{"1min":0.375,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76900000000000002,"5min":1.016,"15min":1.016},"last":0.39100000000000001},{"interface":"front","average":{"1min":1.524,"5min":0.74099999999999999,"15min":0.61699999999999999},"min":{"1min":0.39400000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":15.425000000000001,"5min":15.425000000000001,"15min":15.425000000000001},"last":0.40699999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57299999999999995,"15min":0.56399999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77900000000000003,"5min":1.073,"15min":1.073},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.73399999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.53500000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.54800000000000004,"15min":0.51800000000000002},"min":{"1min":0.40200000000000002,"5min":0.371,"15min":0.371},"max":{"1min":2.6469999999999998,"5min":2.6469999999999998,"15min":2.6469999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57599999999999996,"15min":0.55600000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.45400000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:11:00 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48199999999999998,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69399999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.48299999999999998,"15min":0.47899999999999998},"min":{"1min":0.34399999999999997,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.49399999999999999}]},{"osd":8,"last update":"Fri Sep 13 17:11:26 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.65200000000000002,"15min":0.63900000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.577,"5min":2.577,"15min":2.577},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.65500000000000003,"15min":0.64600000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.60299999999999998}]},{"osd":9,"last update":"Fri Sep 13 17:10:49 2024","interfaces":[{"interface":"back","average":{"1min":1.615,"5min":1.615,"15min":1.615},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":15.448,"5min":15.448,"15min":15.448},"last":0.55500000000000005},{"interface":"front","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":15.385,"5min":15.385,"15min":15.385},"last":0.63}]},{"osd":10,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.51100000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]},{"osd":3,"up_from":25,"seq":107374182454,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":476063,"data_compressed":11720,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34000000000000002,"15min":0.317},"min":{"1min":0.22500000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.34399999999999997,"15min":0.32200000000000001},"min":{"1min":0.23899999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.60899999999999999,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.27400000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52400000000000002,"15min":0.49399999999999999},"min":{"1min":0.32900000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78900000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51200000000000001,"15min":0.48299999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.60999999999999999,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.57199999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51500000000000001,"15min":0.496},"min":{"1min":0.34000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67800000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53800000000000003,"15min":0.50700000000000001},"min":{"1min":0.34200000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.73999999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.58099999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:10:55 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.53000000000000003,"15min":0.51400000000000001},"min":{"1min":0.372,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.625,"5min":0.53200000000000003,"15min":0.50700000000000001},"min":{"1min":0.40500000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.42899999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55900000000000005,"15min":0.55400000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70399999999999996,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.56000000000000005,"15min":0.56100000000000005},"min":{"1min":0.35199999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.754,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.60999999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:11:43 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.45200000000000001,"15min":0.44600000000000001},"min":{"1min":0.28199999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68000000000000005,"5min":0.746,"15min":0.746},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.45700000000000002,"15min":0.443},"min":{"1min":0.29499999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70199999999999996,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.35599999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:11:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58399999999999996,"15min":0.57799999999999996},"min":{"1min":0.42599999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.77500000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.503},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.45500000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.59099999999999997}]},{"osd":8,"last update":"Fri Sep 13 17:10:26 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66400000000000003}]},{"osd":9,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.45200000000000001}]},{"osd":10,"last update":"Fri Sep 13 17:11:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.53300000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]}]},{"osd":2,"up_from":18,"seq":77309411388,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":480693,"data_compressed":11720,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:09 2024","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":0.76600000000000001,"15min":0.73999999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":19.158999999999999,"5min":19.158999999999999,"15min":19.158999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.47599999999999998,"15min":0.46700000000000003},"min":{"1min":0.33700000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68500000000000005,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.57999999999999996}]},{"osd":1,"last update":"Fri Sep 13 17:11:09 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.501,"15min":0.47499999999999998},"min":{"1min":0.38,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68600000000000005,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.498,"15min":0.46800000000000003},"min":{"1min":0.40100000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.92800000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:11:36 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.51900000000000002,"15min":0.5},"min":{"1min":0.41299999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52700000000000002,"15min":0.50600000000000001},"min":{"1min":0.42999999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71899999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.64700000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.51100000000000001},"min":{"1min":0.41499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72199999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.40300000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.65800000000000003,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.79900000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:11:14 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.39900000000000002,"15min":0.39100000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.64500000000000002,"5min":0.747,"15min":0.747},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39800000000000002,"15min":0.39200000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.68799999999999994,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.77800000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:11:38 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54000000000000004},"min":{"1min":0.41699999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68300000000000005,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.875},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.69799999999999995,"15min":0.58699999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82499999999999996,"5min":19.276,"15min":19.276},"last":0.94299999999999995}]},{"osd":7,"last update":"Fri Sep 13 17:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.36699999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76200000000000001,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.41699999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76600000000000001,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.91300000000000003}]},{"osd":8,"last update":"Fri Sep 13 17:11:25 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53700000000000003,"15min":0.53500000000000003},"min":{"1min":0.33100000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76000000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56399999999999995,"15min":0.56100000000000005},"min":{"1min":0.35799999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":1.0309999999999999}]},{"osd":9,"last update":"Fri Sep 13 17:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":19.210999999999999,"5min":19.210999999999999,"15min":19.210999999999999},"last":1.0409999999999999}]},{"osd":10,"last update":"Fri Sep 13 17:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":1.01},{"interface":"front","average":{"1min":1.595,"5min":1.595,"15min":1.595},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":19.242000000000001,"5min":19.242000000000001,"15min":19.242000000000001},"last":1.0529999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":974848,"data_stored":480358,"data_compressed":11720,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:53 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.47799999999999998,"15min":0.46200000000000002},"min":{"1min":0.35199999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.48199999999999998,"15min":0.46500000000000002},"min":{"1min":0.32700000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.65500000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:11:08 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.52800000000000002,"15min":0.504},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.76900000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.52100000000000002,"15min":0.503},"min":{"1min":0.375,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.72199999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:11:37 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70599999999999996,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54700000000000004,"15min":0.52800000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70299999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.70799999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:10:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.39500000000000002,"15min":0.377},"min":{"1min":0.29199999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.38100000000000001,"15min":0.36299999999999999},"min":{"1min":0.26600000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.50600000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:11:21 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.52900000000000003,"15min":0.51300000000000001},"min":{"1min":0.35399999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.52600000000000002,"15min":0.502},"min":{"1min":0.39900000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.78700000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:11:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54000000000000004,"15min":0.52400000000000002},"min":{"1min":0.38500000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73199999999999998,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.59499999999999997,"15min":0.57499999999999996},"min":{"1min":0.45700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.82799999999999996,"5min":0.88,"15min":0.88},"last":0.76500000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:11:00 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.48999999999999999,"15min":0.47599999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.49399999999999999,"15min":0.48399999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.54800000000000004}]},{"osd":8,"last update":"Fri Sep 13 17:11:26 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.626,"15min":0.61699999999999999},"min":{"1min":0.41599999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.67300000000000004,"15min":0.66300000000000003},"min":{"1min":0.44,"5min":0.434,"15min":0.434},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.88200000000000001}]},{"osd":9,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.748}]},{"osd":10,"last update":"Fri Sep 13 17:11:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.86399999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":987136,"data_stored":477768,"data_compressed":11720,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:10:49 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.47299999999999998,"15min":0.46600000000000003},"min":{"1min":0.29899999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.49199999999999999,"15min":0.48099999999999998},"min":{"1min":0.28499999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.59399999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:11:08 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.52100000000000002,"15min":0.505},"min":{"1min":0.374,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77900000000000003,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.501},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.53000000000000003,"15min":0.50700000000000001},"min":{"1min":0.38100000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.624}]},{"osd":3,"last update":"Fri Sep 13 17:10:27 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.40999999999999998,"15min":0.40100000000000002},"min":{"1min":0.23499999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.432},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.39700000000000002,"15min":0.38900000000000001},"min":{"1min":0.26400000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.317}]},{"osd":4,"last update":"Fri Sep 13 17:10:55 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.496,"15min":0.47999999999999998},"min":{"1min":0.34100000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.52100000000000002,"15min":0.503},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Sep 13 17:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52100000000000002,"15min":0.50900000000000001},"min":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82399999999999995,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.54800000000000004,"15min":0.53000000000000003},"min":{"1min":0.42799999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80500000000000005,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.60799999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:11:41 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.433,"15min":0.41799999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.65100000000000002,"5min":0.754,"15min":0.754},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.44800000000000001,"15min":0.42999999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72899999999999998,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.376}]},{"osd":7,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.57999999999999996,"15min":0.57099999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.57599999999999996}]},{"osd":8,"last update":"Fri Sep 13 17:11:30 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.60499999999999998,"15min":0.60699999999999998},"min":{"1min":0.46500000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.77200000000000002,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.65200000000000002,"15min":0.65800000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90200000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.41899999999999998}]},{"osd":9,"last update":"Fri Sep 13 17:10:49 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.44500000000000001}]},{"osd":10,"last update":"Fri Sep 13 17:11:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.58499999999999996}]},{"osd":11,"last update":"Fri Sep 13 17:11:36 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.53700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34721,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34721,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34721,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":41955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:11:50.421 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:11:50.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.549+0000 7ffb05e87640 1 -- 172.21.15.87:0/2051053654 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb00100850 msgr2=0x7ffb001070e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:50.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.549+0000 7ffb05e87640 1 --2- 172.21.15.87:0/2051053654 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb00100850 0x7ffb001070e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8009ca0 tx=0x7ffaf802a8c0 comp rx=0 tx=0).stop 2024-09-13T17:11:50.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.549+0000 7ffb05e87640 1 -- 172.21.15.87:0/2051053654 shutdown_connections 2024-09-13T17:11:50.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.549+0000 7ffb05e87640 1 --2- 172.21.15.87:0/2051053654 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb00100850 0x7ffb001070e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:50.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.549+0000 7ffb05e87640 1 --2- 172.21.15.87:0/2051053654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb000ffe90 0x7ffb00100310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:50.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.549+0000 7ffb05e87640 1 --2- 172.21.15.87:0/2051053654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb000feca0 0x7ffb000ff0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:50.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.549+0000 7ffb05e87640 1 -- 172.21.15.87:0/2051053654 >> 172.21.15.87:0/2051053654 conn(0x7ffb000fa440 msgr2=0x7ffb000fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:50.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.549+0000 7ffb05e87640 1 -- 172.21.15.87:0/2051053654 shutdown_connections 2024-09-13T17:11:50.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.549+0000 7ffb05e87640 1 -- 172.21.15.87:0/2051053654 wait complete. 2024-09-13T17:11:50.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.550+0000 7ffb05e87640 1 Processor -- start 2024-09-13T17:11:50.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.550+0000 7ffb05e87640 1 -- start start 2024-09-13T17:11:50.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.550+0000 7ffb05e87640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb000feca0 0x7ffb00068150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:50.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.550+0000 7ffb05e87640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb000ffe90 0x7ffb0019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:50.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.550+0000 7ffb05e87640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb00100850 0x7ffb0019d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:50.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.550+0000 7ffb05e87640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0019d820 con 0x7ffb000feca0 2024-09-13T17:11:50.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.550+0000 7ffb05e87640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0019d990 con 0x7ffb00100850 2024-09-13T17:11:50.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.550+0000 7ffb05e87640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0019db50 con 0x7ffb000ffe90 2024-09-13T17:11:50.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.550+0000 7ffaff7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb000feca0 0x7ffb00068150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:50.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.550+0000 7ffaff7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb000feca0 0x7ffb00068150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45538/0 (socket says 172.21.15.87:45538) 2024-09-13T17:11:50.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.550+0000 7ffaff7fe640 1 -- 172.21.15.87:0/3927987600 learned_addr learned my addr 172.21.15.87:0/3927987600 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:50.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.550+0000 7ffafeffd640 1 --2- 172.21.15.87:0/3927987600 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb000ffe90 0x7ffb0019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:50.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.550+0000 7ffafffff640 1 --2- 172.21.15.87:0/3927987600 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb00100850 0x7ffb0019d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:50.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.550+0000 7ffaff7fe640 1 -- 172.21.15.87:0/3927987600 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb000ffe90 msgr2=0x7ffb0019aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:50.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.550+0000 7ffaff7fe640 1 --2- 172.21.15.87:0/3927987600 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb000ffe90 0x7ffb0019aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:50.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.550+0000 7ffaff7fe640 1 -- 172.21.15.87:0/3927987600 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb00100850 msgr2=0x7ffb0019d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:50.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.550+0000 7ffaff7fe640 1 --2- 172.21.15.87:0/3927987600 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb00100850 0x7ffb0019d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:50.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.550+0000 7ffaff7fe640 1 -- 172.21.15.87:0/3927987600 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf8009900 con 0x7ffb000feca0 2024-09-13T17:11:50.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.550+0000 7ffaff7fe640 1 --2- 172.21.15.87:0/3927987600 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb000feca0 0x7ffb00068150 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ffaf000d950 tx=0x7ffaf000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:50.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.551+0000 7ffafcff9640 1 -- 172.21.15.87:0/3927987600 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf0009c30 con 0x7ffb000feca0 2024-09-13T17:11:50.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.551+0000 7ffafcff9640 1 -- 172.21.15.87:0/3927987600 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffaf0009d90 con 0x7ffb000feca0 2024-09-13T17:11:50.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.551+0000 7ffb05e87640 1 -- 172.21.15.87:0/3927987600 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb0019de30 con 0x7ffb000feca0 2024-09-13T17:11:50.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.551+0000 7ffafcff9640 1 -- 172.21.15.87:0/3927987600 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf000f7e0 con 0x7ffb000feca0 2024-09-13T17:11:50.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.551+0000 7ffb05e87640 1 -- 172.21.15.87:0/3927987600 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb0019e2b0 con 0x7ffb000feca0 2024-09-13T17:11:50.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.552+0000 7ffb05e87640 1 -- 172.21.15.87:0/3927987600 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb001060e0 con 0x7ffb000feca0 2024-09-13T17:11:50.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.553+0000 7ffafcff9640 1 -- 172.21.15.87:0/3927987600 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7ffaf0010460 con 0x7ffb000feca0 2024-09-13T17:11:50.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.553+0000 7ffafcff9640 1 --2- 172.21.15.87:0/3927987600 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ffae80a11a0 0x7ffae80a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:50.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.553+0000 7ffafcff9640 1 -- 172.21.15.87:0/3927987600 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8978+0+0 (secure 0 0 0) 0x7ffaf00cca90 con 0x7ffb000feca0 2024-09-13T17:11:50.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.553+0000 7ffafeffd640 1 --2- 172.21.15.87:0/3927987600 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ffae80a11a0 0x7ffae80a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:50.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.554+0000 7ffafeffd640 1 --2- 172.21.15.87:0/3927987600 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ffae80a11a0 0x7ffae80a3660 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4005fd0 tx=0x7ffaf400b510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:50.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.558+0000 7ffafcff9640 1 -- 172.21.15.87:0/3927987600 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ffaf0095dd0 con 0x7ffb000feca0 2024-09-13T17:11:50.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:50 smithi149 ceph-mon[35496]: from='client.14895 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:11:50.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:50 smithi149 ceph-mon[35496]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:11:50.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:50 smithi149 ceph-mon[35496]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:11:50.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:50 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2151712949' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:50.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:50 smithi149 ceph-mon[35496]: osdmap e91: 12 total, 12 up, 12 in 2024-09-13T17:11:50.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:50 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/467167976' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:11:50.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:50 smithi118 ceph-mon[34374]: from='client.14895 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:11:50.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:50 smithi118 ceph-mon[34374]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:11:50.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:50 smithi118 ceph-mon[34374]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:11:50.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:50 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2151712949' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:11:50.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:50 smithi118 ceph-mon[34374]: osdmap e91: 12 total, 12 up, 12 in 2024-09-13T17:11:50.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:50 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/467167976' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:11:50.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.717+0000 7ffb05e87640 1 -- 172.21.15.87:0/3927987600 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffb0002c480 con 0x7ffae80a11a0 2024-09-13T17:11:50.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.728+0000 7ffafcff9640 1 -- 172.21.15.87:0/3927987600 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+424210 (secure 0 0 0) 0x7ffb0002c480 con 0x7ffae80a11a0 2024-09-13T17:11:50.733 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:11:50.736 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-13T17:11:50.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.731+0000 7ffb05e87640 1 -- 172.21.15.87:0/3927987600 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ffae80a11a0 msgr2=0x7ffae80a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:50.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.731+0000 7ffb05e87640 1 --2- 172.21.15.87:0/3927987600 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ffae80a11a0 0x7ffae80a3660 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4005fd0 tx=0x7ffaf400b510 comp rx=0 tx=0).stop 2024-09-13T17:11:50.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.731+0000 7ffb05e87640 1 -- 172.21.15.87:0/3927987600 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb000feca0 msgr2=0x7ffb00068150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:50.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.731+0000 7ffb05e87640 1 --2- 172.21.15.87:0/3927987600 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb000feca0 0x7ffb00068150 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ffaf000d950 tx=0x7ffaf000de10 comp rx=0 tx=0).stop 2024-09-13T17:11:50.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.731+0000 7ffb05e87640 1 -- 172.21.15.87:0/3927987600 shutdown_connections 2024-09-13T17:11:50.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.731+0000 7ffb05e87640 1 --2- 172.21.15.87:0/3927987600 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ffae80a11a0 0x7ffae80a3660 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:50.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.731+0000 7ffb05e87640 1 --2- 172.21.15.87:0/3927987600 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb00100850 0x7ffb0019d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:50.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.731+0000 7ffb05e87640 1 --2- 172.21.15.87:0/3927987600 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb000ffe90 0x7ffb0019aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:50.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.731+0000 7ffb05e87640 1 --2- 172.21.15.87:0/3927987600 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb000feca0 0x7ffb00068150 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:50.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.731+0000 7ffb05e87640 1 -- 172.21.15.87:0/3927987600 >> 172.21.15.87:0/3927987600 conn(0x7ffb000fa440 msgr2=0x7ffb001032b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:50.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.732+0000 7ffb05e87640 1 -- 172.21.15.87:0/3927987600 shutdown_connections 2024-09-13T17:11:50.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.732+0000 7ffb05e87640 1 -- 172.21.15.87:0/3927987600 wait complete. 2024-09-13T17:11:50.743 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-09-13T17:11:50.074276+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":634361,"num_objects":56,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":159,"num_read_kb":159,"num_write":307,"num_write_kb":3021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376888,"kb_used_data":11704,"kb_used_omap":18,"kb_used_meta":365037,"kb_avail":1124564936,"statfs":{"total":1151940427776,"available":1151554494464,"internally_reserved":0,"allocated":11984896,"data_stored":7591761,"data_compressed":261610,"data_compressed_allocated":348160,"data_compressed_original":2195456,"omap_allocated":19109,"internal_metadata":373798235},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":39400,"num_objects":32,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":23,"num_read_kb":40,"num_write":78,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002224"},"pg_stats":[{"pgid":"2.1f","version":"89'9","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.181045+0000","last_change":"2024-09-13T17:11:22.998997+0000","last_active":"2024-09-13T17:11:47.181045+0000","last_peered":"2024-09-13T17:11:47.181045+0000","last_clean":"2024-09-13T17:11:47.181045+0000","last_became_active":"2024-09-13T17:11:22.998674+0000","last_became_peered":"2024-09-13T17:11:22.998674+0000","last_unstale":"2024-09-13T17:11:47.181045+0000","last_undegraded":"2024-09-13T17:11:47.181045+0000","last_fullsized":"2024-09-13T17:11:47.181045+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:30:50.554788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.348929+0000","last_change":"2024-09-13T17:11:23.340108+0000","last_active":"2024-09-13T17:11:27.348929+0000","last_peered":"2024-09-13T17:11:27.348929+0000","last_clean":"2024-09-13T17:11:27.348929+0000","last_became_active":"2024-09-13T17:11:23.339832+0000","last_became_peered":"2024-09-13T17:11:23.339832+0000","last_unstale":"2024-09-13T17:11:27.348929+0000","last_undegraded":"2024-09-13T17:11:27.348929+0000","last_fullsized":"2024-09-13T17:11:27.348929+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:40.969448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.683504+0000","last_change":"2024-09-13T17:11:27.358090+0000","last_active":"2024-09-13T17:11:27.683504+0000","last_peered":"2024-09-13T17:11:27.683504+0000","last_clean":"2024-09-13T17:11:27.683504+0000","last_became_active":"2024-09-13T17:11:27.357725+0000","last_became_peered":"2024-09-13T17:11:27.357725+0000","last_unstale":"2024-09-13T17:11:27.683504+0000","last_undegraded":"2024-09-13T17:11:27.683504+0000","last_fullsized":"2024-09-13T17:11:27.683504+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:51.617457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'1","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.349083+0000","last_change":"2024-09-13T17:11:23.000779+0000","last_active":"2024-09-13T17:11:27.349083+0000","last_peered":"2024-09-13T17:11:27.349083+0000","last_clean":"2024-09-13T17:11:27.349083+0000","last_became_active":"2024-09-13T17:11:23.000511+0000","last_became_peered":"2024-09-13T17:11:23.000511+0000","last_unstale":"2024-09-13T17:11:27.349083+0000","last_undegraded":"2024-09-13T17:11:27.349083+0000","last_fullsized":"2024-09-13T17:11:27.349083+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:09.802392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.833095+0000","last_change":"2024-09-13T17:11:23.333948+0000","last_active":"2024-09-13T17:11:27.833095+0000","last_peered":"2024-09-13T17:11:27.833095+0000","last_clean":"2024-09-13T17:11:27.833095+0000","last_became_active":"2024-09-13T17:11:23.333679+0000","last_became_peered":"2024-09-13T17:11:23.333679+0000","last_unstale":"2024-09-13T17:11:27.833095+0000","last_undegraded":"2024-09-13T17:11:27.833095+0000","last_fullsized":"2024-09-13T17:11:27.833095+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:10.265157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537784+0000","last_change":"2024-09-13T17:11:27.353767+0000","last_active":"2024-09-13T17:11:29.537784+0000","last_peered":"2024-09-13T17:11:29.537784+0000","last_clean":"2024-09-13T17:11:29.537784+0000","last_became_active":"2024-09-13T17:11:27.353448+0000","last_became_peered":"2024-09-13T17:11:27.353448+0000","last_unstale":"2024-09-13T17:11:29.537784+0000","last_undegraded":"2024-09-13T17:11:29.537784+0000","last_fullsized":"2024-09-13T17:11:29.537784+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:15.948099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.178059+0000","last_change":"2024-09-13T17:11:22.999879+0000","last_active":"2024-09-13T17:11:47.178059+0000","last_peered":"2024-09-13T17:11:47.178059+0000","last_clean":"2024-09-13T17:11:47.178059+0000","last_became_active":"2024-09-13T17:11:22.999577+0000","last_became_peered":"2024-09-13T17:11:22.999577+0000","last_unstale":"2024-09-13T17:11:47.178059+0000","last_undegraded":"2024-09-13T17:11:47.178059+0000","last_fullsized":"2024-09-13T17:11:47.178059+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:48.485532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.346469+0000","last_change":"2024-09-13T17:11:23.339026+0000","last_active":"2024-09-13T17:11:27.346469+0000","last_peered":"2024-09-13T17:11:27.346469+0000","last_clean":"2024-09-13T17:11:27.346469+0000","last_became_active":"2024-09-13T17:11:23.338745+0000","last_became_peered":"2024-09-13T17:11:23.338745+0000","last_unstale":"2024-09-13T17:11:27.346469+0000","last_undegraded":"2024-09-13T17:11:27.346469+0000","last_fullsized":"2024-09-13T17:11:27.346469+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:27.455418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537867+0000","last_change":"2024-09-13T17:11:27.363137+0000","last_active":"2024-09-13T17:11:29.537867+0000","last_peered":"2024-09-13T17:11:29.537867+0000","last_clean":"2024-09-13T17:11:29.537867+0000","last_became_active":"2024-09-13T17:11:27.362621+0000","last_became_peered":"2024-09-13T17:11:27.362621+0000","last_unstale":"2024-09-13T17:11:29.537867+0000","last_undegraded":"2024-09-13T17:11:29.537867+0000","last_fullsized":"2024-09-13T17:11:29.537867+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:35:51.492630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.352962+0000","last_change":"2024-09-13T17:11:22.998066+0000","last_active":"2024-09-13T17:11:27.352962+0000","last_peered":"2024-09-13T17:11:27.352962+0000","last_clean":"2024-09-13T17:11:27.352962+0000","last_became_active":"2024-09-13T17:11:22.997741+0000","last_became_peered":"2024-09-13T17:11:22.997741+0000","last_unstale":"2024-09-13T17:11:27.352962+0000","last_undegraded":"2024-09-13T17:11:27.352962+0000","last_fullsized":"2024-09-13T17:11:27.352962+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:00.353453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.357913+0000","last_change":"2024-09-13T17:11:23.336778+0000","last_active":"2024-09-13T17:11:27.357913+0000","last_peered":"2024-09-13T17:11:27.357913+0000","last_clean":"2024-09-13T17:11:27.357913+0000","last_became_active":"2024-09-13T17:11:23.336491+0000","last_became_peered":"2024-09-13T17:11:23.336491+0000","last_unstale":"2024-09-13T17:11:27.357913+0000","last_undegraded":"2024-09-13T17:11:27.357913+0000","last_fullsized":"2024-09-13T17:11:27.357913+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:02.045912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537823+0000","last_change":"2024-09-13T17:11:27.361454+0000","last_active":"2024-09-13T17:11:29.537823+0000","last_peered":"2024-09-13T17:11:29.537823+0000","last_clean":"2024-09-13T17:11:29.537823+0000","last_became_active":"2024-09-13T17:11:27.360980+0000","last_became_peered":"2024-09-13T17:11:27.360980+0000","last_unstale":"2024-09-13T17:11:29.537823+0000","last_undegraded":"2024-09-13T17:11:29.537823+0000","last_fullsized":"2024-09-13T17:11:29.537823+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:36.036426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345699+0000","last_change":"2024-09-13T17:11:23.334073+0000","last_active":"2024-09-13T17:11:27.345699+0000","last_peered":"2024-09-13T17:11:27.345699+0000","last_clean":"2024-09-13T17:11:27.345699+0000","last_became_active":"2024-09-13T17:11:23.333628+0000","last_became_peered":"2024-09-13T17:11:23.333628+0000","last_unstale":"2024-09-13T17:11:27.345699+0000","last_undegraded":"2024-09-13T17:11:27.345699+0000","last_fullsized":"2024-09-13T17:11:27.345699+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:18.561346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:46.174718+0000","last_change":"2024-09-13T17:11:22.999115+0000","last_active":"2024-09-13T17:11:46.174718+0000","last_peered":"2024-09-13T17:11:46.174718+0000","last_clean":"2024-09-13T17:11:46.174718+0000","last_became_active":"2024-09-13T17:11:22.998798+0000","last_became_peered":"2024-09-13T17:11:22.998798+0000","last_unstale":"2024-09-13T17:11:46.174718+0000","last_undegraded":"2024-09-13T17:11:46.174718+0000","last_fullsized":"2024-09-13T17:11:46.174718+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:25.263755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537935+0000","last_change":"2024-09-13T17:11:27.355472+0000","last_active":"2024-09-13T17:11:29.537935+0000","last_peered":"2024-09-13T17:11:29.537935+0000","last_clean":"2024-09-13T17:11:29.537935+0000","last_became_active":"2024-09-13T17:11:27.355065+0000","last_became_peered":"2024-09-13T17:11:27.355065+0000","last_unstale":"2024-09-13T17:11:29.537935+0000","last_undegraded":"2024-09-13T17:11:29.537935+0000","last_fullsized":"2024-09-13T17:11:29.537935+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:03.881097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.350859+0000","last_change":"2024-09-13T17:11:23.340268+0000","last_active":"2024-09-13T17:11:27.350859+0000","last_peered":"2024-09-13T17:11:27.350859+0000","last_clean":"2024-09-13T17:11:27.350859+0000","last_became_active":"2024-09-13T17:11:23.339977+0000","last_became_peered":"2024-09-13T17:11:23.339977+0000","last_unstale":"2024-09-13T17:11:27.350859+0000","last_undegraded":"2024-09-13T17:11:27.350859+0000","last_fullsized":"2024-09-13T17:11:27.350859+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:21.067899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.352398+0000","last_change":"2024-09-13T17:11:23.000858+0000","last_active":"2024-09-13T17:11:27.352398+0000","last_peered":"2024-09-13T17:11:27.352398+0000","last_clean":"2024-09-13T17:11:27.352398+0000","last_became_active":"2024-09-13T17:11:23.000536+0000","last_became_peered":"2024-09-13T17:11:23.000536+0000","last_unstale":"2024-09-13T17:11:27.352398+0000","last_undegraded":"2024-09-13T17:11:27.352398+0000","last_fullsized":"2024-09-13T17:11:27.352398+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:28.798579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801541+0000","last_change":"2024-09-13T17:11:27.354018+0000","last_active":"2024-09-13T17:11:48.801541+0000","last_peered":"2024-09-13T17:11:48.801541+0000","last_clean":"2024-09-13T17:11:48.801541+0000","last_became_active":"2024-09-13T17:11:27.353519+0000","last_became_peered":"2024-09-13T17:11:27.353519+0000","last_unstale":"2024-09-13T17:11:48.801541+0000","last_undegraded":"2024-09-13T17:11:48.801541+0000","last_fullsized":"2024-09-13T17:11:48.801541+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:55.227851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801000+0000","last_change":"2024-09-13T17:11:23.335798+0000","last_active":"2024-09-13T17:11:48.801000+0000","last_peered":"2024-09-13T17:11:48.801000+0000","last_clean":"2024-09-13T17:11:48.801000+0000","last_became_active":"2024-09-13T17:11:23.335445+0000","last_became_peered":"2024-09-13T17:11:23.335445+0000","last_unstale":"2024-09-13T17:11:48.801000+0000","last_undegraded":"2024-09-13T17:11:48.801000+0000","last_fullsized":"2024-09-13T17:11:48.801000+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:53.242067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.349338+0000","last_change":"2024-09-13T17:11:22.994118+0000","last_active":"2024-09-13T17:11:27.349338+0000","last_peered":"2024-09-13T17:11:27.349338+0000","last_clean":"2024-09-13T17:11:27.349338+0000","last_became_active":"2024-09-13T17:11:22.993801+0000","last_became_peered":"2024-09-13T17:11:22.993801+0000","last_unstale":"2024-09-13T17:11:27.349338+0000","last_undegraded":"2024-09-13T17:11:27.349338+0000","last_fullsized":"2024-09-13T17:11:27.349338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:01.382130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.557452+0000","last_change":"2024-09-13T17:11:27.358795+0000","last_active":"2024-09-13T17:11:27.557452+0000","last_peered":"2024-09-13T17:11:27.557452+0000","last_clean":"2024-09-13T17:11:27.557452+0000","last_became_active":"2024-09-13T17:11:27.358166+0000","last_became_peered":"2024-09-13T17:11:27.358166+0000","last_unstale":"2024-09-13T17:11:27.557452+0000","last_undegraded":"2024-09-13T17:11:27.557452+0000","last_fullsized":"2024-09-13T17:11:27.557452+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:23.787842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.353077+0000","last_change":"2024-09-13T17:11:23.340671+0000","last_active":"2024-09-13T17:11:27.353077+0000","last_peered":"2024-09-13T17:11:27.353077+0000","last_clean":"2024-09-13T17:11:27.353077+0000","last_became_active":"2024-09-13T17:11:23.340360+0000","last_became_peered":"2024-09-13T17:11:23.340360+0000","last_unstale":"2024-09-13T17:11:27.353077+0000","last_undegraded":"2024-09-13T17:11:27.353077+0000","last_fullsized":"2024-09-13T17:11:27.353077+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:17.875171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344679+0000","last_change":"2024-09-13T17:11:22.993039+0000","last_active":"2024-09-13T17:11:27.344679+0000","last_peered":"2024-09-13T17:11:27.344679+0000","last_clean":"2024-09-13T17:11:27.344679+0000","last_became_active":"2024-09-13T17:11:22.992701+0000","last_became_peered":"2024-09-13T17:11:22.992701+0000","last_unstale":"2024-09-13T17:11:27.344679+0000","last_undegraded":"2024-09-13T17:11:27.344679+0000","last_fullsized":"2024-09-13T17:11:27.344679+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:28.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537946+0000","last_change":"2024-09-13T17:11:27.363834+0000","last_active":"2024-09-13T17:11:29.537946+0000","last_peered":"2024-09-13T17:11:29.537946+0000","last_clean":"2024-09-13T17:11:29.537946+0000","last_became_active":"2024-09-13T17:11:27.363425+0000","last_became_peered":"2024-09-13T17:11:27.363425+0000","last_unstale":"2024-09-13T17:11:29.537946+0000","last_undegraded":"2024-09-13T17:11:29.537946+0000","last_fullsized":"2024-09-13T17:11:29.537946+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:37.389881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832858+0000","last_change":"2024-09-13T17:11:23.337423+0000","last_active":"2024-09-13T17:11:27.832858+0000","last_peered":"2024-09-13T17:11:27.832858+0000","last_clean":"2024-09-13T17:11:27.832858+0000","last_became_active":"2024-09-13T17:11:23.337167+0000","last_became_peered":"2024-09-13T17:11:23.337167+0000","last_unstale":"2024-09-13T17:11:27.832858+0000","last_undegraded":"2024-09-13T17:11:27.832858+0000","last_fullsized":"2024-09-13T17:11:27.832858+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:28.540283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:46.175903+0000","last_change":"2024-09-13T17:11:23.000486+0000","last_active":"2024-09-13T17:11:46.175903+0000","last_peered":"2024-09-13T17:11:46.175903+0000","last_clean":"2024-09-13T17:11:46.175903+0000","last_became_active":"2024-09-13T17:11:23.000158+0000","last_became_peered":"2024-09-13T17:11:23.000158+0000","last_unstale":"2024-09-13T17:11:46.175903+0000","last_undegraded":"2024-09-13T17:11:46.175903+0000","last_fullsized":"2024-09-13T17:11:46.175903+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:42.635037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.683527+0000","last_change":"2024-09-13T17:11:27.355058+0000","last_active":"2024-09-13T17:11:27.683527+0000","last_peered":"2024-09-13T17:11:27.683527+0000","last_clean":"2024-09-13T17:11:27.683527+0000","last_became_active":"2024-09-13T17:11:27.354726+0000","last_became_peered":"2024-09-13T17:11:27.354726+0000","last_unstale":"2024-09-13T17:11:27.683527+0000","last_undegraded":"2024-09-13T17:11:27.683527+0000","last_fullsized":"2024-09-13T17:11:27.683527+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:58.450122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.353872+0000","last_change":"2024-09-13T17:11:23.337245+0000","last_active":"2024-09-13T17:11:27.353872+0000","last_peered":"2024-09-13T17:11:27.353872+0000","last_clean":"2024-09-13T17:11:27.353872+0000","last_became_active":"2024-09-13T17:11:23.336956+0000","last_became_peered":"2024-09-13T17:11:23.336956+0000","last_unstale":"2024-09-13T17:11:27.353872+0000","last_undegraded":"2024-09-13T17:11:27.353872+0000","last_fullsized":"2024-09-13T17:11:27.353872+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:46.876149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'3","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.179427+0000","last_change":"2024-09-13T17:11:22.999942+0000","last_active":"2024-09-13T17:11:47.179427+0000","last_peered":"2024-09-13T17:11:47.179427+0000","last_clean":"2024-09-13T17:11:47.179427+0000","last_became_active":"2024-09-13T17:11:22.999653+0000","last_became_peered":"2024-09-13T17:11:22.999653+0000","last_unstale":"2024-09-13T17:11:47.179427+0000","last_undegraded":"2024-09-13T17:11:47.179427+0000","last_fullsized":"2024-09-13T17:11:47.179427+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:29.400939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832619+0000","last_change":"2024-09-13T17:11:27.356479+0000","last_active":"2024-09-13T17:11:27.832619+0000","last_peered":"2024-09-13T17:11:27.832619+0000","last_clean":"2024-09-13T17:11:27.832619+0000","last_became_active":"2024-09-13T17:11:27.356052+0000","last_became_peered":"2024-09-13T17:11:27.356052+0000","last_unstale":"2024-09-13T17:11:27.832619+0000","last_undegraded":"2024-09-13T17:11:27.832619+0000","last_fullsized":"2024-09-13T17:11:27.832619+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:42.173376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344659+0000","last_change":"2024-09-13T17:11:23.333786+0000","last_active":"2024-09-13T17:11:27.344659+0000","last_peered":"2024-09-13T17:11:27.344659+0000","last_clean":"2024-09-13T17:11:27.344659+0000","last_became_active":"2024-09-13T17:11:23.333472+0000","last_became_peered":"2024-09-13T17:11:23.333472+0000","last_unstale":"2024-09-13T17:11:27.344659+0000","last_undegraded":"2024-09-13T17:11:27.344659+0000","last_fullsized":"2024-09-13T17:11:27.344659+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:41.633228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:46.175724+0000","last_change":"2024-09-13T17:11:22.998646+0000","last_active":"2024-09-13T17:11:46.175724+0000","last_peered":"2024-09-13T17:11:46.175724+0000","last_clean":"2024-09-13T17:11:46.175724+0000","last_became_active":"2024-09-13T17:11:22.998291+0000","last_became_peered":"2024-09-13T17:11:22.998291+0000","last_unstale":"2024-09-13T17:11:46.175724+0000","last_undegraded":"2024-09-13T17:11:46.175724+0000","last_fullsized":"2024-09-13T17:11:46.175724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:20.658436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801089+0000","last_change":"2024-09-13T17:11:27.361174+0000","last_active":"2024-09-13T17:11:48.801089+0000","last_peered":"2024-09-13T17:11:48.801089+0000","last_clean":"2024-09-13T17:11:48.801089+0000","last_became_active":"2024-09-13T17:11:27.360737+0000","last_became_peered":"2024-09-13T17:11:27.360737+0000","last_unstale":"2024-09-13T17:11:48.801089+0000","last_undegraded":"2024-09-13T17:11:48.801089+0000","last_fullsized":"2024-09-13T17:11:48.801089+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:00.941364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.834435+0000","last_change":"2024-09-13T17:11:23.338545+0000","last_active":"2024-09-13T17:11:27.834435+0000","last_peered":"2024-09-13T17:11:27.834435+0000","last_clean":"2024-09-13T17:11:27.834435+0000","last_became_active":"2024-09-13T17:11:23.338246+0000","last_became_peered":"2024-09-13T17:11:23.338246+0000","last_unstale":"2024-09-13T17:11:27.834435+0000","last_undegraded":"2024-09-13T17:11:27.834435+0000","last_fullsized":"2024-09-13T17:11:27.834435+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:18.966658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.341243+0000","last_change":"2024-09-13T17:11:22.993497+0000","last_active":"2024-09-13T17:11:27.341243+0000","last_peered":"2024-09-13T17:11:27.341243+0000","last_clean":"2024-09-13T17:11:27.341243+0000","last_became_active":"2024-09-13T17:11:22.993165+0000","last_became_peered":"2024-09-13T17:11:22.993165+0000","last_unstale":"2024-09-13T17:11:27.341243+0000","last_undegraded":"2024-09-13T17:11:27.341243+0000","last_fullsized":"2024-09-13T17:11:27.341243+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:20.997834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832905+0000","last_change":"2024-09-13T17:11:27.364652+0000","last_active":"2024-09-13T17:11:27.832905+0000","last_peered":"2024-09-13T17:11:27.832905+0000","last_clean":"2024-09-13T17:11:27.832905+0000","last_became_active":"2024-09-13T17:11:27.364245+0000","last_became_peered":"2024-09-13T17:11:27.364245+0000","last_unstale":"2024-09-13T17:11:27.832905+0000","last_undegraded":"2024-09-13T17:11:27.832905+0000","last_fullsized":"2024-09-13T17:11:27.832905+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:23.048289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.834356+0000","last_change":"2024-09-13T17:11:23.335649+0000","last_active":"2024-09-13T17:11:27.834356+0000","last_peered":"2024-09-13T17:11:27.834356+0000","last_clean":"2024-09-13T17:11:27.834356+0000","last_became_active":"2024-09-13T17:11:23.335364+0000","last_became_peered":"2024-09-13T17:11:23.335364+0000","last_unstale":"2024-09-13T17:11:27.834356+0000","last_undegraded":"2024-09-13T17:11:27.834356+0000","last_fullsized":"2024-09-13T17:11:27.834356+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.447947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.684957+0000","last_change":"2024-09-13T17:11:23.003188+0000","last_active":"2024-09-13T17:11:27.684957+0000","last_peered":"2024-09-13T17:11:27.684957+0000","last_clean":"2024-09-13T17:11:27.684957+0000","last_became_active":"2024-09-13T17:11:23.002858+0000","last_became_peered":"2024-09-13T17:11:23.002858+0000","last_unstale":"2024-09-13T17:11:27.684957+0000","last_undegraded":"2024-09-13T17:11:27.684957+0000","last_fullsized":"2024-09-13T17:11:27.684957+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:34.153326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832969+0000","last_change":"2024-09-13T17:11:27.353320+0000","last_active":"2024-09-13T17:11:27.832969+0000","last_peered":"2024-09-13T17:11:27.832969+0000","last_clean":"2024-09-13T17:11:27.832969+0000","last_became_active":"2024-09-13T17:11:27.352947+0000","last_became_peered":"2024-09-13T17:11:27.352947+0000","last_unstale":"2024-09-13T17:11:27.832969+0000","last_undegraded":"2024-09-13T17:11:27.832969+0000","last_fullsized":"2024-09-13T17:11:27.832969+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:04.619618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.354952+0000","last_change":"2024-09-13T17:11:23.330128+0000","last_active":"2024-09-13T17:11:27.354952+0000","last_peered":"2024-09-13T17:11:27.354952+0000","last_clean":"2024-09-13T17:11:27.354952+0000","last_became_active":"2024-09-13T17:11:23.329266+0000","last_became_peered":"2024-09-13T17:11:23.329266+0000","last_unstale":"2024-09-13T17:11:27.354952+0000","last_undegraded":"2024-09-13T17:11:27.354952+0000","last_fullsized":"2024-09-13T17:11:27.354952+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:36.275352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344307+0000","last_change":"2024-09-13T17:11:23.003495+0000","last_active":"2024-09-13T17:11:27.344307+0000","last_peered":"2024-09-13T17:11:27.344307+0000","last_clean":"2024-09-13T17:11:27.344307+0000","last_became_active":"2024-09-13T17:11:23.003186+0000","last_became_peered":"2024-09-13T17:11:23.003186+0000","last_unstale":"2024-09-13T17:11:27.344307+0000","last_undegraded":"2024-09-13T17:11:27.344307+0000","last_fullsized":"2024-09-13T17:11:27.344307+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:23.353587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832748+0000","last_change":"2024-09-13T17:11:27.362233+0000","last_active":"2024-09-13T17:11:27.832748+0000","last_peered":"2024-09-13T17:11:27.832748+0000","last_clean":"2024-09-13T17:11:27.832748+0000","last_became_active":"2024-09-13T17:11:27.361814+0000","last_became_peered":"2024-09-13T17:11:27.361814+0000","last_unstale":"2024-09-13T17:11:27.832748+0000","last_undegraded":"2024-09-13T17:11:27.832748+0000","last_fullsized":"2024-09-13T17:11:27.832748+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:20.723366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344130+0000","last_change":"2024-09-13T17:11:23.332870+0000","last_active":"2024-09-13T17:11:27.344130+0000","last_peered":"2024-09-13T17:11:27.344130+0000","last_clean":"2024-09-13T17:11:27.344130+0000","last_became_active":"2024-09-13T17:11:23.332583+0000","last_became_peered":"2024-09-13T17:11:23.332583+0000","last_unstale":"2024-09-13T17:11:27.344130+0000","last_undegraded":"2024-09-13T17:11:27.344130+0000","last_fullsized":"2024-09-13T17:11:27.344130+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:22.607666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.176932+0000","last_change":"2024-09-13T17:11:23.001932+0000","last_active":"2024-09-13T17:11:47.176932+0000","last_peered":"2024-09-13T17:11:47.176932+0000","last_clean":"2024-09-13T17:11:47.176932+0000","last_became_active":"2024-09-13T17:11:23.001642+0000","last_became_peered":"2024-09-13T17:11:23.001642+0000","last_unstale":"2024-09-13T17:11:47.176932+0000","last_undegraded":"2024-09-13T17:11:47.176932+0000","last_fullsized":"2024-09-13T17:11:47.176932+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:05.976897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.360313+0000","last_change":"2024-09-13T17:11:27.359679+0000","last_active":"2024-09-13T17:11:27.360313+0000","last_peered":"2024-09-13T17:11:27.360313+0000","last_clean":"2024-09-13T17:11:27.360313+0000","last_became_active":"2024-09-13T17:11:27.359268+0000","last_became_peered":"2024-09-13T17:11:27.359268+0000","last_unstale":"2024-09-13T17:11:27.360313+0000","last_undegraded":"2024-09-13T17:11:27.360313+0000","last_fullsized":"2024-09-13T17:11:27.360313+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:48.154917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.350643+0000","last_change":"2024-09-13T17:11:23.340031+0000","last_active":"2024-09-13T17:11:27.350643+0000","last_peered":"2024-09-13T17:11:27.350643+0000","last_clean":"2024-09-13T17:11:27.350643+0000","last_became_active":"2024-09-13T17:11:23.339768+0000","last_became_peered":"2024-09-13T17:11:23.339768+0000","last_unstale":"2024-09-13T17:11:27.350643+0000","last_undegraded":"2024-09-13T17:11:27.350643+0000","last_fullsized":"2024-09-13T17:11:27.350643+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:22.360526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.788033+0000","last_change":"2024-09-13T17:11:22.995060+0000","last_active":"2024-09-13T17:11:47.788033+0000","last_peered":"2024-09-13T17:11:47.788033+0000","last_clean":"2024-09-13T17:11:47.788033+0000","last_became_active":"2024-09-13T17:11:22.991949+0000","last_became_peered":"2024-09-13T17:11:22.991949+0000","last_unstale":"2024-09-13T17:11:47.788033+0000","last_undegraded":"2024-09-13T17:11:47.788033+0000","last_fullsized":"2024-09-13T17:11:47.788033+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:44.716753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":338,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345590+0000","last_change":"2024-09-13T17:10:13.439723+0000","last_active":"2024-09-13T17:11:27.345590+0000","last_peered":"2024-09-13T17:11:27.345590+0000","last_clean":"2024-09-13T17:11:27.345590+0000","last_became_active":"2024-09-13T17:10:13.439290+0000","last_became_peered":"2024-09-13T17:10:13.439290+0000","last_unstale":"2024-09-13T17:11:27.345590+0000","last_undegraded":"2024-09-13T17:11:27.345590+0000","last_fullsized":"2024-09-13T17:11:27.345590+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:03.041486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:03.041486+0000","last_clean_scrub_stamp":"2024-09-13T17:07:03.041486+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:08.673571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:28.497337+0000","last_change":"2024-09-13T17:11:27.361028+0000","last_active":"2024-09-13T17:11:28.497337+0000","last_peered":"2024-09-13T17:11:28.497337+0000","last_clean":"2024-09-13T17:11:28.497337+0000","last_became_active":"2024-09-13T17:11:27.360630+0000","last_became_peered":"2024-09-13T17:11:27.360630+0000","last_unstale":"2024-09-13T17:11:28.497337+0000","last_undegraded":"2024-09-13T17:11:28.497337+0000","last_fullsized":"2024-09-13T17:11:28.497337+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:40:40.860443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.346553+0000","last_change":"2024-09-13T17:11:23.346138+0000","last_active":"2024-09-13T17:11:27.346553+0000","last_peered":"2024-09-13T17:11:27.346553+0000","last_clean":"2024-09-13T17:11:27.346553+0000","last_became_active":"2024-09-13T17:11:23.345855+0000","last_became_peered":"2024-09-13T17:11:23.345855+0000","last_unstale":"2024-09-13T17:11:27.346553+0000","last_undegraded":"2024-09-13T17:11:27.346553+0000","last_fullsized":"2024-09-13T17:11:27.346553+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:02.391726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":2,"reported_epoch":90,"state":"peering","last_fresh":"2024-09-13T17:11:27.684094+0000","last_change":"2024-09-13T17:11:49.540357+0000","last_active":"2024-09-13T17:11:49.540357+0000","last_peered":"2024-09-13T17:11:27.684094+0000","last_clean":"2024-09-13T17:11:27.684094+0000","last_became_active":"2024-09-13T17:11:23.003102+0000","last_became_peered":"2024-09-13T17:11:23.003102+0000","last_unstale":"2024-09-13T17:11:27.684094+0000","last_undegraded":"2024-09-13T17:11:27.684094+0000","last_fullsized":"2024-09-13T17:11:27.684094+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:08.827045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832402+0000","last_change":"2024-09-13T17:11:27.360372+0000","last_active":"2024-09-13T17:11:27.832402+0000","last_peered":"2024-09-13T17:11:27.832402+0000","last_clean":"2024-09-13T17:11:27.832402+0000","last_became_active":"2024-09-13T17:11:27.359990+0000","last_became_peered":"2024-09-13T17:11:27.359990+0000","last_unstale":"2024-09-13T17:11:27.832402+0000","last_undegraded":"2024-09-13T17:11:27.832402+0000","last_fullsized":"2024-09-13T17:11:27.832402+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:26.970317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344659+0000","last_change":"2024-09-13T17:11:23.336269+0000","last_active":"2024-09-13T17:11:27.344659+0000","last_peered":"2024-09-13T17:11:27.344659+0000","last_clean":"2024-09-13T17:11:27.344659+0000","last_became_active":"2024-09-13T17:11:23.335921+0000","last_became_peered":"2024-09-13T17:11:23.335921+0000","last_unstale":"2024-09-13T17:11:27.344659+0000","last_undegraded":"2024-09-13T17:11:27.344659+0000","last_fullsized":"2024-09-13T17:11:27.344659+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:43.035927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.358089+0000","last_change":"2024-09-13T17:11:23.002491+0000","last_active":"2024-09-13T17:11:27.358089+0000","last_peered":"2024-09-13T17:11:27.358089+0000","last_clean":"2024-09-13T17:11:27.358089+0000","last_became_active":"2024-09-13T17:11:23.002178+0000","last_became_peered":"2024-09-13T17:11:23.002178+0000","last_unstale":"2024-09-13T17:11:27.358089+0000","last_undegraded":"2024-09-13T17:11:27.358089+0000","last_fullsized":"2024-09-13T17:11:27.358089+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:06.056639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.108773+0000","last_change":"2024-09-13T17:11:27.355153+0000","last_active":"2024-09-13T17:11:29.108773+0000","last_peered":"2024-09-13T17:11:29.108773+0000","last_clean":"2024-09-13T17:11:29.108773+0000","last_became_active":"2024-09-13T17:11:27.354701+0000","last_became_peered":"2024-09-13T17:11:27.354701+0000","last_unstale":"2024-09-13T17:11:29.108773+0000","last_undegraded":"2024-09-13T17:11:29.108773+0000","last_fullsized":"2024-09-13T17:11:29.108773+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:34.924402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345209+0000","last_change":"2024-09-13T17:11:23.342067+0000","last_active":"2024-09-13T17:11:27.345209+0000","last_peered":"2024-09-13T17:11:27.345209+0000","last_clean":"2024-09-13T17:11:27.345209+0000","last_became_active":"2024-09-13T17:11:23.341736+0000","last_became_peered":"2024-09-13T17:11:23.341736+0000","last_unstale":"2024-09-13T17:11:27.345209+0000","last_undegraded":"2024-09-13T17:11:27.345209+0000","last_fullsized":"2024-09-13T17:11:27.345209+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:03.114638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345020+0000","last_change":"2024-09-13T17:11:23.002849+0000","last_active":"2024-09-13T17:11:27.345020+0000","last_peered":"2024-09-13T17:11:27.345020+0000","last_clean":"2024-09-13T17:11:27.345020+0000","last_became_active":"2024-09-13T17:11:23.002562+0000","last_became_peered":"2024-09-13T17:11:23.002562+0000","last_unstale":"2024-09-13T17:11:27.345020+0000","last_undegraded":"2024-09-13T17:11:27.345020+0000","last_fullsized":"2024-09-13T17:11:27.345020+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:11:24.650510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.360269+0000","last_change":"2024-09-13T17:11:27.359343+0000","last_active":"2024-09-13T17:11:27.360269+0000","last_peered":"2024-09-13T17:11:27.360269+0000","last_clean":"2024-09-13T17:11:27.360269+0000","last_became_active":"2024-09-13T17:11:27.358628+0000","last_became_peered":"2024-09-13T17:11:27.358628+0000","last_unstale":"2024-09-13T17:11:27.360269+0000","last_undegraded":"2024-09-13T17:11:27.360269+0000","last_fullsized":"2024-09-13T17:11:27.360269+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:39.584184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801190+0000","last_change":"2024-09-13T17:11:23.333111+0000","last_active":"2024-09-13T17:11:48.801190+0000","last_peered":"2024-09-13T17:11:48.801190+0000","last_clean":"2024-09-13T17:11:48.801190+0000","last_became_active":"2024-09-13T17:11:23.332734+0000","last_became_peered":"2024-09-13T17:11:23.332734+0000","last_unstale":"2024-09-13T17:11:48.801190+0000","last_undegraded":"2024-09-13T17:11:48.801190+0000","last_fullsized":"2024-09-13T17:11:48.801190+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:44.628106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"84'1","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832752+0000","last_change":"2024-09-13T17:11:23.000759+0000","last_active":"2024-09-13T17:11:27.832752+0000","last_peered":"2024-09-13T17:11:27.832752+0000","last_clean":"2024-09-13T17:11:27.832752+0000","last_became_active":"2024-09-13T17:11:23.000463+0000","last_became_peered":"2024-09-13T17:11:23.000463+0000","last_unstale":"2024-09-13T17:11:27.832752+0000","last_undegraded":"2024-09-13T17:11:27.832752+0000","last_fullsized":"2024-09-13T17:11:27.832752+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:59.077194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.364961+0000","last_change":"2024-09-13T17:11:27.363076+0000","last_active":"2024-09-13T17:11:27.364961+0000","last_peered":"2024-09-13T17:11:27.364961+0000","last_clean":"2024-09-13T17:11:27.364961+0000","last_became_active":"2024-09-13T17:11:27.362642+0000","last_became_peered":"2024-09-13T17:11:27.362642+0000","last_unstale":"2024-09-13T17:11:27.364961+0000","last_undegraded":"2024-09-13T17:11:27.364961+0000","last_fullsized":"2024-09-13T17:11:27.364961+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:25.494875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.355452+0000","last_change":"2024-09-13T17:11:23.336703+0000","last_active":"2024-09-13T17:11:27.355452+0000","last_peered":"2024-09-13T17:11:27.355452+0000","last_clean":"2024-09-13T17:11:27.355452+0000","last_became_active":"2024-09-13T17:11:23.336349+0000","last_became_peered":"2024-09-13T17:11:23.336349+0000","last_unstale":"2024-09-13T17:11:27.355452+0000","last_undegraded":"2024-09-13T17:11:27.355452+0000","last_fullsized":"2024-09-13T17:11:27.355452+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:28.671438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.178750+0000","last_change":"2024-09-13T17:11:22.994382+0000","last_active":"2024-09-13T17:11:47.178750+0000","last_peered":"2024-09-13T17:11:47.178750+0000","last_clean":"2024-09-13T17:11:47.178750+0000","last_became_active":"2024-09-13T17:11:22.994037+0000","last_became_peered":"2024-09-13T17:11:22.994037+0000","last_unstale":"2024-09-13T17:11:47.178750+0000","last_undegraded":"2024-09-13T17:11:47.178750+0000","last_fullsized":"2024-09-13T17:11:47.178750+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:10.763757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.833042+0000","last_change":"2024-09-13T17:11:27.354351+0000","last_active":"2024-09-13T17:11:27.833042+0000","last_peered":"2024-09-13T17:11:27.833042+0000","last_clean":"2024-09-13T17:11:27.833042+0000","last_became_active":"2024-09-13T17:11:27.353715+0000","last_became_peered":"2024-09-13T17:11:27.353715+0000","last_unstale":"2024-09-13T17:11:27.833042+0000","last_undegraded":"2024-09-13T17:11:27.833042+0000","last_fullsized":"2024-09-13T17:11:27.833042+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:18.335183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345355+0000","last_change":"2024-09-13T17:11:23.341743+0000","last_active":"2024-09-13T17:11:27.345355+0000","last_peered":"2024-09-13T17:11:27.345355+0000","last_clean":"2024-09-13T17:11:27.345355+0000","last_became_active":"2024-09-13T17:11:23.341200+0000","last_became_peered":"2024-09-13T17:11:23.341200+0000","last_unstale":"2024-09-13T17:11:27.345355+0000","last_undegraded":"2024-09-13T17:11:27.345355+0000","last_fullsized":"2024-09-13T17:11:27.345355+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:41.854013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'3","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.800911+0000","last_change":"2024-09-13T17:11:22.997571+0000","last_active":"2024-09-13T17:11:48.800911+0000","last_peered":"2024-09-13T17:11:48.800911+0000","last_clean":"2024-09-13T17:11:48.800911+0000","last_became_active":"2024-09-13T17:11:22.997238+0000","last_became_peered":"2024-09-13T17:11:22.997238+0000","last_unstale":"2024-09-13T17:11:48.800911+0000","last_undegraded":"2024-09-13T17:11:48.800911+0000","last_fullsized":"2024-09-13T17:11:48.800911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:34.533004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.557470+0000","last_change":"2024-09-13T17:11:27.356892+0000","last_active":"2024-09-13T17:11:27.557470+0000","last_peered":"2024-09-13T17:11:27.557470+0000","last_clean":"2024-09-13T17:11:27.557470+0000","last_became_active":"2024-09-13T17:11:27.356136+0000","last_became_peered":"2024-09-13T17:11:27.356136+0000","last_unstale":"2024-09-13T17:11:27.557470+0000","last_undegraded":"2024-09-13T17:11:27.557470+0000","last_fullsized":"2024-09-13T17:11:27.557470+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:23.207064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345098+0000","last_change":"2024-09-13T17:11:23.337666+0000","last_active":"2024-09-13T17:11:27.345098+0000","last_peered":"2024-09-13T17:11:27.345098+0000","last_clean":"2024-09-13T17:11:27.345098+0000","last_became_active":"2024-09-13T17:11:23.337185+0000","last_became_peered":"2024-09-13T17:11:23.337185+0000","last_unstale":"2024-09-13T17:11:27.345098+0000","last_undegraded":"2024-09-13T17:11:27.345098+0000","last_fullsized":"2024-09-13T17:11:27.345098+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:51.266709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:46.175759+0000","last_change":"2024-09-13T17:11:23.005075+0000","last_active":"2024-09-13T17:11:46.175759+0000","last_peered":"2024-09-13T17:11:46.175759+0000","last_clean":"2024-09-13T17:11:46.175759+0000","last_became_active":"2024-09-13T17:11:23.004778+0000","last_became_peered":"2024-09-13T17:11:23.004778+0000","last_unstale":"2024-09-13T17:11:46.175759+0000","last_undegraded":"2024-09-13T17:11:46.175759+0000","last_fullsized":"2024-09-13T17:11:46.175759+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:06.763552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801204+0000","last_change":"2024-09-13T17:11:27.353601+0000","last_active":"2024-09-13T17:11:48.801204+0000","last_peered":"2024-09-13T17:11:48.801204+0000","last_clean":"2024-09-13T17:11:48.801204+0000","last_became_active":"2024-09-13T17:11:27.353190+0000","last_became_peered":"2024-09-13T17:11:27.353190+0000","last_unstale":"2024-09-13T17:11:48.801204+0000","last_undegraded":"2024-09-13T17:11:48.801204+0000","last_fullsized":"2024-09-13T17:11:48.801204+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:24.645552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344760+0000","last_change":"2024-09-13T17:11:23.333592+0000","last_active":"2024-09-13T17:11:27.344760+0000","last_peered":"2024-09-13T17:11:27.344760+0000","last_clean":"2024-09-13T17:11:27.344760+0000","last_became_active":"2024-09-13T17:11:23.333306+0000","last_became_peered":"2024-09-13T17:11:23.333306+0000","last_unstale":"2024-09-13T17:11:27.344760+0000","last_undegraded":"2024-09-13T17:11:27.344760+0000","last_fullsized":"2024-09-13T17:11:27.344760+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:26.813987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.177595+0000","last_change":"2024-09-13T17:11:23.005619+0000","last_active":"2024-09-13T17:11:47.177595+0000","last_peered":"2024-09-13T17:11:47.177595+0000","last_clean":"2024-09-13T17:11:47.177595+0000","last_became_active":"2024-09-13T17:11:23.005077+0000","last_became_peered":"2024-09-13T17:11:23.005077+0000","last_unstale":"2024-09-13T17:11:47.177595+0000","last_undegraded":"2024-09-13T17:11:47.177595+0000","last_fullsized":"2024-09-13T17:11:47.177595+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:51.739773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.365375+0000","last_change":"2024-09-13T17:11:27.364603+0000","last_active":"2024-09-13T17:11:27.365375+0000","last_peered":"2024-09-13T17:11:27.365375+0000","last_clean":"2024-09-13T17:11:27.365375+0000","last_became_active":"2024-09-13T17:11:27.364226+0000","last_became_peered":"2024-09-13T17:11:27.364226+0000","last_unstale":"2024-09-13T17:11:27.365375+0000","last_undegraded":"2024-09-13T17:11:27.365375+0000","last_fullsized":"2024-09-13T17:11:27.365375+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:56.802016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.352784+0000","last_change":"2024-09-13T17:11:23.338657+0000","last_active":"2024-09-13T17:11:27.352784+0000","last_peered":"2024-09-13T17:11:27.352784+0000","last_clean":"2024-09-13T17:11:27.352784+0000","last_became_active":"2024-09-13T17:11:23.338377+0000","last_became_peered":"2024-09-13T17:11:23.338377+0000","last_unstale":"2024-09-13T17:11:27.352784+0000","last_undegraded":"2024-09-13T17:11:27.352784+0000","last_fullsized":"2024-09-13T17:11:27.352784+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:52.412887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'23","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.114064+0000","last_change":"2024-09-13T17:11:22.998541+0000","last_active":"2024-09-13T17:11:49.114064+0000","last_peered":"2024-09-13T17:11:49.114064+0000","last_clean":"2024-09-13T17:11:49.114064+0000","last_became_active":"2024-09-13T17:11:22.998132+0000","last_became_peered":"2024-09-13T17:11:22.998132+0000","last_unstale":"2024-09-13T17:11:49.114064+0000","last_undegraded":"2024-09-13T17:11:49.114064+0000","last_fullsized":"2024-09-13T17:11:49.114064+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:16.777772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40425,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":26,"num_write":24,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.557394+0000","last_change":"2024-09-13T17:11:27.361917+0000","last_active":"2024-09-13T17:11:27.557394+0000","last_peered":"2024-09-13T17:11:27.557394+0000","last_clean":"2024-09-13T17:11:27.557394+0000","last_became_active":"2024-09-13T17:11:27.361503+0000","last_became_peered":"2024-09-13T17:11:27.361503+0000","last_unstale":"2024-09-13T17:11:27.557394+0000","last_undegraded":"2024-09-13T17:11:27.557394+0000","last_fullsized":"2024-09-13T17:11:27.557394+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:52.959017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.346573+0000","last_change":"2024-09-13T17:11:23.343648+0000","last_active":"2024-09-13T17:11:27.346573+0000","last_peered":"2024-09-13T17:11:27.346573+0000","last_clean":"2024-09-13T17:11:27.346573+0000","last_became_active":"2024-09-13T17:11:23.343183+0000","last_became_peered":"2024-09-13T17:11:23.343183+0000","last_unstale":"2024-09-13T17:11:27.346573+0000","last_undegraded":"2024-09-13T17:11:27.346573+0000","last_fullsized":"2024-09-13T17:11:27.346573+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:32:49.585628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.833035+0000","last_change":"2024-09-13T17:11:23.004059+0000","last_active":"2024-09-13T17:11:27.833035+0000","last_peered":"2024-09-13T17:11:27.833035+0000","last_clean":"2024-09-13T17:11:27.833035+0000","last_became_active":"2024-09-13T17:11:23.003248+0000","last_became_peered":"2024-09-13T17:11:23.003248+0000","last_unstale":"2024-09-13T17:11:27.833035+0000","last_undegraded":"2024-09-13T17:11:27.833035+0000","last_fullsized":"2024-09-13T17:11:27.833035+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:05.496872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537877+0000","last_change":"2024-09-13T17:11:27.362880+0000","last_active":"2024-09-13T17:11:29.537877+0000","last_peered":"2024-09-13T17:11:29.537877+0000","last_clean":"2024-09-13T17:11:29.537877+0000","last_became_active":"2024-09-13T17:11:27.362471+0000","last_became_peered":"2024-09-13T17:11:27.362471+0000","last_unstale":"2024-09-13T17:11:29.537877+0000","last_undegraded":"2024-09-13T17:11:29.537877+0000","last_fullsized":"2024-09-13T17:11:29.537877+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:49.964606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"peering","last_fresh":"2024-09-13T17:11:48.798762+0000","last_change":"2024-09-13T17:11:48.798906+0000","last_active":"2024-09-13T17:11:48.798762+0000","last_peered":"2024-09-13T17:11:27.833117+0000","last_clean":"2024-09-13T17:11:27.833117+0000","last_became_active":"2024-09-13T17:11:23.332871+0000","last_became_peered":"2024-09-13T17:11:23.332871+0000","last_unstale":"2024-09-13T17:11:48.798762+0000","last_undegraded":"2024-09-13T17:11:48.798762+0000","last_fullsized":"2024-09-13T17:11:48.798762+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:27.370999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,7],"acting":[0,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,5,7,8],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:46.176492+0000","last_change":"2024-09-13T17:11:22.999158+0000","last_active":"2024-09-13T17:11:46.176492+0000","last_peered":"2024-09-13T17:11:46.176492+0000","last_clean":"2024-09-13T17:11:46.176492+0000","last_became_active":"2024-09-13T17:11:22.998795+0000","last_became_peered":"2024-09-13T17:11:22.998795+0000","last_unstale":"2024-09-13T17:11:46.176492+0000","last_undegraded":"2024-09-13T17:11:46.176492+0000","last_fullsized":"2024-09-13T17:11:46.176492+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:23.880769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.557331+0000","last_change":"2024-09-13T17:11:27.358105+0000","last_active":"2024-09-13T17:11:27.557331+0000","last_peered":"2024-09-13T17:11:27.557331+0000","last_clean":"2024-09-13T17:11:27.557331+0000","last_became_active":"2024-09-13T17:11:27.357740+0000","last_became_peered":"2024-09-13T17:11:27.357740+0000","last_unstale":"2024-09-13T17:11:27.557331+0000","last_undegraded":"2024-09-13T17:11:27.557331+0000","last_fullsized":"2024-09-13T17:11:27.557331+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:44.837353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345210+0000","last_change":"2024-09-13T17:11:23.338736+0000","last_active":"2024-09-13T17:11:27.345210+0000","last_peered":"2024-09-13T17:11:27.345210+0000","last_clean":"2024-09-13T17:11:27.345210+0000","last_became_active":"2024-09-13T17:11:23.338462+0000","last_became_peered":"2024-09-13T17:11:23.338462+0000","last_unstale":"2024-09-13T17:11:27.345210+0000","last_undegraded":"2024-09-13T17:11:27.345210+0000","last_fullsized":"2024-09-13T17:11:27.345210+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:49.221314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'3","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.800595+0000","last_change":"2024-09-13T17:11:23.001966+0000","last_active":"2024-09-13T17:11:48.800595+0000","last_peered":"2024-09-13T17:11:48.800595+0000","last_clean":"2024-09-13T17:11:48.800595+0000","last_became_active":"2024-09-13T17:11:23.001565+0000","last_became_peered":"2024-09-13T17:11:23.001565+0000","last_unstale":"2024-09-13T17:11:48.800595+0000","last_undegraded":"2024-09-13T17:11:48.800595+0000","last_fullsized":"2024-09-13T17:11:48.800595+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:47.240702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.833316+0000","last_change":"2024-09-13T17:11:27.360896+0000","last_active":"2024-09-13T17:11:27.833316+0000","last_peered":"2024-09-13T17:11:27.833316+0000","last_clean":"2024-09-13T17:11:27.833316+0000","last_became_active":"2024-09-13T17:11:27.360552+0000","last_became_peered":"2024-09-13T17:11:27.360552+0000","last_unstale":"2024-09-13T17:11:27.833316+0000","last_undegraded":"2024-09-13T17:11:27.833316+0000","last_fullsized":"2024-09-13T17:11:27.833316+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:08.726724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.108810+0000","last_change":"2024-09-13T17:11:27.356317+0000","last_active":"2024-09-13T17:11:29.108810+0000","last_peered":"2024-09-13T17:11:29.108810+0000","last_clean":"2024-09-13T17:11:29.108810+0000","last_became_active":"2024-09-13T17:11:27.355863+0000","last_became_peered":"2024-09-13T17:11:27.355863+0000","last_unstale":"2024-09-13T17:11:29.108810+0000","last_undegraded":"2024-09-13T17:11:29.108810+0000","last_fullsized":"2024-09-13T17:11:29.108810+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:29.356048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.557362+0000","last_change":"2024-09-13T17:11:23.344929+0000","last_active":"2024-09-13T17:11:27.557362+0000","last_peered":"2024-09-13T17:11:27.557362+0000","last_clean":"2024-09-13T17:11:27.557362+0000","last_became_active":"2024-09-13T17:11:23.344627+0000","last_became_peered":"2024-09-13T17:11:23.344627+0000","last_unstale":"2024-09-13T17:11:27.557362+0000","last_undegraded":"2024-09-13T17:11:27.557362+0000","last_fullsized":"2024-09-13T17:11:27.557362+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:15.049627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832206+0000","last_change":"2024-09-13T17:11:23.002539+0000","last_active":"2024-09-13T17:11:27.832206+0000","last_peered":"2024-09-13T17:11:27.832206+0000","last_clean":"2024-09-13T17:11:27.832206+0000","last_became_active":"2024-09-13T17:11:23.002206+0000","last_became_peered":"2024-09-13T17:11:23.002206+0000","last_unstale":"2024-09-13T17:11:27.832206+0000","last_undegraded":"2024-09-13T17:11:27.832206+0000","last_fullsized":"2024-09-13T17:11:27.832206+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:57.708167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801253+0000","last_change":"2024-09-13T17:11:27.362667+0000","last_active":"2024-09-13T17:11:48.801253+0000","last_peered":"2024-09-13T17:11:48.801253+0000","last_clean":"2024-09-13T17:11:48.801253+0000","last_became_active":"2024-09-13T17:11:27.362293+0000","last_became_peered":"2024-09-13T17:11:27.362293+0000","last_unstale":"2024-09-13T17:11:48.801253+0000","last_undegraded":"2024-09-13T17:11:48.801253+0000","last_fullsized":"2024-09-13T17:11:48.801253+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:24.446951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.349858+0000","last_change":"2024-09-13T17:11:23.335823+0000","last_active":"2024-09-13T17:11:27.349858+0000","last_peered":"2024-09-13T17:11:27.349858+0000","last_clean":"2024-09-13T17:11:27.349858+0000","last_became_active":"2024-09-13T17:11:23.335491+0000","last_became_peered":"2024-09-13T17:11:23.335491+0000","last_unstale":"2024-09-13T17:11:27.349858+0000","last_undegraded":"2024-09-13T17:11:27.349858+0000","last_fullsized":"2024-09-13T17:11:27.349858+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:42.172559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344221+0000","last_change":"2024-09-13T17:11:22.999477+0000","last_active":"2024-09-13T17:11:27.344221+0000","last_peered":"2024-09-13T17:11:27.344221+0000","last_clean":"2024-09-13T17:11:27.344221+0000","last_became_active":"2024-09-13T17:11:22.999175+0000","last_became_peered":"2024-09-13T17:11:22.999175+0000","last_unstale":"2024-09-13T17:11:27.344221+0000","last_undegraded":"2024-09-13T17:11:27.344221+0000","last_fullsized":"2024-09-13T17:11:27.344221+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:03.817508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.178558+0000","last_change":"2024-09-13T17:11:23.001737+0000","last_active":"2024-09-13T17:11:47.178558+0000","last_peered":"2024-09-13T17:11:47.178558+0000","last_clean":"2024-09-13T17:11:47.178558+0000","last_became_active":"2024-09-13T17:11:23.001296+0000","last_became_peered":"2024-09-13T17:11:23.001296+0000","last_unstale":"2024-09-13T17:11:47.178558+0000","last_undegraded":"2024-09-13T17:11:47.178558+0000","last_fullsized":"2024-09-13T17:11:47.178558+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:08.671244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.356028+0000","last_change":"2024-09-13T17:11:23.337738+0000","last_active":"2024-09-13T17:11:27.356028+0000","last_peered":"2024-09-13T17:11:27.356028+0000","last_clean":"2024-09-13T17:11:27.356028+0000","last_became_active":"2024-09-13T17:11:23.337411+0000","last_became_peered":"2024-09-13T17:11:23.337411+0000","last_unstale":"2024-09-13T17:11:27.356028+0000","last_undegraded":"2024-09-13T17:11:27.356028+0000","last_fullsized":"2024-09-13T17:11:27.356028+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:02.355706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.683948+0000","last_change":"2024-09-13T17:11:27.363174+0000","last_active":"2024-09-13T17:11:27.683948+0000","last_peered":"2024-09-13T17:11:27.683948+0000","last_clean":"2024-09-13T17:11:27.683948+0000","last_became_active":"2024-09-13T17:11:27.362158+0000","last_became_peered":"2024-09-13T17:11:27.362158+0000","last_unstale":"2024-09-13T17:11:27.683948+0000","last_undegraded":"2024-09-13T17:11:27.683948+0000","last_fullsized":"2024-09-13T17:11:27.683948+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:49:52.892616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'5","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:46.177022+0000","last_change":"2024-09-13T17:11:23.000544+0000","last_active":"2024-09-13T17:11:46.177022+0000","last_peered":"2024-09-13T17:11:46.177022+0000","last_clean":"2024-09-13T17:11:46.177022+0000","last_became_active":"2024-09-13T17:11:23.000233+0000","last_became_peered":"2024-09-13T17:11:23.000233+0000","last_unstale":"2024-09-13T17:11:46.177022+0000","last_undegraded":"2024-09-13T17:11:46.177022+0000","last_fullsized":"2024-09-13T17:11:46.177022+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:04.745950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.352666+0000","last_change":"2024-09-13T17:11:23.340104+0000","last_active":"2024-09-13T17:11:27.352666+0000","last_peered":"2024-09-13T17:11:27.352666+0000","last_clean":"2024-09-13T17:11:27.352666+0000","last_became_active":"2024-09-13T17:11:23.339826+0000","last_became_peered":"2024-09-13T17:11:23.339826+0000","last_unstale":"2024-09-13T17:11:27.352666+0000","last_undegraded":"2024-09-13T17:11:27.352666+0000","last_fullsized":"2024-09-13T17:11:27.352666+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:03.101547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.683859+0000","last_change":"2024-09-13T17:11:27.360848+0000","last_active":"2024-09-13T17:11:27.683859+0000","last_peered":"2024-09-13T17:11:27.683859+0000","last_clean":"2024-09-13T17:11:27.683859+0000","last_became_active":"2024-09-13T17:11:27.360416+0000","last_became_peered":"2024-09-13T17:11:27.360416+0000","last_unstale":"2024-09-13T17:11:27.683859+0000","last_undegraded":"2024-09-13T17:11:27.683859+0000","last_fullsized":"2024-09-13T17:11:27.683859+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:06.857649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.800926+0000","last_change":"2024-09-13T17:11:23.334723+0000","last_active":"2024-09-13T17:11:48.800926+0000","last_peered":"2024-09-13T17:11:48.800926+0000","last_clean":"2024-09-13T17:11:48.800926+0000","last_became_active":"2024-09-13T17:11:23.334433+0000","last_became_peered":"2024-09-13T17:11:23.334433+0000","last_unstale":"2024-09-13T17:11:48.800926+0000","last_undegraded":"2024-09-13T17:11:48.800926+0000","last_fullsized":"2024-09-13T17:11:48.800926+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:08.657151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.352210+0000","last_change":"2024-09-13T17:11:23.334882+0000","last_active":"2024-09-13T17:11:27.352210+0000","last_peered":"2024-09-13T17:11:27.352210+0000","last_clean":"2024-09-13T17:11:27.352210+0000","last_became_active":"2024-09-13T17:11:23.334610+0000","last_became_peered":"2024-09-13T17:11:23.334610+0000","last_unstale":"2024-09-13T17:11:27.352210+0000","last_undegraded":"2024-09-13T17:11:27.352210+0000","last_fullsized":"2024-09-13T17:11:27.352210+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:03.932181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.351982+0000","last_change":"2024-09-13T17:11:23.334076+0000","last_active":"2024-09-13T17:11:27.351982+0000","last_peered":"2024-09-13T17:11:27.351982+0000","last_clean":"2024-09-13T17:11:27.351982+0000","last_became_active":"2024-09-13T17:11:23.333801+0000","last_became_peered":"2024-09-13T17:11:23.333801+0000","last_unstale":"2024-09-13T17:11:27.351982+0000","last_undegraded":"2024-09-13T17:11:27.351982+0000","last_fullsized":"2024-09-13T17:11:27.351982+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:07.113045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832811+0000","last_change":"2024-09-13T17:11:23.332306+0000","last_active":"2024-09-13T17:11:27.832811+0000","last_peered":"2024-09-13T17:11:27.832811+0000","last_clean":"2024-09-13T17:11:27.832811+0000","last_became_active":"2024-09-13T17:11:23.331913+0000","last_became_peered":"2024-09-13T17:11:23.331913+0000","last_unstale":"2024-09-13T17:11:27.832811+0000","last_undegraded":"2024-09-13T17:11:27.832811+0000","last_fullsized":"2024-09-13T17:11:27.832811+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:02.927286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344550+0000","last_change":"2024-09-13T17:11:23.335512+0000","last_active":"2024-09-13T17:11:27.344550+0000","last_peered":"2024-09-13T17:11:27.344550+0000","last_clean":"2024-09-13T17:11:27.344550+0000","last_became_active":"2024-09-13T17:11:23.335201+0000","last_became_peered":"2024-09-13T17:11:23.335201+0000","last_unstale":"2024-09-13T17:11:27.344550+0000","last_undegraded":"2024-09-13T17:11:27.344550+0000","last_fullsized":"2024-09-13T17:11:27.344550+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:17.263819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801579+0000","last_change":"2024-09-13T17:11:23.341204+0000","last_active":"2024-09-13T17:11:48.801579+0000","last_peered":"2024-09-13T17:11:48.801579+0000","last_clean":"2024-09-13T17:11:48.801579+0000","last_became_active":"2024-09-13T17:11:23.339848+0000","last_became_peered":"2024-09-13T17:11:23.339848+0000","last_unstale":"2024-09-13T17:11:48.801579+0000","last_undegraded":"2024-09-13T17:11:48.801579+0000","last_fullsized":"2024-09-13T17:11:48.801579+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:15:09.480651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.353662+0000","last_change":"2024-09-13T17:11:23.334741+0000","last_active":"2024-09-13T17:11:27.353662+0000","last_peered":"2024-09-13T17:11:27.353662+0000","last_clean":"2024-09-13T17:11:27.353662+0000","last_became_active":"2024-09-13T17:11:23.334459+0000","last_became_peered":"2024-09-13T17:11:23.334459+0000","last_unstale":"2024-09-13T17:11:27.353662+0000","last_undegraded":"2024-09-13T17:11:27.353662+0000","last_fullsized":"2024-09-13T17:11:27.353662+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:52.379735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.353786+0000","last_change":"2024-09-13T17:11:23.337869+0000","last_active":"2024-09-13T17:11:27.353786+0000","last_peered":"2024-09-13T17:11:27.353786+0000","last_clean":"2024-09-13T17:11:27.353786+0000","last_became_active":"2024-09-13T17:11:23.337581+0000","last_became_peered":"2024-09-13T17:11:23.337581+0000","last_unstale":"2024-09-13T17:11:27.353786+0000","last_undegraded":"2024-09-13T17:11:27.353786+0000","last_fullsized":"2024-09-13T17:11:27.353786+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:49.407474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.354864+0000","last_change":"2024-09-13T17:11:23.337034+0000","last_active":"2024-09-13T17:11:27.354864+0000","last_peered":"2024-09-13T17:11:27.354864+0000","last_clean":"2024-09-13T17:11:27.354864+0000","last_became_active":"2024-09-13T17:11:23.334863+0000","last_became_peered":"2024-09-13T17:11:23.334863+0000","last_unstale":"2024-09-13T17:11:27.354864+0000","last_undegraded":"2024-09-13T17:11:27.354864+0000","last_fullsized":"2024-09-13T17:11:27.354864+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:05.820989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.349144+0000","last_change":"2024-09-13T17:11:23.336713+0000","last_active":"2024-09-13T17:11:27.349144+0000","last_peered":"2024-09-13T17:11:27.349144+0000","last_clean":"2024-09-13T17:11:27.349144+0000","last_became_active":"2024-09-13T17:11:23.336431+0000","last_became_peered":"2024-09-13T17:11:23.336431+0000","last_unstale":"2024-09-13T17:11:27.349144+0000","last_undegraded":"2024-09-13T17:11:27.349144+0000","last_fullsized":"2024-09-13T17:11:27.349144+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:52.709483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345023+0000","last_change":"2024-09-13T17:11:23.340385+0000","last_active":"2024-09-13T17:11:27.345023+0000","last_peered":"2024-09-13T17:11:27.345023+0000","last_clean":"2024-09-13T17:11:27.345023+0000","last_became_active":"2024-09-13T17:11:23.340068+0000","last_became_peered":"2024-09-13T17:11:23.340068+0000","last_unstale":"2024-09-13T17:11:27.345023+0000","last_undegraded":"2024-09-13T17:11:27.345023+0000","last_fullsized":"2024-09-13T17:11:27.345023+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:17.795222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345000+0000","last_change":"2024-09-13T17:11:23.329214+0000","last_active":"2024-09-13T17:11:27.345000+0000","last_peered":"2024-09-13T17:11:27.345000+0000","last_clean":"2024-09-13T17:11:27.345000+0000","last_became_active":"2024-09-13T17:11:23.328747+0000","last_became_peered":"2024-09-13T17:11:23.328747+0000","last_unstale":"2024-09-13T17:11:27.345000+0000","last_undegraded":"2024-09-13T17:11:27.345000+0000","last_fullsized":"2024-09-13T17:11:27.345000+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:11.233652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801419+0000","last_change":"2024-09-13T17:11:23.339854+0000","last_active":"2024-09-13T17:11:48.801419+0000","last_peered":"2024-09-13T17:11:48.801419+0000","last_clean":"2024-09-13T17:11:48.801419+0000","last_became_active":"2024-09-13T17:11:23.339565+0000","last_became_peered":"2024-09-13T17:11:23.339565+0000","last_unstale":"2024-09-13T17:11:48.801419+0000","last_undegraded":"2024-09-13T17:11:48.801419+0000","last_fullsized":"2024-09-13T17:11:48.801419+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:37.161135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.353415+0000","last_change":"2024-09-13T17:11:23.342562+0000","last_active":"2024-09-13T17:11:27.353415+0000","last_peered":"2024-09-13T17:11:27.353415+0000","last_clean":"2024-09-13T17:11:27.353415+0000","last_became_active":"2024-09-13T17:11:23.342256+0000","last_became_peered":"2024-09-13T17:11:23.342256+0000","last_unstale":"2024-09-13T17:11:27.353415+0000","last_undegraded":"2024-09-13T17:11:27.353415+0000","last_fullsized":"2024-09-13T17:11:27.353415+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:30.788242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.557424+0000","last_change":"2024-09-13T17:11:23.342436+0000","last_active":"2024-09-13T17:11:27.557424+0000","last_peered":"2024-09-13T17:11:27.557424+0000","last_clean":"2024-09-13T17:11:27.557424+0000","last_became_active":"2024-09-13T17:11:23.342157+0000","last_became_peered":"2024-09-13T17:11:23.342157+0000","last_unstale":"2024-09-13T17:11:27.557424+0000","last_undegraded":"2024-09-13T17:11:27.557424+0000","last_fullsized":"2024-09-13T17:11:27.557424+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:56.550875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801559+0000","last_change":"2024-09-13T17:11:23.341660+0000","last_active":"2024-09-13T17:11:48.801559+0000","last_peered":"2024-09-13T17:11:48.801559+0000","last_clean":"2024-09-13T17:11:48.801559+0000","last_became_active":"2024-09-13T17:11:23.341102+0000","last_became_peered":"2024-09-13T17:11:23.341102+0000","last_unstale":"2024-09-13T17:11:48.801559+0000","last_undegraded":"2024-09-13T17:11:48.801559+0000","last_fullsized":"2024-09-13T17:11:48.801559+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:00.546907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345956+0000","last_change":"2024-09-13T17:11:23.338064+0000","last_active":"2024-09-13T17:11:27.345956+0000","last_peered":"2024-09-13T17:11:27.345956+0000","last_clean":"2024-09-13T17:11:27.345956+0000","last_became_active":"2024-09-13T17:11:23.337748+0000","last_became_peered":"2024-09-13T17:11:23.337748+0000","last_unstale":"2024-09-13T17:11:27.345956+0000","last_undegraded":"2024-09-13T17:11:27.345956+0000","last_fullsized":"2024-09-13T17:11:27.345956+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:14.281629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832520+0000","last_change":"2024-09-13T17:11:23.335684+0000","last_active":"2024-09-13T17:11:27.832520+0000","last_peered":"2024-09-13T17:11:27.832520+0000","last_clean":"2024-09-13T17:11:27.832520+0000","last_became_active":"2024-09-13T17:11:23.335364+0000","last_became_peered":"2024-09-13T17:11:23.335364+0000","last_unstale":"2024-09-13T17:11:27.832520+0000","last_undegraded":"2024-09-13T17:11:27.832520+0000","last_fullsized":"2024-09-13T17:11:27.832520+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:02.288009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832521+0000","last_change":"2024-09-13T17:11:23.340881+0000","last_active":"2024-09-13T17:11:27.832521+0000","last_peered":"2024-09-13T17:11:27.832521+0000","last_clean":"2024-09-13T17:11:27.832521+0000","last_became_active":"2024-09-13T17:11:23.340575+0000","last_became_peered":"2024-09-13T17:11:23.340575+0000","last_unstale":"2024-09-13T17:11:27.832521+0000","last_undegraded":"2024-09-13T17:11:27.832521+0000","last_fullsized":"2024-09-13T17:11:27.832521+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:40.757703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344905+0000","last_change":"2024-09-13T17:11:23.329039+0000","last_active":"2024-09-13T17:11:27.344905+0000","last_peered":"2024-09-13T17:11:27.344905+0000","last_clean":"2024-09-13T17:11:27.344905+0000","last_became_active":"2024-09-13T17:11:23.328324+0000","last_became_peered":"2024-09-13T17:11:23.328324+0000","last_unstale":"2024-09-13T17:11:27.344905+0000","last_undegraded":"2024-09-13T17:11:27.344905+0000","last_fullsized":"2024-09-13T17:11:27.344905+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:37.882596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.833586+0000","last_change":"2024-09-13T17:11:23.345229+0000","last_active":"2024-09-13T17:11:27.833586+0000","last_peered":"2024-09-13T17:11:27.833586+0000","last_clean":"2024-09-13T17:11:27.833586+0000","last_became_active":"2024-09-13T17:11:23.344883+0000","last_became_peered":"2024-09-13T17:11:23.344883+0000","last_unstale":"2024-09-13T17:11:27.833586+0000","last_undegraded":"2024-09-13T17:11:27.833586+0000","last_fullsized":"2024-09-13T17:11:27.833586+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:47.983382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.346617+0000","last_change":"2024-09-13T17:11:23.346338+0000","last_active":"2024-09-13T17:11:27.346617+0000","last_peered":"2024-09-13T17:11:27.346617+0000","last_clean":"2024-09-13T17:11:27.346617+0000","last_became_active":"2024-09-13T17:11:23.344777+0000","last_became_peered":"2024-09-13T17:11:23.344777+0000","last_unstale":"2024-09-13T17:11:27.346617+0000","last_undegraded":"2024-09-13T17:11:27.346617+0000","last_fullsized":"2024-09-13T17:11:27.346617+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:23.650174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"peering","last_fresh":"2024-09-13T17:11:48.800882+0000","last_change":"2024-09-13T17:11:48.801055+0000","last_active":"2024-09-13T17:11:48.800882+0000","last_peered":"2024-09-13T17:11:27.834681+0000","last_clean":"2024-09-13T17:11:27.834681+0000","last_became_active":"2024-09-13T17:11:23.334660+0000","last_became_peered":"2024-09-13T17:11:23.334660+0000","last_unstale":"2024-09-13T17:11:48.800882+0000","last_undegraded":"2024-09-13T17:11:48.800882+0000","last_fullsized":"2024-09-13T17:11:48.800882+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:32.110092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,4,9],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344818+0000","last_change":"2024-09-13T17:11:23.340478+0000","last_active":"2024-09-13T17:11:27.344818+0000","last_peered":"2024-09-13T17:11:27.344818+0000","last_clean":"2024-09-13T17:11:27.344818+0000","last_became_active":"2024-09-13T17:11:23.339916+0000","last_became_peered":"2024-09-13T17:11:23.339916+0000","last_unstale":"2024-09-13T17:11:27.344818+0000","last_undegraded":"2024-09-13T17:11:27.344818+0000","last_fullsized":"2024-09-13T17:11:27.344818+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:09.477626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.349777+0000","last_change":"2024-09-13T17:11:23.340882+0000","last_active":"2024-09-13T17:11:27.349777+0000","last_peered":"2024-09-13T17:11:27.349777+0000","last_clean":"2024-09-13T17:11:27.349777+0000","last_became_active":"2024-09-13T17:11:23.340413+0000","last_became_peered":"2024-09-13T17:11:23.340413+0000","last_unstale":"2024-09-13T17:11:27.349777+0000","last_undegraded":"2024-09-13T17:11:27.349777+0000","last_fullsized":"2024-09-13T17:11:27.349777+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:49.040015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344555+0000","last_change":"2024-09-13T17:11:23.345551+0000","last_active":"2024-09-13T17:11:27.344555+0000","last_peered":"2024-09-13T17:11:27.344555+0000","last_clean":"2024-09-13T17:11:27.344555+0000","last_became_active":"2024-09-13T17:11:23.345195+0000","last_became_peered":"2024-09-13T17:11:23.345195+0000","last_unstale":"2024-09-13T17:11:27.344555+0000","last_undegraded":"2024-09-13T17:11:27.344555+0000","last_fullsized":"2024-09-13T17:11:27.344555+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:00.856969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"peering","last_fresh":"2024-09-13T17:11:48.799086+0000","last_change":"2024-09-13T17:11:48.799241+0000","last_active":"2024-09-13T17:11:48.799086+0000","last_peered":"2024-09-13T17:11:27.834170+0000","last_clean":"2024-09-13T17:11:27.834170+0000","last_became_active":"2024-09-13T17:11:23.334061+0000","last_became_peered":"2024-09-13T17:11:23.334061+0000","last_unstale":"2024-09-13T17:11:48.799086+0000","last_undegraded":"2024-09-13T17:11:48.799086+0000","last_fullsized":"2024-09-13T17:11:48.799086+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:40.383855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,7,9],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.353081+0000","last_change":"2024-09-13T17:11:23.340286+0000","last_active":"2024-09-13T17:11:27.353081+0000","last_peered":"2024-09-13T17:11:27.353081+0000","last_clean":"2024-09-13T17:11:27.353081+0000","last_became_active":"2024-09-13T17:11:23.339756+0000","last_became_peered":"2024-09-13T17:11:23.339756+0000","last_unstale":"2024-09-13T17:11:27.353081+0000","last_undegraded":"2024-09-13T17:11:27.353081+0000","last_fullsized":"2024-09-13T17:11:27.353081+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:00.463087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.833501+0000","last_change":"2024-09-13T17:11:23.339818+0000","last_active":"2024-09-13T17:11:27.833501+0000","last_peered":"2024-09-13T17:11:27.833501+0000","last_clean":"2024-09-13T17:11:27.833501+0000","last_became_active":"2024-09-13T17:11:23.339501+0000","last_became_peered":"2024-09-13T17:11:23.339501+0000","last_unstale":"2024-09-13T17:11:27.833501+0000","last_undegraded":"2024-09-13T17:11:27.833501+0000","last_fullsized":"2024-09-13T17:11:27.833501+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:36.904004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832723+0000","last_change":"2024-09-13T17:11:23.334388+0000","last_active":"2024-09-13T17:11:27.832723+0000","last_peered":"2024-09-13T17:11:27.832723+0000","last_clean":"2024-09-13T17:11:27.832723+0000","last_became_active":"2024-09-13T17:11:23.333953+0000","last_became_peered":"2024-09-13T17:11:23.333953+0000","last_unstale":"2024-09-13T17:11:27.832723+0000","last_undegraded":"2024-09-13T17:11:27.832723+0000","last_fullsized":"2024-09-13T17:11:27.832723+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:33.929173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832701+0000","last_change":"2024-09-13T17:11:23.338259+0000","last_active":"2024-09-13T17:11:27.832701+0000","last_peered":"2024-09-13T17:11:27.832701+0000","last_clean":"2024-09-13T17:11:27.832701+0000","last_became_active":"2024-09-13T17:11:23.337979+0000","last_became_peered":"2024-09-13T17:11:23.337979+0000","last_unstale":"2024-09-13T17:11:27.832701+0000","last_undegraded":"2024-09-13T17:11:27.832701+0000","last_fullsized":"2024-09-13T17:11:27.832701+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:55.750255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801517+0000","last_change":"2024-09-13T17:11:23.337899+0000","last_active":"2024-09-13T17:11:48.801517+0000","last_peered":"2024-09-13T17:11:48.801517+0000","last_clean":"2024-09-13T17:11:48.801517+0000","last_became_active":"2024-09-13T17:11:23.337626+0000","last_became_peered":"2024-09-13T17:11:23.337626+0000","last_unstale":"2024-09-13T17:11:48.801517+0000","last_undegraded":"2024-09-13T17:11:48.801517+0000","last_fullsized":"2024-09-13T17:11:48.801517+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:14.654852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":43759,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":23,"num_read_kb":40,"num_write":124,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":58679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285958,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383698,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":995328,"data_stored":499901,"data_compressed":17667,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.35499999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.497}]},{"osd":2,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.58199999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.41799999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.50900000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.67700000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":9,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.52000000000000002}]},{"osd":10,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.60599999999999998}]}]},{"osd":10,"up_from":72,"seq":309237645334,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":1105920,"data_stored":1118312,"data_compressed":51052,"data_compressed_allocated":65536,"data_compressed_original":630784,"omap_allocated":1597,"internal_metadata":36043203},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.52200000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.374},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.39700000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.624},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.60899999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.54500000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.443}]},{"osd":6,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.70999999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.51200000000000001}]},{"osd":8,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.50900000000000001}]},{"osd":9,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.67500000000000004}]},{"osd":11,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.746}]}]},{"osd":9,"up_from":67,"seq":287762808858,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":978944,"data_stored":477347,"data_compressed":11720,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1597,"internal_metadata":31848899},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.315}]},{"osd":1,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.503},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.39100000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.40799999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.27100000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.51300000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.39900000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.49299999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.66500000000000004}]},{"osd":8,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.54200000000000004}]},{"osd":10,"last update":"Fri Sep 13 17:11:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.55700000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]}]},{"osd":8,"up_from":59,"seq":253403070496,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":477301,"data_compressed":11720,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67600000000000005,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.65500000000000003,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.67500000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54300000000000004,"15min":0.54400000000000004},"min":{"1min":0.34599999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71799999999999997,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.79900000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.41899999999999998,"15min":0.41799999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.63100000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.441,"15min":0.438},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70899999999999996,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.68999999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.73899999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.81299999999999994}]},{"osd":5,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.753},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53400000000000003,"15min":0.53600000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76700000000000002,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.78000000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.64400000000000002,"15min":0.64900000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.85999999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64700000000000002,"15min":0.64600000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92200000000000004,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90900000000000003,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.94999999999999996}]},{"osd":9,"last update":"Fri Sep 13 17:10:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.873},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.84699999999999998}]},{"osd":10,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.92900000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]}]},{"osd":7,"up_from":51,"seq":219043332132,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":1069019,"data_compressed":48079,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1587,"internal_metadata":27654605},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.39700000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.66200000000000003,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.35799999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.52500000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.35999999999999999,"15min":0.35399999999999998},"min":{"1min":0.25800000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.34999999999999998,"15min":0.34399999999999997},"min":{"1min":0.32200000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.623}]},{"osd":2,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52800000000000002,"15min":0.52100000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.502},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.51400000000000001,"15min":0.50700000000000001},"min":{"1min":0.39100000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.52200000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.51000000000000001,"15min":0.502},"min":{"1min":0.38100000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67500000000000004,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.53400000000000003},"min":{"1min":0.42899999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.81200000000000006}]},{"osd":4,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46200000000000002,"15min":0.45700000000000002},"min":{"1min":0.29899999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.442,"15min":0.439},"min":{"1min":0.31900000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.44500000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.56899999999999995,"15min":0.56200000000000006},"min":{"1min":0.5,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57499999999999996,"15min":0.57199999999999995},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.47799999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.44700000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.59799999999999998,"15min":0.58699999999999997},"min":{"1min":0.45600000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.86599999999999999}]},{"osd":8,"last update":"Fri Sep 13 17:11:31 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.63600000000000001,"15min":0.628},"min":{"1min":0.504,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.65300000000000002,"15min":0.64200000000000002},"min":{"1min":0.47899999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.70299999999999996}]},{"osd":9,"last update":"Fri Sep 13 17:10:49 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.78900000000000003}]},{"osd":10,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.74299999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]}]},{"osd":6,"up_from":46,"seq":197568495656,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":476563,"data_compressed":11720,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.34200000000000003,"15min":0.33500000000000002},"min":{"1min":0.23400000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.373,"15min":0.36899999999999999},"min":{"1min":0.26500000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.57399999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.29899999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.74199999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.63600000000000001,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.47399999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68999999999999995,"5min":1.095,"15min":1.095},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54100000000000004,"15min":0.52600000000000002},"min":{"1min":0.35899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.77300000000000002,"5min":0.877,"15min":0.877},"last":0.67700000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.42199999999999999,"15min":0.41599999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.626,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41799999999999998,"15min":0.41199999999999998},"min":{"1min":0.28199999999999997,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58599999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.40999999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51000000000000001,"15min":0.502},"min":{"1min":0.41199999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71699999999999997,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.39200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76100000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.59599999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.70599999999999996,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59599999999999997,"15min":0.60299999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.73999999999999999,"5min":1.131,"15min":1.131},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.436},{"interface":"front","average":{"1min":0.628,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.71199999999999997}]},{"osd":8,"last update":"Fri Sep 13 17:11:28 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.623,"15min":0.627},"min":{"1min":0.42399999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.85899999999999999,"5min":0.874,"15min":0.874},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.69799999999999995}]},{"osd":9,"last update":"Fri Sep 13 17:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.63300000000000001}]},{"osd":10,"last update":"Fri Sep 13 17:11:12 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.74299999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]}]},{"osd":5,"up_from":38,"seq":163208757293,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":1036288,"data_stored":1068028,"data_compressed":48079,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48399999999999999,"15min":0.47599999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67300000000000004,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48799999999999999,"15min":0.47999999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69499999999999995,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.56299999999999994}]},{"osd":1,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55100000000000005,"15min":0.54400000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68600000000000005,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.371,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.67600000000000005,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.58099999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.377,"15min":0.371},"min":{"1min":0.23499999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.58699999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.378,"15min":0.372},"min":{"1min":0.253,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.59099999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.39700000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50700000000000001,"15min":0.501},"min":{"1min":0.30199999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.69599999999999995,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.63800000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.67300000000000004}]},{"osd":4,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73099999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56999999999999995,"15min":0.56000000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.629}]},{"osd":6,"last update":"Fri Sep 13 17:11:41 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.75},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56100000000000005,"15min":0.56000000000000005},"min":{"1min":0.39100000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.74199999999999999,"5min":0.749,"15min":0.749},"last":0.74199999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.46400000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.44,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.71599999999999997}]},{"osd":8,"last update":"Fri Sep 13 17:11:26 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52500000000000002,"15min":0.53100000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69199999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55800000000000005,"15min":0.56599999999999995},"min":{"1min":0.39800000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.70299999999999996,"5min":0.747,"15min":0.747},"last":0.52000000000000002}]},{"osd":9,"last update":"Fri Sep 13 17:10:47 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.81000000000000005}]},{"osd":10,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.77800000000000002}]}]},{"osd":4,"up_from":33,"seq":141733920819,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36176,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708976,"statfs":{"total":95995035648,"available":95957991424,"internally_reserved":0,"allocated":987136,"data_stored":490408,"data_compressed":14693,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":0.71699999999999997,"15min":0.59099999999999997},"min":{"1min":0.42399999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":15.369999999999999,"5min":15.369999999999999,"15min":15.369999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":1.4950000000000001,"5min":0.68200000000000005,"15min":0.54400000000000004},"min":{"1min":0.45900000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":15.416,"5min":15.416,"15min":15.416},"last":0.35399999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.36499999999999999,"15min":0.35899999999999999},"min":{"1min":0.25900000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38600000000000001},"min":{"1min":0.28699999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.60099999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.34799999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":0.74099999999999999,"15min":0.61699999999999999},"min":{"1min":0.379,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":15.401,"5min":15.401,"15min":15.401},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.52900000000000003,"15min":0.51900000000000002},"min":{"1min":0.39500000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.745,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.47599999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53900000000000003,"15min":0.54900000000000004},"min":{"1min":0.375,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76900000000000002,"5min":1.016,"15min":1.016},"last":0.39100000000000001},{"interface":"front","average":{"1min":1.524,"5min":0.74099999999999999,"15min":0.61699999999999999},"min":{"1min":0.39400000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":15.425000000000001,"5min":15.425000000000001,"15min":15.425000000000001},"last":0.40699999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57299999999999995,"15min":0.56399999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77900000000000003,"5min":1.073,"15min":1.073},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.73399999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.53500000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.54800000000000004,"15min":0.51800000000000002},"min":{"1min":0.40200000000000002,"5min":0.371,"15min":0.371},"max":{"1min":2.6469999999999998,"5min":2.6469999999999998,"15min":2.6469999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57599999999999996,"15min":0.55600000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.45400000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:11:00 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48199999999999998,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69399999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.48299999999999998,"15min":0.47899999999999998},"min":{"1min":0.34399999999999997,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.49399999999999999}]},{"osd":8,"last update":"Fri Sep 13 17:11:26 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.65200000000000002,"15min":0.63900000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.577,"5min":2.577,"15min":2.577},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.65500000000000003,"15min":0.64600000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.60299999999999998}]},{"osd":9,"last update":"Fri Sep 13 17:10:49 2024","interfaces":[{"interface":"back","average":{"1min":1.615,"5min":1.615,"15min":1.615},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":15.448,"5min":15.448,"15min":15.448},"last":0.55500000000000005},{"interface":"front","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":15.385,"5min":15.385,"15min":15.385},"last":0.63}]},{"osd":10,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.51100000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]},{"osd":3,"up_from":25,"seq":107374182454,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":476063,"data_compressed":11720,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34000000000000002,"15min":0.317},"min":{"1min":0.22500000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.34399999999999997,"15min":0.32200000000000001},"min":{"1min":0.23899999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.60899999999999999,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.27400000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52400000000000002,"15min":0.49399999999999999},"min":{"1min":0.32900000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78900000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51200000000000001,"15min":0.48299999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.60999999999999999,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.57199999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51500000000000001,"15min":0.496},"min":{"1min":0.34000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67800000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53800000000000003,"15min":0.50700000000000001},"min":{"1min":0.34200000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.73999999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.58099999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:10:55 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.53000000000000003,"15min":0.51400000000000001},"min":{"1min":0.372,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.625,"5min":0.53200000000000003,"15min":0.50700000000000001},"min":{"1min":0.40500000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.42899999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55900000000000005,"15min":0.55400000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70399999999999996,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.56000000000000005,"15min":0.56100000000000005},"min":{"1min":0.35199999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.754,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.60999999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:11:43 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.45200000000000001,"15min":0.44600000000000001},"min":{"1min":0.28199999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68000000000000005,"5min":0.746,"15min":0.746},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.45700000000000002,"15min":0.443},"min":{"1min":0.29499999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70199999999999996,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.35599999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:11:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58399999999999996,"15min":0.57799999999999996},"min":{"1min":0.42599999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.77500000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.503},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.45500000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.59099999999999997}]},{"osd":8,"last update":"Fri Sep 13 17:10:26 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66400000000000003}]},{"osd":9,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.45200000000000001}]},{"osd":10,"last update":"Fri Sep 13 17:11:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.53300000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]}]},{"osd":2,"up_from":18,"seq":77309411388,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":480693,"data_compressed":11720,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:09 2024","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":0.76600000000000001,"15min":0.73999999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":19.158999999999999,"5min":19.158999999999999,"15min":19.158999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.47599999999999998,"15min":0.46700000000000003},"min":{"1min":0.33700000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68500000000000005,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.57999999999999996}]},{"osd":1,"last update":"Fri Sep 13 17:11:09 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.501,"15min":0.47499999999999998},"min":{"1min":0.38,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68600000000000005,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.498,"15min":0.46800000000000003},"min":{"1min":0.40100000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.92800000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:11:36 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.51900000000000002,"15min":0.5},"min":{"1min":0.41299999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52700000000000002,"15min":0.50600000000000001},"min":{"1min":0.42999999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71899999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.64700000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.51100000000000001},"min":{"1min":0.41499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72199999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.40300000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.65800000000000003,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.79900000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:11:14 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.39900000000000002,"15min":0.39100000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.64500000000000002,"5min":0.747,"15min":0.747},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39800000000000002,"15min":0.39200000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.68799999999999994,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.77800000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:11:38 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54000000000000004},"min":{"1min":0.41699999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68300000000000005,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.875},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.69799999999999995,"15min":0.58699999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82499999999999996,"5min":19.276,"15min":19.276},"last":0.94299999999999995}]},{"osd":7,"last update":"Fri Sep 13 17:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.36699999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76200000000000001,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.41699999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76600000000000001,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.91300000000000003}]},{"osd":8,"last update":"Fri Sep 13 17:11:25 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53700000000000003,"15min":0.53500000000000003},"min":{"1min":0.33100000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76000000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56399999999999995,"15min":0.56100000000000005},"min":{"1min":0.35799999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":1.0309999999999999}]},{"osd":9,"last update":"Fri Sep 13 17:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":19.210999999999999,"5min":19.210999999999999,"15min":19.210999999999999},"last":1.0409999999999999}]},{"osd":10,"last update":"Fri Sep 13 17:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":1.01},{"interface":"front","average":{"1min":1.595,"5min":1.595,"15min":1.595},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":19.242000000000001,"5min":19.242000000000001,"15min":19.242000000000001},"last":1.0529999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":974848,"data_stored":480358,"data_compressed":11720,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:53 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.47799999999999998,"15min":0.46200000000000002},"min":{"1min":0.35199999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.48199999999999998,"15min":0.46500000000000002},"min":{"1min":0.32700000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.65500000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:11:08 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.52800000000000002,"15min":0.504},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.76900000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.52100000000000002,"15min":0.503},"min":{"1min":0.375,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.72199999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:11:37 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70599999999999996,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54700000000000004,"15min":0.52800000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70299999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.70799999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:10:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.39500000000000002,"15min":0.377},"min":{"1min":0.29199999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.38100000000000001,"15min":0.36299999999999999},"min":{"1min":0.26600000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.50600000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:11:21 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.52900000000000003,"15min":0.51300000000000001},"min":{"1min":0.35399999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.52600000000000002,"15min":0.502},"min":{"1min":0.39900000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.78700000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:11:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54000000000000004,"15min":0.52400000000000002},"min":{"1min":0.38500000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73199999999999998,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.59499999999999997,"15min":0.57499999999999996},"min":{"1min":0.45700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.82799999999999996,"5min":0.88,"15min":0.88},"last":0.76500000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:11:00 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.48999999999999999,"15min":0.47599999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.49399999999999999,"15min":0.48399999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.54800000000000004}]},{"osd":8,"last update":"Fri Sep 13 17:11:26 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.626,"15min":0.61699999999999999},"min":{"1min":0.41599999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.67300000000000004,"15min":0.66300000000000003},"min":{"1min":0.44,"5min":0.434,"15min":0.434},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.88200000000000001}]},{"osd":9,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.748}]},{"osd":10,"last update":"Fri Sep 13 17:11:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.86399999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":987136,"data_stored":477768,"data_compressed":11720,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:10:49 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.47299999999999998,"15min":0.46600000000000003},"min":{"1min":0.29899999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.49199999999999999,"15min":0.48099999999999998},"min":{"1min":0.28499999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.59399999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:11:08 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.52100000000000002,"15min":0.505},"min":{"1min":0.374,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77900000000000003,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.501},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.53000000000000003,"15min":0.50700000000000001},"min":{"1min":0.38100000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.624}]},{"osd":3,"last update":"Fri Sep 13 17:10:27 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.40999999999999998,"15min":0.40100000000000002},"min":{"1min":0.23499999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.432},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.39700000000000002,"15min":0.38900000000000001},"min":{"1min":0.26400000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.317}]},{"osd":4,"last update":"Fri Sep 13 17:10:55 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.496,"15min":0.47999999999999998},"min":{"1min":0.34100000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.52100000000000002,"15min":0.503},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Sep 13 17:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52100000000000002,"15min":0.50900000000000001},"min":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82399999999999995,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.54800000000000004,"15min":0.53000000000000003},"min":{"1min":0.42799999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80500000000000005,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.60799999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:11:41 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.433,"15min":0.41799999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.65100000000000002,"5min":0.754,"15min":0.754},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.44800000000000001,"15min":0.42999999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72899999999999998,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.376}]},{"osd":7,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.57999999999999996,"15min":0.57099999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.57599999999999996}]},{"osd":8,"last update":"Fri Sep 13 17:11:30 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.60499999999999998,"15min":0.60699999999999998},"min":{"1min":0.46500000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.77200000000000002,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.65200000000000002,"15min":0.65800000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90200000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.41899999999999998}]},{"osd":9,"last update":"Fri Sep 13 17:10:49 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.44500000000000001}]},{"osd":10,"last update":"Fri Sep 13 17:11:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.58499999999999996}]},{"osd":11,"last update":"Fri Sep 13 17:11:36 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.53700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34721,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34721,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34721,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":41955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:11:50.751 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:11:50.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.881+0000 7f2d74901640 1 -- 172.21.15.87:0/3570708604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d70101ac0 msgr2=0x7f2d70108350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:50.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.881+0000 7f2d74901640 1 --2- 172.21.15.87:0/3570708604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d70101ac0 0x7f2d70108350 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2d68009ca0 tx=0x7f2d6802a8c0 comp rx=0 tx=0).stop 2024-09-13T17:11:50.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.881+0000 7f2d74901640 1 -- 172.21.15.87:0/3570708604 shutdown_connections 2024-09-13T17:11:50.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.881+0000 7f2d74901640 1 --2- 172.21.15.87:0/3570708604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d70101ac0 0x7f2d70108350 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:50.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.881+0000 7f2d74901640 1 --2- 172.21.15.87:0/3570708604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d70101100 0x7f2d70101580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:50.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.881+0000 7f2d74901640 1 --2- 172.21.15.87:0/3570708604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d700fe090 0x7f2d700fe490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:50.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.881+0000 7f2d74901640 1 -- 172.21.15.87:0/3570708604 >> 172.21.15.87:0/3570708604 conn(0x7f2d700f9bb0 msgr2=0x7f2d700fbfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:50.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.881+0000 7f2d74901640 1 -- 172.21.15.87:0/3570708604 shutdown_connections 2024-09-13T17:11:50.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.881+0000 7f2d74901640 1 -- 172.21.15.87:0/3570708604 wait complete. 2024-09-13T17:11:50.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.882+0000 7f2d74901640 1 Processor -- start 2024-09-13T17:11:50.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.882+0000 7f2d74901640 1 -- start start 2024-09-13T17:11:50.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.882+0000 7f2d74901640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d700fe090 0x7f2d70100a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:50.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.882+0000 7f2d74901640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d70101100 0x7f2d700ff0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:50.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.882+0000 7f2d74901640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d70101ac0 0x7f2d700ff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:50.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.882+0000 7f2d74901640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d700ffd50 con 0x7f2d70101ac0 2024-09-13T17:11:50.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.882+0000 7f2d74901640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d700ffec0 con 0x7f2d700fe090 2024-09-13T17:11:50.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.882+0000 7f2d74901640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7019fe80 con 0x7f2d70101100 2024-09-13T17:11:50.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.882+0000 7f2d6ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d70101ac0 0x7f2d700ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:50.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.882+0000 7f2d6ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d70101ac0 0x7f2d700ff5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45560/0 (socket says 172.21.15.87:45560) 2024-09-13T17:11:50.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.882+0000 7f2d6ed9d640 1 -- 172.21.15.87:0/2507350419 learned_addr learned my addr 172.21.15.87:0/2507350419 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:50.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.882+0000 7f2d6dd9b640 1 --2- 172.21.15.87:0/2507350419 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d70101100 0x7f2d700ff0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:50.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.882+0000 7f2d6e59c640 1 --2- 172.21.15.87:0/2507350419 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d700fe090 0x7f2d70100a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:50.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.882+0000 7f2d6ed9d640 1 -- 172.21.15.87:0/2507350419 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d70101100 msgr2=0x7f2d700ff0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:50.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.882+0000 7f2d6ed9d640 1 --2- 172.21.15.87:0/2507350419 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d70101100 0x7f2d700ff0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:50.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.882+0000 7f2d6ed9d640 1 -- 172.21.15.87:0/2507350419 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d700fe090 msgr2=0x7f2d70100a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:50.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.882+0000 7f2d6ed9d640 1 --2- 172.21.15.87:0/2507350419 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d700fe090 0x7f2d70100a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:50.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.882+0000 7f2d6ed9d640 1 -- 172.21.15.87:0/2507350419 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d68009900 con 0x7f2d70101ac0 2024-09-13T17:11:50.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.882+0000 7f2d6ed9d640 1 --2- 172.21.15.87:0/2507350419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d70101ac0 0x7f2d700ff5f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2d68033040 tx=0x7f2d68031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:50.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.883+0000 7f2d677fe640 1 -- 172.21.15.87:0/2507350419 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6802f310 con 0x7f2d70101ac0 2024-09-13T17:11:50.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.883+0000 7f2d677fe640 1 -- 172.21.15.87:0/2507350419 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2d68040070 con 0x7f2d70101ac0 2024-09-13T17:11:50.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.883+0000 7f2d74901640 1 -- 172.21.15.87:0/2507350419 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d701a00d0 con 0x7f2d70101ac0 2024-09-13T17:11:50.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.883+0000 7f2d677fe640 1 -- 172.21.15.87:0/2507350419 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d68004640 con 0x7f2d70101ac0 2024-09-13T17:11:50.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.883+0000 7f2d74901640 1 -- 172.21.15.87:0/2507350419 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d701a05e0 con 0x7f2d70101ac0 2024-09-13T17:11:50.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.884+0000 7f2d74901640 1 -- 172.21.15.87:0/2507350419 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d701073f0 con 0x7f2d70101ac0 2024-09-13T17:11:50.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.885+0000 7f2d677fe640 1 -- 172.21.15.87:0/2507350419 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f2d68042030 con 0x7f2d70101ac0 2024-09-13T17:11:50.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.885+0000 7f2d677fe640 1 --2- 172.21.15.87:0/2507350419 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2d5c0a1120 0x7f2d5c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:50.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.885+0000 7f2d6e59c640 1 --2- 172.21.15.87:0/2507350419 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2d5c0a1120 0x7f2d5c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:50.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.885+0000 7f2d677fe640 1 -- 172.21.15.87:0/2507350419 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8978+0+0 (secure 0 0 0) 0x7f2d680ee570 con 0x7f2d70101ac0 2024-09-13T17:11:50.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.886+0000 7f2d6e59c640 1 --2- 172.21.15.87:0/2507350419 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2d5c0a1120 0x7f2d5c0a35e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2d580058c0 tx=0x7f2d5800a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:50.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:50.889+0000 7f2d677fe640 1 -- 172.21.15.87:0/2507350419 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2d680b79c0 con 0x7f2d70101ac0 2024-09-13T17:11:51.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.047+0000 7f2d74901640 1 -- 172.21.15.87:0/2507350419 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2d7002c450 con 0x7f2d5c0a1120 2024-09-13T17:11:51.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.058+0000 7f2d677fe640 1 -- 172.21.15.87:0/2507350419 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+424210 (secure 0 0 0) 0x7f2d7002c450 con 0x7f2d5c0a1120 2024-09-13T17:11:51.064 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:11:51.067 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-13T17:11:51.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.061+0000 7f2d74901640 1 -- 172.21.15.87:0/2507350419 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2d5c0a1120 msgr2=0x7f2d5c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:51.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.061+0000 7f2d74901640 1 --2- 172.21.15.87:0/2507350419 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2d5c0a1120 0x7f2d5c0a35e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2d580058c0 tx=0x7f2d5800a4c0 comp rx=0 tx=0).stop 2024-09-13T17:11:51.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.061+0000 7f2d74901640 1 -- 172.21.15.87:0/2507350419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d70101ac0 msgr2=0x7f2d700ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:51.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.061+0000 7f2d74901640 1 --2- 172.21.15.87:0/2507350419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d70101ac0 0x7f2d700ff5f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2d68033040 tx=0x7f2d68031700 comp rx=0 tx=0).stop 2024-09-13T17:11:51.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.061+0000 7f2d74901640 1 -- 172.21.15.87:0/2507350419 shutdown_connections 2024-09-13T17:11:51.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.061+0000 7f2d74901640 1 --2- 172.21.15.87:0/2507350419 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f2d5c0a1120 0x7f2d5c0a35e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:51.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.061+0000 7f2d74901640 1 --2- 172.21.15.87:0/2507350419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d70101ac0 0x7f2d700ff5f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:51.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.061+0000 7f2d74901640 1 --2- 172.21.15.87:0/2507350419 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d70101100 0x7f2d700ff0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:51.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.061+0000 7f2d74901640 1 --2- 172.21.15.87:0/2507350419 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d700fe090 0x7f2d70100a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:51.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.061+0000 7f2d74901640 1 -- 172.21.15.87:0/2507350419 >> 172.21.15.87:0/2507350419 conn(0x7f2d700f9bb0 msgr2=0x7f2d701045c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:51.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.061+0000 7f2d74901640 1 -- 172.21.15.87:0/2507350419 shutdown_connections 2024-09-13T17:11:51.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.062+0000 7f2d74901640 1 -- 172.21.15.87:0/2507350419 wait complete. 2024-09-13T17:11:51.074 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-09-13T17:11:50.074276+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":634361,"num_objects":56,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":159,"num_read_kb":159,"num_write":307,"num_write_kb":3021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376888,"kb_used_data":11704,"kb_used_omap":18,"kb_used_meta":365037,"kb_avail":1124564936,"statfs":{"total":1151940427776,"available":1151554494464,"internally_reserved":0,"allocated":11984896,"data_stored":7591761,"data_compressed":261610,"data_compressed_allocated":348160,"data_compressed_original":2195456,"omap_allocated":19109,"internal_metadata":373798235},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":39400,"num_objects":32,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":23,"num_read_kb":40,"num_write":78,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002224"},"pg_stats":[{"pgid":"2.1f","version":"89'9","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.181045+0000","last_change":"2024-09-13T17:11:22.998997+0000","last_active":"2024-09-13T17:11:47.181045+0000","last_peered":"2024-09-13T17:11:47.181045+0000","last_clean":"2024-09-13T17:11:47.181045+0000","last_became_active":"2024-09-13T17:11:22.998674+0000","last_became_peered":"2024-09-13T17:11:22.998674+0000","last_unstale":"2024-09-13T17:11:47.181045+0000","last_undegraded":"2024-09-13T17:11:47.181045+0000","last_fullsized":"2024-09-13T17:11:47.181045+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:30:50.554788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.348929+0000","last_change":"2024-09-13T17:11:23.340108+0000","last_active":"2024-09-13T17:11:27.348929+0000","last_peered":"2024-09-13T17:11:27.348929+0000","last_clean":"2024-09-13T17:11:27.348929+0000","last_became_active":"2024-09-13T17:11:23.339832+0000","last_became_peered":"2024-09-13T17:11:23.339832+0000","last_unstale":"2024-09-13T17:11:27.348929+0000","last_undegraded":"2024-09-13T17:11:27.348929+0000","last_fullsized":"2024-09-13T17:11:27.348929+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:40.969448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.683504+0000","last_change":"2024-09-13T17:11:27.358090+0000","last_active":"2024-09-13T17:11:27.683504+0000","last_peered":"2024-09-13T17:11:27.683504+0000","last_clean":"2024-09-13T17:11:27.683504+0000","last_became_active":"2024-09-13T17:11:27.357725+0000","last_became_peered":"2024-09-13T17:11:27.357725+0000","last_unstale":"2024-09-13T17:11:27.683504+0000","last_undegraded":"2024-09-13T17:11:27.683504+0000","last_fullsized":"2024-09-13T17:11:27.683504+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:51.617457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'1","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.349083+0000","last_change":"2024-09-13T17:11:23.000779+0000","last_active":"2024-09-13T17:11:27.349083+0000","last_peered":"2024-09-13T17:11:27.349083+0000","last_clean":"2024-09-13T17:11:27.349083+0000","last_became_active":"2024-09-13T17:11:23.000511+0000","last_became_peered":"2024-09-13T17:11:23.000511+0000","last_unstale":"2024-09-13T17:11:27.349083+0000","last_undegraded":"2024-09-13T17:11:27.349083+0000","last_fullsized":"2024-09-13T17:11:27.349083+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:09.802392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.833095+0000","last_change":"2024-09-13T17:11:23.333948+0000","last_active":"2024-09-13T17:11:27.833095+0000","last_peered":"2024-09-13T17:11:27.833095+0000","last_clean":"2024-09-13T17:11:27.833095+0000","last_became_active":"2024-09-13T17:11:23.333679+0000","last_became_peered":"2024-09-13T17:11:23.333679+0000","last_unstale":"2024-09-13T17:11:27.833095+0000","last_undegraded":"2024-09-13T17:11:27.833095+0000","last_fullsized":"2024-09-13T17:11:27.833095+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:10.265157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537784+0000","last_change":"2024-09-13T17:11:27.353767+0000","last_active":"2024-09-13T17:11:29.537784+0000","last_peered":"2024-09-13T17:11:29.537784+0000","last_clean":"2024-09-13T17:11:29.537784+0000","last_became_active":"2024-09-13T17:11:27.353448+0000","last_became_peered":"2024-09-13T17:11:27.353448+0000","last_unstale":"2024-09-13T17:11:29.537784+0000","last_undegraded":"2024-09-13T17:11:29.537784+0000","last_fullsized":"2024-09-13T17:11:29.537784+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:15.948099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.178059+0000","last_change":"2024-09-13T17:11:22.999879+0000","last_active":"2024-09-13T17:11:47.178059+0000","last_peered":"2024-09-13T17:11:47.178059+0000","last_clean":"2024-09-13T17:11:47.178059+0000","last_became_active":"2024-09-13T17:11:22.999577+0000","last_became_peered":"2024-09-13T17:11:22.999577+0000","last_unstale":"2024-09-13T17:11:47.178059+0000","last_undegraded":"2024-09-13T17:11:47.178059+0000","last_fullsized":"2024-09-13T17:11:47.178059+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:48.485532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.346469+0000","last_change":"2024-09-13T17:11:23.339026+0000","last_active":"2024-09-13T17:11:27.346469+0000","last_peered":"2024-09-13T17:11:27.346469+0000","last_clean":"2024-09-13T17:11:27.346469+0000","last_became_active":"2024-09-13T17:11:23.338745+0000","last_became_peered":"2024-09-13T17:11:23.338745+0000","last_unstale":"2024-09-13T17:11:27.346469+0000","last_undegraded":"2024-09-13T17:11:27.346469+0000","last_fullsized":"2024-09-13T17:11:27.346469+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:27.455418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537867+0000","last_change":"2024-09-13T17:11:27.363137+0000","last_active":"2024-09-13T17:11:29.537867+0000","last_peered":"2024-09-13T17:11:29.537867+0000","last_clean":"2024-09-13T17:11:29.537867+0000","last_became_active":"2024-09-13T17:11:27.362621+0000","last_became_peered":"2024-09-13T17:11:27.362621+0000","last_unstale":"2024-09-13T17:11:29.537867+0000","last_undegraded":"2024-09-13T17:11:29.537867+0000","last_fullsized":"2024-09-13T17:11:29.537867+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:35:51.492630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.352962+0000","last_change":"2024-09-13T17:11:22.998066+0000","last_active":"2024-09-13T17:11:27.352962+0000","last_peered":"2024-09-13T17:11:27.352962+0000","last_clean":"2024-09-13T17:11:27.352962+0000","last_became_active":"2024-09-13T17:11:22.997741+0000","last_became_peered":"2024-09-13T17:11:22.997741+0000","last_unstale":"2024-09-13T17:11:27.352962+0000","last_undegraded":"2024-09-13T17:11:27.352962+0000","last_fullsized":"2024-09-13T17:11:27.352962+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:00.353453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.357913+0000","last_change":"2024-09-13T17:11:23.336778+0000","last_active":"2024-09-13T17:11:27.357913+0000","last_peered":"2024-09-13T17:11:27.357913+0000","last_clean":"2024-09-13T17:11:27.357913+0000","last_became_active":"2024-09-13T17:11:23.336491+0000","last_became_peered":"2024-09-13T17:11:23.336491+0000","last_unstale":"2024-09-13T17:11:27.357913+0000","last_undegraded":"2024-09-13T17:11:27.357913+0000","last_fullsized":"2024-09-13T17:11:27.357913+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:02.045912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537823+0000","last_change":"2024-09-13T17:11:27.361454+0000","last_active":"2024-09-13T17:11:29.537823+0000","last_peered":"2024-09-13T17:11:29.537823+0000","last_clean":"2024-09-13T17:11:29.537823+0000","last_became_active":"2024-09-13T17:11:27.360980+0000","last_became_peered":"2024-09-13T17:11:27.360980+0000","last_unstale":"2024-09-13T17:11:29.537823+0000","last_undegraded":"2024-09-13T17:11:29.537823+0000","last_fullsized":"2024-09-13T17:11:29.537823+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:36.036426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345699+0000","last_change":"2024-09-13T17:11:23.334073+0000","last_active":"2024-09-13T17:11:27.345699+0000","last_peered":"2024-09-13T17:11:27.345699+0000","last_clean":"2024-09-13T17:11:27.345699+0000","last_became_active":"2024-09-13T17:11:23.333628+0000","last_became_peered":"2024-09-13T17:11:23.333628+0000","last_unstale":"2024-09-13T17:11:27.345699+0000","last_undegraded":"2024-09-13T17:11:27.345699+0000","last_fullsized":"2024-09-13T17:11:27.345699+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:18.561346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:46.174718+0000","last_change":"2024-09-13T17:11:22.999115+0000","last_active":"2024-09-13T17:11:46.174718+0000","last_peered":"2024-09-13T17:11:46.174718+0000","last_clean":"2024-09-13T17:11:46.174718+0000","last_became_active":"2024-09-13T17:11:22.998798+0000","last_became_peered":"2024-09-13T17:11:22.998798+0000","last_unstale":"2024-09-13T17:11:46.174718+0000","last_undegraded":"2024-09-13T17:11:46.174718+0000","last_fullsized":"2024-09-13T17:11:46.174718+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:25.263755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537935+0000","last_change":"2024-09-13T17:11:27.355472+0000","last_active":"2024-09-13T17:11:29.537935+0000","last_peered":"2024-09-13T17:11:29.537935+0000","last_clean":"2024-09-13T17:11:29.537935+0000","last_became_active":"2024-09-13T17:11:27.355065+0000","last_became_peered":"2024-09-13T17:11:27.355065+0000","last_unstale":"2024-09-13T17:11:29.537935+0000","last_undegraded":"2024-09-13T17:11:29.537935+0000","last_fullsized":"2024-09-13T17:11:29.537935+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:03.881097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.350859+0000","last_change":"2024-09-13T17:11:23.340268+0000","last_active":"2024-09-13T17:11:27.350859+0000","last_peered":"2024-09-13T17:11:27.350859+0000","last_clean":"2024-09-13T17:11:27.350859+0000","last_became_active":"2024-09-13T17:11:23.339977+0000","last_became_peered":"2024-09-13T17:11:23.339977+0000","last_unstale":"2024-09-13T17:11:27.350859+0000","last_undegraded":"2024-09-13T17:11:27.350859+0000","last_fullsized":"2024-09-13T17:11:27.350859+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:21.067899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.352398+0000","last_change":"2024-09-13T17:11:23.000858+0000","last_active":"2024-09-13T17:11:27.352398+0000","last_peered":"2024-09-13T17:11:27.352398+0000","last_clean":"2024-09-13T17:11:27.352398+0000","last_became_active":"2024-09-13T17:11:23.000536+0000","last_became_peered":"2024-09-13T17:11:23.000536+0000","last_unstale":"2024-09-13T17:11:27.352398+0000","last_undegraded":"2024-09-13T17:11:27.352398+0000","last_fullsized":"2024-09-13T17:11:27.352398+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:28.798579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801541+0000","last_change":"2024-09-13T17:11:27.354018+0000","last_active":"2024-09-13T17:11:48.801541+0000","last_peered":"2024-09-13T17:11:48.801541+0000","last_clean":"2024-09-13T17:11:48.801541+0000","last_became_active":"2024-09-13T17:11:27.353519+0000","last_became_peered":"2024-09-13T17:11:27.353519+0000","last_unstale":"2024-09-13T17:11:48.801541+0000","last_undegraded":"2024-09-13T17:11:48.801541+0000","last_fullsized":"2024-09-13T17:11:48.801541+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:55.227851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801000+0000","last_change":"2024-09-13T17:11:23.335798+0000","last_active":"2024-09-13T17:11:48.801000+0000","last_peered":"2024-09-13T17:11:48.801000+0000","last_clean":"2024-09-13T17:11:48.801000+0000","last_became_active":"2024-09-13T17:11:23.335445+0000","last_became_peered":"2024-09-13T17:11:23.335445+0000","last_unstale":"2024-09-13T17:11:48.801000+0000","last_undegraded":"2024-09-13T17:11:48.801000+0000","last_fullsized":"2024-09-13T17:11:48.801000+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:53.242067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.349338+0000","last_change":"2024-09-13T17:11:22.994118+0000","last_active":"2024-09-13T17:11:27.349338+0000","last_peered":"2024-09-13T17:11:27.349338+0000","last_clean":"2024-09-13T17:11:27.349338+0000","last_became_active":"2024-09-13T17:11:22.993801+0000","last_became_peered":"2024-09-13T17:11:22.993801+0000","last_unstale":"2024-09-13T17:11:27.349338+0000","last_undegraded":"2024-09-13T17:11:27.349338+0000","last_fullsized":"2024-09-13T17:11:27.349338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:01.382130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.557452+0000","last_change":"2024-09-13T17:11:27.358795+0000","last_active":"2024-09-13T17:11:27.557452+0000","last_peered":"2024-09-13T17:11:27.557452+0000","last_clean":"2024-09-13T17:11:27.557452+0000","last_became_active":"2024-09-13T17:11:27.358166+0000","last_became_peered":"2024-09-13T17:11:27.358166+0000","last_unstale":"2024-09-13T17:11:27.557452+0000","last_undegraded":"2024-09-13T17:11:27.557452+0000","last_fullsized":"2024-09-13T17:11:27.557452+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:23.787842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.353077+0000","last_change":"2024-09-13T17:11:23.340671+0000","last_active":"2024-09-13T17:11:27.353077+0000","last_peered":"2024-09-13T17:11:27.353077+0000","last_clean":"2024-09-13T17:11:27.353077+0000","last_became_active":"2024-09-13T17:11:23.340360+0000","last_became_peered":"2024-09-13T17:11:23.340360+0000","last_unstale":"2024-09-13T17:11:27.353077+0000","last_undegraded":"2024-09-13T17:11:27.353077+0000","last_fullsized":"2024-09-13T17:11:27.353077+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:17.875171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344679+0000","last_change":"2024-09-13T17:11:22.993039+0000","last_active":"2024-09-13T17:11:27.344679+0000","last_peered":"2024-09-13T17:11:27.344679+0000","last_clean":"2024-09-13T17:11:27.344679+0000","last_became_active":"2024-09-13T17:11:22.992701+0000","last_became_peered":"2024-09-13T17:11:22.992701+0000","last_unstale":"2024-09-13T17:11:27.344679+0000","last_undegraded":"2024-09-13T17:11:27.344679+0000","last_fullsized":"2024-09-13T17:11:27.344679+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:28.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537946+0000","last_change":"2024-09-13T17:11:27.363834+0000","last_active":"2024-09-13T17:11:29.537946+0000","last_peered":"2024-09-13T17:11:29.537946+0000","last_clean":"2024-09-13T17:11:29.537946+0000","last_became_active":"2024-09-13T17:11:27.363425+0000","last_became_peered":"2024-09-13T17:11:27.363425+0000","last_unstale":"2024-09-13T17:11:29.537946+0000","last_undegraded":"2024-09-13T17:11:29.537946+0000","last_fullsized":"2024-09-13T17:11:29.537946+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:37.389881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832858+0000","last_change":"2024-09-13T17:11:23.337423+0000","last_active":"2024-09-13T17:11:27.832858+0000","last_peered":"2024-09-13T17:11:27.832858+0000","last_clean":"2024-09-13T17:11:27.832858+0000","last_became_active":"2024-09-13T17:11:23.337167+0000","last_became_peered":"2024-09-13T17:11:23.337167+0000","last_unstale":"2024-09-13T17:11:27.832858+0000","last_undegraded":"2024-09-13T17:11:27.832858+0000","last_fullsized":"2024-09-13T17:11:27.832858+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:28.540283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:46.175903+0000","last_change":"2024-09-13T17:11:23.000486+0000","last_active":"2024-09-13T17:11:46.175903+0000","last_peered":"2024-09-13T17:11:46.175903+0000","last_clean":"2024-09-13T17:11:46.175903+0000","last_became_active":"2024-09-13T17:11:23.000158+0000","last_became_peered":"2024-09-13T17:11:23.000158+0000","last_unstale":"2024-09-13T17:11:46.175903+0000","last_undegraded":"2024-09-13T17:11:46.175903+0000","last_fullsized":"2024-09-13T17:11:46.175903+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:42.635037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.683527+0000","last_change":"2024-09-13T17:11:27.355058+0000","last_active":"2024-09-13T17:11:27.683527+0000","last_peered":"2024-09-13T17:11:27.683527+0000","last_clean":"2024-09-13T17:11:27.683527+0000","last_became_active":"2024-09-13T17:11:27.354726+0000","last_became_peered":"2024-09-13T17:11:27.354726+0000","last_unstale":"2024-09-13T17:11:27.683527+0000","last_undegraded":"2024-09-13T17:11:27.683527+0000","last_fullsized":"2024-09-13T17:11:27.683527+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:58.450122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.353872+0000","last_change":"2024-09-13T17:11:23.337245+0000","last_active":"2024-09-13T17:11:27.353872+0000","last_peered":"2024-09-13T17:11:27.353872+0000","last_clean":"2024-09-13T17:11:27.353872+0000","last_became_active":"2024-09-13T17:11:23.336956+0000","last_became_peered":"2024-09-13T17:11:23.336956+0000","last_unstale":"2024-09-13T17:11:27.353872+0000","last_undegraded":"2024-09-13T17:11:27.353872+0000","last_fullsized":"2024-09-13T17:11:27.353872+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:46.876149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'3","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.179427+0000","last_change":"2024-09-13T17:11:22.999942+0000","last_active":"2024-09-13T17:11:47.179427+0000","last_peered":"2024-09-13T17:11:47.179427+0000","last_clean":"2024-09-13T17:11:47.179427+0000","last_became_active":"2024-09-13T17:11:22.999653+0000","last_became_peered":"2024-09-13T17:11:22.999653+0000","last_unstale":"2024-09-13T17:11:47.179427+0000","last_undegraded":"2024-09-13T17:11:47.179427+0000","last_fullsized":"2024-09-13T17:11:47.179427+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:29.400939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832619+0000","last_change":"2024-09-13T17:11:27.356479+0000","last_active":"2024-09-13T17:11:27.832619+0000","last_peered":"2024-09-13T17:11:27.832619+0000","last_clean":"2024-09-13T17:11:27.832619+0000","last_became_active":"2024-09-13T17:11:27.356052+0000","last_became_peered":"2024-09-13T17:11:27.356052+0000","last_unstale":"2024-09-13T17:11:27.832619+0000","last_undegraded":"2024-09-13T17:11:27.832619+0000","last_fullsized":"2024-09-13T17:11:27.832619+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:42.173376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344659+0000","last_change":"2024-09-13T17:11:23.333786+0000","last_active":"2024-09-13T17:11:27.344659+0000","last_peered":"2024-09-13T17:11:27.344659+0000","last_clean":"2024-09-13T17:11:27.344659+0000","last_became_active":"2024-09-13T17:11:23.333472+0000","last_became_peered":"2024-09-13T17:11:23.333472+0000","last_unstale":"2024-09-13T17:11:27.344659+0000","last_undegraded":"2024-09-13T17:11:27.344659+0000","last_fullsized":"2024-09-13T17:11:27.344659+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:41.633228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:46.175724+0000","last_change":"2024-09-13T17:11:22.998646+0000","last_active":"2024-09-13T17:11:46.175724+0000","last_peered":"2024-09-13T17:11:46.175724+0000","last_clean":"2024-09-13T17:11:46.175724+0000","last_became_active":"2024-09-13T17:11:22.998291+0000","last_became_peered":"2024-09-13T17:11:22.998291+0000","last_unstale":"2024-09-13T17:11:46.175724+0000","last_undegraded":"2024-09-13T17:11:46.175724+0000","last_fullsized":"2024-09-13T17:11:46.175724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:20.658436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801089+0000","last_change":"2024-09-13T17:11:27.361174+0000","last_active":"2024-09-13T17:11:48.801089+0000","last_peered":"2024-09-13T17:11:48.801089+0000","last_clean":"2024-09-13T17:11:48.801089+0000","last_became_active":"2024-09-13T17:11:27.360737+0000","last_became_peered":"2024-09-13T17:11:27.360737+0000","last_unstale":"2024-09-13T17:11:48.801089+0000","last_undegraded":"2024-09-13T17:11:48.801089+0000","last_fullsized":"2024-09-13T17:11:48.801089+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:00.941364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.834435+0000","last_change":"2024-09-13T17:11:23.338545+0000","last_active":"2024-09-13T17:11:27.834435+0000","last_peered":"2024-09-13T17:11:27.834435+0000","last_clean":"2024-09-13T17:11:27.834435+0000","last_became_active":"2024-09-13T17:11:23.338246+0000","last_became_peered":"2024-09-13T17:11:23.338246+0000","last_unstale":"2024-09-13T17:11:27.834435+0000","last_undegraded":"2024-09-13T17:11:27.834435+0000","last_fullsized":"2024-09-13T17:11:27.834435+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:18.966658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.341243+0000","last_change":"2024-09-13T17:11:22.993497+0000","last_active":"2024-09-13T17:11:27.341243+0000","last_peered":"2024-09-13T17:11:27.341243+0000","last_clean":"2024-09-13T17:11:27.341243+0000","last_became_active":"2024-09-13T17:11:22.993165+0000","last_became_peered":"2024-09-13T17:11:22.993165+0000","last_unstale":"2024-09-13T17:11:27.341243+0000","last_undegraded":"2024-09-13T17:11:27.341243+0000","last_fullsized":"2024-09-13T17:11:27.341243+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:20.997834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832905+0000","last_change":"2024-09-13T17:11:27.364652+0000","last_active":"2024-09-13T17:11:27.832905+0000","last_peered":"2024-09-13T17:11:27.832905+0000","last_clean":"2024-09-13T17:11:27.832905+0000","last_became_active":"2024-09-13T17:11:27.364245+0000","last_became_peered":"2024-09-13T17:11:27.364245+0000","last_unstale":"2024-09-13T17:11:27.832905+0000","last_undegraded":"2024-09-13T17:11:27.832905+0000","last_fullsized":"2024-09-13T17:11:27.832905+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:23.048289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.834356+0000","last_change":"2024-09-13T17:11:23.335649+0000","last_active":"2024-09-13T17:11:27.834356+0000","last_peered":"2024-09-13T17:11:27.834356+0000","last_clean":"2024-09-13T17:11:27.834356+0000","last_became_active":"2024-09-13T17:11:23.335364+0000","last_became_peered":"2024-09-13T17:11:23.335364+0000","last_unstale":"2024-09-13T17:11:27.834356+0000","last_undegraded":"2024-09-13T17:11:27.834356+0000","last_fullsized":"2024-09-13T17:11:27.834356+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.447947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.684957+0000","last_change":"2024-09-13T17:11:23.003188+0000","last_active":"2024-09-13T17:11:27.684957+0000","last_peered":"2024-09-13T17:11:27.684957+0000","last_clean":"2024-09-13T17:11:27.684957+0000","last_became_active":"2024-09-13T17:11:23.002858+0000","last_became_peered":"2024-09-13T17:11:23.002858+0000","last_unstale":"2024-09-13T17:11:27.684957+0000","last_undegraded":"2024-09-13T17:11:27.684957+0000","last_fullsized":"2024-09-13T17:11:27.684957+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:34.153326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832969+0000","last_change":"2024-09-13T17:11:27.353320+0000","last_active":"2024-09-13T17:11:27.832969+0000","last_peered":"2024-09-13T17:11:27.832969+0000","last_clean":"2024-09-13T17:11:27.832969+0000","last_became_active":"2024-09-13T17:11:27.352947+0000","last_became_peered":"2024-09-13T17:11:27.352947+0000","last_unstale":"2024-09-13T17:11:27.832969+0000","last_undegraded":"2024-09-13T17:11:27.832969+0000","last_fullsized":"2024-09-13T17:11:27.832969+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:04.619618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.354952+0000","last_change":"2024-09-13T17:11:23.330128+0000","last_active":"2024-09-13T17:11:27.354952+0000","last_peered":"2024-09-13T17:11:27.354952+0000","last_clean":"2024-09-13T17:11:27.354952+0000","last_became_active":"2024-09-13T17:11:23.329266+0000","last_became_peered":"2024-09-13T17:11:23.329266+0000","last_unstale":"2024-09-13T17:11:27.354952+0000","last_undegraded":"2024-09-13T17:11:27.354952+0000","last_fullsized":"2024-09-13T17:11:27.354952+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:36.275352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344307+0000","last_change":"2024-09-13T17:11:23.003495+0000","last_active":"2024-09-13T17:11:27.344307+0000","last_peered":"2024-09-13T17:11:27.344307+0000","last_clean":"2024-09-13T17:11:27.344307+0000","last_became_active":"2024-09-13T17:11:23.003186+0000","last_became_peered":"2024-09-13T17:11:23.003186+0000","last_unstale":"2024-09-13T17:11:27.344307+0000","last_undegraded":"2024-09-13T17:11:27.344307+0000","last_fullsized":"2024-09-13T17:11:27.344307+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:23.353587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832748+0000","last_change":"2024-09-13T17:11:27.362233+0000","last_active":"2024-09-13T17:11:27.832748+0000","last_peered":"2024-09-13T17:11:27.832748+0000","last_clean":"2024-09-13T17:11:27.832748+0000","last_became_active":"2024-09-13T17:11:27.361814+0000","last_became_peered":"2024-09-13T17:11:27.361814+0000","last_unstale":"2024-09-13T17:11:27.832748+0000","last_undegraded":"2024-09-13T17:11:27.832748+0000","last_fullsized":"2024-09-13T17:11:27.832748+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:20.723366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344130+0000","last_change":"2024-09-13T17:11:23.332870+0000","last_active":"2024-09-13T17:11:27.344130+0000","last_peered":"2024-09-13T17:11:27.344130+0000","last_clean":"2024-09-13T17:11:27.344130+0000","last_became_active":"2024-09-13T17:11:23.332583+0000","last_became_peered":"2024-09-13T17:11:23.332583+0000","last_unstale":"2024-09-13T17:11:27.344130+0000","last_undegraded":"2024-09-13T17:11:27.344130+0000","last_fullsized":"2024-09-13T17:11:27.344130+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:22.607666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.176932+0000","last_change":"2024-09-13T17:11:23.001932+0000","last_active":"2024-09-13T17:11:47.176932+0000","last_peered":"2024-09-13T17:11:47.176932+0000","last_clean":"2024-09-13T17:11:47.176932+0000","last_became_active":"2024-09-13T17:11:23.001642+0000","last_became_peered":"2024-09-13T17:11:23.001642+0000","last_unstale":"2024-09-13T17:11:47.176932+0000","last_undegraded":"2024-09-13T17:11:47.176932+0000","last_fullsized":"2024-09-13T17:11:47.176932+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:05.976897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.360313+0000","last_change":"2024-09-13T17:11:27.359679+0000","last_active":"2024-09-13T17:11:27.360313+0000","last_peered":"2024-09-13T17:11:27.360313+0000","last_clean":"2024-09-13T17:11:27.360313+0000","last_became_active":"2024-09-13T17:11:27.359268+0000","last_became_peered":"2024-09-13T17:11:27.359268+0000","last_unstale":"2024-09-13T17:11:27.360313+0000","last_undegraded":"2024-09-13T17:11:27.360313+0000","last_fullsized":"2024-09-13T17:11:27.360313+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:48.154917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.350643+0000","last_change":"2024-09-13T17:11:23.340031+0000","last_active":"2024-09-13T17:11:27.350643+0000","last_peered":"2024-09-13T17:11:27.350643+0000","last_clean":"2024-09-13T17:11:27.350643+0000","last_became_active":"2024-09-13T17:11:23.339768+0000","last_became_peered":"2024-09-13T17:11:23.339768+0000","last_unstale":"2024-09-13T17:11:27.350643+0000","last_undegraded":"2024-09-13T17:11:27.350643+0000","last_fullsized":"2024-09-13T17:11:27.350643+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:22.360526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.788033+0000","last_change":"2024-09-13T17:11:22.995060+0000","last_active":"2024-09-13T17:11:47.788033+0000","last_peered":"2024-09-13T17:11:47.788033+0000","last_clean":"2024-09-13T17:11:47.788033+0000","last_became_active":"2024-09-13T17:11:22.991949+0000","last_became_peered":"2024-09-13T17:11:22.991949+0000","last_unstale":"2024-09-13T17:11:47.788033+0000","last_undegraded":"2024-09-13T17:11:47.788033+0000","last_fullsized":"2024-09-13T17:11:47.788033+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:44.716753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":338,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345590+0000","last_change":"2024-09-13T17:10:13.439723+0000","last_active":"2024-09-13T17:11:27.345590+0000","last_peered":"2024-09-13T17:11:27.345590+0000","last_clean":"2024-09-13T17:11:27.345590+0000","last_became_active":"2024-09-13T17:10:13.439290+0000","last_became_peered":"2024-09-13T17:10:13.439290+0000","last_unstale":"2024-09-13T17:11:27.345590+0000","last_undegraded":"2024-09-13T17:11:27.345590+0000","last_fullsized":"2024-09-13T17:11:27.345590+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:03.041486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:03.041486+0000","last_clean_scrub_stamp":"2024-09-13T17:07:03.041486+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:08.673571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:28.497337+0000","last_change":"2024-09-13T17:11:27.361028+0000","last_active":"2024-09-13T17:11:28.497337+0000","last_peered":"2024-09-13T17:11:28.497337+0000","last_clean":"2024-09-13T17:11:28.497337+0000","last_became_active":"2024-09-13T17:11:27.360630+0000","last_became_peered":"2024-09-13T17:11:27.360630+0000","last_unstale":"2024-09-13T17:11:28.497337+0000","last_undegraded":"2024-09-13T17:11:28.497337+0000","last_fullsized":"2024-09-13T17:11:28.497337+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:40:40.860443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.346553+0000","last_change":"2024-09-13T17:11:23.346138+0000","last_active":"2024-09-13T17:11:27.346553+0000","last_peered":"2024-09-13T17:11:27.346553+0000","last_clean":"2024-09-13T17:11:27.346553+0000","last_became_active":"2024-09-13T17:11:23.345855+0000","last_became_peered":"2024-09-13T17:11:23.345855+0000","last_unstale":"2024-09-13T17:11:27.346553+0000","last_undegraded":"2024-09-13T17:11:27.346553+0000","last_fullsized":"2024-09-13T17:11:27.346553+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:02.391726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":2,"reported_epoch":90,"state":"peering","last_fresh":"2024-09-13T17:11:27.684094+0000","last_change":"2024-09-13T17:11:49.540357+0000","last_active":"2024-09-13T17:11:49.540357+0000","last_peered":"2024-09-13T17:11:27.684094+0000","last_clean":"2024-09-13T17:11:27.684094+0000","last_became_active":"2024-09-13T17:11:23.003102+0000","last_became_peered":"2024-09-13T17:11:23.003102+0000","last_unstale":"2024-09-13T17:11:27.684094+0000","last_undegraded":"2024-09-13T17:11:27.684094+0000","last_fullsized":"2024-09-13T17:11:27.684094+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:08.827045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832402+0000","last_change":"2024-09-13T17:11:27.360372+0000","last_active":"2024-09-13T17:11:27.832402+0000","last_peered":"2024-09-13T17:11:27.832402+0000","last_clean":"2024-09-13T17:11:27.832402+0000","last_became_active":"2024-09-13T17:11:27.359990+0000","last_became_peered":"2024-09-13T17:11:27.359990+0000","last_unstale":"2024-09-13T17:11:27.832402+0000","last_undegraded":"2024-09-13T17:11:27.832402+0000","last_fullsized":"2024-09-13T17:11:27.832402+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:26.970317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344659+0000","last_change":"2024-09-13T17:11:23.336269+0000","last_active":"2024-09-13T17:11:27.344659+0000","last_peered":"2024-09-13T17:11:27.344659+0000","last_clean":"2024-09-13T17:11:27.344659+0000","last_became_active":"2024-09-13T17:11:23.335921+0000","last_became_peered":"2024-09-13T17:11:23.335921+0000","last_unstale":"2024-09-13T17:11:27.344659+0000","last_undegraded":"2024-09-13T17:11:27.344659+0000","last_fullsized":"2024-09-13T17:11:27.344659+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:43.035927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.358089+0000","last_change":"2024-09-13T17:11:23.002491+0000","last_active":"2024-09-13T17:11:27.358089+0000","last_peered":"2024-09-13T17:11:27.358089+0000","last_clean":"2024-09-13T17:11:27.358089+0000","last_became_active":"2024-09-13T17:11:23.002178+0000","last_became_peered":"2024-09-13T17:11:23.002178+0000","last_unstale":"2024-09-13T17:11:27.358089+0000","last_undegraded":"2024-09-13T17:11:27.358089+0000","last_fullsized":"2024-09-13T17:11:27.358089+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:06.056639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.108773+0000","last_change":"2024-09-13T17:11:27.355153+0000","last_active":"2024-09-13T17:11:29.108773+0000","last_peered":"2024-09-13T17:11:29.108773+0000","last_clean":"2024-09-13T17:11:29.108773+0000","last_became_active":"2024-09-13T17:11:27.354701+0000","last_became_peered":"2024-09-13T17:11:27.354701+0000","last_unstale":"2024-09-13T17:11:29.108773+0000","last_undegraded":"2024-09-13T17:11:29.108773+0000","last_fullsized":"2024-09-13T17:11:29.108773+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:34.924402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345209+0000","last_change":"2024-09-13T17:11:23.342067+0000","last_active":"2024-09-13T17:11:27.345209+0000","last_peered":"2024-09-13T17:11:27.345209+0000","last_clean":"2024-09-13T17:11:27.345209+0000","last_became_active":"2024-09-13T17:11:23.341736+0000","last_became_peered":"2024-09-13T17:11:23.341736+0000","last_unstale":"2024-09-13T17:11:27.345209+0000","last_undegraded":"2024-09-13T17:11:27.345209+0000","last_fullsized":"2024-09-13T17:11:27.345209+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:03.114638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345020+0000","last_change":"2024-09-13T17:11:23.002849+0000","last_active":"2024-09-13T17:11:27.345020+0000","last_peered":"2024-09-13T17:11:27.345020+0000","last_clean":"2024-09-13T17:11:27.345020+0000","last_became_active":"2024-09-13T17:11:23.002562+0000","last_became_peered":"2024-09-13T17:11:23.002562+0000","last_unstale":"2024-09-13T17:11:27.345020+0000","last_undegraded":"2024-09-13T17:11:27.345020+0000","last_fullsized":"2024-09-13T17:11:27.345020+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:11:24.650510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.360269+0000","last_change":"2024-09-13T17:11:27.359343+0000","last_active":"2024-09-13T17:11:27.360269+0000","last_peered":"2024-09-13T17:11:27.360269+0000","last_clean":"2024-09-13T17:11:27.360269+0000","last_became_active":"2024-09-13T17:11:27.358628+0000","last_became_peered":"2024-09-13T17:11:27.358628+0000","last_unstale":"2024-09-13T17:11:27.360269+0000","last_undegraded":"2024-09-13T17:11:27.360269+0000","last_fullsized":"2024-09-13T17:11:27.360269+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:39.584184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801190+0000","last_change":"2024-09-13T17:11:23.333111+0000","last_active":"2024-09-13T17:11:48.801190+0000","last_peered":"2024-09-13T17:11:48.801190+0000","last_clean":"2024-09-13T17:11:48.801190+0000","last_became_active":"2024-09-13T17:11:23.332734+0000","last_became_peered":"2024-09-13T17:11:23.332734+0000","last_unstale":"2024-09-13T17:11:48.801190+0000","last_undegraded":"2024-09-13T17:11:48.801190+0000","last_fullsized":"2024-09-13T17:11:48.801190+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:44.628106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"84'1","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832752+0000","last_change":"2024-09-13T17:11:23.000759+0000","last_active":"2024-09-13T17:11:27.832752+0000","last_peered":"2024-09-13T17:11:27.832752+0000","last_clean":"2024-09-13T17:11:27.832752+0000","last_became_active":"2024-09-13T17:11:23.000463+0000","last_became_peered":"2024-09-13T17:11:23.000463+0000","last_unstale":"2024-09-13T17:11:27.832752+0000","last_undegraded":"2024-09-13T17:11:27.832752+0000","last_fullsized":"2024-09-13T17:11:27.832752+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:59.077194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.364961+0000","last_change":"2024-09-13T17:11:27.363076+0000","last_active":"2024-09-13T17:11:27.364961+0000","last_peered":"2024-09-13T17:11:27.364961+0000","last_clean":"2024-09-13T17:11:27.364961+0000","last_became_active":"2024-09-13T17:11:27.362642+0000","last_became_peered":"2024-09-13T17:11:27.362642+0000","last_unstale":"2024-09-13T17:11:27.364961+0000","last_undegraded":"2024-09-13T17:11:27.364961+0000","last_fullsized":"2024-09-13T17:11:27.364961+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:25.494875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.355452+0000","last_change":"2024-09-13T17:11:23.336703+0000","last_active":"2024-09-13T17:11:27.355452+0000","last_peered":"2024-09-13T17:11:27.355452+0000","last_clean":"2024-09-13T17:11:27.355452+0000","last_became_active":"2024-09-13T17:11:23.336349+0000","last_became_peered":"2024-09-13T17:11:23.336349+0000","last_unstale":"2024-09-13T17:11:27.355452+0000","last_undegraded":"2024-09-13T17:11:27.355452+0000","last_fullsized":"2024-09-13T17:11:27.355452+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:28.671438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.178750+0000","last_change":"2024-09-13T17:11:22.994382+0000","last_active":"2024-09-13T17:11:47.178750+0000","last_peered":"2024-09-13T17:11:47.178750+0000","last_clean":"2024-09-13T17:11:47.178750+0000","last_became_active":"2024-09-13T17:11:22.994037+0000","last_became_peered":"2024-09-13T17:11:22.994037+0000","last_unstale":"2024-09-13T17:11:47.178750+0000","last_undegraded":"2024-09-13T17:11:47.178750+0000","last_fullsized":"2024-09-13T17:11:47.178750+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:10.763757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.833042+0000","last_change":"2024-09-13T17:11:27.354351+0000","last_active":"2024-09-13T17:11:27.833042+0000","last_peered":"2024-09-13T17:11:27.833042+0000","last_clean":"2024-09-13T17:11:27.833042+0000","last_became_active":"2024-09-13T17:11:27.353715+0000","last_became_peered":"2024-09-13T17:11:27.353715+0000","last_unstale":"2024-09-13T17:11:27.833042+0000","last_undegraded":"2024-09-13T17:11:27.833042+0000","last_fullsized":"2024-09-13T17:11:27.833042+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:18.335183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345355+0000","last_change":"2024-09-13T17:11:23.341743+0000","last_active":"2024-09-13T17:11:27.345355+0000","last_peered":"2024-09-13T17:11:27.345355+0000","last_clean":"2024-09-13T17:11:27.345355+0000","last_became_active":"2024-09-13T17:11:23.341200+0000","last_became_peered":"2024-09-13T17:11:23.341200+0000","last_unstale":"2024-09-13T17:11:27.345355+0000","last_undegraded":"2024-09-13T17:11:27.345355+0000","last_fullsized":"2024-09-13T17:11:27.345355+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:41.854013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'3","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.800911+0000","last_change":"2024-09-13T17:11:22.997571+0000","last_active":"2024-09-13T17:11:48.800911+0000","last_peered":"2024-09-13T17:11:48.800911+0000","last_clean":"2024-09-13T17:11:48.800911+0000","last_became_active":"2024-09-13T17:11:22.997238+0000","last_became_peered":"2024-09-13T17:11:22.997238+0000","last_unstale":"2024-09-13T17:11:48.800911+0000","last_undegraded":"2024-09-13T17:11:48.800911+0000","last_fullsized":"2024-09-13T17:11:48.800911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:34.533004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.557470+0000","last_change":"2024-09-13T17:11:27.356892+0000","last_active":"2024-09-13T17:11:27.557470+0000","last_peered":"2024-09-13T17:11:27.557470+0000","last_clean":"2024-09-13T17:11:27.557470+0000","last_became_active":"2024-09-13T17:11:27.356136+0000","last_became_peered":"2024-09-13T17:11:27.356136+0000","last_unstale":"2024-09-13T17:11:27.557470+0000","last_undegraded":"2024-09-13T17:11:27.557470+0000","last_fullsized":"2024-09-13T17:11:27.557470+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:23.207064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345098+0000","last_change":"2024-09-13T17:11:23.337666+0000","last_active":"2024-09-13T17:11:27.345098+0000","last_peered":"2024-09-13T17:11:27.345098+0000","last_clean":"2024-09-13T17:11:27.345098+0000","last_became_active":"2024-09-13T17:11:23.337185+0000","last_became_peered":"2024-09-13T17:11:23.337185+0000","last_unstale":"2024-09-13T17:11:27.345098+0000","last_undegraded":"2024-09-13T17:11:27.345098+0000","last_fullsized":"2024-09-13T17:11:27.345098+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:51.266709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:46.175759+0000","last_change":"2024-09-13T17:11:23.005075+0000","last_active":"2024-09-13T17:11:46.175759+0000","last_peered":"2024-09-13T17:11:46.175759+0000","last_clean":"2024-09-13T17:11:46.175759+0000","last_became_active":"2024-09-13T17:11:23.004778+0000","last_became_peered":"2024-09-13T17:11:23.004778+0000","last_unstale":"2024-09-13T17:11:46.175759+0000","last_undegraded":"2024-09-13T17:11:46.175759+0000","last_fullsized":"2024-09-13T17:11:46.175759+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:06.763552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801204+0000","last_change":"2024-09-13T17:11:27.353601+0000","last_active":"2024-09-13T17:11:48.801204+0000","last_peered":"2024-09-13T17:11:48.801204+0000","last_clean":"2024-09-13T17:11:48.801204+0000","last_became_active":"2024-09-13T17:11:27.353190+0000","last_became_peered":"2024-09-13T17:11:27.353190+0000","last_unstale":"2024-09-13T17:11:48.801204+0000","last_undegraded":"2024-09-13T17:11:48.801204+0000","last_fullsized":"2024-09-13T17:11:48.801204+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:24.645552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344760+0000","last_change":"2024-09-13T17:11:23.333592+0000","last_active":"2024-09-13T17:11:27.344760+0000","last_peered":"2024-09-13T17:11:27.344760+0000","last_clean":"2024-09-13T17:11:27.344760+0000","last_became_active":"2024-09-13T17:11:23.333306+0000","last_became_peered":"2024-09-13T17:11:23.333306+0000","last_unstale":"2024-09-13T17:11:27.344760+0000","last_undegraded":"2024-09-13T17:11:27.344760+0000","last_fullsized":"2024-09-13T17:11:27.344760+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:26.813987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.177595+0000","last_change":"2024-09-13T17:11:23.005619+0000","last_active":"2024-09-13T17:11:47.177595+0000","last_peered":"2024-09-13T17:11:47.177595+0000","last_clean":"2024-09-13T17:11:47.177595+0000","last_became_active":"2024-09-13T17:11:23.005077+0000","last_became_peered":"2024-09-13T17:11:23.005077+0000","last_unstale":"2024-09-13T17:11:47.177595+0000","last_undegraded":"2024-09-13T17:11:47.177595+0000","last_fullsized":"2024-09-13T17:11:47.177595+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:51.739773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.365375+0000","last_change":"2024-09-13T17:11:27.364603+0000","last_active":"2024-09-13T17:11:27.365375+0000","last_peered":"2024-09-13T17:11:27.365375+0000","last_clean":"2024-09-13T17:11:27.365375+0000","last_became_active":"2024-09-13T17:11:27.364226+0000","last_became_peered":"2024-09-13T17:11:27.364226+0000","last_unstale":"2024-09-13T17:11:27.365375+0000","last_undegraded":"2024-09-13T17:11:27.365375+0000","last_fullsized":"2024-09-13T17:11:27.365375+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:56.802016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.352784+0000","last_change":"2024-09-13T17:11:23.338657+0000","last_active":"2024-09-13T17:11:27.352784+0000","last_peered":"2024-09-13T17:11:27.352784+0000","last_clean":"2024-09-13T17:11:27.352784+0000","last_became_active":"2024-09-13T17:11:23.338377+0000","last_became_peered":"2024-09-13T17:11:23.338377+0000","last_unstale":"2024-09-13T17:11:27.352784+0000","last_undegraded":"2024-09-13T17:11:27.352784+0000","last_fullsized":"2024-09-13T17:11:27.352784+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:52.412887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'23","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.114064+0000","last_change":"2024-09-13T17:11:22.998541+0000","last_active":"2024-09-13T17:11:49.114064+0000","last_peered":"2024-09-13T17:11:49.114064+0000","last_clean":"2024-09-13T17:11:49.114064+0000","last_became_active":"2024-09-13T17:11:22.998132+0000","last_became_peered":"2024-09-13T17:11:22.998132+0000","last_unstale":"2024-09-13T17:11:49.114064+0000","last_undegraded":"2024-09-13T17:11:49.114064+0000","last_fullsized":"2024-09-13T17:11:49.114064+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:16.777772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40425,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":26,"num_write":24,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.557394+0000","last_change":"2024-09-13T17:11:27.361917+0000","last_active":"2024-09-13T17:11:27.557394+0000","last_peered":"2024-09-13T17:11:27.557394+0000","last_clean":"2024-09-13T17:11:27.557394+0000","last_became_active":"2024-09-13T17:11:27.361503+0000","last_became_peered":"2024-09-13T17:11:27.361503+0000","last_unstale":"2024-09-13T17:11:27.557394+0000","last_undegraded":"2024-09-13T17:11:27.557394+0000","last_fullsized":"2024-09-13T17:11:27.557394+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:52.959017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.346573+0000","last_change":"2024-09-13T17:11:23.343648+0000","last_active":"2024-09-13T17:11:27.346573+0000","last_peered":"2024-09-13T17:11:27.346573+0000","last_clean":"2024-09-13T17:11:27.346573+0000","last_became_active":"2024-09-13T17:11:23.343183+0000","last_became_peered":"2024-09-13T17:11:23.343183+0000","last_unstale":"2024-09-13T17:11:27.346573+0000","last_undegraded":"2024-09-13T17:11:27.346573+0000","last_fullsized":"2024-09-13T17:11:27.346573+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:32:49.585628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.833035+0000","last_change":"2024-09-13T17:11:23.004059+0000","last_active":"2024-09-13T17:11:27.833035+0000","last_peered":"2024-09-13T17:11:27.833035+0000","last_clean":"2024-09-13T17:11:27.833035+0000","last_became_active":"2024-09-13T17:11:23.003248+0000","last_became_peered":"2024-09-13T17:11:23.003248+0000","last_unstale":"2024-09-13T17:11:27.833035+0000","last_undegraded":"2024-09-13T17:11:27.833035+0000","last_fullsized":"2024-09-13T17:11:27.833035+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:05.496872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537877+0000","last_change":"2024-09-13T17:11:27.362880+0000","last_active":"2024-09-13T17:11:29.537877+0000","last_peered":"2024-09-13T17:11:29.537877+0000","last_clean":"2024-09-13T17:11:29.537877+0000","last_became_active":"2024-09-13T17:11:27.362471+0000","last_became_peered":"2024-09-13T17:11:27.362471+0000","last_unstale":"2024-09-13T17:11:29.537877+0000","last_undegraded":"2024-09-13T17:11:29.537877+0000","last_fullsized":"2024-09-13T17:11:29.537877+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:49.964606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"peering","last_fresh":"2024-09-13T17:11:48.798762+0000","last_change":"2024-09-13T17:11:48.798906+0000","last_active":"2024-09-13T17:11:48.798762+0000","last_peered":"2024-09-13T17:11:27.833117+0000","last_clean":"2024-09-13T17:11:27.833117+0000","last_became_active":"2024-09-13T17:11:23.332871+0000","last_became_peered":"2024-09-13T17:11:23.332871+0000","last_unstale":"2024-09-13T17:11:48.798762+0000","last_undegraded":"2024-09-13T17:11:48.798762+0000","last_fullsized":"2024-09-13T17:11:48.798762+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:27.370999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,7],"acting":[0,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,5,7,8],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:46.176492+0000","last_change":"2024-09-13T17:11:22.999158+0000","last_active":"2024-09-13T17:11:46.176492+0000","last_peered":"2024-09-13T17:11:46.176492+0000","last_clean":"2024-09-13T17:11:46.176492+0000","last_became_active":"2024-09-13T17:11:22.998795+0000","last_became_peered":"2024-09-13T17:11:22.998795+0000","last_unstale":"2024-09-13T17:11:46.176492+0000","last_undegraded":"2024-09-13T17:11:46.176492+0000","last_fullsized":"2024-09-13T17:11:46.176492+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:23.880769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.557331+0000","last_change":"2024-09-13T17:11:27.358105+0000","last_active":"2024-09-13T17:11:27.557331+0000","last_peered":"2024-09-13T17:11:27.557331+0000","last_clean":"2024-09-13T17:11:27.557331+0000","last_became_active":"2024-09-13T17:11:27.357740+0000","last_became_peered":"2024-09-13T17:11:27.357740+0000","last_unstale":"2024-09-13T17:11:27.557331+0000","last_undegraded":"2024-09-13T17:11:27.557331+0000","last_fullsized":"2024-09-13T17:11:27.557331+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:44.837353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345210+0000","last_change":"2024-09-13T17:11:23.338736+0000","last_active":"2024-09-13T17:11:27.345210+0000","last_peered":"2024-09-13T17:11:27.345210+0000","last_clean":"2024-09-13T17:11:27.345210+0000","last_became_active":"2024-09-13T17:11:23.338462+0000","last_became_peered":"2024-09-13T17:11:23.338462+0000","last_unstale":"2024-09-13T17:11:27.345210+0000","last_undegraded":"2024-09-13T17:11:27.345210+0000","last_fullsized":"2024-09-13T17:11:27.345210+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:49.221314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'3","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.800595+0000","last_change":"2024-09-13T17:11:23.001966+0000","last_active":"2024-09-13T17:11:48.800595+0000","last_peered":"2024-09-13T17:11:48.800595+0000","last_clean":"2024-09-13T17:11:48.800595+0000","last_became_active":"2024-09-13T17:11:23.001565+0000","last_became_peered":"2024-09-13T17:11:23.001565+0000","last_unstale":"2024-09-13T17:11:48.800595+0000","last_undegraded":"2024-09-13T17:11:48.800595+0000","last_fullsized":"2024-09-13T17:11:48.800595+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:47.240702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.833316+0000","last_change":"2024-09-13T17:11:27.360896+0000","last_active":"2024-09-13T17:11:27.833316+0000","last_peered":"2024-09-13T17:11:27.833316+0000","last_clean":"2024-09-13T17:11:27.833316+0000","last_became_active":"2024-09-13T17:11:27.360552+0000","last_became_peered":"2024-09-13T17:11:27.360552+0000","last_unstale":"2024-09-13T17:11:27.833316+0000","last_undegraded":"2024-09-13T17:11:27.833316+0000","last_fullsized":"2024-09-13T17:11:27.833316+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:08.726724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.108810+0000","last_change":"2024-09-13T17:11:27.356317+0000","last_active":"2024-09-13T17:11:29.108810+0000","last_peered":"2024-09-13T17:11:29.108810+0000","last_clean":"2024-09-13T17:11:29.108810+0000","last_became_active":"2024-09-13T17:11:27.355863+0000","last_became_peered":"2024-09-13T17:11:27.355863+0000","last_unstale":"2024-09-13T17:11:29.108810+0000","last_undegraded":"2024-09-13T17:11:29.108810+0000","last_fullsized":"2024-09-13T17:11:29.108810+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:29.356048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.557362+0000","last_change":"2024-09-13T17:11:23.344929+0000","last_active":"2024-09-13T17:11:27.557362+0000","last_peered":"2024-09-13T17:11:27.557362+0000","last_clean":"2024-09-13T17:11:27.557362+0000","last_became_active":"2024-09-13T17:11:23.344627+0000","last_became_peered":"2024-09-13T17:11:23.344627+0000","last_unstale":"2024-09-13T17:11:27.557362+0000","last_undegraded":"2024-09-13T17:11:27.557362+0000","last_fullsized":"2024-09-13T17:11:27.557362+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:15.049627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832206+0000","last_change":"2024-09-13T17:11:23.002539+0000","last_active":"2024-09-13T17:11:27.832206+0000","last_peered":"2024-09-13T17:11:27.832206+0000","last_clean":"2024-09-13T17:11:27.832206+0000","last_became_active":"2024-09-13T17:11:23.002206+0000","last_became_peered":"2024-09-13T17:11:23.002206+0000","last_unstale":"2024-09-13T17:11:27.832206+0000","last_undegraded":"2024-09-13T17:11:27.832206+0000","last_fullsized":"2024-09-13T17:11:27.832206+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:57.708167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801253+0000","last_change":"2024-09-13T17:11:27.362667+0000","last_active":"2024-09-13T17:11:48.801253+0000","last_peered":"2024-09-13T17:11:48.801253+0000","last_clean":"2024-09-13T17:11:48.801253+0000","last_became_active":"2024-09-13T17:11:27.362293+0000","last_became_peered":"2024-09-13T17:11:27.362293+0000","last_unstale":"2024-09-13T17:11:48.801253+0000","last_undegraded":"2024-09-13T17:11:48.801253+0000","last_fullsized":"2024-09-13T17:11:48.801253+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:24.446951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.349858+0000","last_change":"2024-09-13T17:11:23.335823+0000","last_active":"2024-09-13T17:11:27.349858+0000","last_peered":"2024-09-13T17:11:27.349858+0000","last_clean":"2024-09-13T17:11:27.349858+0000","last_became_active":"2024-09-13T17:11:23.335491+0000","last_became_peered":"2024-09-13T17:11:23.335491+0000","last_unstale":"2024-09-13T17:11:27.349858+0000","last_undegraded":"2024-09-13T17:11:27.349858+0000","last_fullsized":"2024-09-13T17:11:27.349858+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:42.172559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344221+0000","last_change":"2024-09-13T17:11:22.999477+0000","last_active":"2024-09-13T17:11:27.344221+0000","last_peered":"2024-09-13T17:11:27.344221+0000","last_clean":"2024-09-13T17:11:27.344221+0000","last_became_active":"2024-09-13T17:11:22.999175+0000","last_became_peered":"2024-09-13T17:11:22.999175+0000","last_unstale":"2024-09-13T17:11:27.344221+0000","last_undegraded":"2024-09-13T17:11:27.344221+0000","last_fullsized":"2024-09-13T17:11:27.344221+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:03.817508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.178558+0000","last_change":"2024-09-13T17:11:23.001737+0000","last_active":"2024-09-13T17:11:47.178558+0000","last_peered":"2024-09-13T17:11:47.178558+0000","last_clean":"2024-09-13T17:11:47.178558+0000","last_became_active":"2024-09-13T17:11:23.001296+0000","last_became_peered":"2024-09-13T17:11:23.001296+0000","last_unstale":"2024-09-13T17:11:47.178558+0000","last_undegraded":"2024-09-13T17:11:47.178558+0000","last_fullsized":"2024-09-13T17:11:47.178558+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:08.671244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.356028+0000","last_change":"2024-09-13T17:11:23.337738+0000","last_active":"2024-09-13T17:11:27.356028+0000","last_peered":"2024-09-13T17:11:27.356028+0000","last_clean":"2024-09-13T17:11:27.356028+0000","last_became_active":"2024-09-13T17:11:23.337411+0000","last_became_peered":"2024-09-13T17:11:23.337411+0000","last_unstale":"2024-09-13T17:11:27.356028+0000","last_undegraded":"2024-09-13T17:11:27.356028+0000","last_fullsized":"2024-09-13T17:11:27.356028+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:02.355706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.683948+0000","last_change":"2024-09-13T17:11:27.363174+0000","last_active":"2024-09-13T17:11:27.683948+0000","last_peered":"2024-09-13T17:11:27.683948+0000","last_clean":"2024-09-13T17:11:27.683948+0000","last_became_active":"2024-09-13T17:11:27.362158+0000","last_became_peered":"2024-09-13T17:11:27.362158+0000","last_unstale":"2024-09-13T17:11:27.683948+0000","last_undegraded":"2024-09-13T17:11:27.683948+0000","last_fullsized":"2024-09-13T17:11:27.683948+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:49:52.892616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'5","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:46.177022+0000","last_change":"2024-09-13T17:11:23.000544+0000","last_active":"2024-09-13T17:11:46.177022+0000","last_peered":"2024-09-13T17:11:46.177022+0000","last_clean":"2024-09-13T17:11:46.177022+0000","last_became_active":"2024-09-13T17:11:23.000233+0000","last_became_peered":"2024-09-13T17:11:23.000233+0000","last_unstale":"2024-09-13T17:11:46.177022+0000","last_undegraded":"2024-09-13T17:11:46.177022+0000","last_fullsized":"2024-09-13T17:11:46.177022+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:04.745950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.352666+0000","last_change":"2024-09-13T17:11:23.340104+0000","last_active":"2024-09-13T17:11:27.352666+0000","last_peered":"2024-09-13T17:11:27.352666+0000","last_clean":"2024-09-13T17:11:27.352666+0000","last_became_active":"2024-09-13T17:11:23.339826+0000","last_became_peered":"2024-09-13T17:11:23.339826+0000","last_unstale":"2024-09-13T17:11:27.352666+0000","last_undegraded":"2024-09-13T17:11:27.352666+0000","last_fullsized":"2024-09-13T17:11:27.352666+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:03.101547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.683859+0000","last_change":"2024-09-13T17:11:27.360848+0000","last_active":"2024-09-13T17:11:27.683859+0000","last_peered":"2024-09-13T17:11:27.683859+0000","last_clean":"2024-09-13T17:11:27.683859+0000","last_became_active":"2024-09-13T17:11:27.360416+0000","last_became_peered":"2024-09-13T17:11:27.360416+0000","last_unstale":"2024-09-13T17:11:27.683859+0000","last_undegraded":"2024-09-13T17:11:27.683859+0000","last_fullsized":"2024-09-13T17:11:27.683859+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:06.857649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.800926+0000","last_change":"2024-09-13T17:11:23.334723+0000","last_active":"2024-09-13T17:11:48.800926+0000","last_peered":"2024-09-13T17:11:48.800926+0000","last_clean":"2024-09-13T17:11:48.800926+0000","last_became_active":"2024-09-13T17:11:23.334433+0000","last_became_peered":"2024-09-13T17:11:23.334433+0000","last_unstale":"2024-09-13T17:11:48.800926+0000","last_undegraded":"2024-09-13T17:11:48.800926+0000","last_fullsized":"2024-09-13T17:11:48.800926+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:08.657151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.352210+0000","last_change":"2024-09-13T17:11:23.334882+0000","last_active":"2024-09-13T17:11:27.352210+0000","last_peered":"2024-09-13T17:11:27.352210+0000","last_clean":"2024-09-13T17:11:27.352210+0000","last_became_active":"2024-09-13T17:11:23.334610+0000","last_became_peered":"2024-09-13T17:11:23.334610+0000","last_unstale":"2024-09-13T17:11:27.352210+0000","last_undegraded":"2024-09-13T17:11:27.352210+0000","last_fullsized":"2024-09-13T17:11:27.352210+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:03.932181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.351982+0000","last_change":"2024-09-13T17:11:23.334076+0000","last_active":"2024-09-13T17:11:27.351982+0000","last_peered":"2024-09-13T17:11:27.351982+0000","last_clean":"2024-09-13T17:11:27.351982+0000","last_became_active":"2024-09-13T17:11:23.333801+0000","last_became_peered":"2024-09-13T17:11:23.333801+0000","last_unstale":"2024-09-13T17:11:27.351982+0000","last_undegraded":"2024-09-13T17:11:27.351982+0000","last_fullsized":"2024-09-13T17:11:27.351982+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:07.113045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832811+0000","last_change":"2024-09-13T17:11:23.332306+0000","last_active":"2024-09-13T17:11:27.832811+0000","last_peered":"2024-09-13T17:11:27.832811+0000","last_clean":"2024-09-13T17:11:27.832811+0000","last_became_active":"2024-09-13T17:11:23.331913+0000","last_became_peered":"2024-09-13T17:11:23.331913+0000","last_unstale":"2024-09-13T17:11:27.832811+0000","last_undegraded":"2024-09-13T17:11:27.832811+0000","last_fullsized":"2024-09-13T17:11:27.832811+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:02.927286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344550+0000","last_change":"2024-09-13T17:11:23.335512+0000","last_active":"2024-09-13T17:11:27.344550+0000","last_peered":"2024-09-13T17:11:27.344550+0000","last_clean":"2024-09-13T17:11:27.344550+0000","last_became_active":"2024-09-13T17:11:23.335201+0000","last_became_peered":"2024-09-13T17:11:23.335201+0000","last_unstale":"2024-09-13T17:11:27.344550+0000","last_undegraded":"2024-09-13T17:11:27.344550+0000","last_fullsized":"2024-09-13T17:11:27.344550+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:17.263819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801579+0000","last_change":"2024-09-13T17:11:23.341204+0000","last_active":"2024-09-13T17:11:48.801579+0000","last_peered":"2024-09-13T17:11:48.801579+0000","last_clean":"2024-09-13T17:11:48.801579+0000","last_became_active":"2024-09-13T17:11:23.339848+0000","last_became_peered":"2024-09-13T17:11:23.339848+0000","last_unstale":"2024-09-13T17:11:48.801579+0000","last_undegraded":"2024-09-13T17:11:48.801579+0000","last_fullsized":"2024-09-13T17:11:48.801579+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:15:09.480651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.353662+0000","last_change":"2024-09-13T17:11:23.334741+0000","last_active":"2024-09-13T17:11:27.353662+0000","last_peered":"2024-09-13T17:11:27.353662+0000","last_clean":"2024-09-13T17:11:27.353662+0000","last_became_active":"2024-09-13T17:11:23.334459+0000","last_became_peered":"2024-09-13T17:11:23.334459+0000","last_unstale":"2024-09-13T17:11:27.353662+0000","last_undegraded":"2024-09-13T17:11:27.353662+0000","last_fullsized":"2024-09-13T17:11:27.353662+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:52.379735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.353786+0000","last_change":"2024-09-13T17:11:23.337869+0000","last_active":"2024-09-13T17:11:27.353786+0000","last_peered":"2024-09-13T17:11:27.353786+0000","last_clean":"2024-09-13T17:11:27.353786+0000","last_became_active":"2024-09-13T17:11:23.337581+0000","last_became_peered":"2024-09-13T17:11:23.337581+0000","last_unstale":"2024-09-13T17:11:27.353786+0000","last_undegraded":"2024-09-13T17:11:27.353786+0000","last_fullsized":"2024-09-13T17:11:27.353786+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:49.407474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.354864+0000","last_change":"2024-09-13T17:11:23.337034+0000","last_active":"2024-09-13T17:11:27.354864+0000","last_peered":"2024-09-13T17:11:27.354864+0000","last_clean":"2024-09-13T17:11:27.354864+0000","last_became_active":"2024-09-13T17:11:23.334863+0000","last_became_peered":"2024-09-13T17:11:23.334863+0000","last_unstale":"2024-09-13T17:11:27.354864+0000","last_undegraded":"2024-09-13T17:11:27.354864+0000","last_fullsized":"2024-09-13T17:11:27.354864+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:05.820989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.349144+0000","last_change":"2024-09-13T17:11:23.336713+0000","last_active":"2024-09-13T17:11:27.349144+0000","last_peered":"2024-09-13T17:11:27.349144+0000","last_clean":"2024-09-13T17:11:27.349144+0000","last_became_active":"2024-09-13T17:11:23.336431+0000","last_became_peered":"2024-09-13T17:11:23.336431+0000","last_unstale":"2024-09-13T17:11:27.349144+0000","last_undegraded":"2024-09-13T17:11:27.349144+0000","last_fullsized":"2024-09-13T17:11:27.349144+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:52.709483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345023+0000","last_change":"2024-09-13T17:11:23.340385+0000","last_active":"2024-09-13T17:11:27.345023+0000","last_peered":"2024-09-13T17:11:27.345023+0000","last_clean":"2024-09-13T17:11:27.345023+0000","last_became_active":"2024-09-13T17:11:23.340068+0000","last_became_peered":"2024-09-13T17:11:23.340068+0000","last_unstale":"2024-09-13T17:11:27.345023+0000","last_undegraded":"2024-09-13T17:11:27.345023+0000","last_fullsized":"2024-09-13T17:11:27.345023+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:17.795222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345000+0000","last_change":"2024-09-13T17:11:23.329214+0000","last_active":"2024-09-13T17:11:27.345000+0000","last_peered":"2024-09-13T17:11:27.345000+0000","last_clean":"2024-09-13T17:11:27.345000+0000","last_became_active":"2024-09-13T17:11:23.328747+0000","last_became_peered":"2024-09-13T17:11:23.328747+0000","last_unstale":"2024-09-13T17:11:27.345000+0000","last_undegraded":"2024-09-13T17:11:27.345000+0000","last_fullsized":"2024-09-13T17:11:27.345000+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:11.233652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801419+0000","last_change":"2024-09-13T17:11:23.339854+0000","last_active":"2024-09-13T17:11:48.801419+0000","last_peered":"2024-09-13T17:11:48.801419+0000","last_clean":"2024-09-13T17:11:48.801419+0000","last_became_active":"2024-09-13T17:11:23.339565+0000","last_became_peered":"2024-09-13T17:11:23.339565+0000","last_unstale":"2024-09-13T17:11:48.801419+0000","last_undegraded":"2024-09-13T17:11:48.801419+0000","last_fullsized":"2024-09-13T17:11:48.801419+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:37.161135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.353415+0000","last_change":"2024-09-13T17:11:23.342562+0000","last_active":"2024-09-13T17:11:27.353415+0000","last_peered":"2024-09-13T17:11:27.353415+0000","last_clean":"2024-09-13T17:11:27.353415+0000","last_became_active":"2024-09-13T17:11:23.342256+0000","last_became_peered":"2024-09-13T17:11:23.342256+0000","last_unstale":"2024-09-13T17:11:27.353415+0000","last_undegraded":"2024-09-13T17:11:27.353415+0000","last_fullsized":"2024-09-13T17:11:27.353415+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:30.788242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.557424+0000","last_change":"2024-09-13T17:11:23.342436+0000","last_active":"2024-09-13T17:11:27.557424+0000","last_peered":"2024-09-13T17:11:27.557424+0000","last_clean":"2024-09-13T17:11:27.557424+0000","last_became_active":"2024-09-13T17:11:23.342157+0000","last_became_peered":"2024-09-13T17:11:23.342157+0000","last_unstale":"2024-09-13T17:11:27.557424+0000","last_undegraded":"2024-09-13T17:11:27.557424+0000","last_fullsized":"2024-09-13T17:11:27.557424+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:56.550875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801559+0000","last_change":"2024-09-13T17:11:23.341660+0000","last_active":"2024-09-13T17:11:48.801559+0000","last_peered":"2024-09-13T17:11:48.801559+0000","last_clean":"2024-09-13T17:11:48.801559+0000","last_became_active":"2024-09-13T17:11:23.341102+0000","last_became_peered":"2024-09-13T17:11:23.341102+0000","last_unstale":"2024-09-13T17:11:48.801559+0000","last_undegraded":"2024-09-13T17:11:48.801559+0000","last_fullsized":"2024-09-13T17:11:48.801559+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:00.546907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345956+0000","last_change":"2024-09-13T17:11:23.338064+0000","last_active":"2024-09-13T17:11:27.345956+0000","last_peered":"2024-09-13T17:11:27.345956+0000","last_clean":"2024-09-13T17:11:27.345956+0000","last_became_active":"2024-09-13T17:11:23.337748+0000","last_became_peered":"2024-09-13T17:11:23.337748+0000","last_unstale":"2024-09-13T17:11:27.345956+0000","last_undegraded":"2024-09-13T17:11:27.345956+0000","last_fullsized":"2024-09-13T17:11:27.345956+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:14.281629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832520+0000","last_change":"2024-09-13T17:11:23.335684+0000","last_active":"2024-09-13T17:11:27.832520+0000","last_peered":"2024-09-13T17:11:27.832520+0000","last_clean":"2024-09-13T17:11:27.832520+0000","last_became_active":"2024-09-13T17:11:23.335364+0000","last_became_peered":"2024-09-13T17:11:23.335364+0000","last_unstale":"2024-09-13T17:11:27.832520+0000","last_undegraded":"2024-09-13T17:11:27.832520+0000","last_fullsized":"2024-09-13T17:11:27.832520+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:02.288009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832521+0000","last_change":"2024-09-13T17:11:23.340881+0000","last_active":"2024-09-13T17:11:27.832521+0000","last_peered":"2024-09-13T17:11:27.832521+0000","last_clean":"2024-09-13T17:11:27.832521+0000","last_became_active":"2024-09-13T17:11:23.340575+0000","last_became_peered":"2024-09-13T17:11:23.340575+0000","last_unstale":"2024-09-13T17:11:27.832521+0000","last_undegraded":"2024-09-13T17:11:27.832521+0000","last_fullsized":"2024-09-13T17:11:27.832521+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:40.757703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344905+0000","last_change":"2024-09-13T17:11:23.329039+0000","last_active":"2024-09-13T17:11:27.344905+0000","last_peered":"2024-09-13T17:11:27.344905+0000","last_clean":"2024-09-13T17:11:27.344905+0000","last_became_active":"2024-09-13T17:11:23.328324+0000","last_became_peered":"2024-09-13T17:11:23.328324+0000","last_unstale":"2024-09-13T17:11:27.344905+0000","last_undegraded":"2024-09-13T17:11:27.344905+0000","last_fullsized":"2024-09-13T17:11:27.344905+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:37.882596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.833586+0000","last_change":"2024-09-13T17:11:23.345229+0000","last_active":"2024-09-13T17:11:27.833586+0000","last_peered":"2024-09-13T17:11:27.833586+0000","last_clean":"2024-09-13T17:11:27.833586+0000","last_became_active":"2024-09-13T17:11:23.344883+0000","last_became_peered":"2024-09-13T17:11:23.344883+0000","last_unstale":"2024-09-13T17:11:27.833586+0000","last_undegraded":"2024-09-13T17:11:27.833586+0000","last_fullsized":"2024-09-13T17:11:27.833586+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:47.983382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.346617+0000","last_change":"2024-09-13T17:11:23.346338+0000","last_active":"2024-09-13T17:11:27.346617+0000","last_peered":"2024-09-13T17:11:27.346617+0000","last_clean":"2024-09-13T17:11:27.346617+0000","last_became_active":"2024-09-13T17:11:23.344777+0000","last_became_peered":"2024-09-13T17:11:23.344777+0000","last_unstale":"2024-09-13T17:11:27.346617+0000","last_undegraded":"2024-09-13T17:11:27.346617+0000","last_fullsized":"2024-09-13T17:11:27.346617+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:23.650174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"peering","last_fresh":"2024-09-13T17:11:48.800882+0000","last_change":"2024-09-13T17:11:48.801055+0000","last_active":"2024-09-13T17:11:48.800882+0000","last_peered":"2024-09-13T17:11:27.834681+0000","last_clean":"2024-09-13T17:11:27.834681+0000","last_became_active":"2024-09-13T17:11:23.334660+0000","last_became_peered":"2024-09-13T17:11:23.334660+0000","last_unstale":"2024-09-13T17:11:48.800882+0000","last_undegraded":"2024-09-13T17:11:48.800882+0000","last_fullsized":"2024-09-13T17:11:48.800882+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:32.110092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,4,9],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344818+0000","last_change":"2024-09-13T17:11:23.340478+0000","last_active":"2024-09-13T17:11:27.344818+0000","last_peered":"2024-09-13T17:11:27.344818+0000","last_clean":"2024-09-13T17:11:27.344818+0000","last_became_active":"2024-09-13T17:11:23.339916+0000","last_became_peered":"2024-09-13T17:11:23.339916+0000","last_unstale":"2024-09-13T17:11:27.344818+0000","last_undegraded":"2024-09-13T17:11:27.344818+0000","last_fullsized":"2024-09-13T17:11:27.344818+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:09.477626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.349777+0000","last_change":"2024-09-13T17:11:23.340882+0000","last_active":"2024-09-13T17:11:27.349777+0000","last_peered":"2024-09-13T17:11:27.349777+0000","last_clean":"2024-09-13T17:11:27.349777+0000","last_became_active":"2024-09-13T17:11:23.340413+0000","last_became_peered":"2024-09-13T17:11:23.340413+0000","last_unstale":"2024-09-13T17:11:27.349777+0000","last_undegraded":"2024-09-13T17:11:27.349777+0000","last_fullsized":"2024-09-13T17:11:27.349777+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:49.040015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344555+0000","last_change":"2024-09-13T17:11:23.345551+0000","last_active":"2024-09-13T17:11:27.344555+0000","last_peered":"2024-09-13T17:11:27.344555+0000","last_clean":"2024-09-13T17:11:27.344555+0000","last_became_active":"2024-09-13T17:11:23.345195+0000","last_became_peered":"2024-09-13T17:11:23.345195+0000","last_unstale":"2024-09-13T17:11:27.344555+0000","last_undegraded":"2024-09-13T17:11:27.344555+0000","last_fullsized":"2024-09-13T17:11:27.344555+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:00.856969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"peering","last_fresh":"2024-09-13T17:11:48.799086+0000","last_change":"2024-09-13T17:11:48.799241+0000","last_active":"2024-09-13T17:11:48.799086+0000","last_peered":"2024-09-13T17:11:27.834170+0000","last_clean":"2024-09-13T17:11:27.834170+0000","last_became_active":"2024-09-13T17:11:23.334061+0000","last_became_peered":"2024-09-13T17:11:23.334061+0000","last_unstale":"2024-09-13T17:11:48.799086+0000","last_undegraded":"2024-09-13T17:11:48.799086+0000","last_fullsized":"2024-09-13T17:11:48.799086+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:40.383855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,7,9],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.353081+0000","last_change":"2024-09-13T17:11:23.340286+0000","last_active":"2024-09-13T17:11:27.353081+0000","last_peered":"2024-09-13T17:11:27.353081+0000","last_clean":"2024-09-13T17:11:27.353081+0000","last_became_active":"2024-09-13T17:11:23.339756+0000","last_became_peered":"2024-09-13T17:11:23.339756+0000","last_unstale":"2024-09-13T17:11:27.353081+0000","last_undegraded":"2024-09-13T17:11:27.353081+0000","last_fullsized":"2024-09-13T17:11:27.353081+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:00.463087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.833501+0000","last_change":"2024-09-13T17:11:23.339818+0000","last_active":"2024-09-13T17:11:27.833501+0000","last_peered":"2024-09-13T17:11:27.833501+0000","last_clean":"2024-09-13T17:11:27.833501+0000","last_became_active":"2024-09-13T17:11:23.339501+0000","last_became_peered":"2024-09-13T17:11:23.339501+0000","last_unstale":"2024-09-13T17:11:27.833501+0000","last_undegraded":"2024-09-13T17:11:27.833501+0000","last_fullsized":"2024-09-13T17:11:27.833501+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:36.904004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832723+0000","last_change":"2024-09-13T17:11:23.334388+0000","last_active":"2024-09-13T17:11:27.832723+0000","last_peered":"2024-09-13T17:11:27.832723+0000","last_clean":"2024-09-13T17:11:27.832723+0000","last_became_active":"2024-09-13T17:11:23.333953+0000","last_became_peered":"2024-09-13T17:11:23.333953+0000","last_unstale":"2024-09-13T17:11:27.832723+0000","last_undegraded":"2024-09-13T17:11:27.832723+0000","last_fullsized":"2024-09-13T17:11:27.832723+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:33.929173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832701+0000","last_change":"2024-09-13T17:11:23.338259+0000","last_active":"2024-09-13T17:11:27.832701+0000","last_peered":"2024-09-13T17:11:27.832701+0000","last_clean":"2024-09-13T17:11:27.832701+0000","last_became_active":"2024-09-13T17:11:23.337979+0000","last_became_peered":"2024-09-13T17:11:23.337979+0000","last_unstale":"2024-09-13T17:11:27.832701+0000","last_undegraded":"2024-09-13T17:11:27.832701+0000","last_fullsized":"2024-09-13T17:11:27.832701+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:55.750255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801517+0000","last_change":"2024-09-13T17:11:23.337899+0000","last_active":"2024-09-13T17:11:48.801517+0000","last_peered":"2024-09-13T17:11:48.801517+0000","last_clean":"2024-09-13T17:11:48.801517+0000","last_became_active":"2024-09-13T17:11:23.337626+0000","last_became_peered":"2024-09-13T17:11:23.337626+0000","last_unstale":"2024-09-13T17:11:48.801517+0000","last_undegraded":"2024-09-13T17:11:48.801517+0000","last_fullsized":"2024-09-13T17:11:48.801517+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:14.654852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":43759,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":23,"num_read_kb":40,"num_write":124,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":58679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285958,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383698,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":995328,"data_stored":499901,"data_compressed":17667,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.35499999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.497}]},{"osd":2,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.58199999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.41799999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.50900000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.67700000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":9,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.52000000000000002}]},{"osd":10,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.60599999999999998}]}]},{"osd":10,"up_from":72,"seq":309237645334,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":1105920,"data_stored":1118312,"data_compressed":51052,"data_compressed_allocated":65536,"data_compressed_original":630784,"omap_allocated":1597,"internal_metadata":36043203},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.52200000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.374},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.39700000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.624},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.60899999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.54500000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.443}]},{"osd":6,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.70999999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.51200000000000001}]},{"osd":8,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.50900000000000001}]},{"osd":9,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.67500000000000004}]},{"osd":11,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.746}]}]},{"osd":9,"up_from":67,"seq":287762808858,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":978944,"data_stored":477347,"data_compressed":11720,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1597,"internal_metadata":31848899},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.315}]},{"osd":1,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.503},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.39100000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.40799999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.27100000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.51300000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.39900000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.49299999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.66500000000000004}]},{"osd":8,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.54200000000000004}]},{"osd":10,"last update":"Fri Sep 13 17:11:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.55700000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]}]},{"osd":8,"up_from":59,"seq":253403070496,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":477301,"data_compressed":11720,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67600000000000005,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.65500000000000003,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.67500000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54300000000000004,"15min":0.54400000000000004},"min":{"1min":0.34599999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71799999999999997,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.79900000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.41899999999999998,"15min":0.41799999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.63100000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.441,"15min":0.438},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70899999999999996,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.68999999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.73899999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.81299999999999994}]},{"osd":5,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.753},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53400000000000003,"15min":0.53600000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76700000000000002,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.78000000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.64400000000000002,"15min":0.64900000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.85999999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64700000000000002,"15min":0.64600000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92200000000000004,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90900000000000003,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.94999999999999996}]},{"osd":9,"last update":"Fri Sep 13 17:10:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.873},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.84699999999999998}]},{"osd":10,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.92900000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]}]},{"osd":7,"up_from":51,"seq":219043332132,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":1069019,"data_compressed":48079,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1587,"internal_metadata":27654605},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.39700000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.66200000000000003,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.35799999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.52500000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.35999999999999999,"15min":0.35399999999999998},"min":{"1min":0.25800000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.34999999999999998,"15min":0.34399999999999997},"min":{"1min":0.32200000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.623}]},{"osd":2,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52800000000000002,"15min":0.52100000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.502},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.51400000000000001,"15min":0.50700000000000001},"min":{"1min":0.39100000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.52200000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.51000000000000001,"15min":0.502},"min":{"1min":0.38100000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67500000000000004,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.53400000000000003},"min":{"1min":0.42899999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.81200000000000006}]},{"osd":4,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46200000000000002,"15min":0.45700000000000002},"min":{"1min":0.29899999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.442,"15min":0.439},"min":{"1min":0.31900000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.44500000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.56899999999999995,"15min":0.56200000000000006},"min":{"1min":0.5,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57499999999999996,"15min":0.57199999999999995},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.47799999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.44700000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.59799999999999998,"15min":0.58699999999999997},"min":{"1min":0.45600000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.86599999999999999}]},{"osd":8,"last update":"Fri Sep 13 17:11:31 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.63600000000000001,"15min":0.628},"min":{"1min":0.504,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.65300000000000002,"15min":0.64200000000000002},"min":{"1min":0.47899999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.70299999999999996}]},{"osd":9,"last update":"Fri Sep 13 17:10:49 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.78900000000000003}]},{"osd":10,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.74299999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]}]},{"osd":6,"up_from":46,"seq":197568495656,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":476563,"data_compressed":11720,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.34200000000000003,"15min":0.33500000000000002},"min":{"1min":0.23400000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.373,"15min":0.36899999999999999},"min":{"1min":0.26500000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.57399999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.29899999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.74199999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.63600000000000001,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.47399999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68999999999999995,"5min":1.095,"15min":1.095},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54100000000000004,"15min":0.52600000000000002},"min":{"1min":0.35899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.77300000000000002,"5min":0.877,"15min":0.877},"last":0.67700000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.42199999999999999,"15min":0.41599999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.626,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41799999999999998,"15min":0.41199999999999998},"min":{"1min":0.28199999999999997,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58599999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.40999999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51000000000000001,"15min":0.502},"min":{"1min":0.41199999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71699999999999997,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.39200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76100000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.59599999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.70599999999999996,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59599999999999997,"15min":0.60299999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.73999999999999999,"5min":1.131,"15min":1.131},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.436},{"interface":"front","average":{"1min":0.628,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.71199999999999997}]},{"osd":8,"last update":"Fri Sep 13 17:11:28 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.623,"15min":0.627},"min":{"1min":0.42399999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.85899999999999999,"5min":0.874,"15min":0.874},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.69799999999999995}]},{"osd":9,"last update":"Fri Sep 13 17:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.63300000000000001}]},{"osd":10,"last update":"Fri Sep 13 17:11:12 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.74299999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]}]},{"osd":5,"up_from":38,"seq":163208757293,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":1036288,"data_stored":1068028,"data_compressed":48079,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48399999999999999,"15min":0.47599999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67300000000000004,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48799999999999999,"15min":0.47999999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69499999999999995,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.56299999999999994}]},{"osd":1,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55100000000000005,"15min":0.54400000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68600000000000005,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.371,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.67600000000000005,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.58099999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.377,"15min":0.371},"min":{"1min":0.23499999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.58699999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.378,"15min":0.372},"min":{"1min":0.253,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.59099999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.39700000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50700000000000001,"15min":0.501},"min":{"1min":0.30199999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.69599999999999995,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.63800000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.67300000000000004}]},{"osd":4,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73099999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56999999999999995,"15min":0.56000000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.629}]},{"osd":6,"last update":"Fri Sep 13 17:11:41 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.75},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56100000000000005,"15min":0.56000000000000005},"min":{"1min":0.39100000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.74199999999999999,"5min":0.749,"15min":0.749},"last":0.74199999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.46400000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.44,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.71599999999999997}]},{"osd":8,"last update":"Fri Sep 13 17:11:26 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52500000000000002,"15min":0.53100000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69199999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55800000000000005,"15min":0.56599999999999995},"min":{"1min":0.39800000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.70299999999999996,"5min":0.747,"15min":0.747},"last":0.52000000000000002}]},{"osd":9,"last update":"Fri Sep 13 17:10:47 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.81000000000000005}]},{"osd":10,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.77800000000000002}]}]},{"osd":4,"up_from":33,"seq":141733920819,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36176,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708976,"statfs":{"total":95995035648,"available":95957991424,"internally_reserved":0,"allocated":987136,"data_stored":490408,"data_compressed":14693,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":0.71699999999999997,"15min":0.59099999999999997},"min":{"1min":0.42399999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":15.369999999999999,"5min":15.369999999999999,"15min":15.369999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":1.4950000000000001,"5min":0.68200000000000005,"15min":0.54400000000000004},"min":{"1min":0.45900000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":15.416,"5min":15.416,"15min":15.416},"last":0.35399999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.36499999999999999,"15min":0.35899999999999999},"min":{"1min":0.25900000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38600000000000001},"min":{"1min":0.28699999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.60099999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.34799999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":0.74099999999999999,"15min":0.61699999999999999},"min":{"1min":0.379,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":15.401,"5min":15.401,"15min":15.401},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.52900000000000003,"15min":0.51900000000000002},"min":{"1min":0.39500000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.745,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.47599999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53900000000000003,"15min":0.54900000000000004},"min":{"1min":0.375,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76900000000000002,"5min":1.016,"15min":1.016},"last":0.39100000000000001},{"interface":"front","average":{"1min":1.524,"5min":0.74099999999999999,"15min":0.61699999999999999},"min":{"1min":0.39400000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":15.425000000000001,"5min":15.425000000000001,"15min":15.425000000000001},"last":0.40699999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57299999999999995,"15min":0.56399999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77900000000000003,"5min":1.073,"15min":1.073},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.73399999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.53500000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.54800000000000004,"15min":0.51800000000000002},"min":{"1min":0.40200000000000002,"5min":0.371,"15min":0.371},"max":{"1min":2.6469999999999998,"5min":2.6469999999999998,"15min":2.6469999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57599999999999996,"15min":0.55600000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.45400000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:11:00 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48199999999999998,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69399999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.48299999999999998,"15min":0.47899999999999998},"min":{"1min":0.34399999999999997,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.49399999999999999}]},{"osd":8,"last update":"Fri Sep 13 17:11:26 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.65200000000000002,"15min":0.63900000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.577,"5min":2.577,"15min":2.577},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.65500000000000003,"15min":0.64600000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.60299999999999998}]},{"osd":9,"last update":"Fri Sep 13 17:10:49 2024","interfaces":[{"interface":"back","average":{"1min":1.615,"5min":1.615,"15min":1.615},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":15.448,"5min":15.448,"15min":15.448},"last":0.55500000000000005},{"interface":"front","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":15.385,"5min":15.385,"15min":15.385},"last":0.63}]},{"osd":10,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.51100000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]},{"osd":3,"up_from":25,"seq":107374182454,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":476063,"data_compressed":11720,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34000000000000002,"15min":0.317},"min":{"1min":0.22500000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.34399999999999997,"15min":0.32200000000000001},"min":{"1min":0.23899999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.60899999999999999,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.27400000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52400000000000002,"15min":0.49399999999999999},"min":{"1min":0.32900000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78900000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51200000000000001,"15min":0.48299999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.60999999999999999,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.57199999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51500000000000001,"15min":0.496},"min":{"1min":0.34000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67800000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53800000000000003,"15min":0.50700000000000001},"min":{"1min":0.34200000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.73999999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.58099999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:10:55 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.53000000000000003,"15min":0.51400000000000001},"min":{"1min":0.372,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.625,"5min":0.53200000000000003,"15min":0.50700000000000001},"min":{"1min":0.40500000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.42899999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55900000000000005,"15min":0.55400000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70399999999999996,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.56000000000000005,"15min":0.56100000000000005},"min":{"1min":0.35199999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.754,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.60999999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:11:43 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.45200000000000001,"15min":0.44600000000000001},"min":{"1min":0.28199999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68000000000000005,"5min":0.746,"15min":0.746},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.45700000000000002,"15min":0.443},"min":{"1min":0.29499999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70199999999999996,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.35599999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:11:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58399999999999996,"15min":0.57799999999999996},"min":{"1min":0.42599999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.77500000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.503},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.45500000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.59099999999999997}]},{"osd":8,"last update":"Fri Sep 13 17:10:26 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66400000000000003}]},{"osd":9,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.45200000000000001}]},{"osd":10,"last update":"Fri Sep 13 17:11:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.53300000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]}]},{"osd":2,"up_from":18,"seq":77309411388,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":480693,"data_compressed":11720,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:09 2024","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":0.76600000000000001,"15min":0.73999999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":19.158999999999999,"5min":19.158999999999999,"15min":19.158999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.47599999999999998,"15min":0.46700000000000003},"min":{"1min":0.33700000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68500000000000005,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.57999999999999996}]},{"osd":1,"last update":"Fri Sep 13 17:11:09 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.501,"15min":0.47499999999999998},"min":{"1min":0.38,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68600000000000005,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.498,"15min":0.46800000000000003},"min":{"1min":0.40100000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.92800000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:11:36 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.51900000000000002,"15min":0.5},"min":{"1min":0.41299999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52700000000000002,"15min":0.50600000000000001},"min":{"1min":0.42999999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71899999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.64700000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.51100000000000001},"min":{"1min":0.41499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72199999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.40300000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.65800000000000003,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.79900000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:11:14 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.39900000000000002,"15min":0.39100000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.64500000000000002,"5min":0.747,"15min":0.747},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39800000000000002,"15min":0.39200000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.68799999999999994,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.77800000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:11:38 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54000000000000004},"min":{"1min":0.41699999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68300000000000005,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.875},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.69799999999999995,"15min":0.58699999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82499999999999996,"5min":19.276,"15min":19.276},"last":0.94299999999999995}]},{"osd":7,"last update":"Fri Sep 13 17:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.36699999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76200000000000001,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.41699999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76600000000000001,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.91300000000000003}]},{"osd":8,"last update":"Fri Sep 13 17:11:25 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53700000000000003,"15min":0.53500000000000003},"min":{"1min":0.33100000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76000000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56399999999999995,"15min":0.56100000000000005},"min":{"1min":0.35799999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":1.0309999999999999}]},{"osd":9,"last update":"Fri Sep 13 17:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":19.210999999999999,"5min":19.210999999999999,"15min":19.210999999999999},"last":1.0409999999999999}]},{"osd":10,"last update":"Fri Sep 13 17:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":1.01},{"interface":"front","average":{"1min":1.595,"5min":1.595,"15min":1.595},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":19.242000000000001,"5min":19.242000000000001,"15min":19.242000000000001},"last":1.0529999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":974848,"data_stored":480358,"data_compressed":11720,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:53 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.47799999999999998,"15min":0.46200000000000002},"min":{"1min":0.35199999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.48199999999999998,"15min":0.46500000000000002},"min":{"1min":0.32700000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.65500000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:11:08 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.52800000000000002,"15min":0.504},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.76900000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.52100000000000002,"15min":0.503},"min":{"1min":0.375,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.72199999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:11:37 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70599999999999996,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54700000000000004,"15min":0.52800000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70299999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.70799999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:10:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.39500000000000002,"15min":0.377},"min":{"1min":0.29199999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.38100000000000001,"15min":0.36299999999999999},"min":{"1min":0.26600000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.50600000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:11:21 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.52900000000000003,"15min":0.51300000000000001},"min":{"1min":0.35399999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.52600000000000002,"15min":0.502},"min":{"1min":0.39900000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.78700000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:11:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54000000000000004,"15min":0.52400000000000002},"min":{"1min":0.38500000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73199999999999998,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.59499999999999997,"15min":0.57499999999999996},"min":{"1min":0.45700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.82799999999999996,"5min":0.88,"15min":0.88},"last":0.76500000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:11:00 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.48999999999999999,"15min":0.47599999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.49399999999999999,"15min":0.48399999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.54800000000000004}]},{"osd":8,"last update":"Fri Sep 13 17:11:26 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.626,"15min":0.61699999999999999},"min":{"1min":0.41599999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.67300000000000004,"15min":0.66300000000000003},"min":{"1min":0.44,"5min":0.434,"15min":0.434},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.88200000000000001}]},{"osd":9,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.748}]},{"osd":10,"last update":"Fri Sep 13 17:11:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.86399999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":987136,"data_stored":477768,"data_compressed":11720,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:10:49 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.47299999999999998,"15min":0.46600000000000003},"min":{"1min":0.29899999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.49199999999999999,"15min":0.48099999999999998},"min":{"1min":0.28499999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.59399999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:11:08 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.52100000000000002,"15min":0.505},"min":{"1min":0.374,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77900000000000003,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.501},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.53000000000000003,"15min":0.50700000000000001},"min":{"1min":0.38100000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.624}]},{"osd":3,"last update":"Fri Sep 13 17:10:27 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.40999999999999998,"15min":0.40100000000000002},"min":{"1min":0.23499999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.432},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.39700000000000002,"15min":0.38900000000000001},"min":{"1min":0.26400000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.317}]},{"osd":4,"last update":"Fri Sep 13 17:10:55 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.496,"15min":0.47999999999999998},"min":{"1min":0.34100000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.52100000000000002,"15min":0.503},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Sep 13 17:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52100000000000002,"15min":0.50900000000000001},"min":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82399999999999995,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.54800000000000004,"15min":0.53000000000000003},"min":{"1min":0.42799999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80500000000000005,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.60799999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:11:41 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.433,"15min":0.41799999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.65100000000000002,"5min":0.754,"15min":0.754},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.44800000000000001,"15min":0.42999999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72899999999999998,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.376}]},{"osd":7,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.57999999999999996,"15min":0.57099999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.57599999999999996}]},{"osd":8,"last update":"Fri Sep 13 17:11:30 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.60499999999999998,"15min":0.60699999999999998},"min":{"1min":0.46500000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.77200000000000002,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.65200000000000002,"15min":0.65800000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90200000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.41899999999999998}]},{"osd":9,"last update":"Fri Sep 13 17:10:49 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.44500000000000001}]},{"osd":10,"last update":"Fri Sep 13 17:11:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.58499999999999996}]},{"osd":11,"last update":"Fri Sep 13 17:11:36 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.53700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34721,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34721,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34721,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":41955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:11:51.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.c is not active+clean 2024-09-13T17:11:51.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.c', 'version': "89'3", 'reported_seq': 2, 'reported_epoch': 90, 'state': 'peering', 'last_fresh': '2024-09-13T17:11:27.684094+0000', 'last_change': '2024-09-13T17:11:49.540357+0000', 'last_active': '2024-09-13T17:11:49.540357+0000', 'last_peered': '2024-09-13T17:11:27.684094+0000', 'last_clean': '2024-09-13T17:11:27.684094+0000', 'last_became_active': '2024-09-13T17:11:23.003102+0000', 'last_became_peered': '2024-09-13T17:11:23.003102+0000', 'last_unstale': '2024-09-13T17:11:27.684094+0000', 'last_undegraded': '2024-09-13T17:11:27.684094+0000', 'last_fullsized': '2024-09-13T17:11:27.684094+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 83, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:11:21.965914+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:11:21.965914+0000', 'last_clean_scrub_stamp': '2024-09-13T17:11:21.965914+0000', 'objects_scrubbed': 0, 'log_size': 3, 'log_dups_size': 0, 'ondisk_log_size': 3, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:09:08.827045+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 582, 'num_objects': 2, 'num_object_clones': 0, 'num_object_copies': 6, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 2, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 2, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 4, 'num_write_kb': 1, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 1, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 11, 0], 'acting': [4, 11, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:11:51.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-09-13T17:11:51.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 16, 'reported_epoch': 90, 'state': 'peering', 'last_fresh': '2024-09-13T17:11:48.798762+0000', 'last_change': '2024-09-13T17:11:48.798906+0000', 'last_active': '2024-09-13T17:11:48.798762+0000', 'last_peered': '2024-09-13T17:11:27.833117+0000', 'last_clean': '2024-09-13T17:11:27.833117+0000', 'last_became_active': '2024-09-13T17:11:23.332871+0000', 'last_became_peered': '2024-09-13T17:11:23.332871+0000', 'last_unstale': '2024-09-13T17:11:48.798762+0000', 'last_undegraded': '2024-09-13T17:11:48.798762+0000', 'last_fullsized': '2024-09-13T17:11:48.798762+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 84, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:11:22.975824+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:11:22.975824+0000', 'last_clean_scrub_stamp': '2024-09-13T17:11:22.975824+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:45:27.370999+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 8, 7], 'acting': [0, 8, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4, 5, 7, 8], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:11:51.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.36 is not active+clean 2024-09-13T17:11:51.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 17, 'reported_epoch': 90, 'state': 'peering', 'last_fresh': '2024-09-13T17:11:48.800882+0000', 'last_change': '2024-09-13T17:11:48.801055+0000', 'last_active': '2024-09-13T17:11:48.800882+0000', 'last_peered': '2024-09-13T17:11:27.834681+0000', 'last_clean': '2024-09-13T17:11:27.834681+0000', 'last_became_active': '2024-09-13T17:11:23.334660+0000', 'last_became_peered': '2024-09-13T17:11:23.334660+0000', 'last_unstale': '2024-09-13T17:11:48.800882+0000', 'last_undegraded': '2024-09-13T17:11:48.800882+0000', 'last_fullsized': '2024-09-13T17:11:48.800882+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 84, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:11:22.975824+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:11:22.975824+0000', 'last_clean_scrub_stamp': '2024-09-13T17:11:22.975824+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:59:32.110092+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [10, 2, 9], 'acting': [10, 2, 9], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2, 4, 9], 'up_primary': 10, 'acting_primary': 10, 'purged_snaps': []} 2024-09-13T17:11:51.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3a is not active+clean 2024-09-13T17:11:51.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 17, 'reported_epoch': 90, 'state': 'peering', 'last_fresh': '2024-09-13T17:11:48.799086+0000', 'last_change': '2024-09-13T17:11:48.799241+0000', 'last_active': '2024-09-13T17:11:48.799086+0000', 'last_peered': '2024-09-13T17:11:27.834170+0000', 'last_clean': '2024-09-13T17:11:27.834170+0000', 'last_became_active': '2024-09-13T17:11:23.334061+0000', 'last_became_peered': '2024-09-13T17:11:23.334061+0000', 'last_unstale': '2024-09-13T17:11:48.799086+0000', 'last_undegraded': '2024-09-13T17:11:48.799086+0000', 'last_fullsized': '2024-09-13T17:11:48.799086+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 84, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:11:22.975824+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:11:22.975824+0000', 'last_clean_scrub_stamp': '2024-09-13T17:11:22.975824+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:09:40.383855+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [10, 9, 7], 'acting': [10, 9, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4, 7, 9], 'up_primary': 10, 'acting_primary': 10, 'purged_snaps': []} 2024-09-13T17:11:51.084 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T17:11:51.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.211+0000 7fea87ed7640 1 -- 172.21.15.87:0/1033930793 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea80100830 msgr2=0x7fea801070c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:51.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.211+0000 7fea87ed7640 1 --2- 172.21.15.87:0/1033930793 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea80100830 0x7fea801070c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fea78009ca0 tx=0x7fea7802a8c0 comp rx=0 tx=0).stop 2024-09-13T17:11:51.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.212+0000 7fea87ed7640 1 -- 172.21.15.87:0/1033930793 shutdown_connections 2024-09-13T17:11:51.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.212+0000 7fea87ed7640 1 --2- 172.21.15.87:0/1033930793 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea80100830 0x7fea801070c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:51.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.212+0000 7fea87ed7640 1 --2- 172.21.15.87:0/1033930793 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea800ffe70 0x7fea801002f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:51.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.212+0000 7fea87ed7640 1 --2- 172.21.15.87:0/1033930793 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea800fec80 0x7fea800ff080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:51.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.212+0000 7fea87ed7640 1 -- 172.21.15.87:0/1033930793 >> 172.21.15.87:0/1033930793 conn(0x7fea800fa3e0 msgr2=0x7fea800fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:51.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.212+0000 7fea87ed7640 1 -- 172.21.15.87:0/1033930793 shutdown_connections 2024-09-13T17:11:51.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.212+0000 7fea87ed7640 1 -- 172.21.15.87:0/1033930793 wait complete. 2024-09-13T17:11:51.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.212+0000 7fea87ed7640 1 Processor -- start 2024-09-13T17:11:51.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.212+0000 7fea87ed7640 1 -- start start 2024-09-13T17:11:51.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.212+0000 7fea87ed7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea800fec80 0x7fea801939f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:51.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.212+0000 7fea87ed7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea800ffe70 0x7fea80193f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:51.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.212+0000 7fea87ed7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea80100830 0x7fea8019afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:51.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.212+0000 7fea87ed7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8019b4e0 con 0x7fea80100830 2024-09-13T17:11:51.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.212+0000 7fea87ed7640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8019b650 con 0x7fea800fec80 2024-09-13T17:11:51.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.212+0000 7fea87ed7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8019b810 con 0x7fea800ffe70 2024-09-13T17:11:51.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.212+0000 7fea86474640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea80100830 0x7fea8019afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:51.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.213+0000 7fea86474640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea80100830 0x7fea8019afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45580/0 (socket says 172.21.15.87:45580) 2024-09-13T17:11:51.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.213+0000 7fea86474640 1 -- 172.21.15.87:0/1886732194 learned_addr learned my addr 172.21.15.87:0/1886732194 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:51.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.213+0000 7fea85472640 1 --2- 172.21.15.87:0/1886732194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea800ffe70 0x7fea80193f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:51.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.213+0000 7fea85c73640 1 --2- 172.21.15.87:0/1886732194 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea800fec80 0x7fea801939f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:51.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.213+0000 7fea86474640 1 -- 172.21.15.87:0/1886732194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea800ffe70 msgr2=0x7fea80193f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:51.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.213+0000 7fea86474640 1 --2- 172.21.15.87:0/1886732194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea800ffe70 0x7fea80193f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:51.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.213+0000 7fea86474640 1 -- 172.21.15.87:0/1886732194 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea800fec80 msgr2=0x7fea801939f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:51.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.213+0000 7fea86474640 1 --2- 172.21.15.87:0/1886732194 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea800fec80 0x7fea801939f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:51.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.213+0000 7fea86474640 1 -- 172.21.15.87:0/1886732194 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea78009900 con 0x7fea80100830 2024-09-13T17:11:51.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.213+0000 7fea86474640 1 --2- 172.21.15.87:0/1886732194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea80100830 0x7fea8019afa0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fea7802aeb0 tx=0x7fea78003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:51.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.213+0000 7fea76ffd640 1 -- 172.21.15.87:0/1886732194 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea780307c0 con 0x7fea80100830 2024-09-13T17:11:51.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.213+0000 7fea76ffd640 1 -- 172.21.15.87:0/1886732194 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fea78040070 con 0x7fea80100830 2024-09-13T17:11:51.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.213+0000 7fea76ffd640 1 -- 172.21.15.87:0/1886732194 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea780046c0 con 0x7fea80100830 2024-09-13T17:11:51.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.213+0000 7fea87ed7640 1 -- 172.21.15.87:0/1886732194 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea8019ba90 con 0x7fea80100830 2024-09-13T17:11:51.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.213+0000 7fea87ed7640 1 -- 172.21.15.87:0/1886732194 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea8019bf50 con 0x7fea80100830 2024-09-13T17:11:51.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.214+0000 7fea87ed7640 1 -- 172.21.15.87:0/1886732194 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea80106040 con 0x7fea80100830 2024-09-13T17:11:51.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.215+0000 7fea76ffd640 1 -- 172.21.15.87:0/1886732194 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fea78042030 con 0x7fea80100830 2024-09-13T17:11:51.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.216+0000 7fea76ffd640 1 --2- 172.21.15.87:0/1886732194 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fea6c0a3330 0x7fea6c0a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:51.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.216+0000 7fea85c73640 1 --2- 172.21.15.87:0/1886732194 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fea6c0a3330 0x7fea6c0a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:51.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.216+0000 7fea76ffd640 1 -- 172.21.15.87:0/1886732194 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8978+0+0 (secure 0 0 0) 0x7fea780ee760 con 0x7fea80100830 2024-09-13T17:11:51.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.216+0000 7fea85c73640 1 --2- 172.21.15.87:0/1886732194 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fea6c0a3330 0x7fea6c0a57f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fea800ffcd0 tx=0x7fea7c005c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:51.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.220+0000 7fea76ffd640 1 -- 172.21.15.87:0/1886732194 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fea780b7b50 con 0x7fea80100830 2024-09-13T17:11:51.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.447+0000 7fea87ed7640 1 -- 172.21.15.87:0/1886732194 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fea8002c3e0 con 0x7fea80100830 2024-09-13T17:11:51.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.447+0000 7fea76ffd640 1 -- 172.21.15.87:0/1886732194 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3023 (secure 0 0 0) 0x7fea780bb170 con 0x7fea80100830 2024-09-13T17:11:51.450 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:11:51.450 INFO:teuthology.orchestra.run.smithi087.stdout:{"fsid":"043d5bae-71f2-11ef-bceb-c7b262605968","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_age":366,"monmap":{"epoch":3,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":91,"num_osds":12,"num_up_osds":12,"osd_up_since":1726247434,"num_in_osds":12,"osd_in_since":1726247414,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":125},{"state_name":"peering","count":4}],"num_pgs":129,"num_pools":4,"num_objects":56,"data_bytes":634361,"bytes_used":385933312,"bytes_avail":1151554494464,"bytes_total":1151940427776,"inactive_pgs_ratio":0.031007751822471619,"read_bytes_sec":5118,"write_bytes_sec":8317,"read_op_per_sec":2,"write_op_per_sec":9},"fsmap":{"epoch":23,"id":1,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":1,"rank":2,"name":"l","status":"up:standby-replay","gid":24427},{"filesystem_id":1,"rank":1,"name":"h","status":"up:standby-replay","gid":24446},{"filesystem_id":1,"rank":0,"name":"b","status":"up:standby-replay","gid":24470},{"filesystem_id":1,"rank":2,"name":"f","status":"up:active","gid":24472},{"filesystem_id":1,"rank":1,"name":"c","status":"up:active","gid":24484},{"filesystem_id":1,"rank":0,"name":"i","status":"up:active","gid":24499}],"up:standby":6},"mgrmap":{"available":true,"num_standbys":2,"modules":["cephadm","dashboard","iostat","nfs","restful"],"services":{"dashboard":"https://172.21.15.87:8443/"}},"servicemap":{"epoch":19,"modified":"2024-09-13T17:11:50.074383+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"e":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"f":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"g":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"h":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"i":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"j":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"k":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-13T17:11:51.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.450+0000 7fea87ed7640 1 -- 172.21.15.87:0/1886732194 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fea6c0a3330 msgr2=0x7fea6c0a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:51.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.450+0000 7fea87ed7640 1 --2- 172.21.15.87:0/1886732194 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fea6c0a3330 0x7fea6c0a57f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fea800ffcd0 tx=0x7fea7c005c60 comp rx=0 tx=0).stop 2024-09-13T17:11:51.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.450+0000 7fea87ed7640 1 -- 172.21.15.87:0/1886732194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea80100830 msgr2=0x7fea8019afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:51.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.450+0000 7fea87ed7640 1 --2- 172.21.15.87:0/1886732194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea80100830 0x7fea8019afa0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fea7802aeb0 tx=0x7fea78003c20 comp rx=0 tx=0).stop 2024-09-13T17:11:51.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.450+0000 7fea87ed7640 1 -- 172.21.15.87:0/1886732194 shutdown_connections 2024-09-13T17:11:51.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.450+0000 7fea87ed7640 1 --2- 172.21.15.87:0/1886732194 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fea6c0a3330 0x7fea6c0a57f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:51.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.450+0000 7fea87ed7640 1 --2- 172.21.15.87:0/1886732194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea80100830 0x7fea8019afa0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:51.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.450+0000 7fea87ed7640 1 --2- 172.21.15.87:0/1886732194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea800ffe70 0x7fea80193f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:51.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.450+0000 7fea87ed7640 1 --2- 172.21.15.87:0/1886732194 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea800fec80 0x7fea801939f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:51.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.450+0000 7fea87ed7640 1 -- 172.21.15.87:0/1886732194 >> 172.21.15.87:0/1886732194 conn(0x7fea800fa3e0 msgr2=0x7fea80103210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:51.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.450+0000 7fea87ed7640 1 -- 172.21.15.87:0/1886732194 shutdown_connections 2024-09-13T17:11:51.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.450+0000 7fea87ed7640 1 -- 172.21.15.87:0/1886732194 wait complete. 2024-09-13T17:11:51.461 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:51 smithi087 ceph-mon[30934]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:11:51.461 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:51 smithi087 ceph-mon[30934]: pgmap v292: 129 pgs: 4 peering, 125 active+clean; 619 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 8.1 KiB/s wr, 12 op/s 2024-09-13T17:11:51.462 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-09-13T17:11:51.463 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:11:51.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.558+0000 7f0103c80640 1 -- 172.21.15.87:0/3962532266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00fc105ae0 msgr2=0x7f00fc107ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:51.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.558+0000 7f0103c80640 1 --2- 172.21.15.87:0/3962532266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00fc105ae0 0x7f00fc107ef0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f00ec009ca0 tx=0x7f00ec02a8c0 comp rx=0 tx=0).stop 2024-09-13T17:11:51.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.558+0000 7f0103c80640 1 -- 172.21.15.87:0/3962532266 shutdown_connections 2024-09-13T17:11:51.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.558+0000 7f0103c80640 1 --2- 172.21.15.87:0/3962532266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00fc105ae0 0x7f00fc107ef0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:51.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.558+0000 7f0103c80640 1 --2- 172.21.15.87:0/3962532266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00fc1031b0 0x7f00fc1055a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:51.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.558+0000 7f0103c80640 1 --2- 172.21.15.87:0/3962532266 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00fc100880 0x7f00fc102c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:51.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.558+0000 7f0103c80640 1 -- 172.21.15.87:0/3962532266 >> 172.21.15.87:0/3962532266 conn(0x7f00fc0fa440 msgr2=0x7f00fc0fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:51.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.559+0000 7f0103c80640 1 -- 172.21.15.87:0/3962532266 shutdown_connections 2024-09-13T17:11:51.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.559+0000 7f0103c80640 1 -- 172.21.15.87:0/3962532266 wait complete. 2024-09-13T17:11:51.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.559+0000 7f0103c80640 1 Processor -- start 2024-09-13T17:11:51.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.559+0000 7f0103c80640 1 -- start start 2024-09-13T17:11:51.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.559+0000 7f0103c80640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00fc100880 0x7f00fc195e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:51.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.559+0000 7f0103c80640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00fc1031b0 0x7f00fc196380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:51.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.559+0000 7f0103c80640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00fc105ae0 0x7f00fc19d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:51.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.559+0000 7f0103c80640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc19d8e0 con 0x7f00fc100880 2024-09-13T17:11:51.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.559+0000 7f0103c80640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc19da50 con 0x7f00fc105ae0 2024-09-13T17:11:51.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.559+0000 7f0103c80640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc19dc10 con 0x7f00fc1031b0 2024-09-13T17:11:51.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.559+0000 7f0101a1c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00fc100880 0x7f00fc195e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:51.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.559+0000 7f0101a1c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00fc100880 0x7f00fc195e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45584/0 (socket says 172.21.15.87:45584) 2024-09-13T17:11:51.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.559+0000 7f0101a1c640 1 -- 172.21.15.87:0/3203790577 learned_addr learned my addr 172.21.15.87:0/3203790577 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:51.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.560+0000 7f010221d640 1 --2- 172.21.15.87:0/3203790577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00fc105ae0 0x7f00fc19d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:51.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.560+0000 7f010121b640 1 --2- 172.21.15.87:0/3203790577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00fc1031b0 0x7f00fc196380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:51.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.560+0000 7f0101a1c640 1 -- 172.21.15.87:0/3203790577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00fc1031b0 msgr2=0x7f00fc196380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:51.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.560+0000 7f0101a1c640 1 --2- 172.21.15.87:0/3203790577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00fc1031b0 0x7f00fc196380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:51.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.560+0000 7f0101a1c640 1 -- 172.21.15.87:0/3203790577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00fc105ae0 msgr2=0x7f00fc19d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:51.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.560+0000 7f0101a1c640 1 --2- 172.21.15.87:0/3203790577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00fc105ae0 0x7f00fc19d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:51.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.560+0000 7f0101a1c640 1 -- 172.21.15.87:0/3203790577 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ec009900 con 0x7f00fc100880 2024-09-13T17:11:51.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.560+0000 7f010221d640 1 --2- 172.21.15.87:0/3203790577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00fc105ae0 0x7f00fc19d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:11:51.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.560+0000 7f0101a1c640 1 --2- 172.21.15.87:0/3203790577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00fc100880 0x7f00fc195e40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f00f400b4a0 tx=0x7f00f400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:51.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.560+0000 7f00faffd640 1 -- 172.21.15.87:0/3203790577 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f4010610 con 0x7f00fc100880 2024-09-13T17:11:51.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.560+0000 7f00faffd640 1 -- 172.21.15.87:0/3203790577 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f00f4010c20 con 0x7f00fc100880 2024-09-13T17:11:51.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.560+0000 7f0103c80640 1 -- 172.21.15.87:0/3203790577 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00fc19def0 con 0x7f00fc100880 2024-09-13T17:11:51.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.560+0000 7f00faffd640 1 -- 172.21.15.87:0/3203790577 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f4017d50 con 0x7f00fc100880 2024-09-13T17:11:51.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.560+0000 7f0103c80640 1 -- 172.21.15.87:0/3203790577 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00fc19e310 con 0x7f00fc100880 2024-09-13T17:11:51.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.561+0000 7f0103c80640 1 -- 172.21.15.87:0/3203790577 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00fc103590 con 0x7f00fc100880 2024-09-13T17:11:51.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.562+0000 7f00faffd640 1 -- 172.21.15.87:0/3203790577 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f00f4010770 con 0x7f00fc100880 2024-09-13T17:11:51.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.563+0000 7f00faffd640 1 --2- 172.21.15.87:0/3203790577 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f00e40a11a0 0x7f00e40a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:51.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.563+0000 7f010121b640 1 --2- 172.21.15.87:0/3203790577 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f00e40a11a0 0x7f00e40a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:51.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.563+0000 7f00faffd640 1 -- 172.21.15.87:0/3203790577 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8978+0+0 (secure 0 0 0) 0x7f00f40cc2d0 con 0x7f00fc100880 2024-09-13T17:11:51.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.563+0000 7f010121b640 1 --2- 172.21.15.87:0/3203790577 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f00e40a11a0 0x7f00e40a3660 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f00f0005d00 tx=0x7f00f0005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:51.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.567+0000 7f00faffd640 1 -- 172.21.15.87:0/3203790577 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f00f40957c0 con 0x7f00fc100880 2024-09-13T17:11:51.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:51 smithi149 ceph-mon[35496]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:11:51.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:51 smithi149 ceph-mon[35496]: pgmap v292: 129 pgs: 4 peering, 125 active+clean; 619 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 8.1 KiB/s wr, 12 op/s 2024-09-13T17:11:51.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:51 smithi118 ceph-mon[34374]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:11:51.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:51 smithi118 ceph-mon[34374]: pgmap v292: 129 pgs: 4 peering, 125 active+clean; 619 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 8.1 KiB/s wr, 12 op/s 2024-09-13T17:11:51.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.725+0000 7f0103c80640 1 -- 172.21.15.87:0/3203790577 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f00fc02c540 con 0x7f00e40a11a0 2024-09-13T17:11:51.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.736+0000 7f00faffd640 1 -- 172.21.15.87:0/3203790577 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+424210 (secure 0 0 0) 0x7f00fc02c540 con 0x7f00e40a11a0 2024-09-13T17:11:51.743 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:11:51.745 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-13T17:11:51.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.740+0000 7f0103c80640 1 -- 172.21.15.87:0/3203790577 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f00e40a11a0 msgr2=0x7f00e40a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:51.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.740+0000 7f0103c80640 1 --2- 172.21.15.87:0/3203790577 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f00e40a11a0 0x7f00e40a3660 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f00f0005d00 tx=0x7f00f0005c50 comp rx=0 tx=0).stop 2024-09-13T17:11:51.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.740+0000 7f0103c80640 1 -- 172.21.15.87:0/3203790577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00fc100880 msgr2=0x7f00fc195e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:51.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.740+0000 7f0103c80640 1 --2- 172.21.15.87:0/3203790577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00fc100880 0x7f00fc195e40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f00f400b4a0 tx=0x7f00f400b960 comp rx=0 tx=0).stop 2024-09-13T17:11:51.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.740+0000 7f0103c80640 1 -- 172.21.15.87:0/3203790577 shutdown_connections 2024-09-13T17:11:51.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.740+0000 7f0103c80640 1 --2- 172.21.15.87:0/3203790577 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f00e40a11a0 0x7f00e40a3660 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:51.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.740+0000 7f0103c80640 1 --2- 172.21.15.87:0/3203790577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00fc105ae0 0x7f00fc19d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:51.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.740+0000 7f0103c80640 1 --2- 172.21.15.87:0/3203790577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00fc1031b0 0x7f00fc196380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:51.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.740+0000 7f0103c80640 1 --2- 172.21.15.87:0/3203790577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00fc100880 0x7f00fc195e40 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:51.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.740+0000 7f0103c80640 1 -- 172.21.15.87:0/3203790577 >> 172.21.15.87:0/3203790577 conn(0x7f00fc0fa440 msgr2=0x7f00fc101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:51.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.740+0000 7f0103c80640 1 -- 172.21.15.87:0/3203790577 shutdown_connections 2024-09-13T17:11:51.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:51.740+0000 7f0103c80640 1 -- 172.21.15.87:0/3203790577 wait complete. 2024-09-13T17:11:51.753 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-09-13T17:11:50.074276+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":634361,"num_objects":56,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":159,"num_read_kb":159,"num_write":307,"num_write_kb":3021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376888,"kb_used_data":11704,"kb_used_omap":18,"kb_used_meta":365037,"kb_avail":1124564936,"statfs":{"total":1151940427776,"available":1151554494464,"internally_reserved":0,"allocated":11984896,"data_stored":7591761,"data_compressed":261610,"data_compressed_allocated":348160,"data_compressed_original":2195456,"omap_allocated":19109,"internal_metadata":373798235},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":39400,"num_objects":32,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":23,"num_read_kb":40,"num_write":78,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002224"},"pg_stats":[{"pgid":"2.1f","version":"89'9","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.181045+0000","last_change":"2024-09-13T17:11:22.998997+0000","last_active":"2024-09-13T17:11:47.181045+0000","last_peered":"2024-09-13T17:11:47.181045+0000","last_clean":"2024-09-13T17:11:47.181045+0000","last_became_active":"2024-09-13T17:11:22.998674+0000","last_became_peered":"2024-09-13T17:11:22.998674+0000","last_unstale":"2024-09-13T17:11:47.181045+0000","last_undegraded":"2024-09-13T17:11:47.181045+0000","last_fullsized":"2024-09-13T17:11:47.181045+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:30:50.554788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.348929+0000","last_change":"2024-09-13T17:11:23.340108+0000","last_active":"2024-09-13T17:11:27.348929+0000","last_peered":"2024-09-13T17:11:27.348929+0000","last_clean":"2024-09-13T17:11:27.348929+0000","last_became_active":"2024-09-13T17:11:23.339832+0000","last_became_peered":"2024-09-13T17:11:23.339832+0000","last_unstale":"2024-09-13T17:11:27.348929+0000","last_undegraded":"2024-09-13T17:11:27.348929+0000","last_fullsized":"2024-09-13T17:11:27.348929+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:40.969448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.683504+0000","last_change":"2024-09-13T17:11:27.358090+0000","last_active":"2024-09-13T17:11:27.683504+0000","last_peered":"2024-09-13T17:11:27.683504+0000","last_clean":"2024-09-13T17:11:27.683504+0000","last_became_active":"2024-09-13T17:11:27.357725+0000","last_became_peered":"2024-09-13T17:11:27.357725+0000","last_unstale":"2024-09-13T17:11:27.683504+0000","last_undegraded":"2024-09-13T17:11:27.683504+0000","last_fullsized":"2024-09-13T17:11:27.683504+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:51.617457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'1","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.349083+0000","last_change":"2024-09-13T17:11:23.000779+0000","last_active":"2024-09-13T17:11:27.349083+0000","last_peered":"2024-09-13T17:11:27.349083+0000","last_clean":"2024-09-13T17:11:27.349083+0000","last_became_active":"2024-09-13T17:11:23.000511+0000","last_became_peered":"2024-09-13T17:11:23.000511+0000","last_unstale":"2024-09-13T17:11:27.349083+0000","last_undegraded":"2024-09-13T17:11:27.349083+0000","last_fullsized":"2024-09-13T17:11:27.349083+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:09.802392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.833095+0000","last_change":"2024-09-13T17:11:23.333948+0000","last_active":"2024-09-13T17:11:27.833095+0000","last_peered":"2024-09-13T17:11:27.833095+0000","last_clean":"2024-09-13T17:11:27.833095+0000","last_became_active":"2024-09-13T17:11:23.333679+0000","last_became_peered":"2024-09-13T17:11:23.333679+0000","last_unstale":"2024-09-13T17:11:27.833095+0000","last_undegraded":"2024-09-13T17:11:27.833095+0000","last_fullsized":"2024-09-13T17:11:27.833095+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:10.265157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537784+0000","last_change":"2024-09-13T17:11:27.353767+0000","last_active":"2024-09-13T17:11:29.537784+0000","last_peered":"2024-09-13T17:11:29.537784+0000","last_clean":"2024-09-13T17:11:29.537784+0000","last_became_active":"2024-09-13T17:11:27.353448+0000","last_became_peered":"2024-09-13T17:11:27.353448+0000","last_unstale":"2024-09-13T17:11:29.537784+0000","last_undegraded":"2024-09-13T17:11:29.537784+0000","last_fullsized":"2024-09-13T17:11:29.537784+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:15.948099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.178059+0000","last_change":"2024-09-13T17:11:22.999879+0000","last_active":"2024-09-13T17:11:47.178059+0000","last_peered":"2024-09-13T17:11:47.178059+0000","last_clean":"2024-09-13T17:11:47.178059+0000","last_became_active":"2024-09-13T17:11:22.999577+0000","last_became_peered":"2024-09-13T17:11:22.999577+0000","last_unstale":"2024-09-13T17:11:47.178059+0000","last_undegraded":"2024-09-13T17:11:47.178059+0000","last_fullsized":"2024-09-13T17:11:47.178059+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:48.485532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.346469+0000","last_change":"2024-09-13T17:11:23.339026+0000","last_active":"2024-09-13T17:11:27.346469+0000","last_peered":"2024-09-13T17:11:27.346469+0000","last_clean":"2024-09-13T17:11:27.346469+0000","last_became_active":"2024-09-13T17:11:23.338745+0000","last_became_peered":"2024-09-13T17:11:23.338745+0000","last_unstale":"2024-09-13T17:11:27.346469+0000","last_undegraded":"2024-09-13T17:11:27.346469+0000","last_fullsized":"2024-09-13T17:11:27.346469+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:27.455418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537867+0000","last_change":"2024-09-13T17:11:27.363137+0000","last_active":"2024-09-13T17:11:29.537867+0000","last_peered":"2024-09-13T17:11:29.537867+0000","last_clean":"2024-09-13T17:11:29.537867+0000","last_became_active":"2024-09-13T17:11:27.362621+0000","last_became_peered":"2024-09-13T17:11:27.362621+0000","last_unstale":"2024-09-13T17:11:29.537867+0000","last_undegraded":"2024-09-13T17:11:29.537867+0000","last_fullsized":"2024-09-13T17:11:29.537867+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:35:51.492630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.352962+0000","last_change":"2024-09-13T17:11:22.998066+0000","last_active":"2024-09-13T17:11:27.352962+0000","last_peered":"2024-09-13T17:11:27.352962+0000","last_clean":"2024-09-13T17:11:27.352962+0000","last_became_active":"2024-09-13T17:11:22.997741+0000","last_became_peered":"2024-09-13T17:11:22.997741+0000","last_unstale":"2024-09-13T17:11:27.352962+0000","last_undegraded":"2024-09-13T17:11:27.352962+0000","last_fullsized":"2024-09-13T17:11:27.352962+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:00.353453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.357913+0000","last_change":"2024-09-13T17:11:23.336778+0000","last_active":"2024-09-13T17:11:27.357913+0000","last_peered":"2024-09-13T17:11:27.357913+0000","last_clean":"2024-09-13T17:11:27.357913+0000","last_became_active":"2024-09-13T17:11:23.336491+0000","last_became_peered":"2024-09-13T17:11:23.336491+0000","last_unstale":"2024-09-13T17:11:27.357913+0000","last_undegraded":"2024-09-13T17:11:27.357913+0000","last_fullsized":"2024-09-13T17:11:27.357913+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:02.045912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537823+0000","last_change":"2024-09-13T17:11:27.361454+0000","last_active":"2024-09-13T17:11:29.537823+0000","last_peered":"2024-09-13T17:11:29.537823+0000","last_clean":"2024-09-13T17:11:29.537823+0000","last_became_active":"2024-09-13T17:11:27.360980+0000","last_became_peered":"2024-09-13T17:11:27.360980+0000","last_unstale":"2024-09-13T17:11:29.537823+0000","last_undegraded":"2024-09-13T17:11:29.537823+0000","last_fullsized":"2024-09-13T17:11:29.537823+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:36.036426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345699+0000","last_change":"2024-09-13T17:11:23.334073+0000","last_active":"2024-09-13T17:11:27.345699+0000","last_peered":"2024-09-13T17:11:27.345699+0000","last_clean":"2024-09-13T17:11:27.345699+0000","last_became_active":"2024-09-13T17:11:23.333628+0000","last_became_peered":"2024-09-13T17:11:23.333628+0000","last_unstale":"2024-09-13T17:11:27.345699+0000","last_undegraded":"2024-09-13T17:11:27.345699+0000","last_fullsized":"2024-09-13T17:11:27.345699+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:18.561346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:46.174718+0000","last_change":"2024-09-13T17:11:22.999115+0000","last_active":"2024-09-13T17:11:46.174718+0000","last_peered":"2024-09-13T17:11:46.174718+0000","last_clean":"2024-09-13T17:11:46.174718+0000","last_became_active":"2024-09-13T17:11:22.998798+0000","last_became_peered":"2024-09-13T17:11:22.998798+0000","last_unstale":"2024-09-13T17:11:46.174718+0000","last_undegraded":"2024-09-13T17:11:46.174718+0000","last_fullsized":"2024-09-13T17:11:46.174718+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:25.263755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537935+0000","last_change":"2024-09-13T17:11:27.355472+0000","last_active":"2024-09-13T17:11:29.537935+0000","last_peered":"2024-09-13T17:11:29.537935+0000","last_clean":"2024-09-13T17:11:29.537935+0000","last_became_active":"2024-09-13T17:11:27.355065+0000","last_became_peered":"2024-09-13T17:11:27.355065+0000","last_unstale":"2024-09-13T17:11:29.537935+0000","last_undegraded":"2024-09-13T17:11:29.537935+0000","last_fullsized":"2024-09-13T17:11:29.537935+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:03.881097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.350859+0000","last_change":"2024-09-13T17:11:23.340268+0000","last_active":"2024-09-13T17:11:27.350859+0000","last_peered":"2024-09-13T17:11:27.350859+0000","last_clean":"2024-09-13T17:11:27.350859+0000","last_became_active":"2024-09-13T17:11:23.339977+0000","last_became_peered":"2024-09-13T17:11:23.339977+0000","last_unstale":"2024-09-13T17:11:27.350859+0000","last_undegraded":"2024-09-13T17:11:27.350859+0000","last_fullsized":"2024-09-13T17:11:27.350859+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:21.067899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.352398+0000","last_change":"2024-09-13T17:11:23.000858+0000","last_active":"2024-09-13T17:11:27.352398+0000","last_peered":"2024-09-13T17:11:27.352398+0000","last_clean":"2024-09-13T17:11:27.352398+0000","last_became_active":"2024-09-13T17:11:23.000536+0000","last_became_peered":"2024-09-13T17:11:23.000536+0000","last_unstale":"2024-09-13T17:11:27.352398+0000","last_undegraded":"2024-09-13T17:11:27.352398+0000","last_fullsized":"2024-09-13T17:11:27.352398+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:28.798579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801541+0000","last_change":"2024-09-13T17:11:27.354018+0000","last_active":"2024-09-13T17:11:48.801541+0000","last_peered":"2024-09-13T17:11:48.801541+0000","last_clean":"2024-09-13T17:11:48.801541+0000","last_became_active":"2024-09-13T17:11:27.353519+0000","last_became_peered":"2024-09-13T17:11:27.353519+0000","last_unstale":"2024-09-13T17:11:48.801541+0000","last_undegraded":"2024-09-13T17:11:48.801541+0000","last_fullsized":"2024-09-13T17:11:48.801541+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:55.227851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801000+0000","last_change":"2024-09-13T17:11:23.335798+0000","last_active":"2024-09-13T17:11:48.801000+0000","last_peered":"2024-09-13T17:11:48.801000+0000","last_clean":"2024-09-13T17:11:48.801000+0000","last_became_active":"2024-09-13T17:11:23.335445+0000","last_became_peered":"2024-09-13T17:11:23.335445+0000","last_unstale":"2024-09-13T17:11:48.801000+0000","last_undegraded":"2024-09-13T17:11:48.801000+0000","last_fullsized":"2024-09-13T17:11:48.801000+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:53.242067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.349338+0000","last_change":"2024-09-13T17:11:22.994118+0000","last_active":"2024-09-13T17:11:27.349338+0000","last_peered":"2024-09-13T17:11:27.349338+0000","last_clean":"2024-09-13T17:11:27.349338+0000","last_became_active":"2024-09-13T17:11:22.993801+0000","last_became_peered":"2024-09-13T17:11:22.993801+0000","last_unstale":"2024-09-13T17:11:27.349338+0000","last_undegraded":"2024-09-13T17:11:27.349338+0000","last_fullsized":"2024-09-13T17:11:27.349338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:01.382130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.557452+0000","last_change":"2024-09-13T17:11:27.358795+0000","last_active":"2024-09-13T17:11:27.557452+0000","last_peered":"2024-09-13T17:11:27.557452+0000","last_clean":"2024-09-13T17:11:27.557452+0000","last_became_active":"2024-09-13T17:11:27.358166+0000","last_became_peered":"2024-09-13T17:11:27.358166+0000","last_unstale":"2024-09-13T17:11:27.557452+0000","last_undegraded":"2024-09-13T17:11:27.557452+0000","last_fullsized":"2024-09-13T17:11:27.557452+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:23.787842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.353077+0000","last_change":"2024-09-13T17:11:23.340671+0000","last_active":"2024-09-13T17:11:27.353077+0000","last_peered":"2024-09-13T17:11:27.353077+0000","last_clean":"2024-09-13T17:11:27.353077+0000","last_became_active":"2024-09-13T17:11:23.340360+0000","last_became_peered":"2024-09-13T17:11:23.340360+0000","last_unstale":"2024-09-13T17:11:27.353077+0000","last_undegraded":"2024-09-13T17:11:27.353077+0000","last_fullsized":"2024-09-13T17:11:27.353077+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:17.875171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344679+0000","last_change":"2024-09-13T17:11:22.993039+0000","last_active":"2024-09-13T17:11:27.344679+0000","last_peered":"2024-09-13T17:11:27.344679+0000","last_clean":"2024-09-13T17:11:27.344679+0000","last_became_active":"2024-09-13T17:11:22.992701+0000","last_became_peered":"2024-09-13T17:11:22.992701+0000","last_unstale":"2024-09-13T17:11:27.344679+0000","last_undegraded":"2024-09-13T17:11:27.344679+0000","last_fullsized":"2024-09-13T17:11:27.344679+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:28.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537946+0000","last_change":"2024-09-13T17:11:27.363834+0000","last_active":"2024-09-13T17:11:29.537946+0000","last_peered":"2024-09-13T17:11:29.537946+0000","last_clean":"2024-09-13T17:11:29.537946+0000","last_became_active":"2024-09-13T17:11:27.363425+0000","last_became_peered":"2024-09-13T17:11:27.363425+0000","last_unstale":"2024-09-13T17:11:29.537946+0000","last_undegraded":"2024-09-13T17:11:29.537946+0000","last_fullsized":"2024-09-13T17:11:29.537946+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:37.389881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832858+0000","last_change":"2024-09-13T17:11:23.337423+0000","last_active":"2024-09-13T17:11:27.832858+0000","last_peered":"2024-09-13T17:11:27.832858+0000","last_clean":"2024-09-13T17:11:27.832858+0000","last_became_active":"2024-09-13T17:11:23.337167+0000","last_became_peered":"2024-09-13T17:11:23.337167+0000","last_unstale":"2024-09-13T17:11:27.832858+0000","last_undegraded":"2024-09-13T17:11:27.832858+0000","last_fullsized":"2024-09-13T17:11:27.832858+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:28.540283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:46.175903+0000","last_change":"2024-09-13T17:11:23.000486+0000","last_active":"2024-09-13T17:11:46.175903+0000","last_peered":"2024-09-13T17:11:46.175903+0000","last_clean":"2024-09-13T17:11:46.175903+0000","last_became_active":"2024-09-13T17:11:23.000158+0000","last_became_peered":"2024-09-13T17:11:23.000158+0000","last_unstale":"2024-09-13T17:11:46.175903+0000","last_undegraded":"2024-09-13T17:11:46.175903+0000","last_fullsized":"2024-09-13T17:11:46.175903+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:42.635037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.683527+0000","last_change":"2024-09-13T17:11:27.355058+0000","last_active":"2024-09-13T17:11:27.683527+0000","last_peered":"2024-09-13T17:11:27.683527+0000","last_clean":"2024-09-13T17:11:27.683527+0000","last_became_active":"2024-09-13T17:11:27.354726+0000","last_became_peered":"2024-09-13T17:11:27.354726+0000","last_unstale":"2024-09-13T17:11:27.683527+0000","last_undegraded":"2024-09-13T17:11:27.683527+0000","last_fullsized":"2024-09-13T17:11:27.683527+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:58.450122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.353872+0000","last_change":"2024-09-13T17:11:23.337245+0000","last_active":"2024-09-13T17:11:27.353872+0000","last_peered":"2024-09-13T17:11:27.353872+0000","last_clean":"2024-09-13T17:11:27.353872+0000","last_became_active":"2024-09-13T17:11:23.336956+0000","last_became_peered":"2024-09-13T17:11:23.336956+0000","last_unstale":"2024-09-13T17:11:27.353872+0000","last_undegraded":"2024-09-13T17:11:27.353872+0000","last_fullsized":"2024-09-13T17:11:27.353872+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:46.876149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'3","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.179427+0000","last_change":"2024-09-13T17:11:22.999942+0000","last_active":"2024-09-13T17:11:47.179427+0000","last_peered":"2024-09-13T17:11:47.179427+0000","last_clean":"2024-09-13T17:11:47.179427+0000","last_became_active":"2024-09-13T17:11:22.999653+0000","last_became_peered":"2024-09-13T17:11:22.999653+0000","last_unstale":"2024-09-13T17:11:47.179427+0000","last_undegraded":"2024-09-13T17:11:47.179427+0000","last_fullsized":"2024-09-13T17:11:47.179427+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:29.400939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832619+0000","last_change":"2024-09-13T17:11:27.356479+0000","last_active":"2024-09-13T17:11:27.832619+0000","last_peered":"2024-09-13T17:11:27.832619+0000","last_clean":"2024-09-13T17:11:27.832619+0000","last_became_active":"2024-09-13T17:11:27.356052+0000","last_became_peered":"2024-09-13T17:11:27.356052+0000","last_unstale":"2024-09-13T17:11:27.832619+0000","last_undegraded":"2024-09-13T17:11:27.832619+0000","last_fullsized":"2024-09-13T17:11:27.832619+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:42.173376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344659+0000","last_change":"2024-09-13T17:11:23.333786+0000","last_active":"2024-09-13T17:11:27.344659+0000","last_peered":"2024-09-13T17:11:27.344659+0000","last_clean":"2024-09-13T17:11:27.344659+0000","last_became_active":"2024-09-13T17:11:23.333472+0000","last_became_peered":"2024-09-13T17:11:23.333472+0000","last_unstale":"2024-09-13T17:11:27.344659+0000","last_undegraded":"2024-09-13T17:11:27.344659+0000","last_fullsized":"2024-09-13T17:11:27.344659+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:41.633228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:46.175724+0000","last_change":"2024-09-13T17:11:22.998646+0000","last_active":"2024-09-13T17:11:46.175724+0000","last_peered":"2024-09-13T17:11:46.175724+0000","last_clean":"2024-09-13T17:11:46.175724+0000","last_became_active":"2024-09-13T17:11:22.998291+0000","last_became_peered":"2024-09-13T17:11:22.998291+0000","last_unstale":"2024-09-13T17:11:46.175724+0000","last_undegraded":"2024-09-13T17:11:46.175724+0000","last_fullsized":"2024-09-13T17:11:46.175724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:20.658436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801089+0000","last_change":"2024-09-13T17:11:27.361174+0000","last_active":"2024-09-13T17:11:48.801089+0000","last_peered":"2024-09-13T17:11:48.801089+0000","last_clean":"2024-09-13T17:11:48.801089+0000","last_became_active":"2024-09-13T17:11:27.360737+0000","last_became_peered":"2024-09-13T17:11:27.360737+0000","last_unstale":"2024-09-13T17:11:48.801089+0000","last_undegraded":"2024-09-13T17:11:48.801089+0000","last_fullsized":"2024-09-13T17:11:48.801089+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:00.941364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.834435+0000","last_change":"2024-09-13T17:11:23.338545+0000","last_active":"2024-09-13T17:11:27.834435+0000","last_peered":"2024-09-13T17:11:27.834435+0000","last_clean":"2024-09-13T17:11:27.834435+0000","last_became_active":"2024-09-13T17:11:23.338246+0000","last_became_peered":"2024-09-13T17:11:23.338246+0000","last_unstale":"2024-09-13T17:11:27.834435+0000","last_undegraded":"2024-09-13T17:11:27.834435+0000","last_fullsized":"2024-09-13T17:11:27.834435+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:18.966658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.341243+0000","last_change":"2024-09-13T17:11:22.993497+0000","last_active":"2024-09-13T17:11:27.341243+0000","last_peered":"2024-09-13T17:11:27.341243+0000","last_clean":"2024-09-13T17:11:27.341243+0000","last_became_active":"2024-09-13T17:11:22.993165+0000","last_became_peered":"2024-09-13T17:11:22.993165+0000","last_unstale":"2024-09-13T17:11:27.341243+0000","last_undegraded":"2024-09-13T17:11:27.341243+0000","last_fullsized":"2024-09-13T17:11:27.341243+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:20.997834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832905+0000","last_change":"2024-09-13T17:11:27.364652+0000","last_active":"2024-09-13T17:11:27.832905+0000","last_peered":"2024-09-13T17:11:27.832905+0000","last_clean":"2024-09-13T17:11:27.832905+0000","last_became_active":"2024-09-13T17:11:27.364245+0000","last_became_peered":"2024-09-13T17:11:27.364245+0000","last_unstale":"2024-09-13T17:11:27.832905+0000","last_undegraded":"2024-09-13T17:11:27.832905+0000","last_fullsized":"2024-09-13T17:11:27.832905+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:23.048289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.834356+0000","last_change":"2024-09-13T17:11:23.335649+0000","last_active":"2024-09-13T17:11:27.834356+0000","last_peered":"2024-09-13T17:11:27.834356+0000","last_clean":"2024-09-13T17:11:27.834356+0000","last_became_active":"2024-09-13T17:11:23.335364+0000","last_became_peered":"2024-09-13T17:11:23.335364+0000","last_unstale":"2024-09-13T17:11:27.834356+0000","last_undegraded":"2024-09-13T17:11:27.834356+0000","last_fullsized":"2024-09-13T17:11:27.834356+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.447947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.684957+0000","last_change":"2024-09-13T17:11:23.003188+0000","last_active":"2024-09-13T17:11:27.684957+0000","last_peered":"2024-09-13T17:11:27.684957+0000","last_clean":"2024-09-13T17:11:27.684957+0000","last_became_active":"2024-09-13T17:11:23.002858+0000","last_became_peered":"2024-09-13T17:11:23.002858+0000","last_unstale":"2024-09-13T17:11:27.684957+0000","last_undegraded":"2024-09-13T17:11:27.684957+0000","last_fullsized":"2024-09-13T17:11:27.684957+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:34.153326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832969+0000","last_change":"2024-09-13T17:11:27.353320+0000","last_active":"2024-09-13T17:11:27.832969+0000","last_peered":"2024-09-13T17:11:27.832969+0000","last_clean":"2024-09-13T17:11:27.832969+0000","last_became_active":"2024-09-13T17:11:27.352947+0000","last_became_peered":"2024-09-13T17:11:27.352947+0000","last_unstale":"2024-09-13T17:11:27.832969+0000","last_undegraded":"2024-09-13T17:11:27.832969+0000","last_fullsized":"2024-09-13T17:11:27.832969+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:04.619618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.354952+0000","last_change":"2024-09-13T17:11:23.330128+0000","last_active":"2024-09-13T17:11:27.354952+0000","last_peered":"2024-09-13T17:11:27.354952+0000","last_clean":"2024-09-13T17:11:27.354952+0000","last_became_active":"2024-09-13T17:11:23.329266+0000","last_became_peered":"2024-09-13T17:11:23.329266+0000","last_unstale":"2024-09-13T17:11:27.354952+0000","last_undegraded":"2024-09-13T17:11:27.354952+0000","last_fullsized":"2024-09-13T17:11:27.354952+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:36.275352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344307+0000","last_change":"2024-09-13T17:11:23.003495+0000","last_active":"2024-09-13T17:11:27.344307+0000","last_peered":"2024-09-13T17:11:27.344307+0000","last_clean":"2024-09-13T17:11:27.344307+0000","last_became_active":"2024-09-13T17:11:23.003186+0000","last_became_peered":"2024-09-13T17:11:23.003186+0000","last_unstale":"2024-09-13T17:11:27.344307+0000","last_undegraded":"2024-09-13T17:11:27.344307+0000","last_fullsized":"2024-09-13T17:11:27.344307+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:23.353587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832748+0000","last_change":"2024-09-13T17:11:27.362233+0000","last_active":"2024-09-13T17:11:27.832748+0000","last_peered":"2024-09-13T17:11:27.832748+0000","last_clean":"2024-09-13T17:11:27.832748+0000","last_became_active":"2024-09-13T17:11:27.361814+0000","last_became_peered":"2024-09-13T17:11:27.361814+0000","last_unstale":"2024-09-13T17:11:27.832748+0000","last_undegraded":"2024-09-13T17:11:27.832748+0000","last_fullsized":"2024-09-13T17:11:27.832748+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:20.723366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344130+0000","last_change":"2024-09-13T17:11:23.332870+0000","last_active":"2024-09-13T17:11:27.344130+0000","last_peered":"2024-09-13T17:11:27.344130+0000","last_clean":"2024-09-13T17:11:27.344130+0000","last_became_active":"2024-09-13T17:11:23.332583+0000","last_became_peered":"2024-09-13T17:11:23.332583+0000","last_unstale":"2024-09-13T17:11:27.344130+0000","last_undegraded":"2024-09-13T17:11:27.344130+0000","last_fullsized":"2024-09-13T17:11:27.344130+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:22.607666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.176932+0000","last_change":"2024-09-13T17:11:23.001932+0000","last_active":"2024-09-13T17:11:47.176932+0000","last_peered":"2024-09-13T17:11:47.176932+0000","last_clean":"2024-09-13T17:11:47.176932+0000","last_became_active":"2024-09-13T17:11:23.001642+0000","last_became_peered":"2024-09-13T17:11:23.001642+0000","last_unstale":"2024-09-13T17:11:47.176932+0000","last_undegraded":"2024-09-13T17:11:47.176932+0000","last_fullsized":"2024-09-13T17:11:47.176932+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:05.976897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.360313+0000","last_change":"2024-09-13T17:11:27.359679+0000","last_active":"2024-09-13T17:11:27.360313+0000","last_peered":"2024-09-13T17:11:27.360313+0000","last_clean":"2024-09-13T17:11:27.360313+0000","last_became_active":"2024-09-13T17:11:27.359268+0000","last_became_peered":"2024-09-13T17:11:27.359268+0000","last_unstale":"2024-09-13T17:11:27.360313+0000","last_undegraded":"2024-09-13T17:11:27.360313+0000","last_fullsized":"2024-09-13T17:11:27.360313+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:48.154917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.350643+0000","last_change":"2024-09-13T17:11:23.340031+0000","last_active":"2024-09-13T17:11:27.350643+0000","last_peered":"2024-09-13T17:11:27.350643+0000","last_clean":"2024-09-13T17:11:27.350643+0000","last_became_active":"2024-09-13T17:11:23.339768+0000","last_became_peered":"2024-09-13T17:11:23.339768+0000","last_unstale":"2024-09-13T17:11:27.350643+0000","last_undegraded":"2024-09-13T17:11:27.350643+0000","last_fullsized":"2024-09-13T17:11:27.350643+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:22.360526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.788033+0000","last_change":"2024-09-13T17:11:22.995060+0000","last_active":"2024-09-13T17:11:47.788033+0000","last_peered":"2024-09-13T17:11:47.788033+0000","last_clean":"2024-09-13T17:11:47.788033+0000","last_became_active":"2024-09-13T17:11:22.991949+0000","last_became_peered":"2024-09-13T17:11:22.991949+0000","last_unstale":"2024-09-13T17:11:47.788033+0000","last_undegraded":"2024-09-13T17:11:47.788033+0000","last_fullsized":"2024-09-13T17:11:47.788033+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:44.716753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":338,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345590+0000","last_change":"2024-09-13T17:10:13.439723+0000","last_active":"2024-09-13T17:11:27.345590+0000","last_peered":"2024-09-13T17:11:27.345590+0000","last_clean":"2024-09-13T17:11:27.345590+0000","last_became_active":"2024-09-13T17:10:13.439290+0000","last_became_peered":"2024-09-13T17:10:13.439290+0000","last_unstale":"2024-09-13T17:11:27.345590+0000","last_undegraded":"2024-09-13T17:11:27.345590+0000","last_fullsized":"2024-09-13T17:11:27.345590+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:03.041486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:03.041486+0000","last_clean_scrub_stamp":"2024-09-13T17:07:03.041486+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:08.673571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:28.497337+0000","last_change":"2024-09-13T17:11:27.361028+0000","last_active":"2024-09-13T17:11:28.497337+0000","last_peered":"2024-09-13T17:11:28.497337+0000","last_clean":"2024-09-13T17:11:28.497337+0000","last_became_active":"2024-09-13T17:11:27.360630+0000","last_became_peered":"2024-09-13T17:11:27.360630+0000","last_unstale":"2024-09-13T17:11:28.497337+0000","last_undegraded":"2024-09-13T17:11:28.497337+0000","last_fullsized":"2024-09-13T17:11:28.497337+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:40:40.860443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.346553+0000","last_change":"2024-09-13T17:11:23.346138+0000","last_active":"2024-09-13T17:11:27.346553+0000","last_peered":"2024-09-13T17:11:27.346553+0000","last_clean":"2024-09-13T17:11:27.346553+0000","last_became_active":"2024-09-13T17:11:23.345855+0000","last_became_peered":"2024-09-13T17:11:23.345855+0000","last_unstale":"2024-09-13T17:11:27.346553+0000","last_undegraded":"2024-09-13T17:11:27.346553+0000","last_fullsized":"2024-09-13T17:11:27.346553+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:02.391726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":2,"reported_epoch":90,"state":"peering","last_fresh":"2024-09-13T17:11:27.684094+0000","last_change":"2024-09-13T17:11:49.540357+0000","last_active":"2024-09-13T17:11:49.540357+0000","last_peered":"2024-09-13T17:11:27.684094+0000","last_clean":"2024-09-13T17:11:27.684094+0000","last_became_active":"2024-09-13T17:11:23.003102+0000","last_became_peered":"2024-09-13T17:11:23.003102+0000","last_unstale":"2024-09-13T17:11:27.684094+0000","last_undegraded":"2024-09-13T17:11:27.684094+0000","last_fullsized":"2024-09-13T17:11:27.684094+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:08.827045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832402+0000","last_change":"2024-09-13T17:11:27.360372+0000","last_active":"2024-09-13T17:11:27.832402+0000","last_peered":"2024-09-13T17:11:27.832402+0000","last_clean":"2024-09-13T17:11:27.832402+0000","last_became_active":"2024-09-13T17:11:27.359990+0000","last_became_peered":"2024-09-13T17:11:27.359990+0000","last_unstale":"2024-09-13T17:11:27.832402+0000","last_undegraded":"2024-09-13T17:11:27.832402+0000","last_fullsized":"2024-09-13T17:11:27.832402+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:26.970317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344659+0000","last_change":"2024-09-13T17:11:23.336269+0000","last_active":"2024-09-13T17:11:27.344659+0000","last_peered":"2024-09-13T17:11:27.344659+0000","last_clean":"2024-09-13T17:11:27.344659+0000","last_became_active":"2024-09-13T17:11:23.335921+0000","last_became_peered":"2024-09-13T17:11:23.335921+0000","last_unstale":"2024-09-13T17:11:27.344659+0000","last_undegraded":"2024-09-13T17:11:27.344659+0000","last_fullsized":"2024-09-13T17:11:27.344659+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:43.035927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.358089+0000","last_change":"2024-09-13T17:11:23.002491+0000","last_active":"2024-09-13T17:11:27.358089+0000","last_peered":"2024-09-13T17:11:27.358089+0000","last_clean":"2024-09-13T17:11:27.358089+0000","last_became_active":"2024-09-13T17:11:23.002178+0000","last_became_peered":"2024-09-13T17:11:23.002178+0000","last_unstale":"2024-09-13T17:11:27.358089+0000","last_undegraded":"2024-09-13T17:11:27.358089+0000","last_fullsized":"2024-09-13T17:11:27.358089+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:06.056639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.108773+0000","last_change":"2024-09-13T17:11:27.355153+0000","last_active":"2024-09-13T17:11:29.108773+0000","last_peered":"2024-09-13T17:11:29.108773+0000","last_clean":"2024-09-13T17:11:29.108773+0000","last_became_active":"2024-09-13T17:11:27.354701+0000","last_became_peered":"2024-09-13T17:11:27.354701+0000","last_unstale":"2024-09-13T17:11:29.108773+0000","last_undegraded":"2024-09-13T17:11:29.108773+0000","last_fullsized":"2024-09-13T17:11:29.108773+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:34.924402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345209+0000","last_change":"2024-09-13T17:11:23.342067+0000","last_active":"2024-09-13T17:11:27.345209+0000","last_peered":"2024-09-13T17:11:27.345209+0000","last_clean":"2024-09-13T17:11:27.345209+0000","last_became_active":"2024-09-13T17:11:23.341736+0000","last_became_peered":"2024-09-13T17:11:23.341736+0000","last_unstale":"2024-09-13T17:11:27.345209+0000","last_undegraded":"2024-09-13T17:11:27.345209+0000","last_fullsized":"2024-09-13T17:11:27.345209+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:03.114638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345020+0000","last_change":"2024-09-13T17:11:23.002849+0000","last_active":"2024-09-13T17:11:27.345020+0000","last_peered":"2024-09-13T17:11:27.345020+0000","last_clean":"2024-09-13T17:11:27.345020+0000","last_became_active":"2024-09-13T17:11:23.002562+0000","last_became_peered":"2024-09-13T17:11:23.002562+0000","last_unstale":"2024-09-13T17:11:27.345020+0000","last_undegraded":"2024-09-13T17:11:27.345020+0000","last_fullsized":"2024-09-13T17:11:27.345020+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:11:24.650510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.360269+0000","last_change":"2024-09-13T17:11:27.359343+0000","last_active":"2024-09-13T17:11:27.360269+0000","last_peered":"2024-09-13T17:11:27.360269+0000","last_clean":"2024-09-13T17:11:27.360269+0000","last_became_active":"2024-09-13T17:11:27.358628+0000","last_became_peered":"2024-09-13T17:11:27.358628+0000","last_unstale":"2024-09-13T17:11:27.360269+0000","last_undegraded":"2024-09-13T17:11:27.360269+0000","last_fullsized":"2024-09-13T17:11:27.360269+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:39.584184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801190+0000","last_change":"2024-09-13T17:11:23.333111+0000","last_active":"2024-09-13T17:11:48.801190+0000","last_peered":"2024-09-13T17:11:48.801190+0000","last_clean":"2024-09-13T17:11:48.801190+0000","last_became_active":"2024-09-13T17:11:23.332734+0000","last_became_peered":"2024-09-13T17:11:23.332734+0000","last_unstale":"2024-09-13T17:11:48.801190+0000","last_undegraded":"2024-09-13T17:11:48.801190+0000","last_fullsized":"2024-09-13T17:11:48.801190+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:44.628106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"84'1","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832752+0000","last_change":"2024-09-13T17:11:23.000759+0000","last_active":"2024-09-13T17:11:27.832752+0000","last_peered":"2024-09-13T17:11:27.832752+0000","last_clean":"2024-09-13T17:11:27.832752+0000","last_became_active":"2024-09-13T17:11:23.000463+0000","last_became_peered":"2024-09-13T17:11:23.000463+0000","last_unstale":"2024-09-13T17:11:27.832752+0000","last_undegraded":"2024-09-13T17:11:27.832752+0000","last_fullsized":"2024-09-13T17:11:27.832752+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:59.077194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.364961+0000","last_change":"2024-09-13T17:11:27.363076+0000","last_active":"2024-09-13T17:11:27.364961+0000","last_peered":"2024-09-13T17:11:27.364961+0000","last_clean":"2024-09-13T17:11:27.364961+0000","last_became_active":"2024-09-13T17:11:27.362642+0000","last_became_peered":"2024-09-13T17:11:27.362642+0000","last_unstale":"2024-09-13T17:11:27.364961+0000","last_undegraded":"2024-09-13T17:11:27.364961+0000","last_fullsized":"2024-09-13T17:11:27.364961+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:25.494875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.355452+0000","last_change":"2024-09-13T17:11:23.336703+0000","last_active":"2024-09-13T17:11:27.355452+0000","last_peered":"2024-09-13T17:11:27.355452+0000","last_clean":"2024-09-13T17:11:27.355452+0000","last_became_active":"2024-09-13T17:11:23.336349+0000","last_became_peered":"2024-09-13T17:11:23.336349+0000","last_unstale":"2024-09-13T17:11:27.355452+0000","last_undegraded":"2024-09-13T17:11:27.355452+0000","last_fullsized":"2024-09-13T17:11:27.355452+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:28.671438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.178750+0000","last_change":"2024-09-13T17:11:22.994382+0000","last_active":"2024-09-13T17:11:47.178750+0000","last_peered":"2024-09-13T17:11:47.178750+0000","last_clean":"2024-09-13T17:11:47.178750+0000","last_became_active":"2024-09-13T17:11:22.994037+0000","last_became_peered":"2024-09-13T17:11:22.994037+0000","last_unstale":"2024-09-13T17:11:47.178750+0000","last_undegraded":"2024-09-13T17:11:47.178750+0000","last_fullsized":"2024-09-13T17:11:47.178750+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:10.763757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.833042+0000","last_change":"2024-09-13T17:11:27.354351+0000","last_active":"2024-09-13T17:11:27.833042+0000","last_peered":"2024-09-13T17:11:27.833042+0000","last_clean":"2024-09-13T17:11:27.833042+0000","last_became_active":"2024-09-13T17:11:27.353715+0000","last_became_peered":"2024-09-13T17:11:27.353715+0000","last_unstale":"2024-09-13T17:11:27.833042+0000","last_undegraded":"2024-09-13T17:11:27.833042+0000","last_fullsized":"2024-09-13T17:11:27.833042+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:18.335183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345355+0000","last_change":"2024-09-13T17:11:23.341743+0000","last_active":"2024-09-13T17:11:27.345355+0000","last_peered":"2024-09-13T17:11:27.345355+0000","last_clean":"2024-09-13T17:11:27.345355+0000","last_became_active":"2024-09-13T17:11:23.341200+0000","last_became_peered":"2024-09-13T17:11:23.341200+0000","last_unstale":"2024-09-13T17:11:27.345355+0000","last_undegraded":"2024-09-13T17:11:27.345355+0000","last_fullsized":"2024-09-13T17:11:27.345355+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:41.854013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'3","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.800911+0000","last_change":"2024-09-13T17:11:22.997571+0000","last_active":"2024-09-13T17:11:48.800911+0000","last_peered":"2024-09-13T17:11:48.800911+0000","last_clean":"2024-09-13T17:11:48.800911+0000","last_became_active":"2024-09-13T17:11:22.997238+0000","last_became_peered":"2024-09-13T17:11:22.997238+0000","last_unstale":"2024-09-13T17:11:48.800911+0000","last_undegraded":"2024-09-13T17:11:48.800911+0000","last_fullsized":"2024-09-13T17:11:48.800911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:34.533004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.557470+0000","last_change":"2024-09-13T17:11:27.356892+0000","last_active":"2024-09-13T17:11:27.557470+0000","last_peered":"2024-09-13T17:11:27.557470+0000","last_clean":"2024-09-13T17:11:27.557470+0000","last_became_active":"2024-09-13T17:11:27.356136+0000","last_became_peered":"2024-09-13T17:11:27.356136+0000","last_unstale":"2024-09-13T17:11:27.557470+0000","last_undegraded":"2024-09-13T17:11:27.557470+0000","last_fullsized":"2024-09-13T17:11:27.557470+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:23.207064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345098+0000","last_change":"2024-09-13T17:11:23.337666+0000","last_active":"2024-09-13T17:11:27.345098+0000","last_peered":"2024-09-13T17:11:27.345098+0000","last_clean":"2024-09-13T17:11:27.345098+0000","last_became_active":"2024-09-13T17:11:23.337185+0000","last_became_peered":"2024-09-13T17:11:23.337185+0000","last_unstale":"2024-09-13T17:11:27.345098+0000","last_undegraded":"2024-09-13T17:11:27.345098+0000","last_fullsized":"2024-09-13T17:11:27.345098+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:51.266709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:46.175759+0000","last_change":"2024-09-13T17:11:23.005075+0000","last_active":"2024-09-13T17:11:46.175759+0000","last_peered":"2024-09-13T17:11:46.175759+0000","last_clean":"2024-09-13T17:11:46.175759+0000","last_became_active":"2024-09-13T17:11:23.004778+0000","last_became_peered":"2024-09-13T17:11:23.004778+0000","last_unstale":"2024-09-13T17:11:46.175759+0000","last_undegraded":"2024-09-13T17:11:46.175759+0000","last_fullsized":"2024-09-13T17:11:46.175759+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:06.763552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801204+0000","last_change":"2024-09-13T17:11:27.353601+0000","last_active":"2024-09-13T17:11:48.801204+0000","last_peered":"2024-09-13T17:11:48.801204+0000","last_clean":"2024-09-13T17:11:48.801204+0000","last_became_active":"2024-09-13T17:11:27.353190+0000","last_became_peered":"2024-09-13T17:11:27.353190+0000","last_unstale":"2024-09-13T17:11:48.801204+0000","last_undegraded":"2024-09-13T17:11:48.801204+0000","last_fullsized":"2024-09-13T17:11:48.801204+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:24.645552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344760+0000","last_change":"2024-09-13T17:11:23.333592+0000","last_active":"2024-09-13T17:11:27.344760+0000","last_peered":"2024-09-13T17:11:27.344760+0000","last_clean":"2024-09-13T17:11:27.344760+0000","last_became_active":"2024-09-13T17:11:23.333306+0000","last_became_peered":"2024-09-13T17:11:23.333306+0000","last_unstale":"2024-09-13T17:11:27.344760+0000","last_undegraded":"2024-09-13T17:11:27.344760+0000","last_fullsized":"2024-09-13T17:11:27.344760+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:26.813987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.177595+0000","last_change":"2024-09-13T17:11:23.005619+0000","last_active":"2024-09-13T17:11:47.177595+0000","last_peered":"2024-09-13T17:11:47.177595+0000","last_clean":"2024-09-13T17:11:47.177595+0000","last_became_active":"2024-09-13T17:11:23.005077+0000","last_became_peered":"2024-09-13T17:11:23.005077+0000","last_unstale":"2024-09-13T17:11:47.177595+0000","last_undegraded":"2024-09-13T17:11:47.177595+0000","last_fullsized":"2024-09-13T17:11:47.177595+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:51.739773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.365375+0000","last_change":"2024-09-13T17:11:27.364603+0000","last_active":"2024-09-13T17:11:27.365375+0000","last_peered":"2024-09-13T17:11:27.365375+0000","last_clean":"2024-09-13T17:11:27.365375+0000","last_became_active":"2024-09-13T17:11:27.364226+0000","last_became_peered":"2024-09-13T17:11:27.364226+0000","last_unstale":"2024-09-13T17:11:27.365375+0000","last_undegraded":"2024-09-13T17:11:27.365375+0000","last_fullsized":"2024-09-13T17:11:27.365375+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:56.802016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.352784+0000","last_change":"2024-09-13T17:11:23.338657+0000","last_active":"2024-09-13T17:11:27.352784+0000","last_peered":"2024-09-13T17:11:27.352784+0000","last_clean":"2024-09-13T17:11:27.352784+0000","last_became_active":"2024-09-13T17:11:23.338377+0000","last_became_peered":"2024-09-13T17:11:23.338377+0000","last_unstale":"2024-09-13T17:11:27.352784+0000","last_undegraded":"2024-09-13T17:11:27.352784+0000","last_fullsized":"2024-09-13T17:11:27.352784+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:52.412887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'23","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.114064+0000","last_change":"2024-09-13T17:11:22.998541+0000","last_active":"2024-09-13T17:11:49.114064+0000","last_peered":"2024-09-13T17:11:49.114064+0000","last_clean":"2024-09-13T17:11:49.114064+0000","last_became_active":"2024-09-13T17:11:22.998132+0000","last_became_peered":"2024-09-13T17:11:22.998132+0000","last_unstale":"2024-09-13T17:11:49.114064+0000","last_undegraded":"2024-09-13T17:11:49.114064+0000","last_fullsized":"2024-09-13T17:11:49.114064+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:16.777772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40425,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":26,"num_write":24,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.557394+0000","last_change":"2024-09-13T17:11:27.361917+0000","last_active":"2024-09-13T17:11:27.557394+0000","last_peered":"2024-09-13T17:11:27.557394+0000","last_clean":"2024-09-13T17:11:27.557394+0000","last_became_active":"2024-09-13T17:11:27.361503+0000","last_became_peered":"2024-09-13T17:11:27.361503+0000","last_unstale":"2024-09-13T17:11:27.557394+0000","last_undegraded":"2024-09-13T17:11:27.557394+0000","last_fullsized":"2024-09-13T17:11:27.557394+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:52.959017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.346573+0000","last_change":"2024-09-13T17:11:23.343648+0000","last_active":"2024-09-13T17:11:27.346573+0000","last_peered":"2024-09-13T17:11:27.346573+0000","last_clean":"2024-09-13T17:11:27.346573+0000","last_became_active":"2024-09-13T17:11:23.343183+0000","last_became_peered":"2024-09-13T17:11:23.343183+0000","last_unstale":"2024-09-13T17:11:27.346573+0000","last_undegraded":"2024-09-13T17:11:27.346573+0000","last_fullsized":"2024-09-13T17:11:27.346573+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:32:49.585628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.833035+0000","last_change":"2024-09-13T17:11:23.004059+0000","last_active":"2024-09-13T17:11:27.833035+0000","last_peered":"2024-09-13T17:11:27.833035+0000","last_clean":"2024-09-13T17:11:27.833035+0000","last_became_active":"2024-09-13T17:11:23.003248+0000","last_became_peered":"2024-09-13T17:11:23.003248+0000","last_unstale":"2024-09-13T17:11:27.833035+0000","last_undegraded":"2024-09-13T17:11:27.833035+0000","last_fullsized":"2024-09-13T17:11:27.833035+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:05.496872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537877+0000","last_change":"2024-09-13T17:11:27.362880+0000","last_active":"2024-09-13T17:11:29.537877+0000","last_peered":"2024-09-13T17:11:29.537877+0000","last_clean":"2024-09-13T17:11:29.537877+0000","last_became_active":"2024-09-13T17:11:27.362471+0000","last_became_peered":"2024-09-13T17:11:27.362471+0000","last_unstale":"2024-09-13T17:11:29.537877+0000","last_undegraded":"2024-09-13T17:11:29.537877+0000","last_fullsized":"2024-09-13T17:11:29.537877+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:49.964606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"peering","last_fresh":"2024-09-13T17:11:48.798762+0000","last_change":"2024-09-13T17:11:48.798906+0000","last_active":"2024-09-13T17:11:48.798762+0000","last_peered":"2024-09-13T17:11:27.833117+0000","last_clean":"2024-09-13T17:11:27.833117+0000","last_became_active":"2024-09-13T17:11:23.332871+0000","last_became_peered":"2024-09-13T17:11:23.332871+0000","last_unstale":"2024-09-13T17:11:48.798762+0000","last_undegraded":"2024-09-13T17:11:48.798762+0000","last_fullsized":"2024-09-13T17:11:48.798762+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:27.370999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,7],"acting":[0,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,5,7,8],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:46.176492+0000","last_change":"2024-09-13T17:11:22.999158+0000","last_active":"2024-09-13T17:11:46.176492+0000","last_peered":"2024-09-13T17:11:46.176492+0000","last_clean":"2024-09-13T17:11:46.176492+0000","last_became_active":"2024-09-13T17:11:22.998795+0000","last_became_peered":"2024-09-13T17:11:22.998795+0000","last_unstale":"2024-09-13T17:11:46.176492+0000","last_undegraded":"2024-09-13T17:11:46.176492+0000","last_fullsized":"2024-09-13T17:11:46.176492+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:23.880769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.557331+0000","last_change":"2024-09-13T17:11:27.358105+0000","last_active":"2024-09-13T17:11:27.557331+0000","last_peered":"2024-09-13T17:11:27.557331+0000","last_clean":"2024-09-13T17:11:27.557331+0000","last_became_active":"2024-09-13T17:11:27.357740+0000","last_became_peered":"2024-09-13T17:11:27.357740+0000","last_unstale":"2024-09-13T17:11:27.557331+0000","last_undegraded":"2024-09-13T17:11:27.557331+0000","last_fullsized":"2024-09-13T17:11:27.557331+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:44.837353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345210+0000","last_change":"2024-09-13T17:11:23.338736+0000","last_active":"2024-09-13T17:11:27.345210+0000","last_peered":"2024-09-13T17:11:27.345210+0000","last_clean":"2024-09-13T17:11:27.345210+0000","last_became_active":"2024-09-13T17:11:23.338462+0000","last_became_peered":"2024-09-13T17:11:23.338462+0000","last_unstale":"2024-09-13T17:11:27.345210+0000","last_undegraded":"2024-09-13T17:11:27.345210+0000","last_fullsized":"2024-09-13T17:11:27.345210+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:49.221314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'3","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.800595+0000","last_change":"2024-09-13T17:11:23.001966+0000","last_active":"2024-09-13T17:11:48.800595+0000","last_peered":"2024-09-13T17:11:48.800595+0000","last_clean":"2024-09-13T17:11:48.800595+0000","last_became_active":"2024-09-13T17:11:23.001565+0000","last_became_peered":"2024-09-13T17:11:23.001565+0000","last_unstale":"2024-09-13T17:11:48.800595+0000","last_undegraded":"2024-09-13T17:11:48.800595+0000","last_fullsized":"2024-09-13T17:11:48.800595+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:47.240702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.833316+0000","last_change":"2024-09-13T17:11:27.360896+0000","last_active":"2024-09-13T17:11:27.833316+0000","last_peered":"2024-09-13T17:11:27.833316+0000","last_clean":"2024-09-13T17:11:27.833316+0000","last_became_active":"2024-09-13T17:11:27.360552+0000","last_became_peered":"2024-09-13T17:11:27.360552+0000","last_unstale":"2024-09-13T17:11:27.833316+0000","last_undegraded":"2024-09-13T17:11:27.833316+0000","last_fullsized":"2024-09-13T17:11:27.833316+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:08.726724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.108810+0000","last_change":"2024-09-13T17:11:27.356317+0000","last_active":"2024-09-13T17:11:29.108810+0000","last_peered":"2024-09-13T17:11:29.108810+0000","last_clean":"2024-09-13T17:11:29.108810+0000","last_became_active":"2024-09-13T17:11:27.355863+0000","last_became_peered":"2024-09-13T17:11:27.355863+0000","last_unstale":"2024-09-13T17:11:29.108810+0000","last_undegraded":"2024-09-13T17:11:29.108810+0000","last_fullsized":"2024-09-13T17:11:29.108810+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:29.356048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.557362+0000","last_change":"2024-09-13T17:11:23.344929+0000","last_active":"2024-09-13T17:11:27.557362+0000","last_peered":"2024-09-13T17:11:27.557362+0000","last_clean":"2024-09-13T17:11:27.557362+0000","last_became_active":"2024-09-13T17:11:23.344627+0000","last_became_peered":"2024-09-13T17:11:23.344627+0000","last_unstale":"2024-09-13T17:11:27.557362+0000","last_undegraded":"2024-09-13T17:11:27.557362+0000","last_fullsized":"2024-09-13T17:11:27.557362+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:15.049627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832206+0000","last_change":"2024-09-13T17:11:23.002539+0000","last_active":"2024-09-13T17:11:27.832206+0000","last_peered":"2024-09-13T17:11:27.832206+0000","last_clean":"2024-09-13T17:11:27.832206+0000","last_became_active":"2024-09-13T17:11:23.002206+0000","last_became_peered":"2024-09-13T17:11:23.002206+0000","last_unstale":"2024-09-13T17:11:27.832206+0000","last_undegraded":"2024-09-13T17:11:27.832206+0000","last_fullsized":"2024-09-13T17:11:27.832206+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:57.708167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801253+0000","last_change":"2024-09-13T17:11:27.362667+0000","last_active":"2024-09-13T17:11:48.801253+0000","last_peered":"2024-09-13T17:11:48.801253+0000","last_clean":"2024-09-13T17:11:48.801253+0000","last_became_active":"2024-09-13T17:11:27.362293+0000","last_became_peered":"2024-09-13T17:11:27.362293+0000","last_unstale":"2024-09-13T17:11:48.801253+0000","last_undegraded":"2024-09-13T17:11:48.801253+0000","last_fullsized":"2024-09-13T17:11:48.801253+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:24.446951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.349858+0000","last_change":"2024-09-13T17:11:23.335823+0000","last_active":"2024-09-13T17:11:27.349858+0000","last_peered":"2024-09-13T17:11:27.349858+0000","last_clean":"2024-09-13T17:11:27.349858+0000","last_became_active":"2024-09-13T17:11:23.335491+0000","last_became_peered":"2024-09-13T17:11:23.335491+0000","last_unstale":"2024-09-13T17:11:27.349858+0000","last_undegraded":"2024-09-13T17:11:27.349858+0000","last_fullsized":"2024-09-13T17:11:27.349858+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:42.172559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344221+0000","last_change":"2024-09-13T17:11:22.999477+0000","last_active":"2024-09-13T17:11:27.344221+0000","last_peered":"2024-09-13T17:11:27.344221+0000","last_clean":"2024-09-13T17:11:27.344221+0000","last_became_active":"2024-09-13T17:11:22.999175+0000","last_became_peered":"2024-09-13T17:11:22.999175+0000","last_unstale":"2024-09-13T17:11:27.344221+0000","last_undegraded":"2024-09-13T17:11:27.344221+0000","last_fullsized":"2024-09-13T17:11:27.344221+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:03.817508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.178558+0000","last_change":"2024-09-13T17:11:23.001737+0000","last_active":"2024-09-13T17:11:47.178558+0000","last_peered":"2024-09-13T17:11:47.178558+0000","last_clean":"2024-09-13T17:11:47.178558+0000","last_became_active":"2024-09-13T17:11:23.001296+0000","last_became_peered":"2024-09-13T17:11:23.001296+0000","last_unstale":"2024-09-13T17:11:47.178558+0000","last_undegraded":"2024-09-13T17:11:47.178558+0000","last_fullsized":"2024-09-13T17:11:47.178558+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:08.671244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.356028+0000","last_change":"2024-09-13T17:11:23.337738+0000","last_active":"2024-09-13T17:11:27.356028+0000","last_peered":"2024-09-13T17:11:27.356028+0000","last_clean":"2024-09-13T17:11:27.356028+0000","last_became_active":"2024-09-13T17:11:23.337411+0000","last_became_peered":"2024-09-13T17:11:23.337411+0000","last_unstale":"2024-09-13T17:11:27.356028+0000","last_undegraded":"2024-09-13T17:11:27.356028+0000","last_fullsized":"2024-09-13T17:11:27.356028+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:02.355706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.683948+0000","last_change":"2024-09-13T17:11:27.363174+0000","last_active":"2024-09-13T17:11:27.683948+0000","last_peered":"2024-09-13T17:11:27.683948+0000","last_clean":"2024-09-13T17:11:27.683948+0000","last_became_active":"2024-09-13T17:11:27.362158+0000","last_became_peered":"2024-09-13T17:11:27.362158+0000","last_unstale":"2024-09-13T17:11:27.683948+0000","last_undegraded":"2024-09-13T17:11:27.683948+0000","last_fullsized":"2024-09-13T17:11:27.683948+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:49:52.892616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'5","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:46.177022+0000","last_change":"2024-09-13T17:11:23.000544+0000","last_active":"2024-09-13T17:11:46.177022+0000","last_peered":"2024-09-13T17:11:46.177022+0000","last_clean":"2024-09-13T17:11:46.177022+0000","last_became_active":"2024-09-13T17:11:23.000233+0000","last_became_peered":"2024-09-13T17:11:23.000233+0000","last_unstale":"2024-09-13T17:11:46.177022+0000","last_undegraded":"2024-09-13T17:11:46.177022+0000","last_fullsized":"2024-09-13T17:11:46.177022+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:04.745950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.352666+0000","last_change":"2024-09-13T17:11:23.340104+0000","last_active":"2024-09-13T17:11:27.352666+0000","last_peered":"2024-09-13T17:11:27.352666+0000","last_clean":"2024-09-13T17:11:27.352666+0000","last_became_active":"2024-09-13T17:11:23.339826+0000","last_became_peered":"2024-09-13T17:11:23.339826+0000","last_unstale":"2024-09-13T17:11:27.352666+0000","last_undegraded":"2024-09-13T17:11:27.352666+0000","last_fullsized":"2024-09-13T17:11:27.352666+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:03.101547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.683859+0000","last_change":"2024-09-13T17:11:27.360848+0000","last_active":"2024-09-13T17:11:27.683859+0000","last_peered":"2024-09-13T17:11:27.683859+0000","last_clean":"2024-09-13T17:11:27.683859+0000","last_became_active":"2024-09-13T17:11:27.360416+0000","last_became_peered":"2024-09-13T17:11:27.360416+0000","last_unstale":"2024-09-13T17:11:27.683859+0000","last_undegraded":"2024-09-13T17:11:27.683859+0000","last_fullsized":"2024-09-13T17:11:27.683859+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:06.857649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.800926+0000","last_change":"2024-09-13T17:11:23.334723+0000","last_active":"2024-09-13T17:11:48.800926+0000","last_peered":"2024-09-13T17:11:48.800926+0000","last_clean":"2024-09-13T17:11:48.800926+0000","last_became_active":"2024-09-13T17:11:23.334433+0000","last_became_peered":"2024-09-13T17:11:23.334433+0000","last_unstale":"2024-09-13T17:11:48.800926+0000","last_undegraded":"2024-09-13T17:11:48.800926+0000","last_fullsized":"2024-09-13T17:11:48.800926+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:08.657151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.352210+0000","last_change":"2024-09-13T17:11:23.334882+0000","last_active":"2024-09-13T17:11:27.352210+0000","last_peered":"2024-09-13T17:11:27.352210+0000","last_clean":"2024-09-13T17:11:27.352210+0000","last_became_active":"2024-09-13T17:11:23.334610+0000","last_became_peered":"2024-09-13T17:11:23.334610+0000","last_unstale":"2024-09-13T17:11:27.352210+0000","last_undegraded":"2024-09-13T17:11:27.352210+0000","last_fullsized":"2024-09-13T17:11:27.352210+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:03.932181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.351982+0000","last_change":"2024-09-13T17:11:23.334076+0000","last_active":"2024-09-13T17:11:27.351982+0000","last_peered":"2024-09-13T17:11:27.351982+0000","last_clean":"2024-09-13T17:11:27.351982+0000","last_became_active":"2024-09-13T17:11:23.333801+0000","last_became_peered":"2024-09-13T17:11:23.333801+0000","last_unstale":"2024-09-13T17:11:27.351982+0000","last_undegraded":"2024-09-13T17:11:27.351982+0000","last_fullsized":"2024-09-13T17:11:27.351982+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:07.113045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832811+0000","last_change":"2024-09-13T17:11:23.332306+0000","last_active":"2024-09-13T17:11:27.832811+0000","last_peered":"2024-09-13T17:11:27.832811+0000","last_clean":"2024-09-13T17:11:27.832811+0000","last_became_active":"2024-09-13T17:11:23.331913+0000","last_became_peered":"2024-09-13T17:11:23.331913+0000","last_unstale":"2024-09-13T17:11:27.832811+0000","last_undegraded":"2024-09-13T17:11:27.832811+0000","last_fullsized":"2024-09-13T17:11:27.832811+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:02.927286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344550+0000","last_change":"2024-09-13T17:11:23.335512+0000","last_active":"2024-09-13T17:11:27.344550+0000","last_peered":"2024-09-13T17:11:27.344550+0000","last_clean":"2024-09-13T17:11:27.344550+0000","last_became_active":"2024-09-13T17:11:23.335201+0000","last_became_peered":"2024-09-13T17:11:23.335201+0000","last_unstale":"2024-09-13T17:11:27.344550+0000","last_undegraded":"2024-09-13T17:11:27.344550+0000","last_fullsized":"2024-09-13T17:11:27.344550+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:17.263819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801579+0000","last_change":"2024-09-13T17:11:23.341204+0000","last_active":"2024-09-13T17:11:48.801579+0000","last_peered":"2024-09-13T17:11:48.801579+0000","last_clean":"2024-09-13T17:11:48.801579+0000","last_became_active":"2024-09-13T17:11:23.339848+0000","last_became_peered":"2024-09-13T17:11:23.339848+0000","last_unstale":"2024-09-13T17:11:48.801579+0000","last_undegraded":"2024-09-13T17:11:48.801579+0000","last_fullsized":"2024-09-13T17:11:48.801579+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:15:09.480651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.353662+0000","last_change":"2024-09-13T17:11:23.334741+0000","last_active":"2024-09-13T17:11:27.353662+0000","last_peered":"2024-09-13T17:11:27.353662+0000","last_clean":"2024-09-13T17:11:27.353662+0000","last_became_active":"2024-09-13T17:11:23.334459+0000","last_became_peered":"2024-09-13T17:11:23.334459+0000","last_unstale":"2024-09-13T17:11:27.353662+0000","last_undegraded":"2024-09-13T17:11:27.353662+0000","last_fullsized":"2024-09-13T17:11:27.353662+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:52.379735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.353786+0000","last_change":"2024-09-13T17:11:23.337869+0000","last_active":"2024-09-13T17:11:27.353786+0000","last_peered":"2024-09-13T17:11:27.353786+0000","last_clean":"2024-09-13T17:11:27.353786+0000","last_became_active":"2024-09-13T17:11:23.337581+0000","last_became_peered":"2024-09-13T17:11:23.337581+0000","last_unstale":"2024-09-13T17:11:27.353786+0000","last_undegraded":"2024-09-13T17:11:27.353786+0000","last_fullsized":"2024-09-13T17:11:27.353786+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:49.407474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.354864+0000","last_change":"2024-09-13T17:11:23.337034+0000","last_active":"2024-09-13T17:11:27.354864+0000","last_peered":"2024-09-13T17:11:27.354864+0000","last_clean":"2024-09-13T17:11:27.354864+0000","last_became_active":"2024-09-13T17:11:23.334863+0000","last_became_peered":"2024-09-13T17:11:23.334863+0000","last_unstale":"2024-09-13T17:11:27.354864+0000","last_undegraded":"2024-09-13T17:11:27.354864+0000","last_fullsized":"2024-09-13T17:11:27.354864+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:05.820989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.349144+0000","last_change":"2024-09-13T17:11:23.336713+0000","last_active":"2024-09-13T17:11:27.349144+0000","last_peered":"2024-09-13T17:11:27.349144+0000","last_clean":"2024-09-13T17:11:27.349144+0000","last_became_active":"2024-09-13T17:11:23.336431+0000","last_became_peered":"2024-09-13T17:11:23.336431+0000","last_unstale":"2024-09-13T17:11:27.349144+0000","last_undegraded":"2024-09-13T17:11:27.349144+0000","last_fullsized":"2024-09-13T17:11:27.349144+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:52.709483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345023+0000","last_change":"2024-09-13T17:11:23.340385+0000","last_active":"2024-09-13T17:11:27.345023+0000","last_peered":"2024-09-13T17:11:27.345023+0000","last_clean":"2024-09-13T17:11:27.345023+0000","last_became_active":"2024-09-13T17:11:23.340068+0000","last_became_peered":"2024-09-13T17:11:23.340068+0000","last_unstale":"2024-09-13T17:11:27.345023+0000","last_undegraded":"2024-09-13T17:11:27.345023+0000","last_fullsized":"2024-09-13T17:11:27.345023+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:17.795222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345000+0000","last_change":"2024-09-13T17:11:23.329214+0000","last_active":"2024-09-13T17:11:27.345000+0000","last_peered":"2024-09-13T17:11:27.345000+0000","last_clean":"2024-09-13T17:11:27.345000+0000","last_became_active":"2024-09-13T17:11:23.328747+0000","last_became_peered":"2024-09-13T17:11:23.328747+0000","last_unstale":"2024-09-13T17:11:27.345000+0000","last_undegraded":"2024-09-13T17:11:27.345000+0000","last_fullsized":"2024-09-13T17:11:27.345000+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:11.233652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801419+0000","last_change":"2024-09-13T17:11:23.339854+0000","last_active":"2024-09-13T17:11:48.801419+0000","last_peered":"2024-09-13T17:11:48.801419+0000","last_clean":"2024-09-13T17:11:48.801419+0000","last_became_active":"2024-09-13T17:11:23.339565+0000","last_became_peered":"2024-09-13T17:11:23.339565+0000","last_unstale":"2024-09-13T17:11:48.801419+0000","last_undegraded":"2024-09-13T17:11:48.801419+0000","last_fullsized":"2024-09-13T17:11:48.801419+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:37.161135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.353415+0000","last_change":"2024-09-13T17:11:23.342562+0000","last_active":"2024-09-13T17:11:27.353415+0000","last_peered":"2024-09-13T17:11:27.353415+0000","last_clean":"2024-09-13T17:11:27.353415+0000","last_became_active":"2024-09-13T17:11:23.342256+0000","last_became_peered":"2024-09-13T17:11:23.342256+0000","last_unstale":"2024-09-13T17:11:27.353415+0000","last_undegraded":"2024-09-13T17:11:27.353415+0000","last_fullsized":"2024-09-13T17:11:27.353415+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:30.788242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.557424+0000","last_change":"2024-09-13T17:11:23.342436+0000","last_active":"2024-09-13T17:11:27.557424+0000","last_peered":"2024-09-13T17:11:27.557424+0000","last_clean":"2024-09-13T17:11:27.557424+0000","last_became_active":"2024-09-13T17:11:23.342157+0000","last_became_peered":"2024-09-13T17:11:23.342157+0000","last_unstale":"2024-09-13T17:11:27.557424+0000","last_undegraded":"2024-09-13T17:11:27.557424+0000","last_fullsized":"2024-09-13T17:11:27.557424+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:56.550875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801559+0000","last_change":"2024-09-13T17:11:23.341660+0000","last_active":"2024-09-13T17:11:48.801559+0000","last_peered":"2024-09-13T17:11:48.801559+0000","last_clean":"2024-09-13T17:11:48.801559+0000","last_became_active":"2024-09-13T17:11:23.341102+0000","last_became_peered":"2024-09-13T17:11:23.341102+0000","last_unstale":"2024-09-13T17:11:48.801559+0000","last_undegraded":"2024-09-13T17:11:48.801559+0000","last_fullsized":"2024-09-13T17:11:48.801559+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:00.546907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.345956+0000","last_change":"2024-09-13T17:11:23.338064+0000","last_active":"2024-09-13T17:11:27.345956+0000","last_peered":"2024-09-13T17:11:27.345956+0000","last_clean":"2024-09-13T17:11:27.345956+0000","last_became_active":"2024-09-13T17:11:23.337748+0000","last_became_peered":"2024-09-13T17:11:23.337748+0000","last_unstale":"2024-09-13T17:11:27.345956+0000","last_undegraded":"2024-09-13T17:11:27.345956+0000","last_fullsized":"2024-09-13T17:11:27.345956+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:14.281629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832520+0000","last_change":"2024-09-13T17:11:23.335684+0000","last_active":"2024-09-13T17:11:27.832520+0000","last_peered":"2024-09-13T17:11:27.832520+0000","last_clean":"2024-09-13T17:11:27.832520+0000","last_became_active":"2024-09-13T17:11:23.335364+0000","last_became_peered":"2024-09-13T17:11:23.335364+0000","last_unstale":"2024-09-13T17:11:27.832520+0000","last_undegraded":"2024-09-13T17:11:27.832520+0000","last_fullsized":"2024-09-13T17:11:27.832520+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:02.288009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832521+0000","last_change":"2024-09-13T17:11:23.340881+0000","last_active":"2024-09-13T17:11:27.832521+0000","last_peered":"2024-09-13T17:11:27.832521+0000","last_clean":"2024-09-13T17:11:27.832521+0000","last_became_active":"2024-09-13T17:11:23.340575+0000","last_became_peered":"2024-09-13T17:11:23.340575+0000","last_unstale":"2024-09-13T17:11:27.832521+0000","last_undegraded":"2024-09-13T17:11:27.832521+0000","last_fullsized":"2024-09-13T17:11:27.832521+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:40.757703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344905+0000","last_change":"2024-09-13T17:11:23.329039+0000","last_active":"2024-09-13T17:11:27.344905+0000","last_peered":"2024-09-13T17:11:27.344905+0000","last_clean":"2024-09-13T17:11:27.344905+0000","last_became_active":"2024-09-13T17:11:23.328324+0000","last_became_peered":"2024-09-13T17:11:23.328324+0000","last_unstale":"2024-09-13T17:11:27.344905+0000","last_undegraded":"2024-09-13T17:11:27.344905+0000","last_fullsized":"2024-09-13T17:11:27.344905+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:37.882596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.833586+0000","last_change":"2024-09-13T17:11:23.345229+0000","last_active":"2024-09-13T17:11:27.833586+0000","last_peered":"2024-09-13T17:11:27.833586+0000","last_clean":"2024-09-13T17:11:27.833586+0000","last_became_active":"2024-09-13T17:11:23.344883+0000","last_became_peered":"2024-09-13T17:11:23.344883+0000","last_unstale":"2024-09-13T17:11:27.833586+0000","last_undegraded":"2024-09-13T17:11:27.833586+0000","last_fullsized":"2024-09-13T17:11:27.833586+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:47.983382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.346617+0000","last_change":"2024-09-13T17:11:23.346338+0000","last_active":"2024-09-13T17:11:27.346617+0000","last_peered":"2024-09-13T17:11:27.346617+0000","last_clean":"2024-09-13T17:11:27.346617+0000","last_became_active":"2024-09-13T17:11:23.344777+0000","last_became_peered":"2024-09-13T17:11:23.344777+0000","last_unstale":"2024-09-13T17:11:27.346617+0000","last_undegraded":"2024-09-13T17:11:27.346617+0000","last_fullsized":"2024-09-13T17:11:27.346617+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:23.650174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"peering","last_fresh":"2024-09-13T17:11:48.800882+0000","last_change":"2024-09-13T17:11:48.801055+0000","last_active":"2024-09-13T17:11:48.800882+0000","last_peered":"2024-09-13T17:11:27.834681+0000","last_clean":"2024-09-13T17:11:27.834681+0000","last_became_active":"2024-09-13T17:11:23.334660+0000","last_became_peered":"2024-09-13T17:11:23.334660+0000","last_unstale":"2024-09-13T17:11:48.800882+0000","last_undegraded":"2024-09-13T17:11:48.800882+0000","last_fullsized":"2024-09-13T17:11:48.800882+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:32.110092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,4,9],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344818+0000","last_change":"2024-09-13T17:11:23.340478+0000","last_active":"2024-09-13T17:11:27.344818+0000","last_peered":"2024-09-13T17:11:27.344818+0000","last_clean":"2024-09-13T17:11:27.344818+0000","last_became_active":"2024-09-13T17:11:23.339916+0000","last_became_peered":"2024-09-13T17:11:23.339916+0000","last_unstale":"2024-09-13T17:11:27.344818+0000","last_undegraded":"2024-09-13T17:11:27.344818+0000","last_fullsized":"2024-09-13T17:11:27.344818+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:09.477626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.349777+0000","last_change":"2024-09-13T17:11:23.340882+0000","last_active":"2024-09-13T17:11:27.349777+0000","last_peered":"2024-09-13T17:11:27.349777+0000","last_clean":"2024-09-13T17:11:27.349777+0000","last_became_active":"2024-09-13T17:11:23.340413+0000","last_became_peered":"2024-09-13T17:11:23.340413+0000","last_unstale":"2024-09-13T17:11:27.349777+0000","last_undegraded":"2024-09-13T17:11:27.349777+0000","last_fullsized":"2024-09-13T17:11:27.349777+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:49.040015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.344555+0000","last_change":"2024-09-13T17:11:23.345551+0000","last_active":"2024-09-13T17:11:27.344555+0000","last_peered":"2024-09-13T17:11:27.344555+0000","last_clean":"2024-09-13T17:11:27.344555+0000","last_became_active":"2024-09-13T17:11:23.345195+0000","last_became_peered":"2024-09-13T17:11:23.345195+0000","last_unstale":"2024-09-13T17:11:27.344555+0000","last_undegraded":"2024-09-13T17:11:27.344555+0000","last_fullsized":"2024-09-13T17:11:27.344555+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:00.856969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"peering","last_fresh":"2024-09-13T17:11:48.799086+0000","last_change":"2024-09-13T17:11:48.799241+0000","last_active":"2024-09-13T17:11:48.799086+0000","last_peered":"2024-09-13T17:11:27.834170+0000","last_clean":"2024-09-13T17:11:27.834170+0000","last_became_active":"2024-09-13T17:11:23.334061+0000","last_became_peered":"2024-09-13T17:11:23.334061+0000","last_unstale":"2024-09-13T17:11:48.799086+0000","last_undegraded":"2024-09-13T17:11:48.799086+0000","last_fullsized":"2024-09-13T17:11:48.799086+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:40.383855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,7,9],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.353081+0000","last_change":"2024-09-13T17:11:23.340286+0000","last_active":"2024-09-13T17:11:27.353081+0000","last_peered":"2024-09-13T17:11:27.353081+0000","last_clean":"2024-09-13T17:11:27.353081+0000","last_became_active":"2024-09-13T17:11:23.339756+0000","last_became_peered":"2024-09-13T17:11:23.339756+0000","last_unstale":"2024-09-13T17:11:27.353081+0000","last_undegraded":"2024-09-13T17:11:27.353081+0000","last_fullsized":"2024-09-13T17:11:27.353081+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:00.463087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.833501+0000","last_change":"2024-09-13T17:11:23.339818+0000","last_active":"2024-09-13T17:11:27.833501+0000","last_peered":"2024-09-13T17:11:27.833501+0000","last_clean":"2024-09-13T17:11:27.833501+0000","last_became_active":"2024-09-13T17:11:23.339501+0000","last_became_peered":"2024-09-13T17:11:23.339501+0000","last_unstale":"2024-09-13T17:11:27.833501+0000","last_undegraded":"2024-09-13T17:11:27.833501+0000","last_fullsized":"2024-09-13T17:11:27.833501+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:36.904004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832723+0000","last_change":"2024-09-13T17:11:23.334388+0000","last_active":"2024-09-13T17:11:27.832723+0000","last_peered":"2024-09-13T17:11:27.832723+0000","last_clean":"2024-09-13T17:11:27.832723+0000","last_became_active":"2024-09-13T17:11:23.333953+0000","last_became_peered":"2024-09-13T17:11:23.333953+0000","last_unstale":"2024-09-13T17:11:27.832723+0000","last_undegraded":"2024-09-13T17:11:27.832723+0000","last_fullsized":"2024-09-13T17:11:27.832723+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:33.929173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832701+0000","last_change":"2024-09-13T17:11:23.338259+0000","last_active":"2024-09-13T17:11:27.832701+0000","last_peered":"2024-09-13T17:11:27.832701+0000","last_clean":"2024-09-13T17:11:27.832701+0000","last_became_active":"2024-09-13T17:11:23.337979+0000","last_became_peered":"2024-09-13T17:11:23.337979+0000","last_unstale":"2024-09-13T17:11:27.832701+0000","last_undegraded":"2024-09-13T17:11:27.832701+0000","last_fullsized":"2024-09-13T17:11:27.832701+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:55.750255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801517+0000","last_change":"2024-09-13T17:11:23.337899+0000","last_active":"2024-09-13T17:11:48.801517+0000","last_peered":"2024-09-13T17:11:48.801517+0000","last_clean":"2024-09-13T17:11:48.801517+0000","last_became_active":"2024-09-13T17:11:23.337626+0000","last_became_peered":"2024-09-13T17:11:23.337626+0000","last_unstale":"2024-09-13T17:11:48.801517+0000","last_undegraded":"2024-09-13T17:11:48.801517+0000","last_fullsized":"2024-09-13T17:11:48.801517+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:14.654852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":43759,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":23,"num_read_kb":40,"num_write":124,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":58679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285958,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383698,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":995328,"data_stored":499901,"data_compressed":17667,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.35499999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.497}]},{"osd":2,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.58199999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.41799999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.50900000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.67700000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":9,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.52000000000000002}]},{"osd":10,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.60599999999999998}]}]},{"osd":10,"up_from":72,"seq":309237645334,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":1105920,"data_stored":1118312,"data_compressed":51052,"data_compressed_allocated":65536,"data_compressed_original":630784,"omap_allocated":1597,"internal_metadata":36043203},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.52200000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.374},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.39700000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.624},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.60899999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.54500000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.443}]},{"osd":6,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.70999999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.51200000000000001}]},{"osd":8,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.50900000000000001}]},{"osd":9,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.67500000000000004}]},{"osd":11,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.746}]}]},{"osd":9,"up_from":67,"seq":287762808858,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":978944,"data_stored":477347,"data_compressed":11720,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1597,"internal_metadata":31848899},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.315}]},{"osd":1,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.503},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.39100000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.40799999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.27100000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.51300000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.39900000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.49299999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.66500000000000004}]},{"osd":8,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.54200000000000004}]},{"osd":10,"last update":"Fri Sep 13 17:11:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.55700000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]}]},{"osd":8,"up_from":59,"seq":253403070496,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":477301,"data_compressed":11720,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67600000000000005,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.65500000000000003,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.67500000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54300000000000004,"15min":0.54400000000000004},"min":{"1min":0.34599999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71799999999999997,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.79900000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.41899999999999998,"15min":0.41799999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.63100000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.441,"15min":0.438},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70899999999999996,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.68999999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.73899999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.81299999999999994}]},{"osd":5,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.753},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53400000000000003,"15min":0.53600000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76700000000000002,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.78000000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.64400000000000002,"15min":0.64900000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.85999999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64700000000000002,"15min":0.64600000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92200000000000004,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90900000000000003,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.94999999999999996}]},{"osd":9,"last update":"Fri Sep 13 17:10:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.873},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.84699999999999998}]},{"osd":10,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.92900000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]}]},{"osd":7,"up_from":51,"seq":219043332132,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":1069019,"data_compressed":48079,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1587,"internal_metadata":27654605},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.39700000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.66200000000000003,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.35799999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.52500000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.35999999999999999,"15min":0.35399999999999998},"min":{"1min":0.25800000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.34999999999999998,"15min":0.34399999999999997},"min":{"1min":0.32200000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.623}]},{"osd":2,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52800000000000002,"15min":0.52100000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.502},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.51400000000000001,"15min":0.50700000000000001},"min":{"1min":0.39100000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.52200000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.51000000000000001,"15min":0.502},"min":{"1min":0.38100000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67500000000000004,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.53400000000000003},"min":{"1min":0.42899999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.81200000000000006}]},{"osd":4,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46200000000000002,"15min":0.45700000000000002},"min":{"1min":0.29899999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.442,"15min":0.439},"min":{"1min":0.31900000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.44500000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.56899999999999995,"15min":0.56200000000000006},"min":{"1min":0.5,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57499999999999996,"15min":0.57199999999999995},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.47799999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.44700000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.59799999999999998,"15min":0.58699999999999997},"min":{"1min":0.45600000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.86599999999999999}]},{"osd":8,"last update":"Fri Sep 13 17:11:31 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.63600000000000001,"15min":0.628},"min":{"1min":0.504,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.65300000000000002,"15min":0.64200000000000002},"min":{"1min":0.47899999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.70299999999999996}]},{"osd":9,"last update":"Fri Sep 13 17:10:49 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.78900000000000003}]},{"osd":10,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.74299999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]}]},{"osd":6,"up_from":46,"seq":197568495656,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":476563,"data_compressed":11720,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.34200000000000003,"15min":0.33500000000000002},"min":{"1min":0.23400000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.373,"15min":0.36899999999999999},"min":{"1min":0.26500000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.57399999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.29899999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.74199999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.63600000000000001,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.47399999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68999999999999995,"5min":1.095,"15min":1.095},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54100000000000004,"15min":0.52600000000000002},"min":{"1min":0.35899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.77300000000000002,"5min":0.877,"15min":0.877},"last":0.67700000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.42199999999999999,"15min":0.41599999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.626,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41799999999999998,"15min":0.41199999999999998},"min":{"1min":0.28199999999999997,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58599999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.40999999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51000000000000001,"15min":0.502},"min":{"1min":0.41199999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71699999999999997,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.39200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76100000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.59599999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.70599999999999996,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59599999999999997,"15min":0.60299999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.73999999999999999,"5min":1.131,"15min":1.131},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.436},{"interface":"front","average":{"1min":0.628,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.71199999999999997}]},{"osd":8,"last update":"Fri Sep 13 17:11:28 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.623,"15min":0.627},"min":{"1min":0.42399999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.85899999999999999,"5min":0.874,"15min":0.874},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.69799999999999995}]},{"osd":9,"last update":"Fri Sep 13 17:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.63300000000000001}]},{"osd":10,"last update":"Fri Sep 13 17:11:12 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.74299999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]}]},{"osd":5,"up_from":38,"seq":163208757293,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":1036288,"data_stored":1068028,"data_compressed":48079,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48399999999999999,"15min":0.47599999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67300000000000004,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48799999999999999,"15min":0.47999999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69499999999999995,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.56299999999999994}]},{"osd":1,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55100000000000005,"15min":0.54400000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68600000000000005,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.371,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.67600000000000005,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.58099999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.377,"15min":0.371},"min":{"1min":0.23499999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.58699999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.378,"15min":0.372},"min":{"1min":0.253,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.59099999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.39700000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50700000000000001,"15min":0.501},"min":{"1min":0.30199999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.69599999999999995,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.63800000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.67300000000000004}]},{"osd":4,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73099999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56999999999999995,"15min":0.56000000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.629}]},{"osd":6,"last update":"Fri Sep 13 17:11:41 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.75},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56100000000000005,"15min":0.56000000000000005},"min":{"1min":0.39100000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.74199999999999999,"5min":0.749,"15min":0.749},"last":0.74199999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.46400000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.44,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.71599999999999997}]},{"osd":8,"last update":"Fri Sep 13 17:11:26 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52500000000000002,"15min":0.53100000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69199999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55800000000000005,"15min":0.56599999999999995},"min":{"1min":0.39800000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.70299999999999996,"5min":0.747,"15min":0.747},"last":0.52000000000000002}]},{"osd":9,"last update":"Fri Sep 13 17:10:47 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.81000000000000005}]},{"osd":10,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.77800000000000002}]}]},{"osd":4,"up_from":33,"seq":141733920819,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36176,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708976,"statfs":{"total":95995035648,"available":95957991424,"internally_reserved":0,"allocated":987136,"data_stored":490408,"data_compressed":14693,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":0.71699999999999997,"15min":0.59099999999999997},"min":{"1min":0.42399999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":15.369999999999999,"5min":15.369999999999999,"15min":15.369999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":1.4950000000000001,"5min":0.68200000000000005,"15min":0.54400000000000004},"min":{"1min":0.45900000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":15.416,"5min":15.416,"15min":15.416},"last":0.35399999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.36499999999999999,"15min":0.35899999999999999},"min":{"1min":0.25900000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38600000000000001},"min":{"1min":0.28699999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.60099999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.34799999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":0.74099999999999999,"15min":0.61699999999999999},"min":{"1min":0.379,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":15.401,"5min":15.401,"15min":15.401},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.52900000000000003,"15min":0.51900000000000002},"min":{"1min":0.39500000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.745,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.47599999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53900000000000003,"15min":0.54900000000000004},"min":{"1min":0.375,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76900000000000002,"5min":1.016,"15min":1.016},"last":0.39100000000000001},{"interface":"front","average":{"1min":1.524,"5min":0.74099999999999999,"15min":0.61699999999999999},"min":{"1min":0.39400000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":15.425000000000001,"5min":15.425000000000001,"15min":15.425000000000001},"last":0.40699999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57299999999999995,"15min":0.56399999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77900000000000003,"5min":1.073,"15min":1.073},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.73399999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.53500000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.54800000000000004,"15min":0.51800000000000002},"min":{"1min":0.40200000000000002,"5min":0.371,"15min":0.371},"max":{"1min":2.6469999999999998,"5min":2.6469999999999998,"15min":2.6469999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57599999999999996,"15min":0.55600000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.45400000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:11:00 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48199999999999998,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69399999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.48299999999999998,"15min":0.47899999999999998},"min":{"1min":0.34399999999999997,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.49399999999999999}]},{"osd":8,"last update":"Fri Sep 13 17:11:26 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.65200000000000002,"15min":0.63900000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.577,"5min":2.577,"15min":2.577},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.65500000000000003,"15min":0.64600000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.60299999999999998}]},{"osd":9,"last update":"Fri Sep 13 17:10:49 2024","interfaces":[{"interface":"back","average":{"1min":1.615,"5min":1.615,"15min":1.615},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":15.448,"5min":15.448,"15min":15.448},"last":0.55500000000000005},{"interface":"front","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":15.385,"5min":15.385,"15min":15.385},"last":0.63}]},{"osd":10,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.51100000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]},{"osd":3,"up_from":25,"seq":107374182454,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":476063,"data_compressed":11720,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34000000000000002,"15min":0.317},"min":{"1min":0.22500000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.34399999999999997,"15min":0.32200000000000001},"min":{"1min":0.23899999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.60899999999999999,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.27400000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52400000000000002,"15min":0.49399999999999999},"min":{"1min":0.32900000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78900000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51200000000000001,"15min":0.48299999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.60999999999999999,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.57199999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51500000000000001,"15min":0.496},"min":{"1min":0.34000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67800000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53800000000000003,"15min":0.50700000000000001},"min":{"1min":0.34200000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.73999999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.58099999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:10:55 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.53000000000000003,"15min":0.51400000000000001},"min":{"1min":0.372,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.625,"5min":0.53200000000000003,"15min":0.50700000000000001},"min":{"1min":0.40500000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.42899999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55900000000000005,"15min":0.55400000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70399999999999996,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.56000000000000005,"15min":0.56100000000000005},"min":{"1min":0.35199999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.754,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.60999999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:11:43 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.45200000000000001,"15min":0.44600000000000001},"min":{"1min":0.28199999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68000000000000005,"5min":0.746,"15min":0.746},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.45700000000000002,"15min":0.443},"min":{"1min":0.29499999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70199999999999996,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.35599999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:11:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58399999999999996,"15min":0.57799999999999996},"min":{"1min":0.42599999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.77500000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.503},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.45500000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.59099999999999997}]},{"osd":8,"last update":"Fri Sep 13 17:10:26 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66400000000000003}]},{"osd":9,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.45200000000000001}]},{"osd":10,"last update":"Fri Sep 13 17:11:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.53300000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]}]},{"osd":2,"up_from":18,"seq":77309411388,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":480693,"data_compressed":11720,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:09 2024","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":0.76600000000000001,"15min":0.73999999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":19.158999999999999,"5min":19.158999999999999,"15min":19.158999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.47599999999999998,"15min":0.46700000000000003},"min":{"1min":0.33700000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68500000000000005,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.57999999999999996}]},{"osd":1,"last update":"Fri Sep 13 17:11:09 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.501,"15min":0.47499999999999998},"min":{"1min":0.38,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68600000000000005,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.498,"15min":0.46800000000000003},"min":{"1min":0.40100000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.92800000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:11:36 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.51900000000000002,"15min":0.5},"min":{"1min":0.41299999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52700000000000002,"15min":0.50600000000000001},"min":{"1min":0.42999999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71899999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.64700000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.51100000000000001},"min":{"1min":0.41499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72199999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.40300000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.65800000000000003,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.79900000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:11:14 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.39900000000000002,"15min":0.39100000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.64500000000000002,"5min":0.747,"15min":0.747},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39800000000000002,"15min":0.39200000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.68799999999999994,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.77800000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:11:38 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54000000000000004},"min":{"1min":0.41699999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68300000000000005,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.875},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.69799999999999995,"15min":0.58699999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82499999999999996,"5min":19.276,"15min":19.276},"last":0.94299999999999995}]},{"osd":7,"last update":"Fri Sep 13 17:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.36699999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76200000000000001,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.41699999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76600000000000001,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.91300000000000003}]},{"osd":8,"last update":"Fri Sep 13 17:11:25 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53700000000000003,"15min":0.53500000000000003},"min":{"1min":0.33100000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76000000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56399999999999995,"15min":0.56100000000000005},"min":{"1min":0.35799999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":1.0309999999999999}]},{"osd":9,"last update":"Fri Sep 13 17:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":19.210999999999999,"5min":19.210999999999999,"15min":19.210999999999999},"last":1.0409999999999999}]},{"osd":10,"last update":"Fri Sep 13 17:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":1.01},{"interface":"front","average":{"1min":1.595,"5min":1.595,"15min":1.595},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":19.242000000000001,"5min":19.242000000000001,"15min":19.242000000000001},"last":1.0529999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":974848,"data_stored":480358,"data_compressed":11720,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:53 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.47799999999999998,"15min":0.46200000000000002},"min":{"1min":0.35199999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.48199999999999998,"15min":0.46500000000000002},"min":{"1min":0.32700000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.65500000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:11:08 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.52800000000000002,"15min":0.504},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.76900000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.52100000000000002,"15min":0.503},"min":{"1min":0.375,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.72199999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:11:37 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70599999999999996,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54700000000000004,"15min":0.52800000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70299999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.70799999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:10:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.39500000000000002,"15min":0.377},"min":{"1min":0.29199999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.38100000000000001,"15min":0.36299999999999999},"min":{"1min":0.26600000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.50600000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:11:21 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.52900000000000003,"15min":0.51300000000000001},"min":{"1min":0.35399999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.52600000000000002,"15min":0.502},"min":{"1min":0.39900000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.78700000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:11:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54000000000000004,"15min":0.52400000000000002},"min":{"1min":0.38500000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73199999999999998,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.59499999999999997,"15min":0.57499999999999996},"min":{"1min":0.45700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.82799999999999996,"5min":0.88,"15min":0.88},"last":0.76500000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:11:00 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.48999999999999999,"15min":0.47599999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.49399999999999999,"15min":0.48399999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.54800000000000004}]},{"osd":8,"last update":"Fri Sep 13 17:11:26 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.626,"15min":0.61699999999999999},"min":{"1min":0.41599999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.67300000000000004,"15min":0.66300000000000003},"min":{"1min":0.44,"5min":0.434,"15min":0.434},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.88200000000000001}]},{"osd":9,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.748}]},{"osd":10,"last update":"Fri Sep 13 17:11:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.86399999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":987136,"data_stored":477768,"data_compressed":11720,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:10:49 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.47299999999999998,"15min":0.46600000000000003},"min":{"1min":0.29899999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.49199999999999999,"15min":0.48099999999999998},"min":{"1min":0.28499999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.59399999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:11:08 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.52100000000000002,"15min":0.505},"min":{"1min":0.374,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77900000000000003,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.501},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.53000000000000003,"15min":0.50700000000000001},"min":{"1min":0.38100000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.624}]},{"osd":3,"last update":"Fri Sep 13 17:10:27 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.40999999999999998,"15min":0.40100000000000002},"min":{"1min":0.23499999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.432},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.39700000000000002,"15min":0.38900000000000001},"min":{"1min":0.26400000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.317}]},{"osd":4,"last update":"Fri Sep 13 17:10:55 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.496,"15min":0.47999999999999998},"min":{"1min":0.34100000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.52100000000000002,"15min":0.503},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Sep 13 17:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52100000000000002,"15min":0.50900000000000001},"min":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82399999999999995,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.54800000000000004,"15min":0.53000000000000003},"min":{"1min":0.42799999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80500000000000005,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.60799999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:11:41 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.433,"15min":0.41799999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.65100000000000002,"5min":0.754,"15min":0.754},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.44800000000000001,"15min":0.42999999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72899999999999998,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.376}]},{"osd":7,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.57999999999999996,"15min":0.57099999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.57599999999999996}]},{"osd":8,"last update":"Fri Sep 13 17:11:30 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.60499999999999998,"15min":0.60699999999999998},"min":{"1min":0.46500000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.77200000000000002,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.65200000000000002,"15min":0.65800000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90200000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.41899999999999998}]},{"osd":9,"last update":"Fri Sep 13 17:10:49 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.44500000000000001}]},{"osd":10,"last update":"Fri Sep 13 17:11:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.58499999999999996}]},{"osd":11,"last update":"Fri Sep 13 17:11:36 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.53700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34721,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34721,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34721,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":41955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:11:52.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:52 smithi087 ceph-mon[30934]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:11:52.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:52 smithi087 ceph-mon[30934]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:11:52.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:52 smithi087 ceph-mon[30934]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:11:52.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:52 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1886732194' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-09-13T17:11:52.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:52 smithi149 ceph-mon[35496]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:11:52.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:52 smithi149 ceph-mon[35496]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:11:52.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:52 smithi149 ceph-mon[35496]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:11:52.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:52 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1886732194' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-09-13T17:11:52.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:52 smithi118 ceph-mon[34374]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:11:52.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:52 smithi118 ceph-mon[34374]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:11:52.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:52 smithi118 ceph-mon[34374]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:11:52.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:52 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1886732194' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-09-13T17:11:53.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:53 smithi087 ceph-mon[30934]: from='client.14955 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:11:53.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:53 smithi087 ceph-mon[30934]: pgmap v293: 129 pgs: 4 peering, 125 active+clean; 620 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 8.5 KiB/s wr, 16 op/s 2024-09-13T17:11:53.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:53 smithi149 ceph-mon[35496]: from='client.14955 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:11:53.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:53 smithi149 ceph-mon[35496]: pgmap v293: 129 pgs: 4 peering, 125 active+clean; 620 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 8.5 KiB/s wr, 16 op/s 2024-09-13T17:11:53.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:53 smithi118 ceph-mon[34374]: from='client.14955 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:11:53.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:53 smithi118 ceph-mon[34374]: pgmap v293: 129 pgs: 4 peering, 125 active+clean; 620 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 8.5 KiB/s wr, 16 op/s 2024-09-13T17:11:54.762 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:11:54.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.872+0000 7f83d9202640 1 -- 172.21.15.87:0/4187694612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83d4103150 msgr2=0x7f83d4105540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:54.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.872+0000 7f83d9202640 1 --2- 172.21.15.87:0/4187694612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83d4103150 0x7f83d4105540 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f83c8009900 tx=0x7f83c802a410 comp rx=0 tx=0).stop 2024-09-13T17:11:54.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.872+0000 7f83d9202640 1 -- 172.21.15.87:0/4187694612 shutdown_connections 2024-09-13T17:11:54.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.872+0000 7f83d9202640 1 --2- 172.21.15.87:0/4187694612 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83d4105a80 0x7f83d4107ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:54.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.872+0000 7f83d9202640 1 --2- 172.21.15.87:0/4187694612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83d4103150 0x7f83d4105540 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:54.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.872+0000 7f83d9202640 1 --2- 172.21.15.87:0/4187694612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83d4100820 0x7f83d4102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:54.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.872+0000 7f83d9202640 1 -- 172.21.15.87:0/4187694612 >> 172.21.15.87:0/4187694612 conn(0x7f83d40fa440 msgr2=0x7f83d40fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:54.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.872+0000 7f83d9202640 1 -- 172.21.15.87:0/4187694612 shutdown_connections 2024-09-13T17:11:54.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.872+0000 7f83d9202640 1 -- 172.21.15.87:0/4187694612 wait complete. 2024-09-13T17:11:54.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.873+0000 7f83d9202640 1 Processor -- start 2024-09-13T17:11:54.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.873+0000 7f83d9202640 1 -- start start 2024-09-13T17:11:54.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.873+0000 7f83d9202640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83d4100820 0x7f83d4195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:54.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.873+0000 7f83d9202640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83d4103150 0x7f83d41963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:54.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.873+0000 7f83d9202640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83d4105a80 0x7f83d419d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:54.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.873+0000 7f83d9202640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d419d940 con 0x7f83d4100820 2024-09-13T17:11:54.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.873+0000 7f83d9202640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d419dab0 con 0x7f83d4103150 2024-09-13T17:11:54.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.873+0000 7f83d9202640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d419dc70 con 0x7f83d4105a80 2024-09-13T17:11:54.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.873+0000 7f83d2d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83d4100820 0x7f83d4195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:54.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.873+0000 7f83d2d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83d4100820 0x7f83d4195ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45600/0 (socket says 172.21.15.87:45600) 2024-09-13T17:11:54.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.873+0000 7f83d2d9d640 1 -- 172.21.15.87:0/2669335306 learned_addr learned my addr 172.21.15.87:0/2669335306 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:54.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.873+0000 7f83d259c640 1 --2- 172.21.15.87:0/2669335306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83d4103150 0x7f83d41963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:54.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.873+0000 7f83d359e640 1 --2- 172.21.15.87:0/2669335306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83d4105a80 0x7f83d419d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:54.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.873+0000 7f83d2d9d640 1 -- 172.21.15.87:0/2669335306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83d4105a80 msgr2=0x7f83d419d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:54.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.873+0000 7f83d2d9d640 1 --2- 172.21.15.87:0/2669335306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83d4105a80 0x7f83d419d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:54.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.873+0000 7f83d2d9d640 1 -- 172.21.15.87:0/2669335306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83d4103150 msgr2=0x7f83d41963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:54.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.873+0000 7f83d2d9d640 1 --2- 172.21.15.87:0/2669335306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83d4103150 0x7f83d41963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:54.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.873+0000 7f83d2d9d640 1 -- 172.21.15.87:0/2669335306 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c8009560 con 0x7f83d4100820 2024-09-13T17:11:54.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.874+0000 7f83d2d9d640 1 --2- 172.21.15.87:0/2669335306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83d4100820 0x7f83d4195ea0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f83c400d950 tx=0x7f83c400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:54.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.874+0000 7f83bbfff640 1 -- 172.21.15.87:0/2669335306 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c4009a30 con 0x7f83d4100820 2024-09-13T17:11:54.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.874+0000 7f83bbfff640 1 -- 172.21.15.87:0/2669335306 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f83c40044d0 con 0x7f83d4100820 2024-09-13T17:11:54.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.874+0000 7f83d9202640 1 -- 172.21.15.87:0/2669335306 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d419df50 con 0x7f83d4100820 2024-09-13T17:11:54.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.874+0000 7f83bbfff640 1 -- 172.21.15.87:0/2669335306 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c40047a0 con 0x7f83d4100820 2024-09-13T17:11:54.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.874+0000 7f83d9202640 1 -- 172.21.15.87:0/2669335306 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83d419e370 con 0x7f83d4100820 2024-09-13T17:11:54.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.875+0000 7f83d9202640 1 -- 172.21.15.87:0/2669335306 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83d40fbf30 con 0x7f83d4100820 2024-09-13T17:11:54.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.876+0000 7f83bbfff640 1 -- 172.21.15.87:0/2669335306 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f83c4009b90 con 0x7f83d4100820 2024-09-13T17:11:54.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.877+0000 7f83bbfff640 1 --2- 172.21.15.87:0/2669335306 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f83bc0a1120 0x7f83bc0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:54.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.877+0000 7f83d259c640 1 --2- 172.21.15.87:0/2669335306 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f83bc0a1120 0x7f83bc0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:54.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.877+0000 7f83bbfff640 1 -- 172.21.15.87:0/2669335306 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8978+0+0 (secure 0 0 0) 0x7f83c40cce40 con 0x7f83d4100820 2024-09-13T17:11:54.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.877+0000 7f83d259c640 1 --2- 172.21.15.87:0/2669335306 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f83bc0a1120 0x7f83bc0a35e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f83c80057c0 tx=0x7f83c8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:54.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:54.880+0000 7f83bbfff640 1 -- 172.21.15.87:0/2669335306 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f83c4096180 con 0x7f83d4100820 2024-09-13T17:11:55.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.039+0000 7f83d9202640 1 -- 172.21.15.87:0/2669335306 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f83d402c4f0 con 0x7f83bc0a1120 2024-09-13T17:11:55.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.050+0000 7f83bbfff640 1 -- 172.21.15.87:0/2669335306 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+424082 (secure 0 0 0) 0x7f83d402c4f0 con 0x7f83bc0a1120 2024-09-13T17:11:55.057 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:11:55.059 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-13T17:11:55.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.054+0000 7f83d9202640 1 -- 172.21.15.87:0/2669335306 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f83bc0a1120 msgr2=0x7f83bc0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:55.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.054+0000 7f83d9202640 1 --2- 172.21.15.87:0/2669335306 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f83bc0a1120 0x7f83bc0a35e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f83c80057c0 tx=0x7f83c8005a20 comp rx=0 tx=0).stop 2024-09-13T17:11:55.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.054+0000 7f83d9202640 1 -- 172.21.15.87:0/2669335306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83d4100820 msgr2=0x7f83d4195ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:55.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.054+0000 7f83d9202640 1 --2- 172.21.15.87:0/2669335306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83d4100820 0x7f83d4195ea0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f83c400d950 tx=0x7f83c400de10 comp rx=0 tx=0).stop 2024-09-13T17:11:55.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.054+0000 7f83d9202640 1 -- 172.21.15.87:0/2669335306 shutdown_connections 2024-09-13T17:11:55.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.054+0000 7f83d9202640 1 --2- 172.21.15.87:0/2669335306 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f83bc0a1120 0x7f83bc0a35e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:55.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.054+0000 7f83d9202640 1 --2- 172.21.15.87:0/2669335306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83d4105a80 0x7f83d419d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:55.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.054+0000 7f83d9202640 1 --2- 172.21.15.87:0/2669335306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83d4103150 0x7f83d41963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:55.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.054+0000 7f83d9202640 1 --2- 172.21.15.87:0/2669335306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83d4100820 0x7f83d4195ea0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:55.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.054+0000 7f83d9202640 1 -- 172.21.15.87:0/2669335306 >> 172.21.15.87:0/2669335306 conn(0x7f83d40fa440 msgr2=0x7f83d41012e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:55.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.055+0000 7f83d9202640 1 -- 172.21.15.87:0/2669335306 shutdown_connections 2024-09-13T17:11:55.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.055+0000 7f83d9202640 1 -- 172.21.15.87:0/2669335306 wait complete. 2024-09-13T17:11:55.068 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":294,"stamp":"2024-09-13T17:11:54.075595+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":634933,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":173,"num_read_kb":168,"num_write":326,"num_write_kb":3025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":421,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":377208,"kb_used_data":11996,"kb_used_omap":18,"kb_used_meta":365037,"kb_avail":1124564616,"statfs":{"total":1151940427776,"available":1151554166784,"internally_reserved":0,"allocated":12283904,"data_stored":7826809,"data_compressed":303238,"data_compressed_allocated":405504,"data_compressed_original":2310144,"omap_allocated":19109,"internal_metadata":373798235},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":39972,"num_objects":40,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":37,"num_read_kb":49,"num_write":97,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002376"},"pg_stats":[{"pgid":"2.1f","version":"89'9","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794907+0000","last_change":"2024-09-13T17:11:22.998997+0000","last_active":"2024-09-13T17:11:48.794907+0000","last_peered":"2024-09-13T17:11:48.794907+0000","last_clean":"2024-09-13T17:11:48.794907+0000","last_became_active":"2024-09-13T17:11:22.998674+0000","last_became_peered":"2024-09-13T17:11:22.998674+0000","last_unstale":"2024-09-13T17:11:48.794907+0000","last_undegraded":"2024-09-13T17:11:48.794907+0000","last_fullsized":"2024-09-13T17:11:48.794907+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:30:50.554788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794065+0000","last_change":"2024-09-13T17:11:23.340108+0000","last_active":"2024-09-13T17:11:48.794065+0000","last_peered":"2024-09-13T17:11:48.794065+0000","last_clean":"2024-09-13T17:11:48.794065+0000","last_became_active":"2024-09-13T17:11:23.339832+0000","last_became_peered":"2024-09-13T17:11:23.339832+0000","last_unstale":"2024-09-13T17:11:48.794065+0000","last_undegraded":"2024-09-13T17:11:48.794065+0000","last_fullsized":"2024-09-13T17:11:48.794065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:40.969448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.802879+0000","last_change":"2024-09-13T17:11:27.358090+0000","last_active":"2024-09-13T17:11:48.802879+0000","last_peered":"2024-09-13T17:11:48.802879+0000","last_clean":"2024-09-13T17:11:48.802879+0000","last_became_active":"2024-09-13T17:11:27.357725+0000","last_became_peered":"2024-09-13T17:11:27.357725+0000","last_unstale":"2024-09-13T17:11:48.802879+0000","last_undegraded":"2024-09-13T17:11:48.802879+0000","last_fullsized":"2024-09-13T17:11:48.802879+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:51.617457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794279+0000","last_change":"2024-09-13T17:11:23.000779+0000","last_active":"2024-09-13T17:11:48.794279+0000","last_peered":"2024-09-13T17:11:48.794279+0000","last_clean":"2024-09-13T17:11:48.794279+0000","last_became_active":"2024-09-13T17:11:23.000511+0000","last_became_peered":"2024-09-13T17:11:23.000511+0000","last_unstale":"2024-09-13T17:11:48.794279+0000","last_undegraded":"2024-09-13T17:11:48.794279+0000","last_fullsized":"2024-09-13T17:11:48.794279+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:09.802392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.833095+0000","last_change":"2024-09-13T17:11:23.333948+0000","last_active":"2024-09-13T17:11:27.833095+0000","last_peered":"2024-09-13T17:11:27.833095+0000","last_clean":"2024-09-13T17:11:27.833095+0000","last_became_active":"2024-09-13T17:11:23.333679+0000","last_became_peered":"2024-09-13T17:11:23.333679+0000","last_unstale":"2024-09-13T17:11:27.833095+0000","last_undegraded":"2024-09-13T17:11:27.833095+0000","last_fullsized":"2024-09-13T17:11:27.833095+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:10.265157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537784+0000","last_change":"2024-09-13T17:11:27.353767+0000","last_active":"2024-09-13T17:11:29.537784+0000","last_peered":"2024-09-13T17:11:29.537784+0000","last_clean":"2024-09-13T17:11:29.537784+0000","last_became_active":"2024-09-13T17:11:27.353448+0000","last_became_peered":"2024-09-13T17:11:27.353448+0000","last_unstale":"2024-09-13T17:11:29.537784+0000","last_undegraded":"2024-09-13T17:11:29.537784+0000","last_fullsized":"2024-09-13T17:11:29.537784+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:15.948099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799823+0000","last_change":"2024-09-13T17:11:22.999879+0000","last_active":"2024-09-13T17:11:48.799823+0000","last_peered":"2024-09-13T17:11:48.799823+0000","last_clean":"2024-09-13T17:11:48.799823+0000","last_became_active":"2024-09-13T17:11:22.999577+0000","last_became_peered":"2024-09-13T17:11:22.999577+0000","last_unstale":"2024-09-13T17:11:48.799823+0000","last_undegraded":"2024-09-13T17:11:48.799823+0000","last_fullsized":"2024-09-13T17:11:48.799823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:48.485532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792067+0000","last_change":"2024-09-13T17:11:23.339026+0000","last_active":"2024-09-13T17:11:48.792067+0000","last_peered":"2024-09-13T17:11:48.792067+0000","last_clean":"2024-09-13T17:11:48.792067+0000","last_became_active":"2024-09-13T17:11:23.338745+0000","last_became_peered":"2024-09-13T17:11:23.338745+0000","last_unstale":"2024-09-13T17:11:48.792067+0000","last_undegraded":"2024-09-13T17:11:48.792067+0000","last_fullsized":"2024-09-13T17:11:48.792067+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:27.455418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537867+0000","last_change":"2024-09-13T17:11:27.363137+0000","last_active":"2024-09-13T17:11:29.537867+0000","last_peered":"2024-09-13T17:11:29.537867+0000","last_clean":"2024-09-13T17:11:29.537867+0000","last_became_active":"2024-09-13T17:11:27.362621+0000","last_became_peered":"2024-09-13T17:11:27.362621+0000","last_unstale":"2024-09-13T17:11:29.537867+0000","last_undegraded":"2024-09-13T17:11:29.537867+0000","last_fullsized":"2024-09-13T17:11:29.537867+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:35:51.492630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.800066+0000","last_change":"2024-09-13T17:11:22.998066+0000","last_active":"2024-09-13T17:11:48.800066+0000","last_peered":"2024-09-13T17:11:48.800066+0000","last_clean":"2024-09-13T17:11:48.800066+0000","last_became_active":"2024-09-13T17:11:22.997741+0000","last_became_peered":"2024-09-13T17:11:22.997741+0000","last_unstale":"2024-09-13T17:11:48.800066+0000","last_undegraded":"2024-09-13T17:11:48.800066+0000","last_fullsized":"2024-09-13T17:11:48.800066+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:00.353453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792498+0000","last_change":"2024-09-13T17:11:23.336778+0000","last_active":"2024-09-13T17:11:48.792498+0000","last_peered":"2024-09-13T17:11:48.792498+0000","last_clean":"2024-09-13T17:11:48.792498+0000","last_became_active":"2024-09-13T17:11:23.336491+0000","last_became_peered":"2024-09-13T17:11:23.336491+0000","last_unstale":"2024-09-13T17:11:48.792498+0000","last_undegraded":"2024-09-13T17:11:48.792498+0000","last_fullsized":"2024-09-13T17:11:48.792498+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:02.045912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537823+0000","last_change":"2024-09-13T17:11:27.361454+0000","last_active":"2024-09-13T17:11:29.537823+0000","last_peered":"2024-09-13T17:11:29.537823+0000","last_clean":"2024-09-13T17:11:29.537823+0000","last_became_active":"2024-09-13T17:11:27.360980+0000","last_became_peered":"2024-09-13T17:11:27.360980+0000","last_unstale":"2024-09-13T17:11:29.537823+0000","last_undegraded":"2024-09-13T17:11:29.537823+0000","last_fullsized":"2024-09-13T17:11:29.537823+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:36.036426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.798015+0000","last_change":"2024-09-13T17:11:23.334073+0000","last_active":"2024-09-13T17:11:48.798015+0000","last_peered":"2024-09-13T17:11:48.798015+0000","last_clean":"2024-09-13T17:11:48.798015+0000","last_became_active":"2024-09-13T17:11:23.333628+0000","last_became_peered":"2024-09-13T17:11:23.333628+0000","last_unstale":"2024-09-13T17:11:48.798015+0000","last_undegraded":"2024-09-13T17:11:48.798015+0000","last_fullsized":"2024-09-13T17:11:48.798015+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:18.561346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.800163+0000","last_change":"2024-09-13T17:11:22.999115+0000","last_active":"2024-09-13T17:11:48.800163+0000","last_peered":"2024-09-13T17:11:48.800163+0000","last_clean":"2024-09-13T17:11:48.800163+0000","last_became_active":"2024-09-13T17:11:22.998798+0000","last_became_peered":"2024-09-13T17:11:22.998798+0000","last_unstale":"2024-09-13T17:11:48.800163+0000","last_undegraded":"2024-09-13T17:11:48.800163+0000","last_fullsized":"2024-09-13T17:11:48.800163+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:25.263755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537935+0000","last_change":"2024-09-13T17:11:27.355472+0000","last_active":"2024-09-13T17:11:29.537935+0000","last_peered":"2024-09-13T17:11:29.537935+0000","last_clean":"2024-09-13T17:11:29.537935+0000","last_became_active":"2024-09-13T17:11:27.355065+0000","last_became_peered":"2024-09-13T17:11:27.355065+0000","last_unstale":"2024-09-13T17:11:29.537935+0000","last_undegraded":"2024-09-13T17:11:29.537935+0000","last_fullsized":"2024-09-13T17:11:29.537935+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:03.881097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.793593+0000","last_change":"2024-09-13T17:11:23.340268+0000","last_active":"2024-09-13T17:11:48.793593+0000","last_peered":"2024-09-13T17:11:48.793593+0000","last_clean":"2024-09-13T17:11:48.793593+0000","last_became_active":"2024-09-13T17:11:23.339977+0000","last_became_peered":"2024-09-13T17:11:23.339977+0000","last_unstale":"2024-09-13T17:11:48.793593+0000","last_undegraded":"2024-09-13T17:11:48.793593+0000","last_fullsized":"2024-09-13T17:11:48.793593+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:21.067899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"90'1","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.565951+0000","last_change":"2024-09-13T17:11:23.000858+0000","last_active":"2024-09-13T17:11:49.565951+0000","last_peered":"2024-09-13T17:11:49.565951+0000","last_clean":"2024-09-13T17:11:49.565951+0000","last_became_active":"2024-09-13T17:11:23.000536+0000","last_became_peered":"2024-09-13T17:11:23.000536+0000","last_unstale":"2024-09-13T17:11:49.565951+0000","last_undegraded":"2024-09-13T17:11:49.565951+0000","last_fullsized":"2024-09-13T17:11:49.565951+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:28.798579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801541+0000","last_change":"2024-09-13T17:11:27.354018+0000","last_active":"2024-09-13T17:11:48.801541+0000","last_peered":"2024-09-13T17:11:48.801541+0000","last_clean":"2024-09-13T17:11:48.801541+0000","last_became_active":"2024-09-13T17:11:27.353519+0000","last_became_peered":"2024-09-13T17:11:27.353519+0000","last_unstale":"2024-09-13T17:11:48.801541+0000","last_undegraded":"2024-09-13T17:11:48.801541+0000","last_fullsized":"2024-09-13T17:11:48.801541+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:55.227851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801000+0000","last_change":"2024-09-13T17:11:23.335798+0000","last_active":"2024-09-13T17:11:48.801000+0000","last_peered":"2024-09-13T17:11:48.801000+0000","last_clean":"2024-09-13T17:11:48.801000+0000","last_became_active":"2024-09-13T17:11:23.335445+0000","last_became_peered":"2024-09-13T17:11:23.335445+0000","last_unstale":"2024-09-13T17:11:48.801000+0000","last_undegraded":"2024-09-13T17:11:48.801000+0000","last_fullsized":"2024-09-13T17:11:48.801000+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:53.242067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.793194+0000","last_change":"2024-09-13T17:11:22.994118+0000","last_active":"2024-09-13T17:11:48.793194+0000","last_peered":"2024-09-13T17:11:48.793194+0000","last_clean":"2024-09-13T17:11:48.793194+0000","last_became_active":"2024-09-13T17:11:22.993801+0000","last_became_peered":"2024-09-13T17:11:22.993801+0000","last_unstale":"2024-09-13T17:11:48.793194+0000","last_undegraded":"2024-09-13T17:11:48.793194+0000","last_fullsized":"2024-09-13T17:11:48.793194+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:01.382130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794642+0000","last_change":"2024-09-13T17:11:27.358795+0000","last_active":"2024-09-13T17:11:48.794642+0000","last_peered":"2024-09-13T17:11:48.794642+0000","last_clean":"2024-09-13T17:11:48.794642+0000","last_became_active":"2024-09-13T17:11:27.358166+0000","last_became_peered":"2024-09-13T17:11:27.358166+0000","last_unstale":"2024-09-13T17:11:48.794642+0000","last_undegraded":"2024-09-13T17:11:48.794642+0000","last_fullsized":"2024-09-13T17:11:48.794642+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:23.787842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799478+0000","last_change":"2024-09-13T17:11:23.340671+0000","last_active":"2024-09-13T17:11:48.799478+0000","last_peered":"2024-09-13T17:11:48.799478+0000","last_clean":"2024-09-13T17:11:48.799478+0000","last_became_active":"2024-09-13T17:11:23.340360+0000","last_became_peered":"2024-09-13T17:11:23.340360+0000","last_unstale":"2024-09-13T17:11:48.799478+0000","last_undegraded":"2024-09-13T17:11:48.799478+0000","last_fullsized":"2024-09-13T17:11:48.799478+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:17.875171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.791482+0000","last_change":"2024-09-13T17:11:22.993039+0000","last_active":"2024-09-13T17:11:48.791482+0000","last_peered":"2024-09-13T17:11:48.791482+0000","last_clean":"2024-09-13T17:11:48.791482+0000","last_became_active":"2024-09-13T17:11:22.992701+0000","last_became_peered":"2024-09-13T17:11:22.992701+0000","last_unstale":"2024-09-13T17:11:48.791482+0000","last_undegraded":"2024-09-13T17:11:48.791482+0000","last_fullsized":"2024-09-13T17:11:48.791482+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:28.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537946+0000","last_change":"2024-09-13T17:11:27.363834+0000","last_active":"2024-09-13T17:11:29.537946+0000","last_peered":"2024-09-13T17:11:29.537946+0000","last_clean":"2024-09-13T17:11:29.537946+0000","last_became_active":"2024-09-13T17:11:27.363425+0000","last_became_peered":"2024-09-13T17:11:27.363425+0000","last_unstale":"2024-09-13T17:11:29.537946+0000","last_undegraded":"2024-09-13T17:11:29.537946+0000","last_fullsized":"2024-09-13T17:11:29.537946+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:37.389881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832858+0000","last_change":"2024-09-13T17:11:23.337423+0000","last_active":"2024-09-13T17:11:27.832858+0000","last_peered":"2024-09-13T17:11:27.832858+0000","last_clean":"2024-09-13T17:11:27.832858+0000","last_became_active":"2024-09-13T17:11:23.337167+0000","last_became_peered":"2024-09-13T17:11:23.337167+0000","last_unstale":"2024-09-13T17:11:27.832858+0000","last_undegraded":"2024-09-13T17:11:27.832858+0000","last_fullsized":"2024-09-13T17:11:27.832858+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:28.540283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:46.175903+0000","last_change":"2024-09-13T17:11:23.000486+0000","last_active":"2024-09-13T17:11:46.175903+0000","last_peered":"2024-09-13T17:11:46.175903+0000","last_clean":"2024-09-13T17:11:46.175903+0000","last_became_active":"2024-09-13T17:11:23.000158+0000","last_became_peered":"2024-09-13T17:11:23.000158+0000","last_unstale":"2024-09-13T17:11:46.175903+0000","last_undegraded":"2024-09-13T17:11:46.175903+0000","last_fullsized":"2024-09-13T17:11:46.175903+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:42.635037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.802894+0000","last_change":"2024-09-13T17:11:27.355058+0000","last_active":"2024-09-13T17:11:48.802894+0000","last_peered":"2024-09-13T17:11:48.802894+0000","last_clean":"2024-09-13T17:11:48.802894+0000","last_became_active":"2024-09-13T17:11:27.354726+0000","last_became_peered":"2024-09-13T17:11:27.354726+0000","last_unstale":"2024-09-13T17:11:48.802894+0000","last_undegraded":"2024-09-13T17:11:48.802894+0000","last_fullsized":"2024-09-13T17:11:48.802894+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:58.450122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794550+0000","last_change":"2024-09-13T17:11:23.337245+0000","last_active":"2024-09-13T17:11:48.794550+0000","last_peered":"2024-09-13T17:11:48.794550+0000","last_clean":"2024-09-13T17:11:48.794550+0000","last_became_active":"2024-09-13T17:11:23.336956+0000","last_became_peered":"2024-09-13T17:11:23.336956+0000","last_unstale":"2024-09-13T17:11:48.794550+0000","last_undegraded":"2024-09-13T17:11:48.794550+0000","last_fullsized":"2024-09-13T17:11:48.794550+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:46.876149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.655818+0000","last_change":"2024-09-13T17:11:22.999942+0000","last_active":"2024-09-13T17:11:49.655818+0000","last_peered":"2024-09-13T17:11:49.655818+0000","last_clean":"2024-09-13T17:11:49.655818+0000","last_became_active":"2024-09-13T17:11:22.999653+0000","last_became_peered":"2024-09-13T17:11:22.999653+0000","last_unstale":"2024-09-13T17:11:49.655818+0000","last_undegraded":"2024-09-13T17:11:49.655818+0000","last_fullsized":"2024-09-13T17:11:49.655818+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:29.400939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792511+0000","last_change":"2024-09-13T17:11:27.356479+0000","last_active":"2024-09-13T17:11:48.792511+0000","last_peered":"2024-09-13T17:11:48.792511+0000","last_clean":"2024-09-13T17:11:48.792511+0000","last_became_active":"2024-09-13T17:11:27.356052+0000","last_became_peered":"2024-09-13T17:11:27.356052+0000","last_unstale":"2024-09-13T17:11:48.792511+0000","last_undegraded":"2024-09-13T17:11:48.792511+0000","last_fullsized":"2024-09-13T17:11:48.792511+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:42.173376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.790360+0000","last_change":"2024-09-13T17:11:23.333786+0000","last_active":"2024-09-13T17:11:48.790360+0000","last_peered":"2024-09-13T17:11:48.790360+0000","last_clean":"2024-09-13T17:11:48.790360+0000","last_became_active":"2024-09-13T17:11:23.333472+0000","last_became_peered":"2024-09-13T17:11:23.333472+0000","last_unstale":"2024-09-13T17:11:48.790360+0000","last_undegraded":"2024-09-13T17:11:48.790360+0000","last_fullsized":"2024-09-13T17:11:48.790360+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:41.633228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799918+0000","last_change":"2024-09-13T17:11:22.998646+0000","last_active":"2024-09-13T17:11:48.799918+0000","last_peered":"2024-09-13T17:11:48.799918+0000","last_clean":"2024-09-13T17:11:48.799918+0000","last_became_active":"2024-09-13T17:11:22.998291+0000","last_became_peered":"2024-09-13T17:11:22.998291+0000","last_unstale":"2024-09-13T17:11:48.799918+0000","last_undegraded":"2024-09-13T17:11:48.799918+0000","last_fullsized":"2024-09-13T17:11:48.799918+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:20.658436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801089+0000","last_change":"2024-09-13T17:11:27.361174+0000","last_active":"2024-09-13T17:11:48.801089+0000","last_peered":"2024-09-13T17:11:48.801089+0000","last_clean":"2024-09-13T17:11:48.801089+0000","last_became_active":"2024-09-13T17:11:27.360737+0000","last_became_peered":"2024-09-13T17:11:27.360737+0000","last_unstale":"2024-09-13T17:11:48.801089+0000","last_undegraded":"2024-09-13T17:11:48.801089+0000","last_fullsized":"2024-09-13T17:11:48.801089+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:00.941364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.834435+0000","last_change":"2024-09-13T17:11:23.338545+0000","last_active":"2024-09-13T17:11:27.834435+0000","last_peered":"2024-09-13T17:11:27.834435+0000","last_clean":"2024-09-13T17:11:27.834435+0000","last_became_active":"2024-09-13T17:11:23.338246+0000","last_became_peered":"2024-09-13T17:11:23.338246+0000","last_unstale":"2024-09-13T17:11:27.834435+0000","last_undegraded":"2024-09-13T17:11:27.834435+0000","last_fullsized":"2024-09-13T17:11:27.834435+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:18.966658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794795+0000","last_change":"2024-09-13T17:11:22.993497+0000","last_active":"2024-09-13T17:11:48.794795+0000","last_peered":"2024-09-13T17:11:48.794795+0000","last_clean":"2024-09-13T17:11:48.794795+0000","last_became_active":"2024-09-13T17:11:22.993165+0000","last_became_peered":"2024-09-13T17:11:22.993165+0000","last_unstale":"2024-09-13T17:11:48.794795+0000","last_undegraded":"2024-09-13T17:11:48.794795+0000","last_fullsized":"2024-09-13T17:11:48.794795+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:20.997834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799564+0000","last_change":"2024-09-13T17:11:27.364652+0000","last_active":"2024-09-13T17:11:48.799564+0000","last_peered":"2024-09-13T17:11:48.799564+0000","last_clean":"2024-09-13T17:11:48.799564+0000","last_became_active":"2024-09-13T17:11:27.364245+0000","last_became_peered":"2024-09-13T17:11:27.364245+0000","last_unstale":"2024-09-13T17:11:48.799564+0000","last_undegraded":"2024-09-13T17:11:48.799564+0000","last_fullsized":"2024-09-13T17:11:48.799564+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:23.048289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.834356+0000","last_change":"2024-09-13T17:11:23.335649+0000","last_active":"2024-09-13T17:11:27.834356+0000","last_peered":"2024-09-13T17:11:27.834356+0000","last_clean":"2024-09-13T17:11:27.834356+0000","last_became_active":"2024-09-13T17:11:23.335364+0000","last_became_peered":"2024-09-13T17:11:23.335364+0000","last_unstale":"2024-09-13T17:11:27.834356+0000","last_undegraded":"2024-09-13T17:11:27.834356+0000","last_fullsized":"2024-09-13T17:11:27.834356+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.447947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.798105+0000","last_change":"2024-09-13T17:11:23.003188+0000","last_active":"2024-09-13T17:11:48.798105+0000","last_peered":"2024-09-13T17:11:48.798105+0000","last_clean":"2024-09-13T17:11:48.798105+0000","last_became_active":"2024-09-13T17:11:23.002858+0000","last_became_peered":"2024-09-13T17:11:23.002858+0000","last_unstale":"2024-09-13T17:11:48.798105+0000","last_undegraded":"2024-09-13T17:11:48.798105+0000","last_fullsized":"2024-09-13T17:11:48.798105+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:34.153326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.790425+0000","last_change":"2024-09-13T17:11:27.353320+0000","last_active":"2024-09-13T17:11:48.790425+0000","last_peered":"2024-09-13T17:11:48.790425+0000","last_clean":"2024-09-13T17:11:48.790425+0000","last_became_active":"2024-09-13T17:11:27.352947+0000","last_became_peered":"2024-09-13T17:11:27.352947+0000","last_unstale":"2024-09-13T17:11:48.790425+0000","last_undegraded":"2024-09-13T17:11:48.790425+0000","last_fullsized":"2024-09-13T17:11:48.790425+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:04.619618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792636+0000","last_change":"2024-09-13T17:11:23.330128+0000","last_active":"2024-09-13T17:11:48.792636+0000","last_peered":"2024-09-13T17:11:48.792636+0000","last_clean":"2024-09-13T17:11:48.792636+0000","last_became_active":"2024-09-13T17:11:23.329266+0000","last_became_peered":"2024-09-13T17:11:23.329266+0000","last_unstale":"2024-09-13T17:11:48.792636+0000","last_undegraded":"2024-09-13T17:11:48.792636+0000","last_fullsized":"2024-09-13T17:11:48.792636+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:36.275352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'4","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.795578+0000","last_change":"2024-09-13T17:11:23.003495+0000","last_active":"2024-09-13T17:11:49.795578+0000","last_peered":"2024-09-13T17:11:49.795578+0000","last_clean":"2024-09-13T17:11:49.795578+0000","last_became_active":"2024-09-13T17:11:23.003186+0000","last_became_peered":"2024-09-13T17:11:23.003186+0000","last_unstale":"2024-09-13T17:11:49.795578+0000","last_undegraded":"2024-09-13T17:11:49.795578+0000","last_fullsized":"2024-09-13T17:11:49.795578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:23.353587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.790306+0000","last_change":"2024-09-13T17:11:27.362233+0000","last_active":"2024-09-13T17:11:48.790306+0000","last_peered":"2024-09-13T17:11:48.790306+0000","last_clean":"2024-09-13T17:11:48.790306+0000","last_became_active":"2024-09-13T17:11:27.361814+0000","last_became_peered":"2024-09-13T17:11:27.361814+0000","last_unstale":"2024-09-13T17:11:48.790306+0000","last_undegraded":"2024-09-13T17:11:48.790306+0000","last_fullsized":"2024-09-13T17:11:48.790306+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:20.723366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.789824+0000","last_change":"2024-09-13T17:11:23.332870+0000","last_active":"2024-09-13T17:11:48.789824+0000","last_peered":"2024-09-13T17:11:48.789824+0000","last_clean":"2024-09-13T17:11:48.789824+0000","last_became_active":"2024-09-13T17:11:23.332583+0000","last_became_peered":"2024-09-13T17:11:23.332583+0000","last_unstale":"2024-09-13T17:11:48.789824+0000","last_undegraded":"2024-09-13T17:11:48.789824+0000","last_fullsized":"2024-09-13T17:11:48.789824+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:22.607666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.796075+0000","last_change":"2024-09-13T17:11:23.001932+0000","last_active":"2024-09-13T17:11:48.796075+0000","last_peered":"2024-09-13T17:11:48.796075+0000","last_clean":"2024-09-13T17:11:48.796075+0000","last_became_active":"2024-09-13T17:11:23.001642+0000","last_became_peered":"2024-09-13T17:11:23.001642+0000","last_unstale":"2024-09-13T17:11:48.796075+0000","last_undegraded":"2024-09-13T17:11:48.796075+0000","last_fullsized":"2024-09-13T17:11:48.796075+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:05.976897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.793096+0000","last_change":"2024-09-13T17:11:27.359679+0000","last_active":"2024-09-13T17:11:48.793096+0000","last_peered":"2024-09-13T17:11:48.793096+0000","last_clean":"2024-09-13T17:11:48.793096+0000","last_became_active":"2024-09-13T17:11:27.359268+0000","last_became_peered":"2024-09-13T17:11:27.359268+0000","last_unstale":"2024-09-13T17:11:48.793096+0000","last_undegraded":"2024-09-13T17:11:48.793096+0000","last_fullsized":"2024-09-13T17:11:48.793096+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:48.154917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.793159+0000","last_change":"2024-09-13T17:11:23.340031+0000","last_active":"2024-09-13T17:11:48.793159+0000","last_peered":"2024-09-13T17:11:48.793159+0000","last_clean":"2024-09-13T17:11:48.793159+0000","last_became_active":"2024-09-13T17:11:23.339768+0000","last_became_peered":"2024-09-13T17:11:23.339768+0000","last_unstale":"2024-09-13T17:11:48.793159+0000","last_undegraded":"2024-09-13T17:11:48.793159+0000","last_fullsized":"2024-09-13T17:11:48.793159+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:22.360526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.788033+0000","last_change":"2024-09-13T17:11:22.995060+0000","last_active":"2024-09-13T17:11:47.788033+0000","last_peered":"2024-09-13T17:11:47.788033+0000","last_clean":"2024-09-13T17:11:47.788033+0000","last_became_active":"2024-09-13T17:11:22.991949+0000","last_became_peered":"2024-09-13T17:11:22.991949+0000","last_unstale":"2024-09-13T17:11:47.788033+0000","last_undegraded":"2024-09-13T17:11:47.788033+0000","last_fullsized":"2024-09-13T17:11:47.788033+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:44.716753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":340,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.796218+0000","last_change":"2024-09-13T17:10:13.439723+0000","last_active":"2024-09-13T17:11:48.796218+0000","last_peered":"2024-09-13T17:11:48.796218+0000","last_clean":"2024-09-13T17:11:48.796218+0000","last_became_active":"2024-09-13T17:10:13.439290+0000","last_became_peered":"2024-09-13T17:10:13.439290+0000","last_unstale":"2024-09-13T17:11:48.796218+0000","last_undegraded":"2024-09-13T17:11:48.796218+0000","last_fullsized":"2024-09-13T17:11:48.796218+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:03.041486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:03.041486+0000","last_clean_scrub_stamp":"2024-09-13T17:07:03.041486+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:08.673571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.798637+0000","last_change":"2024-09-13T17:11:27.361028+0000","last_active":"2024-09-13T17:11:48.798637+0000","last_peered":"2024-09-13T17:11:48.798637+0000","last_clean":"2024-09-13T17:11:48.798637+0000","last_became_active":"2024-09-13T17:11:27.360630+0000","last_became_peered":"2024-09-13T17:11:27.360630+0000","last_unstale":"2024-09-13T17:11:48.798637+0000","last_undegraded":"2024-09-13T17:11:48.798637+0000","last_fullsized":"2024-09-13T17:11:48.798637+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:40:40.860443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.798729+0000","last_change":"2024-09-13T17:11:49.798729+0000","last_active":"2024-09-13T17:11:49.798729+0000","last_peered":"2024-09-13T17:11:49.798729+0000","last_clean":"2024-09-13T17:11:49.798729+0000","last_became_active":"2024-09-13T17:11:49.798402+0000","last_became_peered":"2024-09-13T17:11:49.798402+0000","last_unstale":"2024-09-13T17:11:49.798729+0000","last_undegraded":"2024-09-13T17:11:49.798729+0000","last_fullsized":"2024-09-13T17:11:49.798729+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:58.948813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,11],"acting":[7,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":2,"reported_epoch":90,"state":"peering","last_fresh":"2024-09-13T17:11:27.684094+0000","last_change":"2024-09-13T17:11:49.540357+0000","last_active":"2024-09-13T17:11:49.540357+0000","last_peered":"2024-09-13T17:11:27.684094+0000","last_clean":"2024-09-13T17:11:27.684094+0000","last_became_active":"2024-09-13T17:11:23.003102+0000","last_became_peered":"2024-09-13T17:11:23.003102+0000","last_unstale":"2024-09-13T17:11:27.684094+0000","last_undegraded":"2024-09-13T17:11:27.684094+0000","last_fullsized":"2024-09-13T17:11:27.684094+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:08.827045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.791597+0000","last_change":"2024-09-13T17:11:27.360372+0000","last_active":"2024-09-13T17:11:48.791597+0000","last_peered":"2024-09-13T17:11:48.791597+0000","last_clean":"2024-09-13T17:11:48.791597+0000","last_became_active":"2024-09-13T17:11:27.359990+0000","last_became_peered":"2024-09-13T17:11:27.359990+0000","last_unstale":"2024-09-13T17:11:48.791597+0000","last_undegraded":"2024-09-13T17:11:48.791597+0000","last_fullsized":"2024-09-13T17:11:48.791597+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:26.970317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.795820+0000","last_change":"2024-09-13T17:11:23.336269+0000","last_active":"2024-09-13T17:11:48.795820+0000","last_peered":"2024-09-13T17:11:48.795820+0000","last_clean":"2024-09-13T17:11:48.795820+0000","last_became_active":"2024-09-13T17:11:23.335921+0000","last_became_peered":"2024-09-13T17:11:23.335921+0000","last_unstale":"2024-09-13T17:11:48.795820+0000","last_undegraded":"2024-09-13T17:11:48.795820+0000","last_fullsized":"2024-09-13T17:11:48.795820+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:43.035927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792688+0000","last_change":"2024-09-13T17:11:23.002491+0000","last_active":"2024-09-13T17:11:48.792688+0000","last_peered":"2024-09-13T17:11:48.792688+0000","last_clean":"2024-09-13T17:11:48.792688+0000","last_became_active":"2024-09-13T17:11:23.002178+0000","last_became_peered":"2024-09-13T17:11:23.002178+0000","last_unstale":"2024-09-13T17:11:48.792688+0000","last_undegraded":"2024-09-13T17:11:48.792688+0000","last_fullsized":"2024-09-13T17:11:48.792688+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:06.056639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.108773+0000","last_change":"2024-09-13T17:11:27.355153+0000","last_active":"2024-09-13T17:11:29.108773+0000","last_peered":"2024-09-13T17:11:29.108773+0000","last_clean":"2024-09-13T17:11:29.108773+0000","last_became_active":"2024-09-13T17:11:27.354701+0000","last_became_peered":"2024-09-13T17:11:27.354701+0000","last_unstale":"2024-09-13T17:11:29.108773+0000","last_undegraded":"2024-09-13T17:11:29.108773+0000","last_fullsized":"2024-09-13T17:11:29.108773+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:34.924402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.797409+0000","last_change":"2024-09-13T17:11:23.342067+0000","last_active":"2024-09-13T17:11:48.797409+0000","last_peered":"2024-09-13T17:11:48.797409+0000","last_clean":"2024-09-13T17:11:48.797409+0000","last_became_active":"2024-09-13T17:11:23.341736+0000","last_became_peered":"2024-09-13T17:11:23.341736+0000","last_unstale":"2024-09-13T17:11:48.797409+0000","last_undegraded":"2024-09-13T17:11:48.797409+0000","last_fullsized":"2024-09-13T17:11:48.797409+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:03.114638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.790455+0000","last_change":"2024-09-13T17:11:23.002849+0000","last_active":"2024-09-13T17:11:48.790455+0000","last_peered":"2024-09-13T17:11:48.790455+0000","last_clean":"2024-09-13T17:11:48.790455+0000","last_became_active":"2024-09-13T17:11:23.002562+0000","last_became_peered":"2024-09-13T17:11:23.002562+0000","last_unstale":"2024-09-13T17:11:48.790455+0000","last_undegraded":"2024-09-13T17:11:48.790455+0000","last_fullsized":"2024-09-13T17:11:48.790455+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:11:24.650510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.791707+0000","last_change":"2024-09-13T17:11:27.359343+0000","last_active":"2024-09-13T17:11:48.791707+0000","last_peered":"2024-09-13T17:11:48.791707+0000","last_clean":"2024-09-13T17:11:48.791707+0000","last_became_active":"2024-09-13T17:11:27.358628+0000","last_became_peered":"2024-09-13T17:11:27.358628+0000","last_unstale":"2024-09-13T17:11:48.791707+0000","last_undegraded":"2024-09-13T17:11:48.791707+0000","last_fullsized":"2024-09-13T17:11:48.791707+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:39.584184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801190+0000","last_change":"2024-09-13T17:11:23.333111+0000","last_active":"2024-09-13T17:11:48.801190+0000","last_peered":"2024-09-13T17:11:48.801190+0000","last_clean":"2024-09-13T17:11:48.801190+0000","last_became_active":"2024-09-13T17:11:23.332734+0000","last_became_peered":"2024-09-13T17:11:23.332734+0000","last_unstale":"2024-09-13T17:11:48.801190+0000","last_undegraded":"2024-09-13T17:11:48.801190+0000","last_fullsized":"2024-09-13T17:11:48.801190+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:44.628106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"91'2","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.794103+0000","last_change":"2024-09-13T17:11:23.000759+0000","last_active":"2024-09-13T17:11:49.794103+0000","last_peered":"2024-09-13T17:11:49.794103+0000","last_clean":"2024-09-13T17:11:49.794103+0000","last_became_active":"2024-09-13T17:11:23.000463+0000","last_became_peered":"2024-09-13T17:11:23.000463+0000","last_unstale":"2024-09-13T17:11:49.794103+0000","last_undegraded":"2024-09-13T17:11:49.794103+0000","last_fullsized":"2024-09-13T17:11:49.794103+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:59.077194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.791776+0000","last_change":"2024-09-13T17:11:27.363076+0000","last_active":"2024-09-13T17:11:48.791776+0000","last_peered":"2024-09-13T17:11:48.791776+0000","last_clean":"2024-09-13T17:11:48.791776+0000","last_became_active":"2024-09-13T17:11:27.362642+0000","last_became_peered":"2024-09-13T17:11:27.362642+0000","last_unstale":"2024-09-13T17:11:48.791776+0000","last_undegraded":"2024-09-13T17:11:48.791776+0000","last_fullsized":"2024-09-13T17:11:48.791776+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:25.494875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792014+0000","last_change":"2024-09-13T17:11:23.336703+0000","last_active":"2024-09-13T17:11:48.792014+0000","last_peered":"2024-09-13T17:11:48.792014+0000","last_clean":"2024-09-13T17:11:48.792014+0000","last_became_active":"2024-09-13T17:11:23.336349+0000","last_became_peered":"2024-09-13T17:11:23.336349+0000","last_unstale":"2024-09-13T17:11:48.792014+0000","last_undegraded":"2024-09-13T17:11:48.792014+0000","last_fullsized":"2024-09-13T17:11:48.792014+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:28.671438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799746+0000","last_change":"2024-09-13T17:11:22.994382+0000","last_active":"2024-09-13T17:11:48.799746+0000","last_peered":"2024-09-13T17:11:48.799746+0000","last_clean":"2024-09-13T17:11:48.799746+0000","last_became_active":"2024-09-13T17:11:22.994037+0000","last_became_peered":"2024-09-13T17:11:22.994037+0000","last_unstale":"2024-09-13T17:11:48.799746+0000","last_undegraded":"2024-09-13T17:11:48.799746+0000","last_fullsized":"2024-09-13T17:11:48.799746+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:10.763757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.790388+0000","last_change":"2024-09-13T17:11:27.354351+0000","last_active":"2024-09-13T17:11:48.790388+0000","last_peered":"2024-09-13T17:11:48.790388+0000","last_clean":"2024-09-13T17:11:48.790388+0000","last_became_active":"2024-09-13T17:11:27.353715+0000","last_became_peered":"2024-09-13T17:11:27.353715+0000","last_unstale":"2024-09-13T17:11:48.790388+0000","last_undegraded":"2024-09-13T17:11:48.790388+0000","last_fullsized":"2024-09-13T17:11:48.790388+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:18.335183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.795992+0000","last_change":"2024-09-13T17:11:23.341743+0000","last_active":"2024-09-13T17:11:48.795992+0000","last_peered":"2024-09-13T17:11:48.795992+0000","last_clean":"2024-09-13T17:11:48.795992+0000","last_became_active":"2024-09-13T17:11:23.341200+0000","last_became_peered":"2024-09-13T17:11:23.341200+0000","last_unstale":"2024-09-13T17:11:48.795992+0000","last_undegraded":"2024-09-13T17:11:48.795992+0000","last_fullsized":"2024-09-13T17:11:48.795992+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:41.854013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'3","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.800911+0000","last_change":"2024-09-13T17:11:22.997571+0000","last_active":"2024-09-13T17:11:48.800911+0000","last_peered":"2024-09-13T17:11:48.800911+0000","last_clean":"2024-09-13T17:11:48.800911+0000","last_became_active":"2024-09-13T17:11:22.997238+0000","last_became_peered":"2024-09-13T17:11:22.997238+0000","last_unstale":"2024-09-13T17:11:48.800911+0000","last_undegraded":"2024-09-13T17:11:48.800911+0000","last_fullsized":"2024-09-13T17:11:48.800911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:34.533004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794718+0000","last_change":"2024-09-13T17:11:27.356892+0000","last_active":"2024-09-13T17:11:48.794718+0000","last_peered":"2024-09-13T17:11:48.794718+0000","last_clean":"2024-09-13T17:11:48.794718+0000","last_became_active":"2024-09-13T17:11:27.356136+0000","last_became_peered":"2024-09-13T17:11:27.356136+0000","last_unstale":"2024-09-13T17:11:48.794718+0000","last_undegraded":"2024-09-13T17:11:48.794718+0000","last_fullsized":"2024-09-13T17:11:48.794718+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:23.207064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.796238+0000","last_change":"2024-09-13T17:11:23.337666+0000","last_active":"2024-09-13T17:11:48.796238+0000","last_peered":"2024-09-13T17:11:48.796238+0000","last_clean":"2024-09-13T17:11:48.796238+0000","last_became_active":"2024-09-13T17:11:23.337185+0000","last_became_peered":"2024-09-13T17:11:23.337185+0000","last_unstale":"2024-09-13T17:11:48.796238+0000","last_undegraded":"2024-09-13T17:11:48.796238+0000","last_fullsized":"2024-09-13T17:11:48.796238+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:51.266709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792201+0000","last_change":"2024-09-13T17:11:23.005075+0000","last_active":"2024-09-13T17:11:48.792201+0000","last_peered":"2024-09-13T17:11:48.792201+0000","last_clean":"2024-09-13T17:11:48.792201+0000","last_became_active":"2024-09-13T17:11:23.004778+0000","last_became_peered":"2024-09-13T17:11:23.004778+0000","last_unstale":"2024-09-13T17:11:48.792201+0000","last_undegraded":"2024-09-13T17:11:48.792201+0000","last_fullsized":"2024-09-13T17:11:48.792201+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:06.763552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801204+0000","last_change":"2024-09-13T17:11:27.353601+0000","last_active":"2024-09-13T17:11:48.801204+0000","last_peered":"2024-09-13T17:11:48.801204+0000","last_clean":"2024-09-13T17:11:48.801204+0000","last_became_active":"2024-09-13T17:11:27.353190+0000","last_became_peered":"2024-09-13T17:11:27.353190+0000","last_unstale":"2024-09-13T17:11:48.801204+0000","last_undegraded":"2024-09-13T17:11:48.801204+0000","last_fullsized":"2024-09-13T17:11:48.801204+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:24.645552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.799773+0000","last_change":"2024-09-13T17:11:49.799773+0000","last_active":"2024-09-13T17:11:49.799773+0000","last_peered":"2024-09-13T17:11:49.799773+0000","last_clean":"2024-09-13T17:11:49.799773+0000","last_became_active":"2024-09-13T17:11:49.799402+0000","last_became_peered":"2024-09-13T17:11:49.799402+0000","last_unstale":"2024-09-13T17:11:49.799773+0000","last_undegraded":"2024-09-13T17:11:49.799773+0000","last_fullsized":"2024-09-13T17:11:49.799773+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:37.230144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.803208+0000","last_change":"2024-09-13T17:11:23.005619+0000","last_active":"2024-09-13T17:11:48.803208+0000","last_peered":"2024-09-13T17:11:48.803208+0000","last_clean":"2024-09-13T17:11:48.803208+0000","last_became_active":"2024-09-13T17:11:23.005077+0000","last_became_peered":"2024-09-13T17:11:23.005077+0000","last_unstale":"2024-09-13T17:11:48.803208+0000","last_undegraded":"2024-09-13T17:11:48.803208+0000","last_fullsized":"2024-09-13T17:11:48.803208+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:51.739773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792374+0000","last_change":"2024-09-13T17:11:27.364603+0000","last_active":"2024-09-13T17:11:48.792374+0000","last_peered":"2024-09-13T17:11:48.792374+0000","last_clean":"2024-09-13T17:11:48.792374+0000","last_became_active":"2024-09-13T17:11:27.364226+0000","last_became_peered":"2024-09-13T17:11:27.364226+0000","last_unstale":"2024-09-13T17:11:48.792374+0000","last_undegraded":"2024-09-13T17:11:48.792374+0000","last_fullsized":"2024-09-13T17:11:48.792374+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:56.802016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799662+0000","last_change":"2024-09-13T17:11:23.338657+0000","last_active":"2024-09-13T17:11:48.799662+0000","last_peered":"2024-09-13T17:11:48.799662+0000","last_clean":"2024-09-13T17:11:48.799662+0000","last_became_active":"2024-09-13T17:11:23.338377+0000","last_became_peered":"2024-09-13T17:11:23.338377+0000","last_unstale":"2024-09-13T17:11:48.799662+0000","last_undegraded":"2024-09-13T17:11:48.799662+0000","last_fullsized":"2024-09-13T17:11:48.799662+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:52.412887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'23","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.114064+0000","last_change":"2024-09-13T17:11:22.998541+0000","last_active":"2024-09-13T17:11:49.114064+0000","last_peered":"2024-09-13T17:11:49.114064+0000","last_clean":"2024-09-13T17:11:49.114064+0000","last_became_active":"2024-09-13T17:11:22.998132+0000","last_became_peered":"2024-09-13T17:11:22.998132+0000","last_unstale":"2024-09-13T17:11:49.114064+0000","last_undegraded":"2024-09-13T17:11:49.114064+0000","last_fullsized":"2024-09-13T17:11:49.114064+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:16.777772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40425,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":26,"num_write":24,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794245+0000","last_change":"2024-09-13T17:11:27.361917+0000","last_active":"2024-09-13T17:11:48.794245+0000","last_peered":"2024-09-13T17:11:48.794245+0000","last_clean":"2024-09-13T17:11:48.794245+0000","last_became_active":"2024-09-13T17:11:27.361503+0000","last_became_peered":"2024-09-13T17:11:27.361503+0000","last_unstale":"2024-09-13T17:11:48.794245+0000","last_undegraded":"2024-09-13T17:11:48.794245+0000","last_fullsized":"2024-09-13T17:11:48.794245+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:52.959017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.798971+0000","last_change":"2024-09-13T17:11:49.798971+0000","last_active":"2024-09-13T17:11:49.798971+0000","last_peered":"2024-09-13T17:11:49.798971+0000","last_clean":"2024-09-13T17:11:49.798971+0000","last_became_active":"2024-09-13T17:11:49.798597+0000","last_became_peered":"2024-09-13T17:11:49.798597+0000","last_unstale":"2024-09-13T17:11:49.798971+0000","last_undegraded":"2024-09-13T17:11:49.798971+0000","last_fullsized":"2024-09-13T17:11:49.798971+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:41.886456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792661+0000","last_change":"2024-09-13T17:11:23.004059+0000","last_active":"2024-09-13T17:11:48.792661+0000","last_peered":"2024-09-13T17:11:48.792661+0000","last_clean":"2024-09-13T17:11:48.792661+0000","last_became_active":"2024-09-13T17:11:23.003248+0000","last_became_peered":"2024-09-13T17:11:23.003248+0000","last_unstale":"2024-09-13T17:11:48.792661+0000","last_undegraded":"2024-09-13T17:11:48.792661+0000","last_fullsized":"2024-09-13T17:11:48.792661+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:05.496872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537877+0000","last_change":"2024-09-13T17:11:27.362880+0000","last_active":"2024-09-13T17:11:29.537877+0000","last_peered":"2024-09-13T17:11:29.537877+0000","last_clean":"2024-09-13T17:11:29.537877+0000","last_became_active":"2024-09-13T17:11:27.362471+0000","last_became_peered":"2024-09-13T17:11:27.362471+0000","last_unstale":"2024-09-13T17:11:29.537877+0000","last_undegraded":"2024-09-13T17:11:29.537877+0000","last_fullsized":"2024-09-13T17:11:29.537877+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:49.964606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"peering","last_fresh":"2024-09-13T17:11:48.798762+0000","last_change":"2024-09-13T17:11:48.798906+0000","last_active":"2024-09-13T17:11:48.798762+0000","last_peered":"2024-09-13T17:11:27.833117+0000","last_clean":"2024-09-13T17:11:27.833117+0000","last_became_active":"2024-09-13T17:11:23.332871+0000","last_became_peered":"2024-09-13T17:11:23.332871+0000","last_unstale":"2024-09-13T17:11:48.798762+0000","last_undegraded":"2024-09-13T17:11:48.798762+0000","last_fullsized":"2024-09-13T17:11:48.798762+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:27.370999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,7],"acting":[0,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,5,7,8],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.795575+0000","last_change":"2024-09-13T17:11:22.999158+0000","last_active":"2024-09-13T17:11:48.795575+0000","last_peered":"2024-09-13T17:11:48.795575+0000","last_clean":"2024-09-13T17:11:48.795575+0000","last_became_active":"2024-09-13T17:11:22.998795+0000","last_became_peered":"2024-09-13T17:11:22.998795+0000","last_unstale":"2024-09-13T17:11:48.795575+0000","last_undegraded":"2024-09-13T17:11:48.795575+0000","last_fullsized":"2024-09-13T17:11:48.795575+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:23.880769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792383+0000","last_change":"2024-09-13T17:11:27.358105+0000","last_active":"2024-09-13T17:11:48.792383+0000","last_peered":"2024-09-13T17:11:48.792383+0000","last_clean":"2024-09-13T17:11:48.792383+0000","last_became_active":"2024-09-13T17:11:27.357740+0000","last_became_peered":"2024-09-13T17:11:27.357740+0000","last_unstale":"2024-09-13T17:11:48.792383+0000","last_undegraded":"2024-09-13T17:11:48.792383+0000","last_fullsized":"2024-09-13T17:11:48.792383+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:44.837353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792441+0000","last_change":"2024-09-13T17:11:23.338736+0000","last_active":"2024-09-13T17:11:48.792441+0000","last_peered":"2024-09-13T17:11:48.792441+0000","last_clean":"2024-09-13T17:11:48.792441+0000","last_became_active":"2024-09-13T17:11:23.338462+0000","last_became_peered":"2024-09-13T17:11:23.338462+0000","last_unstale":"2024-09-13T17:11:48.792441+0000","last_undegraded":"2024-09-13T17:11:48.792441+0000","last_fullsized":"2024-09-13T17:11:48.792441+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:49.221314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'3","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.800595+0000","last_change":"2024-09-13T17:11:23.001966+0000","last_active":"2024-09-13T17:11:48.800595+0000","last_peered":"2024-09-13T17:11:48.800595+0000","last_clean":"2024-09-13T17:11:48.800595+0000","last_became_active":"2024-09-13T17:11:23.001565+0000","last_became_peered":"2024-09-13T17:11:23.001565+0000","last_unstale":"2024-09-13T17:11:48.800595+0000","last_undegraded":"2024-09-13T17:11:48.800595+0000","last_fullsized":"2024-09-13T17:11:48.800595+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:47.240702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792942+0000","last_change":"2024-09-13T17:11:27.360896+0000","last_active":"2024-09-13T17:11:48.792942+0000","last_peered":"2024-09-13T17:11:48.792942+0000","last_clean":"2024-09-13T17:11:48.792942+0000","last_became_active":"2024-09-13T17:11:27.360552+0000","last_became_peered":"2024-09-13T17:11:27.360552+0000","last_unstale":"2024-09-13T17:11:48.792942+0000","last_undegraded":"2024-09-13T17:11:48.792942+0000","last_fullsized":"2024-09-13T17:11:48.792942+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:08.726724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.108810+0000","last_change":"2024-09-13T17:11:27.356317+0000","last_active":"2024-09-13T17:11:29.108810+0000","last_peered":"2024-09-13T17:11:29.108810+0000","last_clean":"2024-09-13T17:11:29.108810+0000","last_became_active":"2024-09-13T17:11:27.355863+0000","last_became_peered":"2024-09-13T17:11:27.355863+0000","last_unstale":"2024-09-13T17:11:29.108810+0000","last_undegraded":"2024-09-13T17:11:29.108810+0000","last_fullsized":"2024-09-13T17:11:29.108810+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:29.356048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.793992+0000","last_change":"2024-09-13T17:11:23.344929+0000","last_active":"2024-09-13T17:11:48.793992+0000","last_peered":"2024-09-13T17:11:48.793992+0000","last_clean":"2024-09-13T17:11:48.793992+0000","last_became_active":"2024-09-13T17:11:23.344627+0000","last_became_peered":"2024-09-13T17:11:23.344627+0000","last_unstale":"2024-09-13T17:11:48.793992+0000","last_undegraded":"2024-09-13T17:11:48.793992+0000","last_fullsized":"2024-09-13T17:11:48.793992+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:15.049627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792723+0000","last_change":"2024-09-13T17:11:23.002539+0000","last_active":"2024-09-13T17:11:48.792723+0000","last_peered":"2024-09-13T17:11:48.792723+0000","last_clean":"2024-09-13T17:11:48.792723+0000","last_became_active":"2024-09-13T17:11:23.002206+0000","last_became_peered":"2024-09-13T17:11:23.002206+0000","last_unstale":"2024-09-13T17:11:48.792723+0000","last_undegraded":"2024-09-13T17:11:48.792723+0000","last_fullsized":"2024-09-13T17:11:48.792723+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:57.708167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801253+0000","last_change":"2024-09-13T17:11:27.362667+0000","last_active":"2024-09-13T17:11:48.801253+0000","last_peered":"2024-09-13T17:11:48.801253+0000","last_clean":"2024-09-13T17:11:48.801253+0000","last_became_active":"2024-09-13T17:11:27.362293+0000","last_became_peered":"2024-09-13T17:11:27.362293+0000","last_unstale":"2024-09-13T17:11:48.801253+0000","last_undegraded":"2024-09-13T17:11:48.801253+0000","last_fullsized":"2024-09-13T17:11:48.801253+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:24.446951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.793137+0000","last_change":"2024-09-13T17:11:23.335823+0000","last_active":"2024-09-13T17:11:48.793137+0000","last_peered":"2024-09-13T17:11:48.793137+0000","last_clean":"2024-09-13T17:11:48.793137+0000","last_became_active":"2024-09-13T17:11:23.335491+0000","last_became_peered":"2024-09-13T17:11:23.335491+0000","last_unstale":"2024-09-13T17:11:48.793137+0000","last_undegraded":"2024-09-13T17:11:48.793137+0000","last_fullsized":"2024-09-13T17:11:48.793137+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:42.172559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.789870+0000","last_change":"2024-09-13T17:11:22.999477+0000","last_active":"2024-09-13T17:11:48.789870+0000","last_peered":"2024-09-13T17:11:48.789870+0000","last_clean":"2024-09-13T17:11:48.789870+0000","last_became_active":"2024-09-13T17:11:22.999175+0000","last_became_peered":"2024-09-13T17:11:22.999175+0000","last_unstale":"2024-09-13T17:11:48.789870+0000","last_undegraded":"2024-09-13T17:11:48.789870+0000","last_fullsized":"2024-09-13T17:11:48.789870+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:03.817508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.178558+0000","last_change":"2024-09-13T17:11:23.001737+0000","last_active":"2024-09-13T17:11:47.178558+0000","last_peered":"2024-09-13T17:11:47.178558+0000","last_clean":"2024-09-13T17:11:47.178558+0000","last_became_active":"2024-09-13T17:11:23.001296+0000","last_became_peered":"2024-09-13T17:11:23.001296+0000","last_unstale":"2024-09-13T17:11:47.178558+0000","last_undegraded":"2024-09-13T17:11:47.178558+0000","last_fullsized":"2024-09-13T17:11:47.178558+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:08.671244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792018+0000","last_change":"2024-09-13T17:11:23.337738+0000","last_active":"2024-09-13T17:11:48.792018+0000","last_peered":"2024-09-13T17:11:48.792018+0000","last_clean":"2024-09-13T17:11:48.792018+0000","last_became_active":"2024-09-13T17:11:23.337411+0000","last_became_peered":"2024-09-13T17:11:23.337411+0000","last_unstale":"2024-09-13T17:11:48.792018+0000","last_undegraded":"2024-09-13T17:11:48.792018+0000","last_fullsized":"2024-09-13T17:11:48.792018+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:02.355706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.803213+0000","last_change":"2024-09-13T17:11:27.363174+0000","last_active":"2024-09-13T17:11:48.803213+0000","last_peered":"2024-09-13T17:11:48.803213+0000","last_clean":"2024-09-13T17:11:48.803213+0000","last_became_active":"2024-09-13T17:11:27.362158+0000","last_became_peered":"2024-09-13T17:11:27.362158+0000","last_unstale":"2024-09-13T17:11:48.803213+0000","last_undegraded":"2024-09-13T17:11:48.803213+0000","last_fullsized":"2024-09-13T17:11:48.803213+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:49:52.892616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'6","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:50.806879+0000","last_change":"2024-09-13T17:11:23.000544+0000","last_active":"2024-09-13T17:11:50.806879+0000","last_peered":"2024-09-13T17:11:50.806879+0000","last_clean":"2024-09-13T17:11:50.806879+0000","last_became_active":"2024-09-13T17:11:23.000233+0000","last_became_peered":"2024-09-13T17:11:23.000233+0000","last_unstale":"2024-09-13T17:11:50.806879+0000","last_undegraded":"2024-09-13T17:11:50.806879+0000","last_fullsized":"2024-09-13T17:11:50.806879+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:04.745950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":966,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799756+0000","last_change":"2024-09-13T17:11:23.340104+0000","last_active":"2024-09-13T17:11:48.799756+0000","last_peered":"2024-09-13T17:11:48.799756+0000","last_clean":"2024-09-13T17:11:48.799756+0000","last_became_active":"2024-09-13T17:11:23.339826+0000","last_became_peered":"2024-09-13T17:11:23.339826+0000","last_unstale":"2024-09-13T17:11:48.799756+0000","last_undegraded":"2024-09-13T17:11:48.799756+0000","last_fullsized":"2024-09-13T17:11:48.799756+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:03.101547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.803194+0000","last_change":"2024-09-13T17:11:27.360848+0000","last_active":"2024-09-13T17:11:48.803194+0000","last_peered":"2024-09-13T17:11:48.803194+0000","last_clean":"2024-09-13T17:11:48.803194+0000","last_became_active":"2024-09-13T17:11:27.360416+0000","last_became_peered":"2024-09-13T17:11:27.360416+0000","last_unstale":"2024-09-13T17:11:48.803194+0000","last_undegraded":"2024-09-13T17:11:48.803194+0000","last_fullsized":"2024-09-13T17:11:48.803194+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:06.857649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.800926+0000","last_change":"2024-09-13T17:11:23.334723+0000","last_active":"2024-09-13T17:11:48.800926+0000","last_peered":"2024-09-13T17:11:48.800926+0000","last_clean":"2024-09-13T17:11:48.800926+0000","last_became_active":"2024-09-13T17:11:23.334433+0000","last_became_peered":"2024-09-13T17:11:23.334433+0000","last_unstale":"2024-09-13T17:11:48.800926+0000","last_undegraded":"2024-09-13T17:11:48.800926+0000","last_fullsized":"2024-09-13T17:11:48.800926+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:08.657151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.803139+0000","last_change":"2024-09-13T17:11:23.334882+0000","last_active":"2024-09-13T17:11:48.803139+0000","last_peered":"2024-09-13T17:11:48.803139+0000","last_clean":"2024-09-13T17:11:48.803139+0000","last_became_active":"2024-09-13T17:11:23.334610+0000","last_became_peered":"2024-09-13T17:11:23.334610+0000","last_unstale":"2024-09-13T17:11:48.803139+0000","last_undegraded":"2024-09-13T17:11:48.803139+0000","last_fullsized":"2024-09-13T17:11:48.803139+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:03.932181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.802945+0000","last_change":"2024-09-13T17:11:23.334076+0000","last_active":"2024-09-13T17:11:48.802945+0000","last_peered":"2024-09-13T17:11:48.802945+0000","last_clean":"2024-09-13T17:11:48.802945+0000","last_became_active":"2024-09-13T17:11:23.333801+0000","last_became_peered":"2024-09-13T17:11:23.333801+0000","last_unstale":"2024-09-13T17:11:48.802945+0000","last_undegraded":"2024-09-13T17:11:48.802945+0000","last_fullsized":"2024-09-13T17:11:48.802945+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:07.113045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832811+0000","last_change":"2024-09-13T17:11:23.332306+0000","last_active":"2024-09-13T17:11:27.832811+0000","last_peered":"2024-09-13T17:11:27.832811+0000","last_clean":"2024-09-13T17:11:27.832811+0000","last_became_active":"2024-09-13T17:11:23.331913+0000","last_became_peered":"2024-09-13T17:11:23.331913+0000","last_unstale":"2024-09-13T17:11:27.832811+0000","last_undegraded":"2024-09-13T17:11:27.832811+0000","last_fullsized":"2024-09-13T17:11:27.832811+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:02.927286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.790286+0000","last_change":"2024-09-13T17:11:23.335512+0000","last_active":"2024-09-13T17:11:48.790286+0000","last_peered":"2024-09-13T17:11:48.790286+0000","last_clean":"2024-09-13T17:11:48.790286+0000","last_became_active":"2024-09-13T17:11:23.335201+0000","last_became_peered":"2024-09-13T17:11:23.335201+0000","last_unstale":"2024-09-13T17:11:48.790286+0000","last_undegraded":"2024-09-13T17:11:48.790286+0000","last_fullsized":"2024-09-13T17:11:48.790286+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:17.263819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801579+0000","last_change":"2024-09-13T17:11:23.341204+0000","last_active":"2024-09-13T17:11:48.801579+0000","last_peered":"2024-09-13T17:11:48.801579+0000","last_clean":"2024-09-13T17:11:48.801579+0000","last_became_active":"2024-09-13T17:11:23.339848+0000","last_became_peered":"2024-09-13T17:11:23.339848+0000","last_unstale":"2024-09-13T17:11:48.801579+0000","last_undegraded":"2024-09-13T17:11:48.801579+0000","last_fullsized":"2024-09-13T17:11:48.801579+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:15:09.480651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.803495+0000","last_change":"2024-09-13T17:11:23.334741+0000","last_active":"2024-09-13T17:11:48.803495+0000","last_peered":"2024-09-13T17:11:48.803495+0000","last_clean":"2024-09-13T17:11:48.803495+0000","last_became_active":"2024-09-13T17:11:23.334459+0000","last_became_peered":"2024-09-13T17:11:23.334459+0000","last_unstale":"2024-09-13T17:11:48.803495+0000","last_undegraded":"2024-09-13T17:11:48.803495+0000","last_fullsized":"2024-09-13T17:11:48.803495+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:52.379735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794473+0000","last_change":"2024-09-13T17:11:23.337869+0000","last_active":"2024-09-13T17:11:48.794473+0000","last_peered":"2024-09-13T17:11:48.794473+0000","last_clean":"2024-09-13T17:11:48.794473+0000","last_became_active":"2024-09-13T17:11:23.337581+0000","last_became_peered":"2024-09-13T17:11:23.337581+0000","last_unstale":"2024-09-13T17:11:48.794473+0000","last_undegraded":"2024-09-13T17:11:48.794473+0000","last_fullsized":"2024-09-13T17:11:48.794473+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:49.407474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.798177+0000","last_change":"2024-09-13T17:11:49.797828+0000","last_active":"2024-09-13T17:11:49.798177+0000","last_peered":"2024-09-13T17:11:49.798177+0000","last_clean":"2024-09-13T17:11:49.798177+0000","last_became_active":"2024-09-13T17:11:49.797504+0000","last_became_peered":"2024-09-13T17:11:49.797504+0000","last_unstale":"2024-09-13T17:11:49.798177+0000","last_undegraded":"2024-09-13T17:11:49.798177+0000","last_fullsized":"2024-09-13T17:11:49.798177+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:29.677936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.793118+0000","last_change":"2024-09-13T17:11:23.336713+0000","last_active":"2024-09-13T17:11:48.793118+0000","last_peered":"2024-09-13T17:11:48.793118+0000","last_clean":"2024-09-13T17:11:48.793118+0000","last_became_active":"2024-09-13T17:11:23.336431+0000","last_became_peered":"2024-09-13T17:11:23.336431+0000","last_unstale":"2024-09-13T17:11:48.793118+0000","last_undegraded":"2024-09-13T17:11:48.793118+0000","last_fullsized":"2024-09-13T17:11:48.793118+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:52.709483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.791904+0000","last_change":"2024-09-13T17:11:23.340385+0000","last_active":"2024-09-13T17:11:48.791904+0000","last_peered":"2024-09-13T17:11:48.791904+0000","last_clean":"2024-09-13T17:11:48.791904+0000","last_became_active":"2024-09-13T17:11:23.340068+0000","last_became_peered":"2024-09-13T17:11:23.340068+0000","last_unstale":"2024-09-13T17:11:48.791904+0000","last_undegraded":"2024-09-13T17:11:48.791904+0000","last_fullsized":"2024-09-13T17:11:48.791904+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:17.795222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.790214+0000","last_change":"2024-09-13T17:11:23.329214+0000","last_active":"2024-09-13T17:11:48.790214+0000","last_peered":"2024-09-13T17:11:48.790214+0000","last_clean":"2024-09-13T17:11:48.790214+0000","last_became_active":"2024-09-13T17:11:23.328747+0000","last_became_peered":"2024-09-13T17:11:23.328747+0000","last_unstale":"2024-09-13T17:11:48.790214+0000","last_undegraded":"2024-09-13T17:11:48.790214+0000","last_fullsized":"2024-09-13T17:11:48.790214+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:11.233652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801419+0000","last_change":"2024-09-13T17:11:23.339854+0000","last_active":"2024-09-13T17:11:48.801419+0000","last_peered":"2024-09-13T17:11:48.801419+0000","last_clean":"2024-09-13T17:11:48.801419+0000","last_became_active":"2024-09-13T17:11:23.339565+0000","last_became_peered":"2024-09-13T17:11:23.339565+0000","last_unstale":"2024-09-13T17:11:48.801419+0000","last_undegraded":"2024-09-13T17:11:48.801419+0000","last_fullsized":"2024-09-13T17:11:48.801419+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:37.161135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.803426+0000","last_change":"2024-09-13T17:11:23.342562+0000","last_active":"2024-09-13T17:11:48.803426+0000","last_peered":"2024-09-13T17:11:48.803426+0000","last_clean":"2024-09-13T17:11:48.803426+0000","last_became_active":"2024-09-13T17:11:23.342256+0000","last_became_peered":"2024-09-13T17:11:23.342256+0000","last_unstale":"2024-09-13T17:11:48.803426+0000","last_undegraded":"2024-09-13T17:11:48.803426+0000","last_fullsized":"2024-09-13T17:11:48.803426+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:30.788242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.795154+0000","last_change":"2024-09-13T17:11:23.342436+0000","last_active":"2024-09-13T17:11:48.795154+0000","last_peered":"2024-09-13T17:11:48.795154+0000","last_clean":"2024-09-13T17:11:48.795154+0000","last_became_active":"2024-09-13T17:11:23.342157+0000","last_became_peered":"2024-09-13T17:11:23.342157+0000","last_unstale":"2024-09-13T17:11:48.795154+0000","last_undegraded":"2024-09-13T17:11:48.795154+0000","last_fullsized":"2024-09-13T17:11:48.795154+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:56.550875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801559+0000","last_change":"2024-09-13T17:11:23.341660+0000","last_active":"2024-09-13T17:11:48.801559+0000","last_peered":"2024-09-13T17:11:48.801559+0000","last_clean":"2024-09-13T17:11:48.801559+0000","last_became_active":"2024-09-13T17:11:23.341102+0000","last_became_peered":"2024-09-13T17:11:23.341102+0000","last_unstale":"2024-09-13T17:11:48.801559+0000","last_undegraded":"2024-09-13T17:11:48.801559+0000","last_fullsized":"2024-09-13T17:11:48.801559+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:00.546907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.791477+0000","last_change":"2024-09-13T17:11:23.338064+0000","last_active":"2024-09-13T17:11:48.791477+0000","last_peered":"2024-09-13T17:11:48.791477+0000","last_clean":"2024-09-13T17:11:48.791477+0000","last_became_active":"2024-09-13T17:11:23.337748+0000","last_became_peered":"2024-09-13T17:11:23.337748+0000","last_unstale":"2024-09-13T17:11:48.791477+0000","last_undegraded":"2024-09-13T17:11:48.791477+0000","last_fullsized":"2024-09-13T17:11:48.791477+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:14.281629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832520+0000","last_change":"2024-09-13T17:11:23.335684+0000","last_active":"2024-09-13T17:11:27.832520+0000","last_peered":"2024-09-13T17:11:27.832520+0000","last_clean":"2024-09-13T17:11:27.832520+0000","last_became_active":"2024-09-13T17:11:23.335364+0000","last_became_peered":"2024-09-13T17:11:23.335364+0000","last_unstale":"2024-09-13T17:11:27.832520+0000","last_undegraded":"2024-09-13T17:11:27.832520+0000","last_fullsized":"2024-09-13T17:11:27.832520+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:02.288009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832521+0000","last_change":"2024-09-13T17:11:23.340881+0000","last_active":"2024-09-13T17:11:27.832521+0000","last_peered":"2024-09-13T17:11:27.832521+0000","last_clean":"2024-09-13T17:11:27.832521+0000","last_became_active":"2024-09-13T17:11:23.340575+0000","last_became_peered":"2024-09-13T17:11:23.340575+0000","last_unstale":"2024-09-13T17:11:27.832521+0000","last_undegraded":"2024-09-13T17:11:27.832521+0000","last_fullsized":"2024-09-13T17:11:27.832521+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:40.757703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.790161+0000","last_change":"2024-09-13T17:11:23.329039+0000","last_active":"2024-09-13T17:11:48.790161+0000","last_peered":"2024-09-13T17:11:48.790161+0000","last_clean":"2024-09-13T17:11:48.790161+0000","last_became_active":"2024-09-13T17:11:23.328324+0000","last_became_peered":"2024-09-13T17:11:23.328324+0000","last_unstale":"2024-09-13T17:11:48.790161+0000","last_undegraded":"2024-09-13T17:11:48.790161+0000","last_fullsized":"2024-09-13T17:11:48.790161+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:37.882596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.833586+0000","last_change":"2024-09-13T17:11:23.345229+0000","last_active":"2024-09-13T17:11:27.833586+0000","last_peered":"2024-09-13T17:11:27.833586+0000","last_clean":"2024-09-13T17:11:27.833586+0000","last_became_active":"2024-09-13T17:11:23.344883+0000","last_became_peered":"2024-09-13T17:11:23.344883+0000","last_unstale":"2024-09-13T17:11:27.833586+0000","last_undegraded":"2024-09-13T17:11:27.833586+0000","last_fullsized":"2024-09-13T17:11:27.833586+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:47.983382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799023+0000","last_change":"2024-09-13T17:11:23.346338+0000","last_active":"2024-09-13T17:11:48.799023+0000","last_peered":"2024-09-13T17:11:48.799023+0000","last_clean":"2024-09-13T17:11:48.799023+0000","last_became_active":"2024-09-13T17:11:23.344777+0000","last_became_peered":"2024-09-13T17:11:23.344777+0000","last_unstale":"2024-09-13T17:11:48.799023+0000","last_undegraded":"2024-09-13T17:11:48.799023+0000","last_fullsized":"2024-09-13T17:11:48.799023+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:23.650174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"peering","last_fresh":"2024-09-13T17:11:48.800882+0000","last_change":"2024-09-13T17:11:48.801055+0000","last_active":"2024-09-13T17:11:48.800882+0000","last_peered":"2024-09-13T17:11:27.834681+0000","last_clean":"2024-09-13T17:11:27.834681+0000","last_became_active":"2024-09-13T17:11:23.334660+0000","last_became_peered":"2024-09-13T17:11:23.334660+0000","last_unstale":"2024-09-13T17:11:48.800882+0000","last_undegraded":"2024-09-13T17:11:48.800882+0000","last_fullsized":"2024-09-13T17:11:48.800882+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:32.110092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,4,9],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.791755+0000","last_change":"2024-09-13T17:11:23.340478+0000","last_active":"2024-09-13T17:11:48.791755+0000","last_peered":"2024-09-13T17:11:48.791755+0000","last_clean":"2024-09-13T17:11:48.791755+0000","last_became_active":"2024-09-13T17:11:23.339916+0000","last_became_peered":"2024-09-13T17:11:23.339916+0000","last_unstale":"2024-09-13T17:11:48.791755+0000","last_undegraded":"2024-09-13T17:11:48.791755+0000","last_fullsized":"2024-09-13T17:11:48.791755+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:09.477626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.793059+0000","last_change":"2024-09-13T17:11:23.340882+0000","last_active":"2024-09-13T17:11:48.793059+0000","last_peered":"2024-09-13T17:11:48.793059+0000","last_clean":"2024-09-13T17:11:48.793059+0000","last_became_active":"2024-09-13T17:11:23.340413+0000","last_became_peered":"2024-09-13T17:11:23.340413+0000","last_unstale":"2024-09-13T17:11:48.793059+0000","last_undegraded":"2024-09-13T17:11:48.793059+0000","last_fullsized":"2024-09-13T17:11:48.793059+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:49.040015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.796753+0000","last_change":"2024-09-13T17:11:23.345551+0000","last_active":"2024-09-13T17:11:48.796753+0000","last_peered":"2024-09-13T17:11:48.796753+0000","last_clean":"2024-09-13T17:11:48.796753+0000","last_became_active":"2024-09-13T17:11:23.345195+0000","last_became_peered":"2024-09-13T17:11:23.345195+0000","last_unstale":"2024-09-13T17:11:48.796753+0000","last_undegraded":"2024-09-13T17:11:48.796753+0000","last_fullsized":"2024-09-13T17:11:48.796753+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:00.856969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"peering","last_fresh":"2024-09-13T17:11:48.799086+0000","last_change":"2024-09-13T17:11:48.799241+0000","last_active":"2024-09-13T17:11:48.799086+0000","last_peered":"2024-09-13T17:11:27.834170+0000","last_clean":"2024-09-13T17:11:27.834170+0000","last_became_active":"2024-09-13T17:11:23.334061+0000","last_became_peered":"2024-09-13T17:11:23.334061+0000","last_unstale":"2024-09-13T17:11:48.799086+0000","last_undegraded":"2024-09-13T17:11:48.799086+0000","last_fullsized":"2024-09-13T17:11:48.799086+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:40.383855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,7,9],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799582+0000","last_change":"2024-09-13T17:11:23.340286+0000","last_active":"2024-09-13T17:11:48.799582+0000","last_peered":"2024-09-13T17:11:48.799582+0000","last_clean":"2024-09-13T17:11:48.799582+0000","last_became_active":"2024-09-13T17:11:23.339756+0000","last_became_peered":"2024-09-13T17:11:23.339756+0000","last_unstale":"2024-09-13T17:11:48.799582+0000","last_undegraded":"2024-09-13T17:11:48.799582+0000","last_fullsized":"2024-09-13T17:11:48.799582+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:00.463087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.833501+0000","last_change":"2024-09-13T17:11:23.339818+0000","last_active":"2024-09-13T17:11:27.833501+0000","last_peered":"2024-09-13T17:11:27.833501+0000","last_clean":"2024-09-13T17:11:27.833501+0000","last_became_active":"2024-09-13T17:11:23.339501+0000","last_became_peered":"2024-09-13T17:11:23.339501+0000","last_unstale":"2024-09-13T17:11:27.833501+0000","last_undegraded":"2024-09-13T17:11:27.833501+0000","last_fullsized":"2024-09-13T17:11:27.833501+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:36.904004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832723+0000","last_change":"2024-09-13T17:11:23.334388+0000","last_active":"2024-09-13T17:11:27.832723+0000","last_peered":"2024-09-13T17:11:27.832723+0000","last_clean":"2024-09-13T17:11:27.832723+0000","last_became_active":"2024-09-13T17:11:23.333953+0000","last_became_peered":"2024-09-13T17:11:23.333953+0000","last_unstale":"2024-09-13T17:11:27.832723+0000","last_undegraded":"2024-09-13T17:11:27.832723+0000","last_fullsized":"2024-09-13T17:11:27.832723+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:33.929173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832701+0000","last_change":"2024-09-13T17:11:23.338259+0000","last_active":"2024-09-13T17:11:27.832701+0000","last_peered":"2024-09-13T17:11:27.832701+0000","last_clean":"2024-09-13T17:11:27.832701+0000","last_became_active":"2024-09-13T17:11:23.337979+0000","last_became_peered":"2024-09-13T17:11:23.337979+0000","last_unstale":"2024-09-13T17:11:27.832701+0000","last_undegraded":"2024-09-13T17:11:27.832701+0000","last_fullsized":"2024-09-13T17:11:27.832701+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:55.750255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801517+0000","last_change":"2024-09-13T17:11:23.337899+0000","last_active":"2024-09-13T17:11:48.801517+0000","last_peered":"2024-09-13T17:11:48.801517+0000","last_clean":"2024-09-13T17:11:48.801517+0000","last_became_active":"2024-09-13T17:11:23.337626+0000","last_became_peered":"2024-09-13T17:11:23.337626+0000","last_unstale":"2024-09-13T17:11:48.801517+0000","last_undegraded":"2024-09-13T17:11:48.801517+0000","last_fullsized":"2024-09-13T17:11:48.801517+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:14.654852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":44331,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":37,"num_read_kb":49,"num_write":143,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":142811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285958,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383698,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":995328,"data_stored":499901,"data_compressed":17667,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.35499999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.497}]},{"osd":2,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.58199999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.41799999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.50900000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.67700000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":9,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.52000000000000002}]},{"osd":10,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.60599999999999998}]}]},{"osd":10,"up_from":72,"seq":309237645334,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":1105920,"data_stored":1118312,"data_compressed":51052,"data_compressed_allocated":65536,"data_compressed_original":630784,"omap_allocated":1597,"internal_metadata":36043203},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.52200000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.374},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.39700000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.624},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.60899999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.54500000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.443}]},{"osd":6,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.70999999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.51200000000000001}]},{"osd":8,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.50900000000000001}]},{"osd":9,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.67500000000000004}]},{"osd":11,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.746}]}]},{"osd":9,"up_from":67,"seq":287762808859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":1015808,"data_stored":504233,"data_compressed":17667,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1597,"internal_metadata":31848899},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.39700000000000002,"15min":0.40699999999999997},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.311},{"interface":"front","average":{"1min":0.37,"5min":0.41799999999999998,"15min":0.42599999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.55700000000000005,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.33300000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54400000000000004,"15min":0.54700000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.67700000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56100000000000005,"15min":0.56799999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.67800000000000005,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.58399999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.59399999999999997,"15min":0.60799999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.66400000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.58099999999999996,"15min":0.59199999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.755,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.53100000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.48699999999999999,"15min":0.501},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.64300000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.378,"5min":0.49399999999999999,"15min":0.51300000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.58499999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.40100000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.39900000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76500000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.505},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.63,"15min":0.64200000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.78300000000000003,"5min":1.26,"15min":1.26},"last":0.65100000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.64400000000000002,"15min":0.66000000000000003},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.69599999999999995,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.64900000000000002,"15min":0.66900000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68200000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.59599999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.49299999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.68400000000000005,"15min":0.69899999999999995},"min":{"1min":0.46200000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.85499999999999998,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.68500000000000005,"15min":0.70099999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.78700000000000003,"5min":1.018,"15min":1.018},"last":0.624}]},{"osd":8,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.67700000000000005,"15min":0.68899999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.86499999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.622,"5min":0.70599999999999996,"15min":0.71999999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.84799999999999998,"5min":1.228,"15min":1.228},"last":0.57399999999999995}]},{"osd":10,"last update":"Fri Sep 13 17:11:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.68100000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]}]},{"osd":8,"up_from":59,"seq":253403070497,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":500057,"data_compressed":17667,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67600000000000005,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.65500000000000003,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.67500000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54300000000000004,"15min":0.54400000000000004},"min":{"1min":0.34599999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71799999999999997,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.79900000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.41899999999999998,"15min":0.41799999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.63100000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.441,"15min":0.438},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70899999999999996,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.68999999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.73899999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.81299999999999994}]},{"osd":5,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.753},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53400000000000003,"15min":0.53600000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76700000000000002,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.78000000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.64400000000000002,"15min":0.64900000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.85999999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64700000000000002,"15min":0.64600000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92200000000000004,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90900000000000003,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.94999999999999996}]},{"osd":9,"last update":"Fri Sep 13 17:10:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.873},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.84699999999999998}]},{"osd":10,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.92900000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]}]},{"osd":7,"up_from":51,"seq":219043332133,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1060864,"data_stored":1095871,"data_compressed":54026,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1587,"internal_metadata":27654605},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.39700000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.66200000000000003,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.35799999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.52500000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.35999999999999999,"15min":0.35399999999999998},"min":{"1min":0.25800000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.34999999999999998,"15min":0.34399999999999997},"min":{"1min":0.32200000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.312}]},{"osd":2,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52800000000000002,"15min":0.52100000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.51400000000000001,"15min":0.50700000000000001},"min":{"1min":0.39100000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.59499999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.51000000000000001,"15min":0.502},"min":{"1min":0.38100000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67500000000000004,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.497},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.53400000000000003},"min":{"1min":0.42899999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.47299999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46200000000000002,"15min":0.45700000000000002},"min":{"1min":0.29899999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.442,"15min":0.439},"min":{"1min":0.31900000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.33800000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.56899999999999995,"15min":0.56200000000000006},"min":{"1min":0.5,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57499999999999996,"15min":0.57199999999999995},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.57099999999999995}]},{"osd":6,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.44700000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.59799999999999998,"15min":0.58699999999999997},"min":{"1min":0.45600000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.46000000000000002}]},{"osd":8,"last update":"Fri Sep 13 17:11:31 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.63600000000000001,"15min":0.628},"min":{"1min":0.504,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.65300000000000002,"15min":0.64200000000000002},"min":{"1min":0.47899999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.66200000000000003}]},{"osd":9,"last update":"Fri Sep 13 17:11:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.68400000000000005,"15min":0.68799999999999994},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84799999999999998,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.438}]},{"osd":10,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.624}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]},{"osd":6,"up_from":46,"seq":197568495657,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":495313,"data_compressed":17667,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.34200000000000003,"15min":0.33500000000000002},"min":{"1min":0.23400000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.373,"15min":0.36899999999999999},"min":{"1min":0.26500000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.57399999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.41499999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.74199999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.63600000000000001,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.52900000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68999999999999995,"5min":1.095,"15min":1.095},"last":0.501},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54100000000000004,"15min":0.52600000000000002},"min":{"1min":0.35899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.77300000000000002,"5min":0.877,"15min":0.877},"last":0.51400000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.42199999999999999,"15min":0.41599999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.626,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.378},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41799999999999998,"15min":0.41199999999999998},"min":{"1min":0.28199999999999997,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58599999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.435}]},{"osd":4,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51000000000000001,"15min":0.502},"min":{"1min":0.41199999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71699999999999997,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.39200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76100000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.56200000000000006}]},{"osd":5,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.70599999999999996,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59599999999999997,"15min":0.60299999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.73999999999999999,"5min":1.131,"15min":1.131},"last":0.46100000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.62}]},{"osd":8,"last update":"Fri Sep 13 17:11:28 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.623,"15min":0.627},"min":{"1min":0.42399999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.85899999999999999,"5min":0.874,"15min":0.874},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.58099999999999996}]},{"osd":9,"last update":"Fri Sep 13 17:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.59099999999999997}]},{"osd":10,"last update":"Fri Sep 13 17:11:12 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.72099999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":5,"up_from":38,"seq":163208757294,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":1064960,"data_stored":1091176,"data_compressed":54026,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48399999999999999,"15min":0.47599999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67300000000000004,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48799999999999999,"15min":0.47999999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69499999999999995,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.5}]},{"osd":1,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55100000000000005,"15min":0.54400000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68600000000000005,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.371,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.67600000000000005,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.57099999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.377,"15min":0.371},"min":{"1min":0.23499999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.58699999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.374},{"interface":"front","average":{"1min":0.375,"5min":0.378,"15min":0.372},"min":{"1min":0.253,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.59099999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.33600000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50700000000000001,"15min":0.501},"min":{"1min":0.30199999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.69599999999999995,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.63800000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.47499999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73099999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56999999999999995,"15min":0.56000000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.63600000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:11:41 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56100000000000005,"15min":0.56000000000000005},"min":{"1min":0.39100000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.74199999999999999,"5min":0.749,"15min":0.749},"last":0.51700000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.46400000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.75},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.44,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.70399999999999996}]},{"osd":8,"last update":"Fri Sep 13 17:11:26 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52500000000000002,"15min":0.53100000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69199999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.622},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55800000000000005,"15min":0.56599999999999995},"min":{"1min":0.39800000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.70299999999999996,"5min":0.747,"15min":0.747},"last":0.56299999999999994}]},{"osd":9,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.624,"15min":0.62},"min":{"1min":0.47699999999999998,"5min":0.442,"15min":0.442},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.62,"15min":0.61499999999999999},"min":{"1min":0.45800000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.65300000000000002}]},{"osd":10,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.73699999999999999}]}]},{"osd":4,"up_from":33,"seq":141733920819,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36176,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708976,"statfs":{"total":95995035648,"available":95957991424,"internally_reserved":0,"allocated":987136,"data_stored":490408,"data_compressed":14693,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":0.71699999999999997,"15min":0.59099999999999997},"min":{"1min":0.42399999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":15.369999999999999,"5min":15.369999999999999,"15min":15.369999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":1.4950000000000001,"5min":0.68200000000000005,"15min":0.54400000000000004},"min":{"1min":0.45900000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":15.416,"5min":15.416,"15min":15.416},"last":0.35399999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.36499999999999999,"15min":0.35899999999999999},"min":{"1min":0.25900000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38600000000000001},"min":{"1min":0.28699999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.60099999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.34799999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":0.74099999999999999,"15min":0.61699999999999999},"min":{"1min":0.379,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":15.401,"5min":15.401,"15min":15.401},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.52900000000000003,"15min":0.51900000000000002},"min":{"1min":0.39500000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.745,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.47599999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53900000000000003,"15min":0.54900000000000004},"min":{"1min":0.375,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76900000000000002,"5min":1.016,"15min":1.016},"last":0.39100000000000001},{"interface":"front","average":{"1min":1.524,"5min":0.74099999999999999,"15min":0.61699999999999999},"min":{"1min":0.39400000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":15.425000000000001,"5min":15.425000000000001,"15min":15.425000000000001},"last":0.40699999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57299999999999995,"15min":0.56399999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77900000000000003,"5min":1.073,"15min":1.073},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.73399999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.53500000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.54800000000000004,"15min":0.51800000000000002},"min":{"1min":0.40200000000000002,"5min":0.371,"15min":0.371},"max":{"1min":2.6469999999999998,"5min":2.6469999999999998,"15min":2.6469999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57599999999999996,"15min":0.55600000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.45400000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:11:00 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48199999999999998,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69399999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.48299999999999998,"15min":0.47899999999999998},"min":{"1min":0.34399999999999997,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.49399999999999999}]},{"osd":8,"last update":"Fri Sep 13 17:11:26 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.65200000000000002,"15min":0.63900000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.577,"5min":2.577,"15min":2.577},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.65500000000000003,"15min":0.64600000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.60299999999999998}]},{"osd":9,"last update":"Fri Sep 13 17:10:49 2024","interfaces":[{"interface":"back","average":{"1min":1.615,"5min":1.615,"15min":1.615},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":15.448,"5min":15.448,"15min":15.448},"last":0.55500000000000005},{"interface":"front","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":15.385,"5min":15.385,"15min":15.385},"last":0.63}]},{"osd":10,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.51100000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]},{"osd":3,"up_from":25,"seq":107374182455,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":983040,"data_stored":485669,"data_compressed":14693,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34000000000000002,"15min":0.317},"min":{"1min":0.22500000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.34399999999999997,"15min":0.32200000000000001},"min":{"1min":0.23899999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.60899999999999999,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.40799999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52400000000000002,"15min":0.49399999999999999},"min":{"1min":0.32900000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78900000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51200000000000001,"15min":0.48299999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.60999999999999999,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.625}]},{"osd":2,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51500000000000001,"15min":0.496},"min":{"1min":0.34000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67800000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53800000000000003,"15min":0.50700000000000001},"min":{"1min":0.34200000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.73999999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.495}]},{"osd":4,"last update":"Fri Sep 13 17:10:55 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.53000000000000003,"15min":0.51400000000000001},"min":{"1min":0.372,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.53200000000000003,"15min":0.50700000000000001},"min":{"1min":0.40500000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.54800000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55900000000000005,"15min":0.55400000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70399999999999996,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.56000000000000005,"15min":0.56100000000000005},"min":{"1min":0.35199999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.754,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.47399999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:11:43 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.45200000000000001,"15min":0.44600000000000001},"min":{"1min":0.28199999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68000000000000005,"5min":0.746,"15min":0.746},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.45700000000000002,"15min":0.443},"min":{"1min":0.29499999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70199999999999996,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.46400000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:11:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58399999999999996,"15min":0.57799999999999996},"min":{"1min":0.42599999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.77500000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.45500000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.68500000000000005}]},{"osd":8,"last update":"Fri Sep 13 17:10:26 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66400000000000003}]},{"osd":9,"last update":"Fri Sep 13 17:11:49 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.625,"15min":0.63500000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.80100000000000005,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.63300000000000001,"15min":0.65200000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78800000000000003,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.52300000000000002}]},{"osd":10,"last update":"Fri Sep 13 17:11:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.65300000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":2,"up_from":18,"seq":77309411389,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":541687,"data_compressed":17667,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:09 2024","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":0.76600000000000001,"15min":0.73999999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":19.158999999999999,"5min":19.158999999999999,"15min":19.158999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.47599999999999998,"15min":0.46700000000000003},"min":{"1min":0.33700000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68500000000000005,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.75800000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:11:09 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.501,"15min":0.47499999999999998},"min":{"1min":0.38,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68600000000000005,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.498,"15min":0.46800000000000003},"min":{"1min":0.40100000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.54900000000000004}]},{"osd":3,"last update":"Fri Sep 13 17:11:36 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.51900000000000002,"15min":0.5},"min":{"1min":0.41299999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52700000000000002,"15min":0.50600000000000001},"min":{"1min":0.42999999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71899999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.79900000000000004}]},{"osd":4,"last update":"Fri Sep 13 17:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.51100000000000001},"min":{"1min":0.41499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72199999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.40300000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.65800000000000003,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.52800000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:11:14 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.39900000000000002,"15min":0.39100000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.64500000000000002,"5min":0.747,"15min":0.747},"last":0.374},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39800000000000002,"15min":0.39200000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.68799999999999994,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.41899999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:11:38 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54000000000000004},"min":{"1min":0.41699999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68300000000000005,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.746},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.69799999999999995,"15min":0.58699999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82499999999999996,"5min":19.276,"15min":19.276},"last":0.73399999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.36699999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76200000000000001,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.41699999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76600000000000001,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.61499999999999999}]},{"osd":8,"last update":"Fri Sep 13 17:11:25 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53700000000000003,"15min":0.53500000000000003},"min":{"1min":0.33100000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76000000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56399999999999995,"15min":0.56100000000000005},"min":{"1min":0.35799999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.70999999999999996}]},{"osd":9,"last update":"Fri Sep 13 17:11:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64400000000000002,"15min":0.63600000000000001},"min":{"1min":0.377,"5min":0.373,"15min":0.373},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":1.294,"15min":1.3939999999999999},"min":{"1min":0.436,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0409999999999999,"5min":19.210999999999999,"15min":19.210999999999999},"last":0.77300000000000002}]},{"osd":10,"last update":"Fri Sep 13 17:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":1.595,"5min":1.595,"15min":1.595},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":19.242000000000001,"5min":19.242000000000001,"15min":19.242000000000001},"last":0.78700000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":1024000,"data_stored":526414,"data_compressed":14693,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:53 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.47799999999999998,"15min":0.46200000000000002},"min":{"1min":0.35199999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.48199999999999998,"15min":0.46500000000000002},"min":{"1min":0.32700000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.48199999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:11:08 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.52800000000000002,"15min":0.504},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.76900000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.52100000000000002,"15min":0.503},"min":{"1min":0.375,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.64900000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:11:37 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70599999999999996,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54700000000000004,"15min":0.52800000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70299999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.52100000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:10:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.39500000000000002,"15min":0.377},"min":{"1min":0.29199999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.62},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.38100000000000001,"15min":0.36299999999999999},"min":{"1min":0.26600000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:11:21 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.52900000000000003,"15min":0.51300000000000001},"min":{"1min":0.35399999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.52600000000000002,"15min":0.502},"min":{"1min":0.39900000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.70099999999999996}]},{"osd":6,"last update":"Fri Sep 13 17:11:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54000000000000004,"15min":0.52400000000000002},"min":{"1min":0.38500000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73199999999999998,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.59499999999999997,"15min":0.57499999999999996},"min":{"1min":0.45700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.82799999999999996,"5min":0.88,"15min":0.88},"last":0.66000000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:11:00 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.48999999999999999,"15min":0.47599999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.49399999999999999,"15min":0.48399999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.56000000000000005}]},{"osd":8,"last update":"Fri Sep 13 17:11:26 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.626,"15min":0.61699999999999999},"min":{"1min":0.41599999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.754},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.67300000000000004,"15min":0.66300000000000003},"min":{"1min":0.44,"5min":0.434,"15min":0.434},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.76200000000000001}]},{"osd":9,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.72999999999999998}]},{"osd":10,"last update":"Fri Sep 13 17:11:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.77500000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":987136,"data_stored":477768,"data_compressed":11720,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:10:49 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.47299999999999998,"15min":0.46600000000000003},"min":{"1min":0.29899999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.49199999999999999,"15min":0.48099999999999998},"min":{"1min":0.28499999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.59399999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:11:08 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.52100000000000002,"15min":0.505},"min":{"1min":0.374,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77900000000000003,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.501},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.53000000000000003,"15min":0.50700000000000001},"min":{"1min":0.38100000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.624}]},{"osd":3,"last update":"Fri Sep 13 17:10:27 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.40999999999999998,"15min":0.40100000000000002},"min":{"1min":0.23499999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.432},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.39700000000000002,"15min":0.38900000000000001},"min":{"1min":0.26400000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.317}]},{"osd":4,"last update":"Fri Sep 13 17:10:55 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.496,"15min":0.47999999999999998},"min":{"1min":0.34100000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.52100000000000002,"15min":0.503},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Sep 13 17:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52100000000000002,"15min":0.50900000000000001},"min":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82399999999999995,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.54800000000000004,"15min":0.53000000000000003},"min":{"1min":0.42799999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80500000000000005,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.60799999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:11:41 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.433,"15min":0.41799999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.65100000000000002,"5min":0.754,"15min":0.754},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.44800000000000001,"15min":0.42999999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72899999999999998,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.376}]},{"osd":7,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.57999999999999996,"15min":0.57099999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.57599999999999996}]},{"osd":8,"last update":"Fri Sep 13 17:11:30 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.60499999999999998,"15min":0.60699999999999998},"min":{"1min":0.46500000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.77200000000000002,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.65200000000000002,"15min":0.65800000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90200000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.41899999999999998}]},{"osd":9,"last update":"Fri Sep 13 17:10:49 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.44500000000000001}]},{"osd":10,"last update":"Fri Sep 13 17:11:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.58499999999999996}]},{"osd":11,"last update":"Fri Sep 13 17:11:36 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.53700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34721,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34721,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34721,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":45625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":46737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":41955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:11:55.077 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:11:55.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.207+0000 7f73f9d8a640 1 -- 172.21.15.87:0/1970627139 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73f40fe7e0 msgr2=0x7f73f4108390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:55.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.207+0000 7f73f9d8a640 1 --2- 172.21.15.87:0/1970627139 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73f40fe7e0 0x7f73f4108390 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f73ec009ca0 tx=0x7f73ec02a8c0 comp rx=0 tx=0).stop 2024-09-13T17:11:55.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.207+0000 7f73f9d8a640 1 -- 172.21.15.87:0/1970627139 shutdown_connections 2024-09-13T17:11:55.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.207+0000 7f73f9d8a640 1 --2- 172.21.15.87:0/1970627139 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73f40fe7e0 0x7f73f4108390 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:55.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.207+0000 7f73f9d8a640 1 --2- 172.21.15.87:0/1970627139 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73f40fde20 0x7f73f40fe2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:55.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.207+0000 7f73f9d8a640 1 --2- 172.21.15.87:0/1970627139 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73f41013b0 0x7f73f41017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:55.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.207+0000 7f73f9d8a640 1 -- 172.21.15.87:0/1970627139 >> 172.21.15.87:0/1970627139 conn(0x7f73f40f9bb0 msgr2=0x7f73f40fbfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:55.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.207+0000 7f73f9d8a640 1 -- 172.21.15.87:0/1970627139 shutdown_connections 2024-09-13T17:11:55.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.207+0000 7f73f9d8a640 1 -- 172.21.15.87:0/1970627139 wait complete. 2024-09-13T17:11:55.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.207+0000 7f73f9d8a640 1 Processor -- start 2024-09-13T17:11:55.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.207+0000 7f73f9d8a640 1 -- start start 2024-09-13T17:11:55.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.208+0000 7f73f9d8a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73f40fde20 0x7f73f4100ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:55.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.208+0000 7f73f9d8a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73f40fe7e0 0x7f73f40ff0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:55.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.208+0000 7f73f9d8a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73f41013b0 0x7f73f40ff630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:55.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.208+0000 7f73f9d8a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f40ffd90 con 0x7f73f41013b0 2024-09-13T17:11:55.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.208+0000 7f73f9d8a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f40fff00 con 0x7f73f40fde20 2024-09-13T17:11:55.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.208+0000 7f73f9d8a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f419fde0 con 0x7f73f40fe7e0 2024-09-13T17:11:55.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.208+0000 7f73f3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73f41013b0 0x7f73f40ff630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:55.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.208+0000 7f73f3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73f41013b0 0x7f73f40ff630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45624/0 (socket says 172.21.15.87:45624) 2024-09-13T17:11:55.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.208+0000 7f73f3fff640 1 -- 172.21.15.87:0/2101770135 learned_addr learned my addr 172.21.15.87:0/2101770135 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:55.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.208+0000 7f73f37fe640 1 --2- 172.21.15.87:0/2101770135 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73f40fde20 0x7f73f4100ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:55.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.208+0000 7f73ebfff640 1 --2- 172.21.15.87:0/2101770135 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73f40fe7e0 0x7f73f40ff0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:55.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.208+0000 7f73f3fff640 1 -- 172.21.15.87:0/2101770135 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73f40fe7e0 msgr2=0x7f73f40ff0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:55.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.208+0000 7f73f3fff640 1 --2- 172.21.15.87:0/2101770135 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73f40fe7e0 0x7f73f40ff0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:55.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.208+0000 7f73f3fff640 1 -- 172.21.15.87:0/2101770135 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73f40fde20 msgr2=0x7f73f4100ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:55.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.208+0000 7f73f3fff640 1 --2- 172.21.15.87:0/2101770135 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73f40fde20 0x7f73f4100ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:55.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.208+0000 7f73f3fff640 1 -- 172.21.15.87:0/2101770135 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ec009900 con 0x7f73f41013b0 2024-09-13T17:11:55.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.208+0000 7f73f3fff640 1 --2- 172.21.15.87:0/2101770135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73f41013b0 0x7f73f40ff630 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f73ec033040 tx=0x7f73ec031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:55.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.208+0000 7f73f17fa640 1 -- 172.21.15.87:0/2101770135 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec02f310 con 0x7f73f41013b0 2024-09-13T17:11:55.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.208+0000 7f73f17fa640 1 -- 172.21.15.87:0/2101770135 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f73ec040070 con 0x7f73f41013b0 2024-09-13T17:11:55.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.208+0000 7f73f9d8a640 1 -- 172.21.15.87:0/2101770135 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f41a0030 con 0x7f73f41013b0 2024-09-13T17:11:55.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.208+0000 7f73f17fa640 1 -- 172.21.15.87:0/2101770135 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec004590 con 0x7f73f41013b0 2024-09-13T17:11:55.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.208+0000 7f73f9d8a640 1 -- 172.21.15.87:0/2101770135 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f41a0590 con 0x7f73f41013b0 2024-09-13T17:11:55.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.209+0000 7f73f9d8a640 1 -- 172.21.15.87:0/2101770135 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f4107430 con 0x7f73f41013b0 2024-09-13T17:11:55.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.210+0000 7f73f17fa640 1 -- 172.21.15.87:0/2101770135 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f73ec042030 con 0x7f73f41013b0 2024-09-13T17:11:55.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.211+0000 7f73f17fa640 1 --2- 172.21.15.87:0/2101770135 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f73e00a11a0 0x7f73e00a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:55.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.211+0000 7f73f37fe640 1 --2- 172.21.15.87:0/2101770135 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f73e00a11a0 0x7f73e00a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:55.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.211+0000 7f73f17fa640 1 -- 172.21.15.87:0/2101770135 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8978+0+0 (secure 0 0 0) 0x7f73ec0ee2f0 con 0x7f73f41013b0 2024-09-13T17:11:55.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.212+0000 7f73f37fe640 1 --2- 172.21.15.87:0/2101770135 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f73e00a11a0 0x7f73e00a3660 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f73e4005fd0 tx=0x7f73e400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:55.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.215+0000 7f73f17fa640 1 -- 172.21.15.87:0/2101770135 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f73ec0b7740 con 0x7f73f41013b0 2024-09-13T17:11:55.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.378+0000 7f73f9d8a640 1 -- 172.21.15.87:0/2101770135 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f73f402c450 con 0x7f73e00a11a0 2024-09-13T17:11:55.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.388+0000 7f73f17fa640 1 -- 172.21.15.87:0/2101770135 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+424082 (secure 0 0 0) 0x7f73f402c450 con 0x7f73e00a11a0 2024-09-13T17:11:55.396 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:11:55.399 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-13T17:11:55.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.392+0000 7f73f9d8a640 1 -- 172.21.15.87:0/2101770135 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f73e00a11a0 msgr2=0x7f73e00a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:55.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.392+0000 7f73f9d8a640 1 --2- 172.21.15.87:0/2101770135 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f73e00a11a0 0x7f73e00a3660 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f73e4005fd0 tx=0x7f73e400b390 comp rx=0 tx=0).stop 2024-09-13T17:11:55.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.392+0000 7f73f9d8a640 1 -- 172.21.15.87:0/2101770135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73f41013b0 msgr2=0x7f73f40ff630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:55.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.392+0000 7f73f9d8a640 1 --2- 172.21.15.87:0/2101770135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73f41013b0 0x7f73f40ff630 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f73ec033040 tx=0x7f73ec031700 comp rx=0 tx=0).stop 2024-09-13T17:11:55.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.392+0000 7f73f9d8a640 1 -- 172.21.15.87:0/2101770135 shutdown_connections 2024-09-13T17:11:55.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.392+0000 7f73f9d8a640 1 --2- 172.21.15.87:0/2101770135 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f73e00a11a0 0x7f73e00a3660 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:55.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.392+0000 7f73f9d8a640 1 --2- 172.21.15.87:0/2101770135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73f41013b0 0x7f73f40ff630 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:55.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.392+0000 7f73f9d8a640 1 --2- 172.21.15.87:0/2101770135 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73f40fe7e0 0x7f73f40ff0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:55.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.392+0000 7f73f9d8a640 1 --2- 172.21.15.87:0/2101770135 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73f40fde20 0x7f73f4100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:55.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.392+0000 7f73f9d8a640 1 -- 172.21.15.87:0/2101770135 >> 172.21.15.87:0/2101770135 conn(0x7f73f40f9bb0 msgr2=0x7f73f4104600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:55.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.392+0000 7f73f9d8a640 1 -- 172.21.15.87:0/2101770135 shutdown_connections 2024-09-13T17:11:55.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.392+0000 7f73f9d8a640 1 -- 172.21.15.87:0/2101770135 wait complete. 2024-09-13T17:11:55.404 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:55 smithi087 ceph-mon[30934]: pgmap v294: 129 pgs: 4 peering, 125 active+clean; 620 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 8.6 KiB/s wr, 16 op/s 2024-09-13T17:11:55.405 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":294,"stamp":"2024-09-13T17:11:54.075595+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":634933,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":173,"num_read_kb":168,"num_write":326,"num_write_kb":3025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":421,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":377208,"kb_used_data":11996,"kb_used_omap":18,"kb_used_meta":365037,"kb_avail":1124564616,"statfs":{"total":1151940427776,"available":1151554166784,"internally_reserved":0,"allocated":12283904,"data_stored":7826809,"data_compressed":303238,"data_compressed_allocated":405504,"data_compressed_original":2310144,"omap_allocated":19109,"internal_metadata":373798235},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":39972,"num_objects":40,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":37,"num_read_kb":49,"num_write":97,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002376"},"pg_stats":[{"pgid":"2.1f","version":"89'9","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794907+0000","last_change":"2024-09-13T17:11:22.998997+0000","last_active":"2024-09-13T17:11:48.794907+0000","last_peered":"2024-09-13T17:11:48.794907+0000","last_clean":"2024-09-13T17:11:48.794907+0000","last_became_active":"2024-09-13T17:11:22.998674+0000","last_became_peered":"2024-09-13T17:11:22.998674+0000","last_unstale":"2024-09-13T17:11:48.794907+0000","last_undegraded":"2024-09-13T17:11:48.794907+0000","last_fullsized":"2024-09-13T17:11:48.794907+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:30:50.554788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794065+0000","last_change":"2024-09-13T17:11:23.340108+0000","last_active":"2024-09-13T17:11:48.794065+0000","last_peered":"2024-09-13T17:11:48.794065+0000","last_clean":"2024-09-13T17:11:48.794065+0000","last_became_active":"2024-09-13T17:11:23.339832+0000","last_became_peered":"2024-09-13T17:11:23.339832+0000","last_unstale":"2024-09-13T17:11:48.794065+0000","last_undegraded":"2024-09-13T17:11:48.794065+0000","last_fullsized":"2024-09-13T17:11:48.794065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:40.969448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.802879+0000","last_change":"2024-09-13T17:11:27.358090+0000","last_active":"2024-09-13T17:11:48.802879+0000","last_peered":"2024-09-13T17:11:48.802879+0000","last_clean":"2024-09-13T17:11:48.802879+0000","last_became_active":"2024-09-13T17:11:27.357725+0000","last_became_peered":"2024-09-13T17:11:27.357725+0000","last_unstale":"2024-09-13T17:11:48.802879+0000","last_undegraded":"2024-09-13T17:11:48.802879+0000","last_fullsized":"2024-09-13T17:11:48.802879+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:51.617457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794279+0000","last_change":"2024-09-13T17:11:23.000779+0000","last_active":"2024-09-13T17:11:48.794279+0000","last_peered":"2024-09-13T17:11:48.794279+0000","last_clean":"2024-09-13T17:11:48.794279+0000","last_became_active":"2024-09-13T17:11:23.000511+0000","last_became_peered":"2024-09-13T17:11:23.000511+0000","last_unstale":"2024-09-13T17:11:48.794279+0000","last_undegraded":"2024-09-13T17:11:48.794279+0000","last_fullsized":"2024-09-13T17:11:48.794279+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:09.802392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.833095+0000","last_change":"2024-09-13T17:11:23.333948+0000","last_active":"2024-09-13T17:11:27.833095+0000","last_peered":"2024-09-13T17:11:27.833095+0000","last_clean":"2024-09-13T17:11:27.833095+0000","last_became_active":"2024-09-13T17:11:23.333679+0000","last_became_peered":"2024-09-13T17:11:23.333679+0000","last_unstale":"2024-09-13T17:11:27.833095+0000","last_undegraded":"2024-09-13T17:11:27.833095+0000","last_fullsized":"2024-09-13T17:11:27.833095+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:10.265157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537784+0000","last_change":"2024-09-13T17:11:27.353767+0000","last_active":"2024-09-13T17:11:29.537784+0000","last_peered":"2024-09-13T17:11:29.537784+0000","last_clean":"2024-09-13T17:11:29.537784+0000","last_became_active":"2024-09-13T17:11:27.353448+0000","last_became_peered":"2024-09-13T17:11:27.353448+0000","last_unstale":"2024-09-13T17:11:29.537784+0000","last_undegraded":"2024-09-13T17:11:29.537784+0000","last_fullsized":"2024-09-13T17:11:29.537784+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:15.948099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799823+0000","last_change":"2024-09-13T17:11:22.999879+0000","last_active":"2024-09-13T17:11:48.799823+0000","last_peered":"2024-09-13T17:11:48.799823+0000","last_clean":"2024-09-13T17:11:48.799823+0000","last_became_active":"2024-09-13T17:11:22.999577+0000","last_became_peered":"2024-09-13T17:11:22.999577+0000","last_unstale":"2024-09-13T17:11:48.799823+0000","last_undegraded":"2024-09-13T17:11:48.799823+0000","last_fullsized":"2024-09-13T17:11:48.799823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:48.485532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792067+0000","last_change":"2024-09-13T17:11:23.339026+0000","last_active":"2024-09-13T17:11:48.792067+0000","last_peered":"2024-09-13T17:11:48.792067+0000","last_clean":"2024-09-13T17:11:48.792067+0000","last_became_active":"2024-09-13T17:11:23.338745+0000","last_became_peered":"2024-09-13T17:11:23.338745+0000","last_unstale":"2024-09-13T17:11:48.792067+0000","last_undegraded":"2024-09-13T17:11:48.792067+0000","last_fullsized":"2024-09-13T17:11:48.792067+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:27.455418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537867+0000","last_change":"2024-09-13T17:11:27.363137+0000","last_active":"2024-09-13T17:11:29.537867+0000","last_peered":"2024-09-13T17:11:29.537867+0000","last_clean":"2024-09-13T17:11:29.537867+0000","last_became_active":"2024-09-13T17:11:27.362621+0000","last_became_peered":"2024-09-13T17:11:27.362621+0000","last_unstale":"2024-09-13T17:11:29.537867+0000","last_undegraded":"2024-09-13T17:11:29.537867+0000","last_fullsized":"2024-09-13T17:11:29.537867+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:35:51.492630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.800066+0000","last_change":"2024-09-13T17:11:22.998066+0000","last_active":"2024-09-13T17:11:48.800066+0000","last_peered":"2024-09-13T17:11:48.800066+0000","last_clean":"2024-09-13T17:11:48.800066+0000","last_became_active":"2024-09-13T17:11:22.997741+0000","last_became_peered":"2024-09-13T17:11:22.997741+0000","last_unstale":"2024-09-13T17:11:48.800066+0000","last_undegraded":"2024-09-13T17:11:48.800066+0000","last_fullsized":"2024-09-13T17:11:48.800066+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:00.353453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792498+0000","last_change":"2024-09-13T17:11:23.336778+0000","last_active":"2024-09-13T17:11:48.792498+0000","last_peered":"2024-09-13T17:11:48.792498+0000","last_clean":"2024-09-13T17:11:48.792498+0000","last_became_active":"2024-09-13T17:11:23.336491+0000","last_became_peered":"2024-09-13T17:11:23.336491+0000","last_unstale":"2024-09-13T17:11:48.792498+0000","last_undegraded":"2024-09-13T17:11:48.792498+0000","last_fullsized":"2024-09-13T17:11:48.792498+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:02.045912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537823+0000","last_change":"2024-09-13T17:11:27.361454+0000","last_active":"2024-09-13T17:11:29.537823+0000","last_peered":"2024-09-13T17:11:29.537823+0000","last_clean":"2024-09-13T17:11:29.537823+0000","last_became_active":"2024-09-13T17:11:27.360980+0000","last_became_peered":"2024-09-13T17:11:27.360980+0000","last_unstale":"2024-09-13T17:11:29.537823+0000","last_undegraded":"2024-09-13T17:11:29.537823+0000","last_fullsized":"2024-09-13T17:11:29.537823+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:36.036426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.798015+0000","last_change":"2024-09-13T17:11:23.334073+0000","last_active":"2024-09-13T17:11:48.798015+0000","last_peered":"2024-09-13T17:11:48.798015+0000","last_clean":"2024-09-13T17:11:48.798015+0000","last_became_active":"2024-09-13T17:11:23.333628+0000","last_became_peered":"2024-09-13T17:11:23.333628+0000","last_unstale":"2024-09-13T17:11:48.798015+0000","last_undegraded":"2024-09-13T17:11:48.798015+0000","last_fullsized":"2024-09-13T17:11:48.798015+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:18.561346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.800163+0000","last_change":"2024-09-13T17:11:22.999115+0000","last_active":"2024-09-13T17:11:48.800163+0000","last_peered":"2024-09-13T17:11:48.800163+0000","last_clean":"2024-09-13T17:11:48.800163+0000","last_became_active":"2024-09-13T17:11:22.998798+0000","last_became_peered":"2024-09-13T17:11:22.998798+0000","last_unstale":"2024-09-13T17:11:48.800163+0000","last_undegraded":"2024-09-13T17:11:48.800163+0000","last_fullsized":"2024-09-13T17:11:48.800163+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:25.263755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537935+0000","last_change":"2024-09-13T17:11:27.355472+0000","last_active":"2024-09-13T17:11:29.537935+0000","last_peered":"2024-09-13T17:11:29.537935+0000","last_clean":"2024-09-13T17:11:29.537935+0000","last_became_active":"2024-09-13T17:11:27.355065+0000","last_became_peered":"2024-09-13T17:11:27.355065+0000","last_unstale":"2024-09-13T17:11:29.537935+0000","last_undegraded":"2024-09-13T17:11:29.537935+0000","last_fullsized":"2024-09-13T17:11:29.537935+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:03.881097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.793593+0000","last_change":"2024-09-13T17:11:23.340268+0000","last_active":"2024-09-13T17:11:48.793593+0000","last_peered":"2024-09-13T17:11:48.793593+0000","last_clean":"2024-09-13T17:11:48.793593+0000","last_became_active":"2024-09-13T17:11:23.339977+0000","last_became_peered":"2024-09-13T17:11:23.339977+0000","last_unstale":"2024-09-13T17:11:48.793593+0000","last_undegraded":"2024-09-13T17:11:48.793593+0000","last_fullsized":"2024-09-13T17:11:48.793593+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:21.067899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"90'1","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.565951+0000","last_change":"2024-09-13T17:11:23.000858+0000","last_active":"2024-09-13T17:11:49.565951+0000","last_peered":"2024-09-13T17:11:49.565951+0000","last_clean":"2024-09-13T17:11:49.565951+0000","last_became_active":"2024-09-13T17:11:23.000536+0000","last_became_peered":"2024-09-13T17:11:23.000536+0000","last_unstale":"2024-09-13T17:11:49.565951+0000","last_undegraded":"2024-09-13T17:11:49.565951+0000","last_fullsized":"2024-09-13T17:11:49.565951+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:28.798579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801541+0000","last_change":"2024-09-13T17:11:27.354018+0000","last_active":"2024-09-13T17:11:48.801541+0000","last_peered":"2024-09-13T17:11:48.801541+0000","last_clean":"2024-09-13T17:11:48.801541+0000","last_became_active":"2024-09-13T17:11:27.353519+0000","last_became_peered":"2024-09-13T17:11:27.353519+0000","last_unstale":"2024-09-13T17:11:48.801541+0000","last_undegraded":"2024-09-13T17:11:48.801541+0000","last_fullsized":"2024-09-13T17:11:48.801541+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:55.227851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801000+0000","last_change":"2024-09-13T17:11:23.335798+0000","last_active":"2024-09-13T17:11:48.801000+0000","last_peered":"2024-09-13T17:11:48.801000+0000","last_clean":"2024-09-13T17:11:48.801000+0000","last_became_active":"2024-09-13T17:11:23.335445+0000","last_became_peered":"2024-09-13T17:11:23.335445+0000","last_unstale":"2024-09-13T17:11:48.801000+0000","last_undegraded":"2024-09-13T17:11:48.801000+0000","last_fullsized":"2024-09-13T17:11:48.801000+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:53.242067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.793194+0000","last_change":"2024-09-13T17:11:22.994118+0000","last_active":"2024-09-13T17:11:48.793194+0000","last_peered":"2024-09-13T17:11:48.793194+0000","last_clean":"2024-09-13T17:11:48.793194+0000","last_became_active":"2024-09-13T17:11:22.993801+0000","last_became_peered":"2024-09-13T17:11:22.993801+0000","last_unstale":"2024-09-13T17:11:48.793194+0000","last_undegraded":"2024-09-13T17:11:48.793194+0000","last_fullsized":"2024-09-13T17:11:48.793194+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:01.382130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794642+0000","last_change":"2024-09-13T17:11:27.358795+0000","last_active":"2024-09-13T17:11:48.794642+0000","last_peered":"2024-09-13T17:11:48.794642+0000","last_clean":"2024-09-13T17:11:48.794642+0000","last_became_active":"2024-09-13T17:11:27.358166+0000","last_became_peered":"2024-09-13T17:11:27.358166+0000","last_unstale":"2024-09-13T17:11:48.794642+0000","last_undegraded":"2024-09-13T17:11:48.794642+0000","last_fullsized":"2024-09-13T17:11:48.794642+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:23.787842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799478+0000","last_change":"2024-09-13T17:11:23.340671+0000","last_active":"2024-09-13T17:11:48.799478+0000","last_peered":"2024-09-13T17:11:48.799478+0000","last_clean":"2024-09-13T17:11:48.799478+0000","last_became_active":"2024-09-13T17:11:23.340360+0000","last_became_peered":"2024-09-13T17:11:23.340360+0000","last_unstale":"2024-09-13T17:11:48.799478+0000","last_undegraded":"2024-09-13T17:11:48.799478+0000","last_fullsized":"2024-09-13T17:11:48.799478+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:17.875171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.791482+0000","last_change":"2024-09-13T17:11:22.993039+0000","last_active":"2024-09-13T17:11:48.791482+0000","last_peered":"2024-09-13T17:11:48.791482+0000","last_clean":"2024-09-13T17:11:48.791482+0000","last_became_active":"2024-09-13T17:11:22.992701+0000","last_became_peered":"2024-09-13T17:11:22.992701+0000","last_unstale":"2024-09-13T17:11:48.791482+0000","last_undegraded":"2024-09-13T17:11:48.791482+0000","last_fullsized":"2024-09-13T17:11:48.791482+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:28.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537946+0000","last_change":"2024-09-13T17:11:27.363834+0000","last_active":"2024-09-13T17:11:29.537946+0000","last_peered":"2024-09-13T17:11:29.537946+0000","last_clean":"2024-09-13T17:11:29.537946+0000","last_became_active":"2024-09-13T17:11:27.363425+0000","last_became_peered":"2024-09-13T17:11:27.363425+0000","last_unstale":"2024-09-13T17:11:29.537946+0000","last_undegraded":"2024-09-13T17:11:29.537946+0000","last_fullsized":"2024-09-13T17:11:29.537946+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:37.389881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832858+0000","last_change":"2024-09-13T17:11:23.337423+0000","last_active":"2024-09-13T17:11:27.832858+0000","last_peered":"2024-09-13T17:11:27.832858+0000","last_clean":"2024-09-13T17:11:27.832858+0000","last_became_active":"2024-09-13T17:11:23.337167+0000","last_became_peered":"2024-09-13T17:11:23.337167+0000","last_unstale":"2024-09-13T17:11:27.832858+0000","last_undegraded":"2024-09-13T17:11:27.832858+0000","last_fullsized":"2024-09-13T17:11:27.832858+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:28.540283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:46.175903+0000","last_change":"2024-09-13T17:11:23.000486+0000","last_active":"2024-09-13T17:11:46.175903+0000","last_peered":"2024-09-13T17:11:46.175903+0000","last_clean":"2024-09-13T17:11:46.175903+0000","last_became_active":"2024-09-13T17:11:23.000158+0000","last_became_peered":"2024-09-13T17:11:23.000158+0000","last_unstale":"2024-09-13T17:11:46.175903+0000","last_undegraded":"2024-09-13T17:11:46.175903+0000","last_fullsized":"2024-09-13T17:11:46.175903+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:42.635037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.802894+0000","last_change":"2024-09-13T17:11:27.355058+0000","last_active":"2024-09-13T17:11:48.802894+0000","last_peered":"2024-09-13T17:11:48.802894+0000","last_clean":"2024-09-13T17:11:48.802894+0000","last_became_active":"2024-09-13T17:11:27.354726+0000","last_became_peered":"2024-09-13T17:11:27.354726+0000","last_unstale":"2024-09-13T17:11:48.802894+0000","last_undegraded":"2024-09-13T17:11:48.802894+0000","last_fullsized":"2024-09-13T17:11:48.802894+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:58.450122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794550+0000","last_change":"2024-09-13T17:11:23.337245+0000","last_active":"2024-09-13T17:11:48.794550+0000","last_peered":"2024-09-13T17:11:48.794550+0000","last_clean":"2024-09-13T17:11:48.794550+0000","last_became_active":"2024-09-13T17:11:23.336956+0000","last_became_peered":"2024-09-13T17:11:23.336956+0000","last_unstale":"2024-09-13T17:11:48.794550+0000","last_undegraded":"2024-09-13T17:11:48.794550+0000","last_fullsized":"2024-09-13T17:11:48.794550+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:46.876149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.655818+0000","last_change":"2024-09-13T17:11:22.999942+0000","last_active":"2024-09-13T17:11:49.655818+0000","last_peered":"2024-09-13T17:11:49.655818+0000","last_clean":"2024-09-13T17:11:49.655818+0000","last_became_active":"2024-09-13T17:11:22.999653+0000","last_became_peered":"2024-09-13T17:11:22.999653+0000","last_unstale":"2024-09-13T17:11:49.655818+0000","last_undegraded":"2024-09-13T17:11:49.655818+0000","last_fullsized":"2024-09-13T17:11:49.655818+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:29.400939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792511+0000","last_change":"2024-09-13T17:11:27.356479+0000","last_active":"2024-09-13T17:11:48.792511+0000","last_peered":"2024-09-13T17:11:48.792511+0000","last_clean":"2024-09-13T17:11:48.792511+0000","last_became_active":"2024-09-13T17:11:27.356052+0000","last_became_peered":"2024-09-13T17:11:27.356052+0000","last_unstale":"2024-09-13T17:11:48.792511+0000","last_undegraded":"2024-09-13T17:11:48.792511+0000","last_fullsized":"2024-09-13T17:11:48.792511+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:42.173376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.790360+0000","last_change":"2024-09-13T17:11:23.333786+0000","last_active":"2024-09-13T17:11:48.790360+0000","last_peered":"2024-09-13T17:11:48.790360+0000","last_clean":"2024-09-13T17:11:48.790360+0000","last_became_active":"2024-09-13T17:11:23.333472+0000","last_became_peered":"2024-09-13T17:11:23.333472+0000","last_unstale":"2024-09-13T17:11:48.790360+0000","last_undegraded":"2024-09-13T17:11:48.790360+0000","last_fullsized":"2024-09-13T17:11:48.790360+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:41.633228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799918+0000","last_change":"2024-09-13T17:11:22.998646+0000","last_active":"2024-09-13T17:11:48.799918+0000","last_peered":"2024-09-13T17:11:48.799918+0000","last_clean":"2024-09-13T17:11:48.799918+0000","last_became_active":"2024-09-13T17:11:22.998291+0000","last_became_peered":"2024-09-13T17:11:22.998291+0000","last_unstale":"2024-09-13T17:11:48.799918+0000","last_undegraded":"2024-09-13T17:11:48.799918+0000","last_fullsized":"2024-09-13T17:11:48.799918+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:20.658436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801089+0000","last_change":"2024-09-13T17:11:27.361174+0000","last_active":"2024-09-13T17:11:48.801089+0000","last_peered":"2024-09-13T17:11:48.801089+0000","last_clean":"2024-09-13T17:11:48.801089+0000","last_became_active":"2024-09-13T17:11:27.360737+0000","last_became_peered":"2024-09-13T17:11:27.360737+0000","last_unstale":"2024-09-13T17:11:48.801089+0000","last_undegraded":"2024-09-13T17:11:48.801089+0000","last_fullsized":"2024-09-13T17:11:48.801089+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:00.941364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.834435+0000","last_change":"2024-09-13T17:11:23.338545+0000","last_active":"2024-09-13T17:11:27.834435+0000","last_peered":"2024-09-13T17:11:27.834435+0000","last_clean":"2024-09-13T17:11:27.834435+0000","last_became_active":"2024-09-13T17:11:23.338246+0000","last_became_peered":"2024-09-13T17:11:23.338246+0000","last_unstale":"2024-09-13T17:11:27.834435+0000","last_undegraded":"2024-09-13T17:11:27.834435+0000","last_fullsized":"2024-09-13T17:11:27.834435+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:18.966658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794795+0000","last_change":"2024-09-13T17:11:22.993497+0000","last_active":"2024-09-13T17:11:48.794795+0000","last_peered":"2024-09-13T17:11:48.794795+0000","last_clean":"2024-09-13T17:11:48.794795+0000","last_became_active":"2024-09-13T17:11:22.993165+0000","last_became_peered":"2024-09-13T17:11:22.993165+0000","last_unstale":"2024-09-13T17:11:48.794795+0000","last_undegraded":"2024-09-13T17:11:48.794795+0000","last_fullsized":"2024-09-13T17:11:48.794795+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:20.997834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799564+0000","last_change":"2024-09-13T17:11:27.364652+0000","last_active":"2024-09-13T17:11:48.799564+0000","last_peered":"2024-09-13T17:11:48.799564+0000","last_clean":"2024-09-13T17:11:48.799564+0000","last_became_active":"2024-09-13T17:11:27.364245+0000","last_became_peered":"2024-09-13T17:11:27.364245+0000","last_unstale":"2024-09-13T17:11:48.799564+0000","last_undegraded":"2024-09-13T17:11:48.799564+0000","last_fullsized":"2024-09-13T17:11:48.799564+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:23.048289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.834356+0000","last_change":"2024-09-13T17:11:23.335649+0000","last_active":"2024-09-13T17:11:27.834356+0000","last_peered":"2024-09-13T17:11:27.834356+0000","last_clean":"2024-09-13T17:11:27.834356+0000","last_became_active":"2024-09-13T17:11:23.335364+0000","last_became_peered":"2024-09-13T17:11:23.335364+0000","last_unstale":"2024-09-13T17:11:27.834356+0000","last_undegraded":"2024-09-13T17:11:27.834356+0000","last_fullsized":"2024-09-13T17:11:27.834356+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.447947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.798105+0000","last_change":"2024-09-13T17:11:23.003188+0000","last_active":"2024-09-13T17:11:48.798105+0000","last_peered":"2024-09-13T17:11:48.798105+0000","last_clean":"2024-09-13T17:11:48.798105+0000","last_became_active":"2024-09-13T17:11:23.002858+0000","last_became_peered":"2024-09-13T17:11:23.002858+0000","last_unstale":"2024-09-13T17:11:48.798105+0000","last_undegraded":"2024-09-13T17:11:48.798105+0000","last_fullsized":"2024-09-13T17:11:48.798105+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:34.153326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.790425+0000","last_change":"2024-09-13T17:11:27.353320+0000","last_active":"2024-09-13T17:11:48.790425+0000","last_peered":"2024-09-13T17:11:48.790425+0000","last_clean":"2024-09-13T17:11:48.790425+0000","last_became_active":"2024-09-13T17:11:27.352947+0000","last_became_peered":"2024-09-13T17:11:27.352947+0000","last_unstale":"2024-09-13T17:11:48.790425+0000","last_undegraded":"2024-09-13T17:11:48.790425+0000","last_fullsized":"2024-09-13T17:11:48.790425+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:04.619618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792636+0000","last_change":"2024-09-13T17:11:23.330128+0000","last_active":"2024-09-13T17:11:48.792636+0000","last_peered":"2024-09-13T17:11:48.792636+0000","last_clean":"2024-09-13T17:11:48.792636+0000","last_became_active":"2024-09-13T17:11:23.329266+0000","last_became_peered":"2024-09-13T17:11:23.329266+0000","last_unstale":"2024-09-13T17:11:48.792636+0000","last_undegraded":"2024-09-13T17:11:48.792636+0000","last_fullsized":"2024-09-13T17:11:48.792636+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:36.275352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'4","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.795578+0000","last_change":"2024-09-13T17:11:23.003495+0000","last_active":"2024-09-13T17:11:49.795578+0000","last_peered":"2024-09-13T17:11:49.795578+0000","last_clean":"2024-09-13T17:11:49.795578+0000","last_became_active":"2024-09-13T17:11:23.003186+0000","last_became_peered":"2024-09-13T17:11:23.003186+0000","last_unstale":"2024-09-13T17:11:49.795578+0000","last_undegraded":"2024-09-13T17:11:49.795578+0000","last_fullsized":"2024-09-13T17:11:49.795578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:23.353587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.790306+0000","last_change":"2024-09-13T17:11:27.362233+0000","last_active":"2024-09-13T17:11:48.790306+0000","last_peered":"2024-09-13T17:11:48.790306+0000","last_clean":"2024-09-13T17:11:48.790306+0000","last_became_active":"2024-09-13T17:11:27.361814+0000","last_became_peered":"2024-09-13T17:11:27.361814+0000","last_unstale":"2024-09-13T17:11:48.790306+0000","last_undegraded":"2024-09-13T17:11:48.790306+0000","last_fullsized":"2024-09-13T17:11:48.790306+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:20.723366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.789824+0000","last_change":"2024-09-13T17:11:23.332870+0000","last_active":"2024-09-13T17:11:48.789824+0000","last_peered":"2024-09-13T17:11:48.789824+0000","last_clean":"2024-09-13T17:11:48.789824+0000","last_became_active":"2024-09-13T17:11:23.332583+0000","last_became_peered":"2024-09-13T17:11:23.332583+0000","last_unstale":"2024-09-13T17:11:48.789824+0000","last_undegraded":"2024-09-13T17:11:48.789824+0000","last_fullsized":"2024-09-13T17:11:48.789824+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:22.607666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.796075+0000","last_change":"2024-09-13T17:11:23.001932+0000","last_active":"2024-09-13T17:11:48.796075+0000","last_peered":"2024-09-13T17:11:48.796075+0000","last_clean":"2024-09-13T17:11:48.796075+0000","last_became_active":"2024-09-13T17:11:23.001642+0000","last_became_peered":"2024-09-13T17:11:23.001642+0000","last_unstale":"2024-09-13T17:11:48.796075+0000","last_undegraded":"2024-09-13T17:11:48.796075+0000","last_fullsized":"2024-09-13T17:11:48.796075+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:05.976897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.793096+0000","last_change":"2024-09-13T17:11:27.359679+0000","last_active":"2024-09-13T17:11:48.793096+0000","last_peered":"2024-09-13T17:11:48.793096+0000","last_clean":"2024-09-13T17:11:48.793096+0000","last_became_active":"2024-09-13T17:11:27.359268+0000","last_became_peered":"2024-09-13T17:11:27.359268+0000","last_unstale":"2024-09-13T17:11:48.793096+0000","last_undegraded":"2024-09-13T17:11:48.793096+0000","last_fullsized":"2024-09-13T17:11:48.793096+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:48.154917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.793159+0000","last_change":"2024-09-13T17:11:23.340031+0000","last_active":"2024-09-13T17:11:48.793159+0000","last_peered":"2024-09-13T17:11:48.793159+0000","last_clean":"2024-09-13T17:11:48.793159+0000","last_became_active":"2024-09-13T17:11:23.339768+0000","last_became_peered":"2024-09-13T17:11:23.339768+0000","last_unstale":"2024-09-13T17:11:48.793159+0000","last_undegraded":"2024-09-13T17:11:48.793159+0000","last_fullsized":"2024-09-13T17:11:48.793159+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:22.360526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.788033+0000","last_change":"2024-09-13T17:11:22.995060+0000","last_active":"2024-09-13T17:11:47.788033+0000","last_peered":"2024-09-13T17:11:47.788033+0000","last_clean":"2024-09-13T17:11:47.788033+0000","last_became_active":"2024-09-13T17:11:22.991949+0000","last_became_peered":"2024-09-13T17:11:22.991949+0000","last_unstale":"2024-09-13T17:11:47.788033+0000","last_undegraded":"2024-09-13T17:11:47.788033+0000","last_fullsized":"2024-09-13T17:11:47.788033+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:44.716753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":340,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.796218+0000","last_change":"2024-09-13T17:10:13.439723+0000","last_active":"2024-09-13T17:11:48.796218+0000","last_peered":"2024-09-13T17:11:48.796218+0000","last_clean":"2024-09-13T17:11:48.796218+0000","last_became_active":"2024-09-13T17:10:13.439290+0000","last_became_peered":"2024-09-13T17:10:13.439290+0000","last_unstale":"2024-09-13T17:11:48.796218+0000","last_undegraded":"2024-09-13T17:11:48.796218+0000","last_fullsized":"2024-09-13T17:11:48.796218+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:03.041486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:03.041486+0000","last_clean_scrub_stamp":"2024-09-13T17:07:03.041486+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:08.673571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.798637+0000","last_change":"2024-09-13T17:11:27.361028+0000","last_active":"2024-09-13T17:11:48.798637+0000","last_peered":"2024-09-13T17:11:48.798637+0000","last_clean":"2024-09-13T17:11:48.798637+0000","last_became_active":"2024-09-13T17:11:27.360630+0000","last_became_peered":"2024-09-13T17:11:27.360630+0000","last_unstale":"2024-09-13T17:11:48.798637+0000","last_undegraded":"2024-09-13T17:11:48.798637+0000","last_fullsized":"2024-09-13T17:11:48.798637+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:40:40.860443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.798729+0000","last_change":"2024-09-13T17:11:49.798729+0000","last_active":"2024-09-13T17:11:49.798729+0000","last_peered":"2024-09-13T17:11:49.798729+0000","last_clean":"2024-09-13T17:11:49.798729+0000","last_became_active":"2024-09-13T17:11:49.798402+0000","last_became_peered":"2024-09-13T17:11:49.798402+0000","last_unstale":"2024-09-13T17:11:49.798729+0000","last_undegraded":"2024-09-13T17:11:49.798729+0000","last_fullsized":"2024-09-13T17:11:49.798729+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:58.948813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,11],"acting":[7,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":2,"reported_epoch":90,"state":"peering","last_fresh":"2024-09-13T17:11:27.684094+0000","last_change":"2024-09-13T17:11:49.540357+0000","last_active":"2024-09-13T17:11:49.540357+0000","last_peered":"2024-09-13T17:11:27.684094+0000","last_clean":"2024-09-13T17:11:27.684094+0000","last_became_active":"2024-09-13T17:11:23.003102+0000","last_became_peered":"2024-09-13T17:11:23.003102+0000","last_unstale":"2024-09-13T17:11:27.684094+0000","last_undegraded":"2024-09-13T17:11:27.684094+0000","last_fullsized":"2024-09-13T17:11:27.684094+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:08.827045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.791597+0000","last_change":"2024-09-13T17:11:27.360372+0000","last_active":"2024-09-13T17:11:48.791597+0000","last_peered":"2024-09-13T17:11:48.791597+0000","last_clean":"2024-09-13T17:11:48.791597+0000","last_became_active":"2024-09-13T17:11:27.359990+0000","last_became_peered":"2024-09-13T17:11:27.359990+0000","last_unstale":"2024-09-13T17:11:48.791597+0000","last_undegraded":"2024-09-13T17:11:48.791597+0000","last_fullsized":"2024-09-13T17:11:48.791597+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:26.970317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.795820+0000","last_change":"2024-09-13T17:11:23.336269+0000","last_active":"2024-09-13T17:11:48.795820+0000","last_peered":"2024-09-13T17:11:48.795820+0000","last_clean":"2024-09-13T17:11:48.795820+0000","last_became_active":"2024-09-13T17:11:23.335921+0000","last_became_peered":"2024-09-13T17:11:23.335921+0000","last_unstale":"2024-09-13T17:11:48.795820+0000","last_undegraded":"2024-09-13T17:11:48.795820+0000","last_fullsized":"2024-09-13T17:11:48.795820+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:43.035927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792688+0000","last_change":"2024-09-13T17:11:23.002491+0000","last_active":"2024-09-13T17:11:48.792688+0000","last_peered":"2024-09-13T17:11:48.792688+0000","last_clean":"2024-09-13T17:11:48.792688+0000","last_became_active":"2024-09-13T17:11:23.002178+0000","last_became_peered":"2024-09-13T17:11:23.002178+0000","last_unstale":"2024-09-13T17:11:48.792688+0000","last_undegraded":"2024-09-13T17:11:48.792688+0000","last_fullsized":"2024-09-13T17:11:48.792688+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:06.056639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.108773+0000","last_change":"2024-09-13T17:11:27.355153+0000","last_active":"2024-09-13T17:11:29.108773+0000","last_peered":"2024-09-13T17:11:29.108773+0000","last_clean":"2024-09-13T17:11:29.108773+0000","last_became_active":"2024-09-13T17:11:27.354701+0000","last_became_peered":"2024-09-13T17:11:27.354701+0000","last_unstale":"2024-09-13T17:11:29.108773+0000","last_undegraded":"2024-09-13T17:11:29.108773+0000","last_fullsized":"2024-09-13T17:11:29.108773+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:34.924402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.797409+0000","last_change":"2024-09-13T17:11:23.342067+0000","last_active":"2024-09-13T17:11:48.797409+0000","last_peered":"2024-09-13T17:11:48.797409+0000","last_clean":"2024-09-13T17:11:48.797409+0000","last_became_active":"2024-09-13T17:11:23.341736+0000","last_became_peered":"2024-09-13T17:11:23.341736+0000","last_unstale":"2024-09-13T17:11:48.797409+0000","last_undegraded":"2024-09-13T17:11:48.797409+0000","last_fullsized":"2024-09-13T17:11:48.797409+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:03.114638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.790455+0000","last_change":"2024-09-13T17:11:23.002849+0000","last_active":"2024-09-13T17:11:48.790455+0000","last_peered":"2024-09-13T17:11:48.790455+0000","last_clean":"2024-09-13T17:11:48.790455+0000","last_became_active":"2024-09-13T17:11:23.002562+0000","last_became_peered":"2024-09-13T17:11:23.002562+0000","last_unstale":"2024-09-13T17:11:48.790455+0000","last_undegraded":"2024-09-13T17:11:48.790455+0000","last_fullsized":"2024-09-13T17:11:48.790455+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:11:24.650510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.791707+0000","last_change":"2024-09-13T17:11:27.359343+0000","last_active":"2024-09-13T17:11:48.791707+0000","last_peered":"2024-09-13T17:11:48.791707+0000","last_clean":"2024-09-13T17:11:48.791707+0000","last_became_active":"2024-09-13T17:11:27.358628+0000","last_became_peered":"2024-09-13T17:11:27.358628+0000","last_unstale":"2024-09-13T17:11:48.791707+0000","last_undegraded":"2024-09-13T17:11:48.791707+0000","last_fullsized":"2024-09-13T17:11:48.791707+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:39.584184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801190+0000","last_change":"2024-09-13T17:11:23.333111+0000","last_active":"2024-09-13T17:11:48.801190+0000","last_peered":"2024-09-13T17:11:48.801190+0000","last_clean":"2024-09-13T17:11:48.801190+0000","last_became_active":"2024-09-13T17:11:23.332734+0000","last_became_peered":"2024-09-13T17:11:23.332734+0000","last_unstale":"2024-09-13T17:11:48.801190+0000","last_undegraded":"2024-09-13T17:11:48.801190+0000","last_fullsized":"2024-09-13T17:11:48.801190+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:44.628106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"91'2","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.794103+0000","last_change":"2024-09-13T17:11:23.000759+0000","last_active":"2024-09-13T17:11:49.794103+0000","last_peered":"2024-09-13T17:11:49.794103+0000","last_clean":"2024-09-13T17:11:49.794103+0000","last_became_active":"2024-09-13T17:11:23.000463+0000","last_became_peered":"2024-09-13T17:11:23.000463+0000","last_unstale":"2024-09-13T17:11:49.794103+0000","last_undegraded":"2024-09-13T17:11:49.794103+0000","last_fullsized":"2024-09-13T17:11:49.794103+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:59.077194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.791776+0000","last_change":"2024-09-13T17:11:27.363076+0000","last_active":"2024-09-13T17:11:48.791776+0000","last_peered":"2024-09-13T17:11:48.791776+0000","last_clean":"2024-09-13T17:11:48.791776+0000","last_became_active":"2024-09-13T17:11:27.362642+0000","last_became_peered":"2024-09-13T17:11:27.362642+0000","last_unstale":"2024-09-13T17:11:48.791776+0000","last_undegraded":"2024-09-13T17:11:48.791776+0000","last_fullsized":"2024-09-13T17:11:48.791776+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:25.494875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792014+0000","last_change":"2024-09-13T17:11:23.336703+0000","last_active":"2024-09-13T17:11:48.792014+0000","last_peered":"2024-09-13T17:11:48.792014+0000","last_clean":"2024-09-13T17:11:48.792014+0000","last_became_active":"2024-09-13T17:11:23.336349+0000","last_became_peered":"2024-09-13T17:11:23.336349+0000","last_unstale":"2024-09-13T17:11:48.792014+0000","last_undegraded":"2024-09-13T17:11:48.792014+0000","last_fullsized":"2024-09-13T17:11:48.792014+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:28.671438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799746+0000","last_change":"2024-09-13T17:11:22.994382+0000","last_active":"2024-09-13T17:11:48.799746+0000","last_peered":"2024-09-13T17:11:48.799746+0000","last_clean":"2024-09-13T17:11:48.799746+0000","last_became_active":"2024-09-13T17:11:22.994037+0000","last_became_peered":"2024-09-13T17:11:22.994037+0000","last_unstale":"2024-09-13T17:11:48.799746+0000","last_undegraded":"2024-09-13T17:11:48.799746+0000","last_fullsized":"2024-09-13T17:11:48.799746+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:10.763757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.790388+0000","last_change":"2024-09-13T17:11:27.354351+0000","last_active":"2024-09-13T17:11:48.790388+0000","last_peered":"2024-09-13T17:11:48.790388+0000","last_clean":"2024-09-13T17:11:48.790388+0000","last_became_active":"2024-09-13T17:11:27.353715+0000","last_became_peered":"2024-09-13T17:11:27.353715+0000","last_unstale":"2024-09-13T17:11:48.790388+0000","last_undegraded":"2024-09-13T17:11:48.790388+0000","last_fullsized":"2024-09-13T17:11:48.790388+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:18.335183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.795992+0000","last_change":"2024-09-13T17:11:23.341743+0000","last_active":"2024-09-13T17:11:48.795992+0000","last_peered":"2024-09-13T17:11:48.795992+0000","last_clean":"2024-09-13T17:11:48.795992+0000","last_became_active":"2024-09-13T17:11:23.341200+0000","last_became_peered":"2024-09-13T17:11:23.341200+0000","last_unstale":"2024-09-13T17:11:48.795992+0000","last_undegraded":"2024-09-13T17:11:48.795992+0000","last_fullsized":"2024-09-13T17:11:48.795992+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:41.854013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'3","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.800911+0000","last_change":"2024-09-13T17:11:22.997571+0000","last_active":"2024-09-13T17:11:48.800911+0000","last_peered":"2024-09-13T17:11:48.800911+0000","last_clean":"2024-09-13T17:11:48.800911+0000","last_became_active":"2024-09-13T17:11:22.997238+0000","last_became_peered":"2024-09-13T17:11:22.997238+0000","last_unstale":"2024-09-13T17:11:48.800911+0000","last_undegraded":"2024-09-13T17:11:48.800911+0000","last_fullsized":"2024-09-13T17:11:48.800911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:34.533004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794718+0000","last_change":"2024-09-13T17:11:27.356892+0000","last_active":"2024-09-13T17:11:48.794718+0000","last_peered":"2024-09-13T17:11:48.794718+0000","last_clean":"2024-09-13T17:11:48.794718+0000","last_became_active":"2024-09-13T17:11:27.356136+0000","last_became_peered":"2024-09-13T17:11:27.356136+0000","last_unstale":"2024-09-13T17:11:48.794718+0000","last_undegraded":"2024-09-13T17:11:48.794718+0000","last_fullsized":"2024-09-13T17:11:48.794718+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:23.207064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.796238+0000","last_change":"2024-09-13T17:11:23.337666+0000","last_active":"2024-09-13T17:11:48.796238+0000","last_peered":"2024-09-13T17:11:48.796238+0000","last_clean":"2024-09-13T17:11:48.796238+0000","last_became_active":"2024-09-13T17:11:23.337185+0000","last_became_peered":"2024-09-13T17:11:23.337185+0000","last_unstale":"2024-09-13T17:11:48.796238+0000","last_undegraded":"2024-09-13T17:11:48.796238+0000","last_fullsized":"2024-09-13T17:11:48.796238+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:51.266709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792201+0000","last_change":"2024-09-13T17:11:23.005075+0000","last_active":"2024-09-13T17:11:48.792201+0000","last_peered":"2024-09-13T17:11:48.792201+0000","last_clean":"2024-09-13T17:11:48.792201+0000","last_became_active":"2024-09-13T17:11:23.004778+0000","last_became_peered":"2024-09-13T17:11:23.004778+0000","last_unstale":"2024-09-13T17:11:48.792201+0000","last_undegraded":"2024-09-13T17:11:48.792201+0000","last_fullsized":"2024-09-13T17:11:48.792201+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:06.763552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801204+0000","last_change":"2024-09-13T17:11:27.353601+0000","last_active":"2024-09-13T17:11:48.801204+0000","last_peered":"2024-09-13T17:11:48.801204+0000","last_clean":"2024-09-13T17:11:48.801204+0000","last_became_active":"2024-09-13T17:11:27.353190+0000","last_became_peered":"2024-09-13T17:11:27.353190+0000","last_unstale":"2024-09-13T17:11:48.801204+0000","last_undegraded":"2024-09-13T17:11:48.801204+0000","last_fullsized":"2024-09-13T17:11:48.801204+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:24.645552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.799773+0000","last_change":"2024-09-13T17:11:49.799773+0000","last_active":"2024-09-13T17:11:49.799773+0000","last_peered":"2024-09-13T17:11:49.799773+0000","last_clean":"2024-09-13T17:11:49.799773+0000","last_became_active":"2024-09-13T17:11:49.799402+0000","last_became_peered":"2024-09-13T17:11:49.799402+0000","last_unstale":"2024-09-13T17:11:49.799773+0000","last_undegraded":"2024-09-13T17:11:49.799773+0000","last_fullsized":"2024-09-13T17:11:49.799773+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:37.230144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.803208+0000","last_change":"2024-09-13T17:11:23.005619+0000","last_active":"2024-09-13T17:11:48.803208+0000","last_peered":"2024-09-13T17:11:48.803208+0000","last_clean":"2024-09-13T17:11:48.803208+0000","last_became_active":"2024-09-13T17:11:23.005077+0000","last_became_peered":"2024-09-13T17:11:23.005077+0000","last_unstale":"2024-09-13T17:11:48.803208+0000","last_undegraded":"2024-09-13T17:11:48.803208+0000","last_fullsized":"2024-09-13T17:11:48.803208+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:51.739773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792374+0000","last_change":"2024-09-13T17:11:27.364603+0000","last_active":"2024-09-13T17:11:48.792374+0000","last_peered":"2024-09-13T17:11:48.792374+0000","last_clean":"2024-09-13T17:11:48.792374+0000","last_became_active":"2024-09-13T17:11:27.364226+0000","last_became_peered":"2024-09-13T17:11:27.364226+0000","last_unstale":"2024-09-13T17:11:48.792374+0000","last_undegraded":"2024-09-13T17:11:48.792374+0000","last_fullsized":"2024-09-13T17:11:48.792374+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:56.802016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799662+0000","last_change":"2024-09-13T17:11:23.338657+0000","last_active":"2024-09-13T17:11:48.799662+0000","last_peered":"2024-09-13T17:11:48.799662+0000","last_clean":"2024-09-13T17:11:48.799662+0000","last_became_active":"2024-09-13T17:11:23.338377+0000","last_became_peered":"2024-09-13T17:11:23.338377+0000","last_unstale":"2024-09-13T17:11:48.799662+0000","last_undegraded":"2024-09-13T17:11:48.799662+0000","last_fullsized":"2024-09-13T17:11:48.799662+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:52.412887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'23","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.114064+0000","last_change":"2024-09-13T17:11:22.998541+0000","last_active":"2024-09-13T17:11:49.114064+0000","last_peered":"2024-09-13T17:11:49.114064+0000","last_clean":"2024-09-13T17:11:49.114064+0000","last_became_active":"2024-09-13T17:11:22.998132+0000","last_became_peered":"2024-09-13T17:11:22.998132+0000","last_unstale":"2024-09-13T17:11:49.114064+0000","last_undegraded":"2024-09-13T17:11:49.114064+0000","last_fullsized":"2024-09-13T17:11:49.114064+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:16.777772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40425,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":26,"num_write":24,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794245+0000","last_change":"2024-09-13T17:11:27.361917+0000","last_active":"2024-09-13T17:11:48.794245+0000","last_peered":"2024-09-13T17:11:48.794245+0000","last_clean":"2024-09-13T17:11:48.794245+0000","last_became_active":"2024-09-13T17:11:27.361503+0000","last_became_peered":"2024-09-13T17:11:27.361503+0000","last_unstale":"2024-09-13T17:11:48.794245+0000","last_undegraded":"2024-09-13T17:11:48.794245+0000","last_fullsized":"2024-09-13T17:11:48.794245+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:52.959017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.798971+0000","last_change":"2024-09-13T17:11:49.798971+0000","last_active":"2024-09-13T17:11:49.798971+0000","last_peered":"2024-09-13T17:11:49.798971+0000","last_clean":"2024-09-13T17:11:49.798971+0000","last_became_active":"2024-09-13T17:11:49.798597+0000","last_became_peered":"2024-09-13T17:11:49.798597+0000","last_unstale":"2024-09-13T17:11:49.798971+0000","last_undegraded":"2024-09-13T17:11:49.798971+0000","last_fullsized":"2024-09-13T17:11:49.798971+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:41.886456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792661+0000","last_change":"2024-09-13T17:11:23.004059+0000","last_active":"2024-09-13T17:11:48.792661+0000","last_peered":"2024-09-13T17:11:48.792661+0000","last_clean":"2024-09-13T17:11:48.792661+0000","last_became_active":"2024-09-13T17:11:23.003248+0000","last_became_peered":"2024-09-13T17:11:23.003248+0000","last_unstale":"2024-09-13T17:11:48.792661+0000","last_undegraded":"2024-09-13T17:11:48.792661+0000","last_fullsized":"2024-09-13T17:11:48.792661+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:05.496872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537877+0000","last_change":"2024-09-13T17:11:27.362880+0000","last_active":"2024-09-13T17:11:29.537877+0000","last_peered":"2024-09-13T17:11:29.537877+0000","last_clean":"2024-09-13T17:11:29.537877+0000","last_became_active":"2024-09-13T17:11:27.362471+0000","last_became_peered":"2024-09-13T17:11:27.362471+0000","last_unstale":"2024-09-13T17:11:29.537877+0000","last_undegraded":"2024-09-13T17:11:29.537877+0000","last_fullsized":"2024-09-13T17:11:29.537877+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:49.964606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"peering","last_fresh":"2024-09-13T17:11:48.798762+0000","last_change":"2024-09-13T17:11:48.798906+0000","last_active":"2024-09-13T17:11:48.798762+0000","last_peered":"2024-09-13T17:11:27.833117+0000","last_clean":"2024-09-13T17:11:27.833117+0000","last_became_active":"2024-09-13T17:11:23.332871+0000","last_became_peered":"2024-09-13T17:11:23.332871+0000","last_unstale":"2024-09-13T17:11:48.798762+0000","last_undegraded":"2024-09-13T17:11:48.798762+0000","last_fullsized":"2024-09-13T17:11:48.798762+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:27.370999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,7],"acting":[0,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,5,7,8],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.795575+0000","last_change":"2024-09-13T17:11:22.999158+0000","last_active":"2024-09-13T17:11:48.795575+0000","last_peered":"2024-09-13T17:11:48.795575+0000","last_clean":"2024-09-13T17:11:48.795575+0000","last_became_active":"2024-09-13T17:11:22.998795+0000","last_became_peered":"2024-09-13T17:11:22.998795+0000","last_unstale":"2024-09-13T17:11:48.795575+0000","last_undegraded":"2024-09-13T17:11:48.795575+0000","last_fullsized":"2024-09-13T17:11:48.795575+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:23.880769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792383+0000","last_change":"2024-09-13T17:11:27.358105+0000","last_active":"2024-09-13T17:11:48.792383+0000","last_peered":"2024-09-13T17:11:48.792383+0000","last_clean":"2024-09-13T17:11:48.792383+0000","last_became_active":"2024-09-13T17:11:27.357740+0000","last_became_peered":"2024-09-13T17:11:27.357740+0000","last_unstale":"2024-09-13T17:11:48.792383+0000","last_undegraded":"2024-09-13T17:11:48.792383+0000","last_fullsized":"2024-09-13T17:11:48.792383+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:44.837353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792441+0000","last_change":"2024-09-13T17:11:23.338736+0000","last_active":"2024-09-13T17:11:48.792441+0000","last_peered":"2024-09-13T17:11:48.792441+0000","last_clean":"2024-09-13T17:11:48.792441+0000","last_became_active":"2024-09-13T17:11:23.338462+0000","last_became_peered":"2024-09-13T17:11:23.338462+0000","last_unstale":"2024-09-13T17:11:48.792441+0000","last_undegraded":"2024-09-13T17:11:48.792441+0000","last_fullsized":"2024-09-13T17:11:48.792441+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:49.221314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'3","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.800595+0000","last_change":"2024-09-13T17:11:23.001966+0000","last_active":"2024-09-13T17:11:48.800595+0000","last_peered":"2024-09-13T17:11:48.800595+0000","last_clean":"2024-09-13T17:11:48.800595+0000","last_became_active":"2024-09-13T17:11:23.001565+0000","last_became_peered":"2024-09-13T17:11:23.001565+0000","last_unstale":"2024-09-13T17:11:48.800595+0000","last_undegraded":"2024-09-13T17:11:48.800595+0000","last_fullsized":"2024-09-13T17:11:48.800595+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:47.240702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792942+0000","last_change":"2024-09-13T17:11:27.360896+0000","last_active":"2024-09-13T17:11:48.792942+0000","last_peered":"2024-09-13T17:11:48.792942+0000","last_clean":"2024-09-13T17:11:48.792942+0000","last_became_active":"2024-09-13T17:11:27.360552+0000","last_became_peered":"2024-09-13T17:11:27.360552+0000","last_unstale":"2024-09-13T17:11:48.792942+0000","last_undegraded":"2024-09-13T17:11:48.792942+0000","last_fullsized":"2024-09-13T17:11:48.792942+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:08.726724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.108810+0000","last_change":"2024-09-13T17:11:27.356317+0000","last_active":"2024-09-13T17:11:29.108810+0000","last_peered":"2024-09-13T17:11:29.108810+0000","last_clean":"2024-09-13T17:11:29.108810+0000","last_became_active":"2024-09-13T17:11:27.355863+0000","last_became_peered":"2024-09-13T17:11:27.355863+0000","last_unstale":"2024-09-13T17:11:29.108810+0000","last_undegraded":"2024-09-13T17:11:29.108810+0000","last_fullsized":"2024-09-13T17:11:29.108810+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:29.356048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.793992+0000","last_change":"2024-09-13T17:11:23.344929+0000","last_active":"2024-09-13T17:11:48.793992+0000","last_peered":"2024-09-13T17:11:48.793992+0000","last_clean":"2024-09-13T17:11:48.793992+0000","last_became_active":"2024-09-13T17:11:23.344627+0000","last_became_peered":"2024-09-13T17:11:23.344627+0000","last_unstale":"2024-09-13T17:11:48.793992+0000","last_undegraded":"2024-09-13T17:11:48.793992+0000","last_fullsized":"2024-09-13T17:11:48.793992+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:15.049627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792723+0000","last_change":"2024-09-13T17:11:23.002539+0000","last_active":"2024-09-13T17:11:48.792723+0000","last_peered":"2024-09-13T17:11:48.792723+0000","last_clean":"2024-09-13T17:11:48.792723+0000","last_became_active":"2024-09-13T17:11:23.002206+0000","last_became_peered":"2024-09-13T17:11:23.002206+0000","last_unstale":"2024-09-13T17:11:48.792723+0000","last_undegraded":"2024-09-13T17:11:48.792723+0000","last_fullsized":"2024-09-13T17:11:48.792723+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:57.708167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801253+0000","last_change":"2024-09-13T17:11:27.362667+0000","last_active":"2024-09-13T17:11:48.801253+0000","last_peered":"2024-09-13T17:11:48.801253+0000","last_clean":"2024-09-13T17:11:48.801253+0000","last_became_active":"2024-09-13T17:11:27.362293+0000","last_became_peered":"2024-09-13T17:11:27.362293+0000","last_unstale":"2024-09-13T17:11:48.801253+0000","last_undegraded":"2024-09-13T17:11:48.801253+0000","last_fullsized":"2024-09-13T17:11:48.801253+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:24.446951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.793137+0000","last_change":"2024-09-13T17:11:23.335823+0000","last_active":"2024-09-13T17:11:48.793137+0000","last_peered":"2024-09-13T17:11:48.793137+0000","last_clean":"2024-09-13T17:11:48.793137+0000","last_became_active":"2024-09-13T17:11:23.335491+0000","last_became_peered":"2024-09-13T17:11:23.335491+0000","last_unstale":"2024-09-13T17:11:48.793137+0000","last_undegraded":"2024-09-13T17:11:48.793137+0000","last_fullsized":"2024-09-13T17:11:48.793137+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:42.172559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.789870+0000","last_change":"2024-09-13T17:11:22.999477+0000","last_active":"2024-09-13T17:11:48.789870+0000","last_peered":"2024-09-13T17:11:48.789870+0000","last_clean":"2024-09-13T17:11:48.789870+0000","last_became_active":"2024-09-13T17:11:22.999175+0000","last_became_peered":"2024-09-13T17:11:22.999175+0000","last_unstale":"2024-09-13T17:11:48.789870+0000","last_undegraded":"2024-09-13T17:11:48.789870+0000","last_fullsized":"2024-09-13T17:11:48.789870+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:03.817508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.178558+0000","last_change":"2024-09-13T17:11:23.001737+0000","last_active":"2024-09-13T17:11:47.178558+0000","last_peered":"2024-09-13T17:11:47.178558+0000","last_clean":"2024-09-13T17:11:47.178558+0000","last_became_active":"2024-09-13T17:11:23.001296+0000","last_became_peered":"2024-09-13T17:11:23.001296+0000","last_unstale":"2024-09-13T17:11:47.178558+0000","last_undegraded":"2024-09-13T17:11:47.178558+0000","last_fullsized":"2024-09-13T17:11:47.178558+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:08.671244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792018+0000","last_change":"2024-09-13T17:11:23.337738+0000","last_active":"2024-09-13T17:11:48.792018+0000","last_peered":"2024-09-13T17:11:48.792018+0000","last_clean":"2024-09-13T17:11:48.792018+0000","last_became_active":"2024-09-13T17:11:23.337411+0000","last_became_peered":"2024-09-13T17:11:23.337411+0000","last_unstale":"2024-09-13T17:11:48.792018+0000","last_undegraded":"2024-09-13T17:11:48.792018+0000","last_fullsized":"2024-09-13T17:11:48.792018+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:02.355706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.803213+0000","last_change":"2024-09-13T17:11:27.363174+0000","last_active":"2024-09-13T17:11:48.803213+0000","last_peered":"2024-09-13T17:11:48.803213+0000","last_clean":"2024-09-13T17:11:48.803213+0000","last_became_active":"2024-09-13T17:11:27.362158+0000","last_became_peered":"2024-09-13T17:11:27.362158+0000","last_unstale":"2024-09-13T17:11:48.803213+0000","last_undegraded":"2024-09-13T17:11:48.803213+0000","last_fullsized":"2024-09-13T17:11:48.803213+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:49:52.892616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'6","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:50.806879+0000","last_change":"2024-09-13T17:11:23.000544+0000","last_active":"2024-09-13T17:11:50.806879+0000","last_peered":"2024-09-13T17:11:50.806879+0000","last_clean":"2024-09-13T17:11:50.806879+0000","last_became_active":"2024-09-13T17:11:23.000233+0000","last_became_peered":"2024-09-13T17:11:23.000233+0000","last_unstale":"2024-09-13T17:11:50.806879+0000","last_undegraded":"2024-09-13T17:11:50.806879+0000","last_fullsized":"2024-09-13T17:11:50.806879+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:04.745950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":966,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799756+0000","last_change":"2024-09-13T17:11:23.340104+0000","last_active":"2024-09-13T17:11:48.799756+0000","last_peered":"2024-09-13T17:11:48.799756+0000","last_clean":"2024-09-13T17:11:48.799756+0000","last_became_active":"2024-09-13T17:11:23.339826+0000","last_became_peered":"2024-09-13T17:11:23.339826+0000","last_unstale":"2024-09-13T17:11:48.799756+0000","last_undegraded":"2024-09-13T17:11:48.799756+0000","last_fullsized":"2024-09-13T17:11:48.799756+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:03.101547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.803194+0000","last_change":"2024-09-13T17:11:27.360848+0000","last_active":"2024-09-13T17:11:48.803194+0000","last_peered":"2024-09-13T17:11:48.803194+0000","last_clean":"2024-09-13T17:11:48.803194+0000","last_became_active":"2024-09-13T17:11:27.360416+0000","last_became_peered":"2024-09-13T17:11:27.360416+0000","last_unstale":"2024-09-13T17:11:48.803194+0000","last_undegraded":"2024-09-13T17:11:48.803194+0000","last_fullsized":"2024-09-13T17:11:48.803194+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:06.857649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.800926+0000","last_change":"2024-09-13T17:11:23.334723+0000","last_active":"2024-09-13T17:11:48.800926+0000","last_peered":"2024-09-13T17:11:48.800926+0000","last_clean":"2024-09-13T17:11:48.800926+0000","last_became_active":"2024-09-13T17:11:23.334433+0000","last_became_peered":"2024-09-13T17:11:23.334433+0000","last_unstale":"2024-09-13T17:11:48.800926+0000","last_undegraded":"2024-09-13T17:11:48.800926+0000","last_fullsized":"2024-09-13T17:11:48.800926+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:08.657151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.803139+0000","last_change":"2024-09-13T17:11:23.334882+0000","last_active":"2024-09-13T17:11:48.803139+0000","last_peered":"2024-09-13T17:11:48.803139+0000","last_clean":"2024-09-13T17:11:48.803139+0000","last_became_active":"2024-09-13T17:11:23.334610+0000","last_became_peered":"2024-09-13T17:11:23.334610+0000","last_unstale":"2024-09-13T17:11:48.803139+0000","last_undegraded":"2024-09-13T17:11:48.803139+0000","last_fullsized":"2024-09-13T17:11:48.803139+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:03.932181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.802945+0000","last_change":"2024-09-13T17:11:23.334076+0000","last_active":"2024-09-13T17:11:48.802945+0000","last_peered":"2024-09-13T17:11:48.802945+0000","last_clean":"2024-09-13T17:11:48.802945+0000","last_became_active":"2024-09-13T17:11:23.333801+0000","last_became_peered":"2024-09-13T17:11:23.333801+0000","last_unstale":"2024-09-13T17:11:48.802945+0000","last_undegraded":"2024-09-13T17:11:48.802945+0000","last_fullsized":"2024-09-13T17:11:48.802945+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:07.113045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832811+0000","last_change":"2024-09-13T17:11:23.332306+0000","last_active":"2024-09-13T17:11:27.832811+0000","last_peered":"2024-09-13T17:11:27.832811+0000","last_clean":"2024-09-13T17:11:27.832811+0000","last_became_active":"2024-09-13T17:11:23.331913+0000","last_became_peered":"2024-09-13T17:11:23.331913+0000","last_unstale":"2024-09-13T17:11:27.832811+0000","last_undegraded":"2024-09-13T17:11:27.832811+0000","last_fullsized":"2024-09-13T17:11:27.832811+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:02.927286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.790286+0000","last_change":"2024-09-13T17:11:23.335512+0000","last_active":"2024-09-13T17:11:48.790286+0000","last_peered":"2024-09-13T17:11:48.790286+0000","last_clean":"2024-09-13T17:11:48.790286+0000","last_became_active":"2024-09-13T17:11:23.335201+0000","last_became_peered":"2024-09-13T17:11:23.335201+0000","last_unstale":"2024-09-13T17:11:48.790286+0000","last_undegraded":"2024-09-13T17:11:48.790286+0000","last_fullsized":"2024-09-13T17:11:48.790286+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:17.263819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801579+0000","last_change":"2024-09-13T17:11:23.341204+0000","last_active":"2024-09-13T17:11:48.801579+0000","last_peered":"2024-09-13T17:11:48.801579+0000","last_clean":"2024-09-13T17:11:48.801579+0000","last_became_active":"2024-09-13T17:11:23.339848+0000","last_became_peered":"2024-09-13T17:11:23.339848+0000","last_unstale":"2024-09-13T17:11:48.801579+0000","last_undegraded":"2024-09-13T17:11:48.801579+0000","last_fullsized":"2024-09-13T17:11:48.801579+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:15:09.480651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.803495+0000","last_change":"2024-09-13T17:11:23.334741+0000","last_active":"2024-09-13T17:11:48.803495+0000","last_peered":"2024-09-13T17:11:48.803495+0000","last_clean":"2024-09-13T17:11:48.803495+0000","last_became_active":"2024-09-13T17:11:23.334459+0000","last_became_peered":"2024-09-13T17:11:23.334459+0000","last_unstale":"2024-09-13T17:11:48.803495+0000","last_undegraded":"2024-09-13T17:11:48.803495+0000","last_fullsized":"2024-09-13T17:11:48.803495+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:52.379735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794473+0000","last_change":"2024-09-13T17:11:23.337869+0000","last_active":"2024-09-13T17:11:48.794473+0000","last_peered":"2024-09-13T17:11:48.794473+0000","last_clean":"2024-09-13T17:11:48.794473+0000","last_became_active":"2024-09-13T17:11:23.337581+0000","last_became_peered":"2024-09-13T17:11:23.337581+0000","last_unstale":"2024-09-13T17:11:48.794473+0000","last_undegraded":"2024-09-13T17:11:48.794473+0000","last_fullsized":"2024-09-13T17:11:48.794473+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:49.407474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.798177+0000","last_change":"2024-09-13T17:11:49.797828+0000","last_active":"2024-09-13T17:11:49.798177+0000","last_peered":"2024-09-13T17:11:49.798177+0000","last_clean":"2024-09-13T17:11:49.798177+0000","last_became_active":"2024-09-13T17:11:49.797504+0000","last_became_peered":"2024-09-13T17:11:49.797504+0000","last_unstale":"2024-09-13T17:11:49.798177+0000","last_undegraded":"2024-09-13T17:11:49.798177+0000","last_fullsized":"2024-09-13T17:11:49.798177+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:29.677936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.793118+0000","last_change":"2024-09-13T17:11:23.336713+0000","last_active":"2024-09-13T17:11:48.793118+0000","last_peered":"2024-09-13T17:11:48.793118+0000","last_clean":"2024-09-13T17:11:48.793118+0000","last_became_active":"2024-09-13T17:11:23.336431+0000","last_became_peered":"2024-09-13T17:11:23.336431+0000","last_unstale":"2024-09-13T17:11:48.793118+0000","last_undegraded":"2024-09-13T17:11:48.793118+0000","last_fullsized":"2024-09-13T17:11:48.793118+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:52.709483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.791904+0000","last_change":"2024-09-13T17:11:23.340385+0000","last_active":"2024-09-13T17:11:48.791904+0000","last_peered":"2024-09-13T17:11:48.791904+0000","last_clean":"2024-09-13T17:11:48.791904+0000","last_became_active":"2024-09-13T17:11:23.340068+0000","last_became_peered":"2024-09-13T17:11:23.340068+0000","last_unstale":"2024-09-13T17:11:48.791904+0000","last_undegraded":"2024-09-13T17:11:48.791904+0000","last_fullsized":"2024-09-13T17:11:48.791904+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:17.795222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.790214+0000","last_change":"2024-09-13T17:11:23.329214+0000","last_active":"2024-09-13T17:11:48.790214+0000","last_peered":"2024-09-13T17:11:48.790214+0000","last_clean":"2024-09-13T17:11:48.790214+0000","last_became_active":"2024-09-13T17:11:23.328747+0000","last_became_peered":"2024-09-13T17:11:23.328747+0000","last_unstale":"2024-09-13T17:11:48.790214+0000","last_undegraded":"2024-09-13T17:11:48.790214+0000","last_fullsized":"2024-09-13T17:11:48.790214+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:11.233652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801419+0000","last_change":"2024-09-13T17:11:23.339854+0000","last_active":"2024-09-13T17:11:48.801419+0000","last_peered":"2024-09-13T17:11:48.801419+0000","last_clean":"2024-09-13T17:11:48.801419+0000","last_became_active":"2024-09-13T17:11:23.339565+0000","last_became_peered":"2024-09-13T17:11:23.339565+0000","last_unstale":"2024-09-13T17:11:48.801419+0000","last_undegraded":"2024-09-13T17:11:48.801419+0000","last_fullsized":"2024-09-13T17:11:48.801419+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:37.161135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.803426+0000","last_change":"2024-09-13T17:11:23.342562+0000","last_active":"2024-09-13T17:11:48.803426+0000","last_peered":"2024-09-13T17:11:48.803426+0000","last_clean":"2024-09-13T17:11:48.803426+0000","last_became_active":"2024-09-13T17:11:23.342256+0000","last_became_peered":"2024-09-13T17:11:23.342256+0000","last_unstale":"2024-09-13T17:11:48.803426+0000","last_undegraded":"2024-09-13T17:11:48.803426+0000","last_fullsized":"2024-09-13T17:11:48.803426+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:30.788242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.795154+0000","last_change":"2024-09-13T17:11:23.342436+0000","last_active":"2024-09-13T17:11:48.795154+0000","last_peered":"2024-09-13T17:11:48.795154+0000","last_clean":"2024-09-13T17:11:48.795154+0000","last_became_active":"2024-09-13T17:11:23.342157+0000","last_became_peered":"2024-09-13T17:11:23.342157+0000","last_unstale":"2024-09-13T17:11:48.795154+0000","last_undegraded":"2024-09-13T17:11:48.795154+0000","last_fullsized":"2024-09-13T17:11:48.795154+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:56.550875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801559+0000","last_change":"2024-09-13T17:11:23.341660+0000","last_active":"2024-09-13T17:11:48.801559+0000","last_peered":"2024-09-13T17:11:48.801559+0000","last_clean":"2024-09-13T17:11:48.801559+0000","last_became_active":"2024-09-13T17:11:23.341102+0000","last_became_peered":"2024-09-13T17:11:23.341102+0000","last_unstale":"2024-09-13T17:11:48.801559+0000","last_undegraded":"2024-09-13T17:11:48.801559+0000","last_fullsized":"2024-09-13T17:11:48.801559+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:00.546907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.791477+0000","last_change":"2024-09-13T17:11:23.338064+0000","last_active":"2024-09-13T17:11:48.791477+0000","last_peered":"2024-09-13T17:11:48.791477+0000","last_clean":"2024-09-13T17:11:48.791477+0000","last_became_active":"2024-09-13T17:11:23.337748+0000","last_became_peered":"2024-09-13T17:11:23.337748+0000","last_unstale":"2024-09-13T17:11:48.791477+0000","last_undegraded":"2024-09-13T17:11:48.791477+0000","last_fullsized":"2024-09-13T17:11:48.791477+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:14.281629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832520+0000","last_change":"2024-09-13T17:11:23.335684+0000","last_active":"2024-09-13T17:11:27.832520+0000","last_peered":"2024-09-13T17:11:27.832520+0000","last_clean":"2024-09-13T17:11:27.832520+0000","last_became_active":"2024-09-13T17:11:23.335364+0000","last_became_peered":"2024-09-13T17:11:23.335364+0000","last_unstale":"2024-09-13T17:11:27.832520+0000","last_undegraded":"2024-09-13T17:11:27.832520+0000","last_fullsized":"2024-09-13T17:11:27.832520+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:02.288009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832521+0000","last_change":"2024-09-13T17:11:23.340881+0000","last_active":"2024-09-13T17:11:27.832521+0000","last_peered":"2024-09-13T17:11:27.832521+0000","last_clean":"2024-09-13T17:11:27.832521+0000","last_became_active":"2024-09-13T17:11:23.340575+0000","last_became_peered":"2024-09-13T17:11:23.340575+0000","last_unstale":"2024-09-13T17:11:27.832521+0000","last_undegraded":"2024-09-13T17:11:27.832521+0000","last_fullsized":"2024-09-13T17:11:27.832521+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:40.757703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.790161+0000","last_change":"2024-09-13T17:11:23.329039+0000","last_active":"2024-09-13T17:11:48.790161+0000","last_peered":"2024-09-13T17:11:48.790161+0000","last_clean":"2024-09-13T17:11:48.790161+0000","last_became_active":"2024-09-13T17:11:23.328324+0000","last_became_peered":"2024-09-13T17:11:23.328324+0000","last_unstale":"2024-09-13T17:11:48.790161+0000","last_undegraded":"2024-09-13T17:11:48.790161+0000","last_fullsized":"2024-09-13T17:11:48.790161+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:37.882596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.833586+0000","last_change":"2024-09-13T17:11:23.345229+0000","last_active":"2024-09-13T17:11:27.833586+0000","last_peered":"2024-09-13T17:11:27.833586+0000","last_clean":"2024-09-13T17:11:27.833586+0000","last_became_active":"2024-09-13T17:11:23.344883+0000","last_became_peered":"2024-09-13T17:11:23.344883+0000","last_unstale":"2024-09-13T17:11:27.833586+0000","last_undegraded":"2024-09-13T17:11:27.833586+0000","last_fullsized":"2024-09-13T17:11:27.833586+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:47.983382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799023+0000","last_change":"2024-09-13T17:11:23.346338+0000","last_active":"2024-09-13T17:11:48.799023+0000","last_peered":"2024-09-13T17:11:48.799023+0000","last_clean":"2024-09-13T17:11:48.799023+0000","last_became_active":"2024-09-13T17:11:23.344777+0000","last_became_peered":"2024-09-13T17:11:23.344777+0000","last_unstale":"2024-09-13T17:11:48.799023+0000","last_undegraded":"2024-09-13T17:11:48.799023+0000","last_fullsized":"2024-09-13T17:11:48.799023+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:23.650174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"peering","last_fresh":"2024-09-13T17:11:48.800882+0000","last_change":"2024-09-13T17:11:48.801055+0000","last_active":"2024-09-13T17:11:48.800882+0000","last_peered":"2024-09-13T17:11:27.834681+0000","last_clean":"2024-09-13T17:11:27.834681+0000","last_became_active":"2024-09-13T17:11:23.334660+0000","last_became_peered":"2024-09-13T17:11:23.334660+0000","last_unstale":"2024-09-13T17:11:48.800882+0000","last_undegraded":"2024-09-13T17:11:48.800882+0000","last_fullsized":"2024-09-13T17:11:48.800882+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:32.110092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,4,9],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.791755+0000","last_change":"2024-09-13T17:11:23.340478+0000","last_active":"2024-09-13T17:11:48.791755+0000","last_peered":"2024-09-13T17:11:48.791755+0000","last_clean":"2024-09-13T17:11:48.791755+0000","last_became_active":"2024-09-13T17:11:23.339916+0000","last_became_peered":"2024-09-13T17:11:23.339916+0000","last_unstale":"2024-09-13T17:11:48.791755+0000","last_undegraded":"2024-09-13T17:11:48.791755+0000","last_fullsized":"2024-09-13T17:11:48.791755+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:09.477626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.793059+0000","last_change":"2024-09-13T17:11:23.340882+0000","last_active":"2024-09-13T17:11:48.793059+0000","last_peered":"2024-09-13T17:11:48.793059+0000","last_clean":"2024-09-13T17:11:48.793059+0000","last_became_active":"2024-09-13T17:11:23.340413+0000","last_became_peered":"2024-09-13T17:11:23.340413+0000","last_unstale":"2024-09-13T17:11:48.793059+0000","last_undegraded":"2024-09-13T17:11:48.793059+0000","last_fullsized":"2024-09-13T17:11:48.793059+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:49.040015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.796753+0000","last_change":"2024-09-13T17:11:23.345551+0000","last_active":"2024-09-13T17:11:48.796753+0000","last_peered":"2024-09-13T17:11:48.796753+0000","last_clean":"2024-09-13T17:11:48.796753+0000","last_became_active":"2024-09-13T17:11:23.345195+0000","last_became_peered":"2024-09-13T17:11:23.345195+0000","last_unstale":"2024-09-13T17:11:48.796753+0000","last_undegraded":"2024-09-13T17:11:48.796753+0000","last_fullsized":"2024-09-13T17:11:48.796753+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:00.856969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"peering","last_fresh":"2024-09-13T17:11:48.799086+0000","last_change":"2024-09-13T17:11:48.799241+0000","last_active":"2024-09-13T17:11:48.799086+0000","last_peered":"2024-09-13T17:11:27.834170+0000","last_clean":"2024-09-13T17:11:27.834170+0000","last_became_active":"2024-09-13T17:11:23.334061+0000","last_became_peered":"2024-09-13T17:11:23.334061+0000","last_unstale":"2024-09-13T17:11:48.799086+0000","last_undegraded":"2024-09-13T17:11:48.799086+0000","last_fullsized":"2024-09-13T17:11:48.799086+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:40.383855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,7,9],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799582+0000","last_change":"2024-09-13T17:11:23.340286+0000","last_active":"2024-09-13T17:11:48.799582+0000","last_peered":"2024-09-13T17:11:48.799582+0000","last_clean":"2024-09-13T17:11:48.799582+0000","last_became_active":"2024-09-13T17:11:23.339756+0000","last_became_peered":"2024-09-13T17:11:23.339756+0000","last_unstale":"2024-09-13T17:11:48.799582+0000","last_undegraded":"2024-09-13T17:11:48.799582+0000","last_fullsized":"2024-09-13T17:11:48.799582+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:00.463087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.833501+0000","last_change":"2024-09-13T17:11:23.339818+0000","last_active":"2024-09-13T17:11:27.833501+0000","last_peered":"2024-09-13T17:11:27.833501+0000","last_clean":"2024-09-13T17:11:27.833501+0000","last_became_active":"2024-09-13T17:11:23.339501+0000","last_became_peered":"2024-09-13T17:11:23.339501+0000","last_unstale":"2024-09-13T17:11:27.833501+0000","last_undegraded":"2024-09-13T17:11:27.833501+0000","last_fullsized":"2024-09-13T17:11:27.833501+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:36.904004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832723+0000","last_change":"2024-09-13T17:11:23.334388+0000","last_active":"2024-09-13T17:11:27.832723+0000","last_peered":"2024-09-13T17:11:27.832723+0000","last_clean":"2024-09-13T17:11:27.832723+0000","last_became_active":"2024-09-13T17:11:23.333953+0000","last_became_peered":"2024-09-13T17:11:23.333953+0000","last_unstale":"2024-09-13T17:11:27.832723+0000","last_undegraded":"2024-09-13T17:11:27.832723+0000","last_fullsized":"2024-09-13T17:11:27.832723+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:33.929173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832701+0000","last_change":"2024-09-13T17:11:23.338259+0000","last_active":"2024-09-13T17:11:27.832701+0000","last_peered":"2024-09-13T17:11:27.832701+0000","last_clean":"2024-09-13T17:11:27.832701+0000","last_became_active":"2024-09-13T17:11:23.337979+0000","last_became_peered":"2024-09-13T17:11:23.337979+0000","last_unstale":"2024-09-13T17:11:27.832701+0000","last_undegraded":"2024-09-13T17:11:27.832701+0000","last_fullsized":"2024-09-13T17:11:27.832701+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:55.750255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801517+0000","last_change":"2024-09-13T17:11:23.337899+0000","last_active":"2024-09-13T17:11:48.801517+0000","last_peered":"2024-09-13T17:11:48.801517+0000","last_clean":"2024-09-13T17:11:48.801517+0000","last_became_active":"2024-09-13T17:11:23.337626+0000","last_became_peered":"2024-09-13T17:11:23.337626+0000","last_unstale":"2024-09-13T17:11:48.801517+0000","last_undegraded":"2024-09-13T17:11:48.801517+0000","last_fullsized":"2024-09-13T17:11:48.801517+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:14.654852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":44331,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":37,"num_read_kb":49,"num_write":143,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":142811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285958,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383698,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":995328,"data_stored":499901,"data_compressed":17667,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.35499999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.497}]},{"osd":2,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.58199999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.41799999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.50900000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.67700000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":9,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.52000000000000002}]},{"osd":10,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.60599999999999998}]}]},{"osd":10,"up_from":72,"seq":309237645334,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":1105920,"data_stored":1118312,"data_compressed":51052,"data_compressed_allocated":65536,"data_compressed_original":630784,"omap_allocated":1597,"internal_metadata":36043203},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.52200000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.374},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.39700000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.624},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.60899999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.54500000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.443}]},{"osd":6,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.70999999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.51200000000000001}]},{"osd":8,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.50900000000000001}]},{"osd":9,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.67500000000000004}]},{"osd":11,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.746}]}]},{"osd":9,"up_from":67,"seq":287762808859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":1015808,"data_stored":504233,"data_compressed":17667,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1597,"internal_metadata":31848899},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.39700000000000002,"15min":0.40699999999999997},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.311},{"interface":"front","average":{"1min":0.37,"5min":0.41799999999999998,"15min":0.42599999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.55700000000000005,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.33300000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54400000000000004,"15min":0.54700000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.67700000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56100000000000005,"15min":0.56799999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.67800000000000005,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.58399999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.59399999999999997,"15min":0.60799999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.66400000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.58099999999999996,"15min":0.59199999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.755,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.53100000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.48699999999999999,"15min":0.501},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.64300000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.378,"5min":0.49399999999999999,"15min":0.51300000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.58499999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.40100000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.39900000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76500000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.505},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.63,"15min":0.64200000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.78300000000000003,"5min":1.26,"15min":1.26},"last":0.65100000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.64400000000000002,"15min":0.66000000000000003},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.69599999999999995,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.64900000000000002,"15min":0.66900000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68200000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.59599999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.49299999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.68400000000000005,"15min":0.69899999999999995},"min":{"1min":0.46200000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.85499999999999998,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.68500000000000005,"15min":0.70099999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.78700000000000003,"5min":1.018,"15min":1.018},"last":0.624}]},{"osd":8,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.67700000000000005,"15min":0.68899999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.86499999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.622,"5min":0.70599999999999996,"15min":0.71999999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.84799999999999998,"5min":1.228,"15min":1.228},"last":0.57399999999999995}]},{"osd":10,"last update":"Fri Sep 13 17:11:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.68100000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]}]},{"osd":8,"up_from":59,"seq":253403070497,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":500057,"data_compressed":17667,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67600000000000005,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.65500000000000003,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.67500000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54300000000000004,"15min":0.54400000000000004},"min":{"1min":0.34599999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71799999999999997,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.79900000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.41899999999999998,"15min":0.41799999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.63100000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.441,"15min":0.438},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70899999999999996,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.68999999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.73899999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.81299999999999994}]},{"osd":5,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.753},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53400000000000003,"15min":0.53600000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76700000000000002,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.78000000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.64400000000000002,"15min":0.64900000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.85999999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64700000000000002,"15min":0.64600000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92200000000000004,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90900000000000003,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.94999999999999996}]},{"osd":9,"last update":"Fri Sep 13 17:10:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.873},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.84699999999999998}]},{"osd":10,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.92900000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]}]},{"osd":7,"up_from":51,"seq":219043332133,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1060864,"data_stored":1095871,"data_compressed":54026,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1587,"internal_metadata":27654605},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.39700000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.66200000000000003,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.35799999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.52500000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.35999999999999999,"15min":0.35399999999999998},"min":{"1min":0.25800000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.34999999999999998,"15min":0.34399999999999997},"min":{"1min":0.32200000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.312}]},{"osd":2,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52800000000000002,"15min":0.52100000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.51400000000000001,"15min":0.50700000000000001},"min":{"1min":0.39100000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.59499999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.51000000000000001,"15min":0.502},"min":{"1min":0.38100000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67500000000000004,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.497},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.53400000000000003},"min":{"1min":0.42899999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.47299999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46200000000000002,"15min":0.45700000000000002},"min":{"1min":0.29899999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.442,"15min":0.439},"min":{"1min":0.31900000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.33800000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.56899999999999995,"15min":0.56200000000000006},"min":{"1min":0.5,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57499999999999996,"15min":0.57199999999999995},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.57099999999999995}]},{"osd":6,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.44700000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.59799999999999998,"15min":0.58699999999999997},"min":{"1min":0.45600000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.46000000000000002}]},{"osd":8,"last update":"Fri Sep 13 17:11:31 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.63600000000000001,"15min":0.628},"min":{"1min":0.504,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.65300000000000002,"15min":0.64200000000000002},"min":{"1min":0.47899999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.66200000000000003}]},{"osd":9,"last update":"Fri Sep 13 17:11:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.68400000000000005,"15min":0.68799999999999994},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84799999999999998,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.438}]},{"osd":10,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.624}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]},{"osd":6,"up_from":46,"seq":197568495657,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":495313,"data_compressed":17667,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.34200000000000003,"15min":0.33500000000000002},"min":{"1min":0.23400000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.373,"15min":0.36899999999999999},"min":{"1min":0.26500000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.57399999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.41499999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.74199999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.63600000000000001,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.52900000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68999999999999995,"5min":1.095,"15min":1.095},"last":0.501},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54100000000000004,"15min":0.52600000000000002},"min":{"1min":0.35899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.77300000000000002,"5min":0.877,"15min":0.877},"last":0.51400000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.42199999999999999,"15min":0.41599999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.626,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.378},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41799999999999998,"15min":0.41199999999999998},"min":{"1min":0.28199999999999997,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58599999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.435}]},{"osd":4,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51000000000000001,"15min":0.502},"min":{"1min":0.41199999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71699999999999997,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.39200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76100000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.56200000000000006}]},{"osd":5,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.70599999999999996,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59599999999999997,"15min":0.60299999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.73999999999999999,"5min":1.131,"15min":1.131},"last":0.46100000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.62}]},{"osd":8,"last update":"Fri Sep 13 17:11:28 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.623,"15min":0.627},"min":{"1min":0.42399999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.85899999999999999,"5min":0.874,"15min":0.874},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.58099999999999996}]},{"osd":9,"last update":"Fri Sep 13 17:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.59099999999999997}]},{"osd":10,"last update":"Fri Sep 13 17:11:12 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.72099999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":5,"up_from":38,"seq":163208757294,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":1064960,"data_stored":1091176,"data_compressed":54026,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48399999999999999,"15min":0.47599999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67300000000000004,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48799999999999999,"15min":0.47999999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69499999999999995,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.5}]},{"osd":1,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55100000000000005,"15min":0.54400000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68600000000000005,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.371,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.67600000000000005,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.57099999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.377,"15min":0.371},"min":{"1min":0.23499999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.58699999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.374},{"interface":"front","average":{"1min":0.375,"5min":0.378,"15min":0.372},"min":{"1min":0.253,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.59099999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.33600000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50700000000000001,"15min":0.501},"min":{"1min":0.30199999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.69599999999999995,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.63800000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.47499999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73099999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56999999999999995,"15min":0.56000000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.63600000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:11:41 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56100000000000005,"15min":0.56000000000000005},"min":{"1min":0.39100000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.74199999999999999,"5min":0.749,"15min":0.749},"last":0.51700000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.46400000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.75},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.44,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.70399999999999996}]},{"osd":8,"last update":"Fri Sep 13 17:11:26 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52500000000000002,"15min":0.53100000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69199999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.622},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55800000000000005,"15min":0.56599999999999995},"min":{"1min":0.39800000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.70299999999999996,"5min":0.747,"15min":0.747},"last":0.56299999999999994}]},{"osd":9,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.624,"15min":0.62},"min":{"1min":0.47699999999999998,"5min":0.442,"15min":0.442},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.62,"15min":0.61499999999999999},"min":{"1min":0.45800000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.65300000000000002}]},{"osd":10,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.73699999999999999}]}]},{"osd":4,"up_from":33,"seq":141733920819,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36176,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708976,"statfs":{"total":95995035648,"available":95957991424,"internally_reserved":0,"allocated":987136,"data_stored":490408,"data_compressed":14693,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":0.71699999999999997,"15min":0.59099999999999997},"min":{"1min":0.42399999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":15.369999999999999,"5min":15.369999999999999,"15min":15.369999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":1.4950000000000001,"5min":0.68200000000000005,"15min":0.54400000000000004},"min":{"1min":0.45900000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":15.416,"5min":15.416,"15min":15.416},"last":0.35399999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.36499999999999999,"15min":0.35899999999999999},"min":{"1min":0.25900000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38600000000000001},"min":{"1min":0.28699999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.60099999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.34799999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":0.74099999999999999,"15min":0.61699999999999999},"min":{"1min":0.379,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":15.401,"5min":15.401,"15min":15.401},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.52900000000000003,"15min":0.51900000000000002},"min":{"1min":0.39500000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.745,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.47599999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53900000000000003,"15min":0.54900000000000004},"min":{"1min":0.375,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76900000000000002,"5min":1.016,"15min":1.016},"last":0.39100000000000001},{"interface":"front","average":{"1min":1.524,"5min":0.74099999999999999,"15min":0.61699999999999999},"min":{"1min":0.39400000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":15.425000000000001,"5min":15.425000000000001,"15min":15.425000000000001},"last":0.40699999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57299999999999995,"15min":0.56399999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77900000000000003,"5min":1.073,"15min":1.073},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.73399999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.53500000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.54800000000000004,"15min":0.51800000000000002},"min":{"1min":0.40200000000000002,"5min":0.371,"15min":0.371},"max":{"1min":2.6469999999999998,"5min":2.6469999999999998,"15min":2.6469999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57599999999999996,"15min":0.55600000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.45400000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:11:00 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48199999999999998,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69399999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.48299999999999998,"15min":0.47899999999999998},"min":{"1min":0.34399999999999997,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.49399999999999999}]},{"osd":8,"last update":"Fri Sep 13 17:11:26 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.65200000000000002,"15min":0.63900000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.577,"5min":2.577,"15min":2.577},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.65500000000000003,"15min":0.64600000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.60299999999999998}]},{"osd":9,"last update":"Fri Sep 13 17:10:49 2024","interfaces":[{"interface":"back","average":{"1min":1.615,"5min":1.615,"15min":1.615},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":15.448,"5min":15.448,"15min":15.448},"last":0.55500000000000005},{"interface":"front","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":15.385,"5min":15.385,"15min":15.385},"last":0.63}]},{"osd":10,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.51100000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]},{"osd":3,"up_from":25,"seq":107374182455,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":983040,"data_stored":485669,"data_compressed":14693,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34000000000000002,"15min":0.317},"min":{"1min":0.22500000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.34399999999999997,"15min":0.32200000000000001},"min":{"1min":0.23899999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.60899999999999999,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.40799999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52400000000000002,"15min":0.49399999999999999},"min":{"1min":0.32900000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78900000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51200000000000001,"15min":0.48299999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.60999999999999999,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.625}]},{"osd":2,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51500000000000001,"15min":0.496},"min":{"1min":0.34000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67800000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53800000000000003,"15min":0.50700000000000001},"min":{"1min":0.34200000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.73999999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.495}]},{"osd":4,"last update":"Fri Sep 13 17:10:55 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.53000000000000003,"15min":0.51400000000000001},"min":{"1min":0.372,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.53200000000000003,"15min":0.50700000000000001},"min":{"1min":0.40500000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.54800000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55900000000000005,"15min":0.55400000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70399999999999996,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.56000000000000005,"15min":0.56100000000000005},"min":{"1min":0.35199999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.754,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.47399999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:11:43 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.45200000000000001,"15min":0.44600000000000001},"min":{"1min":0.28199999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68000000000000005,"5min":0.746,"15min":0.746},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.45700000000000002,"15min":0.443},"min":{"1min":0.29499999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70199999999999996,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.46400000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:11:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58399999999999996,"15min":0.57799999999999996},"min":{"1min":0.42599999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.77500000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.45500000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.68500000000000005}]},{"osd":8,"last update":"Fri Sep 13 17:10:26 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66400000000000003}]},{"osd":9,"last update":"Fri Sep 13 17:11:49 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.625,"15min":0.63500000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.80100000000000005,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.63300000000000001,"15min":0.65200000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78800000000000003,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.52300000000000002}]},{"osd":10,"last update":"Fri Sep 13 17:11:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.65300000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":2,"up_from":18,"seq":77309411389,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":541687,"data_compressed":17667,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:09 2024","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":0.76600000000000001,"15min":0.73999999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":19.158999999999999,"5min":19.158999999999999,"15min":19.158999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.47599999999999998,"15min":0.46700000000000003},"min":{"1min":0.33700000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68500000000000005,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.75800000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:11:09 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.501,"15min":0.47499999999999998},"min":{"1min":0.38,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68600000000000005,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.498,"15min":0.46800000000000003},"min":{"1min":0.40100000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.54900000000000004}]},{"osd":3,"last update":"Fri Sep 13 17:11:36 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.51900000000000002,"15min":0.5},"min":{"1min":0.41299999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52700000000000002,"15min":0.50600000000000001},"min":{"1min":0.42999999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71899999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.79900000000000004}]},{"osd":4,"last update":"Fri Sep 13 17:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.51100000000000001},"min":{"1min":0.41499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72199999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.40300000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.65800000000000003,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.52800000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:11:14 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.39900000000000002,"15min":0.39100000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.64500000000000002,"5min":0.747,"15min":0.747},"last":0.374},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39800000000000002,"15min":0.39200000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.68799999999999994,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.41899999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:11:38 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54000000000000004},"min":{"1min":0.41699999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68300000000000005,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.746},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.69799999999999995,"15min":0.58699999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82499999999999996,"5min":19.276,"15min":19.276},"last":0.73399999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.36699999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76200000000000001,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.41699999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76600000000000001,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.61499999999999999}]},{"osd":8,"last update":"Fri Sep 13 17:11:25 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53700000000000003,"15min":0.53500000000000003},"min":{"1min":0.33100000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76000000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56399999999999995,"15min":0.56100000000000005},"min":{"1min":0.35799999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.70999999999999996}]},{"osd":9,"last update":"Fri Sep 13 17:11:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64400000000000002,"15min":0.63600000000000001},"min":{"1min":0.377,"5min":0.373,"15min":0.373},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":1.294,"15min":1.3939999999999999},"min":{"1min":0.436,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0409999999999999,"5min":19.210999999999999,"15min":19.210999999999999},"last":0.77300000000000002}]},{"osd":10,"last update":"Fri Sep 13 17:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":1.595,"5min":1.595,"15min":1.595},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":19.242000000000001,"5min":19.242000000000001,"15min":19.242000000000001},"last":0.78700000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":1024000,"data_stored":526414,"data_compressed":14693,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:53 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.47799999999999998,"15min":0.46200000000000002},"min":{"1min":0.35199999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.48199999999999998,"15min":0.46500000000000002},"min":{"1min":0.32700000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.48199999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:11:08 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.52800000000000002,"15min":0.504},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.76900000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.52100000000000002,"15min":0.503},"min":{"1min":0.375,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.64900000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:11:37 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70599999999999996,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54700000000000004,"15min":0.52800000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70299999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.52100000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:10:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.39500000000000002,"15min":0.377},"min":{"1min":0.29199999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.62},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.38100000000000001,"15min":0.36299999999999999},"min":{"1min":0.26600000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:11:21 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.52900000000000003,"15min":0.51300000000000001},"min":{"1min":0.35399999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.52600000000000002,"15min":0.502},"min":{"1min":0.39900000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.70099999999999996}]},{"osd":6,"last update":"Fri Sep 13 17:11:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54000000000000004,"15min":0.52400000000000002},"min":{"1min":0.38500000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73199999999999998,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.59499999999999997,"15min":0.57499999999999996},"min":{"1min":0.45700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.82799999999999996,"5min":0.88,"15min":0.88},"last":0.66000000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:11:00 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.48999999999999999,"15min":0.47599999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.49399999999999999,"15min":0.48399999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.56000000000000005}]},{"osd":8,"last update":"Fri Sep 13 17:11:26 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.626,"15min":0.61699999999999999},"min":{"1min":0.41599999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.754},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.67300000000000004,"15min":0.66300000000000003},"min":{"1min":0.44,"5min":0.434,"15min":0.434},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.76200000000000001}]},{"osd":9,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.72999999999999998}]},{"osd":10,"last update":"Fri Sep 13 17:11:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.77500000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":987136,"data_stored":477768,"data_compressed":11720,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:10:49 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.47299999999999998,"15min":0.46600000000000003},"min":{"1min":0.29899999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.49199999999999999,"15min":0.48099999999999998},"min":{"1min":0.28499999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.59399999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:11:08 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.52100000000000002,"15min":0.505},"min":{"1min":0.374,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77900000000000003,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.501},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.53000000000000003,"15min":0.50700000000000001},"min":{"1min":0.38100000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.624}]},{"osd":3,"last update":"Fri Sep 13 17:10:27 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.40999999999999998,"15min":0.40100000000000002},"min":{"1min":0.23499999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.432},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.39700000000000002,"15min":0.38900000000000001},"min":{"1min":0.26400000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.317}]},{"osd":4,"last update":"Fri Sep 13 17:10:55 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.496,"15min":0.47999999999999998},"min":{"1min":0.34100000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.52100000000000002,"15min":0.503},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Sep 13 17:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52100000000000002,"15min":0.50900000000000001},"min":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82399999999999995,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.54800000000000004,"15min":0.53000000000000003},"min":{"1min":0.42799999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80500000000000005,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.60799999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:11:41 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.433,"15min":0.41799999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.65100000000000002,"5min":0.754,"15min":0.754},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.44800000000000001,"15min":0.42999999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72899999999999998,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.376}]},{"osd":7,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.57999999999999996,"15min":0.57099999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.57599999999999996}]},{"osd":8,"last update":"Fri Sep 13 17:11:30 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.60499999999999998,"15min":0.60699999999999998},"min":{"1min":0.46500000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.77200000000000002,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.65200000000000002,"15min":0.65800000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90200000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.41899999999999998}]},{"osd":9,"last update":"Fri Sep 13 17:10:49 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.44500000000000001}]},{"osd":10,"last update":"Fri Sep 13 17:11:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.58499999999999996}]},{"osd":11,"last update":"Fri Sep 13 17:11:36 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.53700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34721,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34721,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34721,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":45625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":46737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":41955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:11:55.412 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.c is not active+clean 2024-09-13T17:11:55.413 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.c', 'version': "89'3", 'reported_seq': 2, 'reported_epoch': 90, 'state': 'peering', 'last_fresh': '2024-09-13T17:11:27.684094+0000', 'last_change': '2024-09-13T17:11:49.540357+0000', 'last_active': '2024-09-13T17:11:49.540357+0000', 'last_peered': '2024-09-13T17:11:27.684094+0000', 'last_clean': '2024-09-13T17:11:27.684094+0000', 'last_became_active': '2024-09-13T17:11:23.003102+0000', 'last_became_peered': '2024-09-13T17:11:23.003102+0000', 'last_unstale': '2024-09-13T17:11:27.684094+0000', 'last_undegraded': '2024-09-13T17:11:27.684094+0000', 'last_fullsized': '2024-09-13T17:11:27.684094+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 83, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:11:21.965914+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:11:21.965914+0000', 'last_clean_scrub_stamp': '2024-09-13T17:11:21.965914+0000', 'objects_scrubbed': 0, 'log_size': 3, 'log_dups_size': 0, 'ondisk_log_size': 3, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:09:08.827045+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 582, 'num_objects': 2, 'num_object_clones': 0, 'num_object_copies': 6, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 2, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 2, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 4, 'num_write_kb': 1, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 1, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 11, 0], 'acting': [4, 11, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:11:55.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-09-13T17:11:55.413 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 16, 'reported_epoch': 90, 'state': 'peering', 'last_fresh': '2024-09-13T17:11:48.798762+0000', 'last_change': '2024-09-13T17:11:48.798906+0000', 'last_active': '2024-09-13T17:11:48.798762+0000', 'last_peered': '2024-09-13T17:11:27.833117+0000', 'last_clean': '2024-09-13T17:11:27.833117+0000', 'last_became_active': '2024-09-13T17:11:23.332871+0000', 'last_became_peered': '2024-09-13T17:11:23.332871+0000', 'last_unstale': '2024-09-13T17:11:48.798762+0000', 'last_undegraded': '2024-09-13T17:11:48.798762+0000', 'last_fullsized': '2024-09-13T17:11:48.798762+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 84, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:11:22.975824+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:11:22.975824+0000', 'last_clean_scrub_stamp': '2024-09-13T17:11:22.975824+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:45:27.370999+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 8, 7], 'acting': [0, 8, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4, 5, 7, 8], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:11:55.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.36 is not active+clean 2024-09-13T17:11:55.413 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 17, 'reported_epoch': 90, 'state': 'peering', 'last_fresh': '2024-09-13T17:11:48.800882+0000', 'last_change': '2024-09-13T17:11:48.801055+0000', 'last_active': '2024-09-13T17:11:48.800882+0000', 'last_peered': '2024-09-13T17:11:27.834681+0000', 'last_clean': '2024-09-13T17:11:27.834681+0000', 'last_became_active': '2024-09-13T17:11:23.334660+0000', 'last_became_peered': '2024-09-13T17:11:23.334660+0000', 'last_unstale': '2024-09-13T17:11:48.800882+0000', 'last_undegraded': '2024-09-13T17:11:48.800882+0000', 'last_fullsized': '2024-09-13T17:11:48.800882+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 84, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:11:22.975824+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:11:22.975824+0000', 'last_clean_scrub_stamp': '2024-09-13T17:11:22.975824+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:59:32.110092+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [10, 2, 9], 'acting': [10, 2, 9], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2, 4, 9], 'up_primary': 10, 'acting_primary': 10, 'purged_snaps': []} 2024-09-13T17:11:55.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3a is not active+clean 2024-09-13T17:11:55.413 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 17, 'reported_epoch': 90, 'state': 'peering', 'last_fresh': '2024-09-13T17:11:48.799086+0000', 'last_change': '2024-09-13T17:11:48.799241+0000', 'last_active': '2024-09-13T17:11:48.799086+0000', 'last_peered': '2024-09-13T17:11:27.834170+0000', 'last_clean': '2024-09-13T17:11:27.834170+0000', 'last_became_active': '2024-09-13T17:11:23.334061+0000', 'last_became_peered': '2024-09-13T17:11:23.334061+0000', 'last_unstale': '2024-09-13T17:11:48.799086+0000', 'last_undegraded': '2024-09-13T17:11:48.799086+0000', 'last_fullsized': '2024-09-13T17:11:48.799086+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 84, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:11:22.975824+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:11:22.975824+0000', 'last_clean_scrub_stamp': '2024-09-13T17:11:22.975824+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:09:40.383855+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [10, 9, 7], 'acting': [10, 9, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4, 7, 9], 'up_primary': 10, 'acting_primary': 10, 'purged_snaps': []} 2024-09-13T17:11:55.414 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T17:11:55.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.543+0000 7fc37c583640 1 -- 172.21.15.87:0/4249742123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3740ffe70 msgr2=0x7fc3741002f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:55.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.543+0000 7fc37c583640 1 --2- 172.21.15.87:0/4249742123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3740ffe70 0x7fc3741002f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc368009900 tx=0x7fc36802a410 comp rx=0 tx=0).stop 2024-09-13T17:11:55.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.543+0000 7fc37c583640 1 -- 172.21.15.87:0/4249742123 shutdown_connections 2024-09-13T17:11:55.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.543+0000 7fc37c583640 1 --2- 172.21.15.87:0/4249742123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc374100830 0x7fc3741070c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:55.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.543+0000 7fc37c583640 1 --2- 172.21.15.87:0/4249742123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3740ffe70 0x7fc3741002f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:55.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.543+0000 7fc37c583640 1 --2- 172.21.15.87:0/4249742123 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3740fec80 0x7fc3740ff080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:55.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.543+0000 7fc37c583640 1 -- 172.21.15.87:0/4249742123 >> 172.21.15.87:0/4249742123 conn(0x7fc3740fa400 msgr2=0x7fc3740fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:55.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.543+0000 7fc37c583640 1 -- 172.21.15.87:0/4249742123 shutdown_connections 2024-09-13T17:11:55.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.543+0000 7fc37c583640 1 -- 172.21.15.87:0/4249742123 wait complete. 2024-09-13T17:11:55.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.543+0000 7fc37c583640 1 Processor -- start 2024-09-13T17:11:55.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.543+0000 7fc37c583640 1 -- start start 2024-09-13T17:11:55.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.544+0000 7fc37c583640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3740fec80 0x7fc374195c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:55.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.544+0000 7fc37c583640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3740ffe70 0x7fc3741961b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:55.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.544+0000 7fc37c583640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc374100830 0x7fc37419d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:55.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.544+0000 7fc37c583640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37419d780 con 0x7fc3740fec80 2024-09-13T17:11:55.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.544+0000 7fc37c583640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37419d8f0 con 0x7fc374100830 2024-09-13T17:11:55.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.544+0000 7fc37c583640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37419dab0 con 0x7fc3740ffe70 2024-09-13T17:11:55.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.544+0000 7fc37a31f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3740fec80 0x7fc374195c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:55.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.544+0000 7fc37a31f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3740fec80 0x7fc374195c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45636/0 (socket says 172.21.15.87:45636) 2024-09-13T17:11:55.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.544+0000 7fc37a31f640 1 -- 172.21.15.87:0/1730833754 learned_addr learned my addr 172.21.15.87:0/1730833754 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:55.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.544+0000 7fc379b1e640 1 --2- 172.21.15.87:0/1730833754 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3740ffe70 0x7fc3741961b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:55.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.544+0000 7fc37ab20640 1 --2- 172.21.15.87:0/1730833754 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc374100830 0x7fc37419d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:55.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.544+0000 7fc37a31f640 1 -- 172.21.15.87:0/1730833754 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3740ffe70 msgr2=0x7fc3741961b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:55.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.544+0000 7fc37a31f640 1 --2- 172.21.15.87:0/1730833754 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3740ffe70 0x7fc3741961b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:55.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.544+0000 7fc37a31f640 1 -- 172.21.15.87:0/1730833754 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc374100830 msgr2=0x7fc37419d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:55.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.544+0000 7fc37a31f640 1 --2- 172.21.15.87:0/1730833754 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc374100830 0x7fc37419d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:55.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.544+0000 7fc37a31f640 1 -- 172.21.15.87:0/1730833754 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc368009560 con 0x7fc3740fec80 2024-09-13T17:11:55.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.544+0000 7fc379b1e640 1 --2- 172.21.15.87:0/1730833754 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3740ffe70 0x7fc3741961b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:11:55.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.544+0000 7fc37a31f640 1 --2- 172.21.15.87:0/1730833754 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3740fec80 0x7fc374195c70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc36400ccb0 tx=0x7fc36400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:55.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.544+0000 7fc3737fe640 1 -- 172.21.15.87:0/1730833754 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc364003b70 con 0x7fc3740fec80 2024-09-13T17:11:55.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.544+0000 7fc37c583640 1 -- 172.21.15.87:0/1730833754 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc37419dd90 con 0x7fc3740fec80 2024-09-13T17:11:55.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.544+0000 7fc3737fe640 1 -- 172.21.15.87:0/1730833754 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc36400ae50 con 0x7fc3740fec80 2024-09-13T17:11:55.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.544+0000 7fc3737fe640 1 -- 172.21.15.87:0/1730833754 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36400f6b0 con 0x7fc3740fec80 2024-09-13T17:11:55.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.544+0000 7fc37c583640 1 -- 172.21.15.87:0/1730833754 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc37419e1c0 con 0x7fc3740fec80 2024-09-13T17:11:55.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.545+0000 7fc37c583640 1 -- 172.21.15.87:0/1730833754 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc37410a570 con 0x7fc3740fec80 2024-09-13T17:11:55.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.546+0000 7fc3737fe640 1 -- 172.21.15.87:0/1730833754 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fc364004000 con 0x7fc3740fec80 2024-09-13T17:11:55.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.547+0000 7fc3737fe640 1 --2- 172.21.15.87:0/1730833754 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc35c0a1120 0x7fc35c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:55.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.547+0000 7fc379b1e640 1 --2- 172.21.15.87:0/1730833754 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc35c0a1120 0x7fc35c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:55.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.547+0000 7fc3737fe640 1 -- 172.21.15.87:0/1730833754 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8978+0+0 (secure 0 0 0) 0x7fc3640cd280 con 0x7fc3740fec80 2024-09-13T17:11:55.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.547+0000 7fc379b1e640 1 --2- 172.21.15.87:0/1730833754 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc35c0a1120 0x7fc35c0a35e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc368006010 tx=0x7fc368005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:55.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.551+0000 7fc3737fe640 1 -- 172.21.15.87:0/1730833754 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc3640965c0 con 0x7fc3740fec80 2024-09-13T17:11:55.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:55 smithi149 ceph-mon[35496]: pgmap v294: 129 pgs: 4 peering, 125 active+clean; 620 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 8.6 KiB/s wr, 16 op/s 2024-09-13T17:11:55.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:55 smithi118 ceph-mon[34374]: pgmap v294: 129 pgs: 4 peering, 125 active+clean; 620 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 8.6 KiB/s wr, 16 op/s 2024-09-13T17:11:55.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.778+0000 7fc37c583640 1 -- 172.21.15.87:0/1730833754 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fc37410a700 con 0x7fc3740fec80 2024-09-13T17:11:55.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.778+0000 7fc3737fe640 1 -- 172.21.15.87:0/1730833754 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+2895 (secure 0 0 0) 0x7fc364099be0 con 0x7fc3740fec80 2024-09-13T17:11:55.780 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:11:55.780 INFO:teuthology.orchestra.run.smithi087.stdout:{"fsid":"043d5bae-71f2-11ef-bceb-c7b262605968","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_age":371,"monmap":{"epoch":3,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":91,"num_osds":12,"num_up_osds":12,"osd_up_since":1726247434,"num_in_osds":12,"osd_in_since":1726247414,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":125},{"state_name":"peering","count":4}],"num_pgs":129,"num_pools":4,"num_objects":64,"data_bytes":634933,"bytes_used":386260992,"bytes_avail":1151554166784,"bytes_total":1151940427776,"inactive_pgs_ratio":0.031007751822471619,"read_bytes_sec":6270,"write_bytes_sec":8829,"read_op_per_sec":4,"write_op_per_sec":12},"fsmap":{"epoch":23,"id":1,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":1,"rank":2,"name":"l","status":"up:standby-replay","gid":24427},{"filesystem_id":1,"rank":1,"name":"h","status":"up:standby-replay","gid":24446},{"filesystem_id":1,"rank":0,"name":"b","status":"up:standby-replay","gid":24470},{"filesystem_id":1,"rank":2,"name":"f","status":"up:active","gid":24472},{"filesystem_id":1,"rank":1,"name":"c","status":"up:active","gid":24484},{"filesystem_id":1,"rank":0,"name":"i","status":"up:active","gid":24499}],"up:standby":6},"mgrmap":{"available":true,"num_standbys":2,"modules":["cephadm","dashboard","iostat","nfs","restful"],"services":{"dashboard":"https://172.21.15.87:8443/"}},"servicemap":{"epoch":20,"modified":"2024-09-13T17:11:52.075228+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"e":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"f":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"g":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"h":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"i":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"j":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-13T17:11:55.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.780+0000 7fc37c583640 1 -- 172.21.15.87:0/1730833754 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc35c0a1120 msgr2=0x7fc35c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:55.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.780+0000 7fc37c583640 1 --2- 172.21.15.87:0/1730833754 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc35c0a1120 0x7fc35c0a35e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc368006010 tx=0x7fc368005a20 comp rx=0 tx=0).stop 2024-09-13T17:11:55.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.780+0000 7fc37c583640 1 -- 172.21.15.87:0/1730833754 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3740fec80 msgr2=0x7fc374195c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:55.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.780+0000 7fc37c583640 1 --2- 172.21.15.87:0/1730833754 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3740fec80 0x7fc374195c70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc36400ccb0 tx=0x7fc36400a620 comp rx=0 tx=0).stop 2024-09-13T17:11:55.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.780+0000 7fc37c583640 1 -- 172.21.15.87:0/1730833754 shutdown_connections 2024-09-13T17:11:55.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.780+0000 7fc37c583640 1 --2- 172.21.15.87:0/1730833754 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc35c0a1120 0x7fc35c0a35e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:55.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.780+0000 7fc37c583640 1 --2- 172.21.15.87:0/1730833754 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc374100830 0x7fc37419d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:55.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.780+0000 7fc37c583640 1 --2- 172.21.15.87:0/1730833754 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3740ffe70 0x7fc3741961b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:55.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.780+0000 7fc37c583640 1 --2- 172.21.15.87:0/1730833754 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3740fec80 0x7fc374195c70 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:55.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.780+0000 7fc37c583640 1 -- 172.21.15.87:0/1730833754 >> 172.21.15.87:0/1730833754 conn(0x7fc3740fa400 msgr2=0x7fc3740675a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:55.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.780+0000 7fc37c583640 1 -- 172.21.15.87:0/1730833754 shutdown_connections 2024-09-13T17:11:55.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.780+0000 7fc37c583640 1 -- 172.21.15.87:0/1730833754 wait complete. 2024-09-13T17:11:55.793 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-09-13T17:11:55.793 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:11:55.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.890+0000 7fa09470f640 1 -- 172.21.15.87:0/3287765873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa08c0ffe90 msgr2=0x7fa08c100310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:55.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.890+0000 7fa09470f640 1 --2- 172.21.15.87:0/3287765873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa08c0ffe90 0x7fa08c100310 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa080009900 tx=0x7fa08002a410 comp rx=0 tx=0).stop 2024-09-13T17:11:55.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.890+0000 7fa09470f640 1 -- 172.21.15.87:0/3287765873 shutdown_connections 2024-09-13T17:11:55.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.890+0000 7fa09470f640 1 --2- 172.21.15.87:0/3287765873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa08c100850 0x7fa08c1070e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:55.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.890+0000 7fa09470f640 1 --2- 172.21.15.87:0/3287765873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa08c0ffe90 0x7fa08c100310 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:55.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.890+0000 7fa09470f640 1 --2- 172.21.15.87:0/3287765873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa08c0feca0 0x7fa08c0ff0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:55.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.890+0000 7fa09470f640 1 -- 172.21.15.87:0/3287765873 >> 172.21.15.87:0/3287765873 conn(0x7fa08c0fa400 msgr2=0x7fa08c0fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:55.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.890+0000 7fa09470f640 1 -- 172.21.15.87:0/3287765873 shutdown_connections 2024-09-13T17:11:55.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.890+0000 7fa09470f640 1 -- 172.21.15.87:0/3287765873 wait complete. 2024-09-13T17:11:55.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.891+0000 7fa09470f640 1 Processor -- start 2024-09-13T17:11:55.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.891+0000 7fa09470f640 1 -- start start 2024-09-13T17:11:55.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.891+0000 7fa09470f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa08c0feca0 0x7fa08c194be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:55.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.891+0000 7fa09470f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa08c0ffe90 0x7fa08c195120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:55.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.891+0000 7fa09470f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa08c100850 0x7fa08c19c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:55.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.891+0000 7fa09470f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c19c6d0 con 0x7fa08c0feca0 2024-09-13T17:11:55.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.891+0000 7fa09470f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c19c840 con 0x7fa08c0ffe90 2024-09-13T17:11:55.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.891+0000 7fa09470f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c19ca00 con 0x7fa08c100850 2024-09-13T17:11:55.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.891+0000 7fa0924ab640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa08c0feca0 0x7fa08c194be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:55.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.891+0000 7fa0924ab640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa08c0feca0 0x7fa08c194be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45648/0 (socket says 172.21.15.87:45648) 2024-09-13T17:11:55.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.891+0000 7fa0924ab640 1 -- 172.21.15.87:0/3179913138 learned_addr learned my addr 172.21.15.87:0/3179913138 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:55.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.891+0000 7fa091caa640 1 --2- 172.21.15.87:0/3179913138 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa08c0ffe90 0x7fa08c195120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:55.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.891+0000 7fa092cac640 1 --2- 172.21.15.87:0/3179913138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa08c100850 0x7fa08c19c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:55.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.891+0000 7fa0924ab640 1 -- 172.21.15.87:0/3179913138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa08c100850 msgr2=0x7fa08c19c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:55.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.891+0000 7fa0924ab640 1 --2- 172.21.15.87:0/3179913138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa08c100850 0x7fa08c19c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:55.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.891+0000 7fa0924ab640 1 -- 172.21.15.87:0/3179913138 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa08c0ffe90 msgr2=0x7fa08c195120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:55.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.891+0000 7fa0924ab640 1 --2- 172.21.15.87:0/3179913138 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa08c0ffe90 0x7fa08c195120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:55.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.891+0000 7fa0924ab640 1 -- 172.21.15.87:0/3179913138 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa080009560 con 0x7fa08c0feca0 2024-09-13T17:11:55.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.891+0000 7fa091caa640 1 --2- 172.21.15.87:0/3179913138 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa08c0ffe90 0x7fa08c195120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:11:55.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.891+0000 7fa092cac640 1 --2- 172.21.15.87:0/3179913138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa08c100850 0x7fa08c19c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:11:55.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.891+0000 7fa0924ab640 1 --2- 172.21.15.87:0/3179913138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa08c0feca0 0x7fa08c194be0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa07c00ccb0 tx=0x7fa07c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:55.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.891+0000 7fa08b7fe640 1 -- 172.21.15.87:0/3179913138 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c003b70 con 0x7fa08c0feca0 2024-09-13T17:11:55.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.892+0000 7fa08b7fe640 1 -- 172.21.15.87:0/3179913138 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa07c00ae50 con 0x7fa08c0feca0 2024-09-13T17:11:55.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.892+0000 7fa09470f640 1 -- 172.21.15.87:0/3179913138 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa08c19cce0 con 0x7fa08c0feca0 2024-09-13T17:11:55.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.892+0000 7fa08b7fe640 1 -- 172.21.15.87:0/3179913138 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c00f6b0 con 0x7fa08c0feca0 2024-09-13T17:11:55.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.892+0000 7fa09470f640 1 -- 172.21.15.87:0/3179913138 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa08c19d1c0 con 0x7fa08c0feca0 2024-09-13T17:11:55.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.892+0000 7fa09470f640 1 -- 172.21.15.87:0/3179913138 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa08c1060e0 con 0x7fa08c0feca0 2024-09-13T17:11:55.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.894+0000 7fa08b7fe640 1 -- 172.21.15.87:0/3179913138 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fa07c004000 con 0x7fa08c0feca0 2024-09-13T17:11:55.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.894+0000 7fa08b7fe640 1 --2- 172.21.15.87:0/3179913138 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa0740a1120 0x7fa0740a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:55.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.894+0000 7fa091caa640 1 --2- 172.21.15.87:0/3179913138 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa0740a1120 0x7fa0740a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:55.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.894+0000 7fa08b7fe640 1 -- 172.21.15.87:0/3179913138 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8978+0+0 (secure 0 0 0) 0x7fa07c0cd260 con 0x7fa08c0feca0 2024-09-13T17:11:55.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.895+0000 7fa091caa640 1 --2- 172.21.15.87:0/3179913138 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa0740a1120 0x7fa0740a35e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa0800057c0 tx=0x7fa080031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:55.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:55.897+0000 7fa08b7fe640 1 -- 172.21.15.87:0/3179913138 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa07c0965a0 con 0x7fa08c0feca0 2024-09-13T17:11:56.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:56.057+0000 7fa09470f640 1 -- 172.21.15.87:0/3179913138 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa08c02c480 con 0x7fa0740a1120 2024-09-13T17:11:56.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:56.067+0000 7fa08b7fe640 1 -- 172.21.15.87:0/3179913138 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+424082 (secure 0 0 0) 0x7fa08c02c480 con 0x7fa0740a1120 2024-09-13T17:11:56.074 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:11:56.076 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-13T17:11:56.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:56.071+0000 7fa09470f640 1 -- 172.21.15.87:0/3179913138 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa0740a1120 msgr2=0x7fa0740a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:56.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:56.071+0000 7fa09470f640 1 --2- 172.21.15.87:0/3179913138 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa0740a1120 0x7fa0740a35e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa0800057c0 tx=0x7fa080031400 comp rx=0 tx=0).stop 2024-09-13T17:11:56.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:56.071+0000 7fa09470f640 1 -- 172.21.15.87:0/3179913138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa08c0feca0 msgr2=0x7fa08c194be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:56.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:56.071+0000 7fa09470f640 1 --2- 172.21.15.87:0/3179913138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa08c0feca0 0x7fa08c194be0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa07c00ccb0 tx=0x7fa07c00a620 comp rx=0 tx=0).stop 2024-09-13T17:11:56.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:56.071+0000 7fa09470f640 1 -- 172.21.15.87:0/3179913138 shutdown_connections 2024-09-13T17:11:56.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:56.071+0000 7fa09470f640 1 --2- 172.21.15.87:0/3179913138 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa0740a1120 0x7fa0740a35e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:56.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:56.071+0000 7fa09470f640 1 --2- 172.21.15.87:0/3179913138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa08c100850 0x7fa08c19c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:56.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:56.071+0000 7fa09470f640 1 --2- 172.21.15.87:0/3179913138 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa08c0ffe90 0x7fa08c195120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:56.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:56.071+0000 7fa09470f640 1 --2- 172.21.15.87:0/3179913138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa08c0feca0 0x7fa08c194be0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:56.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:56.071+0000 7fa09470f640 1 -- 172.21.15.87:0/3179913138 >> 172.21.15.87:0/3179913138 conn(0x7fa08c0fa400 msgr2=0x7fa08c1032b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:56.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:56.071+0000 7fa09470f640 1 -- 172.21.15.87:0/3179913138 shutdown_connections 2024-09-13T17:11:56.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:56.071+0000 7fa09470f640 1 -- 172.21.15.87:0/3179913138 wait complete. 2024-09-13T17:11:56.084 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":294,"stamp":"2024-09-13T17:11:54.075595+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":634933,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":173,"num_read_kb":168,"num_write":326,"num_write_kb":3025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":421,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":377208,"kb_used_data":11996,"kb_used_omap":18,"kb_used_meta":365037,"kb_avail":1124564616,"statfs":{"total":1151940427776,"available":1151554166784,"internally_reserved":0,"allocated":12283904,"data_stored":7826809,"data_compressed":303238,"data_compressed_allocated":405504,"data_compressed_original":2310144,"omap_allocated":19109,"internal_metadata":373798235},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":39972,"num_objects":40,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":37,"num_read_kb":49,"num_write":97,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002376"},"pg_stats":[{"pgid":"2.1f","version":"89'9","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794907+0000","last_change":"2024-09-13T17:11:22.998997+0000","last_active":"2024-09-13T17:11:48.794907+0000","last_peered":"2024-09-13T17:11:48.794907+0000","last_clean":"2024-09-13T17:11:48.794907+0000","last_became_active":"2024-09-13T17:11:22.998674+0000","last_became_peered":"2024-09-13T17:11:22.998674+0000","last_unstale":"2024-09-13T17:11:48.794907+0000","last_undegraded":"2024-09-13T17:11:48.794907+0000","last_fullsized":"2024-09-13T17:11:48.794907+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:30:50.554788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794065+0000","last_change":"2024-09-13T17:11:23.340108+0000","last_active":"2024-09-13T17:11:48.794065+0000","last_peered":"2024-09-13T17:11:48.794065+0000","last_clean":"2024-09-13T17:11:48.794065+0000","last_became_active":"2024-09-13T17:11:23.339832+0000","last_became_peered":"2024-09-13T17:11:23.339832+0000","last_unstale":"2024-09-13T17:11:48.794065+0000","last_undegraded":"2024-09-13T17:11:48.794065+0000","last_fullsized":"2024-09-13T17:11:48.794065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:40.969448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.802879+0000","last_change":"2024-09-13T17:11:27.358090+0000","last_active":"2024-09-13T17:11:48.802879+0000","last_peered":"2024-09-13T17:11:48.802879+0000","last_clean":"2024-09-13T17:11:48.802879+0000","last_became_active":"2024-09-13T17:11:27.357725+0000","last_became_peered":"2024-09-13T17:11:27.357725+0000","last_unstale":"2024-09-13T17:11:48.802879+0000","last_undegraded":"2024-09-13T17:11:48.802879+0000","last_fullsized":"2024-09-13T17:11:48.802879+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:51.617457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794279+0000","last_change":"2024-09-13T17:11:23.000779+0000","last_active":"2024-09-13T17:11:48.794279+0000","last_peered":"2024-09-13T17:11:48.794279+0000","last_clean":"2024-09-13T17:11:48.794279+0000","last_became_active":"2024-09-13T17:11:23.000511+0000","last_became_peered":"2024-09-13T17:11:23.000511+0000","last_unstale":"2024-09-13T17:11:48.794279+0000","last_undegraded":"2024-09-13T17:11:48.794279+0000","last_fullsized":"2024-09-13T17:11:48.794279+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:09.802392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.833095+0000","last_change":"2024-09-13T17:11:23.333948+0000","last_active":"2024-09-13T17:11:27.833095+0000","last_peered":"2024-09-13T17:11:27.833095+0000","last_clean":"2024-09-13T17:11:27.833095+0000","last_became_active":"2024-09-13T17:11:23.333679+0000","last_became_peered":"2024-09-13T17:11:23.333679+0000","last_unstale":"2024-09-13T17:11:27.833095+0000","last_undegraded":"2024-09-13T17:11:27.833095+0000","last_fullsized":"2024-09-13T17:11:27.833095+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:10.265157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537784+0000","last_change":"2024-09-13T17:11:27.353767+0000","last_active":"2024-09-13T17:11:29.537784+0000","last_peered":"2024-09-13T17:11:29.537784+0000","last_clean":"2024-09-13T17:11:29.537784+0000","last_became_active":"2024-09-13T17:11:27.353448+0000","last_became_peered":"2024-09-13T17:11:27.353448+0000","last_unstale":"2024-09-13T17:11:29.537784+0000","last_undegraded":"2024-09-13T17:11:29.537784+0000","last_fullsized":"2024-09-13T17:11:29.537784+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:15.948099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799823+0000","last_change":"2024-09-13T17:11:22.999879+0000","last_active":"2024-09-13T17:11:48.799823+0000","last_peered":"2024-09-13T17:11:48.799823+0000","last_clean":"2024-09-13T17:11:48.799823+0000","last_became_active":"2024-09-13T17:11:22.999577+0000","last_became_peered":"2024-09-13T17:11:22.999577+0000","last_unstale":"2024-09-13T17:11:48.799823+0000","last_undegraded":"2024-09-13T17:11:48.799823+0000","last_fullsized":"2024-09-13T17:11:48.799823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:48.485532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792067+0000","last_change":"2024-09-13T17:11:23.339026+0000","last_active":"2024-09-13T17:11:48.792067+0000","last_peered":"2024-09-13T17:11:48.792067+0000","last_clean":"2024-09-13T17:11:48.792067+0000","last_became_active":"2024-09-13T17:11:23.338745+0000","last_became_peered":"2024-09-13T17:11:23.338745+0000","last_unstale":"2024-09-13T17:11:48.792067+0000","last_undegraded":"2024-09-13T17:11:48.792067+0000","last_fullsized":"2024-09-13T17:11:48.792067+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:27.455418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537867+0000","last_change":"2024-09-13T17:11:27.363137+0000","last_active":"2024-09-13T17:11:29.537867+0000","last_peered":"2024-09-13T17:11:29.537867+0000","last_clean":"2024-09-13T17:11:29.537867+0000","last_became_active":"2024-09-13T17:11:27.362621+0000","last_became_peered":"2024-09-13T17:11:27.362621+0000","last_unstale":"2024-09-13T17:11:29.537867+0000","last_undegraded":"2024-09-13T17:11:29.537867+0000","last_fullsized":"2024-09-13T17:11:29.537867+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:35:51.492630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.800066+0000","last_change":"2024-09-13T17:11:22.998066+0000","last_active":"2024-09-13T17:11:48.800066+0000","last_peered":"2024-09-13T17:11:48.800066+0000","last_clean":"2024-09-13T17:11:48.800066+0000","last_became_active":"2024-09-13T17:11:22.997741+0000","last_became_peered":"2024-09-13T17:11:22.997741+0000","last_unstale":"2024-09-13T17:11:48.800066+0000","last_undegraded":"2024-09-13T17:11:48.800066+0000","last_fullsized":"2024-09-13T17:11:48.800066+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:00.353453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792498+0000","last_change":"2024-09-13T17:11:23.336778+0000","last_active":"2024-09-13T17:11:48.792498+0000","last_peered":"2024-09-13T17:11:48.792498+0000","last_clean":"2024-09-13T17:11:48.792498+0000","last_became_active":"2024-09-13T17:11:23.336491+0000","last_became_peered":"2024-09-13T17:11:23.336491+0000","last_unstale":"2024-09-13T17:11:48.792498+0000","last_undegraded":"2024-09-13T17:11:48.792498+0000","last_fullsized":"2024-09-13T17:11:48.792498+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:02.045912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537823+0000","last_change":"2024-09-13T17:11:27.361454+0000","last_active":"2024-09-13T17:11:29.537823+0000","last_peered":"2024-09-13T17:11:29.537823+0000","last_clean":"2024-09-13T17:11:29.537823+0000","last_became_active":"2024-09-13T17:11:27.360980+0000","last_became_peered":"2024-09-13T17:11:27.360980+0000","last_unstale":"2024-09-13T17:11:29.537823+0000","last_undegraded":"2024-09-13T17:11:29.537823+0000","last_fullsized":"2024-09-13T17:11:29.537823+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:36.036426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.798015+0000","last_change":"2024-09-13T17:11:23.334073+0000","last_active":"2024-09-13T17:11:48.798015+0000","last_peered":"2024-09-13T17:11:48.798015+0000","last_clean":"2024-09-13T17:11:48.798015+0000","last_became_active":"2024-09-13T17:11:23.333628+0000","last_became_peered":"2024-09-13T17:11:23.333628+0000","last_unstale":"2024-09-13T17:11:48.798015+0000","last_undegraded":"2024-09-13T17:11:48.798015+0000","last_fullsized":"2024-09-13T17:11:48.798015+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:18.561346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.800163+0000","last_change":"2024-09-13T17:11:22.999115+0000","last_active":"2024-09-13T17:11:48.800163+0000","last_peered":"2024-09-13T17:11:48.800163+0000","last_clean":"2024-09-13T17:11:48.800163+0000","last_became_active":"2024-09-13T17:11:22.998798+0000","last_became_peered":"2024-09-13T17:11:22.998798+0000","last_unstale":"2024-09-13T17:11:48.800163+0000","last_undegraded":"2024-09-13T17:11:48.800163+0000","last_fullsized":"2024-09-13T17:11:48.800163+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:25.263755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537935+0000","last_change":"2024-09-13T17:11:27.355472+0000","last_active":"2024-09-13T17:11:29.537935+0000","last_peered":"2024-09-13T17:11:29.537935+0000","last_clean":"2024-09-13T17:11:29.537935+0000","last_became_active":"2024-09-13T17:11:27.355065+0000","last_became_peered":"2024-09-13T17:11:27.355065+0000","last_unstale":"2024-09-13T17:11:29.537935+0000","last_undegraded":"2024-09-13T17:11:29.537935+0000","last_fullsized":"2024-09-13T17:11:29.537935+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:03.881097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.793593+0000","last_change":"2024-09-13T17:11:23.340268+0000","last_active":"2024-09-13T17:11:48.793593+0000","last_peered":"2024-09-13T17:11:48.793593+0000","last_clean":"2024-09-13T17:11:48.793593+0000","last_became_active":"2024-09-13T17:11:23.339977+0000","last_became_peered":"2024-09-13T17:11:23.339977+0000","last_unstale":"2024-09-13T17:11:48.793593+0000","last_undegraded":"2024-09-13T17:11:48.793593+0000","last_fullsized":"2024-09-13T17:11:48.793593+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:21.067899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"90'1","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.565951+0000","last_change":"2024-09-13T17:11:23.000858+0000","last_active":"2024-09-13T17:11:49.565951+0000","last_peered":"2024-09-13T17:11:49.565951+0000","last_clean":"2024-09-13T17:11:49.565951+0000","last_became_active":"2024-09-13T17:11:23.000536+0000","last_became_peered":"2024-09-13T17:11:23.000536+0000","last_unstale":"2024-09-13T17:11:49.565951+0000","last_undegraded":"2024-09-13T17:11:49.565951+0000","last_fullsized":"2024-09-13T17:11:49.565951+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:28.798579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801541+0000","last_change":"2024-09-13T17:11:27.354018+0000","last_active":"2024-09-13T17:11:48.801541+0000","last_peered":"2024-09-13T17:11:48.801541+0000","last_clean":"2024-09-13T17:11:48.801541+0000","last_became_active":"2024-09-13T17:11:27.353519+0000","last_became_peered":"2024-09-13T17:11:27.353519+0000","last_unstale":"2024-09-13T17:11:48.801541+0000","last_undegraded":"2024-09-13T17:11:48.801541+0000","last_fullsized":"2024-09-13T17:11:48.801541+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:55.227851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801000+0000","last_change":"2024-09-13T17:11:23.335798+0000","last_active":"2024-09-13T17:11:48.801000+0000","last_peered":"2024-09-13T17:11:48.801000+0000","last_clean":"2024-09-13T17:11:48.801000+0000","last_became_active":"2024-09-13T17:11:23.335445+0000","last_became_peered":"2024-09-13T17:11:23.335445+0000","last_unstale":"2024-09-13T17:11:48.801000+0000","last_undegraded":"2024-09-13T17:11:48.801000+0000","last_fullsized":"2024-09-13T17:11:48.801000+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:53.242067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.793194+0000","last_change":"2024-09-13T17:11:22.994118+0000","last_active":"2024-09-13T17:11:48.793194+0000","last_peered":"2024-09-13T17:11:48.793194+0000","last_clean":"2024-09-13T17:11:48.793194+0000","last_became_active":"2024-09-13T17:11:22.993801+0000","last_became_peered":"2024-09-13T17:11:22.993801+0000","last_unstale":"2024-09-13T17:11:48.793194+0000","last_undegraded":"2024-09-13T17:11:48.793194+0000","last_fullsized":"2024-09-13T17:11:48.793194+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:01.382130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794642+0000","last_change":"2024-09-13T17:11:27.358795+0000","last_active":"2024-09-13T17:11:48.794642+0000","last_peered":"2024-09-13T17:11:48.794642+0000","last_clean":"2024-09-13T17:11:48.794642+0000","last_became_active":"2024-09-13T17:11:27.358166+0000","last_became_peered":"2024-09-13T17:11:27.358166+0000","last_unstale":"2024-09-13T17:11:48.794642+0000","last_undegraded":"2024-09-13T17:11:48.794642+0000","last_fullsized":"2024-09-13T17:11:48.794642+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:23.787842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799478+0000","last_change":"2024-09-13T17:11:23.340671+0000","last_active":"2024-09-13T17:11:48.799478+0000","last_peered":"2024-09-13T17:11:48.799478+0000","last_clean":"2024-09-13T17:11:48.799478+0000","last_became_active":"2024-09-13T17:11:23.340360+0000","last_became_peered":"2024-09-13T17:11:23.340360+0000","last_unstale":"2024-09-13T17:11:48.799478+0000","last_undegraded":"2024-09-13T17:11:48.799478+0000","last_fullsized":"2024-09-13T17:11:48.799478+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:17.875171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.791482+0000","last_change":"2024-09-13T17:11:22.993039+0000","last_active":"2024-09-13T17:11:48.791482+0000","last_peered":"2024-09-13T17:11:48.791482+0000","last_clean":"2024-09-13T17:11:48.791482+0000","last_became_active":"2024-09-13T17:11:22.992701+0000","last_became_peered":"2024-09-13T17:11:22.992701+0000","last_unstale":"2024-09-13T17:11:48.791482+0000","last_undegraded":"2024-09-13T17:11:48.791482+0000","last_fullsized":"2024-09-13T17:11:48.791482+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:28.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537946+0000","last_change":"2024-09-13T17:11:27.363834+0000","last_active":"2024-09-13T17:11:29.537946+0000","last_peered":"2024-09-13T17:11:29.537946+0000","last_clean":"2024-09-13T17:11:29.537946+0000","last_became_active":"2024-09-13T17:11:27.363425+0000","last_became_peered":"2024-09-13T17:11:27.363425+0000","last_unstale":"2024-09-13T17:11:29.537946+0000","last_undegraded":"2024-09-13T17:11:29.537946+0000","last_fullsized":"2024-09-13T17:11:29.537946+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:37.389881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832858+0000","last_change":"2024-09-13T17:11:23.337423+0000","last_active":"2024-09-13T17:11:27.832858+0000","last_peered":"2024-09-13T17:11:27.832858+0000","last_clean":"2024-09-13T17:11:27.832858+0000","last_became_active":"2024-09-13T17:11:23.337167+0000","last_became_peered":"2024-09-13T17:11:23.337167+0000","last_unstale":"2024-09-13T17:11:27.832858+0000","last_undegraded":"2024-09-13T17:11:27.832858+0000","last_fullsized":"2024-09-13T17:11:27.832858+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:28.540283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:46.175903+0000","last_change":"2024-09-13T17:11:23.000486+0000","last_active":"2024-09-13T17:11:46.175903+0000","last_peered":"2024-09-13T17:11:46.175903+0000","last_clean":"2024-09-13T17:11:46.175903+0000","last_became_active":"2024-09-13T17:11:23.000158+0000","last_became_peered":"2024-09-13T17:11:23.000158+0000","last_unstale":"2024-09-13T17:11:46.175903+0000","last_undegraded":"2024-09-13T17:11:46.175903+0000","last_fullsized":"2024-09-13T17:11:46.175903+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:42.635037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.802894+0000","last_change":"2024-09-13T17:11:27.355058+0000","last_active":"2024-09-13T17:11:48.802894+0000","last_peered":"2024-09-13T17:11:48.802894+0000","last_clean":"2024-09-13T17:11:48.802894+0000","last_became_active":"2024-09-13T17:11:27.354726+0000","last_became_peered":"2024-09-13T17:11:27.354726+0000","last_unstale":"2024-09-13T17:11:48.802894+0000","last_undegraded":"2024-09-13T17:11:48.802894+0000","last_fullsized":"2024-09-13T17:11:48.802894+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:58.450122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794550+0000","last_change":"2024-09-13T17:11:23.337245+0000","last_active":"2024-09-13T17:11:48.794550+0000","last_peered":"2024-09-13T17:11:48.794550+0000","last_clean":"2024-09-13T17:11:48.794550+0000","last_became_active":"2024-09-13T17:11:23.336956+0000","last_became_peered":"2024-09-13T17:11:23.336956+0000","last_unstale":"2024-09-13T17:11:48.794550+0000","last_undegraded":"2024-09-13T17:11:48.794550+0000","last_fullsized":"2024-09-13T17:11:48.794550+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:46.876149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.655818+0000","last_change":"2024-09-13T17:11:22.999942+0000","last_active":"2024-09-13T17:11:49.655818+0000","last_peered":"2024-09-13T17:11:49.655818+0000","last_clean":"2024-09-13T17:11:49.655818+0000","last_became_active":"2024-09-13T17:11:22.999653+0000","last_became_peered":"2024-09-13T17:11:22.999653+0000","last_unstale":"2024-09-13T17:11:49.655818+0000","last_undegraded":"2024-09-13T17:11:49.655818+0000","last_fullsized":"2024-09-13T17:11:49.655818+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:29.400939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792511+0000","last_change":"2024-09-13T17:11:27.356479+0000","last_active":"2024-09-13T17:11:48.792511+0000","last_peered":"2024-09-13T17:11:48.792511+0000","last_clean":"2024-09-13T17:11:48.792511+0000","last_became_active":"2024-09-13T17:11:27.356052+0000","last_became_peered":"2024-09-13T17:11:27.356052+0000","last_unstale":"2024-09-13T17:11:48.792511+0000","last_undegraded":"2024-09-13T17:11:48.792511+0000","last_fullsized":"2024-09-13T17:11:48.792511+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:42.173376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.790360+0000","last_change":"2024-09-13T17:11:23.333786+0000","last_active":"2024-09-13T17:11:48.790360+0000","last_peered":"2024-09-13T17:11:48.790360+0000","last_clean":"2024-09-13T17:11:48.790360+0000","last_became_active":"2024-09-13T17:11:23.333472+0000","last_became_peered":"2024-09-13T17:11:23.333472+0000","last_unstale":"2024-09-13T17:11:48.790360+0000","last_undegraded":"2024-09-13T17:11:48.790360+0000","last_fullsized":"2024-09-13T17:11:48.790360+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:41.633228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799918+0000","last_change":"2024-09-13T17:11:22.998646+0000","last_active":"2024-09-13T17:11:48.799918+0000","last_peered":"2024-09-13T17:11:48.799918+0000","last_clean":"2024-09-13T17:11:48.799918+0000","last_became_active":"2024-09-13T17:11:22.998291+0000","last_became_peered":"2024-09-13T17:11:22.998291+0000","last_unstale":"2024-09-13T17:11:48.799918+0000","last_undegraded":"2024-09-13T17:11:48.799918+0000","last_fullsized":"2024-09-13T17:11:48.799918+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:20.658436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801089+0000","last_change":"2024-09-13T17:11:27.361174+0000","last_active":"2024-09-13T17:11:48.801089+0000","last_peered":"2024-09-13T17:11:48.801089+0000","last_clean":"2024-09-13T17:11:48.801089+0000","last_became_active":"2024-09-13T17:11:27.360737+0000","last_became_peered":"2024-09-13T17:11:27.360737+0000","last_unstale":"2024-09-13T17:11:48.801089+0000","last_undegraded":"2024-09-13T17:11:48.801089+0000","last_fullsized":"2024-09-13T17:11:48.801089+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:00.941364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.834435+0000","last_change":"2024-09-13T17:11:23.338545+0000","last_active":"2024-09-13T17:11:27.834435+0000","last_peered":"2024-09-13T17:11:27.834435+0000","last_clean":"2024-09-13T17:11:27.834435+0000","last_became_active":"2024-09-13T17:11:23.338246+0000","last_became_peered":"2024-09-13T17:11:23.338246+0000","last_unstale":"2024-09-13T17:11:27.834435+0000","last_undegraded":"2024-09-13T17:11:27.834435+0000","last_fullsized":"2024-09-13T17:11:27.834435+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:18.966658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794795+0000","last_change":"2024-09-13T17:11:22.993497+0000","last_active":"2024-09-13T17:11:48.794795+0000","last_peered":"2024-09-13T17:11:48.794795+0000","last_clean":"2024-09-13T17:11:48.794795+0000","last_became_active":"2024-09-13T17:11:22.993165+0000","last_became_peered":"2024-09-13T17:11:22.993165+0000","last_unstale":"2024-09-13T17:11:48.794795+0000","last_undegraded":"2024-09-13T17:11:48.794795+0000","last_fullsized":"2024-09-13T17:11:48.794795+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:20.997834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799564+0000","last_change":"2024-09-13T17:11:27.364652+0000","last_active":"2024-09-13T17:11:48.799564+0000","last_peered":"2024-09-13T17:11:48.799564+0000","last_clean":"2024-09-13T17:11:48.799564+0000","last_became_active":"2024-09-13T17:11:27.364245+0000","last_became_peered":"2024-09-13T17:11:27.364245+0000","last_unstale":"2024-09-13T17:11:48.799564+0000","last_undegraded":"2024-09-13T17:11:48.799564+0000","last_fullsized":"2024-09-13T17:11:48.799564+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:23.048289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.834356+0000","last_change":"2024-09-13T17:11:23.335649+0000","last_active":"2024-09-13T17:11:27.834356+0000","last_peered":"2024-09-13T17:11:27.834356+0000","last_clean":"2024-09-13T17:11:27.834356+0000","last_became_active":"2024-09-13T17:11:23.335364+0000","last_became_peered":"2024-09-13T17:11:23.335364+0000","last_unstale":"2024-09-13T17:11:27.834356+0000","last_undegraded":"2024-09-13T17:11:27.834356+0000","last_fullsized":"2024-09-13T17:11:27.834356+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.447947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.798105+0000","last_change":"2024-09-13T17:11:23.003188+0000","last_active":"2024-09-13T17:11:48.798105+0000","last_peered":"2024-09-13T17:11:48.798105+0000","last_clean":"2024-09-13T17:11:48.798105+0000","last_became_active":"2024-09-13T17:11:23.002858+0000","last_became_peered":"2024-09-13T17:11:23.002858+0000","last_unstale":"2024-09-13T17:11:48.798105+0000","last_undegraded":"2024-09-13T17:11:48.798105+0000","last_fullsized":"2024-09-13T17:11:48.798105+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:34.153326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.790425+0000","last_change":"2024-09-13T17:11:27.353320+0000","last_active":"2024-09-13T17:11:48.790425+0000","last_peered":"2024-09-13T17:11:48.790425+0000","last_clean":"2024-09-13T17:11:48.790425+0000","last_became_active":"2024-09-13T17:11:27.352947+0000","last_became_peered":"2024-09-13T17:11:27.352947+0000","last_unstale":"2024-09-13T17:11:48.790425+0000","last_undegraded":"2024-09-13T17:11:48.790425+0000","last_fullsized":"2024-09-13T17:11:48.790425+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:04.619618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792636+0000","last_change":"2024-09-13T17:11:23.330128+0000","last_active":"2024-09-13T17:11:48.792636+0000","last_peered":"2024-09-13T17:11:48.792636+0000","last_clean":"2024-09-13T17:11:48.792636+0000","last_became_active":"2024-09-13T17:11:23.329266+0000","last_became_peered":"2024-09-13T17:11:23.329266+0000","last_unstale":"2024-09-13T17:11:48.792636+0000","last_undegraded":"2024-09-13T17:11:48.792636+0000","last_fullsized":"2024-09-13T17:11:48.792636+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:36.275352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'4","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.795578+0000","last_change":"2024-09-13T17:11:23.003495+0000","last_active":"2024-09-13T17:11:49.795578+0000","last_peered":"2024-09-13T17:11:49.795578+0000","last_clean":"2024-09-13T17:11:49.795578+0000","last_became_active":"2024-09-13T17:11:23.003186+0000","last_became_peered":"2024-09-13T17:11:23.003186+0000","last_unstale":"2024-09-13T17:11:49.795578+0000","last_undegraded":"2024-09-13T17:11:49.795578+0000","last_fullsized":"2024-09-13T17:11:49.795578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:23.353587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.790306+0000","last_change":"2024-09-13T17:11:27.362233+0000","last_active":"2024-09-13T17:11:48.790306+0000","last_peered":"2024-09-13T17:11:48.790306+0000","last_clean":"2024-09-13T17:11:48.790306+0000","last_became_active":"2024-09-13T17:11:27.361814+0000","last_became_peered":"2024-09-13T17:11:27.361814+0000","last_unstale":"2024-09-13T17:11:48.790306+0000","last_undegraded":"2024-09-13T17:11:48.790306+0000","last_fullsized":"2024-09-13T17:11:48.790306+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:20.723366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.789824+0000","last_change":"2024-09-13T17:11:23.332870+0000","last_active":"2024-09-13T17:11:48.789824+0000","last_peered":"2024-09-13T17:11:48.789824+0000","last_clean":"2024-09-13T17:11:48.789824+0000","last_became_active":"2024-09-13T17:11:23.332583+0000","last_became_peered":"2024-09-13T17:11:23.332583+0000","last_unstale":"2024-09-13T17:11:48.789824+0000","last_undegraded":"2024-09-13T17:11:48.789824+0000","last_fullsized":"2024-09-13T17:11:48.789824+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:22.607666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.796075+0000","last_change":"2024-09-13T17:11:23.001932+0000","last_active":"2024-09-13T17:11:48.796075+0000","last_peered":"2024-09-13T17:11:48.796075+0000","last_clean":"2024-09-13T17:11:48.796075+0000","last_became_active":"2024-09-13T17:11:23.001642+0000","last_became_peered":"2024-09-13T17:11:23.001642+0000","last_unstale":"2024-09-13T17:11:48.796075+0000","last_undegraded":"2024-09-13T17:11:48.796075+0000","last_fullsized":"2024-09-13T17:11:48.796075+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:05.976897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.793096+0000","last_change":"2024-09-13T17:11:27.359679+0000","last_active":"2024-09-13T17:11:48.793096+0000","last_peered":"2024-09-13T17:11:48.793096+0000","last_clean":"2024-09-13T17:11:48.793096+0000","last_became_active":"2024-09-13T17:11:27.359268+0000","last_became_peered":"2024-09-13T17:11:27.359268+0000","last_unstale":"2024-09-13T17:11:48.793096+0000","last_undegraded":"2024-09-13T17:11:48.793096+0000","last_fullsized":"2024-09-13T17:11:48.793096+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:48.154917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.793159+0000","last_change":"2024-09-13T17:11:23.340031+0000","last_active":"2024-09-13T17:11:48.793159+0000","last_peered":"2024-09-13T17:11:48.793159+0000","last_clean":"2024-09-13T17:11:48.793159+0000","last_became_active":"2024-09-13T17:11:23.339768+0000","last_became_peered":"2024-09-13T17:11:23.339768+0000","last_unstale":"2024-09-13T17:11:48.793159+0000","last_undegraded":"2024-09-13T17:11:48.793159+0000","last_fullsized":"2024-09-13T17:11:48.793159+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:22.360526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.788033+0000","last_change":"2024-09-13T17:11:22.995060+0000","last_active":"2024-09-13T17:11:47.788033+0000","last_peered":"2024-09-13T17:11:47.788033+0000","last_clean":"2024-09-13T17:11:47.788033+0000","last_became_active":"2024-09-13T17:11:22.991949+0000","last_became_peered":"2024-09-13T17:11:22.991949+0000","last_unstale":"2024-09-13T17:11:47.788033+0000","last_undegraded":"2024-09-13T17:11:47.788033+0000","last_fullsized":"2024-09-13T17:11:47.788033+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:44.716753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":340,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.796218+0000","last_change":"2024-09-13T17:10:13.439723+0000","last_active":"2024-09-13T17:11:48.796218+0000","last_peered":"2024-09-13T17:11:48.796218+0000","last_clean":"2024-09-13T17:11:48.796218+0000","last_became_active":"2024-09-13T17:10:13.439290+0000","last_became_peered":"2024-09-13T17:10:13.439290+0000","last_unstale":"2024-09-13T17:11:48.796218+0000","last_undegraded":"2024-09-13T17:11:48.796218+0000","last_fullsized":"2024-09-13T17:11:48.796218+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:03.041486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:03.041486+0000","last_clean_scrub_stamp":"2024-09-13T17:07:03.041486+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:08.673571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.798637+0000","last_change":"2024-09-13T17:11:27.361028+0000","last_active":"2024-09-13T17:11:48.798637+0000","last_peered":"2024-09-13T17:11:48.798637+0000","last_clean":"2024-09-13T17:11:48.798637+0000","last_became_active":"2024-09-13T17:11:27.360630+0000","last_became_peered":"2024-09-13T17:11:27.360630+0000","last_unstale":"2024-09-13T17:11:48.798637+0000","last_undegraded":"2024-09-13T17:11:48.798637+0000","last_fullsized":"2024-09-13T17:11:48.798637+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:40:40.860443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.798729+0000","last_change":"2024-09-13T17:11:49.798729+0000","last_active":"2024-09-13T17:11:49.798729+0000","last_peered":"2024-09-13T17:11:49.798729+0000","last_clean":"2024-09-13T17:11:49.798729+0000","last_became_active":"2024-09-13T17:11:49.798402+0000","last_became_peered":"2024-09-13T17:11:49.798402+0000","last_unstale":"2024-09-13T17:11:49.798729+0000","last_undegraded":"2024-09-13T17:11:49.798729+0000","last_fullsized":"2024-09-13T17:11:49.798729+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:58.948813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,11],"acting":[7,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":2,"reported_epoch":90,"state":"peering","last_fresh":"2024-09-13T17:11:27.684094+0000","last_change":"2024-09-13T17:11:49.540357+0000","last_active":"2024-09-13T17:11:49.540357+0000","last_peered":"2024-09-13T17:11:27.684094+0000","last_clean":"2024-09-13T17:11:27.684094+0000","last_became_active":"2024-09-13T17:11:23.003102+0000","last_became_peered":"2024-09-13T17:11:23.003102+0000","last_unstale":"2024-09-13T17:11:27.684094+0000","last_undegraded":"2024-09-13T17:11:27.684094+0000","last_fullsized":"2024-09-13T17:11:27.684094+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:08.827045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.791597+0000","last_change":"2024-09-13T17:11:27.360372+0000","last_active":"2024-09-13T17:11:48.791597+0000","last_peered":"2024-09-13T17:11:48.791597+0000","last_clean":"2024-09-13T17:11:48.791597+0000","last_became_active":"2024-09-13T17:11:27.359990+0000","last_became_peered":"2024-09-13T17:11:27.359990+0000","last_unstale":"2024-09-13T17:11:48.791597+0000","last_undegraded":"2024-09-13T17:11:48.791597+0000","last_fullsized":"2024-09-13T17:11:48.791597+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:26.970317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.795820+0000","last_change":"2024-09-13T17:11:23.336269+0000","last_active":"2024-09-13T17:11:48.795820+0000","last_peered":"2024-09-13T17:11:48.795820+0000","last_clean":"2024-09-13T17:11:48.795820+0000","last_became_active":"2024-09-13T17:11:23.335921+0000","last_became_peered":"2024-09-13T17:11:23.335921+0000","last_unstale":"2024-09-13T17:11:48.795820+0000","last_undegraded":"2024-09-13T17:11:48.795820+0000","last_fullsized":"2024-09-13T17:11:48.795820+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:43.035927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792688+0000","last_change":"2024-09-13T17:11:23.002491+0000","last_active":"2024-09-13T17:11:48.792688+0000","last_peered":"2024-09-13T17:11:48.792688+0000","last_clean":"2024-09-13T17:11:48.792688+0000","last_became_active":"2024-09-13T17:11:23.002178+0000","last_became_peered":"2024-09-13T17:11:23.002178+0000","last_unstale":"2024-09-13T17:11:48.792688+0000","last_undegraded":"2024-09-13T17:11:48.792688+0000","last_fullsized":"2024-09-13T17:11:48.792688+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:06.056639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.108773+0000","last_change":"2024-09-13T17:11:27.355153+0000","last_active":"2024-09-13T17:11:29.108773+0000","last_peered":"2024-09-13T17:11:29.108773+0000","last_clean":"2024-09-13T17:11:29.108773+0000","last_became_active":"2024-09-13T17:11:27.354701+0000","last_became_peered":"2024-09-13T17:11:27.354701+0000","last_unstale":"2024-09-13T17:11:29.108773+0000","last_undegraded":"2024-09-13T17:11:29.108773+0000","last_fullsized":"2024-09-13T17:11:29.108773+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:34.924402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.797409+0000","last_change":"2024-09-13T17:11:23.342067+0000","last_active":"2024-09-13T17:11:48.797409+0000","last_peered":"2024-09-13T17:11:48.797409+0000","last_clean":"2024-09-13T17:11:48.797409+0000","last_became_active":"2024-09-13T17:11:23.341736+0000","last_became_peered":"2024-09-13T17:11:23.341736+0000","last_unstale":"2024-09-13T17:11:48.797409+0000","last_undegraded":"2024-09-13T17:11:48.797409+0000","last_fullsized":"2024-09-13T17:11:48.797409+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:03.114638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.790455+0000","last_change":"2024-09-13T17:11:23.002849+0000","last_active":"2024-09-13T17:11:48.790455+0000","last_peered":"2024-09-13T17:11:48.790455+0000","last_clean":"2024-09-13T17:11:48.790455+0000","last_became_active":"2024-09-13T17:11:23.002562+0000","last_became_peered":"2024-09-13T17:11:23.002562+0000","last_unstale":"2024-09-13T17:11:48.790455+0000","last_undegraded":"2024-09-13T17:11:48.790455+0000","last_fullsized":"2024-09-13T17:11:48.790455+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:11:24.650510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.791707+0000","last_change":"2024-09-13T17:11:27.359343+0000","last_active":"2024-09-13T17:11:48.791707+0000","last_peered":"2024-09-13T17:11:48.791707+0000","last_clean":"2024-09-13T17:11:48.791707+0000","last_became_active":"2024-09-13T17:11:27.358628+0000","last_became_peered":"2024-09-13T17:11:27.358628+0000","last_unstale":"2024-09-13T17:11:48.791707+0000","last_undegraded":"2024-09-13T17:11:48.791707+0000","last_fullsized":"2024-09-13T17:11:48.791707+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:39.584184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801190+0000","last_change":"2024-09-13T17:11:23.333111+0000","last_active":"2024-09-13T17:11:48.801190+0000","last_peered":"2024-09-13T17:11:48.801190+0000","last_clean":"2024-09-13T17:11:48.801190+0000","last_became_active":"2024-09-13T17:11:23.332734+0000","last_became_peered":"2024-09-13T17:11:23.332734+0000","last_unstale":"2024-09-13T17:11:48.801190+0000","last_undegraded":"2024-09-13T17:11:48.801190+0000","last_fullsized":"2024-09-13T17:11:48.801190+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:44.628106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"91'2","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.794103+0000","last_change":"2024-09-13T17:11:23.000759+0000","last_active":"2024-09-13T17:11:49.794103+0000","last_peered":"2024-09-13T17:11:49.794103+0000","last_clean":"2024-09-13T17:11:49.794103+0000","last_became_active":"2024-09-13T17:11:23.000463+0000","last_became_peered":"2024-09-13T17:11:23.000463+0000","last_unstale":"2024-09-13T17:11:49.794103+0000","last_undegraded":"2024-09-13T17:11:49.794103+0000","last_fullsized":"2024-09-13T17:11:49.794103+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:59.077194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.791776+0000","last_change":"2024-09-13T17:11:27.363076+0000","last_active":"2024-09-13T17:11:48.791776+0000","last_peered":"2024-09-13T17:11:48.791776+0000","last_clean":"2024-09-13T17:11:48.791776+0000","last_became_active":"2024-09-13T17:11:27.362642+0000","last_became_peered":"2024-09-13T17:11:27.362642+0000","last_unstale":"2024-09-13T17:11:48.791776+0000","last_undegraded":"2024-09-13T17:11:48.791776+0000","last_fullsized":"2024-09-13T17:11:48.791776+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:25.494875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792014+0000","last_change":"2024-09-13T17:11:23.336703+0000","last_active":"2024-09-13T17:11:48.792014+0000","last_peered":"2024-09-13T17:11:48.792014+0000","last_clean":"2024-09-13T17:11:48.792014+0000","last_became_active":"2024-09-13T17:11:23.336349+0000","last_became_peered":"2024-09-13T17:11:23.336349+0000","last_unstale":"2024-09-13T17:11:48.792014+0000","last_undegraded":"2024-09-13T17:11:48.792014+0000","last_fullsized":"2024-09-13T17:11:48.792014+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:28.671438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799746+0000","last_change":"2024-09-13T17:11:22.994382+0000","last_active":"2024-09-13T17:11:48.799746+0000","last_peered":"2024-09-13T17:11:48.799746+0000","last_clean":"2024-09-13T17:11:48.799746+0000","last_became_active":"2024-09-13T17:11:22.994037+0000","last_became_peered":"2024-09-13T17:11:22.994037+0000","last_unstale":"2024-09-13T17:11:48.799746+0000","last_undegraded":"2024-09-13T17:11:48.799746+0000","last_fullsized":"2024-09-13T17:11:48.799746+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:10.763757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.790388+0000","last_change":"2024-09-13T17:11:27.354351+0000","last_active":"2024-09-13T17:11:48.790388+0000","last_peered":"2024-09-13T17:11:48.790388+0000","last_clean":"2024-09-13T17:11:48.790388+0000","last_became_active":"2024-09-13T17:11:27.353715+0000","last_became_peered":"2024-09-13T17:11:27.353715+0000","last_unstale":"2024-09-13T17:11:48.790388+0000","last_undegraded":"2024-09-13T17:11:48.790388+0000","last_fullsized":"2024-09-13T17:11:48.790388+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:18.335183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.795992+0000","last_change":"2024-09-13T17:11:23.341743+0000","last_active":"2024-09-13T17:11:48.795992+0000","last_peered":"2024-09-13T17:11:48.795992+0000","last_clean":"2024-09-13T17:11:48.795992+0000","last_became_active":"2024-09-13T17:11:23.341200+0000","last_became_peered":"2024-09-13T17:11:23.341200+0000","last_unstale":"2024-09-13T17:11:48.795992+0000","last_undegraded":"2024-09-13T17:11:48.795992+0000","last_fullsized":"2024-09-13T17:11:48.795992+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:41.854013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'3","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.800911+0000","last_change":"2024-09-13T17:11:22.997571+0000","last_active":"2024-09-13T17:11:48.800911+0000","last_peered":"2024-09-13T17:11:48.800911+0000","last_clean":"2024-09-13T17:11:48.800911+0000","last_became_active":"2024-09-13T17:11:22.997238+0000","last_became_peered":"2024-09-13T17:11:22.997238+0000","last_unstale":"2024-09-13T17:11:48.800911+0000","last_undegraded":"2024-09-13T17:11:48.800911+0000","last_fullsized":"2024-09-13T17:11:48.800911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:34.533004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794718+0000","last_change":"2024-09-13T17:11:27.356892+0000","last_active":"2024-09-13T17:11:48.794718+0000","last_peered":"2024-09-13T17:11:48.794718+0000","last_clean":"2024-09-13T17:11:48.794718+0000","last_became_active":"2024-09-13T17:11:27.356136+0000","last_became_peered":"2024-09-13T17:11:27.356136+0000","last_unstale":"2024-09-13T17:11:48.794718+0000","last_undegraded":"2024-09-13T17:11:48.794718+0000","last_fullsized":"2024-09-13T17:11:48.794718+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:23.207064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.796238+0000","last_change":"2024-09-13T17:11:23.337666+0000","last_active":"2024-09-13T17:11:48.796238+0000","last_peered":"2024-09-13T17:11:48.796238+0000","last_clean":"2024-09-13T17:11:48.796238+0000","last_became_active":"2024-09-13T17:11:23.337185+0000","last_became_peered":"2024-09-13T17:11:23.337185+0000","last_unstale":"2024-09-13T17:11:48.796238+0000","last_undegraded":"2024-09-13T17:11:48.796238+0000","last_fullsized":"2024-09-13T17:11:48.796238+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:51.266709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792201+0000","last_change":"2024-09-13T17:11:23.005075+0000","last_active":"2024-09-13T17:11:48.792201+0000","last_peered":"2024-09-13T17:11:48.792201+0000","last_clean":"2024-09-13T17:11:48.792201+0000","last_became_active":"2024-09-13T17:11:23.004778+0000","last_became_peered":"2024-09-13T17:11:23.004778+0000","last_unstale":"2024-09-13T17:11:48.792201+0000","last_undegraded":"2024-09-13T17:11:48.792201+0000","last_fullsized":"2024-09-13T17:11:48.792201+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:06.763552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801204+0000","last_change":"2024-09-13T17:11:27.353601+0000","last_active":"2024-09-13T17:11:48.801204+0000","last_peered":"2024-09-13T17:11:48.801204+0000","last_clean":"2024-09-13T17:11:48.801204+0000","last_became_active":"2024-09-13T17:11:27.353190+0000","last_became_peered":"2024-09-13T17:11:27.353190+0000","last_unstale":"2024-09-13T17:11:48.801204+0000","last_undegraded":"2024-09-13T17:11:48.801204+0000","last_fullsized":"2024-09-13T17:11:48.801204+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:24.645552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.799773+0000","last_change":"2024-09-13T17:11:49.799773+0000","last_active":"2024-09-13T17:11:49.799773+0000","last_peered":"2024-09-13T17:11:49.799773+0000","last_clean":"2024-09-13T17:11:49.799773+0000","last_became_active":"2024-09-13T17:11:49.799402+0000","last_became_peered":"2024-09-13T17:11:49.799402+0000","last_unstale":"2024-09-13T17:11:49.799773+0000","last_undegraded":"2024-09-13T17:11:49.799773+0000","last_fullsized":"2024-09-13T17:11:49.799773+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:37.230144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.803208+0000","last_change":"2024-09-13T17:11:23.005619+0000","last_active":"2024-09-13T17:11:48.803208+0000","last_peered":"2024-09-13T17:11:48.803208+0000","last_clean":"2024-09-13T17:11:48.803208+0000","last_became_active":"2024-09-13T17:11:23.005077+0000","last_became_peered":"2024-09-13T17:11:23.005077+0000","last_unstale":"2024-09-13T17:11:48.803208+0000","last_undegraded":"2024-09-13T17:11:48.803208+0000","last_fullsized":"2024-09-13T17:11:48.803208+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:51.739773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792374+0000","last_change":"2024-09-13T17:11:27.364603+0000","last_active":"2024-09-13T17:11:48.792374+0000","last_peered":"2024-09-13T17:11:48.792374+0000","last_clean":"2024-09-13T17:11:48.792374+0000","last_became_active":"2024-09-13T17:11:27.364226+0000","last_became_peered":"2024-09-13T17:11:27.364226+0000","last_unstale":"2024-09-13T17:11:48.792374+0000","last_undegraded":"2024-09-13T17:11:48.792374+0000","last_fullsized":"2024-09-13T17:11:48.792374+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:56.802016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799662+0000","last_change":"2024-09-13T17:11:23.338657+0000","last_active":"2024-09-13T17:11:48.799662+0000","last_peered":"2024-09-13T17:11:48.799662+0000","last_clean":"2024-09-13T17:11:48.799662+0000","last_became_active":"2024-09-13T17:11:23.338377+0000","last_became_peered":"2024-09-13T17:11:23.338377+0000","last_unstale":"2024-09-13T17:11:48.799662+0000","last_undegraded":"2024-09-13T17:11:48.799662+0000","last_fullsized":"2024-09-13T17:11:48.799662+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:52.412887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'23","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.114064+0000","last_change":"2024-09-13T17:11:22.998541+0000","last_active":"2024-09-13T17:11:49.114064+0000","last_peered":"2024-09-13T17:11:49.114064+0000","last_clean":"2024-09-13T17:11:49.114064+0000","last_became_active":"2024-09-13T17:11:22.998132+0000","last_became_peered":"2024-09-13T17:11:22.998132+0000","last_unstale":"2024-09-13T17:11:49.114064+0000","last_undegraded":"2024-09-13T17:11:49.114064+0000","last_fullsized":"2024-09-13T17:11:49.114064+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:16.777772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40425,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":26,"num_write":24,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794245+0000","last_change":"2024-09-13T17:11:27.361917+0000","last_active":"2024-09-13T17:11:48.794245+0000","last_peered":"2024-09-13T17:11:48.794245+0000","last_clean":"2024-09-13T17:11:48.794245+0000","last_became_active":"2024-09-13T17:11:27.361503+0000","last_became_peered":"2024-09-13T17:11:27.361503+0000","last_unstale":"2024-09-13T17:11:48.794245+0000","last_undegraded":"2024-09-13T17:11:48.794245+0000","last_fullsized":"2024-09-13T17:11:48.794245+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:52.959017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.798971+0000","last_change":"2024-09-13T17:11:49.798971+0000","last_active":"2024-09-13T17:11:49.798971+0000","last_peered":"2024-09-13T17:11:49.798971+0000","last_clean":"2024-09-13T17:11:49.798971+0000","last_became_active":"2024-09-13T17:11:49.798597+0000","last_became_peered":"2024-09-13T17:11:49.798597+0000","last_unstale":"2024-09-13T17:11:49.798971+0000","last_undegraded":"2024-09-13T17:11:49.798971+0000","last_fullsized":"2024-09-13T17:11:49.798971+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:41.886456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792661+0000","last_change":"2024-09-13T17:11:23.004059+0000","last_active":"2024-09-13T17:11:48.792661+0000","last_peered":"2024-09-13T17:11:48.792661+0000","last_clean":"2024-09-13T17:11:48.792661+0000","last_became_active":"2024-09-13T17:11:23.003248+0000","last_became_peered":"2024-09-13T17:11:23.003248+0000","last_unstale":"2024-09-13T17:11:48.792661+0000","last_undegraded":"2024-09-13T17:11:48.792661+0000","last_fullsized":"2024-09-13T17:11:48.792661+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:05.496872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.537877+0000","last_change":"2024-09-13T17:11:27.362880+0000","last_active":"2024-09-13T17:11:29.537877+0000","last_peered":"2024-09-13T17:11:29.537877+0000","last_clean":"2024-09-13T17:11:29.537877+0000","last_became_active":"2024-09-13T17:11:27.362471+0000","last_became_peered":"2024-09-13T17:11:27.362471+0000","last_unstale":"2024-09-13T17:11:29.537877+0000","last_undegraded":"2024-09-13T17:11:29.537877+0000","last_fullsized":"2024-09-13T17:11:29.537877+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:49.964606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"peering","last_fresh":"2024-09-13T17:11:48.798762+0000","last_change":"2024-09-13T17:11:48.798906+0000","last_active":"2024-09-13T17:11:48.798762+0000","last_peered":"2024-09-13T17:11:27.833117+0000","last_clean":"2024-09-13T17:11:27.833117+0000","last_became_active":"2024-09-13T17:11:23.332871+0000","last_became_peered":"2024-09-13T17:11:23.332871+0000","last_unstale":"2024-09-13T17:11:48.798762+0000","last_undegraded":"2024-09-13T17:11:48.798762+0000","last_fullsized":"2024-09-13T17:11:48.798762+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:27.370999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,7],"acting":[0,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,5,7,8],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.795575+0000","last_change":"2024-09-13T17:11:22.999158+0000","last_active":"2024-09-13T17:11:48.795575+0000","last_peered":"2024-09-13T17:11:48.795575+0000","last_clean":"2024-09-13T17:11:48.795575+0000","last_became_active":"2024-09-13T17:11:22.998795+0000","last_became_peered":"2024-09-13T17:11:22.998795+0000","last_unstale":"2024-09-13T17:11:48.795575+0000","last_undegraded":"2024-09-13T17:11:48.795575+0000","last_fullsized":"2024-09-13T17:11:48.795575+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:23.880769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792383+0000","last_change":"2024-09-13T17:11:27.358105+0000","last_active":"2024-09-13T17:11:48.792383+0000","last_peered":"2024-09-13T17:11:48.792383+0000","last_clean":"2024-09-13T17:11:48.792383+0000","last_became_active":"2024-09-13T17:11:27.357740+0000","last_became_peered":"2024-09-13T17:11:27.357740+0000","last_unstale":"2024-09-13T17:11:48.792383+0000","last_undegraded":"2024-09-13T17:11:48.792383+0000","last_fullsized":"2024-09-13T17:11:48.792383+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:44.837353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792441+0000","last_change":"2024-09-13T17:11:23.338736+0000","last_active":"2024-09-13T17:11:48.792441+0000","last_peered":"2024-09-13T17:11:48.792441+0000","last_clean":"2024-09-13T17:11:48.792441+0000","last_became_active":"2024-09-13T17:11:23.338462+0000","last_became_peered":"2024-09-13T17:11:23.338462+0000","last_unstale":"2024-09-13T17:11:48.792441+0000","last_undegraded":"2024-09-13T17:11:48.792441+0000","last_fullsized":"2024-09-13T17:11:48.792441+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:49.221314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'3","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.800595+0000","last_change":"2024-09-13T17:11:23.001966+0000","last_active":"2024-09-13T17:11:48.800595+0000","last_peered":"2024-09-13T17:11:48.800595+0000","last_clean":"2024-09-13T17:11:48.800595+0000","last_became_active":"2024-09-13T17:11:23.001565+0000","last_became_peered":"2024-09-13T17:11:23.001565+0000","last_unstale":"2024-09-13T17:11:48.800595+0000","last_undegraded":"2024-09-13T17:11:48.800595+0000","last_fullsized":"2024-09-13T17:11:48.800595+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:47.240702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792942+0000","last_change":"2024-09-13T17:11:27.360896+0000","last_active":"2024-09-13T17:11:48.792942+0000","last_peered":"2024-09-13T17:11:48.792942+0000","last_clean":"2024-09-13T17:11:48.792942+0000","last_became_active":"2024-09-13T17:11:27.360552+0000","last_became_peered":"2024-09-13T17:11:27.360552+0000","last_unstale":"2024-09-13T17:11:48.792942+0000","last_undegraded":"2024-09-13T17:11:48.792942+0000","last_fullsized":"2024-09-13T17:11:48.792942+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:08.726724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:29.108810+0000","last_change":"2024-09-13T17:11:27.356317+0000","last_active":"2024-09-13T17:11:29.108810+0000","last_peered":"2024-09-13T17:11:29.108810+0000","last_clean":"2024-09-13T17:11:29.108810+0000","last_became_active":"2024-09-13T17:11:27.355863+0000","last_became_peered":"2024-09-13T17:11:27.355863+0000","last_unstale":"2024-09-13T17:11:29.108810+0000","last_undegraded":"2024-09-13T17:11:29.108810+0000","last_fullsized":"2024-09-13T17:11:29.108810+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:29.356048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.793992+0000","last_change":"2024-09-13T17:11:23.344929+0000","last_active":"2024-09-13T17:11:48.793992+0000","last_peered":"2024-09-13T17:11:48.793992+0000","last_clean":"2024-09-13T17:11:48.793992+0000","last_became_active":"2024-09-13T17:11:23.344627+0000","last_became_peered":"2024-09-13T17:11:23.344627+0000","last_unstale":"2024-09-13T17:11:48.793992+0000","last_undegraded":"2024-09-13T17:11:48.793992+0000","last_fullsized":"2024-09-13T17:11:48.793992+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:15.049627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792723+0000","last_change":"2024-09-13T17:11:23.002539+0000","last_active":"2024-09-13T17:11:48.792723+0000","last_peered":"2024-09-13T17:11:48.792723+0000","last_clean":"2024-09-13T17:11:48.792723+0000","last_became_active":"2024-09-13T17:11:23.002206+0000","last_became_peered":"2024-09-13T17:11:23.002206+0000","last_unstale":"2024-09-13T17:11:48.792723+0000","last_undegraded":"2024-09-13T17:11:48.792723+0000","last_fullsized":"2024-09-13T17:11:48.792723+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:57.708167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801253+0000","last_change":"2024-09-13T17:11:27.362667+0000","last_active":"2024-09-13T17:11:48.801253+0000","last_peered":"2024-09-13T17:11:48.801253+0000","last_clean":"2024-09-13T17:11:48.801253+0000","last_became_active":"2024-09-13T17:11:27.362293+0000","last_became_peered":"2024-09-13T17:11:27.362293+0000","last_unstale":"2024-09-13T17:11:48.801253+0000","last_undegraded":"2024-09-13T17:11:48.801253+0000","last_fullsized":"2024-09-13T17:11:48.801253+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:24.446951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.793137+0000","last_change":"2024-09-13T17:11:23.335823+0000","last_active":"2024-09-13T17:11:48.793137+0000","last_peered":"2024-09-13T17:11:48.793137+0000","last_clean":"2024-09-13T17:11:48.793137+0000","last_became_active":"2024-09-13T17:11:23.335491+0000","last_became_peered":"2024-09-13T17:11:23.335491+0000","last_unstale":"2024-09-13T17:11:48.793137+0000","last_undegraded":"2024-09-13T17:11:48.793137+0000","last_fullsized":"2024-09-13T17:11:48.793137+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:42.172559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.789870+0000","last_change":"2024-09-13T17:11:22.999477+0000","last_active":"2024-09-13T17:11:48.789870+0000","last_peered":"2024-09-13T17:11:48.789870+0000","last_clean":"2024-09-13T17:11:48.789870+0000","last_became_active":"2024-09-13T17:11:22.999175+0000","last_became_peered":"2024-09-13T17:11:22.999175+0000","last_unstale":"2024-09-13T17:11:48.789870+0000","last_undegraded":"2024-09-13T17:11:48.789870+0000","last_fullsized":"2024-09-13T17:11:48.789870+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:03.817508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:47.178558+0000","last_change":"2024-09-13T17:11:23.001737+0000","last_active":"2024-09-13T17:11:47.178558+0000","last_peered":"2024-09-13T17:11:47.178558+0000","last_clean":"2024-09-13T17:11:47.178558+0000","last_became_active":"2024-09-13T17:11:23.001296+0000","last_became_peered":"2024-09-13T17:11:23.001296+0000","last_unstale":"2024-09-13T17:11:47.178558+0000","last_undegraded":"2024-09-13T17:11:47.178558+0000","last_fullsized":"2024-09-13T17:11:47.178558+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:08.671244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792018+0000","last_change":"2024-09-13T17:11:23.337738+0000","last_active":"2024-09-13T17:11:48.792018+0000","last_peered":"2024-09-13T17:11:48.792018+0000","last_clean":"2024-09-13T17:11:48.792018+0000","last_became_active":"2024-09-13T17:11:23.337411+0000","last_became_peered":"2024-09-13T17:11:23.337411+0000","last_unstale":"2024-09-13T17:11:48.792018+0000","last_undegraded":"2024-09-13T17:11:48.792018+0000","last_fullsized":"2024-09-13T17:11:48.792018+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:02.355706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.803213+0000","last_change":"2024-09-13T17:11:27.363174+0000","last_active":"2024-09-13T17:11:48.803213+0000","last_peered":"2024-09-13T17:11:48.803213+0000","last_clean":"2024-09-13T17:11:48.803213+0000","last_became_active":"2024-09-13T17:11:27.362158+0000","last_became_peered":"2024-09-13T17:11:27.362158+0000","last_unstale":"2024-09-13T17:11:48.803213+0000","last_undegraded":"2024-09-13T17:11:48.803213+0000","last_fullsized":"2024-09-13T17:11:48.803213+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:49:52.892616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'6","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:50.806879+0000","last_change":"2024-09-13T17:11:23.000544+0000","last_active":"2024-09-13T17:11:50.806879+0000","last_peered":"2024-09-13T17:11:50.806879+0000","last_clean":"2024-09-13T17:11:50.806879+0000","last_became_active":"2024-09-13T17:11:23.000233+0000","last_became_peered":"2024-09-13T17:11:23.000233+0000","last_unstale":"2024-09-13T17:11:50.806879+0000","last_undegraded":"2024-09-13T17:11:50.806879+0000","last_fullsized":"2024-09-13T17:11:50.806879+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:04.745950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":966,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799756+0000","last_change":"2024-09-13T17:11:23.340104+0000","last_active":"2024-09-13T17:11:48.799756+0000","last_peered":"2024-09-13T17:11:48.799756+0000","last_clean":"2024-09-13T17:11:48.799756+0000","last_became_active":"2024-09-13T17:11:23.339826+0000","last_became_peered":"2024-09-13T17:11:23.339826+0000","last_unstale":"2024-09-13T17:11:48.799756+0000","last_undegraded":"2024-09-13T17:11:48.799756+0000","last_fullsized":"2024-09-13T17:11:48.799756+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:03.101547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.803194+0000","last_change":"2024-09-13T17:11:27.360848+0000","last_active":"2024-09-13T17:11:48.803194+0000","last_peered":"2024-09-13T17:11:48.803194+0000","last_clean":"2024-09-13T17:11:48.803194+0000","last_became_active":"2024-09-13T17:11:27.360416+0000","last_became_peered":"2024-09-13T17:11:27.360416+0000","last_unstale":"2024-09-13T17:11:48.803194+0000","last_undegraded":"2024-09-13T17:11:48.803194+0000","last_fullsized":"2024-09-13T17:11:48.803194+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:06.857649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.800926+0000","last_change":"2024-09-13T17:11:23.334723+0000","last_active":"2024-09-13T17:11:48.800926+0000","last_peered":"2024-09-13T17:11:48.800926+0000","last_clean":"2024-09-13T17:11:48.800926+0000","last_became_active":"2024-09-13T17:11:23.334433+0000","last_became_peered":"2024-09-13T17:11:23.334433+0000","last_unstale":"2024-09-13T17:11:48.800926+0000","last_undegraded":"2024-09-13T17:11:48.800926+0000","last_fullsized":"2024-09-13T17:11:48.800926+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:08.657151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.803139+0000","last_change":"2024-09-13T17:11:23.334882+0000","last_active":"2024-09-13T17:11:48.803139+0000","last_peered":"2024-09-13T17:11:48.803139+0000","last_clean":"2024-09-13T17:11:48.803139+0000","last_became_active":"2024-09-13T17:11:23.334610+0000","last_became_peered":"2024-09-13T17:11:23.334610+0000","last_unstale":"2024-09-13T17:11:48.803139+0000","last_undegraded":"2024-09-13T17:11:48.803139+0000","last_fullsized":"2024-09-13T17:11:48.803139+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:03.932181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.802945+0000","last_change":"2024-09-13T17:11:23.334076+0000","last_active":"2024-09-13T17:11:48.802945+0000","last_peered":"2024-09-13T17:11:48.802945+0000","last_clean":"2024-09-13T17:11:48.802945+0000","last_became_active":"2024-09-13T17:11:23.333801+0000","last_became_peered":"2024-09-13T17:11:23.333801+0000","last_unstale":"2024-09-13T17:11:48.802945+0000","last_undegraded":"2024-09-13T17:11:48.802945+0000","last_fullsized":"2024-09-13T17:11:48.802945+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:07.113045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832811+0000","last_change":"2024-09-13T17:11:23.332306+0000","last_active":"2024-09-13T17:11:27.832811+0000","last_peered":"2024-09-13T17:11:27.832811+0000","last_clean":"2024-09-13T17:11:27.832811+0000","last_became_active":"2024-09-13T17:11:23.331913+0000","last_became_peered":"2024-09-13T17:11:23.331913+0000","last_unstale":"2024-09-13T17:11:27.832811+0000","last_undegraded":"2024-09-13T17:11:27.832811+0000","last_fullsized":"2024-09-13T17:11:27.832811+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:02.927286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.790286+0000","last_change":"2024-09-13T17:11:23.335512+0000","last_active":"2024-09-13T17:11:48.790286+0000","last_peered":"2024-09-13T17:11:48.790286+0000","last_clean":"2024-09-13T17:11:48.790286+0000","last_became_active":"2024-09-13T17:11:23.335201+0000","last_became_peered":"2024-09-13T17:11:23.335201+0000","last_unstale":"2024-09-13T17:11:48.790286+0000","last_undegraded":"2024-09-13T17:11:48.790286+0000","last_fullsized":"2024-09-13T17:11:48.790286+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:17.263819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801579+0000","last_change":"2024-09-13T17:11:23.341204+0000","last_active":"2024-09-13T17:11:48.801579+0000","last_peered":"2024-09-13T17:11:48.801579+0000","last_clean":"2024-09-13T17:11:48.801579+0000","last_became_active":"2024-09-13T17:11:23.339848+0000","last_became_peered":"2024-09-13T17:11:23.339848+0000","last_unstale":"2024-09-13T17:11:48.801579+0000","last_undegraded":"2024-09-13T17:11:48.801579+0000","last_fullsized":"2024-09-13T17:11:48.801579+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:15:09.480651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.803495+0000","last_change":"2024-09-13T17:11:23.334741+0000","last_active":"2024-09-13T17:11:48.803495+0000","last_peered":"2024-09-13T17:11:48.803495+0000","last_clean":"2024-09-13T17:11:48.803495+0000","last_became_active":"2024-09-13T17:11:23.334459+0000","last_became_peered":"2024-09-13T17:11:23.334459+0000","last_unstale":"2024-09-13T17:11:48.803495+0000","last_undegraded":"2024-09-13T17:11:48.803495+0000","last_fullsized":"2024-09-13T17:11:48.803495+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:52.379735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794473+0000","last_change":"2024-09-13T17:11:23.337869+0000","last_active":"2024-09-13T17:11:48.794473+0000","last_peered":"2024-09-13T17:11:48.794473+0000","last_clean":"2024-09-13T17:11:48.794473+0000","last_became_active":"2024-09-13T17:11:23.337581+0000","last_became_peered":"2024-09-13T17:11:23.337581+0000","last_unstale":"2024-09-13T17:11:48.794473+0000","last_undegraded":"2024-09-13T17:11:48.794473+0000","last_fullsized":"2024-09-13T17:11:48.794473+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:49.407474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.798177+0000","last_change":"2024-09-13T17:11:49.797828+0000","last_active":"2024-09-13T17:11:49.798177+0000","last_peered":"2024-09-13T17:11:49.798177+0000","last_clean":"2024-09-13T17:11:49.798177+0000","last_became_active":"2024-09-13T17:11:49.797504+0000","last_became_peered":"2024-09-13T17:11:49.797504+0000","last_unstale":"2024-09-13T17:11:49.798177+0000","last_undegraded":"2024-09-13T17:11:49.798177+0000","last_fullsized":"2024-09-13T17:11:49.798177+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:29.677936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.793118+0000","last_change":"2024-09-13T17:11:23.336713+0000","last_active":"2024-09-13T17:11:48.793118+0000","last_peered":"2024-09-13T17:11:48.793118+0000","last_clean":"2024-09-13T17:11:48.793118+0000","last_became_active":"2024-09-13T17:11:23.336431+0000","last_became_peered":"2024-09-13T17:11:23.336431+0000","last_unstale":"2024-09-13T17:11:48.793118+0000","last_undegraded":"2024-09-13T17:11:48.793118+0000","last_fullsized":"2024-09-13T17:11:48.793118+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:52.709483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.791904+0000","last_change":"2024-09-13T17:11:23.340385+0000","last_active":"2024-09-13T17:11:48.791904+0000","last_peered":"2024-09-13T17:11:48.791904+0000","last_clean":"2024-09-13T17:11:48.791904+0000","last_became_active":"2024-09-13T17:11:23.340068+0000","last_became_peered":"2024-09-13T17:11:23.340068+0000","last_unstale":"2024-09-13T17:11:48.791904+0000","last_undegraded":"2024-09-13T17:11:48.791904+0000","last_fullsized":"2024-09-13T17:11:48.791904+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:17.795222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.790214+0000","last_change":"2024-09-13T17:11:23.329214+0000","last_active":"2024-09-13T17:11:48.790214+0000","last_peered":"2024-09-13T17:11:48.790214+0000","last_clean":"2024-09-13T17:11:48.790214+0000","last_became_active":"2024-09-13T17:11:23.328747+0000","last_became_peered":"2024-09-13T17:11:23.328747+0000","last_unstale":"2024-09-13T17:11:48.790214+0000","last_undegraded":"2024-09-13T17:11:48.790214+0000","last_fullsized":"2024-09-13T17:11:48.790214+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:11.233652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801419+0000","last_change":"2024-09-13T17:11:23.339854+0000","last_active":"2024-09-13T17:11:48.801419+0000","last_peered":"2024-09-13T17:11:48.801419+0000","last_clean":"2024-09-13T17:11:48.801419+0000","last_became_active":"2024-09-13T17:11:23.339565+0000","last_became_peered":"2024-09-13T17:11:23.339565+0000","last_unstale":"2024-09-13T17:11:48.801419+0000","last_undegraded":"2024-09-13T17:11:48.801419+0000","last_fullsized":"2024-09-13T17:11:48.801419+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:37.161135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.803426+0000","last_change":"2024-09-13T17:11:23.342562+0000","last_active":"2024-09-13T17:11:48.803426+0000","last_peered":"2024-09-13T17:11:48.803426+0000","last_clean":"2024-09-13T17:11:48.803426+0000","last_became_active":"2024-09-13T17:11:23.342256+0000","last_became_peered":"2024-09-13T17:11:23.342256+0000","last_unstale":"2024-09-13T17:11:48.803426+0000","last_undegraded":"2024-09-13T17:11:48.803426+0000","last_fullsized":"2024-09-13T17:11:48.803426+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:30.788242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.795154+0000","last_change":"2024-09-13T17:11:23.342436+0000","last_active":"2024-09-13T17:11:48.795154+0000","last_peered":"2024-09-13T17:11:48.795154+0000","last_clean":"2024-09-13T17:11:48.795154+0000","last_became_active":"2024-09-13T17:11:23.342157+0000","last_became_peered":"2024-09-13T17:11:23.342157+0000","last_unstale":"2024-09-13T17:11:48.795154+0000","last_undegraded":"2024-09-13T17:11:48.795154+0000","last_fullsized":"2024-09-13T17:11:48.795154+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:56.550875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801559+0000","last_change":"2024-09-13T17:11:23.341660+0000","last_active":"2024-09-13T17:11:48.801559+0000","last_peered":"2024-09-13T17:11:48.801559+0000","last_clean":"2024-09-13T17:11:48.801559+0000","last_became_active":"2024-09-13T17:11:23.341102+0000","last_became_peered":"2024-09-13T17:11:23.341102+0000","last_unstale":"2024-09-13T17:11:48.801559+0000","last_undegraded":"2024-09-13T17:11:48.801559+0000","last_fullsized":"2024-09-13T17:11:48.801559+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:00.546907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.791477+0000","last_change":"2024-09-13T17:11:23.338064+0000","last_active":"2024-09-13T17:11:48.791477+0000","last_peered":"2024-09-13T17:11:48.791477+0000","last_clean":"2024-09-13T17:11:48.791477+0000","last_became_active":"2024-09-13T17:11:23.337748+0000","last_became_peered":"2024-09-13T17:11:23.337748+0000","last_unstale":"2024-09-13T17:11:48.791477+0000","last_undegraded":"2024-09-13T17:11:48.791477+0000","last_fullsized":"2024-09-13T17:11:48.791477+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:14.281629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832520+0000","last_change":"2024-09-13T17:11:23.335684+0000","last_active":"2024-09-13T17:11:27.832520+0000","last_peered":"2024-09-13T17:11:27.832520+0000","last_clean":"2024-09-13T17:11:27.832520+0000","last_became_active":"2024-09-13T17:11:23.335364+0000","last_became_peered":"2024-09-13T17:11:23.335364+0000","last_unstale":"2024-09-13T17:11:27.832520+0000","last_undegraded":"2024-09-13T17:11:27.832520+0000","last_fullsized":"2024-09-13T17:11:27.832520+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:02.288009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832521+0000","last_change":"2024-09-13T17:11:23.340881+0000","last_active":"2024-09-13T17:11:27.832521+0000","last_peered":"2024-09-13T17:11:27.832521+0000","last_clean":"2024-09-13T17:11:27.832521+0000","last_became_active":"2024-09-13T17:11:23.340575+0000","last_became_peered":"2024-09-13T17:11:23.340575+0000","last_unstale":"2024-09-13T17:11:27.832521+0000","last_undegraded":"2024-09-13T17:11:27.832521+0000","last_fullsized":"2024-09-13T17:11:27.832521+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:40.757703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.790161+0000","last_change":"2024-09-13T17:11:23.329039+0000","last_active":"2024-09-13T17:11:48.790161+0000","last_peered":"2024-09-13T17:11:48.790161+0000","last_clean":"2024-09-13T17:11:48.790161+0000","last_became_active":"2024-09-13T17:11:23.328324+0000","last_became_peered":"2024-09-13T17:11:23.328324+0000","last_unstale":"2024-09-13T17:11:48.790161+0000","last_undegraded":"2024-09-13T17:11:48.790161+0000","last_fullsized":"2024-09-13T17:11:48.790161+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:37.882596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.833586+0000","last_change":"2024-09-13T17:11:23.345229+0000","last_active":"2024-09-13T17:11:27.833586+0000","last_peered":"2024-09-13T17:11:27.833586+0000","last_clean":"2024-09-13T17:11:27.833586+0000","last_became_active":"2024-09-13T17:11:23.344883+0000","last_became_peered":"2024-09-13T17:11:23.344883+0000","last_unstale":"2024-09-13T17:11:27.833586+0000","last_undegraded":"2024-09-13T17:11:27.833586+0000","last_fullsized":"2024-09-13T17:11:27.833586+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:47.983382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799023+0000","last_change":"2024-09-13T17:11:23.346338+0000","last_active":"2024-09-13T17:11:48.799023+0000","last_peered":"2024-09-13T17:11:48.799023+0000","last_clean":"2024-09-13T17:11:48.799023+0000","last_became_active":"2024-09-13T17:11:23.344777+0000","last_became_peered":"2024-09-13T17:11:23.344777+0000","last_unstale":"2024-09-13T17:11:48.799023+0000","last_undegraded":"2024-09-13T17:11:48.799023+0000","last_fullsized":"2024-09-13T17:11:48.799023+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:23.650174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"peering","last_fresh":"2024-09-13T17:11:48.800882+0000","last_change":"2024-09-13T17:11:48.801055+0000","last_active":"2024-09-13T17:11:48.800882+0000","last_peered":"2024-09-13T17:11:27.834681+0000","last_clean":"2024-09-13T17:11:27.834681+0000","last_became_active":"2024-09-13T17:11:23.334660+0000","last_became_peered":"2024-09-13T17:11:23.334660+0000","last_unstale":"2024-09-13T17:11:48.800882+0000","last_undegraded":"2024-09-13T17:11:48.800882+0000","last_fullsized":"2024-09-13T17:11:48.800882+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:32.110092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,4,9],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.791755+0000","last_change":"2024-09-13T17:11:23.340478+0000","last_active":"2024-09-13T17:11:48.791755+0000","last_peered":"2024-09-13T17:11:48.791755+0000","last_clean":"2024-09-13T17:11:48.791755+0000","last_became_active":"2024-09-13T17:11:23.339916+0000","last_became_peered":"2024-09-13T17:11:23.339916+0000","last_unstale":"2024-09-13T17:11:48.791755+0000","last_undegraded":"2024-09-13T17:11:48.791755+0000","last_fullsized":"2024-09-13T17:11:48.791755+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:09.477626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.793059+0000","last_change":"2024-09-13T17:11:23.340882+0000","last_active":"2024-09-13T17:11:48.793059+0000","last_peered":"2024-09-13T17:11:48.793059+0000","last_clean":"2024-09-13T17:11:48.793059+0000","last_became_active":"2024-09-13T17:11:23.340413+0000","last_became_peered":"2024-09-13T17:11:23.340413+0000","last_unstale":"2024-09-13T17:11:48.793059+0000","last_undegraded":"2024-09-13T17:11:48.793059+0000","last_fullsized":"2024-09-13T17:11:48.793059+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:49.040015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.796753+0000","last_change":"2024-09-13T17:11:23.345551+0000","last_active":"2024-09-13T17:11:48.796753+0000","last_peered":"2024-09-13T17:11:48.796753+0000","last_clean":"2024-09-13T17:11:48.796753+0000","last_became_active":"2024-09-13T17:11:23.345195+0000","last_became_peered":"2024-09-13T17:11:23.345195+0000","last_unstale":"2024-09-13T17:11:48.796753+0000","last_undegraded":"2024-09-13T17:11:48.796753+0000","last_fullsized":"2024-09-13T17:11:48.796753+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:00.856969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"peering","last_fresh":"2024-09-13T17:11:48.799086+0000","last_change":"2024-09-13T17:11:48.799241+0000","last_active":"2024-09-13T17:11:48.799086+0000","last_peered":"2024-09-13T17:11:27.834170+0000","last_clean":"2024-09-13T17:11:27.834170+0000","last_became_active":"2024-09-13T17:11:23.334061+0000","last_became_peered":"2024-09-13T17:11:23.334061+0000","last_unstale":"2024-09-13T17:11:48.799086+0000","last_undegraded":"2024-09-13T17:11:48.799086+0000","last_fullsized":"2024-09-13T17:11:48.799086+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:40.383855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,7,9],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799582+0000","last_change":"2024-09-13T17:11:23.340286+0000","last_active":"2024-09-13T17:11:48.799582+0000","last_peered":"2024-09-13T17:11:48.799582+0000","last_clean":"2024-09-13T17:11:48.799582+0000","last_became_active":"2024-09-13T17:11:23.339756+0000","last_became_peered":"2024-09-13T17:11:23.339756+0000","last_unstale":"2024-09-13T17:11:48.799582+0000","last_undegraded":"2024-09-13T17:11:48.799582+0000","last_fullsized":"2024-09-13T17:11:48.799582+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:00.463087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.833501+0000","last_change":"2024-09-13T17:11:23.339818+0000","last_active":"2024-09-13T17:11:27.833501+0000","last_peered":"2024-09-13T17:11:27.833501+0000","last_clean":"2024-09-13T17:11:27.833501+0000","last_became_active":"2024-09-13T17:11:23.339501+0000","last_became_peered":"2024-09-13T17:11:23.339501+0000","last_unstale":"2024-09-13T17:11:27.833501+0000","last_undegraded":"2024-09-13T17:11:27.833501+0000","last_fullsized":"2024-09-13T17:11:27.833501+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:36.904004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832723+0000","last_change":"2024-09-13T17:11:23.334388+0000","last_active":"2024-09-13T17:11:27.832723+0000","last_peered":"2024-09-13T17:11:27.832723+0000","last_clean":"2024-09-13T17:11:27.832723+0000","last_became_active":"2024-09-13T17:11:23.333953+0000","last_became_peered":"2024-09-13T17:11:23.333953+0000","last_unstale":"2024-09-13T17:11:27.832723+0000","last_undegraded":"2024-09-13T17:11:27.832723+0000","last_fullsized":"2024-09-13T17:11:27.832723+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:33.929173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T17:11:27.832701+0000","last_change":"2024-09-13T17:11:23.338259+0000","last_active":"2024-09-13T17:11:27.832701+0000","last_peered":"2024-09-13T17:11:27.832701+0000","last_clean":"2024-09-13T17:11:27.832701+0000","last_became_active":"2024-09-13T17:11:23.337979+0000","last_became_peered":"2024-09-13T17:11:23.337979+0000","last_unstale":"2024-09-13T17:11:27.832701+0000","last_undegraded":"2024-09-13T17:11:27.832701+0000","last_fullsized":"2024-09-13T17:11:27.832701+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:55.750255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801517+0000","last_change":"2024-09-13T17:11:23.337899+0000","last_active":"2024-09-13T17:11:48.801517+0000","last_peered":"2024-09-13T17:11:48.801517+0000","last_clean":"2024-09-13T17:11:48.801517+0000","last_became_active":"2024-09-13T17:11:23.337626+0000","last_became_peered":"2024-09-13T17:11:23.337626+0000","last_unstale":"2024-09-13T17:11:48.801517+0000","last_undegraded":"2024-09-13T17:11:48.801517+0000","last_fullsized":"2024-09-13T17:11:48.801517+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:14.654852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":44331,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":37,"num_read_kb":49,"num_write":143,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":142811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285958,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383698,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":995328,"data_stored":499901,"data_compressed":17667,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.35499999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.497}]},{"osd":2,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.58199999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.41799999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.50900000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.67700000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":9,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.52000000000000002}]},{"osd":10,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.60599999999999998}]}]},{"osd":10,"up_from":72,"seq":309237645334,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":1105920,"data_stored":1118312,"data_compressed":51052,"data_compressed_allocated":65536,"data_compressed_original":630784,"omap_allocated":1597,"internal_metadata":36043203},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.52200000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.374},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.39700000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.624},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.60899999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.54500000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.443}]},{"osd":6,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.70999999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.51200000000000001}]},{"osd":8,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.50900000000000001}]},{"osd":9,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.67500000000000004}]},{"osd":11,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.746}]}]},{"osd":9,"up_from":67,"seq":287762808859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":1015808,"data_stored":504233,"data_compressed":17667,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1597,"internal_metadata":31848899},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.39700000000000002,"15min":0.40699999999999997},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.311},{"interface":"front","average":{"1min":0.37,"5min":0.41799999999999998,"15min":0.42599999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.55700000000000005,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.33300000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54400000000000004,"15min":0.54700000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.67700000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56100000000000005,"15min":0.56799999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.67800000000000005,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.58399999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.59399999999999997,"15min":0.60799999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.66400000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.58099999999999996,"15min":0.59199999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.755,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.53100000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.48699999999999999,"15min":0.501},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.64300000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.378,"5min":0.49399999999999999,"15min":0.51300000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.58499999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.40100000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.39900000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76500000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.505},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.63,"15min":0.64200000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.78300000000000003,"5min":1.26,"15min":1.26},"last":0.65100000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.64400000000000002,"15min":0.66000000000000003},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.69599999999999995,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.64900000000000002,"15min":0.66900000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68200000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.59599999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.49299999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.68400000000000005,"15min":0.69899999999999995},"min":{"1min":0.46200000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.85499999999999998,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.68500000000000005,"15min":0.70099999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.78700000000000003,"5min":1.018,"15min":1.018},"last":0.624}]},{"osd":8,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.67700000000000005,"15min":0.68899999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.86499999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.622,"5min":0.70599999999999996,"15min":0.71999999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.84799999999999998,"5min":1.228,"15min":1.228},"last":0.57399999999999995}]},{"osd":10,"last update":"Fri Sep 13 17:11:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.68100000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]}]},{"osd":8,"up_from":59,"seq":253403070497,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":500057,"data_compressed":17667,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67600000000000005,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.65500000000000003,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.67500000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54300000000000004,"15min":0.54400000000000004},"min":{"1min":0.34599999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71799999999999997,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.79900000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.41899999999999998,"15min":0.41799999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.63100000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.441,"15min":0.438},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70899999999999996,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.68999999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.73899999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.81299999999999994}]},{"osd":5,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.753},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53400000000000003,"15min":0.53600000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76700000000000002,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.78000000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.64400000000000002,"15min":0.64900000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.85999999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64700000000000002,"15min":0.64600000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92200000000000004,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90900000000000003,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.94999999999999996}]},{"osd":9,"last update":"Fri Sep 13 17:10:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.873},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.84699999999999998}]},{"osd":10,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.92900000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]}]},{"osd":7,"up_from":51,"seq":219043332133,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1060864,"data_stored":1095871,"data_compressed":54026,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1587,"internal_metadata":27654605},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.39700000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.66200000000000003,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.35799999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.52500000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.35999999999999999,"15min":0.35399999999999998},"min":{"1min":0.25800000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.34999999999999998,"15min":0.34399999999999997},"min":{"1min":0.32200000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.312}]},{"osd":2,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52800000000000002,"15min":0.52100000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.51400000000000001,"15min":0.50700000000000001},"min":{"1min":0.39100000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.59499999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.51000000000000001,"15min":0.502},"min":{"1min":0.38100000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67500000000000004,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.497},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.53400000000000003},"min":{"1min":0.42899999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.47299999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46200000000000002,"15min":0.45700000000000002},"min":{"1min":0.29899999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.442,"15min":0.439},"min":{"1min":0.31900000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.33800000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.56899999999999995,"15min":0.56200000000000006},"min":{"1min":0.5,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57499999999999996,"15min":0.57199999999999995},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.57099999999999995}]},{"osd":6,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.44700000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.59799999999999998,"15min":0.58699999999999997},"min":{"1min":0.45600000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.46000000000000002}]},{"osd":8,"last update":"Fri Sep 13 17:11:31 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.63600000000000001,"15min":0.628},"min":{"1min":0.504,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.65300000000000002,"15min":0.64200000000000002},"min":{"1min":0.47899999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.66200000000000003}]},{"osd":9,"last update":"Fri Sep 13 17:11:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.68400000000000005,"15min":0.68799999999999994},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84799999999999998,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.438}]},{"osd":10,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.624}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]},{"osd":6,"up_from":46,"seq":197568495657,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":495313,"data_compressed":17667,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.34200000000000003,"15min":0.33500000000000002},"min":{"1min":0.23400000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.373,"15min":0.36899999999999999},"min":{"1min":0.26500000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.57399999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.41499999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.74199999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.63600000000000001,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.52900000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68999999999999995,"5min":1.095,"15min":1.095},"last":0.501},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54100000000000004,"15min":0.52600000000000002},"min":{"1min":0.35899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.77300000000000002,"5min":0.877,"15min":0.877},"last":0.51400000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.42199999999999999,"15min":0.41599999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.626,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.378},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41799999999999998,"15min":0.41199999999999998},"min":{"1min":0.28199999999999997,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58599999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.435}]},{"osd":4,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51000000000000001,"15min":0.502},"min":{"1min":0.41199999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71699999999999997,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.39200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76100000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.56200000000000006}]},{"osd":5,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.70599999999999996,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59599999999999997,"15min":0.60299999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.73999999999999999,"5min":1.131,"15min":1.131},"last":0.46100000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.62}]},{"osd":8,"last update":"Fri Sep 13 17:11:28 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.623,"15min":0.627},"min":{"1min":0.42399999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.85899999999999999,"5min":0.874,"15min":0.874},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.58099999999999996}]},{"osd":9,"last update":"Fri Sep 13 17:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.59099999999999997}]},{"osd":10,"last update":"Fri Sep 13 17:11:12 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.72099999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":5,"up_from":38,"seq":163208757294,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":1064960,"data_stored":1091176,"data_compressed":54026,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48399999999999999,"15min":0.47599999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67300000000000004,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48799999999999999,"15min":0.47999999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69499999999999995,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.5}]},{"osd":1,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55100000000000005,"15min":0.54400000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68600000000000005,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.371,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.67600000000000005,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.57099999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.377,"15min":0.371},"min":{"1min":0.23499999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.58699999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.374},{"interface":"front","average":{"1min":0.375,"5min":0.378,"15min":0.372},"min":{"1min":0.253,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.59099999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.33600000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50700000000000001,"15min":0.501},"min":{"1min":0.30199999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.69599999999999995,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.63800000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.47499999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73099999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56999999999999995,"15min":0.56000000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.63600000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:11:41 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56100000000000005,"15min":0.56000000000000005},"min":{"1min":0.39100000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.74199999999999999,"5min":0.749,"15min":0.749},"last":0.51700000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.46400000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.75},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.44,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.70399999999999996}]},{"osd":8,"last update":"Fri Sep 13 17:11:26 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52500000000000002,"15min":0.53100000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69199999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.622},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55800000000000005,"15min":0.56599999999999995},"min":{"1min":0.39800000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.70299999999999996,"5min":0.747,"15min":0.747},"last":0.56299999999999994}]},{"osd":9,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.624,"15min":0.62},"min":{"1min":0.47699999999999998,"5min":0.442,"15min":0.442},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.62,"15min":0.61499999999999999},"min":{"1min":0.45800000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.65300000000000002}]},{"osd":10,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.73699999999999999}]}]},{"osd":4,"up_from":33,"seq":141733920819,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36176,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708976,"statfs":{"total":95995035648,"available":95957991424,"internally_reserved":0,"allocated":987136,"data_stored":490408,"data_compressed":14693,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":0.71699999999999997,"15min":0.59099999999999997},"min":{"1min":0.42399999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":15.369999999999999,"5min":15.369999999999999,"15min":15.369999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":1.4950000000000001,"5min":0.68200000000000005,"15min":0.54400000000000004},"min":{"1min":0.45900000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":15.416,"5min":15.416,"15min":15.416},"last":0.35399999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.36499999999999999,"15min":0.35899999999999999},"min":{"1min":0.25900000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38600000000000001},"min":{"1min":0.28699999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.60099999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.34799999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":0.74099999999999999,"15min":0.61699999999999999},"min":{"1min":0.379,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":15.401,"5min":15.401,"15min":15.401},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.52900000000000003,"15min":0.51900000000000002},"min":{"1min":0.39500000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.745,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.47599999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53900000000000003,"15min":0.54900000000000004},"min":{"1min":0.375,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76900000000000002,"5min":1.016,"15min":1.016},"last":0.39100000000000001},{"interface":"front","average":{"1min":1.524,"5min":0.74099999999999999,"15min":0.61699999999999999},"min":{"1min":0.39400000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":15.425000000000001,"5min":15.425000000000001,"15min":15.425000000000001},"last":0.40699999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57299999999999995,"15min":0.56399999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77900000000000003,"5min":1.073,"15min":1.073},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.73399999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.53500000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.54800000000000004,"15min":0.51800000000000002},"min":{"1min":0.40200000000000002,"5min":0.371,"15min":0.371},"max":{"1min":2.6469999999999998,"5min":2.6469999999999998,"15min":2.6469999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57599999999999996,"15min":0.55600000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.45400000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:11:00 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48199999999999998,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69399999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.48299999999999998,"15min":0.47899999999999998},"min":{"1min":0.34399999999999997,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.49399999999999999}]},{"osd":8,"last update":"Fri Sep 13 17:11:26 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.65200000000000002,"15min":0.63900000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.577,"5min":2.577,"15min":2.577},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.65500000000000003,"15min":0.64600000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.60299999999999998}]},{"osd":9,"last update":"Fri Sep 13 17:10:49 2024","interfaces":[{"interface":"back","average":{"1min":1.615,"5min":1.615,"15min":1.615},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":15.448,"5min":15.448,"15min":15.448},"last":0.55500000000000005},{"interface":"front","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":15.385,"5min":15.385,"15min":15.385},"last":0.63}]},{"osd":10,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.51100000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]},{"osd":3,"up_from":25,"seq":107374182455,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":983040,"data_stored":485669,"data_compressed":14693,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34000000000000002,"15min":0.317},"min":{"1min":0.22500000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.34399999999999997,"15min":0.32200000000000001},"min":{"1min":0.23899999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.60899999999999999,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.40799999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52400000000000002,"15min":0.49399999999999999},"min":{"1min":0.32900000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78900000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51200000000000001,"15min":0.48299999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.60999999999999999,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.625}]},{"osd":2,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51500000000000001,"15min":0.496},"min":{"1min":0.34000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67800000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53800000000000003,"15min":0.50700000000000001},"min":{"1min":0.34200000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.73999999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.495}]},{"osd":4,"last update":"Fri Sep 13 17:10:55 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.53000000000000003,"15min":0.51400000000000001},"min":{"1min":0.372,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.53200000000000003,"15min":0.50700000000000001},"min":{"1min":0.40500000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.54800000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55900000000000005,"15min":0.55400000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70399999999999996,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.56000000000000005,"15min":0.56100000000000005},"min":{"1min":0.35199999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.754,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.47399999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:11:43 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.45200000000000001,"15min":0.44600000000000001},"min":{"1min":0.28199999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68000000000000005,"5min":0.746,"15min":0.746},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.45700000000000002,"15min":0.443},"min":{"1min":0.29499999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70199999999999996,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.46400000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:11:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58399999999999996,"15min":0.57799999999999996},"min":{"1min":0.42599999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.77500000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.45500000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.68500000000000005}]},{"osd":8,"last update":"Fri Sep 13 17:10:26 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66400000000000003}]},{"osd":9,"last update":"Fri Sep 13 17:11:49 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.625,"15min":0.63500000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.80100000000000005,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.63300000000000001,"15min":0.65200000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78800000000000003,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.52300000000000002}]},{"osd":10,"last update":"Fri Sep 13 17:11:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.65300000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":2,"up_from":18,"seq":77309411389,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":541687,"data_compressed":17667,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:09 2024","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":0.76600000000000001,"15min":0.73999999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":19.158999999999999,"5min":19.158999999999999,"15min":19.158999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.47599999999999998,"15min":0.46700000000000003},"min":{"1min":0.33700000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68500000000000005,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.75800000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:11:09 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.501,"15min":0.47499999999999998},"min":{"1min":0.38,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68600000000000005,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.498,"15min":0.46800000000000003},"min":{"1min":0.40100000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.54900000000000004}]},{"osd":3,"last update":"Fri Sep 13 17:11:36 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.51900000000000002,"15min":0.5},"min":{"1min":0.41299999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52700000000000002,"15min":0.50600000000000001},"min":{"1min":0.42999999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71899999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.79900000000000004}]},{"osd":4,"last update":"Fri Sep 13 17:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.51100000000000001},"min":{"1min":0.41499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72199999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.40300000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.65800000000000003,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.52800000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:11:14 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.39900000000000002,"15min":0.39100000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.64500000000000002,"5min":0.747,"15min":0.747},"last":0.374},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39800000000000002,"15min":0.39200000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.68799999999999994,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.41899999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:11:38 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54000000000000004},"min":{"1min":0.41699999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68300000000000005,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.746},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.69799999999999995,"15min":0.58699999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82499999999999996,"5min":19.276,"15min":19.276},"last":0.73399999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.36699999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76200000000000001,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.41699999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76600000000000001,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.61499999999999999}]},{"osd":8,"last update":"Fri Sep 13 17:11:25 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53700000000000003,"15min":0.53500000000000003},"min":{"1min":0.33100000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76000000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56399999999999995,"15min":0.56100000000000005},"min":{"1min":0.35799999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.70999999999999996}]},{"osd":9,"last update":"Fri Sep 13 17:11:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64400000000000002,"15min":0.63600000000000001},"min":{"1min":0.377,"5min":0.373,"15min":0.373},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":1.294,"15min":1.3939999999999999},"min":{"1min":0.436,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0409999999999999,"5min":19.210999999999999,"15min":19.210999999999999},"last":0.77300000000000002}]},{"osd":10,"last update":"Fri Sep 13 17:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":1.595,"5min":1.595,"15min":1.595},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":19.242000000000001,"5min":19.242000000000001,"15min":19.242000000000001},"last":0.78700000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":1024000,"data_stored":526414,"data_compressed":14693,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:53 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.47799999999999998,"15min":0.46200000000000002},"min":{"1min":0.35199999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.48199999999999998,"15min":0.46500000000000002},"min":{"1min":0.32700000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.48199999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:11:08 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.52800000000000002,"15min":0.504},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.76900000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.52100000000000002,"15min":0.503},"min":{"1min":0.375,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.64900000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:11:37 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70599999999999996,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54700000000000004,"15min":0.52800000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70299999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.52100000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:10:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.39500000000000002,"15min":0.377},"min":{"1min":0.29199999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.62},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.38100000000000001,"15min":0.36299999999999999},"min":{"1min":0.26600000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:11:21 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.52900000000000003,"15min":0.51300000000000001},"min":{"1min":0.35399999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.52600000000000002,"15min":0.502},"min":{"1min":0.39900000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.70099999999999996}]},{"osd":6,"last update":"Fri Sep 13 17:11:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54000000000000004,"15min":0.52400000000000002},"min":{"1min":0.38500000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73199999999999998,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.59499999999999997,"15min":0.57499999999999996},"min":{"1min":0.45700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.82799999999999996,"5min":0.88,"15min":0.88},"last":0.66000000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:11:00 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.48999999999999999,"15min":0.47599999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.49399999999999999,"15min":0.48399999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.56000000000000005}]},{"osd":8,"last update":"Fri Sep 13 17:11:26 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.626,"15min":0.61699999999999999},"min":{"1min":0.41599999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.754},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.67300000000000004,"15min":0.66300000000000003},"min":{"1min":0.44,"5min":0.434,"15min":0.434},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.76200000000000001}]},{"osd":9,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.72999999999999998}]},{"osd":10,"last update":"Fri Sep 13 17:11:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.77500000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":987136,"data_stored":477768,"data_compressed":11720,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:10:49 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.47299999999999998,"15min":0.46600000000000003},"min":{"1min":0.29899999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.49199999999999999,"15min":0.48099999999999998},"min":{"1min":0.28499999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.59399999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:11:08 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.52100000000000002,"15min":0.505},"min":{"1min":0.374,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77900000000000003,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.501},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.53000000000000003,"15min":0.50700000000000001},"min":{"1min":0.38100000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.624}]},{"osd":3,"last update":"Fri Sep 13 17:10:27 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.40999999999999998,"15min":0.40100000000000002},"min":{"1min":0.23499999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.432},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.39700000000000002,"15min":0.38900000000000001},"min":{"1min":0.26400000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.317}]},{"osd":4,"last update":"Fri Sep 13 17:10:55 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.496,"15min":0.47999999999999998},"min":{"1min":0.34100000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.52100000000000002,"15min":0.503},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Sep 13 17:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52100000000000002,"15min":0.50900000000000001},"min":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82399999999999995,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.54800000000000004,"15min":0.53000000000000003},"min":{"1min":0.42799999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80500000000000005,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.60799999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:11:41 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.433,"15min":0.41799999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.65100000000000002,"5min":0.754,"15min":0.754},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.44800000000000001,"15min":0.42999999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72899999999999998,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.376}]},{"osd":7,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.57999999999999996,"15min":0.57099999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.57599999999999996}]},{"osd":8,"last update":"Fri Sep 13 17:11:30 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.60499999999999998,"15min":0.60699999999999998},"min":{"1min":0.46500000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.77200000000000002,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.65200000000000002,"15min":0.65800000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90200000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.41899999999999998}]},{"osd":9,"last update":"Fri Sep 13 17:10:49 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.44500000000000001}]},{"osd":10,"last update":"Fri Sep 13 17:11:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.58499999999999996}]},{"osd":11,"last update":"Fri Sep 13 17:11:36 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.53700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34721,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34721,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34721,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":45625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":46737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":41955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:11:56.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:56 smithi087 ceph-mon[30934]: from='client.14961 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:11:56.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:56 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1730833754' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-09-13T17:11:56.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:56 smithi149 ceph-mon[35496]: from='client.14961 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:11:56.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:56 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1730833754' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-09-13T17:11:56.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:56 smithi118 ceph-mon[34374]: from='client.14961 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:11:56.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:56 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1730833754' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-09-13T17:11:57.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:57 smithi087 ceph-mon[30934]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:11:57.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:57 smithi087 ceph-mon[30934]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:11:57.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:57 smithi087 ceph-mon[30934]: pgmap v295: 129 pgs: 129 active+clean; 625 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.9 KiB/s wr, 16 op/s; 72 B/s, 0 objects/s recovering 2024-09-13T17:11:57.493 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:57 smithi149 ceph-mon[35496]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:11:57.494 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:57 smithi149 ceph-mon[35496]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:11:57.494 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:57 smithi149 ceph-mon[35496]: pgmap v295: 129 pgs: 129 active+clean; 625 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.9 KiB/s wr, 16 op/s; 72 B/s, 0 objects/s recovering 2024-09-13T17:11:57.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:57 smithi118 ceph-mon[34374]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:11:57.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:57 smithi118 ceph-mon[34374]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:11:57.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:57 smithi118 ceph-mon[34374]: pgmap v295: 129 pgs: 129 active+clean; 625 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.9 KiB/s wr, 16 op/s; 72 B/s, 0 objects/s recovering 2024-09-13T17:11:59.152 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:11:59.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.263+0000 7fa4e7c96640 1 -- 172.21.15.87:0/359671780 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4e0100850 msgr2=0x7fa4e01070e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:59.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.263+0000 7fa4e7c96640 1 --2- 172.21.15.87:0/359671780 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4e0100850 0x7fa4e01070e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009ca0 tx=0x7fa4d802a8c0 comp rx=0 tx=0).stop 2024-09-13T17:11:59.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.263+0000 7fa4e7c96640 1 -- 172.21.15.87:0/359671780 shutdown_connections 2024-09-13T17:11:59.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.263+0000 7fa4e7c96640 1 --2- 172.21.15.87:0/359671780 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4e0100850 0x7fa4e01070e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:59.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.263+0000 7fa4e7c96640 1 --2- 172.21.15.87:0/359671780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4e00ffe90 0x7fa4e0100310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:59.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.263+0000 7fa4e7c96640 1 --2- 172.21.15.87:0/359671780 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4e00feca0 0x7fa4e00ff0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:59.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.263+0000 7fa4e7c96640 1 -- 172.21.15.87:0/359671780 >> 172.21.15.87:0/359671780 conn(0x7fa4e00fa420 msgr2=0x7fa4e00fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:59.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.263+0000 7fa4e7c96640 1 -- 172.21.15.87:0/359671780 shutdown_connections 2024-09-13T17:11:59.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.263+0000 7fa4e7c96640 1 -- 172.21.15.87:0/359671780 wait complete. 2024-09-13T17:11:59.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.264+0000 7fa4e7c96640 1 Processor -- start 2024-09-13T17:11:59.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.264+0000 7fa4e7c96640 1 -- start start 2024-09-13T17:11:59.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.264+0000 7fa4e7c96640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4e00feca0 0x7fa4e0197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:59.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.264+0000 7fa4e7c96640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4e00ffe90 0x7fa4e0198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:59.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.264+0000 7fa4e7c96640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4e0100850 0x7fa4e019f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:59.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.264+0000 7fa4e7c96640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e019fac0 con 0x7fa4e00feca0 2024-09-13T17:11:59.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.264+0000 7fa4e7c96640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e019fc30 con 0x7fa4e00ffe90 2024-09-13T17:11:59.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.264+0000 7fa4e7c96640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e019fdf0 con 0x7fa4e0100850 2024-09-13T17:11:59.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.264+0000 7fa4e5a32640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4e00feca0 0x7fa4e0197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:59.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.264+0000 7fa4e5a32640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4e00feca0 0x7fa4e0197fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56688/0 (socket says 172.21.15.87:56688) 2024-09-13T17:11:59.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.264+0000 7fa4e5a32640 1 -- 172.21.15.87:0/3602895983 learned_addr learned my addr 172.21.15.87:0/3602895983 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:11:59.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.264+0000 7fa4e5231640 1 --2- 172.21.15.87:0/3602895983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4e00ffe90 0x7fa4e0198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:59.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.264+0000 7fa4e5a32640 1 -- 172.21.15.87:0/3602895983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4e0100850 msgr2=0x7fa4e019f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:59.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.264+0000 7fa4e5a32640 1 --2- 172.21.15.87:0/3602895983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4e0100850 0x7fa4e019f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:59.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.264+0000 7fa4e5a32640 1 -- 172.21.15.87:0/3602895983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4e00ffe90 msgr2=0x7fa4e0198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:59.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.264+0000 7fa4e5a32640 1 --2- 172.21.15.87:0/3602895983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4e00ffe90 0x7fa4e0198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:59.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.264+0000 7fa4e5a32640 1 -- 172.21.15.87:0/3602895983 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d8009900 con 0x7fa4e00feca0 2024-09-13T17:11:59.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.264+0000 7fa4e5231640 1 --2- 172.21.15.87:0/3602895983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4e00ffe90 0x7fa4e0198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:11:59.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.264+0000 7fa4e5a32640 1 --2- 172.21.15.87:0/3602895983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4e00feca0 0x7fa4e0197fd0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa4d400c970 tx=0x7fa4d400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:59.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.265+0000 7fa4d2ffd640 1 -- 172.21.15.87:0/3602895983 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d4004220 con 0x7fa4e00feca0 2024-09-13T17:11:59.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.265+0000 7fa4e7c96640 1 -- 172.21.15.87:0/3602895983 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e01a00d0 con 0x7fa4e00feca0 2024-09-13T17:11:59.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.265+0000 7fa4d2ffd640 1 -- 172.21.15.87:0/3602895983 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa4d4007e60 con 0x7fa4e00feca0 2024-09-13T17:11:59.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.265+0000 7fa4d2ffd640 1 -- 172.21.15.87:0/3602895983 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d4004a00 con 0x7fa4e00feca0 2024-09-13T17:11:59.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.265+0000 7fa4e7c96640 1 -- 172.21.15.87:0/3602895983 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e01a0590 con 0x7fa4e00feca0 2024-09-13T17:11:59.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.266+0000 7fa4e7c96640 1 -- 172.21.15.87:0/3602895983 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4e010a590 con 0x7fa4e00feca0 2024-09-13T17:11:59.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.267+0000 7fa4d2ffd640 1 -- 172.21.15.87:0/3602895983 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fa4d40079b0 con 0x7fa4e00feca0 2024-09-13T17:11:59.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.267+0000 7fa4d2ffd640 1 --2- 172.21.15.87:0/3602895983 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa4cc0a1120 0x7fa4cc0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:11:59.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.268+0000 7fa4e5231640 1 --2- 172.21.15.87:0/3602895983 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa4cc0a1120 0x7fa4cc0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:11:59.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.268+0000 7fa4d2ffd640 1 -- 172.21.15.87:0/3602895983 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8978+0+0 (secure 0 0 0) 0x7fa4d40ccf10 con 0x7fa4e00feca0 2024-09-13T17:11:59.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.268+0000 7fa4e5231640 1 --2- 172.21.15.87:0/3602895983 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa4cc0a1120 0x7fa4cc0a35e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa4e01994e0 tx=0x7fa4dc005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:11:59.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.271+0000 7fa4d2ffd640 1 -- 172.21.15.87:0/3602895983 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa4d40961f0 con 0x7fa4e00feca0 2024-09-13T17:11:59.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.435+0000 7fa4e7c96640 1 -- 172.21.15.87:0/3602895983 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa4e0068d70 con 0x7fa4cc0a1120 2024-09-13T17:11:59.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.445+0000 7fa4d2ffd640 1 -- 172.21.15.87:0/3602895983 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+424260 (secure 0 0 0) 0x7fa4e0068d70 con 0x7fa4cc0a1120 2024-09-13T17:11:59.453 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:11:59.455 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-13T17:11:59.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.449+0000 7fa4e7c96640 1 -- 172.21.15.87:0/3602895983 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa4cc0a1120 msgr2=0x7fa4cc0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:59.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.449+0000 7fa4e7c96640 1 --2- 172.21.15.87:0/3602895983 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa4cc0a1120 0x7fa4cc0a35e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa4e01994e0 tx=0x7fa4dc005e50 comp rx=0 tx=0).stop 2024-09-13T17:11:59.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.449+0000 7fa4e7c96640 1 -- 172.21.15.87:0/3602895983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4e00feca0 msgr2=0x7fa4e0197fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:11:59.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.449+0000 7fa4e7c96640 1 --2- 172.21.15.87:0/3602895983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4e00feca0 0x7fa4e0197fd0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa4d400c970 tx=0x7fa4d400ce30 comp rx=0 tx=0).stop 2024-09-13T17:11:59.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.449+0000 7fa4e7c96640 1 -- 172.21.15.87:0/3602895983 shutdown_connections 2024-09-13T17:11:59.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.449+0000 7fa4e7c96640 1 --2- 172.21.15.87:0/3602895983 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa4cc0a1120 0x7fa4cc0a35e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:59.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.449+0000 7fa4e7c96640 1 --2- 172.21.15.87:0/3602895983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4e0100850 0x7fa4e019f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:59.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.449+0000 7fa4e7c96640 1 --2- 172.21.15.87:0/3602895983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4e00ffe90 0x7fa4e0198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:59.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.450+0000 7fa4e7c96640 1 --2- 172.21.15.87:0/3602895983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4e00feca0 0x7fa4e0197fd0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:11:59.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.450+0000 7fa4e7c96640 1 -- 172.21.15.87:0/3602895983 >> 172.21.15.87:0/3602895983 conn(0x7fa4e00fa420 msgr2=0x7fa4e0068660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:11:59.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.450+0000 7fa4e7c96640 1 -- 172.21.15.87:0/3602895983 shutdown_connections 2024-09-13T17:11:59.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:11:59.450+0000 7fa4e7c96640 1 -- 172.21.15.87:0/3602895983 wait complete. 2024-09-13T17:11:59.461 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:11:59 smithi087 ceph-mon[30934]: pgmap v296: 129 pgs: 129 active+clean; 625 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.7 KiB/s wr, 12 op/s; 62 B/s, 0 objects/s recovering 2024-09-13T17:11:59.462 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":296,"stamp":"2024-09-13T17:11:58.076655+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":640133,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":204,"num_read_kb":206,"num_write":330,"num_write_kb":3032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":417,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":377324,"kb_used_data":12088,"kb_used_omap":18,"kb_used_meta":365037,"kb_avail":1124564500,"statfs":{"total":1151940427776,"available":1151554048000,"internally_reserved":0,"allocated":12378112,"data_stored":7901591,"data_compressed":321081,"data_compressed_allocated":430080,"data_compressed_original":2359296,"omap_allocated":19109,"internal_metadata":373798235},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":43183,"num_objects":19,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":61,"num_read_kb":80,"num_write":55,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.288055"},"pg_stats":[{"pgid":"2.1f","version":"89'9","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794907+0000","last_change":"2024-09-13T17:11:22.998997+0000","last_active":"2024-09-13T17:11:48.794907+0000","last_peered":"2024-09-13T17:11:48.794907+0000","last_clean":"2024-09-13T17:11:48.794907+0000","last_became_active":"2024-09-13T17:11:22.998674+0000","last_became_peered":"2024-09-13T17:11:22.998674+0000","last_unstale":"2024-09-13T17:11:48.794907+0000","last_undegraded":"2024-09-13T17:11:48.794907+0000","last_fullsized":"2024-09-13T17:11:48.794907+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:30:50.554788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794065+0000","last_change":"2024-09-13T17:11:23.340108+0000","last_active":"2024-09-13T17:11:48.794065+0000","last_peered":"2024-09-13T17:11:48.794065+0000","last_clean":"2024-09-13T17:11:48.794065+0000","last_became_active":"2024-09-13T17:11:23.339832+0000","last_became_peered":"2024-09-13T17:11:23.339832+0000","last_unstale":"2024-09-13T17:11:48.794065+0000","last_undegraded":"2024-09-13T17:11:48.794065+0000","last_fullsized":"2024-09-13T17:11:48.794065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:40.969448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.802879+0000","last_change":"2024-09-13T17:11:27.358090+0000","last_active":"2024-09-13T17:11:48.802879+0000","last_peered":"2024-09-13T17:11:48.802879+0000","last_clean":"2024-09-13T17:11:48.802879+0000","last_became_active":"2024-09-13T17:11:27.357725+0000","last_became_peered":"2024-09-13T17:11:27.357725+0000","last_unstale":"2024-09-13T17:11:48.802879+0000","last_undegraded":"2024-09-13T17:11:48.802879+0000","last_fullsized":"2024-09-13T17:11:48.802879+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:51.617457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794279+0000","last_change":"2024-09-13T17:11:23.000779+0000","last_active":"2024-09-13T17:11:48.794279+0000","last_peered":"2024-09-13T17:11:48.794279+0000","last_clean":"2024-09-13T17:11:48.794279+0000","last_became_active":"2024-09-13T17:11:23.000511+0000","last_became_peered":"2024-09-13T17:11:23.000511+0000","last_unstale":"2024-09-13T17:11:48.794279+0000","last_undegraded":"2024-09-13T17:11:48.794279+0000","last_fullsized":"2024-09-13T17:11:48.794279+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:09.802392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799642+0000","last_change":"2024-09-13T17:11:23.333948+0000","last_active":"2024-09-13T17:11:48.799642+0000","last_peered":"2024-09-13T17:11:48.799642+0000","last_clean":"2024-09-13T17:11:48.799642+0000","last_became_active":"2024-09-13T17:11:23.333679+0000","last_became_peered":"2024-09-13T17:11:23.333679+0000","last_unstale":"2024-09-13T17:11:48.799642+0000","last_undegraded":"2024-09-13T17:11:48.799642+0000","last_fullsized":"2024-09-13T17:11:48.799642+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:10.265157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.800458+0000","last_change":"2024-09-13T17:11:27.353767+0000","last_active":"2024-09-13T17:11:48.800458+0000","last_peered":"2024-09-13T17:11:48.800458+0000","last_clean":"2024-09-13T17:11:48.800458+0000","last_became_active":"2024-09-13T17:11:27.353448+0000","last_became_peered":"2024-09-13T17:11:27.353448+0000","last_unstale":"2024-09-13T17:11:48.800458+0000","last_undegraded":"2024-09-13T17:11:48.800458+0000","last_fullsized":"2024-09-13T17:11:48.800458+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:15.948099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799823+0000","last_change":"2024-09-13T17:11:22.999879+0000","last_active":"2024-09-13T17:11:48.799823+0000","last_peered":"2024-09-13T17:11:48.799823+0000","last_clean":"2024-09-13T17:11:48.799823+0000","last_became_active":"2024-09-13T17:11:22.999577+0000","last_became_peered":"2024-09-13T17:11:22.999577+0000","last_unstale":"2024-09-13T17:11:48.799823+0000","last_undegraded":"2024-09-13T17:11:48.799823+0000","last_fullsized":"2024-09-13T17:11:48.799823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:48.485532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792067+0000","last_change":"2024-09-13T17:11:23.339026+0000","last_active":"2024-09-13T17:11:48.792067+0000","last_peered":"2024-09-13T17:11:48.792067+0000","last_clean":"2024-09-13T17:11:48.792067+0000","last_became_active":"2024-09-13T17:11:23.338745+0000","last_became_peered":"2024-09-13T17:11:23.338745+0000","last_unstale":"2024-09-13T17:11:48.792067+0000","last_undegraded":"2024-09-13T17:11:48.792067+0000","last_fullsized":"2024-09-13T17:11:48.792067+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:27.455418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801229+0000","last_change":"2024-09-13T17:11:27.363137+0000","last_active":"2024-09-13T17:11:48.801229+0000","last_peered":"2024-09-13T17:11:48.801229+0000","last_clean":"2024-09-13T17:11:48.801229+0000","last_became_active":"2024-09-13T17:11:27.362621+0000","last_became_peered":"2024-09-13T17:11:27.362621+0000","last_unstale":"2024-09-13T17:11:48.801229+0000","last_undegraded":"2024-09-13T17:11:48.801229+0000","last_fullsized":"2024-09-13T17:11:48.801229+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:35:51.492630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.800066+0000","last_change":"2024-09-13T17:11:22.998066+0000","last_active":"2024-09-13T17:11:48.800066+0000","last_peered":"2024-09-13T17:11:48.800066+0000","last_clean":"2024-09-13T17:11:48.800066+0000","last_became_active":"2024-09-13T17:11:22.997741+0000","last_became_peered":"2024-09-13T17:11:22.997741+0000","last_unstale":"2024-09-13T17:11:48.800066+0000","last_undegraded":"2024-09-13T17:11:48.800066+0000","last_fullsized":"2024-09-13T17:11:48.800066+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:00.353453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792498+0000","last_change":"2024-09-13T17:11:23.336778+0000","last_active":"2024-09-13T17:11:48.792498+0000","last_peered":"2024-09-13T17:11:48.792498+0000","last_clean":"2024-09-13T17:11:48.792498+0000","last_became_active":"2024-09-13T17:11:23.336491+0000","last_became_peered":"2024-09-13T17:11:23.336491+0000","last_unstale":"2024-09-13T17:11:48.792498+0000","last_undegraded":"2024-09-13T17:11:48.792498+0000","last_fullsized":"2024-09-13T17:11:48.792498+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:02.045912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801021+0000","last_change":"2024-09-13T17:11:27.361454+0000","last_active":"2024-09-13T17:11:48.801021+0000","last_peered":"2024-09-13T17:11:48.801021+0000","last_clean":"2024-09-13T17:11:48.801021+0000","last_became_active":"2024-09-13T17:11:27.360980+0000","last_became_peered":"2024-09-13T17:11:27.360980+0000","last_unstale":"2024-09-13T17:11:48.801021+0000","last_undegraded":"2024-09-13T17:11:48.801021+0000","last_fullsized":"2024-09-13T17:11:48.801021+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:36.036426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.798015+0000","last_change":"2024-09-13T17:11:23.334073+0000","last_active":"2024-09-13T17:11:48.798015+0000","last_peered":"2024-09-13T17:11:48.798015+0000","last_clean":"2024-09-13T17:11:48.798015+0000","last_became_active":"2024-09-13T17:11:23.333628+0000","last_became_peered":"2024-09-13T17:11:23.333628+0000","last_unstale":"2024-09-13T17:11:48.798015+0000","last_undegraded":"2024-09-13T17:11:48.798015+0000","last_fullsized":"2024-09-13T17:11:48.798015+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:18.561346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.800163+0000","last_change":"2024-09-13T17:11:22.999115+0000","last_active":"2024-09-13T17:11:48.800163+0000","last_peered":"2024-09-13T17:11:48.800163+0000","last_clean":"2024-09-13T17:11:48.800163+0000","last_became_active":"2024-09-13T17:11:22.998798+0000","last_became_peered":"2024-09-13T17:11:22.998798+0000","last_unstale":"2024-09-13T17:11:48.800163+0000","last_undegraded":"2024-09-13T17:11:48.800163+0000","last_fullsized":"2024-09-13T17:11:48.800163+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:25.263755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801716+0000","last_change":"2024-09-13T17:11:27.355472+0000","last_active":"2024-09-13T17:11:48.801716+0000","last_peered":"2024-09-13T17:11:48.801716+0000","last_clean":"2024-09-13T17:11:48.801716+0000","last_became_active":"2024-09-13T17:11:27.355065+0000","last_became_peered":"2024-09-13T17:11:27.355065+0000","last_unstale":"2024-09-13T17:11:48.801716+0000","last_undegraded":"2024-09-13T17:11:48.801716+0000","last_fullsized":"2024-09-13T17:11:48.801716+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:03.881097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.793593+0000","last_change":"2024-09-13T17:11:23.340268+0000","last_active":"2024-09-13T17:11:48.793593+0000","last_peered":"2024-09-13T17:11:48.793593+0000","last_clean":"2024-09-13T17:11:48.793593+0000","last_became_active":"2024-09-13T17:11:23.339977+0000","last_became_peered":"2024-09-13T17:11:23.339977+0000","last_unstale":"2024-09-13T17:11:48.793593+0000","last_undegraded":"2024-09-13T17:11:48.793593+0000","last_fullsized":"2024-09-13T17:11:48.793593+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:21.067899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"90'1","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.565951+0000","last_change":"2024-09-13T17:11:23.000858+0000","last_active":"2024-09-13T17:11:49.565951+0000","last_peered":"2024-09-13T17:11:49.565951+0000","last_clean":"2024-09-13T17:11:49.565951+0000","last_became_active":"2024-09-13T17:11:23.000536+0000","last_became_peered":"2024-09-13T17:11:23.000536+0000","last_unstale":"2024-09-13T17:11:49.565951+0000","last_undegraded":"2024-09-13T17:11:49.565951+0000","last_fullsized":"2024-09-13T17:11:49.565951+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:28.798579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.119232+0000","last_change":"2024-09-13T17:11:27.354018+0000","last_active":"2024-09-13T17:11:49.119232+0000","last_peered":"2024-09-13T17:11:49.119232+0000","last_clean":"2024-09-13T17:11:49.119232+0000","last_became_active":"2024-09-13T17:11:27.353519+0000","last_became_peered":"2024-09-13T17:11:27.353519+0000","last_unstale":"2024-09-13T17:11:49.119232+0000","last_undegraded":"2024-09-13T17:11:49.119232+0000","last_fullsized":"2024-09-13T17:11:49.119232+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:55.227851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801000+0000","last_change":"2024-09-13T17:11:23.335798+0000","last_active":"2024-09-13T17:11:48.801000+0000","last_peered":"2024-09-13T17:11:48.801000+0000","last_clean":"2024-09-13T17:11:48.801000+0000","last_became_active":"2024-09-13T17:11:23.335445+0000","last_became_peered":"2024-09-13T17:11:23.335445+0000","last_unstale":"2024-09-13T17:11:48.801000+0000","last_undegraded":"2024-09-13T17:11:48.801000+0000","last_fullsized":"2024-09-13T17:11:48.801000+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:53.242067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.793194+0000","last_change":"2024-09-13T17:11:22.994118+0000","last_active":"2024-09-13T17:11:48.793194+0000","last_peered":"2024-09-13T17:11:48.793194+0000","last_clean":"2024-09-13T17:11:48.793194+0000","last_became_active":"2024-09-13T17:11:22.993801+0000","last_became_peered":"2024-09-13T17:11:22.993801+0000","last_unstale":"2024-09-13T17:11:48.793194+0000","last_undegraded":"2024-09-13T17:11:48.793194+0000","last_fullsized":"2024-09-13T17:11:48.793194+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:01.382130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794642+0000","last_change":"2024-09-13T17:11:27.358795+0000","last_active":"2024-09-13T17:11:48.794642+0000","last_peered":"2024-09-13T17:11:48.794642+0000","last_clean":"2024-09-13T17:11:48.794642+0000","last_became_active":"2024-09-13T17:11:27.358166+0000","last_became_peered":"2024-09-13T17:11:27.358166+0000","last_unstale":"2024-09-13T17:11:48.794642+0000","last_undegraded":"2024-09-13T17:11:48.794642+0000","last_fullsized":"2024-09-13T17:11:48.794642+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:23.787842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799478+0000","last_change":"2024-09-13T17:11:23.340671+0000","last_active":"2024-09-13T17:11:48.799478+0000","last_peered":"2024-09-13T17:11:48.799478+0000","last_clean":"2024-09-13T17:11:48.799478+0000","last_became_active":"2024-09-13T17:11:23.340360+0000","last_became_peered":"2024-09-13T17:11:23.340360+0000","last_unstale":"2024-09-13T17:11:48.799478+0000","last_undegraded":"2024-09-13T17:11:48.799478+0000","last_fullsized":"2024-09-13T17:11:48.799478+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:17.875171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.791482+0000","last_change":"2024-09-13T17:11:22.993039+0000","last_active":"2024-09-13T17:11:48.791482+0000","last_peered":"2024-09-13T17:11:48.791482+0000","last_clean":"2024-09-13T17:11:48.791482+0000","last_became_active":"2024-09-13T17:11:22.992701+0000","last_became_peered":"2024-09-13T17:11:22.992701+0000","last_unstale":"2024-09-13T17:11:48.791482+0000","last_undegraded":"2024-09-13T17:11:48.791482+0000","last_fullsized":"2024-09-13T17:11:48.791482+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:28.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801820+0000","last_change":"2024-09-13T17:11:27.363834+0000","last_active":"2024-09-13T17:11:48.801820+0000","last_peered":"2024-09-13T17:11:48.801820+0000","last_clean":"2024-09-13T17:11:48.801820+0000","last_became_active":"2024-09-13T17:11:27.363425+0000","last_became_peered":"2024-09-13T17:11:27.363425+0000","last_unstale":"2024-09-13T17:11:48.801820+0000","last_undegraded":"2024-09-13T17:11:48.801820+0000","last_fullsized":"2024-09-13T17:11:48.801820+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:37.389881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.798427+0000","last_change":"2024-09-13T17:11:23.337423+0000","last_active":"2024-09-13T17:11:48.798427+0000","last_peered":"2024-09-13T17:11:48.798427+0000","last_clean":"2024-09-13T17:11:48.798427+0000","last_became_active":"2024-09-13T17:11:23.337167+0000","last_became_peered":"2024-09-13T17:11:23.337167+0000","last_unstale":"2024-09-13T17:11:48.798427+0000","last_undegraded":"2024-09-13T17:11:48.798427+0000","last_fullsized":"2024-09-13T17:11:48.798427+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:28.540283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.802143+0000","last_change":"2024-09-13T17:11:23.000486+0000","last_active":"2024-09-13T17:11:48.802143+0000","last_peered":"2024-09-13T17:11:48.802143+0000","last_clean":"2024-09-13T17:11:48.802143+0000","last_became_active":"2024-09-13T17:11:23.000158+0000","last_became_peered":"2024-09-13T17:11:23.000158+0000","last_unstale":"2024-09-13T17:11:48.802143+0000","last_undegraded":"2024-09-13T17:11:48.802143+0000","last_fullsized":"2024-09-13T17:11:48.802143+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:42.635037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.802894+0000","last_change":"2024-09-13T17:11:27.355058+0000","last_active":"2024-09-13T17:11:48.802894+0000","last_peered":"2024-09-13T17:11:48.802894+0000","last_clean":"2024-09-13T17:11:48.802894+0000","last_became_active":"2024-09-13T17:11:27.354726+0000","last_became_peered":"2024-09-13T17:11:27.354726+0000","last_unstale":"2024-09-13T17:11:48.802894+0000","last_undegraded":"2024-09-13T17:11:48.802894+0000","last_fullsized":"2024-09-13T17:11:48.802894+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:58.450122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794550+0000","last_change":"2024-09-13T17:11:23.337245+0000","last_active":"2024-09-13T17:11:48.794550+0000","last_peered":"2024-09-13T17:11:48.794550+0000","last_clean":"2024-09-13T17:11:48.794550+0000","last_became_active":"2024-09-13T17:11:23.336956+0000","last_became_peered":"2024-09-13T17:11:23.336956+0000","last_unstale":"2024-09-13T17:11:48.794550+0000","last_undegraded":"2024-09-13T17:11:48.794550+0000","last_fullsized":"2024-09-13T17:11:48.794550+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:46.876149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'5","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.792350+0000","last_change":"2024-09-13T17:11:22.999942+0000","last_active":"2024-09-13T17:11:49.792350+0000","last_peered":"2024-09-13T17:11:49.792350+0000","last_clean":"2024-09-13T17:11:49.792350+0000","last_became_active":"2024-09-13T17:11:22.999653+0000","last_became_peered":"2024-09-13T17:11:22.999653+0000","last_unstale":"2024-09-13T17:11:49.792350+0000","last_undegraded":"2024-09-13T17:11:49.792350+0000","last_fullsized":"2024-09-13T17:11:49.792350+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:29.400939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792511+0000","last_change":"2024-09-13T17:11:27.356479+0000","last_active":"2024-09-13T17:11:48.792511+0000","last_peered":"2024-09-13T17:11:48.792511+0000","last_clean":"2024-09-13T17:11:48.792511+0000","last_became_active":"2024-09-13T17:11:27.356052+0000","last_became_peered":"2024-09-13T17:11:27.356052+0000","last_unstale":"2024-09-13T17:11:48.792511+0000","last_undegraded":"2024-09-13T17:11:48.792511+0000","last_fullsized":"2024-09-13T17:11:48.792511+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:42.173376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.790360+0000","last_change":"2024-09-13T17:11:23.333786+0000","last_active":"2024-09-13T17:11:48.790360+0000","last_peered":"2024-09-13T17:11:48.790360+0000","last_clean":"2024-09-13T17:11:48.790360+0000","last_became_active":"2024-09-13T17:11:23.333472+0000","last_became_peered":"2024-09-13T17:11:23.333472+0000","last_unstale":"2024-09-13T17:11:48.790360+0000","last_undegraded":"2024-09-13T17:11:48.790360+0000","last_fullsized":"2024-09-13T17:11:48.790360+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:41.633228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799918+0000","last_change":"2024-09-13T17:11:22.998646+0000","last_active":"2024-09-13T17:11:48.799918+0000","last_peered":"2024-09-13T17:11:48.799918+0000","last_clean":"2024-09-13T17:11:48.799918+0000","last_became_active":"2024-09-13T17:11:22.998291+0000","last_became_peered":"2024-09-13T17:11:22.998291+0000","last_unstale":"2024-09-13T17:11:48.799918+0000","last_undegraded":"2024-09-13T17:11:48.799918+0000","last_fullsized":"2024-09-13T17:11:48.799918+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:20.658436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801089+0000","last_change":"2024-09-13T17:11:27.361174+0000","last_active":"2024-09-13T17:11:48.801089+0000","last_peered":"2024-09-13T17:11:48.801089+0000","last_clean":"2024-09-13T17:11:48.801089+0000","last_became_active":"2024-09-13T17:11:27.360737+0000","last_became_peered":"2024-09-13T17:11:27.360737+0000","last_unstale":"2024-09-13T17:11:48.801089+0000","last_undegraded":"2024-09-13T17:11:48.801089+0000","last_fullsized":"2024-09-13T17:11:48.801089+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:00.941364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801060+0000","last_change":"2024-09-13T17:11:23.338545+0000","last_active":"2024-09-13T17:11:48.801060+0000","last_peered":"2024-09-13T17:11:48.801060+0000","last_clean":"2024-09-13T17:11:48.801060+0000","last_became_active":"2024-09-13T17:11:23.338246+0000","last_became_peered":"2024-09-13T17:11:23.338246+0000","last_unstale":"2024-09-13T17:11:48.801060+0000","last_undegraded":"2024-09-13T17:11:48.801060+0000","last_fullsized":"2024-09-13T17:11:48.801060+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:18.966658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794795+0000","last_change":"2024-09-13T17:11:22.993497+0000","last_active":"2024-09-13T17:11:48.794795+0000","last_peered":"2024-09-13T17:11:48.794795+0000","last_clean":"2024-09-13T17:11:48.794795+0000","last_became_active":"2024-09-13T17:11:22.993165+0000","last_became_peered":"2024-09-13T17:11:22.993165+0000","last_unstale":"2024-09-13T17:11:48.794795+0000","last_undegraded":"2024-09-13T17:11:48.794795+0000","last_fullsized":"2024-09-13T17:11:48.794795+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:20.997834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799564+0000","last_change":"2024-09-13T17:11:27.364652+0000","last_active":"2024-09-13T17:11:48.799564+0000","last_peered":"2024-09-13T17:11:48.799564+0000","last_clean":"2024-09-13T17:11:48.799564+0000","last_became_active":"2024-09-13T17:11:27.364245+0000","last_became_peered":"2024-09-13T17:11:27.364245+0000","last_unstale":"2024-09-13T17:11:48.799564+0000","last_undegraded":"2024-09-13T17:11:48.799564+0000","last_fullsized":"2024-09-13T17:11:48.799564+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:23.048289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799609+0000","last_change":"2024-09-13T17:11:23.335649+0000","last_active":"2024-09-13T17:11:48.799609+0000","last_peered":"2024-09-13T17:11:48.799609+0000","last_clean":"2024-09-13T17:11:48.799609+0000","last_became_active":"2024-09-13T17:11:23.335364+0000","last_became_peered":"2024-09-13T17:11:23.335364+0000","last_unstale":"2024-09-13T17:11:48.799609+0000","last_undegraded":"2024-09-13T17:11:48.799609+0000","last_fullsized":"2024-09-13T17:11:48.799609+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.447947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.798105+0000","last_change":"2024-09-13T17:11:23.003188+0000","last_active":"2024-09-13T17:11:48.798105+0000","last_peered":"2024-09-13T17:11:48.798105+0000","last_clean":"2024-09-13T17:11:48.798105+0000","last_became_active":"2024-09-13T17:11:23.002858+0000","last_became_peered":"2024-09-13T17:11:23.002858+0000","last_unstale":"2024-09-13T17:11:48.798105+0000","last_undegraded":"2024-09-13T17:11:48.798105+0000","last_fullsized":"2024-09-13T17:11:48.798105+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:34.153326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.790425+0000","last_change":"2024-09-13T17:11:27.353320+0000","last_active":"2024-09-13T17:11:48.790425+0000","last_peered":"2024-09-13T17:11:48.790425+0000","last_clean":"2024-09-13T17:11:48.790425+0000","last_became_active":"2024-09-13T17:11:27.352947+0000","last_became_peered":"2024-09-13T17:11:27.352947+0000","last_unstale":"2024-09-13T17:11:48.790425+0000","last_undegraded":"2024-09-13T17:11:48.790425+0000","last_fullsized":"2024-09-13T17:11:48.790425+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:04.619618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792636+0000","last_change":"2024-09-13T17:11:23.330128+0000","last_active":"2024-09-13T17:11:48.792636+0000","last_peered":"2024-09-13T17:11:48.792636+0000","last_clean":"2024-09-13T17:11:48.792636+0000","last_became_active":"2024-09-13T17:11:23.329266+0000","last_became_peered":"2024-09-13T17:11:23.329266+0000","last_unstale":"2024-09-13T17:11:48.792636+0000","last_undegraded":"2024-09-13T17:11:48.792636+0000","last_fullsized":"2024-09-13T17:11:48.792636+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:36.275352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'4","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:53.809725+0000","last_change":"2024-09-13T17:11:23.003495+0000","last_active":"2024-09-13T17:11:53.809725+0000","last_peered":"2024-09-13T17:11:53.809725+0000","last_clean":"2024-09-13T17:11:53.809725+0000","last_became_active":"2024-09-13T17:11:23.003186+0000","last_became_peered":"2024-09-13T17:11:23.003186+0000","last_unstale":"2024-09-13T17:11:53.809725+0000","last_undegraded":"2024-09-13T17:11:53.809725+0000","last_fullsized":"2024-09-13T17:11:53.809725+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:23.353587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.790306+0000","last_change":"2024-09-13T17:11:27.362233+0000","last_active":"2024-09-13T17:11:48.790306+0000","last_peered":"2024-09-13T17:11:48.790306+0000","last_clean":"2024-09-13T17:11:48.790306+0000","last_became_active":"2024-09-13T17:11:27.361814+0000","last_became_peered":"2024-09-13T17:11:27.361814+0000","last_unstale":"2024-09-13T17:11:48.790306+0000","last_undegraded":"2024-09-13T17:11:48.790306+0000","last_fullsized":"2024-09-13T17:11:48.790306+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:20.723366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.789824+0000","last_change":"2024-09-13T17:11:23.332870+0000","last_active":"2024-09-13T17:11:48.789824+0000","last_peered":"2024-09-13T17:11:48.789824+0000","last_clean":"2024-09-13T17:11:48.789824+0000","last_became_active":"2024-09-13T17:11:23.332583+0000","last_became_peered":"2024-09-13T17:11:23.332583+0000","last_unstale":"2024-09-13T17:11:48.789824+0000","last_undegraded":"2024-09-13T17:11:48.789824+0000","last_fullsized":"2024-09-13T17:11:48.789824+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:22.607666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.796075+0000","last_change":"2024-09-13T17:11:23.001932+0000","last_active":"2024-09-13T17:11:48.796075+0000","last_peered":"2024-09-13T17:11:48.796075+0000","last_clean":"2024-09-13T17:11:48.796075+0000","last_became_active":"2024-09-13T17:11:23.001642+0000","last_became_peered":"2024-09-13T17:11:23.001642+0000","last_unstale":"2024-09-13T17:11:48.796075+0000","last_undegraded":"2024-09-13T17:11:48.796075+0000","last_fullsized":"2024-09-13T17:11:48.796075+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:05.976897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.793096+0000","last_change":"2024-09-13T17:11:27.359679+0000","last_active":"2024-09-13T17:11:48.793096+0000","last_peered":"2024-09-13T17:11:48.793096+0000","last_clean":"2024-09-13T17:11:48.793096+0000","last_became_active":"2024-09-13T17:11:27.359268+0000","last_became_peered":"2024-09-13T17:11:27.359268+0000","last_unstale":"2024-09-13T17:11:48.793096+0000","last_undegraded":"2024-09-13T17:11:48.793096+0000","last_fullsized":"2024-09-13T17:11:48.793096+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:48.154917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.793159+0000","last_change":"2024-09-13T17:11:23.340031+0000","last_active":"2024-09-13T17:11:48.793159+0000","last_peered":"2024-09-13T17:11:48.793159+0000","last_clean":"2024-09-13T17:11:48.793159+0000","last_became_active":"2024-09-13T17:11:23.339768+0000","last_became_peered":"2024-09-13T17:11:23.339768+0000","last_unstale":"2024-09-13T17:11:48.793159+0000","last_undegraded":"2024-09-13T17:11:48.793159+0000","last_fullsized":"2024-09-13T17:11:48.793159+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:22.360526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.802584+0000","last_change":"2024-09-13T17:11:22.995060+0000","last_active":"2024-09-13T17:11:48.802584+0000","last_peered":"2024-09-13T17:11:48.802584+0000","last_clean":"2024-09-13T17:11:48.802584+0000","last_became_active":"2024-09-13T17:11:22.991949+0000","last_became_peered":"2024-09-13T17:11:22.991949+0000","last_unstale":"2024-09-13T17:11:48.802584+0000","last_undegraded":"2024-09-13T17:11:48.802584+0000","last_fullsized":"2024-09-13T17:11:48.802584+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:44.716753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":340,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.796218+0000","last_change":"2024-09-13T17:10:13.439723+0000","last_active":"2024-09-13T17:11:48.796218+0000","last_peered":"2024-09-13T17:11:48.796218+0000","last_clean":"2024-09-13T17:11:48.796218+0000","last_became_active":"2024-09-13T17:10:13.439290+0000","last_became_peered":"2024-09-13T17:10:13.439290+0000","last_unstale":"2024-09-13T17:11:48.796218+0000","last_undegraded":"2024-09-13T17:11:48.796218+0000","last_fullsized":"2024-09-13T17:11:48.796218+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:03.041486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:03.041486+0000","last_clean_scrub_stamp":"2024-09-13T17:07:03.041486+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:08.673571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.798637+0000","last_change":"2024-09-13T17:11:27.361028+0000","last_active":"2024-09-13T17:11:48.798637+0000","last_peered":"2024-09-13T17:11:48.798637+0000","last_clean":"2024-09-13T17:11:48.798637+0000","last_became_active":"2024-09-13T17:11:27.360630+0000","last_became_peered":"2024-09-13T17:11:27.360630+0000","last_unstale":"2024-09-13T17:11:48.798637+0000","last_undegraded":"2024-09-13T17:11:48.798637+0000","last_fullsized":"2024-09-13T17:11:48.798637+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:40:40.860443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.798729+0000","last_change":"2024-09-13T17:11:49.798729+0000","last_active":"2024-09-13T17:11:49.798729+0000","last_peered":"2024-09-13T17:11:49.798729+0000","last_clean":"2024-09-13T17:11:49.798729+0000","last_became_active":"2024-09-13T17:11:49.798402+0000","last_became_peered":"2024-09-13T17:11:49.798402+0000","last_unstale":"2024-09-13T17:11:49.798729+0000","last_undegraded":"2024-09-13T17:11:49.798729+0000","last_fullsized":"2024-09-13T17:11:49.798729+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:58.948813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,11],"acting":[7,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.802654+0000","last_change":"2024-09-13T17:11:49.802654+0000","last_active":"2024-09-13T17:11:49.802654+0000","last_peered":"2024-09-13T17:11:49.802654+0000","last_clean":"2024-09-13T17:11:49.802654+0000","last_became_active":"2024-09-13T17:11:49.797574+0000","last_became_peered":"2024-09-13T17:11:49.797574+0000","last_unstale":"2024-09-13T17:11:49.802654+0000","last_undegraded":"2024-09-13T17:11:49.802654+0000","last_fullsized":"2024-09-13T17:11:49.802654+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:08.827045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.791597+0000","last_change":"2024-09-13T17:11:27.360372+0000","last_active":"2024-09-13T17:11:48.791597+0000","last_peered":"2024-09-13T17:11:48.791597+0000","last_clean":"2024-09-13T17:11:48.791597+0000","last_became_active":"2024-09-13T17:11:27.359990+0000","last_became_peered":"2024-09-13T17:11:27.359990+0000","last_unstale":"2024-09-13T17:11:48.791597+0000","last_undegraded":"2024-09-13T17:11:48.791597+0000","last_fullsized":"2024-09-13T17:11:48.791597+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:26.970317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.795820+0000","last_change":"2024-09-13T17:11:23.336269+0000","last_active":"2024-09-13T17:11:48.795820+0000","last_peered":"2024-09-13T17:11:48.795820+0000","last_clean":"2024-09-13T17:11:48.795820+0000","last_became_active":"2024-09-13T17:11:23.335921+0000","last_became_peered":"2024-09-13T17:11:23.335921+0000","last_unstale":"2024-09-13T17:11:48.795820+0000","last_undegraded":"2024-09-13T17:11:48.795820+0000","last_fullsized":"2024-09-13T17:11:48.795820+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:43.035927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792688+0000","last_change":"2024-09-13T17:11:23.002491+0000","last_active":"2024-09-13T17:11:48.792688+0000","last_peered":"2024-09-13T17:11:48.792688+0000","last_clean":"2024-09-13T17:11:48.792688+0000","last_became_active":"2024-09-13T17:11:23.002178+0000","last_became_peered":"2024-09-13T17:11:23.002178+0000","last_unstale":"2024-09-13T17:11:48.792688+0000","last_undegraded":"2024-09-13T17:11:48.792688+0000","last_fullsized":"2024-09-13T17:11:48.792688+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:06.056639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.796791+0000","last_change":"2024-09-13T17:11:27.355153+0000","last_active":"2024-09-13T17:11:48.796791+0000","last_peered":"2024-09-13T17:11:48.796791+0000","last_clean":"2024-09-13T17:11:48.796791+0000","last_became_active":"2024-09-13T17:11:27.354701+0000","last_became_peered":"2024-09-13T17:11:27.354701+0000","last_unstale":"2024-09-13T17:11:48.796791+0000","last_undegraded":"2024-09-13T17:11:48.796791+0000","last_fullsized":"2024-09-13T17:11:48.796791+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:34.924402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.797409+0000","last_change":"2024-09-13T17:11:23.342067+0000","last_active":"2024-09-13T17:11:48.797409+0000","last_peered":"2024-09-13T17:11:48.797409+0000","last_clean":"2024-09-13T17:11:48.797409+0000","last_became_active":"2024-09-13T17:11:23.341736+0000","last_became_peered":"2024-09-13T17:11:23.341736+0000","last_unstale":"2024-09-13T17:11:48.797409+0000","last_undegraded":"2024-09-13T17:11:48.797409+0000","last_fullsized":"2024-09-13T17:11:48.797409+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:03.114638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.790455+0000","last_change":"2024-09-13T17:11:23.002849+0000","last_active":"2024-09-13T17:11:48.790455+0000","last_peered":"2024-09-13T17:11:48.790455+0000","last_clean":"2024-09-13T17:11:48.790455+0000","last_became_active":"2024-09-13T17:11:23.002562+0000","last_became_peered":"2024-09-13T17:11:23.002562+0000","last_unstale":"2024-09-13T17:11:48.790455+0000","last_undegraded":"2024-09-13T17:11:48.790455+0000","last_fullsized":"2024-09-13T17:11:48.790455+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:11:24.650510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.791707+0000","last_change":"2024-09-13T17:11:27.359343+0000","last_active":"2024-09-13T17:11:48.791707+0000","last_peered":"2024-09-13T17:11:48.791707+0000","last_clean":"2024-09-13T17:11:48.791707+0000","last_became_active":"2024-09-13T17:11:27.358628+0000","last_became_peered":"2024-09-13T17:11:27.358628+0000","last_unstale":"2024-09-13T17:11:48.791707+0000","last_undegraded":"2024-09-13T17:11:48.791707+0000","last_fullsized":"2024-09-13T17:11:48.791707+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:39.584184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801190+0000","last_change":"2024-09-13T17:11:23.333111+0000","last_active":"2024-09-13T17:11:48.801190+0000","last_peered":"2024-09-13T17:11:48.801190+0000","last_clean":"2024-09-13T17:11:48.801190+0000","last_became_active":"2024-09-13T17:11:23.332734+0000","last_became_peered":"2024-09-13T17:11:23.332734+0000","last_unstale":"2024-09-13T17:11:48.801190+0000","last_undegraded":"2024-09-13T17:11:48.801190+0000","last_fullsized":"2024-09-13T17:11:48.801190+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:44.628106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"91'2","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.794103+0000","last_change":"2024-09-13T17:11:23.000759+0000","last_active":"2024-09-13T17:11:49.794103+0000","last_peered":"2024-09-13T17:11:49.794103+0000","last_clean":"2024-09-13T17:11:49.794103+0000","last_became_active":"2024-09-13T17:11:23.000463+0000","last_became_peered":"2024-09-13T17:11:23.000463+0000","last_unstale":"2024-09-13T17:11:49.794103+0000","last_undegraded":"2024-09-13T17:11:49.794103+0000","last_fullsized":"2024-09-13T17:11:49.794103+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:59.077194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.791776+0000","last_change":"2024-09-13T17:11:27.363076+0000","last_active":"2024-09-13T17:11:48.791776+0000","last_peered":"2024-09-13T17:11:48.791776+0000","last_clean":"2024-09-13T17:11:48.791776+0000","last_became_active":"2024-09-13T17:11:27.362642+0000","last_became_peered":"2024-09-13T17:11:27.362642+0000","last_unstale":"2024-09-13T17:11:48.791776+0000","last_undegraded":"2024-09-13T17:11:48.791776+0000","last_fullsized":"2024-09-13T17:11:48.791776+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:25.494875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792014+0000","last_change":"2024-09-13T17:11:23.336703+0000","last_active":"2024-09-13T17:11:48.792014+0000","last_peered":"2024-09-13T17:11:48.792014+0000","last_clean":"2024-09-13T17:11:48.792014+0000","last_became_active":"2024-09-13T17:11:23.336349+0000","last_became_peered":"2024-09-13T17:11:23.336349+0000","last_unstale":"2024-09-13T17:11:48.792014+0000","last_undegraded":"2024-09-13T17:11:48.792014+0000","last_fullsized":"2024-09-13T17:11:48.792014+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:28.671438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799746+0000","last_change":"2024-09-13T17:11:22.994382+0000","last_active":"2024-09-13T17:11:48.799746+0000","last_peered":"2024-09-13T17:11:48.799746+0000","last_clean":"2024-09-13T17:11:48.799746+0000","last_became_active":"2024-09-13T17:11:22.994037+0000","last_became_peered":"2024-09-13T17:11:22.994037+0000","last_unstale":"2024-09-13T17:11:48.799746+0000","last_undegraded":"2024-09-13T17:11:48.799746+0000","last_fullsized":"2024-09-13T17:11:48.799746+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:10.763757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.790388+0000","last_change":"2024-09-13T17:11:27.354351+0000","last_active":"2024-09-13T17:11:48.790388+0000","last_peered":"2024-09-13T17:11:48.790388+0000","last_clean":"2024-09-13T17:11:48.790388+0000","last_became_active":"2024-09-13T17:11:27.353715+0000","last_became_peered":"2024-09-13T17:11:27.353715+0000","last_unstale":"2024-09-13T17:11:48.790388+0000","last_undegraded":"2024-09-13T17:11:48.790388+0000","last_fullsized":"2024-09-13T17:11:48.790388+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:18.335183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.795992+0000","last_change":"2024-09-13T17:11:23.341743+0000","last_active":"2024-09-13T17:11:48.795992+0000","last_peered":"2024-09-13T17:11:48.795992+0000","last_clean":"2024-09-13T17:11:48.795992+0000","last_became_active":"2024-09-13T17:11:23.341200+0000","last_became_peered":"2024-09-13T17:11:23.341200+0000","last_unstale":"2024-09-13T17:11:48.795992+0000","last_undegraded":"2024-09-13T17:11:48.795992+0000","last_fullsized":"2024-09-13T17:11:48.795992+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:41.854013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'3","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:52.808734+0000","last_change":"2024-09-13T17:11:22.997571+0000","last_active":"2024-09-13T17:11:52.808734+0000","last_peered":"2024-09-13T17:11:52.808734+0000","last_clean":"2024-09-13T17:11:52.808734+0000","last_became_active":"2024-09-13T17:11:22.997238+0000","last_became_peered":"2024-09-13T17:11:22.997238+0000","last_unstale":"2024-09-13T17:11:52.808734+0000","last_undegraded":"2024-09-13T17:11:52.808734+0000","last_fullsized":"2024-09-13T17:11:52.808734+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:34.533004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794718+0000","last_change":"2024-09-13T17:11:27.356892+0000","last_active":"2024-09-13T17:11:48.794718+0000","last_peered":"2024-09-13T17:11:48.794718+0000","last_clean":"2024-09-13T17:11:48.794718+0000","last_became_active":"2024-09-13T17:11:27.356136+0000","last_became_peered":"2024-09-13T17:11:27.356136+0000","last_unstale":"2024-09-13T17:11:48.794718+0000","last_undegraded":"2024-09-13T17:11:48.794718+0000","last_fullsized":"2024-09-13T17:11:48.794718+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:23.207064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.796238+0000","last_change":"2024-09-13T17:11:23.337666+0000","last_active":"2024-09-13T17:11:48.796238+0000","last_peered":"2024-09-13T17:11:48.796238+0000","last_clean":"2024-09-13T17:11:48.796238+0000","last_became_active":"2024-09-13T17:11:23.337185+0000","last_became_peered":"2024-09-13T17:11:23.337185+0000","last_unstale":"2024-09-13T17:11:48.796238+0000","last_undegraded":"2024-09-13T17:11:48.796238+0000","last_fullsized":"2024-09-13T17:11:48.796238+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:51.266709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792201+0000","last_change":"2024-09-13T17:11:23.005075+0000","last_active":"2024-09-13T17:11:48.792201+0000","last_peered":"2024-09-13T17:11:48.792201+0000","last_clean":"2024-09-13T17:11:48.792201+0000","last_became_active":"2024-09-13T17:11:23.004778+0000","last_became_peered":"2024-09-13T17:11:23.004778+0000","last_unstale":"2024-09-13T17:11:48.792201+0000","last_undegraded":"2024-09-13T17:11:48.792201+0000","last_fullsized":"2024-09-13T17:11:48.792201+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:06.763552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801204+0000","last_change":"2024-09-13T17:11:27.353601+0000","last_active":"2024-09-13T17:11:48.801204+0000","last_peered":"2024-09-13T17:11:48.801204+0000","last_clean":"2024-09-13T17:11:48.801204+0000","last_became_active":"2024-09-13T17:11:27.353190+0000","last_became_peered":"2024-09-13T17:11:27.353190+0000","last_unstale":"2024-09-13T17:11:48.801204+0000","last_undegraded":"2024-09-13T17:11:48.801204+0000","last_fullsized":"2024-09-13T17:11:48.801204+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:24.645552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.799773+0000","last_change":"2024-09-13T17:11:49.799773+0000","last_active":"2024-09-13T17:11:49.799773+0000","last_peered":"2024-09-13T17:11:49.799773+0000","last_clean":"2024-09-13T17:11:49.799773+0000","last_became_active":"2024-09-13T17:11:49.799402+0000","last_became_peered":"2024-09-13T17:11:49.799402+0000","last_unstale":"2024-09-13T17:11:49.799773+0000","last_undegraded":"2024-09-13T17:11:49.799773+0000","last_fullsized":"2024-09-13T17:11:49.799773+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:37.230144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.803208+0000","last_change":"2024-09-13T17:11:23.005619+0000","last_active":"2024-09-13T17:11:48.803208+0000","last_peered":"2024-09-13T17:11:48.803208+0000","last_clean":"2024-09-13T17:11:48.803208+0000","last_became_active":"2024-09-13T17:11:23.005077+0000","last_became_peered":"2024-09-13T17:11:23.005077+0000","last_unstale":"2024-09-13T17:11:48.803208+0000","last_undegraded":"2024-09-13T17:11:48.803208+0000","last_fullsized":"2024-09-13T17:11:48.803208+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:51.739773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792374+0000","last_change":"2024-09-13T17:11:27.364603+0000","last_active":"2024-09-13T17:11:48.792374+0000","last_peered":"2024-09-13T17:11:48.792374+0000","last_clean":"2024-09-13T17:11:48.792374+0000","last_became_active":"2024-09-13T17:11:27.364226+0000","last_became_peered":"2024-09-13T17:11:27.364226+0000","last_unstale":"2024-09-13T17:11:48.792374+0000","last_undegraded":"2024-09-13T17:11:48.792374+0000","last_fullsized":"2024-09-13T17:11:48.792374+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:56.802016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799662+0000","last_change":"2024-09-13T17:11:23.338657+0000","last_active":"2024-09-13T17:11:48.799662+0000","last_peered":"2024-09-13T17:11:48.799662+0000","last_clean":"2024-09-13T17:11:48.799662+0000","last_became_active":"2024-09-13T17:11:23.338377+0000","last_became_peered":"2024-09-13T17:11:23.338377+0000","last_unstale":"2024-09-13T17:11:48.799662+0000","last_undegraded":"2024-09-13T17:11:48.799662+0000","last_fullsized":"2024-09-13T17:11:48.799662+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:52.412887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'24","reported_seq":60,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:53.810927+0000","last_change":"2024-09-13T17:11:22.998541+0000","last_active":"2024-09-13T17:11:53.810927+0000","last_peered":"2024-09-13T17:11:53.810927+0000","last_clean":"2024-09-13T17:11:53.810927+0000","last_became_active":"2024-09-13T17:11:22.998132+0000","last_became_peered":"2024-09-13T17:11:22.998132+0000","last_unstale":"2024-09-13T17:11:53.810927+0000","last_undegraded":"2024-09-13T17:11:53.810927+0000","last_fullsized":"2024-09-13T17:11:53.810927+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:16.777772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45625,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":18,"num_read_kb":54,"num_write":25,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794245+0000","last_change":"2024-09-13T17:11:27.361917+0000","last_active":"2024-09-13T17:11:48.794245+0000","last_peered":"2024-09-13T17:11:48.794245+0000","last_clean":"2024-09-13T17:11:48.794245+0000","last_became_active":"2024-09-13T17:11:27.361503+0000","last_became_peered":"2024-09-13T17:11:27.361503+0000","last_unstale":"2024-09-13T17:11:48.794245+0000","last_undegraded":"2024-09-13T17:11:48.794245+0000","last_fullsized":"2024-09-13T17:11:48.794245+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:52.959017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.798971+0000","last_change":"2024-09-13T17:11:49.798971+0000","last_active":"2024-09-13T17:11:49.798971+0000","last_peered":"2024-09-13T17:11:49.798971+0000","last_clean":"2024-09-13T17:11:49.798971+0000","last_became_active":"2024-09-13T17:11:49.798597+0000","last_became_peered":"2024-09-13T17:11:49.798597+0000","last_unstale":"2024-09-13T17:11:49.798971+0000","last_undegraded":"2024-09-13T17:11:49.798971+0000","last_fullsized":"2024-09-13T17:11:49.798971+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:41.886456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792661+0000","last_change":"2024-09-13T17:11:23.004059+0000","last_active":"2024-09-13T17:11:48.792661+0000","last_peered":"2024-09-13T17:11:48.792661+0000","last_clean":"2024-09-13T17:11:48.792661+0000","last_became_active":"2024-09-13T17:11:23.003248+0000","last_became_peered":"2024-09-13T17:11:23.003248+0000","last_unstale":"2024-09-13T17:11:48.792661+0000","last_undegraded":"2024-09-13T17:11:48.792661+0000","last_fullsized":"2024-09-13T17:11:48.792661+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:05.496872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801436+0000","last_change":"2024-09-13T17:11:27.362880+0000","last_active":"2024-09-13T17:11:48.801436+0000","last_peered":"2024-09-13T17:11:48.801436+0000","last_clean":"2024-09-13T17:11:48.801436+0000","last_became_active":"2024-09-13T17:11:27.362471+0000","last_became_peered":"2024-09-13T17:11:27.362471+0000","last_unstale":"2024-09-13T17:11:48.801436+0000","last_undegraded":"2024-09-13T17:11:48.801436+0000","last_fullsized":"2024-09-13T17:11:48.801436+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:49.964606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.799023+0000","last_change":"2024-09-13T17:11:49.799023+0000","last_active":"2024-09-13T17:11:49.799023+0000","last_peered":"2024-09-13T17:11:49.799023+0000","last_clean":"2024-09-13T17:11:49.799023+0000","last_became_active":"2024-09-13T17:11:49.798724+0000","last_became_peered":"2024-09-13T17:11:49.798724+0000","last_unstale":"2024-09-13T17:11:49.799023+0000","last_undegraded":"2024-09-13T17:11:49.799023+0000","last_fullsized":"2024-09-13T17:11:49.799023+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:03.569532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,7],"acting":[0,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.795575+0000","last_change":"2024-09-13T17:11:22.999158+0000","last_active":"2024-09-13T17:11:48.795575+0000","last_peered":"2024-09-13T17:11:48.795575+0000","last_clean":"2024-09-13T17:11:48.795575+0000","last_became_active":"2024-09-13T17:11:22.998795+0000","last_became_peered":"2024-09-13T17:11:22.998795+0000","last_unstale":"2024-09-13T17:11:48.795575+0000","last_undegraded":"2024-09-13T17:11:48.795575+0000","last_fullsized":"2024-09-13T17:11:48.795575+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:23.880769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792383+0000","last_change":"2024-09-13T17:11:27.358105+0000","last_active":"2024-09-13T17:11:48.792383+0000","last_peered":"2024-09-13T17:11:48.792383+0000","last_clean":"2024-09-13T17:11:48.792383+0000","last_became_active":"2024-09-13T17:11:27.357740+0000","last_became_peered":"2024-09-13T17:11:27.357740+0000","last_unstale":"2024-09-13T17:11:48.792383+0000","last_undegraded":"2024-09-13T17:11:48.792383+0000","last_fullsized":"2024-09-13T17:11:48.792383+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:44.837353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792441+0000","last_change":"2024-09-13T17:11:23.338736+0000","last_active":"2024-09-13T17:11:48.792441+0000","last_peered":"2024-09-13T17:11:48.792441+0000","last_clean":"2024-09-13T17:11:48.792441+0000","last_became_active":"2024-09-13T17:11:23.338462+0000","last_became_peered":"2024-09-13T17:11:23.338462+0000","last_unstale":"2024-09-13T17:11:48.792441+0000","last_undegraded":"2024-09-13T17:11:48.792441+0000","last_fullsized":"2024-09-13T17:11:48.792441+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:49.221314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'3","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:52.808797+0000","last_change":"2024-09-13T17:11:23.001966+0000","last_active":"2024-09-13T17:11:52.808797+0000","last_peered":"2024-09-13T17:11:52.808797+0000","last_clean":"2024-09-13T17:11:52.808797+0000","last_became_active":"2024-09-13T17:11:23.001565+0000","last_became_peered":"2024-09-13T17:11:23.001565+0000","last_unstale":"2024-09-13T17:11:52.808797+0000","last_undegraded":"2024-09-13T17:11:52.808797+0000","last_fullsized":"2024-09-13T17:11:52.808797+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:47.240702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792942+0000","last_change":"2024-09-13T17:11:27.360896+0000","last_active":"2024-09-13T17:11:48.792942+0000","last_peered":"2024-09-13T17:11:48.792942+0000","last_clean":"2024-09-13T17:11:48.792942+0000","last_became_active":"2024-09-13T17:11:27.360552+0000","last_became_peered":"2024-09-13T17:11:27.360552+0000","last_unstale":"2024-09-13T17:11:48.792942+0000","last_undegraded":"2024-09-13T17:11:48.792942+0000","last_fullsized":"2024-09-13T17:11:48.792942+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:08.726724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.798301+0000","last_change":"2024-09-13T17:11:27.356317+0000","last_active":"2024-09-13T17:11:48.798301+0000","last_peered":"2024-09-13T17:11:48.798301+0000","last_clean":"2024-09-13T17:11:48.798301+0000","last_became_active":"2024-09-13T17:11:27.355863+0000","last_became_peered":"2024-09-13T17:11:27.355863+0000","last_unstale":"2024-09-13T17:11:48.798301+0000","last_undegraded":"2024-09-13T17:11:48.798301+0000","last_fullsized":"2024-09-13T17:11:48.798301+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:29.356048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.793992+0000","last_change":"2024-09-13T17:11:23.344929+0000","last_active":"2024-09-13T17:11:48.793992+0000","last_peered":"2024-09-13T17:11:48.793992+0000","last_clean":"2024-09-13T17:11:48.793992+0000","last_became_active":"2024-09-13T17:11:23.344627+0000","last_became_peered":"2024-09-13T17:11:23.344627+0000","last_unstale":"2024-09-13T17:11:48.793992+0000","last_undegraded":"2024-09-13T17:11:48.793992+0000","last_fullsized":"2024-09-13T17:11:48.793992+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:15.049627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792723+0000","last_change":"2024-09-13T17:11:23.002539+0000","last_active":"2024-09-13T17:11:48.792723+0000","last_peered":"2024-09-13T17:11:48.792723+0000","last_clean":"2024-09-13T17:11:48.792723+0000","last_became_active":"2024-09-13T17:11:23.002206+0000","last_became_peered":"2024-09-13T17:11:23.002206+0000","last_unstale":"2024-09-13T17:11:48.792723+0000","last_undegraded":"2024-09-13T17:11:48.792723+0000","last_fullsized":"2024-09-13T17:11:48.792723+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:57.708167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801253+0000","last_change":"2024-09-13T17:11:27.362667+0000","last_active":"2024-09-13T17:11:48.801253+0000","last_peered":"2024-09-13T17:11:48.801253+0000","last_clean":"2024-09-13T17:11:48.801253+0000","last_became_active":"2024-09-13T17:11:27.362293+0000","last_became_peered":"2024-09-13T17:11:27.362293+0000","last_unstale":"2024-09-13T17:11:48.801253+0000","last_undegraded":"2024-09-13T17:11:48.801253+0000","last_fullsized":"2024-09-13T17:11:48.801253+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:24.446951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.793137+0000","last_change":"2024-09-13T17:11:23.335823+0000","last_active":"2024-09-13T17:11:48.793137+0000","last_peered":"2024-09-13T17:11:48.793137+0000","last_clean":"2024-09-13T17:11:48.793137+0000","last_became_active":"2024-09-13T17:11:23.335491+0000","last_became_peered":"2024-09-13T17:11:23.335491+0000","last_unstale":"2024-09-13T17:11:48.793137+0000","last_undegraded":"2024-09-13T17:11:48.793137+0000","last_fullsized":"2024-09-13T17:11:48.793137+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:42.172559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.789870+0000","last_change":"2024-09-13T17:11:22.999477+0000","last_active":"2024-09-13T17:11:48.789870+0000","last_peered":"2024-09-13T17:11:48.789870+0000","last_clean":"2024-09-13T17:11:48.789870+0000","last_became_active":"2024-09-13T17:11:22.999175+0000","last_became_peered":"2024-09-13T17:11:22.999175+0000","last_unstale":"2024-09-13T17:11:48.789870+0000","last_undegraded":"2024-09-13T17:11:48.789870+0000","last_fullsized":"2024-09-13T17:11:48.789870+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:03.817508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799823+0000","last_change":"2024-09-13T17:11:23.001737+0000","last_active":"2024-09-13T17:11:48.799823+0000","last_peered":"2024-09-13T17:11:48.799823+0000","last_clean":"2024-09-13T17:11:48.799823+0000","last_became_active":"2024-09-13T17:11:23.001296+0000","last_became_peered":"2024-09-13T17:11:23.001296+0000","last_unstale":"2024-09-13T17:11:48.799823+0000","last_undegraded":"2024-09-13T17:11:48.799823+0000","last_fullsized":"2024-09-13T17:11:48.799823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:08.671244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.792018+0000","last_change":"2024-09-13T17:11:23.337738+0000","last_active":"2024-09-13T17:11:48.792018+0000","last_peered":"2024-09-13T17:11:48.792018+0000","last_clean":"2024-09-13T17:11:48.792018+0000","last_became_active":"2024-09-13T17:11:23.337411+0000","last_became_peered":"2024-09-13T17:11:23.337411+0000","last_unstale":"2024-09-13T17:11:48.792018+0000","last_undegraded":"2024-09-13T17:11:48.792018+0000","last_fullsized":"2024-09-13T17:11:48.792018+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:02.355706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.803213+0000","last_change":"2024-09-13T17:11:27.363174+0000","last_active":"2024-09-13T17:11:48.803213+0000","last_peered":"2024-09-13T17:11:48.803213+0000","last_clean":"2024-09-13T17:11:48.803213+0000","last_became_active":"2024-09-13T17:11:27.362158+0000","last_became_peered":"2024-09-13T17:11:27.362158+0000","last_unstale":"2024-09-13T17:11:48.803213+0000","last_undegraded":"2024-09-13T17:11:48.803213+0000","last_fullsized":"2024-09-13T17:11:48.803213+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:49:52.892616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'6","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:55.813473+0000","last_change":"2024-09-13T17:11:23.000544+0000","last_active":"2024-09-13T17:11:55.813473+0000","last_peered":"2024-09-13T17:11:55.813473+0000","last_clean":"2024-09-13T17:11:55.813473+0000","last_became_active":"2024-09-13T17:11:23.000233+0000","last_became_peered":"2024-09-13T17:11:23.000233+0000","last_unstale":"2024-09-13T17:11:55.813473+0000","last_undegraded":"2024-09-13T17:11:55.813473+0000","last_fullsized":"2024-09-13T17:11:55.813473+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:04.745950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":966,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799756+0000","last_change":"2024-09-13T17:11:23.340104+0000","last_active":"2024-09-13T17:11:48.799756+0000","last_peered":"2024-09-13T17:11:48.799756+0000","last_clean":"2024-09-13T17:11:48.799756+0000","last_became_active":"2024-09-13T17:11:23.339826+0000","last_became_peered":"2024-09-13T17:11:23.339826+0000","last_unstale":"2024-09-13T17:11:48.799756+0000","last_undegraded":"2024-09-13T17:11:48.799756+0000","last_fullsized":"2024-09-13T17:11:48.799756+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:03.101547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.803194+0000","last_change":"2024-09-13T17:11:27.360848+0000","last_active":"2024-09-13T17:11:48.803194+0000","last_peered":"2024-09-13T17:11:48.803194+0000","last_clean":"2024-09-13T17:11:48.803194+0000","last_became_active":"2024-09-13T17:11:27.360416+0000","last_became_peered":"2024-09-13T17:11:27.360416+0000","last_unstale":"2024-09-13T17:11:48.803194+0000","last_undegraded":"2024-09-13T17:11:48.803194+0000","last_fullsized":"2024-09-13T17:11:48.803194+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:06.857649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.800926+0000","last_change":"2024-09-13T17:11:23.334723+0000","last_active":"2024-09-13T17:11:48.800926+0000","last_peered":"2024-09-13T17:11:48.800926+0000","last_clean":"2024-09-13T17:11:48.800926+0000","last_became_active":"2024-09-13T17:11:23.334433+0000","last_became_peered":"2024-09-13T17:11:23.334433+0000","last_unstale":"2024-09-13T17:11:48.800926+0000","last_undegraded":"2024-09-13T17:11:48.800926+0000","last_fullsized":"2024-09-13T17:11:48.800926+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:08.657151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.803139+0000","last_change":"2024-09-13T17:11:23.334882+0000","last_active":"2024-09-13T17:11:48.803139+0000","last_peered":"2024-09-13T17:11:48.803139+0000","last_clean":"2024-09-13T17:11:48.803139+0000","last_became_active":"2024-09-13T17:11:23.334610+0000","last_became_peered":"2024-09-13T17:11:23.334610+0000","last_unstale":"2024-09-13T17:11:48.803139+0000","last_undegraded":"2024-09-13T17:11:48.803139+0000","last_fullsized":"2024-09-13T17:11:48.803139+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:03.932181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.802945+0000","last_change":"2024-09-13T17:11:23.334076+0000","last_active":"2024-09-13T17:11:48.802945+0000","last_peered":"2024-09-13T17:11:48.802945+0000","last_clean":"2024-09-13T17:11:48.802945+0000","last_became_active":"2024-09-13T17:11:23.333801+0000","last_became_peered":"2024-09-13T17:11:23.333801+0000","last_unstale":"2024-09-13T17:11:48.802945+0000","last_undegraded":"2024-09-13T17:11:48.802945+0000","last_fullsized":"2024-09-13T17:11:48.802945+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:07.113045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.796858+0000","last_change":"2024-09-13T17:11:23.332306+0000","last_active":"2024-09-13T17:11:48.796858+0000","last_peered":"2024-09-13T17:11:48.796858+0000","last_clean":"2024-09-13T17:11:48.796858+0000","last_became_active":"2024-09-13T17:11:23.331913+0000","last_became_peered":"2024-09-13T17:11:23.331913+0000","last_unstale":"2024-09-13T17:11:48.796858+0000","last_undegraded":"2024-09-13T17:11:48.796858+0000","last_fullsized":"2024-09-13T17:11:48.796858+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:02.927286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.790286+0000","last_change":"2024-09-13T17:11:23.335512+0000","last_active":"2024-09-13T17:11:48.790286+0000","last_peered":"2024-09-13T17:11:48.790286+0000","last_clean":"2024-09-13T17:11:48.790286+0000","last_became_active":"2024-09-13T17:11:23.335201+0000","last_became_peered":"2024-09-13T17:11:23.335201+0000","last_unstale":"2024-09-13T17:11:48.790286+0000","last_undegraded":"2024-09-13T17:11:48.790286+0000","last_fullsized":"2024-09-13T17:11:48.790286+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:17.263819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801579+0000","last_change":"2024-09-13T17:11:23.341204+0000","last_active":"2024-09-13T17:11:48.801579+0000","last_peered":"2024-09-13T17:11:48.801579+0000","last_clean":"2024-09-13T17:11:48.801579+0000","last_became_active":"2024-09-13T17:11:23.339848+0000","last_became_peered":"2024-09-13T17:11:23.339848+0000","last_unstale":"2024-09-13T17:11:48.801579+0000","last_undegraded":"2024-09-13T17:11:48.801579+0000","last_fullsized":"2024-09-13T17:11:48.801579+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:15:09.480651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.803495+0000","last_change":"2024-09-13T17:11:23.334741+0000","last_active":"2024-09-13T17:11:48.803495+0000","last_peered":"2024-09-13T17:11:48.803495+0000","last_clean":"2024-09-13T17:11:48.803495+0000","last_became_active":"2024-09-13T17:11:23.334459+0000","last_became_peered":"2024-09-13T17:11:23.334459+0000","last_unstale":"2024-09-13T17:11:48.803495+0000","last_undegraded":"2024-09-13T17:11:48.803495+0000","last_fullsized":"2024-09-13T17:11:48.803495+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:52.379735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.794473+0000","last_change":"2024-09-13T17:11:23.337869+0000","last_active":"2024-09-13T17:11:48.794473+0000","last_peered":"2024-09-13T17:11:48.794473+0000","last_clean":"2024-09-13T17:11:48.794473+0000","last_became_active":"2024-09-13T17:11:23.337581+0000","last_became_peered":"2024-09-13T17:11:23.337581+0000","last_unstale":"2024-09-13T17:11:48.794473+0000","last_undegraded":"2024-09-13T17:11:48.794473+0000","last_fullsized":"2024-09-13T17:11:48.794473+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:49.407474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.798177+0000","last_change":"2024-09-13T17:11:49.797828+0000","last_active":"2024-09-13T17:11:49.798177+0000","last_peered":"2024-09-13T17:11:49.798177+0000","last_clean":"2024-09-13T17:11:49.798177+0000","last_became_active":"2024-09-13T17:11:49.797504+0000","last_became_peered":"2024-09-13T17:11:49.797504+0000","last_unstale":"2024-09-13T17:11:49.798177+0000","last_undegraded":"2024-09-13T17:11:49.798177+0000","last_fullsized":"2024-09-13T17:11:49.798177+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:29.677936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.793118+0000","last_change":"2024-09-13T17:11:23.336713+0000","last_active":"2024-09-13T17:11:48.793118+0000","last_peered":"2024-09-13T17:11:48.793118+0000","last_clean":"2024-09-13T17:11:48.793118+0000","last_became_active":"2024-09-13T17:11:23.336431+0000","last_became_peered":"2024-09-13T17:11:23.336431+0000","last_unstale":"2024-09-13T17:11:48.793118+0000","last_undegraded":"2024-09-13T17:11:48.793118+0000","last_fullsized":"2024-09-13T17:11:48.793118+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:52.709483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.791904+0000","last_change":"2024-09-13T17:11:23.340385+0000","last_active":"2024-09-13T17:11:48.791904+0000","last_peered":"2024-09-13T17:11:48.791904+0000","last_clean":"2024-09-13T17:11:48.791904+0000","last_became_active":"2024-09-13T17:11:23.340068+0000","last_became_peered":"2024-09-13T17:11:23.340068+0000","last_unstale":"2024-09-13T17:11:48.791904+0000","last_undegraded":"2024-09-13T17:11:48.791904+0000","last_fullsized":"2024-09-13T17:11:48.791904+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:17.795222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.790214+0000","last_change":"2024-09-13T17:11:23.329214+0000","last_active":"2024-09-13T17:11:48.790214+0000","last_peered":"2024-09-13T17:11:48.790214+0000","last_clean":"2024-09-13T17:11:48.790214+0000","last_became_active":"2024-09-13T17:11:23.328747+0000","last_became_peered":"2024-09-13T17:11:23.328747+0000","last_unstale":"2024-09-13T17:11:48.790214+0000","last_undegraded":"2024-09-13T17:11:48.790214+0000","last_fullsized":"2024-09-13T17:11:48.790214+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:11.233652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801419+0000","last_change":"2024-09-13T17:11:23.339854+0000","last_active":"2024-09-13T17:11:48.801419+0000","last_peered":"2024-09-13T17:11:48.801419+0000","last_clean":"2024-09-13T17:11:48.801419+0000","last_became_active":"2024-09-13T17:11:23.339565+0000","last_became_peered":"2024-09-13T17:11:23.339565+0000","last_unstale":"2024-09-13T17:11:48.801419+0000","last_undegraded":"2024-09-13T17:11:48.801419+0000","last_fullsized":"2024-09-13T17:11:48.801419+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:37.161135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.803426+0000","last_change":"2024-09-13T17:11:23.342562+0000","last_active":"2024-09-13T17:11:48.803426+0000","last_peered":"2024-09-13T17:11:48.803426+0000","last_clean":"2024-09-13T17:11:48.803426+0000","last_became_active":"2024-09-13T17:11:23.342256+0000","last_became_peered":"2024-09-13T17:11:23.342256+0000","last_unstale":"2024-09-13T17:11:48.803426+0000","last_undegraded":"2024-09-13T17:11:48.803426+0000","last_fullsized":"2024-09-13T17:11:48.803426+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:30.788242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.795154+0000","last_change":"2024-09-13T17:11:23.342436+0000","last_active":"2024-09-13T17:11:48.795154+0000","last_peered":"2024-09-13T17:11:48.795154+0000","last_clean":"2024-09-13T17:11:48.795154+0000","last_became_active":"2024-09-13T17:11:23.342157+0000","last_became_peered":"2024-09-13T17:11:23.342157+0000","last_unstale":"2024-09-13T17:11:48.795154+0000","last_undegraded":"2024-09-13T17:11:48.795154+0000","last_fullsized":"2024-09-13T17:11:48.795154+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:56.550875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801559+0000","last_change":"2024-09-13T17:11:23.341660+0000","last_active":"2024-09-13T17:11:48.801559+0000","last_peered":"2024-09-13T17:11:48.801559+0000","last_clean":"2024-09-13T17:11:48.801559+0000","last_became_active":"2024-09-13T17:11:23.341102+0000","last_became_peered":"2024-09-13T17:11:23.341102+0000","last_unstale":"2024-09-13T17:11:48.801559+0000","last_undegraded":"2024-09-13T17:11:48.801559+0000","last_fullsized":"2024-09-13T17:11:48.801559+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:00.546907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.791477+0000","last_change":"2024-09-13T17:11:23.338064+0000","last_active":"2024-09-13T17:11:48.791477+0000","last_peered":"2024-09-13T17:11:48.791477+0000","last_clean":"2024-09-13T17:11:48.791477+0000","last_became_active":"2024-09-13T17:11:23.337748+0000","last_became_peered":"2024-09-13T17:11:23.337748+0000","last_unstale":"2024-09-13T17:11:48.791477+0000","last_undegraded":"2024-09-13T17:11:48.791477+0000","last_fullsized":"2024-09-13T17:11:48.791477+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:14.281629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.797790+0000","last_change":"2024-09-13T17:11:23.335684+0000","last_active":"2024-09-13T17:11:48.797790+0000","last_peered":"2024-09-13T17:11:48.797790+0000","last_clean":"2024-09-13T17:11:48.797790+0000","last_became_active":"2024-09-13T17:11:23.335364+0000","last_became_peered":"2024-09-13T17:11:23.335364+0000","last_unstale":"2024-09-13T17:11:48.797790+0000","last_undegraded":"2024-09-13T17:11:48.797790+0000","last_fullsized":"2024-09-13T17:11:48.797790+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:02.288009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.796557+0000","last_change":"2024-09-13T17:11:23.340881+0000","last_active":"2024-09-13T17:11:48.796557+0000","last_peered":"2024-09-13T17:11:48.796557+0000","last_clean":"2024-09-13T17:11:48.796557+0000","last_became_active":"2024-09-13T17:11:23.340575+0000","last_became_peered":"2024-09-13T17:11:23.340575+0000","last_unstale":"2024-09-13T17:11:48.796557+0000","last_undegraded":"2024-09-13T17:11:48.796557+0000","last_fullsized":"2024-09-13T17:11:48.796557+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:40.757703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.790161+0000","last_change":"2024-09-13T17:11:23.329039+0000","last_active":"2024-09-13T17:11:48.790161+0000","last_peered":"2024-09-13T17:11:48.790161+0000","last_clean":"2024-09-13T17:11:48.790161+0000","last_became_active":"2024-09-13T17:11:23.328324+0000","last_became_peered":"2024-09-13T17:11:23.328324+0000","last_unstale":"2024-09-13T17:11:48.790161+0000","last_undegraded":"2024-09-13T17:11:48.790161+0000","last_fullsized":"2024-09-13T17:11:48.790161+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:37.882596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801777+0000","last_change":"2024-09-13T17:11:23.345229+0000","last_active":"2024-09-13T17:11:48.801777+0000","last_peered":"2024-09-13T17:11:48.801777+0000","last_clean":"2024-09-13T17:11:48.801777+0000","last_became_active":"2024-09-13T17:11:23.344883+0000","last_became_peered":"2024-09-13T17:11:23.344883+0000","last_unstale":"2024-09-13T17:11:48.801777+0000","last_undegraded":"2024-09-13T17:11:48.801777+0000","last_fullsized":"2024-09-13T17:11:48.801777+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:47.983382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799023+0000","last_change":"2024-09-13T17:11:23.346338+0000","last_active":"2024-09-13T17:11:48.799023+0000","last_peered":"2024-09-13T17:11:48.799023+0000","last_clean":"2024-09-13T17:11:48.799023+0000","last_became_active":"2024-09-13T17:11:23.344777+0000","last_became_peered":"2024-09-13T17:11:23.344777+0000","last_unstale":"2024-09-13T17:11:48.799023+0000","last_undegraded":"2024-09-13T17:11:48.799023+0000","last_fullsized":"2024-09-13T17:11:48.799023+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:23.650174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.798165+0000","last_change":"2024-09-13T17:11:49.798165+0000","last_active":"2024-09-13T17:11:49.798165+0000","last_peered":"2024-09-13T17:11:49.798165+0000","last_clean":"2024-09-13T17:11:49.798165+0000","last_became_active":"2024-09-13T17:11:49.797753+0000","last_became_peered":"2024-09-13T17:11:49.797753+0000","last_unstale":"2024-09-13T17:11:49.798165+0000","last_undegraded":"2024-09-13T17:11:49.798165+0000","last_fullsized":"2024-09-13T17:11:49.798165+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:51.744236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.791755+0000","last_change":"2024-09-13T17:11:23.340478+0000","last_active":"2024-09-13T17:11:48.791755+0000","last_peered":"2024-09-13T17:11:48.791755+0000","last_clean":"2024-09-13T17:11:48.791755+0000","last_became_active":"2024-09-13T17:11:23.339916+0000","last_became_peered":"2024-09-13T17:11:23.339916+0000","last_unstale":"2024-09-13T17:11:48.791755+0000","last_undegraded":"2024-09-13T17:11:48.791755+0000","last_fullsized":"2024-09-13T17:11:48.791755+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:09.477626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.793059+0000","last_change":"2024-09-13T17:11:23.340882+0000","last_active":"2024-09-13T17:11:48.793059+0000","last_peered":"2024-09-13T17:11:48.793059+0000","last_clean":"2024-09-13T17:11:48.793059+0000","last_became_active":"2024-09-13T17:11:23.340413+0000","last_became_peered":"2024-09-13T17:11:23.340413+0000","last_unstale":"2024-09-13T17:11:48.793059+0000","last_undegraded":"2024-09-13T17:11:48.793059+0000","last_fullsized":"2024-09-13T17:11:48.793059+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:49.040015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.796753+0000","last_change":"2024-09-13T17:11:23.345551+0000","last_active":"2024-09-13T17:11:48.796753+0000","last_peered":"2024-09-13T17:11:48.796753+0000","last_clean":"2024-09-13T17:11:48.796753+0000","last_became_active":"2024-09-13T17:11:23.345195+0000","last_became_peered":"2024-09-13T17:11:23.345195+0000","last_unstale":"2024-09-13T17:11:48.796753+0000","last_undegraded":"2024-09-13T17:11:48.796753+0000","last_fullsized":"2024-09-13T17:11:48.796753+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:00.856969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T17:11:49.799090+0000","last_change":"2024-09-13T17:11:49.799090+0000","last_active":"2024-09-13T17:11:49.799090+0000","last_peered":"2024-09-13T17:11:49.799090+0000","last_clean":"2024-09-13T17:11:49.799090+0000","last_became_active":"2024-09-13T17:11:49.798766+0000","last_became_peered":"2024-09-13T17:11:49.798766+0000","last_unstale":"2024-09-13T17:11:49.799090+0000","last_undegraded":"2024-09-13T17:11:49.799090+0000","last_fullsized":"2024-09-13T17:11:49.799090+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:43.946212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.799582+0000","last_change":"2024-09-13T17:11:23.340286+0000","last_active":"2024-09-13T17:11:48.799582+0000","last_peered":"2024-09-13T17:11:48.799582+0000","last_clean":"2024-09-13T17:11:48.799582+0000","last_became_active":"2024-09-13T17:11:23.339756+0000","last_became_peered":"2024-09-13T17:11:23.339756+0000","last_unstale":"2024-09-13T17:11:48.799582+0000","last_undegraded":"2024-09-13T17:11:48.799582+0000","last_fullsized":"2024-09-13T17:11:48.799582+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:00.463087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801695+0000","last_change":"2024-09-13T17:11:23.339818+0000","last_active":"2024-09-13T17:11:48.801695+0000","last_peered":"2024-09-13T17:11:48.801695+0000","last_clean":"2024-09-13T17:11:48.801695+0000","last_became_active":"2024-09-13T17:11:23.339501+0000","last_became_peered":"2024-09-13T17:11:23.339501+0000","last_unstale":"2024-09-13T17:11:48.801695+0000","last_undegraded":"2024-09-13T17:11:48.801695+0000","last_fullsized":"2024-09-13T17:11:48.801695+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:36.904004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.798232+0000","last_change":"2024-09-13T17:11:23.334388+0000","last_active":"2024-09-13T17:11:48.798232+0000","last_peered":"2024-09-13T17:11:48.798232+0000","last_clean":"2024-09-13T17:11:48.798232+0000","last_became_active":"2024-09-13T17:11:23.333953+0000","last_became_peered":"2024-09-13T17:11:23.333953+0000","last_unstale":"2024-09-13T17:11:48.798232+0000","last_undegraded":"2024-09-13T17:11:48.798232+0000","last_fullsized":"2024-09-13T17:11:48.798232+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:33.929173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.798689+0000","last_change":"2024-09-13T17:11:23.338259+0000","last_active":"2024-09-13T17:11:48.798689+0000","last_peered":"2024-09-13T17:11:48.798689+0000","last_clean":"2024-09-13T17:11:48.798689+0000","last_became_active":"2024-09-13T17:11:23.337979+0000","last_became_peered":"2024-09-13T17:11:23.337979+0000","last_unstale":"2024-09-13T17:11:48.798689+0000","last_undegraded":"2024-09-13T17:11:48.798689+0000","last_fullsized":"2024-09-13T17:11:48.798689+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:55.750255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T17:11:48.801517+0000","last_change":"2024-09-13T17:11:23.337899+0000","last_active":"2024-09-13T17:11:48.801517+0000","last_peered":"2024-09-13T17:11:48.801517+0000","last_clean":"2024-09-13T17:11:48.801517+0000","last_became_active":"2024-09-13T17:11:23.337626+0000","last_became_peered":"2024-09-13T17:11:23.337626+0000","last_unstale":"2024-09-13T17:11:48.801517+0000","last_undegraded":"2024-09-13T17:11:48.801517+0000","last_fullsized":"2024-09-13T17:11:48.801517+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:14.654852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":49531,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":68,"num_read_kb":87,"num_write":147,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":385024,"data_stored":165001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285958,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383699,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":995328,"data_stored":499901,"data_compressed":17667,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.35499999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.497}]},{"osd":2,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.58199999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.41799999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.50900000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.67700000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":9,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.52000000000000002}]},{"osd":10,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.60599999999999998}]}]},{"osd":10,"up_from":72,"seq":309237645335,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36312,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708840,"statfs":{"total":95995035648,"available":95957852160,"internally_reserved":0,"allocated":1122304,"data_stored":1132746,"data_compressed":54026,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1597,"internal_metadata":36043203},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.627}]},{"osd":2,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.61699999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.59799999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.70999999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.755},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.69999999999999996}]},{"osd":6,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.69299999999999995}]},{"osd":7,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.67700000000000005}]},{"osd":8,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.84199999999999997}]},{"osd":9,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.90000000000000002}]},{"osd":11,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.872},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.81499999999999995}]}]},{"osd":9,"up_from":67,"seq":287762808860,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":1015808,"data_stored":504233,"data_compressed":17667,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1597,"internal_metadata":31848899},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.39700000000000002,"15min":0.40699999999999997},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.37,"5min":0.41799999999999998,"15min":0.42599999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.55700000000000005,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.39600000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54400000000000004,"15min":0.54700000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.67700000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56100000000000005,"15min":0.56799999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.67800000000000005,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.45000000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.59399999999999997,"15min":0.60799999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.66400000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.58099999999999996,"15min":0.59199999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.755,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.66400000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.48699999999999999,"15min":0.501},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.64300000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.378,"5min":0.49399999999999999,"15min":0.51300000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.58499999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.42899999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.39900000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76500000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.63,"15min":0.64200000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.78300000000000003,"5min":1.26,"15min":1.26},"last":0.56999999999999995}]},{"osd":5,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.64400000000000002,"15min":0.66000000000000003},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.69599999999999995,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.64900000000000002,"15min":0.66900000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68200000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.61799999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.49299999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.68400000000000005,"15min":0.69899999999999995},"min":{"1min":0.46200000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.85499999999999998,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.68500000000000005,"15min":0.70099999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.78700000000000003,"5min":1.018,"15min":1.018},"last":0.52100000000000002}]},{"osd":8,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.67700000000000005,"15min":0.68899999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.86499999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.70599999999999996,"15min":0.71999999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.84799999999999998,"5min":1.228,"15min":1.228},"last":0.71099999999999997}]},{"osd":10,"last update":"Fri Sep 13 17:11:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.50600000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]}]},{"osd":8,"up_from":59,"seq":253403070497,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":500057,"data_compressed":17667,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67600000000000005,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.65500000000000003,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.67500000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54300000000000004,"15min":0.54400000000000004},"min":{"1min":0.34599999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71799999999999997,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.79900000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.41899999999999998,"15min":0.41799999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.63100000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.441,"15min":0.438},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70899999999999996,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.68999999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.73899999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.81299999999999994}]},{"osd":5,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.753},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53400000000000003,"15min":0.53600000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76700000000000002,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.78000000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.64400000000000002,"15min":0.64900000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.85999999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:11:24 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64700000000000002,"15min":0.64600000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92200000000000004,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90900000000000003,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.94999999999999996}]},{"osd":9,"last update":"Fri Sep 13 17:10:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.873},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.84699999999999998}]},{"osd":10,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.92900000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]}]},{"osd":7,"up_from":51,"seq":219043332133,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1060864,"data_stored":1095871,"data_compressed":54026,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1587,"internal_metadata":27654605},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.39700000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.66200000000000003,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.35799999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.52500000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.35999999999999999,"15min":0.35399999999999998},"min":{"1min":0.25800000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.34999999999999998,"15min":0.34399999999999997},"min":{"1min":0.32200000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.312}]},{"osd":2,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52800000000000002,"15min":0.52100000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.51400000000000001,"15min":0.50700000000000001},"min":{"1min":0.39100000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.59499999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.51000000000000001,"15min":0.502},"min":{"1min":0.38100000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67500000000000004,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.497},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.53400000000000003},"min":{"1min":0.42899999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.47299999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46200000000000002,"15min":0.45700000000000002},"min":{"1min":0.29899999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.442,"15min":0.439},"min":{"1min":0.31900000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.33800000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.56899999999999995,"15min":0.56200000000000006},"min":{"1min":0.5,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57499999999999996,"15min":0.57199999999999995},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.57099999999999995}]},{"osd":6,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.44700000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.59799999999999998,"15min":0.58699999999999997},"min":{"1min":0.45600000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.46000000000000002}]},{"osd":8,"last update":"Fri Sep 13 17:11:31 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.63600000000000001,"15min":0.628},"min":{"1min":0.504,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.65300000000000002,"15min":0.64200000000000002},"min":{"1min":0.47899999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.66200000000000003}]},{"osd":9,"last update":"Fri Sep 13 17:11:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.68400000000000005,"15min":0.68799999999999994},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84799999999999998,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.438}]},{"osd":10,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.624}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]},{"osd":6,"up_from":46,"seq":197568495658,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":495313,"data_compressed":17667,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.34200000000000003,"15min":0.33500000000000002},"min":{"1min":0.23400000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.373,"15min":0.36899999999999999},"min":{"1min":0.26500000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.57399999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.46300000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.74199999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.63600000000000001,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.47999999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68999999999999995,"5min":1.095,"15min":1.095},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54100000000000004,"15min":0.52600000000000002},"min":{"1min":0.35899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.77300000000000002,"5min":0.877,"15min":0.877},"last":0.50900000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.42199999999999999,"15min":0.41599999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.626,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41799999999999998,"15min":0.41199999999999998},"min":{"1min":0.28199999999999997,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58599999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.42299999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51000000000000001,"15min":0.502},"min":{"1min":0.41199999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71699999999999997,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.39200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76100000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.58599999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.70599999999999996,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59599999999999997,"15min":0.60299999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.73999999999999999,"5min":1.131,"15min":1.131},"last":0.41199999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.625}]},{"osd":8,"last update":"Fri Sep 13 17:11:28 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.623,"15min":0.627},"min":{"1min":0.42399999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.85899999999999999,"5min":0.874,"15min":0.874},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.76700000000000002}]},{"osd":9,"last update":"Fri Sep 13 17:11:52 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.60499999999999998,"15min":0.621},"min":{"1min":0.374,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.75700000000000001,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.64600000000000002,"15min":0.66000000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81699999999999995,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.67500000000000004}]},{"osd":10,"last update":"Fri Sep 13 17:11:12 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.71799999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]}]},{"osd":5,"up_from":38,"seq":163208757295,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":1064960,"data_stored":1091176,"data_compressed":54026,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48399999999999999,"15min":0.47599999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67300000000000004,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48799999999999999,"15min":0.47999999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69499999999999995,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.40699999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55100000000000005,"15min":0.54400000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68600000000000005,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.371,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.67600000000000005,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.66100000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.377,"15min":0.371},"min":{"1min":0.23499999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.58699999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.378,"15min":0.372},"min":{"1min":0.253,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.59099999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.438}]},{"osd":3,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50700000000000001,"15min":0.501},"min":{"1min":0.30199999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.69599999999999995,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.497},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.63800000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.46500000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73099999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56999999999999995,"15min":0.56000000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.63200000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:11:41 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56100000000000005,"15min":0.56000000000000005},"min":{"1min":0.39100000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.74199999999999999,"5min":0.749,"15min":0.749},"last":0.51900000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.46400000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.622},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.44,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.68899999999999995}]},{"osd":8,"last update":"Fri Sep 13 17:11:26 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52500000000000002,"15min":0.53100000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69199999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55800000000000005,"15min":0.56599999999999995},"min":{"1min":0.39800000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.70299999999999996,"5min":0.747,"15min":0.747},"last":0.67700000000000005}]},{"osd":9,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.624,"15min":0.62},"min":{"1min":0.47699999999999998,"5min":0.442,"15min":0.442},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.62,"15min":0.61499999999999999},"min":{"1min":0.45800000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.60899999999999999}]},{"osd":10,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.77000000000000002}]}]},{"osd":4,"up_from":33,"seq":141733920820,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36196,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708956,"statfs":{"total":95995035648,"available":95957970944,"internally_reserved":0,"allocated":1003520,"data_stored":500224,"data_compressed":17667,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":0.71699999999999997,"15min":0.59099999999999997},"min":{"1min":0.42399999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":15.369999999999999,"5min":15.369999999999999,"15min":15.369999999999999},"last":0.377},{"interface":"front","average":{"1min":1.4950000000000001,"5min":0.68200000000000005,"15min":0.54400000000000004},"min":{"1min":0.45900000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":15.416,"5min":15.416,"15min":15.416},"last":0.47699999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.36499999999999999,"15min":0.35899999999999999},"min":{"1min":0.25900000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38600000000000001},"min":{"1min":0.28699999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.60099999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.40100000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":0.74099999999999999,"15min":0.61699999999999999},"min":{"1min":0.379,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":15.401,"5min":15.401,"15min":15.401},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.52900000000000003,"15min":0.51900000000000002},"min":{"1min":0.39500000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.745,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.56699999999999995}]},{"osd":3,"last update":"Fri Sep 13 17:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53900000000000003,"15min":0.54900000000000004},"min":{"1min":0.375,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76900000000000002,"5min":1.016,"15min":1.016},"last":0.45100000000000001},{"interface":"front","average":{"1min":1.524,"5min":0.74099999999999999,"15min":0.61699999999999999},"min":{"1min":0.39400000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":15.425000000000001,"5min":15.425000000000001,"15min":15.425000000000001},"last":0.51300000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57299999999999995,"15min":0.56399999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77900000000000003,"5min":1.073,"15min":1.073},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.73399999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.67800000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:11:44 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.54800000000000004,"15min":0.51800000000000002},"min":{"1min":0.40200000000000002,"5min":0.371,"15min":0.371},"max":{"1min":2.6469999999999998,"5min":2.6469999999999998,"15min":2.6469999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57599999999999996,"15min":0.55600000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.64000000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:11:00 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48199999999999998,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69399999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.48299999999999998,"15min":0.47899999999999998},"min":{"1min":0.34399999999999997,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.622}]},{"osd":8,"last update":"Fri Sep 13 17:11:26 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.65200000000000002,"15min":0.63900000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.577,"5min":2.577,"15min":2.577},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.65500000000000003,"15min":0.64600000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.73999999999999999}]},{"osd":9,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":1.4350000000000001,"15min":1.5549999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.403,"5min":15.448,"15min":15.448},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":1.393,"15min":1.5149999999999999},"min":{"1min":0.45800000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.2989999999999999,"5min":15.385,"15min":15.385},"last":0.76100000000000001}]},{"osd":10,"last update":"Fri Sep 13 17:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.71799999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]},{"osd":3,"up_from":25,"seq":107374182456,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":494903,"data_compressed":17667,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34000000000000002,"15min":0.317},"min":{"1min":0.22500000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.34399999999999997,"15min":0.32200000000000001},"min":{"1min":0.23899999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.60899999999999999,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.41199999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52400000000000002,"15min":0.49399999999999999},"min":{"1min":0.32900000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78900000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51200000000000001,"15min":0.48299999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.60999999999999999,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.45500000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:11:34 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51500000000000001,"15min":0.496},"min":{"1min":0.34000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67800000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53800000000000003,"15min":0.50700000000000001},"min":{"1min":0.34200000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.73999999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.54700000000000004}]},{"osd":4,"last update":"Fri Sep 13 17:11:55 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54200000000000004,"15min":0.51800000000000002},"min":{"1min":0.38600000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81000000000000005,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.51100000000000001},"min":{"1min":0.38100000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.69999999999999996,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.38900000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55900000000000005,"15min":0.55400000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70399999999999996,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.56000000000000005,"15min":0.56100000000000005},"min":{"1min":0.35199999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.754,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.71699999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:11:43 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.45200000000000001,"15min":0.44600000000000001},"min":{"1min":0.28199999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68000000000000005,"5min":0.746,"15min":0.746},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.441,"5min":0.45700000000000002,"15min":0.443},"min":{"1min":0.29499999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70199999999999996,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.56200000000000006}]},{"osd":7,"last update":"Fri Sep 13 17:11:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58399999999999996,"15min":0.57799999999999996},"min":{"1min":0.42599999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.77500000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.45500000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.52200000000000002}]},{"osd":8,"last update":"Fri Sep 13 17:10:26 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66400000000000003}]},{"osd":9,"last update":"Fri Sep 13 17:11:49 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.625,"15min":0.63500000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.80100000000000005,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.495},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.63300000000000001,"15min":0.65200000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78800000000000003,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.51400000000000001}]},{"osd":10,"last update":"Fri Sep 13 17:11:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.60799999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]}]},{"osd":2,"up_from":18,"seq":77309411390,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1064960,"data_stored":549891,"data_compressed":17667,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:09 2024","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":0.76600000000000001,"15min":0.73999999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":19.158999999999999,"5min":19.158999999999999,"15min":19.158999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.47599999999999998,"15min":0.46700000000000003},"min":{"1min":0.33700000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68500000000000005,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.44800000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:11:09 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.501,"15min":0.47499999999999998},"min":{"1min":0.38,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68600000000000005,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.498,"15min":0.46800000000000003},"min":{"1min":0.40100000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.64200000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:11:36 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.51900000000000002,"15min":0.5},"min":{"1min":0.41299999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52700000000000002,"15min":0.50600000000000001},"min":{"1min":0.42999999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71899999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.433}]},{"osd":4,"last update":"Fri Sep 13 17:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.51100000000000001},"min":{"1min":0.41499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72199999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.371},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.40300000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.65800000000000003,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.51400000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:11:14 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.39900000000000002,"15min":0.39100000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.64500000000000002,"5min":0.747,"15min":0.747},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39800000000000002,"15min":0.39200000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.68799999999999994,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.67900000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:11:38 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54000000000000004},"min":{"1min":0.41699999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68300000000000005,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.69799999999999995,"15min":0.58699999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82499999999999996,"5min":19.276,"15min":19.276},"last":0.45900000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.36699999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76200000000000001,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.41699999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76600000000000001,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.56399999999999995}]},{"osd":8,"last update":"Fri Sep 13 17:11:25 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53700000000000003,"15min":0.53500000000000003},"min":{"1min":0.33100000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76000000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56399999999999995,"15min":0.56100000000000005},"min":{"1min":0.35799999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.74099999999999999}]},{"osd":9,"last update":"Fri Sep 13 17:11:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64400000000000002,"15min":0.63600000000000001},"min":{"1min":0.377,"5min":0.373,"15min":0.373},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.68999999999999995,"5min":1.294,"15min":1.3939999999999999},"min":{"1min":0.436,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0409999999999999,"5min":19.210999999999999,"15min":19.210999999999999},"last":0.47599999999999998}]},{"osd":10,"last update":"Fri Sep 13 17:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":1.595,"5min":1.595,"15min":1.595},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":19.242000000000001,"5min":19.242000000000001,"15min":19.242000000000001},"last":1.0860000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":1040384,"data_stored":540848,"data_compressed":17667,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:10:53 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.47799999999999998,"15min":0.46200000000000002},"min":{"1min":0.35199999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.48199999999999998,"15min":0.46500000000000002},"min":{"1min":0.32700000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.51200000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:11:08 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.52800000000000002,"15min":0.504},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.76900000000000002,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.52100000000000002,"15min":0.503},"min":{"1min":0.375,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.57599999999999996}]},{"osd":3,"last update":"Fri Sep 13 17:11:37 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70599999999999996,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54700000000000004,"15min":0.52800000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70299999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.71599999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:10:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.39500000000000002,"15min":0.377},"min":{"1min":0.29199999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.62},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.38100000000000001,"15min":0.36299999999999999},"min":{"1min":0.26600000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:11:21 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.52900000000000003,"15min":0.51300000000000001},"min":{"1min":0.35399999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.52600000000000002,"15min":0.502},"min":{"1min":0.39900000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.63700000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:11:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54000000000000004,"15min":0.52400000000000002},"min":{"1min":0.38500000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73199999999999998,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.59499999999999997,"15min":0.57499999999999996},"min":{"1min":0.45700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.82799999999999996,"5min":0.88,"15min":0.88},"last":0.80900000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:11:00 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.48999999999999999,"15min":0.47599999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.49399999999999999,"15min":0.48399999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.82399999999999995}]},{"osd":8,"last update":"Fri Sep 13 17:11:26 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.626,"15min":0.61699999999999999},"min":{"1min":0.41599999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.67300000000000004,"15min":0.66300000000000003},"min":{"1min":0.44,"5min":0.434,"15min":0.434},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.86799999999999999}]},{"osd":9,"last update":"Fri Sep 13 17:11:50 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64800000000000002,"15min":0.64600000000000002},"min":{"1min":0.48099999999999998,"5min":0.436,"15min":0.436},"max":{"1min":0.82999999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.69799999999999995,"15min":0.70199999999999996},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.85499999999999998}]},{"osd":10,"last update":"Fri Sep 13 17:11:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.72899999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738438,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":1011712,"data_stored":496428,"data_compressed":17667,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:11:53 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.48999999999999999,"15min":0.47199999999999998},"min":{"1min":0.31900000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.78000000000000003,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.51100000000000001,"15min":0.48699999999999999},"min":{"1min":0.33100000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.745,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.72499999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:11:08 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.52100000000000002,"15min":0.505},"min":{"1min":0.374,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77900000000000003,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.53000000000000003,"15min":0.50700000000000001},"min":{"1min":0.38100000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.622}]},{"osd":3,"last update":"Fri Sep 13 17:10:27 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.40999999999999998,"15min":0.40100000000000002},"min":{"1min":0.23499999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.39700000000000002,"15min":0.38900000000000001},"min":{"1min":0.26400000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.373}]},{"osd":4,"last update":"Fri Sep 13 17:10:55 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.496,"15min":0.47999999999999998},"min":{"1min":0.34100000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.504},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.52100000000000002,"15min":0.503},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.60199999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52100000000000002,"15min":0.50900000000000001},"min":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82399999999999995,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.54800000000000004,"15min":0.53000000000000003},"min":{"1min":0.42799999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80500000000000005,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.624}]},{"osd":6,"last update":"Fri Sep 13 17:11:41 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.433,"15min":0.41799999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.65100000000000002,"5min":0.754,"15min":0.754},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.44800000000000001,"15min":0.42999999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72899999999999998,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.42399999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.57999999999999996,"15min":0.57099999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.56999999999999995}]},{"osd":8,"last update":"Fri Sep 13 17:11:30 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.60499999999999998,"15min":0.60699999999999998},"min":{"1min":0.46500000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.77200000000000002,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.65200000000000002,"15min":0.65800000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90200000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.754}]},{"osd":9,"last update":"Fri Sep 13 17:11:53 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.61599999999999999,"15min":0.63400000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.80000000000000004,"5min":0.88,"15min":0.88},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.61199999999999999,"15min":0.629},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.78000000000000003,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.52100000000000002}]},{"osd":10,"last update":"Fri Sep 13 17:11:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.71299999999999997}]},{"osd":11,"last update":"Fri Sep 13 17:11:36 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.80700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34721,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34721,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34721,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":53829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":54941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":47155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:11:59.469 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T17:11:59.470 INFO:tasks.cephadm:Setting up client nodes... 2024-09-13T17:11:59.470 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-13T17:11:59.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:11:59 smithi149 ceph-mon[35496]: pgmap v296: 129 pgs: 129 active+clean; 625 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.7 KiB/s wr, 12 op/s; 62 B/s, 0 objects/s recovering 2024-09-13T17:11:59.612 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:11:59 smithi118 ceph-mon[34374]: pgmap v296: 129 pgs: 129 active+clean; 625 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.7 KiB/s wr, 12 op/s; 62 B/s, 0 objects/s recovering 2024-09-13T17:11:59.700 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:12:01.442 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:01 smithi087 ceph-mon[30934]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:12:01.442 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:01 smithi087 ceph-mon[30934]: pgmap v297: 129 pgs: 129 active+clean; 633 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.1 KiB/s wr, 9 op/s; 56 B/s, 0 objects/s recovering 2024-09-13T17:12:01.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.527+0000 7f08ba0cd640 1 -- 172.21.15.87:0/684469269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08b4101920 msgr2=0x7f08b4108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:01.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.527+0000 7f08ba0cd640 1 --2- 172.21.15.87:0/684469269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08b4101920 0x7f08b4108240 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f08ac009ca0 tx=0x7f08ac02a8c0 comp rx=0 tx=0).stop 2024-09-13T17:12:01.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.527+0000 7f08ba0cd640 1 -- 172.21.15.87:0/684469269 shutdown_connections 2024-09-13T17:12:01.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.527+0000 7f08ba0cd640 1 --2- 172.21.15.87:0/684469269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08b4101920 0x7f08b4108240 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:01.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.527+0000 7f08ba0cd640 1 --2- 172.21.15.87:0/684469269 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08b4100f60 0x7f08b41013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:01.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.527+0000 7f08ba0cd640 1 --2- 172.21.15.87:0/684469269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f08b40ffe00 0x7f08b4100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:01.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.527+0000 7f08ba0cd640 1 -- 172.21.15.87:0/684469269 >> 172.21.15.87:0/684469269 conn(0x7f08b40fb5d0 msgr2=0x7f08b40fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:01.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.527+0000 7f08ba0cd640 1 -- 172.21.15.87:0/684469269 shutdown_connections 2024-09-13T17:12:01.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.527+0000 7f08ba0cd640 1 -- 172.21.15.87:0/684469269 wait complete. 2024-09-13T17:12:01.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.527+0000 7f08ba0cd640 1 Processor -- start 2024-09-13T17:12:01.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.527+0000 7f08ba0cd640 1 -- start start 2024-09-13T17:12:01.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.527+0000 7f08ba0cd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08b40ffe00 0x7f08b4195c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:01.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.527+0000 7f08ba0cd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08b4100f60 0x7f08b4196190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:01.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.527+0000 7f08ba0cd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f08b4101920 0x7f08b419d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:01.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.527+0000 7f08ba0cd640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b419d740 con 0x7f08b40ffe00 2024-09-13T17:12:01.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.527+0000 7f08ba0cd640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b419d8b0 con 0x7f08b4101920 2024-09-13T17:12:01.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.527+0000 7f08ba0cd640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b419da70 con 0x7f08b4100f60 2024-09-13T17:12:01.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.528+0000 7f08b37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08b40ffe00 0x7f08b4195c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:01.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.528+0000 7f08b37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08b40ffe00 0x7f08b4195c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56702/0 (socket says 172.21.15.87:56702) 2024-09-13T17:12:01.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.528+0000 7f08b37fe640 1 -- 172.21.15.87:0/734554290 learned_addr learned my addr 172.21.15.87:0/734554290 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:12:01.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.528+0000 7f08abfff640 1 --2- 172.21.15.87:0/734554290 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08b4100f60 0x7f08b4196190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:01.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.528+0000 7f08b37fe640 1 -- 172.21.15.87:0/734554290 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08b4100f60 msgr2=0x7f08b4196190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:01.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.528+0000 7f08b37fe640 1 --2- 172.21.15.87:0/734554290 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08b4100f60 0x7f08b4196190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:01.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.528+0000 7f08b37fe640 1 -- 172.21.15.87:0/734554290 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f08b4101920 msgr2=0x7f08b419d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:01.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.528+0000 7f08b37fe640 1 --2- 172.21.15.87:0/734554290 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f08b4101920 0x7f08b419d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:01.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.528+0000 7f08b37fe640 1 -- 172.21.15.87:0/734554290 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ac009900 con 0x7f08b40ffe00 2024-09-13T17:12:01.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.528+0000 7f08abfff640 1 --2- 172.21.15.87:0/734554290 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08b4100f60 0x7f08b4196190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:12:01.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.528+0000 7f08b37fe640 1 --2- 172.21.15.87:0/734554290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08b40ffe00 0x7f08b4195c50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f08a400c920 tx=0x7f08a400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:01.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.528+0000 7f08b17fa640 1 -- 172.21.15.87:0/734554290 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a4007c70 con 0x7f08b40ffe00 2024-09-13T17:12:01.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.528+0000 7f08ba0cd640 1 -- 172.21.15.87:0/734554290 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b419dd50 con 0x7f08b40ffe00 2024-09-13T17:12:01.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.528+0000 7f08b17fa640 1 -- 172.21.15.87:0/734554290 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f08a4007dd0 con 0x7f08b40ffe00 2024-09-13T17:12:01.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.528+0000 7f08b17fa640 1 -- 172.21.15.87:0/734554290 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a40187c0 con 0x7f08b40ffe00 2024-09-13T17:12:01.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.528+0000 7f08ba0cd640 1 -- 172.21.15.87:0/734554290 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b419e1e0 con 0x7f08b40ffe00 2024-09-13T17:12:01.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.529+0000 7f08ba0cd640 1 -- 172.21.15.87:0/734554290 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b4107120 con 0x7f08b40ffe00 2024-09-13T17:12:01.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.530+0000 7f08b17fa640 1 -- 172.21.15.87:0/734554290 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f08a400f450 con 0x7f08b40ffe00 2024-09-13T17:12:01.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.531+0000 7f08b17fa640 1 --2- 172.21.15.87:0/734554290 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f08a00a1110 0x7f08a00a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:01.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.531+0000 7f08abfff640 1 --2- 172.21.15.87:0/734554290 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f08a00a1110 0x7f08a00a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:01.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.531+0000 7f08b17fa640 1 -- 172.21.15.87:0/734554290 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8978+0+0 (secure 0 0 0) 0x7f08a40ccf50 con 0x7f08b40ffe00 2024-09-13T17:12:01.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.531+0000 7f08abfff640 1 --2- 172.21.15.87:0/734554290 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f08a00a1110 0x7f08a00a35d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f08b40ffb30 tx=0x7f089c00a5e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:01.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.535+0000 7f08b17fa640 1 -- 172.21.15.87:0/734554290 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f08a4096290 con 0x7f08b40ffe00 2024-09-13T17:12:01.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:01 smithi149 ceph-mon[35496]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:12:01.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:01 smithi149 ceph-mon[35496]: pgmap v297: 129 pgs: 129 active+clean; 633 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.1 KiB/s wr, 9 op/s; 56 B/s, 0 objects/s recovering 2024-09-13T17:12:01.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:01 smithi118 ceph-mon[34374]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:12:01.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:01 smithi118 ceph-mon[34374]: pgmap v297: 129 pgs: 129 active+clean; 633 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.1 KiB/s wr, 9 op/s; 56 B/s, 0 objects/s recovering 2024-09-13T17:12:01.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.758+0000 7f08ba0cd640 1 -- 172.21.15.87:0/734554290 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f08b410b6e0 con 0x7f08b40ffe00 2024-09-13T17:12:01.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.762+0000 7f08b17fa640 1 -- 172.21.15.87:0/734554290 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) v1 ==== 170+0+59 (secure 0 0 0) 0x7f08a40998b0 con 0x7f08b40ffe00 2024-09-13T17:12:01.764 INFO:teuthology.orchestra.run.smithi087.stdout:[client.0] 2024-09-13T17:12:01.765 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQBhcuRmjqRTLRAAOvB7/uVRYnSj7DP6vUlUaA== 2024-09-13T17:12:01.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.765+0000 7f08ba0cd640 1 -- 172.21.15.87:0/734554290 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f08a00a1110 msgr2=0x7f08a00a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:01.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.765+0000 7f08ba0cd640 1 --2- 172.21.15.87:0/734554290 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f08a00a1110 0x7f08a00a35d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f08b40ffb30 tx=0x7f089c00a5e0 comp rx=0 tx=0).stop 2024-09-13T17:12:01.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.765+0000 7f08ba0cd640 1 -- 172.21.15.87:0/734554290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08b40ffe00 msgr2=0x7f08b4195c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:01.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.765+0000 7f08ba0cd640 1 --2- 172.21.15.87:0/734554290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08b40ffe00 0x7f08b4195c50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f08a400c920 tx=0x7f08a400cde0 comp rx=0 tx=0).stop 2024-09-13T17:12:01.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.765+0000 7f08ba0cd640 1 -- 172.21.15.87:0/734554290 shutdown_connections 2024-09-13T17:12:01.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.765+0000 7f08ba0cd640 1 --2- 172.21.15.87:0/734554290 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f08a00a1110 0x7f08a00a35d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:01.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.765+0000 7f08ba0cd640 1 --2- 172.21.15.87:0/734554290 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f08b4101920 0x7f08b419d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:01.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.765+0000 7f08ba0cd640 1 --2- 172.21.15.87:0/734554290 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08b4100f60 0x7f08b4196190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:01.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.765+0000 7f08ba0cd640 1 --2- 172.21.15.87:0/734554290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08b40ffe00 0x7f08b4195c50 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:01.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.765+0000 7f08ba0cd640 1 -- 172.21.15.87:0/734554290 >> 172.21.15.87:0/734554290 conn(0x7f08b40fb5d0 msgr2=0x7f08b41042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:01.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.765+0000 7f08ba0cd640 1 -- 172.21.15.87:0/734554290 shutdown_connections 2024-09-13T17:12:01.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:01.765+0000 7f08ba0cd640 1 -- 172.21.15.87:0/734554290 wait complete. 2024-09-13T17:12:02.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:02 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/734554290' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T17:12:02.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:02 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/734554290' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T17:12:02.526 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T17:12:02.526 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-13T17:12:02.526 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T17:12:02.565 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T17:12:02.566 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-13T17:12:02.566 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-13T17:12:02.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:02 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/734554290' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T17:12:02.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:02 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/734554290' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T17:12:02.612 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:02 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/734554290' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T17:12:02.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:02 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/734554290' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T17:12:02.810 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:12:03.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:03 smithi087 ceph-mon[30934]: pgmap v298: 129 pgs: 129 active+clean; 633 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.8 KiB/s wr, 8 op/s; 48 B/s, 0 objects/s recovering 2024-09-13T17:12:03.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:03 smithi149 ceph-mon[35496]: pgmap v298: 129 pgs: 129 active+clean; 633 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.8 KiB/s wr, 8 op/s; 48 B/s, 0 objects/s recovering 2024-09-13T17:12:03.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:03 smithi118 ceph-mon[34374]: pgmap v298: 129 pgs: 129 active+clean; 633 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.8 KiB/s wr, 8 op/s; 48 B/s, 0 objects/s recovering 2024-09-13T17:12:04.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.559+0000 7ff364ae1640 1 -- 172.21.15.87:0/3050432315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff360104000 msgr2=0x7ff36010bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:04.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.559+0000 7ff364ae1640 1 --2- 172.21.15.87:0/3050432315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff360104000 0x7ff36010bb80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff350009930 tx=0x7ff35002a420 comp rx=0 tx=0).stop 2024-09-13T17:12:04.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.559+0000 7ff364ae1640 1 -- 172.21.15.87:0/3050432315 shutdown_connections 2024-09-13T17:12:04.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.559+0000 7ff364ae1640 1 --2- 172.21.15.87:0/3050432315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff360104000 0x7ff36010bb80 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:04.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.559+0000 7ff364ae1640 1 --2- 172.21.15.87:0/3050432315 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3600ff880 0x7ff3601038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:04.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.559+0000 7ff364ae1640 1 --2- 172.21.15.87:0/3050432315 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3600feed0 0x7ff3600ff2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:04.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.559+0000 7ff364ae1640 1 -- 172.21.15.87:0/3050432315 >> 172.21.15.87:0/3050432315 conn(0x7ff3600fa9b0 msgr2=0x7ff3600fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:04.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.559+0000 7ff364ae1640 1 -- 172.21.15.87:0/3050432315 shutdown_connections 2024-09-13T17:12:04.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.559+0000 7ff364ae1640 1 -- 172.21.15.87:0/3050432315 wait complete. 2024-09-13T17:12:04.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.560+0000 7ff364ae1640 1 Processor -- start 2024-09-13T17:12:04.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.560+0000 7ff364ae1640 1 -- start start 2024-09-13T17:12:04.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.560+0000 7ff364ae1640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3600feed0 0x7ff360197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:04.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.560+0000 7ff364ae1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3600ff880 0x7ff360197560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:04.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.560+0000 7ff364ae1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff360104000 0x7ff3601a20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:04.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.560+0000 7ff364ae1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff360197d90 con 0x7ff3600ff880 2024-09-13T17:12:04.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.560+0000 7ff364ae1640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3601a25e0 con 0x7ff360104000 2024-09-13T17:12:04.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.560+0000 7ff364ae1640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3601a2720 con 0x7ff3600feed0 2024-09-13T17:12:04.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.560+0000 7ff35dd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3600ff880 0x7ff360197560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:04.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.560+0000 7ff35dd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3600ff880 0x7ff360197560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56720/0 (socket says 172.21.15.87:56720) 2024-09-13T17:12:04.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.560+0000 7ff35dd9b640 1 -- 172.21.15.87:0/1928563893 learned_addr learned my addr 172.21.15.87:0/1928563893 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:12:04.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.560+0000 7ff35e59c640 1 --2- 172.21.15.87:0/1928563893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3600feed0 0x7ff360197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:04.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.560+0000 7ff35ed9d640 1 --2- 172.21.15.87:0/1928563893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff360104000 0x7ff3601a20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:04.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.561+0000 7ff35dd9b640 1 -- 172.21.15.87:0/1928563893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3600feed0 msgr2=0x7ff360197020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:04.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.561+0000 7ff35dd9b640 1 --2- 172.21.15.87:0/1928563893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3600feed0 0x7ff360197020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:04.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.561+0000 7ff35dd9b640 1 -- 172.21.15.87:0/1928563893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff360104000 msgr2=0x7ff3601a20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:04.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.561+0000 7ff35dd9b640 1 --2- 172.21.15.87:0/1928563893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff360104000 0x7ff3601a20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:04.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.561+0000 7ff35dd9b640 1 -- 172.21.15.87:0/1928563893 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff350009560 con 0x7ff3600ff880 2024-09-13T17:12:04.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.561+0000 7ff35dd9b640 1 --2- 172.21.15.87:0/1928563893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3600ff880 0x7ff360197560 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff35400eab0 tx=0x7ff35400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:04.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.561+0000 7ff34f7fe640 1 -- 172.21.15.87:0/1928563893 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35400ce40 con 0x7ff3600ff880 2024-09-13T17:12:04.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.561+0000 7ff364ae1640 1 -- 172.21.15.87:0/1928563893 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3601a2980 con 0x7ff3600ff880 2024-09-13T17:12:04.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.561+0000 7ff34f7fe640 1 -- 172.21.15.87:0/1928563893 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff354011920 con 0x7ff3600ff880 2024-09-13T17:12:04.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.561+0000 7ff34f7fe640 1 -- 172.21.15.87:0/1928563893 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3540109d0 con 0x7ff3600ff880 2024-09-13T17:12:04.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.561+0000 7ff364ae1640 1 -- 172.21.15.87:0/1928563893 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3601a2ea0 con 0x7ff3600ff880 2024-09-13T17:12:04.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.562+0000 7ff364ae1640 1 -- 172.21.15.87:0/1928563893 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3601003b0 con 0x7ff3600ff880 2024-09-13T17:12:04.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.563+0000 7ff34f7fe640 1 -- 172.21.15.87:0/1928563893 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7ff354011a90 con 0x7ff3600ff880 2024-09-13T17:12:04.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.563+0000 7ff34f7fe640 1 --2- 172.21.15.87:0/1928563893 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff3480a1110 0x7ff3480a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:04.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.564+0000 7ff35e59c640 1 --2- 172.21.15.87:0/1928563893 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff3480a1110 0x7ff3480a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:04.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.564+0000 7ff34f7fe640 1 -- 172.21.15.87:0/1928563893 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8978+0+0 (secure 0 0 0) 0x7ff3540cd300 con 0x7ff3600ff880 2024-09-13T17:12:04.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.564+0000 7ff35e59c640 1 --2- 172.21.15.87:0/1928563893 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff3480a1110 0x7ff3480a35d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff3580058c0 tx=0x7ff35800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:04.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.568+0000 7ff34f7fe640 1 -- 172.21.15.87:0/1928563893 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff354096640 con 0x7ff3600ff880 2024-09-13T17:12:04.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.772+0000 7ff364ae1640 1 -- 172.21.15.87:0/1928563893 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff3600ff2b0 con 0x7ff3600ff880 2024-09-13T17:12:04.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.777+0000 7ff34f7fe640 1 -- 172.21.15.87:0/1928563893 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+260281 (secure 0 0 0) 0x7ff354099c60 con 0x7ff3600ff880 2024-09-13T17:12:04.782 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:12:04.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.780+0000 7ff364ae1640 1 -- 172.21.15.87:0/1928563893 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff3480a1110 msgr2=0x7ff3480a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:04.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.780+0000 7ff364ae1640 1 --2- 172.21.15.87:0/1928563893 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff3480a1110 0x7ff3480a35d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff3580058c0 tx=0x7ff35800a2d0 comp rx=0 tx=0).stop 2024-09-13T17:12:04.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.780+0000 7ff364ae1640 1 -- 172.21.15.87:0/1928563893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3600ff880 msgr2=0x7ff360197560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:04.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.780+0000 7ff364ae1640 1 --2- 172.21.15.87:0/1928563893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3600ff880 0x7ff360197560 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff35400eab0 tx=0x7ff35400ef70 comp rx=0 tx=0).stop 2024-09-13T17:12:04.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.780+0000 7ff364ae1640 1 -- 172.21.15.87:0/1928563893 shutdown_connections 2024-09-13T17:12:04.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.780+0000 7ff364ae1640 1 --2- 172.21.15.87:0/1928563893 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff3480a1110 0x7ff3480a35d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:04.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.780+0000 7ff364ae1640 1 --2- 172.21.15.87:0/1928563893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff360104000 0x7ff3601a20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:04.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.780+0000 7ff364ae1640 1 --2- 172.21.15.87:0/1928563893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3600ff880 0x7ff360197560 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:04.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.780+0000 7ff364ae1640 1 --2- 172.21.15.87:0/1928563893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3600feed0 0x7ff360197020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:04.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.780+0000 7ff364ae1640 1 -- 172.21.15.87:0/1928563893 >> 172.21.15.87:0/1928563893 conn(0x7ff3600fa9b0 msgr2=0x7ff3600fbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:04.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.780+0000 7ff364ae1640 1 -- 172.21.15.87:0/1928563893 shutdown_connections 2024-09-13T17:12:04.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:04.780+0000 7ff364ae1640 1 -- 172.21.15.87:0/1928563893 wait complete. 2024-09-13T17:12:05.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:05 smithi087 ceph-mon[30934]: pgmap v299: 129 pgs: 129 active+clean; 633 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 6 op/s; 48 B/s, 0 objects/s recovering 2024-09-13T17:12:05.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:05 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1928563893' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T17:12:05.533 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":701043027},{"type":"v1","addr":"172.21.15.87:6801","nonce":701043027}]},"active_addr":"172.21.15.87:6801/701043027","active_change":"2024-09-13T17:04:47.990182+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24113,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24118,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.87:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":718653925}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":2612130442}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":1633498542}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":3081317043}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":663048843}]}]} 2024-09-13T17:12:05.539 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-13T17:12:05.539 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-13T17:12:05.539 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T17:12:05.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:05 smithi149 ceph-mon[35496]: pgmap v299: 129 pgs: 129 active+clean; 633 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 6 op/s; 48 B/s, 0 objects/s recovering 2024-09-13T17:12:05.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:05 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1928563893' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T17:12:05.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:05 smithi118 ceph-mon[34374]: pgmap v299: 129 pgs: 129 active+clean; 633 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 6 op/s; 48 B/s, 0 objects/s recovering 2024-09-13T17:12:05.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:05 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1928563893' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T17:12:05.740 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:12:07.228 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:07 smithi087 ceph-mon[30934]: pgmap v300: 129 pgs: 129 active+clean; 637 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.9 KiB/s wr, 8 op/s; 48 B/s, 0 objects/s recovering 2024-09-13T17:12:07.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.498+0000 7fe1df75d640 1 -- 172.21.15.87:0/3413671279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1d8100990 msgr2=0x7fe1d81049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:07.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.498+0000 7fe1df75d640 1 --2- 172.21.15.87:0/3413671279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1d8100990 0x7fe1d81049e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc009930 tx=0x7fe1cc02a420 comp rx=0 tx=0).stop 2024-09-13T17:12:07.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.498+0000 7fe1df75d640 1 -- 172.21.15.87:0/3413671279 shutdown_connections 2024-09-13T17:12:07.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.498+0000 7fe1df75d640 1 --2- 172.21.15.87:0/3413671279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1d8105110 0x7fe1d810cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:07.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.498+0000 7fe1df75d640 1 --2- 172.21.15.87:0/3413671279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1d8100990 0x7fe1d81049e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:07.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.498+0000 7fe1df75d640 1 --2- 172.21.15.87:0/3413671279 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1d80fffe0 0x7fe1d81003c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:07.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.498+0000 7fe1df75d640 1 -- 172.21.15.87:0/3413671279 >> 172.21.15.87:0/3413671279 conn(0x7fe1d80fbae0 msgr2=0x7fe1d80fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:07.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.498+0000 7fe1df75d640 1 -- 172.21.15.87:0/3413671279 shutdown_connections 2024-09-13T17:12:07.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.498+0000 7fe1df75d640 1 -- 172.21.15.87:0/3413671279 wait complete. 2024-09-13T17:12:07.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.499+0000 7fe1df75d640 1 Processor -- start 2024-09-13T17:12:07.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.499+0000 7fe1df75d640 1 -- start start 2024-09-13T17:12:07.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.499+0000 7fe1df75d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1d80fffe0 0x7fe1d81961a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:07.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.499+0000 7fe1df75d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1d8100990 0x7fe1d81966e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:07.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.499+0000 7fe1df75d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1d8105110 0x7fe1d819aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:07.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.499+0000 7fe1df75d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d819b0e0 con 0x7fe1d8100990 2024-09-13T17:12:07.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.499+0000 7fe1df75d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d819b250 con 0x7fe1d8105110 2024-09-13T17:12:07.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.499+0000 7fe1df75d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d819b3c0 con 0x7fe1d80fffe0 2024-09-13T17:12:07.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.499+0000 7fe1dccf8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1d8100990 0x7fe1d81966e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:07.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.499+0000 7fe1dccf8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1d8100990 0x7fe1d81966e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56732/0 (socket says 172.21.15.87:56732) 2024-09-13T17:12:07.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.499+0000 7fe1dccf8640 1 -- 172.21.15.87:0/269542535 learned_addr learned my addr 172.21.15.87:0/269542535 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:12:07.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.499+0000 7fe1dd4f9640 1 --2- 172.21.15.87:0/269542535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1d80fffe0 0x7fe1d81961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:07.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.499+0000 7fe1ddcfa640 1 --2- 172.21.15.87:0/269542535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1d8105110 0x7fe1d819aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:07.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.499+0000 7fe1dccf8640 1 -- 172.21.15.87:0/269542535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1d80fffe0 msgr2=0x7fe1d81961a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:07.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.499+0000 7fe1dccf8640 1 --2- 172.21.15.87:0/269542535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1d80fffe0 0x7fe1d81961a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:07.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.499+0000 7fe1dccf8640 1 -- 172.21.15.87:0/269542535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1d8105110 msgr2=0x7fe1d819aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:07.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.499+0000 7fe1dccf8640 1 --2- 172.21.15.87:0/269542535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1d8105110 0x7fe1d819aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:07.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.499+0000 7fe1dccf8640 1 -- 172.21.15.87:0/269542535 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1cc009560 con 0x7fe1d8100990 2024-09-13T17:12:07.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.499+0000 7fe1ddcfa640 1 --2- 172.21.15.87:0/269542535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1d8105110 0x7fe1d819aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:12:07.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.500+0000 7fe1dccf8640 1 --2- 172.21.15.87:0/269542535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1d8100990 0x7fe1d81966e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc005760 tx=0x7fe1cc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:07.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.500+0000 7fe1d67fc640 1 -- 172.21.15.87:0/269542535 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc004520 con 0x7fe1d8100990 2024-09-13T17:12:07.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.500+0000 7fe1df75d640 1 -- 172.21.15.87:0/269542535 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1d819b640 con 0x7fe1d8100990 2024-09-13T17:12:07.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.500+0000 7fe1df75d640 1 -- 172.21.15.87:0/269542535 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1d819b960 con 0x7fe1d8100990 2024-09-13T17:12:07.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.500+0000 7fe1d67fc640 1 -- 172.21.15.87:0/269542535 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe1cc031c40 con 0x7fe1d8100990 2024-09-13T17:12:07.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.500+0000 7fe1d67fc640 1 -- 172.21.15.87:0/269542535 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc032440 con 0x7fe1d8100990 2024-09-13T17:12:07.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.501+0000 7fe1df75d640 1 -- 172.21.15.87:0/269542535 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1c4005250 con 0x7fe1d8100990 2024-09-13T17:12:07.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.502+0000 7fe1d67fc640 1 -- 172.21.15.87:0/269542535 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fe1cc032640 con 0x7fe1d8100990 2024-09-13T17:12:07.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.502+0000 7fe1d67fc640 1 --2- 172.21.15.87:0/269542535 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe1c00a1070 0x7fe1c00a3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:07.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.502+0000 7fe1dd4f9640 1 --2- 172.21.15.87:0/269542535 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe1c00a1070 0x7fe1c00a3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:07.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.502+0000 7fe1d67fc640 1 -- 172.21.15.87:0/269542535 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8978+0+0 (secure 0 0 0) 0x7fe1cc0ed9c0 con 0x7fe1d8100990 2024-09-13T17:12:07.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.503+0000 7fe1dd4f9640 1 --2- 172.21.15.87:0/269542535 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe1c00a1070 0x7fe1c00a3530 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0007ec0 tx=0x7fe1d00075b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:07.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.506+0000 7fe1d67fc640 1 -- 172.21.15.87:0/269542535 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe1cc0b6d00 con 0x7fe1d8100990 2024-09-13T17:12:07.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:07 smithi149 ceph-mon[35496]: pgmap v300: 129 pgs: 129 active+clean; 637 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.9 KiB/s wr, 8 op/s; 48 B/s, 0 objects/s recovering 2024-09-13T17:12:07.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:07 smithi118 ceph-mon[34374]: pgmap v300: 129 pgs: 129 active+clean; 637 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.9 KiB/s wr, 8 op/s; 48 B/s, 0 objects/s recovering 2024-09-13T17:12:07.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.670+0000 7fe1df75d640 1 -- 172.21.15.87:0/269542535 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1c40057d0 con 0x7fe1d8100990 2024-09-13T17:12:07.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.672+0000 7fe1d67fc640 1 -- 172.21.15.87:0/269542535 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+24383 (secure 0 0 0) 0x7fe1cc03f090 con 0x7fe1d8100990 2024-09-13T17:12:07.674 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:12:07.674 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":91,"fsid":"043d5bae-71f2-11ef-bceb-c7b262605968","created":"2024-09-13T17:03:57.852010+0000","modified":"2024-09-13T17:11:49.788058+0000","last_up_change":"2024-09-13T17:10:34.423548+0000","last_in_change":"2024-09-13T17:10:14.228123+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:07:02.286400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:11:21.965141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:11:22.504345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:11:25.565163+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58250283-85c0-416e-abdd-1fc5a7ff0c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6803","nonce":1316956138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6805","nonce":1316956138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6809","nonce":1316956138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6807","nonce":1316956138}]},"public_addr":"172.21.15.87:6803/1316956138","cluster_addr":"172.21.15.87:6805/1316956138","heartbeat_back_addr":"172.21.15.87:6809/1316956138","heartbeat_front_addr":"172.21.15.87:6807/1316956138","state":["exists","up"]},{"osd":1,"uuid":"b9d49969-94b1-4262-b4ff-db0a8e3331af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6801","nonce":3352566727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6803","nonce":3352566727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6807","nonce":3352566727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6805","nonce":3352566727}]},"public_addr":"172.21.15.118:6801/3352566727","cluster_addr":"172.21.15.118:6803/3352566727","heartbeat_back_addr":"172.21.15.118:6807/3352566727","heartbeat_front_addr":"172.21.15.118:6805/3352566727","state":["exists","up"]},{"osd":2,"uuid":"ba64549e-d736-426f-b466-f569af5f16d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6801","nonce":2774581686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6803","nonce":2774581686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6807","nonce":2774581686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6805","nonce":2774581686}]},"public_addr":"172.21.15.149:6801/2774581686","cluster_addr":"172.21.15.149:6803/2774581686","heartbeat_back_addr":"172.21.15.149:6807/2774581686","heartbeat_front_addr":"172.21.15.149:6805/2774581686","state":["exists","up"]},{"osd":3,"uuid":"3d5553e5-371b-49fd-976b-9e72a97a2f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6811","nonce":3306119066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6813","nonce":3306119066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6817","nonce":3306119066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6815","nonce":3306119066}]},"public_addr":"172.21.15.87:6811/3306119066","cluster_addr":"172.21.15.87:6813/3306119066","heartbeat_back_addr":"172.21.15.87:6817/3306119066","heartbeat_front_addr":"172.21.15.87:6815/3306119066","state":["exists","up"]},{"osd":4,"uuid":"2fbe0e27-34ec-42a6-9962-f1d8202b3159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6809","nonce":3342349890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6811","nonce":3342349890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6815","nonce":3342349890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6813","nonce":3342349890}]},"public_addr":"172.21.15.118:6809/3342349890","cluster_addr":"172.21.15.118:6811/3342349890","heartbeat_back_addr":"172.21.15.118:6815/3342349890","heartbeat_front_addr":"172.21.15.118:6813/3342349890","state":["exists","up"]},{"osd":5,"uuid":"53c14519-6170-4b5a-a79d-4835882d7bec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6809","nonce":3468867124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6811","nonce":3468867124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6815","nonce":3468867124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6813","nonce":3468867124}]},"public_addr":"172.21.15.149:6809/3468867124","cluster_addr":"172.21.15.149:6811/3468867124","heartbeat_back_addr":"172.21.15.149:6815/3468867124","heartbeat_front_addr":"172.21.15.149:6813/3468867124","state":["exists","up"]},{"osd":6,"uuid":"d3951b32-db77-4b8b-9de0-f05e03d13f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6819","nonce":326563617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6821","nonce":326563617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6825","nonce":326563617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6823","nonce":326563617}]},"public_addr":"172.21.15.87:6819/326563617","cluster_addr":"172.21.15.87:6821/326563617","heartbeat_back_addr":"172.21.15.87:6825/326563617","heartbeat_front_addr":"172.21.15.87:6823/326563617","state":["exists","up"]},{"osd":7,"uuid":"4d46dab7-a8bf-4e3e-b5c0-43860d336bdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6817","nonce":1690268990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6819","nonce":1690268990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6823","nonce":1690268990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6821","nonce":1690268990}]},"public_addr":"172.21.15.118:6817/1690268990","cluster_addr":"172.21.15.118:6819/1690268990","heartbeat_back_addr":"172.21.15.118:6823/1690268990","heartbeat_front_addr":"172.21.15.118:6821/1690268990","state":["exists","up"]},{"osd":8,"uuid":"5a015a7d-60a3-4412-96af-1b61d2ad51f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6817","nonce":1558675380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6819","nonce":1558675380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6823","nonce":1558675380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6821","nonce":1558675380}]},"public_addr":"172.21.15.149:6817/1558675380","cluster_addr":"172.21.15.149:6819/1558675380","heartbeat_back_addr":"172.21.15.149:6823/1558675380","heartbeat_front_addr":"172.21.15.149:6821/1558675380","state":["exists","up"]},{"osd":9,"uuid":"248c0b6e-4c4e-4c63-a0dd-e4cdf3b997a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6827","nonce":1453934262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6829","nonce":1453934262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6833","nonce":1453934262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6831","nonce":1453934262}]},"public_addr":"172.21.15.87:6827/1453934262","cluster_addr":"172.21.15.87:6829/1453934262","heartbeat_back_addr":"172.21.15.87:6833/1453934262","heartbeat_front_addr":"172.21.15.87:6831/1453934262","state":["exists","up"]},{"osd":10,"uuid":"24238714-e737-4371-b5d5-0cd3395f09bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6825","nonce":1034318850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6827","nonce":1034318850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6831","nonce":1034318850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6829","nonce":1034318850}]},"public_addr":"172.21.15.118:6825/1034318850","cluster_addr":"172.21.15.118:6827/1034318850","heartbeat_back_addr":"172.21.15.118:6831/1034318850","heartbeat_front_addr":"172.21.15.118:6829/1034318850","state":["exists","up"]},{"osd":11,"uuid":"409dd3bf-5154-4dea-8708-7de7f9e2e793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6825","nonce":271000465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6827","nonce":271000465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6831","nonce":271000465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6829","nonce":271000465}]},"public_addr":"172.21.15.149:6825/271000465","cluster_addr":"172.21.15.149:6827/271000465","heartbeat_back_addr":"172.21.15.149:6831/271000465","heartbeat_front_addr":"172.21.15.149:6829/271000465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:16.382664+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:37.914250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:00.425876+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:23.960183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:47.004088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:10.214345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:33.719221+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:57.099599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:20.971881+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:44.827167+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:08.135516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:32.085853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"3.d","mappings":[{"from":1,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8},{"from":5,"to":7}]},{"pgid":"3.28","mappings":[{"from":3,"to":6},{"from":5,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/586423689":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6801/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6800/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/3270371628":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/515676743":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/1475107314":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/553289143":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/3403361612":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6801/1587363880":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6800/1587363880":"2024-09-14T17:04:24.083789+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:12:07.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.674+0000 7fe1df75d640 1 -- 172.21.15.87:0/269542535 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe1c00a1070 msgr2=0x7fe1c00a3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:07.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.674+0000 7fe1df75d640 1 --2- 172.21.15.87:0/269542535 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe1c00a1070 0x7fe1c00a3530 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0007ec0 tx=0x7fe1d00075b0 comp rx=0 tx=0).stop 2024-09-13T17:12:07.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.674+0000 7fe1df75d640 1 -- 172.21.15.87:0/269542535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1d8100990 msgr2=0x7fe1d81966e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:07.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.674+0000 7fe1df75d640 1 --2- 172.21.15.87:0/269542535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1d8100990 0x7fe1d81966e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc005760 tx=0x7fe1cc004270 comp rx=0 tx=0).stop 2024-09-13T17:12:07.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.674+0000 7fe1df75d640 1 -- 172.21.15.87:0/269542535 shutdown_connections 2024-09-13T17:12:07.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.674+0000 7fe1df75d640 1 --2- 172.21.15.87:0/269542535 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe1c00a1070 0x7fe1c00a3530 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:07.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.674+0000 7fe1df75d640 1 --2- 172.21.15.87:0/269542535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1d8105110 0x7fe1d819aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:07.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.674+0000 7fe1df75d640 1 --2- 172.21.15.87:0/269542535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1d8100990 0x7fe1d81966e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:07.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.674+0000 7fe1df75d640 1 --2- 172.21.15.87:0/269542535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1d80fffe0 0x7fe1d81961a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:07.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.674+0000 7fe1df75d640 1 -- 172.21.15.87:0/269542535 >> 172.21.15.87:0/269542535 conn(0x7fe1d80fbae0 msgr2=0x7fe1d80fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:07.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.674+0000 7fe1df75d640 1 -- 172.21.15.87:0/269542535 shutdown_connections 2024-09-13T17:12:07.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:07.674+0000 7fe1df75d640 1 -- 172.21.15.87:0/269542535 wait complete. 2024-09-13T17:12:08.228 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:08 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/269542535' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:12:08.302 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-13T17:12:08.303 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T17:12:08.500 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:12:08.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:08 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/269542535' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:12:08.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:08 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/269542535' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:12:09.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:09 smithi087 ceph-mon[30934]: pgmap v301: 129 pgs: 129 active+clean; 637 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-13T17:12:09.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:09 smithi149 ceph-mon[35496]: pgmap v301: 129 pgs: 129 active+clean; 637 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-13T17:12:09.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:09 smithi118 ceph-mon[34374]: pgmap v301: 129 pgs: 129 active+clean; 637 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-13T17:12:10.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.178+0000 7f1ce820c640 1 -- 172.21.15.87:0/3066180909 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ce00ff880 msgr2=0x7f1ce01038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:10.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.178+0000 7f1ce820c640 1 --2- 172.21.15.87:0/3066180909 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ce00ff880 0x7f1ce01038d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0009930 tx=0x7f1cd002a420 comp rx=0 tx=0).stop 2024-09-13T17:12:10.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.179+0000 7f1ce820c640 1 -- 172.21.15.87:0/3066180909 shutdown_connections 2024-09-13T17:12:10.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.179+0000 7f1ce820c640 1 --2- 172.21.15.87:0/3066180909 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ce0104000 0x7f1ce010bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:10.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.179+0000 7f1ce820c640 1 --2- 172.21.15.87:0/3066180909 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ce00ff880 0x7f1ce01038d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:10.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.179+0000 7f1ce820c640 1 --2- 172.21.15.87:0/3066180909 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ce00feed0 0x7f1ce00ff2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:10.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.179+0000 7f1ce820c640 1 -- 172.21.15.87:0/3066180909 >> 172.21.15.87:0/3066180909 conn(0x7f1ce00fa9b0 msgr2=0x7f1ce00fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:10.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.179+0000 7f1ce820c640 1 -- 172.21.15.87:0/3066180909 shutdown_connections 2024-09-13T17:12:10.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.179+0000 7f1ce820c640 1 -- 172.21.15.87:0/3066180909 wait complete. 2024-09-13T17:12:10.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.179+0000 7f1ce820c640 1 Processor -- start 2024-09-13T17:12:10.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.179+0000 7f1ce820c640 1 -- start start 2024-09-13T17:12:10.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.179+0000 7f1ce820c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ce00feed0 0x7f1ce0198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:10.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.179+0000 7f1ce820c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ce00ff880 0x7f1ce01989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:10.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.179+0000 7f1ce820c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ce0104000 0x7f1ce019cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:10.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.179+0000 7f1ce820c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce019d3c0 con 0x7f1ce0104000 2024-09-13T17:12:10.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.179+0000 7f1ce820c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce019d530 con 0x7f1ce00ff880 2024-09-13T17:12:10.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.179+0000 7f1ce820c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce019d6a0 con 0x7f1ce00feed0 2024-09-13T17:12:10.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.180+0000 7f1ce67a9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ce0104000 0x7f1ce019cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:10.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.180+0000 7f1ce67a9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ce0104000 0x7f1ce019cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56736/0 (socket says 172.21.15.87:56736) 2024-09-13T17:12:10.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.180+0000 7f1ce67a9640 1 -- 172.21.15.87:0/2880948772 learned_addr learned my addr 172.21.15.87:0/2880948772 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:12:10.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.180+0000 7f1ce5fa8640 1 --2- 172.21.15.87:0/2880948772 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ce00feed0 0x7f1ce0198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:10.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.180+0000 7f1ce57a7640 1 --2- 172.21.15.87:0/2880948772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ce00ff880 0x7f1ce01989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:10.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.180+0000 7f1ce67a9640 1 -- 172.21.15.87:0/2880948772 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ce00feed0 msgr2=0x7f1ce0198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:10.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.180+0000 7f1ce67a9640 1 --2- 172.21.15.87:0/2880948772 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ce00feed0 0x7f1ce0198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:10.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.180+0000 7f1ce67a9640 1 -- 172.21.15.87:0/2880948772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ce00ff880 msgr2=0x7f1ce01989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:10.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.180+0000 7f1ce67a9640 1 --2- 172.21.15.87:0/2880948772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ce00ff880 0x7f1ce01989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:10.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.180+0000 7f1ce67a9640 1 -- 172.21.15.87:0/2880948772 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd0009560 con 0x7f1ce0104000 2024-09-13T17:12:10.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.180+0000 7f1ce67a9640 1 --2- 172.21.15.87:0/2880948772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ce0104000 0x7f1ce019cdc0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800eaa0 tx=0x7f1cd800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:10.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.180+0000 7f1cd6ffd640 1 -- 172.21.15.87:0/2880948772 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd800cdb0 con 0x7f1ce0104000 2024-09-13T17:12:10.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.180+0000 7f1cd6ffd640 1 -- 172.21.15.87:0/2880948772 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1cd8005020 con 0x7f1ce0104000 2024-09-13T17:12:10.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.180+0000 7f1ce820c640 1 -- 172.21.15.87:0/2880948772 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce019d980 con 0x7f1ce0104000 2024-09-13T17:12:10.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.180+0000 7f1cd6ffd640 1 -- 172.21.15.87:0/2880948772 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd80116b0 con 0x7f1ce0104000 2024-09-13T17:12:10.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.180+0000 7f1ce820c640 1 -- 172.21.15.87:0/2880948772 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce019dc30 con 0x7f1ce0104000 2024-09-13T17:12:10.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.181+0000 7f1ce820c640 1 -- 172.21.15.87:0/2880948772 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce01003b0 con 0x7f1ce0104000 2024-09-13T17:12:10.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.182+0000 7f1cd6ffd640 1 -- 172.21.15.87:0/2880948772 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f1cd8005190 con 0x7f1ce0104000 2024-09-13T17:12:10.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.183+0000 7f1cd6ffd640 1 --2- 172.21.15.87:0/2880948772 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f1ccc0a1110 0x7f1ccc0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:10.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.183+0000 7f1ce5fa8640 1 --2- 172.21.15.87:0/2880948772 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f1ccc0a1110 0x7f1ccc0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:10.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.183+0000 7f1cd6ffd640 1 -- 172.21.15.87:0/2880948772 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8978+0+0 (secure 0 0 0) 0x7f1cd80ccd60 con 0x7f1ce0104000 2024-09-13T17:12:10.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.184+0000 7f1ce5fa8640 1 --2- 172.21.15.87:0/2880948772 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f1ccc0a1110 0x7f1ccc0a35d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00bbe0 tx=0x7f1cdc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:10.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.187+0000 7f1cd6ffd640 1 -- 172.21.15.87:0/2880948772 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1cd80960a0 con 0x7f1ce0104000 2024-09-13T17:12:10.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.352+0000 7f1ce820c640 1 -- 172.21.15.87:0/2880948772 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ce019dc30 con 0x7f1ce0104000 2024-09-13T17:12:10.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.353+0000 7f1cd6ffd640 1 -- 172.21.15.87:0/2880948772 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+24383 (secure 0 0 0) 0x7f1ce019dc30 con 0x7f1ce0104000 2024-09-13T17:12:10.355 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:12:10.355 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":91,"fsid":"043d5bae-71f2-11ef-bceb-c7b262605968","created":"2024-09-13T17:03:57.852010+0000","modified":"2024-09-13T17:11:49.788058+0000","last_up_change":"2024-09-13T17:10:34.423548+0000","last_in_change":"2024-09-13T17:10:14.228123+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:07:02.286400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:11:21.965141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:11:22.504345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:11:25.565163+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58250283-85c0-416e-abdd-1fc5a7ff0c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6803","nonce":1316956138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6805","nonce":1316956138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6809","nonce":1316956138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6807","nonce":1316956138}]},"public_addr":"172.21.15.87:6803/1316956138","cluster_addr":"172.21.15.87:6805/1316956138","heartbeat_back_addr":"172.21.15.87:6809/1316956138","heartbeat_front_addr":"172.21.15.87:6807/1316956138","state":["exists","up"]},{"osd":1,"uuid":"b9d49969-94b1-4262-b4ff-db0a8e3331af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6801","nonce":3352566727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6803","nonce":3352566727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6807","nonce":3352566727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6805","nonce":3352566727}]},"public_addr":"172.21.15.118:6801/3352566727","cluster_addr":"172.21.15.118:6803/3352566727","heartbeat_back_addr":"172.21.15.118:6807/3352566727","heartbeat_front_addr":"172.21.15.118:6805/3352566727","state":["exists","up"]},{"osd":2,"uuid":"ba64549e-d736-426f-b466-f569af5f16d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6801","nonce":2774581686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6803","nonce":2774581686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6807","nonce":2774581686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6805","nonce":2774581686}]},"public_addr":"172.21.15.149:6801/2774581686","cluster_addr":"172.21.15.149:6803/2774581686","heartbeat_back_addr":"172.21.15.149:6807/2774581686","heartbeat_front_addr":"172.21.15.149:6805/2774581686","state":["exists","up"]},{"osd":3,"uuid":"3d5553e5-371b-49fd-976b-9e72a97a2f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6811","nonce":3306119066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6813","nonce":3306119066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6817","nonce":3306119066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6815","nonce":3306119066}]},"public_addr":"172.21.15.87:6811/3306119066","cluster_addr":"172.21.15.87:6813/3306119066","heartbeat_back_addr":"172.21.15.87:6817/3306119066","heartbeat_front_addr":"172.21.15.87:6815/3306119066","state":["exists","up"]},{"osd":4,"uuid":"2fbe0e27-34ec-42a6-9962-f1d8202b3159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6809","nonce":3342349890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6811","nonce":3342349890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6815","nonce":3342349890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6813","nonce":3342349890}]},"public_addr":"172.21.15.118:6809/3342349890","cluster_addr":"172.21.15.118:6811/3342349890","heartbeat_back_addr":"172.21.15.118:6815/3342349890","heartbeat_front_addr":"172.21.15.118:6813/3342349890","state":["exists","up"]},{"osd":5,"uuid":"53c14519-6170-4b5a-a79d-4835882d7bec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6809","nonce":3468867124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6811","nonce":3468867124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6815","nonce":3468867124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6813","nonce":3468867124}]},"public_addr":"172.21.15.149:6809/3468867124","cluster_addr":"172.21.15.149:6811/3468867124","heartbeat_back_addr":"172.21.15.149:6815/3468867124","heartbeat_front_addr":"172.21.15.149:6813/3468867124","state":["exists","up"]},{"osd":6,"uuid":"d3951b32-db77-4b8b-9de0-f05e03d13f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6819","nonce":326563617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6821","nonce":326563617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6825","nonce":326563617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6823","nonce":326563617}]},"public_addr":"172.21.15.87:6819/326563617","cluster_addr":"172.21.15.87:6821/326563617","heartbeat_back_addr":"172.21.15.87:6825/326563617","heartbeat_front_addr":"172.21.15.87:6823/326563617","state":["exists","up"]},{"osd":7,"uuid":"4d46dab7-a8bf-4e3e-b5c0-43860d336bdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6817","nonce":1690268990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6819","nonce":1690268990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6823","nonce":1690268990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6821","nonce":1690268990}]},"public_addr":"172.21.15.118:6817/1690268990","cluster_addr":"172.21.15.118:6819/1690268990","heartbeat_back_addr":"172.21.15.118:6823/1690268990","heartbeat_front_addr":"172.21.15.118:6821/1690268990","state":["exists","up"]},{"osd":8,"uuid":"5a015a7d-60a3-4412-96af-1b61d2ad51f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6817","nonce":1558675380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6819","nonce":1558675380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6823","nonce":1558675380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6821","nonce":1558675380}]},"public_addr":"172.21.15.149:6817/1558675380","cluster_addr":"172.21.15.149:6819/1558675380","heartbeat_back_addr":"172.21.15.149:6823/1558675380","heartbeat_front_addr":"172.21.15.149:6821/1558675380","state":["exists","up"]},{"osd":9,"uuid":"248c0b6e-4c4e-4c63-a0dd-e4cdf3b997a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6827","nonce":1453934262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6829","nonce":1453934262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6833","nonce":1453934262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6831","nonce":1453934262}]},"public_addr":"172.21.15.87:6827/1453934262","cluster_addr":"172.21.15.87:6829/1453934262","heartbeat_back_addr":"172.21.15.87:6833/1453934262","heartbeat_front_addr":"172.21.15.87:6831/1453934262","state":["exists","up"]},{"osd":10,"uuid":"24238714-e737-4371-b5d5-0cd3395f09bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6825","nonce":1034318850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6827","nonce":1034318850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6831","nonce":1034318850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6829","nonce":1034318850}]},"public_addr":"172.21.15.118:6825/1034318850","cluster_addr":"172.21.15.118:6827/1034318850","heartbeat_back_addr":"172.21.15.118:6831/1034318850","heartbeat_front_addr":"172.21.15.118:6829/1034318850","state":["exists","up"]},{"osd":11,"uuid":"409dd3bf-5154-4dea-8708-7de7f9e2e793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6825","nonce":271000465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6827","nonce":271000465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6831","nonce":271000465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6829","nonce":271000465}]},"public_addr":"172.21.15.149:6825/271000465","cluster_addr":"172.21.15.149:6827/271000465","heartbeat_back_addr":"172.21.15.149:6831/271000465","heartbeat_front_addr":"172.21.15.149:6829/271000465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:16.382664+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:37.914250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:00.425876+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:23.960183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:47.004088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:10.214345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:33.719221+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:57.099599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:20.971881+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:44.827167+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:08.135516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:32.085853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"3.d","mappings":[{"from":1,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8},{"from":5,"to":7}]},{"pgid":"3.28","mappings":[{"from":3,"to":6},{"from":5,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/586423689":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6801/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6800/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/3270371628":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/515676743":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/1475107314":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/553289143":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/3403361612":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6801/1587363880":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6800/1587363880":"2024-09-14T17:04:24.083789+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:12:10.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.355+0000 7f1ce820c640 1 -- 172.21.15.87:0/2880948772 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f1ccc0a1110 msgr2=0x7f1ccc0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:10.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.355+0000 7f1ce820c640 1 --2- 172.21.15.87:0/2880948772 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f1ccc0a1110 0x7f1ccc0a35d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00bbe0 tx=0x7f1cdc00b390 comp rx=0 tx=0).stop 2024-09-13T17:12:10.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.355+0000 7f1ce820c640 1 -- 172.21.15.87:0/2880948772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ce0104000 msgr2=0x7f1ce019cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:10.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.355+0000 7f1ce820c640 1 --2- 172.21.15.87:0/2880948772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ce0104000 0x7f1ce019cdc0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800eaa0 tx=0x7f1cd800ef60 comp rx=0 tx=0).stop 2024-09-13T17:12:10.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.355+0000 7f1ce820c640 1 -- 172.21.15.87:0/2880948772 shutdown_connections 2024-09-13T17:12:10.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.355+0000 7f1ce820c640 1 --2- 172.21.15.87:0/2880948772 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f1ccc0a1110 0x7f1ccc0a35d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:10.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.355+0000 7f1ce820c640 1 --2- 172.21.15.87:0/2880948772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ce0104000 0x7f1ce019cdc0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:10.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.355+0000 7f1ce820c640 1 --2- 172.21.15.87:0/2880948772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ce00ff880 0x7f1ce01989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:10.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.355+0000 7f1ce820c640 1 --2- 172.21.15.87:0/2880948772 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ce00feed0 0x7f1ce0198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:10.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.355+0000 7f1ce820c640 1 -- 172.21.15.87:0/2880948772 >> 172.21.15.87:0/2880948772 conn(0x7f1ce00fa9b0 msgr2=0x7f1ce00fbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:10.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.355+0000 7f1ce820c640 1 -- 172.21.15.87:0/2880948772 shutdown_connections 2024-09-13T17:12:10.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:10.355+0000 7f1ce820c640 1 -- 172.21.15.87:0/2880948772 wait complete. 2024-09-13T17:12:11.093 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-13T17:12:11.093 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-13T17:12:11.094 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-13T17:12:11.094 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-13T17:12:11.095 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-13T17:12:11.095 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-13T17:12:11.095 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-13T17:12:11.096 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-13T17:12:11.096 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-13T17:12:11.097 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-13T17:12:11.097 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-13T17:12:11.097 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-13T17:12:11.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:11 smithi087 ceph-mon[30934]: pgmap v302: 129 pgs: 129 active+clean; 640 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-13T17:12:11.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:11 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2880948772' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:12:11.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:11 smithi149 ceph-mon[35496]: pgmap v302: 129 pgs: 129 active+clean; 640 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-13T17:12:11.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:11 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2880948772' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:12:11.601 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:12:11.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:11 smithi118 ceph-mon[34374]: pgmap v302: 129 pgs: 129 active+clean; 640 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-13T17:12:11.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:11 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2880948772' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:12:11.732 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:12:11.736 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:12:11.736 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:12:11.737 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:12:11.737 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:12:11.742 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:12:11.743 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:12:11.744 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:12:11.746 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:12:13.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:13 smithi087 ceph-mon[30934]: pgmap v303: 129 pgs: 129 active+clean; 640 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-13T17:12:13.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:13 smithi149 ceph-mon[35496]: pgmap v303: 129 pgs: 129 active+clean; 640 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-13T17:12:13.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:13 smithi118 ceph-mon[34374]: pgmap v303: 129 pgs: 129 active+clean; 640 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-13T17:12:15.372 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:15 smithi087 ceph-mon[30934]: pgmap v304: 129 pgs: 129 active+clean; 640 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-13T17:12:15.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:15 smithi149 ceph-mon[35496]: pgmap v304: 129 pgs: 129 active+clean; 640 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-13T17:12:15.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:15 smithi118 ceph-mon[34374]: pgmap v304: 129 pgs: 129 active+clean; 640 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-13T17:12:17.292 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:17 smithi087 ceph-mon[30934]: pgmap v305: 129 pgs: 129 active+clean; 640 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-13T17:12:17.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:17 smithi149 ceph-mon[35496]: pgmap v305: 129 pgs: 129 active+clean; 640 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-13T17:12:17.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:17 smithi118 ceph-mon[34374]: pgmap v305: 129 pgs: 129 active+clean; 640 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-13T17:12:19.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.074+0000 7f437e117640 1 -- 172.21.15.87:0/4138273732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4378100f60 msgr2=0x7f4378101340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:19.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.074+0000 7f437e117640 1 --2- 172.21.15.87:0/4138273732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4378100f60 0x7f4378101340 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4368009900 tx=0x7f436802a480 comp rx=0 tx=0).stop 2024-09-13T17:12:19.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.074+0000 7f437e117640 1 -- 172.21.15.87:0/4138273732 shutdown_connections 2024-09-13T17:12:19.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.074+0000 7f437e117640 1 --2- 172.21.15.87:0/4138273732 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f437810a390 0x7f437810c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:19.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.074+0000 7f437e117640 1 --2- 172.21.15.87:0/4138273732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4378101880 0x7f4378109d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:19.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.074+0000 7f437e117640 1 --2- 172.21.15.87:0/4138273732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4378100f60 0x7f4378101340 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:19.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.074+0000 7f437e117640 1 -- 172.21.15.87:0/4138273732 >> 172.21.15.87:0/4138273732 conn(0x7f43780fa9a0 msgr2=0x7f43780fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:19.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.074+0000 7f437e117640 1 -- 172.21.15.87:0/4138273732 shutdown_connections 2024-09-13T17:12:19.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.074+0000 7f437e117640 1 -- 172.21.15.87:0/4138273732 wait complete. 2024-09-13T17:12:19.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.075+0000 7f437e117640 1 Processor -- start 2024-09-13T17:12:19.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.075+0000 7f437e117640 1 -- start start 2024-09-13T17:12:19.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.075+0000 7f437e117640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4378100f60 0x7f43780febc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:19.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.075+0000 7f437e117640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4378101880 0x7f43780ff100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:19.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.075+0000 7f437e117640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f437810a390 0x7f43780ff660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:19.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.075+0000 7f437e117640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43781a4760 con 0x7f4378101880 2024-09-13T17:12:19.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.075+0000 7f437e117640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43781a48d0 con 0x7f437810a390 2024-09-13T17:12:19.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.075+0000 7f437e117640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43781a4a90 con 0x7f4378100f60 2024-09-13T17:12:19.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.075+0000 7f4376ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4378101880 0x7f43780ff100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:19.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.075+0000 7f4376ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4378101880 0x7f43780ff100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52292/0 (socket says 172.21.15.87:52292) 2024-09-13T17:12:19.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.075+0000 7f4376ffd640 1 -- 172.21.15.87:0/713580085 learned_addr learned my addr 172.21.15.87:0/713580085 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:12:19.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.076+0000 7f43777fe640 1 --2- 172.21.15.87:0/713580085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4378100f60 0x7f43780febc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:19.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.076+0000 7f4376ffd640 1 -- 172.21.15.87:0/713580085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4378100f60 msgr2=0x7f43780febc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:19.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.076+0000 7f4376ffd640 1 --2- 172.21.15.87:0/713580085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4378100f60 0x7f43780febc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:19.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.076+0000 7f4376ffd640 1 -- 172.21.15.87:0/713580085 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f437810a390 msgr2=0x7f43780ff660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:19.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.076+0000 7f4377fff640 1 --2- 172.21.15.87:0/713580085 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f437810a390 0x7f43780ff660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:19.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.076+0000 7f4376ffd640 1 --2- 172.21.15.87:0/713580085 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f437810a390 0x7f43780ff660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:19.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.076+0000 7f4376ffd640 1 -- 172.21.15.87:0/713580085 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4368009560 con 0x7f4378101880 2024-09-13T17:12:19.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.076+0000 7f4376ffd640 1 --2- 172.21.15.87:0/713580085 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4378101880 0x7f43780ff100 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f436c00c970 tx=0x7f436c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:19.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.076+0000 7f4374ff9640 1 -- 172.21.15.87:0/713580085 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c007bb0 con 0x7f4378101880 2024-09-13T17:12:19.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.076+0000 7f4374ff9640 1 -- 172.21.15.87:0/713580085 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f436c007d10 con 0x7f4378101880 2024-09-13T17:12:19.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.076+0000 7f437e117640 1 -- 172.21.15.87:0/713580085 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43781a4d70 con 0x7f4378101880 2024-09-13T17:12:19.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.076+0000 7f4374ff9640 1 -- 172.21.15.87:0/713580085 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c0186f0 con 0x7f4378101880 2024-09-13T17:12:19.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.076+0000 7f437e117640 1 -- 172.21.15.87:0/713580085 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43781a5260 con 0x7f4378101880 2024-09-13T17:12:19.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.077+0000 7f437e117640 1 -- 172.21.15.87:0/713580085 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4378110080 con 0x7f4378101880 2024-09-13T17:12:19.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.078+0000 7f4374ff9640 1 -- 172.21.15.87:0/713580085 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f436c00f450 con 0x7f4378101880 2024-09-13T17:12:19.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.079+0000 7f4374ff9640 1 --2- 172.21.15.87:0/713580085 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f43600a1190 0x7f43600a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:19.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.079+0000 7f43777fe640 1 --2- 172.21.15.87:0/713580085 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f43600a1190 0x7f43600a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:19.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.079+0000 7f4374ff9640 1 -- 172.21.15.87:0/713580085 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8978+0+0 (secure 0 0 0) 0x7f436c0cd2b0 con 0x7f4378101880 2024-09-13T17:12:19.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.079+0000 7f4374ff9640 1 --2- 172.21.15.87:0/713580085 >> [v2:172.21.15.118:6808/3342349890,v1:172.21.15.118:6809/3342349890] conn(0x7f43600ac0a0 0x7f43600ae540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:19.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.079+0000 7f4374ff9640 1 -- 172.21.15.87:0/713580085 --> [v2:172.21.15.118:6808/3342349890,v1:172.21.15.118:6809/3342349890] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f43600aec10 con 0x7f43600ac0a0 2024-09-13T17:12:19.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.079+0000 7f4374ff9640 1 -- 172.21.15.87:0/713580085 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f436c0cd6c0 con 0x7f4378101880 2024-09-13T17:12:19.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.079+0000 7f43777fe640 1 --2- 172.21.15.87:0/713580085 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f43600a1190 0x7f43600a3650 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4368005ec0 tx=0x7f4368000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:19.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.080+0000 7f4377fff640 1 --2- 172.21.15.87:0/713580085 >> [v2:172.21.15.118:6808/3342349890,v1:172.21.15.118:6809/3342349890] conn(0x7f43600ac0a0 0x7f43600ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:19.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.080+0000 7f4377fff640 1 --2- 172.21.15.87:0/713580085 >> [v2:172.21.15.118:6808/3342349890,v1:172.21.15.118:6809/3342349890] conn(0x7f43600ac0a0 0x7f43600ae540 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:19.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.081+0000 7f4374ff9640 1 -- 172.21.15.87:0/713580085 <== osd.4 v2:172.21.15.118:6808/3342349890 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f43600aec10 con 0x7f43600ac0a0 2024-09-13T17:12:19.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.095+0000 7f437e117640 1 -- 172.21.15.87:0/713580085 --> [v2:172.21.15.118:6808/3342349890,v1:172.21.15.118:6809/3342349890] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4378060b30 con 0x7f43600ac0a0 2024-09-13T17:12:19.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.096+0000 7f4374ff9640 1 -- 172.21.15.87:0/713580085 <== osd.4 v2:172.21.15.118:6808/3342349890 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f4378060b30 con 0x7f43600ac0a0 2024-09-13T17:12:19.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.096+0000 7f437e117640 1 -- 172.21.15.87:0/713580085 >> [v2:172.21.15.118:6808/3342349890,v1:172.21.15.118:6809/3342349890] conn(0x7f43600ac0a0 msgr2=0x7f43600ae540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:19.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.096+0000 7f437e117640 1 --2- 172.21.15.87:0/713580085 >> [v2:172.21.15.118:6808/3342349890,v1:172.21.15.118:6809/3342349890] conn(0x7f43600ac0a0 0x7f43600ae540 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:19.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.096+0000 7f437e117640 1 -- 172.21.15.87:0/713580085 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f43600a1190 msgr2=0x7f43600a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:19.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.096+0000 7f437e117640 1 --2- 172.21.15.87:0/713580085 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f43600a1190 0x7f43600a3650 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4368005ec0 tx=0x7f4368000bc0 comp rx=0 tx=0).stop 2024-09-13T17:12:19.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.096+0000 7f437e117640 1 -- 172.21.15.87:0/713580085 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4378101880 msgr2=0x7f43780ff100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:19.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.096+0000 7f437e117640 1 --2- 172.21.15.87:0/713580085 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4378101880 0x7f43780ff100 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f436c00c970 tx=0x7f436c00ce30 comp rx=0 tx=0).stop 2024-09-13T17:12:19.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.096+0000 7f4377fff640 1 -- 172.21.15.87:0/713580085 reap_dead start 2024-09-13T17:12:19.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.096+0000 7f437e117640 1 -- 172.21.15.87:0/713580085 shutdown_connections 2024-09-13T17:12:19.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.096+0000 7f437e117640 1 -- 172.21.15.87:0/713580085 >> 172.21.15.87:0/713580085 conn(0x7f43780fa9a0 msgr2=0x7f43780fc230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:19.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.096+0000 7f437e117640 1 -- 172.21.15.87:0/713580085 shutdown_connections 2024-09-13T17:12:19.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:19.096+0000 7f437e117640 1 -- 172.21.15.87:0/713580085 wait complete. 2024-09-13T17:12:19.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:19 smithi087 ceph-mon[30934]: pgmap v306: 129 pgs: 129 active+clean; 640 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-13T17:12:19.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:19 smithi149 ceph-mon[35496]: pgmap v306: 129 pgs: 129 active+clean; 640 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-13T17:12:19.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:19 smithi118 ceph-mon[34374]: pgmap v306: 129 pgs: 129 active+clean; 640 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-13T17:12:20.121 INFO:teuthology.orchestra.run.smithi087.stdout:141733920825 2024-09-13T17:12:20.121 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-13T17:12:20.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.735+0000 7fb9b2a8c640 1 -- 172.21.15.87:0/2021782982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9ac0fed50 msgr2=0x7fb9ac0ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:20.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.735+0000 7fb9b2a8c640 1 --2- 172.21.15.87:0/2021782982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9ac0fed50 0x7fb9ac0ff130 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4009ca0 tx=0x7fb9a402a940 comp rx=0 tx=0).stop 2024-09-13T17:12:20.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.735+0000 7fb9b2a8c640 1 -- 172.21.15.87:0/2021782982 shutdown_connections 2024-09-13T17:12:20.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.735+0000 7fb9b2a8c640 1 --2- 172.21.15.87:0/2021782982 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9ac104160 0x7fb9ac1045f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:20.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.735+0000 7fb9b2a8c640 1 --2- 172.21.15.87:0/2021782982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9ac0ff670 0x7fb9ac103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:20.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.735+0000 7fb9b2a8c640 1 --2- 172.21.15.87:0/2021782982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9ac0fed50 0x7fb9ac0ff130 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:20.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.735+0000 7fb9b2a8c640 1 -- 172.21.15.87:0/2021782982 >> 172.21.15.87:0/2021782982 conn(0x7fb9ac0fa9a0 msgr2=0x7fb9ac0fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:20.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.735+0000 7fb9b2a8c640 1 -- 172.21.15.87:0/2021782982 shutdown_connections 2024-09-13T17:12:20.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.735+0000 7fb9b2a8c640 1 -- 172.21.15.87:0/2021782982 wait complete. 2024-09-13T17:12:20.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.736+0000 7fb9b2a8c640 1 Processor -- start 2024-09-13T17:12:20.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.736+0000 7fb9b2a8c640 1 -- start start 2024-09-13T17:12:20.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.736+0000 7fb9b2a8c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9ac0fed50 0x7fb9ac1a2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:20.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.736+0000 7fb9b2a8c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9ac0ff670 0x7fb9ac1a2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:20.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.736+0000 7fb9b2a8c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9ac104160 0x7fb9ac19c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:20.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.736+0000 7fb9b2a8c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac19cfc0 con 0x7fb9ac104160 2024-09-13T17:12:20.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.736+0000 7fb9b2a8c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac19d130 con 0x7fb9ac0ff670 2024-09-13T17:12:20.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.736+0000 7fb9b2a8c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac19d2f0 con 0x7fb9ac0fed50 2024-09-13T17:12:20.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.736+0000 7fb9b1029640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9ac104160 0x7fb9ac19c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:20.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.736+0000 7fb9b1029640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9ac104160 0x7fb9ac19c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52314/0 (socket says 172.21.15.87:52314) 2024-09-13T17:12:20.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.736+0000 7fb9b1029640 1 -- 172.21.15.87:0/1091643519 learned_addr learned my addr 172.21.15.87:0/1091643519 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:12:20.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.737+0000 7fb9b0828640 1 --2- 172.21.15.87:0/1091643519 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9ac0fed50 0x7fb9ac1a2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:20.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.737+0000 7fb9abfff640 1 --2- 172.21.15.87:0/1091643519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9ac0ff670 0x7fb9ac1a2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:20.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.737+0000 7fb9b1029640 1 -- 172.21.15.87:0/1091643519 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9ac0fed50 msgr2=0x7fb9ac1a2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:20.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.737+0000 7fb9b1029640 1 --2- 172.21.15.87:0/1091643519 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9ac0fed50 0x7fb9ac1a2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:20.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.737+0000 7fb9b1029640 1 -- 172.21.15.87:0/1091643519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9ac0ff670 msgr2=0x7fb9ac1a2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:20.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.737+0000 7fb9b1029640 1 --2- 172.21.15.87:0/1091643519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9ac0ff670 0x7fb9ac1a2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:20.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.737+0000 7fb9b1029640 1 -- 172.21.15.87:0/1091643519 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a4009900 con 0x7fb9ac104160 2024-09-13T17:12:20.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.737+0000 7fb9b1029640 1 --2- 172.21.15.87:0/1091643519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9ac104160 0x7fb9ac19c880 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb994009fd0 tx=0x7fb99400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:20.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.737+0000 7fb9a9ffb640 1 -- 172.21.15.87:0/1091643519 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb994011830 con 0x7fb9ac104160 2024-09-13T17:12:20.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.737+0000 7fb9b2a8c640 1 -- 172.21.15.87:0/1091643519 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9ac19d5d0 con 0x7fb9ac104160 2024-09-13T17:12:20.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.737+0000 7fb9a9ffb640 1 -- 172.21.15.87:0/1091643519 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb994011e40 con 0x7fb9ac104160 2024-09-13T17:12:20.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.737+0000 7fb9a9ffb640 1 -- 172.21.15.87:0/1091643519 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99400f2e0 con 0x7fb9ac104160 2024-09-13T17:12:20.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.737+0000 7fb9b2a8c640 1 -- 172.21.15.87:0/1091643519 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9ac1a97a0 con 0x7fb9ac104160 2024-09-13T17:12:20.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.738+0000 7fb9b2a8c640 1 -- 172.21.15.87:0/1091643519 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb9ac116700 con 0x7fb9ac104160 2024-09-13T17:12:20.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.739+0000 7fb9a9ffb640 1 -- 172.21.15.87:0/1091643519 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fb994011990 con 0x7fb9ac104160 2024-09-13T17:12:20.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.740+0000 7fb9a9ffb640 1 --2- 172.21.15.87:0/1091643519 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb9980a1190 0x7fb9980a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:20.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.740+0000 7fb9b0828640 1 --2- 172.21.15.87:0/1091643519 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb9980a1190 0x7fb9980a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:20.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.740+0000 7fb9a9ffb640 1 -- 172.21.15.87:0/1091643519 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8978+0+0 (secure 0 0 0) 0x7fb9940cc4a0 con 0x7fb9ac104160 2024-09-13T17:12:20.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.740+0000 7fb9a9ffb640 1 --2- 172.21.15.87:0/1091643519 >> [v2:172.21.15.118:6824/1034318850,v1:172.21.15.118:6825/1034318850] conn(0x7fb9980ac120 0x7fb9980ae5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:20.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.740+0000 7fb9a9ffb640 1 -- 172.21.15.87:0/1091643519 --> [v2:172.21.15.118:6824/1034318850,v1:172.21.15.118:6825/1034318850] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb9980aec90 con 0x7fb9980ac120 2024-09-13T17:12:20.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.740+0000 7fb9a9ffb640 1 -- 172.21.15.87:0/1091643519 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9940ceb20 con 0x7fb9ac104160 2024-09-13T17:12:20.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.740+0000 7fb9b0828640 1 --2- 172.21.15.87:0/1091643519 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb9980a1190 0x7fb9980a3650 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4030040 tx=0x7fb9a402ffb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:20.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.740+0000 7fb9abfff640 1 --2- 172.21.15.87:0/1091643519 >> [v2:172.21.15.118:6824/1034318850,v1:172.21.15.118:6825/1034318850] conn(0x7fb9980ac120 0x7fb9980ae5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:20.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.741+0000 7fb9abfff640 1 --2- 172.21.15.87:0/1091643519 >> [v2:172.21.15.118:6824/1034318850,v1:172.21.15.118:6825/1034318850] conn(0x7fb9980ac120 0x7fb9980ae5c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:20.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.742+0000 7fb9a9ffb640 1 -- 172.21.15.87:0/1091643519 <== osd.10 v2:172.21.15.118:6824/1034318850 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fb9980aec90 con 0x7fb9980ac120 2024-09-13T17:12:20.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.755+0000 7fb9b2a8c640 1 -- 172.21.15.87:0/1091643519 --> [v2:172.21.15.118:6824/1034318850,v1:172.21.15.118:6825/1034318850] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb9ac10e270 con 0x7fb9980ac120 2024-09-13T17:12:20.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.756+0000 7fb9a9ffb640 1 -- 172.21.15.87:0/1091643519 <== osd.10 v2:172.21.15.118:6824/1034318850 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fb9ac10e270 con 0x7fb9980ac120 2024-09-13T17:12:20.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.756+0000 7fb9b2a8c640 1 -- 172.21.15.87:0/1091643519 >> [v2:172.21.15.118:6824/1034318850,v1:172.21.15.118:6825/1034318850] conn(0x7fb9980ac120 msgr2=0x7fb9980ae5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:20.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.756+0000 7fb9b2a8c640 1 --2- 172.21.15.87:0/1091643519 >> [v2:172.21.15.118:6824/1034318850,v1:172.21.15.118:6825/1034318850] conn(0x7fb9980ac120 0x7fb9980ae5c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:20.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.756+0000 7fb9b2a8c640 1 -- 172.21.15.87:0/1091643519 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb9980a1190 msgr2=0x7fb9980a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:20.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.757+0000 7fb9b2a8c640 1 --2- 172.21.15.87:0/1091643519 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb9980a1190 0x7fb9980a3650 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4030040 tx=0x7fb9a402ffb0 comp rx=0 tx=0).stop 2024-09-13T17:12:20.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.757+0000 7fb9b2a8c640 1 -- 172.21.15.87:0/1091643519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9ac104160 msgr2=0x7fb9ac19c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:20.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.757+0000 7fb9b2a8c640 1 --2- 172.21.15.87:0/1091643519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9ac104160 0x7fb9ac19c880 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb994009fd0 tx=0x7fb99400b8e0 comp rx=0 tx=0).stop 2024-09-13T17:12:20.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.757+0000 7fb9b1029640 1 -- 172.21.15.87:0/1091643519 reap_dead start 2024-09-13T17:12:20.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.757+0000 7fb9b2a8c640 1 -- 172.21.15.87:0/1091643519 shutdown_connections 2024-09-13T17:12:20.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.757+0000 7fb9b2a8c640 1 -- 172.21.15.87:0/1091643519 >> 172.21.15.87:0/1091643519 conn(0x7fb9ac0fa9a0 msgr2=0x7fb9ac10d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:20.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.757+0000 7fb9b2a8c640 1 -- 172.21.15.87:0/1091643519 shutdown_connections 2024-09-13T17:12:20.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:20.757+0000 7fb9b2a8c640 1 -- 172.21.15.87:0/1091643519 wait complete. 2024-09-13T17:12:21.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:21 smithi087 ceph-mon[30934]: pgmap v307: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-13T17:12:21.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:21 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:12:21.531 INFO:teuthology.orchestra.run.smithi087.stdout:309237645341 2024-09-13T17:12:21.531 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-13T17:12:21.556 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:21 smithi118 ceph-mon[34374]: pgmap v307: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-13T17:12:21.556 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:21 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:12:21.557 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:21 smithi149 ceph-mon[35496]: pgmap v307: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-13T17:12:21.557 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:21 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:12:21.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.731+0000 7efe36442640 1 -- 172.21.15.87:0/1712136565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe30104000 msgr2=0x7efe3010bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:21.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.731+0000 7efe36442640 1 --2- 172.21.15.87:0/1712136565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe30104000 0x7efe3010bb80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7efe28009cd0 tx=0x7efe2802a8e0 comp rx=0 tx=0).stop 2024-09-13T17:12:21.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.731+0000 7efe36442640 1 -- 172.21.15.87:0/1712136565 shutdown_connections 2024-09-13T17:12:21.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.731+0000 7efe36442640 1 --2- 172.21.15.87:0/1712136565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe30104000 0x7efe3010bb80 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:21.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.731+0000 7efe36442640 1 --2- 172.21.15.87:0/1712136565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe300ff880 0x7efe301038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:21.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.731+0000 7efe36442640 1 --2- 172.21.15.87:0/1712136565 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe300feed0 0x7efe300ff2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:21.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.731+0000 7efe36442640 1 -- 172.21.15.87:0/1712136565 >> 172.21.15.87:0/1712136565 conn(0x7efe300fa9b0 msgr2=0x7efe300fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:21.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.731+0000 7efe36442640 1 -- 172.21.15.87:0/1712136565 shutdown_connections 2024-09-13T17:12:21.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.731+0000 7efe36442640 1 -- 172.21.15.87:0/1712136565 wait complete. 2024-09-13T17:12:21.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.732+0000 7efe36442640 1 Processor -- start 2024-09-13T17:12:21.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.732+0000 7efe36442640 1 -- start start 2024-09-13T17:12:21.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.732+0000 7efe36442640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe300feed0 0x7efe301961b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:21.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.732+0000 7efe36442640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe300ff880 0x7efe301966f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:21.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.732+0000 7efe36442640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe30104000 0x7efe3019aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:21.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.732+0000 7efe36442640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3019b0f0 con 0x7efe300feed0 2024-09-13T17:12:21.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.732+0000 7efe36442640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3019b260 con 0x7efe300ff880 2024-09-13T17:12:21.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.732+0000 7efe36442640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3019b3d0 con 0x7efe30104000 2024-09-13T17:12:21.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.732+0000 7efe2ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe300feed0 0x7efe301961b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:21.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.732+0000 7efe2ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe300feed0 0x7efe301961b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52328/0 (socket says 172.21.15.87:52328) 2024-09-13T17:12:21.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.732+0000 7efe2ffff640 1 -- 172.21.15.87:0/3279344781 learned_addr learned my addr 172.21.15.87:0/3279344781 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:12:21.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.732+0000 7efe349df640 1 --2- 172.21.15.87:0/3279344781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe30104000 0x7efe3019aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:21.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.732+0000 7efe2f7fe640 1 --2- 172.21.15.87:0/3279344781 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe300ff880 0x7efe301966f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:21.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.733+0000 7efe2ffff640 1 -- 172.21.15.87:0/3279344781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe30104000 msgr2=0x7efe3019aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:21.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.733+0000 7efe2ffff640 1 --2- 172.21.15.87:0/3279344781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe30104000 0x7efe3019aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:21.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.733+0000 7efe2ffff640 1 -- 172.21.15.87:0/3279344781 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe300ff880 msgr2=0x7efe301966f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:21.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.733+0000 7efe2ffff640 1 --2- 172.21.15.87:0/3279344781 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe300ff880 0x7efe301966f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:21.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.733+0000 7efe2ffff640 1 -- 172.21.15.87:0/3279344781 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe28009900 con 0x7efe300feed0 2024-09-13T17:12:21.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.733+0000 7efe2f7fe640 1 --2- 172.21.15.87:0/3279344781 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe300ff880 0x7efe301966f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:12:21.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.733+0000 7efe2ffff640 1 --2- 172.21.15.87:0/3279344781 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe300feed0 0x7efe301961b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7efe2000d950 tx=0x7efe2000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:21.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.733+0000 7efe2d7fa640 1 -- 172.21.15.87:0/3279344781 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe20009c30 con 0x7efe300feed0 2024-09-13T17:12:21.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.733+0000 7efe2d7fa640 1 -- 172.21.15.87:0/3279344781 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efe20009d90 con 0x7efe300feed0 2024-09-13T17:12:21.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.733+0000 7efe36442640 1 -- 172.21.15.87:0/3279344781 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe3019b6b0 con 0x7efe300feed0 2024-09-13T17:12:21.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.733+0000 7efe2d7fa640 1 -- 172.21.15.87:0/3279344781 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2000f6b0 con 0x7efe300feed0 2024-09-13T17:12:21.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.733+0000 7efe36442640 1 -- 172.21.15.87:0/3279344781 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe301a2f70 con 0x7efe300feed0 2024-09-13T17:12:21.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.734+0000 7efe16ffd640 1 -- 172.21.15.87:0/3279344781 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efe10000fc0 con 0x7efe300feed0 2024-09-13T17:12:21.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.735+0000 7efe2d7fa640 1 -- 172.21.15.87:0/3279344781 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7efe20010aa0 con 0x7efe300feed0 2024-09-13T17:12:21.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.736+0000 7efe2d7fa640 1 --2- 172.21.15.87:0/3279344781 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7efe180a1110 0x7efe180a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:21.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.736+0000 7efe2d7fa640 1 -- 172.21.15.87:0/3279344781 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8978+0+0 (secure 0 0 0) 0x7efe200cce30 con 0x7efe300feed0 2024-09-13T17:12:21.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.736+0000 7efe2f7fe640 1 --2- 172.21.15.87:0/3279344781 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7efe180a1110 0x7efe180a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:21.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.736+0000 7efe2d7fa640 1 --2- 172.21.15.87:0/3279344781 >> [v2:172.21.15.149:6816/1558675380,v1:172.21.15.149:6817/1558675380] conn(0x7efe180ac0a0 0x7efe180ae540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:21.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.736+0000 7efe2d7fa640 1 -- 172.21.15.87:0/3279344781 --> [v2:172.21.15.149:6816/1558675380,v1:172.21.15.149:6817/1558675380] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efe180aec10 con 0x7efe180ac0a0 2024-09-13T17:12:21.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.736+0000 7efe2d7fa640 1 -- 172.21.15.87:0/3279344781 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe200cd240 con 0x7efe300feed0 2024-09-13T17:12:21.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.736+0000 7efe2f7fe640 1 --2- 172.21.15.87:0/3279344781 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7efe180a1110 0x7efe180a35d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efe30197760 tx=0x7efe24005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:21.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.736+0000 7efe349df640 1 --2- 172.21.15.87:0/3279344781 >> [v2:172.21.15.149:6816/1558675380,v1:172.21.15.149:6817/1558675380] conn(0x7efe180ac0a0 0x7efe180ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:21.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.737+0000 7efe349df640 1 --2- 172.21.15.87:0/3279344781 >> [v2:172.21.15.149:6816/1558675380,v1:172.21.15.149:6817/1558675380] conn(0x7efe180ac0a0 0x7efe180ae540 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:21.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.738+0000 7efe2d7fa640 1 -- 172.21.15.87:0/3279344781 <== osd.8 v2:172.21.15.149:6816/1558675380 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7efe180aec10 con 0x7efe180ac0a0 2024-09-13T17:12:21.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.751+0000 7efe16ffd640 1 -- 172.21.15.87:0/3279344781 --> [v2:172.21.15.149:6816/1558675380,v1:172.21.15.149:6817/1558675380] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efe10002cb0 con 0x7efe180ac0a0 2024-09-13T17:12:21.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.751+0000 7efe2d7fa640 1 -- 172.21.15.87:0/3279344781 <== osd.8 v2:172.21.15.149:6816/1558675380 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7efe10002cb0 con 0x7efe180ac0a0 2024-09-13T17:12:21.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.752+0000 7efe16ffd640 1 -- 172.21.15.87:0/3279344781 >> [v2:172.21.15.149:6816/1558675380,v1:172.21.15.149:6817/1558675380] conn(0x7efe180ac0a0 msgr2=0x7efe180ae540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:21.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.752+0000 7efe16ffd640 1 --2- 172.21.15.87:0/3279344781 >> [v2:172.21.15.149:6816/1558675380,v1:172.21.15.149:6817/1558675380] conn(0x7efe180ac0a0 0x7efe180ae540 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:21.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.752+0000 7efe16ffd640 1 -- 172.21.15.87:0/3279344781 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7efe180a1110 msgr2=0x7efe180a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:21.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.752+0000 7efe16ffd640 1 --2- 172.21.15.87:0/3279344781 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7efe180a1110 0x7efe180a35d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efe30197760 tx=0x7efe24005f90 comp rx=0 tx=0).stop 2024-09-13T17:12:21.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.752+0000 7efe16ffd640 1 -- 172.21.15.87:0/3279344781 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe300feed0 msgr2=0x7efe301961b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:21.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.752+0000 7efe16ffd640 1 --2- 172.21.15.87:0/3279344781 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe300feed0 0x7efe301961b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7efe2000d950 tx=0x7efe2000de10 comp rx=0 tx=0).stop 2024-09-13T17:12:21.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.752+0000 7efe349df640 1 -- 172.21.15.87:0/3279344781 reap_dead start 2024-09-13T17:12:21.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.752+0000 7efe16ffd640 1 -- 172.21.15.87:0/3279344781 shutdown_connections 2024-09-13T17:12:21.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.752+0000 7efe16ffd640 1 -- 172.21.15.87:0/3279344781 >> 172.21.15.87:0/3279344781 conn(0x7efe300fa9b0 msgr2=0x7efe300fbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:21.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.752+0000 7efe16ffd640 1 -- 172.21.15.87:0/3279344781 shutdown_connections 2024-09-13T17:12:21.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:21.752+0000 7efe16ffd640 1 -- 172.21.15.87:0/3279344781 wait complete. 2024-09-13T17:12:22.494 INFO:teuthology.orchestra.run.smithi087.stdout:253403070503 2024-09-13T17:12:22.494 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-13T17:12:23.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:23 smithi087 ceph-mon[30934]: pgmap v308: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-13T17:12:23.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:23 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:12:23.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:23 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:12:23.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:23 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:12:23.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:23 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:12:23.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:23 smithi149 ceph-mon[35496]: pgmap v308: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-13T17:12:23.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:23 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:12:23.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:23 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:12:23.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:23 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:12:23.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:23 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:12:23.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:23 smithi118 ceph-mon[34374]: pgmap v308: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-13T17:12:23.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:23 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:12:23.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:23 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:12:23.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:23 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:12:23.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:23 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:12:23.731 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:12:23.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.905+0000 7ffadad7f640 1 -- 172.21.15.87:0/3415918262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffad40ff880 msgr2=0x7ffad41038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:23.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.905+0000 7ffadad7f640 1 --2- 172.21.15.87:0/3415918262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffad40ff880 0x7ffad41038d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ffac0009930 tx=0x7ffac002a420 comp rx=0 tx=0).stop 2024-09-13T17:12:23.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.905+0000 7ffadad7f640 1 -- 172.21.15.87:0/3415918262 shutdown_connections 2024-09-13T17:12:23.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.905+0000 7ffadad7f640 1 --2- 172.21.15.87:0/3415918262 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffad4104000 0x7ffad410bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:23.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.905+0000 7ffadad7f640 1 --2- 172.21.15.87:0/3415918262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffad40ff880 0x7ffad41038d0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:23.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.905+0000 7ffadad7f640 1 --2- 172.21.15.87:0/3415918262 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffad40feed0 0x7ffad40ff2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:23.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.905+0000 7ffadad7f640 1 -- 172.21.15.87:0/3415918262 >> 172.21.15.87:0/3415918262 conn(0x7ffad40fa9b0 msgr2=0x7ffad40fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:23.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.905+0000 7ffadad7f640 1 -- 172.21.15.87:0/3415918262 shutdown_connections 2024-09-13T17:12:23.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.905+0000 7ffadad7f640 1 -- 172.21.15.87:0/3415918262 wait complete. 2024-09-13T17:12:23.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.906+0000 7ffadad7f640 1 Processor -- start 2024-09-13T17:12:23.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.906+0000 7ffadad7f640 1 -- start start 2024-09-13T17:12:23.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.906+0000 7ffadad7f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffad40feed0 0x7ffad4197000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:23.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.906+0000 7ffadad7f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffad40ff880 0x7ffad4197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:23.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.906+0000 7ffadad7f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffad4104000 0x7ffad41a2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:23.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.906+0000 7ffadad7f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad4197de0 con 0x7ffad40ff880 2024-09-13T17:12:23.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.906+0000 7ffadad7f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad41a25c0 con 0x7ffad40feed0 2024-09-13T17:12:23.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.906+0000 7ffadad7f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad41a2700 con 0x7ffad4104000 2024-09-13T17:12:23.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.906+0000 7ffad3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffad40ff880 0x7ffad4197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:23.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.906+0000 7ffad3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffad40ff880 0x7ffad4197540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52344/0 (socket says 172.21.15.87:52344) 2024-09-13T17:12:23.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.906+0000 7ffad3fff640 1 -- 172.21.15.87:0/1371703855 learned_addr learned my addr 172.21.15.87:0/1371703855 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:12:23.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.906+0000 7ffad8b1b640 1 --2- 172.21.15.87:0/1371703855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffad40feed0 0x7ffad4197000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:23.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.906+0000 7ffad3fff640 1 -- 172.21.15.87:0/1371703855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffad4104000 msgr2=0x7ffad41a2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:23.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.906+0000 7ffad3fff640 1 --2- 172.21.15.87:0/1371703855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffad4104000 0x7ffad41a2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:23.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.906+0000 7ffad3fff640 1 -- 172.21.15.87:0/1371703855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffad40feed0 msgr2=0x7ffad4197000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:23.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.906+0000 7ffad3fff640 1 --2- 172.21.15.87:0/1371703855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffad40feed0 0x7ffad4197000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:23.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.906+0000 7ffad3fff640 1 -- 172.21.15.87:0/1371703855 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac0009560 con 0x7ffad40ff880 2024-09-13T17:12:23.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.907+0000 7ffad3fff640 1 --2- 172.21.15.87:0/1371703855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffad40ff880 0x7ffad4197540 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ffac0005ab0 tx=0x7ffac0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:23.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.907+0000 7ffad1ffb640 1 -- 172.21.15.87:0/1371703855 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac0031a30 con 0x7ffad40ff880 2024-09-13T17:12:23.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.907+0000 7ffad1ffb640 1 -- 172.21.15.87:0/1371703855 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffac0031b90 con 0x7ffad40ff880 2024-09-13T17:12:23.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.907+0000 7ffadad7f640 1 -- 172.21.15.87:0/1371703855 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad41a2950 con 0x7ffad40ff880 2024-09-13T17:12:23.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.907+0000 7ffad1ffb640 1 -- 172.21.15.87:0/1371703855 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac00322b0 con 0x7ffad40ff880 2024-09-13T17:12:23.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.907+0000 7ffadad7f640 1 -- 172.21.15.87:0/1371703855 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad41a2e40 con 0x7ffad40ff880 2024-09-13T17:12:23.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.908+0000 7ffadad7f640 1 -- 172.21.15.87:0/1371703855 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffad410ef60 con 0x7ffad40ff880 2024-09-13T17:12:23.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.909+0000 7ffad1ffb640 1 -- 172.21.15.87:0/1371703855 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7ffac0031d00 con 0x7ffad40ff880 2024-09-13T17:12:23.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.910+0000 7ffad1ffb640 1 --2- 172.21.15.87:0/1371703855 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ffac40a1190 0x7ffac40a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:23.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.910+0000 7ffad1ffb640 1 -- 172.21.15.87:0/1371703855 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8978+0+0 (secure 0 0 0) 0x7ffac00edef0 con 0x7ffad40ff880 2024-09-13T17:12:23.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.910+0000 7ffad8b1b640 1 --2- 172.21.15.87:0/1371703855 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ffac40a1190 0x7ffac40a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:23.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.910+0000 7ffad1ffb640 1 --2- 172.21.15.87:0/1371703855 >> [v2:172.21.15.149:6800/2774581686,v1:172.21.15.149:6801/2774581686] conn(0x7ffac40ac120 0x7ffac40ae5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:23.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.910+0000 7ffad1ffb640 1 -- 172.21.15.87:0/1371703855 --> [v2:172.21.15.149:6800/2774581686,v1:172.21.15.149:6801/2774581686] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffac40aec90 con 0x7ffac40ac120 2024-09-13T17:12:23.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.910+0000 7ffad1ffb640 1 -- 172.21.15.87:0/1371703855 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffac00ee300 con 0x7ffad40ff880 2024-09-13T17:12:23.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.911+0000 7ffad931c640 1 --2- 172.21.15.87:0/1371703855 >> [v2:172.21.15.149:6800/2774581686,v1:172.21.15.149:6801/2774581686] conn(0x7ffac40ac120 0x7ffac40ae5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:23.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.911+0000 7ffad8b1b640 1 --2- 172.21.15.87:0/1371703855 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ffac40a1190 0x7ffac40a3650 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ffac800abe0 tx=0x7ffac800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:23.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.911+0000 7ffad931c640 1 --2- 172.21.15.87:0/1371703855 >> [v2:172.21.15.149:6800/2774581686,v1:172.21.15.149:6801/2774581686] conn(0x7ffac40ac120 0x7ffac40ae5c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:23.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.912+0000 7ffad1ffb640 1 -- 172.21.15.87:0/1371703855 <== osd.2 v2:172.21.15.149:6800/2774581686 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ffac40aec90 con 0x7ffac40ac120 2024-09-13T17:12:23.914 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:12:23.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.925+0000 7ffadad7f640 1 -- 172.21.15.87:0/1371703855 --> [v2:172.21.15.149:6800/2774581686,v1:172.21.15.149:6801/2774581686] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ffad4060b30 con 0x7ffac40ac120 2024-09-13T17:12:23.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.926+0000 7ffad1ffb640 1 -- 172.21.15.87:0/1371703855 <== osd.2 v2:172.21.15.149:6800/2774581686 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ffad4060b30 con 0x7ffac40ac120 2024-09-13T17:12:23.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.926+0000 7ffadad7f640 1 -- 172.21.15.87:0/1371703855 >> [v2:172.21.15.149:6800/2774581686,v1:172.21.15.149:6801/2774581686] conn(0x7ffac40ac120 msgr2=0x7ffac40ae5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:23.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.926+0000 7ffadad7f640 1 --2- 172.21.15.87:0/1371703855 >> [v2:172.21.15.149:6800/2774581686,v1:172.21.15.149:6801/2774581686] conn(0x7ffac40ac120 0x7ffac40ae5c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:23.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.926+0000 7ffadad7f640 1 -- 172.21.15.87:0/1371703855 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ffac40a1190 msgr2=0x7ffac40a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:23.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.926+0000 7ffadad7f640 1 --2- 172.21.15.87:0/1371703855 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ffac40a1190 0x7ffac40a3650 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ffac800abe0 tx=0x7ffac800a2d0 comp rx=0 tx=0).stop 2024-09-13T17:12:23.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.926+0000 7ffadad7f640 1 -- 172.21.15.87:0/1371703855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffad40ff880 msgr2=0x7ffad4197540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:23.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.926+0000 7ffadad7f640 1 --2- 172.21.15.87:0/1371703855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffad40ff880 0x7ffad4197540 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ffac0005ab0 tx=0x7ffac0004270 comp rx=0 tx=0).stop 2024-09-13T17:12:23.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.926+0000 7ffad931c640 1 -- 172.21.15.87:0/1371703855 reap_dead start 2024-09-13T17:12:23.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.927+0000 7ffadad7f640 1 -- 172.21.15.87:0/1371703855 shutdown_connections 2024-09-13T17:12:23.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.927+0000 7ffadad7f640 1 -- 172.21.15.87:0/1371703855 >> 172.21.15.87:0/1371703855 conn(0x7ffad40fa9b0 msgr2=0x7ffad40fbd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:23.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.927+0000 7ffadad7f640 1 -- 172.21.15.87:0/1371703855 shutdown_connections 2024-09-13T17:12:23.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:23.927+0000 7ffadad7f640 1 -- 172.21.15.87:0/1371703855 wait complete. 2024-09-13T17:12:25.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:25 smithi087 ceph-mon[30934]: pgmap v309: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T17:12:25.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:25 smithi149 ceph-mon[35496]: pgmap v309: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T17:12:25.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:25 smithi118 ceph-mon[34374]: pgmap v309: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T17:12:27.313 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:27 smithi087 ceph-mon[30934]: pgmap v310: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-13T17:12:27.338 INFO:teuthology.orchestra.run.smithi087.stdout:77309411396 2024-09-13T17:12:27.338 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-13T17:12:27.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:27 smithi149 ceph-mon[35496]: pgmap v310: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-13T17:12:27.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:27 smithi118 ceph-mon[34374]: pgmap v310: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-13T17:12:28.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.366+0000 7f80e8e24640 1 -- 172.21.15.87:0/3152393914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80e4100990 msgr2=0x7f80e41049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:28.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.366+0000 7f80e8e24640 1 --2- 172.21.15.87:0/3152393914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80e4100990 0x7f80e41049e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f80cc009930 tx=0x7f80cc02a420 comp rx=0 tx=0).stop 2024-09-13T17:12:28.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.366+0000 7f80e8e24640 1 -- 172.21.15.87:0/3152393914 shutdown_connections 2024-09-13T17:12:28.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.366+0000 7f80e8e24640 1 --2- 172.21.15.87:0/3152393914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80e4105110 0x7f80e410cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:28.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.366+0000 7f80e8e24640 1 --2- 172.21.15.87:0/3152393914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80e4100990 0x7f80e41049e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:28.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.366+0000 7f80e8e24640 1 --2- 172.21.15.87:0/3152393914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80e40fffe0 0x7f80e41003c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:28.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.366+0000 7f80e8e24640 1 -- 172.21.15.87:0/3152393914 >> 172.21.15.87:0/3152393914 conn(0x7f80e40fbae0 msgr2=0x7f80e40fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:28.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.366+0000 7f80e8e24640 1 -- 172.21.15.87:0/3152393914 shutdown_connections 2024-09-13T17:12:28.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.366+0000 7f80e8e24640 1 -- 172.21.15.87:0/3152393914 wait complete. 2024-09-13T17:12:28.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.366+0000 7f80e8e24640 1 Processor -- start 2024-09-13T17:12:28.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.367+0000 7f80e8e24640 1 -- start start 2024-09-13T17:12:28.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.367+0000 7f80e8e24640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80e40fffe0 0x7f80e4196320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:28.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.367+0000 7f80e8e24640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80e4100990 0x7f80e4196860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:28.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.367+0000 7f80e8e24640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80e4105110 0x7f80e419ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:28.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.367+0000 7f80e8e24640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e419b260 con 0x7f80e40fffe0 2024-09-13T17:12:28.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.367+0000 7f80e8e24640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e419b3d0 con 0x7f80e4105110 2024-09-13T17:12:28.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.367+0000 7f80e8e24640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e419b540 con 0x7f80e4100990 2024-09-13T17:12:28.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.367+0000 7f80e259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80e40fffe0 0x7f80e4196320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:28.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.367+0000 7f80e259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80e40fffe0 0x7f80e4196320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52386/0 (socket says 172.21.15.87:52386) 2024-09-13T17:12:28.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.367+0000 7f80e259c640 1 -- 172.21.15.87:0/1111491685 learned_addr learned my addr 172.21.15.87:0/1111491685 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:12:28.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.367+0000 7f80dbfff640 1 --2- 172.21.15.87:0/1111491685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80e4100990 0x7f80e4196860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:28.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.367+0000 7f80e2d9d640 1 --2- 172.21.15.87:0/1111491685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80e4105110 0x7f80e419ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:28.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.367+0000 7f80e259c640 1 -- 172.21.15.87:0/1111491685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80e4100990 msgr2=0x7f80e4196860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:28.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.367+0000 7f80e259c640 1 --2- 172.21.15.87:0/1111491685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80e4100990 0x7f80e4196860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:28.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.367+0000 7f80e259c640 1 -- 172.21.15.87:0/1111491685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80e4105110 msgr2=0x7f80e419ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:28.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.367+0000 7f80e259c640 1 --2- 172.21.15.87:0/1111491685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80e4105110 0x7f80e419ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:28.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.367+0000 7f80e259c640 1 -- 172.21.15.87:0/1111491685 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80cc009560 con 0x7f80e40fffe0 2024-09-13T17:12:28.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.367+0000 7f80e2d9d640 1 --2- 172.21.15.87:0/1111491685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80e4105110 0x7f80e419ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:12:28.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.367+0000 7f80e259c640 1 --2- 172.21.15.87:0/1111491685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80e40fffe0 0x7f80e4196320 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f80d400d950 tx=0x7f80d400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:28.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.367+0000 7f80db7fe640 1 -- 172.21.15.87:0/1111491685 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d4009a30 con 0x7f80e40fffe0 2024-09-13T17:12:28.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.367+0000 7f80e8e24640 1 -- 172.21.15.87:0/1111491685 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e419b820 con 0x7f80e40fffe0 2024-09-13T17:12:28.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.367+0000 7f80db7fe640 1 -- 172.21.15.87:0/1111491685 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f80d40044d0 con 0x7f80e40fffe0 2024-09-13T17:12:28.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.367+0000 7f80db7fe640 1 -- 172.21.15.87:0/1111491685 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d40047a0 con 0x7f80e40fffe0 2024-09-13T17:12:28.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.368+0000 7f80e8e24640 1 -- 172.21.15.87:0/1111491685 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e41a30e0 con 0x7f80e40fffe0 2024-09-13T17:12:28.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.368+0000 7f80e8e24640 1 -- 172.21.15.87:0/1111491685 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f80e410fff0 con 0x7f80e40fffe0 2024-09-13T17:12:28.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.370+0000 7f80db7fe640 1 -- 172.21.15.87:0/1111491685 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f80d4009b90 con 0x7f80e40fffe0 2024-09-13T17:12:28.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.370+0000 7f80db7fe640 1 --2- 172.21.15.87:0/1111491685 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f80d00a1110 0x7f80d00a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:28.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.370+0000 7f80dbfff640 1 --2- 172.21.15.87:0/1111491685 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f80d00a1110 0x7f80d00a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:28.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.370+0000 7f80db7fe640 1 -- 172.21.15.87:0/1111491685 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8978+0+0 (secure 0 0 0) 0x7f80d40cce30 con 0x7f80e40fffe0 2024-09-13T17:12:28.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.371+0000 7f80db7fe640 1 --2- 172.21.15.87:0/1111491685 >> [v2:172.21.15.118:6816/1690268990,v1:172.21.15.118:6817/1690268990] conn(0x7f80d00ac0a0 0x7f80d00ae540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:28.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.371+0000 7f80db7fe640 1 -- 172.21.15.87:0/1111491685 --> [v2:172.21.15.118:6816/1690268990,v1:172.21.15.118:6817/1690268990] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f80d00aec10 con 0x7f80d00ac0a0 2024-09-13T17:12:28.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.371+0000 7f80db7fe640 1 -- 172.21.15.87:0/1111491685 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80d40cd240 con 0x7f80e40fffe0 2024-09-13T17:12:28.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.371+0000 7f80dbfff640 1 --2- 172.21.15.87:0/1111491685 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f80d00a1110 0x7f80d00a35d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f80cc005ab0 tx=0x7f80cc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:28.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.371+0000 7f80e2d9d640 1 --2- 172.21.15.87:0/1111491685 >> [v2:172.21.15.118:6816/1690268990,v1:172.21.15.118:6817/1690268990] conn(0x7f80d00ac0a0 0x7f80d00ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:28.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.371+0000 7f80e2d9d640 1 --2- 172.21.15.87:0/1111491685 >> [v2:172.21.15.118:6816/1690268990,v1:172.21.15.118:6817/1690268990] conn(0x7f80d00ac0a0 0x7f80d00ae540 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:28.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.372+0000 7f80db7fe640 1 -- 172.21.15.87:0/1111491685 <== osd.7 v2:172.21.15.118:6816/1690268990 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f80d00aec10 con 0x7f80d00ac0a0 2024-09-13T17:12:28.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.385+0000 7f80e8e24640 1 -- 172.21.15.87:0/1111491685 --> [v2:172.21.15.118:6816/1690268990,v1:172.21.15.118:6817/1690268990] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f80e41014c0 con 0x7f80d00ac0a0 2024-09-13T17:12:28.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.386+0000 7f80db7fe640 1 -- 172.21.15.87:0/1111491685 <== osd.7 v2:172.21.15.118:6816/1690268990 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f80e41014c0 con 0x7f80d00ac0a0 2024-09-13T17:12:28.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.386+0000 7f80e8e24640 1 -- 172.21.15.87:0/1111491685 >> [v2:172.21.15.118:6816/1690268990,v1:172.21.15.118:6817/1690268990] conn(0x7f80d00ac0a0 msgr2=0x7f80d00ae540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:28.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.386+0000 7f80e8e24640 1 --2- 172.21.15.87:0/1111491685 >> [v2:172.21.15.118:6816/1690268990,v1:172.21.15.118:6817/1690268990] conn(0x7f80d00ac0a0 0x7f80d00ae540 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:28.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.386+0000 7f80e8e24640 1 -- 172.21.15.87:0/1111491685 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f80d00a1110 msgr2=0x7f80d00a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:28.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.386+0000 7f80e8e24640 1 --2- 172.21.15.87:0/1111491685 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f80d00a1110 0x7f80d00a35d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f80cc005ab0 tx=0x7f80cc005a20 comp rx=0 tx=0).stop 2024-09-13T17:12:28.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.386+0000 7f80e8e24640 1 -- 172.21.15.87:0/1111491685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80e40fffe0 msgr2=0x7f80e4196320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:28.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.386+0000 7f80e8e24640 1 --2- 172.21.15.87:0/1111491685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80e40fffe0 0x7f80e4196320 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f80d400d950 tx=0x7f80d400de10 comp rx=0 tx=0).stop 2024-09-13T17:12:28.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.386+0000 7f80e2d9d640 1 -- 172.21.15.87:0/1111491685 reap_dead start 2024-09-13T17:12:28.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.386+0000 7f80e8e24640 1 -- 172.21.15.87:0/1111491685 shutdown_connections 2024-09-13T17:12:28.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.387+0000 7f80e8e24640 1 -- 172.21.15.87:0/1111491685 >> 172.21.15.87:0/1111491685 conn(0x7f80e40fbae0 msgr2=0x7f80e40fcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:28.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.387+0000 7f80e8e24640 1 -- 172.21.15.87:0/1111491685 shutdown_connections 2024-09-13T17:12:28.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.387+0000 7f80e8e24640 1 -- 172.21.15.87:0/1111491685 wait complete. 2024-09-13T17:12:28.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.041+0000 7f9860c21640 1 -- 172.21.15.87:0/678831944 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f985c103db0 msgr2=0x7f985c104190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:28.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.041+0000 7f9860c21640 1 --2- 172.21.15.87:0/678831944 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f985c103db0 0x7f985c104190 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f984c009900 tx=0x7f984c02a410 comp rx=0 tx=0).stop 2024-09-13T17:12:28.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.041+0000 7f9860c21640 1 -- 172.21.15.87:0/678831944 shutdown_connections 2024-09-13T17:12:28.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.041+0000 7f9860c21640 1 --2- 172.21.15.87:0/678831944 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f985c1001f0 0x7f985c10ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:28.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.041+0000 7f9860c21640 1 --2- 172.21.15.87:0/678831944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f985c0ff870 0x7f985c0ffcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:28.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.041+0000 7f9860c21640 1 --2- 172.21.15.87:0/678831944 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f985c103db0 0x7f985c104190 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:28.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.041+0000 7f9860c21640 1 -- 172.21.15.87:0/678831944 >> 172.21.15.87:0/678831944 conn(0x7f985c0f9ce0 msgr2=0x7f985c0fc100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:28.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.041+0000 7f9860c21640 1 -- 172.21.15.87:0/678831944 shutdown_connections 2024-09-13T17:12:28.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.041+0000 7f9860c21640 1 -- 172.21.15.87:0/678831944 wait complete. 2024-09-13T17:12:28.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.042+0000 7f9860c21640 1 Processor -- start 2024-09-13T17:12:28.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.042+0000 7f9860c21640 1 -- start start 2024-09-13T17:12:28.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.042+0000 7f9860c21640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f985c0ff870 0x7f985c196230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:28.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.042+0000 7f9860c21640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f985c1001f0 0x7f985c196770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:28.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.042+0000 7f9860c21640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f985c103db0 0x7f985c19ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:28.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.042+0000 7f9860c21640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985c19b120 con 0x7f985c1001f0 2024-09-13T17:12:28.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.042+0000 7f9860c21640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985c19b290 con 0x7f985c0ff870 2024-09-13T17:12:28.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.042+0000 7f9860c21640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985c19b400 con 0x7f985c103db0 2024-09-13T17:12:28.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.042+0000 7f9853fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f985c1001f0 0x7f985c196770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:28.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.043+0000 7f9853fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f985c1001f0 0x7f985c196770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52362/0 (socket says 172.21.15.87:52362) 2024-09-13T17:12:28.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.043+0000 7f9853fff640 1 -- 172.21.15.87:0/2162076733 learned_addr learned my addr 172.21.15.87:0/2162076733 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:12:28.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.043+0000 7f985ad9d640 1 --2- 172.21.15.87:0/2162076733 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f985c103db0 0x7f985c19ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:28.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.043+0000 7f985a59c640 1 --2- 172.21.15.87:0/2162076733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f985c0ff870 0x7f985c196230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:28.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.043+0000 7f9853fff640 1 -- 172.21.15.87:0/2162076733 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f985c103db0 msgr2=0x7f985c19ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:28.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.043+0000 7f9853fff640 1 --2- 172.21.15.87:0/2162076733 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f985c103db0 0x7f985c19ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:28.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.043+0000 7f9853fff640 1 -- 172.21.15.87:0/2162076733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f985c0ff870 msgr2=0x7f985c196230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:28.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.043+0000 7f9853fff640 1 --2- 172.21.15.87:0/2162076733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f985c0ff870 0x7f985c196230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:28.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.043+0000 7f9853fff640 1 -- 172.21.15.87:0/2162076733 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f984c009560 con 0x7f985c1001f0 2024-09-13T17:12:28.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.043+0000 7f985a59c640 1 --2- 172.21.15.87:0/2162076733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f985c0ff870 0x7f985c196230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:12:28.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.043+0000 7f9853fff640 1 --2- 172.21.15.87:0/2162076733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f985c1001f0 0x7f985c196770 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f984400c890 tx=0x7f984400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:28.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.043+0000 7f98537fe640 1 -- 172.21.15.87:0/2162076733 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9844004220 con 0x7f985c1001f0 2024-09-13T17:12:28.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.043+0000 7f98537fe640 1 -- 172.21.15.87:0/2162076733 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9844007e60 con 0x7f985c1001f0 2024-09-13T17:12:28.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.043+0000 7f9860c21640 1 -- 172.21.15.87:0/2162076733 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f985c19b6e0 con 0x7f985c1001f0 2024-09-13T17:12:28.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.043+0000 7f98537fe640 1 -- 172.21.15.87:0/2162076733 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9844004a00 con 0x7f985c1001f0 2024-09-13T17:12:28.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.043+0000 7f9860c21640 1 -- 172.21.15.87:0/2162076733 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f985c1a2fa0 con 0x7f985c1001f0 2024-09-13T17:12:28.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.044+0000 7f9860c21640 1 -- 172.21.15.87:0/2162076733 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f985c10ef90 con 0x7f985c1001f0 2024-09-13T17:12:28.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.045+0000 7f98537fe640 1 -- 172.21.15.87:0/2162076733 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f98440079b0 con 0x7f985c1001f0 2024-09-13T17:12:28.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.046+0000 7f98537fe640 1 --2- 172.21.15.87:0/2162076733 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f98480a1110 0x7f98480a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:28.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.046+0000 7f985a59c640 1 --2- 172.21.15.87:0/2162076733 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f98480a1110 0x7f98480a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:28.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.046+0000 7f98537fe640 1 -- 172.21.15.87:0/2162076733 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8978+0+0 (secure 0 0 0) 0x7f98440cca60 con 0x7f985c1001f0 2024-09-13T17:12:28.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.046+0000 7f98537fe640 1 --2- 172.21.15.87:0/2162076733 >> [v2:172.21.15.149:6808/3468867124,v1:172.21.15.149:6809/3468867124] conn(0x7f98480ac0a0 0x7f98480ae540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:28.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.046+0000 7f98537fe640 1 -- 172.21.15.87:0/2162076733 --> [v2:172.21.15.149:6808/3468867124,v1:172.21.15.149:6809/3468867124] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f98480aec10 con 0x7f98480ac0a0 2024-09-13T17:12:28.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.046+0000 7f98537fe640 1 -- 172.21.15.87:0/2162076733 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98440d12c0 con 0x7f985c1001f0 2024-09-13T17:12:28.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.046+0000 7f985a59c640 1 --2- 172.21.15.87:0/2162076733 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f98480a1110 0x7f98480a35d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f984c006010 tx=0x7f984c032a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:28.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.046+0000 7f985ad9d640 1 --2- 172.21.15.87:0/2162076733 >> [v2:172.21.15.149:6808/3468867124,v1:172.21.15.149:6809/3468867124] conn(0x7f98480ac0a0 0x7f98480ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:28.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.047+0000 7f985ad9d640 1 --2- 172.21.15.87:0/2162076733 >> [v2:172.21.15.149:6808/3468867124,v1:172.21.15.149:6809/3468867124] conn(0x7f98480ac0a0 0x7f98480ae540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:28.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.048+0000 7f98537fe640 1 -- 172.21.15.87:0/2162076733 <== osd.5 v2:172.21.15.149:6808/3468867124 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f98480aec10 con 0x7f98480ac0a0 2024-09-13T17:12:28.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.061+0000 7f9860c21640 1 -- 172.21.15.87:0/2162076733 --> [v2:172.21.15.149:6808/3468867124,v1:172.21.15.149:6809/3468867124] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f985c060bb0 con 0x7f98480ac0a0 2024-09-13T17:12:28.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.061+0000 7f98537fe640 1 -- 172.21.15.87:0/2162076733 <== osd.5 v2:172.21.15.149:6808/3468867124 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f985c060bb0 con 0x7f98480ac0a0 2024-09-13T17:12:28.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.061+0000 7f9860c21640 1 -- 172.21.15.87:0/2162076733 >> [v2:172.21.15.149:6808/3468867124,v1:172.21.15.149:6809/3468867124] conn(0x7f98480ac0a0 msgr2=0x7f98480ae540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:28.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.062+0000 7f9860c21640 1 --2- 172.21.15.87:0/2162076733 >> [v2:172.21.15.149:6808/3468867124,v1:172.21.15.149:6809/3468867124] conn(0x7f98480ac0a0 0x7f98480ae540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:28.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.062+0000 7f9860c21640 1 -- 172.21.15.87:0/2162076733 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f98480a1110 msgr2=0x7f98480a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:28.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.062+0000 7f9860c21640 1 --2- 172.21.15.87:0/2162076733 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f98480a1110 0x7f98480a35d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f984c006010 tx=0x7f984c032a40 comp rx=0 tx=0).stop 2024-09-13T17:12:28.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.062+0000 7f9860c21640 1 -- 172.21.15.87:0/2162076733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f985c1001f0 msgr2=0x7f985c196770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:28.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.062+0000 7f9860c21640 1 --2- 172.21.15.87:0/2162076733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f985c1001f0 0x7f985c196770 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f984400c890 tx=0x7f984400cd50 comp rx=0 tx=0).stop 2024-09-13T17:12:28.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.062+0000 7f985ad9d640 1 -- 172.21.15.87:0/2162076733 reap_dead start 2024-09-13T17:12:28.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.062+0000 7f9860c21640 1 -- 172.21.15.87:0/2162076733 shutdown_connections 2024-09-13T17:12:28.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.062+0000 7f9860c21640 1 -- 172.21.15.87:0/2162076733 >> 172.21.15.87:0/2162076733 conn(0x7f985c0f9ce0 msgr2=0x7f985c0fef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:28.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.062+0000 7f9860c21640 1 -- 172.21.15.87:0/2162076733 shutdown_connections 2024-09-13T17:12:28.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:28.062+0000 7f9860c21640 1 -- 172.21.15.87:0/2162076733 wait complete. 2024-09-13T17:12:29.100 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:12:29.447 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:29 smithi087 ceph-mon[30934]: pgmap v311: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T17:12:29.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:29 smithi149 ceph-mon[35496]: pgmap v311: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T17:12:29.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:29 smithi118 ceph-mon[34374]: pgmap v311: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T17:12:29.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.669+0000 7fd13056f640 1 -- 172.21.15.87:0/102421382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1280feed0 msgr2=0x7fd1280ff2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:29.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.669+0000 7fd13056f640 1 --2- 172.21.15.87:0/102421382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1280feed0 0x7fd1280ff2b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd120009cd0 tx=0x7fd12002a8e0 comp rx=0 tx=0).stop 2024-09-13T17:12:29.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.669+0000 7fd13056f640 1 -- 172.21.15.87:0/102421382 shutdown_connections 2024-09-13T17:12:29.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.669+0000 7fd13056f640 1 --2- 172.21.15.87:0/102421382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd128104000 0x7fd12810bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:29.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.669+0000 7fd13056f640 1 --2- 172.21.15.87:0/102421382 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1280ff880 0x7fd1281038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:29.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.669+0000 7fd13056f640 1 --2- 172.21.15.87:0/102421382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1280feed0 0x7fd1280ff2b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:29.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.669+0000 7fd13056f640 1 -- 172.21.15.87:0/102421382 >> 172.21.15.87:0/102421382 conn(0x7fd1280fa9b0 msgr2=0x7fd1280fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:29.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.669+0000 7fd13056f640 1 -- 172.21.15.87:0/102421382 shutdown_connections 2024-09-13T17:12:29.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.669+0000 7fd13056f640 1 -- 172.21.15.87:0/102421382 wait complete. 2024-09-13T17:12:29.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.669+0000 7fd13056f640 1 Processor -- start 2024-09-13T17:12:29.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.669+0000 7fd13056f640 1 -- start start 2024-09-13T17:12:29.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.670+0000 7fd13056f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1280feed0 0x7fd128195190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:29.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.670+0000 7fd13056f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1280ff880 0x7fd1281956d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:29.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.670+0000 7fd13056f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd128104000 0x7fd128199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:29.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.670+0000 7fd13056f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12819a0d0 con 0x7fd128104000 2024-09-13T17:12:29.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.670+0000 7fd13056f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12819a240 con 0x7fd1280feed0 2024-09-13T17:12:29.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.670+0000 7fd13056f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12819a3b0 con 0x7fd1280ff880 2024-09-13T17:12:29.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.670+0000 7fd12eb0c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd128104000 0x7fd128199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:29.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.670+0000 7fd12eb0c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd128104000 0x7fd128199ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40750/0 (socket says 172.21.15.87:40750) 2024-09-13T17:12:29.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.670+0000 7fd12eb0c640 1 -- 172.21.15.87:0/1267370244 learned_addr learned my addr 172.21.15.87:0/1267370244 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:12:29.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.670+0000 7fd12e30b640 1 --2- 172.21.15.87:0/1267370244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1280feed0 0x7fd128195190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:29.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.670+0000 7fd12db0a640 1 --2- 172.21.15.87:0/1267370244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1280ff880 0x7fd1281956d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:29.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.670+0000 7fd12eb0c640 1 -- 172.21.15.87:0/1267370244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1280ff880 msgr2=0x7fd1281956d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:29.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.670+0000 7fd12eb0c640 1 --2- 172.21.15.87:0/1267370244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1280ff880 0x7fd1281956d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:29.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.670+0000 7fd12eb0c640 1 -- 172.21.15.87:0/1267370244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1280feed0 msgr2=0x7fd128195190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:29.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.670+0000 7fd12eb0c640 1 --2- 172.21.15.87:0/1267370244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1280feed0 0x7fd128195190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:29.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.670+0000 7fd12eb0c640 1 -- 172.21.15.87:0/1267370244 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd120009900 con 0x7fd128104000 2024-09-13T17:12:29.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.670+0000 7fd12eb0c640 1 --2- 172.21.15.87:0/1267370244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd128104000 0x7fd128199ad0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd11800c970 tx=0x7fd11800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:29.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.670+0000 7fd1277fe640 1 -- 172.21.15.87:0/1267370244 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd118007bb0 con 0x7fd128104000 2024-09-13T17:12:29.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.670+0000 7fd1277fe640 1 -- 172.21.15.87:0/1267370244 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd118007d10 con 0x7fd128104000 2024-09-13T17:12:29.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.670+0000 7fd13056f640 1 -- 172.21.15.87:0/1267370244 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd12819a690 con 0x7fd128104000 2024-09-13T17:12:29.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.670+0000 7fd1277fe640 1 -- 172.21.15.87:0/1267370244 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd118004e40 con 0x7fd128104000 2024-09-13T17:12:29.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.670+0000 7fd13056f640 1 -- 172.21.15.87:0/1267370244 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1281a1f50 con 0x7fd128104000 2024-09-13T17:12:29.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.671+0000 7fd13056f640 1 -- 172.21.15.87:0/1267370244 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd12810ef20 con 0x7fd128104000 2024-09-13T17:12:29.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.673+0000 7fd1277fe640 1 -- 172.21.15.87:0/1267370244 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fd118005000 con 0x7fd128104000 2024-09-13T17:12:29.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.673+0000 7fd1277fe640 1 --2- 172.21.15.87:0/1267370244 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd1100a1110 0x7fd1100a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:29.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.673+0000 7fd12e30b640 1 --2- 172.21.15.87:0/1267370244 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd1100a1110 0x7fd1100a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:29.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.674+0000 7fd1277fe640 1 -- 172.21.15.87:0/1267370244 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8978+0+0 (secure 0 0 0) 0x7fd1180cce30 con 0x7fd128104000 2024-09-13T17:12:29.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.674+0000 7fd1277fe640 1 --2- 172.21.15.87:0/1267370244 >> [v2:172.21.15.87:6802/1316956138,v1:172.21.15.87:6803/1316956138] conn(0x7fd1100ac0a0 0x7fd1100ae540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:29.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.674+0000 7fd1277fe640 1 -- 172.21.15.87:0/1267370244 --> [v2:172.21.15.87:6802/1316956138,v1:172.21.15.87:6803/1316956138] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd1100aec10 con 0x7fd1100ac0a0 2024-09-13T17:12:29.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.674+0000 7fd1277fe640 1 -- 172.21.15.87:0/1267370244 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1180cd240 con 0x7fd128104000 2024-09-13T17:12:29.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.674+0000 7fd12db0a640 1 --2- 172.21.15.87:0/1267370244 >> [v2:172.21.15.87:6802/1316956138,v1:172.21.15.87:6803/1316956138] conn(0x7fd1100ac0a0 0x7fd1100ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:29.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.674+0000 7fd12e30b640 1 --2- 172.21.15.87:0/1267370244 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd1100a1110 0x7fd1100a35d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd120006010 tx=0x7fd1200093a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:29.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.674+0000 7fd12db0a640 1 --2- 172.21.15.87:0/1267370244 >> [v2:172.21.15.87:6802/1316956138,v1:172.21.15.87:6803/1316956138] conn(0x7fd1100ac0a0 0x7fd1100ae540 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:29.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.675+0000 7fd1277fe640 1 -- 172.21.15.87:0/1267370244 <== osd.0 v2:172.21.15.87:6802/1316956138 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd1100aec10 con 0x7fd1100ac0a0 2024-09-13T17:12:29.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.688+0000 7fd13056f640 1 -- 172.21.15.87:0/1267370244 --> [v2:172.21.15.87:6802/1316956138,v1:172.21.15.87:6803/1316956138] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd1280fce60 con 0x7fd1100ac0a0 2024-09-13T17:12:29.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.688+0000 7fd1277fe640 1 -- 172.21.15.87:0/1267370244 <== osd.0 v2:172.21.15.87:6802/1316956138 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd1280fce60 con 0x7fd1100ac0a0 2024-09-13T17:12:29.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.689+0000 7fd13056f640 1 -- 172.21.15.87:0/1267370244 >> [v2:172.21.15.87:6802/1316956138,v1:172.21.15.87:6803/1316956138] conn(0x7fd1100ac0a0 msgr2=0x7fd1100ae540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:29.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.689+0000 7fd13056f640 1 --2- 172.21.15.87:0/1267370244 >> [v2:172.21.15.87:6802/1316956138,v1:172.21.15.87:6803/1316956138] conn(0x7fd1100ac0a0 0x7fd1100ae540 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:29.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.689+0000 7fd13056f640 1 -- 172.21.15.87:0/1267370244 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd1100a1110 msgr2=0x7fd1100a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:29.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.689+0000 7fd13056f640 1 --2- 172.21.15.87:0/1267370244 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd1100a1110 0x7fd1100a35d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd120006010 tx=0x7fd1200093a0 comp rx=0 tx=0).stop 2024-09-13T17:12:29.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.689+0000 7fd13056f640 1 -- 172.21.15.87:0/1267370244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd128104000 msgr2=0x7fd128199ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:29.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.689+0000 7fd13056f640 1 --2- 172.21.15.87:0/1267370244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd128104000 0x7fd128199ad0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd11800c970 tx=0x7fd11800ce30 comp rx=0 tx=0).stop 2024-09-13T17:12:29.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.689+0000 7fd12eb0c640 1 -- 172.21.15.87:0/1267370244 reap_dead start 2024-09-13T17:12:29.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.689+0000 7fd13056f640 1 -- 172.21.15.87:0/1267370244 shutdown_connections 2024-09-13T17:12:29.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.689+0000 7fd13056f640 1 -- 172.21.15.87:0/1267370244 >> 172.21.15.87:0/1267370244 conn(0x7fd1280fa9b0 msgr2=0x7fd1280fbd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:29.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.689+0000 7fd13056f640 1 -- 172.21.15.87:0/1267370244 shutdown_connections 2024-09-13T17:12:29.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:29.689+0000 7fd13056f640 1 -- 172.21.15.87:0/1267370244 wait complete. 2024-09-13T17:12:30.279 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:12:30.716 INFO:teuthology.orchestra.run.smithi087.stdout:163208757302 2024-09-13T17:12:30.717 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-13T17:12:30.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.879+0000 7fbbec83b640 1 -- 172.21.15.87:0/144271483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbe8101880 msgr2=0x7fbbe8109d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:30.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.879+0000 7fbbec83b640 1 --2- 172.21.15.87:0/144271483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbe8101880 0x7fbbe8109d70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0009900 tx=0x7fbbd002a480 comp rx=0 tx=0).stop 2024-09-13T17:12:30.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.879+0000 7fbbec83b640 1 -- 172.21.15.87:0/144271483 shutdown_connections 2024-09-13T17:12:30.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.879+0000 7fbbec83b640 1 --2- 172.21.15.87:0/144271483 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbe810a390 0x7fbbe810c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:30.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.879+0000 7fbbec83b640 1 --2- 172.21.15.87:0/144271483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbe8101880 0x7fbbe8109d70 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:30.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.879+0000 7fbbec83b640 1 --2- 172.21.15.87:0/144271483 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbe8100f60 0x7fbbe8101340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:30.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.879+0000 7fbbec83b640 1 -- 172.21.15.87:0/144271483 >> 172.21.15.87:0/144271483 conn(0x7fbbe80fa9a0 msgr2=0x7fbbe80fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:30.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.879+0000 7fbbec83b640 1 -- 172.21.15.87:0/144271483 shutdown_connections 2024-09-13T17:12:30.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.879+0000 7fbbec83b640 1 -- 172.21.15.87:0/144271483 wait complete. 2024-09-13T17:12:30.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.880+0000 7fbbec83b640 1 Processor -- start 2024-09-13T17:12:30.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.880+0000 7fbbec83b640 1 -- start start 2024-09-13T17:12:30.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.880+0000 7fbbec83b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbe8100f60 0x7fbbe80febc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:30.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.880+0000 7fbbec83b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbe8101880 0x7fbbe80ff100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:30.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.880+0000 7fbbec83b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbe810a390 0x7fbbe80ff640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:30.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.880+0000 7fbbec83b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe8100b60 con 0x7fbbe8101880 2024-09-13T17:12:30.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.880+0000 7fbbec83b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe81a8ca0 con 0x7fbbe8100f60 2024-09-13T17:12:30.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.880+0000 7fbbec83b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe81a8e30 con 0x7fbbe810a390 2024-09-13T17:12:30.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.880+0000 7fbbdffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbe8101880 0x7fbbe80ff100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:30.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.880+0000 7fbbdffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbe8101880 0x7fbbe80ff100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40768/0 (socket says 172.21.15.87:40768) 2024-09-13T17:12:30.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.880+0000 7fbbdffff640 1 -- 172.21.15.87:0/512525564 learned_addr learned my addr 172.21.15.87:0/512525564 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:12:30.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.880+0000 7fbbe659c640 1 --2- 172.21.15.87:0/512525564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbe8100f60 0x7fbbe80febc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:30.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.880+0000 7fbbe6d9d640 1 --2- 172.21.15.87:0/512525564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbe810a390 0x7fbbe80ff640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:30.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.880+0000 7fbbdffff640 1 -- 172.21.15.87:0/512525564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbe810a390 msgr2=0x7fbbe80ff640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:30.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.880+0000 7fbbdffff640 1 --2- 172.21.15.87:0/512525564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbe810a390 0x7fbbe80ff640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:30.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.880+0000 7fbbdffff640 1 -- 172.21.15.87:0/512525564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbe8100f60 msgr2=0x7fbbe80febc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:30.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.880+0000 7fbbdffff640 1 --2- 172.21.15.87:0/512525564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbe8100f60 0x7fbbe80febc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:30.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.881+0000 7fbbdffff640 1 -- 172.21.15.87:0/512525564 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd0009560 con 0x7fbbe8101880 2024-09-13T17:12:30.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.881+0000 7fbbe6d9d640 1 --2- 172.21.15.87:0/512525564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbbe810a390 0x7fbbe80ff640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:12:30.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.881+0000 7fbbdffff640 1 --2- 172.21.15.87:0/512525564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbe8101880 0x7fbbe80ff100 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0005ab0 tx=0x7fbbd00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:30.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.881+0000 7fbbdf7fe640 1 -- 172.21.15.87:0/512525564 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd00044e0 con 0x7fbbe8101880 2024-09-13T17:12:30.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.881+0000 7fbbdf7fe640 1 -- 172.21.15.87:0/512525564 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbbd0031c40 con 0x7fbbe8101880 2024-09-13T17:12:30.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.881+0000 7fbbec83b640 1 -- 172.21.15.87:0/512525564 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe81a90b0 con 0x7fbbe8101880 2024-09-13T17:12:30.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.881+0000 7fbbdf7fe640 1 -- 172.21.15.87:0/512525564 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd0032340 con 0x7fbbe8101880 2024-09-13T17:12:30.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.881+0000 7fbbec83b640 1 -- 172.21.15.87:0/512525564 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe81a9550 con 0x7fbbe8101880 2024-09-13T17:12:30.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.882+0000 7fbbec83b640 1 -- 172.21.15.87:0/512525564 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbbe81100c0 con 0x7fbbe8101880 2024-09-13T17:12:30.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.883+0000 7fbbdf7fe640 1 -- 172.21.15.87:0/512525564 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fbbd00324c0 con 0x7fbbe8101880 2024-09-13T17:12:30.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.884+0000 7fbbdf7fe640 1 --2- 172.21.15.87:0/512525564 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fbbd40a1110 0x7fbbd40a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:30.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.884+0000 7fbbe659c640 1 --2- 172.21.15.87:0/512525564 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fbbd40a1110 0x7fbbd40a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:30.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.884+0000 7fbbdf7fe640 1 -- 172.21.15.87:0/512525564 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8978+0+0 (secure 0 0 0) 0x7fbbd00edc80 con 0x7fbbe8101880 2024-09-13T17:12:30.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.884+0000 7fbbdf7fe640 1 --2- 172.21.15.87:0/512525564 >> [v2:172.21.15.87:6810/3306119066,v1:172.21.15.87:6811/3306119066] conn(0x7fbbd40ac0a0 0x7fbbd40ae540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:30.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.884+0000 7fbbdf7fe640 1 -- 172.21.15.87:0/512525564 --> [v2:172.21.15.87:6810/3306119066,v1:172.21.15.87:6811/3306119066] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbbd40aec10 con 0x7fbbd40ac0a0 2024-09-13T17:12:30.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.884+0000 7fbbdf7fe640 1 -- 172.21.15.87:0/512525564 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbd00ee090 con 0x7fbbe8101880 2024-09-13T17:12:30.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.884+0000 7fbbe6d9d640 1 --2- 172.21.15.87:0/512525564 >> [v2:172.21.15.87:6810/3306119066,v1:172.21.15.87:6811/3306119066] conn(0x7fbbd40ac0a0 0x7fbbd40ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:30.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.884+0000 7fbbe659c640 1 --2- 172.21.15.87:0/512525564 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fbbd40a1110 0x7fbbd40a35d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbbd80058c0 tx=0x7fbbd800a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:30.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.885+0000 7fbbe6d9d640 1 --2- 172.21.15.87:0/512525564 >> [v2:172.21.15.87:6810/3306119066,v1:172.21.15.87:6811/3306119066] conn(0x7fbbd40ac0a0 0x7fbbd40ae540 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:30.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.885+0000 7fbbdf7fe640 1 -- 172.21.15.87:0/512525564 <== osd.3 v2:172.21.15.87:6810/3306119066 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fbbd40aec10 con 0x7fbbd40ac0a0 2024-09-13T17:12:30.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.899+0000 7fbbec83b640 1 -- 172.21.15.87:0/512525564 --> [v2:172.21.15.87:6810/3306119066,v1:172.21.15.87:6811/3306119066] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbbe8060bb0 con 0x7fbbd40ac0a0 2024-09-13T17:12:30.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.899+0000 7fbbdf7fe640 1 -- 172.21.15.87:0/512525564 <== osd.3 v2:172.21.15.87:6810/3306119066 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fbbe8060bb0 con 0x7fbbd40ac0a0 2024-09-13T17:12:30.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.899+0000 7fbbec83b640 1 -- 172.21.15.87:0/512525564 >> [v2:172.21.15.87:6810/3306119066,v1:172.21.15.87:6811/3306119066] conn(0x7fbbd40ac0a0 msgr2=0x7fbbd40ae540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:30.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.899+0000 7fbbec83b640 1 --2- 172.21.15.87:0/512525564 >> [v2:172.21.15.87:6810/3306119066,v1:172.21.15.87:6811/3306119066] conn(0x7fbbd40ac0a0 0x7fbbd40ae540 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:30.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.899+0000 7fbbec83b640 1 -- 172.21.15.87:0/512525564 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fbbd40a1110 msgr2=0x7fbbd40a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:30.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.899+0000 7fbbec83b640 1 --2- 172.21.15.87:0/512525564 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fbbd40a1110 0x7fbbd40a35d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbbd80058c0 tx=0x7fbbd800a4c0 comp rx=0 tx=0).stop 2024-09-13T17:12:30.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.899+0000 7fbbec83b640 1 -- 172.21.15.87:0/512525564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbe8101880 msgr2=0x7fbbe80ff100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:30.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.899+0000 7fbbec83b640 1 --2- 172.21.15.87:0/512525564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbe8101880 0x7fbbe80ff100 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0005ab0 tx=0x7fbbd00042f0 comp rx=0 tx=0).stop 2024-09-13T17:12:30.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.899+0000 7fbbe6d9d640 1 -- 172.21.15.87:0/512525564 reap_dead start 2024-09-13T17:12:30.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.899+0000 7fbbec83b640 1 -- 172.21.15.87:0/512525564 shutdown_connections 2024-09-13T17:12:30.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.899+0000 7fbbec83b640 1 -- 172.21.15.87:0/512525564 >> 172.21.15.87:0/512525564 conn(0x7fbbe80fa9a0 msgr2=0x7fbbe80fc240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:30.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.899+0000 7fbbec83b640 1 -- 172.21.15.87:0/512525564 shutdown_connections 2024-09-13T17:12:30.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:30.900+0000 7fbbec83b640 1 -- 172.21.15.87:0/512525564 wait complete. 2024-09-13T17:12:31.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:31 smithi087 ceph-mon[30934]: pgmap v312: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-13T17:12:31.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:31 smithi149 ceph-mon[35496]: pgmap v312: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-13T17:12:31.612 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:31 smithi118 ceph-mon[34374]: pgmap v312: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-13T17:12:33.403 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:33 smithi087 ceph-mon[30934]: pgmap v313: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T17:12:33.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:33 smithi149 ceph-mon[35496]: pgmap v313: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T17:12:33.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:33 smithi118 ceph-mon[34374]: pgmap v313: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T17:12:34.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.885+0000 7f58fcbbb640 1 -- 172.21.15.87:0/2584038935 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58f80fe930 msgr2=0x7f58f80fed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:34.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.885+0000 7f58fcbbb640 1 --2- 172.21.15.87:0/2584038935 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58f80fe930 0x7f58f80fed70 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f58ec009930 tx=0x7f58ec02a4d0 comp rx=0 tx=0).stop 2024-09-13T17:12:34.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.885+0000 7f58fcbbb640 1 -- 172.21.15.87:0/2584038935 shutdown_connections 2024-09-13T17:12:34.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.885+0000 7f58fcbbb640 1 --2- 172.21.15.87:0/2584038935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58f80ff2b0 0x7f58f810b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:34.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.885+0000 7f58fcbbb640 1 --2- 172.21.15.87:0/2584038935 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58f80fe930 0x7f58f80fed70 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:34.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.885+0000 7f58fcbbb640 1 --2- 172.21.15.87:0/2584038935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58f81044f0 0x7f58f81048d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:34.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.885+0000 7f58fcbbb640 1 -- 172.21.15.87:0/2584038935 >> 172.21.15.87:0/2584038935 conn(0x7f58f8074130 msgr2=0x7f58f8074540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:34.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.885+0000 7f58fcbbb640 1 -- 172.21.15.87:0/2584038935 shutdown_connections 2024-09-13T17:12:34.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.885+0000 7f58fcbbb640 1 -- 172.21.15.87:0/2584038935 wait complete. 2024-09-13T17:12:34.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.886+0000 7f58fcbbb640 1 Processor -- start 2024-09-13T17:12:34.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.886+0000 7f58fcbbb640 1 -- start start 2024-09-13T17:12:34.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.886+0000 7f58fcbbb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58f80fe930 0x7f58f8195210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:34.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.886+0000 7f58fcbbb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58f80ff2b0 0x7f58f8195750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:34.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.886+0000 7f58fcbbb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58f81044f0 0x7f58f8199b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:34.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.886+0000 7f58fcbbb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f819a150 con 0x7f58f81044f0 2024-09-13T17:12:34.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.886+0000 7f58fcbbb640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f819a2c0 con 0x7f58f80ff2b0 2024-09-13T17:12:34.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.886+0000 7f58fcbbb640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f819a430 con 0x7f58f80fe930 2024-09-13T17:12:34.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.886+0000 7f58f6d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58f81044f0 0x7f58f8199b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:34.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.886+0000 7f58f6d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58f81044f0 0x7f58f8199b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40800/0 (socket says 172.21.15.87:40800) 2024-09-13T17:12:34.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.886+0000 7f58f6d9d640 1 -- 172.21.15.87:0/658617317 learned_addr learned my addr 172.21.15.87:0/658617317 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:12:34.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.886+0000 7f58f659c640 1 --2- 172.21.15.87:0/658617317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58f80fe930 0x7f58f8195210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:34.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.887+0000 7f58f5d9b640 1 --2- 172.21.15.87:0/658617317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58f80ff2b0 0x7f58f8195750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:34.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.887+0000 7f58f6d9d640 1 -- 172.21.15.87:0/658617317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58f80fe930 msgr2=0x7f58f8195210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:34.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.887+0000 7f58f6d9d640 1 --2- 172.21.15.87:0/658617317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58f80fe930 0x7f58f8195210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:34.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.887+0000 7f58f6d9d640 1 -- 172.21.15.87:0/658617317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58f80ff2b0 msgr2=0x7f58f8195750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:34.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.887+0000 7f58f6d9d640 1 --2- 172.21.15.87:0/658617317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58f80ff2b0 0x7f58f8195750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:34.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.887+0000 7f58f6d9d640 1 -- 172.21.15.87:0/658617317 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ec009560 con 0x7f58f81044f0 2024-09-13T17:12:34.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.887+0000 7f58f5d9b640 1 --2- 172.21.15.87:0/658617317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58f80ff2b0 0x7f58f8195750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:12:34.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.887+0000 7f58f6d9d640 1 --2- 172.21.15.87:0/658617317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58f81044f0 0x7f58f8199b50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f58f000ebb0 tx=0x7f58f0009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:34.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.887+0000 7f58e77fe640 1 -- 172.21.15.87:0/658617317 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f0013070 con 0x7f58f81044f0 2024-09-13T17:12:34.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.887+0000 7f58e77fe640 1 -- 172.21.15.87:0/658617317 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f58f000e2e0 con 0x7f58f81044f0 2024-09-13T17:12:34.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.887+0000 7f58fcbbb640 1 -- 172.21.15.87:0/658617317 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58f819a6b0 con 0x7f58f81044f0 2024-09-13T17:12:34.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.887+0000 7f58e77fe640 1 -- 172.21.15.87:0/658617317 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f00054e0 con 0x7f58f81044f0 2024-09-13T17:12:34.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.887+0000 7f58fcbbb640 1 -- 172.21.15.87:0/658617317 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f810bbc0 con 0x7f58f81044f0 2024-09-13T17:12:34.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.888+0000 7f58fcbbb640 1 -- 172.21.15.87:0/658617317 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f58f80ffb90 con 0x7f58f81044f0 2024-09-13T17:12:34.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.889+0000 7f58e77fe640 1 -- 172.21.15.87:0/658617317 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f58f0007c50 con 0x7f58f81044f0 2024-09-13T17:12:34.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.890+0000 7f58e77fe640 1 --2- 172.21.15.87:0/658617317 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f58e00a1110 0x7f58e00a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:34.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.890+0000 7f58f659c640 1 --2- 172.21.15.87:0/658617317 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f58e00a1110 0x7f58e00a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:34.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.890+0000 7f58e77fe640 1 -- 172.21.15.87:0/658617317 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8978+0+0 (secure 0 0 0) 0x7f58f00ce980 con 0x7f58f81044f0 2024-09-13T17:12:34.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.890+0000 7f58e77fe640 1 --2- 172.21.15.87:0/658617317 >> [v2:172.21.15.149:6824/271000465,v1:172.21.15.149:6825/271000465] conn(0x7f58e00ac0a0 0x7f58e00ae540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:34.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.890+0000 7f58e77fe640 1 -- 172.21.15.87:0/658617317 --> [v2:172.21.15.149:6824/271000465,v1:172.21.15.149:6825/271000465] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f58e00aec10 con 0x7f58e00ac0a0 2024-09-13T17:12:34.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.890+0000 7f58e77fe640 1 -- 172.21.15.87:0/658617317 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58f00ced90 con 0x7f58f81044f0 2024-09-13T17:12:34.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.890+0000 7f58f659c640 1 --2- 172.21.15.87:0/658617317 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f58e00a1110 0x7f58e00a35d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009990 tx=0x7f58e8009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:34.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.890+0000 7f58f5d9b640 1 --2- 172.21.15.87:0/658617317 >> [v2:172.21.15.149:6824/271000465,v1:172.21.15.149:6825/271000465] conn(0x7f58e00ac0a0 0x7f58e00ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:34.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.891+0000 7f58f5d9b640 1 --2- 172.21.15.87:0/658617317 >> [v2:172.21.15.149:6824/271000465,v1:172.21.15.149:6825/271000465] conn(0x7f58e00ac0a0 0x7f58e00ae540 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:34.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.892+0000 7f58e77fe640 1 -- 172.21.15.87:0/658617317 <== osd.11 v2:172.21.15.149:6824/271000465 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f58e00aec10 con 0x7f58e00ac0a0 2024-09-13T17:12:34.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.905+0000 7f58fcbbb640 1 -- 172.21.15.87:0/658617317 --> [v2:172.21.15.149:6824/271000465,v1:172.21.15.149:6825/271000465] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f58f810f020 con 0x7f58e00ac0a0 2024-09-13T17:12:34.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.906+0000 7f58e77fe640 1 -- 172.21.15.87:0/658617317 <== osd.11 v2:172.21.15.149:6824/271000465 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f58ec032bf0 con 0x7f58e00ac0a0 2024-09-13T17:12:34.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.906+0000 7f58fcbbb640 1 -- 172.21.15.87:0/658617317 >> [v2:172.21.15.149:6824/271000465,v1:172.21.15.149:6825/271000465] conn(0x7f58e00ac0a0 msgr2=0x7f58e00ae540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:34.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.906+0000 7f58fcbbb640 1 --2- 172.21.15.87:0/658617317 >> [v2:172.21.15.149:6824/271000465,v1:172.21.15.149:6825/271000465] conn(0x7f58e00ac0a0 0x7f58e00ae540 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:34.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.906+0000 7f58fcbbb640 1 -- 172.21.15.87:0/658617317 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f58e00a1110 msgr2=0x7f58e00a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:34.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.906+0000 7f58fcbbb640 1 --2- 172.21.15.87:0/658617317 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f58e00a1110 0x7f58e00a35d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009990 tx=0x7f58e8009110 comp rx=0 tx=0).stop 2024-09-13T17:12:34.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.906+0000 7f58fcbbb640 1 -- 172.21.15.87:0/658617317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58f81044f0 msgr2=0x7f58f8199b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:34.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.906+0000 7f58fcbbb640 1 --2- 172.21.15.87:0/658617317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58f81044f0 0x7f58f8199b50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f58f000ebb0 tx=0x7f58f0009f60 comp rx=0 tx=0).stop 2024-09-13T17:12:34.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.906+0000 7f58f6d9d640 1 -- 172.21.15.87:0/658617317 reap_dead start 2024-09-13T17:12:34.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.906+0000 7f58fcbbb640 1 -- 172.21.15.87:0/658617317 shutdown_connections 2024-09-13T17:12:34.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.906+0000 7f58fcbbb640 1 -- 172.21.15.87:0/658617317 >> 172.21.15.87:0/658617317 conn(0x7f58f8074130 msgr2=0x7f58f80fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:34.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.906+0000 7f58fcbbb640 1 -- 172.21.15.87:0/658617317 shutdown_connections 2024-09-13T17:12:34.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:33.906+0000 7f58fcbbb640 1 -- 172.21.15.87:0/658617317 wait complete. 2024-09-13T17:12:34.885 INFO:teuthology.orchestra.run.smithi087.stdout:343597383707 2024-09-13T17:12:34.885 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-13T17:12:35.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.330+0000 7f4aeb615640 1 -- 172.21.15.87:0/693702339 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ae4104030 msgr2=0x7f4ae410bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:35.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.330+0000 7f4aeb615640 1 --2- 172.21.15.87:0/693702339 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ae4104030 0x7f4ae410bbb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4009930 tx=0x7f4ad402a420 comp rx=0 tx=0).stop 2024-09-13T17:12:35.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.330+0000 7f4aeb615640 1 -- 172.21.15.87:0/693702339 shutdown_connections 2024-09-13T17:12:35.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.330+0000 7f4aeb615640 1 --2- 172.21.15.87:0/693702339 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ae4104030 0x7f4ae410bbb0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:35.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.330+0000 7f4aeb615640 1 --2- 172.21.15.87:0/693702339 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ae40ff8b0 0x7f4ae4103900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:35.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.330+0000 7f4aeb615640 1 --2- 172.21.15.87:0/693702339 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ae40fef00 0x7f4ae40ff2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:35.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.330+0000 7f4aeb615640 1 -- 172.21.15.87:0/693702339 >> 172.21.15.87:0/693702339 conn(0x7f4ae40fa9a0 msgr2=0x7f4ae40fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:35.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.330+0000 7f4aeb615640 1 -- 172.21.15.87:0/693702339 shutdown_connections 2024-09-13T17:12:35.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.330+0000 7f4aeb615640 1 -- 172.21.15.87:0/693702339 wait complete. 2024-09-13T17:12:35.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.331+0000 7f4aeb615640 1 Processor -- start 2024-09-13T17:12:35.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.331+0000 7f4aeb615640 1 -- start start 2024-09-13T17:12:35.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.331+0000 7f4aeb615640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ae40fef00 0x7f4ae4195080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:35.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.331+0000 7f4aeb615640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ae40ff8b0 0x7f4ae41955c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:35.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.331+0000 7f4aeb615640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ae4104030 0x7f4ae41999c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:35.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.331+0000 7f4aeb615640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae4199fc0 con 0x7f4ae40ff8b0 2024-09-13T17:12:35.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.331+0000 7f4aeb615640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae419a130 con 0x7f4ae4104030 2024-09-13T17:12:35.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.331+0000 7f4aeb615640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae419a2a0 con 0x7f4ae40fef00 2024-09-13T17:12:35.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.331+0000 7f4ae8bb0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ae40ff8b0 0x7f4ae41955c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:35.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.331+0000 7f4ae8bb0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ae40ff8b0 0x7f4ae41955c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40824/0 (socket says 172.21.15.87:40824) 2024-09-13T17:12:35.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.331+0000 7f4ae8bb0640 1 -- 172.21.15.87:0/1742661394 learned_addr learned my addr 172.21.15.87:0/1742661394 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:12:35.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.332+0000 7f4ae93b1640 1 --2- 172.21.15.87:0/1742661394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ae40fef00 0x7f4ae4195080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:35.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.332+0000 7f4ae8bb0640 1 -- 172.21.15.87:0/1742661394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ae40fef00 msgr2=0x7f4ae4195080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:35.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.332+0000 7f4ae8bb0640 1 --2- 172.21.15.87:0/1742661394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ae40fef00 0x7f4ae4195080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:35.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.332+0000 7f4ae8bb0640 1 -- 172.21.15.87:0/1742661394 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ae4104030 msgr2=0x7f4ae41999c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:35.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.332+0000 7f4ae9bb2640 1 --2- 172.21.15.87:0/1742661394 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ae4104030 0x7f4ae41999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:35.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.332+0000 7f4ae8bb0640 1 --2- 172.21.15.87:0/1742661394 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ae4104030 0x7f4ae41999c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:35.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.332+0000 7f4ae8bb0640 1 -- 172.21.15.87:0/1742661394 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad4009560 con 0x7f4ae40ff8b0 2024-09-13T17:12:35.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.332+0000 7f4ae8bb0640 1 --2- 172.21.15.87:0/1742661394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ae40ff8b0 0x7f4ae41955c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4ad800cce0 tx=0x7f4ad800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:35.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.332+0000 7f4ae27fc640 1 -- 172.21.15.87:0/1742661394 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad800f650 con 0x7f4ae40ff8b0 2024-09-13T17:12:35.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.332+0000 7f4aeb615640 1 -- 172.21.15.87:0/1742661394 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ae419a580 con 0x7f4ae40ff8b0 2024-09-13T17:12:35.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.332+0000 7f4ae27fc640 1 -- 172.21.15.87:0/1742661394 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4ad800ce90 con 0x7f4ae40ff8b0 2024-09-13T17:12:35.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.332+0000 7f4ae27fc640 1 -- 172.21.15.87:0/1742661394 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad8018b10 con 0x7f4ae40ff8b0 2024-09-13T17:12:35.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.332+0000 7f4aeb615640 1 -- 172.21.15.87:0/1742661394 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae4068720 con 0x7f4ae40ff8b0 2024-09-13T17:12:35.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.333+0000 7f4aeb615640 1 -- 172.21.15.87:0/1742661394 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4ae41003e0 con 0x7f4ae40ff8b0 2024-09-13T17:12:35.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.334+0000 7f4ae27fc640 1 -- 172.21.15.87:0/1742661394 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f4ad8018c70 con 0x7f4ae40ff8b0 2024-09-13T17:12:35.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.335+0000 7f4ae27fc640 1 --2- 172.21.15.87:0/1742661394 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f4acc0a3320 0x7f4acc0a57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:35.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.335+0000 7f4ae27fc640 1 -- 172.21.15.87:0/1742661394 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8978+0+0 (secure 0 0 0) 0x7f4ad80cd710 con 0x7f4ae40ff8b0 2024-09-13T17:12:35.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.335+0000 7f4ae93b1640 1 --2- 172.21.15.87:0/1742661394 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f4acc0a3320 0x7f4acc0a57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:35.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.335+0000 7f4ae27fc640 1 --2- 172.21.15.87:0/1742661394 >> [v2:172.21.15.87:6826/1453934262,v1:172.21.15.87:6827/1453934262] conn(0x7f4acc0ae2b0 0x7f4acc0b0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:35.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.335+0000 7f4ae27fc640 1 -- 172.21.15.87:0/1742661394 --> [v2:172.21.15.87:6826/1453934262,v1:172.21.15.87:6827/1453934262] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4acc0b0e20 con 0x7f4acc0ae2b0 2024-09-13T17:12:35.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.335+0000 7f4ae27fc640 1 -- 172.21.15.87:0/1742661394 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ad80cdb20 con 0x7f4ae40ff8b0 2024-09-13T17:12:35.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.335+0000 7f4ae9bb2640 1 --2- 172.21.15.87:0/1742661394 >> [v2:172.21.15.87:6826/1453934262,v1:172.21.15.87:6827/1453934262] conn(0x7f4acc0ae2b0 0x7f4acc0b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:35.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.335+0000 7f4ae93b1640 1 --2- 172.21.15.87:0/1742661394 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f4acc0a3320 0x7f4acc0a57e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4adc005fd0 tx=0x7f4adc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:35.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.336+0000 7f4ae9bb2640 1 --2- 172.21.15.87:0/1742661394 >> [v2:172.21.15.87:6826/1453934262,v1:172.21.15.87:6827/1453934262] conn(0x7f4acc0ae2b0 0x7f4acc0b0750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:35.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.336+0000 7f4ae27fc640 1 -- 172.21.15.87:0/1742661394 <== osd.9 v2:172.21.15.87:6826/1453934262 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f4acc0b0e20 con 0x7f4acc0ae2b0 2024-09-13T17:12:35.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.362+0000 7f4aeb615640 1 -- 172.21.15.87:0/1742661394 --> [v2:172.21.15.87:6826/1453934262,v1:172.21.15.87:6827/1453934262] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4ae4068c20 con 0x7f4acc0ae2b0 2024-09-13T17:12:35.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.363+0000 7f4ae27fc640 1 -- 172.21.15.87:0/1742661394 <== osd.9 v2:172.21.15.87:6826/1453934262 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f4ae4068c20 con 0x7f4acc0ae2b0 2024-09-13T17:12:35.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.363+0000 7f4aeb615640 1 -- 172.21.15.87:0/1742661394 >> [v2:172.21.15.87:6826/1453934262,v1:172.21.15.87:6827/1453934262] conn(0x7f4acc0ae2b0 msgr2=0x7f4acc0b0750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:35.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.363+0000 7f4aeb615640 1 --2- 172.21.15.87:0/1742661394 >> [v2:172.21.15.87:6826/1453934262,v1:172.21.15.87:6827/1453934262] conn(0x7f4acc0ae2b0 0x7f4acc0b0750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:35.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.363+0000 7f4aeb615640 1 -- 172.21.15.87:0/1742661394 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f4acc0a3320 msgr2=0x7f4acc0a57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:35.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.363+0000 7f4aeb615640 1 --2- 172.21.15.87:0/1742661394 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f4acc0a3320 0x7f4acc0a57e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4adc005fd0 tx=0x7f4adc005850 comp rx=0 tx=0).stop 2024-09-13T17:12:35.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.363+0000 7f4aeb615640 1 -- 172.21.15.87:0/1742661394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ae40ff8b0 msgr2=0x7f4ae41955c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:35.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.363+0000 7f4aeb615640 1 --2- 172.21.15.87:0/1742661394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ae40ff8b0 0x7f4ae41955c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4ad800cce0 tx=0x7f4ad800a620 comp rx=0 tx=0).stop 2024-09-13T17:12:35.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.363+0000 7f4ae9bb2640 1 -- 172.21.15.87:0/1742661394 reap_dead start 2024-09-13T17:12:35.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.363+0000 7f4aeb615640 1 -- 172.21.15.87:0/1742661394 shutdown_connections 2024-09-13T17:12:35.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.363+0000 7f4aeb615640 1 -- 172.21.15.87:0/1742661394 >> 172.21.15.87:0/1742661394 conn(0x7f4ae40fa9a0 msgr2=0x7f4ae40fbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:35.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.363+0000 7f4aeb615640 1 -- 172.21.15.87:0/1742661394 shutdown_connections 2024-09-13T17:12:35.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:34.363+0000 7f4aeb615640 1 -- 172.21.15.87:0/1742661394 wait complete. 2024-09-13T17:12:35.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:35 smithi087 ceph-mon[30934]: pgmap v314: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-13T17:12:35.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:35 smithi149 ceph-mon[35496]: pgmap v314: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-13T17:12:35.595 INFO:teuthology.orchestra.run.smithi087.stdout:287762808868 2024-09-13T17:12:35.596 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-13T17:12:35.612 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:35 smithi118 ceph-mon[34374]: pgmap v314: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-13T17:12:36.124 INFO:teuthology.orchestra.run.smithi087.stdout:219043332140 2024-09-13T17:12:36.124 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-13T17:12:36.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.728+0000 7f1b6ba25640 1 -- 172.21.15.87:0/4120097782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b64104160 msgr2=0x7f1b641045f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:36.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.728+0000 7f1b6ba25640 1 --2- 172.21.15.87:0/4120097782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b64104160 0x7f1b641045f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c009ca0 tx=0x7f1b5c02a940 comp rx=0 tx=0).stop 2024-09-13T17:12:36.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.728+0000 7f1b6ba25640 1 -- 172.21.15.87:0/4120097782 shutdown_connections 2024-09-13T17:12:36.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.728+0000 7f1b6ba25640 1 --2- 172.21.15.87:0/4120097782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b64104160 0x7f1b641045f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:36.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.728+0000 7f1b6ba25640 1 --2- 172.21.15.87:0/4120097782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b640ff670 0x7f1b64103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:36.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.728+0000 7f1b6ba25640 1 --2- 172.21.15.87:0/4120097782 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b640fed50 0x7f1b640ff130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:36.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.728+0000 7f1b6ba25640 1 -- 172.21.15.87:0/4120097782 >> 172.21.15.87:0/4120097782 conn(0x7f1b640fa9a0 msgr2=0x7f1b640fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:36.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.728+0000 7f1b6ba25640 1 -- 172.21.15.87:0/4120097782 shutdown_connections 2024-09-13T17:12:36.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.728+0000 7f1b6ba25640 1 -- 172.21.15.87:0/4120097782 wait complete. 2024-09-13T17:12:36.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.729+0000 7f1b6ba25640 1 Processor -- start 2024-09-13T17:12:36.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.729+0000 7f1b6ba25640 1 -- start start 2024-09-13T17:12:36.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.729+0000 7f1b6ba25640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b640fed50 0x7f1b6419c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:36.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.729+0000 7f1b6ba25640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b640ff670 0x7f1b6419cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:36.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.729+0000 7f1b6ba25640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b64104160 0x7f1b641a1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:36.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.729+0000 7f1b6ba25640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b641a1960 con 0x7f1b64104160 2024-09-13T17:12:36.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.729+0000 7f1b6ba25640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b641a1ad0 con 0x7f1b640fed50 2024-09-13T17:12:36.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.729+0000 7f1b6ba25640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b641a1c90 con 0x7f1b640ff670 2024-09-13T17:12:36.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.729+0000 7f1b69fc2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b64104160 0x7f1b641a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:36.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.729+0000 7f1b69fc2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b64104160 0x7f1b641a1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40828/0 (socket says 172.21.15.87:40828) 2024-09-13T17:12:36.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.729+0000 7f1b69fc2640 1 -- 172.21.15.87:0/1619019107 learned_addr learned my addr 172.21.15.87:0/1619019107 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:12:36.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.729+0000 7f1b68fc0640 1 --2- 172.21.15.87:0/1619019107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b640ff670 0x7f1b6419cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:36.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.729+0000 7f1b697c1640 1 --2- 172.21.15.87:0/1619019107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b640fed50 0x7f1b6419c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:36.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.729+0000 7f1b69fc2640 1 -- 172.21.15.87:0/1619019107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b640ff670 msgr2=0x7f1b6419cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:36.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.729+0000 7f1b69fc2640 1 --2- 172.21.15.87:0/1619019107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b640ff670 0x7f1b6419cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:36.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.729+0000 7f1b69fc2640 1 -- 172.21.15.87:0/1619019107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b640fed50 msgr2=0x7f1b6419c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:36.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.729+0000 7f1b69fc2640 1 --2- 172.21.15.87:0/1619019107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b640fed50 0x7f1b6419c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:36.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.729+0000 7f1b69fc2640 1 -- 172.21.15.87:0/1619019107 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5c009900 con 0x7f1b64104160 2024-09-13T17:12:36.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.729+0000 7f1b68fc0640 1 --2- 172.21.15.87:0/1619019107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b640ff670 0x7f1b6419cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:12:36.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.730+0000 7f1b69fc2640 1 --2- 172.21.15.87:0/1619019107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b64104160 0x7f1b641a1360 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c030040 tx=0x7f1b5c031f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:36.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.730+0000 7f1b5a7fc640 1 -- 172.21.15.87:0/1619019107 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c003970 con 0x7f1b64104160 2024-09-13T17:12:36.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.730+0000 7f1b6ba25640 1 -- 172.21.15.87:0/1619019107 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b641a1f10 con 0x7f1b64104160 2024-09-13T17:12:36.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.730+0000 7f1b5a7fc640 1 -- 172.21.15.87:0/1619019107 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1b5c004040 con 0x7f1b64104160 2024-09-13T17:12:36.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.730+0000 7f1b5a7fc640 1 -- 172.21.15.87:0/1619019107 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c039680 con 0x7f1b64104160 2024-09-13T17:12:36.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.730+0000 7f1b6ba25640 1 -- 172.21.15.87:0/1619019107 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b641a97e0 con 0x7f1b64104160 2024-09-13T17:12:36.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.731+0000 7f1b6ba25640 1 -- 172.21.15.87:0/1619019107 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1b641166c0 con 0x7f1b64104160 2024-09-13T17:12:36.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.732+0000 7f1b5a7fc640 1 -- 172.21.15.87:0/1619019107 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f1b5c00a040 con 0x7f1b64104160 2024-09-13T17:12:36.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.733+0000 7f1b5a7fc640 1 --2- 172.21.15.87:0/1619019107 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f1b500a1110 0x7f1b500a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:36.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.733+0000 7f1b697c1640 1 --2- 172.21.15.87:0/1619019107 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f1b500a1110 0x7f1b500a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:36.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.733+0000 7f1b5a7fc640 1 -- 172.21.15.87:0/1619019107 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8978+0+0 (secure 0 0 0) 0x7f1b5c0ee910 con 0x7f1b64104160 2024-09-13T17:12:36.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.733+0000 7f1b5a7fc640 1 --2- 172.21.15.87:0/1619019107 >> [v2:172.21.15.118:6800/3352566727,v1:172.21.15.118:6801/3352566727] conn(0x7f1b500ac0a0 0x7f1b500ae540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:36.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.733+0000 7f1b5a7fc640 1 -- 172.21.15.87:0/1619019107 --> [v2:172.21.15.118:6800/3352566727,v1:172.21.15.118:6801/3352566727] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1b500aec10 con 0x7f1b500ac0a0 2024-09-13T17:12:36.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.733+0000 7f1b5a7fc640 1 -- 172.21.15.87:0/1619019107 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b5c0eed20 con 0x7f1b64104160 2024-09-13T17:12:36.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.733+0000 7f1b697c1640 1 --2- 172.21.15.87:0/1619019107 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f1b500a1110 0x7f1b500a35d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1b5400a810 tx=0x7f1b54008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:36.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.733+0000 7f1b68fc0640 1 --2- 172.21.15.87:0/1619019107 >> [v2:172.21.15.118:6800/3352566727,v1:172.21.15.118:6801/3352566727] conn(0x7f1b500ac0a0 0x7f1b500ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:36.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.734+0000 7f1b68fc0640 1 --2- 172.21.15.87:0/1619019107 >> [v2:172.21.15.118:6800/3352566727,v1:172.21.15.118:6801/3352566727] conn(0x7f1b500ac0a0 0x7f1b500ae540 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:36.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.735+0000 7f1b5a7fc640 1 -- 172.21.15.87:0/1619019107 <== osd.1 v2:172.21.15.118:6800/3352566727 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f1b500aec10 con 0x7f1b500ac0a0 2024-09-13T17:12:36.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.748+0000 7f1b6ba25640 1 -- 172.21.15.87:0/1619019107 --> [v2:172.21.15.118:6800/3352566727,v1:172.21.15.118:6801/3352566727] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1b64069000 con 0x7f1b500ac0a0 2024-09-13T17:12:36.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.749+0000 7f1b5a7fc640 1 -- 172.21.15.87:0/1619019107 <== osd.1 v2:172.21.15.118:6800/3352566727 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1b64069000 con 0x7f1b500ac0a0 2024-09-13T17:12:36.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.749+0000 7f1b6ba25640 1 -- 172.21.15.87:0/1619019107 >> [v2:172.21.15.118:6800/3352566727,v1:172.21.15.118:6801/3352566727] conn(0x7f1b500ac0a0 msgr2=0x7f1b500ae540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:36.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.749+0000 7f1b6ba25640 1 --2- 172.21.15.87:0/1619019107 >> [v2:172.21.15.118:6800/3352566727,v1:172.21.15.118:6801/3352566727] conn(0x7f1b500ac0a0 0x7f1b500ae540 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:36.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.749+0000 7f1b6ba25640 1 -- 172.21.15.87:0/1619019107 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f1b500a1110 msgr2=0x7f1b500a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:36.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.749+0000 7f1b6ba25640 1 --2- 172.21.15.87:0/1619019107 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f1b500a1110 0x7f1b500a35d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1b5400a810 tx=0x7f1b54008040 comp rx=0 tx=0).stop 2024-09-13T17:12:36.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.749+0000 7f1b6ba25640 1 -- 172.21.15.87:0/1619019107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b64104160 msgr2=0x7f1b641a1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:36.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.749+0000 7f1b6ba25640 1 --2- 172.21.15.87:0/1619019107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b64104160 0x7f1b641a1360 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c030040 tx=0x7f1b5c031f70 comp rx=0 tx=0).stop 2024-09-13T17:12:36.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.749+0000 7f1b69fc2640 1 -- 172.21.15.87:0/1619019107 reap_dead start 2024-09-13T17:12:36.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.749+0000 7f1b6ba25640 1 -- 172.21.15.87:0/1619019107 shutdown_connections 2024-09-13T17:12:36.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.749+0000 7f1b6ba25640 1 -- 172.21.15.87:0/1619019107 >> 172.21.15.87:0/1619019107 conn(0x7f1b640fa9a0 msgr2=0x7f1b640fbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:36.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.749+0000 7f1b6ba25640 1 -- 172.21.15.87:0/1619019107 shutdown_connections 2024-09-13T17:12:36.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:36.749+0000 7f1b6ba25640 1 -- 172.21.15.87:0/1619019107 wait complete. 2024-09-13T17:12:37.402 INFO:teuthology.orchestra.run.smithi087.stdout:34359738446 2024-09-13T17:12:37.402 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-13T17:12:37.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:37 smithi087 ceph-mon[30934]: pgmap v315: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-13T17:12:37.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:37 smithi149 ceph-mon[35496]: pgmap v315: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-13T17:12:37.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:37 smithi118 ceph-mon[34374]: pgmap v315: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-13T17:12:39.196 INFO:teuthology.orchestra.run.smithi087.stdout:107374182464 2024-09-13T17:12:39.196 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-13T17:12:39.426 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:39 smithi087 ceph-mon[30934]: pgmap v316: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T17:12:39.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:39 smithi149 ceph-mon[35496]: pgmap v316: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T17:12:39.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:39 smithi118 ceph-mon[34374]: pgmap v316: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T17:12:39.765 INFO:teuthology.orchestra.run.smithi087.stdout:55834574923 2024-09-13T17:12:39.765 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-13T17:12:39.766 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:12:40.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.896+0000 7fca52996640 1 -- 172.21.15.87:0/4256661744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca4c105110 msgr2=0x7fca4c10cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:40.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.896+0000 7fca52996640 1 --2- 172.21.15.87:0/4256661744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca4c105110 0x7fca4c10cc90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fca44009cd0 tx=0x7fca4402a8e0 comp rx=0 tx=0).stop 2024-09-13T17:12:40.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.896+0000 7fca52996640 1 -- 172.21.15.87:0/4256661744 shutdown_connections 2024-09-13T17:12:40.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.896+0000 7fca52996640 1 --2- 172.21.15.87:0/4256661744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca4c105110 0x7fca4c10cc90 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:40.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.896+0000 7fca52996640 1 --2- 172.21.15.87:0/4256661744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca4c100990 0x7fca4c1049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:40.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.896+0000 7fca52996640 1 --2- 172.21.15.87:0/4256661744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca4c0fffe0 0x7fca4c1003c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:40.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.896+0000 7fca52996640 1 -- 172.21.15.87:0/4256661744 >> 172.21.15.87:0/4256661744 conn(0x7fca4c0fbae0 msgr2=0x7fca4c0fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:40.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.896+0000 7fca52996640 1 -- 172.21.15.87:0/4256661744 shutdown_connections 2024-09-13T17:12:40.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.896+0000 7fca52996640 1 -- 172.21.15.87:0/4256661744 wait complete. 2024-09-13T17:12:40.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.896+0000 7fca52996640 1 Processor -- start 2024-09-13T17:12:40.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.896+0000 7fca52996640 1 -- start start 2024-09-13T17:12:40.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.897+0000 7fca52996640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca4c0fffe0 0x7fca4c196240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:40.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.897+0000 7fca52996640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca4c100990 0x7fca4c196780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:40.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.897+0000 7fca52996640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca4c105110 0x7fca4c19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:40.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.897+0000 7fca52996640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c19b180 con 0x7fca4c100990 2024-09-13T17:12:40.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.897+0000 7fca52996640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c19b2f0 con 0x7fca4c0fffe0 2024-09-13T17:12:40.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.897+0000 7fca52996640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c19b460 con 0x7fca4c105110 2024-09-13T17:12:40.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.897+0000 7fca4b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca4c100990 0x7fca4c196780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:40.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.897+0000 7fca4b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca4c100990 0x7fca4c196780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58246/0 (socket says 172.21.15.87:58246) 2024-09-13T17:12:40.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.897+0000 7fca4b7fe640 1 -- 172.21.15.87:0/3184993517 learned_addr learned my addr 172.21.15.87:0/3184993517 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:12:40.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.897+0000 7fca4bfff640 1 --2- 172.21.15.87:0/3184993517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca4c0fffe0 0x7fca4c196240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:40.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.897+0000 7fca50f33640 1 --2- 172.21.15.87:0/3184993517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca4c105110 0x7fca4c19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:40.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.897+0000 7fca4b7fe640 1 -- 172.21.15.87:0/3184993517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca4c105110 msgr2=0x7fca4c19ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:40.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.897+0000 7fca4b7fe640 1 --2- 172.21.15.87:0/3184993517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca4c105110 0x7fca4c19ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:40.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.897+0000 7fca4b7fe640 1 -- 172.21.15.87:0/3184993517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca4c0fffe0 msgr2=0x7fca4c196240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:40.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.897+0000 7fca4b7fe640 1 --2- 172.21.15.87:0/3184993517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca4c0fffe0 0x7fca4c196240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:40.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.897+0000 7fca4b7fe640 1 -- 172.21.15.87:0/3184993517 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca44009900 con 0x7fca4c100990 2024-09-13T17:12:40.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.897+0000 7fca50f33640 1 --2- 172.21.15.87:0/3184993517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca4c105110 0x7fca4c19ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:12:40.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.898+0000 7fca4b7fe640 1 --2- 172.21.15.87:0/3184993517 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca4c100990 0x7fca4c196780 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fca4000c920 tx=0x7fca4000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:40.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.898+0000 7fca497fa640 1 -- 172.21.15.87:0/3184993517 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca40007c70 con 0x7fca4c100990 2024-09-13T17:12:40.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.898+0000 7fca52996640 1 -- 172.21.15.87:0/3184993517 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca4c19b740 con 0x7fca4c100990 2024-09-13T17:12:40.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.898+0000 7fca497fa640 1 -- 172.21.15.87:0/3184993517 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fca40007dd0 con 0x7fca4c100990 2024-09-13T17:12:40.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.898+0000 7fca52996640 1 -- 172.21.15.87:0/3184993517 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca4c1a3000 con 0x7fca4c100990 2024-09-13T17:12:40.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.898+0000 7fca497fa640 1 -- 172.21.15.87:0/3184993517 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca40005220 con 0x7fca4c100990 2024-09-13T17:12:40.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.899+0000 7fca52996640 1 -- 172.21.15.87:0/3184993517 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca4c1014c0 con 0x7fca4c100990 2024-09-13T17:12:40.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.900+0000 7fca497fa640 1 -- 172.21.15.87:0/3184993517 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fca40005380 con 0x7fca4c100990 2024-09-13T17:12:40.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.901+0000 7fca497fa640 1 --2- 172.21.15.87:0/3184993517 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fca340a1110 0x7fca340a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:40.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.901+0000 7fca4bfff640 1 --2- 172.21.15.87:0/3184993517 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fca340a1110 0x7fca340a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:40.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.901+0000 7fca497fa640 1 -- 172.21.15.87:0/3184993517 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8978+0+0 (secure 0 0 0) 0x7fca400cd120 con 0x7fca4c100990 2024-09-13T17:12:40.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.901+0000 7fca4bfff640 1 --2- 172.21.15.87:0/3184993517 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fca340a1110 0x7fca340a35d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fca3c009890 tx=0x7fca3c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:40.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:40.904+0000 7fca497fa640 1 -- 172.21.15.87:0/3184993517 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fca40096490 con 0x7fca4c100990 2024-09-13T17:12:41.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.070+0000 7fca52996640 1 -- 172.21.15.87:0/3184993517 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7fca4c1003c0 con 0x7fca4c100990 2024-09-13T17:12:41.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.071+0000 7fca497fa640 1 -- 172.21.15.87:0/3184993517 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fca40099ab0 con 0x7fca4c100990 2024-09-13T17:12:41.073 INFO:teuthology.orchestra.run.smithi087.stdout:253403070507 2024-09-13T17:12:41.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.073+0000 7fca52996640 1 -- 172.21.15.87:0/3184993517 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fca340a1110 msgr2=0x7fca340a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:41.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.073+0000 7fca52996640 1 --2- 172.21.15.87:0/3184993517 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fca340a1110 0x7fca340a35d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fca3c009890 tx=0x7fca3c008040 comp rx=0 tx=0).stop 2024-09-13T17:12:41.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.073+0000 7fca52996640 1 -- 172.21.15.87:0/3184993517 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca4c100990 msgr2=0x7fca4c196780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:41.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.073+0000 7fca52996640 1 --2- 172.21.15.87:0/3184993517 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca4c100990 0x7fca4c196780 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fca4000c920 tx=0x7fca4000cde0 comp rx=0 tx=0).stop 2024-09-13T17:12:41.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.073+0000 7fca52996640 1 -- 172.21.15.87:0/3184993517 shutdown_connections 2024-09-13T17:12:41.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.073+0000 7fca52996640 1 --2- 172.21.15.87:0/3184993517 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fca340a1110 0x7fca340a35d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:41.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.073+0000 7fca52996640 1 --2- 172.21.15.87:0/3184993517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca4c105110 0x7fca4c19ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:41.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.073+0000 7fca52996640 1 --2- 172.21.15.87:0/3184993517 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca4c100990 0x7fca4c196780 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:41.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.073+0000 7fca52996640 1 --2- 172.21.15.87:0/3184993517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca4c0fffe0 0x7fca4c196240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:41.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.073+0000 7fca52996640 1 -- 172.21.15.87:0/3184993517 >> 172.21.15.87:0/3184993517 conn(0x7fca4c0fbae0 msgr2=0x7fca4c0fce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:41.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.073+0000 7fca52996640 1 -- 172.21.15.87:0/3184993517 shutdown_connections 2024-09-13T17:12:41.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.073+0000 7fca52996640 1 -- 172.21.15.87:0/3184993517 wait complete. 2024-09-13T17:12:41.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.221+0000 7facfde92640 1 -- 172.21.15.87:0/3951769964 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7facf81051c0 msgr2=0x7facf810bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:41.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.221+0000 7facfde92640 1 --2- 172.21.15.87:0/3951769964 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7facf81051c0 0x7facf810bbf0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7facf0009cd0 tx=0x7facf002a8e0 comp rx=0 tx=0).stop 2024-09-13T17:12:41.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.221+0000 7facfde92640 1 -- 172.21.15.87:0/3951769964 shutdown_connections 2024-09-13T17:12:41.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.221+0000 7facfde92640 1 --2- 172.21.15.87:0/3951769964 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7facf81051c0 0x7facf810bbf0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:41.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.221+0000 7facfde92640 1 --2- 172.21.15.87:0/3951769964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7facf8100650 0x7facf8104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:41.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.221+0000 7facfde92640 1 --2- 172.21.15.87:0/3951769964 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facf80ffca0 0x7facf8100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:41.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.221+0000 7facfde92640 1 -- 172.21.15.87:0/3951769964 >> 172.21.15.87:0/3951769964 conn(0x7facf8074130 msgr2=0x7facf8074540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:41.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.221+0000 7facfde92640 1 -- 172.21.15.87:0/3951769964 shutdown_connections 2024-09-13T17:12:41.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.221+0000 7facfde92640 1 -- 172.21.15.87:0/3951769964 wait complete. 2024-09-13T17:12:41.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.222+0000 7facfde92640 1 Processor -- start 2024-09-13T17:12:41.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.222+0000 7facfde92640 1 -- start start 2024-09-13T17:12:41.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.223+0000 7facfde92640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7facf80ffca0 0x7facf81951c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:41.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.223+0000 7facfde92640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facf8100650 0x7facf8195700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:41.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.223+0000 7facfde92640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7facf81051c0 0x7facf8199ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:41.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.223+0000 7facfde92640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf819a0b0 con 0x7facf81051c0 2024-09-13T17:12:41.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.223+0000 7facfde92640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf819a220 con 0x7facf8100650 2024-09-13T17:12:41.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.223+0000 7facfde92640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf819a390 con 0x7facf80ffca0 2024-09-13T17:12:41.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.223+0000 7facf7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7facf81051c0 0x7facf8199ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:41.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.223+0000 7facf7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7facf81051c0 0x7facf8199ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58276/0 (socket says 172.21.15.87:58276) 2024-09-13T17:12:41.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.223+0000 7facf7fff640 1 -- 172.21.15.87:0/3911879821 learned_addr learned my addr 172.21.15.87:0/3911879821 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:12:41.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.223+0000 7facf77fe640 1 --2- 172.21.15.87:0/3911879821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7facf80ffca0 0x7facf81951c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:41.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.223+0000 7facf6ffd640 1 --2- 172.21.15.87:0/3911879821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facf8100650 0x7facf8195700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:41.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.223+0000 7facf7fff640 1 -- 172.21.15.87:0/3911879821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7facf80ffca0 msgr2=0x7facf81951c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:41.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.223+0000 7facf7fff640 1 --2- 172.21.15.87:0/3911879821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7facf80ffca0 0x7facf81951c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:41.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.223+0000 7facf7fff640 1 -- 172.21.15.87:0/3911879821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facf8100650 msgr2=0x7facf8195700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:41.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.223+0000 7facf7fff640 1 --2- 172.21.15.87:0/3911879821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facf8100650 0x7facf8195700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:41.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.223+0000 7facf7fff640 1 -- 172.21.15.87:0/3911879821 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf0009900 con 0x7facf81051c0 2024-09-13T17:12:41.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.223+0000 7facf6ffd640 1 --2- 172.21.15.87:0/3911879821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facf8100650 0x7facf8195700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:12:41.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.223+0000 7facf7fff640 1 --2- 172.21.15.87:0/3911879821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7facf81051c0 0x7facf8199ab0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7facf0005cc0 tx=0x7facf0030850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:41.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.223+0000 7facf4ff9640 1 -- 172.21.15.87:0/3911879821 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf0031d00 con 0x7facf81051c0 2024-09-13T17:12:41.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.223+0000 7facf4ff9640 1 -- 172.21.15.87:0/3911879821 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7facf0003e20 con 0x7facf81051c0 2024-09-13T17:12:41.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.223+0000 7facfde92640 1 -- 172.21.15.87:0/3911879821 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf819a610 con 0x7facf81051c0 2024-09-13T17:12:41.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.223+0000 7facf4ff9640 1 -- 172.21.15.87:0/3911879821 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf0045410 con 0x7facf81051c0 2024-09-13T17:12:41.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.223+0000 7facfde92640 1 -- 172.21.15.87:0/3911879821 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf81a1f30 con 0x7facf81051c0 2024-09-13T17:12:41.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.224+0000 7facfde92640 1 -- 172.21.15.87:0/3911879821 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7facf80680e0 con 0x7facf81051c0 2024-09-13T17:12:41.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.225+0000 7facf4ff9640 1 -- 172.21.15.87:0/3911879821 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7facf000a040 con 0x7facf81051c0 2024-09-13T17:12:41.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.226+0000 7facf4ff9640 1 --2- 172.21.15.87:0/3911879821 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7face00a1110 0x7face00a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:41.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.226+0000 7facf77fe640 1 --2- 172.21.15.87:0/3911879821 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7face00a1110 0x7face00a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:41.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.226+0000 7facf4ff9640 1 -- 172.21.15.87:0/3911879821 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8978+0+0 (secure 0 0 0) 0x7facf00ee820 con 0x7facf81051c0 2024-09-13T17:12:41.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.226+0000 7facf4ff9640 1 --2- 172.21.15.87:0/3911879821 >> [v2:172.21.15.87:6818/326563617,v1:172.21.15.87:6819/326563617] conn(0x7face00ac0a0 0x7face00ae540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:41.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.226+0000 7facf4ff9640 1 -- 172.21.15.87:0/3911879821 --> [v2:172.21.15.87:6818/326563617,v1:172.21.15.87:6819/326563617] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7face00aec10 con 0x7face00ac0a0 2024-09-13T17:12:41.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.226+0000 7facf4ff9640 1 -- 172.21.15.87:0/3911879821 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7facf00eec30 con 0x7facf81051c0 2024-09-13T17:12:41.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.227+0000 7facf6ffd640 1 --2- 172.21.15.87:0/3911879821 >> [v2:172.21.15.87:6818/326563617,v1:172.21.15.87:6819/326563617] conn(0x7face00ac0a0 0x7face00ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:41.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.227+0000 7facf77fe640 1 --2- 172.21.15.87:0/3911879821 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7face00a1110 0x7face00a35d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7face800bbe0 tx=0x7face800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:41.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.227+0000 7facf6ffd640 1 --2- 172.21.15.87:0/3911879821 >> [v2:172.21.15.87:6818/326563617,v1:172.21.15.87:6819/326563617] conn(0x7face00ac0a0 0x7face00ae540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:41.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.228+0000 7facf4ff9640 1 -- 172.21.15.87:0/3911879821 <== osd.6 v2:172.21.15.87:6818/326563617 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7face00aec10 con 0x7face00ac0a0 2024-09-13T17:12:41.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.244+0000 7facfde92640 1 -- 172.21.15.87:0/3911879821 --> [v2:172.21.15.87:6818/326563617,v1:172.21.15.87:6819/326563617] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7facf810f010 con 0x7face00ac0a0 2024-09-13T17:12:41.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.244+0000 7facf4ff9640 1 -- 172.21.15.87:0/3911879821 <== osd.6 v2:172.21.15.87:6818/326563617 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7facec00b7e0 con 0x7face00ac0a0 2024-09-13T17:12:41.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.244+0000 7facfde92640 1 -- 172.21.15.87:0/3911879821 >> [v2:172.21.15.87:6818/326563617,v1:172.21.15.87:6819/326563617] conn(0x7face00ac0a0 msgr2=0x7face00ae540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:41.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.244+0000 7facfde92640 1 --2- 172.21.15.87:0/3911879821 >> [v2:172.21.15.87:6818/326563617,v1:172.21.15.87:6819/326563617] conn(0x7face00ac0a0 0x7face00ae540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:41.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.244+0000 7facfde92640 1 -- 172.21.15.87:0/3911879821 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7face00a1110 msgr2=0x7face00a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:41.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.244+0000 7facfde92640 1 --2- 172.21.15.87:0/3911879821 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7face00a1110 0x7face00a35d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7face800bbe0 tx=0x7face800b390 comp rx=0 tx=0).stop 2024-09-13T17:12:41.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.244+0000 7facfde92640 1 -- 172.21.15.87:0/3911879821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7facf81051c0 msgr2=0x7facf8199ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:41.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.244+0000 7facfde92640 1 --2- 172.21.15.87:0/3911879821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7facf81051c0 0x7facf8199ab0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7facf0005cc0 tx=0x7facf0030850 comp rx=0 tx=0).stop 2024-09-13T17:12:41.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.244+0000 7facf7fff640 1 -- 172.21.15.87:0/3911879821 reap_dead start 2024-09-13T17:12:41.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.245+0000 7facfde92640 1 -- 172.21.15.87:0/3911879821 shutdown_connections 2024-09-13T17:12:41.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.245+0000 7facfde92640 1 -- 172.21.15.87:0/3911879821 >> 172.21.15.87:0/3911879821 conn(0x7facf8074130 msgr2=0x7facf8102da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:41.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.245+0000 7facfde92640 1 -- 172.21.15.87:0/3911879821 shutdown_connections 2024-09-13T17:12:41.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:41.245+0000 7facfde92640 1 -- 172.21.15.87:0/3911879821 wait complete. 2024-09-13T17:12:41.337 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:41 smithi087 ceph-mon[30934]: pgmap v317: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T17:12:41.337 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:41 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3184993517' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-13T17:12:41.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:41 smithi149 ceph-mon[35496]: pgmap v317: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T17:12:41.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:41 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3184993517' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-13T17:12:41.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:41 smithi118 ceph-mon[34374]: pgmap v317: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T17:12:41.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:41 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3184993517' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-13T17:12:42.993 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070503 got 253403070507 for osd.8 2024-09-13T17:12:42.994 DEBUG:teuthology.parallel:result is None 2024-09-13T17:12:43.221 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:43 smithi087 ceph-mon[30934]: pgmap v318: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-13T17:12:43.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:43 smithi149 ceph-mon[35496]: pgmap v318: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-13T17:12:43.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:43 smithi118 ceph-mon[34374]: pgmap v318: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-13T17:12:44.111 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:12:44.112 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:12:44.147 INFO:teuthology.orchestra.run.smithi087.stdout:197568495668 2024-09-13T17:12:44.147 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-13T17:12:45.216 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:45 smithi087 ceph-mon[30934]: pgmap v319: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-13T17:12:45.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.299+0000 7f52458c4640 1 -- 172.21.15.87:0/3208430154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5240100990 msgr2=0x7f52401049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:45.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.299+0000 7f52458c4640 1 --2- 172.21.15.87:0/3208430154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5240100990 0x7f52401049e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5234009930 tx=0x7f523402a420 comp rx=0 tx=0).stop 2024-09-13T17:12:45.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.299+0000 7f52458c4640 1 -- 172.21.15.87:0/3208430154 shutdown_connections 2024-09-13T17:12:45.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.299+0000 7f52458c4640 1 --2- 172.21.15.87:0/3208430154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5240105110 0x7f524010cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:45.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.299+0000 7f52458c4640 1 --2- 172.21.15.87:0/3208430154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5240100990 0x7f52401049e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:45.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.299+0000 7f52458c4640 1 --2- 172.21.15.87:0/3208430154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52400fffe0 0x7f52401003c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:45.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.299+0000 7f52458c4640 1 -- 172.21.15.87:0/3208430154 >> 172.21.15.87:0/3208430154 conn(0x7f52400fbae0 msgr2=0x7f52400fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:45.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.299+0000 7f52458c4640 1 -- 172.21.15.87:0/3208430154 shutdown_connections 2024-09-13T17:12:45.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.299+0000 7f52458c4640 1 -- 172.21.15.87:0/3208430154 wait complete. 2024-09-13T17:12:45.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.300+0000 7f52458c4640 1 Processor -- start 2024-09-13T17:12:45.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.300+0000 7f52458c4640 1 -- start start 2024-09-13T17:12:45.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.300+0000 7f52458c4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52400fffe0 0x7f5240196420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:45.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.300+0000 7f52458c4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5240100990 0x7f5240196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:45.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.300+0000 7f52458c4640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5240105110 0x7f524019ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:45.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.300+0000 7f52458c4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524019b360 con 0x7f5240100990 2024-09-13T17:12:45.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.300+0000 7f52458c4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524019b4d0 con 0x7f52400fffe0 2024-09-13T17:12:45.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.300+0000 7f52458c4640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524019b640 con 0x7f5240105110 2024-09-13T17:12:45.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.300+0000 7f523e7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5240100990 0x7f5240196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:45.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.300+0000 7f523e7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5240100990 0x7f5240196960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58304/0 (socket says 172.21.15.87:58304) 2024-09-13T17:12:45.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.300+0000 7f523e7fc640 1 -- 172.21.15.87:0/496087605 learned_addr learned my addr 172.21.15.87:0/496087605 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:12:45.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.300+0000 7f523f7fe640 1 --2- 172.21.15.87:0/496087605 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5240105110 0x7f524019ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:45.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.301+0000 7f523effd640 1 --2- 172.21.15.87:0/496087605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52400fffe0 0x7f5240196420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:45.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.301+0000 7f523e7fc640 1 -- 172.21.15.87:0/496087605 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5240105110 msgr2=0x7f524019ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:45.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.301+0000 7f523e7fc640 1 --2- 172.21.15.87:0/496087605 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5240105110 0x7f524019ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:45.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.301+0000 7f523e7fc640 1 -- 172.21.15.87:0/496087605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52400fffe0 msgr2=0x7f5240196420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:45.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.301+0000 7f523e7fc640 1 --2- 172.21.15.87:0/496087605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52400fffe0 0x7f5240196420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:45.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.301+0000 7f523e7fc640 1 -- 172.21.15.87:0/496087605 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5234009560 con 0x7f5240100990 2024-09-13T17:12:45.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.301+0000 7f523e7fc640 1 --2- 172.21.15.87:0/496087605 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5240100990 0x7f5240196960 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5234005760 tx=0x7f5234004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:45.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.301+0000 7f52448c2640 1 -- 172.21.15.87:0/496087605 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5234031a30 con 0x7f5240100990 2024-09-13T17:12:45.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.301+0000 7f52448c2640 1 -- 172.21.15.87:0/496087605 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5234031b90 con 0x7f5240100990 2024-09-13T17:12:45.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.301+0000 7f52448c2640 1 -- 172.21.15.87:0/496087605 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5234032340 con 0x7f5240100990 2024-09-13T17:12:45.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.301+0000 7f52458c4640 1 -- 172.21.15.87:0/496087605 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f524019b8c0 con 0x7f5240100990 2024-09-13T17:12:45.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.301+0000 7f52458c4640 1 -- 172.21.15.87:0/496087605 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52401a3010 con 0x7f5240100990 2024-09-13T17:12:45.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.302+0000 7f52458c4640 1 -- 172.21.15.87:0/496087605 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52401014c0 con 0x7f5240100990 2024-09-13T17:12:45.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.303+0000 7f52448c2640 1 -- 172.21.15.87:0/496087605 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f5234031d00 con 0x7f5240100990 2024-09-13T17:12:45.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.304+0000 7f52448c2640 1 --2- 172.21.15.87:0/496087605 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f52280a1110 0x7f52280a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:45.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.304+0000 7f523effd640 1 --2- 172.21.15.87:0/496087605 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f52280a1110 0x7f52280a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:45.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.304+0000 7f52448c2640 1 -- 172.21.15.87:0/496087605 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8978+0+0 (secure 0 0 0) 0x7f52340edcf0 con 0x7f5240100990 2024-09-13T17:12:45.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.304+0000 7f523effd640 1 --2- 172.21.15.87:0/496087605 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f52280a1110 0x7f52280a35d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5230009990 tx=0x7f5230009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:45.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.307+0000 7f52448c2640 1 -- 172.21.15.87:0/496087605 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f52340b7010 con 0x7f5240100990 2024-09-13T17:12:45.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.475+0000 7f52458c4640 1 -- 172.21.15.87:0/496087605 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f5240100440 con 0x7f5240100990 2024-09-13T17:12:45.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.475+0000 7f52448c2640 1 -- 172.21.15.87:0/496087605 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f523403f020 con 0x7f5240100990 2024-09-13T17:12:45.477 INFO:teuthology.orchestra.run.smithi087.stdout:141733920830 2024-09-13T17:12:45.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.477+0000 7f52458c4640 1 -- 172.21.15.87:0/496087605 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f52280a1110 msgr2=0x7f52280a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:45.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.477+0000 7f52458c4640 1 --2- 172.21.15.87:0/496087605 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f52280a1110 0x7f52280a35d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5230009990 tx=0x7f5230009110 comp rx=0 tx=0).stop 2024-09-13T17:12:45.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.477+0000 7f52458c4640 1 -- 172.21.15.87:0/496087605 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5240100990 msgr2=0x7f5240196960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:45.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.477+0000 7f52458c4640 1 --2- 172.21.15.87:0/496087605 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5240100990 0x7f5240196960 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5234005760 tx=0x7f5234004270 comp rx=0 tx=0).stop 2024-09-13T17:12:45.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.477+0000 7f52458c4640 1 -- 172.21.15.87:0/496087605 shutdown_connections 2024-09-13T17:12:45.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.477+0000 7f52458c4640 1 --2- 172.21.15.87:0/496087605 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f52280a1110 0x7f52280a35d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:45.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.477+0000 7f52458c4640 1 --2- 172.21.15.87:0/496087605 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5240105110 0x7f524019ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:45.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.477+0000 7f52458c4640 1 --2- 172.21.15.87:0/496087605 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5240100990 0x7f5240196960 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:45.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.478+0000 7f52458c4640 1 --2- 172.21.15.87:0/496087605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52400fffe0 0x7f5240196420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:45.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.478+0000 7f52458c4640 1 -- 172.21.15.87:0/496087605 >> 172.21.15.87:0/496087605 conn(0x7f52400fbae0 msgr2=0x7f52400fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:45.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.478+0000 7f52458c4640 1 -- 172.21.15.87:0/496087605 shutdown_connections 2024-09-13T17:12:45.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:45.478+0000 7f52458c4640 1 -- 172.21.15.87:0/496087605 wait complete. 2024-09-13T17:12:45.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:45 smithi149 ceph-mon[35496]: pgmap v319: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-13T17:12:45.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:45 smithi118 ceph-mon[34374]: pgmap v319: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-13T17:12:46.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.125+0000 7f5465d0a640 1 -- 172.21.15.87:0/2169268945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54601009a0 msgr2=0x7f54601049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:46.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.125+0000 7f5465d0a640 1 --2- 172.21.15.87:0/2169268945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54601009a0 0x7f54601049f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5454009930 tx=0x7f545402a420 comp rx=0 tx=0).stop 2024-09-13T17:12:46.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.125+0000 7f5465d0a640 1 -- 172.21.15.87:0/2169268945 shutdown_connections 2024-09-13T17:12:46.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.125+0000 7f5465d0a640 1 --2- 172.21.15.87:0/2169268945 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5460105120 0x7f546010cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:46.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.125+0000 7f5465d0a640 1 --2- 172.21.15.87:0/2169268945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54601009a0 0x7f54601049f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:46.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.125+0000 7f5465d0a640 1 --2- 172.21.15.87:0/2169268945 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54600ffff0 0x7f54601003d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:46.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.125+0000 7f5465d0a640 1 -- 172.21.15.87:0/2169268945 >> 172.21.15.87:0/2169268945 conn(0x7f54600fba90 msgr2=0x7f54600fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:46.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.125+0000 7f5465d0a640 1 -- 172.21.15.87:0/2169268945 shutdown_connections 2024-09-13T17:12:46.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.125+0000 7f5465d0a640 1 -- 172.21.15.87:0/2169268945 wait complete. 2024-09-13T17:12:46.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.126+0000 7f5465d0a640 1 Processor -- start 2024-09-13T17:12:46.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.126+0000 7f5465d0a640 1 -- start start 2024-09-13T17:12:46.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.126+0000 7f5465d0a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54600ffff0 0x7f54601963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:46.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.126+0000 7f5465d0a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54601009a0 0x7f54601968f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:46.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.126+0000 7f5465d0a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5460105120 0x7f546019ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:46.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.126+0000 7f5465d0a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546019b250 con 0x7f5460105120 2024-09-13T17:12:46.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.126+0000 7f5465d0a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546019b3c0 con 0x7f54601009a0 2024-09-13T17:12:46.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.126+0000 7f5465d0a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546019b530 con 0x7f54600ffff0 2024-09-13T17:12:46.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.126+0000 7f545ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5460105120 0x7f546019ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:46.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.127+0000 7f545ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5460105120 0x7f546019ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58330/0 (socket says 172.21.15.87:58330) 2024-09-13T17:12:46.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.127+0000 7f545ffff640 1 -- 172.21.15.87:0/3298385222 learned_addr learned my addr 172.21.15.87:0/3298385222 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:12:46.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.127+0000 7f545f7fe640 1 --2- 172.21.15.87:0/3298385222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54600ffff0 0x7f54601963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:46.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.127+0000 7f545effd640 1 --2- 172.21.15.87:0/3298385222 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54601009a0 0x7f54601968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:46.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.127+0000 7f545ffff640 1 -- 172.21.15.87:0/3298385222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54600ffff0 msgr2=0x7f54601963b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:46.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.127+0000 7f545ffff640 1 --2- 172.21.15.87:0/3298385222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54600ffff0 0x7f54601963b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:46.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.127+0000 7f545ffff640 1 -- 172.21.15.87:0/3298385222 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54601009a0 msgr2=0x7f54601968f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:46.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.127+0000 7f545ffff640 1 --2- 172.21.15.87:0/3298385222 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54601009a0 0x7f54601968f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:46.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.127+0000 7f545ffff640 1 -- 172.21.15.87:0/3298385222 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5454009560 con 0x7f5460105120 2024-09-13T17:12:46.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.127+0000 7f545effd640 1 --2- 172.21.15.87:0/3298385222 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54601009a0 0x7f54601968f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:12:46.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.127+0000 7f545ffff640 1 --2- 172.21.15.87:0/3298385222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5460105120 0x7f546019ac50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f545800d750 tx=0x7f545800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:46.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.127+0000 7f545cff9640 1 -- 172.21.15.87:0/3298385222 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5458009bd0 con 0x7f5460105120 2024-09-13T17:12:46.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.127+0000 7f545cff9640 1 -- 172.21.15.87:0/3298385222 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f545800de60 con 0x7f5460105120 2024-09-13T17:12:46.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.127+0000 7f5465d0a640 1 -- 172.21.15.87:0/3298385222 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f546019b810 con 0x7f5460105120 2024-09-13T17:12:46.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.127+0000 7f545cff9640 1 -- 172.21.15.87:0/3298385222 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5458004dd0 con 0x7f5460105120 2024-09-13T17:12:46.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.127+0000 7f5465d0a640 1 -- 172.21.15.87:0/3298385222 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54601a30d0 con 0x7f5460105120 2024-09-13T17:12:46.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.129+0000 7f5465d0a640 1 -- 172.21.15.87:0/3298385222 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54601014d0 con 0x7f5460105120 2024-09-13T17:12:46.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.131+0000 7f545cff9640 1 -- 172.21.15.87:0/3298385222 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f5458010460 con 0x7f5460105120 2024-09-13T17:12:46.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.132+0000 7f545cff9640 1 --2- 172.21.15.87:0/3298385222 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f54480a1190 0x7f54480a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:46.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.132+0000 7f545cff9640 1 -- 172.21.15.87:0/3298385222 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8978+0+0 (secure 0 0 0) 0x7f54580cc6a0 con 0x7f5460105120 2024-09-13T17:12:46.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.132+0000 7f545f7fe640 1 --2- 172.21.15.87:0/3298385222 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f54480a1190 0x7f54480a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:46.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.133+0000 7f545f7fe640 1 --2- 172.21.15.87:0/3298385222 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f54480a1190 0x7f54480a3650 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f545000a400 tx=0x7f545000d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:46.137 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:12:46.138 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:12:46.138 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:12:46.138 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:12:46.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.139+0000 7f545cff9640 1 -- 172.21.15.87:0/3298385222 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5458099470 con 0x7f5460105120 2024-09-13T17:12:46.143 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:12:46.303 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:46 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/496087605' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T17:12:46.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.332+0000 7f5465d0a640 1 -- 172.21.15.87:0/3298385222 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f54601977b0 con 0x7f5460105120 2024-09-13T17:12:46.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.333+0000 7f545cff9640 1 -- 172.21.15.87:0/3298385222 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f5458099000 con 0x7f5460105120 2024-09-13T17:12:46.335 INFO:teuthology.orchestra.run.smithi087.stdout:309237645346 2024-09-13T17:12:46.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.335+0000 7f5465d0a640 1 -- 172.21.15.87:0/3298385222 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f54480a1190 msgr2=0x7f54480a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:46.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.335+0000 7f5465d0a640 1 --2- 172.21.15.87:0/3298385222 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f54480a1190 0x7f54480a3650 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f545000a400 tx=0x7f545000d040 comp rx=0 tx=0).stop 2024-09-13T17:12:46.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.335+0000 7f5465d0a640 1 -- 172.21.15.87:0/3298385222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5460105120 msgr2=0x7f546019ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:46.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.335+0000 7f5465d0a640 1 --2- 172.21.15.87:0/3298385222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5460105120 0x7f546019ac50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f545800d750 tx=0x7f545800dc10 comp rx=0 tx=0).stop 2024-09-13T17:12:46.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.335+0000 7f5465d0a640 1 -- 172.21.15.87:0/3298385222 shutdown_connections 2024-09-13T17:12:46.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.335+0000 7f5465d0a640 1 --2- 172.21.15.87:0/3298385222 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f54480a1190 0x7f54480a3650 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:46.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.335+0000 7f5465d0a640 1 --2- 172.21.15.87:0/3298385222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5460105120 0x7f546019ac50 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:46.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.335+0000 7f5465d0a640 1 --2- 172.21.15.87:0/3298385222 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54601009a0 0x7f54601968f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:46.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.335+0000 7f5465d0a640 1 --2- 172.21.15.87:0/3298385222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54600ffff0 0x7f54601963b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:46.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.335+0000 7f5465d0a640 1 -- 172.21.15.87:0/3298385222 >> 172.21.15.87:0/3298385222 conn(0x7f54600fba90 msgr2=0x7f54600fcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:46.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.335+0000 7f5465d0a640 1 -- 172.21.15.87:0/3298385222 shutdown_connections 2024-09-13T17:12:46.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:46.335+0000 7f5465d0a640 1 -- 172.21.15.87:0/3298385222 wait complete. 2024-09-13T17:12:46.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:46 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/496087605' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T17:12:46.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:46 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/496087605' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T17:12:47.234 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920825 got 141733920830 for osd.4 2024-09-13T17:12:47.234 DEBUG:teuthology.parallel:result is None 2024-09-13T17:12:47.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:47 smithi087 ceph-mon[30934]: pgmap v320: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:12:47.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:47 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3298385222' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-13T17:12:47.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:47 smithi149 ceph-mon[35496]: pgmap v320: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:12:47.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:47 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3298385222' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-13T17:12:47.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:47 smithi118 ceph-mon[34374]: pgmap v320: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:12:47.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:47 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3298385222' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-13T17:12:49.209 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645341 got 309237645346 for osd.10 2024-09-13T17:12:49.210 DEBUG:teuthology.parallel:result is None 2024-09-13T17:12:49.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:49 smithi087 ceph-mon[30934]: pgmap v321: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T17:12:49.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]: dispatch 2024-09-13T17:12:49.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2024-09-13T17:12:49.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-13T17:12:49.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-09-13T17:12:49.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]: dispatch 2024-09-13T17:12:49.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2024-09-13T17:12:49.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 10]}]: dispatch 2024-09-13T17:12:49.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:49 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [5, 8]}]: dispatch 2024-09-13T17:12:49.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:49 smithi149 ceph-mon[35496]: pgmap v321: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T17:12:49.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]: dispatch 2024-09-13T17:12:49.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2024-09-13T17:12:49.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-13T17:12:49.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-09-13T17:12:49.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]: dispatch 2024-09-13T17:12:49.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2024-09-13T17:12:49.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 10]}]: dispatch 2024-09-13T17:12:49.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:49 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [5, 8]}]: dispatch 2024-09-13T17:12:49.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:49 smithi118 ceph-mon[34374]: pgmap v321: 129 pgs: 129 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T17:12:49.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]: dispatch 2024-09-13T17:12:49.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2024-09-13T17:12:49.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-13T17:12:49.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-09-13T17:12:49.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]: dispatch 2024-09-13T17:12:49.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2024-09-13T17:12:49.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 10]}]: dispatch 2024-09-13T17:12:49.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:49 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [5, 8]}]: dispatch 2024-09-13T17:12:50.269 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:50 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]': finished 2024-09-13T17:12:50.269 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:50 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2024-09-13T17:12:50.269 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:50 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-13T17:12:50.269 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:50 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-13T17:12:50.269 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:50 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-09-13T17:12:50.269 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:50 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2024-09-13T17:12:50.269 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:50 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 10]}]': finished 2024-09-13T17:12:50.270 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:50 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [5, 8]}]': finished 2024-09-13T17:12:50.270 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:50 smithi087 ceph-mon[30934]: osdmap e92: 12 total, 12 up, 12 in 2024-09-13T17:12:50.270 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:50 smithi087 ceph-mon[30934]: osdmap e93: 12 total, 12 up, 12 in 2024-09-13T17:12:50.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:50 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]': finished 2024-09-13T17:12:50.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:50 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2024-09-13T17:12:50.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:50 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-13T17:12:50.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:50 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-13T17:12:50.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:50 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-09-13T17:12:50.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:50 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2024-09-13T17:12:50.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:50 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 10]}]': finished 2024-09-13T17:12:50.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:50 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [5, 8]}]': finished 2024-09-13T17:12:50.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:50 smithi149 ceph-mon[35496]: osdmap e92: 12 total, 12 up, 12 in 2024-09-13T17:12:50.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:50 smithi149 ceph-mon[35496]: osdmap e93: 12 total, 12 up, 12 in 2024-09-13T17:12:50.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:50 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]': finished 2024-09-13T17:12:50.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:50 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2024-09-13T17:12:50.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:50 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-13T17:12:50.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:50 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-13T17:12:50.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:50 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-09-13T17:12:50.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:50 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2024-09-13T17:12:50.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:50 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 10]}]': finished 2024-09-13T17:12:50.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:50 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [5, 8]}]': finished 2024-09-13T17:12:50.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:50 smithi118 ceph-mon[34374]: osdmap e92: 12 total, 12 up, 12 in 2024-09-13T17:12:50.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:50 smithi118 ceph-mon[34374]: osdmap e93: 12 total, 12 up, 12 in 2024-09-13T17:12:51.382 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:51 smithi087 ceph-mon[30934]: pgmap v323: 129 pgs: 2 peering, 127 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-13T17:12:51.382 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:51 smithi087 ceph-mon[30934]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-13T17:12:51.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:51 smithi149 ceph-mon[35496]: pgmap v323: 129 pgs: 2 peering, 127 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-13T17:12:51.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:51 smithi149 ceph-mon[35496]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-13T17:12:51.612 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:51 smithi118 ceph-mon[34374]: pgmap v323: 129 pgs: 2 peering, 127 active+clean; 641 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-13T17:12:51.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:51 smithi118 ceph-mon[34374]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-13T17:12:53.472 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:53 smithi087 ceph-mon[30934]: pgmap v325: 129 pgs: 2 peering, 127 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-09-13T17:12:53.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:53 smithi149 ceph-mon[35496]: pgmap v325: 129 pgs: 2 peering, 127 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-09-13T17:12:53.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:53 smithi118 ceph-mon[34374]: pgmap v325: 129 pgs: 2 peering, 127 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-09-13T17:12:54.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.065+0000 7fd34accb640 1 -- 172.21.15.87:0/1062674976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3441050f0 msgr2=0x7fd34410cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:54.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.065+0000 7fd34accb640 1 --2- 172.21.15.87:0/1062674976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3441050f0 0x7fd34410cc70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd33c009cd0 tx=0x7fd33c02a8e0 comp rx=0 tx=0).stop 2024-09-13T17:12:54.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.065+0000 7fd34accb640 1 -- 172.21.15.87:0/1062674976 shutdown_connections 2024-09-13T17:12:54.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.065+0000 7fd34accb640 1 --2- 172.21.15.87:0/1062674976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3441050f0 0x7fd34410cc70 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:54.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.065+0000 7fd34accb640 1 --2- 172.21.15.87:0/1062674976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd344100970 0x7fd3441049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:54.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.065+0000 7fd34accb640 1 --2- 172.21.15.87:0/1062674976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3440fffc0 0x7fd3441003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:54.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.065+0000 7fd34accb640 1 -- 172.21.15.87:0/1062674976 >> 172.21.15.87:0/1062674976 conn(0x7fd3440fbaa0 msgr2=0x7fd3440fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:54.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.065+0000 7fd34accb640 1 -- 172.21.15.87:0/1062674976 shutdown_connections 2024-09-13T17:12:54.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.065+0000 7fd34accb640 1 -- 172.21.15.87:0/1062674976 wait complete. 2024-09-13T17:12:54.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.066+0000 7fd34accb640 1 Processor -- start 2024-09-13T17:12:54.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.066+0000 7fd34accb640 1 -- start start 2024-09-13T17:12:54.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.066+0000 7fd34accb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3440fffc0 0x7fd3441961c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:54.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.066+0000 7fd34accb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd344100970 0x7fd344196700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:54.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.066+0000 7fd34accb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3441050f0 0x7fd34419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:54.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.066+0000 7fd34accb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34419b100 con 0x7fd344100970 2024-09-13T17:12:54.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.066+0000 7fd34accb640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34419b270 con 0x7fd3440fffc0 2024-09-13T17:12:54.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.066+0000 7fd34accb640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34419b3e0 con 0x7fd3441050f0 2024-09-13T17:12:54.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.066+0000 7fd343fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd344100970 0x7fd344196700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:54.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.066+0000 7fd343fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd344100970 0x7fd344196700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:53960/0 (socket says 172.21.15.87:53960) 2024-09-13T17:12:54.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.066+0000 7fd343fff640 1 -- 172.21.15.87:0/2352455103 learned_addr learned my addr 172.21.15.87:0/2352455103 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:12:54.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.066+0000 7fd348a67640 1 --2- 172.21.15.87:0/2352455103 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3440fffc0 0x7fd3441961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:54.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.067+0000 7fd349268640 1 --2- 172.21.15.87:0/2352455103 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3441050f0 0x7fd34419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:54.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.067+0000 7fd343fff640 1 -- 172.21.15.87:0/2352455103 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3441050f0 msgr2=0x7fd34419ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:54.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.067+0000 7fd343fff640 1 --2- 172.21.15.87:0/2352455103 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3441050f0 0x7fd34419ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:54.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.067+0000 7fd343fff640 1 -- 172.21.15.87:0/2352455103 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3440fffc0 msgr2=0x7fd3441961c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:54.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.067+0000 7fd343fff640 1 --2- 172.21.15.87:0/2352455103 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3440fffc0 0x7fd3441961c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:54.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.067+0000 7fd343fff640 1 -- 172.21.15.87:0/2352455103 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c009900 con 0x7fd344100970 2024-09-13T17:12:54.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.067+0000 7fd349268640 1 --2- 172.21.15.87:0/2352455103 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3441050f0 0x7fd34419ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:12:54.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.067+0000 7fd343fff640 1 --2- 172.21.15.87:0/2352455103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd344100970 0x7fd344196700 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd33000b4a0 tx=0x7fd33000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:54.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.067+0000 7fd341ffb640 1 -- 172.21.15.87:0/2352455103 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd330011830 con 0x7fd344100970 2024-09-13T17:12:54.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.067+0000 7fd341ffb640 1 -- 172.21.15.87:0/2352455103 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd330011e40 con 0x7fd344100970 2024-09-13T17:12:54.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.067+0000 7fd34accb640 1 -- 172.21.15.87:0/2352455103 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd34419b6c0 con 0x7fd344100970 2024-09-13T17:12:54.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.067+0000 7fd341ffb640 1 -- 172.21.15.87:0/2352455103 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33000f2e0 con 0x7fd344100970 2024-09-13T17:12:54.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.067+0000 7fd34accb640 1 -- 172.21.15.87:0/2352455103 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3441a2f80 con 0x7fd344100970 2024-09-13T17:12:54.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.068+0000 7fd34accb640 1 -- 172.21.15.87:0/2352455103 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3441014a0 con 0x7fd344100970 2024-09-13T17:12:54.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.069+0000 7fd341ffb640 1 -- 172.21.15.87:0/2352455103 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fd330011990 con 0x7fd344100970 2024-09-13T17:12:54.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.070+0000 7fd341ffb640 1 --2- 172.21.15.87:0/2352455103 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd3340a1110 0x7fd3340a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:54.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.070+0000 7fd348a67640 1 --2- 172.21.15.87:0/2352455103 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd3340a1110 0x7fd3340a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:54.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.070+0000 7fd341ffb640 1 -- 172.21.15.87:0/2352455103 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7fd3300cc910 con 0x7fd344100970 2024-09-13T17:12:54.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.071+0000 7fd348a67640 1 --2- 172.21.15.87:0/2352455103 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd3340a1110 0x7fd3340a35d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd33800abe0 tx=0x7fd33800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:54.352 INFO:teuthology.orchestra.run.smithi087.stdout:107374182468 2024-09-13T17:12:54.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.074+0000 7fd341ffb640 1 -- 172.21.15.87:0/2352455103 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd330095c80 con 0x7fd344100970 2024-09-13T17:12:54.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.246+0000 7fd34accb640 1 -- 172.21.15.87:0/2352455103 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd3441082d0 con 0x7fd344100970 2024-09-13T17:12:54.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.247+0000 7fd341ffb640 1 -- 172.21.15.87:0/2352455103 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd3300992a0 con 0x7fd344100970 2024-09-13T17:12:54.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.249+0000 7fd34accb640 1 -- 172.21.15.87:0/2352455103 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd3340a1110 msgr2=0x7fd3340a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:54.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.249+0000 7fd34accb640 1 --2- 172.21.15.87:0/2352455103 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd3340a1110 0x7fd3340a35d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd33800abe0 tx=0x7fd33800a2d0 comp rx=0 tx=0).stop 2024-09-13T17:12:54.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.249+0000 7fd34accb640 1 -- 172.21.15.87:0/2352455103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd344100970 msgr2=0x7fd344196700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:54.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.249+0000 7fd34accb640 1 --2- 172.21.15.87:0/2352455103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd344100970 0x7fd344196700 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd33000b4a0 tx=0x7fd33000b8a0 comp rx=0 tx=0).stop 2024-09-13T17:12:54.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.249+0000 7fd34accb640 1 -- 172.21.15.87:0/2352455103 shutdown_connections 2024-09-13T17:12:54.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.249+0000 7fd34accb640 1 --2- 172.21.15.87:0/2352455103 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd3340a1110 0x7fd3340a35d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:54.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.249+0000 7fd34accb640 1 --2- 172.21.15.87:0/2352455103 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3441050f0 0x7fd34419ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:54.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.249+0000 7fd34accb640 1 --2- 172.21.15.87:0/2352455103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd344100970 0x7fd344196700 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:54.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.249+0000 7fd34accb640 1 --2- 172.21.15.87:0/2352455103 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3440fffc0 0x7fd3441961c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:54.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.249+0000 7fd34accb640 1 -- 172.21.15.87:0/2352455103 >> 172.21.15.87:0/2352455103 conn(0x7fd3440fbaa0 msgr2=0x7fd3440fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:54.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.249+0000 7fd34accb640 1 -- 172.21.15.87:0/2352455103 shutdown_connections 2024-09-13T17:12:54.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:54.249+0000 7fd34accb640 1 -- 172.21.15.87:0/2352455103 wait complete. 2024-09-13T17:12:55.395 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:55 smithi087 ceph-mon[30934]: pgmap v326: 129 pgs: 2 peering, 127 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s; 72 B/s, 0 objects/s recovering 2024-09-13T17:12:55.395 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:55 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2352455103' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T17:12:55.395 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:55 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:12:55.395 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:55 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:12:55.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.249+0000 7f946b177640 1 -- 172.21.15.87:0/1324382779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9464105130 msgr2=0x7f946410ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:55.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.249+0000 7f946b177640 1 --2- 172.21.15.87:0/1324382779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9464105130 0x7f946410ccb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f945c009cd0 tx=0x7f945c02a8e0 comp rx=0 tx=0).stop 2024-09-13T17:12:55.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.249+0000 7f946b177640 1 -- 172.21.15.87:0/1324382779 shutdown_connections 2024-09-13T17:12:55.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.249+0000 7f946b177640 1 --2- 172.21.15.87:0/1324382779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9464105130 0x7f946410ccb0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:55.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.249+0000 7f946b177640 1 --2- 172.21.15.87:0/1324382779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94641009b0 0x7f9464104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:55.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.249+0000 7f946b177640 1 --2- 172.21.15.87:0/1324382779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9464100000 0x7f94641003e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:55.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.249+0000 7f946b177640 1 -- 172.21.15.87:0/1324382779 >> 172.21.15.87:0/1324382779 conn(0x7f94640fba80 msgr2=0x7f94640fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:55.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.249+0000 7f946b177640 1 -- 172.21.15.87:0/1324382779 shutdown_connections 2024-09-13T17:12:55.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.249+0000 7f946b177640 1 -- 172.21.15.87:0/1324382779 wait complete. 2024-09-13T17:12:55.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.249+0000 7f946b177640 1 Processor -- start 2024-09-13T17:12:55.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.250+0000 7f946b177640 1 -- start start 2024-09-13T17:12:55.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.250+0000 7f946b177640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9464100000 0x7f9464196360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:55.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.250+0000 7f946b177640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94641009b0 0x7f94641968a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:55.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.250+0000 7f946b177640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9464105130 0x7f946419aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:55.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.250+0000 7f946b177640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946419b2a0 con 0x7f9464105130 2024-09-13T17:12:55.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.250+0000 7f946b177640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946419b410 con 0x7f9464100000 2024-09-13T17:12:55.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.250+0000 7f946b177640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946419b580 con 0x7f94641009b0 2024-09-13T17:12:55.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.250+0000 7f9469714640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9464105130 0x7f946419aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:55.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.250+0000 7f9469714640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9464105130 0x7f946419aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:53978/0 (socket says 172.21.15.87:53978) 2024-09-13T17:12:55.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.250+0000 7f9469714640 1 -- 172.21.15.87:0/2510478224 learned_addr learned my addr 172.21.15.87:0/2510478224 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:12:55.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.250+0000 7f9468f13640 1 --2- 172.21.15.87:0/2510478224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9464100000 0x7f9464196360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:55.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.250+0000 7f9463fff640 1 --2- 172.21.15.87:0/2510478224 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94641009b0 0x7f94641968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:55.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.250+0000 7f9469714640 1 -- 172.21.15.87:0/2510478224 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94641009b0 msgr2=0x7f94641968a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:55.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.251+0000 7f9469714640 1 --2- 172.21.15.87:0/2510478224 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94641009b0 0x7f94641968a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:55.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.251+0000 7f9469714640 1 -- 172.21.15.87:0/2510478224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9464100000 msgr2=0x7f9464196360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:55.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.251+0000 7f9469714640 1 --2- 172.21.15.87:0/2510478224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9464100000 0x7f9464196360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:55.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.251+0000 7f9469714640 1 -- 172.21.15.87:0/2510478224 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945c009900 con 0x7f9464105130 2024-09-13T17:12:55.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.251+0000 7f9463fff640 1 --2- 172.21.15.87:0/2510478224 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94641009b0 0x7f94641968a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:12:55.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.251+0000 7f9468f13640 1 --2- 172.21.15.87:0/2510478224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9464100000 0x7f9464196360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:12:55.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.251+0000 7f9469714640 1 --2- 172.21.15.87:0/2510478224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9464105130 0x7f946419aca0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f945c005cc0 tx=0x7f945c030850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:55.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.251+0000 7f9461ffb640 1 -- 172.21.15.87:0/2510478224 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945c031c80 con 0x7f9464105130 2024-09-13T17:12:55.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.251+0000 7f9461ffb640 1 -- 172.21.15.87:0/2510478224 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f945c003e20 con 0x7f9464105130 2024-09-13T17:12:55.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.251+0000 7f9461ffb640 1 -- 172.21.15.87:0/2510478224 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945c045410 con 0x7f9464105130 2024-09-13T17:12:55.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.251+0000 7f946b177640 1 -- 172.21.15.87:0/2510478224 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f946419b800 con 0x7f9464105130 2024-09-13T17:12:55.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.251+0000 7f946b177640 1 -- 172.21.15.87:0/2510478224 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94641a2f50 con 0x7f9464105130 2024-09-13T17:12:55.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.252+0000 7f946b177640 1 -- 172.21.15.87:0/2510478224 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94641014e0 con 0x7f9464105130 2024-09-13T17:12:55.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.253+0000 7f9461ffb640 1 -- 172.21.15.87:0/2510478224 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f945c00a040 con 0x7f9464105130 2024-09-13T17:12:55.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.254+0000 7f9461ffb640 1 --2- 172.21.15.87:0/2510478224 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f94540a1110 0x7f94540a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:55.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.254+0000 7f9468f13640 1 --2- 172.21.15.87:0/2510478224 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f94540a1110 0x7f94540a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:55.549 INFO:teuthology.orchestra.run.smithi087.stdout:343597383711 2024-09-13T17:12:55.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.254+0000 7f9461ffb640 1 -- 172.21.15.87:0/2510478224 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f945c0ee630 con 0x7f9464105130 2024-09-13T17:12:55.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.255+0000 7f9468f13640 1 --2- 172.21.15.87:0/2510478224 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f94540a1110 0x7f94540a35d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9458009b40 tx=0x7f9458005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:55.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.260+0000 7f9461ffb640 1 -- 172.21.15.87:0/2510478224 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f945c0b7920 con 0x7f9464105130 2024-09-13T17:12:55.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.450+0000 7f946b177640 1 -- 172.21.15.87:0/2510478224 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f9464108370 con 0x7f9464105130 2024-09-13T17:12:55.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.450+0000 7f9461ffb640 1 -- 172.21.15.87:0/2510478224 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f945c0baf40 con 0x7f9464105130 2024-09-13T17:12:55.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.452+0000 7f946b177640 1 -- 172.21.15.87:0/2510478224 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f94540a1110 msgr2=0x7f94540a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:55.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.452+0000 7f946b177640 1 --2- 172.21.15.87:0/2510478224 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f94540a1110 0x7f94540a35d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9458009b40 tx=0x7f9458005e50 comp rx=0 tx=0).stop 2024-09-13T17:12:55.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.452+0000 7f946b177640 1 -- 172.21.15.87:0/2510478224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9464105130 msgr2=0x7f946419aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:55.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.452+0000 7f946b177640 1 --2- 172.21.15.87:0/2510478224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9464105130 0x7f946419aca0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f945c005cc0 tx=0x7f945c030850 comp rx=0 tx=0).stop 2024-09-13T17:12:55.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.452+0000 7f946b177640 1 -- 172.21.15.87:0/2510478224 shutdown_connections 2024-09-13T17:12:55.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.452+0000 7f946b177640 1 --2- 172.21.15.87:0/2510478224 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f94540a1110 0x7f94540a35d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:55.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.452+0000 7f946b177640 1 --2- 172.21.15.87:0/2510478224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9464105130 0x7f946419aca0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:55.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.452+0000 7f946b177640 1 --2- 172.21.15.87:0/2510478224 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94641009b0 0x7f94641968a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:55.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.452+0000 7f946b177640 1 --2- 172.21.15.87:0/2510478224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9464100000 0x7f9464196360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:55.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.452+0000 7f946b177640 1 -- 172.21.15.87:0/2510478224 >> 172.21.15.87:0/2510478224 conn(0x7f94640fba80 msgr2=0x7f94640fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:55.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.452+0000 7f946b177640 1 -- 172.21.15.87:0/2510478224 shutdown_connections 2024-09-13T17:12:55.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:55.453+0000 7f946b177640 1 -- 172.21.15.87:0/2510478224 wait complete. 2024-09-13T17:12:55.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:55 smithi149 ceph-mon[35496]: pgmap v326: 129 pgs: 2 peering, 127 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s; 72 B/s, 0 objects/s recovering 2024-09-13T17:12:55.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:55 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2352455103' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T17:12:55.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:55 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:12:55.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:55 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:12:55.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:55 smithi118 ceph-mon[34374]: pgmap v326: 129 pgs: 2 peering, 127 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s; 72 B/s, 0 objects/s recovering 2024-09-13T17:12:55.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:55 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2352455103' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T17:12:55.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:55 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:12:55.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:55 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:12:56.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.197+0000 7f2644d1e640 1 -- 172.21.15.87:0/3569595556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26400ff8b0 msgr2=0x7f2640103900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:56.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.197+0000 7f2644d1e640 1 --2- 172.21.15.87:0/3569595556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26400ff8b0 0x7f2640103900 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2628009930 tx=0x7f262802a420 comp rx=0 tx=0).stop 2024-09-13T17:12:56.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.197+0000 7f2644d1e640 1 -- 172.21.15.87:0/3569595556 shutdown_connections 2024-09-13T17:12:56.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.197+0000 7f2644d1e640 1 --2- 172.21.15.87:0/3569595556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2640104030 0x7f264010bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:56.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.197+0000 7f2644d1e640 1 --2- 172.21.15.87:0/3569595556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26400ff8b0 0x7f2640103900 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:56.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.197+0000 7f2644d1e640 1 --2- 172.21.15.87:0/3569595556 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26400fef00 0x7f26400ff2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:56.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.197+0000 7f2644d1e640 1 -- 172.21.15.87:0/3569595556 >> 172.21.15.87:0/3569595556 conn(0x7f26400fa9a0 msgr2=0x7f26400fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:56.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.197+0000 7f2644d1e640 1 -- 172.21.15.87:0/3569595556 shutdown_connections 2024-09-13T17:12:56.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.197+0000 7f2644d1e640 1 -- 172.21.15.87:0/3569595556 wait complete. 2024-09-13T17:12:56.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.198+0000 7f2644d1e640 1 Processor -- start 2024-09-13T17:12:56.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.198+0000 7f2644d1e640 1 -- start start 2024-09-13T17:12:56.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.199+0000 7f2644d1e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26400fef00 0x7f2640197190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:56.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.199+0000 7f2644d1e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26400ff8b0 0x7f26401976d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:56.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.199+0000 7f2644d1e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2640104030 0x7f26401a2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:56.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.199+0000 7f2644d1e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2640197f70 con 0x7f26400fef00 2024-09-13T17:12:56.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.199+0000 7f2644d1e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26401a2750 con 0x7f2640104030 2024-09-13T17:12:56.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.199+0000 7f2644d1e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26401a2890 con 0x7f26400ff8b0 2024-09-13T17:12:56.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.199+0000 7f263e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26400fef00 0x7f2640197190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:56.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.199+0000 7f263e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26400fef00 0x7f2640197190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:53994/0 (socket says 172.21.15.87:53994) 2024-09-13T17:12:56.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.199+0000 7f263e59c640 1 -- 172.21.15.87:0/3620932598 learned_addr learned my addr 172.21.15.87:0/3620932598 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:12:56.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.199+0000 7f263ed9d640 1 --2- 172.21.15.87:0/3620932598 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2640104030 0x7f26401a2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:56.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.199+0000 7f263dd9b640 1 --2- 172.21.15.87:0/3620932598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26400ff8b0 0x7f26401976d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:56.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.199+0000 7f263e59c640 1 -- 172.21.15.87:0/3620932598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26400ff8b0 msgr2=0x7f26401976d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:56.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.199+0000 7f263e59c640 1 --2- 172.21.15.87:0/3620932598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26400ff8b0 0x7f26401976d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:56.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.199+0000 7f263e59c640 1 -- 172.21.15.87:0/3620932598 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2640104030 msgr2=0x7f26401a2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:56.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.199+0000 7f263e59c640 1 --2- 172.21.15.87:0/3620932598 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2640104030 0x7f26401a2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:56.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.199+0000 7f263e59c640 1 -- 172.21.15.87:0/3620932598 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2628009560 con 0x7f26400fef00 2024-09-13T17:12:56.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.199+0000 7f263ed9d640 1 --2- 172.21.15.87:0/3620932598 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2640104030 0x7f26401a2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:12:56.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.199+0000 7f263e59c640 1 --2- 172.21.15.87:0/3620932598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26400fef00 0x7f2640197190 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f263000cd10 tx=0x7f263000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:56.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.199+0000 7f26377fe640 1 -- 172.21.15.87:0/3620932598 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263000f650 con 0x7f26400fef00 2024-09-13T17:12:56.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.199+0000 7f26377fe640 1 -- 172.21.15.87:0/3620932598 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f263000fc60 con 0x7f26400fef00 2024-09-13T17:12:56.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.199+0000 7f2644d1e640 1 -- 172.21.15.87:0/3620932598 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26401a2b40 con 0x7f26400fef00 2024-09-13T17:12:56.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.199+0000 7f26377fe640 1 -- 172.21.15.87:0/3620932598 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2630018b60 con 0x7f26400fef00 2024-09-13T17:12:56.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.199+0000 7f2644d1e640 1 -- 172.21.15.87:0/3620932598 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26401a3040 con 0x7f26400fef00 2024-09-13T17:12:56.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.201+0000 7f2644d1e640 1 -- 172.21.15.87:0/3620932598 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26401003e0 con 0x7f26400fef00 2024-09-13T17:12:56.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.202+0000 7f26377fe640 1 -- 172.21.15.87:0/3620932598 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f2630018cc0 con 0x7f26400fef00 2024-09-13T17:12:56.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.202+0000 7f26377fe640 1 --2- 172.21.15.87:0/3620932598 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f262c0a1110 0x7f262c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:56.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.203+0000 7f26377fe640 1 -- 172.21.15.87:0/3620932598 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f26300cd3e0 con 0x7f26400fef00 2024-09-13T17:12:56.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.203+0000 7f263dd9b640 1 --2- 172.21.15.87:0/3620932598 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f262c0a1110 0x7f262c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:56.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.203+0000 7f263dd9b640 1 --2- 172.21.15.87:0/3620932598 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f262c0a1110 0x7f262c0a35d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f262802a940 tx=0x7f2628000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:56.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.206+0000 7f26377fe640 1 -- 172.21.15.87:0/3620932598 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f26300965e0 con 0x7f26400fef00 2024-09-13T17:12:56.223 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:12:56.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.381+0000 7f2644d1e640 1 -- 172.21.15.87:0/3620932598 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f26401072b0 con 0x7f26400fef00 2024-09-13T17:12:56.382 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:56 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:12:56.382 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:56 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:12:56.382 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:56 smithi087 ceph-mon[30934]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:12:56.382 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:56 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2510478224' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-13T17:12:56.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.381+0000 7f26377fe640 1 -- 172.21.15.87:0/3620932598 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2630099c00 con 0x7f26400fef00 2024-09-13T17:12:56.383 INFO:teuthology.orchestra.run.smithi087.stdout:287762808872 2024-09-13T17:12:56.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.383+0000 7f2644d1e640 1 -- 172.21.15.87:0/3620932598 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f262c0a1110 msgr2=0x7f262c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:56.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.383+0000 7f2644d1e640 1 --2- 172.21.15.87:0/3620932598 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f262c0a1110 0x7f262c0a35d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f262802a940 tx=0x7f2628000bc0 comp rx=0 tx=0).stop 2024-09-13T17:12:56.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.383+0000 7f2644d1e640 1 -- 172.21.15.87:0/3620932598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26400fef00 msgr2=0x7f2640197190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:56.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.383+0000 7f2644d1e640 1 --2- 172.21.15.87:0/3620932598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26400fef00 0x7f2640197190 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f263000cd10 tx=0x7f263000a620 comp rx=0 tx=0).stop 2024-09-13T17:12:56.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.383+0000 7f2644d1e640 1 -- 172.21.15.87:0/3620932598 shutdown_connections 2024-09-13T17:12:56.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.383+0000 7f2644d1e640 1 --2- 172.21.15.87:0/3620932598 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f262c0a1110 0x7f262c0a35d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:56.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.383+0000 7f2644d1e640 1 --2- 172.21.15.87:0/3620932598 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2640104030 0x7f26401a2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:56.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.383+0000 7f2644d1e640 1 --2- 172.21.15.87:0/3620932598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26400ff8b0 0x7f26401976d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:56.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.383+0000 7f2644d1e640 1 --2- 172.21.15.87:0/3620932598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26400fef00 0x7f2640197190 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:56.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.383+0000 7f2644d1e640 1 -- 172.21.15.87:0/3620932598 >> 172.21.15.87:0/3620932598 conn(0x7f26400fa9a0 msgr2=0x7f26400fbd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:56.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.383+0000 7f2644d1e640 1 -- 172.21.15.87:0/3620932598 shutdown_connections 2024-09-13T17:12:56.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.383+0000 7f2644d1e640 1 -- 172.21.15.87:0/3620932598 wait complete. 2024-09-13T17:12:56.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.424+0000 7fb91f46f640 1 -- 172.21.15.87:0/562549911 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb91810a370 msgr2=0x7fb91810c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:56.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.424+0000 7fb91f46f640 1 --2- 172.21.15.87:0/562549911 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb91810a370 0x7fb91810c7f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb910009ca0 tx=0x7fb91002a950 comp rx=0 tx=0).stop 2024-09-13T17:12:56.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.424+0000 7fb91f46f640 1 -- 172.21.15.87:0/562549911 shutdown_connections 2024-09-13T17:12:56.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.424+0000 7fb91f46f640 1 --2- 172.21.15.87:0/562549911 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb91810a370 0x7fb91810c7f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:56.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.424+0000 7fb91f46f640 1 --2- 172.21.15.87:0/562549911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9181018b0 0x7fb918109da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:56.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.424+0000 7fb91f46f640 1 --2- 172.21.15.87:0/562549911 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb918100f90 0x7fb918101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:56.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.424+0000 7fb91f46f640 1 -- 172.21.15.87:0/562549911 >> 172.21.15.87:0/562549911 conn(0x7fb9180fa9b0 msgr2=0x7fb9180fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:56.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.424+0000 7fb91f46f640 1 -- 172.21.15.87:0/562549911 shutdown_connections 2024-09-13T17:12:56.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.424+0000 7fb91f46f640 1 -- 172.21.15.87:0/562549911 wait complete. 2024-09-13T17:12:56.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.425+0000 7fb91f46f640 1 Processor -- start 2024-09-13T17:12:56.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.425+0000 7fb91f46f640 1 -- start start 2024-09-13T17:12:56.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.425+0000 7fb91f46f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb918100f90 0x7fb918196240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:56.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.425+0000 7fb91f46f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9181018b0 0x7fb918196780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:56.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.425+0000 7fb91f46f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb91810a370 0x7fb91819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:56.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.425+0000 7fb91f46f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91819b130 con 0x7fb9181018b0 2024-09-13T17:12:56.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.425+0000 7fb91f46f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91819b2a0 con 0x7fb918100f90 2024-09-13T17:12:56.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.425+0000 7fb91f46f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91819b410 con 0x7fb91810a370 2024-09-13T17:12:56.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.425+0000 7fb91ca0a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9181018b0 0x7fb918196780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:56.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.425+0000 7fb91ca0a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9181018b0 0x7fb918196780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54014/0 (socket says 172.21.15.87:54014) 2024-09-13T17:12:56.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.425+0000 7fb91ca0a640 1 -- 172.21.15.87:0/2664450871 learned_addr learned my addr 172.21.15.87:0/2664450871 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:12:56.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.426+0000 7fb91ca0a640 1 -- 172.21.15.87:0/2664450871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb91810a370 msgr2=0x7fb91819ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:56.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.426+0000 7fb91ca0a640 1 --2- 172.21.15.87:0/2664450871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb91810a370 0x7fb91819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:56.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.426+0000 7fb91ca0a640 1 -- 172.21.15.87:0/2664450871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb918100f90 msgr2=0x7fb918196240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:56.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.426+0000 7fb91ca0a640 1 --2- 172.21.15.87:0/2664450871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb918100f90 0x7fb918196240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:56.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.426+0000 7fb91ca0a640 1 -- 172.21.15.87:0/2664450871 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb910009900 con 0x7fb9181018b0 2024-09-13T17:12:56.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.426+0000 7fb91ca0a640 1 --2- 172.21.15.87:0/2664450871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9181018b0 0x7fb918196780 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb90800c920 tx=0x7fb90800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:56.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.426+0000 7fb90e7fc640 1 -- 172.21.15.87:0/2664450871 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb908007c70 con 0x7fb9181018b0 2024-09-13T17:12:56.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.426+0000 7fb91f46f640 1 -- 172.21.15.87:0/2664450871 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb91819b6f0 con 0x7fb9181018b0 2024-09-13T17:12:56.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.426+0000 7fb90e7fc640 1 -- 172.21.15.87:0/2664450871 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb908007dd0 con 0x7fb9181018b0 2024-09-13T17:12:56.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.426+0000 7fb90e7fc640 1 -- 172.21.15.87:0/2664450871 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9080187c0 con 0x7fb9181018b0 2024-09-13T17:12:56.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.426+0000 7fb91f46f640 1 -- 172.21.15.87:0/2664450871 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9181a2fb0 con 0x7fb9181018b0 2024-09-13T17:12:56.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.427+0000 7fb91f46f640 1 -- 172.21.15.87:0/2664450871 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb918068780 con 0x7fb9181018b0 2024-09-13T17:12:56.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.428+0000 7fb90e7fc640 1 -- 172.21.15.87:0/2664450871 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fb90800f450 con 0x7fb9181018b0 2024-09-13T17:12:56.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.428+0000 7fb90e7fc640 1 --2- 172.21.15.87:0/2664450871 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb9040a1110 0x7fb9040a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:56.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.429+0000 7fb90e7fc640 1 -- 172.21.15.87:0/2664450871 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7fb9080cd010 con 0x7fb9181018b0 2024-09-13T17:12:56.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.429+0000 7fb91d20b640 1 --2- 172.21.15.87:0/2664450871 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb9040a1110 0x7fb9040a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:56.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.429+0000 7fb91d20b640 1 --2- 172.21.15.87:0/2664450871 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb9040a1110 0x7fb9040a35d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb914009710 tx=0x7fb914006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:56.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.433+0000 7fb90e7fc640 1 -- 172.21.15.87:0/2664450871 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb908096270 con 0x7fb9181018b0 2024-09-13T17:12:56.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:56 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:12:56.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:56 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:12:56.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:56 smithi149 ceph-mon[35496]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:12:56.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:56 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2510478224' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-13T17:12:56.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.602+0000 7fb91f46f640 1 -- 172.21.15.87:0/2664450871 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb918101370 con 0x7fb9181018b0 2024-09-13T17:12:56.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.603+0000 7fb90e7fc640 1 -- 172.21.15.87:0/2664450871 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb908099890 con 0x7fb9181018b0 2024-09-13T17:12:56.604 INFO:teuthology.orchestra.run.smithi087.stdout:34359738451 2024-09-13T17:12:56.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.605+0000 7fb91f46f640 1 -- 172.21.15.87:0/2664450871 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb9040a1110 msgr2=0x7fb9040a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:56.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.605+0000 7fb91f46f640 1 --2- 172.21.15.87:0/2664450871 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb9040a1110 0x7fb9040a35d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb914009710 tx=0x7fb914006c90 comp rx=0 tx=0).stop 2024-09-13T17:12:56.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.605+0000 7fb91f46f640 1 -- 172.21.15.87:0/2664450871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9181018b0 msgr2=0x7fb918196780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:56.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.605+0000 7fb91f46f640 1 --2- 172.21.15.87:0/2664450871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9181018b0 0x7fb918196780 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb90800c920 tx=0x7fb90800cde0 comp rx=0 tx=0).stop 2024-09-13T17:12:56.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.605+0000 7fb91f46f640 1 -- 172.21.15.87:0/2664450871 shutdown_connections 2024-09-13T17:12:56.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.605+0000 7fb91f46f640 1 --2- 172.21.15.87:0/2664450871 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb9040a1110 0x7fb9040a35d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:56.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.605+0000 7fb91f46f640 1 --2- 172.21.15.87:0/2664450871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb91810a370 0x7fb91819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:56.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.605+0000 7fb91f46f640 1 --2- 172.21.15.87:0/2664450871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9181018b0 0x7fb918196780 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:56.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.605+0000 7fb91f46f640 1 --2- 172.21.15.87:0/2664450871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb918100f90 0x7fb918196240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:56.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.605+0000 7fb91f46f640 1 -- 172.21.15.87:0/2664450871 >> 172.21.15.87:0/2664450871 conn(0x7fb9180fa9b0 msgr2=0x7fb9180fc140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:56.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.605+0000 7fb91f46f640 1 -- 172.21.15.87:0/2664450871 shutdown_connections 2024-09-13T17:12:56.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:56.605+0000 7fb91f46f640 1 -- 172.21.15.87:0/2664450871 wait complete. 2024-09-13T17:12:56.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:56 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:12:56.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:56 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:12:56.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:56 smithi118 ceph-mon[34374]: from='mgr.14150 172.21.15.87:0/179211550' entity='mgr.x' 2024-09-13T17:12:56.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:56 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2510478224' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-13T17:12:57.047 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808868 got 287762808872 for osd.9 2024-09-13T17:12:57.047 DEBUG:teuthology.parallel:result is None 2024-09-13T17:12:57.370 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:57 smithi087 ceph-mon[30934]: pgmap v327: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s; 72 B/s, 0 objects/s recovering 2024-09-13T17:12:57.371 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:57 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3620932598' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-13T17:12:57.371 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:57 smithi087 ceph-mon[30934]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-13T17:12:57.371 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:57 smithi087 ceph-mon[30934]: Cluster is now healthy 2024-09-13T17:12:57.371 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:57 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2664450871' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T17:12:57.493 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:57 smithi149 ceph-mon[35496]: pgmap v327: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s; 72 B/s, 0 objects/s recovering 2024-09-13T17:12:57.494 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:57 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3620932598' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-13T17:12:57.494 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:57 smithi149 ceph-mon[35496]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-13T17:12:57.494 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:57 smithi149 ceph-mon[35496]: Cluster is now healthy 2024-09-13T17:12:57.494 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:57 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2664450871' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T17:12:57.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:57 smithi118 ceph-mon[34374]: pgmap v327: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s; 72 B/s, 0 objects/s recovering 2024-09-13T17:12:57.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:57 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3620932598' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-13T17:12:57.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:57 smithi118 ceph-mon[34374]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-13T17:12:57.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:57 smithi118 ceph-mon[34374]: Cluster is now healthy 2024-09-13T17:12:57.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:57 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2664450871' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T17:12:57.669 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738446 got 34359738451 for osd.0 2024-09-13T17:12:57.669 DEBUG:teuthology.parallel:result is None 2024-09-13T17:12:58.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.347+0000 7f0236a92640 1 -- 172.21.15.87:0/667638300 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0230100990 msgr2=0x7f02301049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:58.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.347+0000 7f0236a92640 1 --2- 172.21.15.87:0/667638300 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0230100990 0x7f02301049e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0218009930 tx=0x7f021802a420 comp rx=0 tx=0).stop 2024-09-13T17:12:58.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.347+0000 7f0236a92640 1 -- 172.21.15.87:0/667638300 shutdown_connections 2024-09-13T17:12:58.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.347+0000 7f0236a92640 1 --2- 172.21.15.87:0/667638300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0230105110 0x7f023010cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:58.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.347+0000 7f0236a92640 1 --2- 172.21.15.87:0/667638300 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0230100990 0x7f02301049e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:58.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.347+0000 7f0236a92640 1 --2- 172.21.15.87:0/667638300 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02300fffe0 0x7f02301003c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:58.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.347+0000 7f0236a92640 1 -- 172.21.15.87:0/667638300 >> 172.21.15.87:0/667638300 conn(0x7f02300fbae0 msgr2=0x7f02300fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:58.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.347+0000 7f0236a92640 1 -- 172.21.15.87:0/667638300 shutdown_connections 2024-09-13T17:12:58.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.347+0000 7f0236a92640 1 -- 172.21.15.87:0/667638300 wait complete. 2024-09-13T17:12:58.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.347+0000 7f0236a92640 1 Processor -- start 2024-09-13T17:12:58.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.347+0000 7f0236a92640 1 -- start start 2024-09-13T17:12:58.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.347+0000 7f0236a92640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02300fffe0 0x7f0230196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:58.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.347+0000 7f0236a92640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0230100990 0x7f0230196880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:58.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.347+0000 7f0236a92640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0230105110 0x7f023019ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:58.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.347+0000 7f0236a92640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023019b280 con 0x7f02300fffe0 2024-09-13T17:12:58.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.347+0000 7f0236a92640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023019b3f0 con 0x7f0230105110 2024-09-13T17:12:58.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.348+0000 7f0236a92640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023019b560 con 0x7f0230100990 2024-09-13T17:12:58.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.348+0000 7f023482e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02300fffe0 0x7f0230196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:58.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.348+0000 7f023482e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02300fffe0 0x7f0230196340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54030/0 (socket says 172.21.15.87:54030) 2024-09-13T17:12:58.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.348+0000 7f023482e640 1 -- 172.21.15.87:0/2058094791 learned_addr learned my addr 172.21.15.87:0/2058094791 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:12:58.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.348+0000 7f023502f640 1 --2- 172.21.15.87:0/2058094791 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0230105110 0x7f023019ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:58.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.348+0000 7f023482e640 1 -- 172.21.15.87:0/2058094791 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0230100990 msgr2=0x7f0230196880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:58.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.348+0000 7f023482e640 1 --2- 172.21.15.87:0/2058094791 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0230100990 0x7f0230196880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:58.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.348+0000 7f023482e640 1 -- 172.21.15.87:0/2058094791 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0230105110 msgr2=0x7f023019ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:58.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.348+0000 7f023482e640 1 --2- 172.21.15.87:0/2058094791 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0230105110 0x7f023019ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:58.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.348+0000 7f023482e640 1 -- 172.21.15.87:0/2058094791 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0218009560 con 0x7f02300fffe0 2024-09-13T17:12:58.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.348+0000 7f023482e640 1 --2- 172.21.15.87:0/2058094791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02300fffe0 0x7f0230196340 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f022000b4a0 tx=0x7f022000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:58.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.348+0000 7f022dffb640 1 -- 172.21.15.87:0/2058094791 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220010610 con 0x7f02300fffe0 2024-09-13T17:12:58.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.348+0000 7f022dffb640 1 -- 172.21.15.87:0/2058094791 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0220010c20 con 0x7f02300fffe0 2024-09-13T17:12:58.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.348+0000 7f0236a92640 1 -- 172.21.15.87:0/2058094791 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f023019b840 con 0x7f02300fffe0 2024-09-13T17:12:58.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.348+0000 7f022dffb640 1 -- 172.21.15.87:0/2058094791 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220017d50 con 0x7f02300fffe0 2024-09-13T17:12:58.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.349+0000 7f0236a92640 1 -- 172.21.15.87:0/2058094791 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02301a3100 con 0x7f02300fffe0 2024-09-13T17:12:58.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.350+0000 7f0236a92640 1 -- 172.21.15.87:0/2058094791 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02301014c0 con 0x7f02300fffe0 2024-09-13T17:12:58.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.350+0000 7f022dffb640 1 -- 172.21.15.87:0/2058094791 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f0220010770 con 0x7f02300fffe0 2024-09-13T17:12:58.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.351+0000 7f022dffb640 1 --2- 172.21.15.87:0/2058094791 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f021c0a1110 0x7f021c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:58.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.351+0000 7f022ffff640 1 --2- 172.21.15.87:0/2058094791 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f021c0a1110 0x7f021c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:58.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.351+0000 7f022dffb640 1 -- 172.21.15.87:0/2058094791 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f02200cc4a0 con 0x7f02300fffe0 2024-09-13T17:12:58.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.352+0000 7f022ffff640 1 --2- 172.21.15.87:0/2058094791 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f021c0a1110 0x7f021c0a35d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0218009230 tx=0x7f0218000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:58.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.355+0000 7f022dffb640 1 -- 172.21.15.87:0/2058094791 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0220095810 con 0x7f02300fffe0 2024-09-13T17:12:58.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.522+0000 7f0236a92640 1 -- 172.21.15.87:0/2058094791 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f0230100440 con 0x7f02300fffe0 2024-09-13T17:12:58.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.522+0000 7f022dffb640 1 -- 172.21.15.87:0/2058094791 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0220098e30 con 0x7f02300fffe0 2024-09-13T17:12:58.524 INFO:teuthology.orchestra.run.smithi087.stdout:163208757308 2024-09-13T17:12:58.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.525+0000 7f0236a92640 1 -- 172.21.15.87:0/2058094791 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f021c0a1110 msgr2=0x7f021c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:58.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.525+0000 7f0236a92640 1 --2- 172.21.15.87:0/2058094791 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f021c0a1110 0x7f021c0a35d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0218009230 tx=0x7f0218000bc0 comp rx=0 tx=0).stop 2024-09-13T17:12:58.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.525+0000 7f0236a92640 1 -- 172.21.15.87:0/2058094791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02300fffe0 msgr2=0x7f0230196340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:58.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.525+0000 7f0236a92640 1 --2- 172.21.15.87:0/2058094791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02300fffe0 0x7f0230196340 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f022000b4a0 tx=0x7f022000b960 comp rx=0 tx=0).stop 2024-09-13T17:12:58.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.525+0000 7f0236a92640 1 -- 172.21.15.87:0/2058094791 shutdown_connections 2024-09-13T17:12:58.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.525+0000 7f0236a92640 1 --2- 172.21.15.87:0/2058094791 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f021c0a1110 0x7f021c0a35d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:58.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.525+0000 7f0236a92640 1 --2- 172.21.15.87:0/2058094791 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0230105110 0x7f023019ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:58.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.525+0000 7f0236a92640 1 --2- 172.21.15.87:0/2058094791 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0230100990 0x7f0230196880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:58.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.525+0000 7f0236a92640 1 --2- 172.21.15.87:0/2058094791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02300fffe0 0x7f0230196340 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:58.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.525+0000 7f0236a92640 1 -- 172.21.15.87:0/2058094791 >> 172.21.15.87:0/2058094791 conn(0x7f02300fbae0 msgr2=0x7f02300fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:58.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.525+0000 7f0236a92640 1 -- 172.21.15.87:0/2058094791 shutdown_connections 2024-09-13T17:12:58.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.525+0000 7f0236a92640 1 -- 172.21.15.87:0/2058094791 wait complete. 2024-09-13T17:12:58.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.567+0000 7f8176bca640 1 -- 172.21.15.87:0/327371790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8170105130 msgr2=0x7f817010ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:58.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.567+0000 7f8176bca640 1 --2- 172.21.15.87:0/327371790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8170105130 0x7f817010ccb0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8168009cd0 tx=0x7f816802a8e0 comp rx=0 tx=0).stop 2024-09-13T17:12:58.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.567+0000 7f8176bca640 1 -- 172.21.15.87:0/327371790 shutdown_connections 2024-09-13T17:12:58.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.567+0000 7f8176bca640 1 --2- 172.21.15.87:0/327371790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8170105130 0x7f817010ccb0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:58.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.567+0000 7f8176bca640 1 --2- 172.21.15.87:0/327371790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81701009b0 0x7f8170104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:58.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.567+0000 7f8176bca640 1 --2- 172.21.15.87:0/327371790 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8170100000 0x7f81701003e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:58.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.567+0000 7f8176bca640 1 -- 172.21.15.87:0/327371790 >> 172.21.15.87:0/327371790 conn(0x7f81700fba80 msgr2=0x7f81700fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:58.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.567+0000 7f8176bca640 1 -- 172.21.15.87:0/327371790 shutdown_connections 2024-09-13T17:12:58.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.567+0000 7f8176bca640 1 -- 172.21.15.87:0/327371790 wait complete. 2024-09-13T17:12:58.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.568+0000 7f8176bca640 1 Processor -- start 2024-09-13T17:12:58.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.568+0000 7f8176bca640 1 -- start start 2024-09-13T17:12:58.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.568+0000 7f8176bca640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8170100000 0x7f8170196280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:58.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.568+0000 7f8176bca640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81701009b0 0x7f81701967c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:58.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.568+0000 7f8176bca640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8170105130 0x7f817019abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:58.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.568+0000 7f8176bca640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817019b1c0 con 0x7f81701009b0 2024-09-13T17:12:58.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.568+0000 7f8176bca640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817019b330 con 0x7f8170100000 2024-09-13T17:12:58.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.568+0000 7f8176bca640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817019b4a0 con 0x7f8170105130 2024-09-13T17:12:58.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.568+0000 7f8167fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81701009b0 0x7f81701967c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:58.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.568+0000 7f8167fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81701009b0 0x7f81701967c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54038/0 (socket says 172.21.15.87:54038) 2024-09-13T17:12:58.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.568+0000 7f8167fff640 1 -- 172.21.15.87:0/605676830 learned_addr learned my addr 172.21.15.87:0/605676830 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:12:58.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.568+0000 7f8174966640 1 --2- 172.21.15.87:0/605676830 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8170100000 0x7f8170196280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:58.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.568+0000 7f8175167640 1 --2- 172.21.15.87:0/605676830 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8170105130 0x7f817019abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:58.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.568+0000 7f8167fff640 1 -- 172.21.15.87:0/605676830 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8170105130 msgr2=0x7f817019abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:58.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.568+0000 7f8167fff640 1 --2- 172.21.15.87:0/605676830 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8170105130 0x7f817019abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:58.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.568+0000 7f8167fff640 1 -- 172.21.15.87:0/605676830 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8170100000 msgr2=0x7f8170196280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:58.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.568+0000 7f8167fff640 1 --2- 172.21.15.87:0/605676830 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8170100000 0x7f8170196280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:58.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.568+0000 7f8167fff640 1 -- 172.21.15.87:0/605676830 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8168009900 con 0x7f81701009b0 2024-09-13T17:12:58.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.568+0000 7f8175167640 1 --2- 172.21.15.87:0/605676830 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8170105130 0x7f817019abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:12:58.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.569+0000 7f8167fff640 1 --2- 172.21.15.87:0/605676830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81701009b0 0x7f81701967c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f816000c970 tx=0x7f816000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:58.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.569+0000 7f8165ffb640 1 -- 172.21.15.87:0/605676830 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8160007bb0 con 0x7f81701009b0 2024-09-13T17:12:58.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.569+0000 7f8165ffb640 1 -- 172.21.15.87:0/605676830 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8160007d10 con 0x7f81701009b0 2024-09-13T17:12:58.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.569+0000 7f8176bca640 1 -- 172.21.15.87:0/605676830 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f817019b780 con 0x7f81701009b0 2024-09-13T17:12:58.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.569+0000 7f8165ffb640 1 -- 172.21.15.87:0/605676830 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8160004e80 con 0x7f81701009b0 2024-09-13T17:12:58.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.569+0000 7f8176bca640 1 -- 172.21.15.87:0/605676830 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81701a3040 con 0x7f81701009b0 2024-09-13T17:12:58.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.570+0000 7f8176bca640 1 -- 172.21.15.87:0/605676830 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81701014e0 con 0x7f81701009b0 2024-09-13T17:12:58.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.571+0000 7f8165ffb640 1 -- 172.21.15.87:0/605676830 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f8160005020 con 0x7f81701009b0 2024-09-13T17:12:58.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.572+0000 7f8165ffb640 1 --2- 172.21.15.87:0/605676830 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f81580a1110 0x7f81580a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:12:58.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.572+0000 7f8174966640 1 --2- 172.21.15.87:0/605676830 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f81580a1110 0x7f81580a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:12:58.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.572+0000 7f8165ffb640 1 -- 172.21.15.87:0/605676830 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f81600ccb40 con 0x7f81701009b0 2024-09-13T17:12:58.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.572+0000 7f8174966640 1 --2- 172.21.15.87:0/605676830 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f81580a1110 0x7f81580a35d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f816c0058c0 tx=0x7f816c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:12:58.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.576+0000 7f8165ffb640 1 -- 172.21.15.87:0/605676830 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8160095da0 con 0x7f81701009b0 2024-09-13T17:12:58.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.743+0000 7f8176bca640 1 -- 172.21.15.87:0/605676830 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f81701003e0 con 0x7f81701009b0 2024-09-13T17:12:58.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.744+0000 7f8165ffb640 1 -- 172.21.15.87:0/605676830 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f816001d020 con 0x7f81701009b0 2024-09-13T17:12:58.745 INFO:teuthology.orchestra.run.smithi087.stdout:77309411403 2024-09-13T17:12:58.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.746+0000 7f8176bca640 1 -- 172.21.15.87:0/605676830 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f81580a1110 msgr2=0x7f81580a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:58.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.746+0000 7f8176bca640 1 --2- 172.21.15.87:0/605676830 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f81580a1110 0x7f81580a35d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f816c0058c0 tx=0x7f816c00a2d0 comp rx=0 tx=0).stop 2024-09-13T17:12:58.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.746+0000 7f8176bca640 1 -- 172.21.15.87:0/605676830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81701009b0 msgr2=0x7f81701967c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:12:58.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.746+0000 7f8176bca640 1 --2- 172.21.15.87:0/605676830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81701009b0 0x7f81701967c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f816000c970 tx=0x7f816000ce30 comp rx=0 tx=0).stop 2024-09-13T17:12:58.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.746+0000 7f8176bca640 1 -- 172.21.15.87:0/605676830 shutdown_connections 2024-09-13T17:12:58.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.746+0000 7f8176bca640 1 --2- 172.21.15.87:0/605676830 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f81580a1110 0x7f81580a35d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:58.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.746+0000 7f8176bca640 1 --2- 172.21.15.87:0/605676830 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8170105130 0x7f817019abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:58.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.746+0000 7f8176bca640 1 --2- 172.21.15.87:0/605676830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81701009b0 0x7f81701967c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:58.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.746+0000 7f8176bca640 1 --2- 172.21.15.87:0/605676830 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8170100000 0x7f8170196280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:12:58.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.746+0000 7f8176bca640 1 -- 172.21.15.87:0/605676830 >> 172.21.15.87:0/605676830 conn(0x7f81700fba80 msgr2=0x7f81700fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:12:58.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.746+0000 7f8176bca640 1 -- 172.21.15.87:0/605676830 shutdown_connections 2024-09-13T17:12:58.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:12:58.746+0000 7f8176bca640 1 -- 172.21.15.87:0/605676830 wait complete. 2024-09-13T17:12:59.396 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411396 got 77309411403 for osd.2 2024-09-13T17:12:59.396 DEBUG:teuthology.parallel:result is None 2024-09-13T17:12:59.503 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:59 smithi087 ceph-mon[30934]: pgmap v328: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 65 B/s, 0 objects/s recovering 2024-09-13T17:12:59.503 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:59 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2058094791' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T17:12:59.503 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:12:59 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/605676830' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T17:12:59.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:59 smithi149 ceph-mon[35496]: pgmap v328: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 65 B/s, 0 objects/s recovering 2024-09-13T17:12:59.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:59 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2058094791' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T17:12:59.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:12:59 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/605676830' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T17:12:59.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:59 smithi118 ceph-mon[34374]: pgmap v328: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 65 B/s, 0 objects/s recovering 2024-09-13T17:12:59.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:59 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2058094791' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T17:12:59.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:12:59 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/605676830' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T17:12:59.849 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757302 got 163208757308 for osd.5 2024-09-13T17:12:59.850 DEBUG:teuthology.parallel:result is None 2024-09-13T17:13:00.336 INFO:tasks.cephadm.ceph_manager.ceph:need seq 343597383707 got 343597383711 for osd.11 2024-09-13T17:13:00.336 DEBUG:teuthology.parallel:result is None 2024-09-13T17:13:00.887 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:13:01.373 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:01 smithi087 ceph-mon[30934]: pgmap v329: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s; 58 B/s, 0 objects/s recovering 2024-09-13T17:13:01.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.451+0000 7fde7c1ca640 1 -- 172.21.15.87:0/2298951956 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde741018f0 msgr2=0x7fde74109de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:01.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.451+0000 7fde7c1ca640 1 --2- 172.21.15.87:0/2298951956 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde741018f0 0x7fde74109de0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fde68009900 tx=0x7fde6802a480 comp rx=0 tx=0).stop 2024-09-13T17:13:01.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.451+0000 7fde7c1ca640 1 -- 172.21.15.87:0/2298951956 shutdown_connections 2024-09-13T17:13:01.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.451+0000 7fde7c1ca640 1 --2- 172.21.15.87:0/2298951956 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde7410a370 0x7fde7410c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:01.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.451+0000 7fde7c1ca640 1 --2- 172.21.15.87:0/2298951956 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde741018f0 0x7fde74109de0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:01.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.451+0000 7fde7c1ca640 1 --2- 172.21.15.87:0/2298951956 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde74100fd0 0x7fde741013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:01.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.451+0000 7fde7c1ca640 1 -- 172.21.15.87:0/2298951956 >> 172.21.15.87:0/2298951956 conn(0x7fde740fa9b0 msgr2=0x7fde740fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:01.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.452+0000 7fde7c1ca640 1 -- 172.21.15.87:0/2298951956 shutdown_connections 2024-09-13T17:13:01.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.452+0000 7fde7c1ca640 1 -- 172.21.15.87:0/2298951956 wait complete. 2024-09-13T17:13:01.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.452+0000 7fde7c1ca640 1 Processor -- start 2024-09-13T17:13:01.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.452+0000 7fde7c1ca640 1 -- start start 2024-09-13T17:13:01.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.452+0000 7fde7c1ca640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde74100fd0 0x7fde74196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:01.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.452+0000 7fde7c1ca640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde741018f0 0x7fde741967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:01.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.452+0000 7fde7c1ca640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde7410a370 0x7fde7419aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:01.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.452+0000 7fde7c1ca640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7419b1a0 con 0x7fde74100fd0 2024-09-13T17:13:01.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.452+0000 7fde7c1ca640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7419b310 con 0x7fde7410a370 2024-09-13T17:13:01.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.452+0000 7fde7c1ca640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7419b480 con 0x7fde741018f0 2024-09-13T17:13:01.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.452+0000 7fde79f66640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde74100fd0 0x7fde74196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:01.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.452+0000 7fde79f66640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde74100fd0 0x7fde74196260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57774/0 (socket says 172.21.15.87:57774) 2024-09-13T17:13:01.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.452+0000 7fde79f66640 1 -- 172.21.15.87:0/193707361 learned_addr learned my addr 172.21.15.87:0/193707361 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:01.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.453+0000 7fde7a767640 1 --2- 172.21.15.87:0/193707361 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde7410a370 0x7fde7419aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:01.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.453+0000 7fde79765640 1 --2- 172.21.15.87:0/193707361 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde741018f0 0x7fde741967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:01.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.453+0000 7fde79f66640 1 -- 172.21.15.87:0/193707361 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde741018f0 msgr2=0x7fde741967a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:01.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.453+0000 7fde79f66640 1 --2- 172.21.15.87:0/193707361 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde741018f0 0x7fde741967a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:01.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.453+0000 7fde79f66640 1 -- 172.21.15.87:0/193707361 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde7410a370 msgr2=0x7fde7419aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:01.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.453+0000 7fde79f66640 1 --2- 172.21.15.87:0/193707361 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde7410a370 0x7fde7419aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:01.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.453+0000 7fde79f66640 1 -- 172.21.15.87:0/193707361 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde68009560 con 0x7fde74100fd0 2024-09-13T17:13:01.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.453+0000 7fde79f66640 1 --2- 172.21.15.87:0/193707361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde74100fd0 0x7fde74196260 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fde6400ba50 tx=0x7fde6400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:01.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.453+0000 7fde72ffd640 1 -- 172.21.15.87:0/193707361 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6400cbe0 con 0x7fde74100fd0 2024-09-13T17:13:01.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.453+0000 7fde72ffd640 1 -- 172.21.15.87:0/193707361 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fde6400cd40 con 0x7fde74100fd0 2024-09-13T17:13:01.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.453+0000 7fde7c1ca640 1 -- 172.21.15.87:0/193707361 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde7419b760 con 0x7fde74100fd0 2024-09-13T17:13:01.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.453+0000 7fde72ffd640 1 -- 172.21.15.87:0/193707361 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde640076c0 con 0x7fde74100fd0 2024-09-13T17:13:01.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.453+0000 7fde7c1ca640 1 -- 172.21.15.87:0/193707361 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde7419ba10 con 0x7fde74100fd0 2024-09-13T17:13:01.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.454+0000 7fde7c1ca640 1 -- 172.21.15.87:0/193707361 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde74068740 con 0x7fde74100fd0 2024-09-13T17:13:01.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.455+0000 7fde72ffd640 1 -- 172.21.15.87:0/193707361 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fde64014440 con 0x7fde74100fd0 2024-09-13T17:13:01.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.456+0000 7fde72ffd640 1 --2- 172.21.15.87:0/193707361 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fde5c0a1110 0x7fde5c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:01.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.456+0000 7fde79765640 1 --2- 172.21.15.87:0/193707361 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fde5c0a1110 0x7fde5c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:01.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.456+0000 7fde72ffd640 1 -- 172.21.15.87:0/193707361 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7fde640cc4b0 con 0x7fde74100fd0 2024-09-13T17:13:01.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.456+0000 7fde79765640 1 --2- 172.21.15.87:0/193707361 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fde5c0a1110 0x7fde5c0a35d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fde68005760 tx=0x7fde68005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:01.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.460+0000 7fde72ffd640 1 -- 172.21.15.87:0/193707361 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fde640958d0 con 0x7fde74100fd0 2024-09-13T17:13:01.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:01 smithi149 ceph-mon[35496]: pgmap v329: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s; 58 B/s, 0 objects/s recovering 2024-09-13T17:13:01.612 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:01 smithi118 ceph-mon[34374]: pgmap v329: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s; 58 B/s, 0 objects/s recovering 2024-09-13T17:13:01.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.629+0000 7fde7c1ca640 1 -- 172.21.15.87:0/193707361 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fde741013b0 con 0x7fde74100fd0 2024-09-13T17:13:01.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.629+0000 7fde72ffd640 1 -- 172.21.15.87:0/193707361 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fde64098ef0 con 0x7fde74100fd0 2024-09-13T17:13:01.630 INFO:teuthology.orchestra.run.smithi087.stdout:219043332147 2024-09-13T17:13:01.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.631+0000 7fde7c1ca640 1 -- 172.21.15.87:0/193707361 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fde5c0a1110 msgr2=0x7fde5c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:01.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.631+0000 7fde7c1ca640 1 --2- 172.21.15.87:0/193707361 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fde5c0a1110 0x7fde5c0a35d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fde68005760 tx=0x7fde68005a20 comp rx=0 tx=0).stop 2024-09-13T17:13:01.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.631+0000 7fde7c1ca640 1 -- 172.21.15.87:0/193707361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde74100fd0 msgr2=0x7fde74196260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:01.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.631+0000 7fde7c1ca640 1 --2- 172.21.15.87:0/193707361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde74100fd0 0x7fde74196260 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fde6400ba50 tx=0x7fde6400bf10 comp rx=0 tx=0).stop 2024-09-13T17:13:01.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.631+0000 7fde7c1ca640 1 -- 172.21.15.87:0/193707361 shutdown_connections 2024-09-13T17:13:01.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.631+0000 7fde7c1ca640 1 --2- 172.21.15.87:0/193707361 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fde5c0a1110 0x7fde5c0a35d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:01.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.631+0000 7fde7c1ca640 1 --2- 172.21.15.87:0/193707361 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde7410a370 0x7fde7419aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:01.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.631+0000 7fde7c1ca640 1 --2- 172.21.15.87:0/193707361 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde741018f0 0x7fde741967a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:01.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.631+0000 7fde7c1ca640 1 --2- 172.21.15.87:0/193707361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde74100fd0 0x7fde74196260 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:01.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.631+0000 7fde7c1ca640 1 -- 172.21.15.87:0/193707361 >> 172.21.15.87:0/193707361 conn(0x7fde740fa9b0 msgr2=0x7fde740fc250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:01.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.632+0000 7fde7c1ca640 1 -- 172.21.15.87:0/193707361 shutdown_connections 2024-09-13T17:13:01.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:01.632+0000 7fde7c1ca640 1 -- 172.21.15.87:0/193707361 wait complete. 2024-09-13T17:13:01.964 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182464 got 107374182468 for osd.3 2024-09-13T17:13:01.964 DEBUG:teuthology.parallel:result is None 2024-09-13T17:13:02.580 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:02 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/193707361' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-13T17:13:02.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:02 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/193707361' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-13T17:13:02.602 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332140 got 219043332147 for osd.7 2024-09-13T17:13:02.602 DEBUG:teuthology.parallel:result is None 2024-09-13T17:13:02.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:02 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/193707361' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-13T17:13:03.510 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:03 smithi087 ceph-mon[30934]: pgmap v330: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 48 B/s, 0 objects/s recovering 2024-09-13T17:13:03.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:03 smithi149 ceph-mon[35496]: pgmap v330: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 48 B/s, 0 objects/s recovering 2024-09-13T17:13:03.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:03 smithi118 ceph-mon[34374]: pgmap v330: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 48 B/s, 0 objects/s recovering 2024-09-13T17:13:04.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.163+0000 7f57f8773640 1 -- 172.21.15.87:0/3700705207 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57f00ff880 msgr2=0x7f57f01038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:04.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.163+0000 7f57f8773640 1 --2- 172.21.15.87:0/3700705207 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57f00ff880 0x7f57f01038d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009930 tx=0x7f57e002a420 comp rx=0 tx=0).stop 2024-09-13T17:13:04.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.163+0000 7f57f8773640 1 -- 172.21.15.87:0/3700705207 shutdown_connections 2024-09-13T17:13:04.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.163+0000 7f57f8773640 1 --2- 172.21.15.87:0/3700705207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57f0104000 0x7f57f010bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:04.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.163+0000 7f57f8773640 1 --2- 172.21.15.87:0/3700705207 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57f00ff880 0x7f57f01038d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:04.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.163+0000 7f57f8773640 1 --2- 172.21.15.87:0/3700705207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57f00feed0 0x7f57f00ff2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:04.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.163+0000 7f57f8773640 1 -- 172.21.15.87:0/3700705207 >> 172.21.15.87:0/3700705207 conn(0x7f57f00fa9b0 msgr2=0x7f57f00fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:04.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.163+0000 7f57f8773640 1 -- 172.21.15.87:0/3700705207 shutdown_connections 2024-09-13T17:13:04.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.163+0000 7f57f8773640 1 -- 172.21.15.87:0/3700705207 wait complete. 2024-09-13T17:13:04.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.164+0000 7f57f8773640 1 Processor -- start 2024-09-13T17:13:04.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.164+0000 7f57f8773640 1 -- start start 2024-09-13T17:13:04.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.164+0000 7f57f8773640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57f00feed0 0x7f57f01962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:04.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.164+0000 7f57f8773640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57f00ff880 0x7f57f0196800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:04.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.164+0000 7f57f8773640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57f0104000 0x7f57f019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:04.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.164+0000 7f57f8773640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f019b1b0 con 0x7f57f00ff880 2024-09-13T17:13:04.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.164+0000 7f57f8773640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f019b320 con 0x7f57f0104000 2024-09-13T17:13:04.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.164+0000 7f57f8773640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f019b490 con 0x7f57f00feed0 2024-09-13T17:13:04.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.164+0000 7f57f5d0e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57f00ff880 0x7f57f0196800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:04.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.164+0000 7f57f5d0e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57f00ff880 0x7f57f0196800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57792/0 (socket says 172.21.15.87:57792) 2024-09-13T17:13:04.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.164+0000 7f57f5d0e640 1 -- 172.21.15.87:0/2088242283 learned_addr learned my addr 172.21.15.87:0/2088242283 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:04.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.164+0000 7f57f6d10640 1 --2- 172.21.15.87:0/2088242283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57f0104000 0x7f57f019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:04.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.164+0000 7f57f650f640 1 --2- 172.21.15.87:0/2088242283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57f00feed0 0x7f57f01962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:04.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.164+0000 7f57f5d0e640 1 -- 172.21.15.87:0/2088242283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57f00feed0 msgr2=0x7f57f01962c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:04.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.164+0000 7f57f5d0e640 1 --2- 172.21.15.87:0/2088242283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57f00feed0 0x7f57f01962c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:04.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.164+0000 7f57f5d0e640 1 -- 172.21.15.87:0/2088242283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57f0104000 msgr2=0x7f57f019abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:04.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.164+0000 7f57f5d0e640 1 --2- 172.21.15.87:0/2088242283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57f0104000 0x7f57f019abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:04.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.164+0000 7f57f5d0e640 1 -- 172.21.15.87:0/2088242283 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e0009560 con 0x7f57f00ff880 2024-09-13T17:13:04.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.164+0000 7f57f650f640 1 --2- 172.21.15.87:0/2088242283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57f00feed0 0x7f57f01962c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:04.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.164+0000 7f57f6d10640 1 --2- 172.21.15.87:0/2088242283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57f0104000 0x7f57f019abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:04.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.164+0000 7f57f5d0e640 1 --2- 172.21.15.87:0/2088242283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57f00ff880 0x7f57f0196800 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009900 tx=0x7f57e00040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:04.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.165+0000 7f57e77fe640 1 -- 172.21.15.87:0/2088242283 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e00037f0 con 0x7f57f00ff880 2024-09-13T17:13:04.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.165+0000 7f57e77fe640 1 -- 172.21.15.87:0/2088242283 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f57e00044c0 con 0x7f57f00ff880 2024-09-13T17:13:04.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.165+0000 7f57f8773640 1 -- 172.21.15.87:0/2088242283 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57f019b710 con 0x7f57f00ff880 2024-09-13T17:13:04.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.165+0000 7f57e77fe640 1 -- 172.21.15.87:0/2088242283 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e003bda0 con 0x7f57f00ff880 2024-09-13T17:13:04.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.165+0000 7f57f8773640 1 -- 172.21.15.87:0/2088242283 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f019ba30 con 0x7f57f00ff880 2024-09-13T17:13:04.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.166+0000 7f57f8773640 1 -- 172.21.15.87:0/2088242283 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57f01003b0 con 0x7f57f00ff880 2024-09-13T17:13:04.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.167+0000 7f57e77fe640 1 -- 172.21.15.87:0/2088242283 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f57e003b560 con 0x7f57f00ff880 2024-09-13T17:13:04.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.167+0000 7f57e77fe640 1 --2- 172.21.15.87:0/2088242283 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f57dc0a1190 0x7f57dc0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:04.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.167+0000 7f57f650f640 1 --2- 172.21.15.87:0/2088242283 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f57dc0a1190 0x7f57dc0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:04.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.167+0000 7f57e77fe640 1 -- 172.21.15.87:0/2088242283 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f57e00eda40 con 0x7f57f00ff880 2024-09-13T17:13:04.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.168+0000 7f57f650f640 1 --2- 172.21.15.87:0/2088242283 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f57dc0a1190 0x7f57dc0a3650 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f57ec009c20 tx=0x7f57ec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:04.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.171+0000 7f57e77fe640 1 -- 172.21.15.87:0/2088242283 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f57e00b6ca0 con 0x7f57f00ff880 2024-09-13T17:13:04.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.339+0000 7f57f8773640 1 -- 172.21.15.87:0/2088242283 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f57f00ff2b0 con 0x7f57f00ff880 2024-09-13T17:13:04.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.339+0000 7f57e77fe640 1 -- 172.21.15.87:0/2088242283 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f57e0041090 con 0x7f57f00ff880 2024-09-13T17:13:04.340 INFO:teuthology.orchestra.run.smithi087.stdout:55834574928 2024-09-13T17:13:04.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.342+0000 7f57f8773640 1 -- 172.21.15.87:0/2088242283 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f57dc0a1190 msgr2=0x7f57dc0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:04.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.342+0000 7f57f8773640 1 --2- 172.21.15.87:0/2088242283 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f57dc0a1190 0x7f57dc0a3650 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f57ec009c20 tx=0x7f57ec005f90 comp rx=0 tx=0).stop 2024-09-13T17:13:04.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.342+0000 7f57f8773640 1 -- 172.21.15.87:0/2088242283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57f00ff880 msgr2=0x7f57f0196800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:04.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.342+0000 7f57f8773640 1 --2- 172.21.15.87:0/2088242283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57f00ff880 0x7f57f0196800 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009900 tx=0x7f57e00040c0 comp rx=0 tx=0).stop 2024-09-13T17:13:04.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.342+0000 7f57f8773640 1 -- 172.21.15.87:0/2088242283 shutdown_connections 2024-09-13T17:13:04.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.342+0000 7f57f8773640 1 --2- 172.21.15.87:0/2088242283 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f57dc0a1190 0x7f57dc0a3650 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:04.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.342+0000 7f57f8773640 1 --2- 172.21.15.87:0/2088242283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57f0104000 0x7f57f019abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:04.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.342+0000 7f57f8773640 1 --2- 172.21.15.87:0/2088242283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57f00ff880 0x7f57f0196800 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:04.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.342+0000 7f57f8773640 1 --2- 172.21.15.87:0/2088242283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57f00feed0 0x7f57f01962c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:04.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.342+0000 7f57f8773640 1 -- 172.21.15.87:0/2088242283 >> 172.21.15.87:0/2088242283 conn(0x7f57f00fa9b0 msgr2=0x7f57f0068350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:04.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.342+0000 7f57f8773640 1 -- 172.21.15.87:0/2088242283 shutdown_connections 2024-09-13T17:13:04.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:04.342+0000 7f57f8773640 1 -- 172.21.15.87:0/2088242283 wait complete. 2024-09-13T17:13:05.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.133+0000 7fe8f1fb4640 1 -- 172.21.15.87:0/697411717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8ec0feed0 msgr2=0x7fe8ec0ff2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:05.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.133+0000 7fe8f1fb4640 1 --2- 172.21.15.87:0/697411717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8ec0feed0 0x7fe8ec0ff2b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc009930 tx=0x7fe8dc02a420 comp rx=0 tx=0).stop 2024-09-13T17:13:05.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.133+0000 7fe8f1fb4640 1 -- 172.21.15.87:0/697411717 shutdown_connections 2024-09-13T17:13:05.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.133+0000 7fe8f1fb4640 1 --2- 172.21.15.87:0/697411717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8ec104000 0x7fe8ec10bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.133+0000 7fe8f1fb4640 1 --2- 172.21.15.87:0/697411717 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8ec0ff880 0x7fe8ec1038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.133+0000 7fe8f1fb4640 1 --2- 172.21.15.87:0/697411717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8ec0feed0 0x7fe8ec0ff2b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.133+0000 7fe8f1fb4640 1 -- 172.21.15.87:0/697411717 >> 172.21.15.87:0/697411717 conn(0x7fe8ec0fa9b0 msgr2=0x7fe8ec0fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:05.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.133+0000 7fe8f1fb4640 1 -- 172.21.15.87:0/697411717 shutdown_connections 2024-09-13T17:13:05.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.133+0000 7fe8f1fb4640 1 -- 172.21.15.87:0/697411717 wait complete. 2024-09-13T17:13:05.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.134+0000 7fe8f1fb4640 1 Processor -- start 2024-09-13T17:13:05.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.134+0000 7fe8f1fb4640 1 -- start start 2024-09-13T17:13:05.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.134+0000 7fe8f1fb4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8ec0feed0 0x7fe8ec197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:05.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.134+0000 7fe8f1fb4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8ec0ff880 0x7fe8ec197660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:05.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.134+0000 7fe8f1fb4640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8ec104000 0x7fe8ec1a21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:05.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.134+0000 7fe8f1fb4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec197e90 con 0x7fe8ec0feed0 2024-09-13T17:13:05.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.134+0000 7fe8f1fb4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec1a26e0 con 0x7fe8ec0ff880 2024-09-13T17:13:05.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.134+0000 7fe8f1fb4640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec1a2820 con 0x7fe8ec104000 2024-09-13T17:13:05.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.134+0000 7fe8eb7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8ec0feed0 0x7fe8ec197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:05.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.134+0000 7fe8eb7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8ec0feed0 0x7fe8ec197120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57804/0 (socket says 172.21.15.87:57804) 2024-09-13T17:13:05.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.134+0000 7fe8eb7fe640 1 -- 172.21.15.87:0/3468541917 learned_addr learned my addr 172.21.15.87:0/3468541917 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:05.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.134+0000 7fe8eaffd640 1 --2- 172.21.15.87:0/3468541917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8ec0ff880 0x7fe8ec197660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:05.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.135+0000 7fe8ebfff640 1 --2- 172.21.15.87:0/3468541917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8ec104000 0x7fe8ec1a21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:05.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.135+0000 7fe8eb7fe640 1 -- 172.21.15.87:0/3468541917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8ec104000 msgr2=0x7fe8ec1a21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:05.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.135+0000 7fe8eb7fe640 1 --2- 172.21.15.87:0/3468541917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8ec104000 0x7fe8ec1a21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.135+0000 7fe8eb7fe640 1 -- 172.21.15.87:0/3468541917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8ec0ff880 msgr2=0x7fe8ec197660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:05.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.135+0000 7fe8eb7fe640 1 --2- 172.21.15.87:0/3468541917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8ec0ff880 0x7fe8ec197660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.135+0000 7fe8eb7fe640 1 -- 172.21.15.87:0/3468541917 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8dc009560 con 0x7fe8ec0feed0 2024-09-13T17:13:05.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.135+0000 7fe8eb7fe640 1 --2- 172.21.15.87:0/3468541917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8ec0feed0 0x7fe8ec197120 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc009900 tx=0x7fe8dc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:05.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.135+0000 7fe8e8ff9640 1 -- 172.21.15.87:0/3468541917 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc003a00 con 0x7fe8ec0feed0 2024-09-13T17:13:05.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.135+0000 7fe8e8ff9640 1 -- 172.21.15.87:0/3468541917 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe8dc0044e0 con 0x7fe8ec0feed0 2024-09-13T17:13:05.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.135+0000 7fe8f1fb4640 1 -- 172.21.15.87:0/3468541917 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8ec1a2a20 con 0x7fe8ec0feed0 2024-09-13T17:13:05.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.135+0000 7fe8e8ff9640 1 -- 172.21.15.87:0/3468541917 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc03a3c0 con 0x7fe8ec0feed0 2024-09-13T17:13:05.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.135+0000 7fe8f1fb4640 1 -- 172.21.15.87:0/3468541917 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8ec1a2ee0 con 0x7fe8ec0feed0 2024-09-13T17:13:05.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.136+0000 7fe8f1fb4640 1 -- 172.21.15.87:0/3468541917 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8ec1003b0 con 0x7fe8ec0feed0 2024-09-13T17:13:05.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.138+0000 7fe8e8ff9640 1 -- 172.21.15.87:0/3468541917 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fe8dc03b460 con 0x7fe8ec0feed0 2024-09-13T17:13:05.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.138+0000 7fe8e8ff9640 1 --2- 172.21.15.87:0/3468541917 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe8d40a1190 0x7fe8d40a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:05.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.138+0000 7fe8e8ff9640 1 -- 172.21.15.87:0/3468541917 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7fe8dc0ede40 con 0x7fe8ec0feed0 2024-09-13T17:13:05.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.138+0000 7fe8eaffd640 1 --2- 172.21.15.87:0/3468541917 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe8d40a1190 0x7fe8d40a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:05.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.139+0000 7fe8eaffd640 1 --2- 172.21.15.87:0/3468541917 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe8d40a1190 0x7fe8d40a3650 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec068740 tx=0x7fe8e000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:05.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.141+0000 7fe8e8ff9640 1 -- 172.21.15.87:0/3468541917 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe8dc0b7150 con 0x7fe8ec0feed0 2024-09-13T17:13:05.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.306+0000 7fe8f1fb4640 1 -- 172.21.15.87:0/3468541917 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe8ec0ff2b0 con 0x7fe8ec0feed0 2024-09-13T17:13:05.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.306+0000 7fe8e8ff9640 1 -- 172.21.15.87:0/3468541917 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe8dc041090 con 0x7fe8ec0feed0 2024-09-13T17:13:05.308 INFO:teuthology.orchestra.run.smithi087.stdout:197568495672 2024-09-13T17:13:05.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.308+0000 7fe8f1fb4640 1 -- 172.21.15.87:0/3468541917 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe8d40a1190 msgr2=0x7fe8d40a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:05.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.308+0000 7fe8f1fb4640 1 --2- 172.21.15.87:0/3468541917 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe8d40a1190 0x7fe8d40a3650 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec068740 tx=0x7fe8e000b390 comp rx=0 tx=0).stop 2024-09-13T17:13:05.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.308+0000 7fe8f1fb4640 1 -- 172.21.15.87:0/3468541917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8ec0feed0 msgr2=0x7fe8ec197120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:05.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.308+0000 7fe8f1fb4640 1 --2- 172.21.15.87:0/3468541917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8ec0feed0 0x7fe8ec197120 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc009900 tx=0x7fe8dc0042f0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.308+0000 7fe8f1fb4640 1 -- 172.21.15.87:0/3468541917 shutdown_connections 2024-09-13T17:13:05.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.308+0000 7fe8f1fb4640 1 --2- 172.21.15.87:0/3468541917 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe8d40a1190 0x7fe8d40a3650 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.308+0000 7fe8f1fb4640 1 --2- 172.21.15.87:0/3468541917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8ec104000 0x7fe8ec1a21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.308+0000 7fe8f1fb4640 1 --2- 172.21.15.87:0/3468541917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8ec0ff880 0x7fe8ec197660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.308+0000 7fe8f1fb4640 1 --2- 172.21.15.87:0/3468541917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8ec0feed0 0x7fe8ec197120 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:05.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.308+0000 7fe8f1fb4640 1 -- 172.21.15.87:0/3468541917 >> 172.21.15.87:0/3468541917 conn(0x7fe8ec0fa9b0 msgr2=0x7fe8ec0fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:05.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.308+0000 7fe8f1fb4640 1 -- 172.21.15.87:0/3468541917 shutdown_connections 2024-09-13T17:13:05.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:05.309+0000 7fe8f1fb4640 1 -- 172.21.15.87:0/3468541917 wait complete. 2024-09-13T17:13:05.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:05 smithi087 ceph-mon[30934]: pgmap v331: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 48 B/s, 0 objects/s recovering 2024-09-13T17:13:05.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:05 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2088242283' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T17:13:05.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:05 smithi149 ceph-mon[35496]: pgmap v331: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 48 B/s, 0 objects/s recovering 2024-09-13T17:13:05.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:05 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2088242283' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T17:13:05.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:05 smithi118 ceph-mon[34374]: pgmap v331: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 48 B/s, 0 objects/s recovering 2024-09-13T17:13:05.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:05 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2088242283' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T17:13:05.958 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574923 got 55834574928 for osd.1 2024-09-13T17:13:05.958 DEBUG:teuthology.parallel:result is None 2024-09-13T17:13:06.564 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:06 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3468541917' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-13T17:13:06.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:06 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3468541917' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-13T17:13:06.609 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495668 got 197568495672 for osd.6 2024-09-13T17:13:06.610 DEBUG:teuthology.parallel:result is None 2024-09-13T17:13:06.610 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-13T17:13:06.610 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-13T17:13:06.612 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:06 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3468541917' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-13T17:13:06.810 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:13:07.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:07 smithi087 ceph-mon[30934]: pgmap v332: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 0 B/s, 0 objects/s recovering 2024-09-13T17:13:07.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:07 smithi149 ceph-mon[35496]: pgmap v332: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 0 B/s, 0 objects/s recovering 2024-09-13T17:13:07.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:07 smithi118 ceph-mon[34374]: pgmap v332: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 0 B/s, 0 objects/s recovering 2024-09-13T17:13:08.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.452+0000 7fa45f931640 1 -- 172.21.15.87:0/3311923267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa458101850 msgr2=0x7fa458109d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:08.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.452+0000 7fa45f931640 1 --2- 172.21.15.87:0/3311923267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa458101850 0x7fa458109d40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa44c009900 tx=0x7fa44c02a480 comp rx=0 tx=0).stop 2024-09-13T17:13:08.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.452+0000 7fa45f931640 1 -- 172.21.15.87:0/3311923267 shutdown_connections 2024-09-13T17:13:08.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.452+0000 7fa45f931640 1 --2- 172.21.15.87:0/3311923267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa45810a360 0x7fa45810c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:08.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.452+0000 7fa45f931640 1 --2- 172.21.15.87:0/3311923267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa458101850 0x7fa458109d40 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:08.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.452+0000 7fa45f931640 1 --2- 172.21.15.87:0/3311923267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa458100f30 0x7fa458101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:08.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.452+0000 7fa45f931640 1 -- 172.21.15.87:0/3311923267 >> 172.21.15.87:0/3311923267 conn(0x7fa4580fa9b0 msgr2=0x7fa4580fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:08.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.452+0000 7fa45f931640 1 -- 172.21.15.87:0/3311923267 shutdown_connections 2024-09-13T17:13:08.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.452+0000 7fa45f931640 1 -- 172.21.15.87:0/3311923267 wait complete. 2024-09-13T17:13:08.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.453+0000 7fa45f931640 1 Processor -- start 2024-09-13T17:13:08.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.453+0000 7fa45f931640 1 -- start start 2024-09-13T17:13:08.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.453+0000 7fa45f931640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa458100f30 0x7fa4580feb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:08.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.453+0000 7fa45f931640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa458101850 0x7fa4580ff0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:08.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.453+0000 7fa45f931640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa45810a360 0x7fa4580ff610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:08.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.453+0000 7fa45f931640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4581a4640 con 0x7fa458101850 2024-09-13T17:13:08.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.453+0000 7fa45f931640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4581a47b0 con 0x7fa45810a360 2024-09-13T17:13:08.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.453+0000 7fa45f931640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4581a4970 con 0x7fa458100f30 2024-09-13T17:13:08.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.453+0000 7fa45cecc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa458101850 0x7fa4580ff0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:08.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.453+0000 7fa45cecc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa458101850 0x7fa4580ff0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57818/0 (socket says 172.21.15.87:57818) 2024-09-13T17:13:08.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.453+0000 7fa45cecc640 1 -- 172.21.15.87:0/2056268855 learned_addr learned my addr 172.21.15.87:0/2056268855 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:08.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.453+0000 7fa45dece640 1 --2- 172.21.15.87:0/2056268855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa45810a360 0x7fa4580ff610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:08.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.453+0000 7fa45d6cd640 1 --2- 172.21.15.87:0/2056268855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa458100f30 0x7fa4580feb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:08.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.453+0000 7fa45cecc640 1 -- 172.21.15.87:0/2056268855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa458100f30 msgr2=0x7fa4580feb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:08.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.453+0000 7fa45cecc640 1 --2- 172.21.15.87:0/2056268855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa458100f30 0x7fa4580feb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:08.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.453+0000 7fa45cecc640 1 -- 172.21.15.87:0/2056268855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa45810a360 msgr2=0x7fa4580ff610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:08.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.453+0000 7fa45cecc640 1 --2- 172.21.15.87:0/2056268855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa45810a360 0x7fa4580ff610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:08.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.453+0000 7fa45cecc640 1 -- 172.21.15.87:0/2056268855 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa44c009560 con 0x7fa458101850 2024-09-13T17:13:08.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.453+0000 7fa45cecc640 1 --2- 172.21.15.87:0/2056268855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa458101850 0x7fa4580ff0d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa44c005ab0 tx=0x7fa44c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:08.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.454+0000 7fa4567fc640 1 -- 172.21.15.87:0/2056268855 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44c003a00 con 0x7fa458101850 2024-09-13T17:13:08.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.454+0000 7fa4567fc640 1 -- 172.21.15.87:0/2056268855 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa44c0044e0 con 0x7fa458101850 2024-09-13T17:13:08.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.454+0000 7fa45f931640 1 -- 172.21.15.87:0/2056268855 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4581a4bf0 con 0x7fa458101850 2024-09-13T17:13:08.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.454+0000 7fa4567fc640 1 -- 172.21.15.87:0/2056268855 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44c03bda0 con 0x7fa458101850 2024-09-13T17:13:08.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.454+0000 7fa45f931640 1 -- 172.21.15.87:0/2056268855 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4581a50e0 con 0x7fa458101850 2024-09-13T17:13:08.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.455+0000 7fa45f931640 1 -- 172.21.15.87:0/2056268855 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4580687e0 con 0x7fa458101850 2024-09-13T17:13:08.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.456+0000 7fa4567fc640 1 -- 172.21.15.87:0/2056268855 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fa44c003b60 con 0x7fa458101850 2024-09-13T17:13:08.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.456+0000 7fa4567fc640 1 --2- 172.21.15.87:0/2056268855 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa4400a1190 0x7fa4400a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:08.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.456+0000 7fa45d6cd640 1 --2- 172.21.15.87:0/2056268855 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa4400a1190 0x7fa4400a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:08.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.457+0000 7fa4567fc640 1 -- 172.21.15.87:0/2056268855 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7fa44c0edf00 con 0x7fa458101850 2024-09-13T17:13:08.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.457+0000 7fa45d6cd640 1 --2- 172.21.15.87:0/2056268855 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa4400a1190 0x7fa4400a3650 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa448005fd0 tx=0x7fa448009870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:08.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.460+0000 7fa4567fc640 1 -- 172.21.15.87:0/2056268855 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa44c0b7100 con 0x7fa458101850 2024-09-13T17:13:08.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.618+0000 7fa45f931640 1 -- 172.21.15.87:0/2056268855 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa458105440 con 0x7fa4400a1190 2024-09-13T17:13:08.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.629+0000 7fa4567fc640 1 -- 172.21.15.87:0/2056268855 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+429118 (secure 0 0 0) 0x7fa458105440 con 0x7fa4400a1190 2024-09-13T17:13:08.635 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:13:08.637 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-13T17:13:08.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.632+0000 7fa45f931640 1 -- 172.21.15.87:0/2056268855 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa4400a1190 msgr2=0x7fa4400a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:08.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.632+0000 7fa45f931640 1 --2- 172.21.15.87:0/2056268855 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa4400a1190 0x7fa4400a3650 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa448005fd0 tx=0x7fa448009870 comp rx=0 tx=0).stop 2024-09-13T17:13:08.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.632+0000 7fa45f931640 1 -- 172.21.15.87:0/2056268855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa458101850 msgr2=0x7fa4580ff0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:08.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.632+0000 7fa45f931640 1 --2- 172.21.15.87:0/2056268855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa458101850 0x7fa4580ff0d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa44c005ab0 tx=0x7fa44c0042f0 comp rx=0 tx=0).stop 2024-09-13T17:13:08.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.632+0000 7fa45f931640 1 -- 172.21.15.87:0/2056268855 shutdown_connections 2024-09-13T17:13:08.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.632+0000 7fa45f931640 1 --2- 172.21.15.87:0/2056268855 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa4400a1190 0x7fa4400a3650 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:08.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.632+0000 7fa45f931640 1 --2- 172.21.15.87:0/2056268855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa45810a360 0x7fa4580ff610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:08.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.632+0000 7fa45f931640 1 --2- 172.21.15.87:0/2056268855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa458101850 0x7fa4580ff0d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:08.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.632+0000 7fa45f931640 1 --2- 172.21.15.87:0/2056268855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa458100f30 0x7fa4580feb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:08.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.632+0000 7fa45f931640 1 -- 172.21.15.87:0/2056268855 >> 172.21.15.87:0/2056268855 conn(0x7fa4580fa9b0 msgr2=0x7fa4580fc250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:08.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.632+0000 7fa45f931640 1 -- 172.21.15.87:0/2056268855 shutdown_connections 2024-09-13T17:13:08.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:08.632+0000 7fa45f931640 1 -- 172.21.15.87:0/2056268855 wait complete. 2024-09-13T17:13:09.411 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:09 smithi087 ceph-mon[30934]: pgmap v333: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T17:13:09.432 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":333,"stamp":"2024-09-13T17:13:08.096183+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656795,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":628,"num_read_kb":435,"num_write":341,"num_write_kb":3055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1181900,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":377640,"kb_used_data":12428,"kb_used_omap":18,"kb_used_meta":365037,"kb_avail":1124564184,"statfs":{"total":1151940427776,"available":1151553724416,"internally_reserved":0,"allocated":12726272,"data_stored":8172477,"data_compressed":392949,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19109,"internal_metadata":373798235},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003087"},"pg_stats":[{"pgid":"2.1f","version":"89'9","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.228849+0000","last_change":"2024-09-13T17:12:50.228849+0000","last_active":"2024-09-13T17:12:50.228849+0000","last_peered":"2024-09-13T17:12:50.228849+0000","last_clean":"2024-09-13T17:12:50.228849+0000","last_became_active":"2024-09-13T17:12:50.221697+0000","last_became_peered":"2024-09-13T17:12:50.221697+0000","last_unstale":"2024-09-13T17:12:50.228849+0000","last_undegraded":"2024-09-13T17:12:50.228849+0000","last_fullsized":"2024-09-13T17:12:50.228849+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:45.356785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.223905+0000","last_change":"2024-09-13T17:11:23.340108+0000","last_active":"2024-09-13T17:12:49.223905+0000","last_peered":"2024-09-13T17:12:49.223905+0000","last_clean":"2024-09-13T17:12:49.223905+0000","last_became_active":"2024-09-13T17:11:23.339832+0000","last_became_peered":"2024-09-13T17:11:23.339832+0000","last_unstale":"2024-09-13T17:12:49.223905+0000","last_undegraded":"2024-09-13T17:12:49.223905+0000","last_fullsized":"2024-09-13T17:12:49.223905+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:40.969448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.761228+0000","last_change":"2024-09-13T17:12:50.761228+0000","last_active":"2024-09-13T17:12:50.761228+0000","last_peered":"2024-09-13T17:12:50.761228+0000","last_clean":"2024-09-13T17:12:50.761228+0000","last_became_active":"2024-09-13T17:12:50.760842+0000","last_became_peered":"2024-09-13T17:12:50.760842+0000","last_unstale":"2024-09-13T17:12:50.761228+0000","last_undegraded":"2024-09-13T17:12:50.761228+0000","last_fullsized":"2024-09-13T17:12:50.761228+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:30.513246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,10,0],"acting":[2,3,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.224166+0000","last_change":"2024-09-13T17:11:23.000779+0000","last_active":"2024-09-13T17:12:49.224166+0000","last_peered":"2024-09-13T17:12:49.224166+0000","last_clean":"2024-09-13T17:12:49.224166+0000","last_became_active":"2024-09-13T17:11:23.000511+0000","last_became_peered":"2024-09-13T17:11:23.000511+0000","last_unstale":"2024-09-13T17:12:49.224166+0000","last_undegraded":"2024-09-13T17:12:49.224166+0000","last_fullsized":"2024-09-13T17:12:49.224166+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:09.802392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.220114+0000","last_change":"2024-09-13T17:11:23.333948+0000","last_active":"2024-09-13T17:12:49.220114+0000","last_peered":"2024-09-13T17:12:49.220114+0000","last_clean":"2024-09-13T17:12:49.220114+0000","last_became_active":"2024-09-13T17:11:23.333679+0000","last_became_peered":"2024-09-13T17:11:23.333679+0000","last_unstale":"2024-09-13T17:12:49.220114+0000","last_undegraded":"2024-09-13T17:12:49.220114+0000","last_fullsized":"2024-09-13T17:12:49.220114+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:10.265157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.214269+0000","last_change":"2024-09-13T17:11:27.353767+0000","last_active":"2024-09-13T17:12:49.214269+0000","last_peered":"2024-09-13T17:12:49.214269+0000","last_clean":"2024-09-13T17:12:49.214269+0000","last_became_active":"2024-09-13T17:11:27.353448+0000","last_became_peered":"2024-09-13T17:11:27.353448+0000","last_unstale":"2024-09-13T17:12:49.214269+0000","last_undegraded":"2024-09-13T17:12:49.214269+0000","last_fullsized":"2024-09-13T17:12:49.214269+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:15.948099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.212975+0000","last_change":"2024-09-13T17:11:22.999879+0000","last_active":"2024-09-13T17:12:49.212975+0000","last_peered":"2024-09-13T17:12:49.212975+0000","last_clean":"2024-09-13T17:12:49.212975+0000","last_became_active":"2024-09-13T17:11:22.999577+0000","last_became_peered":"2024-09-13T17:11:22.999577+0000","last_unstale":"2024-09-13T17:12:49.212975+0000","last_undegraded":"2024-09-13T17:12:49.212975+0000","last_fullsized":"2024-09-13T17:12:49.212975+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:48.485532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217363+0000","last_change":"2024-09-13T17:11:23.339026+0000","last_active":"2024-09-13T17:12:49.217363+0000","last_peered":"2024-09-13T17:12:49.217363+0000","last_clean":"2024-09-13T17:12:49.217363+0000","last_became_active":"2024-09-13T17:11:23.338745+0000","last_became_peered":"2024-09-13T17:11:23.338745+0000","last_unstale":"2024-09-13T17:12:49.217363+0000","last_undegraded":"2024-09-13T17:12:49.217363+0000","last_fullsized":"2024-09-13T17:12:49.217363+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:27.455418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.215049+0000","last_change":"2024-09-13T17:11:27.363137+0000","last_active":"2024-09-13T17:12:49.215049+0000","last_peered":"2024-09-13T17:12:49.215049+0000","last_clean":"2024-09-13T17:12:49.215049+0000","last_became_active":"2024-09-13T17:11:27.362621+0000","last_became_peered":"2024-09-13T17:11:27.362621+0000","last_unstale":"2024-09-13T17:12:49.215049+0000","last_undegraded":"2024-09-13T17:12:49.215049+0000","last_fullsized":"2024-09-13T17:12:49.215049+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:35:51.492630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.226520+0000","last_change":"2024-09-13T17:12:50.226520+0000","last_active":"2024-09-13T17:12:50.226520+0000","last_peered":"2024-09-13T17:12:50.226520+0000","last_clean":"2024-09-13T17:12:50.226520+0000","last_became_active":"2024-09-13T17:12:50.223542+0000","last_became_peered":"2024-09-13T17:12:50.223542+0000","last_unstale":"2024-09-13T17:12:50.226520+0000","last_undegraded":"2024-09-13T17:12:50.226520+0000","last_fullsized":"2024-09-13T17:12:50.226520+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:38.064047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.219145+0000","last_change":"2024-09-13T17:11:23.336778+0000","last_active":"2024-09-13T17:12:49.219145+0000","last_peered":"2024-09-13T17:12:49.219145+0000","last_clean":"2024-09-13T17:12:49.219145+0000","last_became_active":"2024-09-13T17:11:23.336491+0000","last_became_peered":"2024-09-13T17:11:23.336491+0000","last_unstale":"2024-09-13T17:12:49.219145+0000","last_undegraded":"2024-09-13T17:12:49.219145+0000","last_fullsized":"2024-09-13T17:12:49.219145+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:02.045912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.214661+0000","last_change":"2024-09-13T17:11:27.361454+0000","last_active":"2024-09-13T17:12:49.214661+0000","last_peered":"2024-09-13T17:12:49.214661+0000","last_clean":"2024-09-13T17:12:49.214661+0000","last_became_active":"2024-09-13T17:11:27.360980+0000","last_became_peered":"2024-09-13T17:11:27.360980+0000","last_unstale":"2024-09-13T17:12:49.214661+0000","last_undegraded":"2024-09-13T17:12:49.214661+0000","last_fullsized":"2024-09-13T17:12:49.214661+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:36.036426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217254+0000","last_change":"2024-09-13T17:11:23.334073+0000","last_active":"2024-09-13T17:12:49.217254+0000","last_peered":"2024-09-13T17:12:49.217254+0000","last_clean":"2024-09-13T17:12:49.217254+0000","last_became_active":"2024-09-13T17:11:23.333628+0000","last_became_peered":"2024-09-13T17:11:23.333628+0000","last_unstale":"2024-09-13T17:12:49.217254+0000","last_undegraded":"2024-09-13T17:12:49.217254+0000","last_fullsized":"2024-09-13T17:12:49.217254+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:18.561346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.229697+0000","last_change":"2024-09-13T17:12:50.229697+0000","last_active":"2024-09-13T17:12:50.229697+0000","last_peered":"2024-09-13T17:12:50.229697+0000","last_clean":"2024-09-13T17:12:50.229697+0000","last_became_active":"2024-09-13T17:12:50.224286+0000","last_became_peered":"2024-09-13T17:12:50.224286+0000","last_unstale":"2024-09-13T17:12:50.229697+0000","last_undegraded":"2024-09-13T17:12:50.229697+0000","last_fullsized":"2024-09-13T17:12:50.229697+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:42.724176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.214861+0000","last_change":"2024-09-13T17:11:27.355472+0000","last_active":"2024-09-13T17:12:49.214861+0000","last_peered":"2024-09-13T17:12:49.214861+0000","last_clean":"2024-09-13T17:12:49.214861+0000","last_became_active":"2024-09-13T17:11:27.355065+0000","last_became_peered":"2024-09-13T17:11:27.355065+0000","last_unstale":"2024-09-13T17:12:49.214861+0000","last_undegraded":"2024-09-13T17:12:49.214861+0000","last_fullsized":"2024-09-13T17:12:49.214861+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:03.881097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.222965+0000","last_change":"2024-09-13T17:11:23.340268+0000","last_active":"2024-09-13T17:12:49.222965+0000","last_peered":"2024-09-13T17:12:49.222965+0000","last_clean":"2024-09-13T17:12:49.222965+0000","last_became_active":"2024-09-13T17:11:23.339977+0000","last_became_peered":"2024-09-13T17:11:23.339977+0000","last_unstale":"2024-09-13T17:12:49.222965+0000","last_undegraded":"2024-09-13T17:12:49.222965+0000","last_fullsized":"2024-09-13T17:12:49.222965+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:21.067899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"90'1","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217071+0000","last_change":"2024-09-13T17:11:23.000858+0000","last_active":"2024-09-13T17:12:49.217071+0000","last_peered":"2024-09-13T17:12:49.217071+0000","last_clean":"2024-09-13T17:12:49.217071+0000","last_became_active":"2024-09-13T17:11:23.000536+0000","last_became_peered":"2024-09-13T17:11:23.000536+0000","last_unstale":"2024-09-13T17:12:49.217071+0000","last_undegraded":"2024-09-13T17:12:49.217071+0000","last_fullsized":"2024-09-13T17:12:49.217071+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:28.798579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.214906+0000","last_change":"2024-09-13T17:11:27.354018+0000","last_active":"2024-09-13T17:12:49.214906+0000","last_peered":"2024-09-13T17:12:49.214906+0000","last_clean":"2024-09-13T17:12:49.214906+0000","last_became_active":"2024-09-13T17:11:27.353519+0000","last_became_peered":"2024-09-13T17:11:27.353519+0000","last_unstale":"2024-09-13T17:12:49.214906+0000","last_undegraded":"2024-09-13T17:12:49.214906+0000","last_fullsized":"2024-09-13T17:12:49.214906+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:55.227851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216063+0000","last_change":"2024-09-13T17:11:23.335798+0000","last_active":"2024-09-13T17:12:49.216063+0000","last_peered":"2024-09-13T17:12:49.216063+0000","last_clean":"2024-09-13T17:12:49.216063+0000","last_became_active":"2024-09-13T17:11:23.335445+0000","last_became_peered":"2024-09-13T17:11:23.335445+0000","last_unstale":"2024-09-13T17:12:49.216063+0000","last_undegraded":"2024-09-13T17:12:49.216063+0000","last_fullsized":"2024-09-13T17:12:49.216063+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:53.242067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.223587+0000","last_change":"2024-09-13T17:11:22.994118+0000","last_active":"2024-09-13T17:12:49.223587+0000","last_peered":"2024-09-13T17:12:49.223587+0000","last_clean":"2024-09-13T17:12:49.223587+0000","last_became_active":"2024-09-13T17:11:22.993801+0000","last_became_peered":"2024-09-13T17:11:22.993801+0000","last_unstale":"2024-09-13T17:12:49.223587+0000","last_undegraded":"2024-09-13T17:12:49.223587+0000","last_fullsized":"2024-09-13T17:12:49.223587+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:01.382130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.213021+0000","last_change":"2024-09-13T17:11:27.358795+0000","last_active":"2024-09-13T17:12:49.213021+0000","last_peered":"2024-09-13T17:12:49.213021+0000","last_clean":"2024-09-13T17:12:49.213021+0000","last_became_active":"2024-09-13T17:11:27.358166+0000","last_became_peered":"2024-09-13T17:11:27.358166+0000","last_unstale":"2024-09-13T17:12:49.213021+0000","last_undegraded":"2024-09-13T17:12:49.213021+0000","last_fullsized":"2024-09-13T17:12:49.213021+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:23.787842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.212378+0000","last_change":"2024-09-13T17:11:23.340671+0000","last_active":"2024-09-13T17:12:49.212378+0000","last_peered":"2024-09-13T17:12:49.212378+0000","last_clean":"2024-09-13T17:12:49.212378+0000","last_became_active":"2024-09-13T17:11:23.340360+0000","last_became_peered":"2024-09-13T17:11:23.340360+0000","last_unstale":"2024-09-13T17:12:49.212378+0000","last_undegraded":"2024-09-13T17:12:49.212378+0000","last_fullsized":"2024-09-13T17:12:49.212378+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:17.875171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216301+0000","last_change":"2024-09-13T17:11:22.993039+0000","last_active":"2024-09-13T17:12:49.216301+0000","last_peered":"2024-09-13T17:12:49.216301+0000","last_clean":"2024-09-13T17:12:49.216301+0000","last_became_active":"2024-09-13T17:11:22.992701+0000","last_became_peered":"2024-09-13T17:11:22.992701+0000","last_unstale":"2024-09-13T17:12:49.216301+0000","last_undegraded":"2024-09-13T17:12:49.216301+0000","last_fullsized":"2024-09-13T17:12:49.216301+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:28.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.214815+0000","last_change":"2024-09-13T17:11:27.363834+0000","last_active":"2024-09-13T17:12:49.214815+0000","last_peered":"2024-09-13T17:12:49.214815+0000","last_clean":"2024-09-13T17:12:49.214815+0000","last_became_active":"2024-09-13T17:11:27.363425+0000","last_became_peered":"2024-09-13T17:11:27.363425+0000","last_unstale":"2024-09-13T17:12:49.214815+0000","last_undegraded":"2024-09-13T17:12:49.214815+0000","last_fullsized":"2024-09-13T17:12:49.214815+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:37.389881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.220993+0000","last_change":"2024-09-13T17:11:23.337423+0000","last_active":"2024-09-13T17:12:49.220993+0000","last_peered":"2024-09-13T17:12:49.220993+0000","last_clean":"2024-09-13T17:12:49.220993+0000","last_became_active":"2024-09-13T17:11:23.337167+0000","last_became_peered":"2024-09-13T17:11:23.337167+0000","last_unstale":"2024-09-13T17:12:49.220993+0000","last_undegraded":"2024-09-13T17:12:49.220993+0000","last_fullsized":"2024-09-13T17:12:49.220993+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:28.540283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.215168+0000","last_change":"2024-09-13T17:11:23.000486+0000","last_active":"2024-09-13T17:12:49.215168+0000","last_peered":"2024-09-13T17:12:49.215168+0000","last_clean":"2024-09-13T17:12:49.215168+0000","last_became_active":"2024-09-13T17:11:23.000158+0000","last_became_peered":"2024-09-13T17:11:23.000158+0000","last_unstale":"2024-09-13T17:12:49.215168+0000","last_undegraded":"2024-09-13T17:12:49.215168+0000","last_fullsized":"2024-09-13T17:12:49.215168+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:42.635037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216284+0000","last_change":"2024-09-13T17:11:27.355058+0000","last_active":"2024-09-13T17:12:49.216284+0000","last_peered":"2024-09-13T17:12:49.216284+0000","last_clean":"2024-09-13T17:12:49.216284+0000","last_became_active":"2024-09-13T17:11:27.354726+0000","last_became_peered":"2024-09-13T17:11:27.354726+0000","last_unstale":"2024-09-13T17:12:49.216284+0000","last_undegraded":"2024-09-13T17:12:49.216284+0000","last_fullsized":"2024-09-13T17:12:49.216284+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:58.450122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.224081+0000","last_change":"2024-09-13T17:11:23.337245+0000","last_active":"2024-09-13T17:12:49.224081+0000","last_peered":"2024-09-13T17:12:49.224081+0000","last_clean":"2024-09-13T17:12:49.224081+0000","last_became_active":"2024-09-13T17:11:23.336956+0000","last_became_peered":"2024-09-13T17:11:23.336956+0000","last_unstale":"2024-09-13T17:12:49.224081+0000","last_undegraded":"2024-09-13T17:12:49.224081+0000","last_fullsized":"2024-09-13T17:12:49.224081+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:46.876149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'6","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.213941+0000","last_change":"2024-09-13T17:11:22.999942+0000","last_active":"2024-09-13T17:12:49.213941+0000","last_peered":"2024-09-13T17:12:49.213941+0000","last_clean":"2024-09-13T17:12:49.213941+0000","last_became_active":"2024-09-13T17:11:22.999653+0000","last_became_peered":"2024-09-13T17:11:22.999653+0000","last_unstale":"2024-09-13T17:12:49.213941+0000","last_undegraded":"2024-09-13T17:12:49.213941+0000","last_fullsized":"2024-09-13T17:12:49.213941+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:29.400939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.223333+0000","last_change":"2024-09-13T17:11:27.356479+0000","last_active":"2024-09-13T17:12:49.223333+0000","last_peered":"2024-09-13T17:12:49.223333+0000","last_clean":"2024-09-13T17:12:49.223333+0000","last_became_active":"2024-09-13T17:11:27.356052+0000","last_became_peered":"2024-09-13T17:11:27.356052+0000","last_unstale":"2024-09-13T17:12:49.223333+0000","last_undegraded":"2024-09-13T17:12:49.223333+0000","last_fullsized":"2024-09-13T17:12:49.223333+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:42.173376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217286+0000","last_change":"2024-09-13T17:11:23.333786+0000","last_active":"2024-09-13T17:12:49.217286+0000","last_peered":"2024-09-13T17:12:49.217286+0000","last_clean":"2024-09-13T17:12:49.217286+0000","last_became_active":"2024-09-13T17:11:23.333472+0000","last_became_peered":"2024-09-13T17:11:23.333472+0000","last_unstale":"2024-09-13T17:12:49.217286+0000","last_undegraded":"2024-09-13T17:12:49.217286+0000","last_fullsized":"2024-09-13T17:12:49.217286+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:41.633228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.213084+0000","last_change":"2024-09-13T17:11:22.998646+0000","last_active":"2024-09-13T17:12:49.213084+0000","last_peered":"2024-09-13T17:12:49.213084+0000","last_clean":"2024-09-13T17:12:49.213084+0000","last_became_active":"2024-09-13T17:11:22.998291+0000","last_became_peered":"2024-09-13T17:11:22.998291+0000","last_unstale":"2024-09-13T17:12:49.213084+0000","last_undegraded":"2024-09-13T17:12:49.213084+0000","last_fullsized":"2024-09-13T17:12:49.213084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:20.658436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216185+0000","last_change":"2024-09-13T17:11:27.361174+0000","last_active":"2024-09-13T17:12:49.216185+0000","last_peered":"2024-09-13T17:12:49.216185+0000","last_clean":"2024-09-13T17:12:49.216185+0000","last_became_active":"2024-09-13T17:11:27.360737+0000","last_became_peered":"2024-09-13T17:11:27.360737+0000","last_unstale":"2024-09-13T17:12:49.216185+0000","last_undegraded":"2024-09-13T17:12:49.216185+0000","last_fullsized":"2024-09-13T17:12:49.216185+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:00.941364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.211855+0000","last_change":"2024-09-13T17:11:23.338545+0000","last_active":"2024-09-13T17:12:49.211855+0000","last_peered":"2024-09-13T17:12:49.211855+0000","last_clean":"2024-09-13T17:12:49.211855+0000","last_became_active":"2024-09-13T17:11:23.338246+0000","last_became_peered":"2024-09-13T17:11:23.338246+0000","last_unstale":"2024-09-13T17:12:49.211855+0000","last_undegraded":"2024-09-13T17:12:49.211855+0000","last_fullsized":"2024-09-13T17:12:49.211855+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:18.966658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.214100+0000","last_change":"2024-09-13T17:11:22.993497+0000","last_active":"2024-09-13T17:12:49.214100+0000","last_peered":"2024-09-13T17:12:49.214100+0000","last_clean":"2024-09-13T17:12:49.214100+0000","last_became_active":"2024-09-13T17:11:22.993165+0000","last_became_peered":"2024-09-13T17:11:22.993165+0000","last_unstale":"2024-09-13T17:12:49.214100+0000","last_undegraded":"2024-09-13T17:12:49.214100+0000","last_fullsized":"2024-09-13T17:12:49.214100+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:20.997834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.212378+0000","last_change":"2024-09-13T17:11:27.364652+0000","last_active":"2024-09-13T17:12:49.212378+0000","last_peered":"2024-09-13T17:12:49.212378+0000","last_clean":"2024-09-13T17:12:49.212378+0000","last_became_active":"2024-09-13T17:11:27.364245+0000","last_became_peered":"2024-09-13T17:11:27.364245+0000","last_unstale":"2024-09-13T17:12:49.212378+0000","last_undegraded":"2024-09-13T17:12:49.212378+0000","last_fullsized":"2024-09-13T17:12:49.212378+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:23.048289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.211679+0000","last_change":"2024-09-13T17:11:23.335649+0000","last_active":"2024-09-13T17:12:49.211679+0000","last_peered":"2024-09-13T17:12:49.211679+0000","last_clean":"2024-09-13T17:12:49.211679+0000","last_became_active":"2024-09-13T17:11:23.335364+0000","last_became_peered":"2024-09-13T17:11:23.335364+0000","last_unstale":"2024-09-13T17:12:49.211679+0000","last_undegraded":"2024-09-13T17:12:49.211679+0000","last_fullsized":"2024-09-13T17:12:49.211679+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.447947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216818+0000","last_change":"2024-09-13T17:11:23.003188+0000","last_active":"2024-09-13T17:12:49.216818+0000","last_peered":"2024-09-13T17:12:49.216818+0000","last_clean":"2024-09-13T17:12:49.216818+0000","last_became_active":"2024-09-13T17:11:23.002858+0000","last_became_peered":"2024-09-13T17:11:23.002858+0000","last_unstale":"2024-09-13T17:12:49.216818+0000","last_undegraded":"2024-09-13T17:12:49.216818+0000","last_fullsized":"2024-09-13T17:12:49.216818+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:34.153326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216174+0000","last_change":"2024-09-13T17:11:27.353320+0000","last_active":"2024-09-13T17:12:49.216174+0000","last_peered":"2024-09-13T17:12:49.216174+0000","last_clean":"2024-09-13T17:12:49.216174+0000","last_became_active":"2024-09-13T17:11:27.352947+0000","last_became_peered":"2024-09-13T17:11:27.352947+0000","last_unstale":"2024-09-13T17:12:49.216174+0000","last_undegraded":"2024-09-13T17:12:49.216174+0000","last_fullsized":"2024-09-13T17:12:49.216174+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:04.619618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.218521+0000","last_change":"2024-09-13T17:11:23.330128+0000","last_active":"2024-09-13T17:12:49.218521+0000","last_peered":"2024-09-13T17:12:49.218521+0000","last_clean":"2024-09-13T17:12:49.218521+0000","last_became_active":"2024-09-13T17:11:23.329266+0000","last_became_peered":"2024-09-13T17:11:23.329266+0000","last_unstale":"2024-09-13T17:12:49.218521+0000","last_undegraded":"2024-09-13T17:12:49.218521+0000","last_fullsized":"2024-09-13T17:12:49.218521+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:36.275352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'4","reported_seq":102,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:03.906325+0000","last_change":"2024-09-13T17:11:23.003495+0000","last_active":"2024-09-13T17:13:03.906325+0000","last_peered":"2024-09-13T17:13:03.906325+0000","last_clean":"2024-09-13T17:13:03.906325+0000","last_became_active":"2024-09-13T17:11:23.003186+0000","last_became_peered":"2024-09-13T17:11:23.003186+0000","last_unstale":"2024-09-13T17:13:03.906325+0000","last_undegraded":"2024-09-13T17:13:03.906325+0000","last_fullsized":"2024-09-13T17:13:03.906325+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:23.353587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216413+0000","last_change":"2024-09-13T17:11:27.362233+0000","last_active":"2024-09-13T17:12:49.216413+0000","last_peered":"2024-09-13T17:12:49.216413+0000","last_clean":"2024-09-13T17:12:49.216413+0000","last_became_active":"2024-09-13T17:11:27.361814+0000","last_became_peered":"2024-09-13T17:11:27.361814+0000","last_unstale":"2024-09-13T17:12:49.216413+0000","last_undegraded":"2024-09-13T17:12:49.216413+0000","last_fullsized":"2024-09-13T17:12:49.216413+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:20.723366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.215129+0000","last_change":"2024-09-13T17:11:23.332870+0000","last_active":"2024-09-13T17:12:49.215129+0000","last_peered":"2024-09-13T17:12:49.215129+0000","last_clean":"2024-09-13T17:12:49.215129+0000","last_became_active":"2024-09-13T17:11:23.332583+0000","last_became_peered":"2024-09-13T17:11:23.332583+0000","last_unstale":"2024-09-13T17:12:49.215129+0000","last_undegraded":"2024-09-13T17:12:49.215129+0000","last_fullsized":"2024-09-13T17:12:49.215129+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:22.607666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216073+0000","last_change":"2024-09-13T17:11:23.001932+0000","last_active":"2024-09-13T17:12:49.216073+0000","last_peered":"2024-09-13T17:12:49.216073+0000","last_clean":"2024-09-13T17:12:49.216073+0000","last_became_active":"2024-09-13T17:11:23.001642+0000","last_became_peered":"2024-09-13T17:11:23.001642+0000","last_unstale":"2024-09-13T17:12:49.216073+0000","last_undegraded":"2024-09-13T17:12:49.216073+0000","last_fullsized":"2024-09-13T17:12:49.216073+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:05.976897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.218572+0000","last_change":"2024-09-13T17:11:27.359679+0000","last_active":"2024-09-13T17:12:49.218572+0000","last_peered":"2024-09-13T17:12:49.218572+0000","last_clean":"2024-09-13T17:12:49.218572+0000","last_became_active":"2024-09-13T17:11:27.359268+0000","last_became_peered":"2024-09-13T17:11:27.359268+0000","last_unstale":"2024-09-13T17:12:49.218572+0000","last_undegraded":"2024-09-13T17:12:49.218572+0000","last_fullsized":"2024-09-13T17:12:49.218572+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:48.154917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.223606+0000","last_change":"2024-09-13T17:11:23.340031+0000","last_active":"2024-09-13T17:12:49.223606+0000","last_peered":"2024-09-13T17:12:49.223606+0000","last_clean":"2024-09-13T17:12:49.223606+0000","last_became_active":"2024-09-13T17:11:23.339768+0000","last_became_peered":"2024-09-13T17:11:23.339768+0000","last_unstale":"2024-09-13T17:12:49.223606+0000","last_undegraded":"2024-09-13T17:12:49.223606+0000","last_fullsized":"2024-09-13T17:12:49.223606+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:22.360526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.215438+0000","last_change":"2024-09-13T17:11:22.995060+0000","last_active":"2024-09-13T17:12:49.215438+0000","last_peered":"2024-09-13T17:12:49.215438+0000","last_clean":"2024-09-13T17:12:49.215438+0000","last_became_active":"2024-09-13T17:11:22.991949+0000","last_became_peered":"2024-09-13T17:11:22.991949+0000","last_unstale":"2024-09-13T17:12:49.215438+0000","last_undegraded":"2024-09-13T17:12:49.215438+0000","last_fullsized":"2024-09-13T17:12:49.215438+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:44.716753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":343,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.217610+0000","last_change":"2024-09-13T17:10:13.439723+0000","last_active":"2024-09-13T17:12:50.217610+0000","last_peered":"2024-09-13T17:12:50.217610+0000","last_clean":"2024-09-13T17:12:50.217610+0000","last_became_active":"2024-09-13T17:10:13.439290+0000","last_became_peered":"2024-09-13T17:10:13.439290+0000","last_unstale":"2024-09-13T17:12:50.217610+0000","last_undegraded":"2024-09-13T17:12:50.217610+0000","last_fullsized":"2024-09-13T17:12:50.217610+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:03.041486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:03.041486+0000","last_clean_scrub_stamp":"2024-09-13T17:07:03.041486+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:08.673571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217581+0000","last_change":"2024-09-13T17:11:27.361028+0000","last_active":"2024-09-13T17:12:49.217581+0000","last_peered":"2024-09-13T17:12:49.217581+0000","last_clean":"2024-09-13T17:12:49.217581+0000","last_became_active":"2024-09-13T17:11:27.360630+0000","last_became_peered":"2024-09-13T17:11:27.360630+0000","last_unstale":"2024-09-13T17:12:49.217581+0000","last_undegraded":"2024-09-13T17:12:49.217581+0000","last_fullsized":"2024-09-13T17:12:49.217581+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:40:40.860443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217834+0000","last_change":"2024-09-13T17:11:49.798729+0000","last_active":"2024-09-13T17:12:49.217834+0000","last_peered":"2024-09-13T17:12:49.217834+0000","last_clean":"2024-09-13T17:12:49.217834+0000","last_became_active":"2024-09-13T17:11:49.798402+0000","last_became_peered":"2024-09-13T17:11:49.798402+0000","last_unstale":"2024-09-13T17:12:49.217834+0000","last_undegraded":"2024-09-13T17:12:49.217834+0000","last_fullsized":"2024-09-13T17:12:49.217834+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:58.948813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,11],"acting":[7,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.214724+0000","last_change":"2024-09-13T17:11:49.802654+0000","last_active":"2024-09-13T17:12:49.214724+0000","last_peered":"2024-09-13T17:12:49.214724+0000","last_clean":"2024-09-13T17:12:49.214724+0000","last_became_active":"2024-09-13T17:11:49.797574+0000","last_became_peered":"2024-09-13T17:11:49.797574+0000","last_unstale":"2024-09-13T17:12:49.214724+0000","last_undegraded":"2024-09-13T17:12:49.214724+0000","last_fullsized":"2024-09-13T17:12:49.214724+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:08.827045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216252+0000","last_change":"2024-09-13T17:11:27.360372+0000","last_active":"2024-09-13T17:12:49.216252+0000","last_peered":"2024-09-13T17:12:49.216252+0000","last_clean":"2024-09-13T17:12:49.216252+0000","last_became_active":"2024-09-13T17:11:27.359990+0000","last_became_peered":"2024-09-13T17:11:27.359990+0000","last_unstale":"2024-09-13T17:12:49.216252+0000","last_undegraded":"2024-09-13T17:12:49.216252+0000","last_fullsized":"2024-09-13T17:12:49.216252+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:26.970317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217460+0000","last_change":"2024-09-13T17:11:23.336269+0000","last_active":"2024-09-13T17:12:49.217460+0000","last_peered":"2024-09-13T17:12:49.217460+0000","last_clean":"2024-09-13T17:12:49.217460+0000","last_became_active":"2024-09-13T17:11:23.335921+0000","last_became_peered":"2024-09-13T17:11:23.335921+0000","last_unstale":"2024-09-13T17:12:49.217460+0000","last_undegraded":"2024-09-13T17:12:49.217460+0000","last_fullsized":"2024-09-13T17:12:49.217460+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:43.035927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.219231+0000","last_change":"2024-09-13T17:11:23.002491+0000","last_active":"2024-09-13T17:12:49.219231+0000","last_peered":"2024-09-13T17:12:49.219231+0000","last_clean":"2024-09-13T17:12:49.219231+0000","last_became_active":"2024-09-13T17:11:23.002178+0000","last_became_peered":"2024-09-13T17:11:23.002178+0000","last_unstale":"2024-09-13T17:12:49.219231+0000","last_undegraded":"2024-09-13T17:12:49.219231+0000","last_fullsized":"2024-09-13T17:12:49.219231+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:06.056639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.219028+0000","last_change":"2024-09-13T17:11:27.355153+0000","last_active":"2024-09-13T17:12:49.219028+0000","last_peered":"2024-09-13T17:12:49.219028+0000","last_clean":"2024-09-13T17:12:49.219028+0000","last_became_active":"2024-09-13T17:11:27.354701+0000","last_became_peered":"2024-09-13T17:11:27.354701+0000","last_unstale":"2024-09-13T17:12:49.219028+0000","last_undegraded":"2024-09-13T17:12:49.219028+0000","last_fullsized":"2024-09-13T17:12:49.219028+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:34.924402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217865+0000","last_change":"2024-09-13T17:11:23.342067+0000","last_active":"2024-09-13T17:12:49.217865+0000","last_peered":"2024-09-13T17:12:49.217865+0000","last_clean":"2024-09-13T17:12:49.217865+0000","last_became_active":"2024-09-13T17:11:23.341736+0000","last_became_peered":"2024-09-13T17:11:23.341736+0000","last_unstale":"2024-09-13T17:12:49.217865+0000","last_undegraded":"2024-09-13T17:12:49.217865+0000","last_fullsized":"2024-09-13T17:12:49.217865+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:03.114638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216293+0000","last_change":"2024-09-13T17:11:23.002849+0000","last_active":"2024-09-13T17:12:49.216293+0000","last_peered":"2024-09-13T17:12:49.216293+0000","last_clean":"2024-09-13T17:12:49.216293+0000","last_became_active":"2024-09-13T17:11:23.002562+0000","last_became_peered":"2024-09-13T17:11:23.002562+0000","last_unstale":"2024-09-13T17:12:49.216293+0000","last_undegraded":"2024-09-13T17:12:49.216293+0000","last_fullsized":"2024-09-13T17:12:49.216293+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:11:24.650510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.218021+0000","last_change":"2024-09-13T17:11:27.359343+0000","last_active":"2024-09-13T17:12:49.218021+0000","last_peered":"2024-09-13T17:12:49.218021+0000","last_clean":"2024-09-13T17:12:49.218021+0000","last_became_active":"2024-09-13T17:11:27.358628+0000","last_became_peered":"2024-09-13T17:11:27.358628+0000","last_unstale":"2024-09-13T17:12:49.218021+0000","last_undegraded":"2024-09-13T17:12:49.218021+0000","last_fullsized":"2024-09-13T17:12:49.218021+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:39.584184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216776+0000","last_change":"2024-09-13T17:11:23.333111+0000","last_active":"2024-09-13T17:12:49.216776+0000","last_peered":"2024-09-13T17:12:49.216776+0000","last_clean":"2024-09-13T17:12:49.216776+0000","last_became_active":"2024-09-13T17:11:23.332734+0000","last_became_peered":"2024-09-13T17:11:23.332734+0000","last_unstale":"2024-09-13T17:12:49.216776+0000","last_undegraded":"2024-09-13T17:12:49.216776+0000","last_fullsized":"2024-09-13T17:12:49.216776+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:44.628106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"91'2","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.213135+0000","last_change":"2024-09-13T17:11:23.000759+0000","last_active":"2024-09-13T17:12:49.213135+0000","last_peered":"2024-09-13T17:12:49.213135+0000","last_clean":"2024-09-13T17:12:49.213135+0000","last_became_active":"2024-09-13T17:11:23.000463+0000","last_became_peered":"2024-09-13T17:11:23.000463+0000","last_unstale":"2024-09-13T17:12:49.213135+0000","last_undegraded":"2024-09-13T17:12:49.213135+0000","last_fullsized":"2024-09-13T17:12:49.213135+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:59.077194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.219054+0000","last_change":"2024-09-13T17:11:27.363076+0000","last_active":"2024-09-13T17:12:49.219054+0000","last_peered":"2024-09-13T17:12:49.219054+0000","last_clean":"2024-09-13T17:12:49.219054+0000","last_became_active":"2024-09-13T17:11:27.362642+0000","last_became_peered":"2024-09-13T17:11:27.362642+0000","last_unstale":"2024-09-13T17:12:49.219054+0000","last_undegraded":"2024-09-13T17:12:49.219054+0000","last_fullsized":"2024-09-13T17:12:49.219054+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:25.494875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.218579+0000","last_change":"2024-09-13T17:11:23.336703+0000","last_active":"2024-09-13T17:12:49.218579+0000","last_peered":"2024-09-13T17:12:49.218579+0000","last_clean":"2024-09-13T17:12:49.218579+0000","last_became_active":"2024-09-13T17:11:23.336349+0000","last_became_peered":"2024-09-13T17:11:23.336349+0000","last_unstale":"2024-09-13T17:12:49.218579+0000","last_undegraded":"2024-09-13T17:12:49.218579+0000","last_fullsized":"2024-09-13T17:12:49.218579+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:28.671438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.212703+0000","last_change":"2024-09-13T17:11:22.994382+0000","last_active":"2024-09-13T17:12:49.212703+0000","last_peered":"2024-09-13T17:12:49.212703+0000","last_clean":"2024-09-13T17:12:49.212703+0000","last_became_active":"2024-09-13T17:11:22.994037+0000","last_became_peered":"2024-09-13T17:11:22.994037+0000","last_unstale":"2024-09-13T17:12:49.212703+0000","last_undegraded":"2024-09-13T17:12:49.212703+0000","last_fullsized":"2024-09-13T17:12:49.212703+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:10.763757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216173+0000","last_change":"2024-09-13T17:11:27.354351+0000","last_active":"2024-09-13T17:12:49.216173+0000","last_peered":"2024-09-13T17:12:49.216173+0000","last_clean":"2024-09-13T17:12:49.216173+0000","last_became_active":"2024-09-13T17:11:27.353715+0000","last_became_peered":"2024-09-13T17:11:27.353715+0000","last_unstale":"2024-09-13T17:12:49.216173+0000","last_undegraded":"2024-09-13T17:12:49.216173+0000","last_fullsized":"2024-09-13T17:12:49.216173+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:18.335183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.215984+0000","last_change":"2024-09-13T17:11:23.341743+0000","last_active":"2024-09-13T17:12:49.215984+0000","last_peered":"2024-09-13T17:12:49.215984+0000","last_clean":"2024-09-13T17:12:49.215984+0000","last_became_active":"2024-09-13T17:11:23.341200+0000","last_became_peered":"2024-09-13T17:11:23.341200+0000","last_unstale":"2024-09-13T17:12:49.215984+0000","last_undegraded":"2024-09-13T17:12:49.215984+0000","last_fullsized":"2024-09-13T17:12:49.215984+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:41.854013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'3","reported_seq":101,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:02.905552+0000","last_change":"2024-09-13T17:11:22.997571+0000","last_active":"2024-09-13T17:13:02.905552+0000","last_peered":"2024-09-13T17:13:02.905552+0000","last_clean":"2024-09-13T17:13:02.905552+0000","last_became_active":"2024-09-13T17:11:22.997238+0000","last_became_peered":"2024-09-13T17:11:22.997238+0000","last_unstale":"2024-09-13T17:13:02.905552+0000","last_undegraded":"2024-09-13T17:13:02.905552+0000","last_fullsized":"2024-09-13T17:13:02.905552+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:34.533004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.761941+0000","last_change":"2024-09-13T17:12:50.761520+0000","last_active":"2024-09-13T17:12:50.761941+0000","last_peered":"2024-09-13T17:12:50.761941+0000","last_clean":"2024-09-13T17:12:50.761941+0000","last_became_active":"2024-09-13T17:12:50.760930+0000","last_became_peered":"2024-09-13T17:12:50.760930+0000","last_unstale":"2024-09-13T17:12:50.761941+0000","last_undegraded":"2024-09-13T17:12:50.761941+0000","last_fullsized":"2024-09-13T17:12:50.761941+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:46.646722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216865+0000","last_change":"2024-09-13T17:11:23.337666+0000","last_active":"2024-09-13T17:12:49.216865+0000","last_peered":"2024-09-13T17:12:49.216865+0000","last_clean":"2024-09-13T17:12:49.216865+0000","last_became_active":"2024-09-13T17:11:23.337185+0000","last_became_peered":"2024-09-13T17:11:23.337185+0000","last_unstale":"2024-09-13T17:12:49.216865+0000","last_undegraded":"2024-09-13T17:12:49.216865+0000","last_fullsized":"2024-09-13T17:12:49.216865+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:51.266709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.219070+0000","last_change":"2024-09-13T17:11:23.005075+0000","last_active":"2024-09-13T17:12:49.219070+0000","last_peered":"2024-09-13T17:12:49.219070+0000","last_clean":"2024-09-13T17:12:49.219070+0000","last_became_active":"2024-09-13T17:11:23.004778+0000","last_became_peered":"2024-09-13T17:11:23.004778+0000","last_unstale":"2024-09-13T17:12:49.219070+0000","last_undegraded":"2024-09-13T17:12:49.219070+0000","last_fullsized":"2024-09-13T17:12:49.219070+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:06.763552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216537+0000","last_change":"2024-09-13T17:11:27.353601+0000","last_active":"2024-09-13T17:12:49.216537+0000","last_peered":"2024-09-13T17:12:49.216537+0000","last_clean":"2024-09-13T17:12:49.216537+0000","last_became_active":"2024-09-13T17:11:27.353190+0000","last_became_peered":"2024-09-13T17:11:27.353190+0000","last_unstale":"2024-09-13T17:12:49.216537+0000","last_undegraded":"2024-09-13T17:12:49.216537+0000","last_fullsized":"2024-09-13T17:12:49.216537+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:24.645552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216619+0000","last_change":"2024-09-13T17:11:49.799773+0000","last_active":"2024-09-13T17:12:49.216619+0000","last_peered":"2024-09-13T17:12:49.216619+0000","last_clean":"2024-09-13T17:12:49.216619+0000","last_became_active":"2024-09-13T17:11:49.799402+0000","last_became_peered":"2024-09-13T17:11:49.799402+0000","last_unstale":"2024-09-13T17:12:49.216619+0000","last_undegraded":"2024-09-13T17:12:49.216619+0000","last_fullsized":"2024-09-13T17:12:49.216619+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:37.230144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217168+0000","last_change":"2024-09-13T17:11:23.005619+0000","last_active":"2024-09-13T17:12:49.217168+0000","last_peered":"2024-09-13T17:12:49.217168+0000","last_clean":"2024-09-13T17:12:49.217168+0000","last_became_active":"2024-09-13T17:11:23.005077+0000","last_became_peered":"2024-09-13T17:11:23.005077+0000","last_unstale":"2024-09-13T17:12:49.217168+0000","last_undegraded":"2024-09-13T17:12:49.217168+0000","last_fullsized":"2024-09-13T17:12:49.217168+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:51.739773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.218348+0000","last_change":"2024-09-13T17:11:27.364603+0000","last_active":"2024-09-13T17:12:49.218348+0000","last_peered":"2024-09-13T17:12:49.218348+0000","last_clean":"2024-09-13T17:12:49.218348+0000","last_became_active":"2024-09-13T17:11:27.364226+0000","last_became_peered":"2024-09-13T17:11:27.364226+0000","last_unstale":"2024-09-13T17:12:49.218348+0000","last_undegraded":"2024-09-13T17:12:49.218348+0000","last_fullsized":"2024-09-13T17:12:49.218348+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:56.802016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.212695+0000","last_change":"2024-09-13T17:11:23.338657+0000","last_active":"2024-09-13T17:12:49.212695+0000","last_peered":"2024-09-13T17:12:49.212695+0000","last_clean":"2024-09-13T17:12:49.212695+0000","last_became_active":"2024-09-13T17:11:23.338377+0000","last_became_peered":"2024-09-13T17:11:23.338377+0000","last_unstale":"2024-09-13T17:12:49.212695+0000","last_undegraded":"2024-09-13T17:12:49.212695+0000","last_fullsized":"2024-09-13T17:12:49.212695+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:52.412887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"91'33","reported_seq":215,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:03.904625+0000","last_change":"2024-09-13T17:11:22.998541+0000","last_active":"2024-09-13T17:13:03.904625+0000","last_peered":"2024-09-13T17:13:03.904625+0000","last_clean":"2024-09-13T17:13:03.904625+0000","last_became_active":"2024-09-13T17:11:22.998132+0000","last_became_peered":"2024-09-13T17:11:22.998132+0000","last_unstale":"2024-09-13T17:13:03.904625+0000","last_undegraded":"2024-09-13T17:13:03.904625+0000","last_fullsized":"2024-09-13T17:13:03.904625+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:16.777772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62287,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":162,"num_read_kb":143,"num_write":34,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.213105+0000","last_change":"2024-09-13T17:11:27.361917+0000","last_active":"2024-09-13T17:12:49.213105+0000","last_peered":"2024-09-13T17:12:49.213105+0000","last_clean":"2024-09-13T17:12:49.213105+0000","last_became_active":"2024-09-13T17:11:27.361503+0000","last_became_peered":"2024-09-13T17:11:27.361503+0000","last_unstale":"2024-09-13T17:12:49.213105+0000","last_undegraded":"2024-09-13T17:12:49.213105+0000","last_fullsized":"2024-09-13T17:12:49.213105+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:52.959017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217459+0000","last_change":"2024-09-13T17:11:49.798971+0000","last_active":"2024-09-13T17:12:49.217459+0000","last_peered":"2024-09-13T17:12:49.217459+0000","last_clean":"2024-09-13T17:12:49.217459+0000","last_became_active":"2024-09-13T17:11:49.798597+0000","last_became_peered":"2024-09-13T17:11:49.798597+0000","last_unstale":"2024-09-13T17:12:49.217459+0000","last_undegraded":"2024-09-13T17:12:49.217459+0000","last_fullsized":"2024-09-13T17:12:49.217459+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:41.886456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.219164+0000","last_change":"2024-09-13T17:11:23.004059+0000","last_active":"2024-09-13T17:12:49.219164+0000","last_peered":"2024-09-13T17:12:49.219164+0000","last_clean":"2024-09-13T17:12:49.219164+0000","last_became_active":"2024-09-13T17:11:23.003248+0000","last_became_peered":"2024-09-13T17:11:23.003248+0000","last_unstale":"2024-09-13T17:12:49.219164+0000","last_undegraded":"2024-09-13T17:12:49.219164+0000","last_fullsized":"2024-09-13T17:12:49.219164+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:05.496872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.215396+0000","last_change":"2024-09-13T17:11:27.362880+0000","last_active":"2024-09-13T17:12:49.215396+0000","last_peered":"2024-09-13T17:12:49.215396+0000","last_clean":"2024-09-13T17:12:49.215396+0000","last_became_active":"2024-09-13T17:11:27.362471+0000","last_became_peered":"2024-09-13T17:11:27.362471+0000","last_unstale":"2024-09-13T17:12:49.215396+0000","last_undegraded":"2024-09-13T17:12:49.215396+0000","last_fullsized":"2024-09-13T17:12:49.215396+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:49.964606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.220188+0000","last_change":"2024-09-13T17:11:49.799023+0000","last_active":"2024-09-13T17:12:49.220188+0000","last_peered":"2024-09-13T17:12:49.220188+0000","last_clean":"2024-09-13T17:12:49.220188+0000","last_became_active":"2024-09-13T17:11:49.798724+0000","last_became_peered":"2024-09-13T17:11:49.798724+0000","last_unstale":"2024-09-13T17:12:49.220188+0000","last_undegraded":"2024-09-13T17:12:49.220188+0000","last_fullsized":"2024-09-13T17:12:49.220188+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:03.569532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,7],"acting":[0,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217861+0000","last_change":"2024-09-13T17:11:22.999158+0000","last_active":"2024-09-13T17:12:49.217861+0000","last_peered":"2024-09-13T17:12:49.217861+0000","last_clean":"2024-09-13T17:12:49.217861+0000","last_became_active":"2024-09-13T17:11:22.998795+0000","last_became_peered":"2024-09-13T17:11:22.998795+0000","last_unstale":"2024-09-13T17:12:49.217861+0000","last_undegraded":"2024-09-13T17:12:49.217861+0000","last_fullsized":"2024-09-13T17:12:49.217861+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:23.880769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.484706+0000","last_change":"2024-09-13T17:12:50.484254+0000","last_active":"2024-09-13T17:12:50.484706+0000","last_peered":"2024-09-13T17:12:50.484706+0000","last_clean":"2024-09-13T17:12:50.484706+0000","last_became_active":"2024-09-13T17:12:50.483742+0000","last_became_peered":"2024-09-13T17:12:50.483742+0000","last_unstale":"2024-09-13T17:12:50.484706+0000","last_undegraded":"2024-09-13T17:12:50.484706+0000","last_fullsized":"2024-09-13T17:12:50.484706+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:59:03.266889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217270+0000","last_change":"2024-09-13T17:11:23.338736+0000","last_active":"2024-09-13T17:12:49.217270+0000","last_peered":"2024-09-13T17:12:49.217270+0000","last_clean":"2024-09-13T17:12:49.217270+0000","last_became_active":"2024-09-13T17:11:23.338462+0000","last_became_peered":"2024-09-13T17:11:23.338462+0000","last_unstale":"2024-09-13T17:12:49.217270+0000","last_undegraded":"2024-09-13T17:12:49.217270+0000","last_fullsized":"2024-09-13T17:12:49.217270+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:49.221314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'3","reported_seq":100,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:02.903016+0000","last_change":"2024-09-13T17:11:23.001966+0000","last_active":"2024-09-13T17:13:02.903016+0000","last_peered":"2024-09-13T17:13:02.903016+0000","last_clean":"2024-09-13T17:13:02.903016+0000","last_became_active":"2024-09-13T17:11:23.001565+0000","last_became_peered":"2024-09-13T17:11:23.001565+0000","last_unstale":"2024-09-13T17:13:02.903016+0000","last_undegraded":"2024-09-13T17:13:02.903016+0000","last_fullsized":"2024-09-13T17:13:02.903016+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:47.240702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":77,"num_read_kb":77,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.223030+0000","last_change":"2024-09-13T17:11:27.360896+0000","last_active":"2024-09-13T17:12:49.223030+0000","last_peered":"2024-09-13T17:12:49.223030+0000","last_clean":"2024-09-13T17:12:49.223030+0000","last_became_active":"2024-09-13T17:11:27.360552+0000","last_became_peered":"2024-09-13T17:11:27.360552+0000","last_unstale":"2024-09-13T17:12:49.223030+0000","last_undegraded":"2024-09-13T17:12:49.223030+0000","last_fullsized":"2024-09-13T17:12:49.223030+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:08.726724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.219405+0000","last_change":"2024-09-13T17:11:27.356317+0000","last_active":"2024-09-13T17:12:49.219405+0000","last_peered":"2024-09-13T17:12:49.219405+0000","last_clean":"2024-09-13T17:12:49.219405+0000","last_became_active":"2024-09-13T17:11:27.355863+0000","last_became_peered":"2024-09-13T17:11:27.355863+0000","last_unstale":"2024-09-13T17:12:49.219405+0000","last_undegraded":"2024-09-13T17:12:49.219405+0000","last_fullsized":"2024-09-13T17:12:49.219405+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:29.356048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.213377+0000","last_change":"2024-09-13T17:11:23.344929+0000","last_active":"2024-09-13T17:12:49.213377+0000","last_peered":"2024-09-13T17:12:49.213377+0000","last_clean":"2024-09-13T17:12:49.213377+0000","last_became_active":"2024-09-13T17:11:23.344627+0000","last_became_peered":"2024-09-13T17:11:23.344627+0000","last_unstale":"2024-09-13T17:12:49.213377+0000","last_undegraded":"2024-09-13T17:12:49.213377+0000","last_fullsized":"2024-09-13T17:12:49.213377+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:15.049627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.218606+0000","last_change":"2024-09-13T17:11:23.002539+0000","last_active":"2024-09-13T17:12:49.218606+0000","last_peered":"2024-09-13T17:12:49.218606+0000","last_clean":"2024-09-13T17:12:49.218606+0000","last_became_active":"2024-09-13T17:11:23.002206+0000","last_became_peered":"2024-09-13T17:11:23.002206+0000","last_unstale":"2024-09-13T17:12:49.218606+0000","last_undegraded":"2024-09-13T17:12:49.218606+0000","last_fullsized":"2024-09-13T17:12:49.218606+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:57.708167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216878+0000","last_change":"2024-09-13T17:11:27.362667+0000","last_active":"2024-09-13T17:12:49.216878+0000","last_peered":"2024-09-13T17:12:49.216878+0000","last_clean":"2024-09-13T17:12:49.216878+0000","last_became_active":"2024-09-13T17:11:27.362293+0000","last_became_peered":"2024-09-13T17:11:27.362293+0000","last_unstale":"2024-09-13T17:12:49.216878+0000","last_undegraded":"2024-09-13T17:12:49.216878+0000","last_fullsized":"2024-09-13T17:12:49.216878+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:24.446951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.223489+0000","last_change":"2024-09-13T17:11:23.335823+0000","last_active":"2024-09-13T17:12:49.223489+0000","last_peered":"2024-09-13T17:12:49.223489+0000","last_clean":"2024-09-13T17:12:49.223489+0000","last_became_active":"2024-09-13T17:11:23.335491+0000","last_became_peered":"2024-09-13T17:11:23.335491+0000","last_unstale":"2024-09-13T17:12:49.223489+0000","last_undegraded":"2024-09-13T17:12:49.223489+0000","last_fullsized":"2024-09-13T17:12:49.223489+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:42.172559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.215225+0000","last_change":"2024-09-13T17:11:22.999477+0000","last_active":"2024-09-13T17:12:49.215225+0000","last_peered":"2024-09-13T17:12:49.215225+0000","last_clean":"2024-09-13T17:12:49.215225+0000","last_became_active":"2024-09-13T17:11:22.999175+0000","last_became_peered":"2024-09-13T17:11:22.999175+0000","last_unstale":"2024-09-13T17:12:49.215225+0000","last_undegraded":"2024-09-13T17:12:49.215225+0000","last_fullsized":"2024-09-13T17:12:49.215225+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:03.817508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.220304+0000","last_change":"2024-09-13T17:12:50.220304+0000","last_active":"2024-09-13T17:12:50.220304+0000","last_peered":"2024-09-13T17:12:50.220304+0000","last_clean":"2024-09-13T17:12:50.220304+0000","last_became_active":"2024-09-13T17:12:50.216329+0000","last_became_peered":"2024-09-13T17:12:50.216329+0000","last_unstale":"2024-09-13T17:12:50.220304+0000","last_undegraded":"2024-09-13T17:12:50.220304+0000","last_fullsized":"2024-09-13T17:12:50.220304+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:18:29.389297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.218126+0000","last_change":"2024-09-13T17:11:23.337738+0000","last_active":"2024-09-13T17:12:49.218126+0000","last_peered":"2024-09-13T17:12:49.218126+0000","last_clean":"2024-09-13T17:12:49.218126+0000","last_became_active":"2024-09-13T17:11:23.337411+0000","last_became_peered":"2024-09-13T17:11:23.337411+0000","last_unstale":"2024-09-13T17:12:49.218126+0000","last_undegraded":"2024-09-13T17:12:49.218126+0000","last_fullsized":"2024-09-13T17:12:49.218126+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:02.355706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.221722+0000","last_change":"2024-09-13T17:12:50.221722+0000","last_active":"2024-09-13T17:12:50.221722+0000","last_peered":"2024-09-13T17:12:50.221722+0000","last_clean":"2024-09-13T17:12:50.221722+0000","last_became_active":"2024-09-13T17:12:50.221273+0000","last_became_peered":"2024-09-13T17:12:50.221273+0000","last_unstale":"2024-09-13T17:12:50.221722+0000","last_undegraded":"2024-09-13T17:12:50.221722+0000","last_fullsized":"2024-09-13T17:12:50.221722+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:28.617737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,8],"acting":[2,6,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'6","reported_seq":108,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:05.908289+0000","last_change":"2024-09-13T17:11:23.000544+0000","last_active":"2024-09-13T17:13:05.908289+0000","last_peered":"2024-09-13T17:13:05.908289+0000","last_clean":"2024-09-13T17:13:05.908289+0000","last_became_active":"2024-09-13T17:11:23.000233+0000","last_became_peered":"2024-09-13T17:11:23.000233+0000","last_unstale":"2024-09-13T17:13:05.908289+0000","last_undegraded":"2024-09-13T17:13:05.908289+0000","last_fullsized":"2024-09-13T17:13:05.908289+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:04.745950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":966,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":83,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.212650+0000","last_change":"2024-09-13T17:11:23.340104+0000","last_active":"2024-09-13T17:12:49.212650+0000","last_peered":"2024-09-13T17:12:49.212650+0000","last_clean":"2024-09-13T17:12:49.212650+0000","last_became_active":"2024-09-13T17:11:23.339826+0000","last_became_peered":"2024-09-13T17:11:23.339826+0000","last_unstale":"2024-09-13T17:12:49.212650+0000","last_undegraded":"2024-09-13T17:12:49.212650+0000","last_fullsized":"2024-09-13T17:12:49.212650+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:03.101547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217283+0000","last_change":"2024-09-13T17:11:27.360848+0000","last_active":"2024-09-13T17:12:49.217283+0000","last_peered":"2024-09-13T17:12:49.217283+0000","last_clean":"2024-09-13T17:12:49.217283+0000","last_became_active":"2024-09-13T17:11:27.360416+0000","last_became_peered":"2024-09-13T17:11:27.360416+0000","last_unstale":"2024-09-13T17:12:49.217283+0000","last_undegraded":"2024-09-13T17:12:49.217283+0000","last_fullsized":"2024-09-13T17:12:49.217283+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:06.857649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.215920+0000","last_change":"2024-09-13T17:11:23.334723+0000","last_active":"2024-09-13T17:12:49.215920+0000","last_peered":"2024-09-13T17:12:49.215920+0000","last_clean":"2024-09-13T17:12:49.215920+0000","last_became_active":"2024-09-13T17:11:23.334433+0000","last_became_peered":"2024-09-13T17:11:23.334433+0000","last_unstale":"2024-09-13T17:12:49.215920+0000","last_undegraded":"2024-09-13T17:12:49.215920+0000","last_fullsized":"2024-09-13T17:12:49.215920+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:08.657151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216615+0000","last_change":"2024-09-13T17:11:23.334882+0000","last_active":"2024-09-13T17:12:49.216615+0000","last_peered":"2024-09-13T17:12:49.216615+0000","last_clean":"2024-09-13T17:12:49.216615+0000","last_became_active":"2024-09-13T17:11:23.334610+0000","last_became_peered":"2024-09-13T17:11:23.334610+0000","last_unstale":"2024-09-13T17:12:49.216615+0000","last_undegraded":"2024-09-13T17:12:49.216615+0000","last_fullsized":"2024-09-13T17:12:49.216615+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:03.932181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216976+0000","last_change":"2024-09-13T17:11:23.334076+0000","last_active":"2024-09-13T17:12:49.216976+0000","last_peered":"2024-09-13T17:12:49.216976+0000","last_clean":"2024-09-13T17:12:49.216976+0000","last_became_active":"2024-09-13T17:11:23.333801+0000","last_became_peered":"2024-09-13T17:11:23.333801+0000","last_unstale":"2024-09-13T17:12:49.216976+0000","last_undegraded":"2024-09-13T17:12:49.216976+0000","last_fullsized":"2024-09-13T17:12:49.216976+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:07.113045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.219073+0000","last_change":"2024-09-13T17:11:23.332306+0000","last_active":"2024-09-13T17:12:49.219073+0000","last_peered":"2024-09-13T17:12:49.219073+0000","last_clean":"2024-09-13T17:12:49.219073+0000","last_became_active":"2024-09-13T17:11:23.331913+0000","last_became_peered":"2024-09-13T17:11:23.331913+0000","last_unstale":"2024-09-13T17:12:49.219073+0000","last_undegraded":"2024-09-13T17:12:49.219073+0000","last_fullsized":"2024-09-13T17:12:49.219073+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:02.927286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216318+0000","last_change":"2024-09-13T17:11:23.335512+0000","last_active":"2024-09-13T17:12:49.216318+0000","last_peered":"2024-09-13T17:12:49.216318+0000","last_clean":"2024-09-13T17:12:49.216318+0000","last_became_active":"2024-09-13T17:11:23.335201+0000","last_became_peered":"2024-09-13T17:11:23.335201+0000","last_unstale":"2024-09-13T17:12:49.216318+0000","last_undegraded":"2024-09-13T17:12:49.216318+0000","last_fullsized":"2024-09-13T17:12:49.216318+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:17.263819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216563+0000","last_change":"2024-09-13T17:11:23.341204+0000","last_active":"2024-09-13T17:12:49.216563+0000","last_peered":"2024-09-13T17:12:49.216563+0000","last_clean":"2024-09-13T17:12:49.216563+0000","last_became_active":"2024-09-13T17:11:23.339848+0000","last_became_peered":"2024-09-13T17:11:23.339848+0000","last_unstale":"2024-09-13T17:12:49.216563+0000","last_undegraded":"2024-09-13T17:12:49.216563+0000","last_fullsized":"2024-09-13T17:12:49.216563+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:15:09.480651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217619+0000","last_change":"2024-09-13T17:11:23.334741+0000","last_active":"2024-09-13T17:12:49.217619+0000","last_peered":"2024-09-13T17:12:49.217619+0000","last_clean":"2024-09-13T17:12:49.217619+0000","last_became_active":"2024-09-13T17:11:23.334459+0000","last_became_peered":"2024-09-13T17:11:23.334459+0000","last_unstale":"2024-09-13T17:12:49.217619+0000","last_undegraded":"2024-09-13T17:12:49.217619+0000","last_fullsized":"2024-09-13T17:12:49.217619+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:52.379735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.224061+0000","last_change":"2024-09-13T17:11:23.337869+0000","last_active":"2024-09-13T17:12:49.224061+0000","last_peered":"2024-09-13T17:12:49.224061+0000","last_clean":"2024-09-13T17:12:49.224061+0000","last_became_active":"2024-09-13T17:11:23.337581+0000","last_became_peered":"2024-09-13T17:11:23.337581+0000","last_unstale":"2024-09-13T17:12:49.224061+0000","last_undegraded":"2024-09-13T17:12:49.224061+0000","last_fullsized":"2024-09-13T17:12:49.224061+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:49.407474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.212446+0000","last_change":"2024-09-13T17:11:49.797828+0000","last_active":"2024-09-13T17:12:49.212446+0000","last_peered":"2024-09-13T17:12:49.212446+0000","last_clean":"2024-09-13T17:12:49.212446+0000","last_became_active":"2024-09-13T17:11:49.797504+0000","last_became_peered":"2024-09-13T17:11:49.797504+0000","last_unstale":"2024-09-13T17:12:49.212446+0000","last_undegraded":"2024-09-13T17:12:49.212446+0000","last_fullsized":"2024-09-13T17:12:49.212446+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:29.677936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.223239+0000","last_change":"2024-09-13T17:11:23.336713+0000","last_active":"2024-09-13T17:12:49.223239+0000","last_peered":"2024-09-13T17:12:49.223239+0000","last_clean":"2024-09-13T17:12:49.223239+0000","last_became_active":"2024-09-13T17:11:23.336431+0000","last_became_peered":"2024-09-13T17:11:23.336431+0000","last_unstale":"2024-09-13T17:12:49.223239+0000","last_undegraded":"2024-09-13T17:12:49.223239+0000","last_fullsized":"2024-09-13T17:12:49.223239+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:52.709483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216726+0000","last_change":"2024-09-13T17:11:23.340385+0000","last_active":"2024-09-13T17:12:49.216726+0000","last_peered":"2024-09-13T17:12:49.216726+0000","last_clean":"2024-09-13T17:12:49.216726+0000","last_became_active":"2024-09-13T17:11:23.340068+0000","last_became_peered":"2024-09-13T17:11:23.340068+0000","last_unstale":"2024-09-13T17:12:49.216726+0000","last_undegraded":"2024-09-13T17:12:49.216726+0000","last_fullsized":"2024-09-13T17:12:49.216726+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:17.795222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216341+0000","last_change":"2024-09-13T17:11:23.329214+0000","last_active":"2024-09-13T17:12:49.216341+0000","last_peered":"2024-09-13T17:12:49.216341+0000","last_clean":"2024-09-13T17:12:49.216341+0000","last_became_active":"2024-09-13T17:11:23.328747+0000","last_became_peered":"2024-09-13T17:11:23.328747+0000","last_unstale":"2024-09-13T17:12:49.216341+0000","last_undegraded":"2024-09-13T17:12:49.216341+0000","last_fullsized":"2024-09-13T17:12:49.216341+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:11.233652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216682+0000","last_change":"2024-09-13T17:11:23.339854+0000","last_active":"2024-09-13T17:12:49.216682+0000","last_peered":"2024-09-13T17:12:49.216682+0000","last_clean":"2024-09-13T17:12:49.216682+0000","last_became_active":"2024-09-13T17:11:23.339565+0000","last_became_peered":"2024-09-13T17:11:23.339565+0000","last_unstale":"2024-09-13T17:12:49.216682+0000","last_undegraded":"2024-09-13T17:12:49.216682+0000","last_fullsized":"2024-09-13T17:12:49.216682+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:37.161135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217407+0000","last_change":"2024-09-13T17:11:23.342562+0000","last_active":"2024-09-13T17:12:49.217407+0000","last_peered":"2024-09-13T17:12:49.217407+0000","last_clean":"2024-09-13T17:12:49.217407+0000","last_became_active":"2024-09-13T17:11:23.342256+0000","last_became_peered":"2024-09-13T17:11:23.342256+0000","last_unstale":"2024-09-13T17:12:49.217407+0000","last_undegraded":"2024-09-13T17:12:49.217407+0000","last_fullsized":"2024-09-13T17:12:49.217407+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:30.788242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.213848+0000","last_change":"2024-09-13T17:11:23.342436+0000","last_active":"2024-09-13T17:12:49.213848+0000","last_peered":"2024-09-13T17:12:49.213848+0000","last_clean":"2024-09-13T17:12:49.213848+0000","last_became_active":"2024-09-13T17:11:23.342157+0000","last_became_peered":"2024-09-13T17:11:23.342157+0000","last_unstale":"2024-09-13T17:12:49.213848+0000","last_undegraded":"2024-09-13T17:12:49.213848+0000","last_fullsized":"2024-09-13T17:12:49.213848+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:56.550875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217284+0000","last_change":"2024-09-13T17:11:23.341660+0000","last_active":"2024-09-13T17:12:49.217284+0000","last_peered":"2024-09-13T17:12:49.217284+0000","last_clean":"2024-09-13T17:12:49.217284+0000","last_became_active":"2024-09-13T17:11:23.341102+0000","last_became_peered":"2024-09-13T17:11:23.341102+0000","last_unstale":"2024-09-13T17:12:49.217284+0000","last_undegraded":"2024-09-13T17:12:49.217284+0000","last_fullsized":"2024-09-13T17:12:49.217284+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:00.546907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216215+0000","last_change":"2024-09-13T17:11:23.338064+0000","last_active":"2024-09-13T17:12:49.216215+0000","last_peered":"2024-09-13T17:12:49.216215+0000","last_clean":"2024-09-13T17:12:49.216215+0000","last_became_active":"2024-09-13T17:11:23.337748+0000","last_became_peered":"2024-09-13T17:11:23.337748+0000","last_unstale":"2024-09-13T17:12:49.216215+0000","last_undegraded":"2024-09-13T17:12:49.216215+0000","last_fullsized":"2024-09-13T17:12:49.216215+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:14.281629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.221628+0000","last_change":"2024-09-13T17:11:23.335684+0000","last_active":"2024-09-13T17:12:49.221628+0000","last_peered":"2024-09-13T17:12:49.221628+0000","last_clean":"2024-09-13T17:12:49.221628+0000","last_became_active":"2024-09-13T17:11:23.335364+0000","last_became_peered":"2024-09-13T17:11:23.335364+0000","last_unstale":"2024-09-13T17:12:49.221628+0000","last_undegraded":"2024-09-13T17:12:49.221628+0000","last_fullsized":"2024-09-13T17:12:49.221628+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:02.288009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.218814+0000","last_change":"2024-09-13T17:11:23.340881+0000","last_active":"2024-09-13T17:12:49.218814+0000","last_peered":"2024-09-13T17:12:49.218814+0000","last_clean":"2024-09-13T17:12:49.218814+0000","last_became_active":"2024-09-13T17:11:23.340575+0000","last_became_peered":"2024-09-13T17:11:23.340575+0000","last_unstale":"2024-09-13T17:12:49.218814+0000","last_undegraded":"2024-09-13T17:12:49.218814+0000","last_fullsized":"2024-09-13T17:12:49.218814+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:40.757703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216251+0000","last_change":"2024-09-13T17:11:23.329039+0000","last_active":"2024-09-13T17:12:49.216251+0000","last_peered":"2024-09-13T17:12:49.216251+0000","last_clean":"2024-09-13T17:12:49.216251+0000","last_became_active":"2024-09-13T17:11:23.328324+0000","last_became_peered":"2024-09-13T17:11:23.328324+0000","last_unstale":"2024-09-13T17:12:49.216251+0000","last_undegraded":"2024-09-13T17:12:49.216251+0000","last_fullsized":"2024-09-13T17:12:49.216251+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:37.882596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.215258+0000","last_change":"2024-09-13T17:11:23.345229+0000","last_active":"2024-09-13T17:12:49.215258+0000","last_peered":"2024-09-13T17:12:49.215258+0000","last_clean":"2024-09-13T17:12:49.215258+0000","last_became_active":"2024-09-13T17:11:23.344883+0000","last_became_peered":"2024-09-13T17:11:23.344883+0000","last_unstale":"2024-09-13T17:12:49.215258+0000","last_undegraded":"2024-09-13T17:12:49.215258+0000","last_fullsized":"2024-09-13T17:12:49.215258+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:47.983382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217881+0000","last_change":"2024-09-13T17:11:23.346338+0000","last_active":"2024-09-13T17:12:49.217881+0000","last_peered":"2024-09-13T17:12:49.217881+0000","last_clean":"2024-09-13T17:12:49.217881+0000","last_became_active":"2024-09-13T17:11:23.344777+0000","last_became_peered":"2024-09-13T17:11:23.344777+0000","last_unstale":"2024-09-13T17:12:49.217881+0000","last_undegraded":"2024-09-13T17:12:49.217881+0000","last_fullsized":"2024-09-13T17:12:49.217881+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:23.650174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.211999+0000","last_change":"2024-09-13T17:11:49.798165+0000","last_active":"2024-09-13T17:12:49.211999+0000","last_peered":"2024-09-13T17:12:49.211999+0000","last_clean":"2024-09-13T17:12:49.211999+0000","last_became_active":"2024-09-13T17:11:49.797753+0000","last_became_peered":"2024-09-13T17:11:49.797753+0000","last_unstale":"2024-09-13T17:12:49.211999+0000","last_undegraded":"2024-09-13T17:12:49.211999+0000","last_fullsized":"2024-09-13T17:12:49.211999+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:51.744236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217600+0000","last_change":"2024-09-13T17:11:23.340478+0000","last_active":"2024-09-13T17:12:49.217600+0000","last_peered":"2024-09-13T17:12:49.217600+0000","last_clean":"2024-09-13T17:12:49.217600+0000","last_became_active":"2024-09-13T17:11:23.339916+0000","last_became_peered":"2024-09-13T17:11:23.339916+0000","last_unstale":"2024-09-13T17:12:49.217600+0000","last_undegraded":"2024-09-13T17:12:49.217600+0000","last_fullsized":"2024-09-13T17:12:49.217600+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:09.477626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.223414+0000","last_change":"2024-09-13T17:11:23.340882+0000","last_active":"2024-09-13T17:12:49.223414+0000","last_peered":"2024-09-13T17:12:49.223414+0000","last_clean":"2024-09-13T17:12:49.223414+0000","last_became_active":"2024-09-13T17:11:23.340413+0000","last_became_peered":"2024-09-13T17:11:23.340413+0000","last_unstale":"2024-09-13T17:12:49.223414+0000","last_undegraded":"2024-09-13T17:12:49.223414+0000","last_fullsized":"2024-09-13T17:12:49.223414+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:49.040015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216546+0000","last_change":"2024-09-13T17:11:23.345551+0000","last_active":"2024-09-13T17:12:49.216546+0000","last_peered":"2024-09-13T17:12:49.216546+0000","last_clean":"2024-09-13T17:12:49.216546+0000","last_became_active":"2024-09-13T17:11:23.345195+0000","last_became_peered":"2024-09-13T17:11:23.345195+0000","last_unstale":"2024-09-13T17:12:49.216546+0000","last_undegraded":"2024-09-13T17:12:49.216546+0000","last_fullsized":"2024-09-13T17:12:49.216546+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:00.856969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.211550+0000","last_change":"2024-09-13T17:11:49.799090+0000","last_active":"2024-09-13T17:12:49.211550+0000","last_peered":"2024-09-13T17:12:49.211550+0000","last_clean":"2024-09-13T17:12:49.211550+0000","last_became_active":"2024-09-13T17:11:49.798766+0000","last_became_peered":"2024-09-13T17:11:49.798766+0000","last_unstale":"2024-09-13T17:12:49.211550+0000","last_undegraded":"2024-09-13T17:12:49.211550+0000","last_fullsized":"2024-09-13T17:12:49.211550+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:43.946212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.212604+0000","last_change":"2024-09-13T17:11:23.340286+0000","last_active":"2024-09-13T17:12:49.212604+0000","last_peered":"2024-09-13T17:12:49.212604+0000","last_clean":"2024-09-13T17:12:49.212604+0000","last_became_active":"2024-09-13T17:11:23.339756+0000","last_became_peered":"2024-09-13T17:11:23.339756+0000","last_unstale":"2024-09-13T17:12:49.212604+0000","last_undegraded":"2024-09-13T17:12:49.212604+0000","last_fullsized":"2024-09-13T17:12:49.212604+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:00.463087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.215023+0000","last_change":"2024-09-13T17:11:23.339818+0000","last_active":"2024-09-13T17:12:49.215023+0000","last_peered":"2024-09-13T17:12:49.215023+0000","last_clean":"2024-09-13T17:12:49.215023+0000","last_became_active":"2024-09-13T17:11:23.339501+0000","last_became_peered":"2024-09-13T17:11:23.339501+0000","last_unstale":"2024-09-13T17:12:49.215023+0000","last_undegraded":"2024-09-13T17:12:49.215023+0000","last_fullsized":"2024-09-13T17:12:49.215023+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:36.904004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.219322+0000","last_change":"2024-09-13T17:11:23.334388+0000","last_active":"2024-09-13T17:12:49.219322+0000","last_peered":"2024-09-13T17:12:49.219322+0000","last_clean":"2024-09-13T17:12:49.219322+0000","last_became_active":"2024-09-13T17:11:23.333953+0000","last_became_peered":"2024-09-13T17:11:23.333953+0000","last_unstale":"2024-09-13T17:12:49.219322+0000","last_undegraded":"2024-09-13T17:12:49.219322+0000","last_fullsized":"2024-09-13T17:12:49.219322+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:33.929173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.219482+0000","last_change":"2024-09-13T17:11:23.338259+0000","last_active":"2024-09-13T17:12:49.219482+0000","last_peered":"2024-09-13T17:12:49.219482+0000","last_clean":"2024-09-13T17:12:49.219482+0000","last_became_active":"2024-09-13T17:11:23.337979+0000","last_became_peered":"2024-09-13T17:11:23.337979+0000","last_unstale":"2024-09-13T17:12:49.219482+0000","last_undegraded":"2024-09-13T17:12:49.219482+0000","last_fullsized":"2024-09-13T17:12:49.219482+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:55.750255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217114+0000","last_change":"2024-09-13T17:11:23.337899+0000","last_active":"2024-09-13T17:12:49.217114+0000","last_peered":"2024-09-13T17:12:49.217114+0000","last_clean":"2024-09-13T17:12:49.217114+0000","last_became_active":"2024-09-13T17:11:23.337626+0000","last_became_peered":"2024-09-13T17:11:23.337626+0000","last_unstale":"2024-09-13T17:12:49.217114+0000","last_undegraded":"2024-09-13T17:12:49.217114+0000","last_fullsized":"2024-09-13T17:12:49.217114+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:14.654852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66193,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":492,"num_read_kb":316,"num_write":158,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":198579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285958,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383714,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":1024000,"data_stored":519575,"data_compressed":23656,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:12:35 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.36099999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79700000000000004,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56299999999999994,"15min":0.56799999999999995},"min":{"1min":0.35499999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67900000000000005,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.52600000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:12:35 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60199999999999998,"15min":0.59999999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.748,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.48099999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:12:35 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.41099999999999998,"15min":0.40200000000000002},"min":{"1min":0.28100000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71899999999999997,"5min":0.748,"15min":0.748},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.45600000000000002,"15min":0.45400000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63100000000000001,"5min":1.286,"15min":1.286},"last":0.44800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:12:35 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63300000000000001,"15min":0.63500000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.76400000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.61399999999999999,"15min":0.60399999999999998},"min":{"1min":0.52200000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.40500000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:12:35 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.50900000000000001,"15min":0.50700000000000001},"min":{"1min":0.35799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.76100000000000001,"5min":1.109,"15min":1.109},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.48099999999999998,"15min":0.47099999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.72099999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:12:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56100000000000005,"15min":0.55700000000000005},"min":{"1min":0.45200000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.90900000000000003,"5min":1.214,"15min":1.214},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.44500000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.86099999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.62}]},{"osd":7,"last update":"Fri Sep 13 17:12:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63600000000000001,"15min":0.63},"min":{"1min":0.50900000000000001,"5min":0.502,"15min":0.502},"max":{"1min":0.78700000000000003,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.68700000000000006,"15min":0.68300000000000005},"min":{"1min":0.54600000000000004,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88400000000000001,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.56000000000000005}]},{"osd":8,"last update":"Fri Sep 13 17:12:25 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.60399999999999998}]},{"osd":9,"last update":"Fri Sep 13 17:12:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.51800000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95699999999999996,"5min":1.196,"15min":1.196},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.63500000000000001,"15min":0.623},"min":{"1min":0.52000000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.88800000000000001,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.80700000000000005}]},{"osd":10,"last update":"Fri Sep 13 17:12:35 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.72399999999999998,"15min":0.71499999999999997},"min":{"1min":0.58799999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0609999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71899999999999997,"15min":0.71799999999999997},"min":{"1min":0.60599999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.873,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.73899999999999999}]}]},{"osd":10,"up_from":72,"seq":309237645350,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1167360,"data_stored":1168500,"data_compressed":60015,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1597,"internal_metadata":36043203},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:12:23 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.49399999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:12:10 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.41399999999999998,"15min":0.41999999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.57299999999999995,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.45400000000000001,"15min":0.46000000000000002},"min":{"1min":0.25700000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.35999999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:12:10 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.72599999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.39700000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.69199999999999995}]},{"osd":3,"last update":"Fri Sep 13 17:12:10 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.57999999999999996,"15min":0.59299999999999997},"min":{"1min":0.34499999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64700000000000002,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.56899999999999995,"15min":0.58199999999999996},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.63800000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.58199999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:12:10 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.503,"15min":0.50900000000000001},"min":{"1min":0.33300000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.67600000000000005,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.53700000000000003,"15min":0.54800000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71099999999999997,"5min":0.876,"15min":0.876},"last":0.52400000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:12:10 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.46000000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.82299999999999995,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.64300000000000002,"15min":0.64900000000000002},"min":{"1min":0.442,"5min":0.44,"15min":0.44},"max":{"1min":0.91000000000000003,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.72499999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:12:10 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.64100000000000001,"15min":0.65500000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76500000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.624,"15min":0.63200000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.77300000000000002,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.55900000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:12:52 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.75}]},{"osd":8,"last update":"Fri Sep 13 17:12:10 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68300000000000005,"15min":0.68799999999999994},"min":{"1min":0.49099999999999999,"5min":0.442,"15min":0.442},"max":{"1min":0.85199999999999998,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.626},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.71899999999999997,"15min":0.72699999999999998},"min":{"1min":0.50900000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85999999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.71599999999999997}]},{"osd":9,"last update":"Fri Sep 13 17:12:10 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.69999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.88300000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.73999999999999999,"15min":0.755},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90000000000000002,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.61699999999999999}]},{"osd":11,"last update":"Fri Sep 13 17:12:36 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.70099999999999996,"15min":0.69299999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.69699999999999995,"15min":0.68500000000000005},"min":{"1min":0.56799999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.63200000000000001}]}]},{"osd":9,"up_from":67,"seq":287762808875,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":1040384,"data_stored":523325,"data_compressed":23656,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1597,"internal_metadata":31848899},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.38800000000000001,"15min":0.40400000000000003},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.58799999999999997,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.40799999999999997,"15min":0.42199999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.52800000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.35999999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.432,"5min":0.374,"15min":0.374},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55100000000000005,"15min":0.56499999999999995},"min":{"1min":0.35499999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70999999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.52100000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57899999999999996,"15min":0.60299999999999998},"min":{"1min":0.38400000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80200000000000005,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.377},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56699999999999995,"15min":0.58699999999999997},"min":{"1min":0.42499999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.66400000000000003,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.42399999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.46600000000000003,"15min":0.49399999999999999},"min":{"1min":0.28599999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54000000000000004,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.316},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.46600000000000003,"15min":0.504},"min":{"1min":0.27300000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.52200000000000002,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.437}]},{"osd":4,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56899999999999995,"15min":0.58099999999999996},"min":{"1min":0.46200000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.70499999999999996,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61899999999999999,"15min":0.63800000000000001},"min":{"1min":0.39800000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.80000000000000004,"5min":1.26,"15min":1.26},"last":0.54300000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.621,"15min":0.65300000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.70499999999999996,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.624,"15min":0.66100000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.74399999999999999,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.48299999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.49299999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.66200000000000003,"15min":0.69199999999999995},"min":{"1min":0.45100000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.77100000000000002,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.65900000000000003,"15min":0.69199999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.73599999999999999,"5min":1.018,"15min":1.018},"last":0.628}]},{"osd":8,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.65900000000000003,"15min":0.68300000000000005},"min":{"1min":0.45700000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.76900000000000002,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.67900000000000005,"15min":0.71099999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78200000000000003,"5min":1.228,"15min":1.228},"last":0.49299999999999999}]},{"osd":10,"last update":"Fri Sep 13 17:12:15 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.67300000000000004,"15min":0.68300000000000005},"min":{"1min":0.49199999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.77300000000000002,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.71199999999999997,"15min":0.72399999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.85799999999999998,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.60899999999999999}]},{"osd":11,"last update":"Fri Sep 13 17:12:29 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.60099999999999998}]}]},{"osd":8,"up_from":59,"seq":253403070512,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":519149,"data_compressed":23656,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:12:24 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.34000000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.52700000000000002,"15min":0.53500000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.51000000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:12:24 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.41099999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.55100000000000005,"15min":0.53700000000000003},"min":{"1min":0.39900000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.65600000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:12:24 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.42199999999999999,"15min":0.41899999999999998},"min":{"1min":0.314,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.60099999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.432},{"interface":"front","average":{"1min":0.433,"5min":0.44,"15min":0.438},"min":{"1min":0.28000000000000003,"5min":0.247,"15min":0.247},"max":{"1min":0.63600000000000001,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.47299999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:12:24 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.38900000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.63300000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72699999999999998,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.58099999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:12:24 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.373,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.60199999999999998,"15min":0.59399999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.751}]},{"osd":5,"last update":"Fri Sep 13 17:12:24 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.51200000000000001,"15min":0.51600000000000001},"min":{"1min":0.35099999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.753,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.53700000000000003},"min":{"1min":0.35199999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.78600000000000003,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.61799999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:12:24 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45400000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63700000000000001,"15min":0.64700000000000002},"min":{"1min":0.46400000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.85999999999999999,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.67800000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:12:24 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.93700000000000006,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.66800000000000004,"15min":0.66500000000000004},"min":{"1min":0.47699999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94999999999999996,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.83999999999999997}]},{"osd":9,"last update":"Fri Sep 13 17:12:53 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.67200000000000004,"15min":0.66800000000000004},"min":{"1min":0.51900000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86499999999999999,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.67600000000000005,"15min":0.67500000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.77600000000000002}]},{"osd":10,"last update":"Fri Sep 13 17:12:10 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.68600000000000005,"15min":0.67900000000000005},"min":{"1min":0.57499999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91900000000000004,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.70599999999999996,"15min":0.69799999999999995},"min":{"1min":0.59699999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.82899999999999996}]},{"osd":11,"last update":"Fri Sep 13 17:12:24 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.79700000000000004}]}]},{"osd":7,"up_from":51,"seq":219043332148,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1081344,"data_stored":1114381,"data_compressed":60015,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1587,"internal_metadata":27654605},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.39700000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.66200000000000003,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.35799999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.52500000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.379,"15min":0.36099999999999999},"min":{"1min":0.27100000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.497,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38100000000000001,"15min":0.35499999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.52800000000000002,"5min":0.623,"15min":0.623},"last":0.42999999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55100000000000005,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70399999999999996,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54700000000000004,"15min":0.51800000000000002},"min":{"1min":0.38300000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.79700000000000004,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.77400000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53100000000000003,"15min":0.50900000000000001},"min":{"1min":0.35199999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72299999999999998,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.54900000000000004,"15min":0.53800000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69699999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.55700000000000005}]},{"osd":4,"last update":"Fri Sep 13 17:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.47799999999999998,"15min":0.46200000000000002},"min":{"1min":0.33600000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.60699999999999998,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45100000000000001,"15min":0.442},"min":{"1min":0.27200000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.61299999999999999,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.48499999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.59999999999999998,"15min":0.57199999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.81899999999999995,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58799999999999997,"15min":0.57599999999999996},"min":{"1min":0.42899999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.75900000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.65800000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59999999999999998,"15min":0.58199999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.75600000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61499999999999999,"15min":0.59299999999999997},"min":{"1min":0.44900000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76000000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.65200000000000002}]},{"osd":8,"last update":"Fri Sep 13 17:12:32 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63600000000000001,"15min":0.628},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.76600000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.66400000000000003,"15min":0.64600000000000002},"min":{"1min":0.50600000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.85099999999999998,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.56599999999999995}]},{"osd":9,"last update":"Fri Sep 13 17:12:55 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.67200000000000004,"15min":0.68400000000000005},"min":{"1min":0.437,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84599999999999997,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.48399999999999999,"5min":0.438,"15min":0.438},"max":{"1min":0.80600000000000005,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.86599999999999999}]},{"osd":10,"last update":"Fri Sep 13 17:12:13 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69899999999999995,"15min":0.70299999999999996},"min":{"1min":0.46400000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.65500000000000003,"15min":0.65300000000000002},"min":{"1min":0.42799999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.80700000000000005}]},{"osd":11,"last update":"Fri Sep 13 17:12:27 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.626},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.83799999999999997}]}]},{"osd":6,"up_from":46,"seq":197568495673,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":514405,"data_compressed":23656,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:12:44 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.34699999999999998,"15min":0.33700000000000002},"min":{"1min":0.25700000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.45500000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.377,"15min":0.371},"min":{"1min":0.28100000000000003,"5min":0.251,"15min":0.251},"max":{"1min":0.53900000000000003,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.255}]},{"osd":1,"last update":"Fri Sep 13 17:12:44 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52200000000000002,"15min":0.50900000000000001},"min":{"1min":0.36199999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.68600000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52600000000000002,"15min":0.51000000000000001},"min":{"1min":0.40899999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71299999999999997,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.54300000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:12:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.36599999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.69499999999999995,"5min":1.095,"15min":1.095},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54500000000000004,"15min":0.52700000000000002},"min":{"1min":0.35899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70999999999999996,"5min":0.877,"15min":0.877},"last":0.47299999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:12:44 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.41499999999999998,"15min":0.41299999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.51900000000000002,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.313},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42099999999999999,"15min":0.41299999999999998},"min":{"1min":0.29099999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.63500000000000001,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.30099999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:12:44 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.52100000000000002,"15min":0.505},"min":{"1min":0.33800000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55300000000000005,"15min":0.53100000000000003},"min":{"1min":0.39400000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73999999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.53100000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:12:44 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58699999999999997,"15min":0.58599999999999997},"min":{"1min":0.41599999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77500000000000002,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58799999999999997,"15min":0.59999999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80200000000000005,"5min":1.131,"15min":1.131},"last":0.51700000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:12:03 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.40999999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.80000000000000004,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60299999999999998,"15min":0.59699999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.72399999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.67200000000000004}]},{"osd":8,"last update":"Fri Sep 13 17:12:28 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.626,"15min":0.628},"min":{"1min":0.48199999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.82199999999999995,"5min":0.874,"15min":0.874},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.65300000000000002,"15min":0.65000000000000002},"min":{"1min":0.54100000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.79900000000000004,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.435}]},{"osd":9,"last update":"Fri Sep 13 17:12:53 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.59199999999999997,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.375},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.626,"15min":0.65400000000000003},"min":{"1min":0.38200000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78000000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.34300000000000003}]},{"osd":10,"last update":"Fri Sep 13 17:12:14 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.872,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.68600000000000005,"15min":0.68200000000000005},"min":{"1min":0.58099999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.88500000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.623}]},{"osd":11,"last update":"Fri Sep 13 17:12:28 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.44},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.60999999999999999}]}]},{"osd":5,"up_from":38,"seq":163208757310,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32184,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712968,"statfs":{"total":95995035648,"available":95962079232,"internally_reserved":0,"allocated":1089536,"data_stored":1110268,"data_compressed":60015,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:12:22 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48699999999999999,"15min":0.47699999999999998},"min":{"1min":0.34000000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.72799999999999998,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.495,"15min":0.48299999999999998},"min":{"1min":0.40699999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68400000000000005,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.433}]},{"osd":1,"last update":"Fri Sep 13 17:12:22 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56499999999999995,"15min":0.54900000000000004},"min":{"1min":0.38,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55300000000000005,"15min":0.54600000000000004},"min":{"1min":0.40300000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.70099999999999996,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.64500000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:12:22 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.38600000000000001,"15min":0.374},"min":{"1min":0.28599999999999998,"5min":0.222,"15min":0.222},"max":{"1min":0.56699999999999995,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.39000000000000001,"15min":0.376},"min":{"1min":0.30599999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.61599999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.378}]},{"osd":3,"last update":"Fri Sep 13 17:12:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.50900000000000001,"15min":0.502},"min":{"1min":0.36099999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70099999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.495},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.40500000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.48099999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:12:22 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56399999999999995,"15min":0.55900000000000005},"min":{"1min":0.36599999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72199999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.58599999999999997,"15min":0.56599999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.69299999999999995}]},{"osd":6,"last update":"Fri Sep 13 17:12:41 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.76300000000000001,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56899999999999995,"15min":0.56299999999999994},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.52000000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:12:59 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61099999999999999,"15min":0.60999999999999999},"min":{"1min":0.40100000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.86299999999999999,"5min":0.874,"15min":0.874},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.625,"15min":0.60999999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.74099999999999999}]},{"osd":8,"last update":"Fri Sep 13 17:12:30 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.53000000000000003,"15min":0.53200000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.80700000000000005,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.41899999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.63100000000000001}]},{"osd":9,"last update":"Fri Sep 13 17:12:51 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.64200000000000002,"15min":0.626},"min":{"1min":0.51000000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.63900000000000001,"15min":0.621},"min":{"1min":0.52200000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56100000000000005}]},{"osd":10,"last update":"Fri Sep 13 17:12:12 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.64800000000000002,"15min":0.63700000000000001},"min":{"1min":0.60199999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.64500000000000002,"15min":0.63300000000000001},"min":{"1min":0.58899999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.70999999999999996}]}]},{"osd":4,"up_from":33,"seq":141733920835,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":1028096,"data_stored":519316,"data_compressed":23656,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:12:50 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.69499999999999995}]},{"osd":1,"last update":"Fri Sep 13 17:12:59 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.38300000000000001,"15min":0.36499999999999999},"min":{"1min":0.28999999999999998,"5min":0.221,"15min":0.221},"max":{"1min":0.68899999999999995,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40699999999999997,"15min":0.39500000000000002},"min":{"1min":0.30299999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.61399999999999999,"5min":2.52,"15min":2.52},"last":0.34599999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:12:59 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.78000000000000003,"15min":0.63},"min":{"1min":0.41699999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.84299999999999997,"5min":15.401,"15min":15.401},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.56999999999999995,"15min":0.53200000000000003},"min":{"1min":0.40400000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83199999999999996,"5min":1.335,"15min":1.335},"last":0.82499999999999996}]},{"osd":3,"last update":"Fri Sep 13 17:12:59 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55200000000000005,"15min":0.55400000000000005},"min":{"1min":0.372,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.77800000000000002,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.747,"15min":0.61899999999999999},"min":{"1min":0.41699999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88400000000000001,"5min":15.425000000000001,"15min":15.425000000000001},"last":0.67600000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:12:22 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.60999999999999999,"15min":0.57599999999999996},"min":{"1min":0.374,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":3.0790000000000002,"5min":3.0790000000000002,"15min":3.0790000000000002},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.61099999999999999,"15min":0.56899999999999995},"min":{"1min":0.441,"5min":0.376,"15min":0.376},"max":{"1min":4.0810000000000004,"5min":4.0810000000000004,"15min":4.0810000000000004},"last":0.79100000000000004}]},{"osd":6,"last update":"Fri Sep 13 17:12:46 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55700000000000005,"15min":0.52100000000000002},"min":{"1min":0.42799999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.65700000000000003,"5min":2.6469999999999998,"15min":2.6469999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58699999999999997,"15min":0.56000000000000005},"min":{"1min":0.45400000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85799999999999998,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.83999999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:12:04 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.50700000000000001,"15min":0.49299999999999999},"min":{"1min":0.317,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.51600000000000001,"15min":0.48999999999999999},"min":{"1min":0.32500000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.55000000000000004}]},{"osd":8,"last update":"Fri Sep 13 17:12:28 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65700000000000003,"15min":0.64100000000000001},"min":{"1min":0.439,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77500000000000002,"5min":2.577,"15min":2.577},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65600000000000003,"15min":0.64600000000000002},"min":{"1min":0.47999999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.81699999999999995,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.66400000000000003}]},{"osd":9,"last update":"Fri Sep 13 17:12:50 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":1.2509999999999999,"15min":1.4930000000000001},"min":{"1min":0.54600000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.84499999999999997,"5min":15.448,"15min":15.448},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":1.2150000000000001,"15min":1.456},"min":{"1min":0.52000000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.82099999999999995,"5min":15.385,"15min":15.385},"last":0.86099999999999999}]},{"osd":10,"last update":"Fri Sep 13 17:12:12 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.64700000000000002,"15min":0.63100000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":3.1259999999999999,"5min":3.1259999999999999,"15min":3.1259999999999999},"last":0.432},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68700000000000006,"15min":0.68400000000000005},"min":{"1min":0.42599999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":2.3439999999999999,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.57899999999999996}]},{"osd":11,"last update":"Fri Sep 13 17:12:22 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.2650000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":3.165,"5min":3.165,"15min":3.165},"last":0.68500000000000005}]}]},{"osd":3,"up_from":25,"seq":107374182471,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":513995,"data_compressed":23656,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:12:37 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.34999999999999998,"15min":0.32000000000000001},"min":{"1min":0.25900000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.53600000000000003,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.35599999999999998,"15min":0.32600000000000001},"min":{"1min":0.27100000000000002,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.51800000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.36099999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:12:37 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54000000000000004,"15min":0.499},"min":{"1min":0.35799999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73099999999999998,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.53400000000000003,"15min":0.48999999999999999},"min":{"1min":0.45500000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.47799999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:12:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.53600000000000003,"15min":0.503},"min":{"1min":0.39900000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.80100000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55400000000000005,"15min":0.51200000000000001},"min":{"1min":0.45400000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.76600000000000001,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.58999999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:12:56 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55800000000000005,"15min":0.52400000000000002},"min":{"1min":0.35699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.749,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56399999999999995,"15min":0.51800000000000002},"min":{"1min":0.39900000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.46300000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:12:20 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56999999999999995,"15min":0.55800000000000005},"min":{"1min":0.44700000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89900000000000002,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56000000000000005,"15min":0.56100000000000005},"min":{"1min":0.36899999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.71699999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.63400000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:12:44 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.45000000000000001,"15min":0.44500000000000001},"min":{"1min":0.29599999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.59799999999999998,"5min":0.746,"15min":0.746},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.46800000000000003,"15min":0.44600000000000001},"min":{"1min":0.35599999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.88200000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.39300000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:12:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81000000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60499999999999998,"15min":0.59699999999999998},"min":{"1min":0.42299999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.44800000000000001}]},{"osd":8,"last update":"Fri Sep 13 17:10:26 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66400000000000003}]},{"osd":9,"last update":"Fri Sep 13 17:12:51 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.60399999999999998,"15min":0.628},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.83799999999999997,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.60999999999999999,"15min":0.64400000000000002},"min":{"1min":0.41099999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71499999999999997,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.42799999999999999}]},{"osd":10,"last update":"Fri Sep 13 17:12:14 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.67500000000000004,"15min":0.68300000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.495},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.66100000000000003,"15min":0.67100000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.5}]},{"osd":11,"last update":"Fri Sep 13 17:12:28 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.67900000000000005}]}]},{"osd":2,"up_from":18,"seq":77309411405,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1101824,"data_stored":577441,"data_compressed":23656,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:12:10 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.71799999999999997,"15min":0.72399999999999998},"min":{"1min":0.33000000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.72699999999999998,"5min":19.158999999999999,"15min":19.158999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.499,"5min":0.48299999999999998,"15min":0.46899999999999997},"min":{"1min":0.34999999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.75800000000000001,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.69399999999999995}]},{"osd":1,"last update":"Fri Sep 13 17:12:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.52300000000000002,"15min":0.48199999999999998},"min":{"1min":0.32900000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.53500000000000003,"15min":0.48099999999999998},"min":{"1min":0.42999999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.68000000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:12:36 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.53700000000000003,"15min":0.50600000000000001},"min":{"1min":0.377,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72599999999999998,"5min":0.75,"15min":0.75},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53000000000000003,"15min":0.50700000000000001},"min":{"1min":0.39000000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.752}]},{"osd":4,"last update":"Fri Sep 13 17:12:23 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.48999999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:12:14 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.42599999999999999,"15min":0.40000000000000002},"min":{"1min":0.29199999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.436,"15min":0.40500000000000003},"min":{"1min":0.372,"5min":0.222,"15min":0.222},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.59699999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:12:38 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.56100000000000005,"15min":0.54500000000000004},"min":{"1min":0.39200000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.70399999999999996,"15min":0.58899999999999997},"min":{"1min":0.38400000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94299999999999995,"5min":19.276,"15min":19.276},"last":0.70799999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:12:27 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.55600000000000005}]},{"osd":8,"last update":"Fri Sep 13 17:12:27 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.56999999999999995,"15min":0.54600000000000004},"min":{"1min":0.43099999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.625},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.59299999999999997,"15min":0.57099999999999995},"min":{"1min":0.45000000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.71999999999999997}]},{"osd":9,"last update":"Fri Sep 13 17:12:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.65800000000000003,"15min":0.64100000000000001},"min":{"1min":0.48499999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.92700000000000005,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":1.135,"15min":1.341},"min":{"1min":0.46600000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.88,"5min":19.210999999999999,"15min":19.210999999999999},"last":0.73199999999999998}]},{"osd":10,"last update":"Fri Sep 13 17:12:14 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.67500000000000004,"15min":0.66300000000000003},"min":{"1min":0.53700000000000003,"5min":0.495,"15min":0.495},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.82099999999999995,"5min":1.4399999999999999,"15min":1.5429999999999999},"min":{"1min":0.61799999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0860000000000001,"5min":19.242000000000001,"15min":19.242000000000001},"last":0.76300000000000001}]},{"osd":11,"last update":"Fri Sep 13 17:12:23 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.81699999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":1085440,"data_stored":576602,"data_compressed":23656,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:12:58 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.49299999999999999,"15min":0.46700000000000003},"min":{"1min":0.33300000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.68000000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.495,"15min":0.46899999999999997},"min":{"1min":0.28999999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.67400000000000004,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.39600000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:12:10 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.55400000000000005,"15min":0.51200000000000001},"min":{"1min":0.42399999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.54700000000000004,"15min":0.51100000000000001},"min":{"1min":0.436,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.60299999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:12:40 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53100000000000003,"15min":0.52200000000000002},"min":{"1min":0.437,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.69799999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55100000000000005,"15min":0.52900000000000003},"min":{"1min":0.30199999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71599999999999997,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.47199999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:10:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.39500000000000002,"15min":0.377},"min":{"1min":0.29199999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.62},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.38100000000000001,"15min":0.36299999999999999},"min":{"1min":0.26600000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:12:21 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.55800000000000005,"15min":0.52300000000000002},"min":{"1min":0.53000000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.84799999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.55700000000000005,"15min":0.51200000000000001},"min":{"1min":0.42899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.65900000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:12:40 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55300000000000005,"15min":0.52800000000000002},"min":{"1min":0.45100000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.70199999999999996,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59599999999999997,"15min":0.57599999999999996},"min":{"1min":0.41299999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80900000000000005,"5min":0.88,"15min":0.88},"last":0.32900000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:12:05 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.50900000000000001,"15min":0.48299999999999998},"min":{"1min":0.36499999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.501,"15min":0.48699999999999999},"min":{"1min":0.35099999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.62}]},{"osd":8,"last update":"Fri Sep 13 17:12:31 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63300000000000001,"15min":0.61899999999999999},"min":{"1min":0.52700000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81999999999999995,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.67900000000000005,"15min":0.66500000000000004},"min":{"1min":0.54400000000000004,"5min":0.434,"15min":0.434},"max":{"1min":0.88200000000000001,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.59499999999999997}]},{"osd":9,"last update":"Fri Sep 13 17:12:51 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.63300000000000001,"15min":0.64100000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72199999999999998,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.68500000000000005,"15min":0.69799999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.85499999999999998,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.41199999999999998}]},{"osd":10,"last update":"Fri Sep 13 17:12:14 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.73199999999999998,"15min":0.75},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85199999999999998,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.69099999999999995,"15min":0.70699999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86399999999999999,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.45400000000000001}]},{"osd":11,"last update":"Fri Sep 13 17:12:24 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.63600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738453,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":1036288,"data_stored":515520,"data_compressed":23656,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.505,"15min":0.47699999999999998},"min":{"1min":0.36199999999999999,"5min":0.27900000000000003,"15min":0.27300000000000002},"max":{"1min":0.70699999999999996,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52300000000000002,"15min":0.49099999999999999},"min":{"1min":0.34599999999999997,"5min":0.28499999999999998,"15min":0.245},"max":{"1min":0.68799999999999994,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.43099999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:12:09 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52700000000000002,"15min":0.50700000000000001},"min":{"1min":0.40100000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.69399999999999995,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53900000000000003,"15min":0.51000000000000001},"min":{"1min":0.38800000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.67600000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.48599999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:12:24 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.34599999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:12:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52900000000000003,"15min":0.49099999999999999},"min":{"1min":0.39100000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72699999999999998,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.54900000000000004,"15min":0.51200000000000001},"min":{"1min":0.442,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77500000000000002,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.442}]},{"osd":5,"last update":"Fri Sep 13 17:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52100000000000002,"15min":0.50900000000000001},"min":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82399999999999995,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.54800000000000004,"15min":0.53000000000000003},"min":{"1min":0.42799999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80500000000000005,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.624}]},{"osd":6,"last update":"Fri Sep 13 17:12:42 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.436,"15min":0.41899999999999998},"min":{"1min":0.312,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.57499999999999996,"5min":0.754,"15min":0.754},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.442,"15min":0.42799999999999999},"min":{"1min":0.29199999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.628,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.41899999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:12:27 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.47099999999999997}]},{"osd":8,"last update":"Fri Sep 13 17:12:34 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.437,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.77000000000000002,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.63900000000000001,"15min":0.65400000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.84299999999999997,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.55800000000000005}]},{"osd":9,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.58999999999999997,"15min":0.626},"min":{"1min":0.376,"5min":0.25,"15min":0.25},"max":{"1min":0.748,"5min":0.88,"15min":0.88},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.58899999999999997,"15min":0.621},"min":{"1min":0.374,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.81100000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.38800000000000001}]},{"osd":10,"last update":"Fri Sep 13 17:12:15 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.68400000000000005,"15min":0.69399999999999995},"min":{"1min":0.49199999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81000000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.67900000000000005,"15min":0.68999999999999995},"min":{"1min":0.46999999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84899999999999998,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.54700000000000004}]},{"osd":11,"last update":"Fri Sep 13 17:12:36 2024","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":0.78000000000000003,"15min":0.70399999999999996},"min":{"1min":0.54600000000000004,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":14.611000000000001,"5min":14.611000000000001,"15min":14.611000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.628,"15min":0.627},"min":{"1min":0.50700000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.82999999999999996,"5min":0.874,"15min":0.874},"last":0.67400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34721,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34721,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34721,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":63817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:13:09.441 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-13T17:13:09.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:09 smithi149 ceph-mon[35496]: pgmap v333: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T17:13:09.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:09 smithi118 ceph-mon[34374]: pgmap v333: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T17:13:09.693 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:13:10.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:10 smithi087 ceph-mon[30934]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:13:10.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:10 smithi149 ceph-mon[35496]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:13:10.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:10 smithi118 ceph-mon[34374]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:13:11.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.384+0000 7fa4d882a640 1 -- 172.21.15.87:0/3480803527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4d40ff860 msgr2=0x7fa4d41038b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:11.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.384+0000 7fa4d882a640 1 --2- 172.21.15.87:0/3480803527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4d40ff860 0x7fa4d41038b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009930 tx=0x7fa4c802a420 comp rx=0 tx=0).stop 2024-09-13T17:13:11.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.385+0000 7fa4d882a640 1 -- 172.21.15.87:0/3480803527 shutdown_connections 2024-09-13T17:13:11.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.385+0000 7fa4d882a640 1 --2- 172.21.15.87:0/3480803527 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4d4103fe0 0x7fa4d410bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.385+0000 7fa4d882a640 1 --2- 172.21.15.87:0/3480803527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4d40ff860 0x7fa4d41038b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.385+0000 7fa4d882a640 1 --2- 172.21.15.87:0/3480803527 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4d40feeb0 0x7fa4d40ff290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.385+0000 7fa4d882a640 1 -- 172.21.15.87:0/3480803527 >> 172.21.15.87:0/3480803527 conn(0x7fa4d40fa990 msgr2=0x7fa4d40fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:11.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.385+0000 7fa4d882a640 1 -- 172.21.15.87:0/3480803527 shutdown_connections 2024-09-13T17:13:11.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.385+0000 7fa4d882a640 1 -- 172.21.15.87:0/3480803527 wait complete. 2024-09-13T17:13:11.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.385+0000 7fa4d882a640 1 Processor -- start 2024-09-13T17:13:11.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.385+0000 7fa4d882a640 1 -- start start 2024-09-13T17:13:11.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.386+0000 7fa4d882a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4d40feeb0 0x7fa4d41952d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:11.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.386+0000 7fa4d882a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4d40ff860 0x7fa4d4195810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:11.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.386+0000 7fa4d882a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4d4103fe0 0x7fa4d4199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:11.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.386+0000 7fa4d882a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d419a210 con 0x7fa4d40ff860 2024-09-13T17:13:11.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.386+0000 7fa4d882a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d419a380 con 0x7fa4d4103fe0 2024-09-13T17:13:11.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.386+0000 7fa4d882a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d419a4f0 con 0x7fa4d40feeb0 2024-09-13T17:13:11.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.386+0000 7fa4d1d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4d40ff860 0x7fa4d4195810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:11.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.386+0000 7fa4d1d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4d40ff860 0x7fa4d4195810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43140/0 (socket says 172.21.15.87:43140) 2024-09-13T17:13:11.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.386+0000 7fa4d1d9b640 1 -- 172.21.15.87:0/697834088 learned_addr learned my addr 172.21.15.87:0/697834088 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:11.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.386+0000 7fa4d259c640 1 --2- 172.21.15.87:0/697834088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4d40feeb0 0x7fa4d41952d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:11.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.386+0000 7fa4d2d9d640 1 --2- 172.21.15.87:0/697834088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4d4103fe0 0x7fa4d4199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:11.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.386+0000 7fa4d1d9b640 1 -- 172.21.15.87:0/697834088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4d40feeb0 msgr2=0x7fa4d41952d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:11.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.386+0000 7fa4d1d9b640 1 --2- 172.21.15.87:0/697834088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4d40feeb0 0x7fa4d41952d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.386+0000 7fa4d1d9b640 1 -- 172.21.15.87:0/697834088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4d4103fe0 msgr2=0x7fa4d4199c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:11.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.386+0000 7fa4d1d9b640 1 --2- 172.21.15.87:0/697834088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4d4103fe0 0x7fa4d4199c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.386+0000 7fa4d1d9b640 1 -- 172.21.15.87:0/697834088 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c8009560 con 0x7fa4d40ff860 2024-09-13T17:13:11.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.386+0000 7fa4d1d9b640 1 --2- 172.21.15.87:0/697834088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4d40ff860 0x7fa4d4195810 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8005760 tx=0x7fa4c8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:11.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.386+0000 7fa4c37fe640 1 -- 172.21.15.87:0/697834088 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8031a30 con 0x7fa4d40ff860 2024-09-13T17:13:11.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.386+0000 7fa4c37fe640 1 -- 172.21.15.87:0/697834088 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa4c8031b90 con 0x7fa4d40ff860 2024-09-13T17:13:11.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.386+0000 7fa4d882a640 1 -- 172.21.15.87:0/697834088 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d419a770 con 0x7fa4d40ff860 2024-09-13T17:13:11.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.386+0000 7fa4c37fe640 1 -- 172.21.15.87:0/697834088 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8032340 con 0x7fa4d40ff860 2024-09-13T17:13:11.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.387+0000 7fa4d882a640 1 -- 172.21.15.87:0/697834088 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d41a1ec0 con 0x7fa4d40ff860 2024-09-13T17:13:11.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.388+0000 7fa4d882a640 1 -- 172.21.15.87:0/697834088 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d4100390 con 0x7fa4d40ff860 2024-09-13T17:13:11.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.389+0000 7fa4c37fe640 1 -- 172.21.15.87:0/697834088 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fa4c8031d00 con 0x7fa4d40ff860 2024-09-13T17:13:11.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.389+0000 7fa4c37fe640 1 --2- 172.21.15.87:0/697834088 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa4bc0a1110 0x7fa4bc0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:11.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.389+0000 7fa4d259c640 1 --2- 172.21.15.87:0/697834088 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa4bc0a1110 0x7fa4bc0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:11.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.389+0000 7fa4c37fe640 1 -- 172.21.15.87:0/697834088 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7fa4c80eda40 con 0x7fa4d40ff860 2024-09-13T17:13:11.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.390+0000 7fa4d259c640 1 --2- 172.21.15.87:0/697834088 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa4bc0a1110 0x7fa4bc0a35d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009990 tx=0x7fa4c4009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:11.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.393+0000 7fa4c37fe640 1 -- 172.21.15.87:0/697834088 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa4c80b6ca0 con 0x7fa4d40ff860 2024-09-13T17:13:11.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:11 smithi087 ceph-mon[30934]: pgmap v334: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T17:13:11.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.556+0000 7fa4d882a640 1 -- 172.21.15.87:0/697834088 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa4d410ed20 con 0x7fa4bc0a1110 2024-09-13T17:13:11.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.567+0000 7fa4c37fe640 1 -- 172.21.15.87:0/697834088 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+429023 (secure 0 0 0) 0x7fa4d410ed20 con 0x7fa4bc0a1110 2024-09-13T17:13:11.572 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:13:11.575 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-13T17:13:11.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.571+0000 7fa4d882a640 1 -- 172.21.15.87:0/697834088 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa4bc0a1110 msgr2=0x7fa4bc0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:11.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.571+0000 7fa4d882a640 1 --2- 172.21.15.87:0/697834088 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa4bc0a1110 0x7fa4bc0a35d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009990 tx=0x7fa4c4009110 comp rx=0 tx=0).stop 2024-09-13T17:13:11.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.571+0000 7fa4d882a640 1 -- 172.21.15.87:0/697834088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4d40ff860 msgr2=0x7fa4d4195810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:11.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.571+0000 7fa4d882a640 1 --2- 172.21.15.87:0/697834088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4d40ff860 0x7fa4d4195810 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8005760 tx=0x7fa4c8004270 comp rx=0 tx=0).stop 2024-09-13T17:13:11.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.571+0000 7fa4d882a640 1 -- 172.21.15.87:0/697834088 shutdown_connections 2024-09-13T17:13:11.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.571+0000 7fa4d882a640 1 --2- 172.21.15.87:0/697834088 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa4bc0a1110 0x7fa4bc0a35d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.572+0000 7fa4d882a640 1 --2- 172.21.15.87:0/697834088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4d4103fe0 0x7fa4d4199c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.572+0000 7fa4d882a640 1 --2- 172.21.15.87:0/697834088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4d40ff860 0x7fa4d4195810 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.572+0000 7fa4d882a640 1 --2- 172.21.15.87:0/697834088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4d40feeb0 0x7fa4d41952d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:11.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.572+0000 7fa4d882a640 1 -- 172.21.15.87:0/697834088 >> 172.21.15.87:0/697834088 conn(0x7fa4d40fa990 msgr2=0x7fa4d40fbe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:11.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.572+0000 7fa4d882a640 1 -- 172.21.15.87:0/697834088 shutdown_connections 2024-09-13T17:13:11.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:11.572+0000 7fa4d882a640 1 -- 172.21.15.87:0/697834088 wait complete. 2024-09-13T17:13:11.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:11 smithi149 ceph-mon[35496]: pgmap v334: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T17:13:11.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:11 smithi118 ceph-mon[34374]: pgmap v334: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T17:13:12.340 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":334,"stamp":"2024-09-13T17:13:10.096583+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656795,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":648,"num_read_kb":445,"num_write":341,"num_write_kb":3055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1181900,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":377640,"kb_used_data":12428,"kb_used_omap":18,"kb_used_meta":365037,"kb_avail":1124564184,"statfs":{"total":1151940427776,"available":1151553724416,"internally_reserved":0,"allocated":12726272,"data_stored":8172477,"data_compressed":392949,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19109,"internal_metadata":373798235},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002731"},"pg_stats":[{"pgid":"2.1f","version":"89'9","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.228849+0000","last_change":"2024-09-13T17:12:50.228849+0000","last_active":"2024-09-13T17:12:50.228849+0000","last_peered":"2024-09-13T17:12:50.228849+0000","last_clean":"2024-09-13T17:12:50.228849+0000","last_became_active":"2024-09-13T17:12:50.221697+0000","last_became_peered":"2024-09-13T17:12:50.221697+0000","last_unstale":"2024-09-13T17:12:50.228849+0000","last_undegraded":"2024-09-13T17:12:50.228849+0000","last_fullsized":"2024-09-13T17:12:50.228849+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:45.356785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.223905+0000","last_change":"2024-09-13T17:11:23.340108+0000","last_active":"2024-09-13T17:12:49.223905+0000","last_peered":"2024-09-13T17:12:49.223905+0000","last_clean":"2024-09-13T17:12:49.223905+0000","last_became_active":"2024-09-13T17:11:23.339832+0000","last_became_peered":"2024-09-13T17:11:23.339832+0000","last_unstale":"2024-09-13T17:12:49.223905+0000","last_undegraded":"2024-09-13T17:12:49.223905+0000","last_fullsized":"2024-09-13T17:12:49.223905+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:40.969448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.761228+0000","last_change":"2024-09-13T17:12:50.761228+0000","last_active":"2024-09-13T17:12:50.761228+0000","last_peered":"2024-09-13T17:12:50.761228+0000","last_clean":"2024-09-13T17:12:50.761228+0000","last_became_active":"2024-09-13T17:12:50.760842+0000","last_became_peered":"2024-09-13T17:12:50.760842+0000","last_unstale":"2024-09-13T17:12:50.761228+0000","last_undegraded":"2024-09-13T17:12:50.761228+0000","last_fullsized":"2024-09-13T17:12:50.761228+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:30.513246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,10,0],"acting":[2,3,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.224166+0000","last_change":"2024-09-13T17:11:23.000779+0000","last_active":"2024-09-13T17:12:49.224166+0000","last_peered":"2024-09-13T17:12:49.224166+0000","last_clean":"2024-09-13T17:12:49.224166+0000","last_became_active":"2024-09-13T17:11:23.000511+0000","last_became_peered":"2024-09-13T17:11:23.000511+0000","last_unstale":"2024-09-13T17:12:49.224166+0000","last_undegraded":"2024-09-13T17:12:49.224166+0000","last_fullsized":"2024-09-13T17:12:49.224166+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:09.802392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.220114+0000","last_change":"2024-09-13T17:11:23.333948+0000","last_active":"2024-09-13T17:12:49.220114+0000","last_peered":"2024-09-13T17:12:49.220114+0000","last_clean":"2024-09-13T17:12:49.220114+0000","last_became_active":"2024-09-13T17:11:23.333679+0000","last_became_peered":"2024-09-13T17:11:23.333679+0000","last_unstale":"2024-09-13T17:12:49.220114+0000","last_undegraded":"2024-09-13T17:12:49.220114+0000","last_fullsized":"2024-09-13T17:12:49.220114+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:10.265157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.214269+0000","last_change":"2024-09-13T17:11:27.353767+0000","last_active":"2024-09-13T17:12:49.214269+0000","last_peered":"2024-09-13T17:12:49.214269+0000","last_clean":"2024-09-13T17:12:49.214269+0000","last_became_active":"2024-09-13T17:11:27.353448+0000","last_became_peered":"2024-09-13T17:11:27.353448+0000","last_unstale":"2024-09-13T17:12:49.214269+0000","last_undegraded":"2024-09-13T17:12:49.214269+0000","last_fullsized":"2024-09-13T17:12:49.214269+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:15.948099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.212975+0000","last_change":"2024-09-13T17:11:22.999879+0000","last_active":"2024-09-13T17:12:49.212975+0000","last_peered":"2024-09-13T17:12:49.212975+0000","last_clean":"2024-09-13T17:12:49.212975+0000","last_became_active":"2024-09-13T17:11:22.999577+0000","last_became_peered":"2024-09-13T17:11:22.999577+0000","last_unstale":"2024-09-13T17:12:49.212975+0000","last_undegraded":"2024-09-13T17:12:49.212975+0000","last_fullsized":"2024-09-13T17:12:49.212975+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:48.485532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217363+0000","last_change":"2024-09-13T17:11:23.339026+0000","last_active":"2024-09-13T17:12:49.217363+0000","last_peered":"2024-09-13T17:12:49.217363+0000","last_clean":"2024-09-13T17:12:49.217363+0000","last_became_active":"2024-09-13T17:11:23.338745+0000","last_became_peered":"2024-09-13T17:11:23.338745+0000","last_unstale":"2024-09-13T17:12:49.217363+0000","last_undegraded":"2024-09-13T17:12:49.217363+0000","last_fullsized":"2024-09-13T17:12:49.217363+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:27.455418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.215049+0000","last_change":"2024-09-13T17:11:27.363137+0000","last_active":"2024-09-13T17:12:49.215049+0000","last_peered":"2024-09-13T17:12:49.215049+0000","last_clean":"2024-09-13T17:12:49.215049+0000","last_became_active":"2024-09-13T17:11:27.362621+0000","last_became_peered":"2024-09-13T17:11:27.362621+0000","last_unstale":"2024-09-13T17:12:49.215049+0000","last_undegraded":"2024-09-13T17:12:49.215049+0000","last_fullsized":"2024-09-13T17:12:49.215049+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:35:51.492630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.226520+0000","last_change":"2024-09-13T17:12:50.226520+0000","last_active":"2024-09-13T17:12:50.226520+0000","last_peered":"2024-09-13T17:12:50.226520+0000","last_clean":"2024-09-13T17:12:50.226520+0000","last_became_active":"2024-09-13T17:12:50.223542+0000","last_became_peered":"2024-09-13T17:12:50.223542+0000","last_unstale":"2024-09-13T17:12:50.226520+0000","last_undegraded":"2024-09-13T17:12:50.226520+0000","last_fullsized":"2024-09-13T17:12:50.226520+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:38.064047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.219145+0000","last_change":"2024-09-13T17:11:23.336778+0000","last_active":"2024-09-13T17:12:49.219145+0000","last_peered":"2024-09-13T17:12:49.219145+0000","last_clean":"2024-09-13T17:12:49.219145+0000","last_became_active":"2024-09-13T17:11:23.336491+0000","last_became_peered":"2024-09-13T17:11:23.336491+0000","last_unstale":"2024-09-13T17:12:49.219145+0000","last_undegraded":"2024-09-13T17:12:49.219145+0000","last_fullsized":"2024-09-13T17:12:49.219145+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:02.045912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.214661+0000","last_change":"2024-09-13T17:11:27.361454+0000","last_active":"2024-09-13T17:12:49.214661+0000","last_peered":"2024-09-13T17:12:49.214661+0000","last_clean":"2024-09-13T17:12:49.214661+0000","last_became_active":"2024-09-13T17:11:27.360980+0000","last_became_peered":"2024-09-13T17:11:27.360980+0000","last_unstale":"2024-09-13T17:12:49.214661+0000","last_undegraded":"2024-09-13T17:12:49.214661+0000","last_fullsized":"2024-09-13T17:12:49.214661+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:36.036426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217254+0000","last_change":"2024-09-13T17:11:23.334073+0000","last_active":"2024-09-13T17:12:49.217254+0000","last_peered":"2024-09-13T17:12:49.217254+0000","last_clean":"2024-09-13T17:12:49.217254+0000","last_became_active":"2024-09-13T17:11:23.333628+0000","last_became_peered":"2024-09-13T17:11:23.333628+0000","last_unstale":"2024-09-13T17:12:49.217254+0000","last_undegraded":"2024-09-13T17:12:49.217254+0000","last_fullsized":"2024-09-13T17:12:49.217254+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:18.561346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.229697+0000","last_change":"2024-09-13T17:12:50.229697+0000","last_active":"2024-09-13T17:12:50.229697+0000","last_peered":"2024-09-13T17:12:50.229697+0000","last_clean":"2024-09-13T17:12:50.229697+0000","last_became_active":"2024-09-13T17:12:50.224286+0000","last_became_peered":"2024-09-13T17:12:50.224286+0000","last_unstale":"2024-09-13T17:12:50.229697+0000","last_undegraded":"2024-09-13T17:12:50.229697+0000","last_fullsized":"2024-09-13T17:12:50.229697+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:42.724176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.214861+0000","last_change":"2024-09-13T17:11:27.355472+0000","last_active":"2024-09-13T17:12:49.214861+0000","last_peered":"2024-09-13T17:12:49.214861+0000","last_clean":"2024-09-13T17:12:49.214861+0000","last_became_active":"2024-09-13T17:11:27.355065+0000","last_became_peered":"2024-09-13T17:11:27.355065+0000","last_unstale":"2024-09-13T17:12:49.214861+0000","last_undegraded":"2024-09-13T17:12:49.214861+0000","last_fullsized":"2024-09-13T17:12:49.214861+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:03.881097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.222965+0000","last_change":"2024-09-13T17:11:23.340268+0000","last_active":"2024-09-13T17:12:49.222965+0000","last_peered":"2024-09-13T17:12:49.222965+0000","last_clean":"2024-09-13T17:12:49.222965+0000","last_became_active":"2024-09-13T17:11:23.339977+0000","last_became_peered":"2024-09-13T17:11:23.339977+0000","last_unstale":"2024-09-13T17:12:49.222965+0000","last_undegraded":"2024-09-13T17:12:49.222965+0000","last_fullsized":"2024-09-13T17:12:49.222965+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:21.067899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"90'1","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217071+0000","last_change":"2024-09-13T17:11:23.000858+0000","last_active":"2024-09-13T17:12:49.217071+0000","last_peered":"2024-09-13T17:12:49.217071+0000","last_clean":"2024-09-13T17:12:49.217071+0000","last_became_active":"2024-09-13T17:11:23.000536+0000","last_became_peered":"2024-09-13T17:11:23.000536+0000","last_unstale":"2024-09-13T17:12:49.217071+0000","last_undegraded":"2024-09-13T17:12:49.217071+0000","last_fullsized":"2024-09-13T17:12:49.217071+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:28.798579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.214906+0000","last_change":"2024-09-13T17:11:27.354018+0000","last_active":"2024-09-13T17:12:49.214906+0000","last_peered":"2024-09-13T17:12:49.214906+0000","last_clean":"2024-09-13T17:12:49.214906+0000","last_became_active":"2024-09-13T17:11:27.353519+0000","last_became_peered":"2024-09-13T17:11:27.353519+0000","last_unstale":"2024-09-13T17:12:49.214906+0000","last_undegraded":"2024-09-13T17:12:49.214906+0000","last_fullsized":"2024-09-13T17:12:49.214906+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:55.227851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216063+0000","last_change":"2024-09-13T17:11:23.335798+0000","last_active":"2024-09-13T17:12:49.216063+0000","last_peered":"2024-09-13T17:12:49.216063+0000","last_clean":"2024-09-13T17:12:49.216063+0000","last_became_active":"2024-09-13T17:11:23.335445+0000","last_became_peered":"2024-09-13T17:11:23.335445+0000","last_unstale":"2024-09-13T17:12:49.216063+0000","last_undegraded":"2024-09-13T17:12:49.216063+0000","last_fullsized":"2024-09-13T17:12:49.216063+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:53.242067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.223587+0000","last_change":"2024-09-13T17:11:22.994118+0000","last_active":"2024-09-13T17:12:49.223587+0000","last_peered":"2024-09-13T17:12:49.223587+0000","last_clean":"2024-09-13T17:12:49.223587+0000","last_became_active":"2024-09-13T17:11:22.993801+0000","last_became_peered":"2024-09-13T17:11:22.993801+0000","last_unstale":"2024-09-13T17:12:49.223587+0000","last_undegraded":"2024-09-13T17:12:49.223587+0000","last_fullsized":"2024-09-13T17:12:49.223587+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:01.382130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.213021+0000","last_change":"2024-09-13T17:11:27.358795+0000","last_active":"2024-09-13T17:12:49.213021+0000","last_peered":"2024-09-13T17:12:49.213021+0000","last_clean":"2024-09-13T17:12:49.213021+0000","last_became_active":"2024-09-13T17:11:27.358166+0000","last_became_peered":"2024-09-13T17:11:27.358166+0000","last_unstale":"2024-09-13T17:12:49.213021+0000","last_undegraded":"2024-09-13T17:12:49.213021+0000","last_fullsized":"2024-09-13T17:12:49.213021+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:23.787842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.212378+0000","last_change":"2024-09-13T17:11:23.340671+0000","last_active":"2024-09-13T17:12:49.212378+0000","last_peered":"2024-09-13T17:12:49.212378+0000","last_clean":"2024-09-13T17:12:49.212378+0000","last_became_active":"2024-09-13T17:11:23.340360+0000","last_became_peered":"2024-09-13T17:11:23.340360+0000","last_unstale":"2024-09-13T17:12:49.212378+0000","last_undegraded":"2024-09-13T17:12:49.212378+0000","last_fullsized":"2024-09-13T17:12:49.212378+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:17.875171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216301+0000","last_change":"2024-09-13T17:11:22.993039+0000","last_active":"2024-09-13T17:12:49.216301+0000","last_peered":"2024-09-13T17:12:49.216301+0000","last_clean":"2024-09-13T17:12:49.216301+0000","last_became_active":"2024-09-13T17:11:22.992701+0000","last_became_peered":"2024-09-13T17:11:22.992701+0000","last_unstale":"2024-09-13T17:12:49.216301+0000","last_undegraded":"2024-09-13T17:12:49.216301+0000","last_fullsized":"2024-09-13T17:12:49.216301+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:28.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.214815+0000","last_change":"2024-09-13T17:11:27.363834+0000","last_active":"2024-09-13T17:12:49.214815+0000","last_peered":"2024-09-13T17:12:49.214815+0000","last_clean":"2024-09-13T17:12:49.214815+0000","last_became_active":"2024-09-13T17:11:27.363425+0000","last_became_peered":"2024-09-13T17:11:27.363425+0000","last_unstale":"2024-09-13T17:12:49.214815+0000","last_undegraded":"2024-09-13T17:12:49.214815+0000","last_fullsized":"2024-09-13T17:12:49.214815+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:37.389881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.220993+0000","last_change":"2024-09-13T17:11:23.337423+0000","last_active":"2024-09-13T17:12:49.220993+0000","last_peered":"2024-09-13T17:12:49.220993+0000","last_clean":"2024-09-13T17:12:49.220993+0000","last_became_active":"2024-09-13T17:11:23.337167+0000","last_became_peered":"2024-09-13T17:11:23.337167+0000","last_unstale":"2024-09-13T17:12:49.220993+0000","last_undegraded":"2024-09-13T17:12:49.220993+0000","last_fullsized":"2024-09-13T17:12:49.220993+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:28.540283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.215168+0000","last_change":"2024-09-13T17:11:23.000486+0000","last_active":"2024-09-13T17:12:49.215168+0000","last_peered":"2024-09-13T17:12:49.215168+0000","last_clean":"2024-09-13T17:12:49.215168+0000","last_became_active":"2024-09-13T17:11:23.000158+0000","last_became_peered":"2024-09-13T17:11:23.000158+0000","last_unstale":"2024-09-13T17:12:49.215168+0000","last_undegraded":"2024-09-13T17:12:49.215168+0000","last_fullsized":"2024-09-13T17:12:49.215168+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:42.635037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216284+0000","last_change":"2024-09-13T17:11:27.355058+0000","last_active":"2024-09-13T17:12:49.216284+0000","last_peered":"2024-09-13T17:12:49.216284+0000","last_clean":"2024-09-13T17:12:49.216284+0000","last_became_active":"2024-09-13T17:11:27.354726+0000","last_became_peered":"2024-09-13T17:11:27.354726+0000","last_unstale":"2024-09-13T17:12:49.216284+0000","last_undegraded":"2024-09-13T17:12:49.216284+0000","last_fullsized":"2024-09-13T17:12:49.216284+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:58.450122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.224081+0000","last_change":"2024-09-13T17:11:23.337245+0000","last_active":"2024-09-13T17:12:49.224081+0000","last_peered":"2024-09-13T17:12:49.224081+0000","last_clean":"2024-09-13T17:12:49.224081+0000","last_became_active":"2024-09-13T17:11:23.336956+0000","last_became_peered":"2024-09-13T17:11:23.336956+0000","last_unstale":"2024-09-13T17:12:49.224081+0000","last_undegraded":"2024-09-13T17:12:49.224081+0000","last_fullsized":"2024-09-13T17:12:49.224081+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:46.876149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'6","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.213941+0000","last_change":"2024-09-13T17:11:22.999942+0000","last_active":"2024-09-13T17:12:49.213941+0000","last_peered":"2024-09-13T17:12:49.213941+0000","last_clean":"2024-09-13T17:12:49.213941+0000","last_became_active":"2024-09-13T17:11:22.999653+0000","last_became_peered":"2024-09-13T17:11:22.999653+0000","last_unstale":"2024-09-13T17:12:49.213941+0000","last_undegraded":"2024-09-13T17:12:49.213941+0000","last_fullsized":"2024-09-13T17:12:49.213941+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:29.400939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.223333+0000","last_change":"2024-09-13T17:11:27.356479+0000","last_active":"2024-09-13T17:12:49.223333+0000","last_peered":"2024-09-13T17:12:49.223333+0000","last_clean":"2024-09-13T17:12:49.223333+0000","last_became_active":"2024-09-13T17:11:27.356052+0000","last_became_peered":"2024-09-13T17:11:27.356052+0000","last_unstale":"2024-09-13T17:12:49.223333+0000","last_undegraded":"2024-09-13T17:12:49.223333+0000","last_fullsized":"2024-09-13T17:12:49.223333+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:42.173376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217286+0000","last_change":"2024-09-13T17:11:23.333786+0000","last_active":"2024-09-13T17:12:49.217286+0000","last_peered":"2024-09-13T17:12:49.217286+0000","last_clean":"2024-09-13T17:12:49.217286+0000","last_became_active":"2024-09-13T17:11:23.333472+0000","last_became_peered":"2024-09-13T17:11:23.333472+0000","last_unstale":"2024-09-13T17:12:49.217286+0000","last_undegraded":"2024-09-13T17:12:49.217286+0000","last_fullsized":"2024-09-13T17:12:49.217286+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:41.633228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.213084+0000","last_change":"2024-09-13T17:11:22.998646+0000","last_active":"2024-09-13T17:12:49.213084+0000","last_peered":"2024-09-13T17:12:49.213084+0000","last_clean":"2024-09-13T17:12:49.213084+0000","last_became_active":"2024-09-13T17:11:22.998291+0000","last_became_peered":"2024-09-13T17:11:22.998291+0000","last_unstale":"2024-09-13T17:12:49.213084+0000","last_undegraded":"2024-09-13T17:12:49.213084+0000","last_fullsized":"2024-09-13T17:12:49.213084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:20.658436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216185+0000","last_change":"2024-09-13T17:11:27.361174+0000","last_active":"2024-09-13T17:12:49.216185+0000","last_peered":"2024-09-13T17:12:49.216185+0000","last_clean":"2024-09-13T17:12:49.216185+0000","last_became_active":"2024-09-13T17:11:27.360737+0000","last_became_peered":"2024-09-13T17:11:27.360737+0000","last_unstale":"2024-09-13T17:12:49.216185+0000","last_undegraded":"2024-09-13T17:12:49.216185+0000","last_fullsized":"2024-09-13T17:12:49.216185+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:00.941364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.211855+0000","last_change":"2024-09-13T17:11:23.338545+0000","last_active":"2024-09-13T17:12:49.211855+0000","last_peered":"2024-09-13T17:12:49.211855+0000","last_clean":"2024-09-13T17:12:49.211855+0000","last_became_active":"2024-09-13T17:11:23.338246+0000","last_became_peered":"2024-09-13T17:11:23.338246+0000","last_unstale":"2024-09-13T17:12:49.211855+0000","last_undegraded":"2024-09-13T17:12:49.211855+0000","last_fullsized":"2024-09-13T17:12:49.211855+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:18.966658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.214100+0000","last_change":"2024-09-13T17:11:22.993497+0000","last_active":"2024-09-13T17:12:49.214100+0000","last_peered":"2024-09-13T17:12:49.214100+0000","last_clean":"2024-09-13T17:12:49.214100+0000","last_became_active":"2024-09-13T17:11:22.993165+0000","last_became_peered":"2024-09-13T17:11:22.993165+0000","last_unstale":"2024-09-13T17:12:49.214100+0000","last_undegraded":"2024-09-13T17:12:49.214100+0000","last_fullsized":"2024-09-13T17:12:49.214100+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:20.997834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.212378+0000","last_change":"2024-09-13T17:11:27.364652+0000","last_active":"2024-09-13T17:12:49.212378+0000","last_peered":"2024-09-13T17:12:49.212378+0000","last_clean":"2024-09-13T17:12:49.212378+0000","last_became_active":"2024-09-13T17:11:27.364245+0000","last_became_peered":"2024-09-13T17:11:27.364245+0000","last_unstale":"2024-09-13T17:12:49.212378+0000","last_undegraded":"2024-09-13T17:12:49.212378+0000","last_fullsized":"2024-09-13T17:12:49.212378+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:23.048289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.211679+0000","last_change":"2024-09-13T17:11:23.335649+0000","last_active":"2024-09-13T17:12:49.211679+0000","last_peered":"2024-09-13T17:12:49.211679+0000","last_clean":"2024-09-13T17:12:49.211679+0000","last_became_active":"2024-09-13T17:11:23.335364+0000","last_became_peered":"2024-09-13T17:11:23.335364+0000","last_unstale":"2024-09-13T17:12:49.211679+0000","last_undegraded":"2024-09-13T17:12:49.211679+0000","last_fullsized":"2024-09-13T17:12:49.211679+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.447947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216818+0000","last_change":"2024-09-13T17:11:23.003188+0000","last_active":"2024-09-13T17:12:49.216818+0000","last_peered":"2024-09-13T17:12:49.216818+0000","last_clean":"2024-09-13T17:12:49.216818+0000","last_became_active":"2024-09-13T17:11:23.002858+0000","last_became_peered":"2024-09-13T17:11:23.002858+0000","last_unstale":"2024-09-13T17:12:49.216818+0000","last_undegraded":"2024-09-13T17:12:49.216818+0000","last_fullsized":"2024-09-13T17:12:49.216818+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:34.153326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216174+0000","last_change":"2024-09-13T17:11:27.353320+0000","last_active":"2024-09-13T17:12:49.216174+0000","last_peered":"2024-09-13T17:12:49.216174+0000","last_clean":"2024-09-13T17:12:49.216174+0000","last_became_active":"2024-09-13T17:11:27.352947+0000","last_became_peered":"2024-09-13T17:11:27.352947+0000","last_unstale":"2024-09-13T17:12:49.216174+0000","last_undegraded":"2024-09-13T17:12:49.216174+0000","last_fullsized":"2024-09-13T17:12:49.216174+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:04.619618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.218521+0000","last_change":"2024-09-13T17:11:23.330128+0000","last_active":"2024-09-13T17:12:49.218521+0000","last_peered":"2024-09-13T17:12:49.218521+0000","last_clean":"2024-09-13T17:12:49.218521+0000","last_became_active":"2024-09-13T17:11:23.329266+0000","last_became_peered":"2024-09-13T17:11:23.329266+0000","last_unstale":"2024-09-13T17:12:49.218521+0000","last_undegraded":"2024-09-13T17:12:49.218521+0000","last_fullsized":"2024-09-13T17:12:49.218521+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:36.275352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'4","reported_seq":102,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:03.906325+0000","last_change":"2024-09-13T17:11:23.003495+0000","last_active":"2024-09-13T17:13:03.906325+0000","last_peered":"2024-09-13T17:13:03.906325+0000","last_clean":"2024-09-13T17:13:03.906325+0000","last_became_active":"2024-09-13T17:11:23.003186+0000","last_became_peered":"2024-09-13T17:11:23.003186+0000","last_unstale":"2024-09-13T17:13:03.906325+0000","last_undegraded":"2024-09-13T17:13:03.906325+0000","last_fullsized":"2024-09-13T17:13:03.906325+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:23.353587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216413+0000","last_change":"2024-09-13T17:11:27.362233+0000","last_active":"2024-09-13T17:12:49.216413+0000","last_peered":"2024-09-13T17:12:49.216413+0000","last_clean":"2024-09-13T17:12:49.216413+0000","last_became_active":"2024-09-13T17:11:27.361814+0000","last_became_peered":"2024-09-13T17:11:27.361814+0000","last_unstale":"2024-09-13T17:12:49.216413+0000","last_undegraded":"2024-09-13T17:12:49.216413+0000","last_fullsized":"2024-09-13T17:12:49.216413+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:20.723366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.215129+0000","last_change":"2024-09-13T17:11:23.332870+0000","last_active":"2024-09-13T17:12:49.215129+0000","last_peered":"2024-09-13T17:12:49.215129+0000","last_clean":"2024-09-13T17:12:49.215129+0000","last_became_active":"2024-09-13T17:11:23.332583+0000","last_became_peered":"2024-09-13T17:11:23.332583+0000","last_unstale":"2024-09-13T17:12:49.215129+0000","last_undegraded":"2024-09-13T17:12:49.215129+0000","last_fullsized":"2024-09-13T17:12:49.215129+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:22.607666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216073+0000","last_change":"2024-09-13T17:11:23.001932+0000","last_active":"2024-09-13T17:12:49.216073+0000","last_peered":"2024-09-13T17:12:49.216073+0000","last_clean":"2024-09-13T17:12:49.216073+0000","last_became_active":"2024-09-13T17:11:23.001642+0000","last_became_peered":"2024-09-13T17:11:23.001642+0000","last_unstale":"2024-09-13T17:12:49.216073+0000","last_undegraded":"2024-09-13T17:12:49.216073+0000","last_fullsized":"2024-09-13T17:12:49.216073+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:05.976897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.218572+0000","last_change":"2024-09-13T17:11:27.359679+0000","last_active":"2024-09-13T17:12:49.218572+0000","last_peered":"2024-09-13T17:12:49.218572+0000","last_clean":"2024-09-13T17:12:49.218572+0000","last_became_active":"2024-09-13T17:11:27.359268+0000","last_became_peered":"2024-09-13T17:11:27.359268+0000","last_unstale":"2024-09-13T17:12:49.218572+0000","last_undegraded":"2024-09-13T17:12:49.218572+0000","last_fullsized":"2024-09-13T17:12:49.218572+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:48.154917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.223606+0000","last_change":"2024-09-13T17:11:23.340031+0000","last_active":"2024-09-13T17:12:49.223606+0000","last_peered":"2024-09-13T17:12:49.223606+0000","last_clean":"2024-09-13T17:12:49.223606+0000","last_became_active":"2024-09-13T17:11:23.339768+0000","last_became_peered":"2024-09-13T17:11:23.339768+0000","last_unstale":"2024-09-13T17:12:49.223606+0000","last_undegraded":"2024-09-13T17:12:49.223606+0000","last_fullsized":"2024-09-13T17:12:49.223606+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:22.360526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.215438+0000","last_change":"2024-09-13T17:11:22.995060+0000","last_active":"2024-09-13T17:12:49.215438+0000","last_peered":"2024-09-13T17:12:49.215438+0000","last_clean":"2024-09-13T17:12:49.215438+0000","last_became_active":"2024-09-13T17:11:22.991949+0000","last_became_peered":"2024-09-13T17:11:22.991949+0000","last_unstale":"2024-09-13T17:12:49.215438+0000","last_undegraded":"2024-09-13T17:12:49.215438+0000","last_fullsized":"2024-09-13T17:12:49.215438+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:44.716753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":343,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.217610+0000","last_change":"2024-09-13T17:10:13.439723+0000","last_active":"2024-09-13T17:12:50.217610+0000","last_peered":"2024-09-13T17:12:50.217610+0000","last_clean":"2024-09-13T17:12:50.217610+0000","last_became_active":"2024-09-13T17:10:13.439290+0000","last_became_peered":"2024-09-13T17:10:13.439290+0000","last_unstale":"2024-09-13T17:12:50.217610+0000","last_undegraded":"2024-09-13T17:12:50.217610+0000","last_fullsized":"2024-09-13T17:12:50.217610+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:03.041486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:03.041486+0000","last_clean_scrub_stamp":"2024-09-13T17:07:03.041486+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:08.673571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217581+0000","last_change":"2024-09-13T17:11:27.361028+0000","last_active":"2024-09-13T17:12:49.217581+0000","last_peered":"2024-09-13T17:12:49.217581+0000","last_clean":"2024-09-13T17:12:49.217581+0000","last_became_active":"2024-09-13T17:11:27.360630+0000","last_became_peered":"2024-09-13T17:11:27.360630+0000","last_unstale":"2024-09-13T17:12:49.217581+0000","last_undegraded":"2024-09-13T17:12:49.217581+0000","last_fullsized":"2024-09-13T17:12:49.217581+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:40:40.860443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217834+0000","last_change":"2024-09-13T17:11:49.798729+0000","last_active":"2024-09-13T17:12:49.217834+0000","last_peered":"2024-09-13T17:12:49.217834+0000","last_clean":"2024-09-13T17:12:49.217834+0000","last_became_active":"2024-09-13T17:11:49.798402+0000","last_became_peered":"2024-09-13T17:11:49.798402+0000","last_unstale":"2024-09-13T17:12:49.217834+0000","last_undegraded":"2024-09-13T17:12:49.217834+0000","last_fullsized":"2024-09-13T17:12:49.217834+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:58.948813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,11],"acting":[7,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.214724+0000","last_change":"2024-09-13T17:11:49.802654+0000","last_active":"2024-09-13T17:12:49.214724+0000","last_peered":"2024-09-13T17:12:49.214724+0000","last_clean":"2024-09-13T17:12:49.214724+0000","last_became_active":"2024-09-13T17:11:49.797574+0000","last_became_peered":"2024-09-13T17:11:49.797574+0000","last_unstale":"2024-09-13T17:12:49.214724+0000","last_undegraded":"2024-09-13T17:12:49.214724+0000","last_fullsized":"2024-09-13T17:12:49.214724+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:08.827045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216252+0000","last_change":"2024-09-13T17:11:27.360372+0000","last_active":"2024-09-13T17:12:49.216252+0000","last_peered":"2024-09-13T17:12:49.216252+0000","last_clean":"2024-09-13T17:12:49.216252+0000","last_became_active":"2024-09-13T17:11:27.359990+0000","last_became_peered":"2024-09-13T17:11:27.359990+0000","last_unstale":"2024-09-13T17:12:49.216252+0000","last_undegraded":"2024-09-13T17:12:49.216252+0000","last_fullsized":"2024-09-13T17:12:49.216252+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:26.970317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217460+0000","last_change":"2024-09-13T17:11:23.336269+0000","last_active":"2024-09-13T17:12:49.217460+0000","last_peered":"2024-09-13T17:12:49.217460+0000","last_clean":"2024-09-13T17:12:49.217460+0000","last_became_active":"2024-09-13T17:11:23.335921+0000","last_became_peered":"2024-09-13T17:11:23.335921+0000","last_unstale":"2024-09-13T17:12:49.217460+0000","last_undegraded":"2024-09-13T17:12:49.217460+0000","last_fullsized":"2024-09-13T17:12:49.217460+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:43.035927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.219231+0000","last_change":"2024-09-13T17:11:23.002491+0000","last_active":"2024-09-13T17:12:49.219231+0000","last_peered":"2024-09-13T17:12:49.219231+0000","last_clean":"2024-09-13T17:12:49.219231+0000","last_became_active":"2024-09-13T17:11:23.002178+0000","last_became_peered":"2024-09-13T17:11:23.002178+0000","last_unstale":"2024-09-13T17:12:49.219231+0000","last_undegraded":"2024-09-13T17:12:49.219231+0000","last_fullsized":"2024-09-13T17:12:49.219231+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:06.056639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.219028+0000","last_change":"2024-09-13T17:11:27.355153+0000","last_active":"2024-09-13T17:12:49.219028+0000","last_peered":"2024-09-13T17:12:49.219028+0000","last_clean":"2024-09-13T17:12:49.219028+0000","last_became_active":"2024-09-13T17:11:27.354701+0000","last_became_peered":"2024-09-13T17:11:27.354701+0000","last_unstale":"2024-09-13T17:12:49.219028+0000","last_undegraded":"2024-09-13T17:12:49.219028+0000","last_fullsized":"2024-09-13T17:12:49.219028+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:34.924402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217865+0000","last_change":"2024-09-13T17:11:23.342067+0000","last_active":"2024-09-13T17:12:49.217865+0000","last_peered":"2024-09-13T17:12:49.217865+0000","last_clean":"2024-09-13T17:12:49.217865+0000","last_became_active":"2024-09-13T17:11:23.341736+0000","last_became_peered":"2024-09-13T17:11:23.341736+0000","last_unstale":"2024-09-13T17:12:49.217865+0000","last_undegraded":"2024-09-13T17:12:49.217865+0000","last_fullsized":"2024-09-13T17:12:49.217865+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:03.114638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216293+0000","last_change":"2024-09-13T17:11:23.002849+0000","last_active":"2024-09-13T17:12:49.216293+0000","last_peered":"2024-09-13T17:12:49.216293+0000","last_clean":"2024-09-13T17:12:49.216293+0000","last_became_active":"2024-09-13T17:11:23.002562+0000","last_became_peered":"2024-09-13T17:11:23.002562+0000","last_unstale":"2024-09-13T17:12:49.216293+0000","last_undegraded":"2024-09-13T17:12:49.216293+0000","last_fullsized":"2024-09-13T17:12:49.216293+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:11:24.650510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.218021+0000","last_change":"2024-09-13T17:11:27.359343+0000","last_active":"2024-09-13T17:12:49.218021+0000","last_peered":"2024-09-13T17:12:49.218021+0000","last_clean":"2024-09-13T17:12:49.218021+0000","last_became_active":"2024-09-13T17:11:27.358628+0000","last_became_peered":"2024-09-13T17:11:27.358628+0000","last_unstale":"2024-09-13T17:12:49.218021+0000","last_undegraded":"2024-09-13T17:12:49.218021+0000","last_fullsized":"2024-09-13T17:12:49.218021+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:39.584184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216776+0000","last_change":"2024-09-13T17:11:23.333111+0000","last_active":"2024-09-13T17:12:49.216776+0000","last_peered":"2024-09-13T17:12:49.216776+0000","last_clean":"2024-09-13T17:12:49.216776+0000","last_became_active":"2024-09-13T17:11:23.332734+0000","last_became_peered":"2024-09-13T17:11:23.332734+0000","last_unstale":"2024-09-13T17:12:49.216776+0000","last_undegraded":"2024-09-13T17:12:49.216776+0000","last_fullsized":"2024-09-13T17:12:49.216776+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:44.628106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"91'2","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.213135+0000","last_change":"2024-09-13T17:11:23.000759+0000","last_active":"2024-09-13T17:12:49.213135+0000","last_peered":"2024-09-13T17:12:49.213135+0000","last_clean":"2024-09-13T17:12:49.213135+0000","last_became_active":"2024-09-13T17:11:23.000463+0000","last_became_peered":"2024-09-13T17:11:23.000463+0000","last_unstale":"2024-09-13T17:12:49.213135+0000","last_undegraded":"2024-09-13T17:12:49.213135+0000","last_fullsized":"2024-09-13T17:12:49.213135+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:59.077194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.219054+0000","last_change":"2024-09-13T17:11:27.363076+0000","last_active":"2024-09-13T17:12:49.219054+0000","last_peered":"2024-09-13T17:12:49.219054+0000","last_clean":"2024-09-13T17:12:49.219054+0000","last_became_active":"2024-09-13T17:11:27.362642+0000","last_became_peered":"2024-09-13T17:11:27.362642+0000","last_unstale":"2024-09-13T17:12:49.219054+0000","last_undegraded":"2024-09-13T17:12:49.219054+0000","last_fullsized":"2024-09-13T17:12:49.219054+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:25.494875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.218579+0000","last_change":"2024-09-13T17:11:23.336703+0000","last_active":"2024-09-13T17:12:49.218579+0000","last_peered":"2024-09-13T17:12:49.218579+0000","last_clean":"2024-09-13T17:12:49.218579+0000","last_became_active":"2024-09-13T17:11:23.336349+0000","last_became_peered":"2024-09-13T17:11:23.336349+0000","last_unstale":"2024-09-13T17:12:49.218579+0000","last_undegraded":"2024-09-13T17:12:49.218579+0000","last_fullsized":"2024-09-13T17:12:49.218579+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:28.671438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.212703+0000","last_change":"2024-09-13T17:11:22.994382+0000","last_active":"2024-09-13T17:12:49.212703+0000","last_peered":"2024-09-13T17:12:49.212703+0000","last_clean":"2024-09-13T17:12:49.212703+0000","last_became_active":"2024-09-13T17:11:22.994037+0000","last_became_peered":"2024-09-13T17:11:22.994037+0000","last_unstale":"2024-09-13T17:12:49.212703+0000","last_undegraded":"2024-09-13T17:12:49.212703+0000","last_fullsized":"2024-09-13T17:12:49.212703+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:10.763757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216173+0000","last_change":"2024-09-13T17:11:27.354351+0000","last_active":"2024-09-13T17:12:49.216173+0000","last_peered":"2024-09-13T17:12:49.216173+0000","last_clean":"2024-09-13T17:12:49.216173+0000","last_became_active":"2024-09-13T17:11:27.353715+0000","last_became_peered":"2024-09-13T17:11:27.353715+0000","last_unstale":"2024-09-13T17:12:49.216173+0000","last_undegraded":"2024-09-13T17:12:49.216173+0000","last_fullsized":"2024-09-13T17:12:49.216173+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:18.335183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.215984+0000","last_change":"2024-09-13T17:11:23.341743+0000","last_active":"2024-09-13T17:12:49.215984+0000","last_peered":"2024-09-13T17:12:49.215984+0000","last_clean":"2024-09-13T17:12:49.215984+0000","last_became_active":"2024-09-13T17:11:23.341200+0000","last_became_peered":"2024-09-13T17:11:23.341200+0000","last_unstale":"2024-09-13T17:12:49.215984+0000","last_undegraded":"2024-09-13T17:12:49.215984+0000","last_fullsized":"2024-09-13T17:12:49.215984+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:41.854013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'3","reported_seq":106,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:07.913449+0000","last_change":"2024-09-13T17:11:22.997571+0000","last_active":"2024-09-13T17:13:07.913449+0000","last_peered":"2024-09-13T17:13:07.913449+0000","last_clean":"2024-09-13T17:13:07.913449+0000","last_became_active":"2024-09-13T17:11:22.997238+0000","last_became_peered":"2024-09-13T17:11:22.997238+0000","last_unstale":"2024-09-13T17:13:07.913449+0000","last_undegraded":"2024-09-13T17:13:07.913449+0000","last_fullsized":"2024-09-13T17:13:07.913449+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:34.533004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":85,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.761941+0000","last_change":"2024-09-13T17:12:50.761520+0000","last_active":"2024-09-13T17:12:50.761941+0000","last_peered":"2024-09-13T17:12:50.761941+0000","last_clean":"2024-09-13T17:12:50.761941+0000","last_became_active":"2024-09-13T17:12:50.760930+0000","last_became_peered":"2024-09-13T17:12:50.760930+0000","last_unstale":"2024-09-13T17:12:50.761941+0000","last_undegraded":"2024-09-13T17:12:50.761941+0000","last_fullsized":"2024-09-13T17:12:50.761941+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:46.646722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216865+0000","last_change":"2024-09-13T17:11:23.337666+0000","last_active":"2024-09-13T17:12:49.216865+0000","last_peered":"2024-09-13T17:12:49.216865+0000","last_clean":"2024-09-13T17:12:49.216865+0000","last_became_active":"2024-09-13T17:11:23.337185+0000","last_became_peered":"2024-09-13T17:11:23.337185+0000","last_unstale":"2024-09-13T17:12:49.216865+0000","last_undegraded":"2024-09-13T17:12:49.216865+0000","last_fullsized":"2024-09-13T17:12:49.216865+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:51.266709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.219070+0000","last_change":"2024-09-13T17:11:23.005075+0000","last_active":"2024-09-13T17:12:49.219070+0000","last_peered":"2024-09-13T17:12:49.219070+0000","last_clean":"2024-09-13T17:12:49.219070+0000","last_became_active":"2024-09-13T17:11:23.004778+0000","last_became_peered":"2024-09-13T17:11:23.004778+0000","last_unstale":"2024-09-13T17:12:49.219070+0000","last_undegraded":"2024-09-13T17:12:49.219070+0000","last_fullsized":"2024-09-13T17:12:49.219070+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:06.763552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216537+0000","last_change":"2024-09-13T17:11:27.353601+0000","last_active":"2024-09-13T17:12:49.216537+0000","last_peered":"2024-09-13T17:12:49.216537+0000","last_clean":"2024-09-13T17:12:49.216537+0000","last_became_active":"2024-09-13T17:11:27.353190+0000","last_became_peered":"2024-09-13T17:11:27.353190+0000","last_unstale":"2024-09-13T17:12:49.216537+0000","last_undegraded":"2024-09-13T17:12:49.216537+0000","last_fullsized":"2024-09-13T17:12:49.216537+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:24.645552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216619+0000","last_change":"2024-09-13T17:11:49.799773+0000","last_active":"2024-09-13T17:12:49.216619+0000","last_peered":"2024-09-13T17:12:49.216619+0000","last_clean":"2024-09-13T17:12:49.216619+0000","last_became_active":"2024-09-13T17:11:49.799402+0000","last_became_peered":"2024-09-13T17:11:49.799402+0000","last_unstale":"2024-09-13T17:12:49.216619+0000","last_undegraded":"2024-09-13T17:12:49.216619+0000","last_fullsized":"2024-09-13T17:12:49.216619+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:37.230144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217168+0000","last_change":"2024-09-13T17:11:23.005619+0000","last_active":"2024-09-13T17:12:49.217168+0000","last_peered":"2024-09-13T17:12:49.217168+0000","last_clean":"2024-09-13T17:12:49.217168+0000","last_became_active":"2024-09-13T17:11:23.005077+0000","last_became_peered":"2024-09-13T17:11:23.005077+0000","last_unstale":"2024-09-13T17:12:49.217168+0000","last_undegraded":"2024-09-13T17:12:49.217168+0000","last_fullsized":"2024-09-13T17:12:49.217168+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:51.739773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.218348+0000","last_change":"2024-09-13T17:11:27.364603+0000","last_active":"2024-09-13T17:12:49.218348+0000","last_peered":"2024-09-13T17:12:49.218348+0000","last_clean":"2024-09-13T17:12:49.218348+0000","last_became_active":"2024-09-13T17:11:27.364226+0000","last_became_peered":"2024-09-13T17:11:27.364226+0000","last_unstale":"2024-09-13T17:12:49.218348+0000","last_undegraded":"2024-09-13T17:12:49.218348+0000","last_fullsized":"2024-09-13T17:12:49.218348+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:56.802016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.212695+0000","last_change":"2024-09-13T17:11:23.338657+0000","last_active":"2024-09-13T17:12:49.212695+0000","last_peered":"2024-09-13T17:12:49.212695+0000","last_clean":"2024-09-13T17:12:49.212695+0000","last_became_active":"2024-09-13T17:11:23.338377+0000","last_became_peered":"2024-09-13T17:11:23.338377+0000","last_unstale":"2024-09-13T17:12:49.212695+0000","last_undegraded":"2024-09-13T17:12:49.212695+0000","last_fullsized":"2024-09-13T17:12:49.212695+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:52.412887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"91'33","reported_seq":225,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:08.912267+0000","last_change":"2024-09-13T17:11:22.998541+0000","last_active":"2024-09-13T17:13:08.912267+0000","last_peered":"2024-09-13T17:13:08.912267+0000","last_clean":"2024-09-13T17:13:08.912267+0000","last_became_active":"2024-09-13T17:11:22.998132+0000","last_became_peered":"2024-09-13T17:11:22.998132+0000","last_unstale":"2024-09-13T17:13:08.912267+0000","last_undegraded":"2024-09-13T17:13:08.912267+0000","last_fullsized":"2024-09-13T17:13:08.912267+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:16.777772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62287,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":172,"num_read_kb":148,"num_write":34,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.213105+0000","last_change":"2024-09-13T17:11:27.361917+0000","last_active":"2024-09-13T17:12:49.213105+0000","last_peered":"2024-09-13T17:12:49.213105+0000","last_clean":"2024-09-13T17:12:49.213105+0000","last_became_active":"2024-09-13T17:11:27.361503+0000","last_became_peered":"2024-09-13T17:11:27.361503+0000","last_unstale":"2024-09-13T17:12:49.213105+0000","last_undegraded":"2024-09-13T17:12:49.213105+0000","last_fullsized":"2024-09-13T17:12:49.213105+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:52.959017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217459+0000","last_change":"2024-09-13T17:11:49.798971+0000","last_active":"2024-09-13T17:12:49.217459+0000","last_peered":"2024-09-13T17:12:49.217459+0000","last_clean":"2024-09-13T17:12:49.217459+0000","last_became_active":"2024-09-13T17:11:49.798597+0000","last_became_peered":"2024-09-13T17:11:49.798597+0000","last_unstale":"2024-09-13T17:12:49.217459+0000","last_undegraded":"2024-09-13T17:12:49.217459+0000","last_fullsized":"2024-09-13T17:12:49.217459+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:41.886456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.219164+0000","last_change":"2024-09-13T17:11:23.004059+0000","last_active":"2024-09-13T17:12:49.219164+0000","last_peered":"2024-09-13T17:12:49.219164+0000","last_clean":"2024-09-13T17:12:49.219164+0000","last_became_active":"2024-09-13T17:11:23.003248+0000","last_became_peered":"2024-09-13T17:11:23.003248+0000","last_unstale":"2024-09-13T17:12:49.219164+0000","last_undegraded":"2024-09-13T17:12:49.219164+0000","last_fullsized":"2024-09-13T17:12:49.219164+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:05.496872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.215396+0000","last_change":"2024-09-13T17:11:27.362880+0000","last_active":"2024-09-13T17:12:49.215396+0000","last_peered":"2024-09-13T17:12:49.215396+0000","last_clean":"2024-09-13T17:12:49.215396+0000","last_became_active":"2024-09-13T17:11:27.362471+0000","last_became_peered":"2024-09-13T17:11:27.362471+0000","last_unstale":"2024-09-13T17:12:49.215396+0000","last_undegraded":"2024-09-13T17:12:49.215396+0000","last_fullsized":"2024-09-13T17:12:49.215396+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:49.964606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.220188+0000","last_change":"2024-09-13T17:11:49.799023+0000","last_active":"2024-09-13T17:12:49.220188+0000","last_peered":"2024-09-13T17:12:49.220188+0000","last_clean":"2024-09-13T17:12:49.220188+0000","last_became_active":"2024-09-13T17:11:49.798724+0000","last_became_peered":"2024-09-13T17:11:49.798724+0000","last_unstale":"2024-09-13T17:12:49.220188+0000","last_undegraded":"2024-09-13T17:12:49.220188+0000","last_fullsized":"2024-09-13T17:12:49.220188+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:03.569532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,7],"acting":[0,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217861+0000","last_change":"2024-09-13T17:11:22.999158+0000","last_active":"2024-09-13T17:12:49.217861+0000","last_peered":"2024-09-13T17:12:49.217861+0000","last_clean":"2024-09-13T17:12:49.217861+0000","last_became_active":"2024-09-13T17:11:22.998795+0000","last_became_peered":"2024-09-13T17:11:22.998795+0000","last_unstale":"2024-09-13T17:12:49.217861+0000","last_undegraded":"2024-09-13T17:12:49.217861+0000","last_fullsized":"2024-09-13T17:12:49.217861+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:23.880769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.484706+0000","last_change":"2024-09-13T17:12:50.484254+0000","last_active":"2024-09-13T17:12:50.484706+0000","last_peered":"2024-09-13T17:12:50.484706+0000","last_clean":"2024-09-13T17:12:50.484706+0000","last_became_active":"2024-09-13T17:12:50.483742+0000","last_became_peered":"2024-09-13T17:12:50.483742+0000","last_unstale":"2024-09-13T17:12:50.484706+0000","last_undegraded":"2024-09-13T17:12:50.484706+0000","last_fullsized":"2024-09-13T17:12:50.484706+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:59:03.266889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217270+0000","last_change":"2024-09-13T17:11:23.338736+0000","last_active":"2024-09-13T17:12:49.217270+0000","last_peered":"2024-09-13T17:12:49.217270+0000","last_clean":"2024-09-13T17:12:49.217270+0000","last_became_active":"2024-09-13T17:11:23.338462+0000","last_became_peered":"2024-09-13T17:11:23.338462+0000","last_unstale":"2024-09-13T17:12:49.217270+0000","last_undegraded":"2024-09-13T17:12:49.217270+0000","last_fullsized":"2024-09-13T17:12:49.217270+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:49.221314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'3","reported_seq":105,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:07.910762+0000","last_change":"2024-09-13T17:11:23.001966+0000","last_active":"2024-09-13T17:13:07.910762+0000","last_peered":"2024-09-13T17:13:07.910762+0000","last_clean":"2024-09-13T17:13:07.910762+0000","last_became_active":"2024-09-13T17:11:23.001565+0000","last_became_peered":"2024-09-13T17:11:23.001565+0000","last_unstale":"2024-09-13T17:13:07.910762+0000","last_undegraded":"2024-09-13T17:13:07.910762+0000","last_fullsized":"2024-09-13T17:13:07.910762+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:47.240702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":82,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.223030+0000","last_change":"2024-09-13T17:11:27.360896+0000","last_active":"2024-09-13T17:12:49.223030+0000","last_peered":"2024-09-13T17:12:49.223030+0000","last_clean":"2024-09-13T17:12:49.223030+0000","last_became_active":"2024-09-13T17:11:27.360552+0000","last_became_peered":"2024-09-13T17:11:27.360552+0000","last_unstale":"2024-09-13T17:12:49.223030+0000","last_undegraded":"2024-09-13T17:12:49.223030+0000","last_fullsized":"2024-09-13T17:12:49.223030+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:08.726724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.219405+0000","last_change":"2024-09-13T17:11:27.356317+0000","last_active":"2024-09-13T17:12:49.219405+0000","last_peered":"2024-09-13T17:12:49.219405+0000","last_clean":"2024-09-13T17:12:49.219405+0000","last_became_active":"2024-09-13T17:11:27.355863+0000","last_became_peered":"2024-09-13T17:11:27.355863+0000","last_unstale":"2024-09-13T17:12:49.219405+0000","last_undegraded":"2024-09-13T17:12:49.219405+0000","last_fullsized":"2024-09-13T17:12:49.219405+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:29.356048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.213377+0000","last_change":"2024-09-13T17:11:23.344929+0000","last_active":"2024-09-13T17:12:49.213377+0000","last_peered":"2024-09-13T17:12:49.213377+0000","last_clean":"2024-09-13T17:12:49.213377+0000","last_became_active":"2024-09-13T17:11:23.344627+0000","last_became_peered":"2024-09-13T17:11:23.344627+0000","last_unstale":"2024-09-13T17:12:49.213377+0000","last_undegraded":"2024-09-13T17:12:49.213377+0000","last_fullsized":"2024-09-13T17:12:49.213377+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:15.049627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.218606+0000","last_change":"2024-09-13T17:11:23.002539+0000","last_active":"2024-09-13T17:12:49.218606+0000","last_peered":"2024-09-13T17:12:49.218606+0000","last_clean":"2024-09-13T17:12:49.218606+0000","last_became_active":"2024-09-13T17:11:23.002206+0000","last_became_peered":"2024-09-13T17:11:23.002206+0000","last_unstale":"2024-09-13T17:12:49.218606+0000","last_undegraded":"2024-09-13T17:12:49.218606+0000","last_fullsized":"2024-09-13T17:12:49.218606+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:57.708167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216878+0000","last_change":"2024-09-13T17:11:27.362667+0000","last_active":"2024-09-13T17:12:49.216878+0000","last_peered":"2024-09-13T17:12:49.216878+0000","last_clean":"2024-09-13T17:12:49.216878+0000","last_became_active":"2024-09-13T17:11:27.362293+0000","last_became_peered":"2024-09-13T17:11:27.362293+0000","last_unstale":"2024-09-13T17:12:49.216878+0000","last_undegraded":"2024-09-13T17:12:49.216878+0000","last_fullsized":"2024-09-13T17:12:49.216878+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:24.446951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.223489+0000","last_change":"2024-09-13T17:11:23.335823+0000","last_active":"2024-09-13T17:12:49.223489+0000","last_peered":"2024-09-13T17:12:49.223489+0000","last_clean":"2024-09-13T17:12:49.223489+0000","last_became_active":"2024-09-13T17:11:23.335491+0000","last_became_peered":"2024-09-13T17:11:23.335491+0000","last_unstale":"2024-09-13T17:12:49.223489+0000","last_undegraded":"2024-09-13T17:12:49.223489+0000","last_fullsized":"2024-09-13T17:12:49.223489+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:42.172559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.215225+0000","last_change":"2024-09-13T17:11:22.999477+0000","last_active":"2024-09-13T17:12:49.215225+0000","last_peered":"2024-09-13T17:12:49.215225+0000","last_clean":"2024-09-13T17:12:49.215225+0000","last_became_active":"2024-09-13T17:11:22.999175+0000","last_became_peered":"2024-09-13T17:11:22.999175+0000","last_unstale":"2024-09-13T17:12:49.215225+0000","last_undegraded":"2024-09-13T17:12:49.215225+0000","last_fullsized":"2024-09-13T17:12:49.215225+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:03.817508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.220304+0000","last_change":"2024-09-13T17:12:50.220304+0000","last_active":"2024-09-13T17:12:50.220304+0000","last_peered":"2024-09-13T17:12:50.220304+0000","last_clean":"2024-09-13T17:12:50.220304+0000","last_became_active":"2024-09-13T17:12:50.216329+0000","last_became_peered":"2024-09-13T17:12:50.216329+0000","last_unstale":"2024-09-13T17:12:50.220304+0000","last_undegraded":"2024-09-13T17:12:50.220304+0000","last_fullsized":"2024-09-13T17:12:50.220304+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:18:29.389297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.218126+0000","last_change":"2024-09-13T17:11:23.337738+0000","last_active":"2024-09-13T17:12:49.218126+0000","last_peered":"2024-09-13T17:12:49.218126+0000","last_clean":"2024-09-13T17:12:49.218126+0000","last_became_active":"2024-09-13T17:11:23.337411+0000","last_became_peered":"2024-09-13T17:11:23.337411+0000","last_unstale":"2024-09-13T17:12:49.218126+0000","last_undegraded":"2024-09-13T17:12:49.218126+0000","last_fullsized":"2024-09-13T17:12:49.218126+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:02.355706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.221722+0000","last_change":"2024-09-13T17:12:50.221722+0000","last_active":"2024-09-13T17:12:50.221722+0000","last_peered":"2024-09-13T17:12:50.221722+0000","last_clean":"2024-09-13T17:12:50.221722+0000","last_became_active":"2024-09-13T17:12:50.221273+0000","last_became_peered":"2024-09-13T17:12:50.221273+0000","last_unstale":"2024-09-13T17:12:50.221722+0000","last_undegraded":"2024-09-13T17:12:50.221722+0000","last_fullsized":"2024-09-13T17:12:50.221722+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:28.617737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,8],"acting":[2,6,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'6","reported_seq":108,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:05.908289+0000","last_change":"2024-09-13T17:11:23.000544+0000","last_active":"2024-09-13T17:13:05.908289+0000","last_peered":"2024-09-13T17:13:05.908289+0000","last_clean":"2024-09-13T17:13:05.908289+0000","last_became_active":"2024-09-13T17:11:23.000233+0000","last_became_peered":"2024-09-13T17:11:23.000233+0000","last_unstale":"2024-09-13T17:13:05.908289+0000","last_undegraded":"2024-09-13T17:13:05.908289+0000","last_fullsized":"2024-09-13T17:13:05.908289+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:04.745950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":966,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":83,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.212650+0000","last_change":"2024-09-13T17:11:23.340104+0000","last_active":"2024-09-13T17:12:49.212650+0000","last_peered":"2024-09-13T17:12:49.212650+0000","last_clean":"2024-09-13T17:12:49.212650+0000","last_became_active":"2024-09-13T17:11:23.339826+0000","last_became_peered":"2024-09-13T17:11:23.339826+0000","last_unstale":"2024-09-13T17:12:49.212650+0000","last_undegraded":"2024-09-13T17:12:49.212650+0000","last_fullsized":"2024-09-13T17:12:49.212650+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:03.101547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217283+0000","last_change":"2024-09-13T17:11:27.360848+0000","last_active":"2024-09-13T17:12:49.217283+0000","last_peered":"2024-09-13T17:12:49.217283+0000","last_clean":"2024-09-13T17:12:49.217283+0000","last_became_active":"2024-09-13T17:11:27.360416+0000","last_became_peered":"2024-09-13T17:11:27.360416+0000","last_unstale":"2024-09-13T17:12:49.217283+0000","last_undegraded":"2024-09-13T17:12:49.217283+0000","last_fullsized":"2024-09-13T17:12:49.217283+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:06.857649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.215920+0000","last_change":"2024-09-13T17:11:23.334723+0000","last_active":"2024-09-13T17:12:49.215920+0000","last_peered":"2024-09-13T17:12:49.215920+0000","last_clean":"2024-09-13T17:12:49.215920+0000","last_became_active":"2024-09-13T17:11:23.334433+0000","last_became_peered":"2024-09-13T17:11:23.334433+0000","last_unstale":"2024-09-13T17:12:49.215920+0000","last_undegraded":"2024-09-13T17:12:49.215920+0000","last_fullsized":"2024-09-13T17:12:49.215920+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:08.657151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216615+0000","last_change":"2024-09-13T17:11:23.334882+0000","last_active":"2024-09-13T17:12:49.216615+0000","last_peered":"2024-09-13T17:12:49.216615+0000","last_clean":"2024-09-13T17:12:49.216615+0000","last_became_active":"2024-09-13T17:11:23.334610+0000","last_became_peered":"2024-09-13T17:11:23.334610+0000","last_unstale":"2024-09-13T17:12:49.216615+0000","last_undegraded":"2024-09-13T17:12:49.216615+0000","last_fullsized":"2024-09-13T17:12:49.216615+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:03.932181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216976+0000","last_change":"2024-09-13T17:11:23.334076+0000","last_active":"2024-09-13T17:12:49.216976+0000","last_peered":"2024-09-13T17:12:49.216976+0000","last_clean":"2024-09-13T17:12:49.216976+0000","last_became_active":"2024-09-13T17:11:23.333801+0000","last_became_peered":"2024-09-13T17:11:23.333801+0000","last_unstale":"2024-09-13T17:12:49.216976+0000","last_undegraded":"2024-09-13T17:12:49.216976+0000","last_fullsized":"2024-09-13T17:12:49.216976+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:07.113045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.219073+0000","last_change":"2024-09-13T17:11:23.332306+0000","last_active":"2024-09-13T17:12:49.219073+0000","last_peered":"2024-09-13T17:12:49.219073+0000","last_clean":"2024-09-13T17:12:49.219073+0000","last_became_active":"2024-09-13T17:11:23.331913+0000","last_became_peered":"2024-09-13T17:11:23.331913+0000","last_unstale":"2024-09-13T17:12:49.219073+0000","last_undegraded":"2024-09-13T17:12:49.219073+0000","last_fullsized":"2024-09-13T17:12:49.219073+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:02.927286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216318+0000","last_change":"2024-09-13T17:11:23.335512+0000","last_active":"2024-09-13T17:12:49.216318+0000","last_peered":"2024-09-13T17:12:49.216318+0000","last_clean":"2024-09-13T17:12:49.216318+0000","last_became_active":"2024-09-13T17:11:23.335201+0000","last_became_peered":"2024-09-13T17:11:23.335201+0000","last_unstale":"2024-09-13T17:12:49.216318+0000","last_undegraded":"2024-09-13T17:12:49.216318+0000","last_fullsized":"2024-09-13T17:12:49.216318+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:17.263819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216563+0000","last_change":"2024-09-13T17:11:23.341204+0000","last_active":"2024-09-13T17:12:49.216563+0000","last_peered":"2024-09-13T17:12:49.216563+0000","last_clean":"2024-09-13T17:12:49.216563+0000","last_became_active":"2024-09-13T17:11:23.339848+0000","last_became_peered":"2024-09-13T17:11:23.339848+0000","last_unstale":"2024-09-13T17:12:49.216563+0000","last_undegraded":"2024-09-13T17:12:49.216563+0000","last_fullsized":"2024-09-13T17:12:49.216563+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:15:09.480651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217619+0000","last_change":"2024-09-13T17:11:23.334741+0000","last_active":"2024-09-13T17:12:49.217619+0000","last_peered":"2024-09-13T17:12:49.217619+0000","last_clean":"2024-09-13T17:12:49.217619+0000","last_became_active":"2024-09-13T17:11:23.334459+0000","last_became_peered":"2024-09-13T17:11:23.334459+0000","last_unstale":"2024-09-13T17:12:49.217619+0000","last_undegraded":"2024-09-13T17:12:49.217619+0000","last_fullsized":"2024-09-13T17:12:49.217619+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:52.379735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.224061+0000","last_change":"2024-09-13T17:11:23.337869+0000","last_active":"2024-09-13T17:12:49.224061+0000","last_peered":"2024-09-13T17:12:49.224061+0000","last_clean":"2024-09-13T17:12:49.224061+0000","last_became_active":"2024-09-13T17:11:23.337581+0000","last_became_peered":"2024-09-13T17:11:23.337581+0000","last_unstale":"2024-09-13T17:12:49.224061+0000","last_undegraded":"2024-09-13T17:12:49.224061+0000","last_fullsized":"2024-09-13T17:12:49.224061+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:49.407474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.212446+0000","last_change":"2024-09-13T17:11:49.797828+0000","last_active":"2024-09-13T17:12:49.212446+0000","last_peered":"2024-09-13T17:12:49.212446+0000","last_clean":"2024-09-13T17:12:49.212446+0000","last_became_active":"2024-09-13T17:11:49.797504+0000","last_became_peered":"2024-09-13T17:11:49.797504+0000","last_unstale":"2024-09-13T17:12:49.212446+0000","last_undegraded":"2024-09-13T17:12:49.212446+0000","last_fullsized":"2024-09-13T17:12:49.212446+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:29.677936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.223239+0000","last_change":"2024-09-13T17:11:23.336713+0000","last_active":"2024-09-13T17:12:49.223239+0000","last_peered":"2024-09-13T17:12:49.223239+0000","last_clean":"2024-09-13T17:12:49.223239+0000","last_became_active":"2024-09-13T17:11:23.336431+0000","last_became_peered":"2024-09-13T17:11:23.336431+0000","last_unstale":"2024-09-13T17:12:49.223239+0000","last_undegraded":"2024-09-13T17:12:49.223239+0000","last_fullsized":"2024-09-13T17:12:49.223239+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:52.709483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216726+0000","last_change":"2024-09-13T17:11:23.340385+0000","last_active":"2024-09-13T17:12:49.216726+0000","last_peered":"2024-09-13T17:12:49.216726+0000","last_clean":"2024-09-13T17:12:49.216726+0000","last_became_active":"2024-09-13T17:11:23.340068+0000","last_became_peered":"2024-09-13T17:11:23.340068+0000","last_unstale":"2024-09-13T17:12:49.216726+0000","last_undegraded":"2024-09-13T17:12:49.216726+0000","last_fullsized":"2024-09-13T17:12:49.216726+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:17.795222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216341+0000","last_change":"2024-09-13T17:11:23.329214+0000","last_active":"2024-09-13T17:12:49.216341+0000","last_peered":"2024-09-13T17:12:49.216341+0000","last_clean":"2024-09-13T17:12:49.216341+0000","last_became_active":"2024-09-13T17:11:23.328747+0000","last_became_peered":"2024-09-13T17:11:23.328747+0000","last_unstale":"2024-09-13T17:12:49.216341+0000","last_undegraded":"2024-09-13T17:12:49.216341+0000","last_fullsized":"2024-09-13T17:12:49.216341+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:11.233652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216682+0000","last_change":"2024-09-13T17:11:23.339854+0000","last_active":"2024-09-13T17:12:49.216682+0000","last_peered":"2024-09-13T17:12:49.216682+0000","last_clean":"2024-09-13T17:12:49.216682+0000","last_became_active":"2024-09-13T17:11:23.339565+0000","last_became_peered":"2024-09-13T17:11:23.339565+0000","last_unstale":"2024-09-13T17:12:49.216682+0000","last_undegraded":"2024-09-13T17:12:49.216682+0000","last_fullsized":"2024-09-13T17:12:49.216682+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:37.161135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217407+0000","last_change":"2024-09-13T17:11:23.342562+0000","last_active":"2024-09-13T17:12:49.217407+0000","last_peered":"2024-09-13T17:12:49.217407+0000","last_clean":"2024-09-13T17:12:49.217407+0000","last_became_active":"2024-09-13T17:11:23.342256+0000","last_became_peered":"2024-09-13T17:11:23.342256+0000","last_unstale":"2024-09-13T17:12:49.217407+0000","last_undegraded":"2024-09-13T17:12:49.217407+0000","last_fullsized":"2024-09-13T17:12:49.217407+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:30.788242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.213848+0000","last_change":"2024-09-13T17:11:23.342436+0000","last_active":"2024-09-13T17:12:49.213848+0000","last_peered":"2024-09-13T17:12:49.213848+0000","last_clean":"2024-09-13T17:12:49.213848+0000","last_became_active":"2024-09-13T17:11:23.342157+0000","last_became_peered":"2024-09-13T17:11:23.342157+0000","last_unstale":"2024-09-13T17:12:49.213848+0000","last_undegraded":"2024-09-13T17:12:49.213848+0000","last_fullsized":"2024-09-13T17:12:49.213848+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:56.550875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217284+0000","last_change":"2024-09-13T17:11:23.341660+0000","last_active":"2024-09-13T17:12:49.217284+0000","last_peered":"2024-09-13T17:12:49.217284+0000","last_clean":"2024-09-13T17:12:49.217284+0000","last_became_active":"2024-09-13T17:11:23.341102+0000","last_became_peered":"2024-09-13T17:11:23.341102+0000","last_unstale":"2024-09-13T17:12:49.217284+0000","last_undegraded":"2024-09-13T17:12:49.217284+0000","last_fullsized":"2024-09-13T17:12:49.217284+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:00.546907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216215+0000","last_change":"2024-09-13T17:11:23.338064+0000","last_active":"2024-09-13T17:12:49.216215+0000","last_peered":"2024-09-13T17:12:49.216215+0000","last_clean":"2024-09-13T17:12:49.216215+0000","last_became_active":"2024-09-13T17:11:23.337748+0000","last_became_peered":"2024-09-13T17:11:23.337748+0000","last_unstale":"2024-09-13T17:12:49.216215+0000","last_undegraded":"2024-09-13T17:12:49.216215+0000","last_fullsized":"2024-09-13T17:12:49.216215+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:14.281629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.221628+0000","last_change":"2024-09-13T17:11:23.335684+0000","last_active":"2024-09-13T17:12:49.221628+0000","last_peered":"2024-09-13T17:12:49.221628+0000","last_clean":"2024-09-13T17:12:49.221628+0000","last_became_active":"2024-09-13T17:11:23.335364+0000","last_became_peered":"2024-09-13T17:11:23.335364+0000","last_unstale":"2024-09-13T17:12:49.221628+0000","last_undegraded":"2024-09-13T17:12:49.221628+0000","last_fullsized":"2024-09-13T17:12:49.221628+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:02.288009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.218814+0000","last_change":"2024-09-13T17:11:23.340881+0000","last_active":"2024-09-13T17:12:49.218814+0000","last_peered":"2024-09-13T17:12:49.218814+0000","last_clean":"2024-09-13T17:12:49.218814+0000","last_became_active":"2024-09-13T17:11:23.340575+0000","last_became_peered":"2024-09-13T17:11:23.340575+0000","last_unstale":"2024-09-13T17:12:49.218814+0000","last_undegraded":"2024-09-13T17:12:49.218814+0000","last_fullsized":"2024-09-13T17:12:49.218814+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:40.757703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216251+0000","last_change":"2024-09-13T17:11:23.329039+0000","last_active":"2024-09-13T17:12:49.216251+0000","last_peered":"2024-09-13T17:12:49.216251+0000","last_clean":"2024-09-13T17:12:49.216251+0000","last_became_active":"2024-09-13T17:11:23.328324+0000","last_became_peered":"2024-09-13T17:11:23.328324+0000","last_unstale":"2024-09-13T17:12:49.216251+0000","last_undegraded":"2024-09-13T17:12:49.216251+0000","last_fullsized":"2024-09-13T17:12:49.216251+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:37.882596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.215258+0000","last_change":"2024-09-13T17:11:23.345229+0000","last_active":"2024-09-13T17:12:49.215258+0000","last_peered":"2024-09-13T17:12:49.215258+0000","last_clean":"2024-09-13T17:12:49.215258+0000","last_became_active":"2024-09-13T17:11:23.344883+0000","last_became_peered":"2024-09-13T17:11:23.344883+0000","last_unstale":"2024-09-13T17:12:49.215258+0000","last_undegraded":"2024-09-13T17:12:49.215258+0000","last_fullsized":"2024-09-13T17:12:49.215258+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:47.983382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217881+0000","last_change":"2024-09-13T17:11:23.346338+0000","last_active":"2024-09-13T17:12:49.217881+0000","last_peered":"2024-09-13T17:12:49.217881+0000","last_clean":"2024-09-13T17:12:49.217881+0000","last_became_active":"2024-09-13T17:11:23.344777+0000","last_became_peered":"2024-09-13T17:11:23.344777+0000","last_unstale":"2024-09-13T17:12:49.217881+0000","last_undegraded":"2024-09-13T17:12:49.217881+0000","last_fullsized":"2024-09-13T17:12:49.217881+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:23.650174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.211999+0000","last_change":"2024-09-13T17:11:49.798165+0000","last_active":"2024-09-13T17:12:49.211999+0000","last_peered":"2024-09-13T17:12:49.211999+0000","last_clean":"2024-09-13T17:12:49.211999+0000","last_became_active":"2024-09-13T17:11:49.797753+0000","last_became_peered":"2024-09-13T17:11:49.797753+0000","last_unstale":"2024-09-13T17:12:49.211999+0000","last_undegraded":"2024-09-13T17:12:49.211999+0000","last_fullsized":"2024-09-13T17:12:49.211999+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:51.744236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217600+0000","last_change":"2024-09-13T17:11:23.340478+0000","last_active":"2024-09-13T17:12:49.217600+0000","last_peered":"2024-09-13T17:12:49.217600+0000","last_clean":"2024-09-13T17:12:49.217600+0000","last_became_active":"2024-09-13T17:11:23.339916+0000","last_became_peered":"2024-09-13T17:11:23.339916+0000","last_unstale":"2024-09-13T17:12:49.217600+0000","last_undegraded":"2024-09-13T17:12:49.217600+0000","last_fullsized":"2024-09-13T17:12:49.217600+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:09.477626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.223414+0000","last_change":"2024-09-13T17:11:23.340882+0000","last_active":"2024-09-13T17:12:49.223414+0000","last_peered":"2024-09-13T17:12:49.223414+0000","last_clean":"2024-09-13T17:12:49.223414+0000","last_became_active":"2024-09-13T17:11:23.340413+0000","last_became_peered":"2024-09-13T17:11:23.340413+0000","last_unstale":"2024-09-13T17:12:49.223414+0000","last_undegraded":"2024-09-13T17:12:49.223414+0000","last_fullsized":"2024-09-13T17:12:49.223414+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:49.040015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.216546+0000","last_change":"2024-09-13T17:11:23.345551+0000","last_active":"2024-09-13T17:12:49.216546+0000","last_peered":"2024-09-13T17:12:49.216546+0000","last_clean":"2024-09-13T17:12:49.216546+0000","last_became_active":"2024-09-13T17:11:23.345195+0000","last_became_peered":"2024-09-13T17:11:23.345195+0000","last_unstale":"2024-09-13T17:12:49.216546+0000","last_undegraded":"2024-09-13T17:12:49.216546+0000","last_fullsized":"2024-09-13T17:12:49.216546+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:00.856969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.211550+0000","last_change":"2024-09-13T17:11:49.799090+0000","last_active":"2024-09-13T17:12:49.211550+0000","last_peered":"2024-09-13T17:12:49.211550+0000","last_clean":"2024-09-13T17:12:49.211550+0000","last_became_active":"2024-09-13T17:11:49.798766+0000","last_became_peered":"2024-09-13T17:11:49.798766+0000","last_unstale":"2024-09-13T17:12:49.211550+0000","last_undegraded":"2024-09-13T17:12:49.211550+0000","last_fullsized":"2024-09-13T17:12:49.211550+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:43.946212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.212604+0000","last_change":"2024-09-13T17:11:23.340286+0000","last_active":"2024-09-13T17:12:49.212604+0000","last_peered":"2024-09-13T17:12:49.212604+0000","last_clean":"2024-09-13T17:12:49.212604+0000","last_became_active":"2024-09-13T17:11:23.339756+0000","last_became_peered":"2024-09-13T17:11:23.339756+0000","last_unstale":"2024-09-13T17:12:49.212604+0000","last_undegraded":"2024-09-13T17:12:49.212604+0000","last_fullsized":"2024-09-13T17:12:49.212604+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:00.463087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.215023+0000","last_change":"2024-09-13T17:11:23.339818+0000","last_active":"2024-09-13T17:12:49.215023+0000","last_peered":"2024-09-13T17:12:49.215023+0000","last_clean":"2024-09-13T17:12:49.215023+0000","last_became_active":"2024-09-13T17:11:23.339501+0000","last_became_peered":"2024-09-13T17:11:23.339501+0000","last_unstale":"2024-09-13T17:12:49.215023+0000","last_undegraded":"2024-09-13T17:12:49.215023+0000","last_fullsized":"2024-09-13T17:12:49.215023+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:36.904004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.219322+0000","last_change":"2024-09-13T17:11:23.334388+0000","last_active":"2024-09-13T17:12:49.219322+0000","last_peered":"2024-09-13T17:12:49.219322+0000","last_clean":"2024-09-13T17:12:49.219322+0000","last_became_active":"2024-09-13T17:11:23.333953+0000","last_became_peered":"2024-09-13T17:11:23.333953+0000","last_unstale":"2024-09-13T17:12:49.219322+0000","last_undegraded":"2024-09-13T17:12:49.219322+0000","last_fullsized":"2024-09-13T17:12:49.219322+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:33.929173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.219482+0000","last_change":"2024-09-13T17:11:23.338259+0000","last_active":"2024-09-13T17:12:49.219482+0000","last_peered":"2024-09-13T17:12:49.219482+0000","last_clean":"2024-09-13T17:12:49.219482+0000","last_became_active":"2024-09-13T17:11:23.337979+0000","last_became_peered":"2024-09-13T17:11:23.337979+0000","last_unstale":"2024-09-13T17:12:49.219482+0000","last_undegraded":"2024-09-13T17:12:49.219482+0000","last_fullsized":"2024-09-13T17:12:49.219482+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:55.750255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T17:12:49.217114+0000","last_change":"2024-09-13T17:11:23.337899+0000","last_active":"2024-09-13T17:12:49.217114+0000","last_peered":"2024-09-13T17:12:49.217114+0000","last_clean":"2024-09-13T17:12:49.217114+0000","last_became_active":"2024-09-13T17:11:23.337626+0000","last_became_peered":"2024-09-13T17:11:23.337626+0000","last_unstale":"2024-09-13T17:12:49.217114+0000","last_undegraded":"2024-09-13T17:12:49.217114+0000","last_fullsized":"2024-09-13T17:12:49.217114+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:14.654852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66193,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":512,"num_read_kb":326,"num_write":158,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":198579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285958,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383715,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":1024000,"data_stored":519575,"data_compressed":23656,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:12:35 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.36099999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79700000000000004,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56299999999999994,"15min":0.56799999999999995},"min":{"1min":0.35499999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67900000000000005,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.73999999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:12:35 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60199999999999998,"15min":0.59999999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.748,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.44700000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:12:35 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.41099999999999998,"15min":0.40200000000000002},"min":{"1min":0.28100000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71899999999999997,"5min":0.748,"15min":0.748},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.45600000000000002,"15min":0.45400000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63100000000000001,"5min":1.286,"15min":1.286},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:12:35 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63300000000000001,"15min":0.63500000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.76400000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.61399999999999999,"15min":0.60399999999999998},"min":{"1min":0.52200000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.51500000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:12:35 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.50900000000000001,"15min":0.50700000000000001},"min":{"1min":0.35799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.76100000000000001,"5min":1.109,"15min":1.109},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.48099999999999998,"15min":0.47099999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.434}]},{"osd":6,"last update":"Fri Sep 13 17:12:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56100000000000005,"15min":0.55700000000000005},"min":{"1min":0.45200000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.90900000000000003,"5min":1.214,"15min":1.214},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.44500000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.86099999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.58599999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:12:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63600000000000001,"15min":0.63},"min":{"1min":0.50900000000000001,"5min":0.502,"15min":0.502},"max":{"1min":0.78700000000000003,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.68700000000000006,"15min":0.68300000000000005},"min":{"1min":0.54600000000000004,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88400000000000001,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.64800000000000002}]},{"osd":8,"last update":"Fri Sep 13 17:12:25 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.60599999999999998}]},{"osd":9,"last update":"Fri Sep 13 17:12:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.51800000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95699999999999996,"5min":1.196,"15min":1.196},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.63500000000000001,"15min":0.623},"min":{"1min":0.52000000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.88800000000000001,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.72899999999999998}]},{"osd":10,"last update":"Fri Sep 13 17:12:35 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.72399999999999998,"15min":0.71499999999999997},"min":{"1min":0.58799999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0609999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71899999999999997,"15min":0.71799999999999997},"min":{"1min":0.60599999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.873,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.69499999999999995}]}]},{"osd":10,"up_from":72,"seq":309237645351,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1167360,"data_stored":1168500,"data_compressed":60015,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1597,"internal_metadata":36043203},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:12:23 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.63200000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:12:10 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.41399999999999998,"15min":0.41999999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.57299999999999995,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.45400000000000001,"15min":0.46000000000000002},"min":{"1min":0.25700000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.35099999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:12:10 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.72599999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.39700000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.45300000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:12:10 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.57999999999999996,"15min":0.59299999999999997},"min":{"1min":0.34499999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64700000000000002,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.56899999999999995,"15min":0.58199999999999996},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.63800000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.52400000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:12:10 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.503,"15min":0.50900000000000001},"min":{"1min":0.33300000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.67600000000000005,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.443},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.53700000000000003,"15min":0.54800000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71099999999999997,"5min":0.876,"15min":0.876},"last":0.46899999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:12:10 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.46000000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.82299999999999995,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.64300000000000002,"15min":0.64900000000000002},"min":{"1min":0.442,"5min":0.44,"15min":0.44},"max":{"1min":0.91000000000000003,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.67300000000000004}]},{"osd":6,"last update":"Fri Sep 13 17:12:10 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.64100000000000001,"15min":0.65500000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76500000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.624,"15min":0.63200000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.77300000000000002,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.58399999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:12:52 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.70099999999999996}]},{"osd":8,"last update":"Fri Sep 13 17:12:10 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68300000000000005,"15min":0.68799999999999994},"min":{"1min":0.49099999999999999,"5min":0.442,"15min":0.442},"max":{"1min":0.85199999999999998,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.626},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.71899999999999997,"15min":0.72699999999999998},"min":{"1min":0.50900000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85999999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.71599999999999997}]},{"osd":9,"last update":"Fri Sep 13 17:12:10 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.69999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.88300000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.73999999999999999,"15min":0.755},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90000000000000002,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.746}]},{"osd":11,"last update":"Fri Sep 13 17:12:36 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.70099999999999996,"15min":0.69299999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.69699999999999995,"15min":0.68500000000000005},"min":{"1min":0.56799999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.66500000000000004}]}]},{"osd":9,"up_from":67,"seq":287762808875,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":1040384,"data_stored":523325,"data_compressed":23656,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1597,"internal_metadata":31848899},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.38800000000000001,"15min":0.40400000000000003},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.58799999999999997,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.40799999999999997,"15min":0.42199999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.52800000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.35999999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.432,"5min":0.374,"15min":0.374},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55100000000000005,"15min":0.56499999999999995},"min":{"1min":0.35499999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70999999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.52100000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57899999999999996,"15min":0.60299999999999998},"min":{"1min":0.38400000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80200000000000005,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.377},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56699999999999995,"15min":0.58699999999999997},"min":{"1min":0.42499999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.66400000000000003,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.42399999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.46600000000000003,"15min":0.49399999999999999},"min":{"1min":0.28599999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54000000000000004,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.316},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.46600000000000003,"15min":0.504},"min":{"1min":0.27300000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.52200000000000002,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.437}]},{"osd":4,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56899999999999995,"15min":0.58099999999999996},"min":{"1min":0.46200000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.70499999999999996,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61899999999999999,"15min":0.63800000000000001},"min":{"1min":0.39800000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.80000000000000004,"5min":1.26,"15min":1.26},"last":0.54300000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.621,"15min":0.65300000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.70499999999999996,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.624,"15min":0.66100000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.74399999999999999,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.48299999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.49299999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.66200000000000003,"15min":0.69199999999999995},"min":{"1min":0.45100000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.77100000000000002,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.65900000000000003,"15min":0.69199999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.73599999999999999,"5min":1.018,"15min":1.018},"last":0.628}]},{"osd":8,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.65900000000000003,"15min":0.68300000000000005},"min":{"1min":0.45700000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.76900000000000002,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.67900000000000005,"15min":0.71099999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78200000000000003,"5min":1.228,"15min":1.228},"last":0.49299999999999999}]},{"osd":10,"last update":"Fri Sep 13 17:12:15 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.67300000000000004,"15min":0.68300000000000005},"min":{"1min":0.49199999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.77300000000000002,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.71199999999999997,"15min":0.72399999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.85799999999999998,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.60899999999999999}]},{"osd":11,"last update":"Fri Sep 13 17:12:29 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.60099999999999998}]}]},{"osd":8,"up_from":59,"seq":253403070513,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":519149,"data_compressed":23656,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:12:24 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.34000000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.442},{"interface":"front","average":{"1min":0.505,"5min":0.52700000000000002,"15min":0.53500000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.46800000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:12:24 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.41099999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.55100000000000005,"15min":0.53700000000000003},"min":{"1min":0.39900000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.58899999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:12:24 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.42199999999999999,"15min":0.41899999999999998},"min":{"1min":0.314,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.60099999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.496},{"interface":"front","average":{"1min":0.433,"5min":0.44,"15min":0.438},"min":{"1min":0.28000000000000003,"5min":0.247,"15min":0.247},"max":{"1min":0.63600000000000001,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.54500000000000004}]},{"osd":3,"last update":"Fri Sep 13 17:12:24 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.38900000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.63300000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72699999999999998,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.63200000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:12:24 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.373,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.60199999999999998,"15min":0.59399999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.72999999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:12:24 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.51200000000000001,"15min":0.51600000000000001},"min":{"1min":0.35099999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.753,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.53700000000000003},"min":{"1min":0.35199999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.78600000000000003,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.74399999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:12:24 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45400000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63700000000000001,"15min":0.64700000000000002},"min":{"1min":0.46400000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.85999999999999999,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.76800000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:12:24 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65200000000000002,"15min":0.64800000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.93700000000000006,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.66800000000000004,"15min":0.66500000000000004},"min":{"1min":0.47699999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94999999999999996,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.93999999999999995}]},{"osd":9,"last update":"Fri Sep 13 17:12:53 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.67200000000000004,"15min":0.66800000000000004},"min":{"1min":0.51900000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86499999999999999,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.67600000000000005,"15min":0.67500000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.80800000000000005}]},{"osd":10,"last update":"Fri Sep 13 17:12:10 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.68600000000000005,"15min":0.67900000000000005},"min":{"1min":0.57499999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91900000000000004,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.70599999999999996,"15min":0.69799999999999995},"min":{"1min":0.59699999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.86799999999999999}]},{"osd":11,"last update":"Fri Sep 13 17:12:24 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.89300000000000002}]}]},{"osd":7,"up_from":51,"seq":219043332149,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1081344,"data_stored":1114381,"data_compressed":60015,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1587,"internal_metadata":27654605},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.39700000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.66200000000000003,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.35799999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.52500000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.379,"15min":0.36099999999999999},"min":{"1min":0.27100000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.497,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38100000000000001,"15min":0.35499999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.52800000000000002,"5min":0.623,"15min":0.623},"last":0.52000000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55100000000000005,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70399999999999996,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54700000000000004,"15min":0.51800000000000002},"min":{"1min":0.38300000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.79700000000000004,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.73299999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53100000000000003,"15min":0.50900000000000001},"min":{"1min":0.35199999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72299999999999998,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.628},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.54900000000000004,"15min":0.53800000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69699999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.68300000000000005}]},{"osd":4,"last update":"Fri Sep 13 17:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.47799999999999998,"15min":0.46200000000000002},"min":{"1min":0.33600000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.60699999999999998,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45100000000000001,"15min":0.442},"min":{"1min":0.27200000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.61299999999999999,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.48399999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.59999999999999998,"15min":0.57199999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.81899999999999995,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58799999999999997,"15min":0.57599999999999996},"min":{"1min":0.42899999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.75900000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.69499999999999995}]},{"osd":6,"last update":"Fri Sep 13 17:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59999999999999998,"15min":0.58199999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.75600000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61499999999999999,"15min":0.59299999999999997},"min":{"1min":0.44900000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76000000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.59299999999999997}]},{"osd":8,"last update":"Fri Sep 13 17:12:32 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63600000000000001,"15min":0.628},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.76600000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.754},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.66400000000000003,"15min":0.64600000000000002},"min":{"1min":0.50600000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.85099999999999998,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.71699999999999997}]},{"osd":9,"last update":"Fri Sep 13 17:12:55 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.67200000000000004,"15min":0.68400000000000005},"min":{"1min":0.437,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84599999999999997,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.48399999999999999,"5min":0.438,"15min":0.438},"max":{"1min":0.80600000000000005,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.80900000000000005}]},{"osd":10,"last update":"Fri Sep 13 17:12:13 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69899999999999995,"15min":0.70299999999999996},"min":{"1min":0.46400000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.65500000000000003,"15min":0.65300000000000002},"min":{"1min":0.42799999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.78500000000000003}]},{"osd":11,"last update":"Fri Sep 13 17:12:27 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.83699999999999997}]}]},{"osd":6,"up_from":46,"seq":197568495673,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":514405,"data_compressed":23656,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:12:44 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.34699999999999998,"15min":0.33700000000000002},"min":{"1min":0.25700000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.45500000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.377,"15min":0.371},"min":{"1min":0.28100000000000003,"5min":0.251,"15min":0.251},"max":{"1min":0.53900000000000003,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.255}]},{"osd":1,"last update":"Fri Sep 13 17:12:44 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52200000000000002,"15min":0.50900000000000001},"min":{"1min":0.36199999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.68600000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52600000000000002,"15min":0.51000000000000001},"min":{"1min":0.40899999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71299999999999997,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.54300000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:12:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.36599999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.69499999999999995,"5min":1.095,"15min":1.095},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54500000000000004,"15min":0.52700000000000002},"min":{"1min":0.35899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70999999999999996,"5min":0.877,"15min":0.877},"last":0.47299999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:12:44 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.41499999999999998,"15min":0.41299999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.51900000000000002,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.313},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42099999999999999,"15min":0.41299999999999998},"min":{"1min":0.29099999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.63500000000000001,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.30099999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:12:44 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.52100000000000002,"15min":0.505},"min":{"1min":0.33800000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55300000000000005,"15min":0.53100000000000003},"min":{"1min":0.39400000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73999999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.53100000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:12:44 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58699999999999997,"15min":0.58599999999999997},"min":{"1min":0.41599999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77500000000000002,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58799999999999997,"15min":0.59999999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80200000000000005,"5min":1.131,"15min":1.131},"last":0.51700000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:12:03 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.40999999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.80000000000000004,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60299999999999998,"15min":0.59699999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.72399999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.67200000000000004}]},{"osd":8,"last update":"Fri Sep 13 17:12:28 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.626,"15min":0.628},"min":{"1min":0.48199999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.82199999999999995,"5min":0.874,"15min":0.874},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.65300000000000002,"15min":0.65000000000000002},"min":{"1min":0.54100000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.79900000000000004,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.435}]},{"osd":9,"last update":"Fri Sep 13 17:12:53 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.59199999999999997,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.375},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.626,"15min":0.65400000000000003},"min":{"1min":0.38200000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78000000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.34300000000000003}]},{"osd":10,"last update":"Fri Sep 13 17:12:14 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.872,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.68600000000000005,"15min":0.68200000000000005},"min":{"1min":0.58099999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.88500000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.623}]},{"osd":11,"last update":"Fri Sep 13 17:12:28 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.44},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.60999999999999999}]}]},{"osd":5,"up_from":38,"seq":163208757310,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32184,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712968,"statfs":{"total":95995035648,"available":95962079232,"internally_reserved":0,"allocated":1089536,"data_stored":1110268,"data_compressed":60015,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:12:22 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48699999999999999,"15min":0.47699999999999998},"min":{"1min":0.34000000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.72799999999999998,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.495,"15min":0.48299999999999998},"min":{"1min":0.40699999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68400000000000005,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.433}]},{"osd":1,"last update":"Fri Sep 13 17:12:22 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56499999999999995,"15min":0.54900000000000004},"min":{"1min":0.38,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55300000000000005,"15min":0.54600000000000004},"min":{"1min":0.40300000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.70099999999999996,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.64500000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:12:22 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.38600000000000001,"15min":0.374},"min":{"1min":0.28599999999999998,"5min":0.222,"15min":0.222},"max":{"1min":0.56699999999999995,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.39000000000000001,"15min":0.376},"min":{"1min":0.30599999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.61599999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.378}]},{"osd":3,"last update":"Fri Sep 13 17:12:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.50900000000000001,"15min":0.502},"min":{"1min":0.36099999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70099999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.495},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.40500000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.48099999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:12:22 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56399999999999995,"15min":0.55900000000000005},"min":{"1min":0.36599999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72199999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.58599999999999997,"15min":0.56599999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.69299999999999995}]},{"osd":6,"last update":"Fri Sep 13 17:12:41 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.76300000000000001,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56899999999999995,"15min":0.56299999999999994},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.52000000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:12:59 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61099999999999999,"15min":0.60999999999999999},"min":{"1min":0.40100000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.86299999999999999,"5min":0.874,"15min":0.874},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.625,"15min":0.60999999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.74099999999999999}]},{"osd":8,"last update":"Fri Sep 13 17:12:30 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.53000000000000003,"15min":0.53200000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.80700000000000005,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.41899999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.63100000000000001}]},{"osd":9,"last update":"Fri Sep 13 17:12:51 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.64200000000000002,"15min":0.626},"min":{"1min":0.51000000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.63900000000000001,"15min":0.621},"min":{"1min":0.52200000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56100000000000005}]},{"osd":10,"last update":"Fri Sep 13 17:12:12 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.64800000000000002,"15min":0.63700000000000001},"min":{"1min":0.60199999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.64500000000000002,"15min":0.63300000000000001},"min":{"1min":0.58899999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.70999999999999996}]}]},{"osd":4,"up_from":33,"seq":141733920836,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":1028096,"data_stored":519316,"data_compressed":23656,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:12:50 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.624},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.71499999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:12:59 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.38300000000000001,"15min":0.36499999999999999},"min":{"1min":0.28999999999999998,"5min":0.221,"15min":0.221},"max":{"1min":0.68899999999999995,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40699999999999997,"15min":0.39500000000000002},"min":{"1min":0.30299999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.61399999999999999,"5min":2.52,"15min":2.52},"last":0.33500000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:12:59 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.78000000000000003,"15min":0.63},"min":{"1min":0.41699999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.84299999999999997,"5min":15.401,"15min":15.401},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.56999999999999995,"15min":0.53200000000000003},"min":{"1min":0.40400000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83199999999999996,"5min":1.335,"15min":1.335},"last":0.54500000000000004}]},{"osd":3,"last update":"Fri Sep 13 17:12:59 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55200000000000005,"15min":0.55400000000000005},"min":{"1min":0.372,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.77800000000000002,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.747,"15min":0.61899999999999999},"min":{"1min":0.41699999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88400000000000001,"5min":15.425000000000001,"15min":15.425000000000001},"last":0.66000000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:12:22 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.60999999999999999,"15min":0.57599999999999996},"min":{"1min":0.374,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":3.0790000000000002,"5min":3.0790000000000002,"15min":3.0790000000000002},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.61099999999999999,"15min":0.56899999999999995},"min":{"1min":0.441,"5min":0.376,"15min":0.376},"max":{"1min":4.0810000000000004,"5min":4.0810000000000004,"15min":4.0810000000000004},"last":0.63400000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:12:46 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55700000000000005,"15min":0.52100000000000002},"min":{"1min":0.42799999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.65700000000000003,"5min":2.6469999999999998,"15min":2.6469999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58699999999999997,"15min":0.56000000000000005},"min":{"1min":0.45400000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85799999999999998,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.72599999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:13:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52000000000000002,"15min":0.497},"min":{"1min":0.45500000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.62,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53300000000000003,"15min":0.495},"min":{"1min":0.40300000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69799999999999995,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.46700000000000003}]},{"osd":8,"last update":"Fri Sep 13 17:12:28 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65700000000000003,"15min":0.64100000000000001},"min":{"1min":0.439,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77500000000000002,"5min":2.577,"15min":2.577},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65600000000000003,"15min":0.64600000000000002},"min":{"1min":0.47999999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.81699999999999995,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.58499999999999996}]},{"osd":9,"last update":"Fri Sep 13 17:12:50 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":1.2509999999999999,"15min":1.4930000000000001},"min":{"1min":0.54600000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.84499999999999997,"5min":15.448,"15min":15.448},"last":0.755},{"interface":"front","average":{"1min":0.68700000000000006,"5min":1.2150000000000001,"15min":1.456},"min":{"1min":0.52000000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.82099999999999995,"5min":15.385,"15min":15.385},"last":0.67700000000000005}]},{"osd":10,"last update":"Fri Sep 13 17:12:12 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.64700000000000002,"15min":0.63100000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":3.1259999999999999,"5min":3.1259999999999999,"15min":3.1259999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68700000000000006,"15min":0.68400000000000005},"min":{"1min":0.42599999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":2.3439999999999999,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.68899999999999995}]},{"osd":11,"last update":"Fri Sep 13 17:12:22 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.2650000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":3.165,"5min":3.165,"15min":3.165},"last":0.64400000000000002}]}]},{"osd":3,"up_from":25,"seq":107374182471,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":513995,"data_compressed":23656,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:12:37 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.34999999999999998,"15min":0.32000000000000001},"min":{"1min":0.25900000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.53600000000000003,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.35599999999999998,"15min":0.32600000000000001},"min":{"1min":0.27100000000000002,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.51800000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.36099999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:12:37 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54000000000000004,"15min":0.499},"min":{"1min":0.35799999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73099999999999998,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.53400000000000003,"15min":0.48999999999999999},"min":{"1min":0.45500000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.47799999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:12:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.53600000000000003,"15min":0.503},"min":{"1min":0.39900000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.80100000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55400000000000005,"15min":0.51200000000000001},"min":{"1min":0.45400000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.76600000000000001,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.58999999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:12:56 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55800000000000005,"15min":0.52400000000000002},"min":{"1min":0.35699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.749,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56399999999999995,"15min":0.51800000000000002},"min":{"1min":0.39900000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.46300000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:12:20 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56999999999999995,"15min":0.55800000000000005},"min":{"1min":0.44700000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89900000000000002,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56000000000000005,"15min":0.56100000000000005},"min":{"1min":0.36899999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.71699999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.63400000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:12:44 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.45000000000000001,"15min":0.44500000000000001},"min":{"1min":0.29599999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.59799999999999998,"5min":0.746,"15min":0.746},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.46800000000000003,"15min":0.44600000000000001},"min":{"1min":0.35599999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.88200000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.39300000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:12:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81000000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60499999999999998,"15min":0.59699999999999998},"min":{"1min":0.42299999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.44800000000000001}]},{"osd":8,"last update":"Fri Sep 13 17:10:26 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66400000000000003}]},{"osd":9,"last update":"Fri Sep 13 17:12:51 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.60399999999999998,"15min":0.628},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.83799999999999997,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.60999999999999999,"15min":0.64400000000000002},"min":{"1min":0.41099999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71499999999999997,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.42799999999999999}]},{"osd":10,"last update":"Fri Sep 13 17:12:14 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.67500000000000004,"15min":0.68300000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.495},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.66100000000000003,"15min":0.67100000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.5}]},{"osd":11,"last update":"Fri Sep 13 17:12:28 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.67900000000000005}]}]},{"osd":2,"up_from":18,"seq":77309411405,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1101824,"data_stored":577441,"data_compressed":23656,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:12:10 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.71799999999999997,"15min":0.72399999999999998},"min":{"1min":0.33000000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.72699999999999998,"5min":19.158999999999999,"15min":19.158999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.499,"5min":0.48299999999999998,"15min":0.46899999999999997},"min":{"1min":0.34999999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.75800000000000001,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.69399999999999995}]},{"osd":1,"last update":"Fri Sep 13 17:12:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.52300000000000002,"15min":0.48199999999999998},"min":{"1min":0.32900000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.53500000000000003,"15min":0.48099999999999998},"min":{"1min":0.42999999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.68000000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:12:36 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.53700000000000003,"15min":0.50600000000000001},"min":{"1min":0.377,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72599999999999998,"5min":0.75,"15min":0.75},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53000000000000003,"15min":0.50700000000000001},"min":{"1min":0.39000000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.752}]},{"osd":4,"last update":"Fri Sep 13 17:12:23 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.48999999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:12:14 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.42599999999999999,"15min":0.40000000000000002},"min":{"1min":0.29199999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.436,"15min":0.40500000000000003},"min":{"1min":0.372,"5min":0.222,"15min":0.222},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.59699999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:12:38 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.56100000000000005,"15min":0.54500000000000004},"min":{"1min":0.39200000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.70399999999999996,"15min":0.58899999999999997},"min":{"1min":0.38400000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94299999999999995,"5min":19.276,"15min":19.276},"last":0.70799999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:12:27 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.55600000000000005}]},{"osd":8,"last update":"Fri Sep 13 17:12:27 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.56999999999999995,"15min":0.54600000000000004},"min":{"1min":0.43099999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.625},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.59299999999999997,"15min":0.57099999999999995},"min":{"1min":0.45000000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.71999999999999997}]},{"osd":9,"last update":"Fri Sep 13 17:12:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.65800000000000003,"15min":0.64100000000000001},"min":{"1min":0.48499999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.92700000000000005,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":1.135,"15min":1.341},"min":{"1min":0.46600000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.88,"5min":19.210999999999999,"15min":19.210999999999999},"last":0.73199999999999998}]},{"osd":10,"last update":"Fri Sep 13 17:12:14 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.67500000000000004,"15min":0.66300000000000003},"min":{"1min":0.53700000000000003,"5min":0.495,"15min":0.495},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.82099999999999995,"5min":1.4399999999999999,"15min":1.5429999999999999},"min":{"1min":0.61799999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0860000000000001,"5min":19.242000000000001,"15min":19.242000000000001},"last":0.76300000000000001}]},{"osd":11,"last update":"Fri Sep 13 17:12:23 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.81699999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":1085440,"data_stored":576602,"data_compressed":23656,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:12:58 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.49299999999999999,"15min":0.46700000000000003},"min":{"1min":0.33300000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.68000000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.495,"15min":0.46899999999999997},"min":{"1min":0.28999999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.67400000000000004,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.39600000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:12:10 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.55400000000000005,"15min":0.51200000000000001},"min":{"1min":0.42399999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.54700000000000004,"15min":0.51100000000000001},"min":{"1min":0.436,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.60299999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:12:40 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53100000000000003,"15min":0.52200000000000002},"min":{"1min":0.437,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.69799999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55100000000000005,"15min":0.52900000000000003},"min":{"1min":0.30199999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71599999999999997,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.47199999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:10:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.39500000000000002,"15min":0.377},"min":{"1min":0.29199999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.62},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.38100000000000001,"15min":0.36299999999999999},"min":{"1min":0.26600000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:12:21 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.55800000000000005,"15min":0.52300000000000002},"min":{"1min":0.53000000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.84799999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.55700000000000005,"15min":0.51200000000000001},"min":{"1min":0.42899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.65900000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:12:40 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55300000000000005,"15min":0.52800000000000002},"min":{"1min":0.45100000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.70199999999999996,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59599999999999997,"15min":0.57599999999999996},"min":{"1min":0.41299999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80900000000000005,"5min":0.88,"15min":0.88},"last":0.32900000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:12:05 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.50900000000000001,"15min":0.48299999999999998},"min":{"1min":0.36499999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.501,"15min":0.48699999999999999},"min":{"1min":0.35099999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.62}]},{"osd":8,"last update":"Fri Sep 13 17:12:31 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63300000000000001,"15min":0.61899999999999999},"min":{"1min":0.52700000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81999999999999995,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.67900000000000005,"15min":0.66500000000000004},"min":{"1min":0.54400000000000004,"5min":0.434,"15min":0.434},"max":{"1min":0.88200000000000001,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.59499999999999997}]},{"osd":9,"last update":"Fri Sep 13 17:12:51 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.63300000000000001,"15min":0.64100000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72199999999999998,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.68500000000000005,"15min":0.69799999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.85499999999999998,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.41199999999999998}]},{"osd":10,"last update":"Fri Sep 13 17:12:14 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.73199999999999998,"15min":0.75},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85199999999999998,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.69099999999999995,"15min":0.70699999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86399999999999999,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.45400000000000001}]},{"osd":11,"last update":"Fri Sep 13 17:12:24 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.63600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738454,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":1036288,"data_stored":515520,"data_compressed":23656,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.505,"15min":0.47699999999999998},"min":{"1min":0.36199999999999999,"5min":0.27900000000000003,"15min":0.27300000000000002},"max":{"1min":0.70699999999999996,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52300000000000002,"15min":0.49099999999999999},"min":{"1min":0.34599999999999997,"5min":0.28499999999999998,"15min":0.245},"max":{"1min":0.68799999999999994,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:12:09 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52700000000000002,"15min":0.50700000000000001},"min":{"1min":0.40100000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.69399999999999995,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.441},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53900000000000003,"15min":0.51000000000000001},"min":{"1min":0.38800000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.67600000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.52100000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:12:24 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.35499999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:12:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52900000000000003,"15min":0.49099999999999999},"min":{"1min":0.39100000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72699999999999998,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.54900000000000004,"15min":0.51200000000000001},"min":{"1min":0.442,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77500000000000002,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.50900000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52100000000000002,"15min":0.50900000000000001},"min":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82399999999999995,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.54800000000000004,"15min":0.53000000000000003},"min":{"1min":0.42799999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80500000000000005,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.624}]},{"osd":6,"last update":"Fri Sep 13 17:12:42 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.436,"15min":0.41899999999999998},"min":{"1min":0.312,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.57499999999999996,"5min":0.754,"15min":0.754},"last":0.318},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.442,"15min":0.42799999999999999},"min":{"1min":0.29199999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.628,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.38300000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:12:27 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.70899999999999996}]},{"osd":8,"last update":"Fri Sep 13 17:12:34 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.437,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.77000000000000002,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.497},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.63900000000000001,"15min":0.65400000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.84299999999999997,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.61399999999999999}]},{"osd":9,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.58999999999999997,"15min":0.626},"min":{"1min":0.376,"5min":0.25,"15min":0.25},"max":{"1min":0.748,"5min":0.88,"15min":0.88},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.58899999999999997,"15min":0.621},"min":{"1min":0.374,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.81100000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.42099999999999999}]},{"osd":10,"last update":"Fri Sep 13 17:12:15 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.68400000000000005,"15min":0.69399999999999995},"min":{"1min":0.49199999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81000000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.67900000000000005,"15min":0.68999999999999995},"min":{"1min":0.46999999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84899999999999998,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.59599999999999997}]},{"osd":11,"last update":"Fri Sep 13 17:12:36 2024","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":0.78000000000000003,"15min":0.70399999999999996},"min":{"1min":0.54600000000000004,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":14.611000000000001,"5min":14.611000000000001,"15min":14.611000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.628,"15min":0.627},"min":{"1min":0.50700000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.82999999999999996,"5min":0.874,"15min":0.874},"last":0.56399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34721,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34721,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34721,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":63817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:13:12.348 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-13T17:13:12.348 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T17:13:12.348 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-13T17:13:12.348 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-13T17:13:12.547 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:13:13.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:13 smithi149 ceph-mon[35496]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:13:13.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:13 smithi149 ceph-mon[35496]: pgmap v335: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T17:13:13.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:13 smithi118 ceph-mon[34374]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:13:13.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:13 smithi118 ceph-mon[34374]: pgmap v335: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T17:13:13.693 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:13 smithi087 ceph-mon[30934]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:13:13.693 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:13 smithi087 ceph-mon[30934]: pgmap v335: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T17:13:14.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.255+0000 7f0873790640 1 -- 172.21.15.87:0/1190930309 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f086c100990 msgr2=0x7f086c1049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:14.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.255+0000 7f0873790640 1 --2- 172.21.15.87:0/1190930309 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f086c100990 0x7f086c1049e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f085c009930 tx=0x7f085c02a420 comp rx=0 tx=0).stop 2024-09-13T17:13:14.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.255+0000 7f0873790640 1 -- 172.21.15.87:0/1190930309 shutdown_connections 2024-09-13T17:13:14.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.255+0000 7f0873790640 1 --2- 172.21.15.87:0/1190930309 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f086c105110 0x7f086c10cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.255+0000 7f0873790640 1 --2- 172.21.15.87:0/1190930309 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f086c100990 0x7f086c1049e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.255+0000 7f0873790640 1 --2- 172.21.15.87:0/1190930309 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f086c0fffe0 0x7f086c1003c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.255+0000 7f0873790640 1 -- 172.21.15.87:0/1190930309 >> 172.21.15.87:0/1190930309 conn(0x7f086c0fbae0 msgr2=0x7f086c0fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:14.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.256+0000 7f0873790640 1 -- 172.21.15.87:0/1190930309 shutdown_connections 2024-09-13T17:13:14.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.256+0000 7f0873790640 1 -- 172.21.15.87:0/1190930309 wait complete. 2024-09-13T17:13:14.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.256+0000 7f0873790640 1 Processor -- start 2024-09-13T17:13:14.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.256+0000 7f0873790640 1 -- start start 2024-09-13T17:13:14.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.256+0000 7f0873790640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f086c0fffe0 0x7f086c0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:14.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.256+0000 7f0873790640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f086c100990 0x7f086c072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:14.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.256+0000 7f0873790640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f086c105110 0x7f086c073230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:14.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.256+0000 7f0873790640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c1a4650 con 0x7f086c105110 2024-09-13T17:13:14.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.256+0000 7f0873790640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c1a47c0 con 0x7f086c100990 2024-09-13T17:13:14.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.256+0000 7f0873790640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c1a4980 con 0x7f086c0fffe0 2024-09-13T17:13:14.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.257+0000 7f0871d2d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f086c105110 0x7f086c073230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:14.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.257+0000 7f0871d2d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f086c105110 0x7f086c073230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43144/0 (socket says 172.21.15.87:43144) 2024-09-13T17:13:14.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.257+0000 7f0871d2d640 1 -- 172.21.15.87:0/2192379572 learned_addr learned my addr 172.21.15.87:0/2192379572 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:14.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.257+0000 7f0870d2b640 1 --2- 172.21.15.87:0/2192379572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f086c100990 0x7f086c072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:14.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.257+0000 7f087152c640 1 --2- 172.21.15.87:0/2192379572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f086c0fffe0 0x7f086c0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:14.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.257+0000 7f0871d2d640 1 -- 172.21.15.87:0/2192379572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f086c0fffe0 msgr2=0x7f086c0727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:14.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.257+0000 7f0871d2d640 1 --2- 172.21.15.87:0/2192379572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f086c0fffe0 0x7f086c0727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.257+0000 7f0871d2d640 1 -- 172.21.15.87:0/2192379572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f086c100990 msgr2=0x7f086c072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:14.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.257+0000 7f0871d2d640 1 --2- 172.21.15.87:0/2192379572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f086c100990 0x7f086c072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.257+0000 7f0871d2d640 1 -- 172.21.15.87:0/2192379572 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f085c009560 con 0x7f086c105110 2024-09-13T17:13:14.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.257+0000 7f0871d2d640 1 --2- 172.21.15.87:0/2192379572 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f086c105110 0x7f086c073230 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f086400cad0 tx=0x7f086400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:14.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.257+0000 7f08627fc640 1 -- 172.21.15.87:0/2192379572 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086400ae20 con 0x7f086c105110 2024-09-13T17:13:14.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.257+0000 7f08627fc640 1 -- 172.21.15.87:0/2192379572 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0864005020 con 0x7f086c105110 2024-09-13T17:13:14.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.257+0000 7f0873790640 1 -- 172.21.15.87:0/2192379572 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f086c1a4c60 con 0x7f086c105110 2024-09-13T17:13:14.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.257+0000 7f08627fc640 1 -- 172.21.15.87:0/2192379572 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086400f690 con 0x7f086c105110 2024-09-13T17:13:14.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.257+0000 7f0873790640 1 -- 172.21.15.87:0/2192379572 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f086c1a5130 con 0x7f086c105110 2024-09-13T17:13:14.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.258+0000 7f0873790640 1 -- 172.21.15.87:0/2192379572 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f086c1014c0 con 0x7f086c105110 2024-09-13T17:13:14.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.259+0000 7f08627fc640 1 -- 172.21.15.87:0/2192379572 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f0864005190 con 0x7f086c105110 2024-09-13T17:13:14.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.260+0000 7f08627fc640 1 --2- 172.21.15.87:0/2192379572 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f08580a1110 0x7f08580a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:14.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.260+0000 7f087152c640 1 --2- 172.21.15.87:0/2192379572 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f08580a1110 0x7f08580a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:14.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.260+0000 7f08627fc640 1 -- 172.21.15.87:0/2192379572 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f08640ccce0 con 0x7f086c105110 2024-09-13T17:13:14.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.261+0000 7f087152c640 1 --2- 172.21.15.87:0/2192379572 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f08580a1110 0x7f08580a35d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f086800bbe0 tx=0x7f086800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:14.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.264+0000 7f08627fc640 1 -- 172.21.15.87:0/2192379572 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0864095ff0 con 0x7f086c105110 2024-09-13T17:13:14.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.463+0000 7f0873790640 1 -- 172.21.15.87:0/2192379572 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f086c1003c0 con 0x7f086c105110 2024-09-13T17:13:14.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.463+0000 7f08627fc640 1 -- 172.21.15.87:0/2192379572 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f086401d080 con 0x7f086c105110 2024-09-13T17:13:14.465 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:13:14.465 INFO:teuthology.orchestra.run.smithi087.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T17:13:14.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.465+0000 7f0873790640 1 -- 172.21.15.87:0/2192379572 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f08580a1110 msgr2=0x7f08580a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:14.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.465+0000 7f0873790640 1 --2- 172.21.15.87:0/2192379572 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f08580a1110 0x7f08580a35d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f086800bbe0 tx=0x7f086800b390 comp rx=0 tx=0).stop 2024-09-13T17:13:14.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.465+0000 7f0873790640 1 -- 172.21.15.87:0/2192379572 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f086c105110 msgr2=0x7f086c073230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:14.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.465+0000 7f0873790640 1 --2- 172.21.15.87:0/2192379572 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f086c105110 0x7f086c073230 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f086400cad0 tx=0x7f086400cf90 comp rx=0 tx=0).stop 2024-09-13T17:13:14.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.466+0000 7f0873790640 1 -- 172.21.15.87:0/2192379572 shutdown_connections 2024-09-13T17:13:14.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.466+0000 7f0873790640 1 --2- 172.21.15.87:0/2192379572 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f08580a1110 0x7f08580a35d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.466+0000 7f0873790640 1 --2- 172.21.15.87:0/2192379572 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f086c105110 0x7f086c073230 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.466+0000 7f0873790640 1 --2- 172.21.15.87:0/2192379572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f086c100990 0x7f086c072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.466+0000 7f0873790640 1 --2- 172.21.15.87:0/2192379572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f086c0fffe0 0x7f086c0727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:14.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.466+0000 7f0873790640 1 -- 172.21.15.87:0/2192379572 >> 172.21.15.87:0/2192379572 conn(0x7f086c0fbae0 msgr2=0x7f086c0fcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:14.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.466+0000 7f0873790640 1 -- 172.21.15.87:0/2192379572 shutdown_connections 2024-09-13T17:13:14.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:14.466+0000 7f0873790640 1 -- 172.21.15.87:0/2192379572 wait complete. 2024-09-13T17:13:15.096 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-13T17:13:15.096 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:13:15.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.195+0000 7f00e0f17640 1 -- 172.21.15.87:0/1698532704 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d402f310 con 0x7f00dc105b50 2024-09-13T17:13:15.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.196+0000 7f00e417d640 1 -- 172.21.15.87:0/1698532704 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00dc105b50 msgr2=0x7f00dc107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:15.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.196+0000 7f00e417d640 1 --2- 172.21.15.87:0/1698532704 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00dc105b50 0x7f00dc107f40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009ca0 tx=0x7f00d402a8c0 comp rx=0 tx=0).stop 2024-09-13T17:13:15.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.196+0000 7f00e417d640 1 -- 172.21.15.87:0/1698532704 shutdown_connections 2024-09-13T17:13:15.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.196+0000 7f00e417d640 1 --2- 172.21.15.87:0/1698532704 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00dc105b50 0x7f00dc107f40 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:15.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.196+0000 7f00e417d640 1 --2- 172.21.15.87:0/1698532704 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00dc103220 0x7f00dc105610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:15.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.196+0000 7f00e417d640 1 --2- 172.21.15.87:0/1698532704 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00dc1008f0 0x7f00dc102ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:15.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.196+0000 7f00e417d640 1 -- 172.21.15.87:0/1698532704 >> 172.21.15.87:0/1698532704 conn(0x7f00dc0fa430 msgr2=0x7f00dc0fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:15.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.196+0000 7f00e417d640 1 -- 172.21.15.87:0/1698532704 shutdown_connections 2024-09-13T17:13:15.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.196+0000 7f00e417d640 1 -- 172.21.15.87:0/1698532704 wait complete. 2024-09-13T17:13:15.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.197+0000 7f00e417d640 1 Processor -- start 2024-09-13T17:13:15.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.197+0000 7f00e417d640 1 -- start start 2024-09-13T17:13:15.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.197+0000 7f00e417d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00dc1008f0 0x7f00dc195f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:15.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.197+0000 7f00e417d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00dc103220 0x7f00dc1964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:15.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.197+0000 7f00e417d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00dc105b50 0x7f00dc19d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:15.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.197+0000 7f00e417d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc19da80 con 0x7f00dc103220 2024-09-13T17:13:15.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.197+0000 7f00e417d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc19dbf0 con 0x7f00dc1008f0 2024-09-13T17:13:15.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.197+0000 7f00e417d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc19ddb0 con 0x7f00dc105b50 2024-09-13T17:13:15.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.197+0000 7f00e1718640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00dc103220 0x7f00dc1964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:15.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.197+0000 7f00e1718640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00dc103220 0x7f00dc1964d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43150/0 (socket says 172.21.15.87:43150) 2024-09-13T17:13:15.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.197+0000 7f00e1718640 1 -- 172.21.15.87:0/1140505101 learned_addr learned my addr 172.21.15.87:0/1140505101 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:15.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.197+0000 7f00e1f19640 1 --2- 172.21.15.87:0/1140505101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00dc1008f0 0x7f00dc195f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:15.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.197+0000 7f00e1718640 1 -- 172.21.15.87:0/1140505101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00dc105b50 msgr2=0x7f00dc19d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:15.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.197+0000 7f00e1718640 1 --2- 172.21.15.87:0/1140505101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00dc105b50 0x7f00dc19d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:15.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.197+0000 7f00e1718640 1 -- 172.21.15.87:0/1140505101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00dc1008f0 msgr2=0x7f00dc195f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:15.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.197+0000 7f00e1718640 1 --2- 172.21.15.87:0/1140505101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00dc1008f0 0x7f00dc195f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:15.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.197+0000 7f00e1718640 1 -- 172.21.15.87:0/1140505101 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d4009900 con 0x7f00dc103220 2024-09-13T17:13:15.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.197+0000 7f00e1f19640 1 --2- 172.21.15.87:0/1140505101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00dc1008f0 0x7f00dc195f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:15.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.197+0000 7f00e1718640 1 --2- 172.21.15.87:0/1140505101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00dc103220 0x7f00dc1964d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f00d800b450 tx=0x7f00d800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:15.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.197+0000 7f00ceffd640 1 -- 172.21.15.87:0/1140505101 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d8011890 con 0x7f00dc103220 2024-09-13T17:13:15.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.197+0000 7f00ceffd640 1 -- 172.21.15.87:0/1140505101 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f00d80103e0 con 0x7f00dc103220 2024-09-13T17:13:15.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.197+0000 7f00ceffd640 1 -- 172.21.15.87:0/1140505101 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d8011ea0 con 0x7f00dc103220 2024-09-13T17:13:15.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.197+0000 7f00e417d640 1 -- 172.21.15.87:0/1140505101 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00dc19e090 con 0x7f00dc103220 2024-09-13T17:13:15.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.198+0000 7f00e417d640 1 -- 172.21.15.87:0/1140505101 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00dc19e550 con 0x7f00dc103220 2024-09-13T17:13:15.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.199+0000 7f00e417d640 1 -- 172.21.15.87:0/1140505101 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00dc0fbf20 con 0x7f00dc103220 2024-09-13T17:13:15.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.200+0000 7f00ceffd640 1 -- 172.21.15.87:0/1140505101 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f00d8010550 con 0x7f00dc103220 2024-09-13T17:13:15.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.200+0000 7f00ceffd640 1 --2- 172.21.15.87:0/1140505101 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f00c80a1120 0x7f00c80a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:15.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.200+0000 7f00e1f19640 1 --2- 172.21.15.87:0/1140505101 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f00c80a1120 0x7f00c80a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:15.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.201+0000 7f00ceffd640 1 -- 172.21.15.87:0/1140505101 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f00d80ccbb0 con 0x7f00dc103220 2024-09-13T17:13:15.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.201+0000 7f00e1f19640 1 --2- 172.21.15.87:0/1140505101 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f00c80a1120 0x7f00c80a35e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f00d0009930 tx=0x7f00d0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:15.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.205+0000 7f00ceffd640 1 -- 172.21.15.87:0/1140505101 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f00d8095f20 con 0x7f00dc103220 2024-09-13T17:13:15.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.370+0000 7f00e417d640 1 -- 172.21.15.87:0/1140505101 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00dc10b990 con 0x7f00dc103220 2024-09-13T17:13:15.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.372+0000 7f00ceffd640 1 -- 172.21.15.87:0/1140505101 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+24817 (secure 0 0 0) 0x7f00d8015090 con 0x7f00dc103220 2024-09-13T17:13:15.374 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:13:15.374 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":93,"fsid":"043d5bae-71f2-11ef-bceb-c7b262605968","created":"2024-09-13T17:03:57.852010+0000","modified":"2024-09-13T17:12:50.208429+0000","last_up_change":"2024-09-13T17:10:34.423548+0000","last_in_change":"2024-09-13T17:10:14.228123+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:07:02.286400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:11:21.965141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:11:22.504345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:11:25.565163+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58250283-85c0-416e-abdd-1fc5a7ff0c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6803","nonce":1316956138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6805","nonce":1316956138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6809","nonce":1316956138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6807","nonce":1316956138}]},"public_addr":"172.21.15.87:6803/1316956138","cluster_addr":"172.21.15.87:6805/1316956138","heartbeat_back_addr":"172.21.15.87:6809/1316956138","heartbeat_front_addr":"172.21.15.87:6807/1316956138","state":["exists","up"]},{"osd":1,"uuid":"b9d49969-94b1-4262-b4ff-db0a8e3331af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6801","nonce":3352566727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6803","nonce":3352566727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6807","nonce":3352566727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6805","nonce":3352566727}]},"public_addr":"172.21.15.118:6801/3352566727","cluster_addr":"172.21.15.118:6803/3352566727","heartbeat_back_addr":"172.21.15.118:6807/3352566727","heartbeat_front_addr":"172.21.15.118:6805/3352566727","state":["exists","up"]},{"osd":2,"uuid":"ba64549e-d736-426f-b466-f569af5f16d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6801","nonce":2774581686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6803","nonce":2774581686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6807","nonce":2774581686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6805","nonce":2774581686}]},"public_addr":"172.21.15.149:6801/2774581686","cluster_addr":"172.21.15.149:6803/2774581686","heartbeat_back_addr":"172.21.15.149:6807/2774581686","heartbeat_front_addr":"172.21.15.149:6805/2774581686","state":["exists","up"]},{"osd":3,"uuid":"3d5553e5-371b-49fd-976b-9e72a97a2f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6811","nonce":3306119066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6813","nonce":3306119066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6817","nonce":3306119066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6815","nonce":3306119066}]},"public_addr":"172.21.15.87:6811/3306119066","cluster_addr":"172.21.15.87:6813/3306119066","heartbeat_back_addr":"172.21.15.87:6817/3306119066","heartbeat_front_addr":"172.21.15.87:6815/3306119066","state":["exists","up"]},{"osd":4,"uuid":"2fbe0e27-34ec-42a6-9962-f1d8202b3159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6809","nonce":3342349890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6811","nonce":3342349890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6815","nonce":3342349890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6813","nonce":3342349890}]},"public_addr":"172.21.15.118:6809/3342349890","cluster_addr":"172.21.15.118:6811/3342349890","heartbeat_back_addr":"172.21.15.118:6815/3342349890","heartbeat_front_addr":"172.21.15.118:6813/3342349890","state":["exists","up"]},{"osd":5,"uuid":"53c14519-6170-4b5a-a79d-4835882d7bec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6809","nonce":3468867124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6811","nonce":3468867124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6815","nonce":3468867124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6813","nonce":3468867124}]},"public_addr":"172.21.15.149:6809/3468867124","cluster_addr":"172.21.15.149:6811/3468867124","heartbeat_back_addr":"172.21.15.149:6815/3468867124","heartbeat_front_addr":"172.21.15.149:6813/3468867124","state":["exists","up"]},{"osd":6,"uuid":"d3951b32-db77-4b8b-9de0-f05e03d13f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6819","nonce":326563617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6821","nonce":326563617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6825","nonce":326563617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6823","nonce":326563617}]},"public_addr":"172.21.15.87:6819/326563617","cluster_addr":"172.21.15.87:6821/326563617","heartbeat_back_addr":"172.21.15.87:6825/326563617","heartbeat_front_addr":"172.21.15.87:6823/326563617","state":["exists","up"]},{"osd":7,"uuid":"4d46dab7-a8bf-4e3e-b5c0-43860d336bdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6817","nonce":1690268990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6819","nonce":1690268990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6823","nonce":1690268990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6821","nonce":1690268990}]},"public_addr":"172.21.15.118:6817/1690268990","cluster_addr":"172.21.15.118:6819/1690268990","heartbeat_back_addr":"172.21.15.118:6823/1690268990","heartbeat_front_addr":"172.21.15.118:6821/1690268990","state":["exists","up"]},{"osd":8,"uuid":"5a015a7d-60a3-4412-96af-1b61d2ad51f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6817","nonce":1558675380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6819","nonce":1558675380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6823","nonce":1558675380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6821","nonce":1558675380}]},"public_addr":"172.21.15.149:6817/1558675380","cluster_addr":"172.21.15.149:6819/1558675380","heartbeat_back_addr":"172.21.15.149:6823/1558675380","heartbeat_front_addr":"172.21.15.149:6821/1558675380","state":["exists","up"]},{"osd":9,"uuid":"248c0b6e-4c4e-4c63-a0dd-e4cdf3b997a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6827","nonce":1453934262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6829","nonce":1453934262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6833","nonce":1453934262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6831","nonce":1453934262}]},"public_addr":"172.21.15.87:6827/1453934262","cluster_addr":"172.21.15.87:6829/1453934262","heartbeat_back_addr":"172.21.15.87:6833/1453934262","heartbeat_front_addr":"172.21.15.87:6831/1453934262","state":["exists","up"]},{"osd":10,"uuid":"24238714-e737-4371-b5d5-0cd3395f09bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6825","nonce":1034318850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6827","nonce":1034318850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6831","nonce":1034318850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6829","nonce":1034318850}]},"public_addr":"172.21.15.118:6825/1034318850","cluster_addr":"172.21.15.118:6827/1034318850","heartbeat_back_addr":"172.21.15.118:6831/1034318850","heartbeat_front_addr":"172.21.15.118:6829/1034318850","state":["exists","up"]},{"osd":11,"uuid":"409dd3bf-5154-4dea-8708-7de7f9e2e793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6825","nonce":271000465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6827","nonce":271000465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6831","nonce":271000465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6829","nonce":271000465}]},"public_addr":"172.21.15.149:6825/271000465","cluster_addr":"172.21.15.149:6827/271000465","heartbeat_back_addr":"172.21.15.149:6831/271000465","heartbeat_front_addr":"172.21.15.149:6829/271000465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:16.382664+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:37.914250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:00.425876+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:23.960183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:47.004088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:10.214345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:33.719221+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:57.099599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:20.971881+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:44.827167+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:08.135516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:32.085853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.d","mappings":[{"from":1,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8},{"from":5,"to":7}]},{"pgid":"3.28","mappings":[{"from":3,"to":6},{"from":5,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/586423689":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6801/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6800/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/3270371628":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/515676743":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/1475107314":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/553289143":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/3403361612":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6801/1587363880":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6800/1587363880":"2024-09-14T17:04:24.083789+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:13:15.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.374+0000 7f00e417d640 1 -- 172.21.15.87:0/1140505101 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f00c80a1120 msgr2=0x7f00c80a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:15.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.374+0000 7f00e417d640 1 --2- 172.21.15.87:0/1140505101 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f00c80a1120 0x7f00c80a35e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f00d0009930 tx=0x7f00d0008040 comp rx=0 tx=0).stop 2024-09-13T17:13:15.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.374+0000 7f00e417d640 1 -- 172.21.15.87:0/1140505101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00dc103220 msgr2=0x7f00dc1964d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:15.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.374+0000 7f00e417d640 1 --2- 172.21.15.87:0/1140505101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00dc103220 0x7f00dc1964d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f00d800b450 tx=0x7f00d800b910 comp rx=0 tx=0).stop 2024-09-13T17:13:15.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.374+0000 7f00e417d640 1 -- 172.21.15.87:0/1140505101 shutdown_connections 2024-09-13T17:13:15.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.374+0000 7f00e417d640 1 --2- 172.21.15.87:0/1140505101 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f00c80a1120 0x7f00c80a35e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:15.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.374+0000 7f00e417d640 1 --2- 172.21.15.87:0/1140505101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00dc105b50 0x7f00dc19d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:15.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.374+0000 7f00e417d640 1 --2- 172.21.15.87:0/1140505101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00dc103220 0x7f00dc1964d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:15.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.374+0000 7f00e417d640 1 --2- 172.21.15.87:0/1140505101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00dc1008f0 0x7f00dc195f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:15.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.374+0000 7f00e417d640 1 -- 172.21.15.87:0/1140505101 >> 172.21.15.87:0/1140505101 conn(0x7f00dc0fa430 msgr2=0x7f00dc102730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:15.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.374+0000 7f00e417d640 1 -- 172.21.15.87:0/1140505101 shutdown_connections 2024-09-13T17:13:15.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.374+0000 7f00e417d640 1 -- 172.21.15.87:0/1140505101 wait complete. 2024-09-13T17:13:15.386 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:15 smithi087 ceph-mon[30934]: pgmap v336: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T17:13:15.386 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:15 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2192379572' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T17:13:15.387 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:07:02.286400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:11:21.965141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:11:22.504345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:11:25.565163+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:13:15.388 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:13:15.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.488+0000 7f0d0e583640 1 -- 172.21.15.87:0/545748095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d080fec80 msgr2=0x7f0d080ff080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:15.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.488+0000 7f0d0e583640 1 --2- 172.21.15.87:0/545748095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d080fec80 0x7f0d080ff080 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8009900 tx=0x7f0cf802a410 comp rx=0 tx=0).stop 2024-09-13T17:13:15.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.488+0000 7f0d0e583640 1 -- 172.21.15.87:0/545748095 shutdown_connections 2024-09-13T17:13:15.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.488+0000 7f0d0e583640 1 --2- 172.21.15.87:0/545748095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d08100830 0x7f0d081070c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:15.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.488+0000 7f0d0e583640 1 --2- 172.21.15.87:0/545748095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d080ffe70 0x7f0d081002f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:15.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.488+0000 7f0d0e583640 1 --2- 172.21.15.87:0/545748095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d080fec80 0x7f0d080ff080 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:15.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.488+0000 7f0d0e583640 1 -- 172.21.15.87:0/545748095 >> 172.21.15.87:0/545748095 conn(0x7f0d080fa3e0 msgr2=0x7f0d080fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:15.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.488+0000 7f0d0e583640 1 -- 172.21.15.87:0/545748095 shutdown_connections 2024-09-13T17:13:15.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.488+0000 7f0d0e583640 1 -- 172.21.15.87:0/545748095 wait complete. 2024-09-13T17:13:15.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.489+0000 7f0d0e583640 1 Processor -- start 2024-09-13T17:13:15.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.489+0000 7f0d0e583640 1 -- start start 2024-09-13T17:13:15.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.489+0000 7f0d0e583640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d080fec80 0x7f0d08069140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:15.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.489+0000 7f0d0e583640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d080ffe70 0x7f0d0819aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:15.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.489+0000 7f0d0e583640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d08100830 0x7f0d0819d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:15.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.489+0000 7f0d0e583640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0819d890 con 0x7f0d08100830 2024-09-13T17:13:15.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.489+0000 7f0d0e583640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0819da00 con 0x7f0d080fec80 2024-09-13T17:13:15.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.489+0000 7f0d0e583640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0819dbc0 con 0x7f0d080ffe70 2024-09-13T17:13:15.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.489+0000 7f0d0cb20640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d08100830 0x7f0d0819d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:15.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.489+0000 7f0d0cb20640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d08100830 0x7f0d0819d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43172/0 (socket says 172.21.15.87:43172) 2024-09-13T17:13:15.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.489+0000 7f0d0cb20640 1 -- 172.21.15.87:0/868002761 learned_addr learned my addr 172.21.15.87:0/868002761 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:15.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.489+0000 7f0cfffff640 1 --2- 172.21.15.87:0/868002761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d080ffe70 0x7f0d0819aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:15.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.489+0000 7f0d07fff640 1 --2- 172.21.15.87:0/868002761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d080fec80 0x7f0d08069140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:15.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.489+0000 7f0d0cb20640 1 -- 172.21.15.87:0/868002761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d080ffe70 msgr2=0x7f0d0819aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:15.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.489+0000 7f0d0cb20640 1 --2- 172.21.15.87:0/868002761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d080ffe70 0x7f0d0819aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:15.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.489+0000 7f0d0cb20640 1 -- 172.21.15.87:0/868002761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d080fec80 msgr2=0x7f0d08069140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:15.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.489+0000 7f0d0cb20640 1 --2- 172.21.15.87:0/868002761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d080fec80 0x7f0d08069140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:15.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.489+0000 7f0d0cb20640 1 -- 172.21.15.87:0/868002761 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf8009560 con 0x7f0d08100830 2024-09-13T17:13:15.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.489+0000 7f0cfffff640 1 --2- 172.21.15.87:0/868002761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d080ffe70 0x7f0d0819aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:15.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.489+0000 7f0d07fff640 1 --2- 172.21.15.87:0/868002761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d080fec80 0x7f0d08069140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:15.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.490+0000 7f0d0cb20640 1 --2- 172.21.15.87:0/868002761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d08100830 0x7f0d0819d100 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0d0000cce0 tx=0x7f0d0000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:15.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.490+0000 7f0d05ffb640 1 -- 172.21.15.87:0/868002761 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0000f450 con 0x7f0d08100830 2024-09-13T17:13:15.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.490+0000 7f0d05ffb640 1 -- 172.21.15.87:0/868002761 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0d0000fa60 con 0x7f0d08100830 2024-09-13T17:13:15.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.490+0000 7f0d0e583640 1 -- 172.21.15.87:0/868002761 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d0819dea0 con 0x7f0d08100830 2024-09-13T17:13:15.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.490+0000 7f0d05ffb640 1 -- 172.21.15.87:0/868002761 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d00018b10 con 0x7f0d08100830 2024-09-13T17:13:15.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.490+0000 7f0d0e583640 1 -- 172.21.15.87:0/868002761 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d0819e2d0 con 0x7f0d08100830 2024-09-13T17:13:15.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.491+0000 7f0d0e583640 1 -- 172.21.15.87:0/868002761 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d08106200 con 0x7f0d08100830 2024-09-13T17:13:15.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.492+0000 7f0d05ffb640 1 -- 172.21.15.87:0/868002761 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f0d0000fbd0 con 0x7f0d08100830 2024-09-13T17:13:15.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.493+0000 7f0d05ffb640 1 --2- 172.21.15.87:0/868002761 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0cf40a1120 0x7f0cf40a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:15.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.493+0000 7f0d07fff640 1 --2- 172.21.15.87:0/868002761 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0cf40a1120 0x7f0cf40a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:15.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.493+0000 7f0d05ffb640 1 -- 172.21.15.87:0/868002761 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f0d000cd760 con 0x7f0d08100830 2024-09-13T17:13:15.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.493+0000 7f0d07fff640 1 --2- 172.21.15.87:0/868002761 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0cf40a1120 0x7f0cf40a35e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0cf802aa00 tx=0x7f0cf8031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:15.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.496+0000 7f0d05ffb640 1 -- 172.21.15.87:0/868002761 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0d000969c0 con 0x7f0d08100830 2024-09-13T17:13:15.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:15 smithi149 ceph-mon[35496]: pgmap v336: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T17:13:15.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:15 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2192379572' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T17:13:15.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:15 smithi118 ceph-mon[34374]: pgmap v336: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T17:13:15.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:15 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2192379572' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T17:13:15.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.658+0000 7f0d0e583640 1 -- 172.21.15.87:0/868002761 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0d0802c410 con 0x7f0d08100830 2024-09-13T17:13:15.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.658+0000 7f0d05ffb640 1 -- 172.21.15.87:0/868002761 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0d00099fe0 con 0x7f0d08100830 2024-09-13T17:13:15.660 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-09-13T17:13:15.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.660+0000 7f0d0e583640 1 -- 172.21.15.87:0/868002761 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0cf40a1120 msgr2=0x7f0cf40a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:15.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.660+0000 7f0d0e583640 1 --2- 172.21.15.87:0/868002761 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0cf40a1120 0x7f0cf40a35e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0cf802aa00 tx=0x7f0cf8031400 comp rx=0 tx=0).stop 2024-09-13T17:13:15.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.660+0000 7f0d0e583640 1 -- 172.21.15.87:0/868002761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d08100830 msgr2=0x7f0d0819d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:15.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.660+0000 7f0d0e583640 1 --2- 172.21.15.87:0/868002761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d08100830 0x7f0d0819d100 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0d0000cce0 tx=0x7f0d0000a620 comp rx=0 tx=0).stop 2024-09-13T17:13:15.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.660+0000 7f0d0e583640 1 -- 172.21.15.87:0/868002761 shutdown_connections 2024-09-13T17:13:15.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.660+0000 7f0d0e583640 1 --2- 172.21.15.87:0/868002761 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0cf40a1120 0x7f0cf40a35e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:15.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.660+0000 7f0d0e583640 1 --2- 172.21.15.87:0/868002761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d08100830 0x7f0d0819d100 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:15.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.660+0000 7f0d0e583640 1 --2- 172.21.15.87:0/868002761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d080ffe70 0x7f0d0819aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:15.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.660+0000 7f0d0e583640 1 --2- 172.21.15.87:0/868002761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d080fec80 0x7f0d08069140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:15.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.660+0000 7f0d0e583640 1 -- 172.21.15.87:0/868002761 >> 172.21.15.87:0/868002761 conn(0x7f0d080fa3e0 msgr2=0x7f0d081033d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:15.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.660+0000 7f0d0e583640 1 -- 172.21.15.87:0/868002761 shutdown_connections 2024-09-13T17:13:15.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.660+0000 7f0d0e583640 1 -- 172.21.15.87:0/868002761 wait complete. 2024-09-13T17:13:15.674 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:13:15.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.773+0000 7f4fe3096640 1 -- 172.21.15.87:0/1198425263 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4fdc100840 msgr2=0x7f4fdc1070d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:15.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.773+0000 7f4fe3096640 1 --2- 172.21.15.87:0/1198425263 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4fdc100840 0x7f4fdc1070d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4009ca0 tx=0x7f4fd402a8c0 comp rx=0 tx=0).stop 2024-09-13T17:13:15.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.773+0000 7f4fe3096640 1 -- 172.21.15.87:0/1198425263 shutdown_connections 2024-09-13T17:13:15.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.773+0000 7f4fe3096640 1 --2- 172.21.15.87:0/1198425263 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4fdc100840 0x7f4fdc1070d0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:15.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.773+0000 7f4fe3096640 1 --2- 172.21.15.87:0/1198425263 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fdc0ffe80 0x7f4fdc100300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:15.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.773+0000 7f4fe3096640 1 --2- 172.21.15.87:0/1198425263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fdc0fec90 0x7f4fdc0ff090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:15.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.773+0000 7f4fe3096640 1 -- 172.21.15.87:0/1198425263 >> 172.21.15.87:0/1198425263 conn(0x7f4fdc0fa3f0 msgr2=0x7f4fdc0fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:15.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.773+0000 7f4fe3096640 1 -- 172.21.15.87:0/1198425263 shutdown_connections 2024-09-13T17:13:15.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.773+0000 7f4fe3096640 1 -- 172.21.15.87:0/1198425263 wait complete. 2024-09-13T17:13:15.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.774+0000 7f4fe3096640 1 Processor -- start 2024-09-13T17:13:15.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.774+0000 7f4fe3096640 1 -- start start 2024-09-13T17:13:15.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.774+0000 7f4fe3096640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fdc0fec90 0x7f4fdc194c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:15.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.774+0000 7f4fe3096640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fdc0ffe80 0x7f4fdc1951b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:15.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.774+0000 7f4fe3096640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4fdc100840 0x7f4fdc19c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:15.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.774+0000 7f4fe3096640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fdc19c780 con 0x7f4fdc100840 2024-09-13T17:13:15.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.774+0000 7f4fe3096640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fdc19c8f0 con 0x7f4fdc0ffe80 2024-09-13T17:13:15.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.774+0000 7f4fe3096640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fdc19cab0 con 0x7f4fdc0fec90 2024-09-13T17:13:15.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.774+0000 7f4fe1633640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4fdc100840 0x7f4fdc19c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:15.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.774+0000 7f4fe1633640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4fdc100840 0x7f4fdc19c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43186/0 (socket says 172.21.15.87:43186) 2024-09-13T17:13:15.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.774+0000 7f4fe1633640 1 -- 172.21.15.87:0/1898572422 learned_addr learned my addr 172.21.15.87:0/1898572422 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:15.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.774+0000 7f4fe0e32640 1 --2- 172.21.15.87:0/1898572422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fdc0fec90 0x7f4fdc194c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:15.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.774+0000 7f4fdbfff640 1 --2- 172.21.15.87:0/1898572422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fdc0ffe80 0x7f4fdc1951b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:15.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.774+0000 7f4fe1633640 1 -- 172.21.15.87:0/1898572422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fdc0fec90 msgr2=0x7f4fdc194c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:15.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.774+0000 7f4fe1633640 1 --2- 172.21.15.87:0/1898572422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fdc0fec90 0x7f4fdc194c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:15.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.774+0000 7f4fe1633640 1 -- 172.21.15.87:0/1898572422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fdc0ffe80 msgr2=0x7f4fdc1951b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:15.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.774+0000 7f4fe1633640 1 --2- 172.21.15.87:0/1898572422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fdc0ffe80 0x7f4fdc1951b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:15.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.774+0000 7f4fe1633640 1 -- 172.21.15.87:0/1898572422 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd4009900 con 0x7f4fdc100840 2024-09-13T17:13:15.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.774+0000 7f4fdbfff640 1 --2- 172.21.15.87:0/1898572422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fdc0ffe80 0x7f4fdc1951b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:15.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.775+0000 7f4fe1633640 1 --2- 172.21.15.87:0/1898572422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4fdc100840 0x7f4fdc19c210 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4033040 tx=0x7f4fd4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:15.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.775+0000 7f4fd9ffb640 1 -- 172.21.15.87:0/1898572422 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd402f310 con 0x7f4fdc100840 2024-09-13T17:13:15.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.775+0000 7f4fd9ffb640 1 -- 172.21.15.87:0/1898572422 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4fd4040070 con 0x7f4fdc100840 2024-09-13T17:13:15.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.775+0000 7f4fe3096640 1 -- 172.21.15.87:0/1898572422 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fdc19cd30 con 0x7f4fdc100840 2024-09-13T17:13:15.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.775+0000 7f4fd9ffb640 1 -- 172.21.15.87:0/1898572422 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd4004560 con 0x7f4fdc100840 2024-09-13T17:13:15.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.775+0000 7f4fe3096640 1 -- 172.21.15.87:0/1898572422 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fdc19d1e0 con 0x7f4fdc100840 2024-09-13T17:13:15.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.776+0000 7f4fe3096640 1 -- 172.21.15.87:0/1898572422 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fdc106120 con 0x7f4fdc100840 2024-09-13T17:13:15.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.777+0000 7f4fd9ffb640 1 -- 172.21.15.87:0/1898572422 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f4fd4042030 con 0x7f4fdc100840 2024-09-13T17:13:15.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.778+0000 7f4fd9ffb640 1 --2- 172.21.15.87:0/1898572422 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f4fcc0a1120 0x7f4fcc0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:15.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.778+0000 7f4fe0e32640 1 --2- 172.21.15.87:0/1898572422 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f4fcc0a1120 0x7f4fcc0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:15.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.778+0000 7f4fd9ffb640 1 -- 172.21.15.87:0/1898572422 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f4fd40ee380 con 0x7f4fdc100840 2024-09-13T17:13:15.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.778+0000 7f4fe0e32640 1 --2- 172.21.15.87:0/1898572422 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f4fcc0a1120 0x7f4fcc0a35e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc195b40 tx=0x7f4fd000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:15.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.781+0000 7f4fd9ffb640 1 -- 172.21.15.87:0/1898572422 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4fd40b7790 con 0x7f4fdc100840 2024-09-13T17:13:15.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.946+0000 7f4fe3096640 1 -- 172.21.15.87:0/1898572422 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4fdc02c480 con 0x7f4fdc100840 2024-09-13T17:13:15.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.946+0000 7f4fd9ffb640 1 -- 172.21.15.87:0/1898572422 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4fd40badb0 con 0x7f4fdc100840 2024-09-13T17:13:15.949 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-09-13T17:13:15.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.948+0000 7f4fe3096640 1 -- 172.21.15.87:0/1898572422 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f4fcc0a1120 msgr2=0x7f4fcc0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:15.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.948+0000 7f4fe3096640 1 --2- 172.21.15.87:0/1898572422 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f4fcc0a1120 0x7f4fcc0a35e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc195b40 tx=0x7f4fd000b410 comp rx=0 tx=0).stop 2024-09-13T17:13:15.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.948+0000 7f4fe3096640 1 -- 172.21.15.87:0/1898572422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4fdc100840 msgr2=0x7f4fdc19c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:15.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.948+0000 7f4fe3096640 1 --2- 172.21.15.87:0/1898572422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4fdc100840 0x7f4fdc19c210 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4033040 tx=0x7f4fd4003ba0 comp rx=0 tx=0).stop 2024-09-13T17:13:15.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.948+0000 7f4fe3096640 1 -- 172.21.15.87:0/1898572422 shutdown_connections 2024-09-13T17:13:15.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.948+0000 7f4fe3096640 1 --2- 172.21.15.87:0/1898572422 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f4fcc0a1120 0x7f4fcc0a35e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:15.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.948+0000 7f4fe3096640 1 --2- 172.21.15.87:0/1898572422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4fdc100840 0x7f4fdc19c210 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:15.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.948+0000 7f4fe3096640 1 --2- 172.21.15.87:0/1898572422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4fdc0ffe80 0x7f4fdc1951b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:15.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.948+0000 7f4fe3096640 1 --2- 172.21.15.87:0/1898572422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4fdc0fec90 0x7f4fdc194c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:15.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.948+0000 7f4fe3096640 1 -- 172.21.15.87:0/1898572422 >> 172.21.15.87:0/1898572422 conn(0x7f4fdc0fa3f0 msgr2=0x7f4fdc1032f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:15.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.948+0000 7f4fe3096640 1 -- 172.21.15.87:0/1898572422 shutdown_connections 2024-09-13T17:13:15.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:15.948+0000 7f4fe3096640 1 -- 172.21.15.87:0/1898572422 wait complete. 2024-09-13T17:13:15.962 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:13:16.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.064+0000 7fe313d5e640 1 -- 172.21.15.87:0/3757173276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe30c101ac0 msgr2=0x7fe30c108350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:16.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.064+0000 7fe313d5e640 1 --2- 172.21.15.87:0/3757173276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe30c101ac0 0x7fe30c108350 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe304009ca0 tx=0x7fe30402a8c0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.064+0000 7fe313d5e640 1 -- 172.21.15.87:0/3757173276 shutdown_connections 2024-09-13T17:13:16.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.064+0000 7fe313d5e640 1 --2- 172.21.15.87:0/3757173276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe30c101ac0 0x7fe30c108350 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.064+0000 7fe313d5e640 1 --2- 172.21.15.87:0/3757173276 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe30c101100 0x7fe30c101580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.064+0000 7fe313d5e640 1 --2- 172.21.15.87:0/3757173276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe30c0fe090 0x7fe30c0fe490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.064+0000 7fe313d5e640 1 -- 172.21.15.87:0/3757173276 >> 172.21.15.87:0/3757173276 conn(0x7fe30c0f9b70 msgr2=0x7fe30c0fbfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:16.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.064+0000 7fe313d5e640 1 -- 172.21.15.87:0/3757173276 shutdown_connections 2024-09-13T17:13:16.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.064+0000 7fe313d5e640 1 -- 172.21.15.87:0/3757173276 wait complete. 2024-09-13T17:13:16.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.065+0000 7fe313d5e640 1 Processor -- start 2024-09-13T17:13:16.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.065+0000 7fe313d5e640 1 -- start start 2024-09-13T17:13:16.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.065+0000 7fe313d5e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe30c0fe090 0x7fe30c195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:16.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.065+0000 7fe313d5e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe30c101100 0x7fe30c1963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:16.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.065+0000 7fe313d5e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe30c101ac0 0x7fe30c19d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:16.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.065+0000 7fe313d5e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c19d980 con 0x7fe30c101ac0 2024-09-13T17:13:16.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.065+0000 7fe313d5e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c19daf0 con 0x7fe30c101100 2024-09-13T17:13:16.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.065+0000 7fe313d5e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c19dcb0 con 0x7fe30c0fe090 2024-09-13T17:13:16.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.065+0000 7fe3122fb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe30c101ac0 0x7fe30c19d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:16.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.065+0000 7fe3122fb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe30c101ac0 0x7fe30c19d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43200/0 (socket says 172.21.15.87:43200) 2024-09-13T17:13:16.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.065+0000 7fe3122fb640 1 -- 172.21.15.87:0/1572231219 learned_addr learned my addr 172.21.15.87:0/1572231219 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:16.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.065+0000 7fe3112f9640 1 --2- 172.21.15.87:0/1572231219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe30c101100 0x7fe30c1963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:16.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.065+0000 7fe311afa640 1 --2- 172.21.15.87:0/1572231219 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe30c0fe090 0x7fe30c195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:16.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.065+0000 7fe3122fb640 1 -- 172.21.15.87:0/1572231219 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe30c0fe090 msgr2=0x7fe30c195e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:16.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.065+0000 7fe3122fb640 1 --2- 172.21.15.87:0/1572231219 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe30c0fe090 0x7fe30c195e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.065+0000 7fe3122fb640 1 -- 172.21.15.87:0/1572231219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe30c101100 msgr2=0x7fe30c1963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:16.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.065+0000 7fe3122fb640 1 --2- 172.21.15.87:0/1572231219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe30c101100 0x7fe30c1963d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.065+0000 7fe3122fb640 1 -- 172.21.15.87:0/1572231219 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe304009900 con 0x7fe30c101ac0 2024-09-13T17:13:16.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.066+0000 7fe3122fb640 1 --2- 172.21.15.87:0/1572231219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe30c101ac0 0x7fe30c19d440 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe3040097b0 tx=0x7fe304031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:16.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.066+0000 7fe302ffd640 1 -- 172.21.15.87:0/1572231219 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30402f310 con 0x7fe30c101ac0 2024-09-13T17:13:16.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.066+0000 7fe302ffd640 1 -- 172.21.15.87:0/1572231219 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe304040070 con 0x7fe30c101ac0 2024-09-13T17:13:16.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.066+0000 7fe302ffd640 1 -- 172.21.15.87:0/1572231219 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3040046e0 con 0x7fe30c101ac0 2024-09-13T17:13:16.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.066+0000 7fe313d5e640 1 -- 172.21.15.87:0/1572231219 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe30c19df30 con 0x7fe30c101ac0 2024-09-13T17:13:16.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.066+0000 7fe313d5e640 1 -- 172.21.15.87:0/1572231219 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe30c19e430 con 0x7fe30c101ac0 2024-09-13T17:13:16.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.067+0000 7fe313d5e640 1 -- 172.21.15.87:0/1572231219 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe30c107390 con 0x7fe30c101ac0 2024-09-13T17:13:16.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.068+0000 7fe302ffd640 1 -- 172.21.15.87:0/1572231219 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fe304042030 con 0x7fe30c101ac0 2024-09-13T17:13:16.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.069+0000 7fe302ffd640 1 --2- 172.21.15.87:0/1572231219 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe2f80a11a0 0x7fe2f80a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:16.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.069+0000 7fe311afa640 1 --2- 172.21.15.87:0/1572231219 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe2f80a11a0 0x7fe2f80a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:16.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.069+0000 7fe302ffd640 1 -- 172.21.15.87:0/1572231219 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7fe3040ee710 con 0x7fe30c101ac0 2024-09-13T17:13:16.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.069+0000 7fe311afa640 1 --2- 172.21.15.87:0/1572231219 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe2f80a11a0 0x7fe2f80a3660 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe30c0682b0 tx=0x7fe308008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:16.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.073+0000 7fe302ffd640 1 -- 172.21.15.87:0/1572231219 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe3040b7a80 con 0x7fe30c101ac0 2024-09-13T17:13:16.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.237+0000 7fe313d5e640 1 -- 172.21.15.87:0/1572231219 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe30c10b970 con 0x7fe30c101ac0 2024-09-13T17:13:16.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.238+0000 7fe302ffd640 1 -- 172.21.15.87:0/1572231219 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe3040bb0a0 con 0x7fe30c101ac0 2024-09-13T17:13:16.240 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-09-13T17:13:16.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.239+0000 7fe313d5e640 1 -- 172.21.15.87:0/1572231219 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe2f80a11a0 msgr2=0x7fe2f80a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:16.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.239+0000 7fe313d5e640 1 --2- 172.21.15.87:0/1572231219 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe2f80a11a0 0x7fe2f80a3660 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe30c0682b0 tx=0x7fe308008040 comp rx=0 tx=0).stop 2024-09-13T17:13:16.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.239+0000 7fe313d5e640 1 -- 172.21.15.87:0/1572231219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe30c101ac0 msgr2=0x7fe30c19d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:16.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.239+0000 7fe313d5e640 1 --2- 172.21.15.87:0/1572231219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe30c101ac0 0x7fe30c19d440 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe3040097b0 tx=0x7fe304031700 comp rx=0 tx=0).stop 2024-09-13T17:13:16.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.240+0000 7fe313d5e640 1 -- 172.21.15.87:0/1572231219 shutdown_connections 2024-09-13T17:13:16.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.240+0000 7fe313d5e640 1 --2- 172.21.15.87:0/1572231219 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe2f80a11a0 0x7fe2f80a3660 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.240+0000 7fe313d5e640 1 --2- 172.21.15.87:0/1572231219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe30c101ac0 0x7fe30c19d440 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.240+0000 7fe313d5e640 1 --2- 172.21.15.87:0/1572231219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe30c101100 0x7fe30c1963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.240+0000 7fe313d5e640 1 --2- 172.21.15.87:0/1572231219 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe30c0fe090 0x7fe30c195e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.240+0000 7fe313d5e640 1 -- 172.21.15.87:0/1572231219 >> 172.21.15.87:0/1572231219 conn(0x7fe30c0f9b70 msgr2=0x7fe30c104560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:16.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.240+0000 7fe313d5e640 1 -- 172.21.15.87:0/1572231219 shutdown_connections 2024-09-13T17:13:16.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.240+0000 7fe313d5e640 1 -- 172.21.15.87:0/1572231219 wait complete. 2024-09-13T17:13:16.252 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:13:16.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.352+0000 7f02d6ac9640 1 -- 172.21.15.87:0/3737567470 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02d00ff930 msgr2=0x7f02d01071d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:16.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.352+0000 7f02d6ac9640 1 --2- 172.21.15.87:0/3737567470 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02d00ff930 0x7f02d01071d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f02c8009ca0 tx=0x7f02c802a8c0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.352+0000 7f02d6ac9640 1 -- 172.21.15.87:0/3737567470 shutdown_connections 2024-09-13T17:13:16.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.352+0000 7f02d6ac9640 1 --2- 172.21.15.87:0/3737567470 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02d00ff930 0x7f02d01071d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.352+0000 7f02d6ac9640 1 --2- 172.21.15.87:0/3737567470 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02d00fef70 0x7f02d00ff3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.352+0000 7f02d6ac9640 1 --2- 172.21.15.87:0/3737567470 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02d0100240 0x7f02d0100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.352+0000 7f02d6ac9640 1 -- 172.21.15.87:0/3737567470 >> 172.21.15.87:0/3737567470 conn(0x7f02d00f9b70 msgr2=0x7f02d00fbfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:16.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.352+0000 7f02d6ac9640 1 -- 172.21.15.87:0/3737567470 shutdown_connections 2024-09-13T17:13:16.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.352+0000 7f02d6ac9640 1 -- 172.21.15.87:0/3737567470 wait complete. 2024-09-13T17:13:16.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.352+0000 7f02d6ac9640 1 Processor -- start 2024-09-13T17:13:16.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.352+0000 7f02d6ac9640 1 -- start start 2024-09-13T17:13:16.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.353+0000 7f02d6ac9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02d00fef70 0x7f02d0195d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:16.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.353+0000 7f02d6ac9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02d00ff930 0x7f02d01962b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:16.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.353+0000 7f02d6ac9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02d0100240 0x7f02d019d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:16.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.353+0000 7f02d6ac9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d019d860 con 0x7f02d00ff930 2024-09-13T17:13:16.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.353+0000 7f02d6ac9640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d019d9d0 con 0x7f02d00fef70 2024-09-13T17:13:16.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.353+0000 7f02d6ac9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d019db90 con 0x7f02d0100240 2024-09-13T17:13:16.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.353+0000 7f02cffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02d00ff930 0x7f02d01962b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:16.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.353+0000 7f02cffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02d00ff930 0x7f02d01962b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43218/0 (socket says 172.21.15.87:43218) 2024-09-13T17:13:16.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.353+0000 7f02cffff640 1 -- 172.21.15.87:0/2278362805 learned_addr learned my addr 172.21.15.87:0/2278362805 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:16.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.353+0000 7f02d4865640 1 --2- 172.21.15.87:0/2278362805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02d00fef70 0x7f02d0195d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:16.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.353+0000 7f02d5066640 1 --2- 172.21.15.87:0/2278362805 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02d0100240 0x7f02d019d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:16.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.353+0000 7f02cffff640 1 -- 172.21.15.87:0/2278362805 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02d0100240 msgr2=0x7f02d019d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:16.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.353+0000 7f02cffff640 1 --2- 172.21.15.87:0/2278362805 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02d0100240 0x7f02d019d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.353+0000 7f02cffff640 1 -- 172.21.15.87:0/2278362805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02d00fef70 msgr2=0x7f02d0195d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:16.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.353+0000 7f02cffff640 1 --2- 172.21.15.87:0/2278362805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02d00fef70 0x7f02d0195d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.353+0000 7f02cffff640 1 -- 172.21.15.87:0/2278362805 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c8009900 con 0x7f02d00ff930 2024-09-13T17:13:16.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.353+0000 7f02d4865640 1 --2- 172.21.15.87:0/2278362805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02d00fef70 0x7f02d0195d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:16.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.353+0000 7f02cffff640 1 --2- 172.21.15.87:0/2278362805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02d00ff930 0x7f02d01962b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f02bc00c920 tx=0x7f02bc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:16.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.353+0000 7f02cdffb640 1 -- 172.21.15.87:0/2278362805 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02bc007c70 con 0x7f02d00ff930 2024-09-13T17:13:16.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.353+0000 7f02cdffb640 1 -- 172.21.15.87:0/2278362805 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f02bc007dd0 con 0x7f02d00ff930 2024-09-13T17:13:16.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.353+0000 7f02cdffb640 1 -- 172.21.15.87:0/2278362805 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02bc0187c0 con 0x7f02d00ff930 2024-09-13T17:13:16.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.353+0000 7f02d6ac9640 1 -- 172.21.15.87:0/2278362805 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02d019de70 con 0x7f02d00ff930 2024-09-13T17:13:16.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.354+0000 7f02d6ac9640 1 -- 172.21.15.87:0/2278362805 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02d019e2a0 con 0x7f02d00ff930 2024-09-13T17:13:16.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.355+0000 7f02d6ac9640 1 -- 172.21.15.87:0/2278362805 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02d01061d0 con 0x7f02d00ff930 2024-09-13T17:13:16.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.355+0000 7f02cdffb640 1 -- 172.21.15.87:0/2278362805 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f02bc00f450 con 0x7f02d00ff930 2024-09-13T17:13:16.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.356+0000 7f02cdffb640 1 --2- 172.21.15.87:0/2278362805 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f02c00a1120 0x7f02c00a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:16.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.356+0000 7f02d4865640 1 --2- 172.21.15.87:0/2278362805 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f02c00a1120 0x7f02c00a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:16.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.356+0000 7f02cdffb640 1 -- 172.21.15.87:0/2278362805 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f02bc0ccff0 con 0x7f02d00ff930 2024-09-13T17:13:16.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.357+0000 7f02d4865640 1 --2- 172.21.15.87:0/2278362805 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f02c00a1120 0x7f02c00a35e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f02d00682f0 tx=0x7f02c4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:16.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.360+0000 7f02cdffb640 1 -- 172.21.15.87:0/2278362805 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f02bc096250 con 0x7f02d00ff930 2024-09-13T17:13:16.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.523+0000 7f02d6ac9640 1 -- 172.21.15.87:0/2278362805 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f02d010b8b0 con 0x7f02d00ff930 2024-09-13T17:13:16.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.523+0000 7f02cdffb640 1 -- 172.21.15.87:0/2278362805 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v93) v1 ==== 103+0+11 (secure 0 0 0) 0x7f02bc099870 con 0x7f02d00ff930 2024-09-13T17:13:16.525 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-09-13T17:13:16.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.525+0000 7f02d6ac9640 1 -- 172.21.15.87:0/2278362805 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f02c00a1120 msgr2=0x7f02c00a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:16.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.525+0000 7f02d6ac9640 1 --2- 172.21.15.87:0/2278362805 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f02c00a1120 0x7f02c00a35e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f02d00682f0 tx=0x7f02c4008040 comp rx=0 tx=0).stop 2024-09-13T17:13:16.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.525+0000 7f02d6ac9640 1 -- 172.21.15.87:0/2278362805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02d00ff930 msgr2=0x7f02d01962b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:16.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.525+0000 7f02d6ac9640 1 --2- 172.21.15.87:0/2278362805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02d00ff930 0x7f02d01962b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f02bc00c920 tx=0x7f02bc00cde0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.525+0000 7f02d6ac9640 1 -- 172.21.15.87:0/2278362805 shutdown_connections 2024-09-13T17:13:16.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.525+0000 7f02d6ac9640 1 --2- 172.21.15.87:0/2278362805 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f02c00a1120 0x7f02c00a35e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.525+0000 7f02d6ac9640 1 --2- 172.21.15.87:0/2278362805 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02d0100240 0x7f02d019d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.525+0000 7f02d6ac9640 1 --2- 172.21.15.87:0/2278362805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02d00ff930 0x7f02d01962b0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.525+0000 7f02d6ac9640 1 --2- 172.21.15.87:0/2278362805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02d00fef70 0x7f02d0195d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.525+0000 7f02d6ac9640 1 -- 172.21.15.87:0/2278362805 >> 172.21.15.87:0/2278362805 conn(0x7f02d00f9b70 msgr2=0x7f02d01033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:16.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.525+0000 7f02d6ac9640 1 -- 172.21.15.87:0/2278362805 shutdown_connections 2024-09-13T17:13:16.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.525+0000 7f02d6ac9640 1 -- 172.21.15.87:0/2278362805 wait complete. 2024-09-13T17:13:16.537 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:16 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1140505101' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:13:16.537 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:16 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/868002761' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:13:16.537 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:16 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1898572422' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:13:16.537 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:16 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1572231219' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:13:16.538 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:13:16.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:16 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1140505101' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:13:16.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:16 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/868002761' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:13:16.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:16 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1898572422' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:13:16.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:16 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1572231219' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:13:16.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:16 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1140505101' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:13:16.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:16 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/868002761' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:13:16.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:16 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1898572422' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:13:16.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:16 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1572231219' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:13:16.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.637+0000 7f8868a61640 1 -- 172.21.15.87:0/1949070829 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8864100850 msgr2=0x7f88641070e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:16.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.637+0000 7f8868a61640 1 --2- 172.21.15.87:0/1949070829 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8864100850 0x7f88641070e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f885c009ca0 tx=0x7f885c02a8c0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.638+0000 7f8868a61640 1 -- 172.21.15.87:0/1949070829 shutdown_connections 2024-09-13T17:13:16.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.638+0000 7f8868a61640 1 --2- 172.21.15.87:0/1949070829 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8864100850 0x7f88641070e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.638+0000 7f8868a61640 1 --2- 172.21.15.87:0/1949070829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88640ffe90 0x7f8864100310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.638+0000 7f8868a61640 1 --2- 172.21.15.87:0/1949070829 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88640feca0 0x7f88640ff0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.638+0000 7f8868a61640 1 -- 172.21.15.87:0/1949070829 >> 172.21.15.87:0/1949070829 conn(0x7f88640fa440 msgr2=0x7f88640fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:16.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.638+0000 7f8868a61640 1 -- 172.21.15.87:0/1949070829 shutdown_connections 2024-09-13T17:13:16.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.638+0000 7f8868a61640 1 -- 172.21.15.87:0/1949070829 wait complete. 2024-09-13T17:13:16.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.638+0000 7f8868a61640 1 Processor -- start 2024-09-13T17:13:16.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.638+0000 7f8868a61640 1 -- start start 2024-09-13T17:13:16.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.638+0000 7f8868a61640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88640feca0 0x7f8864195ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:16.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.638+0000 7f8868a61640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88640ffe90 0x7f88641961e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:16.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.638+0000 7f8868a61640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8864100850 0x7f886419d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:16.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.638+0000 7f8868a61640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886419d7b0 con 0x7f8864100850 2024-09-13T17:13:16.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.638+0000 7f8868a61640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886419d920 con 0x7f88640feca0 2024-09-13T17:13:16.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.638+0000 7f8868a61640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886419dae0 con 0x7f88640ffe90 2024-09-13T17:13:16.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.639+0000 7f8862d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8864100850 0x7f886419d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:16.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.639+0000 7f8862d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8864100850 0x7f886419d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43238/0 (socket says 172.21.15.87:43238) 2024-09-13T17:13:16.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.639+0000 7f8862d9d640 1 -- 172.21.15.87:0/2467482342 learned_addr learned my addr 172.21.15.87:0/2467482342 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:16.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.639+0000 7f8861d9b640 1 --2- 172.21.15.87:0/2467482342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88640ffe90 0x7f88641961e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:16.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.639+0000 7f886259c640 1 --2- 172.21.15.87:0/2467482342 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88640feca0 0x7f8864195ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:16.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.639+0000 7f8862d9d640 1 -- 172.21.15.87:0/2467482342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88640ffe90 msgr2=0x7f88641961e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:16.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.639+0000 7f8862d9d640 1 --2- 172.21.15.87:0/2467482342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88640ffe90 0x7f88641961e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.639+0000 7f8862d9d640 1 -- 172.21.15.87:0/2467482342 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88640feca0 msgr2=0x7f8864195ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:16.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.639+0000 7f8862d9d640 1 --2- 172.21.15.87:0/2467482342 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88640feca0 0x7f8864195ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.639+0000 7f8862d9d640 1 -- 172.21.15.87:0/2467482342 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885c009900 con 0x7f8864100850 2024-09-13T17:13:16.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.639+0000 7f886259c640 1 --2- 172.21.15.87:0/2467482342 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88640feca0 0x7f8864195ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:16.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.639+0000 7f8862d9d640 1 --2- 172.21.15.87:0/2467482342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8864100850 0x7f886419d240 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f885c0097b0 tx=0x7f885c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:16.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.639+0000 7f885b7fe640 1 -- 172.21.15.87:0/2467482342 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c0307c0 con 0x7f8864100850 2024-09-13T17:13:16.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.639+0000 7f885b7fe640 1 -- 172.21.15.87:0/2467482342 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f885c040070 con 0x7f8864100850 2024-09-13T17:13:16.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.639+0000 7f8868a61640 1 -- 172.21.15.87:0/2467482342 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f886419dd60 con 0x7f8864100850 2024-09-13T17:13:16.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.639+0000 7f885b7fe640 1 -- 172.21.15.87:0/2467482342 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c004420 con 0x7f8864100850 2024-09-13T17:13:16.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.639+0000 7f8868a61640 1 -- 172.21.15.87:0/2467482342 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f886419e260 con 0x7f8864100850 2024-09-13T17:13:16.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.640+0000 7f8868a61640 1 -- 172.21.15.87:0/2467482342 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88641060b0 con 0x7f8864100850 2024-09-13T17:13:16.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.641+0000 7f885b7fe640 1 -- 172.21.15.87:0/2467482342 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f885c042030 con 0x7f8864100850 2024-09-13T17:13:16.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.642+0000 7f885b7fe640 1 --2- 172.21.15.87:0/2467482342 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f88500a11a0 0x7f88500a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:16.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.642+0000 7f886259c640 1 --2- 172.21.15.87:0/2467482342 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f88500a11a0 0x7f88500a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:16.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.642+0000 7f885b7fe640 1 -- 172.21.15.87:0/2467482342 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f885c0ee3a0 con 0x7f8864100850 2024-09-13T17:13:16.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.642+0000 7f886259c640 1 --2- 172.21.15.87:0/2467482342 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f88500a11a0 0x7f88500a3660 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8864196b70 tx=0x7f884c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:16.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.646+0000 7f885b7fe640 1 -- 172.21.15.87:0/2467482342 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f885c0b77b0 con 0x7f8864100850 2024-09-13T17:13:16.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.843+0000 7f8868a61640 1 -- 172.21.15.87:0/2467482342 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f886402c3e0 con 0x7f8864100850 2024-09-13T17:13:16.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.844+0000 7f885b7fe640 1 -- 172.21.15.87:0/2467482342 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10877 (secure 0 0 0) 0x7f885c0badd0 con 0x7f8864100850 2024-09-13T17:13:16.846 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:13:16.846 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/3674545180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":3674545180},{"type":"v1","addr":"172.21.15.87:6841","nonce":3674545180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:11:23.313609+0000","modified":"2024-09-13T17:11:47.780404+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24484,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6839/3052680456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3052680456},{"type":"v1","addr":"172.21.15.118:6839","nonce":3052680456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:13:16.846 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 23 2024-09-13T17:13:16.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.846+0000 7f8868a61640 1 -- 172.21.15.87:0/2467482342 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f88500a11a0 msgr2=0x7f88500a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:16.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.846+0000 7f8868a61640 1 --2- 172.21.15.87:0/2467482342 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f88500a11a0 0x7f88500a3660 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8864196b70 tx=0x7f884c005f90 comp rx=0 tx=0).stop 2024-09-13T17:13:16.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.846+0000 7f8868a61640 1 -- 172.21.15.87:0/2467482342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8864100850 msgr2=0x7f886419d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:16.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.846+0000 7f8868a61640 1 --2- 172.21.15.87:0/2467482342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8864100850 0x7f886419d240 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f885c0097b0 tx=0x7f885c003c20 comp rx=0 tx=0).stop 2024-09-13T17:13:16.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.846+0000 7f8868a61640 1 -- 172.21.15.87:0/2467482342 shutdown_connections 2024-09-13T17:13:16.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.846+0000 7f8868a61640 1 --2- 172.21.15.87:0/2467482342 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f88500a11a0 0x7f88500a3660 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.846+0000 7f8868a61640 1 --2- 172.21.15.87:0/2467482342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8864100850 0x7f886419d240 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.846+0000 7f8868a61640 1 --2- 172.21.15.87:0/2467482342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88640ffe90 0x7f88641961e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.846+0000 7f8868a61640 1 --2- 172.21.15.87:0/2467482342 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88640feca0 0x7f8864195ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.846+0000 7f8868a61640 1 -- 172.21.15.87:0/2467482342 >> 172.21.15.87:0/2467482342 conn(0x7f88640fa440 msgr2=0x7f8864103280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:16.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.846+0000 7f8868a61640 1 -- 172.21.15.87:0/2467482342 shutdown_connections 2024-09-13T17:13:16.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.846+0000 7f8868a61640 1 -- 172.21.15.87:0/2467482342 wait complete. 2024-09-13T17:13:16.859 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:13:16.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.955+0000 7f3716db5640 1 -- 172.21.15.87:0/4222206228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37100feca0 msgr2=0x7f37100ff0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:16.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.955+0000 7f3716db5640 1 --2- 172.21.15.87:0/4222206228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37100feca0 0x7f37100ff0a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3704009900 tx=0x7f370402a410 comp rx=0 tx=0).stop 2024-09-13T17:13:16.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.955+0000 7f3716db5640 1 -- 172.21.15.87:0/4222206228 shutdown_connections 2024-09-13T17:13:16.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.955+0000 7f3716db5640 1 --2- 172.21.15.87:0/4222206228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3710100850 0x7f37101070e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.955+0000 7f3716db5640 1 --2- 172.21.15.87:0/4222206228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37100ffe90 0x7f3710100310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.955+0000 7f3716db5640 1 --2- 172.21.15.87:0/4222206228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37100feca0 0x7f37100ff0a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.955+0000 7f3716db5640 1 -- 172.21.15.87:0/4222206228 >> 172.21.15.87:0/4222206228 conn(0x7f37100fa440 msgr2=0x7f37100fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:16.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.956+0000 7f3716db5640 1 -- 172.21.15.87:0/4222206228 shutdown_connections 2024-09-13T17:13:16.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.956+0000 7f3716db5640 1 -- 172.21.15.87:0/4222206228 wait complete. 2024-09-13T17:13:16.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.956+0000 7f3716db5640 1 Processor -- start 2024-09-13T17:13:16.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.956+0000 7f3716db5640 1 -- start start 2024-09-13T17:13:16.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.956+0000 7f3716db5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37100feca0 0x7f3710195d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:16.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.956+0000 7f3716db5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37100ffe90 0x7f37101962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:16.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.956+0000 7f3716db5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3710100850 0x7f371019d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:16.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.956+0000 7f3716db5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371019d850 con 0x7f37100ffe90 2024-09-13T17:13:16.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.956+0000 7f3716db5640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371019d9c0 con 0x7f37100feca0 2024-09-13T17:13:16.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.956+0000 7f3716db5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371019db80 con 0x7f3710100850 2024-09-13T17:13:16.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.956+0000 7f370ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37100ffe90 0x7f37101962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:16.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.956+0000 7f370ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37100ffe90 0x7f37101962a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43266/0 (socket says 172.21.15.87:43266) 2024-09-13T17:13:16.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.956+0000 7f370ffff640 1 -- 172.21.15.87:0/4182731417 learned_addr learned my addr 172.21.15.87:0/4182731417 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:16.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.956+0000 7f3715352640 1 --2- 172.21.15.87:0/4182731417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3710100850 0x7f371019d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:16.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.957+0000 7f3714b51640 1 --2- 172.21.15.87:0/4182731417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37100feca0 0x7f3710195d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:16.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.957+0000 7f370ffff640 1 -- 172.21.15.87:0/4182731417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3710100850 msgr2=0x7f371019d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:16.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.957+0000 7f370ffff640 1 --2- 172.21.15.87:0/4182731417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3710100850 0x7f371019d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.957+0000 7f370ffff640 1 -- 172.21.15.87:0/4182731417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37100feca0 msgr2=0x7f3710195d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:16.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.957+0000 7f370ffff640 1 --2- 172.21.15.87:0/4182731417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37100feca0 0x7f3710195d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:16.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.957+0000 7f370ffff640 1 -- 172.21.15.87:0/4182731417 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3704009560 con 0x7f37100ffe90 2024-09-13T17:13:16.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.957+0000 7f3714b51640 1 --2- 172.21.15.87:0/4182731417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37100feca0 0x7f3710195d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:16.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.957+0000 7f370ffff640 1 --2- 172.21.15.87:0/4182731417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37100ffe90 0x7f37101962a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f36fc00e9f0 tx=0x7f36fc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:16.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.957+0000 7f370dffb640 1 -- 172.21.15.87:0/4182731417 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc009720 con 0x7f37100ffe90 2024-09-13T17:13:16.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.957+0000 7f370dffb640 1 -- 172.21.15.87:0/4182731417 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f36fc00cd80 con 0x7f37100ffe90 2024-09-13T17:13:16.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.957+0000 7f3716db5640 1 -- 172.21.15.87:0/4182731417 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f371019de60 con 0x7f37100ffe90 2024-09-13T17:13:16.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.957+0000 7f370dffb640 1 -- 172.21.15.87:0/4182731417 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc010430 con 0x7f37100ffe90 2024-09-13T17:13:16.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.957+0000 7f3716db5640 1 -- 172.21.15.87:0/4182731417 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f371019e290 con 0x7f37100ffe90 2024-09-13T17:13:16.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.958+0000 7f3716db5640 1 -- 172.21.15.87:0/4182731417 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37101061d0 con 0x7f37100ffe90 2024-09-13T17:13:16.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.959+0000 7f370dffb640 1 -- 172.21.15.87:0/4182731417 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f36fc005020 con 0x7f37100ffe90 2024-09-13T17:13:16.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.960+0000 7f370dffb640 1 --2- 172.21.15.87:0/4182731417 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f37000a1120 0x7f37000a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:16.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.960+0000 7f370dffb640 1 -- 172.21.15.87:0/4182731417 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f36fc014070 con 0x7f37100ffe90 2024-09-13T17:13:16.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.960+0000 7f3714b51640 1 --2- 172.21.15.87:0/4182731417 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f37000a1120 0x7f37000a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:16.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.960+0000 7f3714b51640 1 --2- 172.21.15.87:0/4182731417 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f37000a1120 0x7f37000a35e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3704006010 tx=0x7f3704000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:16.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:16.964+0000 7f370dffb640 1 -- 172.21.15.87:0/4182731417 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f36fc096590 con 0x7f37100ffe90 2024-09-13T17:13:17.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.126+0000 7f3716db5640 1 -- 172.21.15.87:0/4182731417 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f371002c3e0 con 0x7f37100ffe90 2024-09-13T17:13:17.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.127+0000 7f370dffb640 1 -- 172.21.15.87:0/4182731417 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+24817 (secure 0 0 0) 0x7f36fc094e60 con 0x7f37100ffe90 2024-09-13T17:13:17.129 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:13:17.130 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":93,"fsid":"043d5bae-71f2-11ef-bceb-c7b262605968","created":"2024-09-13T17:03:57.852010+0000","modified":"2024-09-13T17:12:50.208429+0000","last_up_change":"2024-09-13T17:10:34.423548+0000","last_in_change":"2024-09-13T17:10:14.228123+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:07:02.286400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:11:21.965141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:11:22.504345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:11:25.565163+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58250283-85c0-416e-abdd-1fc5a7ff0c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6803","nonce":1316956138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6805","nonce":1316956138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6809","nonce":1316956138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6807","nonce":1316956138}]},"public_addr":"172.21.15.87:6803/1316956138","cluster_addr":"172.21.15.87:6805/1316956138","heartbeat_back_addr":"172.21.15.87:6809/1316956138","heartbeat_front_addr":"172.21.15.87:6807/1316956138","state":["exists","up"]},{"osd":1,"uuid":"b9d49969-94b1-4262-b4ff-db0a8e3331af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6801","nonce":3352566727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6803","nonce":3352566727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6807","nonce":3352566727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6805","nonce":3352566727}]},"public_addr":"172.21.15.118:6801/3352566727","cluster_addr":"172.21.15.118:6803/3352566727","heartbeat_back_addr":"172.21.15.118:6807/3352566727","heartbeat_front_addr":"172.21.15.118:6805/3352566727","state":["exists","up"]},{"osd":2,"uuid":"ba64549e-d736-426f-b466-f569af5f16d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6801","nonce":2774581686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6803","nonce":2774581686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6807","nonce":2774581686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6805","nonce":2774581686}]},"public_addr":"172.21.15.149:6801/2774581686","cluster_addr":"172.21.15.149:6803/2774581686","heartbeat_back_addr":"172.21.15.149:6807/2774581686","heartbeat_front_addr":"172.21.15.149:6805/2774581686","state":["exists","up"]},{"osd":3,"uuid":"3d5553e5-371b-49fd-976b-9e72a97a2f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6811","nonce":3306119066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6813","nonce":3306119066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6817","nonce":3306119066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6815","nonce":3306119066}]},"public_addr":"172.21.15.87:6811/3306119066","cluster_addr":"172.21.15.87:6813/3306119066","heartbeat_back_addr":"172.21.15.87:6817/3306119066","heartbeat_front_addr":"172.21.15.87:6815/3306119066","state":["exists","up"]},{"osd":4,"uuid":"2fbe0e27-34ec-42a6-9962-f1d8202b3159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6809","nonce":3342349890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6811","nonce":3342349890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6815","nonce":3342349890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6813","nonce":3342349890}]},"public_addr":"172.21.15.118:6809/3342349890","cluster_addr":"172.21.15.118:6811/3342349890","heartbeat_back_addr":"172.21.15.118:6815/3342349890","heartbeat_front_addr":"172.21.15.118:6813/3342349890","state":["exists","up"]},{"osd":5,"uuid":"53c14519-6170-4b5a-a79d-4835882d7bec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6809","nonce":3468867124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6811","nonce":3468867124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6815","nonce":3468867124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6813","nonce":3468867124}]},"public_addr":"172.21.15.149:6809/3468867124","cluster_addr":"172.21.15.149:6811/3468867124","heartbeat_back_addr":"172.21.15.149:6815/3468867124","heartbeat_front_addr":"172.21.15.149:6813/3468867124","state":["exists","up"]},{"osd":6,"uuid":"d3951b32-db77-4b8b-9de0-f05e03d13f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6819","nonce":326563617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6821","nonce":326563617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6825","nonce":326563617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6823","nonce":326563617}]},"public_addr":"172.21.15.87:6819/326563617","cluster_addr":"172.21.15.87:6821/326563617","heartbeat_back_addr":"172.21.15.87:6825/326563617","heartbeat_front_addr":"172.21.15.87:6823/326563617","state":["exists","up"]},{"osd":7,"uuid":"4d46dab7-a8bf-4e3e-b5c0-43860d336bdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6817","nonce":1690268990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6819","nonce":1690268990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6823","nonce":1690268990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6821","nonce":1690268990}]},"public_addr":"172.21.15.118:6817/1690268990","cluster_addr":"172.21.15.118:6819/1690268990","heartbeat_back_addr":"172.21.15.118:6823/1690268990","heartbeat_front_addr":"172.21.15.118:6821/1690268990","state":["exists","up"]},{"osd":8,"uuid":"5a015a7d-60a3-4412-96af-1b61d2ad51f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6817","nonce":1558675380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6819","nonce":1558675380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6823","nonce":1558675380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6821","nonce":1558675380}]},"public_addr":"172.21.15.149:6817/1558675380","cluster_addr":"172.21.15.149:6819/1558675380","heartbeat_back_addr":"172.21.15.149:6823/1558675380","heartbeat_front_addr":"172.21.15.149:6821/1558675380","state":["exists","up"]},{"osd":9,"uuid":"248c0b6e-4c4e-4c63-a0dd-e4cdf3b997a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6827","nonce":1453934262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6829","nonce":1453934262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6833","nonce":1453934262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6831","nonce":1453934262}]},"public_addr":"172.21.15.87:6827/1453934262","cluster_addr":"172.21.15.87:6829/1453934262","heartbeat_back_addr":"172.21.15.87:6833/1453934262","heartbeat_front_addr":"172.21.15.87:6831/1453934262","state":["exists","up"]},{"osd":10,"uuid":"24238714-e737-4371-b5d5-0cd3395f09bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6825","nonce":1034318850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6827","nonce":1034318850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6831","nonce":1034318850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6829","nonce":1034318850}]},"public_addr":"172.21.15.118:6825/1034318850","cluster_addr":"172.21.15.118:6827/1034318850","heartbeat_back_addr":"172.21.15.118:6831/1034318850","heartbeat_front_addr":"172.21.15.118:6829/1034318850","state":["exists","up"]},{"osd":11,"uuid":"409dd3bf-5154-4dea-8708-7de7f9e2e793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6825","nonce":271000465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6827","nonce":271000465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6831","nonce":271000465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6829","nonce":271000465}]},"public_addr":"172.21.15.149:6825/271000465","cluster_addr":"172.21.15.149:6827/271000465","heartbeat_back_addr":"172.21.15.149:6831/271000465","heartbeat_front_addr":"172.21.15.149:6829/271000465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:16.382664+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:37.914250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:00.425876+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:23.960183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:47.004088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:10.214345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:33.719221+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:57.099599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:20.971881+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:44.827167+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:08.135516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:32.085853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.d","mappings":[{"from":1,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8},{"from":5,"to":7}]},{"pgid":"3.28","mappings":[{"from":3,"to":6},{"from":5,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/586423689":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6801/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6800/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/3270371628":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/515676743":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/1475107314":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/553289143":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/3403361612":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6801/1587363880":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6800/1587363880":"2024-09-14T17:04:24.083789+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:13:17.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.129+0000 7f3716db5640 1 -- 172.21.15.87:0/4182731417 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f37000a1120 msgr2=0x7f37000a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:17.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.129+0000 7f3716db5640 1 --2- 172.21.15.87:0/4182731417 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f37000a1120 0x7f37000a35e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3704006010 tx=0x7f3704000bc0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.129+0000 7f3716db5640 1 -- 172.21.15.87:0/4182731417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37100ffe90 msgr2=0x7f37101962a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:17.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.129+0000 7f3716db5640 1 --2- 172.21.15.87:0/4182731417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37100ffe90 0x7f37101962a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f36fc00e9f0 tx=0x7f36fc00edf0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.129+0000 7f3716db5640 1 -- 172.21.15.87:0/4182731417 shutdown_connections 2024-09-13T17:13:17.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.129+0000 7f3716db5640 1 --2- 172.21.15.87:0/4182731417 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f37000a1120 0x7f37000a35e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.129+0000 7f3716db5640 1 --2- 172.21.15.87:0/4182731417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3710100850 0x7f371019d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.129+0000 7f3716db5640 1 --2- 172.21.15.87:0/4182731417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37100ffe90 0x7f37101962a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.129+0000 7f3716db5640 1 --2- 172.21.15.87:0/4182731417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37100feca0 0x7f3710195d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.129+0000 7f3716db5640 1 -- 172.21.15.87:0/4182731417 >> 172.21.15.87:0/4182731417 conn(0x7f37100fa440 msgr2=0x7f37101033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:17.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.129+0000 7f3716db5640 1 -- 172.21.15.87:0/4182731417 shutdown_connections 2024-09-13T17:13:17.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.129+0000 7f3716db5640 1 -- 172.21.15.87:0/4182731417 wait complete. 2024-09-13T17:13:17.143 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:07:02.286400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:11:21.965141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:11:22.504345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:11:25.565163+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:13:17.144 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:13:17.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.245+0000 7ff24fe68640 1 -- 172.21.15.87:0/362440379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff248100f60 msgr2=0x7ff2481013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:17.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.245+0000 7ff24fe68640 1 --2- 172.21.15.87:0/362440379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff248100f60 0x7ff2481013e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff244009900 tx=0x7ff24402a410 comp rx=0 tx=0).stop 2024-09-13T17:13:17.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.245+0000 7ff24fe68640 1 -- 172.21.15.87:0/362440379 shutdown_connections 2024-09-13T17:13:17.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.245+0000 7ff24fe68640 1 --2- 172.21.15.87:0/362440379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff248101920 0x7ff2481081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.245+0000 7ff24fe68640 1 --2- 172.21.15.87:0/362440379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff248100f60 0x7ff2481013e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.245+0000 7ff24fe68640 1 --2- 172.21.15.87:0/362440379 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2480ffd70 0x7ff248100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.245+0000 7ff24fe68640 1 -- 172.21.15.87:0/362440379 >> 172.21.15.87:0/362440379 conn(0x7ff2480fb4d0 msgr2=0x7ff2480fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:17.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.245+0000 7ff24fe68640 1 -- 172.21.15.87:0/362440379 shutdown_connections 2024-09-13T17:13:17.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.245+0000 7ff24fe68640 1 -- 172.21.15.87:0/362440379 wait complete. 2024-09-13T17:13:17.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.245+0000 7ff24fe68640 1 Processor -- start 2024-09-13T17:13:17.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.246+0000 7ff24fe68640 1 -- start start 2024-09-13T17:13:17.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.246+0000 7ff24fe68640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2480ffd70 0x7ff248195d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:17.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.246+0000 7ff24fe68640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff248100f60 0x7ff248196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:17.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.246+0000 7ff24fe68640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff248101920 0x7ff24819d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:17.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.246+0000 7ff24fe68640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff24819d840 con 0x7ff248100f60 2024-09-13T17:13:17.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.246+0000 7ff24fe68640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff24819d9b0 con 0x7ff2480ffd70 2024-09-13T17:13:17.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.246+0000 7ff24fe68640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff24819db70 con 0x7ff248101920 2024-09-13T17:13:17.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.246+0000 7ff24d403640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff248100f60 0x7ff248196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:17.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.246+0000 7ff24d403640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff248100f60 0x7ff248196290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43288/0 (socket says 172.21.15.87:43288) 2024-09-13T17:13:17.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.246+0000 7ff24d403640 1 -- 172.21.15.87:0/35873989 learned_addr learned my addr 172.21.15.87:0/35873989 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:17.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.246+0000 7ff24e405640 1 --2- 172.21.15.87:0/35873989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff248101920 0x7ff24819d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:17.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.246+0000 7ff24dc04640 1 --2- 172.21.15.87:0/35873989 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2480ffd70 0x7ff248195d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:17.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.246+0000 7ff24d403640 1 -- 172.21.15.87:0/35873989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff248101920 msgr2=0x7ff24819d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:17.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.246+0000 7ff24d403640 1 --2- 172.21.15.87:0/35873989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff248101920 0x7ff24819d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.246+0000 7ff24d403640 1 -- 172.21.15.87:0/35873989 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2480ffd70 msgr2=0x7ff248195d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:17.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.246+0000 7ff24d403640 1 --2- 172.21.15.87:0/35873989 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2480ffd70 0x7ff248195d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.246+0000 7ff24d403640 1 -- 172.21.15.87:0/35873989 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff244009560 con 0x7ff248100f60 2024-09-13T17:13:17.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.246+0000 7ff24e405640 1 --2- 172.21.15.87:0/35873989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff248101920 0x7ff24819d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:17.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.246+0000 7ff24d403640 1 --2- 172.21.15.87:0/35873989 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff248100f60 0x7ff248196290 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff244031460 tx=0x7ff244004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:17.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.246+0000 7ff23affd640 1 -- 172.21.15.87:0/35873989 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2440035f0 con 0x7ff248100f60 2024-09-13T17:13:17.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.246+0000 7ff23affd640 1 -- 172.21.15.87:0/35873989 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff244003c00 con 0x7ff248100f60 2024-09-13T17:13:17.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.246+0000 7ff24fe68640 1 -- 172.21.15.87:0/35873989 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff24819ddf0 con 0x7ff248100f60 2024-09-13T17:13:17.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.246+0000 7ff23affd640 1 -- 172.21.15.87:0/35873989 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24403cda0 con 0x7ff248100f60 2024-09-13T17:13:17.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.247+0000 7ff24fe68640 1 -- 172.21.15.87:0/35873989 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff24819e240 con 0x7ff248100f60 2024-09-13T17:13:17.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.247+0000 7ff24fe68640 1 -- 172.21.15.87:0/35873989 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2481072a0 con 0x7ff248100f60 2024-09-13T17:13:17.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.249+0000 7ff23affd640 1 -- 172.21.15.87:0/35873989 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7ff24403c570 con 0x7ff248100f60 2024-09-13T17:13:17.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.249+0000 7ff23affd640 1 --2- 172.21.15.87:0/35873989 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff2340a1120 0x7ff2340a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:17.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.249+0000 7ff24dc04640 1 --2- 172.21.15.87:0/35873989 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff2340a1120 0x7ff2340a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:17.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.249+0000 7ff23affd640 1 -- 172.21.15.87:0/35873989 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7ff2440ee1f0 con 0x7ff248100f60 2024-09-13T17:13:17.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.250+0000 7ff24dc04640 1 --2- 172.21.15.87:0/35873989 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff2340a1120 0x7ff2340a35e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff23c005fd0 tx=0x7ff23c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:17.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.252+0000 7ff23affd640 1 -- 172.21.15.87:0/35873989 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff2440b7450 con 0x7ff248100f60 2024-09-13T17:13:17.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.417+0000 7ff24fe68640 1 -- 172.21.15.87:0/35873989 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff24802c3e0 con 0x7ff248100f60 2024-09-13T17:13:17.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.417+0000 7ff23affd640 1 -- 172.21.15.87:0/35873989 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff244035020 con 0x7ff248100f60 2024-09-13T17:13:17.419 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-09-13T17:13:17.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.419+0000 7ff24fe68640 1 -- 172.21.15.87:0/35873989 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff2340a1120 msgr2=0x7ff2340a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:17.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.419+0000 7ff24fe68640 1 --2- 172.21.15.87:0/35873989 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff2340a1120 0x7ff2340a35e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff23c005fd0 tx=0x7ff23c005850 comp rx=0 tx=0).stop 2024-09-13T17:13:17.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.419+0000 7ff24fe68640 1 -- 172.21.15.87:0/35873989 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff248100f60 msgr2=0x7ff248196290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:17.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.419+0000 7ff24fe68640 1 --2- 172.21.15.87:0/35873989 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff248100f60 0x7ff248196290 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff244031460 tx=0x7ff244004270 comp rx=0 tx=0).stop 2024-09-13T17:13:17.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.419+0000 7ff24fe68640 1 -- 172.21.15.87:0/35873989 shutdown_connections 2024-09-13T17:13:17.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.419+0000 7ff24fe68640 1 --2- 172.21.15.87:0/35873989 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7ff2340a1120 0x7ff2340a35e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.419+0000 7ff24fe68640 1 --2- 172.21.15.87:0/35873989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff248101920 0x7ff24819d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.419+0000 7ff24fe68640 1 --2- 172.21.15.87:0/35873989 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff248100f60 0x7ff248196290 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.419+0000 7ff24fe68640 1 --2- 172.21.15.87:0/35873989 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2480ffd70 0x7ff248195d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.419+0000 7ff24fe68640 1 -- 172.21.15.87:0/35873989 >> 172.21.15.87:0/35873989 conn(0x7ff2480fb4d0 msgr2=0x7ff248104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:17.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.419+0000 7ff24fe68640 1 -- 172.21.15.87:0/35873989 shutdown_connections 2024-09-13T17:13:17.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.420+0000 7ff24fe68640 1 -- 172.21.15.87:0/35873989 wait complete. 2024-09-13T17:13:17.431 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:17 smithi087 ceph-mon[30934]: pgmap v337: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:13:17.431 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:17 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2278362805' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:13:17.431 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:17 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2467482342' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:13:17.431 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:17 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/4182731417' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:13:17.433 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:13:17.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.532+0000 7f7017232640 1 -- 172.21.15.87:0/1804239035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70100fe410 msgr2=0x7f70100fe810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:17.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.532+0000 7f7017232640 1 --2- 172.21.15.87:0/1804239035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70100fe410 0x7f70100fe810 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7008009900 tx=0x7f700802a410 comp rx=0 tx=0).stop 2024-09-13T17:13:17.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.532+0000 7f7017232640 1 -- 172.21.15.87:0/1804239035 shutdown_connections 2024-09-13T17:13:17.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.532+0000 7f7017232640 1 --2- 172.21.15.87:0/1804239035 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70100fffc0 0x7f7010106850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.532+0000 7f7017232640 1 --2- 172.21.15.87:0/1804239035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70100ff600 0x7f70100ffa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.532+0000 7f7017232640 1 --2- 172.21.15.87:0/1804239035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70100fe410 0x7f70100fe810 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.532+0000 7f7017232640 1 -- 172.21.15.87:0/1804239035 >> 172.21.15.87:0/1804239035 conn(0x7f70100f9b70 msgr2=0x7f70100fbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:17.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.532+0000 7f7017232640 1 -- 172.21.15.87:0/1804239035 shutdown_connections 2024-09-13T17:13:17.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.532+0000 7f7017232640 1 -- 172.21.15.87:0/1804239035 wait complete. 2024-09-13T17:13:17.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.532+0000 7f7017232640 1 Processor -- start 2024-09-13T17:13:17.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.532+0000 7f7017232640 1 -- start start 2024-09-13T17:13:17.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.533+0000 7f7017232640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70100fe410 0x7f7010195d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:17.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.533+0000 7f7017232640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70100ff600 0x7f7010196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:17.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.533+0000 7f7017232640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70100fffc0 0x7f701019d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:17.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.533+0000 7f7017232640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701019d800 con 0x7f70100fffc0 2024-09-13T17:13:17.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.533+0000 7f7017232640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701019d970 con 0x7f70100fe410 2024-09-13T17:13:17.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.533+0000 7f7017232640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701019db30 con 0x7f70100ff600 2024-09-13T17:13:17.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.533+0000 7f70157cf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70100fffc0 0x7f701019d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:17.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.533+0000 7f70157cf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70100fffc0 0x7f701019d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43302/0 (socket says 172.21.15.87:43302) 2024-09-13T17:13:17.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.533+0000 7f70157cf640 1 -- 172.21.15.87:0/147733081 learned_addr learned my addr 172.21.15.87:0/147733081 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:17.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.533+0000 7f700ffff640 1 --2- 172.21.15.87:0/147733081 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70100ff600 0x7f7010196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:17.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.533+0000 7f7014fce640 1 --2- 172.21.15.87:0/147733081 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70100fe410 0x7f7010195d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:17.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.533+0000 7f70157cf640 1 -- 172.21.15.87:0/147733081 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70100ff600 msgr2=0x7f7010196260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:17.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.533+0000 7f70157cf640 1 --2- 172.21.15.87:0/147733081 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70100ff600 0x7f7010196260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.533+0000 7f70157cf640 1 -- 172.21.15.87:0/147733081 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70100fe410 msgr2=0x7f7010195d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:17.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.533+0000 7f70157cf640 1 --2- 172.21.15.87:0/147733081 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70100fe410 0x7f7010195d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.533+0000 7f70157cf640 1 -- 172.21.15.87:0/147733081 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7008009560 con 0x7f70100fffc0 2024-09-13T17:13:17.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.533+0000 7f700ffff640 1 --2- 172.21.15.87:0/147733081 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70100ff600 0x7f7010196260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:17.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.533+0000 7f70157cf640 1 --2- 172.21.15.87:0/147733081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70100fffc0 0x7f701019d290 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6ff800c970 tx=0x7f6ff800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:17.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.533+0000 7f700dffb640 1 -- 172.21.15.87:0/147733081 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff8007bb0 con 0x7f70100fffc0 2024-09-13T17:13:17.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.533+0000 7f700dffb640 1 -- 172.21.15.87:0/147733081 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6ff8007d10 con 0x7f70100fffc0 2024-09-13T17:13:17.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.533+0000 7f700dffb640 1 -- 172.21.15.87:0/147733081 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff8004e40 con 0x7f70100fffc0 2024-09-13T17:13:17.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.533+0000 7f7017232640 1 -- 172.21.15.87:0/147733081 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f701019de10 con 0x7f70100fffc0 2024-09-13T17:13:17.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.534+0000 7f7017232640 1 -- 172.21.15.87:0/147733081 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f701019e1e0 con 0x7f70100fffc0 2024-09-13T17:13:17.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.534+0000 7f7017232640 1 -- 172.21.15.87:0/147733081 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70100fe810 con 0x7f70100fffc0 2024-09-13T17:13:17.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.535+0000 7f700dffb640 1 -- 172.21.15.87:0/147733081 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f6ff8004fa0 con 0x7f70100fffc0 2024-09-13T17:13:17.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.536+0000 7f700dffb640 1 --2- 172.21.15.87:0/147733081 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f6ffc0a1120 0x7f6ffc0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:17.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.536+0000 7f7014fce640 1 --2- 172.21.15.87:0/147733081 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f6ffc0a1120 0x7f6ffc0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:17.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.536+0000 7f700dffb640 1 -- 172.21.15.87:0/147733081 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f6ff80cd020 con 0x7f70100fffc0 2024-09-13T17:13:17.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.537+0000 7f7014fce640 1 --2- 172.21.15.87:0/147733081 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f6ffc0a1120 0x7f6ffc0a35e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7008031460 tx=0x7f7008000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:17.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.540+0000 7f700dffb640 1 -- 172.21.15.87:0/147733081 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6ff80961f0 con 0x7f70100fffc0 2024-09-13T17:13:17.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:17 smithi149 ceph-mon[35496]: pgmap v337: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:13:17.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:17 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2278362805' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:13:17.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:17 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2467482342' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:13:17.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:17 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/4182731417' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:13:17.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:17 smithi118 ceph-mon[34374]: pgmap v337: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:13:17.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:17 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2278362805' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:13:17.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:17 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2467482342' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:13:17.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:17 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/4182731417' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:13:17.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.701+0000 7f7017232640 1 -- 172.21.15.87:0/147733081 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f701010b890 con 0x7f70100fffc0 2024-09-13T17:13:17.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.702+0000 7f700dffb640 1 -- 172.21.15.87:0/147733081 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6ff801d020 con 0x7f70100fffc0 2024-09-13T17:13:17.704 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-09-13T17:13:17.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.704+0000 7f7017232640 1 -- 172.21.15.87:0/147733081 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f6ffc0a1120 msgr2=0x7f6ffc0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:17.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.704+0000 7f7017232640 1 --2- 172.21.15.87:0/147733081 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f6ffc0a1120 0x7f6ffc0a35e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7008031460 tx=0x7f7008000bc0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.704+0000 7f7017232640 1 -- 172.21.15.87:0/147733081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70100fffc0 msgr2=0x7f701019d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:17.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.704+0000 7f7017232640 1 --2- 172.21.15.87:0/147733081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70100fffc0 0x7f701019d290 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6ff800c970 tx=0x7f6ff800ce30 comp rx=0 tx=0).stop 2024-09-13T17:13:17.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.704+0000 7f7017232640 1 -- 172.21.15.87:0/147733081 shutdown_connections 2024-09-13T17:13:17.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.704+0000 7f7017232640 1 --2- 172.21.15.87:0/147733081 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f6ffc0a1120 0x7f6ffc0a35e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.704+0000 7f7017232640 1 --2- 172.21.15.87:0/147733081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70100fffc0 0x7f701019d290 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.704+0000 7f7017232640 1 --2- 172.21.15.87:0/147733081 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70100ff600 0x7f7010196260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.704+0000 7f7017232640 1 --2- 172.21.15.87:0/147733081 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70100fe410 0x7f7010195d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.704+0000 7f7017232640 1 -- 172.21.15.87:0/147733081 >> 172.21.15.87:0/147733081 conn(0x7f70100f9b70 msgr2=0x7f7010102a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:17.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.704+0000 7f7017232640 1 -- 172.21.15.87:0/147733081 shutdown_connections 2024-09-13T17:13:17.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.704+0000 7f7017232640 1 -- 172.21.15.87:0/147733081 wait complete. 2024-09-13T17:13:17.717 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:13:17.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.818+0000 7f29af4e9640 1 -- 172.21.15.87:0/273597744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29a80fec60 msgr2=0x7f29a80ff060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:17.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.818+0000 7f29af4e9640 1 --2- 172.21.15.87:0/273597744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29a80fec60 0x7f29a80ff060 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f299c009900 tx=0x7f299c02a410 comp rx=0 tx=0).stop 2024-09-13T17:13:17.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.819+0000 7f29af4e9640 1 -- 172.21.15.87:0/273597744 shutdown_connections 2024-09-13T17:13:17.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.819+0000 7f29af4e9640 1 --2- 172.21.15.87:0/273597744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29a8100810 0x7f29a81070a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.819+0000 7f29af4e9640 1 --2- 172.21.15.87:0/273597744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29a80ffe50 0x7f29a81002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.819+0000 7f29af4e9640 1 --2- 172.21.15.87:0/273597744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29a80fec60 0x7f29a80ff060 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.819+0000 7f29af4e9640 1 -- 172.21.15.87:0/273597744 >> 172.21.15.87:0/273597744 conn(0x7f29a80fa3e0 msgr2=0x7f29a80fc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:17.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.819+0000 7f29af4e9640 1 -- 172.21.15.87:0/273597744 shutdown_connections 2024-09-13T17:13:17.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.819+0000 7f29af4e9640 1 -- 172.21.15.87:0/273597744 wait complete. 2024-09-13T17:13:17.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.819+0000 7f29af4e9640 1 Processor -- start 2024-09-13T17:13:17.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.819+0000 7f29af4e9640 1 -- start start 2024-09-13T17:13:17.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.819+0000 7f29af4e9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29a80fec60 0x7f29a80680c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:17.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.819+0000 7f29af4e9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29a80ffe50 0x7f29a819ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:17.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.819+0000 7f29af4e9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29a8100810 0x7f29a819d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:17.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.819+0000 7f29af4e9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a819d8e0 con 0x7f29a8100810 2024-09-13T17:13:17.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.819+0000 7f29af4e9640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a819da50 con 0x7f29a80fec60 2024-09-13T17:13:17.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.819+0000 7f29af4e9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a819dc10 con 0x7f29a80ffe50 2024-09-13T17:13:17.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.819+0000 7f29ada86640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29a8100810 0x7f29a819d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:17.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.819+0000 7f29ada86640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29a8100810 0x7f29a819d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43320/0 (socket says 172.21.15.87:43320) 2024-09-13T17:13:17.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.820+0000 7f29ada86640 1 -- 172.21.15.87:0/1469061426 learned_addr learned my addr 172.21.15.87:0/1469061426 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:17.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.820+0000 7f29aca84640 1 --2- 172.21.15.87:0/1469061426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29a80ffe50 0x7f29a819ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:17.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.820+0000 7f29ada86640 1 -- 172.21.15.87:0/1469061426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29a80ffe50 msgr2=0x7f29a819ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:17.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.820+0000 7f29ada86640 1 --2- 172.21.15.87:0/1469061426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29a80ffe50 0x7f29a819ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.820+0000 7f29ada86640 1 -- 172.21.15.87:0/1469061426 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29a80fec60 msgr2=0x7f29a80680c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:17.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.820+0000 7f29ad285640 1 --2- 172.21.15.87:0/1469061426 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29a80fec60 0x7f29a80680c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:17.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.820+0000 7f29ada86640 1 --2- 172.21.15.87:0/1469061426 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29a80fec60 0x7f29a80680c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.820+0000 7f29ada86640 1 -- 172.21.15.87:0/1469061426 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299c009560 con 0x7f29a8100810 2024-09-13T17:13:17.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.820+0000 7f29ada86640 1 --2- 172.21.15.87:0/1469061426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29a8100810 0x7f29a819d150 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f29a000cad0 tx=0x7f29a000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:17.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.820+0000 7f299a7fc640 1 -- 172.21.15.87:0/1469061426 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a000ae20 con 0x7f29a8100810 2024-09-13T17:13:17.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.820+0000 7f299a7fc640 1 -- 172.21.15.87:0/1469061426 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f29a0005020 con 0x7f29a8100810 2024-09-13T17:13:17.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.820+0000 7f29af4e9640 1 -- 172.21.15.87:0/1469061426 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29a819def0 con 0x7f29a8100810 2024-09-13T17:13:17.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.820+0000 7f299a7fc640 1 -- 172.21.15.87:0/1469061426 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a000f690 con 0x7f29a8100810 2024-09-13T17:13:17.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.820+0000 7f29af4e9640 1 -- 172.21.15.87:0/1469061426 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29a819e370 con 0x7f29a8100810 2024-09-13T17:13:17.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.821+0000 7f29af4e9640 1 -- 172.21.15.87:0/1469061426 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29a8106160 con 0x7f29a8100810 2024-09-13T17:13:17.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.822+0000 7f299a7fc640 1 -- 172.21.15.87:0/1469061426 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f29a0005190 con 0x7f29a8100810 2024-09-13T17:13:17.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.823+0000 7f299a7fc640 1 --2- 172.21.15.87:0/1469061426 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f29940a11a0 0x7f29940a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:17.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.823+0000 7f29ad285640 1 --2- 172.21.15.87:0/1469061426 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f29940a11a0 0x7f29940a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:17.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.823+0000 7f299a7fc640 1 -- 172.21.15.87:0/1469061426 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f29a00cd250 con 0x7f29a8100810 2024-09-13T17:13:17.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.823+0000 7f29ad285640 1 --2- 172.21.15.87:0/1469061426 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f29940a11a0 0x7f29940a3660 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f299c031460 tx=0x7f299c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:17.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.826+0000 7f299a7fc640 1 -- 172.21.15.87:0/1469061426 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f29a0096530 con 0x7f29a8100810 2024-09-13T17:13:17.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.986+0000 7f29af4e9640 1 -- 172.21.15.87:0/1469061426 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f29a802c410 con 0x7f29a8100810 2024-09-13T17:13:17.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.987+0000 7f299a7fc640 1 -- 172.21.15.87:0/1469061426 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) v1 ==== 100+0+11 (secure 0 0 0) 0x7f29a001d070 con 0x7f29a8100810 2024-09-13T17:13:17.989 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-09-13T17:13:17.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.989+0000 7f29af4e9640 1 -- 172.21.15.87:0/1469061426 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f29940a11a0 msgr2=0x7f29940a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:17.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.989+0000 7f29af4e9640 1 --2- 172.21.15.87:0/1469061426 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f29940a11a0 0x7f29940a3660 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f299c031460 tx=0x7f299c000bc0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.989+0000 7f29af4e9640 1 -- 172.21.15.87:0/1469061426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29a8100810 msgr2=0x7f29a819d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:17.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.989+0000 7f29af4e9640 1 --2- 172.21.15.87:0/1469061426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29a8100810 0x7f29a819d150 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f29a000cad0 tx=0x7f29a000cf90 comp rx=0 tx=0).stop 2024-09-13T17:13:17.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.989+0000 7f29af4e9640 1 -- 172.21.15.87:0/1469061426 shutdown_connections 2024-09-13T17:13:17.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.989+0000 7f29af4e9640 1 --2- 172.21.15.87:0/1469061426 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f29940a11a0 0x7f29940a3660 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.989+0000 7f29af4e9640 1 --2- 172.21.15.87:0/1469061426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29a8100810 0x7f29a819d150 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.989+0000 7f29af4e9640 1 --2- 172.21.15.87:0/1469061426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29a80ffe50 0x7f29a819ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.989+0000 7f29af4e9640 1 --2- 172.21.15.87:0/1469061426 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29a80fec60 0x7f29a80680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:17.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.989+0000 7f29af4e9640 1 -- 172.21.15.87:0/1469061426 >> 172.21.15.87:0/1469061426 conn(0x7f29a80fa3e0 msgr2=0x7f29a8103330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:17.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.989+0000 7f29af4e9640 1 -- 172.21.15.87:0/1469061426 shutdown_connections 2024-09-13T17:13:17.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:17.989+0000 7f29af4e9640 1 -- 172.21.15.87:0/1469061426 wait complete. 2024-09-13T17:13:18.001 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:13:18.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.119+0000 7f33bed4c640 1 -- 172.21.15.87:0/1132007172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33b80fec60 msgr2=0x7f33b80ff060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:18.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.120+0000 7f33bed4c640 1 --2- 172.21.15.87:0/1132007172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33b80fec60 0x7f33b80ff060 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f33ac009900 tx=0x7f33ac02a410 comp rx=0 tx=0).stop 2024-09-13T17:13:18.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.120+0000 7f33bed4c640 1 -- 172.21.15.87:0/1132007172 shutdown_connections 2024-09-13T17:13:18.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.120+0000 7f33bed4c640 1 --2- 172.21.15.87:0/1132007172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33b8100810 0x7f33b81070a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.120+0000 7f33bed4c640 1 --2- 172.21.15.87:0/1132007172 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33b80ffe50 0x7f33b81002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.120+0000 7f33bed4c640 1 --2- 172.21.15.87:0/1132007172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33b80fec60 0x7f33b80ff060 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.120+0000 7f33bed4c640 1 -- 172.21.15.87:0/1132007172 >> 172.21.15.87:0/1132007172 conn(0x7f33b80fa3e0 msgr2=0x7f33b80fc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:18.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.120+0000 7f33bed4c640 1 -- 172.21.15.87:0/1132007172 shutdown_connections 2024-09-13T17:13:18.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.120+0000 7f33bed4c640 1 -- 172.21.15.87:0/1132007172 wait complete. 2024-09-13T17:13:18.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.120+0000 7f33bed4c640 1 Processor -- start 2024-09-13T17:13:18.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.120+0000 7f33bed4c640 1 -- start start 2024-09-13T17:13:18.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.120+0000 7f33bed4c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33b80fec60 0x7f33b8068110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:18.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.120+0000 7f33bed4c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33b80ffe50 0x7f33b819aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:18.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.120+0000 7f33bed4c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33b8100810 0x7f33b819d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:18.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.120+0000 7f33bed4c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b819d8d0 con 0x7f33b8100810 2024-09-13T17:13:18.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.120+0000 7f33bed4c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b819da40 con 0x7f33b80ffe50 2024-09-13T17:13:18.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.120+0000 7f33bed4c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b819dc00 con 0x7f33b80fec60 2024-09-13T17:13:18.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.121+0000 7f33bd2e9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33b8100810 0x7f33b819d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:18.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.121+0000 7f33bd2e9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33b8100810 0x7f33b819d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43340/0 (socket says 172.21.15.87:43340) 2024-09-13T17:13:18.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.121+0000 7f33bd2e9640 1 -- 172.21.15.87:0/2347985811 learned_addr learned my addr 172.21.15.87:0/2347985811 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:18.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.121+0000 7f33bcae8640 1 --2- 172.21.15.87:0/2347985811 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33b80fec60 0x7f33b8068110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:18.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.121+0000 7f33b7fff640 1 --2- 172.21.15.87:0/2347985811 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33b80ffe50 0x7f33b819aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:18.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.121+0000 7f33bd2e9640 1 -- 172.21.15.87:0/2347985811 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33b80fec60 msgr2=0x7f33b8068110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:18.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.121+0000 7f33bd2e9640 1 --2- 172.21.15.87:0/2347985811 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33b80fec60 0x7f33b8068110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.121+0000 7f33bd2e9640 1 -- 172.21.15.87:0/2347985811 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33b80ffe50 msgr2=0x7f33b819aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:18.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.121+0000 7f33bd2e9640 1 --2- 172.21.15.87:0/2347985811 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33b80ffe50 0x7f33b819aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.121+0000 7f33bd2e9640 1 -- 172.21.15.87:0/2347985811 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ac009560 con 0x7f33b8100810 2024-09-13T17:13:18.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.121+0000 7f33b7fff640 1 --2- 172.21.15.87:0/2347985811 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33b80ffe50 0x7f33b819aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:18.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.121+0000 7f33bd2e9640 1 --2- 172.21.15.87:0/2347985811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33b8100810 0x7f33b819d0f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f33b000eaa0 tx=0x7f33b000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:18.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.121+0000 7f33b5ffb640 1 -- 172.21.15.87:0/2347985811 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b000cdb0 con 0x7f33b8100810 2024-09-13T17:13:18.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.121+0000 7f33b5ffb640 1 -- 172.21.15.87:0/2347985811 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f33b0005020 con 0x7f33b8100810 2024-09-13T17:13:18.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.121+0000 7f33bed4c640 1 -- 172.21.15.87:0/2347985811 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b819de80 con 0x7f33b8100810 2024-09-13T17:13:18.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.121+0000 7f33b5ffb640 1 -- 172.21.15.87:0/2347985811 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b00116b0 con 0x7f33b8100810 2024-09-13T17:13:18.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.121+0000 7f33bed4c640 1 -- 172.21.15.87:0/2347985811 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b819e2b0 con 0x7f33b8100810 2024-09-13T17:13:18.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.122+0000 7f33bed4c640 1 -- 172.21.15.87:0/2347985811 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33b81060e0 con 0x7f33b8100810 2024-09-13T17:13:18.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.123+0000 7f33b5ffb640 1 -- 172.21.15.87:0/2347985811 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f33b0005190 con 0x7f33b8100810 2024-09-13T17:13:18.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.124+0000 7f33b5ffb640 1 --2- 172.21.15.87:0/2347985811 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f33a80a1120 0x7f33a80a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:18.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.124+0000 7f33bcae8640 1 --2- 172.21.15.87:0/2347985811 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f33a80a1120 0x7f33a80a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:18.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.124+0000 7f33b5ffb640 1 -- 172.21.15.87:0/2347985811 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f33b00cd060 con 0x7f33b8100810 2024-09-13T17:13:18.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.125+0000 7f33bcae8640 1 --2- 172.21.15.87:0/2347985811 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f33a80a1120 0x7f33a80a35e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f33ac005940 tx=0x7f33ac0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:18.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.128+0000 7f33b5ffb640 1 -- 172.21.15.87:0/2347985811 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f33b00962c0 con 0x7f33b8100810 2024-09-13T17:13:18.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.294+0000 7f33b5ffb640 1 -- 172.21.15.87:0/2347985811 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f33b0096690 con 0x7f33b8100810 2024-09-13T17:13:18.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.297+0000 7f33bed4c640 1 -- 172.21.15.87:0/2347985811 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f33b8105b50 con 0x7f33b8100810 2024-09-13T17:13:18.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.297+0000 7f33b5ffb640 1 -- 172.21.15.87:0/2347985811 <== mon.0 v2:172.21.15.87:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v93) v1 ==== 103+0+11 (secure 0 0 0) 0x7f33b005f470 con 0x7f33b8100810 2024-09-13T17:13:18.299 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-09-13T17:13:18.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.299+0000 7f33bed4c640 1 -- 172.21.15.87:0/2347985811 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f33a80a1120 msgr2=0x7f33a80a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:18.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.299+0000 7f33bed4c640 1 --2- 172.21.15.87:0/2347985811 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f33a80a1120 0x7f33a80a35e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f33ac005940 tx=0x7f33ac0058d0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.299+0000 7f33bed4c640 1 -- 172.21.15.87:0/2347985811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33b8100810 msgr2=0x7f33b819d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:18.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.299+0000 7f33bed4c640 1 --2- 172.21.15.87:0/2347985811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33b8100810 0x7f33b819d0f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f33b000eaa0 tx=0x7f33b000ef60 comp rx=0 tx=0).stop 2024-09-13T17:13:18.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.299+0000 7f33bed4c640 1 -- 172.21.15.87:0/2347985811 shutdown_connections 2024-09-13T17:13:18.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.299+0000 7f33bed4c640 1 --2- 172.21.15.87:0/2347985811 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f33a80a1120 0x7f33a80a35e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.299+0000 7f33bed4c640 1 --2- 172.21.15.87:0/2347985811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33b8100810 0x7f33b819d0f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.299+0000 7f33bed4c640 1 --2- 172.21.15.87:0/2347985811 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33b80ffe50 0x7f33b819aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.299+0000 7f33bed4c640 1 --2- 172.21.15.87:0/2347985811 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33b80fec60 0x7f33b8068110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.299+0000 7f33bed4c640 1 -- 172.21.15.87:0/2347985811 >> 172.21.15.87:0/2347985811 conn(0x7f33b80fa3e0 msgr2=0x7f33b81032b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:18.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.299+0000 7f33bed4c640 1 -- 172.21.15.87:0/2347985811 shutdown_connections 2024-09-13T17:13:18.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.299+0000 7f33bed4c640 1 -- 172.21.15.87:0/2347985811 wait complete. 2024-09-13T17:13:18.312 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:13:18.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.408+0000 7f0bdb6f7640 1 -- 172.21.15.87:0/3255063161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bd41031e0 msgr2=0x7f0bd41055d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:18.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.408+0000 7f0bdb6f7640 1 --2- 172.21.15.87:0/3255063161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bd41031e0 0x7f0bd41055d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4009900 tx=0x7f0bc402a410 comp rx=0 tx=0).stop 2024-09-13T17:13:18.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.408+0000 7f0bdb6f7640 1 -- 172.21.15.87:0/3255063161 shutdown_connections 2024-09-13T17:13:18.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.408+0000 7f0bdb6f7640 1 --2- 172.21.15.87:0/3255063161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bd4105b10 0x7f0bd4107f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.408+0000 7f0bdb6f7640 1 --2- 172.21.15.87:0/3255063161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bd41031e0 0x7f0bd41055d0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.408+0000 7f0bdb6f7640 1 --2- 172.21.15.87:0/3255063161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bd41008b0 0x7f0bd4102ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.408+0000 7f0bdb6f7640 1 -- 172.21.15.87:0/3255063161 >> 172.21.15.87:0/3255063161 conn(0x7f0bd40fa430 msgr2=0x7f0bd40fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:18.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.408+0000 7f0bdb6f7640 1 -- 172.21.15.87:0/3255063161 shutdown_connections 2024-09-13T17:13:18.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.408+0000 7f0bdb6f7640 1 -- 172.21.15.87:0/3255063161 wait complete. 2024-09-13T17:13:18.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.409+0000 7f0bdb6f7640 1 Processor -- start 2024-09-13T17:13:18.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.409+0000 7f0bdb6f7640 1 -- start start 2024-09-13T17:13:18.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.409+0000 7f0bdb6f7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bd41008b0 0x7f0bd4195e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:18.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.409+0000 7f0bdb6f7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bd41031e0 0x7f0bd41963c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:18.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.409+0000 7f0bdb6f7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bd4105b10 0x7f0bd419d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:18.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.409+0000 7f0bdb6f7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd419d970 con 0x7f0bd4105b10 2024-09-13T17:13:18.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.409+0000 7f0bdb6f7640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd419dae0 con 0x7f0bd41031e0 2024-09-13T17:13:18.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.409+0000 7f0bdb6f7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd419dca0 con 0x7f0bd41008b0 2024-09-13T17:13:18.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.409+0000 7f0bd9c94640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bd4105b10 0x7f0bd419d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:18.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.409+0000 7f0bd9c94640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bd4105b10 0x7f0bd419d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43354/0 (socket says 172.21.15.87:43354) 2024-09-13T17:13:18.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.409+0000 7f0bd9c94640 1 -- 172.21.15.87:0/1095575347 learned_addr learned my addr 172.21.15.87:0/1095575347 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:18.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.409+0000 7f0bd9493640 1 --2- 172.21.15.87:0/1095575347 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bd41008b0 0x7f0bd4195e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:18.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.409+0000 7f0bd8c92640 1 --2- 172.21.15.87:0/1095575347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bd41031e0 0x7f0bd41963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:18.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.409+0000 7f0bd9c94640 1 -- 172.21.15.87:0/1095575347 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bd41008b0 msgr2=0x7f0bd4195e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:18.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.409+0000 7f0bd9c94640 1 --2- 172.21.15.87:0/1095575347 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bd41008b0 0x7f0bd4195e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.409+0000 7f0bd9c94640 1 -- 172.21.15.87:0/1095575347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bd41031e0 msgr2=0x7f0bd41963c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:18.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.409+0000 7f0bd9c94640 1 --2- 172.21.15.87:0/1095575347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bd41031e0 0x7f0bd41963c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.409+0000 7f0bd9c94640 1 -- 172.21.15.87:0/1095575347 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc4009560 con 0x7f0bd4105b10 2024-09-13T17:13:18.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.409+0000 7f0bd9493640 1 --2- 172.21.15.87:0/1095575347 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bd41008b0 0x7f0bd4195e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:18.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.409+0000 7f0bd9c94640 1 --2- 172.21.15.87:0/1095575347 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bd4105b10 0x7f0bd419d430 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc00ccb0 tx=0x7f0bcc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:18.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.409+0000 7f0bca7fc640 1 -- 172.21.15.87:0/1095575347 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc00f450 con 0x7f0bd4105b10 2024-09-13T17:13:18.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.410+0000 7f0bca7fc640 1 -- 172.21.15.87:0/1095575347 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0bcc00fa60 con 0x7f0bd4105b10 2024-09-13T17:13:18.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.410+0000 7f0bca7fc640 1 -- 172.21.15.87:0/1095575347 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc018a80 con 0x7f0bd4105b10 2024-09-13T17:13:18.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.410+0000 7f0bdb6f7640 1 -- 172.21.15.87:0/1095575347 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bd419df80 con 0x7f0bd4105b10 2024-09-13T17:13:18.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.410+0000 7f0bdb6f7640 1 -- 172.21.15.87:0/1095575347 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bd419e3b0 con 0x7f0bd4105b10 2024-09-13T17:13:18.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.410+0000 7f0bdb6f7640 1 -- 172.21.15.87:0/1095575347 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bd40fbf20 con 0x7f0bd4105b10 2024-09-13T17:13:18.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.412+0000 7f0bca7fc640 1 -- 172.21.15.87:0/1095575347 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0bcc00fbd0 con 0x7f0bd4105b10 2024-09-13T17:13:18.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.412+0000 7f0bca7fc640 1 --2- 172.21.15.87:0/1095575347 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0bc00a1090 0x7f0bc00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:18.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.413+0000 7f0bd9493640 1 --2- 172.21.15.87:0/1095575347 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0bc00a1090 0x7f0bc00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:18.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.413+0000 7f0bca7fc640 1 -- 172.21.15.87:0/1095575347 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f0bcc0cd1c0 con 0x7f0bd4105b10 2024-09-13T17:13:18.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.413+0000 7f0bd9493640 1 --2- 172.21.15.87:0/1095575347 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0bc00a1090 0x7f0bc00a3550 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0009930 tx=0x7f0bd0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:18.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.417+0000 7f0bca7fc640 1 -- 172.21.15.87:0/1095575347 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0bcc096580 con 0x7f0bd4105b10 2024-09-13T17:13:18.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:18 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/35873989' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:13:18.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:18 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/147733081' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:13:18.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:18 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1469061426' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:13:18.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:18 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/35873989' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:13:18.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:18 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/147733081' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:13:18.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:18 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1469061426' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:13:18.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.612+0000 7f0bdb6f7640 1 -- 172.21.15.87:0/1095575347 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0bd402c480 con 0x7f0bd4105b10 2024-09-13T17:13:18.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.612+0000 7f0bca7fc640 1 -- 172.21.15.87:0/1095575347 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10877 (secure 0 0 0) 0x7f0bcc099ba0 con 0x7f0bd4105b10 2024-09-13T17:13:18.615 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:13:18.615 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/3674545180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":3674545180},{"type":"v1","addr":"172.21.15.87:6841","nonce":3674545180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:11:23.313609+0000","modified":"2024-09-13T17:11:47.780404+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24484,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6839/3052680456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3052680456},{"type":"v1","addr":"172.21.15.118:6839","nonce":3052680456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:13:18.617 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 23 2024-09-13T17:13:18.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.614+0000 7f0bdb6f7640 1 -- 172.21.15.87:0/1095575347 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0bc00a1090 msgr2=0x7f0bc00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:18.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.614+0000 7f0bdb6f7640 1 --2- 172.21.15.87:0/1095575347 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0bc00a1090 0x7f0bc00a3550 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0009930 tx=0x7f0bd0008040 comp rx=0 tx=0).stop 2024-09-13T17:13:18.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.614+0000 7f0bdb6f7640 1 -- 172.21.15.87:0/1095575347 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bd4105b10 msgr2=0x7f0bd419d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:18.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.614+0000 7f0bdb6f7640 1 --2- 172.21.15.87:0/1095575347 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bd4105b10 0x7f0bd419d430 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc00ccb0 tx=0x7f0bcc00a620 comp rx=0 tx=0).stop 2024-09-13T17:13:18.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.614+0000 7f0bdb6f7640 1 -- 172.21.15.87:0/1095575347 shutdown_connections 2024-09-13T17:13:18.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.614+0000 7f0bdb6f7640 1 --2- 172.21.15.87:0/1095575347 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0bc00a1090 0x7f0bc00a3550 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.614+0000 7f0bdb6f7640 1 --2- 172.21.15.87:0/1095575347 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bd4105b10 0x7f0bd419d430 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.614+0000 7f0bdb6f7640 1 --2- 172.21.15.87:0/1095575347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bd41031e0 0x7f0bd41963c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.614+0000 7f0bdb6f7640 1 --2- 172.21.15.87:0/1095575347 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bd41008b0 0x7f0bd4195e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.614+0000 7f0bdb6f7640 1 -- 172.21.15.87:0/1095575347 >> 172.21.15.87:0/1095575347 conn(0x7f0bd40fa430 msgr2=0x7f0bd41012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:18.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.614+0000 7f0bdb6f7640 1 -- 172.21.15.87:0/1095575347 shutdown_connections 2024-09-13T17:13:18.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.614+0000 7f0bdb6f7640 1 -- 172.21.15.87:0/1095575347 wait complete. 2024-09-13T17:13:18.626 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:18 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/35873989' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:13:18.626 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:18 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/147733081' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:13:18.626 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:18 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1469061426' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:13:18.628 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:13:18.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.724+0000 7f718b2f7640 1 -- 172.21.15.87:0/3029322095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71840fe7e0 msgr2=0x7f7184108390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:18.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.724+0000 7f718b2f7640 1 --2- 172.21.15.87:0/3029322095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71840fe7e0 0x7f7184108390 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7174009ca0 tx=0x7f717402a8c0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.724+0000 7f718b2f7640 1 -- 172.21.15.87:0/3029322095 shutdown_connections 2024-09-13T17:13:18.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.724+0000 7f718b2f7640 1 --2- 172.21.15.87:0/3029322095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71840fe7e0 0x7f7184108390 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.724+0000 7f718b2f7640 1 --2- 172.21.15.87:0/3029322095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71840fde20 0x7f71840fe2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.724+0000 7f718b2f7640 1 --2- 172.21.15.87:0/3029322095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71841013b0 0x7f71841017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.724+0000 7f718b2f7640 1 -- 172.21.15.87:0/3029322095 >> 172.21.15.87:0/3029322095 conn(0x7f71840f9bb0 msgr2=0x7f71840fbfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:18.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.724+0000 7f718b2f7640 1 -- 172.21.15.87:0/3029322095 shutdown_connections 2024-09-13T17:13:18.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.724+0000 7f718b2f7640 1 -- 172.21.15.87:0/3029322095 wait complete. 2024-09-13T17:13:18.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.725+0000 7f718b2f7640 1 Processor -- start 2024-09-13T17:13:18.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.725+0000 7f718b2f7640 1 -- start start 2024-09-13T17:13:18.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.725+0000 7f718b2f7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71840fde20 0x7f7184195df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:18.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.725+0000 7f718b2f7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71840fe7e0 0x7f7184196330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:18.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.725+0000 7f718b2f7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71841013b0 0x7f718419d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:18.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.725+0000 7f718b2f7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718419d8e0 con 0x7f71840fde20 2024-09-13T17:13:18.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.725+0000 7f718b2f7640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718419da50 con 0x7f71840fe7e0 2024-09-13T17:13:18.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.725+0000 7f718b2f7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718419dc10 con 0x7f71841013b0 2024-09-13T17:13:18.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.725+0000 7f7189093640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71840fde20 0x7f7184195df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:18.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.725+0000 7f7189093640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71840fde20 0x7f7184195df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43382/0 (socket says 172.21.15.87:43382) 2024-09-13T17:13:18.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.725+0000 7f7189093640 1 -- 172.21.15.87:0/2772247247 learned_addr learned my addr 172.21.15.87:0/2772247247 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:18.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.725+0000 7f7188892640 1 --2- 172.21.15.87:0/2772247247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71840fe7e0 0x7f7184196330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:18.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.725+0000 7f7189894640 1 --2- 172.21.15.87:0/2772247247 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71841013b0 0x7f718419d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:18.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.725+0000 7f7189093640 1 -- 172.21.15.87:0/2772247247 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71841013b0 msgr2=0x7f718419d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:18.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.725+0000 7f7189093640 1 --2- 172.21.15.87:0/2772247247 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71841013b0 0x7f718419d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.725+0000 7f7189093640 1 -- 172.21.15.87:0/2772247247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71840fe7e0 msgr2=0x7f7184196330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:18.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.725+0000 7f7189093640 1 --2- 172.21.15.87:0/2772247247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71840fe7e0 0x7f7184196330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.725+0000 7f7189093640 1 -- 172.21.15.87:0/2772247247 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7174009900 con 0x7f71840fde20 2024-09-13T17:13:18.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.725+0000 7f7188892640 1 --2- 172.21.15.87:0/2772247247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71840fe7e0 0x7f7184196330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:18.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.725+0000 7f7189894640 1 --2- 172.21.15.87:0/2772247247 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71841013b0 0x7f718419d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:18.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.725+0000 7f7189093640 1 --2- 172.21.15.87:0/2772247247 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71840fde20 0x7f7184195df0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f717c00c970 tx=0x7f717c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:18.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.725+0000 7f71827fc640 1 -- 172.21.15.87:0/2772247247 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c004220 con 0x7f71840fde20 2024-09-13T17:13:18.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.725+0000 7f71827fc640 1 -- 172.21.15.87:0/2772247247 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f717c007e60 con 0x7f71840fde20 2024-09-13T17:13:18.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.725+0000 7f718b2f7640 1 -- 172.21.15.87:0/2772247247 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f718419def0 con 0x7f71840fde20 2024-09-13T17:13:18.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.726+0000 7f71827fc640 1 -- 172.21.15.87:0/2772247247 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c004a00 con 0x7f71840fde20 2024-09-13T17:13:18.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.726+0000 7f718b2f7640 1 -- 172.21.15.87:0/2772247247 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f718419e310 con 0x7f71840fde20 2024-09-13T17:13:18.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.727+0000 7f718b2f7640 1 -- 172.21.15.87:0/2772247247 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71840fe2a0 con 0x7f71840fde20 2024-09-13T17:13:18.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.728+0000 7f71827fc640 1 -- 172.21.15.87:0/2772247247 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f717c0079b0 con 0x7f71840fde20 2024-09-13T17:13:18.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.728+0000 7f71827fc640 1 --2- 172.21.15.87:0/2772247247 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f716c0a1110 0x7f716c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:18.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.728+0000 7f7188892640 1 --2- 172.21.15.87:0/2772247247 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f716c0a1110 0x7f716c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:18.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.728+0000 7f71827fc640 1 -- 172.21.15.87:0/2772247247 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f717c0ccd50 con 0x7f71840fde20 2024-09-13T17:13:18.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.729+0000 7f7188892640 1 --2- 172.21.15.87:0/2772247247 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f716c0a1110 0x7f716c0a35d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f71780058c0 tx=0x7f7178005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:18.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.732+0000 7f71827fc640 1 -- 172.21.15.87:0/2772247247 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f717c0d0030 con 0x7f71840fde20 2024-09-13T17:13:18.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.894+0000 7f718b2f7640 1 -- 172.21.15.87:0/2772247247 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7184107430 con 0x7f71840fde20 2024-09-13T17:13:18.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.895+0000 7f71827fc640 1 -- 172.21.15.87:0/2772247247 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+24817 (secure 0 0 0) 0x7f717c01d020 con 0x7f71840fde20 2024-09-13T17:13:18.898 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:13:18.898 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":93,"fsid":"043d5bae-71f2-11ef-bceb-c7b262605968","created":"2024-09-13T17:03:57.852010+0000","modified":"2024-09-13T17:12:50.208429+0000","last_up_change":"2024-09-13T17:10:34.423548+0000","last_in_change":"2024-09-13T17:10:14.228123+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:07:02.286400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:11:21.965141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:11:22.504345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:11:25.565163+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58250283-85c0-416e-abdd-1fc5a7ff0c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6803","nonce":1316956138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6805","nonce":1316956138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6809","nonce":1316956138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6807","nonce":1316956138}]},"public_addr":"172.21.15.87:6803/1316956138","cluster_addr":"172.21.15.87:6805/1316956138","heartbeat_back_addr":"172.21.15.87:6809/1316956138","heartbeat_front_addr":"172.21.15.87:6807/1316956138","state":["exists","up"]},{"osd":1,"uuid":"b9d49969-94b1-4262-b4ff-db0a8e3331af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6801","nonce":3352566727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6803","nonce":3352566727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6807","nonce":3352566727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6805","nonce":3352566727}]},"public_addr":"172.21.15.118:6801/3352566727","cluster_addr":"172.21.15.118:6803/3352566727","heartbeat_back_addr":"172.21.15.118:6807/3352566727","heartbeat_front_addr":"172.21.15.118:6805/3352566727","state":["exists","up"]},{"osd":2,"uuid":"ba64549e-d736-426f-b466-f569af5f16d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6801","nonce":2774581686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6803","nonce":2774581686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6807","nonce":2774581686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6805","nonce":2774581686}]},"public_addr":"172.21.15.149:6801/2774581686","cluster_addr":"172.21.15.149:6803/2774581686","heartbeat_back_addr":"172.21.15.149:6807/2774581686","heartbeat_front_addr":"172.21.15.149:6805/2774581686","state":["exists","up"]},{"osd":3,"uuid":"3d5553e5-371b-49fd-976b-9e72a97a2f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6811","nonce":3306119066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6813","nonce":3306119066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6817","nonce":3306119066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6815","nonce":3306119066}]},"public_addr":"172.21.15.87:6811/3306119066","cluster_addr":"172.21.15.87:6813/3306119066","heartbeat_back_addr":"172.21.15.87:6817/3306119066","heartbeat_front_addr":"172.21.15.87:6815/3306119066","state":["exists","up"]},{"osd":4,"uuid":"2fbe0e27-34ec-42a6-9962-f1d8202b3159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6809","nonce":3342349890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6811","nonce":3342349890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6815","nonce":3342349890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6813","nonce":3342349890}]},"public_addr":"172.21.15.118:6809/3342349890","cluster_addr":"172.21.15.118:6811/3342349890","heartbeat_back_addr":"172.21.15.118:6815/3342349890","heartbeat_front_addr":"172.21.15.118:6813/3342349890","state":["exists","up"]},{"osd":5,"uuid":"53c14519-6170-4b5a-a79d-4835882d7bec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6809","nonce":3468867124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6811","nonce":3468867124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6815","nonce":3468867124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6813","nonce":3468867124}]},"public_addr":"172.21.15.149:6809/3468867124","cluster_addr":"172.21.15.149:6811/3468867124","heartbeat_back_addr":"172.21.15.149:6815/3468867124","heartbeat_front_addr":"172.21.15.149:6813/3468867124","state":["exists","up"]},{"osd":6,"uuid":"d3951b32-db77-4b8b-9de0-f05e03d13f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6819","nonce":326563617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6821","nonce":326563617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6825","nonce":326563617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6823","nonce":326563617}]},"public_addr":"172.21.15.87:6819/326563617","cluster_addr":"172.21.15.87:6821/326563617","heartbeat_back_addr":"172.21.15.87:6825/326563617","heartbeat_front_addr":"172.21.15.87:6823/326563617","state":["exists","up"]},{"osd":7,"uuid":"4d46dab7-a8bf-4e3e-b5c0-43860d336bdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6817","nonce":1690268990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6819","nonce":1690268990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6823","nonce":1690268990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6821","nonce":1690268990}]},"public_addr":"172.21.15.118:6817/1690268990","cluster_addr":"172.21.15.118:6819/1690268990","heartbeat_back_addr":"172.21.15.118:6823/1690268990","heartbeat_front_addr":"172.21.15.118:6821/1690268990","state":["exists","up"]},{"osd":8,"uuid":"5a015a7d-60a3-4412-96af-1b61d2ad51f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6817","nonce":1558675380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6819","nonce":1558675380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6823","nonce":1558675380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6821","nonce":1558675380}]},"public_addr":"172.21.15.149:6817/1558675380","cluster_addr":"172.21.15.149:6819/1558675380","heartbeat_back_addr":"172.21.15.149:6823/1558675380","heartbeat_front_addr":"172.21.15.149:6821/1558675380","state":["exists","up"]},{"osd":9,"uuid":"248c0b6e-4c4e-4c63-a0dd-e4cdf3b997a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6827","nonce":1453934262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6829","nonce":1453934262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6833","nonce":1453934262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6831","nonce":1453934262}]},"public_addr":"172.21.15.87:6827/1453934262","cluster_addr":"172.21.15.87:6829/1453934262","heartbeat_back_addr":"172.21.15.87:6833/1453934262","heartbeat_front_addr":"172.21.15.87:6831/1453934262","state":["exists","up"]},{"osd":10,"uuid":"24238714-e737-4371-b5d5-0cd3395f09bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6825","nonce":1034318850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6827","nonce":1034318850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6831","nonce":1034318850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6829","nonce":1034318850}]},"public_addr":"172.21.15.118:6825/1034318850","cluster_addr":"172.21.15.118:6827/1034318850","heartbeat_back_addr":"172.21.15.118:6831/1034318850","heartbeat_front_addr":"172.21.15.118:6829/1034318850","state":["exists","up"]},{"osd":11,"uuid":"409dd3bf-5154-4dea-8708-7de7f9e2e793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6825","nonce":271000465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6827","nonce":271000465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6831","nonce":271000465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6829","nonce":271000465}]},"public_addr":"172.21.15.149:6825/271000465","cluster_addr":"172.21.15.149:6827/271000465","heartbeat_back_addr":"172.21.15.149:6831/271000465","heartbeat_front_addr":"172.21.15.149:6829/271000465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:16.382664+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:37.914250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:00.425876+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:23.960183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:47.004088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:10.214345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:33.719221+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:57.099599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:20.971881+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:44.827167+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:08.135516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:32.085853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.d","mappings":[{"from":1,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8},{"from":5,"to":7}]},{"pgid":"3.28","mappings":[{"from":3,"to":6},{"from":5,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/586423689":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6801/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6800/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/3270371628":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/515676743":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/1475107314":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/553289143":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/3403361612":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6801/1587363880":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6800/1587363880":"2024-09-14T17:04:24.083789+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:13:18.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.897+0000 7f718b2f7640 1 -- 172.21.15.87:0/2772247247 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f716c0a1110 msgr2=0x7f716c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:18.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.897+0000 7f718b2f7640 1 --2- 172.21.15.87:0/2772247247 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f716c0a1110 0x7f716c0a35d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f71780058c0 tx=0x7f7178005850 comp rx=0 tx=0).stop 2024-09-13T17:13:18.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.897+0000 7f718b2f7640 1 -- 172.21.15.87:0/2772247247 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71840fde20 msgr2=0x7f7184195df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:18.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.897+0000 7f718b2f7640 1 --2- 172.21.15.87:0/2772247247 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71840fde20 0x7f7184195df0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f717c00c970 tx=0x7f717c00ce30 comp rx=0 tx=0).stop 2024-09-13T17:13:18.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.898+0000 7f718b2f7640 1 -- 172.21.15.87:0/2772247247 shutdown_connections 2024-09-13T17:13:18.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.898+0000 7f718b2f7640 1 --2- 172.21.15.87:0/2772247247 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f716c0a1110 0x7f716c0a35d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.898+0000 7f718b2f7640 1 --2- 172.21.15.87:0/2772247247 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71841013b0 0x7f718419d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.898+0000 7f718b2f7640 1 --2- 172.21.15.87:0/2772247247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71840fe7e0 0x7f7184196330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.898+0000 7f718b2f7640 1 --2- 172.21.15.87:0/2772247247 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71840fde20 0x7f7184195df0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:18.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.898+0000 7f718b2f7640 1 -- 172.21.15.87:0/2772247247 >> 172.21.15.87:0/2772247247 conn(0x7f71840f9bb0 msgr2=0x7f7184104600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:18.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.898+0000 7f718b2f7640 1 -- 172.21.15.87:0/2772247247 shutdown_connections 2024-09-13T17:13:18.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:18.898+0000 7f718b2f7640 1 -- 172.21.15.87:0/2772247247 wait complete. 2024-09-13T17:13:18.911 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:13:19.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.007+0000 7f35e2687640 1 -- 172.21.15.87:0/3790686617 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35dc100fa0 msgr2=0x7f35dc101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.007+0000 7f35e2687640 1 --2- 172.21.15.87:0/3790686617 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35dc100fa0 0x7f35dc101420 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f35d0009900 tx=0x7f35d002a410 comp rx=0 tx=0).stop 2024-09-13T17:13:19.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.007+0000 7f35e2687640 1 -- 172.21.15.87:0/3790686617 shutdown_connections 2024-09-13T17:13:19.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.007+0000 7f35e2687640 1 --2- 172.21.15.87:0/3790686617 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35dc101960 0x7f35dc1081f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.007+0000 7f35e2687640 1 --2- 172.21.15.87:0/3790686617 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35dc100fa0 0x7f35dc101420 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.007+0000 7f35e2687640 1 --2- 172.21.15.87:0/3790686617 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35dc0ffdb0 0x7f35dc1001b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.007+0000 7f35e2687640 1 -- 172.21.15.87:0/3790686617 >> 172.21.15.87:0/3790686617 conn(0x7f35dc0fb510 msgr2=0x7f35dc0fd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:19.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.008+0000 7f35e2687640 1 -- 172.21.15.87:0/3790686617 shutdown_connections 2024-09-13T17:13:19.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.008+0000 7f35e2687640 1 -- 172.21.15.87:0/3790686617 wait complete. 2024-09-13T17:13:19.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.008+0000 7f35e2687640 1 Processor -- start 2024-09-13T17:13:19.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.008+0000 7f35e2687640 1 -- start start 2024-09-13T17:13:19.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.008+0000 7f35e2687640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35dc0ffdb0 0x7f35dc195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.008+0000 7f35e2687640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35dc100fa0 0x7f35dc196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.008+0000 7f35e2687640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35dc101960 0x7f35dc19d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.008+0000 7f35e2687640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc19d8a0 con 0x7f35dc101960 2024-09-13T17:13:19.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.008+0000 7f35e2687640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc19da10 con 0x7f35dc0ffdb0 2024-09-13T17:13:19.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.008+0000 7f35e2687640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc19dbd0 con 0x7f35dc100fa0 2024-09-13T17:13:19.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.009+0000 7f35e0c24640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35dc101960 0x7f35dc19d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.009+0000 7f35e0c24640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35dc101960 0x7f35dc19d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43412/0 (socket says 172.21.15.87:43412) 2024-09-13T17:13:19.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.009+0000 7f35e0c24640 1 -- 172.21.15.87:0/2817218423 learned_addr learned my addr 172.21.15.87:0/2817218423 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:19.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.009+0000 7f35dbfff640 1 --2- 172.21.15.87:0/2817218423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35dc0ffdb0 0x7f35dc195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.009+0000 7f35db7fe640 1 --2- 172.21.15.87:0/2817218423 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35dc100fa0 0x7f35dc196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.009+0000 7f35e0c24640 1 -- 172.21.15.87:0/2817218423 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35dc100fa0 msgr2=0x7f35dc196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.009+0000 7f35e0c24640 1 --2- 172.21.15.87:0/2817218423 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35dc100fa0 0x7f35dc196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.009+0000 7f35e0c24640 1 -- 172.21.15.87:0/2817218423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35dc0ffdb0 msgr2=0x7f35dc195dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.009+0000 7f35e0c24640 1 --2- 172.21.15.87:0/2817218423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35dc0ffdb0 0x7f35dc195dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.009+0000 7f35e0c24640 1 -- 172.21.15.87:0/2817218423 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d0009560 con 0x7f35dc101960 2024-09-13T17:13:19.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.009+0000 7f35e0c24640 1 --2- 172.21.15.87:0/2817218423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35dc101960 0x7f35dc19d330 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f35d400eaa0 tx=0x7f35d400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:19.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.009+0000 7f35d97fa640 1 -- 172.21.15.87:0/2817218423 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d400cdb0 con 0x7f35dc101960 2024-09-13T17:13:19.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.009+0000 7f35e2687640 1 -- 172.21.15.87:0/2817218423 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35dc19deb0 con 0x7f35dc101960 2024-09-13T17:13:19.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.009+0000 7f35d97fa640 1 -- 172.21.15.87:0/2817218423 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f35d4005020 con 0x7f35dc101960 2024-09-13T17:13:19.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.009+0000 7f35d97fa640 1 -- 172.21.15.87:0/2817218423 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d40116b0 con 0x7f35dc101960 2024-09-13T17:13:19.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.009+0000 7f35e2687640 1 -- 172.21.15.87:0/2817218423 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35dc19e280 con 0x7f35dc101960 2024-09-13T17:13:19.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.010+0000 7f35e2687640 1 -- 172.21.15.87:0/2817218423 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35dc1072b0 con 0x7f35dc101960 2024-09-13T17:13:19.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.011+0000 7f35d97fa640 1 -- 172.21.15.87:0/2817218423 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f35d4005190 con 0x7f35dc101960 2024-09-13T17:13:19.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.012+0000 7f35d97fa640 1 --2- 172.21.15.87:0/2817218423 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f35c40a1090 0x7f35c40a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.012+0000 7f35d97fa640 1 -- 172.21.15.87:0/2817218423 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f35d40cced0 con 0x7f35dc101960 2024-09-13T17:13:19.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.012+0000 7f35dbfff640 1 --2- 172.21.15.87:0/2817218423 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f35c40a1090 0x7f35c40a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.012+0000 7f35dbfff640 1 --2- 172.21.15.87:0/2817218423 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f35c40a1090 0x7f35c40a3550 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f35dc197290 tx=0x7f35cc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:19.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.016+0000 7f35d97fa640 1 -- 172.21.15.87:0/2817218423 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f35d40962b0 con 0x7f35dc101960 2024-09-13T17:13:19.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.213+0000 7f35e2687640 1 -- 172.21.15.87:0/2817218423 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35dc10b6a0 con 0x7f35dc101960 2024-09-13T17:13:19.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.214+0000 7f35d97fa640 1 -- 172.21.15.87:0/2817218423 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10877 (secure 0 0 0) 0x7f35d401f020 con 0x7f35dc101960 2024-09-13T17:13:19.216 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:13:19.216 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/3674545180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":3674545180},{"type":"v1","addr":"172.21.15.87:6841","nonce":3674545180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:11:23.313609+0000","modified":"2024-09-13T17:11:47.780404+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24484,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6839/3052680456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3052680456},{"type":"v1","addr":"172.21.15.118:6839","nonce":3052680456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:13:19.216 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 23 2024-09-13T17:13:19.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.216+0000 7f35e2687640 1 -- 172.21.15.87:0/2817218423 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f35c40a1090 msgr2=0x7f35c40a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.216+0000 7f35e2687640 1 --2- 172.21.15.87:0/2817218423 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f35c40a1090 0x7f35c40a3550 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f35dc197290 tx=0x7f35cc00b390 comp rx=0 tx=0).stop 2024-09-13T17:13:19.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.216+0000 7f35e2687640 1 -- 172.21.15.87:0/2817218423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35dc101960 msgr2=0x7f35dc19d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.216+0000 7f35e2687640 1 --2- 172.21.15.87:0/2817218423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35dc101960 0x7f35dc19d330 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f35d400eaa0 tx=0x7f35d400ef60 comp rx=0 tx=0).stop 2024-09-13T17:13:19.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.216+0000 7f35e2687640 1 -- 172.21.15.87:0/2817218423 shutdown_connections 2024-09-13T17:13:19.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.216+0000 7f35e2687640 1 --2- 172.21.15.87:0/2817218423 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f35c40a1090 0x7f35c40a3550 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.216+0000 7f35e2687640 1 --2- 172.21.15.87:0/2817218423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35dc101960 0x7f35dc19d330 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.216+0000 7f35e2687640 1 --2- 172.21.15.87:0/2817218423 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35dc100fa0 0x7f35dc196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.216+0000 7f35e2687640 1 --2- 172.21.15.87:0/2817218423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35dc0ffdb0 0x7f35dc195dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.216+0000 7f35e2687640 1 -- 172.21.15.87:0/2817218423 >> 172.21.15.87:0/2817218423 conn(0x7f35dc0fb510 msgr2=0x7f35dc104480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:19.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.216+0000 7f35e2687640 1 -- 172.21.15.87:0/2817218423 shutdown_connections 2024-09-13T17:13:19.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.216+0000 7f35e2687640 1 -- 172.21.15.87:0/2817218423 wait complete. 2024-09-13T17:13:19.229 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-13T17:11:23.313609+0000', 'modified': '2024-09-13T17:11:47.780404+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24499, 'mds_1': 24484, 'mds_2': 24472}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24427': {'gid': 24427, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.149:6833/3204144514', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6832', 'nonce': 3204144514}, {'type': 'v1', 'addr': '172.21.15.149:6833', 'nonce': 3204144514}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24446': {'gid': 24446, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.118:6837/923553321', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6836', 'nonce': 923553321}, {'type': 'v1', 'addr': '172.21.15.118:6837', 'nonce': 923553321}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24470': {'gid': 24470, 'name': 'b', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.118:6839/3052680456', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6838', 'nonce': 3052680456}, {'type': 'v1', 'addr': '172.21.15.118:6839', 'nonce': 3052680456}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24472': {'gid': 24472, 'name': 'f', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.149:6835/3814444081', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6834', 'nonce': 3814444081}, {'type': 'v1', 'addr': '172.21.15.149:6835', 'nonce': 3814444081}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24484': {'gid': 24484, 'name': 'c', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.149:6837/3893430053', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6836', 'nonce': 3893430053}, {'type': 'v1', 'addr': '172.21.15.149:6837', 'nonce': 3893430053}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24499': {'gid': 24499, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.149:6839/2938961956', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6838', 'nonce': 2938961956}, {'type': 'v1', 'addr': '172.21.15.149:6839', 'nonce': 2938961956}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T17:13:19.230 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-13T17:13:19.230 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-09-13T17:13:19.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.330+0000 7f391386c640 1 -- 172.21.15.87:0/3578426412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f390c0ffe60 msgr2=0x7f390c1002e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.330+0000 7f391386c640 1 --2- 172.21.15.87:0/3578426412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f390c0ffe60 0x7f390c1002e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f38fc009900 tx=0x7f38fc02a410 comp rx=0 tx=0).stop 2024-09-13T17:13:19.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.330+0000 7f391386c640 1 -- 172.21.15.87:0/3578426412 shutdown_connections 2024-09-13T17:13:19.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.330+0000 7f391386c640 1 --2- 172.21.15.87:0/3578426412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f390c100820 0x7f390c1070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.330+0000 7f391386c640 1 --2- 172.21.15.87:0/3578426412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f390c0ffe60 0x7f390c1002e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.330+0000 7f391386c640 1 --2- 172.21.15.87:0/3578426412 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f390c0fec70 0x7f390c0ff070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.330+0000 7f391386c640 1 -- 172.21.15.87:0/3578426412 >> 172.21.15.87:0/3578426412 conn(0x7f390c0fa410 msgr2=0x7f390c0fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:19.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.330+0000 7f391386c640 1 -- 172.21.15.87:0/3578426412 shutdown_connections 2024-09-13T17:13:19.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.330+0000 7f391386c640 1 -- 172.21.15.87:0/3578426412 wait complete. 2024-09-13T17:13:19.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.331+0000 7f391386c640 1 Processor -- start 2024-09-13T17:13:19.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.331+0000 7f391386c640 1 -- start start 2024-09-13T17:13:19.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.331+0000 7f391386c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f390c0fec70 0x7f390c0680c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.331+0000 7f391386c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f390c0ffe60 0x7f390c19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.331+0000 7f391386c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f390c100820 0x7f390c19d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.331+0000 7f391386c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c19d910 con 0x7f390c0fec70 2024-09-13T17:13:19.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.331+0000 7f391386c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c19da80 con 0x7f390c100820 2024-09-13T17:13:19.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.331+0000 7f391386c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c19dc40 con 0x7f390c0ffe60 2024-09-13T17:13:19.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.331+0000 7f3911608640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f390c0fec70 0x7f390c0680c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.331+0000 7f3911608640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f390c0fec70 0x7f390c0680c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57568/0 (socket says 172.21.15.87:57568) 2024-09-13T17:13:19.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.331+0000 7f3911608640 1 -- 172.21.15.87:0/981066701 learned_addr learned my addr 172.21.15.87:0/981066701 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:19.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.331+0000 7f3911e09640 1 --2- 172.21.15.87:0/981066701 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f390c100820 0x7f390c19d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.331+0000 7f3911608640 1 -- 172.21.15.87:0/981066701 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f390c0ffe60 msgr2=0x7f390c19abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.331+0000 7f3910e07640 1 --2- 172.21.15.87:0/981066701 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f390c0ffe60 0x7f390c19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.331+0000 7f3911608640 1 --2- 172.21.15.87:0/981066701 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f390c0ffe60 0x7f390c19abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.332+0000 7f3911608640 1 -- 172.21.15.87:0/981066701 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f390c100820 msgr2=0x7f390c19d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.332+0000 7f3911608640 1 --2- 172.21.15.87:0/981066701 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f390c100820 0x7f390c19d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.332+0000 7f3911608640 1 -- 172.21.15.87:0/981066701 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38fc009560 con 0x7f390c0fec70 2024-09-13T17:13:19.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.332+0000 7f3911e09640 1 --2- 172.21.15.87:0/981066701 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f390c100820 0x7f390c19d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:19.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.332+0000 7f3911608640 1 --2- 172.21.15.87:0/981066701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f390c0fec70 0x7f390c0680c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f390800b450 tx=0x7f390800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:19.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.332+0000 7f39027fc640 1 -- 172.21.15.87:0/981066701 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3908011890 con 0x7f390c0fec70 2024-09-13T17:13:19.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.332+0000 7f39027fc640 1 -- 172.21.15.87:0/981066701 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f39080103e0 con 0x7f390c0fec70 2024-09-13T17:13:19.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.332+0000 7f391386c640 1 -- 172.21.15.87:0/981066701 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f390c19df20 con 0x7f390c0fec70 2024-09-13T17:13:19.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.332+0000 7f39027fc640 1 -- 172.21.15.87:0/981066701 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3908011ea0 con 0x7f390c0fec70 2024-09-13T17:13:19.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.332+0000 7f391386c640 1 -- 172.21.15.87:0/981066701 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f390c19e350 con 0x7f390c0fec70 2024-09-13T17:13:19.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.334+0000 7f39027fc640 1 -- 172.21.15.87:0/981066701 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3908010550 con 0x7f390c0fec70 2024-09-13T17:13:19.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.334+0000 7f3916665740 1 Processor -- start 2024-09-13T17:13:19.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.335+0000 7f3916665740 1 -- start start 2024-09-13T17:13:19.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.335+0000 7f3916665740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb2d298500 0x55cb2d298900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.335+0000 7f3916665740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb2d298e40 0x55cb2d29d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.335+0000 7f3916665740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb2d29ded0 0x55cb2d2a0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.335+0000 7f3916665740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb2d1f37c0 con 0x55cb2d298e40 2024-09-13T17:13:19.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.335+0000 7f3916665740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb2d202b70 con 0x55cb2d29ded0 2024-09-13T17:13:19.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.335+0000 7f3916665740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb2d200300 con 0x55cb2d298500 2024-09-13T17:13:19.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.335+0000 7f39027fc640 1 --2- 172.21.15.87:0/981066701 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f38f80a1090 0x7f38f80a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.335+0000 7f3911608640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb2d298e40 0x55cb2d29d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.335+0000 7f3911608640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb2d298e40 0x55cb2d29d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57580/0 (socket says 172.21.15.87:57580) 2024-09-13T17:13:19.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.335+0000 7f3911608640 1 -- 172.21.15.87:0/2987006142 learned_addr learned my addr 172.21.15.87:0/2987006142 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:19.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.335+0000 7f3910e07640 1 --2- 172.21.15.87:0/2987006142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb2d29ded0 0x55cb2d2a0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.335+0000 7f3911e09640 1 --2- 172.21.15.87:0/981066701 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f38f80a1090 0x7f38f80a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.335+0000 7f3911e09640 1 --2- 172.21.15.87:0/2987006142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb2d298500 0x55cb2d298900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.335+0000 7f39027fc640 1 -- 172.21.15.87:0/981066701 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f39080ccb30 con 0x7f390c0fec70 2024-09-13T17:13:19.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.335+0000 7f3911608640 1 -- 172.21.15.87:0/2987006142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb2d298500 msgr2=0x55cb2d298900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:19.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.335+0000 7f3911608640 1 --2- 172.21.15.87:0/2987006142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb2d298500 0x55cb2d298900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.335+0000 7f3911608640 1 -- 172.21.15.87:0/2987006142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb2d29ded0 msgr2=0x55cb2d2a0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:19.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.335+0000 7f3911608640 1 --2- 172.21.15.87:0/2987006142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb2d29ded0 0x55cb2d2a0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.335+0000 7f3911608640 1 -- 172.21.15.87:0/2987006142 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb2d1884b0 con 0x55cb2d298e40 2024-09-13T17:13:19.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.335+0000 7f3911608640 1 --2- 172.21.15.87:0/2987006142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb2d298e40 0x55cb2d29d900 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f390800be10 tx=0x7f390806cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7bc7b0d6f773a3e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:19.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.336+0000 7f3911e09640 1 --2- 172.21.15.87:0/981066701 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f38f80a1090 0x7f38f80a3550 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f390400afd0 tx=0x7f390400a450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:19.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.336+0000 7f38f77fe640 1 -- 172.21.15.87:0/2987006142 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39080108e0 con 0x55cb2d298e40 2024-09-13T17:13:19.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.336+0000 7f38f77fe640 1 -- 172.21.15.87:0/2987006142 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f390809a2b0 con 0x55cb2d298e40 2024-09-13T17:13:19.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.336+0000 7f38f77fe640 1 -- 172.21.15.87:0/2987006142 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39080962c0 con 0x55cb2d298e40 2024-09-13T17:13:19.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.336+0000 7f3916665740 1 -- 172.21.15.87:0/2987006142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb2d298e40 msgr2=0x55cb2d29d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.336+0000 7f3916665740 1 --2- 172.21.15.87:0/2987006142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb2d298e40 0x55cb2d29d900 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f390800be10 tx=0x7f390806cd90 comp rx=0 tx=0).stop 2024-09-13T17:13:19.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.336+0000 7f3916665740 1 -- 172.21.15.87:0/2987006142 shutdown_connections 2024-09-13T17:13:19.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.336+0000 7f3916665740 1 --2- 172.21.15.87:0/2987006142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb2d29ded0 0x55cb2d2a0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.336+0000 7f3916665740 1 --2- 172.21.15.87:0/2987006142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb2d298e40 0x55cb2d29d900 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.336+0000 7f3916665740 1 --2- 172.21.15.87:0/2987006142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb2d298500 0x55cb2d298900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.336+0000 7f3916665740 1 -- 172.21.15.87:0/2987006142 >> 172.21.15.87:0/2987006142 conn(0x55cb2d293b70 msgr2=0x55cb2d293f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:19.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.336+0000 7f3916665740 1 -- 172.21.15.87:0/2987006142 shutdown_connections 2024-09-13T17:13:19.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.336+0000 7f3916665740 1 -- 172.21.15.87:0/2987006142 wait complete. 2024-09-13T17:13:19.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.337+0000 7f3916665740 1 -- start start 2024-09-13T17:13:19.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.337+0000 7f3916665740 1 Processor -- start 2024-09-13T17:13:19.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.337+0000 7f3916665740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb2d298500 0x55cb2d2a20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.337+0000 7f3916665740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb2d298e40 0x55cb2d2a25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.337+0000 7f3916665740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb2d29ded0 0x55cb2d2a9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.337+0000 7f3916665740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb2d1fbbf0 con 0x55cb2d29ded0 2024-09-13T17:13:19.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.337+0000 7f3916665740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb2d1ba250 con 0x55cb2d298500 2024-09-13T17:13:19.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.337+0000 7f3916665740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb2d1b9ef0 con 0x55cb2d298e40 2024-09-13T17:13:19.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.337+0000 7f3916665740 10 client.0 _ll_register_callbacks cb 0x55cb2d1ec740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:13:19.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.337+0000 7f3911e09640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb2d29ded0 0x55cb2d2a9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.337+0000 7f3911e09640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb2d29ded0 0x55cb2d2a9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57582/0 (socket says 172.21.15.87:57582) 2024-09-13T17:13:19.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.337+0000 7f3911e09640 1 -- 172.21.15.87:0/4042092192 learned_addr learned my addr 172.21.15.87:0/4042092192 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:19.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.338+0000 7f3911608640 1 --2- 172.21.15.87:0/4042092192 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb2d298500 0x55cb2d2a20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.338+0000 7f3910e07640 1 --2- 172.21.15.87:0/4042092192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb2d298e40 0x55cb2d2a25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.338+0000 7f3911e09640 1 -- 172.21.15.87:0/4042092192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb2d298e40 msgr2=0x55cb2d2a25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:19.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.338+0000 7f3911e09640 1 --2- 172.21.15.87:0/4042092192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb2d298e40 0x55cb2d2a25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.338+0000 7f3911e09640 1 -- 172.21.15.87:0/4042092192 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb2d298500 msgr2=0x55cb2d2a20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:19.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.338+0000 7f3911e09640 1 --2- 172.21.15.87:0/4042092192 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb2d298500 0x55cb2d2a20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.338+0000 7f3911e09640 1 -- 172.21.15.87:0/4042092192 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f390c19e350 con 0x55cb2d29ded0 2024-09-13T17:13:19.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.338+0000 7f3910e07640 1 --2- 172.21.15.87:0/4042092192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb2d298e40 0x55cb2d2a25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:19.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.338+0000 7f3911e09640 1 --2- 172.21.15.87:0/4042092192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb2d29ded0 0x55cb2d2a9620 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f390400a650 tx=0x7f3904004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f44e585ab600797 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:19.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.338+0000 7f38f4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:13:19.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.338+0000 7f38f4ff9640 1 -- 172.21.15.87:0/4042092192 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3904004b20 con 0x55cb2d29ded0 2024-09-13T17:13:19.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.338+0000 7f38f4ff9640 1 -- 172.21.15.87:0/4042092192 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f3904004c80 con 0x55cb2d29ded0 2024-09-13T17:13:19.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.338+0000 7f3916665740 1 -- 172.21.15.87:0/4042092192 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cb2ceef3c0 con 0x55cb2d29ded0 2024-09-13T17:13:19.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.338+0000 7f38f4ff9640 1 -- 172.21.15.87:0/4042092192 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3904004e40 con 0x55cb2d29ded0 2024-09-13T17:13:19.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.338+0000 7f3916665740 10 client.15267 fetch_fsmap learned FSMap version 23 2024-09-13T17:13:19.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.338+0000 7f3916665740 1 -- 172.21.15.87:0/4042092192 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55cb2d1fa270 con 0x55cb2d29ded0 2024-09-13T17:13:19.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.339+0000 7f38f4ff9640 1 -- 172.21.15.87:0/4042092192 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55cb2ceef3c0 con 0x55cb2d29ded0 2024-09-13T17:13:19.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.339+0000 7f38f4ff9640 1 -- 172.21.15.87:0/4042092192 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 23) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f39040040b0 con 0x55cb2d29ded0 2024-09-13T17:13:19.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.339+0000 7f3916665740 10 client.15267 fetch_fsmap finished waiting for FSMap version 23 2024-09-13T17:13:19.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.339+0000 7f3916665740 10 client.15267 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-13T17:13:19.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.339+0000 7f3916665740 20 client.15267 populate_metadata read hostname 'smithi087' 2024-09-13T17:13:19.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.339+0000 7f3916665740 1 --2- 172.21.15.87:0/4042092192 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55cb2d2adfe0 0x55cb2d2b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.339+0000 7f3916665740 4 client.15267 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:13:19.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.339+0000 7f3916665740 1 -- 172.21.15.87:0/4042092192 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cb2cf006c0 con 0x55cb2d2adfe0 2024-09-13T17:13:19.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.339+0000 7f3911608640 1 --2- 172.21.15.87:0/4042092192 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55cb2d2adfe0 0x55cb2d2b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.340+0000 7f38f4ff9640 10 client.15267 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:13:19.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.340+0000 7f3911608640 1 --2- 172.21.15.87:0/4042092192 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55cb2d2adfe0 0x55cb2d2b2770 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6b637c67f36ce476 server_cookie=c2f970d200d96b30 in_seq=0 out_seq=0 2024-09-13T17:13:19.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.340+0000 7f38f4ff9640 1 -- 172.21.15.87:0/4042092192 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55cb2cf006c0 con 0x55cb2d2adfe0 2024-09-13T17:13:19.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.340+0000 7f38f4ff9640 10 client.15267 handle_command_reply: tid=0 2024-09-13T17:13:19.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.340+0000 7f3916665740 1 client.15267 shutdown 2024-09-13T17:13:19.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.340+0000 7f3916665740 1 -- 172.21.15.87:0/4042092192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb2d29ded0 msgr2=0x55cb2d2a9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.340+0000 7f3916665740 1 --2- 172.21.15.87:0/4042092192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb2d29ded0 0x55cb2d2a9620 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f390400a650 tx=0x7f3904004ab0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.340+0000 7f3916665740 1 -- 172.21.15.87:0/4042092192 shutdown_connections 2024-09-13T17:13:19.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.340+0000 7f3916665740 1 --2- 172.21.15.87:0/4042092192 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55cb2d2adfe0 0x55cb2d2b2770 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.340+0000 7f3916665740 1 --2- 172.21.15.87:0/4042092192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb2d29ded0 0x55cb2d2a9620 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.340+0000 7f38f4ff9640 0 client.15267 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:13:19.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.340+0000 7f3916665740 1 --2- 172.21.15.87:0/4042092192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb2d298e40 0x55cb2d2a25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.341+0000 7f3916665740 1 --2- 172.21.15.87:0/4042092192 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb2d298500 0x55cb2d2a20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.341+0000 7f3916665740 1 -- 172.21.15.87:0/4042092192 >> 172.21.15.87:0/4042092192 conn(0x55cb2d293b70 msgr2=0x55cb2d295380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:19.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.341+0000 7f3916665740 1 -- 172.21.15.87:0/4042092192 shutdown_connections 2024-09-13T17:13:19.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.341+0000 7f3916665740 1 -- 172.21.15.87:0/4042092192 wait complete. 2024-09-13T17:13:19.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.341+0000 7f3916665740 20 client.15267 trim_cache size 0 max 16384 2024-09-13T17:13:19.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.356+0000 7f3916665740 1 Processor -- start 2024-09-13T17:13:19.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.356+0000 7f3916665740 1 -- start start 2024-09-13T17:13:19.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.356+0000 7f3916665740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb2d298500 0x55cb2d2a2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.356+0000 7f3916665740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb2d298e40 0x55cb2d293470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.356+0000 7f3916665740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb2d29ded0 0x55cb2d2b6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.356+0000 7f3916665740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb2d17f460 con 0x55cb2d298500 2024-09-13T17:13:19.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.356+0000 7f3916665740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb2d28f600 con 0x55cb2d298e40 2024-09-13T17:13:19.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.356+0000 7f3916665740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb2cf006c0 con 0x55cb2d29ded0 2024-09-13T17:13:19.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.356+0000 7f3911608640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb2d298500 0x55cb2d2a2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.356+0000 7f3911608640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb2d298500 0x55cb2d2a2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57584/0 (socket says 172.21.15.87:57584) 2024-09-13T17:13:19.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.356+0000 7f3911e09640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb2d29ded0 0x55cb2d2b6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.356+0000 7f3911608640 1 -- 172.21.15.87:0/23459634 learned_addr learned my addr 172.21.15.87:0/23459634 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:19.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.356+0000 7f3910e07640 1 --2- 172.21.15.87:0/23459634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb2d298e40 0x55cb2d293470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.356+0000 7f3911608640 1 -- 172.21.15.87:0/23459634 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb2d29ded0 msgr2=0x55cb2d2b6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:19.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.356+0000 7f3911608640 1 --2- 172.21.15.87:0/23459634 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb2d29ded0 0x55cb2d2b6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.356+0000 7f3911608640 1 -- 172.21.15.87:0/23459634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb2d298e40 msgr2=0x55cb2d293470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:19.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.356+0000 7f3911608640 1 --2- 172.21.15.87:0/23459634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb2d298e40 0x55cb2d293470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.356+0000 7f3911608640 1 -- 172.21.15.87:0/23459634 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb2d19c5f0 con 0x55cb2d298500 2024-09-13T17:13:19.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.357+0000 7f3911608640 1 --2- 172.21.15.87:0/23459634 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb2d298500 0x55cb2d2a2560 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f39080ca5d0 tx=0x7f39080047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f82ec5cfad90de server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:19.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.357+0000 7f38f7fff640 1 -- 172.21.15.87:0/23459634 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3908097f50 con 0x55cb2d298500 2024-09-13T17:13:19.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.357+0000 7f38f7fff640 1 -- 172.21.15.87:0/23459634 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f39080962c0 con 0x55cb2d298500 2024-09-13T17:13:19.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.357+0000 7f38f7fff640 1 -- 172.21.15.87:0/23459634 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39080a1ba0 con 0x55cb2d298500 2024-09-13T17:13:19.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.358+0000 7f3916665740 1 -- 172.21.15.87:0/23459634 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb2d298500 msgr2=0x55cb2d2a2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.358+0000 7f3916665740 1 --2- 172.21.15.87:0/23459634 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb2d298500 0x55cb2d2a2560 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f39080ca5d0 tx=0x7f39080047d0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.358+0000 7f3916665740 1 -- 172.21.15.87:0/23459634 shutdown_connections 2024-09-13T17:13:19.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.358+0000 7f3916665740 1 --2- 172.21.15.87:0/23459634 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb2d29ded0 0x55cb2d2b6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.358+0000 7f3916665740 1 --2- 172.21.15.87:0/23459634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb2d298e40 0x55cb2d293470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.358+0000 7f3916665740 1 --2- 172.21.15.87:0/23459634 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb2d298500 0x55cb2d2a2560 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.358+0000 7f3916665740 1 -- 172.21.15.87:0/23459634 >> 172.21.15.87:0/23459634 conn(0x55cb2d293b70 msgr2=0x55cb2d2a1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:19.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.358+0000 7f3916665740 1 -- 172.21.15.87:0/23459634 shutdown_connections 2024-09-13T17:13:19.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.358+0000 7f3916665740 1 -- 172.21.15.87:0/23459634 wait complete. 2024-09-13T17:13:19.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.358+0000 7f3916665740 1 -- start start 2024-09-13T17:13:19.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.358+0000 7f3916665740 1 Processor -- start 2024-09-13T17:13:19.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.359+0000 7f3916665740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb2d298500 0x55cb2d29e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.359+0000 7f3916665740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb2d298e40 0x55cb2d29ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.359+0000 7f3916665740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb2d29ded0 0x55cb2d29f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.359+0000 7f3916665740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb2d2a0130 con 0x55cb2d298e40 2024-09-13T17:13:19.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.359+0000 7f3916665740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb2d308450 con 0x55cb2d298500 2024-09-13T17:13:19.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.359+0000 7f3916665740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb2d3085c0 con 0x55cb2d29ded0 2024-09-13T17:13:19.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.359+0000 7f3916665740 10 client.0 _ll_register_callbacks cb 0x7f3908099a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:13:19.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.359+0000 7f3910e07640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb2d298e40 0x55cb2d29ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.359+0000 7f3910e07640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb2d298e40 0x55cb2d29ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57600/0 (socket says 172.21.15.87:57600) 2024-09-13T17:13:19.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.359+0000 7f3910e07640 1 -- 172.21.15.87:0/3856745160 learned_addr learned my addr 172.21.15.87:0/3856745160 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:19.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.359+0000 7f3911e09640 1 --2- 172.21.15.87:0/3856745160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb2d29ded0 0x55cb2d29f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.359+0000 7f3911608640 1 --2- 172.21.15.87:0/3856745160 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb2d298500 0x55cb2d29e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.359+0000 7f3910e07640 1 -- 172.21.15.87:0/3856745160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb2d29ded0 msgr2=0x55cb2d29f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:19.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.359+0000 7f3910e07640 1 --2- 172.21.15.87:0/3856745160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb2d29ded0 0x55cb2d29f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.359+0000 7f3910e07640 1 -- 172.21.15.87:0/3856745160 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb2d298500 msgr2=0x55cb2d29e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:19.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.359+0000 7f3910e07640 1 --2- 172.21.15.87:0/3856745160 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb2d298500 0x55cb2d29e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.359+0000 7f3910e07640 1 -- 172.21.15.87:0/3856745160 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cb2d1884b0 con 0x55cb2d298e40 2024-09-13T17:13:19.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.359+0000 7f3910e07640 1 --2- 172.21.15.87:0/3856745160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb2d298e40 0x55cb2d29ec10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f38fc005940 tx=0x7f38fc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a6637906ffc6498 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:19.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.359+0000 7f38f4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:13:19.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.359+0000 7f38f4ff9640 1 -- 172.21.15.87:0/3856745160 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc0037f0 con 0x55cb2d298e40 2024-09-13T17:13:19.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.359+0000 7f38f4ff9640 1 -- 172.21.15.87:0/3856745160 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f38fc003950 con 0x55cb2d298e40 2024-09-13T17:13:19.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.359+0000 7f3916665740 1 -- 172.21.15.87:0/3856745160 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f390809a2b0 con 0x55cb2d298e40 2024-09-13T17:13:19.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.359+0000 7f38f4ff9640 1 -- 172.21.15.87:0/3856745160 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38fc003b10 con 0x55cb2d298e40 2024-09-13T17:13:19.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.359+0000 7f3916665740 10 client.15273 fetch_fsmap learned FSMap version 23 2024-09-13T17:13:19.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.360+0000 7f3916665740 1 -- 172.21.15.87:0/3856745160 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55cb2d1c1d00 con 0x55cb2d298e40 2024-09-13T17:13:19.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.360+0000 7f38f4ff9640 1 -- 172.21.15.87:0/3856745160 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f390809a2b0 con 0x55cb2d298e40 2024-09-13T17:13:19.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.360+0000 7f38f4ff9640 1 -- 172.21.15.87:0/3856745160 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 23) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f38fc047cd0 con 0x55cb2d298e40 2024-09-13T17:13:19.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.360+0000 7f3916665740 10 client.15273 fetch_fsmap finished waiting for FSMap version 23 2024-09-13T17:13:19.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.360+0000 7f3916665740 10 client.15273 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-13T17:13:19.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.360+0000 7f3916665740 20 client.15273 populate_metadata read hostname 'smithi087' 2024-09-13T17:13:19.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.360+0000 7f3916665740 1 --2- 172.21.15.87:0/3856745160 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55cb2d2adfe0 0x55cb2d309d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.360+0000 7f3916665740 4 client.15273 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:13:19.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.360+0000 7f3916665740 1 -- 172.21.15.87:0/3856745160 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55cb2cf53d10 con 0x55cb2d2adfe0 2024-09-13T17:13:19.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.360+0000 7f3911608640 1 --2- 172.21.15.87:0/3856745160 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55cb2d2adfe0 0x55cb2d309d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.361+0000 7f3911608640 1 --2- 172.21.15.87:0/3856745160 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55cb2d2adfe0 0x55cb2d309d90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=de148017af7cc33a server_cookie=fa44f6c2a238f038 in_seq=0 out_seq=0 2024-09-13T17:13:19.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.361+0000 7f38f4ff9640 10 client.15273 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:13:19.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.361+0000 7f38f4ff9640 1 -- 172.21.15.87:0/3856745160 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55cb2cf53d10 con 0x55cb2d2adfe0 2024-09-13T17:13:19.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.361+0000 7f38f4ff9640 10 client.15273 handle_command_reply: tid=0 2024-09-13T17:13:19.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.361+0000 7f3916665740 1 client.15273 shutdown 2024-09-13T17:13:19.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.361+0000 7f3916665740 1 -- 172.21.15.87:0/3856745160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb2d298e40 msgr2=0x55cb2d29ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.361+0000 7f3916665740 1 --2- 172.21.15.87:0/3856745160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb2d298e40 0x55cb2d29ec10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f38fc005940 tx=0x7f38fc004270 comp rx=0 tx=0).stop 2024-09-13T17:13:19.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.361+0000 7f3916665740 1 -- 172.21.15.87:0/3856745160 shutdown_connections 2024-09-13T17:13:19.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.361+0000 7f3916665740 1 --2- 172.21.15.87:0/3856745160 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55cb2d2adfe0 0x55cb2d309d90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.361+0000 7f3916665740 1 --2- 172.21.15.87:0/3856745160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb2d29ded0 0x55cb2d29f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.361+0000 7f3916665740 1 --2- 172.21.15.87:0/3856745160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb2d298e40 0x55cb2d29ec10 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.361+0000 7f38f4ff9640 0 client.15273 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:13:19.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.361+0000 7f3916665740 1 --2- 172.21.15.87:0/3856745160 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb2d298500 0x55cb2d29e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.361+0000 7f3916665740 1 -- 172.21.15.87:0/3856745160 >> 172.21.15.87:0/3856745160 conn(0x55cb2d293b70 msgr2=0x55cb2d2b6790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:19.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.361+0000 7f3916665740 1 -- 172.21.15.87:0/3856745160 shutdown_connections 2024-09-13T17:13:19.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.361+0000 7f3916665740 1 -- 172.21.15.87:0/3856745160 wait complete. 2024-09-13T17:13:19.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.361+0000 7f3916665740 20 client.15273 trim_cache size 0 max 16384 2024-09-13T17:13:19.372 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:13:19.372 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_fsid": "043d5bae-71f2-11ef-bceb-c7b262605968", 2024-09-13T17:13:19.372 INFO:teuthology.orchestra.run.smithi087.stdout: "whoami": 2, 2024-09-13T17:13:19.372 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 24472, 2024-09-13T17:13:19.373 INFO:teuthology.orchestra.run.smithi087.stdout: "want_state": "up:active", 2024-09-13T17:13:19.373 INFO:teuthology.orchestra.run.smithi087.stdout: "state": "up:active", 2024-09-13T17:13:19.373 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs", 2024-09-13T17:13:19.373 INFO:teuthology.orchestra.run.smithi087.stdout: "rank_uptime": 92.192777207999995, 2024-09-13T17:13:19.373 INFO:teuthology.orchestra.run.smithi087.stdout: "mdsmap_epoch": 23, 2024-09-13T17:13:19.373 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch": 93, 2024-09-13T17:13:19.373 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch_barrier": 89, 2024-09-13T17:13:19.373 INFO:teuthology.orchestra.run.smithi087.stdout: "uptime": 137.32456940200001 2024-09-13T17:13:19.373 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:13:19.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.362+0000 7f391386c640 1 -- 172.21.15.87:0/981066701 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f38f80a1090 msgr2=0x7f38f80a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.362+0000 7f391386c640 1 --2- 172.21.15.87:0/981066701 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f38f80a1090 0x7f38f80a3550 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f390400afd0 tx=0x7f390400a450 comp rx=0 tx=0).stop 2024-09-13T17:13:19.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.362+0000 7f391386c640 1 -- 172.21.15.87:0/981066701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f390c0fec70 msgr2=0x7f390c0680c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.362+0000 7f391386c640 1 --2- 172.21.15.87:0/981066701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f390c0fec70 0x7f390c0680c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f390800b450 tx=0x7f390800b910 comp rx=0 tx=0).stop 2024-09-13T17:13:19.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.362+0000 7f391386c640 1 -- 172.21.15.87:0/981066701 shutdown_connections 2024-09-13T17:13:19.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.362+0000 7f391386c640 1 --2- 172.21.15.87:0/981066701 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f38f80a1090 0x7f38f80a3550 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.362+0000 7f391386c640 1 --2- 172.21.15.87:0/981066701 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f390c100820 0x7f390c19d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.362+0000 7f391386c640 1 --2- 172.21.15.87:0/981066701 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f390c0ffe60 0x7f390c19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.362+0000 7f391386c640 1 --2- 172.21.15.87:0/981066701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f390c0fec70 0x7f390c0680c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.362+0000 7f391386c640 1 -- 172.21.15.87:0/981066701 >> 172.21.15.87:0/981066701 conn(0x7f390c0fa410 msgr2=0x7f390c1033c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:19.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.362+0000 7f391386c640 1 -- 172.21.15.87:0/981066701 shutdown_connections 2024-09-13T17:13:19.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.362+0000 7f391386c640 1 -- 172.21.15.87:0/981066701 wait complete. 2024-09-13T17:13:19.376 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T17:13:19.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:19 smithi087 ceph-mon[30934]: pgmap v338: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T17:13:19.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:19 smithi087 ceph-mon[30934]: mgrmap e18: x(active, since 8m), standbys: y, z 2024-09-13T17:13:19.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:19 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2347985811' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:13:19.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:19 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1095575347' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:13:19.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:19 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2772247247' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:13:19.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:19 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2817218423' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:13:19.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.477+0000 7fcca75e2640 1 -- 172.21.15.87:0/2158468123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcca00fec70 msgr2=0x7fcca00ff070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.477+0000 7fcca75e2640 1 --2- 172.21.15.87:0/2158468123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcca00fec70 0x7fcca00ff070 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c009900 tx=0x7fcc9c02a410 comp rx=0 tx=0).stop 2024-09-13T17:13:19.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.477+0000 7fcca75e2640 1 -- 172.21.15.87:0/2158468123 shutdown_connections 2024-09-13T17:13:19.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.477+0000 7fcca75e2640 1 --2- 172.21.15.87:0/2158468123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcca0100820 0x7fcca01070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.477+0000 7fcca75e2640 1 --2- 172.21.15.87:0/2158468123 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcca00ffe60 0x7fcca01002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.477+0000 7fcca75e2640 1 --2- 172.21.15.87:0/2158468123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcca00fec70 0x7fcca00ff070 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.477+0000 7fcca75e2640 1 -- 172.21.15.87:0/2158468123 >> 172.21.15.87:0/2158468123 conn(0x7fcca00fa410 msgr2=0x7fcca00fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:19.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.477+0000 7fcca75e2640 1 -- 172.21.15.87:0/2158468123 shutdown_connections 2024-09-13T17:13:19.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.477+0000 7fcca75e2640 1 -- 172.21.15.87:0/2158468123 wait complete. 2024-09-13T17:13:19.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.478+0000 7fcca75e2640 1 Processor -- start 2024-09-13T17:13:19.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.478+0000 7fcca75e2640 1 -- start start 2024-09-13T17:13:19.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.478+0000 7fcca75e2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcca00fec70 0x7fcca010a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.478+0000 7fcca75e2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcca00ffe60 0x7fcca0108e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.478+0000 7fcca75e2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcca0100820 0x7fcca0109390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.478+0000 7fcca75e2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca0109af0 con 0x7fcca0100820 2024-09-13T17:13:19.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.478+0000 7fcca75e2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca0109c60 con 0x7fcca00ffe60 2024-09-13T17:13:19.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.478+0000 7fcca75e2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca019fdb0 con 0x7fcca00fec70 2024-09-13T17:13:19.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.478+0000 7fcca5b7f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcca0100820 0x7fcca0109390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.478+0000 7fcca5b7f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcca0100820 0x7fcca0109390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57612/0 (socket says 172.21.15.87:57612) 2024-09-13T17:13:19.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.478+0000 7fcca5b7f640 1 -- 172.21.15.87:0/4010223422 learned_addr learned my addr 172.21.15.87:0/4010223422 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:19.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.478+0000 7fcca537e640 1 --2- 172.21.15.87:0/4010223422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcca00fec70 0x7fcca010a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.478+0000 7fcca4b7d640 1 --2- 172.21.15.87:0/4010223422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcca00ffe60 0x7fcca0108e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.478+0000 7fcca5b7f640 1 -- 172.21.15.87:0/4010223422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcca00fec70 msgr2=0x7fcca010a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.478+0000 7fcca5b7f640 1 --2- 172.21.15.87:0/4010223422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcca00fec70 0x7fcca010a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.478+0000 7fcca5b7f640 1 -- 172.21.15.87:0/4010223422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcca00ffe60 msgr2=0x7fcca0108e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.478+0000 7fcca5b7f640 1 --2- 172.21.15.87:0/4010223422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcca00ffe60 0x7fcca0108e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.478+0000 7fcca5b7f640 1 -- 172.21.15.87:0/4010223422 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc9c009560 con 0x7fcca0100820 2024-09-13T17:13:19.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.478+0000 7fcca4b7d640 1 --2- 172.21.15.87:0/4010223422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcca00ffe60 0x7fcca0108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:19.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.479+0000 7fcca5b7f640 1 --2- 172.21.15.87:0/4010223422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcca0100820 0x7fcca0109390 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800ead0 tx=0x7fcc9800ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:19.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.479+0000 7fcc967fc640 1 -- 172.21.15.87:0/4010223422 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9800cde0 con 0x7fcca0100820 2024-09-13T17:13:19.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.479+0000 7fcca75e2640 1 -- 172.21.15.87:0/4010223422 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca01a0060 con 0x7fcca0100820 2024-09-13T17:13:19.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.479+0000 7fcc967fc640 1 -- 172.21.15.87:0/4010223422 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcc98005020 con 0x7fcca0100820 2024-09-13T17:13:19.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.479+0000 7fcc967fc640 1 -- 172.21.15.87:0/4010223422 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc980116b0 con 0x7fcca0100820 2024-09-13T17:13:19.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.479+0000 7fcca75e2640 1 -- 172.21.15.87:0/4010223422 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca01a0570 con 0x7fcca0100820 2024-09-13T17:13:19.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.481+0000 7fcc967fc640 1 -- 172.21.15.87:0/4010223422 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fcc98005190 con 0x7fcca0100820 2024-09-13T17:13:19.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.482+0000 7fcc967fc640 1 --2- 172.21.15.87:0/4010223422 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fcc8c0a1090 0x7fcc8c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.482+0000 7fcca537e640 1 --2- 172.21.15.87:0/4010223422 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fcc8c0a1090 0x7fcc8c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.482+0000 7fcc967fc640 1 -- 172.21.15.87:0/4010223422 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7fcc980cceb0 con 0x7fcca0100820 2024-09-13T17:13:19.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.482+0000 7fccaa3e0740 1 Processor -- start 2024-09-13T17:13:19.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.482+0000 7fccaa3e0740 1 -- start start 2024-09-13T17:13:19.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.483+0000 7fcca537e640 1 --2- 172.21.15.87:0/4010223422 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fcc8c0a1090 0x7fcc8c0a3550 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c005940 tx=0x7fcc9c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:19.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.483+0000 7fccaa3e0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8393d6500 0x55b8393d6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.483+0000 7fccaa3e0740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8393d6e40 0x55b8393db900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.483+0000 7fccaa3e0740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8393dbed0 0x55b8393de390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.483+0000 7fccaa3e0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8393317c0 con 0x55b8393d6500 2024-09-13T17:13:19.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.483+0000 7fccaa3e0740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b839340b70 con 0x55b8393dbed0 2024-09-13T17:13:19.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.483+0000 7fccaa3e0740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b83933e300 con 0x55b8393d6e40 2024-09-13T17:13:19.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.483+0000 7fcca537e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8393d6500 0x55b8393d6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.483+0000 7fcca537e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8393d6500 0x55b8393d6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57622/0 (socket says 172.21.15.87:57622) 2024-09-13T17:13:19.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.483+0000 7fcca537e640 1 -- 172.21.15.87:0/4078641392 learned_addr learned my addr 172.21.15.87:0/4078641392 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:19.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.483+0000 7fcca4b7d640 1 --2- 172.21.15.87:0/4078641392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8393d6e40 0x55b8393db900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.483+0000 7fcca5b7f640 1 --2- 172.21.15.87:0/4078641392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8393dbed0 0x55b8393de390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.483+0000 7fcca537e640 1 -- 172.21.15.87:0/4078641392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8393d6e40 msgr2=0x55b8393db900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:19.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.483+0000 7fcca537e640 1 --2- 172.21.15.87:0/4078641392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8393d6e40 0x55b8393db900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.483+0000 7fcca537e640 1 -- 172.21.15.87:0/4078641392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8393dbed0 msgr2=0x55b8393de390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:19.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.483+0000 7fcca537e640 1 --2- 172.21.15.87:0/4078641392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8393dbed0 0x55b8393de390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.483+0000 7fcca537e640 1 -- 172.21.15.87:0/4078641392 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8392c64b0 con 0x55b8393d6500 2024-09-13T17:13:19.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.483+0000 7fcca4b7d640 1 --2- 172.21.15.87:0/4078641392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8393d6e40 0x55b8393db900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:19.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.483+0000 7fcca5b7f640 1 --2- 172.21.15.87:0/4078641392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8393dbed0 0x55b8393de390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:19.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.483+0000 7fcca537e640 1 --2- 172.21.15.87:0/4078641392 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8393d6500 0x55b8393d6900 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fcca00ffcc0 tx=0x7fcc9c03f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a45d203caa6cfcc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:19.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.483+0000 7fcc8b7fe640 1 -- 172.21.15.87:0/4078641392 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c004240 con 0x55b8393d6500 2024-09-13T17:13:19.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.483+0000 7fcc8b7fe640 1 -- 172.21.15.87:0/4078641392 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcc9c041070 con 0x55b8393d6500 2024-09-13T17:13:19.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.483+0000 7fcc8b7fe640 1 -- 172.21.15.87:0/4078641392 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c03d6b0 con 0x55b8393d6500 2024-09-13T17:13:19.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.484+0000 7fccaa3e0740 1 -- 172.21.15.87:0/4078641392 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8393d6500 msgr2=0x55b8393d6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.484+0000 7fccaa3e0740 1 --2- 172.21.15.87:0/4078641392 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8393d6500 0x55b8393d6900 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fcca00ffcc0 tx=0x7fcc9c03f000 comp rx=0 tx=0).stop 2024-09-13T17:13:19.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.484+0000 7fccaa3e0740 1 -- 172.21.15.87:0/4078641392 shutdown_connections 2024-09-13T17:13:19.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.484+0000 7fccaa3e0740 1 --2- 172.21.15.87:0/4078641392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8393dbed0 0x55b8393de390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.484+0000 7fccaa3e0740 1 --2- 172.21.15.87:0/4078641392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8393d6e40 0x55b8393db900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.484+0000 7fccaa3e0740 1 --2- 172.21.15.87:0/4078641392 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8393d6500 0x55b8393d6900 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.484+0000 7fccaa3e0740 1 -- 172.21.15.87:0/4078641392 >> 172.21.15.87:0/4078641392 conn(0x55b8393d1b70 msgr2=0x55b8393d1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:19.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.484+0000 7fccaa3e0740 1 -- 172.21.15.87:0/4078641392 shutdown_connections 2024-09-13T17:13:19.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.484+0000 7fccaa3e0740 1 -- 172.21.15.87:0/4078641392 wait complete. 2024-09-13T17:13:19.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.484+0000 7fccaa3e0740 1 -- start start 2024-09-13T17:13:19.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.485+0000 7fccaa3e0740 1 Processor -- start 2024-09-13T17:13:19.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.485+0000 7fccaa3e0740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8393d6500 0x55b8393e00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.485+0000 7fccaa3e0740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8393d6e40 0x55b8393e0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.485+0000 7fccaa3e0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8393dbed0 0x55b8393e7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.485+0000 7fccaa3e0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b839339bf0 con 0x55b8393dbed0 2024-09-13T17:13:19.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.485+0000 7fccaa3e0740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8392f8250 con 0x55b8393d6e40 2024-09-13T17:13:19.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.485+0000 7fccaa3e0740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8392f7ef0 con 0x55b8393d6500 2024-09-13T17:13:19.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.485+0000 7fccaa3e0740 10 client.0 _ll_register_callbacks cb 0x55b83932a740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:13:19.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.485+0000 7fcca5b7f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8393dbed0 0x55b8393e7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.485+0000 7fcca5b7f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8393dbed0 0x55b8393e7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57634/0 (socket says 172.21.15.87:57634) 2024-09-13T17:13:19.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.485+0000 7fcca5b7f640 1 -- 172.21.15.87:0/2603743689 learned_addr learned my addr 172.21.15.87:0/2603743689 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:19.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.485+0000 7fcca4b7d640 1 --2- 172.21.15.87:0/2603743689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8393d6e40 0x55b8393e0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.485+0000 7fcca537e640 1 --2- 172.21.15.87:0/2603743689 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8393d6500 0x55b8393e00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.485+0000 7fcca5b7f640 1 -- 172.21.15.87:0/2603743689 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8393d6500 msgr2=0x55b8393e00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:19.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.485+0000 7fcca5b7f640 1 --2- 172.21.15.87:0/2603743689 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8393d6500 0x55b8393e00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.485+0000 7fcca5b7f640 1 -- 172.21.15.87:0/2603743689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8393d6e40 msgr2=0x55b8393e0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:19.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.485+0000 7fcca5b7f640 1 --2- 172.21.15.87:0/2603743689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8393d6e40 0x55b8393e0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.485+0000 7fcca5b7f640 1 -- 172.21.15.87:0/2603743689 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca01079b0 con 0x55b8393dbed0 2024-09-13T17:13:19.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.486+0000 7fcca5b7f640 1 --2- 172.21.15.87:0/2603743689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8393dbed0 0x55b8393e7650 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800eaa0 tx=0x7fcc9809a770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef6734ad03f85c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:19.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.486+0000 7fcc88ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:13:19.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.486+0000 7fcc88ff9640 1 -- 172.21.15.87:0/2603743689 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc98005520 con 0x55b8393dbed0 2024-09-13T17:13:19.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.486+0000 7fcc88ff9640 1 -- 172.21.15.87:0/2603743689 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7fcc980a1f20 con 0x55b8393dbed0 2024-09-13T17:13:19.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.486+0000 7fccaa3e0740 1 -- 172.21.15.87:0/2603743689 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b83902d3c0 con 0x55b8393dbed0 2024-09-13T17:13:19.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.486+0000 7fcc88ff9640 1 -- 172.21.15.87:0/2603743689 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc980a20e0 con 0x55b8393dbed0 2024-09-13T17:13:19.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.486+0000 7fccaa3e0740 10 client.15285 fetch_fsmap learned FSMap version 23 2024-09-13T17:13:19.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.486+0000 7fccaa3e0740 1 -- 172.21.15.87:0/2603743689 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55b839338270 con 0x55b8393dbed0 2024-09-13T17:13:19.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.486+0000 7fcc88ff9640 1 -- 172.21.15.87:0/2603743689 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55b83902d3c0 con 0x55b8393dbed0 2024-09-13T17:13:19.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.486+0000 7fcc88ff9640 1 -- 172.21.15.87:0/2603743689 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 23) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fcc98018030 con 0x55b8393dbed0 2024-09-13T17:13:19.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.486+0000 7fccaa3e0740 10 client.15285 fetch_fsmap finished waiting for FSMap version 23 2024-09-13T17:13:19.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.486+0000 7fccaa3e0740 10 client.15285 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T17:13:19.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.486+0000 7fccaa3e0740 20 client.15285 populate_metadata read hostname 'smithi087' 2024-09-13T17:13:19.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.486+0000 7fccaa3e0740 1 --2- 172.21.15.87:0/2603743689 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55b8393ec4b0 0x55b8393f0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.486+0000 7fccaa3e0740 4 client.15285 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:13:19.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.486+0000 7fccaa3e0740 1 -- 172.21.15.87:0/2603743689 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b83903e6c0 con 0x55b8393ec4b0 2024-09-13T17:13:19.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.487+0000 7fcca537e640 1 --2- 172.21.15.87:0/2603743689 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55b8393ec4b0 0x55b8393f0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.487+0000 7fcc88ff9640 10 client.15285 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:13:19.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.487+0000 7fcca537e640 1 --2- 172.21.15.87:0/2603743689 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55b8393ec4b0 0x55b8393f0650 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dee8dfee99eb7d3a server_cookie=39515f8cb56b83da in_seq=0 out_seq=0 2024-09-13T17:13:19.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.488+0000 7fcc88ff9640 1 -- 172.21.15.87:0/2603743689 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55b83903e6c0 con 0x55b8393ec4b0 2024-09-13T17:13:19.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.488+0000 7fcc88ff9640 10 client.15285 handle_command_reply: tid=0 2024-09-13T17:13:19.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.488+0000 7fccaa3e0740 1 client.15285 shutdown 2024-09-13T17:13:19.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.488+0000 7fccaa3e0740 1 -- 172.21.15.87:0/2603743689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8393dbed0 msgr2=0x55b8393e7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.488+0000 7fccaa3e0740 1 --2- 172.21.15.87:0/2603743689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8393dbed0 0x55b8393e7650 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800eaa0 tx=0x7fcc9809a770 comp rx=0 tx=0).stop 2024-09-13T17:13:19.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.488+0000 7fccaa3e0740 1 -- 172.21.15.87:0/2603743689 shutdown_connections 2024-09-13T17:13:19.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.488+0000 7fccaa3e0740 1 --2- 172.21.15.87:0/2603743689 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55b8393ec4b0 0x55b8393f0650 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.488+0000 7fccaa3e0740 1 --2- 172.21.15.87:0/2603743689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8393dbed0 0x55b8393e7650 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.488+0000 7fccaa3e0740 1 --2- 172.21.15.87:0/2603743689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8393d6e40 0x55b8393e0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.488+0000 7fccaa3e0740 1 --2- 172.21.15.87:0/2603743689 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8393d6500 0x55b8393e00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.488+0000 7fcc88ff9640 0 client.15285 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:13:19.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.488+0000 7fccaa3e0740 1 -- 172.21.15.87:0/2603743689 >> 172.21.15.87:0/2603743689 conn(0x55b8393d1b70 msgr2=0x55b8393d3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:19.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.488+0000 7fccaa3e0740 1 -- 172.21.15.87:0/2603743689 shutdown_connections 2024-09-13T17:13:19.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.488+0000 7fccaa3e0740 1 -- 172.21.15.87:0/2603743689 wait complete. 2024-09-13T17:13:19.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.488+0000 7fccaa3e0740 20 client.15285 trim_cache size 0 max 16384 2024-09-13T17:13:19.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.503+0000 7fccaa3e0740 1 Processor -- start 2024-09-13T17:13:19.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.503+0000 7fccaa3e0740 1 -- start start 2024-09-13T17:13:19.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.503+0000 7fccaa3e0740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8393d6500 0x55b8393e00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.503+0000 7fccaa3e0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8393d6e40 0x55b8393e7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.503+0000 7fccaa3e0740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8393dbed0 0x55b8393e05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.503+0000 7fccaa3e0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8392bd460 con 0x55b8393d6e40 2024-09-13T17:13:19.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.503+0000 7fccaa3e0740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8393e1200 con 0x55b8393dbed0 2024-09-13T17:13:19.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.503+0000 7fccaa3e0740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b83903e6c0 con 0x55b8393d6500 2024-09-13T17:13:19.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.503+0000 7fcca4b7d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8393d6e40 0x55b8393e7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.503+0000 7fcca4b7d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8393d6e40 0x55b8393e7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57636/0 (socket says 172.21.15.87:57636) 2024-09-13T17:13:19.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.503+0000 7fcca4b7d640 1 -- 172.21.15.87:0/3760012239 learned_addr learned my addr 172.21.15.87:0/3760012239 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:19.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.503+0000 7fcca5b7f640 1 --2- 172.21.15.87:0/3760012239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8393dbed0 0x55b8393e05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.503+0000 7fcca537e640 1 --2- 172.21.15.87:0/3760012239 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8393d6500 0x55b8393e00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.503+0000 7fcca4b7d640 1 -- 172.21.15.87:0/3760012239 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8393d6500 msgr2=0x55b8393e00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:19.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.503+0000 7fcca4b7d640 1 --2- 172.21.15.87:0/3760012239 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8393d6500 0x55b8393e00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.503+0000 7fcca4b7d640 1 -- 172.21.15.87:0/3760012239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8393dbed0 msgr2=0x55b8393e05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:19.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.503+0000 7fcca4b7d640 1 --2- 172.21.15.87:0/3760012239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8393dbed0 0x55b8393e05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.503+0000 7fcca4b7d640 1 -- 172.21.15.87:0/3760012239 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8392da5f0 con 0x55b8393d6e40 2024-09-13T17:13:19.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.504+0000 7fcca4b7d640 1 --2- 172.21.15.87:0/3760012239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8393d6e40 0x55b8393e7610 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fcc90009d40 tx=0x7fcc90013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe0d88255c986212 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:19.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.504+0000 7fcc8bfff640 1 -- 172.21.15.87:0/3760012239 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc90018070 con 0x55b8393d6e40 2024-09-13T17:13:19.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.504+0000 7fcc8bfff640 1 -- 172.21.15.87:0/3760012239 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcc90009e30 con 0x55b8393d6e40 2024-09-13T17:13:19.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.504+0000 7fcc8bfff640 1 -- 172.21.15.87:0/3760012239 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc90011440 con 0x55b8393d6e40 2024-09-13T17:13:19.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.504+0000 7fccaa3e0740 1 -- 172.21.15.87:0/3760012239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8393d6e40 msgr2=0x55b8393e7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.505+0000 7fccaa3e0740 1 --2- 172.21.15.87:0/3760012239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8393d6e40 0x55b8393e7610 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fcc90009d40 tx=0x7fcc90013830 comp rx=0 tx=0).stop 2024-09-13T17:13:19.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.505+0000 7fccaa3e0740 1 -- 172.21.15.87:0/3760012239 shutdown_connections 2024-09-13T17:13:19.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.505+0000 7fccaa3e0740 1 --2- 172.21.15.87:0/3760012239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8393dbed0 0x55b8393e05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.505+0000 7fccaa3e0740 1 --2- 172.21.15.87:0/3760012239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8393d6e40 0x55b8393e7610 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.505+0000 7fccaa3e0740 1 --2- 172.21.15.87:0/3760012239 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8393d6500 0x55b8393e00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.505+0000 7fccaa3e0740 1 -- 172.21.15.87:0/3760012239 >> 172.21.15.87:0/3760012239 conn(0x55b8393d1b70 msgr2=0x55b8393d7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:19.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.505+0000 7fccaa3e0740 1 -- 172.21.15.87:0/3760012239 shutdown_connections 2024-09-13T17:13:19.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.505+0000 7fccaa3e0740 1 -- 172.21.15.87:0/3760012239 wait complete. 2024-09-13T17:13:19.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.505+0000 7fccaa3e0740 1 -- start start 2024-09-13T17:13:19.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.505+0000 7fccaa3e0740 1 Processor -- start 2024-09-13T17:13:19.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.505+0000 7fccaa3e0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8393d6500 0x55b8393e7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.505+0000 7fccaa3e0740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8393d6e40 0x55b8393e3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.505+0000 7fccaa3e0740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8393dbed0 0x55b8393e4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.505+0000 7fccaa3e0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b839442310 con 0x55b8393d6500 2024-09-13T17:13:19.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.505+0000 7fccaa3e0740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b839442450 con 0x55b8393dbed0 2024-09-13T17:13:19.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.505+0000 7fccaa3e0740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b839442590 con 0x55b8393d6e40 2024-09-13T17:13:19.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.505+0000 7fccaa3e0740 10 client.0 _ll_register_callbacks cb 0x7fcc9c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:13:19.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.506+0000 7fcca537e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8393d6500 0x55b8393e7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.506+0000 7fcca537e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8393d6500 0x55b8393e7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57644/0 (socket says 172.21.15.87:57644) 2024-09-13T17:13:19.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.506+0000 7fcca537e640 1 -- 172.21.15.87:0/2185335260 learned_addr learned my addr 172.21.15.87:0/2185335260 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:19.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.506+0000 7fcca4b7d640 1 --2- 172.21.15.87:0/2185335260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8393d6e40 0x55b8393e3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.506+0000 7fcca5b7f640 1 --2- 172.21.15.87:0/2185335260 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8393dbed0 0x55b8393e4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.506+0000 7fcca537e640 1 -- 172.21.15.87:0/2185335260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8393d6e40 msgr2=0x55b8393e3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:19.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.506+0000 7fcca537e640 1 --2- 172.21.15.87:0/2185335260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8393d6e40 0x55b8393e3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.506+0000 7fcca537e640 1 -- 172.21.15.87:0/2185335260 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8393dbed0 msgr2=0x55b8393e4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:19.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.506+0000 7fcca537e640 1 --2- 172.21.15.87:0/2185335260 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8393dbed0 0x55b8393e4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.506+0000 7fcca537e640 1 -- 172.21.15.87:0/2185335260 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc900099f0 con 0x55b8393d6500 2024-09-13T17:13:19.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.506+0000 7fcca537e640 1 --2- 172.21.15.87:0/2185335260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8393d6500 0x55b8393e7550 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c0057c0 tx=0x7fcc9c032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=552b9f86713f4e57 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:19.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.506+0000 7fcc88ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:13:19.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.506+0000 7fcc88ff9640 1 -- 172.21.15.87:0/2185335260 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c057040 con 0x55b8393d6500 2024-09-13T17:13:19.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.506+0000 7fcc88ff9640 1 -- 172.21.15.87:0/2185335260 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7fcc9c043070 con 0x55b8393d6500 2024-09-13T17:13:19.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.506+0000 7fccaa3e0740 1 -- 172.21.15.87:0/2185335260 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcc9c041070 con 0x55b8393d6500 2024-09-13T17:13:19.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.506+0000 7fcc88ff9640 1 -- 172.21.15.87:0/2185335260 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc9c05e7c0 con 0x55b8393d6500 2024-09-13T17:13:19.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.506+0000 7fccaa3e0740 10 client.15291 fetch_fsmap learned FSMap version 23 2024-09-13T17:13:19.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.506+0000 7fccaa3e0740 1 -- 172.21.15.87:0/2185335260 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55b8392ffd00 con 0x55b8393d6500 2024-09-13T17:13:19.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.507+0000 7fcc88ff9640 1 -- 172.21.15.87:0/2185335260 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcc9c041070 con 0x55b8393d6500 2024-09-13T17:13:19.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.507+0000 7fcc88ff9640 1 -- 172.21.15.87:0/2185335260 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 23) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fcc9c046050 con 0x55b8393d6500 2024-09-13T17:13:19.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.507+0000 7fccaa3e0740 10 client.15291 fetch_fsmap finished waiting for FSMap version 23 2024-09-13T17:13:19.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.507+0000 7fccaa3e0740 10 client.15291 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T17:13:19.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.507+0000 7fccaa3e0740 20 client.15291 populate_metadata read hostname 'smithi087' 2024-09-13T17:13:19.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.507+0000 7fccaa3e0740 1 --2- 172.21.15.87:0/2185335260 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55b839447090 0x55b8394439a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.507+0000 7fccaa3e0740 4 client.15291 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:13:19.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.507+0000 7fccaa3e0740 1 -- 172.21.15.87:0/2185335260 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b839091d10 con 0x55b839447090 2024-09-13T17:13:19.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.507+0000 7fcca4b7d640 1 --2- 172.21.15.87:0/2185335260 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55b839447090 0x55b8394439a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.507+0000 7fcc88ff9640 10 client.15291 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:13:19.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.507+0000 7fcca4b7d640 1 --2- 172.21.15.87:0/2185335260 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55b839447090 0x55b8394439a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dd29903932d49078 server_cookie=fbfeaebe2b0dd330 in_seq=0 out_seq=0 2024-09-13T17:13:19.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.508+0000 7fcc88ff9640 1 -- 172.21.15.87:0/2185335260 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55b839091d10 con 0x55b839447090 2024-09-13T17:13:19.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.508+0000 7fcc88ff9640 10 client.15291 handle_command_reply: tid=0 2024-09-13T17:13:19.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.508+0000 7fccaa3e0740 1 client.15291 shutdown 2024-09-13T17:13:19.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.508+0000 7fccaa3e0740 1 -- 172.21.15.87:0/2185335260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8393d6500 msgr2=0x55b8393e7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.508+0000 7fccaa3e0740 1 --2- 172.21.15.87:0/2185335260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8393d6500 0x55b8393e7550 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c0057c0 tx=0x7fcc9c032d00 comp rx=0 tx=0).stop 2024-09-13T17:13:19.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.508+0000 7fccaa3e0740 1 -- 172.21.15.87:0/2185335260 shutdown_connections 2024-09-13T17:13:19.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.508+0000 7fccaa3e0740 1 --2- 172.21.15.87:0/2185335260 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55b839447090 0x55b8394439a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.508+0000 7fccaa3e0740 1 --2- 172.21.15.87:0/2185335260 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8393dbed0 0x55b8393e4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.508+0000 7fccaa3e0740 1 --2- 172.21.15.87:0/2185335260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8393d6e40 0x55b8393e3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.508+0000 7fcc88ff9640 0 client.15291 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:13:19.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.508+0000 7fccaa3e0740 1 --2- 172.21.15.87:0/2185335260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b8393d6500 0x55b8393e7550 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.508+0000 7fccaa3e0740 1 -- 172.21.15.87:0/2185335260 >> 172.21.15.87:0/2185335260 conn(0x55b8393d1b70 msgr2=0x55b8393db2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:19.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.508+0000 7fccaa3e0740 1 -- 172.21.15.87:0/2185335260 shutdown_connections 2024-09-13T17:13:19.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.508+0000 7fccaa3e0740 1 -- 172.21.15.87:0/2185335260 wait complete. 2024-09-13T17:13:19.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.508+0000 7fccaa3e0740 20 client.15291 trim_cache size 0 max 16384 2024-09-13T17:13:19.531 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:13:19.531 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_fsid": "043d5bae-71f2-11ef-bceb-c7b262605968", 2024-09-13T17:13:19.531 INFO:teuthology.orchestra.run.smithi087.stdout: "whoami": 1, 2024-09-13T17:13:19.531 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 24484, 2024-09-13T17:13:19.532 INFO:teuthology.orchestra.run.smithi087.stdout: "want_state": "up:active", 2024-09-13T17:13:19.532 INFO:teuthology.orchestra.run.smithi087.stdout: "state": "up:active", 2024-09-13T17:13:19.532 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs", 2024-09-13T17:13:19.532 INFO:teuthology.orchestra.run.smithi087.stdout: "rank_uptime": 93.342249706999993, 2024-09-13T17:13:19.532 INFO:teuthology.orchestra.run.smithi087.stdout: "mdsmap_epoch": 23, 2024-09-13T17:13:19.532 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch": 93, 2024-09-13T17:13:19.532 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch_barrier": 89, 2024-09-13T17:13:19.532 INFO:teuthology.orchestra.run.smithi087.stdout: "uptime": 134.947486814 2024-09-13T17:13:19.533 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:13:19.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.509+0000 7fcca75e2640 1 -- 172.21.15.87:0/4010223422 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fcc8c0a1090 msgr2=0x7fcc8c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.509+0000 7fcca75e2640 1 --2- 172.21.15.87:0/4010223422 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fcc8c0a1090 0x7fcc8c0a3550 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c005940 tx=0x7fcc9c0058d0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.509+0000 7fcca75e2640 1 -- 172.21.15.87:0/4010223422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcca0100820 msgr2=0x7fcca0109390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.509+0000 7fcca75e2640 1 --2- 172.21.15.87:0/4010223422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcca0100820 0x7fcca0109390 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800ead0 tx=0x7fcc9800ef90 comp rx=0 tx=0).stop 2024-09-13T17:13:19.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.509+0000 7fcca75e2640 1 -- 172.21.15.87:0/4010223422 shutdown_connections 2024-09-13T17:13:19.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.509+0000 7fcca75e2640 1 --2- 172.21.15.87:0/4010223422 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fcc8c0a1090 0x7fcc8c0a3550 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.509+0000 7fcca75e2640 1 --2- 172.21.15.87:0/4010223422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcca0100820 0x7fcca0109390 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.509+0000 7fcca75e2640 1 --2- 172.21.15.87:0/4010223422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcca00ffe60 0x7fcca0108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.509+0000 7fcca75e2640 1 --2- 172.21.15.87:0/4010223422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcca00fec70 0x7fcca010a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.509+0000 7fcca75e2640 1 -- 172.21.15.87:0/4010223422 >> 172.21.15.87:0/4010223422 conn(0x7fcca00fa410 msgr2=0x7fcca0103270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:19.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.509+0000 7fcca75e2640 1 -- 172.21.15.87:0/4010223422 shutdown_connections 2024-09-13T17:13:19.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.509+0000 7fcca75e2640 1 -- 172.21.15.87:0/4010223422 wait complete. 2024-09-13T17:13:19.536 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-09-13T17:13:19.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:19 smithi149 ceph-mon[35496]: pgmap v338: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T17:13:19.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:19 smithi149 ceph-mon[35496]: mgrmap e18: x(active, since 8m), standbys: y, z 2024-09-13T17:13:19.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:19 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2347985811' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:13:19.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:19 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1095575347' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:13:19.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:19 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2772247247' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:13:19.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:19 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2817218423' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:13:19.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:19 smithi118 ceph-mon[34374]: pgmap v338: 129 pgs: 129 active+clean; 641 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T17:13:19.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:19 smithi118 ceph-mon[34374]: mgrmap e18: x(active, since 8m), standbys: y, z 2024-09-13T17:13:19.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:19 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2347985811' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:13:19.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:19 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1095575347' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:13:19.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:19 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2772247247' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:13:19.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:19 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2817218423' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:13:19.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.636+0000 7f0d74220640 1 -- 172.21.15.87:0/4211355011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d6c0fec70 msgr2=0x7f0d6c0ff070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.636+0000 7f0d74220640 1 --2- 172.21.15.87:0/4211355011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d6c0fec70 0x7f0d6c0ff070 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f0d68009900 tx=0x7f0d6802a410 comp rx=0 tx=0).stop 2024-09-13T17:13:19.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.636+0000 7f0d74220640 1 -- 172.21.15.87:0/4211355011 shutdown_connections 2024-09-13T17:13:19.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.636+0000 7f0d74220640 1 --2- 172.21.15.87:0/4211355011 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d6c100820 0x7f0d6c1070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.636+0000 7f0d74220640 1 --2- 172.21.15.87:0/4211355011 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d6c0ffe60 0x7f0d6c1002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.636+0000 7f0d74220640 1 --2- 172.21.15.87:0/4211355011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d6c0fec70 0x7f0d6c0ff070 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.636+0000 7f0d74220640 1 -- 172.21.15.87:0/4211355011 >> 172.21.15.87:0/4211355011 conn(0x7f0d6c0fa410 msgr2=0x7f0d6c0fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:19.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.636+0000 7f0d74220640 1 -- 172.21.15.87:0/4211355011 shutdown_connections 2024-09-13T17:13:19.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.636+0000 7f0d74220640 1 -- 172.21.15.87:0/4211355011 wait complete. 2024-09-13T17:13:19.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.636+0000 7f0d74220640 1 Processor -- start 2024-09-13T17:13:19.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.636+0000 7f0d74220640 1 -- start start 2024-09-13T17:13:19.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.636+0000 7f0d74220640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d6c0fec70 0x7f0d6c195cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.636+0000 7f0d74220640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d6c0ffe60 0x7f0d6c1961f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.636+0000 7f0d74220640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d6c100820 0x7f0d6c19d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.636+0000 7f0d74220640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c19d7c0 con 0x7f0d6c0ffe60 2024-09-13T17:13:19.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.636+0000 7f0d74220640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c19d930 con 0x7f0d6c0fec70 2024-09-13T17:13:19.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.636+0000 7f0d74220640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c19daf0 con 0x7f0d6c100820 2024-09-13T17:13:19.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.637+0000 7f0d717bb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d6c0ffe60 0x7f0d6c1961f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.637+0000 7f0d717bb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d6c0ffe60 0x7f0d6c1961f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57674/0 (socket says 172.21.15.87:57674) 2024-09-13T17:13:19.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.637+0000 7f0d717bb640 1 -- 172.21.15.87:0/1449734959 learned_addr learned my addr 172.21.15.87:0/1449734959 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:19.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.637+0000 7f0d727bd640 1 --2- 172.21.15.87:0/1449734959 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d6c100820 0x7f0d6c19d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.637+0000 7f0d71fbc640 1 --2- 172.21.15.87:0/1449734959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d6c0fec70 0x7f0d6c195cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.637+0000 7f0d717bb640 1 -- 172.21.15.87:0/1449734959 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d6c100820 msgr2=0x7f0d6c19d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.637+0000 7f0d717bb640 1 --2- 172.21.15.87:0/1449734959 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d6c100820 0x7f0d6c19d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.637+0000 7f0d717bb640 1 -- 172.21.15.87:0/1449734959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d6c0fec70 msgr2=0x7f0d6c195cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.637+0000 7f0d717bb640 1 --2- 172.21.15.87:0/1449734959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d6c0fec70 0x7f0d6c195cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.637+0000 7f0d717bb640 1 -- 172.21.15.87:0/1449734959 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d68009560 con 0x7f0d6c0ffe60 2024-09-13T17:13:19.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.637+0000 7f0d71fbc640 1 --2- 172.21.15.87:0/1449734959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d6c0fec70 0x7f0d6c195cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:19.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.637+0000 7f0d727bd640 1 --2- 172.21.15.87:0/1449734959 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d6c100820 0x7f0d6c19d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:19.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.637+0000 7f0d717bb640 1 --2- 172.21.15.87:0/1449734959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d6c0ffe60 0x7f0d6c1961f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c00c920 tx=0x7f0d5c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:19.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.637+0000 7f0d62ffd640 1 -- 172.21.15.87:0/1449734959 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c007c70 con 0x7f0d6c0ffe60 2024-09-13T17:13:19.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.637+0000 7f0d62ffd640 1 -- 172.21.15.87:0/1449734959 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0d5c007dd0 con 0x7f0d6c0ffe60 2024-09-13T17:13:19.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.637+0000 7f0d74220640 1 -- 172.21.15.87:0/1449734959 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d6c19ddd0 con 0x7f0d6c0ffe60 2024-09-13T17:13:19.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.637+0000 7f0d62ffd640 1 -- 172.21.15.87:0/1449734959 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c0187c0 con 0x7f0d6c0ffe60 2024-09-13T17:13:19.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.637+0000 7f0d74220640 1 -- 172.21.15.87:0/1449734959 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d6c19e280 con 0x7f0d6c0ffe60 2024-09-13T17:13:19.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.640+0000 7f0d62ffd640 1 -- 172.21.15.87:0/1449734959 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0d5c00f450 con 0x7f0d6c0ffe60 2024-09-13T17:13:19.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.640+0000 7f0d7701d740 1 Processor -- start 2024-09-13T17:13:19.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.640+0000 7f0d7701d740 1 -- start start 2024-09-13T17:13:19.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.640+0000 7f0d7701d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568916da500 0x5568916da900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.640+0000 7f0d7701d740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568916dae40 0x5568916df900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.640+0000 7f0d7701d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568916dfed0 0x5568916e2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.640+0000 7f0d7701d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568916357c0 con 0x5568916da500 2024-09-13T17:13:19.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.640+0000 7f0d7701d740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556891644b70 con 0x5568916dae40 2024-09-13T17:13:19.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.640+0000 7f0d7701d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x556891642300 con 0x5568916dfed0 2024-09-13T17:13:19.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.640+0000 7f0d727bd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568916da500 0x5568916da900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.641+0000 7f0d727bd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568916da500 0x5568916da900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57676/0 (socket says 172.21.15.87:57676) 2024-09-13T17:13:19.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.641+0000 7f0d727bd640 1 -- 172.21.15.87:0/1059128694 learned_addr learned my addr 172.21.15.87:0/1059128694 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:19.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.641+0000 7f0d71fbc640 1 --2- 172.21.15.87:0/1059128694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568916dae40 0x5568916df900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.641+0000 7f0d717bb640 1 --2- 172.21.15.87:0/1059128694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568916dfed0 0x5568916e2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.641+0000 7f0d727bd640 1 -- 172.21.15.87:0/1059128694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568916dfed0 msgr2=0x5568916e2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:19.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.641+0000 7f0d727bd640 1 --2- 172.21.15.87:0/1059128694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568916dfed0 0x5568916e2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.641+0000 7f0d727bd640 1 -- 172.21.15.87:0/1059128694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568916dae40 msgr2=0x5568916df900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:19.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.641+0000 7f0d727bd640 1 --2- 172.21.15.87:0/1059128694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568916dae40 0x5568916df900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.641+0000 7f0d727bd640 1 -- 172.21.15.87:0/1059128694 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568915ca4b0 con 0x5568916da500 2024-09-13T17:13:19.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.641+0000 7f0d62ffd640 1 --2- 172.21.15.87:0/1449734959 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0d580a1090 0x7f0d580a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.641+0000 7f0d727bd640 1 --2- 172.21.15.87:0/1059128694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568916da500 0x5568916da900 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0d64009fb0 tx=0x7f0d64010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f2305a4ec15a76 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:19.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.641+0000 7f0d71fbc640 1 --2- 172.21.15.87:0/1449734959 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0d580a1090 0x7f0d580a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.641+0000 7f0d62ffd640 1 -- 172.21.15.87:0/1449734959 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f0d5c0cce80 con 0x7f0d6c0ffe60 2024-09-13T17:13:19.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.641+0000 7f0d57fff640 1 -- 172.21.15.87:0/1059128694 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d64012710 con 0x5568916da500 2024-09-13T17:13:19.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.641+0000 7f0d57fff640 1 -- 172.21.15.87:0/1059128694 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0d64012d20 con 0x5568916da500 2024-09-13T17:13:19.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.641+0000 7f0d57fff640 1 -- 172.21.15.87:0/1059128694 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d64011c60 con 0x5568916da500 2024-09-13T17:13:19.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.642+0000 7f0d7701d740 1 -- 172.21.15.87:0/1059128694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568916da500 msgr2=0x5568916da900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.642+0000 7f0d71fbc640 1 --2- 172.21.15.87:0/1449734959 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0d580a1090 0x7f0d580a3550 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x5568916db870 tx=0x7f0d68005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:19.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.642+0000 7f0d7701d740 1 --2- 172.21.15.87:0/1059128694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568916da500 0x5568916da900 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0d64009fb0 tx=0x7f0d64010800 comp rx=0 tx=0).stop 2024-09-13T17:13:19.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.642+0000 7f0d7701d740 1 -- 172.21.15.87:0/1059128694 shutdown_connections 2024-09-13T17:13:19.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.642+0000 7f0d7701d740 1 --2- 172.21.15.87:0/1059128694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568916dfed0 0x5568916e2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.642+0000 7f0d7701d740 1 --2- 172.21.15.87:0/1059128694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568916dae40 0x5568916df900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.642+0000 7f0d7701d740 1 --2- 172.21.15.87:0/1059128694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568916da500 0x5568916da900 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.642+0000 7f0d7701d740 1 -- 172.21.15.87:0/1059128694 >> 172.21.15.87:0/1059128694 conn(0x5568916d5b70 msgr2=0x5568916d5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:19.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.642+0000 7f0d7701d740 1 -- 172.21.15.87:0/1059128694 shutdown_connections 2024-09-13T17:13:19.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.642+0000 7f0d7701d740 1 -- 172.21.15.87:0/1059128694 wait complete. 2024-09-13T17:13:19.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.642+0000 7f0d7701d740 1 -- start start 2024-09-13T17:13:19.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.643+0000 7f0d7701d740 1 Processor -- start 2024-09-13T17:13:19.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.643+0000 7f0d7701d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568916da500 0x5568916e41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.643+0000 7f0d7701d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568916dae40 0x5568916e46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.643+0000 7f0d7701d740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568916dfed0 0x5568916eb720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.643+0000 7f0d7701d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55689163dbf0 con 0x5568916da500 2024-09-13T17:13:19.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.643+0000 7f0d7701d740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568915fc250 con 0x5568916dfed0 2024-09-13T17:13:19.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.643+0000 7f0d7701d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568915fbef0 con 0x5568916dae40 2024-09-13T17:13:19.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.643+0000 7f0d7701d740 10 client.0 _ll_register_callbacks cb 0x55689162e740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:13:19.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.643+0000 7f0d71fbc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568916da500 0x5568916e41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.643+0000 7f0d71fbc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568916da500 0x5568916e41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57686/0 (socket says 172.21.15.87:57686) 2024-09-13T17:13:19.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.643+0000 7f0d71fbc640 1 -- 172.21.15.87:0/3884924169 learned_addr learned my addr 172.21.15.87:0/3884924169 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:19.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.643+0000 7f0d727bd640 1 --2- 172.21.15.87:0/3884924169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568916dfed0 0x5568916eb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.643+0000 7f0d71fbc640 1 -- 172.21.15.87:0/3884924169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568916dae40 msgr2=0x5568916e46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:19.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.643+0000 7f0d717bb640 1 --2- 172.21.15.87:0/3884924169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568916dae40 0x5568916e46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.643+0000 7f0d71fbc640 1 --2- 172.21.15.87:0/3884924169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568916dae40 0x5568916e46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.643+0000 7f0d71fbc640 1 -- 172.21.15.87:0/3884924169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568916dfed0 msgr2=0x5568916eb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:19.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.643+0000 7f0d71fbc640 1 --2- 172.21.15.87:0/3884924169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568916dfed0 0x5568916eb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.643+0000 7f0d71fbc640 1 -- 172.21.15.87:0/3884924169 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d64009be0 con 0x5568916da500 2024-09-13T17:13:19.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.643+0000 7f0d717bb640 1 --2- 172.21.15.87:0/3884924169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568916dae40 0x5568916e46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:19.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.643+0000 7f0d71fbc640 1 --2- 172.21.15.87:0/3884924169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568916da500 0x5568916e41a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0d68005ab0 tx=0x7f0d6802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26af4670dfec319 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:19.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.643+0000 7f0d557fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:13:19.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.644+0000 7f0d557fa640 1 -- 172.21.15.87:0/3884924169 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d680044a0 con 0x5568916da500 2024-09-13T17:13:19.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.644+0000 7f0d557fa640 1 -- 172.21.15.87:0/3884924169 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f0d68031b30 con 0x5568916da500 2024-09-13T17:13:19.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.644+0000 7f0d7701d740 1 -- 172.21.15.87:0/3884924169 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5568913313c0 con 0x5568916da500 2024-09-13T17:13:19.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.644+0000 7f0d557fa640 1 -- 172.21.15.87:0/3884924169 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d68031cf0 con 0x5568916da500 2024-09-13T17:13:19.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.644+0000 7f0d7701d740 10 client.15303 fetch_fsmap learned FSMap version 23 2024-09-13T17:13:19.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.644+0000 7f0d7701d740 1 -- 172.21.15.87:0/3884924169 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55689163c270 con 0x5568916da500 2024-09-13T17:13:19.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.644+0000 7f0d557fa640 1 -- 172.21.15.87:0/3884924169 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x5568913313c0 con 0x5568916da500 2024-09-13T17:13:19.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.644+0000 7f0d557fa640 1 -- 172.21.15.87:0/3884924169 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 23) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f0d6803d960 con 0x5568916da500 2024-09-13T17:13:19.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.644+0000 7f0d7701d740 10 client.15303 fetch_fsmap finished waiting for FSMap version 23 2024-09-13T17:13:19.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.644+0000 7f0d7701d740 10 client.15303 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-13T17:13:19.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.644+0000 7f0d7701d740 20 client.15303 populate_metadata read hostname 'smithi087' 2024-09-13T17:13:19.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.644+0000 7f0d7701d740 1 --2- 172.21.15.87:0/3884924169 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5568916efba0 0x5568916f4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.644+0000 7f0d7701d740 4 client.15303 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:13:19.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.644+0000 7f0d7701d740 1 -- 172.21.15.87:0/3884924169 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5568913426c0 con 0x5568916efba0 2024-09-13T17:13:19.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.645+0000 7f0d717bb640 1 --2- 172.21.15.87:0/3884924169 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5568916efba0 0x5568916f4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.645+0000 7f0d717bb640 1 --2- 172.21.15.87:0/3884924169 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5568916efba0 0x5568916f4860 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d283d8d45214d35a server_cookie=e69b8780bf4fab53 in_seq=0 out_seq=0 2024-09-13T17:13:19.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.645+0000 7f0d557fa640 10 client.15303 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:13:19.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.646+0000 7f0d557fa640 1 -- 172.21.15.87:0/3884924169 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5568913426c0 con 0x5568916efba0 2024-09-13T17:13:19.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.646+0000 7f0d557fa640 10 client.15303 handle_command_reply: tid=0 2024-09-13T17:13:19.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.646+0000 7f0d7701d740 1 client.15303 shutdown 2024-09-13T17:13:19.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.646+0000 7f0d7701d740 1 -- 172.21.15.87:0/3884924169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568916da500 msgr2=0x5568916e41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.646+0000 7f0d7701d740 1 --2- 172.21.15.87:0/3884924169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568916da500 0x5568916e41a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0d68005ab0 tx=0x7f0d6802a410 comp rx=0 tx=0).stop 2024-09-13T17:13:19.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.646+0000 7f0d7701d740 1 -- 172.21.15.87:0/3884924169 shutdown_connections 2024-09-13T17:13:19.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.646+0000 7f0d7701d740 1 --2- 172.21.15.87:0/3884924169 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5568916efba0 0x5568916f4860 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.646+0000 7f0d7701d740 1 --2- 172.21.15.87:0/3884924169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568916dfed0 0x5568916eb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.646+0000 7f0d7701d740 1 --2- 172.21.15.87:0/3884924169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568916dae40 0x5568916e46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.646+0000 7f0d7701d740 1 --2- 172.21.15.87:0/3884924169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568916da500 0x5568916e41a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.646+0000 7f0d557fa640 0 client.15303 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:13:19.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.646+0000 7f0d7701d740 1 -- 172.21.15.87:0/3884924169 >> 172.21.15.87:0/3884924169 conn(0x5568916d5b70 msgr2=0x5568916d7380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:19.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.646+0000 7f0d7701d740 1 -- 172.21.15.87:0/3884924169 shutdown_connections 2024-09-13T17:13:19.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.646+0000 7f0d7701d740 1 -- 172.21.15.87:0/3884924169 wait complete. 2024-09-13T17:13:19.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.646+0000 7f0d7701d740 20 client.15303 trim_cache size 0 max 16384 2024-09-13T17:13:19.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.661+0000 7f0d7701d740 1 Processor -- start 2024-09-13T17:13:19.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.661+0000 7f0d7701d740 1 -- start start 2024-09-13T17:13:19.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.661+0000 7f0d7701d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568916da500 0x5568916e22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.661+0000 7f0d7701d740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568916dae40 0x5568916e4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.661+0000 7f0d7701d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568916dfed0 0x5568916f8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.661+0000 7f0d7701d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568916d59d0 con 0x5568916da500 2024-09-13T17:13:19.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.661+0000 7f0d7701d740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568915c1460 con 0x5568916dae40 2024-09-13T17:13:19.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.661+0000 7f0d7701d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568913426c0 con 0x5568916dfed0 2024-09-13T17:13:19.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.661+0000 7f0d71fbc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568916da500 0x5568916e22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.661+0000 7f0d71fbc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568916da500 0x5568916e22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57690/0 (socket says 172.21.15.87:57690) 2024-09-13T17:13:19.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.661+0000 7f0d71fbc640 1 -- 172.21.15.87:0/854903421 learned_addr learned my addr 172.21.15.87:0/854903421 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:19.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.662+0000 7f0d717bb640 1 --2- 172.21.15.87:0/854903421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568916dae40 0x5568916e4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.662+0000 7f0d727bd640 1 --2- 172.21.15.87:0/854903421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568916dfed0 0x5568916f8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.662+0000 7f0d71fbc640 1 -- 172.21.15.87:0/854903421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568916dfed0 msgr2=0x5568916f8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:19.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.662+0000 7f0d71fbc640 1 --2- 172.21.15.87:0/854903421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568916dfed0 0x5568916f8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.662+0000 7f0d71fbc640 1 -- 172.21.15.87:0/854903421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568916dae40 msgr2=0x5568916e4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:19.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.662+0000 7f0d71fbc640 1 --2- 172.21.15.87:0/854903421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568916dae40 0x5568916e4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.662+0000 7f0d71fbc640 1 -- 172.21.15.87:0/854903421 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568915de5f0 con 0x5568916da500 2024-09-13T17:13:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.662+0000 7f0d71fbc640 1 --2- 172.21.15.87:0/854903421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568916da500 0x5568916e22c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0d6803dcf0 tx=0x7f0d68009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43da43d2cdcd9e8b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.662+0000 7f0d60ff9640 1 -- 172.21.15.87:0/854903421 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d680494b0 con 0x5568916da500 2024-09-13T17:13:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.662+0000 7f0d60ff9640 1 -- 172.21.15.87:0/854903421 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0d680317a0 con 0x5568916da500 2024-09-13T17:13:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.662+0000 7f0d60ff9640 1 -- 172.21.15.87:0/854903421 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d68003a60 con 0x5568916da500 2024-09-13T17:13:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.663+0000 7f0d7701d740 1 -- 172.21.15.87:0/854903421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568916da500 msgr2=0x5568916e22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.663+0000 7f0d7701d740 1 --2- 172.21.15.87:0/854903421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568916da500 0x5568916e22c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0d6803dcf0 tx=0x7f0d68009780 comp rx=0 tx=0).stop 2024-09-13T17:13:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.663+0000 7f0d7701d740 1 -- 172.21.15.87:0/854903421 shutdown_connections 2024-09-13T17:13:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.663+0000 7f0d7701d740 1 --2- 172.21.15.87:0/854903421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568916dfed0 0x5568916f8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.663+0000 7f0d7701d740 1 --2- 172.21.15.87:0/854903421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568916dae40 0x5568916e4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.663+0000 7f0d7701d740 1 --2- 172.21.15.87:0/854903421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568916da500 0x5568916e22c0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.663+0000 7f0d7701d740 1 -- 172.21.15.87:0/854903421 >> 172.21.15.87:0/854903421 conn(0x5568916d5b70 msgr2=0x5568916e3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.663+0000 7f0d7701d740 1 -- 172.21.15.87:0/854903421 shutdown_connections 2024-09-13T17:13:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.663+0000 7f0d7701d740 1 -- 172.21.15.87:0/854903421 wait complete. 2024-09-13T17:13:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.663+0000 7f0d7701d740 1 -- start start 2024-09-13T17:13:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.664+0000 7f0d7701d740 1 Processor -- start 2024-09-13T17:13:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.664+0000 7f0d7701d740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568916da500 0x5568917428a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.664+0000 7f0d7701d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568916dae40 0x556891742de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.664+0000 7f0d7701d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568916dfed0 0x556891749dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.664+0000 7f0d7701d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55689174a310 con 0x5568916dfed0 2024-09-13T17:13:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.664+0000 7f0d7701d740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55689174a450 con 0x5568916da500 2024-09-13T17:13:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.664+0000 7f0d7701d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55689174a5e0 con 0x5568916dae40 2024-09-13T17:13:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.664+0000 7f0d7701d740 10 client.0 _ll_register_callbacks cb 0x7f0d64009740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:13:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.664+0000 7f0d727bd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568916dfed0 0x556891749dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.664+0000 7f0d727bd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568916dfed0 0x556891749dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57700/0 (socket says 172.21.15.87:57700) 2024-09-13T17:13:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.664+0000 7f0d727bd640 1 -- 172.21.15.87:0/2851032411 learned_addr learned my addr 172.21.15.87:0/2851032411 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:19.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.664+0000 7f0d717bb640 1 --2- 172.21.15.87:0/2851032411 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568916dae40 0x556891742de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.664+0000 7f0d71fbc640 1 --2- 172.21.15.87:0/2851032411 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568916da500 0x5568917428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.664+0000 7f0d717bb640 1 -- 172.21.15.87:0/2851032411 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568916da500 msgr2=0x5568917428a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:19.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.664+0000 7f0d717bb640 1 --2- 172.21.15.87:0/2851032411 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568916da500 0x5568917428a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.664+0000 7f0d717bb640 1 -- 172.21.15.87:0/2851032411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568916dfed0 msgr2=0x556891749dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:19.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.664+0000 7f0d717bb640 1 --2- 172.21.15.87:0/2851032411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568916dfed0 0x556891749dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.664+0000 7f0d717bb640 1 -- 172.21.15.87:0/2851032411 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55689163c270 con 0x5568916dae40 2024-09-13T17:13:19.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.664+0000 7f0d727bd640 1 --2- 172.21.15.87:0/2851032411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568916dfed0 0x556891749dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:13:19.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.664+0000 7f0d71fbc640 1 --2- 172.21.15.87:0/2851032411 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568916da500 0x5568917428a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:13:19.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.665+0000 7f0d717bb640 1 --2- 172.21.15.87:0/2851032411 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568916dae40 0x556891742de0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c0ca600 tx=0x7f0d5c00fb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83c6b923c8310179 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:19.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.665+0000 7f0d557fa640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-09-13T17:13:19.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.665+0000 7f0d557fa640 1 -- 172.21.15.87:0/2851032411 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c099f00 con 0x5568916dae40 2024-09-13T17:13:19.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.665+0000 7f0d7701d740 1 -- 172.21.15.87:0/2851032411 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0d64012d20 con 0x5568916dae40 2024-09-13T17:13:19.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.665+0000 7f0d557fa640 1 -- 172.21.15.87:0/2851032411 <== mon.1 v2:172.21.15.149:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f0d5c09dd30 con 0x5568916dae40 2024-09-13T17:13:19.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.665+0000 7f0d557fa640 1 -- 172.21.15.87:0/2851032411 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d5c0a2380 con 0x5568916dae40 2024-09-13T17:13:19.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.665+0000 7f0d7701d740 10 client.24919 fetch_fsmap learned FSMap version 23 2024-09-13T17:13:19.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.665+0000 7f0d7701d740 1 -- 172.21.15.87:0/2851032411 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x556891603d00 con 0x5568916dae40 2024-09-13T17:13:19.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.665+0000 7f0d557fa640 1 -- 172.21.15.87:0/2851032411 <== mon.1 v2:172.21.15.149:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0d5c0b6080 con 0x5568916dae40 2024-09-13T17:13:19.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.665+0000 7f0d557fa640 1 -- 172.21.15.87:0/2851032411 <== mon.1 v2:172.21.15.149:3300/0 5 ==== fsmap(e 23) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f0d5c016020 con 0x5568916dae40 2024-09-13T17:13:19.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.665+0000 7f0d7701d740 10 client.24919 fetch_fsmap finished waiting for FSMap version 23 2024-09-13T17:13:19.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.665+0000 7f0d7701d740 10 client.24919 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-13T17:13:19.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.665+0000 7f0d7701d740 20 client.24919 populate_metadata read hostname 'smithi087' 2024-09-13T17:13:19.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.665+0000 7f0d7701d740 1 --2- 172.21.15.87:0/2851032411 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55689174f420 0x55689174bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:19.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.665+0000 7f0d7701d740 4 client.24919 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:13:19.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.665+0000 7f0d7701d740 1 -- 172.21.15.87:0/2851032411 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556891395d10 con 0x55689174f420 2024-09-13T17:13:19.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.666+0000 7f0d71fbc640 1 --2- 172.21.15.87:0/2851032411 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55689174f420 0x55689174bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:19.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.666+0000 7f0d557fa640 10 client.24919 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:13:19.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.666+0000 7f0d71fbc640 1 --2- 172.21.15.87:0/2851032411 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55689174f420 0x55689174bd90 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=441e540d35c83f3a server_cookie=87ed77fb4f0c7686 in_seq=0 out_seq=0 2024-09-13T17:13:19.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.666+0000 7f0d557fa640 1 -- 172.21.15.87:0/2851032411 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+322 (crc 0 0 0) 0x556891395d10 con 0x55689174f420 2024-09-13T17:13:19.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.666+0000 7f0d557fa640 10 client.24919 handle_command_reply: tid=0 2024-09-13T17:13:19.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.666+0000 7f0d7701d740 1 client.24919 shutdown 2024-09-13T17:13:19.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.666+0000 7f0d7701d740 1 -- 172.21.15.87:0/2851032411 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568916dae40 msgr2=0x556891742de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.666+0000 7f0d7701d740 1 --2- 172.21.15.87:0/2851032411 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568916dae40 0x556891742de0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c0ca600 tx=0x7f0d5c00fb50 comp rx=0 tx=0).stop 2024-09-13T17:13:19.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.666+0000 7f0d7701d740 1 -- 172.21.15.87:0/2851032411 shutdown_connections 2024-09-13T17:13:19.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.666+0000 7f0d7701d740 1 --2- 172.21.15.87:0/2851032411 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55689174f420 0x55689174bd90 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.666+0000 7f0d7701d740 1 --2- 172.21.15.87:0/2851032411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568916dfed0 0x556891749dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.666+0000 7f0d557fa640 0 client.24919 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:13:19.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.666+0000 7f0d7701d740 1 --2- 172.21.15.87:0/2851032411 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568916dae40 0x556891742de0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.666+0000 7f0d7701d740 1 --2- 172.21.15.87:0/2851032411 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568916da500 0x5568917428a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.666+0000 7f0d7701d740 1 -- 172.21.15.87:0/2851032411 >> 172.21.15.87:0/2851032411 conn(0x5568916d5b70 msgr2=0x5568916f8880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:19.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.667+0000 7f0d7701d740 1 -- 172.21.15.87:0/2851032411 shutdown_connections 2024-09-13T17:13:19.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.667+0000 7f0d7701d740 1 -- 172.21.15.87:0/2851032411 wait complete. 2024-09-13T17:13:19.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.667+0000 7f0d7701d740 20 client.24919 trim_cache size 0 max 16384 2024-09-13T17:13:19.676 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:13:19.676 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_fsid": "043d5bae-71f2-11ef-bceb-c7b262605968", 2024-09-13T17:13:19.676 INFO:teuthology.orchestra.run.smithi087.stdout: "whoami": 0, 2024-09-13T17:13:19.676 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 24499, 2024-09-13T17:13:19.676 INFO:teuthology.orchestra.run.smithi087.stdout: "want_state": "up:active", 2024-09-13T17:13:19.676 INFO:teuthology.orchestra.run.smithi087.stdout: "state": "up:active", 2024-09-13T17:13:19.677 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs", 2024-09-13T17:13:19.677 INFO:teuthology.orchestra.run.smithi087.stdout: "rank_uptime": 116.351139854, 2024-09-13T17:13:19.677 INFO:teuthology.orchestra.run.smithi087.stdout: "mdsmap_epoch": 23, 2024-09-13T17:13:19.677 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch": 93, 2024-09-13T17:13:19.677 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch_barrier": 89, 2024-09-13T17:13:19.677 INFO:teuthology.orchestra.run.smithi087.stdout: "uptime": 130.016629642 2024-09-13T17:13:19.677 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:13:19.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.667+0000 7f0d74220640 1 -- 172.21.15.87:0/1449734959 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0d580a1090 msgr2=0x7f0d580a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.667+0000 7f0d74220640 1 --2- 172.21.15.87:0/1449734959 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0d580a1090 0x7f0d580a3550 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x5568916db870 tx=0x7f0d68005a20 comp rx=0 tx=0).stop 2024-09-13T17:13:19.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.667+0000 7f0d74220640 1 -- 172.21.15.87:0/1449734959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d6c0ffe60 msgr2=0x7f0d6c1961f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:19.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.667+0000 7f0d74220640 1 --2- 172.21.15.87:0/1449734959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d6c0ffe60 0x7f0d6c1961f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c00c920 tx=0x7f0d5c00cde0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.667+0000 7f0d74220640 1 -- 172.21.15.87:0/1449734959 shutdown_connections 2024-09-13T17:13:19.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.667+0000 7f0d74220640 1 --2- 172.21.15.87:0/1449734959 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f0d580a1090 0x7f0d580a3550 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.667+0000 7f0d74220640 1 --2- 172.21.15.87:0/1449734959 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d6c100820 0x7f0d6c19d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.667+0000 7f0d74220640 1 --2- 172.21.15.87:0/1449734959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d6c0ffe60 0x7f0d6c1961f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.667+0000 7f0d74220640 1 --2- 172.21.15.87:0/1449734959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d6c0fec70 0x7f0d6c195cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:19.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.667+0000 7f0d74220640 1 -- 172.21.15.87:0/1449734959 >> 172.21.15.87:0/1449734959 conn(0x7f0d6c0fa410 msgr2=0x7f0d6c067580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:19.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.667+0000 7f0d74220640 1 -- 172.21.15.87:0/1449734959 shutdown_connections 2024-09-13T17:13:19.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:19.667+0000 7f0d74220640 1 -- 172.21.15.87:0/1449734959 wait complete. 2024-09-13T17:13:19.680 INFO:tasks.cephadm:Setup complete, yielding 2024-09-13T17:13:19.680 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T17:13:19.694 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T17:13:19.694 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-13T17:13:19.900 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:13:21.309 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:21 smithi087 ceph-mon[30934]: pgmap v339: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-13T17:13:21.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:21 smithi149 ceph-mon[35496]: pgmap v339: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-13T17:13:21.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:21 smithi118 ceph-mon[34374]: pgmap v339: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-13T17:13:21.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.640+0000 7f9f8bc8b640 1 -- 172.21.15.87:0/3870880520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f840fe0a0 msgr2=0x7f9f840fe4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:21.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.640+0000 7f9f8bc8b640 1 --2- 172.21.15.87:0/3870880520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f840fe0a0 0x7f9f840fe4a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c009ca0 tx=0x7f9f7c02a8c0 comp rx=0 tx=0).stop 2024-09-13T17:13:21.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.640+0000 7f9f8bc8b640 1 -- 172.21.15.87:0/3870880520 shutdown_connections 2024-09-13T17:13:21.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.640+0000 7f9f8bc8b640 1 --2- 172.21.15.87:0/3870880520 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f84101a40 0x7f9f841082d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:21.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.640+0000 7f9f8bc8b640 1 --2- 172.21.15.87:0/3870880520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f84101080 0x7f9f84101500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:21.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.640+0000 7f9f8bc8b640 1 --2- 172.21.15.87:0/3870880520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f840fe0a0 0x7f9f840fe4a0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:21.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.640+0000 7f9f8bc8b640 1 -- 172.21.15.87:0/3870880520 >> 172.21.15.87:0/3870880520 conn(0x7f9f840f9c10 msgr2=0x7f9f840fc030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:21.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.640+0000 7f9f8bc8b640 1 -- 172.21.15.87:0/3870880520 shutdown_connections 2024-09-13T17:13:21.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.640+0000 7f9f8bc8b640 1 -- 172.21.15.87:0/3870880520 wait complete. 2024-09-13T17:13:21.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.640+0000 7f9f8bc8b640 1 Processor -- start 2024-09-13T17:13:21.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.640+0000 7f9f8bc8b640 1 -- start start 2024-09-13T17:13:21.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.641+0000 7f9f8bc8b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f840fe0a0 0x7f9f84195de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:21.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.641+0000 7f9f8bc8b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f84101080 0x7f9f84196320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:21.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.641+0000 7f9f8bc8b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f84101a40 0x7f9f8419d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:21.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.641+0000 7f9f8bc8b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8419d8e0 con 0x7f9f840fe0a0 2024-09-13T17:13:21.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.641+0000 7f9f8bc8b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8419da50 con 0x7f9f84101a40 2024-09-13T17:13:21.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.641+0000 7f9f8bc8b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8419dc10 con 0x7f9f84101080 2024-09-13T17:13:21.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.641+0000 7f9f89a27640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f840fe0a0 0x7f9f84195de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:21.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.641+0000 7f9f89a27640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f840fe0a0 0x7f9f84195de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57720/0 (socket says 172.21.15.87:57720) 2024-09-13T17:13:21.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.641+0000 7f9f89a27640 1 -- 172.21.15.87:0/437744160 learned_addr learned my addr 172.21.15.87:0/437744160 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.641+0000 7f9f89226640 1 --2- 172.21.15.87:0/437744160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f84101080 0x7f9f84196320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.641+0000 7f9f8a228640 1 --2- 172.21.15.87:0/437744160 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f84101a40 0x7f9f8419d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.641+0000 7f9f89a27640 1 -- 172.21.15.87:0/437744160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f84101080 msgr2=0x7f9f84196320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.641+0000 7f9f89a27640 1 --2- 172.21.15.87:0/437744160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f84101080 0x7f9f84196320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.641+0000 7f9f89a27640 1 -- 172.21.15.87:0/437744160 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f84101a40 msgr2=0x7f9f8419d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.641+0000 7f9f89a27640 1 --2- 172.21.15.87:0/437744160 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f84101a40 0x7f9f8419d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.641+0000 7f9f89a27640 1 -- 172.21.15.87:0/437744160 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f7c009900 con 0x7f9f840fe0a0 2024-09-13T17:13:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.641+0000 7f9f8a228640 1 --2- 172.21.15.87:0/437744160 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f84101a40 0x7f9f8419d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.641+0000 7f9f89a27640 1 --2- 172.21.15.87:0/437744160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f840fe0a0 0x7f9f84195de0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c003ba0 tx=0x7f9f7c003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.641+0000 7f9f82ffd640 1 -- 172.21.15.87:0/437744160 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c02f310 con 0x7f9f840fe0a0 2024-09-13T17:13:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.641+0000 7f9f82ffd640 1 -- 172.21.15.87:0/437744160 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9f7c040070 con 0x7f9f840fe0a0 2024-09-13T17:13:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.641+0000 7f9f8bc8b640 1 -- 172.21.15.87:0/437744160 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f8419de90 con 0x7f9f840fe0a0 2024-09-13T17:13:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.641+0000 7f9f82ffd640 1 -- 172.21.15.87:0/437744160 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c0048a0 con 0x7f9f840fe0a0 2024-09-13T17:13:21.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.642+0000 7f9f8bc8b640 1 -- 172.21.15.87:0/437744160 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f8419e330 con 0x7f9f840fe0a0 2024-09-13T17:13:21.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.642+0000 7f9f8bc8b640 1 -- 172.21.15.87:0/437744160 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f84107370 con 0x7f9f840fe0a0 2024-09-13T17:13:21.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.643+0000 7f9f82ffd640 1 -- 172.21.15.87:0/437744160 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9f7c042030 con 0x7f9f840fe0a0 2024-09-13T17:13:21.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.644+0000 7f9f82ffd640 1 --2- 172.21.15.87:0/437744160 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f9f6c0a1130 0x7f9f6c0a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:21.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.644+0000 7f9f89226640 1 --2- 172.21.15.87:0/437744160 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f9f6c0a1130 0x7f9f6c0a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:21.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.644+0000 7f9f82ffd640 1 -- 172.21.15.87:0/437744160 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f9f7c0ee500 con 0x7f9f840fe0a0 2024-09-13T17:13:21.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.645+0000 7f9f89226640 1 --2- 172.21.15.87:0/437744160 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f9f6c0a1130 0x7f9f6c0a35f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9f84197300 tx=0x7f9f7800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:21.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.648+0000 7f9f82ffd640 1 -- 172.21.15.87:0/437744160 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9f7c0b7860 con 0x7f9f840fe0a0 2024-09-13T17:13:21.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.825+0000 7f9f8bc8b640 1 -- 172.21.15.87:0/437744160 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f8402c550 con 0x7f9f6c0a1130 2024-09-13T17:13:21.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.826+0000 7f9f82ffd640 1 -- 172.21.15.87:0/437744160 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f9f8402c550 con 0x7f9f6c0a1130 2024-09-13T17:13:21.828 INFO:teuthology.orchestra.run.smithi087.stdout:Backend: cephadm 2024-09-13T17:13:21.828 INFO:teuthology.orchestra.run.smithi087.stdout:Available: Yes 2024-09-13T17:13:21.828 INFO:teuthology.orchestra.run.smithi087.stdout:Paused: No 2024-09-13T17:13:21.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.828+0000 7f9f8bc8b640 1 -- 172.21.15.87:0/437744160 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f9f6c0a1130 msgr2=0x7f9f6c0a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:21.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.828+0000 7f9f8bc8b640 1 --2- 172.21.15.87:0/437744160 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f9f6c0a1130 0x7f9f6c0a35f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9f84197300 tx=0x7f9f7800a2d0 comp rx=0 tx=0).stop 2024-09-13T17:13:21.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.828+0000 7f9f8bc8b640 1 -- 172.21.15.87:0/437744160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f840fe0a0 msgr2=0x7f9f84195de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:21.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.828+0000 7f9f8bc8b640 1 --2- 172.21.15.87:0/437744160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f840fe0a0 0x7f9f84195de0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c003ba0 tx=0x7f9f7c003bd0 comp rx=0 tx=0).stop 2024-09-13T17:13:21.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.828+0000 7f9f8bc8b640 1 -- 172.21.15.87:0/437744160 shutdown_connections 2024-09-13T17:13:21.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.828+0000 7f9f8bc8b640 1 --2- 172.21.15.87:0/437744160 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f9f6c0a1130 0x7f9f6c0a35f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:21.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.828+0000 7f9f8bc8b640 1 --2- 172.21.15.87:0/437744160 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f84101a40 0x7f9f8419d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:21.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.828+0000 7f9f8bc8b640 1 --2- 172.21.15.87:0/437744160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f84101080 0x7f9f84196320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:21.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.828+0000 7f9f8bc8b640 1 --2- 172.21.15.87:0/437744160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f840fe0a0 0x7f9f84195de0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:21.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.828+0000 7f9f8bc8b640 1 -- 172.21.15.87:0/437744160 >> 172.21.15.87:0/437744160 conn(0x7f9f840f9c10 msgr2=0x7f9f84104540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:21.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.828+0000 7f9f8bc8b640 1 -- 172.21.15.87:0/437744160 shutdown_connections 2024-09-13T17:13:21.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:21.828+0000 7f9f8bc8b640 1 -- 172.21.15.87:0/437744160 wait complete. 2024-09-13T17:13:22.603 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-13T17:13:22.801 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:13:23.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:23 smithi087 ceph-mon[30934]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:13:23.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:23 smithi087 ceph-mon[30934]: pgmap v340: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T17:13:23.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:23 smithi149 ceph-mon[35496]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:13:23.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:23 smithi149 ceph-mon[35496]: pgmap v340: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T17:13:23.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:23 smithi118 ceph-mon[34374]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:13:23.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:23 smithi118 ceph-mon[34374]: pgmap v340: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T17:13:24.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.662+0000 7f400c4ef640 1 -- 172.21.15.87:0/2950867366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40040ffee0 msgr2=0x7f4004100360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:24.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.662+0000 7f400c4ef640 1 --2- 172.21.15.87:0/2950867366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40040ffee0 0x7f4004100360 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4009900 tx=0x7f3ff402a410 comp rx=0 tx=0).stop 2024-09-13T17:13:24.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.662+0000 7f400c4ef640 1 -- 172.21.15.87:0/2950867366 shutdown_connections 2024-09-13T17:13:24.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.662+0000 7f400c4ef640 1 --2- 172.21.15.87:0/2950867366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40041008a0 0x7f4004107130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:24.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.662+0000 7f400c4ef640 1 --2- 172.21.15.87:0/2950867366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40040ffee0 0x7f4004100360 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:24.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.662+0000 7f400c4ef640 1 --2- 172.21.15.87:0/2950867366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40040fece0 0x7f40040ff0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:24.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.662+0000 7f400c4ef640 1 -- 172.21.15.87:0/2950867366 >> 172.21.15.87:0/2950867366 conn(0x7f40040fa490 msgr2=0x7f40040fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:24.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.662+0000 7f400c4ef640 1 -- 172.21.15.87:0/2950867366 shutdown_connections 2024-09-13T17:13:24.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.662+0000 7f400c4ef640 1 -- 172.21.15.87:0/2950867366 wait complete. 2024-09-13T17:13:24.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.663+0000 7f400c4ef640 1 Processor -- start 2024-09-13T17:13:24.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.663+0000 7f400c4ef640 1 -- start start 2024-09-13T17:13:24.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.663+0000 7f400c4ef640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40040fece0 0x7f4004068a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:24.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.663+0000 7f400c4ef640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40040ffee0 0x7f400419aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:24.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.663+0000 7f400c4ef640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40041008a0 0x7f400419d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:24.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.663+0000 7f400c4ef640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400419d8a0 con 0x7f40041008a0 2024-09-13T17:13:24.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.663+0000 7f400c4ef640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400419da10 con 0x7f40040ffee0 2024-09-13T17:13:24.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.663+0000 7f400c4ef640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400419dbd0 con 0x7f40040fece0 2024-09-13T17:13:24.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.663+0000 7f400aa8c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40041008a0 0x7f400419d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:24.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.663+0000 7f400aa8c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40041008a0 0x7f400419d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57730/0 (socket says 172.21.15.87:57730) 2024-09-13T17:13:24.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.663+0000 7f400aa8c640 1 -- 172.21.15.87:0/1769899730 learned_addr learned my addr 172.21.15.87:0/1769899730 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:24.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.663+0000 7f400a28b640 1 --2- 172.21.15.87:0/1769899730 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40040fece0 0x7f4004068a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:24.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.663+0000 7f4009a8a640 1 --2- 172.21.15.87:0/1769899730 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40040ffee0 0x7f400419aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:24.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.664+0000 7f400aa8c640 1 -- 172.21.15.87:0/1769899730 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40040fece0 msgr2=0x7f4004068a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:24.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.664+0000 7f400aa8c640 1 --2- 172.21.15.87:0/1769899730 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40040fece0 0x7f4004068a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:24.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.664+0000 7f400aa8c640 1 -- 172.21.15.87:0/1769899730 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40040ffee0 msgr2=0x7f400419aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:24.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.664+0000 7f400aa8c640 1 --2- 172.21.15.87:0/1769899730 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40040ffee0 0x7f400419aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:24.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.664+0000 7f400aa8c640 1 -- 172.21.15.87:0/1769899730 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff4009560 con 0x7f40041008a0 2024-09-13T17:13:24.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.664+0000 7f400a28b640 1 --2- 172.21.15.87:0/1769899730 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40040fece0 0x7f4004068a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:24.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.664+0000 7f400aa8c640 1 --2- 172.21.15.87:0/1769899730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40041008a0 0x7f400419d0c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc00eaa0 tx=0x7f3ffc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:24.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.664+0000 7f3ffb7fe640 1 -- 172.21.15.87:0/1769899730 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc00cdb0 con 0x7f40041008a0 2024-09-13T17:13:24.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.664+0000 7f3ffb7fe640 1 -- 172.21.15.87:0/1769899730 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3ffc005020 con 0x7f40041008a0 2024-09-13T17:13:24.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.664+0000 7f400c4ef640 1 -- 172.21.15.87:0/1769899730 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f400419de50 con 0x7f40041008a0 2024-09-13T17:13:24.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.664+0000 7f3ffb7fe640 1 -- 172.21.15.87:0/1769899730 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc0116b0 con 0x7f40041008a0 2024-09-13T17:13:24.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.664+0000 7f400c4ef640 1 -- 172.21.15.87:0/1769899730 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f400419e310 con 0x7f40041008a0 2024-09-13T17:13:24.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.665+0000 7f400c4ef640 1 -- 172.21.15.87:0/1769899730 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4004106180 con 0x7f40041008a0 2024-09-13T17:13:24.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.666+0000 7f3ffb7fe640 1 -- 172.21.15.87:0/1769899730 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3ffc005190 con 0x7f40041008a0 2024-09-13T17:13:24.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.667+0000 7f3ffb7fe640 1 --2- 172.21.15.87:0/1769899730 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3ff00a1100 0x7f3ff00a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:24.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.667+0000 7f400a28b640 1 --2- 172.21.15.87:0/1769899730 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3ff00a1100 0x7f3ff00a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:24.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.667+0000 7f3ffb7fe640 1 -- 172.21.15.87:0/1769899730 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f3ffc0cce10 con 0x7f40041008a0 2024-09-13T17:13:24.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.667+0000 7f400a28b640 1 --2- 172.21.15.87:0/1769899730 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3ff00a1100 0x7f3ff00a35c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f40040ffd40 tx=0x7f400000a560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:24.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.671+0000 7f3ffb7fe640 1 -- 172.21.15.87:0/1769899730 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3ffc0961d0 con 0x7f40041008a0 2024-09-13T17:13:24.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.842+0000 7f400c4ef640 1 -- 172.21.15.87:0/1769899730 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f400402c4f0 con 0x7f3ff00a1100 2024-09-13T17:13:24.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.854+0000 7f3ffb7fe640 1 -- 172.21.15.87:0/1769899730 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4061 (secure 0 0 0) 0x7f400402c4f0 con 0x7f3ff00a1100 2024-09-13T17:13:24.856 INFO:teuthology.orchestra.run.smithi087.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T17:13:24.856 INFO:teuthology.orchestra.run.smithi087.stdout:mds.a smithi087 running (2m) 29s ago 2m 14.1M - 18.2.4-860-g6c6b083f 8a91f241d7d4 3b4b3dcc0e87 2024-09-13T17:13:24.856 INFO:teuthology.orchestra.run.smithi087.stdout:mds.b smithi118 running (2m) 62s ago 2m 17.2M - 18.2.4-860-g6c6b083f 8a91f241d7d4 ba93741e9051 2024-09-13T17:13:24.856 INFO:teuthology.orchestra.run.smithi087.stdout:mds.c smithi149 running (2m) 62s ago 2m 17.6M - 18.2.4-860-g6c6b083f 8a91f241d7d4 3df041b80a22 2024-09-13T17:13:24.857 INFO:teuthology.orchestra.run.smithi087.stdout:mds.d smithi087 running (2m) 29s ago 2m 15.7M - 18.2.4-860-g6c6b083f 8a91f241d7d4 ed1ef8cca117 2024-09-13T17:13:24.857 INFO:teuthology.orchestra.run.smithi087.stdout:mds.e smithi118 running (2m) 62s ago 2m 13.3M - 18.2.4-860-g6c6b083f 8a91f241d7d4 c5b82dd49f06 2024-09-13T17:13:24.857 INFO:teuthology.orchestra.run.smithi087.stdout:mds.f smithi149 running (2m) 62s ago 2m 18.6M - 18.2.4-860-g6c6b083f 8a91f241d7d4 cd23e64839fa 2024-09-13T17:13:24.857 INFO:teuthology.orchestra.run.smithi087.stdout:mds.g smithi087 running (2m) 29s ago 2m 14.2M - 18.2.4-860-g6c6b083f 8a91f241d7d4 c72bb8e972b5 2024-09-13T17:13:24.857 INFO:teuthology.orchestra.run.smithi087.stdout:mds.h smithi118 running (2m) 62s ago 2m 16.3M - 18.2.4-860-g6c6b083f 8a91f241d7d4 9de8deadcdc3 2024-09-13T17:13:24.857 INFO:teuthology.orchestra.run.smithi087.stdout:mds.i smithi149 running (2m) 62s ago 2m 26.0M - 18.2.4-860-g6c6b083f 8a91f241d7d4 364b088f4326 2024-09-13T17:13:24.857 INFO:teuthology.orchestra.run.smithi087.stdout:mds.j smithi087 running (2m) 29s ago 2m 14.1M - 18.2.4-860-g6c6b083f 8a91f241d7d4 256bdb11cf6f 2024-09-13T17:13:24.857 INFO:teuthology.orchestra.run.smithi087.stdout:mds.k smithi118 running (2m) 62s ago 2m 16.6M - 18.2.4-860-g6c6b083f 8a91f241d7d4 ddac1b90024b 2024-09-13T17:13:24.857 INFO:teuthology.orchestra.run.smithi087.stdout:mds.l smithi149 running (2m) 62s ago 2m 15.4M - 18.2.4-860-g6c6b083f 8a91f241d7d4 f4a6ee081929 2024-09-13T17:13:24.857 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.x smithi087 *:9283,8765 running (9m) 29s ago 9m 497M - 18.2.4-860-g6c6b083f 8a91f241d7d4 0002ab020715 2024-09-13T17:13:24.857 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.y smithi118 *:8443,8765 running (7m) 62s ago 7m 441M - 18.2.4-860-g6c6b083f 8a91f241d7d4 fd5d227353d9 2024-09-13T17:13:24.857 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.z smithi149 *:8443,8765 running (7m) 62s ago 7m 440M - 18.2.4-860-g6c6b083f 8a91f241d7d4 5de72e2b7f58 2024-09-13T17:13:24.858 INFO:teuthology.orchestra.run.smithi087.stdout:mon.a smithi087 running (9m) 29s ago 9m 51.3M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 054de9f0e33b 2024-09-13T17:13:24.858 INFO:teuthology.orchestra.run.smithi087.stdout:mon.b smithi118 running (7m) 62s ago 7m 39.4M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 01f3bc8e7b81 2024-09-13T17:13:24.858 INFO:teuthology.orchestra.run.smithi087.stdout:mon.c smithi149 running (7m) 62s ago 7m 39.3M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 f9fefcd4622c 2024-09-13T17:13:24.858 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0 smithi087 running (7m) 29s ago 7m 58.2M 4272M 18.2.4-860-g6c6b083f 8a91f241d7d4 fd608c9c07a2 2024-09-13T17:13:24.858 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1 smithi118 running (6m) 62s ago 6m 57.7M 4272M 18.2.4-860-g6c6b083f 8a91f241d7d4 2c6df77dffa1 2024-09-13T17:13:24.858 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2 smithi149 running (6m) 62s ago 6m 47.0M 1453M 18.2.4-860-g6c6b083f 8a91f241d7d4 752e681bbaa8 2024-09-13T17:13:24.858 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3 smithi087 running (6m) 29s ago 6m 44.4M 4272M 18.2.4-860-g6c6b083f 8a91f241d7d4 c24c7c736d1f 2024-09-13T17:13:24.858 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4 smithi118 running (5m) 62s ago 5m 52.5M 4272M 18.2.4-860-g6c6b083f 8a91f241d7d4 794c2476431f 2024-09-13T17:13:24.858 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5 smithi149 running (5m) 62s ago 5m 57.2M 1453M 18.2.4-860-g6c6b083f 8a91f241d7d4 821f46df966a 2024-09-13T17:13:24.858 INFO:teuthology.orchestra.run.smithi087.stdout:osd.6 smithi087 running (4m) 29s ago 4m 43.5M 4272M 18.2.4-860-g6c6b083f 8a91f241d7d4 137720ed4960 2024-09-13T17:13:24.858 INFO:teuthology.orchestra.run.smithi087.stdout:osd.7 smithi118 running (4m) 62s ago 4m 47.0M 4272M 18.2.4-860-g6c6b083f 8a91f241d7d4 b15d51e0ad1d 2024-09-13T17:13:24.858 INFO:teuthology.orchestra.run.smithi087.stdout:osd.8 smithi149 running (4m) 62s ago 4m 43.2M 1453M 18.2.4-860-g6c6b083f 8a91f241d7d4 8d211e881c5f 2024-09-13T17:13:24.858 INFO:teuthology.orchestra.run.smithi087.stdout:osd.9 smithi087 running (3m) 29s ago 3m 52.2M 4272M 18.2.4-860-g6c6b083f 8a91f241d7d4 41a732fcd22c 2024-09-13T17:13:24.859 INFO:teuthology.orchestra.run.smithi087.stdout:osd.10 smithi118 running (3m) 62s ago 3m 55.0M 4272M 18.2.4-860-g6c6b083f 8a91f241d7d4 5527996ba27d 2024-09-13T17:13:24.859 INFO:teuthology.orchestra.run.smithi087.stdout:osd.11 smithi149 running (2m) 62s ago 2m 50.7M 1453M 18.2.4-860-g6c6b083f 8a91f241d7d4 9f9231200ae3 2024-09-13T17:13:24.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.856+0000 7f400c4ef640 1 -- 172.21.15.87:0/1769899730 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3ff00a1100 msgr2=0x7f3ff00a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:24.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.856+0000 7f400c4ef640 1 --2- 172.21.15.87:0/1769899730 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3ff00a1100 0x7f3ff00a35c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f40040ffd40 tx=0x7f400000a560 comp rx=0 tx=0).stop 2024-09-13T17:13:24.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.856+0000 7f400c4ef640 1 -- 172.21.15.87:0/1769899730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40041008a0 msgr2=0x7f400419d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:24.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.856+0000 7f400c4ef640 1 --2- 172.21.15.87:0/1769899730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40041008a0 0x7f400419d0c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc00eaa0 tx=0x7f3ffc00ef60 comp rx=0 tx=0).stop 2024-09-13T17:13:24.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.856+0000 7f400c4ef640 1 -- 172.21.15.87:0/1769899730 shutdown_connections 2024-09-13T17:13:24.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.856+0000 7f400c4ef640 1 --2- 172.21.15.87:0/1769899730 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3ff00a1100 0x7f3ff00a35c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:24.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.856+0000 7f400c4ef640 1 --2- 172.21.15.87:0/1769899730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40041008a0 0x7f400419d0c0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:24.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.856+0000 7f400c4ef640 1 --2- 172.21.15.87:0/1769899730 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40040ffee0 0x7f400419aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:24.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.856+0000 7f400c4ef640 1 --2- 172.21.15.87:0/1769899730 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40040fece0 0x7f4004068a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:24.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.856+0000 7f400c4ef640 1 -- 172.21.15.87:0/1769899730 >> 172.21.15.87:0/1769899730 conn(0x7f40040fa490 msgr2=0x7f4004103350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:24.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.856+0000 7f400c4ef640 1 -- 172.21.15.87:0/1769899730 shutdown_connections 2024-09-13T17:13:24.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:24.856+0000 7f400c4ef640 1 -- 172.21.15.87:0/1769899730 wait complete. 2024-09-13T17:13:25.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:25 smithi149 ceph-mon[35496]: pgmap v341: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-13T17:13:25.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:25 smithi118 ceph-mon[34374]: pgmap v341: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-13T17:13:25.622 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:25 smithi087 ceph-mon[30934]: pgmap v341: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-13T17:13:25.645 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-13T17:13:25.843 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:13:26.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:26 smithi149 ceph-mon[35496]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:13:26.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:26 smithi118 ceph-mon[34374]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:13:26.663 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:26 smithi087 ceph-mon[30934]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:13:27.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.481+0000 7f5698231640 1 -- 172.21.15.87:0/2051820680 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56900ffe00 msgr2=0x7f5690100200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:27.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.481+0000 7f5698231640 1 --2- 172.21.15.87:0/2051820680 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56900ffe00 0x7f5690100200 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5680009900 tx=0x7f568002a410 comp rx=0 tx=0).stop 2024-09-13T17:13:27.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.481+0000 7f5698231640 1 -- 172.21.15.87:0/2051820680 shutdown_connections 2024-09-13T17:13:27.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.481+0000 7f5698231640 1 --2- 172.21.15.87:0/2051820680 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5690101920 0x7f5690108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:27.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.481+0000 7f5698231640 1 --2- 172.21.15.87:0/2051820680 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5690100f60 0x7f56901013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:27.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.481+0000 7f5698231640 1 --2- 172.21.15.87:0/2051820680 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56900ffe00 0x7f5690100200 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:27.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.481+0000 7f5698231640 1 -- 172.21.15.87:0/2051820680 >> 172.21.15.87:0/2051820680 conn(0x7f56900fb5d0 msgr2=0x7f56900fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:27.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.481+0000 7f5698231640 1 -- 172.21.15.87:0/2051820680 shutdown_connections 2024-09-13T17:13:27.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.481+0000 7f5698231640 1 -- 172.21.15.87:0/2051820680 wait complete. 2024-09-13T17:13:27.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.481+0000 7f5698231640 1 Processor -- start 2024-09-13T17:13:27.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.481+0000 7f5698231640 1 -- start start 2024-09-13T17:13:27.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.482+0000 7f5698231640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56900ffe00 0x7f5690074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:27.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.482+0000 7f5698231640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5690100f60 0x7f56900728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:27.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.482+0000 7f5698231640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5690101920 0x7f5690072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:27.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.482+0000 7f5698231640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5690073570 con 0x7f5690101920 2024-09-13T17:13:27.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.482+0000 7f5698231640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56900736e0 con 0x7f5690100f60 2024-09-13T17:13:27.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.482+0000 7f5698231640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569019fe40 con 0x7f56900ffe00 2024-09-13T17:13:27.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.482+0000 7f56967ce640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5690101920 0x7f5690072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:27.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.482+0000 7f56967ce640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5690101920 0x7f5690072de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57748/0 (socket says 172.21.15.87:57748) 2024-09-13T17:13:27.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.482+0000 7f56967ce640 1 -- 172.21.15.87:0/1045011779 learned_addr learned my addr 172.21.15.87:0/1045011779 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:27.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.482+0000 7f5695fcd640 1 --2- 172.21.15.87:0/1045011779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56900ffe00 0x7f5690074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:27.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.482+0000 7f56957cc640 1 --2- 172.21.15.87:0/1045011779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5690100f60 0x7f56900728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:27.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.482+0000 7f56967ce640 1 -- 172.21.15.87:0/1045011779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56900ffe00 msgr2=0x7f5690074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:27.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.482+0000 7f56967ce640 1 --2- 172.21.15.87:0/1045011779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56900ffe00 0x7f5690074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:27.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.482+0000 7f56967ce640 1 -- 172.21.15.87:0/1045011779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5690100f60 msgr2=0x7f56900728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:27.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.482+0000 7f56967ce640 1 --2- 172.21.15.87:0/1045011779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5690100f60 0x7f56900728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:27.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.482+0000 7f56967ce640 1 -- 172.21.15.87:0/1045011779 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5680009560 con 0x7f5690101920 2024-09-13T17:13:27.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.482+0000 7f5695fcd640 1 --2- 172.21.15.87:0/1045011779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56900ffe00 0x7f5690074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:27.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.482+0000 7f56957cc640 1 --2- 172.21.15.87:0/1045011779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5690100f60 0x7f56900728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:27.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.482+0000 7f56967ce640 1 --2- 172.21.15.87:0/1045011779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5690101920 0x7f5690072de0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f568800cb30 tx=0x7f568800a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:27.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.482+0000 7f5686ffd640 1 -- 172.21.15.87:0/1045011779 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568800ae90 con 0x7f5690101920 2024-09-13T17:13:27.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.482+0000 7f5686ffd640 1 -- 172.21.15.87:0/1045011779 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5688005020 con 0x7f5690101920 2024-09-13T17:13:27.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.482+0000 7f5686ffd640 1 -- 172.21.15.87:0/1045011779 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568800f690 con 0x7f5690101920 2024-09-13T17:13:27.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.482+0000 7f5698231640 1 -- 172.21.15.87:0/1045011779 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56901a00f0 con 0x7f5690101920 2024-09-13T17:13:27.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.482+0000 7f5698231640 1 -- 172.21.15.87:0/1045011779 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56901a0620 con 0x7f5690101920 2024-09-13T17:13:27.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.483+0000 7f5698231640 1 -- 172.21.15.87:0/1045011779 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56901072b0 con 0x7f5690101920 2024-09-13T17:13:27.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.484+0000 7f5686ffd640 1 -- 172.21.15.87:0/1045011779 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5688005190 con 0x7f5690101920 2024-09-13T17:13:27.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.485+0000 7f5686ffd640 1 --2- 172.21.15.87:0/1045011779 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f567c0a1100 0x7f567c0a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:27.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.485+0000 7f5695fcd640 1 --2- 172.21.15.87:0/1045011779 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f567c0a1100 0x7f567c0a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:27.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.485+0000 7f5686ffd640 1 -- 172.21.15.87:0/1045011779 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f56880ccd20 con 0x7f5690101920 2024-09-13T17:13:27.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.486+0000 7f5695fcd640 1 --2- 172.21.15.87:0/1045011779 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f567c0a1100 0x7f567c0a35c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5680006010 tx=0x7f5680005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:27.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.489+0000 7f5686ffd640 1 -- 172.21.15.87:0/1045011779 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f56880960e0 con 0x7f5690101920 2024-09-13T17:13:27.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:27 smithi149 ceph-mon[35496]: pgmap v342: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T17:13:27.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:27 smithi118 ceph-mon[34374]: pgmap v342: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T17:13:27.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.660+0000 7f5698231640 1 -- 172.21.15.87:0/1045011779 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f569002c450 con 0x7f567c0a1100 2024-09-13T17:13:27.663 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:27 smithi087 ceph-mon[30934]: pgmap v342: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T17:13:27.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.668+0000 7f5686ffd640 1 -- 172.21.15.87:0/1045011779 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7f569002c450 con 0x7f567c0a1100 2024-09-13T17:13:27.670 INFO:teuthology.orchestra.run.smithi087.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-13T17:13:27.670 INFO:teuthology.orchestra.run.smithi087.stdout:mds.all 12/12 65s ago 2m smithi087=a;smithi087=d;smithi087=g;smithi087=j;smithi118=b;smithi118=e;smithi118=h;smithi118=k;smithi149=c;smithi149=f;smithi149=i;smithi149=l;count:12 2024-09-13T17:13:27.670 INFO:teuthology.orchestra.run.smithi087.stdout:mgr 3/3 65s ago 7m smithi087=x;smithi118=y;smithi149=z;count:3 2024-09-13T17:13:27.670 INFO:teuthology.orchestra.run.smithi087.stdout:mon 3/3 65s ago 8m smithi087:172.21.15.87=a;smithi118:172.21.15.118=b;smithi149:172.21.15.149=c;count:3 2024-09-13T17:13:27.670 INFO:teuthology.orchestra.run.smithi087.stdout:osd 12 65s ago - 2024-09-13T17:13:27.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.669+0000 7f5698231640 1 -- 172.21.15.87:0/1045011779 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f567c0a1100 msgr2=0x7f567c0a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:27.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.669+0000 7f5698231640 1 --2- 172.21.15.87:0/1045011779 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f567c0a1100 0x7f567c0a35c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5680006010 tx=0x7f5680005a20 comp rx=0 tx=0).stop 2024-09-13T17:13:27.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.669+0000 7f5698231640 1 -- 172.21.15.87:0/1045011779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5690101920 msgr2=0x7f5690072de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:27.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.669+0000 7f5698231640 1 --2- 172.21.15.87:0/1045011779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5690101920 0x7f5690072de0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f568800cb30 tx=0x7f568800a250 comp rx=0 tx=0).stop 2024-09-13T17:13:27.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.670+0000 7f5698231640 1 -- 172.21.15.87:0/1045011779 shutdown_connections 2024-09-13T17:13:27.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.670+0000 7f5698231640 1 --2- 172.21.15.87:0/1045011779 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f567c0a1100 0x7f567c0a35c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:27.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.670+0000 7f5698231640 1 --2- 172.21.15.87:0/1045011779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5690101920 0x7f5690072de0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:27.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.670+0000 7f5698231640 1 --2- 172.21.15.87:0/1045011779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5690100f60 0x7f56900728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:27.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.670+0000 7f5698231640 1 --2- 172.21.15.87:0/1045011779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56900ffe00 0x7f5690074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:27.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.670+0000 7f5698231640 1 -- 172.21.15.87:0/1045011779 >> 172.21.15.87:0/1045011779 conn(0x7f56900fb5d0 msgr2=0x7f5690104480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:27.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.670+0000 7f5698231640 1 -- 172.21.15.87:0/1045011779 shutdown_connections 2024-09-13T17:13:27.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:27.670+0000 7f5698231640 1 -- 172.21.15.87:0/1045011779 wait complete. 2024-09-13T17:13:28.429 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-13T17:13:28.626 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:13:29.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:29 smithi149 ceph-mon[35496]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:13:29.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:29 smithi149 ceph-mon[35496]: pgmap v343: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T17:13:29.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:29 smithi118 ceph-mon[34374]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:13:29.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:29 smithi118 ceph-mon[34374]: pgmap v343: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T17:13:29.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:29 smithi087 ceph-mon[30934]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:13:29.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:29 smithi087 ceph-mon[30934]: pgmap v343: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-13T17:13:30.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.354+0000 7fb8cce52640 1 -- 172.21.15.87:0/4053463081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8c80fff00 msgr2=0x7fb8c8100380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:30.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.354+0000 7fb8cce52640 1 --2- 172.21.15.87:0/4053463081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8c80fff00 0x7fb8c8100380 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0009900 tx=0x7fb8b002a410 comp rx=0 tx=0).stop 2024-09-13T17:13:30.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.354+0000 7fb8cce52640 1 -- 172.21.15.87:0/4053463081 shutdown_connections 2024-09-13T17:13:30.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.354+0000 7fb8cce52640 1 --2- 172.21.15.87:0/4053463081 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8c81008c0 0x7fb8c8107150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:30.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.354+0000 7fb8cce52640 1 --2- 172.21.15.87:0/4053463081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8c80fff00 0x7fb8c8100380 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:30.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.354+0000 7fb8cce52640 1 --2- 172.21.15.87:0/4053463081 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8c80fed00 0x7fb8c80ff100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:30.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.354+0000 7fb8cce52640 1 -- 172.21.15.87:0/4053463081 >> 172.21.15.87:0/4053463081 conn(0x7fb8c80fa490 msgr2=0x7fb8c80fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:30.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.354+0000 7fb8cce52640 1 -- 172.21.15.87:0/4053463081 shutdown_connections 2024-09-13T17:13:30.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.354+0000 7fb8cce52640 1 -- 172.21.15.87:0/4053463081 wait complete. 2024-09-13T17:13:30.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.355+0000 7fb8cce52640 1 Processor -- start 2024-09-13T17:13:30.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.355+0000 7fb8cce52640 1 -- start start 2024-09-13T17:13:30.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.355+0000 7fb8cce52640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8c80fed00 0x7fb8c81095c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:30.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.355+0000 7fb8cce52640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8c80fff00 0x7fb8c8107c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:30.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.355+0000 7fb8cce52640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8c81008c0 0x7fb8c8108150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:30.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.355+0000 7fb8cce52640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c81088e0 con 0x7fb8c80fff00 2024-09-13T17:13:30.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.355+0000 7fb8cce52640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c8108a50 con 0x7fb8c80fed00 2024-09-13T17:13:30.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.355+0000 7fb8cce52640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c819fd20 con 0x7fb8c81008c0 2024-09-13T17:13:30.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.355+0000 7fb8c5d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8c80fff00 0x7fb8c8107c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:30.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.355+0000 7fb8c5d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8c80fff00 0x7fb8c8107c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39330/0 (socket says 172.21.15.87:39330) 2024-09-13T17:13:30.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.355+0000 7fb8c5d9b640 1 -- 172.21.15.87:0/2796573001 learned_addr learned my addr 172.21.15.87:0/2796573001 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:30.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.355+0000 7fb8c6d9d640 1 --2- 172.21.15.87:0/2796573001 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8c81008c0 0x7fb8c8108150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:30.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.355+0000 7fb8c659c640 1 --2- 172.21.15.87:0/2796573001 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8c80fed00 0x7fb8c81095c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:30.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.355+0000 7fb8c5d9b640 1 -- 172.21.15.87:0/2796573001 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8c81008c0 msgr2=0x7fb8c8108150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:30.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.355+0000 7fb8c5d9b640 1 --2- 172.21.15.87:0/2796573001 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8c81008c0 0x7fb8c8108150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:30.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.355+0000 7fb8c5d9b640 1 -- 172.21.15.87:0/2796573001 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8c80fed00 msgr2=0x7fb8c81095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:30.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.355+0000 7fb8c5d9b640 1 --2- 172.21.15.87:0/2796573001 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8c80fed00 0x7fb8c81095c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:30.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.355+0000 7fb8c5d9b640 1 -- 172.21.15.87:0/2796573001 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b0009560 con 0x7fb8c80fff00 2024-09-13T17:13:30.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.356+0000 7fb8c5d9b640 1 --2- 172.21.15.87:0/2796573001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8c80fff00 0x7fb8c8107c10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0005ab0 tx=0x7fb8b0003e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:30.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.356+0000 7fb8bf7fe640 1 -- 172.21.15.87:0/2796573001 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b00327a0 con 0x7fb8c80fff00 2024-09-13T17:13:30.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.356+0000 7fb8bf7fe640 1 -- 172.21.15.87:0/2796573001 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb8b0032db0 con 0x7fb8c80fff00 2024-09-13T17:13:30.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.356+0000 7fb8cce52640 1 -- 172.21.15.87:0/2796573001 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c819ff70 con 0x7fb8c80fff00 2024-09-13T17:13:30.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.356+0000 7fb8bf7fe640 1 -- 172.21.15.87:0/2796573001 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b003b3d0 con 0x7fb8c80fff00 2024-09-13T17:13:30.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.356+0000 7fb8cce52640 1 -- 172.21.15.87:0/2796573001 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c81a0380 con 0x7fb8c80fff00 2024-09-13T17:13:30.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.357+0000 7fb8cce52640 1 -- 172.21.15.87:0/2796573001 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c81060b0 con 0x7fb8c80fff00 2024-09-13T17:13:30.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.358+0000 7fb8bf7fe640 1 -- 172.21.15.87:0/2796573001 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb8b003c690 con 0x7fb8c80fff00 2024-09-13T17:13:30.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.359+0000 7fb8bf7fe640 1 --2- 172.21.15.87:0/2796573001 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb8b40a1080 0x7fb8b40a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:30.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.359+0000 7fb8c659c640 1 --2- 172.21.15.87:0/2796573001 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb8b40a1080 0x7fb8b40a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:30.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.359+0000 7fb8bf7fe640 1 -- 172.21.15.87:0/2796573001 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7fb8b00edad0 con 0x7fb8c80fff00 2024-09-13T17:13:30.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.359+0000 7fb8c659c640 1 --2- 172.21.15.87:0/2796573001 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb8b40a1080 0x7fb8b40a3540 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb8b80058c0 tx=0x7fb8b8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:30.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.363+0000 7fb8bf7fe640 1 -- 172.21.15.87:0/2796573001 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb8b00b6f20 con 0x7fb8c80fff00 2024-09-13T17:13:30.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.530+0000 7fb8cce52640 1 -- 172.21.15.87:0/2796573001 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8c802c4f0 con 0x7fb8b40a1080 2024-09-13T17:13:30.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.532+0000 7fb8bf7fe640 1 -- 172.21.15.87:0/2796573001 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7fb8c802c4f0 con 0x7fb8b40a1080 2024-09-13T17:13:30.534 INFO:teuthology.orchestra.run.smithi087.stdout:HOST ADDR LABELS STATUS 2024-09-13T17:13:30.534 INFO:teuthology.orchestra.run.smithi087.stdout:smithi087 172.21.15.87 2024-09-13T17:13:30.534 INFO:teuthology.orchestra.run.smithi087.stdout:smithi118 172.21.15.118 2024-09-13T17:13:30.534 INFO:teuthology.orchestra.run.smithi087.stdout:smithi149 172.21.15.149 2024-09-13T17:13:30.534 INFO:teuthology.orchestra.run.smithi087.stdout:3 hosts in cluster 2024-09-13T17:13:30.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.534+0000 7fb8cce52640 1 -- 172.21.15.87:0/2796573001 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb8b40a1080 msgr2=0x7fb8b40a3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:30.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.534+0000 7fb8cce52640 1 --2- 172.21.15.87:0/2796573001 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb8b40a1080 0x7fb8b40a3540 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb8b80058c0 tx=0x7fb8b8005850 comp rx=0 tx=0).stop 2024-09-13T17:13:30.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.534+0000 7fb8cce52640 1 -- 172.21.15.87:0/2796573001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8c80fff00 msgr2=0x7fb8c8107c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:30.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.534+0000 7fb8cce52640 1 --2- 172.21.15.87:0/2796573001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8c80fff00 0x7fb8c8107c10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0005ab0 tx=0x7fb8b0003e00 comp rx=0 tx=0).stop 2024-09-13T17:13:30.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.534+0000 7fb8cce52640 1 -- 172.21.15.87:0/2796573001 shutdown_connections 2024-09-13T17:13:30.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.534+0000 7fb8cce52640 1 --2- 172.21.15.87:0/2796573001 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb8b40a1080 0x7fb8b40a3540 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:30.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.534+0000 7fb8cce52640 1 --2- 172.21.15.87:0/2796573001 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8c81008c0 0x7fb8c8108150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:30.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.534+0000 7fb8cce52640 1 --2- 172.21.15.87:0/2796573001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8c80fff00 0x7fb8c8107c10 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:30.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.534+0000 7fb8cce52640 1 --2- 172.21.15.87:0/2796573001 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8c80fed00 0x7fb8c81095c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:30.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.534+0000 7fb8cce52640 1 -- 172.21.15.87:0/2796573001 >> 172.21.15.87:0/2796573001 conn(0x7fb8c80fa490 msgr2=0x7fb8c8103280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:30.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.534+0000 7fb8cce52640 1 -- 172.21.15.87:0/2796573001 shutdown_connections 2024-09-13T17:13:30.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:30.534+0000 7fb8cce52640 1 -- 172.21.15.87:0/2796573001 wait complete. 2024-09-13T17:13:31.143 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-13T17:13:31.341 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:13:31.463 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:31 smithi087 ceph-mon[30934]: pgmap v344: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T17:13:31.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:31 smithi149 ceph-mon[35496]: pgmap v344: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T17:13:31.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:31 smithi118 ceph-mon[34374]: pgmap v344: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T17:13:32.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:32 smithi087 ceph-mon[30934]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:13:32.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:32 smithi149 ceph-mon[35496]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:13:32.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:32 smithi118 ceph-mon[34374]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:13:33.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.042+0000 7f1dc058d640 1 -- 172.21.15.87:0/1798043853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1db8101920 msgr2=0x7f1db8108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:33.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.042+0000 7f1dc058d640 1 --2- 172.21.15.87:0/1798043853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1db8101920 0x7f1db8108240 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1db0009ca0 tx=0x7f1db002a8c0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.042+0000 7f1dc058d640 1 -- 172.21.15.87:0/1798043853 shutdown_connections 2024-09-13T17:13:33.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.042+0000 7f1dc058d640 1 --2- 172.21.15.87:0/1798043853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1db8101920 0x7f1db8108240 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.042+0000 7f1dc058d640 1 --2- 172.21.15.87:0/1798043853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1db8100f60 0x7f1db81013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.042+0000 7f1dc058d640 1 --2- 172.21.15.87:0/1798043853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1db80ffe00 0x7f1db8100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.042+0000 7f1dc058d640 1 -- 172.21.15.87:0/1798043853 >> 172.21.15.87:0/1798043853 conn(0x7f1db80fb5d0 msgr2=0x7f1db80fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:33.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.042+0000 7f1dc058d640 1 -- 172.21.15.87:0/1798043853 shutdown_connections 2024-09-13T17:13:33.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.042+0000 7f1dc058d640 1 -- 172.21.15.87:0/1798043853 wait complete. 2024-09-13T17:13:33.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.043+0000 7f1dc058d640 1 Processor -- start 2024-09-13T17:13:33.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.043+0000 7f1dc058d640 1 -- start start 2024-09-13T17:13:33.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.043+0000 7f1dc058d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1db80ffe00 0x7f1db8195c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.043+0000 7f1dc058d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1db8100f60 0x7f1db81961a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.043+0000 7f1dc058d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1db8101920 0x7f1db819d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.043+0000 7f1dc058d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db819d750 con 0x7f1db8101920 2024-09-13T17:13:33.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.043+0000 7f1dc058d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db819d8c0 con 0x7f1db8100f60 2024-09-13T17:13:33.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.043+0000 7f1dc058d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db819da80 con 0x7f1db80ffe00 2024-09-13T17:13:33.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.043+0000 7f1dbeb2a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1db8101920 0x7f1db819d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.043+0000 7f1dbeb2a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1db8101920 0x7f1db819d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39340/0 (socket says 172.21.15.87:39340) 2024-09-13T17:13:33.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.043+0000 7f1dbeb2a640 1 -- 172.21.15.87:0/667460994 learned_addr learned my addr 172.21.15.87:0/667460994 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:33.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.043+0000 7f1dbe329640 1 --2- 172.21.15.87:0/667460994 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1db80ffe00 0x7f1db8195c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.043+0000 7f1dbdb28640 1 --2- 172.21.15.87:0/667460994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1db8100f60 0x7f1db81961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.043+0000 7f1dbeb2a640 1 -- 172.21.15.87:0/667460994 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1db80ffe00 msgr2=0x7f1db8195c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:33.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.043+0000 7f1dbeb2a640 1 --2- 172.21.15.87:0/667460994 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1db80ffe00 0x7f1db8195c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.043+0000 7f1dbeb2a640 1 -- 172.21.15.87:0/667460994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1db8100f60 msgr2=0x7f1db81961a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:33.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.043+0000 7f1dbeb2a640 1 --2- 172.21.15.87:0/667460994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1db8100f60 0x7f1db81961a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.043+0000 7f1dbeb2a640 1 -- 172.21.15.87:0/667460994 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db0009900 con 0x7f1db8101920 2024-09-13T17:13:33.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.044+0000 7f1dbeb2a640 1 --2- 172.21.15.87:0/667460994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1db8101920 0x7f1db819d210 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1db002aeb0 tx=0x7f1db0003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:33.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.044+0000 7f1daf7fe640 1 -- 172.21.15.87:0/667460994 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db00307c0 con 0x7f1db8101920 2024-09-13T17:13:33.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.044+0000 7f1dc058d640 1 -- 172.21.15.87:0/667460994 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db819dd00 con 0x7f1db8101920 2024-09-13T17:13:33.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.044+0000 7f1daf7fe640 1 -- 172.21.15.87:0/667460994 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1db0040070 con 0x7f1db8101920 2024-09-13T17:13:33.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.044+0000 7f1daf7fe640 1 -- 172.21.15.87:0/667460994 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db00046c0 con 0x7f1db8101920 2024-09-13T17:13:33.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.044+0000 7f1dc058d640 1 -- 172.21.15.87:0/667460994 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db819e1f0 con 0x7f1db8101920 2024-09-13T17:13:33.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.045+0000 7f1dc058d640 1 -- 172.21.15.87:0/667460994 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db8107170 con 0x7f1db8101920 2024-09-13T17:13:33.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.046+0000 7f1daf7fe640 1 -- 172.21.15.87:0/667460994 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1db0042030 con 0x7f1db8101920 2024-09-13T17:13:33.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.046+0000 7f1daf7fe640 1 --2- 172.21.15.87:0/667460994 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f1da40a1080 0x7f1da40a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:33.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.047+0000 7f1dbe329640 1 --2- 172.21.15.87:0/667460994 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f1da40a1080 0x7f1da40a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:33.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.047+0000 7f1daf7fe640 1 -- 172.21.15.87:0/667460994 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f1db00ee710 con 0x7f1db8101920 2024-09-13T17:13:33.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.047+0000 7f1dbe329640 1 --2- 172.21.15.87:0/667460994 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f1da40a1080 0x7f1da40a3540 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1da8005e10 tx=0x7f1da8005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:33.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.051+0000 7f1daf7fe640 1 -- 172.21.15.87:0/667460994 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1db00b7ad0 con 0x7f1db8101920 2024-09-13T17:13:33.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.222+0000 7f1dc058d640 1 -- 172.21.15.87:0/667460994 --> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f1db802c4f0 con 0x7f1da40a1080 2024-09-13T17:13:33.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.224+0000 7f1daf7fe640 1 -- 172.21.15.87:0/667460994 <== mgr.14150 v2:172.21.15.87:6800/701043027 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7f1db802c4f0 con 0x7f1da40a1080 2024-09-13T17:13:33.226 INFO:teuthology.orchestra.run.smithi087.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-13T17:13:33.226 INFO:teuthology.orchestra.run.smithi087.stdout:smithi087 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400NQ400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-13T17:13:33.226 INFO:teuthology.orchestra.run.smithi087.stdout:smithi118 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB747500JS480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-13T17:13:33.226 INFO:teuthology.orchestra.run.smithi087.stdout:smithi149 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300CK400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-13T17:13:33.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.226+0000 7f1dc058d640 1 -- 172.21.15.87:0/667460994 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f1da40a1080 msgr2=0x7f1da40a3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:33.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.226+0000 7f1dc058d640 1 --2- 172.21.15.87:0/667460994 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f1da40a1080 0x7f1da40a3540 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1da8005e10 tx=0x7f1da8005da0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.226+0000 7f1dc058d640 1 -- 172.21.15.87:0/667460994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1db8101920 msgr2=0x7f1db819d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:33.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.226+0000 7f1dc058d640 1 --2- 172.21.15.87:0/667460994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1db8101920 0x7f1db819d210 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1db002aeb0 tx=0x7f1db0003c20 comp rx=0 tx=0).stop 2024-09-13T17:13:33.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.226+0000 7f1dc058d640 1 -- 172.21.15.87:0/667460994 shutdown_connections 2024-09-13T17:13:33.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.226+0000 7f1dc058d640 1 --2- 172.21.15.87:0/667460994 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f1da40a1080 0x7f1da40a3540 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.226+0000 7f1dc058d640 1 --2- 172.21.15.87:0/667460994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1db8101920 0x7f1db819d210 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.226+0000 7f1dc058d640 1 --2- 172.21.15.87:0/667460994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1db8100f60 0x7f1db81961a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.226+0000 7f1dc058d640 1 --2- 172.21.15.87:0/667460994 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1db80ffe00 0x7f1db8195c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:33.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.226+0000 7f1dc058d640 1 -- 172.21.15.87:0/667460994 >> 172.21.15.87:0/667460994 conn(0x7f1db80fb5d0 msgr2=0x7f1db8104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:33.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.226+0000 7f1dc058d640 1 -- 172.21.15.87:0/667460994 shutdown_connections 2024-09-13T17:13:33.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:33.226+0000 7f1dc058d640 1 -- 172.21.15.87:0/667460994 wait complete. 2024-09-13T17:13:33.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:33 smithi087 ceph-mon[30934]: pgmap v345: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-13T17:13:33.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:33 smithi149 ceph-mon[35496]: pgmap v345: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-13T17:13:33.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:33 smithi118 ceph-mon[34374]: pgmap v345: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-13T17:13:33.945 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T17:13:33.955 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T17:13:33.955 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T17:13:34.159 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:13:34.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:34 smithi149 ceph-mon[35496]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:13:34.604 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:34 smithi087 ceph-mon[30934]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:13:34.612 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:34 smithi118 ceph-mon[34374]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:13:35.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:35 smithi149 ceph-mon[35496]: pgmap v346: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-13T17:13:35.612 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:35 smithi118 ceph-mon[34374]: pgmap v346: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-13T17:13:35.672 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:35 smithi087 ceph-mon[30934]: pgmap v346: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-13T17:13:35.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.901+0000 7fb18f59e640 1 -- 172.21.15.87:0/1185488782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1901017f0 msgr2=0x7fb190108080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:35.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.901+0000 7fb18f59e640 1 --2- 172.21.15.87:0/1185488782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1901017f0 0x7fb190108080 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb188009ca0 tx=0x7fb18802a8c0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.901+0000 7fb18f59e640 1 -- 172.21.15.87:0/1185488782 shutdown_connections 2024-09-13T17:13:35.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.901+0000 7fb18f59e640 1 --2- 172.21.15.87:0/1185488782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1901017f0 0x7fb190108080 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.901+0000 7fb18f59e640 1 --2- 172.21.15.87:0/1185488782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb190100e30 0x7fb1901012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.901+0000 7fb18f59e640 1 --2- 172.21.15.87:0/1185488782 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1900ffc30 0x7fb190100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.901+0000 7fb18f59e640 1 -- 172.21.15.87:0/1185488782 >> 172.21.15.87:0/1185488782 conn(0x7fb1900fb3c0 msgr2=0x7fb1900fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:35.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.901+0000 7fb18f59e640 1 -- 172.21.15.87:0/1185488782 shutdown_connections 2024-09-13T17:13:35.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.901+0000 7fb18f59e640 1 -- 172.21.15.87:0/1185488782 wait complete. 2024-09-13T17:13:35.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.902+0000 7fb18f59e640 1 Processor -- start 2024-09-13T17:13:35.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.902+0000 7fb18f59e640 1 -- start start 2024-09-13T17:13:35.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.902+0000 7fb18f59e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1900ffc30 0x7fb190074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:35.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.902+0000 7fb18f59e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb190100e30 0x7fb1900728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:35.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.902+0000 7fb18f59e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1901017f0 0x7fb190072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:35.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.902+0000 7fb18f59e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1900734e0 con 0x7fb190100e30 2024-09-13T17:13:35.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.902+0000 7fb18f59e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb190073650 con 0x7fb1901017f0 2024-09-13T17:13:35.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.902+0000 7fb18f59e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19019fcc0 con 0x7fb1900ffc30 2024-09-13T17:13:35.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.902+0000 7fb18dd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb190100e30 0x7fb1900728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:35.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.902+0000 7fb18dd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb190100e30 0x7fb1900728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39352/0 (socket says 172.21.15.87:39352) 2024-09-13T17:13:35.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.902+0000 7fb18dd9b640 1 -- 172.21.15.87:0/700299123 learned_addr learned my addr 172.21.15.87:0/700299123 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:35.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.902+0000 7fb18e59c640 1 --2- 172.21.15.87:0/700299123 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1900ffc30 0x7fb190074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:35.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.903+0000 7fb18ed9d640 1 --2- 172.21.15.87:0/700299123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1901017f0 0x7fb190072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:35.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.903+0000 7fb18dd9b640 1 -- 172.21.15.87:0/700299123 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1900ffc30 msgr2=0x7fb190074200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:35.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.903+0000 7fb18dd9b640 1 --2- 172.21.15.87:0/700299123 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1900ffc30 0x7fb190074200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.903+0000 7fb18dd9b640 1 -- 172.21.15.87:0/700299123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1901017f0 msgr2=0x7fb190072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:35.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.903+0000 7fb18dd9b640 1 --2- 172.21.15.87:0/700299123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1901017f0 0x7fb190072de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:35.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.903+0000 7fb18dd9b640 1 -- 172.21.15.87:0/700299123 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb188009900 con 0x7fb190100e30 2024-09-13T17:13:35.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.903+0000 7fb18ed9d640 1 --2- 172.21.15.87:0/700299123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1901017f0 0x7fb190072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:35.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.903+0000 7fb18dd9b640 1 --2- 172.21.15.87:0/700299123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb190100e30 0x7fb1900728a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb18400d770 tx=0x7fb18400db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:35.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.903+0000 7fb17f7fe640 1 -- 172.21.15.87:0/700299123 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb184005220 con 0x7fb190100e30 2024-09-13T17:13:35.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.903+0000 7fb17f7fe640 1 -- 172.21.15.87:0/700299123 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb184009cd0 con 0x7fb190100e30 2024-09-13T17:13:35.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.903+0000 7fb18f59e640 1 -- 172.21.15.87:0/700299123 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb19019ff20 con 0x7fb190100e30 2024-09-13T17:13:35.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.903+0000 7fb17f7fe640 1 -- 172.21.15.87:0/700299123 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb184004d30 con 0x7fb190100e30 2024-09-13T17:13:35.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.903+0000 7fb18f59e640 1 -- 172.21.15.87:0/700299123 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1901a03c0 con 0x7fb190100e30 2024-09-13T17:13:35.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.904+0000 7fb18f59e640 1 -- 172.21.15.87:0/700299123 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb190107120 con 0x7fb190100e30 2024-09-13T17:13:35.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.905+0000 7fb17f7fe640 1 -- 172.21.15.87:0/700299123 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb184009820 con 0x7fb190100e30 2024-09-13T17:13:35.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.906+0000 7fb17f7fe640 1 --2- 172.21.15.87:0/700299123 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb1780a1070 0x7fb1780a3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:35.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.906+0000 7fb18e59c640 1 --2- 172.21.15.87:0/700299123 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb1780a1070 0x7fb1780a3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:35.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.906+0000 7fb17f7fe640 1 -- 172.21.15.87:0/700299123 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7fb1840cc6f0 con 0x7fb190100e30 2024-09-13T17:13:35.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.906+0000 7fb18e59c640 1 --2- 172.21.15.87:0/700299123 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb1780a1070 0x7fb1780a3530 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb190100c90 tx=0x7fb180009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:35.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:35.910+0000 7fb17f7fe640 1 -- 172.21.15.87:0/700299123 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb184095ab0 con 0x7fb190100e30 2024-09-13T17:13:36.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:36.105+0000 7fb18f59e640 1 -- 172.21.15.87:0/700299123 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb19002c410 con 0x7fb190100e30 2024-09-13T17:13:36.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:36.106+0000 7fb17f7fe640 1 -- 172.21.15.87:0/700299123 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+2905 (secure 0 0 0) 0x7fb184017b70 con 0x7fb190100e30 2024-09-13T17:13:36.107 INFO:teuthology.orchestra.run.smithi087.stdout:e23 2024-09-13T17:13:36.107 INFO:teuthology.orchestra.run.smithi087.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T17:13:36.107 INFO:teuthology.orchestra.run.smithi087.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:13:36.107 INFO:teuthology.orchestra.run.smithi087.stdout:legacy client fscid: 1 2024-09-13T17:13:36.107 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:13:36.107 INFO:teuthology.orchestra.run.smithi087.stdout:Filesystem 'cephfs' (1) 2024-09-13T17:13:36.107 INFO:teuthology.orchestra.run.smithi087.stdout:fs_name cephfs 2024-09-13T17:13:36.108 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 23 2024-09-13T17:13:36.108 INFO:teuthology.orchestra.run.smithi087.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T17:13:36.108 INFO:teuthology.orchestra.run.smithi087.stdout:created 2024-09-13T17:11:23.313609+0000 2024-09-13T17:13:36.108 INFO:teuthology.orchestra.run.smithi087.stdout:modified 2024-09-13T17:11:47.780404+0000 2024-09-13T17:13:36.108 INFO:teuthology.orchestra.run.smithi087.stdout:tableserver 0 2024-09-13T17:13:36.108 INFO:teuthology.orchestra.run.smithi087.stdout:root 0 2024-09-13T17:13:36.108 INFO:teuthology.orchestra.run.smithi087.stdout:session_timeout 300 2024-09-13T17:13:36.108 INFO:teuthology.orchestra.run.smithi087.stdout:session_autoclose 300 2024-09-13T17:13:36.108 INFO:teuthology.orchestra.run.smithi087.stdout:max_file_size 1099511627776 2024-09-13T17:13:36.108 INFO:teuthology.orchestra.run.smithi087.stdout:max_xattr_size 65536 2024-09-13T17:13:36.108 INFO:teuthology.orchestra.run.smithi087.stdout:required_client_features {} 2024-09-13T17:13:36.108 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure 0 2024-09-13T17:13:36.108 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure_osd_epoch 0 2024-09-13T17:13:36.108 INFO:teuthology.orchestra.run.smithi087.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:13:36.109 INFO:teuthology.orchestra.run.smithi087.stdout:max_mds 3 2024-09-13T17:13:36.109 INFO:teuthology.orchestra.run.smithi087.stdout:in 0,1,2 2024-09-13T17:13:36.109 INFO:teuthology.orchestra.run.smithi087.stdout:up {0=24499,1=24484,2=24472} 2024-09-13T17:13:36.109 INFO:teuthology.orchestra.run.smithi087.stdout:failed 2024-09-13T17:13:36.109 INFO:teuthology.orchestra.run.smithi087.stdout:damaged 2024-09-13T17:13:36.109 INFO:teuthology.orchestra.run.smithi087.stdout:stopped 2024-09-13T17:13:36.109 INFO:teuthology.orchestra.run.smithi087.stdout:data_pools [3,4] 2024-09-13T17:13:36.109 INFO:teuthology.orchestra.run.smithi087.stdout:metadata_pool 2 2024-09-13T17:13:36.109 INFO:teuthology.orchestra.run.smithi087.stdout:inline_data disabled 2024-09-13T17:13:36.109 INFO:teuthology.orchestra.run.smithi087.stdout:balancer 2024-09-13T17:13:36.109 INFO:teuthology.orchestra.run.smithi087.stdout:bal_rank_mask -1 2024-09-13T17:13:36.109 INFO:teuthology.orchestra.run.smithi087.stdout:standby_count_wanted 0 2024-09-13T17:13:36.109 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.i{0:24499} state up:active seq 5 addr [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:13:36.109 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.b{0:24470} state up:standby-replay seq 1 addr [v2:172.21.15.118:6838/3052680456,v1:172.21.15.118:6839/3052680456] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:13:36.109 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.c{1:24484} state up:active seq 12 addr [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:13:36.110 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.h{1:24446} state up:standby-replay seq 1 addr [v2:172.21.15.118:6836/923553321,v1:172.21.15.118:6837/923553321] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:13:36.110 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.f{2:24472} state up:active seq 13 addr [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:13:36.110 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.l{2:24427} state up:standby-replay seq 1 addr [v2:172.21.15.149:6832/3204144514,v1:172.21.15.149:6833/3204144514] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:13:36.110 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:13:36.110 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:13:36.110 INFO:teuthology.orchestra.run.smithi087.stdout:Standby daemons: 2024-09-13T17:13:36.110 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:13:36.110 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.j{-1:14526} state up:standby seq 1 addr [v2:172.21.15.87:6834/3554185199,v1:172.21.15.87:6835/3554185199] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:13:36.110 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.d{-1:14538} state up:standby seq 1 addr [v2:172.21.15.87:6836/321170197,v1:172.21.15.87:6837/321170197] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:13:36.110 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.g{-1:14613} state up:standby seq 1 addr [v2:172.21.15.87:6838/1687006028,v1:172.21.15.87:6839/1687006028] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:13:36.110 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.a{-1:14625} state up:standby seq 1 addr [v2:172.21.15.87:6840/3674545180,v1:172.21.15.87:6841/3674545180] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:13:36.110 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.k{-1:24398} state up:standby seq 1 addr [v2:172.21.15.118:6832/1988216966,v1:172.21.15.118:6833/1988216966] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:13:36.110 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.e{-1:24422} state up:standby seq 1 addr [v2:172.21.15.118:6834/4187230685,v1:172.21.15.118:6835/4187230685] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T17:13:36.111 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 23 2024-09-13T17:13:36.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:36.108+0000 7fb18f59e640 1 -- 172.21.15.87:0/700299123 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb1780a1070 msgr2=0x7fb1780a3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:36.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:36.108+0000 7fb18f59e640 1 --2- 172.21.15.87:0/700299123 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb1780a1070 0x7fb1780a3530 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb190100c90 tx=0x7fb180009110 comp rx=0 tx=0).stop 2024-09-13T17:13:36.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:36.108+0000 7fb18f59e640 1 -- 172.21.15.87:0/700299123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb190100e30 msgr2=0x7fb1900728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:36.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:36.108+0000 7fb18f59e640 1 --2- 172.21.15.87:0/700299123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb190100e30 0x7fb1900728a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb18400d770 tx=0x7fb18400db70 comp rx=0 tx=0).stop 2024-09-13T17:13:36.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:36.108+0000 7fb18f59e640 1 -- 172.21.15.87:0/700299123 shutdown_connections 2024-09-13T17:13:36.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:36.108+0000 7fb18f59e640 1 --2- 172.21.15.87:0/700299123 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fb1780a1070 0x7fb1780a3530 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:36.108+0000 7fb18f59e640 1 --2- 172.21.15.87:0/700299123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1901017f0 0x7fb190072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:36.108+0000 7fb18f59e640 1 --2- 172.21.15.87:0/700299123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb190100e30 0x7fb1900728a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:36.108+0000 7fb18f59e640 1 --2- 172.21.15.87:0/700299123 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1900ffc30 0x7fb190074200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:36.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:36.108+0000 7fb18f59e640 1 -- 172.21.15.87:0/700299123 >> 172.21.15.87:0/700299123 conn(0x7fb1900fb3c0 msgr2=0x7fb1901042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:36.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:36.108+0000 7fb18f59e640 1 -- 172.21.15.87:0/700299123 shutdown_connections 2024-09-13T17:13:36.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:36.108+0000 7fb18f59e640 1 -- 172.21.15.87:0/700299123 wait complete. 2024-09-13T17:13:36.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:36 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/700299123' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T17:13:36.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:36 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/700299123' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T17:13:36.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:36 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/700299123' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T17:13:36.758 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-13T17:13:36.955 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:13:37.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:37 smithi149 ceph-mon[35496]: pgmap v347: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:13:37.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:37 smithi118 ceph-mon[34374]: pgmap v347: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:13:37.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:37 smithi087 ceph-mon[30934]: pgmap v347: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:13:38.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.619+0000 7fe19b210640 1 -- 172.21.15.87:0/137324297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe194101920 msgr2=0x7fe194108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:38.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.619+0000 7fe19b210640 1 --2- 172.21.15.87:0/137324297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe194101920 0x7fe194108240 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe18c009ca0 tx=0x7fe18c02a8c0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.620+0000 7fe19b210640 1 -- 172.21.15.87:0/137324297 shutdown_connections 2024-09-13T17:13:38.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.620+0000 7fe19b210640 1 --2- 172.21.15.87:0/137324297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe194101920 0x7fe194108240 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.620+0000 7fe19b210640 1 --2- 172.21.15.87:0/137324297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe194100f60 0x7fe1941013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.620+0000 7fe19b210640 1 --2- 172.21.15.87:0/137324297 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1940ffe00 0x7fe194100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.620+0000 7fe19b210640 1 -- 172.21.15.87:0/137324297 >> 172.21.15.87:0/137324297 conn(0x7fe1940fb5d0 msgr2=0x7fe1940fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:38.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.620+0000 7fe19b210640 1 -- 172.21.15.87:0/137324297 shutdown_connections 2024-09-13T17:13:38.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.620+0000 7fe19b210640 1 -- 172.21.15.87:0/137324297 wait complete. 2024-09-13T17:13:38.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.620+0000 7fe19b210640 1 Processor -- start 2024-09-13T17:13:38.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.620+0000 7fe19b210640 1 -- start start 2024-09-13T17:13:38.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.620+0000 7fe19b210640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1940ffe00 0x7fe194195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:38.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.620+0000 7fe19b210640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe194100f60 0x7fe194196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:38.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.620+0000 7fe19b210640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe194101920 0x7fe19419d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:38.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.620+0000 7fe19b210640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19419d8c0 con 0x7fe194101920 2024-09-13T17:13:38.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.620+0000 7fe19b210640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19419da30 con 0x7fe1940ffe00 2024-09-13T17:13:38.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.620+0000 7fe19b210640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19419dbf0 con 0x7fe194100f60 2024-09-13T17:13:38.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.620+0000 7fe1997ad640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe194101920 0x7fe19419d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:38.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.620+0000 7fe1997ad640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe194101920 0x7fe19419d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39374/0 (socket says 172.21.15.87:39374) 2024-09-13T17:13:38.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.620+0000 7fe1997ad640 1 -- 172.21.15.87:0/217791196 learned_addr learned my addr 172.21.15.87:0/217791196 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:38.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.621+0000 7fe193fff640 1 --2- 172.21.15.87:0/217791196 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe194100f60 0x7fe194196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:38.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.621+0000 7fe198fac640 1 --2- 172.21.15.87:0/217791196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1940ffe00 0x7fe194195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:38.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.621+0000 7fe1997ad640 1 -- 172.21.15.87:0/217791196 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe194100f60 msgr2=0x7fe194196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:38.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.621+0000 7fe1997ad640 1 --2- 172.21.15.87:0/217791196 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe194100f60 0x7fe194196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.621+0000 7fe1997ad640 1 -- 172.21.15.87:0/217791196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1940ffe00 msgr2=0x7fe194195dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:38.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.621+0000 7fe1997ad640 1 --2- 172.21.15.87:0/217791196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1940ffe00 0x7fe194195dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.621+0000 7fe1997ad640 1 -- 172.21.15.87:0/217791196 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe18c009900 con 0x7fe194101920 2024-09-13T17:13:38.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.621+0000 7fe1997ad640 1 --2- 172.21.15.87:0/217791196 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe194101920 0x7fe19419d380 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe18c003ba0 tx=0x7fe18c003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:38.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.621+0000 7fe191ffb640 1 -- 172.21.15.87:0/217791196 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18c02f310 con 0x7fe194101920 2024-09-13T17:13:38.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.621+0000 7fe191ffb640 1 -- 172.21.15.87:0/217791196 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe18c040070 con 0x7fe194101920 2024-09-13T17:13:38.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.621+0000 7fe191ffb640 1 -- 172.21.15.87:0/217791196 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18c0046c0 con 0x7fe194101920 2024-09-13T17:13:38.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.621+0000 7fe19b210640 1 -- 172.21.15.87:0/217791196 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe19419de70 con 0x7fe194101920 2024-09-13T17:13:38.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.621+0000 7fe19b210640 1 -- 172.21.15.87:0/217791196 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe19419e360 con 0x7fe194101920 2024-09-13T17:13:38.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.622+0000 7fe19b210640 1 -- 172.21.15.87:0/217791196 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe194107290 con 0x7fe194101920 2024-09-13T17:13:38.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.623+0000 7fe191ffb640 1 -- 172.21.15.87:0/217791196 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe18c042030 con 0x7fe194101920 2024-09-13T17:13:38.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.624+0000 7fe191ffb640 1 --2- 172.21.15.87:0/217791196 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe17c0a10b0 0x7fe17c0a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:38.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.624+0000 7fe198fac640 1 --2- 172.21.15.87:0/217791196 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe17c0a10b0 0x7fe17c0a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:38.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.624+0000 7fe191ffb640 1 -- 172.21.15.87:0/217791196 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7fe18c0ee6a0 con 0x7fe194101920 2024-09-13T17:13:38.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.625+0000 7fe198fac640 1 --2- 172.21.15.87:0/217791196 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe17c0a10b0 0x7fe17c0a3570 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe18400a810 tx=0x7fe184008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:38.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.627+0000 7fe191ffb640 1 -- 172.21.15.87:0/217791196 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe18c0b7a60 con 0x7fe194101920 2024-09-13T17:13:38.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:38 smithi087 ceph-mon[30934]: pgmap v348: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T17:13:38.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.794+0000 7fe19b210640 1 -- 172.21.15.87:0/217791196 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7fe19410b7b0 con 0x7fe194101920 2024-09-13T17:13:38.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.795+0000 7fe191ffb640 1 -- 172.21.15.87:0/217791196 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v93) v1 ==== 56+0+5769 (secure 0 0 0) 0x7fe18c0bb080 con 0x7fe194101920 2024-09-13T17:13:38.796 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 93 2024-09-13T17:13:38.796 INFO:teuthology.orchestra.run.smithi087.stdout:fsid 043d5bae-71f2-11ef-bceb-c7b262605968 2024-09-13T17:13:38.796 INFO:teuthology.orchestra.run.smithi087.stdout:created 2024-09-13T17:03:57.852010+0000 2024-09-13T17:13:38.796 INFO:teuthology.orchestra.run.smithi087.stdout:modified 2024-09-13T17:12:50.208429+0000 2024-09-13T17:13:38.796 INFO:teuthology.orchestra.run.smithi087.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-13T17:13:38.796 INFO:teuthology.orchestra.run.smithi087.stdout:crush_version 27 2024-09-13T17:13:38.796 INFO:teuthology.orchestra.run.smithi087.stdout:full_ratio 0.95 2024-09-13T17:13:38.796 INFO:teuthology.orchestra.run.smithi087.stdout:backfillfull_ratio 0.9 2024-09-13T17:13:38.796 INFO:teuthology.orchestra.run.smithi087.stdout:nearfull_ratio 0.85 2024-09-13T17:13:38.796 INFO:teuthology.orchestra.run.smithi087.stdout:require_min_compat_client luminous 2024-09-13T17:13:38.797 INFO:teuthology.orchestra.run.smithi087.stdout:min_compat_client luminous 2024-09-13T17:13:38.797 INFO:teuthology.orchestra.run.smithi087.stdout:require_osd_release reef 2024-09-13T17:13:38.797 INFO:teuthology.orchestra.run.smithi087.stdout:stretch_mode_enabled false 2024-09-13T17:13:38.797 INFO:teuthology.orchestra.run.smithi087.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-13T17:13:38.797 INFO:teuthology.orchestra.run.smithi087.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-13T17:13:38.797 INFO:teuthology.orchestra.run.smithi087.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 85 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-13T17:13:38.797 INFO:teuthology.orchestra.run.smithi087.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 89 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-13T17:13:38.797 INFO:teuthology.orchestra.run.smithi087.stdout:max_osd 12 2024-09-13T17:13:38.797 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0 up in weight 1 up_from 8 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.87:6802/1316956138,v1:172.21.15.87:6803/1316956138] [v2:172.21.15.87:6804/1316956138,v1:172.21.15.87:6805/1316956138] exists,up 58250283-85c0-416e-abdd-1fc5a7ff0c27 2024-09-13T17:13:38.797 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1 up in weight 1 up_from 13 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.118:6800/3352566727,v1:172.21.15.118:6801/3352566727] [v2:172.21.15.118:6802/3352566727,v1:172.21.15.118:6803/3352566727] exists,up b9d49969-94b1-4262-b4ff-db0a8e3331af 2024-09-13T17:13:38.797 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2 up in weight 1 up_from 18 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.149:6800/2774581686,v1:172.21.15.149:6801/2774581686] [v2:172.21.15.149:6802/2774581686,v1:172.21.15.149:6803/2774581686] exists,up ba64549e-d736-426f-b466-f569af5f16d3 2024-09-13T17:13:38.797 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3 up in weight 1 up_from 25 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.87:6810/3306119066,v1:172.21.15.87:6811/3306119066] [v2:172.21.15.87:6812/3306119066,v1:172.21.15.87:6813/3306119066] exists,up 3d5553e5-371b-49fd-976b-9e72a97a2f79 2024-09-13T17:13:38.797 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4 up in weight 1 up_from 33 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.118:6808/3342349890,v1:172.21.15.118:6809/3342349890] [v2:172.21.15.118:6810/3342349890,v1:172.21.15.118:6811/3342349890] exists,up 2fbe0e27-34ec-42a6-9962-f1d8202b3159 2024-09-13T17:13:38.798 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5 up in weight 1 up_from 38 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.149:6808/3468867124,v1:172.21.15.149:6809/3468867124] [v2:172.21.15.149:6810/3468867124,v1:172.21.15.149:6811/3468867124] exists,up 53c14519-6170-4b5a-a79d-4835882d7bec 2024-09-13T17:13:38.798 INFO:teuthology.orchestra.run.smithi087.stdout:osd.6 up in weight 1 up_from 46 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.87:6818/326563617,v1:172.21.15.87:6819/326563617] [v2:172.21.15.87:6820/326563617,v1:172.21.15.87:6821/326563617] exists,up d3951b32-db77-4b8b-9de0-f05e03d13f25 2024-09-13T17:13:38.798 INFO:teuthology.orchestra.run.smithi087.stdout:osd.7 up in weight 1 up_from 51 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.118:6816/1690268990,v1:172.21.15.118:6817/1690268990] [v2:172.21.15.118:6818/1690268990,v1:172.21.15.118:6819/1690268990] exists,up 4d46dab7-a8bf-4e3e-b5c0-43860d336bdd 2024-09-13T17:13:38.798 INFO:teuthology.orchestra.run.smithi087.stdout:osd.8 up in weight 1 up_from 59 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.149:6816/1558675380,v1:172.21.15.149:6817/1558675380] [v2:172.21.15.149:6818/1558675380,v1:172.21.15.149:6819/1558675380] exists,up 5a015a7d-60a3-4412-96af-1b61d2ad51f1 2024-09-13T17:13:38.798 INFO:teuthology.orchestra.run.smithi087.stdout:osd.9 up in weight 1 up_from 67 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.87:6826/1453934262,v1:172.21.15.87:6827/1453934262] [v2:172.21.15.87:6828/1453934262,v1:172.21.15.87:6829/1453934262] exists,up 248c0b6e-4c4e-4c63-a0dd-e4cdf3b997a7 2024-09-13T17:13:38.798 INFO:teuthology.orchestra.run.smithi087.stdout:osd.10 up in weight 1 up_from 72 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.118:6824/1034318850,v1:172.21.15.118:6825/1034318850] [v2:172.21.15.118:6826/1034318850,v1:172.21.15.118:6827/1034318850] exists,up 24238714-e737-4371-b5d5-0cd3395f09bd 2024-09-13T17:13:38.798 INFO:teuthology.orchestra.run.smithi087.stdout:osd.11 up in weight 1 up_from 80 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.149:6824/271000465,v1:172.21.15.149:6825/271000465] [v2:172.21.15.149:6826/271000465,v1:172.21.15.149:6827/271000465] exists,up 409dd3bf-5154-4dea-8708-7de7f9e2e793 2024-09-13T17:13:38.798 INFO:teuthology.orchestra.run.smithi087.stdout:pg_upmap_items 2.b [2,1] 2024-09-13T17:13:38.798 INFO:teuthology.orchestra.run.smithi087.stdout:pg_upmap_items 2.c [2,4] 2024-09-13T17:13:38.798 INFO:teuthology.orchestra.run.smithi087.stdout:pg_upmap_items 2.1a [8,4] 2024-09-13T17:13:38.798 INFO:teuthology.orchestra.run.smithi087.stdout:pg_upmap_items 2.1c [8,11] 2024-09-13T17:13:38.798 INFO:teuthology.orchestra.run.smithi087.stdout:pg_upmap_items 2.1f [7,11] 2024-09-13T17:13:38.798 INFO:teuthology.orchestra.run.smithi087.stdout:pg_upmap_items 3.d [1,9] 2024-09-13T17:13:38.798 INFO:teuthology.orchestra.run.smithi087.stdout:pg_upmap_items 3.12 [3,9] 2024-09-13T17:13:38.799 INFO:teuthology.orchestra.run.smithi087.stdout:pg_upmap_items 3.14 [4,6] 2024-09-13T17:13:38.799 INFO:teuthology.orchestra.run.smithi087.stdout:pg_upmap_items 3.17 [4,8,5,7] 2024-09-13T17:13:38.799 INFO:teuthology.orchestra.run.smithi087.stdout:pg_upmap_items 3.28 [3,6,5,8] 2024-09-13T17:13:38.799 INFO:teuthology.orchestra.run.smithi087.stdout:pg_upmap_items 3.36 [4,9] 2024-09-13T17:13:38.799 INFO:teuthology.orchestra.run.smithi087.stdout:pg_upmap_items 3.3a [4,7] 2024-09-13T17:13:38.799 INFO:teuthology.orchestra.run.smithi087.stdout:pg_upmap_items 4.10 [9,8] 2024-09-13T17:13:38.799 INFO:teuthology.orchestra.run.smithi087.stdout:pg_upmap_items 4.17 [9,8] 2024-09-13T17:13:38.799 INFO:teuthology.orchestra.run.smithi087.stdout:pg_upmap_items 4.19 [9,10] 2024-09-13T17:13:38.799 INFO:teuthology.orchestra.run.smithi087.stdout:pg_upmap_items 4.1c [5,8] 2024-09-13T17:13:38.799 INFO:teuthology.orchestra.run.smithi087.stdout:blocklist 172.21.15.87:0/586423689 expires 2024-09-14T17:04:47.990078+0000 2024-09-13T17:13:38.799 INFO:teuthology.orchestra.run.smithi087.stdout:blocklist 172.21.15.87:6801/4144176457 expires 2024-09-14T17:04:47.990078+0000 2024-09-13T17:13:38.799 INFO:teuthology.orchestra.run.smithi087.stdout:blocklist 172.21.15.87:6800/4144176457 expires 2024-09-14T17:04:47.990078+0000 2024-09-13T17:13:38.799 INFO:teuthology.orchestra.run.smithi087.stdout:blocklist 172.21.15.87:0/3270371628 expires 2024-09-14T17:04:47.990078+0000 2024-09-13T17:13:38.799 INFO:teuthology.orchestra.run.smithi087.stdout:blocklist 172.21.15.87:0/515676743 expires 2024-09-14T17:04:47.990078+0000 2024-09-13T17:13:38.799 INFO:teuthology.orchestra.run.smithi087.stdout:blocklist 172.21.15.87:0/1475107314 expires 2024-09-14T17:04:24.083789+0000 2024-09-13T17:13:38.800 INFO:teuthology.orchestra.run.smithi087.stdout:blocklist 172.21.15.87:0/553289143 expires 2024-09-14T17:04:24.083789+0000 2024-09-13T17:13:38.800 INFO:teuthology.orchestra.run.smithi087.stdout:blocklist 172.21.15.87:0/3403361612 expires 2024-09-14T17:04:24.083789+0000 2024-09-13T17:13:38.800 INFO:teuthology.orchestra.run.smithi087.stdout:blocklist 172.21.15.87:6801/1587363880 expires 2024-09-14T17:04:24.083789+0000 2024-09-13T17:13:38.800 INFO:teuthology.orchestra.run.smithi087.stdout:blocklist 172.21.15.87:6800/1587363880 expires 2024-09-14T17:04:24.083789+0000 2024-09-13T17:13:38.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.797+0000 7fe19b210640 1 -- 172.21.15.87:0/217791196 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe17c0a10b0 msgr2=0x7fe17c0a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:38.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.797+0000 7fe19b210640 1 --2- 172.21.15.87:0/217791196 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe17c0a10b0 0x7fe17c0a3570 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe18400a810 tx=0x7fe184008040 comp rx=0 tx=0).stop 2024-09-13T17:13:38.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.797+0000 7fe19b210640 1 -- 172.21.15.87:0/217791196 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe194101920 msgr2=0x7fe19419d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:38.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.797+0000 7fe19b210640 1 --2- 172.21.15.87:0/217791196 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe194101920 0x7fe19419d380 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe18c003ba0 tx=0x7fe18c003bd0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.797+0000 7fe19b210640 1 -- 172.21.15.87:0/217791196 shutdown_connections 2024-09-13T17:13:38.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.797+0000 7fe19b210640 1 --2- 172.21.15.87:0/217791196 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fe17c0a10b0 0x7fe17c0a3570 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.797+0000 7fe19b210640 1 --2- 172.21.15.87:0/217791196 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe194101920 0x7fe19419d380 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.797+0000 7fe19b210640 1 --2- 172.21.15.87:0/217791196 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe194100f60 0x7fe194196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.797+0000 7fe19b210640 1 --2- 172.21.15.87:0/217791196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1940ffe00 0x7fe194195dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:38.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.797+0000 7fe19b210640 1 -- 172.21.15.87:0/217791196 >> 172.21.15.87:0/217791196 conn(0x7fe1940fb5d0 msgr2=0x7fe194104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:38.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.797+0000 7fe19b210640 1 -- 172.21.15.87:0/217791196 shutdown_connections 2024-09-13T17:13:38.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:38.797+0000 7fe19b210640 1 -- 172.21.15.87:0/217791196 wait complete. 2024-09-13T17:13:38.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:38 smithi149 ceph-mon[35496]: pgmap v348: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T17:13:38.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:38 smithi118 ceph-mon[34374]: pgmap v348: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T17:13:39.448 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-13T17:13:39.460 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:13:39.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.560+0000 7fac69cbe640 1 -- 172.21.15.87:0/1221618435 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac640feca0 msgr2=0x7fac640ff0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:39.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.560+0000 7fac69cbe640 1 --2- 172.21.15.87:0/1221618435 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac640feca0 0x7fac640ff0a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fac58009900 tx=0x7fac5802a410 comp rx=0 tx=0).stop 2024-09-13T17:13:39.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.560+0000 7fac69cbe640 1 -- 172.21.15.87:0/1221618435 shutdown_connections 2024-09-13T17:13:39.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.560+0000 7fac69cbe640 1 --2- 172.21.15.87:0/1221618435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac64100850 0x7fac641070e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.560+0000 7fac69cbe640 1 --2- 172.21.15.87:0/1221618435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac640ffe90 0x7fac64100310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.560+0000 7fac69cbe640 1 --2- 172.21.15.87:0/1221618435 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac640feca0 0x7fac640ff0a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.560+0000 7fac69cbe640 1 -- 172.21.15.87:0/1221618435 >> 172.21.15.87:0/1221618435 conn(0x7fac640fa420 msgr2=0x7fac640fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:39.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.560+0000 7fac69cbe640 1 -- 172.21.15.87:0/1221618435 shutdown_connections 2024-09-13T17:13:39.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.560+0000 7fac69cbe640 1 -- 172.21.15.87:0/1221618435 wait complete. 2024-09-13T17:13:39.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.560+0000 7fac69cbe640 1 Processor -- start 2024-09-13T17:13:39.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.561+0000 7fac69cbe640 1 -- start start 2024-09-13T17:13:39.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.561+0000 7fac69cbe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac640feca0 0x7fac64102ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:39.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.561+0000 7fac69cbe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac640ffe90 0x7fac64101500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:39.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.561+0000 7fac69cbe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac64100850 0x7fac64101a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:39.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.561+0000 7fac69cbe640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac641021a0 con 0x7fac640feca0 2024-09-13T17:13:39.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.561+0000 7fac69cbe640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac64102310 con 0x7fac640ffe90 2024-09-13T17:13:39.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.561+0000 7fac69cbe640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6419fe10 con 0x7fac64100850 2024-09-13T17:13:39.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.561+0000 7fac637fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac640feca0 0x7fac64102ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:39.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.561+0000 7fac637fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac640feca0 0x7fac64102ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39348/0 (socket says 172.21.15.87:39348) 2024-09-13T17:13:39.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.561+0000 7fac637fe640 1 -- 172.21.15.87:0/2909191949 learned_addr learned my addr 172.21.15.87:0/2909191949 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:39.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.561+0000 7fac62ffd640 1 --2- 172.21.15.87:0/2909191949 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac640ffe90 0x7fac64101500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:39.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.561+0000 7fac63fff640 1 --2- 172.21.15.87:0/2909191949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac64100850 0x7fac64101a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:39.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.561+0000 7fac637fe640 1 -- 172.21.15.87:0/2909191949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac64100850 msgr2=0x7fac64101a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:39.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.561+0000 7fac637fe640 1 --2- 172.21.15.87:0/2909191949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac64100850 0x7fac64101a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.561+0000 7fac637fe640 1 -- 172.21.15.87:0/2909191949 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac640ffe90 msgr2=0x7fac64101500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:39.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.561+0000 7fac637fe640 1 --2- 172.21.15.87:0/2909191949 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac640ffe90 0x7fac64101500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.561+0000 7fac637fe640 1 -- 172.21.15.87:0/2909191949 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac58009560 con 0x7fac640feca0 2024-09-13T17:13:39.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.561+0000 7fac637fe640 1 --2- 172.21.15.87:0/2909191949 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac640feca0 0x7fac64102ec0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fac58005940 tx=0x7fac580042d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:39.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.561+0000 7fac60ff9640 1 -- 172.21.15.87:0/2909191949 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac580044c0 con 0x7fac640feca0 2024-09-13T17:13:39.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.561+0000 7fac69cbe640 1 -- 172.21.15.87:0/2909191949 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac641a0060 con 0x7fac640feca0 2024-09-13T17:13:39.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.561+0000 7fac60ff9640 1 -- 172.21.15.87:0/2909191949 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fac58003cb0 con 0x7fac640feca0 2024-09-13T17:13:39.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.561+0000 7fac60ff9640 1 -- 172.21.15.87:0/2909191949 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5803cdd0 con 0x7fac640feca0 2024-09-13T17:13:39.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.562+0000 7fac69cbe640 1 -- 172.21.15.87:0/2909191949 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac641a0510 con 0x7fac640feca0 2024-09-13T17:13:39.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.562+0000 7fac69cbe640 1 -- 172.21.15.87:0/2909191949 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac6410a590 con 0x7fac640feca0 2024-09-13T17:13:39.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.563+0000 7fac60ff9640 1 -- 172.21.15.87:0/2909191949 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fac5803c570 con 0x7fac640feca0 2024-09-13T17:13:39.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.564+0000 7fac60ff9640 1 --2- 172.21.15.87:0/2909191949 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fac4c0a1090 0x7fac4c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:39.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.564+0000 7fac62ffd640 1 --2- 172.21.15.87:0/2909191949 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fac4c0a1090 0x7fac4c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:39.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.564+0000 7fac60ff9640 1 -- 172.21.15.87:0/2909191949 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7fac580eda40 con 0x7fac640feca0 2024-09-13T17:13:39.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.565+0000 7fac62ffd640 1 --2- 172.21.15.87:0/2909191949 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fac4c0a1090 0x7fac4c0a3550 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fac64102c30 tx=0x7fac5400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:39.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.568+0000 7fac60ff9640 1 -- 172.21.15.87:0/2909191949 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fac580efe60 con 0x7fac640feca0 2024-09-13T17:13:39.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:39 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/217791196' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-13T17:13:39.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.731+0000 7fac69cbe640 1 -- 172.21.15.87:0/2909191949 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac6410a770 con 0x7fac640feca0 2024-09-13T17:13:39.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.733+0000 7fac60ff9640 1 -- 172.21.15.87:0/2909191949 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+24817 (secure 0 0 0) 0x7fac5804a090 con 0x7fac640feca0 2024-09-13T17:13:39.734 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:13:39.734 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":93,"fsid":"043d5bae-71f2-11ef-bceb-c7b262605968","created":"2024-09-13T17:03:57.852010+0000","modified":"2024-09-13T17:12:50.208429+0000","last_up_change":"2024-09-13T17:10:34.423548+0000","last_in_change":"2024-09-13T17:10:14.228123+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:07:02.286400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:11:21.965141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:11:22.504345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:11:25.565163+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58250283-85c0-416e-abdd-1fc5a7ff0c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6803","nonce":1316956138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6805","nonce":1316956138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6809","nonce":1316956138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6807","nonce":1316956138}]},"public_addr":"172.21.15.87:6803/1316956138","cluster_addr":"172.21.15.87:6805/1316956138","heartbeat_back_addr":"172.21.15.87:6809/1316956138","heartbeat_front_addr":"172.21.15.87:6807/1316956138","state":["exists","up"]},{"osd":1,"uuid":"b9d49969-94b1-4262-b4ff-db0a8e3331af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6801","nonce":3352566727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6803","nonce":3352566727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6807","nonce":3352566727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6805","nonce":3352566727}]},"public_addr":"172.21.15.118:6801/3352566727","cluster_addr":"172.21.15.118:6803/3352566727","heartbeat_back_addr":"172.21.15.118:6807/3352566727","heartbeat_front_addr":"172.21.15.118:6805/3352566727","state":["exists","up"]},{"osd":2,"uuid":"ba64549e-d736-426f-b466-f569af5f16d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6801","nonce":2774581686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6803","nonce":2774581686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6807","nonce":2774581686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6805","nonce":2774581686}]},"public_addr":"172.21.15.149:6801/2774581686","cluster_addr":"172.21.15.149:6803/2774581686","heartbeat_back_addr":"172.21.15.149:6807/2774581686","heartbeat_front_addr":"172.21.15.149:6805/2774581686","state":["exists","up"]},{"osd":3,"uuid":"3d5553e5-371b-49fd-976b-9e72a97a2f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6811","nonce":3306119066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6813","nonce":3306119066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6817","nonce":3306119066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6815","nonce":3306119066}]},"public_addr":"172.21.15.87:6811/3306119066","cluster_addr":"172.21.15.87:6813/3306119066","heartbeat_back_addr":"172.21.15.87:6817/3306119066","heartbeat_front_addr":"172.21.15.87:6815/3306119066","state":["exists","up"]},{"osd":4,"uuid":"2fbe0e27-34ec-42a6-9962-f1d8202b3159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6809","nonce":3342349890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6811","nonce":3342349890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6815","nonce":3342349890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6813","nonce":3342349890}]},"public_addr":"172.21.15.118:6809/3342349890","cluster_addr":"172.21.15.118:6811/3342349890","heartbeat_back_addr":"172.21.15.118:6815/3342349890","heartbeat_front_addr":"172.21.15.118:6813/3342349890","state":["exists","up"]},{"osd":5,"uuid":"53c14519-6170-4b5a-a79d-4835882d7bec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6809","nonce":3468867124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6811","nonce":3468867124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6815","nonce":3468867124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6813","nonce":3468867124}]},"public_addr":"172.21.15.149:6809/3468867124","cluster_addr":"172.21.15.149:6811/3468867124","heartbeat_back_addr":"172.21.15.149:6815/3468867124","heartbeat_front_addr":"172.21.15.149:6813/3468867124","state":["exists","up"]},{"osd":6,"uuid":"d3951b32-db77-4b8b-9de0-f05e03d13f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6819","nonce":326563617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6821","nonce":326563617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6825","nonce":326563617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6823","nonce":326563617}]},"public_addr":"172.21.15.87:6819/326563617","cluster_addr":"172.21.15.87:6821/326563617","heartbeat_back_addr":"172.21.15.87:6825/326563617","heartbeat_front_addr":"172.21.15.87:6823/326563617","state":["exists","up"]},{"osd":7,"uuid":"4d46dab7-a8bf-4e3e-b5c0-43860d336bdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6817","nonce":1690268990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6819","nonce":1690268990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6823","nonce":1690268990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6821","nonce":1690268990}]},"public_addr":"172.21.15.118:6817/1690268990","cluster_addr":"172.21.15.118:6819/1690268990","heartbeat_back_addr":"172.21.15.118:6823/1690268990","heartbeat_front_addr":"172.21.15.118:6821/1690268990","state":["exists","up"]},{"osd":8,"uuid":"5a015a7d-60a3-4412-96af-1b61d2ad51f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6817","nonce":1558675380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6819","nonce":1558675380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6823","nonce":1558675380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6821","nonce":1558675380}]},"public_addr":"172.21.15.149:6817/1558675380","cluster_addr":"172.21.15.149:6819/1558675380","heartbeat_back_addr":"172.21.15.149:6823/1558675380","heartbeat_front_addr":"172.21.15.149:6821/1558675380","state":["exists","up"]},{"osd":9,"uuid":"248c0b6e-4c4e-4c63-a0dd-e4cdf3b997a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6827","nonce":1453934262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6829","nonce":1453934262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6833","nonce":1453934262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6831","nonce":1453934262}]},"public_addr":"172.21.15.87:6827/1453934262","cluster_addr":"172.21.15.87:6829/1453934262","heartbeat_back_addr":"172.21.15.87:6833/1453934262","heartbeat_front_addr":"172.21.15.87:6831/1453934262","state":["exists","up"]},{"osd":10,"uuid":"24238714-e737-4371-b5d5-0cd3395f09bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6825","nonce":1034318850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6827","nonce":1034318850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6831","nonce":1034318850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6829","nonce":1034318850}]},"public_addr":"172.21.15.118:6825/1034318850","cluster_addr":"172.21.15.118:6827/1034318850","heartbeat_back_addr":"172.21.15.118:6831/1034318850","heartbeat_front_addr":"172.21.15.118:6829/1034318850","state":["exists","up"]},{"osd":11,"uuid":"409dd3bf-5154-4dea-8708-7de7f9e2e793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6825","nonce":271000465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6827","nonce":271000465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6831","nonce":271000465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6829","nonce":271000465}]},"public_addr":"172.21.15.149:6825/271000465","cluster_addr":"172.21.15.149:6827/271000465","heartbeat_back_addr":"172.21.15.149:6831/271000465","heartbeat_front_addr":"172.21.15.149:6829/271000465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:16.382664+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:37.914250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:00.425876+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:23.960183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:47.004088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:10.214345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:33.719221+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:57.099599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:20.971881+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:44.827167+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:08.135516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:32.085853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.d","mappings":[{"from":1,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8},{"from":5,"to":7}]},{"pgid":"3.28","mappings":[{"from":3,"to":6},{"from":5,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/586423689":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6801/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6800/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/3270371628":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/515676743":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/1475107314":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/553289143":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/3403361612":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6801/1587363880":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6800/1587363880":"2024-09-14T17:04:24.083789+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:13:39.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.735+0000 7fac69cbe640 1 -- 172.21.15.87:0/2909191949 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fac4c0a1090 msgr2=0x7fac4c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:39.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.735+0000 7fac69cbe640 1 --2- 172.21.15.87:0/2909191949 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fac4c0a1090 0x7fac4c0a3550 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fac64102c30 tx=0x7fac5400b390 comp rx=0 tx=0).stop 2024-09-13T17:13:39.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.735+0000 7fac69cbe640 1 -- 172.21.15.87:0/2909191949 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac640feca0 msgr2=0x7fac64102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:39.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.735+0000 7fac69cbe640 1 --2- 172.21.15.87:0/2909191949 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac640feca0 0x7fac64102ec0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fac58005940 tx=0x7fac580042d0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.735+0000 7fac69cbe640 1 -- 172.21.15.87:0/2909191949 shutdown_connections 2024-09-13T17:13:39.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.735+0000 7fac69cbe640 1 --2- 172.21.15.87:0/2909191949 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fac4c0a1090 0x7fac4c0a3550 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.735+0000 7fac69cbe640 1 --2- 172.21.15.87:0/2909191949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac64100850 0x7fac64101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.735+0000 7fac69cbe640 1 --2- 172.21.15.87:0/2909191949 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac640ffe90 0x7fac64101500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.735+0000 7fac69cbe640 1 --2- 172.21.15.87:0/2909191949 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac640feca0 0x7fac64102ec0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.735+0000 7fac69cbe640 1 -- 172.21.15.87:0/2909191949 >> 172.21.15.87:0/2909191949 conn(0x7fac640fa420 msgr2=0x7fac64068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:39.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.735+0000 7fac69cbe640 1 -- 172.21.15.87:0/2909191949 shutdown_connections 2024-09-13T17:13:39.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.735+0000 7fac69cbe640 1 -- 172.21.15.87:0/2909191949 wait complete. 2024-09-13T17:13:39.747 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:07:02.286400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:11:21.965141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:11:22.504345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:11:25.565163+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:13:39.747 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:13:39.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:39 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/217791196' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-13T17:13:39.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.848+0000 7f6c7a33e640 1 -- 172.21.15.87:0/2845224297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c740fec60 msgr2=0x7f6c740ff060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:39.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.848+0000 7f6c7a33e640 1 --2- 172.21.15.87:0/2845224297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c740fec60 0x7f6c740ff060 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6c64009900 tx=0x7f6c6402a410 comp rx=0 tx=0).stop 2024-09-13T17:13:39.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.848+0000 7f6c7a33e640 1 -- 172.21.15.87:0/2845224297 shutdown_connections 2024-09-13T17:13:39.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.848+0000 7f6c7a33e640 1 --2- 172.21.15.87:0/2845224297 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c74100810 0x7f6c741070a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.848+0000 7f6c7a33e640 1 --2- 172.21.15.87:0/2845224297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c740ffe50 0x7f6c741002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.848+0000 7f6c7a33e640 1 --2- 172.21.15.87:0/2845224297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c740fec60 0x7f6c740ff060 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.848+0000 7f6c7a33e640 1 -- 172.21.15.87:0/2845224297 >> 172.21.15.87:0/2845224297 conn(0x7f6c740fa3e0 msgr2=0x7f6c740fc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:39.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.848+0000 7f6c7a33e640 1 -- 172.21.15.87:0/2845224297 shutdown_connections 2024-09-13T17:13:39.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.848+0000 7f6c7a33e640 1 -- 172.21.15.87:0/2845224297 wait complete. 2024-09-13T17:13:39.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.849+0000 7f6c7a33e640 1 Processor -- start 2024-09-13T17:13:39.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.849+0000 7f6c7a33e640 1 -- start start 2024-09-13T17:13:39.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.849+0000 7f6c7a33e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c740fec60 0x7f6c74195d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:39.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.849+0000 7f6c7a33e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c740ffe50 0x7f6c74196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:39.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.849+0000 7f6c7a33e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c74100810 0x7f6c7419d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:39.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.849+0000 7f6c7a33e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7419d840 con 0x7f6c740ffe50 2024-09-13T17:13:39.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.849+0000 7f6c7a33e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7419d9b0 con 0x7f6c740fec60 2024-09-13T17:13:39.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.849+0000 7f6c7a33e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7419db70 con 0x7f6c74100810 2024-09-13T17:13:39.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.849+0000 7f6c737fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c740ffe50 0x7f6c74196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:39.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.849+0000 7f6c737fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c740ffe50 0x7f6c74196290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39366/0 (socket says 172.21.15.87:39366) 2024-09-13T17:13:39.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.849+0000 7f6c737fe640 1 -- 172.21.15.87:0/3499111193 learned_addr learned my addr 172.21.15.87:0/3499111193 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:39.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.850+0000 7f6c788db640 1 --2- 172.21.15.87:0/3499111193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c74100810 0x7f6c7419d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:39.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.850+0000 7f6c73fff640 1 --2- 172.21.15.87:0/3499111193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c740fec60 0x7f6c74195d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:39.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.850+0000 7f6c737fe640 1 -- 172.21.15.87:0/3499111193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c74100810 msgr2=0x7f6c7419d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:39.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.850+0000 7f6c737fe640 1 --2- 172.21.15.87:0/3499111193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c74100810 0x7f6c7419d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.850+0000 7f6c737fe640 1 -- 172.21.15.87:0/3499111193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c740fec60 msgr2=0x7f6c74195d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:39.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.850+0000 7f6c737fe640 1 --2- 172.21.15.87:0/3499111193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c740fec60 0x7f6c74195d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:39.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.850+0000 7f6c737fe640 1 -- 172.21.15.87:0/3499111193 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c64009560 con 0x7f6c740ffe50 2024-09-13T17:13:39.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.850+0000 7f6c73fff640 1 --2- 172.21.15.87:0/3499111193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c740fec60 0x7f6c74195d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:39.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.850+0000 7f6c737fe640 1 --2- 172.21.15.87:0/3499111193 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c740ffe50 0x7f6c74196290 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f6c6800d770 tx=0x7f6c6800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:39.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.850+0000 7f6c717fa640 1 -- 172.21.15.87:0/3499111193 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c68009c30 con 0x7f6c740ffe50 2024-09-13T17:13:39.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.850+0000 7f6c717fa640 1 -- 172.21.15.87:0/3499111193 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6c6800de80 con 0x7f6c740ffe50 2024-09-13T17:13:39.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.850+0000 7f6c717fa640 1 -- 172.21.15.87:0/3499111193 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c68004e00 con 0x7f6c740ffe50 2024-09-13T17:13:39.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.850+0000 7f6c7a33e640 1 -- 172.21.15.87:0/3499111193 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c7419de50 con 0x7f6c740ffe50 2024-09-13T17:13:39.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.850+0000 7f6c7a33e640 1 -- 172.21.15.87:0/3499111193 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7419e280 con 0x7f6c740ffe50 2024-09-13T17:13:39.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.851+0000 7f6c7a33e640 1 -- 172.21.15.87:0/3499111193 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c74106180 con 0x7f6c740ffe50 2024-09-13T17:13:39.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.852+0000 7f6c717fa640 1 -- 172.21.15.87:0/3499111193 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6c68004f60 con 0x7f6c740ffe50 2024-09-13T17:13:39.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.853+0000 7f6c717fa640 1 --2- 172.21.15.87:0/3499111193 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f6c5c0a1090 0x7f6c5c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:39.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.853+0000 7f6c73fff640 1 --2- 172.21.15.87:0/3499111193 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f6c5c0a1090 0x7f6c5c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:39.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.853+0000 7f6c717fa640 1 -- 172.21.15.87:0/3499111193 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f6c680cc7c0 con 0x7f6c740ffe50 2024-09-13T17:13:39.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.853+0000 7f6c73fff640 1 --2- 172.21.15.87:0/3499111193 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f6c5c0a1090 0x7f6c5c0a3550 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6c64006010 tx=0x7f6c64000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:39.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:39.857+0000 7f6c717fa640 1 -- 172.21.15.87:0/3499111193 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6c68095b80 con 0x7f6c740ffe50 2024-09-13T17:13:39.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:39 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/217791196' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-13T17:13:40.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.019+0000 7f6c7a33e640 1 -- 172.21.15.87:0/3499111193 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6c7402c410 con 0x7f6c740ffe50 2024-09-13T17:13:40.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.019+0000 7f6c717fa640 1 -- 172.21.15.87:0/3499111193 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6c680991a0 con 0x7f6c740ffe50 2024-09-13T17:13:40.020 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-09-13T17:13:40.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.021+0000 7f6c7a33e640 1 -- 172.21.15.87:0/3499111193 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f6c5c0a1090 msgr2=0x7f6c5c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:40.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.021+0000 7f6c7a33e640 1 --2- 172.21.15.87:0/3499111193 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f6c5c0a1090 0x7f6c5c0a3550 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6c64006010 tx=0x7f6c64000bc0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.021+0000 7f6c7a33e640 1 -- 172.21.15.87:0/3499111193 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c740ffe50 msgr2=0x7f6c74196290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:40.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.021+0000 7f6c7a33e640 1 --2- 172.21.15.87:0/3499111193 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c740ffe50 0x7f6c74196290 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f6c6800d770 tx=0x7f6c6800dc30 comp rx=0 tx=0).stop 2024-09-13T17:13:40.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.021+0000 7f6c7a33e640 1 -- 172.21.15.87:0/3499111193 shutdown_connections 2024-09-13T17:13:40.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.021+0000 7f6c7a33e640 1 --2- 172.21.15.87:0/3499111193 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f6c5c0a1090 0x7f6c5c0a3550 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.021+0000 7f6c7a33e640 1 --2- 172.21.15.87:0/3499111193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c74100810 0x7f6c7419d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.021+0000 7f6c7a33e640 1 --2- 172.21.15.87:0/3499111193 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c740ffe50 0x7f6c74196290 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.021+0000 7f6c7a33e640 1 --2- 172.21.15.87:0/3499111193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c740fec60 0x7f6c74195d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.021+0000 7f6c7a33e640 1 -- 172.21.15.87:0/3499111193 >> 172.21.15.87:0/3499111193 conn(0x7f6c740fa3e0 msgr2=0x7f6c74103350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:40.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.021+0000 7f6c7a33e640 1 -- 172.21.15.87:0/3499111193 shutdown_connections 2024-09-13T17:13:40.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.021+0000 7f6c7a33e640 1 -- 172.21.15.87:0/3499111193 wait complete. 2024-09-13T17:13:40.033 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:13:40.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.134+0000 7f3c64ba0640 1 -- 172.21.15.87:0/1417541510 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c60103090 msgr2=0x7f3c60105480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:40.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.134+0000 7f3c64ba0640 1 --2- 172.21.15.87:0/1417541510 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c60103090 0x7f3c60105480 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009900 tx=0x7f3c4802a410 comp rx=0 tx=0).stop 2024-09-13T17:13:40.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.134+0000 7f3c64ba0640 1 -- 172.21.15.87:0/1417541510 shutdown_connections 2024-09-13T17:13:40.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.134+0000 7f3c64ba0640 1 --2- 172.21.15.87:0/1417541510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c601059c0 0x7f3c60107e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.134+0000 7f3c64ba0640 1 --2- 172.21.15.87:0/1417541510 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c60103090 0x7f3c60105480 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.134+0000 7f3c64ba0640 1 --2- 172.21.15.87:0/1417541510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c60100760 0x7f3c60102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.134+0000 7f3c64ba0640 1 -- 172.21.15.87:0/1417541510 >> 172.21.15.87:0/1417541510 conn(0x7f3c600fa360 msgr2=0x7f3c600fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:40.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.134+0000 7f3c64ba0640 1 -- 172.21.15.87:0/1417541510 shutdown_connections 2024-09-13T17:13:40.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.134+0000 7f3c64ba0640 1 -- 172.21.15.87:0/1417541510 wait complete. 2024-09-13T17:13:40.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.134+0000 7f3c64ba0640 1 Processor -- start 2024-09-13T17:13:40.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.134+0000 7f3c64ba0640 1 -- start start 2024-09-13T17:13:40.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.135+0000 7f3c64ba0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c60100760 0x7f3c60195d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.135+0000 7f3c64ba0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c60103090 0x7f3c60196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.135+0000 7f3c64ba0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c601059c0 0x7f3c6019d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.135+0000 7f3c64ba0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6019d840 con 0x7f3c60100760 2024-09-13T17:13:40.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.135+0000 7f3c64ba0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6019d9b0 con 0x7f3c601059c0 2024-09-13T17:13:40.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.135+0000 7f3c64ba0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6019db70 con 0x7f3c60103090 2024-09-13T17:13:40.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.135+0000 7f3c5f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c60100760 0x7f3c60195d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.135+0000 7f3c5f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c60100760 0x7f3c60195d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39384/0 (socket says 172.21.15.87:39384) 2024-09-13T17:13:40.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.135+0000 7f3c5f7fe640 1 -- 172.21.15.87:0/1835565919 learned_addr learned my addr 172.21.15.87:0/1835565919 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:40.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.135+0000 7f3c5ffff640 1 --2- 172.21.15.87:0/1835565919 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c601059c0 0x7f3c6019d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.135+0000 7f3c57fff640 1 --2- 172.21.15.87:0/1835565919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c60103090 0x7f3c60196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.135+0000 7f3c5f7fe640 1 -- 172.21.15.87:0/1835565919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c60103090 msgr2=0x7f3c60196290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:40.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.135+0000 7f3c5f7fe640 1 --2- 172.21.15.87:0/1835565919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c60103090 0x7f3c60196290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.135+0000 7f3c5f7fe640 1 -- 172.21.15.87:0/1835565919 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c601059c0 msgr2=0x7f3c6019d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:40.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.135+0000 7f3c5f7fe640 1 --2- 172.21.15.87:0/1835565919 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c601059c0 0x7f3c6019d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.135+0000 7f3c5f7fe640 1 -- 172.21.15.87:0/1835565919 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c48009560 con 0x7f3c60100760 2024-09-13T17:13:40.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.135+0000 7f3c5ffff640 1 --2- 172.21.15.87:0/1835565919 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c601059c0 0x7f3c6019d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:40.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.135+0000 7f3c5f7fe640 1 --2- 172.21.15.87:0/1835565919 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c60100760 0x7f3c60195d50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3c5000e9f0 tx=0x7f3c5000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:40.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.135+0000 7f3c5d7fa640 1 -- 172.21.15.87:0/1835565919 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c50009720 con 0x7f3c60100760 2024-09-13T17:13:40.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.135+0000 7f3c5d7fa640 1 -- 172.21.15.87:0/1835565919 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3c5000cd80 con 0x7f3c60100760 2024-09-13T17:13:40.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.135+0000 7f3c64ba0640 1 -- 172.21.15.87:0/1835565919 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c6019de50 con 0x7f3c60100760 2024-09-13T17:13:40.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.135+0000 7f3c5d7fa640 1 -- 172.21.15.87:0/1835565919 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c50010430 con 0x7f3c60100760 2024-09-13T17:13:40.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.135+0000 7f3c64ba0640 1 -- 172.21.15.87:0/1835565919 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c6019e270 con 0x7f3c60100760 2024-09-13T17:13:40.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.136+0000 7f3c64ba0640 1 -- 172.21.15.87:0/1835565919 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c600fbe50 con 0x7f3c60100760 2024-09-13T17:13:40.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.137+0000 7f3c5d7fa640 1 -- 172.21.15.87:0/1835565919 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3c50005020 con 0x7f3c60100760 2024-09-13T17:13:40.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.138+0000 7f3c5d7fa640 1 --2- 172.21.15.87:0/1835565919 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3c4c0a1090 0x7f3c4c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.138+0000 7f3c57fff640 1 --2- 172.21.15.87:0/1835565919 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3c4c0a1090 0x7f3c4c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.138+0000 7f3c5d7fa640 1 -- 172.21.15.87:0/1835565919 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f3c50014070 con 0x7f3c60100760 2024-09-13T17:13:40.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.138+0000 7f3c57fff640 1 --2- 172.21.15.87:0/1835565919 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3c4c0a1090 0x7f3c4c0a3550 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3c48006010 tx=0x7f3c48000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:40.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.142+0000 7f3c5d7fa640 1 -- 172.21.15.87:0/1835565919 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3c50096570 con 0x7f3c60100760 2024-09-13T17:13:40.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.303+0000 7f3c64ba0640 1 -- 172.21.15.87:0/1835565919 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3c6002c3e0 con 0x7f3c60100760 2024-09-13T17:13:40.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.303+0000 7f3c5d7fa640 1 -- 172.21.15.87:0/1835565919 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3c50099b90 con 0x7f3c60100760 2024-09-13T17:13:40.305 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-09-13T17:13:40.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.305+0000 7f3c64ba0640 1 -- 172.21.15.87:0/1835565919 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3c4c0a1090 msgr2=0x7f3c4c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:40.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.305+0000 7f3c64ba0640 1 --2- 172.21.15.87:0/1835565919 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3c4c0a1090 0x7f3c4c0a3550 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3c48006010 tx=0x7f3c48000bc0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.305+0000 7f3c64ba0640 1 -- 172.21.15.87:0/1835565919 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c60100760 msgr2=0x7f3c60195d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:40.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.305+0000 7f3c64ba0640 1 --2- 172.21.15.87:0/1835565919 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c60100760 0x7f3c60195d50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3c5000e9f0 tx=0x7f3c5000edf0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.305+0000 7f3c64ba0640 1 -- 172.21.15.87:0/1835565919 shutdown_connections 2024-09-13T17:13:40.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.305+0000 7f3c64ba0640 1 --2- 172.21.15.87:0/1835565919 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f3c4c0a1090 0x7f3c4c0a3550 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.305+0000 7f3c64ba0640 1 --2- 172.21.15.87:0/1835565919 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c601059c0 0x7f3c6019d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.305+0000 7f3c64ba0640 1 --2- 172.21.15.87:0/1835565919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c60103090 0x7f3c60196290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.305+0000 7f3c64ba0640 1 --2- 172.21.15.87:0/1835565919 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c60100760 0x7f3c60195d50 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.305+0000 7f3c64ba0640 1 -- 172.21.15.87:0/1835565919 >> 172.21.15.87:0/1835565919 conn(0x7f3c600fa360 msgr2=0x7f3c60101020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:40.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.305+0000 7f3c64ba0640 1 -- 172.21.15.87:0/1835565919 shutdown_connections 2024-09-13T17:13:40.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.305+0000 7f3c64ba0640 1 -- 172.21.15.87:0/1835565919 wait complete. 2024-09-13T17:13:40.317 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:13:40.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.418+0000 7f78b4e3a640 1 -- 172.21.15.87:0/195483711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78b0105a40 msgr2=0x7f78b0107eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:40.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.418+0000 7f78b4e3a640 1 --2- 172.21.15.87:0/195483711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78b0105a40 0x7f78b0107eb0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f78a8009ca0 tx=0x7f78a802a8c0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.418+0000 7f78b4e3a640 1 -- 172.21.15.87:0/195483711 shutdown_connections 2024-09-13T17:13:40.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.418+0000 7f78b4e3a640 1 --2- 172.21.15.87:0/195483711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78b0105a40 0x7f78b0107eb0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.418+0000 7f78b4e3a640 1 --2- 172.21.15.87:0/195483711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78b0103110 0x7f78b0105500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.418+0000 7f78b4e3a640 1 --2- 172.21.15.87:0/195483711 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78b01007e0 0x7f78b0102bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.418+0000 7f78b4e3a640 1 -- 172.21.15.87:0/195483711 >> 172.21.15.87:0/195483711 conn(0x7f78b00fa3e0 msgr2=0x7f78b00fc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:40.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.418+0000 7f78b4e3a640 1 -- 172.21.15.87:0/195483711 shutdown_connections 2024-09-13T17:13:40.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.418+0000 7f78b4e3a640 1 -- 172.21.15.87:0/195483711 wait complete. 2024-09-13T17:13:40.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.419+0000 7f78b4e3a640 1 Processor -- start 2024-09-13T17:13:40.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.419+0000 7f78b4e3a640 1 -- start start 2024-09-13T17:13:40.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.419+0000 7f78b4e3a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78b01007e0 0x7f78b0100150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.419+0000 7f78b4e3a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78b0103110 0x7f78b00fe790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.419+0000 7f78b4e3a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78b0105a40 0x7f78b00fecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.419+0000 7f78b4e3a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b00ff430 con 0x7f78b01007e0 2024-09-13T17:13:40.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.419+0000 7f78b4e3a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b00ff5a0 con 0x7f78b0103110 2024-09-13T17:13:40.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.419+0000 7f78b4e3a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b019feb0 con 0x7f78b0105a40 2024-09-13T17:13:40.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.419+0000 7f78ae59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78b01007e0 0x7f78b0100150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.419+0000 7f78ae59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78b01007e0 0x7f78b0100150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39412/0 (socket says 172.21.15.87:39412) 2024-09-13T17:13:40.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.419+0000 7f78ae59c640 1 -- 172.21.15.87:0/1933602506 learned_addr learned my addr 172.21.15.87:0/1933602506 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:40.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.420+0000 7f78aed9d640 1 --2- 172.21.15.87:0/1933602506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78b0105a40 0x7f78b00fecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.420+0000 7f78ae59c640 1 -- 172.21.15.87:0/1933602506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78b0105a40 msgr2=0x7f78b00fecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:40.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.420+0000 7f78ae59c640 1 --2- 172.21.15.87:0/1933602506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78b0105a40 0x7f78b00fecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.420+0000 7f78ae59c640 1 -- 172.21.15.87:0/1933602506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78b0103110 msgr2=0x7f78b00fe790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:40.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.420+0000 7f78a5d9b640 1 --2- 172.21.15.87:0/1933602506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78b0103110 0x7f78b00fe790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.420+0000 7f78ae59c640 1 --2- 172.21.15.87:0/1933602506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78b0103110 0x7f78b00fe790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.420+0000 7f78ae59c640 1 -- 172.21.15.87:0/1933602506 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a8009900 con 0x7f78b01007e0 2024-09-13T17:13:40.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.420+0000 7f78ae59c640 1 --2- 172.21.15.87:0/1933602506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78b01007e0 0x7f78b0100150 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f78a000b4d0 tx=0x7f78a000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:40.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.420+0000 7f78a7fff640 1 -- 172.21.15.87:0/1933602506 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a0010870 con 0x7f78b01007e0 2024-09-13T17:13:40.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.420+0000 7f78a7fff640 1 -- 172.21.15.87:0/1933602506 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f78a0010e80 con 0x7f78b01007e0 2024-09-13T17:13:40.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.420+0000 7f78b4e3a640 1 -- 172.21.15.87:0/1933602506 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b01a0160 con 0x7f78b01007e0 2024-09-13T17:13:40.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.420+0000 7f78a7fff640 1 -- 172.21.15.87:0/1933602506 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a0017360 con 0x7f78b01007e0 2024-09-13T17:13:40.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.420+0000 7f78b4e3a640 1 -- 172.21.15.87:0/1933602506 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b01a06a0 con 0x7f78b01007e0 2024-09-13T17:13:40.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.421+0000 7f78b4e3a640 1 -- 172.21.15.87:0/1933602506 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b00fbed0 con 0x7f78b01007e0 2024-09-13T17:13:40.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.422+0000 7f78a7fff640 1 -- 172.21.15.87:0/1933602506 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f78a00109d0 con 0x7f78b01007e0 2024-09-13T17:13:40.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.423+0000 7f78a7fff640 1 --2- 172.21.15.87:0/1933602506 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f789c0a1090 0x7f789c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.423+0000 7f78a5d9b640 1 --2- 172.21.15.87:0/1933602506 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f789c0a1090 0x7f789c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.423+0000 7f78a7fff640 1 -- 172.21.15.87:0/1933602506 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f78a00cc790 con 0x7f78b01007e0 2024-09-13T17:13:40.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.423+0000 7f78a5d9b640 1 --2- 172.21.15.87:0/1933602506 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f789c0a1090 0x7f789c0a3550 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f78b00ffec0 tx=0x7f7898008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:40.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.427+0000 7f78a7fff640 1 -- 172.21.15.87:0/1933602506 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f78a0095b50 con 0x7f78b01007e0 2024-09-13T17:13:40.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.587+0000 7f78b4e3a640 1 -- 172.21.15.87:0/1933602506 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f78b002c3e0 con 0x7f78b01007e0 2024-09-13T17:13:40.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.587+0000 7f78a7fff640 1 -- 172.21.15.87:0/1933602506 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) v1 ==== 100+0+11 (secure 0 0 0) 0x7f78a0099170 con 0x7f78b01007e0 2024-09-13T17:13:40.588 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-09-13T17:13:40.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.589+0000 7f78b4e3a640 1 -- 172.21.15.87:0/1933602506 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f789c0a1090 msgr2=0x7f789c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:40.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.589+0000 7f78b4e3a640 1 --2- 172.21.15.87:0/1933602506 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f789c0a1090 0x7f789c0a3550 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f78b00ffec0 tx=0x7f7898008040 comp rx=0 tx=0).stop 2024-09-13T17:13:40.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.590+0000 7f78b4e3a640 1 -- 172.21.15.87:0/1933602506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78b01007e0 msgr2=0x7f78b0100150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:40.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.590+0000 7f78b4e3a640 1 --2- 172.21.15.87:0/1933602506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78b01007e0 0x7f78b0100150 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f78a000b4d0 tx=0x7f78a000b990 comp rx=0 tx=0).stop 2024-09-13T17:13:40.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.590+0000 7f78b4e3a640 1 -- 172.21.15.87:0/1933602506 shutdown_connections 2024-09-13T17:13:40.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.590+0000 7f78b4e3a640 1 --2- 172.21.15.87:0/1933602506 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f789c0a1090 0x7f789c0a3550 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.590+0000 7f78b4e3a640 1 --2- 172.21.15.87:0/1933602506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78b0105a40 0x7f78b00fecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.590+0000 7f78b4e3a640 1 --2- 172.21.15.87:0/1933602506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78b0103110 0x7f78b00fe790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.590+0000 7f78b4e3a640 1 --2- 172.21.15.87:0/1933602506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78b01007e0 0x7f78b0100150 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.590+0000 7f78b4e3a640 1 -- 172.21.15.87:0/1933602506 >> 172.21.15.87:0/1933602506 conn(0x7f78b00fa3e0 msgr2=0x7f78b01011c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:40.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.590+0000 7f78b4e3a640 1 -- 172.21.15.87:0/1933602506 shutdown_connections 2024-09-13T17:13:40.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.590+0000 7f78b4e3a640 1 -- 172.21.15.87:0/1933602506 wait complete. 2024-09-13T17:13:40.600 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:40 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2909191949' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:13:40.601 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:40 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3499111193' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:13:40.601 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:40 smithi087 ceph-mon[30934]: pgmap v349: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T17:13:40.601 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:40 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1835565919' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:13:40.602 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:13:40.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.701+0000 7fd32e019640 1 -- 172.21.15.87:0/3992177306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd328101920 msgr2=0x7fd3281081b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:40.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.701+0000 7fd32e019640 1 --2- 172.21.15.87:0/3992177306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd328101920 0x7fd3281081b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd320009900 tx=0x7fd32002a410 comp rx=0 tx=0).stop 2024-09-13T17:13:40.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.701+0000 7fd32e019640 1 -- 172.21.15.87:0/3992177306 shutdown_connections 2024-09-13T17:13:40.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.701+0000 7fd32e019640 1 --2- 172.21.15.87:0/3992177306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd328101920 0x7fd3281081b0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.701+0000 7fd32e019640 1 --2- 172.21.15.87:0/3992177306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd328100f60 0x7fd3281013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.701+0000 7fd32e019640 1 --2- 172.21.15.87:0/3992177306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3280ffd70 0x7fd328100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.701+0000 7fd32e019640 1 -- 172.21.15.87:0/3992177306 >> 172.21.15.87:0/3992177306 conn(0x7fd3280fb4d0 msgr2=0x7fd3280fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:40.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.701+0000 7fd32e019640 1 -- 172.21.15.87:0/3992177306 shutdown_connections 2024-09-13T17:13:40.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.701+0000 7fd32e019640 1 -- 172.21.15.87:0/3992177306 wait complete. 2024-09-13T17:13:40.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.702+0000 7fd32e019640 1 Processor -- start 2024-09-13T17:13:40.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.702+0000 7fd32e019640 1 -- start start 2024-09-13T17:13:40.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.702+0000 7fd32e019640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3280ffd70 0x7fd328195d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.702+0000 7fd32e019640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd328100f60 0x7fd328196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.702+0000 7fd32e019640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd328101920 0x7fd32819d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.702+0000 7fd32e019640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32819d800 con 0x7fd3280ffd70 2024-09-13T17:13:40.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.702+0000 7fd32e019640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32819d970 con 0x7fd328101920 2024-09-13T17:13:40.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.702+0000 7fd32e019640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32819db30 con 0x7fd328100f60 2024-09-13T17:13:40.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.702+0000 7fd3277fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3280ffd70 0x7fd328195d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.702+0000 7fd3277fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3280ffd70 0x7fd328195d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39428/0 (socket says 172.21.15.87:39428) 2024-09-13T17:13:40.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.702+0000 7fd3277fe640 1 -- 172.21.15.87:0/484794277 learned_addr learned my addr 172.21.15.87:0/484794277 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:40.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.703+0000 7fd3277fe640 1 -- 172.21.15.87:0/484794277 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd328100f60 msgr2=0x7fd328196260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:40.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.703+0000 7fd326ffd640 1 --2- 172.21.15.87:0/484794277 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd328100f60 0x7fd328196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.703+0000 7fd3277fe640 1 --2- 172.21.15.87:0/484794277 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd328100f60 0x7fd328196260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.703+0000 7fd3277fe640 1 -- 172.21.15.87:0/484794277 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd328101920 msgr2=0x7fd32819d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:40.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.703+0000 7fd327fff640 1 --2- 172.21.15.87:0/484794277 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd328101920 0x7fd32819d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.703+0000 7fd3277fe640 1 --2- 172.21.15.87:0/484794277 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd328101920 0x7fd32819d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.703+0000 7fd3277fe640 1 -- 172.21.15.87:0/484794277 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd320009560 con 0x7fd3280ffd70 2024-09-13T17:13:40.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.703+0000 7fd326ffd640 1 --2- 172.21.15.87:0/484794277 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd328100f60 0x7fd328196260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:40.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.703+0000 7fd3277fe640 1 --2- 172.21.15.87:0/484794277 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3280ffd70 0x7fd328195d20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd31800d950 tx=0x7fd31800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:40.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.703+0000 7fd324ff9640 1 -- 172.21.15.87:0/484794277 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd318009c30 con 0x7fd3280ffd70 2024-09-13T17:13:40.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.703+0000 7fd324ff9640 1 -- 172.21.15.87:0/484794277 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd318009d90 con 0x7fd3280ffd70 2024-09-13T17:13:40.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.703+0000 7fd32e019640 1 -- 172.21.15.87:0/484794277 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd32819de10 con 0x7fd3280ffd70 2024-09-13T17:13:40.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.703+0000 7fd324ff9640 1 -- 172.21.15.87:0/484794277 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31800f7e0 con 0x7fd3280ffd70 2024-09-13T17:13:40.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.703+0000 7fd32e019640 1 -- 172.21.15.87:0/484794277 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd32819e230 con 0x7fd3280ffd70 2024-09-13T17:13:40.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.704+0000 7fd32e019640 1 -- 172.21.15.87:0/484794277 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3281071b0 con 0x7fd3280ffd70 2024-09-13T17:13:40.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.705+0000 7fd324ff9640 1 -- 172.21.15.87:0/484794277 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd318010460 con 0x7fd3280ffd70 2024-09-13T17:13:40.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.706+0000 7fd324ff9640 1 --2- 172.21.15.87:0/484794277 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd3100a1090 0x7fd3100a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.706+0000 7fd324ff9640 1 -- 172.21.15.87:0/484794277 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7fd3180cce10 con 0x7fd3280ffd70 2024-09-13T17:13:40.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.706+0000 7fd326ffd640 1 --2- 172.21.15.87:0/484794277 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd3100a1090 0x7fd3100a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.706+0000 7fd326ffd640 1 --2- 172.21.15.87:0/484794277 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd3100a1090 0x7fd3100a3550 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd31c005fd0 tx=0x7fd31c0082b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:40.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.709+0000 7fd324ff9640 1 -- 172.21.15.87:0/484794277 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd318096140 con 0x7fd3280ffd70 2024-09-13T17:13:40.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:40 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2909191949' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:13:40.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:40 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3499111193' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:13:40.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:40 smithi149 ceph-mon[35496]: pgmap v349: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T17:13:40.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:40 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1835565919' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:13:40.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:40 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2909191949' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:13:40.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:40 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3499111193' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:13:40.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:40 smithi118 ceph-mon[34374]: pgmap v349: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T17:13:40.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:40 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1835565919' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:13:40.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.870+0000 7fd32e019640 1 -- 172.21.15.87:0/484794277 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd32802c4b0 con 0x7fd3280ffd70 2024-09-13T17:13:40.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.871+0000 7fd324ff9640 1 -- 172.21.15.87:0/484794277 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v93) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd318098070 con 0x7fd3280ffd70 2024-09-13T17:13:40.872 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-09-13T17:13:40.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.873+0000 7fd32e019640 1 -- 172.21.15.87:0/484794277 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd3100a1090 msgr2=0x7fd3100a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:40.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.873+0000 7fd32e019640 1 --2- 172.21.15.87:0/484794277 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd3100a1090 0x7fd3100a3550 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd31c005fd0 tx=0x7fd31c0082b0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.873+0000 7fd32e019640 1 -- 172.21.15.87:0/484794277 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3280ffd70 msgr2=0x7fd328195d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:40.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.873+0000 7fd32e019640 1 --2- 172.21.15.87:0/484794277 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3280ffd70 0x7fd328195d20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd31800d950 tx=0x7fd31800de10 comp rx=0 tx=0).stop 2024-09-13T17:13:40.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.873+0000 7fd32e019640 1 -- 172.21.15.87:0/484794277 shutdown_connections 2024-09-13T17:13:40.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.873+0000 7fd32e019640 1 --2- 172.21.15.87:0/484794277 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fd3100a1090 0x7fd3100a3550 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.873+0000 7fd32e019640 1 --2- 172.21.15.87:0/484794277 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd328101920 0x7fd32819d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.873+0000 7fd32e019640 1 --2- 172.21.15.87:0/484794277 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd328100f60 0x7fd328196260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.873+0000 7fd32e019640 1 --2- 172.21.15.87:0/484794277 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3280ffd70 0x7fd328195d20 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.873+0000 7fd32e019640 1 -- 172.21.15.87:0/484794277 >> 172.21.15.87:0/484794277 conn(0x7fd3280fb4d0 msgr2=0x7fd328104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:40.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.873+0000 7fd32e019640 1 -- 172.21.15.87:0/484794277 shutdown_connections 2024-09-13T17:13:40.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.873+0000 7fd32e019640 1 -- 172.21.15.87:0/484794277 wait complete. 2024-09-13T17:13:40.887 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:13:40.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.985+0000 7f9bc159c640 1 -- 172.21.15.87:0/1460436203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bbc0ffff0 msgr2=0x7f9bbc106880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:40.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.985+0000 7f9bc159c640 1 --2- 172.21.15.87:0/1460436203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bbc0ffff0 0x7f9bbc106880 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4009ca0 tx=0x7f9bb402a8c0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.985+0000 7f9bc159c640 1 -- 172.21.15.87:0/1460436203 shutdown_connections 2024-09-13T17:13:40.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.985+0000 7f9bc159c640 1 --2- 172.21.15.87:0/1460436203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bbc0ffff0 0x7f9bbc106880 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.985+0000 7f9bc159c640 1 --2- 172.21.15.87:0/1460436203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9bbc0ff630 0x7f9bbc0ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.985+0000 7f9bc159c640 1 --2- 172.21.15.87:0/1460436203 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bbc0fe440 0x7f9bbc0fe840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.985+0000 7f9bc159c640 1 -- 172.21.15.87:0/1460436203 >> 172.21.15.87:0/1460436203 conn(0x7f9bbc0f9bc0 msgr2=0x7f9bbc0fbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:40.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.985+0000 7f9bc159c640 1 -- 172.21.15.87:0/1460436203 shutdown_connections 2024-09-13T17:13:40.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.985+0000 7f9bc159c640 1 -- 172.21.15.87:0/1460436203 wait complete. 2024-09-13T17:13:40.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.985+0000 7f9bc159c640 1 Processor -- start 2024-09-13T17:13:40.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.985+0000 7f9bc159c640 1 -- start start 2024-09-13T17:13:40.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.985+0000 7f9bc159c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9bbc0fe440 0x7f9bbc107a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.985+0000 7f9bc159c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bbc0ff630 0x7f9bbc19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.986+0000 7f9bc159c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bbc0ffff0 0x7f9bbc19d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.986+0000 7f9bc159c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc19d980 con 0x7f9bbc0ff630 2024-09-13T17:13:40.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.986+0000 7f9bc159c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc19daf0 con 0x7f9bbc0ffff0 2024-09-13T17:13:40.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.986+0000 7f9bc159c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc19dcb0 con 0x7f9bbc0fe440 2024-09-13T17:13:40.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.986+0000 7f9bb27fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bbc0ff630 0x7f9bbc19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.986+0000 7f9bb27fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bbc0ff630 0x7f9bbc19ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39440/0 (socket says 172.21.15.87:39440) 2024-09-13T17:13:40.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.986+0000 7f9bb27fc640 1 -- 172.21.15.87:0/2436602479 learned_addr learned my addr 172.21.15.87:0/2436602479 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:40.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.986+0000 7f9bbaffd640 1 --2- 172.21.15.87:0/2436602479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9bbc0fe440 0x7f9bbc107a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.986+0000 7f9bbb7fe640 1 --2- 172.21.15.87:0/2436602479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bbc0ffff0 0x7f9bbc19d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.986+0000 7f9bb27fc640 1 -- 172.21.15.87:0/2436602479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9bbc0fe440 msgr2=0x7f9bbc107a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:40.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.986+0000 7f9bb27fc640 1 --2- 172.21.15.87:0/2436602479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9bbc0fe440 0x7f9bbc107a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.986+0000 7f9bb27fc640 1 -- 172.21.15.87:0/2436602479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bbc0ffff0 msgr2=0x7f9bbc19d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:40.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.986+0000 7f9bb27fc640 1 --2- 172.21.15.87:0/2436602479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bbc0ffff0 0x7f9bbc19d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:40.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.986+0000 7f9bb27fc640 1 -- 172.21.15.87:0/2436602479 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb4009900 con 0x7f9bbc0ff630 2024-09-13T17:13:40.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.986+0000 7f9bb27fc640 1 --2- 172.21.15.87:0/2436602479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bbc0ff630 0x7f9bbc19ab80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9ba400c970 tx=0x7f9ba400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:40.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.986+0000 7f9bb8ff9640 1 -- 172.21.15.87:0/2436602479 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba4007bb0 con 0x7f9bbc0ff630 2024-09-13T17:13:40.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.986+0000 7f9bb8ff9640 1 -- 172.21.15.87:0/2436602479 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9ba4007d10 con 0x7f9bbc0ff630 2024-09-13T17:13:40.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.986+0000 7f9bc159c640 1 -- 172.21.15.87:0/2436602479 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bbc19df30 con 0x7f9bbc0ff630 2024-09-13T17:13:40.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.986+0000 7f9bb8ff9640 1 -- 172.21.15.87:0/2436602479 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba4004e80 con 0x7f9bbc0ff630 2024-09-13T17:13:40.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.986+0000 7f9bc159c640 1 -- 172.21.15.87:0/2436602479 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bbc19e360 con 0x7f9bbc0ff630 2024-09-13T17:13:40.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.987+0000 7f9bc159c640 1 -- 172.21.15.87:0/2436602479 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bbc105920 con 0x7f9bbc0ff630 2024-09-13T17:13:40.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.988+0000 7f9bb8ff9640 1 -- 172.21.15.87:0/2436602479 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9ba4005020 con 0x7f9bbc0ff630 2024-09-13T17:13:40.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.989+0000 7f9bb8ff9640 1 --2- 172.21.15.87:0/2436602479 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f9ba80a1090 0x7f9ba80a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:40.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.989+0000 7f9bb8ff9640 1 -- 172.21.15.87:0/2436602479 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f9ba40cc9d0 con 0x7f9bbc0ff630 2024-09-13T17:13:40.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.989+0000 7f9bbaffd640 1 --2- 172.21.15.87:0/2436602479 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f9ba80a1090 0x7f9ba80a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:40.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.990+0000 7f9bbaffd640 1 --2- 172.21.15.87:0/2436602479 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f9ba80a1090 0x7f9ba80a3550 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9bac0058c0 tx=0x7f9bac00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:40.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:40.993+0000 7f9bb8ff9640 1 -- 172.21.15.87:0/2436602479 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9ba4095d90 con 0x7f9bbc0ff630 2024-09-13T17:13:41.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.190+0000 7f9bc159c640 1 -- 172.21.15.87:0/2436602479 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9bbc02c410 con 0x7f9bbc0ff630 2024-09-13T17:13:41.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.190+0000 7f9bb8ff9640 1 -- 172.21.15.87:0/2436602479 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10877 (secure 0 0 0) 0x7f9ba401d090 con 0x7f9bbc0ff630 2024-09-13T17:13:41.191 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:13:41.192 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/3674545180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":3674545180},{"type":"v1","addr":"172.21.15.87:6841","nonce":3674545180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:11:23.313609+0000","modified":"2024-09-13T17:11:47.780404+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24484,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6839/3052680456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3052680456},{"type":"v1","addr":"172.21.15.118:6839","nonce":3052680456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:13:41.192 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 23 2024-09-13T17:13:41.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.192+0000 7f9bc159c640 1 -- 172.21.15.87:0/2436602479 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f9ba80a1090 msgr2=0x7f9ba80a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:41.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.192+0000 7f9bc159c640 1 --2- 172.21.15.87:0/2436602479 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f9ba80a1090 0x7f9ba80a3550 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9bac0058c0 tx=0x7f9bac00a2d0 comp rx=0 tx=0).stop 2024-09-13T17:13:41.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.193+0000 7f9bc159c640 1 -- 172.21.15.87:0/2436602479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bbc0ff630 msgr2=0x7f9bbc19ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:41.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.193+0000 7f9bc159c640 1 --2- 172.21.15.87:0/2436602479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bbc0ff630 0x7f9bbc19ab80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9ba400c970 tx=0x7f9ba400ce30 comp rx=0 tx=0).stop 2024-09-13T17:13:41.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.193+0000 7f9bc159c640 1 -- 172.21.15.87:0/2436602479 shutdown_connections 2024-09-13T17:13:41.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.193+0000 7f9bc159c640 1 --2- 172.21.15.87:0/2436602479 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f9ba80a1090 0x7f9ba80a3550 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:41.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.193+0000 7f9bc159c640 1 --2- 172.21.15.87:0/2436602479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bbc0ffff0 0x7f9bbc19d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:41.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.193+0000 7f9bc159c640 1 --2- 172.21.15.87:0/2436602479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bbc0ff630 0x7f9bbc19ab80 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:41.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.193+0000 7f9bc159c640 1 --2- 172.21.15.87:0/2436602479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9bbc0fe440 0x7f9bbc107a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:41.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.193+0000 7f9bc159c640 1 -- 172.21.15.87:0/2436602479 >> 172.21.15.87:0/2436602479 conn(0x7f9bbc0f9bc0 msgr2=0x7f9bbc102af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:41.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.193+0000 7f9bc159c640 1 -- 172.21.15.87:0/2436602479 shutdown_connections 2024-09-13T17:13:41.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.193+0000 7f9bc159c640 1 -- 172.21.15.87:0/2436602479 wait complete. 2024-09-13T17:13:41.205 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:13:41.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.302+0000 7f9fd5068640 1 -- 172.21.15.87:0/1356808603 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fd0105a80 msgr2=0x7f9fd0107ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:41.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.302+0000 7f9fd5068640 1 --2- 172.21.15.87:0/1356808603 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fd0105a80 0x7f9fd0107ef0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8009ca0 tx=0x7f9fc802a8c0 comp rx=0 tx=0).stop 2024-09-13T17:13:41.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.302+0000 7f9fd5068640 1 -- 172.21.15.87:0/1356808603 shutdown_connections 2024-09-13T17:13:41.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.302+0000 7f9fd5068640 1 --2- 172.21.15.87:0/1356808603 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fd0105a80 0x7f9fd0107ef0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:41.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.302+0000 7f9fd5068640 1 --2- 172.21.15.87:0/1356808603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fd0103150 0x7f9fd0105540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:41.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.302+0000 7f9fd5068640 1 --2- 172.21.15.87:0/1356808603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fd0100820 0x7f9fd0102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:41.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.302+0000 7f9fd5068640 1 -- 172.21.15.87:0/1356808603 >> 172.21.15.87:0/1356808603 conn(0x7f9fd00fa420 msgr2=0x7f9fd00fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:41.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.302+0000 7f9fd5068640 1 -- 172.21.15.87:0/1356808603 shutdown_connections 2024-09-13T17:13:41.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.302+0000 7f9fd5068640 1 -- 172.21.15.87:0/1356808603 wait complete. 2024-09-13T17:13:41.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.303+0000 7f9fd5068640 1 Processor -- start 2024-09-13T17:13:41.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.303+0000 7f9fd5068640 1 -- start start 2024-09-13T17:13:41.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.303+0000 7f9fd5068640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fd0100820 0x7f9fd0195df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:41.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.303+0000 7f9fd5068640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fd0103150 0x7f9fd0196330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:41.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.303+0000 7f9fd5068640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fd0105a80 0x7f9fd019d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:41.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.303+0000 7f9fd5068640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd019d8e0 con 0x7f9fd0103150 2024-09-13T17:13:41.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.303+0000 7f9fd5068640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd019da50 con 0x7f9fd0100820 2024-09-13T17:13:41.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.303+0000 7f9fd5068640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd019dc10 con 0x7f9fd0105a80 2024-09-13T17:13:41.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.303+0000 7f9fc659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fd0103150 0x7f9fd0196330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:41.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.303+0000 7f9fc659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fd0103150 0x7f9fd0196330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39450/0 (socket says 172.21.15.87:39450) 2024-09-13T17:13:41.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.303+0000 7f9fc659c640 1 -- 172.21.15.87:0/2920560509 learned_addr learned my addr 172.21.15.87:0/2920560509 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:41.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.304+0000 7f9fced9d640 1 --2- 172.21.15.87:0/2920560509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fd0100820 0x7f9fd0195df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:41.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.304+0000 7f9fcf59e640 1 --2- 172.21.15.87:0/2920560509 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fd0105a80 0x7f9fd019d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:41.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.304+0000 7f9fc659c640 1 -- 172.21.15.87:0/2920560509 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fd0105a80 msgr2=0x7f9fd019d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:41.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.304+0000 7f9fc659c640 1 --2- 172.21.15.87:0/2920560509 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fd0105a80 0x7f9fd019d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:41.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.304+0000 7f9fc659c640 1 -- 172.21.15.87:0/2920560509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fd0100820 msgr2=0x7f9fd0195df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:41.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.304+0000 7f9fc659c640 1 --2- 172.21.15.87:0/2920560509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fd0100820 0x7f9fd0195df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:41.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.304+0000 7f9fc659c640 1 -- 172.21.15.87:0/2920560509 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc8009900 con 0x7f9fd0103150 2024-09-13T17:13:41.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.304+0000 7f9fcf59e640 1 --2- 172.21.15.87:0/2920560509 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fd0105a80 0x7f9fd019d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:41.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.304+0000 7f9fc659c640 1 --2- 172.21.15.87:0/2920560509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fd0103150 0x7f9fd0196330 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9fb800d770 tx=0x7f9fb800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:41.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.304+0000 7f9fccd99640 1 -- 172.21.15.87:0/2920560509 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb8009c30 con 0x7f9fd0103150 2024-09-13T17:13:41.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.304+0000 7f9fccd99640 1 -- 172.21.15.87:0/2920560509 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9fb800de80 con 0x7f9fd0103150 2024-09-13T17:13:41.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.304+0000 7f9fd5068640 1 -- 172.21.15.87:0/2920560509 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fd019def0 con 0x7f9fd0103150 2024-09-13T17:13:41.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.304+0000 7f9fccd99640 1 -- 172.21.15.87:0/2920560509 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb800f600 con 0x7f9fd0103150 2024-09-13T17:13:41.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.304+0000 7f9fd5068640 1 -- 172.21.15.87:0/2920560509 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fd019e370 con 0x7f9fd0103150 2024-09-13T17:13:41.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.305+0000 7f9fd5068640 1 -- 172.21.15.87:0/2920560509 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fd00fbf10 con 0x7f9fd0103150 2024-09-13T17:13:41.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.306+0000 7f9fccd99640 1 -- 172.21.15.87:0/2920560509 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9fb8010460 con 0x7f9fd0103150 2024-09-13T17:13:41.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.307+0000 7f9fccd99640 1 --2- 172.21.15.87:0/2920560509 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f9fbc0a1090 0x7f9fbc0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:41.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.307+0000 7f9fced9d640 1 --2- 172.21.15.87:0/2920560509 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f9fbc0a1090 0x7f9fbc0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:41.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.307+0000 7f9fccd99640 1 -- 172.21.15.87:0/2920560509 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f9fb80cca60 con 0x7f9fd0103150 2024-09-13T17:13:41.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.307+0000 7f9fced9d640 1 --2- 172.21.15.87:0/2920560509 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f9fbc0a1090 0x7f9fbc0a3550 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0005fd0 tx=0x7f9fc000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:41.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.311+0000 7f9fccd99640 1 -- 172.21.15.87:0/2920560509 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9fb8095e20 con 0x7f9fd0103150 2024-09-13T17:13:41.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.475+0000 7f9fd5068640 1 -- 172.21.15.87:0/2920560509 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9fd002c410 con 0x7f9fd0103150 2024-09-13T17:13:41.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.477+0000 7f9fccd99640 1 -- 172.21.15.87:0/2920560509 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+24817 (secure 0 0 0) 0x7f9fb8017090 con 0x7f9fd0103150 2024-09-13T17:13:41.478 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:13:41.478 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":93,"fsid":"043d5bae-71f2-11ef-bceb-c7b262605968","created":"2024-09-13T17:03:57.852010+0000","modified":"2024-09-13T17:12:50.208429+0000","last_up_change":"2024-09-13T17:10:34.423548+0000","last_in_change":"2024-09-13T17:10:14.228123+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:07:02.286400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:11:21.965141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:11:22.504345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:11:25.565163+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58250283-85c0-416e-abdd-1fc5a7ff0c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6803","nonce":1316956138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6805","nonce":1316956138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6809","nonce":1316956138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6807","nonce":1316956138}]},"public_addr":"172.21.15.87:6803/1316956138","cluster_addr":"172.21.15.87:6805/1316956138","heartbeat_back_addr":"172.21.15.87:6809/1316956138","heartbeat_front_addr":"172.21.15.87:6807/1316956138","state":["exists","up"]},{"osd":1,"uuid":"b9d49969-94b1-4262-b4ff-db0a8e3331af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6801","nonce":3352566727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6803","nonce":3352566727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6807","nonce":3352566727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6805","nonce":3352566727}]},"public_addr":"172.21.15.118:6801/3352566727","cluster_addr":"172.21.15.118:6803/3352566727","heartbeat_back_addr":"172.21.15.118:6807/3352566727","heartbeat_front_addr":"172.21.15.118:6805/3352566727","state":["exists","up"]},{"osd":2,"uuid":"ba64549e-d736-426f-b466-f569af5f16d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6801","nonce":2774581686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6803","nonce":2774581686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6807","nonce":2774581686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6805","nonce":2774581686}]},"public_addr":"172.21.15.149:6801/2774581686","cluster_addr":"172.21.15.149:6803/2774581686","heartbeat_back_addr":"172.21.15.149:6807/2774581686","heartbeat_front_addr":"172.21.15.149:6805/2774581686","state":["exists","up"]},{"osd":3,"uuid":"3d5553e5-371b-49fd-976b-9e72a97a2f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6811","nonce":3306119066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6813","nonce":3306119066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6817","nonce":3306119066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6815","nonce":3306119066}]},"public_addr":"172.21.15.87:6811/3306119066","cluster_addr":"172.21.15.87:6813/3306119066","heartbeat_back_addr":"172.21.15.87:6817/3306119066","heartbeat_front_addr":"172.21.15.87:6815/3306119066","state":["exists","up"]},{"osd":4,"uuid":"2fbe0e27-34ec-42a6-9962-f1d8202b3159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6809","nonce":3342349890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6811","nonce":3342349890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6815","nonce":3342349890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6813","nonce":3342349890}]},"public_addr":"172.21.15.118:6809/3342349890","cluster_addr":"172.21.15.118:6811/3342349890","heartbeat_back_addr":"172.21.15.118:6815/3342349890","heartbeat_front_addr":"172.21.15.118:6813/3342349890","state":["exists","up"]},{"osd":5,"uuid":"53c14519-6170-4b5a-a79d-4835882d7bec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6809","nonce":3468867124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6811","nonce":3468867124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6815","nonce":3468867124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6813","nonce":3468867124}]},"public_addr":"172.21.15.149:6809/3468867124","cluster_addr":"172.21.15.149:6811/3468867124","heartbeat_back_addr":"172.21.15.149:6815/3468867124","heartbeat_front_addr":"172.21.15.149:6813/3468867124","state":["exists","up"]},{"osd":6,"uuid":"d3951b32-db77-4b8b-9de0-f05e03d13f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6819","nonce":326563617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6821","nonce":326563617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6825","nonce":326563617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6823","nonce":326563617}]},"public_addr":"172.21.15.87:6819/326563617","cluster_addr":"172.21.15.87:6821/326563617","heartbeat_back_addr":"172.21.15.87:6825/326563617","heartbeat_front_addr":"172.21.15.87:6823/326563617","state":["exists","up"]},{"osd":7,"uuid":"4d46dab7-a8bf-4e3e-b5c0-43860d336bdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6817","nonce":1690268990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6819","nonce":1690268990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6823","nonce":1690268990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6821","nonce":1690268990}]},"public_addr":"172.21.15.118:6817/1690268990","cluster_addr":"172.21.15.118:6819/1690268990","heartbeat_back_addr":"172.21.15.118:6823/1690268990","heartbeat_front_addr":"172.21.15.118:6821/1690268990","state":["exists","up"]},{"osd":8,"uuid":"5a015a7d-60a3-4412-96af-1b61d2ad51f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6817","nonce":1558675380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6819","nonce":1558675380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6823","nonce":1558675380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6821","nonce":1558675380}]},"public_addr":"172.21.15.149:6817/1558675380","cluster_addr":"172.21.15.149:6819/1558675380","heartbeat_back_addr":"172.21.15.149:6823/1558675380","heartbeat_front_addr":"172.21.15.149:6821/1558675380","state":["exists","up"]},{"osd":9,"uuid":"248c0b6e-4c4e-4c63-a0dd-e4cdf3b997a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6827","nonce":1453934262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6829","nonce":1453934262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6833","nonce":1453934262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6831","nonce":1453934262}]},"public_addr":"172.21.15.87:6827/1453934262","cluster_addr":"172.21.15.87:6829/1453934262","heartbeat_back_addr":"172.21.15.87:6833/1453934262","heartbeat_front_addr":"172.21.15.87:6831/1453934262","state":["exists","up"]},{"osd":10,"uuid":"24238714-e737-4371-b5d5-0cd3395f09bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6825","nonce":1034318850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6827","nonce":1034318850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6831","nonce":1034318850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6829","nonce":1034318850}]},"public_addr":"172.21.15.118:6825/1034318850","cluster_addr":"172.21.15.118:6827/1034318850","heartbeat_back_addr":"172.21.15.118:6831/1034318850","heartbeat_front_addr":"172.21.15.118:6829/1034318850","state":["exists","up"]},{"osd":11,"uuid":"409dd3bf-5154-4dea-8708-7de7f9e2e793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6825","nonce":271000465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6827","nonce":271000465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6831","nonce":271000465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6829","nonce":271000465}]},"public_addr":"172.21.15.149:6825/271000465","cluster_addr":"172.21.15.149:6827/271000465","heartbeat_back_addr":"172.21.15.149:6831/271000465","heartbeat_front_addr":"172.21.15.149:6829/271000465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:16.382664+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:37.914250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:00.425876+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:23.960183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:47.004088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:10.214345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:33.719221+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:57.099599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:20.971881+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:44.827167+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:08.135516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:32.085853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.d","mappings":[{"from":1,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8},{"from":5,"to":7}]},{"pgid":"3.28","mappings":[{"from":3,"to":6},{"from":5,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/586423689":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6801/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6800/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/3270371628":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/515676743":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/1475107314":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/553289143":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/3403361612":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6801/1587363880":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6800/1587363880":"2024-09-14T17:04:24.083789+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:13:41.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:41 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1933602506' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:13:41.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:41 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/484794277' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:13:41.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:41 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2436602479' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:13:41.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.479+0000 7f9fd5068640 1 -- 172.21.15.87:0/2920560509 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f9fbc0a1090 msgr2=0x7f9fbc0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:41.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.479+0000 7f9fd5068640 1 --2- 172.21.15.87:0/2920560509 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f9fbc0a1090 0x7f9fbc0a3550 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0005fd0 tx=0x7f9fc000b390 comp rx=0 tx=0).stop 2024-09-13T17:13:41.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.479+0000 7f9fd5068640 1 -- 172.21.15.87:0/2920560509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fd0103150 msgr2=0x7f9fd0196330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:41.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.479+0000 7f9fd5068640 1 --2- 172.21.15.87:0/2920560509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fd0103150 0x7f9fd0196330 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9fb800d770 tx=0x7f9fb800dc30 comp rx=0 tx=0).stop 2024-09-13T17:13:41.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.479+0000 7f9fd5068640 1 -- 172.21.15.87:0/2920560509 shutdown_connections 2024-09-13T17:13:41.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.479+0000 7f9fd5068640 1 --2- 172.21.15.87:0/2920560509 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f9fbc0a1090 0x7f9fbc0a3550 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:41.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.479+0000 7f9fd5068640 1 --2- 172.21.15.87:0/2920560509 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fd0105a80 0x7f9fd019d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:41.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.479+0000 7f9fd5068640 1 --2- 172.21.15.87:0/2920560509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fd0103150 0x7f9fd0196330 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:41.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.479+0000 7f9fd5068640 1 --2- 172.21.15.87:0/2920560509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9fd0100820 0x7f9fd0195df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:41.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.479+0000 7f9fd5068640 1 -- 172.21.15.87:0/2920560509 >> 172.21.15.87:0/2920560509 conn(0x7f9fd00fa420 msgr2=0x7f9fd0101220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:41.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.479+0000 7f9fd5068640 1 -- 172.21.15.87:0/2920560509 shutdown_connections 2024-09-13T17:13:41.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.479+0000 7f9fd5068640 1 -- 172.21.15.87:0/2920560509 wait complete. 2024-09-13T17:13:41.492 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:07:02.286400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:11:21.965141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:11:22.504345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:11:25.565163+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:13:41.492 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:13:41.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.592+0000 7fae56672640 1 -- 172.21.15.87:0/2695672149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae50105a70 msgr2=0x7fae50107ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:41.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.592+0000 7fae56672640 1 --2- 172.21.15.87:0/2695672149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae50105a70 0x7fae50107ee0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fae48009ca0 tx=0x7fae4802a8c0 comp rx=0 tx=0).stop 2024-09-13T17:13:41.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.592+0000 7fae56672640 1 -- 172.21.15.87:0/2695672149 shutdown_connections 2024-09-13T17:13:41.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.592+0000 7fae56672640 1 --2- 172.21.15.87:0/2695672149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae50105a70 0x7fae50107ee0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:41.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.592+0000 7fae56672640 1 --2- 172.21.15.87:0/2695672149 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae50103140 0x7fae50105530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:41.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.592+0000 7fae56672640 1 --2- 172.21.15.87:0/2695672149 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae50100810 0x7fae50102c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:41.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.592+0000 7fae56672640 1 -- 172.21.15.87:0/2695672149 >> 172.21.15.87:0/2695672149 conn(0x7fae500fa3f0 msgr2=0x7fae500fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:41.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.592+0000 7fae56672640 1 -- 172.21.15.87:0/2695672149 shutdown_connections 2024-09-13T17:13:41.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.592+0000 7fae56672640 1 -- 172.21.15.87:0/2695672149 wait complete. 2024-09-13T17:13:41.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.592+0000 7fae56672640 1 Processor -- start 2024-09-13T17:13:41.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.593+0000 7fae56672640 1 -- start start 2024-09-13T17:13:41.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.593+0000 7fae56672640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae50100810 0x7fae50195dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:41.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.593+0000 7fae56672640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae50103140 0x7fae50196310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:41.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.593+0000 7fae56672640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae50105a70 0x7fae5019d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:41.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.593+0000 7fae56672640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5019d8c0 con 0x7fae50103140 2024-09-13T17:13:41.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.593+0000 7fae56672640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5019da30 con 0x7fae50100810 2024-09-13T17:13:41.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.593+0000 7fae56672640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5019dbf0 con 0x7fae50105a70 2024-09-13T17:13:41.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.593+0000 7fae4f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae50103140 0x7fae50196310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:41.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.593+0000 7fae4f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae50103140 0x7fae50196310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39464/0 (socket says 172.21.15.87:39464) 2024-09-13T17:13:41.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.593+0000 7fae4f7fe640 1 -- 172.21.15.87:0/2359758341 learned_addr learned my addr 172.21.15.87:0/2359758341 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:41.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.593+0000 7fae4ffff640 1 --2- 172.21.15.87:0/2359758341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae50100810 0x7fae50195dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:41.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.593+0000 7fae54c0f640 1 --2- 172.21.15.87:0/2359758341 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae50105a70 0x7fae5019d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:41.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.593+0000 7fae4f7fe640 1 -- 172.21.15.87:0/2359758341 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae50105a70 msgr2=0x7fae5019d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:41.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.593+0000 7fae4f7fe640 1 --2- 172.21.15.87:0/2359758341 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae50105a70 0x7fae5019d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:41.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.593+0000 7fae4f7fe640 1 -- 172.21.15.87:0/2359758341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae50100810 msgr2=0x7fae50195dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:41.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.593+0000 7fae4f7fe640 1 --2- 172.21.15.87:0/2359758341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae50100810 0x7fae50195dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:41.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.593+0000 7fae4f7fe640 1 -- 172.21.15.87:0/2359758341 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae48009900 con 0x7fae50103140 2024-09-13T17:13:41.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.593+0000 7fae4f7fe640 1 --2- 172.21.15.87:0/2359758341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae50103140 0x7fae50196310 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fae4400c970 tx=0x7fae4400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:41.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.594+0000 7fae4d7fa640 1 -- 172.21.15.87:0/2359758341 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae44007bb0 con 0x7fae50103140 2024-09-13T17:13:41.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.594+0000 7fae4d7fa640 1 -- 172.21.15.87:0/2359758341 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fae44007d10 con 0x7fae50103140 2024-09-13T17:13:41.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.594+0000 7fae56672640 1 -- 172.21.15.87:0/2359758341 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae5019ded0 con 0x7fae50103140 2024-09-13T17:13:41.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.594+0000 7fae4d7fa640 1 -- 172.21.15.87:0/2359758341 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae44018660 con 0x7fae50103140 2024-09-13T17:13:41.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.594+0000 7fae56672640 1 -- 172.21.15.87:0/2359758341 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae5019e300 con 0x7fae50103140 2024-09-13T17:13:41.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.595+0000 7fae56672640 1 -- 172.21.15.87:0/2359758341 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae500fbee0 con 0x7fae50103140 2024-09-13T17:13:41.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.596+0000 7fae4d7fa640 1 -- 172.21.15.87:0/2359758341 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fae4400f450 con 0x7fae50103140 2024-09-13T17:13:41.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.597+0000 7fae4d7fa640 1 --2- 172.21.15.87:0/2359758341 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fae380a1090 0x7fae380a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:41.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.597+0000 7fae4ffff640 1 --2- 172.21.15.87:0/2359758341 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fae380a1090 0x7fae380a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:41.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.597+0000 7fae4d7fa640 1 -- 172.21.15.87:0/2359758341 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7fae440cce00 con 0x7fae50103140 2024-09-13T17:13:41.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.597+0000 7fae4ffff640 1 --2- 172.21.15.87:0/2359758341 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fae380a1090 0x7fae380a3550 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fae40009890 tx=0x7fae40008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:41.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.601+0000 7fae4d7fa640 1 -- 172.21.15.87:0/2359758341 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fae440961c0 con 0x7fae50103140 2024-09-13T17:13:41.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.760+0000 7fae56672640 1 -- 172.21.15.87:0/2359758341 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fae5002c480 con 0x7fae50103140 2024-09-13T17:13:41.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.760+0000 7fae4d7fa640 1 -- 172.21.15.87:0/2359758341 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) v1 ==== 93+0+10 (secure 0 0 0) 0x7fae440997e0 con 0x7fae50103140 2024-09-13T17:13:41.762 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-09-13T17:13:41.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.762+0000 7fae56672640 1 -- 172.21.15.87:0/2359758341 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fae380a1090 msgr2=0x7fae380a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:41.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.762+0000 7fae56672640 1 --2- 172.21.15.87:0/2359758341 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fae380a1090 0x7fae380a3550 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fae40009890 tx=0x7fae40008040 comp rx=0 tx=0).stop 2024-09-13T17:13:41.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.762+0000 7fae56672640 1 -- 172.21.15.87:0/2359758341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae50103140 msgr2=0x7fae50196310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:41.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.762+0000 7fae56672640 1 --2- 172.21.15.87:0/2359758341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae50103140 0x7fae50196310 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fae4400c970 tx=0x7fae4400ce30 comp rx=0 tx=0).stop 2024-09-13T17:13:41.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.762+0000 7fae56672640 1 -- 172.21.15.87:0/2359758341 shutdown_connections 2024-09-13T17:13:41.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.762+0000 7fae56672640 1 --2- 172.21.15.87:0/2359758341 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fae380a1090 0x7fae380a3550 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:41.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.762+0000 7fae56672640 1 --2- 172.21.15.87:0/2359758341 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae50105a70 0x7fae5019d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:41.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.762+0000 7fae56672640 1 --2- 172.21.15.87:0/2359758341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae50103140 0x7fae50196310 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:41.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.762+0000 7fae56672640 1 --2- 172.21.15.87:0/2359758341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae50100810 0x7fae50195dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:41.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.762+0000 7fae56672640 1 -- 172.21.15.87:0/2359758341 >> 172.21.15.87:0/2359758341 conn(0x7fae500fa3f0 msgr2=0x7fae50101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:41.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.762+0000 7fae56672640 1 -- 172.21.15.87:0/2359758341 shutdown_connections 2024-09-13T17:13:41.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.762+0000 7fae56672640 1 -- 172.21.15.87:0/2359758341 wait complete. 2024-09-13T17:13:41.774 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:13:41.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:41 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1933602506' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:13:41.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:41 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/484794277' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:13:41.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:41 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2436602479' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:13:41.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:41 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1933602506' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:13:41.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:41 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/484794277' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:13:41.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:41 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2436602479' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:13:41.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.875+0000 7f96204d0640 1 -- 172.21.15.87:0/1553879931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9618100f60 msgr2=0x7f96181013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:41.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.875+0000 7f96204d0640 1 --2- 172.21.15.87:0/1553879931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9618100f60 0x7f96181013e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9614009900 tx=0x7f961402a410 comp rx=0 tx=0).stop 2024-09-13T17:13:41.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.875+0000 7f96204d0640 1 -- 172.21.15.87:0/1553879931 shutdown_connections 2024-09-13T17:13:41.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.875+0000 7f96204d0640 1 --2- 172.21.15.87:0/1553879931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9618101920 0x7f96181081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:41.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.875+0000 7f96204d0640 1 --2- 172.21.15.87:0/1553879931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9618100f60 0x7f96181013e0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:41.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.875+0000 7f96204d0640 1 --2- 172.21.15.87:0/1553879931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96180ffd70 0x7f9618100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:41.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.875+0000 7f96204d0640 1 -- 172.21.15.87:0/1553879931 >> 172.21.15.87:0/1553879931 conn(0x7f96180fb4d0 msgr2=0x7f96180fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:41.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.875+0000 7f96204d0640 1 -- 172.21.15.87:0/1553879931 shutdown_connections 2024-09-13T17:13:41.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.875+0000 7f96204d0640 1 -- 172.21.15.87:0/1553879931 wait complete. 2024-09-13T17:13:41.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.875+0000 7f96204d0640 1 Processor -- start 2024-09-13T17:13:41.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.875+0000 7f96204d0640 1 -- start start 2024-09-13T17:13:41.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.876+0000 7f96204d0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96180ffd70 0x7f9618195cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:41.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.876+0000 7f96204d0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9618100f60 0x7f9618196230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:41.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.876+0000 7f96204d0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9618101920 0x7f961819d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:41.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.876+0000 7f96204d0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961819d7d0 con 0x7f9618100f60 2024-09-13T17:13:41.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.876+0000 7f96204d0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961819d940 con 0x7f9618101920 2024-09-13T17:13:41.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.876+0000 7f96204d0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961819db00 con 0x7f96180ffd70 2024-09-13T17:13:41.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.876+0000 7f961da6b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9618100f60 0x7f9618196230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:41.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.876+0000 7f961da6b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9618100f60 0x7f9618196230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39488/0 (socket says 172.21.15.87:39488) 2024-09-13T17:13:41.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.876+0000 7f961da6b640 1 -- 172.21.15.87:0/1345213274 learned_addr learned my addr 172.21.15.87:0/1345213274 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:41.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.876+0000 7f961e26c640 1 --2- 172.21.15.87:0/1345213274 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96180ffd70 0x7f9618195cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:41.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.876+0000 7f961ea6d640 1 --2- 172.21.15.87:0/1345213274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9618101920 0x7f961819d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:41.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.876+0000 7f961da6b640 1 -- 172.21.15.87:0/1345213274 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96180ffd70 msgr2=0x7f9618195cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:41.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.876+0000 7f961da6b640 1 --2- 172.21.15.87:0/1345213274 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96180ffd70 0x7f9618195cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:41.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.876+0000 7f961da6b640 1 -- 172.21.15.87:0/1345213274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9618101920 msgr2=0x7f961819d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:41.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.876+0000 7f961da6b640 1 --2- 172.21.15.87:0/1345213274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9618101920 0x7f961819d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:41.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.876+0000 7f961da6b640 1 -- 172.21.15.87:0/1345213274 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9614009560 con 0x7f9618100f60 2024-09-13T17:13:41.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.876+0000 7f961ea6d640 1 --2- 172.21.15.87:0/1345213274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9618101920 0x7f961819d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:41.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.876+0000 7f961da6b640 1 --2- 172.21.15.87:0/1345213274 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9618100f60 0x7f9618196230 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9614005940 tx=0x7f9614004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:41.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.876+0000 7f960f7fe640 1 -- 172.21.15.87:0/1345213274 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9614003800 con 0x7f9618100f60 2024-09-13T17:13:41.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.876+0000 7f960f7fe640 1 -- 172.21.15.87:0/1345213274 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9614003e10 con 0x7f9618100f60 2024-09-13T17:13:41.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.876+0000 7f96204d0640 1 -- 172.21.15.87:0/1345213274 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f961819dd80 con 0x7f9618100f60 2024-09-13T17:13:41.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.876+0000 7f960f7fe640 1 -- 172.21.15.87:0/1345213274 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961403b3d0 con 0x7f9618100f60 2024-09-13T17:13:41.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.877+0000 7f96204d0640 1 -- 172.21.15.87:0/1345213274 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f961819e180 con 0x7f9618100f60 2024-09-13T17:13:41.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.877+0000 7f96204d0640 1 -- 172.21.15.87:0/1345213274 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96181072a0 con 0x7f9618100f60 2024-09-13T17:13:41.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.878+0000 7f960f7fe640 1 -- 172.21.15.87:0/1345213274 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f961403c470 con 0x7f9618100f60 2024-09-13T17:13:41.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.879+0000 7f960f7fe640 1 --2- 172.21.15.87:0/1345213274 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f96040a1090 0x7f96040a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:41.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.879+0000 7f961e26c640 1 --2- 172.21.15.87:0/1345213274 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f96040a1090 0x7f96040a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:41.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.879+0000 7f960f7fe640 1 -- 172.21.15.87:0/1345213274 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f96140edbd0 con 0x7f9618100f60 2024-09-13T17:13:41.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.880+0000 7f961e26c640 1 --2- 172.21.15.87:0/1345213274 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f96040a1090 0x7f96040a3550 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f96181971c0 tx=0x7f9608005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:41.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:41.883+0000 7f960f7fe640 1 -- 172.21.15.87:0/1345213274 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f96140b6f00 con 0x7f9618100f60 2024-09-13T17:13:42.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.046+0000 7f96204d0640 1 -- 172.21.15.87:0/1345213274 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f961802c480 con 0x7f9618100f60 2024-09-13T17:13:42.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.046+0000 7f960f7fe640 1 -- 172.21.15.87:0/1345213274 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) v1 ==== 104+0+11 (secure 0 0 0) 0x7f961404a020 con 0x7f9618100f60 2024-09-13T17:13:42.047 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-09-13T17:13:42.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.048+0000 7f96204d0640 1 -- 172.21.15.87:0/1345213274 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f96040a1090 msgr2=0x7f96040a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.048+0000 7f96204d0640 1 --2- 172.21.15.87:0/1345213274 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f96040a1090 0x7f96040a3550 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f96181971c0 tx=0x7f9608005f90 comp rx=0 tx=0).stop 2024-09-13T17:13:42.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.048+0000 7f96204d0640 1 -- 172.21.15.87:0/1345213274 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9618100f60 msgr2=0x7f9618196230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.048+0000 7f96204d0640 1 --2- 172.21.15.87:0/1345213274 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9618100f60 0x7f9618196230 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9614005940 tx=0x7f9614004430 comp rx=0 tx=0).stop 2024-09-13T17:13:42.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.048+0000 7f96204d0640 1 -- 172.21.15.87:0/1345213274 shutdown_connections 2024-09-13T17:13:42.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.048+0000 7f96204d0640 1 --2- 172.21.15.87:0/1345213274 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f96040a1090 0x7f96040a3550 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.048+0000 7f96204d0640 1 --2- 172.21.15.87:0/1345213274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9618101920 0x7f961819d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.048+0000 7f96204d0640 1 --2- 172.21.15.87:0/1345213274 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9618100f60 0x7f9618196230 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.048+0000 7f96204d0640 1 --2- 172.21.15.87:0/1345213274 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96180ffd70 0x7f9618195cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.048+0000 7f96204d0640 1 -- 172.21.15.87:0/1345213274 >> 172.21.15.87:0/1345213274 conn(0x7f96180fb4d0 msgr2=0x7f9618104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:42.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.048+0000 7f96204d0640 1 -- 172.21.15.87:0/1345213274 shutdown_connections 2024-09-13T17:13:42.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.048+0000 7f96204d0640 1 -- 172.21.15.87:0/1345213274 wait complete. 2024-09-13T17:13:42.060 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:13:42.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.161+0000 7f09d5701640 1 -- 172.21.15.87:0/2671953632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09d00fdde0 msgr2=0x7f09d00fe260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.161+0000 7f09d5701640 1 --2- 172.21.15.87:0/2671953632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09d00fdde0 0x7f09d00fe260 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f09b8009900 tx=0x7f09b802a410 comp rx=0 tx=0).stop 2024-09-13T17:13:42.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.162+0000 7f09d5701640 1 -- 172.21.15.87:0/2671953632 shutdown_connections 2024-09-13T17:13:42.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.162+0000 7f09d5701640 1 --2- 172.21.15.87:0/2671953632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09d00fe7a0 0x7f09d0108350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.162+0000 7f09d5701640 1 --2- 172.21.15.87:0/2671953632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09d00fdde0 0x7f09d00fe260 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.162+0000 7f09d5701640 1 --2- 172.21.15.87:0/2671953632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09d0101370 0x7f09d0101770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.162+0000 7f09d5701640 1 -- 172.21.15.87:0/2671953632 >> 172.21.15.87:0/2671953632 conn(0x7f09d00f9b70 msgr2=0x7f09d00fbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:42.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.162+0000 7f09d5701640 1 -- 172.21.15.87:0/2671953632 shutdown_connections 2024-09-13T17:13:42.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.162+0000 7f09d5701640 1 -- 172.21.15.87:0/2671953632 wait complete. 2024-09-13T17:13:42.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.162+0000 7f09d5701640 1 Processor -- start 2024-09-13T17:13:42.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.162+0000 7f09d5701640 1 -- start start 2024-09-13T17:13:42.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.162+0000 7f09d5701640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09d00fdde0 0x7f09d0195e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:42.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.162+0000 7f09d5701640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09d00fe7a0 0x7f09d0196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:42.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.162+0000 7f09d5701640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09d0101370 0x7f09d019d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:42.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.162+0000 7f09d5701640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d019d920 con 0x7f09d00fdde0 2024-09-13T17:13:42.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.162+0000 7f09d5701640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d019da90 con 0x7f09d00fe7a0 2024-09-13T17:13:42.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.162+0000 7f09d5701640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d019dc50 con 0x7f09d0101370 2024-09-13T17:13:42.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.162+0000 7f09ceffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09d00fdde0 0x7f09d0195e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:42.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.162+0000 7f09ceffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09d00fdde0 0x7f09d0195e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39510/0 (socket says 172.21.15.87:39510) 2024-09-13T17:13:42.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.162+0000 7f09ceffd640 1 -- 172.21.15.87:0/3572273372 learned_addr learned my addr 172.21.15.87:0/3572273372 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:42.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.163+0000 7f09c7fff640 1 --2- 172.21.15.87:0/3572273372 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09d00fe7a0 0x7f09d0196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:42.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.163+0000 7f09cf7fe640 1 --2- 172.21.15.87:0/3572273372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09d0101370 0x7f09d019d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:42.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.163+0000 7f09ceffd640 1 -- 172.21.15.87:0/3572273372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09d0101370 msgr2=0x7f09d019d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.163+0000 7f09ceffd640 1 --2- 172.21.15.87:0/3572273372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09d0101370 0x7f09d019d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.163+0000 7f09ceffd640 1 -- 172.21.15.87:0/3572273372 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09d00fe7a0 msgr2=0x7f09d0196370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.163+0000 7f09ceffd640 1 --2- 172.21.15.87:0/3572273372 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09d00fe7a0 0x7f09d0196370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.163+0000 7f09ceffd640 1 -- 172.21.15.87:0/3572273372 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b8009560 con 0x7f09d00fdde0 2024-09-13T17:13:42.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.163+0000 7f09c7fff640 1 --2- 172.21.15.87:0/3572273372 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09d00fe7a0 0x7f09d0196370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:42.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.163+0000 7f09ceffd640 1 --2- 172.21.15.87:0/3572273372 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09d00fdde0 0x7f09d0195e30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f09c000b450 tx=0x7f09c000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:42.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.163+0000 7f09ccff9640 1 -- 172.21.15.87:0/3572273372 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c0011890 con 0x7f09d00fdde0 2024-09-13T17:13:42.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.163+0000 7f09ccff9640 1 -- 172.21.15.87:0/3572273372 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f09c00103e0 con 0x7f09d00fdde0 2024-09-13T17:13:42.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.163+0000 7f09ccff9640 1 -- 172.21.15.87:0/3572273372 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c0011ea0 con 0x7f09d00fdde0 2024-09-13T17:13:42.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.163+0000 7f09d5701640 1 -- 172.21.15.87:0/3572273372 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d019df30 con 0x7f09d00fdde0 2024-09-13T17:13:42.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.163+0000 7f09d5701640 1 -- 172.21.15.87:0/3572273372 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09d019e300 con 0x7f09d00fdde0 2024-09-13T17:13:42.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.164+0000 7f09d5701640 1 -- 172.21.15.87:0/3572273372 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09d0107440 con 0x7f09d00fdde0 2024-09-13T17:13:42.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.165+0000 7f09ccff9640 1 -- 172.21.15.87:0/3572273372 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f09c0010550 con 0x7f09d00fdde0 2024-09-13T17:13:42.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.166+0000 7f09ccff9640 1 --2- 172.21.15.87:0/3572273372 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f09bc0a1110 0x7f09bc0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:42.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.166+0000 7f09c7fff640 1 --2- 172.21.15.87:0/3572273372 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f09bc0a1110 0x7f09bc0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:42.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.166+0000 7f09ccff9640 1 -- 172.21.15.87:0/3572273372 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f09c00ccb10 con 0x7f09d00fdde0 2024-09-13T17:13:42.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.167+0000 7f09c7fff640 1 --2- 172.21.15.87:0/3572273372 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f09bc0a1110 0x7f09bc0a35d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f09b8006010 tx=0x7f09b8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:42.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.170+0000 7f09ccff9640 1 -- 172.21.15.87:0/3572273372 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f09c0095ed0 con 0x7f09d00fdde0 2024-09-13T17:13:42.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.332+0000 7f09d5701640 1 -- 172.21.15.87:0/3572273372 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f09d002c4b0 con 0x7f09d00fdde0 2024-09-13T17:13:42.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.332+0000 7f09ccff9640 1 -- 172.21.15.87:0/3572273372 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) v1 ==== 100+0+11 (secure 0 0 0) 0x7f09c00150a0 con 0x7f09d00fdde0 2024-09-13T17:13:42.334 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-09-13T17:13:42.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.334+0000 7f09d5701640 1 -- 172.21.15.87:0/3572273372 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f09bc0a1110 msgr2=0x7f09bc0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.334+0000 7f09d5701640 1 --2- 172.21.15.87:0/3572273372 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f09bc0a1110 0x7f09bc0a35d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f09b8006010 tx=0x7f09b8005a20 comp rx=0 tx=0).stop 2024-09-13T17:13:42.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.334+0000 7f09d5701640 1 -- 172.21.15.87:0/3572273372 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09d00fdde0 msgr2=0x7f09d0195e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.334+0000 7f09d5701640 1 --2- 172.21.15.87:0/3572273372 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09d00fdde0 0x7f09d0195e30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f09c000b450 tx=0x7f09c000b910 comp rx=0 tx=0).stop 2024-09-13T17:13:42.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.334+0000 7f09d5701640 1 -- 172.21.15.87:0/3572273372 shutdown_connections 2024-09-13T17:13:42.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.334+0000 7f09d5701640 1 --2- 172.21.15.87:0/3572273372 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f09bc0a1110 0x7f09bc0a35d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.334+0000 7f09d5701640 1 --2- 172.21.15.87:0/3572273372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09d0101370 0x7f09d019d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.334+0000 7f09d5701640 1 --2- 172.21.15.87:0/3572273372 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09d00fe7a0 0x7f09d0196370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.334+0000 7f09d5701640 1 --2- 172.21.15.87:0/3572273372 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09d00fdde0 0x7f09d0195e30 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.334+0000 7f09d5701640 1 -- 172.21.15.87:0/3572273372 >> 172.21.15.87:0/3572273372 conn(0x7f09d00f9b70 msgr2=0x7f09d0104610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:42.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.334+0000 7f09d5701640 1 -- 172.21.15.87:0/3572273372 shutdown_connections 2024-09-13T17:13:42.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.334+0000 7f09d5701640 1 -- 172.21.15.87:0/3572273372 wait complete. 2024-09-13T17:13:42.346 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:13:42.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.448+0000 7f572a9bc640 1 -- 172.21.15.87:0/2454414612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5724100840 msgr2=0x7f5724102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.448+0000 7f572a9bc640 1 --2- 172.21.15.87:0/2454414612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5724100840 0x7f5724102c30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5714009900 tx=0x7f571402a410 comp rx=0 tx=0).stop 2024-09-13T17:13:42.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.448+0000 7f572a9bc640 1 -- 172.21.15.87:0/2454414612 shutdown_connections 2024-09-13T17:13:42.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.448+0000 7f572a9bc640 1 --2- 172.21.15.87:0/2454414612 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5724105aa0 0x7f5724107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.448+0000 7f572a9bc640 1 --2- 172.21.15.87:0/2454414612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5724103170 0x7f5724105560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.448+0000 7f572a9bc640 1 --2- 172.21.15.87:0/2454414612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5724100840 0x7f5724102c30 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.448+0000 7f572a9bc640 1 -- 172.21.15.87:0/2454414612 >> 172.21.15.87:0/2454414612 conn(0x7f57240fa3e0 msgr2=0x7f57240fc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:42.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.448+0000 7f572a9bc640 1 -- 172.21.15.87:0/2454414612 shutdown_connections 2024-09-13T17:13:42.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.448+0000 7f572a9bc640 1 -- 172.21.15.87:0/2454414612 wait complete. 2024-09-13T17:13:42.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.448+0000 7f572a9bc640 1 Processor -- start 2024-09-13T17:13:42.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.448+0000 7f572a9bc640 1 -- start start 2024-09-13T17:13:42.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.448+0000 7f572a9bc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5724100840 0x7f5724195e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:42.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.448+0000 7f572a9bc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5724103170 0x7f57241963c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:42.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.448+0000 7f572a9bc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5724105aa0 0x7f572419d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:42.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.448+0000 7f572a9bc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572419d920 con 0x7f5724103170 2024-09-13T17:13:42.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.448+0000 7f572a9bc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572419da90 con 0x7f5724105aa0 2024-09-13T17:13:42.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.448+0000 7f572a9bc640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572419dc50 con 0x7f5724100840 2024-09-13T17:13:42.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.448+0000 7f571bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5724103170 0x7f57241963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:42.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.449+0000 7f571bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5724103170 0x7f57241963c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39520/0 (socket says 172.21.15.87:39520) 2024-09-13T17:13:42.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.449+0000 7f571bfff640 1 -- 172.21.15.87:0/2649493884 learned_addr learned my addr 172.21.15.87:0/2649493884 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:42.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.449+0000 7f5723fff640 1 --2- 172.21.15.87:0/2649493884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5724100840 0x7f5724195e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:42.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.449+0000 7f5728f59640 1 --2- 172.21.15.87:0/2649493884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5724105aa0 0x7f572419d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:42.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.449+0000 7f571bfff640 1 -- 172.21.15.87:0/2649493884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5724100840 msgr2=0x7f5724195e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.449+0000 7f571bfff640 1 --2- 172.21.15.87:0/2649493884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5724100840 0x7f5724195e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.449+0000 7f571bfff640 1 -- 172.21.15.87:0/2649493884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5724105aa0 msgr2=0x7f572419d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.449+0000 7f571bfff640 1 --2- 172.21.15.87:0/2649493884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5724105aa0 0x7f572419d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.449+0000 7f571bfff640 1 -- 172.21.15.87:0/2649493884 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5714009560 con 0x7f5724103170 2024-09-13T17:13:42.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.449+0000 7f571bfff640 1 --2- 172.21.15.87:0/2649493884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5724103170 0x7f57241963c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f570c00d740 tx=0x7f570c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:42.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.449+0000 7f5721ffb640 1 -- 172.21.15.87:0/2649493884 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c009c30 con 0x7f5724103170 2024-09-13T17:13:42.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.449+0000 7f5721ffb640 1 -- 172.21.15.87:0/2649493884 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f570c00de50 con 0x7f5724103170 2024-09-13T17:13:42.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.449+0000 7f572a9bc640 1 -- 172.21.15.87:0/2649493884 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f572419df30 con 0x7f5724103170 2024-09-13T17:13:42.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.449+0000 7f5721ffb640 1 -- 172.21.15.87:0/2649493884 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c004e40 con 0x7f5724103170 2024-09-13T17:13:42.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.449+0000 7f572a9bc640 1 -- 172.21.15.87:0/2649493884 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f572419e360 con 0x7f5724103170 2024-09-13T17:13:42.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.450+0000 7f572a9bc640 1 -- 172.21.15.87:0/2649493884 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57240fbed0 con 0x7f5724103170 2024-09-13T17:13:42.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.451+0000 7f5721ffb640 1 -- 172.21.15.87:0/2649493884 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f570c004fa0 con 0x7f5724103170 2024-09-13T17:13:42.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.452+0000 7f5721ffb640 1 --2- 172.21.15.87:0/2649493884 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f57100a1090 0x7f57100a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:42.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.452+0000 7f5723fff640 1 --2- 172.21.15.87:0/2649493884 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f57100a1090 0x7f57100a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:42.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.452+0000 7f5721ffb640 1 -- 172.21.15.87:0/2649493884 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f570c0cc5c0 con 0x7f5724103170 2024-09-13T17:13:42.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.452+0000 7f5723fff640 1 --2- 172.21.15.87:0/2649493884 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f57100a1090 0x7f57100a3550 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5714005ab0 tx=0x7f5714005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:42.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.456+0000 7f5721ffb640 1 -- 172.21.15.87:0/2649493884 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f570c0994c0 con 0x7f5724103170 2024-09-13T17:13:42.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.617+0000 7f572a9bc640 1 -- 172.21.15.87:0/2649493884 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f572402c410 con 0x7f5724103170 2024-09-13T17:13:42.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.617+0000 7f5721ffb640 1 -- 172.21.15.87:0/2649493884 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v93) v1 ==== 103+0+11 (secure 0 0 0) 0x7f570c099050 con 0x7f5724103170 2024-09-13T17:13:42.618 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-09-13T17:13:42.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.619+0000 7f572a9bc640 1 -- 172.21.15.87:0/2649493884 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f57100a1090 msgr2=0x7f57100a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.619+0000 7f572a9bc640 1 --2- 172.21.15.87:0/2649493884 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f57100a1090 0x7f57100a3550 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5714005ab0 tx=0x7f5714005a20 comp rx=0 tx=0).stop 2024-09-13T17:13:42.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.619+0000 7f572a9bc640 1 -- 172.21.15.87:0/2649493884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5724103170 msgr2=0x7f57241963c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.619+0000 7f572a9bc640 1 --2- 172.21.15.87:0/2649493884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5724103170 0x7f57241963c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f570c00d740 tx=0x7f570c00dc00 comp rx=0 tx=0).stop 2024-09-13T17:13:42.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.619+0000 7f572a9bc640 1 -- 172.21.15.87:0/2649493884 shutdown_connections 2024-09-13T17:13:42.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.619+0000 7f572a9bc640 1 --2- 172.21.15.87:0/2649493884 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f57100a1090 0x7f57100a3550 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.619+0000 7f572a9bc640 1 --2- 172.21.15.87:0/2649493884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5724105aa0 0x7f572419d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.619+0000 7f572a9bc640 1 --2- 172.21.15.87:0/2649493884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5724103170 0x7f57241963c0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.619+0000 7f572a9bc640 1 --2- 172.21.15.87:0/2649493884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5724100840 0x7f5724195e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.619+0000 7f572a9bc640 1 -- 172.21.15.87:0/2649493884 >> 172.21.15.87:0/2649493884 conn(0x7f57240fa3e0 msgr2=0x7f5724101220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:42.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.619+0000 7f572a9bc640 1 -- 172.21.15.87:0/2649493884 shutdown_connections 2024-09-13T17:13:42.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.619+0000 7f572a9bc640 1 -- 172.21.15.87:0/2649493884 wait complete. 2024-09-13T17:13:42.629 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:42 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2920560509' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:13:42.630 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:42 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2359758341' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:13:42.630 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:42 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1345213274' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:13:42.630 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:42 smithi087 ceph-mon[30934]: pgmap v350: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T17:13:42.630 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:42 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3572273372' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:13:42.631 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:13:42.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.727+0000 7f2632041640 1 -- 172.21.15.87:0/1974051483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f262c0feca0 msgr2=0x7f262c0ff0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.727+0000 7f2632041640 1 --2- 172.21.15.87:0/1974051483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f262c0feca0 0x7f262c0ff0a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f261c009900 tx=0x7f261c02a410 comp rx=0 tx=0).stop 2024-09-13T17:13:42.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.727+0000 7f2632041640 1 -- 172.21.15.87:0/1974051483 shutdown_connections 2024-09-13T17:13:42.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.727+0000 7f2632041640 1 --2- 172.21.15.87:0/1974051483 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f262c100850 0x7f262c1070e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.727+0000 7f2632041640 1 --2- 172.21.15.87:0/1974051483 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f262c0ffe90 0x7f262c100310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.727+0000 7f2632041640 1 --2- 172.21.15.87:0/1974051483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f262c0feca0 0x7f262c0ff0a0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.727+0000 7f2632041640 1 -- 172.21.15.87:0/1974051483 >> 172.21.15.87:0/1974051483 conn(0x7f262c0fa440 msgr2=0x7f262c0fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:42.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.727+0000 7f2632041640 1 -- 172.21.15.87:0/1974051483 shutdown_connections 2024-09-13T17:13:42.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.727+0000 7f2632041640 1 -- 172.21.15.87:0/1974051483 wait complete. 2024-09-13T17:13:42.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.727+0000 7f2632041640 1 Processor -- start 2024-09-13T17:13:42.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.727+0000 7f2632041640 1 -- start start 2024-09-13T17:13:42.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.728+0000 7f2632041640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f262c0feca0 0x7f262c194c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:42.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.728+0000 7f2632041640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f262c0ffe90 0x7f262c1951d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:42.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.728+0000 7f2632041640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f262c100850 0x7f262c19c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:42.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.728+0000 7f2632041640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262c19c7a0 con 0x7f262c0feca0 2024-09-13T17:13:42.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.728+0000 7f2632041640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262c19c910 con 0x7f262c100850 2024-09-13T17:13:42.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.728+0000 7f2632041640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262c19cad0 con 0x7f262c0ffe90 2024-09-13T17:13:42.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.728+0000 7f262b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f262c0feca0 0x7f262c194c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:42.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.728+0000 7f262b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f262c0feca0 0x7f262c194c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39550/0 (socket says 172.21.15.87:39550) 2024-09-13T17:13:42.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.728+0000 7f262b7fe640 1 -- 172.21.15.87:0/2761116226 learned_addr learned my addr 172.21.15.87:0/2761116226 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:42.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.728+0000 7f2623fff640 1 --2- 172.21.15.87:0/2761116226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f262c0ffe90 0x7f262c1951d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:42.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.728+0000 7f262bfff640 1 --2- 172.21.15.87:0/2761116226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f262c100850 0x7f262c19c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:42.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.728+0000 7f262b7fe640 1 -- 172.21.15.87:0/2761116226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f262c0ffe90 msgr2=0x7f262c1951d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.728+0000 7f262b7fe640 1 --2- 172.21.15.87:0/2761116226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f262c0ffe90 0x7f262c1951d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.728+0000 7f262b7fe640 1 -- 172.21.15.87:0/2761116226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f262c100850 msgr2=0x7f262c19c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.728+0000 7f262b7fe640 1 --2- 172.21.15.87:0/2761116226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f262c100850 0x7f262c19c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.728+0000 7f262b7fe640 1 -- 172.21.15.87:0/2761116226 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c009560 con 0x7f262c0feca0 2024-09-13T17:13:42.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.728+0000 7f262bfff640 1 --2- 172.21.15.87:0/2761116226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f262c100850 0x7f262c19c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:42.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.728+0000 7f262b7fe640 1 --2- 172.21.15.87:0/2761116226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f262c0feca0 0x7f262c194c90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f261c031460 tx=0x7f261c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:42.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.728+0000 7f26297fa640 1 -- 172.21.15.87:0/2761116226 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c003800 con 0x7f262c0feca0 2024-09-13T17:13:42.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.728+0000 7f26297fa640 1 -- 172.21.15.87:0/2761116226 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f261c003e10 con 0x7f262c0feca0 2024-09-13T17:13:42.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.728+0000 7f26297fa640 1 -- 172.21.15.87:0/2761116226 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c03b3d0 con 0x7f262c0feca0 2024-09-13T17:13:42.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.728+0000 7f2632041640 1 -- 172.21.15.87:0/2761116226 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f262c19cd50 con 0x7f262c0feca0 2024-09-13T17:13:42.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.728+0000 7f2632041640 1 -- 172.21.15.87:0/2761116226 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f262c19d1b0 con 0x7f262c0feca0 2024-09-13T17:13:42.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.730+0000 7f2632041640 1 -- 172.21.15.87:0/2761116226 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f262c1061c0 con 0x7f262c0feca0 2024-09-13T17:13:42.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.731+0000 7f26297fa640 1 -- 172.21.15.87:0/2761116226 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f261c03c470 con 0x7f262c0feca0 2024-09-13T17:13:42.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.732+0000 7f26297fa640 1 --2- 172.21.15.87:0/2761116226 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f26180a1090 0x7f26180a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:42.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.732+0000 7f2623fff640 1 --2- 172.21.15.87:0/2761116226 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f26180a1090 0x7f26180a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:42.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.732+0000 7f26297fa640 1 -- 172.21.15.87:0/2761116226 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f261c0edf90 con 0x7f262c0feca0 2024-09-13T17:13:42.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.732+0000 7f2623fff640 1 --2- 172.21.15.87:0/2761116226 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f26180a1090 0x7f26180a3550 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f262c196190 tx=0x7f261400a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:42.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.735+0000 7f26297fa640 1 -- 172.21.15.87:0/2761116226 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f261c0b7350 con 0x7f262c0feca0 2024-09-13T17:13:42.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:42 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2920560509' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:13:42.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:42 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2359758341' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:13:42.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:42 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1345213274' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:13:42.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:42 smithi149 ceph-mon[35496]: pgmap v350: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T17:13:42.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:42 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3572273372' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:13:42.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:42 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2920560509' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:13:42.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:42 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2359758341' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:13:42.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:42 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1345213274' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:13:42.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:42 smithi118 ceph-mon[34374]: pgmap v350: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-13T17:13:42.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:42 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3572273372' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:13:42.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.931+0000 7f2632041640 1 -- 172.21.15.87:0/2761116226 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f262c10a590 con 0x7f262c0feca0 2024-09-13T17:13:42.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.932+0000 7f26297fa640 1 -- 172.21.15.87:0/2761116226 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10877 (secure 0 0 0) 0x7f261c04a090 con 0x7f262c0feca0 2024-09-13T17:13:42.933 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:13:42.933 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/3674545180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":3674545180},{"type":"v1","addr":"172.21.15.87:6841","nonce":3674545180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:11:23.313609+0000","modified":"2024-09-13T17:11:47.780404+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24484,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6839/3052680456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3052680456},{"type":"v1","addr":"172.21.15.118:6839","nonce":3052680456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:13:42.933 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 23 2024-09-13T17:13:42.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.934+0000 7f2632041640 1 -- 172.21.15.87:0/2761116226 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f26180a1090 msgr2=0x7f26180a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.934+0000 7f2632041640 1 --2- 172.21.15.87:0/2761116226 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f26180a1090 0x7f26180a3550 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f262c196190 tx=0x7f261400a4c0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.934+0000 7f2632041640 1 -- 172.21.15.87:0/2761116226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f262c0feca0 msgr2=0x7f262c194c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:42.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.934+0000 7f2632041640 1 --2- 172.21.15.87:0/2761116226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f262c0feca0 0x7f262c194c90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f261c031460 tx=0x7f261c004430 comp rx=0 tx=0).stop 2024-09-13T17:13:42.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.934+0000 7f2632041640 1 -- 172.21.15.87:0/2761116226 shutdown_connections 2024-09-13T17:13:42.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.934+0000 7f2632041640 1 --2- 172.21.15.87:0/2761116226 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f26180a1090 0x7f26180a3550 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.934+0000 7f2632041640 1 --2- 172.21.15.87:0/2761116226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f262c100850 0x7f262c19c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.934+0000 7f2632041640 1 --2- 172.21.15.87:0/2761116226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f262c0ffe90 0x7f262c1951d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.934+0000 7f2632041640 1 --2- 172.21.15.87:0/2761116226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f262c0feca0 0x7f262c194c90 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:42.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.934+0000 7f2632041640 1 -- 172.21.15.87:0/2761116226 >> 172.21.15.87:0/2761116226 conn(0x7f262c0fa440 msgr2=0x7f262c103390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:42.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.934+0000 7f2632041640 1 -- 172.21.15.87:0/2761116226 shutdown_connections 2024-09-13T17:13:42.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:42.934+0000 7f2632041640 1 -- 172.21.15.87:0/2761116226 wait complete. 2024-09-13T17:13:42.946 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:13:43.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.042+0000 7fca6fcaa640 1 -- 172.21.15.87:0/887952901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca68105ab0 msgr2=0x7fca68107f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.042+0000 7fca6fcaa640 1 --2- 172.21.15.87:0/887952901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca68105ab0 0x7fca68107f20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fca60009ca0 tx=0x7fca6002a8c0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.042+0000 7fca6fcaa640 1 -- 172.21.15.87:0/887952901 shutdown_connections 2024-09-13T17:13:43.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.042+0000 7fca6fcaa640 1 --2- 172.21.15.87:0/887952901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca68105ab0 0x7fca68107f20 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.042+0000 7fca6fcaa640 1 --2- 172.21.15.87:0/887952901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca68103180 0x7fca68105570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.042+0000 7fca6fcaa640 1 --2- 172.21.15.87:0/887952901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca68100850 0x7fca68102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.042+0000 7fca6fcaa640 1 -- 172.21.15.87:0/887952901 >> 172.21.15.87:0/887952901 conn(0x7fca680fa430 msgr2=0x7fca680fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:43.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.042+0000 7fca6fcaa640 1 -- 172.21.15.87:0/887952901 shutdown_connections 2024-09-13T17:13:43.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.042+0000 7fca6fcaa640 1 -- 172.21.15.87:0/887952901 wait complete. 2024-09-13T17:13:43.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.043+0000 7fca6fcaa640 1 Processor -- start 2024-09-13T17:13:43.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.043+0000 7fca6fcaa640 1 -- start start 2024-09-13T17:13:43.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.043+0000 7fca6fcaa640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca68100850 0x7fca68195d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.043+0000 7fca6fcaa640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca68103180 0x7fca68196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.043+0000 7fca6fcaa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca68105ab0 0x7fca6819d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.043+0000 7fca6fcaa640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6819d840 con 0x7fca68105ab0 2024-09-13T17:13:43.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.043+0000 7fca6fcaa640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6819d9b0 con 0x7fca68103180 2024-09-13T17:13:43.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.043+0000 7fca6fcaa640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6819db70 con 0x7fca68100850 2024-09-13T17:13:43.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.043+0000 7fca6e247640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca68105ab0 0x7fca6819d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.043+0000 7fca6e247640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca68105ab0 0x7fca6819d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39566/0 (socket says 172.21.15.87:39566) 2024-09-13T17:13:43.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.043+0000 7fca6e247640 1 -- 172.21.15.87:0/688241689 learned_addr learned my addr 172.21.15.87:0/688241689 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:43.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.043+0000 7fca6d245640 1 --2- 172.21.15.87:0/688241689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca68103180 0x7fca68196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.043+0000 7fca6da46640 1 --2- 172.21.15.87:0/688241689 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca68100850 0x7fca68195d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.044+0000 7fca6e247640 1 -- 172.21.15.87:0/688241689 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca68100850 msgr2=0x7fca68195d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.044+0000 7fca6e247640 1 --2- 172.21.15.87:0/688241689 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca68100850 0x7fca68195d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.044+0000 7fca6e247640 1 -- 172.21.15.87:0/688241689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca68103180 msgr2=0x7fca68196290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.044+0000 7fca6e247640 1 --2- 172.21.15.87:0/688241689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca68103180 0x7fca68196290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.044+0000 7fca6e247640 1 -- 172.21.15.87:0/688241689 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca60009900 con 0x7fca68105ab0 2024-09-13T17:13:43.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.044+0000 7fca6e247640 1 --2- 172.21.15.87:0/688241689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca68105ab0 0x7fca6819d300 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fca6002aeb0 tx=0x7fca60031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:43.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.044+0000 7fca5effd640 1 -- 172.21.15.87:0/688241689 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6002f310 con 0x7fca68105ab0 2024-09-13T17:13:43.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.044+0000 7fca5effd640 1 -- 172.21.15.87:0/688241689 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fca60040070 con 0x7fca68105ab0 2024-09-13T17:13:43.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.044+0000 7fca6fcaa640 1 -- 172.21.15.87:0/688241689 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca6819ddf0 con 0x7fca68105ab0 2024-09-13T17:13:43.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.044+0000 7fca5effd640 1 -- 172.21.15.87:0/688241689 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca600044a0 con 0x7fca68105ab0 2024-09-13T17:13:43.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.044+0000 7fca6fcaa640 1 -- 172.21.15.87:0/688241689 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca6819e270 con 0x7fca68105ab0 2024-09-13T17:13:43.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.045+0000 7fca6fcaa640 1 -- 172.21.15.87:0/688241689 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca680fbf20 con 0x7fca68105ab0 2024-09-13T17:13:43.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.047+0000 7fca5effd640 1 -- 172.21.15.87:0/688241689 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fca60042030 con 0x7fca68105ab0 2024-09-13T17:13:43.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.047+0000 7fca5effd640 1 --2- 172.21.15.87:0/688241689 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fca540a1090 0x7fca540a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.047+0000 7fca6da46640 1 --2- 172.21.15.87:0/688241689 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fca540a1090 0x7fca540a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.047+0000 7fca5effd640 1 -- 172.21.15.87:0/688241689 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7fca600ee610 con 0x7fca68105ab0 2024-09-13T17:13:43.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.048+0000 7fca6da46640 1 --2- 172.21.15.87:0/688241689 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fca540a1090 0x7fca540a3550 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fca64005d00 tx=0x7fca6400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:43.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.050+0000 7fca5effd640 1 -- 172.21.15.87:0/688241689 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fca600b79d0 con 0x7fca68105ab0 2024-09-13T17:13:43.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.212+0000 7fca6fcaa640 1 -- 172.21.15.87:0/688241689 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca6810b6b0 con 0x7fca68105ab0 2024-09-13T17:13:43.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.213+0000 7fca5effd640 1 -- 172.21.15.87:0/688241689 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+24817 (secure 0 0 0) 0x7fca600baff0 con 0x7fca68105ab0 2024-09-13T17:13:43.215 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:13:43.215 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":93,"fsid":"043d5bae-71f2-11ef-bceb-c7b262605968","created":"2024-09-13T17:03:57.852010+0000","modified":"2024-09-13T17:12:50.208429+0000","last_up_change":"2024-09-13T17:10:34.423548+0000","last_in_change":"2024-09-13T17:10:14.228123+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:07:02.286400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:11:21.965141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:11:22.504345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:11:25.565163+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58250283-85c0-416e-abdd-1fc5a7ff0c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6803","nonce":1316956138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6805","nonce":1316956138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6809","nonce":1316956138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6807","nonce":1316956138}]},"public_addr":"172.21.15.87:6803/1316956138","cluster_addr":"172.21.15.87:6805/1316956138","heartbeat_back_addr":"172.21.15.87:6809/1316956138","heartbeat_front_addr":"172.21.15.87:6807/1316956138","state":["exists","up"]},{"osd":1,"uuid":"b9d49969-94b1-4262-b4ff-db0a8e3331af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6801","nonce":3352566727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6803","nonce":3352566727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6807","nonce":3352566727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6805","nonce":3352566727}]},"public_addr":"172.21.15.118:6801/3352566727","cluster_addr":"172.21.15.118:6803/3352566727","heartbeat_back_addr":"172.21.15.118:6807/3352566727","heartbeat_front_addr":"172.21.15.118:6805/3352566727","state":["exists","up"]},{"osd":2,"uuid":"ba64549e-d736-426f-b466-f569af5f16d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6801","nonce":2774581686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6803","nonce":2774581686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6807","nonce":2774581686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6805","nonce":2774581686}]},"public_addr":"172.21.15.149:6801/2774581686","cluster_addr":"172.21.15.149:6803/2774581686","heartbeat_back_addr":"172.21.15.149:6807/2774581686","heartbeat_front_addr":"172.21.15.149:6805/2774581686","state":["exists","up"]},{"osd":3,"uuid":"3d5553e5-371b-49fd-976b-9e72a97a2f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6811","nonce":3306119066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6813","nonce":3306119066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6817","nonce":3306119066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6815","nonce":3306119066}]},"public_addr":"172.21.15.87:6811/3306119066","cluster_addr":"172.21.15.87:6813/3306119066","heartbeat_back_addr":"172.21.15.87:6817/3306119066","heartbeat_front_addr":"172.21.15.87:6815/3306119066","state":["exists","up"]},{"osd":4,"uuid":"2fbe0e27-34ec-42a6-9962-f1d8202b3159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6809","nonce":3342349890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6811","nonce":3342349890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6815","nonce":3342349890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6813","nonce":3342349890}]},"public_addr":"172.21.15.118:6809/3342349890","cluster_addr":"172.21.15.118:6811/3342349890","heartbeat_back_addr":"172.21.15.118:6815/3342349890","heartbeat_front_addr":"172.21.15.118:6813/3342349890","state":["exists","up"]},{"osd":5,"uuid":"53c14519-6170-4b5a-a79d-4835882d7bec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6809","nonce":3468867124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6811","nonce":3468867124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6815","nonce":3468867124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6813","nonce":3468867124}]},"public_addr":"172.21.15.149:6809/3468867124","cluster_addr":"172.21.15.149:6811/3468867124","heartbeat_back_addr":"172.21.15.149:6815/3468867124","heartbeat_front_addr":"172.21.15.149:6813/3468867124","state":["exists","up"]},{"osd":6,"uuid":"d3951b32-db77-4b8b-9de0-f05e03d13f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6819","nonce":326563617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6821","nonce":326563617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6825","nonce":326563617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6823","nonce":326563617}]},"public_addr":"172.21.15.87:6819/326563617","cluster_addr":"172.21.15.87:6821/326563617","heartbeat_back_addr":"172.21.15.87:6825/326563617","heartbeat_front_addr":"172.21.15.87:6823/326563617","state":["exists","up"]},{"osd":7,"uuid":"4d46dab7-a8bf-4e3e-b5c0-43860d336bdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6817","nonce":1690268990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6819","nonce":1690268990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6823","nonce":1690268990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6821","nonce":1690268990}]},"public_addr":"172.21.15.118:6817/1690268990","cluster_addr":"172.21.15.118:6819/1690268990","heartbeat_back_addr":"172.21.15.118:6823/1690268990","heartbeat_front_addr":"172.21.15.118:6821/1690268990","state":["exists","up"]},{"osd":8,"uuid":"5a015a7d-60a3-4412-96af-1b61d2ad51f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6817","nonce":1558675380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6819","nonce":1558675380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6823","nonce":1558675380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6821","nonce":1558675380}]},"public_addr":"172.21.15.149:6817/1558675380","cluster_addr":"172.21.15.149:6819/1558675380","heartbeat_back_addr":"172.21.15.149:6823/1558675380","heartbeat_front_addr":"172.21.15.149:6821/1558675380","state":["exists","up"]},{"osd":9,"uuid":"248c0b6e-4c4e-4c63-a0dd-e4cdf3b997a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6827","nonce":1453934262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6829","nonce":1453934262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6833","nonce":1453934262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6831","nonce":1453934262}]},"public_addr":"172.21.15.87:6827/1453934262","cluster_addr":"172.21.15.87:6829/1453934262","heartbeat_back_addr":"172.21.15.87:6833/1453934262","heartbeat_front_addr":"172.21.15.87:6831/1453934262","state":["exists","up"]},{"osd":10,"uuid":"24238714-e737-4371-b5d5-0cd3395f09bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6825","nonce":1034318850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6827","nonce":1034318850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6831","nonce":1034318850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6829","nonce":1034318850}]},"public_addr":"172.21.15.118:6825/1034318850","cluster_addr":"172.21.15.118:6827/1034318850","heartbeat_back_addr":"172.21.15.118:6831/1034318850","heartbeat_front_addr":"172.21.15.118:6829/1034318850","state":["exists","up"]},{"osd":11,"uuid":"409dd3bf-5154-4dea-8708-7de7f9e2e793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6825","nonce":271000465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6827","nonce":271000465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6831","nonce":271000465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6829","nonce":271000465}]},"public_addr":"172.21.15.149:6825/271000465","cluster_addr":"172.21.15.149:6827/271000465","heartbeat_back_addr":"172.21.15.149:6831/271000465","heartbeat_front_addr":"172.21.15.149:6829/271000465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:16.382664+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:37.914250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:00.425876+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:23.960183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:47.004088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:10.214345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:33.719221+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:57.099599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:20.971881+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:44.827167+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:08.135516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:32.085853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.d","mappings":[{"from":1,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8},{"from":5,"to":7}]},{"pgid":"3.28","mappings":[{"from":3,"to":6},{"from":5,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/586423689":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6801/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6800/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/3270371628":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/515676743":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/1475107314":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/553289143":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/3403361612":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6801/1587363880":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6800/1587363880":"2024-09-14T17:04:24.083789+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:13:43.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.215+0000 7fca6fcaa640 1 -- 172.21.15.87:0/688241689 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fca540a1090 msgr2=0x7fca540a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.215+0000 7fca6fcaa640 1 --2- 172.21.15.87:0/688241689 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fca540a1090 0x7fca540a3550 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fca64005d00 tx=0x7fca6400b410 comp rx=0 tx=0).stop 2024-09-13T17:13:43.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.215+0000 7fca6fcaa640 1 -- 172.21.15.87:0/688241689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca68105ab0 msgr2=0x7fca6819d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.215+0000 7fca6fcaa640 1 --2- 172.21.15.87:0/688241689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca68105ab0 0x7fca6819d300 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fca6002aeb0 tx=0x7fca60031700 comp rx=0 tx=0).stop 2024-09-13T17:13:43.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.215+0000 7fca6fcaa640 1 -- 172.21.15.87:0/688241689 shutdown_connections 2024-09-13T17:13:43.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.215+0000 7fca6fcaa640 1 --2- 172.21.15.87:0/688241689 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fca540a1090 0x7fca540a3550 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.215+0000 7fca6fcaa640 1 --2- 172.21.15.87:0/688241689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca68105ab0 0x7fca6819d300 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.215+0000 7fca6fcaa640 1 --2- 172.21.15.87:0/688241689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca68103180 0x7fca68196290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.215+0000 7fca6fcaa640 1 --2- 172.21.15.87:0/688241689 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca68100850 0x7fca68195d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.215+0000 7fca6fcaa640 1 -- 172.21.15.87:0/688241689 >> 172.21.15.87:0/688241689 conn(0x7fca680fa430 msgr2=0x7fca68101230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:43.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.215+0000 7fca6fcaa640 1 -- 172.21.15.87:0/688241689 shutdown_connections 2024-09-13T17:13:43.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.215+0000 7fca6fcaa640 1 -- 172.21.15.87:0/688241689 wait complete. 2024-09-13T17:13:43.228 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-13T17:11:23.313609+0000', 'modified': '2024-09-13T17:11:47.780404+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24499, 'mds_1': 24484, 'mds_2': 24472}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24427': {'gid': 24427, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.149:6833/3204144514', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6832', 'nonce': 3204144514}, {'type': 'v1', 'addr': '172.21.15.149:6833', 'nonce': 3204144514}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24446': {'gid': 24446, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.118:6837/923553321', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6836', 'nonce': 923553321}, {'type': 'v1', 'addr': '172.21.15.118:6837', 'nonce': 923553321}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24470': {'gid': 24470, 'name': 'b', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.118:6839/3052680456', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6838', 'nonce': 3052680456}, {'type': 'v1', 'addr': '172.21.15.118:6839', 'nonce': 3052680456}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24472': {'gid': 24472, 'name': 'f', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.149:6835/3814444081', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6834', 'nonce': 3814444081}, {'type': 'v1', 'addr': '172.21.15.149:6835', 'nonce': 3814444081}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24484': {'gid': 24484, 'name': 'c', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.149:6837/3893430053', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6836', 'nonce': 3893430053}, {'type': 'v1', 'addr': '172.21.15.149:6837', 'nonce': 3893430053}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24499': {'gid': 24499, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.149:6839/2938961956', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6838', 'nonce': 2938961956}, {'type': 'v1', 'addr': '172.21.15.149:6839', 'nonce': 2938961956}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T17:13:43.228 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-13T17:13:43.228 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-09-13T17:13:43.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.326+0000 7f0886a12640 1 -- 172.21.15.87:0/3637743427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0880100f80 msgr2=0x7f0880101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.326+0000 7f0886a12640 1 --2- 172.21.15.87:0/3637743427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0880100f80 0x7f0880101400 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0874009900 tx=0x7f087402a410 comp rx=0 tx=0).stop 2024-09-13T17:13:43.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.326+0000 7f0886a12640 1 -- 172.21.15.87:0/3637743427 shutdown_connections 2024-09-13T17:13:43.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.326+0000 7f0886a12640 1 --2- 172.21.15.87:0/3637743427 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0880101940 0x7f08801081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.326+0000 7f0886a12640 1 --2- 172.21.15.87:0/3637743427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0880100f80 0x7f0880101400 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.326+0000 7f0886a12640 1 --2- 172.21.15.87:0/3637743427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08800ffd90 0x7f0880100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.326+0000 7f0886a12640 1 -- 172.21.15.87:0/3637743427 >> 172.21.15.87:0/3637743427 conn(0x7f08800fb4d0 msgr2=0x7f08800fd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:43.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.326+0000 7f0886a12640 1 -- 172.21.15.87:0/3637743427 shutdown_connections 2024-09-13T17:13:43.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.326+0000 7f0886a12640 1 -- 172.21.15.87:0/3637743427 wait complete. 2024-09-13T17:13:43.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.327+0000 7f0886a12640 1 Processor -- start 2024-09-13T17:13:43.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.327+0000 7f0886a12640 1 -- start start 2024-09-13T17:13:43.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.327+0000 7f0886a12640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08800ffd90 0x7f0880197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.327+0000 7f0886a12640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0880100f80 0x7f08801984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.327+0000 7f0886a12640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0880101940 0x7f088019f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.327+0000 7f0886a12640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088019fa50 con 0x7f08800ffd90 2024-09-13T17:13:43.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.327+0000 7f0886a12640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088019fbc0 con 0x7f0880101940 2024-09-13T17:13:43.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.327+0000 7f0886a12640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088019fd80 con 0x7f0880100f80 2024-09-13T17:13:43.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.327+0000 7f087ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08800ffd90 0x7f0880197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.327+0000 7f087ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08800ffd90 0x7f0880197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39586/0 (socket says 172.21.15.87:39586) 2024-09-13T17:13:43.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.327+0000 7f087ffff640 1 -- 172.21.15.87:0/1813764501 learned_addr learned my addr 172.21.15.87:0/1813764501 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:43.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.328+0000 7f087f7fe640 1 --2- 172.21.15.87:0/1813764501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0880100f80 0x7f08801984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.328+0000 7f0884faf640 1 --2- 172.21.15.87:0/1813764501 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0880101940 0x7f088019f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.328+0000 7f087ffff640 1 -- 172.21.15.87:0/1813764501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0880100f80 msgr2=0x7f08801984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.328+0000 7f087ffff640 1 --2- 172.21.15.87:0/1813764501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0880100f80 0x7f08801984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.328+0000 7f087ffff640 1 -- 172.21.15.87:0/1813764501 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0880101940 msgr2=0x7f088019f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.328+0000 7f087ffff640 1 --2- 172.21.15.87:0/1813764501 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0880101940 0x7f088019f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.328+0000 7f087ffff640 1 -- 172.21.15.87:0/1813764501 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0874009560 con 0x7f08800ffd90 2024-09-13T17:13:43.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.328+0000 7f087ffff640 1 --2- 172.21.15.87:0/1813764501 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08800ffd90 0x7f0880197f60 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f087000c970 tx=0x7f087000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:43.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.328+0000 7f087d7fa640 1 -- 172.21.15.87:0/1813764501 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0870004220 con 0x7f08800ffd90 2024-09-13T17:13:43.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.328+0000 7f087d7fa640 1 -- 172.21.15.87:0/1813764501 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0870007e60 con 0x7f08800ffd90 2024-09-13T17:13:43.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.328+0000 7f0886a12640 1 -- 172.21.15.87:0/1813764501 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08801a0060 con 0x7f08800ffd90 2024-09-13T17:13:43.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.328+0000 7f087d7fa640 1 -- 172.21.15.87:0/1813764501 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0870003ea0 con 0x7f08800ffd90 2024-09-13T17:13:43.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.328+0000 7f0886a12640 1 -- 172.21.15.87:0/1813764501 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08801a0540 con 0x7f08800ffd90 2024-09-13T17:13:43.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.330+0000 7f087d7fa640 1 -- 172.21.15.87:0/1813764501 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f08700079b0 con 0x7f08800ffd90 2024-09-13T17:13:43.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.330+0000 7f0889813740 1 Processor -- start 2024-09-13T17:13:43.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.330+0000 7f0889813740 1 -- start start 2024-09-13T17:13:43.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.331+0000 7f0889813740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a915b1d500 0x55a915b1d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.331+0000 7f0889813740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a915b1de40 0x55a915b22900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.331+0000 7f0889813740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a915b22ed0 0x55a915b25390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.331+0000 7f0889813740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a915a787c0 con 0x55a915b1d500 2024-09-13T17:13:43.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.331+0000 7f0889813740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a915a87b70 con 0x55a915b22ed0 2024-09-13T17:13:43.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.331+0000 7f0889813740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a915a85300 con 0x55a915b1de40 2024-09-13T17:13:43.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.331+0000 7f0884faf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a915b1d500 0x55a915b1d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.331+0000 7f0884faf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a915b1d500 0x55a915b1d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39596/0 (socket says 172.21.15.87:39596) 2024-09-13T17:13:43.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.331+0000 7f0884faf640 1 -- 172.21.15.87:0/3508519519 learned_addr learned my addr 172.21.15.87:0/3508519519 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:43.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.331+0000 7f087ffff640 1 --2- 172.21.15.87:0/3508519519 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a915b1de40 0x55a915b22900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.331+0000 7f087f7fe640 1 --2- 172.21.15.87:0/3508519519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a915b22ed0 0x55a915b25390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.331+0000 7f087d7fa640 1 --2- 172.21.15.87:0/1813764501 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f08680a1090 0x7f08680a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.331+0000 7f0884faf640 1 -- 172.21.15.87:0/3508519519 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a915b1de40 msgr2=0x55a915b22900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:43.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.331+0000 7f0884faf640 1 --2- 172.21.15.87:0/3508519519 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a915b1de40 0x55a915b22900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.331+0000 7f0884faf640 1 -- 172.21.15.87:0/3508519519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a915b22ed0 msgr2=0x55a915b25390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:43.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.331+0000 7f0884faf640 1 --2- 172.21.15.87:0/3508519519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a915b22ed0 0x55a915b25390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.331+0000 7f0884faf640 1 -- 172.21.15.87:0/3508519519 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a915a0d4b0 con 0x55a915b1d500 2024-09-13T17:13:43.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.331+0000 7f087f7fe640 1 --2- 172.21.15.87:0/3508519519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a915b22ed0 0x55a915b25390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:43.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.331+0000 7f087d7fa640 1 -- 172.21.15.87:0/1813764501 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f08700cca50 con 0x7f08800ffd90 2024-09-13T17:13:43.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.331+0000 7f0884faf640 1 --2- 172.21.15.87:0/1813764501 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f08680a1090 0x7f08680a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.331+0000 7f0884faf640 1 --2- 172.21.15.87:0/3508519519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a915b1d500 0x55a915b1d900 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f087800f3b0 tx=0x7f087800f870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b02b6e5026039505 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:43.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.332+0000 7f08667fc640 1 -- 172.21.15.87:0/3508519519 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0878021070 con 0x55a915b1d500 2024-09-13T17:13:43.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.332+0000 7f08667fc640 1 -- 172.21.15.87:0/3508519519 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f08780124b0 con 0x55a915b1d500 2024-09-13T17:13:43.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.332+0000 7f0884faf640 1 --2- 172.21.15.87:0/1813764501 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f08680a1090 0x7f08680a3550 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0878020000 tx=0x7f087801d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:43.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.332+0000 7f08667fc640 1 -- 172.21.15.87:0/3508519519 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0878010630 con 0x55a915b1d500 2024-09-13T17:13:43.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.332+0000 7f0889813740 1 -- 172.21.15.87:0/3508519519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a915b1d500 msgr2=0x55a915b1d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.332+0000 7f0889813740 1 --2- 172.21.15.87:0/3508519519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a915b1d500 0x55a915b1d900 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f087800f3b0 tx=0x7f087800f870 comp rx=0 tx=0).stop 2024-09-13T17:13:43.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.332+0000 7f0889813740 1 -- 172.21.15.87:0/3508519519 shutdown_connections 2024-09-13T17:13:43.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.332+0000 7f0889813740 1 --2- 172.21.15.87:0/3508519519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a915b22ed0 0x55a915b25390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.332+0000 7f0889813740 1 --2- 172.21.15.87:0/3508519519 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a915b1de40 0x55a915b22900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.332+0000 7f0889813740 1 --2- 172.21.15.87:0/3508519519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a915b1d500 0x55a915b1d900 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.332+0000 7f0889813740 1 -- 172.21.15.87:0/3508519519 >> 172.21.15.87:0/3508519519 conn(0x55a915b18b70 msgr2=0x55a915b18f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:43.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.332+0000 7f0889813740 1 -- 172.21.15.87:0/3508519519 shutdown_connections 2024-09-13T17:13:43.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.332+0000 7f0889813740 1 -- 172.21.15.87:0/3508519519 wait complete. 2024-09-13T17:13:43.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.333+0000 7f0889813740 1 -- start start 2024-09-13T17:13:43.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.333+0000 7f0889813740 1 Processor -- start 2024-09-13T17:13:43.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.333+0000 7f0889813740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a915b1d500 0x55a915b27220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.333+0000 7f0889813740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a915b1de40 0x55a915b27760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.333+0000 7f0889813740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a915b22ed0 0x55a915b2e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.333+0000 7f0889813740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a915a80bf0 con 0x55a915b22ed0 2024-09-13T17:13:43.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.333+0000 7f0889813740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a915a3f250 con 0x55a915b1de40 2024-09-13T17:13:43.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.333+0000 7f0889813740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a915a3eef0 con 0x55a915b1d500 2024-09-13T17:13:43.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.333+0000 7f0889813740 10 client.0 _ll_register_callbacks cb 0x55a915a71740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:13:43.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.333+0000 7f0884faf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a915b22ed0 0x55a915b2e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.333+0000 7f0884faf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a915b22ed0 0x55a915b2e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39608/0 (socket says 172.21.15.87:39608) 2024-09-13T17:13:43.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.333+0000 7f0884faf640 1 -- 172.21.15.87:0/3175630717 learned_addr learned my addr 172.21.15.87:0/3175630717 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:43.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.333+0000 7f087f7fe640 1 --2- 172.21.15.87:0/3175630717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a915b1de40 0x55a915b27760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.333+0000 7f087ffff640 1 --2- 172.21.15.87:0/3175630717 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a915b1d500 0x55a915b27220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.334+0000 7f0884faf640 1 -- 172.21.15.87:0/3175630717 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a915b1d500 msgr2=0x55a915b27220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:43.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.334+0000 7f0884faf640 1 --2- 172.21.15.87:0/3175630717 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a915b1d500 0x55a915b27220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.334+0000 7f0884faf640 1 -- 172.21.15.87:0/3175630717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a915b1de40 msgr2=0x55a915b27760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:43.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.334+0000 7f0884faf640 1 --2- 172.21.15.87:0/3175630717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a915b1de40 0x55a915b27760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.334+0000 7f0884faf640 1 -- 172.21.15.87:0/3175630717 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0878009be0 con 0x55a915b22ed0 2024-09-13T17:13:43.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.334+0000 7f087f7fe640 1 --2- 172.21.15.87:0/3175630717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a915b1de40 0x55a915b27760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:43.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.334+0000 7f087ffff640 1 --2- 172.21.15.87:0/3175630717 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a915b1d500 0x55a915b27220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:43.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.334+0000 7f0884faf640 1 --2- 172.21.15.87:0/3175630717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a915b22ed0 0x55a915b2e700 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0878005c40 tx=0x7f0878009aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6ca8e69dd81911 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:43.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.334+0000 7f085f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:13:43.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.334+0000 7f085f7fe640 1 -- 172.21.15.87:0/3175630717 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0878021040 con 0x55a915b22ed0 2024-09-13T17:13:43.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.334+0000 7f0889813740 1 -- 172.21.15.87:0/3175630717 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a9157743c0 con 0x55a915b22ed0 2024-09-13T17:13:43.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.334+0000 7f085f7fe640 1 -- 172.21.15.87:0/3175630717 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f0878018030 con 0x55a915b22ed0 2024-09-13T17:13:43.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.334+0000 7f085f7fe640 1 -- 172.21.15.87:0/3175630717 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f087801c600 con 0x55a915b22ed0 2024-09-13T17:13:43.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.334+0000 7f0889813740 10 client.15441 fetch_fsmap learned FSMap version 23 2024-09-13T17:13:43.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.334+0000 7f0889813740 1 -- 172.21.15.87:0/3175630717 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55a915a7f270 con 0x55a915b22ed0 2024-09-13T17:13:43.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.334+0000 7f085f7fe640 1 -- 172.21.15.87:0/3175630717 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55a9157743c0 con 0x55a915b22ed0 2024-09-13T17:13:43.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.334+0000 7f085f7fe640 1 -- 172.21.15.87:0/3175630717 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 23) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f0878010c20 con 0x55a915b22ed0 2024-09-13T17:13:43.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.335+0000 7f0889813740 10 client.15441 fetch_fsmap finished waiting for FSMap version 23 2024-09-13T17:13:43.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.335+0000 7f0889813740 10 client.15441 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-13T17:13:43.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.335+0000 7f0889813740 20 client.15441 populate_metadata read hostname 'smithi087' 2024-09-13T17:13:43.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.335+0000 7f0889813740 1 --2- 172.21.15.87:0/3175630717 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55a915b32b10 0x55a915b37680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.335+0000 7f0889813740 4 client.15441 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:13:43.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.335+0000 7f0889813740 1 -- 172.21.15.87:0/3175630717 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a9157856c0 con 0x55a915b32b10 2024-09-13T17:13:43.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.335+0000 7f087ffff640 1 --2- 172.21.15.87:0/3175630717 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55a915b32b10 0x55a915b37680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.335+0000 7f087ffff640 1 --2- 172.21.15.87:0/3175630717 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55a915b32b10 0x55a915b37680 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ec0d476787645eaf server_cookie=d0b23f938a1241b2 in_seq=0 out_seq=0 2024-09-13T17:13:43.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.335+0000 7f085f7fe640 10 client.15441 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:13:43.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.336+0000 7f085f7fe640 1 -- 172.21.15.87:0/3175630717 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55a9157856c0 con 0x55a915b32b10 2024-09-13T17:13:43.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.336+0000 7f085f7fe640 10 client.15441 handle_command_reply: tid=0 2024-09-13T17:13:43.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.336+0000 7f0889813740 1 client.15441 shutdown 2024-09-13T17:13:43.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.336+0000 7f0889813740 1 -- 172.21.15.87:0/3175630717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a915b22ed0 msgr2=0x55a915b2e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.336+0000 7f0889813740 1 --2- 172.21.15.87:0/3175630717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a915b22ed0 0x55a915b2e700 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0878005c40 tx=0x7f0878009aa0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.336+0000 7f0889813740 1 -- 172.21.15.87:0/3175630717 shutdown_connections 2024-09-13T17:13:43.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.336+0000 7f0889813740 1 --2- 172.21.15.87:0/3175630717 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55a915b32b10 0x55a915b37680 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.336+0000 7f0889813740 1 --2- 172.21.15.87:0/3175630717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a915b22ed0 0x55a915b2e700 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.336+0000 7f085f7fe640 0 client.15441 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:13:43.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.336+0000 7f0889813740 1 --2- 172.21.15.87:0/3175630717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a915b1de40 0x55a915b27760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.336+0000 7f0889813740 1 --2- 172.21.15.87:0/3175630717 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a915b1d500 0x55a915b27220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.336+0000 7f0889813740 1 -- 172.21.15.87:0/3175630717 >> 172.21.15.87:0/3175630717 conn(0x55a915b18b70 msgr2=0x55a915b1a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:43.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.336+0000 7f0889813740 1 -- 172.21.15.87:0/3175630717 shutdown_connections 2024-09-13T17:13:43.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.336+0000 7f0889813740 1 -- 172.21.15.87:0/3175630717 wait complete. 2024-09-13T17:13:43.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.336+0000 7f0889813740 20 client.15441 trim_cache size 0 max 16384 2024-09-13T17:13:43.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.351+0000 7f0889813740 1 Processor -- start 2024-09-13T17:13:43.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.351+0000 7f0889813740 1 -- start start 2024-09-13T17:13:43.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.351+0000 7f0889813740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a915b1d500 0x55a915b276e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.351+0000 7f0889813740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a915b1de40 0x55a915b2e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.351+0000 7f0889813740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a915b22ed0 0x55a915b3b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.351+0000 7f0889813740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a915b18a30 con 0x55a915b1d500 2024-09-13T17:13:43.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.351+0000 7f0889813740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a915a04460 con 0x55a915b22ed0 2024-09-13T17:13:43.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.351+0000 7f0889813740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a915b1e590 con 0x55a915b1de40 2024-09-13T17:13:43.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.351+0000 7f087ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a915b1d500 0x55a915b276e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.351+0000 7f087ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a915b1d500 0x55a915b276e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39622/0 (socket says 172.21.15.87:39622) 2024-09-13T17:13:43.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.351+0000 7f087ffff640 1 -- 172.21.15.87:0/1149282052 learned_addr learned my addr 172.21.15.87:0/1149282052 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:43.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.351+0000 7f087ffff640 1 -- 172.21.15.87:0/1149282052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a915b1de40 msgr2=0x55a915b2e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:43.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.351+0000 7f087ffff640 1 --2- 172.21.15.87:0/1149282052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a915b1de40 0x55a915b2e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.351+0000 7f087ffff640 1 -- 172.21.15.87:0/1149282052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a915b22ed0 msgr2=0x55a915b3b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:43.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.351+0000 7f087ffff640 1 --2- 172.21.15.87:0/1149282052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a915b22ed0 0x55a915b3b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.351+0000 7f087ffff640 1 -- 172.21.15.87:0/1149282052 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a915a215f0 con 0x55a915b1d500 2024-09-13T17:13:43.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.351+0000 7f087ffff640 1 --2- 172.21.15.87:0/1149282052 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a915b1d500 0x55a915b276e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f08700ca180 tx=0x7f08700ce040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f700152c70e2c7b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:43.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.351+0000 7f0866ffd640 1 -- 172.21.15.87:0/1149282052 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0870099430 con 0x55a915b1d500 2024-09-13T17:13:43.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.351+0000 7f0866ffd640 1 -- 172.21.15.87:0/1149282052 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f087009a1d0 con 0x55a915b1d500 2024-09-13T17:13:43.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.351+0000 7f0866ffd640 1 -- 172.21.15.87:0/1149282052 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0870004380 con 0x55a915b1d500 2024-09-13T17:13:43.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.352+0000 7f0889813740 1 -- 172.21.15.87:0/1149282052 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a915b1d500 msgr2=0x55a915b276e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.352+0000 7f0889813740 1 --2- 172.21.15.87:0/1149282052 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a915b1d500 0x55a915b276e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f08700ca180 tx=0x7f08700ce040 comp rx=0 tx=0).stop 2024-09-13T17:13:43.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.352+0000 7f0889813740 1 -- 172.21.15.87:0/1149282052 shutdown_connections 2024-09-13T17:13:43.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.352+0000 7f0889813740 1 --2- 172.21.15.87:0/1149282052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a915b22ed0 0x55a915b3b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.352+0000 7f0889813740 1 --2- 172.21.15.87:0/1149282052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a915b1de40 0x55a915b2e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.352+0000 7f0889813740 1 --2- 172.21.15.87:0/1149282052 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a915b1d500 0x55a915b276e0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.352+0000 7f0889813740 1 -- 172.21.15.87:0/1149282052 >> 172.21.15.87:0/1149282052 conn(0x55a915b18b70 msgr2=0x55a915b26fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:43.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.352+0000 7f0889813740 1 -- 172.21.15.87:0/1149282052 shutdown_connections 2024-09-13T17:13:43.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.352+0000 7f0889813740 1 -- 172.21.15.87:0/1149282052 wait complete. 2024-09-13T17:13:43.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.352+0000 7f0889813740 1 -- start start 2024-09-13T17:13:43.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.353+0000 7f0889813740 1 Processor -- start 2024-09-13T17:13:43.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.353+0000 7f0889813740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a915b1d500 0x55a915b293c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.353+0000 7f0889813740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a915b1de40 0x55a915b29900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.353+0000 7f0889813740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a915b22ed0 0x55a915b89340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.353+0000 7f0889813740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a915b29ec0 con 0x55a915b1d500 2024-09-13T17:13:43.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.353+0000 7f0889813740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a915b2a030 con 0x55a915b1de40 2024-09-13T17:13:43.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.353+0000 7f0889813740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a915b89900 con 0x55a915b22ed0 2024-09-13T17:13:43.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.353+0000 7f0889813740 10 client.0 _ll_register_callbacks cb 0x7f0878009980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:13:43.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.353+0000 7f087ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a915b1d500 0x55a915b293c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.353+0000 7f087ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a915b1d500 0x55a915b293c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39628/0 (socket says 172.21.15.87:39628) 2024-09-13T17:13:43.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.353+0000 7f087ffff640 1 -- 172.21.15.87:0/3989023058 learned_addr learned my addr 172.21.15.87:0/3989023058 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:43.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.353+0000 7f087f7fe640 1 --2- 172.21.15.87:0/3989023058 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a915b1de40 0x55a915b29900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.353+0000 7f087ffff640 1 -- 172.21.15.87:0/3989023058 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a915b22ed0 msgr2=0x55a915b89340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:43.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.353+0000 7f087ffff640 1 --2- 172.21.15.87:0/3989023058 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a915b22ed0 0x55a915b89340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.353+0000 7f087ffff640 1 -- 172.21.15.87:0/3989023058 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a915b1de40 msgr2=0x55a915b29900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:43.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.353+0000 7f087ffff640 1 --2- 172.21.15.87:0/3989023058 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a915b1de40 0x55a915b29900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.353+0000 7f087ffff640 1 -- 172.21.15.87:0/3989023058 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08801a0540 con 0x55a915b1d500 2024-09-13T17:13:43.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.353+0000 7f087f7fe640 1 --2- 172.21.15.87:0/3989023058 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a915b1de40 0x55a915b29900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:43.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.353+0000 7f087ffff640 1 --2- 172.21.15.87:0/3989023058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a915b1d500 0x55a915b293c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0870007fd0 tx=0x7f0870095f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8859a0cfc73501e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:43.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.353+0000 7f085f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:13:43.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.353+0000 7f085f7fe640 1 -- 172.21.15.87:0/3989023058 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08700b1070 con 0x55a915b1d500 2024-09-13T17:13:43.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.353+0000 7f085f7fe640 1 -- 172.21.15.87:0/3989023058 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f087009d900 con 0x55a915b1d500 2024-09-13T17:13:43.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.353+0000 7f0889813740 1 -- 172.21.15.87:0/3989023058 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f08780124b0 con 0x55a915b1d500 2024-09-13T17:13:43.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.354+0000 7f085f7fe640 1 -- 172.21.15.87:0/3989023058 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0870099ad0 con 0x55a915b1d500 2024-09-13T17:13:43.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.354+0000 7f0889813740 10 client.15447 fetch_fsmap learned FSMap version 23 2024-09-13T17:13:43.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.354+0000 7f0889813740 1 -- 172.21.15.87:0/3989023058 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55a915a46d00 con 0x55a915b1d500 2024-09-13T17:13:43.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.354+0000 7f085f7fe640 1 -- 172.21.15.87:0/3989023058 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f08780124b0 con 0x55a915b1d500 2024-09-13T17:13:43.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.354+0000 7f085f7fe640 1 -- 172.21.15.87:0/3989023058 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 23) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f0870016030 con 0x55a915b1d500 2024-09-13T17:13:43.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.354+0000 7f0889813740 10 client.15447 fetch_fsmap finished waiting for FSMap version 23 2024-09-13T17:13:43.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.354+0000 7f0889813740 10 client.15447 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-13T17:13:43.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.354+0000 7f0889813740 20 client.15447 populate_metadata read hostname 'smithi087' 2024-09-13T17:13:43.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.354+0000 7f0889813740 1 --2- 172.21.15.87:0/3989023058 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55a915b8e380 0x55a915b8acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.354+0000 7f0889813740 4 client.15447 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:13:43.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.354+0000 7f0889813740 1 -- 172.21.15.87:0/3989023058 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a9157d8d10 con 0x55a915b8e380 2024-09-13T17:13:43.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.354+0000 7f087f7fe640 1 --2- 172.21.15.87:0/3989023058 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55a915b8e380 0x55a915b8acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.355+0000 7f085f7fe640 10 client.15447 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:13:43.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.355+0000 7f087f7fe640 1 --2- 172.21.15.87:0/3989023058 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55a915b8e380 0x55a915b8acc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d161a1da7c0effec server_cookie=ed870699416bf901 in_seq=0 out_seq=0 2024-09-13T17:13:43.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.355+0000 7f085f7fe640 1 -- 172.21.15.87:0/3989023058 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55a9157d8d10 con 0x55a915b8e380 2024-09-13T17:13:43.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.355+0000 7f085f7fe640 10 client.15447 handle_command_reply: tid=0 2024-09-13T17:13:43.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.355+0000 7f0889813740 1 client.15447 shutdown 2024-09-13T17:13:43.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.355+0000 7f0889813740 1 -- 172.21.15.87:0/3989023058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a915b1d500 msgr2=0x55a915b293c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.355+0000 7f0889813740 1 --2- 172.21.15.87:0/3989023058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a915b1d500 0x55a915b293c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0870007fd0 tx=0x7f0870095f40 comp rx=0 tx=0).stop 2024-09-13T17:13:43.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.355+0000 7f0889813740 1 -- 172.21.15.87:0/3989023058 shutdown_connections 2024-09-13T17:13:43.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.355+0000 7f0889813740 1 --2- 172.21.15.87:0/3989023058 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55a915b8e380 0x55a915b8acc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.355+0000 7f0889813740 1 --2- 172.21.15.87:0/3989023058 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a915b22ed0 0x55a915b89340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.355+0000 7f0889813740 1 --2- 172.21.15.87:0/3989023058 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a915b1de40 0x55a915b29900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.355+0000 7f0889813740 1 --2- 172.21.15.87:0/3989023058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a915b1d500 0x55a915b293c0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.355+0000 7f085f7fe640 0 client.15447 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:13:43.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.355+0000 7f0889813740 1 -- 172.21.15.87:0/3989023058 >> 172.21.15.87:0/3989023058 conn(0x55a915b18b70 msgr2=0x55a915b3b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:43.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.355+0000 7f0889813740 1 -- 172.21.15.87:0/3989023058 shutdown_connections 2024-09-13T17:13:43.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.355+0000 7f0889813740 1 -- 172.21.15.87:0/3989023058 wait complete. 2024-09-13T17:13:43.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.355+0000 7f0889813740 20 client.15447 trim_cache size 0 max 16384 2024-09-13T17:13:43.367 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:13:43.367 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_fsid": "043d5bae-71f2-11ef-bceb-c7b262605968", 2024-09-13T17:13:43.367 INFO:teuthology.orchestra.run.smithi087.stdout: "whoami": 2, 2024-09-13T17:13:43.367 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 24472, 2024-09-13T17:13:43.367 INFO:teuthology.orchestra.run.smithi087.stdout: "want_state": "up:active", 2024-09-13T17:13:43.367 INFO:teuthology.orchestra.run.smithi087.stdout: "state": "up:active", 2024-09-13T17:13:43.367 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs", 2024-09-13T17:13:43.368 INFO:teuthology.orchestra.run.smithi087.stdout: "rank_uptime": 116.18592146100001, 2024-09-13T17:13:43.368 INFO:teuthology.orchestra.run.smithi087.stdout: "mdsmap_epoch": 23, 2024-09-13T17:13:43.368 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch": 93, 2024-09-13T17:13:43.368 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch_barrier": 89, 2024-09-13T17:13:43.368 INFO:teuthology.orchestra.run.smithi087.stdout: "uptime": 161.317713785 2024-09-13T17:13:43.368 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:13:43.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.356+0000 7f0886a12640 1 -- 172.21.15.87:0/1813764501 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f08680a1090 msgr2=0x7f08680a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.356+0000 7f0886a12640 1 --2- 172.21.15.87:0/1813764501 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f08680a1090 0x7f08680a3550 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0878020000 tx=0x7f087801d000 comp rx=0 tx=0).stop 2024-09-13T17:13:43.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.356+0000 7f0886a12640 1 -- 172.21.15.87:0/1813764501 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08800ffd90 msgr2=0x7f0880197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.356+0000 7f0886a12640 1 --2- 172.21.15.87:0/1813764501 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08800ffd90 0x7f0880197f60 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f087000c970 tx=0x7f087000ce30 comp rx=0 tx=0).stop 2024-09-13T17:13:43.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.356+0000 7f0886a12640 1 -- 172.21.15.87:0/1813764501 shutdown_connections 2024-09-13T17:13:43.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.356+0000 7f0886a12640 1 --2- 172.21.15.87:0/1813764501 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f08680a1090 0x7f08680a3550 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.356+0000 7f0886a12640 1 --2- 172.21.15.87:0/1813764501 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0880101940 0x7f088019f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.356+0000 7f0886a12640 1 --2- 172.21.15.87:0/1813764501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0880100f80 0x7f08801984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.356+0000 7f0886a12640 1 --2- 172.21.15.87:0/1813764501 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08800ffd90 0x7f0880197f60 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.356+0000 7f0886a12640 1 -- 172.21.15.87:0/1813764501 >> 172.21.15.87:0/1813764501 conn(0x7f08800fb4d0 msgr2=0x7f0880106740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:43.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.356+0000 7f0886a12640 1 -- 172.21.15.87:0/1813764501 shutdown_connections 2024-09-13T17:13:43.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.356+0000 7f0886a12640 1 -- 172.21.15.87:0/1813764501 wait complete. 2024-09-13T17:13:43.370 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T17:13:43.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.469+0000 7fa02389c640 1 -- 172.21.15.87:0/3822955716 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa01c103200 msgr2=0x7fa01c1055f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.469+0000 7fa02389c640 1 --2- 172.21.15.87:0/3822955716 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa01c103200 0x7fa01c1055f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa010009900 tx=0x7fa01002a410 comp rx=0 tx=0).stop 2024-09-13T17:13:43.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.469+0000 7fa02389c640 1 -- 172.21.15.87:0/3822955716 shutdown_connections 2024-09-13T17:13:43.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.469+0000 7fa02389c640 1 --2- 172.21.15.87:0/3822955716 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa01c105b30 0x7fa01c107f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.469+0000 7fa02389c640 1 --2- 172.21.15.87:0/3822955716 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa01c103200 0x7fa01c1055f0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.469+0000 7fa02389c640 1 --2- 172.21.15.87:0/3822955716 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa01c1008d0 0x7fa01c102cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.469+0000 7fa02389c640 1 -- 172.21.15.87:0/3822955716 >> 172.21.15.87:0/3822955716 conn(0x7fa01c0fa430 msgr2=0x7fa01c0fc850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:43.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.469+0000 7fa02389c640 1 -- 172.21.15.87:0/3822955716 shutdown_connections 2024-09-13T17:13:43.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.469+0000 7fa02389c640 1 -- 172.21.15.87:0/3822955716 wait complete. 2024-09-13T17:13:43.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.469+0000 7fa02389c640 1 Processor -- start 2024-09-13T17:13:43.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.469+0000 7fa02389c640 1 -- start start 2024-09-13T17:13:43.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.470+0000 7fa02389c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa01c1008d0 0x7fa01c100240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.470+0000 7fa02389c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa01c103200 0x7fa01c0fe880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.470+0000 7fa02389c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa01c105b30 0x7fa01c0fedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.470+0000 7fa02389c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c0ff520 con 0x7fa01c103200 2024-09-13T17:13:43.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.470+0000 7fa02389c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c0ff690 con 0x7fa01c105b30 2024-09-13T17:13:43.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.470+0000 7fa02389c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c19fe10 con 0x7fa01c1008d0 2024-09-13T17:13:43.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.470+0000 7fa020e37640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa01c103200 0x7fa01c0fe880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.470+0000 7fa020e37640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa01c103200 0x7fa01c0fe880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39638/0 (socket says 172.21.15.87:39638) 2024-09-13T17:13:43.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.470+0000 7fa020e37640 1 -- 172.21.15.87:0/411123108 learned_addr learned my addr 172.21.15.87:0/411123108 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:43.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.470+0000 7fa021638640 1 --2- 172.21.15.87:0/411123108 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa01c1008d0 0x7fa01c100240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.470+0000 7fa021e39640 1 --2- 172.21.15.87:0/411123108 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa01c105b30 0x7fa01c0fedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.470+0000 7fa020e37640 1 -- 172.21.15.87:0/411123108 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa01c1008d0 msgr2=0x7fa01c100240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.470+0000 7fa020e37640 1 --2- 172.21.15.87:0/411123108 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa01c1008d0 0x7fa01c100240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.470+0000 7fa020e37640 1 -- 172.21.15.87:0/411123108 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa01c105b30 msgr2=0x7fa01c0fedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.470+0000 7fa020e37640 1 --2- 172.21.15.87:0/411123108 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa01c105b30 0x7fa01c0fedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.470+0000 7fa020e37640 1 -- 172.21.15.87:0/411123108 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa010009560 con 0x7fa01c103200 2024-09-13T17:13:43.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.470+0000 7fa020e37640 1 --2- 172.21.15.87:0/411123108 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa01c103200 0x7fa01c0fe880 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa01002a930 tx=0x7fa010004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:43.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.470+0000 7fa01a7fc640 1 -- 172.21.15.87:0/411123108 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa010003a00 con 0x7fa01c103200 2024-09-13T17:13:43.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.470+0000 7fa01a7fc640 1 -- 172.21.15.87:0/411123108 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa01003b460 con 0x7fa01c103200 2024-09-13T17:13:43.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.470+0000 7fa02389c640 1 -- 172.21.15.87:0/411123108 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa01c1a0060 con 0x7fa01c103200 2024-09-13T17:13:43.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.470+0000 7fa01a7fc640 1 -- 172.21.15.87:0/411123108 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01003a620 con 0x7fa01c103200 2024-09-13T17:13:43.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.470+0000 7fa02389c640 1 -- 172.21.15.87:0/411123108 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa01c1a0510 con 0x7fa01c103200 2024-09-13T17:13:43.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.473+0000 7fa01a7fc640 1 -- 172.21.15.87:0/411123108 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa01003b5d0 con 0x7fa01c103200 2024-09-13T17:13:43.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.473+0000 7fa0265c7740 1 Processor -- start 2024-09-13T17:13:43.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.473+0000 7fa0265c7740 1 -- start start 2024-09-13T17:13:43.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.473+0000 7fa0265c7740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5598cb49d500 0x5598cb49d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.473+0000 7fa0265c7740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5598cb49de40 0x5598cb4a2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.473+0000 7fa0265c7740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598cb4a2ed0 0x5598cb4a5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.473+0000 7fa0265c7740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598cb3f87c0 con 0x5598cb49d500 2024-09-13T17:13:43.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.473+0000 7fa0265c7740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598cb407b70 con 0x5598cb4a2ed0 2024-09-13T17:13:43.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.473+0000 7fa0265c7740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598cb405300 con 0x5598cb49de40 2024-09-13T17:13:43.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.473+0000 7fa021e39640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5598cb49d500 0x5598cb49d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.473+0000 7fa021e39640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5598cb49d500 0x5598cb49d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39644/0 (socket says 172.21.15.87:39644) 2024-09-13T17:13:43.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.473+0000 7fa021e39640 1 -- 172.21.15.87:0/2868498158 learned_addr learned my addr 172.21.15.87:0/2868498158 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:43.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.473+0000 7fa020e37640 1 --2- 172.21.15.87:0/2868498158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598cb4a2ed0 0x5598cb4a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.473+0000 7fa021638640 1 --2- 172.21.15.87:0/2868498158 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5598cb49de40 0x5598cb4a2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.473+0000 7fa01a7fc640 1 --2- 172.21.15.87:0/411123108 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa0040a1090 0x7fa0040a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.474+0000 7fa021638640 1 -- 172.21.15.87:0/2868498158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598cb4a2ed0 msgr2=0x5598cb4a5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:43.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.474+0000 7fa021638640 1 --2- 172.21.15.87:0/2868498158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598cb4a2ed0 0x5598cb4a5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.474+0000 7fa021638640 1 -- 172.21.15.87:0/2868498158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5598cb49d500 msgr2=0x5598cb49d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:43.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.474+0000 7fa021638640 1 --2- 172.21.15.87:0/2868498158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5598cb49d500 0x5598cb49d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.474+0000 7fa021638640 1 -- 172.21.15.87:0/2868498158 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598cb38d4b0 con 0x5598cb49de40 2024-09-13T17:13:43.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.474+0000 7fa021e39640 1 --2- 172.21.15.87:0/411123108 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa0040a1090 0x7fa0040a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.474+0000 7fa01a7fc640 1 -- 172.21.15.87:0/411123108 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7fa0100edaa0 con 0x7fa01c103200 2024-09-13T17:13:43.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.474+0000 7fa021638640 1 --2- 172.21.15.87:0/2868498158 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5598cb49de40 0x5598cb4a2900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa00c007ed0 tx=0x7fa00c00f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a39d13f6aca19dc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:43.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.474+0000 7fa0037fe640 1 -- 172.21.15.87:0/2868498158 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c004d20 con 0x5598cb49de40 2024-09-13T17:13:43.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.474+0000 7fa0037fe640 1 -- 172.21.15.87:0/2868498158 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa00c004e80 con 0x5598cb49de40 2024-09-13T17:13:43.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.474+0000 7fa0037fe640 1 -- 172.21.15.87:0/2868498158 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c005560 con 0x5598cb49de40 2024-09-13T17:13:43.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.475+0000 7fa0265c7740 1 -- 172.21.15.87:0/2868498158 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5598cb49de40 msgr2=0x5598cb4a2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.475+0000 7fa021e39640 1 --2- 172.21.15.87:0/411123108 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa0040a1090 0x7fa0040a3550 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa01400ddd0 tx=0x7fa0140046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:43.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.475+0000 7fa0265c7740 1 --2- 172.21.15.87:0/2868498158 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5598cb49de40 0x5598cb4a2900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa00c007ed0 tx=0x7fa00c00f790 comp rx=0 tx=0).stop 2024-09-13T17:13:43.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.475+0000 7fa0265c7740 1 -- 172.21.15.87:0/2868498158 shutdown_connections 2024-09-13T17:13:43.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.475+0000 7fa0265c7740 1 --2- 172.21.15.87:0/2868498158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598cb4a2ed0 0x5598cb4a5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.475+0000 7fa0265c7740 1 --2- 172.21.15.87:0/2868498158 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5598cb49de40 0x5598cb4a2900 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.475+0000 7fa0265c7740 1 --2- 172.21.15.87:0/2868498158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5598cb49d500 0x5598cb49d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.475+0000 7fa0265c7740 1 -- 172.21.15.87:0/2868498158 >> 172.21.15.87:0/2868498158 conn(0x5598cb498b70 msgr2=0x5598cb498f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:43.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.475+0000 7fa0265c7740 1 -- 172.21.15.87:0/2868498158 shutdown_connections 2024-09-13T17:13:43.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.475+0000 7fa0265c7740 1 -- 172.21.15.87:0/2868498158 wait complete. 2024-09-13T17:13:43.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.475+0000 7fa0265c7740 1 -- start start 2024-09-13T17:13:43.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.475+0000 7fa0265c7740 1 Processor -- start 2024-09-13T17:13:43.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.476+0000 7fa0265c7740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5598cb49d500 0x5598cb4a7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.476+0000 7fa0265c7740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5598cb49de40 0x5598cb4a76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.476+0000 7fa0265c7740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598cb4a2ed0 0x5598cb4ae670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.476+0000 7fa0265c7740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598cb400bf0 con 0x5598cb49d500 2024-09-13T17:13:43.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.476+0000 7fa0265c7740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598cb3bf250 con 0x5598cb4a2ed0 2024-09-13T17:13:43.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.476+0000 7fa0265c7740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598cb3beef0 con 0x5598cb49de40 2024-09-13T17:13:43.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.476+0000 7fa0265c7740 10 client.0 _ll_register_callbacks cb 0x5598cb3f1740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:13:43.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.476+0000 7fa021638640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5598cb49d500 0x5598cb4a7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.476+0000 7fa021638640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5598cb49d500 0x5598cb4a7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39650/0 (socket says 172.21.15.87:39650) 2024-09-13T17:13:43.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.476+0000 7fa021638640 1 -- 172.21.15.87:0/816556362 learned_addr learned my addr 172.21.15.87:0/816556362 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:43.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.476+0000 7fa020e37640 1 --2- 172.21.15.87:0/816556362 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5598cb49de40 0x5598cb4a76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.476+0000 7fa021e39640 1 --2- 172.21.15.87:0/816556362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598cb4a2ed0 0x5598cb4ae670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.476+0000 7fa021638640 1 -- 172.21.15.87:0/816556362 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5598cb49de40 msgr2=0x5598cb4a76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:43.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.476+0000 7fa021638640 1 --2- 172.21.15.87:0/816556362 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5598cb49de40 0x5598cb4a76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.476+0000 7fa021638640 1 -- 172.21.15.87:0/816556362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598cb4a2ed0 msgr2=0x5598cb4ae670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:43.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.476+0000 7fa021638640 1 --2- 172.21.15.87:0/816556362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598cb4a2ed0 0x5598cb4ae670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.476+0000 7fa021638640 1 -- 172.21.15.87:0/816556362 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa00c007b00 con 0x5598cb49d500 2024-09-13T17:13:43.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.476+0000 7fa021638640 1 --2- 172.21.15.87:0/816556362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5598cb49d500 0x5598cb4a7190 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa00c007ea0 tx=0x7fa00c005660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576d0c1492b55bb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:43.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.476+0000 7fa000ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:13:43.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.476+0000 7fa000ff9640 1 -- 172.21.15.87:0/816556362 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c010640 con 0x5598cb49d500 2024-09-13T17:13:43.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.476+0000 7fa000ff9640 1 -- 172.21.15.87:0/816556362 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7fa00c0107a0 con 0x5598cb49d500 2024-09-13T17:13:43.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.476+0000 7fa0265c7740 1 -- 172.21.15.87:0/816556362 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5598cb1056c0 con 0x5598cb49d500 2024-09-13T17:13:43.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.476+0000 7fa000ff9640 1 -- 172.21.15.87:0/816556362 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa00c005a50 con 0x5598cb49d500 2024-09-13T17:13:43.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.476+0000 7fa0265c7740 10 client.15459 fetch_fsmap learned FSMap version 23 2024-09-13T17:13:43.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.476+0000 7fa0265c7740 1 -- 172.21.15.87:0/816556362 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x5598cb3ff270 con 0x5598cb49d500 2024-09-13T17:13:43.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.477+0000 7fa000ff9640 1 -- 172.21.15.87:0/816556362 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x5598cb1056c0 con 0x5598cb49d500 2024-09-13T17:13:43.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.477+0000 7fa000ff9640 1 -- 172.21.15.87:0/816556362 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 23) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fa00c022b10 con 0x5598cb49d500 2024-09-13T17:13:43.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.477+0000 7fa0265c7740 10 client.15459 fetch_fsmap finished waiting for FSMap version 23 2024-09-13T17:13:43.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.477+0000 7fa0265c7740 10 client.15459 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T17:13:43.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.477+0000 7fa0265c7740 20 client.15459 populate_metadata read hostname 'smithi087' 2024-09-13T17:13:43.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.477+0000 7fa0265c7740 1 --2- 172.21.15.87:0/816556362 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5598cb4b3390 0x5598cb4b7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.477+0000 7fa0265c7740 4 client.15459 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:13:43.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.477+0000 7fa0265c7740 1 -- 172.21.15.87:0/816556362 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5598cb158d10 con 0x5598cb4b3390 2024-09-13T17:13:43.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.477+0000 7fa020e37640 1 --2- 172.21.15.87:0/816556362 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5598cb4b3390 0x5598cb4b7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.486 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:43 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2649493884' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:13:43.486 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:43 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2761116226' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:13:43.486 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:43 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/688241689' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:13:43.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.478+0000 7fa020e37640 1 --2- 172.21.15.87:0/816556362 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5598cb4b3390 0x5598cb4b7530 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b55de511f95f346e server_cookie=e4d27198d4f99c6e in_seq=0 out_seq=0 2024-09-13T17:13:43.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.478+0000 7fa000ff9640 10 client.15459 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:13:43.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.478+0000 7fa000ff9640 1 -- 172.21.15.87:0/816556362 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x7fa010099e90 con 0x5598cb4b3390 2024-09-13T17:13:43.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.478+0000 7fa000ff9640 10 client.15459 handle_command_reply: tid=0 2024-09-13T17:13:43.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.478+0000 7fa0265c7740 1 client.15459 shutdown 2024-09-13T17:13:43.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.478+0000 7fa0265c7740 1 -- 172.21.15.87:0/816556362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5598cb49d500 msgr2=0x5598cb4a7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.478+0000 7fa0265c7740 1 --2- 172.21.15.87:0/816556362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5598cb49d500 0x5598cb4a7190 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa00c007ea0 tx=0x7fa00c005660 comp rx=0 tx=0).stop 2024-09-13T17:13:43.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.479+0000 7fa0265c7740 1 -- 172.21.15.87:0/816556362 shutdown_connections 2024-09-13T17:13:43.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.479+0000 7fa0265c7740 1 --2- 172.21.15.87:0/816556362 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5598cb4b3390 0x5598cb4b7530 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.479+0000 7fa0265c7740 1 --2- 172.21.15.87:0/816556362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598cb4a2ed0 0x5598cb4ae670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.479+0000 7fa0265c7740 1 --2- 172.21.15.87:0/816556362 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5598cb49de40 0x5598cb4a76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.479+0000 7fa0265c7740 1 --2- 172.21.15.87:0/816556362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5598cb49d500 0x5598cb4a7190 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.479+0000 7fa000ff9640 0 client.15459 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:13:43.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.479+0000 7fa0265c7740 1 -- 172.21.15.87:0/816556362 >> 172.21.15.87:0/816556362 conn(0x5598cb498b70 msgr2=0x5598cb49a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:43.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.479+0000 7fa0265c7740 1 -- 172.21.15.87:0/816556362 shutdown_connections 2024-09-13T17:13:43.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.479+0000 7fa0265c7740 1 -- 172.21.15.87:0/816556362 wait complete. 2024-09-13T17:13:43.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.479+0000 7fa0265c7740 20 client.15459 trim_cache size 0 max 16384 2024-09-13T17:13:43.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.493+0000 7fa0265c7740 1 Processor -- start 2024-09-13T17:13:43.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.493+0000 7fa0265c7740 1 -- start start 2024-09-13T17:13:43.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.493+0000 7fa0265c7740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598cb49d500 0x5598cb4a7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.493+0000 7fa0265c7740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5598cb49de40 0x5598cb4ae590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.493+0000 7fa0265c7740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5598cb4a2ed0 0x5598cb4bb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.493+0000 7fa0265c7740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598cb4a6d60 con 0x5598cb49de40 2024-09-13T17:13:43.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.493+0000 7fa0265c7740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598cb384460 con 0x5598cb49d500 2024-09-13T17:13:43.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.493+0000 7fa0265c7740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598cb3a2410 con 0x5598cb4a2ed0 2024-09-13T17:13:43.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.493+0000 7fa020e37640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5598cb49de40 0x5598cb4ae590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.493+0000 7fa020e37640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5598cb49de40 0x5598cb4ae590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39662/0 (socket says 172.21.15.87:39662) 2024-09-13T17:13:43.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.493+0000 7fa020e37640 1 -- 172.21.15.87:0/475426207 learned_addr learned my addr 172.21.15.87:0/475426207 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:43.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.494+0000 7fa021638640 1 --2- 172.21.15.87:0/475426207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598cb49d500 0x5598cb4a7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.494+0000 7fa021e39640 1 --2- 172.21.15.87:0/475426207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5598cb4a2ed0 0x5598cb4bb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.494+0000 7fa020e37640 1 -- 172.21.15.87:0/475426207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5598cb4a2ed0 msgr2=0x5598cb4bb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:43.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.494+0000 7fa020e37640 1 --2- 172.21.15.87:0/475426207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5598cb4a2ed0 0x5598cb4bb550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.494+0000 7fa020e37640 1 -- 172.21.15.87:0/475426207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598cb49d500 msgr2=0x5598cb4a7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:43.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.494+0000 7fa020e37640 1 --2- 172.21.15.87:0/475426207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598cb49d500 0x5598cb4a7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.494+0000 7fa020e37640 1 -- 172.21.15.87:0/475426207 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598cb3a15f0 con 0x5598cb49de40 2024-09-13T17:13:43.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.494+0000 7fa021638640 1 --2- 172.21.15.87:0/475426207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598cb49d500 0x5598cb4a7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:43.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.494+0000 7fa020e37640 1 --2- 172.21.15.87:0/475426207 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5598cb49de40 0x5598cb4ae590 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa0100babd0 tx=0x7fa0100ed040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c04afdf5f5c9046 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:43.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.494+0000 7fa003fff640 1 -- 172.21.15.87:0/475426207 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01003f070 con 0x5598cb49de40 2024-09-13T17:13:43.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.494+0000 7fa003fff640 1 -- 172.21.15.87:0/475426207 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x5598cb158d10 con 0x5598cb49de40 2024-09-13T17:13:43.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.494+0000 7fa003fff640 1 -- 172.21.15.87:0/475426207 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0100c30c0 con 0x5598cb49de40 2024-09-13T17:13:43.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.494+0000 7fa0265c7740 1 -- 172.21.15.87:0/475426207 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5598cb49de40 msgr2=0x5598cb4ae590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.495+0000 7fa0265c7740 1 --2- 172.21.15.87:0/475426207 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5598cb49de40 0x5598cb4ae590 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa0100babd0 tx=0x7fa0100ed040 comp rx=0 tx=0).stop 2024-09-13T17:13:43.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.495+0000 7fa0265c7740 1 -- 172.21.15.87:0/475426207 shutdown_connections 2024-09-13T17:13:43.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.495+0000 7fa0265c7740 1 --2- 172.21.15.87:0/475426207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5598cb4a2ed0 0x5598cb4bb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.495+0000 7fa0265c7740 1 --2- 172.21.15.87:0/475426207 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5598cb49de40 0x5598cb4ae590 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.495+0000 7fa0265c7740 1 --2- 172.21.15.87:0/475426207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598cb49d500 0x5598cb4a7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.495+0000 7fa0265c7740 1 -- 172.21.15.87:0/475426207 >> 172.21.15.87:0/475426207 conn(0x5598cb498b70 msgr2=0x5598cb4a6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:43.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.495+0000 7fa0265c7740 1 -- 172.21.15.87:0/475426207 shutdown_connections 2024-09-13T17:13:43.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.495+0000 7fa0265c7740 1 -- 172.21.15.87:0/475426207 wait complete. 2024-09-13T17:13:43.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.495+0000 7fa0265c7740 1 -- start start 2024-09-13T17:13:43.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.495+0000 7fa0265c7740 1 Processor -- start 2024-09-13T17:13:43.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.495+0000 7fa0265c7740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5598cb49d500 0x5598cb4a9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.495+0000 7fa0265c7740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598cb49de40 0x5598cb4a9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.495+0000 7fa0265c7740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5598cb4a2ed0 0x5598cb5091f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.495+0000 7fa0265c7740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598cb4ae850 con 0x5598cb49d500 2024-09-13T17:13:43.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.495+0000 7fa0265c7740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598cb4ae9c0 con 0x5598cb49de40 2024-09-13T17:13:43.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.495+0000 7fa0265c7740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598cb509730 con 0x5598cb4a2ed0 2024-09-13T17:13:43.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.495+0000 7fa0265c7740 10 client.0 _ll_register_callbacks cb 0x7fa00c007910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:13:43.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.495+0000 7fa021638640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5598cb49d500 0x5598cb4a9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.495+0000 7fa021638640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5598cb49d500 0x5598cb4a9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39678/0 (socket says 172.21.15.87:39678) 2024-09-13T17:13:43.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.495+0000 7fa021638640 1 -- 172.21.15.87:0/218680355 learned_addr learned my addr 172.21.15.87:0/218680355 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:43.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.496+0000 7fa021e39640 1 --2- 172.21.15.87:0/218680355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5598cb4a2ed0 0x5598cb5091f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.496+0000 7fa021638640 1 -- 172.21.15.87:0/218680355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5598cb4a2ed0 msgr2=0x5598cb5091f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:43.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.496+0000 7fa021638640 1 --2- 172.21.15.87:0/218680355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5598cb4a2ed0 0x5598cb5091f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.496+0000 7fa020e37640 1 --2- 172.21.15.87:0/218680355 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598cb49de40 0x5598cb4a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.496+0000 7fa021638640 1 -- 172.21.15.87:0/218680355 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598cb49de40 msgr2=0x5598cb4a9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:43.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.496+0000 7fa021638640 1 --2- 172.21.15.87:0/218680355 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598cb49de40 0x5598cb4a9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.496+0000 7fa021638640 1 -- 172.21.15.87:0/218680355 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0100f7040 con 0x5598cb49d500 2024-09-13T17:13:43.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.496+0000 7fa021638640 1 --2- 172.21.15.87:0/218680355 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5598cb49d500 0x5598cb4a9330 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa00c007ea0 tx=0x7fa00c007380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b2823c023e79db8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:43.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.496+0000 7fa000ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:13:43.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.496+0000 7fa000ff9640 1 -- 172.21.15.87:0/218680355 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c018ba0 con 0x5598cb49d500 2024-09-13T17:13:43.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.496+0000 7fa000ff9640 1 -- 172.21.15.87:0/218680355 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7fa00c018d00 con 0x5598cb49d500 2024-09-13T17:13:43.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.496+0000 7fa0265c7740 1 -- 172.21.15.87:0/218680355 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5598cb0f43c0 con 0x5598cb49d500 2024-09-13T17:13:43.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.496+0000 7fa000ff9640 1 -- 172.21.15.87:0/218680355 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa00c0056d0 con 0x5598cb49d500 2024-09-13T17:13:43.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.496+0000 7fa0265c7740 10 client.15465 fetch_fsmap learned FSMap version 23 2024-09-13T17:13:43.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.496+0000 7fa0265c7740 1 -- 172.21.15.87:0/218680355 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x5598cb3c6d00 con 0x5598cb49d500 2024-09-13T17:13:43.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.496+0000 7fa000ff9640 1 -- 172.21.15.87:0/218680355 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x5598cb0f43c0 con 0x5598cb49d500 2024-09-13T17:13:43.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.496+0000 7fa000ff9640 1 -- 172.21.15.87:0/218680355 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 23) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fa00c010af0 con 0x5598cb49d500 2024-09-13T17:13:43.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.496+0000 7fa0265c7740 10 client.15465 fetch_fsmap finished waiting for FSMap version 23 2024-09-13T17:13:43.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.497+0000 7fa0265c7740 10 client.15465 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T17:13:43.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.497+0000 7fa0265c7740 20 client.15465 populate_metadata read hostname 'smithi087' 2024-09-13T17:13:43.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.497+0000 7fa0265c7740 1 --2- 172.21.15.87:0/218680355 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5598cb50e240 0x5598cb50abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.497+0000 7fa0265c7740 4 client.15465 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:13:43.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.497+0000 7fa0265c7740 1 -- 172.21.15.87:0/218680355 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5598cb4b37c0 con 0x5598cb50e240 2024-09-13T17:13:43.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.497+0000 7fa020e37640 1 --2- 172.21.15.87:0/218680355 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5598cb50e240 0x5598cb50abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.497+0000 7fa020e37640 1 --2- 172.21.15.87:0/218680355 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5598cb50e240 0x5598cb50abb0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=db370b168899295a server_cookie=7f90a5ff64c38573 in_seq=0 out_seq=0 2024-09-13T17:13:43.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.497+0000 7fa000ff9640 10 client.15465 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:13:43.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.497+0000 7fa000ff9640 1 -- 172.21.15.87:0/218680355 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+322 (crc 0 0 0) 0x7fa0100baa10 con 0x5598cb50e240 2024-09-13T17:13:43.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.497+0000 7fa000ff9640 10 client.15465 handle_command_reply: tid=0 2024-09-13T17:13:43.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.497+0000 7fa0265c7740 1 client.15465 shutdown 2024-09-13T17:13:43.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.497+0000 7fa0265c7740 1 -- 172.21.15.87:0/218680355 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5598cb49d500 msgr2=0x5598cb4a9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.497+0000 7fa0265c7740 1 --2- 172.21.15.87:0/218680355 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5598cb49d500 0x5598cb4a9330 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa00c007ea0 tx=0x7fa00c007380 comp rx=0 tx=0).stop 2024-09-13T17:13:43.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.497+0000 7fa0265c7740 1 -- 172.21.15.87:0/218680355 shutdown_connections 2024-09-13T17:13:43.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.497+0000 7fa0265c7740 1 --2- 172.21.15.87:0/218680355 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5598cb50e240 0x5598cb50abb0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.497+0000 7fa0265c7740 1 --2- 172.21.15.87:0/218680355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5598cb4a2ed0 0x5598cb5091f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.497+0000 7fa0265c7740 1 --2- 172.21.15.87:0/218680355 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598cb49de40 0x5598cb4a9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.497+0000 7fa000ff9640 0 client.15465 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:13:43.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.497+0000 7fa0265c7740 1 --2- 172.21.15.87:0/218680355 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5598cb49d500 0x5598cb4a9330 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.497+0000 7fa0265c7740 1 -- 172.21.15.87:0/218680355 >> 172.21.15.87:0/218680355 conn(0x5598cb498b70 msgr2=0x5598cb4bb550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:43.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.498+0000 7fa0265c7740 1 -- 172.21.15.87:0/218680355 shutdown_connections 2024-09-13T17:13:43.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.498+0000 7fa0265c7740 1 -- 172.21.15.87:0/218680355 wait complete. 2024-09-13T17:13:43.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.498+0000 7fa0265c7740 20 client.15465 trim_cache size 0 max 16384 2024-09-13T17:13:43.506 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:13:43.506 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_fsid": "043d5bae-71f2-11ef-bceb-c7b262605968", 2024-09-13T17:13:43.506 INFO:teuthology.orchestra.run.smithi087.stdout: "whoami": 1, 2024-09-13T17:13:43.506 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 24484, 2024-09-13T17:13:43.506 INFO:teuthology.orchestra.run.smithi087.stdout: "want_state": "up:active", 2024-09-13T17:13:43.506 INFO:teuthology.orchestra.run.smithi087.stdout: "state": "up:active", 2024-09-13T17:13:43.506 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs", 2024-09-13T17:13:43.506 INFO:teuthology.orchestra.run.smithi087.stdout: "rank_uptime": 117.330898183, 2024-09-13T17:13:43.506 INFO:teuthology.orchestra.run.smithi087.stdout: "mdsmap_epoch": 23, 2024-09-13T17:13:43.506 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch": 93, 2024-09-13T17:13:43.507 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch_barrier": 89, 2024-09-13T17:13:43.507 INFO:teuthology.orchestra.run.smithi087.stdout: "uptime": 158.936136288 2024-09-13T17:13:43.507 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:13:43.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.498+0000 7fa02389c640 1 -- 172.21.15.87:0/411123108 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa0040a1090 msgr2=0x7fa0040a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.498+0000 7fa02389c640 1 --2- 172.21.15.87:0/411123108 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa0040a1090 0x7fa0040a3550 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa01400ddd0 tx=0x7fa0140046c0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.498+0000 7fa02389c640 1 -- 172.21.15.87:0/411123108 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa01c103200 msgr2=0x7fa01c0fe880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.498+0000 7fa02389c640 1 --2- 172.21.15.87:0/411123108 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa01c103200 0x7fa01c0fe880 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa01002a930 tx=0x7fa010004340 comp rx=0 tx=0).stop 2024-09-13T17:13:43.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.498+0000 7fa02389c640 1 -- 172.21.15.87:0/411123108 shutdown_connections 2024-09-13T17:13:43.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.498+0000 7fa02389c640 1 --2- 172.21.15.87:0/411123108 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fa0040a1090 0x7fa0040a3550 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.498+0000 7fa02389c640 1 --2- 172.21.15.87:0/411123108 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa01c105b30 0x7fa01c0fedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.498+0000 7fa02389c640 1 --2- 172.21.15.87:0/411123108 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa01c103200 0x7fa01c0fe880 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.499+0000 7fa02389c640 1 --2- 172.21.15.87:0/411123108 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa01c1008d0 0x7fa01c100240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.499+0000 7fa02389c640 1 -- 172.21.15.87:0/411123108 >> 172.21.15.87:0/411123108 conn(0x7fa01c0fa430 msgr2=0x7fa01c101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:43.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.499+0000 7fa02389c640 1 -- 172.21.15.87:0/411123108 shutdown_connections 2024-09-13T17:13:43.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.499+0000 7fa02389c640 1 -- 172.21.15.87:0/411123108 wait complete. 2024-09-13T17:13:43.510 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-09-13T17:13:43.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.609+0000 7fed19953640 1 -- 172.21.15.87:0/2352902209 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed140fec70 msgr2=0x7fed140ff070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.609+0000 7fed19953640 1 --2- 172.21.15.87:0/2352902209 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed140fec70 0x7fed140ff070 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fed04009900 tx=0x7fed0402a410 comp rx=0 tx=0).stop 2024-09-13T17:13:43.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.609+0000 7fed19953640 1 -- 172.21.15.87:0/2352902209 shutdown_connections 2024-09-13T17:13:43.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.609+0000 7fed19953640 1 --2- 172.21.15.87:0/2352902209 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed14100820 0x7fed141070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.609+0000 7fed19953640 1 --2- 172.21.15.87:0/2352902209 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed140ffe60 0x7fed141002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.609+0000 7fed19953640 1 --2- 172.21.15.87:0/2352902209 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed140fec70 0x7fed140ff070 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.609+0000 7fed19953640 1 -- 172.21.15.87:0/2352902209 >> 172.21.15.87:0/2352902209 conn(0x7fed140fa410 msgr2=0x7fed140fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:43.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.609+0000 7fed19953640 1 -- 172.21.15.87:0/2352902209 shutdown_connections 2024-09-13T17:13:43.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.609+0000 7fed19953640 1 -- 172.21.15.87:0/2352902209 wait complete. 2024-09-13T17:13:43.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.609+0000 7fed19953640 1 Processor -- start 2024-09-13T17:13:43.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.610+0000 7fed19953640 1 -- start start 2024-09-13T17:13:43.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.610+0000 7fed19953640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed140fec70 0x7fed14194c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.610+0000 7fed19953640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed140ffe60 0x7fed141951b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.610+0000 7fed19953640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed14100820 0x7fed1419c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.610+0000 7fed19953640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1419c750 con 0x7fed14100820 2024-09-13T17:13:43.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.610+0000 7fed19953640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1419c8c0 con 0x7fed140fec70 2024-09-13T17:13:43.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.610+0000 7fed19953640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1419ca80 con 0x7fed140ffe60 2024-09-13T17:13:43.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.610+0000 7fed137fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed14100820 0x7fed1419c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.610+0000 7fed137fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed14100820 0x7fed1419c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39692/0 (socket says 172.21.15.87:39692) 2024-09-13T17:13:43.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.610+0000 7fed137fe640 1 -- 172.21.15.87:0/362489205 learned_addr learned my addr 172.21.15.87:0/362489205 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:43.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.610+0000 7fed12ffd640 1 --2- 172.21.15.87:0/362489205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed140fec70 0x7fed14194c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.610+0000 7fed127fc640 1 --2- 172.21.15.87:0/362489205 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed140ffe60 0x7fed141951b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.610+0000 7fed137fe640 1 -- 172.21.15.87:0/362489205 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed140ffe60 msgr2=0x7fed141951b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.610+0000 7fed137fe640 1 --2- 172.21.15.87:0/362489205 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed140ffe60 0x7fed141951b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.610+0000 7fed137fe640 1 -- 172.21.15.87:0/362489205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed140fec70 msgr2=0x7fed14194c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.610+0000 7fed137fe640 1 --2- 172.21.15.87:0/362489205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed140fec70 0x7fed14194c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.610+0000 7fed137fe640 1 -- 172.21.15.87:0/362489205 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed04009560 con 0x7fed14100820 2024-09-13T17:13:43.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.610+0000 7fed127fc640 1 --2- 172.21.15.87:0/362489205 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed140ffe60 0x7fed141951b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:43.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.610+0000 7fed137fe640 1 --2- 172.21.15.87:0/362489205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed14100820 0x7fed1419c1e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fed0c00cce0 tx=0x7fed0c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:43.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.611+0000 7fed18951640 1 -- 172.21.15.87:0/362489205 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c00f450 con 0x7fed14100820 2024-09-13T17:13:43.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.611+0000 7fed19953640 1 -- 172.21.15.87:0/362489205 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed1419cd60 con 0x7fed14100820 2024-09-13T17:13:43.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.611+0000 7fed18951640 1 -- 172.21.15.87:0/362489205 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fed0c00fa60 con 0x7fed14100820 2024-09-13T17:13:43.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.611+0000 7fed18951640 1 -- 172.21.15.87:0/362489205 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c018b10 con 0x7fed14100820 2024-09-13T17:13:43.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.611+0000 7fed19953640 1 -- 172.21.15.87:0/362489205 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed1419d190 con 0x7fed14100820 2024-09-13T17:13:43.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.613+0000 7fed18951640 1 -- 172.21.15.87:0/362489205 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fed0c00fbd0 con 0x7fed14100820 2024-09-13T17:13:43.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.613+0000 7fed1c675740 1 Processor -- start 2024-09-13T17:13:43.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.613+0000 7fed1c675740 1 -- start start 2024-09-13T17:13:43.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.613+0000 7fed1c675740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a4fd87710 0x555a4fd87b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.613+0000 7fed1c675740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555a4fd88050 0x555a4fd8cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.613+0000 7fed1c675740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a4fd8d0e0 0x555a4fd8f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.613+0000 7fed1c675740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a4fce07c0 con 0x555a4fd87710 2024-09-13T17:13:43.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.613+0000 7fed1c675740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a4fcefb70 con 0x555a4fd88050 2024-09-13T17:13:43.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.613+0000 7fed1c675740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a4fced300 con 0x555a4fd8d0e0 2024-09-13T17:13:43.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.613+0000 7fed18951640 1 --2- 172.21.15.87:0/362489205 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fecfc0a1090 0x7fecfc0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.614+0000 7fed127fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a4fd87710 0x555a4fd87b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.614+0000 7fed127fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a4fd87710 0x555a4fd87b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39704/0 (socket says 172.21.15.87:39704) 2024-09-13T17:13:43.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.614+0000 7fed127fc640 1 -- 172.21.15.87:0/1917842553 learned_addr learned my addr 172.21.15.87:0/1917842553 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:43.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.614+0000 7fed137fe640 1 --2- 172.21.15.87:0/362489205 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fecfc0a1090 0x7fecfc0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.614+0000 7fed18951640 1 -- 172.21.15.87:0/362489205 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7fed0c0cd1e0 con 0x7fed14100820 2024-09-13T17:13:43.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.614+0000 7fed12ffd640 1 --2- 172.21.15.87:0/1917842553 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555a4fd88050 0x555a4fd8cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.614+0000 7fed127fc640 1 -- 172.21.15.87:0/1917842553 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a4fd8d0e0 msgr2=0x555a4fd8f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:43.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.614+0000 7fed127fc640 1 --2- 172.21.15.87:0/1917842553 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a4fd8d0e0 0x555a4fd8f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.614+0000 7fed127fc640 1 -- 172.21.15.87:0/1917842553 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555a4fd88050 msgr2=0x555a4fd8cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:43.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.614+0000 7fed127fc640 1 --2- 172.21.15.87:0/1917842553 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555a4fd88050 0x555a4fd8cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.614+0000 7fed127fc640 1 -- 172.21.15.87:0/1917842553 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a4fc754b0 con 0x555a4fd87710 2024-09-13T17:13:43.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.614+0000 7fed12ffd640 1 --2- 172.21.15.87:0/1917842553 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555a4fd88050 0x555a4fd8cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:43.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.614+0000 7fed127fc640 1 --2- 172.21.15.87:0/1917842553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a4fd87710 0x555a4fd87b10 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fed08009cd0 tx=0x7fed08012760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=721c5d20ffdc8bd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:43.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.614+0000 7fed137fe640 1 --2- 172.21.15.87:0/362489205 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fecfc0a1090 0x7fecfc0a3550 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fed0c00ccb0 tx=0x7fed0c06d350 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:43.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.614+0000 7fecf9ffb640 1 -- 172.21.15.87:0/1917842553 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed08004030 con 0x555a4fd87710 2024-09-13T17:13:43.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.614+0000 7fecf9ffb640 1 -- 172.21.15.87:0/1917842553 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fed080035f0 con 0x555a4fd87710 2024-09-13T17:13:43.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.614+0000 7fecf9ffb640 1 -- 172.21.15.87:0/1917842553 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed08013660 con 0x555a4fd87710 2024-09-13T17:13:43.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.615+0000 7fed1c675740 1 -- 172.21.15.87:0/1917842553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a4fd87710 msgr2=0x555a4fd87b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.615+0000 7fed1c675740 1 --2- 172.21.15.87:0/1917842553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a4fd87710 0x555a4fd87b10 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fed08009cd0 tx=0x7fed08012760 comp rx=0 tx=0).stop 2024-09-13T17:13:43.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.615+0000 7fed1c675740 1 -- 172.21.15.87:0/1917842553 shutdown_connections 2024-09-13T17:13:43.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.615+0000 7fed1c675740 1 --2- 172.21.15.87:0/1917842553 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a4fd8d0e0 0x555a4fd8f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.615+0000 7fed1c675740 1 --2- 172.21.15.87:0/1917842553 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555a4fd88050 0x555a4fd8cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.615+0000 7fed1c675740 1 --2- 172.21.15.87:0/1917842553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a4fd87710 0x555a4fd87b10 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.615+0000 7fed1c675740 1 -- 172.21.15.87:0/1917842553 >> 172.21.15.87:0/1917842553 conn(0x555a4fd82d80 msgr2=0x555a4fd83180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:43.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.615+0000 7fed1c675740 1 -- 172.21.15.87:0/1917842553 shutdown_connections 2024-09-13T17:13:43.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.615+0000 7fed1c675740 1 -- 172.21.15.87:0/1917842553 wait complete. 2024-09-13T17:13:43.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.615+0000 7fed1c675740 1 -- start start 2024-09-13T17:13:43.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.615+0000 7fed1c675740 1 Processor -- start 2024-09-13T17:13:43.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.616+0000 7fed1c675740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a4fd87710 0x555a4fd912b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.616+0000 7fed1c675740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555a4fd88050 0x555a4fd917f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.616+0000 7fed1c675740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a4fd8d0e0 0x555a4fd98830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.616+0000 7fed1c675740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a4fce8bf0 con 0x555a4fd87710 2024-09-13T17:13:43.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.616+0000 7fed1c675740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a4fca7250 con 0x555a4fd88050 2024-09-13T17:13:43.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.616+0000 7fed1c675740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a4fca6ef0 con 0x555a4fd8d0e0 2024-09-13T17:13:43.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.616+0000 7fed1c675740 10 client.0 _ll_register_callbacks cb 0x555a4fcd9740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:13:43.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.616+0000 7fed127fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a4fd87710 0x555a4fd912b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.616+0000 7fed127fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a4fd87710 0x555a4fd912b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39710/0 (socket says 172.21.15.87:39710) 2024-09-13T17:13:43.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.616+0000 7fed127fc640 1 -- 172.21.15.87:0/4058041514 learned_addr learned my addr 172.21.15.87:0/4058041514 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:43.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.616+0000 7fed12ffd640 1 --2- 172.21.15.87:0/4058041514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555a4fd88050 0x555a4fd917f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.616+0000 7fed127fc640 1 --2- 172.21.15.87:0/4058041514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a4fd8d0e0 0x555a4fd98830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.616+0000 7fed127fc640 1 -- 172.21.15.87:0/4058041514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a4fd8d0e0 msgr2=0x555a4fd98830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:43.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.616+0000 7fed127fc640 1 --2- 172.21.15.87:0/4058041514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a4fd8d0e0 0x555a4fd98830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.616+0000 7fed127fc640 1 -- 172.21.15.87:0/4058041514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555a4fd88050 msgr2=0x555a4fd917f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:43.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.616+0000 7fed127fc640 1 --2- 172.21.15.87:0/4058041514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555a4fd88050 0x555a4fd917f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.616+0000 7fed127fc640 1 -- 172.21.15.87:0/4058041514 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed08009980 con 0x555a4fd87710 2024-09-13T17:13:43.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.616+0000 7fed127fc640 1 --2- 172.21.15.87:0/4058041514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a4fd87710 0x555a4fd912b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fed08009600 tx=0x7fed08009400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a366ee60eae2ef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:43.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.616+0000 7fecf2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:13:43.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.616+0000 7fecf2ffd640 1 -- 172.21.15.87:0/4058041514 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed08013810 con 0x555a4fd87710 2024-09-13T17:13:43.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.616+0000 7fecf2ffd640 1 -- 172.21.15.87:0/4058041514 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7fed08013970 con 0x555a4fd87710 2024-09-13T17:13:43.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.616+0000 7fed1c675740 1 -- 172.21.15.87:0/4058041514 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555a4f9dc3c0 con 0x555a4fd87710 2024-09-13T17:13:43.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.616+0000 7fecf2ffd640 1 -- 172.21.15.87:0/4058041514 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed08013b30 con 0x555a4fd87710 2024-09-13T17:13:43.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.617+0000 7fed1c675740 10 client.15477 fetch_fsmap learned FSMap version 23 2024-09-13T17:13:43.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.617+0000 7fed1c675740 1 -- 172.21.15.87:0/4058041514 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x555a4fce7270 con 0x555a4fd87710 2024-09-13T17:13:43.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.617+0000 7fecf2ffd640 1 -- 172.21.15.87:0/4058041514 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x555a4f9dc3c0 con 0x555a4fd87710 2024-09-13T17:13:43.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.617+0000 7fecf2ffd640 1 -- 172.21.15.87:0/4058041514 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 23) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fed0801bb90 con 0x555a4fd87710 2024-09-13T17:13:43.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.617+0000 7fed1c675740 10 client.15477 fetch_fsmap finished waiting for FSMap version 23 2024-09-13T17:13:43.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.617+0000 7fed1c675740 10 client.15477 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-13T17:13:43.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.617+0000 7fed1c675740 20 client.15477 populate_metadata read hostname 'smithi087' 2024-09-13T17:13:43.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.617+0000 7fed1c675740 1 --2- 172.21.15.87:0/4058041514 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x555a4fd9d660 0x555a4fda17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.617+0000 7fed1c675740 4 client.15477 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:13:43.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.617+0000 7fed1c675740 1 -- 172.21.15.87:0/4058041514 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555a4f9ed6c0 con 0x555a4fd9d660 2024-09-13T17:13:43.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.617+0000 7fed12ffd640 1 --2- 172.21.15.87:0/4058041514 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x555a4fd9d660 0x555a4fda17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.618+0000 7fecf2ffd640 10 client.15477 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:13:43.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.618+0000 7fed12ffd640 1 --2- 172.21.15.87:0/4058041514 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x555a4fd9d660 0x555a4fda17e0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97e85fa2d21e757b server_cookie=228c5bc84f8a868c in_seq=0 out_seq=0 2024-09-13T17:13:43.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.618+0000 7fecf2ffd640 1 -- 172.21.15.87:0/4058041514 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x555a4f9ed6c0 con 0x555a4fd9d660 2024-09-13T17:13:43.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.618+0000 7fecf2ffd640 10 client.15477 handle_command_reply: tid=0 2024-09-13T17:13:43.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.618+0000 7fed1c675740 1 client.15477 shutdown 2024-09-13T17:13:43.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.618+0000 7fed1c675740 1 -- 172.21.15.87:0/4058041514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a4fd87710 msgr2=0x555a4fd912b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.618+0000 7fed1c675740 1 --2- 172.21.15.87:0/4058041514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a4fd87710 0x555a4fd912b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fed08009600 tx=0x7fed08009400 comp rx=0 tx=0).stop 2024-09-13T17:13:43.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.618+0000 7fed1c675740 1 -- 172.21.15.87:0/4058041514 shutdown_connections 2024-09-13T17:13:43.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.618+0000 7fed1c675740 1 --2- 172.21.15.87:0/4058041514 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x555a4fd9d660 0x555a4fda17e0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.618+0000 7fed1c675740 1 --2- 172.21.15.87:0/4058041514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a4fd8d0e0 0x555a4fd98830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.618+0000 7fed1c675740 1 --2- 172.21.15.87:0/4058041514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555a4fd88050 0x555a4fd917f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.618+0000 7fed1c675740 1 --2- 172.21.15.87:0/4058041514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a4fd87710 0x555a4fd912b0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.618+0000 7fecf2ffd640 0 client.15477 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:13:43.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.618+0000 7fed1c675740 1 -- 172.21.15.87:0/4058041514 >> 172.21.15.87:0/4058041514 conn(0x555a4fd82d80 msgr2=0x555a4fd84590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:43.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.618+0000 7fed1c675740 1 -- 172.21.15.87:0/4058041514 shutdown_connections 2024-09-13T17:13:43.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.618+0000 7fed1c675740 1 -- 172.21.15.87:0/4058041514 wait complete. 2024-09-13T17:13:43.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.619+0000 7fed1c675740 20 client.15477 trim_cache size 0 max 16384 2024-09-13T17:13:43.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.633+0000 7fed1c675740 1 Processor -- start 2024-09-13T17:13:43.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.633+0000 7fed1c675740 1 -- start start 2024-09-13T17:13:43.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.633+0000 7fed1c675740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555a4fd82d80 0x555a4fd87af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.633+0000 7fed1c675740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a4fd87710 0x555a4fd91880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.633+0000 7fed1c675740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a4fd88050 0x555a4fda5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.633+0000 7fed1c675740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a4fc6c460 con 0x555a4fd88050 2024-09-13T17:13:43.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.633+0000 7fed1c675740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a4fd7bc80 con 0x555a4fd82d80 2024-09-13T17:13:43.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.633+0000 7fed1c675740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a4fd887a0 con 0x555a4fd87710 2024-09-13T17:13:43.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.633+0000 7fed127fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a4fd88050 0x555a4fda5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.633+0000 7fed127fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a4fd88050 0x555a4fda5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39726/0 (socket says 172.21.15.87:39726) 2024-09-13T17:13:43.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.633+0000 7fed127fc640 1 -- 172.21.15.87:0/4269854547 learned_addr learned my addr 172.21.15.87:0/4269854547 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:43.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.633+0000 7fed127fc640 1 -- 172.21.15.87:0/4269854547 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a4fd87710 msgr2=0x555a4fd91880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:43.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.633+0000 7fed12ffd640 1 --2- 172.21.15.87:0/4269854547 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a4fd87710 0x555a4fd91880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.633+0000 7fed127fc640 1 --2- 172.21.15.87:0/4269854547 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a4fd87710 0x555a4fd91880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.633+0000 7fed127fc640 1 -- 172.21.15.87:0/4269854547 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555a4fd82d80 msgr2=0x555a4fd87af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:43.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.633+0000 7fed127fc640 1 --2- 172.21.15.87:0/4269854547 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555a4fd82d80 0x555a4fd87af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.633+0000 7fed127fc640 1 -- 172.21.15.87:0/4269854547 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a4fc895f0 con 0x555a4fd88050 2024-09-13T17:13:43.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.633+0000 7fed12ffd640 1 --2- 172.21.15.87:0/4269854547 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a4fd87710 0x555a4fd91880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:43.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.633+0000 7fed127fc640 1 --2- 172.21.15.87:0/4269854547 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a4fd88050 0x555a4fda5f10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fed08001eb0 tx=0x7fed08012760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5da386b1bf336c1a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:43.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.634+0000 7fecfa7fc640 1 -- 172.21.15.87:0/4269854547 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed08009ba0 con 0x555a4fd88050 2024-09-13T17:13:43.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.634+0000 7fecfa7fc640 1 -- 172.21.15.87:0/4269854547 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fed0802b470 con 0x555a4fd88050 2024-09-13T17:13:43.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.634+0000 7fecfa7fc640 1 -- 172.21.15.87:0/4269854547 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0802b800 con 0x555a4fd88050 2024-09-13T17:13:43.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.634+0000 7fed1c675740 1 -- 172.21.15.87:0/4269854547 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a4fd88050 msgr2=0x555a4fda5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.634+0000 7fed1c675740 1 --2- 172.21.15.87:0/4269854547 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a4fd88050 0x555a4fda5f10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fed08001eb0 tx=0x7fed08012760 comp rx=0 tx=0).stop 2024-09-13T17:13:43.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.634+0000 7fed1c675740 1 -- 172.21.15.87:0/4269854547 shutdown_connections 2024-09-13T17:13:43.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.634+0000 7fed1c675740 1 --2- 172.21.15.87:0/4269854547 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a4fd88050 0x555a4fda5f10 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.634+0000 7fed1c675740 1 --2- 172.21.15.87:0/4269854547 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a4fd87710 0x555a4fd91880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.634+0000 7fed1c675740 1 --2- 172.21.15.87:0/4269854547 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555a4fd82d80 0x555a4fd87af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.634+0000 7fed1c675740 1 -- 172.21.15.87:0/4269854547 >> 172.21.15.87:0/4269854547 conn(0x555a4fd8f840 msgr2=0x555a4fda5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:43.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.634+0000 7fed1c675740 1 -- 172.21.15.87:0/4269854547 shutdown_connections 2024-09-13T17:13:43.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.634+0000 7fed1c675740 1 -- 172.21.15.87:0/4269854547 wait complete. 2024-09-13T17:13:43.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.634+0000 7fed1c675740 1 -- start start 2024-09-13T17:13:43.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.635+0000 7fed1c675740 1 Processor -- start 2024-09-13T17:13:43.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.635+0000 7fed1c675740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a4fd82d80 0x555a4fd80be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.635+0000 7fed1c675740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555a4fd87710 0x555a4fd81120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.635+0000 7fed1c675740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a4fd88050 0x555a4fd81660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.635+0000 7fed1c675740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a4fdf5580 con 0x555a4fd88050 2024-09-13T17:13:43.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.635+0000 7fed1c675740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a4fdf56f0 con 0x555a4fd87710 2024-09-13T17:13:43.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.635+0000 7fed1c675740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a4fdf58b0 con 0x555a4fd82d80 2024-09-13T17:13:43.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.635+0000 7fed1c675740 10 client.0 _ll_register_callbacks cb 0x7fed08009630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:13:43.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.635+0000 7fed127fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a4fd88050 0x555a4fd81660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.635+0000 7fed127fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a4fd88050 0x555a4fd81660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39730/0 (socket says 172.21.15.87:39730) 2024-09-13T17:13:43.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.635+0000 7fed127fc640 1 -- 172.21.15.87:0/1480564050 learned_addr learned my addr 172.21.15.87:0/1480564050 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:43.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.635+0000 7fed127fc640 1 --2- 172.21.15.87:0/1480564050 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a4fd82d80 0x555a4fd80be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.635+0000 7fed12ffd640 1 --2- 172.21.15.87:0/1480564050 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555a4fd87710 0x555a4fd81120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.635+0000 7fed127fc640 1 -- 172.21.15.87:0/1480564050 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a4fd82d80 msgr2=0x555a4fd80be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:43.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.635+0000 7fed127fc640 1 --2- 172.21.15.87:0/1480564050 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a4fd82d80 0x555a4fd80be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.635+0000 7fed127fc640 1 -- 172.21.15.87:0/1480564050 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555a4fd87710 msgr2=0x555a4fd81120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:43.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.635+0000 7fed127fc640 1 --2- 172.21.15.87:0/1480564050 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555a4fd87710 0x555a4fd81120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.635+0000 7fed127fc640 1 -- 172.21.15.87:0/1480564050 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555a4fce7270 con 0x555a4fd88050 2024-09-13T17:13:43.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.635+0000 7fed127fc640 1 --2- 172.21.15.87:0/1480564050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a4fd88050 0x555a4fd81660 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x555a4fd98d40 tx=0x7fed0801d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c73fc2c93924ad9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:43.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.635+0000 7fecf2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:13:43.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.636+0000 7fecf2ffd640 1 -- 172.21.15.87:0/1480564050 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed08005230 con 0x555a4fd88050 2024-09-13T17:13:43.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.636+0000 7fecf2ffd640 1 -- 172.21.15.87:0/1480564050 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7fed08000e40 con 0x555a4fd88050 2024-09-13T17:13:43.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.636+0000 7fed1c675740 1 -- 172.21.15.87:0/1480564050 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fed080035f0 con 0x555a4fd88050 2024-09-13T17:13:43.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.636+0000 7fecf2ffd640 1 -- 172.21.15.87:0/1480564050 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed08005390 con 0x555a4fd88050 2024-09-13T17:13:43.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.636+0000 7fed1c675740 10 client.15483 fetch_fsmap learned FSMap version 23 2024-09-13T17:13:43.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.636+0000 7fed1c675740 1 -- 172.21.15.87:0/1480564050 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x555a4fcaed00 con 0x555a4fd88050 2024-09-13T17:13:43.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.636+0000 7fecf2ffd640 1 -- 172.21.15.87:0/1480564050 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fed080035f0 con 0x555a4fd88050 2024-09-13T17:13:43.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.636+0000 7fecf2ffd640 1 -- 172.21.15.87:0/1480564050 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 23) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fed08040020 con 0x555a4fd88050 2024-09-13T17:13:43.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.636+0000 7fed1c675740 10 client.15483 fetch_fsmap finished waiting for FSMap version 23 2024-09-13T17:13:43.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.636+0000 7fed1c675740 10 client.15483 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-13T17:13:43.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.636+0000 7fed1c675740 20 client.15483 populate_metadata read hostname 'smithi087' 2024-09-13T17:13:43.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.636+0000 7fed1c675740 1 --2- 172.21.15.87:0/1480564050 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x555a4fd8d0e0 0x555a4fdf6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.636+0000 7fed1c675740 4 client.15483 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:13:43.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.636+0000 7fed1c675740 1 -- 172.21.15.87:0/1480564050 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555a4fa40d10 con 0x555a4fd8d0e0 2024-09-13T17:13:43.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.636+0000 7fed12ffd640 1 --2- 172.21.15.87:0/1480564050 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x555a4fd8d0e0 0x555a4fdf6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.637+0000 7fecf2ffd640 10 client.15483 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:13:43.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.637+0000 7fed12ffd640 1 --2- 172.21.15.87:0/1480564050 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x555a4fd8d0e0 0x555a4fdf6bb0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=670ab537c3d57a7b server_cookie=ad6eb18546d91e88 in_seq=0 out_seq=0 2024-09-13T17:13:43.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.637+0000 7fecf2ffd640 1 -- 172.21.15.87:0/1480564050 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x555a4fa40d10 con 0x555a4fd8d0e0 2024-09-13T17:13:43.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.637+0000 7fecf2ffd640 10 client.15483 handle_command_reply: tid=0 2024-09-13T17:13:43.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.637+0000 7fed1c675740 1 client.15483 shutdown 2024-09-13T17:13:43.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.637+0000 7fed1c675740 1 -- 172.21.15.87:0/1480564050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a4fd88050 msgr2=0x555a4fd81660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.637+0000 7fed1c675740 1 --2- 172.21.15.87:0/1480564050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a4fd88050 0x555a4fd81660 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x555a4fd98d40 tx=0x7fed0801d040 comp rx=0 tx=0).stop 2024-09-13T17:13:43.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.637+0000 7fed1c675740 1 -- 172.21.15.87:0/1480564050 shutdown_connections 2024-09-13T17:13:43.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.637+0000 7fed1c675740 1 --2- 172.21.15.87:0/1480564050 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x555a4fd8d0e0 0x555a4fdf6bb0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.637+0000 7fed1c675740 1 --2- 172.21.15.87:0/1480564050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a4fd88050 0x555a4fd81660 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.637+0000 7fed1c675740 1 --2- 172.21.15.87:0/1480564050 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555a4fd87710 0x555a4fd81120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.637+0000 7fecf2ffd640 0 client.15483 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:13:43.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.637+0000 7fed1c675740 1 --2- 172.21.15.87:0/1480564050 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555a4fd82d80 0x555a4fd80be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.637+0000 7fed1c675740 1 -- 172.21.15.87:0/1480564050 >> 172.21.15.87:0/1480564050 conn(0x555a4fd8f840 msgr2=0x555a4fda6020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:43.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.637+0000 7fed1c675740 1 -- 172.21.15.87:0/1480564050 shutdown_connections 2024-09-13T17:13:43.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.637+0000 7fed1c675740 1 -- 172.21.15.87:0/1480564050 wait complete. 2024-09-13T17:13:43.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.637+0000 7fed1c675740 20 client.15483 trim_cache size 0 max 16384 2024-09-13T17:13:43.646 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:13:43.646 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_fsid": "043d5bae-71f2-11ef-bceb-c7b262605968", 2024-09-13T17:13:43.646 INFO:teuthology.orchestra.run.smithi087.stdout: "whoami": 0, 2024-09-13T17:13:43.646 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 24499, 2024-09-13T17:13:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: "want_state": "up:active", 2024-09-13T17:13:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: "state": "up:active", 2024-09-13T17:13:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs", 2024-09-13T17:13:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: "rank_uptime": 140.32081820299999, 2024-09-13T17:13:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: "mdsmap_epoch": 23, 2024-09-13T17:13:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch": 93, 2024-09-13T17:13:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch_barrier": 89, 2024-09-13T17:13:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: "uptime": 153.98630843500001 2024-09-13T17:13:43.647 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:13:43.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.638+0000 7fed19953640 1 -- 172.21.15.87:0/362489205 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fecfc0a1090 msgr2=0x7fecfc0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.638+0000 7fed19953640 1 --2- 172.21.15.87:0/362489205 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fecfc0a1090 0x7fecfc0a3550 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fed0c00ccb0 tx=0x7fed0c06d350 comp rx=0 tx=0).stop 2024-09-13T17:13:43.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.638+0000 7fed19953640 1 -- 172.21.15.87:0/362489205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed14100820 msgr2=0x7fed1419c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.638+0000 7fed19953640 1 --2- 172.21.15.87:0/362489205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed14100820 0x7fed1419c1e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fed0c00cce0 tx=0x7fed0c00a620 comp rx=0 tx=0).stop 2024-09-13T17:13:43.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.638+0000 7fed19953640 1 -- 172.21.15.87:0/362489205 shutdown_connections 2024-09-13T17:13:43.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.638+0000 7fed19953640 1 --2- 172.21.15.87:0/362489205 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fecfc0a1090 0x7fecfc0a3550 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.638+0000 7fed19953640 1 --2- 172.21.15.87:0/362489205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed14100820 0x7fed1419c1e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.638+0000 7fed19953640 1 --2- 172.21.15.87:0/362489205 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed140ffe60 0x7fed141951b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.638+0000 7fed19953640 1 --2- 172.21.15.87:0/362489205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed140fec70 0x7fed14194c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.638+0000 7fed19953640 1 -- 172.21.15.87:0/362489205 >> 172.21.15.87:0/362489205 conn(0x7fed140fa410 msgr2=0x7fed141032a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:43.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.638+0000 7fed19953640 1 -- 172.21.15.87:0/362489205 shutdown_connections 2024-09-13T17:13:43.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.638+0000 7fed19953640 1 -- 172.21.15.87:0/362489205 wait complete. 2024-09-13T17:13:43.650 INFO:teuthology.run_tasks:Running task sequential... 2024-09-13T17:13:43.660 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-13T17:13:43.660 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-13T17:13:43.660 INFO:teuthology.task.print:Enabling mgr modules 2024-09-13T17:13:43.660 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-09-13T17:13:43.661 INFO:teuthology.task.exec:Executing custom commands... 2024-09-13T17:13:43.661 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T17:13:43.661 DEBUG:teuthology.orchestra.run.smithi087:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-09-13T17:13:43.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.758+0000 7f1bdb6d0640 1 -- 172.21.15.87:0/2447123496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bd40fec10 msgr2=0x7f1bd40ff010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.758+0000 7f1bdb6d0640 1 --2- 172.21.15.87:0/2447123496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bd40fec10 0x7f1bd40ff010 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0009900 tx=0x7f1bd002a410 comp rx=0 tx=0).stop 2024-09-13T17:13:43.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.758+0000 7f1bdb6d0640 1 -- 172.21.15.87:0/2447123496 shutdown_connections 2024-09-13T17:13:43.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.758+0000 7f1bdb6d0640 1 --2- 172.21.15.87:0/2447123496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bd41007c0 0x7f1bd4107050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.758+0000 7f1bdb6d0640 1 --2- 172.21.15.87:0/2447123496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1bd40ffe00 0x7f1bd4100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.758+0000 7f1bdb6d0640 1 --2- 172.21.15.87:0/2447123496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bd40fec10 0x7f1bd40ff010 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.758+0000 7f1bdb6d0640 1 -- 172.21.15.87:0/2447123496 >> 172.21.15.87:0/2447123496 conn(0x7f1bd40fa370 msgr2=0x7f1bd40fc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:43.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.758+0000 7f1bdb6d0640 1 -- 172.21.15.87:0/2447123496 shutdown_connections 2024-09-13T17:13:43.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.758+0000 7f1bdb6d0640 1 -- 172.21.15.87:0/2447123496 wait complete. 2024-09-13T17:13:43.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.759+0000 7f1bdb6d0640 1 Processor -- start 2024-09-13T17:13:43.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.759+0000 7f1bdb6d0640 1 -- start start 2024-09-13T17:13:43.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.759+0000 7f1bdb6d0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1bd40fec10 0x7f1bd40690e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.759+0000 7f1bdb6d0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bd40ffe00 0x7f1bd419aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.759+0000 7f1bdb6d0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bd41007c0 0x7f1bd419d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.759+0000 7f1bdb6d0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd419d980 con 0x7f1bd41007c0 2024-09-13T17:13:43.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.759+0000 7f1bdb6d0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd419daf0 con 0x7f1bd40fec10 2024-09-13T17:13:43.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.759+0000 7f1bdb6d0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd419dcb0 con 0x7f1bd40ffe00 2024-09-13T17:13:43.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.759+0000 7f1bd9c6d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bd41007c0 0x7f1bd419d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.759+0000 7f1bd9c6d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bd41007c0 0x7f1bd419d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39756/0 (socket says 172.21.15.87:39756) 2024-09-13T17:13:43.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.759+0000 7f1bd9c6d640 1 -- 172.21.15.87:0/2817576445 learned_addr learned my addr 172.21.15.87:0/2817576445 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:43.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.759+0000 7f1bd8c6b640 1 --2- 172.21.15.87:0/2817576445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bd40ffe00 0x7f1bd419aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.759+0000 7f1bd946c640 1 --2- 172.21.15.87:0/2817576445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1bd40fec10 0x7f1bd40690e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.759+0000 7f1bd9c6d640 1 -- 172.21.15.87:0/2817576445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bd40ffe00 msgr2=0x7f1bd419aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.759+0000 7f1bd9c6d640 1 --2- 172.21.15.87:0/2817576445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bd40ffe00 0x7f1bd419aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.759+0000 7f1bd9c6d640 1 -- 172.21.15.87:0/2817576445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1bd40fec10 msgr2=0x7f1bd40690e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:43.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.759+0000 7f1bd9c6d640 1 --2- 172.21.15.87:0/2817576445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1bd40fec10 0x7f1bd40690e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:43.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.759+0000 7f1bd9c6d640 1 -- 172.21.15.87:0/2817576445 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd0009560 con 0x7f1bd41007c0 2024-09-13T17:13:43.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.759+0000 7f1bd9c6d640 1 --2- 172.21.15.87:0/2817576445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bd41007c0 0x7f1bd419d1f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc00b970 tx=0x7f1bcc00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:43.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.760+0000 7f1bca7fc640 1 -- 172.21.15.87:0/2817576445 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc00caa0 con 0x7f1bd41007c0 2024-09-13T17:13:43.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.760+0000 7f1bca7fc640 1 -- 172.21.15.87:0/2817576445 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1bcc00cc00 con 0x7f1bd41007c0 2024-09-13T17:13:43.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.760+0000 7f1bdb6d0640 1 -- 172.21.15.87:0/2817576445 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd419df90 con 0x7f1bd41007c0 2024-09-13T17:13:43.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.760+0000 7f1bca7fc640 1 -- 172.21.15.87:0/2817576445 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc0075d0 con 0x7f1bd41007c0 2024-09-13T17:13:43.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.760+0000 7f1bdb6d0640 1 -- 172.21.15.87:0/2817576445 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd419e4e0 con 0x7f1bd41007c0 2024-09-13T17:13:43.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.761+0000 7f1bdb6d0640 1 -- 172.21.15.87:0/2817576445 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd4106190 con 0x7f1bd41007c0 2024-09-13T17:13:43.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.762+0000 7f1bca7fc640 1 -- 172.21.15.87:0/2817576445 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1bcc014440 con 0x7f1bd41007c0 2024-09-13T17:13:43.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.762+0000 7f1bca7fc640 1 --2- 172.21.15.87:0/2817576445 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f1bc00a1110 0x7f1bc00a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:43.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.762+0000 7f1bd946c640 1 --2- 172.21.15.87:0/2817576445 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f1bc00a1110 0x7f1bc00a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:43.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.762+0000 7f1bca7fc640 1 -- 172.21.15.87:0/2817576445 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7f1bcc0cc3d0 con 0x7f1bd41007c0 2024-09-13T17:13:43.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.763+0000 7f1bd946c640 1 --2- 172.21.15.87:0/2817576445 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f1bc00a1110 0x7f1bc00a35d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0005940 tx=0x7f1bd00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:43.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.766+0000 7f1bca7fc640 1 -- 172.21.15.87:0/2817576445 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1bcc095840 con 0x7f1bd41007c0 2024-09-13T17:13:43.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:43 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2649493884' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:13:43.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:43 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2761116226' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:13:43.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:43 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/688241689' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:13:43.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:43 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2649493884' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:13:43.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:43 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2761116226' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:13:43.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:43 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/688241689' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:13:43.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:43.975+0000 7f1bdb6d0640 1 -- 172.21.15.87:0/2817576445 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f1bd402c480 con 0x7f1bd41007c0 2024-09-13T17:13:44.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:44.420+0000 7f1bca7fc640 1 -- 172.21.15.87:0/2817576445 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mgrmap(e 19) v1 ==== 135890+0+0 (secure 0 0 0) 0x7f1bcc082d50 con 0x7f1bd41007c0 2024-09-13T17:13:44.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:44.422+0000 7f1bca7fc640 1 -- 172.21.15.87:0/2817576445 <== mon.0 v2:172.21.15.87:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) v1 ==== 92+0+0 (secure 0 0 0) 0x7f1bcc0992d0 con 0x7f1bd41007c0 2024-09-13T17:13:44.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:44.424+0000 7f1bdb6d0640 1 -- 172.21.15.87:0/2817576445 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f1bc00a1110 msgr2=0x7f1bc00a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:44.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:44.424+0000 7f1bdb6d0640 1 --2- 172.21.15.87:0/2817576445 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f1bc00a1110 0x7f1bc00a35d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0005940 tx=0x7f1bd00058d0 comp rx=0 tx=0).stop 2024-09-13T17:13:44.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:44.424+0000 7f1bdb6d0640 1 -- 172.21.15.87:0/2817576445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bd41007c0 msgr2=0x7f1bd419d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:44.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:44.424+0000 7f1bdb6d0640 1 --2- 172.21.15.87:0/2817576445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bd41007c0 0x7f1bd419d1f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc00b970 tx=0x7f1bcc00bd70 comp rx=0 tx=0).stop 2024-09-13T17:13:44.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:44.424+0000 7f1bdb6d0640 1 -- 172.21.15.87:0/2817576445 shutdown_connections 2024-09-13T17:13:44.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:44.424+0000 7f1bdb6d0640 1 --2- 172.21.15.87:0/2817576445 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7f1bc00a1110 0x7f1bc00a35d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:44.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:44.424+0000 7f1bdb6d0640 1 --2- 172.21.15.87:0/2817576445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bd41007c0 0x7f1bd419d1f0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:44.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:44.424+0000 7f1bdb6d0640 1 --2- 172.21.15.87:0/2817576445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bd40ffe00 0x7f1bd419aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:44.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:44.424+0000 7f1bdb6d0640 1 --2- 172.21.15.87:0/2817576445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1bd40fec10 0x7f1bd40690e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:44.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:44.424+0000 7f1bdb6d0640 1 -- 172.21.15.87:0/2817576445 >> 172.21.15.87:0/2817576445 conn(0x7f1bd40fa370 msgr2=0x7f1bd4103360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:44.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:44.424+0000 7f1bdb6d0640 1 -- 172.21.15.87:0/2817576445 shutdown_connections 2024-09-13T17:13:44.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:44.424+0000 7f1bdb6d0640 1 -- 172.21.15.87:0/2817576445 wait complete. 2024-09-13T17:13:44.437 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-13T17:13:44.448 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-13T17:13:44.448 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-13T17:13:44.448 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-09-13T17:13:44.448 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T17:13:44.448 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T17:13:44.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:44.449 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-09-13T17:13:44.465 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-13T17:13:44.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:44.466 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-13T17:13:44.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:44.535 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link delete ceph-brx 2024-09-13T17:13:44.642 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-13T17:13:44.642 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-13T17:13:44.643 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-13T17:13:44.666 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:44 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2817576445' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-13T17:13:44.666 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:44 smithi087 ceph-mon[30934]: pgmap v351: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T17:13:44.666 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:44 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: ignoring --setuser ceph since I am not root 2024-09-13T17:13:44.666 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:44 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: ignoring --setgroup ceph since I am not root 2024-09-13T17:13:44.666 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:44 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:44.569+0000 7f654f832040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T17:13:44.666 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:44 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:44.628+0000 7f654f832040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T17:13:44.762 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:44 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2817576445' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-13T17:13:44.762 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:44 smithi149 ceph-mon[35496]: pgmap v351: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T17:13:44.762 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:44 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2817576445' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-13T17:13:44.762 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:44 smithi118 ceph-mon[34374]: pgmap v351: 129 pgs: 129 active+clean; 642 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T17:13:44.763 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:13:44 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: ignoring --setuser ceph since I am not root 2024-09-13T17:13:44.763 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:13:44 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: ignoring --setgroup ceph since I am not root 2024-09-13T17:13:44.763 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:13:44 smithi149 ceph-mgr[37436]: -- 172.21.15.149:0/1659255910 <== mon.1 v2:172.21.15.149:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555ffbf8cd00 con 0x555ffbf61400 2024-09-13T17:13:44.763 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:13:44 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:13:44.557+0000 7f8070270040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T17:13:44.763 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:13:44 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:13:44.613+0000 7f8070270040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T17:13:44.763 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:13:44 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: ignoring --setuser ceph since I am not root 2024-09-13T17:13:44.763 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:13:44 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: ignoring --setgroup ceph since I am not root 2024-09-13T17:13:44.763 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:13:44 smithi118 ceph-mgr[35775]: -- 172.21.15.118:0/1622233751 <== mon.2 v2:172.21.15.118:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564c1cd26d00 con 0x564c1ccfb000 2024-09-13T17:13:44.763 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:13:44 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:13:44.557+0000 7f5c4d137040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T17:13:44.764 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:13:44 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:13:44.613+0000 7f5c4d137040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T17:13:44.764 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:13:44 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:13:44.759+0000 7f5c4d137040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T17:13:44.846 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:13:44.967 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:44 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:44.786+0000 7f654f832040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T17:13:44.967 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:44 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:44.859+0000 7f654f832040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T17:13:45.092 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:13:44 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:13:44.760+0000 7f8070270040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T17:13:45.092 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:13:44 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:13:44.825+0000 7f8070270040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T17:13:45.092 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:13:44 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:13:44.970+0000 7f8070270040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:13:45.111 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:13:44 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:13:44.826+0000 7f5c4d137040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T17:13:45.112 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:13:44 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:13:44.970+0000 7f5c4d137040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:13:45.112 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:13:45 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:13:45.109+0000 7f5c4d137040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T17:13:45.229 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:45 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:45.007+0000 7f654f832040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:13:45.229 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:45 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:45.153+0000 7f654f832040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T17:13:45.413 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:13:45 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:13:45.110+0000 7f8070270040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T17:13:45.524 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:45 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:45.463+0000 7f654f832040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T17:13:45.524 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:45 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2817576445' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-13T17:13:45.525 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:45 smithi087 ceph-mon[30934]: mgrmap e19: x(active, since 8m), standbys: y, z 2024-09-13T17:13:45.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:45 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2817576445' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-13T17:13:45.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:45 smithi149 ceph-mon[35496]: mgrmap e19: x(active, since 8m), standbys: y, z 2024-09-13T17:13:45.842 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:13:45 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:13:45.414+0000 7f8070270040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T17:13:45.842 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:13:45 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:13:45.475+0000 7f8070270040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T17:13:45.842 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:13:45 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:13:45.654+0000 7f8070270040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T17:13:45.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:45 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2817576445' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-13T17:13:45.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:45 smithi118 ceph-mon[34374]: mgrmap e19: x(active, since 8m), standbys: y, z 2024-09-13T17:13:45.863 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:13:45 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:13:45.415+0000 7f5c4d137040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T17:13:45.863 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:13:45 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:13:45.477+0000 7f5c4d137040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T17:13:45.863 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:13:45 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:13:45.656+0000 7f5c4d137040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T17:13:45.978 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:45 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:45.523+0000 7f654f832040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T17:13:45.979 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:45 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:45.706+0000 7f654f832040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T17:13:46.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.573+0000 7fc766989640 1 -- 172.21.15.87:0/670277930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc76010c6f0 msgr2=0x7fc76010eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:46.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.573+0000 7fc766989640 1 --2- 172.21.15.87:0/670277930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc76010c6f0 0x7fc76010eae0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc758009ca0 tx=0x7fc75802a8c0 comp rx=0 tx=0).stop 2024-09-13T17:13:46.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.573+0000 7fc766989640 1 -- 172.21.15.87:0/670277930 shutdown_connections 2024-09-13T17:13:46.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.573+0000 7fc766989640 1 --2- 172.21.15.87:0/670277930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc76010c6f0 0x7fc76010eae0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:46.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.573+0000 7fc766989640 1 --2- 172.21.15.87:0/670277930 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7600ff4f0 0x7fc76010c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:46.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.573+0000 7fc766989640 1 --2- 172.21.15.87:0/670277930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc7600feb40 0x7fc7600fef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:46.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.573+0000 7fc766989640 1 -- 172.21.15.87:0/670277930 >> 172.21.15.87:0/670277930 conn(0x7fc7600fa9b0 msgr2=0x7fc7600fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:46.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.573+0000 7fc766989640 1 -- 172.21.15.87:0/670277930 shutdown_connections 2024-09-13T17:13:46.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.573+0000 7fc766989640 1 -- 172.21.15.87:0/670277930 wait complete. 2024-09-13T17:13:46.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.574+0000 7fc766989640 1 Processor -- start 2024-09-13T17:13:46.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.574+0000 7fc766989640 1 -- start start 2024-09-13T17:13:46.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.574+0000 7fc766989640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7600feb40 0x7fc760198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:46.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.574+0000 7fc766989640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7600ff4f0 0x7fc760198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:46.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.574+0000 7fc766989640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc76010c6f0 0x7fc76019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:46.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.574+0000 7fc766989640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76019d390 con 0x7fc7600feb40 2024-09-13T17:13:46.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.574+0000 7fc766989640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76019d500 con 0x7fc76010c6f0 2024-09-13T17:13:46.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.574+0000 7fc766989640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76019d670 con 0x7fc7600ff4f0 2024-09-13T17:13:46.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.575+0000 7fc75ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7600feb40 0x7fc760198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:46.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.575+0000 7fc75ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7600feb40 0x7fc760198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39794/0 (socket says 172.21.15.87:39794) 2024-09-13T17:13:46.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.575+0000 7fc75f7fe640 1 --2- 172.21.15.87:0/3702772913 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7600ff4f0 0x7fc760198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:46.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.575+0000 7fc75ffff640 1 -- 172.21.15.87:0/3702772913 learned_addr learned my addr 172.21.15.87:0/3702772913 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:46.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.575+0000 7fc764f26640 1 --2- 172.21.15.87:0/3702772913 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc76010c6f0 0x7fc76019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:46.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.575+0000 7fc75ffff640 1 -- 172.21.15.87:0/3702772913 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7600ff4f0 msgr2=0x7fc760198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:46.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.575+0000 7fc75ffff640 1 --2- 172.21.15.87:0/3702772913 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7600ff4f0 0x7fc760198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:46.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.575+0000 7fc75ffff640 1 -- 172.21.15.87:0/3702772913 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc76010c6f0 msgr2=0x7fc76019cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:46.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.575+0000 7fc75ffff640 1 --2- 172.21.15.87:0/3702772913 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc76010c6f0 0x7fc76019cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:46.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.575+0000 7fc75ffff640 1 -- 172.21.15.87:0/3702772913 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc758009900 con 0x7fc7600feb40 2024-09-13T17:13:46.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.575+0000 7fc75ffff640 1 --2- 172.21.15.87:0/3702772913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7600feb40 0x7fc760198450 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc75000e9f0 tx=0x7fc75000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:46.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.575+0000 7fc75d7fa640 1 -- 172.21.15.87:0/3702772913 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc750009700 con 0x7fc7600feb40 2024-09-13T17:13:46.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.575+0000 7fc766989640 1 -- 172.21.15.87:0/3702772913 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc76019d950 con 0x7fc7600feb40 2024-09-13T17:13:46.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.575+0000 7fc75d7fa640 1 -- 172.21.15.87:0/3702772913 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc75000cd80 con 0x7fc7600feb40 2024-09-13T17:13:46.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.575+0000 7fc75d7fa640 1 -- 172.21.15.87:0/3702772913 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc750018840 con 0x7fc7600feb40 2024-09-13T17:13:46.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.575+0000 7fc766989640 1 -- 172.21.15.87:0/3702772913 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7601a5210 con 0x7fc7600feb40 2024-09-13T17:13:46.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.576+0000 7fc766989640 1 -- 172.21.15.87:0/3702772913 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc760068760 con 0x7fc7600feb40 2024-09-13T17:13:46.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.578+0000 7fc75d7fa640 1 -- 172.21.15.87:0/3702772913 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 135890+0+0 (secure 0 0 0) 0x7fc7500189a0 con 0x7fc7600feb40 2024-09-13T17:13:46.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.579+0000 7fc75d7fa640 1 --2- 172.21.15.87:0/3702772913 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc7480a10d0 0x7fc7480a3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:46.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.579+0000 7fc75f7fe640 1 -- 172.21.15.87:0/3702772913 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc7480a10d0 msgr2=0x7fc7480a3590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/701043027 2024-09-13T17:13:46.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.579+0000 7fc75d7fa640 1 -- 172.21.15.87:0/3702772913 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7fc750014070 con 0x7fc7600feb40 2024-09-13T17:13:46.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.579+0000 7fc75f7fe640 1 --2- 172.21.15.87:0/3702772913 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc7480a10d0 0x7fc7480a3590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:13:46.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.581+0000 7fc75d7fa640 1 -- 172.21.15.87:0/3702772913 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc750096920 con 0x7fc7600feb40 2024-09-13T17:13:46.671 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:46 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:46.602+0000 7f654f832040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T17:13:46.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.780+0000 7fc75f7fe640 1 -- 172.21.15.87:0/3702772913 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc7480a10d0 msgr2=0x7fc7480a3590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/701043027 2024-09-13T17:13:46.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.780+0000 7fc75f7fe640 1 --2- 172.21.15.87:0/3702772913 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc7480a10d0 0x7fc7480a3590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T17:13:46.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.783+0000 7fc766989640 1 -- 172.21.15.87:0/3702772913 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc76019dae0 con 0x7fc7600feb40 2024-09-13T17:13:46.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.784+0000 7fc75d7fa640 1 -- 172.21.15.87:0/3702772913 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+88 (secure 0 0 0) 0x7fc76019dae0 con 0x7fc7600feb40 2024-09-13T17:13:46.784 INFO:teuthology.orchestra.run.smithi087.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T17:13:46.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.785+0000 7fc766989640 1 -- 172.21.15.87:0/3702772913 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc7480a10d0 msgr2=0x7fc7480a3590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:13:46.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.785+0000 7fc766989640 1 --2- 172.21.15.87:0/3702772913 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc7480a10d0 0x7fc7480a3590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:46.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.785+0000 7fc766989640 1 -- 172.21.15.87:0/3702772913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7600feb40 msgr2=0x7fc760198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:46.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.785+0000 7fc766989640 1 --2- 172.21.15.87:0/3702772913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7600feb40 0x7fc760198450 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc75000e9f0 tx=0x7fc75000eeb0 comp rx=0 tx=0).stop 2024-09-13T17:13:46.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.786+0000 7fc766989640 1 -- 172.21.15.87:0/3702772913 shutdown_connections 2024-09-13T17:13:46.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.786+0000 7fc766989640 1 --2- 172.21.15.87:0/3702772913 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc7480a10d0 0x7fc7480a3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:46.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.786+0000 7fc766989640 1 --2- 172.21.15.87:0/3702772913 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc76010c6f0 0x7fc76019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:46.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.786+0000 7fc766989640 1 --2- 172.21.15.87:0/3702772913 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7600ff4f0 0x7fc760198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:46.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.786+0000 7fc766989640 1 --2- 172.21.15.87:0/3702772913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7600feb40 0x7fc760198450 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:46.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.786+0000 7fc766989640 1 -- 172.21.15.87:0/3702772913 >> 172.21.15.87:0/3702772913 conn(0x7fc7600fa9b0 msgr2=0x7fc7600fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:46.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.786+0000 7fc766989640 1 -- 172.21.15.87:0/3702772913 shutdown_connections 2024-09-13T17:13:46.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:46.786+0000 7fc766989640 1 -- 172.21.15.87:0/3702772913 wait complete. 2024-09-13T17:13:46.836 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:13:46 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:13:46.516+0000 7f5c4d137040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T17:13:46.836 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:13:46 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:13:46.582+0000 7f5c4d137040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T17:13:46.837 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:13:46 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:13:46.518+0000 7f8070270040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T17:13:46.837 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:13:46 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:13:46.584+0000 7f8070270040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T17:13:46.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:46 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3702772913' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T17:13:46.979 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:46 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:46.670+0000 7f654f832040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T17:13:47.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:46 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3702772913' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T17:13:47.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:46 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3702772913' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T17:13:47.463 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:13:47.463 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:13:47.463 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2024-09-13T17:13:47.464 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T17:13:47.464 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T17:13:47.464 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:13:47.464 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:13:47.464 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:13:47.464 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:13:47.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:47.464 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2024-09-13T17:13:47.520 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:13:47.520 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:13:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:13:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-09-13T17:13:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:47.521 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:13:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2024-09-13T17:13:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2024-09-13T17:13:47.521 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:13:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2024-09-13T17:13:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2024-09-13T17:13:47.521 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T17:13:47.521 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:13:47.521 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:13:47.522 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:13:47.522 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T17:13:47.522 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42158sec preferred_lft 42158sec 2024-09-13T17:13:47.522 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link noprefixroute 2024-09-13T17:13:47.522 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:13:47.522 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T17:13:47.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:47.522 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-09-13T17:13:47.522 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-09-13T17:13:47.523 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add name ceph-brx type bridge 2024-09-13T17:13:47.523 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip addr flush dev ceph-brx 2024-09-13T17:13:47.523 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set ceph-brx up 2024-09-13T17:13:47.523 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T17:13:47.523 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-09-13T17:13:47.548 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:13:47 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:13:47.291+0000 7f5c4d137040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T17:13:47.548 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:13:47 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:13:47.406+0000 7f5c4d137040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T17:13:47.556 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:13:47 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:13:47.297+0000 7f8070270040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T17:13:47.556 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:13:47 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:13:47.414+0000 7f8070270040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T17:13:47.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:47.623 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:13:47.648 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-09-13T17:13:47.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:47.649 DEBUG:teuthology.orchestra.run.smithi087:> route 2024-09-13T17:13:47.669 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:47 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:47.397+0000 7f654f832040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T17:13:47.669 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:47 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:47.516+0000 7f654f832040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T17:13:47.684 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2024-09-13T17:13:47.684 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:13:47.684 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:13:47.684 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T17:13:47.684 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:13:47.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:47.685 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-09-13T17:13:47.685 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-09-13T17:13:47.685 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:13:47.685 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:13:47.685 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:13:47.685 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-09-13T17:13:47.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:47.773 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-09-13T17:13:47.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:47.789 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list-id 2024-09-13T17:13:47.818 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:13:47 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:13:47.546+0000 7f5c4d137040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:13:47.818 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:13:47 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:13:47.606+0000 7f5c4d137040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T17:13:47.818 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:13:47 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:13:47.749+0000 7f5c4d137040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T17:13:47.818 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:13:47 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:13:47.816+0000 7f5c4d137040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T17:13:47.833 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:13:47 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:13:47.554+0000 7f8070270040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:13:47.833 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:13:47 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:13:47.615+0000 7f8070270040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T17:13:47.833 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:13:47 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:13:47.760+0000 7f8070270040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T17:13:47.833 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:13:47 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:13:47.831+0000 7f8070270040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T17:13:47.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:47.844 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-09-13T17:13:47.844 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-09-13T17:13:47.844 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:13:47.844 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-13T17:13:47.844 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-09-13T17:13:47.919 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:47 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:47.667+0000 7f654f832040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:13:47.919 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:47 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:47.731+0000 7f654f832040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T17:13:47.919 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:47 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:47.887+0000 7f654f832040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T17:13:47.923 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-13T17:13:47.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:47.924 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-09-13T17:13:47.924 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-09-13T17:13:47.924 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-13T17:13:47.924 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T17:13:47.924 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-13T17:13:47.924 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-13T17:13:47.924 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-13T17:13:47.924 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-09-13T17:13:48.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:48.041 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-09-13T17:13:48.041 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-09-13T17:13:48.041 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2024-09-13T17:13:48.041 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T17:13:48.041 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-09-13T17:13:48.079 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-09-13T17:13:48.079 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:13:48.079 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T17:13:48.092 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:13:47 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:13:47.890+0000 7f8070270040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T17:13:48.092 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:13:48 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:13:48.044+0000 7f8070270040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T17:13:48.098 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:13:47 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:13:47.876+0000 7f5c4d137040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T17:13:48.099 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:13:48 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:13:48.031+0000 7f5c4d137040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T17:13:48.099 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:13:48 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:13:48.096+0000 7f5c4d137040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T17:13:48.135 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:13:48.135 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:13:48.136 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:13:48.191 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T17:13:48.200 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:47 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:47.960+0000 7f654f832040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T17:13:48.200 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:48 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:48.025+0000 7f654f832040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T17:13:48.201 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:48 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:48.199+0000 7f654f832040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T17:13:48.225 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:13:48.225 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:13:48.290 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:13:48.291 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:13:48.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:48.292 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T17:13:48.347 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:13:48.347 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b --client_fs=cephfs) 2024-09-13T17:13:48.361 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:13:48 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:13:48.161+0000 7f5c4d137040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T17:13:48.361 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:13:48 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:13:48.242+0000 7f5c4d137040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T17:13:48.361 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:13:48 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:13:48.301+0000 7f5c4d137040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T17:13:48.361 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:13:48 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:13:48.358+0000 7f5c4d137040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T17:13:48.377 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:13:48 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:13:48.110+0000 7f8070270040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T17:13:48.377 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:13:48 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:13:48.176+0000 7f8070270040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T17:13:48.377 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:13:48 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:13:48.259+0000 7f8070270040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T17:13:48.377 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:13:48 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:13:48.317+0000 7f8070270040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T17:13:48.377 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:13:48 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:13:48.375+0000 7f8070270040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T17:13:48.390 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T17:13:48.414 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:13:48.414 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:13:48.475 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:2024-09-13T17:13:48.474+0000 7fae4ad08480 -1 init, newargv = 0x565447e29430 newargc=15 2024-09-13T17:13:48.475 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[84714]: starting ceph client 2024-09-13T17:13:48.477 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:48 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:48.267+0000 7f654f832040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T17:13:48.477 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:48 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:48.336+0000 7f654f832040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T17:13:48.477 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:48 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:48.423+0000 7f654f832040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T17:13:48.480 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:13:48.481 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:13:48.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:48.482 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T17:13:48.488 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[84714]: starting fuse 2024-09-13T17:13:48.503 INFO:teuthology.orchestra.run.smithi087.stdout:120 2024-09-13T17:13:48.503 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-13T17:13:48.503 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:13:48.503 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2024-09-13T17:13:48.503 DEBUG:teuthology.orchestra.run.smithi087:> import re 2024-09-13T17:13:48.503 DEBUG:teuthology.orchestra.run.smithi087:> import os 2024-09-13T17:13:48.504 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2024-09-13T17:13:48.504 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T17:13:48.504 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2024-09-13T17:13:48.504 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T17:13:48.504 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2024-09-13T17:13:48.504 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T17:13:48.504 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T17:13:48.504 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2024-09-13T17:13:48.504 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2024-09-13T17:13:48.504 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2024-09-13T17:13:48.504 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2024-09-13T17:13:48.504 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T17:13:48.504 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2024-09-13T17:13:48.504 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:13:48.505 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:13:48.505 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:13:48.505 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2024-09-13T17:13:48.505 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2024-09-13T17:13:48.505 DEBUG:teuthology.orchestra.run.smithi087:> return f 2024-09-13T17:13:48.505 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:13:48.505 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T17:13:48.505 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.0")) 2024-09-13T17:13:48.505 DEBUG:teuthology.orchestra.run.smithi087:> ' 2024-09-13T17:13:48.619 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.0.84714.asok 2024-09-13T17:13:48.728 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:48 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:48.490+0000 7f654f832040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T17:13:48.729 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:48 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:48.551+0000 7f654f832040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T17:13:48.805 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.84714.asok 2024-09-13T17:13:48.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:48.805 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.84714.asok status 2024-09-13T17:13:48.940 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:13:48.940 INFO:teuthology.orchestra.run.smithi087.stdout: "metadata": { 2024-09-13T17:13:48.941 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:13:48.941 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:13:48.941 INFO:teuthology.orchestra.run.smithi087.stdout: "entity_id": "0", 2024-09-13T17:13:48.941 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": "smithi087", 2024-09-13T17:13:48.941 INFO:teuthology.orchestra.run.smithi087.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T17:13:48.941 INFO:teuthology.orchestra.run.smithi087.stdout: "pid": "84714", 2024-09-13T17:13:48.941 INFO:teuthology.orchestra.run.smithi087.stdout: "root": "/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b" 2024-09-13T17:13:48.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:13:48.941 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_count": 0, 2024-09-13T17:13:48.941 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_pinned_count": 0, 2024-09-13T17:13:48.941 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 15519, 2024-09-13T17:13:48.941 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2024-09-13T17:13:48.941 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2024-09-13T17:13:48.942 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2024-09-13T17:13:48.942 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 15519 2024-09-13T17:13:48.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:13:48.942 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-09-13T17:13:48.942 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-13T17:13:48.942 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:13:48.942 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1899499576 2024-09-13T17:13:48.942 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:13:48.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:13:48.942 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-09-13T17:13:48.942 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-13T17:13:48.942 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:13:48.942 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1899499576 2024-09-13T17:13:48.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:13:48.943 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.15519 192.168.0.1:0/1899499576", 2024-09-13T17:13:48.943 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "192.168.0.1:0/1899499576", 2024-09-13T17:13:48.943 INFO:teuthology.orchestra.run.smithi087.stdout: "inode_count": 5, 2024-09-13T17:13:48.943 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_epoch": 23, 2024-09-13T17:13:48.943 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch": 93, 2024-09-13T17:13:48.943 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:13:48.943 INFO:teuthology.orchestra.run.smithi087.stdout: "blocklisted": false, 2024-09-13T17:13:48.943 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs" 2024-09-13T17:13:48.943 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:13:48.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:48.949 DEBUG:teuthology.orchestra.run.smithi087:> stat --file-system '--printf=%T 2024-09-13T17:13:48.949 DEBUG:teuthology.orchestra.run.smithi087:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T17:13:48.965 INFO:teuthology.orchestra.run.smithi087.stdout:fuseblk 2024-09-13T17:13:48.965 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T17:13:48.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:13:48.965 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:13:49.034 INFO:teuthology.run_tasks:Running task exec... 2024-09-13T17:13:49.043 INFO:teuthology.task.exec:Executing custom commands... 2024-09-13T17:13:49.043 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T17:13:49.043 DEBUG:teuthology.orchestra.run.smithi087:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-13T17:13:49.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.176+0000 7fc0f29a3640 1 -- 172.21.15.87:0/1818047451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0ec105a10 msgr2=0x7fc0ec107e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:49.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.176+0000 7fc0f29a3640 1 --2- 172.21.15.87:0/1818047451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0ec105a10 0x7fc0ec107e80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4009ca0 tx=0x7fc0e402a8c0 comp rx=0 tx=0).stop 2024-09-13T17:13:49.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.176+0000 7fc0f29a3640 1 -- 172.21.15.87:0/1818047451 shutdown_connections 2024-09-13T17:13:49.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.176+0000 7fc0f29a3640 1 --2- 172.21.15.87:0/1818047451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0ec105a10 0x7fc0ec107e80 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:49.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.176+0000 7fc0f29a3640 1 --2- 172.21.15.87:0/1818047451 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0ec1030e0 0x7fc0ec1054d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:49.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.176+0000 7fc0f29a3640 1 --2- 172.21.15.87:0/1818047451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0ec1007b0 0x7fc0ec102ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:49.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.176+0000 7fc0f29a3640 1 -- 172.21.15.87:0/1818047451 >> 172.21.15.87:0/1818047451 conn(0x7fc0ec0fa3b0 msgr2=0x7fc0ec0fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:49.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.176+0000 7fc0f29a3640 1 -- 172.21.15.87:0/1818047451 shutdown_connections 2024-09-13T17:13:49.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.176+0000 7fc0f29a3640 1 -- 172.21.15.87:0/1818047451 wait complete. 2024-09-13T17:13:49.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.176+0000 7fc0f29a3640 1 Processor -- start 2024-09-13T17:13:49.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.176+0000 7fc0f29a3640 1 -- start start 2024-09-13T17:13:49.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.177+0000 7fc0f29a3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0ec1007b0 0x7fc0ec195d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:49.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.177+0000 7fc0f29a3640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0ec1030e0 0x7fc0ec196270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:49.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.177+0000 7fc0f29a3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0ec105a10 0x7fc0ec19d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:49.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.177+0000 7fc0f29a3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ec19d810 con 0x7fc0ec105a10 2024-09-13T17:13:49.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.177+0000 7fc0f29a3640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ec19d980 con 0x7fc0ec1007b0 2024-09-13T17:13:49.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.177+0000 7fc0f29a3640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ec19db40 con 0x7fc0ec1030e0 2024-09-13T17:13:49.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.177+0000 7fc0f0f40640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0ec105a10 0x7fc0ec19d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:49.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.177+0000 7fc0ebfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0ec1007b0 0x7fc0ec195d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:49.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.177+0000 7fc0ebfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0ec1007b0 0x7fc0ec195d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.87:33412/0 (socket says 172.21.15.87:33412) 2024-09-13T17:13:49.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.177+0000 7fc0f0f40640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0ec105a10 0x7fc0ec19d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41500/0 (socket says 172.21.15.87:41500) 2024-09-13T17:13:49.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.177+0000 7fc0ebfff640 1 -- 172.21.15.87:0/859507518 learned_addr learned my addr 172.21.15.87:0/859507518 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:49.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.177+0000 7fc0eb7fe640 1 --2- 172.21.15.87:0/859507518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0ec1030e0 0x7fc0ec196270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:49.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.177+0000 7fc0ebfff640 1 -- 172.21.15.87:0/859507518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0ec1030e0 msgr2=0x7fc0ec196270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:49.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.177+0000 7fc0ebfff640 1 --2- 172.21.15.87:0/859507518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0ec1030e0 0x7fc0ec196270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:49.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.177+0000 7fc0ebfff640 1 -- 172.21.15.87:0/859507518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0ec105a10 msgr2=0x7fc0ec19d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:49.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.177+0000 7fc0ebfff640 1 --2- 172.21.15.87:0/859507518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0ec105a10 0x7fc0ec19d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:49.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.177+0000 7fc0ebfff640 1 -- 172.21.15.87:0/859507518 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e0009490 con 0x7fc0ec1007b0 2024-09-13T17:13:49.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.177+0000 7fc0ebfff640 1 --2- 172.21.15.87:0/859507518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0ec1007b0 0x7fc0ec195d30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc00e9f0 tx=0x7fc0dc00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:49.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.178+0000 7fc0e97fa640 1 -- 172.21.15.87:0/859507518 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc009720 con 0x7fc0ec1007b0 2024-09-13T17:13:49.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.178+0000 7fc0f29a3640 1 -- 172.21.15.87:0/859507518 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0e4009900 con 0x7fc0ec1007b0 2024-09-13T17:13:49.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.178+0000 7fc0e97fa640 1 -- 172.21.15.87:0/859507518 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc0dc00cd80 con 0x7fc0ec1007b0 2024-09-13T17:13:49.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.178+0000 7fc0e97fa640 1 -- 172.21.15.87:0/859507518 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc010430 con 0x7fc0ec1007b0 2024-09-13T17:13:49.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.178+0000 7fc0f29a3640 1 -- 172.21.15.87:0/859507518 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0ec19e1a0 con 0x7fc0ec1007b0 2024-09-13T17:13:49.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.179+0000 7fc0f29a3640 1 -- 172.21.15.87:0/859507518 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0ec0fbea0 con 0x7fc0ec1007b0 2024-09-13T17:13:49.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.180+0000 7fc0e97fa640 1 -- 172.21.15.87:0/859507518 <== mon.2 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) v1 ==== 135890+0+0 (secure 0 0 0) 0x7fc0dc005020 con 0x7fc0ec1007b0 2024-09-13T17:13:49.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.180+0000 7fc0e97fa640 1 --2- 172.21.15.87:0/859507518 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc0d40a10e0 0x7fc0d40a35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:49.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.180+0000 7fc0eb7fe640 1 -- 172.21.15.87:0/859507518 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc0d40a10e0 msgr2=0x7fc0d40a35a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/701043027 2024-09-13T17:13:49.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.180+0000 7fc0e97fa640 1 -- 172.21.15.87:0/859507518 <== mon.2 v2:172.21.15.118:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9210+0+0 (secure 0 0 0) 0x7fc0dc014070 con 0x7fc0ec1007b0 2024-09-13T17:13:49.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.180+0000 7fc0eb7fe640 1 --2- 172.21.15.87:0/859507518 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc0d40a10e0 0x7fc0d40a35a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:13:49.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.184+0000 7fc0e97fa640 1 -- 172.21.15.87:0/859507518 <== mon.2 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc0dc0964a0 con 0x7fc0ec1007b0 2024-09-13T17:13:49.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.197+0000 7fc0e97fa640 1 -- 172.21.15.87:0/859507518 <== mon.2 v2:172.21.15.118:3300/0 7 ==== mgrmap(e 20) v1 ==== 135890+0+0 (secure 0 0 0) 0x7fc0dc096870 con 0x7fc0ec1007b0 2024-09-13T17:13:49.376 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:49 smithi087 ceph-mon[30934]: Standby manager daemon y restarted 2024-09-13T17:13:49.376 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:49 smithi087 ceph-mon[30934]: Standby manager daemon y started 2024-09-13T17:13:49.377 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:49 smithi087 ceph-mon[30934]: from='mgr.? 172.21.15.118:0/1216292591' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-13T17:13:49.377 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:49 smithi087 ceph-mon[30934]: from='mgr.? 172.21.15.118:0/1216292591' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T17:13:49.377 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:49 smithi087 ceph-mon[30934]: from='mgr.? 172.21.15.118:0/1216292591' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-13T17:13:49.377 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:49 smithi087 ceph-mon[30934]: from='mgr.? 172.21.15.118:0/1216292591' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T17:13:49.377 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:49 smithi087 ceph-mon[30934]: Standby manager daemon z restarted 2024-09-13T17:13:49.377 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:49 smithi087 ceph-mon[30934]: Standby manager daemon z started 2024-09-13T17:13:49.377 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:49 smithi087 ceph-mon[30934]: from='mgr.? 172.21.15.149:0/4082556567' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-13T17:13:49.377 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:49 smithi087 ceph-mon[30934]: from='mgr.? 172.21.15.149:0/4082556567' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T17:13:49.377 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:49 smithi087 ceph-mon[30934]: from='mgr.? 172.21.15.149:0/4082556567' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-13T17:13:49.377 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:49 smithi087 ceph-mon[30934]: from='mgr.? 172.21.15.149:0/4082556567' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T17:13:49.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.381+0000 7fc0eb7fe640 1 -- 172.21.15.87:0/859507518 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc0d40a10e0 msgr2=0x7fc0d40a35a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/701043027 2024-09-13T17:13:49.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.381+0000 7fc0eb7fe640 1 --2- 172.21.15.87:0/859507518 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc0d40a10e0 0x7fc0d40a35a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T17:13:49.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.388+0000 7fc0e97fa640 1 -- 172.21.15.87:0/859507518 <== mon.2 v2:172.21.15.118:3300/0 8 ==== mgrmap(e 21) v1 ==== 135558+0+0 (secure 0 0 0) 0x7fc0dc0ca920 con 0x7fc0ec1007b0 2024-09-13T17:13:49.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.389+0000 7fc0e97fa640 1 -- 172.21.15.87:0/859507518 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc0d40a10e0 msgr2=0x7fc0d40a35a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:13:49.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.389+0000 7fc0e97fa640 1 --2- 172.21.15.87:0/859507518 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc0d40a10e0 0x7fc0d40a35a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:49.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:49.409+0000 7fc0f29a3640 1 -- 172.21.15.87:0/859507518 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) v1 -- 0x7fc0ec10b610 con 0x7fc0ec1007b0 2024-09-13T17:13:49.592 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:13:49 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z[37398]: 2024-09-13T17:13:49.151+0000 7f8070270040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T17:13:49.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:49 smithi149 ceph-mon[35496]: Standby manager daemon y restarted 2024-09-13T17:13:49.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:49 smithi149 ceph-mon[35496]: Standby manager daemon y started 2024-09-13T17:13:49.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:49 smithi149 ceph-mon[35496]: from='mgr.? 172.21.15.118:0/1216292591' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-13T17:13:49.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:49 smithi149 ceph-mon[35496]: from='mgr.? 172.21.15.118:0/1216292591' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T17:13:49.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:49 smithi149 ceph-mon[35496]: from='mgr.? 172.21.15.118:0/1216292591' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-13T17:13:49.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:49 smithi149 ceph-mon[35496]: from='mgr.? 172.21.15.118:0/1216292591' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T17:13:49.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:49 smithi149 ceph-mon[35496]: Standby manager daemon z restarted 2024-09-13T17:13:49.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:49 smithi149 ceph-mon[35496]: Standby manager daemon z started 2024-09-13T17:13:49.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:49 smithi149 ceph-mon[35496]: from='mgr.? 172.21.15.149:0/4082556567' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-13T17:13:49.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:49 smithi149 ceph-mon[35496]: from='mgr.? 172.21.15.149:0/4082556567' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T17:13:49.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:49 smithi149 ceph-mon[35496]: from='mgr.? 172.21.15.149:0/4082556567' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-13T17:13:49.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:49 smithi149 ceph-mon[35496]: from='mgr.? 172.21.15.149:0/4082556567' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T17:13:49.612 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:13:49 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y[35771]: 2024-09-13T17:13:49.134+0000 7f5c4d137040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T17:13:49.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:49 smithi118 ceph-mon[34374]: Standby manager daemon y restarted 2024-09-13T17:13:49.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:49 smithi118 ceph-mon[34374]: Standby manager daemon y started 2024-09-13T17:13:49.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:49 smithi118 ceph-mon[34374]: from='mgr.? 172.21.15.118:0/1216292591' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-13T17:13:49.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:49 smithi118 ceph-mon[34374]: from='mgr.? 172.21.15.118:0/1216292591' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T17:13:49.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:49 smithi118 ceph-mon[34374]: from='mgr.? 172.21.15.118:0/1216292591' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-13T17:13:49.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:49 smithi118 ceph-mon[34374]: from='mgr.? 172.21.15.118:0/1216292591' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T17:13:49.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:49 smithi118 ceph-mon[34374]: Standby manager daemon z restarted 2024-09-13T17:13:49.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:49 smithi118 ceph-mon[34374]: Standby manager daemon z started 2024-09-13T17:13:49.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:49 smithi118 ceph-mon[34374]: from='mgr.? 172.21.15.149:0/4082556567' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-13T17:13:49.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:49 smithi118 ceph-mon[34374]: from='mgr.? 172.21.15.149:0/4082556567' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T17:13:49.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:49 smithi118 ceph-mon[34374]: from='mgr.? 172.21.15.149:0/4082556567' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-13T17:13:49.614 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:49 smithi118 ceph-mon[34374]: from='mgr.? 172.21.15.149:0/4082556567' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T17:13:49.690 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:49 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:49.374+0000 7f654f832040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T17:13:49.690 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:49 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:49.609+0000 7f64bb2c7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:13:49.691 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:49 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:49.609+0000 7f64bb2c7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:13:49.691 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:49 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:49.609+0000 7f64bb2c7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:13:49.691 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:49 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:49.609+0000 7f64bb2c7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:13:49.691 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:49 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:49.609+0000 7f64bb2c7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:13:49.691 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:49 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:49.618+0000 7f64b82c1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:13:49.691 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:49 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:49.618+0000 7f64b82c1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:13:49.691 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:49 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:49.618+0000 7f64b82c1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:13:49.691 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:49 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:49.618+0000 7f64b82c1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:13:49.691 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:49 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:49.618+0000 7f64b82c1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:13:50.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.384+0000 7fc0e97fa640 1 -- 172.21.15.87:0/859507518 <== mon.2 v2:172.21.15.118:3300/0 9 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v24) v1 ==== 117+0+0 (secure 0 0 0) 0x7fc0dc096c30 con 0x7fc0ec1007b0 2024-09-13T17:13:50.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.387+0000 7fc0f29a3640 1 -- 172.21.15.87:0/859507518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0ec1007b0 msgr2=0x7fc0ec195d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:50.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.387+0000 7fc0f29a3640 1 --2- 172.21.15.87:0/859507518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0ec1007b0 0x7fc0ec195d30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc00e9f0 tx=0x7fc0dc00edf0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.387+0000 7fc0f29a3640 1 -- 172.21.15.87:0/859507518 shutdown_connections 2024-09-13T17:13:50.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.387+0000 7fc0f29a3640 1 --2- 172.21.15.87:0/859507518 >> [v2:172.21.15.87:6800/701043027,v1:172.21.15.87:6801/701043027] conn(0x7fc0d40a10e0 0x7fc0d40a35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.387+0000 7fc0f29a3640 1 --2- 172.21.15.87:0/859507518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0ec105a10 0x7fc0ec19d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.387+0000 7fc0f29a3640 1 --2- 172.21.15.87:0/859507518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0ec1030e0 0x7fc0ec196270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.387+0000 7fc0f29a3640 1 --2- 172.21.15.87:0/859507518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0ec1007b0 0x7fc0ec195d30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.387+0000 7fc0f29a3640 1 -- 172.21.15.87:0/859507518 >> 172.21.15.87:0/859507518 conn(0x7fc0ec0fa3b0 msgr2=0x7fc0ec1011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:50.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.387+0000 7fc0f29a3640 1 -- 172.21.15.87:0/859507518 shutdown_connections 2024-09-13T17:13:50.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.387+0000 7fc0f29a3640 1 -- 172.21.15.87:0/859507518 wait complete. 2024-09-13T17:13:50.410 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-13T17:13:50.420 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-13T17:13:50.439 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:13:50.461 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: mgrmap e20: x(active, since 9m), standbys: y, z 2024-09-13T17:13:50.461 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: Active manager daemon x restarted 2024-09-13T17:13:50.461 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: Activating manager daemon x 2024-09-13T17:13:50.461 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: osdmap e94: 12 total, 12 up, 12 in 2024-09-13T17:13:50.461 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: mgrmap e21: x(active, starting, since 0.0150587s), standbys: y, z 2024-09-13T17:13:50.461 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:13:50.461 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:13:50.461 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:13:50.461 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-13T17:13:50.461 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-13T17:13:50.461 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-13T17:13:50.461 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-13T17:13:50.462 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-13T17:13:50.462 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-13T17:13:50.462 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-13T17:13:50.462 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T17:13:50.462 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T17:13:50.462 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T17:13:50.462 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T17:13:50.462 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T17:13:50.462 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-13T17:13:50.462 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-13T17:13:50.462 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-13T17:13:50.462 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:13:50.462 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:13:50.462 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:13:50.462 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:13:50.463 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:13:50.463 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:13:50.463 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:13:50.463 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T17:13:50.463 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:13:50.463 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T17:13:50.463 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T17:13:50.463 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T17:13:50.463 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T17:13:50.463 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T17:13:50.463 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T17:13:50.463 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: Manager daemon x is now available 2024-09-13T17:13:50.463 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/859507518' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-13T17:13:50.463 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-13T17:13:50.464 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:13:50.464 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-13T17:13:50.464 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-13T17:13:50.464 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-13T17:13:50.464 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:50 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-13T17:13:50.491 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: mgrmap e20: x(active, since 9m), standbys: y, z 2024-09-13T17:13:50.491 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: Active manager daemon x restarted 2024-09-13T17:13:50.491 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: Activating manager daemon x 2024-09-13T17:13:50.491 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: osdmap e94: 12 total, 12 up, 12 in 2024-09-13T17:13:50.491 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: mgrmap e21: x(active, starting, since 0.0150587s), standbys: y, z 2024-09-13T17:13:50.491 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:13:50.491 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:13:50.491 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:13:50.491 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-13T17:13:50.492 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-13T17:13:50.492 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-13T17:13:50.492 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-13T17:13:50.492 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-13T17:13:50.492 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-13T17:13:50.492 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-13T17:13:50.492 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T17:13:50.492 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T17:13:50.492 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T17:13:50.492 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T17:13:50.492 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T17:13:50.492 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-13T17:13:50.492 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-13T17:13:50.492 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-13T17:13:50.493 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:13:50.493 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:13:50.493 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:13:50.493 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:13:50.493 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:13:50.493 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:13:50.493 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:13:50.493 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T17:13:50.493 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:13:50.493 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T17:13:50.493 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T17:13:50.493 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T17:13:50.493 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T17:13:50.493 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T17:13:50.494 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T17:13:50.494 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: Manager daemon x is now available 2024-09-13T17:13:50.494 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/859507518' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-13T17:13:50.494 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-13T17:13:50.494 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:13:50.494 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-13T17:13:50.494 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-13T17:13:50.494 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-13T17:13:50.494 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:50 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-13T17:13:50.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.545+0000 7f282fc14640 1 -- 172.21.15.87:0/1896814801 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2828105b30 msgr2=0x7f2828107f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:50.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.545+0000 7f282fc14640 1 --2- 172.21.15.87:0/1896814801 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2828105b30 0x7f2828107f20 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2820009ca0 tx=0x7f282002a8c0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.546+0000 7f282fc14640 1 -- 172.21.15.87:0/1896814801 shutdown_connections 2024-09-13T17:13:50.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.546+0000 7f282fc14640 1 --2- 172.21.15.87:0/1896814801 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2828105b30 0x7f2828107f20 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.546+0000 7f282fc14640 1 --2- 172.21.15.87:0/1896814801 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2828103200 0x7f28281055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.546+0000 7f282fc14640 1 --2- 172.21.15.87:0/1896814801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28281008d0 0x7f2828102cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.546+0000 7f282fc14640 1 -- 172.21.15.87:0/1896814801 >> 172.21.15.87:0/1896814801 conn(0x7f28280fa430 msgr2=0x7f28280fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:50.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.546+0000 7f282fc14640 1 -- 172.21.15.87:0/1896814801 shutdown_connections 2024-09-13T17:13:50.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.546+0000 7f282fc14640 1 -- 172.21.15.87:0/1896814801 wait complete. 2024-09-13T17:13:50.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.546+0000 7f282fc14640 1 Processor -- start 2024-09-13T17:13:50.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.546+0000 7f282fc14640 1 -- start start 2024-09-13T17:13:50.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.547+0000 7f282fc14640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28281008d0 0x7f2828195e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.547+0000 7f282fc14640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2828103200 0x7f2828196350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.547+0000 7f282fc14640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2828105b30 0x7f282819d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.547+0000 7f282fc14640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282819d900 con 0x7f2828103200 2024-09-13T17:13:50.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.547+0000 7f282fc14640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282819da70 con 0x7f28281008d0 2024-09-13T17:13:50.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.547+0000 7f282fc14640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282819dc30 con 0x7f2828105b30 2024-09-13T17:13:50.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.547+0000 7f282d1af640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2828103200 0x7f2828196350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.547+0000 7f282d1af640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2828103200 0x7f2828196350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41664/0 (socket says 172.21.15.87:41664) 2024-09-13T17:13:50.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.547+0000 7f282d1af640 1 -- 172.21.15.87:0/1212631576 learned_addr learned my addr 172.21.15.87:0/1212631576 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:50.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.547+0000 7f282e1b1640 1 --2- 172.21.15.87:0/1212631576 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2828105b30 0x7f282819d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.547+0000 7f282d9b0640 1 --2- 172.21.15.87:0/1212631576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28281008d0 0x7f2828195e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.547+0000 7f282d1af640 1 -- 172.21.15.87:0/1212631576 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2828105b30 msgr2=0x7f282819d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:50.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.547+0000 7f282d1af640 1 --2- 172.21.15.87:0/1212631576 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2828105b30 0x7f282819d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.547+0000 7f282d1af640 1 -- 172.21.15.87:0/1212631576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28281008d0 msgr2=0x7f2828195e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:50.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.547+0000 7f282d1af640 1 --2- 172.21.15.87:0/1212631576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28281008d0 0x7f2828195e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.547+0000 7f282d1af640 1 -- 172.21.15.87:0/1212631576 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2820009900 con 0x7f2828103200 2024-09-13T17:13:50.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.547+0000 7f282e1b1640 1 --2- 172.21.15.87:0/1212631576 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2828105b30 0x7f282819d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:13:50.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.547+0000 7f282d1af640 1 --2- 172.21.15.87:0/1212631576 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2828103200 0x7f2828196350 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f281800d740 tx=0x7f281800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:50.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.547+0000 7f281effd640 1 -- 172.21.15.87:0/1212631576 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2818009c30 con 0x7f2828103200 2024-09-13T17:13:50.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.547+0000 7f281effd640 1 -- 172.21.15.87:0/1212631576 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f281800de50 con 0x7f2828103200 2024-09-13T17:13:50.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.547+0000 7f282fc14640 1 -- 172.21.15.87:0/1212631576 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f282819df10 con 0x7f2828103200 2024-09-13T17:13:50.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.547+0000 7f281effd640 1 -- 172.21.15.87:0/1212631576 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2818004e40 con 0x7f2828103200 2024-09-13T17:13:50.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.548+0000 7f282fc14640 1 -- 172.21.15.87:0/1212631576 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f282819e340 con 0x7f2828103200 2024-09-13T17:13:50.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.549+0000 7f282fc14640 1 -- 172.21.15.87:0/1212631576 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28280fbf20 con 0x7f2828103200 2024-09-13T17:13:50.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.550+0000 7f281effd640 1 -- 172.21.15.87:0/1212631576 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 22) v1 ==== 135685+0+0 (secure 0 0 0) 0x7f2818004fa0 con 0x7f2828103200 2024-09-13T17:13:50.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.551+0000 7f281effd640 1 --2- 172.21.15.87:0/1212631576 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f28140a0e90 0x7f28140a3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.551+0000 7f282d9b0640 1 --2- 172.21.15.87:0/1212631576 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f28140a0e90 0x7f28140a3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.551+0000 7f281effd640 1 -- 172.21.15.87:0/1212631576 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f28180cc250 con 0x7f2828103200 2024-09-13T17:13:50.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.551+0000 7f282d9b0640 1 --2- 172.21.15.87:0/1212631576 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f28140a0e90 0x7f28140a3350 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2824005d00 tx=0x7f282400b410 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:50.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.556+0000 7f281effd640 1 -- 172.21.15.87:0/1212631576 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f28180958b0 con 0x7f2828103200 2024-09-13T17:13:50.601 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: mgrmap e20: x(active, since 9m), standbys: y, z 2024-09-13T17:13:50.601 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: Active manager daemon x restarted 2024-09-13T17:13:50.601 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: Activating manager daemon x 2024-09-13T17:13:50.601 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: osdmap e94: 12 total, 12 up, 12 in 2024-09-13T17:13:50.601 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: mgrmap e21: x(active, starting, since 0.0150587s), standbys: y, z 2024-09-13T17:13:50.601 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:13:50.601 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:13:50.601 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:13:50.601 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-13T17:13:50.601 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-13T17:13:50.601 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-13T17:13:50.602 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-13T17:13:50.602 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-13T17:13:50.602 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-13T17:13:50.602 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-13T17:13:50.602 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T17:13:50.602 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T17:13:50.602 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T17:13:50.602 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T17:13:50.602 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T17:13:50.602 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-13T17:13:50.602 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-13T17:13:50.602 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-13T17:13:50.602 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:13:50.603 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:13:50.603 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:13:50.603 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:13:50.603 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:13:50.603 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:13:50.603 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:13:50.603 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T17:13:50.603 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:13:50.603 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T17:13:50.603 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T17:13:50.603 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T17:13:50.603 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T17:13:50.603 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T17:13:50.603 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T17:13:50.604 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: Manager daemon x is now available 2024-09-13T17:13:50.604 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/859507518' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-13T17:13:50.604 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-13T17:13:50.604 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:13:50.604 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-13T17:13:50.604 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-13T17:13:50.604 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-13T17:13:50.604 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:50 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-13T17:13:50.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.725+0000 7f282fc14640 1 -- 172.21.15.87:0/1212631576 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f282802c410 con 0x7f2828103200 2024-09-13T17:13:50.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.726+0000 7f281effd640 1 -- 172.21.15.87:0/1212631576 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+25192 (secure 0 0 0) 0x7f2818020090 con 0x7f2828103200 2024-09-13T17:13:50.729 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:13:50.729 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":94,"fsid":"043d5bae-71f2-11ef-bceb-c7b262605968","created":"2024-09-13T17:03:57.852010+0000","modified":"2024-09-13T17:13:49.377136+0000","last_up_change":"2024-09-13T17:10:34.423548+0000","last_in_change":"2024-09-13T17:10:14.228123+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:07:02.286400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:11:21.965141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:11:22.504345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:11:25.565163+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58250283-85c0-416e-abdd-1fc5a7ff0c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6803","nonce":1316956138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6805","nonce":1316956138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6809","nonce":1316956138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6807","nonce":1316956138}]},"public_addr":"172.21.15.87:6803/1316956138","cluster_addr":"172.21.15.87:6805/1316956138","heartbeat_back_addr":"172.21.15.87:6809/1316956138","heartbeat_front_addr":"172.21.15.87:6807/1316956138","state":["exists","up"]},{"osd":1,"uuid":"b9d49969-94b1-4262-b4ff-db0a8e3331af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6801","nonce":3352566727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6803","nonce":3352566727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6807","nonce":3352566727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6805","nonce":3352566727}]},"public_addr":"172.21.15.118:6801/3352566727","cluster_addr":"172.21.15.118:6803/3352566727","heartbeat_back_addr":"172.21.15.118:6807/3352566727","heartbeat_front_addr":"172.21.15.118:6805/3352566727","state":["exists","up"]},{"osd":2,"uuid":"ba64549e-d736-426f-b466-f569af5f16d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6801","nonce":2774581686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6803","nonce":2774581686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6807","nonce":2774581686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6805","nonce":2774581686}]},"public_addr":"172.21.15.149:6801/2774581686","cluster_addr":"172.21.15.149:6803/2774581686","heartbeat_back_addr":"172.21.15.149:6807/2774581686","heartbeat_front_addr":"172.21.15.149:6805/2774581686","state":["exists","up"]},{"osd":3,"uuid":"3d5553e5-371b-49fd-976b-9e72a97a2f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6811","nonce":3306119066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6813","nonce":3306119066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6817","nonce":3306119066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6815","nonce":3306119066}]},"public_addr":"172.21.15.87:6811/3306119066","cluster_addr":"172.21.15.87:6813/3306119066","heartbeat_back_addr":"172.21.15.87:6817/3306119066","heartbeat_front_addr":"172.21.15.87:6815/3306119066","state":["exists","up"]},{"osd":4,"uuid":"2fbe0e27-34ec-42a6-9962-f1d8202b3159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6809","nonce":3342349890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6811","nonce":3342349890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6815","nonce":3342349890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6813","nonce":3342349890}]},"public_addr":"172.21.15.118:6809/3342349890","cluster_addr":"172.21.15.118:6811/3342349890","heartbeat_back_addr":"172.21.15.118:6815/3342349890","heartbeat_front_addr":"172.21.15.118:6813/3342349890","state":["exists","up"]},{"osd":5,"uuid":"53c14519-6170-4b5a-a79d-4835882d7bec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6809","nonce":3468867124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6811","nonce":3468867124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6815","nonce":3468867124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6813","nonce":3468867124}]},"public_addr":"172.21.15.149:6809/3468867124","cluster_addr":"172.21.15.149:6811/3468867124","heartbeat_back_addr":"172.21.15.149:6815/3468867124","heartbeat_front_addr":"172.21.15.149:6813/3468867124","state":["exists","up"]},{"osd":6,"uuid":"d3951b32-db77-4b8b-9de0-f05e03d13f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6819","nonce":326563617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6821","nonce":326563617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6825","nonce":326563617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6823","nonce":326563617}]},"public_addr":"172.21.15.87:6819/326563617","cluster_addr":"172.21.15.87:6821/326563617","heartbeat_back_addr":"172.21.15.87:6825/326563617","heartbeat_front_addr":"172.21.15.87:6823/326563617","state":["exists","up"]},{"osd":7,"uuid":"4d46dab7-a8bf-4e3e-b5c0-43860d336bdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6817","nonce":1690268990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6819","nonce":1690268990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6823","nonce":1690268990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6821","nonce":1690268990}]},"public_addr":"172.21.15.118:6817/1690268990","cluster_addr":"172.21.15.118:6819/1690268990","heartbeat_back_addr":"172.21.15.118:6823/1690268990","heartbeat_front_addr":"172.21.15.118:6821/1690268990","state":["exists","up"]},{"osd":8,"uuid":"5a015a7d-60a3-4412-96af-1b61d2ad51f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6817","nonce":1558675380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6819","nonce":1558675380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6823","nonce":1558675380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6821","nonce":1558675380}]},"public_addr":"172.21.15.149:6817/1558675380","cluster_addr":"172.21.15.149:6819/1558675380","heartbeat_back_addr":"172.21.15.149:6823/1558675380","heartbeat_front_addr":"172.21.15.149:6821/1558675380","state":["exists","up"]},{"osd":9,"uuid":"248c0b6e-4c4e-4c63-a0dd-e4cdf3b997a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6827","nonce":1453934262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6829","nonce":1453934262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6833","nonce":1453934262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6831","nonce":1453934262}]},"public_addr":"172.21.15.87:6827/1453934262","cluster_addr":"172.21.15.87:6829/1453934262","heartbeat_back_addr":"172.21.15.87:6833/1453934262","heartbeat_front_addr":"172.21.15.87:6831/1453934262","state":["exists","up"]},{"osd":10,"uuid":"24238714-e737-4371-b5d5-0cd3395f09bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6825","nonce":1034318850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6827","nonce":1034318850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6831","nonce":1034318850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6829","nonce":1034318850}]},"public_addr":"172.21.15.118:6825/1034318850","cluster_addr":"172.21.15.118:6827/1034318850","heartbeat_back_addr":"172.21.15.118:6831/1034318850","heartbeat_front_addr":"172.21.15.118:6829/1034318850","state":["exists","up"]},{"osd":11,"uuid":"409dd3bf-5154-4dea-8708-7de7f9e2e793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6825","nonce":271000465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6827","nonce":271000465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6831","nonce":271000465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6829","nonce":271000465}]},"public_addr":"172.21.15.149:6825/271000465","cluster_addr":"172.21.15.149:6827/271000465","heartbeat_back_addr":"172.21.15.149:6831/271000465","heartbeat_front_addr":"172.21.15.149:6829/271000465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:16.382664+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:37.914250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:00.425876+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:23.960183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:47.004088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:10.214345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:33.719221+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:57.099599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:20.971881+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:44.827167+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:08.135516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:32.085853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.d","mappings":[{"from":1,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8},{"from":5,"to":7}]},{"pgid":"3.28","mappings":[{"from":3,"to":6},{"from":5,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/718653925":"2024-09-14T17:13:49.377087+0000","172.21.15.87:0/3081317043":"2024-09-14T17:13:49.377087+0000","172.21.15.87:0/1633498542":"2024-09-14T17:13:49.377087+0000","172.21.15.87:6801/1587363880":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/3403361612":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/553289143":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/1475107314":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/515676743":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/3270371628":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6800/1587363880":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6800/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6801/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/2612130442":"2024-09-14T17:13:49.377087+0000","172.21.15.87:0/586423689":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6800/701043027":"2024-09-14T17:13:49.377087+0000","172.21.15.87:6801/701043027":"2024-09-14T17:13:49.377087+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:13:50.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.728+0000 7f282fc14640 1 -- 172.21.15.87:0/1212631576 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f28140a0e90 msgr2=0x7f28140a3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:50.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.728+0000 7f282fc14640 1 --2- 172.21.15.87:0/1212631576 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f28140a0e90 0x7f28140a3350 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2824005d00 tx=0x7f282400b410 comp rx=0 tx=0).stop 2024-09-13T17:13:50.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.728+0000 7f282fc14640 1 -- 172.21.15.87:0/1212631576 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2828103200 msgr2=0x7f2828196350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:50.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.728+0000 7f282fc14640 1 --2- 172.21.15.87:0/1212631576 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2828103200 0x7f2828196350 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f281800d740 tx=0x7f281800dc00 comp rx=0 tx=0).stop 2024-09-13T17:13:50.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.728+0000 7f282fc14640 1 -- 172.21.15.87:0/1212631576 shutdown_connections 2024-09-13T17:13:50.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.728+0000 7f282fc14640 1 --2- 172.21.15.87:0/1212631576 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2828105b30 0x7f282819d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.728+0000 7f282fc14640 1 --2- 172.21.15.87:0/1212631576 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f28140a0e90 0x7f28140a3350 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.728+0000 7f282fc14640 1 --2- 172.21.15.87:0/1212631576 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2828103200 0x7f2828196350 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.728+0000 7f282fc14640 1 --2- 172.21.15.87:0/1212631576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28281008d0 0x7f2828195e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.728+0000 7f282fc14640 1 -- 172.21.15.87:0/1212631576 >> 172.21.15.87:0/1212631576 conn(0x7f28280fa430 msgr2=0x7f28281012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:50.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.728+0000 7f282fc14640 1 -- 172.21.15.87:0/1212631576 shutdown_connections 2024-09-13T17:13:50.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.728+0000 7f282fc14640 1 -- 172.21.15.87:0/1212631576 wait complete. 2024-09-13T17:13:50.741 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:07:02.286400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:11:21.965141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:11:22.504345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:11:25.565163+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:13:50.741 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:13:50.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.882+0000 7f65b215e640 1 -- 172.21.15.87:0/4152779659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65ac105a60 msgr2=0x7f65ac107ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:50.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.882+0000 7f65b215e640 1 --2- 172.21.15.87:0/4152779659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65ac105a60 0x7f65ac107ed0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f65a4009ca0 tx=0x7f65a402a8c0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.882+0000 7f65b215e640 1 -- 172.21.15.87:0/4152779659 shutdown_connections 2024-09-13T17:13:50.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.882+0000 7f65b215e640 1 --2- 172.21.15.87:0/4152779659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65ac105a60 0x7f65ac107ed0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.882+0000 7f65b215e640 1 --2- 172.21.15.87:0/4152779659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f65ac103130 0x7f65ac105520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.882+0000 7f65b215e640 1 --2- 172.21.15.87:0/4152779659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65ac100800 0x7f65ac102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.882+0000 7f65b215e640 1 -- 172.21.15.87:0/4152779659 >> 172.21.15.87:0/4152779659 conn(0x7f65ac0fa3e0 msgr2=0x7f65ac0fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:50.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.882+0000 7f65b215e640 1 -- 172.21.15.87:0/4152779659 shutdown_connections 2024-09-13T17:13:50.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.882+0000 7f65b215e640 1 -- 172.21.15.87:0/4152779659 wait complete. 2024-09-13T17:13:50.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.882+0000 7f65b215e640 1 Processor -- start 2024-09-13T17:13:50.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.883+0000 7f65b215e640 1 -- start start 2024-09-13T17:13:50.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.883+0000 7f65b215e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65ac100800 0x7f65ac195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.883+0000 7f65b215e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f65ac103130 0x7f65ac196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.883+0000 7f65b215e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65ac105a60 0x7f65ac19d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.883+0000 7f65b215e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac19d8a0 con 0x7f65ac105a60 2024-09-13T17:13:50.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.883+0000 7f65b215e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac19da10 con 0x7f65ac103130 2024-09-13T17:13:50.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.883+0000 7f65b215e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac19dbd0 con 0x7f65ac100800 2024-09-13T17:13:50.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.883+0000 7f65abfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65ac105a60 0x7f65ac19d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.883+0000 7f65abfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65ac105a60 0x7f65ac19d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41674/0 (socket says 172.21.15.87:41674) 2024-09-13T17:13:50.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.883+0000 7f65abfff640 1 -- 172.21.15.87:0/2110126761 learned_addr learned my addr 172.21.15.87:0/2110126761 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:50.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.883+0000 7f65ab7fe640 1 --2- 172.21.15.87:0/2110126761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65ac100800 0x7f65ac195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.883+0000 7f65aaffd640 1 --2- 172.21.15.87:0/2110126761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f65ac103130 0x7f65ac196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.883+0000 7f65abfff640 1 -- 172.21.15.87:0/2110126761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65ac100800 msgr2=0x7f65ac195dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:50.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.883+0000 7f65abfff640 1 --2- 172.21.15.87:0/2110126761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65ac100800 0x7f65ac195dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.883+0000 7f65abfff640 1 -- 172.21.15.87:0/2110126761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f65ac103130 msgr2=0x7f65ac196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:50.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.883+0000 7f65abfff640 1 --2- 172.21.15.87:0/2110126761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f65ac103130 0x7f65ac196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:50.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.883+0000 7f65abfff640 1 -- 172.21.15.87:0/2110126761 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a4009900 con 0x7f65ac105a60 2024-09-13T17:13:50.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.883+0000 7f65abfff640 1 --2- 172.21.15.87:0/2110126761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65ac105a60 0x7f65ac19d330 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f65a402aeb0 tx=0x7f65a4003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:50.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.884+0000 7f65a8ff9640 1 -- 172.21.15.87:0/2110126761 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a40307c0 con 0x7f65ac105a60 2024-09-13T17:13:50.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.884+0000 7f65a8ff9640 1 -- 172.21.15.87:0/2110126761 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f65a4040070 con 0x7f65ac105a60 2024-09-13T17:13:50.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.884+0000 7f65a8ff9640 1 -- 172.21.15.87:0/2110126761 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a4004420 con 0x7f65ac105a60 2024-09-13T17:13:50.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.884+0000 7f65b215e640 1 -- 172.21.15.87:0/2110126761 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65ac19de50 con 0x7f65ac105a60 2024-09-13T17:13:50.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.884+0000 7f65b215e640 1 -- 172.21.15.87:0/2110126761 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65ac19e220 con 0x7f65ac105a60 2024-09-13T17:13:50.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.885+0000 7f65b215e640 1 -- 172.21.15.87:0/2110126761 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65ac103510 con 0x7f65ac105a60 2024-09-13T17:13:50.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.886+0000 7f65a8ff9640 1 -- 172.21.15.87:0/2110126761 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 22) v1 ==== 135685+0+0 (secure 0 0 0) 0x7f65a4042030 con 0x7f65ac105a60 2024-09-13T17:13:50.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.886+0000 7f65a8ff9640 1 --2- 172.21.15.87:0/2110126761 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f65940a0e90 0x7f65940a3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:50.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.886+0000 7f65ab7fe640 1 --2- 172.21.15.87:0/2110126761 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f65940a0e90 0x7f65940a3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:50.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.886+0000 7f65a8ff9640 1 -- 172.21.15.87:0/2110126761 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f65a40edfd0 con 0x7f65ac105a60 2024-09-13T17:13:50.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.887+0000 7f65ab7fe640 1 --2- 172.21.15.87:0/2110126761 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f65940a0e90 0x7f65940a3350 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f65ac197290 tx=0x7f659c005f90 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:50.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:50.890+0000 7f65a8ff9640 1 -- 172.21.15.87:0/2110126761 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f65a40b7610 con 0x7f65ac105a60 2024-09-13T17:13:51.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.076+0000 7f65b215e640 1 -- 172.21.15.87:0/2110126761 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f65ac10b660 con 0x7f65ac105a60 2024-09-13T17:13:51.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.076+0000 7f65a8ff9640 1 -- 172.21.15.87:0/2110126761 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f65a40b9540 con 0x7f65ac105a60 2024-09-13T17:13:51.078 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-09-13T17:13:51.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.079+0000 7f65b215e640 1 -- 172.21.15.87:0/2110126761 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f65940a0e90 msgr2=0x7f65940a3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:51.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.079+0000 7f65b215e640 1 --2- 172.21.15.87:0/2110126761 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f65940a0e90 0x7f65940a3350 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f65ac197290 tx=0x7f659c005f90 comp rx=0 tx=0).stop 2024-09-13T17:13:51.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.079+0000 7f65b215e640 1 -- 172.21.15.87:0/2110126761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65ac105a60 msgr2=0x7f65ac19d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:51.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.079+0000 7f65b215e640 1 --2- 172.21.15.87:0/2110126761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65ac105a60 0x7f65ac19d330 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f65a402aeb0 tx=0x7f65a4003c20 comp rx=0 tx=0).stop 2024-09-13T17:13:51.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.079+0000 7f65b215e640 1 -- 172.21.15.87:0/2110126761 shutdown_connections 2024-09-13T17:13:51.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.079+0000 7f65b215e640 1 --2- 172.21.15.87:0/2110126761 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f65940a0e90 0x7f65940a3350 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.079+0000 7f65b215e640 1 --2- 172.21.15.87:0/2110126761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65ac105a60 0x7f65ac19d330 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.079+0000 7f65b215e640 1 --2- 172.21.15.87:0/2110126761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f65ac103130 0x7f65ac196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.079+0000 7f65b215e640 1 --2- 172.21.15.87:0/2110126761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65ac100800 0x7f65ac195dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.079+0000 7f65b215e640 1 -- 172.21.15.87:0/2110126761 >> 172.21.15.87:0/2110126761 conn(0x7f65ac0fa3e0 msgr2=0x7f65ac101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:51.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.079+0000 7f65b215e640 1 -- 172.21.15.87:0/2110126761 shutdown_connections 2024-09-13T17:13:51.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.079+0000 7f65b215e640 1 -- 172.21.15.87:0/2110126761 wait complete. 2024-09-13T17:13:51.094 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:13:51.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.206+0000 7fccbcf08640 1 -- 172.21.15.87:0/3958687364 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fccb80fec90 msgr2=0x7fccb80ff090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:51.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.206+0000 7fccbcf08640 1 --2- 172.21.15.87:0/3958687364 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fccb80fec90 0x7fccb80ff090 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fcca8009900 tx=0x7fcca802a410 comp rx=0 tx=0).stop 2024-09-13T17:13:51.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.206+0000 7fccbcf08640 1 -- 172.21.15.87:0/3958687364 shutdown_connections 2024-09-13T17:13:51.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.206+0000 7fccbcf08640 1 --2- 172.21.15.87:0/3958687364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fccb8100840 0x7fccb81070d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.206+0000 7fccbcf08640 1 --2- 172.21.15.87:0/3958687364 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fccb80ffe80 0x7fccb8100300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.206+0000 7fccbcf08640 1 --2- 172.21.15.87:0/3958687364 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fccb80fec90 0x7fccb80ff090 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.206+0000 7fccbcf08640 1 -- 172.21.15.87:0/3958687364 >> 172.21.15.87:0/3958687364 conn(0x7fccb80fa430 msgr2=0x7fccb80fc850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:51.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.206+0000 7fccbcf08640 1 -- 172.21.15.87:0/3958687364 shutdown_connections 2024-09-13T17:13:51.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.206+0000 7fccbcf08640 1 -- 172.21.15.87:0/3958687364 wait complete. 2024-09-13T17:13:51.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.207+0000 7fccbcf08640 1 Processor -- start 2024-09-13T17:13:51.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.207+0000 7fccbcf08640 1 -- start start 2024-09-13T17:13:51.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.207+0000 7fccbcf08640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fccb80fec90 0x7fccb8068c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:51.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.207+0000 7fccbcf08640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fccb80ffe80 0x7fccb819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:51.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.207+0000 7fccbcf08640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fccb8100840 0x7fccb819d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:51.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.207+0000 7fccbcf08640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb819d8a0 con 0x7fccb8100840 2024-09-13T17:13:51.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.207+0000 7fccbcf08640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb819da10 con 0x7fccb80ffe80 2024-09-13T17:13:51.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.207+0000 7fccbcf08640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb819dbd0 con 0x7fccb80fec90 2024-09-13T17:13:51.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.208+0000 7fccb659c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fccb80fec90 0x7fccb8068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:51.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.208+0000 7fccb659c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fccb80fec90 0x7fccb8068c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:55192/0 (socket says 172.21.15.87:55192) 2024-09-13T17:13:51.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.208+0000 7fccb659c640 1 -- 172.21.15.87:0/1788785668 learned_addr learned my addr 172.21.15.87:0/1788785668 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:51.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.208+0000 7fccb5d9b640 1 --2- 172.21.15.87:0/1788785668 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fccb80ffe80 0x7fccb819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:51.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.208+0000 7fccb6d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fccb8100840 0x7fccb819d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:51.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.208+0000 7fccb659c640 1 -- 172.21.15.87:0/1788785668 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fccb80ffe80 msgr2=0x7fccb819ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:51.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.208+0000 7fccb659c640 1 --2- 172.21.15.87:0/1788785668 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fccb80ffe80 0x7fccb819ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.208+0000 7fccb659c640 1 -- 172.21.15.87:0/1788785668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fccb8100840 msgr2=0x7fccb819d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:51.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.208+0000 7fccb659c640 1 --2- 172.21.15.87:0/1788785668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fccb8100840 0x7fccb819d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.208+0000 7fccb659c640 1 -- 172.21.15.87:0/1788785668 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca8009560 con 0x7fccb80fec90 2024-09-13T17:13:51.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.208+0000 7fccb5d9b640 1 --2- 172.21.15.87:0/1788785668 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fccb80ffe80 0x7fccb819ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:13:51.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.208+0000 7fccb659c640 1 --2- 172.21.15.87:0/1788785668 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fccb80fec90 0x7fccb8068c80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcca8031460 tx=0x7fcca80042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:51.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.208+0000 7fcca77fe640 1 -- 172.21.15.87:0/1788785668 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca80044e0 con 0x7fccb80fec90 2024-09-13T17:13:51.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.208+0000 7fcca77fe640 1 -- 172.21.15.87:0/1788785668 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcca8003cb0 con 0x7fccb80fec90 2024-09-13T17:13:51.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.208+0000 7fccbcf08640 1 -- 172.21.15.87:0/1788785668 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccb819de50 con 0x7fccb80fec90 2024-09-13T17:13:51.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.209+0000 7fcca77fe640 1 -- 172.21.15.87:0/1788785668 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca803cca0 con 0x7fccb80fec90 2024-09-13T17:13:51.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.209+0000 7fccbcf08640 1 -- 172.21.15.87:0/1788785668 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb819e220 con 0x7fccb80fec90 2024-09-13T17:13:51.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.210+0000 7fccbcf08640 1 -- 172.21.15.87:0/1788785668 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccb8106140 con 0x7fccb80fec90 2024-09-13T17:13:51.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.211+0000 7fcca77fe640 1 -- 172.21.15.87:0/1788785668 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 22) v1 ==== 135685+0+0 (secure 0 0 0) 0x7fcca803b3d0 con 0x7fccb80fec90 2024-09-13T17:13:51.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.211+0000 7fcca77fe640 1 --2- 172.21.15.87:0/1788785668 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fcca00a0e90 0x7fcca00a3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:51.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.212+0000 7fcca77fe640 1 -- 172.21.15.87:0/1788785668 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fcca80ed590 con 0x7fccb80fec90 2024-09-13T17:13:51.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.212+0000 7fccb5d9b640 1 --2- 172.21.15.87:0/1788785668 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fcca00a0e90 0x7fcca00a3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:51.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.212+0000 7fccb5d9b640 1 --2- 172.21.15.87:0/1788785668 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fcca00a0e90 0x7fcca00a3350 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fccb80689f0 tx=0x7fccac005f90 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:51.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.216+0000 7fcca77fe640 1 -- 172.21.15.87:0/1788785668 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcca80b6bf0 con 0x7fccb80fec90 2024-09-13T17:13:51.384 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:51 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:51.042+0000 7f649ed8f640 -1 log_channel(cephadm) log [ERR] : [13/Sep/2024:17:13:51] ENGINE Error in HTTPServer.serve 2024-09-13T17:13:51.384 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:51 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: Traceback (most recent call last): 2024-09-13T17:13:51.384 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:51 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T17:13:51.385 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:51 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: self._connections.run(self.expiration_interval) 2024-09-13T17:13:51.385 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:51 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T17:13:51.385 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:51 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: self._run(expiration_interval) 2024-09-13T17:13:51.385 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:51 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T17:13:51.385 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:51 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T17:13:51.385 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:51 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T17:13:51.385 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:51 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T17:13:51.385 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:51 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T17:13:51.385 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:51 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: s = self.context.wrap_socket( 2024-09-13T17:13:51.385 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:51 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T17:13:51.385 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:51 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: return self.sslsocket_class._create( 2024-09-13T17:13:51.385 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:51 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T17:13:51.385 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:51 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: self.do_handshake() 2024-09-13T17:13:51.386 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:51 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T17:13:51.386 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:51 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: self._sslobj.do_handshake() 2024-09-13T17:13:51.386 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:51 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T17:13:51.386 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:13:51 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:13:51.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.407+0000 7fccbcf08640 1 -- 172.21.15.87:0/1788785668 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fccb802c480 con 0x7fccb80fec90 2024-09-13T17:13:51.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.410+0000 7fcca77fe640 1 -- 172.21.15.87:0/1788785668 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcca80ba210 con 0x7fccb80fec90 2024-09-13T17:13:51.411 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-09-13T17:13:51.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.412+0000 7fccbcf08640 1 -- 172.21.15.87:0/1788785668 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fcca00a0e90 msgr2=0x7fcca00a3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:51.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.412+0000 7fccbcf08640 1 --2- 172.21.15.87:0/1788785668 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fcca00a0e90 0x7fcca00a3350 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fccb80689f0 tx=0x7fccac005f90 comp rx=0 tx=0).stop 2024-09-13T17:13:51.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.412+0000 7fccbcf08640 1 -- 172.21.15.87:0/1788785668 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fccb80fec90 msgr2=0x7fccb8068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:51.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.412+0000 7fccbcf08640 1 --2- 172.21.15.87:0/1788785668 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fccb80fec90 0x7fccb8068c80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcca8031460 tx=0x7fcca80042f0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.412+0000 7fccbcf08640 1 -- 172.21.15.87:0/1788785668 shutdown_connections 2024-09-13T17:13:51.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.412+0000 7fccbcf08640 1 --2- 172.21.15.87:0/1788785668 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fcca00a0e90 0x7fcca00a3350 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.412+0000 7fccbcf08640 1 --2- 172.21.15.87:0/1788785668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fccb8100840 0x7fccb819d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.412+0000 7fccbcf08640 1 --2- 172.21.15.87:0/1788785668 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fccb80ffe80 0x7fccb819ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.412+0000 7fccbcf08640 1 --2- 172.21.15.87:0/1788785668 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fccb80fec90 0x7fccb8068c80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.412+0000 7fccbcf08640 1 -- 172.21.15.87:0/1788785668 >> 172.21.15.87:0/1788785668 conn(0x7fccb80fa430 msgr2=0x7fccb8103310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:51.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.412+0000 7fccbcf08640 1 -- 172.21.15.87:0/1788785668 shutdown_connections 2024-09-13T17:13:51.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.412+0000 7fccbcf08640 1 -- 172.21.15.87:0/1788785668 wait complete. 2024-09-13T17:13:51.426 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:13:51.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.532+0000 7fa39b202640 1 -- 172.21.15.87:0/1563359824 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3940fec90 msgr2=0x7fa3940ff090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:51.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.532+0000 7fa39b202640 1 --2- 172.21.15.87:0/1563359824 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3940fec90 0x7fa3940ff090 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa388009900 tx=0x7fa38802a410 comp rx=0 tx=0).stop 2024-09-13T17:13:51.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.532+0000 7fa39b202640 1 -- 172.21.15.87:0/1563359824 shutdown_connections 2024-09-13T17:13:51.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.532+0000 7fa39b202640 1 --2- 172.21.15.87:0/1563359824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa394100840 0x7fa3941070d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.532+0000 7fa39b202640 1 --2- 172.21.15.87:0/1563359824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3940ffe80 0x7fa394100300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.532+0000 7fa39b202640 1 --2- 172.21.15.87:0/1563359824 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3940fec90 0x7fa3940ff090 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.532+0000 7fa39b202640 1 -- 172.21.15.87:0/1563359824 >> 172.21.15.87:0/1563359824 conn(0x7fa3940fa3f0 msgr2=0x7fa3940fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:51.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.533+0000 7fa39b202640 1 -- 172.21.15.87:0/1563359824 shutdown_connections 2024-09-13T17:13:51.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.533+0000 7fa39b202640 1 -- 172.21.15.87:0/1563359824 wait complete. 2024-09-13T17:13:51.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.533+0000 7fa39b202640 1 Processor -- start 2024-09-13T17:13:51.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.533+0000 7fa39b202640 1 -- start start 2024-09-13T17:13:51.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.533+0000 7fa39b202640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3940fec90 0x7fa394068cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:51.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.533+0000 7fa39b202640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3940ffe80 0x7fa39419ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:51.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.533+0000 7fa39b202640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa394100840 0x7fa39419d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:51.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.533+0000 7fa39b202640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39419d970 con 0x7fa394100840 2024-09-13T17:13:51.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.533+0000 7fa39b202640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39419dae0 con 0x7fa3940ffe80 2024-09-13T17:13:51.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.533+0000 7fa39b202640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39419dca0 con 0x7fa3940fec90 2024-09-13T17:13:51.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.533+0000 7fa39979f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa394100840 0x7fa39419d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:51.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.534+0000 7fa398f9e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3940fec90 0x7fa394068cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:51.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.534+0000 7fa398f9e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3940fec90 0x7fa394068cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:55212/0 (socket says 172.21.15.87:55212) 2024-09-13T17:13:51.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.534+0000 7fa398f9e640 1 -- 172.21.15.87:0/4170017959 learned_addr learned my addr 172.21.15.87:0/4170017959 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:51.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.534+0000 7fa393fff640 1 --2- 172.21.15.87:0/4170017959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3940ffe80 0x7fa39419ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:51.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.534+0000 7fa39979f640 1 -- 172.21.15.87:0/4170017959 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3940fec90 msgr2=0x7fa394068cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:51.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.534+0000 7fa39979f640 1 --2- 172.21.15.87:0/4170017959 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3940fec90 0x7fa394068cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.534+0000 7fa39979f640 1 -- 172.21.15.87:0/4170017959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3940ffe80 msgr2=0x7fa39419ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:51.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.534+0000 7fa39979f640 1 --2- 172.21.15.87:0/4170017959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3940ffe80 0x7fa39419ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.534+0000 7fa39979f640 1 -- 172.21.15.87:0/4170017959 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa388009560 con 0x7fa394100840 2024-09-13T17:13:51.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.534+0000 7fa39979f640 1 --2- 172.21.15.87:0/4170017959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa394100840 0x7fa39419d190 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa38c011e20 tx=0x7fa38c00b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:51.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.534+0000 7fa391ffb640 1 -- 172.21.15.87:0/4170017959 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c003970 con 0x7fa394100840 2024-09-13T17:13:51.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.534+0000 7fa39b202640 1 -- 172.21.15.87:0/4170017959 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3941949a0 con 0x7fa394100840 2024-09-13T17:13:51.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.534+0000 7fa391ffb640 1 -- 172.21.15.87:0/4170017959 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa38c004030 con 0x7fa394100840 2024-09-13T17:13:51.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.534+0000 7fa391ffb640 1 -- 172.21.15.87:0/4170017959 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c01c7a0 con 0x7fa394100840 2024-09-13T17:13:51.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.535+0000 7fa39b202640 1 -- 172.21.15.87:0/4170017959 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa394194e60 con 0x7fa394100840 2024-09-13T17:13:51.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.536+0000 7fa39b202640 1 -- 172.21.15.87:0/4170017959 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3941061c0 con 0x7fa394100840 2024-09-13T17:13:51.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.537+0000 7fa391ffb640 1 -- 172.21.15.87:0/4170017959 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 22) v1 ==== 135685+0+0 (secure 0 0 0) 0x7fa38c019070 con 0x7fa394100840 2024-09-13T17:13:51.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.537+0000 7fa391ffb640 1 --2- 172.21.15.87:0/4170017959 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa3840a0e90 0x7fa3840a3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:51.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.538+0000 7fa391ffb640 1 -- 172.21.15.87:0/4170017959 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fa38c0d09e0 con 0x7fa394100840 2024-09-13T17:13:51.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.538+0000 7fa398f9e640 1 --2- 172.21.15.87:0/4170017959 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa3840a0e90 0x7fa3840a3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:51.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.538+0000 7fa398f9e640 1 --2- 172.21.15.87:0/4170017959 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa3840a0e90 0x7fa3840a3350 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa388000c00 tx=0x7fa388031400 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:51.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.544+0000 7fa391ffb640 1 -- 172.21.15.87:0/4170017959 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa38c099f90 con 0x7fa394100840 2024-09-13T17:13:51.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.716+0000 7fa39b202640 1 -- 172.21.15.87:0/4170017959 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa39410a8c0 con 0x7fa394100840 2024-09-13T17:13:51.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.716+0000 7fa391ffb640 1 -- 172.21.15.87:0/4170017959 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa38c09d5b0 con 0x7fa394100840 2024-09-13T17:13:51.717 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-09-13T17:13:51.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.718+0000 7fa39b202640 1 -- 172.21.15.87:0/4170017959 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa3840a0e90 msgr2=0x7fa3840a3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:51.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.718+0000 7fa39b202640 1 --2- 172.21.15.87:0/4170017959 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa3840a0e90 0x7fa3840a3350 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa388000c00 tx=0x7fa388031400 comp rx=0 tx=0).stop 2024-09-13T17:13:51.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.718+0000 7fa39b202640 1 -- 172.21.15.87:0/4170017959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa394100840 msgr2=0x7fa39419d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:51.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.718+0000 7fa39b202640 1 --2- 172.21.15.87:0/4170017959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa394100840 0x7fa39419d190 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa38c011e20 tx=0x7fa38c00b630 comp rx=0 tx=0).stop 2024-09-13T17:13:51.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.718+0000 7fa39b202640 1 -- 172.21.15.87:0/4170017959 shutdown_connections 2024-09-13T17:13:51.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.718+0000 7fa39b202640 1 --2- 172.21.15.87:0/4170017959 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa3840a0e90 0x7fa3840a3350 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.718+0000 7fa39b202640 1 --2- 172.21.15.87:0/4170017959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa394100840 0x7fa39419d190 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.718+0000 7fa39b202640 1 --2- 172.21.15.87:0/4170017959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3940ffe80 0x7fa39419ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.718+0000 7fa39b202640 1 --2- 172.21.15.87:0/4170017959 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3940fec90 0x7fa394068cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.718+0000 7fa39b202640 1 -- 172.21.15.87:0/4170017959 >> 172.21.15.87:0/4170017959 conn(0x7fa3940fa3f0 msgr2=0x7fa394103390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:51.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.718+0000 7fa39b202640 1 -- 172.21.15.87:0/4170017959 shutdown_connections 2024-09-13T17:13:51.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.718+0000 7fa39b202640 1 -- 172.21.15.87:0/4170017959 wait complete. 2024-09-13T17:13:51.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:51 smithi087 ceph-mon[30934]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-13T17:13:51.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:51 smithi087 ceph-mon[30934]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:13:51.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:51 smithi087 ceph-mon[30934]: mgrmap e22: x(active, since 1.02041s), standbys: y, z 2024-09-13T17:13:51.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:51 smithi087 ceph-mon[30934]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:13:51.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:51 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1212631576' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:13:51.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:51 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2110126761' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:13:51.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:51 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:51.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:51 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:51.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:51 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:51.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:51 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:51.732 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:13:51.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.837+0000 7fa9cf861640 1 -- 172.21.15.87:0/2229828254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9c8103110 msgr2=0x7fa9c8105500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:51.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.837+0000 7fa9cf861640 1 --2- 172.21.15.87:0/2229828254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9c8103110 0x7fa9c8105500 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8009900 tx=0x7fa9b802a410 comp rx=0 tx=0).stop 2024-09-13T17:13:51.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.837+0000 7fa9cf861640 1 -- 172.21.15.87:0/2229828254 shutdown_connections 2024-09-13T17:13:51.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.837+0000 7fa9cf861640 1 --2- 172.21.15.87:0/2229828254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9c8105a40 0x7fa9c8107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.837+0000 7fa9cf861640 1 --2- 172.21.15.87:0/2229828254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9c8103110 0x7fa9c8105500 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.837+0000 7fa9cf861640 1 --2- 172.21.15.87:0/2229828254 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9c81007e0 0x7fa9c8102bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.837+0000 7fa9cf861640 1 -- 172.21.15.87:0/2229828254 >> 172.21.15.87:0/2229828254 conn(0x7fa9c80fa3e0 msgr2=0x7fa9c80fc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:51.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.837+0000 7fa9cf861640 1 -- 172.21.15.87:0/2229828254 shutdown_connections 2024-09-13T17:13:51.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.837+0000 7fa9cf861640 1 -- 172.21.15.87:0/2229828254 wait complete. 2024-09-13T17:13:51.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.838+0000 7fa9cf861640 1 Processor -- start 2024-09-13T17:13:51.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.838+0000 7fa9cf861640 1 -- start start 2024-09-13T17:13:51.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.838+0000 7fa9cf861640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9c81007e0 0x7fa9c8195dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:51.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.838+0000 7fa9cf861640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9c8103110 0x7fa9c8196310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:51.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.838+0000 7fa9cf861640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9c8105a40 0x7fa9c819d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:51.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.838+0000 7fa9cf861640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c819d8c0 con 0x7fa9c81007e0 2024-09-13T17:13:51.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.838+0000 7fa9cf861640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c819da30 con 0x7fa9c8105a40 2024-09-13T17:13:51.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.838+0000 7fa9cf861640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c819dbf0 con 0x7fa9c8103110 2024-09-13T17:13:51.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.838+0000 7fa9cd5fd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9c81007e0 0x7fa9c8195dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:51.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.838+0000 7fa9cd5fd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9c81007e0 0x7fa9c8195dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41722/0 (socket says 172.21.15.87:41722) 2024-09-13T17:13:51.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.838+0000 7fa9cd5fd640 1 -- 172.21.15.87:0/3710805455 learned_addr learned my addr 172.21.15.87:0/3710805455 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:51.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.838+0000 7fa9ccdfc640 1 --2- 172.21.15.87:0/3710805455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9c8103110 0x7fa9c8196310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:51.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.838+0000 7fa9cddfe640 1 --2- 172.21.15.87:0/3710805455 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9c8105a40 0x7fa9c819d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:51.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.839+0000 7fa9cd5fd640 1 -- 172.21.15.87:0/3710805455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9c8103110 msgr2=0x7fa9c8196310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:51.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.839+0000 7fa9cd5fd640 1 --2- 172.21.15.87:0/3710805455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9c8103110 0x7fa9c8196310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.839+0000 7fa9cd5fd640 1 -- 172.21.15.87:0/3710805455 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9c8105a40 msgr2=0x7fa9c819d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:51.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.839+0000 7fa9cd5fd640 1 --2- 172.21.15.87:0/3710805455 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9c8105a40 0x7fa9c819d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:51.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.839+0000 7fa9cd5fd640 1 -- 172.21.15.87:0/3710805455 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b8009560 con 0x7fa9c81007e0 2024-09-13T17:13:51.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.839+0000 7fa9cd5fd640 1 --2- 172.21.15.87:0/3710805455 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9c81007e0 0x7fa9c8195dd0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa9c400e9f0 tx=0x7fa9c400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:51.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.839+0000 7fa9be7fc640 1 -- 172.21.15.87:0/3710805455 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c4009720 con 0x7fa9c81007e0 2024-09-13T17:13:51.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.839+0000 7fa9be7fc640 1 -- 172.21.15.87:0/3710805455 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa9c400cd80 con 0x7fa9c81007e0 2024-09-13T17:13:51.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.839+0000 7fa9cf861640 1 -- 172.21.15.87:0/3710805455 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9c819ded0 con 0x7fa9c81007e0 2024-09-13T17:13:51.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.839+0000 7fa9be7fc640 1 -- 172.21.15.87:0/3710805455 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c4010430 con 0x7fa9c81007e0 2024-09-13T17:13:51.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.839+0000 7fa9cf861640 1 -- 172.21.15.87:0/3710805455 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9c819e2a0 con 0x7fa9c81007e0 2024-09-13T17:13:51.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:51 smithi149 ceph-mon[35496]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-13T17:13:51.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:51 smithi149 ceph-mon[35496]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:13:51.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:51 smithi149 ceph-mon[35496]: mgrmap e22: x(active, since 1.02041s), standbys: y, z 2024-09-13T17:13:51.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:51 smithi149 ceph-mon[35496]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:13:51.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:51 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1212631576' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:13:51.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:51 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2110126761' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:13:51.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:51 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:51.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:51 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:51.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:51 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:51.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:51 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:51.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.840+0000 7fa9cf861640 1 -- 172.21.15.87:0/3710805455 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9c80fbed0 con 0x7fa9c81007e0 2024-09-13T17:13:51.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.841+0000 7fa9be7fc640 1 -- 172.21.15.87:0/3710805455 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 22) v1 ==== 135685+0+0 (secure 0 0 0) 0x7fa9c4005020 con 0x7fa9c81007e0 2024-09-13T17:13:51.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.842+0000 7fa9be7fc640 1 --2- 172.21.15.87:0/3710805455 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa9b40a0e90 0x7fa9b40a3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:51.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.843+0000 7fa9ccdfc640 1 --2- 172.21.15.87:0/3710805455 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa9b40a0e90 0x7fa9b40a3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:51.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.843+0000 7fa9be7fc640 1 -- 172.21.15.87:0/3710805455 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fa9c4014070 con 0x7fa9c81007e0 2024-09-13T17:13:51.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.843+0000 7fa9ccdfc640 1 --2- 172.21.15.87:0/3710805455 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa9b40a0e90 0x7fa9b40a3350 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8005940 tx=0x7fa9b80058d0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:51.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:51.846+0000 7fa9be7fc640 1 -- 172.21.15.87:0/3710805455 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa9c40962f0 con 0x7fa9c81007e0 2024-09-13T17:13:51.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:51 smithi118 ceph-mon[34374]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-13T17:13:51.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:51 smithi118 ceph-mon[34374]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:13:51.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:51 smithi118 ceph-mon[34374]: mgrmap e22: x(active, since 1.02041s), standbys: y, z 2024-09-13T17:13:51.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:51 smithi118 ceph-mon[34374]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:13:51.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:51 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1212631576' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:13:51.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:51 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2110126761' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:13:51.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:51 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:51.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:51 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:51.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:51 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:51.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:51 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:52.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.022+0000 7fa9cf861640 1 -- 172.21.15.87:0/3710805455 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa9c802c480 con 0x7fa9c81007e0 2024-09-13T17:13:52.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.023+0000 7fa9be7fc640 1 -- 172.21.15.87:0/3710805455 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa9c4099910 con 0x7fa9c81007e0 2024-09-13T17:13:52.024 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-09-13T17:13:52.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.025+0000 7fa9cf861640 1 -- 172.21.15.87:0/3710805455 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa9b40a0e90 msgr2=0x7fa9b40a3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.025+0000 7fa9cf861640 1 --2- 172.21.15.87:0/3710805455 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa9b40a0e90 0x7fa9b40a3350 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8005940 tx=0x7fa9b80058d0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.025+0000 7fa9cf861640 1 -- 172.21.15.87:0/3710805455 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9c81007e0 msgr2=0x7fa9c8195dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.025+0000 7fa9cf861640 1 --2- 172.21.15.87:0/3710805455 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9c81007e0 0x7fa9c8195dd0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa9c400e9f0 tx=0x7fa9c400edf0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.025+0000 7fa9cf861640 1 -- 172.21.15.87:0/3710805455 shutdown_connections 2024-09-13T17:13:52.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.025+0000 7fa9cf861640 1 --2- 172.21.15.87:0/3710805455 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9c8105a40 0x7fa9c819d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.025+0000 7fa9cf861640 1 --2- 172.21.15.87:0/3710805455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9c8103110 0x7fa9c8196310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.025+0000 7fa9cf861640 1 --2- 172.21.15.87:0/3710805455 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa9b40a0e90 0x7fa9b40a3350 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.025+0000 7fa9cf861640 1 --2- 172.21.15.87:0/3710805455 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9c81007e0 0x7fa9c8195dd0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.025+0000 7fa9cf861640 1 -- 172.21.15.87:0/3710805455 >> 172.21.15.87:0/3710805455 conn(0x7fa9c80fa3e0 msgr2=0x7fa9c81010c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:52.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.025+0000 7fa9cf861640 1 -- 172.21.15.87:0/3710805455 shutdown_connections 2024-09-13T17:13:52.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.025+0000 7fa9cf861640 1 -- 172.21.15.87:0/3710805455 wait complete. 2024-09-13T17:13:52.038 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:13:52.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.139+0000 7f233a6e5640 1 -- 172.21.15.87:0/723994751 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2334105ae0 msgr2=0x7f2334107ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.139+0000 7f233a6e5640 1 --2- 172.21.15.87:0/723994751 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2334105ae0 0x7f2334107ef0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f232c009ca0 tx=0x7f232c02a8c0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.140+0000 7f233a6e5640 1 -- 172.21.15.87:0/723994751 shutdown_connections 2024-09-13T17:13:52.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.140+0000 7f233a6e5640 1 --2- 172.21.15.87:0/723994751 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2334105ae0 0x7f2334107ef0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.140+0000 7f233a6e5640 1 --2- 172.21.15.87:0/723994751 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23341031b0 0x7f23341055a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.140+0000 7f233a6e5640 1 --2- 172.21.15.87:0/723994751 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2334100880 0x7f2334102c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.140+0000 7f233a6e5640 1 -- 172.21.15.87:0/723994751 >> 172.21.15.87:0/723994751 conn(0x7f23340fa440 msgr2=0x7f23340fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:52.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.140+0000 7f233a6e5640 1 -- 172.21.15.87:0/723994751 shutdown_connections 2024-09-13T17:13:52.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.140+0000 7f233a6e5640 1 -- 172.21.15.87:0/723994751 wait complete. 2024-09-13T17:13:52.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.140+0000 7f233a6e5640 1 Processor -- start 2024-09-13T17:13:52.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.140+0000 7f233a6e5640 1 -- start start 2024-09-13T17:13:52.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.140+0000 7f233a6e5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2334100880 0x7f23341001a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:52.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.140+0000 7f233a6e5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23341031b0 0x7f23340fe830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:52.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.140+0000 7f233a6e5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2334105ae0 0x7f23340fed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:52.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.141+0000 7f233a6e5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23340ff500 con 0x7f2334100880 2024-09-13T17:13:52.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.141+0000 7f233a6e5640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23340ff670 con 0x7f23341031b0 2024-09-13T17:13:52.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.141+0000 7f233a6e5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233419fe40 con 0x7f2334105ae0 2024-09-13T17:13:52.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.141+0000 7f2333fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2334100880 0x7f23341001a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:52.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.141+0000 7f2333fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2334100880 0x7f23341001a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41744/0 (socket says 172.21.15.87:41744) 2024-09-13T17:13:52.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.141+0000 7f2333fff640 1 -- 172.21.15.87:0/3260724879 learned_addr learned my addr 172.21.15.87:0/3260724879 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:52.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.141+0000 7f2338c82640 1 --2- 172.21.15.87:0/3260724879 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2334105ae0 0x7f23340fed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:52.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.141+0000 7f23337fe640 1 --2- 172.21.15.87:0/3260724879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23341031b0 0x7f23340fe830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:52.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.141+0000 7f2333fff640 1 -- 172.21.15.87:0/3260724879 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2334105ae0 msgr2=0x7f23340fed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.141+0000 7f2333fff640 1 --2- 172.21.15.87:0/3260724879 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2334105ae0 0x7f23340fed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.141+0000 7f2333fff640 1 -- 172.21.15.87:0/3260724879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23341031b0 msgr2=0x7f23340fe830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.141+0000 7f2333fff640 1 --2- 172.21.15.87:0/3260724879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23341031b0 0x7f23340fe830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.141+0000 7f2333fff640 1 -- 172.21.15.87:0/3260724879 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232c009900 con 0x7f2334100880 2024-09-13T17:13:52.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.141+0000 7f23337fe640 1 --2- 172.21.15.87:0/3260724879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23341031b0 0x7f23340fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:13:52.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.141+0000 7f2333fff640 1 --2- 172.21.15.87:0/3260724879 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2334100880 0x7f23341001a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f232400ea20 tx=0x7f232400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:52.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.141+0000 7f23317fa640 1 -- 172.21.15.87:0/3260724879 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2324009720 con 0x7f2334100880 2024-09-13T17:13:52.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.141+0000 7f23317fa640 1 -- 172.21.15.87:0/3260724879 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f232400cd80 con 0x7f2334100880 2024-09-13T17:13:52.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.141+0000 7f233a6e5640 1 -- 172.21.15.87:0/3260724879 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23341a00a0 con 0x7f2334100880 2024-09-13T17:13:52.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.141+0000 7f23317fa640 1 -- 172.21.15.87:0/3260724879 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2324010430 con 0x7f2334100880 2024-09-13T17:13:52.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.141+0000 7f233a6e5640 1 -- 172.21.15.87:0/3260724879 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23341a0560 con 0x7f2334100880 2024-09-13T17:13:52.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.142+0000 7f233a6e5640 1 -- 172.21.15.87:0/3260724879 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23340fbf30 con 0x7f2334100880 2024-09-13T17:13:52.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.144+0000 7f23317fa640 1 -- 172.21.15.87:0/3260724879 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 22) v1 ==== 135685+0+0 (secure 0 0 0) 0x7f2324004f90 con 0x7f2334100880 2024-09-13T17:13:52.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.144+0000 7f23317fa640 1 --2- 172.21.15.87:0/3260724879 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f231c0a0e90 0x7f231c0a3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:52.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.144+0000 7f23337fe640 1 --2- 172.21.15.87:0/3260724879 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f231c0a0e90 0x7f231c0a3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:52.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.144+0000 7f23317fa640 1 -- 172.21.15.87:0/3260724879 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f2324014070 con 0x7f2334100880 2024-09-13T17:13:52.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.145+0000 7f23337fe640 1 --2- 172.21.15.87:0/3260724879 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f231c0a0e90 0x7f231c0a3350 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f23340fff10 tx=0x7f2328005f90 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:52.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.147+0000 7f23317fa640 1 -- 172.21.15.87:0/3260724879 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2324096500 con 0x7f2334100880 2024-09-13T17:13:52.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.325+0000 7f233a6e5640 1 -- 172.21.15.87:0/3260724879 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23340fb9a0 con 0x7f2334100880 2024-09-13T17:13:52.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.326+0000 7f23317fa640 1 -- 172.21.15.87:0/3260724879 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+25192 (secure 0 0 0) 0x7f2324099b20 con 0x7f2334100880 2024-09-13T17:13:52.328 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:13:52.328 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":94,"fsid":"043d5bae-71f2-11ef-bceb-c7b262605968","created":"2024-09-13T17:03:57.852010+0000","modified":"2024-09-13T17:13:49.377136+0000","last_up_change":"2024-09-13T17:10:34.423548+0000","last_in_change":"2024-09-13T17:10:14.228123+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:07:02.286400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:11:21.965141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:11:22.504345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:11:25.565163+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58250283-85c0-416e-abdd-1fc5a7ff0c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6803","nonce":1316956138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6805","nonce":1316956138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6809","nonce":1316956138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6807","nonce":1316956138}]},"public_addr":"172.21.15.87:6803/1316956138","cluster_addr":"172.21.15.87:6805/1316956138","heartbeat_back_addr":"172.21.15.87:6809/1316956138","heartbeat_front_addr":"172.21.15.87:6807/1316956138","state":["exists","up"]},{"osd":1,"uuid":"b9d49969-94b1-4262-b4ff-db0a8e3331af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6801","nonce":3352566727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6803","nonce":3352566727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6807","nonce":3352566727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6805","nonce":3352566727}]},"public_addr":"172.21.15.118:6801/3352566727","cluster_addr":"172.21.15.118:6803/3352566727","heartbeat_back_addr":"172.21.15.118:6807/3352566727","heartbeat_front_addr":"172.21.15.118:6805/3352566727","state":["exists","up"]},{"osd":2,"uuid":"ba64549e-d736-426f-b466-f569af5f16d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6801","nonce":2774581686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6803","nonce":2774581686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6807","nonce":2774581686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6805","nonce":2774581686}]},"public_addr":"172.21.15.149:6801/2774581686","cluster_addr":"172.21.15.149:6803/2774581686","heartbeat_back_addr":"172.21.15.149:6807/2774581686","heartbeat_front_addr":"172.21.15.149:6805/2774581686","state":["exists","up"]},{"osd":3,"uuid":"3d5553e5-371b-49fd-976b-9e72a97a2f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6811","nonce":3306119066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6813","nonce":3306119066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6817","nonce":3306119066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6815","nonce":3306119066}]},"public_addr":"172.21.15.87:6811/3306119066","cluster_addr":"172.21.15.87:6813/3306119066","heartbeat_back_addr":"172.21.15.87:6817/3306119066","heartbeat_front_addr":"172.21.15.87:6815/3306119066","state":["exists","up"]},{"osd":4,"uuid":"2fbe0e27-34ec-42a6-9962-f1d8202b3159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6809","nonce":3342349890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6811","nonce":3342349890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6815","nonce":3342349890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6813","nonce":3342349890}]},"public_addr":"172.21.15.118:6809/3342349890","cluster_addr":"172.21.15.118:6811/3342349890","heartbeat_back_addr":"172.21.15.118:6815/3342349890","heartbeat_front_addr":"172.21.15.118:6813/3342349890","state":["exists","up"]},{"osd":5,"uuid":"53c14519-6170-4b5a-a79d-4835882d7bec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6809","nonce":3468867124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6811","nonce":3468867124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6815","nonce":3468867124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6813","nonce":3468867124}]},"public_addr":"172.21.15.149:6809/3468867124","cluster_addr":"172.21.15.149:6811/3468867124","heartbeat_back_addr":"172.21.15.149:6815/3468867124","heartbeat_front_addr":"172.21.15.149:6813/3468867124","state":["exists","up"]},{"osd":6,"uuid":"d3951b32-db77-4b8b-9de0-f05e03d13f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6819","nonce":326563617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6821","nonce":326563617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6825","nonce":326563617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6823","nonce":326563617}]},"public_addr":"172.21.15.87:6819/326563617","cluster_addr":"172.21.15.87:6821/326563617","heartbeat_back_addr":"172.21.15.87:6825/326563617","heartbeat_front_addr":"172.21.15.87:6823/326563617","state":["exists","up"]},{"osd":7,"uuid":"4d46dab7-a8bf-4e3e-b5c0-43860d336bdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6817","nonce":1690268990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6819","nonce":1690268990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6823","nonce":1690268990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6821","nonce":1690268990}]},"public_addr":"172.21.15.118:6817/1690268990","cluster_addr":"172.21.15.118:6819/1690268990","heartbeat_back_addr":"172.21.15.118:6823/1690268990","heartbeat_front_addr":"172.21.15.118:6821/1690268990","state":["exists","up"]},{"osd":8,"uuid":"5a015a7d-60a3-4412-96af-1b61d2ad51f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6817","nonce":1558675380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6819","nonce":1558675380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6823","nonce":1558675380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6821","nonce":1558675380}]},"public_addr":"172.21.15.149:6817/1558675380","cluster_addr":"172.21.15.149:6819/1558675380","heartbeat_back_addr":"172.21.15.149:6823/1558675380","heartbeat_front_addr":"172.21.15.149:6821/1558675380","state":["exists","up"]},{"osd":9,"uuid":"248c0b6e-4c4e-4c63-a0dd-e4cdf3b997a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6827","nonce":1453934262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6829","nonce":1453934262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6833","nonce":1453934262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6831","nonce":1453934262}]},"public_addr":"172.21.15.87:6827/1453934262","cluster_addr":"172.21.15.87:6829/1453934262","heartbeat_back_addr":"172.21.15.87:6833/1453934262","heartbeat_front_addr":"172.21.15.87:6831/1453934262","state":["exists","up"]},{"osd":10,"uuid":"24238714-e737-4371-b5d5-0cd3395f09bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6825","nonce":1034318850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6827","nonce":1034318850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6831","nonce":1034318850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6829","nonce":1034318850}]},"public_addr":"172.21.15.118:6825/1034318850","cluster_addr":"172.21.15.118:6827/1034318850","heartbeat_back_addr":"172.21.15.118:6831/1034318850","heartbeat_front_addr":"172.21.15.118:6829/1034318850","state":["exists","up"]},{"osd":11,"uuid":"409dd3bf-5154-4dea-8708-7de7f9e2e793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6825","nonce":271000465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6827","nonce":271000465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6831","nonce":271000465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6829","nonce":271000465}]},"public_addr":"172.21.15.149:6825/271000465","cluster_addr":"172.21.15.149:6827/271000465","heartbeat_back_addr":"172.21.15.149:6831/271000465","heartbeat_front_addr":"172.21.15.149:6829/271000465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:16.382664+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:37.914250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:00.425876+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:23.960183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:47.004088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:10.214345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:33.719221+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:57.099599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:20.971881+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:44.827167+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:08.135516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:32.085853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.d","mappings":[{"from":1,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8},{"from":5,"to":7}]},{"pgid":"3.28","mappings":[{"from":3,"to":6},{"from":5,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/718653925":"2024-09-14T17:13:49.377087+0000","172.21.15.87:0/3081317043":"2024-09-14T17:13:49.377087+0000","172.21.15.87:0/1633498542":"2024-09-14T17:13:49.377087+0000","172.21.15.87:6801/1587363880":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/3403361612":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/553289143":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/1475107314":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/515676743":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/3270371628":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6800/1587363880":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6800/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6801/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/2612130442":"2024-09-14T17:13:49.377087+0000","172.21.15.87:0/586423689":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6800/701043027":"2024-09-14T17:13:49.377087+0000","172.21.15.87:6801/701043027":"2024-09-14T17:13:49.377087+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:13:52.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.329+0000 7f233a6e5640 1 -- 172.21.15.87:0/3260724879 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f231c0a0e90 msgr2=0x7f231c0a3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.329+0000 7f233a6e5640 1 --2- 172.21.15.87:0/3260724879 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f231c0a0e90 0x7f231c0a3350 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f23340fff10 tx=0x7f2328005f90 comp rx=0 tx=0).stop 2024-09-13T17:13:52.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.329+0000 7f233a6e5640 1 -- 172.21.15.87:0/3260724879 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2334100880 msgr2=0x7f23341001a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.329+0000 7f233a6e5640 1 --2- 172.21.15.87:0/3260724879 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2334100880 0x7f23341001a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f232400ea20 tx=0x7f232400ee20 comp rx=0 tx=0).stop 2024-09-13T17:13:52.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.329+0000 7f233a6e5640 1 -- 172.21.15.87:0/3260724879 shutdown_connections 2024-09-13T17:13:52.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.329+0000 7f233a6e5640 1 --2- 172.21.15.87:0/3260724879 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2334105ae0 0x7f23340fed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.329+0000 7f233a6e5640 1 --2- 172.21.15.87:0/3260724879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23341031b0 0x7f23340fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.329+0000 7f233a6e5640 1 --2- 172.21.15.87:0/3260724879 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f231c0a0e90 0x7f231c0a3350 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.329+0000 7f233a6e5640 1 --2- 172.21.15.87:0/3260724879 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2334100880 0x7f23341001a0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.329+0000 7f233a6e5640 1 -- 172.21.15.87:0/3260724879 >> 172.21.15.87:0/3260724879 conn(0x7f23340fa440 msgr2=0x7f2334101280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:52.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.329+0000 7f233a6e5640 1 -- 172.21.15.87:0/3260724879 shutdown_connections 2024-09-13T17:13:52.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.329+0000 7f233a6e5640 1 -- 172.21.15.87:0/3260724879 wait complete. 2024-09-13T17:13:52.342 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:07:02.286400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:11:21.965141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:11:22.504345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:11:25.565163+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:13:52.343 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:13:52.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.452+0000 7f59b6c80640 1 -- 172.21.15.87:0/2603958398 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59b0103110 msgr2=0x7f59b0105500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.452+0000 7f59b6c80640 1 --2- 172.21.15.87:0/2603958398 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59b0103110 0x7f59b0105500 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f599c009900 tx=0x7f599c02a410 comp rx=0 tx=0).stop 2024-09-13T17:13:52.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.452+0000 7f59b6c80640 1 -- 172.21.15.87:0/2603958398 shutdown_connections 2024-09-13T17:13:52.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.452+0000 7f59b6c80640 1 --2- 172.21.15.87:0/2603958398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59b0105a40 0x7f59b0107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.452+0000 7f59b6c80640 1 --2- 172.21.15.87:0/2603958398 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59b0103110 0x7f59b0105500 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.452+0000 7f59b6c80640 1 --2- 172.21.15.87:0/2603958398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59b01007e0 0x7f59b0102bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.452+0000 7f59b6c80640 1 -- 172.21.15.87:0/2603958398 >> 172.21.15.87:0/2603958398 conn(0x7f59b00fa3e0 msgr2=0x7f59b00fc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:52.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.452+0000 7f59b6c80640 1 -- 172.21.15.87:0/2603958398 shutdown_connections 2024-09-13T17:13:52.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.452+0000 7f59b6c80640 1 -- 172.21.15.87:0/2603958398 wait complete. 2024-09-13T17:13:52.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.453+0000 7f59b6c80640 1 Processor -- start 2024-09-13T17:13:52.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.453+0000 7f59b6c80640 1 -- start start 2024-09-13T17:13:52.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.453+0000 7f59b6c80640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59b01007e0 0x7f59b0195dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:52.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.453+0000 7f59b6c80640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59b0103110 0x7f59b0196310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:52.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.453+0000 7f59b6c80640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59b0105a40 0x7f59b019d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:52.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.453+0000 7f59b6c80640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b019d8c0 con 0x7f59b0105a40 2024-09-13T17:13:52.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.453+0000 7f59b6c80640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b019da30 con 0x7f59b0103110 2024-09-13T17:13:52.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.453+0000 7f59b6c80640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b019dbf0 con 0x7f59b01007e0 2024-09-13T17:13:52.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.453+0000 7f59b4a1c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59b01007e0 0x7f59b0195dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:52.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.453+0000 7f59b521d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59b0105a40 0x7f59b019d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:52.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.453+0000 7f59affff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59b0103110 0x7f59b0196310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:52.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.453+0000 7f59b4a1c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59b01007e0 0x7f59b0195dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:55264/0 (socket says 172.21.15.87:55264) 2024-09-13T17:13:52.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.453+0000 7f59b4a1c640 1 -- 172.21.15.87:0/664232091 learned_addr learned my addr 172.21.15.87:0/664232091 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:52.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.453+0000 7f59b521d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59b0105a40 0x7f59b019d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41766/0 (socket says 172.21.15.87:41766) 2024-09-13T17:13:52.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.453+0000 7f59b4a1c640 1 -- 172.21.15.87:0/664232091 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59b0103110 msgr2=0x7f59b0196310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.453+0000 7f59b4a1c640 1 --2- 172.21.15.87:0/664232091 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59b0103110 0x7f59b0196310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.454+0000 7f59b4a1c640 1 -- 172.21.15.87:0/664232091 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59b0105a40 msgr2=0x7f59b019d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.454+0000 7f59b4a1c640 1 --2- 172.21.15.87:0/664232091 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59b0105a40 0x7f59b019d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.454+0000 7f59b4a1c640 1 -- 172.21.15.87:0/664232091 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f599c009560 con 0x7f59b01007e0 2024-09-13T17:13:52.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.454+0000 7f59b521d640 1 --2- 172.21.15.87:0/664232091 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59b0105a40 0x7f59b019d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:13:52.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.454+0000 7f59b4a1c640 1 --2- 172.21.15.87:0/664232091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59b01007e0 0x7f59b0195dd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f59a400e9f0 tx=0x7f59a400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:52.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.454+0000 7f59adffb640 1 -- 172.21.15.87:0/664232091 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a4009700 con 0x7f59b01007e0 2024-09-13T17:13:52.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.454+0000 7f59b6c80640 1 -- 172.21.15.87:0/664232091 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b019ded0 con 0x7f59b01007e0 2024-09-13T17:13:52.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.454+0000 7f59adffb640 1 -- 172.21.15.87:0/664232091 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f59a400cd80 con 0x7f59b01007e0 2024-09-13T17:13:52.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.454+0000 7f59adffb640 1 -- 172.21.15.87:0/664232091 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a4018840 con 0x7f59b01007e0 2024-09-13T17:13:52.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.454+0000 7f59b6c80640 1 -- 172.21.15.87:0/664232091 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b019e300 con 0x7f59b01007e0 2024-09-13T17:13:52.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.455+0000 7f59b6c80640 1 -- 172.21.15.87:0/664232091 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b00fbed0 con 0x7f59b01007e0 2024-09-13T17:13:52.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.456+0000 7f59adffb640 1 -- 172.21.15.87:0/664232091 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 23) v1 ==== 135993+0+0 (secure 0 0 0) 0x7f59a40189a0 con 0x7f59b01007e0 2024-09-13T17:13:52.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.457+0000 7f59adffb640 1 --2- 172.21.15.87:0/664232091 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f59a00a1200 0x7f59a00a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:52.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.457+0000 7f59affff640 1 --2- 172.21.15.87:0/664232091 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f59a00a1200 0x7f59a00a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:52.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.457+0000 7f59adffb640 1 -- 172.21.15.87:0/664232091 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f59a4014070 con 0x7f59b01007e0 2024-09-13T17:13:52.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.458+0000 7f59affff640 1 --2- 172.21.15.87:0/664232091 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f59a00a1200 0x7f59a00a36c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f599c005940 tx=0x7f599c0058d0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:52.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.460+0000 7f59adffb640 1 -- 172.21.15.87:0/664232091 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f59a4096990 con 0x7f59b01007e0 2024-09-13T17:13:52.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.638+0000 7f59b6c80640 1 -- 172.21.15.87:0/664232091 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f59b002c410 con 0x7f59b01007e0 2024-09-13T17:13:52.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.639+0000 7f59adffb640 1 -- 172.21.15.87:0/664232091 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f59a4099fb0 con 0x7f59b01007e0 2024-09-13T17:13:52.640 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-09-13T17:13:52.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.641+0000 7f59b6c80640 1 -- 172.21.15.87:0/664232091 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f59a00a1200 msgr2=0x7f59a00a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.641+0000 7f59b6c80640 1 --2- 172.21.15.87:0/664232091 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f59a00a1200 0x7f59a00a36c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f599c005940 tx=0x7f599c0058d0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.641+0000 7f59b6c80640 1 -- 172.21.15.87:0/664232091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59b01007e0 msgr2=0x7f59b0195dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.641+0000 7f59b6c80640 1 --2- 172.21.15.87:0/664232091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59b01007e0 0x7f59b0195dd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f59a400e9f0 tx=0x7f59a400eeb0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.641+0000 7f59b6c80640 1 -- 172.21.15.87:0/664232091 shutdown_connections 2024-09-13T17:13:52.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.641+0000 7f59b6c80640 1 --2- 172.21.15.87:0/664232091 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f59a00a1200 0x7f59a00a36c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.641+0000 7f59b6c80640 1 --2- 172.21.15.87:0/664232091 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59b0105a40 0x7f59b019d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.641+0000 7f59b6c80640 1 --2- 172.21.15.87:0/664232091 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59b0103110 0x7f59b0196310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.641+0000 7f59b6c80640 1 --2- 172.21.15.87:0/664232091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59b01007e0 0x7f59b0195dd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.641+0000 7f59b6c80640 1 -- 172.21.15.87:0/664232091 >> 172.21.15.87:0/664232091 conn(0x7f59b00fa3e0 msgr2=0x7f59b01010c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:52.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.641+0000 7f59b6c80640 1 -- 172.21.15.87:0/664232091 shutdown_connections 2024-09-13T17:13:52.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.641+0000 7f59b6c80640 1 -- 172.21.15.87:0/664232091 wait complete. 2024-09-13T17:13:52.653 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: [13/Sep/2024:17:13:50] ENGINE Bus STARTING 2024-09-13T17:13:52.653 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: [13/Sep/2024:17:13:50] ENGINE Serving on http://172.21.15.87:8765 2024-09-13T17:13:52.653 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: [13/Sep/2024:17:13:51] ENGINE Serving on https://172.21.15.87:7150 2024-09-13T17:13:52.653 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: [13/Sep/2024:17:13:51] ENGINE Bus STARTED 2024-09-13T17:13:52.653 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: [13/Sep/2024:17:13:51] ENGINE Error in HTTPServer.serve 2024-09-13T17:13:52.653 INFO:journalctl@ceph.mon.a.smithi087.stdout: Traceback (most recent call last): 2024-09-13T17:13:52.653 INFO:journalctl@ceph.mon.a.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T17:13:52.654 INFO:journalctl@ceph.mon.a.smithi087.stdout: self._connections.run(self.expiration_interval) 2024-09-13T17:13:52.654 INFO:journalctl@ceph.mon.a.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T17:13:52.654 INFO:journalctl@ceph.mon.a.smithi087.stdout: self._run(expiration_interval) 2024-09-13T17:13:52.654 INFO:journalctl@ceph.mon.a.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T17:13:52.654 INFO:journalctl@ceph.mon.a.smithi087.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T17:13:52.654 INFO:journalctl@ceph.mon.a.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T17:13:52.654 INFO:journalctl@ceph.mon.a.smithi087.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T17:13:52.654 INFO:journalctl@ceph.mon.a.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T17:13:52.654 INFO:journalctl@ceph.mon.a.smithi087.stdout: s = self.context.wrap_socket( 2024-09-13T17:13:52.654 INFO:journalctl@ceph.mon.a.smithi087.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T17:13:52.654 INFO:journalctl@ceph.mon.a.smithi087.stdout: return self.sslsocket_class._create( 2024-09-13T17:13:52.654 INFO:journalctl@ceph.mon.a.smithi087.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T17:13:52.654 INFO:journalctl@ceph.mon.a.smithi087.stdout: self.do_handshake() 2024-09-13T17:13:52.654 INFO:journalctl@ceph.mon.a.smithi087.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T17:13:52.655 INFO:journalctl@ceph.mon.a.smithi087.stdout: self._sslobj.do_handshake() 2024-09-13T17:13:52.655 INFO:journalctl@ceph.mon.a.smithi087.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T17:13:52.655 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:13:52.655 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1788785668' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:13:52.655 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:52.655 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:52.655 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/4170017959' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:13:52.655 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:52.655 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:52.655 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.655 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.655 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' cmd='[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]': finished 2024-09-13T17:13:52.655 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:52.656 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:52.656 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:52.656 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.657 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:13:52.657 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:52.657 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.657 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.657 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.657 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.657 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.658 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.658 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.658 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.658 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.658 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.658 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.658 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.658 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.658 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.658 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.658 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:13:52.658 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:13:52.658 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3710805455' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:13:52.658 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3260724879' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:13:52.659 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:52 smithi087 ceph-mon[30934]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-09-13T17:13:52.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.764+0000 7ff55733e640 1 -- 172.21.15.87:0/1984024582 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5500febc0 msgr2=0x7ff55010cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.764+0000 7ff55733e640 1 --2- 172.21.15.87:0/1984024582 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5500febc0 0x7ff55010cbb0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff548009ca0 tx=0x7ff54802a8c0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.764+0000 7ff55733e640 1 -- 172.21.15.87:0/1984024582 shutdown_connections 2024-09-13T17:13:52.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.764+0000 7ff55733e640 1 --2- 172.21.15.87:0/1984024582 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5500febc0 0x7ff55010cbb0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.764+0000 7ff55733e640 1 --2- 172.21.15.87:0/1984024582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5500fe220 0x7ff5500fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.764+0000 7ff55733e640 1 --2- 172.21.15.87:0/1984024582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff550104d00 0x7ff5501050e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.764+0000 7ff55733e640 1 -- 172.21.15.87:0/1984024582 >> 172.21.15.87:0/1984024582 conn(0x7ff5500753f0 msgr2=0x7ff5500fc740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:52.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.764+0000 7ff55733e640 1 -- 172.21.15.87:0/1984024582 shutdown_connections 2024-09-13T17:13:52.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.764+0000 7ff55733e640 1 -- 172.21.15.87:0/1984024582 wait complete. 2024-09-13T17:13:52.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.765+0000 7ff55733e640 1 Processor -- start 2024-09-13T17:13:52.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.765+0000 7ff55733e640 1 -- start start 2024-09-13T17:13:52.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.765+0000 7ff55733e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5500fe220 0x7ff550196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:52.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.765+0000 7ff55733e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5500febc0 0x7ff5501967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:52.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.765+0000 7ff55733e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff550104d00 0x7ff55019abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:52.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.765+0000 7ff55733e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55019b1c0 con 0x7ff5500febc0 2024-09-13T17:13:52.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.765+0000 7ff55733e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55019b330 con 0x7ff5500fe220 2024-09-13T17:13:52.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.765+0000 7ff55733e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55019b4f0 con 0x7ff550104d00 2024-09-13T17:13:52.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.765+0000 7ff5548d9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5500febc0 0x7ff5501967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:52.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.765+0000 7ff5548d9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5500febc0 0x7ff5501967d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41776/0 (socket says 172.21.15.87:41776) 2024-09-13T17:13:52.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.765+0000 7ff5548d9640 1 -- 172.21.15.87:0/29561137 learned_addr learned my addr 172.21.15.87:0/29561137 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:52.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.765+0000 7ff5550da640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5500fe220 0x7ff550196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:52.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.765+0000 7ff5558db640 1 --2- 172.21.15.87:0/29561137 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff550104d00 0x7ff55019abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:52.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.766+0000 7ff5548d9640 1 -- 172.21.15.87:0/29561137 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff550104d00 msgr2=0x7ff55019abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.766+0000 7ff5548d9640 1 --2- 172.21.15.87:0/29561137 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff550104d00 0x7ff55019abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.766+0000 7ff5548d9640 1 -- 172.21.15.87:0/29561137 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5500fe220 msgr2=0x7ff550196290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.766+0000 7ff5548d9640 1 --2- 172.21.15.87:0/29561137 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5500fe220 0x7ff550196290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.766+0000 7ff5548d9640 1 -- 172.21.15.87:0/29561137 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff548009900 con 0x7ff5500febc0 2024-09-13T17:13:52.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.766+0000 7ff5550da640 1 --2- 172.21.15.87:0/29561137 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5500fe220 0x7ff550196290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:13:52.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.766+0000 7ff5548d9640 1 --2- 172.21.15.87:0/29561137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5500febc0 0x7ff5501967d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff54000d950 tx=0x7ff54000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:52.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.766+0000 7ff5467fc640 1 -- 172.21.15.87:0/29561137 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff540009a30 con 0x7ff5500febc0 2024-09-13T17:13:52.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.766+0000 7ff5467fc640 1 -- 172.21.15.87:0/29561137 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff5400044d0 con 0x7ff5500febc0 2024-09-13T17:13:52.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.766+0000 7ff55733e640 1 -- 172.21.15.87:0/29561137 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff55019b7d0 con 0x7ff5500febc0 2024-09-13T17:13:52.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.766+0000 7ff5467fc640 1 -- 172.21.15.87:0/29561137 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5400047a0 con 0x7ff5500febc0 2024-09-13T17:13:52.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.766+0000 7ff55733e640 1 -- 172.21.15.87:0/29561137 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5501a3050 con 0x7ff5500febc0 2024-09-13T17:13:52.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.767+0000 7ff55733e640 1 -- 172.21.15.87:0/29561137 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff550101540 con 0x7ff5500febc0 2024-09-13T17:13:52.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.769+0000 7ff5467fc640 1 -- 172.21.15.87:0/29561137 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 23) v1 ==== 135993+0+0 (secure 0 0 0) 0x7ff540009b90 con 0x7ff5500febc0 2024-09-13T17:13:52.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.770+0000 7ff5467fc640 1 --2- 172.21.15.87:0/29561137 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff53c0a1200 0x7ff53c0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:52.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.770+0000 7ff5550da640 1 --2- 172.21.15.87:0/29561137 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff53c0a1200 0x7ff53c0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:52.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.770+0000 7ff5467fc640 1 -- 172.21.15.87:0/29561137 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7ff5400ccb40 con 0x7ff5500febc0 2024-09-13T17:13:52.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.770+0000 7ff5550da640 1 --2- 172.21.15.87:0/29561137 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff53c0a1200 0x7ff53c0a36c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff54c009f40 tx=0x7ff54c005f90 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:52.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.775+0000 7ff5467fc640 1 -- 172.21.15.87:0/29561137 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff540095be0 con 0x7ff5500febc0 2024-09-13T17:13:52.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: [13/Sep/2024:17:13:50] ENGINE Bus STARTING 2024-09-13T17:13:52.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: [13/Sep/2024:17:13:50] ENGINE Serving on http://172.21.15.87:8765 2024-09-13T17:13:52.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: [13/Sep/2024:17:13:51] ENGINE Serving on https://172.21.15.87:7150 2024-09-13T17:13:52.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: [13/Sep/2024:17:13:51] ENGINE Bus STARTED 2024-09-13T17:13:52.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: [13/Sep/2024:17:13:51] ENGINE Error in HTTPServer.serve 2024-09-13T17:13:52.843 INFO:journalctl@ceph.mon.c.smithi149.stdout: Traceback (most recent call last): 2024-09-13T17:13:52.843 INFO:journalctl@ceph.mon.c.smithi149.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T17:13:52.843 INFO:journalctl@ceph.mon.c.smithi149.stdout: self._connections.run(self.expiration_interval) 2024-09-13T17:13:52.843 INFO:journalctl@ceph.mon.c.smithi149.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T17:13:52.843 INFO:journalctl@ceph.mon.c.smithi149.stdout: self._run(expiration_interval) 2024-09-13T17:13:52.843 INFO:journalctl@ceph.mon.c.smithi149.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T17:13:52.843 INFO:journalctl@ceph.mon.c.smithi149.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T17:13:52.843 INFO:journalctl@ceph.mon.c.smithi149.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T17:13:52.843 INFO:journalctl@ceph.mon.c.smithi149.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T17:13:52.844 INFO:journalctl@ceph.mon.c.smithi149.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T17:13:52.844 INFO:journalctl@ceph.mon.c.smithi149.stdout: s = self.context.wrap_socket( 2024-09-13T17:13:52.844 INFO:journalctl@ceph.mon.c.smithi149.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T17:13:52.844 INFO:journalctl@ceph.mon.c.smithi149.stdout: return self.sslsocket_class._create( 2024-09-13T17:13:52.844 INFO:journalctl@ceph.mon.c.smithi149.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T17:13:52.844 INFO:journalctl@ceph.mon.c.smithi149.stdout: self.do_handshake() 2024-09-13T17:13:52.844 INFO:journalctl@ceph.mon.c.smithi149.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T17:13:52.844 INFO:journalctl@ceph.mon.c.smithi149.stdout: self._sslobj.do_handshake() 2024-09-13T17:13:52.844 INFO:journalctl@ceph.mon.c.smithi149.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T17:13:52.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:13:52.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1788785668' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:13:52.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:52.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:52.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/4170017959' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:13:52.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:52.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:52.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' cmd='[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]': finished 2024-09-13T17:13:52.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:52.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:52.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:52.846 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.846 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:52.846 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.846 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.846 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.846 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.846 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.846 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.846 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.846 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.846 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.846 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.847 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.847 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.847 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.847 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.847 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.847 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:13:52.847 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:13:52.847 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3710805455' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:13:52.847 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3260724879' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:13:52.847 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:52 smithi149 ceph-mon[35496]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-09-13T17:13:52.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: [13/Sep/2024:17:13:50] ENGINE Bus STARTING 2024-09-13T17:13:52.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: [13/Sep/2024:17:13:50] ENGINE Serving on http://172.21.15.87:8765 2024-09-13T17:13:52.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: [13/Sep/2024:17:13:51] ENGINE Serving on https://172.21.15.87:7150 2024-09-13T17:13:52.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: [13/Sep/2024:17:13:51] ENGINE Bus STARTED 2024-09-13T17:13:52.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: [13/Sep/2024:17:13:51] ENGINE Error in HTTPServer.serve 2024-09-13T17:13:52.863 INFO:journalctl@ceph.mon.b.smithi118.stdout: Traceback (most recent call last): 2024-09-13T17:13:52.864 INFO:journalctl@ceph.mon.b.smithi118.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T17:13:52.864 INFO:journalctl@ceph.mon.b.smithi118.stdout: self._connections.run(self.expiration_interval) 2024-09-13T17:13:52.864 INFO:journalctl@ceph.mon.b.smithi118.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T17:13:52.864 INFO:journalctl@ceph.mon.b.smithi118.stdout: self._run(expiration_interval) 2024-09-13T17:13:52.864 INFO:journalctl@ceph.mon.b.smithi118.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T17:13:52.864 INFO:journalctl@ceph.mon.b.smithi118.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T17:13:52.864 INFO:journalctl@ceph.mon.b.smithi118.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T17:13:52.864 INFO:journalctl@ceph.mon.b.smithi118.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T17:13:52.864 INFO:journalctl@ceph.mon.b.smithi118.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T17:13:52.864 INFO:journalctl@ceph.mon.b.smithi118.stdout: s = self.context.wrap_socket( 2024-09-13T17:13:52.864 INFO:journalctl@ceph.mon.b.smithi118.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T17:13:52.865 INFO:journalctl@ceph.mon.b.smithi118.stdout: return self.sslsocket_class._create( 2024-09-13T17:13:52.865 INFO:journalctl@ceph.mon.b.smithi118.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T17:13:52.865 INFO:journalctl@ceph.mon.b.smithi118.stdout: self.do_handshake() 2024-09-13T17:13:52.865 INFO:journalctl@ceph.mon.b.smithi118.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T17:13:52.865 INFO:journalctl@ceph.mon.b.smithi118.stdout: self._sslobj.do_handshake() 2024-09-13T17:13:52.865 INFO:journalctl@ceph.mon.b.smithi118.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T17:13:52.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:13:52.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1788785668' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:13:52.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:52.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:52.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/4170017959' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:13:52.866 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:52.866 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:52.866 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.866 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.866 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' cmd='[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]': finished 2024-09-13T17:13:52.866 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:52.866 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:52.866 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:52.866 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.866 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:52.866 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.866 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.867 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.867 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.867 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.867 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.867 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.867 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.867 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.867 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.867 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.867 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.867 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.867 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.868 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:13:52.868 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:13:52.868 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:13:52.868 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3710805455' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:13:52.868 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3260724879' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:13:52.868 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:52 smithi118 ceph-mon[34374]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-09-13T17:13:52.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.948+0000 7ff55733e640 1 -- 172.21.15.87:0/29561137 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff5501081e0 con 0x7ff5500febc0 2024-09-13T17:13:52.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.949+0000 7ff5467fc640 1 -- 172.21.15.87:0/29561137 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff540099200 con 0x7ff5500febc0 2024-09-13T17:13:52.950 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-09-13T17:13:52.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.951+0000 7ff55733e640 1 -- 172.21.15.87:0/29561137 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff53c0a1200 msgr2=0x7ff53c0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.951+0000 7ff55733e640 1 --2- 172.21.15.87:0/29561137 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff53c0a1200 0x7ff53c0a36c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff54c009f40 tx=0x7ff54c005f90 comp rx=0 tx=0).stop 2024-09-13T17:13:52.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.951+0000 7ff55733e640 1 -- 172.21.15.87:0/29561137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5500febc0 msgr2=0x7ff5501967d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:52.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.951+0000 7ff55733e640 1 --2- 172.21.15.87:0/29561137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5500febc0 0x7ff5501967d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff54000d950 tx=0x7ff54000de10 comp rx=0 tx=0).stop 2024-09-13T17:13:52.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.951+0000 7ff55733e640 1 -- 172.21.15.87:0/29561137 shutdown_connections 2024-09-13T17:13:52.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.951+0000 7ff55733e640 1 --2- 172.21.15.87:0/29561137 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff550104d00 0x7ff55019abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.951+0000 7ff55733e640 1 --2- 172.21.15.87:0/29561137 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff53c0a1200 0x7ff53c0a36c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.951+0000 7ff55733e640 1 --2- 172.21.15.87:0/29561137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5500febc0 0x7ff5501967d0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.951+0000 7ff55733e640 1 --2- 172.21.15.87:0/29561137 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5500fe220 0x7ff550196290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:52.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.951+0000 7ff55733e640 1 -- 172.21.15.87:0/29561137 >> 172.21.15.87:0/29561137 conn(0x7ff5500753f0 msgr2=0x7ff550102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:52.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.951+0000 7ff55733e640 1 -- 172.21.15.87:0/29561137 shutdown_connections 2024-09-13T17:13:52.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:52.951+0000 7ff55733e640 1 -- 172.21.15.87:0/29561137 wait complete. 2024-09-13T17:13:52.964 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:13:53.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.067+0000 7f5b08bff640 1 -- 172.21.15.87:0/4180179221 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b040fee60 msgr2=0x7f5b040ff240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.067+0000 7f5b08bff640 1 --2- 172.21.15.87:0/4180179221 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b040fee60 0x7f5b040ff240 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f5afc009930 tx=0x7f5afc02a420 comp rx=0 tx=0).stop 2024-09-13T17:13:53.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.067+0000 7f5b08bff640 1 -- 172.21.15.87:0/4180179221 shutdown_connections 2024-09-13T17:13:53.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.067+0000 7f5b08bff640 1 --2- 172.21.15.87:0/4180179221 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b04103fb0 0x7f5b0410bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.067+0000 7f5b08bff640 1 --2- 172.21.15.87:0/4180179221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b040ff810 0x7f5b04103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.067+0000 7f5b08bff640 1 --2- 172.21.15.87:0/4180179221 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b040fee60 0x7f5b040ff240 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.067+0000 7f5b08bff640 1 -- 172.21.15.87:0/4180179221 >> 172.21.15.87:0/4180179221 conn(0x7f5b04075c60 msgr2=0x7f5b040fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:53.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.067+0000 7f5b08bff640 1 -- 172.21.15.87:0/4180179221 shutdown_connections 2024-09-13T17:13:53.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.067+0000 7f5b08bff640 1 -- 172.21.15.87:0/4180179221 wait complete. 2024-09-13T17:13:53.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.067+0000 7f5b08bff640 1 Processor -- start 2024-09-13T17:13:53.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.068+0000 7f5b08bff640 1 -- start start 2024-09-13T17:13:53.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.068+0000 7f5b08bff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b040fee60 0x7f5b041962b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.068+0000 7f5b08bff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b04103fb0 0x7f5b041967f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.068+0000 7f5b08bff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b0419abe0 0x7f5b0419b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.068+0000 7f5b08bff640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0419b5d0 con 0x7f5b04103fb0 2024-09-13T17:13:53.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.068+0000 7f5b08bff640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0419b740 con 0x7f5b0419abe0 2024-09-13T17:13:53.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.068+0000 7f5b08bff640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0419b8b0 con 0x7f5b040fee60 2024-09-13T17:13:53.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.068+0000 7f5b01d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b04103fb0 0x7f5b041967f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.068+0000 7f5b01d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b04103fb0 0x7f5b041967f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41792/0 (socket says 172.21.15.87:41792) 2024-09-13T17:13:53.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.068+0000 7f5b01d9b640 1 -- 172.21.15.87:0/3876271254 learned_addr learned my addr 172.21.15.87:0/3876271254 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:53.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.068+0000 7f5b02d9d640 1 --2- 172.21.15.87:0/3876271254 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b0419abe0 0x7f5b0419b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.068+0000 7f5b0259c640 1 --2- 172.21.15.87:0/3876271254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b040fee60 0x7f5b041962b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.068+0000 7f5b01d9b640 1 -- 172.21.15.87:0/3876271254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b040fee60 msgr2=0x7f5b041962b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.068+0000 7f5b01d9b640 1 --2- 172.21.15.87:0/3876271254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b040fee60 0x7f5b041962b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.068+0000 7f5b01d9b640 1 -- 172.21.15.87:0/3876271254 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b0419abe0 msgr2=0x7f5b0419b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.068+0000 7f5b01d9b640 1 --2- 172.21.15.87:0/3876271254 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b0419abe0 0x7f5b0419b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.068+0000 7f5b01d9b640 1 -- 172.21.15.87:0/3876271254 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc009560 con 0x7f5b04103fb0 2024-09-13T17:13:53.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.068+0000 7f5b01d9b640 1 --2- 172.21.15.87:0/3876271254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b04103fb0 0x7f5b041967f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00e9f0 tx=0x7f5aec00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:53.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.069+0000 7f5afb7fe640 1 -- 172.21.15.87:0/3876271254 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec0096c0 con 0x7f5b04103fb0 2024-09-13T17:13:53.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.069+0000 7f5afb7fe640 1 -- 172.21.15.87:0/3876271254 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5aec0054d0 con 0x7f5b04103fb0 2024-09-13T17:13:53.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.069+0000 7f5b08bff640 1 -- 172.21.15.87:0/3876271254 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b041a2e90 con 0x7f5b04103fb0 2024-09-13T17:13:53.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.069+0000 7f5afb7fe640 1 -- 172.21.15.87:0/3876271254 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec010430 con 0x7f5b04103fb0 2024-09-13T17:13:53.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.069+0000 7f5b08bff640 1 -- 172.21.15.87:0/3876271254 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b041a32b0 con 0x7f5b04103fb0 2024-09-13T17:13:53.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.070+0000 7f5b08bff640 1 -- 172.21.15.87:0/3876271254 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b04100330 con 0x7f5b04103fb0 2024-09-13T17:13:53.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.072+0000 7f5afb7fe640 1 -- 172.21.15.87:0/3876271254 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 23) v1 ==== 135993+0+0 (secure 0 0 0) 0x7f5aec005000 con 0x7f5b04103fb0 2024-09-13T17:13:53.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.072+0000 7f5afb7fe640 1 --2- 172.21.15.87:0/3876271254 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5af00a1200 0x7f5af00a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.072+0000 7f5afb7fe640 1 -- 172.21.15.87:0/3876271254 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f5aec014070 con 0x7f5b04103fb0 2024-09-13T17:13:53.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.072+0000 7f5b0259c640 1 --2- 172.21.15.87:0/3876271254 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5af00a1200 0x7f5af00a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.073+0000 7f5b0259c640 1 --2- 172.21.15.87:0/3876271254 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5af00a1200 0x7f5af00a36c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5afc005ab0 tx=0x7f5afc005a20 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:53.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.078+0000 7f5afb7fe640 1 -- 172.21.15.87:0/3876271254 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5aec096470 con 0x7f5b04103fb0 2024-09-13T17:13:53.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.248+0000 7f5b08bff640 1 -- 172.21.15.87:0/3876271254 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5b04107190 con 0x7f5b04103fb0 2024-09-13T17:13:53.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.248+0000 7f5afb7fe640 1 -- 172.21.15.87:0/3876271254 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5aec099a90 con 0x7f5b04103fb0 2024-09-13T17:13:53.249 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-09-13T17:13:53.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.250+0000 7f5b08bff640 1 -- 172.21.15.87:0/3876271254 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5af00a1200 msgr2=0x7f5af00a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.250+0000 7f5b08bff640 1 --2- 172.21.15.87:0/3876271254 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5af00a1200 0x7f5af00a36c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5afc005ab0 tx=0x7f5afc005a20 comp rx=0 tx=0).stop 2024-09-13T17:13:53.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.250+0000 7f5b08bff640 1 -- 172.21.15.87:0/3876271254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b04103fb0 msgr2=0x7f5b041967f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.250+0000 7f5b08bff640 1 --2- 172.21.15.87:0/3876271254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b04103fb0 0x7f5b041967f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00e9f0 tx=0x7f5aec00eeb0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.250+0000 7f5b08bff640 1 -- 172.21.15.87:0/3876271254 shutdown_connections 2024-09-13T17:13:53.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.250+0000 7f5b08bff640 1 --2- 172.21.15.87:0/3876271254 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b0419abe0 0x7f5b0419b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.250+0000 7f5b08bff640 1 --2- 172.21.15.87:0/3876271254 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5af00a1200 0x7f5af00a36c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.250+0000 7f5b08bff640 1 --2- 172.21.15.87:0/3876271254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b04103fb0 0x7f5b041967f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.250+0000 7f5b08bff640 1 --2- 172.21.15.87:0/3876271254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b040fee60 0x7f5b041962b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.250+0000 7f5b08bff640 1 -- 172.21.15.87:0/3876271254 >> 172.21.15.87:0/3876271254 conn(0x7f5b04075c60 msgr2=0x7f5b04102300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:53.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.250+0000 7f5b08bff640 1 -- 172.21.15.87:0/3876271254 shutdown_connections 2024-09-13T17:13:53.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.250+0000 7f5b08bff640 1 -- 172.21.15.87:0/3876271254 wait complete. 2024-09-13T17:13:53.262 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:13:53.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.362+0000 7f6c88861640 1 -- 172.21.15.87:0/359797574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c840ff800 msgr2=0x7f6c84103840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.362+0000 7f6c88861640 1 --2- 172.21.15.87:0/359797574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c840ff800 0x7f6c84103840 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f6c74009930 tx=0x7f6c7402a420 comp rx=0 tx=0).stop 2024-09-13T17:13:53.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.362+0000 7f6c88861640 1 -- 172.21.15.87:0/359797574 shutdown_connections 2024-09-13T17:13:53.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.362+0000 7f6c88861640 1 --2- 172.21.15.87:0/359797574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c84103fa0 0x7f6c8410baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.362+0000 7f6c88861640 1 --2- 172.21.15.87:0/359797574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c840ff800 0x7f6c84103840 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.362+0000 7f6c88861640 1 --2- 172.21.15.87:0/359797574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c840fee50 0x7f6c840ff230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.362+0000 7f6c88861640 1 -- 172.21.15.87:0/359797574 >> 172.21.15.87:0/359797574 conn(0x7f6c840fa8c0 msgr2=0x7f6c840fcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:53.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.362+0000 7f6c88861640 1 -- 172.21.15.87:0/359797574 shutdown_connections 2024-09-13T17:13:53.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.362+0000 7f6c88861640 1 -- 172.21.15.87:0/359797574 wait complete. 2024-09-13T17:13:53.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.363+0000 7f6c88861640 1 Processor -- start 2024-09-13T17:13:53.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.363+0000 7f6c88861640 1 -- start start 2024-09-13T17:13:53.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.363+0000 7f6c88861640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c840fee50 0x7f6c841964a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.363+0000 7f6c88861640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c84103fa0 0x7f6c841969e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.363+0000 7f6c88861640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c8419ad80 0x7f6c8419b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.363+0000 7f6c88861640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8419b770 con 0x7f6c8419ad80 2024-09-13T17:13:53.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.363+0000 7f6c88861640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8419b8e0 con 0x7f6c84103fa0 2024-09-13T17:13:53.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.363+0000 7f6c88861640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8419ba50 con 0x7f6c840fee50 2024-09-13T17:13:53.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.363+0000 7f6c82d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c8419ad80 0x7f6c8419b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.363+0000 7f6c82d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c8419ad80 0x7f6c8419b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41812/0 (socket says 172.21.15.87:41812) 2024-09-13T17:13:53.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.363+0000 7f6c82d9d640 1 -- 172.21.15.87:0/153880072 learned_addr learned my addr 172.21.15.87:0/153880072 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:53.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.364+0000 7f6c8259c640 1 --2- 172.21.15.87:0/153880072 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c840fee50 0x7f6c841964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.364+0000 7f6c81d9b640 1 --2- 172.21.15.87:0/153880072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c84103fa0 0x7f6c841969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.364+0000 7f6c82d9d640 1 -- 172.21.15.87:0/153880072 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c840fee50 msgr2=0x7f6c841964a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.364+0000 7f6c82d9d640 1 --2- 172.21.15.87:0/153880072 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c840fee50 0x7f6c841964a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.364+0000 7f6c82d9d640 1 -- 172.21.15.87:0/153880072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c84103fa0 msgr2=0x7f6c841969e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.364+0000 7f6c82d9d640 1 --2- 172.21.15.87:0/153880072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c84103fa0 0x7f6c841969e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.364+0000 7f6c82d9d640 1 -- 172.21.15.87:0/153880072 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c74009560 con 0x7f6c8419ad80 2024-09-13T17:13:53.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.364+0000 7f6c81d9b640 1 --2- 172.21.15.87:0/153880072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c84103fa0 0x7f6c841969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:53.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.364+0000 7f6c82d9d640 1 --2- 172.21.15.87:0/153880072 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c8419ad80 0x7f6c8419b230 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00b970 tx=0x7f6c7c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:53.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.364+0000 7f6c737fe640 1 -- 172.21.15.87:0/153880072 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c00cb40 con 0x7f6c8419ad80 2024-09-13T17:13:53.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.364+0000 7f6c737fe640 1 -- 172.21.15.87:0/153880072 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6c7c00cca0 con 0x7f6c8419ad80 2024-09-13T17:13:53.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.364+0000 7f6c737fe640 1 -- 172.21.15.87:0/153880072 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c0076e0 con 0x7f6c8419ad80 2024-09-13T17:13:53.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.364+0000 7f6c88861640 1 -- 172.21.15.87:0/153880072 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c841a3030 con 0x7f6c8419ad80 2024-09-13T17:13:53.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.364+0000 7f6c88861640 1 -- 172.21.15.87:0/153880072 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c841a3490 con 0x7f6c8419ad80 2024-09-13T17:13:53.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.365+0000 7f6c88861640 1 -- 172.21.15.87:0/153880072 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c84100320 con 0x7f6c8419ad80 2024-09-13T17:13:53.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.366+0000 7f6c737fe640 1 -- 172.21.15.87:0/153880072 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 23) v1 ==== 135993+0+0 (secure 0 0 0) 0x7f6c7c014440 con 0x7f6c8419ad80 2024-09-13T17:13:53.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.367+0000 7f6c737fe640 1 --2- 172.21.15.87:0/153880072 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f6c6c0a1280 0x7f6c6c0a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.367+0000 7f6c8259c640 1 --2- 172.21.15.87:0/153880072 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f6c6c0a1280 0x7f6c6c0a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.367+0000 7f6c737fe640 1 -- 172.21.15.87:0/153880072 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f6c7c0cc870 con 0x7f6c8419ad80 2024-09-13T17:13:53.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.367+0000 7f6c8259c640 1 --2- 172.21.15.87:0/153880072 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f6c6c0a1280 0x7f6c6c0a3740 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6c78005fd0 tx=0x7f6c78005850 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:53.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.371+0000 7f6c737fe640 1 -- 172.21.15.87:0/153880072 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6c7c095a20 con 0x7f6c8419ad80 2024-09-13T17:13:53.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.538+0000 7f6c88861640 1 -- 172.21.15.87:0/153880072 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6c841977a0 con 0x7f6c8419ad80 2024-09-13T17:13:53.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.538+0000 7f6c737fe640 1 -- 172.21.15.87:0/153880072 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6c7c099040 con 0x7f6c8419ad80 2024-09-13T17:13:53.541 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-09-13T17:13:53.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.540+0000 7f6c88861640 1 -- 172.21.15.87:0/153880072 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f6c6c0a1280 msgr2=0x7f6c6c0a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.540+0000 7f6c88861640 1 --2- 172.21.15.87:0/153880072 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f6c6c0a1280 0x7f6c6c0a3740 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6c78005fd0 tx=0x7f6c78005850 comp rx=0 tx=0).stop 2024-09-13T17:13:53.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.540+0000 7f6c88861640 1 -- 172.21.15.87:0/153880072 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c8419ad80 msgr2=0x7f6c8419b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.540+0000 7f6c88861640 1 --2- 172.21.15.87:0/153880072 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c8419ad80 0x7f6c8419b230 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00b970 tx=0x7f6c7c00be30 comp rx=0 tx=0).stop 2024-09-13T17:13:53.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.540+0000 7f6c88861640 1 -- 172.21.15.87:0/153880072 shutdown_connections 2024-09-13T17:13:53.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.540+0000 7f6c88861640 1 --2- 172.21.15.87:0/153880072 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f6c6c0a1280 0x7f6c6c0a3740 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.540+0000 7f6c88861640 1 --2- 172.21.15.87:0/153880072 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c8419ad80 0x7f6c8419b230 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.540+0000 7f6c88861640 1 --2- 172.21.15.87:0/153880072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c84103fa0 0x7f6c841969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.540+0000 7f6c88861640 1 --2- 172.21.15.87:0/153880072 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c840fee50 0x7f6c841964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.540+0000 7f6c88861640 1 -- 172.21.15.87:0/153880072 >> 172.21.15.87:0/153880072 conn(0x7f6c840fa8c0 msgr2=0x7f6c840fbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:53.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.540+0000 7f6c88861640 1 -- 172.21.15.87:0/153880072 shutdown_connections 2024-09-13T17:13:53.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.540+0000 7f6c88861640 1 -- 172.21.15.87:0/153880072 wait complete. 2024-09-13T17:13:53.551 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:53 smithi087 ceph-mon[30934]: Adjusting osd_memory_target on smithi118 to 176.0M 2024-09-13T17:13:53.551 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:53 smithi087 ceph-mon[30934]: Unable to set osd_memory_target on smithi118 to 184556646: error parsing value: Value '184556646' is below minimum 939524096 2024-09-13T17:13:53.552 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:53 smithi087 ceph-mon[30934]: Adjusting osd_memory_target on smithi087 to 176.0M 2024-09-13T17:13:53.552 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:53 smithi087 ceph-mon[30934]: Unable to set osd_memory_target on smithi087 to 184555929: error parsing value: Value '184555929' is below minimum 939524096 2024-09-13T17:13:53.552 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:53 smithi087 ceph-mon[30934]: Updating smithi087:/etc/ceph/ceph.conf 2024-09-13T17:13:53.552 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:53 smithi087 ceph-mon[30934]: Updating smithi118:/etc/ceph/ceph.conf 2024-09-13T17:13:53.552 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:53 smithi087 ceph-mon[30934]: Updating smithi149:/etc/ceph/ceph.conf 2024-09-13T17:13:53.553 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:53 smithi087 ceph-mon[30934]: Updating smithi087:/var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:13:53.553 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:53 smithi087 ceph-mon[30934]: Updating smithi118:/var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:13:53.553 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:53 smithi087 ceph-mon[30934]: Updating smithi149:/var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:13:53.553 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:53 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/664232091' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:13:53.553 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:53 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:53.553 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:53 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:53.554 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:53 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/29561137' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:13:53.554 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:53 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:53.554 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:53 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:53.554 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:53 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:53.554 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:53 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:53.554 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:53 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:53.555 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:53 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:13:53.555 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:53 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:13:53.555 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:53 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:13:53.555 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:53 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:53.555 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:53 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3876271254' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:13:53.557 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-13T17:13:53.557 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:13:53.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.655+0000 7fd2a36de640 1 -- 172.21.15.87:0/2510684112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd29c0ff830 msgr2=0x7fd29c103870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.655+0000 7fd2a36de640 1 --2- 172.21.15.87:0/2510684112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd29c0ff830 0x7fd29c103870 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd28c009930 tx=0x7fd28c02a420 comp rx=0 tx=0).stop 2024-09-13T17:13:53.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.655+0000 7fd2a36de640 1 -- 172.21.15.87:0/2510684112 shutdown_connections 2024-09-13T17:13:53.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.655+0000 7fd2a36de640 1 --2- 172.21.15.87:0/2510684112 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd29c103fd0 0x7fd29c10bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.655+0000 7fd2a36de640 1 --2- 172.21.15.87:0/2510684112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd29c0ff830 0x7fd29c103870 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.655+0000 7fd2a36de640 1 --2- 172.21.15.87:0/2510684112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd29c0fee80 0x7fd29c0ff260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.655+0000 7fd2a36de640 1 -- 172.21.15.87:0/2510684112 >> 172.21.15.87:0/2510684112 conn(0x7fd29c075c60 msgr2=0x7fd29c0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:53.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.655+0000 7fd2a36de640 1 -- 172.21.15.87:0/2510684112 shutdown_connections 2024-09-13T17:13:53.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.655+0000 7fd2a36de640 1 -- 172.21.15.87:0/2510684112 wait complete. 2024-09-13T17:13:53.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.656+0000 7fd2a36de640 1 Processor -- start 2024-09-13T17:13:53.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.656+0000 7fd2a36de640 1 -- start start 2024-09-13T17:13:53.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.656+0000 7fd2a36de640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd29c0fee80 0x7fd29c1970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.656+0000 7fd2a36de640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd29c103fd0 0x7fd29c1975f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.656+0000 7fd2a36de640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd29c197b30 0x7fd29c1a2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.656+0000 7fd2a36de640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c1a27d0 con 0x7fd29c0fee80 2024-09-13T17:13:53.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.656+0000 7fd2a36de640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c1a2940 con 0x7fd29c197b30 2024-09-13T17:13:53.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.656+0000 7fd2a36de640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c1a2b00 con 0x7fd29c103fd0 2024-09-13T17:13:53.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.656+0000 7fd2a147a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd29c0fee80 0x7fd29c1970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.656+0000 7fd2a147a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd29c0fee80 0x7fd29c1970b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41832/0 (socket says 172.21.15.87:41832) 2024-09-13T17:13:53.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.656+0000 7fd2a147a640 1 -- 172.21.15.87:0/2385628682 learned_addr learned my addr 172.21.15.87:0/2385628682 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:53.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.656+0000 7fd2a0c79640 1 --2- 172.21.15.87:0/2385628682 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd29c103fd0 0x7fd29c1975f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.656+0000 7fd2a1c7b640 1 --2- 172.21.15.87:0/2385628682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd29c197b30 0x7fd29c1a2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.656+0000 7fd2a147a640 1 -- 172.21.15.87:0/2385628682 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd29c103fd0 msgr2=0x7fd29c1975f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.656+0000 7fd2a147a640 1 --2- 172.21.15.87:0/2385628682 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd29c103fd0 0x7fd29c1975f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.656+0000 7fd2a147a640 1 -- 172.21.15.87:0/2385628682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd29c197b30 msgr2=0x7fd29c1a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.656+0000 7fd2a147a640 1 --2- 172.21.15.87:0/2385628682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd29c197b30 0x7fd29c1a2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.656+0000 7fd2a147a640 1 -- 172.21.15.87:0/2385628682 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd28c009560 con 0x7fd29c0fee80 2024-09-13T17:13:53.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.656+0000 7fd2a1c7b640 1 --2- 172.21.15.87:0/2385628682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd29c197b30 0x7fd29c1a2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:53.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.657+0000 7fd2a147a640 1 --2- 172.21.15.87:0/2385628682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd29c0fee80 0x7fd29c1970b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd29800c920 tx=0x7fd29800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:53.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.657+0000 7fd2927fc640 1 -- 172.21.15.87:0/2385628682 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd298007c70 con 0x7fd29c0fee80 2024-09-13T17:13:53.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.657+0000 7fd2927fc640 1 -- 172.21.15.87:0/2385628682 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd298007dd0 con 0x7fd29c0fee80 2024-09-13T17:13:53.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.657+0000 7fd2927fc640 1 -- 172.21.15.87:0/2385628682 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2980187c0 con 0x7fd29c0fee80 2024-09-13T17:13:53.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.657+0000 7fd2a36de640 1 -- 172.21.15.87:0/2385628682 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd29c1a2de0 con 0x7fd29c0fee80 2024-09-13T17:13:53.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.657+0000 7fd2a36de640 1 -- 172.21.15.87:0/2385628682 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd29c1a3210 con 0x7fd29c0fee80 2024-09-13T17:13:53.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.658+0000 7fd2a36de640 1 -- 172.21.15.87:0/2385628682 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd29c100350 con 0x7fd29c0fee80 2024-09-13T17:13:53.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.659+0000 7fd2927fc640 1 -- 172.21.15.87:0/2385628682 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 23) v1 ==== 135993+0+0 (secure 0 0 0) 0x7fd29800f450 con 0x7fd29c0fee80 2024-09-13T17:13:53.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.660+0000 7fd2927fc640 1 --2- 172.21.15.87:0/2385628682 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd2880a1200 0x7fd2880a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.660+0000 7fd2a0c79640 1 --2- 172.21.15.87:0/2385628682 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd2880a1200 0x7fd2880a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.660+0000 7fd2927fc640 1 -- 172.21.15.87:0/2385628682 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fd2980cd1d0 con 0x7fd29c0fee80 2024-09-13T17:13:53.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.660+0000 7fd2a0c79640 1 --2- 172.21.15.87:0/2385628682 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd2880a1200 0x7fd2880a36c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd28c009900 tx=0x7fd28c005a20 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:53.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.664+0000 7fd2927fc640 1 -- 172.21.15.87:0/2385628682 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd298096270 con 0x7fd29c0fee80 2024-09-13T17:13:53.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:53 smithi149 ceph-mon[35496]: Adjusting osd_memory_target on smithi118 to 176.0M 2024-09-13T17:13:53.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:53 smithi149 ceph-mon[35496]: Unable to set osd_memory_target on smithi118 to 184556646: error parsing value: Value '184556646' is below minimum 939524096 2024-09-13T17:13:53.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:53 smithi149 ceph-mon[35496]: Adjusting osd_memory_target on smithi087 to 176.0M 2024-09-13T17:13:53.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:53 smithi149 ceph-mon[35496]: Unable to set osd_memory_target on smithi087 to 184555929: error parsing value: Value '184555929' is below minimum 939524096 2024-09-13T17:13:53.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:53 smithi149 ceph-mon[35496]: Updating smithi087:/etc/ceph/ceph.conf 2024-09-13T17:13:53.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:53 smithi149 ceph-mon[35496]: Updating smithi118:/etc/ceph/ceph.conf 2024-09-13T17:13:53.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:53 smithi149 ceph-mon[35496]: Updating smithi149:/etc/ceph/ceph.conf 2024-09-13T17:13:53.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:53 smithi149 ceph-mon[35496]: Updating smithi087:/var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:13:53.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:53 smithi149 ceph-mon[35496]: Updating smithi118:/var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:13:53.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:53 smithi149 ceph-mon[35496]: Updating smithi149:/var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:13:53.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:53 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/664232091' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:13:53.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:53 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:53.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:53 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:53.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:53 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/29561137' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:13:53.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:53 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:53.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:53 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:53.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:53 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:53.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:53 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:53.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:53 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:53.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:53 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:13:53.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:53 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:13:53.846 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:53 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:13:53.846 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:53 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:53.846 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:53 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3876271254' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:13:53.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.860+0000 7fd2a36de640 1 -- 172.21.15.87:0/2385628682 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd29c0ff260 con 0x7fd29c0fee80 2024-09-13T17:13:53.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.861+0000 7fd2927fc640 1 -- 172.21.15.87:0/2385628682 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10877 (secure 0 0 0) 0x7fd298099890 con 0x7fd29c0fee80 2024-09-13T17:13:53.862 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:13:53.862 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/3674545180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":3674545180},{"type":"v1","addr":"172.21.15.87:6841","nonce":3674545180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:11:23.313609+0000","modified":"2024-09-13T17:13:50.380502+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24484,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6839/3052680456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3052680456},{"type":"v1","addr":"172.21.15.118:6839","nonce":3052680456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:13:53.862 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 24 2024-09-13T17:13:53.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:53 smithi118 ceph-mon[34374]: Adjusting osd_memory_target on smithi118 to 176.0M 2024-09-13T17:13:53.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:53 smithi118 ceph-mon[34374]: Unable to set osd_memory_target on smithi118 to 184556646: error parsing value: Value '184556646' is below minimum 939524096 2024-09-13T17:13:53.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:53 smithi118 ceph-mon[34374]: Adjusting osd_memory_target on smithi087 to 176.0M 2024-09-13T17:13:53.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:53 smithi118 ceph-mon[34374]: Unable to set osd_memory_target on smithi087 to 184555929: error parsing value: Value '184555929' is below minimum 939524096 2024-09-13T17:13:53.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:53 smithi118 ceph-mon[34374]: Updating smithi087:/etc/ceph/ceph.conf 2024-09-13T17:13:53.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:53 smithi118 ceph-mon[34374]: Updating smithi118:/etc/ceph/ceph.conf 2024-09-13T17:13:53.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:53 smithi118 ceph-mon[34374]: Updating smithi149:/etc/ceph/ceph.conf 2024-09-13T17:13:53.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:53 smithi118 ceph-mon[34374]: Updating smithi087:/var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:13:53.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:53 smithi118 ceph-mon[34374]: Updating smithi118:/var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:13:53.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:53 smithi118 ceph-mon[34374]: Updating smithi149:/var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:13:53.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:53 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/664232091' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:13:53.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:53 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:53.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:53 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:53.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:53 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/29561137' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:13:53.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:53 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:53.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:53 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:53.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:53 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:53.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:53 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:53.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:53 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:53.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:53 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:13:53.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:53 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:13:53.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:53 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:13:53.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:53 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:53.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:53 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3876271254' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:13:53.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.863+0000 7fd2a36de640 1 -- 172.21.15.87:0/2385628682 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd2880a1200 msgr2=0x7fd2880a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.863+0000 7fd2a36de640 1 --2- 172.21.15.87:0/2385628682 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd2880a1200 0x7fd2880a36c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd28c009900 tx=0x7fd28c005a20 comp rx=0 tx=0).stop 2024-09-13T17:13:53.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.863+0000 7fd2a36de640 1 -- 172.21.15.87:0/2385628682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd29c0fee80 msgr2=0x7fd29c1970b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.863+0000 7fd2a36de640 1 --2- 172.21.15.87:0/2385628682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd29c0fee80 0x7fd29c1970b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd29800c920 tx=0x7fd29800cde0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.863+0000 7fd2a36de640 1 -- 172.21.15.87:0/2385628682 shutdown_connections 2024-09-13T17:13:53.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.863+0000 7fd2a36de640 1 --2- 172.21.15.87:0/2385628682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd29c197b30 0x7fd29c1a2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.863+0000 7fd2a36de640 1 --2- 172.21.15.87:0/2385628682 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd29c103fd0 0x7fd29c1975f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.863+0000 7fd2a36de640 1 --2- 172.21.15.87:0/2385628682 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd2880a1200 0x7fd2880a36c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.863+0000 7fd2a36de640 1 --2- 172.21.15.87:0/2385628682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd29c0fee80 0x7fd29c1970b0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.863+0000 7fd2a36de640 1 -- 172.21.15.87:0/2385628682 >> 172.21.15.87:0/2385628682 conn(0x7fd29c075c60 msgr2=0x7fd29c0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:53.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.863+0000 7fd2a36de640 1 -- 172.21.15.87:0/2385628682 shutdown_connections 2024-09-13T17:13:53.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.863+0000 7fd2a36de640 1 -- 172.21.15.87:0/2385628682 wait complete. 2024-09-13T17:13:53.875 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-13T17:13:53.875 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-13T17:13:53.875 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:13:53.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.973+0000 7f953d51f640 1 -- 172.21.15.87:0/2469957104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95381005b0 msgr2=0x7f9538104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.973+0000 7f953d51f640 1 --2- 172.21.15.87:0/2469957104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95381005b0 0x7f9538104a50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9528009930 tx=0x7f952802a420 comp rx=0 tx=0).stop 2024-09-13T17:13:53.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.973+0000 7f953d51f640 1 -- 172.21.15.87:0/2469957104 shutdown_connections 2024-09-13T17:13:53.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.973+0000 7f953d51f640 1 --2- 172.21.15.87:0/2469957104 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95381051b0 0x7f953810bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.973+0000 7f953d51f640 1 --2- 172.21.15.87:0/2469957104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95381005b0 0x7f9538104a50 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.973+0000 7f953d51f640 1 --2- 172.21.15.87:0/2469957104 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95380ffc00 0x7f95380fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.973+0000 7f953d51f640 1 -- 172.21.15.87:0/2469957104 >> 172.21.15.87:0/2469957104 conn(0x7f95380741b0 msgr2=0x7f95380745c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:53.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.973+0000 7f953d51f640 1 -- 172.21.15.87:0/2469957104 shutdown_connections 2024-09-13T17:13:53.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.973+0000 7f953d51f640 1 -- 172.21.15.87:0/2469957104 wait complete. 2024-09-13T17:13:53.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.973+0000 7f953d51f640 1 Processor -- start 2024-09-13T17:13:53.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.974+0000 7f953d51f640 1 -- start start 2024-09-13T17:13:53.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.974+0000 7f953d51f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95380ffc00 0x7f9538196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.974+0000 7f953d51f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95381051b0 0x7f95381968b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.974+0000 7f953d51f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f953819ac50 0x7f953819b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.974+0000 7f953d51f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953819b640 con 0x7f953819ac50 2024-09-13T17:13:53.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.974+0000 7f953d51f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953819b7b0 con 0x7f95381051b0 2024-09-13T17:13:53.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.974+0000 7f953d51f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953819b920 con 0x7f95380ffc00 2024-09-13T17:13:53.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.974+0000 7f95377fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f953819ac50 0x7f953819b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.974+0000 7f95377fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f953819ac50 0x7f953819b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41860/0 (socket says 172.21.15.87:41860) 2024-09-13T17:13:53.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.974+0000 7f95377fe640 1 -- 172.21.15.87:0/1760459798 learned_addr learned my addr 172.21.15.87:0/1760459798 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:53.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.974+0000 7f95367fc640 1 --2- 172.21.15.87:0/1760459798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95381051b0 0x7f95381968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.974+0000 7f9536ffd640 1 --2- 172.21.15.87:0/1760459798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95380ffc00 0x7f9538196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.974+0000 7f95377fe640 1 -- 172.21.15.87:0/1760459798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95380ffc00 msgr2=0x7f9538196370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.974+0000 7f95377fe640 1 --2- 172.21.15.87:0/1760459798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95380ffc00 0x7f9538196370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.974+0000 7f95377fe640 1 -- 172.21.15.87:0/1760459798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95381051b0 msgr2=0x7f95381968b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:53.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.974+0000 7f95377fe640 1 --2- 172.21.15.87:0/1760459798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95381051b0 0x7f95381968b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:53.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.974+0000 7f95377fe640 1 -- 172.21.15.87:0/1760459798 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9528009560 con 0x7f953819ac50 2024-09-13T17:13:53.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.974+0000 7f95377fe640 1 --2- 172.21.15.87:0/1760459798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f953819ac50 0x7f953819b100 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f953000eb10 tx=0x7f953000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:53.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.975+0000 7f952ffff640 1 -- 172.21.15.87:0/1760459798 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9530004b20 con 0x7f953819ac50 2024-09-13T17:13:53.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.975+0000 7f952ffff640 1 -- 172.21.15.87:0/1760459798 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9530004c80 con 0x7f953819ac50 2024-09-13T17:13:53.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.975+0000 7f953d51f640 1 -- 172.21.15.87:0/1760459798 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95381a2f00 con 0x7f953819ac50 2024-09-13T17:13:53.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.975+0000 7f952ffff640 1 -- 172.21.15.87:0/1760459798 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9530010690 con 0x7f953819ac50 2024-09-13T17:13:53.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.975+0000 7f953d51f640 1 -- 172.21.15.87:0/1760459798 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95381a32d0 con 0x7f953819ac50 2024-09-13T17:13:53.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.976+0000 7f953d51f640 1 -- 172.21.15.87:0/1760459798 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9538068060 con 0x7f953819ac50 2024-09-13T17:13:53.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.977+0000 7f952ffff640 1 -- 172.21.15.87:0/1760459798 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 23) v1 ==== 135993+0+0 (secure 0 0 0) 0x7f9530005020 con 0x7f953819ac50 2024-09-13T17:13:53.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.978+0000 7f952ffff640 1 --2- 172.21.15.87:0/1760459798 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f95240a1200 0x7f95240a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:53.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.978+0000 7f9536ffd640 1 --2- 172.21.15.87:0/1760459798 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f95240a1200 0x7f95240a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:53.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.978+0000 7f952ffff640 1 -- 172.21.15.87:0/1760459798 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f9530014070 con 0x7f953819ac50 2024-09-13T17:13:53.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.978+0000 7f9536ffd640 1 --2- 172.21.15.87:0/1760459798 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f95240a1200 0x7f95240a36c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9520005fd0 tx=0x7f952000b390 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:53.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:53.982+0000 7f952ffff640 1 -- 172.21.15.87:0/1760459798 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9530096680 con 0x7f953819ac50 2024-09-13T17:13:54.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.097+0000 7f952ffff640 1 -- 172.21.15.87:0/1760459798 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mgrmap(e 24) v1 ==== 136049+0+0 (secure 0 0 0) 0x7f95300cac00 con 0x7f953819ac50 2024-09-13T17:13:54.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.148+0000 7f953d51f640 1 -- 172.21.15.87:0/1760459798 --> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9538197760 con 0x7f95240a1200 2024-09-13T17:13:54.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.159+0000 7f952ffff640 1 -- 172.21.15.87:0/1760459798 <== mgr.15507 v2:172.21.15.87:6800/157129242 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+427670 (secure 0 0 0) 0x7f9538197760 con 0x7f95240a1200 2024-09-13T17:13:54.165 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:13:54.168 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-13T17:13:54.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.163+0000 7f953d51f640 1 -- 172.21.15.87:0/1760459798 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f95240a1200 msgr2=0x7f95240a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:54.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.163+0000 7f953d51f640 1 --2- 172.21.15.87:0/1760459798 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f95240a1200 0x7f95240a36c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9520005fd0 tx=0x7f952000b390 comp rx=0 tx=0).stop 2024-09-13T17:13:54.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.163+0000 7f953d51f640 1 -- 172.21.15.87:0/1760459798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f953819ac50 msgr2=0x7f953819b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:54.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.163+0000 7f953d51f640 1 --2- 172.21.15.87:0/1760459798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f953819ac50 0x7f953819b100 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f953000eb10 tx=0x7f953000c2d0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.163+0000 7f953d51f640 1 -- 172.21.15.87:0/1760459798 shutdown_connections 2024-09-13T17:13:54.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.163+0000 7f953d51f640 1 --2- 172.21.15.87:0/1760459798 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f95240a1200 0x7f95240a36c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.163+0000 7f953d51f640 1 --2- 172.21.15.87:0/1760459798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f953819ac50 0x7f953819b100 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.163+0000 7f953d51f640 1 --2- 172.21.15.87:0/1760459798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95381051b0 0x7f95381968b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.163+0000 7f953d51f640 1 --2- 172.21.15.87:0/1760459798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95380ffc00 0x7f9538196370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.163+0000 7f953d51f640 1 -- 172.21.15.87:0/1760459798 >> 172.21.15.87:0/1760459798 conn(0x7f95380741b0 msgr2=0x7f95380fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:54.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.163+0000 7f953d51f640 1 -- 172.21.15.87:0/1760459798 shutdown_connections 2024-09-13T17:13:54.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.163+0000 7f953d51f640 1 -- 172.21.15.87:0/1760459798 wait complete. 2024-09-13T17:13:54.174 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-13T17:13:53.397361+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1190149,"num_objects":66,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1000,"num_read_kb":663,"num_write":472,"num_write_kb":4384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1181900,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":869,"ondisk_log_size":869,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":377892,"kb_used_data":12704,"kb_used_omap":18,"kb_used_meta":365037,"kb_avail":1124563932,"statfs":{"total":1151940427776,"available":1151553466368,"internally_reserved":0,"allocated":13008896,"data_stored":9881725,"data_compressed":501701,"data_compressed_allocated":671744,"data_compressed_original":4194304,"omap_allocated":19109,"internal_metadata":373798235},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.986729"},"pg_stats":[{"pgid":"2.1f","version":"89'9","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:27.569619+0000","last_change":"2024-09-13T17:12:50.228849+0000","last_active":"2024-09-13T17:13:27.569619+0000","last_peered":"2024-09-13T17:13:27.569619+0000","last_clean":"2024-09-13T17:13:27.569619+0000","last_became_active":"2024-09-13T17:12:50.221697+0000","last_became_peered":"2024-09-13T17:12:50.221697+0000","last_unstale":"2024-09-13T17:13:27.569619+0000","last_undegraded":"2024-09-13T17:13:27.569619+0000","last_fullsized":"2024-09-13T17:13:27.569619+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:45.356785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"93'5","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:25.608822+0000","last_change":"2024-09-13T17:11:23.340108+0000","last_active":"2024-09-13T17:13:25.608822+0000","last_peered":"2024-09-13T17:13:25.608822+0000","last_clean":"2024-09-13T17:13:25.608822+0000","last_became_active":"2024-09-13T17:11:23.339832+0000","last_became_peered":"2024-09-13T17:11:23.339832+0000","last_unstale":"2024-09-13T17:13:25.608822+0000","last_undegraded":"2024-09-13T17:13:25.608822+0000","last_fullsized":"2024-09-13T17:13:25.608822+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:40.969448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.761732+0000","last_change":"2024-09-13T17:12:50.761228+0000","last_active":"2024-09-13T17:12:50.761732+0000","last_peered":"2024-09-13T17:12:50.761732+0000","last_clean":"2024-09-13T17:12:50.761732+0000","last_became_active":"2024-09-13T17:12:50.760842+0000","last_became_peered":"2024-09-13T17:12:50.760842+0000","last_unstale":"2024-09-13T17:12:50.761732+0000","last_undegraded":"2024-09-13T17:12:50.761732+0000","last_fullsized":"2024-09-13T17:12:50.761732+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:30.513246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,10,0],"acting":[2,3,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:25.608843+0000","last_change":"2024-09-13T17:11:23.000779+0000","last_active":"2024-09-13T17:13:25.608843+0000","last_peered":"2024-09-13T17:13:25.608843+0000","last_clean":"2024-09-13T17:13:25.608843+0000","last_became_active":"2024-09-13T17:11:23.000511+0000","last_became_peered":"2024-09-13T17:11:23.000511+0000","last_unstale":"2024-09-13T17:13:25.608843+0000","last_undegraded":"2024-09-13T17:13:25.608843+0000","last_fullsized":"2024-09-13T17:13:25.608843+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:09.802392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"93'6","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:29.121714+0000","last_change":"2024-09-13T17:11:23.333948+0000","last_active":"2024-09-13T17:13:29.121714+0000","last_peered":"2024-09-13T17:13:29.121714+0000","last_clean":"2024-09-13T17:13:29.121714+0000","last_became_active":"2024-09-13T17:11:23.333679+0000","last_became_peered":"2024-09-13T17:11:23.333679+0000","last_unstale":"2024-09-13T17:13:29.121714+0000","last_undegraded":"2024-09-13T17:13:29.121714+0000","last_fullsized":"2024-09-13T17:13:29.121714+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:10.265157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.212722+0000","last_change":"2024-09-13T17:11:27.353767+0000","last_active":"2024-09-13T17:12:50.212722+0000","last_peered":"2024-09-13T17:12:50.212722+0000","last_clean":"2024-09-13T17:12:50.212722+0000","last_became_active":"2024-09-13T17:11:27.353448+0000","last_became_peered":"2024-09-13T17:11:27.353448+0000","last_unstale":"2024-09-13T17:12:50.212722+0000","last_undegraded":"2024-09-13T17:12:50.212722+0000","last_fullsized":"2024-09-13T17:12:50.212722+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:15.948099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.217794+0000","last_change":"2024-09-13T17:11:22.999879+0000","last_active":"2024-09-13T17:12:50.217794+0000","last_peered":"2024-09-13T17:12:50.217794+0000","last_clean":"2024-09-13T17:12:50.217794+0000","last_became_active":"2024-09-13T17:11:22.999577+0000","last_became_peered":"2024-09-13T17:11:22.999577+0000","last_unstale":"2024-09-13T17:12:50.217794+0000","last_undegraded":"2024-09-13T17:12:50.217794+0000","last_fullsized":"2024-09-13T17:12:50.217794+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:48.485532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"93'9","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:18.082355+0000","last_change":"2024-09-13T17:11:23.339026+0000","last_active":"2024-09-13T17:13:18.082355+0000","last_peered":"2024-09-13T17:13:18.082355+0000","last_clean":"2024-09-13T17:13:18.082355+0000","last_became_active":"2024-09-13T17:11:23.338745+0000","last_became_peered":"2024-09-13T17:11:23.338745+0000","last_unstale":"2024-09-13T17:13:18.082355+0000","last_undegraded":"2024-09-13T17:13:18.082355+0000","last_fullsized":"2024-09-13T17:13:18.082355+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:27.455418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.213246+0000","last_change":"2024-09-13T17:11:27.363137+0000","last_active":"2024-09-13T17:12:50.213246+0000","last_peered":"2024-09-13T17:12:50.213246+0000","last_clean":"2024-09-13T17:12:50.213246+0000","last_became_active":"2024-09-13T17:11:27.362621+0000","last_became_peered":"2024-09-13T17:11:27.362621+0000","last_unstale":"2024-09-13T17:12:50.213246+0000","last_undegraded":"2024-09-13T17:12:50.213246+0000","last_fullsized":"2024-09-13T17:12:50.213246+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:35:51.492630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.226893+0000","last_change":"2024-09-13T17:12:50.226520+0000","last_active":"2024-09-13T17:12:50.226893+0000","last_peered":"2024-09-13T17:12:50.226893+0000","last_clean":"2024-09-13T17:12:50.226893+0000","last_became_active":"2024-09-13T17:12:50.223542+0000","last_became_peered":"2024-09-13T17:12:50.223542+0000","last_unstale":"2024-09-13T17:12:50.226893+0000","last_undegraded":"2024-09-13T17:12:50.226893+0000","last_fullsized":"2024-09-13T17:12:50.226893+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:38.064047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"93'15","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:18.077694+0000","last_change":"2024-09-13T17:11:23.336778+0000","last_active":"2024-09-13T17:13:18.077694+0000","last_peered":"2024-09-13T17:13:18.077694+0000","last_clean":"2024-09-13T17:13:18.077694+0000","last_became_active":"2024-09-13T17:11:23.336491+0000","last_became_peered":"2024-09-13T17:11:23.336491+0000","last_unstale":"2024-09-13T17:13:18.077694+0000","last_undegraded":"2024-09-13T17:13:18.077694+0000","last_fullsized":"2024-09-13T17:13:18.077694+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:02.045912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.213069+0000","last_change":"2024-09-13T17:11:27.361454+0000","last_active":"2024-09-13T17:12:50.213069+0000","last_peered":"2024-09-13T17:12:50.213069+0000","last_clean":"2024-09-13T17:12:50.213069+0000","last_became_active":"2024-09-13T17:11:27.360980+0000","last_became_peered":"2024-09-13T17:11:27.360980+0000","last_unstale":"2024-09-13T17:12:50.213069+0000","last_undegraded":"2024-09-13T17:12:50.213069+0000","last_fullsized":"2024-09-13T17:12:50.213069+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:36.036426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"93'5","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:33.513046+0000","last_change":"2024-09-13T17:11:23.334073+0000","last_active":"2024-09-13T17:13:33.513046+0000","last_peered":"2024-09-13T17:13:33.513046+0000","last_clean":"2024-09-13T17:13:33.513046+0000","last_became_active":"2024-09-13T17:11:23.333628+0000","last_became_peered":"2024-09-13T17:11:23.333628+0000","last_unstale":"2024-09-13T17:13:33.513046+0000","last_undegraded":"2024-09-13T17:13:33.513046+0000","last_fullsized":"2024-09-13T17:13:33.513046+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:18.561346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:38.434680+0000","last_change":"2024-09-13T17:12:50.229697+0000","last_active":"2024-09-13T17:13:38.434680+0000","last_peered":"2024-09-13T17:13:38.434680+0000","last_clean":"2024-09-13T17:13:38.434680+0000","last_became_active":"2024-09-13T17:12:50.224286+0000","last_became_peered":"2024-09-13T17:12:50.224286+0000","last_unstale":"2024-09-13T17:13:38.434680+0000","last_undegraded":"2024-09-13T17:13:38.434680+0000","last_fullsized":"2024-09-13T17:13:38.434680+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:42.724176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.609612+0000","last_change":"2024-09-13T17:11:27.355472+0000","last_active":"2024-09-13T17:13:49.609612+0000","last_peered":"2024-09-13T17:13:49.609612+0000","last_clean":"2024-09-13T17:13:49.609612+0000","last_became_active":"2024-09-13T17:11:27.355065+0000","last_became_peered":"2024-09-13T17:11:27.355065+0000","last_unstale":"2024-09-13T17:13:49.609612+0000","last_undegraded":"2024-09-13T17:13:49.609612+0000","last_fullsized":"2024-09-13T17:13:49.609612+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:03.881097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"93'8","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:40.610299+0000","last_change":"2024-09-13T17:11:23.340268+0000","last_active":"2024-09-13T17:13:40.610299+0000","last_peered":"2024-09-13T17:13:40.610299+0000","last_clean":"2024-09-13T17:13:40.610299+0000","last_became_active":"2024-09-13T17:11:23.339977+0000","last_became_peered":"2024-09-13T17:11:23.339977+0000","last_unstale":"2024-09-13T17:13:40.610299+0000","last_undegraded":"2024-09-13T17:13:40.610299+0000","last_fullsized":"2024-09-13T17:13:40.610299+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:21.067899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"94'2","reported_seq":24,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.385251+0000","last_change":"2024-09-13T17:11:23.000858+0000","last_active":"2024-09-13T17:13:49.385251+0000","last_peered":"2024-09-13T17:13:49.385251+0000","last_clean":"2024-09-13T17:13:49.385251+0000","last_became_active":"2024-09-13T17:11:23.000536+0000","last_became_peered":"2024-09-13T17:11:23.000536+0000","last_unstale":"2024-09-13T17:13:49.385251+0000","last_undegraded":"2024-09-13T17:13:49.385251+0000","last_fullsized":"2024-09-13T17:13:49.385251+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:28.798579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":19,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.609588+0000","last_change":"2024-09-13T17:11:27.354018+0000","last_active":"2024-09-13T17:13:49.609588+0000","last_peered":"2024-09-13T17:13:49.609588+0000","last_clean":"2024-09-13T17:13:49.609588+0000","last_became_active":"2024-09-13T17:11:27.353519+0000","last_became_peered":"2024-09-13T17:11:27.353519+0000","last_unstale":"2024-09-13T17:13:49.609588+0000","last_undegraded":"2024-09-13T17:13:49.609588+0000","last_fullsized":"2024-09-13T17:13:49.609588+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:55.227851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"93'9","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:35.023706+0000","last_change":"2024-09-13T17:11:23.335798+0000","last_active":"2024-09-13T17:13:35.023706+0000","last_peered":"2024-09-13T17:13:35.023706+0000","last_clean":"2024-09-13T17:13:35.023706+0000","last_became_active":"2024-09-13T17:11:23.335445+0000","last_became_peered":"2024-09-13T17:11:23.335445+0000","last_unstale":"2024-09-13T17:13:35.023706+0000","last_undegraded":"2024-09-13T17:13:35.023706+0000","last_fullsized":"2024-09-13T17:13:35.023706+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:53.242067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:35.609814+0000","last_change":"2024-09-13T17:11:22.994118+0000","last_active":"2024-09-13T17:13:35.609814+0000","last_peered":"2024-09-13T17:13:35.609814+0000","last_clean":"2024-09-13T17:13:35.609814+0000","last_became_active":"2024-09-13T17:11:22.993801+0000","last_became_peered":"2024-09-13T17:11:22.993801+0000","last_unstale":"2024-09-13T17:13:35.609814+0000","last_undegraded":"2024-09-13T17:13:35.609814+0000","last_fullsized":"2024-09-13T17:13:35.609814+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:01.382130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:42.571068+0000","last_change":"2024-09-13T17:11:27.358795+0000","last_active":"2024-09-13T17:13:42.571068+0000","last_peered":"2024-09-13T17:13:42.571068+0000","last_clean":"2024-09-13T17:13:42.571068+0000","last_became_active":"2024-09-13T17:11:27.358166+0000","last_became_peered":"2024-09-13T17:11:27.358166+0000","last_unstale":"2024-09-13T17:13:42.571068+0000","last_undegraded":"2024-09-13T17:13:42.571068+0000","last_fullsized":"2024-09-13T17:13:42.571068+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:23.787842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"93'2","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:33.433908+0000","last_change":"2024-09-13T17:11:23.340671+0000","last_active":"2024-09-13T17:13:33.433908+0000","last_peered":"2024-09-13T17:13:33.433908+0000","last_clean":"2024-09-13T17:13:33.433908+0000","last_became_active":"2024-09-13T17:11:23.340360+0000","last_became_peered":"2024-09-13T17:11:23.340360+0000","last_unstale":"2024-09-13T17:13:33.433908+0000","last_undegraded":"2024-09-13T17:13:33.433908+0000","last_fullsized":"2024-09-13T17:13:33.433908+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:17.875171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:35.294965+0000","last_change":"2024-09-13T17:11:22.993039+0000","last_active":"2024-09-13T17:13:35.294965+0000","last_peered":"2024-09-13T17:13:35.294965+0000","last_clean":"2024-09-13T17:13:35.294965+0000","last_became_active":"2024-09-13T17:11:22.992701+0000","last_became_peered":"2024-09-13T17:11:22.992701+0000","last_unstale":"2024-09-13T17:13:35.294965+0000","last_undegraded":"2024-09-13T17:13:35.294965+0000","last_fullsized":"2024-09-13T17:13:35.294965+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:28.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.609970+0000","last_change":"2024-09-13T17:11:27.363834+0000","last_active":"2024-09-13T17:13:49.609970+0000","last_peered":"2024-09-13T17:13:49.609970+0000","last_clean":"2024-09-13T17:13:49.609970+0000","last_became_active":"2024-09-13T17:11:27.363425+0000","last_became_peered":"2024-09-13T17:11:27.363425+0000","last_unstale":"2024-09-13T17:13:49.609970+0000","last_undegraded":"2024-09-13T17:13:49.609970+0000","last_fullsized":"2024-09-13T17:13:49.609970+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:37.389881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"93'7","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:34.122246+0000","last_change":"2024-09-13T17:11:23.337423+0000","last_active":"2024-09-13T17:13:34.122246+0000","last_peered":"2024-09-13T17:13:34.122246+0000","last_clean":"2024-09-13T17:13:34.122246+0000","last_became_active":"2024-09-13T17:11:23.337167+0000","last_became_peered":"2024-09-13T17:11:23.337167+0000","last_unstale":"2024-09-13T17:13:34.122246+0000","last_undegraded":"2024-09-13T17:13:34.122246+0000","last_fullsized":"2024-09-13T17:13:34.122246+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:28.540283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:34.553531+0000","last_change":"2024-09-13T17:11:23.000486+0000","last_active":"2024-09-13T17:13:34.553531+0000","last_peered":"2024-09-13T17:13:34.553531+0000","last_clean":"2024-09-13T17:13:34.553531+0000","last_became_active":"2024-09-13T17:11:23.000158+0000","last_became_peered":"2024-09-13T17:11:23.000158+0000","last_unstale":"2024-09-13T17:13:34.553531+0000","last_undegraded":"2024-09-13T17:13:34.553531+0000","last_fullsized":"2024-09-13T17:13:34.553531+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:42.635037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:33.073032+0000","last_change":"2024-09-13T17:11:27.355058+0000","last_active":"2024-09-13T17:13:33.073032+0000","last_peered":"2024-09-13T17:13:33.073032+0000","last_clean":"2024-09-13T17:13:33.073032+0000","last_became_active":"2024-09-13T17:11:27.354726+0000","last_became_peered":"2024-09-13T17:11:27.354726+0000","last_unstale":"2024-09-13T17:13:33.073032+0000","last_undegraded":"2024-09-13T17:13:33.073032+0000","last_fullsized":"2024-09-13T17:13:33.073032+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:58.450122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"93'5","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:35.609884+0000","last_change":"2024-09-13T17:11:23.337245+0000","last_active":"2024-09-13T17:13:35.609884+0000","last_peered":"2024-09-13T17:13:35.609884+0000","last_clean":"2024-09-13T17:13:35.609884+0000","last_became_active":"2024-09-13T17:11:23.336956+0000","last_became_peered":"2024-09-13T17:11:23.336956+0000","last_unstale":"2024-09-13T17:13:35.609884+0000","last_undegraded":"2024-09-13T17:13:35.609884+0000","last_fullsized":"2024-09-13T17:13:35.609884+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:46.876149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"94'42","reported_seq":87,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.582838+0000","last_change":"2024-09-13T17:11:22.999942+0000","last_active":"2024-09-13T17:13:49.582838+0000","last_peered":"2024-09-13T17:13:49.582838+0000","last_clean":"2024-09-13T17:13:49.582838+0000","last_became_active":"2024-09-13T17:11:22.999653+0000","last_became_peered":"2024-09-13T17:11:22.999653+0000","last_unstale":"2024-09-13T17:13:49.582838+0000","last_undegraded":"2024-09-13T17:13:49.582838+0000","last_fullsized":"2024-09-13T17:13:49.582838+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:29.400939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":75,"num_write_kb":835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:30.609223+0000","last_change":"2024-09-13T17:11:27.356479+0000","last_active":"2024-09-13T17:13:30.609223+0000","last_peered":"2024-09-13T17:13:30.609223+0000","last_clean":"2024-09-13T17:13:30.609223+0000","last_became_active":"2024-09-13T17:11:27.356052+0000","last_became_peered":"2024-09-13T17:11:27.356052+0000","last_unstale":"2024-09-13T17:13:30.609223+0000","last_undegraded":"2024-09-13T17:13:30.609223+0000","last_fullsized":"2024-09-13T17:13:30.609223+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:42.173376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"93'9","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:30.615414+0000","last_change":"2024-09-13T17:11:23.333786+0000","last_active":"2024-09-13T17:13:30.615414+0000","last_peered":"2024-09-13T17:13:30.615414+0000","last_clean":"2024-09-13T17:13:30.615414+0000","last_became_active":"2024-09-13T17:11:23.333472+0000","last_became_peered":"2024-09-13T17:11:23.333472+0000","last_unstale":"2024-09-13T17:13:30.615414+0000","last_undegraded":"2024-09-13T17:13:30.615414+0000","last_fullsized":"2024-09-13T17:13:30.615414+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:41.633228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:28.433423+0000","last_change":"2024-09-13T17:11:22.998646+0000","last_active":"2024-09-13T17:13:28.433423+0000","last_peered":"2024-09-13T17:13:28.433423+0000","last_clean":"2024-09-13T17:13:28.433423+0000","last_became_active":"2024-09-13T17:11:22.998291+0000","last_became_peered":"2024-09-13T17:11:22.998291+0000","last_unstale":"2024-09-13T17:13:28.433423+0000","last_undegraded":"2024-09-13T17:13:28.433423+0000","last_fullsized":"2024-09-13T17:13:28.433423+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:20.658436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:35.023722+0000","last_change":"2024-09-13T17:11:27.361174+0000","last_active":"2024-09-13T17:13:35.023722+0000","last_peered":"2024-09-13T17:13:35.023722+0000","last_clean":"2024-09-13T17:13:35.023722+0000","last_became_active":"2024-09-13T17:11:27.360737+0000","last_became_peered":"2024-09-13T17:11:27.360737+0000","last_unstale":"2024-09-13T17:13:35.023722+0000","last_undegraded":"2024-09-13T17:13:35.023722+0000","last_fullsized":"2024-09-13T17:13:35.023722+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:00.941364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"93'4","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:29.461649+0000","last_change":"2024-09-13T17:11:23.338545+0000","last_active":"2024-09-13T17:13:29.461649+0000","last_peered":"2024-09-13T17:13:29.461649+0000","last_clean":"2024-09-13T17:13:29.461649+0000","last_became_active":"2024-09-13T17:11:23.338246+0000","last_became_peered":"2024-09-13T17:11:23.338246+0000","last_unstale":"2024-09-13T17:13:29.461649+0000","last_undegraded":"2024-09-13T17:13:29.461649+0000","last_fullsized":"2024-09-13T17:13:29.461649+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:18.966658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:27.569578+0000","last_change":"2024-09-13T17:11:22.993497+0000","last_active":"2024-09-13T17:13:27.569578+0000","last_peered":"2024-09-13T17:13:27.569578+0000","last_clean":"2024-09-13T17:13:27.569578+0000","last_became_active":"2024-09-13T17:11:22.993165+0000","last_became_peered":"2024-09-13T17:11:22.993165+0000","last_unstale":"2024-09-13T17:13:27.569578+0000","last_undegraded":"2024-09-13T17:13:27.569578+0000","last_fullsized":"2024-09-13T17:13:27.569578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:20.997834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:33.433950+0000","last_change":"2024-09-13T17:11:27.364652+0000","last_active":"2024-09-13T17:13:33.433950+0000","last_peered":"2024-09-13T17:13:33.433950+0000","last_clean":"2024-09-13T17:13:33.433950+0000","last_became_active":"2024-09-13T17:11:27.364245+0000","last_became_peered":"2024-09-13T17:11:27.364245+0000","last_unstale":"2024-09-13T17:13:33.433950+0000","last_undegraded":"2024-09-13T17:13:33.433950+0000","last_fullsized":"2024-09-13T17:13:33.433950+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:23.048289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"93'7","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:29.461627+0000","last_change":"2024-09-13T17:11:23.335649+0000","last_active":"2024-09-13T17:13:29.461627+0000","last_peered":"2024-09-13T17:13:29.461627+0000","last_clean":"2024-09-13T17:13:29.461627+0000","last_became_active":"2024-09-13T17:11:23.335364+0000","last_became_peered":"2024-09-13T17:11:23.335364+0000","last_unstale":"2024-09-13T17:13:29.461627+0000","last_undegraded":"2024-09-13T17:13:29.461627+0000","last_fullsized":"2024-09-13T17:13:29.461627+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.447947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:28.512345+0000","last_change":"2024-09-13T17:11:23.003188+0000","last_active":"2024-09-13T17:13:28.512345+0000","last_peered":"2024-09-13T17:13:28.512345+0000","last_clean":"2024-09-13T17:13:28.512345+0000","last_became_active":"2024-09-13T17:11:23.002858+0000","last_became_peered":"2024-09-13T17:11:23.002858+0000","last_unstale":"2024-09-13T17:13:28.512345+0000","last_undegraded":"2024-09-13T17:13:28.512345+0000","last_fullsized":"2024-09-13T17:13:28.512345+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:34.153326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:35.616036+0000","last_change":"2024-09-13T17:11:27.353320+0000","last_active":"2024-09-13T17:13:35.616036+0000","last_peered":"2024-09-13T17:13:35.616036+0000","last_clean":"2024-09-13T17:13:35.616036+0000","last_became_active":"2024-09-13T17:11:27.352947+0000","last_became_peered":"2024-09-13T17:11:27.352947+0000","last_unstale":"2024-09-13T17:13:35.616036+0000","last_undegraded":"2024-09-13T17:13:35.616036+0000","last_fullsized":"2024-09-13T17:13:35.616036+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:04.619618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"93'8","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:27.047981+0000","last_change":"2024-09-13T17:11:23.330128+0000","last_active":"2024-09-13T17:13:27.047981+0000","last_peered":"2024-09-13T17:13:27.047981+0000","last_clean":"2024-09-13T17:13:27.047981+0000","last_became_active":"2024-09-13T17:11:23.329266+0000","last_became_peered":"2024-09-13T17:11:23.329266+0000","last_unstale":"2024-09-13T17:13:27.047981+0000","last_undegraded":"2024-09-13T17:13:27.047981+0000","last_fullsized":"2024-09-13T17:13:27.047981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:36.275352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"93'5","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.401642+0000","last_change":"2024-09-13T17:11:23.003495+0000","last_active":"2024-09-13T17:13:49.401642+0000","last_peered":"2024-09-13T17:13:49.401642+0000","last_clean":"2024-09-13T17:13:49.401642+0000","last_became_active":"2024-09-13T17:11:23.003186+0000","last_became_peered":"2024-09-13T17:11:23.003186+0000","last_unstale":"2024-09-13T17:13:49.401642+0000","last_undegraded":"2024-09-13T17:13:49.401642+0000","last_fullsized":"2024-09-13T17:13:49.401642+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:23.353587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":123,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:40.616521+0000","last_change":"2024-09-13T17:11:27.362233+0000","last_active":"2024-09-13T17:13:40.616521+0000","last_peered":"2024-09-13T17:13:40.616521+0000","last_clean":"2024-09-13T17:13:40.616521+0000","last_became_active":"2024-09-13T17:11:27.361814+0000","last_became_peered":"2024-09-13T17:11:27.361814+0000","last_unstale":"2024-09-13T17:13:40.616521+0000","last_undegraded":"2024-09-13T17:13:40.616521+0000","last_fullsized":"2024-09-13T17:13:40.616521+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:20.723366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"93'5","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:30.615308+0000","last_change":"2024-09-13T17:11:23.332870+0000","last_active":"2024-09-13T17:13:30.615308+0000","last_peered":"2024-09-13T17:13:30.615308+0000","last_clean":"2024-09-13T17:13:30.615308+0000","last_became_active":"2024-09-13T17:11:23.332583+0000","last_became_peered":"2024-09-13T17:11:23.332583+0000","last_unstale":"2024-09-13T17:13:30.615308+0000","last_undegraded":"2024-09-13T17:13:30.615308+0000","last_fullsized":"2024-09-13T17:13:30.615308+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:22.607666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:23.511795+0000","last_change":"2024-09-13T17:11:23.001932+0000","last_active":"2024-09-13T17:13:23.511795+0000","last_peered":"2024-09-13T17:13:23.511795+0000","last_clean":"2024-09-13T17:13:23.511795+0000","last_became_active":"2024-09-13T17:11:23.001642+0000","last_became_peered":"2024-09-13T17:11:23.001642+0000","last_unstale":"2024-09-13T17:13:23.511795+0000","last_undegraded":"2024-09-13T17:13:23.511795+0000","last_fullsized":"2024-09-13T17:13:23.511795+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:05.976897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:37.049232+0000","last_change":"2024-09-13T17:11:27.359679+0000","last_active":"2024-09-13T17:13:37.049232+0000","last_peered":"2024-09-13T17:13:37.049232+0000","last_clean":"2024-09-13T17:13:37.049232+0000","last_became_active":"2024-09-13T17:11:27.359268+0000","last_became_peered":"2024-09-13T17:11:27.359268+0000","last_unstale":"2024-09-13T17:13:37.049232+0000","last_undegraded":"2024-09-13T17:13:37.049232+0000","last_fullsized":"2024-09-13T17:13:37.049232+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:48.154917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"93'8","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:30.609274+0000","last_change":"2024-09-13T17:11:23.340031+0000","last_active":"2024-09-13T17:13:30.609274+0000","last_peered":"2024-09-13T17:13:30.609274+0000","last_clean":"2024-09-13T17:13:30.609274+0000","last_became_active":"2024-09-13T17:11:23.339768+0000","last_became_peered":"2024-09-13T17:11:23.339768+0000","last_unstale":"2024-09-13T17:13:30.609274+0000","last_undegraded":"2024-09-13T17:13:30.609274+0000","last_fullsized":"2024-09-13T17:13:30.609274+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:22.360526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:29.552779+0000","last_change":"2024-09-13T17:11:22.995060+0000","last_active":"2024-09-13T17:13:29.552779+0000","last_peered":"2024-09-13T17:13:29.552779+0000","last_clean":"2024-09-13T17:13:29.552779+0000","last_became_active":"2024-09-13T17:11:22.991949+0000","last_became_peered":"2024-09-13T17:11:22.991949+0000","last_unstale":"2024-09-13T17:13:29.552779+0000","last_undegraded":"2024-09-13T17:13:29.552779+0000","last_fullsized":"2024-09-13T17:13:29.552779+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:44.716753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":344,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:03.509232+0000","last_change":"2024-09-13T17:10:13.439723+0000","last_active":"2024-09-13T17:13:03.509232+0000","last_peered":"2024-09-13T17:13:03.509232+0000","last_clean":"2024-09-13T17:13:03.509232+0000","last_became_active":"2024-09-13T17:10:13.439290+0000","last_became_peered":"2024-09-13T17:10:13.439290+0000","last_unstale":"2024-09-13T17:13:03.509232+0000","last_undegraded":"2024-09-13T17:13:03.509232+0000","last_fullsized":"2024-09-13T17:13:03.509232+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:03.041486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:03.041486+0000","last_clean_scrub_stamp":"2024-09-13T17:07:03.041486+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:08.673571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":19,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:33.513108+0000","last_change":"2024-09-13T17:11:27.361028+0000","last_active":"2024-09-13T17:13:33.513108+0000","last_peered":"2024-09-13T17:13:33.513108+0000","last_clean":"2024-09-13T17:13:33.513108+0000","last_became_active":"2024-09-13T17:11:27.360630+0000","last_became_peered":"2024-09-13T17:11:27.360630+0000","last_unstale":"2024-09-13T17:13:33.513108+0000","last_undegraded":"2024-09-13T17:13:33.513108+0000","last_fullsized":"2024-09-13T17:13:33.513108+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:40:40.860443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"93'7","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:38.513709+0000","last_change":"2024-09-13T17:11:49.798729+0000","last_active":"2024-09-13T17:13:38.513709+0000","last_peered":"2024-09-13T17:13:38.513709+0000","last_clean":"2024-09-13T17:13:38.513709+0000","last_became_active":"2024-09-13T17:11:49.798402+0000","last_became_peered":"2024-09-13T17:11:49.798402+0000","last_unstale":"2024-09-13T17:13:38.513709+0000","last_undegraded":"2024-09-13T17:13:38.513709+0000","last_fullsized":"2024-09-13T17:13:38.513709+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:58.948813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,11],"acting":[7,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":20,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.213151+0000","last_change":"2024-09-13T17:11:49.802654+0000","last_active":"2024-09-13T17:12:50.213151+0000","last_peered":"2024-09-13T17:12:50.213151+0000","last_clean":"2024-09-13T17:12:50.213151+0000","last_became_active":"2024-09-13T17:11:49.797574+0000","last_became_peered":"2024-09-13T17:11:49.797574+0000","last_unstale":"2024-09-13T17:12:50.213151+0000","last_undegraded":"2024-09-13T17:12:50.213151+0000","last_fullsized":"2024-09-13T17:12:50.213151+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:08.827045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:40.295461+0000","last_change":"2024-09-13T17:11:27.360372+0000","last_active":"2024-09-13T17:13:40.295461+0000","last_peered":"2024-09-13T17:13:40.295461+0000","last_clean":"2024-09-13T17:13:40.295461+0000","last_became_active":"2024-09-13T17:11:27.359990+0000","last_became_peered":"2024-09-13T17:11:27.359990+0000","last_unstale":"2024-09-13T17:13:40.295461+0000","last_undegraded":"2024-09-13T17:13:40.295461+0000","last_fullsized":"2024-09-13T17:13:40.295461+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:26.970317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"93'6","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:38.513682+0000","last_change":"2024-09-13T17:11:23.336269+0000","last_active":"2024-09-13T17:13:38.513682+0000","last_peered":"2024-09-13T17:13:38.513682+0000","last_clean":"2024-09-13T17:13:38.513682+0000","last_became_active":"2024-09-13T17:11:23.335921+0000","last_became_peered":"2024-09-13T17:11:23.335921+0000","last_unstale":"2024-09-13T17:13:38.513682+0000","last_undegraded":"2024-09-13T17:13:38.513682+0000","last_fullsized":"2024-09-13T17:13:38.513682+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:43.035927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"94'39","reported_seq":68,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.576625+0000","last_change":"2024-09-13T17:11:23.002491+0000","last_active":"2024-09-13T17:13:49.576625+0000","last_peered":"2024-09-13T17:13:49.576625+0000","last_clean":"2024-09-13T17:13:49.576625+0000","last_became_active":"2024-09-13T17:11:23.002178+0000","last_became_peered":"2024-09-13T17:11:23.002178+0000","last_unstale":"2024-09-13T17:13:49.576625+0000","last_undegraded":"2024-09-13T17:13:49.576625+0000","last_fullsized":"2024-09-13T17:13:49.576625+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:06.056639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:44.123173+0000","last_change":"2024-09-13T17:11:27.355153+0000","last_active":"2024-09-13T17:13:44.123173+0000","last_peered":"2024-09-13T17:13:44.123173+0000","last_clean":"2024-09-13T17:13:44.123173+0000","last_became_active":"2024-09-13T17:11:27.354701+0000","last_became_peered":"2024-09-13T17:11:27.354701+0000","last_unstale":"2024-09-13T17:13:44.123173+0000","last_undegraded":"2024-09-13T17:13:44.123173+0000","last_fullsized":"2024-09-13T17:13:44.123173+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:34.924402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"93'9","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:38.513730+0000","last_change":"2024-09-13T17:11:23.342067+0000","last_active":"2024-09-13T17:13:38.513730+0000","last_peered":"2024-09-13T17:13:38.513730+0000","last_clean":"2024-09-13T17:13:38.513730+0000","last_became_active":"2024-09-13T17:11:23.341736+0000","last_became_peered":"2024-09-13T17:11:23.341736+0000","last_unstale":"2024-09-13T17:13:38.513730+0000","last_undegraded":"2024-09-13T17:13:38.513730+0000","last_fullsized":"2024-09-13T17:13:38.513730+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:03.114638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:40.616506+0000","last_change":"2024-09-13T17:11:23.002849+0000","last_active":"2024-09-13T17:13:40.616506+0000","last_peered":"2024-09-13T17:13:40.616506+0000","last_clean":"2024-09-13T17:13:40.616506+0000","last_became_active":"2024-09-13T17:11:23.002562+0000","last_became_peered":"2024-09-13T17:11:23.002562+0000","last_unstale":"2024-09-13T17:13:40.616506+0000","last_undegraded":"2024-09-13T17:13:40.616506+0000","last_fullsized":"2024-09-13T17:13:40.616506+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:11:24.650510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:37.049118+0000","last_change":"2024-09-13T17:11:27.359343+0000","last_active":"2024-09-13T17:13:37.049118+0000","last_peered":"2024-09-13T17:13:37.049118+0000","last_clean":"2024-09-13T17:13:37.049118+0000","last_became_active":"2024-09-13T17:11:27.358628+0000","last_became_peered":"2024-09-13T17:11:27.358628+0000","last_unstale":"2024-09-13T17:13:37.049118+0000","last_undegraded":"2024-09-13T17:13:37.049118+0000","last_fullsized":"2024-09-13T17:13:37.049118+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:39.584184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"93'5","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:40.024237+0000","last_change":"2024-09-13T17:11:23.333111+0000","last_active":"2024-09-13T17:13:40.024237+0000","last_peered":"2024-09-13T17:13:40.024237+0000","last_clean":"2024-09-13T17:13:40.024237+0000","last_became_active":"2024-09-13T17:11:23.332734+0000","last_became_peered":"2024-09-13T17:11:23.332734+0000","last_unstale":"2024-09-13T17:13:40.024237+0000","last_undegraded":"2024-09-13T17:13:40.024237+0000","last_fullsized":"2024-09-13T17:13:40.024237+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:44.628106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"91'2","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:38.434730+0000","last_change":"2024-09-13T17:11:23.000759+0000","last_active":"2024-09-13T17:13:38.434730+0000","last_peered":"2024-09-13T17:13:38.434730+0000","last_clean":"2024-09-13T17:13:38.434730+0000","last_became_active":"2024-09-13T17:11:23.000463+0000","last_became_peered":"2024-09-13T17:11:23.000463+0000","last_unstale":"2024-09-13T17:13:38.434730+0000","last_undegraded":"2024-09-13T17:13:38.434730+0000","last_fullsized":"2024-09-13T17:13:38.434730+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:59.077194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:37.049152+0000","last_change":"2024-09-13T17:11:27.363076+0000","last_active":"2024-09-13T17:13:37.049152+0000","last_peered":"2024-09-13T17:13:37.049152+0000","last_clean":"2024-09-13T17:13:37.049152+0000","last_became_active":"2024-09-13T17:11:27.362642+0000","last_became_peered":"2024-09-13T17:11:27.362642+0000","last_unstale":"2024-09-13T17:13:37.049152+0000","last_undegraded":"2024-09-13T17:13:37.049152+0000","last_fullsized":"2024-09-13T17:13:37.049152+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:25.494875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"93'6","reported_seq":26,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.473181+0000","last_change":"2024-09-13T17:11:23.336703+0000","last_active":"2024-09-13T17:13:49.473181+0000","last_peered":"2024-09-13T17:13:49.473181+0000","last_clean":"2024-09-13T17:13:49.473181+0000","last_became_active":"2024-09-13T17:11:23.336349+0000","last_became_peered":"2024-09-13T17:11:23.336349+0000","last_unstale":"2024-09-13T17:13:49.473181+0000","last_undegraded":"2024-09-13T17:13:49.473181+0000","last_fullsized":"2024-09-13T17:13:49.473181+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:28.671438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:43.435160+0000","last_change":"2024-09-13T17:11:22.994382+0000","last_active":"2024-09-13T17:13:43.435160+0000","last_peered":"2024-09-13T17:13:43.435160+0000","last_clean":"2024-09-13T17:13:43.435160+0000","last_became_active":"2024-09-13T17:11:22.994037+0000","last_became_peered":"2024-09-13T17:11:22.994037+0000","last_unstale":"2024-09-13T17:13:43.435160+0000","last_undegraded":"2024-09-13T17:13:43.435160+0000","last_fullsized":"2024-09-13T17:13:43.435160+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:10.763757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.212460+0000","last_change":"2024-09-13T17:11:27.354351+0000","last_active":"2024-09-13T17:12:50.212460+0000","last_peered":"2024-09-13T17:12:50.212460+0000","last_clean":"2024-09-13T17:12:50.212460+0000","last_became_active":"2024-09-13T17:11:27.353715+0000","last_became_peered":"2024-09-13T17:11:27.353715+0000","last_unstale":"2024-09-13T17:12:50.212460+0000","last_undegraded":"2024-09-13T17:12:50.212460+0000","last_fullsized":"2024-09-13T17:12:50.212460+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:18.335183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"93'6","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:43.514127+0000","last_change":"2024-09-13T17:11:23.341743+0000","last_active":"2024-09-13T17:13:43.514127+0000","last_peered":"2024-09-13T17:13:43.514127+0000","last_clean":"2024-09-13T17:13:43.514127+0000","last_became_active":"2024-09-13T17:11:23.341200+0000","last_became_peered":"2024-09-13T17:11:23.341200+0000","last_unstale":"2024-09-13T17:13:43.514127+0000","last_undegraded":"2024-09-13T17:13:43.514127+0000","last_fullsized":"2024-09-13T17:13:43.514127+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:41.854013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"94'6","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.982188+0000","last_change":"2024-09-13T17:11:22.997571+0000","last_active":"2024-09-13T17:13:49.982188+0000","last_peered":"2024-09-13T17:13:49.982188+0000","last_clean":"2024-09-13T17:13:49.982188+0000","last_became_active":"2024-09-13T17:11:22.997238+0000","last_became_peered":"2024-09-13T17:11:22.997238+0000","last_unstale":"2024-09-13T17:13:49.982188+0000","last_undegraded":"2024-09-13T17:13:49.982188+0000","last_fullsized":"2024-09-13T17:13:49.982188+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:34.533004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1818,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":128,"num_read_kb":5,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:53.429158+0000","last_change":"2024-09-13T17:12:50.761520+0000","last_active":"2024-09-13T17:12:53.429158+0000","last_peered":"2024-09-13T17:12:53.429158+0000","last_clean":"2024-09-13T17:12:53.429158+0000","last_became_active":"2024-09-13T17:12:50.760930+0000","last_became_peered":"2024-09-13T17:12:50.760930+0000","last_unstale":"2024-09-13T17:12:53.429158+0000","last_undegraded":"2024-09-13T17:12:53.429158+0000","last_fullsized":"2024-09-13T17:12:53.429158+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:46.646722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"93'15","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:43.514206+0000","last_change":"2024-09-13T17:11:23.337666+0000","last_active":"2024-09-13T17:13:43.514206+0000","last_peered":"2024-09-13T17:13:43.514206+0000","last_clean":"2024-09-13T17:13:43.514206+0000","last_became_active":"2024-09-13T17:11:23.337185+0000","last_became_peered":"2024-09-13T17:11:23.337185+0000","last_unstale":"2024-09-13T17:13:43.514206+0000","last_undegraded":"2024-09-13T17:13:43.514206+0000","last_fullsized":"2024-09-13T17:13:43.514206+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:51.266709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:42.049772+0000","last_change":"2024-09-13T17:11:23.005075+0000","last_active":"2024-09-13T17:13:42.049772+0000","last_peered":"2024-09-13T17:13:42.049772+0000","last_clean":"2024-09-13T17:13:42.049772+0000","last_became_active":"2024-09-13T17:11:23.004778+0000","last_became_peered":"2024-09-13T17:11:23.004778+0000","last_unstale":"2024-09-13T17:13:42.049772+0000","last_undegraded":"2024-09-13T17:13:42.049772+0000","last_fullsized":"2024-09-13T17:13:42.049772+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:06.763552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.609278+0000","last_change":"2024-09-13T17:11:27.353601+0000","last_active":"2024-09-13T17:13:49.609278+0000","last_peered":"2024-09-13T17:13:49.609278+0000","last_clean":"2024-09-13T17:13:49.609278+0000","last_became_active":"2024-09-13T17:11:27.353190+0000","last_became_peered":"2024-09-13T17:11:27.353190+0000","last_unstale":"2024-09-13T17:13:49.609278+0000","last_undegraded":"2024-09-13T17:13:49.609278+0000","last_fullsized":"2024-09-13T17:13:49.609278+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:24.645552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"93'9","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.401860+0000","last_change":"2024-09-13T17:11:49.799773+0000","last_active":"2024-09-13T17:13:49.401860+0000","last_peered":"2024-09-13T17:13:49.401860+0000","last_clean":"2024-09-13T17:13:49.401860+0000","last_became_active":"2024-09-13T17:11:49.799402+0000","last_became_peered":"2024-09-13T17:11:49.799402+0000","last_unstale":"2024-09-13T17:13:49.401860+0000","last_undegraded":"2024-09-13T17:13:49.401860+0000","last_fullsized":"2024-09-13T17:13:49.401860+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:37.230144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:43.074257+0000","last_change":"2024-09-13T17:11:23.005619+0000","last_active":"2024-09-13T17:13:43.074257+0000","last_peered":"2024-09-13T17:13:43.074257+0000","last_clean":"2024-09-13T17:13:43.074257+0000","last_became_active":"2024-09-13T17:11:23.005077+0000","last_became_peered":"2024-09-13T17:11:23.005077+0000","last_unstale":"2024-09-13T17:13:43.074257+0000","last_undegraded":"2024-09-13T17:13:43.074257+0000","last_fullsized":"2024-09-13T17:13:43.074257+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:51.739773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.473345+0000","last_change":"2024-09-13T17:11:27.364603+0000","last_active":"2024-09-13T17:13:49.473345+0000","last_peered":"2024-09-13T17:13:49.473345+0000","last_clean":"2024-09-13T17:13:49.473345+0000","last_became_active":"2024-09-13T17:11:27.364226+0000","last_became_peered":"2024-09-13T17:11:27.364226+0000","last_unstale":"2024-09-13T17:13:49.473345+0000","last_undegraded":"2024-09-13T17:13:49.473345+0000","last_fullsized":"2024-09-13T17:13:49.473345+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:56.802016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"93'6","reported_seq":27,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.467049+0000","last_change":"2024-09-13T17:11:23.338657+0000","last_active":"2024-09-13T17:13:49.467049+0000","last_peered":"2024-09-13T17:13:49.467049+0000","last_clean":"2024-09-13T17:13:49.467049+0000","last_became_active":"2024-09-13T17:11:23.338377+0000","last_became_peered":"2024-09-13T17:11:23.338377+0000","last_unstale":"2024-09-13T17:13:49.467049+0000","last_undegraded":"2024-09-13T17:13:49.467049+0000","last_fullsized":"2024-09-13T17:13:49.467049+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:52.412887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"94'40","reported_seq":319,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.972724+0000","last_change":"2024-09-13T17:11:22.998541+0000","last_active":"2024-09-13T17:13:49.972724+0000","last_peered":"2024-09-13T17:13:49.972724+0000","last_clean":"2024-09-13T17:13:49.972724+0000","last_became_active":"2024-09-13T17:11:22.998132+0000","last_became_peered":"2024-09-13T17:11:22.998132+0000","last_unstale":"2024-09-13T17:13:49.972724+0000","last_undegraded":"2024-09-13T17:13:49.972724+0000","last_fullsized":"2024-09-13T17:13:49.972724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:16.777772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68128,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":257,"num_read_kb":196,"num_write":41,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.464040+0000","last_change":"2024-09-13T17:11:27.361917+0000","last_active":"2024-09-13T17:13:49.464040+0000","last_peered":"2024-09-13T17:13:49.464040+0000","last_clean":"2024-09-13T17:13:49.464040+0000","last_became_active":"2024-09-13T17:11:27.361503+0000","last_became_peered":"2024-09-13T17:11:27.361503+0000","last_unstale":"2024-09-13T17:13:49.464040+0000","last_undegraded":"2024-09-13T17:13:49.464040+0000","last_fullsized":"2024-09-13T17:13:49.464040+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:52.959017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"93'11","reported_seq":41,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.609609+0000","last_change":"2024-09-13T17:11:49.798971+0000","last_active":"2024-09-13T17:13:49.609609+0000","last_peered":"2024-09-13T17:13:49.609609+0000","last_clean":"2024-09-13T17:13:49.609609+0000","last_became_active":"2024-09-13T17:11:49.798597+0000","last_became_peered":"2024-09-13T17:11:49.798597+0000","last_unstale":"2024-09-13T17:13:49.609609+0000","last_undegraded":"2024-09-13T17:13:49.609609+0000","last_fullsized":"2024-09-13T17:13:49.609609+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:41.886456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":26,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.473545+0000","last_change":"2024-09-13T17:11:23.004059+0000","last_active":"2024-09-13T17:13:49.473545+0000","last_peered":"2024-09-13T17:13:49.473545+0000","last_clean":"2024-09-13T17:13:49.473545+0000","last_became_active":"2024-09-13T17:11:23.003248+0000","last_became_peered":"2024-09-13T17:11:23.003248+0000","last_unstale":"2024-09-13T17:13:49.473545+0000","last_undegraded":"2024-09-13T17:13:49.473545+0000","last_fullsized":"2024-09-13T17:13:49.473545+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:05.496872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.609476+0000","last_change":"2024-09-13T17:11:27.362880+0000","last_active":"2024-09-13T17:13:49.609476+0000","last_peered":"2024-09-13T17:13:49.609476+0000","last_clean":"2024-09-13T17:13:49.609476+0000","last_became_active":"2024-09-13T17:11:27.362471+0000","last_became_peered":"2024-09-13T17:11:27.362471+0000","last_unstale":"2024-09-13T17:13:49.609476+0000","last_undegraded":"2024-09-13T17:13:49.609476+0000","last_fullsized":"2024-09-13T17:13:49.609476+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:49.964606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"93'9","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.611837+0000","last_change":"2024-09-13T17:11:49.799023+0000","last_active":"2024-09-13T17:13:49.611837+0000","last_peered":"2024-09-13T17:13:49.611837+0000","last_clean":"2024-09-13T17:13:49.611837+0000","last_became_active":"2024-09-13T17:11:49.798724+0000","last_became_peered":"2024-09-13T17:11:49.798724+0000","last_unstale":"2024-09-13T17:13:49.611837+0000","last_undegraded":"2024-09-13T17:13:49.611837+0000","last_fullsized":"2024-09-13T17:13:49.611837+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:03.569532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,7],"acting":[0,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":23,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.609750+0000","last_change":"2024-09-13T17:11:22.999158+0000","last_active":"2024-09-13T17:13:49.609750+0000","last_peered":"2024-09-13T17:13:49.609750+0000","last_clean":"2024-09-13T17:13:49.609750+0000","last_became_active":"2024-09-13T17:11:22.998795+0000","last_became_peered":"2024-09-13T17:11:22.998795+0000","last_unstale":"2024-09-13T17:13:49.609750+0000","last_undegraded":"2024-09-13T17:13:49.609750+0000","last_fullsized":"2024-09-13T17:13:49.609750+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:23.880769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:53.429065+0000","last_change":"2024-09-13T17:12:50.484254+0000","last_active":"2024-09-13T17:12:53.429065+0000","last_peered":"2024-09-13T17:12:53.429065+0000","last_clean":"2024-09-13T17:12:53.429065+0000","last_became_active":"2024-09-13T17:12:50.483742+0000","last_became_peered":"2024-09-13T17:12:50.483742+0000","last_unstale":"2024-09-13T17:12:53.429065+0000","last_undegraded":"2024-09-13T17:12:53.429065+0000","last_fullsized":"2024-09-13T17:12:53.429065+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:59:03.266889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"93'10","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.610078+0000","last_change":"2024-09-13T17:11:23.338736+0000","last_active":"2024-09-13T17:13:49.610078+0000","last_peered":"2024-09-13T17:13:49.610078+0000","last_clean":"2024-09-13T17:13:49.610078+0000","last_became_active":"2024-09-13T17:11:23.338462+0000","last_became_peered":"2024-09-13T17:11:23.338462+0000","last_unstale":"2024-09-13T17:13:49.610078+0000","last_undegraded":"2024-09-13T17:13:49.610078+0000","last_fullsized":"2024-09-13T17:13:49.610078+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:49.221314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"93'5","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.971924+0000","last_change":"2024-09-13T17:11:23.001966+0000","last_active":"2024-09-13T17:13:49.971924+0000","last_peered":"2024-09-13T17:13:49.971924+0000","last_clean":"2024-09-13T17:13:49.971924+0000","last_became_active":"2024-09-13T17:11:23.001565+0000","last_became_peered":"2024-09-13T17:11:23.001565+0000","last_unstale":"2024-09-13T17:13:49.971924+0000","last_undegraded":"2024-09-13T17:13:49.971924+0000","last_fullsized":"2024-09-13T17:13:49.971924+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:47.240702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":123,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.383344+0000","last_change":"2024-09-13T17:11:27.360896+0000","last_active":"2024-09-13T17:13:49.383344+0000","last_peered":"2024-09-13T17:13:49.383344+0000","last_clean":"2024-09-13T17:13:49.383344+0000","last_became_active":"2024-09-13T17:11:27.360552+0000","last_became_peered":"2024-09-13T17:11:27.360552+0000","last_unstale":"2024-09-13T17:13:49.383344+0000","last_undegraded":"2024-09-13T17:13:49.383344+0000","last_fullsized":"2024-09-13T17:13:49.383344+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:08.726724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:29.121673+0000","last_change":"2024-09-13T17:11:27.356317+0000","last_active":"2024-09-13T17:13:29.121673+0000","last_peered":"2024-09-13T17:13:29.121673+0000","last_clean":"2024-09-13T17:13:29.121673+0000","last_became_active":"2024-09-13T17:11:27.355863+0000","last_became_peered":"2024-09-13T17:11:27.355863+0000","last_unstale":"2024-09-13T17:13:29.121673+0000","last_undegraded":"2024-09-13T17:13:29.121673+0000","last_fullsized":"2024-09-13T17:13:29.121673+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:29.356048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"93'11","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:18.078137+0000","last_change":"2024-09-13T17:11:23.344929+0000","last_active":"2024-09-13T17:13:18.078137+0000","last_peered":"2024-09-13T17:13:18.078137+0000","last_clean":"2024-09-13T17:13:18.078137+0000","last_became_active":"2024-09-13T17:11:23.344627+0000","last_became_peered":"2024-09-13T17:11:23.344627+0000","last_unstale":"2024-09-13T17:13:18.078137+0000","last_undegraded":"2024-09-13T17:13:18.078137+0000","last_fullsized":"2024-09-13T17:13:18.078137+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:15.049627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.473256+0000","last_change":"2024-09-13T17:11:23.002539+0000","last_active":"2024-09-13T17:13:49.473256+0000","last_peered":"2024-09-13T17:13:49.473256+0000","last_clean":"2024-09-13T17:13:49.473256+0000","last_became_active":"2024-09-13T17:11:23.002206+0000","last_became_peered":"2024-09-13T17:11:23.002206+0000","last_unstale":"2024-09-13T17:13:49.473256+0000","last_undegraded":"2024-09-13T17:13:49.473256+0000","last_fullsized":"2024-09-13T17:13:49.473256+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:57.708167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:35.023777+0000","last_change":"2024-09-13T17:11:27.362667+0000","last_active":"2024-09-13T17:13:35.023777+0000","last_peered":"2024-09-13T17:13:35.023777+0000","last_clean":"2024-09-13T17:13:35.023777+0000","last_became_active":"2024-09-13T17:11:27.362293+0000","last_became_peered":"2024-09-13T17:11:27.362293+0000","last_unstale":"2024-09-13T17:13:35.023777+0000","last_undegraded":"2024-09-13T17:13:35.023777+0000","last_fullsized":"2024-09-13T17:13:35.023777+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:24.446951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"93'8","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.383093+0000","last_change":"2024-09-13T17:11:23.335823+0000","last_active":"2024-09-13T17:13:49.383093+0000","last_peered":"2024-09-13T17:13:49.383093+0000","last_clean":"2024-09-13T17:13:49.383093+0000","last_became_active":"2024-09-13T17:11:23.335491+0000","last_became_peered":"2024-09-13T17:11:23.335491+0000","last_unstale":"2024-09-13T17:13:49.383093+0000","last_undegraded":"2024-09-13T17:13:49.383093+0000","last_fullsized":"2024-09-13T17:13:49.383093+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:42.172559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.211946+0000","last_change":"2024-09-13T17:11:22.999477+0000","last_active":"2024-09-13T17:12:50.211946+0000","last_peered":"2024-09-13T17:12:50.211946+0000","last_clean":"2024-09-13T17:12:50.211946+0000","last_became_active":"2024-09-13T17:11:22.999175+0000","last_became_peered":"2024-09-13T17:11:22.999175+0000","last_unstale":"2024-09-13T17:12:50.211946+0000","last_undegraded":"2024-09-13T17:12:50.211946+0000","last_fullsized":"2024-09-13T17:12:50.211946+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:03.817508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.220694+0000","last_change":"2024-09-13T17:12:50.220304+0000","last_active":"2024-09-13T17:12:50.220694+0000","last_peered":"2024-09-13T17:12:50.220694+0000","last_clean":"2024-09-13T17:12:50.220694+0000","last_became_active":"2024-09-13T17:12:50.216329+0000","last_became_peered":"2024-09-13T17:12:50.216329+0000","last_unstale":"2024-09-13T17:12:50.220694+0000","last_undegraded":"2024-09-13T17:12:50.220694+0000","last_fullsized":"2024-09-13T17:12:50.220694+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:18:29.389297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"93'8","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:18.084569+0000","last_change":"2024-09-13T17:11:23.337738+0000","last_active":"2024-09-13T17:13:18.084569+0000","last_peered":"2024-09-13T17:13:18.084569+0000","last_clean":"2024-09-13T17:13:18.084569+0000","last_became_active":"2024-09-13T17:11:23.337411+0000","last_became_peered":"2024-09-13T17:11:23.337411+0000","last_unstale":"2024-09-13T17:13:18.084569+0000","last_undegraded":"2024-09-13T17:13:18.084569+0000","last_fullsized":"2024-09-13T17:13:18.084569+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:02.355706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.222605+0000","last_change":"2024-09-13T17:12:50.221722+0000","last_active":"2024-09-13T17:12:50.222605+0000","last_peered":"2024-09-13T17:12:50.222605+0000","last_clean":"2024-09-13T17:12:50.222605+0000","last_became_active":"2024-09-13T17:12:50.221273+0000","last_became_peered":"2024-09-13T17:12:50.221273+0000","last_unstale":"2024-09-13T17:12:50.222605+0000","last_undegraded":"2024-09-13T17:12:50.222605+0000","last_fullsized":"2024-09-13T17:12:50.222605+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:28.617737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,8],"acting":[2,6,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"94'10","reported_seq":160,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.972857+0000","last_change":"2024-09-13T17:11:23.000544+0000","last_active":"2024-09-13T17:13:49.972857+0000","last_peered":"2024-09-13T17:13:49.972857+0000","last_clean":"2024-09-13T17:13:49.972857+0000","last_became_active":"2024-09-13T17:11:23.000233+0000","last_became_peered":"2024-09-13T17:11:23.000233+0000","last_unstale":"2024-09-13T17:13:49.972857+0000","last_undegraded":"2024-09-13T17:13:49.972857+0000","last_fullsized":"2024-09-13T17:13:49.972857+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:04.745950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2385,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"93'7","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.467025+0000","last_change":"2024-09-13T17:11:23.340104+0000","last_active":"2024-09-13T17:13:49.467025+0000","last_peered":"2024-09-13T17:13:49.467025+0000","last_clean":"2024-09-13T17:13:49.467025+0000","last_became_active":"2024-09-13T17:11:23.339826+0000","last_became_peered":"2024-09-13T17:11:23.339826+0000","last_unstale":"2024-09-13T17:13:49.467025+0000","last_undegraded":"2024-09-13T17:13:49.467025+0000","last_fullsized":"2024-09-13T17:13:49.467025+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:03.101547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.217668+0000","last_change":"2024-09-13T17:11:27.360848+0000","last_active":"2024-09-13T17:12:50.217668+0000","last_peered":"2024-09-13T17:12:50.217668+0000","last_clean":"2024-09-13T17:12:50.217668+0000","last_became_active":"2024-09-13T17:11:27.360416+0000","last_became_peered":"2024-09-13T17:11:27.360416+0000","last_unstale":"2024-09-13T17:12:50.217668+0000","last_undegraded":"2024-09-13T17:12:50.217668+0000","last_fullsized":"2024-09-13T17:12:50.217668+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:06.857649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"93'9","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:30.023108+0000","last_change":"2024-09-13T17:11:23.334723+0000","last_active":"2024-09-13T17:13:30.023108+0000","last_peered":"2024-09-13T17:13:30.023108+0000","last_clean":"2024-09-13T17:13:30.023108+0000","last_became_active":"2024-09-13T17:11:23.334433+0000","last_became_peered":"2024-09-13T17:11:23.334433+0000","last_unstale":"2024-09-13T17:13:30.023108+0000","last_undegraded":"2024-09-13T17:13:30.023108+0000","last_fullsized":"2024-09-13T17:13:30.023108+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:08.657151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"93'12","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:28.072478+0000","last_change":"2024-09-13T17:11:23.334882+0000","last_active":"2024-09-13T17:13:28.072478+0000","last_peered":"2024-09-13T17:13:28.072478+0000","last_clean":"2024-09-13T17:13:28.072478+0000","last_became_active":"2024-09-13T17:11:23.334610+0000","last_became_peered":"2024-09-13T17:11:23.334610+0000","last_unstale":"2024-09-13T17:13:28.072478+0000","last_undegraded":"2024-09-13T17:13:28.072478+0000","last_fullsized":"2024-09-13T17:13:28.072478+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:03.932181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"93'8","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:28.072501+0000","last_change":"2024-09-13T17:11:23.334076+0000","last_active":"2024-09-13T17:13:28.072501+0000","last_peered":"2024-09-13T17:13:28.072501+0000","last_clean":"2024-09-13T17:13:28.072501+0000","last_became_active":"2024-09-13T17:11:23.333801+0000","last_became_peered":"2024-09-13T17:11:23.333801+0000","last_unstale":"2024-09-13T17:13:28.072501+0000","last_undegraded":"2024-09-13T17:13:28.072501+0000","last_fullsized":"2024-09-13T17:13:28.072501+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:07.113045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"93'7","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:29.121644+0000","last_change":"2024-09-13T17:11:23.332306+0000","last_active":"2024-09-13T17:13:29.121644+0000","last_peered":"2024-09-13T17:13:29.121644+0000","last_clean":"2024-09-13T17:13:29.121644+0000","last_became_active":"2024-09-13T17:11:23.331913+0000","last_became_peered":"2024-09-13T17:11:23.331913+0000","last_unstale":"2024-09-13T17:13:29.121644+0000","last_undegraded":"2024-09-13T17:13:29.121644+0000","last_fullsized":"2024-09-13T17:13:29.121644+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:02.927286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"93'4","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:35.616049+0000","last_change":"2024-09-13T17:11:23.335512+0000","last_active":"2024-09-13T17:13:35.616049+0000","last_peered":"2024-09-13T17:13:35.616049+0000","last_clean":"2024-09-13T17:13:35.616049+0000","last_became_active":"2024-09-13T17:11:23.335201+0000","last_became_peered":"2024-09-13T17:11:23.335201+0000","last_unstale":"2024-09-13T17:13:35.616049+0000","last_undegraded":"2024-09-13T17:13:35.616049+0000","last_fullsized":"2024-09-13T17:13:35.616049+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:17.263819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"93'6","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:35.023757+0000","last_change":"2024-09-13T17:11:23.341204+0000","last_active":"2024-09-13T17:13:35.023757+0000","last_peered":"2024-09-13T17:13:35.023757+0000","last_clean":"2024-09-13T17:13:35.023757+0000","last_became_active":"2024-09-13T17:11:23.339848+0000","last_became_peered":"2024-09-13T17:11:23.339848+0000","last_unstale":"2024-09-13T17:13:35.023757+0000","last_undegraded":"2024-09-13T17:13:35.023757+0000","last_fullsized":"2024-09-13T17:13:35.023757+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:15:09.480651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"93'15","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:33.073116+0000","last_change":"2024-09-13T17:11:23.334741+0000","last_active":"2024-09-13T17:13:33.073116+0000","last_peered":"2024-09-13T17:13:33.073116+0000","last_clean":"2024-09-13T17:13:33.073116+0000","last_became_active":"2024-09-13T17:11:23.334459+0000","last_became_peered":"2024-09-13T17:11:23.334459+0000","last_unstale":"2024-09-13T17:13:33.073116+0000","last_undegraded":"2024-09-13T17:13:33.073116+0000","last_fullsized":"2024-09-13T17:13:33.073116+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:52.379735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"93'2","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:35.609866+0000","last_change":"2024-09-13T17:11:23.337869+0000","last_active":"2024-09-13T17:13:35.609866+0000","last_peered":"2024-09-13T17:13:35.609866+0000","last_clean":"2024-09-13T17:13:35.609866+0000","last_became_active":"2024-09-13T17:11:23.337581+0000","last_became_peered":"2024-09-13T17:11:23.337581+0000","last_unstale":"2024-09-13T17:13:35.609866+0000","last_undegraded":"2024-09-13T17:13:35.609866+0000","last_fullsized":"2024-09-13T17:13:35.609866+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:49.407474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"93'6","reported_seq":20,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:18.078622+0000","last_change":"2024-09-13T17:11:49.797828+0000","last_active":"2024-09-13T17:13:18.078622+0000","last_peered":"2024-09-13T17:13:18.078622+0000","last_clean":"2024-09-13T17:13:18.078622+0000","last_became_active":"2024-09-13T17:11:49.797504+0000","last_became_peered":"2024-09-13T17:11:49.797504+0000","last_unstale":"2024-09-13T17:13:18.078622+0000","last_undegraded":"2024-09-13T17:13:18.078622+0000","last_fullsized":"2024-09-13T17:13:18.078622+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:29.677936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.29","version":"93'8","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:40.610273+0000","last_change":"2024-09-13T17:11:23.336713+0000","last_active":"2024-09-13T17:13:40.610273+0000","last_peered":"2024-09-13T17:13:40.610273+0000","last_clean":"2024-09-13T17:13:40.610273+0000","last_became_active":"2024-09-13T17:11:23.336431+0000","last_became_peered":"2024-09-13T17:11:23.336431+0000","last_unstale":"2024-09-13T17:13:40.610273+0000","last_undegraded":"2024-09-13T17:13:40.610273+0000","last_fullsized":"2024-09-13T17:13:40.610273+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:52.709483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"93'10","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:40.295477+0000","last_change":"2024-09-13T17:11:23.340385+0000","last_active":"2024-09-13T17:13:40.295477+0000","last_peered":"2024-09-13T17:13:40.295477+0000","last_clean":"2024-09-13T17:13:40.295477+0000","last_became_active":"2024-09-13T17:11:23.340068+0000","last_became_peered":"2024-09-13T17:11:23.340068+0000","last_unstale":"2024-09-13T17:13:40.295477+0000","last_undegraded":"2024-09-13T17:13:40.295477+0000","last_fullsized":"2024-09-13T17:13:40.295477+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:17.795222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"93'11","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:40.616451+0000","last_change":"2024-09-13T17:11:23.329214+0000","last_active":"2024-09-13T17:13:40.616451+0000","last_peered":"2024-09-13T17:13:40.616451+0000","last_clean":"2024-09-13T17:13:40.616451+0000","last_became_active":"2024-09-13T17:11:23.328747+0000","last_became_peered":"2024-09-13T17:11:23.328747+0000","last_unstale":"2024-09-13T17:13:40.616451+0000","last_undegraded":"2024-09-13T17:13:40.616451+0000","last_fullsized":"2024-09-13T17:13:40.616451+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:11.233652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"93'8","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:40.024216+0000","last_change":"2024-09-13T17:11:23.339854+0000","last_active":"2024-09-13T17:13:40.024216+0000","last_peered":"2024-09-13T17:13:40.024216+0000","last_clean":"2024-09-13T17:13:40.024216+0000","last_became_active":"2024-09-13T17:11:23.339565+0000","last_became_peered":"2024-09-13T17:11:23.339565+0000","last_unstale":"2024-09-13T17:13:40.024216+0000","last_undegraded":"2024-09-13T17:13:40.024216+0000","last_fullsized":"2024-09-13T17:13:40.024216+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:37.161135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"93'7","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:38.073656+0000","last_change":"2024-09-13T17:11:23.342562+0000","last_active":"2024-09-13T17:13:38.073656+0000","last_peered":"2024-09-13T17:13:38.073656+0000","last_clean":"2024-09-13T17:13:38.073656+0000","last_became_active":"2024-09-13T17:11:23.342256+0000","last_became_peered":"2024-09-13T17:11:23.342256+0000","last_unstale":"2024-09-13T17:13:38.073656+0000","last_undegraded":"2024-09-13T17:13:38.073656+0000","last_fullsized":"2024-09-13T17:13:38.073656+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:30.788242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"93'10","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.464655+0000","last_change":"2024-09-13T17:11:23.342436+0000","last_active":"2024-09-13T17:13:49.464655+0000","last_peered":"2024-09-13T17:13:49.464655+0000","last_clean":"2024-09-13T17:13:49.464655+0000","last_became_active":"2024-09-13T17:11:23.342157+0000","last_became_peered":"2024-09-13T17:11:23.342157+0000","last_unstale":"2024-09-13T17:13:49.464655+0000","last_undegraded":"2024-09-13T17:13:49.464655+0000","last_fullsized":"2024-09-13T17:13:49.464655+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:56.550875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"93'8","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.609673+0000","last_change":"2024-09-13T17:11:23.341660+0000","last_active":"2024-09-13T17:13:49.609673+0000","last_peered":"2024-09-13T17:13:49.609673+0000","last_clean":"2024-09-13T17:13:49.609673+0000","last_became_active":"2024-09-13T17:11:23.341102+0000","last_became_peered":"2024-09-13T17:11:23.341102+0000","last_unstale":"2024-09-13T17:13:49.609673+0000","last_undegraded":"2024-09-13T17:13:49.609673+0000","last_fullsized":"2024-09-13T17:13:49.609673+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:00.546907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"93'9","reported_seq":30,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.608823+0000","last_change":"2024-09-13T17:11:23.338064+0000","last_active":"2024-09-13T17:13:49.608823+0000","last_peered":"2024-09-13T17:13:49.608823+0000","last_clean":"2024-09-13T17:13:49.608823+0000","last_became_active":"2024-09-13T17:11:23.337748+0000","last_became_peered":"2024-09-13T17:11:23.337748+0000","last_unstale":"2024-09-13T17:13:49.608823+0000","last_undegraded":"2024-09-13T17:13:49.608823+0000","last_fullsized":"2024-09-13T17:13:49.608823+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:14.281629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"93'7","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:44.123109+0000","last_change":"2024-09-13T17:11:23.335684+0000","last_active":"2024-09-13T17:13:44.123109+0000","last_peered":"2024-09-13T17:13:44.123109+0000","last_clean":"2024-09-13T17:13:44.123109+0000","last_became_active":"2024-09-13T17:11:23.335364+0000","last_became_peered":"2024-09-13T17:11:23.335364+0000","last_unstale":"2024-09-13T17:13:44.123109+0000","last_undegraded":"2024-09-13T17:13:44.123109+0000","last_fullsized":"2024-09-13T17:13:44.123109+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:02.288009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"93'7","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:44.123153+0000","last_change":"2024-09-13T17:11:23.340881+0000","last_active":"2024-09-13T17:13:44.123153+0000","last_peered":"2024-09-13T17:13:44.123153+0000","last_clean":"2024-09-13T17:13:44.123153+0000","last_became_active":"2024-09-13T17:11:23.340575+0000","last_became_peered":"2024-09-13T17:11:23.340575+0000","last_unstale":"2024-09-13T17:13:44.123153+0000","last_undegraded":"2024-09-13T17:13:44.123153+0000","last_fullsized":"2024-09-13T17:13:44.123153+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:40.757703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"93'10","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.401919+0000","last_change":"2024-09-13T17:11:23.329039+0000","last_active":"2024-09-13T17:13:49.401919+0000","last_peered":"2024-09-13T17:13:49.401919+0000","last_clean":"2024-09-13T17:13:49.401919+0000","last_became_active":"2024-09-13T17:11:23.328324+0000","last_became_peered":"2024-09-13T17:11:23.328324+0000","last_unstale":"2024-09-13T17:13:49.401919+0000","last_undegraded":"2024-09-13T17:13:49.401919+0000","last_fullsized":"2024-09-13T17:13:49.401919+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:37.882596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"93'7","reported_seq":27,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.609805+0000","last_change":"2024-09-13T17:11:23.345229+0000","last_active":"2024-09-13T17:13:49.609805+0000","last_peered":"2024-09-13T17:13:49.609805+0000","last_clean":"2024-09-13T17:13:49.609805+0000","last_became_active":"2024-09-13T17:11:23.344883+0000","last_became_peered":"2024-09-13T17:11:23.344883+0000","last_unstale":"2024-09-13T17:13:49.609805+0000","last_undegraded":"2024-09-13T17:13:49.609805+0000","last_fullsized":"2024-09-13T17:13:49.609805+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:47.983382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"93'6","reported_seq":26,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.610120+0000","last_change":"2024-09-13T17:11:23.346338+0000","last_active":"2024-09-13T17:13:49.610120+0000","last_peered":"2024-09-13T17:13:49.610120+0000","last_clean":"2024-09-13T17:13:49.610120+0000","last_became_active":"2024-09-13T17:11:23.344777+0000","last_became_peered":"2024-09-13T17:11:23.344777+0000","last_unstale":"2024-09-13T17:13:49.610120+0000","last_undegraded":"2024-09-13T17:13:49.610120+0000","last_fullsized":"2024-09-13T17:13:49.610120+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:23.650174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"93'16","reported_seq":46,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.383860+0000","last_change":"2024-09-13T17:11:49.798165+0000","last_active":"2024-09-13T17:13:49.383860+0000","last_peered":"2024-09-13T17:13:49.383860+0000","last_clean":"2024-09-13T17:13:49.383860+0000","last_became_active":"2024-09-13T17:11:49.797753+0000","last_became_peered":"2024-09-13T17:11:49.797753+0000","last_unstale":"2024-09-13T17:13:49.383860+0000","last_undegraded":"2024-09-13T17:13:49.383860+0000","last_fullsized":"2024-09-13T17:13:49.383860+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:51.744236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"93'11","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.610269+0000","last_change":"2024-09-13T17:11:23.340478+0000","last_active":"2024-09-13T17:13:49.610269+0000","last_peered":"2024-09-13T17:13:49.610269+0000","last_clean":"2024-09-13T17:13:49.610269+0000","last_became_active":"2024-09-13T17:11:23.339916+0000","last_became_peered":"2024-09-13T17:11:23.339916+0000","last_unstale":"2024-09-13T17:13:49.610269+0000","last_undegraded":"2024-09-13T17:13:49.610269+0000","last_fullsized":"2024-09-13T17:13:49.610269+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:09.477626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"93'9","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:18.085082+0000","last_change":"2024-09-13T17:11:23.340882+0000","last_active":"2024-09-13T17:13:18.085082+0000","last_peered":"2024-09-13T17:13:18.085082+0000","last_clean":"2024-09-13T17:13:18.085082+0000","last_became_active":"2024-09-13T17:11:23.340413+0000","last_became_peered":"2024-09-13T17:11:23.340413+0000","last_unstale":"2024-09-13T17:13:18.085082+0000","last_undegraded":"2024-09-13T17:13:18.085082+0000","last_fullsized":"2024-09-13T17:13:18.085082+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:49.040015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"93'5","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:18.082603+0000","last_change":"2024-09-13T17:11:23.345551+0000","last_active":"2024-09-13T17:13:18.082603+0000","last_peered":"2024-09-13T17:13:18.082603+0000","last_clean":"2024-09-13T17:13:18.082603+0000","last_became_active":"2024-09-13T17:11:23.345195+0000","last_became_peered":"2024-09-13T17:11:23.345195+0000","last_unstale":"2024-09-13T17:13:18.082603+0000","last_undegraded":"2024-09-13T17:13:18.082603+0000","last_fullsized":"2024-09-13T17:13:18.082603+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:00.856969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"93'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:18.081359+0000","last_change":"2024-09-13T17:11:49.799090+0000","last_active":"2024-09-13T17:13:18.081359+0000","last_peered":"2024-09-13T17:13:18.081359+0000","last_clean":"2024-09-13T17:13:18.081359+0000","last_became_active":"2024-09-13T17:11:49.798766+0000","last_became_peered":"2024-09-13T17:11:49.798766+0000","last_unstale":"2024-09-13T17:13:18.081359+0000","last_undegraded":"2024-09-13T17:13:18.081359+0000","last_fullsized":"2024-09-13T17:13:18.081359+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:43.946212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"93'4","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:18.079563+0000","last_change":"2024-09-13T17:11:23.340286+0000","last_active":"2024-09-13T17:13:18.079563+0000","last_peered":"2024-09-13T17:13:18.079563+0000","last_clean":"2024-09-13T17:13:18.079563+0000","last_became_active":"2024-09-13T17:11:23.339756+0000","last_became_peered":"2024-09-13T17:11:23.339756+0000","last_unstale":"2024-09-13T17:13:18.079563+0000","last_undegraded":"2024-09-13T17:13:18.079563+0000","last_fullsized":"2024-09-13T17:13:18.079563+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:00.463087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"93'8","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:24.552220+0000","last_change":"2024-09-13T17:11:23.339818+0000","last_active":"2024-09-13T17:13:24.552220+0000","last_peered":"2024-09-13T17:13:24.552220+0000","last_clean":"2024-09-13T17:13:24.552220+0000","last_became_active":"2024-09-13T17:11:23.339501+0000","last_became_peered":"2024-09-13T17:11:23.339501+0000","last_unstale":"2024-09-13T17:13:24.552220+0000","last_undegraded":"2024-09-13T17:13:24.552220+0000","last_fullsized":"2024-09-13T17:13:24.552220+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:36.904004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"93'7","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:29.121660+0000","last_change":"2024-09-13T17:11:23.334388+0000","last_active":"2024-09-13T17:13:29.121660+0000","last_peered":"2024-09-13T17:13:29.121660+0000","last_clean":"2024-09-13T17:13:29.121660+0000","last_became_active":"2024-09-13T17:11:23.333953+0000","last_became_peered":"2024-09-13T17:11:23.333953+0000","last_unstale":"2024-09-13T17:13:29.121660+0000","last_undegraded":"2024-09-13T17:13:29.121660+0000","last_fullsized":"2024-09-13T17:13:29.121660+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:33.929173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"93'4","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:29.121689+0000","last_change":"2024-09-13T17:11:23.338259+0000","last_active":"2024-09-13T17:13:29.121689+0000","last_peered":"2024-09-13T17:13:29.121689+0000","last_clean":"2024-09-13T17:13:29.121689+0000","last_became_active":"2024-09-13T17:11:23.337979+0000","last_became_peered":"2024-09-13T17:11:23.337979+0000","last_unstale":"2024-09-13T17:13:29.121689+0000","last_undegraded":"2024-09-13T17:13:29.121689+0000","last_fullsized":"2024-09-13T17:13:29.121689+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:55.750255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"93'8","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:30.023224+0000","last_change":"2024-09-13T17:11:23.337899+0000","last_active":"2024-09-13T17:13:30.023224+0000","last_peered":"2024-09-13T17:13:30.023224+0000","last_clean":"2024-09-13T17:13:30.023224+0000","last_became_active":"2024-09-13T17:11:23.337626+0000","last_became_peered":"2024-09-13T17:11:23.337626+0000","last_unstale":"2024-09-13T17:13:30.023224+0000","last_undegraded":"2024-09-13T17:13:30.023224+0000","last_fullsized":"2024-09-13T17:13:30.023224+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:14.654852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":599547,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":864,"num_read_kb":544,"num_write":289,"num_write_kb":1444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":1798641,"data_compressed":75906,"data_compressed_allocated":98304,"data_compressed_original":1548288,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":109077,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383722,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":1036288,"data_stored":529501,"data_compressed":26642,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54700000000000004,"15min":0.54200000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78600000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.41599999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77600000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.39500000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.45200000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.377},{"interface":"front","average":{"1min":0.629,"5min":0.60999999999999999,"15min":0.60399999999999998},"min":{"1min":0.42799999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77900000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.55800000000000005}]},{"osd":2,"last update":"Fri Sep 13 17:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.41999999999999998,"15min":0.40500000000000003},"min":{"1min":0.28499999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.73699999999999999,"5min":0.748,"15min":0.748},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.46600000000000003,"15min":0.45700000000000002},"min":{"1min":0.30099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.66800000000000004,"5min":1.286,"15min":1.286},"last":0.309}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.51200000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.82199999999999995,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.61499999999999999,"15min":0.60399999999999998},"min":{"1min":0.40500000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.46300000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.36699999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.81200000000000006,"5min":1.109,"15min":1.109},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.50900000000000001,"15min":0.48099999999999998},"min":{"1min":0.434,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.34200000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57299999999999995,"15min":0.56100000000000005},"min":{"1min":0.41899999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81200000000000006,"5min":1.214,"15min":1.214},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.60599999999999998,"15min":0.59999999999999998},"min":{"1min":0.47199999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.90300000000000002,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.44400000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.65300000000000002,"15min":0.63500000000000001},"min":{"1min":0.53100000000000003,"5min":0.502,"15min":0.502},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.68899999999999995,"15min":0.68300000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.86299999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.52300000000000002}]},{"osd":8,"last update":"Fri Sep 13 17:13:29 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.61399999999999999,"15min":0.60399999999999998},"min":{"1min":0.39900000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.64700000000000002,"15min":0.64200000000000002},"min":{"1min":0.46800000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.497}]},{"osd":9,"last update":"Fri Sep 13 17:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.65600000000000003,"15min":0.64000000000000001},"min":{"1min":0.52200000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93799999999999994,"5min":1.196,"15min":1.196},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.66700000000000004,"15min":0.63300000000000001},"min":{"1min":0.60299999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.98399999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.53400000000000003}]},{"osd":10,"last update":"Fri Sep 13 17:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.73799999999999999,"15min":0.71999999999999997},"min":{"1min":0.61699999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0409999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72299999999999998,"15min":0.71899999999999997},"min":{"1min":0.56899999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.95899999999999996,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.50700000000000001}]}]},{"osd":10,"up_from":72,"seq":309237645358,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36384,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708768,"statfs":{"total":95995035648,"available":95957778432,"internally_reserved":0,"allocated":1204224,"data_stored":1317145,"data_compressed":69157,"data_compressed_allocated":90112,"data_compressed_original":786432,"omap_allocated":1597,"internal_metadata":36043203},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:13:27 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.38800000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55200000000000005,"15min":0.55100000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.73499999999999999,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.45100000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.41799999999999998,"15min":0.42099999999999999},"min":{"1min":0.29299999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.45700000000000002,"15min":0.46100000000000002},"min":{"1min":0.33100000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.48299999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.43099999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.58299999999999996,"15min":0.57099999999999995},"min":{"1min":0.44,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78100000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.34899999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57099999999999995,"15min":0.58999999999999997},"min":{"1min":0.41399999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73499999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56799999999999995,"15min":0.58199999999999996},"min":{"1min":0.38900000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.49199999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.501,"15min":0.50900000000000001},"min":{"1min":0.38,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70399999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.52700000000000002,"15min":0.54500000000000004},"min":{"1min":0.374,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.628,"5min":0.876,"15min":0.876},"last":0.30099999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65400000000000003,"15min":0.65600000000000003},"min":{"1min":0.48999999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.86599999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.37},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.64900000000000002,"15min":0.65100000000000002},"min":{"1min":0.47899999999999998,"5min":0.44,"15min":0.44},"max":{"1min":0.82199999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.38}]},{"osd":6,"last update":"Fri Sep 13 17:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63500000000000001,"15min":0.65300000000000002},"min":{"1min":0.46200000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73599999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.623,"15min":0.63100000000000001},"min":{"1min":0.52700000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.72299999999999998,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.39100000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:12:52 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.57199999999999995}]},{"osd":8,"last update":"Fri Sep 13 17:12:10 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68300000000000005,"15min":0.68799999999999994},"min":{"1min":0.49099999999999999,"5min":0.442,"15min":0.442},"max":{"1min":0.85199999999999998,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.626},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.71899999999999997,"15min":0.72699999999999998},"min":{"1min":0.50900000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85999999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.71599999999999997}]},{"osd":9,"last update":"Fri Sep 13 17:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69499999999999995,"15min":0.70799999999999996},"min":{"1min":0.55400000000000005,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.78300000000000003,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72899999999999998,"15min":0.751},"min":{"1min":0.60299999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.83099999999999996,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.71899999999999997}]},{"osd":11,"last update":"Fri Sep 13 17:13:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.70899999999999996,"15min":0.69499999999999995},"min":{"1min":0.66200000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.86199999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70499999999999996,"15min":0.68700000000000006},"min":{"1min":0.61699999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.83099999999999996,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.54400000000000004}]}]},{"osd":9,"up_from":67,"seq":287762808883,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1077248,"data_stored":926467,"data_compressed":45788,"data_compressed_allocated":61440,"data_compressed_original":466944,"omap_allocated":1597,"internal_metadata":31848899},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.38800000000000001,"15min":0.40400000000000003},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.58799999999999997,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.40799999999999997,"15min":0.42199999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.52800000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.312}]},{"osd":1,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.432,"5min":0.374,"15min":0.374},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55100000000000005,"15min":0.56499999999999995},"min":{"1min":0.35499999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70999999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.45800000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57899999999999996,"15min":0.60299999999999998},"min":{"1min":0.38400000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80200000000000005,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56699999999999995,"15min":0.58699999999999997},"min":{"1min":0.42499999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.66400000000000003,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.57499999999999996}]},{"osd":3,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.46600000000000003,"15min":0.49399999999999999},"min":{"1min":0.28599999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54000000000000004,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.46600000000000003,"15min":0.504},"min":{"1min":0.27300000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.52200000000000002,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.33900000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56899999999999995,"15min":0.58099999999999996},"min":{"1min":0.46200000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.70499999999999996,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61899999999999999,"15min":0.63800000000000001},"min":{"1min":0.39800000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.80000000000000004,"5min":1.26,"15min":1.26},"last":0.47299999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.621,"15min":0.65300000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.70499999999999996,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.624,"15min":0.66100000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.74399999999999999,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.51200000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.49299999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.66200000000000003,"15min":0.69199999999999995},"min":{"1min":0.45100000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.77100000000000002,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.65900000000000003,"15min":0.69199999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.73599999999999999,"5min":1.018,"15min":1.018},"last":0.41699999999999998}]},{"osd":8,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.65900000000000003,"15min":0.68300000000000005},"min":{"1min":0.45700000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.76900000000000002,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.496},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.67900000000000005,"15min":0.71099999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78200000000000003,"5min":1.228,"15min":1.228},"last":0.40699999999999997}]},{"osd":10,"last update":"Fri Sep 13 17:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.65700000000000003,"15min":0.67800000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.83299999999999996,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.69199999999999995,"15min":0.71799999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.76400000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.56399999999999995}]},{"osd":11,"last update":"Fri Sep 13 17:13:29 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.628,"15min":0.622},"min":{"1min":0.57699999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.80500000000000005,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.60399999999999998,"15min":0.60099999999999998},"min":{"1min":0.501,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83099999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.55100000000000005}]}]},{"osd":8,"up_from":59,"seq":253403070521,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1073152,"data_stored":922291,"data_compressed":45788,"data_compressed_allocated":61440,"data_compressed_original":466944,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54600000000000004,"15min":0.54900000000000004},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.79600000000000004,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.627},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52300000000000002,"15min":0.53400000000000003},"min":{"1min":0.38300000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.55100000000000005}]},{"osd":1,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.57199999999999995,"15min":0.55400000000000005},"min":{"1min":0.38100000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.79700000000000004,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.57199999999999995,"15min":0.54400000000000004},"min":{"1min":0.42499999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.53300000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.434,"15min":0.42299999999999999},"min":{"1min":0.29499999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.45200000000000001,"15min":0.442},"min":{"1min":0.39000000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.626,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.66300000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.34999999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.69799999999999995,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56699999999999995,"15min":0.56399999999999995},"min":{"1min":0.41699999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.67700000000000005}]},{"osd":4,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.59699999999999998,"15min":0.57799999999999996},"min":{"1min":0.52100000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79100000000000004,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.621,"15min":0.59999999999999998},"min":{"1min":0.53500000000000003,"5min":0.313,"15min":0.313},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.60399999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.318,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.80100000000000005,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54000000000000004,"15min":0.53800000000000003},"min":{"1min":0.40699999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.755,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.69199999999999995}]},{"osd":6,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.63200000000000001,"15min":0.624},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.84399999999999997,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63900000000000001,"15min":0.64700000000000002},"min":{"1min":0.504,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.85299999999999998,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.78100000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.66700000000000004,"15min":0.65300000000000002},"min":{"1min":0.53100000000000003,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91800000000000004,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.68500000000000005,"15min":0.67100000000000004},"min":{"1min":0.52600000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93999999999999995,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.76300000000000001}]},{"osd":9,"last update":"Fri Sep 13 17:12:53 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.67200000000000004,"15min":0.66800000000000004},"min":{"1min":0.51900000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86499999999999999,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.67600000000000005,"15min":0.67500000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.77200000000000002}]},{"osd":10,"last update":"Fri Sep 13 17:13:15 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.69899999999999995,"15min":0.68300000000000005},"min":{"1min":0.54600000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.90700000000000003,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.71999999999999997,"15min":0.70299999999999996},"min":{"1min":0.57199999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91900000000000004,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.73999999999999999}]},{"osd":11,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.71099999999999997,"15min":0.70899999999999996},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.89700000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.754},{"interface":"front","average":{"1min":0.746,"5min":0.73499999999999999,"15min":0.73299999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.72099999999999997}]}]},{"osd":7,"up_from":51,"seq":219043332157,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1093632,"data_stored":1127004,"data_compressed":63001,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1587,"internal_metadata":27654605},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.39700000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.66200000000000003,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.35799999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.52500000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.379,"15min":0.36099999999999999},"min":{"1min":0.27100000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.497,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38100000000000001,"15min":0.35499999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.52800000000000002,"5min":0.623,"15min":0.623},"last":0.36199999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55100000000000005,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70399999999999996,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54700000000000004,"15min":0.51800000000000002},"min":{"1min":0.38300000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.79700000000000004,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.42199999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53100000000000003,"15min":0.50900000000000001},"min":{"1min":0.35199999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72299999999999998,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.54900000000000004,"15min":0.53800000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69699999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.40899999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.47799999999999998,"15min":0.46200000000000002},"min":{"1min":0.33600000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.60699999999999998,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.314},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45100000000000001,"15min":0.442},"min":{"1min":0.27200000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.61299999999999999,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.34399999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.59999999999999998,"15min":0.57199999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.81899999999999995,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58799999999999997,"15min":0.57599999999999996},"min":{"1min":0.42899999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.75900000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.441}]},{"osd":6,"last update":"Fri Sep 13 17:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59999999999999998,"15min":0.58199999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.75600000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61499999999999999,"15min":0.59299999999999997},"min":{"1min":0.44900000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76000000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.49399999999999999}]},{"osd":8,"last update":"Fri Sep 13 17:13:32 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64100000000000001,"15min":0.63},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.75600000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.67000000000000004,"15min":0.64800000000000002},"min":{"1min":0.52600000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.83399999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.52600000000000002}]},{"osd":9,"last update":"Fri Sep 13 17:12:55 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.67200000000000004,"15min":0.68400000000000005},"min":{"1min":0.437,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84599999999999997,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.48399999999999999,"5min":0.438,"15min":0.438},"max":{"1min":0.80600000000000005,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.48599999999999999}]},{"osd":10,"last update":"Fri Sep 13 17:13:13 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.68000000000000005,"15min":0.69599999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.80000000000000004,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65500000000000003,"15min":0.65300000000000002},"min":{"1min":0.45300000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.80700000000000005,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.503}]},{"osd":11,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.73199999999999998,"15min":0.73299999999999998},"min":{"1min":0.57999999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.85499999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.71999999999999997,"15min":0.71299999999999997},"min":{"1min":0.68400000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.83799999999999997,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.51700000000000002}]}]},{"osd":6,"up_from":46,"seq":197568495681,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1028096,"data_stored":524331,"data_compressed":26642,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:13:49 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.35099999999999998,"15min":0.33800000000000002},"min":{"1min":0.27100000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.432,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.373,"15min":0.36899999999999999},"min":{"1min":0.255,"5min":0.251,"15min":0.251},"max":{"1min":0.48299999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.32900000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:13:49 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52500000000000002,"15min":0.51000000000000001},"min":{"1min":0.32000000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.72199999999999998,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52400000000000002,"15min":0.51000000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71699999999999997,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.51300000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:13:49 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.40799999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.66300000000000003,"5min":1.095,"15min":1.095},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54500000000000004,"15min":0.52700000000000002},"min":{"1min":0.371,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69299999999999995,"5min":0.877,"15min":0.877},"last":0.39100000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:13:49 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.40999999999999998,"15min":0.41199999999999998},"min":{"1min":0.313,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.61499999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.41799999999999998,"15min":0.41199999999999998},"min":{"1min":0.30099999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52600000000000002,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.40600000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:13:49 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52500000000000002,"15min":0.50700000000000001},"min":{"1min":0.39600000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72699999999999998,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56000000000000005,"15min":0.53400000000000003},"min":{"1min":0.39000000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76900000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.746}]},{"osd":5,"last update":"Fri Sep 13 17:13:49 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.77500000000000002,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.374},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.59999999999999998},"min":{"1min":0.45100000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.77500000000000002,"5min":1.131,"15min":1.131},"last":0.52900000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:13:06 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59499999999999997,"15min":0.60299999999999998},"min":{"1min":0.41599999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.81100000000000005,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59699999999999998,"15min":0.59499999999999997},"min":{"1min":0.42899999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.76600000000000001,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.77200000000000002}]},{"osd":8,"last update":"Fri Sep 13 17:13:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.62,"15min":0.626},"min":{"1min":0.47199999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.76300000000000001,"5min":0.874,"15min":0.874},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.64500000000000002,"15min":0.64700000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.76600000000000001,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.56399999999999995}]},{"osd":9,"last update":"Fri Sep 13 17:12:53 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.59199999999999997,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.626,"15min":0.65400000000000003},"min":{"1min":0.38200000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78000000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.72199999999999998}]},{"osd":10,"last update":"Fri Sep 13 17:13:17 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.51500000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.747,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.67600000000000005,"15min":0.67800000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.747,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.79800000000000004}]},{"osd":11,"last update":"Fri Sep 13 17:13:31 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.70299999999999996,"15min":0.71599999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.78500000000000003,"5min":0.877,"15min":0.877},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.68400000000000005,"15min":0.69199999999999995},"min":{"1min":0.53300000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.80100000000000005,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.58299999999999996}]}]},{"osd":5,"up_from":38,"seq":163208757318,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1122304,"data_stored":1253213,"data_compressed":69157,"data_compressed_allocated":90112,"data_compressed_original":786432,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:13:24 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.50600000000000001,"15min":0.48399999999999999},"min":{"1min":0.35699999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.621},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.50900000000000001,"15min":0.48699999999999999},"min":{"1min":0.40100000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.57899999999999996}]},{"osd":1,"last update":"Fri Sep 13 17:13:24 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.58399999999999996,"15min":0.55500000000000005},"min":{"1min":0.441,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78300000000000003,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.40400000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.443}]},{"osd":2,"last update":"Fri Sep 13 17:13:24 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.40000000000000002,"15min":0.378},"min":{"1min":0.28899999999999998,"5min":0.222,"15min":0.222},"max":{"1min":0.56299999999999994,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.40799999999999997,"15min":0.38200000000000001},"min":{"1min":0.30199999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.61099999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.40100000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:13:24 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.53600000000000003,"15min":0.51100000000000001},"min":{"1min":0.39100000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.53500000000000003,"15min":0.51500000000000001},"min":{"1min":0.38400000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.505}]},{"osd":4,"last update":"Fri Sep 13 17:13:24 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57299999999999995,"15min":0.56200000000000006},"min":{"1min":0.374,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.60799999999999998,"15min":0.57299999999999995},"min":{"1min":0.40899999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82899999999999996,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.41799999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:13:43 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.58099999999999996,"15min":0.56899999999999995},"min":{"1min":0.53000000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.58799999999999997,"15min":0.56899999999999995},"min":{"1min":0.52000000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.79800000000000004,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.47599999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:12:59 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61099999999999999,"15min":0.60999999999999999},"min":{"1min":0.40100000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.86299999999999999,"5min":0.874,"15min":0.874},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.625,"15min":0.60999999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.43099999999999999}]},{"osd":8,"last update":"Fri Sep 13 17:13:35 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.41499999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81299999999999994,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.42599999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.46400000000000002}]},{"osd":9,"last update":"Fri Sep 13 17:12:51 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.64200000000000002,"15min":0.626},"min":{"1min":0.51000000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.63900000000000001,"15min":0.621},"min":{"1min":0.52200000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56100000000000005}]},{"osd":10,"last update":"Fri Sep 13 17:13:12 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.67000000000000004,"15min":0.64400000000000002},"min":{"1min":0.53100000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.67000000000000004,"15min":0.64200000000000002},"min":{"1min":0.502,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.53900000000000003}]}]},{"osd":4,"up_from":33,"seq":141733920843,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":1040384,"data_stored":530520,"data_compressed":26642,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:12:50 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.247},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.36599999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:12:59 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.38300000000000001,"15min":0.36499999999999999},"min":{"1min":0.28999999999999998,"5min":0.221,"15min":0.221},"max":{"1min":0.68899999999999995,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40699999999999997,"15min":0.39500000000000002},"min":{"1min":0.30299999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.61399999999999999,"5min":2.52,"15min":2.52},"last":0.28899999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:12:59 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.78000000000000003,"15min":0.63},"min":{"1min":0.41699999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.84299999999999997,"5min":15.401,"15min":15.401},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.56999999999999995,"15min":0.53200000000000003},"min":{"1min":0.40400000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83199999999999996,"5min":1.335,"15min":1.335},"last":0.40899999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:12:59 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55200000000000005,"15min":0.55400000000000005},"min":{"1min":0.372,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.77800000000000002,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.747,"15min":0.61899999999999999},"min":{"1min":0.41699999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88400000000000001,"5min":15.425000000000001,"15min":15.425000000000001},"last":0.56599999999999995}]},{"osd":5,"last update":"Fri Sep 13 17:13:25 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.63,"15min":0.58299999999999996},"min":{"1min":0.39600000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.86299999999999999,"5min":3.0790000000000002,"15min":3.0790000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.63600000000000001,"15min":0.57699999999999996},"min":{"1min":0.40999999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.80500000000000005,"5min":4.0810000000000004,"15min":4.0810000000000004},"last":0.45400000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:13:47 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57599999999999996,"15min":0.52800000000000002},"min":{"1min":0.42799999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.79600000000000004,"5min":2.6469999999999998,"15min":2.6469999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60499999999999998,"15min":0.56599999999999995},"min":{"1min":0.435,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.877,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.60099999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:13:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52000000000000002,"15min":0.497},"min":{"1min":0.45500000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.62,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53300000000000003,"15min":0.495},"min":{"1min":0.40300000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69799999999999995,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.46600000000000003}]},{"osd":8,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.67700000000000005,"15min":0.64700000000000002},"min":{"1min":0.54100000000000004,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.874,"5min":2.577,"15min":2.577},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.67000000000000004,"15min":0.65100000000000002},"min":{"1min":0.56899999999999995,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.82799999999999996,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.58199999999999996}]},{"osd":9,"last update":"Fri Sep 13 17:12:50 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":1.2509999999999999,"15min":1.4930000000000001},"min":{"1min":0.54600000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.84499999999999997,"5min":15.448,"15min":15.448},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":1.2150000000000001,"15min":1.456},"min":{"1min":0.52000000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.82099999999999995,"5min":15.385,"15min":15.385},"last":0.51100000000000001}]},{"osd":10,"last update":"Fri Sep 13 17:13:17 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65100000000000002,"15min":0.63200000000000001},"min":{"1min":0.432,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.72899999999999998,"5min":3.1259999999999999,"15min":3.1259999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68799999999999994,"15min":0.68400000000000005},"min":{"1min":0.505,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.88700000000000001,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.63700000000000001}]},{"osd":11,"last update":"Fri Sep 13 17:13:25 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.89000000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.81200000000000006,"15min":0.82399999999999995},"min":{"1min":0.56100000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91500000000000004,"5min":3.165,"15min":3.165},"last":0.503}]}]},{"osd":3,"up_from":25,"seq":107374182479,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1077248,"data_stored":1048737,"data_compressed":51944,"data_compressed_allocated":69632,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:13:41 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36199999999999999,"15min":0.32400000000000001},"min":{"1min":0.251,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.69699999999999995,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.376,"15min":0.33200000000000002},"min":{"1min":0.23200000000000001,"5min":0.19900000000000001,"15min":0.19600000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.42199999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:13:41 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55500000000000005,"15min":0.504},"min":{"1min":0.34200000000000003,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":0.76600000000000001,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55100000000000005,"15min":0.496},"min":{"1min":0.40899999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78700000000000003,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.495}]},{"osd":2,"last update":"Fri Sep 13 17:13:41 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54400000000000004,"15min":0.50600000000000001},"min":{"1min":0.40300000000000002,"5min":0.34000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71599999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56999999999999995,"15min":0.51800000000000002},"min":{"1min":0.41699999999999998,"5min":0.315,"15min":0.25900000000000001},"max":{"1min":0.82899999999999996,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.45800000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:12:56 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55800000000000005,"15min":0.52400000000000002},"min":{"1min":0.35699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.749,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56399999999999995,"15min":0.51800000000000002},"min":{"1min":0.39900000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.50900000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:13:22 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57399999999999995,"15min":0.55900000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80200000000000005,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36599999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72499999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.441}]},{"osd":6,"last update":"Fri Sep 13 17:13:44 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.44600000000000001,"15min":0.44400000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.72099999999999997,"5min":0.746,"15min":0.746},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.47199999999999998,"15min":0.44800000000000001},"min":{"1min":0.32100000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.75600000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.53700000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:13:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59499999999999997,"15min":0.58199999999999996},"min":{"1min":0.45700000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72199999999999998,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78500000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.52900000000000003}]},{"osd":8,"last update":"Fri Sep 13 17:10:26 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66400000000000003}]},{"osd":9,"last update":"Fri Sep 13 17:12:51 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.60399999999999998,"15min":0.628},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.83799999999999997,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.60999999999999999,"15min":0.64400000000000002},"min":{"1min":0.41099999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71499999999999997,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.52000000000000002}]},{"osd":10,"last update":"Fri Sep 13 17:13:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66300000000000003,"15min":0.67900000000000005},"min":{"1min":0.47399999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.84999999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.65200000000000002,"15min":0.66800000000000004},"min":{"1min":0.45000000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82699999999999996,"5min":0.87,"15min":0.87},"last":0.58699999999999997}]},{"osd":11,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67400000000000004,"15min":0.67700000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.88500000000000001,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.51000000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84899999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.60399999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411413,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1118208,"data_stored":594627,"data_compressed":26642,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:13:10 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.67500000000000004,"15min":0.70899999999999996},"min":{"1min":0.32100000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.79500000000000004,"5min":19.158999999999999,"15min":19.158999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.49299999999999999,"15min":0.47299999999999998},"min":{"1min":0.34300000000000003,"5min":0.316,"15min":0.29699999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.47099999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:13:10 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.55600000000000005,"15min":0.49299999999999999},"min":{"1min":0.35999999999999999,"5min":0.32900000000000001,"15min":0.27900000000000003},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.57799999999999996,"15min":0.495},"min":{"1min":0.42899999999999999,"5min":0.31900000000000001,"15min":0.29599999999999999},"max":{"1min":0.82699999999999996,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.41699999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54800000000000004,"15min":0.51000000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54300000000000004,"15min":0.51100000000000001},"min":{"1min":0.35399999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.49299999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:13:24 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63800000000000001,"15min":0.64000000000000001},"min":{"1min":0.49199999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.83699999999999997,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68000000000000005,"15min":0.68200000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.61099999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:13:15 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.45000000000000001,"15min":0.40799999999999997},"min":{"1min":0.33900000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.78400000000000003,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.46000000000000002,"15min":0.41299999999999998},"min":{"1min":0.36199999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.55100000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:13:41 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.58299999999999996,"15min":0.55300000000000005},"min":{"1min":0.437,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.83699999999999997,"5min":0.875,"15min":0.875},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.71399999999999997,"15min":0.59199999999999997},"min":{"1min":0.42999999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80400000000000005,"5min":19.276,"15min":19.276},"last":0.55800000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:13:29 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69699999999999995,"15min":0.69999999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.89000000000000001,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.72699999999999998,"15min":0.73399999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.85999999999999999,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.72699999999999998}]},{"osd":8,"last update":"Fri Sep 13 17:13:29 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.59199999999999997,"15min":0.55400000000000005},"min":{"1min":0.42099999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.84199999999999997,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.62,"15min":0.57999999999999996},"min":{"1min":0.41199999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86899999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.626}]},{"osd":9,"last update":"Fri Sep 13 17:12:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.65800000000000003,"15min":0.64100000000000001},"min":{"1min":0.48499999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.92700000000000005,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":1.135,"15min":1.341},"min":{"1min":0.46600000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.88,"5min":19.210999999999999,"15min":19.210999999999999},"last":0.64000000000000001}]},{"osd":10,"last update":"Fri Sep 13 17:13:15 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.69299999999999995,"15min":0.66900000000000004},"min":{"1min":0.61699999999999999,"5min":0.495,"15min":0.495},"max":{"1min":0.94199999999999995,"5min":1.01,"15min":1.01},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":1.2749999999999999,"15min":1.488},"min":{"1min":0.53900000000000003,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.90900000000000003,"5min":19.242000000000001,"15min":19.242000000000001},"last":0.67300000000000004}]},{"osd":11,"last update":"Fri Sep 13 17:13:24 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.76900000000000002,"15min":0.78100000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.89600000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.79100000000000004,"15min":0.80300000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91500000000000004,"5min":0.995,"15min":0.995},"last":0.70499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":1101824,"data_stored":592369,"data_compressed":26642,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:12:58 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.49299999999999999,"15min":0.46700000000000003},"min":{"1min":0.33300000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.68000000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.5},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.495,"15min":0.46899999999999997},"min":{"1min":0.28999999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.67400000000000004,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.35499999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:13:13 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.57699999999999996,"15min":0.52000000000000002},"min":{"1min":0.32600000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.754,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56599999999999995,"15min":0.51800000000000002},"min":{"1min":0.38400000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.748,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.49099999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:13:41 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53500000000000003,"15min":0.52300000000000002},"min":{"1min":0.309,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.77200000000000002,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55900000000000005,"15min":0.53200000000000003},"min":{"1min":0.38800000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.438}]},{"osd":4,"last update":"Fri Sep 13 17:10:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.39500000000000002,"15min":0.377},"min":{"1min":0.29199999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.62},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.38100000000000001,"15min":0.36299999999999999},"min":{"1min":0.26600000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:13:22 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.58199999999999996,"15min":0.53100000000000003},"min":{"1min":0.46300000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.82099999999999995,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.625,"5min":0.58399999999999996,"15min":0.52100000000000002},"min":{"1min":0.379,"5min":0.315,"15min":0.315},"max":{"1min":0.73699999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.45100000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:13:41 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.56799999999999995,"15min":0.53300000000000003},"min":{"1min":0.46400000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.80000000000000004,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.59399999999999997,"15min":0.57499999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.69299999999999995,"5min":0.88,"15min":0.88},"last":0.46999999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:13:06 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.50800000000000001,"15min":0.48199999999999998},"min":{"1min":0.34100000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.59899999999999998,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.505,"15min":0.48799999999999999},"min":{"1min":0.33800000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.66200000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.26800000000000002}]},{"osd":8,"last update":"Fri Sep 13 17:13:34 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63900000000000001,"15min":0.621},"min":{"1min":0.46899999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79400000000000004,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.379},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68000000000000005,"15min":0.66500000000000004},"min":{"1min":0.503,"5min":0.434,"15min":0.434},"max":{"1min":0.78200000000000003,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.39800000000000002}]},{"osd":9,"last update":"Fri Sep 13 17:12:51 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.63300000000000001,"15min":0.64100000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72199999999999998,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.68500000000000005,"15min":0.69799999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.85499999999999998,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.47899999999999998}]},{"osd":10,"last update":"Fri Sep 13 17:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.69299999999999995,"15min":0.73699999999999999},"min":{"1min":0.44700000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.69899999999999995,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.65500000000000003,"15min":0.69499999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.70999999999999996,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.41699999999999998}]},{"osd":11,"last update":"Fri Sep 13 17:13:24 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69499999999999995,"15min":0.69799999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.77600000000000002,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.79300000000000004,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.51300000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":1036288,"data_stored":515520,"data_compressed":23656,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.505,"15min":0.47699999999999998},"min":{"1min":0.36199999999999999,"5min":0.27900000000000003,"15min":0.27300000000000002},"max":{"1min":0.70699999999999996,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52300000000000002,"15min":0.49099999999999999},"min":{"1min":0.34599999999999997,"5min":0.28499999999999998,"15min":0.245},"max":{"1min":0.68799999999999994,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.58299999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:13:10 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53600000000000003,"15min":0.51000000000000001},"min":{"1min":0.35799999999999998,"5min":0.35699999999999998,"15min":0.35099999999999998},"max":{"1min":0.72099999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55500000000000005,"15min":0.51500000000000001},"min":{"1min":0.373,"5min":0.33100000000000002,"15min":0.315},"max":{"1min":0.79800000000000004,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.48499999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.377,"15min":0.371},"min":{"1min":0.27700000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.59799999999999998,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.313},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.34899999999999998,"15min":0.34200000000000003},"min":{"1min":0.26100000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.34899999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:12:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52900000000000003,"15min":0.49099999999999999},"min":{"1min":0.39100000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72699999999999998,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.54900000000000004,"15min":0.51200000000000001},"min":{"1min":0.442,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77500000000000002,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52100000000000002,"15min":0.50900000000000001},"min":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82399999999999995,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.54800000000000004,"15min":0.53000000000000003},"min":{"1min":0.42799999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80500000000000005,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.624}]},{"osd":6,"last update":"Fri Sep 13 17:13:43 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.44400000000000001,"15min":0.42199999999999999},"min":{"1min":0.28299999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.68700000000000006,"5min":0.754,"15min":0.754},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.44,"15min":0.42799999999999999},"min":{"1min":0.29399999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.65000000000000002,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.439}]},{"osd":7,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.57199999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40200000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.82499999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.38800000000000001}]},{"osd":8,"last update":"Fri Sep 13 17:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.59099999999999997,"15min":0.60299999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.75800000000000001,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.627,"15min":0.65000000000000002},"min":{"1min":0.39500000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.77500000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.54500000000000004}]},{"osd":9,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.58999999999999997,"15min":0.626},"min":{"1min":0.376,"5min":0.25,"15min":0.25},"max":{"1min":0.748,"5min":0.88,"15min":0.88},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.58899999999999997,"15min":0.621},"min":{"1min":0.374,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.81100000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.496}]},{"osd":10,"last update":"Fri Sep 13 17:13:15 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.67400000000000004,"15min":0.68999999999999995},"min":{"1min":0.47599999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84399999999999997,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.67100000000000004,"15min":0.68700000000000006},"min":{"1min":0.503,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.81799999999999995,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.46200000000000002}]},{"osd":11,"last update":"Fri Sep 13 17:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.77500000000000002,"15min":0.70199999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88,"5min":14.611000000000001,"15min":14.611000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63200000000000001,"15min":0.628},"min":{"1min":0.496,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.80100000000000005,"5min":0.874,"15min":0.874},"last":0.63900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":68128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":70659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":525100,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":134839,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":4203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":393954,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394034,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":202536,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:13:54.182 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:13:54.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.313+0000 7f8b2b7ce640 1 -- 172.21.15.87:0/3666635067 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b240ff820 msgr2=0x7f8b24103860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:54.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.313+0000 7f8b2b7ce640 1 --2- 172.21.15.87:0/3666635067 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b240ff820 0x7f8b24103860 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f8b14009930 tx=0x7f8b1402a420 comp rx=0 tx=0).stop 2024-09-13T17:13:54.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.313+0000 7f8b2b7ce640 1 -- 172.21.15.87:0/3666635067 shutdown_connections 2024-09-13T17:13:54.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.313+0000 7f8b2b7ce640 1 --2- 172.21.15.87:0/3666635067 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b24103fc0 0x7f8b2410bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.313+0000 7f8b2b7ce640 1 --2- 172.21.15.87:0/3666635067 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b240ff820 0x7f8b24103860 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.313+0000 7f8b2b7ce640 1 --2- 172.21.15.87:0/3666635067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b240fee70 0x7f8b240ff250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.313+0000 7f8b2b7ce640 1 -- 172.21.15.87:0/3666635067 >> 172.21.15.87:0/3666635067 conn(0x7f8b240fa920 msgr2=0x7f8b240fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:54.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.313+0000 7f8b2b7ce640 1 -- 172.21.15.87:0/3666635067 shutdown_connections 2024-09-13T17:13:54.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.313+0000 7f8b2b7ce640 1 -- 172.21.15.87:0/3666635067 wait complete. 2024-09-13T17:13:54.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.314+0000 7f8b2b7ce640 1 Processor -- start 2024-09-13T17:13:54.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.314+0000 7f8b2b7ce640 1 -- start start 2024-09-13T17:13:54.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.314+0000 7f8b2b7ce640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b240fee70 0x7f8b241971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:54.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.314+0000 7f8b2b7ce640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b24103fc0 0x7f8b241976e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:54.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.314+0000 7f8b2b7ce640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b24197c20 0x7f8b241a2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:54.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.314+0000 7f8b2b7ce640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b241a28c0 con 0x7f8b240fee70 2024-09-13T17:13:54.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.314+0000 7f8b2b7ce640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b241a2a30 con 0x7f8b24103fc0 2024-09-13T17:13:54.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.314+0000 7f8b2b7ce640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b241a2bf0 con 0x7f8b24197c20 2024-09-13T17:13:54.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.314+0000 7f8b2956a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b240fee70 0x7f8b241971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:54.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.314+0000 7f8b2956a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b240fee70 0x7f8b241971a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41886/0 (socket says 172.21.15.87:41886) 2024-09-13T17:13:54.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.314+0000 7f8b2956a640 1 -- 172.21.15.87:0/4043507684 learned_addr learned my addr 172.21.15.87:0/4043507684 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:54.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.314+0000 7f8b28d69640 1 --2- 172.21.15.87:0/4043507684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b24103fc0 0x7f8b241976e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:54.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.314+0000 7f8b29d6b640 1 --2- 172.21.15.87:0/4043507684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b24197c20 0x7f8b241a2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:54.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.314+0000 7f8b2956a640 1 -- 172.21.15.87:0/4043507684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b24197c20 msgr2=0x7f8b241a2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:54.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.314+0000 7f8b2956a640 1 --2- 172.21.15.87:0/4043507684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b24197c20 0x7f8b241a2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.314+0000 7f8b2956a640 1 -- 172.21.15.87:0/4043507684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b24103fc0 msgr2=0x7f8b241976e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:54.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.314+0000 7f8b2956a640 1 --2- 172.21.15.87:0/4043507684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b24103fc0 0x7f8b241976e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.314+0000 7f8b2956a640 1 -- 172.21.15.87:0/4043507684 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b14009560 con 0x7f8b240fee70 2024-09-13T17:13:54.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.314+0000 7f8b28d69640 1 --2- 172.21.15.87:0/4043507684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b24103fc0 0x7f8b241976e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:54.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.314+0000 7f8b2956a640 1 --2- 172.21.15.87:0/4043507684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b240fee70 0x7f8b241971a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f8b2000d770 tx=0x7f8b2000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:54.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.315+0000 7f8b1a7fc640 1 -- 172.21.15.87:0/4043507684 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b20009c30 con 0x7f8b240fee70 2024-09-13T17:13:54.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.315+0000 7f8b1a7fc640 1 -- 172.21.15.87:0/4043507684 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8b2000de80 con 0x7f8b240fee70 2024-09-13T17:13:54.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.315+0000 7f8b2b7ce640 1 -- 172.21.15.87:0/4043507684 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b241a2ed0 con 0x7f8b240fee70 2024-09-13T17:13:54.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.315+0000 7f8b1a7fc640 1 -- 172.21.15.87:0/4043507684 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b20004e00 con 0x7f8b240fee70 2024-09-13T17:13:54.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.315+0000 7f8b2b7ce640 1 -- 172.21.15.87:0/4043507684 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b241a32f0 con 0x7f8b240fee70 2024-09-13T17:13:54.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.316+0000 7f8b2b7ce640 1 -- 172.21.15.87:0/4043507684 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b24100340 con 0x7f8b240fee70 2024-09-13T17:13:54.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.317+0000 7f8b1a7fc640 1 -- 172.21.15.87:0/4043507684 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 24) v1 ==== 136049+0+0 (secure 0 0 0) 0x7f8b20004f60 con 0x7f8b240fee70 2024-09-13T17:13:54.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.317+0000 7f8b1a7fc640 1 --2- 172.21.15.87:0/4043507684 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8b100a1310 0x7f8b100a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:54.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.317+0000 7f8b28d69640 1 --2- 172.21.15.87:0/4043507684 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8b100a1310 0x7f8b100a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:54.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.317+0000 7f8b1a7fc640 1 -- 172.21.15.87:0/4043507684 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f8b200ccbb0 con 0x7f8b240fee70 2024-09-13T17:13:54.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.318+0000 7f8b28d69640 1 --2- 172.21.15.87:0/4043507684 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8b100a1310 0x7f8b100a37d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8b14009900 tx=0x7f8b14005a20 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:54.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.321+0000 7f8b1a7fc640 1 -- 172.21.15.87:0/4043507684 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8b20095ae0 con 0x7f8b240fee70 2024-09-13T17:13:54.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:54 smithi087 ceph-mon[30934]: Updating smithi118:/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:13:54.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:54 smithi087 ceph-mon[30934]: Updating smithi149:/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:13:54.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:54 smithi087 ceph-mon[30934]: Updating smithi087:/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:13:54.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:54 smithi087 ceph-mon[30934]: Updating smithi118:/var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T17:13:54.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:54 smithi087 ceph-mon[30934]: Updating smithi149:/var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T17:13:54.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:54 smithi087 ceph-mon[30934]: Updating smithi087:/var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T17:13:54.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:54 smithi087 ceph-mon[30934]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:13:54.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:54 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/153880072' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:13:54.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:54 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2385628682' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:13:54.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:54 smithi087 ceph-mon[30934]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-09-13T17:13:54.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.483+0000 7f8b2b7ce640 1 -- 172.21.15.87:0/4043507684 --> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b24107240 con 0x7f8b100a1310 2024-09-13T17:13:54.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.494+0000 7f8b1a7fc640 1 -- 172.21.15.87:0/4043507684 <== mgr.15507 v2:172.21.15.87:6800/157129242 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+427670 (secure 0 0 0) 0x7f8b24107240 con 0x7f8b100a1310 2024-09-13T17:13:54.501 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:13:54.503 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-13T17:13:54.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.498+0000 7f8b2b7ce640 1 -- 172.21.15.87:0/4043507684 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8b100a1310 msgr2=0x7f8b100a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:54.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.498+0000 7f8b2b7ce640 1 --2- 172.21.15.87:0/4043507684 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8b100a1310 0x7f8b100a37d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8b14009900 tx=0x7f8b14005a20 comp rx=0 tx=0).stop 2024-09-13T17:13:54.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.498+0000 7f8b2b7ce640 1 -- 172.21.15.87:0/4043507684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b240fee70 msgr2=0x7f8b241971a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:54.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.498+0000 7f8b2b7ce640 1 --2- 172.21.15.87:0/4043507684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b240fee70 0x7f8b241971a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f8b2000d770 tx=0x7f8b2000dc30 comp rx=0 tx=0).stop 2024-09-13T17:13:54.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.498+0000 7f8b2b7ce640 1 -- 172.21.15.87:0/4043507684 shutdown_connections 2024-09-13T17:13:54.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.498+0000 7f8b2b7ce640 1 --2- 172.21.15.87:0/4043507684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b24197c20 0x7f8b241a2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.498+0000 7f8b2b7ce640 1 --2- 172.21.15.87:0/4043507684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b24103fc0 0x7f8b241976e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.498+0000 7f8b2b7ce640 1 --2- 172.21.15.87:0/4043507684 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8b100a1310 0x7f8b100a37d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.498+0000 7f8b2b7ce640 1 --2- 172.21.15.87:0/4043507684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b240fee70 0x7f8b241971a0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.498+0000 7f8b2b7ce640 1 -- 172.21.15.87:0/4043507684 >> 172.21.15.87:0/4043507684 conn(0x7f8b240fa920 msgr2=0x7f8b240fbd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:54.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.498+0000 7f8b2b7ce640 1 -- 172.21.15.87:0/4043507684 shutdown_connections 2024-09-13T17:13:54.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.498+0000 7f8b2b7ce640 1 -- 172.21.15.87:0/4043507684 wait complete. 2024-09-13T17:13:54.510 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-13T17:13:53.397361+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1190149,"num_objects":66,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1000,"num_read_kb":663,"num_write":472,"num_write_kb":4384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1181900,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":869,"ondisk_log_size":869,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":377892,"kb_used_data":12704,"kb_used_omap":18,"kb_used_meta":365037,"kb_avail":1124563932,"statfs":{"total":1151940427776,"available":1151553466368,"internally_reserved":0,"allocated":13008896,"data_stored":9881725,"data_compressed":501701,"data_compressed_allocated":671744,"data_compressed_original":4194304,"omap_allocated":19109,"internal_metadata":373798235},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.986729"},"pg_stats":[{"pgid":"2.1f","version":"89'9","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:27.569619+0000","last_change":"2024-09-13T17:12:50.228849+0000","last_active":"2024-09-13T17:13:27.569619+0000","last_peered":"2024-09-13T17:13:27.569619+0000","last_clean":"2024-09-13T17:13:27.569619+0000","last_became_active":"2024-09-13T17:12:50.221697+0000","last_became_peered":"2024-09-13T17:12:50.221697+0000","last_unstale":"2024-09-13T17:13:27.569619+0000","last_undegraded":"2024-09-13T17:13:27.569619+0000","last_fullsized":"2024-09-13T17:13:27.569619+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:45.356785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"93'5","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:25.608822+0000","last_change":"2024-09-13T17:11:23.340108+0000","last_active":"2024-09-13T17:13:25.608822+0000","last_peered":"2024-09-13T17:13:25.608822+0000","last_clean":"2024-09-13T17:13:25.608822+0000","last_became_active":"2024-09-13T17:11:23.339832+0000","last_became_peered":"2024-09-13T17:11:23.339832+0000","last_unstale":"2024-09-13T17:13:25.608822+0000","last_undegraded":"2024-09-13T17:13:25.608822+0000","last_fullsized":"2024-09-13T17:13:25.608822+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:40.969448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.761732+0000","last_change":"2024-09-13T17:12:50.761228+0000","last_active":"2024-09-13T17:12:50.761732+0000","last_peered":"2024-09-13T17:12:50.761732+0000","last_clean":"2024-09-13T17:12:50.761732+0000","last_became_active":"2024-09-13T17:12:50.760842+0000","last_became_peered":"2024-09-13T17:12:50.760842+0000","last_unstale":"2024-09-13T17:12:50.761732+0000","last_undegraded":"2024-09-13T17:12:50.761732+0000","last_fullsized":"2024-09-13T17:12:50.761732+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:30.513246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,10,0],"acting":[2,3,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:25.608843+0000","last_change":"2024-09-13T17:11:23.000779+0000","last_active":"2024-09-13T17:13:25.608843+0000","last_peered":"2024-09-13T17:13:25.608843+0000","last_clean":"2024-09-13T17:13:25.608843+0000","last_became_active":"2024-09-13T17:11:23.000511+0000","last_became_peered":"2024-09-13T17:11:23.000511+0000","last_unstale":"2024-09-13T17:13:25.608843+0000","last_undegraded":"2024-09-13T17:13:25.608843+0000","last_fullsized":"2024-09-13T17:13:25.608843+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:09.802392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"93'6","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:29.121714+0000","last_change":"2024-09-13T17:11:23.333948+0000","last_active":"2024-09-13T17:13:29.121714+0000","last_peered":"2024-09-13T17:13:29.121714+0000","last_clean":"2024-09-13T17:13:29.121714+0000","last_became_active":"2024-09-13T17:11:23.333679+0000","last_became_peered":"2024-09-13T17:11:23.333679+0000","last_unstale":"2024-09-13T17:13:29.121714+0000","last_undegraded":"2024-09-13T17:13:29.121714+0000","last_fullsized":"2024-09-13T17:13:29.121714+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:10.265157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.212722+0000","last_change":"2024-09-13T17:11:27.353767+0000","last_active":"2024-09-13T17:12:50.212722+0000","last_peered":"2024-09-13T17:12:50.212722+0000","last_clean":"2024-09-13T17:12:50.212722+0000","last_became_active":"2024-09-13T17:11:27.353448+0000","last_became_peered":"2024-09-13T17:11:27.353448+0000","last_unstale":"2024-09-13T17:12:50.212722+0000","last_undegraded":"2024-09-13T17:12:50.212722+0000","last_fullsized":"2024-09-13T17:12:50.212722+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:15.948099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.217794+0000","last_change":"2024-09-13T17:11:22.999879+0000","last_active":"2024-09-13T17:12:50.217794+0000","last_peered":"2024-09-13T17:12:50.217794+0000","last_clean":"2024-09-13T17:12:50.217794+0000","last_became_active":"2024-09-13T17:11:22.999577+0000","last_became_peered":"2024-09-13T17:11:22.999577+0000","last_unstale":"2024-09-13T17:12:50.217794+0000","last_undegraded":"2024-09-13T17:12:50.217794+0000","last_fullsized":"2024-09-13T17:12:50.217794+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:48.485532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"93'9","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:18.082355+0000","last_change":"2024-09-13T17:11:23.339026+0000","last_active":"2024-09-13T17:13:18.082355+0000","last_peered":"2024-09-13T17:13:18.082355+0000","last_clean":"2024-09-13T17:13:18.082355+0000","last_became_active":"2024-09-13T17:11:23.338745+0000","last_became_peered":"2024-09-13T17:11:23.338745+0000","last_unstale":"2024-09-13T17:13:18.082355+0000","last_undegraded":"2024-09-13T17:13:18.082355+0000","last_fullsized":"2024-09-13T17:13:18.082355+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:27.455418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.213246+0000","last_change":"2024-09-13T17:11:27.363137+0000","last_active":"2024-09-13T17:12:50.213246+0000","last_peered":"2024-09-13T17:12:50.213246+0000","last_clean":"2024-09-13T17:12:50.213246+0000","last_became_active":"2024-09-13T17:11:27.362621+0000","last_became_peered":"2024-09-13T17:11:27.362621+0000","last_unstale":"2024-09-13T17:12:50.213246+0000","last_undegraded":"2024-09-13T17:12:50.213246+0000","last_fullsized":"2024-09-13T17:12:50.213246+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:35:51.492630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.226893+0000","last_change":"2024-09-13T17:12:50.226520+0000","last_active":"2024-09-13T17:12:50.226893+0000","last_peered":"2024-09-13T17:12:50.226893+0000","last_clean":"2024-09-13T17:12:50.226893+0000","last_became_active":"2024-09-13T17:12:50.223542+0000","last_became_peered":"2024-09-13T17:12:50.223542+0000","last_unstale":"2024-09-13T17:12:50.226893+0000","last_undegraded":"2024-09-13T17:12:50.226893+0000","last_fullsized":"2024-09-13T17:12:50.226893+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:38.064047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"93'15","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:18.077694+0000","last_change":"2024-09-13T17:11:23.336778+0000","last_active":"2024-09-13T17:13:18.077694+0000","last_peered":"2024-09-13T17:13:18.077694+0000","last_clean":"2024-09-13T17:13:18.077694+0000","last_became_active":"2024-09-13T17:11:23.336491+0000","last_became_peered":"2024-09-13T17:11:23.336491+0000","last_unstale":"2024-09-13T17:13:18.077694+0000","last_undegraded":"2024-09-13T17:13:18.077694+0000","last_fullsized":"2024-09-13T17:13:18.077694+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:02.045912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.213069+0000","last_change":"2024-09-13T17:11:27.361454+0000","last_active":"2024-09-13T17:12:50.213069+0000","last_peered":"2024-09-13T17:12:50.213069+0000","last_clean":"2024-09-13T17:12:50.213069+0000","last_became_active":"2024-09-13T17:11:27.360980+0000","last_became_peered":"2024-09-13T17:11:27.360980+0000","last_unstale":"2024-09-13T17:12:50.213069+0000","last_undegraded":"2024-09-13T17:12:50.213069+0000","last_fullsized":"2024-09-13T17:12:50.213069+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:36.036426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"93'5","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:33.513046+0000","last_change":"2024-09-13T17:11:23.334073+0000","last_active":"2024-09-13T17:13:33.513046+0000","last_peered":"2024-09-13T17:13:33.513046+0000","last_clean":"2024-09-13T17:13:33.513046+0000","last_became_active":"2024-09-13T17:11:23.333628+0000","last_became_peered":"2024-09-13T17:11:23.333628+0000","last_unstale":"2024-09-13T17:13:33.513046+0000","last_undegraded":"2024-09-13T17:13:33.513046+0000","last_fullsized":"2024-09-13T17:13:33.513046+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:18.561346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:38.434680+0000","last_change":"2024-09-13T17:12:50.229697+0000","last_active":"2024-09-13T17:13:38.434680+0000","last_peered":"2024-09-13T17:13:38.434680+0000","last_clean":"2024-09-13T17:13:38.434680+0000","last_became_active":"2024-09-13T17:12:50.224286+0000","last_became_peered":"2024-09-13T17:12:50.224286+0000","last_unstale":"2024-09-13T17:13:38.434680+0000","last_undegraded":"2024-09-13T17:13:38.434680+0000","last_fullsized":"2024-09-13T17:13:38.434680+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:42.724176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.609612+0000","last_change":"2024-09-13T17:11:27.355472+0000","last_active":"2024-09-13T17:13:49.609612+0000","last_peered":"2024-09-13T17:13:49.609612+0000","last_clean":"2024-09-13T17:13:49.609612+0000","last_became_active":"2024-09-13T17:11:27.355065+0000","last_became_peered":"2024-09-13T17:11:27.355065+0000","last_unstale":"2024-09-13T17:13:49.609612+0000","last_undegraded":"2024-09-13T17:13:49.609612+0000","last_fullsized":"2024-09-13T17:13:49.609612+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:03.881097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"93'8","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:40.610299+0000","last_change":"2024-09-13T17:11:23.340268+0000","last_active":"2024-09-13T17:13:40.610299+0000","last_peered":"2024-09-13T17:13:40.610299+0000","last_clean":"2024-09-13T17:13:40.610299+0000","last_became_active":"2024-09-13T17:11:23.339977+0000","last_became_peered":"2024-09-13T17:11:23.339977+0000","last_unstale":"2024-09-13T17:13:40.610299+0000","last_undegraded":"2024-09-13T17:13:40.610299+0000","last_fullsized":"2024-09-13T17:13:40.610299+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:21.067899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"94'2","reported_seq":24,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.385251+0000","last_change":"2024-09-13T17:11:23.000858+0000","last_active":"2024-09-13T17:13:49.385251+0000","last_peered":"2024-09-13T17:13:49.385251+0000","last_clean":"2024-09-13T17:13:49.385251+0000","last_became_active":"2024-09-13T17:11:23.000536+0000","last_became_peered":"2024-09-13T17:11:23.000536+0000","last_unstale":"2024-09-13T17:13:49.385251+0000","last_undegraded":"2024-09-13T17:13:49.385251+0000","last_fullsized":"2024-09-13T17:13:49.385251+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:28.798579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":19,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.609588+0000","last_change":"2024-09-13T17:11:27.354018+0000","last_active":"2024-09-13T17:13:49.609588+0000","last_peered":"2024-09-13T17:13:49.609588+0000","last_clean":"2024-09-13T17:13:49.609588+0000","last_became_active":"2024-09-13T17:11:27.353519+0000","last_became_peered":"2024-09-13T17:11:27.353519+0000","last_unstale":"2024-09-13T17:13:49.609588+0000","last_undegraded":"2024-09-13T17:13:49.609588+0000","last_fullsized":"2024-09-13T17:13:49.609588+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:55.227851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"93'9","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:35.023706+0000","last_change":"2024-09-13T17:11:23.335798+0000","last_active":"2024-09-13T17:13:35.023706+0000","last_peered":"2024-09-13T17:13:35.023706+0000","last_clean":"2024-09-13T17:13:35.023706+0000","last_became_active":"2024-09-13T17:11:23.335445+0000","last_became_peered":"2024-09-13T17:11:23.335445+0000","last_unstale":"2024-09-13T17:13:35.023706+0000","last_undegraded":"2024-09-13T17:13:35.023706+0000","last_fullsized":"2024-09-13T17:13:35.023706+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:53.242067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:35.609814+0000","last_change":"2024-09-13T17:11:22.994118+0000","last_active":"2024-09-13T17:13:35.609814+0000","last_peered":"2024-09-13T17:13:35.609814+0000","last_clean":"2024-09-13T17:13:35.609814+0000","last_became_active":"2024-09-13T17:11:22.993801+0000","last_became_peered":"2024-09-13T17:11:22.993801+0000","last_unstale":"2024-09-13T17:13:35.609814+0000","last_undegraded":"2024-09-13T17:13:35.609814+0000","last_fullsized":"2024-09-13T17:13:35.609814+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:01.382130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:42.571068+0000","last_change":"2024-09-13T17:11:27.358795+0000","last_active":"2024-09-13T17:13:42.571068+0000","last_peered":"2024-09-13T17:13:42.571068+0000","last_clean":"2024-09-13T17:13:42.571068+0000","last_became_active":"2024-09-13T17:11:27.358166+0000","last_became_peered":"2024-09-13T17:11:27.358166+0000","last_unstale":"2024-09-13T17:13:42.571068+0000","last_undegraded":"2024-09-13T17:13:42.571068+0000","last_fullsized":"2024-09-13T17:13:42.571068+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:23.787842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"93'2","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:33.433908+0000","last_change":"2024-09-13T17:11:23.340671+0000","last_active":"2024-09-13T17:13:33.433908+0000","last_peered":"2024-09-13T17:13:33.433908+0000","last_clean":"2024-09-13T17:13:33.433908+0000","last_became_active":"2024-09-13T17:11:23.340360+0000","last_became_peered":"2024-09-13T17:11:23.340360+0000","last_unstale":"2024-09-13T17:13:33.433908+0000","last_undegraded":"2024-09-13T17:13:33.433908+0000","last_fullsized":"2024-09-13T17:13:33.433908+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:17.875171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:35.294965+0000","last_change":"2024-09-13T17:11:22.993039+0000","last_active":"2024-09-13T17:13:35.294965+0000","last_peered":"2024-09-13T17:13:35.294965+0000","last_clean":"2024-09-13T17:13:35.294965+0000","last_became_active":"2024-09-13T17:11:22.992701+0000","last_became_peered":"2024-09-13T17:11:22.992701+0000","last_unstale":"2024-09-13T17:13:35.294965+0000","last_undegraded":"2024-09-13T17:13:35.294965+0000","last_fullsized":"2024-09-13T17:13:35.294965+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:28.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.609970+0000","last_change":"2024-09-13T17:11:27.363834+0000","last_active":"2024-09-13T17:13:49.609970+0000","last_peered":"2024-09-13T17:13:49.609970+0000","last_clean":"2024-09-13T17:13:49.609970+0000","last_became_active":"2024-09-13T17:11:27.363425+0000","last_became_peered":"2024-09-13T17:11:27.363425+0000","last_unstale":"2024-09-13T17:13:49.609970+0000","last_undegraded":"2024-09-13T17:13:49.609970+0000","last_fullsized":"2024-09-13T17:13:49.609970+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:37.389881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"93'7","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:34.122246+0000","last_change":"2024-09-13T17:11:23.337423+0000","last_active":"2024-09-13T17:13:34.122246+0000","last_peered":"2024-09-13T17:13:34.122246+0000","last_clean":"2024-09-13T17:13:34.122246+0000","last_became_active":"2024-09-13T17:11:23.337167+0000","last_became_peered":"2024-09-13T17:11:23.337167+0000","last_unstale":"2024-09-13T17:13:34.122246+0000","last_undegraded":"2024-09-13T17:13:34.122246+0000","last_fullsized":"2024-09-13T17:13:34.122246+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:28.540283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:34.553531+0000","last_change":"2024-09-13T17:11:23.000486+0000","last_active":"2024-09-13T17:13:34.553531+0000","last_peered":"2024-09-13T17:13:34.553531+0000","last_clean":"2024-09-13T17:13:34.553531+0000","last_became_active":"2024-09-13T17:11:23.000158+0000","last_became_peered":"2024-09-13T17:11:23.000158+0000","last_unstale":"2024-09-13T17:13:34.553531+0000","last_undegraded":"2024-09-13T17:13:34.553531+0000","last_fullsized":"2024-09-13T17:13:34.553531+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:42.635037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:33.073032+0000","last_change":"2024-09-13T17:11:27.355058+0000","last_active":"2024-09-13T17:13:33.073032+0000","last_peered":"2024-09-13T17:13:33.073032+0000","last_clean":"2024-09-13T17:13:33.073032+0000","last_became_active":"2024-09-13T17:11:27.354726+0000","last_became_peered":"2024-09-13T17:11:27.354726+0000","last_unstale":"2024-09-13T17:13:33.073032+0000","last_undegraded":"2024-09-13T17:13:33.073032+0000","last_fullsized":"2024-09-13T17:13:33.073032+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:58.450122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"93'5","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:35.609884+0000","last_change":"2024-09-13T17:11:23.337245+0000","last_active":"2024-09-13T17:13:35.609884+0000","last_peered":"2024-09-13T17:13:35.609884+0000","last_clean":"2024-09-13T17:13:35.609884+0000","last_became_active":"2024-09-13T17:11:23.336956+0000","last_became_peered":"2024-09-13T17:11:23.336956+0000","last_unstale":"2024-09-13T17:13:35.609884+0000","last_undegraded":"2024-09-13T17:13:35.609884+0000","last_fullsized":"2024-09-13T17:13:35.609884+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:46.876149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"94'42","reported_seq":87,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.582838+0000","last_change":"2024-09-13T17:11:22.999942+0000","last_active":"2024-09-13T17:13:49.582838+0000","last_peered":"2024-09-13T17:13:49.582838+0000","last_clean":"2024-09-13T17:13:49.582838+0000","last_became_active":"2024-09-13T17:11:22.999653+0000","last_became_peered":"2024-09-13T17:11:22.999653+0000","last_unstale":"2024-09-13T17:13:49.582838+0000","last_undegraded":"2024-09-13T17:13:49.582838+0000","last_fullsized":"2024-09-13T17:13:49.582838+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:29.400939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":75,"num_write_kb":835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:30.609223+0000","last_change":"2024-09-13T17:11:27.356479+0000","last_active":"2024-09-13T17:13:30.609223+0000","last_peered":"2024-09-13T17:13:30.609223+0000","last_clean":"2024-09-13T17:13:30.609223+0000","last_became_active":"2024-09-13T17:11:27.356052+0000","last_became_peered":"2024-09-13T17:11:27.356052+0000","last_unstale":"2024-09-13T17:13:30.609223+0000","last_undegraded":"2024-09-13T17:13:30.609223+0000","last_fullsized":"2024-09-13T17:13:30.609223+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:42.173376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"93'9","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:30.615414+0000","last_change":"2024-09-13T17:11:23.333786+0000","last_active":"2024-09-13T17:13:30.615414+0000","last_peered":"2024-09-13T17:13:30.615414+0000","last_clean":"2024-09-13T17:13:30.615414+0000","last_became_active":"2024-09-13T17:11:23.333472+0000","last_became_peered":"2024-09-13T17:11:23.333472+0000","last_unstale":"2024-09-13T17:13:30.615414+0000","last_undegraded":"2024-09-13T17:13:30.615414+0000","last_fullsized":"2024-09-13T17:13:30.615414+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:41.633228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:28.433423+0000","last_change":"2024-09-13T17:11:22.998646+0000","last_active":"2024-09-13T17:13:28.433423+0000","last_peered":"2024-09-13T17:13:28.433423+0000","last_clean":"2024-09-13T17:13:28.433423+0000","last_became_active":"2024-09-13T17:11:22.998291+0000","last_became_peered":"2024-09-13T17:11:22.998291+0000","last_unstale":"2024-09-13T17:13:28.433423+0000","last_undegraded":"2024-09-13T17:13:28.433423+0000","last_fullsized":"2024-09-13T17:13:28.433423+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:20.658436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:35.023722+0000","last_change":"2024-09-13T17:11:27.361174+0000","last_active":"2024-09-13T17:13:35.023722+0000","last_peered":"2024-09-13T17:13:35.023722+0000","last_clean":"2024-09-13T17:13:35.023722+0000","last_became_active":"2024-09-13T17:11:27.360737+0000","last_became_peered":"2024-09-13T17:11:27.360737+0000","last_unstale":"2024-09-13T17:13:35.023722+0000","last_undegraded":"2024-09-13T17:13:35.023722+0000","last_fullsized":"2024-09-13T17:13:35.023722+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:00.941364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"93'4","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:29.461649+0000","last_change":"2024-09-13T17:11:23.338545+0000","last_active":"2024-09-13T17:13:29.461649+0000","last_peered":"2024-09-13T17:13:29.461649+0000","last_clean":"2024-09-13T17:13:29.461649+0000","last_became_active":"2024-09-13T17:11:23.338246+0000","last_became_peered":"2024-09-13T17:11:23.338246+0000","last_unstale":"2024-09-13T17:13:29.461649+0000","last_undegraded":"2024-09-13T17:13:29.461649+0000","last_fullsized":"2024-09-13T17:13:29.461649+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:18.966658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:27.569578+0000","last_change":"2024-09-13T17:11:22.993497+0000","last_active":"2024-09-13T17:13:27.569578+0000","last_peered":"2024-09-13T17:13:27.569578+0000","last_clean":"2024-09-13T17:13:27.569578+0000","last_became_active":"2024-09-13T17:11:22.993165+0000","last_became_peered":"2024-09-13T17:11:22.993165+0000","last_unstale":"2024-09-13T17:13:27.569578+0000","last_undegraded":"2024-09-13T17:13:27.569578+0000","last_fullsized":"2024-09-13T17:13:27.569578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:20.997834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:33.433950+0000","last_change":"2024-09-13T17:11:27.364652+0000","last_active":"2024-09-13T17:13:33.433950+0000","last_peered":"2024-09-13T17:13:33.433950+0000","last_clean":"2024-09-13T17:13:33.433950+0000","last_became_active":"2024-09-13T17:11:27.364245+0000","last_became_peered":"2024-09-13T17:11:27.364245+0000","last_unstale":"2024-09-13T17:13:33.433950+0000","last_undegraded":"2024-09-13T17:13:33.433950+0000","last_fullsized":"2024-09-13T17:13:33.433950+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:23.048289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"93'7","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:29.461627+0000","last_change":"2024-09-13T17:11:23.335649+0000","last_active":"2024-09-13T17:13:29.461627+0000","last_peered":"2024-09-13T17:13:29.461627+0000","last_clean":"2024-09-13T17:13:29.461627+0000","last_became_active":"2024-09-13T17:11:23.335364+0000","last_became_peered":"2024-09-13T17:11:23.335364+0000","last_unstale":"2024-09-13T17:13:29.461627+0000","last_undegraded":"2024-09-13T17:13:29.461627+0000","last_fullsized":"2024-09-13T17:13:29.461627+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.447947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:28.512345+0000","last_change":"2024-09-13T17:11:23.003188+0000","last_active":"2024-09-13T17:13:28.512345+0000","last_peered":"2024-09-13T17:13:28.512345+0000","last_clean":"2024-09-13T17:13:28.512345+0000","last_became_active":"2024-09-13T17:11:23.002858+0000","last_became_peered":"2024-09-13T17:11:23.002858+0000","last_unstale":"2024-09-13T17:13:28.512345+0000","last_undegraded":"2024-09-13T17:13:28.512345+0000","last_fullsized":"2024-09-13T17:13:28.512345+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:34.153326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:35.616036+0000","last_change":"2024-09-13T17:11:27.353320+0000","last_active":"2024-09-13T17:13:35.616036+0000","last_peered":"2024-09-13T17:13:35.616036+0000","last_clean":"2024-09-13T17:13:35.616036+0000","last_became_active":"2024-09-13T17:11:27.352947+0000","last_became_peered":"2024-09-13T17:11:27.352947+0000","last_unstale":"2024-09-13T17:13:35.616036+0000","last_undegraded":"2024-09-13T17:13:35.616036+0000","last_fullsized":"2024-09-13T17:13:35.616036+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:04.619618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"93'8","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:27.047981+0000","last_change":"2024-09-13T17:11:23.330128+0000","last_active":"2024-09-13T17:13:27.047981+0000","last_peered":"2024-09-13T17:13:27.047981+0000","last_clean":"2024-09-13T17:13:27.047981+0000","last_became_active":"2024-09-13T17:11:23.329266+0000","last_became_peered":"2024-09-13T17:11:23.329266+0000","last_unstale":"2024-09-13T17:13:27.047981+0000","last_undegraded":"2024-09-13T17:13:27.047981+0000","last_fullsized":"2024-09-13T17:13:27.047981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:36.275352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"93'5","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.401642+0000","last_change":"2024-09-13T17:11:23.003495+0000","last_active":"2024-09-13T17:13:49.401642+0000","last_peered":"2024-09-13T17:13:49.401642+0000","last_clean":"2024-09-13T17:13:49.401642+0000","last_became_active":"2024-09-13T17:11:23.003186+0000","last_became_peered":"2024-09-13T17:11:23.003186+0000","last_unstale":"2024-09-13T17:13:49.401642+0000","last_undegraded":"2024-09-13T17:13:49.401642+0000","last_fullsized":"2024-09-13T17:13:49.401642+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:23.353587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":123,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:40.616521+0000","last_change":"2024-09-13T17:11:27.362233+0000","last_active":"2024-09-13T17:13:40.616521+0000","last_peered":"2024-09-13T17:13:40.616521+0000","last_clean":"2024-09-13T17:13:40.616521+0000","last_became_active":"2024-09-13T17:11:27.361814+0000","last_became_peered":"2024-09-13T17:11:27.361814+0000","last_unstale":"2024-09-13T17:13:40.616521+0000","last_undegraded":"2024-09-13T17:13:40.616521+0000","last_fullsized":"2024-09-13T17:13:40.616521+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:20.723366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"93'5","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:30.615308+0000","last_change":"2024-09-13T17:11:23.332870+0000","last_active":"2024-09-13T17:13:30.615308+0000","last_peered":"2024-09-13T17:13:30.615308+0000","last_clean":"2024-09-13T17:13:30.615308+0000","last_became_active":"2024-09-13T17:11:23.332583+0000","last_became_peered":"2024-09-13T17:11:23.332583+0000","last_unstale":"2024-09-13T17:13:30.615308+0000","last_undegraded":"2024-09-13T17:13:30.615308+0000","last_fullsized":"2024-09-13T17:13:30.615308+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:22.607666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:23.511795+0000","last_change":"2024-09-13T17:11:23.001932+0000","last_active":"2024-09-13T17:13:23.511795+0000","last_peered":"2024-09-13T17:13:23.511795+0000","last_clean":"2024-09-13T17:13:23.511795+0000","last_became_active":"2024-09-13T17:11:23.001642+0000","last_became_peered":"2024-09-13T17:11:23.001642+0000","last_unstale":"2024-09-13T17:13:23.511795+0000","last_undegraded":"2024-09-13T17:13:23.511795+0000","last_fullsized":"2024-09-13T17:13:23.511795+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:05.976897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:37.049232+0000","last_change":"2024-09-13T17:11:27.359679+0000","last_active":"2024-09-13T17:13:37.049232+0000","last_peered":"2024-09-13T17:13:37.049232+0000","last_clean":"2024-09-13T17:13:37.049232+0000","last_became_active":"2024-09-13T17:11:27.359268+0000","last_became_peered":"2024-09-13T17:11:27.359268+0000","last_unstale":"2024-09-13T17:13:37.049232+0000","last_undegraded":"2024-09-13T17:13:37.049232+0000","last_fullsized":"2024-09-13T17:13:37.049232+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:48.154917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"93'8","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:30.609274+0000","last_change":"2024-09-13T17:11:23.340031+0000","last_active":"2024-09-13T17:13:30.609274+0000","last_peered":"2024-09-13T17:13:30.609274+0000","last_clean":"2024-09-13T17:13:30.609274+0000","last_became_active":"2024-09-13T17:11:23.339768+0000","last_became_peered":"2024-09-13T17:11:23.339768+0000","last_unstale":"2024-09-13T17:13:30.609274+0000","last_undegraded":"2024-09-13T17:13:30.609274+0000","last_fullsized":"2024-09-13T17:13:30.609274+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:22.360526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:29.552779+0000","last_change":"2024-09-13T17:11:22.995060+0000","last_active":"2024-09-13T17:13:29.552779+0000","last_peered":"2024-09-13T17:13:29.552779+0000","last_clean":"2024-09-13T17:13:29.552779+0000","last_became_active":"2024-09-13T17:11:22.991949+0000","last_became_peered":"2024-09-13T17:11:22.991949+0000","last_unstale":"2024-09-13T17:13:29.552779+0000","last_undegraded":"2024-09-13T17:13:29.552779+0000","last_fullsized":"2024-09-13T17:13:29.552779+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:44.716753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":344,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:03.509232+0000","last_change":"2024-09-13T17:10:13.439723+0000","last_active":"2024-09-13T17:13:03.509232+0000","last_peered":"2024-09-13T17:13:03.509232+0000","last_clean":"2024-09-13T17:13:03.509232+0000","last_became_active":"2024-09-13T17:10:13.439290+0000","last_became_peered":"2024-09-13T17:10:13.439290+0000","last_unstale":"2024-09-13T17:13:03.509232+0000","last_undegraded":"2024-09-13T17:13:03.509232+0000","last_fullsized":"2024-09-13T17:13:03.509232+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:03.041486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:03.041486+0000","last_clean_scrub_stamp":"2024-09-13T17:07:03.041486+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:08.673571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":19,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:33.513108+0000","last_change":"2024-09-13T17:11:27.361028+0000","last_active":"2024-09-13T17:13:33.513108+0000","last_peered":"2024-09-13T17:13:33.513108+0000","last_clean":"2024-09-13T17:13:33.513108+0000","last_became_active":"2024-09-13T17:11:27.360630+0000","last_became_peered":"2024-09-13T17:11:27.360630+0000","last_unstale":"2024-09-13T17:13:33.513108+0000","last_undegraded":"2024-09-13T17:13:33.513108+0000","last_fullsized":"2024-09-13T17:13:33.513108+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:40:40.860443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"93'7","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:38.513709+0000","last_change":"2024-09-13T17:11:49.798729+0000","last_active":"2024-09-13T17:13:38.513709+0000","last_peered":"2024-09-13T17:13:38.513709+0000","last_clean":"2024-09-13T17:13:38.513709+0000","last_became_active":"2024-09-13T17:11:49.798402+0000","last_became_peered":"2024-09-13T17:11:49.798402+0000","last_unstale":"2024-09-13T17:13:38.513709+0000","last_undegraded":"2024-09-13T17:13:38.513709+0000","last_fullsized":"2024-09-13T17:13:38.513709+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:58.948813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,11],"acting":[7,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":20,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.213151+0000","last_change":"2024-09-13T17:11:49.802654+0000","last_active":"2024-09-13T17:12:50.213151+0000","last_peered":"2024-09-13T17:12:50.213151+0000","last_clean":"2024-09-13T17:12:50.213151+0000","last_became_active":"2024-09-13T17:11:49.797574+0000","last_became_peered":"2024-09-13T17:11:49.797574+0000","last_unstale":"2024-09-13T17:12:50.213151+0000","last_undegraded":"2024-09-13T17:12:50.213151+0000","last_fullsized":"2024-09-13T17:12:50.213151+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:08.827045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:40.295461+0000","last_change":"2024-09-13T17:11:27.360372+0000","last_active":"2024-09-13T17:13:40.295461+0000","last_peered":"2024-09-13T17:13:40.295461+0000","last_clean":"2024-09-13T17:13:40.295461+0000","last_became_active":"2024-09-13T17:11:27.359990+0000","last_became_peered":"2024-09-13T17:11:27.359990+0000","last_unstale":"2024-09-13T17:13:40.295461+0000","last_undegraded":"2024-09-13T17:13:40.295461+0000","last_fullsized":"2024-09-13T17:13:40.295461+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:26.970317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"93'6","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:38.513682+0000","last_change":"2024-09-13T17:11:23.336269+0000","last_active":"2024-09-13T17:13:38.513682+0000","last_peered":"2024-09-13T17:13:38.513682+0000","last_clean":"2024-09-13T17:13:38.513682+0000","last_became_active":"2024-09-13T17:11:23.335921+0000","last_became_peered":"2024-09-13T17:11:23.335921+0000","last_unstale":"2024-09-13T17:13:38.513682+0000","last_undegraded":"2024-09-13T17:13:38.513682+0000","last_fullsized":"2024-09-13T17:13:38.513682+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:43.035927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"94'39","reported_seq":68,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.576625+0000","last_change":"2024-09-13T17:11:23.002491+0000","last_active":"2024-09-13T17:13:49.576625+0000","last_peered":"2024-09-13T17:13:49.576625+0000","last_clean":"2024-09-13T17:13:49.576625+0000","last_became_active":"2024-09-13T17:11:23.002178+0000","last_became_peered":"2024-09-13T17:11:23.002178+0000","last_unstale":"2024-09-13T17:13:49.576625+0000","last_undegraded":"2024-09-13T17:13:49.576625+0000","last_fullsized":"2024-09-13T17:13:49.576625+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:06.056639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:44.123173+0000","last_change":"2024-09-13T17:11:27.355153+0000","last_active":"2024-09-13T17:13:44.123173+0000","last_peered":"2024-09-13T17:13:44.123173+0000","last_clean":"2024-09-13T17:13:44.123173+0000","last_became_active":"2024-09-13T17:11:27.354701+0000","last_became_peered":"2024-09-13T17:11:27.354701+0000","last_unstale":"2024-09-13T17:13:44.123173+0000","last_undegraded":"2024-09-13T17:13:44.123173+0000","last_fullsized":"2024-09-13T17:13:44.123173+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:34.924402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"93'9","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:38.513730+0000","last_change":"2024-09-13T17:11:23.342067+0000","last_active":"2024-09-13T17:13:38.513730+0000","last_peered":"2024-09-13T17:13:38.513730+0000","last_clean":"2024-09-13T17:13:38.513730+0000","last_became_active":"2024-09-13T17:11:23.341736+0000","last_became_peered":"2024-09-13T17:11:23.341736+0000","last_unstale":"2024-09-13T17:13:38.513730+0000","last_undegraded":"2024-09-13T17:13:38.513730+0000","last_fullsized":"2024-09-13T17:13:38.513730+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:03.114638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:40.616506+0000","last_change":"2024-09-13T17:11:23.002849+0000","last_active":"2024-09-13T17:13:40.616506+0000","last_peered":"2024-09-13T17:13:40.616506+0000","last_clean":"2024-09-13T17:13:40.616506+0000","last_became_active":"2024-09-13T17:11:23.002562+0000","last_became_peered":"2024-09-13T17:11:23.002562+0000","last_unstale":"2024-09-13T17:13:40.616506+0000","last_undegraded":"2024-09-13T17:13:40.616506+0000","last_fullsized":"2024-09-13T17:13:40.616506+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:11:24.650510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:37.049118+0000","last_change":"2024-09-13T17:11:27.359343+0000","last_active":"2024-09-13T17:13:37.049118+0000","last_peered":"2024-09-13T17:13:37.049118+0000","last_clean":"2024-09-13T17:13:37.049118+0000","last_became_active":"2024-09-13T17:11:27.358628+0000","last_became_peered":"2024-09-13T17:11:27.358628+0000","last_unstale":"2024-09-13T17:13:37.049118+0000","last_undegraded":"2024-09-13T17:13:37.049118+0000","last_fullsized":"2024-09-13T17:13:37.049118+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:39.584184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"93'5","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:40.024237+0000","last_change":"2024-09-13T17:11:23.333111+0000","last_active":"2024-09-13T17:13:40.024237+0000","last_peered":"2024-09-13T17:13:40.024237+0000","last_clean":"2024-09-13T17:13:40.024237+0000","last_became_active":"2024-09-13T17:11:23.332734+0000","last_became_peered":"2024-09-13T17:11:23.332734+0000","last_unstale":"2024-09-13T17:13:40.024237+0000","last_undegraded":"2024-09-13T17:13:40.024237+0000","last_fullsized":"2024-09-13T17:13:40.024237+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:44.628106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"91'2","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:38.434730+0000","last_change":"2024-09-13T17:11:23.000759+0000","last_active":"2024-09-13T17:13:38.434730+0000","last_peered":"2024-09-13T17:13:38.434730+0000","last_clean":"2024-09-13T17:13:38.434730+0000","last_became_active":"2024-09-13T17:11:23.000463+0000","last_became_peered":"2024-09-13T17:11:23.000463+0000","last_unstale":"2024-09-13T17:13:38.434730+0000","last_undegraded":"2024-09-13T17:13:38.434730+0000","last_fullsized":"2024-09-13T17:13:38.434730+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:59.077194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:37.049152+0000","last_change":"2024-09-13T17:11:27.363076+0000","last_active":"2024-09-13T17:13:37.049152+0000","last_peered":"2024-09-13T17:13:37.049152+0000","last_clean":"2024-09-13T17:13:37.049152+0000","last_became_active":"2024-09-13T17:11:27.362642+0000","last_became_peered":"2024-09-13T17:11:27.362642+0000","last_unstale":"2024-09-13T17:13:37.049152+0000","last_undegraded":"2024-09-13T17:13:37.049152+0000","last_fullsized":"2024-09-13T17:13:37.049152+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:25.494875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"93'6","reported_seq":26,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.473181+0000","last_change":"2024-09-13T17:11:23.336703+0000","last_active":"2024-09-13T17:13:49.473181+0000","last_peered":"2024-09-13T17:13:49.473181+0000","last_clean":"2024-09-13T17:13:49.473181+0000","last_became_active":"2024-09-13T17:11:23.336349+0000","last_became_peered":"2024-09-13T17:11:23.336349+0000","last_unstale":"2024-09-13T17:13:49.473181+0000","last_undegraded":"2024-09-13T17:13:49.473181+0000","last_fullsized":"2024-09-13T17:13:49.473181+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:28.671438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:43.435160+0000","last_change":"2024-09-13T17:11:22.994382+0000","last_active":"2024-09-13T17:13:43.435160+0000","last_peered":"2024-09-13T17:13:43.435160+0000","last_clean":"2024-09-13T17:13:43.435160+0000","last_became_active":"2024-09-13T17:11:22.994037+0000","last_became_peered":"2024-09-13T17:11:22.994037+0000","last_unstale":"2024-09-13T17:13:43.435160+0000","last_undegraded":"2024-09-13T17:13:43.435160+0000","last_fullsized":"2024-09-13T17:13:43.435160+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:10.763757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.212460+0000","last_change":"2024-09-13T17:11:27.354351+0000","last_active":"2024-09-13T17:12:50.212460+0000","last_peered":"2024-09-13T17:12:50.212460+0000","last_clean":"2024-09-13T17:12:50.212460+0000","last_became_active":"2024-09-13T17:11:27.353715+0000","last_became_peered":"2024-09-13T17:11:27.353715+0000","last_unstale":"2024-09-13T17:12:50.212460+0000","last_undegraded":"2024-09-13T17:12:50.212460+0000","last_fullsized":"2024-09-13T17:12:50.212460+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:18.335183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"93'6","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:43.514127+0000","last_change":"2024-09-13T17:11:23.341743+0000","last_active":"2024-09-13T17:13:43.514127+0000","last_peered":"2024-09-13T17:13:43.514127+0000","last_clean":"2024-09-13T17:13:43.514127+0000","last_became_active":"2024-09-13T17:11:23.341200+0000","last_became_peered":"2024-09-13T17:11:23.341200+0000","last_unstale":"2024-09-13T17:13:43.514127+0000","last_undegraded":"2024-09-13T17:13:43.514127+0000","last_fullsized":"2024-09-13T17:13:43.514127+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:41.854013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"94'6","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.982188+0000","last_change":"2024-09-13T17:11:22.997571+0000","last_active":"2024-09-13T17:13:49.982188+0000","last_peered":"2024-09-13T17:13:49.982188+0000","last_clean":"2024-09-13T17:13:49.982188+0000","last_became_active":"2024-09-13T17:11:22.997238+0000","last_became_peered":"2024-09-13T17:11:22.997238+0000","last_unstale":"2024-09-13T17:13:49.982188+0000","last_undegraded":"2024-09-13T17:13:49.982188+0000","last_fullsized":"2024-09-13T17:13:49.982188+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:34.533004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1818,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":128,"num_read_kb":5,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:53.429158+0000","last_change":"2024-09-13T17:12:50.761520+0000","last_active":"2024-09-13T17:12:53.429158+0000","last_peered":"2024-09-13T17:12:53.429158+0000","last_clean":"2024-09-13T17:12:53.429158+0000","last_became_active":"2024-09-13T17:12:50.760930+0000","last_became_peered":"2024-09-13T17:12:50.760930+0000","last_unstale":"2024-09-13T17:12:53.429158+0000","last_undegraded":"2024-09-13T17:12:53.429158+0000","last_fullsized":"2024-09-13T17:12:53.429158+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:46.646722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"93'15","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:43.514206+0000","last_change":"2024-09-13T17:11:23.337666+0000","last_active":"2024-09-13T17:13:43.514206+0000","last_peered":"2024-09-13T17:13:43.514206+0000","last_clean":"2024-09-13T17:13:43.514206+0000","last_became_active":"2024-09-13T17:11:23.337185+0000","last_became_peered":"2024-09-13T17:11:23.337185+0000","last_unstale":"2024-09-13T17:13:43.514206+0000","last_undegraded":"2024-09-13T17:13:43.514206+0000","last_fullsized":"2024-09-13T17:13:43.514206+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:51.266709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:42.049772+0000","last_change":"2024-09-13T17:11:23.005075+0000","last_active":"2024-09-13T17:13:42.049772+0000","last_peered":"2024-09-13T17:13:42.049772+0000","last_clean":"2024-09-13T17:13:42.049772+0000","last_became_active":"2024-09-13T17:11:23.004778+0000","last_became_peered":"2024-09-13T17:11:23.004778+0000","last_unstale":"2024-09-13T17:13:42.049772+0000","last_undegraded":"2024-09-13T17:13:42.049772+0000","last_fullsized":"2024-09-13T17:13:42.049772+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:06.763552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.609278+0000","last_change":"2024-09-13T17:11:27.353601+0000","last_active":"2024-09-13T17:13:49.609278+0000","last_peered":"2024-09-13T17:13:49.609278+0000","last_clean":"2024-09-13T17:13:49.609278+0000","last_became_active":"2024-09-13T17:11:27.353190+0000","last_became_peered":"2024-09-13T17:11:27.353190+0000","last_unstale":"2024-09-13T17:13:49.609278+0000","last_undegraded":"2024-09-13T17:13:49.609278+0000","last_fullsized":"2024-09-13T17:13:49.609278+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:24.645552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"93'9","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.401860+0000","last_change":"2024-09-13T17:11:49.799773+0000","last_active":"2024-09-13T17:13:49.401860+0000","last_peered":"2024-09-13T17:13:49.401860+0000","last_clean":"2024-09-13T17:13:49.401860+0000","last_became_active":"2024-09-13T17:11:49.799402+0000","last_became_peered":"2024-09-13T17:11:49.799402+0000","last_unstale":"2024-09-13T17:13:49.401860+0000","last_undegraded":"2024-09-13T17:13:49.401860+0000","last_fullsized":"2024-09-13T17:13:49.401860+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:37.230144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:43.074257+0000","last_change":"2024-09-13T17:11:23.005619+0000","last_active":"2024-09-13T17:13:43.074257+0000","last_peered":"2024-09-13T17:13:43.074257+0000","last_clean":"2024-09-13T17:13:43.074257+0000","last_became_active":"2024-09-13T17:11:23.005077+0000","last_became_peered":"2024-09-13T17:11:23.005077+0000","last_unstale":"2024-09-13T17:13:43.074257+0000","last_undegraded":"2024-09-13T17:13:43.074257+0000","last_fullsized":"2024-09-13T17:13:43.074257+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:51.739773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.473345+0000","last_change":"2024-09-13T17:11:27.364603+0000","last_active":"2024-09-13T17:13:49.473345+0000","last_peered":"2024-09-13T17:13:49.473345+0000","last_clean":"2024-09-13T17:13:49.473345+0000","last_became_active":"2024-09-13T17:11:27.364226+0000","last_became_peered":"2024-09-13T17:11:27.364226+0000","last_unstale":"2024-09-13T17:13:49.473345+0000","last_undegraded":"2024-09-13T17:13:49.473345+0000","last_fullsized":"2024-09-13T17:13:49.473345+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:56.802016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"93'6","reported_seq":27,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.467049+0000","last_change":"2024-09-13T17:11:23.338657+0000","last_active":"2024-09-13T17:13:49.467049+0000","last_peered":"2024-09-13T17:13:49.467049+0000","last_clean":"2024-09-13T17:13:49.467049+0000","last_became_active":"2024-09-13T17:11:23.338377+0000","last_became_peered":"2024-09-13T17:11:23.338377+0000","last_unstale":"2024-09-13T17:13:49.467049+0000","last_undegraded":"2024-09-13T17:13:49.467049+0000","last_fullsized":"2024-09-13T17:13:49.467049+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:52.412887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"94'40","reported_seq":319,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.972724+0000","last_change":"2024-09-13T17:11:22.998541+0000","last_active":"2024-09-13T17:13:49.972724+0000","last_peered":"2024-09-13T17:13:49.972724+0000","last_clean":"2024-09-13T17:13:49.972724+0000","last_became_active":"2024-09-13T17:11:22.998132+0000","last_became_peered":"2024-09-13T17:11:22.998132+0000","last_unstale":"2024-09-13T17:13:49.972724+0000","last_undegraded":"2024-09-13T17:13:49.972724+0000","last_fullsized":"2024-09-13T17:13:49.972724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:16.777772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68128,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":257,"num_read_kb":196,"num_write":41,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.464040+0000","last_change":"2024-09-13T17:11:27.361917+0000","last_active":"2024-09-13T17:13:49.464040+0000","last_peered":"2024-09-13T17:13:49.464040+0000","last_clean":"2024-09-13T17:13:49.464040+0000","last_became_active":"2024-09-13T17:11:27.361503+0000","last_became_peered":"2024-09-13T17:11:27.361503+0000","last_unstale":"2024-09-13T17:13:49.464040+0000","last_undegraded":"2024-09-13T17:13:49.464040+0000","last_fullsized":"2024-09-13T17:13:49.464040+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:52.959017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"93'11","reported_seq":41,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.609609+0000","last_change":"2024-09-13T17:11:49.798971+0000","last_active":"2024-09-13T17:13:49.609609+0000","last_peered":"2024-09-13T17:13:49.609609+0000","last_clean":"2024-09-13T17:13:49.609609+0000","last_became_active":"2024-09-13T17:11:49.798597+0000","last_became_peered":"2024-09-13T17:11:49.798597+0000","last_unstale":"2024-09-13T17:13:49.609609+0000","last_undegraded":"2024-09-13T17:13:49.609609+0000","last_fullsized":"2024-09-13T17:13:49.609609+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:41.886456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":26,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.473545+0000","last_change":"2024-09-13T17:11:23.004059+0000","last_active":"2024-09-13T17:13:49.473545+0000","last_peered":"2024-09-13T17:13:49.473545+0000","last_clean":"2024-09-13T17:13:49.473545+0000","last_became_active":"2024-09-13T17:11:23.003248+0000","last_became_peered":"2024-09-13T17:11:23.003248+0000","last_unstale":"2024-09-13T17:13:49.473545+0000","last_undegraded":"2024-09-13T17:13:49.473545+0000","last_fullsized":"2024-09-13T17:13:49.473545+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:05.496872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.609476+0000","last_change":"2024-09-13T17:11:27.362880+0000","last_active":"2024-09-13T17:13:49.609476+0000","last_peered":"2024-09-13T17:13:49.609476+0000","last_clean":"2024-09-13T17:13:49.609476+0000","last_became_active":"2024-09-13T17:11:27.362471+0000","last_became_peered":"2024-09-13T17:11:27.362471+0000","last_unstale":"2024-09-13T17:13:49.609476+0000","last_undegraded":"2024-09-13T17:13:49.609476+0000","last_fullsized":"2024-09-13T17:13:49.609476+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:49.964606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"93'9","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.611837+0000","last_change":"2024-09-13T17:11:49.799023+0000","last_active":"2024-09-13T17:13:49.611837+0000","last_peered":"2024-09-13T17:13:49.611837+0000","last_clean":"2024-09-13T17:13:49.611837+0000","last_became_active":"2024-09-13T17:11:49.798724+0000","last_became_peered":"2024-09-13T17:11:49.798724+0000","last_unstale":"2024-09-13T17:13:49.611837+0000","last_undegraded":"2024-09-13T17:13:49.611837+0000","last_fullsized":"2024-09-13T17:13:49.611837+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:03.569532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,7],"acting":[0,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":23,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.609750+0000","last_change":"2024-09-13T17:11:22.999158+0000","last_active":"2024-09-13T17:13:49.609750+0000","last_peered":"2024-09-13T17:13:49.609750+0000","last_clean":"2024-09-13T17:13:49.609750+0000","last_became_active":"2024-09-13T17:11:22.998795+0000","last_became_peered":"2024-09-13T17:11:22.998795+0000","last_unstale":"2024-09-13T17:13:49.609750+0000","last_undegraded":"2024-09-13T17:13:49.609750+0000","last_fullsized":"2024-09-13T17:13:49.609750+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:23.880769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:53.429065+0000","last_change":"2024-09-13T17:12:50.484254+0000","last_active":"2024-09-13T17:12:53.429065+0000","last_peered":"2024-09-13T17:12:53.429065+0000","last_clean":"2024-09-13T17:12:53.429065+0000","last_became_active":"2024-09-13T17:12:50.483742+0000","last_became_peered":"2024-09-13T17:12:50.483742+0000","last_unstale":"2024-09-13T17:12:53.429065+0000","last_undegraded":"2024-09-13T17:12:53.429065+0000","last_fullsized":"2024-09-13T17:12:53.429065+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:59:03.266889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"93'10","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.610078+0000","last_change":"2024-09-13T17:11:23.338736+0000","last_active":"2024-09-13T17:13:49.610078+0000","last_peered":"2024-09-13T17:13:49.610078+0000","last_clean":"2024-09-13T17:13:49.610078+0000","last_became_active":"2024-09-13T17:11:23.338462+0000","last_became_peered":"2024-09-13T17:11:23.338462+0000","last_unstale":"2024-09-13T17:13:49.610078+0000","last_undegraded":"2024-09-13T17:13:49.610078+0000","last_fullsized":"2024-09-13T17:13:49.610078+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:49.221314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"93'5","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.971924+0000","last_change":"2024-09-13T17:11:23.001966+0000","last_active":"2024-09-13T17:13:49.971924+0000","last_peered":"2024-09-13T17:13:49.971924+0000","last_clean":"2024-09-13T17:13:49.971924+0000","last_became_active":"2024-09-13T17:11:23.001565+0000","last_became_peered":"2024-09-13T17:11:23.001565+0000","last_unstale":"2024-09-13T17:13:49.971924+0000","last_undegraded":"2024-09-13T17:13:49.971924+0000","last_fullsized":"2024-09-13T17:13:49.971924+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:47.240702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":123,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.383344+0000","last_change":"2024-09-13T17:11:27.360896+0000","last_active":"2024-09-13T17:13:49.383344+0000","last_peered":"2024-09-13T17:13:49.383344+0000","last_clean":"2024-09-13T17:13:49.383344+0000","last_became_active":"2024-09-13T17:11:27.360552+0000","last_became_peered":"2024-09-13T17:11:27.360552+0000","last_unstale":"2024-09-13T17:13:49.383344+0000","last_undegraded":"2024-09-13T17:13:49.383344+0000","last_fullsized":"2024-09-13T17:13:49.383344+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:08.726724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:29.121673+0000","last_change":"2024-09-13T17:11:27.356317+0000","last_active":"2024-09-13T17:13:29.121673+0000","last_peered":"2024-09-13T17:13:29.121673+0000","last_clean":"2024-09-13T17:13:29.121673+0000","last_became_active":"2024-09-13T17:11:27.355863+0000","last_became_peered":"2024-09-13T17:11:27.355863+0000","last_unstale":"2024-09-13T17:13:29.121673+0000","last_undegraded":"2024-09-13T17:13:29.121673+0000","last_fullsized":"2024-09-13T17:13:29.121673+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:29.356048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"93'11","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:18.078137+0000","last_change":"2024-09-13T17:11:23.344929+0000","last_active":"2024-09-13T17:13:18.078137+0000","last_peered":"2024-09-13T17:13:18.078137+0000","last_clean":"2024-09-13T17:13:18.078137+0000","last_became_active":"2024-09-13T17:11:23.344627+0000","last_became_peered":"2024-09-13T17:11:23.344627+0000","last_unstale":"2024-09-13T17:13:18.078137+0000","last_undegraded":"2024-09-13T17:13:18.078137+0000","last_fullsized":"2024-09-13T17:13:18.078137+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:15.049627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.473256+0000","last_change":"2024-09-13T17:11:23.002539+0000","last_active":"2024-09-13T17:13:49.473256+0000","last_peered":"2024-09-13T17:13:49.473256+0000","last_clean":"2024-09-13T17:13:49.473256+0000","last_became_active":"2024-09-13T17:11:23.002206+0000","last_became_peered":"2024-09-13T17:11:23.002206+0000","last_unstale":"2024-09-13T17:13:49.473256+0000","last_undegraded":"2024-09-13T17:13:49.473256+0000","last_fullsized":"2024-09-13T17:13:49.473256+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:57.708167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:35.023777+0000","last_change":"2024-09-13T17:11:27.362667+0000","last_active":"2024-09-13T17:13:35.023777+0000","last_peered":"2024-09-13T17:13:35.023777+0000","last_clean":"2024-09-13T17:13:35.023777+0000","last_became_active":"2024-09-13T17:11:27.362293+0000","last_became_peered":"2024-09-13T17:11:27.362293+0000","last_unstale":"2024-09-13T17:13:35.023777+0000","last_undegraded":"2024-09-13T17:13:35.023777+0000","last_fullsized":"2024-09-13T17:13:35.023777+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:24.446951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"93'8","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.383093+0000","last_change":"2024-09-13T17:11:23.335823+0000","last_active":"2024-09-13T17:13:49.383093+0000","last_peered":"2024-09-13T17:13:49.383093+0000","last_clean":"2024-09-13T17:13:49.383093+0000","last_became_active":"2024-09-13T17:11:23.335491+0000","last_became_peered":"2024-09-13T17:11:23.335491+0000","last_unstale":"2024-09-13T17:13:49.383093+0000","last_undegraded":"2024-09-13T17:13:49.383093+0000","last_fullsized":"2024-09-13T17:13:49.383093+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:42.172559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.211946+0000","last_change":"2024-09-13T17:11:22.999477+0000","last_active":"2024-09-13T17:12:50.211946+0000","last_peered":"2024-09-13T17:12:50.211946+0000","last_clean":"2024-09-13T17:12:50.211946+0000","last_became_active":"2024-09-13T17:11:22.999175+0000","last_became_peered":"2024-09-13T17:11:22.999175+0000","last_unstale":"2024-09-13T17:12:50.211946+0000","last_undegraded":"2024-09-13T17:12:50.211946+0000","last_fullsized":"2024-09-13T17:12:50.211946+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:03.817508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.220694+0000","last_change":"2024-09-13T17:12:50.220304+0000","last_active":"2024-09-13T17:12:50.220694+0000","last_peered":"2024-09-13T17:12:50.220694+0000","last_clean":"2024-09-13T17:12:50.220694+0000","last_became_active":"2024-09-13T17:12:50.216329+0000","last_became_peered":"2024-09-13T17:12:50.216329+0000","last_unstale":"2024-09-13T17:12:50.220694+0000","last_undegraded":"2024-09-13T17:12:50.220694+0000","last_fullsized":"2024-09-13T17:12:50.220694+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:18:29.389297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"93'8","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:18.084569+0000","last_change":"2024-09-13T17:11:23.337738+0000","last_active":"2024-09-13T17:13:18.084569+0000","last_peered":"2024-09-13T17:13:18.084569+0000","last_clean":"2024-09-13T17:13:18.084569+0000","last_became_active":"2024-09-13T17:11:23.337411+0000","last_became_peered":"2024-09-13T17:11:23.337411+0000","last_unstale":"2024-09-13T17:13:18.084569+0000","last_undegraded":"2024-09-13T17:13:18.084569+0000","last_fullsized":"2024-09-13T17:13:18.084569+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:02.355706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.222605+0000","last_change":"2024-09-13T17:12:50.221722+0000","last_active":"2024-09-13T17:12:50.222605+0000","last_peered":"2024-09-13T17:12:50.222605+0000","last_clean":"2024-09-13T17:12:50.222605+0000","last_became_active":"2024-09-13T17:12:50.221273+0000","last_became_peered":"2024-09-13T17:12:50.221273+0000","last_unstale":"2024-09-13T17:12:50.222605+0000","last_undegraded":"2024-09-13T17:12:50.222605+0000","last_fullsized":"2024-09-13T17:12:50.222605+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:28.617737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,8],"acting":[2,6,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"94'10","reported_seq":160,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.972857+0000","last_change":"2024-09-13T17:11:23.000544+0000","last_active":"2024-09-13T17:13:49.972857+0000","last_peered":"2024-09-13T17:13:49.972857+0000","last_clean":"2024-09-13T17:13:49.972857+0000","last_became_active":"2024-09-13T17:11:23.000233+0000","last_became_peered":"2024-09-13T17:11:23.000233+0000","last_unstale":"2024-09-13T17:13:49.972857+0000","last_undegraded":"2024-09-13T17:13:49.972857+0000","last_fullsized":"2024-09-13T17:13:49.972857+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:04.745950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2385,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"93'7","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.467025+0000","last_change":"2024-09-13T17:11:23.340104+0000","last_active":"2024-09-13T17:13:49.467025+0000","last_peered":"2024-09-13T17:13:49.467025+0000","last_clean":"2024-09-13T17:13:49.467025+0000","last_became_active":"2024-09-13T17:11:23.339826+0000","last_became_peered":"2024-09-13T17:11:23.339826+0000","last_unstale":"2024-09-13T17:13:49.467025+0000","last_undegraded":"2024-09-13T17:13:49.467025+0000","last_fullsized":"2024-09-13T17:13:49.467025+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:03.101547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.217668+0000","last_change":"2024-09-13T17:11:27.360848+0000","last_active":"2024-09-13T17:12:50.217668+0000","last_peered":"2024-09-13T17:12:50.217668+0000","last_clean":"2024-09-13T17:12:50.217668+0000","last_became_active":"2024-09-13T17:11:27.360416+0000","last_became_peered":"2024-09-13T17:11:27.360416+0000","last_unstale":"2024-09-13T17:12:50.217668+0000","last_undegraded":"2024-09-13T17:12:50.217668+0000","last_fullsized":"2024-09-13T17:12:50.217668+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:06.857649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"93'9","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:30.023108+0000","last_change":"2024-09-13T17:11:23.334723+0000","last_active":"2024-09-13T17:13:30.023108+0000","last_peered":"2024-09-13T17:13:30.023108+0000","last_clean":"2024-09-13T17:13:30.023108+0000","last_became_active":"2024-09-13T17:11:23.334433+0000","last_became_peered":"2024-09-13T17:11:23.334433+0000","last_unstale":"2024-09-13T17:13:30.023108+0000","last_undegraded":"2024-09-13T17:13:30.023108+0000","last_fullsized":"2024-09-13T17:13:30.023108+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:08.657151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"93'12","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:28.072478+0000","last_change":"2024-09-13T17:11:23.334882+0000","last_active":"2024-09-13T17:13:28.072478+0000","last_peered":"2024-09-13T17:13:28.072478+0000","last_clean":"2024-09-13T17:13:28.072478+0000","last_became_active":"2024-09-13T17:11:23.334610+0000","last_became_peered":"2024-09-13T17:11:23.334610+0000","last_unstale":"2024-09-13T17:13:28.072478+0000","last_undegraded":"2024-09-13T17:13:28.072478+0000","last_fullsized":"2024-09-13T17:13:28.072478+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:03.932181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"93'8","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:28.072501+0000","last_change":"2024-09-13T17:11:23.334076+0000","last_active":"2024-09-13T17:13:28.072501+0000","last_peered":"2024-09-13T17:13:28.072501+0000","last_clean":"2024-09-13T17:13:28.072501+0000","last_became_active":"2024-09-13T17:11:23.333801+0000","last_became_peered":"2024-09-13T17:11:23.333801+0000","last_unstale":"2024-09-13T17:13:28.072501+0000","last_undegraded":"2024-09-13T17:13:28.072501+0000","last_fullsized":"2024-09-13T17:13:28.072501+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:07.113045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"93'7","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:29.121644+0000","last_change":"2024-09-13T17:11:23.332306+0000","last_active":"2024-09-13T17:13:29.121644+0000","last_peered":"2024-09-13T17:13:29.121644+0000","last_clean":"2024-09-13T17:13:29.121644+0000","last_became_active":"2024-09-13T17:11:23.331913+0000","last_became_peered":"2024-09-13T17:11:23.331913+0000","last_unstale":"2024-09-13T17:13:29.121644+0000","last_undegraded":"2024-09-13T17:13:29.121644+0000","last_fullsized":"2024-09-13T17:13:29.121644+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:02.927286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"93'4","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:35.616049+0000","last_change":"2024-09-13T17:11:23.335512+0000","last_active":"2024-09-13T17:13:35.616049+0000","last_peered":"2024-09-13T17:13:35.616049+0000","last_clean":"2024-09-13T17:13:35.616049+0000","last_became_active":"2024-09-13T17:11:23.335201+0000","last_became_peered":"2024-09-13T17:11:23.335201+0000","last_unstale":"2024-09-13T17:13:35.616049+0000","last_undegraded":"2024-09-13T17:13:35.616049+0000","last_fullsized":"2024-09-13T17:13:35.616049+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:17.263819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"93'6","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:35.023757+0000","last_change":"2024-09-13T17:11:23.341204+0000","last_active":"2024-09-13T17:13:35.023757+0000","last_peered":"2024-09-13T17:13:35.023757+0000","last_clean":"2024-09-13T17:13:35.023757+0000","last_became_active":"2024-09-13T17:11:23.339848+0000","last_became_peered":"2024-09-13T17:11:23.339848+0000","last_unstale":"2024-09-13T17:13:35.023757+0000","last_undegraded":"2024-09-13T17:13:35.023757+0000","last_fullsized":"2024-09-13T17:13:35.023757+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:15:09.480651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"93'15","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:33.073116+0000","last_change":"2024-09-13T17:11:23.334741+0000","last_active":"2024-09-13T17:13:33.073116+0000","last_peered":"2024-09-13T17:13:33.073116+0000","last_clean":"2024-09-13T17:13:33.073116+0000","last_became_active":"2024-09-13T17:11:23.334459+0000","last_became_peered":"2024-09-13T17:11:23.334459+0000","last_unstale":"2024-09-13T17:13:33.073116+0000","last_undegraded":"2024-09-13T17:13:33.073116+0000","last_fullsized":"2024-09-13T17:13:33.073116+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:52.379735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"93'2","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:35.609866+0000","last_change":"2024-09-13T17:11:23.337869+0000","last_active":"2024-09-13T17:13:35.609866+0000","last_peered":"2024-09-13T17:13:35.609866+0000","last_clean":"2024-09-13T17:13:35.609866+0000","last_became_active":"2024-09-13T17:11:23.337581+0000","last_became_peered":"2024-09-13T17:11:23.337581+0000","last_unstale":"2024-09-13T17:13:35.609866+0000","last_undegraded":"2024-09-13T17:13:35.609866+0000","last_fullsized":"2024-09-13T17:13:35.609866+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:49.407474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"93'6","reported_seq":20,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:18.078622+0000","last_change":"2024-09-13T17:11:49.797828+0000","last_active":"2024-09-13T17:13:18.078622+0000","last_peered":"2024-09-13T17:13:18.078622+0000","last_clean":"2024-09-13T17:13:18.078622+0000","last_became_active":"2024-09-13T17:11:49.797504+0000","last_became_peered":"2024-09-13T17:11:49.797504+0000","last_unstale":"2024-09-13T17:13:18.078622+0000","last_undegraded":"2024-09-13T17:13:18.078622+0000","last_fullsized":"2024-09-13T17:13:18.078622+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:29.677936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.29","version":"93'8","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:40.610273+0000","last_change":"2024-09-13T17:11:23.336713+0000","last_active":"2024-09-13T17:13:40.610273+0000","last_peered":"2024-09-13T17:13:40.610273+0000","last_clean":"2024-09-13T17:13:40.610273+0000","last_became_active":"2024-09-13T17:11:23.336431+0000","last_became_peered":"2024-09-13T17:11:23.336431+0000","last_unstale":"2024-09-13T17:13:40.610273+0000","last_undegraded":"2024-09-13T17:13:40.610273+0000","last_fullsized":"2024-09-13T17:13:40.610273+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:52.709483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"93'10","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:40.295477+0000","last_change":"2024-09-13T17:11:23.340385+0000","last_active":"2024-09-13T17:13:40.295477+0000","last_peered":"2024-09-13T17:13:40.295477+0000","last_clean":"2024-09-13T17:13:40.295477+0000","last_became_active":"2024-09-13T17:11:23.340068+0000","last_became_peered":"2024-09-13T17:11:23.340068+0000","last_unstale":"2024-09-13T17:13:40.295477+0000","last_undegraded":"2024-09-13T17:13:40.295477+0000","last_fullsized":"2024-09-13T17:13:40.295477+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:17.795222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"93'11","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:40.616451+0000","last_change":"2024-09-13T17:11:23.329214+0000","last_active":"2024-09-13T17:13:40.616451+0000","last_peered":"2024-09-13T17:13:40.616451+0000","last_clean":"2024-09-13T17:13:40.616451+0000","last_became_active":"2024-09-13T17:11:23.328747+0000","last_became_peered":"2024-09-13T17:11:23.328747+0000","last_unstale":"2024-09-13T17:13:40.616451+0000","last_undegraded":"2024-09-13T17:13:40.616451+0000","last_fullsized":"2024-09-13T17:13:40.616451+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:11.233652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"93'8","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:40.024216+0000","last_change":"2024-09-13T17:11:23.339854+0000","last_active":"2024-09-13T17:13:40.024216+0000","last_peered":"2024-09-13T17:13:40.024216+0000","last_clean":"2024-09-13T17:13:40.024216+0000","last_became_active":"2024-09-13T17:11:23.339565+0000","last_became_peered":"2024-09-13T17:11:23.339565+0000","last_unstale":"2024-09-13T17:13:40.024216+0000","last_undegraded":"2024-09-13T17:13:40.024216+0000","last_fullsized":"2024-09-13T17:13:40.024216+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:37.161135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"93'7","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:38.073656+0000","last_change":"2024-09-13T17:11:23.342562+0000","last_active":"2024-09-13T17:13:38.073656+0000","last_peered":"2024-09-13T17:13:38.073656+0000","last_clean":"2024-09-13T17:13:38.073656+0000","last_became_active":"2024-09-13T17:11:23.342256+0000","last_became_peered":"2024-09-13T17:11:23.342256+0000","last_unstale":"2024-09-13T17:13:38.073656+0000","last_undegraded":"2024-09-13T17:13:38.073656+0000","last_fullsized":"2024-09-13T17:13:38.073656+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:30.788242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"93'10","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.464655+0000","last_change":"2024-09-13T17:11:23.342436+0000","last_active":"2024-09-13T17:13:49.464655+0000","last_peered":"2024-09-13T17:13:49.464655+0000","last_clean":"2024-09-13T17:13:49.464655+0000","last_became_active":"2024-09-13T17:11:23.342157+0000","last_became_peered":"2024-09-13T17:11:23.342157+0000","last_unstale":"2024-09-13T17:13:49.464655+0000","last_undegraded":"2024-09-13T17:13:49.464655+0000","last_fullsized":"2024-09-13T17:13:49.464655+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:56.550875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"93'8","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.609673+0000","last_change":"2024-09-13T17:11:23.341660+0000","last_active":"2024-09-13T17:13:49.609673+0000","last_peered":"2024-09-13T17:13:49.609673+0000","last_clean":"2024-09-13T17:13:49.609673+0000","last_became_active":"2024-09-13T17:11:23.341102+0000","last_became_peered":"2024-09-13T17:11:23.341102+0000","last_unstale":"2024-09-13T17:13:49.609673+0000","last_undegraded":"2024-09-13T17:13:49.609673+0000","last_fullsized":"2024-09-13T17:13:49.609673+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:00.546907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"93'9","reported_seq":30,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.608823+0000","last_change":"2024-09-13T17:11:23.338064+0000","last_active":"2024-09-13T17:13:49.608823+0000","last_peered":"2024-09-13T17:13:49.608823+0000","last_clean":"2024-09-13T17:13:49.608823+0000","last_became_active":"2024-09-13T17:11:23.337748+0000","last_became_peered":"2024-09-13T17:11:23.337748+0000","last_unstale":"2024-09-13T17:13:49.608823+0000","last_undegraded":"2024-09-13T17:13:49.608823+0000","last_fullsized":"2024-09-13T17:13:49.608823+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:14.281629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"93'7","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:44.123109+0000","last_change":"2024-09-13T17:11:23.335684+0000","last_active":"2024-09-13T17:13:44.123109+0000","last_peered":"2024-09-13T17:13:44.123109+0000","last_clean":"2024-09-13T17:13:44.123109+0000","last_became_active":"2024-09-13T17:11:23.335364+0000","last_became_peered":"2024-09-13T17:11:23.335364+0000","last_unstale":"2024-09-13T17:13:44.123109+0000","last_undegraded":"2024-09-13T17:13:44.123109+0000","last_fullsized":"2024-09-13T17:13:44.123109+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:02.288009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"93'7","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:44.123153+0000","last_change":"2024-09-13T17:11:23.340881+0000","last_active":"2024-09-13T17:13:44.123153+0000","last_peered":"2024-09-13T17:13:44.123153+0000","last_clean":"2024-09-13T17:13:44.123153+0000","last_became_active":"2024-09-13T17:11:23.340575+0000","last_became_peered":"2024-09-13T17:11:23.340575+0000","last_unstale":"2024-09-13T17:13:44.123153+0000","last_undegraded":"2024-09-13T17:13:44.123153+0000","last_fullsized":"2024-09-13T17:13:44.123153+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:40.757703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"93'10","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.401919+0000","last_change":"2024-09-13T17:11:23.329039+0000","last_active":"2024-09-13T17:13:49.401919+0000","last_peered":"2024-09-13T17:13:49.401919+0000","last_clean":"2024-09-13T17:13:49.401919+0000","last_became_active":"2024-09-13T17:11:23.328324+0000","last_became_peered":"2024-09-13T17:11:23.328324+0000","last_unstale":"2024-09-13T17:13:49.401919+0000","last_undegraded":"2024-09-13T17:13:49.401919+0000","last_fullsized":"2024-09-13T17:13:49.401919+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:37.882596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"93'7","reported_seq":27,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.609805+0000","last_change":"2024-09-13T17:11:23.345229+0000","last_active":"2024-09-13T17:13:49.609805+0000","last_peered":"2024-09-13T17:13:49.609805+0000","last_clean":"2024-09-13T17:13:49.609805+0000","last_became_active":"2024-09-13T17:11:23.344883+0000","last_became_peered":"2024-09-13T17:11:23.344883+0000","last_unstale":"2024-09-13T17:13:49.609805+0000","last_undegraded":"2024-09-13T17:13:49.609805+0000","last_fullsized":"2024-09-13T17:13:49.609805+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:47.983382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"93'6","reported_seq":26,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.610120+0000","last_change":"2024-09-13T17:11:23.346338+0000","last_active":"2024-09-13T17:13:49.610120+0000","last_peered":"2024-09-13T17:13:49.610120+0000","last_clean":"2024-09-13T17:13:49.610120+0000","last_became_active":"2024-09-13T17:11:23.344777+0000","last_became_peered":"2024-09-13T17:11:23.344777+0000","last_unstale":"2024-09-13T17:13:49.610120+0000","last_undegraded":"2024-09-13T17:13:49.610120+0000","last_fullsized":"2024-09-13T17:13:49.610120+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:23.650174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"93'16","reported_seq":46,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.383860+0000","last_change":"2024-09-13T17:11:49.798165+0000","last_active":"2024-09-13T17:13:49.383860+0000","last_peered":"2024-09-13T17:13:49.383860+0000","last_clean":"2024-09-13T17:13:49.383860+0000","last_became_active":"2024-09-13T17:11:49.797753+0000","last_became_peered":"2024-09-13T17:11:49.797753+0000","last_unstale":"2024-09-13T17:13:49.383860+0000","last_undegraded":"2024-09-13T17:13:49.383860+0000","last_fullsized":"2024-09-13T17:13:49.383860+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:51.744236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"93'11","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.610269+0000","last_change":"2024-09-13T17:11:23.340478+0000","last_active":"2024-09-13T17:13:49.610269+0000","last_peered":"2024-09-13T17:13:49.610269+0000","last_clean":"2024-09-13T17:13:49.610269+0000","last_became_active":"2024-09-13T17:11:23.339916+0000","last_became_peered":"2024-09-13T17:11:23.339916+0000","last_unstale":"2024-09-13T17:13:49.610269+0000","last_undegraded":"2024-09-13T17:13:49.610269+0000","last_fullsized":"2024-09-13T17:13:49.610269+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:09.477626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"93'9","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:18.085082+0000","last_change":"2024-09-13T17:11:23.340882+0000","last_active":"2024-09-13T17:13:18.085082+0000","last_peered":"2024-09-13T17:13:18.085082+0000","last_clean":"2024-09-13T17:13:18.085082+0000","last_became_active":"2024-09-13T17:11:23.340413+0000","last_became_peered":"2024-09-13T17:11:23.340413+0000","last_unstale":"2024-09-13T17:13:18.085082+0000","last_undegraded":"2024-09-13T17:13:18.085082+0000","last_fullsized":"2024-09-13T17:13:18.085082+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:49.040015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"93'5","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:18.082603+0000","last_change":"2024-09-13T17:11:23.345551+0000","last_active":"2024-09-13T17:13:18.082603+0000","last_peered":"2024-09-13T17:13:18.082603+0000","last_clean":"2024-09-13T17:13:18.082603+0000","last_became_active":"2024-09-13T17:11:23.345195+0000","last_became_peered":"2024-09-13T17:11:23.345195+0000","last_unstale":"2024-09-13T17:13:18.082603+0000","last_undegraded":"2024-09-13T17:13:18.082603+0000","last_fullsized":"2024-09-13T17:13:18.082603+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:00.856969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"93'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:18.081359+0000","last_change":"2024-09-13T17:11:49.799090+0000","last_active":"2024-09-13T17:13:18.081359+0000","last_peered":"2024-09-13T17:13:18.081359+0000","last_clean":"2024-09-13T17:13:18.081359+0000","last_became_active":"2024-09-13T17:11:49.798766+0000","last_became_peered":"2024-09-13T17:11:49.798766+0000","last_unstale":"2024-09-13T17:13:18.081359+0000","last_undegraded":"2024-09-13T17:13:18.081359+0000","last_fullsized":"2024-09-13T17:13:18.081359+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:43.946212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"93'4","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:18.079563+0000","last_change":"2024-09-13T17:11:23.340286+0000","last_active":"2024-09-13T17:13:18.079563+0000","last_peered":"2024-09-13T17:13:18.079563+0000","last_clean":"2024-09-13T17:13:18.079563+0000","last_became_active":"2024-09-13T17:11:23.339756+0000","last_became_peered":"2024-09-13T17:11:23.339756+0000","last_unstale":"2024-09-13T17:13:18.079563+0000","last_undegraded":"2024-09-13T17:13:18.079563+0000","last_fullsized":"2024-09-13T17:13:18.079563+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:00.463087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"93'8","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:24.552220+0000","last_change":"2024-09-13T17:11:23.339818+0000","last_active":"2024-09-13T17:13:24.552220+0000","last_peered":"2024-09-13T17:13:24.552220+0000","last_clean":"2024-09-13T17:13:24.552220+0000","last_became_active":"2024-09-13T17:11:23.339501+0000","last_became_peered":"2024-09-13T17:11:23.339501+0000","last_unstale":"2024-09-13T17:13:24.552220+0000","last_undegraded":"2024-09-13T17:13:24.552220+0000","last_fullsized":"2024-09-13T17:13:24.552220+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:36.904004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"93'7","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:29.121660+0000","last_change":"2024-09-13T17:11:23.334388+0000","last_active":"2024-09-13T17:13:29.121660+0000","last_peered":"2024-09-13T17:13:29.121660+0000","last_clean":"2024-09-13T17:13:29.121660+0000","last_became_active":"2024-09-13T17:11:23.333953+0000","last_became_peered":"2024-09-13T17:11:23.333953+0000","last_unstale":"2024-09-13T17:13:29.121660+0000","last_undegraded":"2024-09-13T17:13:29.121660+0000","last_fullsized":"2024-09-13T17:13:29.121660+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:33.929173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"93'4","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:29.121689+0000","last_change":"2024-09-13T17:11:23.338259+0000","last_active":"2024-09-13T17:13:29.121689+0000","last_peered":"2024-09-13T17:13:29.121689+0000","last_clean":"2024-09-13T17:13:29.121689+0000","last_became_active":"2024-09-13T17:11:23.337979+0000","last_became_peered":"2024-09-13T17:11:23.337979+0000","last_unstale":"2024-09-13T17:13:29.121689+0000","last_undegraded":"2024-09-13T17:13:29.121689+0000","last_fullsized":"2024-09-13T17:13:29.121689+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:55.750255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"93'8","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:30.023224+0000","last_change":"2024-09-13T17:11:23.337899+0000","last_active":"2024-09-13T17:13:30.023224+0000","last_peered":"2024-09-13T17:13:30.023224+0000","last_clean":"2024-09-13T17:13:30.023224+0000","last_became_active":"2024-09-13T17:11:23.337626+0000","last_became_peered":"2024-09-13T17:11:23.337626+0000","last_unstale":"2024-09-13T17:13:30.023224+0000","last_undegraded":"2024-09-13T17:13:30.023224+0000","last_fullsized":"2024-09-13T17:13:30.023224+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:14.654852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":599547,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":864,"num_read_kb":544,"num_write":289,"num_write_kb":1444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":1798641,"data_compressed":75906,"data_compressed_allocated":98304,"data_compressed_original":1548288,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":109077,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383722,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":1036288,"data_stored":529501,"data_compressed":26642,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54700000000000004,"15min":0.54200000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78600000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.41599999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77600000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.39500000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.45200000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.377},{"interface":"front","average":{"1min":0.629,"5min":0.60999999999999999,"15min":0.60399999999999998},"min":{"1min":0.42799999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77900000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.55800000000000005}]},{"osd":2,"last update":"Fri Sep 13 17:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.41999999999999998,"15min":0.40500000000000003},"min":{"1min":0.28499999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.73699999999999999,"5min":0.748,"15min":0.748},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.46600000000000003,"15min":0.45700000000000002},"min":{"1min":0.30099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.66800000000000004,"5min":1.286,"15min":1.286},"last":0.309}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.51200000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.82199999999999995,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.61499999999999999,"15min":0.60399999999999998},"min":{"1min":0.40500000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.46300000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.36699999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.81200000000000006,"5min":1.109,"15min":1.109},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.50900000000000001,"15min":0.48099999999999998},"min":{"1min":0.434,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.34200000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57299999999999995,"15min":0.56100000000000005},"min":{"1min":0.41899999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81200000000000006,"5min":1.214,"15min":1.214},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.60599999999999998,"15min":0.59999999999999998},"min":{"1min":0.47199999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.90300000000000002,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.44400000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.65300000000000002,"15min":0.63500000000000001},"min":{"1min":0.53100000000000003,"5min":0.502,"15min":0.502},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.68899999999999995,"15min":0.68300000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.86299999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.52300000000000002}]},{"osd":8,"last update":"Fri Sep 13 17:13:29 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.61399999999999999,"15min":0.60399999999999998},"min":{"1min":0.39900000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.64700000000000002,"15min":0.64200000000000002},"min":{"1min":0.46800000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.497}]},{"osd":9,"last update":"Fri Sep 13 17:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.65600000000000003,"15min":0.64000000000000001},"min":{"1min":0.52200000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93799999999999994,"5min":1.196,"15min":1.196},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.66700000000000004,"15min":0.63300000000000001},"min":{"1min":0.60299999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.98399999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.53400000000000003}]},{"osd":10,"last update":"Fri Sep 13 17:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.73799999999999999,"15min":0.71999999999999997},"min":{"1min":0.61699999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0409999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72299999999999998,"15min":0.71899999999999997},"min":{"1min":0.56899999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.95899999999999996,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.50700000000000001}]}]},{"osd":10,"up_from":72,"seq":309237645358,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36384,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708768,"statfs":{"total":95995035648,"available":95957778432,"internally_reserved":0,"allocated":1204224,"data_stored":1317145,"data_compressed":69157,"data_compressed_allocated":90112,"data_compressed_original":786432,"omap_allocated":1597,"internal_metadata":36043203},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:13:27 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.38800000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55200000000000005,"15min":0.55100000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.73499999999999999,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.45100000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.41799999999999998,"15min":0.42099999999999999},"min":{"1min":0.29299999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.45700000000000002,"15min":0.46100000000000002},"min":{"1min":0.33100000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.48299999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.43099999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.58299999999999996,"15min":0.57099999999999995},"min":{"1min":0.44,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78100000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.34899999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57099999999999995,"15min":0.58999999999999997},"min":{"1min":0.41399999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73499999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56799999999999995,"15min":0.58199999999999996},"min":{"1min":0.38900000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.49199999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.501,"15min":0.50900000000000001},"min":{"1min":0.38,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70399999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.52700000000000002,"15min":0.54500000000000004},"min":{"1min":0.374,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.628,"5min":0.876,"15min":0.876},"last":0.30099999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65400000000000003,"15min":0.65600000000000003},"min":{"1min":0.48999999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.86599999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.37},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.64900000000000002,"15min":0.65100000000000002},"min":{"1min":0.47899999999999998,"5min":0.44,"15min":0.44},"max":{"1min":0.82199999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.38}]},{"osd":6,"last update":"Fri Sep 13 17:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63500000000000001,"15min":0.65300000000000002},"min":{"1min":0.46200000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73599999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.623,"15min":0.63100000000000001},"min":{"1min":0.52700000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.72299999999999998,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.39100000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:12:52 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.57199999999999995}]},{"osd":8,"last update":"Fri Sep 13 17:12:10 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68300000000000005,"15min":0.68799999999999994},"min":{"1min":0.49099999999999999,"5min":0.442,"15min":0.442},"max":{"1min":0.85199999999999998,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.626},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.71899999999999997,"15min":0.72699999999999998},"min":{"1min":0.50900000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85999999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.71599999999999997}]},{"osd":9,"last update":"Fri Sep 13 17:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69499999999999995,"15min":0.70799999999999996},"min":{"1min":0.55400000000000005,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.78300000000000003,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72899999999999998,"15min":0.751},"min":{"1min":0.60299999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.83099999999999996,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.71899999999999997}]},{"osd":11,"last update":"Fri Sep 13 17:13:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.70899999999999996,"15min":0.69499999999999995},"min":{"1min":0.66200000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.86199999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70499999999999996,"15min":0.68700000000000006},"min":{"1min":0.61699999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.83099999999999996,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.54400000000000004}]}]},{"osd":9,"up_from":67,"seq":287762808883,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1077248,"data_stored":926467,"data_compressed":45788,"data_compressed_allocated":61440,"data_compressed_original":466944,"omap_allocated":1597,"internal_metadata":31848899},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.38800000000000001,"15min":0.40400000000000003},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.58799999999999997,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.40799999999999997,"15min":0.42199999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.52800000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.312}]},{"osd":1,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.432,"5min":0.374,"15min":0.374},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55100000000000005,"15min":0.56499999999999995},"min":{"1min":0.35499999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70999999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.45800000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57899999999999996,"15min":0.60299999999999998},"min":{"1min":0.38400000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80200000000000005,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56699999999999995,"15min":0.58699999999999997},"min":{"1min":0.42499999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.66400000000000003,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.57499999999999996}]},{"osd":3,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.46600000000000003,"15min":0.49399999999999999},"min":{"1min":0.28599999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54000000000000004,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.46600000000000003,"15min":0.504},"min":{"1min":0.27300000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.52200000000000002,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.33900000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56899999999999995,"15min":0.58099999999999996},"min":{"1min":0.46200000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.70499999999999996,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61899999999999999,"15min":0.63800000000000001},"min":{"1min":0.39800000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.80000000000000004,"5min":1.26,"15min":1.26},"last":0.47299999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.621,"15min":0.65300000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.70499999999999996,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.624,"15min":0.66100000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.74399999999999999,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.51200000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.49299999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.66200000000000003,"15min":0.69199999999999995},"min":{"1min":0.45100000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.77100000000000002,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.65900000000000003,"15min":0.69199999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.73599999999999999,"5min":1.018,"15min":1.018},"last":0.41699999999999998}]},{"osd":8,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.65900000000000003,"15min":0.68300000000000005},"min":{"1min":0.45700000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.76900000000000002,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.496},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.67900000000000005,"15min":0.71099999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78200000000000003,"5min":1.228,"15min":1.228},"last":0.40699999999999997}]},{"osd":10,"last update":"Fri Sep 13 17:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.65700000000000003,"15min":0.67800000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.83299999999999996,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.69199999999999995,"15min":0.71799999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.76400000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.56399999999999995}]},{"osd":11,"last update":"Fri Sep 13 17:13:29 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.628,"15min":0.622},"min":{"1min":0.57699999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.80500000000000005,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.60399999999999998,"15min":0.60099999999999998},"min":{"1min":0.501,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83099999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.55100000000000005}]}]},{"osd":8,"up_from":59,"seq":253403070521,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1073152,"data_stored":922291,"data_compressed":45788,"data_compressed_allocated":61440,"data_compressed_original":466944,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54600000000000004,"15min":0.54900000000000004},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.79600000000000004,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.627},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52300000000000002,"15min":0.53400000000000003},"min":{"1min":0.38300000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.55100000000000005}]},{"osd":1,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.57199999999999995,"15min":0.55400000000000005},"min":{"1min":0.38100000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.79700000000000004,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.57199999999999995,"15min":0.54400000000000004},"min":{"1min":0.42499999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.53300000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.434,"15min":0.42299999999999999},"min":{"1min":0.29499999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.45200000000000001,"15min":0.442},"min":{"1min":0.39000000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.626,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.66300000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.34999999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.69799999999999995,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56699999999999995,"15min":0.56399999999999995},"min":{"1min":0.41699999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.67700000000000005}]},{"osd":4,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.59699999999999998,"15min":0.57799999999999996},"min":{"1min":0.52100000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79100000000000004,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.621,"15min":0.59999999999999998},"min":{"1min":0.53500000000000003,"5min":0.313,"15min":0.313},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.60399999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.318,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.80100000000000005,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54000000000000004,"15min":0.53800000000000003},"min":{"1min":0.40699999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.755,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.69199999999999995}]},{"osd":6,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.63200000000000001,"15min":0.624},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.84399999999999997,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63900000000000001,"15min":0.64700000000000002},"min":{"1min":0.504,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.85299999999999998,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.78100000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.66700000000000004,"15min":0.65300000000000002},"min":{"1min":0.53100000000000003,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91800000000000004,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.68500000000000005,"15min":0.67100000000000004},"min":{"1min":0.52600000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93999999999999995,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.76300000000000001}]},{"osd":9,"last update":"Fri Sep 13 17:12:53 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.67200000000000004,"15min":0.66800000000000004},"min":{"1min":0.51900000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86499999999999999,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.67600000000000005,"15min":0.67500000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.77200000000000002}]},{"osd":10,"last update":"Fri Sep 13 17:13:15 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.69899999999999995,"15min":0.68300000000000005},"min":{"1min":0.54600000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.90700000000000003,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.71999999999999997,"15min":0.70299999999999996},"min":{"1min":0.57199999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91900000000000004,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.73999999999999999}]},{"osd":11,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.71099999999999997,"15min":0.70899999999999996},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.89700000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.754},{"interface":"front","average":{"1min":0.746,"5min":0.73499999999999999,"15min":0.73299999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.72099999999999997}]}]},{"osd":7,"up_from":51,"seq":219043332157,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1093632,"data_stored":1127004,"data_compressed":63001,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1587,"internal_metadata":27654605},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.39700000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.66200000000000003,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.35799999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.52500000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.379,"15min":0.36099999999999999},"min":{"1min":0.27100000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.497,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38100000000000001,"15min":0.35499999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.52800000000000002,"5min":0.623,"15min":0.623},"last":0.36199999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55100000000000005,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70399999999999996,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54700000000000004,"15min":0.51800000000000002},"min":{"1min":0.38300000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.79700000000000004,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.42199999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53100000000000003,"15min":0.50900000000000001},"min":{"1min":0.35199999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72299999999999998,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.54900000000000004,"15min":0.53800000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69699999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.40899999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.47799999999999998,"15min":0.46200000000000002},"min":{"1min":0.33600000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.60699999999999998,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.314},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45100000000000001,"15min":0.442},"min":{"1min":0.27200000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.61299999999999999,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.34399999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.59999999999999998,"15min":0.57199999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.81899999999999995,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58799999999999997,"15min":0.57599999999999996},"min":{"1min":0.42899999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.75900000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.441}]},{"osd":6,"last update":"Fri Sep 13 17:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59999999999999998,"15min":0.58199999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.75600000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61499999999999999,"15min":0.59299999999999997},"min":{"1min":0.44900000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76000000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.49399999999999999}]},{"osd":8,"last update":"Fri Sep 13 17:13:32 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64100000000000001,"15min":0.63},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.75600000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.67000000000000004,"15min":0.64800000000000002},"min":{"1min":0.52600000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.83399999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.52600000000000002}]},{"osd":9,"last update":"Fri Sep 13 17:12:55 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.67200000000000004,"15min":0.68400000000000005},"min":{"1min":0.437,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84599999999999997,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.48399999999999999,"5min":0.438,"15min":0.438},"max":{"1min":0.80600000000000005,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.48599999999999999}]},{"osd":10,"last update":"Fri Sep 13 17:13:13 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.68000000000000005,"15min":0.69599999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.80000000000000004,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65500000000000003,"15min":0.65300000000000002},"min":{"1min":0.45300000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.80700000000000005,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.503}]},{"osd":11,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.73199999999999998,"15min":0.73299999999999998},"min":{"1min":0.57999999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.85499999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.71999999999999997,"15min":0.71299999999999997},"min":{"1min":0.68400000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.83799999999999997,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.51700000000000002}]}]},{"osd":6,"up_from":46,"seq":197568495681,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1028096,"data_stored":524331,"data_compressed":26642,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:13:49 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.35099999999999998,"15min":0.33800000000000002},"min":{"1min":0.27100000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.432,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.373,"15min":0.36899999999999999},"min":{"1min":0.255,"5min":0.251,"15min":0.251},"max":{"1min":0.48299999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.32900000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:13:49 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52500000000000002,"15min":0.51000000000000001},"min":{"1min":0.32000000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.72199999999999998,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52400000000000002,"15min":0.51000000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71699999999999997,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.51300000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:13:49 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.40799999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.66300000000000003,"5min":1.095,"15min":1.095},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54500000000000004,"15min":0.52700000000000002},"min":{"1min":0.371,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69299999999999995,"5min":0.877,"15min":0.877},"last":0.39100000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:13:49 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.40999999999999998,"15min":0.41199999999999998},"min":{"1min":0.313,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.61499999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.41799999999999998,"15min":0.41199999999999998},"min":{"1min":0.30099999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52600000000000002,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.40600000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:13:49 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52500000000000002,"15min":0.50700000000000001},"min":{"1min":0.39600000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72699999999999998,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56000000000000005,"15min":0.53400000000000003},"min":{"1min":0.39000000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76900000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.746}]},{"osd":5,"last update":"Fri Sep 13 17:13:49 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.77500000000000002,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.374},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.59999999999999998},"min":{"1min":0.45100000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.77500000000000002,"5min":1.131,"15min":1.131},"last":0.52900000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:13:06 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59499999999999997,"15min":0.60299999999999998},"min":{"1min":0.41599999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.81100000000000005,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59699999999999998,"15min":0.59499999999999997},"min":{"1min":0.42899999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.76600000000000001,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.77200000000000002}]},{"osd":8,"last update":"Fri Sep 13 17:13:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.62,"15min":0.626},"min":{"1min":0.47199999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.76300000000000001,"5min":0.874,"15min":0.874},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.64500000000000002,"15min":0.64700000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.76600000000000001,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.56399999999999995}]},{"osd":9,"last update":"Fri Sep 13 17:12:53 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.59199999999999997,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.626,"15min":0.65400000000000003},"min":{"1min":0.38200000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78000000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.72199999999999998}]},{"osd":10,"last update":"Fri Sep 13 17:13:17 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.51500000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.747,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.67600000000000005,"15min":0.67800000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.747,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.79800000000000004}]},{"osd":11,"last update":"Fri Sep 13 17:13:31 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.70299999999999996,"15min":0.71599999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.78500000000000003,"5min":0.877,"15min":0.877},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.68400000000000005,"15min":0.69199999999999995},"min":{"1min":0.53300000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.80100000000000005,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.58299999999999996}]}]},{"osd":5,"up_from":38,"seq":163208757318,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1122304,"data_stored":1253213,"data_compressed":69157,"data_compressed_allocated":90112,"data_compressed_original":786432,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:13:24 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.50600000000000001,"15min":0.48399999999999999},"min":{"1min":0.35699999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.621},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.50900000000000001,"15min":0.48699999999999999},"min":{"1min":0.40100000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.57899999999999996}]},{"osd":1,"last update":"Fri Sep 13 17:13:24 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.58399999999999996,"15min":0.55500000000000005},"min":{"1min":0.441,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78300000000000003,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.40400000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.443}]},{"osd":2,"last update":"Fri Sep 13 17:13:24 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.40000000000000002,"15min":0.378},"min":{"1min":0.28899999999999998,"5min":0.222,"15min":0.222},"max":{"1min":0.56299999999999994,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.40799999999999997,"15min":0.38200000000000001},"min":{"1min":0.30199999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.61099999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.40100000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:13:24 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.53600000000000003,"15min":0.51100000000000001},"min":{"1min":0.39100000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.53500000000000003,"15min":0.51500000000000001},"min":{"1min":0.38400000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.505}]},{"osd":4,"last update":"Fri Sep 13 17:13:24 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57299999999999995,"15min":0.56200000000000006},"min":{"1min":0.374,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.60799999999999998,"15min":0.57299999999999995},"min":{"1min":0.40899999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82899999999999996,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.41799999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:13:43 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.58099999999999996,"15min":0.56899999999999995},"min":{"1min":0.53000000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.58799999999999997,"15min":0.56899999999999995},"min":{"1min":0.52000000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.79800000000000004,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.47599999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:12:59 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61099999999999999,"15min":0.60999999999999999},"min":{"1min":0.40100000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.86299999999999999,"5min":0.874,"15min":0.874},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.625,"15min":0.60999999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.43099999999999999}]},{"osd":8,"last update":"Fri Sep 13 17:13:35 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.41499999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81299999999999994,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.42599999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.46400000000000002}]},{"osd":9,"last update":"Fri Sep 13 17:12:51 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.64200000000000002,"15min":0.626},"min":{"1min":0.51000000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.63900000000000001,"15min":0.621},"min":{"1min":0.52200000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56100000000000005}]},{"osd":10,"last update":"Fri Sep 13 17:13:12 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.67000000000000004,"15min":0.64400000000000002},"min":{"1min":0.53100000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.67000000000000004,"15min":0.64200000000000002},"min":{"1min":0.502,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.53900000000000003}]}]},{"osd":4,"up_from":33,"seq":141733920843,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":1040384,"data_stored":530520,"data_compressed":26642,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:12:50 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.247},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.36599999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:12:59 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.38300000000000001,"15min":0.36499999999999999},"min":{"1min":0.28999999999999998,"5min":0.221,"15min":0.221},"max":{"1min":0.68899999999999995,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40699999999999997,"15min":0.39500000000000002},"min":{"1min":0.30299999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.61399999999999999,"5min":2.52,"15min":2.52},"last":0.28899999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:12:59 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.78000000000000003,"15min":0.63},"min":{"1min":0.41699999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.84299999999999997,"5min":15.401,"15min":15.401},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.56999999999999995,"15min":0.53200000000000003},"min":{"1min":0.40400000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83199999999999996,"5min":1.335,"15min":1.335},"last":0.40899999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:12:59 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55200000000000005,"15min":0.55400000000000005},"min":{"1min":0.372,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.77800000000000002,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.747,"15min":0.61899999999999999},"min":{"1min":0.41699999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88400000000000001,"5min":15.425000000000001,"15min":15.425000000000001},"last":0.56599999999999995}]},{"osd":5,"last update":"Fri Sep 13 17:13:25 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.63,"15min":0.58299999999999996},"min":{"1min":0.39600000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.86299999999999999,"5min":3.0790000000000002,"15min":3.0790000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.63600000000000001,"15min":0.57699999999999996},"min":{"1min":0.40999999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.80500000000000005,"5min":4.0810000000000004,"15min":4.0810000000000004},"last":0.45400000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:13:47 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57599999999999996,"15min":0.52800000000000002},"min":{"1min":0.42799999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.79600000000000004,"5min":2.6469999999999998,"15min":2.6469999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60499999999999998,"15min":0.56599999999999995},"min":{"1min":0.435,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.877,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.60099999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:13:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52000000000000002,"15min":0.497},"min":{"1min":0.45500000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.62,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53300000000000003,"15min":0.495},"min":{"1min":0.40300000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69799999999999995,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.46600000000000003}]},{"osd":8,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.67700000000000005,"15min":0.64700000000000002},"min":{"1min":0.54100000000000004,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.874,"5min":2.577,"15min":2.577},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.67000000000000004,"15min":0.65100000000000002},"min":{"1min":0.56899999999999995,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.82799999999999996,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.58199999999999996}]},{"osd":9,"last update":"Fri Sep 13 17:12:50 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":1.2509999999999999,"15min":1.4930000000000001},"min":{"1min":0.54600000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.84499999999999997,"5min":15.448,"15min":15.448},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":1.2150000000000001,"15min":1.456},"min":{"1min":0.52000000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.82099999999999995,"5min":15.385,"15min":15.385},"last":0.51100000000000001}]},{"osd":10,"last update":"Fri Sep 13 17:13:17 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65100000000000002,"15min":0.63200000000000001},"min":{"1min":0.432,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.72899999999999998,"5min":3.1259999999999999,"15min":3.1259999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68799999999999994,"15min":0.68400000000000005},"min":{"1min":0.505,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.88700000000000001,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.63700000000000001}]},{"osd":11,"last update":"Fri Sep 13 17:13:25 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.89000000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.81200000000000006,"15min":0.82399999999999995},"min":{"1min":0.56100000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91500000000000004,"5min":3.165,"15min":3.165},"last":0.503}]}]},{"osd":3,"up_from":25,"seq":107374182479,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1077248,"data_stored":1048737,"data_compressed":51944,"data_compressed_allocated":69632,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:13:41 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36199999999999999,"15min":0.32400000000000001},"min":{"1min":0.251,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.69699999999999995,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.376,"15min":0.33200000000000002},"min":{"1min":0.23200000000000001,"5min":0.19900000000000001,"15min":0.19600000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.42199999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:13:41 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55500000000000005,"15min":0.504},"min":{"1min":0.34200000000000003,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":0.76600000000000001,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55100000000000005,"15min":0.496},"min":{"1min":0.40899999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78700000000000003,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.495}]},{"osd":2,"last update":"Fri Sep 13 17:13:41 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54400000000000004,"15min":0.50600000000000001},"min":{"1min":0.40300000000000002,"5min":0.34000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71599999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56999999999999995,"15min":0.51800000000000002},"min":{"1min":0.41699999999999998,"5min":0.315,"15min":0.25900000000000001},"max":{"1min":0.82899999999999996,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.45800000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:12:56 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55800000000000005,"15min":0.52400000000000002},"min":{"1min":0.35699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.749,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56399999999999995,"15min":0.51800000000000002},"min":{"1min":0.39900000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.50900000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:13:22 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57399999999999995,"15min":0.55900000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80200000000000005,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36599999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72499999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.441}]},{"osd":6,"last update":"Fri Sep 13 17:13:44 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.44600000000000001,"15min":0.44400000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.72099999999999997,"5min":0.746,"15min":0.746},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.47199999999999998,"15min":0.44800000000000001},"min":{"1min":0.32100000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.75600000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.53700000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:13:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59499999999999997,"15min":0.58199999999999996},"min":{"1min":0.45700000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72199999999999998,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78500000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.52900000000000003}]},{"osd":8,"last update":"Fri Sep 13 17:10:26 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66400000000000003}]},{"osd":9,"last update":"Fri Sep 13 17:12:51 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.60399999999999998,"15min":0.628},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.83799999999999997,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.60999999999999999,"15min":0.64400000000000002},"min":{"1min":0.41099999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71499999999999997,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.52000000000000002}]},{"osd":10,"last update":"Fri Sep 13 17:13:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66300000000000003,"15min":0.67900000000000005},"min":{"1min":0.47399999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.84999999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.65200000000000002,"15min":0.66800000000000004},"min":{"1min":0.45000000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82699999999999996,"5min":0.87,"15min":0.87},"last":0.58699999999999997}]},{"osd":11,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67400000000000004,"15min":0.67700000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.88500000000000001,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.51000000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84899999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.60399999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411413,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1118208,"data_stored":594627,"data_compressed":26642,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:13:10 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.67500000000000004,"15min":0.70899999999999996},"min":{"1min":0.32100000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.79500000000000004,"5min":19.158999999999999,"15min":19.158999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.49299999999999999,"15min":0.47299999999999998},"min":{"1min":0.34300000000000003,"5min":0.316,"15min":0.29699999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.47099999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:13:10 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.55600000000000005,"15min":0.49299999999999999},"min":{"1min":0.35999999999999999,"5min":0.32900000000000001,"15min":0.27900000000000003},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.57799999999999996,"15min":0.495},"min":{"1min":0.42899999999999999,"5min":0.31900000000000001,"15min":0.29599999999999999},"max":{"1min":0.82699999999999996,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.41699999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54800000000000004,"15min":0.51000000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54300000000000004,"15min":0.51100000000000001},"min":{"1min":0.35399999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.49299999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:13:24 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63800000000000001,"15min":0.64000000000000001},"min":{"1min":0.49199999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.83699999999999997,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68000000000000005,"15min":0.68200000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.61099999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:13:15 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.45000000000000001,"15min":0.40799999999999997},"min":{"1min":0.33900000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.78400000000000003,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.46000000000000002,"15min":0.41299999999999998},"min":{"1min":0.36199999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.55100000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:13:41 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.58299999999999996,"15min":0.55300000000000005},"min":{"1min":0.437,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.83699999999999997,"5min":0.875,"15min":0.875},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.71399999999999997,"15min":0.59199999999999997},"min":{"1min":0.42999999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80400000000000005,"5min":19.276,"15min":19.276},"last":0.55800000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:13:29 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69699999999999995,"15min":0.69999999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.89000000000000001,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.72699999999999998,"15min":0.73399999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.85999999999999999,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.72699999999999998}]},{"osd":8,"last update":"Fri Sep 13 17:13:29 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.59199999999999997,"15min":0.55400000000000005},"min":{"1min":0.42099999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.84199999999999997,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.62,"15min":0.57999999999999996},"min":{"1min":0.41199999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86899999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.626}]},{"osd":9,"last update":"Fri Sep 13 17:12:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.65800000000000003,"15min":0.64100000000000001},"min":{"1min":0.48499999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.92700000000000005,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":1.135,"15min":1.341},"min":{"1min":0.46600000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.88,"5min":19.210999999999999,"15min":19.210999999999999},"last":0.64000000000000001}]},{"osd":10,"last update":"Fri Sep 13 17:13:15 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.69299999999999995,"15min":0.66900000000000004},"min":{"1min":0.61699999999999999,"5min":0.495,"15min":0.495},"max":{"1min":0.94199999999999995,"5min":1.01,"15min":1.01},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":1.2749999999999999,"15min":1.488},"min":{"1min":0.53900000000000003,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.90900000000000003,"5min":19.242000000000001,"15min":19.242000000000001},"last":0.67300000000000004}]},{"osd":11,"last update":"Fri Sep 13 17:13:24 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.76900000000000002,"15min":0.78100000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.89600000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.79100000000000004,"15min":0.80300000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91500000000000004,"5min":0.995,"15min":0.995},"last":0.70499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":1101824,"data_stored":592369,"data_compressed":26642,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:12:58 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.49299999999999999,"15min":0.46700000000000003},"min":{"1min":0.33300000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.68000000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.5},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.495,"15min":0.46899999999999997},"min":{"1min":0.28999999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.67400000000000004,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.35499999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:13:13 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.57699999999999996,"15min":0.52000000000000002},"min":{"1min":0.32600000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.754,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56599999999999995,"15min":0.51800000000000002},"min":{"1min":0.38400000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.748,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.49099999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:13:41 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53500000000000003,"15min":0.52300000000000002},"min":{"1min":0.309,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.77200000000000002,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55900000000000005,"15min":0.53200000000000003},"min":{"1min":0.38800000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.438}]},{"osd":4,"last update":"Fri Sep 13 17:10:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.39500000000000002,"15min":0.377},"min":{"1min":0.29199999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.62},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.38100000000000001,"15min":0.36299999999999999},"min":{"1min":0.26600000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:13:22 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.58199999999999996,"15min":0.53100000000000003},"min":{"1min":0.46300000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.82099999999999995,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.625,"5min":0.58399999999999996,"15min":0.52100000000000002},"min":{"1min":0.379,"5min":0.315,"15min":0.315},"max":{"1min":0.73699999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.45100000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:13:41 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.56799999999999995,"15min":0.53300000000000003},"min":{"1min":0.46400000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.80000000000000004,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.59399999999999997,"15min":0.57499999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.69299999999999995,"5min":0.88,"15min":0.88},"last":0.46999999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:13:06 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.50800000000000001,"15min":0.48199999999999998},"min":{"1min":0.34100000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.59899999999999998,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.505,"15min":0.48799999999999999},"min":{"1min":0.33800000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.66200000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.26800000000000002}]},{"osd":8,"last update":"Fri Sep 13 17:13:34 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63900000000000001,"15min":0.621},"min":{"1min":0.46899999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79400000000000004,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.379},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68000000000000005,"15min":0.66500000000000004},"min":{"1min":0.503,"5min":0.434,"15min":0.434},"max":{"1min":0.78200000000000003,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.39800000000000002}]},{"osd":9,"last update":"Fri Sep 13 17:12:51 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.63300000000000001,"15min":0.64100000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72199999999999998,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.68500000000000005,"15min":0.69799999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.85499999999999998,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.47899999999999998}]},{"osd":10,"last update":"Fri Sep 13 17:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.69299999999999995,"15min":0.73699999999999999},"min":{"1min":0.44700000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.69899999999999995,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.65500000000000003,"15min":0.69499999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.70999999999999996,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.41699999999999998}]},{"osd":11,"last update":"Fri Sep 13 17:13:24 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69499999999999995,"15min":0.69799999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.77600000000000002,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.79300000000000004,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.51300000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":1036288,"data_stored":515520,"data_compressed":23656,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.505,"15min":0.47699999999999998},"min":{"1min":0.36199999999999999,"5min":0.27900000000000003,"15min":0.27300000000000002},"max":{"1min":0.70699999999999996,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52300000000000002,"15min":0.49099999999999999},"min":{"1min":0.34599999999999997,"5min":0.28499999999999998,"15min":0.245},"max":{"1min":0.68799999999999994,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.58299999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:13:10 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53600000000000003,"15min":0.51000000000000001},"min":{"1min":0.35799999999999998,"5min":0.35699999999999998,"15min":0.35099999999999998},"max":{"1min":0.72099999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55500000000000005,"15min":0.51500000000000001},"min":{"1min":0.373,"5min":0.33100000000000002,"15min":0.315},"max":{"1min":0.79800000000000004,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.48499999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.377,"15min":0.371},"min":{"1min":0.27700000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.59799999999999998,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.313},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.34899999999999998,"15min":0.34200000000000003},"min":{"1min":0.26100000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.34899999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:12:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52900000000000003,"15min":0.49099999999999999},"min":{"1min":0.39100000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72699999999999998,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.54900000000000004,"15min":0.51200000000000001},"min":{"1min":0.442,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77500000000000002,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52100000000000002,"15min":0.50900000000000001},"min":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82399999999999995,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.54800000000000004,"15min":0.53000000000000003},"min":{"1min":0.42799999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80500000000000005,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.624}]},{"osd":6,"last update":"Fri Sep 13 17:13:43 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.44400000000000001,"15min":0.42199999999999999},"min":{"1min":0.28299999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.68700000000000006,"5min":0.754,"15min":0.754},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.44,"15min":0.42799999999999999},"min":{"1min":0.29399999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.65000000000000002,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.439}]},{"osd":7,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.57199999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40200000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.82499999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.38800000000000001}]},{"osd":8,"last update":"Fri Sep 13 17:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.59099999999999997,"15min":0.60299999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.75800000000000001,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.627,"15min":0.65000000000000002},"min":{"1min":0.39500000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.77500000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.54500000000000004}]},{"osd":9,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.58999999999999997,"15min":0.626},"min":{"1min":0.376,"5min":0.25,"15min":0.25},"max":{"1min":0.748,"5min":0.88,"15min":0.88},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.58899999999999997,"15min":0.621},"min":{"1min":0.374,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.81100000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.496}]},{"osd":10,"last update":"Fri Sep 13 17:13:15 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.67400000000000004,"15min":0.68999999999999995},"min":{"1min":0.47599999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84399999999999997,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.67100000000000004,"15min":0.68700000000000006},"min":{"1min":0.503,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.81799999999999995,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.46200000000000002}]},{"osd":11,"last update":"Fri Sep 13 17:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.77500000000000002,"15min":0.70199999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88,"5min":14.611000000000001,"15min":14.611000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63200000000000001,"15min":0.628},"min":{"1min":0.496,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.80100000000000005,"5min":0.874,"15min":0.874},"last":0.63900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":68128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":70659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":525100,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":134839,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":4203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":393954,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394034,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":202536,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:13:54.518 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-13T17:13:54.518 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:13:54.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.649+0000 7f75b24e9640 1 -- 172.21.15.87:0/1357230235 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75ac101830 msgr2=0x7f75ac109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:54.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.649+0000 7f75b24e9640 1 --2- 172.21.15.87:0/1357230235 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75ac101830 0x7f75ac109d10 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7594009900 tx=0x7f759402a480 comp rx=0 tx=0).stop 2024-09-13T17:13:54.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.649+0000 7f75b24e9640 1 -- 172.21.15.87:0/1357230235 shutdown_connections 2024-09-13T17:13:54.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.649+0000 7f75b24e9640 1 --2- 172.21.15.87:0/1357230235 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75ac10a360 0x7f75ac10c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.649+0000 7f75b24e9640 1 --2- 172.21.15.87:0/1357230235 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75ac101830 0x7f75ac109d10 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.649+0000 7f75b24e9640 1 --2- 172.21.15.87:0/1357230235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75ac100f10 0x7f75ac1012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.649+0000 7f75b24e9640 1 -- 172.21.15.87:0/1357230235 >> 172.21.15.87:0/1357230235 conn(0x7f75ac0fa900 msgr2=0x7f75ac0fcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:54.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.649+0000 7f75b24e9640 1 -- 172.21.15.87:0/1357230235 shutdown_connections 2024-09-13T17:13:54.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.649+0000 7f75b24e9640 1 -- 172.21.15.87:0/1357230235 wait complete. 2024-09-13T17:13:54.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.650+0000 7f75b24e9640 1 Processor -- start 2024-09-13T17:13:54.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.650+0000 7f75b24e9640 1 -- start start 2024-09-13T17:13:54.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.650+0000 7f75b24e9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75ac100f10 0x7f75ac196270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:54.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.650+0000 7f75b24e9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75ac101830 0x7f75ac1967b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:54.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.650+0000 7f75b24e9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75ac10a360 0x7f75ac19aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:54.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.650+0000 7f75b24e9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac19b1a0 con 0x7f75ac10a360 2024-09-13T17:13:54.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.650+0000 7f75b24e9640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac19b310 con 0x7f75ac101830 2024-09-13T17:13:54.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.650+0000 7f75b24e9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac19b4d0 con 0x7f75ac100f10 2024-09-13T17:13:54.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.650+0000 7f75b0a86640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75ac10a360 0x7f75ac19aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:54.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.650+0000 7f75b0a86640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75ac10a360 0x7f75ac19aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41906/0 (socket says 172.21.15.87:41906) 2024-09-13T17:13:54.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.650+0000 7f75b0a86640 1 -- 172.21.15.87:0/3122360579 learned_addr learned my addr 172.21.15.87:0/3122360579 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:54.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.650+0000 7f75abfff640 1 --2- 172.21.15.87:0/3122360579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75ac100f10 0x7f75ac196270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:54.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.650+0000 7f75b0a86640 1 -- 172.21.15.87:0/3122360579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75ac100f10 msgr2=0x7f75ac196270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:54.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.650+0000 7f75b0a86640 1 --2- 172.21.15.87:0/3122360579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75ac100f10 0x7f75ac196270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.650+0000 7f75b0a86640 1 -- 172.21.15.87:0/3122360579 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75ac101830 msgr2=0x7f75ac1967b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:54.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.650+0000 7f75a3fff640 1 --2- 172.21.15.87:0/3122360579 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75ac101830 0x7f75ac1967b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:54.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.650+0000 7f75b0a86640 1 --2- 172.21.15.87:0/3122360579 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75ac101830 0x7f75ac1967b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.650+0000 7f75b0a86640 1 -- 172.21.15.87:0/3122360579 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7594009560 con 0x7f75ac10a360 2024-09-13T17:13:54.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.650+0000 7f75abfff640 1 --2- 172.21.15.87:0/3122360579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75ac100f10 0x7f75ac196270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:54.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.651+0000 7f75b0a86640 1 --2- 172.21.15.87:0/3122360579 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75ac10a360 0x7f75ac19aba0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f75a4009fd0 tx=0x7f75a400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:54.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.651+0000 7f75a9ffb640 1 -- 172.21.15.87:0/3122360579 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a400bea0 con 0x7f75ac10a360 2024-09-13T17:13:54.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.651+0000 7f75b24e9640 1 -- 172.21.15.87:0/3122360579 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75ac19b7b0 con 0x7f75ac10a360 2024-09-13T17:13:54.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.651+0000 7f75a9ffb640 1 -- 172.21.15.87:0/3122360579 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f75a4009940 con 0x7f75ac10a360 2024-09-13T17:13:54.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.651+0000 7f75a9ffb640 1 -- 172.21.15.87:0/3122360579 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a40106c0 con 0x7f75ac10a360 2024-09-13T17:13:54.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.651+0000 7f75b24e9640 1 -- 172.21.15.87:0/3122360579 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75ac1a3030 con 0x7f75ac10a360 2024-09-13T17:13:54.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.652+0000 7f75b24e9640 1 -- 172.21.15.87:0/3122360579 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75ac068ed0 con 0x7f75ac10a360 2024-09-13T17:13:54.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.653+0000 7f75a9ffb640 1 -- 172.21.15.87:0/3122360579 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 24) v1 ==== 136049+0+0 (secure 0 0 0) 0x7f75a4004a40 con 0x7f75ac10a360 2024-09-13T17:13:54.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.653+0000 7f75a9ffb640 1 --2- 172.21.15.87:0/3122360579 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f75980a1290 0x7f75980a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:54.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.654+0000 7f75a9ffb640 1 -- 172.21.15.87:0/3122360579 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f75a40ccfd0 con 0x7f75ac10a360 2024-09-13T17:13:54.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.654+0000 7f75abfff640 1 --2- 172.21.15.87:0/3122360579 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f75980a1290 0x7f75980a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:54.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.654+0000 7f75abfff640 1 --2- 172.21.15.87:0/3122360579 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f75980a1290 0x7f75980a3750 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f759c00baa0 tx=0x7f759c005d90 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:54.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.656+0000 7f75a9ffb640 1 -- 172.21.15.87:0/3122360579 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f75a4095f00 con 0x7f75ac10a360 2024-09-13T17:13:54.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.815+0000 7f75b24e9640 1 -- 172.21.15.87:0/3122360579 --> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f75ac1975c0 con 0x7f75980a1290 2024-09-13T17:13:54.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.825+0000 7f75a9ffb640 1 -- 172.21.15.87:0/3122360579 <== mgr.15507 v2:172.21.15.87:6800/157129242 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+427670 (secure 0 0 0) 0x7f75ac1975c0 con 0x7f75980a1290 2024-09-13T17:13:54.831 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:13:54.834 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-13T17:13:54.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.829+0000 7f75b24e9640 1 -- 172.21.15.87:0/3122360579 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f75980a1290 msgr2=0x7f75980a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:54.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.829+0000 7f75b24e9640 1 --2- 172.21.15.87:0/3122360579 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f75980a1290 0x7f75980a3750 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f759c00baa0 tx=0x7f759c005d90 comp rx=0 tx=0).stop 2024-09-13T17:13:54.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.829+0000 7f75b24e9640 1 -- 172.21.15.87:0/3122360579 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75ac10a360 msgr2=0x7f75ac19aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:54.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.829+0000 7f75b24e9640 1 --2- 172.21.15.87:0/3122360579 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75ac10a360 0x7f75ac19aba0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f75a4009fd0 tx=0x7f75a400b260 comp rx=0 tx=0).stop 2024-09-13T17:13:54.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.829+0000 7f75b24e9640 1 -- 172.21.15.87:0/3122360579 shutdown_connections 2024-09-13T17:13:54.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.829+0000 7f75b24e9640 1 --2- 172.21.15.87:0/3122360579 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f75980a1290 0x7f75980a3750 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.829+0000 7f75b24e9640 1 --2- 172.21.15.87:0/3122360579 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75ac10a360 0x7f75ac19aba0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.829+0000 7f75b24e9640 1 --2- 172.21.15.87:0/3122360579 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75ac101830 0x7f75ac1967b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.829+0000 7f75b24e9640 1 --2- 172.21.15.87:0/3122360579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75ac100f10 0x7f75ac196270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.829+0000 7f75b24e9640 1 -- 172.21.15.87:0/3122360579 >> 172.21.15.87:0/3122360579 conn(0x7f75ac0fa900 msgr2=0x7f75ac0fc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:54.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.829+0000 7f75b24e9640 1 -- 172.21.15.87:0/3122360579 shutdown_connections 2024-09-13T17:13:54.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.829+0000 7f75b24e9640 1 -- 172.21.15.87:0/3122360579 wait complete. 2024-09-13T17:13:54.841 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-13T17:13:53.397361+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1190149,"num_objects":66,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1000,"num_read_kb":663,"num_write":472,"num_write_kb":4384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1181900,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":869,"ondisk_log_size":869,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":377892,"kb_used_data":12704,"kb_used_omap":18,"kb_used_meta":365037,"kb_avail":1124563932,"statfs":{"total":1151940427776,"available":1151553466368,"internally_reserved":0,"allocated":13008896,"data_stored":9881725,"data_compressed":501701,"data_compressed_allocated":671744,"data_compressed_original":4194304,"omap_allocated":19109,"internal_metadata":373798235},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.986729"},"pg_stats":[{"pgid":"2.1f","version":"89'9","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:27.569619+0000","last_change":"2024-09-13T17:12:50.228849+0000","last_active":"2024-09-13T17:13:27.569619+0000","last_peered":"2024-09-13T17:13:27.569619+0000","last_clean":"2024-09-13T17:13:27.569619+0000","last_became_active":"2024-09-13T17:12:50.221697+0000","last_became_peered":"2024-09-13T17:12:50.221697+0000","last_unstale":"2024-09-13T17:13:27.569619+0000","last_undegraded":"2024-09-13T17:13:27.569619+0000","last_fullsized":"2024-09-13T17:13:27.569619+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:45.356785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"93'5","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:25.608822+0000","last_change":"2024-09-13T17:11:23.340108+0000","last_active":"2024-09-13T17:13:25.608822+0000","last_peered":"2024-09-13T17:13:25.608822+0000","last_clean":"2024-09-13T17:13:25.608822+0000","last_became_active":"2024-09-13T17:11:23.339832+0000","last_became_peered":"2024-09-13T17:11:23.339832+0000","last_unstale":"2024-09-13T17:13:25.608822+0000","last_undegraded":"2024-09-13T17:13:25.608822+0000","last_fullsized":"2024-09-13T17:13:25.608822+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:40.969448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.761732+0000","last_change":"2024-09-13T17:12:50.761228+0000","last_active":"2024-09-13T17:12:50.761732+0000","last_peered":"2024-09-13T17:12:50.761732+0000","last_clean":"2024-09-13T17:12:50.761732+0000","last_became_active":"2024-09-13T17:12:50.760842+0000","last_became_peered":"2024-09-13T17:12:50.760842+0000","last_unstale":"2024-09-13T17:12:50.761732+0000","last_undegraded":"2024-09-13T17:12:50.761732+0000","last_fullsized":"2024-09-13T17:12:50.761732+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:30.513246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,10,0],"acting":[2,3,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:25.608843+0000","last_change":"2024-09-13T17:11:23.000779+0000","last_active":"2024-09-13T17:13:25.608843+0000","last_peered":"2024-09-13T17:13:25.608843+0000","last_clean":"2024-09-13T17:13:25.608843+0000","last_became_active":"2024-09-13T17:11:23.000511+0000","last_became_peered":"2024-09-13T17:11:23.000511+0000","last_unstale":"2024-09-13T17:13:25.608843+0000","last_undegraded":"2024-09-13T17:13:25.608843+0000","last_fullsized":"2024-09-13T17:13:25.608843+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:09.802392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"93'6","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:29.121714+0000","last_change":"2024-09-13T17:11:23.333948+0000","last_active":"2024-09-13T17:13:29.121714+0000","last_peered":"2024-09-13T17:13:29.121714+0000","last_clean":"2024-09-13T17:13:29.121714+0000","last_became_active":"2024-09-13T17:11:23.333679+0000","last_became_peered":"2024-09-13T17:11:23.333679+0000","last_unstale":"2024-09-13T17:13:29.121714+0000","last_undegraded":"2024-09-13T17:13:29.121714+0000","last_fullsized":"2024-09-13T17:13:29.121714+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:10.265157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.212722+0000","last_change":"2024-09-13T17:11:27.353767+0000","last_active":"2024-09-13T17:12:50.212722+0000","last_peered":"2024-09-13T17:12:50.212722+0000","last_clean":"2024-09-13T17:12:50.212722+0000","last_became_active":"2024-09-13T17:11:27.353448+0000","last_became_peered":"2024-09-13T17:11:27.353448+0000","last_unstale":"2024-09-13T17:12:50.212722+0000","last_undegraded":"2024-09-13T17:12:50.212722+0000","last_fullsized":"2024-09-13T17:12:50.212722+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:48:15.948099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.217794+0000","last_change":"2024-09-13T17:11:22.999879+0000","last_active":"2024-09-13T17:12:50.217794+0000","last_peered":"2024-09-13T17:12:50.217794+0000","last_clean":"2024-09-13T17:12:50.217794+0000","last_became_active":"2024-09-13T17:11:22.999577+0000","last_became_peered":"2024-09-13T17:11:22.999577+0000","last_unstale":"2024-09-13T17:12:50.217794+0000","last_undegraded":"2024-09-13T17:12:50.217794+0000","last_fullsized":"2024-09-13T17:12:50.217794+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:48.485532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"93'9","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:18.082355+0000","last_change":"2024-09-13T17:11:23.339026+0000","last_active":"2024-09-13T17:13:18.082355+0000","last_peered":"2024-09-13T17:13:18.082355+0000","last_clean":"2024-09-13T17:13:18.082355+0000","last_became_active":"2024-09-13T17:11:23.338745+0000","last_became_peered":"2024-09-13T17:11:23.338745+0000","last_unstale":"2024-09-13T17:13:18.082355+0000","last_undegraded":"2024-09-13T17:13:18.082355+0000","last_fullsized":"2024-09-13T17:13:18.082355+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:27.455418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.213246+0000","last_change":"2024-09-13T17:11:27.363137+0000","last_active":"2024-09-13T17:12:50.213246+0000","last_peered":"2024-09-13T17:12:50.213246+0000","last_clean":"2024-09-13T17:12:50.213246+0000","last_became_active":"2024-09-13T17:11:27.362621+0000","last_became_peered":"2024-09-13T17:11:27.362621+0000","last_unstale":"2024-09-13T17:12:50.213246+0000","last_undegraded":"2024-09-13T17:12:50.213246+0000","last_fullsized":"2024-09-13T17:12:50.213246+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:35:51.492630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.226893+0000","last_change":"2024-09-13T17:12:50.226520+0000","last_active":"2024-09-13T17:12:50.226893+0000","last_peered":"2024-09-13T17:12:50.226893+0000","last_clean":"2024-09-13T17:12:50.226893+0000","last_became_active":"2024-09-13T17:12:50.223542+0000","last_became_peered":"2024-09-13T17:12:50.223542+0000","last_unstale":"2024-09-13T17:12:50.226893+0000","last_undegraded":"2024-09-13T17:12:50.226893+0000","last_fullsized":"2024-09-13T17:12:50.226893+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:38.064047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"93'15","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:18.077694+0000","last_change":"2024-09-13T17:11:23.336778+0000","last_active":"2024-09-13T17:13:18.077694+0000","last_peered":"2024-09-13T17:13:18.077694+0000","last_clean":"2024-09-13T17:13:18.077694+0000","last_became_active":"2024-09-13T17:11:23.336491+0000","last_became_peered":"2024-09-13T17:11:23.336491+0000","last_unstale":"2024-09-13T17:13:18.077694+0000","last_undegraded":"2024-09-13T17:13:18.077694+0000","last_fullsized":"2024-09-13T17:13:18.077694+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:02.045912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.213069+0000","last_change":"2024-09-13T17:11:27.361454+0000","last_active":"2024-09-13T17:12:50.213069+0000","last_peered":"2024-09-13T17:12:50.213069+0000","last_clean":"2024-09-13T17:12:50.213069+0000","last_became_active":"2024-09-13T17:11:27.360980+0000","last_became_peered":"2024-09-13T17:11:27.360980+0000","last_unstale":"2024-09-13T17:12:50.213069+0000","last_undegraded":"2024-09-13T17:12:50.213069+0000","last_fullsized":"2024-09-13T17:12:50.213069+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:36.036426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"93'5","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:33.513046+0000","last_change":"2024-09-13T17:11:23.334073+0000","last_active":"2024-09-13T17:13:33.513046+0000","last_peered":"2024-09-13T17:13:33.513046+0000","last_clean":"2024-09-13T17:13:33.513046+0000","last_became_active":"2024-09-13T17:11:23.333628+0000","last_became_peered":"2024-09-13T17:11:23.333628+0000","last_unstale":"2024-09-13T17:13:33.513046+0000","last_undegraded":"2024-09-13T17:13:33.513046+0000","last_fullsized":"2024-09-13T17:13:33.513046+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:18.561346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:38.434680+0000","last_change":"2024-09-13T17:12:50.229697+0000","last_active":"2024-09-13T17:13:38.434680+0000","last_peered":"2024-09-13T17:13:38.434680+0000","last_clean":"2024-09-13T17:13:38.434680+0000","last_became_active":"2024-09-13T17:12:50.224286+0000","last_became_peered":"2024-09-13T17:12:50.224286+0000","last_unstale":"2024-09-13T17:13:38.434680+0000","last_undegraded":"2024-09-13T17:13:38.434680+0000","last_fullsized":"2024-09-13T17:13:38.434680+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:42.724176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.609612+0000","last_change":"2024-09-13T17:11:27.355472+0000","last_active":"2024-09-13T17:13:49.609612+0000","last_peered":"2024-09-13T17:13:49.609612+0000","last_clean":"2024-09-13T17:13:49.609612+0000","last_became_active":"2024-09-13T17:11:27.355065+0000","last_became_peered":"2024-09-13T17:11:27.355065+0000","last_unstale":"2024-09-13T17:13:49.609612+0000","last_undegraded":"2024-09-13T17:13:49.609612+0000","last_fullsized":"2024-09-13T17:13:49.609612+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:03.881097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"93'8","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:40.610299+0000","last_change":"2024-09-13T17:11:23.340268+0000","last_active":"2024-09-13T17:13:40.610299+0000","last_peered":"2024-09-13T17:13:40.610299+0000","last_clean":"2024-09-13T17:13:40.610299+0000","last_became_active":"2024-09-13T17:11:23.339977+0000","last_became_peered":"2024-09-13T17:11:23.339977+0000","last_unstale":"2024-09-13T17:13:40.610299+0000","last_undegraded":"2024-09-13T17:13:40.610299+0000","last_fullsized":"2024-09-13T17:13:40.610299+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:21.067899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"94'2","reported_seq":24,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.385251+0000","last_change":"2024-09-13T17:11:23.000858+0000","last_active":"2024-09-13T17:13:49.385251+0000","last_peered":"2024-09-13T17:13:49.385251+0000","last_clean":"2024-09-13T17:13:49.385251+0000","last_became_active":"2024-09-13T17:11:23.000536+0000","last_became_peered":"2024-09-13T17:11:23.000536+0000","last_unstale":"2024-09-13T17:13:49.385251+0000","last_undegraded":"2024-09-13T17:13:49.385251+0000","last_fullsized":"2024-09-13T17:13:49.385251+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:28.798579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":19,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.609588+0000","last_change":"2024-09-13T17:11:27.354018+0000","last_active":"2024-09-13T17:13:49.609588+0000","last_peered":"2024-09-13T17:13:49.609588+0000","last_clean":"2024-09-13T17:13:49.609588+0000","last_became_active":"2024-09-13T17:11:27.353519+0000","last_became_peered":"2024-09-13T17:11:27.353519+0000","last_unstale":"2024-09-13T17:13:49.609588+0000","last_undegraded":"2024-09-13T17:13:49.609588+0000","last_fullsized":"2024-09-13T17:13:49.609588+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:55.227851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"93'9","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:35.023706+0000","last_change":"2024-09-13T17:11:23.335798+0000","last_active":"2024-09-13T17:13:35.023706+0000","last_peered":"2024-09-13T17:13:35.023706+0000","last_clean":"2024-09-13T17:13:35.023706+0000","last_became_active":"2024-09-13T17:11:23.335445+0000","last_became_peered":"2024-09-13T17:11:23.335445+0000","last_unstale":"2024-09-13T17:13:35.023706+0000","last_undegraded":"2024-09-13T17:13:35.023706+0000","last_fullsized":"2024-09-13T17:13:35.023706+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:53.242067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:35.609814+0000","last_change":"2024-09-13T17:11:22.994118+0000","last_active":"2024-09-13T17:13:35.609814+0000","last_peered":"2024-09-13T17:13:35.609814+0000","last_clean":"2024-09-13T17:13:35.609814+0000","last_became_active":"2024-09-13T17:11:22.993801+0000","last_became_peered":"2024-09-13T17:11:22.993801+0000","last_unstale":"2024-09-13T17:13:35.609814+0000","last_undegraded":"2024-09-13T17:13:35.609814+0000","last_fullsized":"2024-09-13T17:13:35.609814+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:01.382130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:42.571068+0000","last_change":"2024-09-13T17:11:27.358795+0000","last_active":"2024-09-13T17:13:42.571068+0000","last_peered":"2024-09-13T17:13:42.571068+0000","last_clean":"2024-09-13T17:13:42.571068+0000","last_became_active":"2024-09-13T17:11:27.358166+0000","last_became_peered":"2024-09-13T17:11:27.358166+0000","last_unstale":"2024-09-13T17:13:42.571068+0000","last_undegraded":"2024-09-13T17:13:42.571068+0000","last_fullsized":"2024-09-13T17:13:42.571068+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:23.787842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"93'2","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:33.433908+0000","last_change":"2024-09-13T17:11:23.340671+0000","last_active":"2024-09-13T17:13:33.433908+0000","last_peered":"2024-09-13T17:13:33.433908+0000","last_clean":"2024-09-13T17:13:33.433908+0000","last_became_active":"2024-09-13T17:11:23.340360+0000","last_became_peered":"2024-09-13T17:11:23.340360+0000","last_unstale":"2024-09-13T17:13:33.433908+0000","last_undegraded":"2024-09-13T17:13:33.433908+0000","last_fullsized":"2024-09-13T17:13:33.433908+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:17.875171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:35.294965+0000","last_change":"2024-09-13T17:11:22.993039+0000","last_active":"2024-09-13T17:13:35.294965+0000","last_peered":"2024-09-13T17:13:35.294965+0000","last_clean":"2024-09-13T17:13:35.294965+0000","last_became_active":"2024-09-13T17:11:22.992701+0000","last_became_peered":"2024-09-13T17:11:22.992701+0000","last_unstale":"2024-09-13T17:13:35.294965+0000","last_undegraded":"2024-09-13T17:13:35.294965+0000","last_fullsized":"2024-09-13T17:13:35.294965+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:28.168646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.609970+0000","last_change":"2024-09-13T17:11:27.363834+0000","last_active":"2024-09-13T17:13:49.609970+0000","last_peered":"2024-09-13T17:13:49.609970+0000","last_clean":"2024-09-13T17:13:49.609970+0000","last_became_active":"2024-09-13T17:11:27.363425+0000","last_became_peered":"2024-09-13T17:11:27.363425+0000","last_unstale":"2024-09-13T17:13:49.609970+0000","last_undegraded":"2024-09-13T17:13:49.609970+0000","last_fullsized":"2024-09-13T17:13:49.609970+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:37.389881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"93'7","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:34.122246+0000","last_change":"2024-09-13T17:11:23.337423+0000","last_active":"2024-09-13T17:13:34.122246+0000","last_peered":"2024-09-13T17:13:34.122246+0000","last_clean":"2024-09-13T17:13:34.122246+0000","last_became_active":"2024-09-13T17:11:23.337167+0000","last_became_peered":"2024-09-13T17:11:23.337167+0000","last_unstale":"2024-09-13T17:13:34.122246+0000","last_undegraded":"2024-09-13T17:13:34.122246+0000","last_fullsized":"2024-09-13T17:13:34.122246+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:28.540283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:34.553531+0000","last_change":"2024-09-13T17:11:23.000486+0000","last_active":"2024-09-13T17:13:34.553531+0000","last_peered":"2024-09-13T17:13:34.553531+0000","last_clean":"2024-09-13T17:13:34.553531+0000","last_became_active":"2024-09-13T17:11:23.000158+0000","last_became_peered":"2024-09-13T17:11:23.000158+0000","last_unstale":"2024-09-13T17:13:34.553531+0000","last_undegraded":"2024-09-13T17:13:34.553531+0000","last_fullsized":"2024-09-13T17:13:34.553531+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:42.635037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:33.073032+0000","last_change":"2024-09-13T17:11:27.355058+0000","last_active":"2024-09-13T17:13:33.073032+0000","last_peered":"2024-09-13T17:13:33.073032+0000","last_clean":"2024-09-13T17:13:33.073032+0000","last_became_active":"2024-09-13T17:11:27.354726+0000","last_became_peered":"2024-09-13T17:11:27.354726+0000","last_unstale":"2024-09-13T17:13:33.073032+0000","last_undegraded":"2024-09-13T17:13:33.073032+0000","last_fullsized":"2024-09-13T17:13:33.073032+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:58.450122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"93'5","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:35.609884+0000","last_change":"2024-09-13T17:11:23.337245+0000","last_active":"2024-09-13T17:13:35.609884+0000","last_peered":"2024-09-13T17:13:35.609884+0000","last_clean":"2024-09-13T17:13:35.609884+0000","last_became_active":"2024-09-13T17:11:23.336956+0000","last_became_peered":"2024-09-13T17:11:23.336956+0000","last_unstale":"2024-09-13T17:13:35.609884+0000","last_undegraded":"2024-09-13T17:13:35.609884+0000","last_fullsized":"2024-09-13T17:13:35.609884+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:46.876149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"94'42","reported_seq":87,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.582838+0000","last_change":"2024-09-13T17:11:22.999942+0000","last_active":"2024-09-13T17:13:49.582838+0000","last_peered":"2024-09-13T17:13:49.582838+0000","last_clean":"2024-09-13T17:13:49.582838+0000","last_became_active":"2024-09-13T17:11:22.999653+0000","last_became_peered":"2024-09-13T17:11:22.999653+0000","last_unstale":"2024-09-13T17:13:49.582838+0000","last_undegraded":"2024-09-13T17:13:49.582838+0000","last_fullsized":"2024-09-13T17:13:49.582838+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:29.400939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":75,"num_write_kb":835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:30.609223+0000","last_change":"2024-09-13T17:11:27.356479+0000","last_active":"2024-09-13T17:13:30.609223+0000","last_peered":"2024-09-13T17:13:30.609223+0000","last_clean":"2024-09-13T17:13:30.609223+0000","last_became_active":"2024-09-13T17:11:27.356052+0000","last_became_peered":"2024-09-13T17:11:27.356052+0000","last_unstale":"2024-09-13T17:13:30.609223+0000","last_undegraded":"2024-09-13T17:13:30.609223+0000","last_fullsized":"2024-09-13T17:13:30.609223+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:42.173376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"93'9","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:30.615414+0000","last_change":"2024-09-13T17:11:23.333786+0000","last_active":"2024-09-13T17:13:30.615414+0000","last_peered":"2024-09-13T17:13:30.615414+0000","last_clean":"2024-09-13T17:13:30.615414+0000","last_became_active":"2024-09-13T17:11:23.333472+0000","last_became_peered":"2024-09-13T17:11:23.333472+0000","last_unstale":"2024-09-13T17:13:30.615414+0000","last_undegraded":"2024-09-13T17:13:30.615414+0000","last_fullsized":"2024-09-13T17:13:30.615414+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:41.633228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:28.433423+0000","last_change":"2024-09-13T17:11:22.998646+0000","last_active":"2024-09-13T17:13:28.433423+0000","last_peered":"2024-09-13T17:13:28.433423+0000","last_clean":"2024-09-13T17:13:28.433423+0000","last_became_active":"2024-09-13T17:11:22.998291+0000","last_became_peered":"2024-09-13T17:11:22.998291+0000","last_unstale":"2024-09-13T17:13:28.433423+0000","last_undegraded":"2024-09-13T17:13:28.433423+0000","last_fullsized":"2024-09-13T17:13:28.433423+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:20.658436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:35.023722+0000","last_change":"2024-09-13T17:11:27.361174+0000","last_active":"2024-09-13T17:13:35.023722+0000","last_peered":"2024-09-13T17:13:35.023722+0000","last_clean":"2024-09-13T17:13:35.023722+0000","last_became_active":"2024-09-13T17:11:27.360737+0000","last_became_peered":"2024-09-13T17:11:27.360737+0000","last_unstale":"2024-09-13T17:13:35.023722+0000","last_undegraded":"2024-09-13T17:13:35.023722+0000","last_fullsized":"2024-09-13T17:13:35.023722+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:00.941364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"93'4","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:29.461649+0000","last_change":"2024-09-13T17:11:23.338545+0000","last_active":"2024-09-13T17:13:29.461649+0000","last_peered":"2024-09-13T17:13:29.461649+0000","last_clean":"2024-09-13T17:13:29.461649+0000","last_became_active":"2024-09-13T17:11:23.338246+0000","last_became_peered":"2024-09-13T17:11:23.338246+0000","last_unstale":"2024-09-13T17:13:29.461649+0000","last_undegraded":"2024-09-13T17:13:29.461649+0000","last_fullsized":"2024-09-13T17:13:29.461649+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:18.966658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:27.569578+0000","last_change":"2024-09-13T17:11:22.993497+0000","last_active":"2024-09-13T17:13:27.569578+0000","last_peered":"2024-09-13T17:13:27.569578+0000","last_clean":"2024-09-13T17:13:27.569578+0000","last_became_active":"2024-09-13T17:11:22.993165+0000","last_became_peered":"2024-09-13T17:11:22.993165+0000","last_unstale":"2024-09-13T17:13:27.569578+0000","last_undegraded":"2024-09-13T17:13:27.569578+0000","last_fullsized":"2024-09-13T17:13:27.569578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:20.997834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:33.433950+0000","last_change":"2024-09-13T17:11:27.364652+0000","last_active":"2024-09-13T17:13:33.433950+0000","last_peered":"2024-09-13T17:13:33.433950+0000","last_clean":"2024-09-13T17:13:33.433950+0000","last_became_active":"2024-09-13T17:11:27.364245+0000","last_became_peered":"2024-09-13T17:11:27.364245+0000","last_unstale":"2024-09-13T17:13:33.433950+0000","last_undegraded":"2024-09-13T17:13:33.433950+0000","last_fullsized":"2024-09-13T17:13:33.433950+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:23.048289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"93'7","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:29.461627+0000","last_change":"2024-09-13T17:11:23.335649+0000","last_active":"2024-09-13T17:13:29.461627+0000","last_peered":"2024-09-13T17:13:29.461627+0000","last_clean":"2024-09-13T17:13:29.461627+0000","last_became_active":"2024-09-13T17:11:23.335364+0000","last_became_peered":"2024-09-13T17:11:23.335364+0000","last_unstale":"2024-09-13T17:13:29.461627+0000","last_undegraded":"2024-09-13T17:13:29.461627+0000","last_fullsized":"2024-09-13T17:13:29.461627+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:21.447947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:28.512345+0000","last_change":"2024-09-13T17:11:23.003188+0000","last_active":"2024-09-13T17:13:28.512345+0000","last_peered":"2024-09-13T17:13:28.512345+0000","last_clean":"2024-09-13T17:13:28.512345+0000","last_became_active":"2024-09-13T17:11:23.002858+0000","last_became_peered":"2024-09-13T17:11:23.002858+0000","last_unstale":"2024-09-13T17:13:28.512345+0000","last_undegraded":"2024-09-13T17:13:28.512345+0000","last_fullsized":"2024-09-13T17:13:28.512345+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:34.153326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:35.616036+0000","last_change":"2024-09-13T17:11:27.353320+0000","last_active":"2024-09-13T17:13:35.616036+0000","last_peered":"2024-09-13T17:13:35.616036+0000","last_clean":"2024-09-13T17:13:35.616036+0000","last_became_active":"2024-09-13T17:11:27.352947+0000","last_became_peered":"2024-09-13T17:11:27.352947+0000","last_unstale":"2024-09-13T17:13:35.616036+0000","last_undegraded":"2024-09-13T17:13:35.616036+0000","last_fullsized":"2024-09-13T17:13:35.616036+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:04.619618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"93'8","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:27.047981+0000","last_change":"2024-09-13T17:11:23.330128+0000","last_active":"2024-09-13T17:13:27.047981+0000","last_peered":"2024-09-13T17:13:27.047981+0000","last_clean":"2024-09-13T17:13:27.047981+0000","last_became_active":"2024-09-13T17:11:23.329266+0000","last_became_peered":"2024-09-13T17:11:23.329266+0000","last_unstale":"2024-09-13T17:13:27.047981+0000","last_undegraded":"2024-09-13T17:13:27.047981+0000","last_fullsized":"2024-09-13T17:13:27.047981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:36.275352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"93'5","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.401642+0000","last_change":"2024-09-13T17:11:23.003495+0000","last_active":"2024-09-13T17:13:49.401642+0000","last_peered":"2024-09-13T17:13:49.401642+0000","last_clean":"2024-09-13T17:13:49.401642+0000","last_became_active":"2024-09-13T17:11:23.003186+0000","last_became_peered":"2024-09-13T17:11:23.003186+0000","last_unstale":"2024-09-13T17:13:49.401642+0000","last_undegraded":"2024-09-13T17:13:49.401642+0000","last_fullsized":"2024-09-13T17:13:49.401642+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:23.353587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":123,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:40.616521+0000","last_change":"2024-09-13T17:11:27.362233+0000","last_active":"2024-09-13T17:13:40.616521+0000","last_peered":"2024-09-13T17:13:40.616521+0000","last_clean":"2024-09-13T17:13:40.616521+0000","last_became_active":"2024-09-13T17:11:27.361814+0000","last_became_peered":"2024-09-13T17:11:27.361814+0000","last_unstale":"2024-09-13T17:13:40.616521+0000","last_undegraded":"2024-09-13T17:13:40.616521+0000","last_fullsized":"2024-09-13T17:13:40.616521+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:20.723366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"93'5","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:30.615308+0000","last_change":"2024-09-13T17:11:23.332870+0000","last_active":"2024-09-13T17:13:30.615308+0000","last_peered":"2024-09-13T17:13:30.615308+0000","last_clean":"2024-09-13T17:13:30.615308+0000","last_became_active":"2024-09-13T17:11:23.332583+0000","last_became_peered":"2024-09-13T17:11:23.332583+0000","last_unstale":"2024-09-13T17:13:30.615308+0000","last_undegraded":"2024-09-13T17:13:30.615308+0000","last_fullsized":"2024-09-13T17:13:30.615308+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:22.607666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:23.511795+0000","last_change":"2024-09-13T17:11:23.001932+0000","last_active":"2024-09-13T17:13:23.511795+0000","last_peered":"2024-09-13T17:13:23.511795+0000","last_clean":"2024-09-13T17:13:23.511795+0000","last_became_active":"2024-09-13T17:11:23.001642+0000","last_became_peered":"2024-09-13T17:11:23.001642+0000","last_unstale":"2024-09-13T17:13:23.511795+0000","last_undegraded":"2024-09-13T17:13:23.511795+0000","last_fullsized":"2024-09-13T17:13:23.511795+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:05.976897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:37.049232+0000","last_change":"2024-09-13T17:11:27.359679+0000","last_active":"2024-09-13T17:13:37.049232+0000","last_peered":"2024-09-13T17:13:37.049232+0000","last_clean":"2024-09-13T17:13:37.049232+0000","last_became_active":"2024-09-13T17:11:27.359268+0000","last_became_peered":"2024-09-13T17:11:27.359268+0000","last_unstale":"2024-09-13T17:13:37.049232+0000","last_undegraded":"2024-09-13T17:13:37.049232+0000","last_fullsized":"2024-09-13T17:13:37.049232+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:48.154917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"93'8","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:30.609274+0000","last_change":"2024-09-13T17:11:23.340031+0000","last_active":"2024-09-13T17:13:30.609274+0000","last_peered":"2024-09-13T17:13:30.609274+0000","last_clean":"2024-09-13T17:13:30.609274+0000","last_became_active":"2024-09-13T17:11:23.339768+0000","last_became_peered":"2024-09-13T17:11:23.339768+0000","last_unstale":"2024-09-13T17:13:30.609274+0000","last_undegraded":"2024-09-13T17:13:30.609274+0000","last_fullsized":"2024-09-13T17:13:30.609274+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:22.360526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:29.552779+0000","last_change":"2024-09-13T17:11:22.995060+0000","last_active":"2024-09-13T17:13:29.552779+0000","last_peered":"2024-09-13T17:13:29.552779+0000","last_clean":"2024-09-13T17:13:29.552779+0000","last_became_active":"2024-09-13T17:11:22.991949+0000","last_became_peered":"2024-09-13T17:11:22.991949+0000","last_unstale":"2024-09-13T17:13:29.552779+0000","last_undegraded":"2024-09-13T17:13:29.552779+0000","last_fullsized":"2024-09-13T17:13:29.552779+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:44.716753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":344,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:03.509232+0000","last_change":"2024-09-13T17:10:13.439723+0000","last_active":"2024-09-13T17:13:03.509232+0000","last_peered":"2024-09-13T17:13:03.509232+0000","last_clean":"2024-09-13T17:13:03.509232+0000","last_became_active":"2024-09-13T17:10:13.439290+0000","last_became_peered":"2024-09-13T17:10:13.439290+0000","last_unstale":"2024-09-13T17:13:03.509232+0000","last_undegraded":"2024-09-13T17:13:03.509232+0000","last_fullsized":"2024-09-13T17:13:03.509232+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:07:03.041486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:07:03.041486+0000","last_clean_scrub_stamp":"2024-09-13T17:07:03.041486+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:08.673571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":19,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:33.513108+0000","last_change":"2024-09-13T17:11:27.361028+0000","last_active":"2024-09-13T17:13:33.513108+0000","last_peered":"2024-09-13T17:13:33.513108+0000","last_clean":"2024-09-13T17:13:33.513108+0000","last_became_active":"2024-09-13T17:11:27.360630+0000","last_became_peered":"2024-09-13T17:11:27.360630+0000","last_unstale":"2024-09-13T17:13:33.513108+0000","last_undegraded":"2024-09-13T17:13:33.513108+0000","last_fullsized":"2024-09-13T17:13:33.513108+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:40:40.860443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"93'7","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:38.513709+0000","last_change":"2024-09-13T17:11:49.798729+0000","last_active":"2024-09-13T17:13:38.513709+0000","last_peered":"2024-09-13T17:13:38.513709+0000","last_clean":"2024-09-13T17:13:38.513709+0000","last_became_active":"2024-09-13T17:11:49.798402+0000","last_became_peered":"2024-09-13T17:11:49.798402+0000","last_unstale":"2024-09-13T17:13:38.513709+0000","last_undegraded":"2024-09-13T17:13:38.513709+0000","last_fullsized":"2024-09-13T17:13:38.513709+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:58.948813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,11],"acting":[7,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":20,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.213151+0000","last_change":"2024-09-13T17:11:49.802654+0000","last_active":"2024-09-13T17:12:50.213151+0000","last_peered":"2024-09-13T17:12:50.213151+0000","last_clean":"2024-09-13T17:12:50.213151+0000","last_became_active":"2024-09-13T17:11:49.797574+0000","last_became_peered":"2024-09-13T17:11:49.797574+0000","last_unstale":"2024-09-13T17:12:50.213151+0000","last_undegraded":"2024-09-13T17:12:50.213151+0000","last_fullsized":"2024-09-13T17:12:50.213151+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:08.827045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:40.295461+0000","last_change":"2024-09-13T17:11:27.360372+0000","last_active":"2024-09-13T17:13:40.295461+0000","last_peered":"2024-09-13T17:13:40.295461+0000","last_clean":"2024-09-13T17:13:40.295461+0000","last_became_active":"2024-09-13T17:11:27.359990+0000","last_became_peered":"2024-09-13T17:11:27.359990+0000","last_unstale":"2024-09-13T17:13:40.295461+0000","last_undegraded":"2024-09-13T17:13:40.295461+0000","last_fullsized":"2024-09-13T17:13:40.295461+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:26.970317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"93'6","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:38.513682+0000","last_change":"2024-09-13T17:11:23.336269+0000","last_active":"2024-09-13T17:13:38.513682+0000","last_peered":"2024-09-13T17:13:38.513682+0000","last_clean":"2024-09-13T17:13:38.513682+0000","last_became_active":"2024-09-13T17:11:23.335921+0000","last_became_peered":"2024-09-13T17:11:23.335921+0000","last_unstale":"2024-09-13T17:13:38.513682+0000","last_undegraded":"2024-09-13T17:13:38.513682+0000","last_fullsized":"2024-09-13T17:13:38.513682+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:43.035927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"94'39","reported_seq":68,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.576625+0000","last_change":"2024-09-13T17:11:23.002491+0000","last_active":"2024-09-13T17:13:49.576625+0000","last_peered":"2024-09-13T17:13:49.576625+0000","last_clean":"2024-09-13T17:13:49.576625+0000","last_became_active":"2024-09-13T17:11:23.002178+0000","last_became_peered":"2024-09-13T17:11:23.002178+0000","last_unstale":"2024-09-13T17:13:49.576625+0000","last_undegraded":"2024-09-13T17:13:49.576625+0000","last_fullsized":"2024-09-13T17:13:49.576625+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:06.056639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:44.123173+0000","last_change":"2024-09-13T17:11:27.355153+0000","last_active":"2024-09-13T17:13:44.123173+0000","last_peered":"2024-09-13T17:13:44.123173+0000","last_clean":"2024-09-13T17:13:44.123173+0000","last_became_active":"2024-09-13T17:11:27.354701+0000","last_became_peered":"2024-09-13T17:11:27.354701+0000","last_unstale":"2024-09-13T17:13:44.123173+0000","last_undegraded":"2024-09-13T17:13:44.123173+0000","last_fullsized":"2024-09-13T17:13:44.123173+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:34.924402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"93'9","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:38.513730+0000","last_change":"2024-09-13T17:11:23.342067+0000","last_active":"2024-09-13T17:13:38.513730+0000","last_peered":"2024-09-13T17:13:38.513730+0000","last_clean":"2024-09-13T17:13:38.513730+0000","last_became_active":"2024-09-13T17:11:23.341736+0000","last_became_peered":"2024-09-13T17:11:23.341736+0000","last_unstale":"2024-09-13T17:13:38.513730+0000","last_undegraded":"2024-09-13T17:13:38.513730+0000","last_fullsized":"2024-09-13T17:13:38.513730+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:03.114638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:40.616506+0000","last_change":"2024-09-13T17:11:23.002849+0000","last_active":"2024-09-13T17:13:40.616506+0000","last_peered":"2024-09-13T17:13:40.616506+0000","last_clean":"2024-09-13T17:13:40.616506+0000","last_became_active":"2024-09-13T17:11:23.002562+0000","last_became_peered":"2024-09-13T17:11:23.002562+0000","last_unstale":"2024-09-13T17:13:40.616506+0000","last_undegraded":"2024-09-13T17:13:40.616506+0000","last_fullsized":"2024-09-13T17:13:40.616506+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:11:24.650510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:37.049118+0000","last_change":"2024-09-13T17:11:27.359343+0000","last_active":"2024-09-13T17:13:37.049118+0000","last_peered":"2024-09-13T17:13:37.049118+0000","last_clean":"2024-09-13T17:13:37.049118+0000","last_became_active":"2024-09-13T17:11:27.358628+0000","last_became_peered":"2024-09-13T17:11:27.358628+0000","last_unstale":"2024-09-13T17:13:37.049118+0000","last_undegraded":"2024-09-13T17:13:37.049118+0000","last_fullsized":"2024-09-13T17:13:37.049118+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:39.584184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"93'5","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:40.024237+0000","last_change":"2024-09-13T17:11:23.333111+0000","last_active":"2024-09-13T17:13:40.024237+0000","last_peered":"2024-09-13T17:13:40.024237+0000","last_clean":"2024-09-13T17:13:40.024237+0000","last_became_active":"2024-09-13T17:11:23.332734+0000","last_became_peered":"2024-09-13T17:11:23.332734+0000","last_unstale":"2024-09-13T17:13:40.024237+0000","last_undegraded":"2024-09-13T17:13:40.024237+0000","last_fullsized":"2024-09-13T17:13:40.024237+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:44.628106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"91'2","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:38.434730+0000","last_change":"2024-09-13T17:11:23.000759+0000","last_active":"2024-09-13T17:13:38.434730+0000","last_peered":"2024-09-13T17:13:38.434730+0000","last_clean":"2024-09-13T17:13:38.434730+0000","last_became_active":"2024-09-13T17:11:23.000463+0000","last_became_peered":"2024-09-13T17:11:23.000463+0000","last_unstale":"2024-09-13T17:13:38.434730+0000","last_undegraded":"2024-09-13T17:13:38.434730+0000","last_fullsized":"2024-09-13T17:13:38.434730+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:24:59.077194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:37.049152+0000","last_change":"2024-09-13T17:11:27.363076+0000","last_active":"2024-09-13T17:13:37.049152+0000","last_peered":"2024-09-13T17:13:37.049152+0000","last_clean":"2024-09-13T17:13:37.049152+0000","last_became_active":"2024-09-13T17:11:27.362642+0000","last_became_peered":"2024-09-13T17:11:27.362642+0000","last_unstale":"2024-09-13T17:13:37.049152+0000","last_undegraded":"2024-09-13T17:13:37.049152+0000","last_fullsized":"2024-09-13T17:13:37.049152+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:25.494875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"93'6","reported_seq":26,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.473181+0000","last_change":"2024-09-13T17:11:23.336703+0000","last_active":"2024-09-13T17:13:49.473181+0000","last_peered":"2024-09-13T17:13:49.473181+0000","last_clean":"2024-09-13T17:13:49.473181+0000","last_became_active":"2024-09-13T17:11:23.336349+0000","last_became_peered":"2024-09-13T17:11:23.336349+0000","last_unstale":"2024-09-13T17:13:49.473181+0000","last_undegraded":"2024-09-13T17:13:49.473181+0000","last_fullsized":"2024-09-13T17:13:49.473181+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:28.671438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:43.435160+0000","last_change":"2024-09-13T17:11:22.994382+0000","last_active":"2024-09-13T17:13:43.435160+0000","last_peered":"2024-09-13T17:13:43.435160+0000","last_clean":"2024-09-13T17:13:43.435160+0000","last_became_active":"2024-09-13T17:11:22.994037+0000","last_became_peered":"2024-09-13T17:11:22.994037+0000","last_unstale":"2024-09-13T17:13:43.435160+0000","last_undegraded":"2024-09-13T17:13:43.435160+0000","last_fullsized":"2024-09-13T17:13:43.435160+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:10.763757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.212460+0000","last_change":"2024-09-13T17:11:27.354351+0000","last_active":"2024-09-13T17:12:50.212460+0000","last_peered":"2024-09-13T17:12:50.212460+0000","last_clean":"2024-09-13T17:12:50.212460+0000","last_became_active":"2024-09-13T17:11:27.353715+0000","last_became_peered":"2024-09-13T17:11:27.353715+0000","last_unstale":"2024-09-13T17:12:50.212460+0000","last_undegraded":"2024-09-13T17:12:50.212460+0000","last_fullsized":"2024-09-13T17:12:50.212460+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:18.335183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"93'6","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:43.514127+0000","last_change":"2024-09-13T17:11:23.341743+0000","last_active":"2024-09-13T17:13:43.514127+0000","last_peered":"2024-09-13T17:13:43.514127+0000","last_clean":"2024-09-13T17:13:43.514127+0000","last_became_active":"2024-09-13T17:11:23.341200+0000","last_became_peered":"2024-09-13T17:11:23.341200+0000","last_unstale":"2024-09-13T17:13:43.514127+0000","last_undegraded":"2024-09-13T17:13:43.514127+0000","last_fullsized":"2024-09-13T17:13:43.514127+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:41.854013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"94'6","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.982188+0000","last_change":"2024-09-13T17:11:22.997571+0000","last_active":"2024-09-13T17:13:49.982188+0000","last_peered":"2024-09-13T17:13:49.982188+0000","last_clean":"2024-09-13T17:13:49.982188+0000","last_became_active":"2024-09-13T17:11:22.997238+0000","last_became_peered":"2024-09-13T17:11:22.997238+0000","last_unstale":"2024-09-13T17:13:49.982188+0000","last_undegraded":"2024-09-13T17:13:49.982188+0000","last_fullsized":"2024-09-13T17:13:49.982188+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:34.533004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1818,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":128,"num_read_kb":5,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:53.429158+0000","last_change":"2024-09-13T17:12:50.761520+0000","last_active":"2024-09-13T17:12:53.429158+0000","last_peered":"2024-09-13T17:12:53.429158+0000","last_clean":"2024-09-13T17:12:53.429158+0000","last_became_active":"2024-09-13T17:12:50.760930+0000","last_became_peered":"2024-09-13T17:12:50.760930+0000","last_unstale":"2024-09-13T17:12:53.429158+0000","last_undegraded":"2024-09-13T17:12:53.429158+0000","last_fullsized":"2024-09-13T17:12:53.429158+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:46.646722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"93'15","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:43.514206+0000","last_change":"2024-09-13T17:11:23.337666+0000","last_active":"2024-09-13T17:13:43.514206+0000","last_peered":"2024-09-13T17:13:43.514206+0000","last_clean":"2024-09-13T17:13:43.514206+0000","last_became_active":"2024-09-13T17:11:23.337185+0000","last_became_peered":"2024-09-13T17:11:23.337185+0000","last_unstale":"2024-09-13T17:13:43.514206+0000","last_undegraded":"2024-09-13T17:13:43.514206+0000","last_fullsized":"2024-09-13T17:13:43.514206+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:51.266709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:42.049772+0000","last_change":"2024-09-13T17:11:23.005075+0000","last_active":"2024-09-13T17:13:42.049772+0000","last_peered":"2024-09-13T17:13:42.049772+0000","last_clean":"2024-09-13T17:13:42.049772+0000","last_became_active":"2024-09-13T17:11:23.004778+0000","last_became_peered":"2024-09-13T17:11:23.004778+0000","last_unstale":"2024-09-13T17:13:42.049772+0000","last_undegraded":"2024-09-13T17:13:42.049772+0000","last_fullsized":"2024-09-13T17:13:42.049772+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:06.763552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.609278+0000","last_change":"2024-09-13T17:11:27.353601+0000","last_active":"2024-09-13T17:13:49.609278+0000","last_peered":"2024-09-13T17:13:49.609278+0000","last_clean":"2024-09-13T17:13:49.609278+0000","last_became_active":"2024-09-13T17:11:27.353190+0000","last_became_peered":"2024-09-13T17:11:27.353190+0000","last_unstale":"2024-09-13T17:13:49.609278+0000","last_undegraded":"2024-09-13T17:13:49.609278+0000","last_fullsized":"2024-09-13T17:13:49.609278+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:24.645552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"93'9","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.401860+0000","last_change":"2024-09-13T17:11:49.799773+0000","last_active":"2024-09-13T17:13:49.401860+0000","last_peered":"2024-09-13T17:13:49.401860+0000","last_clean":"2024-09-13T17:13:49.401860+0000","last_became_active":"2024-09-13T17:11:49.799402+0000","last_became_peered":"2024-09-13T17:11:49.799402+0000","last_unstale":"2024-09-13T17:13:49.401860+0000","last_undegraded":"2024-09-13T17:13:49.401860+0000","last_fullsized":"2024-09-13T17:13:49.401860+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:37.230144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:43.074257+0000","last_change":"2024-09-13T17:11:23.005619+0000","last_active":"2024-09-13T17:13:43.074257+0000","last_peered":"2024-09-13T17:13:43.074257+0000","last_clean":"2024-09-13T17:13:43.074257+0000","last_became_active":"2024-09-13T17:11:23.005077+0000","last_became_peered":"2024-09-13T17:11:23.005077+0000","last_unstale":"2024-09-13T17:13:43.074257+0000","last_undegraded":"2024-09-13T17:13:43.074257+0000","last_fullsized":"2024-09-13T17:13:43.074257+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:51.739773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.473345+0000","last_change":"2024-09-13T17:11:27.364603+0000","last_active":"2024-09-13T17:13:49.473345+0000","last_peered":"2024-09-13T17:13:49.473345+0000","last_clean":"2024-09-13T17:13:49.473345+0000","last_became_active":"2024-09-13T17:11:27.364226+0000","last_became_peered":"2024-09-13T17:11:27.364226+0000","last_unstale":"2024-09-13T17:13:49.473345+0000","last_undegraded":"2024-09-13T17:13:49.473345+0000","last_fullsized":"2024-09-13T17:13:49.473345+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:56.802016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"93'6","reported_seq":27,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.467049+0000","last_change":"2024-09-13T17:11:23.338657+0000","last_active":"2024-09-13T17:13:49.467049+0000","last_peered":"2024-09-13T17:13:49.467049+0000","last_clean":"2024-09-13T17:13:49.467049+0000","last_became_active":"2024-09-13T17:11:23.338377+0000","last_became_peered":"2024-09-13T17:11:23.338377+0000","last_unstale":"2024-09-13T17:13:49.467049+0000","last_undegraded":"2024-09-13T17:13:49.467049+0000","last_fullsized":"2024-09-13T17:13:49.467049+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:52.412887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"94'40","reported_seq":319,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.972724+0000","last_change":"2024-09-13T17:11:22.998541+0000","last_active":"2024-09-13T17:13:49.972724+0000","last_peered":"2024-09-13T17:13:49.972724+0000","last_clean":"2024-09-13T17:13:49.972724+0000","last_became_active":"2024-09-13T17:11:22.998132+0000","last_became_peered":"2024-09-13T17:11:22.998132+0000","last_unstale":"2024-09-13T17:13:49.972724+0000","last_undegraded":"2024-09-13T17:13:49.972724+0000","last_fullsized":"2024-09-13T17:13:49.972724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:16.777772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68128,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":257,"num_read_kb":196,"num_write":41,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.464040+0000","last_change":"2024-09-13T17:11:27.361917+0000","last_active":"2024-09-13T17:13:49.464040+0000","last_peered":"2024-09-13T17:13:49.464040+0000","last_clean":"2024-09-13T17:13:49.464040+0000","last_became_active":"2024-09-13T17:11:27.361503+0000","last_became_peered":"2024-09-13T17:11:27.361503+0000","last_unstale":"2024-09-13T17:13:49.464040+0000","last_undegraded":"2024-09-13T17:13:49.464040+0000","last_fullsized":"2024-09-13T17:13:49.464040+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:52.959017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"93'11","reported_seq":41,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.609609+0000","last_change":"2024-09-13T17:11:49.798971+0000","last_active":"2024-09-13T17:13:49.609609+0000","last_peered":"2024-09-13T17:13:49.609609+0000","last_clean":"2024-09-13T17:13:49.609609+0000","last_became_active":"2024-09-13T17:11:49.798597+0000","last_became_peered":"2024-09-13T17:11:49.798597+0000","last_unstale":"2024-09-13T17:13:49.609609+0000","last_undegraded":"2024-09-13T17:13:49.609609+0000","last_fullsized":"2024-09-13T17:13:49.609609+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:41.886456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":26,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.473545+0000","last_change":"2024-09-13T17:11:23.004059+0000","last_active":"2024-09-13T17:13:49.473545+0000","last_peered":"2024-09-13T17:13:49.473545+0000","last_clean":"2024-09-13T17:13:49.473545+0000","last_became_active":"2024-09-13T17:11:23.003248+0000","last_became_peered":"2024-09-13T17:11:23.003248+0000","last_unstale":"2024-09-13T17:13:49.473545+0000","last_undegraded":"2024-09-13T17:13:49.473545+0000","last_fullsized":"2024-09-13T17:13:49.473545+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:05.496872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.609476+0000","last_change":"2024-09-13T17:11:27.362880+0000","last_active":"2024-09-13T17:13:49.609476+0000","last_peered":"2024-09-13T17:13:49.609476+0000","last_clean":"2024-09-13T17:13:49.609476+0000","last_became_active":"2024-09-13T17:11:27.362471+0000","last_became_peered":"2024-09-13T17:11:27.362471+0000","last_unstale":"2024-09-13T17:13:49.609476+0000","last_undegraded":"2024-09-13T17:13:49.609476+0000","last_fullsized":"2024-09-13T17:13:49.609476+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:49.964606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"93'9","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.611837+0000","last_change":"2024-09-13T17:11:49.799023+0000","last_active":"2024-09-13T17:13:49.611837+0000","last_peered":"2024-09-13T17:13:49.611837+0000","last_clean":"2024-09-13T17:13:49.611837+0000","last_became_active":"2024-09-13T17:11:49.798724+0000","last_became_peered":"2024-09-13T17:11:49.798724+0000","last_unstale":"2024-09-13T17:13:49.611837+0000","last_undegraded":"2024-09-13T17:13:49.611837+0000","last_fullsized":"2024-09-13T17:13:49.611837+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:03.569532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,7],"acting":[0,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":23,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.609750+0000","last_change":"2024-09-13T17:11:22.999158+0000","last_active":"2024-09-13T17:13:49.609750+0000","last_peered":"2024-09-13T17:13:49.609750+0000","last_clean":"2024-09-13T17:13:49.609750+0000","last_became_active":"2024-09-13T17:11:22.998795+0000","last_became_peered":"2024-09-13T17:11:22.998795+0000","last_unstale":"2024-09-13T17:13:49.609750+0000","last_undegraded":"2024-09-13T17:13:49.609750+0000","last_fullsized":"2024-09-13T17:13:49.609750+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:23.880769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:53.429065+0000","last_change":"2024-09-13T17:12:50.484254+0000","last_active":"2024-09-13T17:12:53.429065+0000","last_peered":"2024-09-13T17:12:53.429065+0000","last_clean":"2024-09-13T17:12:53.429065+0000","last_became_active":"2024-09-13T17:12:50.483742+0000","last_became_peered":"2024-09-13T17:12:50.483742+0000","last_unstale":"2024-09-13T17:12:53.429065+0000","last_undegraded":"2024-09-13T17:12:53.429065+0000","last_fullsized":"2024-09-13T17:12:53.429065+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:59:03.266889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"93'10","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.610078+0000","last_change":"2024-09-13T17:11:23.338736+0000","last_active":"2024-09-13T17:13:49.610078+0000","last_peered":"2024-09-13T17:13:49.610078+0000","last_clean":"2024-09-13T17:13:49.610078+0000","last_became_active":"2024-09-13T17:11:23.338462+0000","last_became_peered":"2024-09-13T17:11:23.338462+0000","last_unstale":"2024-09-13T17:13:49.610078+0000","last_undegraded":"2024-09-13T17:13:49.610078+0000","last_fullsized":"2024-09-13T17:13:49.610078+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:49.221314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"93'5","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.971924+0000","last_change":"2024-09-13T17:11:23.001966+0000","last_active":"2024-09-13T17:13:49.971924+0000","last_peered":"2024-09-13T17:13:49.971924+0000","last_clean":"2024-09-13T17:13:49.971924+0000","last_became_active":"2024-09-13T17:11:23.001565+0000","last_became_peered":"2024-09-13T17:11:23.001565+0000","last_unstale":"2024-09-13T17:13:49.971924+0000","last_undegraded":"2024-09-13T17:13:49.971924+0000","last_fullsized":"2024-09-13T17:13:49.971924+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:47.240702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":123,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.383344+0000","last_change":"2024-09-13T17:11:27.360896+0000","last_active":"2024-09-13T17:13:49.383344+0000","last_peered":"2024-09-13T17:13:49.383344+0000","last_clean":"2024-09-13T17:13:49.383344+0000","last_became_active":"2024-09-13T17:11:27.360552+0000","last_became_peered":"2024-09-13T17:11:27.360552+0000","last_unstale":"2024-09-13T17:13:49.383344+0000","last_undegraded":"2024-09-13T17:13:49.383344+0000","last_fullsized":"2024-09-13T17:13:49.383344+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:08.726724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:29.121673+0000","last_change":"2024-09-13T17:11:27.356317+0000","last_active":"2024-09-13T17:13:29.121673+0000","last_peered":"2024-09-13T17:13:29.121673+0000","last_clean":"2024-09-13T17:13:29.121673+0000","last_became_active":"2024-09-13T17:11:27.355863+0000","last_became_peered":"2024-09-13T17:11:27.355863+0000","last_unstale":"2024-09-13T17:13:29.121673+0000","last_undegraded":"2024-09-13T17:13:29.121673+0000","last_fullsized":"2024-09-13T17:13:29.121673+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:29.356048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"93'11","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:18.078137+0000","last_change":"2024-09-13T17:11:23.344929+0000","last_active":"2024-09-13T17:13:18.078137+0000","last_peered":"2024-09-13T17:13:18.078137+0000","last_clean":"2024-09-13T17:13:18.078137+0000","last_became_active":"2024-09-13T17:11:23.344627+0000","last_became_peered":"2024-09-13T17:11:23.344627+0000","last_unstale":"2024-09-13T17:13:18.078137+0000","last_undegraded":"2024-09-13T17:13:18.078137+0000","last_fullsized":"2024-09-13T17:13:18.078137+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:15.049627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.473256+0000","last_change":"2024-09-13T17:11:23.002539+0000","last_active":"2024-09-13T17:13:49.473256+0000","last_peered":"2024-09-13T17:13:49.473256+0000","last_clean":"2024-09-13T17:13:49.473256+0000","last_became_active":"2024-09-13T17:11:23.002206+0000","last_became_peered":"2024-09-13T17:11:23.002206+0000","last_unstale":"2024-09-13T17:13:49.473256+0000","last_undegraded":"2024-09-13T17:13:49.473256+0000","last_fullsized":"2024-09-13T17:13:49.473256+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:57.708167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:35.023777+0000","last_change":"2024-09-13T17:11:27.362667+0000","last_active":"2024-09-13T17:13:35.023777+0000","last_peered":"2024-09-13T17:13:35.023777+0000","last_clean":"2024-09-13T17:13:35.023777+0000","last_became_active":"2024-09-13T17:11:27.362293+0000","last_became_peered":"2024-09-13T17:11:27.362293+0000","last_unstale":"2024-09-13T17:13:35.023777+0000","last_undegraded":"2024-09-13T17:13:35.023777+0000","last_fullsized":"2024-09-13T17:13:35.023777+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:24.446951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"93'8","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.383093+0000","last_change":"2024-09-13T17:11:23.335823+0000","last_active":"2024-09-13T17:13:49.383093+0000","last_peered":"2024-09-13T17:13:49.383093+0000","last_clean":"2024-09-13T17:13:49.383093+0000","last_became_active":"2024-09-13T17:11:23.335491+0000","last_became_peered":"2024-09-13T17:11:23.335491+0000","last_unstale":"2024-09-13T17:13:49.383093+0000","last_undegraded":"2024-09-13T17:13:49.383093+0000","last_fullsized":"2024-09-13T17:13:49.383093+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:42.172559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.211946+0000","last_change":"2024-09-13T17:11:22.999477+0000","last_active":"2024-09-13T17:12:50.211946+0000","last_peered":"2024-09-13T17:12:50.211946+0000","last_clean":"2024-09-13T17:12:50.211946+0000","last_became_active":"2024-09-13T17:11:22.999175+0000","last_became_peered":"2024-09-13T17:11:22.999175+0000","last_unstale":"2024-09-13T17:12:50.211946+0000","last_undegraded":"2024-09-13T17:12:50.211946+0000","last_fullsized":"2024-09-13T17:12:50.211946+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:03.817508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.220694+0000","last_change":"2024-09-13T17:12:50.220304+0000","last_active":"2024-09-13T17:12:50.220694+0000","last_peered":"2024-09-13T17:12:50.220694+0000","last_clean":"2024-09-13T17:12:50.220694+0000","last_became_active":"2024-09-13T17:12:50.216329+0000","last_became_peered":"2024-09-13T17:12:50.216329+0000","last_unstale":"2024-09-13T17:12:50.220694+0000","last_undegraded":"2024-09-13T17:12:50.220694+0000","last_fullsized":"2024-09-13T17:12:50.220694+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:18:29.389297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"93'8","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:18.084569+0000","last_change":"2024-09-13T17:11:23.337738+0000","last_active":"2024-09-13T17:13:18.084569+0000","last_peered":"2024-09-13T17:13:18.084569+0000","last_clean":"2024-09-13T17:13:18.084569+0000","last_became_active":"2024-09-13T17:11:23.337411+0000","last_became_peered":"2024-09-13T17:11:23.337411+0000","last_unstale":"2024-09-13T17:13:18.084569+0000","last_undegraded":"2024-09-13T17:13:18.084569+0000","last_fullsized":"2024-09-13T17:13:18.084569+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:02.355706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.222605+0000","last_change":"2024-09-13T17:12:50.221722+0000","last_active":"2024-09-13T17:12:50.222605+0000","last_peered":"2024-09-13T17:12:50.222605+0000","last_clean":"2024-09-13T17:12:50.222605+0000","last_became_active":"2024-09-13T17:12:50.221273+0000","last_became_peered":"2024-09-13T17:12:50.221273+0000","last_unstale":"2024-09-13T17:12:50.222605+0000","last_undegraded":"2024-09-13T17:12:50.222605+0000","last_fullsized":"2024-09-13T17:12:50.222605+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:28.617737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,8],"acting":[2,6,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"94'10","reported_seq":160,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.972857+0000","last_change":"2024-09-13T17:11:23.000544+0000","last_active":"2024-09-13T17:13:49.972857+0000","last_peered":"2024-09-13T17:13:49.972857+0000","last_clean":"2024-09-13T17:13:49.972857+0000","last_became_active":"2024-09-13T17:11:23.000233+0000","last_became_peered":"2024-09-13T17:11:23.000233+0000","last_unstale":"2024-09-13T17:13:49.972857+0000","last_undegraded":"2024-09-13T17:13:49.972857+0000","last_fullsized":"2024-09-13T17:13:49.972857+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:21.965914+0000","last_clean_scrub_stamp":"2024-09-13T17:11:21.965914+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:04.745950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2385,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"93'7","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.467025+0000","last_change":"2024-09-13T17:11:23.340104+0000","last_active":"2024-09-13T17:13:49.467025+0000","last_peered":"2024-09-13T17:13:49.467025+0000","last_clean":"2024-09-13T17:13:49.467025+0000","last_became_active":"2024-09-13T17:11:23.339826+0000","last_became_peered":"2024-09-13T17:11:23.339826+0000","last_unstale":"2024-09-13T17:13:49.467025+0000","last_undegraded":"2024-09-13T17:13:49.467025+0000","last_fullsized":"2024-09-13T17:13:49.467025+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:03.101547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:12:50.217668+0000","last_change":"2024-09-13T17:11:27.360848+0000","last_active":"2024-09-13T17:12:50.217668+0000","last_peered":"2024-09-13T17:12:50.217668+0000","last_clean":"2024-09-13T17:12:50.217668+0000","last_became_active":"2024-09-13T17:11:27.360416+0000","last_became_peered":"2024-09-13T17:11:27.360416+0000","last_unstale":"2024-09-13T17:12:50.217668+0000","last_undegraded":"2024-09-13T17:12:50.217668+0000","last_fullsized":"2024-09-13T17:12:50.217668+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:26.329053+0000","last_clean_scrub_stamp":"2024-09-13T17:11:26.329053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:06.857649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"93'9","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:30.023108+0000","last_change":"2024-09-13T17:11:23.334723+0000","last_active":"2024-09-13T17:13:30.023108+0000","last_peered":"2024-09-13T17:13:30.023108+0000","last_clean":"2024-09-13T17:13:30.023108+0000","last_became_active":"2024-09-13T17:11:23.334433+0000","last_became_peered":"2024-09-13T17:11:23.334433+0000","last_unstale":"2024-09-13T17:13:30.023108+0000","last_undegraded":"2024-09-13T17:13:30.023108+0000","last_fullsized":"2024-09-13T17:13:30.023108+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:08.657151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"93'12","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:28.072478+0000","last_change":"2024-09-13T17:11:23.334882+0000","last_active":"2024-09-13T17:13:28.072478+0000","last_peered":"2024-09-13T17:13:28.072478+0000","last_clean":"2024-09-13T17:13:28.072478+0000","last_became_active":"2024-09-13T17:11:23.334610+0000","last_became_peered":"2024-09-13T17:11:23.334610+0000","last_unstale":"2024-09-13T17:13:28.072478+0000","last_undegraded":"2024-09-13T17:13:28.072478+0000","last_fullsized":"2024-09-13T17:13:28.072478+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:03.932181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"93'8","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:28.072501+0000","last_change":"2024-09-13T17:11:23.334076+0000","last_active":"2024-09-13T17:13:28.072501+0000","last_peered":"2024-09-13T17:13:28.072501+0000","last_clean":"2024-09-13T17:13:28.072501+0000","last_became_active":"2024-09-13T17:11:23.333801+0000","last_became_peered":"2024-09-13T17:11:23.333801+0000","last_unstale":"2024-09-13T17:13:28.072501+0000","last_undegraded":"2024-09-13T17:13:28.072501+0000","last_fullsized":"2024-09-13T17:13:28.072501+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:07.113045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"93'7","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:29.121644+0000","last_change":"2024-09-13T17:11:23.332306+0000","last_active":"2024-09-13T17:13:29.121644+0000","last_peered":"2024-09-13T17:13:29.121644+0000","last_clean":"2024-09-13T17:13:29.121644+0000","last_became_active":"2024-09-13T17:11:23.331913+0000","last_became_peered":"2024-09-13T17:11:23.331913+0000","last_unstale":"2024-09-13T17:13:29.121644+0000","last_undegraded":"2024-09-13T17:13:29.121644+0000","last_fullsized":"2024-09-13T17:13:29.121644+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:02.927286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"93'4","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:35.616049+0000","last_change":"2024-09-13T17:11:23.335512+0000","last_active":"2024-09-13T17:13:35.616049+0000","last_peered":"2024-09-13T17:13:35.616049+0000","last_clean":"2024-09-13T17:13:35.616049+0000","last_became_active":"2024-09-13T17:11:23.335201+0000","last_became_peered":"2024-09-13T17:11:23.335201+0000","last_unstale":"2024-09-13T17:13:35.616049+0000","last_undegraded":"2024-09-13T17:13:35.616049+0000","last_fullsized":"2024-09-13T17:13:35.616049+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:17.263819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"93'6","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:35.023757+0000","last_change":"2024-09-13T17:11:23.341204+0000","last_active":"2024-09-13T17:13:35.023757+0000","last_peered":"2024-09-13T17:13:35.023757+0000","last_clean":"2024-09-13T17:13:35.023757+0000","last_became_active":"2024-09-13T17:11:23.339848+0000","last_became_peered":"2024-09-13T17:11:23.339848+0000","last_unstale":"2024-09-13T17:13:35.023757+0000","last_undegraded":"2024-09-13T17:13:35.023757+0000","last_fullsized":"2024-09-13T17:13:35.023757+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:15:09.480651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"93'15","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:33.073116+0000","last_change":"2024-09-13T17:11:23.334741+0000","last_active":"2024-09-13T17:13:33.073116+0000","last_peered":"2024-09-13T17:13:33.073116+0000","last_clean":"2024-09-13T17:13:33.073116+0000","last_became_active":"2024-09-13T17:11:23.334459+0000","last_became_peered":"2024-09-13T17:11:23.334459+0000","last_unstale":"2024-09-13T17:13:33.073116+0000","last_undegraded":"2024-09-13T17:13:33.073116+0000","last_fullsized":"2024-09-13T17:13:33.073116+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:52.379735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"93'2","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:35.609866+0000","last_change":"2024-09-13T17:11:23.337869+0000","last_active":"2024-09-13T17:13:35.609866+0000","last_peered":"2024-09-13T17:13:35.609866+0000","last_clean":"2024-09-13T17:13:35.609866+0000","last_became_active":"2024-09-13T17:11:23.337581+0000","last_became_peered":"2024-09-13T17:11:23.337581+0000","last_unstale":"2024-09-13T17:13:35.609866+0000","last_undegraded":"2024-09-13T17:13:35.609866+0000","last_fullsized":"2024-09-13T17:13:35.609866+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:49.407474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"93'6","reported_seq":20,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:18.078622+0000","last_change":"2024-09-13T17:11:49.797828+0000","last_active":"2024-09-13T17:13:18.078622+0000","last_peered":"2024-09-13T17:13:18.078622+0000","last_clean":"2024-09-13T17:13:18.078622+0000","last_became_active":"2024-09-13T17:11:49.797504+0000","last_became_peered":"2024-09-13T17:11:49.797504+0000","last_unstale":"2024-09-13T17:13:18.078622+0000","last_undegraded":"2024-09-13T17:13:18.078622+0000","last_fullsized":"2024-09-13T17:13:18.078622+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:29.677936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.29","version":"93'8","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:40.610273+0000","last_change":"2024-09-13T17:11:23.336713+0000","last_active":"2024-09-13T17:13:40.610273+0000","last_peered":"2024-09-13T17:13:40.610273+0000","last_clean":"2024-09-13T17:13:40.610273+0000","last_became_active":"2024-09-13T17:11:23.336431+0000","last_became_peered":"2024-09-13T17:11:23.336431+0000","last_unstale":"2024-09-13T17:13:40.610273+0000","last_undegraded":"2024-09-13T17:13:40.610273+0000","last_fullsized":"2024-09-13T17:13:40.610273+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:52.709483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"93'10","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:40.295477+0000","last_change":"2024-09-13T17:11:23.340385+0000","last_active":"2024-09-13T17:13:40.295477+0000","last_peered":"2024-09-13T17:13:40.295477+0000","last_clean":"2024-09-13T17:13:40.295477+0000","last_became_active":"2024-09-13T17:11:23.340068+0000","last_became_peered":"2024-09-13T17:11:23.340068+0000","last_unstale":"2024-09-13T17:13:40.295477+0000","last_undegraded":"2024-09-13T17:13:40.295477+0000","last_fullsized":"2024-09-13T17:13:40.295477+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:17.795222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"93'11","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:40.616451+0000","last_change":"2024-09-13T17:11:23.329214+0000","last_active":"2024-09-13T17:13:40.616451+0000","last_peered":"2024-09-13T17:13:40.616451+0000","last_clean":"2024-09-13T17:13:40.616451+0000","last_became_active":"2024-09-13T17:11:23.328747+0000","last_became_peered":"2024-09-13T17:11:23.328747+0000","last_unstale":"2024-09-13T17:13:40.616451+0000","last_undegraded":"2024-09-13T17:13:40.616451+0000","last_fullsized":"2024-09-13T17:13:40.616451+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:11.233652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"93'8","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:40.024216+0000","last_change":"2024-09-13T17:11:23.339854+0000","last_active":"2024-09-13T17:13:40.024216+0000","last_peered":"2024-09-13T17:13:40.024216+0000","last_clean":"2024-09-13T17:13:40.024216+0000","last_became_active":"2024-09-13T17:11:23.339565+0000","last_became_peered":"2024-09-13T17:11:23.339565+0000","last_unstale":"2024-09-13T17:13:40.024216+0000","last_undegraded":"2024-09-13T17:13:40.024216+0000","last_fullsized":"2024-09-13T17:13:40.024216+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:37.161135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"93'7","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:38.073656+0000","last_change":"2024-09-13T17:11:23.342562+0000","last_active":"2024-09-13T17:13:38.073656+0000","last_peered":"2024-09-13T17:13:38.073656+0000","last_clean":"2024-09-13T17:13:38.073656+0000","last_became_active":"2024-09-13T17:11:23.342256+0000","last_became_peered":"2024-09-13T17:11:23.342256+0000","last_unstale":"2024-09-13T17:13:38.073656+0000","last_undegraded":"2024-09-13T17:13:38.073656+0000","last_fullsized":"2024-09-13T17:13:38.073656+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:30.788242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"93'10","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.464655+0000","last_change":"2024-09-13T17:11:23.342436+0000","last_active":"2024-09-13T17:13:49.464655+0000","last_peered":"2024-09-13T17:13:49.464655+0000","last_clean":"2024-09-13T17:13:49.464655+0000","last_became_active":"2024-09-13T17:11:23.342157+0000","last_became_peered":"2024-09-13T17:11:23.342157+0000","last_unstale":"2024-09-13T17:13:49.464655+0000","last_undegraded":"2024-09-13T17:13:49.464655+0000","last_fullsized":"2024-09-13T17:13:49.464655+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:56.550875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"93'8","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.609673+0000","last_change":"2024-09-13T17:11:23.341660+0000","last_active":"2024-09-13T17:13:49.609673+0000","last_peered":"2024-09-13T17:13:49.609673+0000","last_clean":"2024-09-13T17:13:49.609673+0000","last_became_active":"2024-09-13T17:11:23.341102+0000","last_became_peered":"2024-09-13T17:11:23.341102+0000","last_unstale":"2024-09-13T17:13:49.609673+0000","last_undegraded":"2024-09-13T17:13:49.609673+0000","last_fullsized":"2024-09-13T17:13:49.609673+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:00.546907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"93'9","reported_seq":30,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.608823+0000","last_change":"2024-09-13T17:11:23.338064+0000","last_active":"2024-09-13T17:13:49.608823+0000","last_peered":"2024-09-13T17:13:49.608823+0000","last_clean":"2024-09-13T17:13:49.608823+0000","last_became_active":"2024-09-13T17:11:23.337748+0000","last_became_peered":"2024-09-13T17:11:23.337748+0000","last_unstale":"2024-09-13T17:13:49.608823+0000","last_undegraded":"2024-09-13T17:13:49.608823+0000","last_fullsized":"2024-09-13T17:13:49.608823+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:14.281629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"93'7","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:44.123109+0000","last_change":"2024-09-13T17:11:23.335684+0000","last_active":"2024-09-13T17:13:44.123109+0000","last_peered":"2024-09-13T17:13:44.123109+0000","last_clean":"2024-09-13T17:13:44.123109+0000","last_became_active":"2024-09-13T17:11:23.335364+0000","last_became_peered":"2024-09-13T17:11:23.335364+0000","last_unstale":"2024-09-13T17:13:44.123109+0000","last_undegraded":"2024-09-13T17:13:44.123109+0000","last_fullsized":"2024-09-13T17:13:44.123109+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:02.288009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"93'7","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:44.123153+0000","last_change":"2024-09-13T17:11:23.340881+0000","last_active":"2024-09-13T17:13:44.123153+0000","last_peered":"2024-09-13T17:13:44.123153+0000","last_clean":"2024-09-13T17:13:44.123153+0000","last_became_active":"2024-09-13T17:11:23.340575+0000","last_became_peered":"2024-09-13T17:11:23.340575+0000","last_unstale":"2024-09-13T17:13:44.123153+0000","last_undegraded":"2024-09-13T17:13:44.123153+0000","last_fullsized":"2024-09-13T17:13:44.123153+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:40.757703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"93'10","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.401919+0000","last_change":"2024-09-13T17:11:23.329039+0000","last_active":"2024-09-13T17:13:49.401919+0000","last_peered":"2024-09-13T17:13:49.401919+0000","last_clean":"2024-09-13T17:13:49.401919+0000","last_became_active":"2024-09-13T17:11:23.328324+0000","last_became_peered":"2024-09-13T17:11:23.328324+0000","last_unstale":"2024-09-13T17:13:49.401919+0000","last_undegraded":"2024-09-13T17:13:49.401919+0000","last_fullsized":"2024-09-13T17:13:49.401919+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:37.882596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"93'7","reported_seq":27,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.609805+0000","last_change":"2024-09-13T17:11:23.345229+0000","last_active":"2024-09-13T17:13:49.609805+0000","last_peered":"2024-09-13T17:13:49.609805+0000","last_clean":"2024-09-13T17:13:49.609805+0000","last_became_active":"2024-09-13T17:11:23.344883+0000","last_became_peered":"2024-09-13T17:11:23.344883+0000","last_unstale":"2024-09-13T17:13:49.609805+0000","last_undegraded":"2024-09-13T17:13:49.609805+0000","last_fullsized":"2024-09-13T17:13:49.609805+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:47.983382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"93'6","reported_seq":26,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.610120+0000","last_change":"2024-09-13T17:11:23.346338+0000","last_active":"2024-09-13T17:13:49.610120+0000","last_peered":"2024-09-13T17:13:49.610120+0000","last_clean":"2024-09-13T17:13:49.610120+0000","last_became_active":"2024-09-13T17:11:23.344777+0000","last_became_peered":"2024-09-13T17:11:23.344777+0000","last_unstale":"2024-09-13T17:13:49.610120+0000","last_undegraded":"2024-09-13T17:13:49.610120+0000","last_fullsized":"2024-09-13T17:13:49.610120+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:23.650174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"93'16","reported_seq":46,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.383860+0000","last_change":"2024-09-13T17:11:49.798165+0000","last_active":"2024-09-13T17:13:49.383860+0000","last_peered":"2024-09-13T17:13:49.383860+0000","last_clean":"2024-09-13T17:13:49.383860+0000","last_became_active":"2024-09-13T17:11:49.797753+0000","last_became_peered":"2024-09-13T17:11:49.797753+0000","last_unstale":"2024-09-13T17:13:49.383860+0000","last_undegraded":"2024-09-13T17:13:49.383860+0000","last_fullsized":"2024-09-13T17:13:49.383860+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:51.744236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"93'11","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-13T17:13:49.610269+0000","last_change":"2024-09-13T17:11:23.340478+0000","last_active":"2024-09-13T17:13:49.610269+0000","last_peered":"2024-09-13T17:13:49.610269+0000","last_clean":"2024-09-13T17:13:49.610269+0000","last_became_active":"2024-09-13T17:11:23.339916+0000","last_became_peered":"2024-09-13T17:11:23.339916+0000","last_unstale":"2024-09-13T17:13:49.610269+0000","last_undegraded":"2024-09-13T17:13:49.610269+0000","last_fullsized":"2024-09-13T17:13:49.610269+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:09.477626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"93'9","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:18.085082+0000","last_change":"2024-09-13T17:11:23.340882+0000","last_active":"2024-09-13T17:13:18.085082+0000","last_peered":"2024-09-13T17:13:18.085082+0000","last_clean":"2024-09-13T17:13:18.085082+0000","last_became_active":"2024-09-13T17:11:23.340413+0000","last_became_peered":"2024-09-13T17:11:23.340413+0000","last_unstale":"2024-09-13T17:13:18.085082+0000","last_undegraded":"2024-09-13T17:13:18.085082+0000","last_fullsized":"2024-09-13T17:13:18.085082+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:49.040015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"93'5","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:18.082603+0000","last_change":"2024-09-13T17:11:23.345551+0000","last_active":"2024-09-13T17:13:18.082603+0000","last_peered":"2024-09-13T17:13:18.082603+0000","last_clean":"2024-09-13T17:13:18.082603+0000","last_became_active":"2024-09-13T17:11:23.345195+0000","last_became_peered":"2024-09-13T17:11:23.345195+0000","last_unstale":"2024-09-13T17:13:18.082603+0000","last_undegraded":"2024-09-13T17:13:18.082603+0000","last_fullsized":"2024-09-13T17:13:18.082603+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:00.856969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"93'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:18.081359+0000","last_change":"2024-09-13T17:11:49.799090+0000","last_active":"2024-09-13T17:13:18.081359+0000","last_peered":"2024-09-13T17:13:18.081359+0000","last_clean":"2024-09-13T17:13:18.081359+0000","last_became_active":"2024-09-13T17:11:49.798766+0000","last_became_peered":"2024-09-13T17:11:49.798766+0000","last_unstale":"2024-09-13T17:13:18.081359+0000","last_undegraded":"2024-09-13T17:13:18.081359+0000","last_fullsized":"2024-09-13T17:13:18.081359+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:43.946212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"93'4","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:18.079563+0000","last_change":"2024-09-13T17:11:23.340286+0000","last_active":"2024-09-13T17:13:18.079563+0000","last_peered":"2024-09-13T17:13:18.079563+0000","last_clean":"2024-09-13T17:13:18.079563+0000","last_became_active":"2024-09-13T17:11:23.339756+0000","last_became_peered":"2024-09-13T17:11:23.339756+0000","last_unstale":"2024-09-13T17:13:18.079563+0000","last_undegraded":"2024-09-13T17:13:18.079563+0000","last_fullsized":"2024-09-13T17:13:18.079563+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:00.463087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"93'8","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:24.552220+0000","last_change":"2024-09-13T17:11:23.339818+0000","last_active":"2024-09-13T17:13:24.552220+0000","last_peered":"2024-09-13T17:13:24.552220+0000","last_clean":"2024-09-13T17:13:24.552220+0000","last_became_active":"2024-09-13T17:11:23.339501+0000","last_became_peered":"2024-09-13T17:11:23.339501+0000","last_unstale":"2024-09-13T17:13:24.552220+0000","last_undegraded":"2024-09-13T17:13:24.552220+0000","last_fullsized":"2024-09-13T17:13:24.552220+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:36.904004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"93'7","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:29.121660+0000","last_change":"2024-09-13T17:11:23.334388+0000","last_active":"2024-09-13T17:13:29.121660+0000","last_peered":"2024-09-13T17:13:29.121660+0000","last_clean":"2024-09-13T17:13:29.121660+0000","last_became_active":"2024-09-13T17:11:23.333953+0000","last_became_peered":"2024-09-13T17:11:23.333953+0000","last_unstale":"2024-09-13T17:13:29.121660+0000","last_undegraded":"2024-09-13T17:13:29.121660+0000","last_fullsized":"2024-09-13T17:13:29.121660+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:33.929173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"93'4","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:29.121689+0000","last_change":"2024-09-13T17:11:23.338259+0000","last_active":"2024-09-13T17:13:29.121689+0000","last_peered":"2024-09-13T17:13:29.121689+0000","last_clean":"2024-09-13T17:13:29.121689+0000","last_became_active":"2024-09-13T17:11:23.337979+0000","last_became_peered":"2024-09-13T17:11:23.337979+0000","last_unstale":"2024-09-13T17:13:29.121689+0000","last_undegraded":"2024-09-13T17:13:29.121689+0000","last_fullsized":"2024-09-13T17:13:29.121689+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:55.750255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"93'8","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-13T17:13:30.023224+0000","last_change":"2024-09-13T17:11:23.337899+0000","last_active":"2024-09-13T17:13:30.023224+0000","last_peered":"2024-09-13T17:13:30.023224+0000","last_clean":"2024-09-13T17:13:30.023224+0000","last_became_active":"2024-09-13T17:11:23.337626+0000","last_became_peered":"2024-09-13T17:11:23.337626+0000","last_unstale":"2024-09-13T17:13:30.023224+0000","last_undegraded":"2024-09-13T17:13:30.023224+0000","last_fullsized":"2024-09-13T17:13:30.023224+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:11:22.975824+0000","last_clean_scrub_stamp":"2024-09-13T17:11:22.975824+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:14.654852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":599547,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":864,"num_read_kb":544,"num_write":289,"num_write_kb":1444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":1798641,"data_compressed":75906,"data_compressed_allocated":98304,"data_compressed_original":1548288,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":109077,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383722,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":1036288,"data_stored":529501,"data_compressed":26642,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54700000000000004,"15min":0.54200000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78600000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.41599999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77600000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.39500000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.45200000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.377},{"interface":"front","average":{"1min":0.629,"5min":0.60999999999999999,"15min":0.60399999999999998},"min":{"1min":0.42799999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77900000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.55800000000000005}]},{"osd":2,"last update":"Fri Sep 13 17:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.41999999999999998,"15min":0.40500000000000003},"min":{"1min":0.28499999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.73699999999999999,"5min":0.748,"15min":0.748},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.46600000000000003,"15min":0.45700000000000002},"min":{"1min":0.30099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.66800000000000004,"5min":1.286,"15min":1.286},"last":0.309}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.51200000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.82199999999999995,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.61499999999999999,"15min":0.60399999999999998},"min":{"1min":0.40500000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.46300000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.36699999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.81200000000000006,"5min":1.109,"15min":1.109},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.50900000000000001,"15min":0.48099999999999998},"min":{"1min":0.434,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.34200000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57299999999999995,"15min":0.56100000000000005},"min":{"1min":0.41899999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81200000000000006,"5min":1.214,"15min":1.214},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.60599999999999998,"15min":0.59999999999999998},"min":{"1min":0.47199999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.90300000000000002,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.44400000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.65300000000000002,"15min":0.63500000000000001},"min":{"1min":0.53100000000000003,"5min":0.502,"15min":0.502},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.68899999999999995,"15min":0.68300000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.86299999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.52300000000000002}]},{"osd":8,"last update":"Fri Sep 13 17:13:29 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.61399999999999999,"15min":0.60399999999999998},"min":{"1min":0.39900000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.64700000000000002,"15min":0.64200000000000002},"min":{"1min":0.46800000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.497}]},{"osd":9,"last update":"Fri Sep 13 17:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.65600000000000003,"15min":0.64000000000000001},"min":{"1min":0.52200000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93799999999999994,"5min":1.196,"15min":1.196},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.66700000000000004,"15min":0.63300000000000001},"min":{"1min":0.60299999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.98399999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.53400000000000003}]},{"osd":10,"last update":"Fri Sep 13 17:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.73799999999999999,"15min":0.71999999999999997},"min":{"1min":0.61699999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0409999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72299999999999998,"15min":0.71899999999999997},"min":{"1min":0.56899999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.95899999999999996,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.50700000000000001}]}]},{"osd":10,"up_from":72,"seq":309237645358,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36384,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708768,"statfs":{"total":95995035648,"available":95957778432,"internally_reserved":0,"allocated":1204224,"data_stored":1317145,"data_compressed":69157,"data_compressed_allocated":90112,"data_compressed_original":786432,"omap_allocated":1597,"internal_metadata":36043203},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:13:27 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.38800000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55200000000000005,"15min":0.55100000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.73499999999999999,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.45100000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.41799999999999998,"15min":0.42099999999999999},"min":{"1min":0.29299999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.45700000000000002,"15min":0.46100000000000002},"min":{"1min":0.33100000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.48299999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.43099999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.58299999999999996,"15min":0.57099999999999995},"min":{"1min":0.44,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78100000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.34899999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57099999999999995,"15min":0.58999999999999997},"min":{"1min":0.41399999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73499999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56799999999999995,"15min":0.58199999999999996},"min":{"1min":0.38900000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.49199999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.501,"15min":0.50900000000000001},"min":{"1min":0.38,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70399999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.52700000000000002,"15min":0.54500000000000004},"min":{"1min":0.374,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.628,"5min":0.876,"15min":0.876},"last":0.30099999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65400000000000003,"15min":0.65600000000000003},"min":{"1min":0.48999999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.86599999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.37},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.64900000000000002,"15min":0.65100000000000002},"min":{"1min":0.47899999999999998,"5min":0.44,"15min":0.44},"max":{"1min":0.82199999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.38}]},{"osd":6,"last update":"Fri Sep 13 17:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63500000000000001,"15min":0.65300000000000002},"min":{"1min":0.46200000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73599999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.623,"15min":0.63100000000000001},"min":{"1min":0.52700000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.72299999999999998,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.39100000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:12:52 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.57199999999999995}]},{"osd":8,"last update":"Fri Sep 13 17:12:10 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68300000000000005,"15min":0.68799999999999994},"min":{"1min":0.49099999999999999,"5min":0.442,"15min":0.442},"max":{"1min":0.85199999999999998,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.626},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.71899999999999997,"15min":0.72699999999999998},"min":{"1min":0.50900000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85999999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.71599999999999997}]},{"osd":9,"last update":"Fri Sep 13 17:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69499999999999995,"15min":0.70799999999999996},"min":{"1min":0.55400000000000005,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.78300000000000003,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72899999999999998,"15min":0.751},"min":{"1min":0.60299999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.83099999999999996,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.71899999999999997}]},{"osd":11,"last update":"Fri Sep 13 17:13:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.70899999999999996,"15min":0.69499999999999995},"min":{"1min":0.66200000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.86199999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70499999999999996,"15min":0.68700000000000006},"min":{"1min":0.61699999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.83099999999999996,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.54400000000000004}]}]},{"osd":9,"up_from":67,"seq":287762808883,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1077248,"data_stored":926467,"data_compressed":45788,"data_compressed_allocated":61440,"data_compressed_original":466944,"omap_allocated":1597,"internal_metadata":31848899},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.38800000000000001,"15min":0.40400000000000003},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.58799999999999997,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.40799999999999997,"15min":0.42199999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.52800000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.312}]},{"osd":1,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.432,"5min":0.374,"15min":0.374},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55100000000000005,"15min":0.56499999999999995},"min":{"1min":0.35499999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70999999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.45800000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57899999999999996,"15min":0.60299999999999998},"min":{"1min":0.38400000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80200000000000005,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56699999999999995,"15min":0.58699999999999997},"min":{"1min":0.42499999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.66400000000000003,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.57499999999999996}]},{"osd":3,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.46600000000000003,"15min":0.49399999999999999},"min":{"1min":0.28599999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54000000000000004,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.46600000000000003,"15min":0.504},"min":{"1min":0.27300000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.52200000000000002,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.33900000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56899999999999995,"15min":0.58099999999999996},"min":{"1min":0.46200000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.70499999999999996,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61899999999999999,"15min":0.63800000000000001},"min":{"1min":0.39800000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.80000000000000004,"5min":1.26,"15min":1.26},"last":0.47299999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.621,"15min":0.65300000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.70499999999999996,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.624,"15min":0.66100000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.74399999999999999,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.51200000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:10:48 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.49299999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.66200000000000003,"15min":0.69199999999999995},"min":{"1min":0.45100000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.77100000000000002,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.65900000000000003,"15min":0.69199999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.73599999999999999,"5min":1.018,"15min":1.018},"last":0.41699999999999998}]},{"osd":8,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.65900000000000003,"15min":0.68300000000000005},"min":{"1min":0.45700000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.76900000000000002,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.496},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.67900000000000005,"15min":0.71099999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78200000000000003,"5min":1.228,"15min":1.228},"last":0.40699999999999997}]},{"osd":10,"last update":"Fri Sep 13 17:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.65700000000000003,"15min":0.67800000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.83299999999999996,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.69199999999999995,"15min":0.71799999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.76400000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.56399999999999995}]},{"osd":11,"last update":"Fri Sep 13 17:13:29 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.628,"15min":0.622},"min":{"1min":0.57699999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.80500000000000005,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.60399999999999998,"15min":0.60099999999999998},"min":{"1min":0.501,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83099999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.55100000000000005}]}]},{"osd":8,"up_from":59,"seq":253403070521,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1073152,"data_stored":922291,"data_compressed":45788,"data_compressed_allocated":61440,"data_compressed_original":466944,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54600000000000004,"15min":0.54900000000000004},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.79600000000000004,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.627},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52300000000000002,"15min":0.53400000000000003},"min":{"1min":0.38300000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.55100000000000005}]},{"osd":1,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.57199999999999995,"15min":0.55400000000000005},"min":{"1min":0.38100000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.79700000000000004,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.57199999999999995,"15min":0.54400000000000004},"min":{"1min":0.42499999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.53300000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.434,"15min":0.42299999999999999},"min":{"1min":0.29499999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.45200000000000001,"15min":0.442},"min":{"1min":0.39000000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.626,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.66300000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.34999999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.69799999999999995,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56699999999999995,"15min":0.56399999999999995},"min":{"1min":0.41699999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.67700000000000005}]},{"osd":4,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.59699999999999998,"15min":0.57799999999999996},"min":{"1min":0.52100000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79100000000000004,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.621,"15min":0.59999999999999998},"min":{"1min":0.53500000000000003,"5min":0.313,"15min":0.313},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.60399999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.318,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.80100000000000005,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54000000000000004,"15min":0.53800000000000003},"min":{"1min":0.40699999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.755,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.69199999999999995}]},{"osd":6,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.63200000000000001,"15min":0.624},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.84399999999999997,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63900000000000001,"15min":0.64700000000000002},"min":{"1min":0.504,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.85299999999999998,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.78100000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.66700000000000004,"15min":0.65300000000000002},"min":{"1min":0.53100000000000003,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91800000000000004,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.68500000000000005,"15min":0.67100000000000004},"min":{"1min":0.52600000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93999999999999995,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.76300000000000001}]},{"osd":9,"last update":"Fri Sep 13 17:12:53 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.67200000000000004,"15min":0.66800000000000004},"min":{"1min":0.51900000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86499999999999999,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.67600000000000005,"15min":0.67500000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.77200000000000002}]},{"osd":10,"last update":"Fri Sep 13 17:13:15 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.69899999999999995,"15min":0.68300000000000005},"min":{"1min":0.54600000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.90700000000000003,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.71999999999999997,"15min":0.70299999999999996},"min":{"1min":0.57199999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91900000000000004,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.73999999999999999}]},{"osd":11,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.71099999999999997,"15min":0.70899999999999996},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.89700000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.754},{"interface":"front","average":{"1min":0.746,"5min":0.73499999999999999,"15min":0.73299999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.72099999999999997}]}]},{"osd":7,"up_from":51,"seq":219043332157,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1093632,"data_stored":1127004,"data_compressed":63001,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1587,"internal_metadata":27654605},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:11:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.39700000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.66200000000000003,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.35799999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.52500000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.379,"15min":0.36099999999999999},"min":{"1min":0.27100000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.497,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38100000000000001,"15min":0.35499999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.52800000000000002,"5min":0.623,"15min":0.623},"last":0.36199999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55100000000000005,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70399999999999996,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54700000000000004,"15min":0.51800000000000002},"min":{"1min":0.38300000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.79700000000000004,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.42199999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53100000000000003,"15min":0.50900000000000001},"min":{"1min":0.35199999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72299999999999998,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.54900000000000004,"15min":0.53800000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69699999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.40899999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.47799999999999998,"15min":0.46200000000000002},"min":{"1min":0.33600000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.60699999999999998,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.314},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45100000000000001,"15min":0.442},"min":{"1min":0.27200000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.61299999999999999,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.34399999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.59999999999999998,"15min":0.57199999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.81899999999999995,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58799999999999997,"15min":0.57599999999999996},"min":{"1min":0.42899999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.75900000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.441}]},{"osd":6,"last update":"Fri Sep 13 17:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59999999999999998,"15min":0.58199999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.75600000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61499999999999999,"15min":0.59299999999999997},"min":{"1min":0.44900000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76000000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.49399999999999999}]},{"osd":8,"last update":"Fri Sep 13 17:13:32 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64100000000000001,"15min":0.63},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.75600000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.67000000000000004,"15min":0.64800000000000002},"min":{"1min":0.52600000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.83399999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.52600000000000002}]},{"osd":9,"last update":"Fri Sep 13 17:12:55 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.67200000000000004,"15min":0.68400000000000005},"min":{"1min":0.437,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84599999999999997,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.48399999999999999,"5min":0.438,"15min":0.438},"max":{"1min":0.80600000000000005,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.48599999999999999}]},{"osd":10,"last update":"Fri Sep 13 17:13:13 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.68000000000000005,"15min":0.69599999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.80000000000000004,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65500000000000003,"15min":0.65300000000000002},"min":{"1min":0.45300000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.80700000000000005,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.503}]},{"osd":11,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.73199999999999998,"15min":0.73299999999999998},"min":{"1min":0.57999999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.85499999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.71999999999999997,"15min":0.71299999999999997},"min":{"1min":0.68400000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.83799999999999997,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.51700000000000002}]}]},{"osd":6,"up_from":46,"seq":197568495681,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1028096,"data_stored":524331,"data_compressed":26642,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:13:49 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.35099999999999998,"15min":0.33800000000000002},"min":{"1min":0.27100000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.432,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.373,"15min":0.36899999999999999},"min":{"1min":0.255,"5min":0.251,"15min":0.251},"max":{"1min":0.48299999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.32900000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:13:49 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52500000000000002,"15min":0.51000000000000001},"min":{"1min":0.32000000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.72199999999999998,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52400000000000002,"15min":0.51000000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71699999999999997,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.51300000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:13:49 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.40799999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.66300000000000003,"5min":1.095,"15min":1.095},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54500000000000004,"15min":0.52700000000000002},"min":{"1min":0.371,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69299999999999995,"5min":0.877,"15min":0.877},"last":0.39100000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:13:49 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.40999999999999998,"15min":0.41199999999999998},"min":{"1min":0.313,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.61499999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.41799999999999998,"15min":0.41199999999999998},"min":{"1min":0.30099999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52600000000000002,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.40600000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:13:49 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52500000000000002,"15min":0.50700000000000001},"min":{"1min":0.39600000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72699999999999998,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56000000000000005,"15min":0.53400000000000003},"min":{"1min":0.39000000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76900000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.746}]},{"osd":5,"last update":"Fri Sep 13 17:13:49 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.77500000000000002,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.374},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.59999999999999998},"min":{"1min":0.45100000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.77500000000000002,"5min":1.131,"15min":1.131},"last":0.52900000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:13:06 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59499999999999997,"15min":0.60299999999999998},"min":{"1min":0.41599999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.81100000000000005,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59699999999999998,"15min":0.59499999999999997},"min":{"1min":0.42899999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.76600000000000001,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.77200000000000002}]},{"osd":8,"last update":"Fri Sep 13 17:13:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.62,"15min":0.626},"min":{"1min":0.47199999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.76300000000000001,"5min":0.874,"15min":0.874},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.64500000000000002,"15min":0.64700000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.76600000000000001,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.56399999999999995}]},{"osd":9,"last update":"Fri Sep 13 17:12:53 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.59199999999999997,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.626,"15min":0.65400000000000003},"min":{"1min":0.38200000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78000000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.72199999999999998}]},{"osd":10,"last update":"Fri Sep 13 17:13:17 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.51500000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.747,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.67600000000000005,"15min":0.67800000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.747,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.79800000000000004}]},{"osd":11,"last update":"Fri Sep 13 17:13:31 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.70299999999999996,"15min":0.71599999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.78500000000000003,"5min":0.877,"15min":0.877},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.68400000000000005,"15min":0.69199999999999995},"min":{"1min":0.53300000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.80100000000000005,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.58299999999999996}]}]},{"osd":5,"up_from":38,"seq":163208757318,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1122304,"data_stored":1253213,"data_compressed":69157,"data_compressed_allocated":90112,"data_compressed_original":786432,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:13:24 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.50600000000000001,"15min":0.48399999999999999},"min":{"1min":0.35699999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.621},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.50900000000000001,"15min":0.48699999999999999},"min":{"1min":0.40100000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.57899999999999996}]},{"osd":1,"last update":"Fri Sep 13 17:13:24 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.58399999999999996,"15min":0.55500000000000005},"min":{"1min":0.441,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78300000000000003,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.40400000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.443}]},{"osd":2,"last update":"Fri Sep 13 17:13:24 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.40000000000000002,"15min":0.378},"min":{"1min":0.28899999999999998,"5min":0.222,"15min":0.222},"max":{"1min":0.56299999999999994,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.40799999999999997,"15min":0.38200000000000001},"min":{"1min":0.30199999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.61099999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.40100000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:13:24 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.53600000000000003,"15min":0.51100000000000001},"min":{"1min":0.39100000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.53500000000000003,"15min":0.51500000000000001},"min":{"1min":0.38400000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.505}]},{"osd":4,"last update":"Fri Sep 13 17:13:24 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57299999999999995,"15min":0.56200000000000006},"min":{"1min":0.374,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.60799999999999998,"15min":0.57299999999999995},"min":{"1min":0.40899999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82899999999999996,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.41799999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:13:43 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.58099999999999996,"15min":0.56899999999999995},"min":{"1min":0.53000000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.58799999999999997,"15min":0.56899999999999995},"min":{"1min":0.52000000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.79800000000000004,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.47599999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:12:59 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61099999999999999,"15min":0.60999999999999999},"min":{"1min":0.40100000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.86299999999999999,"5min":0.874,"15min":0.874},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.625,"15min":0.60999999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.43099999999999999}]},{"osd":8,"last update":"Fri Sep 13 17:13:35 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.41499999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81299999999999994,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.42599999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.46400000000000002}]},{"osd":9,"last update":"Fri Sep 13 17:12:51 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.64200000000000002,"15min":0.626},"min":{"1min":0.51000000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.63900000000000001,"15min":0.621},"min":{"1min":0.52200000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56100000000000005}]},{"osd":10,"last update":"Fri Sep 13 17:13:12 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.67000000000000004,"15min":0.64400000000000002},"min":{"1min":0.53100000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.67000000000000004,"15min":0.64200000000000002},"min":{"1min":0.502,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.53900000000000003}]}]},{"osd":4,"up_from":33,"seq":141733920843,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":1040384,"data_stored":530520,"data_compressed":26642,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:12:50 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.247},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.36599999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:12:59 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.38300000000000001,"15min":0.36499999999999999},"min":{"1min":0.28999999999999998,"5min":0.221,"15min":0.221},"max":{"1min":0.68899999999999995,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40699999999999997,"15min":0.39500000000000002},"min":{"1min":0.30299999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.61399999999999999,"5min":2.52,"15min":2.52},"last":0.28899999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:12:59 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.78000000000000003,"15min":0.63},"min":{"1min":0.41699999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.84299999999999997,"5min":15.401,"15min":15.401},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.56999999999999995,"15min":0.53200000000000003},"min":{"1min":0.40400000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83199999999999996,"5min":1.335,"15min":1.335},"last":0.40899999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:12:59 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55200000000000005,"15min":0.55400000000000005},"min":{"1min":0.372,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.77800000000000002,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.747,"15min":0.61899999999999999},"min":{"1min":0.41699999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88400000000000001,"5min":15.425000000000001,"15min":15.425000000000001},"last":0.56599999999999995}]},{"osd":5,"last update":"Fri Sep 13 17:13:25 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.63,"15min":0.58299999999999996},"min":{"1min":0.39600000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.86299999999999999,"5min":3.0790000000000002,"15min":3.0790000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.63600000000000001,"15min":0.57699999999999996},"min":{"1min":0.40999999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.80500000000000005,"5min":4.0810000000000004,"15min":4.0810000000000004},"last":0.45400000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:13:47 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57599999999999996,"15min":0.52800000000000002},"min":{"1min":0.42799999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.79600000000000004,"5min":2.6469999999999998,"15min":2.6469999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60499999999999998,"15min":0.56599999999999995},"min":{"1min":0.435,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.877,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.60099999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:13:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52000000000000002,"15min":0.497},"min":{"1min":0.45500000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.62,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53300000000000003,"15min":0.495},"min":{"1min":0.40300000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69799999999999995,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.46600000000000003}]},{"osd":8,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.67700000000000005,"15min":0.64700000000000002},"min":{"1min":0.54100000000000004,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.874,"5min":2.577,"15min":2.577},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.67000000000000004,"15min":0.65100000000000002},"min":{"1min":0.56899999999999995,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.82799999999999996,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.58199999999999996}]},{"osd":9,"last update":"Fri Sep 13 17:12:50 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":1.2509999999999999,"15min":1.4930000000000001},"min":{"1min":0.54600000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.84499999999999997,"5min":15.448,"15min":15.448},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":1.2150000000000001,"15min":1.456},"min":{"1min":0.52000000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.82099999999999995,"5min":15.385,"15min":15.385},"last":0.51100000000000001}]},{"osd":10,"last update":"Fri Sep 13 17:13:17 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65100000000000002,"15min":0.63200000000000001},"min":{"1min":0.432,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.72899999999999998,"5min":3.1259999999999999,"15min":3.1259999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68799999999999994,"15min":0.68400000000000005},"min":{"1min":0.505,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.88700000000000001,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.63700000000000001}]},{"osd":11,"last update":"Fri Sep 13 17:13:25 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.89000000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.81200000000000006,"15min":0.82399999999999995},"min":{"1min":0.56100000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91500000000000004,"5min":3.165,"15min":3.165},"last":0.503}]}]},{"osd":3,"up_from":25,"seq":107374182479,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1077248,"data_stored":1048737,"data_compressed":51944,"data_compressed_allocated":69632,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:13:41 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36199999999999999,"15min":0.32400000000000001},"min":{"1min":0.251,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.69699999999999995,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.376,"15min":0.33200000000000002},"min":{"1min":0.23200000000000001,"5min":0.19900000000000001,"15min":0.19600000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.42199999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:13:41 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55500000000000005,"15min":0.504},"min":{"1min":0.34200000000000003,"5min":0.32900000000000001,"15min":0.30099999999999999},"max":{"1min":0.76600000000000001,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55100000000000005,"15min":0.496},"min":{"1min":0.40899999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78700000000000003,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.495}]},{"osd":2,"last update":"Fri Sep 13 17:13:41 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54400000000000004,"15min":0.50600000000000001},"min":{"1min":0.40300000000000002,"5min":0.34000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71599999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56999999999999995,"15min":0.51800000000000002},"min":{"1min":0.41699999999999998,"5min":0.315,"15min":0.25900000000000001},"max":{"1min":0.82899999999999996,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.45800000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:12:56 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55800000000000005,"15min":0.52400000000000002},"min":{"1min":0.35699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.749,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56399999999999995,"15min":0.51800000000000002},"min":{"1min":0.39900000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.50900000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:13:22 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57399999999999995,"15min":0.55900000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80200000000000005,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36599999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72499999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.441}]},{"osd":6,"last update":"Fri Sep 13 17:13:44 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.44600000000000001,"15min":0.44400000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.72099999999999997,"5min":0.746,"15min":0.746},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.47199999999999998,"15min":0.44800000000000001},"min":{"1min":0.32100000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.75600000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.53700000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:13:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59499999999999997,"15min":0.58199999999999996},"min":{"1min":0.45700000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72199999999999998,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78500000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.52900000000000003}]},{"osd":8,"last update":"Fri Sep 13 17:10:26 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66400000000000003}]},{"osd":9,"last update":"Fri Sep 13 17:12:51 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.60399999999999998,"15min":0.628},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.83799999999999997,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.60999999999999999,"15min":0.64400000000000002},"min":{"1min":0.41099999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71499999999999997,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.52000000000000002}]},{"osd":10,"last update":"Fri Sep 13 17:13:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66300000000000003,"15min":0.67900000000000005},"min":{"1min":0.47399999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.84999999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.65200000000000002,"15min":0.66800000000000004},"min":{"1min":0.45000000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82699999999999996,"5min":0.87,"15min":0.87},"last":0.58699999999999997}]},{"osd":11,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67400000000000004,"15min":0.67700000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.88500000000000001,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.51000000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84899999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.60399999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411413,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1118208,"data_stored":594627,"data_compressed":26642,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:13:10 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.67500000000000004,"15min":0.70899999999999996},"min":{"1min":0.32100000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.79500000000000004,"5min":19.158999999999999,"15min":19.158999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.49299999999999999,"15min":0.47299999999999998},"min":{"1min":0.34300000000000003,"5min":0.316,"15min":0.29699999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.47099999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:13:10 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.55600000000000005,"15min":0.49299999999999999},"min":{"1min":0.35999999999999999,"5min":0.32900000000000001,"15min":0.27900000000000003},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.57799999999999996,"15min":0.495},"min":{"1min":0.42899999999999999,"5min":0.31900000000000001,"15min":0.29599999999999999},"max":{"1min":0.82699999999999996,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.41699999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54800000000000004,"15min":0.51000000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54300000000000004,"15min":0.51100000000000001},"min":{"1min":0.35399999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.49299999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:13:24 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63800000000000001,"15min":0.64000000000000001},"min":{"1min":0.49199999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.83699999999999997,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68000000000000005,"15min":0.68200000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.61099999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:13:15 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.45000000000000001,"15min":0.40799999999999997},"min":{"1min":0.33900000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.78400000000000003,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.46000000000000002,"15min":0.41299999999999998},"min":{"1min":0.36199999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.55100000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:13:41 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.58299999999999996,"15min":0.55300000000000005},"min":{"1min":0.437,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.83699999999999997,"5min":0.875,"15min":0.875},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.71399999999999997,"15min":0.59199999999999997},"min":{"1min":0.42999999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80400000000000005,"5min":19.276,"15min":19.276},"last":0.55800000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:13:29 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69699999999999995,"15min":0.69999999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.89000000000000001,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.72699999999999998,"15min":0.73399999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.85999999999999999,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.72699999999999998}]},{"osd":8,"last update":"Fri Sep 13 17:13:29 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.59199999999999997,"15min":0.55400000000000005},"min":{"1min":0.42099999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.84199999999999997,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.62,"15min":0.57999999999999996},"min":{"1min":0.41199999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86899999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.626}]},{"osd":9,"last update":"Fri Sep 13 17:12:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.65800000000000003,"15min":0.64100000000000001},"min":{"1min":0.48499999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.92700000000000005,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":1.135,"15min":1.341},"min":{"1min":0.46600000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.88,"5min":19.210999999999999,"15min":19.210999999999999},"last":0.64000000000000001}]},{"osd":10,"last update":"Fri Sep 13 17:13:15 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.69299999999999995,"15min":0.66900000000000004},"min":{"1min":0.61699999999999999,"5min":0.495,"15min":0.495},"max":{"1min":0.94199999999999995,"5min":1.01,"15min":1.01},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":1.2749999999999999,"15min":1.488},"min":{"1min":0.53900000000000003,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.90900000000000003,"5min":19.242000000000001,"15min":19.242000000000001},"last":0.67300000000000004}]},{"osd":11,"last update":"Fri Sep 13 17:13:24 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.76900000000000002,"15min":0.78100000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.89600000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.79100000000000004,"15min":0.80300000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91500000000000004,"5min":0.995,"15min":0.995},"last":0.70499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":1101824,"data_stored":592369,"data_compressed":26642,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:12:58 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.49299999999999999,"15min":0.46700000000000003},"min":{"1min":0.33300000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.68000000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.5},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.495,"15min":0.46899999999999997},"min":{"1min":0.28999999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.67400000000000004,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.35499999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:13:13 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.57699999999999996,"15min":0.52000000000000002},"min":{"1min":0.32600000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.754,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56599999999999995,"15min":0.51800000000000002},"min":{"1min":0.38400000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.748,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.49099999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:13:41 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53500000000000003,"15min":0.52300000000000002},"min":{"1min":0.309,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.77200000000000002,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55900000000000005,"15min":0.53200000000000003},"min":{"1min":0.38800000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.438}]},{"osd":4,"last update":"Fri Sep 13 17:10:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.39500000000000002,"15min":0.377},"min":{"1min":0.29199999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.62},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.38100000000000001,"15min":0.36299999999999999},"min":{"1min":0.26600000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:13:22 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.58199999999999996,"15min":0.53100000000000003},"min":{"1min":0.46300000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.82099999999999995,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.625,"5min":0.58399999999999996,"15min":0.52100000000000002},"min":{"1min":0.379,"5min":0.315,"15min":0.315},"max":{"1min":0.73699999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.45100000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:13:41 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.56799999999999995,"15min":0.53300000000000003},"min":{"1min":0.46400000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.80000000000000004,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.59399999999999997,"15min":0.57499999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.69299999999999995,"5min":0.88,"15min":0.88},"last":0.46999999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:13:06 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.50800000000000001,"15min":0.48199999999999998},"min":{"1min":0.34100000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.59899999999999998,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.505,"15min":0.48799999999999999},"min":{"1min":0.33800000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.66200000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.26800000000000002}]},{"osd":8,"last update":"Fri Sep 13 17:13:34 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63900000000000001,"15min":0.621},"min":{"1min":0.46899999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79400000000000004,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.379},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68000000000000005,"15min":0.66500000000000004},"min":{"1min":0.503,"5min":0.434,"15min":0.434},"max":{"1min":0.78200000000000003,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.39800000000000002}]},{"osd":9,"last update":"Fri Sep 13 17:12:51 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.63300000000000001,"15min":0.64100000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72199999999999998,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.68500000000000005,"15min":0.69799999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.85499999999999998,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.47899999999999998}]},{"osd":10,"last update":"Fri Sep 13 17:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.69299999999999995,"15min":0.73699999999999999},"min":{"1min":0.44700000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.69899999999999995,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.65500000000000003,"15min":0.69499999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.70999999999999996,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.41699999999999998}]},{"osd":11,"last update":"Fri Sep 13 17:13:24 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69499999999999995,"15min":0.69799999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.77600000000000002,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.79300000000000004,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.51300000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":1036288,"data_stored":515520,"data_compressed":23656,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.505,"15min":0.47699999999999998},"min":{"1min":0.36199999999999999,"5min":0.27900000000000003,"15min":0.27300000000000002},"max":{"1min":0.70699999999999996,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52300000000000002,"15min":0.49099999999999999},"min":{"1min":0.34599999999999997,"5min":0.28499999999999998,"15min":0.245},"max":{"1min":0.68799999999999994,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.58299999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:13:10 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53600000000000003,"15min":0.51000000000000001},"min":{"1min":0.35799999999999998,"5min":0.35699999999999998,"15min":0.35099999999999998},"max":{"1min":0.72099999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55500000000000005,"15min":0.51500000000000001},"min":{"1min":0.373,"5min":0.33100000000000002,"15min":0.315},"max":{"1min":0.79800000000000004,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.48499999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.377,"15min":0.371},"min":{"1min":0.27700000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.59799999999999998,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.313},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.34899999999999998,"15min":0.34200000000000003},"min":{"1min":0.26100000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.34899999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:12:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52900000000000003,"15min":0.49099999999999999},"min":{"1min":0.39100000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72699999999999998,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.54900000000000004,"15min":0.51200000000000001},"min":{"1min":0.442,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77500000000000002,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52100000000000002,"15min":0.50900000000000001},"min":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82399999999999995,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.54800000000000004,"15min":0.53000000000000003},"min":{"1min":0.42799999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80500000000000005,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.624}]},{"osd":6,"last update":"Fri Sep 13 17:13:43 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.44400000000000001,"15min":0.42199999999999999},"min":{"1min":0.28299999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.68700000000000006,"5min":0.754,"15min":0.754},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.44,"15min":0.42799999999999999},"min":{"1min":0.29399999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.65000000000000002,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.439}]},{"osd":7,"last update":"Fri Sep 13 17:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.57199999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40200000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.82499999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.38800000000000001}]},{"osd":8,"last update":"Fri Sep 13 17:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.59099999999999997,"15min":0.60299999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.75800000000000001,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.627,"15min":0.65000000000000002},"min":{"1min":0.39500000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.77500000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.54500000000000004}]},{"osd":9,"last update":"Fri Sep 13 17:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.58999999999999997,"15min":0.626},"min":{"1min":0.376,"5min":0.25,"15min":0.25},"max":{"1min":0.748,"5min":0.88,"15min":0.88},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.58899999999999997,"15min":0.621},"min":{"1min":0.374,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.81100000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.496}]},{"osd":10,"last update":"Fri Sep 13 17:13:15 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.67400000000000004,"15min":0.68999999999999995},"min":{"1min":0.47599999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84399999999999997,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.67100000000000004,"15min":0.68700000000000006},"min":{"1min":0.503,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.81799999999999995,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.46200000000000002}]},{"osd":11,"last update":"Fri Sep 13 17:13:39 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.77500000000000002,"15min":0.70199999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88,"5min":14.611000000000001,"15min":14.611000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63200000000000001,"15min":0.628},"min":{"1min":0.496,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.80100000000000005,"5min":0.874,"15min":0.874},"last":0.63900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36359,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":68128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":70659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":525100,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":134839,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":4203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":393954,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394034,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":202536,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:13:54.849 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:13:54.850 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:54 smithi149 ceph-mon[35496]: Updating smithi118:/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:13:54.850 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:54 smithi149 ceph-mon[35496]: Updating smithi149:/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:13:54.850 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:54 smithi149 ceph-mon[35496]: Updating smithi087:/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:13:54.850 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:54 smithi149 ceph-mon[35496]: Updating smithi118:/var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T17:13:54.850 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:54 smithi149 ceph-mon[35496]: Updating smithi149:/var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T17:13:54.850 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:54 smithi149 ceph-mon[35496]: Updating smithi087:/var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T17:13:54.850 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:54 smithi149 ceph-mon[35496]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:13:54.850 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:54 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/153880072' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:13:54.850 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:54 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2385628682' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:13:54.850 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:54 smithi149 ceph-mon[35496]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-09-13T17:13:54.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:54 smithi118 ceph-mon[34374]: Updating smithi118:/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:13:54.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:54 smithi118 ceph-mon[34374]: Updating smithi149:/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:13:54.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:54 smithi118 ceph-mon[34374]: Updating smithi087:/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:13:54.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:54 smithi118 ceph-mon[34374]: Updating smithi118:/var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T17:13:54.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:54 smithi118 ceph-mon[34374]: Updating smithi149:/var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T17:13:54.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:54 smithi118 ceph-mon[34374]: Updating smithi087:/var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T17:13:54.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:54 smithi118 ceph-mon[34374]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:13:54.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:54 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/153880072' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:13:54.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:54 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2385628682' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:13:54.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:54 smithi118 ceph-mon[34374]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-09-13T17:13:54.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.981+0000 7f2adfa80640 1 -- 172.21.15.87:0/1311893868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ad8100590 msgr2=0x7f2ad8104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:54.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.981+0000 7f2adfa80640 1 --2- 172.21.15.87:0/1311893868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ad8100590 0x7f2ad8104a30 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8009930 tx=0x7f2ac802a420 comp rx=0 tx=0).stop 2024-09-13T17:13:54.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.981+0000 7f2adfa80640 1 -- 172.21.15.87:0/1311893868 shutdown_connections 2024-09-13T17:13:54.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.981+0000 7f2adfa80640 1 --2- 172.21.15.87:0/1311893868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ad8105190 0x7f2ad810bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.981+0000 7f2adfa80640 1 --2- 172.21.15.87:0/1311893868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ad8100590 0x7f2ad8104a30 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.981+0000 7f2adfa80640 1 --2- 172.21.15.87:0/1311893868 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ad80ffbe0 0x7f2ad80fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.981+0000 7f2adfa80640 1 -- 172.21.15.87:0/1311893868 >> 172.21.15.87:0/1311893868 conn(0x7f2ad8074180 msgr2=0x7f2ad8074590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:54.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.981+0000 7f2adfa80640 1 -- 172.21.15.87:0/1311893868 shutdown_connections 2024-09-13T17:13:54.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.981+0000 7f2adfa80640 1 -- 172.21.15.87:0/1311893868 wait complete. 2024-09-13T17:13:54.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.982+0000 7f2adfa80640 1 Processor -- start 2024-09-13T17:13:54.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.982+0000 7f2adfa80640 1 -- start start 2024-09-13T17:13:54.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.982+0000 7f2adfa80640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ad80ffbe0 0x7f2ad81962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:54.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.982+0000 7f2adfa80640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ad8105190 0x7f2ad8196800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:54.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.982+0000 7f2adfa80640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ad819abf0 0x7f2ad819b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:54.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.982+0000 7f2adfa80640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad819b5e0 con 0x7f2ad8105190 2024-09-13T17:13:54.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.982+0000 7f2adfa80640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad819b750 con 0x7f2ad80ffbe0 2024-09-13T17:13:54.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.982+0000 7f2adfa80640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad819b8c0 con 0x7f2ad819abf0 2024-09-13T17:13:54.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.982+0000 7f2add01b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ad8105190 0x7f2ad8196800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:54.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.982+0000 7f2add01b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ad8105190 0x7f2ad8196800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41926/0 (socket says 172.21.15.87:41926) 2024-09-13T17:13:54.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.982+0000 7f2add01b640 1 -- 172.21.15.87:0/2657197226 learned_addr learned my addr 172.21.15.87:0/2657197226 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:54.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.982+0000 7f2add81c640 1 --2- 172.21.15.87:0/2657197226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ad80ffbe0 0x7f2ad81962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:54.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.982+0000 7f2ade01d640 1 --2- 172.21.15.87:0/2657197226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ad819abf0 0x7f2ad819b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:54.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.982+0000 7f2add01b640 1 -- 172.21.15.87:0/2657197226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ad819abf0 msgr2=0x7f2ad819b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:54.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.982+0000 7f2add01b640 1 --2- 172.21.15.87:0/2657197226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ad819abf0 0x7f2ad819b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.982+0000 7f2add01b640 1 -- 172.21.15.87:0/2657197226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ad80ffbe0 msgr2=0x7f2ad81962c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:54.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.982+0000 7f2add01b640 1 --2- 172.21.15.87:0/2657197226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ad80ffbe0 0x7f2ad81962c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:54.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.982+0000 7f2add01b640 1 -- 172.21.15.87:0/2657197226 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac8009560 con 0x7f2ad8105190 2024-09-13T17:13:54.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.982+0000 7f2add01b640 1 --2- 172.21.15.87:0/2657197226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ad8105190 0x7f2ad8196800 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2ac802a940 tx=0x7f2ac8003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:54.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.983+0000 7f2aceffd640 1 -- 172.21.15.87:0/2657197226 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac803b670 con 0x7f2ad8105190 2024-09-13T17:13:54.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.983+0000 7f2aceffd640 1 -- 172.21.15.87:0/2657197226 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2ac803bc80 con 0x7f2ad8105190 2024-09-13T17:13:54.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.983+0000 7f2adfa80640 1 -- 172.21.15.87:0/2657197226 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad81a2ea0 con 0x7f2ad8105190 2024-09-13T17:13:54.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.983+0000 7f2aceffd640 1 -- 172.21.15.87:0/2657197226 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac8031c60 con 0x7f2ad8105190 2024-09-13T17:13:54.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.983+0000 7f2adfa80640 1 -- 172.21.15.87:0/2657197226 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad81a3210 con 0x7f2ad8105190 2024-09-13T17:13:54.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.984+0000 7f2adfa80640 1 -- 172.21.15.87:0/2657197226 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad8068020 con 0x7f2ad8105190 2024-09-13T17:13:54.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.985+0000 7f2aceffd640 1 -- 172.21.15.87:0/2657197226 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 24) v1 ==== 136049+0+0 (secure 0 0 0) 0x7f2ac8031400 con 0x7f2ad8105190 2024-09-13T17:13:54.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.985+0000 7f2aceffd640 1 --2- 172.21.15.87:0/2657197226 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f2ac40a1290 0x7f2ac40a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:54.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.985+0000 7f2add81c640 1 --2- 172.21.15.87:0/2657197226 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f2ac40a1290 0x7f2ac40a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:54.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.985+0000 7f2aceffd640 1 -- 172.21.15.87:0/2657197226 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f2ac80eda90 con 0x7f2ad8105190 2024-09-13T17:13:54.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.986+0000 7f2add81c640 1 --2- 172.21.15.87:0/2657197226 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f2ac40a1290 0x7f2ac40a3750 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4005d00 tx=0x7f2ad400b410 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:54.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:54.989+0000 7f2aceffd640 1 -- 172.21.15.87:0/2657197226 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2ac80b6a70 con 0x7f2ad8105190 2024-09-13T17:13:55.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.154+0000 7f2adfa80640 1 -- 172.21.15.87:0/2657197226 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ad80fffc0 con 0x7f2ad8105190 2024-09-13T17:13:55.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.155+0000 7f2aceffd640 1 -- 172.21.15.87:0/2657197226 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+25192 (secure 0 0 0) 0x7f2ac80ba090 con 0x7f2ad8105190 2024-09-13T17:13:55.157 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:13:55.157 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":94,"fsid":"043d5bae-71f2-11ef-bceb-c7b262605968","created":"2024-09-13T17:03:57.852010+0000","modified":"2024-09-13T17:13:49.377136+0000","last_up_change":"2024-09-13T17:10:34.423548+0000","last_in_change":"2024-09-13T17:10:14.228123+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:07:02.286400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:11:21.965141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:11:22.504345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:11:25.565163+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58250283-85c0-416e-abdd-1fc5a7ff0c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6803","nonce":1316956138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6805","nonce":1316956138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6809","nonce":1316956138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6807","nonce":1316956138}]},"public_addr":"172.21.15.87:6803/1316956138","cluster_addr":"172.21.15.87:6805/1316956138","heartbeat_back_addr":"172.21.15.87:6809/1316956138","heartbeat_front_addr":"172.21.15.87:6807/1316956138","state":["exists","up"]},{"osd":1,"uuid":"b9d49969-94b1-4262-b4ff-db0a8e3331af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6801","nonce":3352566727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6803","nonce":3352566727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6807","nonce":3352566727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6805","nonce":3352566727}]},"public_addr":"172.21.15.118:6801/3352566727","cluster_addr":"172.21.15.118:6803/3352566727","heartbeat_back_addr":"172.21.15.118:6807/3352566727","heartbeat_front_addr":"172.21.15.118:6805/3352566727","state":["exists","up"]},{"osd":2,"uuid":"ba64549e-d736-426f-b466-f569af5f16d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6801","nonce":2774581686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6803","nonce":2774581686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6807","nonce":2774581686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6805","nonce":2774581686}]},"public_addr":"172.21.15.149:6801/2774581686","cluster_addr":"172.21.15.149:6803/2774581686","heartbeat_back_addr":"172.21.15.149:6807/2774581686","heartbeat_front_addr":"172.21.15.149:6805/2774581686","state":["exists","up"]},{"osd":3,"uuid":"3d5553e5-371b-49fd-976b-9e72a97a2f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6811","nonce":3306119066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6813","nonce":3306119066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6817","nonce":3306119066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6815","nonce":3306119066}]},"public_addr":"172.21.15.87:6811/3306119066","cluster_addr":"172.21.15.87:6813/3306119066","heartbeat_back_addr":"172.21.15.87:6817/3306119066","heartbeat_front_addr":"172.21.15.87:6815/3306119066","state":["exists","up"]},{"osd":4,"uuid":"2fbe0e27-34ec-42a6-9962-f1d8202b3159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6809","nonce":3342349890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6811","nonce":3342349890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6815","nonce":3342349890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6813","nonce":3342349890}]},"public_addr":"172.21.15.118:6809/3342349890","cluster_addr":"172.21.15.118:6811/3342349890","heartbeat_back_addr":"172.21.15.118:6815/3342349890","heartbeat_front_addr":"172.21.15.118:6813/3342349890","state":["exists","up"]},{"osd":5,"uuid":"53c14519-6170-4b5a-a79d-4835882d7bec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6809","nonce":3468867124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6811","nonce":3468867124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6815","nonce":3468867124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6813","nonce":3468867124}]},"public_addr":"172.21.15.149:6809/3468867124","cluster_addr":"172.21.15.149:6811/3468867124","heartbeat_back_addr":"172.21.15.149:6815/3468867124","heartbeat_front_addr":"172.21.15.149:6813/3468867124","state":["exists","up"]},{"osd":6,"uuid":"d3951b32-db77-4b8b-9de0-f05e03d13f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6819","nonce":326563617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6821","nonce":326563617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6825","nonce":326563617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6823","nonce":326563617}]},"public_addr":"172.21.15.87:6819/326563617","cluster_addr":"172.21.15.87:6821/326563617","heartbeat_back_addr":"172.21.15.87:6825/326563617","heartbeat_front_addr":"172.21.15.87:6823/326563617","state":["exists","up"]},{"osd":7,"uuid":"4d46dab7-a8bf-4e3e-b5c0-43860d336bdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6817","nonce":1690268990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6819","nonce":1690268990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6823","nonce":1690268990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6821","nonce":1690268990}]},"public_addr":"172.21.15.118:6817/1690268990","cluster_addr":"172.21.15.118:6819/1690268990","heartbeat_back_addr":"172.21.15.118:6823/1690268990","heartbeat_front_addr":"172.21.15.118:6821/1690268990","state":["exists","up"]},{"osd":8,"uuid":"5a015a7d-60a3-4412-96af-1b61d2ad51f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6817","nonce":1558675380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6819","nonce":1558675380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6823","nonce":1558675380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6821","nonce":1558675380}]},"public_addr":"172.21.15.149:6817/1558675380","cluster_addr":"172.21.15.149:6819/1558675380","heartbeat_back_addr":"172.21.15.149:6823/1558675380","heartbeat_front_addr":"172.21.15.149:6821/1558675380","state":["exists","up"]},{"osd":9,"uuid":"248c0b6e-4c4e-4c63-a0dd-e4cdf3b997a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6827","nonce":1453934262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6829","nonce":1453934262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6833","nonce":1453934262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6831","nonce":1453934262}]},"public_addr":"172.21.15.87:6827/1453934262","cluster_addr":"172.21.15.87:6829/1453934262","heartbeat_back_addr":"172.21.15.87:6833/1453934262","heartbeat_front_addr":"172.21.15.87:6831/1453934262","state":["exists","up"]},{"osd":10,"uuid":"24238714-e737-4371-b5d5-0cd3395f09bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6825","nonce":1034318850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6827","nonce":1034318850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6831","nonce":1034318850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6829","nonce":1034318850}]},"public_addr":"172.21.15.118:6825/1034318850","cluster_addr":"172.21.15.118:6827/1034318850","heartbeat_back_addr":"172.21.15.118:6831/1034318850","heartbeat_front_addr":"172.21.15.118:6829/1034318850","state":["exists","up"]},{"osd":11,"uuid":"409dd3bf-5154-4dea-8708-7de7f9e2e793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6825","nonce":271000465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6827","nonce":271000465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6831","nonce":271000465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6829","nonce":271000465}]},"public_addr":"172.21.15.149:6825/271000465","cluster_addr":"172.21.15.149:6827/271000465","heartbeat_back_addr":"172.21.15.149:6831/271000465","heartbeat_front_addr":"172.21.15.149:6829/271000465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:16.382664+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:37.914250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:00.425876+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:23.960183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:47.004088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:10.214345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:33.719221+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:57.099599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:20.971881+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:44.827167+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:08.135516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:32.085853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.d","mappings":[{"from":1,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8},{"from":5,"to":7}]},{"pgid":"3.28","mappings":[{"from":3,"to":6},{"from":5,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/718653925":"2024-09-14T17:13:49.377087+0000","172.21.15.87:0/3081317043":"2024-09-14T17:13:49.377087+0000","172.21.15.87:0/1633498542":"2024-09-14T17:13:49.377087+0000","172.21.15.87:6801/1587363880":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/3403361612":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/553289143":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/1475107314":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/515676743":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/3270371628":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6800/1587363880":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6800/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6801/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/2612130442":"2024-09-14T17:13:49.377087+0000","172.21.15.87:0/586423689":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6800/701043027":"2024-09-14T17:13:49.377087+0000","172.21.15.87:6801/701043027":"2024-09-14T17:13:49.377087+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:13:55.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.157+0000 7f2adfa80640 1 -- 172.21.15.87:0/2657197226 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f2ac40a1290 msgr2=0x7f2ac40a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:55.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.157+0000 7f2adfa80640 1 --2- 172.21.15.87:0/2657197226 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f2ac40a1290 0x7f2ac40a3750 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4005d00 tx=0x7f2ad400b410 comp rx=0 tx=0).stop 2024-09-13T17:13:55.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.157+0000 7f2adfa80640 1 -- 172.21.15.87:0/2657197226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ad8105190 msgr2=0x7f2ad8196800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:55.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.157+0000 7f2adfa80640 1 --2- 172.21.15.87:0/2657197226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ad8105190 0x7f2ad8196800 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2ac802a940 tx=0x7f2ac8003cd0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.157+0000 7f2adfa80640 1 -- 172.21.15.87:0/2657197226 shutdown_connections 2024-09-13T17:13:55.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.157+0000 7f2adfa80640 1 --2- 172.21.15.87:0/2657197226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ad819abf0 0x7f2ad819b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.157+0000 7f2adfa80640 1 --2- 172.21.15.87:0/2657197226 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f2ac40a1290 0x7f2ac40a3750 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.157+0000 7f2adfa80640 1 --2- 172.21.15.87:0/2657197226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ad8105190 0x7f2ad8196800 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.157+0000 7f2adfa80640 1 --2- 172.21.15.87:0/2657197226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ad80ffbe0 0x7f2ad81962c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.157+0000 7f2adfa80640 1 -- 172.21.15.87:0/2657197226 >> 172.21.15.87:0/2657197226 conn(0x7f2ad8074180 msgr2=0x7f2ad8102d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:55.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.157+0000 7f2adfa80640 1 -- 172.21.15.87:0/2657197226 shutdown_connections 2024-09-13T17:13:55.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.157+0000 7f2adfa80640 1 -- 172.21.15.87:0/2657197226 wait complete. 2024-09-13T17:13:55.170 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:07:02.286400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:11:21.965141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:11:22.504345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:11:25.565163+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:13:55.170 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:13:55.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.271+0000 7fb14da96640 1 -- 172.21.15.87:0/4107141689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb148103fb0 msgr2=0x7fb14810bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:55.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.271+0000 7fb14da96640 1 --2- 172.21.15.87:0/4107141689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb148103fb0 0x7fb14810bb00 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb140009cd0 tx=0x7fb14002a8e0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.271+0000 7fb14da96640 1 -- 172.21.15.87:0/4107141689 shutdown_connections 2024-09-13T17:13:55.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.271+0000 7fb14da96640 1 --2- 172.21.15.87:0/4107141689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb148103fb0 0x7fb14810bb00 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.271+0000 7fb14da96640 1 --2- 172.21.15.87:0/4107141689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1480ff810 0x7fb148103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.271+0000 7fb14da96640 1 --2- 172.21.15.87:0/4107141689 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1480fee60 0x7fb1480ff240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.272+0000 7fb14da96640 1 -- 172.21.15.87:0/4107141689 >> 172.21.15.87:0/4107141689 conn(0x7fb148075c60 msgr2=0x7fb1480fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:55.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.272+0000 7fb14da96640 1 -- 172.21.15.87:0/4107141689 shutdown_connections 2024-09-13T17:13:55.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.272+0000 7fb14da96640 1 -- 172.21.15.87:0/4107141689 wait complete. 2024-09-13T17:13:55.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.272+0000 7fb14da96640 1 Processor -- start 2024-09-13T17:13:55.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.272+0000 7fb14da96640 1 -- start start 2024-09-13T17:13:55.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.272+0000 7fb14da96640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1480fee60 0x7fb148196ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:55.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.272+0000 7fb14da96640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb148103fb0 0x7fb148197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:55.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.272+0000 7fb14da96640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb148197a70 0x7fb1481a2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:55.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.272+0000 7fb14da96640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1481a2710 con 0x7fb148197a70 2024-09-13T17:13:55.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.272+0000 7fb14da96640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1481a2880 con 0x7fb1480fee60 2024-09-13T17:13:55.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.272+0000 7fb14da96640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1481a2a40 con 0x7fb148103fb0 2024-09-13T17:13:55.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.273+0000 7fb147fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb148197a70 0x7fb1481a2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:55.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.273+0000 7fb147fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb148197a70 0x7fb1481a2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41948/0 (socket says 172.21.15.87:41948) 2024-09-13T17:13:55.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.273+0000 7fb147fff640 1 -- 172.21.15.87:0/1945275330 learned_addr learned my addr 172.21.15.87:0/1945275330 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:55.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.273+0000 7fb13effd640 1 --2- 172.21.15.87:0/1945275330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb148103fb0 0x7fb148197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:55.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.273+0000 7fb147fff640 1 -- 172.21.15.87:0/1945275330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb148103fb0 msgr2=0x7fb148197530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:55.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.273+0000 7fb147fff640 1 --2- 172.21.15.87:0/1945275330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb148103fb0 0x7fb148197530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.273+0000 7fb147fff640 1 -- 172.21.15.87:0/1945275330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1480fee60 msgr2=0x7fb148196ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:55.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.273+0000 7fb1477fe640 1 --2- 172.21.15.87:0/1945275330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1480fee60 0x7fb148196ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:55.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.273+0000 7fb147fff640 1 --2- 172.21.15.87:0/1945275330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1480fee60 0x7fb148196ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.273+0000 7fb147fff640 1 -- 172.21.15.87:0/1945275330 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb140009900 con 0x7fb148197a70 2024-09-13T17:13:55.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.273+0000 7fb1477fe640 1 --2- 172.21.15.87:0/1945275330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1480fee60 0x7fb148196ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:55.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.273+0000 7fb147fff640 1 --2- 172.21.15.87:0/1945275330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb148197a70 0x7fb1481a2070 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb140005cc0 tx=0x7fb140030850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:55.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.273+0000 7fb1457fa640 1 -- 172.21.15.87:0/1945275330 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb140031c80 con 0x7fb148197a70 2024-09-13T17:13:55.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.273+0000 7fb1457fa640 1 -- 172.21.15.87:0/1945275330 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb140003e20 con 0x7fb148197a70 2024-09-13T17:13:55.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.273+0000 7fb14da96640 1 -- 172.21.15.87:0/1945275330 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1481a2cc0 con 0x7fb148197a70 2024-09-13T17:13:55.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.273+0000 7fb1457fa640 1 -- 172.21.15.87:0/1945275330 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb140045410 con 0x7fb148197a70 2024-09-13T17:13:55.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.273+0000 7fb14da96640 1 -- 172.21.15.87:0/1945275330 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1481a31d0 con 0x7fb148197a70 2024-09-13T17:13:55.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.274+0000 7fb14da96640 1 -- 172.21.15.87:0/1945275330 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb148100330 con 0x7fb148197a70 2024-09-13T17:13:55.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.275+0000 7fb1457fa640 1 -- 172.21.15.87:0/1945275330 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 24) v1 ==== 136049+0+0 (secure 0 0 0) 0x7fb14000a040 con 0x7fb148197a70 2024-09-13T17:13:55.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.276+0000 7fb1457fa640 1 --2- 172.21.15.87:0/1945275330 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb1340a1290 0x7fb1340a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:55.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.276+0000 7fb1477fe640 1 --2- 172.21.15.87:0/1945275330 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb1340a1290 0x7fb1340a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:55.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.276+0000 7fb1457fa640 1 -- 172.21.15.87:0/1945275330 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fb1400eea30 con 0x7fb148197a70 2024-09-13T17:13:55.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.276+0000 7fb1477fe640 1 --2- 172.21.15.87:0/1945275330 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb1340a1290 0x7fb1340a3750 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb13800baa0 tx=0x7fb138005d90 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:55.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.280+0000 7fb1457fa640 1 -- 172.21.15.87:0/1945275330 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb1400b79f0 con 0x7fb148197a70 2024-09-13T17:13:55.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.452+0000 7fb14da96640 1 -- 172.21.15.87:0/1945275330 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb148067b90 con 0x7fb148197a70 2024-09-13T17:13:55.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.453+0000 7fb1457fa640 1 -- 172.21.15.87:0/1945275330 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb1400bb010 con 0x7fb148197a70 2024-09-13T17:13:55.454 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-09-13T17:13:55.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.455+0000 7fb14da96640 1 -- 172.21.15.87:0/1945275330 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb1340a1290 msgr2=0x7fb1340a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:55.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.455+0000 7fb14da96640 1 --2- 172.21.15.87:0/1945275330 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb1340a1290 0x7fb1340a3750 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb13800baa0 tx=0x7fb138005d90 comp rx=0 tx=0).stop 2024-09-13T17:13:55.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.455+0000 7fb14da96640 1 -- 172.21.15.87:0/1945275330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb148197a70 msgr2=0x7fb1481a2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:55.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.455+0000 7fb14da96640 1 --2- 172.21.15.87:0/1945275330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb148197a70 0x7fb1481a2070 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb140005cc0 tx=0x7fb140030850 comp rx=0 tx=0).stop 2024-09-13T17:13:55.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.455+0000 7fb14da96640 1 -- 172.21.15.87:0/1945275330 shutdown_connections 2024-09-13T17:13:55.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.455+0000 7fb14da96640 1 --2- 172.21.15.87:0/1945275330 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb1340a1290 0x7fb1340a3750 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.455+0000 7fb14da96640 1 --2- 172.21.15.87:0/1945275330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb148197a70 0x7fb1481a2070 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.455+0000 7fb14da96640 1 --2- 172.21.15.87:0/1945275330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb148103fb0 0x7fb148197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.455+0000 7fb14da96640 1 --2- 172.21.15.87:0/1945275330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1480fee60 0x7fb148196ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.455+0000 7fb14da96640 1 -- 172.21.15.87:0/1945275330 >> 172.21.15.87:0/1945275330 conn(0x7fb148075c60 msgr2=0x7fb1480fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:55.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.455+0000 7fb14da96640 1 -- 172.21.15.87:0/1945275330 shutdown_connections 2024-09-13T17:13:55.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.455+0000 7fb14da96640 1 -- 172.21.15.87:0/1945275330 wait complete. 2024-09-13T17:13:55.467 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:13:55.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.568+0000 7fc652d4c640 1 -- 172.21.15.87:0/810847870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc64c0fee80 msgr2=0x7fc64c0ff260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:55.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.568+0000 7fc652d4c640 1 --2- 172.21.15.87:0/810847870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc64c0fee80 0x7fc64c0ff260 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc640009930 tx=0x7fc64002a420 comp rx=0 tx=0).stop 2024-09-13T17:13:55.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.568+0000 7fc652d4c640 1 -- 172.21.15.87:0/810847870 shutdown_connections 2024-09-13T17:13:55.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.568+0000 7fc652d4c640 1 --2- 172.21.15.87:0/810847870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc64c103fd0 0x7fc64c10bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.568+0000 7fc652d4c640 1 --2- 172.21.15.87:0/810847870 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc64c0ff830 0x7fc64c103870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.568+0000 7fc652d4c640 1 --2- 172.21.15.87:0/810847870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc64c0fee80 0x7fc64c0ff260 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.568+0000 7fc652d4c640 1 -- 172.21.15.87:0/810847870 >> 172.21.15.87:0/810847870 conn(0x7fc64c0fa930 msgr2=0x7fc64c0fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:55.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.568+0000 7fc652d4c640 1 -- 172.21.15.87:0/810847870 shutdown_connections 2024-09-13T17:13:55.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.568+0000 7fc652d4c640 1 -- 172.21.15.87:0/810847870 wait complete. 2024-09-13T17:13:55.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.568+0000 7fc652d4c640 1 Processor -- start 2024-09-13T17:13:55.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.568+0000 7fc652d4c640 1 -- start start 2024-09-13T17:13:55.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.569+0000 7fc652d4c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc64c0fee80 0x7fc64c10c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:55.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.569+0000 7fc652d4c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc64c103fd0 0x7fc64c10c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:55.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.569+0000 7fc652d4c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc64c10ceb0 0x7fc64c1a4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:55.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.569+0000 7fc652d4c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c1a49d0 con 0x7fc64c0fee80 2024-09-13T17:13:55.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.569+0000 7fc652d4c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c1a4b40 con 0x7fc64c10ceb0 2024-09-13T17:13:55.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.569+0000 7fc652d4c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c1a4d00 con 0x7fc64c103fd0 2024-09-13T17:13:55.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.569+0000 7fc650ae8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc64c0fee80 0x7fc64c10c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:55.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.569+0000 7fc650ae8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc64c0fee80 0x7fc64c10c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41956/0 (socket says 172.21.15.87:41956) 2024-09-13T17:13:55.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.569+0000 7fc650ae8640 1 -- 172.21.15.87:0/1183898666 learned_addr learned my addr 172.21.15.87:0/1183898666 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:55.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.569+0000 7fc64bfff640 1 --2- 172.21.15.87:0/1183898666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc64c103fd0 0x7fc64c10c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:55.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.569+0000 7fc6512e9640 1 --2- 172.21.15.87:0/1183898666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc64c10ceb0 0x7fc64c1a4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:55.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.569+0000 7fc650ae8640 1 -- 172.21.15.87:0/1183898666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc64c103fd0 msgr2=0x7fc64c10c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:55.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.569+0000 7fc650ae8640 1 --2- 172.21.15.87:0/1183898666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc64c103fd0 0x7fc64c10c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.569+0000 7fc650ae8640 1 -- 172.21.15.87:0/1183898666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc64c10ceb0 msgr2=0x7fc64c1a4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:55.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.569+0000 7fc650ae8640 1 --2- 172.21.15.87:0/1183898666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc64c10ceb0 0x7fc64c1a4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.569+0000 7fc650ae8640 1 -- 172.21.15.87:0/1183898666 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc640009560 con 0x7fc64c0fee80 2024-09-13T17:13:55.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.569+0000 7fc6512e9640 1 --2- 172.21.15.87:0/1183898666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc64c10ceb0 0x7fc64c1a4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:55.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.569+0000 7fc650ae8640 1 --2- 172.21.15.87:0/1183898666 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc64c0fee80 0x7fc64c10c430 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc640005760 tx=0x7fc640004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:55.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.569+0000 7fc649ffb640 1 -- 172.21.15.87:0/1183898666 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc640004520 con 0x7fc64c0fee80 2024-09-13T17:13:55.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.569+0000 7fc649ffb640 1 -- 172.21.15.87:0/1183898666 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc640031c40 con 0x7fc64c0fee80 2024-09-13T17:13:55.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.569+0000 7fc649ffb640 1 -- 172.21.15.87:0/1183898666 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc640032440 con 0x7fc64c0fee80 2024-09-13T17:13:55.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.569+0000 7fc652d4c640 1 -- 172.21.15.87:0/1183898666 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc64c1a4f80 con 0x7fc64c0fee80 2024-09-13T17:13:55.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.570+0000 7fc652d4c640 1 -- 172.21.15.87:0/1183898666 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc64c1a53a0 con 0x7fc64c0fee80 2024-09-13T17:13:55.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.571+0000 7fc652d4c640 1 -- 172.21.15.87:0/1183898666 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc64c100350 con 0x7fc64c0fee80 2024-09-13T17:13:55.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.572+0000 7fc649ffb640 1 -- 172.21.15.87:0/1183898666 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 24) v1 ==== 136049+0+0 (secure 0 0 0) 0x7fc640003ba0 con 0x7fc64c0fee80 2024-09-13T17:13:55.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.572+0000 7fc649ffb640 1 --2- 172.21.15.87:0/1183898666 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc63c0a1340 0x7fc63c0a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:55.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.572+0000 7fc649ffb640 1 -- 172.21.15.87:0/1183898666 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fc6400edc00 con 0x7fc64c0fee80 2024-09-13T17:13:55.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.572+0000 7fc64bfff640 1 --2- 172.21.15.87:0/1183898666 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc63c0a1340 0x7fc63c0a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:55.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.573+0000 7fc64bfff640 1 --2- 172.21.15.87:0/1183898666 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc63c0a1340 0x7fc63c0a3800 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc638005e10 tx=0x7fc638005da0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:55.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.576+0000 7fc649ffb640 1 -- 172.21.15.87:0/1183898666 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc6400b6b30 con 0x7fc64c0fee80 2024-09-13T17:13:55.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:55 smithi087 ceph-mon[30934]: from='client.15639 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:13:55.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:55 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2657197226' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:13:55.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.740+0000 7fc652d4c640 1 -- 172.21.15.87:0/1183898666 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc64c107220 con 0x7fc64c0fee80 2024-09-13T17:13:55.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.741+0000 7fc649ffb640 1 -- 172.21.15.87:0/1183898666 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc640049020 con 0x7fc64c0fee80 2024-09-13T17:13:55.743 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-09-13T17:13:55.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.743+0000 7fc652d4c640 1 -- 172.21.15.87:0/1183898666 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc63c0a1340 msgr2=0x7fc63c0a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:55.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.743+0000 7fc652d4c640 1 --2- 172.21.15.87:0/1183898666 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc63c0a1340 0x7fc63c0a3800 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc638005e10 tx=0x7fc638005da0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.743+0000 7fc652d4c640 1 -- 172.21.15.87:0/1183898666 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc64c0fee80 msgr2=0x7fc64c10c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:55.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.743+0000 7fc652d4c640 1 --2- 172.21.15.87:0/1183898666 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc64c0fee80 0x7fc64c10c430 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc640005760 tx=0x7fc640004270 comp rx=0 tx=0).stop 2024-09-13T17:13:55.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.743+0000 7fc652d4c640 1 -- 172.21.15.87:0/1183898666 shutdown_connections 2024-09-13T17:13:55.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.743+0000 7fc652d4c640 1 --2- 172.21.15.87:0/1183898666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc64c10ceb0 0x7fc64c1a4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.743+0000 7fc652d4c640 1 --2- 172.21.15.87:0/1183898666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc64c103fd0 0x7fc64c10c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.743+0000 7fc652d4c640 1 --2- 172.21.15.87:0/1183898666 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc63c0a1340 0x7fc63c0a3800 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.743+0000 7fc652d4c640 1 --2- 172.21.15.87:0/1183898666 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc64c0fee80 0x7fc64c10c430 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.743+0000 7fc652d4c640 1 -- 172.21.15.87:0/1183898666 >> 172.21.15.87:0/1183898666 conn(0x7fc64c0fa930 msgr2=0x7fc64c0fbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:55.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.743+0000 7fc652d4c640 1 -- 172.21.15.87:0/1183898666 shutdown_connections 2024-09-13T17:13:55.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.743+0000 7fc652d4c640 1 -- 172.21.15.87:0/1183898666 wait complete. 2024-09-13T17:13:55.755 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:13:55.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:55 smithi149 ceph-mon[35496]: from='client.15639 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:13:55.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:55 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2657197226' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:13:55.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.855+0000 7f22413a0640 1 -- 172.21.15.87:0/3424324584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f223c101740 msgr2=0x7f223c109c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:55.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.855+0000 7f22413a0640 1 --2- 172.21.15.87:0/3424324584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f223c101740 0x7f223c109c20 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f2224009900 tx=0x7f222402a410 comp rx=0 tx=0).stop 2024-09-13T17:13:55.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.856+0000 7f22413a0640 1 -- 172.21.15.87:0/3424324584 shutdown_connections 2024-09-13T17:13:55.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.856+0000 7f22413a0640 1 --2- 172.21.15.87:0/3424324584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f223c10a290 0x7f223c10c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.856+0000 7f22413a0640 1 --2- 172.21.15.87:0/3424324584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f223c101740 0x7f223c109c20 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.856+0000 7f22413a0640 1 --2- 172.21.15.87:0/3424324584 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f223c100d90 0x7f223c101170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.856+0000 7f22413a0640 1 -- 172.21.15.87:0/3424324584 >> 172.21.15.87:0/3424324584 conn(0x7f223c0fa870 msgr2=0x7f223c0fcc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:55.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.856+0000 7f22413a0640 1 -- 172.21.15.87:0/3424324584 shutdown_connections 2024-09-13T17:13:55.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.856+0000 7f22413a0640 1 -- 172.21.15.87:0/3424324584 wait complete. 2024-09-13T17:13:55.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.856+0000 7f22413a0640 1 Processor -- start 2024-09-13T17:13:55.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.856+0000 7f22413a0640 1 -- start start 2024-09-13T17:13:55.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.856+0000 7f22413a0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f223c100d90 0x7f223c1961b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:55.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.856+0000 7f22413a0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f223c101740 0x7f223c1966f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:55.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.856+0000 7f22413a0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f223c10a290 0x7f223c19aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:55.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.856+0000 7f22413a0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c19b0e0 con 0x7f223c101740 2024-09-13T17:13:55.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.856+0000 7f22413a0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c19b250 con 0x7f223c100d90 2024-09-13T17:13:55.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.856+0000 7f22413a0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c19b410 con 0x7f223c10a290 2024-09-13T17:13:55.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.856+0000 7f2233fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f223c101740 0x7f223c1966f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:55.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.857+0000 7f2233fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f223c101740 0x7f223c1966f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41966/0 (socket says 172.21.15.87:41966) 2024-09-13T17:13:55.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.857+0000 7f2233fff640 1 -- 172.21.15.87:0/557515296 learned_addr learned my addr 172.21.15.87:0/557515296 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:55.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.857+0000 7f223bfff640 1 --2- 172.21.15.87:0/557515296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f223c100d90 0x7f223c1961b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:55.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.857+0000 7f2240b9f640 1 --2- 172.21.15.87:0/557515296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f223c10a290 0x7f223c19aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:55.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.857+0000 7f2233fff640 1 -- 172.21.15.87:0/557515296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f223c10a290 msgr2=0x7f223c19aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:55.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.857+0000 7f2233fff640 1 --2- 172.21.15.87:0/557515296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f223c10a290 0x7f223c19aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.857+0000 7f2233fff640 1 -- 172.21.15.87:0/557515296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f223c100d90 msgr2=0x7f223c1961b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:55.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.857+0000 7f2233fff640 1 --2- 172.21.15.87:0/557515296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f223c100d90 0x7f223c1961b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:55.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.857+0000 7f2233fff640 1 -- 172.21.15.87:0/557515296 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2224009560 con 0x7f223c101740 2024-09-13T17:13:55.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.857+0000 7f223bfff640 1 --2- 172.21.15.87:0/557515296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f223c100d90 0x7f223c1961b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:55.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.857+0000 7f2240b9f640 1 --2- 172.21.15.87:0/557515296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f223c10a290 0x7f223c19aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:55.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.857+0000 7f2233fff640 1 --2- 172.21.15.87:0/557515296 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f223c101740 0x7f223c1966f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2224005ab0 tx=0x7f2224004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:55.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.857+0000 7f2239ffb640 1 -- 172.21.15.87:0/557515296 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2224031c40 con 0x7f223c101740 2024-09-13T17:13:55.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.857+0000 7f2239ffb640 1 -- 172.21.15.87:0/557515296 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2224031da0 con 0x7f223c101740 2024-09-13T17:13:55.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.857+0000 7f2239ffb640 1 -- 172.21.15.87:0/557515296 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2224032390 con 0x7f223c101740 2024-09-13T17:13:55.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.857+0000 7f22413a0640 1 -- 172.21.15.87:0/557515296 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f223c19b690 con 0x7f223c101740 2024-09-13T17:13:55.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.857+0000 7f22413a0640 1 -- 172.21.15.87:0/557515296 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f223c19b960 con 0x7f223c101740 2024-09-13T17:13:55.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:55 smithi118 ceph-mon[34374]: from='client.15639 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:13:55.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:55 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2657197226' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:13:55.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.858+0000 7f22413a0640 1 -- 172.21.15.87:0/557515296 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f223c068d80 con 0x7f223c101740 2024-09-13T17:13:55.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.859+0000 7f2239ffb640 1 -- 172.21.15.87:0/557515296 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 24) v1 ==== 136049+0+0 (secure 0 0 0) 0x7f2224003b30 con 0x7f223c101740 2024-09-13T17:13:55.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.860+0000 7f2239ffb640 1 --2- 172.21.15.87:0/557515296 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f22280a1310 0x7f22280a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:55.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.860+0000 7f223bfff640 1 --2- 172.21.15.87:0/557515296 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f22280a1310 0x7f22280a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:55.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.860+0000 7f2239ffb640 1 -- 172.21.15.87:0/557515296 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f22240edd20 con 0x7f223c101740 2024-09-13T17:13:55.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.861+0000 7f223bfff640 1 --2- 172.21.15.87:0/557515296 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f22280a1310 0x7f22280a37d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f222c0058c0 tx=0x7f222c005d30 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:55.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:55.864+0000 7f2239ffb640 1 -- 172.21.15.87:0/557515296 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f22240b6c50 con 0x7f223c101740 2024-09-13T17:13:56.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.025+0000 7f22413a0640 1 -- 172.21.15.87:0/557515296 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f223c1052c0 con 0x7f223c101740 2024-09-13T17:13:56.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.026+0000 7f2239ffb640 1 -- 172.21.15.87:0/557515296 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7f22240490a0 con 0x7f223c101740 2024-09-13T17:13:56.028 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-09-13T17:13:56.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.028+0000 7f22413a0640 1 -- 172.21.15.87:0/557515296 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f22280a1310 msgr2=0x7f22280a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:56.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.028+0000 7f22413a0640 1 --2- 172.21.15.87:0/557515296 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f22280a1310 0x7f22280a37d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f222c0058c0 tx=0x7f222c005d30 comp rx=0 tx=0).stop 2024-09-13T17:13:56.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.028+0000 7f22413a0640 1 -- 172.21.15.87:0/557515296 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f223c101740 msgr2=0x7f223c1966f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:56.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.028+0000 7f22413a0640 1 --2- 172.21.15.87:0/557515296 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f223c101740 0x7f223c1966f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2224005ab0 tx=0x7f2224004360 comp rx=0 tx=0).stop 2024-09-13T17:13:56.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.028+0000 7f22413a0640 1 -- 172.21.15.87:0/557515296 shutdown_connections 2024-09-13T17:13:56.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.028+0000 7f22413a0640 1 --2- 172.21.15.87:0/557515296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f223c10a290 0x7f223c19aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.028+0000 7f22413a0640 1 --2- 172.21.15.87:0/557515296 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f22280a1310 0x7f22280a37d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.028+0000 7f22413a0640 1 --2- 172.21.15.87:0/557515296 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f223c101740 0x7f223c1966f0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.028+0000 7f22413a0640 1 --2- 172.21.15.87:0/557515296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f223c100d90 0x7f223c1961b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.028+0000 7f22413a0640 1 -- 172.21.15.87:0/557515296 >> 172.21.15.87:0/557515296 conn(0x7f223c0fa870 msgr2=0x7f223c0fc170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:56.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.028+0000 7f22413a0640 1 -- 172.21.15.87:0/557515296 shutdown_connections 2024-09-13T17:13:56.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.028+0000 7f22413a0640 1 -- 172.21.15.87:0/557515296 wait complete. 2024-09-13T17:13:56.040 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:13:56.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.140+0000 7f578b473640 1 -- 172.21.15.87:0/887793807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57840fee60 msgr2=0x7f57840ff240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:56.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.140+0000 7f578b473640 1 --2- 172.21.15.87:0/887793807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57840fee60 0x7f57840ff240 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5780009930 tx=0x7f578002a420 comp rx=0 tx=0).stop 2024-09-13T17:13:56.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.140+0000 7f578b473640 1 -- 172.21.15.87:0/887793807 shutdown_connections 2024-09-13T17:13:56.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.140+0000 7f578b473640 1 --2- 172.21.15.87:0/887793807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5784103fb0 0x7f578410bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.140+0000 7f578b473640 1 --2- 172.21.15.87:0/887793807 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57840ff810 0x7f5784103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.140+0000 7f578b473640 1 --2- 172.21.15.87:0/887793807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57840fee60 0x7f57840ff240 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.140+0000 7f578b473640 1 -- 172.21.15.87:0/887793807 >> 172.21.15.87:0/887793807 conn(0x7f5784075c60 msgr2=0x7f57840fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:56.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.140+0000 7f578b473640 1 -- 172.21.15.87:0/887793807 shutdown_connections 2024-09-13T17:13:56.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.140+0000 7f578b473640 1 -- 172.21.15.87:0/887793807 wait complete. 2024-09-13T17:13:56.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.140+0000 7f578b473640 1 Processor -- start 2024-09-13T17:13:56.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.140+0000 7f578b473640 1 -- start start 2024-09-13T17:13:56.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.140+0000 7f578b473640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57840fee60 0x7f5784196200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:56.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.140+0000 7f578b473640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5784103fb0 0x7f5784196740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:56.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.141+0000 7f578b473640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f578419ab30 0x7f578419afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:56.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.141+0000 7f578b473640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578419b520 con 0x7f57840fee60 2024-09-13T17:13:56.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.141+0000 7f578b473640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578419b690 con 0x7f5784103fb0 2024-09-13T17:13:56.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.141+0000 7f578b473640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578419b800 con 0x7f578419ab30 2024-09-13T17:13:56.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.141+0000 7f578920f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57840fee60 0x7f5784196200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:56.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.141+0000 7f578920f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57840fee60 0x7f5784196200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41986/0 (socket says 172.21.15.87:41986) 2024-09-13T17:13:56.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.141+0000 7f578920f640 1 -- 172.21.15.87:0/2725868871 learned_addr learned my addr 172.21.15.87:0/2725868871 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:56.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.141+0000 7f5789a10640 1 --2- 172.21.15.87:0/2725868871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f578419ab30 0x7f578419afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:56.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.141+0000 7f5788a0e640 1 --2- 172.21.15.87:0/2725868871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5784103fb0 0x7f5784196740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:56.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.141+0000 7f578920f640 1 -- 172.21.15.87:0/2725868871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f578419ab30 msgr2=0x7f578419afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:56.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.141+0000 7f578920f640 1 --2- 172.21.15.87:0/2725868871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f578419ab30 0x7f578419afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.141+0000 7f578920f640 1 -- 172.21.15.87:0/2725868871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5784103fb0 msgr2=0x7f5784196740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:56.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.141+0000 7f578920f640 1 --2- 172.21.15.87:0/2725868871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5784103fb0 0x7f5784196740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.141+0000 7f578920f640 1 -- 172.21.15.87:0/2725868871 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5780009560 con 0x7f57840fee60 2024-09-13T17:13:56.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.141+0000 7f5788a0e640 1 --2- 172.21.15.87:0/2725868871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5784103fb0 0x7f5784196740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:56.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.141+0000 7f5789a10640 1 --2- 172.21.15.87:0/2725868871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f578419ab30 0x7f578419afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:56.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.141+0000 7f578920f640 1 --2- 172.21.15.87:0/2725868871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57840fee60 0x7f5784196200 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f5780009900 tx=0x7f57800042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:56.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.141+0000 7f577a7fc640 1 -- 172.21.15.87:0/2725868871 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5780003a00 con 0x7f57840fee60 2024-09-13T17:13:56.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.141+0000 7f577a7fc640 1 -- 172.21.15.87:0/2725868871 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f57800044e0 con 0x7f57840fee60 2024-09-13T17:13:56.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.141+0000 7f578b473640 1 -- 172.21.15.87:0/2725868871 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57841a2de0 con 0x7f57840fee60 2024-09-13T17:13:56.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.141+0000 7f577a7fc640 1 -- 172.21.15.87:0/2725868871 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578003a3c0 con 0x7f57840fee60 2024-09-13T17:13:56.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.141+0000 7f578b473640 1 -- 172.21.15.87:0/2725868871 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57841a31b0 con 0x7f57840fee60 2024-09-13T17:13:56.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.142+0000 7f578b473640 1 -- 172.21.15.87:0/2725868871 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5784100330 con 0x7f57840fee60 2024-09-13T17:13:56.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.143+0000 7f577a7fc640 1 -- 172.21.15.87:0/2725868871 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 24) v1 ==== 136049+0+0 (secure 0 0 0) 0x7f578003b460 con 0x7f57840fee60 2024-09-13T17:13:56.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.144+0000 7f577a7fc640 1 --2- 172.21.15.87:0/2725868871 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f57700a1290 0x7f57700a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:56.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.144+0000 7f5788a0e640 1 --2- 172.21.15.87:0/2725868871 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f57700a1290 0x7f57700a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:56.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.144+0000 7f577a7fc640 1 -- 172.21.15.87:0/2725868871 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f57800ee2f0 con 0x7f57840fee60 2024-09-13T17:13:56.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.144+0000 7f5788a0e640 1 --2- 172.21.15.87:0/2725868871 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f57700a1290 0x7f57700a3750 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f57740058c0 tx=0x7f5774005850 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:56.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.148+0000 7f577a7fc640 1 -- 172.21.15.87:0/2725868871 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f57800b7220 con 0x7f57840fee60 2024-09-13T17:13:56.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.312+0000 7f578b473640 1 -- 172.21.15.87:0/2725868871 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f57840ff860 con 0x7f57840fee60 2024-09-13T17:13:56.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.312+0000 7f577a7fc640 1 -- 172.21.15.87:0/2725868871 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) v1 ==== 103+0+11 (secure 0 0 0) 0x7f578004b0a0 con 0x7f57840fee60 2024-09-13T17:13:56.314 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-09-13T17:13:56.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.314+0000 7f578b473640 1 -- 172.21.15.87:0/2725868871 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f57700a1290 msgr2=0x7f57700a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:56.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.314+0000 7f578b473640 1 --2- 172.21.15.87:0/2725868871 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f57700a1290 0x7f57700a3750 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f57740058c0 tx=0x7f5774005850 comp rx=0 tx=0).stop 2024-09-13T17:13:56.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.314+0000 7f578b473640 1 -- 172.21.15.87:0/2725868871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57840fee60 msgr2=0x7f5784196200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:56.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.314+0000 7f578b473640 1 --2- 172.21.15.87:0/2725868871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57840fee60 0x7f5784196200 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f5780009900 tx=0x7f57800042f0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.314+0000 7f578b473640 1 -- 172.21.15.87:0/2725868871 shutdown_connections 2024-09-13T17:13:56.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.314+0000 7f578b473640 1 --2- 172.21.15.87:0/2725868871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f578419ab30 0x7f578419afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.314+0000 7f578b473640 1 --2- 172.21.15.87:0/2725868871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5784103fb0 0x7f5784196740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.314+0000 7f578b473640 1 --2- 172.21.15.87:0/2725868871 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f57700a1290 0x7f57700a3750 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.314+0000 7f578b473640 1 --2- 172.21.15.87:0/2725868871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57840fee60 0x7f5784196200 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.314+0000 7f578b473640 1 -- 172.21.15.87:0/2725868871 >> 172.21.15.87:0/2725868871 conn(0x7f5784075c60 msgr2=0x7f57840679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:56.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.314+0000 7f578b473640 1 -- 172.21.15.87:0/2725868871 shutdown_connections 2024-09-13T17:13:56.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.314+0000 7f578b473640 1 -- 172.21.15.87:0/2725868871 wait complete. 2024-09-13T17:13:56.327 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:13:56.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.424+0000 7f068b1e2640 1 -- 172.21.15.87:0/504123047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06840ff830 msgr2=0x7f0684103870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:56.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.424+0000 7f068b1e2640 1 --2- 172.21.15.87:0/504123047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06840ff830 0x7f0684103870 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0670009930 tx=0x7f067002a420 comp rx=0 tx=0).stop 2024-09-13T17:13:56.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.424+0000 7f068b1e2640 1 -- 172.21.15.87:0/504123047 shutdown_connections 2024-09-13T17:13:56.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.424+0000 7f068b1e2640 1 --2- 172.21.15.87:0/504123047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0684103fd0 0x7f068410bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.424+0000 7f068b1e2640 1 --2- 172.21.15.87:0/504123047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06840ff830 0x7f0684103870 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.424+0000 7f068b1e2640 1 --2- 172.21.15.87:0/504123047 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06840fee80 0x7f06840ff260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.424+0000 7f068b1e2640 1 -- 172.21.15.87:0/504123047 >> 172.21.15.87:0/504123047 conn(0x7f0684075c60 msgr2=0x7f06840fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:56.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.424+0000 7f068b1e2640 1 -- 172.21.15.87:0/504123047 shutdown_connections 2024-09-13T17:13:56.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.424+0000 7f068b1e2640 1 -- 172.21.15.87:0/504123047 wait complete. 2024-09-13T17:13:56.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.424+0000 7f068b1e2640 1 Processor -- start 2024-09-13T17:13:56.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.424+0000 7f068b1e2640 1 -- start start 2024-09-13T17:13:56.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.425+0000 7f068b1e2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06840fee80 0x7f06840fb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:56.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.425+0000 7f068b1e2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0684103fd0 0x7f06840fb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:56.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.425+0000 7f068b1e2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06840fbb20 0x7f06841a44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:56.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.425+0000 7f068b1e2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06841a4a60 con 0x7f0684103fd0 2024-09-13T17:13:56.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.425+0000 7f068b1e2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06841a4bd0 con 0x7f06840fbb20 2024-09-13T17:13:56.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.425+0000 7f068b1e2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06841a4d90 con 0x7f06840fee80 2024-09-13T17:13:56.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.425+0000 7f0683fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0684103fd0 0x7f06840fb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:56.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.425+0000 7f0683fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0684103fd0 0x7f06840fb5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42000/0 (socket says 172.21.15.87:42000) 2024-09-13T17:13:56.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.425+0000 7f0683fff640 1 -- 172.21.15.87:0/1141404074 learned_addr learned my addr 172.21.15.87:0/1141404074 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:56.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.425+0000 7f0688f7e640 1 --2- 172.21.15.87:0/1141404074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06840fee80 0x7f06840fb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:56.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.425+0000 7f068977f640 1 --2- 172.21.15.87:0/1141404074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06840fbb20 0x7f06841a44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:56.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.425+0000 7f0683fff640 1 -- 172.21.15.87:0/1141404074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06840fee80 msgr2=0x7f06840fb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:56.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.425+0000 7f0683fff640 1 --2- 172.21.15.87:0/1141404074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06840fee80 0x7f06840fb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.425+0000 7f0683fff640 1 -- 172.21.15.87:0/1141404074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06840fbb20 msgr2=0x7f06841a44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:56.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.425+0000 7f0683fff640 1 --2- 172.21.15.87:0/1141404074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06840fbb20 0x7f06841a44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.425+0000 7f0683fff640 1 -- 172.21.15.87:0/1141404074 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0670009560 con 0x7f0684103fd0 2024-09-13T17:13:56.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.425+0000 7f0683fff640 1 --2- 172.21.15.87:0/1141404074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0684103fd0 0x7f06840fb5e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0670009900 tx=0x7f06700042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:56.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.427+0000 7f0681ffb640 1 -- 172.21.15.87:0/1141404074 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0670003a00 con 0x7f0684103fd0 2024-09-13T17:13:56.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.427+0000 7f068b1e2640 1 -- 172.21.15.87:0/1141404074 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06841a5010 con 0x7f0684103fd0 2024-09-13T17:13:56.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.427+0000 7f0681ffb640 1 -- 172.21.15.87:0/1141404074 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f06700044e0 con 0x7f0684103fd0 2024-09-13T17:13:56.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.427+0000 7f0681ffb640 1 -- 172.21.15.87:0/1141404074 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067003a3c0 con 0x7f0684103fd0 2024-09-13T17:13:56.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.427+0000 7f068b1e2640 1 -- 172.21.15.87:0/1141404074 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06841a5510 con 0x7f0684103fd0 2024-09-13T17:13:56.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.429+0000 7f068b1e2640 1 -- 172.21.15.87:0/1141404074 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0684100350 con 0x7f0684103fd0 2024-09-13T17:13:56.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.430+0000 7f0681ffb640 1 -- 172.21.15.87:0/1141404074 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 24) v1 ==== 136049+0+0 (secure 0 0 0) 0x7f067003b460 con 0x7f0684103fd0 2024-09-13T17:13:56.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.430+0000 7f0681ffb640 1 --2- 172.21.15.87:0/1141404074 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f06740a1290 0x7f06740a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:56.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.430+0000 7f0681ffb640 1 -- 172.21.15.87:0/1141404074 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f06700ee1a0 con 0x7f0684103fd0 2024-09-13T17:13:56.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.430+0000 7f0688f7e640 1 --2- 172.21.15.87:0/1141404074 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f06740a1290 0x7f06740a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:56.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.431+0000 7f0688f7e640 1 --2- 172.21.15.87:0/1141404074 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f06740a1290 0x7f06740a3750 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f067800bbe0 tx=0x7f067800b390 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:56.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.434+0000 7f0681ffb640 1 -- 172.21.15.87:0/1141404074 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f06700b72a0 con 0x7f0684103fd0 2024-09-13T17:13:56.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.630+0000 7f068b1e2640 1 -- 172.21.15.87:0/1141404074 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06840ff830 con 0x7f0684103fd0 2024-09-13T17:13:56.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.631+0000 7f0681ffb640 1 -- 172.21.15.87:0/1141404074 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10877 (secure 0 0 0) 0x7f067003b710 con 0x7f0684103fd0 2024-09-13T17:13:56.633 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:13:56.633 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/3674545180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":3674545180},{"type":"v1","addr":"172.21.15.87:6841","nonce":3674545180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:11:23.313609+0000","modified":"2024-09-13T17:13:50.380502+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24484,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6839/3052680456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3052680456},{"type":"v1","addr":"172.21.15.118:6839","nonce":3052680456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:13:56.633 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 24 2024-09-13T17:13:56.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.633+0000 7f068b1e2640 1 -- 172.21.15.87:0/1141404074 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f06740a1290 msgr2=0x7f06740a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:56.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.633+0000 7f068b1e2640 1 --2- 172.21.15.87:0/1141404074 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f06740a1290 0x7f06740a3750 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f067800bbe0 tx=0x7f067800b390 comp rx=0 tx=0).stop 2024-09-13T17:13:56.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.633+0000 7f068b1e2640 1 -- 172.21.15.87:0/1141404074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0684103fd0 msgr2=0x7f06840fb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:56.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.633+0000 7f068b1e2640 1 --2- 172.21.15.87:0/1141404074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0684103fd0 0x7f06840fb5e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0670009900 tx=0x7f06700042f0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.633+0000 7f068b1e2640 1 -- 172.21.15.87:0/1141404074 shutdown_connections 2024-09-13T17:13:56.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.633+0000 7f068b1e2640 1 --2- 172.21.15.87:0/1141404074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06840fbb20 0x7f06841a44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.633+0000 7f068b1e2640 1 --2- 172.21.15.87:0/1141404074 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f06740a1290 0x7f06740a3750 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.633+0000 7f068b1e2640 1 --2- 172.21.15.87:0/1141404074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0684103fd0 0x7f06840fb5e0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.633+0000 7f068b1e2640 1 --2- 172.21.15.87:0/1141404074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06840fee80 0x7f06840fb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.633+0000 7f068b1e2640 1 -- 172.21.15.87:0/1141404074 >> 172.21.15.87:0/1141404074 conn(0x7f0684075c60 msgr2=0x7f0684067730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:56.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.633+0000 7f068b1e2640 1 -- 172.21.15.87:0/1141404074 shutdown_connections 2024-09-13T17:13:56.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.633+0000 7f068b1e2640 1 -- 172.21.15.87:0/1141404074 wait complete. 2024-09-13T17:13:56.644 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:56 smithi087 ceph-mon[30934]: from='client.15645 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:13:56.644 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:56 smithi087 ceph-mon[30934]: from='client.15651 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:13:56.644 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:56 smithi087 ceph-mon[30934]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 0 B/s wr, 25 op/s 2024-09-13T17:13:56.645 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:56 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1945275330' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:13:56.645 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:56 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1183898666' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:13:56.645 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:56 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/557515296' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:13:56.645 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:56 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2725868871' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:13:56.646 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:13:56.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.742+0000 7efc6422b640 1 -- 172.21.15.87:0/1652368722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc5c103fe0 msgr2=0x7efc5c10bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:56.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.742+0000 7efc6422b640 1 --2- 172.21.15.87:0/1652368722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc5c103fe0 0x7efc5c10bb30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7efc54009cd0 tx=0x7efc5402a8e0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.742+0000 7efc6422b640 1 -- 172.21.15.87:0/1652368722 shutdown_connections 2024-09-13T17:13:56.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.742+0000 7efc6422b640 1 --2- 172.21.15.87:0/1652368722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc5c103fe0 0x7efc5c10bb30 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.742+0000 7efc6422b640 1 --2- 172.21.15.87:0/1652368722 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc5c0ff840 0x7efc5c103880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.742+0000 7efc6422b640 1 --2- 172.21.15.87:0/1652368722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc5c0fee90 0x7efc5c0ff270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.742+0000 7efc6422b640 1 -- 172.21.15.87:0/1652368722 >> 172.21.15.87:0/1652368722 conn(0x7efc5c0fa900 msgr2=0x7efc5c0fcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:56.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.742+0000 7efc6422b640 1 -- 172.21.15.87:0/1652368722 shutdown_connections 2024-09-13T17:13:56.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.742+0000 7efc6422b640 1 -- 172.21.15.87:0/1652368722 wait complete. 2024-09-13T17:13:56.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.743+0000 7efc6422b640 1 Processor -- start 2024-09-13T17:13:56.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.743+0000 7efc6422b640 1 -- start start 2024-09-13T17:13:56.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.743+0000 7efc6422b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc5c0fee90 0x7efc5c197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:56.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.743+0000 7efc6422b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc5c103fe0 0x7efc5c197640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:56.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.743+0000 7efc6422b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc5c197bd0 0x7efc5c1a2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:56.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.743+0000 7efc6422b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c1a2850 con 0x7efc5c0fee90 2024-09-13T17:13:56.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.743+0000 7efc6422b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c1a29c0 con 0x7efc5c103fe0 2024-09-13T17:13:56.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.743+0000 7efc6422b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c1a2b80 con 0x7efc5c197bd0 2024-09-13T17:13:56.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.743+0000 7efc61fc7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc5c0fee90 0x7efc5c197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:56.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.743+0000 7efc61fc7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc5c0fee90 0x7efc5c197100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42014/0 (socket says 172.21.15.87:42014) 2024-09-13T17:13:56.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.743+0000 7efc61fc7640 1 -- 172.21.15.87:0/606810231 learned_addr learned my addr 172.21.15.87:0/606810231 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:56.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.743+0000 7efc627c8640 1 --2- 172.21.15.87:0/606810231 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc5c197bd0 0x7efc5c1a2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:56.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.743+0000 7efc61fc7640 1 -- 172.21.15.87:0/606810231 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc5c197bd0 msgr2=0x7efc5c1a2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:56.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.743+0000 7efc61fc7640 1 --2- 172.21.15.87:0/606810231 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc5c197bd0 0x7efc5c1a2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.743+0000 7efc61fc7640 1 -- 172.21.15.87:0/606810231 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc5c103fe0 msgr2=0x7efc5c197640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:56.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.743+0000 7efc617c6640 1 --2- 172.21.15.87:0/606810231 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc5c103fe0 0x7efc5c197640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:56.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.743+0000 7efc61fc7640 1 --2- 172.21.15.87:0/606810231 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc5c103fe0 0x7efc5c197640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.743+0000 7efc61fc7640 1 -- 172.21.15.87:0/606810231 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc54009900 con 0x7efc5c0fee90 2024-09-13T17:13:56.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.743+0000 7efc627c8640 1 --2- 172.21.15.87:0/606810231 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc5c197bd0 0x7efc5c1a2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:56.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.743+0000 7efc61fc7640 1 --2- 172.21.15.87:0/606810231 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc5c0fee90 0x7efc5c197100 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7efc4c00d950 tx=0x7efc4c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:56.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.744+0000 7efc52ffd640 1 -- 172.21.15.87:0/606810231 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c009a30 con 0x7efc5c0fee90 2024-09-13T17:13:56.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.744+0000 7efc52ffd640 1 -- 172.21.15.87:0/606810231 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efc4c0044d0 con 0x7efc5c0fee90 2024-09-13T17:13:56.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.744+0000 7efc6422b640 1 -- 172.21.15.87:0/606810231 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc5c1a2e60 con 0x7efc5c0fee90 2024-09-13T17:13:56.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.744+0000 7efc52ffd640 1 -- 172.21.15.87:0/606810231 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c0047a0 con 0x7efc5c0fee90 2024-09-13T17:13:56.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.744+0000 7efc6422b640 1 -- 172.21.15.87:0/606810231 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc5c1a32e0 con 0x7efc5c0fee90 2024-09-13T17:13:56.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.745+0000 7efc6422b640 1 -- 172.21.15.87:0/606810231 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc5c100360 con 0x7efc5c0fee90 2024-09-13T17:13:56.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.746+0000 7efc52ffd640 1 -- 172.21.15.87:0/606810231 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 24) v1 ==== 136049+0+0 (secure 0 0 0) 0x7efc4c009b90 con 0x7efc5c0fee90 2024-09-13T17:13:56.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.746+0000 7efc52ffd640 1 --2- 172.21.15.87:0/606810231 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7efc480a1290 0x7efc480a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:56.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.747+0000 7efc617c6640 1 --2- 172.21.15.87:0/606810231 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7efc480a1290 0x7efc480a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:56.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.747+0000 7efc52ffd640 1 -- 172.21.15.87:0/606810231 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7efc4c0cd390 con 0x7efc5c0fee90 2024-09-13T17:13:56.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.747+0000 7efc617c6640 1 --2- 172.21.15.87:0/606810231 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7efc480a1290 0x7efc480a3750 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efc5c069160 tx=0x7efc58005ed0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:56.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.749+0000 7efc52ffd640 1 -- 172.21.15.87:0/606810231 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7efc4c0962c0 con 0x7efc5c0fee90 2024-09-13T17:13:56.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:56 smithi149 ceph-mon[35496]: from='client.15645 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:13:56.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:56 smithi149 ceph-mon[35496]: from='client.15651 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:13:56.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:56 smithi149 ceph-mon[35496]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 0 B/s wr, 25 op/s 2024-09-13T17:13:56.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:56 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1945275330' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:13:56.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:56 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1183898666' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:13:56.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:56 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/557515296' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:13:56.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:56 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2725868871' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:13:56.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:56 smithi118 ceph-mon[34374]: from='client.15645 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:13:56.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:56 smithi118 ceph-mon[34374]: from='client.15651 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:13:56.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:56 smithi118 ceph-mon[34374]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 0 B/s wr, 25 op/s 2024-09-13T17:13:56.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:56 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1945275330' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:13:56.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:56 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1183898666' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:13:56.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:56 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/557515296' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:13:56.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:56 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2725868871' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:13:56.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.912+0000 7efc6422b640 1 -- 172.21.15.87:0/606810231 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc5c0ff270 con 0x7efc5c0fee90 2024-09-13T17:13:56.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.913+0000 7efc52ffd640 1 -- 172.21.15.87:0/606810231 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+25192 (secure 0 0 0) 0x7efc4c017020 con 0x7efc5c0fee90 2024-09-13T17:13:56.915 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:13:56.916 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":94,"fsid":"043d5bae-71f2-11ef-bceb-c7b262605968","created":"2024-09-13T17:03:57.852010+0000","modified":"2024-09-13T17:13:49.377136+0000","last_up_change":"2024-09-13T17:10:34.423548+0000","last_in_change":"2024-09-13T17:10:14.228123+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:07:02.286400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:11:21.965141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:11:22.504345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:11:25.565163+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58250283-85c0-416e-abdd-1fc5a7ff0c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6803","nonce":1316956138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6805","nonce":1316956138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6809","nonce":1316956138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6807","nonce":1316956138}]},"public_addr":"172.21.15.87:6803/1316956138","cluster_addr":"172.21.15.87:6805/1316956138","heartbeat_back_addr":"172.21.15.87:6809/1316956138","heartbeat_front_addr":"172.21.15.87:6807/1316956138","state":["exists","up"]},{"osd":1,"uuid":"b9d49969-94b1-4262-b4ff-db0a8e3331af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6801","nonce":3352566727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6803","nonce":3352566727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6807","nonce":3352566727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6805","nonce":3352566727}]},"public_addr":"172.21.15.118:6801/3352566727","cluster_addr":"172.21.15.118:6803/3352566727","heartbeat_back_addr":"172.21.15.118:6807/3352566727","heartbeat_front_addr":"172.21.15.118:6805/3352566727","state":["exists","up"]},{"osd":2,"uuid":"ba64549e-d736-426f-b466-f569af5f16d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6801","nonce":2774581686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6803","nonce":2774581686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6807","nonce":2774581686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6805","nonce":2774581686}]},"public_addr":"172.21.15.149:6801/2774581686","cluster_addr":"172.21.15.149:6803/2774581686","heartbeat_back_addr":"172.21.15.149:6807/2774581686","heartbeat_front_addr":"172.21.15.149:6805/2774581686","state":["exists","up"]},{"osd":3,"uuid":"3d5553e5-371b-49fd-976b-9e72a97a2f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6811","nonce":3306119066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6813","nonce":3306119066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6817","nonce":3306119066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6815","nonce":3306119066}]},"public_addr":"172.21.15.87:6811/3306119066","cluster_addr":"172.21.15.87:6813/3306119066","heartbeat_back_addr":"172.21.15.87:6817/3306119066","heartbeat_front_addr":"172.21.15.87:6815/3306119066","state":["exists","up"]},{"osd":4,"uuid":"2fbe0e27-34ec-42a6-9962-f1d8202b3159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6809","nonce":3342349890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6811","nonce":3342349890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6815","nonce":3342349890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6813","nonce":3342349890}]},"public_addr":"172.21.15.118:6809/3342349890","cluster_addr":"172.21.15.118:6811/3342349890","heartbeat_back_addr":"172.21.15.118:6815/3342349890","heartbeat_front_addr":"172.21.15.118:6813/3342349890","state":["exists","up"]},{"osd":5,"uuid":"53c14519-6170-4b5a-a79d-4835882d7bec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6809","nonce":3468867124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6811","nonce":3468867124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6815","nonce":3468867124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6813","nonce":3468867124}]},"public_addr":"172.21.15.149:6809/3468867124","cluster_addr":"172.21.15.149:6811/3468867124","heartbeat_back_addr":"172.21.15.149:6815/3468867124","heartbeat_front_addr":"172.21.15.149:6813/3468867124","state":["exists","up"]},{"osd":6,"uuid":"d3951b32-db77-4b8b-9de0-f05e03d13f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6819","nonce":326563617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6821","nonce":326563617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6825","nonce":326563617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6823","nonce":326563617}]},"public_addr":"172.21.15.87:6819/326563617","cluster_addr":"172.21.15.87:6821/326563617","heartbeat_back_addr":"172.21.15.87:6825/326563617","heartbeat_front_addr":"172.21.15.87:6823/326563617","state":["exists","up"]},{"osd":7,"uuid":"4d46dab7-a8bf-4e3e-b5c0-43860d336bdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6817","nonce":1690268990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6819","nonce":1690268990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6823","nonce":1690268990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6821","nonce":1690268990}]},"public_addr":"172.21.15.118:6817/1690268990","cluster_addr":"172.21.15.118:6819/1690268990","heartbeat_back_addr":"172.21.15.118:6823/1690268990","heartbeat_front_addr":"172.21.15.118:6821/1690268990","state":["exists","up"]},{"osd":8,"uuid":"5a015a7d-60a3-4412-96af-1b61d2ad51f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6817","nonce":1558675380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6819","nonce":1558675380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6823","nonce":1558675380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6821","nonce":1558675380}]},"public_addr":"172.21.15.149:6817/1558675380","cluster_addr":"172.21.15.149:6819/1558675380","heartbeat_back_addr":"172.21.15.149:6823/1558675380","heartbeat_front_addr":"172.21.15.149:6821/1558675380","state":["exists","up"]},{"osd":9,"uuid":"248c0b6e-4c4e-4c63-a0dd-e4cdf3b997a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6827","nonce":1453934262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6829","nonce":1453934262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6833","nonce":1453934262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6831","nonce":1453934262}]},"public_addr":"172.21.15.87:6827/1453934262","cluster_addr":"172.21.15.87:6829/1453934262","heartbeat_back_addr":"172.21.15.87:6833/1453934262","heartbeat_front_addr":"172.21.15.87:6831/1453934262","state":["exists","up"]},{"osd":10,"uuid":"24238714-e737-4371-b5d5-0cd3395f09bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6825","nonce":1034318850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6827","nonce":1034318850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6831","nonce":1034318850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6829","nonce":1034318850}]},"public_addr":"172.21.15.118:6825/1034318850","cluster_addr":"172.21.15.118:6827/1034318850","heartbeat_back_addr":"172.21.15.118:6831/1034318850","heartbeat_front_addr":"172.21.15.118:6829/1034318850","state":["exists","up"]},{"osd":11,"uuid":"409dd3bf-5154-4dea-8708-7de7f9e2e793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6825","nonce":271000465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6827","nonce":271000465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6831","nonce":271000465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6829","nonce":271000465}]},"public_addr":"172.21.15.149:6825/271000465","cluster_addr":"172.21.15.149:6827/271000465","heartbeat_back_addr":"172.21.15.149:6831/271000465","heartbeat_front_addr":"172.21.15.149:6829/271000465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:16.382664+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:37.914250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:00.425876+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:23.960183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:47.004088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:10.214345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:33.719221+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:57.099599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:20.971881+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:44.827167+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:08.135516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:32.085853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.d","mappings":[{"from":1,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8},{"from":5,"to":7}]},{"pgid":"3.28","mappings":[{"from":3,"to":6},{"from":5,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/718653925":"2024-09-14T17:13:49.377087+0000","172.21.15.87:0/3081317043":"2024-09-14T17:13:49.377087+0000","172.21.15.87:0/1633498542":"2024-09-14T17:13:49.377087+0000","172.21.15.87:6801/1587363880":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/3403361612":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/553289143":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/1475107314":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/515676743":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/3270371628":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6800/1587363880":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6800/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6801/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/2612130442":"2024-09-14T17:13:49.377087+0000","172.21.15.87:0/586423689":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6800/701043027":"2024-09-14T17:13:49.377087+0000","172.21.15.87:6801/701043027":"2024-09-14T17:13:49.377087+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:13:56.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.915+0000 7efc6422b640 1 -- 172.21.15.87:0/606810231 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7efc480a1290 msgr2=0x7efc480a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:56.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.915+0000 7efc6422b640 1 --2- 172.21.15.87:0/606810231 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7efc480a1290 0x7efc480a3750 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efc5c069160 tx=0x7efc58005ed0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.915+0000 7efc6422b640 1 -- 172.21.15.87:0/606810231 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc5c0fee90 msgr2=0x7efc5c197100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:56.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.915+0000 7efc6422b640 1 --2- 172.21.15.87:0/606810231 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc5c0fee90 0x7efc5c197100 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7efc4c00d950 tx=0x7efc4c00de10 comp rx=0 tx=0).stop 2024-09-13T17:13:56.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.915+0000 7efc6422b640 1 -- 172.21.15.87:0/606810231 shutdown_connections 2024-09-13T17:13:56.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.915+0000 7efc6422b640 1 --2- 172.21.15.87:0/606810231 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc5c197bd0 0x7efc5c1a2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.915+0000 7efc6422b640 1 --2- 172.21.15.87:0/606810231 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc5c103fe0 0x7efc5c197640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.915+0000 7efc6422b640 1 --2- 172.21.15.87:0/606810231 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7efc480a1290 0x7efc480a3750 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.915+0000 7efc6422b640 1 --2- 172.21.15.87:0/606810231 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc5c0fee90 0x7efc5c197100 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:56.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.915+0000 7efc6422b640 1 -- 172.21.15.87:0/606810231 >> 172.21.15.87:0/606810231 conn(0x7efc5c0fa900 msgr2=0x7efc5c0fbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:56.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.915+0000 7efc6422b640 1 -- 172.21.15.87:0/606810231 shutdown_connections 2024-09-13T17:13:56.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:56.915+0000 7efc6422b640 1 -- 172.21.15.87:0/606810231 wait complete. 2024-09-13T17:13:56.928 DEBUG:tasks.fwd_scrub:Yielding 2024-09-13T17:13:56.929 INFO:teuthology.run_tasks:Running task exec... 2024-09-13T17:13:56.938 INFO:teuthology.task.exec:Executing custom commands... 2024-09-13T17:13:56.938 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T17:13:56.938 DEBUG:teuthology.orchestra.run.smithi087:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-09-13T17:13:56.939 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-13T17:13:56.939 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-13T17:13:56.939 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-09-13T17:13:57.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.038+0000 7f5889ab7640 1 -- 172.21.15.87:0/351844597 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5884104ce0 msgr2=0x7f58841050c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.038+0000 7f5889ab7640 1 --2- 172.21.15.87:0/351844597 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5884104ce0 0x7f58841050c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f5874009ca0 tx=0x7f587402a8c0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.038+0000 7f5889ab7640 1 -- 172.21.15.87:0/351844597 shutdown_connections 2024-09-13T17:13:57.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.038+0000 7f5889ab7640 1 --2- 172.21.15.87:0/351844597 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58840681d0 0x7f588410cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.038+0000 7f5889ab7640 1 --2- 172.21.15.87:0/351844597 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5884067830 0x7f5884067c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.038+0000 7f5889ab7640 1 --2- 172.21.15.87:0/351844597 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5884104ce0 0x7f58841050c0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.038+0000 7f5889ab7640 1 -- 172.21.15.87:0/351844597 >> 172.21.15.87:0/351844597 conn(0x7f5884074940 msgr2=0x7f5884074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:57.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.038+0000 7f5889ab7640 1 -- 172.21.15.87:0/351844597 shutdown_connections 2024-09-13T17:13:57.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.038+0000 7f5889ab7640 1 -- 172.21.15.87:0/351844597 wait complete. 2024-09-13T17:13:57.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.038+0000 7f5889ab7640 1 Processor -- start 2024-09-13T17:13:57.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.039+0000 7f5889ab7640 1 -- start start 2024-09-13T17:13:57.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.039+0000 7f5889ab7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5884067830 0x7f5884198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.039+0000 7f5889ab7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58840681d0 0x7f5884198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.039+0000 7f5889ab7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5884104ce0 0x7f588419cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.039+0000 7f5889ab7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588419d4a0 con 0x7f58840681d0 2024-09-13T17:13:57.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.039+0000 7f5889ab7640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588419d610 con 0x7f5884067830 2024-09-13T17:13:57.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.039+0000 7f5889ab7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588419d7d0 con 0x7f5884104ce0 2024-09-13T17:13:57.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.039+0000 7f5882ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58840681d0 0x7f5884198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.039+0000 7f5882ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58840681d0 0x7f5884198ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42042/0 (socket says 172.21.15.87:42042) 2024-09-13T17:13:57.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.039+0000 7f5882ffd640 1 -- 172.21.15.87:0/2793317904 learned_addr learned my addr 172.21.15.87:0/2793317904 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:57.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.039+0000 7f58837fe640 1 --2- 172.21.15.87:0/2793317904 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5884067830 0x7f5884198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.039+0000 7f5883fff640 1 --2- 172.21.15.87:0/2793317904 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5884104ce0 0x7f588419cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.039+0000 7f5882ffd640 1 -- 172.21.15.87:0/2793317904 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5884104ce0 msgr2=0x7f588419cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.039+0000 7f5882ffd640 1 --2- 172.21.15.87:0/2793317904 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5884104ce0 0x7f588419cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.039+0000 7f5882ffd640 1 -- 172.21.15.87:0/2793317904 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5884067830 msgr2=0x7f5884198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.039+0000 7f5882ffd640 1 --2- 172.21.15.87:0/2793317904 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5884067830 0x7f5884198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.039+0000 7f5882ffd640 1 -- 172.21.15.87:0/2793317904 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5874009900 con 0x7f58840681d0 2024-09-13T17:13:57.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.039+0000 7f5882ffd640 1 --2- 172.21.15.87:0/2793317904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58840681d0 0x7f5884198ab0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f586c00d950 tx=0x7f586c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:57.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.040+0000 7f5880ff9640 1 -- 172.21.15.87:0/2793317904 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c009a30 con 0x7f58840681d0 2024-09-13T17:13:57.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.040+0000 7f5889ab7640 1 -- 172.21.15.87:0/2793317904 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f588419dab0 con 0x7f58840681d0 2024-09-13T17:13:57.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.040+0000 7f5880ff9640 1 -- 172.21.15.87:0/2793317904 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f586c0044d0 con 0x7f58840681d0 2024-09-13T17:13:57.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.040+0000 7f5880ff9640 1 -- 172.21.15.87:0/2793317904 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c0047a0 con 0x7f58840681d0 2024-09-13T17:13:57.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.040+0000 7f5889ab7640 1 -- 172.21.15.87:0/2793317904 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58841a5330 con 0x7f58840681d0 2024-09-13T17:13:57.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.040+0000 7fe62da53640 1 -- 172.21.15.87:0/2307664935 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe628103fb0 msgr2=0x7fe62810bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.040+0000 7fe62da53640 1 --2- 172.21.15.87:0/2307664935 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe628103fb0 0x7fe62810bb00 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe620009cd0 tx=0x7fe62002a8e0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.040+0000 7fe62da53640 1 -- 172.21.15.87:0/2307664935 shutdown_connections 2024-09-13T17:13:57.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.040+0000 7fe62da53640 1 --2- 172.21.15.87:0/2307664935 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe628103fb0 0x7fe62810bb00 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.040+0000 7fe62da53640 1 --2- 172.21.15.87:0/2307664935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6280ff810 0x7fe628103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.040+0000 7fe62da53640 1 --2- 172.21.15.87:0/2307664935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6280fee60 0x7fe6280ff240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.040+0000 7fe62da53640 1 -- 172.21.15.87:0/2307664935 >> 172.21.15.87:0/2307664935 conn(0x7fe6280fa910 msgr2=0x7fe6280fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.040+0000 7fe62da53640 1 -- 172.21.15.87:0/2307664935 shutdown_connections 2024-09-13T17:13:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.040+0000 7fe62da53640 1 -- 172.21.15.87:0/2307664935 wait complete. 2024-09-13T17:13:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.041+0000 7fe62da53640 1 Processor -- start 2024-09-13T17:13:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.041+0000 7fe62da53640 1 -- start start 2024-09-13T17:13:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.041+0000 7f5889ab7640 1 -- 172.21.15.87:0/2793317904 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5884101410 con 0x7f58840681d0 2024-09-13T17:13:57.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.041+0000 7fe62da53640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6280fee60 0x7fe6281008f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.041+0000 7fe62da53640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe628103fb0 0x7fe628100e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.041+0000 7fe62da53640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe628101370 0x7fe6281a4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.041+0000 7fe62da53640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6281a4ad0 con 0x7fe628101370 2024-09-13T17:13:57.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.041+0000 7fe62da53640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6281a4c40 con 0x7fe6280fee60 2024-09-13T17:13:57.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.041+0000 7fe62da53640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6281a4e00 con 0x7fe628103fb0 2024-09-13T17:13:57.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.041+0000 7fe6277fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe628101370 0x7fe6281a4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.041+0000 7fe6277fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe628101370 0x7fe6281a4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42048/0 (socket says 172.21.15.87:42048) 2024-09-13T17:13:57.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.041+0000 7fe6277fe640 1 -- 172.21.15.87:0/3091556455 learned_addr learned my addr 172.21.15.87:0/3091556455 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:57.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.041+0000 7fe6267fc640 1 --2- 172.21.15.87:0/3091556455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe628103fb0 0x7fe628100e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.041+0000 7fe626ffd640 1 --2- 172.21.15.87:0/3091556455 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6280fee60 0x7fe6281008f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.042+0000 7fe6277fe640 1 -- 172.21.15.87:0/3091556455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe628103fb0 msgr2=0x7fe628100e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.042+0000 7fe6277fe640 1 --2- 172.21.15.87:0/3091556455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe628103fb0 0x7fe628100e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.042+0000 7fe6277fe640 1 -- 172.21.15.87:0/3091556455 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6280fee60 msgr2=0x7fe6281008f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.042+0000 7fe6277fe640 1 --2- 172.21.15.87:0/3091556455 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6280fee60 0x7fe6281008f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.042+0000 7fe6277fe640 1 -- 172.21.15.87:0/3091556455 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe620009900 con 0x7fe628101370 2024-09-13T17:13:57.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.042+0000 7fe6277fe640 1 --2- 172.21.15.87:0/3091556455 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe628101370 0x7fe6281a4480 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe620005e30 tx=0x7fe6200307d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:57.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.042+0000 7fe62ca51640 1 -- 172.21.15.87:0/3091556455 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe620031c80 con 0x7fe628101370 2024-09-13T17:13:57.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.042+0000 7fe62ca51640 1 -- 172.21.15.87:0/3091556455 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe620003e20 con 0x7fe628101370 2024-09-13T17:13:57.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.042+0000 7fe62ca51640 1 -- 172.21.15.87:0/3091556455 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62003b400 con 0x7fe628101370 2024-09-13T17:13:57.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.042+0000 7fe62da53640 1 -- 172.21.15.87:0/3091556455 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6281a5080 con 0x7fe628101370 2024-09-13T17:13:57.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.042+0000 7f5880ff9640 1 -- 172.21.15.87:0/2793317904 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 24) v1 ==== 136049+0+0 (secure 0 0 0) 0x7f586c009b90 con 0x7f58840681d0 2024-09-13T17:13:57.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.042+0000 7fe62da53640 1 -- 172.21.15.87:0/3091556455 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6281a5590 con 0x7fe628101370 2024-09-13T17:13:57.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.043+0000 7f5880ff9640 1 --2- 172.21.15.87:0/2793317904 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f58700a1290 0x7f58700a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.043+0000 7f58837fe640 1 --2- 172.21.15.87:0/2793317904 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f58700a1290 0x7f58700a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.043+0000 7f5880ff9640 1 -- 172.21.15.87:0/2793317904 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f586c0ccb90 con 0x7f58840681d0 2024-09-13T17:13:57.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.043+0000 7f58837fe640 1 --2- 172.21.15.87:0/2793317904 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f58700a1290 0x7f58700a3750 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5874000f80 tx=0x7f5874004a60 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:57.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.044+0000 7fe62ca51640 1 -- 172.21.15.87:0/3091556455 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 24) v1 ==== 136049+0+0 (secure 0 0 0) 0x7fe62000a040 con 0x7fe628101370 2024-09-13T17:13:57.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.045+0000 7fe630853740 1 Processor -- start 2024-09-13T17:13:57.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.045+0000 7fe630853740 1 -- start start 2024-09-13T17:13:57.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.045+0000 7fe62ca51640 1 --2- 172.21.15.87:0/3091556455 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe6100a1310 0x7fe6100a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.045+0000 7fe630853740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647f7cb77c0 0x5647f7cb7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.045+0000 7fe630853740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647f7cb80e0 0x5647f7cc2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.045+0000 7fe630853740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647f7cc2980 0x5647f7cc4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.045+0000 7fe630853740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f7c22c60 con 0x5647f7cb77c0 2024-09-13T17:13:57.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.045+0000 7fe630853740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f7c203f0 con 0x5647f7cb80e0 2024-09-13T17:13:57.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.045+0000 7fe630853740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f7c1bce0 con 0x5647f7cc2980 2024-09-13T17:13:57.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.045+0000 7fe6267fc640 1 --2- 172.21.15.87:0/3091556455 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe6100a1310 0x7fe6100a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.045+0000 7fe626ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647f7cb77c0 0x5647f7cb7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.045+0000 7fe62ca51640 1 -- 172.21.15.87:0/3091556455 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fe6200ee170 con 0x7fe628101370 2024-09-13T17:13:57.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.045+0000 7fe626ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647f7cb77c0 0x5647f7cb7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42050/0 (socket says 172.21.15.87:42050) 2024-09-13T17:13:57.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.045+0000 7fe626ffd640 1 -- 172.21.15.87:0/2488347450 learned_addr learned my addr 172.21.15.87:0/2488347450 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:57.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.045+0000 7fe6267fc640 1 --2- 172.21.15.87:0/2488347450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647f7cb80e0 0x5647f7cc2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.045+0000 7fe626ffd640 1 -- 172.21.15.87:0/2488347450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647f7cc2980 msgr2=0x5647f7cc4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:57.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.045+0000 7fe626ffd640 1 --2- 172.21.15.87:0/2488347450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647f7cc2980 0x5647f7cc4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.045+0000 7fe626ffd640 1 -- 172.21.15.87:0/2488347450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647f7cb80e0 msgr2=0x5647f7cc2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:57.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.045+0000 7fe626ffd640 1 --2- 172.21.15.87:0/2488347450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647f7cb80e0 0x5647f7cc2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.046+0000 7fe626ffd640 1 -- 172.21.15.87:0/2488347450 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647f7bd7970 con 0x5647f7cb77c0 2024-09-13T17:13:57.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.046+0000 7fe6267fc640 1 --2- 172.21.15.87:0/2488347450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647f7cb80e0 0x5647f7cc2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:57.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.046+0000 7fe6267fc640 1 --2- 172.21.15.87:0/3091556455 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe6100a1310 0x7fe6100a37d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe6281023f0 tx=0x7fe61c00ba60 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:57.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.046+0000 7fe626ffd640 1 --2- 172.21.15.87:0/2488347450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647f7cb77c0 0x5647f7cb7ba0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe61800bd10 tx=0x7fe6180107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f51f39bbd5b09f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:57.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.047+0000 7fe60dffb640 1 -- 172.21.15.87:0/2488347450 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe618004030 con 0x5647f7cb77c0 2024-09-13T17:13:57.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.048+0000 7fe60dffb640 1 -- 172.21.15.87:0/2488347450 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe618015070 con 0x5647f7cb77c0 2024-09-13T17:13:57.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.048+0000 7fe60dffb640 1 -- 172.21.15.87:0/2488347450 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6180116a0 con 0x5647f7cb77c0 2024-09-13T17:13:57.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.048+0000 7f5880ff9640 1 -- 172.21.15.87:0/2793317904 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f586c095ac0 con 0x7f58840681d0 2024-09-13T17:13:57.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.048+0000 7fe630853740 1 -- 172.21.15.87:0/2488347450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647f7cb77c0 msgr2=0x5647f7cb7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.048+0000 7fe630853740 1 --2- 172.21.15.87:0/2488347450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647f7cb77c0 0x5647f7cb7ba0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe61800bd10 tx=0x7fe6180107a0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.048+0000 7fe630853740 1 -- 172.21.15.87:0/2488347450 shutdown_connections 2024-09-13T17:13:57.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.048+0000 7fe630853740 1 --2- 172.21.15.87:0/2488347450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647f7cc2980 0x5647f7cc4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.048+0000 7fe630853740 1 --2- 172.21.15.87:0/2488347450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647f7cb80e0 0x5647f7cc2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.048+0000 7fe630853740 1 --2- 172.21.15.87:0/2488347450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647f7cb77c0 0x5647f7cb7ba0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.048+0000 7fe630853740 1 -- 172.21.15.87:0/2488347450 >> 172.21.15.87:0/2488347450 conn(0x5647f7cb3d50 msgr2=0x5647f7cb4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:57.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.048+0000 7fe630853740 1 -- 172.21.15.87:0/2488347450 shutdown_connections 2024-09-13T17:13:57.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.048+0000 7fe630853740 1 -- 172.21.15.87:0/2488347450 wait complete. 2024-09-13T17:13:57.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.049+0000 7fe630853740 1 -- start start 2024-09-13T17:13:57.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.049+0000 7fe630853740 1 Processor -- start 2024-09-13T17:13:57.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.049+0000 7fe630853740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647f7cb77c0 0x5647f7cc23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.049+0000 7fe630853740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647f7cb80e0 0x5647f7cbf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.049+0000 7fe630853740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647f7cc2980 0x5647f7cbfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.049+0000 7fe630853740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f7bd9f80 con 0x5647f7cc2980 2024-09-13T17:13:57.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.049+0000 7fe630853740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f7bd9c20 con 0x5647f7cb77c0 2024-09-13T17:13:57.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.049+0000 7fe630853740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f7ba6ab0 con 0x5647f7cb80e0 2024-09-13T17:13:57.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.049+0000 7fe630853740 10 client.0 _ll_register_callbacks cb 0x5647f7c15350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:13:57.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.049+0000 7fe6277fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647f7cc2980 0x5647f7cbfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.049+0000 7fe6277fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647f7cc2980 0x5647f7cbfe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42062/0 (socket says 172.21.15.87:42062) 2024-09-13T17:13:57.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.049+0000 7fe6277fe640 1 -- 172.21.15.87:0/2436075635 learned_addr learned my addr 172.21.15.87:0/2436075635 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:57.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.049+0000 7fe626ffd640 1 --2- 172.21.15.87:0/2436075635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647f7cb77c0 0x5647f7cc23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.049+0000 7fe6267fc640 1 --2- 172.21.15.87:0/2436075635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647f7cb80e0 0x5647f7cbf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.050+0000 7fe6277fe640 1 -- 172.21.15.87:0/2436075635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647f7cb80e0 msgr2=0x5647f7cbf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:57.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.050+0000 7fe6277fe640 1 --2- 172.21.15.87:0/2436075635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647f7cb80e0 0x5647f7cbf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.050+0000 7fe6277fe640 1 -- 172.21.15.87:0/2436075635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647f7cb77c0 msgr2=0x5647f7cc23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:57.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.050+0000 7fe6277fe640 1 --2- 172.21.15.87:0/2436075635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647f7cb77c0 0x5647f7cc23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.050+0000 7fe6277fe640 1 -- 172.21.15.87:0/2436075635 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe61800b940 con 0x5647f7cc2980 2024-09-13T17:13:57.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.050+0000 7fe6277fe640 1 --2- 172.21.15.87:0/2436075635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647f7cc2980 0x5647f7cbfe30 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe6200ebb10 tx=0x7fe6200b7240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd522bec665e291 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:57.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.050+0000 7fe606ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:13:57.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.050+0000 7fe606ffd640 1 -- 172.21.15.87:0/2436075635 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62004a250 con 0x5647f7cc2980 2024-09-13T17:13:57.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.050+0000 7fe606ffd640 1 -- 172.21.15.87:0/2436075635 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fe620036220 con 0x5647f7cc2980 2024-09-13T17:13:57.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.050+0000 7fe630853740 1 -- 172.21.15.87:0/2436075635 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5647f790f590 con 0x5647f7cc2980 2024-09-13T17:13:57.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.050+0000 7fe606ffd640 1 -- 172.21.15.87:0/2436075635 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe620036450 con 0x5647f7cc2980 2024-09-13T17:13:57.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.050+0000 7fe630853740 10 client.15711 fetch_fsmap learned FSMap version 24 2024-09-13T17:13:57.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.050+0000 7fe630853740 1 -- 172.21.15.87:0/2436075635 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5647f7c1a360 con 0x5647f7cc2980 2024-09-13T17:13:57.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.050+0000 7fe606ffd640 1 -- 172.21.15.87:0/2436075635 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x5647f790f590 con 0x5647f7cc2980 2024-09-13T17:13:57.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.050+0000 7fe606ffd640 1 -- 172.21.15.87:0/2436075635 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fe6200716e0 con 0x5647f7cc2980 2024-09-13T17:13:57.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.050+0000 7fe630853740 10 client.15711 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:13:57.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.050+0000 7fe630853740 10 client.15711 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:13:57.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.050+0000 7fe630853740 20 client.15711 populate_metadata read hostname 'smithi087' 2024-09-13T17:13:57.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.050+0000 7fe630853740 1 --2- 172.21.15.87:0/2436075635 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5647f7cd2370 0x5647f7cd4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.051+0000 7fe630853740 4 client.15711 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:13:57.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.051+0000 7fe630853740 1 -- 172.21.15.87:0/2436075635 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5647f7920860 con 0x5647f7cd2370 2024-09-13T17:13:57.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.051+0000 7fe626ffd640 1 --2- 172.21.15.87:0/2436075635 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5647f7cd2370 0x5647f7cd4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.051+0000 7fe606ffd640 10 client.15711 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:13:57.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.051+0000 7fe626ffd640 1 --2- 172.21.15.87:0/2436075635 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5647f7cd2370 0x5647f7cd4790 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b717abfb09dbf08d server_cookie=3ef25b4236c22c97 in_seq=0 out_seq=0 2024-09-13T17:13:57.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.052+0000 7fe606ffd640 1 -- 172.21.15.87:0/2436075635 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5647f7920860 con 0x5647f7cd2370 2024-09-13T17:13:57.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.052+0000 7fe606ffd640 10 client.15711 handle_command_reply: tid=0 2024-09-13T17:13:57.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.052+0000 7fe630853740 1 client.15711 shutdown 2024-09-13T17:13:57.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.052+0000 7fe630853740 1 -- 172.21.15.87:0/2436075635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647f7cc2980 msgr2=0x5647f7cbfe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.052+0000 7fe630853740 1 --2- 172.21.15.87:0/2436075635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647f7cc2980 0x5647f7cbfe30 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe6200ebb10 tx=0x7fe6200b7240 comp rx=0 tx=0).stop 2024-09-13T17:13:57.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.052+0000 7fe630853740 1 -- 172.21.15.87:0/2436075635 shutdown_connections 2024-09-13T17:13:57.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.052+0000 7fe630853740 1 --2- 172.21.15.87:0/2436075635 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5647f7cd2370 0x5647f7cd4790 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.052+0000 7fe630853740 1 --2- 172.21.15.87:0/2436075635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647f7cc2980 0x5647f7cbfe30 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.052+0000 7fe630853740 1 --2- 172.21.15.87:0/2436075635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647f7cb80e0 0x5647f7cbf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.052+0000 7fe606ffd640 0 client.15711 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:13:57.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.052+0000 7fe630853740 1 --2- 172.21.15.87:0/2436075635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647f7cb77c0 0x5647f7cc23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.052+0000 7fe630853740 1 -- 172.21.15.87:0/2436075635 >> 172.21.15.87:0/2436075635 conn(0x5647f7cb3d50 msgr2=0x5647f7cb91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:57.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.052+0000 7fe630853740 1 -- 172.21.15.87:0/2436075635 shutdown_connections 2024-09-13T17:13:57.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.052+0000 7fe630853740 1 -- 172.21.15.87:0/2436075635 wait complete. 2024-09-13T17:13:57.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.052+0000 7fe630853740 20 client.15711 trim_cache size 0 max 16384 2024-09-13T17:13:57.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.066+0000 7fe630853740 1 Processor -- start 2024-09-13T17:13:57.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.066+0000 7fe630853740 1 -- start start 2024-09-13T17:13:57.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.066+0000 7fe630853740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647f7cb77c0 0x5647f7cc9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.066+0000 7fe630853740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647f7cb80e0 0x5647f7cc9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.066+0000 7fe630853740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647f7cc2980 0x5647f7cba940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.066+0000 7fe630853740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f7cc0660 con 0x5647f7cc2980 2024-09-13T17:13:57.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.066+0000 7fe630853740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f7ca5ef0 con 0x5647f7cb77c0 2024-09-13T17:13:57.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.066+0000 7fe630853740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f7cae5e0 con 0x5647f7cb80e0 2024-09-13T17:13:57.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.066+0000 7fe6277fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647f7cc2980 0x5647f7cba940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.067+0000 7fe6277fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647f7cc2980 0x5647f7cba940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42072/0 (socket says 172.21.15.87:42072) 2024-09-13T17:13:57.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.067+0000 7fe6277fe640 1 -- 172.21.15.87:0/3788132433 learned_addr learned my addr 172.21.15.87:0/3788132433 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:57.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.067+0000 7fe6267fc640 1 --2- 172.21.15.87:0/3788132433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647f7cb80e0 0x5647f7cc9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.067+0000 7fe626ffd640 1 --2- 172.21.15.87:0/3788132433 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647f7cb77c0 0x5647f7cc9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.067+0000 7fe6277fe640 1 -- 172.21.15.87:0/3788132433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647f7cb80e0 msgr2=0x5647f7cc9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:57.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.067+0000 7fe6277fe640 1 --2- 172.21.15.87:0/3788132433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647f7cb80e0 0x5647f7cc9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.067+0000 7fe6277fe640 1 -- 172.21.15.87:0/3788132433 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647f7cb77c0 msgr2=0x5647f7cc9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:57.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.067+0000 7fe6277fe640 1 --2- 172.21.15.87:0/3788132433 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647f7cb77c0 0x5647f7cc9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.067+0000 7fe6277fe640 1 -- 172.21.15.87:0/3788132433 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647f7bbc1c0 con 0x5647f7cc2980 2024-09-13T17:13:57.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.067+0000 7fe6277fe640 1 --2- 172.21.15.87:0/3788132433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647f7cc2980 0x5647f7cba940 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe6200b9160 tx=0x7fe620003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad7e85d9e513fe2b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:57.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.067+0000 7fe60e7fc640 1 -- 172.21.15.87:0/3788132433 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6200eb390 con 0x5647f7cc2980 2024-09-13T17:13:57.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.067+0000 7fe60e7fc640 1 -- 172.21.15.87:0/3788132433 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe6200ba950 con 0x5647f7cc2980 2024-09-13T17:13:57.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.067+0000 7fe60e7fc640 1 -- 172.21.15.87:0/3788132433 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6200eb700 con 0x5647f7cc2980 2024-09-13T17:13:57.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.068+0000 7fe630853740 1 -- 172.21.15.87:0/3788132433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647f7cc2980 msgr2=0x5647f7cba940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.068+0000 7fe630853740 1 --2- 172.21.15.87:0/3788132433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647f7cc2980 0x5647f7cba940 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe6200b9160 tx=0x7fe620003f90 comp rx=0 tx=0).stop 2024-09-13T17:13:57.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.068+0000 7fe630853740 1 -- 172.21.15.87:0/3788132433 shutdown_connections 2024-09-13T17:13:57.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.068+0000 7fe630853740 1 --2- 172.21.15.87:0/3788132433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647f7cc2980 0x5647f7cba940 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.068+0000 7fe630853740 1 --2- 172.21.15.87:0/3788132433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647f7cb80e0 0x5647f7cc9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.068+0000 7fe630853740 1 --2- 172.21.15.87:0/3788132433 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647f7cb77c0 0x5647f7cc9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.068+0000 7fe630853740 1 -- 172.21.15.87:0/3788132433 >> 172.21.15.87:0/3788132433 conn(0x5647f7cb3d50 msgr2=0x5647f7cd90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:57.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.068+0000 7fe630853740 1 -- 172.21.15.87:0/3788132433 shutdown_connections 2024-09-13T17:13:57.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.068+0000 7fe630853740 1 -- 172.21.15.87:0/3788132433 wait complete. 2024-09-13T17:13:57.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.068+0000 7fe630853740 1 -- start start 2024-09-13T17:13:57.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.068+0000 7fe630853740 1 Processor -- start 2024-09-13T17:13:57.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.069+0000 7fe630853740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647f7cb77c0 0x5647f7cc8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.069+0000 7fe630853740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647f7cb80e0 0x5647f7cc86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.069+0000 7fe630853740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647f7cc2980 0x5647f7cc8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.069+0000 7fe630853740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f7d28880 con 0x5647f7cb77c0 2024-09-13T17:13:57.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.069+0000 7fe630853740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f7d289c0 con 0x5647f7cc2980 2024-09-13T17:13:57.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.069+0000 7fe630853740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f7d28b00 con 0x5647f7cb80e0 2024-09-13T17:13:57.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.069+0000 7fe630853740 10 client.0 _ll_register_callbacks cb 0x7fe6200eb2e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:13:57.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.069+0000 7fe626ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647f7cb77c0 0x5647f7cc8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.069+0000 7fe626ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647f7cb77c0 0x5647f7cc8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42080/0 (socket says 172.21.15.87:42080) 2024-09-13T17:13:57.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.069+0000 7fe626ffd640 1 -- 172.21.15.87:0/3145494394 learned_addr learned my addr 172.21.15.87:0/3145494394 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:57.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.069+0000 7fe6277fe640 1 --2- 172.21.15.87:0/3145494394 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647f7cc2980 0x5647f7cc8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.069+0000 7fe6267fc640 1 --2- 172.21.15.87:0/3145494394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647f7cb80e0 0x5647f7cc86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.069+0000 7fe626ffd640 1 -- 172.21.15.87:0/3145494394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647f7cb80e0 msgr2=0x5647f7cc86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:57.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.069+0000 7fe626ffd640 1 --2- 172.21.15.87:0/3145494394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647f7cb80e0 0x5647f7cc86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.069+0000 7fe626ffd640 1 -- 172.21.15.87:0/3145494394 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647f7cc2980 msgr2=0x5647f7cc8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:57.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.069+0000 7fe626ffd640 1 --2- 172.21.15.87:0/3145494394 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647f7cc2980 0x5647f7cc8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.069+0000 7fe626ffd640 1 -- 172.21.15.87:0/3145494394 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5647f7c1a360 con 0x5647f7cb77c0 2024-09-13T17:13:57.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.069+0000 7fe626ffd640 1 --2- 172.21.15.87:0/3145494394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647f7cb77c0 0x5647f7cc8170 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fe618011010 tx=0x7fe618003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c70680e05bd73d63 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:57.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.069+0000 7fe606ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:13:57.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.069+0000 7fe606ffd640 1 -- 172.21.15.87:0/3145494394 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe618020070 con 0x5647f7cb77c0 2024-09-13T17:13:57.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.069+0000 7fe606ffd640 1 -- 172.21.15.87:0/3145494394 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fe618017070 con 0x5647f7cb77c0 2024-09-13T17:13:57.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.069+0000 7fe630853740 1 -- 172.21.15.87:0/3145494394 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe618015070 con 0x5647f7cb77c0 2024-09-13T17:13:57.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.070+0000 7fe606ffd640 1 -- 172.21.15.87:0/3145494394 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe618005040 con 0x5647f7cb77c0 2024-09-13T17:13:57.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.070+0000 7fe630853740 10 client.15717 fetch_fsmap learned FSMap version 24 2024-09-13T17:13:57.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.070+0000 7fe630853740 1 -- 172.21.15.87:0/3145494394 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5647f7be1990 con 0x5647f7cb77c0 2024-09-13T17:13:57.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.070+0000 7fe606ffd640 1 -- 172.21.15.87:0/3145494394 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe618015070 con 0x5647f7cb77c0 2024-09-13T17:13:57.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.070+0000 7fe606ffd640 1 -- 172.21.15.87:0/3145494394 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fe61802f060 con 0x5647f7cb77c0 2024-09-13T17:13:57.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.070+0000 7fe630853740 10 client.15717 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:13:57.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.070+0000 7fe630853740 10 client.15717 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:13:57.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.070+0000 7fe630853740 20 client.15717 populate_metadata read hostname 'smithi087' 2024-09-13T17:13:57.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.070+0000 7fe630853740 1 --2- 172.21.15.87:0/3145494394 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5647f7d2a300 0x5647f7d2c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.070+0000 7fe630853740 4 client.15717 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-13T17:13:57.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.070+0000 7fe630853740 1 -- 172.21.15.87:0/3145494394 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5647f7973eb0 con 0x5647f7d2a300 2024-09-13T17:13:57.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.071+0000 7fe6267fc640 1 --2- 172.21.15.87:0/3145494394 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5647f7d2a300 0x5647f7d2c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.071+0000 7fe6267fc640 1 --2- 172.21.15.87:0/3145494394 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5647f7d2a300 0x5647f7d2c720 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aad54dbd88732db3 server_cookie=bdc44c42cdc72436 in_seq=0 out_seq=0 2024-09-13T17:13:57.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.071+0000 7fe606ffd640 10 client.15717 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:13:57.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.072+0000 7fe606ffd640 1 -- 172.21.15.87:0/3145494394 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5647f7973eb0 con 0x5647f7d2a300 2024-09-13T17:13:57.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.072+0000 7fe606ffd640 10 client.15717 handle_command_reply: tid=0 2024-09-13T17:13:57.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.072+0000 7fe630853740 1 client.15717 shutdown 2024-09-13T17:13:57.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.072+0000 7fe630853740 1 -- 172.21.15.87:0/3145494394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647f7cb77c0 msgr2=0x5647f7cc8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.072+0000 7fe630853740 1 --2- 172.21.15.87:0/3145494394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647f7cb77c0 0x5647f7cc8170 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fe618011010 tx=0x7fe618003c80 comp rx=0 tx=0).stop 2024-09-13T17:13:57.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.072+0000 7fe630853740 1 -- 172.21.15.87:0/3145494394 shutdown_connections 2024-09-13T17:13:57.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.072+0000 7fe630853740 1 --2- 172.21.15.87:0/3145494394 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5647f7d2a300 0x5647f7d2c720 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.072+0000 7fe630853740 1 --2- 172.21.15.87:0/3145494394 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647f7cc2980 0x5647f7cc8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.072+0000 7fe630853740 1 --2- 172.21.15.87:0/3145494394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647f7cb80e0 0x5647f7cc86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.072+0000 7fe630853740 1 --2- 172.21.15.87:0/3145494394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5647f7cb77c0 0x5647f7cc8170 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.072+0000 7fe630853740 1 -- 172.21.15.87:0/3145494394 >> 172.21.15.87:0/3145494394 conn(0x5647f7cb3d50 msgr2=0x5647f7cba940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:57.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.072+0000 7fe606ffd640 0 client.15717 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:13:57.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.072+0000 7fe630853740 1 -- 172.21.15.87:0/3145494394 shutdown_connections 2024-09-13T17:13:57.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.072+0000 7fe630853740 1 -- 172.21.15.87:0/3145494394 wait complete. 2024-09-13T17:13:57.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.073+0000 7fe630853740 20 client.15717 trim_cache size 0 max 16384 2024-09-13T17:13:57.083 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:13:57.083 INFO:teuthology.orchestra.run.smithi087.stdout: "return_code": 0, 2024-09-13T17:13:57.083 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_tag": "473f1b09-2716-4571-b115-bac8cfdc2e80", 2024-09-13T17:13:57.083 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": "asynchronous" 2024-09-13T17:13:57.083 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:13:57.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.073+0000 7fe62da53640 1 -- 172.21.15.87:0/3091556455 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe6100a1310 msgr2=0x7fe6100a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.073+0000 7fe62da53640 1 --2- 172.21.15.87:0/3091556455 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe6100a1310 0x7fe6100a37d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe6281023f0 tx=0x7fe61c00ba60 comp rx=0 tx=0).stop 2024-09-13T17:13:57.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.073+0000 7fe62da53640 1 -- 172.21.15.87:0/3091556455 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe628101370 msgr2=0x7fe6281a4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.073+0000 7fe62da53640 1 --2- 172.21.15.87:0/3091556455 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe628101370 0x7fe6281a4480 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe620005e30 tx=0x7fe6200307d0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.073+0000 7fe62da53640 1 -- 172.21.15.87:0/3091556455 shutdown_connections 2024-09-13T17:13:57.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.073+0000 7fe62da53640 1 --2- 172.21.15.87:0/3091556455 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe6100a1310 0x7fe6100a37d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.073+0000 7fe62da53640 1 --2- 172.21.15.87:0/3091556455 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe628101370 0x7fe6281a4480 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.073+0000 7fe62da53640 1 --2- 172.21.15.87:0/3091556455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe628103fb0 0x7fe628100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.073+0000 7fe62da53640 1 --2- 172.21.15.87:0/3091556455 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6280fee60 0x7fe6281008f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.073+0000 7fe62da53640 1 -- 172.21.15.87:0/3091556455 >> 172.21.15.87:0/3091556455 conn(0x7fe6280fa910 msgr2=0x7fe628068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:57.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.073+0000 7fe62da53640 1 -- 172.21.15.87:0/3091556455 shutdown_connections 2024-09-13T17:13:57.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.073+0000 7fe62da53640 1 -- 172.21.15.87:0/3091556455 wait complete. 2024-09-13T17:13:57.086 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:13:57.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.186+0000 7fdc566be640 1 -- 172.21.15.87:0/3391456749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc50100f60 msgr2=0x7fdc50101340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.186+0000 7fdc566be640 1 --2- 172.21.15.87:0/3391456749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc50100f60 0x7fdc50101340 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fdc40009900 tx=0x7fdc4002a480 comp rx=0 tx=0).stop 2024-09-13T17:13:57.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.186+0000 7fdc566be640 1 -- 172.21.15.87:0/3391456749 shutdown_connections 2024-09-13T17:13:57.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.186+0000 7fdc566be640 1 --2- 172.21.15.87:0/3391456749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc5010a330 0x7fdc5010c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.186+0000 7fdc566be640 1 --2- 172.21.15.87:0/3391456749 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc50101880 0x7fdc50109d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.186+0000 7fdc566be640 1 --2- 172.21.15.87:0/3391456749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc50100f60 0x7fdc50101340 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.186+0000 7fdc566be640 1 -- 172.21.15.87:0/3391456749 >> 172.21.15.87:0/3391456749 conn(0x7fdc50075c60 msgr2=0x7fdc500fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:57.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.186+0000 7fdc566be640 1 -- 172.21.15.87:0/3391456749 shutdown_connections 2024-09-13T17:13:57.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.186+0000 7fdc566be640 1 -- 172.21.15.87:0/3391456749 wait complete. 2024-09-13T17:13:57.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.187+0000 7fdc566be640 1 Processor -- start 2024-09-13T17:13:57.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.187+0000 7fdc566be640 1 -- start start 2024-09-13T17:13:57.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.187+0000 7fdc566be640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc50100f60 0x7fdc50196210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.187+0000 7fdc566be640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc50101880 0x7fdc50196750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.187+0000 7fdc566be640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc5010a330 0x7fdc5019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.187+0000 7fdc566be640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5019b140 con 0x7fdc5010a330 2024-09-13T17:13:57.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.187+0000 7fdc566be640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5019b2b0 con 0x7fdc50101880 2024-09-13T17:13:57.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.187+0000 7fdc566be640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5019b470 con 0x7fdc50100f60 2024-09-13T17:13:57.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.187+0000 7fdc54c5b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc5010a330 0x7fdc5019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.187+0000 7fdc54c5b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc5010a330 0x7fdc5019ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42100/0 (socket says 172.21.15.87:42100) 2024-09-13T17:13:57.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.187+0000 7fdc54c5b640 1 -- 172.21.15.87:0/2586826806 learned_addr learned my addr 172.21.15.87:0/2586826806 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:57.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.187+0000 7fdc4ffff640 1 --2- 172.21.15.87:0/2586826806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc50100f60 0x7fdc50196210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.187+0000 7fdc4f7fe640 1 --2- 172.21.15.87:0/2586826806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc50101880 0x7fdc50196750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.187+0000 7fdc54c5b640 1 -- 172.21.15.87:0/2586826806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc50100f60 msgr2=0x7fdc50196210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.187+0000 7fdc54c5b640 1 --2- 172.21.15.87:0/2586826806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc50100f60 0x7fdc50196210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.187+0000 7fdc54c5b640 1 -- 172.21.15.87:0/2586826806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc50101880 msgr2=0x7fdc50196750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.187+0000 7fdc54c5b640 1 --2- 172.21.15.87:0/2586826806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc50101880 0x7fdc50196750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.188+0000 7fdc54c5b640 1 -- 172.21.15.87:0/2586826806 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc40009560 con 0x7fdc5010a330 2024-09-13T17:13:57.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.188+0000 7fdc54c5b640 1 --2- 172.21.15.87:0/2586826806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc5010a330 0x7fdc5019ab40 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fdc4800e960 tx=0x7fdc4800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:57.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.188+0000 7fdc4d7fa640 1 -- 172.21.15.87:0/2586826806 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc48004d20 con 0x7fdc5010a330 2024-09-13T17:13:57.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.188+0000 7fdc4d7fa640 1 -- 172.21.15.87:0/2586826806 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdc48004e80 con 0x7fdc5010a330 2024-09-13T17:13:57.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.188+0000 7fdc566be640 1 -- 172.21.15.87:0/2586826806 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc5019b750 con 0x7fdc5010a330 2024-09-13T17:13:57.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.188+0000 7fdc4d7fa640 1 -- 172.21.15.87:0/2586826806 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc480116d0 con 0x7fdc5010a330 2024-09-13T17:13:57.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.188+0000 7fdc566be640 1 -- 172.21.15.87:0/2586826806 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc501a2fd0 con 0x7fdc5010a330 2024-09-13T17:13:57.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.190+0000 7fdc4d7fa640 1 -- 172.21.15.87:0/2586826806 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 24) v1 ==== 136049+0+0 (secure 0 0 0) 0x7fdc48005020 con 0x7fdc5010a330 2024-09-13T17:13:57.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.190+0000 7fdc593e0740 1 Processor -- start 2024-09-13T17:13:57.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.191+0000 7fdc593e0740 1 -- start start 2024-09-13T17:13:57.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.191+0000 7fdc593e0740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56305029ed30 0x56305029f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.191+0000 7fdc593e0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56305029f650 0x5630502adea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.191+0000 7fdc593e0740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5630502ae3e0 0x5630502b07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.191+0000 7fdc593e0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x563050209f20 con 0x56305029f650 2024-09-13T17:13:57.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.191+0000 7fdc593e0740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630502076b0 con 0x5630502ae3e0 2024-09-13T17:13:57.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.191+0000 7fdc593e0740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x563050202fa0 con 0x56305029ed30 2024-09-13T17:13:57.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.191+0000 7fdc4ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56305029f650 0x5630502adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.191+0000 7fdc4ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56305029f650 0x5630502adea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42112/0 (socket says 172.21.15.87:42112) 2024-09-13T17:13:57.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.191+0000 7fdc4ffff640 1 -- 172.21.15.87:0/2740805507 learned_addr learned my addr 172.21.15.87:0/2740805507 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:57.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.191+0000 7fdc4f7fe640 1 --2- 172.21.15.87:0/2740805507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5630502ae3e0 0x5630502b07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.191+0000 7fdc4f7fe640 1 --2- 172.21.15.87:0/2740805507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56305029ed30 0x56305029f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.191+0000 7fdc4ffff640 1 -- 172.21.15.87:0/2740805507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56305029ed30 msgr2=0x56305029f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:57.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.191+0000 7fdc4ffff640 1 --2- 172.21.15.87:0/2740805507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56305029ed30 0x56305029f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.191+0000 7fdc4d7fa640 1 --2- 172.21.15.87:0/2586826806 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdc380a1310 0x7fdc380a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.191+0000 7fdc4ffff640 1 -- 172.21.15.87:0/2740805507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5630502ae3e0 msgr2=0x5630502b07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:57.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.191+0000 7fdc4ffff640 1 --2- 172.21.15.87:0/2740805507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5630502ae3e0 0x5630502b07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.191+0000 7fdc4ffff640 1 -- 172.21.15.87:0/2740805507 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630501bd840 con 0x56305029f650 2024-09-13T17:13:57.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.191+0000 7fdc4f7fe640 1 --2- 172.21.15.87:0/2740805507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5630502ae3e0 0x5630502b07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:57.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.191+0000 7fdc54c5b640 1 --2- 172.21.15.87:0/2586826806 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdc380a1310 0x7fdc380a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.191+0000 7fdc4ffff640 1 --2- 172.21.15.87:0/2740805507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56305029f650 0x5630502adea0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fdc4002a9a0 tx=0x7fdc40005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d31d60be8f02db9b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:57.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.191+0000 7fdc4d7fa640 1 -- 172.21.15.87:0/2586826806 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fdc480cd400 con 0x7fdc5010a330 2024-09-13T17:13:57.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.192+0000 7fdc367fc640 1 -- 172.21.15.87:0/2740805507 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40031bf0 con 0x56305029f650 2024-09-13T17:13:57.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.192+0000 7fdc367fc640 1 -- 172.21.15.87:0/2740805507 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdc40031800 con 0x56305029f650 2024-09-13T17:13:57.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.192+0000 7fdc367fc640 1 -- 172.21.15.87:0/2740805507 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc400046c0 con 0x56305029f650 2024-09-13T17:13:57.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.192+0000 7fdc593e0740 1 -- 172.21.15.87:0/2740805507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56305029f650 msgr2=0x5630502adea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.192+0000 7fdc54c5b640 1 --2- 172.21.15.87:0/2586826806 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdc380a1310 0x7fdc380a37d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdc480ca740 tx=0x7fdc4806d180 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:57.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.192+0000 7fdc593e0740 1 --2- 172.21.15.87:0/2740805507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56305029f650 0x5630502adea0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fdc4002a9a0 tx=0x7fdc40005e80 comp rx=0 tx=0).stop 2024-09-13T17:13:57.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.192+0000 7fdc593e0740 1 -- 172.21.15.87:0/2740805507 shutdown_connections 2024-09-13T17:13:57.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.192+0000 7fdc593e0740 1 --2- 172.21.15.87:0/2740805507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5630502ae3e0 0x5630502b07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.192+0000 7fdc593e0740 1 --2- 172.21.15.87:0/2740805507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56305029f650 0x5630502adea0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.192+0000 7fdc593e0740 1 --2- 172.21.15.87:0/2740805507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56305029ed30 0x56305029f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.192+0000 7fdc593e0740 1 -- 172.21.15.87:0/2740805507 >> 172.21.15.87:0/2740805507 conn(0x56305029b380 msgr2=0x56305029b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:57.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.192+0000 7fdc593e0740 1 -- 172.21.15.87:0/2740805507 shutdown_connections 2024-09-13T17:13:57.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.192+0000 7fdc593e0740 1 -- 172.21.15.87:0/2740805507 wait complete. 2024-09-13T17:13:57.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.193+0000 7fdc593e0740 1 -- start start 2024-09-13T17:13:57.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.193+0000 7fdc593e0740 1 Processor -- start 2024-09-13T17:13:57.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.193+0000 7fdc593e0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56305029ed30 0x5630502add50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.193+0000 7fdc593e0740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56305029f650 0x5630502aaf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.193+0000 7fdc593e0740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5630502ae3e0 0x5630502ab4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.193+0000 7fdc593e0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630501a42a0 con 0x56305029ed30 2024-09-13T17:13:57.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.193+0000 7fdc593e0740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56304fedb430 con 0x56305029f650 2024-09-13T17:13:57.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.193+0000 7fdc593e0740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x563050186680 con 0x5630502ae3e0 2024-09-13T17:13:57.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.193+0000 7fdc593e0740 10 client.0 _ll_register_callbacks cb 0x5630501fc610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:13:57.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.193+0000 7fdc4f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56305029ed30 0x5630502add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.193+0000 7fdc4f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56305029ed30 0x5630502add50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42116/0 (socket says 172.21.15.87:42116) 2024-09-13T17:13:57.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.193+0000 7fdc4f7fe640 1 -- 172.21.15.87:0/1983932220 learned_addr learned my addr 172.21.15.87:0/1983932220 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:57.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.193+0000 7fdc4f7fe640 1 --2- 172.21.15.87:0/1983932220 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5630502ae3e0 0x5630502ab4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.194+0000 7fdc4f7fe640 1 -- 172.21.15.87:0/1983932220 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5630502ae3e0 msgr2=0x5630502ab4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:57.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.194+0000 7fdc4f7fe640 1 --2- 172.21.15.87:0/1983932220 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5630502ae3e0 0x5630502ab4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.194+0000 7fdc4f7fe640 1 -- 172.21.15.87:0/1983932220 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56305029f650 msgr2=0x5630502aaf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:57.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.194+0000 7fdc4f7fe640 1 --2- 172.21.15.87:0/1983932220 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56305029f650 0x5630502aaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.194+0000 7fdc4f7fe640 1 -- 172.21.15.87:0/1983932220 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc5010d420 con 0x56305029ed30 2024-09-13T17:13:57.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.194+0000 7fdc4f7fe640 1 --2- 172.21.15.87:0/1983932220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56305029ed30 0x5630502add50 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fdc4400ee90 tx=0x7fdc44015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4672ce791cd8e8d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:57.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.194+0000 7fdc2f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:13:57.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.194+0000 7fdc2f7fe640 1 -- 172.21.15.87:0/1983932220 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc44018070 con 0x56305029ed30 2024-09-13T17:13:57.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.194+0000 7fdc2f7fe640 1 -- 172.21.15.87:0/1983932220 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fdc44005020 con 0x56305029ed30 2024-09-13T17:13:57.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.194+0000 7fdc593e0740 1 -- 172.21.15.87:0/1983932220 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56304fef64e0 con 0x56305029ed30 2024-09-13T17:13:57.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.194+0000 7fdc2f7fe640 1 -- 172.21.15.87:0/1983932220 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc440053f0 con 0x56305029ed30 2024-09-13T17:13:57.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.194+0000 7fdc593e0740 10 client.15729 fetch_fsmap learned FSMap version 24 2024-09-13T17:13:57.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.194+0000 7fdc593e0740 1 -- 172.21.15.87:0/1983932220 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x563050201620 con 0x56305029ed30 2024-09-13T17:13:57.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.194+0000 7fdc2f7fe640 1 -- 172.21.15.87:0/1983932220 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x56304fef64e0 con 0x56305029ed30 2024-09-13T17:13:57.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.194+0000 7fdc2f7fe640 1 -- 172.21.15.87:0/1983932220 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fdc4401f5b0 con 0x56305029ed30 2024-09-13T17:13:57.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.194+0000 7fdc593e0740 10 client.15729 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:13:57.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.194+0000 7fdc593e0740 10 client.15729 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:13:57.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.194+0000 7fdc593e0740 20 client.15729 populate_metadata read hostname 'smithi087' 2024-09-13T17:13:57.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.194+0000 7fdc593e0740 1 --2- 172.21.15.87:0/1983932220 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5630502be150 0x5630502c0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.194+0000 7fdc593e0740 4 client.15729 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:13:57.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.194+0000 7fdc593e0740 1 -- 172.21.15.87:0/1983932220 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56304ff077e0 con 0x5630502be150 2024-09-13T17:13:57.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.195+0000 7fdc4ffff640 1 --2- 172.21.15.87:0/1983932220 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5630502be150 0x5630502c0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.195+0000 7fdc2f7fe640 10 client.15729 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:13:57.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.195+0000 7fdc4ffff640 1 --2- 172.21.15.87:0/1983932220 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5630502be150 0x5630502c0570 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c2fd95c82118594 server_cookie=f4c8e4448ee4d686 in_seq=0 out_seq=0 2024-09-13T17:13:57.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.196+0000 7fdc2f7fe640 1 -- 172.21.15.87:0/1983932220 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x56304ff077e0 con 0x5630502be150 2024-09-13T17:13:57.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.196+0000 7fdc2f7fe640 10 client.15729 handle_command_reply: tid=0 2024-09-13T17:13:57.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.196+0000 7fdc593e0740 1 client.15729 shutdown 2024-09-13T17:13:57.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.196+0000 7fdc593e0740 1 -- 172.21.15.87:0/1983932220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56305029ed30 msgr2=0x5630502add50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.196+0000 7fdc593e0740 1 --2- 172.21.15.87:0/1983932220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56305029ed30 0x5630502add50 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fdc4400ee90 tx=0x7fdc44015040 comp rx=0 tx=0).stop 2024-09-13T17:13:57.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.196+0000 7fdc593e0740 1 -- 172.21.15.87:0/1983932220 shutdown_connections 2024-09-13T17:13:57.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.196+0000 7fdc593e0740 1 --2- 172.21.15.87:0/1983932220 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5630502be150 0x5630502c0570 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.196+0000 7fdc593e0740 1 --2- 172.21.15.87:0/1983932220 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5630502ae3e0 0x5630502ab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.196+0000 7fdc593e0740 1 --2- 172.21.15.87:0/1983932220 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56305029f650 0x5630502aaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.196+0000 7fdc2f7fe640 0 client.15729 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:13:57.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.196+0000 7fdc593e0740 1 --2- 172.21.15.87:0/1983932220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56305029ed30 0x5630502add50 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.196+0000 7fdc593e0740 1 -- 172.21.15.87:0/1983932220 >> 172.21.15.87:0/1983932220 conn(0x56305029b380 msgr2=0x5630502a1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:57.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.196+0000 7fdc593e0740 1 -- 172.21.15.87:0/1983932220 shutdown_connections 2024-09-13T17:13:57.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.196+0000 7fdc593e0740 1 -- 172.21.15.87:0/1983932220 wait complete. 2024-09-13T17:13:57.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.196+0000 7fdc593e0740 20 client.15729 trim_cache size 0 max 16384 2024-09-13T17:13:57.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.210+0000 7fdc593e0740 1 Processor -- start 2024-09-13T17:13:57.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.210+0000 7fdc593e0740 1 -- start start 2024-09-13T17:13:57.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.210+0000 7fdc593e0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56305029ed30 0x5630502ad860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.210+0000 7fdc593e0740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56305029f650 0x5630502b5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.210+0000 7fdc593e0740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5630502ae3e0 0x5630502b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.210+0000 7fdc593e0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630502bca30 con 0x56305029ed30 2024-09-13T17:13:57.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.210+0000 7fdc593e0740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56305029c510 con 0x5630502ae3e0 2024-09-13T17:13:57.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.210+0000 7fdc593e0740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630502c57c0 con 0x56305029f650 2024-09-13T17:13:57.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.210+0000 7fdc4f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56305029ed30 0x5630502ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.210+0000 7fdc4f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56305029ed30 0x5630502ad860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42120/0 (socket says 172.21.15.87:42120) 2024-09-13T17:13:57.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.210+0000 7fdc4f7fe640 1 -- 172.21.15.87:0/84592769 learned_addr learned my addr 172.21.15.87:0/84592769 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:57.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.211+0000 7fdc4f7fe640 1 -- 172.21.15.87:0/84592769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56305029f650 msgr2=0x5630502b5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:57.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.211+0000 7fdc4f7fe640 1 --2- 172.21.15.87:0/84592769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56305029f650 0x5630502b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.211+0000 7fdc4f7fe640 1 -- 172.21.15.87:0/84592769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5630502ae3e0 msgr2=0x5630502b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:57.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.211+0000 7fdc4f7fe640 1 --2- 172.21.15.87:0/84592769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5630502ae3e0 0x5630502b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.211+0000 7fdc4f7fe640 1 -- 172.21.15.87:0/84592769 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630501a3790 con 0x56305029ed30 2024-09-13T17:13:57.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.211+0000 7fdc4f7fe640 1 --2- 172.21.15.87:0/84592769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56305029ed30 0x5630502ad860 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fdc4400e3d0 tx=0x7fdc4400e460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d4f106fae800f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:57.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.211+0000 7fdc36ffd640 1 -- 172.21.15.87:0/84592769 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc44018070 con 0x56305029ed30 2024-09-13T17:13:57.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.211+0000 7fdc36ffd640 1 -- 172.21.15.87:0/84592769 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdc44019040 con 0x56305029ed30 2024-09-13T17:13:57.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.211+0000 7fdc36ffd640 1 -- 172.21.15.87:0/84592769 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc44005650 con 0x56305029ed30 2024-09-13T17:13:57.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.212+0000 7fdc593e0740 1 -- 172.21.15.87:0/84592769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56305029ed30 msgr2=0x5630502ad860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.212+0000 7fdc593e0740 1 --2- 172.21.15.87:0/84592769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56305029ed30 0x5630502ad860 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fdc4400e3d0 tx=0x7fdc4400e460 comp rx=0 tx=0).stop 2024-09-13T17:13:57.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.212+0000 7fdc593e0740 1 -- 172.21.15.87:0/84592769 shutdown_connections 2024-09-13T17:13:57.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.212+0000 7fdc593e0740 1 --2- 172.21.15.87:0/84592769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5630502ae3e0 0x5630502b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.212+0000 7fdc593e0740 1 --2- 172.21.15.87:0/84592769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56305029f650 0x5630502b5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.212+0000 7fdc593e0740 1 --2- 172.21.15.87:0/84592769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56305029ed30 0x5630502ad860 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.212+0000 7fdc593e0740 1 -- 172.21.15.87:0/84592769 >> 172.21.15.87:0/84592769 conn(0x56305029b380 msgr2=0x5630502aaf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:57.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.212+0000 7fdc593e0740 1 -- 172.21.15.87:0/84592769 shutdown_connections 2024-09-13T17:13:57.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.212+0000 7fdc593e0740 1 -- 172.21.15.87:0/84592769 wait complete. 2024-09-13T17:13:57.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.212+0000 7fdc593e0740 1 -- start start 2024-09-13T17:13:57.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.212+0000 7fdc593e0740 1 Processor -- start 2024-09-13T17:13:57.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.212+0000 7fdc593e0740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56305029ed30 0x5630502b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.212+0000 7fdc593e0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56305029f650 0x5630502b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.212+0000 7fdc593e0740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5630502ae3e0 0x5630502b3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.212+0000 7fdc593e0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630502b3ae0 con 0x56305029f650 2024-09-13T17:13:57.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.212+0000 7fdc593e0740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630502b3c50 con 0x56305029ed30 2024-09-13T17:13:57.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.212+0000 7fdc593e0740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630502b3e10 con 0x5630502ae3e0 2024-09-13T17:13:57.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.212+0000 7fdc593e0740 10 client.0 _ll_register_callbacks cb 0x7fdc4400e950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:13:57.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.212+0000 7fdc4ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56305029f650 0x5630502b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.213+0000 7fdc4ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56305029f650 0x5630502b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42126/0 (socket says 172.21.15.87:42126) 2024-09-13T17:13:57.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.213+0000 7fdc4ffff640 1 -- 172.21.15.87:0/4218526281 learned_addr learned my addr 172.21.15.87:0/4218526281 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:57.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.213+0000 7fdc4f7fe640 1 --2- 172.21.15.87:0/4218526281 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5630502ae3e0 0x5630502b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.213+0000 7fdc4f7fe640 1 --2- 172.21.15.87:0/4218526281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56305029ed30 0x5630502b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.213+0000 7fdc4ffff640 1 -- 172.21.15.87:0/4218526281 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5630502ae3e0 msgr2=0x5630502b3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:57.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.213+0000 7fdc4ffff640 1 --2- 172.21.15.87:0/4218526281 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5630502ae3e0 0x5630502b3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.213+0000 7fdc4ffff640 1 -- 172.21.15.87:0/4218526281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56305029ed30 msgr2=0x5630502b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:13:57.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.213+0000 7fdc4ffff640 1 --2- 172.21.15.87:0/4218526281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56305029ed30 0x5630502b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.213+0000 7fdc4ffff640 1 -- 172.21.15.87:0/4218526281 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563050201620 con 0x56305029f650 2024-09-13T17:13:57.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.213+0000 7fdc4f7fe640 1 --2- 172.21.15.87:0/4218526281 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5630502ae3e0 0x5630502b3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:13:57.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.213+0000 7fdc4ffff640 1 --2- 172.21.15.87:0/4218526281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56305029f650 0x5630502b5450 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fdc400057c0 tx=0x7fdc400055c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6f8c664317c965 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:57.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.213+0000 7fdc2f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:13:57.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.213+0000 7fdc2f7fe640 1 -- 172.21.15.87:0/4218526281 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40049040 con 0x56305029f650 2024-09-13T17:13:57.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.213+0000 7fdc2f7fe640 1 -- 172.21.15.87:0/4218526281 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fdc40004040 con 0x56305029f650 2024-09-13T17:13:57.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.213+0000 7fdc593e0740 1 -- 172.21.15.87:0/4218526281 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdc40031800 con 0x56305029f650 2024-09-13T17:13:57.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.213+0000 7fdc2f7fe640 1 -- 172.21.15.87:0/4218526281 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc40004200 con 0x56305029f650 2024-09-13T17:13:57.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.213+0000 7fdc593e0740 10 client.15735 fetch_fsmap learned FSMap version 24 2024-09-13T17:13:57.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.213+0000 7fdc593e0740 1 -- 172.21.15.87:0/4218526281 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5630501c8ea0 con 0x56305029f650 2024-09-13T17:13:57.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.213+0000 7fdc2f7fe640 1 -- 172.21.15.87:0/4218526281 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdc40031800 con 0x56305029f650 2024-09-13T17:13:57.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.214+0000 7fdc2f7fe640 1 -- 172.21.15.87:0/4218526281 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fdc40050020 con 0x56305029f650 2024-09-13T17:13:57.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.214+0000 7fdc593e0740 10 client.15735 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:13:57.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.214+0000 7fdc593e0740 10 client.15735 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:13:57.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.214+0000 7fdc593e0740 20 client.15735 populate_metadata read hostname 'smithi087' 2024-09-13T17:13:57.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.214+0000 7fdc593e0740 1 --2- 172.21.15.87:0/4218526281 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5630502be150 0x5630503174a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.214+0000 7fdc593e0740 4 client.15735 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:13:57.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.214+0000 7fdc593e0740 1 -- 172.21.15.87:0/4218526281 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56304ff5ae30 con 0x5630502be150 2024-09-13T17:13:57.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.214+0000 7fdc4f7fe640 1 --2- 172.21.15.87:0/4218526281 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5630502be150 0x5630503174a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.214+0000 7fdc4f7fe640 1 --2- 172.21.15.87:0/4218526281 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5630502be150 0x5630503174a0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=849099ded08ba956 server_cookie=218727b55a63bf02 in_seq=0 out_seq=0 2024-09-13T17:13:57.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.214+0000 7fdc2f7fe640 10 client.15735 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:13:57.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.215+0000 7fdc2f7fe640 1 -- 172.21.15.87:0/4218526281 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x56304ff5ae30 con 0x5630502be150 2024-09-13T17:13:57.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.215+0000 7fdc2f7fe640 10 client.15735 handle_command_reply: tid=0 2024-09-13T17:13:57.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.215+0000 7fdc593e0740 1 client.15735 shutdown 2024-09-13T17:13:57.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.215+0000 7fdc593e0740 1 -- 172.21.15.87:0/4218526281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56305029f650 msgr2=0x5630502b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.215+0000 7fdc593e0740 1 --2- 172.21.15.87:0/4218526281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56305029f650 0x5630502b5450 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fdc400057c0 tx=0x7fdc400055c0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.215+0000 7fdc593e0740 1 -- 172.21.15.87:0/4218526281 shutdown_connections 2024-09-13T17:13:57.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.215+0000 7fdc593e0740 1 --2- 172.21.15.87:0/4218526281 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5630502be150 0x5630503174a0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.215+0000 7fdc593e0740 1 --2- 172.21.15.87:0/4218526281 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5630502ae3e0 0x5630502b3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.215+0000 7fdc2f7fe640 0 client.15735 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:13:57.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.215+0000 7fdc593e0740 1 --2- 172.21.15.87:0/4218526281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56305029f650 0x5630502b5450 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.215+0000 7fdc593e0740 1 --2- 172.21.15.87:0/4218526281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56305029ed30 0x5630502b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.215+0000 7fdc593e0740 1 -- 172.21.15.87:0/4218526281 >> 172.21.15.87:0/4218526281 conn(0x56305029b380 msgr2=0x5630502a97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:57.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.215+0000 7fdc593e0740 1 -- 172.21.15.87:0/4218526281 shutdown_connections 2024-09-13T17:13:57.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.215+0000 7fdc593e0740 1 -- 172.21.15.87:0/4218526281 wait complete. 2024-09-13T17:13:57.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.215+0000 7fdc593e0740 20 client.15735 trim_cache size 0 max 16384 2024-09-13T17:13:57.223 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:13:57.223 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-13T17:13:57.223 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": { 2024-09-13T17:13:57.223 INFO:teuthology.orchestra.run.smithi087.stdout: "473f1b09-2716-4571-b115-bac8cfdc2e80": { 2024-09-13T17:13:57.223 INFO:teuthology.orchestra.run.smithi087.stdout: "path": "/", 2024-09-13T17:13:57.223 INFO:teuthology.orchestra.run.smithi087.stdout: "tag": "473f1b09-2716-4571-b115-bac8cfdc2e80", 2024-09-13T17:13:57.223 INFO:teuthology.orchestra.run.smithi087.stdout: "options": "recursive,force" 2024-09-13T17:13:57.224 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:13:57.224 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:13:57.224 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:13:57.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.215+0000 7fdc566be640 1 -- 172.21.15.87:0/2586826806 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdc380a1310 msgr2=0x7fdc380a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.215+0000 7fdc566be640 1 --2- 172.21.15.87:0/2586826806 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdc380a1310 0x7fdc380a37d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdc480ca740 tx=0x7fdc4806d180 comp rx=0 tx=0).stop 2024-09-13T17:13:57.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.215+0000 7fdc566be640 1 -- 172.21.15.87:0/2586826806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc5010a330 msgr2=0x7fdc5019ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.215+0000 7fdc566be640 1 --2- 172.21.15.87:0/2586826806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc5010a330 0x7fdc5019ab40 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fdc4800e960 tx=0x7fdc4800ee20 comp rx=0 tx=0).stop 2024-09-13T17:13:57.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.216+0000 7fdc566be640 1 -- 172.21.15.87:0/2586826806 shutdown_connections 2024-09-13T17:13:57.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.216+0000 7fdc566be640 1 --2- 172.21.15.87:0/2586826806 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdc380a1310 0x7fdc380a37d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.216+0000 7fdc566be640 1 --2- 172.21.15.87:0/2586826806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc5010a330 0x7fdc5019ab40 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.216+0000 7fdc566be640 1 --2- 172.21.15.87:0/2586826806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc50101880 0x7fdc50196750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.216+0000 7fdc566be640 1 --2- 172.21.15.87:0/2586826806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc50100f60 0x7fdc50196210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.216+0000 7fdc566be640 1 -- 172.21.15.87:0/2586826806 >> 172.21.15.87:0/2586826806 conn(0x7fdc50075c60 msgr2=0x7fdc500fb4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:57.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.216+0000 7fdc566be640 1 -- 172.21.15.87:0/2586826806 shutdown_connections 2024-09-13T17:13:57.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.216+0000 7fdc566be640 1 -- 172.21.15.87:0/2586826806 wait complete. 2024-09-13T17:13:57.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.224+0000 7f5889ab7640 1 -- 172.21.15.87:0/2793317904 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) v1 -- 0x7f58840fe570 con 0x7f58840681d0 2024-09-13T17:13:57.228 INFO:tasks.cephfs.filesystem:scrub status for tag:473f1b09-2716-4571-b115-bac8cfdc2e80 - {'path': '/', 'tag': '473f1b09-2716-4571-b115-bac8cfdc2e80', 'options': 'recursive,force'} 2024-09-13T17:13:57.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.229+0000 7f5880ff9640 1 -- 172.21.15.87:0/2793317904 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v31)=0 v31) v1 ==== 129+0+0 (secure 0 0 0) 0x7f586c0990e0 con 0x7f58840681d0 2024-09-13T17:13:57.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.231+0000 7f5889ab7640 1 -- 172.21.15.87:0/2793317904 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f58700a1290 msgr2=0x7f58700a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.231+0000 7f5889ab7640 1 --2- 172.21.15.87:0/2793317904 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f58700a1290 0x7f58700a3750 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5874000f80 tx=0x7f5874004a60 comp rx=0 tx=0).stop 2024-09-13T17:13:57.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.231+0000 7f5889ab7640 1 -- 172.21.15.87:0/2793317904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58840681d0 msgr2=0x7f5884198ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.231+0000 7f5889ab7640 1 --2- 172.21.15.87:0/2793317904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58840681d0 0x7f5884198ab0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f586c00d950 tx=0x7f586c00de10 comp rx=0 tx=0).stop 2024-09-13T17:13:57.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.231+0000 7f5889ab7640 1 -- 172.21.15.87:0/2793317904 shutdown_connections 2024-09-13T17:13:57.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.231+0000 7f5889ab7640 1 --2- 172.21.15.87:0/2793317904 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5884104ce0 0x7f588419cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.231+0000 7f5889ab7640 1 --2- 172.21.15.87:0/2793317904 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f58700a1290 0x7f58700a3750 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.231+0000 7f5889ab7640 1 --2- 172.21.15.87:0/2793317904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58840681d0 0x7f5884198ab0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.231+0000 7f5889ab7640 1 --2- 172.21.15.87:0/2793317904 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5884067830 0x7f5884198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.231+0000 7f5889ab7640 1 -- 172.21.15.87:0/2793317904 >> 172.21.15.87:0/2793317904 conn(0x7f5884074940 msgr2=0x7f588410b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:57.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.231+0000 7f5889ab7640 1 -- 172.21.15.87:0/2793317904 shutdown_connections 2024-09-13T17:13:57.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.231+0000 7f5889ab7640 1 -- 172.21.15.87:0/2793317904 wait complete. 2024-09-13T17:13:57.245 DEBUG:teuthology.orchestra.run.smithi087:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-09-13T17:13:57.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.382+0000 7f843c525640 1 -- 172.21.15.87:0/500277028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84340fe9f0 msgr2=0x7f84340fedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.382+0000 7f843c525640 1 --2- 172.21.15.87:0/500277028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84340fe9f0 0x7f84340fedd0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f8430009930 tx=0x7f843002a420 comp rx=0 tx=0).stop 2024-09-13T17:13:57.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.382+0000 7f843c525640 1 -- 172.21.15.87:0/500277028 shutdown_connections 2024-09-13T17:13:57.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.382+0000 7f843c525640 1 --2- 172.21.15.87:0/500277028 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8434106240 0x7f843410cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.382+0000 7f843c525640 1 --2- 172.21.15.87:0/500277028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84340ff3a0 0x7f8434105ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.382+0000 7f843c525640 1 --2- 172.21.15.87:0/500277028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84340fe9f0 0x7f84340fedd0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.382+0000 7f843c525640 1 -- 172.21.15.87:0/500277028 >> 172.21.15.87:0/500277028 conn(0x7f8434075170 msgr2=0x7f8434075580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:57.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.382+0000 7f843c525640 1 -- 172.21.15.87:0/500277028 shutdown_connections 2024-09-13T17:13:57.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.382+0000 7f843c525640 1 -- 172.21.15.87:0/500277028 wait complete. 2024-09-13T17:13:57.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.383+0000 7f843c525640 1 Processor -- start 2024-09-13T17:13:57.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.383+0000 7f843c525640 1 -- start start 2024-09-13T17:13:57.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.383+0000 7f843c525640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84340fe9f0 0x7f8434196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.383+0000 7f843c525640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8434106240 0x7f84341967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.383+0000 7f843c525640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f843419abc0 0x7f843419b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.383+0000 7f843c525640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843419b5b0 con 0x7f843419abc0 2024-09-13T17:13:57.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.383+0000 7f843c525640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843419b720 con 0x7f8434106240 2024-09-13T17:13:57.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.383+0000 7f843c525640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843419b890 con 0x7f84340fe9f0 2024-09-13T17:13:57.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.383+0000 7f843aac2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f843419abc0 0x7f843419b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.383+0000 7f843aac2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f843419abc0 0x7f843419b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42134/0 (socket says 172.21.15.87:42134) 2024-09-13T17:13:57.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.383+0000 7f843aac2640 1 -- 172.21.15.87:0/1325115783 learned_addr learned my addr 172.21.15.87:0/1325115783 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:57.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.383+0000 7f843a2c1640 1 --2- 172.21.15.87:0/1325115783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84340fe9f0 0x7f8434196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.383+0000 7f8439ac0640 1 --2- 172.21.15.87:0/1325115783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8434106240 0x7f84341967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.383+0000 7f843aac2640 1 -- 172.21.15.87:0/1325115783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84340fe9f0 msgr2=0x7f8434196290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.383+0000 7f843aac2640 1 --2- 172.21.15.87:0/1325115783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84340fe9f0 0x7f8434196290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.383+0000 7f843aac2640 1 -- 172.21.15.87:0/1325115783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8434106240 msgr2=0x7f84341967d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.383+0000 7f843aac2640 1 --2- 172.21.15.87:0/1325115783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8434106240 0x7f84341967d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.383+0000 7f843aac2640 1 -- 172.21.15.87:0/1325115783 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8430009560 con 0x7f843419abc0 2024-09-13T17:13:57.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.383+0000 7f843aac2640 1 --2- 172.21.15.87:0/1325115783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f843419abc0 0x7f843419b070 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f842c00cad0 tx=0x7f842c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:57.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.383+0000 7f842b7fe640 1 -- 172.21.15.87:0/1325115783 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c00ae20 con 0x7f843419abc0 2024-09-13T17:13:57.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.383+0000 7f843c525640 1 -- 172.21.15.87:0/1325115783 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84341a2e70 con 0x7f843419abc0 2024-09-13T17:13:57.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.384+0000 7f842b7fe640 1 -- 172.21.15.87:0/1325115783 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f842c005020 con 0x7f843419abc0 2024-09-13T17:13:57.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.384+0000 7f842b7fe640 1 -- 172.21.15.87:0/1325115783 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c00f690 con 0x7f843419abc0 2024-09-13T17:13:57.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.384+0000 7f843c525640 1 -- 172.21.15.87:0/1325115783 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84341a32f0 con 0x7f843419abc0 2024-09-13T17:13:57.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.384+0000 7f843c525640 1 -- 172.21.15.87:0/1325115783 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8434067ef0 con 0x7f843419abc0 2024-09-13T17:13:57.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.386+0000 7f842b7fe640 1 -- 172.21.15.87:0/1325115783 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 24) v1 ==== 136049+0+0 (secure 0 0 0) 0x7f842c005190 con 0x7f843419abc0 2024-09-13T17:13:57.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.386+0000 7f842b7fe640 1 --2- 172.21.15.87:0/1325115783 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f84200a1290 0x7f84200a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.386+0000 7f843a2c1640 1 --2- 172.21.15.87:0/1325115783 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f84200a1290 0x7f84200a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.386+0000 7f842b7fe640 1 -- 172.21.15.87:0/1325115783 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f842c0cd270 con 0x7f843419abc0 2024-09-13T17:13:57.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.387+0000 7f843a2c1640 1 --2- 172.21.15.87:0/1325115783 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f84200a1290 0x7f84200a3750 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f84300057c0 tx=0x7f8430000bc0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:57.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.390+0000 7f842b7fe640 1 -- 172.21.15.87:0/1325115783 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f842c0961a0 con 0x7f843419abc0 2024-09-13T17:13:57.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:57 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1141404074' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:13:57.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:57 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/606810231' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:13:57.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:57 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2793317904' entity='client.admin' 2024-09-13T17:13:57.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:57 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:13:57.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:57 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:13:57.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:57 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:13:57.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:57 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:57.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.557+0000 7f843c525640 1 -- 172.21.15.87:0/1325115783 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f8434197660 con 0x7f843419abc0 2024-09-13T17:13:57.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.564+0000 7f842b7fe640 1 -- 172.21.15.87:0/1325115783 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v32)=0 v32) v1 ==== 138+0+0 (secure 0 0 0) 0x7f842c01d0d0 con 0x7f843419abc0 2024-09-13T17:13:57.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.566+0000 7f843c525640 1 -- 172.21.15.87:0/1325115783 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f84200a1290 msgr2=0x7f84200a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.566+0000 7f843c525640 1 --2- 172.21.15.87:0/1325115783 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f84200a1290 0x7f84200a3750 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f84300057c0 tx=0x7f8430000bc0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.566+0000 7f843c525640 1 -- 172.21.15.87:0/1325115783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f843419abc0 msgr2=0x7f843419b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.566+0000 7f843c525640 1 --2- 172.21.15.87:0/1325115783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f843419abc0 0x7f843419b070 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f842c00cad0 tx=0x7f842c00cf90 comp rx=0 tx=0).stop 2024-09-13T17:13:57.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.566+0000 7f843c525640 1 -- 172.21.15.87:0/1325115783 shutdown_connections 2024-09-13T17:13:57.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.566+0000 7f843c525640 1 --2- 172.21.15.87:0/1325115783 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f84200a1290 0x7f84200a3750 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.566+0000 7f843c525640 1 --2- 172.21.15.87:0/1325115783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f843419abc0 0x7f843419b070 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.566+0000 7f843c525640 1 --2- 172.21.15.87:0/1325115783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8434106240 0x7f84341967d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.566+0000 7f843c525640 1 --2- 172.21.15.87:0/1325115783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84340fe9f0 0x7f8434196290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.566+0000 7f843c525640 1 -- 172.21.15.87:0/1325115783 >> 172.21.15.87:0/1325115783 conn(0x7f8434075170 msgr2=0x7f8434103d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:57.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.566+0000 7f843c525640 1 -- 172.21.15.87:0/1325115783 shutdown_connections 2024-09-13T17:13:57.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.566+0000 7f843c525640 1 -- 172.21.15.87:0/1325115783 wait complete. 2024-09-13T17:13:57.579 DEBUG:teuthology.orchestra.run.smithi087:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-09-13T17:13:57.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.679+0000 7f867a432640 1 -- 172.21.15.87:0/2712074841 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86741008c0 msgr2=0x7f8674104900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.679+0000 7f867a432640 1 --2- 172.21.15.87:0/2712074841 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86741008c0 0x7f8674104900 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f865c009930 tx=0x7f865c02a420 comp rx=0 tx=0).stop 2024-09-13T17:13:57.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.679+0000 7f867a432640 1 -- 172.21.15.87:0/2712074841 shutdown_connections 2024-09-13T17:13:57.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.679+0000 7f867a432640 1 --2- 172.21.15.87:0/2712074841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8674105060 0x7f867410cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.679+0000 7f867a432640 1 --2- 172.21.15.87:0/2712074841 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86741008c0 0x7f8674104900 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.679+0000 7f867a432640 1 --2- 172.21.15.87:0/2712074841 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86740fff10 0x7f86741002f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.679+0000 7f867a432640 1 -- 172.21.15.87:0/2712074841 >> 172.21.15.87:0/2712074841 conn(0x7f86740fb9a0 msgr2=0x7f86740fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:57.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.679+0000 7f867a432640 1 -- 172.21.15.87:0/2712074841 shutdown_connections 2024-09-13T17:13:57.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.679+0000 7f867a432640 1 -- 172.21.15.87:0/2712074841 wait complete. 2024-09-13T17:13:57.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.679+0000 7f867a432640 1 Processor -- start 2024-09-13T17:13:57.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.680+0000 7f867a432640 1 -- start start 2024-09-13T17:13:57.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.680+0000 7f867a432640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86740fff10 0x7f8674196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.680+0000 7f867a432640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8674105060 0x7f86741967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.680+0000 7f867a432640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f867419ab90 0x7f867419b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.680+0000 7f867a432640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867419b580 con 0x7f8674105060 2024-09-13T17:13:57.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.680+0000 7f867a432640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867419b6f0 con 0x7f867419ab90 2024-09-13T17:13:57.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.680+0000 7f867a432640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867419b860 con 0x7f86740fff10 2024-09-13T17:13:57.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.680+0000 7f866bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8674105060 0x7f86741967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.680+0000 7f866bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8674105060 0x7f86741967a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42154/0 (socket says 172.21.15.87:42154) 2024-09-13T17:13:57.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.680+0000 7f86789cf640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f867419ab90 0x7f867419b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.680+0000 7f866bfff640 1 -- 172.21.15.87:0/616531008 learned_addr learned my addr 172.21.15.87:0/616531008 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:57.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.680+0000 7f8673fff640 1 --2- 172.21.15.87:0/616531008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86740fff10 0x7f8674196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.680+0000 7f866bfff640 1 -- 172.21.15.87:0/616531008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86740fff10 msgr2=0x7f8674196260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.680+0000 7f866bfff640 1 --2- 172.21.15.87:0/616531008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86740fff10 0x7f8674196260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.680+0000 7f866bfff640 1 -- 172.21.15.87:0/616531008 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f867419ab90 msgr2=0x7f867419b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.680+0000 7f866bfff640 1 --2- 172.21.15.87:0/616531008 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f867419ab90 0x7f867419b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.680+0000 7f866bfff640 1 -- 172.21.15.87:0/616531008 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865c009560 con 0x7f8674105060 2024-09-13T17:13:57.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.680+0000 7f866bfff640 1 --2- 172.21.15.87:0/616531008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8674105060 0x7f86741967a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f865c009900 tx=0x7f865c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:57.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.681+0000 7f8671ffb640 1 -- 172.21.15.87:0/616531008 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c0037f0 con 0x7f8674105060 2024-09-13T17:13:57.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.681+0000 7f867a432640 1 -- 172.21.15.87:0/616531008 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86741a2e40 con 0x7f8674105060 2024-09-13T17:13:57.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.681+0000 7f8671ffb640 1 -- 172.21.15.87:0/616531008 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f865c0044c0 con 0x7f8674105060 2024-09-13T17:13:57.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.681+0000 7f8671ffb640 1 -- 172.21.15.87:0/616531008 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c03bdd0 con 0x7f8674105060 2024-09-13T17:13:57.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.681+0000 7f867a432640 1 -- 172.21.15.87:0/616531008 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86741a3200 con 0x7f8674105060 2024-09-13T17:13:57.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.682+0000 7f867a432640 1 -- 172.21.15.87:0/616531008 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86741013e0 con 0x7f8674105060 2024-09-13T17:13:57.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.683+0000 7f8671ffb640 1 -- 172.21.15.87:0/616531008 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 24) v1 ==== 136049+0+0 (secure 0 0 0) 0x7f865c03b560 con 0x7f8674105060 2024-09-13T17:13:57.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.683+0000 7f8671ffb640 1 --2- 172.21.15.87:0/616531008 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f86600a1290 0x7f86600a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.683+0000 7f8671ffb640 1 -- 172.21.15.87:0/616531008 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f865c0ee0b0 con 0x7f8674105060 2024-09-13T17:13:57.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.683+0000 7f8673fff640 1 --2- 172.21.15.87:0/616531008 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f86600a1290 0x7f86600a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.684+0000 7f8673fff640 1 --2- 172.21.15.87:0/616531008 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f86600a1290 0x7f86600a3750 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8664009bd0 tx=0x7f8664005f90 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:57.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.687+0000 7f8671ffb640 1 -- 172.21.15.87:0/616531008 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f865c0b7090 con 0x7f8674105060 2024-09-13T17:13:57.744 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:57 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1141404074' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:13:57.744 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:57 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/606810231' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:13:57.744 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:57 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2793317904' entity='client.admin' 2024-09-13T17:13:57.744 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:57 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:13:57.744 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:57 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:13:57.744 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:57 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:13:57.744 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:57 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:57.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.854+0000 7f867a432640 1 -- 172.21.15.87:0/616531008 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f86741975b0 con 0x7f8674105060 2024-09-13T17:13:57.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.860+0000 7f8671ffb640 1 -- 172.21.15.87:0/616531008 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v33)=0 v33) v1 ==== 133+0+0 (secure 0 0 0) 0x7f865c0ba6b0 con 0x7f8674105060 2024-09-13T17:13:57.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:57 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1141404074' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:13:57.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:57 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/606810231' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:13:57.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:57 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2793317904' entity='client.admin' 2024-09-13T17:13:57.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:57 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:13:57.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:57 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:13:57.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:57 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:13:57.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:57 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:57.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.863+0000 7f867a432640 1 -- 172.21.15.87:0/616531008 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f86600a1290 msgr2=0x7f86600a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.863+0000 7f867a432640 1 --2- 172.21.15.87:0/616531008 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f86600a1290 0x7f86600a3750 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8664009bd0 tx=0x7f8664005f90 comp rx=0 tx=0).stop 2024-09-13T17:13:57.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.863+0000 7f867a432640 1 -- 172.21.15.87:0/616531008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8674105060 msgr2=0x7f86741967a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.863+0000 7f867a432640 1 --2- 172.21.15.87:0/616531008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8674105060 0x7f86741967a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f865c009900 tx=0x7f865c0040c0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.863+0000 7f867a432640 1 -- 172.21.15.87:0/616531008 shutdown_connections 2024-09-13T17:13:57.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.863+0000 7f867a432640 1 --2- 172.21.15.87:0/616531008 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f867419ab90 0x7f867419b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.863+0000 7f867a432640 1 --2- 172.21.15.87:0/616531008 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f86600a1290 0x7f86600a3750 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.863+0000 7f867a432640 1 --2- 172.21.15.87:0/616531008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8674105060 0x7f86741967a0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.863+0000 7f867a432640 1 --2- 172.21.15.87:0/616531008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86740fff10 0x7f8674196260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.863+0000 7f867a432640 1 -- 172.21.15.87:0/616531008 >> 172.21.15.87:0/616531008 conn(0x7f86740fb9a0 msgr2=0x7f86740fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:57.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.863+0000 7f867a432640 1 -- 172.21.15.87:0/616531008 shutdown_connections 2024-09-13T17:13:57.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.863+0000 7f867a432640 1 -- 172.21.15.87:0/616531008 wait complete. 2024-09-13T17:13:57.877 DEBUG:teuthology.orchestra.run.smithi087:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-13T17:13:57.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.978+0000 7fcc36680640 1 -- 172.21.15.87:0/3829036701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc30067830 msgr2=0x7fcc30067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.978+0000 7fcc36680640 1 --2- 172.21.15.87:0/3829036701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc30067830 0x7fcc30067c90 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fcc24009900 tx=0x7fcc2402a410 comp rx=0 tx=0).stop 2024-09-13T17:13:57.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.978+0000 7fcc36680640 1 -- 172.21.15.87:0/3829036701 shutdown_connections 2024-09-13T17:13:57.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.978+0000 7fcc36680640 1 --2- 172.21.15.87:0/3829036701 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc300681d0 0x7fcc3010cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.978+0000 7fcc36680640 1 --2- 172.21.15.87:0/3829036701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc30067830 0x7fcc30067c90 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.978+0000 7fcc36680640 1 --2- 172.21.15.87:0/3829036701 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc30104ce0 0x7fcc301050c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.978+0000 7fcc36680640 1 -- 172.21.15.87:0/3829036701 >> 172.21.15.87:0/3829036701 conn(0x7fcc30074940 msgr2=0x7fcc30074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:57.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.978+0000 7fcc36680640 1 -- 172.21.15.87:0/3829036701 shutdown_connections 2024-09-13T17:13:57.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.978+0000 7fcc36680640 1 -- 172.21.15.87:0/3829036701 wait complete. 2024-09-13T17:13:57.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.978+0000 7fcc36680640 1 Processor -- start 2024-09-13T17:13:57.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.978+0000 7fcc36680640 1 -- start start 2024-09-13T17:13:57.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.979+0000 7fcc36680640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc30067830 0x7fcc30196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.979+0000 7fcc36680640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc300681d0 0x7fcc301967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.979+0000 7fcc36680640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc30104ce0 0x7fcc3019abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.979+0000 7fcc36680640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3019b1c0 con 0x7fcc300681d0 2024-09-13T17:13:57.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.979+0000 7fcc36680640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3019b330 con 0x7fcc30104ce0 2024-09-13T17:13:57.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.979+0000 7fcc36680640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3019b4f0 con 0x7fcc30067830 2024-09-13T17:13:57.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.979+0000 7fcc2f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc300681d0 0x7fcc301967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.979+0000 7fcc2f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc300681d0 0x7fcc301967d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42172/0 (socket says 172.21.15.87:42172) 2024-09-13T17:13:57.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.979+0000 7fcc2ffff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc30067830 0x7fcc30196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.979+0000 7fcc2f7fe640 1 -- 172.21.15.87:0/885204674 learned_addr learned my addr 172.21.15.87:0/885204674 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:57.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.979+0000 7fcc34c1d640 1 --2- 172.21.15.87:0/885204674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc30104ce0 0x7fcc3019abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.979+0000 7fcc2f7fe640 1 -- 172.21.15.87:0/885204674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc30067830 msgr2=0x7fcc30196290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.979+0000 7fcc2f7fe640 1 --2- 172.21.15.87:0/885204674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc30067830 0x7fcc30196290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.979+0000 7fcc2f7fe640 1 -- 172.21.15.87:0/885204674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc30104ce0 msgr2=0x7fcc3019abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:57.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.979+0000 7fcc2f7fe640 1 --2- 172.21.15.87:0/885204674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc30104ce0 0x7fcc3019abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:57.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.979+0000 7fcc2f7fe640 1 -- 172.21.15.87:0/885204674 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc24009560 con 0x7fcc300681d0 2024-09-13T17:13:57.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.979+0000 7fcc2ffff640 1 --2- 172.21.15.87:0/885204674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc30067830 0x7fcc30196290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:13:57.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.979+0000 7fcc2f7fe640 1 --2- 172.21.15.87:0/885204674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc300681d0 0x7fcc301967d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fcc24005ab0 tx=0x7fcc240042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:57.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.979+0000 7fcc2d7fa640 1 -- 172.21.15.87:0/885204674 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc24003a00 con 0x7fcc300681d0 2024-09-13T17:13:57.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.979+0000 7fcc2d7fa640 1 -- 172.21.15.87:0/885204674 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcc240044e0 con 0x7fcc300681d0 2024-09-13T17:13:57.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.979+0000 7fcc36680640 1 -- 172.21.15.87:0/885204674 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc3019b770 con 0x7fcc300681d0 2024-09-13T17:13:57.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.979+0000 7fcc2d7fa640 1 -- 172.21.15.87:0/885204674 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2403bda0 con 0x7fcc300681d0 2024-09-13T17:13:57.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.980+0000 7fcc36680640 1 -- 172.21.15.87:0/885204674 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc3019ba40 con 0x7fcc300681d0 2024-09-13T17:13:57.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.980+0000 7fcc36680640 1 -- 172.21.15.87:0/885204674 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc30101410 con 0x7fcc300681d0 2024-09-13T17:13:57.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.981+0000 7fcc2d7fa640 1 -- 172.21.15.87:0/885204674 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 24) v1 ==== 136049+0+0 (secure 0 0 0) 0x7fcc24003b60 con 0x7fcc300681d0 2024-09-13T17:13:57.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.982+0000 7fcc2d7fa640 1 --2- 172.21.15.87:0/885204674 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fcc180a1290 0x7fcc180a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:57.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.982+0000 7fcc2ffff640 1 --2- 172.21.15.87:0/885204674 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fcc180a1290 0x7fcc180a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:57.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.983+0000 7fcc2d7fa640 1 -- 172.21.15.87:0/885204674 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fcc240ede10 con 0x7fcc300681d0 2024-09-13T17:13:57.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.983+0000 7fcc2ffff640 1 --2- 172.21.15.87:0/885204674 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fcc180a1290 0x7fcc180a3750 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcc20009fc0 tx=0x7fcc20005f90 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:57.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:57.987+0000 7fcc2d7fa640 1 -- 172.21.15.87:0/885204674 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcc240b6d40 con 0x7fcc300681d0 2024-09-13T17:13:58.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.170+0000 7fcc36680640 1 -- 172.21.15.87:0/885204674 --> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc3010fdd0 con 0x7fcc180a1290 2024-09-13T17:13:58.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.228+0000 7fcc2d7fa640 1 -- 172.21.15.87:0/885204674 <== mgr.15507 v2:172.21.15.87:6800/157129242 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fcc3010fdd0 con 0x7fcc180a1290 2024-09-13T17:13:58.230 INFO:teuthology.orchestra.run.smithi087.stdout:Schedule set for path / 2024-09-13T17:13:58.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.230+0000 7fcc36680640 1 -- 172.21.15.87:0/885204674 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fcc180a1290 msgr2=0x7fcc180a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:58.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.230+0000 7fcc36680640 1 --2- 172.21.15.87:0/885204674 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fcc180a1290 0x7fcc180a3750 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcc20009fc0 tx=0x7fcc20005f90 comp rx=0 tx=0).stop 2024-09-13T17:13:58.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.230+0000 7fcc36680640 1 -- 172.21.15.87:0/885204674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc300681d0 msgr2=0x7fcc301967d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:58.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.230+0000 7fcc36680640 1 --2- 172.21.15.87:0/885204674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc300681d0 0x7fcc301967d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fcc24005ab0 tx=0x7fcc240042f0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.230+0000 7fcc36680640 1 -- 172.21.15.87:0/885204674 shutdown_connections 2024-09-13T17:13:58.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.230+0000 7fcc36680640 1 --2- 172.21.15.87:0/885204674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc30104ce0 0x7fcc3019abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.230+0000 7fcc36680640 1 --2- 172.21.15.87:0/885204674 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fcc180a1290 0x7fcc180a3750 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.230+0000 7fcc36680640 1 --2- 172.21.15.87:0/885204674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc300681d0 0x7fcc301967d0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.230+0000 7fcc36680640 1 --2- 172.21.15.87:0/885204674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc30067830 0x7fcc30196290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.230+0000 7fcc36680640 1 -- 172.21.15.87:0/885204674 >> 172.21.15.87:0/885204674 conn(0x7fcc30074940 msgr2=0x7fcc300fd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:58.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.230+0000 7fcc36680640 1 -- 172.21.15.87:0/885204674 shutdown_connections 2024-09-13T17:13:58.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.230+0000 7fcc36680640 1 -- 172.21.15.87:0/885204674 wait complete. 2024-09-13T17:13:58.243 DEBUG:teuthology.orchestra.run.smithi087:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-13T17:13:58.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.341+0000 7f4c81a9c640 1 -- 172.21.15.87:0/4257533572 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c7c10a270 msgr2=0x7f4c7c10c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:58.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.341+0000 7f4c81a9c640 1 --2- 172.21.15.87:0/4257533572 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c7c10a270 0x7f4c7c10c710 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4c74009ca0 tx=0x7f4c7402a950 comp rx=0 tx=0).stop 2024-09-13T17:13:58.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.341+0000 7f4c81a9c640 1 -- 172.21.15.87:0/4257533572 shutdown_connections 2024-09-13T17:13:58.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.341+0000 7f4c81a9c640 1 --2- 172.21.15.87:0/4257533572 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c7c10a270 0x7f4c7c10c710 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.341+0000 7f4c81a9c640 1 --2- 172.21.15.87:0/4257533572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c7c1017c0 0x7f4c7c109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.341+0000 7f4c81a9c640 1 --2- 172.21.15.87:0/4257533572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c7c100ea0 0x7f4c7c101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.341+0000 7f4c81a9c640 1 -- 172.21.15.87:0/4257533572 >> 172.21.15.87:0/4257533572 conn(0x7f4c7c0fa870 msgr2=0x7f4c7c0fcc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:58.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.341+0000 7f4c81a9c640 1 -- 172.21.15.87:0/4257533572 shutdown_connections 2024-09-13T17:13:58.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.341+0000 7f4c81a9c640 1 -- 172.21.15.87:0/4257533572 wait complete. 2024-09-13T17:13:58.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.341+0000 7f4c81a9c640 1 Processor -- start 2024-09-13T17:13:58.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.342+0000 7f4c81a9c640 1 -- start start 2024-09-13T17:13:58.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.342+0000 7f4c81a9c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c7c100ea0 0x7f4c7c196210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:58.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.342+0000 7f4c81a9c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c7c1017c0 0x7f4c7c196750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:58.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.342+0000 7f4c81a9c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c7c10a270 0x7f4c7c19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:58.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.342+0000 7f4c81a9c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c19b140 con 0x7f4c7c1017c0 2024-09-13T17:13:58.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.342+0000 7f4c81a9c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c19b2b0 con 0x7f4c7c100ea0 2024-09-13T17:13:58.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.342+0000 7f4c81a9c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c19b470 con 0x7f4c7c10a270 2024-09-13T17:13:58.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.342+0000 7f4c73fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c7c1017c0 0x7f4c7c196750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:58.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.342+0000 7f4c73fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c7c1017c0 0x7f4c7c196750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42196/0 (socket says 172.21.15.87:42196) 2024-09-13T17:13:58.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.342+0000 7f4c73fff640 1 -- 172.21.15.87:0/1870839383 learned_addr learned my addr 172.21.15.87:0/1870839383 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:58.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.342+0000 7f4c7bfff640 1 --2- 172.21.15.87:0/1870839383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c7c10a270 0x7f4c7c19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:58.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.342+0000 7f4c7b7fe640 1 --2- 172.21.15.87:0/1870839383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c7c100ea0 0x7f4c7c196210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:58.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.342+0000 7f4c73fff640 1 -- 172.21.15.87:0/1870839383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c7c10a270 msgr2=0x7f4c7c19ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:58.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.342+0000 7f4c73fff640 1 --2- 172.21.15.87:0/1870839383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c7c10a270 0x7f4c7c19ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.342+0000 7f4c73fff640 1 -- 172.21.15.87:0/1870839383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c7c100ea0 msgr2=0x7f4c7c196210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:58.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.342+0000 7f4c73fff640 1 --2- 172.21.15.87:0/1870839383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c7c100ea0 0x7f4c7c196210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.342+0000 7f4c73fff640 1 -- 172.21.15.87:0/1870839383 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c74009900 con 0x7f4c7c1017c0 2024-09-13T17:13:58.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.342+0000 7f4c7b7fe640 1 --2- 172.21.15.87:0/1870839383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c7c100ea0 0x7f4c7c196210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:58.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.342+0000 7f4c73fff640 1 --2- 172.21.15.87:0/1870839383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c7c1017c0 0x7f4c7c196750 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400e9f0 tx=0x7f4c6400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:58.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.342+0000 7f4c797fa640 1 -- 172.21.15.87:0/1870839383 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c64009720 con 0x7f4c7c1017c0 2024-09-13T17:13:58.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.342+0000 7f4c797fa640 1 -- 172.21.15.87:0/1870839383 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4c6400cd80 con 0x7f4c7c1017c0 2024-09-13T17:13:58.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.342+0000 7f4c81a9c640 1 -- 172.21.15.87:0/1870839383 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c7c19b750 con 0x7f4c7c1017c0 2024-09-13T17:13:58.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.342+0000 7f4c797fa640 1 -- 172.21.15.87:0/1870839383 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c64010430 con 0x7f4c7c1017c0 2024-09-13T17:13:58.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.343+0000 7f4c81a9c640 1 -- 172.21.15.87:0/1870839383 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c7c1a2fd0 con 0x7f4c7c1017c0 2024-09-13T17:13:58.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.344+0000 7f4c81a9c640 1 -- 172.21.15.87:0/1870839383 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c7c068e30 con 0x7f4c7c1017c0 2024-09-13T17:13:58.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.345+0000 7f4c797fa640 1 -- 172.21.15.87:0/1870839383 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 24) v1 ==== 136049+0+0 (secure 0 0 0) 0x7f4c64005020 con 0x7f4c7c1017c0 2024-09-13T17:13:58.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.345+0000 7f4c797fa640 1 --2- 172.21.15.87:0/1870839383 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4c680a1310 0x7f4c680a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:58.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.345+0000 7f4c7b7fe640 1 --2- 172.21.15.87:0/1870839383 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4c680a1310 0x7f4c680a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:58.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.345+0000 7f4c797fa640 1 -- 172.21.15.87:0/1870839383 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f4c64014070 con 0x7f4c7c1017c0 2024-09-13T17:13:58.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.346+0000 7f4c7b7fe640 1 --2- 172.21.15.87:0/1870839383 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4c680a1310 0x7f4c680a37d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c0058c0 tx=0x7f4c6c005ec0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:58.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.349+0000 7f4c797fa640 1 -- 172.21.15.87:0/1870839383 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4c640964b0 con 0x7f4c7c1017c0 2024-09-13T17:13:58.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.536+0000 7f4c81a9c640 1 -- 172.21.15.87:0/1870839383 --> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c7c10fcd0 con 0x7f4c680a1310 2024-09-13T17:13:58.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.589+0000 7f4c797fa640 1 -- 172.21.15.87:0/1870839383 <== mgr.15507 v2:172.21.15.87:6800/157129242 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f4c7c10fcd0 con 0x7f4c680a1310 2024-09-13T17:13:58.592 INFO:teuthology.orchestra.run.smithi087.stdout:Retention added to path / 2024-09-13T17:13:58.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:58 smithi149 ceph-mon[35496]: scrub queued for path: / 2024-09-13T17:13:58.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:58 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:13:58.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:58 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:13:58.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:58 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:13:58.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:58 smithi149 ceph-mon[35496]: pgmap v7: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 146 B/s wr, 21 op/s 2024-09-13T17:13:58.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:58 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1325115783' entity='client.admin' 2024-09-13T17:13:58.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:58 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:13:58.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:58 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:13:58.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:58 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:13:58.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:58 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:58.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:58 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/616531008' entity='client.admin' 2024-09-13T17:13:58.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:58 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:13:58.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:58 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:13:58.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:58 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:13:58.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:58 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:58.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.592+0000 7f4c81a9c640 1 -- 172.21.15.87:0/1870839383 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4c680a1310 msgr2=0x7f4c680a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:58.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.592+0000 7f4c81a9c640 1 --2- 172.21.15.87:0/1870839383 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4c680a1310 0x7f4c680a37d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c0058c0 tx=0x7f4c6c005ec0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.592+0000 7f4c81a9c640 1 -- 172.21.15.87:0/1870839383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c7c1017c0 msgr2=0x7f4c7c196750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:58.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.592+0000 7f4c81a9c640 1 --2- 172.21.15.87:0/1870839383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c7c1017c0 0x7f4c7c196750 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400e9f0 tx=0x7f4c6400edf0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.592+0000 7f4c81a9c640 1 -- 172.21.15.87:0/1870839383 shutdown_connections 2024-09-13T17:13:58.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.592+0000 7f4c81a9c640 1 --2- 172.21.15.87:0/1870839383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c7c10a270 0x7f4c7c19ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.592+0000 7f4c81a9c640 1 --2- 172.21.15.87:0/1870839383 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4c680a1310 0x7f4c680a37d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.592+0000 7f4c81a9c640 1 --2- 172.21.15.87:0/1870839383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c7c1017c0 0x7f4c7c196750 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.592+0000 7f4c81a9c640 1 --2- 172.21.15.87:0/1870839383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c7c100ea0 0x7f4c7c196210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.592+0000 7f4c81a9c640 1 -- 172.21.15.87:0/1870839383 >> 172.21.15.87:0/1870839383 conn(0x7f4c7c0fa870 msgr2=0x7f4c7c0fc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:58.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.592+0000 7f4c81a9c640 1 -- 172.21.15.87:0/1870839383 shutdown_connections 2024-09-13T17:13:58.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.592+0000 7f4c81a9c640 1 -- 172.21.15.87:0/1870839383 wait complete. 2024-09-13T17:13:58.604 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:58 smithi087 ceph-mon[30934]: scrub queued for path: / 2024-09-13T17:13:58.604 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:58 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:13:58.604 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:58 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:13:58.604 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:58 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:13:58.604 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:58 smithi087 ceph-mon[30934]: pgmap v7: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 146 B/s wr, 21 op/s 2024-09-13T17:13:58.604 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:58 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1325115783' entity='client.admin' 2024-09-13T17:13:58.604 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:58 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:13:58.604 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:58 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:13:58.604 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:58 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:13:58.604 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:58 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:58.604 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:58 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/616531008' entity='client.admin' 2024-09-13T17:13:58.604 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:58 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:13:58.605 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:58 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:13:58.605 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:58 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:13:58.605 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:58 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:58.606 DEBUG:teuthology.orchestra.run.smithi087:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-13T17:13:58.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.703+0000 7f4d7435e640 1 -- 172.21.15.87:0/2334207689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d6c10a290 msgr2=0x7f4d6c10c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:58.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.703+0000 7f4d7435e640 1 --2- 172.21.15.87:0/2334207689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d6c10a290 0x7f4d6c10c730 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4d64009ca0 tx=0x7f4d6402a950 comp rx=0 tx=0).stop 2024-09-13T17:13:58.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.703+0000 7f4d7435e640 1 -- 172.21.15.87:0/2334207689 shutdown_connections 2024-09-13T17:13:58.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.703+0000 7f4d7435e640 1 --2- 172.21.15.87:0/2334207689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d6c10a290 0x7f4d6c10c730 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.703+0000 7f4d7435e640 1 --2- 172.21.15.87:0/2334207689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d6c101820 0x7f4d6c109d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.703+0000 7f4d7435e640 1 --2- 172.21.15.87:0/2334207689 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d6c100f00 0x7f4d6c1012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.703+0000 7f4d7435e640 1 -- 172.21.15.87:0/2334207689 >> 172.21.15.87:0/2334207689 conn(0x7f4d6c0fa890 msgr2=0x7f4d6c0fccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:58.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.703+0000 7f4d7435e640 1 -- 172.21.15.87:0/2334207689 shutdown_connections 2024-09-13T17:13:58.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.703+0000 7f4d7435e640 1 -- 172.21.15.87:0/2334207689 wait complete. 2024-09-13T17:13:58.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.703+0000 7f4d7435e640 1 Processor -- start 2024-09-13T17:13:58.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.703+0000 7f4d7435e640 1 -- start start 2024-09-13T17:13:58.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.704+0000 7f4d7435e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d6c100f00 0x7f4d6c1961a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:58.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.704+0000 7f4d7435e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d6c101820 0x7f4d6c1966e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:58.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.704+0000 7f4d7435e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d6c10a290 0x7f4d6c19aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:58.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.704+0000 7f4d7435e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c19b0d0 con 0x7f4d6c100f00 2024-09-13T17:13:58.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.704+0000 7f4d7435e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c19b240 con 0x7f4d6c101820 2024-09-13T17:13:58.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.704+0000 7f4d7435e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c19b400 con 0x7f4d6c10a290 2024-09-13T17:13:58.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.704+0000 7f4d720fa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d6c100f00 0x7f4d6c1961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:58.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.704+0000 7f4d720fa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d6c100f00 0x7f4d6c1961a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42218/0 (socket says 172.21.15.87:42218) 2024-09-13T17:13:58.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.704+0000 7f4d720fa640 1 -- 172.21.15.87:0/3018842904 learned_addr learned my addr 172.21.15.87:0/3018842904 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:58.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.704+0000 7f4d728fb640 1 --2- 172.21.15.87:0/3018842904 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d6c10a290 0x7f4d6c19aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:58.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.704+0000 7f4d720fa640 1 -- 172.21.15.87:0/3018842904 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d6c10a290 msgr2=0x7f4d6c19aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:58.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.704+0000 7f4d720fa640 1 --2- 172.21.15.87:0/3018842904 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d6c10a290 0x7f4d6c19aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.704+0000 7f4d720fa640 1 -- 172.21.15.87:0/3018842904 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d6c101820 msgr2=0x7f4d6c1966e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:58.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.704+0000 7f4d720fa640 1 --2- 172.21.15.87:0/3018842904 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d6c101820 0x7f4d6c1966e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.704+0000 7f4d720fa640 1 -- 172.21.15.87:0/3018842904 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d64009900 con 0x7f4d6c100f00 2024-09-13T17:13:58.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.704+0000 7f4d720fa640 1 --2- 172.21.15.87:0/3018842904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d6c100f00 0x7f4d6c1961a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4d6800e9f0 tx=0x7f4d6800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:58.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.704+0000 7f4d637fe640 1 -- 172.21.15.87:0/3018842904 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d68009720 con 0x7f4d6c100f00 2024-09-13T17:13:58.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.704+0000 7f4d637fe640 1 -- 172.21.15.87:0/3018842904 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4d6800cd80 con 0x7f4d6c100f00 2024-09-13T17:13:58.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.704+0000 7f4d7435e640 1 -- 172.21.15.87:0/3018842904 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d6c19b6e0 con 0x7f4d6c100f00 2024-09-13T17:13:58.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.704+0000 7f4d637fe640 1 -- 172.21.15.87:0/3018842904 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d68010430 con 0x7f4d6c100f00 2024-09-13T17:13:58.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.704+0000 7f4d7435e640 1 -- 172.21.15.87:0/3018842904 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d6c1a2f60 con 0x7f4d6c100f00 2024-09-13T17:13:58.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.705+0000 7f4d7435e640 1 -- 172.21.15.87:0/3018842904 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6c068d70 con 0x7f4d6c100f00 2024-09-13T17:13:58.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.706+0000 7f4d637fe640 1 -- 172.21.15.87:0/3018842904 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 24) v1 ==== 136049+0+0 (secure 0 0 0) 0x7f4d68005020 con 0x7f4d6c100f00 2024-09-13T17:13:58.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.707+0000 7f4d637fe640 1 --2- 172.21.15.87:0/3018842904 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4d580a1290 0x7f4d580a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:58.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.707+0000 7f4d718f9640 1 --2- 172.21.15.87:0/3018842904 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4d580a1290 0x7f4d580a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:58.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.707+0000 7f4d637fe640 1 -- 172.21.15.87:0/3018842904 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f4d68014070 con 0x7f4d6c100f00 2024-09-13T17:13:58.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.707+0000 7f4d718f9640 1 --2- 172.21.15.87:0/3018842904 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4d580a1290 0x7f4d580a3750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c005fd0 tx=0x7f4d5c005f40 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:58.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.711+0000 7f4d637fe640 1 -- 172.21.15.87:0/3018842904 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4d68096580 con 0x7f4d6c100f00 2024-09-13T17:13:58.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:58 smithi118 ceph-mon[34374]: scrub queued for path: / 2024-09-13T17:13:58.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:58 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:13:58.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:58 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:13:58.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:58 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:13:58.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:58 smithi118 ceph-mon[34374]: pgmap v7: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 146 B/s wr, 21 op/s 2024-09-13T17:13:58.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:58 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1325115783' entity='client.admin' 2024-09-13T17:13:58.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:58 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:13:58.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:58 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:13:58.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:58 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:13:58.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:58 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:58.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:58 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/616531008' entity='client.admin' 2024-09-13T17:13:58.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:58 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:13:58.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:58 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:13:58.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:58 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:13:58.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:58 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:13:58.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.893+0000 7f4d7435e640 1 -- 172.21.15.87:0/3018842904 --> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d6c1053f0 con 0x7f4d580a1290 2024-09-13T17:13:58.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.899+0000 7f4d637fe640 1 -- 172.21.15.87:0/3018842904 <== mgr.15507 v2:172.21.15.87:6800/157129242 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+298 (secure 0 0 0) 0x7f4d6c1053f0 con 0x7f4d580a1290 2024-09-13T17:13:58.901 INFO:teuthology.orchestra.run.smithi087.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-13T00:00:00", "created": "2024-09-13T17:13:58", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-13T17:13:58.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.901+0000 7f4d7435e640 1 -- 172.21.15.87:0/3018842904 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4d580a1290 msgr2=0x7f4d580a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:58.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.901+0000 7f4d7435e640 1 --2- 172.21.15.87:0/3018842904 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4d580a1290 0x7f4d580a3750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c005fd0 tx=0x7f4d5c005f40 comp rx=0 tx=0).stop 2024-09-13T17:13:58.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.901+0000 7f4d7435e640 1 -- 172.21.15.87:0/3018842904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d6c100f00 msgr2=0x7f4d6c1961a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:58.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.901+0000 7f4d7435e640 1 --2- 172.21.15.87:0/3018842904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d6c100f00 0x7f4d6c1961a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4d6800e9f0 tx=0x7f4d6800edf0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.901+0000 7f4d7435e640 1 -- 172.21.15.87:0/3018842904 shutdown_connections 2024-09-13T17:13:58.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.901+0000 7f4d7435e640 1 --2- 172.21.15.87:0/3018842904 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d6c10a290 0x7f4d6c19aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.901+0000 7f4d7435e640 1 --2- 172.21.15.87:0/3018842904 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d6c101820 0x7f4d6c1966e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.901+0000 7f4d7435e640 1 --2- 172.21.15.87:0/3018842904 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4d580a1290 0x7f4d580a3750 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.901+0000 7f4d7435e640 1 --2- 172.21.15.87:0/3018842904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d6c100f00 0x7f4d6c1961a0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:58.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.901+0000 7f4d7435e640 1 -- 172.21.15.87:0/3018842904 >> 172.21.15.87:0/3018842904 conn(0x7f4d6c0fa890 msgr2=0x7f4d6c0fc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:58.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.901+0000 7f4d7435e640 1 -- 172.21.15.87:0/3018842904 shutdown_connections 2024-09-13T17:13:58.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:58.901+0000 7f4d7435e640 1 -- 172.21.15.87:0/3018842904 wait complete. 2024-09-13T17:13:58.914 DEBUG:teuthology.orchestra.run.smithi087:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-13T17:13:59.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.013+0000 7f7a7579c640 1 -- 172.21.15.87:0/1234926689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a70101770 msgr2=0x7f7a70109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:59.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.013+0000 7f7a7579c640 1 --2- 172.21.15.87:0/1234926689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a70101770 0x7f7a70109c50 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f7a64009900 tx=0x7f7a6402a480 comp rx=0 tx=0).stop 2024-09-13T17:13:59.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.013+0000 7f7a7579c640 1 -- 172.21.15.87:0/1234926689 shutdown_connections 2024-09-13T17:13:59.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.013+0000 7f7a7579c640 1 --2- 172.21.15.87:0/1234926689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a7010a270 0x7f7a7010c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.013+0000 7f7a7579c640 1 --2- 172.21.15.87:0/1234926689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a70101770 0x7f7a70109c50 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.013+0000 7f7a7579c640 1 --2- 172.21.15.87:0/1234926689 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a70100e50 0x7f7a70101230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.013+0000 7f7a7579c640 1 -- 172.21.15.87:0/1234926689 >> 172.21.15.87:0/1234926689 conn(0x7f7a700fa8a0 msgr2=0x7f7a700fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:59.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.013+0000 7f7a7579c640 1 -- 172.21.15.87:0/1234926689 shutdown_connections 2024-09-13T17:13:59.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.013+0000 7f7a7579c640 1 -- 172.21.15.87:0/1234926689 wait complete. 2024-09-13T17:13:59.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.014+0000 7f7a7579c640 1 Processor -- start 2024-09-13T17:13:59.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.014+0000 7f7a7579c640 1 -- start start 2024-09-13T17:13:59.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.014+0000 7f7a7579c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a70100e50 0x7f7a700feaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:59.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.014+0000 7f7a7579c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a70101770 0x7f7a700fefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:59.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.014+0000 7f7a7579c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a7010a270 0x7f7a700ff520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:59.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.014+0000 7f7a7579c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a701a45b0 con 0x7f7a70101770 2024-09-13T17:13:59.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.014+0000 7f7a7579c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a701a4720 con 0x7f7a70100e50 2024-09-13T17:13:59.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.014+0000 7f7a7579c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a701a48e0 con 0x7f7a7010a270 2024-09-13T17:13:59.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.014+0000 7f7a6e7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a70101770 0x7f7a700fefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:59.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.014+0000 7f7a6e7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a70101770 0x7f7a700fefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42244/0 (socket says 172.21.15.87:42244) 2024-09-13T17:13:59.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.014+0000 7f7a6e7fc640 1 -- 172.21.15.87:0/2090543719 learned_addr learned my addr 172.21.15.87:0/2090543719 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:13:59.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.014+0000 7f7a6f7fe640 1 --2- 172.21.15.87:0/2090543719 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a7010a270 0x7f7a700ff520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:59.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.015+0000 7f7a6effd640 1 --2- 172.21.15.87:0/2090543719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a70100e50 0x7f7a700feaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:59.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.015+0000 7f7a6e7fc640 1 -- 172.21.15.87:0/2090543719 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a7010a270 msgr2=0x7f7a700ff520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:59.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.015+0000 7f7a6e7fc640 1 --2- 172.21.15.87:0/2090543719 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a7010a270 0x7f7a700ff520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.015+0000 7f7a6e7fc640 1 -- 172.21.15.87:0/2090543719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a70100e50 msgr2=0x7f7a700feaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:59.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.015+0000 7f7a6e7fc640 1 --2- 172.21.15.87:0/2090543719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a70100e50 0x7f7a700feaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.015+0000 7f7a6e7fc640 1 -- 172.21.15.87:0/2090543719 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a60009490 con 0x7f7a70101770 2024-09-13T17:13:59.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.015+0000 7f7a6effd640 1 --2- 172.21.15.87:0/2090543719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a70100e50 0x7f7a700feaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:13:59.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.015+0000 7f7a6e7fc640 1 --2- 172.21.15.87:0/2090543719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a70101770 0x7f7a700fefe0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7a6402aa70 tx=0x7f7a640040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:59.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.015+0000 7f7a57fff640 1 -- 172.21.15.87:0/2090543719 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a640037f0 con 0x7f7a70101770 2024-09-13T17:13:59.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.015+0000 7f7a7579c640 1 -- 172.21.15.87:0/2090543719 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a64009560 con 0x7f7a70101770 2024-09-13T17:13:59.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.015+0000 7f7a57fff640 1 -- 172.21.15.87:0/2090543719 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7a640044c0 con 0x7f7a70101770 2024-09-13T17:13:59.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.015+0000 7f7a57fff640 1 -- 172.21.15.87:0/2090543719 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6403bd90 con 0x7f7a70101770 2024-09-13T17:13:59.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.015+0000 7f7a7579c640 1 -- 172.21.15.87:0/2090543719 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a701a4e80 con 0x7f7a70101770 2024-09-13T17:13:59.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.016+0000 7f7a7579c640 1 -- 172.21.15.87:0/2090543719 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a70068e50 con 0x7f7a70101770 2024-09-13T17:13:59.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.017+0000 7f7a57fff640 1 -- 172.21.15.87:0/2090543719 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 24) v1 ==== 136049+0+0 (secure 0 0 0) 0x7f7a6403b560 con 0x7f7a70101770 2024-09-13T17:13:59.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.018+0000 7f7a57fff640 1 --2- 172.21.15.87:0/2090543719 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7a580a1290 0x7f7a580a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:13:59.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.018+0000 7f7a57fff640 1 -- 172.21.15.87:0/2090543719 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f7a640ede70 con 0x7f7a70101770 2024-09-13T17:13:59.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.018+0000 7f7a6effd640 1 --2- 172.21.15.87:0/2090543719 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7a580a1290 0x7f7a580a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:13:59.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.019+0000 7f7a6effd640 1 --2- 172.21.15.87:0/2090543719 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7a580a1290 0x7f7a580a3750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7a60009db0 tx=0x7f7a60005f90 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:13:59.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.022+0000 7f7a57fff640 1 -- 172.21.15.87:0/2090543719 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7a640b6da0 con 0x7f7a70101770 2024-09-13T17:13:59.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.206+0000 7f7a7579c640 1 -- 172.21.15.87:0/2090543719 --> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f7a7010fc80 con 0x7f7a580a1290 2024-09-13T17:13:59.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.212+0000 7f7a57fff640 1 -- 172.21.15.87:0/2090543719 <== mgr.15507 v2:172.21.15.87:6800/157129242 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7f7a7010fc80 con 0x7f7a580a1290 2024-09-13T17:13:59.214 INFO:teuthology.orchestra.run.smithi087.stdout:/ 1m 6m3h 2024-09-13T17:13:59.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.215+0000 7f7a7579c640 1 -- 172.21.15.87:0/2090543719 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7a580a1290 msgr2=0x7f7a580a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:59.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.215+0000 7f7a7579c640 1 --2- 172.21.15.87:0/2090543719 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7a580a1290 0x7f7a580a3750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7a60009db0 tx=0x7f7a60005f90 comp rx=0 tx=0).stop 2024-09-13T17:13:59.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.215+0000 7f7a7579c640 1 -- 172.21.15.87:0/2090543719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a70101770 msgr2=0x7f7a700fefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:13:59.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.215+0000 7f7a7579c640 1 --2- 172.21.15.87:0/2090543719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a70101770 0x7f7a700fefe0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7a6402aa70 tx=0x7f7a640040c0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.215+0000 7f7a7579c640 1 -- 172.21.15.87:0/2090543719 shutdown_connections 2024-09-13T17:13:59.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.215+0000 7f7a7579c640 1 --2- 172.21.15.87:0/2090543719 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a7010a270 0x7f7a700ff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.215+0000 7f7a7579c640 1 --2- 172.21.15.87:0/2090543719 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7a580a1290 0x7f7a580a3750 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.215+0000 7f7a7579c640 1 --2- 172.21.15.87:0/2090543719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a70101770 0x7f7a700fefe0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.215+0000 7f7a7579c640 1 --2- 172.21.15.87:0/2090543719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a70100e50 0x7f7a700feaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:13:59.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.215+0000 7f7a7579c640 1 -- 172.21.15.87:0/2090543719 >> 172.21.15.87:0/2090543719 conn(0x7f7a700fa8a0 msgr2=0x7f7a700fc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:13:59.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.215+0000 7f7a7579c640 1 -- 172.21.15.87:0/2090543719 shutdown_connections 2024-09-13T17:13:59.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:13:59.215+0000 7f7a7579c640 1 -- 172.21.15.87:0/2090543719 wait complete. 2024-09-13T17:13:59.228 DEBUG:teuthology.orchestra.run.smithi087:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-13T17:13:59.255 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-13T17:13:59.310 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-13T17:13:59.320 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T17:13:59.321 DEBUG:teuthology.orchestra.run.smithi087:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-13T17:13:59.324 INFO:teuthology.run_tasks:Running task workunit... 2024-09-13T17:13:59.337 INFO:tasks.workunit:Pulling workunits from ref 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:13:59.338 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-13T17:13:59.338 INFO:tasks.workunit:timeout=3h 2024-09-13T17:13:59.338 INFO:tasks.workunit:cleanup=True 2024-09-13T17:13:59.338 DEBUG:teuthology.orchestra.run.smithi087:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-13T17:13:59.353 INFO:teuthology.orchestra.run.smithi087.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-13T17:13:59.353 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-13T17:13:59.353 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 78h/120d Inode: 1 Links: 2 2024-09-13T17:13:59.354 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:13:59.354 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-13T17:13:59.354 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-09-13 17:11:48.442952522 +0000 2024-09-13T17:13:59.354 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-09-13 17:11:48.442952522 +0000 2024-09-13T17:13:59.354 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-09-13 17:13:49.030281931 +0000 2024-09-13T17:13:59.354 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2024-09-13T17:13:59.354 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-13T17:13:59.354 DEBUG:teuthology.orchestra.run.smithi087:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-13T17:13:59.425 DEBUG:teuthology.orchestra.run.smithi087:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:13:59.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:13:59 smithi087 ceph-mon[30934]: from='client.15753 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:13:59.481 INFO:tasks.workunit.client.0.smithi087.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-13T17:13:59.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:13:59 smithi149 ceph-mon[35496]: from='client.15753 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:13:59.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:13:59 smithi118 ceph-mon[34374]: from='client.15753 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:14:00.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:00 smithi087 ceph-mon[30934]: from='client.15759 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:14:00.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:00 smithi087 ceph-mon[30934]: from='client.15765 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:14:00.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:00 smithi087 ceph-mon[30934]: from='client.15771 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:14:00.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:00 smithi087 ceph-mon[30934]: pgmap v8: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 113 B/s wr, 17 op/s 2024-09-13T17:14:00.729 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:14:00 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:14:00.598+0000 7f6494c3b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:14:00.729 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:14:00 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:14:00.598+0000 7f6494c3b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:14:00.729 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:14:00 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:14:00.598+0000 7f6494c3b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:14:00.729 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:14:00 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:14:00.598+0000 7f6494c3b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:14:00.729 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:14:00 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:14:00.598+0000 7f6494c3b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T17:14:00.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:00 smithi149 ceph-mon[35496]: from='client.15759 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:14:00.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:00 smithi149 ceph-mon[35496]: from='client.15765 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:14:00.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:00 smithi149 ceph-mon[35496]: from='client.15771 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:14:00.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:00 smithi149 ceph-mon[35496]: pgmap v8: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 113 B/s wr, 17 op/s 2024-09-13T17:14:00.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:00 smithi118 ceph-mon[34374]: from='client.15759 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:14:00.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:00 smithi118 ceph-mon[34374]: from='client.15765 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:14:00.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:00 smithi118 ceph-mon[34374]: from='client.15771 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:14:00.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:00 smithi118 ceph-mon[34374]: pgmap v8: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 113 B/s wr, 17 op/s 2024-09-13T17:14:02.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:02 smithi087 ceph-mon[30934]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 84 KiB/s wr, 51 op/s 2024-09-13T17:14:02.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:02 smithi087 ceph-mon[30934]: mgrmap e25: x(active, since 12s), standbys: y, z 2024-09-13T17:14:02.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:02 smithi149 ceph-mon[35496]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 84 KiB/s wr, 51 op/s 2024-09-13T17:14:02.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:02 smithi149 ceph-mon[35496]: mgrmap e25: x(active, since 12s), standbys: y, z 2024-09-13T17:14:02.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:02 smithi118 ceph-mon[34374]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 84 KiB/s wr, 51 op/s 2024-09-13T17:14:02.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:02 smithi118 ceph-mon[34374]: mgrmap e25: x(active, since 12s), standbys: y, z 2024-09-13T17:14:04.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:04 smithi087 ceph-mon[30934]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 47 op/s 2024-09-13T17:14:04.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:04 smithi149 ceph-mon[35496]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 47 op/s 2024-09-13T17:14:04.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:04 smithi118 ceph-mon[34374]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 47 op/s 2024-09-13T17:14:06.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:06 smithi087 ceph-mon[30934]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 47 op/s 2024-09-13T17:14:06.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:06 smithi149 ceph-mon[35496]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 47 op/s 2024-09-13T17:14:06.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:06 smithi118 ceph-mon[34374]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 47 op/s 2024-09-13T17:14:08.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:08 smithi087 ceph-mon[30934]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 100 KiB/s wr, 54 op/s 2024-09-13T17:14:08.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:08 smithi149 ceph-mon[35496]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 100 KiB/s wr, 54 op/s 2024-09-13T17:14:08.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:08 smithi118 ceph-mon[34374]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 100 KiB/s wr, 54 op/s 2024-09-13T17:14:10.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:10 smithi087 ceph-mon[30934]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 100 KiB/s wr, 52 op/s 2024-09-13T17:14:10.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:10 smithi087 ceph-mon[30934]: scrub summary: idle 2024-09-13T17:14:10.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:10 smithi149 ceph-mon[35496]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 100 KiB/s wr, 52 op/s 2024-09-13T17:14:10.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:10 smithi149 ceph-mon[35496]: scrub summary: idle 2024-09-13T17:14:10.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:10 smithi118 ceph-mon[34374]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 100 KiB/s wr, 52 op/s 2024-09-13T17:14:10.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:10 smithi118 ceph-mon[34374]: scrub summary: idle 2024-09-13T17:14:12.462 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.458+0000 7fe9a1dff640 1 -- 172.21.15.87:0/1900726571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe99c0fff20 msgr2=0x7fe99c100300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:12.463 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.458+0000 7fe9a1dff640 1 --2- 172.21.15.87:0/1900726571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe99c0fff20 0x7fe99c100300 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe98c009930 tx=0x7fe98c02a420 comp rx=0 tx=0).stop 2024-09-13T17:14:12.463 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.458+0000 7fe9a1dff640 1 -- 172.21.15.87:0/1900726571 shutdown_connections 2024-09-13T17:14:12.463 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.458+0000 7fe9a1dff640 1 --2- 172.21.15.87:0/1900726571 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe99c105070 0x7fe99c10cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.463 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.458+0000 7fe9a1dff640 1 --2- 172.21.15.87:0/1900726571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe99c1008d0 0x7fe99c104910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.463 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.458+0000 7fe9a1dff640 1 --2- 172.21.15.87:0/1900726571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe99c0fff20 0x7fe99c100300 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.463 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.458+0000 7fe9a1dff640 1 -- 172.21.15.87:0/1900726571 >> 172.21.15.87:0/1900726571 conn(0x7fe99c0fb9b0 msgr2=0x7fe99c0fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:12.463 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.458+0000 7fe9a1dff640 1 -- 172.21.15.87:0/1900726571 shutdown_connections 2024-09-13T17:14:12.463 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.458+0000 7fe9a1dff640 1 -- 172.21.15.87:0/1900726571 wait complete. 2024-09-13T17:14:12.463 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.459+0000 7fe9a1dff640 1 Processor -- start 2024-09-13T17:14:12.463 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.459+0000 7fe9a1dff640 1 -- start start 2024-09-13T17:14:12.463 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.459+0000 7fe9a1dff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe99c0fff20 0x7fe99c196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.464 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.459+0000 7fe9a1dff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe99c105070 0x7fe99c196790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.464 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.459+0000 7fe9a1dff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe99c19ab80 0x7fe99c19b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.464 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.459+0000 7fe9a1dff640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c19b570 con 0x7fe99c0fff20 2024-09-13T17:14:12.464 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.459+0000 7fe9a1dff640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c19b6e0 con 0x7fe99c19ab80 2024-09-13T17:14:12.464 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.459+0000 7fe9a1dff640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c19b850 con 0x7fe99c105070 2024-09-13T17:14:12.464 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.459+0000 7fe99b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe99c0fff20 0x7fe99c196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.464 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.459+0000 7fe99b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe99c0fff20 0x7fe99c196250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39894/0 (socket says 172.21.15.87:39894) 2024-09-13T17:14:12.464 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.459+0000 7fe99b7fe640 1 -- 172.21.15.87:0/1709135952 learned_addr learned my addr 172.21.15.87:0/1709135952 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:12.464 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.459+0000 7fe99affd640 1 --2- 172.21.15.87:0/1709135952 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe99c105070 0x7fe99c196790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.464 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.460+0000 7fe99bfff640 1 --2- 172.21.15.87:0/1709135952 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe99c19ab80 0x7fe99c19b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.464 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.460+0000 7fe99b7fe640 1 -- 172.21.15.87:0/1709135952 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe99c105070 msgr2=0x7fe99c196790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:12.464 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.460+0000 7fe99b7fe640 1 --2- 172.21.15.87:0/1709135952 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe99c105070 0x7fe99c196790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.464 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.460+0000 7fe99b7fe640 1 -- 172.21.15.87:0/1709135952 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe99c19ab80 msgr2=0x7fe99c19b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:12.465 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.460+0000 7fe99b7fe640 1 --2- 172.21.15.87:0/1709135952 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe99c19ab80 0x7fe99c19b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.465 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.460+0000 7fe99b7fe640 1 -- 172.21.15.87:0/1709135952 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98c009560 con 0x7fe99c0fff20 2024-09-13T17:14:12.465 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.460+0000 7fe99b7fe640 1 --2- 172.21.15.87:0/1709135952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe99c0fff20 0x7fe99c196250 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe98c009900 tx=0x7fe98c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:12.465 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.460+0000 7fe998ff9640 1 -- 172.21.15.87:0/1709135952 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c003a00 con 0x7fe99c0fff20 2024-09-13T17:14:12.465 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.460+0000 7fe998ff9640 1 -- 172.21.15.87:0/1709135952 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe98c0044e0 con 0x7fe99c0fff20 2024-09-13T17:14:12.465 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.460+0000 7fe9a1dff640 1 -- 172.21.15.87:0/1709135952 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe99c1a2e30 con 0x7fe99c0fff20 2024-09-13T17:14:12.465 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.460+0000 7fe998ff9640 1 -- 172.21.15.87:0/1709135952 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c03a3c0 con 0x7fe99c0fff20 2024-09-13T17:14:12.465 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.460+0000 7fe9a1dff640 1 -- 172.21.15.87:0/1709135952 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe99c1a31f0 con 0x7fe99c0fff20 2024-09-13T17:14:12.467 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.462+0000 7fe998ff9640 1 -- 172.21.15.87:0/1709135952 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 25) v1 ==== 136106+0+0 (secure 0 0 0) 0x7fe98c03b460 con 0x7fe99c0fff20 2024-09-13T17:14:12.467 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.463+0000 7fe9a4bfd740 1 Processor -- start 2024-09-13T17:14:12.467 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.463+0000 7fe9a4bfd740 1 -- start start 2024-09-13T17:14:12.467 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.463+0000 7fe998ff9640 1 --2- 172.21.15.87:0/1709135952 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe9840a1320 0x7fe9840a37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.468 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.463+0000 7fe9a4bfd740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564522bde210 0x564522bde5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.468 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.463+0000 7fe9a4bfd740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564522bdeb30 0x564522bed3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.468 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.463+0000 7fe9a4bfd740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564522bed900 0x564522befcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.468 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.463+0000 7fe9a4bfd740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564522b49c30 con 0x564522bed900 2024-09-13T17:14:12.468 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.463+0000 7fe9a4bfd740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564522b473c0 con 0x564522bde210 2024-09-13T17:14:12.468 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.463+0000 7fe9a4bfd740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564522b42cb0 con 0x564522bdeb30 2024-09-13T17:14:12.468 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.463+0000 7fe99bfff640 1 --2- 172.21.15.87:0/1709135952 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe9840a1320 0x7fe9840a37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.468 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.464+0000 7fe998ff9640 1 -- 172.21.15.87:0/1709135952 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fe98c0ee330 con 0x7fe99c0fff20 2024-09-13T17:14:12.468 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.464+0000 7fe99b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564522bde210 0x564522bde5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.468 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.464+0000 7fe99bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564522bed900 0x564522befcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.468 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.464+0000 7fe99affd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564522bdeb30 0x564522bed3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.468 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.464+0000 7fe99b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564522bde210 0x564522bde5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.87:51318/0 (socket says 172.21.15.87:51318) 2024-09-13T17:14:12.469 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.464+0000 7fe99b7fe640 1 -- 172.21.15.87:0/470223613 learned_addr learned my addr 172.21.15.87:0/470223613 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:12.469 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.464+0000 7fe99b7fe640 1 -- 172.21.15.87:0/470223613 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564522bdeb30 msgr2=0x564522bed3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:12.469 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.464+0000 7fe99b7fe640 1 --2- 172.21.15.87:0/470223613 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564522bdeb30 0x564522bed3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.469 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.464+0000 7fe99b7fe640 1 -- 172.21.15.87:0/470223613 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564522bed900 msgr2=0x564522befcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:12.469 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.464+0000 7fe99b7fe640 1 --2- 172.21.15.87:0/470223613 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564522bed900 0x564522befcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.469 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.464+0000 7fe99b7fe640 1 -- 172.21.15.87:0/470223613 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564522ae9910 con 0x564522bde210 2024-09-13T17:14:12.469 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.464+0000 7fe99bfff640 1 --2- 172.21.15.87:0/470223613 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564522bed900 0x564522befcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:14:12.469 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.464+0000 7fe99bfff640 1 --2- 172.21.15.87:0/1709135952 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe9840a1320 0x7fe9840a37e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe9940058c0 tx=0x7fe99400ca70 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:12.469 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.464+0000 7fe99b7fe640 1 --2- 172.21.15.87:0/470223613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564522bde210 0x564522bde5f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe98c005ab0 tx=0x7fe98c02a420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d268ade6634c1d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:12.469 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.465+0000 7fe981ffb640 1 -- 172.21.15.87:0/470223613 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c086c60 con 0x564522bde210 2024-09-13T17:14:12.469 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.465+0000 7fe981ffb640 1 -- 172.21.15.87:0/470223613 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe98c087510 con 0x564522bde210 2024-09-13T17:14:12.469 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.465+0000 7fe981ffb640 1 -- 172.21.15.87:0/470223613 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c0b7620 con 0x564522bde210 2024-09-13T17:14:12.474 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.466+0000 7fe9a4bfd740 1 -- 172.21.15.87:0/470223613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564522bde210 msgr2=0x564522bde5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:12.474 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.466+0000 7fe9a4bfd740 1 --2- 172.21.15.87:0/470223613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564522bde210 0x564522bde5f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe98c005ab0 tx=0x7fe98c02a420 comp rx=0 tx=0).stop 2024-09-13T17:14:12.474 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.466+0000 7fe9a4bfd740 1 -- 172.21.15.87:0/470223613 shutdown_connections 2024-09-13T17:14:12.474 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.466+0000 7fe9a4bfd740 1 --2- 172.21.15.87:0/470223613 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564522bed900 0x564522befcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.474 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.466+0000 7fe9a4bfd740 1 --2- 172.21.15.87:0/470223613 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564522bdeb30 0x564522bed3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.474 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.466+0000 7fe9a4bfd740 1 --2- 172.21.15.87:0/470223613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564522bde210 0x564522bde5f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.474 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.466+0000 7fe9a4bfd740 1 -- 172.21.15.87:0/470223613 >> 172.21.15.87:0/470223613 conn(0x564522bda8c0 msgr2=0x564522bdaca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:12.474 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.466+0000 7fe9a4bfd740 1 -- 172.21.15.87:0/470223613 shutdown_connections 2024-09-13T17:14:12.474 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.466+0000 7fe9a4bfd740 1 -- 172.21.15.87:0/470223613 wait complete. 2024-09-13T17:14:12.475 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.466+0000 7fe9a4bfd740 1 -- start start 2024-09-13T17:14:12.475 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.467+0000 7fe9a4bfd740 1 Processor -- start 2024-09-13T17:14:12.475 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.467+0000 7fe9a4bfd740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564522bde210 0x564522bed260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.475 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.467+0000 7fe9a4bfd740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564522bdeb30 0x564522bea550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.475 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.467+0000 7fe9a4bfd740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564522bed900 0x564522beaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.475 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.467+0000 7fe9a4bfd740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564522b00e80 con 0x564522bdeb30 2024-09-13T17:14:12.475 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.467+0000 7fe9a4bfd740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564522b00b20 con 0x564522bed900 2024-09-13T17:14:12.475 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.467+0000 7fe9a4bfd740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564522ac6260 con 0x564522bde210 2024-09-13T17:14:12.475 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.467+0000 7fe9a4bfd740 10 client.0 _ll_register_callbacks cb 0x564522afbdf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:14:12.475 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.467+0000 7fe99affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564522bdeb30 0x564522bea550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.475 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.467+0000 7fe99affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564522bdeb30 0x564522bea550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39908/0 (socket says 172.21.15.87:39908) 2024-09-13T17:14:12.475 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.467+0000 7fe99affd640 1 -- 172.21.15.87:0/2203539643 learned_addr learned my addr 172.21.15.87:0/2203539643 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:12.475 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.467+0000 7fe99b7fe640 1 --2- 172.21.15.87:0/2203539643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564522bde210 0x564522bed260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.476 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.467+0000 7fe99bfff640 1 --2- 172.21.15.87:0/2203539643 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564522bed900 0x564522beaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.476 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.468+0000 7fe99affd640 1 -- 172.21.15.87:0/2203539643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564522bde210 msgr2=0x564522bed260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:12.476 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.468+0000 7fe99affd640 1 --2- 172.21.15.87:0/2203539643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564522bde210 0x564522bed260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.476 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.468+0000 7fe99affd640 1 -- 172.21.15.87:0/2203539643 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564522bed900 msgr2=0x564522beaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:12.476 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.468+0000 7fe99affd640 1 --2- 172.21.15.87:0/2203539643 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564522bed900 0x564522beaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.476 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.468+0000 7fe99affd640 1 -- 172.21.15.87:0/2203539643 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe99c1a31f0 con 0x564522bdeb30 2024-09-13T17:14:12.476 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.468+0000 7fe99affd640 1 --2- 172.21.15.87:0/2203539643 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564522bdeb30 0x564522bea550 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fe9900129b0 tx=0x7fe990012db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=764c6c35cd78ab33 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:12.476 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.468+0000 7fe97affd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:14:12.476 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.468+0000 7fe97affd640 1 -- 172.21.15.87:0/2203539643 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99000cde0 con 0x564522bdeb30 2024-09-13T17:14:12.476 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.468+0000 7fe9a4bfd740 1 -- 172.21.15.87:0/2203539643 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564522b6b680 con 0x564522bdeb30 2024-09-13T17:14:12.476 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.468+0000 7fe97affd640 1 -- 172.21.15.87:0/2203539643 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fe99001a3f0 con 0x564522bdeb30 2024-09-13T17:14:12.476 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.468+0000 7fe97affd640 1 -- 172.21.15.87:0/2203539643 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe99001a5b0 con 0x564522bdeb30 2024-09-13T17:14:12.476 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.468+0000 7fe9a4bfd740 10 client.15789 fetch_fsmap learned FSMap version 24 2024-09-13T17:14:12.477 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.468+0000 7fe9a4bfd740 1 -- 172.21.15.87:0/2203539643 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x564522b41330 con 0x564522bdeb30 2024-09-13T17:14:12.477 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.468+0000 7fe97affd640 1 -- 172.21.15.87:0/2203539643 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x564522b6b680 con 0x564522bdeb30 2024-09-13T17:14:12.477 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.468+0000 7fe97affd640 1 -- 172.21.15.87:0/2203539643 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fe99000e410 con 0x564522bdeb30 2024-09-13T17:14:12.477 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.469+0000 7fe9a4bfd740 10 client.15789 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:14:12.477 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.469+0000 7fe9a4bfd740 10 client.15789 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-13T17:14:12.477 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.469+0000 7fe9a4bfd740 20 client.15789 populate_metadata read hostname 'smithi087' 2024-09-13T17:14:12.477 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.469+0000 7fe9a4bfd740 1 --2- 172.21.15.87:0/2203539643 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x564522bfcff0 0x564522bff410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.477 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.469+0000 7fe9a4bfd740 4 client.15789 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:14:12.477 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.469+0000 7fe9a4bfd740 1 -- 172.21.15.87:0/2203539643 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564522b365d0 con 0x564522bfcff0 2024-09-13T17:14:12.477 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.469+0000 7fe99b7fe640 1 --2- 172.21.15.87:0/2203539643 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x564522bfcff0 0x564522bff410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.477 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.469+0000 7fe97affd640 10 client.15789 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:12.477 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.469+0000 7fe99b7fe640 1 --2- 172.21.15.87:0/2203539643 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x564522bfcff0 0x564522bff410 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8ff8649fb981e77 server_cookie=e073b9a19975058d in_seq=0 out_seq=0 2024-09-13T17:14:12.478 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.470+0000 7fe97affd640 1 -- 172.21.15.87:0/2203539643 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x564522b365d0 con 0x564522bfcff0 2024-09-13T17:14:12.478 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.470+0000 7fe97affd640 10 client.15789 handle_command_reply: tid=0 2024-09-13T17:14:12.478 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.470+0000 7fe9a4bfd740 1 client.15789 shutdown 2024-09-13T17:14:12.478 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.470+0000 7fe9a4bfd740 1 -- 172.21.15.87:0/2203539643 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564522bdeb30 msgr2=0x564522bea550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:12.478 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.470+0000 7fe9a4bfd740 1 --2- 172.21.15.87:0/2203539643 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564522bdeb30 0x564522bea550 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fe9900129b0 tx=0x7fe990012db0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.478 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.470+0000 7fe9a4bfd740 1 -- 172.21.15.87:0/2203539643 shutdown_connections 2024-09-13T17:14:12.478 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.470+0000 7fe9a4bfd740 1 --2- 172.21.15.87:0/2203539643 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x564522bfcff0 0x564522bff410 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.478 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.470+0000 7fe9a4bfd740 1 --2- 172.21.15.87:0/2203539643 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564522bed900 0x564522beaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.478 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.470+0000 7fe97affd640 0 client.15789 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:12.478 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.470+0000 7fe9a4bfd740 1 --2- 172.21.15.87:0/2203539643 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564522bdeb30 0x564522bea550 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.478 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.470+0000 7fe9a4bfd740 1 --2- 172.21.15.87:0/2203539643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564522bde210 0x564522bed260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.478 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.470+0000 7fe9a4bfd740 1 -- 172.21.15.87:0/2203539643 >> 172.21.15.87:0/2203539643 conn(0x564522bda8c0 msgr2=0x564522be0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:12.478 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.470+0000 7fe9a4bfd740 1 -- 172.21.15.87:0/2203539643 shutdown_connections 2024-09-13T17:14:12.478 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.470+0000 7fe9a4bfd740 1 -- 172.21.15.87:0/2203539643 wait complete. 2024-09-13T17:14:12.479 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.470+0000 7fe9a4bfd740 20 client.15789 trim_cache size 0 max 16384 2024-09-13T17:14:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.483+0000 7fe9a4bfd740 1 Processor -- start 2024-09-13T17:14:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.483+0000 7fe9a4bfd740 1 -- start start 2024-09-13T17:14:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.483+0000 7fe9a4bfd740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564522bde210 0x564522bda300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.483+0000 7fe9a4bfd740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564522bdeb30 0x564522bf42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.483+0000 7fe9a4bfd740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564522bed900 0x564522bf4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.483+0000 7fe9a4bfd740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564522bfb820 con 0x564522bed900 2024-09-13T17:14:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.483+0000 7fe9a4bfd740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564522bd4f90 con 0x564522bde210 2024-09-13T17:14:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.483+0000 7fe9a4bfd740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564522be8ac0 con 0x564522bdeb30 2024-09-13T17:14:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.483+0000 7fe99bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564522bed900 0x564522bf4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.483+0000 7fe99bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564522bed900 0x564522bf4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39924/0 (socket says 172.21.15.87:39924) 2024-09-13T17:14:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.483+0000 7fe99bfff640 1 -- 172.21.15.87:0/3498908518 learned_addr learned my addr 172.21.15.87:0/3498908518 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.483+0000 7fe99bfff640 1 -- 172.21.15.87:0/3498908518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564522bdeb30 msgr2=0x564522bf42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.483+0000 7fe99affd640 1 --2- 172.21.15.87:0/3498908518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564522bdeb30 0x564522bf42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.483+0000 7fe99b7fe640 1 --2- 172.21.15.87:0/3498908518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564522bde210 0x564522bda300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.483+0000 7fe99bfff640 1 --2- 172.21.15.87:0/3498908518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564522bdeb30 0x564522bf42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.483+0000 7fe99bfff640 1 -- 172.21.15.87:0/3498908518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564522bde210 msgr2=0x564522bda300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.483+0000 7fe99bfff640 1 --2- 172.21.15.87:0/3498908518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564522bde210 0x564522bda300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.483+0000 7fe99bfff640 1 -- 172.21.15.87:0/3498908518 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564522ae3300 con 0x564522bed900 2024-09-13T17:14:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.484+0000 7fe99bfff640 1 --2- 172.21.15.87:0/3498908518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564522bed900 0x564522bf4820 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fe9940141e0 tx=0x7fe994004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e33022bd51431b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.484+0000 7fe9827fc640 1 -- 172.21.15.87:0/3498908518 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9940129d0 con 0x564522bed900 2024-09-13T17:14:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.484+0000 7fe9827fc640 1 -- 172.21.15.87:0/3498908518 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe994025070 con 0x564522bed900 2024-09-13T17:14:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.484+0000 7fe9827fc640 1 -- 172.21.15.87:0/3498908518 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe994021c10 con 0x564522bed900 2024-09-13T17:14:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.484+0000 7fe9a4bfd740 1 -- 172.21.15.87:0/3498908518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564522bed900 msgr2=0x564522bf4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.484+0000 7fe9a4bfd740 1 --2- 172.21.15.87:0/3498908518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564522bed900 0x564522bf4820 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fe9940141e0 tx=0x7fe994004730 comp rx=0 tx=0).stop 2024-09-13T17:14:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.484+0000 7fe9a4bfd740 1 -- 172.21.15.87:0/3498908518 shutdown_connections 2024-09-13T17:14:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.484+0000 7fe9a4bfd740 1 --2- 172.21.15.87:0/3498908518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564522bed900 0x564522bf4820 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.484+0000 7fe9a4bfd740 1 --2- 172.21.15.87:0/3498908518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564522bdeb30 0x564522bf42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.484+0000 7fe9a4bfd740 1 --2- 172.21.15.87:0/3498908518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564522bde210 0x564522bda300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.484+0000 7fe9a4bfd740 1 -- 172.21.15.87:0/3498908518 >> 172.21.15.87:0/3498908518 conn(0x564522bda8c0 msgr2=0x564522be5860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.484+0000 7fe9a4bfd740 1 -- 172.21.15.87:0/3498908518 shutdown_connections 2024-09-13T17:14:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.484+0000 7fe9a4bfd740 1 -- 172.21.15.87:0/3498908518 wait complete. 2024-09-13T17:14:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.485+0000 7fe9a4bfd740 1 -- start start 2024-09-13T17:14:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.485+0000 7fe9a4bfd740 1 Processor -- start 2024-09-13T17:14:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.485+0000 7fe9a4bfd740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564522bde210 0x564522be7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.485+0000 7fe9a4bfd740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564522bdeb30 0x564522be7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.485+0000 7fe9a4bfd740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564522bed900 0x564522be8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.485+0000 7fe9a4bfd740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564522c535c0 con 0x564522bdeb30 2024-09-13T17:14:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.485+0000 7fe9a4bfd740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564522c53730 con 0x564522bed900 2024-09-13T17:14:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.485+0000 7fe9a4bfd740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564522c538f0 con 0x564522bde210 2024-09-13T17:14:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.485+0000 7fe9a4bfd740 10 client.0 _ll_register_callbacks cb 0x7fe98c0b7310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:14:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.485+0000 7fe99affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564522bdeb30 0x564522be7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.485+0000 7fe99affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564522bdeb30 0x564522be7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39938/0 (socket says 172.21.15.87:39938) 2024-09-13T17:14:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.485+0000 7fe99affd640 1 -- 172.21.15.87:0/3737172132 learned_addr learned my addr 172.21.15.87:0/3737172132 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.486+0000 7fe99bfff640 1 --2- 172.21.15.87:0/3737172132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564522bed900 0x564522be8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.486+0000 7fe99b7fe640 1 --2- 172.21.15.87:0/3737172132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564522bde210 0x564522be7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.486+0000 7fe99affd640 1 -- 172.21.15.87:0/3737172132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564522bde210 msgr2=0x564522be7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.486+0000 7fe99affd640 1 --2- 172.21.15.87:0/3737172132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564522bde210 0x564522be7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.486+0000 7fe99affd640 1 -- 172.21.15.87:0/3737172132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564522bed900 msgr2=0x564522be8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.486+0000 7fe99affd640 1 --2- 172.21.15.87:0/3737172132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564522bed900 0x564522be8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.486+0000 7fe99affd640 1 -- 172.21.15.87:0/3737172132 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe99400c400 con 0x564522bdeb30 2024-09-13T17:14:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.486+0000 7fe99affd640 1 --2- 172.21.15.87:0/3737172132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564522bdeb30 0x564522be7bc0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe990012470 tx=0x7fe990012690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e97ae333dfcd0aa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.486+0000 7fe97affd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:14:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.486+0000 7fe97affd640 1 -- 172.21.15.87:0/3737172132 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99000e590 con 0x564522bdeb30 2024-09-13T17:14:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.486+0000 7fe97affd640 1 -- 172.21.15.87:0/3737172132 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fe99000cbe0 con 0x564522bdeb30 2024-09-13T17:14:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.486+0000 7fe9a4bfd740 1 -- 172.21.15.87:0/3737172132 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe98c087510 con 0x564522bdeb30 2024-09-13T17:14:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.486+0000 7fe97affd640 1 -- 172.21.15.87:0/3737172132 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe99000ee70 con 0x564522bdeb30 2024-09-13T17:14:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.486+0000 7fe9a4bfd740 10 client.15795 fetch_fsmap learned FSMap version 24 2024-09-13T17:14:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.486+0000 7fe9a4bfd740 1 -- 172.21.15.87:0/3737172132 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x564522b088e0 con 0x564522bdeb30 2024-09-13T17:14:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.486+0000 7fe97affd640 1 -- 172.21.15.87:0/3737172132 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe98c087510 con 0x564522bdeb30 2024-09-13T17:14:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.486+0000 7fe97affd640 1 -- 172.21.15.87:0/3737172132 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fe990031060 con 0x564522bdeb30 2024-09-13T17:14:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.487+0000 7fe9a4bfd740 10 client.15795 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:14:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.487+0000 7fe9a4bfd740 10 client.15795 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-13T17:14:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.487+0000 7fe9a4bfd740 20 client.15795 populate_metadata read hostname 'smithi087' 2024-09-13T17:14:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.487+0000 7fe9a4bfd740 1 --2- 172.21.15.87:0/3737172132 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x564522c55090 0x564522c574b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.487+0000 7fe9a4bfd740 4 client.15795 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T17:14:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.487+0000 7fe9a4bfd740 1 -- 172.21.15.87:0/3737172132 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564522836300 con 0x564522c55090 2024-09-13T17:14:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.487+0000 7fe99b7fe640 1 --2- 172.21.15.87:0/3737172132 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x564522c55090 0x564522c574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.487+0000 7fe99b7fe640 1 --2- 172.21.15.87:0/3737172132 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x564522c55090 0x564522c574b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f7fb56034bc9a6c server_cookie=2ce7258f4309b9c in_seq=0 out_seq=0 2024-09-13T17:14:12.495 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.487+0000 7fe97affd640 10 client.15795 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.499+0000 7fe97affd640 1 -- 172.21.15.87:0/3737172132 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564522836300 con 0x564522c55090 2024-09-13T17:14:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.499+0000 7fe97affd640 10 client.15795 handle_command_reply: tid=0 2024-09-13T17:14:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.499+0000 7fe9a4bfd740 1 client.15795 shutdown 2024-09-13T17:14:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.499+0000 7fe9a4bfd740 1 -- 172.21.15.87:0/3737172132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564522bdeb30 msgr2=0x564522be7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.499+0000 7fe9a4bfd740 1 --2- 172.21.15.87:0/3737172132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564522bdeb30 0x564522be7bc0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe990012470 tx=0x7fe990012690 comp rx=0 tx=0).stop 2024-09-13T17:14:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.499+0000 7fe9a4bfd740 1 -- 172.21.15.87:0/3737172132 shutdown_connections 2024-09-13T17:14:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.499+0000 7fe9a4bfd740 1 --2- 172.21.15.87:0/3737172132 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x564522c55090 0x564522c574b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.499+0000 7fe9a4bfd740 1 --2- 172.21.15.87:0/3737172132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564522bed900 0x564522be8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.499+0000 7fe9a4bfd740 1 --2- 172.21.15.87:0/3737172132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564522bdeb30 0x564522be7bc0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.499+0000 7fe97affd640 0 client.15795 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.499+0000 7fe9a4bfd740 1 --2- 172.21.15.87:0/3737172132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564522bde210 0x564522be7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.499+0000 7fe9a4bfd740 1 -- 172.21.15.87:0/3737172132 >> 172.21.15.87:0/3737172132 conn(0x564522bda8c0 msgr2=0x564522be8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.499+0000 7fe9a4bfd740 1 -- 172.21.15.87:0/3737172132 shutdown_connections 2024-09-13T17:14:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.499+0000 7fe9a4bfd740 1 -- 172.21.15.87:0/3737172132 wait complete. 2024-09-13T17:14:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.499+0000 7fe9a4bfd740 20 client.15795 trim_cache size 0 max 16384 2024-09-13T17:14:12.503 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout:{ 2024-09-13T17:14:12.503 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout: "message": "", 2024-09-13T17:14:12.503 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout: "return_code": 0 2024-09-13T17:14:12.503 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout:} 2024-09-13T17:14:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.500+0000 7fe9a1dff640 1 -- 172.21.15.87:0/1709135952 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe9840a1320 msgr2=0x7fe9840a37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.500+0000 7fe9a1dff640 1 --2- 172.21.15.87:0/1709135952 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe9840a1320 0x7fe9840a37e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe9940058c0 tx=0x7fe99400ca70 comp rx=0 tx=0).stop 2024-09-13T17:14:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.500+0000 7fe9a1dff640 1 -- 172.21.15.87:0/1709135952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe99c0fff20 msgr2=0x7fe99c196250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.500+0000 7fe9a1dff640 1 --2- 172.21.15.87:0/1709135952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe99c0fff20 0x7fe99c196250 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe98c009900 tx=0x7fe98c0042f0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.500+0000 7fe9a1dff640 1 -- 172.21.15.87:0/1709135952 shutdown_connections 2024-09-13T17:14:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.500+0000 7fe9a1dff640 1 --2- 172.21.15.87:0/1709135952 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe99c19ab80 0x7fe99c19b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.500+0000 7fe9a1dff640 1 --2- 172.21.15.87:0/1709135952 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe99c105070 0x7fe99c196790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.500+0000 7fe9a1dff640 1 --2- 172.21.15.87:0/1709135952 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe9840a1320 0x7fe9840a37e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.500+0000 7fe9a1dff640 1 --2- 172.21.15.87:0/1709135952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe99c0fff20 0x7fe99c196250 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.500+0000 7fe9a1dff640 1 -- 172.21.15.87:0/1709135952 >> 172.21.15.87:0/1709135952 conn(0x7fe99c0fb9b0 msgr2=0x7fe99c0fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:12.505 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.500+0000 7fe9a1dff640 1 -- 172.21.15.87:0/1709135952 shutdown_connections 2024-09-13T17:14:12.505 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:12.500+0000 7fe9a1dff640 1 -- 172.21.15.87:0/1709135952 wait complete. 2024-09-13T17:14:12.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:12 smithi087 ceph-mon[30934]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 100 KiB/s wr, 55 op/s 2024-09-13T17:14:12.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:12 smithi149 ceph-mon[35496]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 100 KiB/s wr, 55 op/s 2024-09-13T17:14:12.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:12 smithi118 ceph-mon[34374]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 100 KiB/s wr, 55 op/s 2024-09-13T17:14:14.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:14 smithi087 ceph-mon[30934]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 20 op/s 2024-09-13T17:14:14.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:14 smithi149 ceph-mon[35496]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 20 op/s 2024-09-13T17:14:14.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:14 smithi118 ceph-mon[34374]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 20 op/s 2024-09-13T17:14:16.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:16 smithi087 ceph-mon[30934]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-09-13T17:14:16.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:16 smithi149 ceph-mon[35496]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-09-13T17:14:16.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:16 smithi118 ceph-mon[34374]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-09-13T17:14:18.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:18 smithi087 ceph-mon[30934]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 27 op/s 2024-09-13T17:14:18.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:18 smithi149 ceph-mon[35496]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 27 op/s 2024-09-13T17:14:18.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:18 smithi118 ceph-mon[34374]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 27 op/s 2024-09-13T17:14:20.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:20 smithi087 ceph-mon[30934]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-13T17:14:20.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:20 smithi149 ceph-mon[35496]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-13T17:14:20.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:20 smithi118 ceph-mon[34374]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-13T17:14:22.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:22 smithi087 ceph-mon[30934]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-13T17:14:22.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:22 smithi149 ceph-mon[35496]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-13T17:14:22.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:22 smithi118 ceph-mon[34374]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-13T17:14:23.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:23 smithi149 ceph-mon[35496]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-13T17:14:23.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:23 smithi118 ceph-mon[34374]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-13T17:14:23.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:23 smithi087 ceph-mon[30934]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-13T17:14:25.609 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.589+0000 7f5ba92b7640 1 -- 172.21.15.87:0/4139576297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ba4104c30 msgr2=0x7f5ba4105010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:25.609 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.589+0000 7f5ba92b7640 1 --2- 172.21.15.87:0/4139576297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ba4104c30 0x7f5ba4105010 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5b94009930 tx=0x7f5b9402a420 comp rx=0 tx=0).stop 2024-09-13T17:14:25.609 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.589+0000 7f5ba92b7640 1 -- 172.21.15.87:0/4139576297 shutdown_connections 2024-09-13T17:14:25.610 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.589+0000 7f5ba92b7640 1 --2- 172.21.15.87:0/4139576297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ba40ff970 0x7f5ba410ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.610 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.589+0000 7f5ba92b7640 1 --2- 172.21.15.87:0/4139576297 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ba40feff0 0x7f5ba40ff430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.610 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.589+0000 7f5ba92b7640 1 --2- 172.21.15.87:0/4139576297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ba4104c30 0x7f5ba4105010 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.610 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.590+0000 7f5ba92b7640 1 -- 172.21.15.87:0/4139576297 >> 172.21.15.87:0/4139576297 conn(0x7f5ba4074940 msgr2=0x7f5ba4074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:25.610 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.590+0000 7f5ba92b7640 1 -- 172.21.15.87:0/4139576297 shutdown_connections 2024-09-13T17:14:25.610 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.590+0000 7f5ba92b7640 1 -- 172.21.15.87:0/4139576297 wait complete. 2024-09-13T17:14:25.610 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.590+0000 7f5ba92b7640 1 Processor -- start 2024-09-13T17:14:25.610 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.590+0000 7f5ba92b7640 1 -- start start 2024-09-13T17:14:25.610 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.590+0000 7f5ba92b7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ba40feff0 0x7f5ba4100870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.610 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.591+0000 7f5ba92b7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ba40ff970 0x7f5ba4100db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.610 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.591+0000 7f5ba92b7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ba4104c30 0x7f5ba41012f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.610 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.591+0000 7f5ba92b7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba41a45e0 con 0x7f5ba40ff970 2024-09-13T17:14:25.610 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.591+0000 7f5ba92b7640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba41a4750 con 0x7f5ba4104c30 2024-09-13T17:14:25.611 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.591+0000 7f5ba92b7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba41a4910 con 0x7f5ba40feff0 2024-09-13T17:14:25.611 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.591+0000 7f5ba27fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ba40ff970 0x7f5ba4100db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.611 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.591+0000 7f5ba27fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ba40ff970 0x7f5ba4100db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47338/0 (socket says 172.21.15.87:47338) 2024-09-13T17:14:25.611 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.591+0000 7f5ba27fc640 1 -- 172.21.15.87:0/813448762 learned_addr learned my addr 172.21.15.87:0/813448762 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:25.611 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.591+0000 7f5ba2ffd640 1 --2- 172.21.15.87:0/813448762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ba40feff0 0x7f5ba4100870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.611 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.591+0000 7f5ba37fe640 1 --2- 172.21.15.87:0/813448762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ba4104c30 0x7f5ba41012f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.611 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.591+0000 7f5ba27fc640 1 -- 172.21.15.87:0/813448762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ba40feff0 msgr2=0x7f5ba4100870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:25.611 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.591+0000 7f5ba27fc640 1 --2- 172.21.15.87:0/813448762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ba40feff0 0x7f5ba4100870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.611 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.591+0000 7f5ba27fc640 1 -- 172.21.15.87:0/813448762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ba4104c30 msgr2=0x7f5ba41012f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:25.611 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.591+0000 7f5ba27fc640 1 --2- 172.21.15.87:0/813448762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ba4104c30 0x7f5ba41012f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.611 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.591+0000 7f5ba27fc640 1 -- 172.21.15.87:0/813448762 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b94009560 con 0x7f5ba40ff970 2024-09-13T17:14:25.611 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.591+0000 7f5ba37fe640 1 --2- 172.21.15.87:0/813448762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ba4104c30 0x7f5ba41012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:25.611 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.591+0000 7f5ba27fc640 1 --2- 172.21.15.87:0/813448762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ba40ff970 0x7f5ba4100db0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f5b9800e9f0 tx=0x7f5b9800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.591+0000 7f5b8bfff640 1 -- 172.21.15.87:0/813448762 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b98009700 con 0x7f5ba40ff970 2024-09-13T17:14:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.591+0000 7f5b8bfff640 1 -- 172.21.15.87:0/813448762 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5b9800cd80 con 0x7f5ba40ff970 2024-09-13T17:14:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.591+0000 7f5b8bfff640 1 -- 172.21.15.87:0/813448762 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b98018840 con 0x7f5ba40ff970 2024-09-13T17:14:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.591+0000 7f5ba92b7640 1 -- 172.21.15.87:0/813448762 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ba41a4bf0 con 0x7f5ba40ff970 2024-09-13T17:14:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.592+0000 7f5ba92b7640 1 -- 172.21.15.87:0/813448762 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba41a50b0 con 0x7f5ba40ff970 2024-09-13T17:14:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.594+0000 7f5b8bfff640 1 -- 172.21.15.87:0/813448762 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 25) v1 ==== 136106+0+0 (secure 0 0 0) 0x7f5b980189a0 con 0x7f5ba40ff970 2024-09-13T17:14:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.594+0000 7f5b8bfff640 1 --2- 172.21.15.87:0/813448762 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5b8c0a1320 0x7f5b8c0a37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.594+0000 7f5ba2ffd640 1 --2- 172.21.15.87:0/813448762 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5b8c0a1320 0x7f5b8c0a37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.594+0000 7f5b8bfff640 1 -- 172.21.15.87:0/813448762 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f5b98014070 con 0x7f5ba40ff970 2024-09-13T17:14:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.595+0000 7f5babfde740 1 Processor -- start 2024-09-13T17:14:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.595+0000 7f5ba2ffd640 1 --2- 172.21.15.87:0/813448762 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5b8c0a1320 0x7f5b8c0a37e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5b94005ab0 tx=0x7f5b94005a20 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.595+0000 7f5babfde740 1 -- start start 2024-09-13T17:14:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.595+0000 7f5babfde740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557aeff8d330 0x557aeff8d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.595+0000 7f5babfde740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557aeff8dc50 0x557aeff97fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.595+0000 7f5babfde740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557aeff984f0 0x557aeff9a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.595+0000 7f5babfde740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aefef8c30 con 0x557aeff8dc50 2024-09-13T17:14:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.595+0000 7f5babfde740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aefef63c0 con 0x557aeff984f0 2024-09-13T17:14:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.595+0000 7f5babfde740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aefef1cb0 con 0x557aeff8d330 2024-09-13T17:14:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.595+0000 7f5ba27fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557aeff8dc50 0x557aeff97fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.595+0000 7f5ba27fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557aeff8dc50 0x557aeff97fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47344/0 (socket says 172.21.15.87:47344) 2024-09-13T17:14:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.595+0000 7f5ba27fc640 1 -- 172.21.15.87:0/2075264338 learned_addr learned my addr 172.21.15.87:0/2075264338 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.596+0000 7f5ba2ffd640 1 --2- 172.21.15.87:0/2075264338 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557aeff8d330 0x557aeff8d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.596+0000 7f5ba37fe640 1 --2- 172.21.15.87:0/2075264338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557aeff984f0 0x557aeff9a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.596+0000 7f5ba27fc640 1 -- 172.21.15.87:0/2075264338 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557aeff8d330 msgr2=0x557aeff8d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.596+0000 7f5ba27fc640 1 --2- 172.21.15.87:0/2075264338 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557aeff8d330 0x557aeff8d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.596+0000 7f5ba27fc640 1 -- 172.21.15.87:0/2075264338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557aeff984f0 msgr2=0x557aeff9a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.596+0000 7f5ba27fc640 1 --2- 172.21.15.87:0/2075264338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557aeff984f0 0x557aeff9a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.596+0000 7f5ba27fc640 1 -- 172.21.15.87:0/2075264338 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557aefe98910 con 0x557aeff8dc50 2024-09-13T17:14:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.596+0000 7f5ba27fc640 1 --2- 172.21.15.87:0/2075264338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557aeff8dc50 0x557aeff97fb0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5b9800e9c0 tx=0x7f5b9809a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee4d28b05e4ad5b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.596+0000 7f5b897fa640 1 -- 172.21.15.87:0/2075264338 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b980b0070 con 0x557aeff8dc50 2024-09-13T17:14:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.596+0000 7f5b897fa640 1 -- 172.21.15.87:0/2075264338 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5b980a2680 con 0x557aeff8dc50 2024-09-13T17:14:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.596+0000 7f5b897fa640 1 -- 172.21.15.87:0/2075264338 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b980cd300 con 0x557aeff8dc50 2024-09-13T17:14:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.597+0000 7f5babfde740 1 -- 172.21.15.87:0/2075264338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557aeff8dc50 msgr2=0x557aeff97fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.597+0000 7f5babfde740 1 --2- 172.21.15.87:0/2075264338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557aeff8dc50 0x557aeff97fb0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5b9800e9c0 tx=0x7f5b9809a900 comp rx=0 tx=0).stop 2024-09-13T17:14:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.597+0000 7f5babfde740 1 -- 172.21.15.87:0/2075264338 shutdown_connections 2024-09-13T17:14:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.597+0000 7f5babfde740 1 --2- 172.21.15.87:0/2075264338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557aeff984f0 0x557aeff9a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.597+0000 7f5babfde740 1 --2- 172.21.15.87:0/2075264338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557aeff8dc50 0x557aeff97fb0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.615 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.597+0000 7f5babfde740 1 --2- 172.21.15.87:0/2075264338 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557aeff8d330 0x557aeff8d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.615 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.597+0000 7f5babfde740 1 -- 172.21.15.87:0/2075264338 >> 172.21.15.87:0/2075264338 conn(0x557aeff898c0 msgr2=0x557aeff89ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:25.615 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.597+0000 7f5babfde740 1 -- 172.21.15.87:0/2075264338 shutdown_connections 2024-09-13T17:14:25.615 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.597+0000 7f5babfde740 1 -- 172.21.15.87:0/2075264338 wait complete. 2024-09-13T17:14:25.615 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.597+0000 7f5babfde740 1 -- start start 2024-09-13T17:14:25.615 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.597+0000 7f5babfde740 1 Processor -- start 2024-09-13T17:14:25.615 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.598+0000 7f5babfde740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557aeff8d330 0x557aeff97ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.615 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.598+0000 7f5babfde740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557aeff8dc50 0x557aeff951d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.615 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.598+0000 7f5babfde740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557aeff984f0 0x557aeff957c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.615 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.598+0000 7f5babfde740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aefeafe80 con 0x557aeff8d330 2024-09-13T17:14:25.615 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.598+0000 7f5babfde740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aefeafb20 con 0x557aeff8dc50 2024-09-13T17:14:25.615 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.598+0000 7f5babfde740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aefe75260 con 0x557aeff984f0 2024-09-13T17:14:25.615 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.598+0000 7f5babfde740 10 client.0 _ll_register_callbacks cb 0x557aefeaadf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:14:25.616 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.598+0000 7f5ba2ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557aeff8d330 0x557aeff97ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.616 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.598+0000 7f5ba2ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557aeff8d330 0x557aeff97ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47354/0 (socket says 172.21.15.87:47354) 2024-09-13T17:14:25.616 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.598+0000 7f5ba2ffd640 1 -- 172.21.15.87:0/1046976393 learned_addr learned my addr 172.21.15.87:0/1046976393 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:25.616 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.598+0000 7f5ba27fc640 1 --2- 172.21.15.87:0/1046976393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557aeff8dc50 0x557aeff951d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.616 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.598+0000 7f5ba37fe640 1 --2- 172.21.15.87:0/1046976393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557aeff984f0 0x557aeff957c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.616 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.598+0000 7f5ba2ffd640 1 -- 172.21.15.87:0/1046976393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557aeff984f0 msgr2=0x557aeff957c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:25.616 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.598+0000 7f5ba2ffd640 1 --2- 172.21.15.87:0/1046976393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557aeff984f0 0x557aeff957c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.616 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.598+0000 7f5ba2ffd640 1 -- 172.21.15.87:0/1046976393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557aeff8dc50 msgr2=0x557aeff951d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:25.616 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.598+0000 7f5ba2ffd640 1 --2- 172.21.15.87:0/1046976393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557aeff8dc50 0x557aeff951d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.616 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.598+0000 7f5ba2ffd640 1 -- 172.21.15.87:0/1046976393 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba41a50b0 con 0x557aeff8d330 2024-09-13T17:14:25.616 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.598+0000 7f5ba2ffd640 1 --2- 172.21.15.87:0/1046976393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557aeff8d330 0x557aeff97ee0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f5b940057c0 tx=0x7f5b9402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d1fe12d3b73cc5e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:25.616 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.598+0000 7f5b86ff5640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:14:25.616 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.599+0000 7f5b86ff5640 1 -- 172.21.15.87:0/1046976393 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b940038b0 con 0x557aeff8d330 2024-09-13T17:14:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.599+0000 7f5b86ff5640 1 -- 172.21.15.87:0/1046976393 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f5b94042070 con 0x557aeff8d330 2024-09-13T17:14:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.599+0000 7f5babfde740 1 -- 172.21.15.87:0/1046976393 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557aeff1a680 con 0x557aeff8d330 2024-09-13T17:14:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.599+0000 7f5b86ff5640 1 -- 172.21.15.87:0/1046976393 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b94003a10 con 0x557aeff8d330 2024-09-13T17:14:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.599+0000 7f5babfde740 10 client.15807 fetch_fsmap learned FSMap version 24 2024-09-13T17:14:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.599+0000 7f5babfde740 1 -- 172.21.15.87:0/1046976393 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x557aefef0330 con 0x557aeff8d330 2024-09-13T17:14:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.599+0000 7f5b86ff5640 1 -- 172.21.15.87:0/1046976393 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x557aeff1a680 con 0x557aeff8d330 2024-09-13T17:14:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.599+0000 7f5b86ff5640 1 -- 172.21.15.87:0/1046976393 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f5b94045040 con 0x557aeff8d330 2024-09-13T17:14:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.599+0000 7f5babfde740 10 client.15807 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:14:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.599+0000 7f5babfde740 10 client.15807 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-13T17:14:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.599+0000 7f5babfde740 20 client.15807 populate_metadata read hostname 'smithi087' 2024-09-13T17:14:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.599+0000 7f5babfde740 1 --2- 172.21.15.87:0/1046976393 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x557aeffa7f20 0x557aeffaa310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.599+0000 7f5babfde740 4 client.15807 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:14:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.599+0000 7f5babfde740 1 -- 172.21.15.87:0/1046976393 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557aefee55d0 con 0x557aeffa7f20 2024-09-13T17:14:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.600+0000 7f5ba27fc640 1 --2- 172.21.15.87:0/1046976393 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x557aeffa7f20 0x557aeffaa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.600+0000 7f5ba27fc640 1 --2- 172.21.15.87:0/1046976393 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x557aeffa7f20 0x557aeffaa310 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf3de743153f876f server_cookie=75909621f8a08caa in_seq=0 out_seq=0 2024-09-13T17:14:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.600+0000 7f5b86ff5640 10 client.15807 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.601+0000 7f5b86ff5640 1 -- 172.21.15.87:0/1046976393 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x557aefee55d0 con 0x557aeffa7f20 2024-09-13T17:14:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.601+0000 7f5b86ff5640 10 client.15807 handle_command_reply: tid=0 2024-09-13T17:14:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.601+0000 7f5babfde740 1 client.15807 shutdown 2024-09-13T17:14:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.601+0000 7f5babfde740 1 -- 172.21.15.87:0/1046976393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557aeff8d330 msgr2=0x557aeff97ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.601+0000 7f5babfde740 1 --2- 172.21.15.87:0/1046976393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557aeff8d330 0x557aeff97ee0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f5b940057c0 tx=0x7f5b9402a420 comp rx=0 tx=0).stop 2024-09-13T17:14:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.601+0000 7f5babfde740 1 -- 172.21.15.87:0/1046976393 shutdown_connections 2024-09-13T17:14:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.601+0000 7f5babfde740 1 --2- 172.21.15.87:0/1046976393 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x557aeffa7f20 0x557aeffaa310 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.601+0000 7f5babfde740 1 --2- 172.21.15.87:0/1046976393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557aeff984f0 0x557aeff957c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.601+0000 7f5babfde740 1 --2- 172.21.15.87:0/1046976393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557aeff8dc50 0x557aeff951d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.619 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.601+0000 7f5b86ff5640 0 client.15807 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:25.619 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.601+0000 7f5babfde740 1 --2- 172.21.15.87:0/1046976393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557aeff8d330 0x557aeff97ee0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.619 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.601+0000 7f5babfde740 1 -- 172.21.15.87:0/1046976393 >> 172.21.15.87:0/1046976393 conn(0x557aeff898c0 msgr2=0x557aeff88b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:25.619 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.601+0000 7f5babfde740 1 -- 172.21.15.87:0/1046976393 shutdown_connections 2024-09-13T17:14:25.619 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.601+0000 7f5babfde740 1 -- 172.21.15.87:0/1046976393 wait complete. 2024-09-13T17:14:25.619 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.601+0000 7f5babfde740 20 client.15807 trim_cache size 0 max 16384 2024-09-13T17:14:25.625 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.613+0000 7f5babfde740 1 Processor -- start 2024-09-13T17:14:25.625 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.613+0000 7f5babfde740 1 -- start start 2024-09-13T17:14:25.625 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.613+0000 7f5babfde740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557aeff8d330 0x557aeff979f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.625 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.613+0000 7f5babfde740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557aeff8dc50 0x557aeff93a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.625 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.613+0000 7f5babfde740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557aeff984f0 0x557aeff93fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.625 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.613+0000 7f5babfde740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aeff94550 con 0x557aeff8d330 2024-09-13T17:14:25.625 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.613+0000 7f5babfde740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aeff83fc0 con 0x557aeff8dc50 2024-09-13T17:14:25.625 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.613+0000 7f5babfde740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aeff93700 con 0x557aeff984f0 2024-09-13T17:14:25.625 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.614+0000 7f5ba2ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557aeff8d330 0x557aeff979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.625 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.614+0000 7f5ba2ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557aeff8d330 0x557aeff979f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47360/0 (socket says 172.21.15.87:47360) 2024-09-13T17:14:25.625 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.614+0000 7f5ba2ffd640 1 -- 172.21.15.87:0/2413483515 learned_addr learned my addr 172.21.15.87:0/2413483515 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:25.625 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.614+0000 7f5ba37fe640 1 --2- 172.21.15.87:0/2413483515 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557aeff984f0 0x557aeff93fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.614+0000 7f5ba2ffd640 1 -- 172.21.15.87:0/2413483515 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557aeff984f0 msgr2=0x557aeff93fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.614+0000 7f5ba2ffd640 1 --2- 172.21.15.87:0/2413483515 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557aeff984f0 0x557aeff93fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.614+0000 7f5ba2ffd640 1 -- 172.21.15.87:0/2413483515 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557aeff8dc50 msgr2=0x557aeff93a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.614+0000 7f5ba27fc640 1 --2- 172.21.15.87:0/2413483515 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557aeff8dc50 0x557aeff93a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.614+0000 7f5ba2ffd640 1 --2- 172.21.15.87:0/2413483515 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557aeff8dc50 0x557aeff93a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.614+0000 7f5ba2ffd640 1 -- 172.21.15.87:0/2413483515 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557aefe92300 con 0x557aeff8d330 2024-09-13T17:14:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.614+0000 7f5ba37fe640 1 --2- 172.21.15.87:0/2413483515 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557aeff984f0 0x557aeff93fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.614+0000 7f5ba2ffd640 1 --2- 172.21.15.87:0/2413483515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557aeff8d330 0x557aeff979f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f5b94005ec0 tx=0x7f5b94009230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c390b97f96cd299 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.614+0000 7f5b89ffb640 1 -- 172.21.15.87:0/2413483515 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9403c640 con 0x557aeff8d330 2024-09-13T17:14:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.614+0000 7f5b89ffb640 1 -- 172.21.15.87:0/2413483515 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5b9404d070 con 0x557aeff8d330 2024-09-13T17:14:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.614+0000 7f5b89ffb640 1 -- 172.21.15.87:0/2413483515 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b94003dd0 con 0x557aeff8d330 2024-09-13T17:14:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.615+0000 7f5babfde740 1 -- 172.21.15.87:0/2413483515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557aeff8d330 msgr2=0x557aeff979f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.615+0000 7f5babfde740 1 --2- 172.21.15.87:0/2413483515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557aeff8d330 0x557aeff979f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f5b94005ec0 tx=0x7f5b94009230 comp rx=0 tx=0).stop 2024-09-13T17:14:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.615+0000 7f5babfde740 1 -- 172.21.15.87:0/2413483515 shutdown_connections 2024-09-13T17:14:25.627 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.615+0000 7f5babfde740 1 --2- 172.21.15.87:0/2413483515 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557aeff984f0 0x557aeff93fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.627 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.615+0000 7f5babfde740 1 --2- 172.21.15.87:0/2413483515 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557aeff8dc50 0x557aeff93a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.627 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.615+0000 7f5babfde740 1 --2- 172.21.15.87:0/2413483515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557aeff8d330 0x557aeff979f0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.627 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.615+0000 7f5babfde740 1 -- 172.21.15.87:0/2413483515 >> 172.21.15.87:0/2413483515 conn(0x557aeff898c0 msgr2=0x557aeff904b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:25.627 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.615+0000 7f5babfde740 1 -- 172.21.15.87:0/2413483515 shutdown_connections 2024-09-13T17:14:25.627 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.615+0000 7f5babfde740 1 -- 172.21.15.87:0/2413483515 wait complete. 2024-09-13T17:14:25.627 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.615+0000 7f5babfde740 1 -- start start 2024-09-13T17:14:25.627 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.615+0000 7f5babfde740 1 Processor -- start 2024-09-13T17:14:25.627 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.616+0000 7f5babfde740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557aeff8d330 0x557aeff9f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.627 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.616+0000 7f5babfde740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557aeff8dc50 0x557aeff9b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.627 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.616+0000 7f5babfde740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557aeff984f0 0x557aeff9bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.627 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.616+0000 7f5babfde740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aeff9c1f0 con 0x557aeff8d330 2024-09-13T17:14:25.628 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.616+0000 7f5babfde740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aeff9c360 con 0x557aeff984f0 2024-09-13T17:14:25.628 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.616+0000 7f5babfde740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aeff9c520 con 0x557aeff8dc50 2024-09-13T17:14:25.628 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.616+0000 7f5babfde740 10 client.0 _ll_register_callbacks cb 0x7f5b98095f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:14:25.628 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.616+0000 7f5ba2ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557aeff8d330 0x557aeff9f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.628 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.616+0000 7f5ba2ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557aeff8d330 0x557aeff9f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47362/0 (socket says 172.21.15.87:47362) 2024-09-13T17:14:25.628 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.616+0000 7f5ba2ffd640 1 -- 172.21.15.87:0/3023491808 learned_addr learned my addr 172.21.15.87:0/3023491808 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:25.628 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.616+0000 7f5ba37fe640 1 --2- 172.21.15.87:0/3023491808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557aeff984f0 0x557aeff9bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.628 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.616+0000 7f5ba27fc640 1 --2- 172.21.15.87:0/3023491808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557aeff8dc50 0x557aeff9b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.628 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.616+0000 7f5ba2ffd640 1 -- 172.21.15.87:0/3023491808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557aeff8dc50 msgr2=0x557aeff9b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:25.629 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.616+0000 7f5ba2ffd640 1 --2- 172.21.15.87:0/3023491808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557aeff8dc50 0x557aeff9b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.629 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.616+0000 7f5ba2ffd640 1 -- 172.21.15.87:0/3023491808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557aeff984f0 msgr2=0x557aeff9bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:25.629 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.616+0000 7f5ba2ffd640 1 --2- 172.21.15.87:0/3023491808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557aeff984f0 0x557aeff9bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.629 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.616+0000 7f5ba2ffd640 1 -- 172.21.15.87:0/3023491808 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557aefef0330 con 0x557aeff8d330 2024-09-13T17:14:25.629 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.616+0000 7f5ba2ffd640 1 --2- 172.21.15.87:0/3023491808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557aeff8d330 0x557aeff9f2c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5b9403cfd0 tx=0x7f5b94031490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebb6324cde6bb52d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:25.629 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.616+0000 7f5b86ff5640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:14:25.629 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.617+0000 7f5b86ff5640 1 -- 172.21.15.87:0/3023491808 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b94003d90 con 0x557aeff8d330 2024-09-13T17:14:25.629 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.617+0000 7f5b86ff5640 1 -- 172.21.15.87:0/3023491808 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f5b94042040 con 0x557aeff8d330 2024-09-13T17:14:25.629 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.617+0000 7f5babfde740 1 -- 172.21.15.87:0/3023491808 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5b980a2680 con 0x557aeff8d330 2024-09-13T17:14:25.629 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.617+0000 7f5b86ff5640 1 -- 172.21.15.87:0/3023491808 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b9403c440 con 0x557aeff8d330 2024-09-13T17:14:25.630 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.617+0000 7f5babfde740 10 client.15813 fetch_fsmap learned FSMap version 24 2024-09-13T17:14:25.630 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.617+0000 7f5babfde740 1 -- 172.21.15.87:0/3023491808 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x557aefeb78e0 con 0x557aeff8d330 2024-09-13T17:14:25.630 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.617+0000 7f5b86ff5640 1 -- 172.21.15.87:0/3023491808 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5b9407a020 con 0x557aeff8d330 2024-09-13T17:14:25.630 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.617+0000 7f5b86ff5640 1 -- 172.21.15.87:0/3023491808 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f5b94045070 con 0x557aeff8d330 2024-09-13T17:14:25.630 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.617+0000 7f5babfde740 10 client.15813 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:14:25.630 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.617+0000 7f5babfde740 10 client.15813 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-13T17:14:25.630 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.617+0000 7f5babfde740 20 client.15813 populate_metadata read hostname 'smithi087' 2024-09-13T17:14:25.630 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.617+0000 7f5babfde740 1 --2- 172.21.15.87:0/3023491808 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x557aeffff3a0 0x557af0001790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:25.630 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.617+0000 7f5babfde740 4 client.15813 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T17:14:25.630 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.617+0000 7f5babfde740 1 -- 172.21.15.87:0/3023491808 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557aefbe5300 con 0x557aeffff3a0 2024-09-13T17:14:25.630 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.617+0000 7f5ba27fc640 1 --2- 172.21.15.87:0/3023491808 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x557aeffff3a0 0x557af0001790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:25.630 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.618+0000 7f5b86ff5640 10 client.15813 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:25.630 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.618+0000 7f5ba27fc640 1 --2- 172.21.15.87:0/3023491808 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x557aeffff3a0 0x557af0001790 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5860a3f57fd766b7 server_cookie=295c6f03c1878f3c in_seq=0 out_seq=0 2024-09-13T17:14:25.631 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.621+0000 7f5b86ff5640 1 -- 172.21.15.87:0/3023491808 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557aefbe5300 con 0x557aeffff3a0 2024-09-13T17:14:25.631 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.621+0000 7f5b86ff5640 10 client.15813 handle_command_reply: tid=0 2024-09-13T17:14:25.631 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.621+0000 7f5babfde740 1 client.15813 shutdown 2024-09-13T17:14:25.631 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.621+0000 7f5babfde740 1 -- 172.21.15.87:0/3023491808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557aeff8d330 msgr2=0x557aeff9f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:25.631 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.621+0000 7f5babfde740 1 --2- 172.21.15.87:0/3023491808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557aeff8d330 0x557aeff9f2c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5b9403cfd0 tx=0x7f5b94031490 comp rx=0 tx=0).stop 2024-09-13T17:14:25.631 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.621+0000 7f5babfde740 1 -- 172.21.15.87:0/3023491808 shutdown_connections 2024-09-13T17:14:25.631 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.621+0000 7f5babfde740 1 --2- 172.21.15.87:0/3023491808 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x557aeffff3a0 0x557af0001790 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.631 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.621+0000 7f5babfde740 1 --2- 172.21.15.87:0/3023491808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557aeff984f0 0x557aeff9bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.631 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.621+0000 7f5b86ff5640 0 client.15813 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:25.631 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.621+0000 7f5babfde740 1 --2- 172.21.15.87:0/3023491808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557aeff8dc50 0x557aeff9b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.631 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.622+0000 7f5babfde740 1 --2- 172.21.15.87:0/3023491808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557aeff8d330 0x557aeff9f2c0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.631 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.622+0000 7f5babfde740 1 -- 172.21.15.87:0/3023491808 >> 172.21.15.87:0/3023491808 conn(0x557aeff898c0 msgr2=0x557aeff939c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:25.631 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.622+0000 7f5babfde740 1 -- 172.21.15.87:0/3023491808 shutdown_connections 2024-09-13T17:14:25.631 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.622+0000 7f5babfde740 1 -- 172.21.15.87:0/3023491808 wait complete. 2024-09-13T17:14:25.632 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.622+0000 7f5babfde740 20 client.15813 trim_cache size 0 max 16384 2024-09-13T17:14:25.632 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout:{ 2024-09-13T17:14:25.632 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout: "message": "", 2024-09-13T17:14:25.632 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout: "return_code": 0 2024-09-13T17:14:25.632 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout:} 2024-09-13T17:14:25.633 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.622+0000 7f5ba92b7640 1 -- 172.21.15.87:0/813448762 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5b8c0a1320 msgr2=0x7f5b8c0a37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:25.633 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.622+0000 7f5ba92b7640 1 --2- 172.21.15.87:0/813448762 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5b8c0a1320 0x7f5b8c0a37e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5b94005ab0 tx=0x7f5b94005a20 comp rx=0 tx=0).stop 2024-09-13T17:14:25.633 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.622+0000 7f5ba92b7640 1 -- 172.21.15.87:0/813448762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ba40ff970 msgr2=0x7f5ba4100db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:25.633 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.622+0000 7f5ba92b7640 1 --2- 172.21.15.87:0/813448762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ba40ff970 0x7f5ba4100db0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f5b9800e9f0 tx=0x7f5b9800eeb0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.633 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.623+0000 7f5ba92b7640 1 -- 172.21.15.87:0/813448762 shutdown_connections 2024-09-13T17:14:25.633 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.623+0000 7f5ba92b7640 1 --2- 172.21.15.87:0/813448762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ba4104c30 0x7f5ba41012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.633 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.623+0000 7f5ba92b7640 1 --2- 172.21.15.87:0/813448762 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5b8c0a1320 0x7f5b8c0a37e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.633 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.623+0000 7f5ba92b7640 1 --2- 172.21.15.87:0/813448762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ba40ff970 0x7f5ba4100db0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.634 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.623+0000 7f5ba92b7640 1 --2- 172.21.15.87:0/813448762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ba40feff0 0x7f5ba4100870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:25.634 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.623+0000 7f5ba92b7640 1 -- 172.21.15.87:0/813448762 >> 172.21.15.87:0/813448762 conn(0x7f5ba4074940 msgr2=0x7f5ba4067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:25.634 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.623+0000 7f5ba92b7640 1 -- 172.21.15.87:0/813448762 shutdown_connections 2024-09-13T17:14:25.634 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:25.623+0000 7f5ba92b7640 1 -- 172.21.15.87:0/813448762 wait complete. 2024-09-13T17:14:26.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:26 smithi087 ceph-mon[30934]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-13T17:14:26.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:26 smithi149 ceph-mon[35496]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-13T17:14:26.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:26 smithi118 ceph-mon[34374]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-13T17:14:27.230 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:14:27.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.334+0000 7f5bc03db640 1 -- 172.21.15.87:0/2715305122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bb80ff810 msgr2=0x7f5bb8103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.334+0000 7f5bc03db640 1 --2- 172.21.15.87:0/2715305122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bb80ff810 0x7f5bb8103850 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4009890 tx=0x7f5bb402a380 comp rx=0 tx=0).stop 2024-09-13T17:14:27.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.334+0000 7f5bc03db640 1 -- 172.21.15.87:0/2715305122 shutdown_connections 2024-09-13T17:14:27.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.334+0000 7f5bc03db640 1 --2- 172.21.15.87:0/2715305122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5bb8103fb0 0x7f5bb810bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.334+0000 7f5bc03db640 1 --2- 172.21.15.87:0/2715305122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bb80ff810 0x7f5bb8103850 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.334+0000 7f5bc03db640 1 --2- 172.21.15.87:0/2715305122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5bb80fee60 0x7f5bb80ff240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.334+0000 7f5bc03db640 1 -- 172.21.15.87:0/2715305122 >> 172.21.15.87:0/2715305122 conn(0x7f5bb8075c60 msgr2=0x7f5bb80fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:27.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.334+0000 7f5bc03db640 1 -- 172.21.15.87:0/2715305122 shutdown_connections 2024-09-13T17:14:27.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.334+0000 7f5bc03db640 1 -- 172.21.15.87:0/2715305122 wait complete. 2024-09-13T17:14:27.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.334+0000 7f5bc03db640 1 Processor -- start 2024-09-13T17:14:27.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.334+0000 7f5bc03db640 1 -- start start 2024-09-13T17:14:27.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.335+0000 7f5bc03db640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5bb80fee60 0x7f5bb8196320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.335+0000 7f5bc03db640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5bb8103fb0 0x7f5bb8196860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.335+0000 7f5bc03db640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bb819ac50 0x7f5bb819b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.335+0000 7f5bc03db640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb819b640 con 0x7f5bb819ac50 2024-09-13T17:14:27.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.335+0000 7f5bc03db640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb819b7b0 con 0x7f5bb80fee60 2024-09-13T17:14:27.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.335+0000 7f5bc03db640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb819b920 con 0x7f5bb8103fb0 2024-09-13T17:14:27.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.335+0000 7f5bbe978640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bb819ac50 0x7f5bb819b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.335+0000 7f5bbe177640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5bb80fee60 0x7f5bb8196320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.335+0000 7f5bbe978640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bb819ac50 0x7f5bb819b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47374/0 (socket says 172.21.15.87:47374) 2024-09-13T17:14:27.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.335+0000 7f5bbe978640 1 -- 172.21.15.87:0/643854349 learned_addr learned my addr 172.21.15.87:0/643854349 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:27.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.335+0000 7f5bbd976640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5bb8103fb0 0x7f5bb8196860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.335+0000 7f5bbe177640 1 -- 172.21.15.87:0/643854349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5bb8103fb0 msgr2=0x7f5bb8196860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.335+0000 7f5bbe177640 1 --2- 172.21.15.87:0/643854349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5bb8103fb0 0x7f5bb8196860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.335+0000 7f5bbe177640 1 -- 172.21.15.87:0/643854349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bb819ac50 msgr2=0x7f5bb819b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.335+0000 7f5bbe177640 1 --2- 172.21.15.87:0/643854349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bb819ac50 0x7f5bb819b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.335+0000 7f5bbe177640 1 -- 172.21.15.87:0/643854349 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb4009490 con 0x7f5bb80fee60 2024-09-13T17:14:27.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.335+0000 7f5bbe978640 1 --2- 172.21.15.87:0/643854349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bb819ac50 0x7f5bb819b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:14:27.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.336+0000 7f5bbe177640 1 --2- 172.21.15.87:0/643854349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5bb80fee60 0x7f5bb8196320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8009bf0 tx=0x7f5ba800b690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:27.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.336+0000 7f5baf7fe640 1 -- 172.21.15.87:0/643854349 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba8015070 con 0x7f5bb80fee60 2024-09-13T17:14:27.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.336+0000 7f5bc03db640 1 -- 172.21.15.87:0/643854349 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bb80fafd0 con 0x7f5bb80fee60 2024-09-13T17:14:27.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.336+0000 7f5baf7fe640 1 -- 172.21.15.87:0/643854349 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5ba8009ce0 con 0x7f5bb80fee60 2024-09-13T17:14:27.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.336+0000 7f5baf7fe640 1 -- 172.21.15.87:0/643854349 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba8004da0 con 0x7f5bb80fee60 2024-09-13T17:14:27.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.336+0000 7f5bc03db640 1 -- 172.21.15.87:0/643854349 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb80fb450 con 0x7f5bb80fee60 2024-09-13T17:14:27.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.339+0000 7f5bc31d5740 1 Processor -- start 2024-09-13T17:14:27.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.339+0000 7f5bc31d5740 1 -- start start 2024-09-13T17:14:27.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.339+0000 7f5baf7fe640 1 -- 172.21.15.87:0/643854349 <== mon.2 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 25) v1 ==== 136106+0+0 (secure 0 0 0) 0x7f5ba8004f20 con 0x7f5bb80fee60 2024-09-13T17:14:27.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.339+0000 7f5bc31d5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb1a0bde10 0x55fb1a0be1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.339+0000 7f5bc31d5740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb1a0be730 0x55fb1a0c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.339+0000 7f5bc31d5740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb1a0c8fd0 0x55fb1a0cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.339+0000 7f5bc31d5740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb1a028f20 con 0x55fb1a0c8fd0 2024-09-13T17:14:27.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.339+0000 7f5bc31d5740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb1a0266b0 con 0x55fb1a0be730 2024-09-13T17:14:27.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.339+0000 7f5bc31d5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb1a021fa0 con 0x55fb1a0bde10 2024-09-13T17:14:27.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.340+0000 7f5bbe978640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb1a0bde10 0x55fb1a0be1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.340+0000 7f5bbe177640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb1a0be730 0x55fb1a0c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.340+0000 7f5bbd976640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb1a0c8fd0 0x55fb1a0cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.340+0000 7f5bbe978640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb1a0bde10 0x55fb1a0be1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:51060/0 (socket says 172.21.15.87:51060) 2024-09-13T17:14:27.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.340+0000 7f5bbe978640 1 -- 172.21.15.87:0/1451727882 learned_addr learned my addr 172.21.15.87:0/1451727882 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:27.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.340+0000 7f5bbe978640 1 -- 172.21.15.87:0/1451727882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb1a0be730 msgr2=0x55fb1a0c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:27.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.340+0000 7f5bbe978640 1 --2- 172.21.15.87:0/1451727882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb1a0be730 0x55fb1a0c8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.340+0000 7f5bbe978640 1 -- 172.21.15.87:0/1451727882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb1a0c8fd0 msgr2=0x55fb1a0cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:27.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.340+0000 7f5bbe978640 1 --2- 172.21.15.87:0/1451727882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb1a0c8fd0 0x55fb1a0cb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.340+0000 7f5bbe978640 1 -- 172.21.15.87:0/1451727882 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb19fdc840 con 0x55fb1a0bde10 2024-09-13T17:14:27.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.340+0000 7f5bbd976640 1 --2- 172.21.15.87:0/1451727882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb1a0c8fd0 0x55fb1a0cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:14:27.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.340+0000 7f5bbe177640 1 --2- 172.21.15.87:0/1451727882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb1a0be730 0x55fb1a0c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:27.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.340+0000 7f5baf7fe640 1 --2- 172.21.15.87:0/643854349 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5ba00a1320 0x7f5ba00a37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.340+0000 7f5bbe978640 1 --2- 172.21.15.87:0/1451727882 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb1a0bde10 0x55fb1a0be1f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0010810 tx=0x7f5bb0010cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6b312a31250286c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:27.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.341+0000 7f5bbe177640 1 --2- 172.21.15.87:0/643854349 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5ba00a1320 0x7f5ba00a37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.341+0000 7f5baf7fe640 1 -- 172.21.15.87:0/643854349 <== mon.2 v2:172.21.15.118:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f5ba80d0bb0 con 0x7f5bb80fee60 2024-09-13T17:14:27.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.341+0000 7f5bace05640 1 -- 172.21.15.87:0/1451727882 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb000eb30 con 0x55fb1a0bde10 2024-09-13T17:14:27.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.341+0000 7f5bace05640 1 -- 172.21.15.87:0/1451727882 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5bb000ec90 con 0x55fb1a0bde10 2024-09-13T17:14:27.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.341+0000 7f5bace05640 1 -- 172.21.15.87:0/1451727882 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb00116a0 con 0x55fb1a0bde10 2024-09-13T17:14:27.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.341+0000 7f5bc31d5740 1 -- 172.21.15.87:0/1451727882 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb1a0bde10 msgr2=0x55fb1a0be1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.341+0000 7f5bbe177640 1 --2- 172.21.15.87:0/643854349 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5ba00a1320 0x7f5ba00a37e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5ba80cde30 tx=0x7f5ba80d4680 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:27.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.341+0000 7f5bc31d5740 1 --2- 172.21.15.87:0/1451727882 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb1a0bde10 0x55fb1a0be1f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0010810 tx=0x7f5bb0010cd0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.342+0000 7f5bc31d5740 1 -- 172.21.15.87:0/1451727882 shutdown_connections 2024-09-13T17:14:27.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.342+0000 7f5bc31d5740 1 --2- 172.21.15.87:0/1451727882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb1a0c8fd0 0x55fb1a0cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.342+0000 7f5bc31d5740 1 --2- 172.21.15.87:0/1451727882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb1a0be730 0x55fb1a0c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.342+0000 7f5bc31d5740 1 --2- 172.21.15.87:0/1451727882 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb1a0bde10 0x55fb1a0be1f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.342+0000 7f5bc31d5740 1 -- 172.21.15.87:0/1451727882 >> 172.21.15.87:0/1451727882 conn(0x55fb1a0ba380 msgr2=0x55fb1a0ba760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:27.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.342+0000 7f5bc31d5740 1 -- 172.21.15.87:0/1451727882 shutdown_connections 2024-09-13T17:14:27.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.342+0000 7f5bc31d5740 1 -- 172.21.15.87:0/1451727882 wait complete. 2024-09-13T17:14:27.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.342+0000 7f5bc31d5740 1 -- start start 2024-09-13T17:14:27.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.342+0000 7f5bc31d5740 1 Processor -- start 2024-09-13T17:14:27.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.342+0000 7f5bc31d5740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb1a0bde10 0x55fb1a0c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.343+0000 7f5bc31d5740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb1a0be730 0x55fb1a0c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.343+0000 7f5bc31d5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb1a0c8fd0 0x55fb1a0c6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.343+0000 7f5bc31d5740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb19fc32a0 con 0x55fb1a0be730 2024-09-13T17:14:27.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.343+0000 7f5bc31d5740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb19cfa430 con 0x55fb1a0bde10 2024-09-13T17:14:27.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.343+0000 7f5bc31d5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb19fa5680 con 0x55fb1a0c8fd0 2024-09-13T17:14:27.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.343+0000 7f5bc31d5740 10 client.0 _ll_register_callbacks cb 0x55fb1a01b610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:14:27.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.343+0000 7f5bbd976640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb1a0be730 0x55fb1a0c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.343+0000 7f5bbd976640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb1a0be730 0x55fb1a0c5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47398/0 (socket says 172.21.15.87:47398) 2024-09-13T17:14:27.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.343+0000 7f5bbd976640 1 -- 172.21.15.87:0/940574057 learned_addr learned my addr 172.21.15.87:0/940574057 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:27.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.343+0000 7f5bbe978640 1 --2- 172.21.15.87:0/940574057 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb1a0bde10 0x55fb1a0c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.343+0000 7f5bbe978640 1 --2- 172.21.15.87:0/940574057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb1a0c8fd0 0x55fb1a0c6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.343+0000 7f5bbd976640 1 -- 172.21.15.87:0/940574057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb1a0c8fd0 msgr2=0x55fb1a0c6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:27.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.343+0000 7f5bbd976640 1 --2- 172.21.15.87:0/940574057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb1a0c8fd0 0x55fb1a0c6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.343+0000 7f5bbd976640 1 -- 172.21.15.87:0/940574057 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb1a0bde10 msgr2=0x55fb1a0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:27.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.343+0000 7f5bbd976640 1 --2- 172.21.15.87:0/940574057 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb1a0bde10 0x55fb1a0c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.343+0000 7f5bbd976640 1 -- 172.21.15.87:0/940574057 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb0010470 con 0x55fb1a0be730 2024-09-13T17:14:27.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.344+0000 7f5bbd976640 1 --2- 172.21.15.87:0/940574057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb1a0be730 0x55fb1a0c5ce0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4005e00 tx=0x7f5bb4032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7df6141f559ace0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:27.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.344+0000 7f5b9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:14:27.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.344+0000 7f5b9dffb640 1 -- 172.21.15.87:0/940574057 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb4030750 con 0x55fb1a0be730 2024-09-13T17:14:27.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.344+0000 7f5bc31d5740 1 -- 172.21.15.87:0/940574057 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fb19d154e0 con 0x55fb1a0be730 2024-09-13T17:14:27.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.344+0000 7f5b9dffb640 1 -- 172.21.15.87:0/940574057 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f5bb40308b0 con 0x55fb1a0be730 2024-09-13T17:14:27.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.344+0000 7f5b9dffb640 1 -- 172.21.15.87:0/940574057 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5bb4004040 con 0x55fb1a0be730 2024-09-13T17:14:27.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.344+0000 7f5bc31d5740 10 client.15825 fetch_fsmap learned FSMap version 24 2024-09-13T17:14:27.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.344+0000 7f5bc31d5740 1 -- 172.21.15.87:0/940574057 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55fb1a020620 con 0x55fb1a0be730 2024-09-13T17:14:27.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.344+0000 7f5b9dffb640 1 -- 172.21.15.87:0/940574057 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55fb19d154e0 con 0x55fb1a0be730 2024-09-13T17:14:27.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.344+0000 7f5b9dffb640 1 -- 172.21.15.87:0/940574057 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f5bb40046c0 con 0x55fb1a0be730 2024-09-13T17:14:27.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.344+0000 7f5bc31d5740 10 client.15825 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:14:27.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.344+0000 7f5bc31d5740 10 client.15825 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:14:27.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.344+0000 7f5bc31d5740 20 client.15825 populate_metadata read hostname 'smithi087' 2024-09-13T17:14:27.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.344+0000 7f5bc31d5740 1 --2- 172.21.15.87:0/940574057 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55fb1a0d8e60 0x55fb1a0db280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.344+0000 7f5bc31d5740 4 client.15825 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:14:27.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.344+0000 7f5bc31d5740 1 -- 172.21.15.87:0/940574057 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fb19d267e0 con 0x55fb1a0d8e60 2024-09-13T17:14:27.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.345+0000 7f5bbe978640 1 --2- 172.21.15.87:0/940574057 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55fb1a0d8e60 0x55fb1a0db280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.345+0000 7f5bbe978640 1 --2- 172.21.15.87:0/940574057 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55fb1a0d8e60 0x55fb1a0db280 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dbc8bd2740e78af server_cookie=f39acbbda104a94a in_seq=0 out_seq=0 2024-09-13T17:14:27.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.345+0000 7f5b9dffb640 10 client.15825 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:27.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.346+0000 7f5b9dffb640 1 -- 172.21.15.87:0/940574057 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55fb19d267e0 con 0x55fb1a0d8e60 2024-09-13T17:14:27.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.346+0000 7f5b9dffb640 10 client.15825 handle_command_reply: tid=0 2024-09-13T17:14:27.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.346+0000 7f5bc31d5740 1 client.15825 shutdown 2024-09-13T17:14:27.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.346+0000 7f5bc31d5740 1 -- 172.21.15.87:0/940574057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb1a0be730 msgr2=0x55fb1a0c5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.346+0000 7f5bc31d5740 1 --2- 172.21.15.87:0/940574057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb1a0be730 0x55fb1a0c5ce0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4005e00 tx=0x7f5bb4032670 comp rx=0 tx=0).stop 2024-09-13T17:14:27.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.346+0000 7f5bc31d5740 1 -- 172.21.15.87:0/940574057 shutdown_connections 2024-09-13T17:14:27.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.346+0000 7f5bc31d5740 1 --2- 172.21.15.87:0/940574057 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55fb1a0d8e60 0x55fb1a0db280 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.346+0000 7f5bc31d5740 1 --2- 172.21.15.87:0/940574057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb1a0c8fd0 0x55fb1a0c6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.346+0000 7f5b9dffb640 0 client.15825 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:27.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.346+0000 7f5bc31d5740 1 --2- 172.21.15.87:0/940574057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb1a0be730 0x55fb1a0c5ce0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.346+0000 7f5bc31d5740 1 --2- 172.21.15.87:0/940574057 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb1a0bde10 0x55fb1a0c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.346+0000 7f5bc31d5740 1 -- 172.21.15.87:0/940574057 >> 172.21.15.87:0/940574057 conn(0x55fb1a0ba380 msgr2=0x55fb1a0b9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:27.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.346+0000 7f5bc31d5740 1 -- 172.21.15.87:0/940574057 shutdown_connections 2024-09-13T17:14:27.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.346+0000 7f5bc31d5740 1 -- 172.21.15.87:0/940574057 wait complete. 2024-09-13T17:14:27.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.346+0000 7f5bc31d5740 20 client.15825 trim_cache size 0 max 16384 2024-09-13T17:14:27.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.374+0000 7f5bc31d5740 1 Processor -- start 2024-09-13T17:14:27.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.374+0000 7f5bc31d5740 1 -- start start 2024-09-13T17:14:27.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.374+0000 7f5bc31d5740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb1a0ba380 0x55fb1a0cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.374+0000 7f5bc31d5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb1a0bde10 0x55fb1a0b9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.374+0000 7f5bc31d5740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb1a0be730 0x55fb1a0c4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.374+0000 7f5bc31d5740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb1a0ba240 con 0x55fb1a0ba380 2024-09-13T17:14:27.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.374+0000 7f5bc31d5740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb1a0bb2e0 con 0x55fb1a0be730 2024-09-13T17:14:27.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.374+0000 7f5bc31d5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb1a0b8b40 con 0x55fb1a0bde10 2024-09-13T17:14:27.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.375+0000 7f5bbe978640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb1a0ba380 0x55fb1a0cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.375+0000 7f5bbe978640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb1a0ba380 0x55fb1a0cb2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47410/0 (socket says 172.21.15.87:47410) 2024-09-13T17:14:27.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.375+0000 7f5bbe978640 1 -- 172.21.15.87:0/1786107957 learned_addr learned my addr 172.21.15.87:0/1786107957 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:27.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.375+0000 7f5bbd976640 1 --2- 172.21.15.87:0/1786107957 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb1a0bde10 0x55fb1a0b9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.375+0000 7f5bbe978640 1 -- 172.21.15.87:0/1786107957 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb1a0bde10 msgr2=0x55fb1a0b9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:27.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.375+0000 7f5bbe978640 1 --2- 172.21.15.87:0/1786107957 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb1a0bde10 0x55fb1a0b9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.375+0000 7f5bbe978640 1 -- 172.21.15.87:0/1786107957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb1a0be730 msgr2=0x55fb1a0c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:27.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.375+0000 7f5bbe978640 1 --2- 172.21.15.87:0/1786107957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb1a0be730 0x55fb1a0c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.375+0000 7f5bbe978640 1 -- 172.21.15.87:0/1786107957 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb19fc2790 con 0x55fb1a0ba380 2024-09-13T17:14:27.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.375+0000 7f5bbe978640 1 --2- 172.21.15.87:0/1786107957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb1a0ba380 0x55fb1a0cb2e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0009370 tx=0x7f5bb00096b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0609b4acb66b4bb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:27.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.375+0000 7f5bad606640 1 -- 172.21.15.87:0/1786107957 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb0030070 con 0x55fb1a0ba380 2024-09-13T17:14:27.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.375+0000 7f5bad606640 1 -- 172.21.15.87:0/1786107957 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5bb002c430 con 0x55fb1a0ba380 2024-09-13T17:14:27.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.375+0000 7f5bad606640 1 -- 172.21.15.87:0/1786107957 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb0021040 con 0x55fb1a0ba380 2024-09-13T17:14:27.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.376+0000 7f5bc31d5740 1 -- 172.21.15.87:0/1786107957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb1a0ba380 msgr2=0x55fb1a0cb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.376+0000 7f5bc31d5740 1 --2- 172.21.15.87:0/1786107957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb1a0ba380 0x55fb1a0cb2e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0009370 tx=0x7f5bb00096b0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.376+0000 7f5bc31d5740 1 -- 172.21.15.87:0/1786107957 shutdown_connections 2024-09-13T17:14:27.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.376+0000 7f5bc31d5740 1 --2- 172.21.15.87:0/1786107957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb1a0be730 0x55fb1a0c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.376+0000 7f5bc31d5740 1 --2- 172.21.15.87:0/1786107957 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb1a0bde10 0x55fb1a0b9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.376+0000 7f5bc31d5740 1 --2- 172.21.15.87:0/1786107957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb1a0ba380 0x55fb1a0cb2e0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.376+0000 7f5bc31d5740 1 -- 172.21.15.87:0/1786107957 >> 172.21.15.87:0/1786107957 conn(0x55fb1a0c8b20 msgr2=0x55fb1a0c0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:27.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.376+0000 7f5bc31d5740 1 -- 172.21.15.87:0/1786107957 shutdown_connections 2024-09-13T17:14:27.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.376+0000 7f5bc31d5740 1 -- 172.21.15.87:0/1786107957 wait complete. 2024-09-13T17:14:27.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.377+0000 7f5bc31d5740 1 -- start start 2024-09-13T17:14:27.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.377+0000 7f5bc31d5740 1 Processor -- start 2024-09-13T17:14:27.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.377+0000 7f5bc31d5740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb1a0ba380 0x55fb1a0cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.377+0000 7f5bc31d5740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb1a0bde10 0x55fb1a0cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.377+0000 7f5bc31d5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb1a0be730 0x55fb1a0cc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.377+0000 7f5bc31d5740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb1a0ccd70 con 0x55fb1a0bde10 2024-09-13T17:14:27.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.377+0000 7f5bc31d5740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb1a0ccee0 con 0x55fb1a0ba380 2024-09-13T17:14:27.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.377+0000 7f5bc31d5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb1a0cd0a0 con 0x55fb1a0be730 2024-09-13T17:14:27.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.377+0000 7f5bc31d5740 10 client.0 _ll_register_callbacks cb 0x7f5bb40096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:14:27.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.377+0000 7f5bbd976640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb1a0bde10 0x55fb1a0cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.377+0000 7f5bbd976640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb1a0bde10 0x55fb1a0cc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47414/0 (socket says 172.21.15.87:47414) 2024-09-13T17:14:27.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.377+0000 7f5bbd976640 1 -- 172.21.15.87:0/26712570 learned_addr learned my addr 172.21.15.87:0/26712570 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:27.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.377+0000 7f5bbe978640 1 --2- 172.21.15.87:0/26712570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb1a0ba380 0x55fb1a0cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.377+0000 7f5bbd976640 1 -- 172.21.15.87:0/26712570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb1a0be730 msgr2=0x55fb1a0cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:27.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.377+0000 7f5bbd976640 1 --2- 172.21.15.87:0/26712570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb1a0be730 0x55fb1a0cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.377+0000 7f5bbd976640 1 -- 172.21.15.87:0/26712570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb1a0ba380 msgr2=0x55fb1a0cfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:27.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.377+0000 7f5bbd976640 1 --2- 172.21.15.87:0/26712570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb1a0ba380 0x55fb1a0cfe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.377+0000 7f5bbd976640 1 -- 172.21.15.87:0/26712570 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fb19fdc840 con 0x55fb1a0bde10 2024-09-13T17:14:27.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.377+0000 7f5bbe978640 1 --2- 172.21.15.87:0/26712570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb1a0ba380 0x55fb1a0cfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:27.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.378+0000 7f5bbd976640 1 --2- 172.21.15.87:0/26712570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb1a0bde10 0x55fb1a0cc2f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4004a50 tx=0x7f5bb4005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e7f12ca375b2a19 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:27.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.378+0000 7f5b9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:14:27.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.378+0000 7f5b9dffb640 1 -- 172.21.15.87:0/26712570 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb4030750 con 0x55fb1a0bde10 2024-09-13T17:14:27.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.378+0000 7f5b9dffb640 1 -- 172.21.15.87:0/26712570 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f5bb4000e40 con 0x55fb1a0bde10 2024-09-13T17:14:27.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.378+0000 7f5bc31d5740 1 -- 172.21.15.87:0/26712570 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5bb000ec90 con 0x55fb1a0bde10 2024-09-13T17:14:27.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.378+0000 7f5b9dffb640 1 -- 172.21.15.87:0/26712570 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5bb4030340 con 0x55fb1a0bde10 2024-09-13T17:14:27.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.378+0000 7f5bc31d5740 10 client.15831 fetch_fsmap learned FSMap version 24 2024-09-13T17:14:27.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.378+0000 7f5bc31d5740 1 -- 172.21.15.87:0/26712570 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55fb19fe7ea0 con 0x55fb1a0bde10 2024-09-13T17:14:27.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.378+0000 7f5b9dffb640 1 -- 172.21.15.87:0/26712570 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5bb000ec90 con 0x55fb1a0bde10 2024-09-13T17:14:27.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.378+0000 7f5b9dffb640 1 -- 172.21.15.87:0/26712570 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f5bb4004f80 con 0x55fb1a0bde10 2024-09-13T17:14:27.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.378+0000 7f5bc31d5740 10 client.15831 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:14:27.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.378+0000 7f5bc31d5740 10 client.15831 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:14:27.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.378+0000 7f5bc31d5740 20 client.15831 populate_metadata read hostname 'smithi087' 2024-09-13T17:14:27.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.378+0000 7f5bc31d5740 1 --2- 172.21.15.87:0/26712570 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55fb1a0c8fd0 0x55fb1a1324c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.378+0000 7f5bc31d5740 4 client.15831 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:14:27.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.378+0000 7f5bc31d5740 1 -- 172.21.15.87:0/26712570 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55fb19d79e30 con 0x55fb1a0c8fd0 2024-09-13T17:14:27.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.379+0000 7f5bbe978640 1 --2- 172.21.15.87:0/26712570 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55fb1a0c8fd0 0x55fb1a1324c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.379+0000 7f5b9dffb640 10 client.15831 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:27.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.379+0000 7f5bbe978640 1 --2- 172.21.15.87:0/26712570 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55fb1a0c8fd0 0x55fb1a1324c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8887aafce3ea36a server_cookie=3f94656150c6f733 in_seq=0 out_seq=0 2024-09-13T17:14:27.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.379+0000 7f5b9dffb640 1 -- 172.21.15.87:0/26712570 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55fb19d79e30 con 0x55fb1a0c8fd0 2024-09-13T17:14:27.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.379+0000 7f5b9dffb640 10 client.15831 handle_command_reply: tid=0 2024-09-13T17:14:27.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.379+0000 7f5bc31d5740 1 client.15831 shutdown 2024-09-13T17:14:27.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.379+0000 7f5bc31d5740 1 -- 172.21.15.87:0/26712570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb1a0bde10 msgr2=0x55fb1a0cc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.379+0000 7f5bc31d5740 1 --2- 172.21.15.87:0/26712570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb1a0bde10 0x55fb1a0cc2f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4004a50 tx=0x7f5bb4005f10 comp rx=0 tx=0).stop 2024-09-13T17:14:27.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.379+0000 7f5bc31d5740 1 -- 172.21.15.87:0/26712570 shutdown_connections 2024-09-13T17:14:27.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.379+0000 7f5bc31d5740 1 --2- 172.21.15.87:0/26712570 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55fb1a0c8fd0 0x55fb1a1324c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.379+0000 7f5bc31d5740 1 --2- 172.21.15.87:0/26712570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb1a0be730 0x55fb1a0cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.379+0000 7f5bc31d5740 1 --2- 172.21.15.87:0/26712570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fb1a0bde10 0x55fb1a0cc2f0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.379+0000 7f5b9dffb640 0 client.15831 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:27.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.379+0000 7f5bc31d5740 1 --2- 172.21.15.87:0/26712570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb1a0ba380 0x55fb1a0cfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.380+0000 7f5bc31d5740 1 -- 172.21.15.87:0/26712570 >> 172.21.15.87:0/26712570 conn(0x55fb1a0c8b20 msgr2=0x55fb1a0c4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:27.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.380+0000 7f5bc31d5740 1 -- 172.21.15.87:0/26712570 shutdown_connections 2024-09-13T17:14:27.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.380+0000 7f5bc31d5740 1 -- 172.21.15.87:0/26712570 wait complete. 2024-09-13T17:14:27.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.380+0000 7f5bc31d5740 20 client.15831 trim_cache size 0 max 16384 2024-09-13T17:14:27.391 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:14:27.391 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "no active scrubs running", 2024-09-13T17:14:27.391 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": {} 2024-09-13T17:14:27.391 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:14:27.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.380+0000 7f5bc03db640 1 -- 172.21.15.87:0/643854349 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5ba00a1320 msgr2=0x7f5ba00a37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.380+0000 7f5bc03db640 1 --2- 172.21.15.87:0/643854349 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5ba00a1320 0x7f5ba00a37e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5ba80cde30 tx=0x7f5ba80d4680 comp rx=0 tx=0).stop 2024-09-13T17:14:27.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.380+0000 7f5bc03db640 1 -- 172.21.15.87:0/643854349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5bb80fee60 msgr2=0x7f5bb8196320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.380+0000 7f5bc03db640 1 --2- 172.21.15.87:0/643854349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5bb80fee60 0x7f5bb8196320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8009bf0 tx=0x7f5ba800b690 comp rx=0 tx=0).stop 2024-09-13T17:14:27.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.380+0000 7f5bc03db640 1 -- 172.21.15.87:0/643854349 shutdown_connections 2024-09-13T17:14:27.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.380+0000 7f5bc03db640 1 --2- 172.21.15.87:0/643854349 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5ba00a1320 0x7f5ba00a37e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.380+0000 7f5bc03db640 1 --2- 172.21.15.87:0/643854349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bb819ac50 0x7f5bb819b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.380+0000 7f5bc03db640 1 --2- 172.21.15.87:0/643854349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5bb8103fb0 0x7f5bb8196860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.380+0000 7f5bc03db640 1 --2- 172.21.15.87:0/643854349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5bb80fee60 0x7f5bb8196320 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.380+0000 7f5bc03db640 1 -- 172.21.15.87:0/643854349 >> 172.21.15.87:0/643854349 conn(0x7f5bb8075c60 msgr2=0x7f5bb8067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:27.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.380+0000 7f5bc03db640 1 -- 172.21.15.87:0/643854349 shutdown_connections 2024-09-13T17:14:27.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.380+0000 7f5bc03db640 1 -- 172.21.15.87:0/643854349 wait complete. 2024-09-13T17:14:27.394 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T17:14:27.395 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:14:27.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.496+0000 7f0c8e4e5640 1 -- 172.21.15.87:0/4291588774 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c880ff830 msgr2=0x7f0c88103870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.496+0000 7f0c8e4e5640 1 --2- 172.21.15.87:0/4291588774 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c880ff830 0x7f0c88103870 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0c70009930 tx=0x7f0c7002a420 comp rx=0 tx=0).stop 2024-09-13T17:14:27.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.496+0000 7f0c8e4e5640 1 -- 172.21.15.87:0/4291588774 shutdown_connections 2024-09-13T17:14:27.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.496+0000 7f0c8e4e5640 1 --2- 172.21.15.87:0/4291588774 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c88103fd0 0x7f0c8810bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.496+0000 7f0c8e4e5640 1 --2- 172.21.15.87:0/4291588774 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c880ff830 0x7f0c88103870 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.496+0000 7f0c8e4e5640 1 --2- 172.21.15.87:0/4291588774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c880fee80 0x7f0c880ff260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.496+0000 7f0c8e4e5640 1 -- 172.21.15.87:0/4291588774 >> 172.21.15.87:0/4291588774 conn(0x7f0c88075c60 msgr2=0x7f0c880fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:27.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.496+0000 7f0c8e4e5640 1 -- 172.21.15.87:0/4291588774 shutdown_connections 2024-09-13T17:14:27.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.496+0000 7f0c8e4e5640 1 -- 172.21.15.87:0/4291588774 wait complete. 2024-09-13T17:14:27.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.497+0000 7f0c8e4e5640 1 Processor -- start 2024-09-13T17:14:27.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.497+0000 7f0c8e4e5640 1 -- start start 2024-09-13T17:14:27.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.497+0000 7f0c8e4e5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c880fee80 0x7f0c88197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.497+0000 7f0c8e4e5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c88103fd0 0x7f0c881976b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.497+0000 7f0c8e4e5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c88197c90 0x7f0c881a21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.497+0000 7f0c8e4e5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c881a2930 con 0x7f0c88103fd0 2024-09-13T17:14:27.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.497+0000 7f0c8e4e5640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c881a2aa0 con 0x7f0c880fee80 2024-09-13T17:14:27.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.497+0000 7f0c8e4e5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c881a2c60 con 0x7f0c88197c90 2024-09-13T17:14:27.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.497+0000 7f0c7ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c88103fd0 0x7f0c881976b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.497+0000 7f0c7ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c88103fd0 0x7f0c881976b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47422/0 (socket says 172.21.15.87:47422) 2024-09-13T17:14:27.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.497+0000 7f0c7ffff640 1 -- 172.21.15.87:0/4236508083 learned_addr learned my addr 172.21.15.87:0/4236508083 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:27.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.497+0000 7f0c87fff640 1 --2- 172.21.15.87:0/4236508083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c880fee80 0x7f0c88197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.497+0000 7f0c8ca82640 1 --2- 172.21.15.87:0/4236508083 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c88197c90 0x7f0c881a21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.497+0000 7f0c7ffff640 1 -- 172.21.15.87:0/4236508083 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c88197c90 msgr2=0x7f0c881a21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.497+0000 7f0c7ffff640 1 --2- 172.21.15.87:0/4236508083 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c88197c90 0x7f0c881a21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.497+0000 7f0c7ffff640 1 -- 172.21.15.87:0/4236508083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c880fee80 msgr2=0x7f0c88197170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.497+0000 7f0c7ffff640 1 --2- 172.21.15.87:0/4236508083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c880fee80 0x7f0c88197170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.497+0000 7f0c7ffff640 1 -- 172.21.15.87:0/4236508083 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c70009560 con 0x7f0c88103fd0 2024-09-13T17:14:27.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.497+0000 7f0c87fff640 1 --2- 172.21.15.87:0/4236508083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c880fee80 0x7f0c88197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:27.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.497+0000 7f0c8ca82640 1 --2- 172.21.15.87:0/4236508083 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c88197c90 0x7f0c881a21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:27.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.497+0000 7f0c7ffff640 1 --2- 172.21.15.87:0/4236508083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c88103fd0 0x7f0c881976b0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0c70005760 tx=0x7f0c70004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:27.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.498+0000 7f0c85ffb640 1 -- 172.21.15.87:0/4236508083 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c70004520 con 0x7f0c88103fd0 2024-09-13T17:14:27.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.498+0000 7f0c85ffb640 1 -- 172.21.15.87:0/4236508083 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0c70031e40 con 0x7f0c88103fd0 2024-09-13T17:14:27.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.498+0000 7f0c8e4e5640 1 -- 172.21.15.87:0/4236508083 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c881a2ee0 con 0x7f0c88103fd0 2024-09-13T17:14:27.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.498+0000 7f0c85ffb640 1 -- 172.21.15.87:0/4236508083 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c700325b0 con 0x7f0c88103fd0 2024-09-13T17:14:27.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.498+0000 7f0c8e4e5640 1 -- 172.21.15.87:0/4236508083 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c881a3300 con 0x7f0c88103fd0 2024-09-13T17:14:27.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.499+0000 7f0c8e4e5640 1 -- 172.21.15.87:0/4236508083 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c88100350 con 0x7f0c88103fd0 2024-09-13T17:14:27.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.500+0000 7f0c85ffb640 1 -- 172.21.15.87:0/4236508083 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 25) v1 ==== 136106+0+0 (secure 0 0 0) 0x7f0c70032770 con 0x7f0c88103fd0 2024-09-13T17:14:27.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.500+0000 7f0c85ffb640 1 --2- 172.21.15.87:0/4236508083 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0c740a1320 0x7f0c740a37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.501+0000 7f0c85ffb640 1 -- 172.21.15.87:0/4236508083 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f0c700ed820 con 0x7f0c88103fd0 2024-09-13T17:14:27.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.501+0000 7f0c87fff640 1 --2- 172.21.15.87:0/4236508083 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0c740a1320 0x7f0c740a37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.501+0000 7f0c87fff640 1 --2- 172.21.15.87:0/4236508083 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0c740a1320 0x7f0c740a37e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0c780058c0 tx=0x7f0c78005ec0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:27.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.505+0000 7f0c85ffb640 1 -- 172.21.15.87:0/4236508083 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0c700b6740 con 0x7f0c88103fd0 2024-09-13T17:14:27.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.819+0000 7f0c8e4e5640 1 -- 172.21.15.87:0/4236508083 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c880ff260 con 0x7f0c88103fd0 2024-09-13T17:14:27.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.820+0000 7f0c85ffb640 1 -- 172.21.15.87:0/4236508083 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10877 (secure 0 0 0) 0x7f0c7003f090 con 0x7f0c88103fd0 2024-09-13T17:14:27.821 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:14:27.821 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/3674545180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":3674545180},{"type":"v1","addr":"172.21.15.87:6841","nonce":3674545180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:11:23.313609+0000","modified":"2024-09-13T17:13:50.380502+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24484,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6839/3052680456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3052680456},{"type":"v1","addr":"172.21.15.118:6839","nonce":3052680456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:14:27.821 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 24 2024-09-13T17:14:27.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.822+0000 7f0c8e4e5640 1 -- 172.21.15.87:0/4236508083 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0c740a1320 msgr2=0x7f0c740a37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.822+0000 7f0c8e4e5640 1 --2- 172.21.15.87:0/4236508083 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0c740a1320 0x7f0c740a37e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0c780058c0 tx=0x7f0c78005ec0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.822+0000 7f0c8e4e5640 1 -- 172.21.15.87:0/4236508083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c88103fd0 msgr2=0x7f0c881976b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.822+0000 7f0c8e4e5640 1 --2- 172.21.15.87:0/4236508083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c88103fd0 0x7f0c881976b0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0c70005760 tx=0x7f0c70004270 comp rx=0 tx=0).stop 2024-09-13T17:14:27.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.822+0000 7f0c8e4e5640 1 -- 172.21.15.87:0/4236508083 shutdown_connections 2024-09-13T17:14:27.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.822+0000 7f0c8e4e5640 1 --2- 172.21.15.87:0/4236508083 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c88197c90 0x7f0c881a21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.822+0000 7f0c8e4e5640 1 --2- 172.21.15.87:0/4236508083 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0c740a1320 0x7f0c740a37e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.822+0000 7f0c8e4e5640 1 --2- 172.21.15.87:0/4236508083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c88103fd0 0x7f0c881976b0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.822+0000 7f0c8e4e5640 1 --2- 172.21.15.87:0/4236508083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0c880fee80 0x7f0c88197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.822+0000 7f0c8e4e5640 1 -- 172.21.15.87:0/4236508083 >> 172.21.15.87:0/4236508083 conn(0x7f0c88075c60 msgr2=0x7f0c880fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:27.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.823+0000 7f0c8e4e5640 1 -- 172.21.15.87:0/4236508083 shutdown_connections 2024-09-13T17:14:27.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.823+0000 7f0c8e4e5640 1 -- 172.21.15.87:0/4236508083 wait complete. 2024-09-13T17:14:27.835 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-09-13T17:14:27.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.940+0000 7fc1ad908640 1 -- 172.21.15.87:0/673336344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1a80fff50 msgr2=0x7fc1a8103a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.940+0000 7fc1ad908640 1 --2- 172.21.15.87:0/673336344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1a80fff50 0x7fc1a8103a70 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fc19c009930 tx=0x7fc19c02a420 comp rx=0 tx=0).stop 2024-09-13T17:14:27.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.940+0000 7fc1ad908640 1 -- 172.21.15.87:0/673336344 shutdown_connections 2024-09-13T17:14:27.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.940+0000 7fc1ad908640 1 --2- 172.21.15.87:0/673336344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1a81041d0 0x7fc1a810bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.940+0000 7fc1ad908640 1 --2- 172.21.15.87:0/673336344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1a80fff50 0x7fc1a8103a70 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.940+0000 7fc1ad908640 1 --2- 172.21.15.87:0/673336344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1a80ff5a0 0x7fc1a80ff980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.940+0000 7fc1ad908640 1 -- 172.21.15.87:0/673336344 >> 172.21.15.87:0/673336344 conn(0x7fc1a80753f0 msgr2=0x7fc1a80fc740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:27.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.940+0000 7fc1ad908640 1 -- 172.21.15.87:0/673336344 shutdown_connections 2024-09-13T17:14:27.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.940+0000 7fc1ad908640 1 -- 172.21.15.87:0/673336344 wait complete. 2024-09-13T17:14:27.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.941+0000 7fc1ad908640 1 Processor -- start 2024-09-13T17:14:27.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.941+0000 7fc1ad908640 1 -- start start 2024-09-13T17:14:27.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.941+0000 7fc1ad908640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1a80ff5a0 0x7fc1a8196520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.941+0000 7fc1ad908640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1a81041d0 0x7fc1a8196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.942+0000 7fc1ad908640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1a819ae50 0x7fc1a819b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.942+0000 7fc1ad908640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a819b840 con 0x7fc1a81041d0 2024-09-13T17:14:27.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.942+0000 7fc1ad908640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a819b9b0 con 0x7fc1a80ff5a0 2024-09-13T17:14:27.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.942+0000 7fc1ad908640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a819bb20 con 0x7fc1a819ae50 2024-09-13T17:14:27.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.942+0000 7fc1a67fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1a81041d0 0x7fc1a8196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.942+0000 7fc1a67fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1a81041d0 0x7fc1a8196a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47432/0 (socket says 172.21.15.87:47432) 2024-09-13T17:14:27.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.942+0000 7fc1a67fc640 1 -- 172.21.15.87:0/1331684239 learned_addr learned my addr 172.21.15.87:0/1331684239 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:27.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.942+0000 7fc1a6ffd640 1 --2- 172.21.15.87:0/1331684239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1a80ff5a0 0x7fc1a8196520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.942+0000 7fc1a77fe640 1 --2- 172.21.15.87:0/1331684239 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1a819ae50 0x7fc1a819b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.942+0000 7fc1a67fc640 1 -- 172.21.15.87:0/1331684239 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1a819ae50 msgr2=0x7fc1a819b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.942+0000 7fc1a67fc640 1 --2- 172.21.15.87:0/1331684239 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1a819ae50 0x7fc1a819b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.942+0000 7fc1a67fc640 1 -- 172.21.15.87:0/1331684239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1a80ff5a0 msgr2=0x7fc1a8196520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.942+0000 7fc1a67fc640 1 --2- 172.21.15.87:0/1331684239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1a80ff5a0 0x7fc1a8196520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.942+0000 7fc1a67fc640 1 -- 172.21.15.87:0/1331684239 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc19c009560 con 0x7fc1a81041d0 2024-09-13T17:14:27.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.942+0000 7fc1a77fe640 1 --2- 172.21.15.87:0/1331684239 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1a819ae50 0x7fc1a819b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:27.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.942+0000 7fc1a67fc640 1 --2- 172.21.15.87:0/1331684239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1a81041d0 0x7fc1a8196a60 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fc19c009900 tx=0x7fc19c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:27.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.943+0000 7fc1ac906640 1 -- 172.21.15.87:0/1331684239 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c0037f0 con 0x7fc1a81041d0 2024-09-13T17:14:27.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.943+0000 7fc1ad908640 1 -- 172.21.15.87:0/1331684239 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1a81a3100 con 0x7fc1a81041d0 2024-09-13T17:14:27.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.943+0000 7fc1ac906640 1 -- 172.21.15.87:0/1331684239 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc19c0044c0 con 0x7fc1a81041d0 2024-09-13T17:14:27.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.943+0000 7fc1ac906640 1 -- 172.21.15.87:0/1331684239 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c03bdd0 con 0x7fc1a81041d0 2024-09-13T17:14:27.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.943+0000 7fc1ad908640 1 -- 172.21.15.87:0/1331684239 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1a81a3580 con 0x7fc1a81041d0 2024-09-13T17:14:27.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.945+0000 7fc1ac906640 1 -- 172.21.15.87:0/1331684239 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 25) v1 ==== 136106+0+0 (secure 0 0 0) 0x7fc19c03b560 con 0x7fc1a81041d0 2024-09-13T17:14:27.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.946+0000 7fc1ac906640 1 --2- 172.21.15.87:0/1331684239 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc1900a1320 0x7fc1900a37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.946+0000 7fc1a6ffd640 1 --2- 172.21.15.87:0/1331684239 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc1900a1320 0x7fc1900a37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.946+0000 7fc1ac906640 1 -- 172.21.15.87:0/1331684239 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fc19c0ee1a0 con 0x7fc1a81041d0 2024-09-13T17:14:27.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.946+0000 7fc1a6ffd640 1 --2- 172.21.15.87:0/1331684239 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc1900a1320 0x7fc1900a37e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc198009bd0 tx=0x7fc198005f90 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:27.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.947+0000 7fc1b0628740 1 Processor -- start 2024-09-13T17:14:27.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.947+0000 7fc1b0628740 1 -- start start 2024-09-13T17:14:27.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.947+0000 7fc1b0628740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55de20aa5790 0x55de20aa5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.947+0000 7fc1b0628740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de20aa60b0 0x55de20ab0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.947+0000 7fc1b0628740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55de20ab0950 0x55de20ab2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.947+0000 7fc1b0628740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de20a0fcc0 con 0x55de20aa5790 2024-09-13T17:14:27.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.947+0000 7fc1b0628740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de20a0d450 con 0x55de20aa60b0 2024-09-13T17:14:27.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.947+0000 7fc1b0628740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de20a08d40 con 0x55de20ab0950 2024-09-13T17:14:27.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.947+0000 7fc1a6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55de20aa5790 0x55de20aa5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.947+0000 7fc1a6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55de20aa5790 0x55de20aa5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47448/0 (socket says 172.21.15.87:47448) 2024-09-13T17:14:27.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.947+0000 7fc1a6ffd640 1 -- 172.21.15.87:0/2037421632 learned_addr learned my addr 172.21.15.87:0/2037421632 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:27.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.947+0000 7fc1a67fc640 1 --2- 172.21.15.87:0/2037421632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de20aa60b0 0x55de20ab0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.947+0000 7fc1a77fe640 1 --2- 172.21.15.87:0/2037421632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55de20ab0950 0x55de20ab2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.947+0000 7fc1a6ffd640 1 -- 172.21.15.87:0/2037421632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55de20ab0950 msgr2=0x55de20ab2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:27.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.947+0000 7fc1a6ffd640 1 --2- 172.21.15.87:0/2037421632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55de20ab0950 0x55de20ab2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.947+0000 7fc1a6ffd640 1 -- 172.21.15.87:0/2037421632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de20aa60b0 msgr2=0x55de20ab0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:27.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.947+0000 7fc1a6ffd640 1 --2- 172.21.15.87:0/2037421632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de20aa60b0 0x55de20ab0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.947+0000 7fc1a6ffd640 1 -- 172.21.15.87:0/2037421632 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de209d0620 con 0x55de20aa5790 2024-09-13T17:14:27.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.947+0000 7fc1a67fc640 1 --2- 172.21.15.87:0/2037421632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de20aa60b0 0x55de20ab0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:27.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.948+0000 7fc1a6ffd640 1 --2- 172.21.15.87:0/2037421632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55de20aa5790 0x55de20aa5b70 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fc19800e630 tx=0x7fc198014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6343d3ffe718b46b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:27.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.948+0000 7fc18dffb640 1 -- 172.21.15.87:0/2037421632 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc198004020 con 0x55de20aa5790 2024-09-13T17:14:27.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.948+0000 7fc18dffb640 1 -- 172.21.15.87:0/2037421632 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc198021070 con 0x55de20aa5790 2024-09-13T17:14:27.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.948+0000 7fc18dffb640 1 -- 172.21.15.87:0/2037421632 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19801c470 con 0x55de20aa5790 2024-09-13T17:14:27.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.948+0000 7fc1b0628740 1 -- 172.21.15.87:0/2037421632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55de20aa5790 msgr2=0x55de20aa5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.948+0000 7fc1b0628740 1 --2- 172.21.15.87:0/2037421632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55de20aa5790 0x55de20aa5b70 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fc19800e630 tx=0x7fc198014000 comp rx=0 tx=0).stop 2024-09-13T17:14:27.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.949+0000 7fc1b0628740 1 -- 172.21.15.87:0/2037421632 shutdown_connections 2024-09-13T17:14:27.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.949+0000 7fc1b0628740 1 --2- 172.21.15.87:0/2037421632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55de20ab0950 0x55de20ab2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.949+0000 7fc1b0628740 1 --2- 172.21.15.87:0/2037421632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de20aa60b0 0x55de20ab0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.949+0000 7fc1b0628740 1 --2- 172.21.15.87:0/2037421632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55de20aa5790 0x55de20aa5b70 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.949+0000 7fc1b0628740 1 -- 172.21.15.87:0/2037421632 >> 172.21.15.87:0/2037421632 conn(0x55de20aa1d00 msgr2=0x55de20aa20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:27.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.949+0000 7fc1b0628740 1 -- 172.21.15.87:0/2037421632 shutdown_connections 2024-09-13T17:14:27.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.949+0000 7fc1b0628740 1 -- 172.21.15.87:0/2037421632 wait complete. 2024-09-13T17:14:27.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.949+0000 7fc1b0628740 1 -- start start 2024-09-13T17:14:27.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.949+0000 7fc1b0628740 1 Processor -- start 2024-09-13T17:14:27.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.949+0000 7fc1b0628740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de20aa5790 0x55de20aaff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.949+0000 7fc1b0628740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55de20aa60b0 0x55de20aad2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.949+0000 7fc1b0628740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55de20ab0950 0x55de20aad7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.949+0000 7fc1b0628740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de209c7180 con 0x55de20aa60b0 2024-09-13T17:14:27.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.949+0000 7fc1b0628740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de206e1430 con 0x55de20aa5790 2024-09-13T17:14:27.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.949+0000 7fc1b0628740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de2098c5e0 con 0x55de20ab0950 2024-09-13T17:14:27.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.949+0000 7fc1a67fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55de20aa60b0 0x55de20aad2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.950+0000 7fc1b0628740 10 client.0 _ll_register_callbacks cb 0x55de209f8aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:14:27.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.950+0000 7fc1a67fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55de20aa60b0 0x55de20aad2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47462/0 (socket says 172.21.15.87:47462) 2024-09-13T17:14:27.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.950+0000 7fc1a67fc640 1 -- 172.21.15.87:0/588594827 learned_addr learned my addr 172.21.15.87:0/588594827 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:27.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.950+0000 7fc1a77fe640 1 --2- 172.21.15.87:0/588594827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55de20ab0950 0x55de20aad7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.950+0000 7fc1a6ffd640 1 --2- 172.21.15.87:0/588594827 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de20aa5790 0x55de20aaff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.950+0000 7fc1a67fc640 1 -- 172.21.15.87:0/588594827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55de20ab0950 msgr2=0x55de20aad7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:27.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.950+0000 7fc1a67fc640 1 --2- 172.21.15.87:0/588594827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55de20ab0950 0x55de20aad7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.950+0000 7fc1a67fc640 1 -- 172.21.15.87:0/588594827 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de20aa5790 msgr2=0x55de20aaff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:27.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.950+0000 7fc1a67fc640 1 --2- 172.21.15.87:0/588594827 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de20aa5790 0x55de20aaff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.950+0000 7fc1a67fc640 1 -- 172.21.15.87:0/588594827 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc198017070 con 0x55de20aa60b0 2024-09-13T17:14:27.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.950+0000 7fc1a6ffd640 1 --2- 172.21.15.87:0/588594827 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de20aa5790 0x55de20aaff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:27.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.950+0000 7fc1a67fc640 1 --2- 172.21.15.87:0/588594827 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55de20aa60b0 0x55de20aad2a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc19c0eb4d0 tx=0x7fc19c0ba7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b349c4ad12fa261a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:27.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.950+0000 7fc186ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:14:27.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.950+0000 7fc186ffd640 1 -- 172.21.15.87:0/588594827 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c0bb1e0 con 0x55de20aa60b0 2024-09-13T17:14:27.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.950+0000 7fc186ffd640 1 -- 172.21.15.87:0/588594827 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fc19c0c3200 con 0x55de20aa60b0 2024-09-13T17:14:27.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.950+0000 7fc1b0628740 1 -- 172.21.15.87:0/588594827 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55de20a32b80 con 0x55de20aa60b0 2024-09-13T17:14:27.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.950+0000 7fc186ffd640 1 -- 172.21.15.87:0/588594827 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc19c0ee020 con 0x55de20aa60b0 2024-09-13T17:14:27.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.950+0000 7fc1b0628740 10 client.15849 fetch_fsmap learned FSMap version 24 2024-09-13T17:14:27.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.950+0000 7fc1b0628740 1 -- 172.21.15.87:0/588594827 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55de20a073c0 con 0x55de20aa60b0 2024-09-13T17:14:27.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.951+0000 7fc186ffd640 1 -- 172.21.15.87:0/588594827 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55de20a32b80 con 0x55de20aa60b0 2024-09-13T17:14:27.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.951+0000 7fc186ffd640 1 -- 172.21.15.87:0/588594827 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc19c04e070 con 0x55de20aa60b0 2024-09-13T17:14:27.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.951+0000 7fc1b0628740 10 client.15849 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:14:27.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.951+0000 7fc1b0628740 10 client.15849 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:14:27.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.951+0000 7fc1b0628740 20 client.15849 populate_metadata read hostname 'smithi087' 2024-09-13T17:14:27.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.951+0000 7fc1b0628740 1 --2- 172.21.15.87:0/588594827 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55de20abfd90 0x55de20ac21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.951+0000 7fc1b0628740 4 client.15849 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:14:27.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.951+0000 7fc1b0628740 1 -- 172.21.15.87:0/588594827 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55de209fb1f0 con 0x55de20abfd90 2024-09-13T17:14:27.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.951+0000 7fc1a6ffd640 1 --2- 172.21.15.87:0/588594827 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55de20abfd90 0x55de20ac21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.952+0000 7fc186ffd640 10 client.15849 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:14:27.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.952+0000 7fc1a6ffd640 1 --2- 172.21.15.87:0/588594827 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55de20abfd90 0x55de20ac21b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=55897b0a93b54edf server_cookie=3ed96696ea57b06a in_seq=0 out_seq=0 2024-09-13T17:14:27.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.952+0000 7fc186ffd640 1 -- 172.21.15.87:0/588594827 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55de209fb1f0 con 0x55de20abfd90 2024-09-13T17:14:27.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.952+0000 7fc186ffd640 10 client.15849 handle_command_reply: tid=0 2024-09-13T17:14:27.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.952+0000 7fc1b0628740 1 client.15849 shutdown 2024-09-13T17:14:27.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.953+0000 7fc1b0628740 1 -- 172.21.15.87:0/588594827 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55de20aa60b0 msgr2=0x55de20aad2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.953+0000 7fc1b0628740 1 --2- 172.21.15.87:0/588594827 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55de20aa60b0 0x55de20aad2a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc19c0eb4d0 tx=0x7fc19c0ba7a0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.953+0000 7fc1b0628740 1 -- 172.21.15.87:0/588594827 shutdown_connections 2024-09-13T17:14:27.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.953+0000 7fc1b0628740 1 --2- 172.21.15.87:0/588594827 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55de20abfd90 0x55de20ac21b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.953+0000 7fc1b0628740 1 --2- 172.21.15.87:0/588594827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55de20ab0950 0x55de20aad7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.953+0000 7fc1b0628740 1 --2- 172.21.15.87:0/588594827 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55de20aa60b0 0x55de20aad2a0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.953+0000 7fc1b0628740 1 --2- 172.21.15.87:0/588594827 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de20aa5790 0x55de20aaff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.953+0000 7fc1b0628740 1 -- 172.21.15.87:0/588594827 >> 172.21.15.87:0/588594827 conn(0x55de20aa1d00 msgr2=0x55de20aa7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:27.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.953+0000 7fc186ffd640 0 client.15849 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:14:27.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.953+0000 7fc1b0628740 1 -- 172.21.15.87:0/588594827 shutdown_connections 2024-09-13T17:14:27.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.953+0000 7fc1b0628740 1 -- 172.21.15.87:0/588594827 wait complete. 2024-09-13T17:14:27.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.953+0000 7fc1b0628740 20 client.15849 trim_cache size 0 max 16384 2024-09-13T17:14:27.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.974+0000 7fc1b0628740 1 Processor -- start 2024-09-13T17:14:27.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.974+0000 7fc1b0628740 1 -- start start 2024-09-13T17:14:27.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.974+0000 7fc1b0628740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de20aa5790 0x55de20ab7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.974+0000 7fc1b0628740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55de20aa60b0 0x55de20ab7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.974+0000 7fc1b0628740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55de20ab0950 0x55de20aabb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.974+0000 7fc1b0628740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de20a9d860 con 0x55de20ab0950 2024-09-13T17:14:27.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.974+0000 7fc1b0628740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de20a9c3b0 con 0x55de20aa5790 2024-09-13T17:14:27.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.974+0000 7fc1b0628740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de20aadb50 con 0x55de20aa60b0 2024-09-13T17:14:27.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.974+0000 7fc1a77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55de20ab0950 0x55de20aabb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.974+0000 7fc1a77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55de20ab0950 0x55de20aabb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47468/0 (socket says 172.21.15.87:47468) 2024-09-13T17:14:27.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.975+0000 7fc1a77fe640 1 -- 172.21.15.87:0/256921151 learned_addr learned my addr 172.21.15.87:0/256921151 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:27.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.975+0000 7fc1a6ffd640 1 --2- 172.21.15.87:0/256921151 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de20aa5790 0x55de20ab7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.975+0000 7fc1a67fc640 1 --2- 172.21.15.87:0/256921151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55de20aa60b0 0x55de20ab7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.975+0000 7fc1a77fe640 1 -- 172.21.15.87:0/256921151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55de20aa60b0 msgr2=0x55de20ab7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:27.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.975+0000 7fc1a77fe640 1 --2- 172.21.15.87:0/256921151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55de20aa60b0 0x55de20ab7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.975+0000 7fc1a77fe640 1 -- 172.21.15.87:0/256921151 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de20aa5790 msgr2=0x55de20ab7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:27.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.975+0000 7fc1a77fe640 1 --2- 172.21.15.87:0/256921151 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de20aa5790 0x55de20ab7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.975+0000 7fc1a77fe640 1 -- 172.21.15.87:0/256921151 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de209a9770 con 0x55de20ab0950 2024-09-13T17:14:27.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.975+0000 7fc1a6ffd640 1 --2- 172.21.15.87:0/256921151 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de20aa5790 0x55de20ab7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:14:27.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.975+0000 7fc1a77fe640 1 --2- 172.21.15.87:0/256921151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55de20ab0950 0x55de20aabb50 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0009ed0 tx=0x7fc1a00127c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef757cb456f5466 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:27.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.975+0000 7fc18e7fc640 1 -- 172.21.15.87:0/256921151 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a0003b70 con 0x55de20ab0950 2024-09-13T17:14:27.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.975+0000 7fc18e7fc640 1 -- 172.21.15.87:0/256921151 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc1a0003cd0 con 0x55de20ab0950 2024-09-13T17:14:27.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.975+0000 7fc18e7fc640 1 -- 172.21.15.87:0/256921151 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a00108e0 con 0x55de20ab0950 2024-09-13T17:14:27.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.976+0000 7fc1b0628740 1 -- 172.21.15.87:0/256921151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55de20ab0950 msgr2=0x55de20aabb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.976+0000 7fc1b0628740 1 --2- 172.21.15.87:0/256921151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55de20ab0950 0x55de20aabb50 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0009ed0 tx=0x7fc1a00127c0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.976+0000 7fc1b0628740 1 -- 172.21.15.87:0/256921151 shutdown_connections 2024-09-13T17:14:27.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.976+0000 7fc1b0628740 1 --2- 172.21.15.87:0/256921151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55de20ab0950 0x55de20aabb50 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.976+0000 7fc1b0628740 1 --2- 172.21.15.87:0/256921151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55de20aa60b0 0x55de20ab7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.976+0000 7fc1b0628740 1 --2- 172.21.15.87:0/256921151 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de20aa5790 0x55de20ab7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.976+0000 7fc1b0628740 1 -- 172.21.15.87:0/256921151 >> 172.21.15.87:0/256921151 conn(0x55de20aa1d00 msgr2=0x55de20aa20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:27.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.976+0000 7fc1b0628740 1 -- 172.21.15.87:0/256921151 shutdown_connections 2024-09-13T17:14:27.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.976+0000 7fc1b0628740 1 -- 172.21.15.87:0/256921151 wait complete. 2024-09-13T17:14:27.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.977+0000 7fc1b0628740 1 -- start start 2024-09-13T17:14:27.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.977+0000 7fc1b0628740 1 Processor -- start 2024-09-13T17:14:27.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.977+0000 7fc1b0628740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de20aa5790 0x55de20ab79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.977+0000 7fc1b0628740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55de20aa60b0 0x55de20aa9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.977+0000 7fc1b0628740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55de20ab0950 0x55de20aaa360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.977+0000 7fc1b0628740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de20aaaa60 con 0x55de20aa60b0 2024-09-13T17:14:27.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.977+0000 7fc1b0628740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de20aaabd0 con 0x55de20aa5790 2024-09-13T17:14:27.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.977+0000 7fc1b0628740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de20b16290 con 0x55de20ab0950 2024-09-13T17:14:27.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.977+0000 7fc1a67fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55de20aa60b0 0x55de20aa9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.977+0000 7fc1a67fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55de20aa60b0 0x55de20aa9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47474/0 (socket says 172.21.15.87:47474) 2024-09-13T17:14:27.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.977+0000 7fc1b0628740 10 client.0 _ll_register_callbacks cb 0x7fc198009660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:14:27.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.977+0000 7fc1a67fc640 1 -- 172.21.15.87:0/648641377 learned_addr learned my addr 172.21.15.87:0/648641377 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:27.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.978+0000 7fc1a6ffd640 1 --2- 172.21.15.87:0/648641377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de20aa5790 0x55de20ab79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.978+0000 7fc1a67fc640 1 -- 172.21.15.87:0/648641377 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55de20ab0950 msgr2=0x55de20aaa360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:27.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.978+0000 7fc1a67fc640 1 --2- 172.21.15.87:0/648641377 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55de20ab0950 0x55de20aaa360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.978+0000 7fc1a67fc640 1 -- 172.21.15.87:0/648641377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de20aa5790 msgr2=0x55de20ab79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:27.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.978+0000 7fc1a67fc640 1 --2- 172.21.15.87:0/648641377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de20aa5790 0x55de20ab79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.978+0000 7fc1a67fc640 1 -- 172.21.15.87:0/648641377 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55de209d0620 con 0x55de20aa60b0 2024-09-13T17:14:27.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.978+0000 7fc1a67fc640 1 --2- 172.21.15.87:0/648641377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55de20aa60b0 0x55de20aa9dc0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fc19c005ab0 tx=0x7fc19c0b70c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b3829b41b95d670 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:27.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.978+0000 7fc186ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:14:27.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.978+0000 7fc186ffd640 1 -- 172.21.15.87:0/648641377 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c0ee040 con 0x55de20aa60b0 2024-09-13T17:14:27.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.978+0000 7fc186ffd640 1 -- 172.21.15.87:0/648641377 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fc19c0c3200 con 0x55de20aa60b0 2024-09-13T17:14:27.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.978+0000 7fc1b0628740 1 -- 172.21.15.87:0/648641377 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc198021070 con 0x55de20aa60b0 2024-09-13T17:14:27.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.978+0000 7fc186ffd640 1 -- 172.21.15.87:0/648641377 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc19c0bafe0 con 0x55de20aa60b0 2024-09-13T17:14:27.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.978+0000 7fc1b0628740 10 client.15855 fetch_fsmap learned FSMap version 24 2024-09-13T17:14:27.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.978+0000 7fc1b0628740 1 -- 172.21.15.87:0/648641377 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7fc1a0009ad0 con 0x55de20aa60b0 2024-09-13T17:14:27.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.978+0000 7fc186ffd640 1 -- 172.21.15.87:0/648641377 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc19c0a42a0 con 0x55de20aa60b0 2024-09-13T17:14:27.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.979+0000 7fc186ffd640 1 -- 172.21.15.87:0/648641377 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc19c04e040 con 0x55de20aa60b0 2024-09-13T17:14:27.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.979+0000 7fc1b0628740 10 client.15855 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:14:27.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.979+0000 7fc1b0628740 10 client.15855 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:14:27.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.979+0000 7fc1b0628740 20 client.15855 populate_metadata read hostname 'smithi087' 2024-09-13T17:14:27.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.979+0000 7fc1b0628740 1 --2- 172.21.15.87:0/648641377 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55de20b176c0 0x55de20b19ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:27.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.979+0000 7fc1b0628740 4 client.15855 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:14:27.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.979+0000 7fc1b0628740 1 -- 172.21.15.87:0/648641377 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7fc198021070 con 0x55de20b176c0 2024-09-13T17:14:27.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.979+0000 7fc1a6ffd640 1 --2- 172.21.15.87:0/648641377 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55de20b176c0 0x55de20b19ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:27.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.979+0000 7fc186ffd640 10 client.15855 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:14:27.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.979+0000 7fc1a6ffd640 1 --2- 172.21.15.87:0/648641377 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55de20b176c0 0x55de20b19ae0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=39366e52e4311afa server_cookie=7750a90143ce6191 in_seq=0 out_seq=0 2024-09-13T17:14:27.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.980+0000 7fc186ffd640 1 -- 172.21.15.87:0/648641377 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7fc198021070 con 0x55de20b176c0 2024-09-13T17:14:27.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.980+0000 7fc186ffd640 10 client.15855 handle_command_reply: tid=0 2024-09-13T17:14:27.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.980+0000 7fc1b0628740 1 client.15855 shutdown 2024-09-13T17:14:27.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.980+0000 7fc1b0628740 1 -- 172.21.15.87:0/648641377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55de20aa60b0 msgr2=0x55de20aa9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.980+0000 7fc1b0628740 1 --2- 172.21.15.87:0/648641377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55de20aa60b0 0x55de20aa9dc0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fc19c005ab0 tx=0x7fc19c0b70c0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.980+0000 7fc1b0628740 1 -- 172.21.15.87:0/648641377 shutdown_connections 2024-09-13T17:14:27.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.980+0000 7fc1b0628740 1 --2- 172.21.15.87:0/648641377 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55de20b176c0 0x55de20b19ae0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.980+0000 7fc1b0628740 1 --2- 172.21.15.87:0/648641377 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55de20ab0950 0x55de20aaa360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.980+0000 7fc1b0628740 1 --2- 172.21.15.87:0/648641377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55de20aa60b0 0x55de20aa9dc0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.980+0000 7fc186ffd640 0 client.15855 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:14:27.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.980+0000 7fc1b0628740 1 --2- 172.21.15.87:0/648641377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de20aa5790 0x55de20ab79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.980+0000 7fc1b0628740 1 -- 172.21.15.87:0/648641377 >> 172.21.15.87:0/648641377 conn(0x55de20aa1d00 msgr2=0x55de20aabae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:27.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.980+0000 7fc1b0628740 1 -- 172.21.15.87:0/648641377 shutdown_connections 2024-09-13T17:14:27.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.980+0000 7fc1b0628740 1 -- 172.21.15.87:0/648641377 wait complete. 2024-09-13T17:14:27.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.980+0000 7fc1b0628740 20 client.15855 trim_cache size 0 max 16384 2024-09-13T17:14:27.986 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:14:27.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.981+0000 7fc1ad908640 1 -- 172.21.15.87:0/1331684239 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc1900a1320 msgr2=0x7fc1900a37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.981+0000 7fc1ad908640 1 --2- 172.21.15.87:0/1331684239 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc1900a1320 0x7fc1900a37e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc198009bd0 tx=0x7fc198005f90 comp rx=0 tx=0).stop 2024-09-13T17:14:27.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.981+0000 7fc1ad908640 1 -- 172.21.15.87:0/1331684239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1a81041d0 msgr2=0x7fc1a8196a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:27.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.981+0000 7fc1ad908640 1 --2- 172.21.15.87:0/1331684239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1a81041d0 0x7fc1a8196a60 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fc19c009900 tx=0x7fc19c0040c0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.981+0000 7fc1ad908640 1 -- 172.21.15.87:0/1331684239 shutdown_connections 2024-09-13T17:14:27.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.981+0000 7fc1ad908640 1 --2- 172.21.15.87:0/1331684239 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1a819ae50 0x7fc1a819b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.981+0000 7fc1ad908640 1 --2- 172.21.15.87:0/1331684239 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc1900a1320 0x7fc1900a37e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.981+0000 7fc1ad908640 1 --2- 172.21.15.87:0/1331684239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1a81041d0 0x7fc1a8196a60 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.981+0000 7fc1ad908640 1 --2- 172.21.15.87:0/1331684239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1a80ff5a0 0x7fc1a8196520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:27.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.981+0000 7fc1ad908640 1 -- 172.21.15.87:0/1331684239 >> 172.21.15.87:0/1331684239 conn(0x7fc1a80753f0 msgr2=0x7fc1a8101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:27.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.981+0000 7fc1ad908640 1 -- 172.21.15.87:0/1331684239 shutdown_connections 2024-09-13T17:14:27.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:27.981+0000 7fc1ad908640 1 -- 172.21.15.87:0/1331684239 wait complete. 2024-09-13T17:14:27.995 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-09-13T17:14:28.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.098+0000 7f750e725640 1 -- 172.21.15.87:0/1282301697 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75080ff810 msgr2=0x7f7508103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:28.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.098+0000 7f750e725640 1 --2- 172.21.15.87:0/1282301697 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75080ff810 0x7f7508103850 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f74fc009930 tx=0x7f74fc02a420 comp rx=0 tx=0).stop 2024-09-13T17:14:28.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.098+0000 7f750e725640 1 -- 172.21.15.87:0/1282301697 shutdown_connections 2024-09-13T17:14:28.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.098+0000 7f750e725640 1 --2- 172.21.15.87:0/1282301697 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7508103fb0 0x7f750810bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.098+0000 7f750e725640 1 --2- 172.21.15.87:0/1282301697 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75080ff810 0x7f7508103850 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.098+0000 7f750e725640 1 --2- 172.21.15.87:0/1282301697 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75080fee60 0x7f75080ff240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.098+0000 7f750e725640 1 -- 172.21.15.87:0/1282301697 >> 172.21.15.87:0/1282301697 conn(0x7f7508075c60 msgr2=0x7f75080fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:28.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.098+0000 7f750e725640 1 -- 172.21.15.87:0/1282301697 shutdown_connections 2024-09-13T17:14:28.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.098+0000 7f750e725640 1 -- 172.21.15.87:0/1282301697 wait complete. 2024-09-13T17:14:28.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.099+0000 7f750e725640 1 Processor -- start 2024-09-13T17:14:28.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.099+0000 7f750e725640 1 -- start start 2024-09-13T17:14:28.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.099+0000 7f750e725640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75080fee60 0x7f7508197190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.099+0000 7f750e725640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7508103fb0 0x7f75081976d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.099+0000 7f750e725640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7508197c10 0x7f75081a2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.099+0000 7f750e725640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75081a28b0 con 0x7f7508103fb0 2024-09-13T17:14:28.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.099+0000 7f750e725640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75081a2a20 con 0x7f7508197c10 2024-09-13T17:14:28.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.099+0000 7f750e725640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75081a2be0 con 0x7f75080fee60 2024-09-13T17:14:28.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.099+0000 7f75077fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7508103fb0 0x7f75081976d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.099+0000 7f75077fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7508103fb0 0x7f75081976d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47488/0 (socket says 172.21.15.87:47488) 2024-09-13T17:14:28.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.099+0000 7f75077fe640 1 -- 172.21.15.87:0/1232853206 learned_addr learned my addr 172.21.15.87:0/1232853206 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:28.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.099+0000 7f7507fff640 1 --2- 172.21.15.87:0/1232853206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75080fee60 0x7f7508197190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.099+0000 7f750ccc2640 1 --2- 172.21.15.87:0/1232853206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7508197c10 0x7f75081a2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.099+0000 7f75077fe640 1 -- 172.21.15.87:0/1232853206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75080fee60 msgr2=0x7f7508197190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:28.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.099+0000 7f75077fe640 1 --2- 172.21.15.87:0/1232853206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75080fee60 0x7f7508197190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.099+0000 7f75077fe640 1 -- 172.21.15.87:0/1232853206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7508197c10 msgr2=0x7f75081a2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:28.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.099+0000 7f75077fe640 1 --2- 172.21.15.87:0/1232853206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7508197c10 0x7f75081a2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.100+0000 7f75077fe640 1 -- 172.21.15.87:0/1232853206 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74fc009560 con 0x7f7508103fb0 2024-09-13T17:14:28.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.100+0000 7f75077fe640 1 --2- 172.21.15.87:0/1232853206 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7508103fb0 0x7f75081976d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f74fc009900 tx=0x7f74fc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:28.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.100+0000 7f75057fa640 1 -- 172.21.15.87:0/1232853206 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc003a00 con 0x7f7508103fb0 2024-09-13T17:14:28.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.100+0000 7f750e725640 1 -- 172.21.15.87:0/1232853206 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75081a2e60 con 0x7f7508103fb0 2024-09-13T17:14:28.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.100+0000 7f75057fa640 1 -- 172.21.15.87:0/1232853206 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f74fc0044e0 con 0x7f7508103fb0 2024-09-13T17:14:28.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.100+0000 7f75057fa640 1 -- 172.21.15.87:0/1232853206 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc03a3c0 con 0x7f7508103fb0 2024-09-13T17:14:28.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.100+0000 7f750e725640 1 -- 172.21.15.87:0/1232853206 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75081a3280 con 0x7f7508103fb0 2024-09-13T17:14:28.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.103+0000 7f751144d740 1 Processor -- start 2024-09-13T17:14:28.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.103+0000 7f75057fa640 1 -- 172.21.15.87:0/1232853206 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 25) v1 ==== 136106+0+0 (secure 0 0 0) 0x7f74fc03b460 con 0x7f7508103fb0 2024-09-13T17:14:28.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.103+0000 7f751144d740 1 -- start start 2024-09-13T17:14:28.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.103+0000 7f751144d740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e3f6ff4d20 0x55e3f6ff3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.104+0000 7f751144d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e3f6ff3b70 0x55e3f6ff3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.104+0000 7f751144d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3f7006ff0 0x55e3f70093e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.104+0000 7f751144d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f6f5dcc0 con 0x55e3f7006ff0 2024-09-13T17:14:28.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.104+0000 7f751144d740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f6f5b450 con 0x55e3f6ff4d20 2024-09-13T17:14:28.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.104+0000 7f751144d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f6f56d40 con 0x55e3f6ff3b70 2024-09-13T17:14:28.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.104+0000 7f75077fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3f7006ff0 0x55e3f70093e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.104+0000 7f75077fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3f7006ff0 0x55e3f70093e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47496/0 (socket says 172.21.15.87:47496) 2024-09-13T17:14:28.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.104+0000 7f75077fe640 1 -- 172.21.15.87:0/1094038760 learned_addr learned my addr 172.21.15.87:0/1094038760 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:28.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.104+0000 7f7507fff640 1 --2- 172.21.15.87:0/1094038760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e3f6ff3b70 0x55e3f6ff3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.104+0000 7f750ccc2640 1 --2- 172.21.15.87:0/1094038760 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e3f6ff4d20 0x55e3f6ff3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.104+0000 7f75057fa640 1 --2- 172.21.15.87:0/1232853206 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f74f00a1320 0x7f74f00a37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.104+0000 7f75077fe640 1 -- 172.21.15.87:0/1094038760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e3f6ff3b70 msgr2=0x55e3f6ff3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:28.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.104+0000 7f75077fe640 1 --2- 172.21.15.87:0/1094038760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e3f6ff3b70 0x55e3f6ff3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.104+0000 7f75077fe640 1 -- 172.21.15.87:0/1094038760 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e3f6ff4d20 msgr2=0x55e3f6ff3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:28.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.104+0000 7f75077fe640 1 --2- 172.21.15.87:0/1094038760 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e3f6ff4d20 0x55e3f6ff3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.104+0000 7f75077fe640 1 -- 172.21.15.87:0/1094038760 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3f6f1e620 con 0x55e3f7006ff0 2024-09-13T17:14:28.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.104+0000 7f750ccc2640 1 --2- 172.21.15.87:0/1232853206 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f74f00a1320 0x7f74f00a37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.105+0000 7f75077fe640 1 --2- 172.21.15.87:0/1094038760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3f7006ff0 0x55e3f70093e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f74fc0eaf60 tx=0x7f74fc089ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c4c914e3c7e3f68 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:28.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.105+0000 7f75057fa640 1 -- 172.21.15.87:0/1232853206 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f74fc0edc30 con 0x7f7508103fb0 2024-09-13T17:14:28.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.105+0000 7f750ccc2640 1 --2- 172.21.15.87:0/1232853206 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f74f00a1320 0x7f74f00a37e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f750000a5a0 tx=0x7f750000c040 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:28.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.105+0000 7f74ee7fc640 1 -- 172.21.15.87:0/1094038760 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc0ba170 con 0x55e3f7006ff0 2024-09-13T17:14:28.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.105+0000 7f74ee7fc640 1 -- 172.21.15.87:0/1094038760 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f74fc0baa70 con 0x55e3f7006ff0 2024-09-13T17:14:28.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.105+0000 7f74ee7fc640 1 -- 172.21.15.87:0/1094038760 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc0898e0 con 0x55e3f7006ff0 2024-09-13T17:14:28.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.106+0000 7f751144d740 1 -- 172.21.15.87:0/1094038760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3f7006ff0 msgr2=0x55e3f70093e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:28.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.106+0000 7f751144d740 1 --2- 172.21.15.87:0/1094038760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3f7006ff0 0x55e3f70093e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f74fc0eaf60 tx=0x7f74fc089ad0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.106+0000 7f751144d740 1 -- 172.21.15.87:0/1094038760 shutdown_connections 2024-09-13T17:14:28.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.106+0000 7f751144d740 1 --2- 172.21.15.87:0/1094038760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3f7006ff0 0x55e3f70093e0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.106+0000 7f751144d740 1 --2- 172.21.15.87:0/1094038760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e3f6ff3b70 0x55e3f6ff3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.106+0000 7f751144d740 1 --2- 172.21.15.87:0/1094038760 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e3f6ff4d20 0x55e3f6ff3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.106+0000 7f751144d740 1 -- 172.21.15.87:0/1094038760 >> 172.21.15.87:0/1094038760 conn(0x55e3f6fefd00 msgr2=0x55e3f6ff00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:28.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.106+0000 7f751144d740 1 -- 172.21.15.87:0/1094038760 shutdown_connections 2024-09-13T17:14:28.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.106+0000 7f751144d740 1 -- 172.21.15.87:0/1094038760 wait complete. 2024-09-13T17:14:28.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.106+0000 7f751144d740 1 -- start start 2024-09-13T17:14:28.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.107+0000 7f751144d740 1 Processor -- start 2024-09-13T17:14:28.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.107+0000 7f751144d740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e3f6ff3b70 0x55e3f6ff9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.107+0000 7f751144d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3f6ff4d20 0x55e3f6ff9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.107+0000 7f751144d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e3f7006ff0 0x55e3f6ff6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.107+0000 7f751144d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f6f15180 con 0x55e3f6ff4d20 2024-09-13T17:14:28.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.107+0000 7f751144d740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f6c2f430 con 0x55e3f6ff3b70 2024-09-13T17:14:28.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.107+0000 7f751144d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f6eda5e0 con 0x55e3f7006ff0 2024-09-13T17:14:28.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.107+0000 7f751144d740 10 client.0 _ll_register_callbacks cb 0x55e3f6f46aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:14:28.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.107+0000 7f75077fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3f6ff4d20 0x55e3f6ff9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.107+0000 7f75077fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3f6ff4d20 0x55e3f6ff9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47506/0 (socket says 172.21.15.87:47506) 2024-09-13T17:14:28.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.107+0000 7f75077fe640 1 -- 172.21.15.87:0/1024003239 learned_addr learned my addr 172.21.15.87:0/1024003239 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:28.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.107+0000 7f7507fff640 1 --2- 172.21.15.87:0/1024003239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e3f6ff3b70 0x55e3f6ff9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.108+0000 7f75077fe640 1 -- 172.21.15.87:0/1024003239 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e3f7006ff0 msgr2=0x55e3f6ff6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:28.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.108+0000 7f75077fe640 1 --2- 172.21.15.87:0/1024003239 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e3f7006ff0 0x55e3f6ff6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.108+0000 7f75077fe640 1 -- 172.21.15.87:0/1024003239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e3f6ff3b70 msgr2=0x55e3f6ff9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:28.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.108+0000 7f75077fe640 1 --2- 172.21.15.87:0/1024003239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e3f6ff3b70 0x55e3f6ff9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.108+0000 7f75077fe640 1 -- 172.21.15.87:0/1024003239 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75081a3280 con 0x55e3f6ff4d20 2024-09-13T17:14:28.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.108+0000 7f75077fe640 1 --2- 172.21.15.87:0/1024003239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3f6ff4d20 0x55e3f6ff9ed0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f74fc006010 tx=0x7f74fc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=756ff5ef3d386670 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:28.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.108+0000 7f74e77fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:14:28.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.108+0000 7f74e77fe640 1 -- 172.21.15.87:0/1024003239 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc0ba170 con 0x55e3f6ff4d20 2024-09-13T17:14:28.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.108+0000 7f751144d740 1 -- 172.21.15.87:0/1024003239 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e3f6f80b80 con 0x55e3f6ff4d20 2024-09-13T17:14:28.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.108+0000 7f74e77fe640 1 -- 172.21.15.87:0/1024003239 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f74fc0ba810 con 0x55e3f6ff4d20 2024-09-13T17:14:28.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.108+0000 7f74e77fe640 1 -- 172.21.15.87:0/1024003239 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74fc03b710 con 0x55e3f6ff4d20 2024-09-13T17:14:28.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.108+0000 7f751144d740 10 client.15867 fetch_fsmap learned FSMap version 24 2024-09-13T17:14:28.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.108+0000 7f751144d740 1 -- 172.21.15.87:0/1024003239 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55e3f6f553c0 con 0x55e3f6ff4d20 2024-09-13T17:14:28.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.108+0000 7f74e77fe640 1 -- 172.21.15.87:0/1024003239 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55e3f6f80b80 con 0x55e3f6ff4d20 2024-09-13T17:14:28.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.109+0000 7f74e77fe640 1 -- 172.21.15.87:0/1024003239 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f74fc0b6f20 con 0x55e3f6ff4d20 2024-09-13T17:14:28.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.109+0000 7f751144d740 10 client.15867 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:14:28.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.109+0000 7f751144d740 10 client.15867 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:14:28.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.109+0000 7f751144d740 20 client.15867 populate_metadata read hostname 'smithi087' 2024-09-13T17:14:28.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.109+0000 7f751144d740 1 --2- 172.21.15.87:0/1024003239 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55e3f7016330 0x55e3f7018720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.109+0000 7f751144d740 4 client.15867 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:14:28.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.109+0000 7f751144d740 1 -- 172.21.15.87:0/1024003239 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e3f6f491f0 con 0x55e3f7016330 2024-09-13T17:14:28.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.109+0000 7f7507fff640 1 --2- 172.21.15.87:0/1024003239 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55e3f7016330 0x55e3f7018720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.110+0000 7f7507fff640 1 --2- 172.21.15.87:0/1024003239 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55e3f7016330 0x55e3f7018720 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1a75f4ed026e704d server_cookie=b58d4486c4e9ab71 in_seq=0 out_seq=0 2024-09-13T17:14:28.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.110+0000 7f74e77fe640 10 client.15867 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:14:28.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.110+0000 7f74e77fe640 1 -- 172.21.15.87:0/1024003239 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55e3f6f491f0 con 0x55e3f7016330 2024-09-13T17:14:28.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.110+0000 7f74e77fe640 10 client.15867 handle_command_reply: tid=0 2024-09-13T17:14:28.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.110+0000 7f751144d740 1 client.15867 shutdown 2024-09-13T17:14:28.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.110+0000 7f751144d740 1 -- 172.21.15.87:0/1024003239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3f6ff4d20 msgr2=0x55e3f6ff9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:28.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.110+0000 7f751144d740 1 --2- 172.21.15.87:0/1024003239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3f6ff4d20 0x55e3f6ff9ed0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f74fc006010 tx=0x7f74fc009260 comp rx=0 tx=0).stop 2024-09-13T17:14:28.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.110+0000 7f751144d740 1 -- 172.21.15.87:0/1024003239 shutdown_connections 2024-09-13T17:14:28.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.110+0000 7f751144d740 1 --2- 172.21.15.87:0/1024003239 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55e3f7016330 0x55e3f7018720 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.110+0000 7f751144d740 1 --2- 172.21.15.87:0/1024003239 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e3f7006ff0 0x55e3f6ff6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.110+0000 7f74e77fe640 0 client.15867 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:14:28.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.110+0000 7f751144d740 1 --2- 172.21.15.87:0/1024003239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3f6ff4d20 0x55e3f6ff9ed0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.110+0000 7f751144d740 1 --2- 172.21.15.87:0/1024003239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e3f6ff3b70 0x55e3f6ff9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.110+0000 7f751144d740 1 -- 172.21.15.87:0/1024003239 >> 172.21.15.87:0/1024003239 conn(0x55e3f6fefd00 msgr2=0x55e3f6feeeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:28.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.111+0000 7f751144d740 1 -- 172.21.15.87:0/1024003239 shutdown_connections 2024-09-13T17:14:28.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.111+0000 7f751144d740 1 -- 172.21.15.87:0/1024003239 wait complete. 2024-09-13T17:14:28.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.111+0000 7f751144d740 20 client.15867 trim_cache size 0 max 16384 2024-09-13T17:14:28.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.122+0000 7f751144d740 1 Processor -- start 2024-09-13T17:14:28.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.122+0000 7f751144d740 1 -- start start 2024-09-13T17:14:28.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.122+0000 7f751144d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3f6ff3b70 0x55e3f6fef6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.122+0000 7f751144d740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e3f6ff4d20 0x55e3f70083e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.122+0000 7f751144d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e3f7006ff0 0x55e3f6ff00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.122+0000 7f751144d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f6f49220 con 0x55e3f6ff3b70 2024-09-13T17:14:28.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.122+0000 7f751144d740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f6f80bb0 con 0x55e3f6ff4d20 2024-09-13T17:14:28.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.122+0000 7f751144d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f6feb6b0 con 0x55e3f7006ff0 2024-09-13T17:14:28.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.122+0000 7f7507fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3f6ff3b70 0x55e3f6fef6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.122+0000 7f7507fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3f6ff3b70 0x55e3f6fef6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47514/0 (socket says 172.21.15.87:47514) 2024-09-13T17:14:28.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.122+0000 7f7507fff640 1 -- 172.21.15.87:0/94737021 learned_addr learned my addr 172.21.15.87:0/94737021 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:28.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.122+0000 7f750ccc2640 1 --2- 172.21.15.87:0/94737021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e3f7006ff0 0x55e3f6ff00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.122+0000 7f75077fe640 1 --2- 172.21.15.87:0/94737021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e3f6ff4d20 0x55e3f70083e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.122+0000 7f7507fff640 1 -- 172.21.15.87:0/94737021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e3f7006ff0 msgr2=0x55e3f6ff00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:28.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.122+0000 7f7507fff640 1 --2- 172.21.15.87:0/94737021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e3f7006ff0 0x55e3f6ff00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.122+0000 7f7507fff640 1 -- 172.21.15.87:0/94737021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e3f6ff4d20 msgr2=0x55e3f70083e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:28.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.122+0000 7f7507fff640 1 --2- 172.21.15.87:0/94737021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e3f6ff4d20 0x55e3f70083e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.122+0000 7f7507fff640 1 -- 172.21.15.87:0/94737021 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3f6feb4d0 con 0x55e3f6ff3b70 2024-09-13T17:14:28.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.122+0000 7f750ccc2640 1 --2- 172.21.15.87:0/94737021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e3f7006ff0 0x55e3f6ff00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:28.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.123+0000 7f7507fff640 1 --2- 172.21.15.87:0/94737021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3f6ff3b70 0x55e3f6fef6a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f74f800bfb0 tx=0x7f74f80138f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0f76c8f2439aac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:28.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.123+0000 7f74eeffd640 1 -- 172.21.15.87:0/94737021 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f8017040 con 0x55e3f6ff3b70 2024-09-13T17:14:28.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.123+0000 7f74eeffd640 1 -- 172.21.15.87:0/94737021 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f74f8020070 con 0x55e3f6ff3b70 2024-09-13T17:14:28.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.123+0000 7f74eeffd640 1 -- 172.21.15.87:0/94737021 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f8011bf0 con 0x55e3f6ff3b70 2024-09-13T17:14:28.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.123+0000 7f751144d740 1 -- 172.21.15.87:0/94737021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3f6ff3b70 msgr2=0x55e3f6fef6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:28.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.123+0000 7f751144d740 1 --2- 172.21.15.87:0/94737021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3f6ff3b70 0x55e3f6fef6a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f74f800bfb0 tx=0x7f74f80138f0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.124+0000 7f751144d740 1 -- 172.21.15.87:0/94737021 shutdown_connections 2024-09-13T17:14:28.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.124+0000 7f751144d740 1 --2- 172.21.15.87:0/94737021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e3f7006ff0 0x55e3f6ff00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.124+0000 7f751144d740 1 --2- 172.21.15.87:0/94737021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e3f6ff4d20 0x55e3f70083e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.124+0000 7f751144d740 1 --2- 172.21.15.87:0/94737021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3f6ff3b70 0x55e3f6fef6a0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.124+0000 7f751144d740 1 -- 172.21.15.87:0/94737021 >> 172.21.15.87:0/94737021 conn(0x55e3f6fefd00 msgr2=0x55e3f701d050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:28.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.124+0000 7f751144d740 1 -- 172.21.15.87:0/94737021 shutdown_connections 2024-09-13T17:14:28.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.124+0000 7f751144d740 1 -- 172.21.15.87:0/94737021 wait complete. 2024-09-13T17:14:28.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.124+0000 7f751144d740 1 -- start start 2024-09-13T17:14:28.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.124+0000 7f751144d740 1 Processor -- start 2024-09-13T17:14:28.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.124+0000 7f751144d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e3f6ff3b70 0x55e3f700a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.124+0000 7f751144d740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e3f6ff4d20 0x55e3f700ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.124+0000 7f751144d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3f7006ff0 0x55e3f700b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.125+0000 7f751144d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f706c990 con 0x55e3f7006ff0 2024-09-13T17:14:28.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.125+0000 7f751144d740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f706cb00 con 0x55e3f6ff4d20 2024-09-13T17:14:28.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.125+0000 7f751144d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f706ccc0 con 0x55e3f6ff3b70 2024-09-13T17:14:28.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.125+0000 7f751144d740 10 client.0 _ll_register_callbacks cb 0x7f74fc0f15d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:14:28.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.125+0000 7f7507fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e3f6ff3b70 0x55e3f700a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.125+0000 7f75077fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e3f6ff4d20 0x55e3f700ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.125+0000 7f7507fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e3f6ff3b70 0x55e3f700a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:51202/0 (socket says 172.21.15.87:51202) 2024-09-13T17:14:28.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.125+0000 7f7507fff640 1 -- 172.21.15.87:0/352023089 learned_addr learned my addr 172.21.15.87:0/352023089 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:28.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.125+0000 7f750ccc2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3f7006ff0 0x55e3f700b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.125+0000 7f750ccc2640 1 -- 172.21.15.87:0/352023089 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e3f6ff3b70 msgr2=0x55e3f700a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:28.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.125+0000 7f750ccc2640 1 --2- 172.21.15.87:0/352023089 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e3f6ff3b70 0x55e3f700a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.125+0000 7f750ccc2640 1 -- 172.21.15.87:0/352023089 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e3f6ff4d20 msgr2=0x55e3f700ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:28.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.125+0000 7f750ccc2640 1 --2- 172.21.15.87:0/352023089 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e3f6ff4d20 0x55e3f700ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.125+0000 7f750ccc2640 1 -- 172.21.15.87:0/352023089 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e3f6ef7770 con 0x55e3f7006ff0 2024-09-13T17:14:28.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.125+0000 7f7507fff640 1 --2- 172.21.15.87:0/352023089 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e3f6ff3b70 0x55e3f700a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:14:28.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.125+0000 7f75077fe640 1 --2- 172.21.15.87:0/352023089 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e3f6ff4d20 0x55e3f700ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:14:28.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.125+0000 7f750ccc2640 1 --2- 172.21.15.87:0/352023089 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3f7006ff0 0x55e3f700b3a0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f750000ae30 tx=0x7f7500004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee6165f6bf619ec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:28.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.125+0000 7f74e77fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:14:28.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.125+0000 7f74e77fe640 1 -- 172.21.15.87:0/352023089 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7500024640 con 0x55e3f7006ff0 2024-09-13T17:14:28.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.125+0000 7f751144d740 1 -- 172.21.15.87:0/352023089 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f74fc0baa70 con 0x55e3f7006ff0 2024-09-13T17:14:28.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.125+0000 7f74e77fe640 1 -- 172.21.15.87:0/352023089 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f75000233e0 con 0x55e3f7006ff0 2024-09-13T17:14:28.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.126+0000 7f74e77fe640 1 -- 172.21.15.87:0/352023089 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75000247a0 con 0x55e3f7006ff0 2024-09-13T17:14:28.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.126+0000 7f751144d740 10 client.15873 fetch_fsmap learned FSMap version 24 2024-09-13T17:14:28.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.126+0000 7f751144d740 1 -- 172.21.15.87:0/352023089 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55e3f6f1ce80 con 0x55e3f7006ff0 2024-09-13T17:14:28.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.126+0000 7f74e77fe640 1 -- 172.21.15.87:0/352023089 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f74fc0baa70 con 0x55e3f7006ff0 2024-09-13T17:14:28.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.126+0000 7f74e77fe640 1 -- 172.21.15.87:0/352023089 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f7500008040 con 0x55e3f7006ff0 2024-09-13T17:14:28.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.126+0000 7f751144d740 10 client.15873 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:14:28.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.126+0000 7f751144d740 10 client.15873 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:14:28.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.126+0000 7f751144d740 20 client.15873 populate_metadata read hostname 'smithi087' 2024-09-13T17:14:28.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.126+0000 7f751144d740 1 --2- 172.21.15.87:0/352023089 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55e3f7016330 0x55e3f70705a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.126+0000 7f751144d740 4 client.15873 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:14:28.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.126+0000 7f751144d740 1 -- 172.21.15.87:0/352023089 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e3f6c4a4e0 con 0x55e3f7016330 2024-09-13T17:14:28.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.126+0000 7f7507fff640 1 --2- 172.21.15.87:0/352023089 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55e3f7016330 0x55e3f70705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.127+0000 7f74e77fe640 10 client.15873 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:14:28.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.127+0000 7f7507fff640 1 --2- 172.21.15.87:0/352023089 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55e3f7016330 0x55e3f70705a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f03b6f2bdb14aa6 server_cookie=d910bc564f3a23a6 in_seq=0 out_seq=0 2024-09-13T17:14:28.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.127+0000 7f74e77fe640 1 -- 172.21.15.87:0/352023089 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e3f6c4a4e0 con 0x55e3f7016330 2024-09-13T17:14:28.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.127+0000 7f74e77fe640 10 client.15873 handle_command_reply: tid=0 2024-09-13T17:14:28.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.127+0000 7f751144d740 1 client.15873 shutdown 2024-09-13T17:14:28.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.127+0000 7f751144d740 1 -- 172.21.15.87:0/352023089 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3f7006ff0 msgr2=0x55e3f700b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:28.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.127+0000 7f751144d740 1 --2- 172.21.15.87:0/352023089 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3f7006ff0 0x55e3f700b3a0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f750000ae30 tx=0x7f7500004b50 comp rx=0 tx=0).stop 2024-09-13T17:14:28.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.127+0000 7f751144d740 1 -- 172.21.15.87:0/352023089 shutdown_connections 2024-09-13T17:14:28.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.127+0000 7f751144d740 1 --2- 172.21.15.87:0/352023089 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55e3f7016330 0x55e3f70705a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.127+0000 7f751144d740 1 --2- 172.21.15.87:0/352023089 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3f7006ff0 0x55e3f700b3a0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.127+0000 7f751144d740 1 --2- 172.21.15.87:0/352023089 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e3f6ff4d20 0x55e3f700ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.127+0000 7f751144d740 1 --2- 172.21.15.87:0/352023089 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e3f6ff3b70 0x55e3f700a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.127+0000 7f751144d740 1 -- 172.21.15.87:0/352023089 >> 172.21.15.87:0/352023089 conn(0x55e3f6fefd00 msgr2=0x55e3f7005fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:28.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.127+0000 7f74e77fe640 0 client.15873 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:14:28.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.128+0000 7f751144d740 1 -- 172.21.15.87:0/352023089 shutdown_connections 2024-09-13T17:14:28.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.128+0000 7f751144d740 1 -- 172.21.15.87:0/352023089 wait complete. 2024-09-13T17:14:28.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.128+0000 7f751144d740 20 client.15873 trim_cache size 0 max 16384 2024-09-13T17:14:28.135 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:14:28.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.128+0000 7f750e725640 1 -- 172.21.15.87:0/1232853206 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f74f00a1320 msgr2=0x7f74f00a37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:28.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.128+0000 7f750e725640 1 --2- 172.21.15.87:0/1232853206 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f74f00a1320 0x7f74f00a37e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f750000a5a0 tx=0x7f750000c040 comp rx=0 tx=0).stop 2024-09-13T17:14:28.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.128+0000 7f750e725640 1 -- 172.21.15.87:0/1232853206 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7508103fb0 msgr2=0x7f75081976d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:28.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.128+0000 7f750e725640 1 --2- 172.21.15.87:0/1232853206 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7508103fb0 0x7f75081976d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f74fc009900 tx=0x7f74fc0042f0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.128+0000 7f750e725640 1 -- 172.21.15.87:0/1232853206 shutdown_connections 2024-09-13T17:14:28.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.128+0000 7f750e725640 1 --2- 172.21.15.87:0/1232853206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7508197c10 0x7f75081a2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.128+0000 7f750e725640 1 --2- 172.21.15.87:0/1232853206 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f74f00a1320 0x7f74f00a37e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.128+0000 7f750e725640 1 --2- 172.21.15.87:0/1232853206 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7508103fb0 0x7f75081976d0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.128+0000 7f750e725640 1 --2- 172.21.15.87:0/1232853206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75080fee60 0x7f7508197190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.128+0000 7f750e725640 1 -- 172.21.15.87:0/1232853206 >> 172.21.15.87:0/1232853206 conn(0x7f7508075c60 msgr2=0x7f7508102280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:28.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.128+0000 7f750e725640 1 -- 172.21.15.87:0/1232853206 shutdown_connections 2024-09-13T17:14:28.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.128+0000 7f750e725640 1 -- 172.21.15.87:0/1232853206 wait complete. 2024-09-13T17:14:28.143 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-09-13T17:14:28.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.272+0000 7f057ddaa640 1 -- 172.21.15.87:0/3933478993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05781050c0 msgr2=0x7f057810cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:28.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.272+0000 7f057ddaa640 1 --2- 172.21.15.87:0/3933478993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05781050c0 0x7f057810cc10 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0570009cd0 tx=0x7f057002a8e0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.273+0000 7f057ddaa640 1 -- 172.21.15.87:0/3933478993 shutdown_connections 2024-09-13T17:14:28.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.273+0000 7f057ddaa640 1 --2- 172.21.15.87:0/3933478993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05781050c0 0x7f057810cc10 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.273+0000 7f057ddaa640 1 --2- 172.21.15.87:0/3933478993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0578100920 0x7f0578104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.273+0000 7f057ddaa640 1 --2- 172.21.15.87:0/3933478993 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05780fff70 0x7f0578100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.273+0000 7f057ddaa640 1 -- 172.21.15.87:0/3933478993 >> 172.21.15.87:0/3933478993 conn(0x7f05780fb9c0 msgr2=0x7f05780fdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:28.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.273+0000 7f057ddaa640 1 -- 172.21.15.87:0/3933478993 shutdown_connections 2024-09-13T17:14:28.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.273+0000 7f057ddaa640 1 -- 172.21.15.87:0/3933478993 wait complete. 2024-09-13T17:14:28.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.273+0000 7f057ddaa640 1 Processor -- start 2024-09-13T17:14:28.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.273+0000 7f057ddaa640 1 -- start start 2024-09-13T17:14:28.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.274+0000 7f057ddaa640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05780fff70 0x7f0578194050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.274+0000 7f057ddaa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05781050c0 0x7f0578194590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.274+0000 7f057ddaa640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0578198980 0x7f0578198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.274+0000 7f057ddaa640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0578199370 con 0x7f05781050c0 2024-09-13T17:14:28.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.274+0000 7f0576ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05781050c0 0x7f0578194590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.274+0000 7f057ddaa640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05781994e0 con 0x7f0578198980 2024-09-13T17:14:28.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.274+0000 7f057ddaa640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0578199650 con 0x7f05780fff70 2024-09-13T17:14:28.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.274+0000 7f0576ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05781050c0 0x7f0578194590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47546/0 (socket says 172.21.15.87:47546) 2024-09-13T17:14:28.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.274+0000 7f0576ffd640 1 -- 172.21.15.87:0/3931481121 learned_addr learned my addr 172.21.15.87:0/3931481121 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:28.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.274+0000 7f05777fe640 1 --2- 172.21.15.87:0/3931481121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05780fff70 0x7f0578194050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.274+0000 7f0576ffd640 1 -- 172.21.15.87:0/3931481121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05780fff70 msgr2=0x7f0578194050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:28.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.274+0000 7f0576ffd640 1 --2- 172.21.15.87:0/3931481121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05780fff70 0x7f0578194050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.274+0000 7f0577fff640 1 --2- 172.21.15.87:0/3931481121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0578198980 0x7f0578198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.274+0000 7f0576ffd640 1 -- 172.21.15.87:0/3931481121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0578198980 msgr2=0x7f0578198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:28.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.274+0000 7f0576ffd640 1 --2- 172.21.15.87:0/3931481121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0578198980 0x7f0578198e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.274+0000 7f0576ffd640 1 -- 172.21.15.87:0/3931481121 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0570009900 con 0x7f05781050c0 2024-09-13T17:14:28.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.274+0000 7f0576ffd640 1 --2- 172.21.15.87:0/3931481121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05781050c0 0x7f0578194590 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f056c009c10 tx=0x7f056c007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:28.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.274+0000 7f0574ff9640 1 -- 172.21.15.87:0/3931481121 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c00f9e0 con 0x7f05781050c0 2024-09-13T17:14:28.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.274+0000 7f0574ff9640 1 -- 172.21.15.87:0/3931481121 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f056c015040 con 0x7f05781050c0 2024-09-13T17:14:28.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.274+0000 7f057ddaa640 1 -- 172.21.15.87:0/3931481121 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05781a0c30 con 0x7f05781050c0 2024-09-13T17:14:28.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.275+0000 7f0574ff9640 1 -- 172.21.15.87:0/3931481121 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c0186c0 con 0x7f05781050c0 2024-09-13T17:14:28.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.275+0000 7f057ddaa640 1 -- 172.21.15.87:0/3931481121 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05781a1130 con 0x7f05781050c0 2024-09-13T17:14:28.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.277+0000 7f0574ff9640 1 -- 172.21.15.87:0/3931481121 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 25) v1 ==== 136106+0+0 (secure 0 0 0) 0x7f056c0195f0 con 0x7f05781050c0 2024-09-13T17:14:28.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.278+0000 7f0580acc740 1 Processor -- start 2024-09-13T17:14:28.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.278+0000 7f0580acc740 1 -- start start 2024-09-13T17:14:28.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.278+0000 7f0574ff9640 1 --2- 172.21.15.87:0/3931481121 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f05600a13a0 0x7f05600a3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.278+0000 7f0580acc740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d684015790 0x55d684015b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.278+0000 7f0577fff640 1 --2- 172.21.15.87:0/3931481121 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f05600a13a0 0x7f05600a3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.278+0000 7f0574ff9640 1 -- 172.21.15.87:0/3931481121 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f056c0d1480 con 0x7f05781050c0 2024-09-13T17:14:28.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.278+0000 7f0580acc740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6840160b0 0x55d684020410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.278+0000 7f05777fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d684015790 0x55d684015b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.278+0000 7f05777fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d684015790 0x55d684015b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47548/0 (socket says 172.21.15.87:47548) 2024-09-13T17:14:28.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.278+0000 7f0580acc740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d684020950 0x55d684022d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.278+0000 7f0580acc740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d683f7fcc0 con 0x55d684015790 2024-09-13T17:14:28.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.278+0000 7f0580acc740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d683f7d450 con 0x55d684020950 2024-09-13T17:14:28.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.278+0000 7f0580acc740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d683f78d40 con 0x55d6840160b0 2024-09-13T17:14:28.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.278+0000 7f05777fe640 1 -- 172.21.15.87:0/2611657292 learned_addr learned my addr 172.21.15.87:0/2611657292 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:28.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.279+0000 7f0576ffd640 1 --2- 172.21.15.87:0/2611657292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6840160b0 0x55d684020410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.279+0000 7f0576ffd640 1 -- 172.21.15.87:0/2611657292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d684020950 msgr2=0x55d684022d40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T17:14:28.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.279+0000 7f0576ffd640 1 --2- 172.21.15.87:0/2611657292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d684020950 0x55d684022d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.279+0000 7f0576ffd640 1 -- 172.21.15.87:0/2611657292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d684015790 msgr2=0x55d684015b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:28.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.279+0000 7f0576ffd640 1 --2- 172.21.15.87:0/2611657292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d684015790 0x55d684015b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.279+0000 7f0576ffd640 1 -- 172.21.15.87:0/2611657292 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d683f40620 con 0x55d6840160b0 2024-09-13T17:14:28.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.279+0000 7f0577fff640 1 --2- 172.21.15.87:0/3931481121 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f05600a13a0 0x7f05600a3860 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0570006010 tx=0x7f05700093f0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:28.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.279+0000 7f05777fe640 1 --2- 172.21.15.87:0/2611657292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d684015790 0x55d684015b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:14:28.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.279+0000 7f0576ffd640 1 --2- 172.21.15.87:0/2611657292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6840160b0 0x55d684020410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f056c0ce6a0 tx=0x7f056c009e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b953ccc67405902b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:28.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.279+0000 7f055dffb640 1 -- 172.21.15.87:0/2611657292 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c0198a0 con 0x55d6840160b0 2024-09-13T17:14:28.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.279+0000 7f055dffb640 1 -- 172.21.15.87:0/2611657292 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f056c016250 con 0x55d6840160b0 2024-09-13T17:14:28.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.279+0000 7f055dffb640 1 -- 172.21.15.87:0/2611657292 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c09a6a0 con 0x55d6840160b0 2024-09-13T17:14:28.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.280+0000 7f0580acc740 1 -- 172.21.15.87:0/2611657292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6840160b0 msgr2=0x55d684020410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:28.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.280+0000 7f0580acc740 1 --2- 172.21.15.87:0/2611657292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6840160b0 0x55d684020410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f056c0ce6a0 tx=0x7f056c009e20 comp rx=0 tx=0).stop 2024-09-13T17:14:28.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.281+0000 7f0580acc740 1 -- 172.21.15.87:0/2611657292 shutdown_connections 2024-09-13T17:14:28.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.281+0000 7f0580acc740 1 --2- 172.21.15.87:0/2611657292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d684020950 0x55d684022d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.281+0000 7f0580acc740 1 --2- 172.21.15.87:0/2611657292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6840160b0 0x55d684020410 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.281+0000 7f0580acc740 1 --2- 172.21.15.87:0/2611657292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d684015790 0x55d684015b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.281+0000 7f0580acc740 1 -- 172.21.15.87:0/2611657292 >> 172.21.15.87:0/2611657292 conn(0x55d684011d00 msgr2=0x55d6840120e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:28.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.282+0000 7f0580acc740 1 -- 172.21.15.87:0/2611657292 shutdown_connections 2024-09-13T17:14:28.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.282+0000 7f0580acc740 1 -- 172.21.15.87:0/2611657292 wait complete. 2024-09-13T17:14:28.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.282+0000 7f0580acc740 1 -- start start 2024-09-13T17:14:28.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.282+0000 7f0580acc740 1 Processor -- start 2024-09-13T17:14:28.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.283+0000 7f0580acc740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d684015790 0x55d68401ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.283+0000 7f0580acc740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d6840160b0 0x55d68401d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.283+0000 7f0580acc740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d684020950 0x55d68401d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.283+0000 7f0580acc740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d683f37180 con 0x55d684015790 2024-09-13T17:14:28.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.283+0000 7f05777fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d684015790 0x55d68401ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.283+0000 7f05777fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d684015790 0x55d68401ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47550/0 (socket says 172.21.15.87:47550) 2024-09-13T17:14:28.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.283+0000 7f0580acc740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d683c51430 con 0x55d6840160b0 2024-09-13T17:14:28.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.283+0000 7f05777fe640 1 -- 172.21.15.87:0/586283300 learned_addr learned my addr 172.21.15.87:0/586283300 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:28.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.283+0000 7f0580acc740 1 -- 172.21.15.87:0/586283300 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d683efc5e0 con 0x55d684020950 2024-09-13T17:14:28.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.283+0000 7f0580acc740 10 client.0 _ll_register_callbacks cb 0x55d683f68aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:14:28.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.283+0000 7f0576ffd640 1 --2- 172.21.15.87:0/586283300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d6840160b0 0x55d68401d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.283+0000 7f0577fff640 1 --2- 172.21.15.87:0/586283300 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d684020950 0x55d68401d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.283+0000 7f05777fe640 1 -- 172.21.15.87:0/586283300 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d684020950 msgr2=0x55d68401d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:28.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.284+0000 7f05777fe640 1 --2- 172.21.15.87:0/586283300 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d684020950 0x55d68401d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.284+0000 7f05777fe640 1 -- 172.21.15.87:0/586283300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d6840160b0 msgr2=0x55d68401d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:28.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.284+0000 7f05777fe640 1 --2- 172.21.15.87:0/586283300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d6840160b0 0x55d68401d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.284+0000 7f05777fe640 1 -- 172.21.15.87:0/586283300 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05781a1130 con 0x55d684015790 2024-09-13T17:14:28.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.284+0000 7f05777fe640 1 --2- 172.21.15.87:0/586283300 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d684015790 0x55d68401ffa0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f05680124a0 tx=0x7f0568012960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6511281f7e7f6785 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:28.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.284+0000 7f0556ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:14:28.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.284+0000 7f0556ffd640 1 -- 172.21.15.87:0/586283300 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0568010920 con 0x55d684015790 2024-09-13T17:14:28.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.284+0000 7f0556ffd640 1 -- 172.21.15.87:0/586283300 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f0568010a80 con 0x55d684015790 2024-09-13T17:14:28.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.284+0000 7f0580acc740 1 -- 172.21.15.87:0/586283300 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d683fa2b80 con 0x55d684015790 2024-09-13T17:14:28.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.284+0000 7f0556ffd640 1 -- 172.21.15.87:0/586283300 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0568010c40 con 0x55d684015790 2024-09-13T17:14:28.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.284+0000 7f0580acc740 10 client.15885 fetch_fsmap learned FSMap version 24 2024-09-13T17:14:28.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.284+0000 7f0580acc740 1 -- 172.21.15.87:0/586283300 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55d683f773c0 con 0x55d684015790 2024-09-13T17:14:28.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.284+0000 7f0556ffd640 1 -- 172.21.15.87:0/586283300 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55d683fa2b80 con 0x55d684015790 2024-09-13T17:14:28.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.285+0000 7f0556ffd640 1 -- 172.21.15.87:0/586283300 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f056800e350 con 0x55d684015790 2024-09-13T17:14:28.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.285+0000 7f0580acc740 10 client.15885 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:14:28.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.285+0000 7f0580acc740 10 client.15885 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:14:28.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.285+0000 7f0580acc740 20 client.15885 populate_metadata read hostname 'smithi087' 2024-09-13T17:14:28.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.285+0000 7f0580acc740 1 --2- 172.21.15.87:0/586283300 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55d684030350 0x55d684032740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.285+0000 7f0580acc740 4 client.15885 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:14:28.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.285+0000 7f0580acc740 1 -- 172.21.15.87:0/586283300 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d683f6b1f0 con 0x55d684030350 2024-09-13T17:14:28.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.285+0000 7f0576ffd640 1 --2- 172.21.15.87:0/586283300 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55d684030350 0x55d684032740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.286+0000 7f0556ffd640 10 client.15885 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:28.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.286+0000 7f0576ffd640 1 --2- 172.21.15.87:0/586283300 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55d684030350 0x55d684032740 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=866aef4c935fa709 server_cookie=f25c2685b65d3dd3 in_seq=0 out_seq=0 2024-09-13T17:14:28.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.286+0000 7f0556ffd640 1 -- 172.21.15.87:0/586283300 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55d683f6b1f0 con 0x55d684030350 2024-09-13T17:14:28.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.286+0000 7f0556ffd640 10 client.15885 handle_command_reply: tid=0 2024-09-13T17:14:28.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.286+0000 7f0580acc740 1 client.15885 shutdown 2024-09-13T17:14:28.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.287+0000 7f0580acc740 1 -- 172.21.15.87:0/586283300 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d684015790 msgr2=0x55d68401ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:28.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.287+0000 7f0580acc740 1 --2- 172.21.15.87:0/586283300 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d684015790 0x55d68401ffa0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f05680124a0 tx=0x7f0568012960 comp rx=0 tx=0).stop 2024-09-13T17:14:28.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.287+0000 7f0580acc740 1 -- 172.21.15.87:0/586283300 shutdown_connections 2024-09-13T17:14:28.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.287+0000 7f0580acc740 1 --2- 172.21.15.87:0/586283300 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55d684030350 0x55d684032740 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.287+0000 7f0580acc740 1 --2- 172.21.15.87:0/586283300 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d684020950 0x55d68401d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.287+0000 7f0556ffd640 0 client.15885 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:28.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.287+0000 7f0580acc740 1 --2- 172.21.15.87:0/586283300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d6840160b0 0x55d68401d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.287+0000 7f0580acc740 1 --2- 172.21.15.87:0/586283300 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d684015790 0x55d68401ffa0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.287+0000 7f0580acc740 1 -- 172.21.15.87:0/586283300 >> 172.21.15.87:0/586283300 conn(0x55d684011d00 msgr2=0x55d684017a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:28.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.287+0000 7f0580acc740 1 -- 172.21.15.87:0/586283300 shutdown_connections 2024-09-13T17:14:28.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.287+0000 7f0580acc740 1 -- 172.21.15.87:0/586283300 wait complete. 2024-09-13T17:14:28.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.287+0000 7f0580acc740 20 client.15885 trim_cache size 0 max 16384 2024-09-13T17:14:28.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.298+0000 7f0580acc740 1 Processor -- start 2024-09-13T17:14:28.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.298+0000 7f0580acc740 1 -- start start 2024-09-13T17:14:28.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.298+0000 7f0580acc740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d684015790 0x55d68402c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.298+0000 7f0580acc740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d6840160b0 0x55d68402c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.298+0000 7f0580acc740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d684020950 0x55d68401d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.298+0000 7f0580acc740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d68401e360 con 0x55d684015790 2024-09-13T17:14:28.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.298+0000 7f0580acc740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d684030130 con 0x55d6840160b0 2024-09-13T17:14:28.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.298+0000 7f0580acc740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6840129f0 con 0x55d684020950 2024-09-13T17:14:28.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.298+0000 7f05777fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d684015790 0x55d68402c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.298+0000 7f05777fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d684015790 0x55d68402c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47562/0 (socket says 172.21.15.87:47562) 2024-09-13T17:14:28.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.298+0000 7f05777fe640 1 -- 172.21.15.87:0/462982046 learned_addr learned my addr 172.21.15.87:0/462982046 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:28.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.298+0000 7f0577fff640 1 --2- 172.21.15.87:0/462982046 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d684020950 0x55d68401d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.298+0000 7f0576ffd640 1 --2- 172.21.15.87:0/462982046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d6840160b0 0x55d68402c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.299+0000 7f05777fe640 1 -- 172.21.15.87:0/462982046 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d684020950 msgr2=0x55d68401d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:28.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.299+0000 7f05777fe640 1 --2- 172.21.15.87:0/462982046 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d684020950 0x55d68401d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.299+0000 7f05777fe640 1 -- 172.21.15.87:0/462982046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d6840160b0 msgr2=0x55d68402c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:28.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.299+0000 7f05777fe640 1 --2- 172.21.15.87:0/462982046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d6840160b0 0x55d68402c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.299+0000 7f05777fe640 1 -- 172.21.15.87:0/462982046 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d683f19770 con 0x55d684015790 2024-09-13T17:14:28.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.299+0000 7f0576ffd640 1 --2- 172.21.15.87:0/462982046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d6840160b0 0x55d68402c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:28.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.299+0000 7f05777fe640 1 --2- 172.21.15.87:0/462982046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d684015790 0x55d68402c070 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f056800d7f0 tx=0x7f056800d820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108178e40649f07d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:28.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.299+0000 7f055e7fc640 1 -- 172.21.15.87:0/462982046 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056800e350 con 0x55d684015790 2024-09-13T17:14:28.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.299+0000 7f055e7fc640 1 -- 172.21.15.87:0/462982046 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f05680044e0 con 0x55d684015790 2024-09-13T17:14:28.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.299+0000 7f055e7fc640 1 -- 172.21.15.87:0/462982046 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05680052a0 con 0x55d684015790 2024-09-13T17:14:28.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.299+0000 7f0580acc740 1 -- 172.21.15.87:0/462982046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d684015790 msgr2=0x55d68402c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:28.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.299+0000 7f0580acc740 1 --2- 172.21.15.87:0/462982046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d684015790 0x55d68402c070 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f056800d7f0 tx=0x7f056800d820 comp rx=0 tx=0).stop 2024-09-13T17:14:28.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.300+0000 7f0580acc740 1 -- 172.21.15.87:0/462982046 shutdown_connections 2024-09-13T17:14:28.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.300+0000 7f0580acc740 1 --2- 172.21.15.87:0/462982046 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d684020950 0x55d68401d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.300+0000 7f0580acc740 1 --2- 172.21.15.87:0/462982046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d6840160b0 0x55d68402c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.300+0000 7f0580acc740 1 --2- 172.21.15.87:0/462982046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d684015790 0x55d68402c070 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.300+0000 7f0580acc740 1 -- 172.21.15.87:0/462982046 >> 172.21.15.87:0/462982046 conn(0x55d684011d00 msgr2=0x55d6840370a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:28.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.300+0000 7f0580acc740 1 -- 172.21.15.87:0/462982046 shutdown_connections 2024-09-13T17:14:28.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.300+0000 7f0580acc740 1 -- 172.21.15.87:0/462982046 wait complete. 2024-09-13T17:14:28.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.300+0000 7f0580acc740 1 -- start start 2024-09-13T17:14:28.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.300+0000 7f0580acc740 1 Processor -- start 2024-09-13T17:14:28.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.300+0000 7f0580acc740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d684015790 0x55d6840275c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.300+0000 7f0580acc740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6840160b0 0x55d684027b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.300+0000 7f0580acc740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d684020950 0x55d684023dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.300+0000 7f0580acc740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6840244c0 con 0x55d684020950 2024-09-13T17:14:28.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.300+0000 7f0580acc740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d684024630 con 0x55d684015790 2024-09-13T17:14:28.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.300+0000 7f0580acc740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6840247f0 con 0x55d6840160b0 2024-09-13T17:14:28.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.301+0000 7f0576ffd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6840160b0 0x55d684027b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.301+0000 7f0580acc740 10 client.0 _ll_register_callbacks cb 0x7f056c007e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:14:28.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.301+0000 7f0576ffd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6840160b0 0x55d684027b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:51260/0 (socket says 172.21.15.87:51260) 2024-09-13T17:14:28.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.301+0000 7f0576ffd640 1 -- 172.21.15.87:0/559030980 learned_addr learned my addr 172.21.15.87:0/559030980 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:28.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.301+0000 7f0577fff640 1 --2- 172.21.15.87:0/559030980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d684020950 0x55d684023dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.301+0000 7f05777fe640 1 --2- 172.21.15.87:0/559030980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d684015790 0x55d6840275c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.301+0000 7f0576ffd640 1 -- 172.21.15.87:0/559030980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d684015790 msgr2=0x55d6840275c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:28.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.301+0000 7f0576ffd640 1 --2- 172.21.15.87:0/559030980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d684015790 0x55d6840275c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.301+0000 7f0576ffd640 1 -- 172.21.15.87:0/559030980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d684020950 msgr2=0x55d684023dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:28.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.301+0000 7f0576ffd640 1 --2- 172.21.15.87:0/559030980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d684020950 0x55d684023dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.301+0000 7f0576ffd640 1 -- 172.21.15.87:0/559030980 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0568013e70 con 0x55d6840160b0 2024-09-13T17:14:28.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.301+0000 7f0576ffd640 1 --2- 172.21.15.87:0/559030980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6840160b0 0x55d684027b00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f056c0ce5e0 tx=0x7f056c0a6410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca3ad9c6927935b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:28.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.301+0000 7f0556ffd640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-09-13T17:14:28.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.301+0000 7f0556ffd640 1 -- 172.21.15.87:0/559030980 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c09dad0 con 0x55d6840160b0 2024-09-13T17:14:28.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.301+0000 7f0580acc740 1 -- 172.21.15.87:0/559030980 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d683c6c4e0 con 0x55d6840160b0 2024-09-13T17:14:28.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.301+0000 7f0556ffd640 1 -- 172.21.15.87:0/559030980 <== mon.1 v2:172.21.15.149:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f056c09df90 con 0x55d6840160b0 2024-09-13T17:14:28.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.301+0000 7f0556ffd640 1 -- 172.21.15.87:0/559030980 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f056c0a1dc0 con 0x55d6840160b0 2024-09-13T17:14:28.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.302+0000 7f0580acc740 10 client.25342 fetch_fsmap learned FSMap version 24 2024-09-13T17:14:28.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.302+0000 7f0580acc740 1 -- 172.21.15.87:0/559030980 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55d683f3ee80 con 0x55d6840160b0 2024-09-13T17:14:28.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.302+0000 7f0556ffd640 1 -- 172.21.15.87:0/559030980 <== mon.1 v2:172.21.15.149:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55d683c6c4e0 con 0x55d6840160b0 2024-09-13T17:14:28.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.302+0000 7f0556ffd640 1 -- 172.21.15.87:0/559030980 <== mon.1 v2:172.21.15.149:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f056c018070 con 0x55d6840160b0 2024-09-13T17:14:28.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.302+0000 7f0580acc740 10 client.25342 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:14:28.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.302+0000 7f0580acc740 10 client.25342 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:14:28.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.302+0000 7f0580acc740 20 client.25342 populate_metadata read hostname 'smithi087' 2024-09-13T17:14:28.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.302+0000 7f0580acc740 1 --2- 172.21.15.87:0/559030980 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55d684030350 0x55d6840899f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:28.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.302+0000 7f0580acc740 4 client.25342 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:14:28.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.302+0000 7f0580acc740 1 -- 172.21.15.87:0/559030980 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d683c7d7e0 con 0x55d684030350 2024-09-13T17:14:28.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.302+0000 7f05777fe640 1 --2- 172.21.15.87:0/559030980 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55d684030350 0x55d6840899f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:28.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.303+0000 7f05777fe640 1 --2- 172.21.15.87:0/559030980 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55d684030350 0x55d6840899f0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4db26cfa4358c48f server_cookie=7e7ff3be8ab8fc37 in_seq=0 out_seq=0 2024-09-13T17:14:28.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.303+0000 7f0556ffd640 10 client.25342 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:28.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.303+0000 7f0556ffd640 1 -- 172.21.15.87:0/559030980 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d683c7d7e0 con 0x55d684030350 2024-09-13T17:14:28.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.303+0000 7f0556ffd640 10 client.25342 handle_command_reply: tid=0 2024-09-13T17:14:28.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.303+0000 7f0580acc740 1 client.25342 shutdown 2024-09-13T17:14:28.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.303+0000 7f0580acc740 1 -- 172.21.15.87:0/559030980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6840160b0 msgr2=0x55d684027b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:28.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.303+0000 7f0580acc740 1 --2- 172.21.15.87:0/559030980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6840160b0 0x55d684027b00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f056c0ce5e0 tx=0x7f056c0a6410 comp rx=0 tx=0).stop 2024-09-13T17:14:28.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.303+0000 7f0580acc740 1 -- 172.21.15.87:0/559030980 shutdown_connections 2024-09-13T17:14:28.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.303+0000 7f0580acc740 1 --2- 172.21.15.87:0/559030980 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55d684030350 0x55d6840899f0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.303+0000 7f0580acc740 1 --2- 172.21.15.87:0/559030980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d684020950 0x55d684023dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.303+0000 7f0580acc740 1 --2- 172.21.15.87:0/559030980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6840160b0 0x55d684027b00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.303+0000 7f0556ffd640 0 client.25342 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:28.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.303+0000 7f0580acc740 1 --2- 172.21.15.87:0/559030980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d684015790 0x55d6840275c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.303+0000 7f0580acc740 1 -- 172.21.15.87:0/559030980 >> 172.21.15.87:0/559030980 conn(0x55d684011d00 msgr2=0x55d68401d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:28.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.303+0000 7f0580acc740 1 -- 172.21.15.87:0/559030980 shutdown_connections 2024-09-13T17:14:28.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.303+0000 7f0580acc740 1 -- 172.21.15.87:0/559030980 wait complete. 2024-09-13T17:14:28.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.303+0000 7f0580acc740 20 client.25342 trim_cache size 0 max 16384 2024-09-13T17:14:28.311 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:14:28.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.304+0000 7f057ddaa640 1 -- 172.21.15.87:0/3931481121 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f05600a13a0 msgr2=0x7f05600a3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:28.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.304+0000 7f057ddaa640 1 --2- 172.21.15.87:0/3931481121 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f05600a13a0 0x7f05600a3860 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0570006010 tx=0x7f05700093f0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.304+0000 7f057ddaa640 1 -- 172.21.15.87:0/3931481121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05781050c0 msgr2=0x7f0578194590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:28.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.304+0000 7f057ddaa640 1 --2- 172.21.15.87:0/3931481121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05781050c0 0x7f0578194590 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f056c009c10 tx=0x7f056c007590 comp rx=0 tx=0).stop 2024-09-13T17:14:28.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.304+0000 7f057ddaa640 1 -- 172.21.15.87:0/3931481121 shutdown_connections 2024-09-13T17:14:28.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.304+0000 7f057ddaa640 1 --2- 172.21.15.87:0/3931481121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0578198980 0x7f0578198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.304+0000 7f057ddaa640 1 --2- 172.21.15.87:0/3931481121 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f05600a13a0 0x7f05600a3860 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.304+0000 7f057ddaa640 1 --2- 172.21.15.87:0/3931481121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05781050c0 0x7f0578194590 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.304+0000 7f057ddaa640 1 --2- 172.21.15.87:0/3931481121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05780fff70 0x7f0578194050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:28.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.304+0000 7f057ddaa640 1 -- 172.21.15.87:0/3931481121 >> 172.21.15.87:0/3931481121 conn(0x7f05780fb9c0 msgr2=0x7f05780fcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:28.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.304+0000 7f057ddaa640 1 -- 172.21.15.87:0/3931481121 shutdown_connections 2024-09-13T17:14:28.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:28.304+0000 7f057ddaa640 1 -- 172.21.15.87:0/3931481121 wait complete. 2024-09-13T17:14:28.463 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:28 smithi087 ceph-mon[30934]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-13T17:14:28.463 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:28 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/4236508083' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:14:28.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:28 smithi149 ceph-mon[35496]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-13T17:14:28.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:28 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/4236508083' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:14:28.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:28 smithi118 ceph-mon[34374]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-13T17:14:28.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:28 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/4236508083' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:14:29.320 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-13T17:14:29.320 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-09-13T17:14:29.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.435+0000 7fe89829d640 1 -- 172.21.15.87:0/4256259950 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe89010a350 msgr2=0x7fe89010c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:29.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.435+0000 7fe89829d640 1 --2- 172.21.15.87:0/4256259950 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe89010a350 0x7fe89010c7a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe888009ca0 tx=0x7fe88802a950 comp rx=0 tx=0).stop 2024-09-13T17:14:29.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.436+0000 7fe89829d640 1 -- 172.21.15.87:0/4256259950 shutdown_connections 2024-09-13T17:14:29.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.436+0000 7fe89829d640 1 --2- 172.21.15.87:0/4256259950 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe89010a350 0x7fe89010c7a0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.436+0000 7fe89829d640 1 --2- 172.21.15.87:0/4256259950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8901018a0 0x7fe890109d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.436+0000 7fe89829d640 1 --2- 172.21.15.87:0/4256259950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe890100f80 0x7fe890101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.436+0000 7fe89829d640 1 -- 172.21.15.87:0/4256259950 >> 172.21.15.87:0/4256259950 conn(0x7fe890075c60 msgr2=0x7fe8900fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:29.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.436+0000 7fe89829d640 1 -- 172.21.15.87:0/4256259950 shutdown_connections 2024-09-13T17:14:29.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.436+0000 7fe89829d640 1 -- 172.21.15.87:0/4256259950 wait complete. 2024-09-13T17:14:29.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.436+0000 7fe89829d640 1 Processor -- start 2024-09-13T17:14:29.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.436+0000 7fe89829d640 1 -- start start 2024-09-13T17:14:29.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.437+0000 7fe89829d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe890100f80 0x7fe890196220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.437+0000 7fe89829d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8901018a0 0x7fe890196760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.437+0000 7fe89829d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe89010a350 0x7fe89019ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.437+0000 7fe89829d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89019b100 con 0x7fe8901018a0 2024-09-13T17:14:29.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.437+0000 7fe89829d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89019b270 con 0x7fe89010a350 2024-09-13T17:14:29.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.437+0000 7fe895838640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8901018a0 0x7fe890196760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.437+0000 7fe89829d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89019b430 con 0x7fe890100f80 2024-09-13T17:14:29.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.437+0000 7fe896039640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe890100f80 0x7fe890196220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.437+0000 7fe895838640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8901018a0 0x7fe890196760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47862/0 (socket says 172.21.15.87:47862) 2024-09-13T17:14:29.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.437+0000 7fe895838640 1 -- 172.21.15.87:0/3336990890 learned_addr learned my addr 172.21.15.87:0/3336990890 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:29.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.437+0000 7fe89683a640 1 --2- 172.21.15.87:0/3336990890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe89010a350 0x7fe89019ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.437+0000 7fe895838640 1 -- 172.21.15.87:0/3336990890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe890100f80 msgr2=0x7fe890196220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:29.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.437+0000 7fe895838640 1 --2- 172.21.15.87:0/3336990890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe890100f80 0x7fe890196220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.437+0000 7fe895838640 1 -- 172.21.15.87:0/3336990890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe89010a350 msgr2=0x7fe89019ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:29.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.437+0000 7fe895838640 1 --2- 172.21.15.87:0/3336990890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe89010a350 0x7fe89019ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.437+0000 7fe895838640 1 -- 172.21.15.87:0/3336990890 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe888009900 con 0x7fe8901018a0 2024-09-13T17:14:29.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.437+0000 7fe895838640 1 --2- 172.21.15.87:0/3336990890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8901018a0 0x7fe890196760 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fe88000d950 tx=0x7fe88000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:29.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.438+0000 7fe8877fe640 1 -- 172.21.15.87:0/3336990890 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe880009a30 con 0x7fe8901018a0 2024-09-13T17:14:29.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.438+0000 7fe89829d640 1 -- 172.21.15.87:0/3336990890 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe89019b710 con 0x7fe8901018a0 2024-09-13T17:14:29.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.438+0000 7fe89829d640 1 -- 172.21.15.87:0/3336990890 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8900fece0 con 0x7fe8901018a0 2024-09-13T17:14:29.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.438+0000 7fe8877fe640 1 -- 172.21.15.87:0/3336990890 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe8800044d0 con 0x7fe8901018a0 2024-09-13T17:14:29.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.438+0000 7fe8877fe640 1 -- 172.21.15.87:0/3336990890 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8800047a0 con 0x7fe8901018a0 2024-09-13T17:14:29.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.440+0000 7fe8877fe640 1 -- 172.21.15.87:0/3336990890 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 25) v1 ==== 136106+0+0 (secure 0 0 0) 0x7fe880009b90 con 0x7fe8901018a0 2024-09-13T17:14:29.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.440+0000 7fe89afbf740 1 Processor -- start 2024-09-13T17:14:29.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.441+0000 7fe89afbf740 1 -- start start 2024-09-13T17:14:29.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.441+0000 7fe89afbf740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cc626d7c0 0x560cc626dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.441+0000 7fe89afbf740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560cc626e0e0 0x560cc6278440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.441+0000 7fe89afbf740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc6278980 0x560cc627ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.441+0000 7fe89afbf740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cc61d8c60 con 0x560cc6278980 2024-09-13T17:14:29.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.441+0000 7fe89afbf740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cc61d63f0 con 0x560cc626e0e0 2024-09-13T17:14:29.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.441+0000 7fe89afbf740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cc61d1ce0 con 0x560cc626d7c0 2024-09-13T17:14:29.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.441+0000 7fe8877fe640 1 --2- 172.21.15.87:0/3336990890 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe87c0a13a0 0x7fe87c0a3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.441+0000 7fe896039640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560cc626e0e0 0x560cc6278440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.441+0000 7fe896039640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560cc626e0e0 0x560cc6278440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.87:47740/0 (socket says 172.21.15.87:47740) 2024-09-13T17:14:29.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.441+0000 7fe896039640 1 -- 172.21.15.87:0/1843818082 learned_addr learned my addr 172.21.15.87:0/1843818082 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:29.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.441+0000 7fe895838640 1 --2- 172.21.15.87:0/1843818082 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc6278980 0x560cc627ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.441+0000 7fe89683a640 1 --2- 172.21.15.87:0/1843818082 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cc626d7c0 0x560cc626dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.441+0000 7fe89683a640 1 --2- 172.21.15.87:0/3336990890 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe87c0a13a0 0x7fe87c0a3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.441+0000 7fe8877fe640 1 -- 172.21.15.87:0/3336990890 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fe8800ccbb0 con 0x7fe8901018a0 2024-09-13T17:14:29.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.441+0000 7fe896039640 1 -- 172.21.15.87:0/1843818082 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cc626d7c0 msgr2=0x560cc626dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:29.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.441+0000 7fe896039640 1 --2- 172.21.15.87:0/1843818082 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cc626d7c0 0x560cc626dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.441+0000 7fe896039640 1 -- 172.21.15.87:0/1843818082 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc6278980 msgr2=0x560cc627ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:29.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.441+0000 7fe896039640 1 --2- 172.21.15.87:0/1843818082 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc6278980 0x560cc627ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.441+0000 7fe896039640 1 -- 172.21.15.87:0/1843818082 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560cc618d970 con 0x560cc626e0e0 2024-09-13T17:14:29.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.442+0000 7fe89683a640 1 --2- 172.21.15.87:0/1843818082 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cc626d7c0 0x560cc626dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:29.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.442+0000 7fe896039640 1 --2- 172.21.15.87:0/1843818082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560cc626e0e0 0x560cc6278440 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe88c010e90 tx=0x7fe88c005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5edcd7606e0e0b4c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:29.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.442+0000 7fe89683a640 1 --2- 172.21.15.87:0/3336990890 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe87c0a13a0 0x7fe87c0a3860 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe888009430 tx=0x7fe8880095c0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:29.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.442+0000 7fe884e05640 1 -- 172.21.15.87:0/1843818082 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c015050 con 0x560cc626e0e0 2024-09-13T17:14:29.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.442+0000 7fe884e05640 1 -- 172.21.15.87:0/1843818082 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe88c016040 con 0x560cc626e0e0 2024-09-13T17:14:29.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.442+0000 7fe884e05640 1 -- 172.21.15.87:0/1843818082 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c01a660 con 0x560cc626e0e0 2024-09-13T17:14:29.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.443+0000 7fe89afbf740 1 -- 172.21.15.87:0/1843818082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560cc626e0e0 msgr2=0x560cc6278440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:29.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.443+0000 7fe89afbf740 1 --2- 172.21.15.87:0/1843818082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560cc626e0e0 0x560cc6278440 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe88c010e90 tx=0x7fe88c005f90 comp rx=0 tx=0).stop 2024-09-13T17:14:29.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.443+0000 7fe89afbf740 1 -- 172.21.15.87:0/1843818082 shutdown_connections 2024-09-13T17:14:29.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.443+0000 7fe89afbf740 1 --2- 172.21.15.87:0/1843818082 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc6278980 0x560cc627ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.443+0000 7fe89afbf740 1 --2- 172.21.15.87:0/1843818082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560cc626e0e0 0x560cc6278440 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.443+0000 7fe89afbf740 1 --2- 172.21.15.87:0/1843818082 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cc626d7c0 0x560cc626dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.443+0000 7fe89afbf740 1 -- 172.21.15.87:0/1843818082 >> 172.21.15.87:0/1843818082 conn(0x560cc6269d50 msgr2=0x560cc626a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:29.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.443+0000 7fe89afbf740 1 -- 172.21.15.87:0/1843818082 shutdown_connections 2024-09-13T17:14:29.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.443+0000 7fe89afbf740 1 -- 172.21.15.87:0/1843818082 wait complete. 2024-09-13T17:14:29.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.443+0000 7fe89afbf740 1 -- start start 2024-09-13T17:14:29.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.443+0000 7fe89afbf740 1 Processor -- start 2024-09-13T17:14:29.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.443+0000 7fe89afbf740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc626d7c0 0x560cc6278380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.443+0000 7fe89afbf740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560cc626e0e0 0x560cc6275670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.443+0000 7fe89afbf740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cc6278980 0x560cc6275c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.443+0000 7fe89afbf740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cc618ff80 con 0x560cc626d7c0 2024-09-13T17:14:29.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.443+0000 7fe89afbf740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cc618fc20 con 0x560cc626e0e0 2024-09-13T17:14:29.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.443+0000 7fe89afbf740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cc615cab0 con 0x560cc6278980 2024-09-13T17:14:29.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.444+0000 7fe89afbf740 10 client.0 _ll_register_callbacks cb 0x560cc61cb350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:14:29.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.444+0000 7fe896039640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc626d7c0 0x560cc6278380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.444+0000 7fe896039640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc626d7c0 0x560cc6278380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47880/0 (socket says 172.21.15.87:47880) 2024-09-13T17:14:29.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.444+0000 7fe896039640 1 -- 172.21.15.87:0/1817277844 learned_addr learned my addr 172.21.15.87:0/1817277844 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:29.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.444+0000 7fe895838640 1 --2- 172.21.15.87:0/1817277844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560cc626e0e0 0x560cc6275670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.444+0000 7fe89683a640 1 --2- 172.21.15.87:0/1817277844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cc6278980 0x560cc6275c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.444+0000 7fe896039640 1 -- 172.21.15.87:0/1817277844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cc6278980 msgr2=0x560cc6275c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:29.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.444+0000 7fe896039640 1 --2- 172.21.15.87:0/1817277844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cc6278980 0x560cc6275c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.444+0000 7fe896039640 1 -- 172.21.15.87:0/1817277844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560cc626e0e0 msgr2=0x560cc6275670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:29.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.444+0000 7fe896039640 1 --2- 172.21.15.87:0/1817277844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560cc626e0e0 0x560cc6275670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.444+0000 7fe896039640 1 -- 172.21.15.87:0/1817277844 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe88c010b40 con 0x560cc626d7c0 2024-09-13T17:14:29.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.444+0000 7fe89683a640 1 --2- 172.21.15.87:0/1817277844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cc6278980 0x560cc6275c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:29.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.444+0000 7fe896039640 1 --2- 172.21.15.87:0/1817277844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc626d7c0 0x560cc6278380 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fe88c00e870 tx=0x7fe88c00e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9306898b5848872e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:29.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.444+0000 7fe879ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:14:29.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.444+0000 7fe879ffb640 1 -- 172.21.15.87:0/1817277844 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c005450 con 0x560cc626d7c0 2024-09-13T17:14:29.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.444+0000 7fe879ffb640 1 -- 172.21.15.87:0/1817277844 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fe88c0055b0 con 0x560cc626d7c0 2024-09-13T17:14:29.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.444+0000 7fe89afbf740 1 -- 172.21.15.87:0/1817277844 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560cc5ec5590 con 0x560cc626d7c0 2024-09-13T17:14:29.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.445+0000 7fe879ffb640 1 -- 172.21.15.87:0/1817277844 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe88c015030 con 0x560cc626d7c0 2024-09-13T17:14:29.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.445+0000 7fe89afbf740 10 client.15903 fetch_fsmap learned FSMap version 24 2024-09-13T17:14:29.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.445+0000 7fe89afbf740 1 -- 172.21.15.87:0/1817277844 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x560cc61d0360 con 0x560cc626d7c0 2024-09-13T17:14:29.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.445+0000 7fe879ffb640 1 -- 172.21.15.87:0/1817277844 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe88c034020 con 0x560cc626d7c0 2024-09-13T17:14:29.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.445+0000 7fe879ffb640 1 -- 172.21.15.87:0/1817277844 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fe88c004b90 con 0x560cc626d7c0 2024-09-13T17:14:29.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.445+0000 7fe89afbf740 10 client.15903 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:14:29.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.445+0000 7fe89afbf740 10 client.15903 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:14:29.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.445+0000 7fe89afbf740 20 client.15903 populate_metadata read hostname 'smithi087' 2024-09-13T17:14:29.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.445+0000 7fe89afbf740 1 --2- 172.21.15.87:0/1817277844 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560cc62885f0 0x560cc628a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.445+0000 7fe89afbf740 4 client.15903 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:14:29.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.445+0000 7fe89afbf740 1 -- 172.21.15.87:0/1817277844 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560cc5ed6860 con 0x560cc62885f0 2024-09-13T17:14:29.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.445+0000 7fe895838640 1 --2- 172.21.15.87:0/1817277844 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560cc62885f0 0x560cc628a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.446+0000 7fe879ffb640 10 client.15903 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:29.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.446+0000 7fe895838640 1 --2- 172.21.15.87:0/1817277844 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560cc62885f0 0x560cc628a9e0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9daae1c2052bc2a server_cookie=21239d974df077f0 in_seq=0 out_seq=0 2024-09-13T17:14:29.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.446+0000 7fe879ffb640 1 -- 172.21.15.87:0/1817277844 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x560cc5ed6860 con 0x560cc62885f0 2024-09-13T17:14:29.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.446+0000 7fe879ffb640 10 client.15903 handle_command_reply: tid=0 2024-09-13T17:14:29.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.446+0000 7fe89afbf740 1 client.15903 shutdown 2024-09-13T17:14:29.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.446+0000 7fe89afbf740 1 -- 172.21.15.87:0/1817277844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc626d7c0 msgr2=0x560cc6278380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:29.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.447+0000 7fe89afbf740 1 --2- 172.21.15.87:0/1817277844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc626d7c0 0x560cc6278380 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fe88c00e870 tx=0x7fe88c00e8a0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.447+0000 7fe89afbf740 1 -- 172.21.15.87:0/1817277844 shutdown_connections 2024-09-13T17:14:29.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.447+0000 7fe89afbf740 1 --2- 172.21.15.87:0/1817277844 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560cc62885f0 0x560cc628a9e0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.447+0000 7fe89afbf740 1 --2- 172.21.15.87:0/1817277844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cc6278980 0x560cc6275c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.447+0000 7fe879ffb640 0 client.15903 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:29.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.447+0000 7fe89afbf740 1 --2- 172.21.15.87:0/1817277844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560cc626e0e0 0x560cc6275670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.447+0000 7fe89afbf740 1 --2- 172.21.15.87:0/1817277844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc626d7c0 0x560cc6278380 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.447+0000 7fe89afbf740 1 -- 172.21.15.87:0/1817277844 >> 172.21.15.87:0/1817277844 conn(0x560cc6269d50 msgr2=0x560cc626f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:29.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.447+0000 7fe89afbf740 1 -- 172.21.15.87:0/1817277844 shutdown_connections 2024-09-13T17:14:29.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.447+0000 7fe89afbf740 1 -- 172.21.15.87:0/1817277844 wait complete. 2024-09-13T17:14:29.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.447+0000 7fe89afbf740 20 client.15903 trim_cache size 0 max 16384 2024-09-13T17:14:29.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.473+0000 7fe89afbf740 1 Processor -- start 2024-09-13T17:14:29.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.473+0000 7fe89afbf740 1 -- start start 2024-09-13T17:14:29.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.474+0000 7fe89afbf740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc626d7c0 0x560cc6277e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.474+0000 7fe89afbf740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cc626e0e0 0x560cc627f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.474+0000 7fe89afbf740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560cc6278980 0x560cc627fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.474+0000 7fe896039640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc626d7c0 0x560cc6277e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.474+0000 7fe89afbf740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cc6271160 con 0x560cc626d7c0 2024-09-13T17:14:29.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.474+0000 7fe896039640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc626d7c0 0x560cc6277e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47888/0 (socket says 172.21.15.87:47888) 2024-09-13T17:14:29.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.474+0000 7fe896039640 1 -- 172.21.15.87:0/2170346073 learned_addr learned my addr 172.21.15.87:0/2170346073 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:29.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.474+0000 7fe89afbf740 1 -- 172.21.15.87:0/2170346073 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cc62712d0 con 0x560cc6278980 2024-09-13T17:14:29.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.474+0000 7fe89afbf740 1 -- 172.21.15.87:0/2170346073 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cc628f510 con 0x560cc626e0e0 2024-09-13T17:14:29.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.474+0000 7fe895838640 1 --2- 172.21.15.87:0/2170346073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cc626e0e0 0x560cc627f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.474+0000 7fe896039640 1 -- 172.21.15.87:0/2170346073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cc626e0e0 msgr2=0x560cc627f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:29.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.474+0000 7fe896039640 1 --2- 172.21.15.87:0/2170346073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cc626e0e0 0x560cc627f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.474+0000 7fe896039640 1 -- 172.21.15.87:0/2170346073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560cc6278980 msgr2=0x560cc627fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:29.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.474+0000 7fe896039640 1 --2- 172.21.15.87:0/2170346073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560cc6278980 0x560cc627fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.474+0000 7fe896039640 1 -- 172.21.15.87:0/2170346073 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560cc61721c0 con 0x560cc626d7c0 2024-09-13T17:14:29.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.474+0000 7fe896039640 1 --2- 172.21.15.87:0/2170346073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc626d7c0 0x560cc6277e90 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe88c024780 tx=0x7fe88c010580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f526153059ddbf1e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:29.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.474+0000 7fe885606640 1 -- 172.21.15.87:0/2170346073 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c015040 con 0x560cc626d7c0 2024-09-13T17:14:29.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.475+0000 7fe885606640 1 -- 172.21.15.87:0/2170346073 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe88c034030 con 0x560cc626d7c0 2024-09-13T17:14:29.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.475+0000 7fe885606640 1 -- 172.21.15.87:0/2170346073 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c00ed10 con 0x560cc626d7c0 2024-09-13T17:14:29.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.475+0000 7fe89afbf740 1 -- 172.21.15.87:0/2170346073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc626d7c0 msgr2=0x560cc6277e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:29.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.475+0000 7fe89afbf740 1 --2- 172.21.15.87:0/2170346073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc626d7c0 0x560cc6277e90 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe88c024780 tx=0x7fe88c010580 comp rx=0 tx=0).stop 2024-09-13T17:14:29.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.476+0000 7fe89afbf740 1 -- 172.21.15.87:0/2170346073 shutdown_connections 2024-09-13T17:14:29.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.476+0000 7fe89afbf740 1 --2- 172.21.15.87:0/2170346073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560cc6278980 0x560cc627fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.476+0000 7fe89afbf740 1 --2- 172.21.15.87:0/2170346073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cc626e0e0 0x560cc627f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.476+0000 7fe89afbf740 1 --2- 172.21.15.87:0/2170346073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc626d7c0 0x560cc6277e90 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.476+0000 7fe89afbf740 1 -- 172.21.15.87:0/2170346073 >> 172.21.15.87:0/2170346073 conn(0x560cc6269d50 msgr2=0x560cc6273f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:29.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.476+0000 7fe89afbf740 1 -- 172.21.15.87:0/2170346073 shutdown_connections 2024-09-13T17:14:29.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.476+0000 7fe89afbf740 1 -- 172.21.15.87:0/2170346073 wait complete. 2024-09-13T17:14:29.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.476+0000 7fe89afbf740 1 -- start start 2024-09-13T17:14:29.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.476+0000 7fe89afbf740 1 Processor -- start 2024-09-13T17:14:29.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.476+0000 7fe89afbf740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cc626d7c0 0x560cc627ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.477+0000 7fe89afbf740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc626e0e0 0x560cc627f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.477+0000 7fe89afbf740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560cc6278980 0x560cc62d7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.477+0000 7fe89afbf740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cc62d7f70 con 0x560cc626e0e0 2024-09-13T17:14:29.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.477+0000 7fe89afbf740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cc62d80e0 con 0x560cc6278980 2024-09-13T17:14:29.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.477+0000 7fe89afbf740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cc62d82a0 con 0x560cc626d7c0 2024-09-13T17:14:29.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.477+0000 7fe89afbf740 10 client.0 _ll_register_callbacks cb 0x7fe880095390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:14:29.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.477+0000 7fe895838640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc626e0e0 0x560cc627f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.477+0000 7fe895838640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc626e0e0 0x560cc627f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47900/0 (socket says 172.21.15.87:47900) 2024-09-13T17:14:29.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.477+0000 7fe895838640 1 -- 172.21.15.87:0/446326310 learned_addr learned my addr 172.21.15.87:0/446326310 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:29.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.477+0000 7fe896039640 1 --2- 172.21.15.87:0/446326310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cc626d7c0 0x560cc627ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.477+0000 7fe89683a640 1 --2- 172.21.15.87:0/446326310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560cc6278980 0x560cc62d7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.477+0000 7fe895838640 1 -- 172.21.15.87:0/446326310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cc626d7c0 msgr2=0x560cc627ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:29.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.477+0000 7fe895838640 1 --2- 172.21.15.87:0/446326310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cc626d7c0 0x560cc627ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.477+0000 7fe895838640 1 -- 172.21.15.87:0/446326310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560cc6278980 msgr2=0x560cc62d7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:29.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.477+0000 7fe895838640 1 --2- 172.21.15.87:0/446326310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560cc6278980 0x560cc62d7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.477+0000 7fe895838640 1 -- 172.21.15.87:0/446326310 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560cc61d0360 con 0x560cc626e0e0 2024-09-13T17:14:29.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.477+0000 7fe89683a640 1 --2- 172.21.15.87:0/446326310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560cc6278980 0x560cc62d7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:29.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.477+0000 7fe895838640 1 --2- 172.21.15.87:0/446326310 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc626e0e0 0x560cc627f140 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fe880009610 tx=0x7fe880084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea336f4684d3003f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:29.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.477+0000 7fe879ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:14:29.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.477+0000 7fe879ffb640 1 -- 172.21.15.87:0/446326310 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe880078540 con 0x560cc626e0e0 2024-09-13T17:14:29.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.477+0000 7fe879ffb640 1 -- 172.21.15.87:0/446326310 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fe880099dc0 con 0x560cc626e0e0 2024-09-13T17:14:29.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.477+0000 7fe89afbf740 1 -- 172.21.15.87:0/446326310 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe88c016040 con 0x560cc626e0e0 2024-09-13T17:14:29.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.477+0000 7fe879ffb640 1 -- 172.21.15.87:0/446326310 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe8800996c0 con 0x560cc626e0e0 2024-09-13T17:14:29.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.478+0000 7fe89afbf740 10 client.15909 fetch_fsmap learned FSMap version 24 2024-09-13T17:14:29.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.478+0000 7fe89afbf740 1 -- 172.21.15.87:0/446326310 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x560cc6197990 con 0x560cc626e0e0 2024-09-13T17:14:29.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.478+0000 7fe879ffb640 1 -- 172.21.15.87:0/446326310 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe88c016040 con 0x560cc626e0e0 2024-09-13T17:14:29.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.478+0000 7fe879ffb640 1 -- 172.21.15.87:0/446326310 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fe88009d120 con 0x560cc626e0e0 2024-09-13T17:14:29.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.478+0000 7fe89afbf740 10 client.15909 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:14:29.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.478+0000 7fe89afbf740 10 client.15909 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:14:29.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.478+0000 7fe89afbf740 20 client.15909 populate_metadata read hostname 'smithi087' 2024-09-13T17:14:29.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.478+0000 7fe89afbf740 1 --2- 172.21.15.87:0/446326310 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560cc62e0b40 0x560cc62e2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.478+0000 7fe89afbf740 4 client.15909 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-13T17:14:29.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.478+0000 7fe89afbf740 1 -- 172.21.15.87:0/446326310 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x560cc5f29eb0 con 0x560cc62e0b40 2024-09-13T17:14:29.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.478+0000 7fe896039640 1 --2- 172.21.15.87:0/446326310 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560cc62e0b40 0x560cc62e2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.479+0000 7fe879ffb640 10 client.15909 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:29.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.479+0000 7fe896039640 1 --2- 172.21.15.87:0/446326310 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560cc62e0b40 0x560cc62e2f60 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90c2039c9ff080c4 server_cookie=5c4f9b4f6b814e4 in_seq=0 out_seq=0 2024-09-13T17:14:29.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.480+0000 7fe879ffb640 1 -- 172.21.15.87:0/446326310 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x560cc5f29eb0 con 0x560cc62e0b40 2024-09-13T17:14:29.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.480+0000 7fe879ffb640 10 client.15909 handle_command_reply: tid=0 2024-09-13T17:14:29.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.480+0000 7fe89afbf740 1 client.15909 shutdown 2024-09-13T17:14:29.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.480+0000 7fe89afbf740 1 -- 172.21.15.87:0/446326310 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc626e0e0 msgr2=0x560cc627f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:29.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.480+0000 7fe89afbf740 1 --2- 172.21.15.87:0/446326310 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc626e0e0 0x560cc627f140 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fe880009610 tx=0x7fe880084040 comp rx=0 tx=0).stop 2024-09-13T17:14:29.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.480+0000 7fe89afbf740 1 -- 172.21.15.87:0/446326310 shutdown_connections 2024-09-13T17:14:29.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.480+0000 7fe89afbf740 1 --2- 172.21.15.87:0/446326310 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560cc62e0b40 0x560cc62e2f60 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.480+0000 7fe89afbf740 1 --2- 172.21.15.87:0/446326310 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560cc6278980 0x560cc62d7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.480+0000 7fe89afbf740 1 --2- 172.21.15.87:0/446326310 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560cc626e0e0 0x560cc627f140 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.480+0000 7fe89afbf740 1 --2- 172.21.15.87:0/446326310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cc626d7c0 0x560cc627ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.480+0000 7fe89afbf740 1 -- 172.21.15.87:0/446326310 >> 172.21.15.87:0/446326310 conn(0x560cc6269d50 msgr2=0x560cc626f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:29.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.480+0000 7fe879ffb640 0 client.15909 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:29.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.480+0000 7fe89afbf740 1 -- 172.21.15.87:0/446326310 shutdown_connections 2024-09-13T17:14:29.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.480+0000 7fe89afbf740 1 -- 172.21.15.87:0/446326310 wait complete. 2024-09-13T17:14:29.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.480+0000 7fe89afbf740 20 client.15909 trim_cache size 0 max 16384 2024-09-13T17:14:29.488 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:14:29.488 INFO:teuthology.orchestra.run.smithi087.stdout: "return_code": 0, 2024-09-13T17:14:29.489 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_tag": "252e6b70-6653-44e9-8a91-84eaa73069df", 2024-09-13T17:14:29.489 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": "asynchronous" 2024-09-13T17:14:29.489 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:14:29.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.481+0000 7fe89829d640 1 -- 172.21.15.87:0/3336990890 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe87c0a13a0 msgr2=0x7fe87c0a3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:29.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.481+0000 7fe89829d640 1 --2- 172.21.15.87:0/3336990890 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe87c0a13a0 0x7fe87c0a3860 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe888009430 tx=0x7fe8880095c0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.481+0000 7fe89829d640 1 -- 172.21.15.87:0/3336990890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8901018a0 msgr2=0x7fe890196760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:29.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.481+0000 7fe89829d640 1 --2- 172.21.15.87:0/3336990890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8901018a0 0x7fe890196760 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fe88000d950 tx=0x7fe88000de10 comp rx=0 tx=0).stop 2024-09-13T17:14:29.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.481+0000 7fe89829d640 1 -- 172.21.15.87:0/3336990890 shutdown_connections 2024-09-13T17:14:29.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.481+0000 7fe89829d640 1 --2- 172.21.15.87:0/3336990890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe89010a350 0x7fe89019ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.481+0000 7fe89829d640 1 --2- 172.21.15.87:0/3336990890 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe87c0a13a0 0x7fe87c0a3860 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.481+0000 7fe89829d640 1 --2- 172.21.15.87:0/3336990890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8901018a0 0x7fe890196760 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.481+0000 7fe89829d640 1 --2- 172.21.15.87:0/3336990890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe890100f80 0x7fe890196220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.481+0000 7fe89829d640 1 -- 172.21.15.87:0/3336990890 >> 172.21.15.87:0/3336990890 conn(0x7fe890075c60 msgr2=0x7fe8900fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:29.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.481+0000 7fe89829d640 1 -- 172.21.15.87:0/3336990890 shutdown_connections 2024-09-13T17:14:29.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.481+0000 7fe89829d640 1 -- 172.21.15.87:0/3336990890 wait complete. 2024-09-13T17:14:29.496 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:14:29.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.618+0000 7f648e0aa640 1 -- 172.21.15.87:0/289153059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64881050c0 msgr2=0x7f648810cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:29.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.618+0000 7f648e0aa640 1 --2- 172.21.15.87:0/289153059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64881050c0 0x7f648810cc10 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6480009cd0 tx=0x7f648002a8e0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.618+0000 7f648e0aa640 1 -- 172.21.15.87:0/289153059 shutdown_connections 2024-09-13T17:14:29.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.618+0000 7f648e0aa640 1 --2- 172.21.15.87:0/289153059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64881050c0 0x7f648810cc10 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.618+0000 7f648e0aa640 1 --2- 172.21.15.87:0/289153059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6488100920 0x7f6488104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.618+0000 7f648e0aa640 1 --2- 172.21.15.87:0/289153059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64880fff70 0x7f6488100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.618+0000 7f648e0aa640 1 -- 172.21.15.87:0/289153059 >> 172.21.15.87:0/289153059 conn(0x7f64880fb9e0 msgr2=0x7f64880fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:29.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.618+0000 7f648e0aa640 1 -- 172.21.15.87:0/289153059 shutdown_connections 2024-09-13T17:14:29.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.618+0000 7f648e0aa640 1 -- 172.21.15.87:0/289153059 wait complete. 2024-09-13T17:14:29.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.618+0000 7f648e0aa640 1 Processor -- start 2024-09-13T17:14:29.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.619+0000 7f648e0aa640 1 -- start start 2024-09-13T17:14:29.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.619+0000 7f648e0aa640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64880fff70 0x7f64881962f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.619+0000 7f648e0aa640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64881050c0 0x7f6488196830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.619+0000 7f648e0aa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f648819abd0 0x7f648819b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.619+0000 7f648e0aa640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648819b5c0 con 0x7f648819abd0 2024-09-13T17:14:29.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.619+0000 7f648e0aa640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648819b730 con 0x7f64881050c0 2024-09-13T17:14:29.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.619+0000 7f648e0aa640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648819b8a0 con 0x7f64880fff70 2024-09-13T17:14:29.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.619+0000 7f6487fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f648819abd0 0x7f648819b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.619+0000 7f6487fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f648819abd0 0x7f648819b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47922/0 (socket says 172.21.15.87:47922) 2024-09-13T17:14:29.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.619+0000 7f6487fff640 1 -- 172.21.15.87:0/2373045882 learned_addr learned my addr 172.21.15.87:0/2373045882 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:29.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.619+0000 7f64877fe640 1 --2- 172.21.15.87:0/2373045882 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64880fff70 0x7f64881962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.619+0000 7f6486ffd640 1 --2- 172.21.15.87:0/2373045882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64881050c0 0x7f6488196830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.619+0000 7f6487fff640 1 -- 172.21.15.87:0/2373045882 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64880fff70 msgr2=0x7f64881962f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:29.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.619+0000 7f6487fff640 1 --2- 172.21.15.87:0/2373045882 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64880fff70 0x7f64881962f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.619+0000 7f6487fff640 1 -- 172.21.15.87:0/2373045882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64881050c0 msgr2=0x7f6488196830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:29.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.619+0000 7f6487fff640 1 --2- 172.21.15.87:0/2373045882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64881050c0 0x7f6488196830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.619+0000 7f6487fff640 1 -- 172.21.15.87:0/2373045882 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6480009900 con 0x7f648819abd0 2024-09-13T17:14:29.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.620+0000 7f6487fff640 1 --2- 172.21.15.87:0/2373045882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f648819abd0 0x7f648819b080 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f6480005e30 tx=0x7f64800307d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:29.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.620+0000 7f6484ff9640 1 -- 172.21.15.87:0/2373045882 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6480031c80 con 0x7f648819abd0 2024-09-13T17:14:29.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.620+0000 7f6484ff9640 1 -- 172.21.15.87:0/2373045882 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6480003e20 con 0x7f648819abd0 2024-09-13T17:14:29.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.620+0000 7f648e0aa640 1 -- 172.21.15.87:0/2373045882 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64881a2e80 con 0x7f648819abd0 2024-09-13T17:14:29.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.620+0000 7f6484ff9640 1 -- 172.21.15.87:0/2373045882 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6480045410 con 0x7f648819abd0 2024-09-13T17:14:29.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.620+0000 7f648e0aa640 1 -- 172.21.15.87:0/2373045882 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64881a3300 con 0x7f648819abd0 2024-09-13T17:14:29.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.622+0000 7f6490dd0740 1 Processor -- start 2024-09-13T17:14:29.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.623+0000 7f6484ff9640 1 -- 172.21.15.87:0/2373045882 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 25) v1 ==== 136106+0+0 (secure 0 0 0) 0x7f648000a040 con 0x7f648819abd0 2024-09-13T17:14:29.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.623+0000 7f6490dd0740 1 -- start start 2024-09-13T17:14:29.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.623+0000 7f6490dd0740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56040bf86e10 0x56040bf871f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.623+0000 7f6490dd0740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56040bf87730 0x56040bf91a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.623+0000 7f6490dd0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56040bf91fd0 0x56040bf943c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.623+0000 7f6490dd0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56040bef1f20 con 0x56040bf91fd0 2024-09-13T17:14:29.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.623+0000 7f6490dd0740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56040beef6b0 con 0x56040bf86e10 2024-09-13T17:14:29.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.623+0000 7f6490dd0740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56040beeafa0 con 0x56040bf87730 2024-09-13T17:14:29.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.624+0000 7f6486ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56040bf91fd0 0x56040bf943c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.624+0000 7f6486ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56040bf91fd0 0x56040bf943c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47932/0 (socket says 172.21.15.87:47932) 2024-09-13T17:14:29.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.624+0000 7f6486ffd640 1 -- 172.21.15.87:0/1593020649 learned_addr learned my addr 172.21.15.87:0/1593020649 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:29.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.624+0000 7f64877fe640 1 --2- 172.21.15.87:0/1593020649 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56040bf87730 0x56040bf91a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.624+0000 7f6486ffd640 1 --2- 172.21.15.87:0/1593020649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56040bf86e10 0x56040bf871f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.624+0000 7f6484ff9640 1 --2- 172.21.15.87:0/2373045882 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f64700a1320 0x7f64700a37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.624+0000 7f64877fe640 1 -- 172.21.15.87:0/1593020649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56040bf86e10 msgr2=0x56040bf871f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:29.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.624+0000 7f64877fe640 1 --2- 172.21.15.87:0/1593020649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56040bf86e10 0x56040bf871f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.624+0000 7f64877fe640 1 -- 172.21.15.87:0/1593020649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56040bf91fd0 msgr2=0x56040bf943c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:29.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.624+0000 7f64877fe640 1 --2- 172.21.15.87:0/1593020649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56040bf91fd0 0x56040bf943c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.624+0000 7f64877fe640 1 -- 172.21.15.87:0/1593020649 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56040bea5840 con 0x56040bf87730 2024-09-13T17:14:29.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.624+0000 7f6486ffd640 1 --2- 172.21.15.87:0/1593020649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56040bf91fd0 0x56040bf943c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:14:29.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.624+0000 7f6487fff640 1 --2- 172.21.15.87:0/2373045882 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f64700a1320 0x7f64700a37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.624+0000 7f6484ff9640 1 -- 172.21.15.87:0/2373045882 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f64800eea20 con 0x7f648819abd0 2024-09-13T17:14:29.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.624+0000 7f64877fe640 1 --2- 172.21.15.87:0/1593020649 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56040bf87730 0x56040bf91a90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f647800bbf0 tx=0x7f64780107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e76e256a43159a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:29.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.625+0000 7f646dffb640 1 -- 172.21.15.87:0/1593020649 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6478004030 con 0x56040bf87730 2024-09-13T17:14:29.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.625+0000 7f646dffb640 1 -- 172.21.15.87:0/1593020649 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6478015070 con 0x56040bf87730 2024-09-13T17:14:29.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.625+0000 7f646dffb640 1 -- 172.21.15.87:0/1593020649 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6478011440 con 0x56040bf87730 2024-09-13T17:14:29.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.626+0000 7f6490dd0740 1 -- 172.21.15.87:0/1593020649 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56040bf87730 msgr2=0x56040bf91a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:29.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.626+0000 7f6487fff640 1 --2- 172.21.15.87:0/2373045882 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f64700a1320 0x7f64700a37e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f64800ebca0 tx=0x7f6480086fc0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:29.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.626+0000 7f6490dd0740 1 --2- 172.21.15.87:0/1593020649 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56040bf87730 0x56040bf91a90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f647800bbf0 tx=0x7f64780107a0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.626+0000 7f6490dd0740 1 -- 172.21.15.87:0/1593020649 shutdown_connections 2024-09-13T17:14:29.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.626+0000 7f6490dd0740 1 --2- 172.21.15.87:0/1593020649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56040bf91fd0 0x56040bf943c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.626+0000 7f6490dd0740 1 --2- 172.21.15.87:0/1593020649 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56040bf87730 0x56040bf91a90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.626+0000 7f6490dd0740 1 --2- 172.21.15.87:0/1593020649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56040bf86e10 0x56040bf871f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.626+0000 7f6490dd0740 1 -- 172.21.15.87:0/1593020649 >> 172.21.15.87:0/1593020649 conn(0x56040bf83380 msgr2=0x56040bf83760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:29.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.626+0000 7f6490dd0740 1 -- 172.21.15.87:0/1593020649 shutdown_connections 2024-09-13T17:14:29.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.626+0000 7f6490dd0740 1 -- 172.21.15.87:0/1593020649 wait complete. 2024-09-13T17:14:29.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.626+0000 7f6490dd0740 1 -- start start 2024-09-13T17:14:29.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.626+0000 7f6490dd0740 1 Processor -- start 2024-09-13T17:14:29.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.627+0000 7f6490dd0740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56040bf86e10 0x56040bf919d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.627+0000 7f6490dd0740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56040bf87730 0x56040bf8eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.627+0000 7f6490dd0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56040bf91fd0 0x56040bf8f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.627+0000 7f6490dd0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56040be8c2a0 con 0x56040bf91fd0 2024-09-13T17:14:29.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.627+0000 7f6490dd0740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56040bbc3430 con 0x56040bf87730 2024-09-13T17:14:29.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.627+0000 7f6490dd0740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56040be6e680 con 0x56040bf86e10 2024-09-13T17:14:29.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.627+0000 7f6490dd0740 10 client.0 _ll_register_callbacks cb 0x56040bee4610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:14:29.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.627+0000 7f6486ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56040bf91fd0 0x56040bf8f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.627+0000 7f6486ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56040bf91fd0 0x56040bf8f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47938/0 (socket says 172.21.15.87:47938) 2024-09-13T17:14:29.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.627+0000 7f6486ffd640 1 -- 172.21.15.87:0/2662397171 learned_addr learned my addr 172.21.15.87:0/2662397171 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:29.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.627+0000 7f6486ffd640 1 --2- 172.21.15.87:0/2662397171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56040bf86e10 0x56040bf919d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.627+0000 7f64877fe640 1 --2- 172.21.15.87:0/2662397171 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56040bf87730 0x56040bf8eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.627+0000 7f6486ffd640 1 -- 172.21.15.87:0/2662397171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56040bf86e10 msgr2=0x56040bf919d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:29.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.627+0000 7f6486ffd640 1 --2- 172.21.15.87:0/2662397171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56040bf86e10 0x56040bf919d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.627+0000 7f6486ffd640 1 -- 172.21.15.87:0/2662397171 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56040bf87730 msgr2=0x56040bf8eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:29.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.627+0000 7f6486ffd640 1 --2- 172.21.15.87:0/2662397171 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56040bf87730 0x56040bf8eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.627+0000 7f6486ffd640 1 -- 172.21.15.87:0/2662397171 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f647800b820 con 0x56040bf91fd0 2024-09-13T17:14:29.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.627+0000 7f6486ffd640 1 --2- 172.21.15.87:0/2662397171 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56040bf91fd0 0x56040bf8f290 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f647c012a60 tx=0x7f647c014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48da5768ca3419 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:29.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.627+0000 7f6466ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:14:29.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.627+0000 7f6466ffd640 1 -- 172.21.15.87:0/2662397171 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647c010ba0 con 0x56040bf91fd0 2024-09-13T17:14:29.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.627+0000 7f6490dd0740 1 -- 172.21.15.87:0/2662397171 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56040bbde4e0 con 0x56040bf91fd0 2024-09-13T17:14:29.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.627+0000 7f6466ffd640 1 -- 172.21.15.87:0/2662397171 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f647c010d00 con 0x56040bf91fd0 2024-09-13T17:14:29.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.628+0000 7f6466ffd640 1 -- 172.21.15.87:0/2662397171 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f647c010ec0 con 0x56040bf91fd0 2024-09-13T17:14:29.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.628+0000 7f6490dd0740 10 client.15921 fetch_fsmap learned FSMap version 24 2024-09-13T17:14:29.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.628+0000 7f6490dd0740 1 -- 172.21.15.87:0/2662397171 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x56040bee9620 con 0x56040bf91fd0 2024-09-13T17:14:29.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.628+0000 7f6466ffd640 1 -- 172.21.15.87:0/2662397171 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x56040bbde4e0 con 0x56040bf91fd0 2024-09-13T17:14:29.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.628+0000 7f6466ffd640 1 -- 172.21.15.87:0/2662397171 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f647c003c60 con 0x56040bf91fd0 2024-09-13T17:14:29.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.628+0000 7f6490dd0740 10 client.15921 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:14:29.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.628+0000 7f6490dd0740 10 client.15921 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:14:29.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.628+0000 7f6490dd0740 20 client.15921 populate_metadata read hostname 'smithi087' 2024-09-13T17:14:29.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.628+0000 7f6490dd0740 1 --2- 172.21.15.87:0/2662397171 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56040bfa1dc0 0x56040bfa41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.628+0000 7f6490dd0740 4 client.15921 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:14:29.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.628+0000 7f6490dd0740 1 -- 172.21.15.87:0/2662397171 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56040bbef7e0 con 0x56040bfa1dc0 2024-09-13T17:14:29.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.628+0000 7f64877fe640 1 --2- 172.21.15.87:0/2662397171 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56040bfa1dc0 0x56040bfa41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.629+0000 7f64877fe640 1 --2- 172.21.15.87:0/2662397171 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56040bfa1dc0 0x56040bfa41b0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7d960b4c15611a1 server_cookie=90d81f84769c49eb in_seq=0 out_seq=0 2024-09-13T17:14:29.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.629+0000 7f6466ffd640 10 client.15921 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:29.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.629+0000 7f6466ffd640 1 -- 172.21.15.87:0/2662397171 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x56040bbef7e0 con 0x56040bfa1dc0 2024-09-13T17:14:29.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.629+0000 7f6466ffd640 10 client.15921 handle_command_reply: tid=0 2024-09-13T17:14:29.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.629+0000 7f6490dd0740 1 client.15921 shutdown 2024-09-13T17:14:29.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.630+0000 7f6490dd0740 1 -- 172.21.15.87:0/2662397171 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56040bf91fd0 msgr2=0x56040bf8f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:29.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.630+0000 7f6490dd0740 1 --2- 172.21.15.87:0/2662397171 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56040bf91fd0 0x56040bf8f290 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f647c012a60 tx=0x7f647c014040 comp rx=0 tx=0).stop 2024-09-13T17:14:29.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.630+0000 7f6490dd0740 1 -- 172.21.15.87:0/2662397171 shutdown_connections 2024-09-13T17:14:29.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.630+0000 7f6490dd0740 1 --2- 172.21.15.87:0/2662397171 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56040bfa1dc0 0x56040bfa41b0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.630+0000 7f6490dd0740 1 --2- 172.21.15.87:0/2662397171 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56040bf91fd0 0x56040bf8f290 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.630+0000 7f6490dd0740 1 --2- 172.21.15.87:0/2662397171 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56040bf87730 0x56040bf8eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.630+0000 7f6490dd0740 1 --2- 172.21.15.87:0/2662397171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56040bf86e10 0x56040bf919d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.630+0000 7f6466ffd640 0 client.15921 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:29.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.630+0000 7f6490dd0740 1 -- 172.21.15.87:0/2662397171 >> 172.21.15.87:0/2662397171 conn(0x56040bf83380 msgr2=0x56040bf82510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:29.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.630+0000 7f6490dd0740 1 -- 172.21.15.87:0/2662397171 shutdown_connections 2024-09-13T17:14:29.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.630+0000 7f6490dd0740 1 -- 172.21.15.87:0/2662397171 wait complete. 2024-09-13T17:14:29.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.630+0000 7f6490dd0740 20 client.15921 trim_cache size 0 max 16384 2024-09-13T17:14:29.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.648+0000 7f6490dd0740 1 Processor -- start 2024-09-13T17:14:29.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.649+0000 7f6490dd0740 1 -- start start 2024-09-13T17:14:29.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.649+0000 7f6490dd0740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56040bf86e10 0x56040bf8e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.649+0000 7f6490dd0740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56040bf87730 0x56040bf8e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.649+0000 7f6490dd0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56040bf91fd0 0x56040bf89f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.649+0000 7f6490dd0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56040bf8d1d0 con 0x56040bf91fd0 2024-09-13T17:14:29.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.649+0000 7f6490dd0740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56040bf7e760 con 0x56040bf87730 2024-09-13T17:14:29.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.649+0000 7f6490dd0740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56040bf946e0 con 0x56040bf86e10 2024-09-13T17:14:29.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.649+0000 7f6486ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56040bf91fd0 0x56040bf89f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.649+0000 7f6486ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56040bf91fd0 0x56040bf89f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47954/0 (socket says 172.21.15.87:47954) 2024-09-13T17:14:29.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.649+0000 7f6486ffd640 1 -- 172.21.15.87:0/3588376559 learned_addr learned my addr 172.21.15.87:0/3588376559 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:29.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.649+0000 7f6486ffd640 1 --2- 172.21.15.87:0/3588376559 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56040bf86e10 0x56040bf8e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.649+0000 7f64877fe640 1 --2- 172.21.15.87:0/3588376559 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56040bf87730 0x56040bf8e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.649+0000 7f6486ffd640 1 -- 172.21.15.87:0/3588376559 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56040bf86e10 msgr2=0x56040bf8e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:29.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.649+0000 7f6486ffd640 1 --2- 172.21.15.87:0/3588376559 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56040bf86e10 0x56040bf8e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.649+0000 7f6486ffd640 1 -- 172.21.15.87:0/3588376559 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56040bf87730 msgr2=0x56040bf8e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:29.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.649+0000 7f6486ffd640 1 --2- 172.21.15.87:0/3588376559 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56040bf87730 0x56040bf8e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.649+0000 7f6486ffd640 1 -- 172.21.15.87:0/3588376559 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56040be8b790 con 0x56040bf91fd0 2024-09-13T17:14:29.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.649+0000 7f64877fe640 1 --2- 172.21.15.87:0/3588376559 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56040bf87730 0x56040bf8e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:29.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.649+0000 7f6486ffd640 1 --2- 172.21.15.87:0/3588376559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56040bf91fd0 0x56040bf89f30 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f647c014010 tx=0x7f647c00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26603d765745d0c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:29.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.650+0000 7f646e7fc640 1 -- 172.21.15.87:0/3588376559 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647c00eec0 con 0x56040bf91fd0 2024-09-13T17:14:29.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.650+0000 7f646e7fc640 1 -- 172.21.15.87:0/3588376559 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f647c01f070 con 0x56040bf91fd0 2024-09-13T17:14:29.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.650+0000 7f646e7fc640 1 -- 172.21.15.87:0/3588376559 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647c010e00 con 0x56040bf91fd0 2024-09-13T17:14:29.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.650+0000 7f6490dd0740 1 -- 172.21.15.87:0/3588376559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56040bf91fd0 msgr2=0x56040bf89f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:29.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.650+0000 7f6490dd0740 1 --2- 172.21.15.87:0/3588376559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56040bf91fd0 0x56040bf89f30 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f647c014010 tx=0x7f647c00b890 comp rx=0 tx=0).stop 2024-09-13T17:14:29.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.650+0000 7f6490dd0740 1 -- 172.21.15.87:0/3588376559 shutdown_connections 2024-09-13T17:14:29.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.650+0000 7f6490dd0740 1 --2- 172.21.15.87:0/3588376559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56040bf91fd0 0x56040bf89f30 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.650+0000 7f6490dd0740 1 --2- 172.21.15.87:0/3588376559 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56040bf87730 0x56040bf8e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.650+0000 7f6490dd0740 1 --2- 172.21.15.87:0/3588376559 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56040bf86e10 0x56040bf8e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.650+0000 7f6490dd0740 1 -- 172.21.15.87:0/3588376559 >> 172.21.15.87:0/3588376559 conn(0x56040bf83380 msgr2=0x56040bf83760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:29.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.651+0000 7f6490dd0740 1 -- 172.21.15.87:0/3588376559 shutdown_connections 2024-09-13T17:14:29.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.651+0000 7f6490dd0740 1 -- 172.21.15.87:0/3588376559 wait complete. 2024-09-13T17:14:29.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.651+0000 7f6490dd0740 1 -- start start 2024-09-13T17:14:29.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.651+0000 7f6490dd0740 1 Processor -- start 2024-09-13T17:14:29.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.651+0000 7f6490dd0740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56040bf86e10 0x56040bf98d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.652+0000 7f6490dd0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56040bf87730 0x56040bf99240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.652+0000 7f6490dd0740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56040bf91fd0 0x56040bf95520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.652+0000 7f6490dd0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56040bf95c20 con 0x56040bf87730 2024-09-13T17:14:29.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.652+0000 7f6490dd0740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56040bf95d90 con 0x56040bf91fd0 2024-09-13T17:14:29.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.652+0000 7f6490dd0740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56040bf95f50 con 0x56040bf86e10 2024-09-13T17:14:29.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.652+0000 7f64877fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56040bf87730 0x56040bf99240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.652+0000 7f6490dd0740 10 client.0 _ll_register_callbacks cb 0x7f647c012710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:14:29.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.652+0000 7f6486ffd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56040bf86e10 0x56040bf98d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.652+0000 7f64877fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56040bf87730 0x56040bf99240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47968/0 (socket says 172.21.15.87:47968) 2024-09-13T17:14:29.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.652+0000 7f64877fe640 1 -- 172.21.15.87:0/4145963086 learned_addr learned my addr 172.21.15.87:0/4145963086 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:29.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.652+0000 7f6486ffd640 1 --2- 172.21.15.87:0/4145963086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56040bf91fd0 0x56040bf95520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.652+0000 7f64877fe640 1 -- 172.21.15.87:0/4145963086 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56040bf86e10 msgr2=0x56040bf98d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:29.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.652+0000 7f64877fe640 1 --2- 172.21.15.87:0/4145963086 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56040bf86e10 0x56040bf98d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.652+0000 7f64877fe640 1 -- 172.21.15.87:0/4145963086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56040bf91fd0 msgr2=0x56040bf95520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:29.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.652+0000 7f64877fe640 1 --2- 172.21.15.87:0/4145963086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56040bf91fd0 0x56040bf95520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.652+0000 7f64877fe640 1 -- 172.21.15.87:0/4145963086 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56040bee9620 con 0x56040bf87730 2024-09-13T17:14:29.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.652+0000 7f64877fe640 1 --2- 172.21.15.87:0/4145963086 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56040bf87730 0x56040bf99240 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f64780058c0 tx=0x7f647800bb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d51ecf1c5ee619f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:29.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.652+0000 7f6466ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:14:29.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.652+0000 7f6466ffd640 1 -- 172.21.15.87:0/4145963086 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6478027040 con 0x56040bf87730 2024-09-13T17:14:29.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.652+0000 7f6466ffd640 1 -- 172.21.15.87:0/4145963086 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f6478017070 con 0x56040bf87730 2024-09-13T17:14:29.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.653+0000 7f6490dd0740 1 -- 172.21.15.87:0/4145963086 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6478015070 con 0x56040bf87730 2024-09-13T17:14:29.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.653+0000 7f6466ffd640 1 -- 172.21.15.87:0/4145963086 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6478003ae0 con 0x56040bf87730 2024-09-13T17:14:29.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.653+0000 7f6490dd0740 10 client.15927 fetch_fsmap learned FSMap version 24 2024-09-13T17:14:29.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.653+0000 7f6490dd0740 1 -- 172.21.15.87:0/4145963086 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x56040beb0ea0 con 0x56040bf87730 2024-09-13T17:14:29.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.653+0000 7f6466ffd640 1 -- 172.21.15.87:0/4145963086 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6478015070 con 0x56040bf87730 2024-09-13T17:14:29.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.653+0000 7f6466ffd640 1 -- 172.21.15.87:0/4145963086 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f6478022540 con 0x56040bf87730 2024-09-13T17:14:29.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.653+0000 7f6490dd0740 10 client.15927 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:14:29.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.653+0000 7f6490dd0740 10 client.15927 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:14:29.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.653+0000 7f6490dd0740 20 client.15927 populate_metadata read hostname 'smithi087' 2024-09-13T17:14:29.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.653+0000 7f6490dd0740 1 --2- 172.21.15.87:0/4145963086 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56040bff9610 0x56040bffba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:29.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.653+0000 7f6490dd0740 4 client.15927 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:14:29.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.653+0000 7f6490dd0740 1 -- 172.21.15.87:0/4145963086 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56040bc42e30 con 0x56040bff9610 2024-09-13T17:14:29.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.653+0000 7f6486ffd640 1 --2- 172.21.15.87:0/4145963086 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56040bff9610 0x56040bffba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:29.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.654+0000 7f6466ffd640 10 client.15927 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:29.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.654+0000 7f6486ffd640 1 --2- 172.21.15.87:0/4145963086 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56040bff9610 0x56040bffba30 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5267f8ab0650478 server_cookie=340c0a8234dc89e9 in_seq=0 out_seq=0 2024-09-13T17:14:29.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.654+0000 7f6466ffd640 1 -- 172.21.15.87:0/4145963086 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x56040bc42e30 con 0x56040bff9610 2024-09-13T17:14:29.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.654+0000 7f6466ffd640 10 client.15927 handle_command_reply: tid=0 2024-09-13T17:14:29.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.654+0000 7f6490dd0740 1 client.15927 shutdown 2024-09-13T17:14:29.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.654+0000 7f6490dd0740 1 -- 172.21.15.87:0/4145963086 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56040bf87730 msgr2=0x56040bf99240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:29.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.654+0000 7f6490dd0740 1 --2- 172.21.15.87:0/4145963086 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56040bf87730 0x56040bf99240 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f64780058c0 tx=0x7f647800bb30 comp rx=0 tx=0).stop 2024-09-13T17:14:29.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.654+0000 7f6490dd0740 1 -- 172.21.15.87:0/4145963086 shutdown_connections 2024-09-13T17:14:29.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.654+0000 7f6490dd0740 1 --2- 172.21.15.87:0/4145963086 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56040bff9610 0x56040bffba30 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.654+0000 7f6490dd0740 1 --2- 172.21.15.87:0/4145963086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56040bf91fd0 0x56040bf95520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.654+0000 7f6490dd0740 1 --2- 172.21.15.87:0/4145963086 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56040bf87730 0x56040bf99240 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.654+0000 7f6466ffd640 0 client.15927 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:29.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.654+0000 7f6490dd0740 1 --2- 172.21.15.87:0/4145963086 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56040bf86e10 0x56040bf98d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.654+0000 7f6490dd0740 1 -- 172.21.15.87:0/4145963086 >> 172.21.15.87:0/4145963086 conn(0x56040bf83380 msgr2=0x56040bf8e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:29.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.654+0000 7f6490dd0740 1 -- 172.21.15.87:0/4145963086 shutdown_connections 2024-09-13T17:14:29.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.654+0000 7f6490dd0740 1 -- 172.21.15.87:0/4145963086 wait complete. 2024-09-13T17:14:29.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.655+0000 7f6490dd0740 20 client.15927 trim_cache size 0 max 16384 2024-09-13T17:14:29.662 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:14:29.662 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-13T17:14:29.662 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": { 2024-09-13T17:14:29.662 INFO:teuthology.orchestra.run.smithi087.stdout: "252e6b70-6653-44e9-8a91-84eaa73069df": { 2024-09-13T17:14:29.662 INFO:teuthology.orchestra.run.smithi087.stdout: "path": "/", 2024-09-13T17:14:29.662 INFO:teuthology.orchestra.run.smithi087.stdout: "tag": "252e6b70-6653-44e9-8a91-84eaa73069df", 2024-09-13T17:14:29.662 INFO:teuthology.orchestra.run.smithi087.stdout: "options": "recursive,force" 2024-09-13T17:14:29.662 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:14:29.663 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:14:29.663 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:14:29.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.655+0000 7f648e0aa640 1 -- 172.21.15.87:0/2373045882 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f64700a1320 msgr2=0x7f64700a37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:29.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.655+0000 7f648e0aa640 1 --2- 172.21.15.87:0/2373045882 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f64700a1320 0x7f64700a37e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f64800ebca0 tx=0x7f6480086fc0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.655+0000 7f648e0aa640 1 -- 172.21.15.87:0/2373045882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f648819abd0 msgr2=0x7f648819b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:29.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.655+0000 7f648e0aa640 1 --2- 172.21.15.87:0/2373045882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f648819abd0 0x7f648819b080 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f6480005e30 tx=0x7f64800307d0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.655+0000 7f648e0aa640 1 -- 172.21.15.87:0/2373045882 shutdown_connections 2024-09-13T17:14:29.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.655+0000 7f648e0aa640 1 --2- 172.21.15.87:0/2373045882 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f64700a1320 0x7f64700a37e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.655+0000 7f648e0aa640 1 --2- 172.21.15.87:0/2373045882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f648819abd0 0x7f648819b080 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.655+0000 7f648e0aa640 1 --2- 172.21.15.87:0/2373045882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64881050c0 0x7f6488196830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.655+0000 7f648e0aa640 1 --2- 172.21.15.87:0/2373045882 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64880fff70 0x7f64881962f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:29.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.655+0000 7f648e0aa640 1 -- 172.21.15.87:0/2373045882 >> 172.21.15.87:0/2373045882 conn(0x7f64880fb9e0 msgr2=0x7f64880fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:29.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.655+0000 7f648e0aa640 1 -- 172.21.15.87:0/2373045882 shutdown_connections 2024-09-13T17:14:29.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:29.655+0000 7f648e0aa640 1 -- 172.21.15.87:0/2373045882 wait complete. 2024-09-13T17:14:29.670 INFO:tasks.cephfs.filesystem:scrub status for tag:252e6b70-6653-44e9-8a91-84eaa73069df - {'path': '/', 'tag': '252e6b70-6653-44e9-8a91-84eaa73069df', 'options': 'recursive,force'} 2024-09-13T17:14:30.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:30 smithi087 ceph-mon[30934]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T17:14:30.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:30 smithi087 ceph-mon[30934]: scrub queued for path: / 2024-09-13T17:14:30.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:30 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:14:30.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:30 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:14:30.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:30 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:14:30.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:30 smithi087 ceph-mon[30934]: scrub summary: idle 2024-09-13T17:14:30.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:30 smithi149 ceph-mon[35496]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T17:14:30.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:30 smithi149 ceph-mon[35496]: scrub queued for path: / 2024-09-13T17:14:30.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:30 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:14:30.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:30 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:14:30.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:30 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:14:30.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:30 smithi149 ceph-mon[35496]: scrub summary: idle 2024-09-13T17:14:30.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:30 smithi118 ceph-mon[34374]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T17:14:30.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:30 smithi118 ceph-mon[34374]: scrub queued for path: / 2024-09-13T17:14:30.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:30 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:14:30.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:30 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:14:30.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:30 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:14:30.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:30 smithi118 ceph-mon[34374]: scrub summary: idle 2024-09-13T17:14:32.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:32 smithi087 ceph-mon[30934]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-13T17:14:32.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:32 smithi149 ceph-mon[35496]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-13T17:14:32.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:32 smithi118 ceph-mon[34374]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-13T17:14:34.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:34 smithi087 ceph-mon[30934]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T17:14:34.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:34 smithi149 ceph-mon[35496]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T17:14:34.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:34 smithi118 ceph-mon[34374]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T17:14:36.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:36 smithi087 ceph-mon[30934]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-13T17:14:36.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:36 smithi149 ceph-mon[35496]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-13T17:14:36.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:36 smithi118 ceph-mon[34374]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-13T17:14:38.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:38 smithi087 ceph-mon[30934]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-13T17:14:38.755 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.753+0000 7fe9e1d11640 1 -- 172.21.15.87:0/1653618435 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9dc105060 msgr2=0x7fe9dc10cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:38.755 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.753+0000 7fe9e1d11640 1 --2- 172.21.15.87:0/1653618435 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9dc105060 0x7fe9dc10cbb0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4009cd0 tx=0x7fe9d402a8e0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.755 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.753+0000 7fe9e1d11640 1 -- 172.21.15.87:0/1653618435 shutdown_connections 2024-09-13T17:14:38.755 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.753+0000 7fe9e1d11640 1 --2- 172.21.15.87:0/1653618435 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9dc105060 0x7fe9dc10cbb0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.755 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.753+0000 7fe9e1d11640 1 --2- 172.21.15.87:0/1653618435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9dc1008c0 0x7fe9dc104900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.755 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.753+0000 7fe9e1d11640 1 --2- 172.21.15.87:0/1653618435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9dc0fff10 0x7fe9dc1002f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.756 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.753+0000 7fe9e1d11640 1 -- 172.21.15.87:0/1653618435 >> 172.21.15.87:0/1653618435 conn(0x7fe9dc0fb9a0 msgr2=0x7fe9dc0fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:38.756 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.753+0000 7fe9e1d11640 1 -- 172.21.15.87:0/1653618435 shutdown_connections 2024-09-13T17:14:38.756 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.753+0000 7fe9e1d11640 1 -- 172.21.15.87:0/1653618435 wait complete. 2024-09-13T17:14:38.758 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.754+0000 7fe9e1d11640 1 Processor -- start 2024-09-13T17:14:38.758 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.754+0000 7fe9e1d11640 1 -- start start 2024-09-13T17:14:38.758 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.754+0000 7fe9e1d11640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9dc0fff10 0x7fe9dc194080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.754+0000 7fe9e1d11640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9dc105060 0x7fe9dc1945c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.754+0000 7fe9e1d11640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9dc198960 0x7fe9dc198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.754+0000 7fe9e1d11640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc199350 con 0x7fe9dc105060 2024-09-13T17:14:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.754+0000 7fe9e1d11640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc1994c0 con 0x7fe9dc198960 2024-09-13T17:14:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.754+0000 7fe9e1d11640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc199630 con 0x7fe9dc0fff10 2024-09-13T17:14:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.755+0000 7fe9db7fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9dc0fff10 0x7fe9dc194080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.755+0000 7fe9db7fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9dc0fff10 0x7fe9dc194080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:35438/0 (socket says 172.21.15.87:35438) 2024-09-13T17:14:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.755+0000 7fe9daffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9dc105060 0x7fe9dc1945c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.755+0000 7fe9db7fe640 1 -- 172.21.15.87:0/3886448021 learned_addr learned my addr 172.21.15.87:0/3886448021 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.755+0000 7fe9dbfff640 1 --2- 172.21.15.87:0/3886448021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9dc198960 0x7fe9dc198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.755+0000 7fe9db7fe640 1 -- 172.21.15.87:0/3886448021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9dc198960 msgr2=0x7fe9dc198e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.755+0000 7fe9db7fe640 1 --2- 172.21.15.87:0/3886448021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9dc198960 0x7fe9dc198e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.755+0000 7fe9db7fe640 1 -- 172.21.15.87:0/3886448021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9dc105060 msgr2=0x7fe9dc1945c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.755+0000 7fe9db7fe640 1 --2- 172.21.15.87:0/3886448021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9dc105060 0x7fe9dc1945c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.755+0000 7fe9db7fe640 1 -- 172.21.15.87:0/3886448021 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d0009490 con 0x7fe9dc0fff10 2024-09-13T17:14:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.755+0000 7fe9dbfff640 1 --2- 172.21.15.87:0/3886448021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9dc198960 0x7fe9dc198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.755+0000 7fe9daffd640 1 --2- 172.21.15.87:0/3886448021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9dc105060 0x7fe9dc1945c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:14:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.755+0000 7fe9db7fe640 1 --2- 172.21.15.87:0/3886448021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9dc0fff10 0x7fe9dc194080 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc004650 tx=0x7fe9cc003da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.756+0000 7fe9d8ff9640 1 -- 172.21.15.87:0/3886448021 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc01c070 con 0x7fe9dc0fff10 2024-09-13T17:14:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.756+0000 7fe9d8ff9640 1 -- 172.21.15.87:0/3886448021 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe9cc0054d0 con 0x7fe9dc0fff10 2024-09-13T17:14:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.756+0000 7fe9d8ff9640 1 -- 172.21.15.87:0/3886448021 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc014040 con 0x7fe9dc0fff10 2024-09-13T17:14:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.756+0000 7fe9e1d11640 1 -- 172.21.15.87:0/3886448021 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d4009900 con 0x7fe9dc0fff10 2024-09-13T17:14:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.756+0000 7fe9e1d11640 1 -- 172.21.15.87:0/3886448021 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9dc1a0ee0 con 0x7fe9dc0fff10 2024-09-13T17:14:38.763 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.759+0000 7fe9d8ff9640 1 -- 172.21.15.87:0/3886448021 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 25) v1 ==== 136106+0+0 (secure 0 0 0) 0x7fe9cc004bc0 con 0x7fe9dc0fff10 2024-09-13T17:14:38.763 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.759+0000 7fe9e4a33740 1 Processor -- start 2024-09-13T17:14:38.763 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.759+0000 7fe9e4a33740 1 -- start start 2024-09-13T17:14:38.763 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.759+0000 7fe9e4a33740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f687ef2330 0x55f687ef2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:38.763 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.759+0000 7fe9e4a33740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f687ef2c50 0x55f687efcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:38.763 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.759+0000 7fe9e4a33740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f687efd4f0 0x55f687eff8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:38.763 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.759+0000 7fe9e4a33740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f687e5dc30 con 0x55f687efd4f0 2024-09-13T17:14:38.764 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.759+0000 7fe9e4a33740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f687e5b3c0 con 0x55f687ef2330 2024-09-13T17:14:38.764 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.759+0000 7fe9e4a33740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f687e56cb0 con 0x55f687ef2c50 2024-09-13T17:14:38.764 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.760+0000 7fe9db7fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f687ef2c50 0x55f687efcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:38.764 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.760+0000 7fe9daffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f687efd4f0 0x55f687eff8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:38.764 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.760+0000 7fe9db7fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f687ef2c50 0x55f687efcfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:35440/0 (socket says 172.21.15.87:35440) 2024-09-13T17:14:38.764 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.760+0000 7fe9db7fe640 1 -- 172.21.15.87:0/109324816 learned_addr learned my addr 172.21.15.87:0/109324816 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:38.764 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.760+0000 7fe9dbfff640 1 --2- 172.21.15.87:0/109324816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f687ef2330 0x55f687ef2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:38.764 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.760+0000 7fe9d8ff9640 1 --2- 172.21.15.87:0/3886448021 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe9c40a13a0 0x7fe9c40a3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:38.764 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.760+0000 7fe9db7fe640 1 -- 172.21.15.87:0/109324816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f687ef2330 msgr2=0x55f687ef2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:38.764 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.760+0000 7fe9db7fe640 1 --2- 172.21.15.87:0/109324816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f687ef2330 0x55f687ef2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.764 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.760+0000 7fe9db7fe640 1 -- 172.21.15.87:0/109324816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f687efd4f0 msgr2=0x55f687eff8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:38.764 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.760+0000 7fe9db7fe640 1 --2- 172.21.15.87:0/109324816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f687efd4f0 0x55f687eff8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.765 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.760+0000 7fe9db7fe640 1 -- 172.21.15.87:0/109324816 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f687dfd910 con 0x55f687ef2c50 2024-09-13T17:14:38.765 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.760+0000 7fe9dbfff640 1 --2- 172.21.15.87:0/109324816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f687ef2330 0x55f687ef2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:14:38.765 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.760+0000 7fe9daffd640 1 --2- 172.21.15.87:0/109324816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f687efd4f0 0x55f687eff8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:14:38.765 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.760+0000 7fe9dbfff640 1 --2- 172.21.15.87:0/3886448021 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe9c40a13a0 0x7fe9c40a3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:38.765 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.761+0000 7fe9d8ff9640 1 -- 172.21.15.87:0/3886448021 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fe9cc0d0d90 con 0x7fe9dc0fff10 2024-09-13T17:14:38.765 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.761+0000 7fe9db7fe640 1 --2- 172.21.15.87:0/109324816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f687ef2c50 0x55f687efcfb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc0cdef0 tx=0x7fe9cc068cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b70af94406bca29a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:38.765 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.761+0000 7fe9c1ffb640 1 -- 172.21.15.87:0/109324816 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc09d610 con 0x55f687ef2c50 2024-09-13T17:14:38.765 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.761+0000 7fe9dbfff640 1 --2- 172.21.15.87:0/3886448021 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe9c40a13a0 0x7fe9c40a3860 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4004af0 tx=0x7fe9d403f040 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:38.765 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.761+0000 7fe9c1ffb640 1 -- 172.21.15.87:0/109324816 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe9cc09d380 con 0x55f687ef2c50 2024-09-13T17:14:38.765 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.761+0000 7fe9c1ffb640 1 -- 172.21.15.87:0/109324816 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc0691e0 con 0x55f687ef2c50 2024-09-13T17:14:38.770 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.762+0000 7fe9e4a33740 1 -- 172.21.15.87:0/109324816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f687ef2c50 msgr2=0x55f687efcfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:38.770 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.762+0000 7fe9e4a33740 1 --2- 172.21.15.87:0/109324816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f687ef2c50 0x55f687efcfb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc0cdef0 tx=0x7fe9cc068cd0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.770 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.762+0000 7fe9e4a33740 1 -- 172.21.15.87:0/109324816 shutdown_connections 2024-09-13T17:14:38.770 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.762+0000 7fe9e4a33740 1 --2- 172.21.15.87:0/109324816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f687efd4f0 0x55f687eff8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.770 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.762+0000 7fe9e4a33740 1 --2- 172.21.15.87:0/109324816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f687ef2c50 0x55f687efcfb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.770 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.762+0000 7fe9e4a33740 1 --2- 172.21.15.87:0/109324816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f687ef2330 0x55f687ef2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.770 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.762+0000 7fe9e4a33740 1 -- 172.21.15.87:0/109324816 >> 172.21.15.87:0/109324816 conn(0x55f687eee8c0 msgr2=0x55f687eeeca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:38.770 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.762+0000 7fe9e4a33740 1 -- 172.21.15.87:0/109324816 shutdown_connections 2024-09-13T17:14:38.770 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.762+0000 7fe9e4a33740 1 -- 172.21.15.87:0/109324816 wait complete. 2024-09-13T17:14:38.770 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.762+0000 7fe9e4a33740 1 -- start start 2024-09-13T17:14:38.771 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.763+0000 7fe9e4a33740 1 Processor -- start 2024-09-13T17:14:38.771 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.763+0000 7fe9e4a33740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f687ef2330 0x55f687efce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:38.771 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.763+0000 7fe9e4a33740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f687ef2c50 0x55f687efa0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:38.771 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.763+0000 7fe9db7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f687ef2330 0x55f687efce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:38.771 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.763+0000 7fe9e4a33740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f687efd4f0 0x55f687efa6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:38.771 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.763+0000 7fe9db7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f687ef2330 0x55f687efce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48008/0 (socket says 172.21.15.87:48008) 2024-09-13T17:14:38.771 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.763+0000 7fe9db7fe640 1 -- 172.21.15.87:0/84967585 learned_addr learned my addr 172.21.15.87:0/84967585 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:38.771 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.763+0000 7fe9e4a33740 1 -- 172.21.15.87:0/84967585 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f687e14e80 con 0x55f687ef2330 2024-09-13T17:14:38.771 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.763+0000 7fe9e4a33740 1 -- 172.21.15.87:0/84967585 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f687e14b20 con 0x55f687ef2c50 2024-09-13T17:14:38.771 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.763+0000 7fe9e4a33740 1 -- 172.21.15.87:0/84967585 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f687dda260 con 0x55f687efd4f0 2024-09-13T17:14:38.771 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.763+0000 7fe9daffd640 1 --2- 172.21.15.87:0/84967585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f687ef2c50 0x55f687efa0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:38.771 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.764+0000 7fe9dbfff640 1 --2- 172.21.15.87:0/84967585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f687efd4f0 0x55f687efa6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:38.771 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.764+0000 7fe9daffd640 1 -- 172.21.15.87:0/84967585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f687efd4f0 msgr2=0x55f687efa6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:38.772 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.764+0000 7fe9daffd640 1 --2- 172.21.15.87:0/84967585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f687efd4f0 0x55f687efa6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.772 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.764+0000 7fe9daffd640 1 -- 172.21.15.87:0/84967585 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f687ef2330 msgr2=0x55f687efce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:38.772 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.764+0000 7fe9daffd640 1 --2- 172.21.15.87:0/84967585 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f687ef2330 0x55f687efce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.772 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.764+0000 7fe9daffd640 1 -- 172.21.15.87:0/84967585 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9dc1a0ee0 con 0x55f687ef2c50 2024-09-13T17:14:38.772 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.764+0000 7fe9e4a33740 10 client.0 _ll_register_callbacks cb 0x55f687e0fdf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:14:38.772 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.764+0000 7fe9e4a33740 1 -- 172.21.15.87:0/84967585 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f687e7f680 con 0x55f687ef2c50 2024-09-13T17:14:38.772 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.764+0000 7fe9daffd640 1 --2- 172.21.15.87:0/84967585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f687ef2c50 0x55f687efa0e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x55f687eef9b0 tx=0x7fe9d000f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bac033a056207fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:38.772 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.764+0000 7fe9baffd640 10 client.25316 ms_handle_connect on v2:172.21.15.118:3300/0 2024-09-13T17:14:38.772 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.764+0000 7fe9baffd640 1 -- 172.21.15.87:0/84967585 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0017070 con 0x55f687ef2c50 2024-09-13T17:14:38.772 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.764+0000 7fe9baffd640 1 -- 172.21.15.87:0/84967585 <== mon.2 v2:172.21.15.118:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fe9d00047a0 con 0x55f687ef2c50 2024-09-13T17:14:38.772 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.764+0000 7fe9baffd640 1 -- 172.21.15.87:0/84967585 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9d0004960 con 0x55f687ef2c50 2024-09-13T17:14:38.772 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.764+0000 7fe9e4a33740 10 client.25316 fetch_fsmap learned FSMap version 24 2024-09-13T17:14:38.772 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.764+0000 7fe9e4a33740 1 -- 172.21.15.87:0/84967585 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({fsmap=24}) v3 -- 0x55f687e55330 con 0x55f687ef2c50 2024-09-13T17:14:38.773 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.765+0000 7fe9baffd640 1 -- 172.21.15.87:0/84967585 <== mon.2 v2:172.21.15.118:3300/0 4 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fe9d0010430 con 0x55f687ef2c50 2024-09-13T17:14:38.773 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.765+0000 7fe9e4a33740 10 client.25316 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:14:38.773 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.765+0000 7fe9e4a33740 10 client.25316 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-13T17:14:38.773 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.765+0000 7fe9e4a33740 20 client.25316 populate_metadata read hostname 'smithi087' 2024-09-13T17:14:38.773 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.765+0000 7fe9e4a33740 1 --2- 172.21.15.87:0/84967585 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55f687f0cd60 0x55f687f0f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:38.773 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.765+0000 7fe9e4a33740 4 client.25316 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:14:38.773 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.765+0000 7fe9e4a33740 1 -- 172.21.15.87:0/84967585 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f687e4a5d0 con 0x55f687f0cd60 2024-09-13T17:14:38.773 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.765+0000 7fe9db7fe640 1 --2- 172.21.15.87:0/84967585 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55f687f0cd60 0x55f687f0f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:38.773 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.766+0000 7fe9baffd640 10 client.25316 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:38.773 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.766+0000 7fe9db7fe640 1 --2- 172.21.15.87:0/84967585 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55f687f0cd60 0x55f687f0f170 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=389e4426daa065a6 server_cookie=30997ad8963b013b in_seq=0 out_seq=0 2024-09-13T17:14:38.773 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.766+0000 7fe9baffd640 1 -- 172.21.15.87:0/84967585 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55f687e4a5d0 con 0x55f687f0cd60 2024-09-13T17:14:38.773 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.766+0000 7fe9baffd640 10 client.25316 handle_command_reply: tid=0 2024-09-13T17:14:38.773 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.766+0000 7fe9e4a33740 1 client.25316 shutdown 2024-09-13T17:14:38.774 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.766+0000 7fe9e4a33740 1 -- 172.21.15.87:0/84967585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f687ef2c50 msgr2=0x55f687efa0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:38.774 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.766+0000 7fe9e4a33740 1 --2- 172.21.15.87:0/84967585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f687ef2c50 0x55f687efa0e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x55f687eef9b0 tx=0x7fe9d000f790 comp rx=0 tx=0).stop 2024-09-13T17:14:38.774 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.767+0000 7fe9e4a33740 1 -- 172.21.15.87:0/84967585 shutdown_connections 2024-09-13T17:14:38.774 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.767+0000 7fe9e4a33740 1 --2- 172.21.15.87:0/84967585 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55f687f0cd60 0x55f687f0f170 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.774 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.767+0000 7fe9e4a33740 1 --2- 172.21.15.87:0/84967585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f687efd4f0 0x55f687efa6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.774 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.767+0000 7fe9baffd640 0 client.25316 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:38.774 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.767+0000 7fe9e4a33740 1 --2- 172.21.15.87:0/84967585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f687ef2c50 0x55f687efa0e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.774 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.767+0000 7fe9e4a33740 1 --2- 172.21.15.87:0/84967585 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f687ef2330 0x55f687efce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.774 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.767+0000 7fe9e4a33740 1 -- 172.21.15.87:0/84967585 >> 172.21.15.87:0/84967585 conn(0x55f687eee8c0 msgr2=0x55f687eedb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:38.775 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.767+0000 7fe9e4a33740 1 -- 172.21.15.87:0/84967585 shutdown_connections 2024-09-13T17:14:38.775 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.767+0000 7fe9e4a33740 1 -- 172.21.15.87:0/84967585 wait complete. 2024-09-13T17:14:38.775 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.767+0000 7fe9e4a33740 20 client.25316 trim_cache size 0 max 16384 2024-09-13T17:14:38.795 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.791+0000 7fe9e4a33740 1 Processor -- start 2024-09-13T17:14:38.795 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.791+0000 7fe9e4a33740 1 -- start start 2024-09-13T17:14:38.795 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.791+0000 7fe9e4a33740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f687ef2330 0x55f687efc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:38.795 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.791+0000 7fe9e4a33740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f687ef2c50 0x55f687f04220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:38.795 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.791+0000 7fe9e4a33740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f687efd4f0 0x55f687f04760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:38.795 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.791+0000 7fe9e4a33740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f687eef9e0 con 0x55f687efd4f0 2024-09-13T17:14:38.795 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.791+0000 7fe9dbfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f687efd4f0 0x55f687f04760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:38.795 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.791+0000 7fe9dbfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f687efd4f0 0x55f687f04760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48014/0 (socket says 172.21.15.87:48014) 2024-09-13T17:14:38.795 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.791+0000 7fe9dbfff640 1 -- 172.21.15.87:0/4007628575 learned_addr learned my addr 172.21.15.87:0/4007628575 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.791+0000 7fe9e4a33740 1 -- 172.21.15.87:0/4007628575 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f687ef8610 con 0x55f687ef2330 2024-09-13T17:14:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.791+0000 7fe9daffd640 1 --2- 172.21.15.87:0/4007628575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f687ef2c50 0x55f687f04220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.791+0000 7fe9e4a33740 1 -- 172.21.15.87:0/4007628575 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f687ef37f0 con 0x55f687ef2c50 2024-09-13T17:14:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.791+0000 7fe9db7fe640 1 --2- 172.21.15.87:0/4007628575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f687ef2330 0x55f687efc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.792+0000 7fe9daffd640 1 -- 172.21.15.87:0/4007628575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f687ef2330 msgr2=0x55f687efc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.792+0000 7fe9daffd640 1 --2- 172.21.15.87:0/4007628575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f687ef2330 0x55f687efc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.792+0000 7fe9daffd640 1 -- 172.21.15.87:0/4007628575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f687efd4f0 msgr2=0x55f687f04760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.792+0000 7fe9daffd640 1 --2- 172.21.15.87:0/4007628575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f687efd4f0 0x55f687f04760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.792+0000 7fe9daffd640 1 -- 172.21.15.87:0/4007628575 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f687df7300 con 0x55f687ef2c50 2024-09-13T17:14:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.792+0000 7fe9dbfff640 1 --2- 172.21.15.87:0/4007628575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f687efd4f0 0x55f687f04760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:14:38.797 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.792+0000 7fe9daffd640 1 --2- 172.21.15.87:0/4007628575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f687ef2c50 0x55f687f04220 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55f687efb700 tx=0x7fe9d0014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8abdde5743adf63 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:38.797 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.792+0000 7fe9c27fc640 1 -- 172.21.15.87:0/4007628575 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d00122e0 con 0x55f687ef2c50 2024-09-13T17:14:38.797 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.792+0000 7fe9c27fc640 1 -- 172.21.15.87:0/4007628575 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe9d002a070 con 0x55f687ef2c50 2024-09-13T17:14:38.797 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.792+0000 7fe9c27fc640 1 -- 172.21.15.87:0/4007628575 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d00047a0 con 0x55f687ef2c50 2024-09-13T17:14:38.802 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.793+0000 7fe9e4a33740 1 -- 172.21.15.87:0/4007628575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f687ef2c50 msgr2=0x55f687f04220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:38.802 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.793+0000 7fe9e4a33740 1 --2- 172.21.15.87:0/4007628575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f687ef2c50 0x55f687f04220 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55f687efb700 tx=0x7fe9d0014000 comp rx=0 tx=0).stop 2024-09-13T17:14:38.803 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.793+0000 7fe9e4a33740 1 -- 172.21.15.87:0/4007628575 shutdown_connections 2024-09-13T17:14:38.803 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.793+0000 7fe9e4a33740 1 --2- 172.21.15.87:0/4007628575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f687efd4f0 0x55f687f04760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.803 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.794+0000 7fe9e4a33740 1 --2- 172.21.15.87:0/4007628575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f687ef2c50 0x55f687f04220 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.803 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.794+0000 7fe9e4a33740 1 --2- 172.21.15.87:0/4007628575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f687ef2330 0x55f687efc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.803 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.794+0000 7fe9e4a33740 1 -- 172.21.15.87:0/4007628575 >> 172.21.15.87:0/4007628575 conn(0x55f687eee8c0 msgr2=0x55f687f08cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:38.803 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.794+0000 7fe9e4a33740 1 -- 172.21.15.87:0/4007628575 shutdown_connections 2024-09-13T17:14:38.803 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.794+0000 7fe9e4a33740 1 -- 172.21.15.87:0/4007628575 wait complete. 2024-09-13T17:14:38.803 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.794+0000 7fe9e4a33740 1 -- start start 2024-09-13T17:14:38.803 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.795+0000 7fe9e4a33740 1 Processor -- start 2024-09-13T17:14:38.804 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.795+0000 7fe9e4a33740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f687ef2330 0x55f687f02c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:38.804 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.795+0000 7fe9e4a33740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f687ef2c50 0x55f687f031d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:38.804 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.795+0000 7fe9e4a33740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f687efd4f0 0x55f687f03710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:38.804 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.795+0000 7fe9e4a33740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f687f632a0 con 0x55f687efd4f0 2024-09-13T17:14:38.804 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.795+0000 7fe9e4a33740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f687f633e0 con 0x55f687ef2330 2024-09-13T17:14:38.804 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.795+0000 7fe9e4a33740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f687f63520 con 0x55f687ef2c50 2024-09-13T17:14:38.805 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.795+0000 7fe9db7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f687ef2330 0x55f687f02c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:38.805 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.795+0000 7fe9db7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f687ef2330 0x55f687f02c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.87:47920/0 (socket says 172.21.15.87:47920) 2024-09-13T17:14:38.805 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.795+0000 7fe9db7fe640 1 -- 172.21.15.87:0/2447457566 learned_addr learned my addr 172.21.15.87:0/2447457566 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:38.805 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.795+0000 7fe9e4a33740 10 client.0 _ll_register_callbacks cb 0x7fe9cc0d4630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:14:38.805 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.795+0000 7fe9daffd640 1 --2- 172.21.15.87:0/2447457566 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f687ef2c50 0x55f687f031d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:38.805 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.795+0000 7fe9dbfff640 1 --2- 172.21.15.87:0/2447457566 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f687efd4f0 0x55f687f03710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:38.805 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.796+0000 7fe9db7fe640 1 -- 172.21.15.87:0/2447457566 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f687ef2c50 msgr2=0x55f687f031d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:38.805 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.796+0000 7fe9db7fe640 1 --2- 172.21.15.87:0/2447457566 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f687ef2c50 0x55f687f031d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.805 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.796+0000 7fe9db7fe640 1 -- 172.21.15.87:0/2447457566 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f687efd4f0 msgr2=0x55f687f03710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:38.805 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.796+0000 7fe9db7fe640 1 --2- 172.21.15.87:0/2447457566 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f687efd4f0 0x55f687f03710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.805 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.796+0000 7fe9db7fe640 1 -- 172.21.15.87:0/2447457566 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d4030cc0 con 0x55f687ef2330 2024-09-13T17:14:38.805 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.796+0000 7fe9dbfff640 1 --2- 172.21.15.87:0/2447457566 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f687efd4f0 0x55f687f03710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:14:38.806 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.796+0000 7fe9db7fe640 1 --2- 172.21.15.87:0/2447457566 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f687ef2330 0x55f687f02c90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc07fe80 tx=0x7fe9cc004280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=285d159f4cf949a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:38.806 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.796+0000 7fe9baffd640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-09-13T17:14:38.806 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.796+0000 7fe9baffd640 1 -- 172.21.15.87:0/2447457566 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc09d1a0 con 0x55f687ef2330 2024-09-13T17:14:38.806 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.796+0000 7fe9baffd640 1 -- 172.21.15.87:0/2447457566 <== mon.2 v2:172.21.15.118:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fe9cc09df40 con 0x55f687ef2330 2024-09-13T17:14:38.806 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.796+0000 7fe9e4a33740 1 -- 172.21.15.87:0/2447457566 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe9cc09d380 con 0x55f687ef2330 2024-09-13T17:14:38.806 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.796+0000 7fe9baffd640 1 -- 172.21.15.87:0/2447457566 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9cc09d610 con 0x55f687ef2330 2024-09-13T17:14:38.806 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.797+0000 7fe9e4a33740 10 client.25322 fetch_fsmap learned FSMap version 24 2024-09-13T17:14:38.806 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.797+0000 7fe9e4a33740 1 -- 172.21.15.87:0/2447457566 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55f687e55330 con 0x55f687ef2330 2024-09-13T17:14:38.806 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.797+0000 7fe9baffd640 1 -- 172.21.15.87:0/2447457566 <== mon.2 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe9cc09d380 con 0x55f687ef2330 2024-09-13T17:14:38.806 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.798+0000 7fe9baffd640 1 -- 172.21.15.87:0/2447457566 <== mon.2 v2:172.21.15.118:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fe9cc099f50 con 0x55f687ef2330 2024-09-13T17:14:38.806 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.798+0000 7fe9e4a33740 10 client.25322 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:14:38.806 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.798+0000 7fe9e4a33740 10 client.25322 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-13T17:14:38.806 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.798+0000 7fe9e4a33740 20 client.25322 populate_metadata read hostname 'smithi087' 2024-09-13T17:14:38.807 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.798+0000 7fe9e4a33740 1 --2- 172.21.15.87:0/2447457566 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55f687f64a30 0x55f687f66e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:38.807 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.798+0000 7fe9e4a33740 4 client.25322 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T17:14:38.807 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.798+0000 7fe9e4a33740 1 -- 172.21.15.87:0/2447457566 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f687b4a300 con 0x55f687f64a30 2024-09-13T17:14:38.807 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.798+0000 7fe9daffd640 1 --2- 172.21.15.87:0/2447457566 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55f687f64a30 0x55f687f66e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:38.807 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.798+0000 7fe9baffd640 10 client.25322 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:38.807 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.798+0000 7fe9daffd640 1 --2- 172.21.15.87:0/2447457566 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55f687f64a30 0x55f687f66e20 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74fb9e5a92c5d5e6 server_cookie=56d69d8c6ca9cfc9 in_seq=0 out_seq=0 2024-09-13T17:14:38.808 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.802+0000 7fe9baffd640 1 -- 172.21.15.87:0/2447457566 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f687b4a300 con 0x55f687f64a30 2024-09-13T17:14:38.808 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.802+0000 7fe9baffd640 10 client.25322 handle_command_reply: tid=0 2024-09-13T17:14:38.808 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.802+0000 7fe9e4a33740 1 client.25322 shutdown 2024-09-13T17:14:38.808 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.802+0000 7fe9e4a33740 1 -- 172.21.15.87:0/2447457566 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f687ef2330 msgr2=0x55f687f02c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:38.809 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.802+0000 7fe9e4a33740 1 --2- 172.21.15.87:0/2447457566 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f687ef2330 0x55f687f02c90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc07fe80 tx=0x7fe9cc004280 comp rx=0 tx=0).stop 2024-09-13T17:14:38.809 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.802+0000 7fe9e4a33740 1 -- 172.21.15.87:0/2447457566 shutdown_connections 2024-09-13T17:14:38.809 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.802+0000 7fe9e4a33740 1 --2- 172.21.15.87:0/2447457566 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55f687f64a30 0x55f687f66e20 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.809 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.802+0000 7fe9e4a33740 1 --2- 172.21.15.87:0/2447457566 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f687efd4f0 0x55f687f03710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.809 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.802+0000 7fe9e4a33740 1 --2- 172.21.15.87:0/2447457566 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f687ef2c50 0x55f687f031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.809 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.802+0000 7fe9e4a33740 1 --2- 172.21.15.87:0/2447457566 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f687ef2330 0x55f687f02c90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.809 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.802+0000 7fe9e4a33740 1 -- 172.21.15.87:0/2447457566 >> 172.21.15.87:0/2447457566 conn(0x55f687eee8c0 msgr2=0x55f687f08cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:38.809 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.802+0000 7fe9baffd640 0 client.25322 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:38.809 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.802+0000 7fe9e4a33740 1 -- 172.21.15.87:0/2447457566 shutdown_connections 2024-09-13T17:14:38.809 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.802+0000 7fe9e4a33740 1 -- 172.21.15.87:0/2447457566 wait complete. 2024-09-13T17:14:38.809 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.802+0000 7fe9e4a33740 20 client.25322 trim_cache size 0 max 16384 2024-09-13T17:14:38.810 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout:{ 2024-09-13T17:14:38.810 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout: "message": "", 2024-09-13T17:14:38.810 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout: "return_code": 0 2024-09-13T17:14:38.810 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout:} 2024-09-13T17:14:38.811 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.803+0000 7fe9e1d11640 1 -- 172.21.15.87:0/3886448021 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe9c40a13a0 msgr2=0x7fe9c40a3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:38.811 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.803+0000 7fe9e1d11640 1 --2- 172.21.15.87:0/3886448021 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe9c40a13a0 0x7fe9c40a3860 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4004af0 tx=0x7fe9d403f040 comp rx=0 tx=0).stop 2024-09-13T17:14:38.811 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.803+0000 7fe9e1d11640 1 -- 172.21.15.87:0/3886448021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9dc0fff10 msgr2=0x7fe9dc194080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:38.811 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.803+0000 7fe9e1d11640 1 --2- 172.21.15.87:0/3886448021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9dc0fff10 0x7fe9dc194080 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc004650 tx=0x7fe9cc003da0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.811 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.803+0000 7fe9e1d11640 1 -- 172.21.15.87:0/3886448021 shutdown_connections 2024-09-13T17:14:38.811 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.803+0000 7fe9e1d11640 1 --2- 172.21.15.87:0/3886448021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9dc198960 0x7fe9dc198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.811 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.803+0000 7fe9e1d11640 1 --2- 172.21.15.87:0/3886448021 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe9c40a13a0 0x7fe9c40a3860 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.812 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.803+0000 7fe9e1d11640 1 --2- 172.21.15.87:0/3886448021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9dc105060 0x7fe9dc1945c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.812 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.803+0000 7fe9e1d11640 1 --2- 172.21.15.87:0/3886448021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9dc0fff10 0x7fe9dc194080 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:38.812 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.803+0000 7fe9e1d11640 1 -- 172.21.15.87:0/3886448021 >> 172.21.15.87:0/3886448021 conn(0x7fe9dc0fb9a0 msgr2=0x7fe9dc0fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:38.812 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.803+0000 7fe9e1d11640 1 -- 172.21.15.87:0/3886448021 shutdown_connections 2024-09-13T17:14:38.812 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:38.803+0000 7fe9e1d11640 1 -- 172.21.15.87:0/3886448021 wait complete. 2024-09-13T17:14:38.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:38 smithi149 ceph-mon[35496]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-13T17:14:38.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:38 smithi118 ceph-mon[34374]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-13T17:14:40.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:40 smithi087 ceph-mon[30934]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T17:14:40.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:40 smithi149 ceph-mon[35496]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T17:14:40.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:40 smithi118 ceph-mon[34374]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T17:14:41.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:41 smithi149 ceph-mon[35496]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-13T17:14:41.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:41 smithi118 ceph-mon[34374]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-13T17:14:41.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:41 smithi087 ceph-mon[30934]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-13T17:14:44.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:44 smithi087 ceph-mon[30934]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T17:14:44.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:44 smithi149 ceph-mon[35496]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T17:14:44.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:44 smithi118 ceph-mon[34374]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T17:14:46.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:46 smithi087 ceph-mon[30934]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T17:14:46.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:46 smithi149 ceph-mon[35496]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T17:14:46.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:46 smithi118 ceph-mon[34374]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-13T17:14:48.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:48 smithi087 ceph-mon[30934]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-13T17:14:48.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:48 smithi149 ceph-mon[35496]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-13T17:14:48.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:48 smithi118 ceph-mon[34374]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-13T17:14:50.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:50 smithi087 ceph-mon[30934]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T17:14:50.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:50 smithi149 ceph-mon[35496]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T17:14:50.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:50 smithi118 ceph-mon[34374]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T17:14:51.941 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.938+0000 7fc907f57640 1 -- 172.21.15.87:0/2665619710 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc900104c30 msgr2=0x7fc900105010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:51.941 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.938+0000 7fc907f57640 1 --2- 172.21.15.87:0/2665619710 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc900104c30 0x7fc900105010 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc009930 tx=0x7fc8fc02a420 comp rx=0 tx=0).stop 2024-09-13T17:14:51.941 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.938+0000 7fc907f57640 1 -- 172.21.15.87:0/2665619710 shutdown_connections 2024-09-13T17:14:51.941 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.938+0000 7fc907f57640 1 --2- 172.21.15.87:0/2665619710 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9000ff970 0x7fc90010ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.941 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.938+0000 7fc907f57640 1 --2- 172.21.15.87:0/2665619710 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9000feff0 0x7fc9000ff430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.941 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.938+0000 7fc907f57640 1 --2- 172.21.15.87:0/2665619710 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc900104c30 0x7fc900105010 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.941 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.938+0000 7fc907f57640 1 -- 172.21.15.87:0/2665619710 >> 172.21.15.87:0/2665619710 conn(0x7fc900074940 msgr2=0x7fc900074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:51.942 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.938+0000 7fc907f57640 1 -- 172.21.15.87:0/2665619710 shutdown_connections 2024-09-13T17:14:51.942 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.938+0000 7fc907f57640 1 -- 172.21.15.87:0/2665619710 wait complete. 2024-09-13T17:14:51.944 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.939+0000 7fc907f57640 1 Processor -- start 2024-09-13T17:14:51.944 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.939+0000 7fc907f57640 1 -- start start 2024-09-13T17:14:51.944 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.939+0000 7fc907f57640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9000feff0 0x7fc900197080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.944 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.939+0000 7fc907f57640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9000ff970 0x7fc9001975c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.944 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.939+0000 7fc907f57640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc900104c30 0x7fc9001a2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.944 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.939+0000 7fc907f57640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc900197e40 con 0x7fc9000ff970 2024-09-13T17:14:51.944 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.939+0000 7fc907f57640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9001a2640 con 0x7fc900104c30 2024-09-13T17:14:51.944 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.939+0000 7fc907f57640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9001a2780 con 0x7fc9000feff0 2024-09-13T17:14:51.945 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.940+0000 7fc9054f2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9000ff970 0x7fc9001975c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.945 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.940+0000 7fc9054f2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9000ff970 0x7fc9001975c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44512/0 (socket says 172.21.15.87:44512) 2024-09-13T17:14:51.945 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.940+0000 7fc9054f2640 1 -- 172.21.15.87:0/1100204176 learned_addr learned my addr 172.21.15.87:0/1100204176 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:51.945 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.940+0000 7fc905cf3640 1 --2- 172.21.15.87:0/1100204176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9000feff0 0x7fc900197080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.945 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.940+0000 7fc9064f4640 1 --2- 172.21.15.87:0/1100204176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc900104c30 0x7fc9001a2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.945 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.940+0000 7fc9054f2640 1 -- 172.21.15.87:0/1100204176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9000feff0 msgr2=0x7fc900197080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:51.945 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.940+0000 7fc9054f2640 1 --2- 172.21.15.87:0/1100204176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9000feff0 0x7fc900197080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.946 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.940+0000 7fc9054f2640 1 -- 172.21.15.87:0/1100204176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc900104c30 msgr2=0x7fc9001a2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:51.946 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.940+0000 7fc9054f2640 1 --2- 172.21.15.87:0/1100204176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc900104c30 0x7fc9001a2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.946 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.940+0000 7fc9054f2640 1 -- 172.21.15.87:0/1100204176 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8fc009560 con 0x7fc9000ff970 2024-09-13T17:14:51.946 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.940+0000 7fc9054f2640 1 --2- 172.21.15.87:0/1100204176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9000ff970 0x7fc9001975c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc8f000d950 tx=0x7fc8f000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:51.946 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.940+0000 7fc8f6ffd640 1 -- 172.21.15.87:0/1100204176 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0009bd0 con 0x7fc9000ff970 2024-09-13T17:14:51.946 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.940+0000 7fc907f57640 1 -- 172.21.15.87:0/1100204176 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9001a2a10 con 0x7fc9000ff970 2024-09-13T17:14:51.946 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.940+0000 7fc907f57640 1 -- 172.21.15.87:0/1100204176 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9001a2f70 con 0x7fc9000ff970 2024-09-13T17:14:51.946 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.940+0000 7fc8f6ffd640 1 -- 172.21.15.87:0/1100204176 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc8f0009d30 con 0x7fc9000ff970 2024-09-13T17:14:51.946 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.940+0000 7fc8f6ffd640 1 -- 172.21.15.87:0/1100204176 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f000f6b0 con 0x7fc9000ff970 2024-09-13T17:14:51.949 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.944+0000 7fc8f6ffd640 1 -- 172.21.15.87:0/1100204176 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 25) v1 ==== 136106+0+0 (secure 0 0 0) 0x7fc8f0005060 con 0x7fc9000ff970 2024-09-13T17:14:51.949 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.944+0000 7fc8f6ffd640 1 --2- 172.21.15.87:0/1100204176 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc8ec0a1320 0x7fc8ec0a37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.949 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.944+0000 7fc8f6ffd640 1 -- 172.21.15.87:0/1100204176 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fc8f00ccaf0 con 0x7fc9000ff970 2024-09-13T17:14:51.949 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.944+0000 7fc905cf3640 1 --2- 172.21.15.87:0/1100204176 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc8ec0a1320 0x7fc8ec0a37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.949 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.945+0000 7fc90ac7a740 1 Processor -- start 2024-09-13T17:14:51.949 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.945+0000 7fc905cf3640 1 --2- 172.21.15.87:0/1100204176 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc8ec0a1320 0x7fc8ec0a37e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc005ab0 tx=0x7fc8fc005a20 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:51.950 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.945+0000 7fc90ac7a740 1 -- start start 2024-09-13T17:14:51.950 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.945+0000 7fc90ac7a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56308a555330 0x56308a555710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.950 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.945+0000 7fc90ac7a740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56308a555c50 0x56308a55ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.950 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.945+0000 7fc90ac7a740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56308a5604f0 0x56308a5628e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.950 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.946+0000 7fc90ac7a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56308a4c0c30 con 0x56308a555330 2024-09-13T17:14:51.950 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.946+0000 7fc90ac7a740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56308a4be3c0 con 0x56308a555c50 2024-09-13T17:14:51.950 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.946+0000 7fc90ac7a740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56308a4b9cb0 con 0x56308a5604f0 2024-09-13T17:14:51.950 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.946+0000 7fc905cf3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56308a555330 0x56308a555710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.950 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.946+0000 7fc905cf3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56308a555330 0x56308a555710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44520/0 (socket says 172.21.15.87:44520) 2024-09-13T17:14:51.950 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.946+0000 7fc905cf3640 1 -- 172.21.15.87:0/3433551226 learned_addr learned my addr 172.21.15.87:0/3433551226 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:51.950 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.946+0000 7fc9054f2640 1 --2- 172.21.15.87:0/3433551226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56308a555c50 0x56308a55ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.950 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.946+0000 7fc9064f4640 1 --2- 172.21.15.87:0/3433551226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56308a5604f0 0x56308a5628e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.950 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.946+0000 7fc905cf3640 1 -- 172.21.15.87:0/3433551226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56308a5604f0 msgr2=0x56308a5628e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:51.951 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.946+0000 7fc905cf3640 1 --2- 172.21.15.87:0/3433551226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56308a5604f0 0x56308a5628e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.951 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.946+0000 7fc905cf3640 1 -- 172.21.15.87:0/3433551226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56308a555c50 msgr2=0x56308a55ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:51.951 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.946+0000 7fc905cf3640 1 --2- 172.21.15.87:0/3433551226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56308a555c50 0x56308a55ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.951 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.946+0000 7fc905cf3640 1 -- 172.21.15.87:0/3433551226 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56308a460910 con 0x56308a555330 2024-09-13T17:14:51.951 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.946+0000 7fc9054f2640 1 --2- 172.21.15.87:0/3433551226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56308a555c50 0x56308a55ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:14:51.951 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.946+0000 7fc905cf3640 1 --2- 172.21.15.87:0/3433551226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56308a555330 0x56308a555710 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc005ec0 tx=0x7fc8fc03e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e729681d0242aea2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:51.951 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.947+0000 7fc8ebfff640 1 -- 172.21.15.87:0/3433551226 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc0044c0 con 0x56308a555330 2024-09-13T17:14:51.951 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.947+0000 7fc8ebfff640 1 -- 172.21.15.87:0/3433551226 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc8fc040070 con 0x56308a555330 2024-09-13T17:14:51.951 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.947+0000 7fc8ebfff640 1 -- 172.21.15.87:0/3433551226 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc003c90 con 0x56308a555330 2024-09-13T17:14:51.958 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.948+0000 7fc90ac7a740 1 -- 172.21.15.87:0/3433551226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56308a555330 msgr2=0x56308a555710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:51.958 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.948+0000 7fc90ac7a740 1 --2- 172.21.15.87:0/3433551226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56308a555330 0x56308a555710 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc005ec0 tx=0x7fc8fc03e000 comp rx=0 tx=0).stop 2024-09-13T17:14:51.958 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.948+0000 7fc90ac7a740 1 -- 172.21.15.87:0/3433551226 shutdown_connections 2024-09-13T17:14:51.958 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.948+0000 7fc90ac7a740 1 --2- 172.21.15.87:0/3433551226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56308a5604f0 0x56308a5628e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.958 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.948+0000 7fc90ac7a740 1 --2- 172.21.15.87:0/3433551226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56308a555c50 0x56308a55ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.958 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.948+0000 7fc90ac7a740 1 --2- 172.21.15.87:0/3433551226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56308a555330 0x56308a555710 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.958 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.948+0000 7fc90ac7a740 1 -- 172.21.15.87:0/3433551226 >> 172.21.15.87:0/3433551226 conn(0x56308a5518c0 msgr2=0x56308a551ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:51.958 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.948+0000 7fc90ac7a740 1 -- 172.21.15.87:0/3433551226 shutdown_connections 2024-09-13T17:14:51.959 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.948+0000 7fc90ac7a740 1 -- 172.21.15.87:0/3433551226 wait complete. 2024-09-13T17:14:51.959 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.948+0000 7fc90ac7a740 1 -- start start 2024-09-13T17:14:51.959 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.948+0000 7fc90ac7a740 1 Processor -- start 2024-09-13T17:14:51.959 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.949+0000 7fc90ac7a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56308a555330 0x56308a55fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.959 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.949+0000 7fc905cf3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56308a555330 0x56308a55fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.959 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.949+0000 7fc905cf3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56308a555330 0x56308a55fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44528/0 (socket says 172.21.15.87:44528) 2024-09-13T17:14:51.959 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.949+0000 7fc905cf3640 1 -- 172.21.15.87:0/1427885286 learned_addr learned my addr 172.21.15.87:0/1427885286 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:51.959 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.949+0000 7fc90ac7a740 1 --2- 172.21.15.87:0/1427885286 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56308a555c50 0x56308a55d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.959 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.949+0000 7fc90ac7a740 1 --2- 172.21.15.87:0/1427885286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56308a5604f0 0x56308a55d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.959 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.949+0000 7fc90ac7a740 1 -- 172.21.15.87:0/1427885286 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56308a477e80 con 0x56308a555330 2024-09-13T17:14:51.960 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.949+0000 7fc90ac7a740 1 -- 172.21.15.87:0/1427885286 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56308a477b20 con 0x56308a5604f0 2024-09-13T17:14:51.960 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.949+0000 7fc90ac7a740 1 -- 172.21.15.87:0/1427885286 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56308a43d260 con 0x56308a555c50 2024-09-13T17:14:51.960 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.949+0000 7fc90ac7a740 10 client.0 _ll_register_callbacks cb 0x56308a472df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:14:51.960 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.950+0000 7fc9054f2640 1 --2- 172.21.15.87:0/1427885286 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56308a555c50 0x56308a55d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.960 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.950+0000 7fc9064f4640 1 --2- 172.21.15.87:0/1427885286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56308a5604f0 0x56308a55d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.960 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.950+0000 7fc905cf3640 1 -- 172.21.15.87:0/1427885286 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56308a555c50 msgr2=0x56308a55d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:51.960 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.950+0000 7fc905cf3640 1 --2- 172.21.15.87:0/1427885286 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56308a555c50 0x56308a55d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.960 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.950+0000 7fc905cf3640 1 -- 172.21.15.87:0/1427885286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56308a5604f0 msgr2=0x56308a55d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:51.960 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.950+0000 7fc905cf3640 1 --2- 172.21.15.87:0/1427885286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56308a5604f0 0x56308a55d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.960 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.950+0000 7fc905cf3640 1 -- 172.21.15.87:0/1427885286 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc90010c340 con 0x56308a555330 2024-09-13T17:14:51.960 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.950+0000 7fc9054f2640 1 --2- 172.21.15.87:0/1427885286 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56308a555c50 0x56308a55d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:51.960 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.950+0000 7fc905cf3640 1 --2- 172.21.15.87:0/1427885286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56308a555330 0x56308a55fe40 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc02aa10 tx=0x7fc8fc0042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44732bc638b2460b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:51.960 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.950+0000 7fc8e97fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:14:51.961 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.950+0000 7fc8e97fa640 1 -- 172.21.15.87:0/1427885286 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc057040 con 0x56308a555330 2024-09-13T17:14:51.961 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.950+0000 7fc8e97fa640 1 -- 172.21.15.87:0/1427885286 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fc8fc042070 con 0x56308a555330 2024-09-13T17:14:51.961 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.950+0000 7fc90ac7a740 1 -- 172.21.15.87:0/1427885286 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56308a4e2680 con 0x56308a555330 2024-09-13T17:14:51.961 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.950+0000 7fc8e97fa640 1 -- 172.21.15.87:0/1427885286 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8fc04a740 con 0x56308a555330 2024-09-13T17:14:51.961 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.950+0000 7fc90ac7a740 10 client.15957 fetch_fsmap learned FSMap version 24 2024-09-13T17:14:51.961 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.950+0000 7fc90ac7a740 1 -- 172.21.15.87:0/1427885286 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x56308a4b8330 con 0x56308a555330 2024-09-13T17:14:51.961 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.951+0000 7fc8e97fa640 1 -- 172.21.15.87:0/1427885286 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc8fc04ad50 con 0x56308a555330 2024-09-13T17:14:51.961 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.951+0000 7fc8e97fa640 1 -- 172.21.15.87:0/1427885286 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc8fc045070 con 0x56308a555330 2024-09-13T17:14:51.961 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.951+0000 7fc90ac7a740 10 client.15957 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:14:51.961 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.951+0000 7fc90ac7a740 10 client.15957 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-13T17:14:51.961 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.951+0000 7fc90ac7a740 20 client.15957 populate_metadata read hostname 'smithi087' 2024-09-13T17:14:51.961 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.951+0000 7fc90ac7a740 1 --2- 172.21.15.87:0/1427885286 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56308a56fb80 0x56308a571fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.961 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.951+0000 7fc90ac7a740 4 client.15957 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:14:51.961 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.951+0000 7fc90ac7a740 1 -- 172.21.15.87:0/1427885286 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56308a4e2680 con 0x56308a56fb80 2024-09-13T17:14:51.962 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.951+0000 7fc9054f2640 1 --2- 172.21.15.87:0/1427885286 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56308a56fb80 0x56308a571fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.962 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.952+0000 7fc8e97fa640 10 client.15957 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:51.962 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.952+0000 7fc9054f2640 1 --2- 172.21.15.87:0/1427885286 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56308a56fb80 0x56308a571fa0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e06af4709a03f25a server_cookie=20425e0dc950bcca in_seq=0 out_seq=0 2024-09-13T17:14:51.962 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.952+0000 7fc8e97fa640 1 -- 172.21.15.87:0/1427885286 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x56308a4e2680 con 0x56308a56fb80 2024-09-13T17:14:51.962 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.952+0000 7fc8e97fa640 10 client.15957 handle_command_reply: tid=0 2024-09-13T17:14:51.962 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.953+0000 7fc90ac7a740 1 client.15957 shutdown 2024-09-13T17:14:51.962 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.953+0000 7fc90ac7a740 1 -- 172.21.15.87:0/1427885286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56308a555330 msgr2=0x56308a55fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:51.962 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.953+0000 7fc90ac7a740 1 --2- 172.21.15.87:0/1427885286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56308a555330 0x56308a55fe40 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc02aa10 tx=0x7fc8fc0042c0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.962 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.953+0000 7fc90ac7a740 1 -- 172.21.15.87:0/1427885286 shutdown_connections 2024-09-13T17:14:51.962 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.953+0000 7fc90ac7a740 1 --2- 172.21.15.87:0/1427885286 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56308a56fb80 0x56308a571fa0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.962 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.953+0000 7fc90ac7a740 1 --2- 172.21.15.87:0/1427885286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56308a5604f0 0x56308a55d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.962 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.953+0000 7fc8e97fa640 0 client.15957 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.953+0000 7fc90ac7a740 1 --2- 172.21.15.87:0/1427885286 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56308a555c50 0x56308a55d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.953+0000 7fc90ac7a740 1 --2- 172.21.15.87:0/1427885286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56308a555330 0x56308a55fe40 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.953+0000 7fc90ac7a740 1 -- 172.21.15.87:0/1427885286 >> 172.21.15.87:0/1427885286 conn(0x56308a5518c0 msgr2=0x56308a550b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.953+0000 7fc90ac7a740 1 -- 172.21.15.87:0/1427885286 shutdown_connections 2024-09-13T17:14:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.953+0000 7fc90ac7a740 1 -- 172.21.15.87:0/1427885286 wait complete. 2024-09-13T17:14:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.953+0000 7fc90ac7a740 20 client.15957 trim_cache size 0 max 16384 2024-09-13T17:14:51.982 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.977+0000 7fc90ac7a740 1 Processor -- start 2024-09-13T17:14:51.982 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.977+0000 7fc90ac7a740 1 -- start start 2024-09-13T17:14:51.982 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.977+0000 7fc90ac7a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56308a555330 0x56308a55f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.982 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.977+0000 7fc90ac7a740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56308a555c50 0x56308a55b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.982 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.978+0000 7fc90ac7a740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56308a5604f0 0x56308a55bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.982 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.978+0000 7fc90ac7a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56308a55c460 con 0x56308a555330 2024-09-13T17:14:51.982 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.978+0000 7fc90ac7a740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56308a56cb30 con 0x56308a555c50 2024-09-13T17:14:51.982 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.978+0000 7fc90ac7a740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56308a55b660 con 0x56308a5604f0 2024-09-13T17:14:51.982 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.978+0000 7fc905cf3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56308a555330 0x56308a55f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.982 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.978+0000 7fc905cf3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56308a555330 0x56308a55f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44536/0 (socket says 172.21.15.87:44536) 2024-09-13T17:14:51.982 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.978+0000 7fc905cf3640 1 -- 172.21.15.87:0/2210885847 learned_addr learned my addr 172.21.15.87:0/2210885847 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:51.983 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.978+0000 7fc9064f4640 1 --2- 172.21.15.87:0/2210885847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56308a5604f0 0x56308a55bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.983 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.978+0000 7fc9054f2640 1 --2- 172.21.15.87:0/2210885847 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56308a555c50 0x56308a55b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.983 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.978+0000 7fc905cf3640 1 -- 172.21.15.87:0/2210885847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56308a5604f0 msgr2=0x56308a55bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:51.983 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.978+0000 7fc905cf3640 1 --2- 172.21.15.87:0/2210885847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56308a5604f0 0x56308a55bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.983 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.978+0000 7fc905cf3640 1 -- 172.21.15.87:0/2210885847 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56308a555c50 msgr2=0x56308a55b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:51.983 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.978+0000 7fc905cf3640 1 --2- 172.21.15.87:0/2210885847 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56308a555c50 0x56308a55b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.983 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.978+0000 7fc905cf3640 1 -- 172.21.15.87:0/2210885847 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56308a45a300 con 0x56308a555330 2024-09-13T17:14:51.983 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.978+0000 7fc9064f4640 1 --2- 172.21.15.87:0/2210885847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56308a5604f0 0x56308a55bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:51.983 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.978+0000 7fc905cf3640 1 --2- 172.21.15.87:0/2210885847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56308a555330 0x56308a55f950 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc005ec0 tx=0x7fc8fc005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff2f55377c4de06f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:51.983 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.978+0000 7fc8f4ff9640 1 -- 172.21.15.87:0/2210885847 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc057040 con 0x56308a555330 2024-09-13T17:14:51.983 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.979+0000 7fc8f4ff9640 1 -- 172.21.15.87:0/2210885847 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc8fc004330 con 0x56308a555330 2024-09-13T17:14:51.984 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.979+0000 7fc8f4ff9640 1 -- 172.21.15.87:0/2210885847 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc05baf0 con 0x56308a555330 2024-09-13T17:14:51.984 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.979+0000 7fc90ac7a740 1 -- 172.21.15.87:0/2210885847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56308a555330 msgr2=0x56308a55f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:51.984 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.980+0000 7fc90ac7a740 1 --2- 172.21.15.87:0/2210885847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56308a555330 0x56308a55f950 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc005ec0 tx=0x7fc8fc005c00 comp rx=0 tx=0).stop 2024-09-13T17:14:51.984 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.980+0000 7fc90ac7a740 1 -- 172.21.15.87:0/2210885847 shutdown_connections 2024-09-13T17:14:51.984 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.980+0000 7fc90ac7a740 1 --2- 172.21.15.87:0/2210885847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56308a5604f0 0x56308a55bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.984 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.980+0000 7fc90ac7a740 1 --2- 172.21.15.87:0/2210885847 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56308a555c50 0x56308a55b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.984 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.980+0000 7fc90ac7a740 1 --2- 172.21.15.87:0/2210885847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56308a555330 0x56308a55f950 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.984 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.980+0000 7fc90ac7a740 1 -- 172.21.15.87:0/2210885847 >> 172.21.15.87:0/2210885847 conn(0x56308a5518c0 msgr2=0x56308a5583d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:51.984 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.980+0000 7fc90ac7a740 1 -- 172.21.15.87:0/2210885847 shutdown_connections 2024-09-13T17:14:51.984 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.980+0000 7fc90ac7a740 1 -- 172.21.15.87:0/2210885847 wait complete. 2024-09-13T17:14:51.988 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.980+0000 7fc90ac7a740 1 -- start start 2024-09-13T17:14:51.988 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.980+0000 7fc90ac7a740 1 Processor -- start 2024-09-13T17:14:51.988 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.981+0000 7fc90ac7a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56308a555330 0x56308a563ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.988 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.981+0000 7fc90ac7a740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56308a555c50 0x56308a5640e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.988 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.981+0000 7fc90ac7a740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56308a5604f0 0x56308a564620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.988 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.981+0000 7fc905cf3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56308a555330 0x56308a563ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.989 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.981+0000 7fc905cf3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56308a555330 0x56308a563ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44552/0 (socket says 172.21.15.87:44552) 2024-09-13T17:14:51.989 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.981+0000 7fc905cf3640 1 -- 172.21.15.87:0/435554176 learned_addr learned my addr 172.21.15.87:0/435554176 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:51.989 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.981+0000 7fc90ac7a740 1 -- 172.21.15.87:0/435554176 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56308a5c6060 con 0x56308a555330 2024-09-13T17:14:51.989 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.981+0000 7fc90ac7a740 1 -- 172.21.15.87:0/435554176 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56308a5c61a0 con 0x56308a5604f0 2024-09-13T17:14:51.989 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.981+0000 7fc9054f2640 1 --2- 172.21.15.87:0/435554176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56308a555c50 0x56308a5640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.989 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.981+0000 7fc90ac7a740 1 -- 172.21.15.87:0/435554176 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56308a5c62e0 con 0x56308a555c50 2024-09-13T17:14:51.989 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.981+0000 7fc9064f4640 1 --2- 172.21.15.87:0/435554176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56308a5604f0 0x56308a564620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.989 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.981+0000 7fc90ac7a740 10 client.0 _ll_register_callbacks cb 0x7fc8fc005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:14:51.990 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.981+0000 7fc905cf3640 1 -- 172.21.15.87:0/435554176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56308a555c50 msgr2=0x56308a5640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:51.990 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.981+0000 7fc905cf3640 1 --2- 172.21.15.87:0/435554176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56308a555c50 0x56308a5640e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.990 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.981+0000 7fc905cf3640 1 -- 172.21.15.87:0/435554176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56308a5604f0 msgr2=0x56308a564620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:51.990 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.981+0000 7fc905cf3640 1 --2- 172.21.15.87:0/435554176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56308a5604f0 0x56308a564620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.990 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.981+0000 7fc905cf3640 1 -- 172.21.15.87:0/435554176 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56308a4b8330 con 0x56308a555330 2024-09-13T17:14:51.990 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.982+0000 7fc905cf3640 1 --2- 172.21.15.87:0/435554176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56308a555330 0x56308a563ba0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc005890 tx=0x7fc8fc031c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=632a95ce74f9a728 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:51.990 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.982+0000 7fc8e97fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:14:51.990 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.982+0000 7fc8e97fa640 1 -- 172.21.15.87:0/435554176 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc057070 con 0x56308a555330 2024-09-13T17:14:51.990 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.982+0000 7fc8e97fa640 1 -- 172.21.15.87:0/435554176 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fc8fc042040 con 0x56308a555330 2024-09-13T17:14:51.990 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.982+0000 7fc90ac7a740 1 -- 172.21.15.87:0/435554176 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56308a4ad5d0 con 0x56308a555330 2024-09-13T17:14:51.990 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.982+0000 7fc8e97fa640 1 -- 172.21.15.87:0/435554176 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8fc05ba70 con 0x56308a555330 2024-09-13T17:14:51.990 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.982+0000 7fc90ac7a740 10 client.15963 fetch_fsmap learned FSMap version 24 2024-09-13T17:14:51.990 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.982+0000 7fc90ac7a740 1 -- 172.21.15.87:0/435554176 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x56308a47f8e0 con 0x56308a555330 2024-09-13T17:14:51.991 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.982+0000 7fc8e97fa640 1 -- 172.21.15.87:0/435554176 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc8fc05bbd0 con 0x56308a555330 2024-09-13T17:14:51.991 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.982+0000 7fc8e97fa640 1 -- 172.21.15.87:0/435554176 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc8fc045040 con 0x56308a555330 2024-09-13T17:14:51.991 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.983+0000 7fc90ac7a740 10 client.15963 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:14:51.991 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.983+0000 7fc90ac7a740 10 client.15963 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-13T17:14:51.991 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.983+0000 7fc90ac7a740 20 client.15963 populate_metadata read hostname 'smithi087' 2024-09-13T17:14:51.991 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.983+0000 7fc90ac7a740 1 --2- 172.21.15.87:0/435554176 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56308a5c7520 0x56308a5c9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:51.991 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.983+0000 7fc90ac7a740 4 client.15963 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T17:14:51.991 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.983+0000 7fc90ac7a740 1 -- 172.21.15.87:0/435554176 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56308a4ad5d0 con 0x56308a5c7520 2024-09-13T17:14:51.991 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.983+0000 7fc9054f2640 1 --2- 172.21.15.87:0/435554176 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56308a5c7520 0x56308a5c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:51.991 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.983+0000 7fc9054f2640 1 --2- 172.21.15.87:0/435554176 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56308a5c7520 0x56308a5c9910 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ba2e24096dd6a43 server_cookie=36f86a3b022ba1bd in_seq=0 out_seq=0 2024-09-13T17:14:51.991 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.983+0000 7fc8e97fa640 10 client.15963 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:51.992 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.987+0000 7fc8e97fa640 1 -- 172.21.15.87:0/435554176 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56308a4ad5d0 con 0x56308a5c7520 2024-09-13T17:14:51.993 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.987+0000 7fc8e97fa640 10 client.15963 handle_command_reply: tid=0 2024-09-13T17:14:51.993 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.987+0000 7fc90ac7a740 1 client.15963 shutdown 2024-09-13T17:14:51.993 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.987+0000 7fc90ac7a740 1 -- 172.21.15.87:0/435554176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56308a555330 msgr2=0x56308a563ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:51.993 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.987+0000 7fc90ac7a740 1 --2- 172.21.15.87:0/435554176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56308a555330 0x56308a563ba0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc005890 tx=0x7fc8fc031c50 comp rx=0 tx=0).stop 2024-09-13T17:14:51.993 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.987+0000 7fc90ac7a740 1 -- 172.21.15.87:0/435554176 shutdown_connections 2024-09-13T17:14:51.993 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.987+0000 7fc90ac7a740 1 --2- 172.21.15.87:0/435554176 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56308a5c7520 0x56308a5c9910 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.993 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.987+0000 7fc90ac7a740 1 --2- 172.21.15.87:0/435554176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56308a5604f0 0x56308a564620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.993 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.987+0000 7fc8e97fa640 0 client.15963 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:51.993 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.987+0000 7fc90ac7a740 1 --2- 172.21.15.87:0/435554176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56308a555c50 0x56308a5640e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.993 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.987+0000 7fc90ac7a740 1 --2- 172.21.15.87:0/435554176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56308a555330 0x56308a563ba0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.993 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.987+0000 7fc90ac7a740 1 -- 172.21.15.87:0/435554176 >> 172.21.15.87:0/435554176 conn(0x56308a5518c0 msgr2=0x56308a54ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:51.993 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.988+0000 7fc90ac7a740 1 -- 172.21.15.87:0/435554176 shutdown_connections 2024-09-13T17:14:51.994 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.988+0000 7fc90ac7a740 1 -- 172.21.15.87:0/435554176 wait complete. 2024-09-13T17:14:51.994 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.988+0000 7fc90ac7a740 20 client.15963 trim_cache size 0 max 16384 2024-09-13T17:14:51.994 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout:{ 2024-09-13T17:14:51.994 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout: "message": "", 2024-09-13T17:14:51.994 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout: "return_code": 0 2024-09-13T17:14:51.994 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout:} 2024-09-13T17:14:51.995 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.988+0000 7fc907f57640 1 -- 172.21.15.87:0/1100204176 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc8ec0a1320 msgr2=0x7fc8ec0a37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:51.995 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.988+0000 7fc907f57640 1 --2- 172.21.15.87:0/1100204176 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc8ec0a1320 0x7fc8ec0a37e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc005ab0 tx=0x7fc8fc005a20 comp rx=0 tx=0).stop 2024-09-13T17:14:51.995 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.988+0000 7fc907f57640 1 -- 172.21.15.87:0/1100204176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9000ff970 msgr2=0x7fc9001975c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:51.995 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.988+0000 7fc907f57640 1 --2- 172.21.15.87:0/1100204176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9000ff970 0x7fc9001975c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc8f000d950 tx=0x7fc8f000de10 comp rx=0 tx=0).stop 2024-09-13T17:14:51.995 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.988+0000 7fc907f57640 1 -- 172.21.15.87:0/1100204176 shutdown_connections 2024-09-13T17:14:51.995 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.988+0000 7fc907f57640 1 --2- 172.21.15.87:0/1100204176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc900104c30 0x7fc9001a2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.996 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.988+0000 7fc907f57640 1 --2- 172.21.15.87:0/1100204176 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc8ec0a1320 0x7fc8ec0a37e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.996 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.988+0000 7fc907f57640 1 --2- 172.21.15.87:0/1100204176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9000ff970 0x7fc9001975c0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.996 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.988+0000 7fc907f57640 1 --2- 172.21.15.87:0/1100204176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9000feff0 0x7fc900197080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:51.996 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.988+0000 7fc907f57640 1 -- 172.21.15.87:0/1100204176 >> 172.21.15.87:0/1100204176 conn(0x7fc900074940 msgr2=0x7fc9000fdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:51.996 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.988+0000 7fc907f57640 1 -- 172.21.15.87:0/1100204176 shutdown_connections 2024-09-13T17:14:51.997 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:14:51.989+0000 7fc907f57640 1 -- 172.21.15.87:0/1100204176 wait complete. 2024-09-13T17:14:52.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:52 smithi149 ceph-mon[35496]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-13T17:14:52.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:52 smithi118 ceph-mon[34374]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-13T17:14:52.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:52 smithi087 ceph-mon[30934]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-13T17:14:53.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:53 smithi149 ceph-mon[35496]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T17:14:53.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:53 smithi118 ceph-mon[34374]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T17:14:53.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:53 smithi087 ceph-mon[30934]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T17:14:56.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:56 smithi087 ceph-mon[30934]: pgmap v36: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-13T17:14:56.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:56 smithi149 ceph-mon[35496]: pgmap v36: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-13T17:14:56.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:56 smithi118 ceph-mon[34374]: pgmap v36: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-13T17:14:58.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:58 smithi087 ceph-mon[30934]: pgmap v37: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-13T17:14:58.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:58 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:14:58.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:58 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:14:58.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:58 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:14:58.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:58 smithi149 ceph-mon[35496]: pgmap v37: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-13T17:14:58.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:58 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:14:58.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:58 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:14:58.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:58 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:14:58.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:58 smithi118 ceph-mon[34374]: pgmap v37: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-13T17:14:58.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:58 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:14:58.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:58 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:14:58.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:58 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:14:59.485 INFO:tasks.workunit.client.0.smithi087.stderr:Updating files: 98% (12531/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-13T17:14:59.671 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:14:59.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:59 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:14:59.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:59 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:14:59.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:14:59 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:14:59.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.774+0000 7f29f4e9c640 1 -- 172.21.15.87:0/2380975036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29f00fee60 msgr2=0x7f29f00ff240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:59.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.774+0000 7f29f4e9c640 1 --2- 172.21.15.87:0/2380975036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29f00fee60 0x7f29f00ff240 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f29e0009930 tx=0x7f29e002a420 comp rx=0 tx=0).stop 2024-09-13T17:14:59.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.774+0000 7f29f4e9c640 1 -- 172.21.15.87:0/2380975036 shutdown_connections 2024-09-13T17:14:59.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.774+0000 7f29f4e9c640 1 --2- 172.21.15.87:0/2380975036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29f0103fb0 0x7f29f010bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.774+0000 7f29f4e9c640 1 --2- 172.21.15.87:0/2380975036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29f00ff810 0x7f29f0103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.774+0000 7f29f4e9c640 1 --2- 172.21.15.87:0/2380975036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29f00fee60 0x7f29f00ff240 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.774+0000 7f29f4e9c640 1 -- 172.21.15.87:0/2380975036 >> 172.21.15.87:0/2380975036 conn(0x7f29f0075c60 msgr2=0x7f29f00fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:59.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.774+0000 7f29f4e9c640 1 -- 172.21.15.87:0/2380975036 shutdown_connections 2024-09-13T17:14:59.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.774+0000 7f29f4e9c640 1 -- 172.21.15.87:0/2380975036 wait complete. 2024-09-13T17:14:59.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.775+0000 7f29f4e9c640 1 Processor -- start 2024-09-13T17:14:59.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.775+0000 7f29f4e9c640 1 -- start start 2024-09-13T17:14:59.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.775+0000 7f29f4e9c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29f00fee60 0x7f29f01951b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.775+0000 7f29f4e9c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29f0103fb0 0x7f29f01956f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.775+0000 7f29f4e9c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29f0199ae0 0x7f29f0199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.775+0000 7f29f4e9c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f019a4d0 con 0x7f29f0199ae0 2024-09-13T17:14:59.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.775+0000 7f29f4e9c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f019a640 con 0x7f29f00fee60 2024-09-13T17:14:59.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.775+0000 7f29f4e9c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f019a7b0 con 0x7f29f0103fb0 2024-09-13T17:14:59.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.775+0000 7f29eed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29f0199ae0 0x7f29f0199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.775+0000 7f29eed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29f0199ae0 0x7f29f0199f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33138/0 (socket says 172.21.15.87:33138) 2024-09-13T17:14:59.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.775+0000 7f29eed9d640 1 -- 172.21.15.87:0/1511614156 learned_addr learned my addr 172.21.15.87:0/1511614156 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:59.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.776+0000 7f29ee59c640 1 --2- 172.21.15.87:0/1511614156 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29f00fee60 0x7f29f01951b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.776+0000 7f29e7fff640 1 --2- 172.21.15.87:0/1511614156 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29f0103fb0 0x7f29f01956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.776+0000 7f29eed9d640 1 -- 172.21.15.87:0/1511614156 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29f0103fb0 msgr2=0x7f29f01956f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:59.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.776+0000 7f29eed9d640 1 --2- 172.21.15.87:0/1511614156 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29f0103fb0 0x7f29f01956f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.776+0000 7f29eed9d640 1 -- 172.21.15.87:0/1511614156 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29f00fee60 msgr2=0x7f29f01951b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:59.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.776+0000 7f29eed9d640 1 --2- 172.21.15.87:0/1511614156 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29f00fee60 0x7f29f01951b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.776+0000 7f29eed9d640 1 -- 172.21.15.87:0/1511614156 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e0009560 con 0x7f29f0199ae0 2024-09-13T17:14:59.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.776+0000 7f29e7fff640 1 --2- 172.21.15.87:0/1511614156 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29f0103fb0 0x7f29f01956f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:59.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.776+0000 7f29eed9d640 1 --2- 172.21.15.87:0/1511614156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29f0199ae0 0x7f29f0199f90 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f29e8007c30 tx=0x7f29e800e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:59.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.776+0000 7f29e77fe640 1 -- 172.21.15.87:0/1511614156 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e8011070 con 0x7f29f0199ae0 2024-09-13T17:14:59.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.776+0000 7f29e77fe640 1 -- 172.21.15.87:0/1511614156 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f29e800c810 con 0x7f29f0199ae0 2024-09-13T17:14:59.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.776+0000 7f29f4e9c640 1 -- 172.21.15.87:0/1511614156 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f00675a0 con 0x7f29f0199ae0 2024-09-13T17:14:59.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.776+0000 7f29e77fe640 1 -- 172.21.15.87:0/1511614156 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e80053e0 con 0x7f29f0199ae0 2024-09-13T17:14:59.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.776+0000 7f29f4e9c640 1 -- 172.21.15.87:0/1511614156 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f0067a50 con 0x7f29f0199ae0 2024-09-13T17:14:59.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.778+0000 7f29e77fe640 1 -- 172.21.15.87:0/1511614156 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 25) v1 ==== 136106+0+0 (secure 0 0 0) 0x7f29e80057b0 con 0x7f29f0199ae0 2024-09-13T17:14:59.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.779+0000 7f29e77fe640 1 --2- 172.21.15.87:0/1511614156 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f29dc0a13a0 0x7f29dc0a3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.779+0000 7f29ee59c640 1 --2- 172.21.15.87:0/1511614156 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f29dc0a13a0 0x7f29dc0a3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.779+0000 7f29e77fe640 1 -- 172.21.15.87:0/1511614156 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f29e80ceb70 con 0x7f29f0199ae0 2024-09-13T17:14:59.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.779+0000 7f29f7bc4740 1 Processor -- start 2024-09-13T17:14:59.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.779+0000 7f29ee59c640 1 --2- 172.21.15.87:0/1511614156 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f29dc0a13a0 0x7f29dc0a3860 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f29e0005ab0 tx=0x7f29e0005a20 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:59.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.780+0000 7f29f7bc4740 1 -- start start 2024-09-13T17:14:59.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.780+0000 7f29f7bc4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5584bd163e10 0x5584bd1641f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.780+0000 7f29f7bc4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584bd164730 0x5584bd16ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.780+0000 7f29f7bc4740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5584bd16efd0 0x5584bd1713c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.780+0000 7f29f7bc4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584bd0cef20 con 0x5584bd163e10 2024-09-13T17:14:59.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.780+0000 7f29f7bc4740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584bd0cc6b0 con 0x5584bd16efd0 2024-09-13T17:14:59.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.780+0000 7f29f7bc4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584bd0c7fa0 con 0x5584bd164730 2024-09-13T17:14:59.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.780+0000 7f29ee59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5584bd163e10 0x5584bd1641f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.780+0000 7f29ee59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5584bd163e10 0x5584bd1641f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33146/0 (socket says 172.21.15.87:33146) 2024-09-13T17:14:59.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.780+0000 7f29ee59c640 1 -- 172.21.15.87:0/4011441190 learned_addr learned my addr 172.21.15.87:0/4011441190 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:59.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.780+0000 7f29eed9d640 1 --2- 172.21.15.87:0/4011441190 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5584bd16efd0 0x5584bd1713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.780+0000 7f29e7fff640 1 --2- 172.21.15.87:0/4011441190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584bd164730 0x5584bd16ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.780+0000 7f29ee59c640 1 -- 172.21.15.87:0/4011441190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584bd164730 msgr2=0x5584bd16ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:59.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.780+0000 7f29ee59c640 1 --2- 172.21.15.87:0/4011441190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584bd164730 0x5584bd16ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.780+0000 7f29ee59c640 1 -- 172.21.15.87:0/4011441190 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5584bd16efd0 msgr2=0x5584bd1713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:59.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.780+0000 7f29ee59c640 1 --2- 172.21.15.87:0/4011441190 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5584bd16efd0 0x5584bd1713c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.780+0000 7f29ee59c640 1 -- 172.21.15.87:0/4011441190 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5584bd082840 con 0x5584bd163e10 2024-09-13T17:14:59.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.780+0000 7f29eed9d640 1 --2- 172.21.15.87:0/4011441190 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5584bd16efd0 0x5584bd1713c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:59.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.781+0000 7f29ee59c640 1 --2- 172.21.15.87:0/4011441190 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5584bd163e10 0x5584bd1641f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f29e0032fd0 tx=0x7f29e003e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e6b87d451ba006 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:59.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.781+0000 7f29e4ff9640 1 -- 172.21.15.87:0/4011441190 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e0031850 con 0x5584bd163e10 2024-09-13T17:14:59.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.781+0000 7f29e4ff9640 1 -- 172.21.15.87:0/4011441190 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f29e0040070 con 0x5584bd163e10 2024-09-13T17:14:59.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.781+0000 7f29e4ff9640 1 -- 172.21.15.87:0/4011441190 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e0048940 con 0x5584bd163e10 2024-09-13T17:14:59.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.781+0000 7f29f7bc4740 1 -- 172.21.15.87:0/4011441190 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5584bd163e10 msgr2=0x5584bd1641f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:59.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.781+0000 7f29f7bc4740 1 --2- 172.21.15.87:0/4011441190 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5584bd163e10 0x5584bd1641f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f29e0032fd0 tx=0x7f29e003e000 comp rx=0 tx=0).stop 2024-09-13T17:14:59.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.781+0000 7f29f7bc4740 1 -- 172.21.15.87:0/4011441190 shutdown_connections 2024-09-13T17:14:59.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.781+0000 7f29f7bc4740 1 --2- 172.21.15.87:0/4011441190 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5584bd16efd0 0x5584bd1713c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.781+0000 7f29f7bc4740 1 --2- 172.21.15.87:0/4011441190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584bd164730 0x5584bd16ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.781+0000 7f29f7bc4740 1 --2- 172.21.15.87:0/4011441190 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5584bd163e10 0x5584bd1641f0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.781+0000 7f29f7bc4740 1 -- 172.21.15.87:0/4011441190 >> 172.21.15.87:0/4011441190 conn(0x5584bd160380 msgr2=0x5584bd160760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:59.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.782+0000 7f29f7bc4740 1 -- 172.21.15.87:0/4011441190 shutdown_connections 2024-09-13T17:14:59.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.782+0000 7f29f7bc4740 1 -- 172.21.15.87:0/4011441190 wait complete. 2024-09-13T17:14:59.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.782+0000 7f29f7bc4740 1 -- start start 2024-09-13T17:14:59.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.782+0000 7f29f7bc4740 1 Processor -- start 2024-09-13T17:14:59.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.782+0000 7f29f7bc4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584bd163e10 0x5584bd16e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.782+0000 7f29f7bc4740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5584bd164730 0x5584bd16bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.782+0000 7f29f7bc4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5584bd16efd0 0x5584bd16c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.782+0000 7f29f7bc4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584bd0692a0 con 0x5584bd16efd0 2024-09-13T17:14:59.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.782+0000 7f29f7bc4740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584bcda0430 con 0x5584bd164730 2024-09-13T17:14:59.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.782+0000 7f29f7bc4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584bd04b680 con 0x5584bd163e10 2024-09-13T17:14:59.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.782+0000 7f29f7bc4740 10 client.0 _ll_register_callbacks cb 0x5584bd0c1610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:14:59.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.783+0000 7f29eed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5584bd16efd0 0x5584bd16c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.783+0000 7f29eed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5584bd16efd0 0x5584bd16c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33148/0 (socket says 172.21.15.87:33148) 2024-09-13T17:14:59.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.783+0000 7f29eed9d640 1 -- 172.21.15.87:0/3370607743 learned_addr learned my addr 172.21.15.87:0/3370607743 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:59.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.783+0000 7f29ee59c640 1 --2- 172.21.15.87:0/3370607743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584bd163e10 0x5584bd16e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.783+0000 7f29e7fff640 1 --2- 172.21.15.87:0/3370607743 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5584bd164730 0x5584bd16bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.783+0000 7f29eed9d640 1 -- 172.21.15.87:0/3370607743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584bd163e10 msgr2=0x5584bd16e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:59.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.783+0000 7f29eed9d640 1 --2- 172.21.15.87:0/3370607743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584bd163e10 0x5584bd16e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.783+0000 7f29eed9d640 1 -- 172.21.15.87:0/3370607743 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5584bd164730 msgr2=0x5584bd16bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:59.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.783+0000 7f29eed9d640 1 --2- 172.21.15.87:0/3370607743 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5584bd164730 0x5584bd16bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.783+0000 7f29eed9d640 1 -- 172.21.15.87:0/3370607743 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f010c340 con 0x5584bd16efd0 2024-09-13T17:14:59.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.783+0000 7f29ee59c640 1 --2- 172.21.15.87:0/3370607743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584bd163e10 0x5584bd16e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:59.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.783+0000 7f29e7fff640 1 --2- 172.21.15.87:0/3370607743 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5584bd164730 0x5584bd16bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:59.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.783+0000 7f29eed9d640 1 --2- 172.21.15.87:0/3370607743 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5584bd16efd0 0x5584bd16c2b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f29e8097c10 tx=0x7f29e809bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c3e68c059a690d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:59.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.783+0000 7f29d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:14:59.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.783+0000 7f29d5ffb640 1 -- 172.21.15.87:0/3370607743 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e80a3b00 con 0x5584bd16efd0 2024-09-13T17:14:59.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.783+0000 7f29d5ffb640 1 -- 172.21.15.87:0/3370607743 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f29e8097e20 con 0x5584bd16efd0 2024-09-13T17:14:59.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.783+0000 7f29f7bc4740 1 -- 172.21.15.87:0/3370607743 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5584bcdbb4e0 con 0x5584bd16efd0 2024-09-13T17:14:59.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.783+0000 7f29d5ffb640 1 -- 172.21.15.87:0/3370607743 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29e8097fe0 con 0x5584bd16efd0 2024-09-13T17:14:59.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.783+0000 7f29f7bc4740 10 client.15975 fetch_fsmap learned FSMap version 24 2024-09-13T17:14:59.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.783+0000 7f29f7bc4740 1 -- 172.21.15.87:0/3370607743 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5584bd0c6620 con 0x5584bd16efd0 2024-09-13T17:14:59.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.783+0000 7f29d5ffb640 1 -- 172.21.15.87:0/3370607743 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x5584bcdbb4e0 con 0x5584bd16efd0 2024-09-13T17:14:59.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.784+0000 7f29d5ffb640 1 -- 172.21.15.87:0/3370607743 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f29e801c030 con 0x5584bd16efd0 2024-09-13T17:14:59.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.784+0000 7f29f7bc4740 10 client.15975 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:14:59.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.784+0000 7f29f7bc4740 10 client.15975 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:14:59.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.784+0000 7f29f7bc4740 20 client.15975 populate_metadata read hostname 'smithi087' 2024-09-13T17:14:59.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.784+0000 7f29f7bc4740 1 --2- 172.21.15.87:0/3370607743 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5584bd17ee60 0x5584bd181250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.784+0000 7f29f7bc4740 4 client.15975 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:14:59.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.784+0000 7f29f7bc4740 1 -- 172.21.15.87:0/3370607743 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5584bcdcc7e0 con 0x5584bd17ee60 2024-09-13T17:14:59.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.784+0000 7f29ee59c640 1 --2- 172.21.15.87:0/3370607743 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5584bd17ee60 0x5584bd181250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.784+0000 7f29ee59c640 1 --2- 172.21.15.87:0/3370607743 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5584bd17ee60 0x5584bd181250 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd9169f2b543cf7a server_cookie=9a5f8de7853ee54f in_seq=0 out_seq=0 2024-09-13T17:14:59.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.784+0000 7f29d5ffb640 10 client.15975 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:59.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.785+0000 7f29d5ffb640 1 -- 172.21.15.87:0/3370607743 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5584bcdcc7e0 con 0x5584bd17ee60 2024-09-13T17:14:59.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.785+0000 7f29d5ffb640 10 client.15975 handle_command_reply: tid=0 2024-09-13T17:14:59.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.785+0000 7f29f7bc4740 1 client.15975 shutdown 2024-09-13T17:14:59.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.785+0000 7f29f7bc4740 1 -- 172.21.15.87:0/3370607743 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5584bd16efd0 msgr2=0x5584bd16c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:59.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.785+0000 7f29f7bc4740 1 --2- 172.21.15.87:0/3370607743 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5584bd16efd0 0x5584bd16c2b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f29e8097c10 tx=0x7f29e809bed0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.785+0000 7f29f7bc4740 1 -- 172.21.15.87:0/3370607743 shutdown_connections 2024-09-13T17:14:59.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.785+0000 7f29f7bc4740 1 --2- 172.21.15.87:0/3370607743 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5584bd17ee60 0x5584bd181250 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.785+0000 7f29f7bc4740 1 --2- 172.21.15.87:0/3370607743 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5584bd16efd0 0x5584bd16c2b0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.785+0000 7f29f7bc4740 1 --2- 172.21.15.87:0/3370607743 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5584bd164730 0x5584bd16bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.785+0000 7f29d5ffb640 0 client.15975 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:59.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.785+0000 7f29f7bc4740 1 --2- 172.21.15.87:0/3370607743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584bd163e10 0x5584bd16e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.785+0000 7f29f7bc4740 1 -- 172.21.15.87:0/3370607743 >> 172.21.15.87:0/3370607743 conn(0x5584bd160380 msgr2=0x5584bd15f510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:59.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.785+0000 7f29f7bc4740 1 -- 172.21.15.87:0/3370607743 shutdown_connections 2024-09-13T17:14:59.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.785+0000 7f29f7bc4740 1 -- 172.21.15.87:0/3370607743 wait complete. 2024-09-13T17:14:59.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.786+0000 7f29f7bc4740 20 client.15975 trim_cache size 0 max 16384 2024-09-13T17:14:59.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.800+0000 7f29f7bc4740 1 Processor -- start 2024-09-13T17:14:59.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.800+0000 7f29f7bc4740 1 -- start start 2024-09-13T17:14:59.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.800+0000 7f29f7bc4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5584bd160380 0x5584bd15fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.800+0000 7f29f7bc4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584bd163e10 0x5584bd175d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.800+0000 7f29f7bc4740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5584bd164730 0x5584bd176270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.800+0000 7f29f7bc4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584bcdbb4e0 con 0x5584bd160380 2024-09-13T17:14:59.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.800+0000 7f29f7bc4740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584bd16e5e0 con 0x5584bd164730 2024-09-13T17:14:59.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.800+0000 7f29f7bc4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584bd17ec90 con 0x5584bd163e10 2024-09-13T17:14:59.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.800+0000 7f29ee59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5584bd160380 0x5584bd15fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.800+0000 7f29ee59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5584bd160380 0x5584bd15fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33150/0 (socket says 172.21.15.87:33150) 2024-09-13T17:14:59.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.800+0000 7f29ee59c640 1 -- 172.21.15.87:0/3536193241 learned_addr learned my addr 172.21.15.87:0/3536193241 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:59.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.800+0000 7f29ee59c640 1 -- 172.21.15.87:0/3536193241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584bd163e10 msgr2=0x5584bd175d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:59.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.800+0000 7f29e7fff640 1 --2- 172.21.15.87:0/3536193241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584bd163e10 0x5584bd175d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.800+0000 7f29ee59c640 1 --2- 172.21.15.87:0/3536193241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584bd163e10 0x5584bd175d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.800+0000 7f29ee59c640 1 -- 172.21.15.87:0/3536193241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5584bd164730 msgr2=0x5584bd176270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:59.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.800+0000 7f29ee59c640 1 --2- 172.21.15.87:0/3536193241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5584bd164730 0x5584bd176270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.800+0000 7f29ee59c640 1 -- 172.21.15.87:0/3536193241 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5584bd068790 con 0x5584bd160380 2024-09-13T17:14:59.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.800+0000 7f29e7fff640 1 --2- 172.21.15.87:0/3536193241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584bd163e10 0x5584bd175d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:59.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.801+0000 7f29ee59c640 1 --2- 172.21.15.87:0/3536193241 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5584bd160380 0x5584bd15fd00 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f29e0033000 tx=0x7f29e0031e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f30ca8adbbffe6a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:59.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.801+0000 7f29e57fa640 1 -- 172.21.15.87:0/3536193241 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e0057040 con 0x5584bd160380 2024-09-13T17:14:59.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.801+0000 7f29e57fa640 1 -- 172.21.15.87:0/3536193241 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f29e005c860 con 0x5584bd160380 2024-09-13T17:14:59.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.801+0000 7f29e57fa640 1 -- 172.21.15.87:0/3536193241 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e0003b60 con 0x5584bd160380 2024-09-13T17:14:59.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.801+0000 7f29f7bc4740 1 -- 172.21.15.87:0/3536193241 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5584bd160380 msgr2=0x5584bd15fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:59.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.801+0000 7f29f7bc4740 1 --2- 172.21.15.87:0/3536193241 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5584bd160380 0x5584bd15fd00 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f29e0033000 tx=0x7f29e0031e80 comp rx=0 tx=0).stop 2024-09-13T17:14:59.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.802+0000 7f29f7bc4740 1 -- 172.21.15.87:0/3536193241 shutdown_connections 2024-09-13T17:14:59.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.802+0000 7f29f7bc4740 1 --2- 172.21.15.87:0/3536193241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5584bd164730 0x5584bd176270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.802+0000 7f29f7bc4740 1 --2- 172.21.15.87:0/3536193241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584bd163e10 0x5584bd175d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.802+0000 7f29f7bc4740 1 --2- 172.21.15.87:0/3536193241 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5584bd160380 0x5584bd15fd00 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.802+0000 7f29f7bc4740 1 -- 172.21.15.87:0/3536193241 >> 172.21.15.87:0/3536193241 conn(0x5584bd16eae0 msgr2=0x5584bd166f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:59.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.802+0000 7f29f7bc4740 1 -- 172.21.15.87:0/3536193241 shutdown_connections 2024-09-13T17:14:59.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.802+0000 7f29f7bc4740 1 -- 172.21.15.87:0/3536193241 wait complete. 2024-09-13T17:14:59.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.802+0000 7f29f7bc4740 1 -- start start 2024-09-13T17:14:59.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.802+0000 7f29f7bc4740 1 Processor -- start 2024-09-13T17:14:59.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.802+0000 7f29f7bc4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584bd160380 0x5584bd176070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.802+0000 7f29f7bc4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5584bd163e10 0x5584bd168660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.802+0000 7f29f7bc4740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5584bd164730 0x5584bd168ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.802+0000 7f29f7bc4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584bd169280 con 0x5584bd163e10 2024-09-13T17:14:59.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.802+0000 7f29f7bc4740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584bd1693f0 con 0x5584bd164730 2024-09-13T17:14:59.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.802+0000 7f29f7bc4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584bd1d5330 con 0x5584bd160380 2024-09-13T17:14:59.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.802+0000 7f29f7bc4740 10 client.0 _ll_register_callbacks cb 0x7f29e80973e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:14:59.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.802+0000 7f29e7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5584bd163e10 0x5584bd168660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.802+0000 7f29e7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5584bd163e10 0x5584bd168660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33154/0 (socket says 172.21.15.87:33154) 2024-09-13T17:14:59.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.802+0000 7f29e7fff640 1 -- 172.21.15.87:0/4172319818 learned_addr learned my addr 172.21.15.87:0/4172319818 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:59.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.803+0000 7f29ee59c640 1 --2- 172.21.15.87:0/4172319818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584bd160380 0x5584bd176070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.803+0000 7f29eed9d640 1 --2- 172.21.15.87:0/4172319818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5584bd164730 0x5584bd168ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.803+0000 7f29e7fff640 1 -- 172.21.15.87:0/4172319818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584bd160380 msgr2=0x5584bd176070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:59.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.803+0000 7f29e7fff640 1 --2- 172.21.15.87:0/4172319818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584bd160380 0x5584bd176070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.803+0000 7f29e7fff640 1 -- 172.21.15.87:0/4172319818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5584bd164730 msgr2=0x5584bd168ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:14:59.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.803+0000 7f29e7fff640 1 --2- 172.21.15.87:0/4172319818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5584bd164730 0x5584bd168ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.803+0000 7f29e7fff640 1 -- 172.21.15.87:0/4172319818 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5584bd082840 con 0x5584bd163e10 2024-09-13T17:14:59.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.803+0000 7f29ee59c640 1 --2- 172.21.15.87:0/4172319818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584bd160380 0x5584bd176070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:14:59.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.803+0000 7f29e7fff640 1 --2- 172.21.15.87:0/4172319818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5584bd163e10 0x5584bd168660 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f29f0196750 tx=0x7f29d80129b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9daa644644937d26 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:59.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.803+0000 7f29d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:14:59.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.803+0000 7f29d5ffb640 1 -- 172.21.15.87:0/4172319818 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d80107e0 con 0x5584bd163e10 2024-09-13T17:14:59.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.803+0000 7f29d5ffb640 1 -- 172.21.15.87:0/4172319818 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f29d8010940 con 0x5584bd163e10 2024-09-13T17:14:59.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.803+0000 7f29f7bc4740 1 -- 172.21.15.87:0/4172319818 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f29e0040070 con 0x5584bd163e10 2024-09-13T17:14:59.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.803+0000 7f29d5ffb640 1 -- 172.21.15.87:0/4172319818 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29d8010b00 con 0x5584bd163e10 2024-09-13T17:14:59.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.803+0000 7f29f7bc4740 10 client.15981 fetch_fsmap learned FSMap version 24 2024-09-13T17:14:59.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.803+0000 7f29f7bc4740 1 -- 172.21.15.87:0/4172319818 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5584bd08dea0 con 0x5584bd163e10 2024-09-13T17:14:59.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.803+0000 7f29d5ffb640 1 -- 172.21.15.87:0/4172319818 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f29e0040070 con 0x5584bd163e10 2024-09-13T17:14:59.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.804+0000 7f29d5ffb640 1 -- 172.21.15.87:0/4172319818 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f29d80193b0 con 0x5584bd163e10 2024-09-13T17:14:59.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.804+0000 7f29f7bc4740 10 client.15981 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:14:59.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.804+0000 7f29f7bc4740 10 client.15981 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:14:59.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.804+0000 7f29f7bc4740 20 client.15981 populate_metadata read hostname 'smithi087' 2024-09-13T17:14:59.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.804+0000 7f29f7bc4740 1 --2- 172.21.15.87:0/4172319818 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5584bd16efd0 0x5584bd1d8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.804+0000 7f29f7bc4740 4 client.15981 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:14:59.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.804+0000 7f29f7bc4740 1 -- 172.21.15.87:0/4172319818 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5584bce1fe30 con 0x5584bd16efd0 2024-09-13T17:14:59.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.804+0000 7f29ee59c640 1 --2- 172.21.15.87:0/4172319818 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5584bd16efd0 0x5584bd1d8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.804+0000 7f29d5ffb640 10 client.15981 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:59.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.804+0000 7f29ee59c640 1 --2- 172.21.15.87:0/4172319818 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5584bd16efd0 0x5584bd1d8980 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8da44e6885a0808a server_cookie=95fb5fb27ca4667c in_seq=0 out_seq=0 2024-09-13T17:14:59.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.805+0000 7f29d5ffb640 1 -- 172.21.15.87:0/4172319818 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5584bce1fe30 con 0x5584bd16efd0 2024-09-13T17:14:59.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.805+0000 7f29d5ffb640 10 client.15981 handle_command_reply: tid=0 2024-09-13T17:14:59.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.805+0000 7f29f7bc4740 1 client.15981 shutdown 2024-09-13T17:14:59.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.805+0000 7f29f7bc4740 1 -- 172.21.15.87:0/4172319818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5584bd163e10 msgr2=0x5584bd168660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:59.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.805+0000 7f29f7bc4740 1 --2- 172.21.15.87:0/4172319818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5584bd163e10 0x5584bd168660 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f29f0196750 tx=0x7f29d80129b0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.805+0000 7f29f7bc4740 1 -- 172.21.15.87:0/4172319818 shutdown_connections 2024-09-13T17:14:59.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.805+0000 7f29f7bc4740 1 --2- 172.21.15.87:0/4172319818 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5584bd16efd0 0x5584bd1d8980 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.805+0000 7f29f7bc4740 1 --2- 172.21.15.87:0/4172319818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5584bd164730 0x5584bd168ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.805+0000 7f29f7bc4740 1 --2- 172.21.15.87:0/4172319818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5584bd163e10 0x5584bd168660 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.805+0000 7f29f7bc4740 1 --2- 172.21.15.87:0/4172319818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584bd160380 0x5584bd176070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.805+0000 7f29d5ffb640 0 client.15981 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:14:59.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.805+0000 7f29f7bc4740 1 -- 172.21.15.87:0/4172319818 >> 172.21.15.87:0/4172319818 conn(0x5584bd16eae0 msgr2=0x5584bd165870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:59.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.805+0000 7f29f7bc4740 1 -- 172.21.15.87:0/4172319818 shutdown_connections 2024-09-13T17:14:59.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.805+0000 7f29f7bc4740 1 -- 172.21.15.87:0/4172319818 wait complete. 2024-09-13T17:14:59.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.805+0000 7f29f7bc4740 20 client.15981 trim_cache size 0 max 16384 2024-09-13T17:14:59.814 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:14:59.814 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "no active scrubs running", 2024-09-13T17:14:59.814 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": {} 2024-09-13T17:14:59.815 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:14:59.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.805+0000 7f29f4e9c640 1 -- 172.21.15.87:0/1511614156 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f29dc0a13a0 msgr2=0x7f29dc0a3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:59.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.805+0000 7f29f4e9c640 1 --2- 172.21.15.87:0/1511614156 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f29dc0a13a0 0x7f29dc0a3860 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f29e0005ab0 tx=0x7f29e0005a20 comp rx=0 tx=0).stop 2024-09-13T17:14:59.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.805+0000 7f29f4e9c640 1 -- 172.21.15.87:0/1511614156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29f0199ae0 msgr2=0x7f29f0199f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:59.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.805+0000 7f29f4e9c640 1 --2- 172.21.15.87:0/1511614156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29f0199ae0 0x7f29f0199f90 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f29e8007c30 tx=0x7f29e800e420 comp rx=0 tx=0).stop 2024-09-13T17:14:59.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.805+0000 7f29f4e9c640 1 -- 172.21.15.87:0/1511614156 shutdown_connections 2024-09-13T17:14:59.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.806+0000 7f29f4e9c640 1 --2- 172.21.15.87:0/1511614156 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f29dc0a13a0 0x7f29dc0a3860 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.806+0000 7f29f4e9c640 1 --2- 172.21.15.87:0/1511614156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29f0199ae0 0x7f29f0199f90 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.806+0000 7f29f4e9c640 1 --2- 172.21.15.87:0/1511614156 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29f0103fb0 0x7f29f01956f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.806+0000 7f29f4e9c640 1 --2- 172.21.15.87:0/1511614156 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29f00fee60 0x7f29f01951b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.806+0000 7f29f4e9c640 1 -- 172.21.15.87:0/1511614156 >> 172.21.15.87:0/1511614156 conn(0x7f29f0075c60 msgr2=0x7f29f0102300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:59.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.806+0000 7f29f4e9c640 1 -- 172.21.15.87:0/1511614156 shutdown_connections 2024-09-13T17:14:59.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.806+0000 7f29f4e9c640 1 -- 172.21.15.87:0/1511614156 wait complete. 2024-09-13T17:14:59.817 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T17:14:59.818 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:14:59.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:59 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:14:59.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:59 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:14:59.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:14:59 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:14:59.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:59 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:14:59.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:59 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:14:59.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:14:59 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:14:59.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.917+0000 7fb39a40d640 1 -- 172.21.15.87:0/2176386121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb39410c690 msgr2=0x7fb39410ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:59.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.917+0000 7fb39a40d640 1 --2- 172.21.15.87:0/2176386121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb39410c690 0x7fb39410ea80 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fb38c009ca0 tx=0x7fb38c02a8c0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.917+0000 7fb39a40d640 1 -- 172.21.15.87:0/2176386121 shutdown_connections 2024-09-13T17:14:59.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.917+0000 7fb39a40d640 1 --2- 172.21.15.87:0/2176386121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb39410c690 0x7fb39410ea80 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.917+0000 7fb39a40d640 1 --2- 172.21.15.87:0/2176386121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3940ff490 0x7fb39410c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.917+0000 7fb39a40d640 1 --2- 172.21.15.87:0/2176386121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3940feae0 0x7fb3940feec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.917+0000 7fb39a40d640 1 -- 172.21.15.87:0/2176386121 >> 172.21.15.87:0/2176386121 conn(0x7fb394075c60 msgr2=0x7fb3940fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:14:59.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.917+0000 7fb39a40d640 1 -- 172.21.15.87:0/2176386121 shutdown_connections 2024-09-13T17:14:59.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.917+0000 7fb39a40d640 1 -- 172.21.15.87:0/2176386121 wait complete. 2024-09-13T17:14:59.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.918+0000 7fb39a40d640 1 Processor -- start 2024-09-13T17:14:59.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.918+0000 7fb39a40d640 1 -- start start 2024-09-13T17:14:59.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.918+0000 7fb39a40d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3940feae0 0x7fb394198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.918+0000 7fb39a40d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3940ff490 0x7fb3941989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.918+0000 7fb39a40d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb39410c690 0x7fb39419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.918+0000 7fb39a40d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39419d3a0 con 0x7fb39410c690 2024-09-13T17:14:59.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.918+0000 7fb39a40d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39419d510 con 0x7fb3940ff490 2024-09-13T17:14:59.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.918+0000 7fb39a40d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39419d6d0 con 0x7fb3940feae0 2024-09-13T17:14:59.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.918+0000 7fb3989aa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb39410c690 0x7fb39419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.918+0000 7fb3989aa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb39410c690 0x7fb39419cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33168/0 (socket says 172.21.15.87:33168) 2024-09-13T17:14:59.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.918+0000 7fb3989aa640 1 -- 172.21.15.87:0/3533408692 learned_addr learned my addr 172.21.15.87:0/3533408692 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:14:59.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.918+0000 7fb38bfff640 1 --2- 172.21.15.87:0/3533408692 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3940ff490 0x7fb3941989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.918+0000 7fb393fff640 1 --2- 172.21.15.87:0/3533408692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3940feae0 0x7fb394198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.918+0000 7fb3989aa640 1 -- 172.21.15.87:0/3533408692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3940feae0 msgr2=0x7fb394198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:59.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.918+0000 7fb3989aa640 1 --2- 172.21.15.87:0/3533408692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3940feae0 0x7fb394198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.918+0000 7fb3989aa640 1 -- 172.21.15.87:0/3533408692 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3940ff490 msgr2=0x7fb3941989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:14:59.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.918+0000 7fb3989aa640 1 --2- 172.21.15.87:0/3533408692 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3940ff490 0x7fb3941989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:14:59.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.918+0000 7fb3989aa640 1 -- 172.21.15.87:0/3533408692 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb38c009900 con 0x7fb39410c690 2024-09-13T17:14:59.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.918+0000 7fb38bfff640 1 --2- 172.21.15.87:0/3533408692 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3940ff490 0x7fb3941989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:14:59.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.919+0000 7fb3989aa640 1 --2- 172.21.15.87:0/3533408692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb39410c690 0x7fb39419cda0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fb38c005e30 tx=0x7fb38c003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:59.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.919+0000 7fb391ffb640 1 -- 172.21.15.87:0/3533408692 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c031650 con 0x7fb39410c690 2024-09-13T17:14:59.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.919+0000 7fb39a40d640 1 -- 172.21.15.87:0/3533408692 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb39419d950 con 0x7fb39410c690 2024-09-13T17:14:59.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.919+0000 7fb391ffb640 1 -- 172.21.15.87:0/3533408692 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb38c040070 con 0x7fb39410c690 2024-09-13T17:14:59.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.919+0000 7fb391ffb640 1 -- 172.21.15.87:0/3533408692 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c004430 con 0x7fb39410c690 2024-09-13T17:14:59.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.919+0000 7fb39a40d640 1 -- 172.21.15.87:0/3533408692 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3941a5230 con 0x7fb39410c690 2024-09-13T17:14:59.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.920+0000 7fb39a40d640 1 -- 172.21.15.87:0/3533408692 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb394067e00 con 0x7fb39410c690 2024-09-13T17:14:59.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.921+0000 7fb391ffb640 1 -- 172.21.15.87:0/3533408692 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 25) v1 ==== 136106+0+0 (secure 0 0 0) 0x7fb38c042030 con 0x7fb39410c690 2024-09-13T17:14:59.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.922+0000 7fb391ffb640 1 --2- 172.21.15.87:0/3533408692 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb3800a1320 0x7fb3800a37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:14:59.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.922+0000 7fb393fff640 1 --2- 172.21.15.87:0/3533408692 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb3800a1320 0x7fb3800a37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:14:59.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.922+0000 7fb391ffb640 1 -- 172.21.15.87:0/3533408692 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fb38c0ee8d0 con 0x7fb39410c690 2024-09-13T17:14:59.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.922+0000 7fb393fff640 1 --2- 172.21.15.87:0/3533408692 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb3800a1320 0x7fb3800a37e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb384005fd0 tx=0x7fb384009470 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:14:59.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:14:59.929+0000 7fb391ffb640 1 -- 172.21.15.87:0/3533408692 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb38c0b7830 con 0x7fb39410c690 2024-09-13T17:15:00.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.133+0000 7fb39a40d640 1 -- 172.21.15.87:0/3533408692 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3940feec0 con 0x7fb39410c690 2024-09-13T17:15:00.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.134+0000 7fb391ffb640 1 -- 172.21.15.87:0/3533408692 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10877 (secure 0 0 0) 0x7fb38c0bae50 con 0x7fb39410c690 2024-09-13T17:15:00.135 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:15:00.136 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/3674545180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":3674545180},{"type":"v1","addr":"172.21.15.87:6841","nonce":3674545180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:11:23.313609+0000","modified":"2024-09-13T17:13:50.380502+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24484,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6839/3052680456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3052680456},{"type":"v1","addr":"172.21.15.118:6839","nonce":3052680456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:15:00.136 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 24 2024-09-13T17:15:00.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.136+0000 7fb39a40d640 1 -- 172.21.15.87:0/3533408692 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb3800a1320 msgr2=0x7fb3800a37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.136+0000 7fb39a40d640 1 --2- 172.21.15.87:0/3533408692 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb3800a1320 0x7fb3800a37e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb384005fd0 tx=0x7fb384009470 comp rx=0 tx=0).stop 2024-09-13T17:15:00.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.136+0000 7fb39a40d640 1 -- 172.21.15.87:0/3533408692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb39410c690 msgr2=0x7fb39419cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.136+0000 7fb39a40d640 1 --2- 172.21.15.87:0/3533408692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb39410c690 0x7fb39419cda0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fb38c005e30 tx=0x7fb38c003f90 comp rx=0 tx=0).stop 2024-09-13T17:15:00.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.136+0000 7fb39a40d640 1 -- 172.21.15.87:0/3533408692 shutdown_connections 2024-09-13T17:15:00.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.136+0000 7fb39a40d640 1 --2- 172.21.15.87:0/3533408692 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb3800a1320 0x7fb3800a37e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.136+0000 7fb39a40d640 1 --2- 172.21.15.87:0/3533408692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb39410c690 0x7fb39419cda0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.136+0000 7fb39a40d640 1 --2- 172.21.15.87:0/3533408692 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3940ff490 0x7fb3941989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.136+0000 7fb39a40d640 1 --2- 172.21.15.87:0/3533408692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3940feae0 0x7fb394198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.136+0000 7fb39a40d640 1 -- 172.21.15.87:0/3533408692 >> 172.21.15.87:0/3533408692 conn(0x7fb394075c60 msgr2=0x7fb3940fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:00.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.136+0000 7fb39a40d640 1 -- 172.21.15.87:0/3533408692 shutdown_connections 2024-09-13T17:15:00.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.136+0000 7fb39a40d640 1 -- 172.21.15.87:0/3533408692 wait complete. 2024-09-13T17:15:00.148 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-09-13T17:15:00.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.252+0000 7f76d295e640 1 -- 172.21.15.87:0/4066186076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76cc0fee60 msgr2=0x7f76cc0ff240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.252+0000 7f76d295e640 1 --2- 172.21.15.87:0/4066186076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76cc0fee60 0x7f76cc0ff240 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f76bc009930 tx=0x7f76bc02a420 comp rx=0 tx=0).stop 2024-09-13T17:15:00.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.252+0000 7f76d295e640 1 -- 172.21.15.87:0/4066186076 shutdown_connections 2024-09-13T17:15:00.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.252+0000 7f76d295e640 1 --2- 172.21.15.87:0/4066186076 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76cc103fb0 0x7f76cc10bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.252+0000 7f76d295e640 1 --2- 172.21.15.87:0/4066186076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76cc0ff810 0x7f76cc103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.252+0000 7f76d295e640 1 --2- 172.21.15.87:0/4066186076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76cc0fee60 0x7f76cc0ff240 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.252+0000 7f76d295e640 1 -- 172.21.15.87:0/4066186076 >> 172.21.15.87:0/4066186076 conn(0x7f76cc075c60 msgr2=0x7f76cc0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:00.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.252+0000 7f76d295e640 1 -- 172.21.15.87:0/4066186076 shutdown_connections 2024-09-13T17:15:00.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.252+0000 7f76d295e640 1 -- 172.21.15.87:0/4066186076 wait complete. 2024-09-13T17:15:00.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.253+0000 7f76d295e640 1 Processor -- start 2024-09-13T17:15:00.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.253+0000 7f76d295e640 1 -- start start 2024-09-13T17:15:00.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.253+0000 7f76d295e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76cc0fee60 0x7f76cc197070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.253+0000 7f76d295e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76cc103fb0 0x7f76cc1975b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.253+0000 7f76d295e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76cc197af0 0x7f76cc1a20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.253+0000 7f76d295e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc1a2790 con 0x7f76cc103fb0 2024-09-13T17:15:00.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.253+0000 7f76d295e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc1a2900 con 0x7f76cc0fee60 2024-09-13T17:15:00.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.253+0000 7f76d295e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc1a2ac0 con 0x7f76cc197af0 2024-09-13T17:15:00.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.253+0000 7f76c3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76cc103fb0 0x7f76cc1975b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.253+0000 7f76c3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76cc103fb0 0x7f76cc1975b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33190/0 (socket says 172.21.15.87:33190) 2024-09-13T17:15:00.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.253+0000 7f76c3fff640 1 -- 172.21.15.87:0/2303809732 learned_addr learned my addr 172.21.15.87:0/2303809732 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:00.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.253+0000 7f76cbfff640 1 --2- 172.21.15.87:0/2303809732 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76cc0fee60 0x7f76cc197070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.253+0000 7f76d0efb640 1 --2- 172.21.15.87:0/2303809732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76cc197af0 0x7f76cc1a20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.253+0000 7f76c3fff640 1 -- 172.21.15.87:0/2303809732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76cc197af0 msgr2=0x7f76cc1a20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.253+0000 7f76c3fff640 1 --2- 172.21.15.87:0/2303809732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76cc197af0 0x7f76cc1a20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.253+0000 7f76c3fff640 1 -- 172.21.15.87:0/2303809732 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76cc0fee60 msgr2=0x7f76cc197070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.253+0000 7f76c3fff640 1 --2- 172.21.15.87:0/2303809732 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76cc0fee60 0x7f76cc197070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.253+0000 7f76c3fff640 1 -- 172.21.15.87:0/2303809732 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76bc009560 con 0x7f76cc103fb0 2024-09-13T17:15:00.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.253+0000 7f76c3fff640 1 --2- 172.21.15.87:0/2303809732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76cc103fb0 0x7f76cc1975b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f76b400c970 tx=0x7f76b400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:00.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.254+0000 7f76c9ffb640 1 -- 172.21.15.87:0/2303809732 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b4004440 con 0x7f76cc103fb0 2024-09-13T17:15:00.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.254+0000 7f76d295e640 1 -- 172.21.15.87:0/2303809732 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76cc1a2da0 con 0x7f76cc103fb0 2024-09-13T17:15:00.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.254+0000 7f76c9ffb640 1 -- 172.21.15.87:0/2303809732 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f76b4007d10 con 0x7f76cc103fb0 2024-09-13T17:15:00.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.254+0000 7f76c9ffb640 1 -- 172.21.15.87:0/2303809732 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b400f450 con 0x7f76cc103fb0 2024-09-13T17:15:00.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.254+0000 7f76d295e640 1 -- 172.21.15.87:0/2303809732 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76cc1a3220 con 0x7f76cc103fb0 2024-09-13T17:15:00.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.256+0000 7f76c9ffb640 1 -- 172.21.15.87:0/2303809732 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 25) v1 ==== 136106+0+0 (secure 0 0 0) 0x7f76b40036f0 con 0x7f76cc103fb0 2024-09-13T17:15:00.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.256+0000 7f76d5684740 1 Processor -- start 2024-09-13T17:15:00.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.256+0000 7f76d5684740 1 -- start start 2024-09-13T17:15:00.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.256+0000 7f76d5684740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7467c2790 0x55c7467c2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.256+0000 7f76d5684740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c7467c30b0 0x55c7467cd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.256+0000 7f76d5684740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c7467cd950 0x55c7467cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.256+0000 7f76d5684740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c74672ccc0 con 0x55c7467c30b0 2024-09-13T17:15:00.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.256+0000 7f76d5684740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c74672a450 con 0x55c7467c2790 2024-09-13T17:15:00.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.256+0000 7f76d5684740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c746725d40 con 0x55c7467cd950 2024-09-13T17:15:00.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.257+0000 7f76cbfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c7467c30b0 0x55c7467cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.257+0000 7f76cbfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c7467c30b0 0x55c7467cd410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33202/0 (socket says 172.21.15.87:33202) 2024-09-13T17:15:00.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.257+0000 7f76cbfff640 1 -- 172.21.15.87:0/1515347540 learned_addr learned my addr 172.21.15.87:0/1515347540 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:00.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.257+0000 7f76c3fff640 1 --2- 172.21.15.87:0/1515347540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c7467cd950 0x55c7467cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.257+0000 7f76c9ffb640 1 --2- 172.21.15.87:0/2303809732 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f76b80a1320 0x7f76b80a37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.257+0000 7f76d0efb640 1 --2- 172.21.15.87:0/1515347540 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7467c2790 0x55c7467c2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.257+0000 7f76cbfff640 1 -- 172.21.15.87:0/1515347540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c7467cd950 msgr2=0x55c7467cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:00.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.257+0000 7f76cbfff640 1 --2- 172.21.15.87:0/1515347540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c7467cd950 0x55c7467cfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.257+0000 7f76cbfff640 1 -- 172.21.15.87:0/1515347540 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7467c2790 msgr2=0x55c7467c2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:00.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.257+0000 7f76cbfff640 1 --2- 172.21.15.87:0/1515347540 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7467c2790 0x55c7467c2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.257+0000 7f76cbfff640 1 -- 172.21.15.87:0/1515347540 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7466ed620 con 0x55c7467c30b0 2024-09-13T17:15:00.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.257+0000 7f76d0efb640 1 --2- 172.21.15.87:0/2303809732 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f76b80a1320 0x7f76b80a37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.257+0000 7f76c9ffb640 1 -- 172.21.15.87:0/2303809732 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f76b40cd4c0 con 0x7f76cc103fb0 2024-09-13T17:15:00.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.257+0000 7f76cbfff640 1 --2- 172.21.15.87:0/1515347540 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c7467c30b0 0x55c7467cd410 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0057c0 tx=0x7f76bc032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bdda9a31be32901 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:00.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.257+0000 7f76c27fc640 1 -- 172.21.15.87:0/1515347540 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc031cf0 con 0x55c7467c30b0 2024-09-13T17:15:00.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.257+0000 7f76c27fc640 1 -- 172.21.15.87:0/1515347540 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f76bc040070 con 0x55c7467c30b0 2024-09-13T17:15:00.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.257+0000 7f76c27fc640 1 -- 172.21.15.87:0/1515347540 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc003850 con 0x55c7467c30b0 2024-09-13T17:15:00.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.258+0000 7f76d5684740 1 -- 172.21.15.87:0/1515347540 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c7467c30b0 msgr2=0x55c7467cd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.258+0000 7f76d5684740 1 --2- 172.21.15.87:0/1515347540 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c7467c30b0 0x55c7467cd410 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0057c0 tx=0x7f76bc032dd0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.258+0000 7f76d0efb640 1 --2- 172.21.15.87:0/2303809732 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f76b80a1320 0x7f76b80a37e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f76c400ae60 tx=0x7f76c4004a40 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:00.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.258+0000 7f76d5684740 1 -- 172.21.15.87:0/1515347540 shutdown_connections 2024-09-13T17:15:00.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.258+0000 7f76d5684740 1 --2- 172.21.15.87:0/1515347540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c7467cd950 0x55c7467cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.258+0000 7f76d5684740 1 --2- 172.21.15.87:0/1515347540 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c7467c30b0 0x55c7467cd410 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.258+0000 7f76d5684740 1 --2- 172.21.15.87:0/1515347540 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7467c2790 0x55c7467c2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.258+0000 7f76d5684740 1 -- 172.21.15.87:0/1515347540 >> 172.21.15.87:0/1515347540 conn(0x55c7467bed00 msgr2=0x55c7467bf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:00.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.258+0000 7f76d5684740 1 -- 172.21.15.87:0/1515347540 shutdown_connections 2024-09-13T17:15:00.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.258+0000 7f76d5684740 1 -- 172.21.15.87:0/1515347540 wait complete. 2024-09-13T17:15:00.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.259+0000 7f76d5684740 1 -- start start 2024-09-13T17:15:00.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.259+0000 7f76d5684740 1 Processor -- start 2024-09-13T17:15:00.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.259+0000 7f76d5684740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7467c2790 0x55c7467ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.259+0000 7f76d5684740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c7467c30b0 0x55c7467ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.259+0000 7f76d5684740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c7467cd950 0x55c7467ca800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.259+0000 7f76d5684740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7466e4180 con 0x55c7467c30b0 2024-09-13T17:15:00.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.259+0000 7f76d5684740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7463fe430 con 0x55c7467c2790 2024-09-13T17:15:00.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.259+0000 7f76d5684740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7466a95e0 con 0x55c7467cd950 2024-09-13T17:15:00.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.259+0000 7f76d5684740 10 client.0 _ll_register_callbacks cb 0x55c746715aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:00.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.259+0000 7f76c3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c7467c30b0 0x55c7467ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.259+0000 7f76c3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c7467c30b0 0x55c7467ca2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33216/0 (socket says 172.21.15.87:33216) 2024-09-13T17:15:00.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.259+0000 7f76c3fff640 1 -- 172.21.15.87:0/952507097 learned_addr learned my addr 172.21.15.87:0/952507097 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:00.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.259+0000 7f76d0efb640 1 --2- 172.21.15.87:0/952507097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c7467cd950 0x55c7467ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.259+0000 7f76cbfff640 1 --2- 172.21.15.87:0/952507097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7467c2790 0x55c7467ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.259+0000 7f76c3fff640 1 -- 172.21.15.87:0/952507097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c7467cd950 msgr2=0x55c7467ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:00.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.259+0000 7f76c3fff640 1 --2- 172.21.15.87:0/952507097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c7467cd950 0x55c7467ca800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.259+0000 7f76c3fff640 1 -- 172.21.15.87:0/952507097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7467c2790 msgr2=0x55c7467ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:00.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.260+0000 7f76c3fff640 1 --2- 172.21.15.87:0/952507097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7467c2790 0x55c7467ccfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.260+0000 7f76c3fff640 1 -- 172.21.15.87:0/952507097 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76cc10c340 con 0x55c7467c30b0 2024-09-13T17:15:00.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.260+0000 7f76d0efb640 1 --2- 172.21.15.87:0/952507097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c7467cd950 0x55c7467ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:00.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.260+0000 7f76c3fff640 1 --2- 172.21.15.87:0/952507097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c7467c30b0 0x55c7467ca2c0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f76b4099f60 tx=0x7f76b4095cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be722b70793df08f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:00.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.260+0000 7f76ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:15:00.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.260+0000 7f76ab7fe640 1 -- 172.21.15.87:0/952507097 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b40adea0 con 0x55c7467c30b0 2024-09-13T17:15:00.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.260+0000 7f76ab7fe640 1 -- 172.21.15.87:0/952507097 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f76b409a230 con 0x55c7467c30b0 2024-09-13T17:15:00.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.260+0000 7f76d5684740 1 -- 172.21.15.87:0/952507097 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c74674fb80 con 0x55c7467c30b0 2024-09-13T17:15:00.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.260+0000 7f76ab7fe640 1 -- 172.21.15.87:0/952507097 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76b409a6d0 con 0x55c7467c30b0 2024-09-13T17:15:00.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.260+0000 7f76d5684740 10 client.15999 fetch_fsmap learned FSMap version 24 2024-09-13T17:15:00.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.260+0000 7f76d5684740 1 -- 172.21.15.87:0/952507097 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55c7467243c0 con 0x55c7467c30b0 2024-09-13T17:15:00.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.260+0000 7f76ab7fe640 1 -- 172.21.15.87:0/952507097 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55c74674fb80 con 0x55c7467c30b0 2024-09-13T17:15:00.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.260+0000 7f76ab7fe640 1 -- 172.21.15.87:0/952507097 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f76b40ca9c0 con 0x55c7467c30b0 2024-09-13T17:15:00.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.260+0000 7f76d5684740 10 client.15999 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:15:00.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.260+0000 7f76d5684740 10 client.15999 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:15:00.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.260+0000 7f76d5684740 20 client.15999 populate_metadata read hostname 'smithi087' 2024-09-13T17:15:00.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.260+0000 7f76d5684740 1 --2- 172.21.15.87:0/952507097 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55c7467dd0b0 0x55c7467df4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.260+0000 7f76d5684740 4 client.15999 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:15:00.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.260+0000 7f76d5684740 1 -- 172.21.15.87:0/952507097 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c7467181f0 con 0x55c7467dd0b0 2024-09-13T17:15:00.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.261+0000 7f76cbfff640 1 --2- 172.21.15.87:0/952507097 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55c7467dd0b0 0x55c7467df4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.261+0000 7f76ab7fe640 10 client.15999 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:15:00.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.261+0000 7f76cbfff640 1 --2- 172.21.15.87:0/952507097 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55c7467dd0b0 0x55c7467df4a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ed6f839932971ae9 server_cookie=c0f1a991efa3cef5 in_seq=0 out_seq=0 2024-09-13T17:15:00.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.262+0000 7f76ab7fe640 1 -- 172.21.15.87:0/952507097 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55c7467181f0 con 0x55c7467dd0b0 2024-09-13T17:15:00.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.262+0000 7f76ab7fe640 10 client.15999 handle_command_reply: tid=0 2024-09-13T17:15:00.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.262+0000 7f76d5684740 1 client.15999 shutdown 2024-09-13T17:15:00.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.262+0000 7f76d5684740 1 -- 172.21.15.87:0/952507097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c7467c30b0 msgr2=0x55c7467ca2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.262+0000 7f76d5684740 1 --2- 172.21.15.87:0/952507097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c7467c30b0 0x55c7467ca2c0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f76b4099f60 tx=0x7f76b4095cb0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.262+0000 7f76d5684740 1 -- 172.21.15.87:0/952507097 shutdown_connections 2024-09-13T17:15:00.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.262+0000 7f76d5684740 1 --2- 172.21.15.87:0/952507097 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55c7467dd0b0 0x55c7467df4a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.262+0000 7f76ab7fe640 0 client.15999 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:15:00.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.262+0000 7f76d5684740 1 --2- 172.21.15.87:0/952507097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c7467cd950 0x55c7467ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.262+0000 7f76d5684740 1 --2- 172.21.15.87:0/952507097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c7467c30b0 0x55c7467ca2c0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.262+0000 7f76d5684740 1 --2- 172.21.15.87:0/952507097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7467c2790 0x55c7467ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.262+0000 7f76d5684740 1 -- 172.21.15.87:0/952507097 >> 172.21.15.87:0/952507097 conn(0x55c7467bed00 msgr2=0x55c7467c4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:00.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.262+0000 7f76d5684740 1 -- 172.21.15.87:0/952507097 shutdown_connections 2024-09-13T17:15:00.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.262+0000 7f76d5684740 1 -- 172.21.15.87:0/952507097 wait complete. 2024-09-13T17:15:00.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.262+0000 7f76d5684740 20 client.15999 trim_cache size 0 max 16384 2024-09-13T17:15:00.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.273+0000 7f76d5684740 1 Processor -- start 2024-09-13T17:15:00.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.273+0000 7f76d5684740 1 -- start start 2024-09-13T17:15:00.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.273+0000 7f76d5684740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c7467c2790 0x55c7467be7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.273+0000 7f76d5684740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7467c30b0 0x55c7467ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.273+0000 7f76d5684740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c7467cd950 0x55c7467ca7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.273+0000 7f76d5684740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7467c2ea0 con 0x55c7467cd950 2024-09-13T17:15:00.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.273+0000 7f76d5684740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7467e4620 con 0x55c7467c30b0 2024-09-13T17:15:00.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.273+0000 7f76d5684740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7467d97e0 con 0x55c7467c2790 2024-09-13T17:15:00.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.274+0000 7f76d0efb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c7467cd950 0x55c7467ca7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.274+0000 7f76d0efb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c7467cd950 0x55c7467ca7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33230/0 (socket says 172.21.15.87:33230) 2024-09-13T17:15:00.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.274+0000 7f76d0efb640 1 -- 172.21.15.87:0/2456107459 learned_addr learned my addr 172.21.15.87:0/2456107459 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:00.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.274+0000 7f76cbfff640 1 --2- 172.21.15.87:0/2456107459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c7467c2790 0x55c7467be7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.274+0000 7f76c3fff640 1 --2- 172.21.15.87:0/2456107459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7467c30b0 0x55c7467ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.274+0000 7f76d0efb640 1 -- 172.21.15.87:0/2456107459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c7467c2790 msgr2=0x55c7467be7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:00.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.274+0000 7f76d0efb640 1 --2- 172.21.15.87:0/2456107459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c7467c2790 0x55c7467be7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.274+0000 7f76d0efb640 1 -- 172.21.15.87:0/2456107459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7467c30b0 msgr2=0x55c7467ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:00.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.274+0000 7f76d0efb640 1 --2- 172.21.15.87:0/2456107459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7467c30b0 0x55c7467ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.274+0000 7f76d0efb640 1 -- 172.21.15.87:0/2456107459 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7466c6770 con 0x55c7467cd950 2024-09-13T17:15:00.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.274+0000 7f76c3fff640 1 --2- 172.21.15.87:0/2456107459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7467c30b0 0x55c7467ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:00.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.274+0000 7f76d0efb640 1 --2- 172.21.15.87:0/2456107459 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c7467cd950 0x55c7467ca7c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f76c40125b0 tx=0x7f76c4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75299c0aa8e23af5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:00.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.274+0000 7f76c2ffd640 1 -- 172.21.15.87:0/2456107459 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c4026640 con 0x55c7467cd950 2024-09-13T17:15:00.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.274+0000 7f76c2ffd640 1 -- 172.21.15.87:0/2456107459 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f76c4026c50 con 0x55c7467cd950 2024-09-13T17:15:00.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.274+0000 7f76c2ffd640 1 -- 172.21.15.87:0/2456107459 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c401cba0 con 0x55c7467cd950 2024-09-13T17:15:00.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.275+0000 7f76d5684740 1 -- 172.21.15.87:0/2456107459 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c7467cd950 msgr2=0x55c7467ca7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.275+0000 7f76d5684740 1 --2- 172.21.15.87:0/2456107459 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c7467cd950 0x55c7467ca7c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f76c40125b0 tx=0x7f76c4013000 comp rx=0 tx=0).stop 2024-09-13T17:15:00.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.275+0000 7f76d5684740 1 -- 172.21.15.87:0/2456107459 shutdown_connections 2024-09-13T17:15:00.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.275+0000 7f76d5684740 1 --2- 172.21.15.87:0/2456107459 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c7467cd950 0x55c7467ca7c0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.275+0000 7f76d5684740 1 --2- 172.21.15.87:0/2456107459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7467c30b0 0x55c7467ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.275+0000 7f76d5684740 1 --2- 172.21.15.87:0/2456107459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c7467c2790 0x55c7467be7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.275+0000 7f76d5684740 1 -- 172.21.15.87:0/2456107459 >> 172.21.15.87:0/2456107459 conn(0x55c7467bed00 msgr2=0x55c7467d90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:00.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.275+0000 7f76d5684740 1 -- 172.21.15.87:0/2456107459 shutdown_connections 2024-09-13T17:15:00.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.275+0000 7f76d5684740 1 -- 172.21.15.87:0/2456107459 wait complete. 2024-09-13T17:15:00.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.275+0000 7f76d5684740 1 -- start start 2024-09-13T17:15:00.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.276+0000 7f76d5684740 1 Processor -- start 2024-09-13T17:15:00.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.276+0000 7f76d5684740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c7467c2790 0x55c7467d1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.276+0000 7f76d5684740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c7467c30b0 0x55c7467d1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.276+0000 7f76d5684740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7467cd950 0x55c7467d1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.276+0000 7f76d5684740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7468336f0 con 0x55c7467c30b0 2024-09-13T17:15:00.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.276+0000 7f76d5684740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c746833860 con 0x55c7467cd950 2024-09-13T17:15:00.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.276+0000 7f76d5684740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c746833a20 con 0x55c7467c2790 2024-09-13T17:15:00.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.276+0000 7f76d5684740 10 client.0 _ll_register_callbacks cb 0x7f76bc032ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:00.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.276+0000 7f76c3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c7467c30b0 0x55c7467d1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.276+0000 7f76c3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c7467c30b0 0x55c7467d1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33234/0 (socket says 172.21.15.87:33234) 2024-09-13T17:15:00.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.276+0000 7f76c3fff640 1 -- 172.21.15.87:0/3942899163 learned_addr learned my addr 172.21.15.87:0/3942899163 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:00.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.276+0000 7f76cbfff640 1 --2- 172.21.15.87:0/3942899163 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c7467c2790 0x55c7467d1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.276+0000 7f76d0efb640 1 --2- 172.21.15.87:0/3942899163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7467cd950 0x55c7467d1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.276+0000 7f76c3fff640 1 -- 172.21.15.87:0/3942899163 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c7467c2790 msgr2=0x55c7467d1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:00.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.276+0000 7f76c3fff640 1 --2- 172.21.15.87:0/3942899163 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c7467c2790 0x55c7467d1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.276+0000 7f76c3fff640 1 -- 172.21.15.87:0/3942899163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7467cd950 msgr2=0x55c7467d1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:00.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.276+0000 7f76c3fff640 1 --2- 172.21.15.87:0/3942899163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7467cd950 0x55c7467d1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.276+0000 7f76c3fff640 1 -- 172.21.15.87:0/3942899163 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c4015070 con 0x55c7467c30b0 2024-09-13T17:15:00.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.276+0000 7f76d0efb640 1 --2- 172.21.15.87:0/3942899163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7467cd950 0x55c7467d1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:00.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.276+0000 7f76cbfff640 1 --2- 172.21.15.87:0/3942899163 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c7467c2790 0x55c7467d1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:00.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.276+0000 7f76c3fff640 1 --2- 172.21.15.87:0/3942899163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c7467c30b0 0x55c7467d1840 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f76b400a670 tx=0x7f76b40b2de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc4e32647266cce5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:00.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.276+0000 7f76ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:15:00.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.277+0000 7f76ab7fe640 1 -- 172.21.15.87:0/3942899163 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b40adea0 con 0x55c7467c30b0 2024-09-13T17:15:00.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.277+0000 7f76ab7fe640 1 -- 172.21.15.87:0/3942899163 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f76b409a230 con 0x55c7467c30b0 2024-09-13T17:15:00.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.277+0000 7f76d5684740 1 -- 172.21.15.87:0/3942899163 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f76bc040070 con 0x55c7467c30b0 2024-09-13T17:15:00.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.277+0000 7f76ab7fe640 1 -- 172.21.15.87:0/3942899163 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76b40056f0 con 0x55c7467c30b0 2024-09-13T17:15:00.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.277+0000 7f76d5684740 10 client.16005 fetch_fsmap learned FSMap version 24 2024-09-13T17:15:00.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.277+0000 7f76d5684740 1 -- 172.21.15.87:0/3942899163 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55c7466ebe80 con 0x55c7467c30b0 2024-09-13T17:15:00.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.277+0000 7f76ab7fe640 1 -- 172.21.15.87:0/3942899163 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f76b407e080 con 0x55c7467c30b0 2024-09-13T17:15:00.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.277+0000 7f76ab7fe640 1 -- 172.21.15.87:0/3942899163 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f76b4095dc0 con 0x55c7467c30b0 2024-09-13T17:15:00.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.277+0000 7f76d5684740 10 client.16005 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:15:00.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.277+0000 7f76d5684740 10 client.16005 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:15:00.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.277+0000 7f76d5684740 20 client.16005 populate_metadata read hostname 'smithi087' 2024-09-13T17:15:00.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.277+0000 7f76d5684740 1 --2- 172.21.15.87:0/3942899163 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55c7467dd0b0 0x55c746836e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.277+0000 7f76d5684740 4 client.16005 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:15:00.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.277+0000 7f76d5684740 1 -- 172.21.15.87:0/3942899163 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c7464194e0 con 0x55c7467dd0b0 2024-09-13T17:15:00.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.278+0000 7f76cbfff640 1 --2- 172.21.15.87:0/3942899163 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55c7467dd0b0 0x55c746836e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.278+0000 7f76cbfff640 1 --2- 172.21.15.87:0/3942899163 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55c7467dd0b0 0x55c746836e40 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=54e7e8ab371a61c4 server_cookie=e7297bc98c59a3ff in_seq=0 out_seq=0 2024-09-13T17:15:00.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.278+0000 7f76ab7fe640 10 client.16005 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:15:00.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.278+0000 7f76ab7fe640 1 -- 172.21.15.87:0/3942899163 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c7464194e0 con 0x55c7467dd0b0 2024-09-13T17:15:00.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.278+0000 7f76ab7fe640 10 client.16005 handle_command_reply: tid=0 2024-09-13T17:15:00.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.278+0000 7f76d5684740 1 client.16005 shutdown 2024-09-13T17:15:00.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.278+0000 7f76d5684740 1 -- 172.21.15.87:0/3942899163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c7467c30b0 msgr2=0x55c7467d1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.278+0000 7f76d5684740 1 --2- 172.21.15.87:0/3942899163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c7467c30b0 0x55c7467d1840 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f76b400a670 tx=0x7f76b40b2de0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.278+0000 7f76d5684740 1 -- 172.21.15.87:0/3942899163 shutdown_connections 2024-09-13T17:15:00.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.278+0000 7f76d5684740 1 --2- 172.21.15.87:0/3942899163 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55c7467dd0b0 0x55c746836e40 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.278+0000 7f76d5684740 1 --2- 172.21.15.87:0/3942899163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7467cd950 0x55c7467d1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.278+0000 7f76d5684740 1 --2- 172.21.15.87:0/3942899163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c7467c30b0 0x55c7467d1840 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.278+0000 7f76ab7fe640 0 client.16005 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:15:00.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.278+0000 7f76d5684740 1 --2- 172.21.15.87:0/3942899163 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c7467c2790 0x55c7467d1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.278+0000 7f76d5684740 1 -- 172.21.15.87:0/3942899163 >> 172.21.15.87:0/3942899163 conn(0x55c7467bed00 msgr2=0x55c7467ca260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:00.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.278+0000 7f76d5684740 1 -- 172.21.15.87:0/3942899163 shutdown_connections 2024-09-13T17:15:00.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.278+0000 7f76d5684740 1 -- 172.21.15.87:0/3942899163 wait complete. 2024-09-13T17:15:00.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.279+0000 7f76d5684740 20 client.16005 trim_cache size 0 max 16384 2024-09-13T17:15:00.287 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:15:00.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.279+0000 7f76d295e640 1 -- 172.21.15.87:0/2303809732 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f76b80a1320 msgr2=0x7f76b80a37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.279+0000 7f76d295e640 1 --2- 172.21.15.87:0/2303809732 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f76b80a1320 0x7f76b80a37e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f76c400ae60 tx=0x7f76c4004a40 comp rx=0 tx=0).stop 2024-09-13T17:15:00.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.279+0000 7f76d295e640 1 -- 172.21.15.87:0/2303809732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76cc103fb0 msgr2=0x7f76cc1975b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.279+0000 7f76d295e640 1 --2- 172.21.15.87:0/2303809732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76cc103fb0 0x7f76cc1975b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f76b400c970 tx=0x7f76b400ce30 comp rx=0 tx=0).stop 2024-09-13T17:15:00.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.279+0000 7f76d295e640 1 -- 172.21.15.87:0/2303809732 shutdown_connections 2024-09-13T17:15:00.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.279+0000 7f76d295e640 1 --2- 172.21.15.87:0/2303809732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76cc197af0 0x7f76cc1a20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.279+0000 7f76d295e640 1 --2- 172.21.15.87:0/2303809732 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f76b80a1320 0x7f76b80a37e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.279+0000 7f76d295e640 1 --2- 172.21.15.87:0/2303809732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76cc103fb0 0x7f76cc1975b0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.279+0000 7f76d295e640 1 --2- 172.21.15.87:0/2303809732 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76cc0fee60 0x7f76cc197070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.279+0000 7f76d295e640 1 -- 172.21.15.87:0/2303809732 >> 172.21.15.87:0/2303809732 conn(0x7f76cc075c60 msgr2=0x7f76cc0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:00.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.279+0000 7f76d295e640 1 -- 172.21.15.87:0/2303809732 shutdown_connections 2024-09-13T17:15:00.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.279+0000 7f76d295e640 1 -- 172.21.15.87:0/2303809732 wait complete. 2024-09-13T17:15:00.291 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-09-13T17:15:00.368 INFO:tasks.workunit.client.0.smithi087.stderr:Note: switching to '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'. 2024-09-13T17:15:00.369 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-09-13T17:15:00.369 INFO:tasks.workunit.client.0.smithi087.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T17:15:00.369 INFO:tasks.workunit.client.0.smithi087.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T17:15:00.369 INFO:tasks.workunit.client.0.smithi087.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T17:15:00.369 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-09-13T17:15:00.369 INFO:tasks.workunit.client.0.smithi087.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T17:15:00.369 INFO:tasks.workunit.client.0.smithi087.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T17:15:00.369 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-09-13T17:15:00.370 INFO:tasks.workunit.client.0.smithi087.stderr: git switch -c 2024-09-13T17:15:00.370 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-09-13T17:15:00.370 INFO:tasks.workunit.client.0.smithi087.stderr:Or undo this operation with: 2024-09-13T17:15:00.370 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-09-13T17:15:00.370 INFO:tasks.workunit.client.0.smithi087.stderr: git switch - 2024-09-13T17:15:00.370 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-09-13T17:15:00.370 INFO:tasks.workunit.client.0.smithi087.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T17:15:00.370 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-09-13T17:15:00.370 INFO:tasks.workunit.client.0.smithi087.stderr:HEAD is now at 6c6b083f148 Merge PR #56690 into wip-rishabh-testing-20240910.100730-reef 2024-09-13T17:15:00.372 DEBUG:teuthology.orchestra.run.smithi087:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-13T17:15:00.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.394+0000 7ff924b2c640 1 -- 172.21.15.87:0/2025656253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff920103fb0 msgr2=0x7ff92010bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.394+0000 7ff924b2c640 1 --2- 172.21.15.87:0/2025656253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff920103fb0 0x7ff92010bb00 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ff918009cd0 tx=0x7ff91802a8e0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.394+0000 7ff924b2c640 1 -- 172.21.15.87:0/2025656253 shutdown_connections 2024-09-13T17:15:00.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.394+0000 7ff924b2c640 1 --2- 172.21.15.87:0/2025656253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff920103fb0 0x7ff92010bb00 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.394+0000 7ff924b2c640 1 --2- 172.21.15.87:0/2025656253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9200ff810 0x7ff920103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.394+0000 7ff924b2c640 1 --2- 172.21.15.87:0/2025656253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9200fee60 0x7ff9200ff240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.394+0000 7ff924b2c640 1 -- 172.21.15.87:0/2025656253 >> 172.21.15.87:0/2025656253 conn(0x7ff920075c60 msgr2=0x7ff9200fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:00.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.394+0000 7ff924b2c640 1 -- 172.21.15.87:0/2025656253 shutdown_connections 2024-09-13T17:15:00.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.394+0000 7ff924b2c640 1 -- 172.21.15.87:0/2025656253 wait complete. 2024-09-13T17:15:00.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.394+0000 7ff924b2c640 1 Processor -- start 2024-09-13T17:15:00.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.394+0000 7ff924b2c640 1 -- start start 2024-09-13T17:15:00.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.395+0000 7ff924b2c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9200fee60 0x7ff9201970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.395+0000 7ff924b2c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff920103fb0 0x7ff9201975f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.395+0000 7ff924b2c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff920197b30 0x7ff9201a2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.395+0000 7ff924b2c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9201a27d0 con 0x7ff920103fb0 2024-09-13T17:15:00.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.395+0000 7ff924b2c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9201a2940 con 0x7ff920197b30 2024-09-13T17:15:00.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.395+0000 7ff924b2c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9201a2b00 con 0x7ff9200fee60 2024-09-13T17:15:00.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.395+0000 7ff91dd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff920103fb0 0x7ff9201975f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.395+0000 7ff91dd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff920103fb0 0x7ff9201975f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33256/0 (socket says 172.21.15.87:33256) 2024-09-13T17:15:00.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.395+0000 7ff91dd9b640 1 -- 172.21.15.87:0/2466160611 learned_addr learned my addr 172.21.15.87:0/2466160611 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:00.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.395+0000 7ff91e59c640 1 --2- 172.21.15.87:0/2466160611 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9200fee60 0x7ff9201970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.395+0000 7ff91ed9d640 1 --2- 172.21.15.87:0/2466160611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff920197b30 0x7ff9201a2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.395+0000 7ff91dd9b640 1 -- 172.21.15.87:0/2466160611 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9200fee60 msgr2=0x7ff9201970b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.395+0000 7ff91dd9b640 1 --2- 172.21.15.87:0/2466160611 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9200fee60 0x7ff9201970b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.395+0000 7ff91dd9b640 1 -- 172.21.15.87:0/2466160611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff920197b30 msgr2=0x7ff9201a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.395+0000 7ff91dd9b640 1 --2- 172.21.15.87:0/2466160611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff920197b30 0x7ff9201a2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.395+0000 7ff91dd9b640 1 -- 172.21.15.87:0/2466160611 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff918009900 con 0x7ff920103fb0 2024-09-13T17:15:00.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.395+0000 7ff91dd9b640 1 --2- 172.21.15.87:0/2466160611 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff920103fb0 0x7ff9201975f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff910005fd0 tx=0x7ff91000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:00.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.395+0000 7ff90f7fe640 1 -- 172.21.15.87:0/2466160611 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff910009c30 con 0x7ff920103fb0 2024-09-13T17:15:00.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.395+0000 7ff90f7fe640 1 -- 172.21.15.87:0/2466160611 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff9100044d0 con 0x7ff920103fb0 2024-09-13T17:15:00.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.395+0000 7ff90f7fe640 1 -- 172.21.15.87:0/2466160611 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff910003e50 con 0x7ff920103fb0 2024-09-13T17:15:00.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.395+0000 7ff924b2c640 1 -- 172.21.15.87:0/2466160611 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9201a2de0 con 0x7ff920103fb0 2024-09-13T17:15:00.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.396+0000 7ff924b2c640 1 -- 172.21.15.87:0/2466160611 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9201a3210 con 0x7ff920103fb0 2024-09-13T17:15:00.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.398+0000 7ff90f7fe640 1 -- 172.21.15.87:0/2466160611 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 25) v1 ==== 136106+0+0 (secure 0 0 0) 0x7ff910004000 con 0x7ff920103fb0 2024-09-13T17:15:00.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.398+0000 7ff92784e740 1 Processor -- start 2024-09-13T17:15:00.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.399+0000 7ff92784e740 1 -- start start 2024-09-13T17:15:00.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.399+0000 7ff92784e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56015c925790 0x56015c925b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.399+0000 7ff92784e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56015c9260b0 0x56015c930410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.399+0000 7ff92784e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56015c930950 0x56015c932d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.399+0000 7ff92784e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56015c88fcc0 con 0x56015c9260b0 2024-09-13T17:15:00.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.399+0000 7ff92784e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56015c88d450 con 0x56015c930950 2024-09-13T17:15:00.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.399+0000 7ff92784e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56015c888d40 con 0x56015c925790 2024-09-13T17:15:00.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.399+0000 7ff91e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56015c9260b0 0x56015c930410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.399+0000 7ff91e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56015c9260b0 0x56015c930410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33260/0 (socket says 172.21.15.87:33260) 2024-09-13T17:15:00.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.399+0000 7ff91e59c640 1 -- 172.21.15.87:0/1183597449 learned_addr learned my addr 172.21.15.87:0/1183597449 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:00.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.399+0000 7ff90f7fe640 1 --2- 172.21.15.87:0/2466160611 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff9080a1320 0x7ff9080a37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.399+0000 7ff91dd9b640 1 --2- 172.21.15.87:0/1183597449 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56015c930950 0x56015c932d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.399+0000 7ff91ed9d640 1 --2- 172.21.15.87:0/1183597449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56015c925790 0x56015c925b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.399+0000 7ff91e59c640 1 -- 172.21.15.87:0/1183597449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56015c925790 msgr2=0x56015c925b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:00.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.399+0000 7ff91e59c640 1 --2- 172.21.15.87:0/1183597449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56015c925790 0x56015c925b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.399+0000 7ff91e59c640 1 -- 172.21.15.87:0/1183597449 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56015c930950 msgr2=0x56015c932d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:00.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.399+0000 7ff91e59c640 1 --2- 172.21.15.87:0/1183597449 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56015c930950 0x56015c932d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.399+0000 7ff91e59c640 1 -- 172.21.15.87:0/1183597449 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56015c850620 con 0x56015c9260b0 2024-09-13T17:15:00.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.399+0000 7ff91dd9b640 1 --2- 172.21.15.87:0/1183597449 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56015c930950 0x56015c932d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:00.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.399+0000 7ff90f7fe640 1 -- 172.21.15.87:0/2466160611 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7ff9100ccf40 con 0x7ff920103fb0 2024-09-13T17:15:00.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.399+0000 7ff91ed9d640 1 --2- 172.21.15.87:0/1183597449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56015c925790 0x56015c925b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:15:00.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.399+0000 7ff91ed9d640 1 --2- 172.21.15.87:0/2466160611 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff9080a1320 0x7ff9080a37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.400+0000 7ff91e59c640 1 --2- 172.21.15.87:0/1183597449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56015c9260b0 0x56015c930410 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff91400bcd0 tx=0x7ff9140107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=317cd631afb1f4de server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:00.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.400+0000 7ff90cff9640 1 -- 172.21.15.87:0/1183597449 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff914005220 con 0x56015c9260b0 2024-09-13T17:15:00.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.400+0000 7ff90cff9640 1 -- 172.21.15.87:0/1183597449 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff914015070 con 0x56015c9260b0 2024-09-13T17:15:00.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.400+0000 7ff90cff9640 1 -- 172.21.15.87:0/1183597449 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9140116a0 con 0x56015c9260b0 2024-09-13T17:15:00.405 INFO:tasks.workunit.client.0.smithi087.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T17:15:00.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.401+0000 7ff92784e740 1 -- 172.21.15.87:0/1183597449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56015c9260b0 msgr2=0x56015c930410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.401+0000 7ff92784e740 1 --2- 172.21.15.87:0/1183597449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56015c9260b0 0x56015c930410 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff91400bcd0 tx=0x7ff9140107a0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.401+0000 7ff91ed9d640 1 --2- 172.21.15.87:0/2466160611 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff9080a1320 0x7ff9080a37e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff918009430 tx=0x7ff91803f040 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:00.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.401+0000 7ff92784e740 1 -- 172.21.15.87:0/1183597449 shutdown_connections 2024-09-13T17:15:00.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.401+0000 7ff92784e740 1 --2- 172.21.15.87:0/1183597449 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56015c930950 0x56015c932d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.401+0000 7ff92784e740 1 --2- 172.21.15.87:0/1183597449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56015c9260b0 0x56015c930410 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.401+0000 7ff92784e740 1 --2- 172.21.15.87:0/1183597449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56015c925790 0x56015c925b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.401+0000 7ff92784e740 1 -- 172.21.15.87:0/1183597449 >> 172.21.15.87:0/1183597449 conn(0x56015c921d00 msgr2=0x56015c9220e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:00.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.401+0000 7ff92784e740 1 -- 172.21.15.87:0/1183597449 shutdown_connections 2024-09-13T17:15:00.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.401+0000 7ff92784e740 1 -- 172.21.15.87:0/1183597449 wait complete. 2024-09-13T17:15:00.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.401+0000 7ff92784e740 1 -- start start 2024-09-13T17:15:00.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.401+0000 7ff92784e740 1 Processor -- start 2024-09-13T17:15:00.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.401+0000 7ff92784e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56015c925790 0x56015c92ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.401+0000 7ff92784e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56015c9260b0 0x56015c92d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.401+0000 7ff92784e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56015c930950 0x56015c92d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.401+0000 7ff92784e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56015c847180 con 0x56015c925790 2024-09-13T17:15:00.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.401+0000 7ff92784e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56015c561430 con 0x56015c930950 2024-09-13T17:15:00.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.401+0000 7ff92784e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56015c80c5e0 con 0x56015c9260b0 2024-09-13T17:15:00.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.401+0000 7ff92784e740 10 client.0 _ll_register_callbacks cb 0x56015c878aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:00.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.402+0000 7ff91e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56015c925790 0x56015c92ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.402+0000 7ff91e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56015c925790 0x56015c92ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33264/0 (socket says 172.21.15.87:33264) 2024-09-13T17:15:00.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.402+0000 7ff91e59c640 1 -- 172.21.15.87:0/2196527446 learned_addr learned my addr 172.21.15.87:0/2196527446 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:00.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.402+0000 7ff91ed9d640 1 --2- 172.21.15.87:0/2196527446 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56015c930950 0x56015c92d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.402+0000 7ff91dd9b640 1 --2- 172.21.15.87:0/2196527446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56015c9260b0 0x56015c92d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.402+0000 7ff91e59c640 1 -- 172.21.15.87:0/2196527446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56015c9260b0 msgr2=0x56015c92d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:00.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.402+0000 7ff91e59c640 1 --2- 172.21.15.87:0/2196527446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56015c9260b0 0x56015c92d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.402+0000 7ff91e59c640 1 -- 172.21.15.87:0/2196527446 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56015c930950 msgr2=0x56015c92d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:00.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.402+0000 7ff91e59c640 1 --2- 172.21.15.87:0/2196527446 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56015c930950 0x56015c92d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.402+0000 7ff91e59c640 1 -- 172.21.15.87:0/2196527446 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff91400b900 con 0x56015c925790 2024-09-13T17:15:00.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.402+0000 7ff91ed9d640 1 --2- 172.21.15.87:0/2196527446 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56015c930950 0x56015c92d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:15:00.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.402+0000 7ff91dd9b640 1 --2- 172.21.15.87:0/2196527446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56015c9260b0 0x56015c92d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:15:00.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.402+0000 7ff91e59c640 1 --2- 172.21.15.87:0/2196527446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56015c925790 0x56015c92ff10 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff914000c00 tx=0x7ff914005180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8df34dba891d448f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:00.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.402+0000 7ff905ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:15:00.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.402+0000 7ff905ffb640 1 -- 172.21.15.87:0/2196527446 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff914021070 con 0x56015c925790 2024-09-13T17:15:00.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.402+0000 7ff905ffb640 1 -- 172.21.15.87:0/2196527446 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7ff914017070 con 0x56015c925790 2024-09-13T17:15:00.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.402+0000 7ff92784e740 1 -- 172.21.15.87:0/2196527446 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56015c8b2b80 con 0x56015c925790 2024-09-13T17:15:00.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.403+0000 7ff905ffb640 1 -- 172.21.15.87:0/2196527446 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9140048d0 con 0x56015c925790 2024-09-13T17:15:00.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.403+0000 7ff92784e740 10 client.16017 fetch_fsmap learned FSMap version 24 2024-09-13T17:15:00.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.403+0000 7ff92784e740 1 -- 172.21.15.87:0/2196527446 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x56015c8873c0 con 0x56015c925790 2024-09-13T17:15:00.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.403+0000 7ff905ffb640 1 -- 172.21.15.87:0/2196527446 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x56015c8b2b80 con 0x56015c925790 2024-09-13T17:15:00.411 INFO:tasks.workunit.client.0.smithi087.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T17:15:00.411 INFO:tasks.workunit.client.0.smithi087.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T17:15:00.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.403+0000 7ff905ffb640 1 -- 172.21.15.87:0/2196527446 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7ff914026cc0 con 0x56015c925790 2024-09-13T17:15:00.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.403+0000 7ff92784e740 10 client.16017 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:15:00.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.403+0000 7ff92784e740 10 client.16017 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:15:00.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.403+0000 7ff92784e740 20 client.16017 populate_metadata read hostname 'smithi087' 2024-09-13T17:15:00.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.403+0000 7ff92784e740 1 --2- 172.21.15.87:0/2196527446 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x56015c940170 0x56015c942560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.403+0000 7ff92784e740 4 client.16017 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:15:00.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.403+0000 7ff92784e740 1 -- 172.21.15.87:0/2196527446 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56015c87b1f0 con 0x56015c940170 2024-09-13T17:15:00.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.403+0000 7ff91dd9b640 1 --2- 172.21.15.87:0/2196527446 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x56015c940170 0x56015c942560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.404+0000 7ff905ffb640 10 client.16017 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:15:00.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.404+0000 7ff91dd9b640 1 --2- 172.21.15.87:0/2196527446 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x56015c940170 0x56015c942560 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5b4ae471368d818d server_cookie=d729abda84ffe9da in_seq=0 out_seq=0 2024-09-13T17:15:00.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.404+0000 7ff905ffb640 1 -- 172.21.15.87:0/2196527446 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x56015c87b1f0 con 0x56015c940170 2024-09-13T17:15:00.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.404+0000 7ff905ffb640 10 client.16017 handle_command_reply: tid=0 2024-09-13T17:15:00.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.404+0000 7ff92784e740 1 client.16017 shutdown 2024-09-13T17:15:00.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.405+0000 7ff92784e740 1 -- 172.21.15.87:0/2196527446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56015c925790 msgr2=0x56015c92ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.405+0000 7ff92784e740 1 --2- 172.21.15.87:0/2196527446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56015c925790 0x56015c92ff10 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff914000c00 tx=0x7ff914005180 comp rx=0 tx=0).stop 2024-09-13T17:15:00.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.405+0000 7ff92784e740 1 -- 172.21.15.87:0/2196527446 shutdown_connections 2024-09-13T17:15:00.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.405+0000 7ff92784e740 1 --2- 172.21.15.87:0/2196527446 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x56015c940170 0x56015c942560 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.405+0000 7ff92784e740 1 --2- 172.21.15.87:0/2196527446 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56015c930950 0x56015c92d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.405+0000 7ff905ffb640 0 client.16017 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:15:00.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.405+0000 7ff92784e740 1 --2- 172.21.15.87:0/2196527446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56015c9260b0 0x56015c92d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.405+0000 7ff92784e740 1 --2- 172.21.15.87:0/2196527446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56015c925790 0x56015c92ff10 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.405+0000 7ff92784e740 1 -- 172.21.15.87:0/2196527446 >> 172.21.15.87:0/2196527446 conn(0x56015c921d00 msgr2=0x56015c927a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:00.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.405+0000 7ff92784e740 1 -- 172.21.15.87:0/2196527446 shutdown_connections 2024-09-13T17:15:00.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.405+0000 7ff92784e740 1 -- 172.21.15.87:0/2196527446 wait complete. 2024-09-13T17:15:00.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.405+0000 7ff92784e740 20 client.16017 trim_cache size 0 max 16384 2024-09-13T17:15:00.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.416+0000 7ff92784e740 1 Processor -- start 2024-09-13T17:15:00.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.417+0000 7ff92784e740 1 -- start start 2024-09-13T17:15:00.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.417+0000 7ff92784e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56015c925790 0x56015c9216a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.417+0000 7ff92784e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56015c9260b0 0x56015c928170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.417+0000 7ff92784e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56015c930950 0x56015c9286b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.417+0000 7ff92784e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56015c924fb0 con 0x56015c930950 2024-09-13T17:15:00.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.417+0000 7ff92784e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56015c92e350 con 0x56015c925790 2024-09-13T17:15:00.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.417+0000 7ff92784e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56015c9330a0 con 0x56015c9260b0 2024-09-13T17:15:00.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.417+0000 7ff91ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56015c930950 0x56015c9286b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.417+0000 7ff91ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56015c930950 0x56015c9286b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33280/0 (socket says 172.21.15.87:33280) 2024-09-13T17:15:00.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.417+0000 7ff91ed9d640 1 -- 172.21.15.87:0/2745015575 learned_addr learned my addr 172.21.15.87:0/2745015575 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:00.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.417+0000 7ff91dd9b640 1 --2- 172.21.15.87:0/2745015575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56015c9260b0 0x56015c928170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.417+0000 7ff91e59c640 1 --2- 172.21.15.87:0/2745015575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56015c925790 0x56015c9216a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.417+0000 7ff91ed9d640 1 -- 172.21.15.87:0/2745015575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56015c9260b0 msgr2=0x56015c928170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:00.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.417+0000 7ff91ed9d640 1 --2- 172.21.15.87:0/2745015575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56015c9260b0 0x56015c928170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.417+0000 7ff91ed9d640 1 -- 172.21.15.87:0/2745015575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56015c925790 msgr2=0x56015c9216a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:00.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.417+0000 7ff91ed9d640 1 --2- 172.21.15.87:0/2745015575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56015c925790 0x56015c9216a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.417+0000 7ff91ed9d640 1 -- 172.21.15.87:0/2745015575 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56015c829770 con 0x56015c930950 2024-09-13T17:15:00.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.417+0000 7ff91dd9b640 1 --2- 172.21.15.87:0/2745015575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56015c9260b0 0x56015c928170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:00.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.417+0000 7ff91ed9d640 1 --2- 172.21.15.87:0/2745015575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56015c930950 0x56015c9286b0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ff918009cd0 tx=0x7ff918009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d3023a4924f9a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:00.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.417+0000 7ff90d7fa640 1 -- 172.21.15.87:0/2745015575 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff918003970 con 0x56015c930950 2024-09-13T17:15:00.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.418+0000 7ff90d7fa640 1 -- 172.21.15.87:0/2745015575 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff91804b070 con 0x56015c930950 2024-09-13T17:15:00.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.418+0000 7ff90d7fa640 1 -- 172.21.15.87:0/2745015575 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91803c410 con 0x56015c930950 2024-09-13T17:15:00.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.418+0000 7ff92784e740 1 -- 172.21.15.87:0/2745015575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56015c930950 msgr2=0x56015c9286b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.418+0000 7ff92784e740 1 --2- 172.21.15.87:0/2745015575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56015c930950 0x56015c9286b0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ff918009cd0 tx=0x7ff918009820 comp rx=0 tx=0).stop 2024-09-13T17:15:00.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.418+0000 7ff92784e740 1 -- 172.21.15.87:0/2745015575 shutdown_connections 2024-09-13T17:15:00.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.418+0000 7ff92784e740 1 --2- 172.21.15.87:0/2745015575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56015c930950 0x56015c9286b0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.418+0000 7ff92784e740 1 --2- 172.21.15.87:0/2745015575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56015c9260b0 0x56015c928170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.418+0000 7ff92784e740 1 --2- 172.21.15.87:0/2745015575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56015c925790 0x56015c9216a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.418+0000 7ff92784e740 1 -- 172.21.15.87:0/2745015575 >> 172.21.15.87:0/2745015575 conn(0x56015c921d00 msgr2=0x56015c946ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:00.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.418+0000 7ff92784e740 1 -- 172.21.15.87:0/2745015575 shutdown_connections 2024-09-13T17:15:00.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.418+0000 7ff92784e740 1 -- 172.21.15.87:0/2745015575 wait complete. 2024-09-13T17:15:00.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.419+0000 7ff92784e740 1 -- start start 2024-09-13T17:15:00.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.419+0000 7ff92784e740 1 Processor -- start 2024-09-13T17:15:00.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.419+0000 7ff92784e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56015c925790 0x56015c937600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.419+0000 7ff92784e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56015c9260b0 0x56015c937b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.419+0000 7ff92784e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56015c930950 0x56015c935c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.419+0000 7ff92784e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56015c936320 con 0x56015c9260b0 2024-09-13T17:15:00.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.419+0000 7ff92784e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56015c936490 con 0x56015c930950 2024-09-13T17:15:00.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.419+0000 7ff92784e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56015c936650 con 0x56015c925790 2024-09-13T17:15:00.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.419+0000 7ff92784e740 10 client.0 _ll_register_callbacks cb 0x7ff91400b810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:00.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.419+0000 7ff91dd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56015c9260b0 0x56015c937b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.419+0000 7ff91dd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56015c9260b0 0x56015c937b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33296/0 (socket says 172.21.15.87:33296) 2024-09-13T17:15:00.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.419+0000 7ff91dd9b640 1 -- 172.21.15.87:0/1431514435 learned_addr learned my addr 172.21.15.87:0/1431514435 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:00.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.419+0000 7ff91ed9d640 1 --2- 172.21.15.87:0/1431514435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56015c930950 0x56015c935c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.419+0000 7ff91dd9b640 1 -- 172.21.15.87:0/1431514435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56015c925790 msgr2=0x56015c937600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:00.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.419+0000 7ff91dd9b640 1 --2- 172.21.15.87:0/1431514435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56015c925790 0x56015c937600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.419+0000 7ff91dd9b640 1 -- 172.21.15.87:0/1431514435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56015c930950 msgr2=0x56015c935c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:00.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.419+0000 7ff91dd9b640 1 --2- 172.21.15.87:0/1431514435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56015c930950 0x56015c935c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.419+0000 7ff91dd9b640 1 -- 172.21.15.87:0/1431514435 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff92010c340 con 0x56015c9260b0 2024-09-13T17:15:00.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.419+0000 7ff91dd9b640 1 --2- 172.21.15.87:0/1431514435 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56015c9260b0 0x56015c937b40 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff910003fd0 tx=0x7ff910099900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca1e6b31fdae969 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:00.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.419+0000 7ff905ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:15:00.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.419+0000 7ff905ffb640 1 -- 172.21.15.87:0/1431514435 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff910099a50 con 0x56015c9260b0 2024-09-13T17:15:00.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.419+0000 7ff905ffb640 1 -- 172.21.15.87:0/1431514435 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7ff91009d880 con 0x56015c9260b0 2024-09-13T17:15:00.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.420+0000 7ff92784e740 1 -- 172.21.15.87:0/1431514435 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff914015070 con 0x56015c9260b0 2024-09-13T17:15:00.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.420+0000 7ff905ffb640 1 -- 172.21.15.87:0/1431514435 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9100a1ed0 con 0x56015c9260b0 2024-09-13T17:15:00.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.420+0000 7ff92784e740 10 client.16023 fetch_fsmap learned FSMap version 24 2024-09-13T17:15:00.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.420+0000 7ff92784e740 1 -- 172.21.15.87:0/1431514435 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x56015c84ee80 con 0x56015c9260b0 2024-09-13T17:15:00.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.420+0000 7ff905ffb640 1 -- 172.21.15.87:0/1431514435 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff914015070 con 0x56015c9260b0 2024-09-13T17:15:00.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.420+0000 7ff905ffb640 1 -- 172.21.15.87:0/1431514435 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7ff910022020 con 0x56015c9260b0 2024-09-13T17:15:00.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.420+0000 7ff92784e740 10 client.16023 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:15:00.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.420+0000 7ff92784e740 10 client.16023 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:15:00.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.420+0000 7ff92784e740 20 client.16023 populate_metadata read hostname 'smithi087' 2024-09-13T17:15:00.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.420+0000 7ff92784e740 1 --2- 172.21.15.87:0/1431514435 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x56015c9979d0 0x56015c999df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.420+0000 7ff92784e740 4 client.16023 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:15:00.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.420+0000 7ff92784e740 1 -- 172.21.15.87:0/1431514435 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56015c57c4e0 con 0x56015c9979d0 2024-09-13T17:15:00.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.420+0000 7ff91e59c640 1 --2- 172.21.15.87:0/1431514435 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x56015c9979d0 0x56015c999df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.421+0000 7ff905ffb640 10 client.16023 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:15:00.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.421+0000 7ff91e59c640 1 --2- 172.21.15.87:0/1431514435 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x56015c9979d0 0x56015c999df0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c98cb9dfc5ce7855 server_cookie=31255b7b529d59e9 in_seq=0 out_seq=0 2024-09-13T17:15:00.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.421+0000 7ff905ffb640 1 -- 172.21.15.87:0/1431514435 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56015c57c4e0 con 0x56015c9979d0 2024-09-13T17:15:00.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.421+0000 7ff905ffb640 10 client.16023 handle_command_reply: tid=0 2024-09-13T17:15:00.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.421+0000 7ff92784e740 1 client.16023 shutdown 2024-09-13T17:15:00.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.421+0000 7ff92784e740 1 -- 172.21.15.87:0/1431514435 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56015c9260b0 msgr2=0x56015c937b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.421+0000 7ff92784e740 1 --2- 172.21.15.87:0/1431514435 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56015c9260b0 0x56015c937b40 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff910003fd0 tx=0x7ff910099900 comp rx=0 tx=0).stop 2024-09-13T17:15:00.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.421+0000 7ff92784e740 1 -- 172.21.15.87:0/1431514435 shutdown_connections 2024-09-13T17:15:00.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.421+0000 7ff92784e740 1 --2- 172.21.15.87:0/1431514435 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x56015c9979d0 0x56015c999df0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.421+0000 7ff92784e740 1 --2- 172.21.15.87:0/1431514435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56015c930950 0x56015c935c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.421+0000 7ff92784e740 1 --2- 172.21.15.87:0/1431514435 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56015c9260b0 0x56015c937b40 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.421+0000 7ff905ffb640 0 client.16023 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:15:00.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.421+0000 7ff92784e740 1 --2- 172.21.15.87:0/1431514435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56015c925790 0x56015c937600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.421+0000 7ff92784e740 1 -- 172.21.15.87:0/1431514435 >> 172.21.15.87:0/1431514435 conn(0x56015c921d00 msgr2=0x56015c92ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:00.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.421+0000 7ff92784e740 1 -- 172.21.15.87:0/1431514435 shutdown_connections 2024-09-13T17:15:00.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.421+0000 7ff92784e740 1 -- 172.21.15.87:0/1431514435 wait complete. 2024-09-13T17:15:00.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.421+0000 7ff92784e740 20 client.16023 trim_cache size 0 max 16384 2024-09-13T17:15:00.430 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:15:00.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.422+0000 7ff924b2c640 1 -- 172.21.15.87:0/2466160611 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff9080a1320 msgr2=0x7ff9080a37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.422+0000 7ff924b2c640 1 --2- 172.21.15.87:0/2466160611 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff9080a1320 0x7ff9080a37e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff918009430 tx=0x7ff91803f040 comp rx=0 tx=0).stop 2024-09-13T17:15:00.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.422+0000 7ff924b2c640 1 -- 172.21.15.87:0/2466160611 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff920103fb0 msgr2=0x7ff9201975f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.422+0000 7ff924b2c640 1 --2- 172.21.15.87:0/2466160611 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff920103fb0 0x7ff9201975f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff910005fd0 tx=0x7ff91000dde0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.422+0000 7ff924b2c640 1 -- 172.21.15.87:0/2466160611 shutdown_connections 2024-09-13T17:15:00.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.422+0000 7ff924b2c640 1 --2- 172.21.15.87:0/2466160611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff920197b30 0x7ff9201a2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.422+0000 7ff924b2c640 1 --2- 172.21.15.87:0/2466160611 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff9080a1320 0x7ff9080a37e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.422+0000 7ff924b2c640 1 --2- 172.21.15.87:0/2466160611 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff920103fb0 0x7ff9201975f0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.422+0000 7ff924b2c640 1 --2- 172.21.15.87:0/2466160611 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9200fee60 0x7ff9201970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.422+0000 7ff924b2c640 1 -- 172.21.15.87:0/2466160611 >> 172.21.15.87:0/2466160611 conn(0x7ff920075c60 msgr2=0x7ff9200fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:00.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.422+0000 7ff924b2c640 1 -- 172.21.15.87:0/2466160611 shutdown_connections 2024-09-13T17:15:00.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.422+0000 7ff924b2c640 1 -- 172.21.15.87:0/2466160611 wait complete. 2024-09-13T17:15:00.433 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-09-13T17:15:00.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.574+0000 7eff34ec5640 1 -- 172.21.15.87:0/33854793 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff300ff810 msgr2=0x7eff30103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.574+0000 7eff34ec5640 1 --2- 172.21.15.87:0/33854793 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff300ff810 0x7eff30103850 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7eff18009930 tx=0x7eff1802a420 comp rx=0 tx=0).stop 2024-09-13T17:15:00.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.574+0000 7eff34ec5640 1 -- 172.21.15.87:0/33854793 shutdown_connections 2024-09-13T17:15:00.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.574+0000 7eff34ec5640 1 --2- 172.21.15.87:0/33854793 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff30103fb0 0x7eff3010bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.574+0000 7eff34ec5640 1 --2- 172.21.15.87:0/33854793 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff300ff810 0x7eff30103850 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.574+0000 7eff34ec5640 1 --2- 172.21.15.87:0/33854793 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff300fee60 0x7eff300ff240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.574+0000 7eff34ec5640 1 -- 172.21.15.87:0/33854793 >> 172.21.15.87:0/33854793 conn(0x7eff30075c60 msgr2=0x7eff300fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:00.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.574+0000 7eff34ec5640 1 -- 172.21.15.87:0/33854793 shutdown_connections 2024-09-13T17:15:00.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.574+0000 7eff34ec5640 1 -- 172.21.15.87:0/33854793 wait complete. 2024-09-13T17:15:00.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.575+0000 7eff34ec5640 1 Processor -- start 2024-09-13T17:15:00.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.575+0000 7eff34ec5640 1 -- start start 2024-09-13T17:15:00.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.575+0000 7eff34ec5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff300fee60 0x7eff301951f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.575+0000 7eff34ec5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff30103fb0 0x7eff30195730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.575+0000 7eff34ec5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff30199b20 0x7eff30199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.575+0000 7eff34ec5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3019a510 con 0x7eff30103fb0 2024-09-13T17:15:00.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.575+0000 7eff34ec5640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3019a680 con 0x7eff30199b20 2024-09-13T17:15:00.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.575+0000 7eff34ec5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3019a7f0 con 0x7eff300fee60 2024-09-13T17:15:00.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.575+0000 7eff2dd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff30103fb0 0x7eff30195730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.575+0000 7eff2dd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff30103fb0 0x7eff30195730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33322/0 (socket says 172.21.15.87:33322) 2024-09-13T17:15:00.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.575+0000 7eff2dd9b640 1 -- 172.21.15.87:0/561353337 learned_addr learned my addr 172.21.15.87:0/561353337 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:00.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.575+0000 7eff2ed9d640 1 --2- 172.21.15.87:0/561353337 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff30199b20 0x7eff30199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.575+0000 7eff2e59c640 1 --2- 172.21.15.87:0/561353337 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff300fee60 0x7eff301951f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.575+0000 7eff2dd9b640 1 -- 172.21.15.87:0/561353337 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff300fee60 msgr2=0x7eff301951f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.575+0000 7eff2dd9b640 1 --2- 172.21.15.87:0/561353337 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff300fee60 0x7eff301951f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.575+0000 7eff2dd9b640 1 -- 172.21.15.87:0/561353337 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff30199b20 msgr2=0x7eff30199fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.575+0000 7eff2dd9b640 1 --2- 172.21.15.87:0/561353337 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff30199b20 0x7eff30199fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.576+0000 7eff2dd9b640 1 -- 172.21.15.87:0/561353337 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff18009560 con 0x7eff30103fb0 2024-09-13T17:15:00.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.576+0000 7eff2dd9b640 1 --2- 172.21.15.87:0/561353337 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff30103fb0 0x7eff30195730 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7eff18009900 tx=0x7eff180042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:00.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.576+0000 7eff277fe640 1 -- 172.21.15.87:0/561353337 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff18003a00 con 0x7eff30103fb0 2024-09-13T17:15:00.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.576+0000 7eff277fe640 1 -- 172.21.15.87:0/561353337 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7eff180044e0 con 0x7eff30103fb0 2024-09-13T17:15:00.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.576+0000 7eff277fe640 1 -- 172.21.15.87:0/561353337 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1803a3c0 con 0x7eff30103fb0 2024-09-13T17:15:00.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.576+0000 7eff34ec5640 1 -- 172.21.15.87:0/561353337 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff301a1dd0 con 0x7eff30103fb0 2024-09-13T17:15:00.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.576+0000 7eff34ec5640 1 -- 172.21.15.87:0/561353337 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff301a21a0 con 0x7eff30103fb0 2024-09-13T17:15:00.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.578+0000 7eff277fe640 1 -- 172.21.15.87:0/561353337 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 25) v1 ==== 136106+0+0 (secure 0 0 0) 0x7eff1803b460 con 0x7eff30103fb0 2024-09-13T17:15:00.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.578+0000 7eff37be2740 1 Processor -- start 2024-09-13T17:15:00.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.578+0000 7eff37be2740 1 -- start start 2024-09-13T17:15:00.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.579+0000 7eff37be2740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563fbb092790 0x563fbb092b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.579+0000 7eff37be2740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fbb0930b0 0x563fbb09d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.579+0000 7eff37be2740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563fbb09d950 0x563fbb09fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.579+0000 7eff37be2740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fbaffccc0 con 0x563fbb0930b0 2024-09-13T17:15:00.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.579+0000 7eff37be2740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fbaffa450 con 0x563fbb09d950 2024-09-13T17:15:00.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.579+0000 7eff37be2740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fbaff5d40 con 0x563fbb092790 2024-09-13T17:15:00.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.579+0000 7eff277fe640 1 --2- 172.21.15.87:0/561353337 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7eff1c0a1320 0x7eff1c0a37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.579+0000 7eff2e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fbb0930b0 0x563fbb09d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.579+0000 7eff2e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fbb0930b0 0x563fbb09d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33330/0 (socket says 172.21.15.87:33330) 2024-09-13T17:15:00.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.579+0000 7eff2e59c640 1 -- 172.21.15.87:0/2227119164 learned_addr learned my addr 172.21.15.87:0/2227119164 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:00.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.579+0000 7eff2dd9b640 1 --2- 172.21.15.87:0/2227119164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563fbb09d950 0x563fbb09fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.579+0000 7eff2ed9d640 1 --2- 172.21.15.87:0/561353337 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7eff1c0a1320 0x7eff1c0a37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.579+0000 7eff2ed9d640 1 --2- 172.21.15.87:0/2227119164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563fbb092790 0x563fbb092b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.579+0000 7eff277fe640 1 -- 172.21.15.87:0/561353337 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7eff180ee2e0 con 0x7eff30103fb0 2024-09-13T17:15:00.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.579+0000 7eff2e59c640 1 -- 172.21.15.87:0/2227119164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563fbb092790 msgr2=0x563fbb092b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:00.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.579+0000 7eff2e59c640 1 --2- 172.21.15.87:0/2227119164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563fbb092790 0x563fbb092b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.579+0000 7eff2e59c640 1 -- 172.21.15.87:0/2227119164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563fbb09d950 msgr2=0x563fbb09fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:00.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.579+0000 7eff2e59c640 1 --2- 172.21.15.87:0/2227119164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563fbb09d950 0x563fbb09fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.579+0000 7eff2e59c640 1 -- 172.21.15.87:0/2227119164 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563fbafbd620 con 0x563fbb0930b0 2024-09-13T17:15:00.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.579+0000 7eff2ed9d640 1 --2- 172.21.15.87:0/561353337 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7eff1c0a1320 0x7eff1c0a37e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7eff28005c40 tx=0x7eff28009590 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:00.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.579+0000 7eff2e59c640 1 --2- 172.21.15.87:0/2227119164 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fbb0930b0 0x563fbb09d410 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7eff2000ed20 tx=0x7eff20009670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5451940c1e856eb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:00.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.580+0000 7eff24ff9640 1 -- 172.21.15.87:0/2227119164 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff20013070 con 0x563fbb0930b0 2024-09-13T17:15:00.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.580+0000 7eff24ff9640 1 -- 172.21.15.87:0/2227119164 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7eff20009d80 con 0x563fbb0930b0 2024-09-13T17:15:00.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.580+0000 7eff24ff9640 1 -- 172.21.15.87:0/2227119164 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff20004b20 con 0x563fbb0930b0 2024-09-13T17:15:00.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.580+0000 7eff37be2740 1 -- 172.21.15.87:0/2227119164 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fbb0930b0 msgr2=0x563fbb09d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.580+0000 7eff37be2740 1 --2- 172.21.15.87:0/2227119164 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fbb0930b0 0x563fbb09d410 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7eff2000ed20 tx=0x7eff20009670 comp rx=0 tx=0).stop 2024-09-13T17:15:00.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.580+0000 7eff37be2740 1 -- 172.21.15.87:0/2227119164 shutdown_connections 2024-09-13T17:15:00.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.580+0000 7eff37be2740 1 --2- 172.21.15.87:0/2227119164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563fbb09d950 0x563fbb09fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.580+0000 7eff37be2740 1 --2- 172.21.15.87:0/2227119164 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fbb0930b0 0x563fbb09d410 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.580+0000 7eff37be2740 1 --2- 172.21.15.87:0/2227119164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563fbb092790 0x563fbb092b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.580+0000 7eff37be2740 1 -- 172.21.15.87:0/2227119164 >> 172.21.15.87:0/2227119164 conn(0x563fbb08ed00 msgr2=0x563fbb08f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:00.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.580+0000 7eff37be2740 1 -- 172.21.15.87:0/2227119164 shutdown_connections 2024-09-13T17:15:00.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.580+0000 7eff37be2740 1 -- 172.21.15.87:0/2227119164 wait complete. 2024-09-13T17:15:00.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.581+0000 7eff37be2740 1 -- start start 2024-09-13T17:15:00.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.581+0000 7eff37be2740 1 Processor -- start 2024-09-13T17:15:00.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.581+0000 7eff37be2740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563fbb092790 0x563fbb09ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.581+0000 7eff37be2740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fbb0930b0 0x563fbb09d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.581+0000 7eff37be2740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563fbb09d950 0x563fbb09a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.581+0000 7eff37be2740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fbafb4180 con 0x563fbb0930b0 2024-09-13T17:15:00.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.581+0000 7eff37be2740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fbacce430 con 0x563fbb09d950 2024-09-13T17:15:00.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.581+0000 7eff37be2740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fbaf795e0 con 0x563fbb092790 2024-09-13T17:15:00.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.581+0000 7eff37be2740 10 client.0 _ll_register_callbacks cb 0x563fbafe5aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:00.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.581+0000 7eff2dd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fbb0930b0 0x563fbb09d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.581+0000 7eff2dd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fbb0930b0 0x563fbb09d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33334/0 (socket says 172.21.15.87:33334) 2024-09-13T17:15:00.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.581+0000 7eff2dd9b640 1 -- 172.21.15.87:0/860005528 learned_addr learned my addr 172.21.15.87:0/860005528 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:00.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.581+0000 7eff2e59c640 1 --2- 172.21.15.87:0/860005528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563fbb092790 0x563fbb09ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.581+0000 7eff2dd9b640 1 -- 172.21.15.87:0/860005528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563fbb092790 msgr2=0x563fbb09ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:00.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.581+0000 7eff2dd9b640 1 --2- 172.21.15.87:0/860005528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563fbb092790 0x563fbb09ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.581+0000 7eff2dd9b640 1 -- 172.21.15.87:0/860005528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563fbb09d950 msgr2=0x563fbb09a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:00.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.581+0000 7eff2dd9b640 1 --2- 172.21.15.87:0/860005528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563fbb09d950 0x563fbb09a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.581+0000 7eff2dd9b640 1 -- 172.21.15.87:0/860005528 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff2000ea00 con 0x563fbb0930b0 2024-09-13T17:15:00.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.581+0000 7eff2e59c640 1 --2- 172.21.15.87:0/860005528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563fbb092790 0x563fbb09ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:15:00.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.582+0000 7eff2dd9b640 1 --2- 172.21.15.87:0/860005528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fbb0930b0 0x563fbb09d410 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7eff18000c00 tx=0x7eff1808a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1166f7f738a765e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:00.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.582+0000 7eff15ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:15:00.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.582+0000 7eff15ffb640 1 -- 172.21.15.87:0/860005528 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff180ee170 con 0x563fbb0930b0 2024-09-13T17:15:00.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.582+0000 7eff15ffb640 1 -- 172.21.15.87:0/860005528 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7eff180baec0 con 0x563fbb0930b0 2024-09-13T17:15:00.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.582+0000 7eff37be2740 1 -- 172.21.15.87:0/860005528 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563fbb01fb80 con 0x563fbb0930b0 2024-09-13T17:15:00.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.582+0000 7eff15ffb640 1 -- 172.21.15.87:0/860005528 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff180becf0 con 0x563fbb0930b0 2024-09-13T17:15:00.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.582+0000 7eff37be2740 10 client.16035 fetch_fsmap learned FSMap version 24 2024-09-13T17:15:00.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.582+0000 7eff37be2740 1 -- 172.21.15.87:0/860005528 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x563fbaff43c0 con 0x563fbb0930b0 2024-09-13T17:15:00.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.582+0000 7eff15ffb640 1 -- 172.21.15.87:0/860005528 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x563fbb01fb80 con 0x563fbb0930b0 2024-09-13T17:15:00.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.582+0000 7eff15ffb640 1 -- 172.21.15.87:0/860005528 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7eff1804e070 con 0x563fbb0930b0 2024-09-13T17:15:00.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.582+0000 7eff37be2740 10 client.16035 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:15:00.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.582+0000 7eff37be2740 10 client.16035 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:15:00.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.582+0000 7eff37be2740 20 client.16035 populate_metadata read hostname 'smithi087' 2024-09-13T17:15:00.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.582+0000 7eff37be2740 1 --2- 172.21.15.87:0/860005528 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x563fbb0acef0 0x563fbb0af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.582+0000 7eff37be2740 4 client.16035 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:15:00.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.582+0000 7eff37be2740 1 -- 172.21.15.87:0/860005528 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563fbafe81f0 con 0x563fbb0acef0 2024-09-13T17:15:00.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.583+0000 7eff2e59c640 1 --2- 172.21.15.87:0/860005528 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x563fbb0acef0 0x563fbb0af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.583+0000 7eff15ffb640 10 client.16035 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:00.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.583+0000 7eff2e59c640 1 --2- 172.21.15.87:0/860005528 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x563fbb0acef0 0x563fbb0af2e0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dd7b80163854b61 server_cookie=a2d028f51523ea04 in_seq=0 out_seq=0 2024-09-13T17:15:00.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.584+0000 7eff15ffb640 1 -- 172.21.15.87:0/860005528 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x563fbafe81f0 con 0x563fbb0acef0 2024-09-13T17:15:00.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.584+0000 7eff15ffb640 10 client.16035 handle_command_reply: tid=0 2024-09-13T17:15:00.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.584+0000 7eff37be2740 1 client.16035 shutdown 2024-09-13T17:15:00.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.584+0000 7eff37be2740 1 -- 172.21.15.87:0/860005528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fbb0930b0 msgr2=0x563fbb09d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.584+0000 7eff37be2740 1 --2- 172.21.15.87:0/860005528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fbb0930b0 0x563fbb09d410 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7eff18000c00 tx=0x7eff1808a2a0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.584+0000 7eff37be2740 1 -- 172.21.15.87:0/860005528 shutdown_connections 2024-09-13T17:15:00.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.584+0000 7eff37be2740 1 --2- 172.21.15.87:0/860005528 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x563fbb0acef0 0x563fbb0af2e0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.584+0000 7eff37be2740 1 --2- 172.21.15.87:0/860005528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563fbb09d950 0x563fbb09a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.584+0000 7eff15ffb640 0 client.16035 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:00.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.584+0000 7eff37be2740 1 --2- 172.21.15.87:0/860005528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fbb0930b0 0x563fbb09d410 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.584+0000 7eff37be2740 1 --2- 172.21.15.87:0/860005528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563fbb092790 0x563fbb09ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.584+0000 7eff37be2740 1 -- 172.21.15.87:0/860005528 >> 172.21.15.87:0/860005528 conn(0x563fbb08ed00 msgr2=0x563fbb08deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:00.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.584+0000 7eff37be2740 1 -- 172.21.15.87:0/860005528 shutdown_connections 2024-09-13T17:15:00.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.584+0000 7eff37be2740 1 -- 172.21.15.87:0/860005528 wait complete. 2024-09-13T17:15:00.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.584+0000 7eff37be2740 20 client.16035 trim_cache size 0 max 16384 2024-09-13T17:15:00.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.595+0000 7eff37be2740 1 Processor -- start 2024-09-13T17:15:00.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.595+0000 7eff37be2740 1 -- start start 2024-09-13T17:15:00.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.595+0000 7eff37be2740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563fbb092790 0x563fbb08e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.595+0000 7eff37be2740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fbb0930b0 0x563fbb0a4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.595+0000 7eff37be2740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563fbb09d950 0x563fbb0a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.595+0000 7eff37be2740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fbb08f8b0 con 0x563fbb0930b0 2024-09-13T17:15:00.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.595+0000 7eff37be2740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fbb0a0400 con 0x563fbb092790 2024-09-13T17:15:00.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.595+0000 7eff37be2740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fbafe81f0 con 0x563fbb09d950 2024-09-13T17:15:00.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.595+0000 7eff2dd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fbb0930b0 0x563fbb0a4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.595+0000 7eff2dd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fbb0930b0 0x563fbb0a4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33340/0 (socket says 172.21.15.87:33340) 2024-09-13T17:15:00.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.595+0000 7eff2dd9b640 1 -- 172.21.15.87:0/3259657802 learned_addr learned my addr 172.21.15.87:0/3259657802 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:00.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.595+0000 7eff2e59c640 1 --2- 172.21.15.87:0/3259657802 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563fbb092790 0x563fbb08e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.595+0000 7eff2dd9b640 1 -- 172.21.15.87:0/3259657802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563fbb09d950 msgr2=0x563fbb0a4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:00.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.595+0000 7eff2dd9b640 1 --2- 172.21.15.87:0/3259657802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563fbb09d950 0x563fbb0a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.595+0000 7eff2dd9b640 1 -- 172.21.15.87:0/3259657802 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563fbb092790 msgr2=0x563fbb08e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:00.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.595+0000 7eff2dd9b640 1 --2- 172.21.15.87:0/3259657802 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563fbb092790 0x563fbb08e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.595+0000 7eff2dd9b640 1 -- 172.21.15.87:0/3259657802 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563fbaf96770 con 0x563fbb0930b0 2024-09-13T17:15:00.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.595+0000 7eff2e59c640 1 --2- 172.21.15.87:0/3259657802 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563fbb092790 0x563fbb08e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:15:00.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.595+0000 7eff2dd9b640 1 --2- 172.21.15.87:0/3259657802 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fbb0930b0 0x563fbb0a4620 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7eff18006010 tx=0x7eff1802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4178d377c15f4a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:00.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.596+0000 7eff257fa640 1 -- 172.21.15.87:0/3259657802 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff180f00f0 con 0x563fbb0930b0 2024-09-13T17:15:00.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.596+0000 7eff257fa640 1 -- 172.21.15.87:0/3259657802 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7eff180ee170 con 0x563fbb0930b0 2024-09-13T17:15:00.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.596+0000 7eff257fa640 1 -- 172.21.15.87:0/3259657802 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff180c3340 con 0x563fbb0930b0 2024-09-13T17:15:00.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.596+0000 7eff37be2740 1 -- 172.21.15.87:0/3259657802 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fbb0930b0 msgr2=0x563fbb0a4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.596+0000 7eff37be2740 1 --2- 172.21.15.87:0/3259657802 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fbb0930b0 0x563fbb0a4620 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7eff18006010 tx=0x7eff1802a420 comp rx=0 tx=0).stop 2024-09-13T17:15:00.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.596+0000 7eff37be2740 1 -- 172.21.15.87:0/3259657802 shutdown_connections 2024-09-13T17:15:00.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.596+0000 7eff37be2740 1 --2- 172.21.15.87:0/3259657802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563fbb09d950 0x563fbb0a4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.596+0000 7eff37be2740 1 --2- 172.21.15.87:0/3259657802 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fbb0930b0 0x563fbb0a4620 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.596+0000 7eff37be2740 1 --2- 172.21.15.87:0/3259657802 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563fbb092790 0x563fbb08e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.596+0000 7eff37be2740 1 -- 172.21.15.87:0/3259657802 >> 172.21.15.87:0/3259657802 conn(0x563fbb08ed00 msgr2=0x563fbb0a90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:00.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.596+0000 7eff37be2740 1 -- 172.21.15.87:0/3259657802 shutdown_connections 2024-09-13T17:15:00.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.596+0000 7eff37be2740 1 -- 172.21.15.87:0/3259657802 wait complete. 2024-09-13T17:15:00.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.596+0000 7eff37be2740 1 -- start start 2024-09-13T17:15:00.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.597+0000 7eff37be2740 1 Processor -- start 2024-09-13T17:15:00.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.597+0000 7eff37be2740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fbb092790 0x563fbb0a2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.597+0000 7eff37be2740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563fbb0930b0 0x563fbb0a2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.597+0000 7eff37be2740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563fbb09d950 0x563fbb102400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.597+0000 7eff37be2740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fbb0a3500 con 0x563fbb092790 2024-09-13T17:15:00.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.597+0000 7eff37be2740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fbb102940 con 0x563fbb09d950 2024-09-13T17:15:00.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.597+0000 7eff37be2740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fbb102b00 con 0x563fbb0930b0 2024-09-13T17:15:00.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.597+0000 7eff37be2740 10 client.0 _ll_register_callbacks cb 0x7eff2000e560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:00.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.597+0000 7eff2e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fbb092790 0x563fbb0a2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.597+0000 7eff2e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fbb092790 0x563fbb0a2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33346/0 (socket says 172.21.15.87:33346) 2024-09-13T17:15:00.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.597+0000 7eff2e59c640 1 -- 172.21.15.87:0/3133066669 learned_addr learned my addr 172.21.15.87:0/3133066669 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:00.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.597+0000 7eff2e59c640 1 -- 172.21.15.87:0/3133066669 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563fbb0930b0 msgr2=0x563fbb0a2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:00.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.597+0000 7eff2e59c640 1 --2- 172.21.15.87:0/3133066669 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563fbb0930b0 0x563fbb0a2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.597+0000 7eff2e59c640 1 -- 172.21.15.87:0/3133066669 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563fbb09d950 msgr2=0x563fbb102400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:00.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.597+0000 7eff2e59c640 1 --2- 172.21.15.87:0/3133066669 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563fbb09d950 0x563fbb102400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.597+0000 7eff2e59c640 1 -- 172.21.15.87:0/3133066669 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563fbaff43c0 con 0x563fbb092790 2024-09-13T17:15:00.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.597+0000 7eff2e59c640 1 --2- 172.21.15.87:0/3133066669 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fbb092790 0x563fbb0a2860 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7eff20009b70 tx=0x7eff200058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7a6c9dd4f8902d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:00.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.597+0000 7eff15ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:15:00.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.597+0000 7eff15ffb640 1 -- 172.21.15.87:0/3133066669 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2001d030 con 0x563fbb092790 2024-09-13T17:15:00.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.597+0000 7eff15ffb640 1 -- 172.21.15.87:0/3133066669 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7eff20021750 con 0x563fbb092790 2024-09-13T17:15:00.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.597+0000 7eff37be2740 1 -- 172.21.15.87:0/3133066669 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7eff20009d80 con 0x563fbb092790 2024-09-13T17:15:00.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.598+0000 7eff15ffb640 1 -- 172.21.15.87:0/3133066669 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff20021a90 con 0x563fbb092790 2024-09-13T17:15:00.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.598+0000 7eff37be2740 10 client.16041 fetch_fsmap learned FSMap version 24 2024-09-13T17:15:00.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.598+0000 7eff37be2740 1 -- 172.21.15.87:0/3133066669 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x563fbafbbe80 con 0x563fbb092790 2024-09-13T17:15:00.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.598+0000 7eff15ffb640 1 -- 172.21.15.87:0/3133066669 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7eff20009d80 con 0x563fbb092790 2024-09-13T17:15:00.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.598+0000 7eff15ffb640 1 -- 172.21.15.87:0/3133066669 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7eff20004a50 con 0x563fbb092790 2024-09-13T17:15:00.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.598+0000 7eff37be2740 10 client.16041 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:15:00.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.598+0000 7eff37be2740 10 client.16041 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:15:00.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.598+0000 7eff37be2740 20 client.16041 populate_metadata read hostname 'smithi087' 2024-09-13T17:15:00.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.598+0000 7eff37be2740 1 --2- 172.21.15.87:0/3133066669 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x563fbb104280 0x563fbb1066c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:00.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.598+0000 7eff37be2740 4 client.16041 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:15:00.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.598+0000 7eff37be2740 1 -- 172.21.15.87:0/3133066669 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563fbace94e0 con 0x563fbb104280 2024-09-13T17:15:00.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.598+0000 7eff2dd9b640 1 --2- 172.21.15.87:0/3133066669 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x563fbb104280 0x563fbb1066c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:00.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.599+0000 7eff15ffb640 10 client.16041 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:00.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.599+0000 7eff2dd9b640 1 --2- 172.21.15.87:0/3133066669 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x563fbb104280 0x563fbb1066c0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6dcfac4f0335f4b8 server_cookie=42fec740bd9ce576 in_seq=0 out_seq=0 2024-09-13T17:15:00.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.599+0000 7eff15ffb640 1 -- 172.21.15.87:0/3133066669 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563fbace94e0 con 0x563fbb104280 2024-09-13T17:15:00.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.599+0000 7eff15ffb640 10 client.16041 handle_command_reply: tid=0 2024-09-13T17:15:00.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.599+0000 7eff37be2740 1 client.16041 shutdown 2024-09-13T17:15:00.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.599+0000 7eff37be2740 1 -- 172.21.15.87:0/3133066669 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fbb092790 msgr2=0x563fbb0a2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.599+0000 7eff37be2740 1 --2- 172.21.15.87:0/3133066669 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fbb092790 0x563fbb0a2860 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7eff20009b70 tx=0x7eff200058e0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.599+0000 7eff37be2740 1 -- 172.21.15.87:0/3133066669 shutdown_connections 2024-09-13T17:15:00.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.599+0000 7eff37be2740 1 --2- 172.21.15.87:0/3133066669 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x563fbb104280 0x563fbb1066c0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.599+0000 7eff37be2740 1 --2- 172.21.15.87:0/3133066669 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563fbb09d950 0x563fbb102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.599+0000 7eff15ffb640 0 client.16041 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:00.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.599+0000 7eff37be2740 1 --2- 172.21.15.87:0/3133066669 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563fbb0930b0 0x563fbb0a2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.599+0000 7eff37be2740 1 --2- 172.21.15.87:0/3133066669 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563fbb092790 0x563fbb0a2860 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.599+0000 7eff37be2740 1 -- 172.21.15.87:0/3133066669 >> 172.21.15.87:0/3133066669 conn(0x563fbb08ed00 msgr2=0x563fbb095270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:00.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.599+0000 7eff37be2740 1 -- 172.21.15.87:0/3133066669 shutdown_connections 2024-09-13T17:15:00.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.599+0000 7eff37be2740 1 -- 172.21.15.87:0/3133066669 wait complete. 2024-09-13T17:15:00.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.599+0000 7eff37be2740 20 client.16041 trim_cache size 0 max 16384 2024-09-13T17:15:00.607 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:15:00.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.600+0000 7eff34ec5640 1 -- 172.21.15.87:0/561353337 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7eff1c0a1320 msgr2=0x7eff1c0a37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.600+0000 7eff34ec5640 1 --2- 172.21.15.87:0/561353337 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7eff1c0a1320 0x7eff1c0a37e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7eff28005c40 tx=0x7eff28009590 comp rx=0 tx=0).stop 2024-09-13T17:15:00.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.600+0000 7eff34ec5640 1 -- 172.21.15.87:0/561353337 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff30103fb0 msgr2=0x7eff30195730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:00.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.600+0000 7eff34ec5640 1 --2- 172.21.15.87:0/561353337 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff30103fb0 0x7eff30195730 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7eff18009900 tx=0x7eff180042f0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.600+0000 7eff34ec5640 1 -- 172.21.15.87:0/561353337 shutdown_connections 2024-09-13T17:15:00.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.600+0000 7eff34ec5640 1 --2- 172.21.15.87:0/561353337 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff30199b20 0x7eff30199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.600+0000 7eff34ec5640 1 --2- 172.21.15.87:0/561353337 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7eff1c0a1320 0x7eff1c0a37e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.600+0000 7eff34ec5640 1 --2- 172.21.15.87:0/561353337 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff30103fb0 0x7eff30195730 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.600+0000 7eff34ec5640 1 --2- 172.21.15.87:0/561353337 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff300fee60 0x7eff301951f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:00.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.600+0000 7eff34ec5640 1 -- 172.21.15.87:0/561353337 >> 172.21.15.87:0/561353337 conn(0x7eff30075c60 msgr2=0x7eff30102320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:00.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.600+0000 7eff34ec5640 1 -- 172.21.15.87:0/561353337 shutdown_connections 2024-09-13T17:15:00.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:00.600+0000 7eff34ec5640 1 -- 172.21.15.87:0/561353337 wait complete. 2024-09-13T17:15:00.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:00 smithi087 ceph-mon[30934]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T17:15:00.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:00 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3533408692' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:15:00.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:00 smithi149 ceph-mon[35496]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T17:15:00.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:00 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3533408692' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:15:00.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:00 smithi118 ceph-mon[34374]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T17:15:00.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:00 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3533408692' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:15:01.130 INFO:tasks.workunit.client.0.smithi087.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T17:15:01.194 INFO:tasks.workunit.client.0.smithi087.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T17:15:01.234 INFO:tasks.workunit.client.0.smithi087.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T17:15:01.235 INFO:tasks.workunit.client.0.smithi087.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T17:15:01.235 INFO:tasks.workunit.client.0.smithi087.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T17:15:01.273 INFO:tasks.workunit.client.0.smithi087.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T17:15:01.277 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T17:15:01.277 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-13T17:15:01.293 INFO:tasks.workunit:Running workunits matching fs/norstats on client.0... 2024-09-13T17:15:01.294 INFO:tasks.workunit:Running workunit fs/norstats/kernel_untar_tar.sh... 2024-09-13T17:15:01.294 DEBUG:teuthology.orchestra.run.smithi087:workunit test fs/norstats/kernel_untar_tar.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/norstats/kernel_untar_tar.sh 2024-09-13T17:15:01.611 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-13T17:15:01.612 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-09-13T17:15:01.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.719+0000 7fb297553640 1 -- 172.21.15.87:0/1637699771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb29010a310 msgr2=0x7fb29010c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.719+0000 7fb297553640 1 --2- 172.21.15.87:0/1637699771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb29010a310 0x7fb29010c790 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fb288009ca0 tx=0x7fb28802a950 comp rx=0 tx=0).stop 2024-09-13T17:15:01.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.719+0000 7fb297553640 1 -- 172.21.15.87:0/1637699771 shutdown_connections 2024-09-13T17:15:01.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.719+0000 7fb297553640 1 --2- 172.21.15.87:0/1637699771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb29010a310 0x7fb29010c790 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.719+0000 7fb297553640 1 --2- 172.21.15.87:0/1637699771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb290101860 0x7fb290109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.719+0000 7fb297553640 1 --2- 172.21.15.87:0/1637699771 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb290100f40 0x7fb290101320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.719+0000 7fb297553640 1 -- 172.21.15.87:0/1637699771 >> 172.21.15.87:0/1637699771 conn(0x7fb290075c60 msgr2=0x7fb2900fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:01.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.719+0000 7fb297553640 1 -- 172.21.15.87:0/1637699771 shutdown_connections 2024-09-13T17:15:01.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.719+0000 7fb297553640 1 -- 172.21.15.87:0/1637699771 wait complete. 2024-09-13T17:15:01.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.719+0000 7fb297553640 1 Processor -- start 2024-09-13T17:15:01.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.720+0000 7fb297553640 1 -- start start 2024-09-13T17:15:01.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.720+0000 7fb297553640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb290100f40 0x7fb2901962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.720+0000 7fb297553640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb290101860 0x7fb2901967e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.720+0000 7fb297553640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb29010a310 0x7fb29019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.720+0000 7fb297553640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29019b180 con 0x7fb290101860 2024-09-13T17:15:01.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.720+0000 7fb297553640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29019b2f0 con 0x7fb290100f40 2024-09-13T17:15:01.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.720+0000 7fb297553640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29019b4b0 con 0x7fb29010a310 2024-09-13T17:15:01.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.720+0000 7fb294aee640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb290101860 0x7fb2901967e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.720+0000 7fb294aee640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb290101860 0x7fb2901967e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33364/0 (socket says 172.21.15.87:33364) 2024-09-13T17:15:01.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.720+0000 7fb294aee640 1 -- 172.21.15.87:0/3846373654 learned_addr learned my addr 172.21.15.87:0/3846373654 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:01.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.720+0000 7fb2952ef640 1 --2- 172.21.15.87:0/3846373654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb290100f40 0x7fb2901962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.720+0000 7fb295af0640 1 --2- 172.21.15.87:0/3846373654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb29010a310 0x7fb29019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.720+0000 7fb294aee640 1 -- 172.21.15.87:0/3846373654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb29010a310 msgr2=0x7fb29019ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.720+0000 7fb294aee640 1 --2- 172.21.15.87:0/3846373654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb29010a310 0x7fb29019ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.720+0000 7fb294aee640 1 -- 172.21.15.87:0/3846373654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb290100f40 msgr2=0x7fb2901962a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.720+0000 7fb294aee640 1 --2- 172.21.15.87:0/3846373654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb290100f40 0x7fb2901962a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.720+0000 7fb294aee640 1 -- 172.21.15.87:0/3846373654 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb288009900 con 0x7fb290101860 2024-09-13T17:15:01.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.720+0000 7fb2952ef640 1 --2- 172.21.15.87:0/3846373654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb290100f40 0x7fb2901962a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:01.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.720+0000 7fb295af0640 1 --2- 172.21.15.87:0/3846373654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb29010a310 0x7fb29019ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:15:01.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.720+0000 7fb294aee640 1 --2- 172.21.15.87:0/3846373654 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb290101860 0x7fb2901967e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb28000d950 tx=0x7fb28000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:01.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.721+0000 7fb2867fc640 1 -- 172.21.15.87:0/3846373654 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb280009c30 con 0x7fb290101860 2024-09-13T17:15:01.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.721+0000 7fb297553640 1 -- 172.21.15.87:0/3846373654 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb29019b790 con 0x7fb290101860 2024-09-13T17:15:01.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.721+0000 7fb2867fc640 1 -- 172.21.15.87:0/3846373654 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb280009d90 con 0x7fb290101860 2024-09-13T17:15:01.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.721+0000 7fb2867fc640 1 -- 172.21.15.87:0/3846373654 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28000f6b0 con 0x7fb290101860 2024-09-13T17:15:01.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.721+0000 7fb297553640 1 -- 172.21.15.87:0/3846373654 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2901a3010 con 0x7fb290101860 2024-09-13T17:15:01.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.723+0000 7fb2867fc640 1 -- 172.21.15.87:0/3846373654 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 25) v1 ==== 136106+0+0 (secure 0 0 0) 0x7fb280010aa0 con 0x7fb290101860 2024-09-13T17:15:01.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.724+0000 7fb29a272740 1 Processor -- start 2024-09-13T17:15:01.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.724+0000 7fb29a272740 1 -- start start 2024-09-13T17:15:01.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.724+0000 7fb2867fc640 1 --2- 172.21.15.87:0/3846373654 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb27c0a1320 0x7fb27c0a37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.724+0000 7fb29a272740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d9ec8737c0 0x55d9ec873ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.724+0000 7fb29a272740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d9ec8740e0 0x55d9ec87e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.724+0000 7fb29a272740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9ec87e980 0x55d9ec880d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.724+0000 7fb295af0640 1 --2- 172.21.15.87:0/3846373654 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb27c0a1320 0x7fb27c0a37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.724+0000 7fb29a272740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9ec7dec60 con 0x55d9ec87e980 2024-09-13T17:15:01.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.724+0000 7fb29a272740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9ec7dc3f0 con 0x55d9ec8740e0 2024-09-13T17:15:01.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.724+0000 7fb29a272740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9ec7d7ce0 con 0x55d9ec8737c0 2024-09-13T17:15:01.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.724+0000 7fb2867fc640 1 -- 172.21.15.87:0/3846373654 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fb2800cd030 con 0x7fb290101860 2024-09-13T17:15:01.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.724+0000 7fb295af0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9ec87e980 0x55d9ec880d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.724+0000 7fb295af0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9ec87e980 0x55d9ec880d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33380/0 (socket says 172.21.15.87:33380) 2024-09-13T17:15:01.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.724+0000 7fb295af0640 1 -- 172.21.15.87:0/4031825807 learned_addr learned my addr 172.21.15.87:0/4031825807 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:01.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.724+0000 7fb2952ef640 1 --2- 172.21.15.87:0/4031825807 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d9ec8737c0 0x55d9ec873ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.724+0000 7fb294aee640 1 --2- 172.21.15.87:0/4031825807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d9ec8740e0 0x55d9ec87e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.725+0000 7fb295af0640 1 -- 172.21.15.87:0/4031825807 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d9ec8737c0 msgr2=0x55d9ec873ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:01.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.725+0000 7fb295af0640 1 --2- 172.21.15.87:0/4031825807 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d9ec8737c0 0x55d9ec873ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.725+0000 7fb295af0640 1 -- 172.21.15.87:0/4031825807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d9ec8740e0 msgr2=0x55d9ec87e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:01.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.725+0000 7fb295af0640 1 --2- 172.21.15.87:0/4031825807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d9ec8740e0 0x55d9ec87e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.725+0000 7fb295af0640 1 -- 172.21.15.87:0/4031825807 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9ec793970 con 0x55d9ec87e980 2024-09-13T17:15:01.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.725+0000 7fb294aee640 1 --2- 172.21.15.87:0/4031825807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d9ec8740e0 0x55d9ec87e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:15:01.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.725+0000 7fb295af0640 1 --2- 172.21.15.87:0/3846373654 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb27c0a1320 0x7fb27c0a37e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb28802f530 tx=0x7fb28802fa20 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:01.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.725+0000 7fb295af0640 1 --2- 172.21.15.87:0/4031825807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9ec87e980 0x55d9ec880d70 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb28802f560 tx=0x7fb288048000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a781a055c0a1bf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:01.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.725+0000 7fb27b7fe640 1 -- 172.21.15.87:0/4031825807 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb288003d70 con 0x55d9ec87e980 2024-09-13T17:15:01.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.725+0000 7fb27b7fe640 1 -- 172.21.15.87:0/4031825807 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb288030440 con 0x55d9ec87e980 2024-09-13T17:15:01.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.725+0000 7fb27b7fe640 1 -- 172.21.15.87:0/4031825807 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb288004240 con 0x55d9ec87e980 2024-09-13T17:15:01.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.726+0000 7fb29a272740 1 -- 172.21.15.87:0/4031825807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9ec87e980 msgr2=0x55d9ec880d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.726+0000 7fb29a272740 1 --2- 172.21.15.87:0/4031825807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9ec87e980 0x55d9ec880d70 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb28802f560 tx=0x7fb288048000 comp rx=0 tx=0).stop 2024-09-13T17:15:01.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.726+0000 7fb29a272740 1 -- 172.21.15.87:0/4031825807 shutdown_connections 2024-09-13T17:15:01.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.726+0000 7fb29a272740 1 --2- 172.21.15.87:0/4031825807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9ec87e980 0x55d9ec880d70 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.726+0000 7fb29a272740 1 --2- 172.21.15.87:0/4031825807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d9ec8740e0 0x55d9ec87e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.726+0000 7fb29a272740 1 --2- 172.21.15.87:0/4031825807 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d9ec8737c0 0x55d9ec873ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.726+0000 7fb29a272740 1 -- 172.21.15.87:0/4031825807 >> 172.21.15.87:0/4031825807 conn(0x55d9ec86fd50 msgr2=0x55d9ec870130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:01.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.726+0000 7fb29a272740 1 -- 172.21.15.87:0/4031825807 shutdown_connections 2024-09-13T17:15:01.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.726+0000 7fb29a272740 1 -- 172.21.15.87:0/4031825807 wait complete. 2024-09-13T17:15:01.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.726+0000 7fb29a272740 1 -- start start 2024-09-13T17:15:01.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.726+0000 7fb29a272740 1 Processor -- start 2024-09-13T17:15:01.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.727+0000 7fb29a272740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9ec8737c0 0x55d9ec87e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.727+0000 7fb29a272740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d9ec8740e0 0x55d9ec87b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.727+0000 7fb29a272740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d9ec87e980 0x55d9ec87bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.727+0000 7fb29a272740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9ec795f80 con 0x55d9ec8737c0 2024-09-13T17:15:01.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.727+0000 7fb29a272740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9ec795c20 con 0x55d9ec87e980 2024-09-13T17:15:01.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.727+0000 7fb29a272740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9ec762ab0 con 0x55d9ec8740e0 2024-09-13T17:15:01.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.727+0000 7fb29a272740 10 client.0 _ll_register_callbacks cb 0x55d9ec7d1350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:01.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.727+0000 7fb2952ef640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9ec8737c0 0x55d9ec87e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.727+0000 7fb2952ef640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9ec8737c0 0x55d9ec87e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33382/0 (socket says 172.21.15.87:33382) 2024-09-13T17:15:01.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.727+0000 7fb2952ef640 1 -- 172.21.15.87:0/1954346624 learned_addr learned my addr 172.21.15.87:0/1954346624 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:01.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.727+0000 7fb294aee640 1 --2- 172.21.15.87:0/1954346624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d9ec8740e0 0x55d9ec87b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.727+0000 7fb295af0640 1 --2- 172.21.15.87:0/1954346624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d9ec87e980 0x55d9ec87bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.727+0000 7fb2952ef640 1 -- 172.21.15.87:0/1954346624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d9ec8740e0 msgr2=0x55d9ec87b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:01.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.727+0000 7fb2952ef640 1 --2- 172.21.15.87:0/1954346624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d9ec8740e0 0x55d9ec87b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.727+0000 7fb2952ef640 1 -- 172.21.15.87:0/1954346624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d9ec87e980 msgr2=0x55d9ec87bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:01.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.727+0000 7fb2952ef640 1 --2- 172.21.15.87:0/1954346624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d9ec87e980 0x55d9ec87bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.727+0000 7fb2952ef640 1 -- 172.21.15.87:0/1954346624 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb288044040 con 0x55d9ec8737c0 2024-09-13T17:15:01.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.727+0000 7fb295af0640 1 --2- 172.21.15.87:0/1954346624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d9ec87e980 0x55d9ec87bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:15:01.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.727+0000 7fb294aee640 1 --2- 172.21.15.87:0/1954346624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d9ec8740e0 0x55d9ec87b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:01.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.727+0000 7fb2952ef640 1 --2- 172.21.15.87:0/1954346624 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9ec8737c0 0x55d9ec87e3c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb28c00bb40 tx=0x7fb28c0044f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc478f23aaf1ecca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:01.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.727+0000 7fb278ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:15:01.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.728+0000 7fb278ff9640 1 -- 172.21.15.87:0/1954346624 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c003ea0 con 0x55d9ec8737c0 2024-09-13T17:15:01.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.728+0000 7fb278ff9640 1 -- 172.21.15.87:0/1954346624 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fb28c011440 con 0x55d9ec8737c0 2024-09-13T17:15:01.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.728+0000 7fb29a272740 1 -- 172.21.15.87:0/1954346624 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d9ec4cb590 con 0x55d9ec8737c0 2024-09-13T17:15:01.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.728+0000 7fb278ff9640 1 -- 172.21.15.87:0/1954346624 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb28c01b640 con 0x55d9ec8737c0 2024-09-13T17:15:01.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.728+0000 7fb29a272740 10 client.16053 fetch_fsmap learned FSMap version 24 2024-09-13T17:15:01.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.728+0000 7fb29a272740 1 -- 172.21.15.87:0/1954346624 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55d9ec7d6360 con 0x55d9ec8737c0 2024-09-13T17:15:01.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.728+0000 7fb278ff9640 1 -- 172.21.15.87:0/1954346624 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55d9ec4cb590 con 0x55d9ec8737c0 2024-09-13T17:15:01.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.728+0000 7fb278ff9640 1 -- 172.21.15.87:0/1954346624 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fb28c011b70 con 0x55d9ec8737c0 2024-09-13T17:15:01.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.728+0000 7fb29a272740 10 client.16053 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:15:01.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.728+0000 7fb29a272740 10 client.16053 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:15:01.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.728+0000 7fb29a272740 20 client.16053 populate_metadata read hostname 'smithi087' 2024-09-13T17:15:01.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.728+0000 7fb29a272740 1 --2- 172.21.15.87:0/1954346624 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55d9ec88e870 0x55d9ec890c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.728+0000 7fb29a272740 4 client.16053 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:15:01.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.728+0000 7fb29a272740 1 -- 172.21.15.87:0/1954346624 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d9ec4dc860 con 0x55d9ec88e870 2024-09-13T17:15:01.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.729+0000 7fb294aee640 1 --2- 172.21.15.87:0/1954346624 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55d9ec88e870 0x55d9ec890c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.729+0000 7fb278ff9640 10 client.16053 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:01.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.729+0000 7fb294aee640 1 --2- 172.21.15.87:0/1954346624 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55d9ec88e870 0x55d9ec890c90 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31a6f3a6c8f19981 server_cookie=4b004d86d5c3d18e in_seq=0 out_seq=0 2024-09-13T17:15:01.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.730+0000 7fb278ff9640 1 -- 172.21.15.87:0/1954346624 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55d9ec4dc860 con 0x55d9ec88e870 2024-09-13T17:15:01.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.730+0000 7fb278ff9640 10 client.16053 handle_command_reply: tid=0 2024-09-13T17:15:01.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.730+0000 7fb29a272740 1 client.16053 shutdown 2024-09-13T17:15:01.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.730+0000 7fb29a272740 1 -- 172.21.15.87:0/1954346624 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9ec8737c0 msgr2=0x55d9ec87e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.730+0000 7fb29a272740 1 --2- 172.21.15.87:0/1954346624 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9ec8737c0 0x55d9ec87e3c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb28c00bb40 tx=0x7fb28c0044f0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.730+0000 7fb29a272740 1 -- 172.21.15.87:0/1954346624 shutdown_connections 2024-09-13T17:15:01.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.730+0000 7fb29a272740 1 --2- 172.21.15.87:0/1954346624 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55d9ec88e870 0x55d9ec890c90 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.730+0000 7fb278ff9640 0 client.16053 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:01.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.730+0000 7fb29a272740 1 --2- 172.21.15.87:0/1954346624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d9ec87e980 0x55d9ec87bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.730+0000 7fb29a272740 1 --2- 172.21.15.87:0/1954346624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d9ec8740e0 0x55d9ec87b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.730+0000 7fb29a272740 1 --2- 172.21.15.87:0/1954346624 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9ec8737c0 0x55d9ec87e3c0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.730+0000 7fb29a272740 1 -- 172.21.15.87:0/1954346624 >> 172.21.15.87:0/1954346624 conn(0x55d9ec86fd50 msgr2=0x55d9ec8751a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:01.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.730+0000 7fb29a272740 1 -- 172.21.15.87:0/1954346624 shutdown_connections 2024-09-13T17:15:01.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.730+0000 7fb29a272740 1 -- 172.21.15.87:0/1954346624 wait complete. 2024-09-13T17:15:01.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.730+0000 7fb29a272740 20 client.16053 trim_cache size 0 max 16384 2024-09-13T17:15:01.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.748+0000 7fb29a272740 1 Processor -- start 2024-09-13T17:15:01.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.748+0000 7fb29a272740 1 -- start start 2024-09-13T17:15:01.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.748+0000 7fb29a272740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d9ec8737c0 0x55d9ec8856a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.748+0000 7fb29a272740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9ec8740e0 0x55d9ec885be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.748+0000 7fb29a272740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d9ec87e980 0x55d9ec87aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.748+0000 7fb29a272740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9ec4cb590 con 0x55d9ec8740e0 2024-09-13T17:15:01.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.748+0000 7fb29a272740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9ec88e6a0 con 0x55d9ec8737c0 2024-09-13T17:15:01.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.748+0000 7fb29a272740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9ec87c5a0 con 0x55d9ec87e980 2024-09-13T17:15:01.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.748+0000 7fb294aee640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9ec8740e0 0x55d9ec885be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.748+0000 7fb294aee640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9ec8740e0 0x55d9ec885be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33384/0 (socket says 172.21.15.87:33384) 2024-09-13T17:15:01.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.748+0000 7fb294aee640 1 -- 172.21.15.87:0/518573268 learned_addr learned my addr 172.21.15.87:0/518573268 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:01.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.748+0000 7fb2952ef640 1 --2- 172.21.15.87:0/518573268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d9ec8737c0 0x55d9ec8856a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.748+0000 7fb295af0640 1 --2- 172.21.15.87:0/518573268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d9ec87e980 0x55d9ec87aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.748+0000 7fb294aee640 1 -- 172.21.15.87:0/518573268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d9ec87e980 msgr2=0x55d9ec87aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:01.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.748+0000 7fb294aee640 1 --2- 172.21.15.87:0/518573268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d9ec87e980 0x55d9ec87aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.748+0000 7fb294aee640 1 -- 172.21.15.87:0/518573268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d9ec8737c0 msgr2=0x55d9ec8856a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:01.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.748+0000 7fb294aee640 1 --2- 172.21.15.87:0/518573268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d9ec8737c0 0x55d9ec8856a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.748+0000 7fb294aee640 1 -- 172.21.15.87:0/518573268 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9ec7781c0 con 0x55d9ec8740e0 2024-09-13T17:15:01.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.748+0000 7fb294aee640 1 --2- 172.21.15.87:0/518573268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9ec8740e0 0x55d9ec885be0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb2800965b0 tx=0x7fb280095fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6ba99378e5b1d4a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:01.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.749+0000 7fb27bfff640 1 -- 172.21.15.87:0/518573268 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2800b9040 con 0x55d9ec8740e0 2024-09-13T17:15:01.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.749+0000 7fb27bfff640 1 -- 172.21.15.87:0/518573268 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb280097d40 con 0x55d9ec8740e0 2024-09-13T17:15:01.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.749+0000 7fb27bfff640 1 -- 172.21.15.87:0/518573268 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2800ca530 con 0x55d9ec8740e0 2024-09-13T17:15:01.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.749+0000 7fb29a272740 1 -- 172.21.15.87:0/518573268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9ec8740e0 msgr2=0x55d9ec885be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.749+0000 7fb29a272740 1 --2- 172.21.15.87:0/518573268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9ec8740e0 0x55d9ec885be0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb2800965b0 tx=0x7fb280095fb0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.749+0000 7fb29a272740 1 -- 172.21.15.87:0/518573268 shutdown_connections 2024-09-13T17:15:01.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.749+0000 7fb29a272740 1 --2- 172.21.15.87:0/518573268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d9ec87e980 0x55d9ec87aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.749+0000 7fb29a272740 1 --2- 172.21.15.87:0/518573268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9ec8740e0 0x55d9ec885be0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.749+0000 7fb29a272740 1 --2- 172.21.15.87:0/518573268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d9ec8737c0 0x55d9ec8856a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.749+0000 7fb29a272740 1 -- 172.21.15.87:0/518573268 >> 172.21.15.87:0/518573268 conn(0x55d9ec86fd50 msgr2=0x55d9ec8768e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:01.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.750+0000 7fb29a272740 1 -- 172.21.15.87:0/518573268 shutdown_connections 2024-09-13T17:15:01.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.750+0000 7fb29a272740 1 -- 172.21.15.87:0/518573268 wait complete. 2024-09-13T17:15:01.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.750+0000 7fb29a272740 1 -- start start 2024-09-13T17:15:01.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.750+0000 7fb29a272740 1 Processor -- start 2024-09-13T17:15:01.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.750+0000 7fb29a272740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d9ec8737c0 0x55d9ec8841a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.750+0000 7fb29a272740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d9ec8740e0 0x55d9ec8846e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.750+0000 7fb29a272740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9ec87e980 0x55d9ec884c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.750+0000 7fb29a272740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9ec8e4dc0 con 0x55d9ec87e980 2024-09-13T17:15:01.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.750+0000 7fb29a272740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9ec8e4f00 con 0x55d9ec8740e0 2024-09-13T17:15:01.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.750+0000 7fb29a272740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9ec8e5040 con 0x55d9ec8737c0 2024-09-13T17:15:01.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.750+0000 7fb29a272740 10 client.0 _ll_register_callbacks cb 0x7fb28c0043b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:01.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.750+0000 7fb295af0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9ec87e980 0x55d9ec884c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.750+0000 7fb295af0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9ec87e980 0x55d9ec884c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33388/0 (socket says 172.21.15.87:33388) 2024-09-13T17:15:01.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.750+0000 7fb295af0640 1 -- 172.21.15.87:0/2012649112 learned_addr learned my addr 172.21.15.87:0/2012649112 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:01.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.751+0000 7fb2952ef640 1 --2- 172.21.15.87:0/2012649112 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d9ec8737c0 0x55d9ec8841a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.751+0000 7fb294aee640 1 --2- 172.21.15.87:0/2012649112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d9ec8740e0 0x55d9ec8846e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.751+0000 7fb295af0640 1 -- 172.21.15.87:0/2012649112 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d9ec8737c0 msgr2=0x55d9ec8841a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:01.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.751+0000 7fb295af0640 1 --2- 172.21.15.87:0/2012649112 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d9ec8737c0 0x55d9ec8841a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.751+0000 7fb295af0640 1 -- 172.21.15.87:0/2012649112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d9ec8740e0 msgr2=0x55d9ec8846e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:01.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.751+0000 7fb295af0640 1 --2- 172.21.15.87:0/2012649112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d9ec8740e0 0x55d9ec8846e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.751+0000 7fb295af0640 1 -- 172.21.15.87:0/2012649112 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb29019b790 con 0x55d9ec87e980 2024-09-13T17:15:01.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.751+0000 7fb295af0640 1 --2- 172.21.15.87:0/2012649112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9ec87e980 0x55d9ec884c20 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb288004af0 tx=0x7fb288005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cafffae0ab62c71c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:01.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.751+0000 7fb278ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:15:01.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.751+0000 7fb278ff9640 1 -- 172.21.15.87:0/2012649112 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2880305b0 con 0x55d9ec87e980 2024-09-13T17:15:01.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.751+0000 7fb29a272740 1 -- 172.21.15.87:0/2012649112 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d9ec52feb0 con 0x55d9ec87e980 2024-09-13T17:15:01.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.751+0000 7fb278ff9640 1 -- 172.21.15.87:0/2012649112 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fb288030710 con 0x55d9ec87e980 2024-09-13T17:15:01.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.751+0000 7fb278ff9640 1 -- 172.21.15.87:0/2012649112 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2880308d0 con 0x55d9ec87e980 2024-09-13T17:15:01.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.751+0000 7fb29a272740 10 client.16059 fetch_fsmap learned FSMap version 24 2024-09-13T17:15:01.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.751+0000 7fb29a272740 1 -- 172.21.15.87:0/2012649112 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55d9ec79d990 con 0x55d9ec87e980 2024-09-13T17:15:01.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.751+0000 7fb278ff9640 1 -- 172.21.15.87:0/2012649112 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55d9ec52feb0 con 0x55d9ec87e980 2024-09-13T17:15:01.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.752+0000 7fb278ff9640 1 -- 172.21.15.87:0/2012649112 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fb28804a470 con 0x55d9ec87e980 2024-09-13T17:15:01.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.752+0000 7fb29a272740 10 client.16059 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:15:01.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.752+0000 7fb29a272740 10 client.16059 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:15:01.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.752+0000 7fb29a272740 20 client.16059 populate_metadata read hostname 'smithi087' 2024-09-13T17:15:01.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.752+0000 7fb29a272740 1 --2- 172.21.15.87:0/2012649112 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55d9ec88e870 0x55d9ec8e8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.752+0000 7fb29a272740 4 client.16059 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-13T17:15:01.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.752+0000 7fb29a272740 1 -- 172.21.15.87:0/2012649112 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55d9ec8e8c70 con 0x55d9ec88e870 2024-09-13T17:15:01.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.752+0000 7fb2952ef640 1 --2- 172.21.15.87:0/2012649112 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55d9ec88e870 0x55d9ec8e8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.752+0000 7fb2952ef640 1 --2- 172.21.15.87:0/2012649112 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55d9ec88e870 0x55d9ec8e8450 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67f092d4a6aee1c9 server_cookie=4cf49efbec123e61 in_seq=0 out_seq=0 2024-09-13T17:15:01.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.752+0000 7fb278ff9640 10 client.16059 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:01.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.753+0000 7fb278ff9640 1 -- 172.21.15.87:0/2012649112 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55d9ec8e8c70 con 0x55d9ec88e870 2024-09-13T17:15:01.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.753+0000 7fb278ff9640 10 client.16059 handle_command_reply: tid=0 2024-09-13T17:15:01.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.753+0000 7fb29a272740 1 client.16059 shutdown 2024-09-13T17:15:01.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.754+0000 7fb29a272740 1 -- 172.21.15.87:0/2012649112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9ec87e980 msgr2=0x55d9ec884c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.754+0000 7fb29a272740 1 --2- 172.21.15.87:0/2012649112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9ec87e980 0x55d9ec884c20 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb288004af0 tx=0x7fb288005fa0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.754+0000 7fb29a272740 1 -- 172.21.15.87:0/2012649112 shutdown_connections 2024-09-13T17:15:01.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.754+0000 7fb29a272740 1 --2- 172.21.15.87:0/2012649112 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55d9ec88e870 0x55d9ec8e8450 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.754+0000 7fb29a272740 1 --2- 172.21.15.87:0/2012649112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9ec87e980 0x55d9ec884c20 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.754+0000 7fb29a272740 1 --2- 172.21.15.87:0/2012649112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d9ec8740e0 0x55d9ec8846e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.754+0000 7fb29a272740 1 --2- 172.21.15.87:0/2012649112 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d9ec8737c0 0x55d9ec8841a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.754+0000 7fb278ff9640 0 client.16059 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:01.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.754+0000 7fb29a272740 1 -- 172.21.15.87:0/2012649112 >> 172.21.15.87:0/2012649112 conn(0x55d9ec86fd50 msgr2=0x55d9ec8751a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:01.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.754+0000 7fb29a272740 1 -- 172.21.15.87:0/2012649112 shutdown_connections 2024-09-13T17:15:01.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.754+0000 7fb29a272740 1 -- 172.21.15.87:0/2012649112 wait complete. 2024-09-13T17:15:01.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.754+0000 7fb29a272740 20 client.16059 trim_cache size 0 max 16384 2024-09-13T17:15:01.761 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:15:01.761 INFO:teuthology.orchestra.run.smithi087.stdout: "return_code": 0, 2024-09-13T17:15:01.761 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_tag": "ce96bd85-c059-4c0d-b114-5be82032a6df", 2024-09-13T17:15:01.762 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": "asynchronous" 2024-09-13T17:15:01.762 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:15:01.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.754+0000 7fb297553640 1 -- 172.21.15.87:0/3846373654 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb27c0a1320 msgr2=0x7fb27c0a37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.754+0000 7fb297553640 1 --2- 172.21.15.87:0/3846373654 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb27c0a1320 0x7fb27c0a37e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb28802f530 tx=0x7fb28802fa20 comp rx=0 tx=0).stop 2024-09-13T17:15:01.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.754+0000 7fb297553640 1 -- 172.21.15.87:0/3846373654 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb290101860 msgr2=0x7fb2901967e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.754+0000 7fb297553640 1 --2- 172.21.15.87:0/3846373654 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb290101860 0x7fb2901967e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb28000d950 tx=0x7fb28000de10 comp rx=0 tx=0).stop 2024-09-13T17:15:01.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.755+0000 7fb297553640 1 -- 172.21.15.87:0/3846373654 shutdown_connections 2024-09-13T17:15:01.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.755+0000 7fb297553640 1 --2- 172.21.15.87:0/3846373654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb29010a310 0x7fb29019ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.755+0000 7fb297553640 1 --2- 172.21.15.87:0/3846373654 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb27c0a1320 0x7fb27c0a37e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.755+0000 7fb297553640 1 --2- 172.21.15.87:0/3846373654 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb290101860 0x7fb2901967e0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.755+0000 7fb297553640 1 --2- 172.21.15.87:0/3846373654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb290100f40 0x7fb2901962a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.755+0000 7fb297553640 1 -- 172.21.15.87:0/3846373654 >> 172.21.15.87:0/3846373654 conn(0x7fb290075c60 msgr2=0x7fb2900fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:01.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.755+0000 7fb297553640 1 -- 172.21.15.87:0/3846373654 shutdown_connections 2024-09-13T17:15:01.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.755+0000 7fb297553640 1 -- 172.21.15.87:0/3846373654 wait complete. 2024-09-13T17:15:01.768 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:15:01.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.875+0000 7f7da084f640 1 -- 172.21.15.87:0/74749140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d9c101860 msgr2=0x7f7d9c109d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.875+0000 7f7da084f640 1 --2- 172.21.15.87:0/74749140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d9c101860 0x7f7d9c109d40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f7d90009900 tx=0x7f7d9002a480 comp rx=0 tx=0).stop 2024-09-13T17:15:01.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.875+0000 7f7da084f640 1 -- 172.21.15.87:0/74749140 shutdown_connections 2024-09-13T17:15:01.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.875+0000 7f7da084f640 1 --2- 172.21.15.87:0/74749140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d9c10a310 0x7f7d9c10c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.875+0000 7f7da084f640 1 --2- 172.21.15.87:0/74749140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d9c101860 0x7f7d9c109d40 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.875+0000 7f7da084f640 1 --2- 172.21.15.87:0/74749140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d9c100f40 0x7f7d9c101320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.875+0000 7f7da084f640 1 -- 172.21.15.87:0/74749140 >> 172.21.15.87:0/74749140 conn(0x7f7d9c075c60 msgr2=0x7f7d9c0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:01.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.875+0000 7f7da084f640 1 -- 172.21.15.87:0/74749140 shutdown_connections 2024-09-13T17:15:01.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.876+0000 7f7da084f640 1 -- 172.21.15.87:0/74749140 wait complete. 2024-09-13T17:15:01.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.876+0000 7f7da084f640 1 Processor -- start 2024-09-13T17:15:01.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.876+0000 7f7da084f640 1 -- start start 2024-09-13T17:15:01.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.876+0000 7f7da084f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d9c100f40 0x7f7d9c196220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.876+0000 7f7da084f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d9c101860 0x7f7d9c196760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.877+0000 7f7da084f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d9c10a310 0x7f7d9c19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.877+0000 7f7da084f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c19b150 con 0x7f7d9c10a310 2024-09-13T17:15:01.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.877+0000 7f7da084f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c19b2c0 con 0x7f7d9c101860 2024-09-13T17:15:01.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.877+0000 7f7da084f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c19b480 con 0x7f7d9c100f40 2024-09-13T17:15:01.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.877+0000 7f7d9ad9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d9c10a310 0x7f7d9c19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.877+0000 7f7d9ad9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d9c10a310 0x7f7d9c19ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33408/0 (socket says 172.21.15.87:33408) 2024-09-13T17:15:01.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.877+0000 7f7d9ad9d640 1 -- 172.21.15.87:0/4060379169 learned_addr learned my addr 172.21.15.87:0/4060379169 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:01.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.877+0000 7f7d9a59c640 1 --2- 172.21.15.87:0/4060379169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d9c100f40 0x7f7d9c196220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.877+0000 7f7d99d9b640 1 --2- 172.21.15.87:0/4060379169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d9c101860 0x7f7d9c196760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.877+0000 7f7d9ad9d640 1 -- 172.21.15.87:0/4060379169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d9c100f40 msgr2=0x7f7d9c196220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.877+0000 7f7d9ad9d640 1 --2- 172.21.15.87:0/4060379169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d9c100f40 0x7f7d9c196220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.877+0000 7f7d9ad9d640 1 -- 172.21.15.87:0/4060379169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d9c101860 msgr2=0x7f7d9c196760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.877+0000 7f7d9ad9d640 1 --2- 172.21.15.87:0/4060379169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d9c101860 0x7f7d9c196760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.877+0000 7f7d9ad9d640 1 -- 172.21.15.87:0/4060379169 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d90009560 con 0x7f7d9c10a310 2024-09-13T17:15:01.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.877+0000 7f7d99d9b640 1 --2- 172.21.15.87:0/4060379169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d9c101860 0x7f7d9c196760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:01.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.877+0000 7f7d9a59c640 1 --2- 172.21.15.87:0/4060379169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d9c100f40 0x7f7d9c196220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:15:01.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.877+0000 7f7d9ad9d640 1 --2- 172.21.15.87:0/4060379169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d9c10a310 0x7f7d9c19ab50 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f7d9400ea60 tx=0x7f7d9400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:01.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.877+0000 7f7d8b7fe640 1 -- 172.21.15.87:0/4060379169 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9400ce40 con 0x7f7d9c10a310 2024-09-13T17:15:01.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.877+0000 7f7da084f640 1 -- 172.21.15.87:0/4060379169 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d9c19b760 con 0x7f7d9c10a310 2024-09-13T17:15:01.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.877+0000 7f7d8b7fe640 1 -- 172.21.15.87:0/4060379169 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7d94005020 con 0x7f7d9c10a310 2024-09-13T17:15:01.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.877+0000 7f7d8b7fe640 1 -- 172.21.15.87:0/4060379169 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d94010690 con 0x7f7d9c10a310 2024-09-13T17:15:01.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.878+0000 7f7da084f640 1 -- 172.21.15.87:0/4060379169 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d9c1a2fe0 con 0x7f7d9c10a310 2024-09-13T17:15:01.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.880+0000 7f7da364d740 1 Processor -- start 2024-09-13T17:15:01.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.880+0000 7f7d8b7fe640 1 -- 172.21.15.87:0/4060379169 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 25) v1 ==== 136106+0+0 (secure 0 0 0) 0x7f7d94005190 con 0x7f7d9c10a310 2024-09-13T17:15:01.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.881+0000 7f7da364d740 1 -- start start 2024-09-13T17:15:01.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.881+0000 7f7da364d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565308a62e10 0x565308a631f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.881+0000 7f7da364d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565308a63730 0x565308a6da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.881+0000 7f7da364d740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565308a6dfd0 0x565308a703c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.881+0000 7f7da364d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653089cdf20 con 0x565308a63730 2024-09-13T17:15:01.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.881+0000 7f7da364d740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653089cb6b0 con 0x565308a6dfd0 2024-09-13T17:15:01.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.881+0000 7f7da364d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653089c6fa0 con 0x565308a62e10 2024-09-13T17:15:01.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.881+0000 7f7d9a59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565308a63730 0x565308a6da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.881+0000 7f7d9a59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565308a63730 0x565308a6da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33414/0 (socket says 172.21.15.87:33414) 2024-09-13T17:15:01.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.881+0000 7f7d9a59c640 1 -- 172.21.15.87:0/3994319394 learned_addr learned my addr 172.21.15.87:0/3994319394 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:01.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.881+0000 7f7d99d9b640 1 --2- 172.21.15.87:0/3994319394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565308a62e10 0x565308a631f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.881+0000 7f7d99d9b640 1 --2- 172.21.15.87:0/3994319394 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565308a6dfd0 0x565308a703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.881+0000 7f7d9a59c640 1 -- 172.21.15.87:0/3994319394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565308a62e10 msgr2=0x565308a631f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:01.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.881+0000 7f7d8b7fe640 1 --2- 172.21.15.87:0/4060379169 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7d840a1320 0x7f7d840a37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.881+0000 7f7d9a59c640 1 --2- 172.21.15.87:0/3994319394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565308a62e10 0x565308a631f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.881+0000 7f7d9a59c640 1 -- 172.21.15.87:0/3994319394 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565308a6dfd0 msgr2=0x565308a703c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:01.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.881+0000 7f7d9a59c640 1 --2- 172.21.15.87:0/3994319394 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565308a6dfd0 0x565308a703c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.881+0000 7f7d9a59c640 1 -- 172.21.15.87:0/3994319394 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565308981840 con 0x565308a63730 2024-09-13T17:15:01.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.881+0000 7f7d9ad9d640 1 --2- 172.21.15.87:0/4060379169 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7d840a1320 0x7f7d840a37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.882+0000 7f7d9a59c640 1 --2- 172.21.15.87:0/3994319394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565308a63730 0x565308a6da90 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c0104d0 tx=0x7f7d8c010990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=809bf83a7d1dbe3a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:01.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.882+0000 7f7d8b7fe640 1 -- 172.21.15.87:0/4060379169 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f7d94014070 con 0x7f7d9c10a310 2024-09-13T17:15:01.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.882+0000 7f7d88ff9640 1 -- 172.21.15.87:0/3994319394 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c004220 con 0x565308a63730 2024-09-13T17:15:01.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.882+0000 7f7d88ff9640 1 -- 172.21.15.87:0/3994319394 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7d8c015070 con 0x565308a63730 2024-09-13T17:15:01.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.882+0000 7f7d88ff9640 1 -- 172.21.15.87:0/3994319394 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c0117c0 con 0x565308a63730 2024-09-13T17:15:01.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.883+0000 7f7da364d740 1 -- 172.21.15.87:0/3994319394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565308a63730 msgr2=0x565308a6da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.883+0000 7f7da364d740 1 --2- 172.21.15.87:0/3994319394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565308a63730 0x565308a6da90 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c0104d0 tx=0x7f7d8c010990 comp rx=0 tx=0).stop 2024-09-13T17:15:01.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.883+0000 7f7d9ad9d640 1 --2- 172.21.15.87:0/4060379169 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7d840a1320 0x7f7d840a37e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7d940cab00 tx=0x7f7d94069650 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:01.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.883+0000 7f7da364d740 1 -- 172.21.15.87:0/3994319394 shutdown_connections 2024-09-13T17:15:01.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.883+0000 7f7da364d740 1 --2- 172.21.15.87:0/3994319394 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565308a6dfd0 0x565308a703c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.883+0000 7f7da364d740 1 --2- 172.21.15.87:0/3994319394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565308a63730 0x565308a6da90 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.883+0000 7f7da364d740 1 --2- 172.21.15.87:0/3994319394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565308a62e10 0x565308a631f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.883+0000 7f7da364d740 1 -- 172.21.15.87:0/3994319394 >> 172.21.15.87:0/3994319394 conn(0x565308a5f380 msgr2=0x565308a5f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:01.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.883+0000 7f7da364d740 1 -- 172.21.15.87:0/3994319394 shutdown_connections 2024-09-13T17:15:01.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.883+0000 7f7da364d740 1 -- 172.21.15.87:0/3994319394 wait complete. 2024-09-13T17:15:01.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.883+0000 7f7da364d740 1 -- start start 2024-09-13T17:15:01.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.883+0000 7f7da364d740 1 Processor -- start 2024-09-13T17:15:01.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.883+0000 7f7da364d740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565308a62e10 0x565308a6d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.883+0000 7f7da364d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565308a63730 0x565308a6aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.883+0000 7f7da364d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565308a6dfd0 0x565308a6b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.883+0000 7f7da364d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653089682a0 con 0x565308a63730 2024-09-13T17:15:01.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.884+0000 7f7da364d740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56530869f430 con 0x565308a62e10 2024-09-13T17:15:01.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.884+0000 7f7da364d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56530894a680 con 0x565308a6dfd0 2024-09-13T17:15:01.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.884+0000 7f7da364d740 10 client.0 _ll_register_callbacks cb 0x5653089c0610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:01.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.884+0000 7f7d9a59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565308a63730 0x565308a6aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.884+0000 7f7d9a59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565308a63730 0x565308a6aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33420/0 (socket says 172.21.15.87:33420) 2024-09-13T17:15:01.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.884+0000 7f7d9a59c640 1 -- 172.21.15.87:0/2918331703 learned_addr learned my addr 172.21.15.87:0/2918331703 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:01.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.884+0000 7f7d99d9b640 1 --2- 172.21.15.87:0/2918331703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565308a62e10 0x565308a6d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.884+0000 7f7d99d9b640 1 --2- 172.21.15.87:0/2918331703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565308a6dfd0 0x565308a6b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.884+0000 7f7d9a59c640 1 -- 172.21.15.87:0/2918331703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565308a6dfd0 msgr2=0x565308a6b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:01.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.884+0000 7f7d9a59c640 1 --2- 172.21.15.87:0/2918331703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565308a6dfd0 0x565308a6b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.884+0000 7f7d9a59c640 1 -- 172.21.15.87:0/2918331703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565308a62e10 msgr2=0x565308a6d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:01.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.884+0000 7f7d9a59c640 1 --2- 172.21.15.87:0/2918331703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565308a62e10 0x565308a6d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.884+0000 7f7d9a59c640 1 -- 172.21.15.87:0/2918331703 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d8c00bd30 con 0x565308a63730 2024-09-13T17:15:01.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.884+0000 7f7d99d9b640 1 --2- 172.21.15.87:0/2918331703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565308a6dfd0 0x565308a6b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:01.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.884+0000 7f7d9a59c640 1 --2- 172.21.15.87:0/2918331703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565308a63730 0x565308a6aba0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c003f30 tx=0x7f7d8c0042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d8507463b6aa69 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:01.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.884+0000 7f7d81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:15:01.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.884+0000 7f7d81ffb640 1 -- 172.21.15.87:0/2918331703 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c020070 con 0x565308a63730 2024-09-13T17:15:01.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.884+0000 7f7d81ffb640 1 -- 172.21.15.87:0/2918331703 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f7d8c017070 con 0x565308a63730 2024-09-13T17:15:01.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.884+0000 7f7da364d740 1 -- 172.21.15.87:0/2918331703 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5653086ba4e0 con 0x565308a63730 2024-09-13T17:15:01.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.884+0000 7f7d81ffb640 1 -- 172.21.15.87:0/2918331703 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d8c003800 con 0x565308a63730 2024-09-13T17:15:01.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.884+0000 7f7da364d740 10 client.16071 fetch_fsmap learned FSMap version 24 2024-09-13T17:15:01.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.885+0000 7f7da364d740 1 -- 172.21.15.87:0/2918331703 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5653089c5620 con 0x565308a63730 2024-09-13T17:15:01.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.885+0000 7f7d81ffb640 1 -- 172.21.15.87:0/2918331703 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x5653086ba4e0 con 0x565308a63730 2024-09-13T17:15:01.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.885+0000 7f7d81ffb640 1 -- 172.21.15.87:0/2918331703 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f7d8c0047e0 con 0x565308a63730 2024-09-13T17:15:01.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.885+0000 7f7da364d740 10 client.16071 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:15:01.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.885+0000 7f7da364d740 10 client.16071 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:15:01.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.885+0000 7f7da364d740 20 client.16071 populate_metadata read hostname 'smithi087' 2024-09-13T17:15:01.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.885+0000 7f7da364d740 1 --2- 172.21.15.87:0/2918331703 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x565308a7dc50 0x565308a80040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.885+0000 7f7da364d740 4 client.16071 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:15:01.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.885+0000 7f7da364d740 1 -- 172.21.15.87:0/2918331703 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5653086cb7e0 con 0x565308a7dc50 2024-09-13T17:15:01.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.885+0000 7f7d99d9b640 1 --2- 172.21.15.87:0/2918331703 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x565308a7dc50 0x565308a80040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.886+0000 7f7d81ffb640 10 client.16071 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:01.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.886+0000 7f7d99d9b640 1 --2- 172.21.15.87:0/2918331703 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x565308a7dc50 0x565308a80040 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40459f2934934560 server_cookie=f7e5522c015a1522 in_seq=0 out_seq=0 2024-09-13T17:15:01.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.886+0000 7f7d81ffb640 1 -- 172.21.15.87:0/2918331703 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5653086cb7e0 con 0x565308a7dc50 2024-09-13T17:15:01.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.886+0000 7f7d81ffb640 10 client.16071 handle_command_reply: tid=0 2024-09-13T17:15:01.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.886+0000 7f7da364d740 1 client.16071 shutdown 2024-09-13T17:15:01.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.886+0000 7f7da364d740 1 -- 172.21.15.87:0/2918331703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565308a63730 msgr2=0x565308a6aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.886+0000 7f7da364d740 1 --2- 172.21.15.87:0/2918331703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565308a63730 0x565308a6aba0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c003f30 tx=0x7f7d8c0042c0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.886+0000 7f7da364d740 1 -- 172.21.15.87:0/2918331703 shutdown_connections 2024-09-13T17:15:01.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.886+0000 7f7da364d740 1 --2- 172.21.15.87:0/2918331703 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x565308a7dc50 0x565308a80040 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.886+0000 7f7da364d740 1 --2- 172.21.15.87:0/2918331703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565308a6dfd0 0x565308a6b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.886+0000 7f7da364d740 1 --2- 172.21.15.87:0/2918331703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565308a63730 0x565308a6aba0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.886+0000 7f7da364d740 1 --2- 172.21.15.87:0/2918331703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565308a62e10 0x565308a6d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.886+0000 7f7d81ffb640 0 client.16071 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:01.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.886+0000 7f7da364d740 1 -- 172.21.15.87:0/2918331703 >> 172.21.15.87:0/2918331703 conn(0x565308a5f380 msgr2=0x565308a5e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:01.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.887+0000 7f7da364d740 1 -- 172.21.15.87:0/2918331703 shutdown_connections 2024-09-13T17:15:01.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.887+0000 7f7da364d740 1 -- 172.21.15.87:0/2918331703 wait complete. 2024-09-13T17:15:01.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.887+0000 7f7da364d740 20 client.16071 trim_cache size 0 max 16384 2024-09-13T17:15:01.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.905+0000 7f7da364d740 1 Processor -- start 2024-09-13T17:15:01.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.905+0000 7f7da364d740 1 -- start start 2024-09-13T17:15:01.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.905+0000 7f7da364d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565308a5f380 0x565308a5ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.905+0000 7f7da364d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565308a62e10 0x565308a74d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.905+0000 7f7da364d740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565308a63730 0x565308a75270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.905+0000 7f7da364d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x565308a5f240 con 0x565308a5f380 2024-09-13T17:15:01.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.905+0000 7f7da364d740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x565308a6c010 con 0x565308a63730 2024-09-13T17:15:01.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.905+0000 7f7da364d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653086ba4e0 con 0x565308a62e10 2024-09-13T17:15:01.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.906+0000 7f7d99d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565308a5f380 0x565308a5ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.906+0000 7f7d99d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565308a5f380 0x565308a5ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33434/0 (socket says 172.21.15.87:33434) 2024-09-13T17:15:01.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.906+0000 7f7d99d9b640 1 -- 172.21.15.87:0/3495265575 learned_addr learned my addr 172.21.15.87:0/3495265575 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:01.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.906+0000 7f7d9a59c640 1 --2- 172.21.15.87:0/3495265575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565308a62e10 0x565308a74d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.906+0000 7f7d99d9b640 1 -- 172.21.15.87:0/3495265575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565308a62e10 msgr2=0x565308a74d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:01.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.906+0000 7f7d99d9b640 1 --2- 172.21.15.87:0/3495265575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565308a62e10 0x565308a74d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.906+0000 7f7d99d9b640 1 -- 172.21.15.87:0/3495265575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565308a63730 msgr2=0x565308a75270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:01.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.906+0000 7f7d99d9b640 1 --2- 172.21.15.87:0/3495265575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565308a63730 0x565308a75270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.906+0000 7f7d99d9b640 1 -- 172.21.15.87:0/3495265575 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565308967790 con 0x565308a5f380 2024-09-13T17:15:01.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.906+0000 7f7d99d9b640 1 --2- 172.21.15.87:0/3495265575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565308a5f380 0x565308a5ed00 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f7d90006010 tx=0x7f7d9002a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd03a3807fbbda4f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:01.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.906+0000 7f7d897fa640 1 -- 172.21.15.87:0/3495265575 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d90044040 con 0x565308a5f380 2024-09-13T17:15:01.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.906+0000 7f7d897fa640 1 -- 172.21.15.87:0/3495265575 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7d90045040 con 0x565308a5f380 2024-09-13T17:15:01.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.906+0000 7f7d897fa640 1 -- 172.21.15.87:0/3495265575 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d90003b20 con 0x565308a5f380 2024-09-13T17:15:01.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.907+0000 7f7da364d740 1 -- 172.21.15.87:0/3495265575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565308a5f380 msgr2=0x565308a5ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.907+0000 7f7da364d740 1 --2- 172.21.15.87:0/3495265575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565308a5f380 0x565308a5ed00 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f7d90006010 tx=0x7f7d9002a480 comp rx=0 tx=0).stop 2024-09-13T17:15:01.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.907+0000 7f7da364d740 1 -- 172.21.15.87:0/3495265575 shutdown_connections 2024-09-13T17:15:01.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.907+0000 7f7da364d740 1 --2- 172.21.15.87:0/3495265575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565308a63730 0x565308a75270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.907+0000 7f7da364d740 1 --2- 172.21.15.87:0/3495265575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565308a62e10 0x565308a74d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.907+0000 7f7da364d740 1 --2- 172.21.15.87:0/3495265575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565308a5f380 0x565308a5ed00 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.907+0000 7f7da364d740 1 -- 172.21.15.87:0/3495265575 >> 172.21.15.87:0/3495265575 conn(0x565308a6da30 msgr2=0x565308a65eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:01.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.907+0000 7f7da364d740 1 -- 172.21.15.87:0/3495265575 shutdown_connections 2024-09-13T17:15:01.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.907+0000 7f7da364d740 1 -- 172.21.15.87:0/3495265575 wait complete. 2024-09-13T17:15:01.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.907+0000 7f7da364d740 1 -- start start 2024-09-13T17:15:01.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.907+0000 7f7da364d740 1 Processor -- start 2024-09-13T17:15:01.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.908+0000 7f7da364d740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565308a5f380 0x565308a74f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.908+0000 7f7da364d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565308a62e10 0x565308a71390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.908+0000 7f7da364d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565308a63730 0x565308a718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.908+0000 7f7da364d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x565308a71e90 con 0x565308a63730 2024-09-13T17:15:01.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.908+0000 7f7da364d740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x565308a72000 con 0x565308a5f380 2024-09-13T17:15:01.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.908+0000 7f7da364d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x565308a721c0 con 0x565308a62e10 2024-09-13T17:15:01.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.908+0000 7f7da364d740 10 client.0 _ll_register_callbacks cb 0x7f7d940093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:01.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.908+0000 7f7d99d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565308a63730 0x565308a718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.908+0000 7f7d99d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565308a63730 0x565308a718d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33446/0 (socket says 172.21.15.87:33446) 2024-09-13T17:15:01.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.908+0000 7f7d99d9b640 1 -- 172.21.15.87:0/3481077961 learned_addr learned my addr 172.21.15.87:0/3481077961 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:01.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.908+0000 7f7d9a59c640 1 --2- 172.21.15.87:0/3481077961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565308a62e10 0x565308a71390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.908+0000 7f7d99d9b640 1 --2- 172.21.15.87:0/3481077961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565308a5f380 0x565308a74f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.908+0000 7f7d99d9b640 1 -- 172.21.15.87:0/3481077961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565308a62e10 msgr2=0x565308a71390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:01.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.908+0000 7f7d99d9b640 1 --2- 172.21.15.87:0/3481077961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565308a62e10 0x565308a71390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.908+0000 7f7d99d9b640 1 -- 172.21.15.87:0/3481077961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565308a5f380 msgr2=0x565308a74f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:01.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.908+0000 7f7d99d9b640 1 --2- 172.21.15.87:0/3481077961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565308a5f380 0x565308a74f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.908+0000 7f7d99d9b640 1 -- 172.21.15.87:0/3481077961 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d9c10d410 con 0x565308a63730 2024-09-13T17:15:01.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.908+0000 7f7d99d9b640 1 --2- 172.21.15.87:0/3481077961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565308a63730 0x565308a718d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f7d9002aa70 tx=0x7f7d90003700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0fd23111220883d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:01.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.908+0000 7f7d81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:15:01.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.908+0000 7f7d81ffb640 1 -- 172.21.15.87:0/3481077961 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d90044040 con 0x565308a63730 2024-09-13T17:15:01.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.908+0000 7f7d81ffb640 1 -- 172.21.15.87:0/3481077961 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f7d90000e40 con 0x565308a63730 2024-09-13T17:15:01.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.908+0000 7f7da364d740 1 -- 172.21.15.87:0/3481077961 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7d8c015070 con 0x565308a63730 2024-09-13T17:15:01.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.909+0000 7f7d81ffb640 1 -- 172.21.15.87:0/3481077961 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d9003d650 con 0x565308a63730 2024-09-13T17:15:01.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.909+0000 7f7da364d740 10 client.16077 fetch_fsmap learned FSMap version 24 2024-09-13T17:15:01.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.909+0000 7f7da364d740 1 -- 172.21.15.87:0/3481077961 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x56530898cea0 con 0x565308a63730 2024-09-13T17:15:01.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.909+0000 7f7d81ffb640 1 -- 172.21.15.87:0/3481077961 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7d8c015070 con 0x565308a63730 2024-09-13T17:15:01.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.909+0000 7f7d81ffb640 1 -- 172.21.15.87:0/3481077961 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f7d90054040 con 0x565308a63730 2024-09-13T17:15:01.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.909+0000 7f7da364d740 10 client.16077 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:15:01.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.909+0000 7f7da364d740 10 client.16077 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:15:01.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.909+0000 7f7da364d740 20 client.16077 populate_metadata read hostname 'smithi087' 2024-09-13T17:15:01.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.909+0000 7f7da364d740 1 --2- 172.21.15.87:0/3481077961 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x565308a6dfd0 0x565308ad72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:01.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.909+0000 7f7da364d740 4 client.16077 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:15:01.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.909+0000 7f7da364d740 1 -- 172.21.15.87:0/3481077961 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56530871ee30 con 0x565308a6dfd0 2024-09-13T17:15:01.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.909+0000 7f7d9a59c640 1 --2- 172.21.15.87:0/3481077961 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x565308a6dfd0 0x565308ad72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:01.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.910+0000 7f7d81ffb640 10 client.16077 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:01.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.910+0000 7f7d9a59c640 1 --2- 172.21.15.87:0/3481077961 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x565308a6dfd0 0x565308ad72d0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca282c4dfe4c1866 server_cookie=14e2437dd1f2188 in_seq=0 out_seq=0 2024-09-13T17:15:01.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.910+0000 7f7d81ffb640 1 -- 172.21.15.87:0/3481077961 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x56530871ee30 con 0x565308a6dfd0 2024-09-13T17:15:01.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.910+0000 7f7d81ffb640 10 client.16077 handle_command_reply: tid=0 2024-09-13T17:15:01.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.910+0000 7f7da364d740 1 client.16077 shutdown 2024-09-13T17:15:01.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.910+0000 7f7da364d740 1 -- 172.21.15.87:0/3481077961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565308a63730 msgr2=0x565308a718d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.910+0000 7f7da364d740 1 --2- 172.21.15.87:0/3481077961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565308a63730 0x565308a718d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f7d9002aa70 tx=0x7f7d90003700 comp rx=0 tx=0).stop 2024-09-13T17:15:01.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.910+0000 7f7da364d740 1 -- 172.21.15.87:0/3481077961 shutdown_connections 2024-09-13T17:15:01.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.910+0000 7f7da364d740 1 --2- 172.21.15.87:0/3481077961 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x565308a6dfd0 0x565308ad72d0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.910+0000 7f7d81ffb640 0 client.16077 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:01.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.910+0000 7f7da364d740 1 --2- 172.21.15.87:0/3481077961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x565308a63730 0x565308a718d0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.910+0000 7f7da364d740 1 --2- 172.21.15.87:0/3481077961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565308a62e10 0x565308a71390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.910+0000 7f7da364d740 1 --2- 172.21.15.87:0/3481077961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565308a5f380 0x565308a74f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.910+0000 7f7da364d740 1 -- 172.21.15.87:0/3481077961 >> 172.21.15.87:0/3481077961 conn(0x565308a6da30 msgr2=0x565308a693d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:01.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.910+0000 7f7da364d740 1 -- 172.21.15.87:0/3481077961 shutdown_connections 2024-09-13T17:15:01.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.910+0000 7f7da364d740 1 -- 172.21.15.87:0/3481077961 wait complete. 2024-09-13T17:15:01.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.910+0000 7f7da364d740 20 client.16077 trim_cache size 0 max 16384 2024-09-13T17:15:01.919 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:15:01.919 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-13T17:15:01.920 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": { 2024-09-13T17:15:01.920 INFO:teuthology.orchestra.run.smithi087.stdout: "ce96bd85-c059-4c0d-b114-5be82032a6df": { 2024-09-13T17:15:01.920 INFO:teuthology.orchestra.run.smithi087.stdout: "path": "/", 2024-09-13T17:15:01.920 INFO:teuthology.orchestra.run.smithi087.stdout: "tag": "ce96bd85-c059-4c0d-b114-5be82032a6df", 2024-09-13T17:15:01.920 INFO:teuthology.orchestra.run.smithi087.stdout: "options": "recursive,force" 2024-09-13T17:15:01.920 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:15:01.920 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:15:01.920 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:15:01.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.911+0000 7f7da084f640 1 -- 172.21.15.87:0/4060379169 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7d840a1320 msgr2=0x7f7d840a37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.911+0000 7f7da084f640 1 --2- 172.21.15.87:0/4060379169 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7d840a1320 0x7f7d840a37e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7d940cab00 tx=0x7f7d94069650 comp rx=0 tx=0).stop 2024-09-13T17:15:01.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.911+0000 7f7da084f640 1 -- 172.21.15.87:0/4060379169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d9c10a310 msgr2=0x7f7d9c19ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:01.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.911+0000 7f7da084f640 1 --2- 172.21.15.87:0/4060379169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d9c10a310 0x7f7d9c19ab50 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f7d9400ea60 tx=0x7f7d9400ef20 comp rx=0 tx=0).stop 2024-09-13T17:15:01.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.911+0000 7f7da084f640 1 -- 172.21.15.87:0/4060379169 shutdown_connections 2024-09-13T17:15:01.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.911+0000 7f7da084f640 1 --2- 172.21.15.87:0/4060379169 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7d840a1320 0x7f7d840a37e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.911+0000 7f7da084f640 1 --2- 172.21.15.87:0/4060379169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d9c10a310 0x7f7d9c19ab50 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.911+0000 7f7da084f640 1 --2- 172.21.15.87:0/4060379169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d9c101860 0x7f7d9c196760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.911+0000 7f7da084f640 1 --2- 172.21.15.87:0/4060379169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d9c100f40 0x7f7d9c196220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:01.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.911+0000 7f7da084f640 1 -- 172.21.15.87:0/4060379169 >> 172.21.15.87:0/4060379169 conn(0x7f7d9c075c60 msgr2=0x7f7d9c0fb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:01.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.911+0000 7f7da084f640 1 -- 172.21.15.87:0/4060379169 shutdown_connections 2024-09-13T17:15:01.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:01.911+0000 7f7da084f640 1 -- 172.21.15.87:0/4060379169 wait complete. 2024-09-13T17:15:01.924 INFO:tasks.cephfs.filesystem:scrub status for tag:ce96bd85-c059-4c0d-b114-5be82032a6df - {'path': '/', 'tag': 'ce96bd85-c059-4c0d-b114-5be82032a6df', 'options': 'recursive,force'} 2024-09-13T17:15:02.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:02 smithi087 ceph-mon[30934]: pgmap v39: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-13T17:15:02.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:02 smithi149 ceph-mon[35496]: pgmap v39: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-13T17:15:02.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:02 smithi118 ceph-mon[34374]: pgmap v39: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-13T17:15:03.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:03 smithi149 ceph-mon[35496]: scrub queued for path: / 2024-09-13T17:15:03.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:03 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:15:03.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:03 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:15:03.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:03 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:15:03.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:03 smithi118 ceph-mon[34374]: scrub queued for path: / 2024-09-13T17:15:03.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:03 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:15:03.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:03 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:15:03.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:03 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:15:03.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:03 smithi087 ceph-mon[30934]: scrub queued for path: / 2024-09-13T17:15:03.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:03 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:15:03.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:03 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:15:03.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:03 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:15:04.704 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ 2024-09-13T17:15:04.707 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/00-INDEX 2024-09-13T17:15:04.709 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/ 2024-09-13T17:15:04.710 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/README 2024-09-13T17:15:04.712 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/obsolete/ 2024-09-13T17:15:04.714 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads 2024-09-13T17:15:04.716 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb 2024-09-13T17:15:04.718 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill 2024-09-13T17:15:04.720 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus 2024-09-13T17:15:04.722 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus 2024-09-13T17:15:04.724 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra 2024-09-13T17:15:04.726 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/removed/ 2024-09-13T17:15:04.729 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/removed/devfs 2024-09-13T17:15:04.730 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/removed/dv1394 2024-09-13T17:15:04.733 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/removed/ip_queue 2024-09-13T17:15:04.735 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/removed/net_dma 2024-09-13T17:15:04.736 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/removed/o2cb 2024-09-13T17:15:04.738 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/removed/raw1394 2024-09-13T17:15:04.740 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/removed/video1394 2024-09-13T17:15:04.742 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/stable/ 2024-09-13T17:15:04.744 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/stable/firewire-cdev 2024-09-13T17:15:04.746 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/stable/o2cb 2024-09-13T17:15:04.748 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/stable/syscalls 2024-09-13T17:15:04.750 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile 2024-09-13T17:15:04.752 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire 2024-09-13T17:15:04.754 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb 2024-09-13T17:15:04.756 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend 2024-09-13T17:15:04.758 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight 2024-09-13T17:15:04.760 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill 2024-09-13T17:15:04.761 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm 2024-09-13T17:15:04.763 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi 2024-09-13T17:15:04.766 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc 2024-09-13T17:15:04.768 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node 2024-09-13T17:15:04.770 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu 2024-09-13T17:15:04.772 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory 2024-09-13T17:15:04.774 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp 2024-09-13T17:15:04.776 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx 2024-09-13T17:15:04.778 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc 2024-09-13T17:15:04.779 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04 2024-09-13T17:15:04.781 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars 2024-09-13T17:15:04.784 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump 2024-09-13T17:15:04.785 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog 2024-09-13T17:15:04.787 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-module 2024-09-13T17:15:04.790 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp 2024-09-13T17:15:04.792 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/stable/thermal-notification 2024-09-13T17:15:04.794 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/stable/vdso 2024-09-13T17:15:04.796 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/ 2024-09-13T17:15:04.798 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget 2024-09-13T17:15:04.800 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget 2024-09-13T17:15:04.802 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm 2024-09-13T17:15:04.804 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm 2024-09-13T17:15:04.806 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem 2024-09-13T17:15:04.807 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs 2024-09-13T17:15:04.809 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid 2024-09-13T17:15:04.811 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback 2024-09-13T17:15:04.813 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage 2024-09-13T17:15:04.815 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi 2024-09-13T17:15:04.817 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm 2024-09-13T17:15:04.818 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex 2024-09-13T17:15:04.820 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet 2024-09-13T17:15:04.822 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis 2024-09-13T17:15:04.824 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial 2024-09-13T17:15:04.826 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink 2024-09-13T17:15:04.827 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset 2024-09-13T17:15:04.829 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1 2024-09-13T17:15:04.831 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2 2024-09-13T17:15:04.833 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc 2024-09-13T17:15:04.835 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe 2024-09-13T17:15:04.837 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ec 2024-09-13T17:15:04.839 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad 2024-09-13T17:15:04.840 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-olpc 2024-09-13T17:15:04.841 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:04 smithi149 ceph-mon[35496]: pgmap v40: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T17:15:04.842 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto 2024-09-13T17:15:04.844 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd 2024-09-13T17:15:04.846 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/dev-kmsg 2024-09-13T17:15:04.848 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/evm 2024-09-13T17:15:04.850 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/ima_policy 2024-09-13T17:15:04.852 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/procfs-diskstats 2024-09-13T17:15:04.854 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/pstore 2024-09-13T17:15:04.856 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ata 2024-09-13T17:15:04.858 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block 2024-09-13T17:15:04.860 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache 2024-09-13T17:15:04.862 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm 2024-09-13T17:15:04.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:04 smithi118 ceph-mon[34374]: pgmap v40: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T17:15:04.864 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd 2024-09-13T17:15:04.866 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram 2024-09-13T17:15:04.869 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi 2024-09-13T17:15:04.872 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba 2024-09-13T17:15:04.872 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma 2024-09-13T17:15:04.874 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10 2024-09-13T17:15:04.876 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x 2024-09-13T17:15:04.878 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel 2024-09-13T17:15:04.880 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc 2024-09-13T17:15:04.882 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css 2024-09-13T17:15:04.884 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events 2024-09-13T17:15:04.886 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format 2024-09-13T17:15:04.888 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7 2024-09-13T17:15:04.890 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci 2024-09-13T17:15:04.892 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe 2024-09-13T17:15:04.894 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi 2024-09-13T17:15:04.896 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480 2024-09-13T17:15:04.898 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352 2024-09-13T17:15:04.899 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533 2024-09-13T17:15:04.901 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio 2024-09-13T17:15:04.905 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150 2024-09-13T17:15:04.907 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523 2024-09-13T17:15:04.909 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350 2024-09-13T17:15:04.911 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160 2024-09-13T17:15:04.913 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als 2024-09-13T17:15:04.915 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050 2024-09-13T17:15:04.917 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935 2024-09-13T17:15:04.919 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs 2024-09-13T17:15:04.920 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio 2024-09-13T17:15:04.922 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media 2024-09-13T17:15:04.924 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei 2024-09-13T17:15:04.926 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci 2024-09-13T17:15:04.928 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss 2024-09-13T17:15:04.930 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd 2024-09-13T17:15:04.932 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform 2024-09-13T17:15:04.934 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd 2024-09-13T17:15:04.936 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg 2024-09-13T17:15:04.938 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc 2024-09-13T17:15:04.939 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb 2024-09-13T17:15:04.941 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg 2024-09-13T17:15:04.943 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest 2024-09-13T17:15:04.945 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-c2port 2024-09-13T17:15:04.947 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency 2024-09-13T17:15:04.949 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class 2024-09-13T17:15:04.951 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870 2024-09-13T17:15:04.953 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533 2024-09-13T17:15:04.955 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi 2024-09-13T17:15:04.957 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl 2024-09-13T17:15:04.959 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq 2024-09-13T17:15:04.961 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon 2024-09-13T17:15:04.963 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu 2024-09-13T17:15:04.965 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu 2024-09-13T17:15:04.967 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu 2024-09-13T17:15:04.968 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd 2024-09-13T17:15:04.970 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led 2024-09-13T17:15:04.973 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533 2024-09-13T17:15:04.974 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r 2024-09-13T17:15:04.976 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei 2024-09-13T17:15:04.978 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt 2024-09-13T17:15:04.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:04 smithi087 ceph-mon[30934]: pgmap v40: 129 pgs: 129 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-13T17:15:04.980 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd 2024-09-13T17:15:04.982 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net 2024-09-13T17:15:04.984 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv 2024-09-13T17:15:04.986 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm 2024-09-13T17:15:04.988 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan 2024-09-13T17:15:04.990 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh 2024-09-13T17:15:04.992 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues 2024-09-13T17:15:04.994 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics 2024-09-13T17:15:04.996 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd 2024-09-13T17:15:04.998 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-power 2024-09-13T17:15:05.000 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap 2024-09-13T17:15:05.002 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm 2024-09-13T17:15:05.004 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc 2024-09-13T17:15:05.006 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator 2024-09-13T17:15:05.008 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration 2024-09-13T17:15:05.010 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host 2024-09-13T17:15:05.012 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc 2024-09-13T17:15:05.014 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc 2024-09-13T17:15:05.016 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-dev 2024-09-13T17:15:05.018 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices 2024-09-13T17:15:05.020 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac 2024-09-13T17:15:05.023 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node 2024-09-13T17:15:05.025 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr 2024-09-13T17:15:05.027 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory 2024-09-13T17:15:05.029 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc 2024-09-13T17:15:05.031 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online 2024-09-13T17:15:05.033 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget 2024-09-13T17:15:05.035 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3 2024-09-13T17:15:05.037 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb 2024-09-13T17:15:05.039 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power 2024-09-13T17:15:05.042 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0 2024-09-13T17:15:05.044 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1 2024-09-13T17:15:05.046 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2 2024-09-13T17:15:05.048 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot 2024-09-13T17:15:05.050 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup 2024-09-13T17:15:05.053 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state 2024-09-13T17:15:05.054 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state 2024-09-13T17:15:05.056 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use 2024-09-13T17:15:05.058 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc 2024-09-13T17:15:05.061 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun 2024-09-13T17:15:05.062 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu 2024-09-13T17:15:05.064 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl 2024-09-13T17:15:05.066 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu 2024-09-13T17:15:05.068 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe 2024-09-13T17:15:05.070 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid 2024-09-13T17:15:05.073 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo 2024-09-13T17:15:05.076 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff 2024-09-13T17:15:05.077 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch 2024-09-13T17:15:05.079 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd 2024-09-13T17:15:05.081 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys 2024-09-13T17:15:05.083 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo 2024-09-13T17:15:05.085 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku 2024-09-13T17:15:05.087 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone 2024-09-13T17:15:05.089 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus 2024-09-13T17:15:05.091 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure 2024-09-13T17:15:05.093 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus 2024-09-13T17:15:05.095 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua 2024-09-13T17:15:05.097 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra 2024-09-13T17:15:05.103 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.101+0000 7f357371f640 1 -- 172.21.15.87:0/897049919 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f356c104ce0 msgr2=0x7f356c1050c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:05.103 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.101+0000 7f357371f640 1 --2- 172.21.15.87:0/897049919 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f356c104ce0 0x7f356c1050c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f3568009900 tx=0x7f356802a410 comp rx=0 tx=0).stop 2024-09-13T17:15:05.103 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.101+0000 7f357371f640 1 -- 172.21.15.87:0/897049919 shutdown_connections 2024-09-13T17:15:05.103 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.101+0000 7f357371f640 1 --2- 172.21.15.87:0/897049919 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f356c0681d0 0x7f356c10cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.103 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.101+0000 7f357371f640 1 --2- 172.21.15.87:0/897049919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f356c067830 0x7f356c067c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.103 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.101+0000 7f357371f640 1 --2- 172.21.15.87:0/897049919 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f356c104ce0 0x7f356c1050c0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.103 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.101+0000 7f357371f640 1 -- 172.21.15.87:0/897049919 >> 172.21.15.87:0/897049919 conn(0x7f356c074940 msgr2=0x7f356c074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:05.103 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.102+0000 7f357371f640 1 -- 172.21.15.87:0/897049919 shutdown_connections 2024-09-13T17:15:05.104 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.102+0000 7f357371f640 1 -- 172.21.15.87:0/897049919 wait complete. 2024-09-13T17:15:05.104 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.102+0000 7f357371f640 1 Processor -- start 2024-09-13T17:15:05.104 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.102+0000 7f357371f640 1 -- start start 2024-09-13T17:15:05.114 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.102+0000 7f357371f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f356c067830 0x7f356c0ff0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:05.114 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.102+0000 7f357371f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f356c0681d0 0x7f356c0ff600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:05.114 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.102+0000 7f357371f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f356c104ce0 0x7f356c0ffb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:05.114 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.102+0000 7f357371f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356c1a4640 con 0x7f356c067830 2024-09-13T17:15:05.114 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.102+0000 7f357371f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356c1a47b0 con 0x7f356c104ce0 2024-09-13T17:15:05.114 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.102+0000 7f357371f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356c1a4970 con 0x7f356c0681d0 2024-09-13T17:15:05.114 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.102+0000 7f35714bb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f356c067830 0x7f356c0ff0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:05.114 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.103+0000 7f35714bb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f356c067830 0x7f356c0ff0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33468/0 (socket says 172.21.15.87:33468) 2024-09-13T17:15:05.114 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.103+0000 7f35714bb640 1 -- 172.21.15.87:0/1154039528 learned_addr learned my addr 172.21.15.87:0/1154039528 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:05.114 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.103+0000 7f3570cba640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f356c0681d0 0x7f356c0ff600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:05.114 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.103+0000 7f3571cbc640 1 --2- 172.21.15.87:0/1154039528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f356c104ce0 0x7f356c0ffb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:05.114 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.103+0000 7f3570cba640 1 -- 172.21.15.87:0/1154039528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f356c104ce0 msgr2=0x7f356c0ffb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:05.115 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.103+0000 7f3570cba640 1 --2- 172.21.15.87:0/1154039528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f356c104ce0 0x7f356c0ffb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.115 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.103+0000 7f3570cba640 1 -- 172.21.15.87:0/1154039528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f356c067830 msgr2=0x7f356c0ff0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:05.115 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.103+0000 7f3570cba640 1 --2- 172.21.15.87:0/1154039528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f356c067830 0x7f356c0ff0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.115 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.103+0000 7f3570cba640 1 -- 172.21.15.87:0/1154039528 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3568009560 con 0x7f356c0681d0 2024-09-13T17:15:05.115 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.103+0000 7f35714bb640 1 --2- 172.21.15.87:0/1154039528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f356c067830 0x7f356c0ff0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:15:05.115 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.103+0000 7f3571cbc640 1 --2- 172.21.15.87:0/1154039528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f356c104ce0 0x7f356c0ffb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:15:05.115 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.103+0000 7f3570cba640 1 --2- 172.21.15.87:0/1154039528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f356c0681d0 0x7f356c0ff600 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f355c00e9f0 tx=0x7f355c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:05.115 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.103+0000 7f35627fc640 1 -- 172.21.15.87:0/1154039528 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c00ccc0 con 0x7f356c0681d0 2024-09-13T17:15:05.115 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.103+0000 7f35627fc640 1 -- 172.21.15.87:0/1154039528 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f355c00ce20 con 0x7f356c0681d0 2024-09-13T17:15:05.115 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.103+0000 7f35627fc640 1 -- 172.21.15.87:0/1154039528 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c0187c0 con 0x7f356c0681d0 2024-09-13T17:15:05.115 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.103+0000 7f357371f640 1 -- 172.21.15.87:0/1154039528 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f356c1a4c50 con 0x7f356c0681d0 2024-09-13T17:15:05.115 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.103+0000 7f357371f640 1 -- 172.21.15.87:0/1154039528 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f356c1a5160 con 0x7f356c0681d0 2024-09-13T17:15:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.105+0000 7f35627fc640 1 -- 172.21.15.87:0/1154039528 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 25) v1 ==== 136106+0+0 (secure 0 0 0) 0x7f355c010430 con 0x7f356c0681d0 2024-09-13T17:15:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.106+0000 7f357643f740 1 Processor -- start 2024-09-13T17:15:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.106+0000 7f357643f740 1 -- start start 2024-09-13T17:15:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.106+0000 7f357643f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5585d8789330 0x5585d8789710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.106+0000 7f357643f740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5585d8789c50 0x5585d8793fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.106+0000 7f357643f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5585d87944f0 0x5585d87968e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.106+0000 7f357643f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d86f4c30 con 0x5585d87944f0 2024-09-13T17:15:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.106+0000 7f357643f740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d86f23c0 con 0x5585d8789c50 2024-09-13T17:15:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.106+0000 7f357643f740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d86edcb0 con 0x5585d8789330 2024-09-13T17:15:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.106+0000 7f3570cba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5585d87944f0 0x5585d87968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.106+0000 7f35627fc640 1 --2- 172.21.15.87:0/1154039528 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f35580a13a0 0x7f35580a3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.106+0000 7f3571cbc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5585d8789330 0x5585d8789710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.106+0000 7f3571cbc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5585d8789330 0x5585d8789710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:37218/0 (socket says 172.21.15.87:37218) 2024-09-13T17:15:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.106+0000 7f3571cbc640 1 -- 172.21.15.87:0/2296494585 learned_addr learned my addr 172.21.15.87:0/2296494585 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.106+0000 7f35714bb640 1 --2- 172.21.15.87:0/2296494585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5585d8789c50 0x5585d8793fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.106+0000 7f3571cbc640 1 --2- 172.21.15.87:0/1154039528 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f35580a13a0 0x7f35580a3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.107+0000 7f35627fc640 1 -- 172.21.15.87:0/1154039528 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f355c014070 con 0x7f356c0681d0 2024-09-13T17:15:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.107+0000 7f3571cbc640 1 -- 172.21.15.87:0/2296494585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5585d8789c50 msgr2=0x5585d8793fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.107+0000 7f3571cbc640 1 --2- 172.21.15.87:0/2296494585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5585d8789c50 0x5585d8793fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.107+0000 7f3571cbc640 1 -- 172.21.15.87:0/2296494585 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5585d87944f0 msgr2=0x5585d87968e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.107+0000 7f3571cbc640 1 --2- 172.21.15.87:0/2296494585 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5585d87944f0 0x5585d87968e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.107+0000 7f3571cbc640 1 -- 172.21.15.87:0/2296494585 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585d8694910 con 0x5585d8789330 2024-09-13T17:15:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.107+0000 7f3571cbc640 1 --2- 172.21.15.87:0/2296494585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5585d8789330 0x5585d8789710 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3564009fd0 tx=0x7f3564013830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=847044e83bb8f674 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.107+0000 7f3571cbc640 1 --2- 172.21.15.87:0/1154039528 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f35580a13a0 0x7f35580a3860 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f356401d000 tx=0x7f356401f000 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.107+0000 7f35577fe640 1 -- 172.21.15.87:0/2296494585 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356400f8b0 con 0x5585d8789330 2024-09-13T17:15:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.107+0000 7f35577fe640 1 -- 172.21.15.87:0/2296494585 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f35640120d0 con 0x5585d8789330 2024-09-13T17:15:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.107+0000 7f35577fe640 1 -- 172.21.15.87:0/2296494585 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3564010bb0 con 0x5585d8789330 2024-09-13T17:15:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.108+0000 7f357643f740 1 -- 172.21.15.87:0/2296494585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5585d8789330 msgr2=0x5585d8789710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.108+0000 7f357643f740 1 --2- 172.21.15.87:0/2296494585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5585d8789330 0x5585d8789710 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3564009fd0 tx=0x7f3564013830 comp rx=0 tx=0).stop 2024-09-13T17:15:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.108+0000 7f357643f740 1 -- 172.21.15.87:0/2296494585 shutdown_connections 2024-09-13T17:15:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.108+0000 7f357643f740 1 --2- 172.21.15.87:0/2296494585 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5585d87944f0 0x5585d87968e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.108+0000 7f357643f740 1 --2- 172.21.15.87:0/2296494585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5585d8789c50 0x5585d8793fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.108+0000 7f357643f740 1 --2- 172.21.15.87:0/2296494585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5585d8789330 0x5585d8789710 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.108+0000 7f357643f740 1 -- 172.21.15.87:0/2296494585 >> 172.21.15.87:0/2296494585 conn(0x5585d87858c0 msgr2=0x5585d8785ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.108+0000 7f357643f740 1 -- 172.21.15.87:0/2296494585 shutdown_connections 2024-09-13T17:15:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.108+0000 7f357643f740 1 -- 172.21.15.87:0/2296494585 wait complete. 2024-09-13T17:15:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.108+0000 7f357643f740 1 -- start start 2024-09-13T17:15:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.108+0000 7f357643f740 1 Processor -- start 2024-09-13T17:15:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.109+0000 7f357643f740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5585d8789330 0x5585d8793e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.109+0000 7f357643f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5585d8789c50 0x5585d8791100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.109+0000 7f357643f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5585d87944f0 0x5585d8791680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.109+0000 7f357643f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d86abe80 con 0x5585d8789c50 2024-09-13T17:15:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.109+0000 7f357643f740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d86abb20 con 0x5585d8789330 2024-09-13T17:15:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.109+0000 7f357643f740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d8671260 con 0x5585d87944f0 2024-09-13T17:15:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.109+0000 7f357643f740 10 client.0 _ll_register_callbacks cb 0x5585d86a6df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.109+0000 7f3570cba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5585d8789c50 0x5585d8791100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.109+0000 7f3570cba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5585d8789c50 0x5585d8791100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33478/0 (socket says 172.21.15.87:33478) 2024-09-13T17:15:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.109+0000 7f3570cba640 1 -- 172.21.15.87:0/1135668526 learned_addr learned my addr 172.21.15.87:0/1135668526 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.109+0000 7f35714bb640 1 --2- 172.21.15.87:0/1135668526 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5585d8789330 0x5585d8793e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.109+0000 7f3571cbc640 1 --2- 172.21.15.87:0/1135668526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5585d87944f0 0x5585d8791680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.109+0000 7f3570cba640 1 -- 172.21.15.87:0/1135668526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5585d87944f0 msgr2=0x5585d8791680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.109+0000 7f3570cba640 1 --2- 172.21.15.87:0/1135668526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5585d87944f0 0x5585d8791680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.109+0000 7f3570cba640 1 -- 172.21.15.87:0/1135668526 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5585d8789330 msgr2=0x5585d8793e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.109+0000 7f3570cba640 1 --2- 172.21.15.87:0/1135668526 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5585d8789330 0x5585d8793e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.109+0000 7f3570cba640 1 -- 172.21.15.87:0/1135668526 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f356400fa70 con 0x5585d8789c50 2024-09-13T17:15:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.109+0000 7f3570cba640 1 --2- 172.21.15.87:0/1135668526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5585d8789c50 0x5585d8791100 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f355c096680 tx=0x7f355c009700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77c88bddbf8ccb49 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.109+0000 7f3554ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:15:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.109+0000 7f3554ff9640 1 -- 172.21.15.87:0/1135668526 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c09a180 con 0x5585d8789c50 2024-09-13T17:15:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.109+0000 7f3554ff9640 1 -- 172.21.15.87:0/1135668526 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f355c0a20c0 con 0x5585d8789c50 2024-09-13T17:15:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.109+0000 7f357643f740 1 -- 172.21.15.87:0/1135668526 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5585d8716680 con 0x5585d8789c50 2024-09-13T17:15:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.109+0000 7f3554ff9640 1 -- 172.21.15.87:0/1135668526 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f355c0a2280 con 0x5585d8789c50 2024-09-13T17:15:05.120 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.109+0000 7f357643f740 10 client.16089 fetch_fsmap learned FSMap version 24 2024-09-13T17:15:05.121 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.109+0000 7f357643f740 1 -- 172.21.15.87:0/1135668526 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5585d86ec330 con 0x5585d8789c50 2024-09-13T17:15:05.121 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.110+0000 7f3554ff9640 1 -- 172.21.15.87:0/1135668526 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x5585d8716680 con 0x5585d8789c50 2024-09-13T17:15:05.121 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.110+0000 7f3554ff9640 1 -- 172.21.15.87:0/1135668526 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f355c0cd2d0 con 0x5585d8789c50 2024-09-13T17:15:05.121 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.110+0000 7f357643f740 10 client.16089 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:15:05.121 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.110+0000 7f357643f740 10 client.16089 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-13T17:15:05.121 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.110+0000 7f357643f740 20 client.16089 populate_metadata read hostname 'smithi087' 2024-09-13T17:15:05.121 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.110+0000 7f357643f740 1 --2- 172.21.15.87:0/1135668526 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5585d87a3ea0 0x5585d87a62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:05.121 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.110+0000 7f357643f740 4 client.16089 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:15:05.121 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.110+0000 7f357643f740 1 -- 172.21.15.87:0/1135668526 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5585d86e15d0 con 0x5585d87a3ea0 2024-09-13T17:15:05.121 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.110+0000 7f35714bb640 1 --2- 172.21.15.87:0/1135668526 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5585d87a3ea0 0x5585d87a62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:05.121 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.110+0000 7f3554ff9640 10 client.16089 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:05.121 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.110+0000 7f35714bb640 1 --2- 172.21.15.87:0/1135668526 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5585d87a3ea0 0x5585d87a62c0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5dd1a927682b82c0 server_cookie=d4fc716fbf088556 in_seq=0 out_seq=0 2024-09-13T17:15:05.122 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.111+0000 7f3554ff9640 1 -- 172.21.15.87:0/1135668526 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5585d86e15d0 con 0x5585d87a3ea0 2024-09-13T17:15:05.122 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.111+0000 7f3554ff9640 10 client.16089 handle_command_reply: tid=0 2024-09-13T17:15:05.122 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.111+0000 7f357643f740 1 client.16089 shutdown 2024-09-13T17:15:05.122 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.111+0000 7f357643f740 1 -- 172.21.15.87:0/1135668526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5585d8789c50 msgr2=0x5585d8791100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:05.122 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.111+0000 7f357643f740 1 --2- 172.21.15.87:0/1135668526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5585d8789c50 0x5585d8791100 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f355c096680 tx=0x7f355c009700 comp rx=0 tx=0).stop 2024-09-13T17:15:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.111+0000 7f357643f740 1 -- 172.21.15.87:0/1135668526 shutdown_connections 2024-09-13T17:15:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.111+0000 7f357643f740 1 --2- 172.21.15.87:0/1135668526 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5585d87a3ea0 0x5585d87a62c0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.111+0000 7f357643f740 1 --2- 172.21.15.87:0/1135668526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5585d87944f0 0x5585d8791680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.111+0000 7f357643f740 1 --2- 172.21.15.87:0/1135668526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5585d8789c50 0x5585d8791100 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.111+0000 7f3554ff9640 0 client.16089 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.111+0000 7f357643f740 1 --2- 172.21.15.87:0/1135668526 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5585d8789330 0x5585d8793e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.111+0000 7f357643f740 1 -- 172.21.15.87:0/1135668526 >> 172.21.15.87:0/1135668526 conn(0x5585d87858c0 msgr2=0x5585d8784b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:05.123 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.111+0000 7f357643f740 1 -- 172.21.15.87:0/1135668526 shutdown_connections 2024-09-13T17:15:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.111+0000 7f357643f740 1 -- 172.21.15.87:0/1135668526 wait complete. 2024-09-13T17:15:05.124 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.111+0000 7f357643f740 20 client.16089 trim_cache size 0 max 16384 2024-09-13T17:15:05.129 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.123+0000 7f357643f740 1 Processor -- start 2024-09-13T17:15:05.130 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.124+0000 7f357643f740 1 -- start start 2024-09-13T17:15:05.130 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.124+0000 7f357643f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5585d8789330 0x5585d878f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:05.130 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.124+0000 7f357643f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5585d8789c50 0x5585d878fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:05.130 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.124+0000 7f357643f740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5585d87944f0 0x5585d878e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:05.130 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.124+0000 7f357643f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d878a610 con 0x5585d8789c50 2024-09-13T17:15:05.130 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.124+0000 7f357643f740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d87890d0 con 0x5585d87944f0 2024-09-13T17:15:05.130 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.124+0000 7f357643f740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d87813c0 con 0x5585d8789330 2024-09-13T17:15:05.130 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.124+0000 7f3570cba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5585d8789c50 0x5585d878fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:05.130 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.124+0000 7f3570cba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5585d8789c50 0x5585d878fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33486/0 (socket says 172.21.15.87:33486) 2024-09-13T17:15:05.130 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.124+0000 7f3570cba640 1 -- 172.21.15.87:0/441847370 learned_addr learned my addr 172.21.15.87:0/441847370 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:05.130 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.124+0000 7f3571cbc640 1 --2- 172.21.15.87:0/441847370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5585d87944f0 0x5585d878e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:05.130 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.124+0000 7f35714bb640 1 --2- 172.21.15.87:0/441847370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5585d8789330 0x5585d878f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:05.131 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.124+0000 7f3570cba640 1 -- 172.21.15.87:0/441847370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5585d8789330 msgr2=0x5585d878f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:05.131 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.124+0000 7f3570cba640 1 --2- 172.21.15.87:0/441847370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5585d8789330 0x5585d878f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.131 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.124+0000 7f3570cba640 1 -- 172.21.15.87:0/441847370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5585d87944f0 msgr2=0x5585d878e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:05.131 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.124+0000 7f3570cba640 1 --2- 172.21.15.87:0/441847370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5585d87944f0 0x5585d878e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.131 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.124+0000 7f3570cba640 1 -- 172.21.15.87:0/441847370 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585d868e300 con 0x5585d8789c50 2024-09-13T17:15:05.131 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.124+0000 7f3570cba640 1 --2- 172.21.15.87:0/441847370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5585d8789c50 0x5585d878fef0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f355c096bf0 tx=0x7f355c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4209415c532042ed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:05.131 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.124+0000 7f3557fff640 1 -- 172.21.15.87:0/441847370 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c099180 con 0x5585d8789c50 2024-09-13T17:15:05.131 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.124+0000 7f3557fff640 1 -- 172.21.15.87:0/441847370 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f355c0b6070 con 0x5585d8789c50 2024-09-13T17:15:05.132 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.124+0000 7f3557fff640 1 -- 172.21.15.87:0/441847370 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c0994d0 con 0x5585d8789c50 2024-09-13T17:15:05.132 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.125+0000 7f357643f740 1 -- 172.21.15.87:0/441847370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5585d8789c50 msgr2=0x5585d878fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:05.132 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.125+0000 7f357643f740 1 --2- 172.21.15.87:0/441847370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5585d8789c50 0x5585d878fef0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f355c096bf0 tx=0x7f355c00cf90 comp rx=0 tx=0).stop 2024-09-13T17:15:05.132 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.125+0000 7f357643f740 1 -- 172.21.15.87:0/441847370 shutdown_connections 2024-09-13T17:15:05.132 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.125+0000 7f357643f740 1 --2- 172.21.15.87:0/441847370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5585d87944f0 0x5585d878e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.132 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.125+0000 7f357643f740 1 --2- 172.21.15.87:0/441847370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5585d8789c50 0x5585d878fef0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.132 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.125+0000 7f357643f740 1 --2- 172.21.15.87:0/441847370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5585d8789330 0x5585d878f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.132 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.125+0000 7f357643f740 1 -- 172.21.15.87:0/441847370 >> 172.21.15.87:0/441847370 conn(0x5585d87858c0 msgr2=0x5585d878c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:05.132 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.125+0000 7f357643f740 1 -- 172.21.15.87:0/441847370 shutdown_connections 2024-09-13T17:15:05.132 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.125+0000 7f357643f740 1 -- 172.21.15.87:0/441847370 wait complete. 2024-09-13T17:15:05.132 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.125+0000 7f357643f740 1 -- start start 2024-09-13T17:15:05.133 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.125+0000 7f357643f740 1 Processor -- start 2024-09-13T17:15:05.133 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.126+0000 7f357643f740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5585d8789330 0x5585d879b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:05.133 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.126+0000 7f357643f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5585d8789c50 0x5585d8799630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:05.133 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.126+0000 7f357643f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5585d87944f0 0x5585d8799b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:05.133 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.126+0000 7f357643f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d879a0b0 con 0x5585d8789c50 2024-09-13T17:15:05.133 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.126+0000 7f357643f740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d879a220 con 0x5585d8789330 2024-09-13T17:15:05.133 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.126+0000 7f357643f740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d879a3e0 con 0x5585d87944f0 2024-09-13T17:15:05.133 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.126+0000 7f357643f740 10 client.0 _ll_register_callbacks cb 0x7f3564009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:05.134 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.126+0000 7f3570cba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5585d8789c50 0x5585d8799630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:05.134 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.126+0000 7f3570cba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5585d8789c50 0x5585d8799630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33490/0 (socket says 172.21.15.87:33490) 2024-09-13T17:15:05.134 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.126+0000 7f3570cba640 1 -- 172.21.15.87:0/1843974233 learned_addr learned my addr 172.21.15.87:0/1843974233 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:05.134 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.126+0000 7f3571cbc640 1 --2- 172.21.15.87:0/1843974233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5585d87944f0 0x5585d8799b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:05.134 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.126+0000 7f35714bb640 1 --2- 172.21.15.87:0/1843974233 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5585d8789330 0x5585d879b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:05.134 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.126+0000 7f3570cba640 1 -- 172.21.15.87:0/1843974233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5585d87944f0 msgr2=0x5585d8799b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:05.134 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.126+0000 7f3570cba640 1 --2- 172.21.15.87:0/1843974233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5585d87944f0 0x5585d8799b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.134 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.126+0000 7f3570cba640 1 -- 172.21.15.87:0/1843974233 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5585d8789330 msgr2=0x5585d879b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:05.134 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.126+0000 7f3570cba640 1 --2- 172.21.15.87:0/1843974233 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5585d8789330 0x5585d879b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.134 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.126+0000 7f3570cba640 1 -- 172.21.15.87:0/1843974233 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5585d86ec330 con 0x5585d8789c50 2024-09-13T17:15:05.134 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.126+0000 7f3570cba640 1 --2- 172.21.15.87:0/1843974233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5585d8789c50 0x5585d8799630 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f355c099e80 tx=0x7f355c099320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=178ead09d1ca7cb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:05.134 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.126+0000 7f3554ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:15:05.135 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.126+0000 7f3554ff9640 1 -- 172.21.15.87:0/1843974233 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c0a22c0 con 0x5585d8789c50 2024-09-13T17:15:05.135 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.126+0000 7f3554ff9640 1 -- 172.21.15.87:0/1843974233 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f355c099470 con 0x5585d8789c50 2024-09-13T17:15:05.135 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.126+0000 7f357643f740 1 -- 172.21.15.87:0/1843974233 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f35640120d0 con 0x5585d8789c50 2024-09-13T17:15:05.135 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.127+0000 7f3554ff9640 1 -- 172.21.15.87:0/1843974233 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f355c099cc0 con 0x5585d8789c50 2024-09-13T17:15:05.135 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.127+0000 7f357643f740 10 client.16095 fetch_fsmap learned FSMap version 24 2024-09-13T17:15:05.135 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.127+0000 7f357643f740 1 -- 172.21.15.87:0/1843974233 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5585d86b38e0 con 0x5585d8789c50 2024-09-13T17:15:05.135 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.127+0000 7f3554ff9640 1 -- 172.21.15.87:0/1843974233 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f35640120d0 con 0x5585d8789c50 2024-09-13T17:15:05.135 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.127+0000 7f3554ff9640 1 -- 172.21.15.87:0/1843974233 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f355c09ee20 con 0x5585d8789c50 2024-09-13T17:15:05.135 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.127+0000 7f357643f740 10 client.16095 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T17:15:05.135 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.127+0000 7f357643f740 10 client.16095 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-13T17:15:05.135 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.127+0000 7f357643f740 20 client.16095 populate_metadata read hostname 'smithi087' 2024-09-13T17:15:05.135 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.127+0000 7f357643f740 1 --2- 172.21.15.87:0/1843974233 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5585d87fb270 0x5585d87fd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:05.135 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.127+0000 7f357643f740 4 client.16095 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T17:15:05.135 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.127+0000 7f357643f740 1 -- 172.21.15.87:0/1843974233 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5585d83e1300 con 0x5585d87fb270 2024-09-13T17:15:05.136 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.127+0000 7f35714bb640 1 --2- 172.21.15.87:0/1843974233 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5585d87fb270 0x5585d87fd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:05.136 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.127+0000 7f3554ff9640 10 client.16095 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:05.136 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.127+0000 7f35714bb640 1 --2- 172.21.15.87:0/1843974233 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5585d87fb270 0x5585d87fd660 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab5d6297d274c342 server_cookie=9a2a16a899c57188 in_seq=0 out_seq=0 2024-09-13T17:15:05.237 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos 2024-09-13T17:15:05.248 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu 2024-09-13T17:15:05.258 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1 2024-09-13T17:15:05.268 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote 2024-09-13T17:15:05.272 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek 2024-09-13T17:15:05.276 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start 2024-09-13T17:15:05.279 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback 2024-09-13T17:15:05.282 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi 2024-09-13T17:15:05.284 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop 2024-09-13T17:15:05.286 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.285+0000 7f3554ff9640 1 -- 172.21.15.87:0/1843974233 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5585d83e1300 con 0x5585d87fb270 2024-09-13T17:15:05.287 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.285+0000 7f3554ff9640 10 client.16095 handle_command_reply: tid=0 2024-09-13T17:15:05.287 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.285+0000 7f357643f740 1 client.16095 shutdown 2024-09-13T17:15:05.287 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.285+0000 7f357643f740 1 -- 172.21.15.87:0/1843974233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5585d8789c50 msgr2=0x5585d8799630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:05.287 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.285+0000 7f357643f740 1 --2- 172.21.15.87:0/1843974233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5585d8789c50 0x5585d8799630 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f355c099e80 tx=0x7f355c099320 comp rx=0 tx=0).stop 2024-09-13T17:15:05.287 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.285+0000 7f357643f740 1 -- 172.21.15.87:0/1843974233 shutdown_connections 2024-09-13T17:15:05.287 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.285+0000 7f357643f740 1 --2- 172.21.15.87:0/1843974233 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5585d87fb270 0x5585d87fd660 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.287 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.286+0000 7f357643f740 1 --2- 172.21.15.87:0/1843974233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5585d87944f0 0x5585d8799b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.287 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.286+0000 7f3554ff9640 0 client.16095 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:05.287 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.286+0000 7f357643f740 1 --2- 172.21.15.87:0/1843974233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5585d8789c50 0x5585d8799630 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.287 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.286+0000 7f357643f740 1 --2- 172.21.15.87:0/1843974233 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5585d8789330 0x5585d879b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.287 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.286+0000 7f357643f740 1 -- 172.21.15.87:0/1843974233 >> 172.21.15.87:0/1843974233 conn(0x5585d87858c0 msgr2=0x5585d878c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:05.288 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid 2024-09-13T17:15:05.288 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.286+0000 7f357643f740 1 -- 172.21.15.87:0/1843974233 shutdown_connections 2024-09-13T17:15:05.288 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.286+0000 7f357643f740 1 -- 172.21.15.87:0/1843974233 wait complete. 2024-09-13T17:15:05.288 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.286+0000 7f357643f740 20 client.16095 trim_cache size 0 max 16384 2024-09-13T17:15:05.289 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout:{ 2024-09-13T17:15:05.289 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout: "message": "", 2024-09-13T17:15:05.289 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout: "return_code": 0 2024-09-13T17:15:05.289 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout:} 2024-09-13T17:15:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.286+0000 7f357371f640 1 -- 172.21.15.87:0/1154039528 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f35580a13a0 msgr2=0x7f35580a3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.286+0000 7f357371f640 1 --2- 172.21.15.87:0/1154039528 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f35580a13a0 0x7f35580a3860 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f356401d000 tx=0x7f356401f000 comp rx=0 tx=0).stop 2024-09-13T17:15:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.286+0000 7f357371f640 1 -- 172.21.15.87:0/1154039528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f356c0681d0 msgr2=0x7f356c0ff600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.286+0000 7f357371f640 1 --2- 172.21.15.87:0/1154039528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f356c0681d0 0x7f356c0ff600 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f355c00e9f0 tx=0x7f355c00eeb0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.287+0000 7f357371f640 1 -- 172.21.15.87:0/1154039528 shutdown_connections 2024-09-13T17:15:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.287+0000 7f357371f640 1 --2- 172.21.15.87:0/1154039528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f356c104ce0 0x7f356c0ffb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.287+0000 7f357371f640 1 --2- 172.21.15.87:0/1154039528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f356c0681d0 0x7f356c0ff600 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.287+0000 7f357371f640 1 --2- 172.21.15.87:0/1154039528 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f35580a13a0 0x7f35580a3860 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.287+0000 7f357371f640 1 --2- 172.21.15.87:0/1154039528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f356c067830 0x7f356c0ff0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.287+0000 7f357371f640 1 -- 172.21.15.87:0/1154039528 >> 172.21.15.87:0/1154039528 conn(0x7f356c074940 msgr2=0x7f356c0fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:05.291 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.287+0000 7f357371f640 1 -- 172.21.15.87:0/1154039528 shutdown_connections 2024-09-13T17:15:05.291 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:05.287+0000 7f357371f640 1 -- 172.21.15.87:0/1154039528 wait complete. 2024-09-13T17:15:05.291 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse 2024-09-13T17:15:05.291 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi 2024-09-13T17:15:05.292 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom 2024-09-13T17:15:05.295 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback 2024-09-13T17:15:05.297 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront 2024-09-13T17:15:05.299 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi 2024-09-13T17:15:05.301 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi 2024-09-13T17:15:05.303 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi 2024-09-13T17:15:05.305 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map 2024-09-13T17:15:05.307 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi 2024-09-13T17:15:05.309 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log 2024-09-13T17:15:05.311 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap 2024-09-13T17:15:05.313 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw 2024-09-13T17:15:05.315 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi 2024-09-13T17:15:05.317 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv 2024-09-13T17:15:05.318 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4 2024-09-13T17:15:05.320 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs 2024-09-13T17:15:05.323 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2 2024-09-13T17:15:05.325 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs 2024-09-13T17:15:05.327 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-gpio 2024-09-13T17:15:05.329 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085 2024-09-13T17:15:05.331 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ibft 2024-09-13T17:15:05.333 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params 2024-09-13T17:15:05.335 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps 2024-09-13T17:15:05.337 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups 2024-09-13T17:15:05.339 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch 2024-09-13T17:15:05.341 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm 2024-09-13T17:15:05.343 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages 2024-09-13T17:15:05.345 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm 2024-09-13T17:15:05.347 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab 2024-09-13T17:15:05.349 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids 2024-09-13T17:15:05.351 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo 2024-09-13T17:15:05.353 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline 2024-09-13T17:15:05.355 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-module 2024-09-13T17:15:05.356 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2 2024-09-13T17:15:05.358 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop 2024-09-13T17:15:05.360 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi 2024-09-13T17:15:05.362 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91 2024-09-13T17:15:05.364 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb 2024-09-13T17:15:05.367 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg 2024-09-13T17:15:05.368 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop 2024-09-13T17:15:05.370 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop 2024-09-13T17:15:05.372 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim 2024-09-13T17:15:05.374 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop 2024-09-13T17:15:05.376 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb 2024-09-13T17:15:05.378 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500 2024-09-13T17:15:05.380 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-power 2024-09-13T17:15:05.382 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-pps 2024-09-13T17:15:05.384 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-profiling 2024-09-13T17:15:05.386 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ptp 2024-09-13T17:15:05.388 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-tty 2024-09-13T17:15:05.390 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf 2024-09-13T17:15:05.392 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/BUG-HUNTING 2024-09-13T17:15:05.395 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/Changes 2024-09-13T17:15:05.397 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/CodeOfConflict 2024-09-13T17:15:05.399 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/CodingStyle 2024-09-13T17:15:05.402 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DMA-API-HOWTO.txt 2024-09-13T17:15:05.405 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DMA-API.txt 2024-09-13T17:15:05.407 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DMA-ISA-LPC.txt 2024-09-13T17:15:05.409 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DMA-attributes.txt 2024-09-13T17:15:05.411 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/ 2024-09-13T17:15:05.413 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/.gitignore 2024-09-13T17:15:05.414 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/80211.tmpl 2024-09-13T17:15:05.417 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/Makefile 2024-09-13T17:15:05.419 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl 2024-09-13T17:15:05.421 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/crypto-API.tmpl 2024-09-13T17:15:05.424 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/debugobjects.tmpl 2024-09-13T17:15:05.427 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/device-drivers.tmpl 2024-09-13T17:15:05.429 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl 2024-09-13T17:15:05.430 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/drm.tmpl 2024-09-13T17:15:05.436 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/filesystems.tmpl 2024-09-13T17:15:05.438 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/gadget.tmpl 2024-09-13T17:15:05.441 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/genericirq.tmpl 2024-09-13T17:15:05.443 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/kernel-api.tmpl 2024-09-13T17:15:05.446 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl 2024-09-13T17:15:05.448 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl 2024-09-13T17:15:05.452 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/kgdb.tmpl 2024-09-13T17:15:05.454 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/libata.tmpl 2024-09-13T17:15:05.457 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/librs.tmpl 2024-09-13T17:15:05.459 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/lsm.tmpl 2024-09-13T17:15:05.462 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/ 2024-09-13T17:15:05.464 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/Makefile 2024-09-13T17:15:05.466 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/bayer.png.b64 2024-09-13T17:15:05.468 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/constraints.png.b64 2024-09-13T17:15:05.470 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/crop.gif.b64 2024-09-13T17:15:05.472 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ 2024-09-13T17:15:05.473 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore 2024-09-13T17:15:05.475 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml 2024-09-13T17:15:05.478 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml 2024-09-13T17:15:05.480 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml 2024-09-13T17:15:05.484 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml 2024-09-13T17:15:05.485 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml 2024-09-13T17:15:05.491 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf 2024-09-13T17:15:05.493 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml 2024-09-13T17:15:05.495 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml 2024-09-13T17:15:05.498 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml 2024-09-13T17:15:05.500 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml 2024-09-13T17:15:05.504 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/net.xml 2024-09-13T17:15:05.505 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/video.xml 2024-09-13T17:15:05.509 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64 2024-09-13T17:15:05.513 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64 2024-09-13T17:15:05.515 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64 2024-09-13T17:15:05.518 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64 2024-09-13T17:15:05.521 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64 2024-09-13T17:15:05.523 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64 2024-09-13T17:15:05.525 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/selection.png.b64 2024-09-13T17:15:05.527 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/ 2024-09-13T17:15:05.529 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore 2024-09-13T17:15:05.531 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml 2024-09-13T17:15:05.533 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml 2024-09-13T17:15:05.536 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/common.xml 2024-09-13T17:15:05.538 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml 2024-09-13T17:15:05.543 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml 2024-09-13T17:15:05.549 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf 2024-09-13T17:15:05.551 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml 2024-09-13T17:15:05.554 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml 2024-09-13T17:15:05.556 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml 2024-09-13T17:15:05.558 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml 2024-09-13T17:15:05.560 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml 2024-09-13T17:15:05.562 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml 2024-09-13T17:15:05.563 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml 2024-09-13T17:15:05.566 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml 2024-09-13T17:15:05.567 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml 2024-09-13T17:15:05.570 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml 2024-09-13T17:15:05.572 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml 2024-09-13T17:15:05.574 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml 2024-09-13T17:15:05.577 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml 2024-09-13T17:15:05.580 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml 2024-09-13T17:15:05.582 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml 2024-09-13T17:15:05.584 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml 2024-09-13T17:15:05.587 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf 2024-09-13T17:15:05.589 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf 2024-09-13T17:15:05.590 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml 2024-09-13T17:15:05.592 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml 2024-09-13T17:15:05.594 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml 2024-09-13T17:15:05.597 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml 2024-09-13T17:15:05.599 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml 2024-09-13T17:15:05.601 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml 2024-09-13T17:15:05.603 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml 2024-09-13T17:15:05.605 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml 2024-09-13T17:15:05.607 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml 2024-09-13T17:15:05.609 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml 2024-09-13T17:15:05.611 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/io.xml 2024-09-13T17:15:05.614 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml 2024-09-13T17:15:05.617 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml 2024-09-13T17:15:05.619 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml 2024-09-13T17:15:05.621 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml 2024-09-13T17:15:05.623 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml 2024-09-13T17:15:05.625 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml 2024-09-13T17:15:05.627 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml 2024-09-13T17:15:05.630 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml 2024-09-13T17:15:05.632 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml 2024-09-13T17:15:05.635 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml 2024-09-13T17:15:05.636 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml 2024-09-13T17:15:05.638 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf 2024-09-13T17:15:05.641 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml 2024-09-13T17:15:05.643 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml 2024-09-13T17:15:05.645 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml 2024-09-13T17:15:05.647 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml 2024-09-13T17:15:05.649 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml 2024-09-13T17:15:05.651 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml 2024-09-13T17:15:05.653 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml 2024-09-13T17:15:05.655 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml 2024-09-13T17:15:05.657 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml 2024-09-13T17:15:05.660 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml 2024-09-13T17:15:05.662 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml 2024-09-13T17:15:05.664 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml 2024-09-13T17:15:05.666 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml 2024-09-13T17:15:05.668 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml 2024-09-13T17:15:05.670 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml 2024-09-13T17:15:05.672 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml 2024-09-13T17:15:05.674 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml 2024-09-13T17:15:05.675 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml 2024-09-13T17:15:05.678 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml 2024-09-13T17:15:05.679 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml 2024-09-13T17:15:05.682 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml 2024-09-13T17:15:05.684 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml 2024-09-13T17:15:05.686 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml 2024-09-13T17:15:05.688 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml 2024-09-13T17:15:05.690 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml 2024-09-13T17:15:05.692 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml 2024-09-13T17:15:05.694 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml 2024-09-13T17:15:05.696 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml 2024-09-13T17:15:05.699 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml 2024-09-13T17:15:05.700 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml 2024-09-13T17:15:05.702 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml 2024-09-13T17:15:05.704 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml 2024-09-13T17:15:05.706 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml 2024-09-13T17:15:05.708 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml 2024-09-13T17:15:05.710 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml 2024-09-13T17:15:05.712 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml 2024-09-13T17:15:05.714 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml 2024-09-13T17:15:05.716 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml 2024-09-13T17:15:05.718 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml 2024-09-13T17:15:05.721 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml 2024-09-13T17:15:05.723 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml 2024-09-13T17:15:05.725 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml 2024-09-13T17:15:05.728 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml 2024-09-13T17:15:05.731 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml 2024-09-13T17:15:05.733 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml 2024-09-13T17:15:05.736 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml 2024-09-13T17:15:05.738 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml 2024-09-13T17:15:05.742 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia 2024-09-13T17:15:05.745 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg 2024-09-13T17:15:05.747 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia 2024-09-13T17:15:05.750 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg 2024-09-13T17:15:05.752 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia 2024-09-13T17:15:05.755 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg 2024-09-13T17:15:05.757 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml 2024-09-13T17:15:05.759 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml 2024-09-13T17:15:05.762 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf 2024-09-13T17:15:05.764 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf 2024-09-13T17:15:05.766 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf 2024-09-13T17:15:05.768 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml 2024-09-13T17:15:05.770 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml 2024-09-13T17:15:05.772 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml 2024-09-13T17:15:05.774 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml 2024-09-13T17:15:05.776 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml 2024-09-13T17:15:05.778 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml 2024-09-13T17:15:05.781 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml 2024-09-13T17:15:05.783 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml 2024-09-13T17:15:05.785 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml 2024-09-13T17:15:05.787 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml 2024-09-13T17:15:05.789 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml 2024-09-13T17:15:05.791 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml 2024-09-13T17:15:05.793 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml 2024-09-13T17:15:05.796 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml 2024-09-13T17:15:05.798 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml 2024-09-13T17:15:05.799 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml 2024-09-13T17:15:05.801 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml 2024-09-13T17:15:05.803 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml 2024-09-13T17:15:05.805 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml 2024-09-13T17:15:05.808 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml 2024-09-13T17:15:05.810 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml 2024-09-13T17:15:05.812 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml 2024-09-13T17:15:05.814 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml 2024-09-13T17:15:05.816 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml 2024-09-13T17:15:05.818 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml 2024-09-13T17:15:05.821 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml 2024-09-13T17:15:05.823 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml 2024-09-13T17:15:05.825 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml 2024-09-13T17:15:05.827 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml 2024-09-13T17:15:05.829 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml 2024-09-13T17:15:05.831 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml 2024-09-13T17:15:05.833 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml 2024-09-13T17:15:05.835 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml 2024-09-13T17:15:05.837 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml 2024-09-13T17:15:05.839 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml 2024-09-13T17:15:05.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:05 smithi149 ceph-mon[35496]: scrub summary: idle 2024-09-13T17:15:05.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:05 smithi149 ceph-mon[35496]: pgmap v41: 129 pgs: 129 active+clean; 68 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.6 MiB/s wr, 90 op/s 2024-09-13T17:15:05.842 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml 2024-09-13T17:15:05.844 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml 2024-09-13T17:15:05.846 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml 2024-09-13T17:15:05.848 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml 2024-09-13T17:15:05.850 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml 2024-09-13T17:15:05.852 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml 2024-09-13T17:15:05.854 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml 2024-09-13T17:15:05.856 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml 2024-09-13T17:15:05.858 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml 2024-09-13T17:15:05.860 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml 2024-09-13T17:15:05.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:05 smithi118 ceph-mon[34374]: scrub summary: idle 2024-09-13T17:15:05.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:05 smithi118 ceph-mon[34374]: pgmap v41: 129 pgs: 129 active+clean; 68 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.6 MiB/s wr, 90 op/s 2024-09-13T17:15:05.863 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml 2024-09-13T17:15:05.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:05 smithi087 ceph-mon[30934]: scrub summary: idle 2024-09-13T17:15:05.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:05 smithi087 ceph-mon[30934]: pgmap v41: 129 pgs: 129 active+clean; 68 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.6 MiB/s wr, 90 op/s 2024-09-13T17:15:08.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:08 smithi087 ceph-mon[30934]: pgmap v42: 129 pgs: 129 active+clean; 81 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.7 MiB/s wr, 103 op/s 2024-09-13T17:15:08.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:08 smithi149 ceph-mon[35496]: pgmap v42: 129 pgs: 129 active+clean; 81 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.7 MiB/s wr, 103 op/s 2024-09-13T17:15:08.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:08 smithi118 ceph-mon[34374]: pgmap v42: 129 pgs: 129 active+clean; 81 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.7 MiB/s wr, 103 op/s 2024-09-13T17:15:09.754 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml 2024-09-13T17:15:09.756 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml 2024-09-13T17:15:09.759 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml 2024-09-13T17:15:09.761 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml 2024-09-13T17:15:09.764 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml 2024-09-13T17:15:09.767 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml 2024-09-13T17:15:09.769 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml 2024-09-13T17:15:09.771 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml 2024-09-13T17:15:09.774 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml 2024-09-13T17:15:09.776 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml 2024-09-13T17:15:09.782 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml 2024-09-13T17:15:09.782 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml 2024-09-13T17:15:09.783 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml 2024-09-13T17:15:09.785 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml 2024-09-13T17:15:09.787 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64 2024-09-13T17:15:09.790 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64 2024-09-13T17:15:09.793 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64 2024-09-13T17:15:09.795 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/media_api.tmpl 2024-09-13T17:15:09.798 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/mtdnand.tmpl 2024-09-13T17:15:09.801 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/networking.tmpl 2024-09-13T17:15:09.803 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/rapidio.tmpl 2024-09-13T17:15:09.805 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/regulator.tmpl 2024-09-13T17:15:09.808 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl 2024-09-13T17:15:09.810 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/scsi.tmpl 2024-09-13T17:15:09.812 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/sh.tmpl 2024-09-13T17:15:09.814 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/stylesheet.xsl 2024-09-13T17:15:09.816 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/tracepoint.tmpl 2024-09-13T17:15:09.818 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/uio-howto.tmpl 2024-09-13T17:15:09.821 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/usb.tmpl 2024-09-13T17:15:09.824 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/w1.tmpl 2024-09-13T17:15:09.826 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl 2024-09-13T17:15:09.833 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl 2024-09-13T17:15:09.836 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl 2024-09-13T17:15:09.838 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/DocBook/z8530book.tmpl 2024-09-13T17:15:09.841 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/EDID/ 2024-09-13T17:15:09.843 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/EDID/1024x768.S 2024-09-13T17:15:09.845 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/EDID/1280x1024.S 2024-09-13T17:15:09.846 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/EDID/1600x1200.S 2024-09-13T17:15:09.849 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/EDID/1680x1050.S 2024-09-13T17:15:09.851 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/EDID/1920x1080.S 2024-09-13T17:15:09.852 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/EDID/800x600.S 2024-09-13T17:15:09.854 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/EDID/HOWTO.txt 2024-09-13T17:15:09.856 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/EDID/Makefile 2024-09-13T17:15:09.858 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/EDID/edid.S 2024-09-13T17:15:09.860 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/EDID/hex 2024-09-13T17:15:09.862 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/HOWTO 2024-09-13T17:15:09.865 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/IPMI.txt 2024-09-13T17:15:09.868 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/IRQ-affinity.txt 2024-09-13T17:15:09.869 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/IRQ-domain.txt 2024-09-13T17:15:09.871 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/IRQ.txt 2024-09-13T17:15:09.873 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/Intel-IOMMU.txt 2024-09-13T17:15:09.875 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/Makefile 2024-09-13T17:15:09.877 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ManagementStyle 2024-09-13T17:15:09.880 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/PCI/ 2024-09-13T17:15:09.881 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/PCI/00-INDEX 2024-09-13T17:15:09.883 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt 2024-09-13T17:15:09.886 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt 2024-09-13T17:15:09.888 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/PCI/pci-error-recovery.txt 2024-09-13T17:15:09.890 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/PCI/pci-iov-howto.txt 2024-09-13T17:15:09.892 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/PCI/pci.txt 2024-09-13T17:15:09.894 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/PCI/pcieaer-howto.txt 2024-09-13T17:15:09.897 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/RCU/ 2024-09-13T17:15:09.898 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/RCU/00-INDEX 2024-09-13T17:15:09.900 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/RCU/NMI-RCU.txt 2024-09-13T17:15:09.902 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/RCU/RTFP.txt 2024-09-13T17:15:09.906 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/RCU/UP.txt 2024-09-13T17:15:09.908 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/RCU/arrayRCU.txt 2024-09-13T17:15:09.910 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/RCU/checklist.txt 2024-09-13T17:15:09.912 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/RCU/listRCU.txt 2024-09-13T17:15:09.914 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/RCU/lockdep-splat.txt 2024-09-13T17:15:09.915 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/RCU/lockdep.txt 2024-09-13T17:15:09.918 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/RCU/rcu.txt 2024-09-13T17:15:09.920 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/RCU/rcu_dereference.txt 2024-09-13T17:15:09.922 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/RCU/rcubarrier.txt 2024-09-13T17:15:09.924 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/RCU/rculist_nulls.txt 2024-09-13T17:15:09.926 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/RCU/rcuref.txt 2024-09-13T17:15:09.928 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/RCU/stallwarn.txt 2024-09-13T17:15:09.930 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/RCU/torture.txt 2024-09-13T17:15:09.932 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/RCU/trace.txt 2024-09-13T17:15:09.935 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/RCU/whatisRCU.txt 2024-09-13T17:15:09.938 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/SAK.txt 2024-09-13T17:15:09.940 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/SM501.txt 2024-09-13T17:15:09.942 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/SecurityBugs 2024-09-13T17:15:09.944 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/SubmitChecklist 2024-09-13T17:15:09.945 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/SubmittingDrivers 2024-09-13T17:15:09.947 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/SubmittingPatches 2024-09-13T17:15:09.950 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/VGA-softcursor.txt 2024-09-13T17:15:09.952 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/accounting/ 2024-09-13T17:15:09.953 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/accounting/.gitignore 2024-09-13T17:15:09.955 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/accounting/Makefile 2024-09-13T17:15:09.957 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/accounting/cgroupstats.txt 2024-09-13T17:15:09.958 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/accounting/delay-accounting.txt 2024-09-13T17:15:09.961 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/accounting/getdelays.c 2024-09-13T17:15:09.963 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/accounting/taskstats-struct.txt 2024-09-13T17:15:09.965 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/accounting/taskstats.txt 2024-09-13T17:15:09.968 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/acpi/ 2024-09-13T17:15:09.969 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/acpi/apei/ 2024-09-13T17:15:09.971 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/acpi/apei/einj.txt 2024-09-13T17:15:09.973 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/acpi/apei/output_format.txt 2024-09-13T17:15:09.974 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/acpi/debug.txt 2024-09-13T17:15:09.977 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/acpi/dsdt-override.txt 2024-09-13T17:15:09.979 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/acpi/enumeration.txt 2024-09-13T17:15:09.981 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/acpi/gpio-properties.txt 2024-09-13T17:15:09.983 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/acpi/initrd_table_override.txt 2024-09-13T17:15:09.985 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/acpi/method-customizing.txt 2024-09-13T17:15:09.987 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/acpi/method-tracing.txt 2024-09-13T17:15:09.989 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/acpi/namespace.txt 2024-09-13T17:15:09.991 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/acpi/scan_handlers.txt 2024-09-13T17:15:09.993 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/acpi/video_extension.txt 2024-09-13T17:15:09.996 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/aoe/ 2024-09-13T17:15:09.997 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/aoe/aoe.txt 2024-09-13T17:15:10.000 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/aoe/autoload.sh 2024-09-13T17:15:10.001 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/aoe/status.sh 2024-09-13T17:15:10.003 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/aoe/todo.txt 2024-09-13T17:15:10.005 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/aoe/udev-install.sh 2024-09-13T17:15:10.007 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/aoe/udev.txt 2024-09-13T17:15:10.009 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/applying-patches.txt 2024-09-13T17:15:10.011 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/ 2024-09-13T17:15:10.013 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/00-INDEX 2024-09-13T17:15:10.014 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/Atmel/ 2024-09-13T17:15:10.016 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/Atmel/README 2024-09-13T17:15:10.018 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/Booting 2024-09-13T17:15:10.020 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/CCN.txt 2024-09-13T17:15:10.022 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/IXP4xx 2024-09-13T17:15:10.024 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/Interrupts 2024-09-13T17:15:10.026 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/Makefile 2024-09-13T17:15:10.028 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/Marvell/ 2024-09-13T17:15:10.030 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/Marvell/README 2024-09-13T17:15:10.032 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/Netwinder 2024-09-13T17:15:10.034 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/OMAP/ 2024-09-13T17:15:10.036 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/OMAP/DSS 2024-09-13T17:15:10.038 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/OMAP/omap_pm 2024-09-13T17:15:10.040 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/Porting 2024-09-13T17:15:10.043 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/README 2024-09-13T17:15:10.045 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/SA1100/ 2024-09-13T17:15:10.046 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/SA1100/ADSBitsy 2024-09-13T17:15:10.048 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/SA1100/Assabet 2024-09-13T17:15:10.051 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/SA1100/Brutus 2024-09-13T17:15:10.053 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/SA1100/CERF 2024-09-13T17:15:10.055 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/SA1100/FreeBird 2024-09-13T17:15:10.057 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsClient 2024-09-13T17:15:10.058 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster 2024-09-13T17:15:10.061 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL 2024-09-13T17:15:10.062 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/SA1100/Itsy 2024-09-13T17:15:10.064 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/SA1100/LART 2024-09-13T17:15:10.066 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/SA1100/PLEB 2024-09-13T17:15:10.068 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/SA1100/Pangolin 2024-09-13T17:15:10.070 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/SA1100/Tifon 2024-09-13T17:15:10.072 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/SA1100/Victor 2024-09-13T17:15:10.075 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/SA1100/Yopy 2024-09-13T17:15:10.076 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/SA1100/empeg 2024-09-13T17:15:10.078 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/SA1100/nanoEngine 2024-09-13T17:15:10.080 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/SA1100/serial_UART 2024-09-13T17:15:10.082 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/ 2024-09-13T17:15:10.084 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore 2024-09-13T17:15:10.086 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/Makefile 2024-09-13T17:15:10.088 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c 2024-09-13T17:15:10.090 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt 2024-09-13T17:15:10.092 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt 2024-09-13T17:15:10.094 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/SPEAr/ 2024-09-13T17:15:10.096 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/SPEAr/overview.txt 2024-09-13T17:15:10.098 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/ 2024-09-13T17:15:10.100 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt 2024-09-13T17:15:10.102 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt 2024-09-13T17:15:10.103 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt 2024-09-13T17:15:10.105 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt 2024-09-13T17:15:10.107 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt 2024-09-13T17:15:10.109 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt 2024-09-13T17:15:10.111 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt 2024-09-13T17:15:10.113 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt 2024-09-13T17:15:10.115 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt 2024-09-13T17:15:10.117 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt 2024-09-13T17:15:10.119 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt 2024-09-13T17:15:10.121 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/Samsung/ 2024-09-13T17:15:10.123 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/Samsung/GPIO.txt 2024-09-13T17:15:10.125 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/Samsung/Overview.txt 2024-09-13T17:15:10.127 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk 2024-09-13T17:15:10.129 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/Setup 2024-09-13T17:15:10.131 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/VFP/ 2024-09-13T17:15:10.133 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/VFP/release-notes.txt 2024-09-13T17:15:10.135 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt 2024-09-13T17:15:10.138 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/firmware.txt 2024-09-13T17:15:10.140 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/kernel_mode_neon.txt 2024-09-13T17:15:10.145 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/kernel_user_helpers.txt 2024-09-13T17:15:10.145 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/mem_alignment 2024-09-13T17:15:10.146 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/memory.txt 2024-09-13T17:15:10.148 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/msm/ 2024-09-13T17:15:10.149 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/msm/gpiomux.txt 2024-09-13T17:15:10.152 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/nwfpe/ 2024-09-13T17:15:10.153 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/nwfpe/NOTES 2024-09-13T17:15:10.155 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/nwfpe/README 2024-09-13T17:15:10.157 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/nwfpe/README.FPE 2024-09-13T17:15:10.159 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/nwfpe/TODO 2024-09-13T17:15:10.161 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/pxa/ 2024-09-13T17:15:10.163 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/pxa/mfp.txt 2024-09-13T17:15:10.165 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/sti/ 2024-09-13T17:15:10.167 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/sti/overview.txt 2024-09-13T17:15:10.169 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/sti/stih407-overview.txt 2024-09-13T17:15:10.170 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/sti/stih415-overview.txt 2024-09-13T17:15:10.173 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/sti/stih416-overview.txt 2024-09-13T17:15:10.175 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/sti/stih418-overview.txt 2024-09-13T17:15:10.177 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/sunxi/ 2024-09-13T17:15:10.179 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/sunxi/README 2024-09-13T17:15:10.181 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/sunxi/clocks.txt 2024-09-13T17:15:10.183 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/swp_emulation 2024-09-13T17:15:10.185 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/tcm.txt 2024-09-13T17:15:10.187 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/uefi.txt 2024-09-13T17:15:10.189 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm/vlocks.txt 2024-09-13T17:15:10.191 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm64/ 2024-09-13T17:15:10.193 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm64/booting.txt 2024-09-13T17:15:10.195 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm64/legacy_instructions.txt 2024-09-13T17:15:10.197 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm64/memory.txt 2024-09-13T17:15:10.199 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/arm64/tagged-pointers.txt 2024-09-13T17:15:10.201 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/assoc_array.txt 2024-09-13T17:15:10.203 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/atomic_ops.txt 2024-09-13T17:15:10.206 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/auxdisplay/ 2024-09-13T17:15:10.208 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/auxdisplay/.gitignore 2024-09-13T17:15:10.210 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/auxdisplay/Makefile 2024-09-13T17:15:10.212 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b 2024-09-13T17:15:10.214 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b-example.c 2024-09-13T17:15:10.216 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/auxdisplay/ks0108 2024-09-13T17:15:10.217 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/backlight/ 2024-09-13T17:15:10.220 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/backlight/lp855x-driver.txt 2024-09-13T17:15:10.221 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/bad_memory.txt 2024-09-13T17:15:10.224 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/basic_profiling.txt 2024-09-13T17:15:10.226 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/bcache.txt 2024-09-13T17:15:10.228 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/binfmt_misc.txt 2024-09-13T17:15:10.230 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/blackfin/ 2024-09-13T17:15:10.231 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/blackfin/00-INDEX 2024-09-13T17:15:10.233 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/blackfin/Makefile 2024-09-13T17:15:10.235 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/blackfin/bfin-gpio-notes.txt 2024-09-13T17:15:10.237 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/blackfin/bfin-spi-notes.txt 2024-09-13T17:15:10.238 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/blackfin/gptimers-example.c 2024-09-13T17:15:10.240 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/block/ 2024-09-13T17:15:10.242 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/block/00-INDEX 2024-09-13T17:15:10.244 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/block/biodoc.txt 2024-09-13T17:15:10.247 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/block/biovecs.txt 2024-09-13T17:15:10.249 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/block/capability.txt 2024-09-13T17:15:10.251 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/block/cfq-iosched.txt 2024-09-13T17:15:10.253 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/block/cmdline-partition.txt 2024-09-13T17:15:10.255 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/block/data-integrity.txt 2024-09-13T17:15:10.257 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/block/deadline-iosched.txt 2024-09-13T17:15:10.259 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/block/ioprio.txt 2024-09-13T17:15:10.261 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/block/null_blk.txt 2024-09-13T17:15:10.263 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/block/queue-sysfs.txt 2024-09-13T17:15:10.265 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/block/request.txt 2024-09-13T17:15:10.267 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/block/stat.txt 2024-09-13T17:15:10.269 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/block/switching-sched.txt 2024-09-13T17:15:10.270 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/block/writeback_cache_control.txt 2024-09-13T17:15:10.272 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/blockdev/ 2024-09-13T17:15:10.274 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/blockdev/00-INDEX 2024-09-13T17:15:10.276 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/blockdev/README.DAC960 2024-09-13T17:15:10.278 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/blockdev/cciss.txt 2024-09-13T17:15:10.280 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/blockdev/cpqarray.txt 2024-09-13T17:15:10.283 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/blockdev/drbd/ 2024-09-13T17:15:10.284 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-8.3-data-packets.svg 2024-09-13T17:15:10.287 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-data-packets.svg 2024-09-13T17:15:10.289 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/blockdev/drbd/README.txt 2024-09-13T17:15:10.291 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/blockdev/drbd/conn-states-8.dot 2024-09-13T17:15:10.293 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/blockdev/drbd/data-structure-v9.txt 2024-09-13T17:15:10.295 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/blockdev/drbd/disk-states-8.dot 2024-09-13T17:15:10.296 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/blockdev/drbd/drbd-connection-state-overview.dot 2024-09-13T17:15:10.299 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/blockdev/drbd/node-states-8.dot 2024-09-13T17:15:10.301 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/blockdev/floppy.txt 2024-09-13T17:15:10.303 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/blockdev/mflash.txt 2024-09-13T17:15:10.305 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/blockdev/nbd.txt 2024-09-13T17:15:10.307 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/blockdev/paride.txt 2024-09-13T17:15:10.309 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/blockdev/ramdisk.txt 2024-09-13T17:15:10.311 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/blockdev/zram.txt 2024-09-13T17:15:10.313 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/braille-console.txt 2024-09-13T17:15:10.316 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/bt8xxgpio.txt 2024-09-13T17:15:10.318 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/btmrvl.txt 2024-09-13T17:15:10.319 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/bus-devices/ 2024-09-13T17:15:10.321 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/bus-devices/ti-gpmc.txt 2024-09-13T17:15:10.323 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/bus-virt-phys-mapping.txt 2024-09-13T17:15:10.325 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cachetlb.txt 2024-09-13T17:15:10.327 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cdrom/ 2024-09-13T17:15:10.329 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cdrom/00-INDEX 2024-09-13T17:15:10.331 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cdrom/Makefile 2024-09-13T17:15:10.332 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cdrom/cdrom-standard.tex 2024-09-13T17:15:10.335 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cdrom/ide-cd 2024-09-13T17:15:10.338 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cdrom/packet-writing.txt 2024-09-13T17:15:10.340 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cgroups/ 2024-09-13T17:15:10.342 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cgroups/00-INDEX 2024-09-13T17:15:10.343 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cgroups/blkio-controller.txt 2024-09-13T17:15:10.346 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cgroups/cgroups.txt 2024-09-13T17:15:10.348 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cgroups/cpuacct.txt 2024-09-13T17:15:10.350 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cgroups/cpusets.txt 2024-09-13T17:15:10.353 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cgroups/devices.txt 2024-09-13T17:15:10.355 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cgroups/freezer-subsystem.txt 2024-09-13T17:15:10.357 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cgroups/hugetlb.txt 2024-09-13T17:15:10.359 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cgroups/memcg_test.txt 2024-09-13T17:15:10.361 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cgroups/memory.txt 2024-09-13T17:15:10.364 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cgroups/net_cls.txt 2024-09-13T17:15:10.366 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cgroups/net_prio.txt 2024-09-13T17:15:10.368 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cgroups/unified-hierarchy.txt 2024-09-13T17:15:10.370 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/circular-buffers.txt 2024-09-13T17:15:10.373 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/clk.txt 2024-09-13T17:15:10.375 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/coccinelle.txt 2024-09-13T17:15:10.377 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/connector/ 2024-09-13T17:15:10.379 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/connector/.gitignore 2024-09-13T17:15:10.381 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/connector/Makefile 2024-09-13T17:15:10.383 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/connector/cn_test.c 2024-09-13T17:15:10.385 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/connector/connector.txt 2024-09-13T17:15:10.387 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/connector/ucon.c 2024-09-13T17:15:10.389 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/console/ 2024-09-13T17:15:10.391 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/console/console.txt 2024-09-13T17:15:10.393 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cpu-freq/ 2024-09-13T17:15:10.395 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cpu-freq/amd-powernow.txt 2024-09-13T17:15:10.397 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cpu-freq/boost.txt 2024-09-13T17:15:10.399 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cpu-freq/core.txt 2024-09-13T17:15:10.401 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cpu-freq/cpu-drivers.txt 2024-09-13T17:15:10.403 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-nforce2.txt 2024-09-13T17:15:10.405 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-stats.txt 2024-09-13T17:15:10.407 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cpu-freq/governors.txt 2024-09-13T17:15:10.410 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cpu-freq/index.txt 2024-09-13T17:15:10.412 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cpu-freq/intel-pstate.txt 2024-09-13T17:15:10.413 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cpu-freq/pcc-cpufreq.txt 2024-09-13T17:15:10.416 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cpu-freq/user-guide.txt 2024-09-13T17:15:10.418 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cpu-hotplug.txt 2024-09-13T17:15:10.421 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cpu-load.txt 2024-09-13T17:15:10.423 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cpuidle/ 2024-09-13T17:15:10.425 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cpuidle/core.txt 2024-09-13T17:15:10.427 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cpuidle/driver.txt 2024-09-13T17:15:10.429 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cpuidle/governor.txt 2024-09-13T17:15:10.431 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cpuidle/sysfs.txt 2024-09-13T17:15:10.433 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cputopology.txt 2024-09-13T17:15:10.435 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/crc32.txt 2024-09-13T17:15:10.437 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cris/ 2024-09-13T17:15:10.439 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/cris/README 2024-09-13T17:15:10.441 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/crypto/ 2024-09-13T17:15:10.443 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/crypto/api-intro.txt 2024-09-13T17:15:10.445 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/crypto/asymmetric-keys.txt 2024-09-13T17:15:10.447 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/crypto/async-tx-api.txt 2024-09-13T17:15:10.449 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/crypto/crypto-API-userspace.txt 2024-09-13T17:15:10.451 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/crypto/descore-readme.txt 2024-09-13T17:15:10.453 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/dcdbas.txt 2024-09-13T17:15:10.455 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/debugging-modules.txt 2024-09-13T17:15:10.457 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/debugging-via-ohci1394.txt 2024-09-13T17:15:10.459 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/dell_rbu.txt 2024-09-13T17:15:10.461 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/development-process/ 2024-09-13T17:15:10.462 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/development-process/1.Intro 2024-09-13T17:15:10.465 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/development-process/2.Process 2024-09-13T17:15:10.467 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/development-process/3.Early-stage 2024-09-13T17:15:10.469 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/development-process/4.Coding 2024-09-13T17:15:10.472 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/development-process/5.Posting 2024-09-13T17:15:10.474 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/development-process/6.Followthrough 2024-09-13T17:15:10.476 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/development-process/7.AdvancedTopics 2024-09-13T17:15:10.478 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/development-process/8.Conclusion 2024-09-13T17:15:10.480 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/device-mapper/ 2024-09-13T17:15:10.482 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/device-mapper/cache-policies.txt 2024-09-13T17:15:10.484 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/device-mapper/cache.txt 2024-09-13T17:15:10.486 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/device-mapper/delay.txt 2024-09-13T17:15:10.488 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/device-mapper/dm-crypt.txt 2024-09-13T17:15:10.489 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/device-mapper/dm-flakey.txt 2024-09-13T17:15:10.491 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/device-mapper/dm-io.txt 2024-09-13T17:15:10.505 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/device-mapper/dm-log.txt 2024-09-13T17:15:10.606 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/device-mapper/dm-queue-length.txt 2024-09-13T17:15:10.608 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/device-mapper/dm-raid.txt 2024-09-13T17:15:10.610 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/device-mapper/dm-service-time.txt 2024-09-13T17:15:10.612 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/device-mapper/dm-uevent.txt 2024-09-13T17:15:10.614 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/device-mapper/era.txt 2024-09-13T17:15:10.616 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/device-mapper/kcopyd.txt 2024-09-13T17:15:10.618 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/device-mapper/linear.txt 2024-09-13T17:15:10.620 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/device-mapper/persistent-data.txt 2024-09-13T17:15:10.622 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/device-mapper/snapshot.txt 2024-09-13T17:15:10.624 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/device-mapper/statistics.txt 2024-09-13T17:15:10.626 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/device-mapper/striped.txt 2024-09-13T17:15:10.628 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/device-mapper/switch.txt 2024-09-13T17:15:10.630 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/device-mapper/thin-provisioning.txt 2024-09-13T17:15:10.632 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/device-mapper/verity.txt 2024-09-13T17:15:10.634 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/device-mapper/zero.txt 2024-09-13T17:15:10.636 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devices.txt 2024-09-13T17:15:10.640 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/ 2024-09-13T17:15:10.642 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/00-INDEX 2024-09-13T17:15:10.644 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/ 2024-09-13T17:15:10.645 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/ABI.txt 2024-09-13T17:15:10.647 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/ 2024-09-13T17:15:10.649 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/interrupts.txt 2024-09-13T17:15:10.651 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/pmu.txt 2024-09-13T17:15:10.653 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ 2024-09-13T17:15:10.655 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/adapteva.txt 2024-09-13T17:15:10.657 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/ 2024-09-13T17:15:10.659 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-clk-manager.txt 2024-09-13T17:15:10.661 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-sdram-edac.txt 2024-09-13T17:15:10.663 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-system.txt 2024-09-13T17:15:10.665 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/amlogic.txt 2024-09-13T17:15:10.668 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arch_timer.txt 2024-09-13T17:15:10.670 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arm-boards 2024-09-13T17:15:10.672 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp-pmsu.txt 2024-09-13T17:15:10.674 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp.txt 2024-09-13T17:15:10.676 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-375.txt 2024-09-13T17:15:10.678 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-380-mpcore-soc-ctrl.txt 2024-09-13T17:15:10.680 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-38x.txt 2024-09-13T17:15:10.682 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-cpu-reset.txt 2024-09-13T17:15:10.684 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armadeus.txt 2024-09-13T17:15:10.686 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-at91.txt 2024-09-13T17:15:10.688 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-pmc.txt 2024-09-13T17:15:10.690 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/axxia.txt 2024-09-13T17:15:10.692 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/ 2024-09-13T17:15:10.694 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm11351.txt 2024-09-13T17:15:10.696 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm21664.txt 2024-09-13T17:15:10.698 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm63138.txt 2024-09-13T17:15:10.700 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/brcm,bcm11351-cpu-method 2024-09-13T17:15:10.702 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/cygnus.txt 2024-09-13T17:15:10.704 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-resetmgr.txt 2024-09-13T17:15:10.707 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-timer.txt 2024-09-13T17:15:10.709 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-wdt.txt 2024-09-13T17:15:10.711 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm2835.txt 2024-09-13T17:15:10.713 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm4708.txt 2024-09-13T17:15:10.715 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/brcm-brcmstb.txt 2024-09-13T17:15:10.717 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda.txt 2024-09-13T17:15:10.719 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/ 2024-09-13T17:15:10.721 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/combophy.txt 2024-09-13T17:15:10.723 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/l2ecc.txt 2024-09-13T17:15:10.725 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/mem-ctrlr.txt 2024-09-13T17:15:10.727 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cavium-thunder.txt 2024-09-13T17:15:10.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:10 smithi087 ceph-mon[30934]: pgmap v43: 129 pgs: 129 active+clean; 81 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.7 MiB/s wr, 101 op/s 2024-09-13T17:15:10.730 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cci.txt 2024-09-13T17:15:10.732 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ccn.txt 2024-09-13T17:15:10.733 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coherency-fabric.txt 2024-09-13T17:15:10.735 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coresight.txt 2024-09-13T17:15:10.738 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/ 2024-09-13T17:15:10.739 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/marvell,berlin-smp 2024-09-13T17:15:10.741 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpus.txt 2024-09-13T17:15:10.744 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci.txt 2024-09-13T17:15:10.746 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/ 2024-09-13T17:15:10.748 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/cp-intc.txt 2024-09-13T17:15:10.750 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/digicolor.txt 2024-09-13T17:15:10.752 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/ 2024-09-13T17:15:10.754 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/power_domain.txt 2024-09-13T17:15:10.756 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/smp-sysram.txt 2024-09-13T17:15:10.758 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/ 2024-09-13T17:15:10.761 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/tlm,trusted-foundations.txt 2024-09-13T17:15:10.763 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fsl.txt 2024-09-13T17:15:10.765 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fw-cfg.txt 2024-09-13T17:15:10.767 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/geniatech.txt 2024-09-13T17:15:10.769 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic-v3.txt 2024-09-13T17:15:10.771 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic.txt 2024-09-13T17:15:10.773 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/global_timer.txt 2024-09-13T17:15:10.775 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/ 2024-09-13T17:15:10.777 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/hisilicon.txt 2024-09-13T17:15:10.779 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/idle-states.txt 2024-09-13T17:15:10.782 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/insignal-boards.txt 2024-09-13T17:15:10.784 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/ 2024-09-13T17:15:10.786 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/keystone.txt 2024-09-13T17:15:10.787 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/kirkwood.txt 2024-09-13T17:15:10.790 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/l2cc.txt 2024-09-13T17:15:10.791 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx-mic.txt 2024-09-13T17:15:10.793 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx.txt 2024-09-13T17:15:10.795 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,berlin.txt 2024-09-13T17:15:10.800 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,dove.txt 2024-09-13T17:15:10.801 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,kirkwood.txt 2024-09-13T17:15:10.801 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek.txt 2024-09-13T17:15:10.803 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/ 2024-09-13T17:15:10.805 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/mediatek,sysirq.txt 2024-09-13T17:15:10.807 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/moxart.txt 2024-09-13T17:15:10.810 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/ 2024-09-13T17:15:10.812 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/feroceon.txt 2024-09-13T17:15:10.814 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/intc.txt 2024-09-13T17:15:10.816 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/mrvl.txt 2024-09-13T17:15:10.819 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/tauros2.txt 2024-09-13T17:15:10.821 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/timer.txt 2024-09-13T17:15:10.823 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ 2024-09-13T17:15:10.826 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,kpss-acc.txt 2024-09-13T17:15:10.828 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,saw2.txt 2024-09-13T17:15:10.829 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ssbi.txt 2024-09-13T17:15:10.831 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/timer.txt 2024-09-13T17:15:10.833 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mvebu-system-controller.txt 2024-09-13T17:15:10.836 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/nspire.txt 2024-09-13T17:15:10.838 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/olimex.txt 2024-09-13T17:15:10.840 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/ 2024-09-13T17:15:10.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:10 smithi149 ceph-mon[35496]: pgmap v43: 129 pgs: 129 active+clean; 81 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.7 MiB/s wr, 101 op/s 2024-09-13T17:15:10.842 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/counter.txt 2024-09-13T17:15:10.844 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/crossbar.txt 2024-09-13T17:15:10.847 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dmm.txt 2024-09-13T17:15:10.848 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dsp.txt 2024-09-13T17:15:10.851 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/intc.txt 2024-09-13T17:15:10.853 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/iva.txt 2024-09-13T17:15:10.855 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/l3-noc.txt 2024-09-13T17:15:10.857 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/mpu.txt 2024-09-13T17:15:10.859 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/omap.txt 2024-09-13T17:15:10.861 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/prcm.txt 2024-09-13T17:15:10.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:10 smithi118 ceph-mon[34374]: pgmap v43: 129 pgs: 129 active+clean; 81 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.7 MiB/s wr, 101 op/s 2024-09-13T17:15:10.863 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/timer.txt 2024-09-13T17:15:10.865 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/picoxcell.txt 2024-09-13T17:15:10.867 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/pmu.txt 2024-09-13T17:15:10.869 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/primecell.txt 2024-09-13T17:15:10.871 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/psci.txt 2024-09-13T17:15:10.873 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip.txt 2024-09-13T17:15:10.876 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/ 2024-09-13T17:15:10.877 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu-sram.txt 2024-09-13T17:15:10.879 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu.txt 2024-09-13T17:15:10.881 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/smp-sram.txt 2024-09-13T17:15:10.883 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rtsm-dcscb.txt 2024-09-13T17:15:10.886 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung-boards.txt 2024-09-13T17:15:10.888 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/ 2024-09-13T17:15:10.890 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-adc.txt 2024-09-13T17:15:10.892 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-chipid.txt 2024-09-13T17:15:10.894 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/interrupt-combiner.txt 2024-09-13T17:15:10.896 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/pmu.txt 2024-09-13T17:15:10.898 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/sysreg.txt 2024-09-13T17:15:10.900 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/shmobile.txt 2024-09-13T17:15:10.902 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sirf.txt 2024-09-13T17:15:10.904 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-misc.txt 2024-09-13T17:15:10.906 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-timer.txt 2024-09-13T17:15:10.908 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear.txt 2024-09-13T17:15:10.910 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/ 2024-09-13T17:15:10.912 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/shirq.txt 2024-09-13T17:15:10.914 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sprd.txt 2024-09-13T17:15:10.917 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-nomadik.txt 2024-09-13T17:15:10.919 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-u300.txt 2024-09-13T17:15:10.921 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sti.txt 2024-09-13T17:15:10.923 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sunxi.txt 2024-09-13T17:15:10.925 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra.txt 2024-09-13T17:15:10.927 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/ 2024-09-13T17:15:10.929 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt 2024-09-13T17:15:10.931 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt 2024-09-13T17:15:10.933 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt 2024-09-13T17:15:10.935 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt 2024-09-13T17:15:10.937 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt 2024-09-13T17:15:10.939 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt 2024-09-13T17:15:10.941 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/topology.txt 2024-09-13T17:15:10.944 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/twd.txt 2024-09-13T17:15:10.947 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/ 2024-09-13T17:15:10.948 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt 2024-09-13T17:15:10.950 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-fpga-irq.txt 2024-09-13T17:15:10.953 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-sysreg.txt 2024-09-13T17:15:10.955 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-scc.txt 2024-09-13T17:15:10.957 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-sysreg.txt 2024-09-13T17:15:10.959 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress.txt 2024-09-13T17:15:10.962 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vic.txt 2024-09-13T17:15:10.964 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500.txt 2024-09-13T17:15:10.966 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/ 2024-09-13T17:15:10.967 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-intc.txt 2024-09-13T17:15:11.156 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-pmc.txt 2024-09-13T17:15:11.158 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-timer.txt 2024-09-13T17:15:11.160 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xen.txt 2024-09-13T17:15:11.163 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xilinx.txt 2024-09-13T17:15:11.165 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ 2024-09-13T17:15:11.167 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-platform.txt 2024-09-13T17:15:11.169 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-st.txt 2024-09-13T17:15:11.171 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/apm-xgene.txt 2024-09-13T17:15:11.173 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/atmel-at91_cf.txt 2024-09-13T17:15:11.175 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/cavium-compact-flash.txt 2024-09-13T17:15:11.177 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/exynos-sata.txt 2024-09-13T17:15:11.179 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/fsl-sata.txt 2024-09-13T17:15:11.181 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-pata.txt 2024-09-13T17:15:11.183 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-sata.txt 2024-09-13T17:15:11.185 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/marvell.txt 2024-09-13T17:15:11.187 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/pata-arasan.txt 2024-09-13T17:15:11.189 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/qcom-sata.txt 2024-09-13T17:15:11.191 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_highbank.txt 2024-09-13T17:15:11.193 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_rcar.txt 2024-09-13T17:15:11.195 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/tegra-sata.txt 2024-09-13T17:15:11.197 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/btmrvl.txt 2024-09-13T17:15:11.200 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ 2024-09-13T17:15:11.201 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/bcma.txt 2024-09-13T17:15:11.203 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/brcm,gisb-arb.txt 2024-09-13T17:15:11.208 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/imx-weim.txt 2024-09-13T17:15:11.208 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/mvebu-mbus.txt 2024-09-13T17:15:11.209 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/omap-ocp2scp.txt 2024-09-13T17:15:11.211 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ti-gpmc.txt 2024-09-13T17:15:11.213 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/ 2024-09-13T17:15:11.216 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/clocks.txt 2024-09-13T17:15:11.217 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/dscr.txt 2024-09-13T17:15:11.220 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/emifa.txt 2024-09-13T17:15:11.222 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/interrupt.txt 2024-09-13T17:15:11.224 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/soc.txt 2024-09-13T17:15:11.226 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/timer64.txt 2024-09-13T17:15:11.227 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/chosen.txt 2024-09-13T17:15:11.230 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ 2024-09-13T17:15:11.232 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/alphascale,acc.txt 2024-09-13T17:15:11.234 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/altr_socfpga.txt 2024-09-13T17:15:11.236 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/arm-integrator.txt 2024-09-13T17:15:11.238 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/at91-clock.txt 2024-09-13T17:15:11.240 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/axi-clkgen.txt 2024-09-13T17:15:11.242 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-cygnus-clock.txt 2024-09-13T17:15:11.244 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-kona-clock.txt 2024-09-13T17:15:11.246 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/calxeda.txt 2024-09-13T17:15:11.248 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-exynos-audss.txt 2024-09-13T17:15:11.250 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-palmas-clk32kg-clocks.txt 2024-09-13T17:15:11.252 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-s5pv210-audss.txt 2024-09-13T17:15:11.255 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clock-bindings.txt 2024-09-13T17:15:11.257 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clps711x-clock.txt 2024-09-13T17:15:11.259 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/efm32-clock.txt 2024-09-13T17:15:11.261 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/emev2-clock.txt 2024-09-13T17:15:11.263 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos3250-clock.txt 2024-09-13T17:15:11.265 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4-clock.txt 2024-09-13T17:15:11.266 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4415-clock.txt 2024-09-13T17:15:11.269 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5250-clock.txt 2024-09-13T17:15:11.270 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5260-clock.txt 2024-09-13T17:15:11.272 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5410-clock.txt 2024-09-13T17:15:11.275 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5420-clock.txt 2024-09-13T17:15:11.277 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5440-clock.txt 2024-09-13T17:15:11.279 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos7-clock.txt 2024-09-13T17:15:11.281 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-clock.txt 2024-09-13T17:15:11.282 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-factor-clock.txt 2024-09-13T17:15:11.285 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/gpio-gate-clock.txt 2024-09-13T17:15:11.286 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hi3620-clock.txt 2024-09-13T17:15:11.288 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hix5hd2-clock.txt 2024-09-13T17:15:11.291 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx1-clock.txt 2024-09-13T17:15:11.293 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx21-clock.txt 2024-09-13T17:15:11.294 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx23-clock.txt 2024-09-13T17:15:11.296 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx25-clock.txt 2024-09-13T17:15:11.298 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx27-clock.txt 2024-09-13T17:15:11.301 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx28-clock.txt 2024-09-13T17:15:11.302 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx31-clock.txt 2024-09-13T17:15:11.304 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx35-clock.txt 2024-09-13T17:15:11.306 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx5-clock.txt 2024-09-13T17:15:11.308 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6q-clock.txt 2024-09-13T17:15:11.310 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sl-clock.txt 2024-09-13T17:15:11.312 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sx-clock.txt 2024-09-13T17:15:11.314 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-gate.txt 2024-09-13T17:15:11.316 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-pll.txt 2024-09-13T17:15:11.318 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/lsi,axm5516-clks.txt 2024-09-13T17:15:11.320 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,mmp2.txt 2024-09-13T17:15:11.322 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa168.txt 2024-09-13T17:15:11.324 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa910.txt 2024-09-13T17:15:11.326 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77686.txt 2024-09-13T17:15:11.328 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77802.txt 2024-09-13T17:15:11.330 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/moxa,moxart-clock.txt 2024-09-13T17:15:11.332 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-core-clock.txt 2024-09-13T17:15:11.334 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-corediv-clock.txt 2024-09-13T17:15:11.336 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-cpu-clock.txt 2024-09-13T17:15:11.338 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-gated-clock.txt 2024-09-13T17:15:11.340 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nspire-clock.txt 2024-09-13T17:15:11.342 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra114-car.txt 2024-09-13T17:15:11.344 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra124-car.txt 2024-09-13T17:15:11.346 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra20-car.txt 2024-09-13T17:15:11.348 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra30-car.txt 2024-09-13T17:15:11.350 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/prima2-clock.txt 2024-09-13T17:15:11.352 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/pxa-clock.txt 2024-09-13T17:15:11.354 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,gcc.txt 2024-09-13T17:15:11.356 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,lcc.txt 2024-09-13T17:15:11.358 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,mmcc.txt 2024-09-13T17:15:11.361 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qoriq-clock.txt 2024-09-13T17:15:11.363 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-div6-clocks.txt 2024-09-13T17:15:11.366 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-mstp-clocks.txt 2024-09-13T17:15:11.369 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a73a4-cpg-clocks.txt 2024-09-13T17:15:11.370 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7740-cpg-clocks.txt 2024-09-13T17:15:11.372 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7779-cpg-clocks.txt 2024-09-13T17:15:11.374 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rcar-gen2-cpg-clocks.txt 2024-09-13T17:15:11.376 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rz-cpg-clocks.txt 2024-09-13T17:15:11.378 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,sh73a0-cpg-clocks.txt 2024-09-13T17:15:11.380 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3188-cru.txt 2024-09-13T17:15:11.382 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3288-cru.txt 2024-09-13T17:15:11.384 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip.txt 2024-09-13T17:15:11.386 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2410-clock.txt 2024-09-13T17:15:11.388 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2412-clock.txt 2024-09-13T17:15:11.390 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2443-clock.txt 2024-09-13T17:15:11.392 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c64xx-clock.txt 2024-09-13T17:15:11.394 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s5pv210-clock.txt 2024-09-13T17:15:11.396 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si5351.txt 2024-09-13T17:15:11.399 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si570.txt 2024-09-13T17:15:11.401 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st,nomadik.txt 2024-09-13T17:15:11.403 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/ 2024-09-13T17:15:11.405 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-divmux.txt 2024-09-13T17:15:11.408 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-mux.txt 2024-09-13T17:15:11.412 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-pll.txt 2024-09-13T17:15:11.413 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-prediv.txt 2024-09-13T17:15:11.414 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-vcc.txt 2024-09-13T17:15:11.416 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen.txt 2024-09-13T17:15:11.418 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,flexgen.txt 2024-09-13T17:15:11.420 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,quadfs.txt 2024-09-13T17:15:11.422 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ste-u300-syscon-clock.txt 2024-09-13T17:15:11.425 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/sunxi.txt 2024-09-13T17:15:11.427 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti,cdce706.txt 2024-09-13T17:15:11.429 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti-keystone-pllctrl.txt 2024-09-13T17:15:11.431 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/ 2024-09-13T17:15:11.433 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/apll.txt 2024-09-13T17:15:11.435 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/autoidle.txt 2024-09-13T17:15:11.437 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/clockdomain.txt 2024-09-13T17:15:11.439 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/composite.txt 2024-09-13T17:15:11.441 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/divider.txt 2024-09-13T17:15:11.443 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dpll.txt 2024-09-13T17:15:11.445 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dra7-atl.txt 2024-09-13T17:15:11.447 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fapll.txt 2024-09-13T17:15:11.449 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fixed-factor-clock.txt 2024-09-13T17:15:11.451 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/gate.txt 2024-09-13T17:15:11.453 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/interface.txt 2024-09-13T17:15:11.455 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/mux.txt 2024-09-13T17:15:11.457 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vf610-clock.txt 2024-09-13T17:15:11.459 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vt8500.txt 2024-09-13T17:15:11.461 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/xgene.txt 2024-09-13T17:15:11.463 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/zynq-7000.txt 2024-09-13T17:15:11.465 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/ 2024-09-13T17:15:11.468 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/arm_big_little_dt.txt 2024-09-13T17:15:11.470 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-dt.txt 2024-09-13T17:15:11.472 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-exynos5440.txt 2024-09-13T17:15:11.475 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-spear.txt 2024-09-13T17:15:11.477 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/ 2024-09-13T17:15:11.479 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/amd-ccp.txt 2024-09-13T17:15:11.481 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/atmel-crypto.txt 2024-09-13T17:15:11.483 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-dcp.txt 2024-09-13T17:15:11.485 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-imx-sahara.txt 2024-09-13T17:15:11.487 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec2.txt 2024-09-13T17:15:11.489 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec4.txt 2024-09-13T17:15:11.491 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec6.txt 2024-09-13T17:15:11.493 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/mv_cesa.txt 2024-09-13T17:15:11.495 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-aes.txt 2024-09-13T17:15:11.497 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-des.txt 2024-09-13T17:15:11.499 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-sham.txt 2024-09-13T17:15:11.501 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/picochip-spacc.txt 2024-09-13T17:15:11.503 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/qcom-qce.txt 2024-09-13T17:15:11.517 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/samsung-sss.txt 2024-09-13T17:15:11.573 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/ 2024-09-13T17:15:11.575 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/ 2024-09-13T17:15:11.577 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt 2024-09-13T17:15:11.579 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ 2024-09-13T17:15:11.582 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/arm-pl330.txt 2024-09-13T17:15:11.584 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-dma.txt 2024-09-13T17:15:11.585 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-xdma.txt 2024-09-13T17:15:11.588 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/bcm2835-dma.txt 2024-09-13T17:15:11.589 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/dma.txt 2024-09-13T17:15:11.592 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-edma.txt 2024-09-13T17:15:11.594 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-dma.txt 2024-09-13T17:15:11.596 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-sdma.txt 2024-09-13T17:15:11.598 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-mxs-dma.txt 2024-09-13T17:15:11.600 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/img-mdc-dma.txt 2024-09-13T17:15:11.602 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/k3dma.txt 2024-09-13T17:15:11.604 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mmp-dma.txt 2024-09-13T17:15:11.606 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/moxa,moxart-dma.txt 2024-09-13T17:15:11.607 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mpc512x-dma.txt 2024-09-13T17:15:11.609 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mv-xor.txt 2024-09-13T17:15:11.612 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/nbpfaxi.txt 2024-09-13T17:15:11.614 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_adm.txt 2024-09-13T17:15:11.616 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_bam_dma.txt 2024-09-13T17:15:11.621 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/rcar-audmapp.txt 2024-09-13T17:15:11.621 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/renesas,rcar-dmac.txt 2024-09-13T17:15:11.622 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/shdma.txt 2024-09-13T17:15:11.624 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sirfsoc-dma.txt 2024-09-13T17:15:11.626 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/snps-dma.txt 2024-09-13T17:15:11.628 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-coh901318.txt 2024-09-13T17:15:11.631 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-dma40.txt 2024-09-13T17:15:11.633 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sun6i-dma.txt 2024-09-13T17:15:11.635 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/tegra20-apbdma.txt 2024-09-13T17:15:11.637 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ti-edma.txt 2024-09-13T17:15:11.639 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/ 2024-09-13T17:15:11.641 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_dma.txt 2024-09-13T17:15:11.643 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_vdma.txt 2024-09-13T17:15:11.645 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/ 2024-09-13T17:15:11.649 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/ 2024-09-13T17:15:11.650 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/marvell,dove-lcd.txt 2024-09-13T17:15:11.652 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/ 2024-09-13T17:15:11.655 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/hlcdc-dc.txt 2024-09-13T17:15:11.657 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/ 2024-09-13T17:15:11.659 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/dw_hdmi.txt 2024-09-13T17:15:11.661 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/ 2024-09-13T17:15:11.664 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/tda998x.txt 2024-09-13T17:15:11.666 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ 2024-09-13T17:15:11.669 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/fsl-imx-drm.txt 2024-09-13T17:15:11.671 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/hdmi.txt 2024-09-13T17:15:11.674 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ldb.txt 2024-09-13T17:15:11.675 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/ 2024-09-13T17:15:11.678 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/gpu.txt 2024-09-13T17:15:11.680 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/hdmi.txt 2024-09-13T17:15:11.682 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/mdp.txt 2024-09-13T17:15:11.684 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/ 2024-09-13T17:15:11.686 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/panel.txt 2024-09-13T17:15:11.688 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/slave.txt 2024-09-13T17:15:11.690 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tfp410.txt 2024-09-13T17:15:11.692 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tilcdc.txt 2024-09-13T17:15:11.694 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/eeprom.txt 2024-09-13T17:15:11.698 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/ 2024-09-13T17:15:11.700 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-palmas.txt 2024-09-13T17:15:11.701 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-rt8973a.txt 2024-09-13T17:15:11.704 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-sm5502.txt 2024-09-13T17:15:11.706 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/ 2024-09-13T17:15:11.708 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/mxsfb.txt 2024-09-13T17:15:11.710 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/sm501fb.txt 2024-09-13T17:15:11.712 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/ 2024-09-13T17:15:11.714 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/altera-socfpga-fpga-mgr.txt 2024-09-13T17:15:11.716 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/ 2024-09-13T17:15:11.718 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/nvidia,tegra20-fuse.txt 2024-09-13T17:15:11.720 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/ 2024-09-13T17:15:11.723 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt 2024-09-13T17:15:11.724 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt 2024-09-13T17:15:11.726 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt 2024-09-13T17:15:11.729 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt 2024-09-13T17:15:11.731 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt 2024-09-13T17:15:11.733 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt 2024-09-13T17:15:11.735 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt 2024-09-13T17:15:11.737 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt 2024-09-13T17:15:11.739 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt 2024-09-13T17:15:11.741 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt 2024-09-13T17:15:11.743 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt 2024-09-13T17:15:11.745 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt 2024-09-13T17:15:11.747 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt 2024-09-13T17:15:11.749 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt 2024-09-13T17:15:11.751 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt 2024-09-13T17:15:11.753 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt 2024-09-13T17:15:11.755 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt 2024-09-13T17:15:11.757 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt 2024-09-13T17:15:11.759 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt 2024-09-13T17:15:11.761 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt 2024-09-13T17:15:11.763 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt 2024-09-13T17:15:11.765 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt 2024-09-13T17:15:11.767 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt 2024-09-13T17:15:11.769 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt 2024-09-13T17:15:11.771 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt 2024-09-13T17:15:11.773 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt 2024-09-13T17:15:11.775 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt 2024-09-13T17:15:11.777 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt 2024-09-13T17:15:11.780 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt 2024-09-13T17:15:11.781 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt 2024-09-13T17:15:11.783 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt 2024-09-13T17:15:11.785 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt 2024-09-13T17:15:11.787 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt 2024-09-13T17:15:11.789 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt 2024-09-13T17:15:11.791 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt 2024-09-13T17:15:11.793 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt 2024-09-13T17:15:11.795 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt 2024-09-13T17:15:11.797 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt 2024-09-13T17:15:11.799 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt 2024-09-13T17:15:11.801 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt 2024-09-13T17:15:11.803 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt 2024-09-13T17:15:11.805 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt 2024-09-13T17:15:11.807 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt 2024-09-13T17:15:11.809 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt 2024-09-13T17:15:11.811 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt 2024-09-13T17:15:11.813 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt 2024-09-13T17:15:11.815 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt 2024-09-13T17:15:11.817 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt 2024-09-13T17:15:11.820 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt 2024-09-13T17:15:11.821 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt 2024-09-13T17:15:11.823 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt 2024-09-13T17:15:11.825 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt 2024-09-13T17:15:11.827 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt 2024-09-13T17:15:11.829 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt 2024-09-13T17:15:11.831 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/ 2024-09-13T17:15:11.833 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,gk20a.txt 2024-09-13T17:15:11.835 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,tegra20-host1x.txt 2024-09-13T17:15:11.838 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-g2d.txt 2024-09-13T17:15:11.840 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-rotator.txt 2024-09-13T17:15:11.843 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/st,stih4xx.txt 2024-09-13T17:15:11.845 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/graph.txt 2024-09-13T17:15:11.847 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/ 2024-09-13T17:15:11.849 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/hid-over-i2c.txt 2024-09-13T17:15:11.851 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/ 2024-09-13T17:15:11.853 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/client-devices.txt 2024-09-13T17:15:11.855 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/nokia-modem.txt 2024-09-13T17:15:11.858 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/omap-ssi.txt 2024-09-13T17:15:11.860 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ 2024-09-13T17:15:11.862 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ads1015.txt 2024-09-13T17:15:11.865 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/g762.txt 2024-09-13T17:15:11.867 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ibmpowernv.txt 2024-09-13T17:15:11.869 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/lm90.txt 2024-09-13T17:15:11.871 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ltc2978.txt 2024-09-13T17:15:11.873 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ntc_thermistor.txt 2024-09-13T17:15:11.875 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/pwm-fan.txt 2024-09-13T17:15:11.877 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/vexpress.txt 2024-09-13T17:15:11.880 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/ 2024-09-13T17:15:11.882 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/atmel-trng.txt 2024-09-13T17:15:11.885 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/omap_rng.txt 2024-09-13T17:15:11.886 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/timeriomem_rng.txt 2024-09-13T17:15:11.889 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ 2024-09-13T17:15:11.891 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,bcm2835-i2c.txt 2024-09-13T17:15:11.893 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,iproc-i2c.txt 2024-09-13T17:15:11.895 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-arb-gpio-challenge.txt 2024-09-13T17:15:11.897 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-at91.txt 2024-09-13T17:15:11.899 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-axxia.txt 2024-09-13T17:15:11.900 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-bcm-kona.txt 2024-09-13T17:15:11.902 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cadence.txt 2024-09-13T17:15:11.904 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cbus-gpio.txt 2024-09-13T17:15:11.906 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cros-ec-tunnel.txt 2024-09-13T17:15:11.908 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-davinci.txt 2024-09-13T17:15:11.910 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-designware.txt 2024-09-13T17:15:11.912 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-efm32.txt 2024-09-13T17:15:11.914 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-exynos5.txt 2024-09-13T17:15:11.916 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-gpio.txt 2024-09-13T17:15:11.918 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-hix5hd2.txt 2024-09-13T17:15:11.921 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-img-scb.txt 2024-09-13T17:15:11.923 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-imx.txt 2024-09-13T17:15:11.925 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-meson.txt 2024-09-13T17:15:11.927 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mpc.txt 2024-09-13T17:15:11.929 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-gpio.txt 2024-09-13T17:15:11.931 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pca954x.txt 2024-09-13T17:15:11.933 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pinctrl.txt 2024-09-13T17:15:11.934 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux.txt 2024-09-13T17:15:11.936 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mv64xxx.txt 2024-09-13T17:15:11.938 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mxs.txt 2024-09-13T17:15:11.940 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-nomadik.txt 2024-09-13T17:15:11.942 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-ocores.txt 2024-09-13T17:15:11.944 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-octeon.txt 2024-09-13T17:15:11.946 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-omap.txt 2024-09-13T17:15:11.948 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-opal.txt 2024-09-13T17:15:11.951 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pnx.txt 2024-09-13T17:15:11.953 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa-pci-ce4100.txt 2024-09-13T17:15:11.954 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa.txt 2024-09-13T17:15:11.957 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rcar.txt 2024-09-13T17:15:11.959 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-riic.txt 2024-09-13T17:15:11.961 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rk3x.txt 2024-09-13T17:15:11.963 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-s3c2410.txt 2024-09-13T17:15:11.965 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sh_mobile.txt 2024-09-13T17:15:11.967 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sirf.txt 2024-09-13T17:15:11.969 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st-ddci2c.txt 2024-09-13T17:15:11.971 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st.txt 2024-09-13T17:15:11.973 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sunxi-p2wi.txt 2024-09-13T17:15:11.975 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-versatile.txt 2024-09-13T17:15:11.977 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-vt8500.txt 2024-09-13T17:15:11.979 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-xiic.txt 2024-09-13T17:15:11.981 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina209.txt 2024-09-13T17:15:11.983 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina2xx.txt 2024-09-13T17:15:11.985 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/max6697.txt 2024-09-13T17:15:11.987 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/nvidia,tegra20-i2c.txt 2024-09-13T17:15:11.989 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/qcom,i2c-qup.txt 2024-09-13T17:15:11.991 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ti,bq32k.txt 2024-09-13T17:15:11.993 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/trivial-devices.txt 2024-09-13T17:15:11.995 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/ 2024-09-13T17:15:11.997 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/ 2024-09-13T17:15:11.999 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/bma180.txt 2024-09-13T17:15:12.001 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/ 2024-09-13T17:15:12.003 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/at91_adc.txt 2024-09-13T17:15:12.005 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/cc10001_adc.txt 2024-09-13T17:15:12.007 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/max1027-adc.txt 2024-09-13T17:15:12.010 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/nuvoton-nau7802.txt 2024-09-13T17:15:12.012 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-iadc.txt 2024-09-13T17:15:12.013 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-vadc.txt 2024-09-13T17:15:12.016 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/rockchip-saradc.txt 2024-09-13T17:15:12.018 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/twl4030-madc.txt 2024-09-13T17:15:12.020 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/vf610-adc.txt 2024-09-13T17:15:12.025 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/xilinx-xadc.txt 2024-09-13T17:15:12.025 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ 2024-09-13T17:15:12.026 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ad7303.txt 2024-09-13T17:15:12.028 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/max5821.txt 2024-09-13T17:15:12.031 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/ 2024-09-13T17:15:12.033 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/adf4350.txt 2024-09-13T17:15:12.035 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/ 2024-09-13T17:15:12.037 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/dht11.txt 2024-09-13T17:15:12.039 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/iio-bindings.txt 2024-09-13T17:15:12.042 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/ 2024-09-13T17:15:12.044 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/apds9300.txt 2024-09-13T17:15:12.046 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/cm36651.txt 2024-09-13T17:15:12.047 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/gp2ap020a00f.txt 2024-09-13T17:15:12.050 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/tsl2563.txt 2024-09-13T17:15:12.052 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ 2024-09-13T17:15:12.054 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ak8975.txt 2024-09-13T17:15:12.057 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/hmc5843.txt 2024-09-13T17:15:12.059 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/ 2024-09-13T17:15:12.061 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/as3935.txt 2024-09-13T17:15:12.063 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/sensorhub.txt 2024-09-13T17:15:12.067 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/st-sensors.txt 2024-09-13T17:15:12.069 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ 2024-09-13T17:15:12.071 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt 2024-09-13T17:15:12.073 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt 2024-09-13T17:15:12.075 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt 2024-09-13T17:15:12.077 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt 2024-09-13T17:15:12.079 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt 2024-09-13T17:15:12.081 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt 2024-09-13T17:15:12.083 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt 2024-09-13T17:15:12.085 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt 2024-09-13T17:15:12.088 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt 2024-09-13T17:15:12.090 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt 2024-09-13T17:15:12.092 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt 2024-09-13T17:15:12.094 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt 2024-09-13T17:15:12.096 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt 2024-09-13T17:15:12.098 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt 2024-09-13T17:15:12.099 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt 2024-09-13T17:15:12.101 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt 2024-09-13T17:15:12.104 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt 2024-09-13T17:15:12.106 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt 2024-09-13T17:15:12.107 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt 2024-09-13T17:15:12.109 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt 2024-09-13T17:15:12.111 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt 2024-09-13T17:15:12.113 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt 2024-09-13T17:15:12.116 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt 2024-09-13T17:15:12.118 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt 2024-09-13T17:15:12.120 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt 2024-09-13T17:15:12.122 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt 2024-09-13T17:15:12.124 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt 2024-09-13T17:15:12.126 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt 2024-09-13T17:15:12.128 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt 2024-09-13T17:15:12.130 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt 2024-09-13T17:15:12.132 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt 2024-09-13T17:15:12.134 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt 2024-09-13T17:15:12.136 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt 2024-09-13T17:15:12.138 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt 2024-09-13T17:15:12.140 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt 2024-09-13T17:15:12.142 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt 2024-09-13T17:15:12.144 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt 2024-09-13T17:15:12.146 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ 2024-09-13T17:15:12.148 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt 2024-09-13T17:15:12.150 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt 2024-09-13T17:15:12.152 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt 2024-09-13T17:15:12.153 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt 2024-09-13T17:15:12.155 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt 2024-09-13T17:15:12.157 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt 2024-09-13T17:15:12.159 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt 2024-09-13T17:15:12.165 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt 2024-09-13T17:15:12.165 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt 2024-09-13T17:15:12.166 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt 2024-09-13T17:15:12.168 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt 2024-09-13T17:15:12.170 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt 2024-09-13T17:15:12.172 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt 2024-09-13T17:15:12.174 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt 2024-09-13T17:15:12.177 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt 2024-09-13T17:15:12.179 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt 2024-09-13T17:15:12.181 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt 2024-09-13T17:15:12.183 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt 2024-09-13T17:15:12.185 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ 2024-09-13T17:15:12.188 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/abilis,tb10x-ictl.txt 2024-09-13T17:15:12.190 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun4i-ic.txt 2024-09-13T17:15:12.191 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun67i-sc-nmi.txt 2024-09-13T17:15:12.194 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/atmel,aic.txt 2024-09-13T17:15:12.196 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm2835-armctrl-ic.txt 2024-09-13T17:15:12.198 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm7120-l2-intc.txt 2024-09-13T17:15:12.200 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,l2-intc.txt 2024-09-13T17:15:12.202 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/cirrus,clps711x-intc.txt 2024-09-13T17:15:12.204 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/digicolor-ic.txt 2024-09-13T17:15:12.206 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/interrupts.txt 2024-09-13T17:15:12.208 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/lsi,zevio-intc.txt 2024-09-13T17:15:12.210 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,armada-370-xp-mpic.txt 2024-09-13T17:15:12.212 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,orion-intc.txt 2024-09-13T17:15:12.214 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/mips-gic.txt 2024-09-13T17:15:12.216 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/opencores,or1k-pic.txt 2024-09-13T17:15:12.218 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,intc-irqpin.txt 2024-09-13T17:15:12.220 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,irqc.txt 2024-09-13T17:15:12.222 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/samsung,s3c24xx-irq.txt 2024-09-13T17:15:12.224 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/snps,dw-apb-ictl.txt 2024-09-13T17:15:12.227 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,keystone-irq.txt 2024-09-13T17:15:12.228 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,omap-intc-irq.txt 2024-09-13T17:15:12.230 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ 2024-09-13T17:15:12.233 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/arm,smmu.txt 2024-09-13T17:15:12.235 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/iommu.txt 2024-09-13T17:15:12.237 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra20-gart.txt 2024-09-13T17:15:12.239 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra30-smmu.txt 2024-09-13T17:15:12.241 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/renesas,ipmmu-vmsa.txt 2024-09-13T17:15:12.243 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/rockchip,iommu.txt 2024-09-13T17:15:12.245 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/samsung,sysmmu.txt 2024-09-13T17:15:12.247 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ti,omap-iommu.txt 2024-09-13T17:15:12.249 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/ 2024-09-13T17:15:12.251 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/common.txt 2024-09-13T17:15:12.253 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-gpio.txt 2024-09-13T17:15:12.255 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp55xx.txt 2024-09-13T17:15:12.257 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp8860.txt 2024-09-13T17:15:12.259 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-ns2.txt 2024-09-13T17:15:12.402 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-pwm.txt 2024-09-13T17:15:12.404 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/pca963x.txt 2024-09-13T17:15:12.406 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/register-bit-led.txt 2024-09-13T17:15:12.408 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/tca6507.txt 2024-09-13T17:15:12.410 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/ 2024-09-13T17:15:12.413 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2-timings.txt 2024-09-13T17:15:12.415 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2.txt 2024-09-13T17:15:12.416 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/ 2024-09-13T17:15:12.419 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/altera-mailbox.txt 2024-09-13T17:15:12.421 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/mailbox.txt 2024-09-13T17:15:12.423 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/omap-mailbox.txt 2024-09-13T17:15:12.425 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/marvell.txt 2024-09-13T17:15:12.428 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ 2024-09-13T17:15:12.434 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/atmel-isi.txt 2024-09-13T17:15:12.434 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/coda.txt 2024-09-13T17:15:12.434 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-fimc-lite.txt 2024-09-13T17:15:12.435 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-jpeg-codec.txt 2024-09-13T17:15:12.437 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos4-fimc-is.txt 2024-09-13T17:15:12.439 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos5-gsc.txt 2024-09-13T17:15:12.442 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/gpio-ir-receiver.txt 2024-09-13T17:15:12.444 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/hix5hd2-ir.txt 2024-09-13T17:15:12.446 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ 2024-09-13T17:15:12.448 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt 2024-09-13T17:15:12.450 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt 2024-09-13T17:15:12.452 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt 2024-09-13T17:15:12.454 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt 2024-09-13T17:15:12.456 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt 2024-09-13T17:15:12.458 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt 2024-09-13T17:15:12.460 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt 2024-09-13T17:15:12.462 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt 2024-09-13T17:15:12.464 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/img-ir-rev1.txt 2024-09-13T17:15:12.467 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/meson-ir.txt 2024-09-13T17:15:12.469 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/pxa-camera.txt 2024-09-13T17:15:12.471 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/rcar_vin.txt 2024-09-13T17:15:12.473 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/renesas,vsp1.txt 2024-09-13T17:15:12.475 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/s5p-mfc.txt 2024-09-13T17:15:12.477 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-fimc.txt 2024-09-13T17:15:12.479 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-mipi-csis.txt 2024-09-13T17:15:12.481 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5c73m3.txt 2024-09-13T17:15:12.483 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k5baf.txt 2024-09-13T17:15:12.485 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k6a3.txt 2024-09-13T17:15:12.488 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sh_mobile_ceu.txt 2024-09-13T17:15:12.490 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/si4713.txt 2024-09-13T17:15:12.491 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/st-rc.txt 2024-09-13T17:15:12.493 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sunxi-ir.txt 2024-09-13T17:15:12.495 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ti-am437x-vpfe.txt 2024-09-13T17:15:12.497 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/video-interfaces.txt 2024-09-13T17:15:12.499 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ 2024-09-13T17:15:12.501 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ 2024-09-13T17:15:12.503 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ifc.txt 2024-09-13T17:15:12.505 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-devbus.txt 2024-09-13T17:15:12.508 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-sdram-controller.txt 2024-09-13T17:15:12.510 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra-mc.txt 2024-09-13T17:15:12.512 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/renesas-memory-controllers.txt 2024-09-13T17:15:12.514 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/synopsys.txt 2024-09-13T17:15:12.516 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti-aemif.txt 2024-09-13T17:15:12.523 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/ 2024-09-13T17:15:12.524 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/emif.txt 2024-09-13T17:15:12.527 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/ 2024-09-13T17:15:12.529 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta-intc.txt 2024-09-13T17:15:12.531 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta.txt 2024-09-13T17:15:12.533 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/pdc-intc.txt 2024-09-13T17:15:12.536 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ 2024-09-13T17:15:12.538 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/88pm860x.txt 2024-09-13T17:15:12.540 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ab8500.txt 2024-09-13T17:15:12.542 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/arizona.txt 2024-09-13T17:15:12.544 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3711.txt 2024-09-13T17:15:12.545 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3722.txt 2024-09-13T17:15:12.548 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-gpbr.txt 2024-09-13T17:15:12.550 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-hlcdc.txt 2024-09-13T17:15:12.552 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-matrix.txt 2024-09-13T17:15:12.554 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-smc.txt 2024-09-13T17:15:12.556 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bcm590xx.txt 2024-09-13T17:15:12.558 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bfticu.txt 2024-09-13T17:15:12.560 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/cros-ec.txt 2024-09-13T17:15:12.561 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9052-i2c.txt 2024-09-13T17:15:12.565 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9055.txt 2024-09-13T17:15:12.566 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9063.txt 2024-09-13T17:15:12.568 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/hi6421.txt 2024-09-13T17:15:12.570 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/lp3943.txt 2024-09-13T17:15:12.572 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max14577.txt 2024-09-13T17:15:12.574 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77686.txt 2024-09-13T17:15:12.576 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77693.txt 2024-09-13T17:15:12.578 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8925.txt 2024-09-13T17:15:12.580 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8998.txt 2024-09-13T17:15:12.582 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/mc13xxx.txt 2024-09-13T17:15:12.584 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-host.txt 2024-09-13T17:15:12.587 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-tll.txt 2024-09-13T17:15:12.589 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/palmas.txt 2024-09-13T17:15:12.591 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom,spmi-pmic.txt 2024-09-13T17:15:12.593 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-pm8xxx.txt 2024-09-13T17:15:12.595 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-rpm.txt 2024-09-13T17:15:12.597 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qriox.txt 2024-09-13T17:15:12.599 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rk808.txt 2024-09-13T17:15:12.601 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rn5t618.txt 2024-09-13T17:15:12.603 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mpa01.txt 2024-09-13T17:15:12.605 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mps11.txt 2024-09-13T17:15:12.607 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/stmpe.txt 2024-09-13T17:15:12.609 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/sun6i-prcm.txt 2024-09-13T17:15:12.611 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/syscon.txt 2024-09-13T17:15:12.613 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tc3589x.txt 2024-09-13T17:15:12.615 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ti-keystone-devctrl.txt 2024-09-13T17:15:12.618 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps6507x.txt 2024-09-13T17:15:12.621 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps65910.txt 2024-09-13T17:15:12.622 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl-familly.txt 2024-09-13T17:15:12.624 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-audio.txt 2024-09-13T17:15:12.625 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-power.txt 2024-09-13T17:15:12.627 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl6040.txt 2024-09-13T17:15:12.631 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/ 2024-09-13T17:15:12.632 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/ 2024-09-13T17:15:12.633 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt 2024-09-13T17:15:12.635 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt 2024-09-13T17:15:12.642 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ 2024-09-13T17:15:12.642 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/ 2024-09-13T17:15:12.642 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt 2024-09-13T17:15:12.643 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt 2024-09-13T17:15:12.645 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt 2024-09-13T17:15:12.647 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt 2024-09-13T17:15:12.649 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ 2024-09-13T17:15:12.651 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/bootbus.txt 2024-09-13T17:15:12.653 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/cib.txt 2024-09-13T17:15:12.655 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu.txt 2024-09-13T17:15:12.657 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu2.txt 2024-09-13T17:15:12.659 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/dma-engine.txt 2024-09-13T17:15:12.661 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/uctl.txt 2024-09-13T17:15:12.664 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cpu_irq.txt 2024-09-13T17:15:12.667 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ralink.txt 2024-09-13T17:15:12.668 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ 2024-09-13T17:15:12.672 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/allwinner,sunxi-sid.txt 2024-09-13T17:15:12.674 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/arm-charlcd.txt 2024-09-13T17:15:12.676 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/at25.txt 2024-09-13T17:15:12.678 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/atmel-ssc.txt 2024-09-13T17:15:12.680 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/bmp085.txt 2024-09-13T17:15:12.682 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/fsl,qoriq-mc.txt 2024-09-13T17:15:12.684 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ifm-csi.txt 2024-09-13T17:15:12.686 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/lis302.txt 2024-09-13T17:15:12.689 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/nvidia,tegra20-apbmisc.txt 2024-09-13T17:15:12.690 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/smc.txt 2024-09-13T17:15:12.693 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/sram.txt 2024-09-13T17:15:12.694 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ti,dac7512.txt 2024-09-13T17:15:12.696 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ 2024-09-13T17:15:12.699 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt 2024-09-13T17:15:12.701 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt 2024-09-13T17:15:12.702 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt 2024-09-13T17:15:12.705 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt 2024-09-13T17:15:12.707 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt 2024-09-13T17:15:12.709 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt 2024-09-13T17:15:12.711 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt 2024-09-13T17:15:12.713 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt 2024-09-13T17:15:12.715 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt 2024-09-13T17:15:12.717 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt 2024-09-13T17:15:12.719 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt 2024-09-13T17:15:12.721 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt 2024-09-13T17:15:12.723 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt 2024-09-13T17:15:12.725 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt 2024-09-13T17:15:12.727 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt 2024-09-13T17:15:12.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:12 smithi087 ceph-mon[30934]: pgmap v44: 129 pgs: 129 active+clean; 86 MiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 7.2 MiB/s wr, 145 op/s 2024-09-13T17:15:12.729 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt 2024-09-13T17:15:12.731 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt 2024-09-13T17:15:12.733 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt 2024-09-13T17:15:12.735 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt 2024-09-13T17:15:12.736 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt 2024-09-13T17:15:12.738 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt 2024-09-13T17:15:12.741 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt 2024-09-13T17:15:12.742 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt 2024-09-13T17:15:12.745 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt 2024-09-13T17:15:12.746 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt 2024-09-13T17:15:12.749 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt 2024-09-13T17:15:12.751 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt 2024-09-13T17:15:12.752 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt 2024-09-13T17:15:12.754 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt 2024-09-13T17:15:12.756 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt 2024-09-13T17:15:12.758 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt 2024-09-13T17:15:12.760 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt 2024-09-13T17:15:12.762 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt 2024-09-13T17:15:12.764 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt 2024-09-13T17:15:12.766 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt 2024-09-13T17:15:12.768 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt 2024-09-13T17:15:12.769 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt 2024-09-13T17:15:12.771 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt 2024-09-13T17:15:12.773 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt 2024-09-13T17:15:12.775 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/ 2024-09-13T17:15:12.777 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/arm-versatile.txt 2024-09-13T17:15:12.780 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-dataflash.txt 2024-09-13T17:15:12.782 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-nand.txt 2024-09-13T17:15:12.784 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/davinci-nand.txt 2024-09-13T17:15:12.786 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/denali-nand.txt 2024-09-13T17:15:12.788 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/diskonchip.txt 2024-09-13T17:15:12.790 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/elm.txt 2024-09-13T17:15:12.792 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/flctl-nand.txt 2024-09-13T17:15:12.794 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-quadspi.txt 2024-09-13T17:15:12.796 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-upm-nand.txt 2024-09-13T17:15:12.798 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsmc-nand.txt 2024-09-13T17:15:12.800 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpio-control-nand.txt 2024-09-13T17:15:12.802 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nand.txt 2024-09-13T17:15:12.804 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nor.txt 2024-09-13T17:15:12.806 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-onenand.txt 2024-09-13T17:15:12.808 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmi-nand.txt 2024-09-13T17:15:12.811 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/hisi504-nand.txt 2024-09-13T17:15:12.813 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-mlc.txt 2024-09-13T17:15:12.814 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-slc.txt 2024-09-13T17:15:12.816 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/m25p80.txt 2024-09-13T17:15:12.818 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mtd-physmap.txt 2024-09-13T17:15:12.820 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mxc-nand.txt 2024-09-13T17:15:12.822 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/nand.txt 2024-09-13T17:15:12.824 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/orion-nand.txt 2024-09-13T17:15:12.826 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/partition.txt 2024-09-13T17:15:12.828 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/pxa3xx-nand.txt 2024-09-13T17:15:12.830 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/spear_smi.txt 2024-09-13T17:15:12.832 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/st-fsm.txt 2024-09-13T17:15:12.834 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/sunxi-nand.txt 2024-09-13T17:15:12.836 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ 2024-09-13T17:15:12.839 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt 2024-09-13T17:15:12.841 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt 2024-09-13T17:15:12.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:12 smithi149 ceph-mon[35496]: pgmap v44: 129 pgs: 129 active+clean; 86 MiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 7.2 MiB/s wr, 145 op/s 2024-09-13T17:15:12.842 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt 2024-09-13T17:15:12.844 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt 2024-09-13T17:15:12.846 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt 2024-09-13T17:15:12.849 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt 2024-09-13T17:15:12.851 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt 2024-09-13T17:15:12.853 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt 2024-09-13T17:15:12.855 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt 2024-09-13T17:15:12.857 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt 2024-09-13T17:15:12.860 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt 2024-09-13T17:15:12.862 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt 2024-09-13T17:15:12.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:12 smithi118 ceph-mon[34374]: pgmap v44: 129 pgs: 129 active+clean; 86 MiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 7.2 MiB/s wr, 145 op/s 2024-09-13T17:15:12.864 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt 2024-09-13T17:15:12.866 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt 2024-09-13T17:15:12.868 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/ 2024-09-13T17:15:12.870 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt 2024-09-13T17:15:12.872 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt 2024-09-13T17:15:12.874 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt 2024-09-13T17:15:12.876 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt 2024-09-13T17:15:12.878 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt 2024-09-13T17:15:12.880 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt 2024-09-13T17:15:12.882 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt 2024-09-13T17:15:12.884 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt 2024-09-13T17:15:12.886 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt 2024-09-13T17:15:12.888 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt 2024-09-13T17:15:12.890 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt 2024-09-13T17:15:12.892 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt 2024-09-13T17:15:12.895 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt 2024-09-13T17:15:12.896 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt 2024-09-13T17:15:12.899 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt 2024-09-13T17:15:12.901 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt 2024-09-13T17:15:12.902 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt 2024-09-13T17:15:12.904 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt 2024-09-13T17:15:12.907 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt 2024-09-13T17:15:12.909 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt 2024-09-13T17:15:12.911 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/ 2024-09-13T17:15:12.913 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt 2024-09-13T17:15:12.916 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt 2024-09-13T17:15:12.919 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt 2024-09-13T17:15:12.921 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt 2024-09-13T17:15:12.922 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt 2024-09-13T17:15:12.924 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt 2024-09-13T17:15:12.927 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt 2024-09-13T17:15:12.929 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt 2024-09-13T17:15:12.931 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt 2024-09-13T17:15:12.933 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/ 2024-09-13T17:15:12.935 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt 2024-09-13T17:15:12.937 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt 2024-09-13T17:15:12.939 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt 2024-09-13T17:15:12.942 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt 2024-09-13T17:15:12.943 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt 2024-09-13T17:15:12.946 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt 2024-09-13T17:15:12.947 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt 2024-09-13T17:15:12.949 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt 2024-09-13T17:15:12.951 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt 2024-09-13T17:15:12.953 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt 2024-09-13T17:15:12.955 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt 2024-09-13T17:15:12.957 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt 2024-09-13T17:15:12.959 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt 2024-09-13T17:15:12.961 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt 2024-09-13T17:15:12.964 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt 2024-09-13T17:15:12.966 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt 2024-09-13T17:15:12.967 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt 2024-09-13T17:15:12.970 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt 2024-09-13T17:15:12.972 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt 2024-09-13T17:15:12.973 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/ 2024-09-13T17:15:12.975 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt 2024-09-13T17:15:12.977 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt 2024-09-13T17:15:12.979 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt 2024-09-13T17:15:12.982 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt 2024-09-13T17:15:12.984 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt 2024-09-13T17:15:12.986 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt 2024-09-13T17:15:12.988 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt 2024-09-13T17:15:12.990 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt 2024-09-13T17:15:12.992 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt 2024-09-13T17:15:12.994 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt 2024-09-13T17:15:12.996 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt 2024-09-13T17:15:12.998 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt 2024-09-13T17:15:13.000 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt 2024-09-13T17:15:13.002 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt 2024-09-13T17:15:13.004 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt 2024-09-13T17:15:13.006 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt 2024-09-13T17:15:13.009 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt 2024-09-13T17:15:13.010 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ 2024-09-13T17:15:13.012 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt 2024-09-13T17:15:13.014 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt 2024-09-13T17:15:13.016 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt 2024-09-13T17:15:13.018 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/ 2024-09-13T17:15:13.021 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/nios2.txt 2024-09-13T17:15:13.023 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/timer.txt 2024-09-13T17:15:13.025 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/ 2024-09-13T17:15:13.027 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/nvidia,nvec.txt 2024-09-13T17:15:13.029 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/open-pic.txt 2024-09-13T17:15:13.031 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/ 2024-09-13T17:15:13.033 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101aw03.txt 2024-09-13T17:15:13.035 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101xtn01.txt 2024-09-13T17:15:13.037 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b116xw03.txt 2024-09-13T17:15:13.039 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133htn01.txt 2024-09-13T17:15:13.042 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133xtn01.txt 2024-09-13T17:15:13.043 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/avic,tm070ddh03.txt 2024-09-13T17:15:13.049 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wa01a.txt 2024-09-13T17:15:13.049 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wb03.txt 2024-09-13T17:15:13.049 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et057090dhu.txt 2024-09-13T17:15:13.052 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et070080dh6.txt 2024-09-13T17:15:13.054 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,etm0700g0dh6.txt 2024-09-13T17:15:13.056 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/foxlink,fl500wvr00-a0t.txt 2024-09-13T17:15:13.058 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/giantplus,gpg482739qs5.txt 2024-09-13T17:15:13.060 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hannstar,hsd070pww1.txt 2024-09-13T17:15:13.062 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hit,tx23d38vm0caa.txt 2024-09-13T17:15:13.064 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,g121i1-l01.txt 2024-09-13T17:15:13.065 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n116bge.txt 2024-09-13T17:15:13.067 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n156bge-l21.txt 2024-09-13T17:15:13.069 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,ld070wx3-sl01.txt 2024-09-13T17:15:13.071 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lh500wx1-sd03.txt 2024-09-13T17:15:13.074 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lp129qe.txt 2024-09-13T17:15:13.076 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/panasonic,vvx10f004b00.txt 2024-09-13T17:15:13.078 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ld9040.txt 2024-09-13T17:15:13.080 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ltn101nt05.txt 2024-09-13T17:15:13.082 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,s6e8aa0.txt 2024-09-13T17:15:13.084 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/sharp,lq101r1sx01.txt 2024-09-13T17:15:13.086 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/simple-panel.txt 2024-09-13T17:15:13.088 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ 2024-09-13T17:15:13.090 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/83xx-512x-pci.txt 2024-09-13T17:15:13.092 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/designware-pcie.txt 2024-09-13T17:15:13.094 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,imx6q-pcie.txt 2024-09-13T17:15:13.096 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,pci.txt 2024-09-13T17:15:13.098 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/host-generic-pci.txt 2024-09-13T17:15:13.100 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/layerscape-pci.txt 2024-09-13T17:15:13.102 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/mvebu-pci.txt 2024-09-13T17:15:13.104 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/nvidia,tegra20-pcie.txt 2024-09-13T17:15:13.106 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-keystone.txt 2024-09-13T17:15:13.108 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-rcar-gen2.txt 2024-09-13T17:15:13.110 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci.txt 2024-09-13T17:15:13.112 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ralink,rt3883-pci.txt 2024-09-13T17:15:13.114 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/rcar-pci.txt 2024-09-13T17:15:13.116 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/samsung,exynos5440-pcie.txt 2024-09-13T17:15:13.118 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/spear13xx-pcie.txt 2024-09-13T17:15:13.120 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ti-pci.txt 2024-09-13T17:15:13.122 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/v3-v360epc-pci.txt 2024-09-13T17:15:13.124 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/versatile.txt 2024-09-13T17:15:13.126 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xgene-pci.txt 2024-09-13T17:15:13.128 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xilinx-pcie.txt 2024-09-13T17:15:13.130 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ 2024-09-13T17:15:13.133 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/apm-xgene-phy.txt 2024-09-13T17:15:13.135 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/bcm-phy.txt 2024-09-13T17:15:13.137 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-sata-phy.txt 2024-09-13T17:15:13.139 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-usb-phy.txt 2024-09-13T17:15:13.141 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/hix5hd2-phy.txt 2024-09-13T17:15:13.143 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-bindings.txt 2024-09-13T17:15:13.145 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy28lp.txt 2024-09-13T17:15:13.147 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy365x.txt 2024-09-13T17:15:13.149 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-mvebu.txt 2024-09-13T17:15:13.151 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih407-usb.txt 2024-09-13T17:15:13.153 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih41x-usb.txt 2024-09-13T17:15:13.155 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-apq8064-sata-phy.txt 2024-09-13T17:15:13.157 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-dwc3-usb-phy.txt 2024-09-13T17:15:13.159 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-ipq806x-sata-phy.txt 2024-09-13T17:15:13.161 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rcar-gen2-phy.txt 2024-09-13T17:15:13.163 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rockchip-usb-phy.txt 2024-09-13T17:15:13.165 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/samsung-phy.txt 2024-09-13T17:15:13.167 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/st-spear-miphy.txt 2024-09-13T17:15:13.169 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/sun4i-usb-phy.txt 2024-09-13T17:15:13.171 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ti-phy.txt 2024-09-13T17:15:13.173 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ 2024-09-13T17:15:13.175 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/abilis,tb10x-iomux.txt 2024-09-13T17:15:13.177 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/allwinner,sunxi-pinctrl.txt 2024-09-13T17:15:13.179 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/atmel,at91-pinctrl.txt 2024-09-13T17:15:13.182 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm11351-pinctrl.txt 2024-09-13T17:15:13.184 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm2835-gpio.txt 2024-09-13T17:15:13.186 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx-pinctrl.txt 2024-09-13T17:15:13.188 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx25-pinctrl.txt 2024-09-13T17:15:13.190 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx27-pinctrl.txt 2024-09-13T17:15:13.192 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx35-pinctrl.txt 2024-09-13T17:15:13.194 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx51-pinctrl.txt 2024-09-13T17:15:13.195 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx53-pinctrl.txt 2024-09-13T17:15:13.197 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6dl-pinctrl.txt 2024-09-13T17:15:13.199 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6q-pinctrl.txt 2024-09-13T17:15:13.201 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sl-pinctrl.txt 2024-09-13T17:15:13.203 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sx-pinctrl.txt 2024-09-13T17:15:13.205 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,mxs-pinctrl.txt 2024-09-13T17:15:13.207 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,vf610-pinctrl.txt 2024-09-13T17:15:13.209 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pdc-pinctrl.txt 2024-09-13T17:15:13.211 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pinctrl.txt 2024-09-13T17:15:13.213 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,falcon-pinumx.txt 2024-09-13T17:15:13.216 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,xway-pinumx.txt 2024-09-13T17:15:13.218 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-370-pinctrl.txt 2024-09-13T17:15:13.220 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-375-pinctrl.txt 2024-09-13T17:15:13.222 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-38x-pinctrl.txt 2024-09-13T17:15:13.224 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-xp-pinctrl.txt 2024-09-13T17:15:13.226 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,dove-pinctrl.txt 2024-09-13T17:15:13.229 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,kirkwood-pinctrl.txt 2024-09-13T17:15:13.231 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,mvebu-pinctrl.txt 2024-09-13T17:15:13.233 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,orion-pinctrl.txt 2024-09-13T17:15:13.235 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/meson,pinctrl.txt 2024-09-13T17:15:13.237 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra114-pinmux.txt 2024-09-13T17:15:13.239 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-pinmux.txt 2024-09-13T17:15:13.242 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-xusb-padctl.txt 2024-09-13T17:15:13.244 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra20-pinmux.txt 2024-09-13T17:15:13.246 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra30-pinmux.txt 2024-09-13T17:15:13.248 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-bindings.txt 2024-09-13T17:15:13.253 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-palmas.txt 2024-09-13T17:15:13.253 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-single.txt 2024-09-13T17:15:13.254 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-sirf.txt 2024-09-13T17:15:13.256 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-st.txt 2024-09-13T17:15:13.259 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-vt8500.txt 2024-09-13T17:15:13.261 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl_spear.txt 2024-09-13T17:15:13.263 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8064-pinctrl.txt 2024-09-13T17:15:13.266 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8084-pinctrl.txt 2024-09-13T17:15:13.268 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,ipq8064-pinctrl.txt 2024-09-13T17:15:13.270 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8916-pinctrl.txt 2024-09-13T17:15:13.272 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8960-pinctrl.txt 2024-09-13T17:15:13.274 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8974-pinctrl.txt 2024-09-13T17:15:13.277 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-gpio.txt 2024-09-13T17:15:13.279 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-mpp.txt 2024-09-13T17:15:13.281 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/renesas,pfc-pinctrl.txt 2024-09-13T17:15:13.283 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/rockchip,pinctrl.txt 2024-09-13T17:15:13.285 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/samsung-pinctrl.txt 2024-09-13T17:15:13.287 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,abx500.txt 2024-09-13T17:15:13.290 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,nomadik.txt 2024-09-13T17:15:13.291 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ti,omap-pinctrl.txt 2024-09-13T17:15:13.293 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/xlnx,zynq-pinctrl.txt 2024-09-13T17:15:13.295 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ 2024-09-13T17:15:13.298 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/bq2415x.txt 2024-09-13T17:15:13.300 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/isp1704.txt 2024-09-13T17:15:13.302 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ltc2941.txt 2024-09-13T17:15:13.304 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/opp.txt 2024-09-13T17:15:13.306 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power-controller.txt 2024-09-13T17:15:13.308 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power_domain.txt 2024-09-13T17:15:13.310 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/renesas,sysc-rmobile.txt 2024-09-13T17:15:13.312 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ 2024-09-13T17:15:13.313 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/keystone-reset.txt 2024-09-13T17:15:13.316 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ltc2952-poweroff.txt 2024-09-13T17:15:13.317 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/st-reset.txt 2024-09-13T17:15:13.319 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/syscon-reboot.txt 2024-09-13T17:15:13.322 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rockchip-io-domain.txt 2024-09-13T17:15:13.324 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rx51-battery.txt 2024-09-13T17:15:13.326 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/twl-charger.txt 2024-09-13T17:15:13.327 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ 2024-09-13T17:15:13.330 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/ 2024-09-13T17:15:13.331 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/btemp.txt 2024-09-13T17:15:13.333 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/chargalg.txt 2024-09-13T17:15:13.335 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/charger.txt 2024-09-13T17:15:13.338 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/fg.txt 2024-09-13T17:15:13.340 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/axxia-reset.txt 2024-09-13T17:15:13.343 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/charger-manager.txt 2024-09-13T17:15:13.345 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/gpio-charger.txt 2024-09-13T17:15:13.346 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/imx-snvs-poweroff.txt 2024-09-13T17:15:13.348 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/lp8727_charger.txt 2024-09-13T17:15:13.351 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max17042_battery.txt 2024-09-13T17:15:13.353 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max8925_batter.txt 2024-09-13T17:15:13.355 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/msm-poweroff.txt 2024-09-13T17:15:13.357 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/olpc_battery.txt 2024-09-13T17:15:13.359 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/power_supply.txt 2024-09-13T17:15:13.361 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/qnap-poweroff.txt 2024-09-13T17:15:13.363 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/restart-poweroff.txt 2024-09-13T17:15:13.365 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/sbs_sbs-battery.txt 2024-09-13T17:15:13.367 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ti,bq24735.txt 2024-09-13T17:15:13.369 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/tps65090.txt 2024-09-13T17:15:13.371 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/ 2024-09-13T17:15:13.373 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ 2024-09-13T17:15:13.375 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/akebono.txt 2024-09-13T17:15:13.376 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/cpm.txt 2024-09-13T17:15:13.379 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/emac.txt 2024-09-13T17:15:13.381 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/hsta.txt 2024-09-13T17:15:13.383 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ndfc.txt 2024-09-13T17:15:13.385 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ppc440spe-adma.txt 2024-09-13T17:15:13.387 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/reboot.txt 2024-09-13T17:15:13.389 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ 2024-09-13T17:15:13.391 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/board.txt 2024-09-13T17:15:13.393 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cache_sram.txt 2024-09-13T17:15:13.395 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ccf.txt 2024-09-13T17:15:13.398 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/ 2024-09-13T17:15:13.399 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm.txt 2024-09-13T17:15:13.402 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/ 2024-09-13T17:15:13.404 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/brg.txt 2024-09-13T17:15:13.407 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/i2c.txt 2024-09-13T17:15:13.409 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/pic.txt 2024-09-13T17:15:13.411 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/usb.txt 2024-09-13T17:15:13.413 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/gpio.txt 2024-09-13T17:15:13.416 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/network.txt 2024-09-13T17:15:13.418 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe.txt 2024-09-13T17:15:13.420 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ 2024-09-13T17:15:13.422 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/firmware.txt 2024-09-13T17:15:13.425 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/par_io.txt 2024-09-13T17:15:13.427 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/pincfg.txt 2024-09-13T17:15:13.430 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ucc.txt 2024-09-13T17:15:13.432 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/usb.txt 2024-09-13T17:15:13.434 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/serial.txt 2024-09-13T17:15:13.437 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpus.txt 2024-09-13T17:15:13.440 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dcsr.txt 2024-09-13T17:15:13.442 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/diu.txt 2024-09-13T17:15:13.444 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dma.txt 2024-09-13T17:15:13.446 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ecm.txt 2024-09-13T17:15:13.448 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/fman.txt 2024-09-13T17:15:13.451 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/gtm.txt 2024-09-13T17:15:13.456 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/guts.txt 2024-09-13T17:15:13.457 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/interlaken-lac.txt 2024-09-13T17:15:13.457 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/l2cache.txt 2024-09-13T17:15:13.460 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/lbc.txt 2024-09-13T17:15:13.462 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcm.txt 2024-09-13T17:15:13.464 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcu-mpc8349emitx.txt 2024-09-13T17:15:13.466 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mem-ctrlr.txt 2024-09-13T17:15:13.468 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5121-psc.txt 2024-09-13T17:15:13.470 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5200.txt 2024-09-13T17:15:13.472 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-msgr.txt 2024-09-13T17:15:13.475 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-timer.txt 2024-09-13T17:15:13.477 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic.txt 2024-09-13T17:15:13.479 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/msi-pic.txt 2024-09-13T17:15:13.482 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pamu.txt 2024-09-13T17:15:13.484 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pmc.txt 2024-09-13T17:15:13.486 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/raideng.txt 2024-09-13T17:15:13.488 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio-rmu.txt 2024-09-13T17:15:13.490 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio.txt 2024-09-13T17:15:13.492 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/ 2024-09-13T17:15:13.494 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/gamecube.txt 2024-09-13T17:15:13.497 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/wii.txt 2024-09-13T17:15:13.498 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/ 2024-09-13T17:15:13.501 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/pps-gpio.txt 2024-09-13T17:15:13.503 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ 2024-09-13T17:15:13.505 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-hlcdc-pwm.txt 2024-09-13T17:15:13.507 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-pwm.txt 2024-09-13T17:15:13.509 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-tcb-pwm.txt 2024-09-13T17:15:13.511 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/bcm-kona-pwm.txt 2024-09-13T17:15:13.513 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/cirrus,clps711x-pwm.txt 2024-09-13T17:15:13.515 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/img-pwm.txt 2024-09-13T17:15:13.517 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/imx-pwm.txt 2024-09-13T17:15:13.519 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/lpc32xx-pwm.txt 2024-09-13T17:15:13.521 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/mxs-pwm.txt 2024-09-13T17:15:13.528 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nvidia,tegra20-pwm.txt 2024-09-13T17:15:13.530 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nxp,pca9685-pwm.txt 2024-09-13T17:15:13.532 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-bcm2835.txt 2024-09-13T17:15:13.535 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-fsl-ftm.txt 2024-09-13T17:15:13.537 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-lp3943.txt 2024-09-13T17:15:13.539 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-rockchip.txt 2024-09-13T17:15:13.540 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-samsung.txt 2024-09-13T17:15:13.542 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-st.txt 2024-09-13T17:15:13.544 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-sun4i.txt 2024-09-13T17:15:13.546 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiecap.txt 2024-09-13T17:15:13.548 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiehrpwm.txt 2024-09-13T17:15:13.550 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tipwmss.txt 2024-09-13T17:15:13.553 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm.txt 2024-09-13T17:15:13.554 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pxa-pwm.txt 2024-09-13T17:15:13.556 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/renesas,tpu-pwm.txt 2024-09-13T17:15:13.558 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/spear-pwm.txt 2024-09-13T17:15:13.560 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwm.txt 2024-09-13T17:15:13.562 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwmled.txt 2024-09-13T17:15:13.564 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/vt8500-pwm.txt 2024-09-13T17:15:13.566 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/ 2024-09-13T17:15:13.569 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/regmap.txt 2024-09-13T17:15:13.570 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ 2024-09-13T17:15:13.573 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt 2024-09-13T17:15:13.575 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt 2024-09-13T17:15:13.577 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt 2024-09-13T17:15:13.579 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt 2024-09-13T17:15:13.581 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt 2024-09-13T17:15:13.583 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt 2024-09-13T17:15:13.585 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt 2024-09-13T17:15:13.587 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt 2024-09-13T17:15:13.589 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt 2024-09-13T17:15:13.591 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt 2024-09-13T17:15:13.593 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt 2024-09-13T17:15:13.595 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt 2024-09-13T17:15:13.597 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt 2024-09-13T17:15:13.599 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt 2024-09-13T17:15:13.601 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt 2024-09-13T17:15:13.603 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt 2024-09-13T17:15:13.605 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt 2024-09-13T17:15:13.607 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt 2024-09-13T17:15:13.610 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt 2024-09-13T17:15:13.612 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt 2024-09-13T17:15:13.614 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt 2024-09-13T17:15:13.616 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt 2024-09-13T17:15:13.618 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt 2024-09-13T17:15:13.620 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt 2024-09-13T17:15:13.622 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt 2024-09-13T17:15:13.624 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt 2024-09-13T17:15:13.626 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt 2024-09-13T17:15:13.628 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt 2024-09-13T17:15:13.630 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt 2024-09-13T17:15:13.632 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt 2024-09-13T17:15:13.634 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt 2024-09-13T17:15:13.636 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt 2024-09-13T17:15:13.638 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt 2024-09-13T17:15:13.639 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt 2024-09-13T17:15:13.641 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt 2024-09-13T17:15:13.643 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt 2024-09-13T17:15:13.645 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt 2024-09-13T17:15:13.647 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt 2024-09-13T17:15:13.649 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/ 2024-09-13T17:15:13.651 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/reserved-memory.txt 2024-09-13T17:15:13.653 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/ 2024-09-13T17:15:13.656 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/allwinner,sunxi-clock-reset.txt 2024-09-13T17:15:13.662 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/fsl,imx-src.txt 2024-09-13T17:15:13.662 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/reset.txt 2024-09-13T17:15:13.662 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/sirf,rstc.txt 2024-09-13T17:15:13.663 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/socfpga-reset.txt 2024-09-13T17:15:13.665 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-picophyreset.txt 2024-09-13T17:15:13.667 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-powerdown.txt 2024-09-13T17:15:13.669 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-softreset.txt 2024-09-13T17:15:13.671 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/resource-names.txt 2024-09-13T17:15:13.675 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/ 2024-09-13T17:15:13.677 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/apm,rng.txt 2024-09-13T17:15:13.679 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/brcm,bcm2835.txt 2024-09-13T17:15:13.681 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/qcom,prng.txt 2024-09-13T17:15:13.683 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/ 2024-09-13T17:15:13.685 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/armada-380-rtc.txt 2024-09-13T17:15:13.687 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91rm9200-rtc.txt 2024-09-13T17:15:13.689 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91sam9-rtc.txt 2024-09-13T17:15:13.691 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dallas,ds1339.txt 2024-09-13T17:15:13.693 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dw-apb.txt 2024-09-13T17:15:13.695 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/haoyu,hym8563.txt 2024-09-13T17:15:13.697 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/imxdi-rtc.txt 2024-09-13T17:15:13.699 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/isil,isl12057.txt 2024-09-13T17:15:13.701 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/lpc32xx-rtc.txt 2024-09-13T17:15:13.703 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/maxim,ds1742.txt 2024-09-13T17:15:13.705 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/moxa,moxart-rtc.txt 2024-09-13T17:15:13.707 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nvidia,tegra20-rtc.txt 2024-09-13T17:15:13.709 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nxp,rtc-2123.txt 2024-09-13T17:15:13.711 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/olpc-xo1-rtc.txt 2024-09-13T17:15:13.713 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/orion-rtc.txt 2024-09-13T17:15:13.715 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/pxa-rtc.txt 2024-09-13T17:15:13.717 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-cmos.txt 2024-09-13T17:15:13.719 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-omap.txt 2024-09-13T17:15:13.721 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-opal.txt 2024-09-13T17:15:13.723 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-palmas.txt 2024-09-13T17:15:13.725 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/s3c-rtc.txt 2024-09-13T17:15:13.727 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sa1100-rtc.txt 2024-09-13T17:15:13.729 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/snvs-rtc.txt 2024-09-13T17:15:13.732 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/spear-rtc.txt 2024-09-13T17:15:13.733 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/stmp3xxx-rtc.txt 2024-09-13T17:15:13.736 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sun6i-rtc.txt 2024-09-13T17:15:13.737 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sunxi-rtc.txt 2024-09-13T17:15:13.739 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/twl-rtc.txt 2024-09-13T17:15:13.741 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/via,vt8500-rtc.txt 2024-09-13T17:15:13.744 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/xgene-rtc.txt 2024-09-13T17:15:13.746 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/ 2024-09-13T17:15:13.748 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/ 2024-09-13T17:15:13.750 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/st33zp24-i2c.txt 2024-09-13T17:15:13.752 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/ 2024-09-13T17:15:13.755 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/8250.txt 2024-09-13T17:15:13.757 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_jtaguart.txt 2024-09-13T17:15:13.758 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_uart.txt 2024-09-13T17:15:13.760 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/arc-uart.txt 2024-09-13T17:15:13.762 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/atmel-usart.txt 2024-09-13T17:15:13.765 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/axis,etraxfs-uart.txt 2024-09-13T17:15:13.766 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/bcm63xx-uart.txt 2024-09-13T17:15:13.769 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cavium-uart.txt 2024-09-13T17:15:13.771 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cdns,uart.txt 2024-09-13T17:15:13.773 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cirrus,clps711x-uart.txt 2024-09-13T17:15:13.775 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/digicolor-usart.txt 2024-09-13T17:15:13.777 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/efm32-uart.txt 2024-09-13T17:15:13.779 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-imx-uart.txt 2024-09-13T17:15:13.781 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-lpuart.txt 2024-09-13T17:15:13.783 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-mxs-auart.txt 2024-09-13T17:15:13.785 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/lantiq_asc.txt 2024-09-13T17:15:13.786 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/maxim,max310x.txt 2024-09-13T17:15:13.788 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl,pxa-ssp.txt 2024-09-13T17:15:13.790 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl-serial.txt 2024-09-13T17:15:13.792 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mtk-uart.txt 2024-09-13T17:15:13.794 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nvidia,tegra20-hsuart.txt 2024-09-13T17:15:13.796 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp,sc16is7xx.txt 2024-09-13T17:15:13.798 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp-lpc32xx-hsuart.txt 2024-09-13T17:15:13.800 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/omap_serial.txt 2024-09-13T17:15:13.802 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/pl011.txt 2024-09-13T17:15:13.805 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qca,ar9330-uart.txt 2024-09-13T17:15:13.806 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uart.txt 2024-09-13T17:15:13.808 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uartdm.txt 2024-09-13T17:15:13.810 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/renesas,sci-serial.txt 2024-09-13T17:15:13.812 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/rs485.txt 2024-09-13T17:15:13.814 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/samsung_uart.txt 2024-09-13T17:15:13.816 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sirf-uart.txt 2024-09-13T17:15:13.818 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/snps-dw-apb-uart.txt 2024-09-13T17:15:13.820 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sprd-uart.txt 2024-09-13T17:15:13.822 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/st-asc.txt 2024-09-13T17:15:13.824 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/vt8500-uart.txt 2024-09-13T17:15:13.826 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/ 2024-09-13T17:15:13.828 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/allwinner,sun4i-ps2.txt 2024-09-13T17:15:13.830 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/altera_ps2.txt 2024-09-13T17:15:13.832 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/olpc,ap-sp.txt 2024-09-13T17:15:13.834 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/snps-arc_ps2.txt 2024-09-13T17:15:13.836 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ 2024-09-13T17:15:13.839 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/ 2024-09-13T17:15:13.841 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman-portals.txt 2024-09-13T17:15:13.844 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman.txt 2024-09-13T17:15:13.846 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman-portals.txt 2024-09-13T17:15:13.848 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman.txt 2024-09-13T17:15:13.850 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/ 2024-09-13T17:15:13.852 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/qcom,gsbi.txt 2024-09-13T17:15:13.854 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/ 2024-09-13T17:15:13.857 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-dma.txt 2024-09-13T17:15:13.859 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-qmss.txt 2024-09-13T17:15:13.861 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ 2024-09-13T17:15:13.864 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,adau1701.txt 2024-09-13T17:15:13.866 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-i2s.txt 2024-09-13T17:15:13.868 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-spdif-tx.txt 2024-09-13T17:15:13.870 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,ssm2602.txt 2024-09-13T17:15:13.872 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4104.txt 2024-09-13T17:15:13.874 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4554.c 2024-09-13T17:15:13.876 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4642.txt 2024-09-13T17:15:13.879 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak5386.txt 2024-09-13T17:15:13.880 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5623.txt 2024-09-13T17:15:13.883 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5632.txt 2024-09-13T17:15:13.885 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/armada-370db-audio.txt 2024-09-13T17:15:13.887 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/arndale.txt 2024-09-13T17:15:13.889 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-at91sam9g20ek-wm8731-audio.txt 2024-09-13T17:15:13.891 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-sam9x5-wm8731-audio.txt 2024-09-13T17:15:13.893 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-wm8904.txt 2024-09-13T17:15:13.895 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel_ac97c.txt 2024-09-13T17:15:13.898 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/bcm2835-i2s.txt 2024-09-13T17:15:13.900 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cdns,xtfpga-i2s.txt 2024-09-13T17:15:13.902 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs35l32.txt 2024-09-13T17:15:13.904 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4265.txt 2024-09-13T17:15:13.906 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4270.txt 2024-09-13T17:15:13.908 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4271.txt 2024-09-13T17:15:13.910 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l52.txt 2024-09-13T17:15:13.912 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l56.txt 2024-09-13T17:15:13.914 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l73.txt 2024-09-13T17:15:13.916 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42xx8.txt 2024-09-13T17:15:13.918 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/da9055.txt 2024-09-13T17:15:13.920 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-evm-audio.txt 2024-09-13T17:15:13.922 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-mcasp-audio.txt 2024-09-13T17:15:13.924 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/designware-i2s.txt 2024-09-13T17:15:13.926 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/es8328.txt 2024-09-13T17:15:13.928 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/eukrea-tlv320.txt 2024-09-13T17:15:13.930 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,asrc.txt 2024-09-13T17:15:13.932 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,esai.txt 2024-09-13T17:15:13.934 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,spdif.txt 2024-09-13T17:15:13.935 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,ssi.txt 2024-09-13T17:15:13.937 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-asoc-card.txt 2024-09-13T17:15:13.939 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-sai.txt 2024-09-13T17:15:13.941 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/hdmi.txt 2024-09-13T17:15:13.943 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-es8328.txt 2024-09-13T17:15:13.945 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-sgtl5000.txt 2024-09-13T17:15:13.947 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-spdif.txt 2024-09-13T17:15:13.950 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-wm8962.txt 2024-09-13T17:15:13.951 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audmux.txt 2024-09-13T17:15:13.953 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ingenic,jz4740-i2s.txt 2024-09-13T17:15:13.955 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98090.txt 2024-09-13T17:15:13.957 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98095.txt 2024-09-13T17:15:13.959 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98357a.txt 2024-09-13T17:15:13.961 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa-ssp.txt 2024-09-13T17:15:13.963 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa2xx-pcm.txt 2024-09-13T17:15:13.965 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mvebu-audio.txt 2024-09-13T17:15:13.967 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-audio-sgtl5000.txt 2024-09-13T17:15:13.969 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-saif.txt 2024-09-13T17:15:13.972 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nokia,rx51.txt 2024-09-13T17:15:13.974 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-alc5632.txt 2024-09-13T17:15:13.976 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-max98090.txt 2024-09-13T17:15:13.978 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5640.txt 2024-09-13T17:15:13.980 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5677.txt 2024-09-13T17:15:13.982 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-trimslice.txt 2024-09-13T17:15:13.984 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8753.txt 2024-09-13T17:15:13.986 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8903.txt 2024-09-13T17:15:13.988 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm9712.txt 2024-09-13T17:15:13.990 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-ac97.txt 2024-09-13T17:15:13.992 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-das.txt 2024-09-13T17:15:13.994 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-i2s.txt 2024-09-13T17:15:13.996 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-ahub.txt 2024-09-13T17:15:13.998 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-hda.txt 2024-09-13T17:15:14.000 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-i2s.txt 2024-09-13T17:15:14.002 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-abe-twl6040.txt 2024-09-13T17:15:14.004 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-dmic.txt 2024-09-13T17:15:14.007 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcbsp.txt 2024-09-13T17:15:14.008 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcpdm.txt 2024-09-13T17:15:14.010 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-twl4030.txt 2024-09-13T17:15:14.012 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm1792a.txt 2024-09-13T17:15:14.014 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm512x.txt 2024-09-13T17:15:14.017 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,fsi.txt 2024-09-13T17:15:14.018 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,rsnd.txt 2024-09-13T17:15:14.020 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rockchip-i2s.txt 2024-09-13T17:15:14.022 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5631.txt 2024-09-13T17:15:14.024 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5640.txt 2024-09-13T17:15:14.026 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5677.txt 2024-09-13T17:15:14.029 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,odroidx2-max98090.txt 2024-09-13T17:15:14.031 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,smdk-wm8994.txt 2024-09-13T17:15:14.033 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung-i2s.txt 2024-09-13T17:15:14.035 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sgtl5000.txt 2024-09-13T17:15:14.037 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/simple-card.txt 2024-09-13T17:15:14.039 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-codec.txt 2024-09-13T17:15:14.040 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-port.txt 2024-09-13T17:15:14.042 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio.txt 2024-09-13T17:15:14.044 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-usp.txt 2024-09-13T17:15:14.046 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/snow.txt 2024-09-13T17:15:14.048 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/soc-ac97link.txt 2024-09-13T17:15:14.050 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-receiver.txt 2024-09-13T17:15:14.052 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-transmitter.txt 2024-09-13T17:15:14.054 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm2518.txt 2024-09-13T17:15:14.056 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm4567.txt 2024-09-13T17:15:14.058 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta32x.txt 2024-09-13T17:15:14.060 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta350.txt 2024-09-13T17:15:14.062 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tas2552.txt 2024-09-13T17:15:14.064 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tdm-slot.txt 2024-09-13T17:15:14.069 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,pcm1681.txt 2024-09-13T17:15:14.069 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,tas5086.txt 2024-09-13T17:15:14.071 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic31xx.txt 2024-09-13T17:15:14.073 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic32x4.txt 2024-09-13T17:15:14.075 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic3x.txt 2024-09-13T17:15:14.077 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tpa6130a2.txt 2024-09-13T17:15:14.079 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ts3a227e.txt 2024-09-13T17:15:14.081 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-mop500.txt 2024-09-13T17:15:14.083 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-msp.txt 2024-09-13T17:15:14.084 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/widgets.txt 2024-09-13T17:15:14.087 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8510.txt 2024-09-13T17:15:14.089 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8523.txt 2024-09-13T17:15:14.090 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8580.txt 2024-09-13T17:15:14.092 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8711.txt 2024-09-13T17:15:14.094 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8728.txt 2024-09-13T17:15:14.096 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8731.txt 2024-09-13T17:15:14.098 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8737.txt 2024-09-13T17:15:14.100 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8741.txt 2024-09-13T17:15:14.102 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8750.txt 2024-09-13T17:15:14.104 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8753.txt 2024-09-13T17:15:14.106 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8770.txt 2024-09-13T17:15:14.107 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8776.txt 2024-09-13T17:15:14.110 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8804.txt 2024-09-13T17:15:14.111 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8903.txt 2024-09-13T17:15:14.113 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8904.txt 2024-09-13T17:15:14.115 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8960.txt 2024-09-13T17:15:14.118 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8962.txt 2024-09-13T17:15:14.120 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8994.txt 2024-09-13T17:15:14.122 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ 2024-09-13T17:15:14.124 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/brcm,bcm2835-spi.txt 2024-09-13T17:15:14.126 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/efm32-spi.txt 2024-09-13T17:15:14.128 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-imx-cspi.txt 2024-09-13T17:15:14.130 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-spi.txt 2024-09-13T17:15:14.132 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/mxs-spi.txt 2024-09-13T17:15:14.134 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra114-spi.txt 2024-09-13T17:15:14.136 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-sflash.txt 2024-09-13T17:15:14.138 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-slink.txt 2024-09-13T17:15:14.140 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/omap-spi.txt 2024-09-13T17:15:14.142 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/qcom,spi-qup.txt 2024-09-13T17:15:14.144 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-hspi.txt 2024-09-13T17:15:14.146 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-msiof.txt 2024-09-13T17:15:14.148 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/snps,dw-apb-ssi.txt 2024-09-13T17:15:14.150 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-bus.txt 2024-09-13T17:15:14.152 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-cadence.txt 2024-09-13T17:15:14.154 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-davinci.txt 2024-09-13T17:15:14.156 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-dw.txt 2024-09-13T17:15:14.158 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-fsl-dspi.txt 2024-09-13T17:15:14.160 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-gpio.txt 2024-09-13T17:15:14.163 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-img-spfi.txt 2024-09-13T17:15:14.164 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-meson.txt 2024-09-13T17:15:14.167 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-octeon.txt 2024-09-13T17:15:14.169 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-orion.txt 2024-09-13T17:15:14.170 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rockchip.txt 2024-09-13T17:15:14.173 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rspi.txt 2024-09-13T17:15:14.177 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-samsung.txt 2024-09-13T17:15:14.177 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sc18is602.txt 2024-09-13T17:15:14.179 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sirf.txt 2024-09-13T17:15:14.180 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-st-ssc.txt 2024-09-13T17:15:14.182 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun4i.txt 2024-09-13T17:15:14.184 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun6i.txt 2024-09-13T17:15:14.186 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-xtensa-xtfpga.txt 2024-09-13T17:15:14.188 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_altera.txt 2024-09-13T17:15:14.190 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_atmel.txt 2024-09-13T17:15:14.193 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_oc_tiny.txt 2024-09-13T17:15:14.195 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_pl022.txt 2024-09-13T17:15:14.197 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ti_qspi.txt 2024-09-13T17:15:14.199 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/ 2024-09-13T17:15:14.201 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/qcom,spmi-pmic-arb.txt 2024-09-13T17:15:14.204 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/spmi.txt 2024-09-13T17:15:14.206 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/ 2024-09-13T17:15:14.209 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/ 2024-09-13T17:15:14.211 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/ 2024-09-13T17:15:14.212 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/lpc32xx-adc.txt 2024-09-13T17:15:14.216 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/mxs-lradc.txt 2024-09-13T17:15:14.218 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/spear-adc.txt 2024-09-13T17:15:14.220 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/submitting-patches.txt 2024-09-13T17:15:14.224 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ 2024-09-13T17:15:14.226 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/armada-thermal.txt 2024-09-13T17:15:14.228 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/db8500-thermal.txt 2024-09-13T17:15:14.230 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/dove-thermal.txt 2024-09-13T17:15:14.232 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/exynos-thermal.txt 2024-09-13T17:15:14.234 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/imx-thermal.txt 2024-09-13T17:15:14.237 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/kirkwood-thermal.txt 2024-09-13T17:15:14.238 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rcar-thermal.txt 2024-09-13T17:15:14.241 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rockchip-thermal.txt 2024-09-13T17:15:14.243 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/spear-thermal.txt 2024-09-13T17:15:14.245 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/st-thermal.txt 2024-09-13T17:15:14.247 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/tegra-soctherm.txt 2024-09-13T17:15:14.249 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/thermal.txt 2024-09-13T17:15:14.252 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ti_soc_thermal.txt 2024-09-13T17:15:14.254 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ 2024-09-13T17:15:14.256 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun4i-timer.txt 2024-09-13T17:15:14.258 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun5i-a13-hstimer.txt 2024-09-13T17:15:14.260 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/amlogic,meson6-timer.txt 2024-09-13T17:15:14.262 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/arm,sp804.txt 2024-09-13T17:15:14.264 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/brcm,bcm2835-system-timer.txt 2024-09-13T17:15:14.266 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cadence,ttc-timer.txt 2024-09-13T17:15:14.269 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cirrus,clps711x-timer.txt 2024-09-13T17:15:14.270 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/digicolor-timer.txt 2024-09-13T17:15:14.273 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/energymicro,efm32-timer.txt 2024-09-13T17:15:14.275 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,ftm-timer.txt 2024-09-13T17:15:14.277 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,imxgpt.txt 2024-09-13T17:15:14.279 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/lsi,zevio-timer.txt 2024-09-13T17:15:14.281 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,armada-370-xp-timer.txt 2024-09-13T17:15:14.283 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,orion-timer.txt 2024-09-13T17:15:14.284 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/mediatek,mtk-timer.txt 2024-09-13T17:15:14.286 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/moxa,moxart-timer.txt 2024-09-13T17:15:14.288 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra20-timer.txt 2024-09-13T17:15:14.290 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra30-timer.txt 2024-09-13T17:15:14.292 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,cmt.txt 2024-09-13T17:15:14.294 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,mtu2.txt 2024-09-13T17:15:14.296 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,tmu.txt 2024-09-13T17:15:14.298 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/rockchip,rk3288-timer.txt 2024-09-13T17:15:14.300 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/samsung,exynos4210-mct.txt 2024-09-13T17:15:14.302 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/stericsson-u300-apptimer.txt 2024-09-13T17:15:14.304 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ti,keystone-timer.txt 2024-09-13T17:15:14.307 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ 2024-09-13T17:15:14.309 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ufshcd-pltfrm.txt 2024-09-13T17:15:14.311 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/unittest.txt 2024-09-13T17:15:14.314 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ 2024-09-13T17:15:14.315 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/am33xx-usb.txt 2024-09-13T17:15:14.317 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/atmel-usb.txt 2024-09-13T17:15:14.319 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-imx.txt 2024-09-13T17:15:14.321 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-qcom.txt 2024-09-13T17:15:14.323 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-usb2.txt 2024-09-13T17:15:14.325 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-zevio.txt 2024-09-13T17:15:14.327 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc2.txt 2024-09-13T17:15:14.329 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3-st.txt 2024-09-13T17:15:14.331 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3.txt 2024-09-13T17:15:14.334 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-omap.txt 2024-09-13T17:15:14.335 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-orion.txt 2024-09-13T17:15:14.338 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-st.txt 2024-09-13T17:15:14.340 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/exynos-usb.txt 2024-09-13T17:15:14.342 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/fsl-usb.txt 2024-09-13T17:15:14.344 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/generic.txt 2024-09-13T17:15:14.345 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/gr-udc.txt 2024-09-13T17:15:14.348 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/isp1301.txt 2024-09-13T17:15:14.350 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-phy.txt 2024-09-13T17:15:14.351 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-usb.txt 2024-09-13T17:15:14.353 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/lpc32xx-udc.txt 2024-09-13T17:15:14.355 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/msm-hsusb.txt 2024-09-13T17:15:14.357 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/mxs-phy.txt 2024-09-13T17:15:14.359 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-ehci.txt 2024-09-13T17:15:14.361 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-usb-phy.txt 2024-09-13T17:15:14.363 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-nxp.txt 2024-09-13T17:15:14.365 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-omap3.txt 2024-09-13T17:15:14.368 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-st.txt 2024-09-13T17:15:14.369 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/omap-usb.txt 2024-09-13T17:15:14.371 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/pxa-usb.txt 2024-09-13T17:15:14.374 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/qcom,dwc3.txt 2024-09-13T17:15:14.375 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/renesas_usbhs.txt 2024-09-13T17:15:14.377 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-hsotg.txt 2024-09-13T17:15:14.379 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-usbphy.txt 2024-09-13T17:15:14.381 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/spear-usb.txt 2024-09-13T17:15:14.383 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/twlxxxx-usb.txt 2024-09-13T17:15:14.385 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/udc-xilinx.txt 2024-09-13T17:15:14.387 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ehci.txt 2024-09-13T17:15:14.389 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-nop-xceiv.txt 2024-09-13T17:15:14.391 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ohci.txt 2024-09-13T17:15:14.393 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-uhci.txt 2024-09-13T17:15:14.395 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-xhci.txt 2024-09-13T17:15:14.397 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb3503.txt 2024-09-13T17:15:14.400 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usbmisc-imx.txt 2024-09-13T17:15:14.402 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ux500-usb.txt 2024-09-13T17:15:14.404 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/vendor-prefixes.txt 2024-09-13T17:15:14.407 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ 2024-09-13T17:15:14.409 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7123.txt 2024-09-13T17:15:14.412 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7511.txt 2024-09-13T17:15:14.414 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/analog-tv-connector.txt 2024-09-13T17:15:14.415 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/arm,pl11x.txt 2024-09-13T17:15:14.418 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/atmel,lcdc.txt 2024-09-13T17:15:14.419 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/ 2024-09-13T17:15:14.421 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/88pm860x.txt 2024-09-13T17:15:14.423 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/gpio-backlight.txt 2024-09-13T17:15:14.425 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/lp855x.txt 2024-09-13T17:15:14.427 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/max8925-backlight.txt 2024-09-13T17:15:14.429 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/pwm-backlight.txt 2024-09-13T17:15:14.431 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/tps65217-backlight.txt 2024-09-13T17:15:14.433 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ 2024-09-13T17:15:14.436 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ps8622.txt 2024-09-13T17:15:14.437 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ptn3460.txt 2024-09-13T17:15:14.440 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/cirrus,clps711x-fb.txt 2024-09-13T17:15:14.442 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/display-timing.txt 2024-09-13T17:15:14.444 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dvi-connector.txt 2024-09-13T17:15:14.446 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dw_hdmi-rockchip.txt 2024-09-13T17:15:14.448 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos7-decon.txt 2024-09-13T17:15:14.450 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dp.txt 2024-09-13T17:15:14.452 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dsim.txt 2024-09-13T17:15:14.454 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmi.txt 2024-09-13T17:15:14.456 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiddc.txt 2024-09-13T17:15:14.458 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiphy.txt 2024-09-13T17:15:14.460 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_mixer.txt 2024-09-13T17:15:14.462 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/fsl,imx-fb.txt 2024-09-13T17:15:14.465 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/hdmi-connector.txt 2024-09-13T17:15:14.467 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/lgphilips,lb035q02.txt 2024-09-13T17:15:14.469 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dpi.txt 2024-09-13T17:15:14.471 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dsi-cm.txt 2024-09-13T17:15:14.473 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/renesas,du.txt 2024-09-13T17:15:14.475 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-drm.txt 2024-09-13T17:15:14.477 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-vop.txt 2024-09-13T17:15:14.716 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/samsung-fimd.txt 2024-09-13T17:15:14.719 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sharp,ls037v7dw01.txt 2024-09-13T17:15:14.721 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer-sunxi.txt 2024-09-13T17:15:14.724 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer.txt 2024-09-13T17:15:14.726 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sony,acx565akm.txt 2024-09-13T17:15:14.728 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1289fb.txt 2024-09-13T17:15:14.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:14 smithi087 ceph-mon[30934]: pgmap v45: 129 pgs: 129 active+clean; 86 MiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 7.2 MiB/s wr, 143 op/s 2024-09-13T17:15:14.730 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1307fb.txt 2024-09-13T17:15:14.732 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/thine,thc63lvdm83d 2024-09-13T17:15:14.734 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,dra7-dss.txt 2024-09-13T17:15:14.736 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap-dss.txt 2024-09-13T17:15:14.738 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap2-dss.txt 2024-09-13T17:15:14.740 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap3-dss.txt 2024-09-13T17:15:14.742 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap4-dss.txt 2024-09-13T17:15:14.744 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap5-dss.txt 2024-09-13T17:15:14.745 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,opa362.txt 2024-09-13T17:15:14.747 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tfp410.txt 2024-09-13T17:15:14.749 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tpd12s015.txt 2024-09-13T17:15:14.751 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/toppoly,td028ttec1.txt 2024-09-13T17:15:14.753 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/tpo,td043mtea1.txt 2024-09-13T17:15:14.755 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/vga-connector.txt 2024-09-13T17:15:14.757 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/via,vt8500-fb.txt 2024-09-13T17:15:14.759 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,prizm-ge-rops.txt 2024-09-13T17:15:14.761 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,wm8505-fb.txt 2024-09-13T17:15:14.764 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/ 2024-09-13T17:15:14.767 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/mmio.txt 2024-09-13T17:15:14.769 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/ 2024-09-13T17:15:14.772 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/fsl-imx-owire.txt 2024-09-13T17:15:14.774 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/omap-hdq.txt 2024-09-13T17:15:14.777 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/w1-gpio.txt 2024-09-13T17:15:14.779 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ 2024-09-13T17:15:14.781 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-at91rm9200-wdt.txt 2024-09-13T17:15:14.783 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-wdt.txt 2024-09-13T17:15:14.785 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/brcm,bcm2835-pm-wdog.txt 2024-09-13T17:15:14.787 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/cadence-wdt.txt 2024-09-13T17:15:14.789 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/davinci-wdt.txt 2024-09-13T17:15:14.791 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/dw_wdt.txt 2024-09-13T17:15:14.793 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/fsl-imx-wdt.txt 2024-09-13T17:15:14.795 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/gpio-wdt.txt 2024-09-13T17:15:14.797 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/imgpdc-wdt.txt 2024-09-13T17:15:14.799 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ingenic,jz4740-wdt.txt 2024-09-13T17:15:14.801 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/marvel.txt 2024-09-13T17:15:14.803 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/men-a021-wdt.txt 2024-09-13T17:15:14.805 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/meson6-wdt.txt 2024-09-13T17:15:14.808 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/moxa,moxart-watchdog.txt 2024-09-13T17:15:14.810 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/mtk-wdt.txt 2024-09-13T17:15:14.811 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/of-xilinx-wdt.txt 2024-09-13T17:15:14.814 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/omap-wdt.txt 2024-09-13T17:15:14.816 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/pnx4008-wdt.txt 2024-09-13T17:15:14.818 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qca-ar7130-wdt.txt 2024-09-13T17:15:14.819 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qcom-wdt.txt 2024-09-13T17:15:14.822 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/rt2880-wdt.txt 2024-09-13T17:15:14.823 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/samsung-wdt.txt 2024-09-13T17:15:14.825 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sirfsoc_wdt.txt 2024-09-13T17:15:14.827 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/stericsson-coh901327.txt 2024-09-13T17:15:14.829 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sunxi-wdt.txt 2024-09-13T17:15:14.831 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/twl4030-wdt.txt 2024-09-13T17:15:14.833 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ 2024-09-13T17:15:14.836 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ce4100.txt 2024-09-13T17:15:14.838 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/interrupt.txt 2024-09-13T17:15:14.840 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/timer.txt 2024-09-13T17:15:14.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:14 smithi149 ceph-mon[35496]: pgmap v45: 129 pgs: 129 active+clean; 86 MiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 7.2 MiB/s wr, 143 op/s 2024-09-13T17:15:14.842 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/xilinx.txt 2024-09-13T17:15:14.844 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/ 2024-09-13T17:15:14.846 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/xillybus.txt 2024-09-13T17:15:14.848 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/booting-without-of.txt 2024-09-13T17:15:14.852 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/changesets.txt 2024-09-13T17:15:14.854 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/dynamic-resolution-notes.txt 2024-09-13T17:15:14.856 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/of_selftest.txt 2024-09-13T17:15:14.858 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/overlay-notes.txt 2024-09-13T17:15:14.860 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/todo.txt 2024-09-13T17:15:14.862 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/devicetree/usage-model.txt 2024-09-13T17:15:14.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:14 smithi118 ceph-mon[34374]: pgmap v45: 129 pgs: 129 active+clean; 86 MiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 7.2 MiB/s wr, 143 op/s 2024-09-13T17:15:14.864 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/digsig.txt 2024-09-13T17:15:14.867 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/dma-buf-sharing.txt 2024-09-13T17:15:14.869 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/dmaengine/ 2024-09-13T17:15:14.871 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/dmaengine/00-INDEX 2024-09-13T17:15:14.873 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/dmaengine/client.txt 2024-09-13T17:15:14.874 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/dmaengine/dmatest.txt 2024-09-13T17:15:14.876 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/dmaengine/provider.txt 2024-09-13T17:15:14.879 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/dontdiff 2024-09-13T17:15:14.884 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/driver-model/ 2024-09-13T17:15:14.885 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/driver-model/binding.txt 2024-09-13T17:15:14.885 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/driver-model/bus.txt 2024-09-13T17:15:14.886 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/driver-model/class.txt 2024-09-13T17:15:14.888 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/driver-model/design-patterns.txt 2024-09-13T17:15:14.890 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/driver-model/device.txt 2024-09-13T17:15:14.892 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/driver-model/devres.txt 2024-09-13T17:15:14.894 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/driver-model/driver.txt 2024-09-13T17:15:14.896 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/driver-model/overview.txt 2024-09-13T17:15:14.898 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/driver-model/platform.txt 2024-09-13T17:15:14.901 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/driver-model/porting.txt 2024-09-13T17:15:14.903 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/dvb/ 2024-09-13T17:15:14.905 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/dvb/README.dvb-usb 2024-09-13T17:15:14.907 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/dvb/avermedia.txt 2024-09-13T17:15:14.909 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/dvb/bt8xx.txt 2024-09-13T17:15:14.911 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/dvb/cards.txt 2024-09-13T17:15:14.913 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/dvb/ci.txt 2024-09-13T17:15:14.915 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/dvb/contributors.txt 2024-09-13T17:15:14.916 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/dvb/faq.txt 2024-09-13T17:15:14.918 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/dvb/get_dvb_firmware 2024-09-13T17:15:14.921 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/dvb/lmedm04.txt 2024-09-13T17:15:14.923 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/dvb/opera-firmware.txt 2024-09-13T17:15:14.925 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/dvb/readme.txt 2024-09-13T17:15:14.926 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/dvb/technisat.txt 2024-09-13T17:15:14.929 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/dvb/ttusb-dec.txt 2024-09-13T17:15:14.930 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/dvb/udev.txt 2024-09-13T17:15:14.932 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/dynamic-debug-howto.txt 2024-09-13T17:15:14.935 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/early-userspace/ 2024-09-13T17:15:14.936 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/early-userspace/README 2024-09-13T17:15:14.938 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/early-userspace/buffer-format.txt 2024-09-13T17:15:14.940 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/edac.txt 2024-09-13T17:15:14.943 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/efi-stub.txt 2024-09-13T17:15:14.945 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/eisa.txt 2024-09-13T17:15:14.947 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/email-clients.txt 2024-09-13T17:15:14.949 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/extcon/ 2024-09-13T17:15:14.950 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/extcon/porting-android-switch-class 2024-09-13T17:15:14.952 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fault-injection/ 2024-09-13T17:15:14.954 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fault-injection/fault-injection.txt 2024-09-13T17:15:14.957 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fault-injection/notifier-error-inject.txt 2024-09-13T17:15:14.959 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fault-injection/provoke-crashes.txt 2024-09-13T17:15:14.961 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/ 2024-09-13T17:15:14.963 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/00-INDEX 2024-09-13T17:15:14.965 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/api.txt 2024-09-13T17:15:14.967 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/arkfb.txt 2024-09-13T17:15:14.969 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/aty128fb.txt 2024-09-13T17:15:14.971 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/cirrusfb.txt 2024-09-13T17:15:14.973 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/cmap_xfbdev.txt 2024-09-13T17:15:14.975 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/deferred_io.txt 2024-09-13T17:15:14.977 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/efifb.txt 2024-09-13T17:15:14.979 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/ep93xx-fb.txt 2024-09-13T17:15:14.981 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/fbcon.txt 2024-09-13T17:15:14.983 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/framebuffer.txt 2024-09-13T17:15:14.986 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/gxfb.txt 2024-09-13T17:15:14.987 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/intel810.txt 2024-09-13T17:15:14.990 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/intelfb.txt 2024-09-13T17:15:14.992 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/internals.txt 2024-09-13T17:15:14.994 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/lxfb.txt 2024-09-13T17:15:14.995 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/matroxfb.txt 2024-09-13T17:15:14.998 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/metronomefb.txt 2024-09-13T17:15:14.999 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/modedb.txt 2024-09-13T17:15:15.002 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/pvr2fb.txt 2024-09-13T17:15:15.004 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/pxafb.txt 2024-09-13T17:15:15.006 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/s3fb.txt 2024-09-13T17:15:15.008 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/sa1100fb.txt 2024-09-13T17:15:15.010 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/sh7760fb.txt 2024-09-13T17:15:15.012 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/sisfb.txt 2024-09-13T17:15:15.014 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/sm501.txt 2024-09-13T17:15:15.016 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/sstfb.txt 2024-09-13T17:15:15.018 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/tgafb.txt 2024-09-13T17:15:15.020 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/tridentfb.txt 2024-09-13T17:15:15.022 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/udlfb.txt 2024-09-13T17:15:15.025 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/uvesafb.txt 2024-09-13T17:15:15.027 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/vesafb.txt 2024-09-13T17:15:15.029 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/viafb.modes 2024-09-13T17:15:15.032 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/viafb.txt 2024-09-13T17:15:15.034 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fb/vt8623fb.txt 2024-09-13T17:15:15.036 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/ 2024-09-13T17:15:15.038 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/.gitignore 2024-09-13T17:15:15.040 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/00-INDEX 2024-09-13T17:15:15.042 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/9p.txt 2024-09-13T17:15:15.044 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/Locking 2024-09-13T17:15:15.046 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/Makefile 2024-09-13T17:15:15.048 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/adfs.txt 2024-09-13T17:15:15.050 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/affs.txt 2024-09-13T17:15:15.052 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/afs.txt 2024-09-13T17:15:15.054 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/autofs4-mount-control.txt 2024-09-13T17:15:15.056 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/autofs4.txt 2024-09-13T17:15:15.059 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/automount-support.txt 2024-09-13T17:15:15.061 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/befs.txt 2024-09-13T17:15:15.063 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/bfs.txt 2024-09-13T17:15:15.065 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/btrfs.txt 2024-09-13T17:15:15.067 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/caching/ 2024-09-13T17:15:15.068 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/caching/backend-api.txt 2024-09-13T17:15:15.071 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/caching/cachefiles.txt 2024-09-13T17:15:15.073 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/caching/fscache.txt 2024-09-13T17:15:15.075 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/caching/netfs-api.txt 2024-09-13T17:15:15.078 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/caching/object.txt 2024-09-13T17:15:15.080 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/caching/operations.txt 2024-09-13T17:15:15.083 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/ceph.txt 2024-09-13T17:15:15.085 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/cifs/ 2024-09-13T17:15:15.088 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/cifs/AUTHORS 2024-09-13T17:15:15.089 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/cifs/CHANGES 2024-09-13T17:15:15.091 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/cifs/README 2024-09-13T17:15:15.094 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/cifs/TODO 2024-09-13T17:15:15.096 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/cifs/cifs.txt 2024-09-13T17:15:15.098 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/cifs/winucase_convert.pl 2024-09-13T17:15:15.100 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/coda.txt 2024-09-13T17:15:15.103 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/configfs/ 2024-09-13T17:15:15.105 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/configfs/Makefile 2024-09-13T17:15:15.107 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs.txt 2024-09-13T17:15:15.109 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_explicit.c 2024-09-13T17:15:15.111 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_macros.c 2024-09-13T17:15:15.113 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/cramfs.txt 2024-09-13T17:15:15.115 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/dax.txt 2024-09-13T17:15:15.118 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/debugfs.txt 2024-09-13T17:15:15.120 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/devpts.txt 2024-09-13T17:15:15.122 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/directory-locking 2024-09-13T17:15:15.123 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/dlmfs.txt 2024-09-13T17:15:15.125 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/dnotify.txt 2024-09-13T17:15:15.128 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/dnotify_test.c 2024-09-13T17:15:15.129 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/ecryptfs.txt 2024-09-13T17:15:15.131 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/efivarfs.txt 2024-09-13T17:15:15.133 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/exofs.txt 2024-09-13T17:15:15.135 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/ext2.txt 2024-09-13T17:15:15.138 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/ext3.txt 2024-09-13T17:15:15.140 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/ext4.txt 2024-09-13T17:15:15.142 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/f2fs.txt 2024-09-13T17:15:15.145 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/fiemap.txt 2024-09-13T17:15:15.147 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/files.txt 2024-09-13T17:15:15.149 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/fuse.txt 2024-09-13T17:15:15.152 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/gfs2-glocks.txt 2024-09-13T17:15:15.153 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/gfs2-uevents.txt 2024-09-13T17:15:15.155 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/gfs2.txt 2024-09-13T17:15:15.157 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/hfs.txt 2024-09-13T17:15:15.160 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/hfsplus.txt 2024-09-13T17:15:15.161 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/hpfs.txt 2024-09-13T17:15:15.164 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/inotify.txt 2024-09-13T17:15:15.166 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/isofs.txt 2024-09-13T17:15:15.167 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/jfs.txt 2024-09-13T17:15:15.169 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/locks.txt 2024-09-13T17:15:15.171 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/logfs.txt 2024-09-13T17:15:15.173 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/mandatory-locking.txt 2024-09-13T17:15:15.175 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/ncpfs.txt 2024-09-13T17:15:15.177 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/nfs/ 2024-09-13T17:15:15.179 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/nfs/00-INDEX 2024-09-13T17:15:15.181 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/nfs/Exporting 2024-09-13T17:15:15.183 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/nfs/fault_injection.txt 2024-09-13T17:15:15.185 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/nfs/idmapper.txt 2024-09-13T17:15:15.187 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/nfs/knfsd-stats.txt 2024-09-13T17:15:15.189 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs-rdma.txt 2024-09-13T17:15:15.191 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs.txt 2024-09-13T17:15:15.193 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs41-server.txt 2024-09-13T17:15:15.196 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsd-admin-interfaces.txt 2024-09-13T17:15:15.197 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsroot.txt 2024-09-13T17:15:15.200 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs-block-server.txt 2024-09-13T17:15:15.201 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs.txt 2024-09-13T17:15:15.204 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-cache.txt 2024-09-13T17:15:15.206 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-server-gss.txt 2024-09-13T17:15:15.208 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/nilfs2.txt 2024-09-13T17:15:15.211 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/ntfs.txt 2024-09-13T17:15:15.213 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/ocfs2.txt 2024-09-13T17:15:15.215 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/omfs.txt 2024-09-13T17:15:15.217 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/overlayfs.txt 2024-09-13T17:15:15.218 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/path-lookup.txt 2024-09-13T17:15:15.221 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/ 2024-09-13T17:15:15.223 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/design_notes.txt 2024-09-13T17:15:15.225 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/info.txt 2024-09-13T17:15:15.227 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/network_protocol.txt 2024-09-13T17:15:15.229 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/porting 2024-09-13T17:15:15.231 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/proc.txt 2024-09-13T17:15:15.235 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/qnx6.txt 2024-09-13T17:15:15.237 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/quota.txt 2024-09-13T17:15:15.239 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/ramfs-rootfs-initramfs.txt 2024-09-13T17:15:15.242 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/relay.txt 2024-09-13T17:15:15.244 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/romfs.txt 2024-09-13T17:15:15.246 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/seq_file.txt 2024-09-13T17:15:15.248 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/sharedsubtree.txt 2024-09-13T17:15:15.251 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/spufs.txt 2024-09-13T17:15:15.253 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/squashfs.txt 2024-09-13T17:15:15.255 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/sysfs-pci.txt 2024-09-13T17:15:15.257 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/sysfs-tagging.txt 2024-09-13T17:15:15.259 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/sysfs.txt 2024-09-13T17:15:15.261 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/sysv-fs.txt 2024-09-13T17:15:15.263 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/tmpfs.txt 2024-09-13T17:15:15.265 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/ubifs.txt 2024-09-13T17:15:15.267 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/udf.txt 2024-09-13T17:15:15.269 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/ufs.txt 2024-09-13T17:15:15.270 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/vfat.txt 2024-09-13T17:15:15.273 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/vfs.txt 2024-09-13T17:15:15.276 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/xfs-delayed-logging-design.txt 2024-09-13T17:15:15.279 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/xfs-self-describing-metadata.txt 2024-09-13T17:15:15.281 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/filesystems/xfs.txt 2024-09-13T17:15:15.283 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/firmware_class/ 2024-09-13T17:15:15.285 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/firmware_class/README 2024-09-13T17:15:15.287 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/firmware_class/hotplug-script 2024-09-13T17:15:15.289 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/flexible-arrays.txt 2024-09-13T17:15:15.293 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fmc/ 2024-09-13T17:15:15.293 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fmc/00-INDEX 2024-09-13T17:15:15.294 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fmc/API.txt 2024-09-13T17:15:15.296 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fmc/FMC-and-SDB.txt 2024-09-13T17:15:15.299 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fmc/carrier.txt 2024-09-13T17:15:15.301 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fmc/fmc-chardev.txt 2024-09-13T17:15:15.302 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fmc/fmc-fakedev.txt 2024-09-13T17:15:15.304 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fmc/fmc-trivial.txt 2024-09-13T17:15:15.306 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fmc/fmc-write-eeprom.txt 2024-09-13T17:15:15.308 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fmc/identifiers.txt 2024-09-13T17:15:15.310 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fmc/mezzanine.txt 2024-09-13T17:15:15.312 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/fmc/parameters.txt 2024-09-13T17:15:15.314 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/frv/ 2024-09-13T17:15:15.316 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/frv/README.txt 2024-09-13T17:15:15.318 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/frv/atomic-ops.txt 2024-09-13T17:15:15.320 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/frv/booting.txt 2024-09-13T17:15:15.322 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/frv/clock.txt 2024-09-13T17:15:15.324 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/frv/configuring.txt 2024-09-13T17:15:15.326 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/frv/features.txt 2024-09-13T17:15:15.328 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/frv/gdbinit 2024-09-13T17:15:15.331 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/frv/gdbstub.txt 2024-09-13T17:15:15.333 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/frv/kernel-ABI.txt 2024-09-13T17:15:15.335 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/frv/mmu-layout.txt 2024-09-13T17:15:15.338 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/futex-requeue-pi.txt 2024-09-13T17:15:15.340 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/gcov.txt 2024-09-13T17:15:15.342 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/gdb-kernel-debugging.txt 2024-09-13T17:15:15.345 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/gpio/ 2024-09-13T17:15:15.347 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/gpio/00-INDEX 2024-09-13T17:15:15.349 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/gpio/board.txt 2024-09-13T17:15:15.351 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/gpio/consumer.txt 2024-09-13T17:15:15.353 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/gpio/driver.txt 2024-09-13T17:15:15.355 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/gpio/gpio-legacy.txt 2024-09-13T17:15:15.358 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/gpio/gpio.txt 2024-09-13T17:15:15.360 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/gpio/sysfs.txt 2024-09-13T17:15:15.361 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hid/ 2024-09-13T17:15:15.363 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hid/hid-sensor.txt 2024-09-13T17:15:15.365 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hid/hid-transport.txt 2024-09-13T17:15:15.368 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hid/hiddev.txt 2024-09-13T17:15:15.370 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hid/hidraw.txt 2024-09-13T17:15:15.372 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hid/uhid.txt 2024-09-13T17:15:15.374 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/highuid.txt 2024-09-13T17:15:15.376 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hsi.txt 2024-09-13T17:15:15.378 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hw_random.txt 2024-09-13T17:15:15.380 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/ 2024-09-13T17:15:15.382 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/ab8500 2024-09-13T17:15:15.384 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/abituguru 2024-09-13T17:15:15.385 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/abituguru-datasheet 2024-09-13T17:15:15.388 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/abituguru3 2024-09-13T17:15:15.389 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/abx500 2024-09-13T17:15:15.391 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/acpi_power_meter 2024-09-13T17:15:15.393 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/ad7314 2024-09-13T17:15:15.395 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/adc128d818 2024-09-13T17:15:15.397 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/adm1021 2024-09-13T17:15:15.399 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/adm1025 2024-09-13T17:15:15.400 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/adm1026 2024-09-13T17:15:15.402 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/adm1031 2024-09-13T17:15:15.404 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/adm1275 2024-09-13T17:15:15.407 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/adm9240 2024-09-13T17:15:15.408 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/ads1015 2024-09-13T17:15:15.410 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/ads7828 2024-09-13T17:15:15.412 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/adt7410 2024-09-13T17:15:15.414 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/adt7411 2024-09-13T17:15:15.416 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/adt7462 2024-09-13T17:15:15.418 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/adt7470 2024-09-13T17:15:15.420 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/adt7475 2024-09-13T17:15:15.422 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/amc6821 2024-09-13T17:15:15.424 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/asb100 2024-09-13T17:15:15.426 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/asc7621 2024-09-13T17:15:15.428 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/coretemp 2024-09-13T17:15:15.430 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/da9052 2024-09-13T17:15:15.432 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/da9055 2024-09-13T17:15:15.434 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/dme1737 2024-09-13T17:15:15.436 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/ds1621 2024-09-13T17:15:15.438 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/ds620 2024-09-13T17:15:15.440 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/emc1403 2024-09-13T17:15:15.442 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/emc2103 2024-09-13T17:15:15.444 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/emc6w201 2024-09-13T17:15:15.446 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/f71805f 2024-09-13T17:15:15.448 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/f71882fg 2024-09-13T17:15:15.450 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/fam15h_power 2024-09-13T17:15:15.451 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/g760a 2024-09-13T17:15:15.453 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/g762 2024-09-13T17:15:15.455 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/gl518sm 2024-09-13T17:15:15.457 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/hih6130 2024-09-13T17:15:15.459 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/htu21 2024-09-13T17:15:15.461 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/hwmon-kernel-api.txt 2024-09-13T17:15:15.463 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/ibmaem 2024-09-13T17:15:15.465 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/ibmpowernv 2024-09-13T17:15:15.467 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/ina209 2024-09-13T17:15:15.469 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/ina2xx 2024-09-13T17:15:15.471 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/it87 2024-09-13T17:15:15.473 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/jc42 2024-09-13T17:15:15.475 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/k10temp 2024-09-13T17:15:15.477 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/k8temp 2024-09-13T17:15:15.479 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/lineage-pem 2024-09-13T17:15:15.481 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/lm25066 2024-09-13T17:15:15.483 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/lm63 2024-09-13T17:15:15.485 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/lm70 2024-09-13T17:15:15.489 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/lm73 2024-09-13T17:15:15.491 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/lm75 2024-09-13T17:15:15.496 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/lm77 2024-09-13T17:15:15.497 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/lm78 2024-09-13T17:15:15.499 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/lm80 2024-09-13T17:15:15.501 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/lm83 2024-09-13T17:15:15.504 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/lm85 2024-09-13T17:15:15.506 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/lm87 2024-09-13T17:15:15.508 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/lm90 2024-09-13T17:15:15.510 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/lm92 2024-09-13T17:15:15.512 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/lm93 2024-09-13T17:15:15.515 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/lm95234 2024-09-13T17:15:15.517 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/lm95245 2024-09-13T17:15:15.519 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/ltc2945 2024-09-13T17:15:15.521 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/ltc2978 2024-09-13T17:15:15.524 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/ltc4151 2024-09-13T17:15:15.526 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/ltc4215 2024-09-13T17:15:15.528 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/ltc4245 2024-09-13T17:15:15.553 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/ltc4260 2024-09-13T17:15:15.752 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/ltc4261 2024-09-13T17:15:15.754 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/max16064 2024-09-13T17:15:15.756 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/max16065 2024-09-13T17:15:15.759 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/max1619 2024-09-13T17:15:15.761 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/max1668 2024-09-13T17:15:15.763 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/max197 2024-09-13T17:15:15.766 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/max34440 2024-09-13T17:15:15.768 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/max6639 2024-09-13T17:15:15.770 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/max6642 2024-09-13T17:15:15.772 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/max6650 2024-09-13T17:15:15.774 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/max6697 2024-09-13T17:15:15.776 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/max8688 2024-09-13T17:15:15.778 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/mc13783-adc 2024-09-13T17:15:15.781 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/mcp3021 2024-09-13T17:15:15.782 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/menf21bmc 2024-09-13T17:15:15.785 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/nct6683 2024-09-13T17:15:15.787 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/nct6775 2024-09-13T17:15:15.789 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/nct7802 2024-09-13T17:15:15.791 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/ntc_thermistor 2024-09-13T17:15:15.794 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/pc87360 2024-09-13T17:15:15.796 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/pc87427 2024-09-13T17:15:15.798 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/pcf8591 2024-09-13T17:15:15.801 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/pmbus 2024-09-13T17:15:15.803 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/pmbus-core 2024-09-13T17:15:15.806 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/powr1220 2024-09-13T17:15:15.807 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/pwm-fan 2024-09-13T17:15:15.810 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/sch5627 2024-09-13T17:15:15.812 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/sch5636 2024-09-13T17:15:15.814 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/sht15 2024-09-13T17:15:15.816 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/sht21 2024-09-13T17:15:15.822 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/shtc1 2024-09-13T17:15:15.825 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/sis5595 2024-09-13T17:15:15.827 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/smm665 2024-09-13T17:15:15.829 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/smsc47b397 2024-09-13T17:15:15.831 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/smsc47m1 2024-09-13T17:15:15.833 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/smsc47m192 2024-09-13T17:15:15.836 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/submitting-patches 2024-09-13T17:15:15.838 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/sysfs-interface 2024-09-13T17:15:15.841 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/thmc50 2024-09-13T17:15:15.843 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/tmp102 2024-09-13T17:15:15.845 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/tmp103 2024-09-13T17:15:15.847 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/tmp401 2024-09-13T17:15:15.849 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/tmp421 2024-09-13T17:15:15.851 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/tps40422 2024-09-13T17:15:15.854 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/twl4030-madc-hwmon 2024-09-13T17:15:15.856 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/ucd9000 2024-09-13T17:15:15.858 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/ucd9200 2024-09-13T17:15:15.860 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/userspace-tools 2024-09-13T17:15:15.862 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/vexpress 2024-09-13T17:15:15.864 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/via686a 2024-09-13T17:15:15.866 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/vt1211 2024-09-13T17:15:15.869 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/w83627ehf 2024-09-13T17:15:15.871 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/w83627hf 2024-09-13T17:15:15.873 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/w83781d 2024-09-13T17:15:15.875 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/w83791d 2024-09-13T17:15:15.877 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/w83792d 2024-09-13T17:15:15.881 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/w83793 2024-09-13T17:15:15.883 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/w83795 2024-09-13T17:15:15.886 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/w83l785ts 2024-09-13T17:15:15.888 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/w83l786ng 2024-09-13T17:15:15.889 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/wm831x 2024-09-13T17:15:15.891 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/wm8350 2024-09-13T17:15:15.893 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwmon/zl6100 2024-09-13T17:15:15.895 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/hwspinlock.txt 2024-09-13T17:15:15.899 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/ 2024-09-13T17:15:15.900 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/busses/ 2024-09-13T17:15:15.904 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1535 2024-09-13T17:15:15.904 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1563 2024-09-13T17:15:15.905 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali15x3 2024-09-13T17:15:15.907 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd756 2024-09-13T17:15:15.909 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd8111 2024-09-13T17:15:15.911 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-diolan-u2c 2024-09-13T17:15:15.913 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-i801 2024-09-13T17:15:15.915 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ismt 2024-09-13T17:15:15.917 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-nforce2 2024-09-13T17:15:15.919 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ocores 2024-09-13T17:15:15.921 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport 2024-09-13T17:15:15.923 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport-light 2024-09-13T17:15:15.925 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-pca-isa 2024-09-13T17:15:15.927 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-piix4 2024-09-13T17:15:15.929 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis5595 2024-09-13T17:15:15.931 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis630 2024-09-13T17:15:15.932 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis96x 2024-09-13T17:15:15.935 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-taos-evm 2024-09-13T17:15:15.937 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-via 2024-09-13T17:15:15.939 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-viapro 2024-09-13T17:15:15.941 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/busses/scx200_acb 2024-09-13T17:15:15.943 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/dev-interface 2024-09-13T17:15:15.945 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/fault-codes 2024-09-13T17:15:15.947 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/functionality 2024-09-13T17:15:15.949 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/i2c-protocol 2024-09-13T17:15:15.951 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/i2c-stub 2024-09-13T17:15:15.953 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/instantiating-devices 2024-09-13T17:15:15.955 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/muxes/ 2024-09-13T17:15:15.957 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/muxes/i2c-mux-gpio 2024-09-13T17:15:15.959 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/old-module-parameters 2024-09-13T17:15:15.961 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/smbus-protocol 2024-09-13T17:15:15.963 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/summary 2024-09-13T17:15:15.965 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/ten-bit-addresses 2024-09-13T17:15:15.967 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/upgrading-clients 2024-09-13T17:15:15.969 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2c/writing-clients 2024-09-13T17:15:15.971 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2o/ 2024-09-13T17:15:15.974 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2o/README 2024-09-13T17:15:15.976 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/i2o/ioctl 2024-09-13T17:15:15.978 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ia64/ 2024-09-13T17:15:15.981 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ia64/.gitignore 2024-09-13T17:15:15.982 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ia64/IRQ-redir.txt 2024-09-13T17:15:15.984 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ia64/Makefile 2024-09-13T17:15:15.986 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ia64/README 2024-09-13T17:15:15.988 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ia64/aliasing-test.c 2024-09-13T17:15:15.990 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ia64/aliasing.txt 2024-09-13T17:15:15.992 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ia64/efirtc.txt 2024-09-13T17:15:15.994 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ia64/err_inject.txt 2024-09-13T17:15:15.996 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ia64/fsys.txt 2024-09-13T17:15:15.998 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ia64/mca.txt 2024-09-13T17:15:16.000 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ia64/serial.txt 2024-09-13T17:15:16.002 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ia64/xen.txt 2024-09-13T17:15:16.004 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ide/ 2024-09-13T17:15:16.006 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ide/00-INDEX 2024-09-13T17:15:16.008 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-cd.1994-2004 2024-09-13T17:15:16.010 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-floppy.1996-2002 2024-09-13T17:15:16.012 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-tape.1995-2002 2024-09-13T17:15:16.014 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ide/ide-tape.txt 2024-09-13T17:15:16.016 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ide/ide.txt 2024-09-13T17:15:16.019 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ide/warm-plug-howto.txt 2024-09-13T17:15:16.021 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/infiniband/ 2024-09-13T17:15:16.023 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/infiniband/core_locking.txt 2024-09-13T17:15:16.025 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/infiniband/ipoib.txt 2024-09-13T17:15:16.026 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/infiniband/sysfs.txt 2024-09-13T17:15:16.028 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/infiniband/user_mad.txt 2024-09-13T17:15:16.030 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/infiniband/user_verbs.txt 2024-09-13T17:15:16.032 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/init.txt 2024-09-13T17:15:16.034 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/initrd.txt 2024-09-13T17:15:16.037 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/input/ 2024-09-13T17:15:16.038 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/input/alps.txt 2024-09-13T17:15:16.041 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/input/amijoy.txt 2024-09-13T17:15:16.043 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/input/appletouch.txt 2024-09-13T17:15:16.044 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/input/atarikbd.txt 2024-09-13T17:15:16.047 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/input/bcm5974.txt 2024-09-13T17:15:16.049 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/input/cd32.txt 2024-09-13T17:15:16.051 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/input/cma3000_d0x.txt 2024-09-13T17:15:16.052 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/input/cs461x.txt 2024-09-13T17:15:16.054 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/input/edt-ft5x06.txt 2024-09-13T17:15:16.056 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/input/elantech.txt 2024-09-13T17:15:16.059 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/input/event-codes.txt 2024-09-13T17:15:16.061 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/input/ff.txt 2024-09-13T17:15:16.063 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/input/gamepad.txt 2024-09-13T17:15:16.065 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/input/gameport-programming.txt 2024-09-13T17:15:16.067 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/input/gpio-tilt.txt 2024-09-13T17:15:16.069 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/input/iforce-protocol.txt 2024-09-13T17:15:16.071 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/input/input-programming.txt 2024-09-13T17:15:16.073 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/input/input.txt 2024-09-13T17:15:16.076 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/input/interactive.fig 2024-09-13T17:15:16.078 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/input/joystick-api.txt 2024-09-13T17:15:16.080 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/input/joystick-parport.txt 2024-09-13T17:15:16.082 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/input/joystick.txt 2024-09-13T17:15:16.085 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/input/multi-touch-protocol.txt 2024-09-13T17:15:16.087 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/input/notifier.txt 2024-09-13T17:15:16.088 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/input/ntrig.txt 2024-09-13T17:15:16.091 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/input/rotary-encoder.txt 2024-09-13T17:15:16.093 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/input/sentelic.txt 2024-09-13T17:15:16.095 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/input/shape.fig 2024-09-13T17:15:16.097 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/input/walkera0701.txt 2024-09-13T17:15:16.099 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/input/xpad.txt 2024-09-13T17:15:16.101 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/input/yealink.txt 2024-09-13T17:15:16.102 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/intel_txt.txt 2024-09-13T17:15:16.105 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/io-mapping.txt 2024-09-13T17:15:16.108 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/io_ordering.txt 2024-09-13T17:15:16.109 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ioctl/ 2024-09-13T17:15:16.111 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ioctl/00-INDEX 2024-09-13T17:15:16.113 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ioctl/botching-up-ioctls.txt 2024-09-13T17:15:16.115 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ioctl/cdrom.txt 2024-09-13T17:15:16.118 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ioctl/hdio.txt 2024-09-13T17:15:16.120 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ioctl/ioctl-decoding.txt 2024-09-13T17:15:16.122 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ioctl/ioctl-number.txt 2024-09-13T17:15:16.124 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/iostats.txt 2024-09-13T17:15:16.127 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/irqflags-tracing.txt 2024-09-13T17:15:16.129 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/isapnp.txt 2024-09-13T17:15:16.130 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/isdn/ 2024-09-13T17:15:16.132 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/isdn/00-INDEX 2024-09-13T17:15:16.134 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/isdn/CREDITS 2024-09-13T17:15:16.136 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/isdn/HiSax.cert 2024-09-13T17:15:16.138 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/isdn/INTERFACE 2024-09-13T17:15:16.141 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.CAPI 2024-09-13T17:15:16.143 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.fax 2024-09-13T17:15:16.145 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/isdn/README 2024-09-13T17:15:16.148 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/isdn/README.FAQ 2024-09-13T17:15:16.150 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/isdn/README.HiSax 2024-09-13T17:15:16.152 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/isdn/README.act2000 2024-09-13T17:15:16.154 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/isdn/README.audio 2024-09-13T17:15:16.156 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/isdn/README.avmb1 2024-09-13T17:15:16.158 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/isdn/README.concap 2024-09-13T17:15:16.160 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/isdn/README.diversion 2024-09-13T17:15:16.162 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/isdn/README.fax 2024-09-13T17:15:16.164 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/isdn/README.gigaset 2024-09-13T17:15:16.166 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/isdn/README.hfc-pci 2024-09-13T17:15:16.168 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/isdn/README.hysdn 2024-09-13T17:15:16.171 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/isdn/README.icn 2024-09-13T17:15:16.173 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/isdn/README.mISDN 2024-09-13T17:15:16.174 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/isdn/README.pcbit 2024-09-13T17:15:16.176 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/isdn/README.sc 2024-09-13T17:15:16.178 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/isdn/README.syncppp 2024-09-13T17:15:16.180 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/isdn/README.x25 2024-09-13T17:15:16.182 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/isdn/syncPPP.FAQ 2024-09-13T17:15:16.184 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ja_JP/ 2024-09-13T17:15:16.186 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ja_JP/HOWTO 2024-09-13T17:15:16.188 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ja_JP/SubmitChecklist 2024-09-13T17:15:16.190 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ja_JP/SubmittingPatches 2024-09-13T17:15:16.193 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ja_JP/stable_api_nonsense.txt 2024-09-13T17:15:16.195 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ja_JP/stable_kernel_rules.txt 2024-09-13T17:15:16.197 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/java.txt 2024-09-13T17:15:16.199 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/kasan.txt 2024-09-13T17:15:16.201 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/kbuild/ 2024-09-13T17:15:16.203 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/kbuild/00-INDEX 2024-09-13T17:15:16.205 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/kbuild/headers_install.txt 2024-09-13T17:15:16.206 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/kbuild/kbuild.txt 2024-09-13T17:15:16.209 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/kbuild/kconfig-language.txt 2024-09-13T17:15:16.211 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/kbuild/kconfig.txt 2024-09-13T17:15:16.213 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/kbuild/makefiles.txt 2024-09-13T17:15:16.216 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/kbuild/modules.txt 2024-09-13T17:15:16.218 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/kdump/ 2024-09-13T17:15:16.220 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/kdump/gdbmacros.txt 2024-09-13T17:15:16.222 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/kdump/kdump.txt 2024-09-13T17:15:16.224 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/kernel-doc-nano-HOWTO.txt 2024-09-13T17:15:16.226 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/kernel-docs.txt 2024-09-13T17:15:16.229 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/kernel-parameters.txt 2024-09-13T17:15:16.234 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/kernel-per-CPU-kthreads.txt 2024-09-13T17:15:16.236 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/kmemcheck.txt 2024-09-13T17:15:16.239 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/kmemleak.txt 2024-09-13T17:15:16.241 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ko_KR/ 2024-09-13T17:15:16.243 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ko_KR/HOWTO 2024-09-13T17:15:16.246 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ko_KR/stable_api_nonsense.txt 2024-09-13T17:15:16.248 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/kobject.txt 2024-09-13T17:15:16.251 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/kprobes.txt 2024-09-13T17:15:16.253 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/kref.txt 2024-09-13T17:15:16.255 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/kselftest.txt 2024-09-13T17:15:16.257 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/laptops/ 2024-09-13T17:15:16.259 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/laptops/.gitignore 2024-09-13T17:15:16.262 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/laptops/00-INDEX 2024-09-13T17:15:16.264 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/laptops/Makefile 2024-09-13T17:15:16.266 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/laptops/asus-laptop.txt 2024-09-13T17:15:16.267 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/laptops/disk-shock-protection.txt 2024-09-13T17:15:16.269 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/laptops/dslm.c 2024-09-13T17:15:16.272 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/laptops/freefall.c 2024-09-13T17:15:16.274 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/laptops/laptop-mode.txt 2024-09-13T17:15:16.276 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/laptops/sony-laptop.txt 2024-09-13T17:15:16.279 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/laptops/sonypi.txt 2024-09-13T17:15:16.280 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/laptops/thinkpad-acpi.txt 2024-09-13T17:15:16.283 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/laptops/toshiba_haps.txt 2024-09-13T17:15:16.285 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ldm.txt 2024-09-13T17:15:16.287 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/leds/ 2024-09-13T17:15:16.289 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/leds/00-INDEX 2024-09-13T17:15:16.291 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/leds/leds-blinkm.txt 2024-09-13T17:15:16.293 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/leds/leds-class.txt 2024-09-13T17:15:16.295 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/leds/leds-lm3556.txt 2024-09-13T17:15:16.297 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/leds/leds-lp3944.txt 2024-09-13T17:15:16.299 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/leds/leds-lp5521.txt 2024-09-13T17:15:16.300 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/leds/leds-lp5523.txt 2024-09-13T17:15:16.303 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/leds/leds-lp5562.txt 2024-09-13T17:15:16.304 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/leds/leds-lp55xx.txt 2024-09-13T17:15:16.307 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/leds/ledtrig-oneshot.txt 2024-09-13T17:15:16.308 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/leds/ledtrig-transient.txt 2024-09-13T17:15:16.312 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/local_ops.txt 2024-09-13T17:15:16.313 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/locking/ 2024-09-13T17:15:16.315 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/locking/00-INDEX 2024-09-13T17:15:16.316 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/locking/lglock.txt 2024-09-13T17:15:16.318 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/locking/lockdep-design.txt 2024-09-13T17:15:16.321 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/locking/lockstat.txt 2024-09-13T17:15:16.323 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/locking/locktorture.txt 2024-09-13T17:15:16.325 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/locking/mutex-design.txt 2024-09-13T17:15:16.327 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/locking/rt-mutex-design.txt 2024-09-13T17:15:16.330 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/locking/rt-mutex.txt 2024-09-13T17:15:16.332 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/locking/spinlocks.txt 2024-09-13T17:15:16.334 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/locking/ww-mutex-design.txt 2024-09-13T17:15:16.336 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/lockup-watchdogs.txt 2024-09-13T17:15:16.339 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/logo.gif 2024-09-13T17:15:16.341 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/logo.txt 2024-09-13T17:15:16.343 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/lzo.txt 2024-09-13T17:15:16.345 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/m68k/ 2024-09-13T17:15:16.347 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/m68k/00-INDEX 2024-09-13T17:15:16.348 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/m68k/README.buddha 2024-09-13T17:15:16.350 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/m68k/kernel-options.txt 2024-09-13T17:15:16.353 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/magic-number.txt 2024-09-13T17:15:16.355 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/mailbox.txt 2024-09-13T17:15:16.357 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/md.txt 2024-09-13T17:15:16.359 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/media-framework.txt 2024-09-13T17:15:16.361 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/memory-barriers.txt 2024-09-13T17:15:16.442 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/memory-devices/ 2024-09-13T17:15:16.444 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/memory-devices/ti-emif.txt 2024-09-13T17:15:16.446 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/memory-hotplug.txt 2024-09-13T17:15:16.448 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/metag/ 2024-09-13T17:15:16.450 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/metag/00-INDEX 2024-09-13T17:15:16.452 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/metag/kernel-ABI.txt 2024-09-13T17:15:16.454 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/mic/ 2024-09-13T17:15:16.457 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/mic/Makefile 2024-09-13T17:15:16.458 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/mic/mic_overview.txt 2024-09-13T17:15:16.461 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/mic/mpssd/ 2024-09-13T17:15:16.463 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/mic/mpssd/.gitignore 2024-09-13T17:15:16.465 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/mic/mpssd/Makefile 2024-09-13T17:15:16.467 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/mic/mpssd/micctrl 2024-09-13T17:15:16.469 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/mic/mpssd/mpss 2024-09-13T17:15:16.471 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.c 2024-09-13T17:15:16.474 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.h 2024-09-13T17:15:16.476 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/mic/mpssd/sysfs.c 2024-09-13T17:15:16.478 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/mips/ 2024-09-13T17:15:16.480 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/mips/00-INDEX 2024-09-13T17:15:16.483 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/mips/AU1xxx_IDE.README 2024-09-13T17:15:16.485 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/misc-devices/ 2024-09-13T17:15:16.487 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/misc-devices/Makefile 2024-09-13T17:15:16.489 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/misc-devices/ad525x_dpot.txt 2024-09-13T17:15:16.492 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/misc-devices/apds990x.txt 2024-09-13T17:15:16.493 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/misc-devices/bh1770glc.txt 2024-09-13T17:15:16.496 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/misc-devices/c2port.txt 2024-09-13T17:15:16.497 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/misc-devices/eeprom 2024-09-13T17:15:16.499 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/misc-devices/ics932s401 2024-09-13T17:15:16.501 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/misc-devices/isl29003 2024-09-13T17:15:16.503 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/misc-devices/lis3lv02d 2024-09-13T17:15:16.505 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/misc-devices/max6875 2024-09-13T17:15:16.507 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/misc-devices/mei/ 2024-09-13T17:15:16.509 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/misc-devices/mei/.gitignore 2024-09-13T17:15:16.511 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/misc-devices/mei/Makefile 2024-09-13T17:15:16.513 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/misc-devices/mei/TODO 2024-09-13T17:15:16.516 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-amt-version.c 2024-09-13T17:15:16.517 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-client-bus.txt 2024-09-13T17:15:16.519 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei.txt 2024-09-13T17:15:16.522 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/misc-devices/spear-pcie-gadget.txt 2024-09-13T17:15:16.524 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/mmc/ 2024-09-13T17:15:16.525 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/mmc/00-INDEX 2024-09-13T17:15:16.527 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/mmc/mmc-async-req.txt 2024-09-13T17:15:16.529 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-attrs.txt 2024-09-13T17:15:16.531 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-parts.txt 2024-09-13T17:15:16.533 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/mn10300/ 2024-09-13T17:15:16.535 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/mn10300/ABI.txt 2024-09-13T17:15:16.537 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/mn10300/compartmentalisation.txt 2024-09-13T17:15:16.538 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/module-signing.txt 2024-09-13T17:15:16.541 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/mono.txt 2024-09-13T17:15:16.543 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/mtd/ 2024-09-13T17:15:16.544 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/mtd/nand/ 2024-09-13T17:15:16.546 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/mtd/nand/pxa3xx-nand.txt 2024-09-13T17:15:16.547 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/mtd/nand_ecc.txt 2024-09-13T17:15:16.551 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/mtd/spi-nor.txt 2024-09-13T17:15:16.552 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/namespaces/ 2024-09-13T17:15:16.682 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/namespaces/compatibility-list.txt 2024-09-13T17:15:16.683 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/namespaces/resource-control.txt 2024-09-13T17:15:16.685 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/netlabel/ 2024-09-13T17:15:16.687 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/netlabel/00-INDEX 2024-09-13T17:15:16.689 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/netlabel/cipso_ipv4.txt 2024-09-13T17:15:16.691 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/netlabel/draft-ietf-cipso-ipsecurity-01.txt 2024-09-13T17:15:16.693 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/netlabel/introduction.txt 2024-09-13T17:15:16.695 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/netlabel/lsm_interface.txt 2024-09-13T17:15:16.697 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/ 2024-09-13T17:15:16.699 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/00-INDEX 2024-09-13T17:15:16.701 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/3c509.txt 2024-09-13T17:15:16.703 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/6pack.txt 2024-09-13T17:15:16.705 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/LICENSE.qla3xxx 2024-09-13T17:15:16.707 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlcnic 2024-09-13T17:15:16.709 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlge 2024-09-13T17:15:16.712 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/Makefile 2024-09-13T17:15:16.713 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/PLIP.txt 2024-09-13T17:15:16.715 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/README.ipw2100 2024-09-13T17:15:16.717 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/README.ipw2200 2024-09-13T17:15:16.721 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/README.sb1000 2024-09-13T17:15:16.722 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/alias.txt 2024-09-13T17:15:16.724 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/altera_tse.txt 2024-09-13T17:15:16.726 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/arcnet-hardware.txt 2024-09-13T17:15:16.730 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/arcnet.txt 2024-09-13T17:15:16.732 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/atm.txt 2024-09-13T17:15:16.734 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/ax25.txt 2024-09-13T17:15:16.736 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/batman-adv.txt 2024-09-13T17:15:16.738 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/baycom.txt 2024-09-13T17:15:16.740 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/bonding.txt 2024-09-13T17:15:16.744 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/bridge.txt 2024-09-13T17:15:16.746 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/caif/ 2024-09-13T17:15:16.748 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/caif/Linux-CAIF.txt 2024-09-13T17:15:16.750 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/caif/README 2024-09-13T17:15:16.752 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/caif/spi_porting.txt 2024-09-13T17:15:16.754 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/can.txt 2024-09-13T17:15:16.757 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/cdc_mbim.txt 2024-09-13T17:15:16.759 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/cops.txt 2024-09-13T17:15:16.761 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/cs89x0.txt 2024-09-13T17:15:16.763 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/cxacru-cf.py 2024-09-13T17:15:16.765 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/cxacru.txt 2024-09-13T17:15:16.767 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/cxgb.txt 2024-09-13T17:15:16.769 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/dccp.txt 2024-09-13T17:15:16.772 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/dctcp.txt 2024-09-13T17:15:16.774 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/de4x5.txt 2024-09-13T17:15:16.776 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/decnet.txt 2024-09-13T17:15:16.778 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/dl2k.txt 2024-09-13T17:15:16.780 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/dm9000.txt 2024-09-13T17:15:16.782 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/dmfe.txt 2024-09-13T17:15:16.784 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/dns_resolver.txt 2024-09-13T17:15:16.786 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/driver.txt 2024-09-13T17:15:16.788 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/e100.txt 2024-09-13T17:15:16.790 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/e1000.txt 2024-09-13T17:15:16.793 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/e1000e.txt 2024-09-13T17:15:16.795 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/eql.txt 2024-09-13T17:15:16.797 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/fib_trie.txt 2024-09-13T17:15:16.798 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/filter.txt 2024-09-13T17:15:16.801 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/fore200e.txt 2024-09-13T17:15:16.803 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/framerelay.txt 2024-09-13T17:15:16.805 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/gen_stats.txt 2024-09-13T17:15:16.807 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/generic-hdlc.txt 2024-09-13T17:15:16.809 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/generic_netlink.txt 2024-09-13T17:15:16.811 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/gianfar.txt 2024-09-13T17:15:16.813 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/i40e.txt 2024-09-13T17:15:16.815 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/i40evf.txt 2024-09-13T17:15:16.817 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/ieee802154.txt 2024-09-13T17:15:16.819 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/igb.txt 2024-09-13T17:15:16.821 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/igbvf.txt 2024-09-13T17:15:16.823 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/ip-sysctl.txt 2024-09-13T17:15:16.826 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/ip_dynaddr.txt 2024-09-13T17:15:16.828 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/ipddp.txt 2024-09-13T17:15:16.830 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/iphase.txt 2024-09-13T17:15:16.832 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/ipsec.txt 2024-09-13T17:15:16.834 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/ipv6.txt 2024-09-13T17:15:16.836 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/ipvlan.txt 2024-09-13T17:15:16.838 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/ipvs-sysctl.txt 2024-09-13T17:15:16.841 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/irda.txt 2024-09-13T17:15:16.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:16 smithi149 ceph-mon[35496]: pgmap v46: 129 pgs: 129 active+clean; 96 MiB data, 612 MiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 8.0 MiB/s wr, 289 op/s 2024-09-13T17:15:16.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:16 smithi149 ceph-mon[35496]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:15:16.842 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/ixgb.txt 2024-09-13T17:15:16.845 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/ixgbe.txt 2024-09-13T17:15:16.847 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/ixgbevf.txt 2024-09-13T17:15:16.849 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/l2tp.txt 2024-09-13T17:15:16.852 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/lapb-module.txt 2024-09-13T17:15:16.853 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/ltpc.txt 2024-09-13T17:15:16.855 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/mac80211-auth-assoc-deauth.txt 2024-09-13T17:15:16.857 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/mac80211-injection.txt 2024-09-13T17:15:16.859 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/ 2024-09-13T17:15:16.860 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/README 2024-09-13T17:15:16.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:16 smithi118 ceph-mon[34374]: pgmap v46: 129 pgs: 129 active+clean; 96 MiB data, 612 MiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 8.0 MiB/s wr, 289 op/s 2024-09-13T17:15:16.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:16 smithi118 ceph-mon[34374]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:15:16.863 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/hostapd.conf 2024-09-13T17:15:16.864 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/wpa_supplicant.conf 2024-09-13T17:15:16.867 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/multiqueue.txt 2024-09-13T17:15:16.869 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/netconsole.txt 2024-09-13T17:15:16.871 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/netdev-FAQ.txt 2024-09-13T17:15:16.874 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/netdev-features.txt 2024-09-13T17:15:16.876 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/netdevices.txt 2024-09-13T17:15:16.877 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/netif-msg.txt 2024-09-13T17:15:16.879 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/netlink_mmap.txt 2024-09-13T17:15:16.881 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/nf_conntrack-sysctl.txt 2024-09-13T17:15:16.883 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/nfc.txt 2024-09-13T17:15:16.885 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/openvswitch.txt 2024-09-13T17:15:16.887 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/operstates.txt 2024-09-13T17:15:16.889 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/packet_mmap.txt 2024-09-13T17:15:16.893 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/phonet.txt 2024-09-13T17:15:16.895 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/phy.txt 2024-09-13T17:15:16.897 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/pktgen.txt 2024-09-13T17:15:16.899 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/policy-routing.txt 2024-09-13T17:15:16.901 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/ppp_generic.txt 2024-09-13T17:15:16.903 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/proc_net_tcp.txt 2024-09-13T17:15:16.905 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/radiotap-headers.txt 2024-09-13T17:15:16.907 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/ray_cs.txt 2024-09-13T17:15:16.909 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/rds.txt 2024-09-13T17:15:16.911 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/regulatory.txt 2024-09-13T17:15:16.913 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/rxrpc.txt 2024-09-13T17:15:16.916 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/s2io.txt 2024-09-13T17:15:16.918 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/scaling.txt 2024-09-13T17:15:16.920 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/sctp.txt 2024-09-13T17:15:16.922 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/secid.txt 2024-09-13T17:15:16.924 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/skfp.txt 2024-09-13T17:15:16.925 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/smc9.txt 2024-09-13T17:15:16.927 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/spider_net.txt 2024-09-13T17:15:16.929 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/stmmac.txt 2024-09-13T17:15:16.931 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/switchdev.txt 2024-09-13T17:15:16.933 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/tc-actions-env-rules.txt 2024-09-13T17:15:16.935 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/tcp-thin.txt 2024-09-13T17:15:16.937 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/tcp.txt 2024-09-13T17:15:16.939 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/team.txt 2024-09-13T17:15:16.941 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/timestamping.txt 2024-09-13T17:15:16.943 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/timestamping/ 2024-09-13T17:15:16.945 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/timestamping/.gitignore 2024-09-13T17:15:16.948 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/timestamping/Makefile 2024-09-13T17:15:16.949 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/timestamping/hwtstamp_config.c 2024-09-13T17:15:16.951 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/timestamping/timestamping.c 2024-09-13T17:15:16.953 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/timestamping/txtimestamp.c 2024-09-13T17:15:16.955 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/tlan.txt 2024-09-13T17:15:16.958 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/tproxy.txt 2024-09-13T17:15:16.960 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/tuntap.txt 2024-09-13T17:15:16.962 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/udplite.txt 2024-09-13T17:15:16.964 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/vortex.txt 2024-09-13T17:15:16.966 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/vxge.txt 2024-09-13T17:15:16.968 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/vxlan.txt 2024-09-13T17:15:16.970 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/x25-iface.txt 2024-09-13T17:15:16.972 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/x25.txt 2024-09-13T17:15:16.974 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/xfrm_proc.txt 2024-09-13T17:15:16.976 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/xfrm_sync.txt 2024-09-13T17:15:16.978 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/xfrm_sysctl.txt 2024-09-13T17:15:16.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:16 smithi087 ceph-mon[30934]: pgmap v46: 129 pgs: 129 active+clean; 96 MiB data, 612 MiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 8.0 MiB/s wr, 289 op/s 2024-09-13T17:15:16.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:16 smithi087 ceph-mon[30934]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:15:16.980 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/networking/z8530drv.txt 2024-09-13T17:15:16.983 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/nfc/ 2024-09-13T17:15:16.985 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/nfc/nfc-hci.txt 2024-09-13T17:15:16.987 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/nfc/nfc-pn544.txt 2024-09-13T17:15:16.988 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/nios2/ 2024-09-13T17:15:16.990 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/nios2/README 2024-09-13T17:15:16.992 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/nommu-mmap.txt 2024-09-13T17:15:16.995 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/numastat.txt 2024-09-13T17:15:16.996 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/oops-tracing.txt 2024-09-13T17:15:16.999 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/padata.txt 2024-09-13T17:15:17.001 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/parisc/ 2024-09-13T17:15:17.002 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/parisc/00-INDEX 2024-09-13T17:15:17.004 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/parisc/debugging 2024-09-13T17:15:17.006 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/parisc/registers 2024-09-13T17:15:17.008 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/parport-lowlevel.txt 2024-09-13T17:15:17.011 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/parport.txt 2024-09-13T17:15:17.013 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/pcmcia/ 2024-09-13T17:15:17.014 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/pcmcia/.gitignore 2024-09-13T17:15:17.016 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/pcmcia/Makefile 2024-09-13T17:15:17.018 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/pcmcia/crc32hash.c 2024-09-13T17:15:17.020 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/pcmcia/devicetable.txt 2024-09-13T17:15:17.022 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/pcmcia/driver-changes.txt 2024-09-13T17:15:17.024 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/pcmcia/driver.txt 2024-09-13T17:15:17.026 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/pcmcia/locking.txt 2024-09-13T17:15:17.028 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/percpu-rw-semaphore.txt 2024-09-13T17:15:17.031 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/phy.txt 2024-09-13T17:15:17.033 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/phy/ 2024-09-13T17:15:17.035 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/phy/samsung-usb2.txt 2024-09-13T17:15:17.036 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/pi-futex.txt 2024-09-13T17:15:17.038 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/pinctrl.txt 2024-09-13T17:15:17.042 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/platform/ 2024-09-13T17:15:17.043 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/platform/x86-laptop-drivers.txt 2024-09-13T17:15:17.045 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/pnp.txt 2024-09-13T17:15:17.048 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/power/ 2024-09-13T17:15:17.049 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/power/00-INDEX 2024-09-13T17:15:17.051 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/power/apm-acpi.txt 2024-09-13T17:15:17.053 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/power/basic-pm-debugging.txt 2024-09-13T17:15:17.055 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/power/charger-manager.txt 2024-09-13T17:15:17.058 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/power/devices.txt 2024-09-13T17:15:17.060 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/power/drivers-testing.txt 2024-09-13T17:15:17.062 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/power/freezing-of-tasks.txt 2024-09-13T17:15:17.064 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/power/interface.txt 2024-09-13T17:15:17.066 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/power/notifiers.txt 2024-09-13T17:15:17.068 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/power/opp.txt 2024-09-13T17:15:17.070 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/power/pci.txt 2024-09-13T17:15:17.074 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/power/pm_qos_interface.txt 2024-09-13T17:15:17.076 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/power/power_supply_class.txt 2024-09-13T17:15:17.078 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/power/powercap/ 2024-09-13T17:15:17.080 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/power/powercap/powercap.txt 2024-09-13T17:15:17.082 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/power/regulator/ 2024-09-13T17:15:17.084 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/power/regulator/consumer.txt 2024-09-13T17:15:17.086 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/power/regulator/design.txt 2024-09-13T17:15:17.088 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/power/regulator/machine.txt 2024-09-13T17:15:17.090 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/power/regulator/overview.txt 2024-09-13T17:15:17.092 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/power/regulator/regulator.txt 2024-09-13T17:15:17.094 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/power/runtime_pm.txt 2024-09-13T17:15:17.097 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/power/s2ram.txt 2024-09-13T17:15:17.099 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/power/states.txt 2024-09-13T17:15:17.101 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/power/suspend-and-cpuhotplug.txt 2024-09-13T17:15:17.104 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/power/suspend-and-interrupts.txt 2024-09-13T17:15:17.106 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/power/swsusp-and-swap-files.txt 2024-09-13T17:15:17.108 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/power/swsusp-dmcrypt.txt 2024-09-13T17:15:17.109 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/power/swsusp.txt 2024-09-13T17:15:17.112 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/power/tricks.txt 2024-09-13T17:15:17.113 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/power/userland-swsusp.txt 2024-09-13T17:15:17.115 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/power/video.txt 2024-09-13T17:15:17.118 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/powerpc/ 2024-09-13T17:15:17.120 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/powerpc/00-INDEX 2024-09-13T17:15:17.122 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/powerpc/bootwrapper.txt 2024-09-13T17:15:17.124 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/powerpc/cpu_families.txt 2024-09-13T17:15:17.129 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/powerpc/cpu_features.txt 2024-09-13T17:15:17.129 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/powerpc/cxl.txt 2024-09-13T17:15:17.130 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/powerpc/eeh-pci-error-recovery.txt 2024-09-13T17:15:17.132 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/powerpc/firmware-assisted-dump.txt 2024-09-13T17:15:17.134 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/powerpc/hvcs.txt 2024-09-13T17:15:17.136 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/powerpc/mpc52xx.txt 2024-09-13T17:15:17.138 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/powerpc/pmu-ebb.txt 2024-09-13T17:15:17.140 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/powerpc/ptrace.txt 2024-09-13T17:15:17.142 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/powerpc/qe_firmware.txt 2024-09-13T17:15:17.144 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/powerpc/transactional_memory.txt 2024-09-13T17:15:17.146 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/pps/ 2024-09-13T17:15:17.149 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/pps/pps.txt 2024-09-13T17:15:17.150 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/prctl/ 2024-09-13T17:15:17.152 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/prctl/.gitignore 2024-09-13T17:15:17.154 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/prctl/Makefile 2024-09-13T17:15:17.156 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-ctxt-sw-stress-test.c 2024-09-13T17:15:17.158 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-on-off-stress-test.c 2024-09-13T17:15:17.160 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-test.c 2024-09-13T17:15:17.162 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/prctl/no_new_privs.txt 2024-09-13T17:15:17.163 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/prctl/seccomp_filter.txt 2024-09-13T17:15:17.166 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/preempt-locking.txt 2024-09-13T17:15:17.168 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/printk-formats.txt 2024-09-13T17:15:17.170 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/pti/ 2024-09-13T17:15:17.172 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/pti/pti_intel_mid.txt 2024-09-13T17:15:17.174 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ptp/ 2024-09-13T17:15:17.176 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ptp/.gitignore 2024-09-13T17:15:17.178 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ptp/Makefile 2024-09-13T17:15:17.180 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ptp/ptp.txt 2024-09-13T17:15:17.182 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ptp/testptp.c 2024-09-13T17:15:17.185 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ptp/testptp.mk 2024-09-13T17:15:17.186 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/pwm.txt 2024-09-13T17:15:17.188 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/ramoops.txt 2024-09-13T17:15:17.191 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/rapidio/ 2024-09-13T17:15:17.192 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/rapidio/rapidio.txt 2024-09-13T17:15:17.195 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/rapidio/sysfs.txt 2024-09-13T17:15:17.197 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/rapidio/tsi721.txt 2024-09-13T17:15:17.199 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/rbtree.txt 2024-09-13T17:15:17.202 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/remoteproc.txt 2024-09-13T17:15:17.204 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/rfkill.txt 2024-09-13T17:15:17.206 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/robust-futex-ABI.txt 2024-09-13T17:15:17.208 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/robust-futexes.txt 2024-09-13T17:15:17.210 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/rpmsg.txt 2024-09-13T17:15:17.212 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/rtc.txt 2024-09-13T17:15:17.215 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/s390/ 2024-09-13T17:15:17.216 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/s390/00-INDEX 2024-09-13T17:15:17.218 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/s390/3270.ChangeLog 2024-09-13T17:15:17.220 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/s390/3270.txt 2024-09-13T17:15:17.222 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/s390/CommonIO 2024-09-13T17:15:17.224 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/s390/DASD 2024-09-13T17:15:17.226 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/s390/Debugging390.txt 2024-09-13T17:15:17.230 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/s390/cds.txt 2024-09-13T17:15:17.232 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/s390/config3270.sh 2024-09-13T17:15:17.233 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/s390/driver-model.txt 2024-09-13T17:15:17.236 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/s390/kvm.txt 2024-09-13T17:15:17.238 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/s390/monreader.txt 2024-09-13T17:15:17.240 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/s390/qeth.txt 2024-09-13T17:15:17.242 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/s390/s390dbf.txt 2024-09-13T17:15:17.244 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/s390/zfcpdump.txt 2024-09-13T17:15:17.246 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scheduler/ 2024-09-13T17:15:17.248 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scheduler/00-INDEX 2024-09-13T17:15:17.250 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scheduler/completion.txt 2024-09-13T17:15:17.252 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scheduler/sched-arch.txt 2024-09-13T17:15:17.254 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scheduler/sched-bwc.txt 2024-09-13T17:15:17.256 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scheduler/sched-deadline.txt 2024-09-13T17:15:17.259 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scheduler/sched-design-CFS.txt 2024-09-13T17:15:17.261 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scheduler/sched-domains.txt 2024-09-13T17:15:17.263 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scheduler/sched-nice-design.txt 2024-09-13T17:15:17.265 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scheduler/sched-rt-group.txt 2024-09-13T17:15:17.266 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scheduler/sched-stats.txt 2024-09-13T17:15:17.269 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/ 2024-09-13T17:15:17.271 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/00-INDEX 2024-09-13T17:15:17.272 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/53c700.txt 2024-09-13T17:15:17.275 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/BusLogic.txt 2024-09-13T17:15:17.277 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.1992-1997 2024-09-13T17:15:17.280 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.arcmsr 2024-09-13T17:15:17.282 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ips 2024-09-13T17:15:17.284 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.lpfc 2024-09-13T17:15:17.288 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid 2024-09-13T17:15:17.291 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid_sas 2024-09-13T17:15:17.294 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ncr53c8xx 2024-09-13T17:15:17.296 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx 2024-09-13T17:15:17.299 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx_2 2024-09-13T17:15:17.301 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/FlashPoint.txt 2024-09-13T17:15:17.303 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/LICENSE.FlashPoint 2024-09-13T17:15:17.304 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla2xxx 2024-09-13T17:15:17.307 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla4xxx 2024-09-13T17:15:17.309 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/Mylex.txt 2024-09-13T17:15:17.311 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/NinjaSCSI.txt 2024-09-13T17:15:17.313 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/aacraid.txt 2024-09-13T17:15:17.315 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/advansys.txt 2024-09-13T17:15:17.317 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/aha152x.txt 2024-09-13T17:15:17.319 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/aic79xx.txt 2024-09-13T17:15:17.321 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/aic7xxx.txt 2024-09-13T17:15:17.323 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/arcmsr_spec.txt 2024-09-13T17:15:17.326 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/bfa.txt 2024-09-13T17:15:17.328 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/bnx2fc.txt 2024-09-13T17:15:17.333 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/cxgb3i.txt 2024-09-13T17:15:17.333 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/dc395x.txt 2024-09-13T17:15:17.333 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/dpti.txt 2024-09-13T17:15:17.335 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/dtc3x80.txt 2024-09-13T17:15:17.337 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/g_NCR5380.txt 2024-09-13T17:15:17.339 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/hpsa.txt 2024-09-13T17:15:17.342 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/hptiop.txt 2024-09-13T17:15:17.344 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/in2000.txt 2024-09-13T17:15:17.346 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/libsas.txt 2024-09-13T17:15:17.349 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/link_power_management_policy.txt 2024-09-13T17:15:17.351 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/lpfc.txt 2024-09-13T17:15:17.353 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/megaraid.txt 2024-09-13T17:15:17.355 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/ncr53c8xx.txt 2024-09-13T17:15:17.359 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/osd.txt 2024-09-13T17:15:17.361 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/osst.txt 2024-09-13T17:15:17.363 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/ppa.txt 2024-09-13T17:15:17.365 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/qlogicfas.txt 2024-09-13T17:15:17.367 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/scsi-changer.txt 2024-09-13T17:15:17.369 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/scsi-generic.txt 2024-09-13T17:15:17.371 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/scsi-parameters.txt 2024-09-13T17:15:17.373 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/scsi.txt 2024-09-13T17:15:17.375 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/scsi_eh.txt 2024-09-13T17:15:17.377 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/scsi_fc_transport.txt 2024-09-13T17:15:17.379 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/scsi_mid_low_api.txt 2024-09-13T17:15:17.383 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/ 2024-09-13T17:15:17.385 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/Makefile 2024-09-13T17:15:17.387 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/rport_state_diagram.dot 2024-09-13T17:15:17.389 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/st.txt 2024-09-13T17:15:17.392 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/sym53c500_cs.txt 2024-09-13T17:15:17.393 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/sym53c8xx_2.txt 2024-09-13T17:15:17.396 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/tmscsim.txt 2024-09-13T17:15:17.399 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/ufs.txt 2024-09-13T17:15:17.401 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/scsi/wd719x.txt 2024-09-13T17:15:17.403 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/security/ 2024-09-13T17:15:17.405 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/security/00-INDEX 2024-09-13T17:15:17.407 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/security/IMA-templates.txt 2024-09-13T17:15:17.410 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/security/LSM.txt 2024-09-13T17:15:17.412 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/security/SELinux.txt 2024-09-13T17:15:17.414 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/security/Smack.txt 2024-09-13T17:15:17.417 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/security/Yama.txt 2024-09-13T17:15:17.419 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/security/apparmor.txt 2024-09-13T17:15:17.421 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/security/credentials.txt 2024-09-13T17:15:17.424 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/security/keys-ecryptfs.txt 2024-09-13T17:15:17.426 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/security/keys-request-key.txt 2024-09-13T17:15:17.428 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/security/keys-trusted-encrypted.txt 2024-09-13T17:15:17.430 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/security/keys.txt 2024-09-13T17:15:17.433 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/security/tomoyo.txt 2024-09-13T17:15:17.434 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/serial-console.txt 2024-09-13T17:15:17.438 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/serial/ 2024-09-13T17:15:17.439 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/serial/00-INDEX 2024-09-13T17:15:17.441 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/serial/README.cycladesZ 2024-09-13T17:15:17.483 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/serial/driver 2024-09-13T17:15:17.483 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/serial/moxa-smartio 2024-09-13T17:15:17.483 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/serial/n_gsm.txt 2024-09-13T17:15:17.483 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/serial/rocket.txt 2024-09-13T17:15:17.483 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/serial/serial-rs485.txt 2024-09-13T17:15:17.483 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/serial/tty.txt 2024-09-13T17:15:17.483 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sgi-ioc4.txt 2024-09-13T17:15:17.483 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sh/ 2024-09-13T17:15:17.483 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sh/new-machine.txt 2024-09-13T17:15:17.483 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sh/register-banks.txt 2024-09-13T17:15:17.483 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/smsc_ece1099.txt 2024-09-13T17:15:17.484 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/ 2024-09-13T17:15:17.484 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/ 2024-09-13T17:15:17.484 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/ALSA-Configuration.txt 2024-09-13T17:15:17.484 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/Audigy-mixer.txt 2024-09-13T17:15:17.484 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/Audiophile-Usb.txt 2024-09-13T17:15:17.484 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/Bt87x.txt 2024-09-13T17:15:17.484 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/CMIPCI.txt 2024-09-13T17:15:17.484 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/Channel-Mapping-API.txt 2024-09-13T17:15:17.485 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/ControlNames.txt 2024-09-13T17:15:17.487 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Controls.txt 2024-09-13T17:15:17.489 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Models.txt 2024-09-13T17:15:17.491 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio.txt 2024-09-13T17:15:17.494 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/Joystick.txt 2024-09-13T17:15:17.496 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/MIXART.txt 2024-09-13T17:15:17.498 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/OSS-Emulation.txt 2024-09-13T17:15:17.500 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/Procfile.txt 2024-09-13T17:15:17.502 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/README.maya44 2024-09-13T17:15:17.504 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/SB-Live-mixer.txt 2024-09-13T17:15:17.507 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/VIA82xx-mixer.txt 2024-09-13T17:15:17.509 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/alsa-parameters.txt 2024-09-13T17:15:17.511 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/compress_offload.txt 2024-09-13T17:15:17.513 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/emu10k1-jack.txt 2024-09-13T17:15:17.515 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/hda_codec.txt 2024-09-13T17:15:17.517 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/hdspm.txt 2024-09-13T17:15:17.519 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/powersave.txt 2024-09-13T17:15:17.521 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/seq_oss.html 2024-09-13T17:15:17.523 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/serial-u16550.txt 2024-09-13T17:15:17.526 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/soc/ 2024-09-13T17:15:17.527 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DAI.txt 2024-09-13T17:15:17.529 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DPCM.txt 2024-09-13T17:15:17.531 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/soc/clocking.txt 2024-09-13T17:15:17.537 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/soc/codec.txt 2024-09-13T17:15:17.537 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/soc/dapm.txt 2024-09-13T17:15:17.537 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/soc/jack.txt 2024-09-13T17:15:17.540 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/soc/machine.txt 2024-09-13T17:15:17.542 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/soc/overview.txt 2024-09-13T17:15:17.544 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/soc/platform.txt 2024-09-13T17:15:17.546 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/alsa/soc/pops_clicks.txt 2024-09-13T17:15:17.548 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/oss/ 2024-09-13T17:15:17.551 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/oss/ALS 2024-09-13T17:15:17.553 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/oss/AudioExcelDSP16 2024-09-13T17:15:17.555 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/oss/CMI8330 2024-09-13T17:15:17.557 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/oss/ESS 2024-09-13T17:15:17.559 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/oss/ESS1868 2024-09-13T17:15:17.561 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/oss/Introduction 2024-09-13T17:15:17.563 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/oss/MultiSound 2024-09-13T17:15:17.566 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/oss/OPL3 2024-09-13T17:15:17.568 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/oss/Opti 2024-09-13T17:15:17.729 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/oss/PAS16 2024-09-13T17:15:17.731 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/oss/PSS 2024-09-13T17:15:17.733 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/oss/PSS-updates 2024-09-13T17:15:17.735 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/oss/README.OSS 2024-09-13T17:15:17.739 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/oss/README.modules 2024-09-13T17:15:17.741 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/oss/README.ymfsb 2024-09-13T17:15:17.743 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/oss/SoundPro 2024-09-13T17:15:17.745 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/oss/Soundblaster 2024-09-13T17:15:17.747 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/oss/Tropez+ 2024-09-13T17:15:17.749 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/oss/VIBRA16 2024-09-13T17:15:17.751 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/oss/WaveArtist 2024-09-13T17:15:17.753 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/oss/btaudio 2024-09-13T17:15:17.755 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/oss/mwave 2024-09-13T17:15:17.757 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/oss/oss-parameters.txt 2024-09-13T17:15:17.759 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sound/oss/ultrasound 2024-09-13T17:15:17.761 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sparse.txt 2024-09-13T17:15:17.764 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/spi/ 2024-09-13T17:15:17.765 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/spi/.gitignore 2024-09-13T17:15:17.767 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/spi/00-INDEX 2024-09-13T17:15:17.769 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/spi/Makefile 2024-09-13T17:15:17.771 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/spi/butterfly 2024-09-13T17:15:17.773 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/spi/ep93xx_spi 2024-09-13T17:15:17.775 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/spi/pxa2xx 2024-09-13T17:15:17.777 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/spi/spi-lm70llp 2024-09-13T17:15:17.778 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/spi/spi-sc18is602 2024-09-13T17:15:17.780 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/spi/spi-summary 2024-09-13T17:15:17.783 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/spi/spidev 2024-09-13T17:15:17.785 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/spi/spidev_fdx.c 2024-09-13T17:15:17.787 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/spi/spidev_test.c 2024-09-13T17:15:17.789 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/stable_api_nonsense.txt 2024-09-13T17:15:17.791 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/stable_kernel_rules.txt 2024-09-13T17:15:17.793 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/static-keys.txt 2024-09-13T17:15:17.795 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/svga.txt 2024-09-13T17:15:17.797 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sysctl/ 2024-09-13T17:15:17.799 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sysctl/00-INDEX 2024-09-13T17:15:17.801 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sysctl/README 2024-09-13T17:15:17.803 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sysctl/abi.txt 2024-09-13T17:15:17.805 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sysctl/fs.txt 2024-09-13T17:15:17.808 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sysctl/kernel.txt 2024-09-13T17:15:17.810 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sysctl/net.txt 2024-09-13T17:15:17.812 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sysctl/sunrpc.txt 2024-09-13T17:15:17.814 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sysctl/vm.txt 2024-09-13T17:15:17.816 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sysfs-rules.txt 2024-09-13T17:15:17.819 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/sysrq.txt 2024-09-13T17:15:17.821 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/target/ 2024-09-13T17:15:17.823 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.py 2024-09-13T17:15:17.826 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.txt 2024-09-13T17:15:17.828 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/target/tcmu-design.txt 2024-09-13T17:15:17.830 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/thermal/ 2024-09-13T17:15:17.832 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/thermal/cpu-cooling-api.txt 2024-09-13T17:15:17.834 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal 2024-09-13T17:15:17.836 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal_emulation 2024-09-13T17:15:17.838 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/thermal/intel_powerclamp.txt 2024-09-13T17:15:17.841 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/thermal/nouveau_thermal 2024-09-13T17:15:17.843 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/thermal/sysfs-api.txt 2024-09-13T17:15:17.845 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/thermal/x86_pkg_temperature_thermal 2024-09-13T17:15:17.847 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/this_cpu_ops.txt 2024-09-13T17:15:17.850 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/timers/ 2024-09-13T17:15:17.852 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/timers/.gitignore 2024-09-13T17:15:17.853 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/timers/00-INDEX 2024-09-13T17:15:17.855 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/timers/Makefile 2024-09-13T17:15:17.857 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/timers/NO_HZ.txt 2024-09-13T17:15:17.859 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/timers/highres.txt 2024-09-13T17:15:17.862 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/timers/hpet.txt 2024-09-13T17:15:17.864 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/timers/hpet_example.c 2024-09-13T17:15:17.866 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/timers/hrtimers.txt 2024-09-13T17:15:17.868 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/timers/timekeeping.txt 2024-09-13T17:15:17.870 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/timers/timer_stats.txt 2024-09-13T17:15:17.873 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/timers/timers-howto.txt 2024-09-13T17:15:17.874 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/tpm/ 2024-09-13T17:15:17.877 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/tpm/xen-tpmfront.txt 2024-09-13T17:15:17.879 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/trace/ 2024-09-13T17:15:17.881 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/trace/coresight.txt 2024-09-13T17:15:17.883 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/trace/events-kmem.txt 2024-09-13T17:15:17.885 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/trace/events-nmi.txt 2024-09-13T17:15:17.887 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/trace/events-power.txt 2024-09-13T17:15:17.889 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/trace/events.txt 2024-09-13T17:15:17.891 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/trace/ftrace-design.txt 2024-09-13T17:15:17.894 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/trace/ftrace.txt 2024-09-13T17:15:17.898 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/trace/function-graph-fold.vim 2024-09-13T17:15:17.901 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/trace/kprobetrace.txt 2024-09-13T17:15:17.903 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/trace/mmiotrace.txt 2024-09-13T17:15:17.905 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/trace/postprocess/ 2024-09-13T17:15:17.907 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-pagealloc-postprocess.pl 2024-09-13T17:15:17.910 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-vmscan-postprocess.pl 2024-09-13T17:15:17.912 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/trace/ring-buffer-design.txt 2024-09-13T17:15:17.915 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/trace/tracepoint-analysis.txt 2024-09-13T17:15:17.917 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/trace/tracepoints.txt 2024-09-13T17:15:17.919 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/trace/uprobetracer.txt 2024-09-13T17:15:17.921 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/unaligned-memory-access.txt 2024-09-13T17:15:17.924 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/unicode.txt 2024-09-13T17:15:17.926 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/unshare.txt 2024-09-13T17:15:17.928 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/ 2024-09-13T17:15:17.930 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/CREDITS 2024-09-13T17:15:17.932 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/URB.txt 2024-09-13T17:15:17.934 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/WUSB-Design-overview.txt 2024-09-13T17:15:17.937 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/acm.txt 2024-09-13T17:15:17.939 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/anchors.txt 2024-09-13T17:15:17.940 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/authorization.txt 2024-09-13T17:15:17.942 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/bulk-streams.txt 2024-09-13T17:15:17.950 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/callbacks.txt 2024-09-13T17:15:17.950 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/chipidea.txt 2024-09-13T17:15:17.950 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/dma.txt 2024-09-13T17:15:17.951 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/dwc3.txt 2024-09-13T17:15:17.953 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/ehci.txt 2024-09-13T17:15:17.955 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/error-codes.txt 2024-09-13T17:15:17.957 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/functionfs.txt 2024-09-13T17:15:17.959 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/gadget-testing.txt 2024-09-13T17:15:17.961 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/gadget_configfs.txt 2024-09-13T17:15:17.963 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/gadget_hid.txt 2024-09-13T17:15:17.966 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/gadget_multi.txt 2024-09-13T17:15:17.968 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/gadget_printer.txt 2024-09-13T17:15:17.970 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/gadget_serial.txt 2024-09-13T17:15:17.972 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/hotplug.txt 2024-09-13T17:15:17.974 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/iuu_phoenix.txt 2024-09-13T17:15:17.975 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/linux-cdc-acm.inf 2024-09-13T17:15:17.977 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/linux.inf 2024-09-13T17:15:17.979 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/mass-storage.txt 2024-09-13T17:15:17.981 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/misc_usbsevseg.txt 2024-09-13T17:15:17.983 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/mtouchusb.txt 2024-09-13T17:15:17.985 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/ohci.txt 2024-09-13T17:15:17.987 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/persist.txt 2024-09-13T17:15:17.989 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/power-management.txt 2024-09-13T17:15:17.992 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/proc_usb_info.txt 2024-09-13T17:15:17.993 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/rio.txt 2024-09-13T17:15:17.996 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/usb-help.txt 2024-09-13T17:15:17.997 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/usb-serial.txt 2024-09-13T17:15:18.000 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/usbmon.txt 2024-09-13T17:15:18.002 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/usb/wusb-cbaf 2024-09-13T17:15:18.004 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/vDSO/ 2024-09-13T17:15:18.007 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/vDSO/.gitignore 2024-09-13T17:15:18.008 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/vDSO/Makefile 2024-09-13T17:15:18.010 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/vDSO/parse_vdso.c 2024-09-13T17:15:18.012 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/vDSO/vdso_standalone_test_x86.c 2024-09-13T17:15:18.014 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/vDSO/vdso_test.c 2024-09-13T17:15:18.016 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/vfio.txt 2024-09-13T17:15:18.019 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/vgaarbiter.txt 2024-09-13T17:15:18.021 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video-output.txt 2024-09-13T17:15:18.023 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/ 2024-09-13T17:15:18.025 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/4CCs.txt 2024-09-13T17:15:18.028 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/API.html 2024-09-13T17:15:18.029 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.au0828 2024-09-13T17:15:18.031 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.bttv 2024-09-13T17:15:18.033 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx23885 2024-09-13T17:15:18.035 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx88 2024-09-13T17:15:18.037 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.em28xx 2024-09-13T17:15:18.039 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.ivtv 2024-09-13T17:15:18.041 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7134 2024-09-13T17:15:18.042 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7164 2024-09-13T17:15:18.045 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tm6000 2024-09-13T17:15:18.047 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tuner 2024-09-13T17:15:18.049 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.usbvision 2024-09-13T17:15:18.051 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/Makefile 2024-09-13T17:15:18.053 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/README.cpia2 2024-09-13T17:15:18.055 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/README.cx88 2024-09-13T17:15:18.057 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/README.davinci-vpbe 2024-09-13T17:15:18.058 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/README.ir 2024-09-13T17:15:18.060 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/README.ivtv 2024-09-13T17:15:18.062 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/README.pvrusb2 2024-09-13T17:15:18.065 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/README.saa7134 2024-09-13T17:15:18.067 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/Zoran 2024-09-13T17:15:18.069 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/bttv/ 2024-09-13T17:15:18.071 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/bttv/CONTRIBUTORS 2024-09-13T17:15:18.073 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/bttv/Cards 2024-09-13T17:15:18.075 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/bttv/ICs 2024-09-13T17:15:18.077 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/bttv/Insmod-options 2024-09-13T17:15:18.079 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/bttv/MAKEDEV 2024-09-13T17:15:18.081 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modprobe.conf 2024-09-13T17:15:18.083 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modules.conf 2024-09-13T17:15:18.085 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/bttv/PROBLEMS 2024-09-13T17:15:18.086 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/bttv/README 2024-09-13T17:15:18.088 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.WINVIEW 2024-09-13T17:15:18.090 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.freeze 2024-09-13T17:15:18.093 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.quirks 2024-09-13T17:15:18.095 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/bttv/Sound-FAQ 2024-09-13T17:15:18.097 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/bttv/Specs 2024-09-13T17:15:18.098 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/bttv/THANKS 2024-09-13T17:15:18.100 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/bttv/Tuners 2024-09-13T17:15:18.102 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/cafe_ccic 2024-09-13T17:15:18.105 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/cpia2_overview.txt 2024-09-13T17:15:18.106 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/cx18.txt 2024-09-13T17:15:18.108 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/ 2024-09-13T17:15:18.109 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.hm12 2024-09-13T17:15:18.112 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.vbi 2024-09-13T17:15:18.114 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-calling.txt 2024-09-13T17:15:18.115 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-api.txt 2024-09-13T17:15:18.118 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-regs.txt 2024-09-13T17:15:18.120 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-dma.txt 2024-09-13T17:15:18.122 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-encoder-api.txt 2024-09-13T17:15:18.125 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-memory.txt 2024-09-13T17:15:18.126 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-osd-api.txt 2024-09-13T17:15:18.128 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-upload.txt 2024-09-13T17:15:18.130 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/cx88/ 2024-09-13T17:15:18.133 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/cx88/hauppauge-wintv-cx88-ir.txt 2024-09-13T17:15:18.135 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/extract_xc3028.pl 2024-09-13T17:15:18.139 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/fimc.txt 2024-09-13T17:15:18.141 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/gspca.txt 2024-09-13T17:15:18.144 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/hauppauge-wintv-cx88-ir.txt 2024-09-13T17:15:18.146 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/lifeview.txt 2024-09-13T17:15:18.148 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/meye.txt 2024-09-13T17:15:18.153 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/not-in-cx2388x-datasheet.txt 2024-09-13T17:15:18.153 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/omap3isp.txt 2024-09-13T17:15:18.154 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/omap4_camera.txt 2024-09-13T17:15:18.156 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/pxa_camera.txt 2024-09-13T17:15:18.158 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/radiotrack.txt 2024-09-13T17:15:18.161 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/sh_mobile_ceu_camera.txt 2024-09-13T17:15:18.162 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/si470x.txt 2024-09-13T17:15:18.165 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/si4713.txt 2024-09-13T17:15:18.167 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/si476x.txt 2024-09-13T17:15:18.169 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/soc-camera.txt 2024-09-13T17:15:18.171 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/uvcvideo.txt 2024-09-13T17:15:18.173 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/v4l2-controls.txt 2024-09-13T17:15:18.176 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/v4l2-framework.txt 2024-09-13T17:15:18.179 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/v4l2-pci-skeleton.c 2024-09-13T17:15:18.181 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/videobuf 2024-09-13T17:15:18.184 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/vivid.txt 2024-09-13T17:15:18.187 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/video4linux/zr364xx.txt 2024-09-13T17:15:18.189 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/virtual/ 2024-09-13T17:15:18.191 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/virtual/00-INDEX 2024-09-13T17:15:18.193 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/virtual/kvm/ 2024-09-13T17:15:18.195 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/virtual/kvm/00-INDEX 2024-09-13T17:15:18.197 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/virtual/kvm/api.txt 2024-09-13T17:15:18.201 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/virtual/kvm/cpuid.txt 2024-09-13T17:15:18.203 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/ 2024-09-13T17:15:18.205 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/README 2024-09-13T17:15:18.207 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/arm-vgic.txt 2024-09-13T17:15:18.209 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/mpic.txt 2024-09-13T17:15:18.211 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/s390_flic.txt 2024-09-13T17:15:18.213 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vfio.txt 2024-09-13T17:15:18.215 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vm.txt 2024-09-13T17:15:18.217 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/xics.txt 2024-09-13T17:15:18.219 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/virtual/kvm/hypercalls.txt 2024-09-13T17:15:18.222 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/virtual/kvm/locking.txt 2024-09-13T17:15:18.223 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/virtual/kvm/mmu.txt 2024-09-13T17:15:18.226 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/virtual/kvm/msr.txt 2024-09-13T17:15:18.228 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/virtual/kvm/nested-vmx.txt 2024-09-13T17:15:18.230 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/virtual/kvm/ppc-pv.txt 2024-09-13T17:15:18.232 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/virtual/kvm/review-checklist.txt 2024-09-13T17:15:18.234 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/virtual/kvm/s390-diag.txt 2024-09-13T17:15:18.236 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/virtual/kvm/timekeeping.txt 2024-09-13T17:15:18.238 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/virtual/paravirt_ops.txt 2024-09-13T17:15:18.241 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/virtual/uml/ 2024-09-13T17:15:18.242 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/virtual/uml/UserModeLinux-HOWTO.txt 2024-09-13T17:15:18.247 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/vm/ 2024-09-13T17:15:18.249 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/vm/.gitignore 2024-09-13T17:15:18.251 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/vm/00-INDEX 2024-09-13T17:15:18.253 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/vm/active_mm.txt 2024-09-13T17:15:18.255 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/vm/balance 2024-09-13T17:15:18.257 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/vm/cleancache.txt 2024-09-13T17:15:18.259 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/vm/frontswap.txt 2024-09-13T17:15:18.261 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/vm/highmem.txt 2024-09-13T17:15:18.264 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/vm/hugetlbpage.txt 2024-09-13T17:15:18.266 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/vm/hwpoison.txt 2024-09-13T17:15:18.268 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/vm/ksm.txt 2024-09-13T17:15:18.271 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/vm/numa 2024-09-13T17:15:18.273 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/vm/numa_memory_policy.txt 2024-09-13T17:15:18.275 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/vm/overcommit-accounting 2024-09-13T17:15:18.277 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/vm/page_migration 2024-09-13T17:15:18.279 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/vm/page_owner.txt 2024-09-13T17:15:18.281 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/vm/pagemap.txt 2024-09-13T17:15:18.283 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/vm/remap_file_pages.txt 2024-09-13T17:15:18.285 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/vm/slub.txt 2024-09-13T17:15:18.288 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/vm/soft-dirty.txt 2024-09-13T17:15:18.290 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/vm/split_page_table_lock 2024-09-13T17:15:18.292 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/vm/transhuge.txt 2024-09-13T17:15:18.294 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/vm/unevictable-lru.txt 2024-09-13T17:15:18.297 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/vm/zswap.txt 2024-09-13T17:15:18.299 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/vme_api.txt 2024-09-13T17:15:18.301 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/volatile-considered-harmful.txt 2024-09-13T17:15:18.304 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/w1/ 2024-09-13T17:15:18.305 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/w1/00-INDEX 2024-09-13T17:15:18.307 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/w1/masters/ 2024-09-13T17:15:18.309 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/w1/masters/00-INDEX 2024-09-13T17:15:18.311 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/w1/masters/ds2482 2024-09-13T17:15:18.313 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/w1/masters/ds2490 2024-09-13T17:15:18.315 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/w1/masters/mxc-w1 2024-09-13T17:15:18.317 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/w1/masters/omap-hdq 2024-09-13T17:15:18.319 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/w1/masters/w1-gpio 2024-09-13T17:15:18.321 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/w1/slaves/ 2024-09-13T17:15:18.323 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/w1/slaves/00-INDEX 2024-09-13T17:15:18.325 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2406 2024-09-13T17:15:18.327 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2423 2024-09-13T17:15:18.329 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds28e04 2024-09-13T17:15:18.331 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/w1/slaves/w1_therm 2024-09-13T17:15:18.333 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/w1/w1.generic 2024-09-13T17:15:18.336 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/w1/w1.netlink 2024-09-13T17:15:18.338 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/watchdog/ 2024-09-13T17:15:18.340 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/watchdog/Makefile 2024-09-13T17:15:18.342 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/watchdog/convert_drivers_to_kernel_api.txt 2024-09-13T17:15:18.344 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/watchdog/hpwdt.txt 2024-09-13T17:15:18.346 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/watchdog/pcwd-watchdog.txt 2024-09-13T17:15:18.348 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/watchdog/src/ 2024-09-13T17:15:18.350 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/watchdog/src/.gitignore 2024-09-13T17:15:18.352 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/watchdog/src/Makefile 2024-09-13T17:15:18.356 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-simple.c 2024-09-13T17:15:18.357 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-test.c 2024-09-13T17:15:18.358 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/watchdog/watchdog-api.txt 2024-09-13T17:15:18.361 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/watchdog/watchdog-kernel-api.txt 2024-09-13T17:15:18.363 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/watchdog/watchdog-parameters.txt 2024-09-13T17:15:18.366 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/watchdog/wdt.txt 2024-09-13T17:15:18.368 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/wimax/ 2024-09-13T17:15:18.370 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/wimax/README.i2400m 2024-09-13T17:15:18.372 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/wimax/README.wimax 2024-09-13T17:15:18.374 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/workqueue.txt 2024-09-13T17:15:18.377 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/x86/ 2024-09-13T17:15:18.378 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/x86/00-INDEX 2024-09-13T17:15:18.380 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/x86/boot.txt 2024-09-13T17:15:18.383 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/x86/early-microcode.txt 2024-09-13T17:15:18.386 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/x86/earlyprintk.txt 2024-09-13T17:15:18.388 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/x86/entry_64.txt 2024-09-13T17:15:18.390 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/x86/exception-tables.txt 2024-09-13T17:15:18.393 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/x86/i386/ 2024-09-13T17:15:18.394 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/x86/i386/IO-APIC.txt 2024-09-13T17:15:18.397 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/x86/intel_mpx.txt 2024-09-13T17:15:18.399 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/x86/mtrr.txt 2024-09-13T17:15:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.398+0000 7f83efe12640 1 -- 172.21.15.87:0/3040032753 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83e80feff0 msgr2=0x7f83e80ff430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.398+0000 7f83efe12640 1 --2- 172.21.15.87:0/3040032753 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83e80feff0 0x7f83e80ff430 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f83e4009930 tx=0x7f83e402a420 comp rx=0 tx=0).stop 2024-09-13T17:15:18.400 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.398+0000 7f83efe12640 1 -- 172.21.15.87:0/3040032753 shutdown_connections 2024-09-13T17:15:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.398+0000 7f83efe12640 1 --2- 172.21.15.87:0/3040032753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83e80ff970 0x7f83e810ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.398+0000 7f83efe12640 1 --2- 172.21.15.87:0/3040032753 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83e80feff0 0x7f83e80ff430 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.398+0000 7f83efe12640 1 --2- 172.21.15.87:0/3040032753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83e8104c30 0x7f83e8105010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.398+0000 7f83efe12640 1 -- 172.21.15.87:0/3040032753 >> 172.21.15.87:0/3040032753 conn(0x7f83e8074940 msgr2=0x7f83e8074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.398+0000 7f83efe12640 1 -- 172.21.15.87:0/3040032753 shutdown_connections 2024-09-13T17:15:18.401 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.398+0000 7f83efe12640 1 -- 172.21.15.87:0/3040032753 wait complete. 2024-09-13T17:15:18.403 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.399+0000 7f83efe12640 1 Processor -- start 2024-09-13T17:15:18.403 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.399+0000 7f83efe12640 1 -- start start 2024-09-13T17:15:18.403 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.399+0000 7f83efe12640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83e80feff0 0x7f83e81970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:18.403 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.399+0000 7f83efe12640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83e80ff970 0x7f83e8197610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:18.403 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.399+0000 7f83efe12640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83e8104c30 0x7f83e81a2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:18.403 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.399+0000 7f83efe12640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e8197e50 con 0x7f83e80ff970 2024-09-13T17:15:18.403 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.399+0000 7f83efe12640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e81a2690 con 0x7f83e8104c30 2024-09-13T17:15:18.403 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.399+0000 7f83efe12640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e81a27d0 con 0x7f83e80feff0 2024-09-13T17:15:18.403 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.399+0000 7f83ed3ad640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83e80ff970 0x7f83e8197610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:18.403 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.399+0000 7f83ed3ad640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83e80ff970 0x7f83e8197610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47390/0 (socket says 172.21.15.87:47390) 2024-09-13T17:15:18.403 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.399+0000 7f83ed3ad640 1 -- 172.21.15.87:0/3226294224 learned_addr learned my addr 172.21.15.87:0/3226294224 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:18.404 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.399+0000 7f83edbae640 1 --2- 172.21.15.87:0/3226294224 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83e80feff0 0x7f83e81970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:18.404 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.399+0000 7f83ee3af640 1 --2- 172.21.15.87:0/3226294224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83e8104c30 0x7f83e81a2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:18.404 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.400+0000 7f83ee3af640 1 -- 172.21.15.87:0/3226294224 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83e80feff0 msgr2=0x7f83e81970d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:18.404 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.400+0000 7f83ee3af640 1 --2- 172.21.15.87:0/3226294224 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83e80feff0 0x7f83e81970d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:18.404 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.400+0000 7f83ee3af640 1 -- 172.21.15.87:0/3226294224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83e80ff970 msgr2=0x7f83e8197610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:18.404 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.400+0000 7f83ee3af640 1 --2- 172.21.15.87:0/3226294224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83e80ff970 0x7f83e8197610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:18.404 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.400+0000 7f83ee3af640 1 -- 172.21.15.87:0/3226294224 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e4009560 con 0x7f83e8104c30 2024-09-13T17:15:18.404 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.400+0000 7f83ed3ad640 1 --2- 172.21.15.87:0/3226294224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83e80ff970 0x7f83e8197610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:15:18.404 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.400+0000 7f83ee3af640 1 --2- 172.21.15.87:0/3226294224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83e8104c30 0x7f83e81a2150 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f83e0009fd0 tx=0x7f83e000ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:18.404 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.400+0000 7f83deffd640 1 -- 172.21.15.87:0/3226294224 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e000ce20 con 0x7f83e8104c30 2024-09-13T17:15:18.404 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.400+0000 7f83deffd640 1 -- 172.21.15.87:0/3226294224 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f83e0005020 con 0x7f83e8104c30 2024-09-13T17:15:18.404 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.400+0000 7f83efe12640 1 -- 172.21.15.87:0/3226294224 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83e81a2a30 con 0x7f83e8104c30 2024-09-13T17:15:18.405 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/x86/pat.txt 2024-09-13T17:15:18.405 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.400+0000 7f83deffd640 1 -- 172.21.15.87:0/3226294224 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e0010690 con 0x7f83e8104c30 2024-09-13T17:15:18.405 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.400+0000 7f83efe12640 1 -- 172.21.15.87:0/3226294224 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e81a2ef0 con 0x7f83e8104c30 2024-09-13T17:15:18.405 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/x86/tlb.txt 2024-09-13T17:15:18.407 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.403+0000 7f83deffd640 1 -- 172.21.15.87:0/3226294224 <== mon.2 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 25) v1 ==== 136106+0+0 (secure 0 0 0) 0x7f83e0005190 con 0x7f83e8104c30 2024-09-13T17:15:18.407 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.404+0000 7f83f2c13740 1 Processor -- start 2024-09-13T17:15:18.407 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.404+0000 7f83f2c13740 1 -- start start 2024-09-13T17:15:18.407 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.404+0000 7f83f2c13740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fa9df7d0d0 0x55fa9df7d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:18.407 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.404+0000 7f83f2c13740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa9df7da80 0x55fa9df810d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:18.408 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.404+0000 7f83f2c13740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa9df816f0 0x55fa9df81b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:18.408 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.404+0000 7f83f2c13740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa9dedec30 con 0x55fa9df7d0d0 2024-09-13T17:15:18.408 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.404+0000 7f83f2c13740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa9dedc3c0 con 0x55fa9df7da80 2024-09-13T17:15:18.408 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.404+0000 7f83f2c13740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa9ded7cb0 con 0x55fa9df816f0 2024-09-13T17:15:18.408 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.405+0000 7f83edbae640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa9df7da80 0x55fa9df810d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:18.408 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.405+0000 7f83edbae640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa9df7da80 0x55fa9df810d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.87:36040/0 (socket says 172.21.15.87:36040) 2024-09-13T17:15:18.408 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.405+0000 7f83edbae640 1 -- 172.21.15.87:0/4249192344 learned_addr learned my addr 172.21.15.87:0/4249192344 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:18.408 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.405+0000 7f83ed3ad640 1 --2- 172.21.15.87:0/4249192344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fa9df7d0d0 0x55fa9df7d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:18.408 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.405+0000 7f83deffd640 1 --2- 172.21.15.87:0/3226294224 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f83d40a13a0 0x7f83d40a3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:18.408 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.405+0000 7f83ed3ad640 1 --2- 172.21.15.87:0/4249192344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa9df816f0 0x55fa9df81b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:18.408 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.405+0000 7f83ed3ad640 1 -- 172.21.15.87:0/4249192344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa9df816f0 msgr2=0x55fa9df81b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:18.408 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.405+0000 7f83ed3ad640 1 --2- 172.21.15.87:0/4249192344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa9df816f0 0x55fa9df81b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:18.408 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.405+0000 7f83ed3ad640 1 -- 172.21.15.87:0/4249192344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa9df7da80 msgr2=0x55fa9df810d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:18.409 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.405+0000 7f83ed3ad640 1 --2- 172.21.15.87:0/4249192344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa9df7da80 0x55fa9df810d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:18.409 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.405+0000 7f83ed3ad640 1 -- 172.21.15.87:0/4249192344 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa9de7e910 con 0x55fa9df7d0d0 2024-09-13T17:15:18.409 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.405+0000 7f83ee3af640 1 --2- 172.21.15.87:0/3226294224 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f83d40a13a0 0x7f83d40a3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:18.409 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.405+0000 7f83edbae640 1 --2- 172.21.15.87:0/4249192344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa9df7da80 0x55fa9df810d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:15:18.409 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.405+0000 7f83deffd640 1 -- 172.21.15.87:0/3226294224 <== mon.2 v2:172.21.15.118:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f83e0014070 con 0x7f83e8104c30 2024-09-13T17:15:18.409 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.405+0000 7f83ed3ad640 1 --2- 172.21.15.87:0/4249192344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fa9df7d0d0 0x55fa9df7d4b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f83e4000c00 tx=0x7f83e4005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb812d45cd8911d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:18.409 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.405+0000 7f83d3fff640 1 -- 172.21.15.87:0/4249192344 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e4003ae0 con 0x55fa9df7d0d0 2024-09-13T17:15:18.409 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.405+0000 7f83d3fff640 1 -- 172.21.15.87:0/4249192344 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f83e4003c40 con 0x55fa9df7d0d0 2024-09-13T17:15:18.409 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.405+0000 7f83ee3af640 1 --2- 172.21.15.87:0/3226294224 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f83d40a13a0 0x7f83d40a3860 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f83e00caca0 tx=0x7f83e00cacd0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:18.409 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.405+0000 7f83d3fff640 1 -- 172.21.15.87:0/4249192344 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e403b450 con 0x55fa9df7d0d0 2024-09-13T17:15:18.410 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/x86/usb-legacy-support.txt 2024-09-13T17:15:18.412 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.406+0000 7f83f2c13740 1 -- 172.21.15.87:0/4249192344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fa9df7d0d0 msgr2=0x55fa9df7d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:18.412 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.406+0000 7f83f2c13740 1 --2- 172.21.15.87:0/4249192344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fa9df7d0d0 0x55fa9df7d4b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f83e4000c00 tx=0x7f83e4005b50 comp rx=0 tx=0).stop 2024-09-13T17:15:18.412 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.406+0000 7f83f2c13740 1 -- 172.21.15.87:0/4249192344 shutdown_connections 2024-09-13T17:15:18.412 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.406+0000 7f83f2c13740 1 --2- 172.21.15.87:0/4249192344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa9df816f0 0x55fa9df81b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:18.412 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.406+0000 7f83f2c13740 1 --2- 172.21.15.87:0/4249192344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa9df7da80 0x55fa9df810d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:18.412 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.406+0000 7f83f2c13740 1 --2- 172.21.15.87:0/4249192344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fa9df7d0d0 0x55fa9df7d4b0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:18.413 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.406+0000 7f83f2c13740 1 -- 172.21.15.87:0/4249192344 >> 172.21.15.87:0/4249192344 conn(0x55fa9df73250 msgr2=0x55fa9df6f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:18.413 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.407+0000 7f83f2c13740 1 -- 172.21.15.87:0/4249192344 shutdown_connections 2024-09-13T17:15:18.413 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.407+0000 7f83f2c13740 1 -- 172.21.15.87:0/4249192344 wait complete. 2024-09-13T17:15:18.413 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.407+0000 7f83f2c13740 1 -- start start 2024-09-13T17:15:18.413 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.407+0000 7f83f2c13740 1 Processor -- start 2024-09-13T17:15:18.413 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.407+0000 7f83f2c13740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa9df7da80 0x55fa9df86270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:18.413 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.407+0000 7f83f2c13740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fa9df816f0 0x55fa9df867b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:18.413 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.407+0000 7f83f2c13740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa9df86cf0 0x55fa9df92a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:18.413 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.407+0000 7f83f2c13740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa9de95e80 con 0x55fa9df816f0 2024-09-13T17:15:18.413 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.407+0000 7f83f2c13740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa9de95b20 con 0x55fa9df7da80 2024-09-13T17:15:18.413 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.407+0000 7f83f2c13740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa9de5b260 con 0x55fa9df86cf0 2024-09-13T17:15:18.413 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.407+0000 7f83f2c13740 10 client.0 _ll_register_callbacks cb 0x55fa9de90df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:18.413 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.408+0000 7f83ed3ad640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa9df7da80 0x55fa9df86270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:18.414 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.408+0000 7f83edbae640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fa9df816f0 0x55fa9df867b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:18.414 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.408+0000 7f83ed3ad640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa9df7da80 0x55fa9df86270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.87:36044/0 (socket says 172.21.15.87:36044) 2024-09-13T17:15:18.414 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.408+0000 7f83ed3ad640 1 -- 172.21.15.87:0/3752766584 learned_addr learned my addr 172.21.15.87:0/3752766584 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:18.414 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.408+0000 7f83ed3ad640 1 --2- 172.21.15.87:0/3752766584 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa9df86cf0 0x55fa9df92a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:18.414 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.408+0000 7f83edbae640 1 -- 172.21.15.87:0/3752766584 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa9df86cf0 msgr2=0x55fa9df92a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:18.414 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.408+0000 7f83edbae640 1 --2- 172.21.15.87:0/3752766584 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa9df86cf0 0x55fa9df92a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:18.414 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.408+0000 7f83edbae640 1 -- 172.21.15.87:0/3752766584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa9df7da80 msgr2=0x55fa9df86270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:18.414 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.408+0000 7f83edbae640 1 --2- 172.21.15.87:0/3752766584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa9df7da80 0x55fa9df86270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:18.414 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.408+0000 7f83edbae640 1 -- 172.21.15.87:0/3752766584 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e4045040 con 0x55fa9df816f0 2024-09-13T17:15:18.414 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.408+0000 7f83ed3ad640 1 --2- 172.21.15.87:0/3752766584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa9df7da80 0x55fa9df86270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:15:18.414 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/x86/x86_64/ 2024-09-13T17:15:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.408+0000 7f83edbae640 1 --2- 172.21.15.87:0/3752766584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fa9df816f0 0x55fa9df867b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f83d80126d0 tx=0x7f83d8012b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=803e8d859482882e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.408+0000 7f83d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:15:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.408+0000 7f83d17fa640 1 -- 172.21.15.87:0/3752766584 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d8017070 con 0x55fa9df816f0 2024-09-13T17:15:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.408+0000 7f83d17fa640 1 -- 172.21.15.87:0/3752766584 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f83d8004050 con 0x55fa9df816f0 2024-09-13T17:15:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.408+0000 7f83f2c13740 1 -- 172.21.15.87:0/3752766584 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fa9df00680 con 0x55fa9df816f0 2024-09-13T17:15:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.408+0000 7f83d17fa640 1 -- 172.21.15.87:0/3752766584 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83d8004210 con 0x55fa9df816f0 2024-09-13T17:15:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.408+0000 7f83f2c13740 10 client.16107 fetch_fsmap learned FSMap version 25 2024-09-13T17:15:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.408+0000 7f83f2c13740 1 -- 172.21.15.87:0/3752766584 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55fa9ded6330 con 0x55fa9df816f0 2024-09-13T17:15:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.409+0000 7f83d17fa640 1 -- 172.21.15.87:0/3752766584 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55fa9df00680 con 0x55fa9df816f0 2024-09-13T17:15:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.409+0000 7f83d17fa640 1 -- 172.21.15.87:0/3752766584 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 25) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f83d80038f0 con 0x55fa9df816f0 2024-09-13T17:15:18.416 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.409+0000 7f83f2c13740 10 client.16107 fetch_fsmap finished waiting for FSMap version 25 2024-09-13T17:15:18.417 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.409+0000 7f83f2c13740 10 client.16107 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-13T17:15:18.417 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.409+0000 7f83f2c13740 20 client.16107 populate_metadata read hostname 'smithi087' 2024-09-13T17:15:18.417 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.409+0000 7f83f2c13740 1 --2- 172.21.15.87:0/3752766584 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55fa9df96c80 0x55fa9df990a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:18.417 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.409+0000 7f83f2c13740 4 client.16107 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:15:18.417 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.409+0000 7f83f2c13740 1 -- 172.21.15.87:0/3752766584 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fa9decb5d0 con 0x55fa9df96c80 2024-09-13T17:15:18.417 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.409+0000 7f83ed3ad640 1 --2- 172.21.15.87:0/3752766584 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55fa9df96c80 0x55fa9df990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:18.417 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.410+0000 7f83ed3ad640 1 --2- 172.21.15.87:0/3752766584 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55fa9df96c80 0x55fa9df990a0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc5cf8894611a6c6 server_cookie=dabb903fb50be35b in_seq=0 out_seq=0 2024-09-13T17:15:18.417 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.410+0000 7f83d17fa640 10 client.16107 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:18.417 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/x86/x86_64/00-INDEX 2024-09-13T17:15:18.418 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.410+0000 7f83d17fa640 1 -- 172.21.15.87:0/3752766584 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55fa9decb5d0 con 0x55fa9df96c80 2024-09-13T17:15:18.418 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.410+0000 7f83d17fa640 10 client.16107 handle_command_reply: tid=0 2024-09-13T17:15:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.411+0000 7f83f2c13740 1 client.16107 shutdown 2024-09-13T17:15:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.411+0000 7f83f2c13740 1 -- 172.21.15.87:0/3752766584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fa9df816f0 msgr2=0x55fa9df867b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.411+0000 7f83f2c13740 1 --2- 172.21.15.87:0/3752766584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fa9df816f0 0x55fa9df867b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f83d80126d0 tx=0x7f83d8012b90 comp rx=0 tx=0).stop 2024-09-13T17:15:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.411+0000 7f83f2c13740 1 -- 172.21.15.87:0/3752766584 shutdown_connections 2024-09-13T17:15:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.411+0000 7f83f2c13740 1 --2- 172.21.15.87:0/3752766584 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55fa9df96c80 0x55fa9df990a0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.411+0000 7f83f2c13740 1 --2- 172.21.15.87:0/3752766584 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa9df86cf0 0x55fa9df92a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.411+0000 7f83d17fa640 0 client.16107 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.411+0000 7f83f2c13740 1 --2- 172.21.15.87:0/3752766584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fa9df816f0 0x55fa9df867b0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.411+0000 7f83f2c13740 1 --2- 172.21.15.87:0/3752766584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa9df7da80 0x55fa9df86270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.411+0000 7f83f2c13740 1 -- 172.21.15.87:0/3752766584 >> 172.21.15.87:0/3752766584 conn(0x55fa9df7d0d0 msgr2=0x55fa9df6eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.411+0000 7f83f2c13740 1 -- 172.21.15.87:0/3752766584 shutdown_connections 2024-09-13T17:15:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.411+0000 7f83f2c13740 1 -- 172.21.15.87:0/3752766584 wait complete. 2024-09-13T17:15:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.411+0000 7f83f2c13740 20 client.16107 trim_cache size 0 max 16384 2024-09-13T17:15:18.420 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/x86/x86_64/boot-options.txt 2024-09-13T17:15:18.420 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec 2024-09-13T17:15:18.420 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets 2024-09-13T17:15:18.420 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/x86/x86_64/kernel-stacks 2024-09-13T17:15:18.423 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/x86/x86_64/machinecheck 2024-09-13T17:15:18.425 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/x86/x86_64/mm.txt 2024-09-13T17:15:18.427 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/x86/x86_64/uefi.txt 2024-09-13T17:15:18.429 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/x86/zero-page.txt 2024-09-13T17:15:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.428+0000 7f83f2c13740 1 Processor -- start 2024-09-13T17:15:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.429+0000 7f83f2c13740 1 -- start start 2024-09-13T17:15:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.429+0000 7f83f2c13740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa9df7da80 0x55fa9df80f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.429+0000 7f83f2c13740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa9df816f0 0x55fa9df7ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.429+0000 7f83f2c13740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fa9df86cf0 0x55fa9df6f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.429+0000 7f83f2c13740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa9df7f460 con 0x55fa9df86cf0 2024-09-13T17:15:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.429+0000 7f83f2c13740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa9df9e270 con 0x55fa9df7da80 2024-09-13T17:15:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.429+0000 7f83f2c13740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa9df70430 con 0x55fa9df816f0 2024-09-13T17:15:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.429+0000 7f83ed3ad640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa9df7da80 0x55fa9df80f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.429+0000 7f83ed3ad640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fa9df86cf0 0x55fa9df6f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.429+0000 7f83edbae640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa9df816f0 0x55fa9df7ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.429+0000 7f83edbae640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa9df816f0 0x55fa9df7ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:49908/0 (socket says 172.21.15.87:49908) 2024-09-13T17:15:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.429+0000 7f83ed3ad640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa9df7da80 0x55fa9df80f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.87:36060/0 (socket says 172.21.15.87:36060) 2024-09-13T17:15:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.429+0000 7f83edbae640 1 -- 172.21.15.87:0/3204033574 learned_addr learned my addr 172.21.15.87:0/3204033574 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:18.432 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/xillybus.txt 2024-09-13T17:15:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.429+0000 7f83edbae640 1 -- 172.21.15.87:0/3204033574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa9df7da80 msgr2=0x55fa9df80f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.429+0000 7f83edbae640 1 --2- 172.21.15.87:0/3204033574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa9df7da80 0x55fa9df80f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.429+0000 7f83edbae640 1 -- 172.21.15.87:0/3204033574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fa9df86cf0 msgr2=0x55fa9df6f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.429+0000 7f83edbae640 1 --2- 172.21.15.87:0/3204033574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fa9df86cf0 0x55fa9df6f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.429+0000 7f83edbae640 1 -- 172.21.15.87:0/3204033574 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa9de78300 con 0x55fa9df816f0 2024-09-13T17:15:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.429+0000 7f83ed3ad640 1 --2- 172.21.15.87:0/3204033574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa9df7da80 0x55fa9df80f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:15:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.430+0000 7f83edbae640 1 --2- 172.21.15.87:0/3204033574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa9df816f0 0x55fa9df7ef20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f83d80059f0 tx=0x7f83d8009830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5eafca1cd33eab1b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.430+0000 7f83dcff9640 1 -- 172.21.15.87:0/3204033574 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d8017070 con 0x55fa9df816f0 2024-09-13T17:15:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.430+0000 7f83dcff9640 1 -- 172.21.15.87:0/3204033574 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f83d8003e70 con 0x55fa9df816f0 2024-09-13T17:15:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.430+0000 7f83dcff9640 1 -- 172.21.15.87:0/3204033574 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d8005070 con 0x55fa9df816f0 2024-09-13T17:15:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.431+0000 7f83f2c13740 1 -- 172.21.15.87:0/3204033574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa9df816f0 msgr2=0x55fa9df7ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.431+0000 7f83f2c13740 1 --2- 172.21.15.87:0/3204033574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa9df816f0 0x55fa9df7ef20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f83d80059f0 tx=0x7f83d8009830 comp rx=0 tx=0).stop 2024-09-13T17:15:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.431+0000 7f83f2c13740 1 -- 172.21.15.87:0/3204033574 shutdown_connections 2024-09-13T17:15:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.431+0000 7f83f2c13740 1 --2- 172.21.15.87:0/3204033574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fa9df86cf0 0x55fa9df6f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.431+0000 7f83f2c13740 1 --2- 172.21.15.87:0/3204033574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa9df816f0 0x55fa9df7ef20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.431+0000 7f83f2c13740 1 --2- 172.21.15.87:0/3204033574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa9df7da80 0x55fa9df80f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.431+0000 7f83f2c13740 1 -- 172.21.15.87:0/3204033574 >> 172.21.15.87:0/3204033574 conn(0x55fa9df7d0d0 msgr2=0x55fa9df80860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.431+0000 7f83f2c13740 1 -- 172.21.15.87:0/3204033574 shutdown_connections 2024-09-13T17:15:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.431+0000 7f83f2c13740 1 -- 172.21.15.87:0/3204033574 wait complete. 2024-09-13T17:15:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.431+0000 7f83f2c13740 1 -- start start 2024-09-13T17:15:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.431+0000 7f83f2c13740 1 Processor -- start 2024-09-13T17:15:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.432+0000 7f83f2c13740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa9df7da80 0x55fa9df8d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.432+0000 7f83f2c13740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fa9df816f0 0x55fa9df8df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.432+0000 7f83f2c13740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa9df86cf0 0x55fa9df82e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.432+0000 7f83f2c13740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa9df83520 con 0x55fa9df816f0 2024-09-13T17:15:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.432+0000 7f83ed3ad640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa9df7da80 0x55fa9df8d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:18.437 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.432+0000 7f83edbae640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fa9df816f0 0x55fa9df8df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:18.437 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.432+0000 7f83edbae640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fa9df816f0 0x55fa9df8df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47424/0 (socket says 172.21.15.87:47424) 2024-09-13T17:15:18.437 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.432+0000 7f83edbae640 1 -- 172.21.15.87:0/918047820 learned_addr learned my addr 172.21.15.87:0/918047820 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:18.437 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.432+0000 7f83f2c13740 1 -- 172.21.15.87:0/918047820 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa9df83690 con 0x55fa9df7da80 2024-09-13T17:15:18.437 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.432+0000 7f83f2c13740 1 -- 172.21.15.87:0/918047820 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa9df83850 con 0x55fa9df86cf0 2024-09-13T17:15:18.437 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.432+0000 7f83f2c13740 10 client.0 _ll_register_callbacks cb 0x7f83d8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:18.437 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.432+0000 7f83ed3ad640 1 --2- 172.21.15.87:0/918047820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa9df86cf0 0x55fa9df82e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:18.437 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.432+0000 7f83ed3ad640 1 -- 172.21.15.87:0/918047820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa9df86cf0 msgr2=0x55fa9df82e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:18.437 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.432+0000 7f83ed3ad640 1 --2- 172.21.15.87:0/918047820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa9df86cf0 0x55fa9df82e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:18.437 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.432+0000 7f83ed3ad640 1 -- 172.21.15.87:0/918047820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fa9df816f0 msgr2=0x55fa9df8df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:18.437 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.432+0000 7f83ed3ad640 1 --2- 172.21.15.87:0/918047820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fa9df816f0 0x55fa9df8df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:18.437 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.432+0000 7f83ed3ad640 1 -- 172.21.15.87:0/918047820 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e4052040 con 0x55fa9df7da80 2024-09-13T17:15:18.438 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/xtensa/ 2024-09-13T17:15:18.439 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.433+0000 7f83ed3ad640 1 --2- 172.21.15.87:0/918047820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa9df7da80 0x55fa9df8d9e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x55fa9df97060 tx=0x7f83e4042040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c492dcea79833569 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:18.439 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.433+0000 7f83d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-09-13T17:15:18.439 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.433+0000 7f83d17fa640 1 -- 172.21.15.87:0/918047820 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e40597b0 con 0x55fa9df7da80 2024-09-13T17:15:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.433+0000 7f83d17fa640 1 -- 172.21.15.87:0/918047820 <== mon.2 v2:172.21.15.118:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f83e403d650 con 0x55fa9df7da80 2024-09-13T17:15:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.433+0000 7f83f2c13740 1 -- 172.21.15.87:0/918047820 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f83e4003c40 con 0x55fa9df7da80 2024-09-13T17:15:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.433+0000 7f83d17fa640 1 -- 172.21.15.87:0/918047820 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83e4059910 con 0x55fa9df7da80 2024-09-13T17:15:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.433+0000 7f83f2c13740 10 client.25451 fetch_fsmap learned FSMap version 25 2024-09-13T17:15:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.433+0000 7f83f2c13740 1 -- 172.21.15.87:0/918047820 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7f83d8021040 con 0x55fa9df7da80 2024-09-13T17:15:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.433+0000 7f83d17fa640 1 -- 172.21.15.87:0/918047820 <== mon.2 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f83e4003c40 con 0x55fa9df7da80 2024-09-13T17:15:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.433+0000 7f83d17fa640 1 -- 172.21.15.87:0/918047820 <== mon.2 v2:172.21.15.118:3300/0 5 ==== fsmap(e 25) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f83e404a930 con 0x55fa9df7da80 2024-09-13T17:15:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.433+0000 7f83f2c13740 10 client.25451 fetch_fsmap finished waiting for FSMap version 25 2024-09-13T17:15:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.433+0000 7f83f2c13740 10 client.25451 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-13T17:15:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.433+0000 7f83f2c13740 20 client.25451 populate_metadata read hostname 'smithi087' 2024-09-13T17:15:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.433+0000 7f83f2c13740 1 --2- 172.21.15.87:0/918047820 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55fa9dfee0e0 0x55fa9dff04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.433+0000 7f83f2c13740 4 client.25451 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T17:15:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.434+0000 7f83f2c13740 1 -- 172.21.15.87:0/918047820 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fa9dbcb300 con 0x55fa9dfee0e0 2024-09-13T17:15:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.434+0000 7f83edbae640 1 --2- 172.21.15.87:0/918047820 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55fa9dfee0e0 0x55fa9dff04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.434+0000 7f83edbae640 1 --2- 172.21.15.87:0/918047820 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55fa9dfee0e0 0x55fa9dff04d0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0e9d47eab56da50 server_cookie=d48532329733c494 in_seq=0 out_seq=0 2024-09-13T17:15:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:18.434+0000 7f83d17fa640 10 client.25451 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:18.442 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/xtensa/atomctl.txt 2024-09-13T17:15:18.442 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/xtensa/mmu.txt 2024-09-13T17:15:18.442 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/xz.txt 2024-09-13T17:15:18.443 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/zh_CN/ 2024-09-13T17:15:18.446 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/zh_CN/CodingStyle 2024-09-13T17:15:18.449 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/zh_CN/HOWTO 2024-09-13T17:15:18.452 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/zh_CN/IRQ.txt 2024-09-13T17:15:18.453 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/zh_CN/SecurityBugs 2024-09-13T17:15:18.456 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingDrivers 2024-09-13T17:15:18.458 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingPatches 2024-09-13T17:15:18.461 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/zh_CN/arm/ 2024-09-13T17:15:18.462 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/zh_CN/arm/Booting 2024-09-13T17:15:18.466 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/zh_CN/arm/kernel_user_helpers.txt 2024-09-13T17:15:18.468 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/zh_CN/arm64/ 2024-09-13T17:15:18.471 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/zh_CN/arm64/booting.txt 2024-09-13T17:15:18.473 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/zh_CN/arm64/memory.txt 2024-09-13T17:15:18.475 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/zh_CN/arm64/tagged-pointers.txt 2024-09-13T17:15:18.477 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/zh_CN/basic_profiling.txt 2024-09-13T17:15:18.480 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/zh_CN/email-clients.txt 2024-09-13T17:15:18.483 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/ 2024-09-13T17:15:18.484 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/sysfs.txt 2024-09-13T17:15:18.487 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/zh_CN/gpio.txt 2024-09-13T17:15:18.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:18 smithi149 ceph-mon[35496]: pgmap v47: 129 pgs: 129 active+clean; 96 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 2.4 MiB/s wr, 220 op/s 2024-09-13T17:15:18.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:18 smithi118 ceph-mon[34374]: pgmap v47: 129 pgs: 129 active+clean; 96 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 2.4 MiB/s wr, 220 op/s 2024-09-13T17:15:18.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:18 smithi087 ceph-mon[30934]: pgmap v47: 129 pgs: 129 active+clean; 96 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 2.4 MiB/s wr, 220 op/s 2024-09-13T17:15:18.998 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/zh_CN/io_ordering.txt 2024-09-13T17:15:19.000 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/zh_CN/magic-number.txt 2024-09-13T17:15:19.002 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/zh_CN/oops-tracing.txt 2024-09-13T17:15:19.005 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/zh_CN/sparse.txt 2024-09-13T17:15:19.006 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/zh_CN/stable_api_nonsense.txt 2024-09-13T17:15:19.009 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/zh_CN/stable_kernel_rules.txt 2024-09-13T17:15:19.011 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/ 2024-09-13T17:15:19.012 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/omap3isp.txt 2024-09-13T17:15:19.015 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/v4l2-framework.txt 2024-09-13T17:15:19.017 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/zh_CN/volatile-considered-harmful.txt 2024-09-13T17:15:19.020 INFO:tasks.workunit.client.0.smithi087.stdout:linux-4.0.5/Documentation/zorro.txt 2024-09-13T17:15:19.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:19 smithi149 ceph-mon[35496]: pgmap v48: 129 pgs: 129 active+clean; 96 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 1.4 MiB/s wr, 206 op/s 2024-09-13T17:15:19.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:19 smithi118 ceph-mon[34374]: pgmap v48: 129 pgs: 129 active+clean; 96 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 1.4 MiB/s wr, 206 op/s 2024-09-13T17:15:19.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:19 smithi087 ceph-mon[30934]: pgmap v48: 129 pgs: 129 active+clean; 96 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 1.4 MiB/s wr, 206 op/s 2024-09-13T17:15:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:20.360+0000 7f83d17fa640 1 -- 172.21.15.87:0/918047820 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fa9dbcb300 con 0x55fa9dfee0e0 2024-09-13T17:15:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:20.360+0000 7f83d17fa640 10 client.25451 handle_command_reply: tid=0 2024-09-13T17:15:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:20.360+0000 7f83f2c13740 1 client.25451 shutdown 2024-09-13T17:15:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:20.360+0000 7f83f2c13740 1 -- 172.21.15.87:0/918047820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa9df7da80 msgr2=0x55fa9df8d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:20.360+0000 7f83f2c13740 1 --2- 172.21.15.87:0/918047820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa9df7da80 0x55fa9df8d9e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x55fa9df97060 tx=0x7f83e4042040 comp rx=0 tx=0).stop 2024-09-13T17:15:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:20.361+0000 7f83f2c13740 1 -- 172.21.15.87:0/918047820 shutdown_connections 2024-09-13T17:15:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:20.361+0000 7f83f2c13740 1 --2- 172.21.15.87:0/918047820 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55fa9dfee0e0 0x55fa9dff04d0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:20.361+0000 7f83f2c13740 1 --2- 172.21.15.87:0/918047820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fa9df86cf0 0x55fa9df82e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:20.361+0000 7f83d17fa640 0 client.25451 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:20.361+0000 7f83f2c13740 1 --2- 172.21.15.87:0/918047820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fa9df816f0 0x55fa9df8df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:20.361+0000 7f83f2c13740 1 --2- 172.21.15.87:0/918047820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa9df7da80 0x55fa9df8d9e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:20.361+0000 7f83f2c13740 1 -- 172.21.15.87:0/918047820 >> 172.21.15.87:0/918047820 conn(0x55fa9df7d0d0 msgr2=0x55fa9df85aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:20.361+0000 7f83f2c13740 1 -- 172.21.15.87:0/918047820 shutdown_connections 2024-09-13T17:15:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:20.361+0000 7f83f2c13740 1 -- 172.21.15.87:0/918047820 wait complete. 2024-09-13T17:15:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:20.361+0000 7f83f2c13740 20 client.25451 trim_cache size 0 max 16384 2024-09-13T17:15:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout:{ 2024-09-13T17:15:20.365 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout: "message": "", 2024-09-13T17:15:20.365 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout: "return_code": 0 2024-09-13T17:15:20.365 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout:} 2024-09-13T17:15:20.365 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:20.361+0000 7f83efe12640 1 -- 172.21.15.87:0/3226294224 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f83d40a13a0 msgr2=0x7f83d40a3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:20.361+0000 7f83efe12640 1 --2- 172.21.15.87:0/3226294224 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f83d40a13a0 0x7f83d40a3860 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f83e00caca0 tx=0x7f83e00cacd0 comp rx=0 tx=0).stop 2024-09-13T17:15:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:20.361+0000 7f83efe12640 1 -- 172.21.15.87:0/3226294224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83e8104c30 msgr2=0x7f83e81a2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:20.361+0000 7f83efe12640 1 --2- 172.21.15.87:0/3226294224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83e8104c30 0x7f83e81a2150 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f83e0009fd0 tx=0x7f83e000ef10 comp rx=0 tx=0).stop 2024-09-13T17:15:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:20.361+0000 7f83efe12640 1 -- 172.21.15.87:0/3226294224 shutdown_connections 2024-09-13T17:15:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:20.361+0000 7f83efe12640 1 --2- 172.21.15.87:0/3226294224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83e8104c30 0x7f83e81a2150 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:20.361+0000 7f83efe12640 1 --2- 172.21.15.87:0/3226294224 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f83d40a13a0 0x7f83d40a3860 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:20.361+0000 7f83efe12640 1 --2- 172.21.15.87:0/3226294224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83e80ff970 0x7f83e8197610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:20.361+0000 7f83efe12640 1 --2- 172.21.15.87:0/3226294224 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83e80feff0 0x7f83e81970d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:20.361+0000 7f83efe12640 1 -- 172.21.15.87:0/3226294224 >> 172.21.15.87:0/3226294224 conn(0x7f83e8074940 msgr2=0x7f83e80fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:20.361+0000 7f83efe12640 1 -- 172.21.15.87:0/3226294224 shutdown_connections 2024-09-13T17:15:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:20.361+0000 7f83efe12640 1 -- 172.21.15.87:0/3226294224 wait complete. 2024-09-13T17:15:21.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:21 smithi149 ceph-mon[35496]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:15:21.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:21 smithi149 ceph-mon[35496]: pgmap v49: 129 pgs: 129 active+clean; 104 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.0 MiB/s wr, 1.29k op/s 2024-09-13T17:15:21.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:21 smithi118 ceph-mon[34374]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:15:21.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:21 smithi118 ceph-mon[34374]: pgmap v49: 129 pgs: 129 active+clean; 104 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.0 MiB/s wr, 1.29k op/s 2024-09-13T17:15:21.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:21 smithi087 ceph-mon[30934]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:15:21.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:21 smithi087 ceph-mon[30934]: pgmap v49: 129 pgs: 129 active+clean; 104 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.0 MiB/s wr, 1.29k op/s 2024-09-13T17:15:22.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:22 smithi149 ceph-mon[35496]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-09-13T17:15:22.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:22 smithi118 ceph-mon[34374]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-09-13T17:15:22.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:22 smithi087 ceph-mon[30934]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-09-13T17:15:23.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:23 smithi149 ceph-mon[35496]: pgmap v50: 129 pgs: 129 active+clean; 104 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 2.5 MiB/s wr, 1.24k op/s 2024-09-13T17:15:23.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:23 smithi118 ceph-mon[34374]: pgmap v50: 129 pgs: 129 active+clean; 104 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 2.5 MiB/s wr, 1.24k op/s 2024-09-13T17:15:23.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:23 smithi087 ceph-mon[30934]: pgmap v50: 129 pgs: 129 active+clean; 104 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 2.5 MiB/s wr, 1.24k op/s 2024-09-13T17:15:26.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:26 smithi087 ceph-mon[30934]: pgmap v51: 129 pgs: 129 active+clean; 109 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 1.25k op/s 2024-09-13T17:15:26.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:26 smithi149 ceph-mon[35496]: pgmap v51: 129 pgs: 129 active+clean; 109 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 1.25k op/s 2024-09-13T17:15:26.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:26 smithi118 ceph-mon[34374]: pgmap v51: 129 pgs: 129 active+clean; 109 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 1.25k op/s 2024-09-13T17:15:28.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:28 smithi087 ceph-mon[30934]: pgmap v52: 129 pgs: 129 active+clean; 109 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 2.0 MiB/s wr, 1.10k op/s 2024-09-13T17:15:28.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:28 smithi149 ceph-mon[35496]: pgmap v52: 129 pgs: 129 active+clean; 109 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 2.0 MiB/s wr, 1.10k op/s 2024-09-13T17:15:28.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:28 smithi118 ceph-mon[34374]: pgmap v52: 129 pgs: 129 active+clean; 109 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 2.0 MiB/s wr, 1.10k op/s 2024-09-13T17:15:30.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:30 smithi149 ceph-mon[35496]: pgmap v53: 129 pgs: 129 active+clean; 109 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 2.0 MiB/s wr, 1.09k op/s 2024-09-13T17:15:30.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:30 smithi118 ceph-mon[34374]: pgmap v53: 129 pgs: 129 active+clean; 109 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 2.0 MiB/s wr, 1.09k op/s 2024-09-13T17:15:30.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:30 smithi087 ceph-mon[30934]: pgmap v53: 129 pgs: 129 active+clean; 109 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 2.0 MiB/s wr, 1.09k op/s 2024-09-13T17:15:31.925 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:15:32.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.032+0000 7f77fd819640 1 -- 172.21.15.87:0/3037778073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77f80fee60 msgr2=0x7f77f80ff240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.032+0000 7f77fd819640 1 --2- 172.21.15.87:0/3037778073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77f80fee60 0x7f77f80ff240 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f77e8009890 tx=0x7f77e802a380 comp rx=0 tx=0).stop 2024-09-13T17:15:32.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.032+0000 7f77fd819640 1 -- 172.21.15.87:0/3037778073 shutdown_connections 2024-09-13T17:15:32.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.032+0000 7f77fd819640 1 --2- 172.21.15.87:0/3037778073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77f8103fb0 0x7f77f810bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.032+0000 7f77fd819640 1 --2- 172.21.15.87:0/3037778073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77f80ff810 0x7f77f8103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.032+0000 7f77fd819640 1 --2- 172.21.15.87:0/3037778073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77f80fee60 0x7f77f80ff240 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f77e8009890 tx=0x7f77e802a380 comp rx=0 tx=0).stop 2024-09-13T17:15:32.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.032+0000 7f77fd819640 1 -- 172.21.15.87:0/3037778073 >> 172.21.15.87:0/3037778073 conn(0x7f77f8075c60 msgr2=0x7f77f80fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:32.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.032+0000 7f77fd819640 1 -- 172.21.15.87:0/3037778073 shutdown_connections 2024-09-13T17:15:32.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.032+0000 7f77fd819640 1 -- 172.21.15.87:0/3037778073 wait complete. 2024-09-13T17:15:32.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.033+0000 7f77fd819640 1 Processor -- start 2024-09-13T17:15:32.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.033+0000 7f77fd819640 1 -- start start 2024-09-13T17:15:32.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.033+0000 7f77fd819640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77f8103fb0 0x7f77f8196520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.033+0000 7f77fd819640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77f8196a60 0x7f77f819ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.033+0000 7f77fd819640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77f819b340 0x7f77f819b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.033+0000 7f77fd819640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f8197130 con 0x7f77f819b340 2024-09-13T17:15:32.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.033+0000 7f77fd819640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f81a30b0 con 0x7f77f8196a60 2024-09-13T17:15:32.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.033+0000 7f77fd819640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f8107ae0 con 0x7f77f8103fb0 2024-09-13T17:15:32.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.033+0000 7f77f77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77f819b340 0x7f77f819b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.033+0000 7f77f77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77f819b340 0x7f77f819b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59550/0 (socket says 172.21.15.87:59550) 2024-09-13T17:15:32.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.033+0000 7f77f77fe640 1 -- 172.21.15.87:0/2828096193 learned_addr learned my addr 172.21.15.87:0/2828096193 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:32.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.033+0000 7f77f6ffd640 1 --2- 172.21.15.87:0/2828096193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77f8103fb0 0x7f77f8196520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.034+0000 7f77effff640 1 --2- 172.21.15.87:0/2828096193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77f8196a60 0x7f77f819ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.034+0000 7f77f77fe640 1 -- 172.21.15.87:0/2828096193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77f8103fb0 msgr2=0x7f77f8196520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.034+0000 7f77f77fe640 1 --2- 172.21.15.87:0/2828096193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77f8103fb0 0x7f77f8196520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.034+0000 7f77f77fe640 1 -- 172.21.15.87:0/2828096193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77f8196a60 msgr2=0x7f77f819ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.034+0000 7f77f77fe640 1 --2- 172.21.15.87:0/2828096193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77f8196a60 0x7f77f819ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.034+0000 7f77f77fe640 1 -- 172.21.15.87:0/2828096193 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e8009490 con 0x7f77f819b340 2024-09-13T17:15:32.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.034+0000 7f77f6ffd640 1 --2- 172.21.15.87:0/2828096193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77f8103fb0 0x7f77f8196520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:15:32.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.034+0000 7f77effff640 1 --2- 172.21.15.87:0/2828096193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77f8196a60 0x7f77f819ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:32.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.034+0000 7f77f77fe640 1 --2- 172.21.15.87:0/2828096193 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77f819b340 0x7f77f819b7f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f77f000ea60 tx=0x7f77f000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:32.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.034+0000 7f77fc817640 1 -- 172.21.15.87:0/2828096193 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f000ce40 con 0x7f77f819b340 2024-09-13T17:15:32.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.034+0000 7f77fd819640 1 -- 172.21.15.87:0/2828096193 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f8107d90 con 0x7f77f819b340 2024-09-13T17:15:32.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.034+0000 7f77fc817640 1 -- 172.21.15.87:0/2828096193 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f77f0005020 con 0x7f77f819b340 2024-09-13T17:15:32.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.034+0000 7f77fc817640 1 -- 172.21.15.87:0/2828096193 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f0010690 con 0x7f77f819b340 2024-09-13T17:15:32.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.034+0000 7f77fd819640 1 -- 172.21.15.87:0/2828096193 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f81082a0 con 0x7f77f819b340 2024-09-13T17:15:32.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.036+0000 7f77fc817640 1 -- 172.21.15.87:0/2828096193 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f77f0005190 con 0x7f77f819b340 2024-09-13T17:15:32.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.037+0000 7f7800617740 1 Processor -- start 2024-09-13T17:15:32.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.037+0000 7f7800617740 1 -- start start 2024-09-13T17:15:32.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.037+0000 7f7800617740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f0fa352e10 0x55f0fa3531f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.037+0000 7f77fc817640 1 --2- 172.21.15.87:0/2828096193 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f77e40a1200 0x7f77e40a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.037+0000 7f7800617740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0fa353730 0x55f0fa35da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.037+0000 7f7800617740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0fa35dfd0 0x55f0fa3603c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.037+0000 7f7800617740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0fa2bdf20 con 0x55f0fa353730 2024-09-13T17:15:32.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.037+0000 7f7800617740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0fa2bb6b0 con 0x55f0fa35dfd0 2024-09-13T17:15:32.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.037+0000 7f7800617740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0fa2b6fa0 con 0x55f0fa352e10 2024-09-13T17:15:32.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.037+0000 7f77f6ffd640 1 --2- 172.21.15.87:0/2828096193 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f77e40a1200 0x7f77e40a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.037+0000 7f77fc817640 1 -- 172.21.15.87:0/2828096193 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f77f0014070 con 0x7f77f819b340 2024-09-13T17:15:32.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.037+0000 7f77effff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f0fa352e10 0x55f0fa3531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.038+0000 7f77f77fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0fa35dfd0 0x55f0fa3603c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.038+0000 7f77effff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f0fa352e10 0x55f0fa3531f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:38834/0 (socket says 172.21.15.87:38834) 2024-09-13T17:15:32.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.038+0000 7f77effff640 1 -- 172.21.15.87:0/2109219622 learned_addr learned my addr 172.21.15.87:0/2109219622 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:32.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.038+0000 7f77effff640 1 --2- 172.21.15.87:0/2109219622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0fa353730 0x55f0fa35da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.038+0000 7f77f77fe640 1 -- 172.21.15.87:0/2109219622 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f0fa352e10 msgr2=0x55f0fa3531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:32.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.038+0000 7f77f77fe640 1 --2- 172.21.15.87:0/2109219622 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f0fa352e10 0x55f0fa3531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.038+0000 7f77f77fe640 1 -- 172.21.15.87:0/2109219622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0fa353730 msgr2=0x55f0fa35da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:32.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.038+0000 7f77f77fe640 1 --2- 172.21.15.87:0/2109219622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0fa353730 0x55f0fa35da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.038+0000 7f77f77fe640 1 -- 172.21.15.87:0/2109219622 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0fa271840 con 0x55f0fa35dfd0 2024-09-13T17:15:32.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.038+0000 7f77f6ffd640 1 --2- 172.21.15.87:0/2828096193 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f77e40a1200 0x7f77e40a36c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f77e802a970 tx=0x7f77e80058b0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:32.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.038+0000 7f77f77fe640 1 --2- 172.21.15.87:0/2109219622 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0fa35dfd0 0x55f0fa3603c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f77f00ca9a0 tx=0x7f77f0099cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e383930f984d2c7d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:32.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.038+0000 7f77edffb640 1 -- 172.21.15.87:0/2109219622 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f0077e20 con 0x55f0fa35dfd0 2024-09-13T17:15:32.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.039+0000 7f77edffb640 1 -- 172.21.15.87:0/2109219622 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f77f0077c40 con 0x55f0fa35dfd0 2024-09-13T17:15:32.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.039+0000 7f77edffb640 1 -- 172.21.15.87:0/2109219622 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f009e190 con 0x55f0fa35dfd0 2024-09-13T17:15:32.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.039+0000 7f7800617740 1 -- 172.21.15.87:0/2109219622 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0fa35dfd0 msgr2=0x55f0fa3603c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.039+0000 7f7800617740 1 --2- 172.21.15.87:0/2109219622 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0fa35dfd0 0x55f0fa3603c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f77f00ca9a0 tx=0x7f77f0099cc0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.039+0000 7f7800617740 1 -- 172.21.15.87:0/2109219622 shutdown_connections 2024-09-13T17:15:32.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.039+0000 7f7800617740 1 --2- 172.21.15.87:0/2109219622 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0fa35dfd0 0x55f0fa3603c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.039+0000 7f7800617740 1 --2- 172.21.15.87:0/2109219622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0fa353730 0x55f0fa35da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.039+0000 7f7800617740 1 --2- 172.21.15.87:0/2109219622 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f0fa352e10 0x55f0fa3531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.039+0000 7f7800617740 1 -- 172.21.15.87:0/2109219622 >> 172.21.15.87:0/2109219622 conn(0x55f0fa34f380 msgr2=0x55f0fa34f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:32.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.039+0000 7f7800617740 1 -- 172.21.15.87:0/2109219622 shutdown_connections 2024-09-13T17:15:32.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.039+0000 7f7800617740 1 -- 172.21.15.87:0/2109219622 wait complete. 2024-09-13T17:15:32.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.040+0000 7f7800617740 1 -- start start 2024-09-13T17:15:32.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.040+0000 7f7800617740 1 Processor -- start 2024-09-13T17:15:32.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.040+0000 7f7800617740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0fa352e10 0x55f0fa35d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.040+0000 7f7800617740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0fa353730 0x55f0fa35ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.040+0000 7f7800617740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f0fa35dfd0 0x55f0fa35b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.040+0000 7f7800617740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0fa2582a0 con 0x55f0fa353730 2024-09-13T17:15:32.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.040+0000 7f7800617740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0f9f8f430 con 0x55f0fa352e10 2024-09-13T17:15:32.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.040+0000 7f7800617740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0fa23a680 con 0x55f0fa35dfd0 2024-09-13T17:15:32.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.040+0000 7f7800617740 10 client.0 _ll_register_callbacks cb 0x55f0fa2b0610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:32.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.040+0000 7f77effff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0fa353730 0x55f0fa35ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.040+0000 7f77f77fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f0fa35dfd0 0x55f0fa35b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.040+0000 7f77effff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0fa353730 0x55f0fa35ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59572/0 (socket says 172.21.15.87:59572) 2024-09-13T17:15:32.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.040+0000 7f77effff640 1 -- 172.21.15.87:0/3280848769 learned_addr learned my addr 172.21.15.87:0/3280848769 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:32.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.041+0000 7f77f6ffd640 1 --2- 172.21.15.87:0/3280848769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0fa352e10 0x55f0fa35d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.041+0000 7f77effff640 1 -- 172.21.15.87:0/3280848769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f0fa35dfd0 msgr2=0x55f0fa35b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:32.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.041+0000 7f77effff640 1 --2- 172.21.15.87:0/3280848769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f0fa35dfd0 0x55f0fa35b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.041+0000 7f77effff640 1 -- 172.21.15.87:0/3280848769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0fa352e10 msgr2=0x55f0fa35d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:32.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.041+0000 7f77effff640 1 --2- 172.21.15.87:0/3280848769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0fa352e10 0x55f0fa35d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.041+0000 7f77effff640 1 -- 172.21.15.87:0/3280848769 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f81082a0 con 0x55f0fa353730 2024-09-13T17:15:32.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.041+0000 7f77f77fe640 1 --2- 172.21.15.87:0/3280848769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f0fa35dfd0 0x55f0fa35b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:15:32.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.041+0000 7f77effff640 1 --2- 172.21.15.87:0/3280848769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0fa353730 0x55f0fa35ab00 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f77e0011890 tx=0x7f77e0011d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf8bcd12e85cd229 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:32.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.041+0000 7f77d6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:15:32.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.041+0000 7f77d6ffd640 1 -- 172.21.15.87:0/3280848769 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e0010ce0 con 0x55f0fa353730 2024-09-13T17:15:32.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.041+0000 7f77d6ffd640 1 -- 172.21.15.87:0/3280848769 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f77e0010e40 con 0x55f0fa353730 2024-09-13T17:15:32.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.041+0000 7f7800617740 1 -- 172.21.15.87:0/3280848769 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f0f9faa4e0 con 0x55f0fa353730 2024-09-13T17:15:32.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.041+0000 7f77d6ffd640 1 -- 172.21.15.87:0/3280848769 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77e001c400 con 0x55f0fa353730 2024-09-13T17:15:32.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.041+0000 7f7800617740 10 client.16125 fetch_fsmap learned FSMap version 26 2024-09-13T17:15:32.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.041+0000 7f7800617740 1 -- 172.21.15.87:0/3280848769 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f0fa2b5620 con 0x55f0fa353730 2024-09-13T17:15:32.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.041+0000 7f77d6ffd640 1 -- 172.21.15.87:0/3280848769 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55f0f9faa4e0 con 0x55f0fa353730 2024-09-13T17:15:32.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.042+0000 7f77d6ffd640 1 -- 172.21.15.87:0/3280848769 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f77e001a030 con 0x55f0fa353730 2024-09-13T17:15:32.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.042+0000 7f7800617740 10 client.16125 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T17:15:32.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.042+0000 7f7800617740 10 client.16125 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:15:32.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.042+0000 7f7800617740 20 client.16125 populate_metadata read hostname 'smithi087' 2024-09-13T17:15:32.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.042+0000 7f7800617740 1 --2- 172.21.15.87:0/3280848769 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55f0fa36dde0 0x55f0fa370200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.042+0000 7f7800617740 4 client.16125 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:15:32.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.042+0000 7f7800617740 1 -- 172.21.15.87:0/3280848769 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f0f9fbb7e0 con 0x55f0fa36dde0 2024-09-13T17:15:32.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.042+0000 7f77f6ffd640 1 --2- 172.21.15.87:0/3280848769 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55f0fa36dde0 0x55f0fa370200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.042+0000 7f77d6ffd640 10 client.16125 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:32.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.042+0000 7f77f6ffd640 1 --2- 172.21.15.87:0/3280848769 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55f0fa36dde0 0x55f0fa370200 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df89de0aaa7d45f7 server_cookie=78e6361bc03dbc5a in_seq=0 out_seq=0 2024-09-13T17:15:32.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.043+0000 7f77d6ffd640 1 -- 172.21.15.87:0/3280848769 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55f0f9fbb7e0 con 0x55f0fa36dde0 2024-09-13T17:15:32.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.043+0000 7f77d6ffd640 10 client.16125 handle_command_reply: tid=0 2024-09-13T17:15:32.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.043+0000 7f7800617740 1 client.16125 shutdown 2024-09-13T17:15:32.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.043+0000 7f7800617740 1 -- 172.21.15.87:0/3280848769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0fa353730 msgr2=0x55f0fa35ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.043+0000 7f7800617740 1 --2- 172.21.15.87:0/3280848769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0fa353730 0x55f0fa35ab00 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f77e0011890 tx=0x7f77e0011d50 comp rx=0 tx=0).stop 2024-09-13T17:15:32.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.043+0000 7f7800617740 1 -- 172.21.15.87:0/3280848769 shutdown_connections 2024-09-13T17:15:32.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.043+0000 7f7800617740 1 --2- 172.21.15.87:0/3280848769 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55f0fa36dde0 0x55f0fa370200 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.043+0000 7f7800617740 1 --2- 172.21.15.87:0/3280848769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f0fa35dfd0 0x55f0fa35b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.043+0000 7f77d6ffd640 0 client.16125 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:32.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.043+0000 7f7800617740 1 --2- 172.21.15.87:0/3280848769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0fa353730 0x55f0fa35ab00 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.043+0000 7f7800617740 1 --2- 172.21.15.87:0/3280848769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0fa352e10 0x55f0fa35d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.043+0000 7f7800617740 1 -- 172.21.15.87:0/3280848769 >> 172.21.15.87:0/3280848769 conn(0x55f0fa34f380 msgr2=0x55f0fa3550e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:32.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.043+0000 7f7800617740 1 -- 172.21.15.87:0/3280848769 shutdown_connections 2024-09-13T17:15:32.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.043+0000 7f7800617740 1 -- 172.21.15.87:0/3280848769 wait complete. 2024-09-13T17:15:32.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.043+0000 7f7800617740 20 client.16125 trim_cache size 0 max 16384 2024-09-13T17:15:32.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.058+0000 7f7800617740 1 Processor -- start 2024-09-13T17:15:32.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.058+0000 7f7800617740 1 -- start start 2024-09-13T17:15:32.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.058+0000 7f7800617740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f0fa34f380 0x55f0fa3697f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.058+0000 7f7800617740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0fa352e10 0x55f0fa3593b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.058+0000 7f7800617740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0fa353730 0x55f0fa3598f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.058+0000 7f7800617740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0fa36a3b0 con 0x55f0fa352e10 2024-09-13T17:15:32.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.058+0000 7f7800617740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0f9fbb7e0 con 0x55f0fa353730 2024-09-13T17:15:32.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.058+0000 7f7800617740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0f9faa4e0 con 0x55f0fa34f380 2024-09-13T17:15:32.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.058+0000 7f77effff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0fa352e10 0x55f0fa3593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.058+0000 7f77effff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0fa352e10 0x55f0fa3593b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59582/0 (socket says 172.21.15.87:59582) 2024-09-13T17:15:32.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.058+0000 7f77effff640 1 -- 172.21.15.87:0/1946924088 learned_addr learned my addr 172.21.15.87:0/1946924088 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:32.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.058+0000 7f77f77fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0fa353730 0x55f0fa3598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.058+0000 7f77f6ffd640 1 --2- 172.21.15.87:0/1946924088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f0fa34f380 0x55f0fa3697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.058+0000 7f77effff640 1 -- 172.21.15.87:0/1946924088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f0fa34f380 msgr2=0x55f0fa3697f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:32.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.058+0000 7f77effff640 1 --2- 172.21.15.87:0/1946924088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f0fa34f380 0x55f0fa3697f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.058+0000 7f77effff640 1 -- 172.21.15.87:0/1946924088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0fa353730 msgr2=0x55f0fa3598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:32.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.058+0000 7f77effff640 1 --2- 172.21.15.87:0/1946924088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0fa353730 0x55f0fa3598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.058+0000 7f77effff640 1 -- 172.21.15.87:0/1946924088 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0fa257790 con 0x55f0fa352e10 2024-09-13T17:15:32.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.058+0000 7f77effff640 1 --2- 172.21.15.87:0/1946924088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0fa352e10 0x55f0fa3593b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f77e0006010 tx=0x7f77e0005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=461e7c18de51b71a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:32.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.059+0000 7f77ee7fc640 1 -- 172.21.15.87:0/1946924088 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e001b8f0 con 0x55f0fa352e10 2024-09-13T17:15:32.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.059+0000 7f77ee7fc640 1 -- 172.21.15.87:0/1946924088 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f77e0010ae0 con 0x55f0fa352e10 2024-09-13T17:15:32.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.059+0000 7f77ee7fc640 1 -- 172.21.15.87:0/1946924088 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e0004320 con 0x55f0fa352e10 2024-09-13T17:15:32.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.059+0000 7f7800617740 1 -- 172.21.15.87:0/1946924088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0fa352e10 msgr2=0x55f0fa3593b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.059+0000 7f7800617740 1 --2- 172.21.15.87:0/1946924088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0fa352e10 0x55f0fa3593b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f77e0006010 tx=0x7f77e0005a00 comp rx=0 tx=0).stop 2024-09-13T17:15:32.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.059+0000 7f7800617740 1 -- 172.21.15.87:0/1946924088 shutdown_connections 2024-09-13T17:15:32.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.059+0000 7f7800617740 1 --2- 172.21.15.87:0/1946924088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0fa353730 0x55f0fa3598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.059+0000 7f7800617740 1 --2- 172.21.15.87:0/1946924088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0fa352e10 0x55f0fa3593b0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.059+0000 7f7800617740 1 --2- 172.21.15.87:0/1946924088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f0fa34f380 0x55f0fa3697f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.059+0000 7f7800617740 1 -- 172.21.15.87:0/1946924088 >> 172.21.15.87:0/1946924088 conn(0x55f0fa35d9e0 msgr2=0x55f0fa355db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:32.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.059+0000 7f7800617740 1 -- 172.21.15.87:0/1946924088 shutdown_connections 2024-09-13T17:15:32.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.059+0000 7f7800617740 1 -- 172.21.15.87:0/1946924088 wait complete. 2024-09-13T17:15:32.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.060+0000 7f7800617740 1 -- start start 2024-09-13T17:15:32.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.060+0000 7f7800617740 1 Processor -- start 2024-09-13T17:15:32.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.060+0000 7f7800617740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0fa34f380 0x55f0fa362b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.060+0000 7f7800617740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f0fa352e10 0x55f0fa3630c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.060+0000 7f7800617740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0fa353730 0x55f0fa3c32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.060+0000 7f7800617740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0fa363a10 con 0x55f0fa353730 2024-09-13T17:15:32.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.060+0000 7f7800617740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0fa3c3820 con 0x55f0fa34f380 2024-09-13T17:15:32.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.060+0000 7f7800617740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0fa3c3960 con 0x55f0fa352e10 2024-09-13T17:15:32.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.060+0000 7f7800617740 10 client.0 _ll_register_callbacks cb 0x7f77e0011510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:32.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.060+0000 7f77f77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0fa353730 0x55f0fa3c32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.060+0000 7f77f77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0fa353730 0x55f0fa3c32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59590/0 (socket says 172.21.15.87:59590) 2024-09-13T17:15:32.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.060+0000 7f77f77fe640 1 -- 172.21.15.87:0/1327925763 learned_addr learned my addr 172.21.15.87:0/1327925763 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:32.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.060+0000 7f77f6ffd640 1 --2- 172.21.15.87:0/1327925763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0fa34f380 0x55f0fa362b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.060+0000 7f77effff640 1 --2- 172.21.15.87:0/1327925763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f0fa352e10 0x55f0fa3630c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.061+0000 7f77f77fe640 1 -- 172.21.15.87:0/1327925763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f0fa352e10 msgr2=0x55f0fa3630c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:32.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.061+0000 7f77f77fe640 1 --2- 172.21.15.87:0/1327925763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f0fa352e10 0x55f0fa3630c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.061+0000 7f77f77fe640 1 -- 172.21.15.87:0/1327925763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0fa34f380 msgr2=0x55f0fa362b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:32.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.061+0000 7f77f77fe640 1 --2- 172.21.15.87:0/1327925763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0fa34f380 0x55f0fa362b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.061+0000 7f77f77fe640 1 -- 172.21.15.87:0/1327925763 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f0fa2b5620 con 0x55f0fa353730 2024-09-13T17:15:32.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.061+0000 7f77effff640 1 --2- 172.21.15.87:0/1327925763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f0fa352e10 0x55f0fa3630c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:32.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.061+0000 7f77f6ffd640 1 --2- 172.21.15.87:0/1327925763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0fa34f380 0x55f0fa362b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:32.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.061+0000 7f77f77fe640 1 --2- 172.21.15.87:0/1327925763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0fa353730 0x55f0fa3c32e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f77f009a2f0 tx=0x7f77f00096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11b469faf062675e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:32.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.061+0000 7f77d6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:15:32.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.061+0000 7f77d6ffd640 1 -- 172.21.15.87:0/1327925763 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f00a27e0 con 0x55f0fa353730 2024-09-13T17:15:32.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.061+0000 7f77d6ffd640 1 -- 172.21.15.87:0/1327925763 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f77f00cd030 con 0x55f0fa353730 2024-09-13T17:15:32.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.061+0000 7f7800617740 1 -- 172.21.15.87:0/1327925763 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f77f0077c40 con 0x55f0fa353730 2024-09-13T17:15:32.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.061+0000 7f77d6ffd640 1 -- 172.21.15.87:0/1327925763 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77f009e190 con 0x55f0fa353730 2024-09-13T17:15:32.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.061+0000 7f7800617740 10 client.16131 fetch_fsmap learned FSMap version 26 2024-09-13T17:15:32.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.061+0000 7f7800617740 1 -- 172.21.15.87:0/1327925763 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f0fa27cea0 con 0x55f0fa353730 2024-09-13T17:15:32.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.061+0000 7f77d6ffd640 1 -- 172.21.15.87:0/1327925763 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f77f0077c40 con 0x55f0fa353730 2024-09-13T17:15:32.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.061+0000 7f77d6ffd640 1 -- 172.21.15.87:0/1327925763 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f77f001f060 con 0x55f0fa353730 2024-09-13T17:15:32.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.061+0000 7f7800617740 10 client.16131 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T17:15:32.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.061+0000 7f7800617740 10 client.16131 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:15:32.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.061+0000 7f7800617740 20 client.16131 populate_metadata read hostname 'smithi087' 2024-09-13T17:15:32.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.061+0000 7f7800617740 1 --2- 172.21.15.87:0/1327925763 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55f0fa35dfd0 0x55f0fa3c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.061+0000 7f7800617740 4 client.16131 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:15:32.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.061+0000 7f7800617740 1 -- 172.21.15.87:0/1327925763 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f0fa00ee30 con 0x55f0fa35dfd0 2024-09-13T17:15:32.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.062+0000 7f77f6ffd640 1 --2- 172.21.15.87:0/1327925763 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55f0fa35dfd0 0x55f0fa3c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.062+0000 7f77d6ffd640 10 client.16131 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:32.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.062+0000 7f77f6ffd640 1 --2- 172.21.15.87:0/1327925763 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55f0fa35dfd0 0x55f0fa3c6eb0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c368270ec81b0e9e server_cookie=e2a802ce7e0435d2 in_seq=0 out_seq=0 2024-09-13T17:15:32.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.062+0000 7f77d6ffd640 1 -- 172.21.15.87:0/1327925763 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55f0fa00ee30 con 0x55f0fa35dfd0 2024-09-13T17:15:32.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.062+0000 7f77d6ffd640 10 client.16131 handle_command_reply: tid=0 2024-09-13T17:15:32.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.062+0000 7f7800617740 1 client.16131 shutdown 2024-09-13T17:15:32.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.062+0000 7f7800617740 1 -- 172.21.15.87:0/1327925763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0fa353730 msgr2=0x55f0fa3c32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.062+0000 7f7800617740 1 --2- 172.21.15.87:0/1327925763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0fa353730 0x55f0fa3c32e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f77f009a2f0 tx=0x7f77f00096c0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.062+0000 7f7800617740 1 -- 172.21.15.87:0/1327925763 shutdown_connections 2024-09-13T17:15:32.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.062+0000 7f7800617740 1 --2- 172.21.15.87:0/1327925763 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55f0fa35dfd0 0x55f0fa3c6eb0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.062+0000 7f7800617740 1 --2- 172.21.15.87:0/1327925763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0fa353730 0x55f0fa3c32e0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.062+0000 7f7800617740 1 --2- 172.21.15.87:0/1327925763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f0fa352e10 0x55f0fa3630c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.062+0000 7f77d6ffd640 0 client.16131 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:32.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.062+0000 7f7800617740 1 --2- 172.21.15.87:0/1327925763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0fa34f380 0x55f0fa362b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.062+0000 7f7800617740 1 -- 172.21.15.87:0/1327925763 >> 172.21.15.87:0/1327925763 conn(0x55f0fa35d9e0 msgr2=0x55f0fa34dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:32.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.063+0000 7f7800617740 1 -- 172.21.15.87:0/1327925763 shutdown_connections 2024-09-13T17:15:32.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.063+0000 7f7800617740 1 -- 172.21.15.87:0/1327925763 wait complete. 2024-09-13T17:15:32.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.063+0000 7f7800617740 20 client.16131 trim_cache size 0 max 16384 2024-09-13T17:15:32.072 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:15:32.072 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "no active scrubs running", 2024-09-13T17:15:32.072 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": {} 2024-09-13T17:15:32.072 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:15:32.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.063+0000 7f77fd819640 1 -- 172.21.15.87:0/2828096193 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f77e40a1200 msgr2=0x7f77e40a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.063+0000 7f77fd819640 1 --2- 172.21.15.87:0/2828096193 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f77e40a1200 0x7f77e40a36c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f77e802a970 tx=0x7f77e80058b0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.063+0000 7f77fd819640 1 -- 172.21.15.87:0/2828096193 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77f819b340 msgr2=0x7f77f819b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.063+0000 7f77fd819640 1 --2- 172.21.15.87:0/2828096193 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77f819b340 0x7f77f819b7f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f77f000ea60 tx=0x7f77f000ef20 comp rx=0 tx=0).stop 2024-09-13T17:15:32.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.063+0000 7f77fd819640 1 -- 172.21.15.87:0/2828096193 shutdown_connections 2024-09-13T17:15:32.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.063+0000 7f77fd819640 1 --2- 172.21.15.87:0/2828096193 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f77e40a1200 0x7f77e40a36c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.063+0000 7f77fd819640 1 --2- 172.21.15.87:0/2828096193 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77f819b340 0x7f77f819b7f0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.063+0000 7f77fd819640 1 --2- 172.21.15.87:0/2828096193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77f8196a60 0x7f77f819ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.063+0000 7f77fd819640 1 --2- 172.21.15.87:0/2828096193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f77f8103fb0 0x7f77f8196520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.063+0000 7f77fd819640 1 -- 172.21.15.87:0/2828096193 >> 172.21.15.87:0/2828096193 conn(0x7f77f8075c60 msgr2=0x7f77f8100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:32.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.063+0000 7f77fd819640 1 -- 172.21.15.87:0/2828096193 shutdown_connections 2024-09-13T17:15:32.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.063+0000 7f77fd819640 1 -- 172.21.15.87:0/2828096193 wait complete. 2024-09-13T17:15:32.077 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T17:15:32.077 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:15:32.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.184+0000 7fe9a84e5640 1 -- 172.21.15.87:0/92269640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9a0100f40 msgr2=0x7fe9a0101320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.184+0000 7fe9a84e5640 1 --2- 172.21.15.87:0/92269640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9a0100f40 0x7fe9a0101320 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fe99c009900 tx=0x7fe99c02a480 comp rx=0 tx=0).stop 2024-09-13T17:15:32.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.184+0000 7fe9a84e5640 1 -- 172.21.15.87:0/92269640 shutdown_connections 2024-09-13T17:15:32.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.184+0000 7fe9a84e5640 1 --2- 172.21.15.87:0/92269640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9a010a310 0x7fe9a010c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.184+0000 7fe9a84e5640 1 --2- 172.21.15.87:0/92269640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9a0101860 0x7fe9a0109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.184+0000 7fe9a84e5640 1 --2- 172.21.15.87:0/92269640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9a0100f40 0x7fe9a0101320 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.184+0000 7fe9a84e5640 1 -- 172.21.15.87:0/92269640 >> 172.21.15.87:0/92269640 conn(0x7fe9a0075c60 msgr2=0x7fe9a00fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:32.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.184+0000 7fe9a84e5640 1 -- 172.21.15.87:0/92269640 shutdown_connections 2024-09-13T17:15:32.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.184+0000 7fe9a84e5640 1 -- 172.21.15.87:0/92269640 wait complete. 2024-09-13T17:15:32.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.184+0000 7fe9a84e5640 1 Processor -- start 2024-09-13T17:15:32.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.184+0000 7fe9a84e5640 1 -- start start 2024-09-13T17:15:32.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.185+0000 7fe9a84e5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9a0100f40 0x7fe9a0196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.185+0000 7fe9a84e5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9a0101860 0x7fe9a01967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.185+0000 7fe9a84e5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9a010a310 0x7fe9a019ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.185+0000 7fe9a84e5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a019b190 con 0x7fe9a010a310 2024-09-13T17:15:32.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.185+0000 7fe9a84e5640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a019b300 con 0x7fe9a0101860 2024-09-13T17:15:32.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.185+0000 7fe9a84e5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a019b4c0 con 0x7fe9a0100f40 2024-09-13T17:15:32.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.185+0000 7fe9a6a82640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9a010a310 0x7fe9a019ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.185+0000 7fe9a6281640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9a0100f40 0x7fe9a0196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.185+0000 7fe9a6a82640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9a010a310 0x7fe9a019ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59622/0 (socket says 172.21.15.87:59622) 2024-09-13T17:15:32.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.185+0000 7fe9a6a82640 1 -- 172.21.15.87:0/1084407323 learned_addr learned my addr 172.21.15.87:0/1084407323 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:32.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.185+0000 7fe9a6281640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9a0100f40 0x7fe9a0196260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:38882/0 (socket says 172.21.15.87:38882) 2024-09-13T17:15:32.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.185+0000 7fe9a5a80640 1 --2- 172.21.15.87:0/1084407323 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9a0101860 0x7fe9a01967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.185+0000 7fe9a6a82640 1 -- 172.21.15.87:0/1084407323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9a0100f40 msgr2=0x7fe9a0196260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.185+0000 7fe9a6a82640 1 --2- 172.21.15.87:0/1084407323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9a0100f40 0x7fe9a0196260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.185+0000 7fe9a6a82640 1 -- 172.21.15.87:0/1084407323 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9a0101860 msgr2=0x7fe9a01967a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.185+0000 7fe9a6a82640 1 --2- 172.21.15.87:0/1084407323 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9a0101860 0x7fe9a01967a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.185+0000 7fe9a6a82640 1 -- 172.21.15.87:0/1084407323 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe99c009560 con 0x7fe9a010a310 2024-09-13T17:15:32.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.185+0000 7fe9a5a80640 1 --2- 172.21.15.87:0/1084407323 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9a0101860 0x7fe9a01967a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:15:32.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.185+0000 7fe9a6281640 1 --2- 172.21.15.87:0/1084407323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9a0100f40 0x7fe9a0196260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:15:32.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.185+0000 7fe9a6a82640 1 --2- 172.21.15.87:0/1084407323 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9a010a310 0x7fe9a019ab90 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe99800eb10 tx=0x7fe99800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:32.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.185+0000 7fe9977fe640 1 -- 172.21.15.87:0/1084407323 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe998004b20 con 0x7fe9a010a310 2024-09-13T17:15:32.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.185+0000 7fe9977fe640 1 -- 172.21.15.87:0/1084407323 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe998004c80 con 0x7fe9a010a310 2024-09-13T17:15:32.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.185+0000 7fe9a84e5640 1 -- 172.21.15.87:0/1084407323 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a019b7a0 con 0x7fe9a010a310 2024-09-13T17:15:32.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.185+0000 7fe9977fe640 1 -- 172.21.15.87:0/1084407323 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe998010690 con 0x7fe9a010a310 2024-09-13T17:15:32.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.186+0000 7fe9a84e5640 1 -- 172.21.15.87:0/1084407323 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a01a3020 con 0x7fe9a010a310 2024-09-13T17:15:32.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.187+0000 7fe9a84e5640 1 -- 172.21.15.87:0/1084407323 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a0067e20 con 0x7fe9a010a310 2024-09-13T17:15:32.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.188+0000 7fe9977fe640 1 -- 172.21.15.87:0/1084407323 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fe998005020 con 0x7fe9a010a310 2024-09-13T17:15:32.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.188+0000 7fe9977fe640 1 --2- 172.21.15.87:0/1084407323 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe98c0a1280 0x7fe98c0a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.188+0000 7fe9977fe640 1 -- 172.21.15.87:0/1084407323 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fe998014070 con 0x7fe9a010a310 2024-09-13T17:15:32.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.189+0000 7fe9a6281640 1 --2- 172.21.15.87:0/1084407323 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe98c0a1280 0x7fe98c0a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.189+0000 7fe9a6281640 1 --2- 172.21.15.87:0/1084407323 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe98c0a1280 0x7fe98c0a3740 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe99c0057c0 tx=0x7fe99c005a20 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:32.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.193+0000 7fe9977fe640 1 -- 172.21.15.87:0/1084407323 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe998096600 con 0x7fe9a010a310 2024-09-13T17:15:32.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.416+0000 7fe9a84e5640 1 -- 172.21.15.87:0/1084407323 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9a0101320 con 0x7fe9a010a310 2024-09-13T17:15:32.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.416+0000 7fe9977fe640 1 -- 172.21.15.87:0/1084407323 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10880 (secure 0 0 0) 0x7fe998099c20 con 0x7fe9a010a310 2024-09-13T17:15:32.418 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:15:32.419 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/3674545180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":3674545180},{"type":"v1","addr":"172.21.15.87:6841","nonce":3674545180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:11:23.313609+0000","modified":"2024-09-13T17:15:20.534419+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24484,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6839/3052680456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3052680456},{"type":"v1","addr":"172.21.15.118:6839","nonce":3052680456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:15:32.419 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 26 2024-09-13T17:15:32.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.418+0000 7fe9a84e5640 1 -- 172.21.15.87:0/1084407323 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe98c0a1280 msgr2=0x7fe98c0a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.418+0000 7fe9a84e5640 1 --2- 172.21.15.87:0/1084407323 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe98c0a1280 0x7fe98c0a3740 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe99c0057c0 tx=0x7fe99c005a20 comp rx=0 tx=0).stop 2024-09-13T17:15:32.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.418+0000 7fe9a84e5640 1 -- 172.21.15.87:0/1084407323 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9a010a310 msgr2=0x7fe9a019ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.418+0000 7fe9a84e5640 1 --2- 172.21.15.87:0/1084407323 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9a010a310 0x7fe9a019ab90 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe99800eb10 tx=0x7fe99800c2d0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.418+0000 7fe9a84e5640 1 -- 172.21.15.87:0/1084407323 shutdown_connections 2024-09-13T17:15:32.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.418+0000 7fe9a84e5640 1 --2- 172.21.15.87:0/1084407323 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe98c0a1280 0x7fe98c0a3740 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.418+0000 7fe9a84e5640 1 --2- 172.21.15.87:0/1084407323 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9a010a310 0x7fe9a019ab90 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.418+0000 7fe9a84e5640 1 --2- 172.21.15.87:0/1084407323 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9a0101860 0x7fe9a01967a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.418+0000 7fe9a84e5640 1 --2- 172.21.15.87:0/1084407323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9a0100f40 0x7fe9a0196260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.418+0000 7fe9a84e5640 1 -- 172.21.15.87:0/1084407323 >> 172.21.15.87:0/1084407323 conn(0x7fe9a0075c60 msgr2=0x7fe9a00fb5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:32.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.418+0000 7fe9a84e5640 1 -- 172.21.15.87:0/1084407323 shutdown_connections 2024-09-13T17:15:32.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.418+0000 7fe9a84e5640 1 -- 172.21.15.87:0/1084407323 wait complete. 2024-09-13T17:15:32.431 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-09-13T17:15:32.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.542+0000 7fb79a88e640 1 -- 172.21.15.87:0/2426403538 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb794103fb0 msgr2=0x7fb79410bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.542+0000 7fb79a88e640 1 --2- 172.21.15.87:0/2426403538 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb794103fb0 0x7fb79410bb00 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fb78c009cd0 tx=0x7fb78c02a8e0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.542+0000 7fb79a88e640 1 -- 172.21.15.87:0/2426403538 shutdown_connections 2024-09-13T17:15:32.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.542+0000 7fb79a88e640 1 --2- 172.21.15.87:0/2426403538 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb794103fb0 0x7fb79410bb00 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.542+0000 7fb79a88e640 1 --2- 172.21.15.87:0/2426403538 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7940ff810 0x7fb794103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.542+0000 7fb79a88e640 1 --2- 172.21.15.87:0/2426403538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7940fee60 0x7fb7940ff240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.542+0000 7fb79a88e640 1 -- 172.21.15.87:0/2426403538 >> 172.21.15.87:0/2426403538 conn(0x7fb794075c60 msgr2=0x7fb7940fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:32.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.542+0000 7fb79a88e640 1 -- 172.21.15.87:0/2426403538 shutdown_connections 2024-09-13T17:15:32.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.542+0000 7fb79a88e640 1 -- 172.21.15.87:0/2426403538 wait complete. 2024-09-13T17:15:32.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.543+0000 7fb79a88e640 1 Processor -- start 2024-09-13T17:15:32.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.543+0000 7fb79a88e640 1 -- start start 2024-09-13T17:15:32.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.543+0000 7fb79a88e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7940fee60 0x7fb7941970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.543+0000 7fb79a88e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb794103fb0 0x7fb7941975f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.543+0000 7fb79a88e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb794197b30 0x7fb7941a2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.543+0000 7fb79a88e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7941a27d0 con 0x7fb794103fb0 2024-09-13T17:15:32.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.543+0000 7fb79a88e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7941a2940 con 0x7fb794197b30 2024-09-13T17:15:32.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.543+0000 7fb79a88e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7941a2b00 con 0x7fb7940fee60 2024-09-13T17:15:32.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.543+0000 7fb7937fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb794103fb0 0x7fb7941975f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.543+0000 7fb7937fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb794103fb0 0x7fb7941975f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59646/0 (socket says 172.21.15.87:59646) 2024-09-13T17:15:32.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.543+0000 7fb7937fe640 1 -- 172.21.15.87:0/3424050808 learned_addr learned my addr 172.21.15.87:0/3424050808 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:32.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.544+0000 7fb793fff640 1 --2- 172.21.15.87:0/3424050808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7940fee60 0x7fb7941970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.544+0000 7fb798e2b640 1 --2- 172.21.15.87:0/3424050808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb794197b30 0x7fb7941a2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.544+0000 7fb7937fe640 1 -- 172.21.15.87:0/3424050808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7940fee60 msgr2=0x7fb7941970b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.544+0000 7fb7937fe640 1 --2- 172.21.15.87:0/3424050808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7940fee60 0x7fb7941970b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.544+0000 7fb7937fe640 1 -- 172.21.15.87:0/3424050808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb794197b30 msgr2=0x7fb7941a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.544+0000 7fb7937fe640 1 --2- 172.21.15.87:0/3424050808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb794197b30 0x7fb7941a2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.544+0000 7fb7937fe640 1 -- 172.21.15.87:0/3424050808 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb784009490 con 0x7fb794103fb0 2024-09-13T17:15:32.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.544+0000 7fb798e2b640 1 --2- 172.21.15.87:0/3424050808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb794197b30 0x7fb7941a2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:32.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.544+0000 7fb7937fe640 1 --2- 172.21.15.87:0/3424050808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb794103fb0 0x7fb7941975f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fb78800e9a0 tx=0x7fb78800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:32.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.544+0000 7fb7917fa640 1 -- 172.21.15.87:0/3424050808 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78800cd80 con 0x7fb794103fb0 2024-09-13T17:15:32.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.544+0000 7fb7917fa640 1 -- 172.21.15.87:0/3424050808 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb7880044d0 con 0x7fb794103fb0 2024-09-13T17:15:32.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.544+0000 7fb79a88e640 1 -- 172.21.15.87:0/3424050808 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb788009490 con 0x7fb794103fb0 2024-09-13T17:15:32.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.544+0000 7fb7917fa640 1 -- 172.21.15.87:0/3424050808 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb788010690 con 0x7fb794103fb0 2024-09-13T17:15:32.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.545+0000 7fb79a88e640 1 -- 172.21.15.87:0/3424050808 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb78c009900 con 0x7fb794103fb0 2024-09-13T17:15:32.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.547+0000 7fb7917fa640 1 -- 172.21.15.87:0/3424050808 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fb788003e40 con 0x7fb794103fb0 2024-09-13T17:15:32.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.548+0000 7fb79d688740 1 Processor -- start 2024-09-13T17:15:32.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.548+0000 7fb7917fa640 1 --2- 172.21.15.87:0/3424050808 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb77c0a5610 0x7fb77c0a7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.548+0000 7fb79d688740 1 -- start start 2024-09-13T17:15:32.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.548+0000 7fb798e2b640 1 --2- 172.21.15.87:0/3424050808 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb77c0a5610 0x7fb77c0a7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.548+0000 7fb7917fa640 1 -- 172.21.15.87:0/3424050808 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fb788014070 con 0x7fb794103fb0 2024-09-13T17:15:32.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.548+0000 7fb79d688740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a2a8816790 0x55a2a8816b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.548+0000 7fb79d688740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2a88170b0 0x55a2a8821410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.548+0000 7fb79d688740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2a8821950 0x55a2a8823d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.548+0000 7fb79d688740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2a8780cc0 con 0x55a2a88170b0 2024-09-13T17:15:32.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.548+0000 7fb79d688740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2a877e450 con 0x55a2a8816790 2024-09-13T17:15:32.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.548+0000 7fb79d688740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2a8779d40 con 0x55a2a8821950 2024-09-13T17:15:32.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.548+0000 7fb7937fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2a88170b0 0x55a2a8821410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.548+0000 7fb793fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a2a8816790 0x55a2a8816b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.548+0000 7fb793fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a2a8816790 0x55a2a8816b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.87:55064/0 (socket says 172.21.15.87:55064) 2024-09-13T17:15:32.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.548+0000 7fb793fff640 1 -- 172.21.15.87:0/2706238819 learned_addr learned my addr 172.21.15.87:0/2706238819 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:32.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.548+0000 7fb7937fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2a88170b0 0x55a2a8821410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59652/0 (socket says 172.21.15.87:59652) 2024-09-13T17:15:32.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.548+0000 7fb798e2b640 1 --2- 172.21.15.87:0/2706238819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2a8821950 0x55a2a8823d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.548+0000 7fb793fff640 1 -- 172.21.15.87:0/2706238819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2a8821950 msgr2=0x55a2a8823d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:32.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.548+0000 7fb793fff640 1 --2- 172.21.15.87:0/2706238819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2a8821950 0x55a2a8823d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.548+0000 7fb793fff640 1 -- 172.21.15.87:0/2706238819 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2a88170b0 msgr2=0x55a2a8821410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:32.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.548+0000 7fb793fff640 1 --2- 172.21.15.87:0/2706238819 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2a88170b0 0x55a2a8821410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.549+0000 7fb793fff640 1 -- 172.21.15.87:0/2706238819 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a2a8741620 con 0x55a2a8816790 2024-09-13T17:15:32.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.549+0000 7fb7937fe640 1 --2- 172.21.15.87:0/2706238819 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2a88170b0 0x55a2a8821410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:15:32.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.549+0000 7fb798e2b640 1 --2- 172.21.15.87:0/3424050808 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb77c0a5610 0x7fb77c0a7ad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb78c006010 tx=0x7fb78c031730 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:32.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.549+0000 7fb793fff640 1 --2- 172.21.15.87:0/2706238819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a2a8816790 0x55a2a8816b70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb784009e80 tx=0x7fb784011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46d4219686830841 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:32.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.549+0000 7fb77a7fc640 1 -- 172.21.15.87:0/2706238819 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb784019410 con 0x55a2a8816790 2024-09-13T17:15:32.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.549+0000 7fb77a7fc640 1 -- 172.21.15.87:0/2706238819 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb784019a20 con 0x55a2a8816790 2024-09-13T17:15:32.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.549+0000 7fb77a7fc640 1 -- 172.21.15.87:0/2706238819 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb784018a20 con 0x55a2a8816790 2024-09-13T17:15:32.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.550+0000 7fb79d688740 1 -- 172.21.15.87:0/2706238819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a2a8816790 msgr2=0x55a2a8816b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.550+0000 7fb79d688740 1 --2- 172.21.15.87:0/2706238819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a2a8816790 0x55a2a8816b70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb784009e80 tx=0x7fb784011810 comp rx=0 tx=0).stop 2024-09-13T17:15:32.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.550+0000 7fb79d688740 1 -- 172.21.15.87:0/2706238819 shutdown_connections 2024-09-13T17:15:32.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.550+0000 7fb79d688740 1 --2- 172.21.15.87:0/2706238819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2a8821950 0x55a2a8823d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.550+0000 7fb79d688740 1 --2- 172.21.15.87:0/2706238819 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2a88170b0 0x55a2a8821410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.550+0000 7fb79d688740 1 --2- 172.21.15.87:0/2706238819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a2a8816790 0x55a2a8816b70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.550+0000 7fb79d688740 1 -- 172.21.15.87:0/2706238819 >> 172.21.15.87:0/2706238819 conn(0x55a2a8812d00 msgr2=0x55a2a88130e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:32.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.550+0000 7fb79d688740 1 -- 172.21.15.87:0/2706238819 shutdown_connections 2024-09-13T17:15:32.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.550+0000 7fb79d688740 1 -- 172.21.15.87:0/2706238819 wait complete. 2024-09-13T17:15:32.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.550+0000 7fb79d688740 1 -- start start 2024-09-13T17:15:32.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.550+0000 7fb79d688740 1 Processor -- start 2024-09-13T17:15:32.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.551+0000 7fb79d688740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2a8816790 0x55a2a8820ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.551+0000 7fb79d688740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a2a88170b0 0x55a2a881e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.551+0000 7fb79d688740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2a8821950 0x55a2a881e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.551+0000 7fb79d688740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2a8738180 con 0x55a2a8821950 2024-09-13T17:15:32.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.551+0000 7fb79d688740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2a8452430 con 0x55a2a88170b0 2024-09-13T17:15:32.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.551+0000 7fb79d688740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2a86fd5e0 con 0x55a2a8816790 2024-09-13T17:15:32.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.551+0000 7fb79d688740 10 client.0 _ll_register_callbacks cb 0x55a2a8769aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:32.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.551+0000 7fb798e2b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2a8821950 0x55a2a881e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.551+0000 7fb793fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2a8816790 0x55a2a8820ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.551+0000 7fb793fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2a8816790 0x55a2a8820ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:38914/0 (socket says 172.21.15.87:38914) 2024-09-13T17:15:32.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.551+0000 7fb793fff640 1 -- 172.21.15.87:0/2600920510 learned_addr learned my addr 172.21.15.87:0/2600920510 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:32.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.551+0000 7fb798e2b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2a8821950 0x55a2a881e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59660/0 (socket says 172.21.15.87:59660) 2024-09-13T17:15:32.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.551+0000 7fb7937fe640 1 --2- 172.21.15.87:0/2600920510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a2a88170b0 0x55a2a881e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.551+0000 7fb793fff640 1 -- 172.21.15.87:0/2600920510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a2a88170b0 msgr2=0x55a2a881e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:32.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.551+0000 7fb793fff640 1 --2- 172.21.15.87:0/2600920510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a2a88170b0 0x55a2a881e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.551+0000 7fb793fff640 1 -- 172.21.15.87:0/2600920510 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2a8821950 msgr2=0x55a2a881e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:32.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.551+0000 7fb793fff640 1 --2- 172.21.15.87:0/2600920510 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2a8821950 0x55a2a881e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.551+0000 7fb793fff640 1 -- 172.21.15.87:0/2600920510 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb784009ae0 con 0x55a2a8816790 2024-09-13T17:15:32.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.551+0000 7fb798e2b640 1 --2- 172.21.15.87:0/2600920510 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2a8821950 0x55a2a881e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:15:32.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.551+0000 7fb793fff640 1 --2- 172.21.15.87:0/2600920510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2a8816790 0x55a2a8820ef0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb78401afd0 tx=0x7fb784019410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c16b4e78d22faf38 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:32.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.551+0000 7fb7737fe640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-09-13T17:15:32.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.552+0000 7fb7737fe640 1 -- 172.21.15.87:0/2600920510 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb784019840 con 0x55a2a8816790 2024-09-13T17:15:32.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.552+0000 7fb79d688740 1 -- 172.21.15.87:0/2600920510 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a2a87a3b80 con 0x55a2a8816790 2024-09-13T17:15:32.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.552+0000 7fb7737fe640 1 -- 172.21.15.87:0/2600920510 <== mon.1 v2:172.21.15.149:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fb784005040 con 0x55a2a8816790 2024-09-13T17:15:32.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.552+0000 7fb7737fe640 1 -- 172.21.15.87:0/2600920510 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb784005200 con 0x55a2a8816790 2024-09-13T17:15:32.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.552+0000 7fb79d688740 10 client.25558 fetch_fsmap learned FSMap version 26 2024-09-13T17:15:32.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.552+0000 7fb79d688740 1 -- 172.21.15.87:0/2600920510 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a2a87783c0 con 0x55a2a8816790 2024-09-13T17:15:32.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.552+0000 7fb7737fe640 1 -- 172.21.15.87:0/2600920510 <== mon.1 v2:172.21.15.149:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55a2a87a3b80 con 0x55a2a8816790 2024-09-13T17:15:32.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.552+0000 7fb7737fe640 1 -- 172.21.15.87:0/2600920510 <== mon.1 v2:172.21.15.149:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fb7840046e0 con 0x55a2a8816790 2024-09-13T17:15:32.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.552+0000 7fb79d688740 10 client.25558 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T17:15:32.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.552+0000 7fb79d688740 10 client.25558 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:15:32.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.552+0000 7fb79d688740 20 client.25558 populate_metadata read hostname 'smithi087' 2024-09-13T17:15:32.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.552+0000 7fb79d688740 1 --2- 172.21.15.87:0/2600920510 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55a2a8831120 0x55a2a8833510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.552+0000 7fb79d688740 4 client.25558 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:15:32.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.552+0000 7fb79d688740 1 -- 172.21.15.87:0/2600920510 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a2a876c1f0 con 0x55a2a8831120 2024-09-13T17:15:32.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.553+0000 7fb7937fe640 1 --2- 172.21.15.87:0/2600920510 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55a2a8831120 0x55a2a8833510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.553+0000 7fb7737fe640 10 client.25558 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:15:32.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.553+0000 7fb7937fe640 1 --2- 172.21.15.87:0/2600920510 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55a2a8831120 0x55a2a8833510 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=529a005f2eb613c9 server_cookie=5477875794d04308 in_seq=0 out_seq=0 2024-09-13T17:15:32.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.554+0000 7fb7737fe640 1 -- 172.21.15.87:0/2600920510 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55a2a876c1f0 con 0x55a2a8831120 2024-09-13T17:15:32.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.554+0000 7fb7737fe640 10 client.25558 handle_command_reply: tid=0 2024-09-13T17:15:32.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.554+0000 7fb79d688740 1 client.25558 shutdown 2024-09-13T17:15:32.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.554+0000 7fb79d688740 1 -- 172.21.15.87:0/2600920510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2a8816790 msgr2=0x55a2a8820ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.554+0000 7fb79d688740 1 --2- 172.21.15.87:0/2600920510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2a8816790 0x55a2a8820ef0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb78401afd0 tx=0x7fb784019410 comp rx=0 tx=0).stop 2024-09-13T17:15:32.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.554+0000 7fb79d688740 1 -- 172.21.15.87:0/2600920510 shutdown_connections 2024-09-13T17:15:32.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.554+0000 7fb79d688740 1 --2- 172.21.15.87:0/2600920510 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55a2a8831120 0x55a2a8833510 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.554+0000 7fb79d688740 1 --2- 172.21.15.87:0/2600920510 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2a8821950 0x55a2a881e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.554+0000 7fb79d688740 1 --2- 172.21.15.87:0/2600920510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a2a88170b0 0x55a2a881e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.554+0000 7fb7737fe640 0 client.25558 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:15:32.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.554+0000 7fb79d688740 1 --2- 172.21.15.87:0/2600920510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2a8816790 0x55a2a8820ef0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.554+0000 7fb79d688740 1 -- 172.21.15.87:0/2600920510 >> 172.21.15.87:0/2600920510 conn(0x55a2a8812d00 msgr2=0x55a2a8818a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:32.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.554+0000 7fb79d688740 1 -- 172.21.15.87:0/2600920510 shutdown_connections 2024-09-13T17:15:32.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.554+0000 7fb79d688740 1 -- 172.21.15.87:0/2600920510 wait complete. 2024-09-13T17:15:32.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.554+0000 7fb79d688740 20 client.25558 trim_cache size 0 max 16384 2024-09-13T17:15:32.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.565+0000 7fb79d688740 1 Processor -- start 2024-09-13T17:15:32.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.565+0000 7fb79d688740 1 -- start start 2024-09-13T17:15:32.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.566+0000 7fb79d688740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2a8816790 0x55a2a8820990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.566+0000 7fb79d688740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2a88170b0 0x55a2a8820ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.566+0000 7fb79d688740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a2a8821950 0x55a2a8819360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.566+0000 7fb79d688740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2a881ea70 con 0x55a2a8816790 2024-09-13T17:15:32.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.566+0000 7fb79d688740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2a882d8f0 con 0x55a2a8821950 2024-09-13T17:15:32.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.566+0000 7fb79d688740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2a880d300 con 0x55a2a88170b0 2024-09-13T17:15:32.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.566+0000 7fb793fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2a8816790 0x55a2a8820990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.566+0000 7fb7937fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2a88170b0 0x55a2a8820ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.566+0000 7fb793fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2a8816790 0x55a2a8820990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59668/0 (socket says 172.21.15.87:59668) 2024-09-13T17:15:32.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.566+0000 7fb793fff640 1 -- 172.21.15.87:0/3496404688 learned_addr learned my addr 172.21.15.87:0/3496404688 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:32.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.566+0000 7fb798e2b640 1 --2- 172.21.15.87:0/3496404688 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a2a8821950 0x55a2a8819360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.566+0000 7fb793fff640 1 -- 172.21.15.87:0/3496404688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2a88170b0 msgr2=0x55a2a8820ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:32.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.566+0000 7fb793fff640 1 --2- 172.21.15.87:0/3496404688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2a88170b0 0x55a2a8820ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.566+0000 7fb793fff640 1 -- 172.21.15.87:0/3496404688 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a2a8821950 msgr2=0x55a2a8819360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:32.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.566+0000 7fb793fff640 1 --2- 172.21.15.87:0/3496404688 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a2a8821950 0x55a2a8819360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.566+0000 7fb793fff640 1 -- 172.21.15.87:0/3496404688 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a2a871a770 con 0x55a2a8816790 2024-09-13T17:15:32.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.566+0000 7fb793fff640 1 --2- 172.21.15.87:0/3496404688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2a8816790 0x55a2a8820990 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fb7840059f0 tx=0x7fb784011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e302cb480cdfc5a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:32.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.566+0000 7fb77affd640 1 -- 172.21.15.87:0/3496404688 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb784019840 con 0x55a2a8816790 2024-09-13T17:15:32.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.566+0000 7fb77affd640 1 -- 172.21.15.87:0/3496404688 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb784004d60 con 0x55a2a8816790 2024-09-13T17:15:32.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.566+0000 7fb77affd640 1 -- 172.21.15.87:0/3496404688 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb784005220 con 0x55a2a8816790 2024-09-13T17:15:32.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.567+0000 7fb79d688740 1 -- 172.21.15.87:0/3496404688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2a8816790 msgr2=0x55a2a8820990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.567+0000 7fb79d688740 1 --2- 172.21.15.87:0/3496404688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2a8816790 0x55a2a8820990 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fb7840059f0 tx=0x7fb784011810 comp rx=0 tx=0).stop 2024-09-13T17:15:32.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.567+0000 7fb79d688740 1 -- 172.21.15.87:0/3496404688 shutdown_connections 2024-09-13T17:15:32.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.567+0000 7fb79d688740 1 --2- 172.21.15.87:0/3496404688 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a2a8821950 0x55a2a8819360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.567+0000 7fb79d688740 1 --2- 172.21.15.87:0/3496404688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2a88170b0 0x55a2a8820ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.567+0000 7fb79d688740 1 --2- 172.21.15.87:0/3496404688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2a8816790 0x55a2a8820990 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.567+0000 7fb79d688740 1 -- 172.21.15.87:0/3496404688 >> 172.21.15.87:0/3496404688 conn(0x55a2a8812d00 msgr2=0x55a2a8837e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:32.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.567+0000 7fb79d688740 1 -- 172.21.15.87:0/3496404688 shutdown_connections 2024-09-13T17:15:32.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.567+0000 7fb79d688740 1 -- 172.21.15.87:0/3496404688 wait complete. 2024-09-13T17:15:32.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.567+0000 7fb79d688740 1 -- start start 2024-09-13T17:15:32.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.568+0000 7fb79d688740 1 Processor -- start 2024-09-13T17:15:32.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.568+0000 7fb79d688740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a2a8816790 0x55a2a88267f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.568+0000 7fb79d688740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2a88170b0 0x55a2a8826d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.568+0000 7fb79d688740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2a8821950 0x55a2a88865b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.568+0000 7fb79d688740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2a8886af0 con 0x55a2a88170b0 2024-09-13T17:15:32.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.568+0000 7fb79d688740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2a8886c30 con 0x55a2a8816790 2024-09-13T17:15:32.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.568+0000 7fb79d688740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2a8886dc0 con 0x55a2a8821950 2024-09-13T17:15:32.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.568+0000 7fb79d688740 10 client.0 _ll_register_callbacks cb 0x7fb784009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:32.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.568+0000 7fb7937fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2a88170b0 0x55a2a8826d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.568+0000 7fb793fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a2a8816790 0x55a2a88267f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.568+0000 7fb7937fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2a88170b0 0x55a2a8826d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59674/0 (socket says 172.21.15.87:59674) 2024-09-13T17:15:32.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.568+0000 7fb7937fe640 1 -- 172.21.15.87:0/3082031983 learned_addr learned my addr 172.21.15.87:0/3082031983 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:32.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.568+0000 7fb798e2b640 1 --2- 172.21.15.87:0/3082031983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2a8821950 0x55a2a88865b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.569+0000 7fb793fff640 1 -- 172.21.15.87:0/3082031983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2a8821950 msgr2=0x55a2a88865b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:32.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.569+0000 7fb793fff640 1 --2- 172.21.15.87:0/3082031983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2a8821950 0x55a2a88865b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.569+0000 7fb793fff640 1 -- 172.21.15.87:0/3082031983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2a88170b0 msgr2=0x55a2a8826d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:32.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.569+0000 7fb793fff640 1 --2- 172.21.15.87:0/3082031983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2a88170b0 0x55a2a8826d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.569+0000 7fb793fff640 1 -- 172.21.15.87:0/3082031983 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a2a87783c0 con 0x55a2a8816790 2024-09-13T17:15:32.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.569+0000 7fb7937fe640 1 --2- 172.21.15.87:0/3082031983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2a88170b0 0x55a2a8826d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:15:32.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.569+0000 7fb793fff640 1 --2- 172.21.15.87:0/3082031983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a2a8816790 0x55a2a88267f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb784004af0 tx=0x7fb7840198c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c137fc778065435 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:32.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.569+0000 7fb7737fe640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-09-13T17:15:32.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.569+0000 7fb7737fe640 1 -- 172.21.15.87:0/3082031983 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78403e070 con 0x55a2a8816790 2024-09-13T17:15:32.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.569+0000 7fb7737fe640 1 -- 172.21.15.87:0/3082031983 <== mon.2 v2:172.21.15.118:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fb784000e40 con 0x55a2a8816790 2024-09-13T17:15:32.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.569+0000 7fb79d688740 1 -- 172.21.15.87:0/3082031983 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb784019a20 con 0x55a2a8816790 2024-09-13T17:15:32.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.569+0000 7fb7737fe640 1 -- 172.21.15.87:0/3082031983 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7840189b0 con 0x55a2a8816790 2024-09-13T17:15:32.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.569+0000 7fb79d688740 10 client.25493 fetch_fsmap learned FSMap version 26 2024-09-13T17:15:32.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.569+0000 7fb79d688740 1 -- 172.21.15.87:0/3082031983 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a2a873fe80 con 0x55a2a8816790 2024-09-13T17:15:32.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.569+0000 7fb7737fe640 1 -- 172.21.15.87:0/3082031983 <== mon.2 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb784019a20 con 0x55a2a8816790 2024-09-13T17:15:32.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.570+0000 7fb7737fe640 1 -- 172.21.15.87:0/3082031983 <== mon.2 v2:172.21.15.118:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fb784041020 con 0x55a2a8816790 2024-09-13T17:15:32.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.570+0000 7fb79d688740 10 client.25493 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T17:15:32.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.570+0000 7fb79d688740 10 client.25493 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:15:32.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.570+0000 7fb79d688740 20 client.25493 populate_metadata read hostname 'smithi087' 2024-09-13T17:15:32.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.570+0000 7fb79d688740 1 --2- 172.21.15.87:0/3082031983 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55a2a8888100 0x55a2a888a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.570+0000 7fb79d688740 4 client.25493 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:15:32.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.570+0000 7fb79d688740 1 -- 172.21.15.87:0/3082031983 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a2a846d4e0 con 0x55a2a8888100 2024-09-13T17:15:32.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.570+0000 7fb7937fe640 1 --2- 172.21.15.87:0/3082031983 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55a2a8888100 0x55a2a888a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.570+0000 7fb7737fe640 10 client.25493 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:15:32.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.570+0000 7fb7937fe640 1 --2- 172.21.15.87:0/3082031983 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55a2a8888100 0x55a2a888a4f0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e8f4f808b1c0d3b server_cookie=b90f374ec7b634da in_seq=0 out_seq=0 2024-09-13T17:15:32.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.570+0000 7fb7737fe640 1 -- 172.21.15.87:0/3082031983 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a2a846d4e0 con 0x55a2a8888100 2024-09-13T17:15:32.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.570+0000 7fb7737fe640 10 client.25493 handle_command_reply: tid=0 2024-09-13T17:15:32.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.570+0000 7fb79d688740 1 client.25493 shutdown 2024-09-13T17:15:32.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.570+0000 7fb79d688740 1 -- 172.21.15.87:0/3082031983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a2a8816790 msgr2=0x55a2a88267f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.570+0000 7fb79d688740 1 --2- 172.21.15.87:0/3082031983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a2a8816790 0x55a2a88267f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb784004af0 tx=0x7fb7840198c0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.571+0000 7fb79d688740 1 -- 172.21.15.87:0/3082031983 shutdown_connections 2024-09-13T17:15:32.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.571+0000 7fb79d688740 1 --2- 172.21.15.87:0/3082031983 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55a2a8888100 0x55a2a888a4f0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.571+0000 7fb79d688740 1 --2- 172.21.15.87:0/3082031983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2a8821950 0x55a2a88865b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.571+0000 7fb79d688740 1 --2- 172.21.15.87:0/3082031983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a2a88170b0 0x55a2a8826d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.571+0000 7fb79d688740 1 --2- 172.21.15.87:0/3082031983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a2a8816790 0x55a2a88267f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.571+0000 7fb79d688740 1 -- 172.21.15.87:0/3082031983 >> 172.21.15.87:0/3082031983 conn(0x55a2a8812d00 msgr2=0x55a2a8819360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:32.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.571+0000 7fb7737fe640 0 client.25493 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:15:32.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.571+0000 7fb79d688740 1 -- 172.21.15.87:0/3082031983 shutdown_connections 2024-09-13T17:15:32.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.571+0000 7fb79d688740 1 -- 172.21.15.87:0/3082031983 wait complete. 2024-09-13T17:15:32.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.571+0000 7fb79d688740 20 client.25493 trim_cache size 0 max 16384 2024-09-13T17:15:32.579 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:15:32.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.571+0000 7fb79a88e640 1 -- 172.21.15.87:0/3424050808 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb77c0a5610 msgr2=0x7fb77c0a7ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.571+0000 7fb79a88e640 1 --2- 172.21.15.87:0/3424050808 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb77c0a5610 0x7fb77c0a7ad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb78c006010 tx=0x7fb78c031730 comp rx=0 tx=0).stop 2024-09-13T17:15:32.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.571+0000 7fb79a88e640 1 -- 172.21.15.87:0/3424050808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb794103fb0 msgr2=0x7fb7941975f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.571+0000 7fb79a88e640 1 --2- 172.21.15.87:0/3424050808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb794103fb0 0x7fb7941975f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fb78800e9a0 tx=0x7fb78800ee60 comp rx=0 tx=0).stop 2024-09-13T17:15:32.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.571+0000 7fb79a88e640 1 -- 172.21.15.87:0/3424050808 shutdown_connections 2024-09-13T17:15:32.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.571+0000 7fb79a88e640 1 --2- 172.21.15.87:0/3424050808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb794197b30 0x7fb7941a2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.571+0000 7fb79a88e640 1 --2- 172.21.15.87:0/3424050808 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb77c0a5610 0x7fb77c0a7ad0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.571+0000 7fb79a88e640 1 --2- 172.21.15.87:0/3424050808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb794103fb0 0x7fb7941975f0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.571+0000 7fb79a88e640 1 --2- 172.21.15.87:0/3424050808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7940fee60 0x7fb7941970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.571+0000 7fb79a88e640 1 -- 172.21.15.87:0/3424050808 >> 172.21.15.87:0/3424050808 conn(0x7fb794075c60 msgr2=0x7fb7940fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:32.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.572+0000 7fb79a88e640 1 -- 172.21.15.87:0/3424050808 shutdown_connections 2024-09-13T17:15:32.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.572+0000 7fb79a88e640 1 -- 172.21.15.87:0/3424050808 wait complete. 2024-09-13T17:15:32.584 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-09-13T17:15:32.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.695+0000 7f47ca1d5640 1 -- 172.21.15.87:0/3590324926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47c41050c0 msgr2=0x7f47c410cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.695+0000 7f47ca1d5640 1 --2- 172.21.15.87:0/3590324926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47c41050c0 0x7f47c410cc10 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f47bc009cd0 tx=0x7f47bc02a8e0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.695+0000 7f47ca1d5640 1 -- 172.21.15.87:0/3590324926 shutdown_connections 2024-09-13T17:15:32.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.695+0000 7f47ca1d5640 1 --2- 172.21.15.87:0/3590324926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47c41050c0 0x7f47c410cc10 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.695+0000 7f47ca1d5640 1 --2- 172.21.15.87:0/3590324926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47c4100920 0x7f47c4104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.695+0000 7f47ca1d5640 1 --2- 172.21.15.87:0/3590324926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47c40fff70 0x7f47c4100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.695+0000 7f47ca1d5640 1 -- 172.21.15.87:0/3590324926 >> 172.21.15.87:0/3590324926 conn(0x7f47c40fba20 msgr2=0x7f47c40fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:32.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.695+0000 7f47ca1d5640 1 -- 172.21.15.87:0/3590324926 shutdown_connections 2024-09-13T17:15:32.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.695+0000 7f47ca1d5640 1 -- 172.21.15.87:0/3590324926 wait complete. 2024-09-13T17:15:32.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.695+0000 7f47ca1d5640 1 Processor -- start 2024-09-13T17:15:32.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.696+0000 7f47ca1d5640 1 -- start start 2024-09-13T17:15:32.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.696+0000 7f47ca1d5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47c40fff70 0x7f47c40727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.696+0000 7f47ca1d5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47c41050c0 0x7f47c4072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.696+0000 7f47ca1d5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47c4073230 0x7f47c41a4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.696+0000 7f47ca1d5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c41a4b60 con 0x7f47c41050c0 2024-09-13T17:15:32.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.696+0000 7f47ca1d5640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c41a4cd0 con 0x7f47c4073230 2024-09-13T17:15:32.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.696+0000 7f47ca1d5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c41a4e90 con 0x7f47c40fff70 2024-09-13T17:15:32.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.696+0000 7f47bbfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47c41050c0 0x7f47c4072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.696+0000 7f47c37fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47c40fff70 0x7f47c40727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.696+0000 7f47c3fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47c4073230 0x7f47c41a4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.696+0000 7f47bbfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47c41050c0 0x7f47c4072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59688/0 (socket says 172.21.15.87:59688) 2024-09-13T17:15:32.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.696+0000 7f47bbfff640 1 -- 172.21.15.87:0/2710823876 learned_addr learned my addr 172.21.15.87:0/2710823876 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:32.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.696+0000 7f47c37fe640 1 -- 172.21.15.87:0/2710823876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47c4073230 msgr2=0x7f47c41a4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.696+0000 7f47c37fe640 1 --2- 172.21.15.87:0/2710823876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47c4073230 0x7f47c41a4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.696+0000 7f47c37fe640 1 -- 172.21.15.87:0/2710823876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47c41050c0 msgr2=0x7f47c4072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.696+0000 7f47c37fe640 1 --2- 172.21.15.87:0/2710823876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47c41050c0 0x7f47c4072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.696+0000 7f47c37fe640 1 -- 172.21.15.87:0/2710823876 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47bc009900 con 0x7f47c40fff70 2024-09-13T17:15:32.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.696+0000 7f47bbfff640 1 --2- 172.21.15.87:0/2710823876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47c41050c0 0x7f47c4072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:15:32.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.696+0000 7f47c3fff640 1 --2- 172.21.15.87:0/2710823876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47c4073230 0x7f47c41a4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:15:32.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.696+0000 7f47c37fe640 1 --2- 172.21.15.87:0/2710823876 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47c40fff70 0x7f47c40727b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f47b400e9f0 tx=0x7f47b400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:32.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.697+0000 7f47c17fa640 1 -- 172.21.15.87:0/2710823876 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b400ccc0 con 0x7f47c40fff70 2024-09-13T17:15:32.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.697+0000 7f47ca1d5640 1 -- 172.21.15.87:0/2710823876 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47c41a5170 con 0x7f47c40fff70 2024-09-13T17:15:32.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.697+0000 7f47c17fa640 1 -- 172.21.15.87:0/2710823876 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f47b40044d0 con 0x7f47c40fff70 2024-09-13T17:15:32.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.697+0000 7f47c17fa640 1 -- 172.21.15.87:0/2710823876 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b4004a00 con 0x7f47c40fff70 2024-09-13T17:15:32.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.697+0000 7f47ca1d5640 1 -- 172.21.15.87:0/2710823876 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47c41a5680 con 0x7f47c40fff70 2024-09-13T17:15:32.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.699+0000 7f47c17fa640 1 -- 172.21.15.87:0/2710823876 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f47b4004b60 con 0x7f47c40fff70 2024-09-13T17:15:32.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.700+0000 7f47ccfcf740 1 Processor -- start 2024-09-13T17:15:32.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.700+0000 7f47ccfcf740 1 -- start start 2024-09-13T17:15:32.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.700+0000 7f47ccfcf740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568f4915790 0x5568f4915b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.700+0000 7f47ccfcf740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568f49160b0 0x5568f4920410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.700+0000 7f47ccfcf740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568f4920950 0x5568f4922d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.700+0000 7f47ccfcf740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f487fcc0 con 0x5568f4915790 2024-09-13T17:15:32.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.700+0000 7f47ccfcf740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f487d450 con 0x5568f49160b0 2024-09-13T17:15:32.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.700+0000 7f47ccfcf740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f4878d40 con 0x5568f4920950 2024-09-13T17:15:32.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.700+0000 7f47c3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568f4915790 0x5568f4915b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.700+0000 7f47c3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568f4915790 0x5568f4915b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59702/0 (socket says 172.21.15.87:59702) 2024-09-13T17:15:32.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.700+0000 7f47c37fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568f49160b0 0x5568f4920410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.700+0000 7f47c3fff640 1 -- 172.21.15.87:0/2040079396 learned_addr learned my addr 172.21.15.87:0/2040079396 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:32.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.700+0000 7f47bbfff640 1 --2- 172.21.15.87:0/2040079396 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568f4920950 0x5568f4922d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.700+0000 7f47c17fa640 1 --2- 172.21.15.87:0/2710823876 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f47b00a1200 0x7f47b00a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.701+0000 7f47c3fff640 1 -- 172.21.15.87:0/2040079396 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568f4920950 msgr2=0x5568f4922d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:32.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.701+0000 7f47c3fff640 1 --2- 172.21.15.87:0/2040079396 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568f4920950 0x5568f4922d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.701+0000 7f47c3fff640 1 -- 172.21.15.87:0/2040079396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568f49160b0 msgr2=0x5568f4920410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:32.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.701+0000 7f47c3fff640 1 --2- 172.21.15.87:0/2040079396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568f49160b0 0x5568f4920410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.701+0000 7f47c3fff640 1 -- 172.21.15.87:0/2040079396 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568f4840620 con 0x5568f4915790 2024-09-13T17:15:32.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.701+0000 7f47c17fa640 1 -- 172.21.15.87:0/2710823876 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f47b4014070 con 0x7f47c40fff70 2024-09-13T17:15:32.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.701+0000 7f47c3fff640 1 --2- 172.21.15.87:0/2710823876 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f47b00a1200 0x7f47b00a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.701+0000 7f47c3fff640 1 --2- 172.21.15.87:0/2040079396 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568f4915790 0x5568f4915b70 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f47bc009cd0 tx=0x7f47bc005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=603923678da3dd5d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:32.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.701+0000 7f47b9ffb640 1 -- 172.21.15.87:0/2040079396 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc04d070 con 0x5568f4915790 2024-09-13T17:15:32.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.701+0000 7f47b9ffb640 1 -- 172.21.15.87:0/2040079396 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f47bc031d20 con 0x5568f4915790 2024-09-13T17:15:32.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.701+0000 7f47b9ffb640 1 -- 172.21.15.87:0/2040079396 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc004240 con 0x5568f4915790 2024-09-13T17:15:32.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.701+0000 7f47c3fff640 1 --2- 172.21.15.87:0/2710823876 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f47b00a1200 0x7f47b00a36c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f47bc04c000 tx=0x7f47bc049000 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:32.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.702+0000 7f47ccfcf740 1 -- 172.21.15.87:0/2040079396 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568f4915790 msgr2=0x5568f4915b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.702+0000 7f47ccfcf740 1 --2- 172.21.15.87:0/2040079396 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568f4915790 0x5568f4915b70 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f47bc009cd0 tx=0x7f47bc005fa0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.702+0000 7f47ccfcf740 1 -- 172.21.15.87:0/2040079396 shutdown_connections 2024-09-13T17:15:32.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.702+0000 7f47ccfcf740 1 --2- 172.21.15.87:0/2040079396 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568f4920950 0x5568f4922d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.702+0000 7f47ccfcf740 1 --2- 172.21.15.87:0/2040079396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568f49160b0 0x5568f4920410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.702+0000 7f47ccfcf740 1 --2- 172.21.15.87:0/2040079396 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568f4915790 0x5568f4915b70 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.702+0000 7f47ccfcf740 1 -- 172.21.15.87:0/2040079396 >> 172.21.15.87:0/2040079396 conn(0x5568f4911d00 msgr2=0x5568f49120e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:32.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.702+0000 7f47ccfcf740 1 -- 172.21.15.87:0/2040079396 shutdown_connections 2024-09-13T17:15:32.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.702+0000 7f47ccfcf740 1 -- 172.21.15.87:0/2040079396 wait complete. 2024-09-13T17:15:32.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.702+0000 7f47ccfcf740 1 -- start start 2024-09-13T17:15:32.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.703+0000 7f47ccfcf740 1 Processor -- start 2024-09-13T17:15:32.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.703+0000 7f47ccfcf740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568f4915790 0x5568f491fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.703+0000 7f47ccfcf740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568f49160b0 0x5568f4920410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.703+0000 7f47ccfcf740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568f4920950 0x5568f491d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.703+0000 7f47ccfcf740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f4837180 con 0x5568f4920950 2024-09-13T17:15:32.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.703+0000 7f47ccfcf740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f4551430 con 0x5568f4915790 2024-09-13T17:15:32.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.703+0000 7f47ccfcf740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f47fc5e0 con 0x5568f49160b0 2024-09-13T17:15:32.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.703+0000 7f47ccfcf740 10 client.0 _ll_register_callbacks cb 0x5568f4868aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:32.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.703+0000 7f47c3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568f4920950 0x5568f491d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.703+0000 7f47c3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568f4920950 0x5568f491d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59706/0 (socket says 172.21.15.87:59706) 2024-09-13T17:15:32.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.703+0000 7f47c3fff640 1 -- 172.21.15.87:0/2209312979 learned_addr learned my addr 172.21.15.87:0/2209312979 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:32.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.703+0000 7f47bbfff640 1 --2- 172.21.15.87:0/2209312979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568f49160b0 0x5568f4920410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.703+0000 7f47c37fe640 1 --2- 172.21.15.87:0/2209312979 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568f4915790 0x5568f491fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.703+0000 7f47c3fff640 1 -- 172.21.15.87:0/2209312979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568f49160b0 msgr2=0x5568f4920410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:32.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.703+0000 7f47c3fff640 1 --2- 172.21.15.87:0/2209312979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568f49160b0 0x5568f4920410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.703+0000 7f47c3fff640 1 -- 172.21.15.87:0/2209312979 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568f4915790 msgr2=0x5568f491fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:32.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.703+0000 7f47c3fff640 1 --2- 172.21.15.87:0/2209312979 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568f4915790 0x5568f491fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.703+0000 7f47c3fff640 1 -- 172.21.15.87:0/2209312979 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47c410d450 con 0x5568f4920950 2024-09-13T17:15:32.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.703+0000 7f47c37fe640 1 --2- 172.21.15.87:0/2209312979 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568f4915790 0x5568f491fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:32.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.704+0000 7f47c3fff640 1 --2- 172.21.15.87:0/2209312979 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568f4920950 0x5568f491d500 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f47bc02ae00 tx=0x7f47bc003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=565995b1cd80baa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:32.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.704+0000 7f47a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:15:32.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.704+0000 7f47a2ffd640 1 -- 172.21.15.87:0/2209312979 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc04d040 con 0x5568f4920950 2024-09-13T17:15:32.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.704+0000 7f47a2ffd640 1 -- 172.21.15.87:0/2209312979 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f47bc044030 con 0x5568f4920950 2024-09-13T17:15:32.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.704+0000 7f47ccfcf740 1 -- 172.21.15.87:0/2209312979 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5568f48a2b80 con 0x5568f4920950 2024-09-13T17:15:32.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.704+0000 7f47a2ffd640 1 -- 172.21.15.87:0/2209312979 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47bc030e90 con 0x5568f4920950 2024-09-13T17:15:32.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.704+0000 7f47ccfcf740 10 client.16167 fetch_fsmap learned FSMap version 26 2024-09-13T17:15:32.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.704+0000 7f47ccfcf740 1 -- 172.21.15.87:0/2209312979 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5568f48773c0 con 0x5568f4920950 2024-09-13T17:15:32.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.704+0000 7f47a2ffd640 1 -- 172.21.15.87:0/2209312979 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x5568f48a2b80 con 0x5568f4920950 2024-09-13T17:15:32.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.704+0000 7f47a2ffd640 1 -- 172.21.15.87:0/2209312979 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f47bc052c70 con 0x5568f4920950 2024-09-13T17:15:32.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.704+0000 7f47ccfcf740 10 client.16167 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T17:15:32.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.704+0000 7f47ccfcf740 10 client.16167 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:15:32.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.704+0000 7f47ccfcf740 20 client.16167 populate_metadata read hostname 'smithi087' 2024-09-13T17:15:32.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.704+0000 7f47ccfcf740 1 --2- 172.21.15.87:0/2209312979 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5568f492feb0 0x5568f49322a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.704+0000 7f47ccfcf740 4 client.16167 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:15:32.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.704+0000 7f47ccfcf740 1 -- 172.21.15.87:0/2209312979 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5568f486b1f0 con 0x5568f492feb0 2024-09-13T17:15:32.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.705+0000 7f47c37fe640 1 --2- 172.21.15.87:0/2209312979 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5568f492feb0 0x5568f49322a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.705+0000 7f47a2ffd640 10 client.16167 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:15:32.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.705+0000 7f47c37fe640 1 --2- 172.21.15.87:0/2209312979 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5568f492feb0 0x5568f49322a0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f9b83b077579b8f4 server_cookie=3d443ceaa0e69f13 in_seq=0 out_seq=0 2024-09-13T17:15:32.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.705+0000 7f47a2ffd640 1 -- 172.21.15.87:0/2209312979 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5568f486b1f0 con 0x5568f492feb0 2024-09-13T17:15:32.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.706+0000 7f47a2ffd640 10 client.16167 handle_command_reply: tid=0 2024-09-13T17:15:32.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.706+0000 7f47ccfcf740 1 client.16167 shutdown 2024-09-13T17:15:32.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.706+0000 7f47ccfcf740 1 -- 172.21.15.87:0/2209312979 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568f4920950 msgr2=0x5568f491d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.706+0000 7f47ccfcf740 1 --2- 172.21.15.87:0/2209312979 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568f4920950 0x5568f491d500 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f47bc02ae00 tx=0x7f47bc003ba0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.706+0000 7f47ccfcf740 1 -- 172.21.15.87:0/2209312979 shutdown_connections 2024-09-13T17:15:32.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.706+0000 7f47ccfcf740 1 --2- 172.21.15.87:0/2209312979 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5568f492feb0 0x5568f49322a0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.706+0000 7f47ccfcf740 1 --2- 172.21.15.87:0/2209312979 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568f4920950 0x5568f491d500 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.706+0000 7f47a2ffd640 0 client.16167 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:15:32.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.706+0000 7f47ccfcf740 1 --2- 172.21.15.87:0/2209312979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568f49160b0 0x5568f4920410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.706+0000 7f47ccfcf740 1 --2- 172.21.15.87:0/2209312979 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568f4915790 0x5568f491fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.706+0000 7f47ccfcf740 1 -- 172.21.15.87:0/2209312979 >> 172.21.15.87:0/2209312979 conn(0x5568f4911d00 msgr2=0x5568f4917a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:32.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.706+0000 7f47ccfcf740 1 -- 172.21.15.87:0/2209312979 shutdown_connections 2024-09-13T17:15:32.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.706+0000 7f47ccfcf740 1 -- 172.21.15.87:0/2209312979 wait complete. 2024-09-13T17:15:32.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.706+0000 7f47ccfcf740 20 client.16167 trim_cache size 0 max 16384 2024-09-13T17:15:32.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.717+0000 7f47ccfcf740 1 Processor -- start 2024-09-13T17:15:32.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.718+0000 7f47ccfcf740 1 -- start start 2024-09-13T17:15:32.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.718+0000 7f47ccfcf740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568f4915790 0x5568f491bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.718+0000 7f47ccfcf740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568f49160b0 0x5568f491c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.718+0000 7f47ccfcf740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568f4920950 0x5568f4918360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.718+0000 7f47ccfcf740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f48a2b80 con 0x5568f4920950 2024-09-13T17:15:32.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.718+0000 7f47ccfcf740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f4916930 con 0x5568f4915790 2024-09-13T17:15:32.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.718+0000 7f47ccfcf740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f490c3b0 con 0x5568f49160b0 2024-09-13T17:15:32.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.718+0000 7f47c3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568f4920950 0x5568f4918360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.718+0000 7f47c37fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568f4915790 0x5568f491bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.718+0000 7f47c3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568f4920950 0x5568f4918360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59712/0 (socket says 172.21.15.87:59712) 2024-09-13T17:15:32.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.718+0000 7f47c3fff640 1 -- 172.21.15.87:0/129166236 learned_addr learned my addr 172.21.15.87:0/129166236 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:32.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.718+0000 7f47bbfff640 1 --2- 172.21.15.87:0/129166236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568f49160b0 0x5568f491c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.718+0000 7f47c3fff640 1 -- 172.21.15.87:0/129166236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568f49160b0 msgr2=0x5568f491c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:32.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.718+0000 7f47c3fff640 1 --2- 172.21.15.87:0/129166236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568f49160b0 0x5568f491c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.718+0000 7f47c3fff640 1 -- 172.21.15.87:0/129166236 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568f4915790 msgr2=0x5568f491bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:32.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.718+0000 7f47c3fff640 1 --2- 172.21.15.87:0/129166236 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568f4915790 0x5568f491bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.718+0000 7f47c3fff640 1 -- 172.21.15.87:0/129166236 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568f4819770 con 0x5568f4920950 2024-09-13T17:15:32.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.718+0000 7f47c37fe640 1 --2- 172.21.15.87:0/129166236 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568f4915790 0x5568f491bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:15:32.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.718+0000 7f47c3fff640 1 --2- 172.21.15.87:0/129166236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568f4920950 0x5568f4918360 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f47bc002230 tx=0x7f47bc005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4987529d80660dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:32.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.718+0000 7f47ba7fc640 1 -- 172.21.15.87:0/129166236 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc04d040 con 0x5568f4920950 2024-09-13T17:15:32.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.719+0000 7f47ba7fc640 1 -- 172.21.15.87:0/129166236 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f47bc005bd0 con 0x5568f4920950 2024-09-13T17:15:32.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.719+0000 7f47ba7fc640 1 -- 172.21.15.87:0/129166236 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc03cca0 con 0x5568f4920950 2024-09-13T17:15:32.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.719+0000 7f47ccfcf740 1 -- 172.21.15.87:0/129166236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568f4920950 msgr2=0x5568f4918360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.719+0000 7f47ccfcf740 1 --2- 172.21.15.87:0/129166236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568f4920950 0x5568f4918360 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f47bc002230 tx=0x7f47bc005ef0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.719+0000 7f47ccfcf740 1 -- 172.21.15.87:0/129166236 shutdown_connections 2024-09-13T17:15:32.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.719+0000 7f47ccfcf740 1 --2- 172.21.15.87:0/129166236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568f4920950 0x5568f4918360 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.719+0000 7f47ccfcf740 1 --2- 172.21.15.87:0/129166236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568f49160b0 0x5568f491c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.719+0000 7f47ccfcf740 1 --2- 172.21.15.87:0/129166236 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568f4915790 0x5568f491bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.719+0000 7f47ccfcf740 1 -- 172.21.15.87:0/129166236 >> 172.21.15.87:0/129166236 conn(0x5568f4911d00 msgr2=0x5568f4936c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:32.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.719+0000 7f47ccfcf740 1 -- 172.21.15.87:0/129166236 shutdown_connections 2024-09-13T17:15:32.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.719+0000 7f47ccfcf740 1 -- 172.21.15.87:0/129166236 wait complete. 2024-09-13T17:15:32.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.720+0000 7f47ccfcf740 1 -- start start 2024-09-13T17:15:32.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.720+0000 7f47ccfcf740 1 Processor -- start 2024-09-13T17:15:32.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.720+0000 7f47ccfcf740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568f4915790 0x5568f4927790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.720+0000 7f47ccfcf740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568f49160b0 0x5568f4923c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.720+0000 7f47ccfcf740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568f4920950 0x5568f4924170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.720+0000 7f47ccfcf740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f49246b0 con 0x5568f4920950 2024-09-13T17:15:32.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.720+0000 7f47ccfcf740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f4924820 con 0x5568f4915790 2024-09-13T17:15:32.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.720+0000 7f47ccfcf740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f49249e0 con 0x5568f49160b0 2024-09-13T17:15:32.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.720+0000 7f47ccfcf740 10 client.0 _ll_register_callbacks cb 0x7f47bc009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:32.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.720+0000 7f47c3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568f4920950 0x5568f4924170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.720+0000 7f47bbfff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568f49160b0 0x5568f4923c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.720+0000 7f47bbfff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568f49160b0 0x5568f4923c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:38994/0 (socket says 172.21.15.87:38994) 2024-09-13T17:15:32.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.720+0000 7f47bbfff640 1 -- 172.21.15.87:0/1988018273 learned_addr learned my addr 172.21.15.87:0/1988018273 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:32.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.720+0000 7f47c3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568f4920950 0x5568f4924170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59718/0 (socket says 172.21.15.87:59718) 2024-09-13T17:15:32.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.720+0000 7f47c37fe640 1 --2- 172.21.15.87:0/1988018273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568f4915790 0x5568f4927790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.721+0000 7f47bbfff640 1 -- 172.21.15.87:0/1988018273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568f4915790 msgr2=0x5568f4927790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:32.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.721+0000 7f47bbfff640 1 --2- 172.21.15.87:0/1988018273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568f4915790 0x5568f4927790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.721+0000 7f47bbfff640 1 -- 172.21.15.87:0/1988018273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568f4920950 msgr2=0x5568f4924170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:32.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.721+0000 7f47bbfff640 1 --2- 172.21.15.87:0/1988018273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568f4920950 0x5568f4924170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.721+0000 7f47bbfff640 1 -- 172.21.15.87:0/1988018273 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47c41a5680 con 0x5568f49160b0 2024-09-13T17:15:32.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.721+0000 7f47c3fff640 1 --2- 172.21.15.87:0/1988018273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568f4920950 0x5568f4924170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:15:32.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.721+0000 7f47bbfff640 1 --2- 172.21.15.87:0/1988018273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568f49160b0 0x5568f4923c30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f47c40742b0 tx=0x7f47ac003a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a5a7549682ced9e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:32.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.721+0000 7f47a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-09-13T17:15:32.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.721+0000 7f47a2ffd640 1 -- 172.21.15.87:0/1988018273 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ac016070 con 0x5568f49160b0 2024-09-13T17:15:32.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.721+0000 7f47a2ffd640 1 -- 172.21.15.87:0/1988018273 <== mon.1 v2:172.21.15.149:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f47ac011a50 con 0x5568f49160b0 2024-09-13T17:15:32.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.721+0000 7f47ccfcf740 1 -- 172.21.15.87:0/1988018273 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f47bc031d20 con 0x5568f49160b0 2024-09-13T17:15:32.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.721+0000 7f47a2ffd640 1 -- 172.21.15.87:0/1988018273 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47ac011c10 con 0x5568f49160b0 2024-09-13T17:15:32.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.721+0000 7f47ccfcf740 10 client.25582 fetch_fsmap learned FSMap version 26 2024-09-13T17:15:32.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.721+0000 7f47ccfcf740 1 -- 172.21.15.87:0/1988018273 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5568f48773c0 con 0x5568f49160b0 2024-09-13T17:15:32.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.722+0000 7f47a2ffd640 1 -- 172.21.15.87:0/1988018273 <== mon.1 v2:172.21.15.149:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f47bc031d20 con 0x5568f49160b0 2024-09-13T17:15:32.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.722+0000 7f47a2ffd640 1 -- 172.21.15.87:0/1988018273 <== mon.1 v2:172.21.15.149:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f47ac010430 con 0x5568f49160b0 2024-09-13T17:15:32.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.722+0000 7f47ccfcf740 10 client.25582 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T17:15:32.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.722+0000 7f47ccfcf740 10 client.25582 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:15:32.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.722+0000 7f47ccfcf740 20 client.25582 populate_metadata read hostname 'smithi087' 2024-09-13T17:15:32.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.722+0000 7f47ccfcf740 1 --2- 172.21.15.87:0/1988018273 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5568f49878c0 0x5568f4989ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.722+0000 7f47ccfcf740 4 client.25582 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:15:32.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.722+0000 7f47ccfcf740 1 -- 172.21.15.87:0/1988018273 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5568f456c4e0 con 0x5568f49878c0 2024-09-13T17:15:32.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.722+0000 7f47c37fe640 1 --2- 172.21.15.87:0/1988018273 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5568f49878c0 0x5568f4989ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.722+0000 7f47a2ffd640 10 client.25582 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:15:32.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.722+0000 7f47c37fe640 1 --2- 172.21.15.87:0/1988018273 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5568f49878c0 0x5568f4989ce0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=43080f0700063861 server_cookie=42c54c05c2f0152d in_seq=0 out_seq=0 2024-09-13T17:15:32.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.723+0000 7f47a2ffd640 1 -- 172.21.15.87:0/1988018273 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5568f456c4e0 con 0x5568f49878c0 2024-09-13T17:15:32.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.723+0000 7f47a2ffd640 10 client.25582 handle_command_reply: tid=0 2024-09-13T17:15:32.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.723+0000 7f47ccfcf740 1 client.25582 shutdown 2024-09-13T17:15:32.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.723+0000 7f47ccfcf740 1 -- 172.21.15.87:0/1988018273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568f49160b0 msgr2=0x5568f4923c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.723+0000 7f47ccfcf740 1 --2- 172.21.15.87:0/1988018273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568f49160b0 0x5568f4923c30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f47c40742b0 tx=0x7f47ac003a80 comp rx=0 tx=0).stop 2024-09-13T17:15:32.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.723+0000 7f47ccfcf740 1 -- 172.21.15.87:0/1988018273 shutdown_connections 2024-09-13T17:15:32.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.723+0000 7f47ccfcf740 1 --2- 172.21.15.87:0/1988018273 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5568f49878c0 0x5568f4989ce0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.724+0000 7f47ccfcf740 1 --2- 172.21.15.87:0/1988018273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568f4920950 0x5568f4924170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.724+0000 7f47a2ffd640 0 client.25582 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:15:32.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.724+0000 7f47ccfcf740 1 --2- 172.21.15.87:0/1988018273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5568f49160b0 0x5568f4923c30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.724+0000 7f47ccfcf740 1 --2- 172.21.15.87:0/1988018273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568f4915790 0x5568f4927790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.724+0000 7f47ccfcf740 1 -- 172.21.15.87:0/1988018273 >> 172.21.15.87:0/1988018273 conn(0x5568f4911d00 msgr2=0x5568f492c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:32.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.724+0000 7f47ccfcf740 1 -- 172.21.15.87:0/1988018273 shutdown_connections 2024-09-13T17:15:32.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.724+0000 7f47ccfcf740 1 -- 172.21.15.87:0/1988018273 wait complete. 2024-09-13T17:15:32.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.724+0000 7f47ccfcf740 20 client.25582 trim_cache size 0 max 16384 2024-09-13T17:15:32.731 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:15:32.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.724+0000 7f47ca1d5640 1 -- 172.21.15.87:0/2710823876 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f47b00a1200 msgr2=0x7f47b00a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.724+0000 7f47ca1d5640 1 --2- 172.21.15.87:0/2710823876 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f47b00a1200 0x7f47b00a36c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f47bc04c000 tx=0x7f47bc049000 comp rx=0 tx=0).stop 2024-09-13T17:15:32.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.724+0000 7f47ca1d5640 1 -- 172.21.15.87:0/2710823876 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47c40fff70 msgr2=0x7f47c40727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.724+0000 7f47ca1d5640 1 --2- 172.21.15.87:0/2710823876 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47c40fff70 0x7f47c40727b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f47b400e9f0 tx=0x7f47b400eeb0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.724+0000 7f47ca1d5640 1 -- 172.21.15.87:0/2710823876 shutdown_connections 2024-09-13T17:15:32.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.724+0000 7f47ca1d5640 1 --2- 172.21.15.87:0/2710823876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47c4073230 0x7f47c41a4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.724+0000 7f47ca1d5640 1 --2- 172.21.15.87:0/2710823876 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f47b00a1200 0x7f47b00a36c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.724+0000 7f47ca1d5640 1 --2- 172.21.15.87:0/2710823876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47c41050c0 0x7f47c4072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.724+0000 7f47ca1d5640 1 --2- 172.21.15.87:0/2710823876 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47c40fff70 0x7f47c40727b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.724+0000 7f47ca1d5640 1 -- 172.21.15.87:0/2710823876 >> 172.21.15.87:0/2710823876 conn(0x7f47c40fba20 msgr2=0x7f47c40fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:32.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.724+0000 7f47ca1d5640 1 -- 172.21.15.87:0/2710823876 shutdown_connections 2024-09-13T17:15:32.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.724+0000 7f47ca1d5640 1 -- 172.21.15.87:0/2710823876 wait complete. 2024-09-13T17:15:32.733 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:32 smithi087 ceph-mon[30934]: pgmap v54: 129 pgs: 129 active+clean; 123 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.1 MiB/s wr, 1.11k op/s 2024-09-13T17:15:32.733 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:32 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1084407323' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:15:32.737 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-09-13T17:15:32.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:32 smithi149 ceph-mon[35496]: pgmap v54: 129 pgs: 129 active+clean; 123 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.1 MiB/s wr, 1.11k op/s 2024-09-13T17:15:32.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:32 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1084407323' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:15:32.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.843+0000 7fe945b9c640 1 -- 172.21.15.87:0/52022976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9400fee60 msgr2=0x7fe9400ff240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.843+0000 7fe945b9c640 1 --2- 172.21.15.87:0/52022976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9400fee60 0x7fe9400ff240 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fe930009930 tx=0x7fe93002a420 comp rx=0 tx=0).stop 2024-09-13T17:15:32.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.844+0000 7fe945b9c640 1 -- 172.21.15.87:0/52022976 shutdown_connections 2024-09-13T17:15:32.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.844+0000 7fe945b9c640 1 --2- 172.21.15.87:0/52022976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe940103fb0 0x7fe94010bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.844+0000 7fe945b9c640 1 --2- 172.21.15.87:0/52022976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9400ff810 0x7fe940103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.844+0000 7fe945b9c640 1 --2- 172.21.15.87:0/52022976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9400fee60 0x7fe9400ff240 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.844+0000 7fe945b9c640 1 -- 172.21.15.87:0/52022976 >> 172.21.15.87:0/52022976 conn(0x7fe940075c60 msgr2=0x7fe9400fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:32.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.844+0000 7fe945b9c640 1 -- 172.21.15.87:0/52022976 shutdown_connections 2024-09-13T17:15:32.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.844+0000 7fe945b9c640 1 -- 172.21.15.87:0/52022976 wait complete. 2024-09-13T17:15:32.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.844+0000 7fe945b9c640 1 Processor -- start 2024-09-13T17:15:32.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.844+0000 7fe945b9c640 1 -- start start 2024-09-13T17:15:32.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.845+0000 7fe945b9c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9400fee60 0x7fe9401970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.845+0000 7fe945b9c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe940103fb0 0x7fe940197610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.845+0000 7fe945b9c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe940197b50 0x7fe9401a2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.845+0000 7fe945b9c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9401a27f0 con 0x7fe940197b50 2024-09-13T17:15:32.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.845+0000 7fe945b9c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9401a2960 con 0x7fe940103fb0 2024-09-13T17:15:32.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.845+0000 7fe945b9c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9401a2b20 con 0x7fe9400fee60 2024-09-13T17:15:32.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.845+0000 7fe93ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe940197b50 0x7fe9401a2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.845+0000 7fe93f7fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9400fee60 0x7fe9401970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.845+0000 7fe93ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe940197b50 0x7fe9401a2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59740/0 (socket says 172.21.15.87:59740) 2024-09-13T17:15:32.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.845+0000 7fe93ffff640 1 -- 172.21.15.87:0/1544374245 learned_addr learned my addr 172.21.15.87:0/1544374245 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:32.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.845+0000 7fe93effd640 1 --2- 172.21.15.87:0/1544374245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe940103fb0 0x7fe940197610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.845+0000 7fe93ffff640 1 -- 172.21.15.87:0/1544374245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9400fee60 msgr2=0x7fe9401970d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.845+0000 7fe93ffff640 1 --2- 172.21.15.87:0/1544374245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9400fee60 0x7fe9401970d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.845+0000 7fe93ffff640 1 -- 172.21.15.87:0/1544374245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe940103fb0 msgr2=0x7fe940197610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.845+0000 7fe93ffff640 1 --2- 172.21.15.87:0/1544374245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe940103fb0 0x7fe940197610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.845+0000 7fe93ffff640 1 -- 172.21.15.87:0/1544374245 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe930009560 con 0x7fe940197b50 2024-09-13T17:15:32.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.845+0000 7fe93effd640 1 --2- 172.21.15.87:0/1544374245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe940103fb0 0x7fe940197610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:32.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.845+0000 7fe93ffff640 1 --2- 172.21.15.87:0/1544374245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe940197b50 0x7fe9401a2150 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fe93800ea60 tx=0x7fe93800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:32.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.845+0000 7fe93cff9640 1 -- 172.21.15.87:0/1544374245 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93800ce40 con 0x7fe940197b50 2024-09-13T17:15:32.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.845+0000 7fe93cff9640 1 -- 172.21.15.87:0/1544374245 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe938005020 con 0x7fe940197b50 2024-09-13T17:15:32.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.845+0000 7fe93cff9640 1 -- 172.21.15.87:0/1544374245 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe938010690 con 0x7fe940197b50 2024-09-13T17:15:32.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.845+0000 7fe945b9c640 1 -- 172.21.15.87:0/1544374245 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9401a2e00 con 0x7fe940197b50 2024-09-13T17:15:32.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.845+0000 7fe945b9c640 1 -- 172.21.15.87:0/1544374245 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9401a3290 con 0x7fe940197b50 2024-09-13T17:15:32.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.848+0000 7fe93cff9640 1 -- 172.21.15.87:0/1544374245 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fe938005190 con 0x7fe940197b50 2024-09-13T17:15:32.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.848+0000 7fe9488b9740 1 Processor -- start 2024-09-13T17:15:32.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.848+0000 7fe9488b9740 1 -- start start 2024-09-13T17:15:32.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.849+0000 7fe9488b9740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563f29575790 0x563f29575b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.849+0000 7fe9488b9740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f295760b0 0x563f29580410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.849+0000 7fe9488b9740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f29580950 0x563f29582d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.849+0000 7fe9488b9740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f294dfcc0 con 0x563f295760b0 2024-09-13T17:15:32.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.849+0000 7fe9488b9740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f294dd450 con 0x563f29580950 2024-09-13T17:15:32.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.849+0000 7fe9488b9740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f294d8d40 con 0x563f29575790 2024-09-13T17:15:32.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.849+0000 7fe93cff9640 1 --2- 172.21.15.87:0/1544374245 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe9280a1280 0x7fe9280a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.849+0000 7fe93f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f295760b0 0x563f29580410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.849+0000 7fe93effd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563f29575790 0x563f29575b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.849+0000 7fe93f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f295760b0 0x563f29580410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59754/0 (socket says 172.21.15.87:59754) 2024-09-13T17:15:32.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.849+0000 7fe93f7fe640 1 -- 172.21.15.87:0/202138926 learned_addr learned my addr 172.21.15.87:0/202138926 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:32.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.849+0000 7fe93effd640 1 --2- 172.21.15.87:0/202138926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f29580950 0x563f29582d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.849+0000 7fe93ffff640 1 --2- 172.21.15.87:0/1544374245 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe9280a1280 0x7fe9280a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.849+0000 7fe93cff9640 1 -- 172.21.15.87:0/1544374245 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fe938014070 con 0x7fe940197b50 2024-09-13T17:15:32.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.849+0000 7fe93effd640 1 -- 172.21.15.87:0/202138926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f29580950 msgr2=0x563f29582d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:32.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.849+0000 7fe93effd640 1 --2- 172.21.15.87:0/202138926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f29580950 0x563f29582d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.849+0000 7fe93effd640 1 -- 172.21.15.87:0/202138926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f295760b0 msgr2=0x563f29580410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:32.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.849+0000 7fe93effd640 1 --2- 172.21.15.87:0/202138926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f295760b0 0x563f29580410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.849+0000 7fe93effd640 1 -- 172.21.15.87:0/202138926 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f294a0620 con 0x563f29575790 2024-09-13T17:15:32.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.849+0000 7fe93ffff640 1 --2- 172.21.15.87:0/1544374245 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe9280a1280 0x7fe9280a3740 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe9380ca980 tx=0x7fe93806c370 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:32.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.849+0000 7fe93effd640 1 --2- 172.21.15.87:0/202138926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563f29575790 0x563f29575b70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe940072f50 tx=0x7fe934009680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6429a786c4c5ef5d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:32.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.850+0000 7fe925ffb640 1 -- 172.21.15.87:0/202138926 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe934012ca0 con 0x563f29575790 2024-09-13T17:15:32.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.850+0000 7fe925ffb640 1 -- 172.21.15.87:0/202138926 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe9340044f0 con 0x563f29575790 2024-09-13T17:15:32.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.850+0000 7fe925ffb640 1 -- 172.21.15.87:0/202138926 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9340035f0 con 0x563f29575790 2024-09-13T17:15:32.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.850+0000 7fe9488b9740 1 -- 172.21.15.87:0/202138926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563f29575790 msgr2=0x563f29575b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.850+0000 7fe9488b9740 1 --2- 172.21.15.87:0/202138926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563f29575790 0x563f29575b70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe940072f50 tx=0x7fe934009680 comp rx=0 tx=0).stop 2024-09-13T17:15:32.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.850+0000 7fe9488b9740 1 -- 172.21.15.87:0/202138926 shutdown_connections 2024-09-13T17:15:32.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.850+0000 7fe9488b9740 1 --2- 172.21.15.87:0/202138926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f29580950 0x563f29582d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.850+0000 7fe9488b9740 1 --2- 172.21.15.87:0/202138926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f295760b0 0x563f29580410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.850+0000 7fe9488b9740 1 --2- 172.21.15.87:0/202138926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563f29575790 0x563f29575b70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.850+0000 7fe9488b9740 1 -- 172.21.15.87:0/202138926 >> 172.21.15.87:0/202138926 conn(0x563f29571d00 msgr2=0x563f295720e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:32.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.850+0000 7fe9488b9740 1 -- 172.21.15.87:0/202138926 shutdown_connections 2024-09-13T17:15:32.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.850+0000 7fe9488b9740 1 -- 172.21.15.87:0/202138926 wait complete. 2024-09-13T17:15:32.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.851+0000 7fe9488b9740 1 -- start start 2024-09-13T17:15:32.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.851+0000 7fe9488b9740 1 Processor -- start 2024-09-13T17:15:32.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.851+0000 7fe9488b9740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f29575790 0x563f2957ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.851+0000 7fe9488b9740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563f295760b0 0x563f2957d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.851+0000 7fe9488b9740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f29580950 0x563f2957d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.851+0000 7fe9488b9740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f29497180 con 0x563f29575790 2024-09-13T17:15:32.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.851+0000 7fe9488b9740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f291b1430 con 0x563f29580950 2024-09-13T17:15:32.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.851+0000 7fe9488b9740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f2945c5e0 con 0x563f295760b0 2024-09-13T17:15:32.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.851+0000 7fe9488b9740 10 client.0 _ll_register_callbacks cb 0x563f294c8aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:32.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.851+0000 7fe93effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f29575790 0x563f2957ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.851+0000 7fe93f7fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563f295760b0 0x563f2957d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.851+0000 7fe93effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f29575790 0x563f2957ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59756/0 (socket says 172.21.15.87:59756) 2024-09-13T17:15:32.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.851+0000 7fe93effd640 1 -- 172.21.15.87:0/3763110250 learned_addr learned my addr 172.21.15.87:0/3763110250 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:32.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.851+0000 7fe93effd640 1 --2- 172.21.15.87:0/3763110250 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f29580950 0x563f2957d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.852+0000 7fe93f7fe640 1 -- 172.21.15.87:0/3763110250 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f29580950 msgr2=0x563f2957d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:32.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.852+0000 7fe93f7fe640 1 --2- 172.21.15.87:0/3763110250 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f29580950 0x563f2957d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.852+0000 7fe93f7fe640 1 -- 172.21.15.87:0/3763110250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f29575790 msgr2=0x563f2957ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:32.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.852+0000 7fe93f7fe640 1 --2- 172.21.15.87:0/3763110250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f29575790 0x563f2957ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.852+0000 7fe93f7fe640 1 -- 172.21.15.87:0/3763110250 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe93401a040 con 0x563f295760b0 2024-09-13T17:15:32.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.852+0000 7fe93effd640 1 --2- 172.21.15.87:0/3763110250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f29575790 0x563f2957ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:15:32.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.852+0000 7fe93f7fe640 1 --2- 172.21.15.87:0/3763110250 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563f295760b0 0x563f2957d3a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe930000c00 tx=0x7fe930031f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b399ed802f09ec6a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:32.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.852+0000 7fe91effd640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-09-13T17:15:32.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.852+0000 7fe91effd640 1 -- 172.21.15.87:0/3763110250 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe930004040 con 0x563f295760b0 2024-09-13T17:15:32.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.852+0000 7fe91effd640 1 -- 172.21.15.87:0/3763110250 <== mon.1 v2:172.21.15.149:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fe9300041a0 con 0x563f295760b0 2024-09-13T17:15:32.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.852+0000 7fe9488b9740 1 -- 172.21.15.87:0/3763110250 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563f29502b80 con 0x563f295760b0 2024-09-13T17:15:32.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.852+0000 7fe91effd640 1 -- 172.21.15.87:0/3763110250 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe930004360 con 0x563f295760b0 2024-09-13T17:15:32.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.852+0000 7fe9488b9740 10 client.25594 fetch_fsmap learned FSMap version 26 2024-09-13T17:15:32.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.852+0000 7fe9488b9740 1 -- 172.21.15.87:0/3763110250 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563f294d73c0 con 0x563f295760b0 2024-09-13T17:15:32.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.852+0000 7fe91effd640 1 -- 172.21.15.87:0/3763110250 <== mon.1 v2:172.21.15.149:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x563f29502b80 con 0x563f295760b0 2024-09-13T17:15:32.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.853+0000 7fe91effd640 1 -- 172.21.15.87:0/3763110250 <== mon.1 v2:172.21.15.149:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fe930004b50 con 0x563f295760b0 2024-09-13T17:15:32.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.853+0000 7fe9488b9740 10 client.25594 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T17:15:32.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.853+0000 7fe9488b9740 10 client.25594 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:15:32.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.853+0000 7fe9488b9740 20 client.25594 populate_metadata read hostname 'smithi087' 2024-09-13T17:15:32.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.853+0000 7fe9488b9740 1 --2- 172.21.15.87:0/3763110250 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x563f29590240 0x563f29592660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.853+0000 7fe9488b9740 4 client.25594 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:15:32.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.853+0000 7fe9488b9740 1 -- 172.21.15.87:0/3763110250 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563f294cb1f0 con 0x563f29590240 2024-09-13T17:15:32.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.853+0000 7fe93effd640 1 --2- 172.21.15.87:0/3763110250 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x563f29590240 0x563f29592660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.853+0000 7fe91effd640 10 client.25594 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:32.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.853+0000 7fe93effd640 1 --2- 172.21.15.87:0/3763110250 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x563f29590240 0x563f29592660 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f96472047d6514c0 server_cookie=f32016133295e603 in_seq=0 out_seq=0 2024-09-13T17:15:32.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.854+0000 7fe91effd640 1 -- 172.21.15.87:0/3763110250 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x563f294cb1f0 con 0x563f29590240 2024-09-13T17:15:32.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.854+0000 7fe91effd640 10 client.25594 handle_command_reply: tid=0 2024-09-13T17:15:32.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.854+0000 7fe9488b9740 1 client.25594 shutdown 2024-09-13T17:15:32.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.854+0000 7fe9488b9740 1 -- 172.21.15.87:0/3763110250 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563f295760b0 msgr2=0x563f2957d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.854+0000 7fe9488b9740 1 --2- 172.21.15.87:0/3763110250 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563f295760b0 0x563f2957d3a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe930000c00 tx=0x7fe930031f00 comp rx=0 tx=0).stop 2024-09-13T17:15:32.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.854+0000 7fe9488b9740 1 -- 172.21.15.87:0/3763110250 shutdown_connections 2024-09-13T17:15:32.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.854+0000 7fe9488b9740 1 --2- 172.21.15.87:0/3763110250 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x563f29590240 0x563f29592660 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.854+0000 7fe9488b9740 1 --2- 172.21.15.87:0/3763110250 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f29580950 0x563f2957d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.854+0000 7fe9488b9740 1 --2- 172.21.15.87:0/3763110250 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563f295760b0 0x563f2957d3a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.854+0000 7fe9488b9740 1 --2- 172.21.15.87:0/3763110250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f29575790 0x563f2957ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.854+0000 7fe91effd640 0 client.25594 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:32.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.854+0000 7fe9488b9740 1 -- 172.21.15.87:0/3763110250 >> 172.21.15.87:0/3763110250 conn(0x563f29571d00 msgr2=0x563f29577a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:32.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.854+0000 7fe9488b9740 1 -- 172.21.15.87:0/3763110250 shutdown_connections 2024-09-13T17:15:32.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.854+0000 7fe9488b9740 1 -- 172.21.15.87:0/3763110250 wait complete. 2024-09-13T17:15:32.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.854+0000 7fe9488b9740 20 client.25594 trim_cache size 0 max 16384 2024-09-13T17:15:32.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:32 smithi118 ceph-mon[34374]: pgmap v54: 129 pgs: 129 active+clean; 123 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.1 MiB/s wr, 1.11k op/s 2024-09-13T17:15:32.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:32 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1084407323' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:15:32.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.867+0000 7fe9488b9740 1 Processor -- start 2024-09-13T17:15:32.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.867+0000 7fe9488b9740 1 -- start start 2024-09-13T17:15:32.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.867+0000 7fe9488b9740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f29575790 0x563f2957d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.867+0000 7fe9488b9740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563f295760b0 0x563f2957d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.867+0000 7fe9488b9740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f29580950 0x563f2957bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.867+0000 7fe9488b9740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f2956d4b0 con 0x563f29575790 2024-09-13T17:15:32.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.867+0000 7fe9488b9740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f2956c390 con 0x563f29580950 2024-09-13T17:15:32.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.867+0000 7fe9488b9740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f29580300 con 0x563f295760b0 2024-09-13T17:15:32.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.867+0000 7fe93effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f29575790 0x563f2957d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.867+0000 7fe93effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f29575790 0x563f2957d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59768/0 (socket says 172.21.15.87:59768) 2024-09-13T17:15:32.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.867+0000 7fe93effd640 1 -- 172.21.15.87:0/3377137527 learned_addr learned my addr 172.21.15.87:0/3377137527 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:32.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.867+0000 7fe93f7fe640 1 --2- 172.21.15.87:0/3377137527 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563f295760b0 0x563f2957d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.867+0000 7fe93effd640 1 --2- 172.21.15.87:0/3377137527 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f29580950 0x563f2957bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.867+0000 7fe93effd640 1 -- 172.21.15.87:0/3377137527 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563f295760b0 msgr2=0x563f2957d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:32.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.867+0000 7fe93effd640 1 --2- 172.21.15.87:0/3377137527 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563f295760b0 0x563f2957d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.867+0000 7fe93effd640 1 -- 172.21.15.87:0/3377137527 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f29580950 msgr2=0x563f2957bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:32.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.867+0000 7fe93effd640 1 --2- 172.21.15.87:0/3377137527 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f29580950 0x563f2957bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.867+0000 7fe93effd640 1 -- 172.21.15.87:0/3377137527 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f29479770 con 0x563f29575790 2024-09-13T17:15:32.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.867+0000 7fe93effd640 1 --2- 172.21.15.87:0/3377137527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f29575790 0x563f2957d3a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fe9340107a0 tx=0x7fe934009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdda20251f839d56 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:32.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.868+0000 7fe9267fc640 1 -- 172.21.15.87:0/3377137527 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe934026070 con 0x563f29575790 2024-09-13T17:15:32.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.868+0000 7fe9267fc640 1 -- 172.21.15.87:0/3377137527 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe93402e2f0 con 0x563f29575790 2024-09-13T17:15:32.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.868+0000 7fe9267fc640 1 -- 172.21.15.87:0/3377137527 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9340047c0 con 0x563f29575790 2024-09-13T17:15:32.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.868+0000 7fe9488b9740 1 -- 172.21.15.87:0/3377137527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f29575790 msgr2=0x563f2957d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.868+0000 7fe9488b9740 1 --2- 172.21.15.87:0/3377137527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f29575790 0x563f2957d3a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fe9340107a0 tx=0x7fe934009b60 comp rx=0 tx=0).stop 2024-09-13T17:15:32.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.868+0000 7fe9488b9740 1 -- 172.21.15.87:0/3377137527 shutdown_connections 2024-09-13T17:15:32.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.868+0000 7fe9488b9740 1 --2- 172.21.15.87:0/3377137527 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f29580950 0x563f2957bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.868+0000 7fe9488b9740 1 --2- 172.21.15.87:0/3377137527 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563f295760b0 0x563f2957d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.868+0000 7fe9488b9740 1 --2- 172.21.15.87:0/3377137527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f29575790 0x563f2957d3a0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.868+0000 7fe9488b9740 1 -- 172.21.15.87:0/3377137527 >> 172.21.15.87:0/3377137527 conn(0x563f29571d00 msgr2=0x563f2958c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:32.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.868+0000 7fe9488b9740 1 -- 172.21.15.87:0/3377137527 shutdown_connections 2024-09-13T17:15:32.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.868+0000 7fe9488b9740 1 -- 172.21.15.87:0/3377137527 wait complete. 2024-09-13T17:15:32.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.869+0000 7fe9488b9740 1 -- start start 2024-09-13T17:15:32.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.869+0000 7fe9488b9740 1 Processor -- start 2024-09-13T17:15:32.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.869+0000 7fe9488b9740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f29575790 0x563f29583d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.869+0000 7fe9488b9740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f295760b0 0x563f29584290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.869+0000 7fe9488b9740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563f29580950 0x563f295de710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.869+0000 7fe9488b9740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f295dedb0 con 0x563f295760b0 2024-09-13T17:15:32.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.869+0000 7fe9488b9740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f295def20 con 0x563f29575790 2024-09-13T17:15:32.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.869+0000 7fe9488b9740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f295df0e0 con 0x563f29580950 2024-09-13T17:15:32.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.869+0000 7fe9488b9740 10 client.0 _ll_register_callbacks cb 0x7fe934009a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:32.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.869+0000 7fe93f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f295760b0 0x563f29584290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.869+0000 7fe93f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f295760b0 0x563f29584290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59774/0 (socket says 172.21.15.87:59774) 2024-09-13T17:15:32.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.869+0000 7fe93f7fe640 1 -- 172.21.15.87:0/254495848 learned_addr learned my addr 172.21.15.87:0/254495848 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:32.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.869+0000 7fe93effd640 1 --2- 172.21.15.87:0/254495848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563f29580950 0x563f295de710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.869+0000 7fe93effd640 1 --2- 172.21.15.87:0/254495848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f29575790 0x563f29583d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.870+0000 7fe93f7fe640 1 -- 172.21.15.87:0/254495848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563f29580950 msgr2=0x563f295de710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:32.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.870+0000 7fe93f7fe640 1 --2- 172.21.15.87:0/254495848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563f29580950 0x563f295de710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.870+0000 7fe93f7fe640 1 -- 172.21.15.87:0/254495848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f29575790 msgr2=0x563f29583d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:32.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.870+0000 7fe93f7fe640 1 --2- 172.21.15.87:0/254495848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f29575790 0x563f29583d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.870+0000 7fe93f7fe640 1 -- 172.21.15.87:0/254495848 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe934029040 con 0x563f295760b0 2024-09-13T17:15:32.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.870+0000 7fe93effd640 1 --2- 172.21.15.87:0/254495848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f29575790 0x563f29583d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:32.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.870+0000 7fe93f7fe640 1 --2- 172.21.15.87:0/254495848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f295760b0 0x563f29584290 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fe930003670 tx=0x7fe930005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a3109a68a1f56ec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:32.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.870+0000 7fe91effd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:15:32.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.870+0000 7fe91effd640 1 -- 172.21.15.87:0/254495848 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93003acd0 con 0x563f295760b0 2024-09-13T17:15:32.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.870+0000 7fe91effd640 1 -- 172.21.15.87:0/254495848 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fe930000e40 con 0x563f295760b0 2024-09-13T17:15:32.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.870+0000 7fe9488b9740 1 -- 172.21.15.87:0/254495848 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe9340044f0 con 0x563f295760b0 2024-09-13T17:15:32.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.870+0000 7fe91effd640 1 -- 172.21.15.87:0/254495848 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe93003ae30 con 0x563f295760b0 2024-09-13T17:15:32.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.870+0000 7fe9488b9740 10 client.16191 fetch_fsmap learned FSMap version 26 2024-09-13T17:15:32.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.870+0000 7fe9488b9740 1 -- 172.21.15.87:0/254495848 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563f2949ee80 con 0x563f295760b0 2024-09-13T17:15:32.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.870+0000 7fe91effd640 1 -- 172.21.15.87:0/254495848 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe9340044f0 con 0x563f295760b0 2024-09-13T17:15:32.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.871+0000 7fe91effd640 1 -- 172.21.15.87:0/254495848 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fe930004a20 con 0x563f295760b0 2024-09-13T17:15:32.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.871+0000 7fe9488b9740 10 client.16191 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T17:15:32.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.871+0000 7fe9488b9740 10 client.16191 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:15:32.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.871+0000 7fe9488b9740 20 client.16191 populate_metadata read hostname 'smithi087' 2024-09-13T17:15:32.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.871+0000 7fe9488b9740 1 --2- 172.21.15.87:0/254495848 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x563f295e77e0 0x563f295e9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:32.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.871+0000 7fe9488b9740 4 client.16191 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:15:32.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.871+0000 7fe9488b9740 1 -- 172.21.15.87:0/254495848 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563f291cc4e0 con 0x563f295e77e0 2024-09-13T17:15:32.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.871+0000 7fe93effd640 1 --2- 172.21.15.87:0/254495848 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x563f295e77e0 0x563f295e9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:32.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.871+0000 7fe91effd640 10 client.16191 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:32.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.871+0000 7fe93effd640 1 --2- 172.21.15.87:0/254495848 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x563f295e77e0 0x563f295e9c00 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56de4995dbea6710 server_cookie=1843a1861f34deec in_seq=0 out_seq=0 2024-09-13T17:15:32.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.871+0000 7fe91effd640 1 -- 172.21.15.87:0/254495848 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563f291cc4e0 con 0x563f295e77e0 2024-09-13T17:15:32.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.871+0000 7fe91effd640 10 client.16191 handle_command_reply: tid=0 2024-09-13T17:15:32.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.871+0000 7fe9488b9740 1 client.16191 shutdown 2024-09-13T17:15:32.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.872+0000 7fe9488b9740 1 -- 172.21.15.87:0/254495848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f295760b0 msgr2=0x563f29584290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.872+0000 7fe9488b9740 1 --2- 172.21.15.87:0/254495848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f295760b0 0x563f29584290 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fe930003670 tx=0x7fe930005d50 comp rx=0 tx=0).stop 2024-09-13T17:15:32.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.872+0000 7fe9488b9740 1 -- 172.21.15.87:0/254495848 shutdown_connections 2024-09-13T17:15:32.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.872+0000 7fe9488b9740 1 --2- 172.21.15.87:0/254495848 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x563f295e77e0 0x563f295e9c00 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.872+0000 7fe9488b9740 1 --2- 172.21.15.87:0/254495848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563f29580950 0x563f295de710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.872+0000 7fe9488b9740 1 --2- 172.21.15.87:0/254495848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563f295760b0 0x563f29584290 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.872+0000 7fe91effd640 0 client.16191 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:32.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.872+0000 7fe9488b9740 1 --2- 172.21.15.87:0/254495848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563f29575790 0x563f29583d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.872+0000 7fe9488b9740 1 -- 172.21.15.87:0/254495848 >> 172.21.15.87:0/254495848 conn(0x563f29571d00 msgr2=0x563f2957bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:32.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.872+0000 7fe9488b9740 1 -- 172.21.15.87:0/254495848 shutdown_connections 2024-09-13T17:15:32.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.872+0000 7fe9488b9740 1 -- 172.21.15.87:0/254495848 wait complete. 2024-09-13T17:15:32.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.872+0000 7fe9488b9740 20 client.16191 trim_cache size 0 max 16384 2024-09-13T17:15:32.880 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:15:32.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.872+0000 7fe945b9c640 1 -- 172.21.15.87:0/1544374245 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe9280a1280 msgr2=0x7fe9280a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.872+0000 7fe945b9c640 1 --2- 172.21.15.87:0/1544374245 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe9280a1280 0x7fe9280a3740 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe9380ca980 tx=0x7fe93806c370 comp rx=0 tx=0).stop 2024-09-13T17:15:32.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.872+0000 7fe945b9c640 1 -- 172.21.15.87:0/1544374245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe940197b50 msgr2=0x7fe9401a2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:32.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.872+0000 7fe945b9c640 1 --2- 172.21.15.87:0/1544374245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe940197b50 0x7fe9401a2150 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fe93800ea60 tx=0x7fe93800ef20 comp rx=0 tx=0).stop 2024-09-13T17:15:32.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.872+0000 7fe945b9c640 1 -- 172.21.15.87:0/1544374245 shutdown_connections 2024-09-13T17:15:32.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.872+0000 7fe945b9c640 1 --2- 172.21.15.87:0/1544374245 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe9280a1280 0x7fe9280a3740 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.872+0000 7fe945b9c640 1 --2- 172.21.15.87:0/1544374245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe940197b50 0x7fe9401a2150 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.872+0000 7fe945b9c640 1 --2- 172.21.15.87:0/1544374245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe940103fb0 0x7fe940197610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.872+0000 7fe945b9c640 1 --2- 172.21.15.87:0/1544374245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9400fee60 0x7fe9401970d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:32.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.872+0000 7fe945b9c640 1 -- 172.21.15.87:0/1544374245 >> 172.21.15.87:0/1544374245 conn(0x7fe940075c60 msgr2=0x7fe9400fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:32.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.872+0000 7fe945b9c640 1 -- 172.21.15.87:0/1544374245 shutdown_connections 2024-09-13T17:15:32.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:32.872+0000 7fe945b9c640 1 -- 172.21.15.87:0/1544374245 wait complete. 2024-09-13T17:15:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.454+0000 7f204f19c640 1 -- 172.21.15.87:0/841607505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2048103f80 msgr2=0x7f204810bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.454+0000 7f204f19c640 1 --2- 172.21.15.87:0/841607505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2048103f80 0x7f204810bad0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f2040009cd0 tx=0x7f204002a8e0 comp rx=0 tx=0).stop 2024-09-13T17:15:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.454+0000 7f204f19c640 1 -- 172.21.15.87:0/841607505 shutdown_connections 2024-09-13T17:15:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.454+0000 7f204f19c640 1 --2- 172.21.15.87:0/841607505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2048103f80 0x7f204810bad0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.454+0000 7f204f19c640 1 --2- 172.21.15.87:0/841607505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20480ff7e0 0x7f2048103820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.454+0000 7f204f19c640 1 --2- 172.21.15.87:0/841607505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20480fee30 0x7f20480ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.454+0000 7f204f19c640 1 -- 172.21.15.87:0/841607505 >> 172.21.15.87:0/841607505 conn(0x7f20480fa8c0 msgr2=0x7f20480fcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.455+0000 7f204f19c640 1 -- 172.21.15.87:0/841607505 shutdown_connections 2024-09-13T17:15:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.455+0000 7f204f19c640 1 -- 172.21.15.87:0/841607505 wait complete. 2024-09-13T17:15:33.459 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.455+0000 7f204f19c640 1 Processor -- start 2024-09-13T17:15:33.459 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.456+0000 7f204f19c640 1 -- start start 2024-09-13T17:15:33.459 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.456+0000 7f204f19c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20480fee30 0x7f204810fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:33.459 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.456+0000 7f204f19c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2048103f80 0x7f2048110160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:33.459 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.456+0000 7f204f19c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2048112cd0 0x7f2048113150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:33.459 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.456+0000 7f204f19c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2048113690 con 0x7f2048103f80 2024-09-13T17:15:33.459 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.456+0000 7f204f19c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2048113800 con 0x7f2048112cd0 2024-09-13T17:15:33.460 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.456+0000 7f204f19c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20481139c0 con 0x7f20480fee30 2024-09-13T17:15:33.460 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.456+0000 7f2047fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2048103f80 0x7f2048110160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:33.460 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.456+0000 7f2047fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2048103f80 0x7f2048110160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59788/0 (socket says 172.21.15.87:59788) 2024-09-13T17:15:33.460 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.456+0000 7f2047fff640 1 -- 172.21.15.87:0/1000882858 learned_addr learned my addr 172.21.15.87:0/1000882858 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:33.460 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.456+0000 7f204cf38640 1 --2- 172.21.15.87:0/1000882858 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20480fee30 0x7f204810fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:33.460 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.456+0000 7f204d739640 1 --2- 172.21.15.87:0/1000882858 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2048112cd0 0x7f2048113150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:33.460 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.457+0000 7f2047fff640 1 -- 172.21.15.87:0/1000882858 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20480fee30 msgr2=0x7f204810fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:33.460 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.457+0000 7f2047fff640 1 --2- 172.21.15.87:0/1000882858 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20480fee30 0x7f204810fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:33.460 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.457+0000 7f2047fff640 1 -- 172.21.15.87:0/1000882858 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2048112cd0 msgr2=0x7f2048113150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:33.460 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.457+0000 7f2047fff640 1 --2- 172.21.15.87:0/1000882858 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2048112cd0 0x7f2048113150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:33.460 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.457+0000 7f2047fff640 1 -- 172.21.15.87:0/1000882858 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2040009900 con 0x7f2048103f80 2024-09-13T17:15:33.460 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.457+0000 7f2047fff640 1 --2- 172.21.15.87:0/1000882858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2048103f80 0x7f2048110160 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f203400e9f0 tx=0x7f203400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:33.460 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.457+0000 7f2045ffb640 1 -- 172.21.15.87:0/1000882858 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20340096c0 con 0x7f2048103f80 2024-09-13T17:15:33.461 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.457+0000 7f2045ffb640 1 -- 172.21.15.87:0/1000882858 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f20340054d0 con 0x7f2048103f80 2024-09-13T17:15:33.461 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.457+0000 7f204f19c640 1 -- 172.21.15.87:0/1000882858 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20481a94c0 con 0x7f2048103f80 2024-09-13T17:15:33.461 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.457+0000 7f2045ffb640 1 -- 172.21.15.87:0/1000882858 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2034010430 con 0x7f2048103f80 2024-09-13T17:15:33.461 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.458+0000 7f204f19c640 1 -- 172.21.15.87:0/1000882858 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20481a9940 con 0x7f2048103f80 2024-09-13T17:15:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.461+0000 7f2045ffb640 1 -- 172.21.15.87:0/1000882858 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f2034004f90 con 0x7f2048103f80 2024-09-13T17:15:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.462+0000 7f2045ffb640 1 --2- 172.21.15.87:0/1000882858 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f20380a12c0 0x7f20380a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.462+0000 7f2051ebe740 1 Processor -- start 2024-09-13T17:15:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.462+0000 7f2051ebe740 1 -- start start 2024-09-13T17:15:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.462+0000 7f2045ffb640 1 -- 172.21.15.87:0/1000882858 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f2034014070 con 0x7f2048103f80 2024-09-13T17:15:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.463+0000 7f2051ebe740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a31d1a330 0x560a31d1a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.463+0000 7f2051ebe740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a31d1ac50 0x560a31d24fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.463+0000 7f2051ebe740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a31d254f0 0x560a31d278e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:33.466 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.463+0000 7f204cf38640 1 --2- 172.21.15.87:0/1000882858 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f20380a12c0 0x7f20380a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:33.466 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.463+0000 7f2051ebe740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a31c85c30 con 0x560a31d1ac50 2024-09-13T17:15:33.466 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.463+0000 7f2051ebe740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a31c833c0 con 0x560a31d254f0 2024-09-13T17:15:33.466 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.463+0000 7f2051ebe740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a31c7ecb0 con 0x560a31d1a330 2024-09-13T17:15:33.466 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.463+0000 7f204d739640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a31d254f0 0x560a31d278e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:33.466 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.463+0000 7f204d739640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a31d254f0 0x560a31d278e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.87:55204/0 (socket says 172.21.15.87:55204) 2024-09-13T17:15:33.466 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.463+0000 7f204d739640 1 -- 172.21.15.87:0/1404045778 learned_addr learned my addr 172.21.15.87:0/1404045778 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:33.467 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.464+0000 7f204d739640 1 -- 172.21.15.87:0/1404045778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a31d1a330 msgr2=0x560a31d1a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:33.467 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.464+0000 7f204d739640 1 --2- 172.21.15.87:0/1404045778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a31d1a330 0x560a31d1a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:33.467 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.464+0000 7f204d739640 1 -- 172.21.15.87:0/1404045778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a31d1ac50 msgr2=0x560a31d24fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:33.467 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.464+0000 7f204d739640 1 --2- 172.21.15.87:0/1404045778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a31d1ac50 0x560a31d24fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:33.467 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.464+0000 7f204d739640 1 -- 172.21.15.87:0/1404045778 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a31c25910 con 0x560a31d254f0 2024-09-13T17:15:33.467 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.464+0000 7f204d739640 1 --2- 172.21.15.87:0/1404045778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a31d254f0 0x560a31d278e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f204002aed0 tx=0x7f2040005fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b4a77b2dec98d2a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:33.467 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.465+0000 7f204cf38640 1 --2- 172.21.15.87:0/1000882858 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f20380a12c0 0x7f20380a3780 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2048105620 tx=0x7f203c009850 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:33.467 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.465+0000 7f2032ffd640 1 -- 172.21.15.87:0/1404045778 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2040030bc0 con 0x560a31d254f0 2024-09-13T17:15:33.468 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.465+0000 7f2032ffd640 1 -- 172.21.15.87:0/1404045778 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2040040070 con 0x560a31d254f0 2024-09-13T17:15:33.468 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.466+0000 7f2051ebe740 1 -- 172.21.15.87:0/1404045778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a31d254f0 msgr2=0x560a31d278e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:33.468 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.466+0000 7f2051ebe740 1 --2- 172.21.15.87:0/1404045778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a31d254f0 0x560a31d278e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f204002aed0 tx=0x7f2040005fa0 comp rx=0 tx=0).stop 2024-09-13T17:15:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.466+0000 7f2051ebe740 1 -- 172.21.15.87:0/1404045778 shutdown_connections 2024-09-13T17:15:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.466+0000 7f2051ebe740 1 --2- 172.21.15.87:0/1404045778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a31d254f0 0x560a31d278e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.466+0000 7f2051ebe740 1 --2- 172.21.15.87:0/1404045778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a31d1ac50 0x560a31d24fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.466+0000 7f2051ebe740 1 --2- 172.21.15.87:0/1404045778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a31d1a330 0x560a31d1a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.466+0000 7f2051ebe740 1 -- 172.21.15.87:0/1404045778 >> 172.21.15.87:0/1404045778 conn(0x560a31d168c0 msgr2=0x560a31d16ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.466+0000 7f2051ebe740 1 -- 172.21.15.87:0/1404045778 shutdown_connections 2024-09-13T17:15:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.466+0000 7f2051ebe740 1 -- 172.21.15.87:0/1404045778 wait complete. 2024-09-13T17:15:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.467+0000 7f2051ebe740 1 -- start start 2024-09-13T17:15:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.467+0000 7f2051ebe740 1 Processor -- start 2024-09-13T17:15:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.467+0000 7f2051ebe740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a31d1a330 0x560a31d24ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.467+0000 7f2051ebe740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a31d1ac50 0x560a31d22160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.467+0000 7f2051ebe740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a31d254f0 0x560a31d227c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.467+0000 7f2051ebe740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a31c3ce80 con 0x560a31d1a330 2024-09-13T17:15:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.467+0000 7f2051ebe740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a31c3cb20 con 0x560a31d254f0 2024-09-13T17:15:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.467+0000 7f2051ebe740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a31c02260 con 0x560a31d1ac50 2024-09-13T17:15:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.467+0000 7f2051ebe740 10 client.0 _ll_register_callbacks cb 0x560a31c37df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.468+0000 7f2047fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a31d1ac50 0x560a31d22160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.468+0000 7f2047fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a31d1ac50 0x560a31d22160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:39070/0 (socket says 172.21.15.87:39070) 2024-09-13T17:15:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.468+0000 7f2047fff640 1 -- 172.21.15.87:0/323427266 learned_addr learned my addr 172.21.15.87:0/323427266 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:33.471 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.468+0000 7f204cf38640 1 --2- 172.21.15.87:0/323427266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a31d1a330 0x560a31d24ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:33.471 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.468+0000 7f204cf38640 1 -- 172.21.15.87:0/323427266 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a31d1ac50 msgr2=0x560a31d22160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:33.471 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.468+0000 7f204cf38640 1 --2- 172.21.15.87:0/323427266 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a31d1ac50 0x560a31d22160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:33.471 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.468+0000 7f204cf38640 1 -- 172.21.15.87:0/323427266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a31d254f0 msgr2=0x560a31d227c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T17:15:33.471 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.468+0000 7f204cf38640 1 --2- 172.21.15.87:0/323427266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a31d254f0 0x560a31d227c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:33.471 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.468+0000 7f204cf38640 1 -- 172.21.15.87:0/323427266 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f204810c310 con 0x560a31d1a330 2024-09-13T17:15:33.471 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.469+0000 7f204cf38640 1 --2- 172.21.15.87:0/323427266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a31d1a330 0x560a31d24ee0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f203c009bb0 tx=0x7f203c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1724fb499d479923 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.470+0000 7f2027fff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:15:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.470+0000 7f2027fff640 1 -- 172.21.15.87:0/323427266 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c00e940 con 0x560a31d1a330 2024-09-13T17:15:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.470+0000 7f2027fff640 1 -- 172.21.15.87:0/323427266 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f203c01b040 con 0x560a31d1a330 2024-09-13T17:15:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.470+0000 7f2051ebe740 1 -- 172.21.15.87:0/323427266 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560a31c725d0 con 0x560a31d1a330 2024-09-13T17:15:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.470+0000 7f2027fff640 1 -- 172.21.15.87:0/323427266 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f203c00eaa0 con 0x560a31d1a330 2024-09-13T17:15:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.470+0000 7f2051ebe740 10 client.16200 fetch_fsmap learned FSMap version 26 2024-09-13T17:15:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.470+0000 7f2051ebe740 1 -- 172.21.15.87:0/323427266 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x560a31c7d330 con 0x560a31d1a330 2024-09-13T17:15:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.471+0000 7f2027fff640 1 -- 172.21.15.87:0/323427266 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x560a31c725d0 con 0x560a31d1a330 2024-09-13T17:15:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.471+0000 7f2027fff640 1 -- 172.21.15.87:0/323427266 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f203c020cb0 con 0x560a31d1a330 2024-09-13T17:15:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.471+0000 7f2051ebe740 10 client.16200 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T17:15:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.471+0000 7f2051ebe740 10 client.16200 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-13T17:15:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.471+0000 7f2051ebe740 20 client.16200 populate_metadata read hostname 'smithi087' 2024-09-13T17:15:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.471+0000 7f2051ebe740 1 --2- 172.21.15.87:0/323427266 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560a31d46110 0x560a31d48530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.471+0000 7f2051ebe740 4 client.16200 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:15:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.471+0000 7f2051ebe740 1 -- 172.21.15.87:0/323427266 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560a31972300 con 0x560a31d46110 2024-09-13T17:15:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.472+0000 7f2047fff640 1 --2- 172.21.15.87:0/323427266 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560a31d46110 0x560a31d48530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.472+0000 7f2047fff640 1 --2- 172.21.15.87:0/323427266 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560a31d46110 0x560a31d48530 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63df4b38220de71 server_cookie=abb12a0449b8ee75 in_seq=0 out_seq=0 2024-09-13T17:15:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.472+0000 7f2027fff640 10 client.16200 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.473+0000 7f2027fff640 1 -- 172.21.15.87:0/323427266 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x560a31972300 con 0x560a31d46110 2024-09-13T17:15:33.476 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.473+0000 7f2027fff640 10 client.16200 handle_command_reply: tid=0 2024-09-13T17:15:33.476 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.474+0000 7f2051ebe740 1 client.16200 shutdown 2024-09-13T17:15:33.476 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.474+0000 7f2051ebe740 1 -- 172.21.15.87:0/323427266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a31d1a330 msgr2=0x560a31d24ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:33.476 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.474+0000 7f2051ebe740 1 --2- 172.21.15.87:0/323427266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a31d1a330 0x560a31d24ee0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f203c009bb0 tx=0x7f203c004730 comp rx=0 tx=0).stop 2024-09-13T17:15:33.476 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.474+0000 7f2051ebe740 1 -- 172.21.15.87:0/323427266 shutdown_connections 2024-09-13T17:15:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.474+0000 7f2051ebe740 1 --2- 172.21.15.87:0/323427266 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560a31d46110 0x560a31d48530 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.474+0000 7f2051ebe740 1 --2- 172.21.15.87:0/323427266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a31d254f0 0x560a31d227c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.474+0000 7f2051ebe740 1 --2- 172.21.15.87:0/323427266 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a31d1ac50 0x560a31d22160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.474+0000 7f2051ebe740 1 --2- 172.21.15.87:0/323427266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a31d1a330 0x560a31d24ee0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.474+0000 7f2051ebe740 1 -- 172.21.15.87:0/323427266 >> 172.21.15.87:0/323427266 conn(0x560a31d168c0 msgr2=0x560a31d1c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.474+0000 7f2027fff640 0 client.16200 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.474+0000 7f2051ebe740 1 -- 172.21.15.87:0/323427266 shutdown_connections 2024-09-13T17:15:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.474+0000 7f2051ebe740 1 -- 172.21.15.87:0/323427266 wait complete. 2024-09-13T17:15:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.475+0000 7f2051ebe740 20 client.16200 trim_cache size 0 max 16384 2024-09-13T17:15:33.505 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.501+0000 7f2051ebe740 1 Processor -- start 2024-09-13T17:15:33.505 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.501+0000 7f2051ebe740 1 -- start start 2024-09-13T17:15:33.505 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.501+0000 7f2051ebe740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a31d1a330 0x560a31d24a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:33.505 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.501+0000 7f2051ebe740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a31d1ac50 0x560a31d20a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:33.505 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.501+0000 7f2051ebe740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a31d254f0 0x560a31d20f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:33.505 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.501+0000 7f2051ebe740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a31d21490 con 0x560a31d1ac50 2024-09-13T17:15:33.505 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.501+0000 7f2051ebe740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a31d27c60 con 0x560a31d254f0 2024-09-13T17:15:33.505 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.501+0000 7f2051ebe740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a31d175b0 con 0x560a31d1a330 2024-09-13T17:15:33.505 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.501+0000 7f204cf38640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a31d1a330 0x560a31d24a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:33.505 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.501+0000 7f204cf38640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a31d1a330 0x560a31d24a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:39076/0 (socket says 172.21.15.87:39076) 2024-09-13T17:15:33.506 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.501+0000 7f204cf38640 1 -- 172.21.15.87:0/3671594733 learned_addr learned my addr 172.21.15.87:0/3671594733 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:33.506 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.502+0000 7f204d739640 1 --2- 172.21.15.87:0/3671594733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a31d254f0 0x560a31d20f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:33.506 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.503+0000 7f204cf38640 1 -- 172.21.15.87:0/3671594733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a31d254f0 msgr2=0x560a31d20f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:33.506 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.503+0000 7f204cf38640 1 --2- 172.21.15.87:0/3671594733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a31d254f0 0x560a31d20f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:33.506 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.503+0000 7f204cf38640 1 -- 172.21.15.87:0/3671594733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a31d1ac50 msgr2=0x560a31d20a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:33.506 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.503+0000 7f204cf38640 1 --2- 172.21.15.87:0/3671594733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a31d1ac50 0x560a31d20a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:33.506 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.503+0000 7f204cf38640 1 -- 172.21.15.87:0/3671594733 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a31c1f300 con 0x560a31d1a330 2024-09-13T17:15:33.507 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.503+0000 7f204cf38640 1 --2- 172.21.15.87:0/3671594733 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a31d1a330 0x560a31d24a40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f203c015040 tx=0x7f203c028560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f86f303235d19711 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:33.507 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.504+0000 7f20337fe640 1 -- 172.21.15.87:0/3671594733 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c005bb0 con 0x560a31d1a330 2024-09-13T17:15:33.507 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.504+0000 7f20337fe640 1 -- 172.21.15.87:0/3671594733 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f203c028640 con 0x560a31d1a330 2024-09-13T17:15:33.507 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.504+0000 7f20337fe640 1 -- 172.21.15.87:0/3671594733 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c028880 con 0x560a31d1a330 2024-09-13T17:15:33.507 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.505+0000 7f2051ebe740 1 -- 172.21.15.87:0/3671594733 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a31d1a330 msgr2=0x560a31d24a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:33.507 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.505+0000 7f2051ebe740 1 --2- 172.21.15.87:0/3671594733 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a31d1a330 0x560a31d24a40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f203c015040 tx=0x7f203c028560 comp rx=0 tx=0).stop 2024-09-13T17:15:33.508 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.506+0000 7f2051ebe740 1 -- 172.21.15.87:0/3671594733 shutdown_connections 2024-09-13T17:15:33.508 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.506+0000 7f2051ebe740 1 --2- 172.21.15.87:0/3671594733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a31d254f0 0x560a31d20f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:33.508 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.506+0000 7f2051ebe740 1 --2- 172.21.15.87:0/3671594733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a31d1ac50 0x560a31d20a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:33.508 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.506+0000 7f2051ebe740 1 --2- 172.21.15.87:0/3671594733 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a31d1a330 0x560a31d24a40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:33.508 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.506+0000 7f2051ebe740 1 -- 172.21.15.87:0/3671594733 >> 172.21.15.87:0/3671594733 conn(0x560a31d168c0 msgr2=0x560a31d1d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:33.509 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.507+0000 7f2051ebe740 1 -- 172.21.15.87:0/3671594733 shutdown_connections 2024-09-13T17:15:33.509 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.507+0000 7f2051ebe740 1 -- 172.21.15.87:0/3671594733 wait complete. 2024-09-13T17:15:33.509 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.507+0000 7f2051ebe740 1 -- start start 2024-09-13T17:15:33.509 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.508+0000 7f2051ebe740 1 Processor -- start 2024-09-13T17:15:33.510 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.508+0000 7f2051ebe740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a31d1a330 0x560a31d2c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:33.510 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.508+0000 7f2051ebe740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a31d1ac50 0x560a31d288c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:33.510 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.508+0000 7f2051ebe740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a31d254f0 0x560a31d28e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:33.510 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.508+0000 7f2051ebe740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a31d29340 con 0x560a31d1a330 2024-09-13T17:15:33.510 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.508+0000 7f2051ebe740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a31d294b0 con 0x560a31d254f0 2024-09-13T17:15:33.510 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.508+0000 7f2051ebe740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a31d29670 con 0x560a31d1ac50 2024-09-13T17:15:33.510 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.508+0000 7f2051ebe740 10 client.0 _ll_register_callbacks cb 0x7f2034005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:33.511 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.508+0000 7f204cf38640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a31d1a330 0x560a31d2c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:33.511 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.508+0000 7f204cf38640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a31d1a330 0x560a31d2c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59818/0 (socket says 172.21.15.87:59818) 2024-09-13T17:15:33.511 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.508+0000 7f204cf38640 1 -- 172.21.15.87:0/2476498379 learned_addr learned my addr 172.21.15.87:0/2476498379 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:33.511 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.508+0000 7f2047fff640 1 --2- 172.21.15.87:0/2476498379 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a31d1ac50 0x560a31d288c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:33.512 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.509+0000 7f2047fff640 1 -- 172.21.15.87:0/2476498379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a31d254f0 msgr2=0x560a31d28e00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T17:15:33.512 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.509+0000 7f2047fff640 1 --2- 172.21.15.87:0/2476498379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a31d254f0 0x560a31d28e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.509+0000 7f2047fff640 1 -- 172.21.15.87:0/2476498379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a31d1a330 msgr2=0x560a31d2c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.509+0000 7f2047fff640 1 --2- 172.21.15.87:0/2476498379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a31d1a330 0x560a31d2c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.509+0000 7f2047fff640 1 -- 172.21.15.87:0/2476498379 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560a31c7d330 con 0x560a31d1ac50 2024-09-13T17:15:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.510+0000 7f2047fff640 1 --2- 172.21.15.87:0/2476498379 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a31d1ac50 0x560a31d288c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f20340ca670 tx=0x7f203409a6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9b033a4175ec5f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.510+0000 7f2027fff640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-09-13T17:15:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.510+0000 7f2027fff640 1 -- 172.21.15.87:0/2476498379 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20340adea0 con 0x560a31d1ac50 2024-09-13T17:15:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.510+0000 7f2027fff640 1 -- 172.21.15.87:0/2476498379 <== mon.1 v2:172.21.15.149:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f20340a2450 con 0x560a31d1ac50 2024-09-13T17:15:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.511+0000 7f2051ebe740 1 -- 172.21.15.87:0/2476498379 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560a31ca7680 con 0x560a31d1ac50 2024-09-13T17:15:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.511+0000 7f2027fff640 1 -- 172.21.15.87:0/2476498379 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2034098370 con 0x560a31d1ac50 2024-09-13T17:15:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.511+0000 7f2051ebe740 10 client.25615 fetch_fsmap learned FSMap version 26 2024-09-13T17:15:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.511+0000 7f2051ebe740 1 -- 172.21.15.87:0/2476498379 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x560a31c448e0 con 0x560a31d1ac50 2024-09-13T17:15:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.513+0000 7f2027fff640 1 -- 172.21.15.87:0/2476498379 <== mon.1 v2:172.21.15.149:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x560a31ca7680 con 0x560a31d1ac50 2024-09-13T17:15:33.515 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.513+0000 7f2027fff640 1 -- 172.21.15.87:0/2476498379 <== mon.1 v2:172.21.15.149:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f203401f060 con 0x560a31d1ac50 2024-09-13T17:15:33.515 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.513+0000 7f2051ebe740 10 client.25615 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T17:15:33.515 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.513+0000 7f2051ebe740 10 client.25615 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-13T17:15:33.515 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.513+0000 7f2051ebe740 20 client.25615 populate_metadata read hostname 'smithi087' 2024-09-13T17:15:33.515 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.513+0000 7f2051ebe740 1 --2- 172.21.15.87:0/2476498379 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560a31d9dbd0 0x560a31d9fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:33.515 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.513+0000 7f2051ebe740 4 client.25615 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T17:15:33.515 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.513+0000 7f2051ebe740 1 -- 172.21.15.87:0/2476498379 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560a31983600 con 0x560a31d9dbd0 2024-09-13T17:15:33.517 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.515+0000 7f204cf38640 1 --2- 172.21.15.87:0/2476498379 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560a31d9dbd0 0x560a31d9fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:33.519 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.517+0000 7f204cf38640 1 --2- 172.21.15.87:0/2476498379 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560a31d9dbd0 0x560a31d9fff0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3da2fc22b8238da4 server_cookie=5c03de5993e7b900 in_seq=0 out_seq=0 2024-09-13T17:15:33.519 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.517+0000 7f2027fff640 10 client.25615 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:33.653 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.650+0000 7f2027fff640 1 -- 172.21.15.87:0/2476498379 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560a31983600 con 0x560a31d9dbd0 2024-09-13T17:15:33.653 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.650+0000 7f2027fff640 10 client.25615 handle_command_reply: tid=0 2024-09-13T17:15:33.653 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.650+0000 7f2051ebe740 1 client.25615 shutdown 2024-09-13T17:15:33.653 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.650+0000 7f2051ebe740 1 -- 172.21.15.87:0/2476498379 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a31d1ac50 msgr2=0x560a31d288c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:33.653 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.650+0000 7f2051ebe740 1 --2- 172.21.15.87:0/2476498379 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a31d1ac50 0x560a31d288c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f20340ca670 tx=0x7f203409a6d0 comp rx=0 tx=0).stop 2024-09-13T17:15:33.653 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.650+0000 7f2051ebe740 1 -- 172.21.15.87:0/2476498379 shutdown_connections 2024-09-13T17:15:33.654 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.650+0000 7f2051ebe740 1 --2- 172.21.15.87:0/2476498379 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560a31d9dbd0 0x560a31d9fff0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:33.654 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.650+0000 7f2051ebe740 1 --2- 172.21.15.87:0/2476498379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a31d254f0 0x560a31d28e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:33.654 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.650+0000 7f2027fff640 0 client.25615 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:33.654 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.650+0000 7f2051ebe740 1 --2- 172.21.15.87:0/2476498379 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a31d1ac50 0x560a31d288c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:33.654 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.651+0000 7f2051ebe740 1 --2- 172.21.15.87:0/2476498379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a31d1a330 0x560a31d2c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:33.654 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.651+0000 7f2051ebe740 1 -- 172.21.15.87:0/2476498379 >> 172.21.15.87:0/2476498379 conn(0x560a31d168c0 msgr2=0x560a31d1d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:33.654 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.651+0000 7f2051ebe740 1 -- 172.21.15.87:0/2476498379 shutdown_connections 2024-09-13T17:15:33.654 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.651+0000 7f2051ebe740 1 -- 172.21.15.87:0/2476498379 wait complete. 2024-09-13T17:15:33.654 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.651+0000 7f2051ebe740 20 client.25615 trim_cache size 0 max 16384 2024-09-13T17:15:33.654 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout:{ 2024-09-13T17:15:33.654 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout: "message": "", 2024-09-13T17:15:33.655 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout: "return_code": 0 2024-09-13T17:15:33.655 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout:} 2024-09-13T17:15:33.655 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.651+0000 7f204f19c640 1 -- 172.21.15.87:0/1000882858 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f20380a12c0 msgr2=0x7f20380a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:33.655 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.651+0000 7f204f19c640 1 --2- 172.21.15.87:0/1000882858 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f20380a12c0 0x7f20380a3780 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2048105620 tx=0x7f203c009850 comp rx=0 tx=0).stop 2024-09-13T17:15:33.655 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.651+0000 7f204f19c640 1 -- 172.21.15.87:0/1000882858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2048103f80 msgr2=0x7f2048110160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:33.656 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.651+0000 7f204f19c640 1 --2- 172.21.15.87:0/1000882858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2048103f80 0x7f2048110160 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f203400e9f0 tx=0x7f203400eeb0 comp rx=0 tx=0).stop 2024-09-13T17:15:33.656 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.651+0000 7f204f19c640 1 -- 172.21.15.87:0/1000882858 shutdown_connections 2024-09-13T17:15:33.656 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.651+0000 7f204f19c640 1 --2- 172.21.15.87:0/1000882858 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2048112cd0 0x7f2048113150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:33.656 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.651+0000 7f204f19c640 1 --2- 172.21.15.87:0/1000882858 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f20380a12c0 0x7f20380a3780 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:33.656 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.651+0000 7f204f19c640 1 --2- 172.21.15.87:0/1000882858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2048103f80 0x7f2048110160 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:33.656 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.651+0000 7f204f19c640 1 --2- 172.21.15.87:0/1000882858 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20480fee30 0x7f204810fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:33.656 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.651+0000 7f204f19c640 1 -- 172.21.15.87:0/1000882858 >> 172.21.15.87:0/1000882858 conn(0x7f20480fa8c0 msgr2=0x7f20480fc0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:33.656 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.652+0000 7f204f19c640 1 -- 172.21.15.87:0/1000882858 shutdown_connections 2024-09-13T17:15:33.656 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:33.652+0000 7f204f19c640 1 -- 172.21.15.87:0/1000882858 wait complete. 2024-09-13T17:15:33.886 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-13T17:15:33.886 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-09-13T17:15:34.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:33.999+0000 7fa5d5fc7640 1 -- 172.21.15.87:0/3348373203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5d00fee60 msgr2=0x7fa5d00ff240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:34.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:33.999+0000 7fa5d5fc7640 1 --2- 172.21.15.87:0/3348373203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5d00fee60 0x7fa5d00ff240 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0009930 tx=0x7fa5c002a420 comp rx=0 tx=0).stop 2024-09-13T17:15:34.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:33.999+0000 7fa5d5fc7640 1 -- 172.21.15.87:0/3348373203 shutdown_connections 2024-09-13T17:15:34.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:33.999+0000 7fa5d5fc7640 1 --2- 172.21.15.87:0/3348373203 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5d0103fb0 0x7fa5d010bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:33.999+0000 7fa5d5fc7640 1 --2- 172.21.15.87:0/3348373203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa5d00ff810 0x7fa5d0103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:33.999+0000 7fa5d5fc7640 1 --2- 172.21.15.87:0/3348373203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5d00fee60 0x7fa5d00ff240 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:33.999+0000 7fa5d5fc7640 1 -- 172.21.15.87:0/3348373203 >> 172.21.15.87:0/3348373203 conn(0x7fa5d0075c60 msgr2=0x7fa5d00fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:34.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:33.999+0000 7fa5d5fc7640 1 -- 172.21.15.87:0/3348373203 shutdown_connections 2024-09-13T17:15:34.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:33.999+0000 7fa5d5fc7640 1 -- 172.21.15.87:0/3348373203 wait complete. 2024-09-13T17:15:34.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:33.999+0000 7fa5d5fc7640 1 Processor -- start 2024-09-13T17:15:34.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.000+0000 7fa5d5fc7640 1 -- start start 2024-09-13T17:15:34.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.000+0000 7fa5d5fc7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5d00fee60 0x7fa5d0196330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.000+0000 7fa5d5fc7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa5d0103fb0 0x7fa5d0196870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.000+0000 7fa5d5fc7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5d019ac60 0x7fa5d019b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.000+0000 7fa5d5fc7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d019b650 con 0x7fa5d019ac60 2024-09-13T17:15:34.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.000+0000 7fa5d5fc7640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d019b7c0 con 0x7fa5d00fee60 2024-09-13T17:15:34.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.000+0000 7fa5d5fc7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d019b930 con 0x7fa5d0103fb0 2024-09-13T17:15:34.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.000+0000 7fa5cffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5d019ac60 0x7fa5d019b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.000+0000 7fa5cf7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5d00fee60 0x7fa5d0196330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.000+0000 7fa5cffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5d019ac60 0x7fa5d019b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59836/0 (socket says 172.21.15.87:59836) 2024-09-13T17:15:34.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.000+0000 7fa5cffff640 1 -- 172.21.15.87:0/701812421 learned_addr learned my addr 172.21.15.87:0/701812421 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:34.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.000+0000 7fa5ceffd640 1 --2- 172.21.15.87:0/701812421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa5d0103fb0 0x7fa5d0196870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.000+0000 7fa5cffff640 1 -- 172.21.15.87:0/701812421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa5d0103fb0 msgr2=0x7fa5d0196870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:34.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.000+0000 7fa5cffff640 1 --2- 172.21.15.87:0/701812421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa5d0103fb0 0x7fa5d0196870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.000+0000 7fa5cffff640 1 -- 172.21.15.87:0/701812421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5d00fee60 msgr2=0x7fa5d0196330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:34.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.000+0000 7fa5cffff640 1 --2- 172.21.15.87:0/701812421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5d00fee60 0x7fa5d0196330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.000+0000 7fa5cffff640 1 -- 172.21.15.87:0/701812421 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c0009560 con 0x7fa5d019ac60 2024-09-13T17:15:34.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.000+0000 7fa5cf7fe640 1 --2- 172.21.15.87:0/701812421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5d00fee60 0x7fa5d0196330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:15:34.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.000+0000 7fa5cffff640 1 --2- 172.21.15.87:0/701812421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5d019ac60 0x7fa5d019b110 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa5c800ea60 tx=0x7fa5c800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:34.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.000+0000 7fa5ccff9640 1 -- 172.21.15.87:0/701812421 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c800ce40 con 0x7fa5d019ac60 2024-09-13T17:15:34.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.001+0000 7fa5ccff9640 1 -- 172.21.15.87:0/701812421 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa5c8005020 con 0x7fa5d019ac60 2024-09-13T17:15:34.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.001+0000 7fa5d5fc7640 1 -- 172.21.15.87:0/701812421 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5d01a2f10 con 0x7fa5d019ac60 2024-09-13T17:15:34.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.001+0000 7fa5ccff9640 1 -- 172.21.15.87:0/701812421 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c8010690 con 0x7fa5d019ac60 2024-09-13T17:15:34.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.001+0000 7fa5d5fc7640 1 -- 172.21.15.87:0/701812421 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d01a3390 con 0x7fa5d019ac60 2024-09-13T17:15:34.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.003+0000 7fa5ccff9640 1 -- 172.21.15.87:0/701812421 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fa5c8005190 con 0x7fa5d019ac60 2024-09-13T17:15:34.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.003+0000 7fa5d8dc3740 1 Processor -- start 2024-09-13T17:15:34.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.003+0000 7fa5d8dc3740 1 -- start start 2024-09-13T17:15:34.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.004+0000 7fa5d8dc3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557ae0b74680 0x557ae0b74a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.004+0000 7fa5d8dc3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae0b74fa0 0x557ae0b83850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.004+0000 7fa5d8dc3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ae0b83d90 0x557ae0b86180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.004+0000 7fa5d8dc3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae0adfc60 con 0x557ae0b83d90 2024-09-13T17:15:34.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.004+0000 7fa5d8dc3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae0add3f0 con 0x557ae0b74fa0 2024-09-13T17:15:34.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.004+0000 7fa5d8dc3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae0ad8ce0 con 0x557ae0b74680 2024-09-13T17:15:34.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.004+0000 7fa5ccff9640 1 --2- 172.21.15.87:0/701812421 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa5b80a1280 0x7fa5b80a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.004+0000 7fa5ceffd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557ae0b74680 0x557ae0b74a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.004+0000 7fa5cffff640 1 --2- 172.21.15.87:0/701812421 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa5b80a1280 0x7fa5b80a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.004+0000 7fa5ceffd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557ae0b74680 0x557ae0b74a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:39098/0 (socket says 172.21.15.87:39098) 2024-09-13T17:15:34.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.004+0000 7fa5ceffd640 1 -- 172.21.15.87:0/1719363328 learned_addr learned my addr 172.21.15.87:0/1719363328 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:34.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.004+0000 7fa5ceffd640 1 --2- 172.21.15.87:0/1719363328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ae0b83d90 0x557ae0b86180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.004+0000 7fa5cf7fe640 1 --2- 172.21.15.87:0/1719363328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae0b74fa0 0x557ae0b83850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.004+0000 7fa5ccff9640 1 -- 172.21.15.87:0/701812421 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fa5c8014070 con 0x7fa5d019ac60 2024-09-13T17:15:34.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.004+0000 7fa5ceffd640 1 -- 172.21.15.87:0/1719363328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae0b74fa0 msgr2=0x557ae0b83850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:34.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.004+0000 7fa5ceffd640 1 --2- 172.21.15.87:0/1719363328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae0b74fa0 0x557ae0b83850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.004+0000 7fa5ceffd640 1 -- 172.21.15.87:0/1719363328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ae0b83d90 msgr2=0x557ae0b86180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:34.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.004+0000 7fa5ceffd640 1 --2- 172.21.15.87:0/1719363328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ae0b83d90 0x557ae0b86180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.004+0000 7fa5ceffd640 1 -- 172.21.15.87:0/1719363328 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ae0a94970 con 0x557ae0b74680 2024-09-13T17:15:34.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.004+0000 7fa5cffff640 1 --2- 172.21.15.87:0/701812421 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa5b80a1280 0x7fa5b80a3740 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8096700 tx=0x7fa5c806d390 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:34.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.004+0000 7fa5ceffd640 1 --2- 172.21.15.87:0/1719363328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557ae0b74680 0x557ae0b74a60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4009fd0 tx=0x7fa5c4005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cea634cb4912c9c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:34.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.004+0000 7fa5b5ffb640 1 -- 172.21.15.87:0/1719363328 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c4004020 con 0x557ae0b74680 2024-09-13T17:15:34.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.005+0000 7fa5b5ffb640 1 -- 172.21.15.87:0/1719363328 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa5c400f790 con 0x557ae0b74680 2024-09-13T17:15:34.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.005+0000 7fa5b5ffb640 1 -- 172.21.15.87:0/1719363328 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c4003850 con 0x557ae0b74680 2024-09-13T17:15:34.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.005+0000 7fa5d8dc3740 1 -- 172.21.15.87:0/1719363328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557ae0b74680 msgr2=0x557ae0b74a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:34.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.005+0000 7fa5d8dc3740 1 --2- 172.21.15.87:0/1719363328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557ae0b74680 0x557ae0b74a60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4009fd0 tx=0x7fa5c4005850 comp rx=0 tx=0).stop 2024-09-13T17:15:34.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.005+0000 7fa5d8dc3740 1 -- 172.21.15.87:0/1719363328 shutdown_connections 2024-09-13T17:15:34.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.005+0000 7fa5d8dc3740 1 --2- 172.21.15.87:0/1719363328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ae0b83d90 0x557ae0b86180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.005+0000 7fa5d8dc3740 1 --2- 172.21.15.87:0/1719363328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae0b74fa0 0x557ae0b83850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.005+0000 7fa5d8dc3740 1 --2- 172.21.15.87:0/1719363328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557ae0b74680 0x557ae0b74a60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.005+0000 7fa5d8dc3740 1 -- 172.21.15.87:0/1719363328 >> 172.21.15.87:0/1719363328 conn(0x557ae0b70d50 msgr2=0x557ae0b71130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:34.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.005+0000 7fa5d8dc3740 1 -- 172.21.15.87:0/1719363328 shutdown_connections 2024-09-13T17:15:34.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.005+0000 7fa5d8dc3740 1 -- 172.21.15.87:0/1719363328 wait complete. 2024-09-13T17:15:34.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.006+0000 7fa5d8dc3740 1 -- start start 2024-09-13T17:15:34.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.006+0000 7fa5d8dc3740 1 Processor -- start 2024-09-13T17:15:34.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.006+0000 7fa5d8dc3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ae0b74680 0x557ae0b83840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.006+0000 7fa5d8dc3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae0b74fa0 0x557ae0b80ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.006+0000 7fa5d8dc3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557ae0b83d90 0x557ae0b81250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.006+0000 7fa5d8dc3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae0a96f80 con 0x557ae0b74680 2024-09-13T17:15:34.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.006+0000 7fa5d8dc3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae0a96c20 con 0x557ae0b74fa0 2024-09-13T17:15:34.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.006+0000 7fa5d8dc3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae0a63ab0 con 0x557ae0b83d90 2024-09-13T17:15:34.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.006+0000 7fa5d8dc3740 10 client.0 _ll_register_callbacks cb 0x557ae0ad2350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:34.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.006+0000 7fa5ceffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ae0b74680 0x557ae0b83840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.006+0000 7fa5ceffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ae0b74680 0x557ae0b83840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59864/0 (socket says 172.21.15.87:59864) 2024-09-13T17:15:34.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.006+0000 7fa5ceffd640 1 -- 172.21.15.87:0/1863395986 learned_addr learned my addr 172.21.15.87:0/1863395986 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:34.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.006+0000 7fa5cf7fe640 1 --2- 172.21.15.87:0/1863395986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae0b74fa0 0x557ae0b80ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.006+0000 7fa5ceffd640 1 --2- 172.21.15.87:0/1863395986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557ae0b83d90 0x557ae0b81250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.007+0000 7fa5ceffd640 1 -- 172.21.15.87:0/1863395986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557ae0b83d90 msgr2=0x557ae0b81250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:34.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.007+0000 7fa5ceffd640 1 --2- 172.21.15.87:0/1863395986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557ae0b83d90 0x557ae0b81250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.007+0000 7fa5ceffd640 1 -- 172.21.15.87:0/1863395986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae0b74fa0 msgr2=0x557ae0b80ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:34.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.007+0000 7fa5ceffd640 1 --2- 172.21.15.87:0/1863395986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae0b74fa0 0x557ae0b80ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.007+0000 7fa5ceffd640 1 -- 172.21.15.87:0/1863395986 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c4019040 con 0x557ae0b74680 2024-09-13T17:15:34.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.007+0000 7fa5ceffd640 1 --2- 172.21.15.87:0/1863395986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ae0b74680 0x557ae0b83840 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4005bc0 tx=0x7fa5c4005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=368fac56cab9116a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:34.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.007+0000 7fa5aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:15:34.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.007+0000 7fa5aeffd640 1 -- 172.21.15.87:0/1863395986 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c400fd50 con 0x557ae0b74680 2024-09-13T17:15:34.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.007+0000 7fa5aeffd640 1 -- 172.21.15.87:0/1863395986 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fa5c4005040 con 0x557ae0b74680 2024-09-13T17:15:34.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.007+0000 7fa5d8dc3740 1 -- 172.21.15.87:0/1863395986 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557ae07cc590 con 0x557ae0b74680 2024-09-13T17:15:34.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.007+0000 7fa5aeffd640 1 -- 172.21.15.87:0/1863395986 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5c4005200 con 0x557ae0b74680 2024-09-13T17:15:34.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.007+0000 7fa5d8dc3740 10 client.16215 fetch_fsmap learned FSMap version 26 2024-09-13T17:15:34.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.007+0000 7fa5d8dc3740 1 -- 172.21.15.87:0/1863395986 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557ae0ad7360 con 0x557ae0b74680 2024-09-13T17:15:34.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.007+0000 7fa5aeffd640 1 -- 172.21.15.87:0/1863395986 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x557ae07cc590 con 0x557ae0b74680 2024-09-13T17:15:34.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.007+0000 7fa5aeffd640 1 -- 172.21.15.87:0/1863395986 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fa5c40035f0 con 0x557ae0b74680 2024-09-13T17:15:34.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.008+0000 7fa5d8dc3740 10 client.16215 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T17:15:34.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.008+0000 7fa5d8dc3740 10 client.16215 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:15:34.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.008+0000 7fa5d8dc3740 20 client.16215 populate_metadata read hostname 'smithi087' 2024-09-13T17:15:34.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.008+0000 7fa5d8dc3740 1 --2- 172.21.15.87:0/1863395986 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x557ae0b93a10 0x557ae0b95e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.008+0000 7fa5d8dc3740 4 client.16215 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:15:34.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.008+0000 7fa5d8dc3740 1 -- 172.21.15.87:0/1863395986 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557ae07dd860 con 0x557ae0b93a10 2024-09-13T17:15:34.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.008+0000 7fa5cf7fe640 1 --2- 172.21.15.87:0/1863395986 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x557ae0b93a10 0x557ae0b95e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.008+0000 7fa5aeffd640 10 client.16215 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:34.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.008+0000 7fa5cf7fe640 1 --2- 172.21.15.87:0/1863395986 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x557ae0b93a10 0x557ae0b95e30 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8659cca8c9e607e server_cookie=d1f83c83b8bc7206 in_seq=0 out_seq=0 2024-09-13T17:15:34.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.009+0000 7fa5aeffd640 1 -- 172.21.15.87:0/1863395986 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x557ae07dd860 con 0x557ae0b93a10 2024-09-13T17:15:34.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.009+0000 7fa5aeffd640 10 client.16215 handle_command_reply: tid=0 2024-09-13T17:15:34.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.009+0000 7fa5d8dc3740 1 client.16215 shutdown 2024-09-13T17:15:34.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.009+0000 7fa5d8dc3740 1 -- 172.21.15.87:0/1863395986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ae0b74680 msgr2=0x557ae0b83840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:34.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.009+0000 7fa5d8dc3740 1 --2- 172.21.15.87:0/1863395986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ae0b74680 0x557ae0b83840 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4005bc0 tx=0x7fa5c4005fd0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.009+0000 7fa5d8dc3740 1 -- 172.21.15.87:0/1863395986 shutdown_connections 2024-09-13T17:15:34.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.009+0000 7fa5d8dc3740 1 --2- 172.21.15.87:0/1863395986 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x557ae0b93a10 0x557ae0b95e30 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.009+0000 7fa5d8dc3740 1 --2- 172.21.15.87:0/1863395986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557ae0b83d90 0x557ae0b81250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.009+0000 7fa5d8dc3740 1 --2- 172.21.15.87:0/1863395986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae0b74fa0 0x557ae0b80ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.009+0000 7fa5aeffd640 0 client.16215 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:34.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.009+0000 7fa5d8dc3740 1 --2- 172.21.15.87:0/1863395986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ae0b74680 0x557ae0b83840 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.009+0000 7fa5d8dc3740 1 -- 172.21.15.87:0/1863395986 >> 172.21.15.87:0/1863395986 conn(0x557ae0b70d50 msgr2=0x557ae0b70160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:34.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.009+0000 7fa5d8dc3740 1 -- 172.21.15.87:0/1863395986 shutdown_connections 2024-09-13T17:15:34.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.009+0000 7fa5d8dc3740 1 -- 172.21.15.87:0/1863395986 wait complete. 2024-09-13T17:15:34.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.009+0000 7fa5d8dc3740 20 client.16215 trim_cache size 0 max 16384 2024-09-13T17:15:34.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.024+0000 7fa5d8dc3740 1 Processor -- start 2024-09-13T17:15:34.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.024+0000 7fa5d8dc3740 1 -- start start 2024-09-13T17:15:34.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.024+0000 7fa5d8dc3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557ae0b74680 0x557ae0b833a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.024+0000 7fa5d8dc3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ae0b74fa0 0x557ae0b85180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.024+0000 7fa5d8dc3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae0b83d90 0x557ae0b856c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.024+0000 7fa5d8dc3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae0b6c880 con 0x557ae0b74fa0 2024-09-13T17:15:34.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.024+0000 7fa5d8dc3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae0b86810 con 0x557ae0b83d90 2024-09-13T17:15:34.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.024+0000 7fa5d8dc3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae0b62f20 con 0x557ae0b74680 2024-09-13T17:15:34.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.024+0000 7fa5cf7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ae0b74fa0 0x557ae0b85180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.024+0000 7fa5ceffd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557ae0b74680 0x557ae0b833a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.025+0000 7fa5ceffd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557ae0b74680 0x557ae0b833a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:39122/0 (socket says 172.21.15.87:39122) 2024-09-13T17:15:34.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.025+0000 7fa5cf7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ae0b74fa0 0x557ae0b85180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59878/0 (socket says 172.21.15.87:59878) 2024-09-13T17:15:34.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.025+0000 7fa5ceffd640 1 -- 172.21.15.87:0/2387240879 learned_addr learned my addr 172.21.15.87:0/2387240879 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:34.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.025+0000 7fa5ceffd640 1 --2- 172.21.15.87:0/2387240879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae0b83d90 0x557ae0b856c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.025+0000 7fa5ceffd640 1 -- 172.21.15.87:0/2387240879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae0b83d90 msgr2=0x557ae0b856c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:34.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.025+0000 7fa5ceffd640 1 --2- 172.21.15.87:0/2387240879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae0b83d90 0x557ae0b856c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.025+0000 7fa5ceffd640 1 -- 172.21.15.87:0/2387240879 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ae0b74fa0 msgr2=0x557ae0b85180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:34.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.025+0000 7fa5ceffd640 1 --2- 172.21.15.87:0/2387240879 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ae0b74fa0 0x557ae0b85180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.025+0000 7fa5ceffd640 1 -- 172.21.15.87:0/2387240879 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ae0a791c0 con 0x557ae0b74680 2024-09-13T17:15:34.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.025+0000 7fa5cf7fe640 1 --2- 172.21.15.87:0/2387240879 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ae0b74fa0 0x557ae0b85180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:15:34.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.025+0000 7fa5ceffd640 1 --2- 172.21.15.87:0/2387240879 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557ae0b74680 0x557ae0b833a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4001eb0 tx=0x7fa5c4005990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74d673b683359658 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:34.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.025+0000 7fa5b67fc640 1 -- 172.21.15.87:0/2387240879 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c4003e60 con 0x557ae0b74680 2024-09-13T17:15:34.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.025+0000 7fa5b67fc640 1 -- 172.21.15.87:0/2387240879 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa5c4009b40 con 0x557ae0b74680 2024-09-13T17:15:34.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.025+0000 7fa5b67fc640 1 -- 172.21.15.87:0/2387240879 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c402b5e0 con 0x557ae0b74680 2024-09-13T17:15:34.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.026+0000 7fa5d8dc3740 1 -- 172.21.15.87:0/2387240879 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557ae0b74680 msgr2=0x557ae0b833a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:34.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.026+0000 7fa5d8dc3740 1 --2- 172.21.15.87:0/2387240879 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557ae0b74680 0x557ae0b833a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4001eb0 tx=0x7fa5c4005990 comp rx=0 tx=0).stop 2024-09-13T17:15:34.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.026+0000 7fa5d8dc3740 1 -- 172.21.15.87:0/2387240879 shutdown_connections 2024-09-13T17:15:34.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.026+0000 7fa5d8dc3740 1 --2- 172.21.15.87:0/2387240879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae0b83d90 0x557ae0b856c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.026+0000 7fa5d8dc3740 1 --2- 172.21.15.87:0/2387240879 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ae0b74fa0 0x557ae0b85180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.026+0000 7fa5d8dc3740 1 --2- 172.21.15.87:0/2387240879 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557ae0b74680 0x557ae0b833a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.026+0000 7fa5d8dc3740 1 -- 172.21.15.87:0/2387240879 >> 172.21.15.87:0/2387240879 conn(0x557ae0b70d50 msgr2=0x557ae0b7bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:34.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.026+0000 7fa5d8dc3740 1 -- 172.21.15.87:0/2387240879 shutdown_connections 2024-09-13T17:15:34.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.026+0000 7fa5d8dc3740 1 -- 172.21.15.87:0/2387240879 wait complete. 2024-09-13T17:15:34.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.026+0000 7fa5d8dc3740 1 -- start start 2024-09-13T17:15:34.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.027+0000 7fa5d8dc3740 1 Processor -- start 2024-09-13T17:15:34.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.027+0000 7fa5d8dc3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae0b74680 0x557ae0b8af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.027+0000 7fa5d8dc3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557ae0b74fa0 0x557ae0b87340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.027+0000 7fa5d8dc3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ae0b83d90 0x557ae0b87ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.027+0000 7fa5d8dc3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae0b881d0 con 0x557ae0b83d90 2024-09-13T17:15:34.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.027+0000 7fa5d8dc3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae0be9f10 con 0x557ae0b74680 2024-09-13T17:15:34.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.027+0000 7fa5d8dc3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae0bea050 con 0x557ae0b74fa0 2024-09-13T17:15:34.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.027+0000 7fa5d8dc3740 10 client.0 _ll_register_callbacks cb 0x7fa5c4009e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:34.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.027+0000 7fa5ceffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ae0b83d90 0x557ae0b87ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.027+0000 7fa5cf7fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557ae0b74fa0 0x557ae0b87340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.027+0000 7fa5ceffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ae0b83d90 0x557ae0b87ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59882/0 (socket says 172.21.15.87:59882) 2024-09-13T17:15:34.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.027+0000 7fa5ceffd640 1 -- 172.21.15.87:0/525515186 learned_addr learned my addr 172.21.15.87:0/525515186 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:34.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.027+0000 7fa5ceffd640 1 --2- 172.21.15.87:0/525515186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae0b74680 0x557ae0b8af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.027+0000 7fa5cf7fe640 1 -- 172.21.15.87:0/525515186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae0b74680 msgr2=0x557ae0b8af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:34.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.027+0000 7fa5cf7fe640 1 --2- 172.21.15.87:0/525515186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae0b74680 0x557ae0b8af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.027+0000 7fa5cf7fe640 1 -- 172.21.15.87:0/525515186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ae0b83d90 msgr2=0x557ae0b87ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:34.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.027+0000 7fa5cf7fe640 1 --2- 172.21.15.87:0/525515186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ae0b83d90 0x557ae0b87ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.027+0000 7fa5cf7fe640 1 -- 172.21.15.87:0/525515186 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d010c340 con 0x557ae0b74fa0 2024-09-13T17:15:34.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.027+0000 7fa5ceffd640 1 --2- 172.21.15.87:0/525515186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ae0b83d90 0x557ae0b87ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:15:34.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.028+0000 7fa5cf7fe640 1 --2- 172.21.15.87:0/525515186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557ae0b74fa0 0x557ae0b87340 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0009230 tx=0x7fa5c0004180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b5808f6140a2f76 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:34.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.028+0000 7fa5aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-09-13T17:15:34.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.028+0000 7fa5aeffd640 1 -- 172.21.15.87:0/525515186 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c0041040 con 0x557ae0b74fa0 2024-09-13T17:15:34.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.028+0000 7fa5aeffd640 1 -- 172.21.15.87:0/525515186 <== mon.1 v2:172.21.15.149:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fa5c0049620 con 0x557ae0b74fa0 2024-09-13T17:15:34.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.028+0000 7fa5d8dc3740 1 -- 172.21.15.87:0/525515186 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa5c400f790 con 0x557ae0b74fa0 2024-09-13T17:15:34.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.028+0000 7fa5aeffd640 1 -- 172.21.15.87:0/525515186 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5c00497e0 con 0x557ae0b74fa0 2024-09-13T17:15:34.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.028+0000 7fa5d8dc3740 10 client.25633 fetch_fsmap learned FSMap version 26 2024-09-13T17:15:34.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.028+0000 7fa5d8dc3740 1 -- 172.21.15.87:0/525515186 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557ae0ad7360 con 0x557ae0b74fa0 2024-09-13T17:15:34.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.028+0000 7fa5aeffd640 1 -- 172.21.15.87:0/525515186 <== mon.1 v2:172.21.15.149:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa5c400f790 con 0x557ae0b74fa0 2024-09-13T17:15:34.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.029+0000 7fa5aeffd640 1 -- 172.21.15.87:0/525515186 <== mon.1 v2:172.21.15.149:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fa5c0032280 con 0x557ae0b74fa0 2024-09-13T17:15:34.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.029+0000 7fa5d8dc3740 10 client.25633 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T17:15:34.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.029+0000 7fa5d8dc3740 10 client.25633 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:15:34.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.029+0000 7fa5d8dc3740 20 client.25633 populate_metadata read hostname 'smithi087' 2024-09-13T17:15:34.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.029+0000 7fa5d8dc3740 1 --2- 172.21.15.87:0/525515186 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x557ae0b93a10 0x557ae0bed8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.029+0000 7fa5d8dc3740 4 client.25633 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-13T17:15:34.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.029+0000 7fa5d8dc3740 1 -- 172.21.15.87:0/525515186 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x557ae0830eb0 con 0x557ae0b93a10 2024-09-13T17:15:34.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.029+0000 7fa5ceffd640 1 --2- 172.21.15.87:0/525515186 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x557ae0b93a10 0x557ae0bed8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.029+0000 7fa5aeffd640 10 client.25633 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:34.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.029+0000 7fa5ceffd640 1 --2- 172.21.15.87:0/525515186 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x557ae0b93a10 0x557ae0bed8b0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c158506914b0502a server_cookie=c8add5f276be4def in_seq=0 out_seq=0 2024-09-13T17:15:34.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.030+0000 7fa5aeffd640 1 -- 172.21.15.87:0/525515186 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x557ae0830eb0 con 0x557ae0b93a10 2024-09-13T17:15:34.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.030+0000 7fa5aeffd640 10 client.25633 handle_command_reply: tid=0 2024-09-13T17:15:34.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.030+0000 7fa5d8dc3740 1 client.25633 shutdown 2024-09-13T17:15:34.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.030+0000 7fa5d8dc3740 1 -- 172.21.15.87:0/525515186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557ae0b74fa0 msgr2=0x557ae0b87340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:34.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.030+0000 7fa5d8dc3740 1 --2- 172.21.15.87:0/525515186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557ae0b74fa0 0x557ae0b87340 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0009230 tx=0x7fa5c0004180 comp rx=0 tx=0).stop 2024-09-13T17:15:34.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.030+0000 7fa5d8dc3740 1 -- 172.21.15.87:0/525515186 shutdown_connections 2024-09-13T17:15:34.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.030+0000 7fa5d8dc3740 1 --2- 172.21.15.87:0/525515186 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x557ae0b93a10 0x557ae0bed8b0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.030+0000 7fa5d8dc3740 1 --2- 172.21.15.87:0/525515186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ae0b83d90 0x557ae0b87ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.030+0000 7fa5aeffd640 0 client.25633 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:34.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.030+0000 7fa5d8dc3740 1 --2- 172.21.15.87:0/525515186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557ae0b74fa0 0x557ae0b87340 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.030+0000 7fa5d8dc3740 1 --2- 172.21.15.87:0/525515186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae0b74680 0x557ae0b8af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.030+0000 7fa5d8dc3740 1 -- 172.21.15.87:0/525515186 >> 172.21.15.87:0/525515186 conn(0x557ae0b70d50 msgr2=0x557ae0b761c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:34.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.030+0000 7fa5d8dc3740 1 -- 172.21.15.87:0/525515186 shutdown_connections 2024-09-13T17:15:34.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.030+0000 7fa5d8dc3740 1 -- 172.21.15.87:0/525515186 wait complete. 2024-09-13T17:15:34.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.030+0000 7fa5d8dc3740 20 client.25633 trim_cache size 0 max 16384 2024-09-13T17:15:34.038 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:15:34.038 INFO:teuthology.orchestra.run.smithi087.stdout: "return_code": 0, 2024-09-13T17:15:34.038 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_tag": "c847273c-f651-41dc-adcf-fd7d97912ca1", 2024-09-13T17:15:34.038 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": "asynchronous" 2024-09-13T17:15:34.039 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:15:34.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.031+0000 7fa5d5fc7640 1 -- 172.21.15.87:0/701812421 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa5b80a1280 msgr2=0x7fa5b80a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:34.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.031+0000 7fa5d5fc7640 1 --2- 172.21.15.87:0/701812421 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa5b80a1280 0x7fa5b80a3740 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8096700 tx=0x7fa5c806d390 comp rx=0 tx=0).stop 2024-09-13T17:15:34.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.031+0000 7fa5d5fc7640 1 -- 172.21.15.87:0/701812421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5d019ac60 msgr2=0x7fa5d019b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:34.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.031+0000 7fa5d5fc7640 1 --2- 172.21.15.87:0/701812421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5d019ac60 0x7fa5d019b110 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa5c800ea60 tx=0x7fa5c800ef20 comp rx=0 tx=0).stop 2024-09-13T17:15:34.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.031+0000 7fa5d5fc7640 1 -- 172.21.15.87:0/701812421 shutdown_connections 2024-09-13T17:15:34.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.031+0000 7fa5d5fc7640 1 --2- 172.21.15.87:0/701812421 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa5b80a1280 0x7fa5b80a3740 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.031+0000 7fa5d5fc7640 1 --2- 172.21.15.87:0/701812421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5d019ac60 0x7fa5d019b110 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.031+0000 7fa5d5fc7640 1 --2- 172.21.15.87:0/701812421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa5d0103fb0 0x7fa5d0196870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.031+0000 7fa5d5fc7640 1 --2- 172.21.15.87:0/701812421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5d00fee60 0x7fa5d0196330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.031+0000 7fa5d5fc7640 1 -- 172.21.15.87:0/701812421 >> 172.21.15.87:0/701812421 conn(0x7fa5d0075c60 msgr2=0x7fa5d00676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:34.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.031+0000 7fa5d5fc7640 1 -- 172.21.15.87:0/701812421 shutdown_connections 2024-09-13T17:15:34.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.031+0000 7fa5d5fc7640 1 -- 172.21.15.87:0/701812421 wait complete. 2024-09-13T17:15:34.044 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:15:34.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.159+0000 7f81f5f83640 1 -- 172.21.15.87:0/770538460 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81f00fee60 msgr2=0x7f81f00ff240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:34.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.159+0000 7f81f5f83640 1 --2- 172.21.15.87:0/770538460 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81f00fee60 0x7f81f00ff240 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f81e0009930 tx=0x7f81e002a420 comp rx=0 tx=0).stop 2024-09-13T17:15:34.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.159+0000 7f81f5f83640 1 -- 172.21.15.87:0/770538460 shutdown_connections 2024-09-13T17:15:34.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.159+0000 7f81f5f83640 1 --2- 172.21.15.87:0/770538460 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81f0103fb0 0x7f81f010bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.159+0000 7f81f5f83640 1 --2- 172.21.15.87:0/770538460 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81f00ff810 0x7f81f0103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.159+0000 7f81f5f83640 1 --2- 172.21.15.87:0/770538460 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81f00fee60 0x7f81f00ff240 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.159+0000 7f81f5f83640 1 -- 172.21.15.87:0/770538460 >> 172.21.15.87:0/770538460 conn(0x7f81f0075c60 msgr2=0x7f81f00fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:34.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.159+0000 7f81f5f83640 1 -- 172.21.15.87:0/770538460 shutdown_connections 2024-09-13T17:15:34.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.159+0000 7f81f5f83640 1 -- 172.21.15.87:0/770538460 wait complete. 2024-09-13T17:15:34.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.160+0000 7f81f5f83640 1 Processor -- start 2024-09-13T17:15:34.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.160+0000 7f81f5f83640 1 -- start start 2024-09-13T17:15:34.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.160+0000 7f81f5f83640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81f00fee60 0x7f81f0197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.160+0000 7f81f5f83640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81f0103fb0 0x7f81f01975d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.160+0000 7f81f5f83640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81f0197b60 0x7f81f01a2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.160+0000 7f81f5f83640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f01a27e0 con 0x7f81f0103fb0 2024-09-13T17:15:34.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.160+0000 7f81f5f83640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f01a2950 con 0x7f81f00fee60 2024-09-13T17:15:34.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.160+0000 7f81f5f83640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f01a2b10 con 0x7f81f0197b60 2024-09-13T17:15:34.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.161+0000 7f81eeffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81f0103fb0 0x7f81f01975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.161+0000 7f81ef7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81f00fee60 0x7f81f0197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.161+0000 7f81ef7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81f00fee60 0x7f81f0197090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.87:55298/0 (socket says 172.21.15.87:55298) 2024-09-13T17:15:34.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.161+0000 7f81ef7fe640 1 -- 172.21.15.87:0/3385206037 learned_addr learned my addr 172.21.15.87:0/3385206037 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:34.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.161+0000 7f81eeffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81f0103fb0 0x7f81f01975d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59896/0 (socket says 172.21.15.87:59896) 2024-09-13T17:15:34.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.161+0000 7f81effff640 1 --2- 172.21.15.87:0/3385206037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81f0197b60 0x7f81f01a2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.161+0000 7f81eeffd640 1 -- 172.21.15.87:0/3385206037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81f0197b60 msgr2=0x7f81f01a2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:34.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.161+0000 7f81eeffd640 1 --2- 172.21.15.87:0/3385206037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81f0197b60 0x7f81f01a2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.161+0000 7f81eeffd640 1 -- 172.21.15.87:0/3385206037 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81f00fee60 msgr2=0x7f81f0197090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:34.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.161+0000 7f81eeffd640 1 --2- 172.21.15.87:0/3385206037 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81f00fee60 0x7f81f0197090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.161+0000 7f81eeffd640 1 -- 172.21.15.87:0/3385206037 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e0009560 con 0x7f81f0103fb0 2024-09-13T17:15:34.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.161+0000 7f81eeffd640 1 --2- 172.21.15.87:0/3385206037 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81f0103fb0 0x7f81f01975d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f81e400e9c0 tx=0x7f81e400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:34.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.161+0000 7f81ecff9640 1 -- 172.21.15.87:0/3385206037 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e400ccc0 con 0x7f81f0103fb0 2024-09-13T17:15:34.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.161+0000 7f81ecff9640 1 -- 172.21.15.87:0/3385206037 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f81e400ce20 con 0x7f81f0103fb0 2024-09-13T17:15:34.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.161+0000 7f81ecff9640 1 -- 172.21.15.87:0/3385206037 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e4018710 con 0x7f81f0103fb0 2024-09-13T17:15:34.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.161+0000 7f81f5f83640 1 -- 172.21.15.87:0/3385206037 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f01a2df0 con 0x7f81f0103fb0 2024-09-13T17:15:34.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.161+0000 7f81f5f83640 1 -- 172.21.15.87:0/3385206037 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f01a3270 con 0x7f81f0103fb0 2024-09-13T17:15:34.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.164+0000 7f81ecff9640 1 -- 172.21.15.87:0/3385206037 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f81e4010430 con 0x7f81f0103fb0 2024-09-13T17:15:34.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.164+0000 7f81f8ca6740 1 Processor -- start 2024-09-13T17:15:34.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.164+0000 7f81f8ca6740 1 -- start start 2024-09-13T17:15:34.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.164+0000 7f81f8ca6740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55adb739ae10 0x55adb739b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.164+0000 7f81f8ca6740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adb739b730 0x55adb73a5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.164+0000 7f81f8ca6740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55adb73a5fd0 0x55adb73a83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.164+0000 7f81f8ca6740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adb7305f20 con 0x55adb73a5fd0 2024-09-13T17:15:34.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.164+0000 7f81f8ca6740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adb73036b0 con 0x55adb739b730 2024-09-13T17:15:34.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.164+0000 7f81f8ca6740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adb72fefa0 con 0x55adb739ae10 2024-09-13T17:15:34.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.164+0000 7f81ecff9640 1 --2- 172.21.15.87:0/3385206037 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f81d80a1280 0x7f81d80a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.164+0000 7f81eeffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55adb73a5fd0 0x55adb73a83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.164+0000 7f81ef7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adb739b730 0x55adb73a5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.164+0000 7f81ef7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adb739b730 0x55adb73a5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.87:55302/0 (socket says 172.21.15.87:55302) 2024-09-13T17:15:34.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.164+0000 7f81ef7fe640 1 -- 172.21.15.87:0/3455824588 learned_addr learned my addr 172.21.15.87:0/3455824588 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:34.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.164+0000 7f81effff640 1 --2- 172.21.15.87:0/3455824588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55adb739ae10 0x55adb739b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.165+0000 7f81effff640 1 --2- 172.21.15.87:0/3385206037 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f81d80a1280 0x7f81d80a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.165+0000 7f81ef7fe640 1 -- 172.21.15.87:0/3455824588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55adb739ae10 msgr2=0x55adb739b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:34.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.165+0000 7f81ef7fe640 1 --2- 172.21.15.87:0/3455824588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55adb739ae10 0x55adb739b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.165+0000 7f81ef7fe640 1 -- 172.21.15.87:0/3455824588 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55adb73a5fd0 msgr2=0x55adb73a83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:34.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.165+0000 7f81ef7fe640 1 --2- 172.21.15.87:0/3455824588 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55adb73a5fd0 0x55adb73a83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.165+0000 7f81ecff9640 1 -- 172.21.15.87:0/3385206037 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f81e4014070 con 0x7f81f0103fb0 2024-09-13T17:15:34.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.165+0000 7f81ef7fe640 1 -- 172.21.15.87:0/3455824588 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55adb72b9840 con 0x55adb739b730 2024-09-13T17:15:34.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.165+0000 7f81ef7fe640 1 --2- 172.21.15.87:0/3455824588 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adb739b730 0x55adb73a5a90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f81e002a940 tx=0x7f81e0031b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cef958466c42fcac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:34.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.165+0000 7f81effff640 1 --2- 172.21.15.87:0/3385206037 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f81d80a1280 0x7f81d80a3740 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f81e8005fd0 tx=0x7f81e8009550 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:34.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.166+0000 7f81d5ffb640 1 -- 172.21.15.87:0/3455824588 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e0031600 con 0x55adb739b730 2024-09-13T17:15:34.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.166+0000 7f81d5ffb640 1 -- 172.21.15.87:0/3455824588 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f81e0044070 con 0x55adb739b730 2024-09-13T17:15:34.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.166+0000 7f81d5ffb640 1 -- 172.21.15.87:0/3455824588 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e0040df0 con 0x55adb739b730 2024-09-13T17:15:34.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.166+0000 7f81f8ca6740 1 -- 172.21.15.87:0/3455824588 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adb739b730 msgr2=0x55adb73a5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:34.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.166+0000 7f81f8ca6740 1 --2- 172.21.15.87:0/3455824588 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adb739b730 0x55adb73a5a90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f81e002a940 tx=0x7f81e0031b60 comp rx=0 tx=0).stop 2024-09-13T17:15:34.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.167+0000 7f81f8ca6740 1 -- 172.21.15.87:0/3455824588 shutdown_connections 2024-09-13T17:15:34.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.167+0000 7f81f8ca6740 1 --2- 172.21.15.87:0/3455824588 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55adb73a5fd0 0x55adb73a83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.167+0000 7f81f8ca6740 1 --2- 172.21.15.87:0/3455824588 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adb739b730 0x55adb73a5a90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.167+0000 7f81f8ca6740 1 --2- 172.21.15.87:0/3455824588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55adb739ae10 0x55adb739b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.167+0000 7f81f8ca6740 1 -- 172.21.15.87:0/3455824588 >> 172.21.15.87:0/3455824588 conn(0x55adb7397380 msgr2=0x55adb7397760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:34.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.167+0000 7f81f8ca6740 1 -- 172.21.15.87:0/3455824588 shutdown_connections 2024-09-13T17:15:34.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.167+0000 7f81f8ca6740 1 -- 172.21.15.87:0/3455824588 wait complete. 2024-09-13T17:15:34.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.167+0000 7f81f8ca6740 1 -- start start 2024-09-13T17:15:34.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.167+0000 7f81f8ca6740 1 Processor -- start 2024-09-13T17:15:34.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.167+0000 7f81f8ca6740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55adb739ae10 0x55adb73a59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.167+0000 7f81f8ca6740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adb739b730 0x55adb73a2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.167+0000 7f81f8ca6740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55adb73a5fd0 0x55adb73a3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.167+0000 7f81f8ca6740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adb72a02a0 con 0x55adb73a5fd0 2024-09-13T17:15:34.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.167+0000 7f81f8ca6740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adb6fd7430 con 0x55adb739b730 2024-09-13T17:15:34.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.167+0000 7f81f8ca6740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adb7282680 con 0x55adb739ae10 2024-09-13T17:15:34.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.168+0000 7f81effff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55adb73a5fd0 0x55adb73a3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.168+0000 7f81effff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55adb73a5fd0 0x55adb73a3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59916/0 (socket says 172.21.15.87:59916) 2024-09-13T17:15:34.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.168+0000 7f81effff640 1 -- 172.21.15.87:0/1999689806 learned_addr learned my addr 172.21.15.87:0/1999689806 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:34.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.168+0000 7f81f8ca6740 10 client.0 _ll_register_callbacks cb 0x55adb72f8610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:34.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.168+0000 7f81eeffd640 1 --2- 172.21.15.87:0/1999689806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adb739b730 0x55adb73a2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.168+0000 7f81ef7fe640 1 --2- 172.21.15.87:0/1999689806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55adb739ae10 0x55adb73a59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.168+0000 7f81effff640 1 -- 172.21.15.87:0/1999689806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55adb739ae10 msgr2=0x55adb73a59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:34.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.168+0000 7f81effff640 1 --2- 172.21.15.87:0/1999689806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55adb739ae10 0x55adb73a59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.168+0000 7f81effff640 1 -- 172.21.15.87:0/1999689806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adb739b730 msgr2=0x55adb73a2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:34.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.168+0000 7f81effff640 1 --2- 172.21.15.87:0/1999689806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adb739b730 0x55adb73a2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.168+0000 7f81effff640 1 -- 172.21.15.87:0/1999689806 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f010c340 con 0x55adb73a5fd0 2024-09-13T17:15:34.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.168+0000 7f81eeffd640 1 --2- 172.21.15.87:0/1999689806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adb739b730 0x55adb73a2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:34.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.168+0000 7f81effff640 1 --2- 172.21.15.87:0/1999689806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55adb73a5fd0 0x55adb73a3330 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f81e800aba0 tx=0x7f81e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf38e8b9858d972b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:34.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.168+0000 7f81ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:15:34.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.168+0000 7f81ceffd640 1 -- 172.21.15.87:0/1999689806 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e8004b20 con 0x55adb73a5fd0 2024-09-13T17:15:34.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.168+0000 7f81ceffd640 1 -- 172.21.15.87:0/1999689806 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f81e8004c80 con 0x55adb73a5fd0 2024-09-13T17:15:34.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.168+0000 7f81f8ca6740 1 -- 172.21.15.87:0/1999689806 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55adb6ff24e0 con 0x55adb73a5fd0 2024-09-13T17:15:34.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.169+0000 7f81ceffd640 1 -- 172.21.15.87:0/1999689806 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81e8004e80 con 0x55adb73a5fd0 2024-09-13T17:15:34.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.169+0000 7f81f8ca6740 10 client.16233 fetch_fsmap learned FSMap version 26 2024-09-13T17:15:34.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.169+0000 7f81f8ca6740 1 -- 172.21.15.87:0/1999689806 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55adb72fd620 con 0x55adb73a5fd0 2024-09-13T17:15:34.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.169+0000 7f81ceffd640 1 -- 172.21.15.87:0/1999689806 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55adb6ff24e0 con 0x55adb73a5fd0 2024-09-13T17:15:34.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.169+0000 7f81ceffd640 1 -- 172.21.15.87:0/1999689806 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f81e8005640 con 0x55adb73a5fd0 2024-09-13T17:15:34.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.169+0000 7f81f8ca6740 10 client.16233 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T17:15:34.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.169+0000 7f81f8ca6740 10 client.16233 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:15:34.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.169+0000 7f81f8ca6740 20 client.16233 populate_metadata read hostname 'smithi087' 2024-09-13T17:15:34.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.169+0000 7f81f8ca6740 1 --2- 172.21.15.87:0/1999689806 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55adb73b5ec0 0x55adb73b82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.169+0000 7f81f8ca6740 4 client.16233 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:15:34.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.169+0000 7f81f8ca6740 1 -- 172.21.15.87:0/1999689806 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55adb70037e0 con 0x55adb73b5ec0 2024-09-13T17:15:34.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.169+0000 7f81ef7fe640 1 --2- 172.21.15.87:0/1999689806 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55adb73b5ec0 0x55adb73b82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.171+0000 7f81ceffd640 10 client.16233 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:34.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.171+0000 7f81ef7fe640 1 --2- 172.21.15.87:0/1999689806 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55adb73b5ec0 0x55adb73b82e0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b7529eca45325cc server_cookie=984601afd71e438 in_seq=0 out_seq=0 2024-09-13T17:15:34.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.174+0000 7f81ceffd640 1 -- 172.21.15.87:0/1999689806 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55adb70037e0 con 0x55adb73b5ec0 2024-09-13T17:15:34.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.174+0000 7f81ceffd640 10 client.16233 handle_command_reply: tid=0 2024-09-13T17:15:34.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.174+0000 7f81f8ca6740 1 client.16233 shutdown 2024-09-13T17:15:34.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.175+0000 7f81f8ca6740 1 -- 172.21.15.87:0/1999689806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55adb73a5fd0 msgr2=0x55adb73a3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:34.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.175+0000 7f81f8ca6740 1 --2- 172.21.15.87:0/1999689806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55adb73a5fd0 0x55adb73a3330 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f81e800aba0 tx=0x7f81e8004a40 comp rx=0 tx=0).stop 2024-09-13T17:15:34.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.175+0000 7f81f8ca6740 1 -- 172.21.15.87:0/1999689806 shutdown_connections 2024-09-13T17:15:34.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.175+0000 7f81f8ca6740 1 --2- 172.21.15.87:0/1999689806 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55adb73b5ec0 0x55adb73b82e0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.175+0000 7f81f8ca6740 1 --2- 172.21.15.87:0/1999689806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55adb73a5fd0 0x55adb73a3330 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.175+0000 7f81f8ca6740 1 --2- 172.21.15.87:0/1999689806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adb739b730 0x55adb73a2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.175+0000 7f81f8ca6740 1 --2- 172.21.15.87:0/1999689806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55adb739ae10 0x55adb73a59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.175+0000 7f81f8ca6740 1 -- 172.21.15.87:0/1999689806 >> 172.21.15.87:0/1999689806 conn(0x55adb7397380 msgr2=0x55adb739d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:34.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.175+0000 7f81ceffd640 0 client.16233 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:34.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.175+0000 7f81f8ca6740 1 -- 172.21.15.87:0/1999689806 shutdown_connections 2024-09-13T17:15:34.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.175+0000 7f81f8ca6740 1 -- 172.21.15.87:0/1999689806 wait complete. 2024-09-13T17:15:34.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.175+0000 7f81f8ca6740 20 client.16233 trim_cache size 0 max 16384 2024-09-13T17:15:34.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.192+0000 7f81f8ca6740 1 Processor -- start 2024-09-13T17:15:34.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.192+0000 7f81f8ca6740 1 -- start start 2024-09-13T17:15:34.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.192+0000 7f81f8ca6740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55adb739ae10 0x55adb7397760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.192+0000 7f81f8ca6740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adb739b730 0x55adb7397ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.192+0000 7f81f8ca6740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55adb73a5fd0 0x55adb73acd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.192+0000 7f81f8ca6740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adb6ff2510 con 0x55adb739ae10 2024-09-13T17:15:34.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.192+0000 7f81f8ca6740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adb73b46b0 con 0x55adb739b730 2024-09-13T17:15:34.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.192+0000 7f81f8ca6740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adb73b2b30 con 0x55adb73a5fd0 2024-09-13T17:15:34.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.192+0000 7f81ef7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55adb739ae10 0x55adb7397760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.192+0000 7f81ef7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55adb739ae10 0x55adb7397760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59920/0 (socket says 172.21.15.87:59920) 2024-09-13T17:15:34.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.192+0000 7f81ef7fe640 1 -- 172.21.15.87:0/1281404075 learned_addr learned my addr 172.21.15.87:0/1281404075 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:34.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.192+0000 7f81eeffd640 1 --2- 172.21.15.87:0/1281404075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adb739b730 0x55adb7397ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.192+0000 7f81effff640 1 --2- 172.21.15.87:0/1281404075 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55adb73a5fd0 0x55adb73acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.193+0000 7f81ef7fe640 1 -- 172.21.15.87:0/1281404075 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55adb73a5fd0 msgr2=0x55adb73acd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:34.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.193+0000 7f81ef7fe640 1 --2- 172.21.15.87:0/1281404075 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55adb73a5fd0 0x55adb73acd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.193+0000 7f81ef7fe640 1 -- 172.21.15.87:0/1281404075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adb739b730 msgr2=0x55adb7397ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:34.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.193+0000 7f81ef7fe640 1 --2- 172.21.15.87:0/1281404075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adb739b730 0x55adb7397ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.193+0000 7f81ef7fe640 1 -- 172.21.15.87:0/1281404075 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55adb729f790 con 0x55adb739ae10 2024-09-13T17:15:34.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.193+0000 7f81effff640 1 --2- 172.21.15.87:0/1281404075 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55adb73a5fd0 0x55adb73acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:34.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.193+0000 7f81eeffd640 1 --2- 172.21.15.87:0/1281404075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adb739b730 0x55adb7397ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:15:34.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.193+0000 7f81ef7fe640 1 --2- 172.21.15.87:0/1281404075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55adb739ae10 0x55adb7397760 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f81e002a940 tx=0x7f81e00409d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7afc148e0b646171 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:34.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.193+0000 7f81d67fc640 1 -- 172.21.15.87:0/1281404075 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e004d040 con 0x55adb739ae10 2024-09-13T17:15:34.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.193+0000 7f81d67fc640 1 -- 172.21.15.87:0/1281404075 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f81e0004030 con 0x55adb739ae10 2024-09-13T17:15:34.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.193+0000 7f81d67fc640 1 -- 172.21.15.87:0/1281404075 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e0005370 con 0x55adb739ae10 2024-09-13T17:15:34.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.194+0000 7f81f8ca6740 1 -- 172.21.15.87:0/1281404075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55adb739ae10 msgr2=0x55adb7397760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:34.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.194+0000 7f81f8ca6740 1 --2- 172.21.15.87:0/1281404075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55adb739ae10 0x55adb7397760 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f81e002a940 tx=0x7f81e00409d0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.194+0000 7f81f8ca6740 1 -- 172.21.15.87:0/1281404075 shutdown_connections 2024-09-13T17:15:34.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.194+0000 7f81f8ca6740 1 --2- 172.21.15.87:0/1281404075 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55adb73a5fd0 0x55adb73acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.194+0000 7f81f8ca6740 1 --2- 172.21.15.87:0/1281404075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adb739b730 0x55adb7397ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.194+0000 7f81f8ca6740 1 --2- 172.21.15.87:0/1281404075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55adb739ae10 0x55adb7397760 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.194+0000 7f81f8ca6740 1 -- 172.21.15.87:0/1281404075 >> 172.21.15.87:0/1281404075 conn(0x55adb7397380 msgr2=0x55adb73bcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:34.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.194+0000 7f81f8ca6740 1 -- 172.21.15.87:0/1281404075 shutdown_connections 2024-09-13T17:15:34.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.194+0000 7f81f8ca6740 1 -- 172.21.15.87:0/1281404075 wait complete. 2024-09-13T17:15:34.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.194+0000 7f81f8ca6740 1 -- start start 2024-09-13T17:15:34.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.195+0000 7f81f8ca6740 1 Processor -- start 2024-09-13T17:15:34.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.195+0000 7f81f8ca6740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55adb739ae10 0x55adb74079c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.195+0000 7f81f8ca6740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55adb739b730 0x55adb73acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.195+0000 7f81f8ca6740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adb73a5fd0 0x55adb73ad280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.195+0000 7f81f8ca6740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adb74043b0 con 0x55adb739ae10 2024-09-13T17:15:34.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.195+0000 7f81f8ca6740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adb7404520 con 0x55adb73a5fd0 2024-09-13T17:15:34.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.195+0000 7f81f8ca6740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adb74046e0 con 0x55adb739b730 2024-09-13T17:15:34.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.195+0000 7f81f8ca6740 10 client.0 _ll_register_callbacks cb 0x7f81e800a820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:34.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.195+0000 7f81ef7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55adb739ae10 0x55adb74079c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.195+0000 7f81ef7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55adb739ae10 0x55adb74079c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59932/0 (socket says 172.21.15.87:59932) 2024-09-13T17:15:34.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.195+0000 7f81ef7fe640 1 -- 172.21.15.87:0/3523473017 learned_addr learned my addr 172.21.15.87:0/3523473017 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:34.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.195+0000 7f81effff640 1 --2- 172.21.15.87:0/3523473017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adb73a5fd0 0x55adb73ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.195+0000 7f81eeffd640 1 --2- 172.21.15.87:0/3523473017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55adb739b730 0x55adb73acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.195+0000 7f81ef7fe640 1 -- 172.21.15.87:0/3523473017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55adb739b730 msgr2=0x55adb73acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:34.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.195+0000 7f81ef7fe640 1 --2- 172.21.15.87:0/3523473017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55adb739b730 0x55adb73acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.195+0000 7f81ef7fe640 1 -- 172.21.15.87:0/3523473017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adb73a5fd0 msgr2=0x55adb73ad280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:34.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.195+0000 7f81ef7fe640 1 --2- 172.21.15.87:0/3523473017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adb73a5fd0 0x55adb73ad280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.195+0000 7f81ef7fe640 1 -- 172.21.15.87:0/3523473017 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f01a3270 con 0x55adb739ae10 2024-09-13T17:15:34.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.195+0000 7f81eeffd640 1 --2- 172.21.15.87:0/3523473017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55adb739b730 0x55adb73acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:15:34.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.195+0000 7f81effff640 1 --2- 172.21.15.87:0/3523473017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adb73a5fd0 0x55adb73ad280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:15:34.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.196+0000 7f81ef7fe640 1 --2- 172.21.15.87:0/3523473017 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55adb739ae10 0x55adb74079c0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f81e0031ba0 tx=0x7f81e0005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6956a401c933528 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:34.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.196+0000 7f81ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:15:34.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.196+0000 7f81ceffd640 1 -- 172.21.15.87:0/3523473017 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e004d070 con 0x55adb739ae10 2024-09-13T17:15:34.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.196+0000 7f81ceffd640 1 -- 172.21.15.87:0/3523473017 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f81e0031e40 con 0x55adb739ae10 2024-09-13T17:15:34.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.196+0000 7f81f8ca6740 1 -- 172.21.15.87:0/3523473017 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f81e0044070 con 0x55adb739ae10 2024-09-13T17:15:34.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.196+0000 7f81ceffd640 1 -- 172.21.15.87:0/3523473017 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81e0004460 con 0x55adb739ae10 2024-09-13T17:15:34.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.196+0000 7f81f8ca6740 10 client.16239 fetch_fsmap learned FSMap version 26 2024-09-13T17:15:34.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.196+0000 7f81f8ca6740 1 -- 172.21.15.87:0/3523473017 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55adb72b9840 con 0x55adb739ae10 2024-09-13T17:15:34.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.197+0000 7f81ceffd640 1 -- 172.21.15.87:0/3523473017 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f81e0044070 con 0x55adb739ae10 2024-09-13T17:15:34.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.197+0000 7f81ceffd640 1 -- 172.21.15.87:0/3523473017 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f81e00401d0 con 0x55adb739ae10 2024-09-13T17:15:34.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.197+0000 7f81f8ca6740 10 client.16239 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T17:15:34.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.197+0000 7f81f8ca6740 10 client.16239 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:15:34.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.197+0000 7f81f8ca6740 20 client.16239 populate_metadata read hostname 'smithi087' 2024-09-13T17:15:34.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.197+0000 7f81f8ca6740 1 --2- 172.21.15.87:0/3523473017 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55adb7415120 0x55adb7417540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:34.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.197+0000 7f81f8ca6740 4 client.16239 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:15:34.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.197+0000 7f81f8ca6740 1 -- 172.21.15.87:0/3523473017 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55adb7056e30 con 0x55adb7415120 2024-09-13T17:15:34.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.197+0000 7f81eeffd640 1 --2- 172.21.15.87:0/3523473017 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55adb7415120 0x55adb7417540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:34.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.199+0000 7f81ceffd640 10 client.16239 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:34.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.199+0000 7f81eeffd640 1 --2- 172.21.15.87:0/3523473017 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55adb7415120 0x55adb7417540 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=519674a5132f80fb server_cookie=ca1617f3b8a7a51 in_seq=0 out_seq=0 2024-09-13T17:15:34.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.201+0000 7f81ceffd640 1 -- 172.21.15.87:0/3523473017 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x55adb7056e30 con 0x55adb7415120 2024-09-13T17:15:34.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.201+0000 7f81ceffd640 10 client.16239 handle_command_reply: tid=0 2024-09-13T17:15:34.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.201+0000 7f81f8ca6740 1 client.16239 shutdown 2024-09-13T17:15:34.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.202+0000 7f81f8ca6740 1 -- 172.21.15.87:0/3523473017 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55adb739ae10 msgr2=0x55adb74079c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:34.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.202+0000 7f81f8ca6740 1 --2- 172.21.15.87:0/3523473017 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55adb739ae10 0x55adb74079c0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f81e0031ba0 tx=0x7f81e0005dd0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.202+0000 7f81f8ca6740 1 -- 172.21.15.87:0/3523473017 shutdown_connections 2024-09-13T17:15:34.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.202+0000 7f81f8ca6740 1 --2- 172.21.15.87:0/3523473017 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55adb7415120 0x55adb7417540 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.202+0000 7f81f8ca6740 1 --2- 172.21.15.87:0/3523473017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55adb73a5fd0 0x55adb73ad280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.202+0000 7f81f8ca6740 1 --2- 172.21.15.87:0/3523473017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55adb739b730 0x55adb73acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.202+0000 7f81f8ca6740 1 --2- 172.21.15.87:0/3523473017 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55adb739ae10 0x55adb74079c0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.202+0000 7f81f8ca6740 1 -- 172.21.15.87:0/3523473017 >> 172.21.15.87:0/3523473017 conn(0x55adb7397380 msgr2=0x55adb739df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:34.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.202+0000 7f81ceffd640 0 client.16239 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:34.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.202+0000 7f81f8ca6740 1 -- 172.21.15.87:0/3523473017 shutdown_connections 2024-09-13T17:15:34.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.202+0000 7f81f8ca6740 1 -- 172.21.15.87:0/3523473017 wait complete. 2024-09-13T17:15:34.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.202+0000 7f81f8ca6740 20 client.16239 trim_cache size 0 max 16384 2024-09-13T17:15:34.206 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:15:34.206 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "scrub active (707 inodes in the stack)", 2024-09-13T17:15:34.206 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": { 2024-09-13T17:15:34.206 INFO:teuthology.orchestra.run.smithi087.stdout: "c847273c-f651-41dc-adcf-fd7d97912ca1": { 2024-09-13T17:15:34.206 INFO:teuthology.orchestra.run.smithi087.stdout: "path": "/", 2024-09-13T17:15:34.206 INFO:teuthology.orchestra.run.smithi087.stdout: "tag": "c847273c-f651-41dc-adcf-fd7d97912ca1", 2024-09-13T17:15:34.206 INFO:teuthology.orchestra.run.smithi087.stdout: "options": "recursive,force" 2024-09-13T17:15:34.206 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:15:34.207 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:15:34.207 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:15:34.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.203+0000 7f81f5f83640 1 -- 172.21.15.87:0/3385206037 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f81d80a1280 msgr2=0x7f81d80a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:34.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.203+0000 7f81f5f83640 1 --2- 172.21.15.87:0/3385206037 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f81d80a1280 0x7f81d80a3740 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f81e8005fd0 tx=0x7f81e8009550 comp rx=0 tx=0).stop 2024-09-13T17:15:34.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.203+0000 7f81f5f83640 1 -- 172.21.15.87:0/3385206037 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81f0103fb0 msgr2=0x7f81f01975d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:34.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.203+0000 7f81f5f83640 1 --2- 172.21.15.87:0/3385206037 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81f0103fb0 0x7f81f01975d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f81e400e9c0 tx=0x7f81e400ee80 comp rx=0 tx=0).stop 2024-09-13T17:15:34.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.203+0000 7f81f5f83640 1 -- 172.21.15.87:0/3385206037 shutdown_connections 2024-09-13T17:15:34.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.203+0000 7f81f5f83640 1 --2- 172.21.15.87:0/3385206037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81f0197b60 0x7f81f01a2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.203+0000 7f81f5f83640 1 --2- 172.21.15.87:0/3385206037 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f81d80a1280 0x7f81d80a3740 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.203+0000 7f81f5f83640 1 --2- 172.21.15.87:0/3385206037 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81f0103fb0 0x7f81f01975d0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.203+0000 7f81f5f83640 1 --2- 172.21.15.87:0/3385206037 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81f00fee60 0x7f81f0197090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:34.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.203+0000 7f81f5f83640 1 -- 172.21.15.87:0/3385206037 >> 172.21.15.87:0/3385206037 conn(0x7f81f0075c60 msgr2=0x7f81f00fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:34.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.203+0000 7f81f5f83640 1 -- 172.21.15.87:0/3385206037 shutdown_connections 2024-09-13T17:15:34.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:15:34.203+0000 7f81f5f83640 1 -- 172.21.15.87:0/3385206037 wait complete. 2024-09-13T17:15:34.216 INFO:tasks.cephfs.filesystem:scrub status for tag:c847273c-f651-41dc-adcf-fd7d97912ca1 - {'path': '/', 'tag': 'c847273c-f651-41dc-adcf-fd7d97912ca1', 'options': 'recursive,force'} 2024-09-13T17:15:34.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:34 smithi149 ceph-mon[35496]: pgmap v55: 129 pgs: 129 active+clean; 123 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 1.6 MiB/s wr, 27 op/s 2024-09-13T17:15:34.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:34 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:15:34.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:34 smithi118 ceph-mon[34374]: pgmap v55: 129 pgs: 129 active+clean; 123 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 1.6 MiB/s wr, 27 op/s 2024-09-13T17:15:34.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:34 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:15:34.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:34 smithi087 ceph-mon[30934]: pgmap v55: 129 pgs: 129 active+clean; 123 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 1.6 MiB/s wr, 27 op/s 2024-09-13T17:15:34.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:34 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:15:35.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:35 smithi149 ceph-mon[35496]: scrub queued for path: / 2024-09-13T17:15:35.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:35 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:15:35.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:35 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:15:35.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:35 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:15:35.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:35 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:15:35.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:35 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:15:35.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:35 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:15:35.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:35 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:15:35.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:35 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:15:35.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:35 smithi118 ceph-mon[34374]: scrub queued for path: / 2024-09-13T17:15:35.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:35 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:15:35.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:35 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:15:35.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:35 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:15:35.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:35 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:15:35.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:35 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:15:35.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:35 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:15:35.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:35 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:15:35.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:35 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:15:35.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:35 smithi087 ceph-mon[30934]: scrub queued for path: / 2024-09-13T17:15:35.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:35 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:15:35.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:35 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:15:35.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:35 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:15:35.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:35 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:15:35.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:35 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:15:35.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:35 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:15:35.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:35 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:15:35.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:35 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:15:36.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:36 smithi149 ceph-mon[35496]: pgmap v56: 129 pgs: 129 active+clean; 129 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.9 MiB/s wr, 592 op/s 2024-09-13T17:15:36.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:36 smithi118 ceph-mon[34374]: pgmap v56: 129 pgs: 129 active+clean; 129 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.9 MiB/s wr, 592 op/s 2024-09-13T17:15:36.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:36 smithi087 ceph-mon[30934]: pgmap v56: 129 pgs: 129 active+clean; 129 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.9 MiB/s wr, 592 op/s 2024-09-13T17:15:37.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:37 smithi149 ceph-mon[35496]: pgmap v57: 129 pgs: 129 active+clean; 129 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 2.5 MiB/s wr, 582 op/s 2024-09-13T17:15:37.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:37 smithi118 ceph-mon[34374]: pgmap v57: 129 pgs: 129 active+clean; 129 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 2.5 MiB/s wr, 582 op/s 2024-09-13T17:15:37.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:37 smithi087 ceph-mon[30934]: pgmap v57: 129 pgs: 129 active+clean; 129 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 2.5 MiB/s wr, 582 op/s 2024-09-13T17:15:40.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:40 smithi087 ceph-mon[30934]: pgmap v58: 129 pgs: 129 active+clean; 129 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 2.5 MiB/s wr, 582 op/s 2024-09-13T17:15:40.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:40 smithi149 ceph-mon[35496]: pgmap v58: 129 pgs: 129 active+clean; 129 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 2.5 MiB/s wr, 582 op/s 2024-09-13T17:15:40.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:40 smithi118 ceph-mon[34374]: pgmap v58: 129 pgs: 129 active+clean; 129 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 2.5 MiB/s wr, 582 op/s 2024-09-13T17:15:42.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:42 smithi149 ceph-mon[35496]: pgmap v59: 129 pgs: 129 active+clean; 134 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 787 op/s 2024-09-13T17:15:42.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:42 smithi118 ceph-mon[34374]: pgmap v59: 129 pgs: 129 active+clean; 134 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 787 op/s 2024-09-13T17:15:42.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:42 smithi087 ceph-mon[30934]: pgmap v59: 129 pgs: 129 active+clean; 134 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 787 op/s 2024-09-13T17:15:44.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:44 smithi149 ceph-mon[35496]: pgmap v60: 129 pgs: 129 active+clean; 134 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 770 op/s 2024-09-13T17:15:44.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:44 smithi118 ceph-mon[34374]: pgmap v60: 129 pgs: 129 active+clean; 134 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 770 op/s 2024-09-13T17:15:44.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:44 smithi087 ceph-mon[30934]: pgmap v60: 129 pgs: 129 active+clean; 134 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 770 op/s 2024-09-13T17:15:45.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:45 smithi149 ceph-mon[35496]: scrub summary: idle 2024-09-13T17:15:45.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:45 smithi149 ceph-mon[35496]: scrub summary: idle 2024-09-13T17:15:45.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:45 smithi118 ceph-mon[34374]: scrub summary: idle 2024-09-13T17:15:45.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:45 smithi118 ceph-mon[34374]: scrub summary: idle 2024-09-13T17:15:45.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:45 smithi087 ceph-mon[30934]: scrub summary: idle 2024-09-13T17:15:45.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:45 smithi087 ceph-mon[30934]: scrub summary: idle 2024-09-13T17:15:46.748 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.745+0000 7f6315ede640 1 -- 172.21.15.87:0/3408166965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63101008f0 msgr2=0x7f6310104930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:46.748 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.745+0000 7f6315ede640 1 --2- 172.21.15.87:0/3408166965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63101008f0 0x7f6310104930 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f6304009930 tx=0x7f630402a420 comp rx=0 tx=0).stop 2024-09-13T17:15:46.748 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.745+0000 7f6315ede640 1 -- 172.21.15.87:0/3408166965 shutdown_connections 2024-09-13T17:15:46.748 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.745+0000 7f6315ede640 1 --2- 172.21.15.87:0/3408166965 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6310105090 0x7f631010cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:46.748 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.745+0000 7f6315ede640 1 --2- 172.21.15.87:0/3408166965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63101008f0 0x7f6310104930 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:46.748 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.745+0000 7f6315ede640 1 --2- 172.21.15.87:0/3408166965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63100fff40 0x7f6310100320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:46.748 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.745+0000 7f6315ede640 1 -- 172.21.15.87:0/3408166965 >> 172.21.15.87:0/3408166965 conn(0x7f63100fb9d0 msgr2=0x7f63100fddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:46.748 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.745+0000 7f6315ede640 1 -- 172.21.15.87:0/3408166965 shutdown_connections 2024-09-13T17:15:46.749 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.745+0000 7f6315ede640 1 -- 172.21.15.87:0/3408166965 wait complete. 2024-09-13T17:15:46.749 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.745+0000 7f6315ede640 1 Processor -- start 2024-09-13T17:15:46.749 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.746+0000 7f6315ede640 1 -- start start 2024-09-13T17:15:46.749 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.746+0000 7f6315ede640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63100fff40 0x7f63100727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:46.749 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.746+0000 7f6315ede640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6310105090 0x7f6310072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:46.749 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.746+0000 7f6315ede640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6310073230 0x7f63101a4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:46.749 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.746+0000 7f6315ede640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63101a49f0 con 0x7f6310105090 2024-09-13T17:15:46.749 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.746+0000 7f6315ede640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63101a4b60 con 0x7f6310073230 2024-09-13T17:15:46.749 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.746+0000 7f6315ede640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63101a4d20 con 0x7f63100fff40 2024-09-13T17:15:46.749 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.746+0000 7f630effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6310105090 0x7f6310072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:46.749 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.746+0000 7f630effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6310105090 0x7f6310072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38814/0 (socket says 172.21.15.87:38814) 2024-09-13T17:15:46.749 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.746+0000 7f630effd640 1 -- 172.21.15.87:0/2993713064 learned_addr learned my addr 172.21.15.87:0/2993713064 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:46.750 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.746+0000 7f630f7fe640 1 --2- 172.21.15.87:0/2993713064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63100fff40 0x7f63100727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:46.750 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.746+0000 7f630ffff640 1 --2- 172.21.15.87:0/2993713064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6310073230 0x7f63101a4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:46.750 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.746+0000 7f630effd640 1 -- 172.21.15.87:0/2993713064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63100fff40 msgr2=0x7f63100727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:46.750 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.746+0000 7f630effd640 1 --2- 172.21.15.87:0/2993713064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63100fff40 0x7f63100727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:46.750 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.746+0000 7f630effd640 1 -- 172.21.15.87:0/2993713064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6310073230 msgr2=0x7f63101a4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:46.750 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.746+0000 7f630effd640 1 --2- 172.21.15.87:0/2993713064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6310073230 0x7f63101a4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:46.750 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.746+0000 7f630effd640 1 -- 172.21.15.87:0/2993713064 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6304009560 con 0x7f6310105090 2024-09-13T17:15:46.750 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.746+0000 7f630effd640 1 --2- 172.21.15.87:0/2993713064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6310105090 0x7f6310072cf0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f6304009900 tx=0x7f63040040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:46.750 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.746+0000 7f630cff9640 1 -- 172.21.15.87:0/2993713064 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63040037f0 con 0x7f6310105090 2024-09-13T17:15:46.750 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.747+0000 7f6315ede640 1 -- 172.21.15.87:0/2993713064 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63101a4fa0 con 0x7f6310105090 2024-09-13T17:15:46.750 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.747+0000 7f630cff9640 1 -- 172.21.15.87:0/2993713064 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f63040044c0 con 0x7f6310105090 2024-09-13T17:15:46.750 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.747+0000 7f630cff9640 1 -- 172.21.15.87:0/2993713064 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630403bdd0 con 0x7f6310105090 2024-09-13T17:15:46.750 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.747+0000 7f6315ede640 1 -- 172.21.15.87:0/2993713064 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63101a53d0 con 0x7f6310105090 2024-09-13T17:15:46.757 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.749+0000 7f630cff9640 1 -- 172.21.15.87:0/2993713064 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f630403b560 con 0x7f6310105090 2024-09-13T17:15:46.757 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.749+0000 7f6318bff740 1 Processor -- start 2024-09-13T17:15:46.757 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.749+0000 7f6318bff740 1 -- start start 2024-09-13T17:15:46.757 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.749+0000 7f6318bff740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564a3cce330 0x5564a3cce710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:46.757 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.749+0000 7f6318bff740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564a3ccec50 0x5564a3cd8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:46.757 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.749+0000 7f6318bff740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a3cd94f0 0x5564a3cdb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:46.757 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.749+0000 7f6318bff740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564a3c39c30 con 0x5564a3ccec50 2024-09-13T17:15:46.757 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.749+0000 7f6318bff740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564a3c373c0 con 0x5564a3cd94f0 2024-09-13T17:15:46.757 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.749+0000 7f6318bff740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564a3c32cb0 con 0x5564a3cce330 2024-09-13T17:15:46.757 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.750+0000 7f630ffff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564a3cce330 0x5564a3cce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:46.757 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.750+0000 7f630ffff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564a3cce330 0x5564a3cce710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:59088/0 (socket says 172.21.15.87:59088) 2024-09-13T17:15:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.750+0000 7f630ffff640 1 -- 172.21.15.87:0/550467975 learned_addr learned my addr 172.21.15.87:0/550467975 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.750+0000 7f630effd640 1 --2- 172.21.15.87:0/550467975 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a3cd94f0 0x5564a3cdb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.750+0000 7f630f7fe640 1 --2- 172.21.15.87:0/550467975 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564a3ccec50 0x5564a3cd8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.750+0000 7f630cff9640 1 --2- 172.21.15.87:0/2993713064 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f62f80a1230 0x7f62f80a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.750+0000 7f630ffff640 1 -- 172.21.15.87:0/550467975 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a3cd94f0 msgr2=0x5564a3cdb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.750+0000 7f630ffff640 1 --2- 172.21.15.87:0/550467975 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a3cd94f0 0x5564a3cdb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.750+0000 7f630ffff640 1 -- 172.21.15.87:0/550467975 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564a3ccec50 msgr2=0x5564a3cd8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.750+0000 7f630ffff640 1 --2- 172.21.15.87:0/550467975 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564a3ccec50 0x5564a3cd8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.750+0000 7f630ffff640 1 -- 172.21.15.87:0/550467975 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564a3bd9910 con 0x5564a3cce330 2024-09-13T17:15:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.750+0000 7f630ffff640 1 --2- 172.21.15.87:0/2993713064 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f62f80a1230 0x7f62f80a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.750+0000 7f630cff9640 1 -- 172.21.15.87:0/2993713064 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f63040edb90 con 0x7f6310105090 2024-09-13T17:15:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.750+0000 7f630ffff640 1 --2- 172.21.15.87:0/550467975 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564a3cce330 0x5564a3cce710 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6308011590 tx=0x7f6308011a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ef7168363f33485 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.751+0000 7f630ffff640 1 --2- 172.21.15.87:0/2993713064 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f62f80a1230 0x7f62f80a36f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f630801b000 tx=0x7f630801d000 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.751+0000 7f62f5ffb640 1 -- 172.21.15.87:0/550467975 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630800f7a0 con 0x5564a3cce330 2024-09-13T17:15:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.751+0000 7f62f5ffb640 1 -- 172.21.15.87:0/550467975 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f630801cd70 con 0x5564a3cce330 2024-09-13T17:15:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.751+0000 7f62f5ffb640 1 -- 172.21.15.87:0/550467975 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630801bc30 con 0x5564a3cce330 2024-09-13T17:15:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.751+0000 7f6318bff740 1 -- 172.21.15.87:0/550467975 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564a3cce330 msgr2=0x5564a3cce710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.751+0000 7f6318bff740 1 --2- 172.21.15.87:0/550467975 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564a3cce330 0x5564a3cce710 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6308011590 tx=0x7f6308011a50 comp rx=0 tx=0).stop 2024-09-13T17:15:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.751+0000 7f6318bff740 1 -- 172.21.15.87:0/550467975 shutdown_connections 2024-09-13T17:15:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.751+0000 7f6318bff740 1 --2- 172.21.15.87:0/550467975 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a3cd94f0 0x5564a3cdb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.751+0000 7f6318bff740 1 --2- 172.21.15.87:0/550467975 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564a3ccec50 0x5564a3cd8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.751+0000 7f6318bff740 1 --2- 172.21.15.87:0/550467975 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564a3cce330 0x5564a3cce710 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.751+0000 7f6318bff740 1 -- 172.21.15.87:0/550467975 >> 172.21.15.87:0/550467975 conn(0x5564a3cca8c0 msgr2=0x5564a3ccaca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.751+0000 7f6318bff740 1 -- 172.21.15.87:0/550467975 shutdown_connections 2024-09-13T17:15:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.752+0000 7f6318bff740 1 -- 172.21.15.87:0/550467975 wait complete. 2024-09-13T17:15:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.752+0000 7f6318bff740 1 -- start start 2024-09-13T17:15:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.752+0000 7f6318bff740 1 Processor -- start 2024-09-13T17:15:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.752+0000 7f6318bff740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564a3cce330 0x5564a3cd8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.752+0000 7f6318bff740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a3ccec50 0x5564a3cd6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.753+0000 7f6318bff740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564a3cd94f0 0x5564a3cd6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.753+0000 7f6318bff740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564a3bf0e80 con 0x5564a3cce330 2024-09-13T17:15:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.753+0000 7f6318bff740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564a3bf0b20 con 0x5564a3ccec50 2024-09-13T17:15:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.753+0000 7f6318bff740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564a3bb6260 con 0x5564a3cd94f0 2024-09-13T17:15:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.753+0000 7f6318bff740 10 client.0 _ll_register_callbacks cb 0x5564a3bebdf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.753+0000 7f630f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564a3cce330 0x5564a3cd8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.753+0000 7f630effd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a3ccec50 0x5564a3cd6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.753+0000 7f630f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564a3cce330 0x5564a3cd8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38834/0 (socket says 172.21.15.87:38834) 2024-09-13T17:15:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.753+0000 7f630ffff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564a3cd94f0 0x5564a3cd6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.753+0000 7f630f7fe640 1 -- 172.21.15.87:0/3833372794 learned_addr learned my addr 172.21.15.87:0/3833372794 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.753+0000 7f630effd640 1 -- 172.21.15.87:0/3833372794 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564a3cd94f0 msgr2=0x5564a3cd6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:46.761 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.753+0000 7f630effd640 1 --2- 172.21.15.87:0/3833372794 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564a3cd94f0 0x5564a3cd6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:46.761 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.753+0000 7f630effd640 1 -- 172.21.15.87:0/3833372794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564a3cce330 msgr2=0x5564a3cd8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:46.761 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.753+0000 7f630effd640 1 --2- 172.21.15.87:0/3833372794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564a3cce330 0x5564a3cd8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:46.761 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.753+0000 7f630effd640 1 -- 172.21.15.87:0/3833372794 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6308009c50 con 0x5564a3ccec50 2024-09-13T17:15:46.761 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.753+0000 7f630effd640 1 --2- 172.21.15.87:0/3833372794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a3ccec50 0x5564a3cd6140 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f63040eaf30 tx=0x7f63040f1290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a78fb10877233f06 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:46.761 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.753+0000 7f62eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-09-13T17:15:46.761 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.753+0000 7f62eeffd640 1 -- 172.21.15.87:0/3833372794 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63040ba4e0 con 0x5564a3ccec50 2024-09-13T17:15:46.761 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.753+0000 7f62eeffd640 1 -- 172.21.15.87:0/3833372794 <== mon.2 v2:172.21.15.118:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f63040ba9a0 con 0x5564a3ccec50 2024-09-13T17:15:46.761 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.753+0000 7f6318bff740 1 -- 172.21.15.87:0/3833372794 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5564a3c5b680 con 0x5564a3ccec50 2024-09-13T17:15:46.761 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.754+0000 7f62eeffd640 1 -- 172.21.15.87:0/3833372794 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63040ba300 con 0x5564a3ccec50 2024-09-13T17:15:46.761 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.754+0000 7f6318bff740 10 client.25589 fetch_fsmap learned FSMap version 26 2024-09-13T17:15:46.761 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.754+0000 7f6318bff740 1 -- 172.21.15.87:0/3833372794 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5564a3c31330 con 0x5564a3ccec50 2024-09-13T17:15:46.761 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.754+0000 7f62eeffd640 1 -- 172.21.15.87:0/3833372794 <== mon.2 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x5564a3c5b680 con 0x5564a3ccec50 2024-09-13T17:15:46.762 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.754+0000 7f62eeffd640 1 -- 172.21.15.87:0/3833372794 <== mon.2 v2:172.21.15.118:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f63040b9e90 con 0x5564a3ccec50 2024-09-13T17:15:46.762 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.754+0000 7f6318bff740 10 client.25589 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T17:15:46.762 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.754+0000 7f6318bff740 10 client.25589 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-13T17:15:46.762 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.754+0000 7f6318bff740 20 client.25589 populate_metadata read hostname 'smithi087' 2024-09-13T17:15:46.762 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.754+0000 7f6318bff740 1 --2- 172.21.15.87:0/3833372794 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5564a3ce8ba0 0x5564a3ceafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:46.762 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.754+0000 7f6318bff740 4 client.25589 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:15:46.762 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.754+0000 7f6318bff740 1 -- 172.21.15.87:0/3833372794 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5564a3c265d0 con 0x5564a3ce8ba0 2024-09-13T17:15:46.762 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.754+0000 7f630f7fe640 1 --2- 172.21.15.87:0/3833372794 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5564a3ce8ba0 0x5564a3ceafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:46.762 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.755+0000 7f630f7fe640 1 --2- 172.21.15.87:0/3833372794 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5564a3ce8ba0 0x5564a3ceafc0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=170bd20535e3df62 server_cookie=edfcf7f3be050d23 in_seq=0 out_seq=0 2024-09-13T17:15:46.762 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.755+0000 7f62eeffd640 10 client.25589 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:46.762 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.755+0000 7f62eeffd640 1 -- 172.21.15.87:0/3833372794 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5564a3c265d0 con 0x5564a3ce8ba0 2024-09-13T17:15:46.762 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.755+0000 7f62eeffd640 10 client.25589 handle_command_reply: tid=0 2024-09-13T17:15:46.762 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.755+0000 7f6318bff740 1 client.25589 shutdown 2024-09-13T17:15:46.762 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.755+0000 7f6318bff740 1 -- 172.21.15.87:0/3833372794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a3ccec50 msgr2=0x5564a3cd6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.755+0000 7f6318bff740 1 --2- 172.21.15.87:0/3833372794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a3ccec50 0x5564a3cd6140 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f63040eaf30 tx=0x7f63040f1290 comp rx=0 tx=0).stop 2024-09-13T17:15:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.755+0000 7f6318bff740 1 -- 172.21.15.87:0/3833372794 shutdown_connections 2024-09-13T17:15:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.755+0000 7f6318bff740 1 --2- 172.21.15.87:0/3833372794 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5564a3ce8ba0 0x5564a3ceafc0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.755+0000 7f6318bff740 1 --2- 172.21.15.87:0/3833372794 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564a3cd94f0 0x5564a3cd6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.755+0000 7f62eeffd640 0 client.25589 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.755+0000 7f6318bff740 1 --2- 172.21.15.87:0/3833372794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a3ccec50 0x5564a3cd6140 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.755+0000 7f6318bff740 1 --2- 172.21.15.87:0/3833372794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564a3cce330 0x5564a3cd8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.755+0000 7f6318bff740 1 -- 172.21.15.87:0/3833372794 >> 172.21.15.87:0/3833372794 conn(0x5564a3cca8c0 msgr2=0x5564a3cc9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.755+0000 7f6318bff740 1 -- 172.21.15.87:0/3833372794 shutdown_connections 2024-09-13T17:15:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.755+0000 7f6318bff740 1 -- 172.21.15.87:0/3833372794 wait complete. 2024-09-13T17:15:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.756+0000 7f6318bff740 20 client.25589 trim_cache size 0 max 16384 2024-09-13T17:15:46.770 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.769+0000 7f6318bff740 1 Processor -- start 2024-09-13T17:15:46.770 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.769+0000 7f6318bff740 1 -- start start 2024-09-13T17:15:46.770 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.769+0000 7f6318bff740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564a3cce330 0x5564a3cd8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:46.770 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.769+0000 7f6318bff740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564a3ccec50 0x5564a3cd49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.769+0000 7f6318bff740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a3cd94f0 0x5564a3cd4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.769+0000 7f6318bff740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564a3cdbfa0 con 0x5564a3ccec50 2024-09-13T17:15:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.769+0000 7f6318bff740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564a3c265d0 con 0x5564a3cd94f0 2024-09-13T17:15:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.769+0000 7f6318bff740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564a3c5b680 con 0x5564a3cce330 2024-09-13T17:15:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.769+0000 7f630effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564a3ccec50 0x5564a3cd49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.770+0000 7f630ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a3cd94f0 0x5564a3cd4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.770+0000 7f630f7fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564a3cce330 0x5564a3cd8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.770+0000 7f630effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564a3ccec50 0x5564a3cd49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38840/0 (socket says 172.21.15.87:38840) 2024-09-13T17:15:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.770+0000 7f630effd640 1 -- 172.21.15.87:0/2508713066 learned_addr learned my addr 172.21.15.87:0/2508713066 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:46.775 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.770+0000 7f630ffff640 1 -- 172.21.15.87:0/2508713066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564a3cce330 msgr2=0x5564a3cd8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:46.775 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.770+0000 7f630ffff640 1 --2- 172.21.15.87:0/2508713066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564a3cce330 0x5564a3cd8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:46.775 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.770+0000 7f630ffff640 1 -- 172.21.15.87:0/2508713066 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564a3ccec50 msgr2=0x5564a3cd49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:46.775 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.770+0000 7f630ffff640 1 --2- 172.21.15.87:0/2508713066 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564a3ccec50 0x5564a3cd49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:46.775 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.770+0000 7f630ffff640 1 -- 172.21.15.87:0/2508713066 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564a3bd3300 con 0x5564a3cd94f0 2024-09-13T17:15:46.776 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.770+0000 7f630f7fe640 1 --2- 172.21.15.87:0/2508713066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564a3cce330 0x5564a3cd8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:15:46.776 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.770+0000 7f630ffff640 1 --2- 172.21.15.87:0/2508713066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a3cd94f0 0x5564a3cd4f30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6308006010 tx=0x7f630801cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f20856b03ac92aec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:46.776 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.770+0000 7f62f67fc640 1 -- 172.21.15.87:0/2508713066 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630801b690 con 0x5564a3cd94f0 2024-09-13T17:15:46.776 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.770+0000 7f62f67fc640 1 -- 172.21.15.87:0/2508713066 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f63080049c0 con 0x5564a3cd94f0 2024-09-13T17:15:46.776 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.770+0000 7f62f67fc640 1 -- 172.21.15.87:0/2508713066 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630801be60 con 0x5564a3cd94f0 2024-09-13T17:15:46.776 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.771+0000 7f6318bff740 1 -- 172.21.15.87:0/2508713066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a3cd94f0 msgr2=0x5564a3cd4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:46.776 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.771+0000 7f6318bff740 1 --2- 172.21.15.87:0/2508713066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a3cd94f0 0x5564a3cd4f30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6308006010 tx=0x7f630801cf60 comp rx=0 tx=0).stop 2024-09-13T17:15:46.776 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.771+0000 7f6318bff740 1 -- 172.21.15.87:0/2508713066 shutdown_connections 2024-09-13T17:15:46.776 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.771+0000 7f6318bff740 1 --2- 172.21.15.87:0/2508713066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a3cd94f0 0x5564a3cd4f30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:46.776 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.771+0000 7f6318bff740 1 --2- 172.21.15.87:0/2508713066 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564a3ccec50 0x5564a3cd49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:46.776 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.771+0000 7f6318bff740 1 --2- 172.21.15.87:0/2508713066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564a3cce330 0x5564a3cd8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:46.776 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.771+0000 7f6318bff740 1 -- 172.21.15.87:0/2508713066 >> 172.21.15.87:0/2508713066 conn(0x5564a3cca8c0 msgr2=0x5564a3cc5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:46.776 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.771+0000 7f6318bff740 1 -- 172.21.15.87:0/2508713066 shutdown_connections 2024-09-13T17:15:46.777 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.771+0000 7f6318bff740 1 -- 172.21.15.87:0/2508713066 wait complete. 2024-09-13T17:15:46.777 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.772+0000 7f6318bff740 1 -- start start 2024-09-13T17:15:46.777 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.772+0000 7f6318bff740 1 Processor -- start 2024-09-13T17:15:46.777 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.772+0000 7f6318bff740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a3cce330 0x5564a3cd3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:46.777 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.772+0000 7f6318bff740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564a3ccec50 0x5564a3cd39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:46.777 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.772+0000 7f6318bff740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564a3cd94f0 0x5564a3d3f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:46.777 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.772+0000 7f6318bff740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564a3cd4140 con 0x5564a3ccec50 2024-09-13T17:15:46.777 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.772+0000 7f6318bff740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564a3d3f5e0 con 0x5564a3cce330 2024-09-13T17:15:46.777 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.772+0000 7f6318bff740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564a3d3f7a0 con 0x5564a3cd94f0 2024-09-13T17:15:46.777 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.772+0000 7f6318bff740 10 client.0 _ll_register_callbacks cb 0x7f6308009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:15:46.777 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.772+0000 7f630effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564a3ccec50 0x5564a3cd39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:46.777 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.772+0000 7f630f7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a3cce330 0x5564a3cd3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:46.777 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.772+0000 7f630f7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a3cce330 0x5564a3cd3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.87:39672/0 (socket says 172.21.15.87:39672) 2024-09-13T17:15:46.778 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.772+0000 7f630effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564a3ccec50 0x5564a3cd39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38842/0 (socket says 172.21.15.87:38842) 2024-09-13T17:15:46.778 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.772+0000 7f630f7fe640 1 -- 172.21.15.87:0/2187446208 learned_addr learned my addr 172.21.15.87:0/2187446208 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:15:46.778 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.772+0000 7f630ffff640 1 --2- 172.21.15.87:0/2187446208 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564a3cd94f0 0x5564a3d3f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:46.778 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.772+0000 7f630f7fe640 1 -- 172.21.15.87:0/2187446208 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564a3cd94f0 msgr2=0x5564a3d3f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:46.778 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.772+0000 7f630f7fe640 1 --2- 172.21.15.87:0/2187446208 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564a3cd94f0 0x5564a3d3f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:46.778 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.772+0000 7f630f7fe640 1 -- 172.21.15.87:0/2187446208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564a3ccec50 msgr2=0x5564a3cd39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:15:46.778 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.772+0000 7f630f7fe640 1 --2- 172.21.15.87:0/2187446208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564a3ccec50 0x5564a3cd39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:46.778 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.772+0000 7f630f7fe640 1 -- 172.21.15.87:0/2187446208 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f630000bc00 con 0x5564a3cce330 2024-09-13T17:15:46.778 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.773+0000 7f630f7fe640 1 --2- 172.21.15.87:0/2187446208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a3cce330 0x5564a3cd3460 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6300005f80 tx=0x7f6300012b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef763c29b8fa6842 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:15:46.778 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.773+0000 7f62eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-09-13T17:15:46.778 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.773+0000 7f62eeffd640 1 -- 172.21.15.87:0/2187446208 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6300016040 con 0x5564a3cce330 2024-09-13T17:15:46.778 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.773+0000 7f62eeffd640 1 -- 172.21.15.87:0/2187446208 <== mon.2 v2:172.21.15.118:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f6300010c20 con 0x5564a3cce330 2024-09-13T17:15:46.778 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.773+0000 7f6318bff740 1 -- 172.21.15.87:0/2187446208 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f630801cd70 con 0x5564a3cce330 2024-09-13T17:15:46.778 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.773+0000 7f62eeffd640 1 -- 172.21.15.87:0/2187446208 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6300010de0 con 0x5564a3cce330 2024-09-13T17:15:46.779 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.773+0000 7f6318bff740 10 client.25595 fetch_fsmap learned FSMap version 26 2024-09-13T17:15:46.779 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.773+0000 7f6318bff740 1 -- 172.21.15.87:0/2187446208 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f6308028070 con 0x5564a3cce330 2024-09-13T17:15:46.779 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.773+0000 7f62eeffd640 1 -- 172.21.15.87:0/2187446208 <== mon.2 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f630801cd70 con 0x5564a3cce330 2024-09-13T17:15:46.779 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.773+0000 7f62eeffd640 1 -- 172.21.15.87:0/2187446208 <== mon.2 v2:172.21.15.118:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f6300004c90 con 0x5564a3cce330 2024-09-13T17:15:46.779 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.773+0000 7f6318bff740 10 client.25595 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T17:15:46.779 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.773+0000 7f6318bff740 10 client.25595 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-13T17:15:46.779 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.773+0000 7f6318bff740 20 client.25595 populate_metadata read hostname 'smithi087' 2024-09-13T17:15:46.779 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.773+0000 7f6318bff740 1 --2- 172.21.15.87:0/2187446208 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5564a3d41010 0x5564a3d43430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:15:46.779 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.773+0000 7f6318bff740 4 client.25595 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T17:15:46.779 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.773+0000 7f6318bff740 1 -- 172.21.15.87:0/2187446208 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5564a3926300 con 0x5564a3d41010 2024-09-13T17:15:46.779 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.774+0000 7f630effd640 1 --2- 172.21.15.87:0/2187446208 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5564a3d41010 0x5564a3d43430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:15:46.779 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.774+0000 7f630effd640 1 --2- 172.21.15.87:0/2187446208 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5564a3d41010 0x5564a3d43430 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae025e9c831c2e6b server_cookie=48dbb9147f3a4ec2 in_seq=0 out_seq=0 2024-09-13T17:15:46.779 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.774+0000 7f62eeffd640 10 client.25595 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:46.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:46 smithi149 ceph-mon[35496]: scrub summary: idle 2024-09-13T17:15:46.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:46 smithi149 ceph-mon[35496]: pgmap v61: 129 pgs: 129 active+clean; 138 MiB data, 815 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 966 op/s 2024-09-13T17:15:46.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:46 smithi118 ceph-mon[34374]: scrub summary: idle 2024-09-13T17:15:46.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:46 smithi118 ceph-mon[34374]: pgmap v61: 129 pgs: 129 active+clean; 138 MiB data, 815 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 966 op/s 2024-09-13T17:15:46.958 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.957+0000 7f62eeffd640 1 -- 172.21.15.87:0/2187446208 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5564a3926300 con 0x5564a3d41010 2024-09-13T17:15:46.958 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.957+0000 7f62eeffd640 10 client.25595 handle_command_reply: tid=0 2024-09-13T17:15:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.957+0000 7f6318bff740 1 client.25595 shutdown 2024-09-13T17:15:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.957+0000 7f6318bff740 1 -- 172.21.15.87:0/2187446208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a3cce330 msgr2=0x5564a3cd3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.957+0000 7f6318bff740 1 --2- 172.21.15.87:0/2187446208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a3cce330 0x5564a3cd3460 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6300005f80 tx=0x7f6300012b90 comp rx=0 tx=0).stop 2024-09-13T17:15:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.957+0000 7f6318bff740 1 -- 172.21.15.87:0/2187446208 shutdown_connections 2024-09-13T17:15:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.957+0000 7f6318bff740 1 --2- 172.21.15.87:0/2187446208 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5564a3d41010 0x5564a3d43430 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.957+0000 7f6318bff740 1 --2- 172.21.15.87:0/2187446208 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564a3cd94f0 0x5564a3d3f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.957+0000 7f62eeffd640 0 client.25595 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:15:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.957+0000 7f6318bff740 1 --2- 172.21.15.87:0/2187446208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564a3ccec50 0x5564a3cd39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.957+0000 7f6318bff740 1 --2- 172.21.15.87:0/2187446208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a3cce330 0x5564a3cd3460 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.957+0000 7f6318bff740 1 -- 172.21.15.87:0/2187446208 >> 172.21.15.87:0/2187446208 conn(0x5564a3cca8c0 msgr2=0x5564a3cd4940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.957+0000 7f6318bff740 1 -- 172.21.15.87:0/2187446208 shutdown_connections 2024-09-13T17:15:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.957+0000 7f6318bff740 1 -- 172.21.15.87:0/2187446208 wait complete. 2024-09-13T17:15:46.960 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.957+0000 7f6318bff740 20 client.25595 trim_cache size 0 max 16384 2024-09-13T17:15:46.960 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout:{ 2024-09-13T17:15:46.960 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout: "message": "", 2024-09-13T17:15:46.960 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout: "return_code": 0 2024-09-13T17:15:46.960 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout:} 2024-09-13T17:15:46.961 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.958+0000 7f6315ede640 1 -- 172.21.15.87:0/2993713064 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f62f80a1230 msgr2=0x7f62f80a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:46.961 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.958+0000 7f6315ede640 1 --2- 172.21.15.87:0/2993713064 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f62f80a1230 0x7f62f80a36f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f630801b000 tx=0x7f630801d000 comp rx=0 tx=0).stop 2024-09-13T17:15:46.961 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.958+0000 7f6315ede640 1 -- 172.21.15.87:0/2993713064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6310105090 msgr2=0x7f6310072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:15:46.961 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.958+0000 7f6315ede640 1 --2- 172.21.15.87:0/2993713064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6310105090 0x7f6310072cf0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f6304009900 tx=0x7f63040040c0 comp rx=0 tx=0).stop 2024-09-13T17:15:46.961 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.958+0000 7f6315ede640 1 -- 172.21.15.87:0/2993713064 shutdown_connections 2024-09-13T17:15:46.961 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.958+0000 7f6315ede640 1 --2- 172.21.15.87:0/2993713064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6310073230 0x7f63101a4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:46.961 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.958+0000 7f6315ede640 1 --2- 172.21.15.87:0/2993713064 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f62f80a1230 0x7f62f80a36f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:46.961 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.958+0000 7f6315ede640 1 --2- 172.21.15.87:0/2993713064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6310105090 0x7f6310072cf0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:46.961 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.958+0000 7f6315ede640 1 --2- 172.21.15.87:0/2993713064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63100fff40 0x7f63100727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:15:46.962 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.958+0000 7f6315ede640 1 -- 172.21.15.87:0/2993713064 >> 172.21.15.87:0/2993713064 conn(0x7f63100fb9d0 msgr2=0x7f63100fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:15:46.962 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.958+0000 7f6315ede640 1 -- 172.21.15.87:0/2993713064 shutdown_connections 2024-09-13T17:15:46.962 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:15:46.958+0000 7f6315ede640 1 -- 172.21.15.87:0/2993713064 wait complete. 2024-09-13T17:15:46.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:46 smithi087 ceph-mon[30934]: scrub summary: idle 2024-09-13T17:15:46.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:46 smithi087 ceph-mon[30934]: pgmap v61: 129 pgs: 129 active+clean; 138 MiB data, 815 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 966 op/s 2024-09-13T17:15:47.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:47 smithi149 ceph-mon[35496]: pgmap v62: 129 pgs: 129 active+clean; 138 MiB data, 815 MiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 1.0 MiB/s wr, 400 op/s 2024-09-13T17:15:47.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:47 smithi118 ceph-mon[34374]: pgmap v62: 129 pgs: 129 active+clean; 138 MiB data, 815 MiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 1.0 MiB/s wr, 400 op/s 2024-09-13T17:15:47.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:47 smithi087 ceph-mon[30934]: pgmap v62: 129 pgs: 129 active+clean; 138 MiB data, 815 MiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 1.0 MiB/s wr, 400 op/s 2024-09-13T17:15:50.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:50 smithi087 ceph-mon[30934]: pgmap v63: 129 pgs: 129 active+clean; 138 MiB data, 815 MiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 1.0 MiB/s wr, 400 op/s 2024-09-13T17:15:50.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:50 smithi149 ceph-mon[35496]: pgmap v63: 129 pgs: 129 active+clean; 138 MiB data, 815 MiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 1.0 MiB/s wr, 400 op/s 2024-09-13T17:15:50.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:50 smithi118 ceph-mon[34374]: pgmap v63: 129 pgs: 129 active+clean; 138 MiB data, 815 MiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 1.0 MiB/s wr, 400 op/s 2024-09-13T17:15:52.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:52 smithi149 ceph-mon[35496]: pgmap v64: 129 pgs: 129 active+clean; 135 MiB data, 814 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 716 op/s 2024-09-13T17:15:52.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:52 smithi118 ceph-mon[34374]: pgmap v64: 129 pgs: 129 active+clean; 135 MiB data, 814 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 716 op/s 2024-09-13T17:15:52.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:52 smithi087 ceph-mon[30934]: pgmap v64: 129 pgs: 129 active+clean; 135 MiB data, 814 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 716 op/s 2024-09-13T17:15:54.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:54 smithi149 ceph-mon[35496]: pgmap v65: 129 pgs: 129 active+clean; 135 MiB data, 814 MiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 1.0 MiB/s wr, 511 op/s 2024-09-13T17:15:54.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:54 smithi118 ceph-mon[34374]: pgmap v65: 129 pgs: 129 active+clean; 135 MiB data, 814 MiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 1.0 MiB/s wr, 511 op/s 2024-09-13T17:15:54.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:54 smithi087 ceph-mon[30934]: pgmap v65: 129 pgs: 129 active+clean; 135 MiB data, 814 MiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 1.0 MiB/s wr, 511 op/s 2024-09-13T17:15:56.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:56 smithi149 ceph-mon[35496]: pgmap v66: 129 pgs: 129 active+clean; 142 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 711 op/s 2024-09-13T17:15:56.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:56 smithi118 ceph-mon[34374]: pgmap v66: 129 pgs: 129 active+clean; 142 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 711 op/s 2024-09-13T17:15:56.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:56 smithi087 ceph-mon[30934]: pgmap v66: 129 pgs: 129 active+clean; 142 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 711 op/s 2024-09-13T17:15:58.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:58 smithi149 ceph-mon[35496]: pgmap v67: 129 pgs: 129 active+clean; 142 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 1.5 MiB/s wr, 515 op/s 2024-09-13T17:15:58.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:58 smithi118 ceph-mon[34374]: pgmap v67: 129 pgs: 129 active+clean; 142 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 1.5 MiB/s wr, 515 op/s 2024-09-13T17:15:58.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:58 smithi087 ceph-mon[30934]: pgmap v67: 129 pgs: 129 active+clean; 142 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 1.5 MiB/s wr, 515 op/s 2024-09-13T17:15:59.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:59 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:15:59.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:59 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:15:59.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:59 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:15:59.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:59 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:15:59.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:59 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:15:59.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:59 smithi149 ceph-mon[35496]: pgmap v68: 129 pgs: 129 active+clean; 142 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 1.5 MiB/s wr, 515 op/s 2024-09-13T17:15:59.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:59 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:15:59.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:59 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:15:59.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:15:59 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:15:59.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:59 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:15:59.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:59 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:15:59.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:59 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:15:59.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:59 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:15:59.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:59 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:15:59.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:59 smithi118 ceph-mon[34374]: pgmap v68: 129 pgs: 129 active+clean; 142 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 1.5 MiB/s wr, 515 op/s 2024-09-13T17:15:59.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:59 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:15:59.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:59 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:15:59.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:15:59 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:15:59.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:59 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:15:59.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:59 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:15:59.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:59 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:15:59.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:59 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:15:59.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:59 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:15:59.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:59 smithi087 ceph-mon[30934]: pgmap v68: 129 pgs: 129 active+clean; 142 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 1.5 MiB/s wr, 515 op/s 2024-09-13T17:15:59.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:59 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:15:59.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:59 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:15:59.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:15:59 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:16:00.053 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.050+0000 7fe17e7ec640 1 -- 172.21.15.87:0/1705186989 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1780fee30 msgr2=0x7fe1780ff210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:00.053 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.050+0000 7fe17e7ec640 1 --2- 172.21.15.87:0/1705186989 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1780fee30 0x7fe1780ff210 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe168009930 tx=0x7fe16802a420 comp rx=0 tx=0).stop 2024-09-13T17:16:00.053 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.050+0000 7fe17e7ec640 1 -- 172.21.15.87:0/1705186989 shutdown_connections 2024-09-13T17:16:00.053 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.050+0000 7fe17e7ec640 1 --2- 172.21.15.87:0/1705186989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe178103f80 0x7fe17810bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.053 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.050+0000 7fe17e7ec640 1 --2- 172.21.15.87:0/1705186989 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1780ff7e0 0x7fe178103820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.054 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.050+0000 7fe17e7ec640 1 --2- 172.21.15.87:0/1705186989 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1780fee30 0x7fe1780ff210 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.054 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.050+0000 7fe17e7ec640 1 -- 172.21.15.87:0/1705186989 >> 172.21.15.87:0/1705186989 conn(0x7fe1780fa8c0 msgr2=0x7fe1780fcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:00.054 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.050+0000 7fe17e7ec640 1 -- 172.21.15.87:0/1705186989 shutdown_connections 2024-09-13T17:16:00.054 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.050+0000 7fe17e7ec640 1 -- 172.21.15.87:0/1705186989 wait complete. 2024-09-13T17:16:00.054 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.051+0000 7fe17e7ec640 1 Processor -- start 2024-09-13T17:16:00.054 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.051+0000 7fe17e7ec640 1 -- start start 2024-09-13T17:16:00.056 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.051+0000 7fe17e7ec640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1780fee30 0x7fe1781951b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.056 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.051+0000 7fe17e7ec640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe178103f80 0x7fe1781956f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.056 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.051+0000 7fe17e7ec640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe178199ae0 0x7fe178199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.056 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.051+0000 7fe17e7ec640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17819a4d0 con 0x7fe178199ae0 2024-09-13T17:16:00.056 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.052+0000 7fe17e7ec640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17819a640 con 0x7fe1780fee30 2024-09-13T17:16:00.056 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.052+0000 7fe17e7ec640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17819a7b0 con 0x7fe178103f80 2024-09-13T17:16:00.056 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.052+0000 7fe17cd89640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe178199ae0 0x7fe178199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.056 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.052+0000 7fe177fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1780fee30 0x7fe1781951b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.056 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.052+0000 7fe17cd89640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe178199ae0 0x7fe178199f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60970/0 (socket says 172.21.15.87:60970) 2024-09-13T17:16:00.056 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.052+0000 7fe177fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1780fee30 0x7fe1781951b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.87:54258/0 (socket says 172.21.15.87:54258) 2024-09-13T17:16:00.057 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.052+0000 7fe17cd89640 1 -- 172.21.15.87:0/914131564 learned_addr learned my addr 172.21.15.87:0/914131564 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:00.057 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.052+0000 7fe1777fe640 1 --2- 172.21.15.87:0/914131564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe178103f80 0x7fe1781956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.057 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.052+0000 7fe17cd89640 1 -- 172.21.15.87:0/914131564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe178103f80 msgr2=0x7fe1781956f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:00.057 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.052+0000 7fe17cd89640 1 --2- 172.21.15.87:0/914131564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe178103f80 0x7fe1781956f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.057 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.052+0000 7fe17cd89640 1 -- 172.21.15.87:0/914131564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1780fee30 msgr2=0x7fe1781951b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:00.057 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.052+0000 7fe17cd89640 1 --2- 172.21.15.87:0/914131564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1780fee30 0x7fe1781951b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.057 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.052+0000 7fe17cd89640 1 -- 172.21.15.87:0/914131564 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe168009560 con 0x7fe178199ae0 2024-09-13T17:16:00.057 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.052+0000 7fe177fff640 1 --2- 172.21.15.87:0/914131564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1780fee30 0x7fe1781951b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:16:00.057 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.052+0000 7fe17cd89640 1 --2- 172.21.15.87:0/914131564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe178199ae0 0x7fe178199f90 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fe17000eb10 tx=0x7fe17000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:00.057 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.052+0000 7fe1757fa640 1 -- 172.21.15.87:0/914131564 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe170004b20 con 0x7fe178199ae0 2024-09-13T17:16:00.057 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.053+0000 7fe17e7ec640 1 -- 172.21.15.87:0/914131564 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1781a1d90 con 0x7fe178199ae0 2024-09-13T17:16:00.057 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.053+0000 7fe1757fa640 1 -- 172.21.15.87:0/914131564 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe170004c80 con 0x7fe178199ae0 2024-09-13T17:16:00.057 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.053+0000 7fe1757fa640 1 -- 172.21.15.87:0/914131564 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe170010690 con 0x7fe178199ae0 2024-09-13T17:16:00.058 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.053+0000 7fe17e7ec640 1 -- 172.21.15.87:0/914131564 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1780680d0 con 0x7fe178199ae0 2024-09-13T17:16:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.055+0000 7fe1757fa640 1 -- 172.21.15.87:0/914131564 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fe170005020 con 0x7fe178199ae0 2024-09-13T17:16:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.055+0000 7fe1815e1740 1 Processor -- start 2024-09-13T17:16:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.055+0000 7fe1815e1740 1 -- start start 2024-09-13T17:16:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.056+0000 7fe1815e1740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591215f9330 0x5591215f9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.056+0000 7fe1815e1740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5591215f9c50 0x559121603fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.056+0000 7fe1815e1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591216044f0 0x5591216068e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.056+0000 7fe1815e1740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559121564c30 con 0x5591216044f0 2024-09-13T17:16:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.056+0000 7fe1815e1740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591215623c0 con 0x5591215f9330 2024-09-13T17:16:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.056+0000 7fe1815e1740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55912155dcb0 con 0x5591215f9c50 2024-09-13T17:16:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.056+0000 7fe1757fa640 1 --2- 172.21.15.87:0/914131564 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe1600a3410 0x7fe1600a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.056+0000 7fe1777fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591216044f0 0x5591216068e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.056+0000 7fe177fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5591215f9c50 0x559121603fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.056+0000 7fe177fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5591215f9c50 0x559121603fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:44388/0 (socket says 172.21.15.87:44388) 2024-09-13T17:16:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.056+0000 7fe1777fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591216044f0 0x5591216068e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60978/0 (socket says 172.21.15.87:60978) 2024-09-13T17:16:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.056+0000 7fe177fff640 1 -- 172.21.15.87:0/2130279088 learned_addr learned my addr 172.21.15.87:0/2130279088 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.056+0000 7fe17cd89640 1 --2- 172.21.15.87:0/914131564 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe1600a3410 0x7fe1600a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.056+0000 7fe1777fe640 1 --2- 172.21.15.87:0/2130279088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591215f9330 0x5591215f9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.056+0000 7fe1757fa640 1 -- 172.21.15.87:0/914131564 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fe170014070 con 0x7fe178199ae0 2024-09-13T17:16:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.056+0000 7fe177fff640 1 -- 172.21.15.87:0/2130279088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591215f9330 msgr2=0x5591215f9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.056+0000 7fe177fff640 1 --2- 172.21.15.87:0/2130279088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591215f9330 0x5591215f9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.056+0000 7fe177fff640 1 -- 172.21.15.87:0/2130279088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591216044f0 msgr2=0x5591216068e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.056+0000 7fe177fff640 1 --2- 172.21.15.87:0/2130279088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591216044f0 0x5591216068e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.056+0000 7fe177fff640 1 -- 172.21.15.87:0/2130279088 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559121504910 con 0x5591215f9c50 2024-09-13T17:16:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.056+0000 7fe17cd89640 1 --2- 172.21.15.87:0/914131564 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe1600a3410 0x7fe1600a58d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe1700ca9e0 tx=0x7fe170009a70 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.056+0000 7fe177fff640 1 --2- 172.21.15.87:0/2130279088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5591215f9c50 0x559121603fb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe168005ec0 tx=0x7fe1680045b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40bc83022d892d94 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.057+0000 7fe15e7fc640 1 -- 172.21.15.87:0/2130279088 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16803fba0 con 0x5591215f9c50 2024-09-13T17:16:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.057+0000 7fe15e7fc640 1 -- 172.21.15.87:0/2130279088 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe16803fd00 con 0x5591215f9c50 2024-09-13T17:16:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.057+0000 7fe15e7fc640 1 -- 172.21.15.87:0/2130279088 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe168031780 con 0x5591215f9c50 2024-09-13T17:16:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.058+0000 7fe1815e1740 1 -- 172.21.15.87:0/2130279088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5591215f9c50 msgr2=0x559121603fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.058+0000 7fe1815e1740 1 --2- 172.21.15.87:0/2130279088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5591215f9c50 0x559121603fb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe168005ec0 tx=0x7fe1680045b0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.058+0000 7fe1815e1740 1 -- 172.21.15.87:0/2130279088 shutdown_connections 2024-09-13T17:16:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.058+0000 7fe1815e1740 1 --2- 172.21.15.87:0/2130279088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591216044f0 0x5591216068e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.058+0000 7fe1815e1740 1 --2- 172.21.15.87:0/2130279088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5591215f9c50 0x559121603fb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.058+0000 7fe1815e1740 1 --2- 172.21.15.87:0/2130279088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591215f9330 0x5591215f9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.058+0000 7fe1815e1740 1 -- 172.21.15.87:0/2130279088 >> 172.21.15.87:0/2130279088 conn(0x5591215f58c0 msgr2=0x5591215f5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.058+0000 7fe1815e1740 1 -- 172.21.15.87:0/2130279088 shutdown_connections 2024-09-13T17:16:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.058+0000 7fe1815e1740 1 -- 172.21.15.87:0/2130279088 wait complete. 2024-09-13T17:16:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.058+0000 7fe1815e1740 1 -- start start 2024-09-13T17:16:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.058+0000 7fe1815e1740 1 Processor -- start 2024-09-13T17:16:00.066 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.059+0000 7fe1815e1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591215f9330 0x559121603eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.066 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.059+0000 7fe1815e1740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5591215f9c50 0x559121601180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.066 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.059+0000 7fe1815e1740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591216044f0 0x5591216017e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.066 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.059+0000 7fe1815e1740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55912151be80 con 0x5591215f9330 2024-09-13T17:16:00.066 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.059+0000 7fe1815e1740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55912151bb20 con 0x5591216044f0 2024-09-13T17:16:00.066 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.059+0000 7fe1815e1740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591214e1260 con 0x5591215f9c50 2024-09-13T17:16:00.066 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.059+0000 7fe1815e1740 10 client.0 _ll_register_callbacks cb 0x559121516df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:00.066 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.059+0000 7fe1777fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591215f9330 0x559121603eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.066 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.059+0000 7fe1777fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591215f9330 0x559121603eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60980/0 (socket says 172.21.15.87:60980) 2024-09-13T17:16:00.066 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.059+0000 7fe1777fe640 1 -- 172.21.15.87:0/2356924120 learned_addr learned my addr 172.21.15.87:0/2356924120 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:00.066 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.059+0000 7fe1777fe640 1 --2- 172.21.15.87:0/2356924120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591216044f0 0x5591216017e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.067 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.059+0000 7fe177fff640 1 --2- 172.21.15.87:0/2356924120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5591215f9c50 0x559121601180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.067 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.059+0000 7fe1777fe640 1 -- 172.21.15.87:0/2356924120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5591215f9c50 msgr2=0x559121601180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:00.067 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.059+0000 7fe1777fe640 1 --2- 172.21.15.87:0/2356924120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5591215f9c50 0x559121601180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.067 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.059+0000 7fe1777fe640 1 -- 172.21.15.87:0/2356924120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591216044f0 msgr2=0x5591216017e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:00.067 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.059+0000 7fe1777fe640 1 --2- 172.21.15.87:0/2356924120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591216044f0 0x5591216017e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.067 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.059+0000 7fe1777fe640 1 -- 172.21.15.87:0/2356924120 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17810c310 con 0x5591215f9330 2024-09-13T17:16:00.067 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.059+0000 7fe1777fe640 1 --2- 172.21.15.87:0/2356924120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591215f9330 0x559121603eb0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fe1780696a0 tx=0x7fe16c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8795bd71513bec48 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:00.067 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.059+0000 7fe1577fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:16:00.067 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.059+0000 7fe1577fe640 1 -- 172.21.15.87:0/2356924120 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c004020 con 0x5591215f9330 2024-09-13T17:16:00.067 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.059+0000 7fe1577fe640 1 -- 172.21.15.87:0/2356924120 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fe16c004180 con 0x5591215f9330 2024-09-13T17:16:00.067 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.059+0000 7fe1815e1740 1 -- 172.21.15.87:0/2356924120 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559121586680 con 0x5591215f9330 2024-09-13T17:16:00.067 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.060+0000 7fe1577fe640 1 -- 172.21.15.87:0/2356924120 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe16c004340 con 0x5591215f9330 2024-09-13T17:16:00.067 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.060+0000 7fe1815e1740 10 client.16269 fetch_fsmap learned FSMap version 26 2024-09-13T17:16:00.068 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.060+0000 7fe1815e1740 1 -- 172.21.15.87:0/2356924120 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55912155c330 con 0x5591215f9330 2024-09-13T17:16:00.068 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.060+0000 7fe1577fe640 1 -- 172.21.15.87:0/2356924120 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x559121586680 con 0x5591215f9330 2024-09-13T17:16:00.068 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.060+0000 7fe1577fe640 1 -- 172.21.15.87:0/2356924120 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fe16c004a30 con 0x5591215f9330 2024-09-13T17:16:00.068 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.060+0000 7fe1815e1740 10 client.16269 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T17:16:00.068 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.060+0000 7fe1815e1740 10 client.16269 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-13T17:16:00.068 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.060+0000 7fe1815e1740 20 client.16269 populate_metadata read hostname 'smithi087' 2024-09-13T17:16:00.068 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.060+0000 7fe1815e1740 1 --2- 172.21.15.87:0/2356924120 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x559121613ee0 0x559121616300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.068 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.060+0000 7fe1815e1740 4 client.16269 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:16:00.068 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.060+0000 7fe1815e1740 1 -- 172.21.15.87:0/2356924120 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5591215515d0 con 0x559121613ee0 2024-09-13T17:16:00.068 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.060+0000 7fe177fff640 1 --2- 172.21.15.87:0/2356924120 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x559121613ee0 0x559121616300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.068 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.061+0000 7fe1577fe640 10 client.16269 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:00.068 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.061+0000 7fe177fff640 1 --2- 172.21.15.87:0/2356924120 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x559121613ee0 0x559121616300 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=922ba04a93a4d683 server_cookie=18bdd9684d21acbd in_seq=0 out_seq=0 2024-09-13T17:16:00.070 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.061+0000 7fe1577fe640 1 -- 172.21.15.87:0/2356924120 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5591215515d0 con 0x559121613ee0 2024-09-13T17:16:00.070 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.061+0000 7fe1577fe640 10 client.16269 handle_command_reply: tid=0 2024-09-13T17:16:00.070 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.061+0000 7fe1815e1740 1 client.16269 shutdown 2024-09-13T17:16:00.070 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.061+0000 7fe1815e1740 1 -- 172.21.15.87:0/2356924120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591215f9330 msgr2=0x559121603eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:00.070 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.061+0000 7fe1815e1740 1 --2- 172.21.15.87:0/2356924120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591215f9330 0x559121603eb0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fe1780696a0 tx=0x7fe16c004730 comp rx=0 tx=0).stop 2024-09-13T17:16:00.070 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.061+0000 7fe1815e1740 1 -- 172.21.15.87:0/2356924120 shutdown_connections 2024-09-13T17:16:00.070 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.061+0000 7fe1815e1740 1 --2- 172.21.15.87:0/2356924120 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x559121613ee0 0x559121616300 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.070 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.062+0000 7fe1815e1740 1 --2- 172.21.15.87:0/2356924120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591216044f0 0x5591216017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.070 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.062+0000 7fe1577fe640 0 client.16269 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:00.070 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.062+0000 7fe1815e1740 1 --2- 172.21.15.87:0/2356924120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5591215f9c50 0x559121601180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.071 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.062+0000 7fe1815e1740 1 --2- 172.21.15.87:0/2356924120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591215f9330 0x559121603eb0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.071 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.062+0000 7fe1815e1740 1 -- 172.21.15.87:0/2356924120 >> 172.21.15.87:0/2356924120 conn(0x5591215f58c0 msgr2=0x5591215f4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:00.071 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.062+0000 7fe1815e1740 1 -- 172.21.15.87:0/2356924120 shutdown_connections 2024-09-13T17:16:00.071 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.062+0000 7fe1815e1740 1 -- 172.21.15.87:0/2356924120 wait complete. 2024-09-13T17:16:00.071 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.062+0000 7fe1815e1740 20 client.16269 trim_cache size 0 max 16384 2024-09-13T17:16:00.079 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.075+0000 7fe1815e1740 1 Processor -- start 2024-09-13T17:16:00.079 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.076+0000 7fe1815e1740 1 -- start start 2024-09-13T17:16:00.079 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.076+0000 7fe1815e1740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591215f9330 0x559121603a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.079 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.076+0000 7fe1815e1740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5591215f9c50 0x5591215fc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.079 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.076+0000 7fe1815e1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591216044f0 0x5591215fc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.079 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.076+0000 7fe1815e1740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591215f9a40 con 0x5591216044f0 2024-09-13T17:16:00.079 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.076+0000 7fe1815e1740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559121606c00 con 0x5591215f9330 2024-09-13T17:16:00.079 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.076+0000 7fe1815e1740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55912161b460 con 0x5591215f9c50 2024-09-13T17:16:00.079 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.076+0000 7fe1777fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591215f9330 0x559121603a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.079 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.076+0000 7fe177fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5591215f9c50 0x5591215fc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.079 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.076+0000 7fe1777fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591215f9330 0x559121603a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.87:54284/0 (socket says 172.21.15.87:54284) 2024-09-13T17:16:00.079 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.076+0000 7fe1777fe640 1 -- 172.21.15.87:0/294148453 learned_addr learned my addr 172.21.15.87:0/294148453 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:00.080 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.076+0000 7fe1777fe640 1 --2- 172.21.15.87:0/294148453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591216044f0 0x5591215fc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.080 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.076+0000 7fe177fff640 1 -- 172.21.15.87:0/294148453 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591215f9330 msgr2=0x559121603a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:00.080 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.076+0000 7fe177fff640 1 --2- 172.21.15.87:0/294148453 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591215f9330 0x559121603a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.080 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.076+0000 7fe177fff640 1 -- 172.21.15.87:0/294148453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591216044f0 msgr2=0x5591215fc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:00.080 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.076+0000 7fe177fff640 1 --2- 172.21.15.87:0/294148453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591216044f0 0x5591215fc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.080 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.076+0000 7fe177fff640 1 -- 172.21.15.87:0/294148453 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591214fe300 con 0x5591215f9c50 2024-09-13T17:16:00.080 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.076+0000 7fe1777fe640 1 --2- 172.21.15.87:0/294148453 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591215f9330 0x559121603a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:16:00.080 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.076+0000 7fe177fff640 1 --2- 172.21.15.87:0/294148453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5591215f9c50 0x5591215fc450 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe16802aa10 tx=0x7fe16802a420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=826d07defe8db4ca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:00.080 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.077+0000 7fe15effd640 1 -- 172.21.15.87:0/294148453 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16803e9d0 con 0x5591215f9c50 2024-09-13T17:16:00.080 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.077+0000 7fe15effd640 1 -- 172.21.15.87:0/294148453 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe16803f040 con 0x5591215f9c50 2024-09-13T17:16:00.080 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.077+0000 7fe15effd640 1 -- 172.21.15.87:0/294148453 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe168003850 con 0x5591215f9c50 2024-09-13T17:16:00.083 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.077+0000 7fe1815e1740 1 -- 172.21.15.87:0/294148453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5591215f9c50 msgr2=0x5591215fc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:00.084 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.077+0000 7fe1815e1740 1 --2- 172.21.15.87:0/294148453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5591215f9c50 0x5591215fc450 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe16802aa10 tx=0x7fe16802a420 comp rx=0 tx=0).stop 2024-09-13T17:16:00.084 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.077+0000 7fe1815e1740 1 -- 172.21.15.87:0/294148453 shutdown_connections 2024-09-13T17:16:00.084 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.077+0000 7fe1815e1740 1 --2- 172.21.15.87:0/294148453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591216044f0 0x5591215fc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.084 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.077+0000 7fe1815e1740 1 --2- 172.21.15.87:0/294148453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5591215f9c50 0x5591215fc450 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.084 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.077+0000 7fe1815e1740 1 --2- 172.21.15.87:0/294148453 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591215f9330 0x559121603a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.084 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.077+0000 7fe1815e1740 1 -- 172.21.15.87:0/294148453 >> 172.21.15.87:0/294148453 conn(0x5591215f58c0 msgr2=0x55912160fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:00.084 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.077+0000 7fe1815e1740 1 -- 172.21.15.87:0/294148453 shutdown_connections 2024-09-13T17:16:00.084 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.077+0000 7fe1815e1740 1 -- 172.21.15.87:0/294148453 wait complete. 2024-09-13T17:16:00.084 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.078+0000 7fe1815e1740 1 -- start start 2024-09-13T17:16:00.084 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.078+0000 7fe1815e1740 1 Processor -- start 2024-09-13T17:16:00.084 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.078+0000 7fe1815e1740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5591215f9330 0x55912160b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.085 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.078+0000 7fe1815e1740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591215f9c50 0x55912160b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.085 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.078+0000 7fe1815e1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591216044f0 0x5591215fdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.085 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.078+0000 7fe1815e1740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591215fe210 con 0x5591216044f0 2024-09-13T17:16:00.085 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.078+0000 7fe1815e1740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591215fe380 con 0x5591215f9c50 2024-09-13T17:16:00.085 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.078+0000 7fe1815e1740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591215fe540 con 0x5591215f9330 2024-09-13T17:16:00.085 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.078+0000 7fe1815e1740 10 client.0 _ll_register_callbacks cb 0x7fe168009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:00.085 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.078+0000 7fe1777fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591216044f0 0x5591215fdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.085 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.078+0000 7fe1777fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5591215f9330 0x55912160b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.085 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.078+0000 7fe1777fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591216044f0 0x5591215fdb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:32770/0 (socket says 172.21.15.87:32770) 2024-09-13T17:16:00.085 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.078+0000 7fe1777fe640 1 -- 172.21.15.87:0/99175891 learned_addr learned my addr 172.21.15.87:0/99175891 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:00.085 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.078+0000 7fe177fff640 1 --2- 172.21.15.87:0/99175891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591215f9c50 0x55912160b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.085 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.079+0000 7fe1777fe640 1 -- 172.21.15.87:0/99175891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5591215f9330 msgr2=0x55912160b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:00.085 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.079+0000 7fe1777fe640 1 --2- 172.21.15.87:0/99175891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5591215f9330 0x55912160b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.086 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.079+0000 7fe1777fe640 1 -- 172.21.15.87:0/99175891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591215f9c50 msgr2=0x55912160b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:00.086 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.079+0000 7fe1777fe640 1 --2- 172.21.15.87:0/99175891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591215f9c50 0x55912160b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.086 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.079+0000 7fe1777fe640 1 -- 172.21.15.87:0/99175891 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55912155c330 con 0x5591216044f0 2024-09-13T17:16:00.086 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.079+0000 7fe1777fe640 1 --2- 172.21.15.87:0/99175891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591216044f0 0x5591215fdb40 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x5591216064c0 tx=0x7fe16c013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6daf16254cf35018 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:00.086 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.079+0000 7fe1577fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:16:00.086 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.079+0000 7fe1577fe640 1 -- 172.21.15.87:0/99175891 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c0047a0 con 0x5591216044f0 2024-09-13T17:16:00.086 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.079+0000 7fe1577fe640 1 -- 172.21.15.87:0/99175891 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fe16c004900 con 0x5591216044f0 2024-09-13T17:16:00.086 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.079+0000 7fe1815e1740 1 -- 172.21.15.87:0/99175891 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe16803fd00 con 0x5591216044f0 2024-09-13T17:16:00.086 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.079+0000 7fe1577fe640 1 -- 172.21.15.87:0/99175891 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe16c004ac0 con 0x5591216044f0 2024-09-13T17:16:00.086 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.079+0000 7fe1815e1740 10 client.16275 fetch_fsmap learned FSMap version 26 2024-09-13T17:16:00.086 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.079+0000 7fe1815e1740 1 -- 172.21.15.87:0/99175891 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559121504910 con 0x5591216044f0 2024-09-13T17:16:00.086 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.079+0000 7fe1577fe640 1 -- 172.21.15.87:0/99175891 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe16803fd00 con 0x5591216044f0 2024-09-13T17:16:00.086 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.079+0000 7fe1577fe640 1 -- 172.21.15.87:0/99175891 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fe16c027070 con 0x5591216044f0 2024-09-13T17:16:00.087 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.079+0000 7fe1815e1740 10 client.16275 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T17:16:00.087 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.079+0000 7fe1815e1740 10 client.16275 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-13T17:16:00.087 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.080+0000 7fe1815e1740 20 client.16275 populate_metadata read hostname 'smithi087' 2024-09-13T17:16:00.087 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.080+0000 7fe1815e1740 1 --2- 172.21.15.87:0/99175891 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55912166b690 0x55912166dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:00.087 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.080+0000 7fe1815e1740 4 client.16275 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T17:16:00.087 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.080+0000 7fe1815e1740 1 -- 172.21.15.87:0/99175891 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559121251300 con 0x55912166b690 2024-09-13T17:16:00.087 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.080+0000 7fe177fff640 1 --2- 172.21.15.87:0/99175891 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55912166b690 0x55912166dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:00.087 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.080+0000 7fe1577fe640 10 client.16275 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:00.087 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.080+0000 7fe177fff640 1 --2- 172.21.15.87:0/99175891 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55912166b690 0x55912166dab0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fc2dfb2c6cfa1c0 server_cookie=a3c0b9e074d6518e in_seq=0 out_seq=0 2024-09-13T17:16:00.171 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.168+0000 7fe1577fe640 1 -- 172.21.15.87:0/99175891 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559121251300 con 0x55912166b690 2024-09-13T17:16:00.171 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.168+0000 7fe1577fe640 10 client.16275 handle_command_reply: tid=0 2024-09-13T17:16:00.171 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.168+0000 7fe1815e1740 1 client.16275 shutdown 2024-09-13T17:16:00.171 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.168+0000 7fe1815e1740 1 -- 172.21.15.87:0/99175891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591216044f0 msgr2=0x5591215fdb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:00.171 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.168+0000 7fe1815e1740 1 --2- 172.21.15.87:0/99175891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591216044f0 0x5591215fdb40 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x5591216064c0 tx=0x7fe16c013040 comp rx=0 tx=0).stop 2024-09-13T17:16:00.171 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.168+0000 7fe1815e1740 1 -- 172.21.15.87:0/99175891 shutdown_connections 2024-09-13T17:16:00.172 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.168+0000 7fe1815e1740 1 --2- 172.21.15.87:0/99175891 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55912166b690 0x55912166dab0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.172 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.168+0000 7fe1815e1740 1 --2- 172.21.15.87:0/99175891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5591216044f0 0x5591215fdb40 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.172 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.168+0000 7fe1815e1740 1 --2- 172.21.15.87:0/99175891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591215f9c50 0x55912160b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.172 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.168+0000 7fe1815e1740 1 --2- 172.21.15.87:0/99175891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5591215f9330 0x55912160b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.172 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.168+0000 7fe1815e1740 1 -- 172.21.15.87:0/99175891 >> 172.21.15.87:0/99175891 conn(0x5591215f58c0 msgr2=0x5591215f0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:00.172 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.168+0000 7fe1577fe640 0 client.16275 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:00.172 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.168+0000 7fe1815e1740 1 -- 172.21.15.87:0/99175891 shutdown_connections 2024-09-13T17:16:00.172 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.168+0000 7fe1815e1740 1 -- 172.21.15.87:0/99175891 wait complete. 2024-09-13T17:16:00.172 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.169+0000 7fe1815e1740 20 client.16275 trim_cache size 0 max 16384 2024-09-13T17:16:00.172 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout:{ 2024-09-13T17:16:00.172 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout: "message": "", 2024-09-13T17:16:00.173 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout: "return_code": 0 2024-09-13T17:16:00.173 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout:} 2024-09-13T17:16:00.173 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.169+0000 7fe17e7ec640 1 -- 172.21.15.87:0/914131564 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe1600a3410 msgr2=0x7fe1600a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:00.173 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.169+0000 7fe17e7ec640 1 --2- 172.21.15.87:0/914131564 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe1600a3410 0x7fe1600a58d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe1700ca9e0 tx=0x7fe170009a70 comp rx=0 tx=0).stop 2024-09-13T17:16:00.174 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.169+0000 7fe17e7ec640 1 -- 172.21.15.87:0/914131564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe178199ae0 msgr2=0x7fe178199f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:00.174 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.169+0000 7fe17e7ec640 1 --2- 172.21.15.87:0/914131564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe178199ae0 0x7fe178199f90 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fe17000eb10 tx=0x7fe17000c2d0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.174 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.169+0000 7fe17e7ec640 1 -- 172.21.15.87:0/914131564 shutdown_connections 2024-09-13T17:16:00.174 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.169+0000 7fe17e7ec640 1 --2- 172.21.15.87:0/914131564 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe1600a3410 0x7fe1600a58d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.174 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.169+0000 7fe17e7ec640 1 --2- 172.21.15.87:0/914131564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe178199ae0 0x7fe178199f90 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.174 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.169+0000 7fe17e7ec640 1 --2- 172.21.15.87:0/914131564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe178103f80 0x7fe1781956f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.174 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.169+0000 7fe17e7ec640 1 --2- 172.21.15.87:0/914131564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1780fee30 0x7fe1781951b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:00.174 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.169+0000 7fe17e7ec640 1 -- 172.21.15.87:0/914131564 >> 172.21.15.87:0/914131564 conn(0x7fe1780fa8c0 msgr2=0x7fe1780fbcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:00.174 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.169+0000 7fe17e7ec640 1 -- 172.21.15.87:0/914131564 shutdown_connections 2024-09-13T17:16:00.174 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:00.169+0000 7fe17e7ec640 1 -- 172.21.15.87:0/914131564 wait complete. 2024-09-13T17:16:02.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:02 smithi149 ceph-mon[35496]: pgmap v69: 129 pgs: 129 active+clean; 149 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 733 op/s 2024-09-13T17:16:02.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:02 smithi118 ceph-mon[34374]: pgmap v69: 129 pgs: 129 active+clean; 149 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 733 op/s 2024-09-13T17:16:02.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:02 smithi087 ceph-mon[30934]: pgmap v69: 129 pgs: 129 active+clean; 149 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 733 op/s 2024-09-13T17:16:04.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:03 smithi149 ceph-mon[35496]: pgmap v70: 129 pgs: 129 active+clean; 149 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 995 KiB/s rd, 2.2 MiB/s wr, 417 op/s 2024-09-13T17:16:04.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:03 smithi118 ceph-mon[34374]: pgmap v70: 129 pgs: 129 active+clean; 149 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 995 KiB/s rd, 2.2 MiB/s wr, 417 op/s 2024-09-13T17:16:04.217 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:16:04.228 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:03 smithi087 ceph-mon[30934]: pgmap v70: 129 pgs: 129 active+clean; 149 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 995 KiB/s rd, 2.2 MiB/s wr, 417 op/s 2024-09-13T17:16:04.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.318+0000 7f6633c20640 1 -- 172.21.15.87:0/905742862 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f662c0fee50 msgr2=0x7f662c0ff230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:04.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.318+0000 7f6633c20640 1 --2- 172.21.15.87:0/905742862 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f662c0fee50 0x7f662c0ff230 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f6628009930 tx=0x7f662802a420 comp rx=0 tx=0).stop 2024-09-13T17:16:04.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.318+0000 7f6633c20640 1 -- 172.21.15.87:0/905742862 shutdown_connections 2024-09-13T17:16:04.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.318+0000 7f6633c20640 1 --2- 172.21.15.87:0/905742862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f662c103fa0 0x7f662c10baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.318+0000 7f6633c20640 1 --2- 172.21.15.87:0/905742862 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f662c0ff800 0x7f662c103840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.318+0000 7f6633c20640 1 --2- 172.21.15.87:0/905742862 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f662c0fee50 0x7f662c0ff230 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.318+0000 7f6633c20640 1 -- 172.21.15.87:0/905742862 >> 172.21.15.87:0/905742862 conn(0x7f662c0fa8e0 msgr2=0x7f662c0fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:04.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.318+0000 7f6633c20640 1 -- 172.21.15.87:0/905742862 shutdown_connections 2024-09-13T17:16:04.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.318+0000 7f6633c20640 1 -- 172.21.15.87:0/905742862 wait complete. 2024-09-13T17:16:04.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.319+0000 7f6633c20640 1 Processor -- start 2024-09-13T17:16:04.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.319+0000 7f6633c20640 1 -- start start 2024-09-13T17:16:04.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.319+0000 7f6633c20640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f662c0fee50 0x7f662c1951c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.319+0000 7f6633c20640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f662c103fa0 0x7f662c195700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.319+0000 7f6633c20640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f662c199af0 0x7f662c199fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.319+0000 7f6633c20640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662c19a4e0 con 0x7f662c103fa0 2024-09-13T17:16:04.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.319+0000 7f6633c20640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662c19a650 con 0x7f662c199af0 2024-09-13T17:16:04.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.319+0000 7f6633c20640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662c19a7c0 con 0x7f662c0fee50 2024-09-13T17:16:04.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.319+0000 7f66311bb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f662c103fa0 0x7f662c195700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.319+0000 7f66311bb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f662c103fa0 0x7f662c195700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:32786/0 (socket says 172.21.15.87:32786) 2024-09-13T17:16:04.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.319+0000 7f66311bb640 1 -- 172.21.15.87:0/3293659203 learned_addr learned my addr 172.21.15.87:0/3293659203 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:04.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.319+0000 7f66321bd640 1 --2- 172.21.15.87:0/3293659203 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f662c199af0 0x7f662c199fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.319+0000 7f66311bb640 1 -- 172.21.15.87:0/3293659203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f662c0fee50 msgr2=0x7f662c1951c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:04.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.319+0000 7f66319bc640 1 --2- 172.21.15.87:0/3293659203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f662c0fee50 0x7f662c1951c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.319+0000 7f66311bb640 1 --2- 172.21.15.87:0/3293659203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f662c0fee50 0x7f662c1951c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.319+0000 7f66311bb640 1 -- 172.21.15.87:0/3293659203 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f662c199af0 msgr2=0x7f662c199fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:04.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.319+0000 7f66311bb640 1 --2- 172.21.15.87:0/3293659203 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f662c199af0 0x7f662c199fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.319+0000 7f66311bb640 1 -- 172.21.15.87:0/3293659203 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6628009560 con 0x7f662c103fa0 2024-09-13T17:16:04.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.319+0000 7f66321bd640 1 --2- 172.21.15.87:0/3293659203 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f662c199af0 0x7f662c199fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:04.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.319+0000 7f66311bb640 1 --2- 172.21.15.87:0/3293659203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f662c103fa0 0x7f662c195700 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f662000d740 tx=0x7f662000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:04.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.320+0000 7f661effd640 1 -- 172.21.15.87:0/3293659203 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6620009c30 con 0x7f662c103fa0 2024-09-13T17:16:04.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.320+0000 7f661effd640 1 -- 172.21.15.87:0/3293659203 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f662000de50 con 0x7f662c103fa0 2024-09-13T17:16:04.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.320+0000 7f661effd640 1 -- 172.21.15.87:0/3293659203 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6620004e40 con 0x7f662c103fa0 2024-09-13T17:16:04.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.320+0000 7f6633c20640 1 -- 172.21.15.87:0/3293659203 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f662c1a1da0 con 0x7f662c103fa0 2024-09-13T17:16:04.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.320+0000 7f6633c20640 1 -- 172.21.15.87:0/3293659203 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f662c1a21a0 con 0x7f662c103fa0 2024-09-13T17:16:04.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.322+0000 7f661effd640 1 -- 172.21.15.87:0/3293659203 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f6620004fa0 con 0x7f662c103fa0 2024-09-13T17:16:04.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.322+0000 7f6636a20740 1 Processor -- start 2024-09-13T17:16:04.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.322+0000 7f6636a20740 1 -- start start 2024-09-13T17:16:04.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.323+0000 7f6636a20740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5630e9e4de10 0x5630e9e4e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.323+0000 7f6636a20740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5630e9e4e730 0x5630e9e58a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.323+0000 7f6636a20740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5630e9e58fd0 0x5630e9e5b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.323+0000 7f6636a20740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e9db8f20 con 0x5630e9e58fd0 2024-09-13T17:16:04.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.323+0000 7f6636a20740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e9db66b0 con 0x5630e9e4de10 2024-09-13T17:16:04.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.323+0000 7f6636a20740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e9db1fa0 con 0x5630e9e4e730 2024-09-13T17:16:04.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.323+0000 7f66311bb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5630e9e58fd0 0x5630e9e5b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.323+0000 7f661effd640 1 --2- 172.21.15.87:0/3293659203 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f66180a1280 0x7f66180a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.323+0000 7f66311bb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5630e9e58fd0 0x5630e9e5b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:32802/0 (socket says 172.21.15.87:32802) 2024-09-13T17:16:04.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.323+0000 7f66311bb640 1 -- 172.21.15.87:0/314086449 learned_addr learned my addr 172.21.15.87:0/314086449 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:04.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.323+0000 7f66319bc640 1 --2- 172.21.15.87:0/314086449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5630e9e4e730 0x5630e9e58a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.323+0000 7f66321bd640 1 --2- 172.21.15.87:0/314086449 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5630e9e4de10 0x5630e9e4e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.323+0000 7f66321bd640 1 --2- 172.21.15.87:0/3293659203 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f66180a1280 0x7f66180a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.323+0000 7f661effd640 1 -- 172.21.15.87:0/3293659203 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f66200ccaf0 con 0x7f662c103fa0 2024-09-13T17:16:04.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.323+0000 7f66311bb640 1 -- 172.21.15.87:0/314086449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5630e9e4e730 msgr2=0x5630e9e58a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:04.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.323+0000 7f66311bb640 1 --2- 172.21.15.87:0/314086449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5630e9e4e730 0x5630e9e58a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.323+0000 7f66311bb640 1 -- 172.21.15.87:0/314086449 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5630e9e4de10 msgr2=0x5630e9e4e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:04.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.323+0000 7f66311bb640 1 --2- 172.21.15.87:0/314086449 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5630e9e4de10 0x5630e9e4e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.323+0000 7f66311bb640 1 -- 172.21.15.87:0/314086449 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630e9d6c840 con 0x5630e9e58fd0 2024-09-13T17:16:04.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.323+0000 7f66319bc640 1 --2- 172.21.15.87:0/314086449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5630e9e4e730 0x5630e9e58a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:16:04.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.323+0000 7f66321bd640 1 --2- 172.21.15.87:0/314086449 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5630e9e4de10 0x5630e9e4e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:04.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.323+0000 7f66311bb640 1 --2- 172.21.15.87:0/314086449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5630e9e58fd0 0x5630e9e5b3c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f6620095cf0 tx=0x7f6620099280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6075a7f996f8e5cf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:04.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.323+0000 7f6617fff640 1 -- 172.21.15.87:0/314086449 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66200ccea0 con 0x5630e9e58fd0 2024-09-13T17:16:04.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.324+0000 7f66321bd640 1 --2- 172.21.15.87:0/3293659203 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f66180a1280 0x7f66180a3740 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6624013600 tx=0x7f6624005c60 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:04.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.324+0000 7f6617fff640 1 -- 172.21.15.87:0/314086449 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6620099ef0 con 0x5630e9e58fd0 2024-09-13T17:16:04.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.324+0000 7f6617fff640 1 -- 172.21.15.87:0/314086449 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6620095f00 con 0x5630e9e58fd0 2024-09-13T17:16:04.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.324+0000 7f6636a20740 1 -- 172.21.15.87:0/314086449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5630e9e58fd0 msgr2=0x5630e9e5b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:04.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.324+0000 7f6636a20740 1 --2- 172.21.15.87:0/314086449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5630e9e58fd0 0x5630e9e5b3c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f6620095cf0 tx=0x7f6620099280 comp rx=0 tx=0).stop 2024-09-13T17:16:04.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.324+0000 7f6636a20740 1 -- 172.21.15.87:0/314086449 shutdown_connections 2024-09-13T17:16:04.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.324+0000 7f6636a20740 1 --2- 172.21.15.87:0/314086449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5630e9e58fd0 0x5630e9e5b3c0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.324+0000 7f6636a20740 1 --2- 172.21.15.87:0/314086449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5630e9e4e730 0x5630e9e58a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.324+0000 7f6636a20740 1 --2- 172.21.15.87:0/314086449 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5630e9e4de10 0x5630e9e4e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.324+0000 7f6636a20740 1 -- 172.21.15.87:0/314086449 >> 172.21.15.87:0/314086449 conn(0x5630e9e4a380 msgr2=0x5630e9e4a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:04.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.324+0000 7f6636a20740 1 -- 172.21.15.87:0/314086449 shutdown_connections 2024-09-13T17:16:04.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.325+0000 7f6636a20740 1 -- 172.21.15.87:0/314086449 wait complete. 2024-09-13T17:16:04.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.325+0000 7f6636a20740 1 -- start start 2024-09-13T17:16:04.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.325+0000 7f6636a20740 1 Processor -- start 2024-09-13T17:16:04.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.325+0000 7f6636a20740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5630e9e4de10 0x5630e9e589e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.325+0000 7f6636a20740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5630e9e4e730 0x5630e9e55c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.325+0000 7f6636a20740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5630e9e58fd0 0x5630e9e56220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.325+0000 7f6636a20740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e9d532a0 con 0x5630e9e58fd0 2024-09-13T17:16:04.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.325+0000 7f6636a20740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e9a8a430 con 0x5630e9e4de10 2024-09-13T17:16:04.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.325+0000 7f6636a20740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e9d35680 con 0x5630e9e4e730 2024-09-13T17:16:04.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.325+0000 7f6636a20740 10 client.0 _ll_register_callbacks cb 0x5630e9dab610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:04.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.325+0000 7f66321bd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5630e9e58fd0 0x5630e9e56220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.325+0000 7f66319bc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5630e9e4de10 0x5630e9e589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.325+0000 7f66321bd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5630e9e58fd0 0x5630e9e56220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:32818/0 (socket says 172.21.15.87:32818) 2024-09-13T17:16:04.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.325+0000 7f66321bd640 1 -- 172.21.15.87:0/3900590719 learned_addr learned my addr 172.21.15.87:0/3900590719 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:04.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.326+0000 7f66311bb640 1 --2- 172.21.15.87:0/3900590719 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5630e9e4e730 0x5630e9e55c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.326+0000 7f66321bd640 1 -- 172.21.15.87:0/3900590719 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5630e9e4e730 msgr2=0x5630e9e55c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:04.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.326+0000 7f66321bd640 1 --2- 172.21.15.87:0/3900590719 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5630e9e4e730 0x5630e9e55c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.326+0000 7f66321bd640 1 -- 172.21.15.87:0/3900590719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5630e9e4de10 msgr2=0x5630e9e589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:04.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.326+0000 7f66321bd640 1 --2- 172.21.15.87:0/3900590719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5630e9e4de10 0x5630e9e589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.326+0000 7f66321bd640 1 -- 172.21.15.87:0/3900590719 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f662c1a21a0 con 0x5630e9e58fd0 2024-09-13T17:16:04.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.326+0000 7f66321bd640 1 --2- 172.21.15.87:0/3900590719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5630e9e58fd0 0x5630e9e56220 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f662400ef50 tx=0x7f6624004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf69c0fff2579b88 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:04.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.326+0000 7f66157fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:16:04.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.326+0000 7f66157fa640 1 -- 172.21.15.87:0/3900590719 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6624003970 con 0x5630e9e58fd0 2024-09-13T17:16:04.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.326+0000 7f66157fa640 1 -- 172.21.15.87:0/3900590719 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f6624003ad0 con 0x5630e9e58fd0 2024-09-13T17:16:04.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.326+0000 7f6636a20740 1 -- 172.21.15.87:0/3900590719 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5630e9aa54e0 con 0x5630e9e58fd0 2024-09-13T17:16:04.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.326+0000 7f66157fa640 1 -- 172.21.15.87:0/3900590719 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6624003c90 con 0x5630e9e58fd0 2024-09-13T17:16:04.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.326+0000 7f6636a20740 10 client.16287 fetch_fsmap learned FSMap version 26 2024-09-13T17:16:04.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.326+0000 7f6636a20740 1 -- 172.21.15.87:0/3900590719 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5630e9db0620 con 0x5630e9e58fd0 2024-09-13T17:16:04.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.326+0000 7f66157fa640 1 -- 172.21.15.87:0/3900590719 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x5630e9aa54e0 con 0x5630e9e58fd0 2024-09-13T17:16:04.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.327+0000 7f66157fa640 1 -- 172.21.15.87:0/3900590719 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f662401e4b0 con 0x5630e9e58fd0 2024-09-13T17:16:04.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.327+0000 7f6636a20740 10 client.16287 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T17:16:04.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.327+0000 7f6636a20740 10 client.16287 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:16:04.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.327+0000 7f6636a20740 20 client.16287 populate_metadata read hostname 'smithi087' 2024-09-13T17:16:04.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.327+0000 7f6636a20740 1 --2- 172.21.15.87:0/3900590719 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5630e9e6af60 0x5630e9e6d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.327+0000 7f6636a20740 4 client.16287 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:16:04.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.327+0000 7f6636a20740 1 -- 172.21.15.87:0/3900590719 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5630e9ab67e0 con 0x5630e9e6af60 2024-09-13T17:16:04.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.327+0000 7f66319bc640 1 --2- 172.21.15.87:0/3900590719 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5630e9e6af60 0x5630e9e6d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.327+0000 7f66157fa640 10 client.16287 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:04.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.327+0000 7f66319bc640 1 --2- 172.21.15.87:0/3900590719 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5630e9e6af60 0x5630e9e6d380 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13c560f237aa7388 server_cookie=59561ec464a4d489 in_seq=0 out_seq=0 2024-09-13T17:16:04.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.328+0000 7f66157fa640 1 -- 172.21.15.87:0/3900590719 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5630e9ab67e0 con 0x5630e9e6af60 2024-09-13T17:16:04.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.328+0000 7f66157fa640 10 client.16287 handle_command_reply: tid=0 2024-09-13T17:16:04.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.328+0000 7f6636a20740 1 client.16287 shutdown 2024-09-13T17:16:04.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.328+0000 7f6636a20740 1 -- 172.21.15.87:0/3900590719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5630e9e58fd0 msgr2=0x5630e9e56220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:04.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.328+0000 7f6636a20740 1 --2- 172.21.15.87:0/3900590719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5630e9e58fd0 0x5630e9e56220 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f662400ef50 tx=0x7f6624004a40 comp rx=0 tx=0).stop 2024-09-13T17:16:04.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.328+0000 7f6636a20740 1 -- 172.21.15.87:0/3900590719 shutdown_connections 2024-09-13T17:16:04.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.328+0000 7f6636a20740 1 --2- 172.21.15.87:0/3900590719 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5630e9e6af60 0x5630e9e6d380 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.328+0000 7f6636a20740 1 --2- 172.21.15.87:0/3900590719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5630e9e58fd0 0x5630e9e56220 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.328+0000 7f6636a20740 1 --2- 172.21.15.87:0/3900590719 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5630e9e4e730 0x5630e9e55c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.328+0000 7f6636a20740 1 --2- 172.21.15.87:0/3900590719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5630e9e4de10 0x5630e9e589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.328+0000 7f66157fa640 0 client.16287 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:04.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.328+0000 7f6636a20740 1 -- 172.21.15.87:0/3900590719 >> 172.21.15.87:0/3900590719 conn(0x5630e9e4a380 msgr2=0x5630e9e50090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:04.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.328+0000 7f6636a20740 1 -- 172.21.15.87:0/3900590719 shutdown_connections 2024-09-13T17:16:04.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.328+0000 7f6636a20740 1 -- 172.21.15.87:0/3900590719 wait complete. 2024-09-13T17:16:04.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.329+0000 7f6636a20740 20 client.16287 trim_cache size 0 max 16384 2024-09-13T17:16:04.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.342+0000 7f6636a20740 1 Processor -- start 2024-09-13T17:16:04.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.343+0000 7f6636a20740 1 -- start start 2024-09-13T17:16:04.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.343+0000 7f6636a20740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5630e9e4de10 0x5630e9e49d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.343+0000 7f6636a20740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5630e9e4e730 0x5630e9e5fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.343+0000 7f6636a20740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5630e9e58fd0 0x5630e9e60150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.343+0000 7f6636a20740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e9e675e0 con 0x5630e9e4de10 2024-09-13T17:16:04.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.343+0000 7f6636a20740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e9e4edd0 con 0x5630e9e4e730 2024-09-13T17:16:04.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.343+0000 7f6636a20740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e9e45760 con 0x5630e9e58fd0 2024-09-13T17:16:04.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.343+0000 7f66319bc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5630e9e4de10 0x5630e9e49d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.343+0000 7f66319bc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5630e9e4de10 0x5630e9e49d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:32824/0 (socket says 172.21.15.87:32824) 2024-09-13T17:16:04.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.343+0000 7f66319bc640 1 -- 172.21.15.87:0/960611065 learned_addr learned my addr 172.21.15.87:0/960611065 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:04.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.343+0000 7f66311bb640 1 --2- 172.21.15.87:0/960611065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5630e9e4e730 0x5630e9e5fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.343+0000 7f66321bd640 1 --2- 172.21.15.87:0/960611065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5630e9e58fd0 0x5630e9e60150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.343+0000 7f66319bc640 1 -- 172.21.15.87:0/960611065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5630e9e58fd0 msgr2=0x5630e9e60150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:04.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.343+0000 7f66319bc640 1 --2- 172.21.15.87:0/960611065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5630e9e58fd0 0x5630e9e60150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.343+0000 7f66319bc640 1 -- 172.21.15.87:0/960611065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5630e9e4e730 msgr2=0x5630e9e5fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:04.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.343+0000 7f66319bc640 1 --2- 172.21.15.87:0/960611065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5630e9e4e730 0x5630e9e5fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.343+0000 7f66319bc640 1 -- 172.21.15.87:0/960611065 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630e9d52790 con 0x5630e9e4de10 2024-09-13T17:16:04.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.343+0000 7f66319bc640 1 --2- 172.21.15.87:0/960611065 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5630e9e4de10 0x5630e9e49d00 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f6628009230 tx=0x7f6628005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c8e81770d7c653 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:04.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.343+0000 7f661ce05640 1 -- 172.21.15.87:0/960611065 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6628044b70 con 0x5630e9e4de10 2024-09-13T17:16:04.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.343+0000 7f661ce05640 1 -- 172.21.15.87:0/960611065 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f66280447e0 con 0x5630e9e4de10 2024-09-13T17:16:04.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.343+0000 7f661ce05640 1 -- 172.21.15.87:0/960611065 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6628003c40 con 0x5630e9e4de10 2024-09-13T17:16:04.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.344+0000 7f6636a20740 1 -- 172.21.15.87:0/960611065 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5630e9e4de10 msgr2=0x5630e9e49d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:04.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.344+0000 7f6636a20740 1 --2- 172.21.15.87:0/960611065 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5630e9e4de10 0x5630e9e49d00 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f6628009230 tx=0x7f6628005a20 comp rx=0 tx=0).stop 2024-09-13T17:16:04.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.344+0000 7f6636a20740 1 -- 172.21.15.87:0/960611065 shutdown_connections 2024-09-13T17:16:04.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.344+0000 7f6636a20740 1 --2- 172.21.15.87:0/960611065 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5630e9e58fd0 0x5630e9e60150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.344+0000 7f6636a20740 1 --2- 172.21.15.87:0/960611065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5630e9e4e730 0x5630e9e5fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.344+0000 7f6636a20740 1 --2- 172.21.15.87:0/960611065 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5630e9e4de10 0x5630e9e49d00 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.344+0000 7f6636a20740 1 -- 172.21.15.87:0/960611065 >> 172.21.15.87:0/960611065 conn(0x5630e9e4a380 msgr2=0x5630e9e71ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:04.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.344+0000 7f6636a20740 1 -- 172.21.15.87:0/960611065 shutdown_connections 2024-09-13T17:16:04.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.344+0000 7f6636a20740 1 -- 172.21.15.87:0/960611065 wait complete. 2024-09-13T17:16:04.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.345+0000 7f6636a20740 1 -- start start 2024-09-13T17:16:04.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.345+0000 7f6636a20740 1 Processor -- start 2024-09-13T17:16:04.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.345+0000 7f6636a20740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5630e9e4de10 0x5630e9e5c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.345+0000 7f6636a20740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5630e9e4e730 0x5630e9e5c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.345+0000 7f6636a20740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5630e9e58fd0 0x5630e9eb9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.345+0000 7f6636a20740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e9eb9aa0 con 0x5630e9e58fd0 2024-09-13T17:16:04.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.345+0000 7f6636a20740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e9eb9c10 con 0x5630e9e4e730 2024-09-13T17:16:04.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.345+0000 7f6636a20740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e9eb9dd0 con 0x5630e9e4de10 2024-09-13T17:16:04.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.345+0000 7f6636a20740 10 client.0 _ll_register_callbacks cb 0x7f662400a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:04.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.346+0000 7f66321bd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5630e9e58fd0 0x5630e9eb9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.346+0000 7f66321bd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5630e9e58fd0 0x5630e9eb9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:32836/0 (socket says 172.21.15.87:32836) 2024-09-13T17:16:04.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.346+0000 7f66321bd640 1 -- 172.21.15.87:0/888773955 learned_addr learned my addr 172.21.15.87:0/888773955 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:04.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.346+0000 7f66319bc640 1 --2- 172.21.15.87:0/888773955 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5630e9e4de10 0x5630e9e5c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.346+0000 7f66311bb640 1 --2- 172.21.15.87:0/888773955 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5630e9e4e730 0x5630e9e5c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.347+0000 7f66321bd640 1 -- 172.21.15.87:0/888773955 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5630e9e4de10 msgr2=0x5630e9e5c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:04.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.347+0000 7f66321bd640 1 --2- 172.21.15.87:0/888773955 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5630e9e4de10 0x5630e9e5c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.347+0000 7f66321bd640 1 -- 172.21.15.87:0/888773955 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5630e9e4e730 msgr2=0x5630e9e5c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:04.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.347+0000 7f66321bd640 1 --2- 172.21.15.87:0/888773955 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5630e9e4e730 0x5630e9e5c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.347+0000 7f66321bd640 1 -- 172.21.15.87:0/888773955 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6628004040 con 0x5630e9e58fd0 2024-09-13T17:16:04.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.347+0000 7f66321bd640 1 --2- 172.21.15.87:0/888773955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5630e9e58fd0 0x5630e9eb9410 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f662401e8c0 tx=0x7f662401e740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d525409b2cd7aa93 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:04.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.347+0000 7f66157fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:16:04.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.347+0000 7f66157fa640 1 -- 172.21.15.87:0/888773955 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662401eb30 con 0x5630e9e58fd0 2024-09-13T17:16:04.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.347+0000 7f6636a20740 1 -- 172.21.15.87:0/888773955 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6620099ef0 con 0x5630e9e58fd0 2024-09-13T17:16:04.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.347+0000 7f66157fa640 1 -- 172.21.15.87:0/888773955 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f6624013030 con 0x5630e9e58fd0 2024-09-13T17:16:04.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.348+0000 7f66157fa640 1 -- 172.21.15.87:0/888773955 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66240131f0 con 0x5630e9e58fd0 2024-09-13T17:16:04.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.348+0000 7f6636a20740 10 client.16293 fetch_fsmap learned FSMap version 26 2024-09-13T17:16:04.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.348+0000 7f6636a20740 1 -- 172.21.15.87:0/888773955 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5630e9d77ea0 con 0x5630e9e58fd0 2024-09-13T17:16:04.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.348+0000 7f66157fa640 1 -- 172.21.15.87:0/888773955 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6620099ef0 con 0x5630e9e58fd0 2024-09-13T17:16:04.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.348+0000 7f66157fa640 1 -- 172.21.15.87:0/888773955 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f6624004020 con 0x5630e9e58fd0 2024-09-13T17:16:04.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.348+0000 7f6636a20740 10 client.16293 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T17:16:04.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.348+0000 7f6636a20740 10 client.16293 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:16:04.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.348+0000 7f6636a20740 20 client.16293 populate_metadata read hostname 'smithi087' 2024-09-13T17:16:04.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.348+0000 7f6636a20740 1 --2- 172.21.15.87:0/888773955 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5630e9e65da0 0x5630e9e661b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.348+0000 7f6636a20740 4 client.16293 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:16:04.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.348+0000 7f6636a20740 1 -- 172.21.15.87:0/888773955 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5630e9b09e30 con 0x5630e9e65da0 2024-09-13T17:16:04.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.348+0000 7f66319bc640 1 --2- 172.21.15.87:0/888773955 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5630e9e65da0 0x5630e9e661b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.349+0000 7f66157fa640 10 client.16293 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:04.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.349+0000 7f66319bc640 1 --2- 172.21.15.87:0/888773955 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5630e9e65da0 0x5630e9e661b0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce38e4dd3992a2e7 server_cookie=a13bd1a83798526 in_seq=0 out_seq=0 2024-09-13T17:16:04.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.349+0000 7f66157fa640 1 -- 172.21.15.87:0/888773955 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5630e9b09e30 con 0x5630e9e65da0 2024-09-13T17:16:04.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.349+0000 7f66157fa640 10 client.16293 handle_command_reply: tid=0 2024-09-13T17:16:04.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.349+0000 7f6636a20740 1 client.16293 shutdown 2024-09-13T17:16:04.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.349+0000 7f6636a20740 1 -- 172.21.15.87:0/888773955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5630e9e58fd0 msgr2=0x5630e9eb9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:04.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.349+0000 7f6636a20740 1 --2- 172.21.15.87:0/888773955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5630e9e58fd0 0x5630e9eb9410 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f662401e8c0 tx=0x7f662401e740 comp rx=0 tx=0).stop 2024-09-13T17:16:04.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.350+0000 7f6636a20740 1 -- 172.21.15.87:0/888773955 shutdown_connections 2024-09-13T17:16:04.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.350+0000 7f6636a20740 1 --2- 172.21.15.87:0/888773955 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5630e9e65da0 0x5630e9e661b0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.350+0000 7f6636a20740 1 --2- 172.21.15.87:0/888773955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5630e9e58fd0 0x5630e9eb9410 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.350+0000 7f6636a20740 1 --2- 172.21.15.87:0/888773955 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5630e9e4e730 0x5630e9e5c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.350+0000 7f6636a20740 1 --2- 172.21.15.87:0/888773955 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5630e9e4de10 0x5630e9e5c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.350+0000 7f6636a20740 1 -- 172.21.15.87:0/888773955 >> 172.21.15.87:0/888773955 conn(0x5630e9e4a380 msgr2=0x5630e9e50f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:04.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.350+0000 7f66157fa640 0 client.16293 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:04.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.350+0000 7f6636a20740 1 -- 172.21.15.87:0/888773955 shutdown_connections 2024-09-13T17:16:04.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.350+0000 7f6636a20740 1 -- 172.21.15.87:0/888773955 wait complete. 2024-09-13T17:16:04.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.350+0000 7f6636a20740 20 client.16293 trim_cache size 0 max 16384 2024-09-13T17:16:04.356 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:16:04.356 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "no active scrubs running", 2024-09-13T17:16:04.356 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": {} 2024-09-13T17:16:04.356 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:16:04.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.351+0000 7f6633c20640 1 -- 172.21.15.87:0/3293659203 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f66180a1280 msgr2=0x7f66180a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:04.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.351+0000 7f6633c20640 1 --2- 172.21.15.87:0/3293659203 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f66180a1280 0x7f66180a3740 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6624013600 tx=0x7f6624005c60 comp rx=0 tx=0).stop 2024-09-13T17:16:04.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.351+0000 7f6633c20640 1 -- 172.21.15.87:0/3293659203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f662c103fa0 msgr2=0x7f662c195700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:04.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.351+0000 7f6633c20640 1 --2- 172.21.15.87:0/3293659203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f662c103fa0 0x7f662c195700 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f662000d740 tx=0x7f662000dc00 comp rx=0 tx=0).stop 2024-09-13T17:16:04.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.351+0000 7f6633c20640 1 -- 172.21.15.87:0/3293659203 shutdown_connections 2024-09-13T17:16:04.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.351+0000 7f6633c20640 1 --2- 172.21.15.87:0/3293659203 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f662c199af0 0x7f662c199fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.351+0000 7f6633c20640 1 --2- 172.21.15.87:0/3293659203 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f66180a1280 0x7f66180a3740 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.351+0000 7f6633c20640 1 --2- 172.21.15.87:0/3293659203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f662c103fa0 0x7f662c195700 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.351+0000 7f6633c20640 1 --2- 172.21.15.87:0/3293659203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f662c0fee50 0x7f662c1951c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.352+0000 7f6633c20640 1 -- 172.21.15.87:0/3293659203 >> 172.21.15.87:0/3293659203 conn(0x7f662c0fa8e0 msgr2=0x7f662c0fbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:04.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.352+0000 7f6633c20640 1 -- 172.21.15.87:0/3293659203 shutdown_connections 2024-09-13T17:16:04.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.352+0000 7f6633c20640 1 -- 172.21.15.87:0/3293659203 wait complete. 2024-09-13T17:16:04.370 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T17:16:04.370 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:16:04.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.506+0000 7f0a9f44f640 1 -- 172.21.15.87:0/690922190 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a980ff620 msgr2=0x7f0a98103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:04.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.506+0000 7f0a9f44f640 1 --2- 172.21.15.87:0/690922190 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a980ff620 0x7f0a98103ae0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f0a88009900 tx=0x7f0a8802a480 comp rx=0 tx=0).stop 2024-09-13T17:16:04.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.506+0000 7f0a9f44f640 1 -- 172.21.15.87:0/690922190 shutdown_connections 2024-09-13T17:16:04.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.506+0000 7f0a9f44f640 1 --2- 172.21.15.87:0/690922190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a98104130 0x7f0a981045a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.506+0000 7f0a9f44f640 1 --2- 172.21.15.87:0/690922190 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a980ff620 0x7f0a98103ae0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.506+0000 7f0a9f44f640 1 --2- 172.21.15.87:0/690922190 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a980fed00 0x7f0a980ff0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.506+0000 7f0a9f44f640 1 -- 172.21.15.87:0/690922190 >> 172.21.15.87:0/690922190 conn(0x7f0a980fa900 msgr2=0x7f0a980fcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:04.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.506+0000 7f0a9f44f640 1 -- 172.21.15.87:0/690922190 shutdown_connections 2024-09-13T17:16:04.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.506+0000 7f0a9f44f640 1 -- 172.21.15.87:0/690922190 wait complete. 2024-09-13T17:16:04.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.507+0000 7f0a9f44f640 1 Processor -- start 2024-09-13T17:16:04.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.507+0000 7f0a9f44f640 1 -- start start 2024-09-13T17:16:04.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.507+0000 7f0a9f44f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a980fed00 0x7f0a981a2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.507+0000 7f0a9f44f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a980ff620 0x7f0a981a2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.507+0000 7f0a9f44f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a98104130 0x7f0a9819c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.507+0000 7f0a9f44f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9819cd30 con 0x7f0a980fed00 2024-09-13T17:16:04.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.507+0000 7f0a9f44f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9819cea0 con 0x7f0a98104130 2024-09-13T17:16:04.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.507+0000 7f0a9f44f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9819d060 con 0x7f0a980ff620 2024-09-13T17:16:04.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.507+0000 7f0a9d1eb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a980fed00 0x7f0a981a2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.507+0000 7f0a9d1eb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a980fed00 0x7f0a981a2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:32858/0 (socket says 172.21.15.87:32858) 2024-09-13T17:16:04.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.507+0000 7f0a9d1eb640 1 -- 172.21.15.87:0/4239829737 learned_addr learned my addr 172.21.15.87:0/4239829737 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:04.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.508+0000 7f0a9d9ec640 1 --2- 172.21.15.87:0/4239829737 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a98104130 0x7f0a9819c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.508+0000 7f0a9d1eb640 1 -- 172.21.15.87:0/4239829737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a980ff620 msgr2=0x7f0a981a2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:04.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.508+0000 7f0a9c9ea640 1 --2- 172.21.15.87:0/4239829737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a980ff620 0x7f0a981a2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.508+0000 7f0a9d1eb640 1 --2- 172.21.15.87:0/4239829737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a980ff620 0x7f0a981a2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.508+0000 7f0a9d1eb640 1 -- 172.21.15.87:0/4239829737 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a98104130 msgr2=0x7f0a9819c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:04.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.508+0000 7f0a9d1eb640 1 --2- 172.21.15.87:0/4239829737 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a98104130 0x7f0a9819c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.508+0000 7f0a9d1eb640 1 -- 172.21.15.87:0/4239829737 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a88009560 con 0x7f0a980fed00 2024-09-13T17:16:04.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.508+0000 7f0a9d9ec640 1 --2- 172.21.15.87:0/4239829737 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a98104130 0x7f0a9819c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:04.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.508+0000 7f0a9d1eb640 1 --2- 172.21.15.87:0/4239829737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a980fed00 0x7f0a981a2630 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f0a9400d950 tx=0x7f0a9400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:04.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.508+0000 7f0a8e7fc640 1 -- 172.21.15.87:0/4239829737 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a94009c30 con 0x7f0a980fed00 2024-09-13T17:16:04.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.508+0000 7f0a8e7fc640 1 -- 172.21.15.87:0/4239829737 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0a94009d90 con 0x7f0a980fed00 2024-09-13T17:16:04.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.508+0000 7f0a9f44f640 1 -- 172.21.15.87:0/4239829737 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a9819d340 con 0x7f0a980fed00 2024-09-13T17:16:04.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.508+0000 7f0a8e7fc640 1 -- 172.21.15.87:0/4239829737 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9400f6b0 con 0x7f0a980fed00 2024-09-13T17:16:04.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.508+0000 7f0a9f44f640 1 -- 172.21.15.87:0/4239829737 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a981a9620 con 0x7f0a980fed00 2024-09-13T17:16:04.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.509+0000 7f0a9f44f640 1 -- 172.21.15.87:0/4239829737 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a98068ed0 con 0x7f0a980fed00 2024-09-13T17:16:04.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.510+0000 7f0a8e7fc640 1 -- 172.21.15.87:0/4239829737 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f0a94010aa0 con 0x7f0a980fed00 2024-09-13T17:16:04.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.511+0000 7f0a8e7fc640 1 --2- 172.21.15.87:0/4239829737 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0a840a1200 0x7f0a840a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.511+0000 7f0a9c9ea640 1 --2- 172.21.15.87:0/4239829737 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0a840a1200 0x7f0a840a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.511+0000 7f0a8e7fc640 1 -- 172.21.15.87:0/4239829737 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f0a940cce10 con 0x7f0a980fed00 2024-09-13T17:16:04.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.511+0000 7f0a9c9ea640 1 --2- 172.21.15.87:0/4239829737 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0a840a1200 0x7f0a840a36c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0a8802a9a0 tx=0x7f0a88000bc0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:04.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.514+0000 7f0a8e7fc640 1 -- 172.21.15.87:0/4239829737 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0a94095eb0 con 0x7f0a980fed00 2024-09-13T17:16:04.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.741+0000 7f0a9f44f640 1 -- 172.21.15.87:0/4239829737 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a98103ae0 con 0x7f0a980fed00 2024-09-13T17:16:04.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.742+0000 7f0a8e7fc640 1 -- 172.21.15.87:0/4239829737 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10880 (secure 0 0 0) 0x7f0a94017090 con 0x7f0a980fed00 2024-09-13T17:16:04.744 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:16:04.745 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/3674545180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":3674545180},{"type":"v1","addr":"172.21.15.87:6841","nonce":3674545180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:11:23.313609+0000","modified":"2024-09-13T17:15:20.534419+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24484,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6839/3052680456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3052680456},{"type":"v1","addr":"172.21.15.118:6839","nonce":3052680456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:16:04.745 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 26 2024-09-13T17:16:04.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.744+0000 7f0a9f44f640 1 -- 172.21.15.87:0/4239829737 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0a840a1200 msgr2=0x7f0a840a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:04.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.744+0000 7f0a9f44f640 1 --2- 172.21.15.87:0/4239829737 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0a840a1200 0x7f0a840a36c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0a8802a9a0 tx=0x7f0a88000bc0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.744+0000 7f0a9f44f640 1 -- 172.21.15.87:0/4239829737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a980fed00 msgr2=0x7f0a981a2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:04.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.744+0000 7f0a9f44f640 1 --2- 172.21.15.87:0/4239829737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a980fed00 0x7f0a981a2630 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f0a9400d950 tx=0x7f0a9400de10 comp rx=0 tx=0).stop 2024-09-13T17:16:04.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.745+0000 7f0a9f44f640 1 -- 172.21.15.87:0/4239829737 shutdown_connections 2024-09-13T17:16:04.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.745+0000 7f0a9f44f640 1 --2- 172.21.15.87:0/4239829737 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a98104130 0x7f0a9819c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.745+0000 7f0a9f44f640 1 --2- 172.21.15.87:0/4239829737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a980ff620 0x7f0a981a2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.745+0000 7f0a9f44f640 1 --2- 172.21.15.87:0/4239829737 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0a840a1200 0x7f0a840a36c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.745+0000 7f0a9f44f640 1 --2- 172.21.15.87:0/4239829737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a980fed00 0x7f0a981a2630 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.745+0000 7f0a9f44f640 1 -- 172.21.15.87:0/4239829737 >> 172.21.15.87:0/4239829737 conn(0x7f0a980fa900 msgr2=0x7f0a980fb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:04.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.745+0000 7f0a9f44f640 1 -- 172.21.15.87:0/4239829737 shutdown_connections 2024-09-13T17:16:04.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.745+0000 7f0a9f44f640 1 -- 172.21.15.87:0/4239829737 wait complete. 2024-09-13T17:16:04.759 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-09-13T17:16:04.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.871+0000 7f13b817d640 1 -- 172.21.15.87:0/4070676271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13b00febc0 msgr2=0x7f13b010cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:04.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.871+0000 7f13b817d640 1 --2- 172.21.15.87:0/4070676271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13b00febc0 0x7f13b010cbb0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f13a8009ca0 tx=0x7f13a802a8c0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.871+0000 7f13b817d640 1 -- 172.21.15.87:0/4070676271 shutdown_connections 2024-09-13T17:16:04.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.871+0000 7f13b817d640 1 --2- 172.21.15.87:0/4070676271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13b00febc0 0x7f13b010cbb0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.871+0000 7f13b817d640 1 --2- 172.21.15.87:0/4070676271 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13b00fe220 0x7f13b00fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.871+0000 7f13b817d640 1 --2- 172.21.15.87:0/4070676271 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13b0104d00 0x7f13b01050e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.871+0000 7f13b817d640 1 -- 172.21.15.87:0/4070676271 >> 172.21.15.87:0/4070676271 conn(0x7f13b00753f0 msgr2=0x7f13b00fc740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:04.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.871+0000 7f13b817d640 1 -- 172.21.15.87:0/4070676271 shutdown_connections 2024-09-13T17:16:04.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.871+0000 7f13b817d640 1 -- 172.21.15.87:0/4070676271 wait complete. 2024-09-13T17:16:04.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.871+0000 7f13b817d640 1 Processor -- start 2024-09-13T17:16:04.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.871+0000 7f13b817d640 1 -- start start 2024-09-13T17:16:04.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.872+0000 7f13b817d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13b00fe220 0x7f13b0196240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.872+0000 7f13b817d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13b00febc0 0x7f13b0196780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.872+0000 7f13b817d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13b0104d00 0x7f13b019ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.872+0000 7f13b817d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b019b170 con 0x7f13b0104d00 2024-09-13T17:16:04.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.872+0000 7f13b817d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b019b2e0 con 0x7f13b00fe220 2024-09-13T17:16:04.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.872+0000 7f13b817d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b019b4a0 con 0x7f13b00febc0 2024-09-13T17:16:04.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.872+0000 7f13b671a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13b0104d00 0x7f13b019ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.872+0000 7f13b671a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13b0104d00 0x7f13b019ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:32884/0 (socket says 172.21.15.87:32884) 2024-09-13T17:16:04.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.872+0000 7f13b671a640 1 -- 172.21.15.87:0/72618075 learned_addr learned my addr 172.21.15.87:0/72618075 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:04.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.872+0000 7f13b5f19640 1 --2- 172.21.15.87:0/72618075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13b00fe220 0x7f13b0196240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.872+0000 7f13b5718640 1 --2- 172.21.15.87:0/72618075 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13b00febc0 0x7f13b0196780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.872+0000 7f13b671a640 1 -- 172.21.15.87:0/72618075 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13b00febc0 msgr2=0x7f13b0196780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:04.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.872+0000 7f13b671a640 1 --2- 172.21.15.87:0/72618075 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13b00febc0 0x7f13b0196780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.872+0000 7f13b671a640 1 -- 172.21.15.87:0/72618075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13b00fe220 msgr2=0x7f13b0196240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:04.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.872+0000 7f13b671a640 1 --2- 172.21.15.87:0/72618075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13b00fe220 0x7f13b0196240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.872+0000 7f13b671a640 1 -- 172.21.15.87:0/72618075 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a8009900 con 0x7f13b0104d00 2024-09-13T17:16:04.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.872+0000 7f13b5f19640 1 --2- 172.21.15.87:0/72618075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13b00fe220 0x7f13b0196240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:16:04.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.872+0000 7f13b671a640 1 --2- 172.21.15.87:0/72618075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13b0104d00 0x7f13b019ab70 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f13a8004af0 tx=0x7f13a8003e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:04.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.872+0000 7f13a6ffd640 1 -- 172.21.15.87:0/72618075 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a8031650 con 0x7f13b0104d00 2024-09-13T17:16:04.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.873+0000 7f13b817d640 1 -- 172.21.15.87:0/72618075 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13b019b720 con 0x7f13b0104d00 2024-09-13T17:16:04.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.873+0000 7f13a6ffd640 1 -- 172.21.15.87:0/72618075 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f13a8040070 con 0x7f13b0104d00 2024-09-13T17:16:04.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.873+0000 7f13a6ffd640 1 -- 172.21.15.87:0/72618075 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a8004330 con 0x7f13b0104d00 2024-09-13T17:16:04.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.873+0000 7f13b817d640 1 -- 172.21.15.87:0/72618075 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b01a3000 con 0x7f13b0104d00 2024-09-13T17:16:04.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.875+0000 7f13a6ffd640 1 -- 172.21.15.87:0/72618075 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f13a8042030 con 0x7f13b0104d00 2024-09-13T17:16:04.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.876+0000 7f13bae9e740 1 Processor -- start 2024-09-13T17:16:04.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.876+0000 7f13bae9e740 1 -- start start 2024-09-13T17:16:04.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.876+0000 7f13bae9e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d6dc0a790 0x559d6dc0ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.876+0000 7f13a6ffd640 1 --2- 172.21.15.87:0/72618075 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f139c0a1280 0x7f139c0a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.876+0000 7f13bae9e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559d6dc0b0b0 0x559d6dc15410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.876+0000 7f13bae9e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559d6dc15950 0x559d6dc17d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.876+0000 7f13bae9e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d6db74cc0 con 0x559d6dc0a790 2024-09-13T17:16:04.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.876+0000 7f13bae9e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d6db72450 con 0x559d6dc15950 2024-09-13T17:16:04.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.876+0000 7f13bae9e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d6db6dd40 con 0x559d6dc0b0b0 2024-09-13T17:16:04.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.876+0000 7f13b5718640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d6dc0a790 0x559d6dc0ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.876+0000 7f13b5f19640 1 --2- 172.21.15.87:0/72618075 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f139c0a1280 0x7f139c0a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.876+0000 7f13b5718640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d6dc0a790 0x559d6dc0ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:32892/0 (socket says 172.21.15.87:32892) 2024-09-13T17:16:04.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.876+0000 7f13b5718640 1 -- 172.21.15.87:0/1685864309 learned_addr learned my addr 172.21.15.87:0/1685864309 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:04.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.876+0000 7f13b671a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559d6dc15950 0x559d6dc17d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.876+0000 7f13a6ffd640 1 -- 172.21.15.87:0/72618075 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f13a80ee210 con 0x7f13b0104d00 2024-09-13T17:16:04.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.876+0000 7f13b5718640 1 --2- 172.21.15.87:0/1685864309 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559d6dc0b0b0 0x559d6dc15410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.876+0000 7f13b671a640 1 -- 172.21.15.87:0/1685864309 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559d6dc0b0b0 msgr2=0x559d6dc15410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:04.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.876+0000 7f13b671a640 1 --2- 172.21.15.87:0/1685864309 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559d6dc0b0b0 0x559d6dc15410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.876+0000 7f13b671a640 1 -- 172.21.15.87:0/1685864309 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d6dc0a790 msgr2=0x559d6dc0ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:04.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.877+0000 7f13b671a640 1 --2- 172.21.15.87:0/1685864309 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d6dc0a790 0x559d6dc0ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.877+0000 7f13b671a640 1 -- 172.21.15.87:0/1685864309 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d6db35620 con 0x559d6dc15950 2024-09-13T17:16:04.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.877+0000 7f13b671a640 1 --2- 172.21.15.87:0/1685864309 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559d6dc15950 0x559d6dc17d40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f13a80eb6c0 tx=0x7f13a802f3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=797c88c1d7fc92f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:04.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.877+0000 7f13b5f19640 1 --2- 172.21.15.87:0/72618075 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f139c0a1280 0x7f139c0a3740 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f13ac009fc0 tx=0x7f13ac005f90 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:04.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.877+0000 7f139bfff640 1 -- 172.21.15.87:0/1685864309 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a80bae50 con 0x559d6dc15950 2024-09-13T17:16:04.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.877+0000 7f139bfff640 1 -- 172.21.15.87:0/1685864309 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f13a80babc0 con 0x559d6dc15950 2024-09-13T17:16:04.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.877+0000 7f139bfff640 1 -- 172.21.15.87:0/1685864309 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a80beeb0 con 0x559d6dc15950 2024-09-13T17:16:04.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.878+0000 7f13bae9e740 1 -- 172.21.15.87:0/1685864309 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559d6dc15950 msgr2=0x559d6dc17d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:04.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.878+0000 7f13bae9e740 1 --2- 172.21.15.87:0/1685864309 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559d6dc15950 0x559d6dc17d40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f13a80eb6c0 tx=0x7f13a802f3d0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.878+0000 7f13bae9e740 1 -- 172.21.15.87:0/1685864309 shutdown_connections 2024-09-13T17:16:04.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.878+0000 7f13bae9e740 1 --2- 172.21.15.87:0/1685864309 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559d6dc15950 0x559d6dc17d40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.878+0000 7f13bae9e740 1 --2- 172.21.15.87:0/1685864309 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559d6dc0b0b0 0x559d6dc15410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.878+0000 7f13bae9e740 1 --2- 172.21.15.87:0/1685864309 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d6dc0a790 0x559d6dc0ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.878+0000 7f13bae9e740 1 -- 172.21.15.87:0/1685864309 >> 172.21.15.87:0/1685864309 conn(0x559d6dc06d00 msgr2=0x559d6dc070e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:04.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.878+0000 7f13bae9e740 1 -- 172.21.15.87:0/1685864309 shutdown_connections 2024-09-13T17:16:04.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.878+0000 7f13bae9e740 1 -- 172.21.15.87:0/1685864309 wait complete. 2024-09-13T17:16:04.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.878+0000 7f13bae9e740 1 -- start start 2024-09-13T17:16:04.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.878+0000 7f13bae9e740 1 Processor -- start 2024-09-13T17:16:04.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.879+0000 7f13bae9e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559d6dc0a790 0x559d6dc14ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.879+0000 7f13bae9e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d6dc0b0b0 0x559d6dc15410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.879+0000 7f13bae9e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559d6dc15950 0x559d6dc12460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.879+0000 7f13bae9e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d6db2c180 con 0x559d6dc0b0b0 2024-09-13T17:16:04.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.879+0000 7f13bae9e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d6d846430 con 0x559d6dc15950 2024-09-13T17:16:04.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.879+0000 7f13bae9e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d6daf15e0 con 0x559d6dc0a790 2024-09-13T17:16:04.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.879+0000 7f13b5f19640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559d6dc0a790 0x559d6dc14ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.879+0000 7f13b5f19640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559d6dc0a790 0x559d6dc14ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:44514/0 (socket says 172.21.15.87:44514) 2024-09-13T17:16:04.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.879+0000 7f13b5f19640 1 -- 172.21.15.87:0/2244060760 learned_addr learned my addr 172.21.15.87:0/2244060760 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:04.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.879+0000 7f13b5718640 1 --2- 172.21.15.87:0/2244060760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d6dc0b0b0 0x559d6dc15410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.879+0000 7f13bae9e740 10 client.0 _ll_register_callbacks cb 0x559d6db5daa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:04.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.879+0000 7f13b671a640 1 --2- 172.21.15.87:0/2244060760 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559d6dc15950 0x559d6dc12460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.879+0000 7f13b5f19640 1 -- 172.21.15.87:0/2244060760 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559d6dc15950 msgr2=0x559d6dc12460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:04.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.880+0000 7f13b5f19640 1 --2- 172.21.15.87:0/2244060760 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559d6dc15950 0x559d6dc12460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.880+0000 7f13b5f19640 1 -- 172.21.15.87:0/2244060760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d6dc0b0b0 msgr2=0x559d6dc15410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:04.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.880+0000 7f13b5f19640 1 --2- 172.21.15.87:0/2244060760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d6dc0b0b0 0x559d6dc15410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.880+0000 7f13b5f19640 1 -- 172.21.15.87:0/2244060760 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b01a3000 con 0x559d6dc0a790 2024-09-13T17:16:04.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.880+0000 7f13b5f19640 1 --2- 172.21.15.87:0/2244060760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559d6dc0a790 0x559d6dc14ed0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f13ac004650 tx=0x7f13ac004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74a6425c4c064423 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:04.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.880+0000 7f13997fa640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-09-13T17:16:04.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.880+0000 7f13997fa640 1 -- 172.21.15.87:0/2244060760 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ac00f7c0 con 0x559d6dc0a790 2024-09-13T17:16:04.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.880+0000 7f13997fa640 1 -- 172.21.15.87:0/2244060760 <== mon.1 v2:172.21.15.149:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f13ac00f920 con 0x559d6dc0a790 2024-09-13T17:16:04.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.880+0000 7f13bae9e740 1 -- 172.21.15.87:0/2244060760 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559d6db97b80 con 0x559d6dc0a790 2024-09-13T17:16:04.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.881+0000 7f13997fa640 1 -- 172.21.15.87:0/2244060760 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13ac00fae0 con 0x559d6dc0a790 2024-09-13T17:16:04.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.881+0000 7f13bae9e740 10 client.25714 fetch_fsmap learned FSMap version 26 2024-09-13T17:16:04.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.881+0000 7f13bae9e740 1 -- 172.21.15.87:0/2244060760 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559d6db6c3c0 con 0x559d6dc0a790 2024-09-13T17:16:04.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.881+0000 7f13997fa640 1 -- 172.21.15.87:0/2244060760 <== mon.1 v2:172.21.15.149:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x559d6db97b80 con 0x559d6dc0a790 2024-09-13T17:16:04.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.881+0000 7f13997fa640 1 -- 172.21.15.87:0/2244060760 <== mon.1 v2:172.21.15.149:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f13ac026430 con 0x559d6dc0a790 2024-09-13T17:16:04.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.881+0000 7f13bae9e740 10 client.25714 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T17:16:04.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.881+0000 7f13bae9e740 10 client.25714 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:16:04.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.881+0000 7f13bae9e740 20 client.25714 populate_metadata read hostname 'smithi087' 2024-09-13T17:16:04.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.881+0000 7f13bae9e740 1 --2- 172.21.15.87:0/2244060760 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x559d6dc25040 0x559d6dc27460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.881+0000 7f13bae9e740 4 client.25714 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:16:04.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.881+0000 7f13bae9e740 1 -- 172.21.15.87:0/2244060760 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559d6db601f0 con 0x559d6dc25040 2024-09-13T17:16:04.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.881+0000 7f13b5718640 1 --2- 172.21.15.87:0/2244060760 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x559d6dc25040 0x559d6dc27460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.882+0000 7f13997fa640 10 client.25714 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:16:04.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.882+0000 7f13b5718640 1 --2- 172.21.15.87:0/2244060760 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x559d6dc25040 0x559d6dc27460 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e81d77d42cd9df82 server_cookie=cf3ba07aea5eb99d in_seq=0 out_seq=0 2024-09-13T17:16:04.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.882+0000 7f13997fa640 1 -- 172.21.15.87:0/2244060760 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x559d6db601f0 con 0x559d6dc25040 2024-09-13T17:16:04.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.882+0000 7f13997fa640 10 client.25714 handle_command_reply: tid=0 2024-09-13T17:16:04.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.882+0000 7f13bae9e740 1 client.25714 shutdown 2024-09-13T17:16:04.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.882+0000 7f13bae9e740 1 -- 172.21.15.87:0/2244060760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559d6dc0a790 msgr2=0x559d6dc14ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:04.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.882+0000 7f13bae9e740 1 --2- 172.21.15.87:0/2244060760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559d6dc0a790 0x559d6dc14ed0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f13ac004650 tx=0x7f13ac004730 comp rx=0 tx=0).stop 2024-09-13T17:16:04.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.882+0000 7f13bae9e740 1 -- 172.21.15.87:0/2244060760 shutdown_connections 2024-09-13T17:16:04.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.882+0000 7f13bae9e740 1 --2- 172.21.15.87:0/2244060760 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x559d6dc25040 0x559d6dc27460 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.882+0000 7f13bae9e740 1 --2- 172.21.15.87:0/2244060760 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559d6dc15950 0x559d6dc12460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.882+0000 7f13bae9e740 1 --2- 172.21.15.87:0/2244060760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d6dc0b0b0 0x559d6dc15410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.882+0000 7f13bae9e740 1 --2- 172.21.15.87:0/2244060760 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559d6dc0a790 0x559d6dc14ed0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.882+0000 7f13997fa640 0 client.25714 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:16:04.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.882+0000 7f13bae9e740 1 -- 172.21.15.87:0/2244060760 >> 172.21.15.87:0/2244060760 conn(0x559d6dc06d00 msgr2=0x559d6dc05eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:04.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.883+0000 7f13bae9e740 1 -- 172.21.15.87:0/2244060760 shutdown_connections 2024-09-13T17:16:04.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.883+0000 7f13bae9e740 1 -- 172.21.15.87:0/2244060760 wait complete. 2024-09-13T17:16:04.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.883+0000 7f13bae9e740 20 client.25714 trim_cache size 0 max 16384 2024-09-13T17:16:04.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.896+0000 7f13bae9e740 1 Processor -- start 2024-09-13T17:16:04.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.896+0000 7f13bae9e740 1 -- start start 2024-09-13T17:16:04.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.896+0000 7f13bae9e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559d6dc0a790 0x559d6dc1c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.896+0000 7f13bae9e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d6dc0b0b0 0x559d6dc1c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.896+0000 7f13bae9e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559d6dc15950 0x559d6dc10ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.896+0000 7f13bae9e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d6dc07e70 con 0x559d6dc0b0b0 2024-09-13T17:16:04.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.896+0000 7f13bae9e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d6dc216b0 con 0x559d6dc15950 2024-09-13T17:16:04.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.896+0000 7f13bae9e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d6dc028e0 con 0x559d6dc0a790 2024-09-13T17:16:04.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.897+0000 7f13b5718640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d6dc0b0b0 0x559d6dc1c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.897+0000 7f13b5718640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d6dc0b0b0 0x559d6dc1c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:32910/0 (socket says 172.21.15.87:32910) 2024-09-13T17:16:04.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.897+0000 7f13b5718640 1 -- 172.21.15.87:0/2306011948 learned_addr learned my addr 172.21.15.87:0/2306011948 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:04.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.897+0000 7f13b5f19640 1 --2- 172.21.15.87:0/2306011948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559d6dc0a790 0x559d6dc1c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.897+0000 7f13b671a640 1 --2- 172.21.15.87:0/2306011948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559d6dc15950 0x559d6dc10ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.897+0000 7f13b5718640 1 -- 172.21.15.87:0/2306011948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559d6dc0a790 msgr2=0x559d6dc1c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:04.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.897+0000 7f13b5718640 1 --2- 172.21.15.87:0/2306011948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559d6dc0a790 0x559d6dc1c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.897+0000 7f13b5718640 1 -- 172.21.15.87:0/2306011948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559d6dc15950 msgr2=0x559d6dc10ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:04.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.897+0000 7f13b5718640 1 --2- 172.21.15.87:0/2306011948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559d6dc15950 0x559d6dc10ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.897+0000 7f13b5718640 1 -- 172.21.15.87:0/2306011948 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d6db0e770 con 0x559d6dc0b0b0 2024-09-13T17:16:04.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.897+0000 7f13b671a640 1 --2- 172.21.15.87:0/2306011948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559d6dc15950 0x559d6dc10ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:04.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.897+0000 7f13b5f19640 1 --2- 172.21.15.87:0/2306011948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559d6dc0a790 0x559d6dc1c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:04.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.897+0000 7f13b5718640 1 --2- 172.21.15.87:0/2306011948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d6dc0b0b0 0x559d6dc1c920 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x559d6dc07b60 tx=0x7f13a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb00b93ced028fa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:04.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.897+0000 7f13a4ff9640 1 -- 172.21.15.87:0/2306011948 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a00120d0 con 0x559d6dc0b0b0 2024-09-13T17:16:04.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.897+0000 7f13a4ff9640 1 -- 172.21.15.87:0/2306011948 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f13a0012230 con 0x559d6dc0b0b0 2024-09-13T17:16:04.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.897+0000 7f13a4ff9640 1 -- 172.21.15.87:0/2306011948 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a00047a0 con 0x559d6dc0b0b0 2024-09-13T17:16:04.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.898+0000 7f13bae9e740 1 -- 172.21.15.87:0/2306011948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d6dc0b0b0 msgr2=0x559d6dc1c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:04.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.898+0000 7f13bae9e740 1 --2- 172.21.15.87:0/2306011948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d6dc0b0b0 0x559d6dc1c920 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x559d6dc07b60 tx=0x7f13a00046c0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.898+0000 7f13bae9e740 1 -- 172.21.15.87:0/2306011948 shutdown_connections 2024-09-13T17:16:04.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.898+0000 7f13bae9e740 1 --2- 172.21.15.87:0/2306011948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559d6dc15950 0x559d6dc10ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.898+0000 7f13bae9e740 1 --2- 172.21.15.87:0/2306011948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d6dc0b0b0 0x559d6dc1c920 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.898+0000 7f13bae9e740 1 --2- 172.21.15.87:0/2306011948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559d6dc0a790 0x559d6dc1c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.898+0000 7f13bae9e740 1 -- 172.21.15.87:0/2306011948 >> 172.21.15.87:0/2306011948 conn(0x559d6dc06d00 msgr2=0x559d6dc2bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:04.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.898+0000 7f13bae9e740 1 -- 172.21.15.87:0/2306011948 shutdown_connections 2024-09-13T17:16:04.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.898+0000 7f13bae9e740 1 -- 172.21.15.87:0/2306011948 wait complete. 2024-09-13T17:16:04.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.899+0000 7f13bae9e740 1 -- start start 2024-09-13T17:16:04.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.899+0000 7f13bae9e740 1 Processor -- start 2024-09-13T17:16:04.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.899+0000 7f13bae9e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559d6dc0a790 0x559d6dc1c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.899+0000 7f13bae9e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559d6dc15950 0x559d6dc1a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.899+0000 7f13bae9e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d6dc1ae40 0x559d6dc1b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.899+0000 7f13bae9e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d6dc7b550 con 0x559d6dc1ae40 2024-09-13T17:16:04.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.899+0000 7f13bae9e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d6dc7b690 con 0x559d6dc15950 2024-09-13T17:16:04.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.899+0000 7f13bae9e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d6dc7b7d0 con 0x559d6dc0a790 2024-09-13T17:16:04.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.899+0000 7f13bae9e740 10 client.0 _ll_register_callbacks cb 0x7f13a8005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:04.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.900+0000 7f13b671a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d6dc1ae40 0x559d6dc1b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.900+0000 7f13b5718640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559d6dc15950 0x559d6dc1a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.900+0000 7f13b5f19640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559d6dc0a790 0x559d6dc1c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.900+0000 7f13b671a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d6dc1ae40 0x559d6dc1b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:32918/0 (socket says 172.21.15.87:32918) 2024-09-13T17:16:04.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.900+0000 7f13b671a640 1 -- 172.21.15.87:0/1379710291 learned_addr learned my addr 172.21.15.87:0/1379710291 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:04.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.900+0000 7f13b5f19640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559d6dc0a790 0x559d6dc1c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:44530/0 (socket says 172.21.15.87:44530) 2024-09-13T17:16:04.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.900+0000 7f13b671a640 1 -- 172.21.15.87:0/1379710291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559d6dc0a790 msgr2=0x559d6dc1c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:04.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.900+0000 7f13b671a640 1 --2- 172.21.15.87:0/1379710291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559d6dc0a790 0x559d6dc1c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.900+0000 7f13b671a640 1 -- 172.21.15.87:0/1379710291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559d6dc15950 msgr2=0x559d6dc1a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:04.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.900+0000 7f13b671a640 1 --2- 172.21.15.87:0/1379710291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559d6dc15950 0x559d6dc1a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.900+0000 7f13b671a640 1 -- 172.21.15.87:0/1379710291 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a001b040 con 0x559d6dc1ae40 2024-09-13T17:16:04.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.900+0000 7f13b5718640 1 --2- 172.21.15.87:0/1379710291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559d6dc15950 0x559d6dc1a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:16:04.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.900+0000 7f13b671a640 1 --2- 172.21.15.87:0/1379710291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d6dc1ae40 0x559d6dc1b2c0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f13a80bad30 tx=0x7f13a80baa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50bfda16840fe76e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:04.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.900+0000 7f13997fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:16:04.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.900+0000 7f13997fa640 1 -- 172.21.15.87:0/1379710291 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a80bb780 con 0x559d6dc1ae40 2024-09-13T17:16:04.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.900+0000 7f13997fa640 1 -- 172.21.15.87:0/1379710291 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f13a80c3500 con 0x559d6dc1ae40 2024-09-13T17:16:04.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.900+0000 7f13bae9e740 1 -- 172.21.15.87:0/1379710291 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f13a80babc0 con 0x559d6dc1ae40 2024-09-13T17:16:04.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.900+0000 7f13997fa640 1 -- 172.21.15.87:0/1379710291 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13a80beeb0 con 0x559d6dc1ae40 2024-09-13T17:16:04.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.900+0000 7f13bae9e740 10 client.16317 fetch_fsmap learned FSMap version 26 2024-09-13T17:16:04.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.900+0000 7f13bae9e740 1 -- 172.21.15.87:0/1379710291 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559d6db33e80 con 0x559d6dc1ae40 2024-09-13T17:16:04.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.901+0000 7f13997fa640 1 -- 172.21.15.87:0/1379710291 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f13a80babc0 con 0x559d6dc1ae40 2024-09-13T17:16:04.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.901+0000 7f13997fa640 1 -- 172.21.15.87:0/1379710291 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f13a804c060 con 0x559d6dc1ae40 2024-09-13T17:16:04.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.901+0000 7f13bae9e740 10 client.16317 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T17:16:04.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.901+0000 7f13bae9e740 10 client.16317 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:16:04.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.901+0000 7f13bae9e740 20 client.16317 populate_metadata read hostname 'smithi087' 2024-09-13T17:16:04.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.901+0000 7f13bae9e740 1 --2- 172.21.15.87:0/1379710291 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x559d6dc7c9e0 0x559d6dc7edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:04.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.901+0000 7f13bae9e740 4 client.16317 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:16:04.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.901+0000 7f13bae9e740 1 -- 172.21.15.87:0/1379710291 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559d6d8614e0 con 0x559d6dc7c9e0 2024-09-13T17:16:04.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.901+0000 7f13b5f19640 1 --2- 172.21.15.87:0/1379710291 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x559d6dc7c9e0 0x559d6dc7edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:04.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.902+0000 7f13b5f19640 1 --2- 172.21.15.87:0/1379710291 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x559d6dc7c9e0 0x559d6dc7edd0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ed76a060d85fc4c1 server_cookie=917723f383d85fa4 in_seq=0 out_seq=0 2024-09-13T17:16:04.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.902+0000 7f13997fa640 10 client.16317 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:16:04.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.902+0000 7f13997fa640 1 -- 172.21.15.87:0/1379710291 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559d6d8614e0 con 0x559d6dc7c9e0 2024-09-13T17:16:04.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.902+0000 7f13997fa640 10 client.16317 handle_command_reply: tid=0 2024-09-13T17:16:04.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.902+0000 7f13bae9e740 1 client.16317 shutdown 2024-09-13T17:16:04.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.902+0000 7f13bae9e740 1 -- 172.21.15.87:0/1379710291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d6dc1ae40 msgr2=0x559d6dc1b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:04.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.902+0000 7f13bae9e740 1 --2- 172.21.15.87:0/1379710291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d6dc1ae40 0x559d6dc1b2c0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f13a80bad30 tx=0x7f13a80baa50 comp rx=0 tx=0).stop 2024-09-13T17:16:04.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.902+0000 7f13bae9e740 1 -- 172.21.15.87:0/1379710291 shutdown_connections 2024-09-13T17:16:04.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.902+0000 7f13bae9e740 1 --2- 172.21.15.87:0/1379710291 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x559d6dc7c9e0 0x559d6dc7edd0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.902+0000 7f13bae9e740 1 --2- 172.21.15.87:0/1379710291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559d6dc1ae40 0x559d6dc1b2c0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.902+0000 7f13bae9e740 1 --2- 172.21.15.87:0/1379710291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559d6dc15950 0x559d6dc1a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.902+0000 7f13997fa640 0 client.16317 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:16:04.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.902+0000 7f13bae9e740 1 --2- 172.21.15.87:0/1379710291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559d6dc0a790 0x559d6dc1c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.902+0000 7f13bae9e740 1 -- 172.21.15.87:0/1379710291 >> 172.21.15.87:0/1379710291 conn(0x559d6dc06d00 msgr2=0x559d6dc0d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:04.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.902+0000 7f13bae9e740 1 -- 172.21.15.87:0/1379710291 shutdown_connections 2024-09-13T17:16:04.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.902+0000 7f13bae9e740 1 -- 172.21.15.87:0/1379710291 wait complete. 2024-09-13T17:16:04.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.902+0000 7f13bae9e740 20 client.16317 trim_cache size 0 max 16384 2024-09-13T17:16:04.911 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:16:04.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.903+0000 7f13b817d640 1 -- 172.21.15.87:0/72618075 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f139c0a1280 msgr2=0x7f139c0a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:04.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.903+0000 7f13b817d640 1 --2- 172.21.15.87:0/72618075 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f139c0a1280 0x7f139c0a3740 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f13ac009fc0 tx=0x7f13ac005f90 comp rx=0 tx=0).stop 2024-09-13T17:16:04.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.903+0000 7f13b817d640 1 -- 172.21.15.87:0/72618075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13b0104d00 msgr2=0x7f13b019ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:04.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.903+0000 7f13b817d640 1 --2- 172.21.15.87:0/72618075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13b0104d00 0x7f13b019ab70 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f13a8004af0 tx=0x7f13a8003e60 comp rx=0 tx=0).stop 2024-09-13T17:16:04.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.903+0000 7f13b817d640 1 -- 172.21.15.87:0/72618075 shutdown_connections 2024-09-13T17:16:04.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.903+0000 7f13b817d640 1 --2- 172.21.15.87:0/72618075 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f139c0a1280 0x7f139c0a3740 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.903+0000 7f13b817d640 1 --2- 172.21.15.87:0/72618075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13b0104d00 0x7f13b019ab70 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.903+0000 7f13b817d640 1 --2- 172.21.15.87:0/72618075 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13b00febc0 0x7f13b0196780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.903+0000 7f13b817d640 1 --2- 172.21.15.87:0/72618075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13b00fe220 0x7f13b0196240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:04.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.903+0000 7f13b817d640 1 -- 172.21.15.87:0/72618075 >> 172.21.15.87:0/72618075 conn(0x7f13b00753f0 msgr2=0x7f13b0102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:04.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.903+0000 7f13b817d640 1 -- 172.21.15.87:0/72618075 shutdown_connections 2024-09-13T17:16:04.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:04.903+0000 7f13b817d640 1 -- 172.21.15.87:0/72618075 wait complete. 2024-09-13T17:16:04.917 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-09-13T17:16:05.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.028+0000 7f014b6a3640 1 -- 172.21.15.87:0/44945219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01441050a0 msgr2=0x7f014410cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:05.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.028+0000 7f014b6a3640 1 --2- 172.21.15.87:0/44945219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01441050a0 0x7f014410cbf0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f013c009cd0 tx=0x7f013c02a8e0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.028+0000 7f014b6a3640 1 -- 172.21.15.87:0/44945219 shutdown_connections 2024-09-13T17:16:05.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.028+0000 7f014b6a3640 1 --2- 172.21.15.87:0/44945219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01441050a0 0x7f014410cbf0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.028+0000 7f014b6a3640 1 --2- 172.21.15.87:0/44945219 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0144100900 0x7f0144104940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.028+0000 7f014b6a3640 1 --2- 172.21.15.87:0/44945219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01440fff50 0x7f0144100330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.028+0000 7f014b6a3640 1 -- 172.21.15.87:0/44945219 >> 172.21.15.87:0/44945219 conn(0x7f01440fb9e0 msgr2=0x7f01440fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:05.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.028+0000 7f014b6a3640 1 -- 172.21.15.87:0/44945219 shutdown_connections 2024-09-13T17:16:05.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.028+0000 7f014b6a3640 1 -- 172.21.15.87:0/44945219 wait complete. 2024-09-13T17:16:05.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.029+0000 7f014b6a3640 1 Processor -- start 2024-09-13T17:16:05.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.029+0000 7f014b6a3640 1 -- start start 2024-09-13T17:16:05.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.029+0000 7f014b6a3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01440fff50 0x7f01441961a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.029+0000 7f014b6a3640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01441050a0 0x7f01441966e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.029+0000 7f014b6a3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f014419aad0 0x7f014419af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.029+0000 7f014b6a3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014419b4c0 con 0x7f014419aad0 2024-09-13T17:16:05.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.029+0000 7f014b6a3640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014419b630 con 0x7f01440fff50 2024-09-13T17:16:05.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.029+0000 7f014b6a3640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014419b7a0 con 0x7f01441050a0 2024-09-13T17:16:05.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.029+0000 7f0149c40640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f014419aad0 0x7f014419af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.029+0000 7f0149c40640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f014419aad0 0x7f014419af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:32942/0 (socket says 172.21.15.87:32942) 2024-09-13T17:16:05.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.029+0000 7f0149c40640 1 -- 172.21.15.87:0/1992899214 learned_addr learned my addr 172.21.15.87:0/1992899214 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:05.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.029+0000 7f0148c3e640 1 --2- 172.21.15.87:0/1992899214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01441050a0 0x7f01441966e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.029+0000 7f014943f640 1 --2- 172.21.15.87:0/1992899214 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01440fff50 0x7f01441961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.030+0000 7f0149c40640 1 -- 172.21.15.87:0/1992899214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01441050a0 msgr2=0x7f01441966e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:05.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.030+0000 7f0149c40640 1 --2- 172.21.15.87:0/1992899214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01441050a0 0x7f01441966e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.030+0000 7f0149c40640 1 -- 172.21.15.87:0/1992899214 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01440fff50 msgr2=0x7f01441961a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:05.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.030+0000 7f0149c40640 1 --2- 172.21.15.87:0/1992899214 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01440fff50 0x7f01441961a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.030+0000 7f0149c40640 1 -- 172.21.15.87:0/1992899214 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f013c009900 con 0x7f014419aad0 2024-09-13T17:16:05.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.030+0000 7f0149c40640 1 --2- 172.21.15.87:0/1992899214 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f014419aad0 0x7f014419af80 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f013c005cc0 tx=0x7f013c030850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:05.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.030+0000 7f013a7fc640 1 -- 172.21.15.87:0/1992899214 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c031c80 con 0x7f014419aad0 2024-09-13T17:16:05.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.030+0000 7f013a7fc640 1 -- 172.21.15.87:0/1992899214 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f013c003e20 con 0x7f014419aad0 2024-09-13T17:16:05.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.030+0000 7f014b6a3640 1 -- 172.21.15.87:0/1992899214 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01441a2d80 con 0x7f014419aad0 2024-09-13T17:16:05.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.030+0000 7f013a7fc640 1 -- 172.21.15.87:0/1992899214 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c03b400 con 0x7f014419aad0 2024-09-13T17:16:05.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.030+0000 7f014b6a3640 1 -- 172.21.15.87:0/1992899214 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01441a3230 con 0x7f014419aad0 2024-09-13T17:16:05.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.032+0000 7f013a7fc640 1 -- 172.21.15.87:0/1992899214 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f013c00a040 con 0x7f014419aad0 2024-09-13T17:16:05.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.032+0000 7f014e3cc740 1 Processor -- start 2024-09-13T17:16:05.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.033+0000 7f014e3cc740 1 -- start start 2024-09-13T17:16:05.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.033+0000 7f014e3cc740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ffe10c650 0x564ffe10ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.033+0000 7f014e3cc740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe10cf70 0x564ffe11b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.033+0000 7f014e3cc740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564ffe11bd60 0x564ffe11e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.033+0000 7f014e3cc740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ffe076cc0 con 0x564ffe10c650 2024-09-13T17:16:05.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.033+0000 7f014e3cc740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ffe074450 con 0x564ffe10cf70 2024-09-13T17:16:05.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.033+0000 7f014e3cc740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ffe06fd40 con 0x564ffe11bd60 2024-09-13T17:16:05.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.033+0000 7f0148c3e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ffe10c650 0x564ffe10ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.033+0000 7f0148c3e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ffe10c650 0x564ffe10ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:32956/0 (socket says 172.21.15.87:32956) 2024-09-13T17:16:05.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.033+0000 7f0148c3e640 1 -- 172.21.15.87:0/461692830 learned_addr learned my addr 172.21.15.87:0/461692830 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:05.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.033+0000 7f014943f640 1 --2- 172.21.15.87:0/461692830 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe10cf70 0x564ffe11b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.033+0000 7f0148c3e640 1 --2- 172.21.15.87:0/461692830 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564ffe11bd60 0x564ffe11e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.033+0000 7f013a7fc640 1 --2- 172.21.15.87:0/1992899214 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f01300a1280 0x7f01300a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.033+0000 7f014943f640 1 -- 172.21.15.87:0/461692830 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564ffe11bd60 msgr2=0x564ffe11e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:05.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.033+0000 7f014943f640 1 --2- 172.21.15.87:0/461692830 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564ffe11bd60 0x564ffe11e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.033+0000 7f014943f640 1 -- 172.21.15.87:0/461692830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ffe10c650 msgr2=0x564ffe10ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:05.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.033+0000 7f014943f640 1 --2- 172.21.15.87:0/461692830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ffe10c650 0x564ffe10ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.033+0000 7f014943f640 1 -- 172.21.15.87:0/461692830 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ffe037620 con 0x564ffe10cf70 2024-09-13T17:16:05.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.033+0000 7f0149c40640 1 --2- 172.21.15.87:0/1992899214 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f01300a1280 0x7f01300a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.033+0000 7f013a7fc640 1 -- 172.21.15.87:0/1992899214 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f013c0edfe0 con 0x7f014419aad0 2024-09-13T17:16:05.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.033+0000 7f014943f640 1 --2- 172.21.15.87:0/461692830 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe10cf70 0x564ffe11b820 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f014000abf0 tx=0x7f014000f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5510978794578185 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:05.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.034+0000 7f012f7fe640 1 -- 172.21.15.87:0/461692830 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0140005220 con 0x564ffe10cf70 2024-09-13T17:16:05.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.034+0000 7f012f7fe640 1 -- 172.21.15.87:0/461692830 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f01400047a0 con 0x564ffe10cf70 2024-09-13T17:16:05.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.034+0000 7f012f7fe640 1 -- 172.21.15.87:0/461692830 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01400186a0 con 0x564ffe10cf70 2024-09-13T17:16:05.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.034+0000 7f014e3cc740 1 -- 172.21.15.87:0/461692830 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe10cf70 msgr2=0x564ffe11b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:05.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.034+0000 7f0149c40640 1 --2- 172.21.15.87:0/1992899214 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f01300a1280 0x7f01300a3740 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f013c0eb430 tx=0x7f013c08df60 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:05.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.034+0000 7f014e3cc740 1 --2- 172.21.15.87:0/461692830 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe10cf70 0x564ffe11b820 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f014000abf0 tx=0x7f014000f790 comp rx=0 tx=0).stop 2024-09-13T17:16:05.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.034+0000 7f014e3cc740 1 -- 172.21.15.87:0/461692830 shutdown_connections 2024-09-13T17:16:05.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.034+0000 7f014e3cc740 1 --2- 172.21.15.87:0/461692830 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564ffe11bd60 0x564ffe11e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.034+0000 7f014e3cc740 1 --2- 172.21.15.87:0/461692830 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe10cf70 0x564ffe11b820 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.034+0000 7f014e3cc740 1 --2- 172.21.15.87:0/461692830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ffe10c650 0x564ffe10ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.034+0000 7f014e3cc740 1 -- 172.21.15.87:0/461692830 >> 172.21.15.87:0/461692830 conn(0x564ffe108d00 msgr2=0x564ffe1090e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:05.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.034+0000 7f014e3cc740 1 -- 172.21.15.87:0/461692830 shutdown_connections 2024-09-13T17:16:05.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.034+0000 7f014e3cc740 1 -- 172.21.15.87:0/461692830 wait complete. 2024-09-13T17:16:05.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.035+0000 7f014e3cc740 1 -- start start 2024-09-13T17:16:05.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.035+0000 7f014e3cc740 1 Processor -- start 2024-09-13T17:16:05.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.035+0000 7f014e3cc740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ffe10c650 0x564ffe11b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.035+0000 7f014e3cc740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564ffe10cf70 0x564ffe118720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.035+0000 7f014e3cc740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe11bd60 0x564ffe118c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.035+0000 7f014e3cc740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ffe02e180 con 0x564ffe10c650 2024-09-13T17:16:05.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.035+0000 7f014e3cc740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ffdd48430 con 0x564ffe11bd60 2024-09-13T17:16:05.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.035+0000 7f014e3cc740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ffdff35e0 con 0x564ffe10cf70 2024-09-13T17:16:05.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.035+0000 7f014e3cc740 10 client.0 _ll_register_callbacks cb 0x564ffe05faa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:05.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.035+0000 7f0148c3e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ffe10c650 0x564ffe11b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.035+0000 7f0148c3e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ffe10c650 0x564ffe11b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:32966/0 (socket says 172.21.15.87:32966) 2024-09-13T17:16:05.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.035+0000 7f0148c3e640 1 -- 172.21.15.87:0/1646773792 learned_addr learned my addr 172.21.15.87:0/1646773792 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:05.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.035+0000 7f014943f640 1 --2- 172.21.15.87:0/1646773792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564ffe10cf70 0x564ffe118720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.036+0000 7f0148c3e640 1 -- 172.21.15.87:0/1646773792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564ffe10cf70 msgr2=0x564ffe118720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:05.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.036+0000 7f0148c3e640 1 --2- 172.21.15.87:0/1646773792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564ffe10cf70 0x564ffe118720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.036+0000 7f0148c3e640 1 -- 172.21.15.87:0/1646773792 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe11bd60 msgr2=0x564ffe118c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:05.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.036+0000 7f0148c3e640 1 --2- 172.21.15.87:0/1646773792 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe11bd60 0x564ffe118c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.036+0000 7f0148c3e640 1 -- 172.21.15.87:0/1646773792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014000a820 con 0x564ffe10c650 2024-09-13T17:16:05.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.036+0000 7f0148c3e640 1 --2- 172.21.15.87:0/1646773792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ffe10c650 0x564ffe11b340 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f0134004630 tx=0x7f0134011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=609c1069498424b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:05.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.036+0000 7f012cff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:16:05.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.036+0000 7f012cff9640 1 -- 172.21.15.87:0/1646773792 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01340132c0 con 0x564ffe10c650 2024-09-13T17:16:05.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.036+0000 7f014e3cc740 1 -- 172.21.15.87:0/1646773792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564ffe099b80 con 0x564ffe10c650 2024-09-13T17:16:05.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.036+0000 7f012cff9640 1 -- 172.21.15.87:0/1646773792 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f01340047a0 con 0x564ffe10c650 2024-09-13T17:16:05.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.036+0000 7f012cff9640 1 -- 172.21.15.87:0/1646773792 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0134004960 con 0x564ffe10c650 2024-09-13T17:16:05.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.036+0000 7f014e3cc740 10 client.16329 fetch_fsmap learned FSMap version 26 2024-09-13T17:16:05.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.036+0000 7f014e3cc740 1 -- 172.21.15.87:0/1646773792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x564ffe06e3c0 con 0x564ffe10c650 2024-09-13T17:16:05.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.036+0000 7f012cff9640 1 -- 172.21.15.87:0/1646773792 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x564ffe099b80 con 0x564ffe10c650 2024-09-13T17:16:05.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.036+0000 7f012cff9640 1 -- 172.21.15.87:0/1646773792 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f013400f4c0 con 0x564ffe10c650 2024-09-13T17:16:05.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.036+0000 7f014e3cc740 10 client.16329 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T17:16:05.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.036+0000 7f014e3cc740 10 client.16329 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:16:05.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.036+0000 7f014e3cc740 20 client.16329 populate_metadata read hostname 'smithi087' 2024-09-13T17:16:05.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.036+0000 7f014e3cc740 1 --2- 172.21.15.87:0/1646773792 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x564ffe12b630 0x564ffe12da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.036+0000 7f014e3cc740 4 client.16329 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:16:05.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.036+0000 7f014e3cc740 1 -- 172.21.15.87:0/1646773792 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564ffe0621f0 con 0x564ffe12b630 2024-09-13T17:16:05.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.037+0000 7f014943f640 1 --2- 172.21.15.87:0/1646773792 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x564ffe12b630 0x564ffe12da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.037+0000 7f012cff9640 10 client.16329 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:16:05.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.037+0000 7f014943f640 1 --2- 172.21.15.87:0/1646773792 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x564ffe12b630 0x564ffe12da50 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3fdaa9bcda118c6e server_cookie=e59deb1a2ef842e in_seq=0 out_seq=0 2024-09-13T17:16:05.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.038+0000 7f012cff9640 1 -- 172.21.15.87:0/1646773792 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x564ffe0621f0 con 0x564ffe12b630 2024-09-13T17:16:05.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.038+0000 7f012cff9640 10 client.16329 handle_command_reply: tid=0 2024-09-13T17:16:05.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.038+0000 7f014e3cc740 1 client.16329 shutdown 2024-09-13T17:16:05.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.038+0000 7f014e3cc740 1 -- 172.21.15.87:0/1646773792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ffe10c650 msgr2=0x564ffe11b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:05.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.038+0000 7f014e3cc740 1 --2- 172.21.15.87:0/1646773792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ffe10c650 0x564ffe11b340 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f0134004630 tx=0x7f0134011810 comp rx=0 tx=0).stop 2024-09-13T17:16:05.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.038+0000 7f014e3cc740 1 -- 172.21.15.87:0/1646773792 shutdown_connections 2024-09-13T17:16:05.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.038+0000 7f014e3cc740 1 --2- 172.21.15.87:0/1646773792 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x564ffe12b630 0x564ffe12da50 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.039+0000 7f014e3cc740 1 --2- 172.21.15.87:0/1646773792 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe11bd60 0x564ffe118c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.039+0000 7f014e3cc740 1 --2- 172.21.15.87:0/1646773792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564ffe10cf70 0x564ffe118720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.039+0000 7f012cff9640 0 client.16329 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:16:05.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.039+0000 7f014e3cc740 1 --2- 172.21.15.87:0/1646773792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ffe10c650 0x564ffe11b340 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.039+0000 7f014e3cc740 1 -- 172.21.15.87:0/1646773792 >> 172.21.15.87:0/1646773792 conn(0x564ffe108d00 msgr2=0x564ffe107eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:05.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.039+0000 7f014e3cc740 1 -- 172.21.15.87:0/1646773792 shutdown_connections 2024-09-13T17:16:05.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.039+0000 7f014e3cc740 1 -- 172.21.15.87:0/1646773792 wait complete. 2024-09-13T17:16:05.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.039+0000 7f014e3cc740 20 client.16329 trim_cache size 0 max 16384 2024-09-13T17:16:05.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.050+0000 7f014e3cc740 1 Processor -- start 2024-09-13T17:16:05.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.050+0000 7f014e3cc740 1 -- start start 2024-09-13T17:16:05.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.050+0000 7f014e3cc740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe10c650 0x564ffe11ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.050+0000 7f014e3cc740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564ffe10cf70 0x564ffe11b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.050+0000 7f014e3cc740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ffe11bd60 0x564ffe1137c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.050+0000 7f014e3cc740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ffe099b80 con 0x564ffe11bd60 2024-09-13T17:16:05.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.050+0000 7f014e3cc740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ffe129fb0 con 0x564ffe10c650 2024-09-13T17:16:05.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.050+0000 7f014e3cc740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ffe11e810 con 0x564ffe10cf70 2024-09-13T17:16:05.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.050+0000 7f0148c3e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ffe11bd60 0x564ffe1137c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.050+0000 7f0148c3e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ffe11bd60 0x564ffe1137c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:32978/0 (socket says 172.21.15.87:32978) 2024-09-13T17:16:05.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.050+0000 7f0148c3e640 1 -- 172.21.15.87:0/3048741015 learned_addr learned my addr 172.21.15.87:0/3048741015 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:05.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.050+0000 7f014943f640 1 --2- 172.21.15.87:0/3048741015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564ffe10cf70 0x564ffe11b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.050+0000 7f0148c3e640 1 --2- 172.21.15.87:0/3048741015 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe10c650 0x564ffe11ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.050+0000 7f0148c3e640 1 -- 172.21.15.87:0/3048741015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564ffe10cf70 msgr2=0x564ffe11b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:05.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.050+0000 7f0148c3e640 1 --2- 172.21.15.87:0/3048741015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564ffe10cf70 0x564ffe11b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.050+0000 7f0148c3e640 1 -- 172.21.15.87:0/3048741015 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe10c650 msgr2=0x564ffe11ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:05.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.050+0000 7f0148c3e640 1 --2- 172.21.15.87:0/3048741015 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe10c650 0x564ffe11ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.050+0000 7f0148c3e640 1 -- 172.21.15.87:0/3048741015 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ffe010770 con 0x564ffe11bd60 2024-09-13T17:16:05.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.050+0000 7f0148c3e640 1 --2- 172.21.15.87:0/3048741015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ffe11bd60 0x564ffe1137c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f0134021040 tx=0x7f0134013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a486ef991b9f432e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:05.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.050+0000 7f012ffff640 1 -- 172.21.15.87:0/3048741015 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0134009880 con 0x564ffe11bd60 2024-09-13T17:16:05.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.051+0000 7f012ffff640 1 -- 172.21.15.87:0/3048741015 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f01340134f0 con 0x564ffe11bd60 2024-09-13T17:16:05.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.051+0000 7f012ffff640 1 -- 172.21.15.87:0/3048741015 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0134005650 con 0x564ffe11bd60 2024-09-13T17:16:05.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.051+0000 7f014e3cc740 1 -- 172.21.15.87:0/3048741015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ffe11bd60 msgr2=0x564ffe1137c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:05.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.051+0000 7f014e3cc740 1 --2- 172.21.15.87:0/3048741015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ffe11bd60 0x564ffe1137c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f0134021040 tx=0x7f0134013040 comp rx=0 tx=0).stop 2024-09-13T17:16:05.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.051+0000 7f014e3cc740 1 -- 172.21.15.87:0/3048741015 shutdown_connections 2024-09-13T17:16:05.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.051+0000 7f014e3cc740 1 --2- 172.21.15.87:0/3048741015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ffe11bd60 0x564ffe1137c0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.051+0000 7f014e3cc740 1 --2- 172.21.15.87:0/3048741015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564ffe10cf70 0x564ffe11b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.051+0000 7f014e3cc740 1 --2- 172.21.15.87:0/3048741015 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe10c650 0x564ffe11ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.051+0000 7f014e3cc740 1 -- 172.21.15.87:0/3048741015 >> 172.21.15.87:0/3048741015 conn(0x564ffe108d00 msgr2=0x564ffe116fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:05.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.051+0000 7f014e3cc740 1 -- 172.21.15.87:0/3048741015 shutdown_connections 2024-09-13T17:16:05.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.051+0000 7f014e3cc740 1 -- 172.21.15.87:0/3048741015 wait complete. 2024-09-13T17:16:05.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.051+0000 7f014e3cc740 1 -- start start 2024-09-13T17:16:05.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.051+0000 7f014e3cc740 1 Processor -- start 2024-09-13T17:16:05.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.052+0000 7f014e3cc740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ffe10c650 0x564ffe11fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.052+0000 7f014e3cc740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe10cf70 0x564ffe120300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.052+0000 7f014e3cc740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564ffe11bd60 0x564ffe17bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.052+0000 7f014e3cc740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ffe17c040 con 0x564ffe10c650 2024-09-13T17:16:05.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.052+0000 7f014e3cc740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ffe17c1b0 con 0x564ffe10cf70 2024-09-13T17:16:05.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.052+0000 7f014e3cc740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ffe17c370 con 0x564ffe11bd60 2024-09-13T17:16:05.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.052+0000 7f014e3cc740 10 client.0 _ll_register_callbacks cb 0x7f014000a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:05.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.052+0000 7f0148c3e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ffe10c650 0x564ffe11fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.052+0000 7f0148c3e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ffe10c650 0x564ffe11fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:32980/0 (socket says 172.21.15.87:32980) 2024-09-13T17:16:05.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.052+0000 7f0148c3e640 1 -- 172.21.15.87:0/3865168684 learned_addr learned my addr 172.21.15.87:0/3865168684 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:05.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.052+0000 7f014943f640 1 --2- 172.21.15.87:0/3865168684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe10cf70 0x564ffe120300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.052+0000 7f0148c3e640 1 --2- 172.21.15.87:0/3865168684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564ffe11bd60 0x564ffe17bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.052+0000 7f0148c3e640 1 -- 172.21.15.87:0/3865168684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564ffe11bd60 msgr2=0x564ffe17bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:05.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.052+0000 7f0148c3e640 1 --2- 172.21.15.87:0/3865168684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564ffe11bd60 0x564ffe17bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.052+0000 7f0148c3e640 1 -- 172.21.15.87:0/3865168684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe10cf70 msgr2=0x564ffe120300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:05.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.052+0000 7f0148c3e640 1 --2- 172.21.15.87:0/3865168684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe10cf70 0x564ffe120300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.052+0000 7f0148c3e640 1 -- 172.21.15.87:0/3865168684 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564ffe06e3c0 con 0x564ffe10c650 2024-09-13T17:16:05.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.052+0000 7f0148c3e640 1 --2- 172.21.15.87:0/3865168684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ffe10c650 0x564ffe11fdc0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0134013bc0 tx=0x7f0134013b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df2b3895a07692c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:05.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.052+0000 7f012cff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:16:05.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.052+0000 7f012cff9640 1 -- 172.21.15.87:0/3865168684 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013400fb10 con 0x564ffe10c650 2024-09-13T17:16:05.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.053+0000 7f012cff9640 1 -- 172.21.15.87:0/3865168684 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f0134000e40 con 0x564ffe10c650 2024-09-13T17:16:05.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.053+0000 7f014e3cc740 1 -- 172.21.15.87:0/3865168684 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f01400047a0 con 0x564ffe10c650 2024-09-13T17:16:05.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.053+0000 7f012cff9640 1 -- 172.21.15.87:0/3865168684 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0134005c50 con 0x564ffe10c650 2024-09-13T17:16:05.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.053+0000 7f014e3cc740 10 client.16335 fetch_fsmap learned FSMap version 26 2024-09-13T17:16:05.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.053+0000 7f014e3cc740 1 -- 172.21.15.87:0/3865168684 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x564ffe035e80 con 0x564ffe10c650 2024-09-13T17:16:05.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.053+0000 7f012cff9640 1 -- 172.21.15.87:0/3865168684 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f01400047a0 con 0x564ffe10c650 2024-09-13T17:16:05.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.053+0000 7f012cff9640 1 -- 172.21.15.87:0/3865168684 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f01340047a0 con 0x564ffe10c650 2024-09-13T17:16:05.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.053+0000 7f014e3cc740 10 client.16335 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T17:16:05.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.053+0000 7f014e3cc740 10 client.16335 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:16:05.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.053+0000 7f014e3cc740 20 client.16335 populate_metadata read hostname 'smithi087' 2024-09-13T17:16:05.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.053+0000 7f014e3cc740 1 --2- 172.21.15.87:0/3865168684 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x564ffe1837d0 0x564ffe185bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.053+0000 7f014e3cc740 4 client.16335 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:16:05.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.053+0000 7f014e3cc740 1 -- 172.21.15.87:0/3865168684 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564ffdd634e0 con 0x564ffe1837d0 2024-09-13T17:16:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.053+0000 7f014943f640 1 --2- 172.21.15.87:0/3865168684 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x564ffe1837d0 0x564ffe185bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.054+0000 7f012cff9640 10 client.16335 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:16:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.054+0000 7f014943f640 1 --2- 172.21.15.87:0/3865168684 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x564ffe1837d0 0x564ffe185bc0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cb6e9378e370ed23 server_cookie=c7e35bbe9fae5e17 in_seq=0 out_seq=0 2024-09-13T17:16:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.054+0000 7f012cff9640 1 -- 172.21.15.87:0/3865168684 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564ffdd634e0 con 0x564ffe1837d0 2024-09-13T17:16:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.054+0000 7f012cff9640 10 client.16335 handle_command_reply: tid=0 2024-09-13T17:16:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.054+0000 7f014e3cc740 1 client.16335 shutdown 2024-09-13T17:16:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.055+0000 7f014e3cc740 1 -- 172.21.15.87:0/3865168684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ffe10c650 msgr2=0x564ffe11fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.055+0000 7f014e3cc740 1 --2- 172.21.15.87:0/3865168684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ffe10c650 0x564ffe11fdc0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0134013bc0 tx=0x7f0134013b50 comp rx=0 tx=0).stop 2024-09-13T17:16:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.055+0000 7f014e3cc740 1 -- 172.21.15.87:0/3865168684 shutdown_connections 2024-09-13T17:16:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.055+0000 7f014e3cc740 1 --2- 172.21.15.87:0/3865168684 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x564ffe1837d0 0x564ffe185bc0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.055+0000 7f014e3cc740 1 --2- 172.21.15.87:0/3865168684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564ffe11bd60 0x564ffe17bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.055+0000 7f012cff9640 0 client.16335 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:16:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.055+0000 7f014e3cc740 1 --2- 172.21.15.87:0/3865168684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ffe10cf70 0x564ffe120300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.055+0000 7f014e3cc740 1 --2- 172.21.15.87:0/3865168684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ffe10c650 0x564ffe11fdc0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.055+0000 7f014e3cc740 1 -- 172.21.15.87:0/3865168684 >> 172.21.15.87:0/3865168684 conn(0x564ffe108d00 msgr2=0x564ffe1137c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:05.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.055+0000 7f014e3cc740 1 -- 172.21.15.87:0/3865168684 shutdown_connections 2024-09-13T17:16:05.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.055+0000 7f014e3cc740 1 -- 172.21.15.87:0/3865168684 wait complete. 2024-09-13T17:16:05.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.055+0000 7f014e3cc740 20 client.16335 trim_cache size 0 max 16384 2024-09-13T17:16:05.065 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:16:05.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.055+0000 7f014b6a3640 1 -- 172.21.15.87:0/1992899214 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f01300a1280 msgr2=0x7f01300a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:05.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.055+0000 7f014b6a3640 1 --2- 172.21.15.87:0/1992899214 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f01300a1280 0x7f01300a3740 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f013c0eb430 tx=0x7f013c08df60 comp rx=0 tx=0).stop 2024-09-13T17:16:05.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.055+0000 7f014b6a3640 1 -- 172.21.15.87:0/1992899214 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f014419aad0 msgr2=0x7f014419af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:05.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.055+0000 7f014b6a3640 1 --2- 172.21.15.87:0/1992899214 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f014419aad0 0x7f014419af80 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f013c005cc0 tx=0x7f013c030850 comp rx=0 tx=0).stop 2024-09-13T17:16:05.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.055+0000 7f014b6a3640 1 -- 172.21.15.87:0/1992899214 shutdown_connections 2024-09-13T17:16:05.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.055+0000 7f014b6a3640 1 --2- 172.21.15.87:0/1992899214 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f01300a1280 0x7f01300a3740 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.055+0000 7f014b6a3640 1 --2- 172.21.15.87:0/1992899214 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f014419aad0 0x7f014419af80 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.055+0000 7f014b6a3640 1 --2- 172.21.15.87:0/1992899214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01441050a0 0x7f01441966e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.055+0000 7f014b6a3640 1 --2- 172.21.15.87:0/1992899214 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01440fff50 0x7f01441961a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.055+0000 7f014b6a3640 1 -- 172.21.15.87:0/1992899214 >> 172.21.15.87:0/1992899214 conn(0x7f01440fb9e0 msgr2=0x7f01440fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:05.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.056+0000 7f014b6a3640 1 -- 172.21.15.87:0/1992899214 shutdown_connections 2024-09-13T17:16:05.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.056+0000 7f014b6a3640 1 -- 172.21.15.87:0/1992899214 wait complete. 2024-09-13T17:16:05.068 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:04 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/4239829737' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:16:05.069 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-09-13T17:16:05.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:04 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/4239829737' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:16:05.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:04 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/4239829737' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:16:05.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.175+0000 7fe353e19640 1 -- 172.21.15.87:0/3063139255 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe34c0fee60 msgr2=0x7fe34c0ff240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:05.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.175+0000 7fe353e19640 1 --2- 172.21.15.87:0/3063139255 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe34c0fee60 0x7fe34c0ff240 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe348009930 tx=0x7fe34802a420 comp rx=0 tx=0).stop 2024-09-13T17:16:05.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.175+0000 7fe353e19640 1 -- 172.21.15.87:0/3063139255 shutdown_connections 2024-09-13T17:16:05.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.175+0000 7fe353e19640 1 --2- 172.21.15.87:0/3063139255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe34c103fb0 0x7fe34c10bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.175+0000 7fe353e19640 1 --2- 172.21.15.87:0/3063139255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe34c0ff810 0x7fe34c103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.175+0000 7fe353e19640 1 --2- 172.21.15.87:0/3063139255 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe34c0fee60 0x7fe34c0ff240 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.175+0000 7fe353e19640 1 -- 172.21.15.87:0/3063139255 >> 172.21.15.87:0/3063139255 conn(0x7fe34c075c60 msgr2=0x7fe34c0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:05.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.175+0000 7fe353e19640 1 -- 172.21.15.87:0/3063139255 shutdown_connections 2024-09-13T17:16:05.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.175+0000 7fe353e19640 1 -- 172.21.15.87:0/3063139255 wait complete. 2024-09-13T17:16:05.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.176+0000 7fe353e19640 1 Processor -- start 2024-09-13T17:16:05.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.176+0000 7fe353e19640 1 -- start start 2024-09-13T17:16:05.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.176+0000 7fe353e19640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe34c0fee60 0x7fe34c196330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.176+0000 7fe353e19640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe34c103fb0 0x7fe34c196870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.176+0000 7fe353e19640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe34c19ac60 0x7fe34c19b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.176+0000 7fe353e19640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c19b650 con 0x7fe34c0fee60 2024-09-13T17:16:05.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.176+0000 7fe353e19640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c19b7c0 con 0x7fe34c103fb0 2024-09-13T17:16:05.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.176+0000 7fe353e19640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c19b930 con 0x7fe34c19ac60 2024-09-13T17:16:05.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.176+0000 7fe351bb5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe34c0fee60 0x7fe34c196330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.176+0000 7fe3523b6640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe34c19ac60 0x7fe34c19b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.176+0000 7fe351bb5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe34c0fee60 0x7fe34c196330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33000/0 (socket says 172.21.15.87:33000) 2024-09-13T17:16:05.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.176+0000 7fe351bb5640 1 -- 172.21.15.87:0/207916027 learned_addr learned my addr 172.21.15.87:0/207916027 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:05.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.176+0000 7fe3513b4640 1 --2- 172.21.15.87:0/207916027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe34c103fb0 0x7fe34c196870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.177+0000 7fe3513b4640 1 -- 172.21.15.87:0/207916027 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe34c19ac60 msgr2=0x7fe34c19b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:05.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.177+0000 7fe3513b4640 1 --2- 172.21.15.87:0/207916027 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe34c19ac60 0x7fe34c19b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.177+0000 7fe3513b4640 1 -- 172.21.15.87:0/207916027 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe34c0fee60 msgr2=0x7fe34c196330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:05.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.177+0000 7fe3513b4640 1 --2- 172.21.15.87:0/207916027 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe34c0fee60 0x7fe34c196330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.177+0000 7fe3513b4640 1 -- 172.21.15.87:0/207916027 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe348009560 con 0x7fe34c103fb0 2024-09-13T17:16:05.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.177+0000 7fe3523b6640 1 --2- 172.21.15.87:0/207916027 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe34c19ac60 0x7fe34c19b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:16:05.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.177+0000 7fe3513b4640 1 --2- 172.21.15.87:0/207916027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe34c103fb0 0x7fe34c196870 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe33c00e9c0 tx=0x7fe33c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:05.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.177+0000 7fe342ffd640 1 -- 172.21.15.87:0/207916027 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c00ccc0 con 0x7fe34c103fb0 2024-09-13T17:16:05.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.177+0000 7fe342ffd640 1 -- 172.21.15.87:0/207916027 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe33c00ce20 con 0x7fe34c103fb0 2024-09-13T17:16:05.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.177+0000 7fe353e19640 1 -- 172.21.15.87:0/207916027 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe34c1a2f10 con 0x7fe34c103fb0 2024-09-13T17:16:05.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.177+0000 7fe342ffd640 1 -- 172.21.15.87:0/207916027 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c018710 con 0x7fe34c103fb0 2024-09-13T17:16:05.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.177+0000 7fe353e19640 1 -- 172.21.15.87:0/207916027 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe34c1a3390 con 0x7fe34c103fb0 2024-09-13T17:16:05.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.180+0000 7fe342ffd640 1 -- 172.21.15.87:0/207916027 <== mon.2 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fe33c010430 con 0x7fe34c103fb0 2024-09-13T17:16:05.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.180+0000 7fe356c18740 1 Processor -- start 2024-09-13T17:16:05.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.180+0000 7fe356c18740 1 -- start start 2024-09-13T17:16:05.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.181+0000 7fe356c18740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56010ef594f0 0x56010ef598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.181+0000 7fe356c18740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56010ef59ea0 0x56010ef5d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.181+0000 7fe356c18740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56010ef5db60 0x56010ef5dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.181+0000 7fe356c18740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56010eeb9cc0 con 0x56010ef5db60 2024-09-13T17:16:05.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.181+0000 7fe356c18740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56010eeb7450 con 0x56010ef594f0 2024-09-13T17:16:05.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.181+0000 7fe356c18740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56010eeb2d40 con 0x56010ef59ea0 2024-09-13T17:16:05.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.181+0000 7fe3523b6640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56010ef594f0 0x56010ef598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.181+0000 7fe3523b6640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56010ef594f0 0x56010ef598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.87:54470/0 (socket says 172.21.15.87:54470) 2024-09-13T17:16:05.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.181+0000 7fe3523b6640 1 -- 172.21.15.87:0/3717763243 learned_addr learned my addr 172.21.15.87:0/3717763243 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:05.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.181+0000 7fe3513b4640 1 --2- 172.21.15.87:0/3717763243 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56010ef5db60 0x56010ef5dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.181+0000 7fe342ffd640 1 --2- 172.21.15.87:0/207916027 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe3380a1280 0x7fe3380a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.181+0000 7fe351bb5640 1 --2- 172.21.15.87:0/3717763243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56010ef59ea0 0x56010ef5d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.181+0000 7fe3523b6640 1 --2- 172.21.15.87:0/207916027 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe3380a1280 0x7fe3380a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.181+0000 7fe3523b6640 1 -- 172.21.15.87:0/3717763243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56010ef59ea0 msgr2=0x56010ef5d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:05.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.181+0000 7fe3523b6640 1 --2- 172.21.15.87:0/3717763243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56010ef59ea0 0x56010ef5d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.181+0000 7fe3523b6640 1 -- 172.21.15.87:0/3717763243 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56010ef5db60 msgr2=0x56010ef5dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:05.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.181+0000 7fe342ffd640 1 -- 172.21.15.87:0/207916027 <== mon.2 v2:172.21.15.118:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fe33c014070 con 0x7fe34c103fb0 2024-09-13T17:16:05.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.182+0000 7fe3523b6640 1 --2- 172.21.15.87:0/3717763243 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56010ef5db60 0x56010ef5dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.182+0000 7fe3523b6640 1 -- 172.21.15.87:0/3717763243 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56010ee7a620 con 0x56010ef594f0 2024-09-13T17:16:05.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.182+0000 7fe3513b4640 1 --2- 172.21.15.87:0/3717763243 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56010ef5db60 0x56010ef5dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:16:05.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.182+0000 7fe3523b6640 1 --2- 172.21.15.87:0/3717763243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56010ef594f0 0x56010ef598d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe344013e80 tx=0x7fe34400f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b56f61ee7155fa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:05.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.182+0000 7fe337fff640 1 -- 172.21.15.87:0/3717763243 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe344013880 con 0x56010ef594f0 2024-09-13T17:16:05.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.182+0000 7fe337fff640 1 -- 172.21.15.87:0/3717763243 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe34401f930 con 0x56010ef594f0 2024-09-13T17:16:05.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.182+0000 7fe337fff640 1 -- 172.21.15.87:0/3717763243 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe344010630 con 0x56010ef594f0 2024-09-13T17:16:05.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.182+0000 7fe3523b6640 1 --2- 172.21.15.87:0/207916027 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe3380a1280 0x7fe3380a3740 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe344024000 tx=0x7fe344022000 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:05.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.183+0000 7fe356c18740 1 -- 172.21.15.87:0/3717763243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56010ef594f0 msgr2=0x56010ef598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:05.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.183+0000 7fe356c18740 1 --2- 172.21.15.87:0/3717763243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56010ef594f0 0x56010ef598d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe344013e80 tx=0x7fe34400f790 comp rx=0 tx=0).stop 2024-09-13T17:16:05.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.183+0000 7fe356c18740 1 -- 172.21.15.87:0/3717763243 shutdown_connections 2024-09-13T17:16:05.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.183+0000 7fe356c18740 1 --2- 172.21.15.87:0/3717763243 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56010ef5db60 0x56010ef5dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.183+0000 7fe356c18740 1 --2- 172.21.15.87:0/3717763243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56010ef59ea0 0x56010ef5d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.183+0000 7fe356c18740 1 --2- 172.21.15.87:0/3717763243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56010ef594f0 0x56010ef598d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.183+0000 7fe356c18740 1 -- 172.21.15.87:0/3717763243 >> 172.21.15.87:0/3717763243 conn(0x56010ef4f660 msgr2=0x56010ef4b780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:05.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.183+0000 7fe356c18740 1 -- 172.21.15.87:0/3717763243 shutdown_connections 2024-09-13T17:16:05.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.183+0000 7fe356c18740 1 -- 172.21.15.87:0/3717763243 wait complete. 2024-09-13T17:16:05.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.183+0000 7fe356c18740 1 -- start start 2024-09-13T17:16:05.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.183+0000 7fe356c18740 1 Processor -- start 2024-09-13T17:16:05.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.184+0000 7fe356c18740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56010ef594f0 0x56010ef64fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.184+0000 7fe356c18740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56010ef59ea0 0x56010ef622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.184+0000 7fe356c18740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56010ef5db60 0x56010ef627e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.184+0000 7fe356c18740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56010ee71180 con 0x56010ef594f0 2024-09-13T17:16:05.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.184+0000 7fe356c18740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56010eb8b430 con 0x56010ef5db60 2024-09-13T17:16:05.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.184+0000 7fe356c18740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56010ee365e0 con 0x56010ef59ea0 2024-09-13T17:16:05.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.184+0000 7fe356c18740 10 client.0 _ll_register_callbacks cb 0x56010eea2aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:05.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.184+0000 7fe351bb5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56010ef594f0 0x56010ef64fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.184+0000 7fe351bb5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56010ef594f0 0x56010ef64fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33016/0 (socket says 172.21.15.87:33016) 2024-09-13T17:16:05.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.184+0000 7fe351bb5640 1 -- 172.21.15.87:0/1632534390 learned_addr learned my addr 172.21.15.87:0/1632534390 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:05.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.184+0000 7fe3513b4640 1 --2- 172.21.15.87:0/1632534390 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56010ef59ea0 0x56010ef622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.184+0000 7fe3523b6640 1 --2- 172.21.15.87:0/1632534390 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56010ef5db60 0x56010ef627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.184+0000 7fe351bb5640 1 -- 172.21.15.87:0/1632534390 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56010ef59ea0 msgr2=0x56010ef622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:05.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.184+0000 7fe351bb5640 1 --2- 172.21.15.87:0/1632534390 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56010ef59ea0 0x56010ef622a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.184+0000 7fe351bb5640 1 -- 172.21.15.87:0/1632534390 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56010ef5db60 msgr2=0x56010ef627e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:05.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.184+0000 7fe351bb5640 1 --2- 172.21.15.87:0/1632534390 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56010ef5db60 0x56010ef627e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.184+0000 7fe351bb5640 1 -- 172.21.15.87:0/1632534390 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe344013a60 con 0x56010ef594f0 2024-09-13T17:16:05.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.185+0000 7fe351bb5640 1 --2- 172.21.15.87:0/1632534390 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56010ef594f0 0x56010ef64fd0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe348005ab0 tx=0x7fe348031f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4425b102fc7c8a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:05.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.185+0000 7fe3357fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:16:05.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.185+0000 7fe3357fa640 1 -- 172.21.15.87:0/1632534390 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe348004240 con 0x56010ef594f0 2024-09-13T17:16:05.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.185+0000 7fe3357fa640 1 -- 172.21.15.87:0/1632534390 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fe3480043a0 con 0x56010ef594f0 2024-09-13T17:16:05.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.185+0000 7fe356c18740 1 -- 172.21.15.87:0/1632534390 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56010eedcb80 con 0x56010ef594f0 2024-09-13T17:16:05.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.185+0000 7fe3357fa640 1 -- 172.21.15.87:0/1632534390 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe348031850 con 0x56010ef594f0 2024-09-13T17:16:05.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.185+0000 7fe356c18740 10 client.16347 fetch_fsmap learned FSMap version 26 2024-09-13T17:16:05.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.185+0000 7fe356c18740 1 -- 172.21.15.87:0/1632534390 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56010eeb13c0 con 0x56010ef594f0 2024-09-13T17:16:05.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.186+0000 7fe3357fa640 1 -- 172.21.15.87:0/1632534390 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x56010eedcb80 con 0x56010ef594f0 2024-09-13T17:16:05.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.186+0000 7fe3357fa640 1 -- 172.21.15.87:0/1632534390 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fe348050630 con 0x56010ef594f0 2024-09-13T17:16:05.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.186+0000 7fe356c18740 10 client.16347 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T17:16:05.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.186+0000 7fe356c18740 10 client.16347 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:16:05.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.186+0000 7fe356c18740 20 client.16347 populate_metadata read hostname 'smithi087' 2024-09-13T17:16:05.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.186+0000 7fe356c18740 1 --2- 172.21.15.87:0/1632534390 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56010ef72c20 0x56010ef75040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.186+0000 7fe356c18740 4 client.16347 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:16:05.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.186+0000 7fe356c18740 1 -- 172.21.15.87:0/1632534390 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56010eea51f0 con 0x56010ef72c20 2024-09-13T17:16:05.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.186+0000 7fe3513b4640 1 --2- 172.21.15.87:0/1632534390 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56010ef72c20 0x56010ef75040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.187+0000 7fe3513b4640 1 --2- 172.21.15.87:0/1632534390 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56010ef72c20 0x56010ef75040 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b81b109811535df9 server_cookie=ddbdbb262fa04092 in_seq=0 out_seq=0 2024-09-13T17:16:05.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.187+0000 7fe3357fa640 10 client.16347 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:05.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.187+0000 7fe3357fa640 1 -- 172.21.15.87:0/1632534390 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x56010eea51f0 con 0x56010ef72c20 2024-09-13T17:16:05.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.187+0000 7fe3357fa640 10 client.16347 handle_command_reply: tid=0 2024-09-13T17:16:05.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.187+0000 7fe356c18740 1 client.16347 shutdown 2024-09-13T17:16:05.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.187+0000 7fe356c18740 1 -- 172.21.15.87:0/1632534390 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56010ef594f0 msgr2=0x56010ef64fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:05.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.187+0000 7fe356c18740 1 --2- 172.21.15.87:0/1632534390 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56010ef594f0 0x56010ef64fd0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe348005ab0 tx=0x7fe348031f90 comp rx=0 tx=0).stop 2024-09-13T17:16:05.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.188+0000 7fe356c18740 1 -- 172.21.15.87:0/1632534390 shutdown_connections 2024-09-13T17:16:05.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.188+0000 7fe356c18740 1 --2- 172.21.15.87:0/1632534390 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56010ef72c20 0x56010ef75040 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.188+0000 7fe356c18740 1 --2- 172.21.15.87:0/1632534390 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56010ef5db60 0x56010ef627e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.188+0000 7fe356c18740 1 --2- 172.21.15.87:0/1632534390 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56010ef59ea0 0x56010ef622a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.188+0000 7fe356c18740 1 --2- 172.21.15.87:0/1632534390 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56010ef594f0 0x56010ef64fd0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.188+0000 7fe356c18740 1 -- 172.21.15.87:0/1632534390 >> 172.21.15.87:0/1632534390 conn(0x56010ef4f660 msgr2=0x56010ef58b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:05.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.188+0000 7fe3357fa640 0 client.16347 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:05.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.188+0000 7fe356c18740 1 -- 172.21.15.87:0/1632534390 shutdown_connections 2024-09-13T17:16:05.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.188+0000 7fe356c18740 1 -- 172.21.15.87:0/1632534390 wait complete. 2024-09-13T17:16:05.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.188+0000 7fe356c18740 20 client.16347 trim_cache size 0 max 16384 2024-09-13T17:16:05.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.201+0000 7fe356c18740 1 Processor -- start 2024-09-13T17:16:05.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.201+0000 7fe356c18740 1 -- start start 2024-09-13T17:16:05.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.201+0000 7fe356c18740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56010ef594f0 0x56010ef5fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.201+0000 7fe356c18740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56010ef59ea0 0x56010ef5ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.201+0000 7fe356c18740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56010ef5db60 0x56010ef4b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.201+0000 7fe356c18740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56010ef4c270 con 0x56010ef5db60 2024-09-13T17:16:05.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.201+0000 7fe356c18740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56010ef5f490 con 0x56010ef594f0 2024-09-13T17:16:05.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.201+0000 7fe356c18740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56010ef59c10 con 0x56010ef59ea0 2024-09-13T17:16:05.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.201+0000 7fe3523b6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56010ef5db60 0x56010ef4b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.201+0000 7fe3523b6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56010ef5db60 0x56010ef4b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33018/0 (socket says 172.21.15.87:33018) 2024-09-13T17:16:05.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.201+0000 7fe3523b6640 1 -- 172.21.15.87:0/513702545 learned_addr learned my addr 172.21.15.87:0/513702545 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:05.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.201+0000 7fe3513b4640 1 --2- 172.21.15.87:0/513702545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56010ef59ea0 0x56010ef5ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.201+0000 7fe351bb5640 1 --2- 172.21.15.87:0/513702545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56010ef594f0 0x56010ef5fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.202+0000 7fe3523b6640 1 -- 172.21.15.87:0/513702545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56010ef59ea0 msgr2=0x56010ef5ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:05.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.202+0000 7fe3523b6640 1 --2- 172.21.15.87:0/513702545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56010ef59ea0 0x56010ef5ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.202+0000 7fe3523b6640 1 -- 172.21.15.87:0/513702545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56010ef594f0 msgr2=0x56010ef5fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:05.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.202+0000 7fe3523b6640 1 --2- 172.21.15.87:0/513702545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56010ef594f0 0x56010ef5fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.202+0000 7fe3523b6640 1 -- 172.21.15.87:0/513702545 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56010ee53770 con 0x56010ef5db60 2024-09-13T17:16:05.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.202+0000 7fe3513b4640 1 --2- 172.21.15.87:0/513702545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56010ef59ea0 0x56010ef5ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:05.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.202+0000 7fe351bb5640 1 --2- 172.21.15.87:0/513702545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56010ef594f0 0x56010ef5fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:05.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.202+0000 7fe3523b6640 1 --2- 172.21.15.87:0/513702545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56010ef5db60 0x56010ef4b6a0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fe34400a010 tx=0x7fe344005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=266b114a64cc8818 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:05.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.202+0000 7fe340ff9640 1 -- 172.21.15.87:0/513702545 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3440120a0 con 0x56010ef5db60 2024-09-13T17:16:05.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.203+0000 7fe340ff9640 1 -- 172.21.15.87:0/513702545 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe344012200 con 0x56010ef5db60 2024-09-13T17:16:05.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.203+0000 7fe340ff9640 1 -- 172.21.15.87:0/513702545 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe344004c60 con 0x56010ef5db60 2024-09-13T17:16:05.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.203+0000 7fe356c18740 1 -- 172.21.15.87:0/513702545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56010ef5db60 msgr2=0x56010ef4b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:05.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.203+0000 7fe356c18740 1 --2- 172.21.15.87:0/513702545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56010ef5db60 0x56010ef4b6a0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fe34400a010 tx=0x7fe344005fb0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.203+0000 7fe356c18740 1 -- 172.21.15.87:0/513702545 shutdown_connections 2024-09-13T17:16:05.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.203+0000 7fe356c18740 1 --2- 172.21.15.87:0/513702545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56010ef5db60 0x56010ef4b6a0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.203+0000 7fe356c18740 1 --2- 172.21.15.87:0/513702545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56010ef59ea0 0x56010ef5ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.203+0000 7fe356c18740 1 --2- 172.21.15.87:0/513702545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56010ef594f0 0x56010ef5fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.203+0000 7fe356c18740 1 -- 172.21.15.87:0/513702545 >> 172.21.15.87:0/513702545 conn(0x56010ef4f660 msgr2=0x56010ef5f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:05.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.203+0000 7fe356c18740 1 -- 172.21.15.87:0/513702545 shutdown_connections 2024-09-13T17:16:05.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.203+0000 7fe356c18740 1 -- 172.21.15.87:0/513702545 wait complete. 2024-09-13T17:16:05.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.204+0000 7fe356c18740 1 -- start start 2024-09-13T17:16:05.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.204+0000 7fe356c18740 1 Processor -- start 2024-09-13T17:16:05.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.204+0000 7fe356c18740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56010ef594f0 0x56010ef6a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.204+0000 7fe356c18740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56010ef59ea0 0x56010ef5aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.204+0000 7fe356c18740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56010ef5db60 0x56010ef5af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.204+0000 7fe356c18740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56010ef6a760 con 0x56010ef5db60 2024-09-13T17:16:05.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.204+0000 7fe356c18740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56010ef5b4d0 con 0x56010ef59ea0 2024-09-13T17:16:05.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.204+0000 7fe356c18740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56010ef5b690 con 0x56010ef594f0 2024-09-13T17:16:05.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.204+0000 7fe356c18740 10 client.0 _ll_register_callbacks cb 0x7fe344009ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:05.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.204+0000 7fe3523b6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56010ef5db60 0x56010ef5af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.204+0000 7fe3523b6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56010ef5db60 0x56010ef5af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33022/0 (socket says 172.21.15.87:33022) 2024-09-13T17:16:05.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.204+0000 7fe3523b6640 1 -- 172.21.15.87:0/534953092 learned_addr learned my addr 172.21.15.87:0/534953092 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:05.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.204+0000 7fe351bb5640 1 --2- 172.21.15.87:0/534953092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56010ef594f0 0x56010ef6a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.205+0000 7fe3513b4640 1 --2- 172.21.15.87:0/534953092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56010ef59ea0 0x56010ef5aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.205+0000 7fe3523b6640 1 -- 172.21.15.87:0/534953092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56010ef594f0 msgr2=0x56010ef6a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:05.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.205+0000 7fe3523b6640 1 --2- 172.21.15.87:0/534953092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56010ef594f0 0x56010ef6a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.205+0000 7fe3523b6640 1 -- 172.21.15.87:0/534953092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56010ef59ea0 msgr2=0x56010ef5aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:05.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.205+0000 7fe3523b6640 1 --2- 172.21.15.87:0/534953092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56010ef59ea0 0x56010ef5aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.205+0000 7fe3523b6640 1 -- 172.21.15.87:0/534953092 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56010ee7a620 con 0x56010ef5db60 2024-09-13T17:16:05.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.205+0000 7fe3523b6640 1 --2- 172.21.15.87:0/534953092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56010ef5db60 0x56010ef5af60 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fe344000f80 tx=0x7fe34401fd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=948adb0afe3c5617 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:05.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.205+0000 7fe3357fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:16:05.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.205+0000 7fe3357fa640 1 -- 172.21.15.87:0/534953092 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34403b070 con 0x56010ef5db60 2024-09-13T17:16:05.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.205+0000 7fe3357fa640 1 -- 172.21.15.87:0/534953092 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fe34401faa0 con 0x56010ef5db60 2024-09-13T17:16:05.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.205+0000 7fe356c18740 1 -- 172.21.15.87:0/534953092 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe34401f930 con 0x56010ef5db60 2024-09-13T17:16:05.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.205+0000 7fe3357fa640 1 -- 172.21.15.87:0/534953092 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe344010640 con 0x56010ef5db60 2024-09-13T17:16:05.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.205+0000 7fe356c18740 10 client.16353 fetch_fsmap learned FSMap version 26 2024-09-13T17:16:05.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.205+0000 7fe356c18740 1 -- 172.21.15.87:0/534953092 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56010ee78e80 con 0x56010ef5db60 2024-09-13T17:16:05.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.205+0000 7fe3357fa640 1 -- 172.21.15.87:0/534953092 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe344043080 con 0x56010ef5db60 2024-09-13T17:16:05.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.206+0000 7fe3357fa640 1 -- 172.21.15.87:0/534953092 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fe34403e030 con 0x56010ef5db60 2024-09-13T17:16:05.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.206+0000 7fe356c18740 10 client.16353 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T17:16:05.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.206+0000 7fe356c18740 10 client.16353 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:16:05.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.206+0000 7fe356c18740 20 client.16353 populate_metadata read hostname 'smithi087' 2024-09-13T17:16:05.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.206+0000 7fe356c18740 1 --2- 172.21.15.87:0/534953092 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56010efca230 0x56010efcc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:05.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.206+0000 7fe356c18740 4 client.16353 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:16:05.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.206+0000 7fe356c18740 1 -- 172.21.15.87:0/534953092 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56010eba64e0 con 0x56010efca230 2024-09-13T17:16:05.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.206+0000 7fe351bb5640 1 --2- 172.21.15.87:0/534953092 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56010efca230 0x56010efcc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:05.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.206+0000 7fe3357fa640 10 client.16353 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:05.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.206+0000 7fe351bb5640 1 --2- 172.21.15.87:0/534953092 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56010efca230 0x56010efcc650 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52b0a3174a8586b6 server_cookie=3339def06bd03add in_seq=0 out_seq=0 2024-09-13T17:16:05.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.206+0000 7fe3357fa640 1 -- 172.21.15.87:0/534953092 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56010eba64e0 con 0x56010efca230 2024-09-13T17:16:05.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.206+0000 7fe3357fa640 10 client.16353 handle_command_reply: tid=0 2024-09-13T17:16:05.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.206+0000 7fe356c18740 1 client.16353 shutdown 2024-09-13T17:16:05.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.207+0000 7fe356c18740 1 -- 172.21.15.87:0/534953092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56010ef5db60 msgr2=0x56010ef5af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:05.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.207+0000 7fe356c18740 1 --2- 172.21.15.87:0/534953092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56010ef5db60 0x56010ef5af60 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fe344000f80 tx=0x7fe34401fd50 comp rx=0 tx=0).stop 2024-09-13T17:16:05.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.207+0000 7fe356c18740 1 -- 172.21.15.87:0/534953092 shutdown_connections 2024-09-13T17:16:05.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.207+0000 7fe356c18740 1 --2- 172.21.15.87:0/534953092 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56010efca230 0x56010efcc650 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.207+0000 7fe356c18740 1 --2- 172.21.15.87:0/534953092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56010ef5db60 0x56010ef5af60 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.207+0000 7fe356c18740 1 --2- 172.21.15.87:0/534953092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56010ef59ea0 0x56010ef5aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.207+0000 7fe3357fa640 0 client.16353 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:05.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.207+0000 7fe356c18740 1 --2- 172.21.15.87:0/534953092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56010ef594f0 0x56010ef6a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.207+0000 7fe356c18740 1 -- 172.21.15.87:0/534953092 >> 172.21.15.87:0/534953092 conn(0x56010ef4f660 msgr2=0x56010ef582f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:05.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.207+0000 7fe356c18740 1 -- 172.21.15.87:0/534953092 shutdown_connections 2024-09-13T17:16:05.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.207+0000 7fe356c18740 1 -- 172.21.15.87:0/534953092 wait complete. 2024-09-13T17:16:05.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.207+0000 7fe356c18740 20 client.16353 trim_cache size 0 max 16384 2024-09-13T17:16:05.215 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:16:05.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.207+0000 7fe353e19640 1 -- 172.21.15.87:0/207916027 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe3380a1280 msgr2=0x7fe3380a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:05.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.207+0000 7fe353e19640 1 --2- 172.21.15.87:0/207916027 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe3380a1280 0x7fe3380a3740 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe344024000 tx=0x7fe344022000 comp rx=0 tx=0).stop 2024-09-13T17:16:05.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.207+0000 7fe353e19640 1 -- 172.21.15.87:0/207916027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe34c103fb0 msgr2=0x7fe34c196870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:05.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.207+0000 7fe353e19640 1 --2- 172.21.15.87:0/207916027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe34c103fb0 0x7fe34c196870 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe33c00e9c0 tx=0x7fe33c00ee80 comp rx=0 tx=0).stop 2024-09-13T17:16:05.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.208+0000 7fe353e19640 1 -- 172.21.15.87:0/207916027 shutdown_connections 2024-09-13T17:16:05.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.208+0000 7fe353e19640 1 --2- 172.21.15.87:0/207916027 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe34c19ac60 0x7fe34c19b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.208+0000 7fe353e19640 1 --2- 172.21.15.87:0/207916027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe34c103fb0 0x7fe34c196870 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.208+0000 7fe353e19640 1 --2- 172.21.15.87:0/207916027 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe3380a1280 0x7fe3380a3740 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.208+0000 7fe353e19640 1 --2- 172.21.15.87:0/207916027 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe34c0fee60 0x7fe34c196330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:05.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.208+0000 7fe353e19640 1 -- 172.21.15.87:0/207916027 >> 172.21.15.87:0/207916027 conn(0x7fe34c075c60 msgr2=0x7fe34c067780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:05.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.208+0000 7fe353e19640 1 -- 172.21.15.87:0/207916027 shutdown_connections 2024-09-13T17:16:05.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:05.208+0000 7fe353e19640 1 -- 172.21.15.87:0/207916027 wait complete. 2024-09-13T17:16:06.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:05 smithi118 ceph-mon[34374]: pgmap v71: 129 pgs: 129 active+clean; 154 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 578 op/s 2024-09-13T17:16:06.222 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-13T17:16:06.222 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-09-13T17:16:06.228 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:05 smithi087 ceph-mon[30934]: pgmap v71: 129 pgs: 129 active+clean; 154 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 578 op/s 2024-09-13T17:16:06.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.337+0000 7fba71b45640 1 -- 172.21.15.87:0/3068086622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba6c0fff70 msgr2=0x7fba6c100350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:06.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.337+0000 7fba71b45640 1 --2- 172.21.15.87:0/3068086622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba6c0fff70 0x7fba6c100350 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fba5c009930 tx=0x7fba5c02a420 comp rx=0 tx=0).stop 2024-09-13T17:16:06.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.337+0000 7fba71b45640 1 -- 172.21.15.87:0/3068086622 shutdown_connections 2024-09-13T17:16:06.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.337+0000 7fba71b45640 1 --2- 172.21.15.87:0/3068086622 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba6c1050c0 0x7fba6c10cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.337+0000 7fba71b45640 1 --2- 172.21.15.87:0/3068086622 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba6c100920 0x7fba6c104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.337+0000 7fba71b45640 1 --2- 172.21.15.87:0/3068086622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba6c0fff70 0x7fba6c100350 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.337+0000 7fba71b45640 1 -- 172.21.15.87:0/3068086622 >> 172.21.15.87:0/3068086622 conn(0x7fba6c0fb9e0 msgr2=0x7fba6c0fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:06.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.337+0000 7fba71b45640 1 -- 172.21.15.87:0/3068086622 shutdown_connections 2024-09-13T17:16:06.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.337+0000 7fba71b45640 1 -- 172.21.15.87:0/3068086622 wait complete. 2024-09-13T17:16:06.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.338+0000 7fba71b45640 1 Processor -- start 2024-09-13T17:16:06.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.338+0000 7fba71b45640 1 -- start start 2024-09-13T17:16:06.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.339+0000 7fba71b45640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba6c0fff70 0x7fba6c1962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.339+0000 7fba71b45640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba6c1050c0 0x7fba6c1967e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.339+0000 7fba71b45640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba6c19abd0 0x7fba6c19b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.339+0000 7fba71b45640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6c19b5c0 con 0x7fba6c19abd0 2024-09-13T17:16:06.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.339+0000 7fba71b45640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6c19b730 con 0x7fba6c0fff70 2024-09-13T17:16:06.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.339+0000 7fba71b45640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6c19b8a0 con 0x7fba6c1050c0 2024-09-13T17:16:06.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.339+0000 7fba6affd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba6c1050c0 0x7fba6c1967e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.339+0000 7fba6b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba6c0fff70 0x7fba6c1962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.339+0000 7fba6affd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba6c1050c0 0x7fba6c1967e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:44650/0 (socket says 172.21.15.87:44650) 2024-09-13T17:16:06.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.339+0000 7fba6b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba6c0fff70 0x7fba6c1962a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.87:54500/0 (socket says 172.21.15.87:54500) 2024-09-13T17:16:06.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.339+0000 7fba6affd640 1 -- 172.21.15.87:0/4164228333 learned_addr learned my addr 172.21.15.87:0/4164228333 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:06.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.339+0000 7fba6bfff640 1 --2- 172.21.15.87:0/4164228333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba6c19abd0 0x7fba6c19b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.339+0000 7fba6affd640 1 -- 172.21.15.87:0/4164228333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba6c0fff70 msgr2=0x7fba6c1962a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:06.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.339+0000 7fba6affd640 1 --2- 172.21.15.87:0/4164228333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba6c0fff70 0x7fba6c1962a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.339+0000 7fba6affd640 1 -- 172.21.15.87:0/4164228333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba6c19abd0 msgr2=0x7fba6c19b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:06.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.339+0000 7fba6affd640 1 --2- 172.21.15.87:0/4164228333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba6c19abd0 0x7fba6c19b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.339+0000 7fba6affd640 1 -- 172.21.15.87:0/4164228333 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5c009560 con 0x7fba6c1050c0 2024-09-13T17:16:06.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.339+0000 7fba6b7fe640 1 --2- 172.21.15.87:0/4164228333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba6c0fff70 0x7fba6c1962a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:16:06.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.340+0000 7fba6affd640 1 --2- 172.21.15.87:0/4164228333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba6c1050c0 0x7fba6c1967e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fba60009f20 tx=0x7fba6000ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:06.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.340+0000 7fba68ff9640 1 -- 172.21.15.87:0/4164228333 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba60009700 con 0x7fba6c1050c0 2024-09-13T17:16:06.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.340+0000 7fba68ff9640 1 -- 172.21.15.87:0/4164228333 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fba6000cd00 con 0x7fba6c1050c0 2024-09-13T17:16:06.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.340+0000 7fba68ff9640 1 -- 172.21.15.87:0/4164228333 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba60021440 con 0x7fba6c1050c0 2024-09-13T17:16:06.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.340+0000 7fba71b45640 1 -- 172.21.15.87:0/4164228333 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba6c069ed0 con 0x7fba6c1050c0 2024-09-13T17:16:06.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.340+0000 7fba71b45640 1 -- 172.21.15.87:0/4164228333 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba6c06a380 con 0x7fba6c1050c0 2024-09-13T17:16:06.344 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:05 smithi149 ceph-mon[35496]: pgmap v71: 129 pgs: 129 active+clean; 154 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 578 op/s 2024-09-13T17:16:06.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.343+0000 7fba74865740 1 Processor -- start 2024-09-13T17:16:06.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.343+0000 7fba68ff9640 1 -- 172.21.15.87:0/4164228333 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fba60004f80 con 0x7fba6c1050c0 2024-09-13T17:16:06.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.343+0000 7fba74865740 1 -- start start 2024-09-13T17:16:06.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.343+0000 7fba74865740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559b76d4a7c0 0x559b76d4aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.343+0000 7fba74865740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b76d4b0e0 0x559b76d55440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.343+0000 7fba74865740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559b76d55980 0x559b76d57d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.343+0000 7fba74865740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b76cb5c60 con 0x559b76d4a7c0 2024-09-13T17:16:06.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.343+0000 7fba74865740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b76cb33f0 con 0x559b76d4b0e0 2024-09-13T17:16:06.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.343+0000 7fba74865740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b76caece0 con 0x559b76d55980 2024-09-13T17:16:06.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.343+0000 7fba6bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559b76d4a7c0 0x559b76d4aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.343+0000 7fba6b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b76d4b0e0 0x559b76d55440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.343+0000 7fba6bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559b76d4a7c0 0x559b76d4aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33038/0 (socket says 172.21.15.87:33038) 2024-09-13T17:16:06.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.343+0000 7fba6b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b76d4b0e0 0x559b76d55440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.87:54504/0 (socket says 172.21.15.87:54504) 2024-09-13T17:16:06.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.343+0000 7fba6bfff640 1 -- 172.21.15.87:0/1730166691 learned_addr learned my addr 172.21.15.87:0/1730166691 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:06.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.344+0000 7fba6affd640 1 --2- 172.21.15.87:0/1730166691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559b76d55980 0x559b76d57d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.344+0000 7fba6b7fe640 1 -- 172.21.15.87:0/1730166691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559b76d55980 msgr2=0x559b76d57d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:06.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.344+0000 7fba6b7fe640 1 --2- 172.21.15.87:0/1730166691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559b76d55980 0x559b76d57d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.344+0000 7fba6b7fe640 1 -- 172.21.15.87:0/1730166691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559b76d4a7c0 msgr2=0x559b76d4aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:06.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.344+0000 7fba6b7fe640 1 --2- 172.21.15.87:0/1730166691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559b76d4a7c0 0x559b76d4aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.344+0000 7fba6b7fe640 1 -- 172.21.15.87:0/1730166691 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b76c6a970 con 0x559b76d4b0e0 2024-09-13T17:16:06.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.344+0000 7fba6affd640 1 --2- 172.21.15.87:0/1730166691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559b76d55980 0x559b76d57d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:06.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.344+0000 7fba68ff9640 1 --2- 172.21.15.87:0/4164228333 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fba540a1280 0x7fba540a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.344+0000 7fba6b7fe640 1 --2- 172.21.15.87:0/1730166691 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b76d4b0e0 0x559b76d55440 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fba5c02a940 tx=0x7fba5c005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8dfbca60e35a8039 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:06.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.344+0000 7fba6bfff640 1 --2- 172.21.15.87:0/4164228333 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fba540a1280 0x7fba540a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.344+0000 7fba68ff9640 1 -- 172.21.15.87:0/4164228333 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fba60025070 con 0x7fba6c1050c0 2024-09-13T17:16:06.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.344+0000 7fba51ffb640 1 -- 172.21.15.87:0/1730166691 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c031740 con 0x559b76d4b0e0 2024-09-13T17:16:06.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.345+0000 7fba51ffb640 1 -- 172.21.15.87:0/1730166691 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fba5c044070 con 0x559b76d4b0e0 2024-09-13T17:16:06.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.345+0000 7fba51ffb640 1 -- 172.21.15.87:0/1730166691 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c0035f0 con 0x559b76d4b0e0 2024-09-13T17:16:06.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.347+0000 7fba74865740 1 -- 172.21.15.87:0/1730166691 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b76d4b0e0 msgr2=0x559b76d55440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:06.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.347+0000 7fba74865740 1 --2- 172.21.15.87:0/1730166691 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b76d4b0e0 0x559b76d55440 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fba5c02a940 tx=0x7fba5c005c00 comp rx=0 tx=0).stop 2024-09-13T17:16:06.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.348+0000 7fba6bfff640 1 --2- 172.21.15.87:0/4164228333 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fba540a1280 0x7fba540a3740 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fba64011630 tx=0x7fba64009500 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:06.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.348+0000 7fba74865740 1 -- 172.21.15.87:0/1730166691 shutdown_connections 2024-09-13T17:16:06.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.348+0000 7fba74865740 1 --2- 172.21.15.87:0/1730166691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559b76d55980 0x559b76d57d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.348+0000 7fba74865740 1 --2- 172.21.15.87:0/1730166691 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b76d4b0e0 0x559b76d55440 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.348+0000 7fba74865740 1 --2- 172.21.15.87:0/1730166691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559b76d4a7c0 0x559b76d4aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.348+0000 7fba74865740 1 -- 172.21.15.87:0/1730166691 >> 172.21.15.87:0/1730166691 conn(0x559b76d46d50 msgr2=0x559b76d47130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:06.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.349+0000 7fba74865740 1 -- 172.21.15.87:0/1730166691 shutdown_connections 2024-09-13T17:16:06.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.349+0000 7fba74865740 1 -- 172.21.15.87:0/1730166691 wait complete. 2024-09-13T17:16:06.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.349+0000 7fba74865740 1 -- start start 2024-09-13T17:16:06.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.350+0000 7fba74865740 1 Processor -- start 2024-09-13T17:16:06.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.351+0000 7fba74865740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559b76d4a7c0 0x559b76d55370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.351+0000 7fba74865740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b76d4b0e0 0x559b76d525a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.351+0000 7fba74865740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559b76d55980 0x559b76d52b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.352+0000 7fba74865740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b76c6cf80 con 0x559b76d4a7c0 2024-09-13T17:16:06.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.352+0000 7fba74865740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b76c6cc20 con 0x559b76d4b0e0 2024-09-13T17:16:06.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.352+0000 7fba6affd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b76d4b0e0 0x559b76d525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.352+0000 7fba6affd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b76d4b0e0 0x559b76d525a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.87:54520/0 (socket says 172.21.15.87:54520) 2024-09-13T17:16:06.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.352+0000 7fba6affd640 1 -- 172.21.15.87:0/3730938295 learned_addr learned my addr 172.21.15.87:0/3730938295 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:06.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.352+0000 7fba74865740 1 -- 172.21.15.87:0/3730938295 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b76c39ab0 con 0x559b76d55980 2024-09-13T17:16:06.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.352+0000 7fba74865740 10 client.0 _ll_register_callbacks cb 0x559b76ca8350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:06.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.352+0000 7fba6b7fe640 1 --2- 172.21.15.87:0/3730938295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559b76d4a7c0 0x559b76d55370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.352+0000 7fba6bfff640 1 --2- 172.21.15.87:0/3730938295 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559b76d55980 0x559b76d52b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.352+0000 7fba6affd640 1 -- 172.21.15.87:0/3730938295 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559b76d55980 msgr2=0x559b76d52b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:06.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.352+0000 7fba6affd640 1 --2- 172.21.15.87:0/3730938295 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559b76d55980 0x559b76d52b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.352+0000 7fba6affd640 1 -- 172.21.15.87:0/3730938295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559b76d4a7c0 msgr2=0x559b76d55370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:06.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.353+0000 7fba6affd640 1 --2- 172.21.15.87:0/3730938295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559b76d4a7c0 0x559b76d55370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.353+0000 7fba6affd640 1 -- 172.21.15.87:0/3730938295 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba6c10d450 con 0x559b76d4b0e0 2024-09-13T17:16:06.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.353+0000 7fba6affd640 1 --2- 172.21.15.87:0/3730938295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b76d4b0e0 0x559b76d525a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fba600ab030 tx=0x7fba600a74a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aec7bd41bb97f9e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:06.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.353+0000 7fba4affd640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-09-13T17:16:06.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.354+0000 7fba4affd640 1 -- 172.21.15.87:0/3730938295 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba600046c0 con 0x559b76d4b0e0 2024-09-13T17:16:06.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.354+0000 7fba4affd640 1 -- 172.21.15.87:0/3730938295 <== mon.2 v2:172.21.15.118:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fba600ab7a0 con 0x559b76d4b0e0 2024-09-13T17:16:06.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.354+0000 7fba74865740 1 -- 172.21.15.87:0/3730938295 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559b769a2590 con 0x559b76d4b0e0 2024-09-13T17:16:06.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.354+0000 7fba4affd640 1 -- 172.21.15.87:0/3730938295 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba600ab0a0 con 0x559b76d4b0e0 2024-09-13T17:16:06.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.354+0000 7fba74865740 10 client.25685 fetch_fsmap learned FSMap version 26 2024-09-13T17:16:06.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.355+0000 7fba74865740 1 -- 172.21.15.87:0/3730938295 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559b76cad360 con 0x559b76d4b0e0 2024-09-13T17:16:06.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.355+0000 7fba4affd640 1 -- 172.21.15.87:0/3730938295 <== mon.2 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x559b769a2590 con 0x559b76d4b0e0 2024-09-13T17:16:06.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.356+0000 7fba4affd640 1 -- 172.21.15.87:0/3730938295 <== mon.2 v2:172.21.15.118:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fba60030060 con 0x559b76d4b0e0 2024-09-13T17:16:06.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.356+0000 7fba74865740 10 client.25685 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T17:16:06.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.356+0000 7fba74865740 10 client.25685 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:16:06.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.356+0000 7fba74865740 20 client.25685 populate_metadata read hostname 'smithi087' 2024-09-13T17:16:06.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.356+0000 7fba74865740 1 --2- 172.21.15.87:0/3730938295 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x559b76d65690 0x559b76d67ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.356+0000 7fba74865740 4 client.25685 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:16:06.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.356+0000 7fba74865740 1 -- 172.21.15.87:0/3730938295 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559b769b3860 con 0x559b76d65690 2024-09-13T17:16:06.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.357+0000 7fba6b7fe640 1 --2- 172.21.15.87:0/3730938295 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x559b76d65690 0x559b76d67ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.358+0000 7fba6b7fe640 1 --2- 172.21.15.87:0/3730938295 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x559b76d65690 0x559b76d67ab0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8a2ab2b1ca00b0 server_cookie=632fa5d10da18f66 in_seq=0 out_seq=0 2024-09-13T17:16:06.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.358+0000 7fba4affd640 10 client.25685 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:06.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.361+0000 7fba4affd640 1 -- 172.21.15.87:0/3730938295 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x559b769b3860 con 0x559b76d65690 2024-09-13T17:16:06.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.361+0000 7fba4affd640 10 client.25685 handle_command_reply: tid=0 2024-09-13T17:16:06.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.361+0000 7fba74865740 1 client.25685 shutdown 2024-09-13T17:16:06.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.362+0000 7fba74865740 1 -- 172.21.15.87:0/3730938295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b76d4b0e0 msgr2=0x559b76d525a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:06.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.362+0000 7fba74865740 1 --2- 172.21.15.87:0/3730938295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b76d4b0e0 0x559b76d525a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fba600ab030 tx=0x7fba600a74a0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.363+0000 7fba74865740 1 -- 172.21.15.87:0/3730938295 shutdown_connections 2024-09-13T17:16:06.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.363+0000 7fba74865740 1 --2- 172.21.15.87:0/3730938295 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x559b76d65690 0x559b76d67ab0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.363+0000 7fba4affd640 0 client.25685 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:06.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.363+0000 7fba74865740 1 --2- 172.21.15.87:0/3730938295 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559b76d55980 0x559b76d52b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.363+0000 7fba74865740 1 --2- 172.21.15.87:0/3730938295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b76d4b0e0 0x559b76d525a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.363+0000 7fba74865740 1 --2- 172.21.15.87:0/3730938295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559b76d4a7c0 0x559b76d55370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.363+0000 7fba74865740 1 -- 172.21.15.87:0/3730938295 >> 172.21.15.87:0/3730938295 conn(0x559b76d46d50 msgr2=0x559b76d4c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:06.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.363+0000 7fba74865740 1 -- 172.21.15.87:0/3730938295 shutdown_connections 2024-09-13T17:16:06.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.363+0000 7fba74865740 1 -- 172.21.15.87:0/3730938295 wait complete. 2024-09-13T17:16:06.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.363+0000 7fba74865740 20 client.25685 trim_cache size 0 max 16384 2024-09-13T17:16:06.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.392+0000 7fba74865740 1 Processor -- start 2024-09-13T17:16:06.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.393+0000 7fba74865740 1 -- start start 2024-09-13T17:16:06.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.393+0000 7fba74865740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559b76d4a7c0 0x559b76d54e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.393+0000 7fba74865740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b76d4b0e0 0x559b76d5c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.393+0000 7fba74865740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559b76d55980 0x559b76d5cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.393+0000 7fba74865740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b76d479e0 con 0x559b76d55980 2024-09-13T17:16:06.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.393+0000 7fba74865740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b76d6cb20 con 0x559b76d4b0e0 2024-09-13T17:16:06.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.393+0000 7fba74865740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b76d6cce0 con 0x559b76d4a7c0 2024-09-13T17:16:06.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.393+0000 7fba6bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559b76d55980 0x559b76d5cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.393+0000 7fba6bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559b76d55980 0x559b76d5cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33046/0 (socket says 172.21.15.87:33046) 2024-09-13T17:16:06.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.393+0000 7fba6bfff640 1 -- 172.21.15.87:0/2612299964 learned_addr learned my addr 172.21.15.87:0/2612299964 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:06.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.394+0000 7fba6bfff640 1 -- 172.21.15.87:0/2612299964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559b76d4a7c0 msgr2=0x559b76d54e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:06.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.394+0000 7fba6bfff640 1 --2- 172.21.15.87:0/2612299964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559b76d4a7c0 0x559b76d54e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.394+0000 7fba6bfff640 1 -- 172.21.15.87:0/2612299964 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b76d4b0e0 msgr2=0x559b76d5c650 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T17:16:06.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.394+0000 7fba6bfff640 1 --2- 172.21.15.87:0/2612299964 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b76d4b0e0 0x559b76d5c650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.394+0000 7fba6bfff640 1 -- 172.21.15.87:0/2612299964 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b76c4f1c0 con 0x559b76d55980 2024-09-13T17:16:06.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.394+0000 7fba6bfff640 1 --2- 172.21.15.87:0/2612299964 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559b76d55980 0x559b76d5cb90 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fba64003d60 tx=0x7fba64016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29188c80f0ff4dbe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:06.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.395+0000 7fba527fc640 1 -- 172.21.15.87:0/2612299964 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba64024070 con 0x559b76d55980 2024-09-13T17:16:06.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.395+0000 7fba527fc640 1 -- 172.21.15.87:0/2612299964 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fba6400f560 con 0x559b76d55980 2024-09-13T17:16:06.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.395+0000 7fba527fc640 1 -- 172.21.15.87:0/2612299964 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba64016070 con 0x559b76d55980 2024-09-13T17:16:06.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.396+0000 7fba74865740 1 -- 172.21.15.87:0/2612299964 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559b76d55980 msgr2=0x559b76d5cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:06.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.396+0000 7fba74865740 1 --2- 172.21.15.87:0/2612299964 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559b76d55980 0x559b76d5cb90 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fba64003d60 tx=0x7fba64016000 comp rx=0 tx=0).stop 2024-09-13T17:16:06.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.397+0000 7fba74865740 1 -- 172.21.15.87:0/2612299964 shutdown_connections 2024-09-13T17:16:06.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.397+0000 7fba74865740 1 --2- 172.21.15.87:0/2612299964 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559b76d55980 0x559b76d5cb90 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.397+0000 7fba74865740 1 --2- 172.21.15.87:0/2612299964 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b76d4b0e0 0x559b76d5c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.397+0000 7fba74865740 1 --2- 172.21.15.87:0/2612299964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559b76d4a7c0 0x559b76d54e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.397+0000 7fba74865740 1 -- 172.21.15.87:0/2612299964 >> 172.21.15.87:0/2612299964 conn(0x559b76d46d50 msgr2=0x559b76d6c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:06.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.398+0000 7fba74865740 1 -- 172.21.15.87:0/2612299964 shutdown_connections 2024-09-13T17:16:06.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.399+0000 7fba74865740 1 -- 172.21.15.87:0/2612299964 wait complete. 2024-09-13T17:16:06.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.399+0000 7fba74865740 1 -- start start 2024-09-13T17:16:06.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.400+0000 7fba74865740 1 Processor -- start 2024-09-13T17:16:06.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.400+0000 7fba74865740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559b76d4a7c0 0x559b76db5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.400+0000 7fba74865740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559b76d4b0e0 0x559b76db5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.400+0000 7fba74865740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b76d55980 0x559b76d5bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.400+0000 7fba74865740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b76d5c4d0 con 0x559b76d4b0e0 2024-09-13T17:16:06.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.400+0000 7fba74865740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b76d5c640 con 0x559b76d55980 2024-09-13T17:16:06.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.400+0000 7fba74865740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b76d5c800 con 0x559b76d4a7c0 2024-09-13T17:16:06.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.400+0000 7fba74865740 10 client.0 _ll_register_callbacks cb 0x7fba600048b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:06.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.400+0000 7fba6affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559b76d4b0e0 0x559b76db5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.400+0000 7fba6bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b76d55980 0x559b76d5bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.400+0000 7fba6affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559b76d4b0e0 0x559b76db5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33058/0 (socket says 172.21.15.87:33058) 2024-09-13T17:16:06.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.400+0000 7fba6affd640 1 -- 172.21.15.87:0/1410113261 learned_addr learned my addr 172.21.15.87:0/1410113261 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:06.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.400+0000 7fba6b7fe640 1 --2- 172.21.15.87:0/1410113261 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559b76d4a7c0 0x559b76db5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.401+0000 7fba6affd640 1 -- 172.21.15.87:0/1410113261 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559b76d4a7c0 msgr2=0x559b76db5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:06.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.401+0000 7fba6affd640 1 --2- 172.21.15.87:0/1410113261 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559b76d4a7c0 0x559b76db5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.401+0000 7fba6affd640 1 -- 172.21.15.87:0/1410113261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b76d55980 msgr2=0x559b76d5bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:06.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.401+0000 7fba6affd640 1 --2- 172.21.15.87:0/1410113261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b76d55980 0x559b76d5bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.401+0000 7fba6affd640 1 -- 172.21.15.87:0/1410113261 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba64003a10 con 0x559b76d4b0e0 2024-09-13T17:16:06.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.401+0000 7fba6bfff640 1 --2- 172.21.15.87:0/1410113261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b76d55980 0x559b76d5bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:16:06.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.401+0000 7fba6affd640 1 --2- 172.21.15.87:0/1410113261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559b76d4b0e0 0x559b76db5840 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fba6000c6a0 tx=0x7fba600b3400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=531f1acaf1b4fb8a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:06.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.401+0000 7fba4affd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:16:06.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.402+0000 7fba4affd640 1 -- 172.21.15.87:0/1410113261 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba60005430 con 0x559b76d4b0e0 2024-09-13T17:16:06.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.402+0000 7fba4affd640 1 -- 172.21.15.87:0/1410113261 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fba600046c0 con 0x559b76d4b0e0 2024-09-13T17:16:06.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.402+0000 7fba74865740 1 -- 172.21.15.87:0/1410113261 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fba5c044070 con 0x559b76d4b0e0 2024-09-13T17:16:06.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.402+0000 7fba4affd640 1 -- 172.21.15.87:0/1410113261 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba600c94a0 con 0x559b76d4b0e0 2024-09-13T17:16:06.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.403+0000 7fba74865740 10 client.16371 fetch_fsmap learned FSMap version 26 2024-09-13T17:16:06.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.403+0000 7fba74865740 1 -- 172.21.15.87:0/1410113261 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559b76c74990 con 0x559b76d4b0e0 2024-09-13T17:16:06.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.403+0000 7fba4affd640 1 -- 172.21.15.87:0/1410113261 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fba5c044070 con 0x559b76d4b0e0 2024-09-13T17:16:06.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.403+0000 7fba4affd640 1 -- 172.21.15.87:0/1410113261 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fba60030070 con 0x559b76d4b0e0 2024-09-13T17:16:06.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.404+0000 7fba74865740 10 client.16371 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T17:16:06.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.404+0000 7fba74865740 10 client.16371 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:16:06.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.404+0000 7fba74865740 20 client.16371 populate_metadata read hostname 'smithi087' 2024-09-13T17:16:06.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.404+0000 7fba74865740 1 --2- 172.21.15.87:0/1410113261 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x559b76d65690 0x559b76dbff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.404+0000 7fba74865740 4 client.16371 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-13T17:16:06.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.404+0000 7fba74865740 1 -- 172.21.15.87:0/1410113261 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x559b76a06eb0 con 0x559b76d65690 2024-09-13T17:16:06.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.405+0000 7fba6b7fe640 1 --2- 172.21.15.87:0/1410113261 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x559b76d65690 0x559b76dbff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.406+0000 7fba6b7fe640 1 --2- 172.21.15.87:0/1410113261 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x559b76d65690 0x559b76dbff30 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3e6d831815f8eb7 server_cookie=7bf03ab2417c1679 in_seq=0 out_seq=0 2024-09-13T17:16:06.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.407+0000 7fba4affd640 10 client.16371 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:06.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.408+0000 7fba4affd640 1 -- 172.21.15.87:0/1410113261 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x559b76a06eb0 con 0x559b76d65690 2024-09-13T17:16:06.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.408+0000 7fba4affd640 10 client.16371 handle_command_reply: tid=0 2024-09-13T17:16:06.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.409+0000 7fba74865740 1 client.16371 shutdown 2024-09-13T17:16:06.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.409+0000 7fba74865740 1 -- 172.21.15.87:0/1410113261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559b76d4b0e0 msgr2=0x559b76db5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:06.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.409+0000 7fba74865740 1 --2- 172.21.15.87:0/1410113261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559b76d4b0e0 0x559b76db5840 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fba6000c6a0 tx=0x7fba600b3400 comp rx=0 tx=0).stop 2024-09-13T17:16:06.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.409+0000 7fba74865740 1 -- 172.21.15.87:0/1410113261 shutdown_connections 2024-09-13T17:16:06.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.409+0000 7fba74865740 1 --2- 172.21.15.87:0/1410113261 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x559b76d65690 0x559b76dbff30 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.410+0000 7fba74865740 1 --2- 172.21.15.87:0/1410113261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b76d55980 0x559b76d5bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.410+0000 7fba74865740 1 --2- 172.21.15.87:0/1410113261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559b76d4b0e0 0x559b76db5840 secure :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fba6000c6a0 tx=0x7fba600b3400 comp rx=0 tx=0).stop 2024-09-13T17:16:06.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.410+0000 7fba74865740 1 --2- 172.21.15.87:0/1410113261 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559b76d4a7c0 0x559b76db5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.410+0000 7fba74865740 1 -- 172.21.15.87:0/1410113261 >> 172.21.15.87:0/1410113261 conn(0x559b76d46d50 msgr2=0x559b76d4d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:06.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.410+0000 7fba4affd640 0 client.16371 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:06.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.411+0000 7fba74865740 1 -- 172.21.15.87:0/1410113261 shutdown_connections 2024-09-13T17:16:06.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.411+0000 7fba74865740 1 -- 172.21.15.87:0/1410113261 wait complete. 2024-09-13T17:16:06.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.412+0000 7fba74865740 20 client.16371 trim_cache size 0 max 16384 2024-09-13T17:16:06.415 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:16:06.415 INFO:teuthology.orchestra.run.smithi087.stdout: "return_code": 0, 2024-09-13T17:16:06.415 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_tag": "8563f902-e689-4406-9a6c-d935ca989e6d", 2024-09-13T17:16:06.415 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": "asynchronous" 2024-09-13T17:16:06.415 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:16:06.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.414+0000 7fba71b45640 1 -- 172.21.15.87:0/4164228333 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fba540a1280 msgr2=0x7fba540a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:06.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.414+0000 7fba71b45640 1 --2- 172.21.15.87:0/4164228333 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fba540a1280 0x7fba540a3740 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fba64011630 tx=0x7fba64009500 comp rx=0 tx=0).stop 2024-09-13T17:16:06.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.414+0000 7fba71b45640 1 -- 172.21.15.87:0/4164228333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba6c1050c0 msgr2=0x7fba6c1967e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:06.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.414+0000 7fba71b45640 1 --2- 172.21.15.87:0/4164228333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba6c1050c0 0x7fba6c1967e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fba60009f20 tx=0x7fba6000ee50 comp rx=0 tx=0).stop 2024-09-13T17:16:06.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.415+0000 7fba71b45640 1 -- 172.21.15.87:0/4164228333 shutdown_connections 2024-09-13T17:16:06.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.415+0000 7fba71b45640 1 --2- 172.21.15.87:0/4164228333 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fba540a1280 0x7fba540a3740 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.415+0000 7fba71b45640 1 --2- 172.21.15.87:0/4164228333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba6c19abd0 0x7fba6c19b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.415+0000 7fba71b45640 1 --2- 172.21.15.87:0/4164228333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba6c1050c0 0x7fba6c1967e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.415+0000 7fba71b45640 1 --2- 172.21.15.87:0/4164228333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba6c0fff70 0x7fba6c1962a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.415+0000 7fba71b45640 1 -- 172.21.15.87:0/4164228333 >> 172.21.15.87:0/4164228333 conn(0x7fba6c0fb9e0 msgr2=0x7fba6c0fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:06.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.415+0000 7fba71b45640 1 -- 172.21.15.87:0/4164228333 shutdown_connections 2024-09-13T17:16:06.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.415+0000 7fba71b45640 1 -- 172.21.15.87:0/4164228333 wait complete. 2024-09-13T17:16:06.431 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:16:06.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.586+0000 7f3b2be9c640 1 -- 172.21.15.87:0/1256286527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b240ff840 msgr2=0x7f3b24103880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:06.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.586+0000 7f3b2be9c640 1 --2- 172.21.15.87:0/1256286527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b240ff840 0x7f3b24103880 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f3b14009930 tx=0x7f3b1402a420 comp rx=0 tx=0).stop 2024-09-13T17:16:06.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.586+0000 7f3b2be9c640 1 -- 172.21.15.87:0/1256286527 shutdown_connections 2024-09-13T17:16:06.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.586+0000 7f3b2be9c640 1 --2- 172.21.15.87:0/1256286527 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b24103fe0 0x7f3b2410bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.586+0000 7f3b2be9c640 1 --2- 172.21.15.87:0/1256286527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b240ff840 0x7f3b24103880 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.586+0000 7f3b2be9c640 1 --2- 172.21.15.87:0/1256286527 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b240fee90 0x7f3b240ff270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.586+0000 7f3b2be9c640 1 -- 172.21.15.87:0/1256286527 >> 172.21.15.87:0/1256286527 conn(0x7f3b240fa900 msgr2=0x7f3b240fcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:06.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.586+0000 7f3b2be9c640 1 -- 172.21.15.87:0/1256286527 shutdown_connections 2024-09-13T17:16:06.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.586+0000 7f3b2be9c640 1 -- 172.21.15.87:0/1256286527 wait complete. 2024-09-13T17:16:06.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.587+0000 7f3b2be9c640 1 Processor -- start 2024-09-13T17:16:06.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.587+0000 7f3b2be9c640 1 -- start start 2024-09-13T17:16:06.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.587+0000 7f3b2be9c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b240fee90 0x7f3b24100920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.587+0000 7f3b2be9c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b24103fe0 0x7f3b24100e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.587+0000 7f3b2be9c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b241013a0 0x7f3b241a4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.587+0000 7f3b2be9c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b241a4b10 con 0x7f3b24103fe0 2024-09-13T17:16:06.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.587+0000 7f3b2be9c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b241a4c80 con 0x7f3b240fee90 2024-09-13T17:16:06.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.587+0000 7f3b2be9c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b241a4e40 con 0x7f3b241013a0 2024-09-13T17:16:06.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.587+0000 7f3b29437640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b24103fe0 0x7f3b24100e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.587+0000 7f3b29437640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b24103fe0 0x7f3b24100e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33080/0 (socket says 172.21.15.87:33080) 2024-09-13T17:16:06.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.587+0000 7f3b29437640 1 -- 172.21.15.87:0/405514387 learned_addr learned my addr 172.21.15.87:0/405514387 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:06.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.587+0000 7f3b29c38640 1 --2- 172.21.15.87:0/405514387 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b240fee90 0x7f3b24100920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.587+0000 7f3b2a439640 1 --2- 172.21.15.87:0/405514387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b241013a0 0x7f3b241a4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.587+0000 7f3b29437640 1 -- 172.21.15.87:0/405514387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b241013a0 msgr2=0x7f3b241a4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:06.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.587+0000 7f3b29437640 1 --2- 172.21.15.87:0/405514387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b241013a0 0x7f3b241a4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.587+0000 7f3b29437640 1 -- 172.21.15.87:0/405514387 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b240fee90 msgr2=0x7f3b24100920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:06.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.587+0000 7f3b29437640 1 --2- 172.21.15.87:0/405514387 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b240fee90 0x7f3b24100920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.587+0000 7f3b29437640 1 -- 172.21.15.87:0/405514387 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b14009560 con 0x7f3b24103fe0 2024-09-13T17:16:06.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.587+0000 7f3b2a439640 1 --2- 172.21.15.87:0/405514387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b241013a0 0x7f3b241a4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:06.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.588+0000 7f3b29437640 1 --2- 172.21.15.87:0/405514387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b24103fe0 0x7f3b24100e60 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3b14009900 tx=0x7f3b140040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:06.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.588+0000 7f3b1affd640 1 -- 172.21.15.87:0/405514387 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b140037f0 con 0x7f3b24103fe0 2024-09-13T17:16:06.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.588+0000 7f3b1affd640 1 -- 172.21.15.87:0/405514387 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3b140044c0 con 0x7f3b24103fe0 2024-09-13T17:16:06.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.588+0000 7f3b2be9c640 1 -- 172.21.15.87:0/405514387 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b241a50c0 con 0x7f3b24103fe0 2024-09-13T17:16:06.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.588+0000 7f3b1affd640 1 -- 172.21.15.87:0/405514387 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1403be00 con 0x7f3b24103fe0 2024-09-13T17:16:06.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.588+0000 7f3b2be9c640 1 -- 172.21.15.87:0/405514387 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b241a55c0 con 0x7f3b24103fe0 2024-09-13T17:16:06.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.590+0000 7f3b1affd640 1 -- 172.21.15.87:0/405514387 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f3b1403b560 con 0x7f3b24103fe0 2024-09-13T17:16:06.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.591+0000 7f3b2ebc0740 1 Processor -- start 2024-09-13T17:16:06.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.591+0000 7f3b2ebc0740 1 -- start start 2024-09-13T17:16:06.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.591+0000 7f3b2ebc0740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608efa47e10 0x5608efa481f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.591+0000 7f3b2ebc0740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608efa48730 0x5608efa52a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.591+0000 7f3b2ebc0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608efa52fd0 0x5608efa553c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.591+0000 7f3b2ebc0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608ef9b2f20 con 0x5608efa52fd0 2024-09-13T17:16:06.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.591+0000 7f3b2ebc0740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608ef9b06b0 con 0x5608efa47e10 2024-09-13T17:16:06.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.591+0000 7f3b2ebc0740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608ef9abfa0 con 0x5608efa48730 2024-09-13T17:16:06.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.591+0000 7f3b29437640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608efa52fd0 0x5608efa553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.591+0000 7f3b2a439640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608efa47e10 0x5608efa481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.591+0000 7f3b2a439640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608efa47e10 0x5608efa481f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.87:54568/0 (socket says 172.21.15.87:54568) 2024-09-13T17:16:06.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.591+0000 7f3b2a439640 1 -- 172.21.15.87:0/1287957533 learned_addr learned my addr 172.21.15.87:0/1287957533 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:06.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.591+0000 7f3b29c38640 1 --2- 172.21.15.87:0/1287957533 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608efa48730 0x5608efa52a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.591+0000 7f3b1affd640 1 --2- 172.21.15.87:0/405514387 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f3b100a12b0 0x7f3b100a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.591+0000 7f3b2a439640 1 --2- 172.21.15.87:0/405514387 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f3b100a12b0 0x7f3b100a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.592+0000 7f3b1affd640 1 -- 172.21.15.87:0/405514387 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f3b140edde0 con 0x7f3b24103fe0 2024-09-13T17:16:06.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.592+0000 7f3b29437640 1 -- 172.21.15.87:0/1287957533 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608efa48730 msgr2=0x5608efa52a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:06.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.592+0000 7f3b29437640 1 --2- 172.21.15.87:0/1287957533 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608efa48730 0x5608efa52a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.592+0000 7f3b29437640 1 -- 172.21.15.87:0/1287957533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608efa47e10 msgr2=0x5608efa481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:06.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.592+0000 7f3b29437640 1 --2- 172.21.15.87:0/1287957533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608efa47e10 0x5608efa481f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.592+0000 7f3b29437640 1 -- 172.21.15.87:0/1287957533 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5608ef966840 con 0x5608efa52fd0 2024-09-13T17:16:06.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.592+0000 7f3b2a439640 1 --2- 172.21.15.87:0/1287957533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608efa47e10 0x5608efa481f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:16:06.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.592+0000 7f3b29c38640 1 --2- 172.21.15.87:0/1287957533 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608efa48730 0x5608efa52a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:06.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.592+0000 7f3b29437640 1 --2- 172.21.15.87:0/1287957533 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608efa52fd0 0x5608efa553c0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f3b140eb180 tx=0x7f3b14009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578cb5494f726426 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:06.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.592+0000 7f3b0ffff640 1 -- 172.21.15.87:0/1287957533 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b140ba5c0 con 0x5608efa52fd0 2024-09-13T17:16:06.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.592+0000 7f3b2a439640 1 --2- 172.21.15.87:0/405514387 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f3b100a12b0 0x7f3b100a3770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c013b70 tx=0x7f3b1c004ab0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:06.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.592+0000 7f3b0ffff640 1 -- 172.21.15.87:0/1287957533 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3b140bb360 con 0x5608efa52fd0 2024-09-13T17:16:06.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.592+0000 7f3b0ffff640 1 -- 172.21.15.87:0/1287957533 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b140b7370 con 0x5608efa52fd0 2024-09-13T17:16:06.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.593+0000 7f3b2ebc0740 1 -- 172.21.15.87:0/1287957533 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608efa52fd0 msgr2=0x5608efa553c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:06.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.593+0000 7f3b2ebc0740 1 --2- 172.21.15.87:0/1287957533 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608efa52fd0 0x5608efa553c0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f3b140eb180 tx=0x7f3b14009260 comp rx=0 tx=0).stop 2024-09-13T17:16:06.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.593+0000 7f3b2ebc0740 1 -- 172.21.15.87:0/1287957533 shutdown_connections 2024-09-13T17:16:06.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.593+0000 7f3b2ebc0740 1 --2- 172.21.15.87:0/1287957533 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608efa52fd0 0x5608efa553c0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.593+0000 7f3b2ebc0740 1 --2- 172.21.15.87:0/1287957533 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608efa48730 0x5608efa52a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.593+0000 7f3b2ebc0740 1 --2- 172.21.15.87:0/1287957533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608efa47e10 0x5608efa481f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.593+0000 7f3b2ebc0740 1 -- 172.21.15.87:0/1287957533 >> 172.21.15.87:0/1287957533 conn(0x5608efa44380 msgr2=0x5608efa44760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:06.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.593+0000 7f3b2ebc0740 1 -- 172.21.15.87:0/1287957533 shutdown_connections 2024-09-13T17:16:06.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.593+0000 7f3b2ebc0740 1 -- 172.21.15.87:0/1287957533 wait complete. 2024-09-13T17:16:06.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.593+0000 7f3b2ebc0740 1 -- start start 2024-09-13T17:16:06.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.593+0000 7f3b2ebc0740 1 Processor -- start 2024-09-13T17:16:06.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.594+0000 7f3b2ebc0740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608efa47e10 0x5608efa52970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.594+0000 7f3b2ebc0740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608efa48730 0x5608efa4fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.594+0000 7f3b2ebc0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608efa52fd0 0x5608efa50140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.594+0000 7f3b2ebc0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608ef94d2a0 con 0x5608efa52fd0 2024-09-13T17:16:06.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.594+0000 7f3b2ebc0740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608ef684430 con 0x5608efa47e10 2024-09-13T17:16:06.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.594+0000 7f3b2ebc0740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608ef92f680 con 0x5608efa48730 2024-09-13T17:16:06.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.594+0000 7f3b2ebc0740 10 client.0 _ll_register_callbacks cb 0x5608ef9a5610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:06.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.594+0000 7f3b29c38640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608efa47e10 0x5608efa52970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.594+0000 7f3b29c38640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608efa47e10 0x5608efa52970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.87:54574/0 (socket says 172.21.15.87:54574) 2024-09-13T17:16:06.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.594+0000 7f3b29c38640 1 -- 172.21.15.87:0/2972818739 learned_addr learned my addr 172.21.15.87:0/2972818739 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:06.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.594+0000 7f3b2a439640 1 --2- 172.21.15.87:0/2972818739 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608efa52fd0 0x5608efa50140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.594+0000 7f3b29437640 1 --2- 172.21.15.87:0/2972818739 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608efa48730 0x5608efa4fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.594+0000 7f3b29c38640 1 -- 172.21.15.87:0/2972818739 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608efa48730 msgr2=0x5608efa4fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:06.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.594+0000 7f3b29c38640 1 --2- 172.21.15.87:0/2972818739 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608efa48730 0x5608efa4fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.594+0000 7f3b29c38640 1 -- 172.21.15.87:0/2972818739 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608efa52fd0 msgr2=0x5608efa50140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:06.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.594+0000 7f3b29c38640 1 --2- 172.21.15.87:0/2972818739 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608efa52fd0 0x5608efa50140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.594+0000 7f3b29c38640 1 -- 172.21.15.87:0/2972818739 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b241a55c0 con 0x5608efa47e10 2024-09-13T17:16:06.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.595+0000 7f3b2a439640 1 --2- 172.21.15.87:0/2972818739 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608efa52fd0 0x5608efa50140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:16:06.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.595+0000 7f3b29c38640 1 --2- 172.21.15.87:0/2972818739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608efa47e10 0x5608efa52970 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3b20013790 tx=0x7f3b20013b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39d88bc3081dee00 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:06.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.595+0000 7f3b0d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-09-13T17:16:06.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.595+0000 7f3b0d7fa640 1 -- 172.21.15.87:0/2972818739 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b20011dd0 con 0x5608efa47e10 2024-09-13T17:16:06.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.595+0000 7f3b0d7fa640 1 -- 172.21.15.87:0/2972818739 <== mon.2 v2:172.21.15.118:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f3b2000f450 con 0x5608efa47e10 2024-09-13T17:16:06.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.595+0000 7f3b2ebc0740 1 -- 172.21.15.87:0/2972818739 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5608ef69f4e0 con 0x5608efa47e10 2024-09-13T17:16:06.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.595+0000 7f3b0d7fa640 1 -- 172.21.15.87:0/2972818739 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b2000f610 con 0x5608efa47e10 2024-09-13T17:16:06.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.595+0000 7f3b2ebc0740 10 client.25700 fetch_fsmap learned FSMap version 26 2024-09-13T17:16:06.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.595+0000 7f3b2ebc0740 1 -- 172.21.15.87:0/2972818739 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5608ef9aa620 con 0x5608efa47e10 2024-09-13T17:16:06.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.595+0000 7f3b0d7fa640 1 -- 172.21.15.87:0/2972818739 <== mon.2 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x5608ef69f4e0 con 0x5608efa47e10 2024-09-13T17:16:06.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.596+0000 7f3b0d7fa640 1 -- 172.21.15.87:0/2972818739 <== mon.2 v2:172.21.15.118:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f3b2000e800 con 0x5608efa47e10 2024-09-13T17:16:06.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.596+0000 7f3b2ebc0740 10 client.25700 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T17:16:06.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.596+0000 7f3b2ebc0740 10 client.25700 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:16:06.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.596+0000 7f3b2ebc0740 20 client.25700 populate_metadata read hostname 'smithi087' 2024-09-13T17:16:06.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.596+0000 7f3b2ebc0740 1 --2- 172.21.15.87:0/2972818739 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5608efa629f0 0x5608efa64e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.596+0000 7f3b2ebc0740 4 client.25700 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:16:06.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.596+0000 7f3b2ebc0740 1 -- 172.21.15.87:0/2972818739 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5608ef6b07e0 con 0x5608efa629f0 2024-09-13T17:16:06.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.596+0000 7f3b29437640 1 --2- 172.21.15.87:0/2972818739 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5608efa629f0 0x5608efa64e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.597+0000 7f3b0d7fa640 10 client.25700 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:06.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.597+0000 7f3b29437640 1 --2- 172.21.15.87:0/2972818739 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5608efa629f0 0x5608efa64e10 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6dab5750616bfb2 server_cookie=6b1c6442fd84fa7b in_seq=0 out_seq=0 2024-09-13T17:16:06.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.598+0000 7f3b0d7fa640 1 -- 172.21.15.87:0/2972818739 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5608ef6b07e0 con 0x5608efa629f0 2024-09-13T17:16:06.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.598+0000 7f3b0d7fa640 10 client.25700 handle_command_reply: tid=0 2024-09-13T17:16:06.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.598+0000 7f3b2ebc0740 1 client.25700 shutdown 2024-09-13T17:16:06.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.598+0000 7f3b2ebc0740 1 -- 172.21.15.87:0/2972818739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608efa47e10 msgr2=0x5608efa52970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:06.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.598+0000 7f3b2ebc0740 1 --2- 172.21.15.87:0/2972818739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608efa47e10 0x5608efa52970 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3b20013790 tx=0x7f3b20013b90 comp rx=0 tx=0).stop 2024-09-13T17:16:06.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.598+0000 7f3b2ebc0740 1 -- 172.21.15.87:0/2972818739 shutdown_connections 2024-09-13T17:16:06.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.598+0000 7f3b2ebc0740 1 --2- 172.21.15.87:0/2972818739 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5608efa629f0 0x5608efa64e10 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.598+0000 7f3b2ebc0740 1 --2- 172.21.15.87:0/2972818739 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608efa52fd0 0x5608efa50140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.598+0000 7f3b2ebc0740 1 --2- 172.21.15.87:0/2972818739 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608efa48730 0x5608efa4fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.598+0000 7f3b2ebc0740 1 --2- 172.21.15.87:0/2972818739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608efa47e10 0x5608efa52970 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.598+0000 7f3b2ebc0740 1 -- 172.21.15.87:0/2972818739 >> 172.21.15.87:0/2972818739 conn(0x5608efa44380 msgr2=0x5608efa43510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:06.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.598+0000 7f3b0d7fa640 0 client.25700 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:06.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.598+0000 7f3b2ebc0740 1 -- 172.21.15.87:0/2972818739 shutdown_connections 2024-09-13T17:16:06.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.598+0000 7f3b2ebc0740 1 -- 172.21.15.87:0/2972818739 wait complete. 2024-09-13T17:16:06.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.598+0000 7f3b2ebc0740 20 client.25700 trim_cache size 0 max 16384 2024-09-13T17:16:06.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.615+0000 7f3b2ebc0740 1 Processor -- start 2024-09-13T17:16:06.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.615+0000 7f3b2ebc0740 1 -- start start 2024-09-13T17:16:06.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.615+0000 7f3b2ebc0740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608efa47e10 0x5608efa43d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.615+0000 7f3b2ebc0740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608efa48730 0x5608efa59a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.615+0000 7f3b2ebc0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608efa52fd0 0x5608efa59f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.615+0000 7f3b2ebc0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608efa50740 con 0x5608efa52fd0 2024-09-13T17:16:06.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.615+0000 7f3b2ebc0740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608efa452e0 con 0x5608efa48730 2024-09-13T17:16:06.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.615+0000 7f3b2ebc0740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608efa3f760 con 0x5608efa47e10 2024-09-13T17:16:06.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.615+0000 7f3b2a439640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608efa52fd0 0x5608efa59f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.615+0000 7f3b2a439640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608efa52fd0 0x5608efa59f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33112/0 (socket says 172.21.15.87:33112) 2024-09-13T17:16:06.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.615+0000 7f3b2a439640 1 -- 172.21.15.87:0/2238243885 learned_addr learned my addr 172.21.15.87:0/2238243885 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:06.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.615+0000 7f3b29437640 1 --2- 172.21.15.87:0/2238243885 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608efa48730 0x5608efa59a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.615+0000 7f3b2a439640 1 -- 172.21.15.87:0/2238243885 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608efa47e10 msgr2=0x5608efa43d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:06.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.615+0000 7f3b2a439640 1 --2- 172.21.15.87:0/2238243885 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608efa47e10 0x5608efa43d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.615+0000 7f3b2a439640 1 -- 172.21.15.87:0/2238243885 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608efa48730 msgr2=0x5608efa59a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:06.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.615+0000 7f3b2a439640 1 --2- 172.21.15.87:0/2238243885 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608efa48730 0x5608efa59a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.615+0000 7f3b2a439640 1 -- 172.21.15.87:0/2238243885 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5608ef94c790 con 0x5608efa52fd0 2024-09-13T17:16:06.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.615+0000 7f3b29437640 1 --2- 172.21.15.87:0/2238243885 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608efa48730 0x5608efa59a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:16:06.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.616+0000 7f3b2a439640 1 --2- 172.21.15.87:0/2238243885 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608efa52fd0 0x5608efa59f60 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c011bb0 tx=0x7f3b1c009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79a8c6d188887218 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:06.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.616+0000 7f3b18ff9640 1 -- 172.21.15.87:0/2238243885 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c02a440 con 0x5608efa52fd0 2024-09-13T17:16:06.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.616+0000 7f3b18ff9640 1 -- 172.21.15.87:0/2238243885 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3b1c010900 con 0x5608efa52fd0 2024-09-13T17:16:06.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.616+0000 7f3b18ff9640 1 -- 172.21.15.87:0/2238243885 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c029810 con 0x5608efa52fd0 2024-09-13T17:16:06.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.616+0000 7f3b2ebc0740 1 -- 172.21.15.87:0/2238243885 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608efa52fd0 msgr2=0x5608efa59f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:06.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.616+0000 7f3b2ebc0740 1 --2- 172.21.15.87:0/2238243885 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608efa52fd0 0x5608efa59f60 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c011bb0 tx=0x7f3b1c009a60 comp rx=0 tx=0).stop 2024-09-13T17:16:06.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.617+0000 7f3b2ebc0740 1 -- 172.21.15.87:0/2238243885 shutdown_connections 2024-09-13T17:16:06.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.617+0000 7f3b2ebc0740 1 --2- 172.21.15.87:0/2238243885 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608efa52fd0 0x5608efa59f60 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.617+0000 7f3b2ebc0740 1 --2- 172.21.15.87:0/2238243885 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608efa48730 0x5608efa59a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.617+0000 7f3b2ebc0740 1 --2- 172.21.15.87:0/2238243885 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608efa47e10 0x5608efa43d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.617+0000 7f3b2ebc0740 1 -- 172.21.15.87:0/2238243885 >> 172.21.15.87:0/2238243885 conn(0x5608efa44380 msgr2=0x5608efa69770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:06.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.617+0000 7f3b2ebc0740 1 -- 172.21.15.87:0/2238243885 shutdown_connections 2024-09-13T17:16:06.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.617+0000 7f3b2ebc0740 1 -- 172.21.15.87:0/2238243885 wait complete. 2024-09-13T17:16:06.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.617+0000 7f3b2ebc0740 1 -- start start 2024-09-13T17:16:06.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.617+0000 7f3b2ebc0740 1 Processor -- start 2024-09-13T17:16:06.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.618+0000 7f3b2ebc0740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608efa47e10 0x5608efa57cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.618+0000 7f3b2ebc0740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608efa48730 0x5608efa58210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.618+0000 7f3b2ebc0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608efa52fd0 0x5608efab7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.618+0000 7f3b2ebc0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608efab8430 con 0x5608efa52fd0 2024-09-13T17:16:06.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.618+0000 7f3b2ebc0740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608efab8570 con 0x5608efa48730 2024-09-13T17:16:06.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.618+0000 7f3b2ebc0740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608efab86e0 con 0x5608efa47e10 2024-09-13T17:16:06.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.618+0000 7f3b2ebc0740 10 client.0 _ll_register_callbacks cb 0x7f3b20009650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:06.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.618+0000 7f3b29437640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608efa48730 0x5608efa58210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.618+0000 7f3b2a439640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608efa52fd0 0x5608efab7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.618+0000 7f3b29437640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608efa48730 0x5608efa58210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.87:54596/0 (socket says 172.21.15.87:54596) 2024-09-13T17:16:06.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.618+0000 7f3b29437640 1 -- 172.21.15.87:0/871215587 learned_addr learned my addr 172.21.15.87:0/871215587 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:06.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.618+0000 7f3b2a439640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608efa52fd0 0x5608efab7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33128/0 (socket says 172.21.15.87:33128) 2024-09-13T17:16:06.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.618+0000 7f3b29437640 1 -- 172.21.15.87:0/871215587 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608efa47e10 msgr2=0x5608efa57cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:06.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.618+0000 7f3b29437640 1 --2- 172.21.15.87:0/871215587 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608efa47e10 0x5608efa57cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.618+0000 7f3b29437640 1 -- 172.21.15.87:0/871215587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608efa52fd0 msgr2=0x5608efab7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:06.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.618+0000 7f3b29437640 1 --2- 172.21.15.87:0/871215587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608efa52fd0 0x5608efab7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.618+0000 7f3b29437640 1 -- 172.21.15.87:0/871215587 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5608ef966840 con 0x5608efa48730 2024-09-13T17:16:06.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.618+0000 7f3b2a439640 1 --2- 172.21.15.87:0/871215587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608efa52fd0 0x5608efab7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:16:06.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.618+0000 7f3b29437640 1 --2- 172.21.15.87:0/871215587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608efa48730 0x5608efa58210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3b14000c00 tx=0x7f3b140bb4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33500964c9f21e21 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:06.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.618+0000 7f3b0d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-09-13T17:16:06.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.618+0000 7f3b0d7fa640 1 -- 172.21.15.87:0/871215587 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b140ba5c0 con 0x5608efa48730 2024-09-13T17:16:06.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.618+0000 7f3b0d7fa640 1 -- 172.21.15.87:0/871215587 <== mon.2 v2:172.21.15.118:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f3b140bac60 con 0x5608efa48730 2024-09-13T17:16:06.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.618+0000 7f3b2ebc0740 1 -- 172.21.15.87:0/871215587 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3b140bb360 con 0x5608efa48730 2024-09-13T17:16:06.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.619+0000 7f3b0d7fa640 1 -- 172.21.15.87:0/871215587 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b140bea90 con 0x5608efa48730 2024-09-13T17:16:06.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.619+0000 7f3b2ebc0740 10 client.25706 fetch_fsmap learned FSMap version 26 2024-09-13T17:16:06.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.619+0000 7f3b2ebc0740 1 -- 172.21.15.87:0/871215587 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5608ef971ea0 con 0x5608efa48730 2024-09-13T17:16:06.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.619+0000 7f3b0d7fa640 1 -- 172.21.15.87:0/871215587 <== mon.2 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3b140c30e0 con 0x5608efa48730 2024-09-13T17:16:06.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.619+0000 7f3b0d7fa640 1 -- 172.21.15.87:0/871215587 <== mon.2 v2:172.21.15.118:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f3b140f0040 con 0x5608efa48730 2024-09-13T17:16:06.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.619+0000 7f3b2ebc0740 10 client.25706 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T17:16:06.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.619+0000 7f3b2ebc0740 10 client.25706 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:16:06.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.619+0000 7f3b2ebc0740 20 client.25706 populate_metadata read hostname 'smithi087' 2024-09-13T17:16:06.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.619+0000 7f3b2ebc0740 1 --2- 172.21.15.87:0/871215587 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5608efab9c30 0x5608efabc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:06.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.619+0000 7f3b2ebc0740 4 client.25706 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:16:06.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.619+0000 7f3b2ebc0740 1 -- 172.21.15.87:0/871215587 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7f3b140bb360 con 0x5608efab9c30 2024-09-13T17:16:06.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.619+0000 7f3b29c38640 1 --2- 172.21.15.87:0/871215587 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5608efab9c30 0x5608efabc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:06.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.620+0000 7f3b0d7fa640 10 client.25706 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:06.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.620+0000 7f3b29c38640 1 --2- 172.21.15.87:0/871215587 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5608efab9c30 0x5608efabc050 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b4793a78341cfbd server_cookie=faf8a2f3c745ca1a in_seq=0 out_seq=0 2024-09-13T17:16:06.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.621+0000 7f3b0d7fa640 1 -- 172.21.15.87:0/871215587 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x7f3b140bb360 con 0x5608efab9c30 2024-09-13T17:16:06.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.621+0000 7f3b0d7fa640 10 client.25706 handle_command_reply: tid=0 2024-09-13T17:16:06.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.621+0000 7f3b2ebc0740 1 client.25706 shutdown 2024-09-13T17:16:06.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.621+0000 7f3b2ebc0740 1 -- 172.21.15.87:0/871215587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608efa48730 msgr2=0x5608efa58210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:06.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.621+0000 7f3b2ebc0740 1 --2- 172.21.15.87:0/871215587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608efa48730 0x5608efa58210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3b14000c00 tx=0x7f3b140bb4d0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.621+0000 7f3b2ebc0740 1 -- 172.21.15.87:0/871215587 shutdown_connections 2024-09-13T17:16:06.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.621+0000 7f3b2ebc0740 1 --2- 172.21.15.87:0/871215587 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5608efab9c30 0x5608efabc050 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.621+0000 7f3b2ebc0740 1 --2- 172.21.15.87:0/871215587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608efa52fd0 0x5608efab7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.621+0000 7f3b0d7fa640 0 client.25706 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:06.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.621+0000 7f3b2ebc0740 1 --2- 172.21.15.87:0/871215587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608efa48730 0x5608efa58210 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.621+0000 7f3b2ebc0740 1 --2- 172.21.15.87:0/871215587 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608efa47e10 0x5608efa57cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.622+0000 7f3b2ebc0740 1 -- 172.21.15.87:0/871215587 >> 172.21.15.87:0/871215587 conn(0x5608efa44380 msgr2=0x5608efa44760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:06.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.622+0000 7f3b2ebc0740 1 -- 172.21.15.87:0/871215587 shutdown_connections 2024-09-13T17:16:06.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.622+0000 7f3b2ebc0740 1 -- 172.21.15.87:0/871215587 wait complete. 2024-09-13T17:16:06.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.622+0000 7f3b2ebc0740 20 client.25706 trim_cache size 0 max 16384 2024-09-13T17:16:06.635 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:16:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "scrub active (291 inodes in the stack)", 2024-09-13T17:16:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": { 2024-09-13T17:16:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: "8563f902-e689-4406-9a6c-d935ca989e6d": { 2024-09-13T17:16:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: "path": "/", 2024-09-13T17:16:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: "tag": "8563f902-e689-4406-9a6c-d935ca989e6d", 2024-09-13T17:16:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: "options": "recursive,force" 2024-09-13T17:16:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:16:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:16:06.636 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:16:06.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.622+0000 7f3b2be9c640 1 -- 172.21.15.87:0/405514387 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f3b100a12b0 msgr2=0x7f3b100a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:06.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.622+0000 7f3b2be9c640 1 --2- 172.21.15.87:0/405514387 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f3b100a12b0 0x7f3b100a3770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c013b70 tx=0x7f3b1c004ab0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.622+0000 7f3b2be9c640 1 -- 172.21.15.87:0/405514387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b24103fe0 msgr2=0x7f3b24100e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:06.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.622+0000 7f3b2be9c640 1 --2- 172.21.15.87:0/405514387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b24103fe0 0x7f3b24100e60 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3b14009900 tx=0x7f3b140040c0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.623+0000 7f3b2be9c640 1 -- 172.21.15.87:0/405514387 shutdown_connections 2024-09-13T17:16:06.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.623+0000 7f3b2be9c640 1 --2- 172.21.15.87:0/405514387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b241013a0 0x7f3b241a4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.623+0000 7f3b2be9c640 1 --2- 172.21.15.87:0/405514387 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f3b100a12b0 0x7f3b100a3770 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.623+0000 7f3b2be9c640 1 --2- 172.21.15.87:0/405514387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b24103fe0 0x7f3b24100e60 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.623+0000 7f3b2be9c640 1 --2- 172.21.15.87:0/405514387 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b240fee90 0x7f3b24100920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:06.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.623+0000 7f3b2be9c640 1 -- 172.21.15.87:0/405514387 >> 172.21.15.87:0/405514387 conn(0x7f3b240fa900 msgr2=0x7f3b24068410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:06.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.623+0000 7f3b2be9c640 1 -- 172.21.15.87:0/405514387 shutdown_connections 2024-09-13T17:16:06.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:06.623+0000 7f3b2be9c640 1 -- 172.21.15.87:0/405514387 wait complete. 2024-09-13T17:16:06.638 INFO:tasks.cephfs.filesystem:scrub status for tag:8563f902-e689-4406-9a6c-d935ca989e6d - {'path': '/', 'tag': '8563f902-e689-4406-9a6c-d935ca989e6d', 'options': 'recursive,force'} 2024-09-13T17:16:06.843 INFO:journalctl@ceph.mds.i.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-i[66198]: 2024-09-13T17:16:06.488+0000 7fa760a9b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000044c [...4,head] /volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/ auth{1=1,2=1} v3705 ap=2 f(v40 m2024-09-13T17:15:50.349284+0000 34=20+14) n(v2 rc2024-09-13T17:15:50.355925+0000 b244875 91=76+15) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15519=pAsLsXs/-@126} | ptrwaiter=0 dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5622b0b15600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000044c:[<0x10000000203/arm v1615>,<0x10000000202/Documentation v674>,<0x10000000201/linux-4.0.5 v36>,<0x10000000006/untar_tar v50>,<0x10000000005/tmp v50>,<0x10000000003/client.0 v36>,<0x10000000002/da8ae53e-9ccd-4a0b-9f6b-645aa215073b v53>,<0x10000000001/sv_0 v71>,<0x10000000000/qa v56>,<0x1/volumes v52>]//[]","memoryvalue":"(2)0x1000000044c:[<0x10000000203/arm v3705>,<0x10000000202/Documentation v2004>,<0x10000000201/linux-4.0.5 v617>,<0x10000000006/untar_tar v148>,<0x10000000005/tmp v141>,<0x10000000003/client.0 v125>,<0x10000000002/da8ae53e-9ccd-4a0b-9f6b-645aa215073b v138>,<0x10000000001/sv_0 v153>,<0x10000000000/qa v140>,<0x1/volumes v131>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T17:15:50.342382+0000 33=19+14)","ondisk_value.rstat":"n(v0 rc2024-09-13T17:15:50.351497+0000 b244875 91=76+15)","memory_value.dirstat":"f(v40 m2024-09-13T17:15:50.349284+0000 34=20+14)","memory_value.rstat":"n(v2 rc2024-09-13T17:15:50.355925+0000 b244875 91=76+15)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-09-13T17:16:06.843 INFO:journalctl@ceph.mds.i.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-i[66198]: 2024-09-13T17:16:06.493+0000 7fa760a9b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000553 [...4,head] /volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/ auth{1=1,2=1} v11221 ap=2 f(v150 m2024-09-13T17:15:32.894809+0000 94=75+19) n(v3 rc2024-09-13T17:15:32.902253+0000 b207851 156=136+20) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15519=pAsLsXs/-@408} | ptrwaiter=0 dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x5622b165b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000553:[<0x1000000054e/arm v3128>,<0x1000000054c/bindings v310>,<0x10000000203/devicetree v2565>,<0x10000000202/Documentation v674>,<0x10000000201/linux-4.0.5 v36>,<0x10000000006/untar_tar v50>,<0x10000000005/tmp v50>,<0x10000000003/client.0 v36>,<0x10000000002/da8ae53e-9ccd-4a0b-9f6b-645aa215073b v53>,<0x10000000001/sv_0 v71>,<0x10000000000/qa v56>,<0x1/volumes v52>]//[]","memoryvalue":"(2)0x10000000553:[<0x1000000054e/arm v11221>,<0x1000000054c/bindings v3535>,<0x10000000203/devicetree v3713>,<0x10000000202/Documentation v2004>,<0x10000000201/linux-4.0.5 v617>,<0x10000000006/untar_tar v148>,<0x10000000005/tmp v141>,<0x10000000003/client.0 v125>,<0x10000000002/da8ae53e-9ccd-4a0b-9f6b-645aa215073b v138>,<0x10000000001/sv_0 v153>,<0x10000000000/qa v140>,<0x1/volumes v131>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T17:15:32.888048+0000 93=74+19)","ondisk_value.rstat":"n(v0 rc2024-09-13T17:15:32.897036+0000 b207851 156=136+20)","memory_value.dirstat":"f(v150 m2024-09-13T17:15:32.894809+0000 94=75+19)","memory_value.rstat":"n(v3 rc2024-09-13T17:15:32.902253+0000 b207851 156=136+20)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-09-13T17:16:06.843 INFO:journalctl@ceph.mds.i.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-i[66198]: 2024-09-13T17:16:06.500+0000 7fa760a9b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008b2 [...4,head] /volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net/ auth{1=1,2=1} v10409 ap=2 f(v122 m2024-09-13T17:15:34.779564+0000 66=61+5) n(v3 rc2024-09-13T17:15:34.787813+0000 b130960 88=82+6) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15519=pAsLsXs/-@321} | ptrwaiter=0 dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x5622b0fb2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x100000008b2:[<0x1000000054e/net v4500>,<0x1000000054c/bindings v310>,<0x10000000203/devicetree v2565>,<0x10000000202/Documentation v674>,<0x10000000201/linux-4.0.5 v36>,<0x10000000006/untar_tar v50>,<0x10000000005/tmp v50>,<0x10000000003/client.0 v36>,<0x10000000002/da8ae53e-9ccd-4a0b-9f6b-645aa215073b v53>,<0x10000000001/sv_0 v71>,<0x10000000000/qa v56>,<0x1/volumes v52>]//[]","memoryvalue":"(2)0x100000008b2:[<0x1000000054e/net v10409>,<0x1000000054c/bindings v3535>,<0x10000000203/devicetree v3713>,<0x10000000202/Documentation v2004>,<0x10000000201/linux-4.0.5 v617>,<0x10000000006/untar_tar v148>,<0x10000000005/tmp v141>,<0x10000000003/client.0 v125>,<0x10000000002/da8ae53e-9ccd-4a0b-9f6b-645aa215073b v138>,<0x10000000001/sv_0 v153>,<0x10000000000/qa v140>,<0x1/volumes v131>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T17:15:34.769988+0000 65=60+5)","ondisk_value.rstat":"n(v0 rc2024-09-13T17:15:34.782858+0000 b130960 88=82+6)","memory_value.dirstat":"f(v122 m2024-09-13T17:15:34.779564+0000 66=61+5)","memory_value.rstat":"n(v3 rc2024-09-13T17:15:34.787813+0000 b130960 88=82+6)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-09-13T17:16:06.843 INFO:journalctl@ceph.mds.i.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-i[66198]: 2024-09-13T17:16:06.503+0000 7fa760a9b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000086c [...4,head] /volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc/ auth{1=1,2=1} v10411 ap=2 f(v78 m2024-09-13T17:15:35.408241+0000 39=39+0) n(v1 rc2024-09-13T17:15:35.415644+0000 b52340 40=39+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15519=pAsLsXs/-@202} | ptrwaiter=0 dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5622b0677600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000086c:[<0x1000000054e/mmc v4306>,<0x1000000054c/bindings v310>,<0x10000000203/devicetree v2565>,<0x10000000202/Documentation v674>,<0x10000000201/linux-4.0.5 v36>,<0x10000000006/untar_tar v50>,<0x10000000005/tmp v50>,<0x10000000003/client.0 v36>,<0x10000000002/da8ae53e-9ccd-4a0b-9f6b-645aa215073b v53>,<0x10000000001/sv_0 v71>,<0x10000000000/qa v56>,<0x1/volumes v52>]//[]","memoryvalue":"(2)0x1000000086c:[<0x1000000054e/mmc v10411>,<0x1000000054c/bindings v3535>,<0x10000000203/devicetree v3713>,<0x10000000202/Documentation v2004>,<0x10000000201/linux-4.0.5 v617>,<0x10000000006/untar_tar v148>,<0x10000000005/tmp v141>,<0x10000000003/client.0 v125>,<0x10000000002/da8ae53e-9ccd-4a0b-9f6b-645aa215073b v138>,<0x10000000001/sv_0 v153>,<0x10000000000/qa v140>,<0x1/volumes v131>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T17:15:35.400628+0000 38=38+0)","ondisk_value.rstat":"n(v0 rc2024-09-13T17:15:35.410266+0000 b52340 40=39+1)","memory_value.dirstat":"f(v78 m2024-09-13T17:15:35.408241+0000 39=39+0)","memory_value.rstat":"n(v1 rc2024-09-13T17:15:35.415644+0000 b52340 40=39+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-09-13T17:16:06.843 INFO:journalctl@ceph.mds.i.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-i[66198]: 2024-09-13T17:16:06.516+0000 7fa760a9b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006da [...4,head] /volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio/ auth{1=1,2=1} v12699 ap=2 f(v108 m2024-09-13T17:15:37.783226+0000 54=54+0) n(v2 rc2024-09-13T17:15:37.790634+0000 b79229 55=54+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15519=pAsLsXs/-@277} | ptrwaiter=0 dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5622b11cf700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x100000006da:[<0x1000000054e/gpio v3640>,<0x1000000054c/bindings v310>,<0x10000000203/devicetree v2565>,<0x10000000202/Documentation v674>,<0x10000000201/linux-4.0.5 v36>,<0x10000000006/untar_tar v50>,<0x10000000005/tmp v50>,<0x10000000003/client.0 v36>,<0x10000000002/da8ae53e-9ccd-4a0b-9f6b-645aa215073b v53>,<0x10000000001/sv_0 v71>,<0x10000000000/qa v56>,<0x1/volumes v52>]//[]","memoryvalue":"(2)0x100000006da:[<0x1000000054e/gpio v12699>,<0x1000000054c/bindings v3535>,<0x10000000203/devicetree v3713>,<0x10000000202/Documentation v2004>,<0x10000000201/linux-4.0.5 v617>,<0x10000000006/untar_tar v148>,<0x10000000005/tmp v141>,<0x10000000003/client.0 v125>,<0x10000000002/da8ae53e-9ccd-4a0b-9f6b-645aa215073b v138>,<0x10000000001/sv_0 v153>,<0x10000000000/qa v140>,<0x1/volumes v131>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T17:15:37.776739+0000 53=53+0)","ondisk_value.rstat":"n(v0 rc2024-09-13T17:15:37.785717+0000 b79229 55=54+1)","memory_value.dirstat":"f(v108 m2024-09-13T17:15:37.783226+0000 54=54+0)","memory_value.rstat":"n(v2 rc2024-09-13T17:15:37.790634+0000 b79229 55=54+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-09-13T17:16:06.844 INFO:journalctl@ceph.mds.i.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-i[66198]: 2024-09-13T17:16:06.519+0000 7fa760a9b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000782 [...4,head] /volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input/ auth{1=1,2=1} v12023 ap=2 f(v80 m2024-09-13T17:15:38.574126+0000 41=40+1) n(v2 rc2024-09-13T17:15:38.593389+0000 b61927 57=55+2) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15519=pAsLsXs/-@208} | ptrwaiter=0 dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x5622b136ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000782:[<0x1000000054e/input v3908>,<0x1000000054c/bindings v310>,<0x10000000203/devicetree v2565>,<0x10000000202/Documentation v674>,<0x10000000201/linux-4.0.5 v36>,<0x10000000006/untar_tar v50>,<0x10000000005/tmp v50>,<0x10000000003/client.0 v36>,<0x10000000002/da8ae53e-9ccd-4a0b-9f6b-645aa215073b v53>,<0x10000000001/sv_0 v71>,<0x10000000000/qa v56>,<0x1/volumes v52>]//[]","memoryvalue":"(2)0x10000000782:[<0x1000000054e/input v12023>,<0x1000000054c/bindings v3535>,<0x10000000203/devicetree v3713>,<0x10000000202/Documentation v2006>,<0x10000000201/linux-4.0.5 v619>,<0x10000000006/untar_tar v148>,<0x10000000005/tmp v141>,<0x10000000003/client.0 v125>,<0x10000000002/da8ae53e-9ccd-4a0b-9f6b-645aa215073b v138>,<0x10000000001/sv_0 v153>,<0x10000000000/qa v140>,<0x1/volumes v131>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T17:15:38.554151+0000 40=39+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T17:15:38.578259+0000 b61927 57=55+2)","memory_value.dirstat":"f(v80 m2024-09-13T17:15:38.574126+0000 41=40+1)","memory_value.rstat":"n(v2 rc2024-09-13T17:15:38.593389+0000 b61927 57=55+2)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-09-13T17:16:06.844 INFO:journalctl@ceph.mds.i.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-i[66198]: 2024-09-13T17:16:06.520+0000 7fa760a9b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009f2 [...4,head] /volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/pwm/ auth{1=1,2=1} v12025 ap=2 f(v56 m2024-09-13T17:15:39.326632+0000 28=28+0) n(v1 rc2024-09-13T17:15:39.333626+0000 b24257 29=28+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15519=pAsLsXs/-@147} | ptrwaiter=0 dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5622b1ab2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x100000009f2:[<0x1000000054e/pwm v4900>,<0x1000000054c/bindings v310>,<0x10000000203/devicetree v2565>,<0x10000000202/Documentation v674>,<0x10000000201/linux-4.0.5 v36>,<0x10000000006/untar_tar v50>,<0x10000000005/tmp v50>,<0x10000000003/client.0 v36>,<0x10000000002/da8ae53e-9ccd-4a0b-9f6b-645aa215073b v53>,<0x10000000001/sv_0 v71>,<0x10000000000/qa v56>,<0x1/volumes v52>]//[]","memoryvalue":"(2)0x100000009f2:[<0x1000000054e/pwm v12025>,<0x1000000054c/bindings v3535>,<0x10000000203/devicetree v3713>,<0x10000000202/Documentation v2006>,<0x10000000201/linux-4.0.5 v619>,<0x10000000006/untar_tar v148>,<0x10000000005/tmp v141>,<0x10000000003/client.0 v125>,<0x10000000002/da8ae53e-9ccd-4a0b-9f6b-645aa215073b v138>,<0x10000000001/sv_0 v153>,<0x10000000000/qa v140>,<0x1/volumes v131>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T17:15:39.316361+0000 27=27+0)","ondisk_value.rstat":"n(v0 rc2024-09-13T17:15:39.328606+0000 b24257 29=28+1)","memory_value.dirstat":"f(v56 m2024-09-13T17:15:39.326632+0000 28=28+0)","memory_value.rstat":"n(v1 rc2024-09-13T17:15:39.333626+0000 b24257 29=28+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-09-13T17:16:06.844 INFO:journalctl@ceph.mds.i.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-i[66198]: 2024-09-13T17:16:06.528+0000 7fa760a9b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000760 [...4,head] /volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/iio/ auth{1=1,2=1} v12029 ap=2 f(v6 m2024-09-13T17:15:39.699844+0000 11=3+8) n(v2 rc2024-09-13T17:15:39.706679+0000 b30028 34=25+9) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15519=pAsLsXs/-@31} | ptrwaiter=0 dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x5622b1204580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000760:[<0x1000000054e/iio v3824>,<0x1000000054c/bindings v310>,<0x10000000203/devicetree v2565>,<0x10000000202/Documentation v674>,<0x10000000201/linux-4.0.5 v36>,<0x10000000006/untar_tar v50>,<0x10000000005/tmp v50>,<0x10000000003/client.0 v36>,<0x10000000002/da8ae53e-9ccd-4a0b-9f6b-645aa215073b v53>,<0x10000000001/sv_0 v71>,<0x10000000000/qa v56>,<0x1/volumes v52>]//[]","memoryvalue":"(2)0x10000000760:[<0x1000000054e/iio v12029>,<0x1000000054c/bindings v3535>,<0x10000000203/devicetree v3713>,<0x10000000202/Documentation v2006>,<0x10000000201/linux-4.0.5 v619>,<0x10000000006/untar_tar v148>,<0x10000000005/tmp v141>,<0x10000000003/client.0 v125>,<0x10000000002/da8ae53e-9ccd-4a0b-9f6b-645aa215073b v138>,<0x10000000001/sv_0 v153>,<0x10000000000/qa v140>,<0x1/volumes v131>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T17:15:39.692728+0000 10=2+8)","ondisk_value.rstat":"n(v0 rc2024-09-13T17:15:39.702025+0000 b30028 34=25+9)","memory_value.dirstat":"f(v6 m2024-09-13T17:15:39.699844+0000 11=3+8)","memory_value.rstat":"n(v2 rc2024-09-13T17:15:39.706679+0000 b30028 34=25+9)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-09-13T17:16:06.844 INFO:journalctl@ceph.mds.i.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-i[66198]: 2024-09-13T17:16:06.534+0000 7fa760a9b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000060e [...4,head] /volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/clock/ auth{1=1,2=1} v12033 ap=2 f(v184 m2024-09-13T17:15:41.756210+0000 94=92+2) n(v2 rc2024-09-13T17:15:41.763317+0000 b208130 115=112+3) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15519=pAsLsXs/-@469} | ptrwaiter=0 dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x5622b0a89600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000060e:[<0x1000000054e/clock v3382>,<0x1000000054c/bindings v310>,<0x10000000203/devicetree v2565>,<0x10000000202/Documentation v674>,<0x10000000201/linux-4.0.5 v36>,<0x10000000006/untar_tar v50>,<0x10000000005/tmp v50>,<0x10000000003/client.0 v36>,<0x10000000002/da8ae53e-9ccd-4a0b-9f6b-645aa215073b v53>,<0x10000000001/sv_0 v71>,<0x10000000000/qa v56>,<0x1/volumes v52>]//[]","memoryvalue":"(2)0x1000000060e:[<0x1000000054e/clock v12033>,<0x1000000054c/bindings v3535>,<0x10000000203/devicetree v3713>,<0x10000000202/Documentation v2006>,<0x10000000201/linux-4.0.5 v619>,<0x10000000006/untar_tar v148>,<0x10000000005/tmp v141>,<0x10000000003/client.0 v125>,<0x10000000002/da8ae53e-9ccd-4a0b-9f6b-645aa215073b v138>,<0x10000000001/sv_0 v153>,<0x10000000000/qa v140>,<0x1/volumes v131>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T17:15:41.749093+0000 93=91+2)","ondisk_value.rstat":"n(v0 rc2024-09-13T17:15:41.758370+0000 b208130 115=112+3)","memory_value.dirstat":"f(v184 m2024-09-13T17:15:41.756210+0000 94=92+2)","memory_value.rstat":"n(v2 rc2024-09-13T17:15:41.763317+0000 b208130 115=112+3)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-09-13T17:16:06.844 INFO:journalctl@ceph.mds.i.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-i[66198]: 2024-09-13T17:16:06.539+0000 7fa760a9b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000956 [...4,head] /volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ auth{1=1,2=1} v12803 ap=2 f(v114 m2024-09-13T17:15:42.883200+0000 57=57+0) n(v2 rc2024-09-13T17:15:42.890433+0000 b256555 58=57+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15519=pAsLsXs/-@292} | ptrwaiter=0 dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5622b1180680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000956:[<0x1000000054e/pinctrl v4768>,<0x1000000054c/bindings v310>,<0x10000000203/devicetree v2565>,<0x10000000202/Documentation v674>,<0x10000000201/linux-4.0.5 v36>,<0x10000000006/untar_tar v50>,<0x10000000005/tmp v50>,<0x10000000003/client.0 v36>,<0x10000000002/da8ae53e-9ccd-4a0b-9f6b-645aa215073b v53>,<0x10000000001/sv_0 v71>,<0x10000000000/qa v56>,<0x1/volumes v52>]//[]","memoryvalue":"(2)0x10000000956:[<0x1000000054e/pinctrl v12803>,<0x1000000054c/bindings v3535>,<0x10000000203/devicetree v3713>,<0x10000000202/Documentation v2006>,<0x10000000201/linux-4.0.5 v619>,<0x10000000006/untar_tar v148>,<0x10000000005/tmp v141>,<0x10000000003/client.0 v125>,<0x10000000002/da8ae53e-9ccd-4a0b-9f6b-645aa215073b v138>,<0x10000000001/sv_0 v153>,<0x10000000000/qa v140>,<0x1/volumes v131>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T17:15:42.876631+0000 56=56+0)","ondisk_value.rstat":"n(v0 rc2024-09-13T17:15:42.885112+0000 b256555 58=57+1)","memory_value.dirstat":"f(v114 m2024-09-13T17:15:42.883200+0000 57=57+0)","memory_value.rstat":"n(v2 rc2024-09-13T17:15:42.890433+0000 b256555 58=57+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-09-13T17:16:06.844 INFO:journalctl@ceph.mds.i.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-i[66198]: 2024-09-13T17:16:06.543+0000 7fa760a9b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000081e [...4,head] /volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mfd/ auth{1=1,2=1} v12701 ap=2 f(v90 m2024-09-13T17:15:43.645053+0000 45=45+0) n(v1 rc2024-09-13T17:15:43.651866+0000 b107252 46=45+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15519=pAsLsXs/-@232} | ptrwaiter=0 dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5622b1311080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000081e:[<0x1000000054e/mfd v4180>,<0x1000000054c/bindings v310>,<0x10000000203/devicetree v2565>,<0x10000000202/Documentation v674>,<0x10000000201/linux-4.0.5 v36>,<0x10000000006/untar_tar v50>,<0x10000000005/tmp v50>,<0x10000000003/client.0 v36>,<0x10000000002/da8ae53e-9ccd-4a0b-9f6b-645aa215073b v53>,<0x10000000001/sv_0 v71>,<0x10000000000/qa v56>,<0x1/volumes v52>]//[]","memoryvalue":"(2)0x1000000081e:[<0x1000000054e/mfd v12701>,<0x1000000054c/bindings v3537>,<0x10000000203/devicetree v3750>,<0x10000000202/Documentation v2008>,<0x10000000201/linux-4.0.5 v619>,<0x10000000006/untar_tar v148>,<0x10000000005/tmp v141>,<0x10000000003/client.0 v125>,<0x10000000002/da8ae53e-9ccd-4a0b-9f6b-645aa215073b v138>,<0x10000000001/sv_0 v153>,<0x10000000000/qa v140>,<0x1/volumes v131>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T17:15:43.637684+0000 44=44+0)","ondisk_value.rstat":"n(v0 rc2024-09-13T17:15:43.646978+0000 b107252 46=45+1)","memory_value.dirstat":"f(v90 m2024-09-13T17:15:43.645053+0000 45=45+0)","memory_value.rstat":"n(v1 rc2024-09-13T17:15:43.651866+0000 b107252 46=45+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-09-13T17:16:06.844 INFO:journalctl@ceph.mds.i.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-i[66198]: 2024-09-13T17:16:06.546+0000 7fa760a9b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000910 [...4,head] /volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/panel/ auth{1=1,2=1} v12703 ap=2 f(v54 m2024-09-13T17:15:44.270953+0000 27=27+0) n(v1 rc2024-09-13T17:15:44.278242+0000 b11238 28=27+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15519=pAsLsXs/-@142} | ptrwaiter=0 dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5622b115d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000910:[<0x1000000054e/panel v4568>,<0x1000000054c/bindings v310>,<0x10000000203/devicetree v2565>,<0x10000000202/Documentation v674>,<0x10000000201/linux-4.0.5 v36>,<0x10000000006/untar_tar v50>,<0x10000000005/tmp v50>,<0x10000000003/client.0 v36>,<0x10000000002/da8ae53e-9ccd-4a0b-9f6b-645aa215073b v53>,<0x10000000001/sv_0 v71>,<0x10000000000/qa v56>,<0x1/volumes v52>]//[]","memoryvalue":"(2)0x10000000910:[<0x1000000054e/panel v12703>,<0x1000000054c/bindings v3537>,<0x10000000203/devicetree v3750>,<0x10000000202/Documentation v2008>,<0x10000000201/linux-4.0.5 v619>,<0x10000000006/untar_tar v148>,<0x10000000005/tmp v141>,<0x10000000003/client.0 v125>,<0x10000000002/da8ae53e-9ccd-4a0b-9f6b-645aa215073b v138>,<0x10000000001/sv_0 v153>,<0x10000000000/qa v140>,<0x1/volumes v131>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T17:15:44.264285+0000 26=26+0)","ondisk_value.rstat":"n(v0 rc2024-09-13T17:15:44.273343+0000 b11238 28=27+1)","memory_value.dirstat":"f(v54 m2024-09-13T17:15:44.270953+0000 27=27+0)","memory_value.rstat":"n(v1 rc2024-09-13T17:15:44.278242+0000 b11238 28=27+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-09-13T17:16:06.844 INFO:journalctl@ceph.mds.i.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-i[66198]: 2024-09-13T17:16:06.553+0000 7fa760a9b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000072b [...4,head] /volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/i2c/ auth{1=1,2=1} v12707 ap=2 f(v104 m2024-09-13T17:15:45.475431+0000 52=52+0) n(v1 rc2024-09-13T17:15:45.482818+0000 b65491 53=52+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15519=pAsLsXs/-@267} | ptrwaiter=0 dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5622b1041080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000072b:[<0x1000000054e/i2c v3798>,<0x1000000054c/bindings v310>,<0x10000000203/devicetree v2565>,<0x10000000202/Documentation v674>,<0x10000000201/linux-4.0.5 v36>,<0x10000000006/untar_tar v50>,<0x10000000005/tmp v50>,<0x10000000003/client.0 v36>,<0x10000000002/da8ae53e-9ccd-4a0b-9f6b-645aa215073b v53>,<0x10000000001/sv_0 v71>,<0x10000000000/qa v56>,<0x1/volumes v52>]//[]","memoryvalue":"(2)0x1000000072b:[<0x1000000054e/i2c v12707>,<0x1000000054c/bindings v3537>,<0x10000000203/devicetree v3750>,<0x10000000202/Documentation v2008>,<0x10000000201/linux-4.0.5 v619>,<0x10000000006/untar_tar v148>,<0x10000000005/tmp v141>,<0x10000000003/client.0 v125>,<0x10000000002/da8ae53e-9ccd-4a0b-9f6b-645aa215073b v138>,<0x10000000001/sv_0 v153>,<0x10000000000/qa v140>,<0x1/volumes v131>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T17:15:45.467853+0000 51=51+0)","ondisk_value.rstat":"n(v0 rc2024-09-13T17:15:45.477650+0000 b65491 53=52+1)","memory_value.dirstat":"f(v104 m2024-09-13T17:15:45.475431+0000 52=52+0)","memory_value.rstat":"n(v1 rc2024-09-13T17:15:45.482818+0000 b65491 53=52+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-09-13T17:16:06.844 INFO:journalctl@ceph.mds.i.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-i[66198]: 2024-09-13T17:16:06.554+0000 7fa760a9b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000894 [...4,head] /volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mtd/ auth{1=1,2=1} v12709 ap=2 f(v58 m2024-09-13T17:15:46.172606+0000 29=29+0) n(v1 rc2024-09-13T17:15:46.179645+0000 b45161 30=29+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15519=pAsLsXs/-@152} | ptrwaiter=0 dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5622b0ebc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000894:[<0x1000000054e/mtd v4366>,<0x1000000054c/bindings v310>,<0x10000000203/devicetree v2565>,<0x10000000202/Documentation v674>,<0x10000000201/linux-4.0.5 v36>,<0x10000000006/untar_tar v50>,<0x10000000005/tmp v50>,<0x10000000003/client.0 v36>,<0x10000000002/da8ae53e-9ccd-4a0b-9f6b-645aa215073b v53>,<0x10000000001/sv_0 v71>,<0x10000000000/qa v56>,<0x1/volumes v52>]//[]","memoryvalue":"(2)0x10000000894:[<0x1000000054e/mtd v12709>,<0x1000000054c/bindings v3537>,<0x10000000203/devicetree v3750>,<0x10000000202/Documentation v2008>,<0x10000000201/linux-4.0.5 v619>,<0x10000000006/untar_tar v148>,<0x10000000005/tmp v141>,<0x10000000003/client.0 v125>,<0x10000000002/da8ae53e-9ccd-4a0b-9f6b-645aa215073b v138>,<0x10000000001/sv_0 v153>,<0x10000000000/qa v140>,<0x1/volumes v131>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T17:15:46.165514+0000 28=28+0)","ondisk_value.rstat":"n(v0 rc2024-09-13T17:15:46.174607+0000 b45161 30=29+1)","memory_value.dirstat":"f(v58 m2024-09-13T17:15:46.172606+0000 29=29+0)","memory_value.rstat":"n(v1 rc2024-09-13T17:15:46.179645+0000 b45161 30=29+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-09-13T17:16:06.844 INFO:journalctl@ceph.mds.i.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-i[66198]: 2024-09-13T17:16:06.559+0000 7fa760a9b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ba9 [...4,head] /volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/video/ auth{1=1,2=1} v12801 ap=2 f(v94 m2024-09-13T17:15:48.076563+0000 49=47+2) n(v3 rc2024-09-13T17:15:48.084162+0000 b77468 58=55+3) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15519=pAsLsXs/-@244} | ptrwaiter=0 dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5622b23d2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000ba9:[<0x1000000054e/video v2850>,<0x1000000054c/bindings v310>,<0x10000000203/devicetree v2565>,<0x10000000202/Documentation v674>,<0x10000000201/linux-4.0.5 v36>,<0x10000000006/untar_tar v50>,<0x10000000005/tmp v50>,<0x10000000003/client.0 v36>,<0x10000000002/da8ae53e-9ccd-4a0b-9f6b-645aa215073b v53>,<0x10000000001/sv_0 v71>,<0x10000000000/qa v56>,<0x1/volumes v52>]//[]","memoryvalue":"(2)0x10000000ba9:[<0x1000000054e/video v12801>,<0x1000000054c/bindings v3537>,<0x10000000203/devicetree v3750>,<0x10000000202/Documentation v2008>,<0x10000000201/linux-4.0.5 v619>,<0x10000000006/untar_tar v148>,<0x10000000005/tmp v141>,<0x10000000003/client.0 v125>,<0x10000000002/da8ae53e-9ccd-4a0b-9f6b-645aa215073b v138>,<0x10000000001/sv_0 v153>,<0x10000000000/qa v140>,<0x1/volumes v131>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T17:15:48.069550+0000 48=46+2)","ondisk_value.rstat":"n(v0 rc2024-09-13T17:15:48.078784+0000 b77468 58=55+3)","memory_value.dirstat":"f(v94 m2024-09-13T17:15:48.076563+0000 49=47+2)","memory_value.rstat":"n(v3 rc2024-09-13T17:15:48.084162+0000 b77468 58=55+3)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-09-13T17:16:06.844 INFO:journalctl@ceph.mds.i.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-i[66198]: 2024-09-13T17:16:06.561+0000 7fa760a9b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ec [...4,head] /volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/ auth{1=1,2=1} v12805 ap=2 f(v50 m2024-09-13T17:15:48.587073+0000 26=25+1) n(v2 rc2024-09-13T17:15:48.595467+0000 b54902 35=33+2) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15519=pAsLsXs/-@133} | ptrwaiter=0 dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x5622b0278c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x100000007ec:[<0x1000000054e/media v4060>,<0x1000000054c/bindings v310>,<0x10000000203/devicetree v2565>,<0x10000000202/Documentation v674>,<0x10000000201/linux-4.0.5 v36>,<0x10000000006/untar_tar v50>,<0x10000000005/tmp v50>,<0x10000000003/client.0 v36>,<0x10000000002/da8ae53e-9ccd-4a0b-9f6b-645aa215073b v53>,<0x10000000001/sv_0 v71>,<0x10000000000/qa v56>,<0x1/volumes v52>]//[]","memoryvalue":"(2)0x100000007ec:[<0x1000000054e/media v12805>,<0x1000000054c/bindings v3537>,<0x10000000203/devicetree v3750>,<0x10000000202/Documentation v2008>,<0x10000000201/linux-4.0.5 v619>,<0x10000000006/untar_tar v148>,<0x10000000005/tmp v141>,<0x10000000003/client.0 v125>,<0x10000000002/da8ae53e-9ccd-4a0b-9f6b-645aa215073b v138>,<0x10000000001/sv_0 v153>,<0x10000000000/qa v140>,<0x1/volumes v131>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T17:15:48.578927+0000 25=24+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T17:15:48.590228+0000 b54902 35=33+2)","memory_value.dirstat":"f(v50 m2024-09-13T17:15:48.587073+0000 26=25+1)","memory_value.rstat":"n(v2 rc2024-09-13T17:15:48.595467+0000 b54902 35=33+2)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-09-13T17:16:07.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:06 smithi118 ceph-mon[34374]: scrub queued for path: / 2024-09-13T17:16:07.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:06 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:07.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:06 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:07.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:06 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:07.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:06 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:07.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:06 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:07.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:06 smithi118 ceph-mon[34374]: Scrub error on inode 0x1000000044c (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:06 smithi118 ceph-mon[34374]: Scrub error on inode 0x10000000553 (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:06 smithi118 ceph-mon[34374]: Scrub error on inode 0x100000008b2 (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:06 smithi118 ceph-mon[34374]: Scrub error on inode 0x1000000086c (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.115 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:06 smithi118 ceph-mon[34374]: Scrub error on inode 0x100000006da (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.115 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:06 smithi118 ceph-mon[34374]: Scrub error on inode 0x10000000782 (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.115 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:06 smithi118 ceph-mon[34374]: Scrub error on inode 0x100000009f2 (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/pwm) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.115 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:06 smithi118 ceph-mon[34374]: Scrub error on inode 0x10000000760 (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/iio) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.115 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:06 smithi118 ceph-mon[34374]: Scrub error on inode 0x1000000060e (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/clock) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.115 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:06 smithi118 ceph-mon[34374]: Scrub error on inode 0x10000000956 (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/pinctrl) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.115 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:06 smithi118 ceph-mon[34374]: Scrub error on inode 0x1000000081e (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mfd) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.115 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:06 smithi118 ceph-mon[34374]: Scrub error on inode 0x10000000910 (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/panel) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.116 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:06 smithi118 ceph-mon[34374]: Scrub error on inode 0x1000000072b (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/i2c) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.116 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:06 smithi118 ceph-mon[34374]: Scrub error on inode 0x10000000894 (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mtd) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.116 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:06 smithi118 ceph-mon[34374]: Scrub error on inode 0x10000000ba9 (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/video) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.116 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:06 smithi118 ceph-mon[34374]: Scrub error on inode 0x100000007ec (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.116 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:06 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:07.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:06 smithi087 ceph-mon[30934]: scrub queued for path: / 2024-09-13T17:16:07.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:06 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:07.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:06 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:07.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:06 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:07.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:06 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:07.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:06 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:07.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:06 smithi087 ceph-mon[30934]: Scrub error on inode 0x1000000044c (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:06 smithi087 ceph-mon[30934]: Scrub error on inode 0x10000000553 (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:06 smithi087 ceph-mon[30934]: Scrub error on inode 0x100000008b2 (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:06 smithi087 ceph-mon[30934]: Scrub error on inode 0x1000000086c (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:06 smithi087 ceph-mon[30934]: Scrub error on inode 0x100000006da (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:06 smithi087 ceph-mon[30934]: Scrub error on inode 0x10000000782 (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:06 smithi087 ceph-mon[30934]: Scrub error on inode 0x100000009f2 (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/pwm) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.230 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:06 smithi087 ceph-mon[30934]: Scrub error on inode 0x10000000760 (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/iio) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.231 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:06 smithi087 ceph-mon[30934]: Scrub error on inode 0x1000000060e (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/clock) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.231 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:06 smithi087 ceph-mon[30934]: Scrub error on inode 0x10000000956 (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/pinctrl) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.231 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:06 smithi087 ceph-mon[30934]: Scrub error on inode 0x1000000081e (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mfd) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.231 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:06 smithi087 ceph-mon[30934]: Scrub error on inode 0x10000000910 (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/panel) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.231 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:06 smithi087 ceph-mon[30934]: Scrub error on inode 0x1000000072b (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/i2c) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.231 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:06 smithi087 ceph-mon[30934]: Scrub error on inode 0x10000000894 (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mtd) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.231 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:06 smithi087 ceph-mon[30934]: Scrub error on inode 0x10000000ba9 (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/video) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.231 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:06 smithi087 ceph-mon[30934]: Scrub error on inode 0x100000007ec (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.231 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:06 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:07.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-mon[35496]: scrub queued for path: / 2024-09-13T17:16:07.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:07.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:07.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:07.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:07.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:07.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-mon[35496]: Scrub error on inode 0x1000000044c (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-mon[35496]: Scrub error on inode 0x10000000553 (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-mon[35496]: Scrub error on inode 0x100000008b2 (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/net) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-mon[35496]: Scrub error on inode 0x1000000086c (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mmc) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-mon[35496]: Scrub error on inode 0x100000006da (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/gpio) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-mon[35496]: Scrub error on inode 0x10000000782 (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/input) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-mon[35496]: Scrub error on inode 0x100000009f2 (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/pwm) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-mon[35496]: Scrub error on inode 0x10000000760 (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/iio) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.344 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-mon[35496]: Scrub error on inode 0x1000000060e (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/clock) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.344 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-mon[35496]: Scrub error on inode 0x10000000956 (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/pinctrl) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.344 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-mon[35496]: Scrub error on inode 0x1000000081e (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mfd) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.344 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-mon[35496]: Scrub error on inode 0x10000000910 (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/panel) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.344 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-mon[35496]: Scrub error on inode 0x1000000072b (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/i2c) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.344 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-mon[35496]: Scrub error on inode 0x10000000894 (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mtd) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.344 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-mon[35496]: Scrub error on inode 0x10000000ba9 (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/video) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.344 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-mon[35496]: Scrub error on inode 0x100000007ec (/volumes/qa/sv_0/da8ae53e-9ccd-4a0b-9f6b-645aa215073b/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media) see mds.i log and `damage ls` output for details 2024-09-13T17:16:07.344 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:06 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:08.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:07 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:08.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:07 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:08.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:07 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:08.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:07 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:08.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:07 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:08.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:07 smithi118 ceph-mon[34374]: pgmap v72: 129 pgs: 129 active+clean; 154 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 379 op/s 2024-09-13T17:16:08.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:07 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:08.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:07 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:08.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:07 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:08.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:07 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:08.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:07 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:08.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:07 smithi087 ceph-mon[30934]: pgmap v72: 129 pgs: 129 active+clean; 154 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 379 op/s 2024-09-13T17:16:08.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:07 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:08.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:07 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:08.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:07 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:08.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:07 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:08.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:07 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:08.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:07 smithi149 ceph-mon[35496]: pgmap v72: 129 pgs: 129 active+clean; 154 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 379 op/s 2024-09-13T17:16:10.816 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:10 smithi118 ceph-mon[34374]: pgmap v73: 129 pgs: 129 active+clean; 154 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 379 op/s 2024-09-13T17:16:10.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:10 smithi149 ceph-mon[35496]: pgmap v73: 129 pgs: 129 active+clean; 154 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 379 op/s 2024-09-13T17:16:10.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:10 smithi087 ceph-mon[30934]: pgmap v73: 129 pgs: 129 active+clean; 154 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 379 op/s 2024-09-13T17:16:12.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:12 smithi149 ceph-mon[35496]: pgmap v74: 129 pgs: 129 active+clean; 159 MiB data, 940 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 MiB/s wr, 553 op/s 2024-09-13T17:16:12.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:12 smithi118 ceph-mon[34374]: pgmap v74: 129 pgs: 129 active+clean; 159 MiB data, 940 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 MiB/s wr, 553 op/s 2024-09-13T17:16:12.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:12 smithi087 ceph-mon[30934]: pgmap v74: 129 pgs: 129 active+clean; 159 MiB data, 940 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 MiB/s wr, 553 op/s 2024-09-13T17:16:13.262 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.258+0000 7fd2d4241640 1 -- 172.21.15.87:0/3390556509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2cc0fecb0 msgr2=0x7fd2cc0ff090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:13.263 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.258+0000 7fd2d4241640 1 --2- 172.21.15.87:0/3390556509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2cc0fecb0 0x7fd2cc0ff090 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8009960 tx=0x7fd2c802a4f0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.263 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.258+0000 7fd2d4241640 1 -- 172.21.15.87:0/3390556509 shutdown_connections 2024-09-13T17:16:13.263 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.258+0000 7fd2d4241640 1 --2- 172.21.15.87:0/3390556509 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2cc1040e0 0x7fd2cc104590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.263 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.258+0000 7fd2d4241640 1 --2- 172.21.15.87:0/3390556509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2cc0ff5d0 0x7fd2cc103a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.263 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.258+0000 7fd2d4241640 1 --2- 172.21.15.87:0/3390556509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2cc0fecb0 0x7fd2cc0ff090 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.263 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.258+0000 7fd2d4241640 1 -- 172.21.15.87:0/3390556509 >> 172.21.15.87:0/3390556509 conn(0x7fd2cc0fa8d0 msgr2=0x7fd2cc0fccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:13.263 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.258+0000 7fd2d4241640 1 -- 172.21.15.87:0/3390556509 shutdown_connections 2024-09-13T17:16:13.263 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.258+0000 7fd2d4241640 1 -- 172.21.15.87:0/3390556509 wait complete. 2024-09-13T17:16:13.263 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.259+0000 7fd2d4241640 1 Processor -- start 2024-09-13T17:16:13.263 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.259+0000 7fd2d4241640 1 -- start start 2024-09-13T17:16:13.263 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.259+0000 7fd2d4241640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2cc0fecb0 0x7fd2cc1a25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:13.264 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.259+0000 7fd2d4241640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2cc0ff5d0 0x7fd2cc1a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:13.264 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.259+0000 7fd2d4241640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2cc1040e0 0x7fd2cc19c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:13.264 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.259+0000 7fd2d4241640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc19ccc0 con 0x7fd2cc0ff5d0 2024-09-13T17:16:13.264 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.259+0000 7fd2d4241640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc19ce30 con 0x7fd2cc1040e0 2024-09-13T17:16:13.264 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.259+0000 7fd2d4241640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc19cff0 con 0x7fd2cc0fecb0 2024-09-13T17:16:13.264 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.259+0000 7fd2d17dc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2cc0ff5d0 0x7fd2cc1a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:13.264 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.259+0000 7fd2d17dc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2cc0ff5d0 0x7fd2cc1a2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57224/0 (socket says 172.21.15.87:57224) 2024-09-13T17:16:13.264 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.259+0000 7fd2d17dc640 1 -- 172.21.15.87:0/197039211 learned_addr learned my addr 172.21.15.87:0/197039211 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:13.264 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.259+0000 7fd2d1fdd640 1 --2- 172.21.15.87:0/197039211 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2cc0fecb0 0x7fd2cc1a25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:13.264 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.259+0000 7fd2d27de640 1 --2- 172.21.15.87:0/197039211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2cc1040e0 0x7fd2cc19c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:13.264 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.260+0000 7fd2d17dc640 1 -- 172.21.15.87:0/197039211 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2cc0fecb0 msgr2=0x7fd2cc1a25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:13.264 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.260+0000 7fd2d17dc640 1 --2- 172.21.15.87:0/197039211 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2cc0fecb0 0x7fd2cc1a25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.265 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.260+0000 7fd2d17dc640 1 -- 172.21.15.87:0/197039211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2cc1040e0 msgr2=0x7fd2cc19c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:13.265 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.260+0000 7fd2d17dc640 1 --2- 172.21.15.87:0/197039211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2cc1040e0 0x7fd2cc19c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.265 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.260+0000 7fd2d17dc640 1 -- 172.21.15.87:0/197039211 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c8009560 con 0x7fd2cc0ff5d0 2024-09-13T17:16:13.265 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.260+0000 7fd2d17dc640 1 --2- 172.21.15.87:0/197039211 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2cc0ff5d0 0x7fd2cc1a2b00 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc00e9f0 tx=0x7fd2bc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:13.265 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.260+0000 7fd2c2ffd640 1 -- 172.21.15.87:0/197039211 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc009700 con 0x7fd2cc0ff5d0 2024-09-13T17:16:13.265 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.260+0000 7fd2c2ffd640 1 -- 172.21.15.87:0/197039211 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd2bc00cd80 con 0x7fd2cc0ff5d0 2024-09-13T17:16:13.265 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.260+0000 7fd2d4241640 1 -- 172.21.15.87:0/197039211 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2cc19d2d0 con 0x7fd2cc0ff5d0 2024-09-13T17:16:13.265 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.260+0000 7fd2c2ffd640 1 -- 172.21.15.87:0/197039211 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc018840 con 0x7fd2cc0ff5d0 2024-09-13T17:16:13.265 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.260+0000 7fd2d4241640 1 -- 172.21.15.87:0/197039211 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2cc1a95b0 con 0x7fd2cc0ff5d0 2024-09-13T17:16:13.271 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.262+0000 7fd2c2ffd640 1 -- 172.21.15.87:0/197039211 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fd2bc0189a0 con 0x7fd2cc0ff5d0 2024-09-13T17:16:13.271 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.263+0000 7fd2d7046740 1 Processor -- start 2024-09-13T17:16:13.271 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.263+0000 7fd2d7046740 1 -- start start 2024-09-13T17:16:13.271 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.263+0000 7fd2d7046740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555ff01ce330 0x555ff01ce710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:13.271 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.263+0000 7fd2d7046740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ff01cec50 0x555ff01d8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:13.272 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.263+0000 7fd2d7046740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ff01d94f0 0x555ff01db8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:13.272 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.263+0000 7fd2d7046740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ff0139c30 con 0x555ff01d94f0 2024-09-13T17:16:13.272 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.263+0000 7fd2d7046740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ff01373c0 con 0x555ff01cec50 2024-09-13T17:16:13.272 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.263+0000 7fd2d7046740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ff0132cb0 con 0x555ff01ce330 2024-09-13T17:16:13.272 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.263+0000 7fd2d17dc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ff01d94f0 0x555ff01db8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:13.272 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.263+0000 7fd2d27de640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555ff01ce330 0x555ff01ce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:13.272 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.263+0000 7fd2d17dc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ff01d94f0 0x555ff01db8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57238/0 (socket says 172.21.15.87:57238) 2024-09-13T17:16:13.272 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.263+0000 7fd2d17dc640 1 -- 172.21.15.87:0/670495859 learned_addr learned my addr 172.21.15.87:0/670495859 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:13.272 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.263+0000 7fd2d1fdd640 1 --2- 172.21.15.87:0/670495859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ff01cec50 0x555ff01d8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:13.272 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.263+0000 7fd2c2ffd640 1 --2- 172.21.15.87:0/197039211 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd2b80a1200 0x7fd2b80a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:13.272 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.263+0000 7fd2d27de640 1 --2- 172.21.15.87:0/197039211 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd2b80a1200 0x7fd2b80a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:13.272 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.263+0000 7fd2d17dc640 1 -- 172.21.15.87:0/670495859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555ff01ce330 msgr2=0x555ff01ce710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:13.273 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.264+0000 7fd2d17dc640 1 --2- 172.21.15.87:0/670495859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555ff01ce330 0x555ff01ce710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.273 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.264+0000 7fd2d17dc640 1 -- 172.21.15.87:0/670495859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ff01cec50 msgr2=0x555ff01d8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:13.273 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.264+0000 7fd2d17dc640 1 --2- 172.21.15.87:0/670495859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ff01cec50 0x555ff01d8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.273 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.264+0000 7fd2d17dc640 1 -- 172.21.15.87:0/670495859 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ff00d9910 con 0x555ff01d94f0 2024-09-13T17:16:13.273 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.264+0000 7fd2d1fdd640 1 --2- 172.21.15.87:0/670495859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ff01cec50 0x555ff01d8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:16:13.273 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.264+0000 7fd2c2ffd640 1 -- 172.21.15.87:0/197039211 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fd2bc014070 con 0x7fd2cc0ff5d0 2024-09-13T17:16:13.273 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.264+0000 7fd2d17dc640 1 --2- 172.21.15.87:0/670495859 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ff01d94f0 0x555ff01db8e0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc096c40 tx=0x7fd2bc024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49125182ff02ea6b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:13.273 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.264+0000 7fd2d27de640 1 --2- 172.21.15.87:0/197039211 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd2b80a1200 0x7fd2b80a36c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4005fd0 tx=0x7fd2c4004ab0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:13.273 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.264+0000 7fd2b7fff640 1 -- 172.21.15.87:0/670495859 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc025170 con 0x555ff01d94f0 2024-09-13T17:16:13.273 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.264+0000 7fd2b7fff640 1 -- 172.21.15.87:0/670495859 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd2bc09a8d0 con 0x555ff01d94f0 2024-09-13T17:16:13.273 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.264+0000 7fd2b7fff640 1 -- 172.21.15.87:0/670495859 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc09e000 con 0x555ff01d94f0 2024-09-13T17:16:13.273 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.265+0000 7fd2d7046740 1 -- 172.21.15.87:0/670495859 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ff01d94f0 msgr2=0x555ff01db8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:13.273 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.265+0000 7fd2d7046740 1 --2- 172.21.15.87:0/670495859 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ff01d94f0 0x555ff01db8e0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc096c40 tx=0x7fd2bc024000 comp rx=0 tx=0).stop 2024-09-13T17:16:13.274 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.265+0000 7fd2d7046740 1 -- 172.21.15.87:0/670495859 shutdown_connections 2024-09-13T17:16:13.274 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.265+0000 7fd2d7046740 1 --2- 172.21.15.87:0/670495859 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ff01d94f0 0x555ff01db8e0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.274 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.265+0000 7fd2d7046740 1 --2- 172.21.15.87:0/670495859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ff01cec50 0x555ff01d8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.274 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.265+0000 7fd2d7046740 1 --2- 172.21.15.87:0/670495859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555ff01ce330 0x555ff01ce710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.274 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.265+0000 7fd2d7046740 1 -- 172.21.15.87:0/670495859 >> 172.21.15.87:0/670495859 conn(0x555ff01ca8c0 msgr2=0x555ff01caca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:13.274 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.265+0000 7fd2d7046740 1 -- 172.21.15.87:0/670495859 shutdown_connections 2024-09-13T17:16:13.274 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.265+0000 7fd2d7046740 1 -- 172.21.15.87:0/670495859 wait complete. 2024-09-13T17:16:13.274 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.265+0000 7fd2d7046740 1 -- start start 2024-09-13T17:16:13.274 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.265+0000 7fd2d7046740 1 Processor -- start 2024-09-13T17:16:13.274 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.266+0000 7fd2d7046740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ff01ce330 0x555ff01d8e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:13.275 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.266+0000 7fd2d7046740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ff01cec50 0x555ff01d6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:13.275 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.266+0000 7fd2d7046740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555ff01d94f0 0x555ff01d66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:13.275 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.266+0000 7fd2d7046740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ff00f0e80 con 0x555ff01cec50 2024-09-13T17:16:13.275 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.266+0000 7fd2d7046740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ff00f0b20 con 0x555ff01ce330 2024-09-13T17:16:13.275 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.266+0000 7fd2d7046740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ff00b6260 con 0x555ff01d94f0 2024-09-13T17:16:13.275 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.266+0000 7fd2d7046740 10 client.0 _ll_register_callbacks cb 0x555ff00ebdf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:13.275 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.266+0000 7fd2d17dc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ff01cec50 0x555ff01d6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:13.275 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.266+0000 7fd2d17dc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ff01cec50 0x555ff01d6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57242/0 (socket says 172.21.15.87:57242) 2024-09-13T17:16:13.275 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.266+0000 7fd2d17dc640 1 -- 172.21.15.87:0/4277048832 learned_addr learned my addr 172.21.15.87:0/4277048832 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:13.275 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.266+0000 7fd2d27de640 1 --2- 172.21.15.87:0/4277048832 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555ff01d94f0 0x555ff01d66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:13.275 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.266+0000 7fd2d1fdd640 1 --2- 172.21.15.87:0/4277048832 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ff01ce330 0x555ff01d8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:13.275 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.266+0000 7fd2d17dc640 1 -- 172.21.15.87:0/4277048832 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555ff01d94f0 msgr2=0x555ff01d66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:13.276 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.266+0000 7fd2d17dc640 1 --2- 172.21.15.87:0/4277048832 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555ff01d94f0 0x555ff01d66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.276 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.266+0000 7fd2d17dc640 1 -- 172.21.15.87:0/4277048832 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ff01ce330 msgr2=0x555ff01d8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:13.276 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.266+0000 7fd2d17dc640 1 --2- 172.21.15.87:0/4277048832 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ff01ce330 0x555ff01d8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.276 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.266+0000 7fd2d17dc640 1 -- 172.21.15.87:0/4277048832 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2cc1a95b0 con 0x555ff01cec50 2024-09-13T17:16:13.276 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.266+0000 7fd2d17dc640 1 --2- 172.21.15.87:0/4277048832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ff01cec50 0x555ff01d6110 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc09a160 tx=0x7fd2bc09aa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d8dd7cc007b6a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:13.276 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.266+0000 7fd2b57fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:16:13.276 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.266+0000 7fd2b57fa640 1 -- 172.21.15.87:0/4277048832 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc025170 con 0x555ff01cec50 2024-09-13T17:16:13.276 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.266+0000 7fd2b57fa640 1 -- 172.21.15.87:0/4277048832 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fd2bc0a2650 con 0x555ff01cec50 2024-09-13T17:16:13.276 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.266+0000 7fd2d7046740 1 -- 172.21.15.87:0/4277048832 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555ff015b680 con 0x555ff01cec50 2024-09-13T17:16:13.276 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.267+0000 7fd2b57fa640 1 -- 172.21.15.87:0/4277048832 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2bc09e000 con 0x555ff01cec50 2024-09-13T17:16:13.276 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.267+0000 7fd2d7046740 10 client.16401 fetch_fsmap learned FSMap version 26 2024-09-13T17:16:13.276 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.267+0000 7fd2d7046740 1 -- 172.21.15.87:0/4277048832 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555ff0131330 con 0x555ff01cec50 2024-09-13T17:16:13.276 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.267+0000 7fd2b57fa640 1 -- 172.21.15.87:0/4277048832 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x555ff015b680 con 0x555ff01cec50 2024-09-13T17:16:13.277 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.267+0000 7fd2b57fa640 1 -- 172.21.15.87:0/4277048832 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fd2bc095fc0 con 0x555ff01cec50 2024-09-13T17:16:13.277 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.267+0000 7fd2d7046740 10 client.16401 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T17:16:13.277 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.267+0000 7fd2d7046740 10 client.16401 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-13T17:16:13.277 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.267+0000 7fd2d7046740 20 client.16401 populate_metadata read hostname 'smithi087' 2024-09-13T17:16:13.277 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.267+0000 7fd2d7046740 1 --2- 172.21.15.87:0/4277048832 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x555ff01e8c90 0x555ff01eb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:13.277 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.267+0000 7fd2d7046740 4 client.16401 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:16:13.277 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.267+0000 7fd2d7046740 1 -- 172.21.15.87:0/4277048832 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555ff01265d0 con 0x555ff01e8c90 2024-09-13T17:16:13.277 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.267+0000 7fd2d1fdd640 1 --2- 172.21.15.87:0/4277048832 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x555ff01e8c90 0x555ff01eb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:13.277 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.268+0000 7fd2b57fa640 10 client.16401 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:13.277 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.268+0000 7fd2d1fdd640 1 --2- 172.21.15.87:0/4277048832 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x555ff01e8c90 0x555ff01eb0b0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1048a3026069b894 server_cookie=583ee417b0e7980e in_seq=0 out_seq=0 2024-09-13T17:16:13.277 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.268+0000 7fd2b57fa640 1 -- 172.21.15.87:0/4277048832 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x555ff01265d0 con 0x555ff01e8c90 2024-09-13T17:16:13.277 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.268+0000 7fd2b57fa640 10 client.16401 handle_command_reply: tid=0 2024-09-13T17:16:13.277 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.268+0000 7fd2d7046740 1 client.16401 shutdown 2024-09-13T17:16:13.277 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.268+0000 7fd2d7046740 1 -- 172.21.15.87:0/4277048832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ff01cec50 msgr2=0x555ff01d6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:13.278 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.268+0000 7fd2d7046740 1 --2- 172.21.15.87:0/4277048832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ff01cec50 0x555ff01d6110 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc09a160 tx=0x7fd2bc09aa40 comp rx=0 tx=0).stop 2024-09-13T17:16:13.278 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.268+0000 7fd2d7046740 1 -- 172.21.15.87:0/4277048832 shutdown_connections 2024-09-13T17:16:13.278 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.268+0000 7fd2d7046740 1 --2- 172.21.15.87:0/4277048832 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x555ff01e8c90 0x555ff01eb0b0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.278 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.268+0000 7fd2d7046740 1 --2- 172.21.15.87:0/4277048832 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555ff01d94f0 0x555ff01d66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.278 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.268+0000 7fd2d7046740 1 --2- 172.21.15.87:0/4277048832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ff01cec50 0x555ff01d6110 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.278 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.268+0000 7fd2d7046740 1 --2- 172.21.15.87:0/4277048832 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ff01ce330 0x555ff01d8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.278 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.268+0000 7fd2b57fa640 0 client.16401 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:13.278 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.269+0000 7fd2d7046740 1 -- 172.21.15.87:0/4277048832 >> 172.21.15.87:0/4277048832 conn(0x555ff01ca8c0 msgr2=0x555ff01c9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:13.278 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.269+0000 7fd2d7046740 1 -- 172.21.15.87:0/4277048832 shutdown_connections 2024-09-13T17:16:13.278 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.269+0000 7fd2d7046740 1 -- 172.21.15.87:0/4277048832 wait complete. 2024-09-13T17:16:13.278 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.269+0000 7fd2d7046740 20 client.16401 trim_cache size 0 max 16384 2024-09-13T17:16:13.285 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.281+0000 7fd2d7046740 1 Processor -- start 2024-09-13T17:16:13.286 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.281+0000 7fd2d7046740 1 -- start start 2024-09-13T17:16:13.286 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.282+0000 7fd2d7046740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ff01ca8c0 0x555ff01ca300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:13.286 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.282+0000 7fd2d7046740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555ff01ce330 0x555ff01c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:13.286 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.282+0000 7fd2d7046740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ff01cec50 0x555ff01c5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:13.286 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.282+0000 7fd2d7046740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ff01cf170 con 0x555ff01ca8c0 2024-09-13T17:16:13.286 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.282+0000 7fd2d7046740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ff01d8a30 con 0x555ff01cec50 2024-09-13T17:16:13.286 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.282+0000 7fd2d7046740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ff01c6490 con 0x555ff01ce330 2024-09-13T17:16:13.286 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.282+0000 7fd2d1fdd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ff01ca8c0 0x555ff01ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:13.286 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.282+0000 7fd2d1fdd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ff01ca8c0 0x555ff01ca300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57246/0 (socket says 172.21.15.87:57246) 2024-09-13T17:16:13.286 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.282+0000 7fd2d1fdd640 1 -- 172.21.15.87:0/1412110923 learned_addr learned my addr 172.21.15.87:0/1412110923 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:13.286 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.282+0000 7fd2d17dc640 1 --2- 172.21.15.87:0/1412110923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555ff01ce330 0x555ff01c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:13.286 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.282+0000 7fd2d27de640 1 --2- 172.21.15.87:0/1412110923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ff01cec50 0x555ff01c5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:13.286 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.282+0000 7fd2d1fdd640 1 -- 172.21.15.87:0/1412110923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555ff01ce330 msgr2=0x555ff01c5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:13.287 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.282+0000 7fd2d1fdd640 1 --2- 172.21.15.87:0/1412110923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555ff01ce330 0x555ff01c5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.287 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.282+0000 7fd2d1fdd640 1 -- 172.21.15.87:0/1412110923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ff01cec50 msgr2=0x555ff01c5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:13.287 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.282+0000 7fd2d1fdd640 1 --2- 172.21.15.87:0/1412110923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ff01cec50 0x555ff01c5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.287 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.282+0000 7fd2d1fdd640 1 -- 172.21.15.87:0/1412110923 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ff00d3300 con 0x555ff01ca8c0 2024-09-13T17:16:13.287 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.282+0000 7fd2d1fdd640 1 --2- 172.21.15.87:0/1412110923 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ff01ca8c0 0x555ff01ca300 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8005940 tx=0x7fd2c80058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1489c8b8718ac58d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:13.287 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.282+0000 7fd2c0ff9640 1 -- 172.21.15.87:0/1412110923 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8041040 con 0x555ff01ca8c0 2024-09-13T17:16:13.287 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.283+0000 7fd2c0ff9640 1 -- 172.21.15.87:0/1412110923 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd2c8031dd0 con 0x555ff01ca8c0 2024-09-13T17:16:13.287 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.283+0000 7fd2c0ff9640 1 -- 172.21.15.87:0/1412110923 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8003d10 con 0x555ff01ca8c0 2024-09-13T17:16:13.287 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.283+0000 7fd2d7046740 1 -- 172.21.15.87:0/1412110923 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ff01ca8c0 msgr2=0x555ff01ca300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:13.287 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.283+0000 7fd2d7046740 1 --2- 172.21.15.87:0/1412110923 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ff01ca8c0 0x555ff01ca300 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8005940 tx=0x7fd2c80058d0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.287 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.283+0000 7fd2d7046740 1 -- 172.21.15.87:0/1412110923 shutdown_connections 2024-09-13T17:16:13.287 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.283+0000 7fd2d7046740 1 --2- 172.21.15.87:0/1412110923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ff01cec50 0x555ff01c5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.288 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.283+0000 7fd2d7046740 1 --2- 172.21.15.87:0/1412110923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555ff01ce330 0x555ff01c5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.288 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.283+0000 7fd2d7046740 1 --2- 172.21.15.87:0/1412110923 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ff01ca8c0 0x555ff01ca300 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.288 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.283+0000 7fd2d7046740 1 -- 172.21.15.87:0/1412110923 >> 172.21.15.87:0/1412110923 conn(0x555ff01d8fa0 msgr2=0x555ff01d49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:13.288 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.283+0000 7fd2d7046740 1 -- 172.21.15.87:0/1412110923 shutdown_connections 2024-09-13T17:16:13.288 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.283+0000 7fd2d7046740 1 -- 172.21.15.87:0/1412110923 wait complete. 2024-09-13T17:16:13.288 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.284+0000 7fd2d7046740 1 -- start start 2024-09-13T17:16:13.288 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.284+0000 7fd2d7046740 1 Processor -- start 2024-09-13T17:16:13.291 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.284+0000 7fd2d7046740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ff01ca8c0 0x555ff01d3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:13.291 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.284+0000 7fd2d7046740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ff01ce330 0x555ff01d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:13.291 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.284+0000 7fd2d7046740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555ff01cec50 0x555ff023f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:13.291 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.284+0000 7fd2d7046740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ff01d3ee0 con 0x555ff01ce330 2024-09-13T17:16:13.291 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.284+0000 7fd2d7046740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ff01d4050 con 0x555ff01ca8c0 2024-09-13T17:16:13.291 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.284+0000 7fd2d7046740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ff023f690 con 0x555ff01cec50 2024-09-13T17:16:13.291 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.284+0000 7fd2d7046740 10 client.0 _ll_register_callbacks cb 0x7fd2bc0d0c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:13.291 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.284+0000 7fd2d17dc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ff01ce330 0x555ff01d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:13.291 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.284+0000 7fd2d17dc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ff01ce330 0x555ff01d3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57258/0 (socket says 172.21.15.87:57258) 2024-09-13T17:16:13.291 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.284+0000 7fd2d17dc640 1 -- 172.21.15.87:0/1948472038 learned_addr learned my addr 172.21.15.87:0/1948472038 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:13.292 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.284+0000 7fd2d27de640 1 --2- 172.21.15.87:0/1948472038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555ff01cec50 0x555ff023f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:13.292 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.284+0000 7fd2d1fdd640 1 --2- 172.21.15.87:0/1948472038 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ff01ca8c0 0x555ff01d3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:13.292 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.284+0000 7fd2d17dc640 1 -- 172.21.15.87:0/1948472038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555ff01cec50 msgr2=0x555ff023f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:13.292 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.284+0000 7fd2d17dc640 1 --2- 172.21.15.87:0/1948472038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555ff01cec50 0x555ff023f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.292 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.284+0000 7fd2d17dc640 1 -- 172.21.15.87:0/1948472038 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ff01ca8c0 msgr2=0x555ff01d3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:13.292 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.284+0000 7fd2d17dc640 1 --2- 172.21.15.87:0/1948472038 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ff01ca8c0 0x555ff01d3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.292 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.284+0000 7fd2d17dc640 1 -- 172.21.15.87:0/1948472038 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2c8031560 con 0x555ff01ce330 2024-09-13T17:16:13.292 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.284+0000 7fd2d1fdd640 1 --2- 172.21.15.87:0/1948472038 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ff01ca8c0 0x555ff01d3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:13.292 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.285+0000 7fd2d17dc640 1 --2- 172.21.15.87:0/1948472038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ff01ce330 0x555ff01d3760 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc00c6a0 tx=0x7fd2bc096af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbec35fbf1eb00eb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:13.292 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.285+0000 7fd2b57fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:16:13.292 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.285+0000 7fd2b57fa640 1 -- 172.21.15.87:0/1948472038 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc0994f0 con 0x555ff01ce330 2024-09-13T17:16:13.292 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.285+0000 7fd2b57fa640 1 -- 172.21.15.87:0/1948472038 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fd2bc0a2650 con 0x555ff01ce330 2024-09-13T17:16:13.293 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.285+0000 7fd2d7046740 1 -- 172.21.15.87:0/1948472038 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd2bc09a8d0 con 0x555ff01ce330 2024-09-13T17:16:13.293 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.285+0000 7fd2b57fa640 1 -- 172.21.15.87:0/1948472038 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2bc099b30 con 0x555ff01ce330 2024-09-13T17:16:13.293 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.285+0000 7fd2d7046740 10 client.16407 fetch_fsmap learned FSMap version 26 2024-09-13T17:16:13.293 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.285+0000 7fd2d7046740 1 -- 172.21.15.87:0/1948472038 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555ff00f88e0 con 0x555ff01ce330 2024-09-13T17:16:13.293 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.285+0000 7fd2b57fa640 1 -- 172.21.15.87:0/1948472038 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd2bc09a8d0 con 0x555ff01ce330 2024-09-13T17:16:13.293 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.285+0000 7fd2b57fa640 1 -- 172.21.15.87:0/1948472038 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 26) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fd2bc09a4c0 con 0x555ff01ce330 2024-09-13T17:16:13.293 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.285+0000 7fd2d7046740 10 client.16407 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T17:16:13.293 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.285+0000 7fd2d7046740 10 client.16407 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-13T17:16:13.293 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.285+0000 7fd2d7046740 20 client.16407 populate_metadata read hostname 'smithi087' 2024-09-13T17:16:13.293 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.285+0000 7fd2d7046740 1 --2- 172.21.15.87:0/1948472038 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x555ff01d94f0 0x555ff0242a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:13.293 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.285+0000 7fd2d7046740 4 client.16407 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T17:16:13.293 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.285+0000 7fd2d7046740 1 -- 172.21.15.87:0/1948472038 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555fefe26300 con 0x555ff01d94f0 2024-09-13T17:16:13.293 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.285+0000 7fd2d1fdd640 1 --2- 172.21.15.87:0/1948472038 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x555ff01d94f0 0x555ff0242a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:13.294 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.286+0000 7fd2b57fa640 10 client.16407 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:13.294 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.286+0000 7fd2d1fdd640 1 --2- 172.21.15.87:0/1948472038 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x555ff01d94f0 0x555ff0242a80 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e76b400dc6cb2bea server_cookie=dfd49e2b80697128 in_seq=0 out_seq=0 2024-09-13T17:16:13.344 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.341+0000 7fd2b57fa640 1 -- 172.21.15.87:0/1948472038 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555fefe26300 con 0x555ff01d94f0 2024-09-13T17:16:13.344 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.341+0000 7fd2b57fa640 10 client.16407 handle_command_reply: tid=0 2024-09-13T17:16:13.344 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.341+0000 7fd2d7046740 1 client.16407 shutdown 2024-09-13T17:16:13.344 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.341+0000 7fd2d7046740 1 -- 172.21.15.87:0/1948472038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ff01ce330 msgr2=0x555ff01d3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:13.344 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.341+0000 7fd2d7046740 1 --2- 172.21.15.87:0/1948472038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ff01ce330 0x555ff01d3760 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc00c6a0 tx=0x7fd2bc096af0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.344 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.341+0000 7fd2d7046740 1 -- 172.21.15.87:0/1948472038 shutdown_connections 2024-09-13T17:16:13.344 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.341+0000 7fd2d7046740 1 --2- 172.21.15.87:0/1948472038 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x555ff01d94f0 0x555ff0242a80 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.341+0000 7fd2d7046740 1 --2- 172.21.15.87:0/1948472038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555ff01cec50 0x555ff023f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.341+0000 7fd2b57fa640 0 client.16407 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.341+0000 7fd2d7046740 1 --2- 172.21.15.87:0/1948472038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ff01ce330 0x555ff01d3760 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.341+0000 7fd2d7046740 1 --2- 172.21.15.87:0/1948472038 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ff01ca8c0 0x555ff01d3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.341+0000 7fd2d7046740 1 -- 172.21.15.87:0/1948472038 >> 172.21.15.87:0/1948472038 conn(0x555ff01d8fa0 msgr2=0x555ff01d59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.341+0000 7fd2d7046740 1 -- 172.21.15.87:0/1948472038 shutdown_connections 2024-09-13T17:16:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.341+0000 7fd2d7046740 1 -- 172.21.15.87:0/1948472038 wait complete. 2024-09-13T17:16:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.342+0000 7fd2d7046740 20 client.16407 trim_cache size 0 max 16384 2024-09-13T17:16:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout:{ 2024-09-13T17:16:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout: "message": "", 2024-09-13T17:16:13.346 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout: "return_code": 0 2024-09-13T17:16:13.346 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout:} 2024-09-13T17:16:13.346 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.342+0000 7fd2d4241640 1 -- 172.21.15.87:0/197039211 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd2b80a1200 msgr2=0x7fd2b80a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:13.346 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.342+0000 7fd2d4241640 1 --2- 172.21.15.87:0/197039211 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd2b80a1200 0x7fd2b80a36c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4005fd0 tx=0x7fd2c4004ab0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.346 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.342+0000 7fd2d4241640 1 -- 172.21.15.87:0/197039211 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2cc0ff5d0 msgr2=0x7fd2cc1a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:13.346 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.342+0000 7fd2d4241640 1 --2- 172.21.15.87:0/197039211 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2cc0ff5d0 0x7fd2cc1a2b00 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc00e9f0 tx=0x7fd2bc00eeb0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.342+0000 7fd2d4241640 1 -- 172.21.15.87:0/197039211 shutdown_connections 2024-09-13T17:16:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.342+0000 7fd2d4241640 1 --2- 172.21.15.87:0/197039211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2cc1040e0 0x7fd2cc19c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.342+0000 7fd2d4241640 1 --2- 172.21.15.87:0/197039211 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd2b80a1200 0x7fd2b80a36c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.342+0000 7fd2d4241640 1 --2- 172.21.15.87:0/197039211 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2cc0ff5d0 0x7fd2cc1a2b00 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.342+0000 7fd2d4241640 1 --2- 172.21.15.87:0/197039211 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2cc0fecb0 0x7fd2cc1a25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.342+0000 7fd2d4241640 1 -- 172.21.15.87:0/197039211 >> 172.21.15.87:0/197039211 conn(0x7fd2cc0fa8d0 msgr2=0x7fd2cc10d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.342+0000 7fd2d4241640 1 -- 172.21.15.87:0/197039211 shutdown_connections 2024-09-13T17:16:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:13.342+0000 7fd2d4241640 1 -- 172.21.15.87:0/197039211 wait complete. 2024-09-13T17:16:14.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:14 smithi149 ceph-mon[35496]: pgmap v75: 129 pgs: 129 active+clean; 159 MiB data, 940 MiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 1.1 MiB/s wr, 336 op/s 2024-09-13T17:16:14.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:14 smithi118 ceph-mon[34374]: pgmap v75: 129 pgs: 129 active+clean; 159 MiB data, 940 MiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 1.1 MiB/s wr, 336 op/s 2024-09-13T17:16:14.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:14 smithi087 ceph-mon[30934]: pgmap v75: 129 pgs: 129 active+clean; 159 MiB data, 940 MiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 1.1 MiB/s wr, 336 op/s 2024-09-13T17:16:15.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:15 smithi149 ceph-mon[35496]: pgmap v76: 129 pgs: 129 active+clean; 164 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 404 op/s 2024-09-13T17:16:15.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:15 smithi118 ceph-mon[34374]: pgmap v76: 129 pgs: 129 active+clean; 164 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 404 op/s 2024-09-13T17:16:15.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:15 smithi087 ceph-mon[30934]: pgmap v76: 129 pgs: 129 active+clean; 164 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 404 op/s 2024-09-13T17:16:16.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:16 smithi149 ceph-mon[35496]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:16:16.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:16 smithi118 ceph-mon[34374]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:16:16.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:16 smithi087 ceph-mon[30934]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:16:17.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:17 smithi149 ceph-mon[35496]: pgmap v77: 129 pgs: 129 active+clean; 164 MiB data, 936 MiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 922 KiB/s wr, 250 op/s 2024-09-13T17:16:17.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:17 smithi118 ceph-mon[34374]: pgmap v77: 129 pgs: 129 active+clean; 164 MiB data, 936 MiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 922 KiB/s wr, 250 op/s 2024-09-13T17:16:17.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:17 smithi087 ceph-mon[30934]: pgmap v77: 129 pgs: 129 active+clean; 164 MiB data, 936 MiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 922 KiB/s wr, 250 op/s 2024-09-13T17:16:18.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:18 smithi149 ceph-mon[35496]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:16:18.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:18 smithi118 ceph-mon[34374]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:16:18.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:18 smithi087 ceph-mon[30934]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:16:19.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:19 smithi149 ceph-mon[35496]: pgmap v78: 129 pgs: 129 active+clean; 164 MiB data, 936 MiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 922 KiB/s wr, 250 op/s 2024-09-13T17:16:19.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:19 smithi118 ceph-mon[34374]: pgmap v78: 129 pgs: 129 active+clean; 164 MiB data, 936 MiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 922 KiB/s wr, 250 op/s 2024-09-13T17:16:19.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:19 smithi087 ceph-mon[30934]: pgmap v78: 129 pgs: 129 active+clean; 164 MiB data, 936 MiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 922 KiB/s wr, 250 op/s 2024-09-13T17:16:20.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:20 smithi149 ceph-mon[35496]: scrub summary: idle 2024-09-13T17:16:20.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:20 smithi149 ceph-mon[35496]: scrub summary: idle 2024-09-13T17:16:20.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:20 smithi118 ceph-mon[34374]: scrub summary: idle 2024-09-13T17:16:20.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:20 smithi118 ceph-mon[34374]: scrub summary: idle 2024-09-13T17:16:20.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:20 smithi087 ceph-mon[30934]: scrub summary: idle 2024-09-13T17:16:20.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:20 smithi087 ceph-mon[30934]: scrub summary: idle 2024-09-13T17:16:21.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:21 smithi149 ceph-mon[35496]: scrub summary: idle 2024-09-13T17:16:21.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:21 smithi149 ceph-mon[35496]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:16:21.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:21 smithi149 ceph-mon[35496]: pgmap v79: 129 pgs: 129 active+clean; 172 MiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 454 op/s 2024-09-13T17:16:21.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:21 smithi118 ceph-mon[34374]: scrub summary: idle 2024-09-13T17:16:21.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:21 smithi118 ceph-mon[34374]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:16:21.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:21 smithi118 ceph-mon[34374]: pgmap v79: 129 pgs: 129 active+clean; 172 MiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 454 op/s 2024-09-13T17:16:21.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:21 smithi087 ceph-mon[30934]: scrub summary: idle 2024-09-13T17:16:21.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:21 smithi087 ceph-mon[30934]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:16:21.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:21 smithi087 ceph-mon[30934]: pgmap v79: 129 pgs: 129 active+clean; 172 MiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 454 op/s 2024-09-13T17:16:23.780 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:23 smithi087 ceph-mon[30934]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:16:23.780 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:23 smithi087 ceph-mon[30934]: pgmap v80: 129 pgs: 129 active+clean; 172 MiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 280 op/s 2024-09-13T17:16:23.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:23 smithi149 ceph-mon[35496]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:16:23.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:23 smithi149 ceph-mon[35496]: pgmap v80: 129 pgs: 129 active+clean; 172 MiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 280 op/s 2024-09-13T17:16:23.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:23 smithi118 ceph-mon[34374]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:16:23.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:23 smithi118 ceph-mon[34374]: pgmap v80: 129 pgs: 129 active+clean; 172 MiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 280 op/s 2024-09-13T17:16:26.448 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.446+0000 7fc4b9348640 1 -- 172.21.15.87:0/298023289 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac0355a0 con 0x7fc4b4112d70 2024-09-13T17:16:26.448 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.446+0000 7fc4bc5ae640 1 -- 172.21.15.87:0/298023289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4b4112d70 msgr2=0x7fc4b4115160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:26.448 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.446+0000 7fc4bc5ae640 1 --2- 172.21.15.87:0/298023289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4b4112d70 0x7fc4b4115160 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac009cc0 tx=0x7fc4ac02ecd0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.450 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.448+0000 7fc4bc5ae640 1 -- 172.21.15.87:0/298023289 shutdown_connections 2024-09-13T17:16:26.450 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.448+0000 7fc4bc5ae640 1 --2- 172.21.15.87:0/298023289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4b4112d70 0x7fc4b4115160 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.450 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.448+0000 7fc4bc5ae640 1 --2- 172.21.15.87:0/298023289 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4b4107dd0 0x7fc4b4112830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.450 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.448+0000 7fc4bc5ae640 1 --2- 172.21.15.87:0/298023289 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4b41074b0 0x7fc4b4107890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.450 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.448+0000 7fc4bc5ae640 1 -- 172.21.15.87:0/298023289 >> 172.21.15.87:0/298023289 conn(0x7fc4b406af50 msgr2=0x7fc4b406b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:26.450 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.449+0000 7fc4bc5ae640 1 -- 172.21.15.87:0/298023289 shutdown_connections 2024-09-13T17:16:26.450 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.449+0000 7fc4bc5ae640 1 -- 172.21.15.87:0/298023289 wait complete. 2024-09-13T17:16:26.451 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.450+0000 7fc4bc5ae640 1 Processor -- start 2024-09-13T17:16:26.451 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.450+0000 7fc4bc5ae640 1 -- start start 2024-09-13T17:16:26.451 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.450+0000 7fc4bc5ae640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4b41074b0 0x7fc4b41a2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.451 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.450+0000 7fc4bc5ae640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4b4107dd0 0x7fc4b41a2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.451 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.450+0000 7fc4bc5ae640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4b4112d70 0x7fc4b419c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.450+0000 7fc4ba34a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4b41074b0 0x7fc4b41a2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.450+0000 7fc4ba34a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4b41074b0 0x7fc4b41a2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.87:52328/0 (socket says 172.21.15.87:52328) 2024-09-13T17:16:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.451+0000 7fc4bab4b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4b4112d70 0x7fc4b419c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.451+0000 7fc4b9b49640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4b4107dd0 0x7fc4b41a2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.451+0000 7fc4b9b49640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4b4107dd0 0x7fc4b41a2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:49668/0 (socket says 172.21.15.87:49668) 2024-09-13T17:16:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.451+0000 7fc4bab4b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4b4112d70 0x7fc4b419c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41940/0 (socket says 172.21.15.87:41940) 2024-09-13T17:16:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.451+0000 7fc4ba34a640 1 -- 172.21.15.87:0/643137102 learned_addr learned my addr 172.21.15.87:0/643137102 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.451+0000 7fc4bc5ae640 1 -- 172.21.15.87:0/643137102 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b419ce60 con 0x7fc4b4112d70 2024-09-13T17:16:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.451+0000 7fc4bc5ae640 1 -- 172.21.15.87:0/643137102 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b419cfd0 con 0x7fc4b41074b0 2024-09-13T17:16:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.451+0000 7fc4bc5ae640 1 -- 172.21.15.87:0/643137102 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b419d190 con 0x7fc4b4107dd0 2024-09-13T17:16:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.452+0000 7fc4b9b49640 1 -- 172.21.15.87:0/643137102 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4b41074b0 msgr2=0x7fc4b41a2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.452+0000 7fc4b9b49640 1 --2- 172.21.15.87:0/643137102 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4b41074b0 0x7fc4b41a2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.452+0000 7fc4b9b49640 1 -- 172.21.15.87:0/643137102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4b4112d70 msgr2=0x7fc4b419c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.452+0000 7fc4b9b49640 1 --2- 172.21.15.87:0/643137102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4b4112d70 0x7fc4b419c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.452+0000 7fc4b9b49640 1 -- 172.21.15.87:0/643137102 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ac009900 con 0x7fc4b4107dd0 2024-09-13T17:16:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.452+0000 7fc4bab4b640 1 --2- 172.21.15.87:0/643137102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4b4112d70 0x7fc4b419c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:26.456 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.452+0000 7fc4ba34a640 1 --2- 172.21.15.87:0/643137102 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4b41074b0 0x7fc4b41a2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:26.456 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.452+0000 7fc4b9b49640 1 --2- 172.21.15.87:0/643137102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4b4107dd0 0x7fc4b41a2bc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc4b000d6d0 tx=0x7fc4b000db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:26.456 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.452+0000 7fc4ab7fe640 1 -- 172.21.15.87:0/643137102 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0005220 con 0x7fc4b4107dd0 2024-09-13T17:16:26.456 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.452+0000 7fc4bc5ae640 1 -- 172.21.15.87:0/643137102 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4b419d470 con 0x7fc4b4107dd0 2024-09-13T17:16:26.456 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.453+0000 7fc4ab7fe640 1 -- 172.21.15.87:0/643137102 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc4b0009cd0 con 0x7fc4b4107dd0 2024-09-13T17:16:26.456 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.453+0000 7fc4bc5ae640 1 -- 172.21.15.87:0/643137102 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4b41a9600 con 0x7fc4b4107dd0 2024-09-13T17:16:26.457 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.454+0000 7fc4ab7fe640 1 -- 172.21.15.87:0/643137102 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0004cf0 con 0x7fc4b4107dd0 2024-09-13T17:16:26.457 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.456+0000 7fc4bf2d3740 1 Processor -- start 2024-09-13T17:16:26.458 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.457+0000 7fc4bf2d3740 1 -- start start 2024-09-13T17:16:26.459 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.457+0000 7fc4bf2d3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0b1850330 0x55a0b1850710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.459 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.457+0000 7fc4bf2d3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0b1850c50 0x55a0b185afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.459 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.457+0000 7fc4bf2d3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0b185b4f0 0x55a0b185d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.459 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.457+0000 7fc4bf2d3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0b17bbc30 con 0x55a0b185b4f0 2024-09-13T17:16:26.459 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.457+0000 7fc4bf2d3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0b17b93c0 con 0x55a0b1850330 2024-09-13T17:16:26.459 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.457+0000 7fc4bf2d3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0b17b4cb0 con 0x55a0b1850c50 2024-09-13T17:16:26.460 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.458+0000 7fc4ba34a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0b1850c50 0x55a0b185afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.460 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.458+0000 7fc4ba34a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0b1850c50 0x55a0b185afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:49670/0 (socket says 172.21.15.87:49670) 2024-09-13T17:16:26.460 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.458+0000 7fc4ba34a640 1 -- 172.21.15.87:0/2406966573 learned_addr learned my addr 172.21.15.87:0/2406966573 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:26.460 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.458+0000 7fc4bab4b640 1 --2- 172.21.15.87:0/2406966573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0b1850330 0x55a0b1850710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.461 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.458+0000 7fc4ba34a640 1 -- 172.21.15.87:0/2406966573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0b1850330 msgr2=0x55a0b1850710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:26.461 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.458+0000 7fc4ba34a640 1 --2- 172.21.15.87:0/2406966573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0b1850330 0x55a0b1850710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.461 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.458+0000 7fc4ba34a640 1 -- 172.21.15.87:0/2406966573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0b185b4f0 msgr2=0x55a0b185d8e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T17:16:26.461 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.458+0000 7fc4ba34a640 1 --2- 172.21.15.87:0/2406966573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0b185b4f0 0x55a0b185d8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.461 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.458+0000 7fc4ba34a640 1 -- 172.21.15.87:0/2406966573 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0b175b910 con 0x55a0b1850c50 2024-09-13T17:16:26.461 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.459+0000 7fc4ab7fe640 1 -- 172.21.15.87:0/643137102 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fc4b0005380 con 0x7fc4b4107dd0 2024-09-13T17:16:26.461 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.459+0000 7fc4ba34a640 1 --2- 172.21.15.87:0/2406966573 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0b1850c50 0x55a0b185afb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc4a400bdc0 tx=0x7fc4a400f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d4f520b0fec06bb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:26.461 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.459+0000 7fc4a8ff9640 1 -- 172.21.15.87:0/2406966573 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4011440 con 0x55a0b1850c50 2024-09-13T17:16:26.461 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.459+0000 7fc4a8ff9640 1 -- 172.21.15.87:0/2406966573 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc4a4011a50 con 0x55a0b1850c50 2024-09-13T17:16:26.461 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.459+0000 7fc4a8ff9640 1 -- 172.21.15.87:0/2406966573 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4010b40 con 0x55a0b1850c50 2024-09-13T17:16:26.463 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.460+0000 7fc4bf2d3740 1 -- 172.21.15.87:0/2406966573 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0b1850c50 msgr2=0x55a0b185afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:26.463 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.460+0000 7fc4bf2d3740 1 --2- 172.21.15.87:0/2406966573 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0b1850c50 0x55a0b185afb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc4a400bdc0 tx=0x7fc4a400f730 comp rx=0 tx=0).stop 2024-09-13T17:16:26.463 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.460+0000 7fc4ab7fe640 1 --2- 172.21.15.87:0/643137102 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc4a00a1240 0x7fc4a00a3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.463 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.461+0000 7fc4ab7fe640 1 -- 172.21.15.87:0/643137102 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fc4b00ccb80 con 0x7fc4b4107dd0 2024-09-13T17:16:26.463 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.461+0000 7fc4bf2d3740 1 -- 172.21.15.87:0/2406966573 shutdown_connections 2024-09-13T17:16:26.463 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.461+0000 7fc4bf2d3740 1 --2- 172.21.15.87:0/2406966573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0b185b4f0 0x55a0b185d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.461+0000 7fc4bf2d3740 1 --2- 172.21.15.87:0/2406966573 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0b1850c50 0x55a0b185afb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.461+0000 7fc4bf2d3740 1 --2- 172.21.15.87:0/2406966573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0b1850330 0x55a0b1850710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.461+0000 7fc4bf2d3740 1 -- 172.21.15.87:0/2406966573 >> 172.21.15.87:0/2406966573 conn(0x55a0b184c8c0 msgr2=0x55a0b184cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.461+0000 7fc4bab4b640 1 --2- 172.21.15.87:0/643137102 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc4a00a1240 0x7fc4a00a3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.462+0000 7fc4bf2d3740 1 -- 172.21.15.87:0/2406966573 shutdown_connections 2024-09-13T17:16:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.462+0000 7fc4bf2d3740 1 -- 172.21.15.87:0/2406966573 wait complete. 2024-09-13T17:16:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.462+0000 7fc4bf2d3740 1 -- start start 2024-09-13T17:16:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.462+0000 7fc4bf2d3740 1 Processor -- start 2024-09-13T17:16:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.463+0000 7fc4bab4b640 1 --2- 172.21.15.87:0/643137102 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc4a00a1240 0x7fc4a00a3700 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac006010 tx=0x7fc4ac031040 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.464+0000 7fc4bf2d3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0b1850330 0x55a0b185ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.464+0000 7fc4bf2d3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0b1850c50 0x55a0b18580a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.464+0000 7fc4bf2d3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0b185b4f0 0x55a0b1858620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.466 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.464+0000 7fc4bf2d3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0b1772e80 con 0x55a0b185b4f0 2024-09-13T17:16:26.466 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.464+0000 7fc4bf2d3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0b1772b20 con 0x55a0b1850330 2024-09-13T17:16:26.466 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.464+0000 7fc4bf2d3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0b1738260 con 0x55a0b1850c50 2024-09-13T17:16:26.466 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.464+0000 7fc4bf2d3740 10 client.0 _ll_register_callbacks cb 0x55a0b176ddf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:26.466 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.464+0000 7fc4b9b49640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0b1850c50 0x55a0b18580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.466 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.464+0000 7fc4b9b49640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0b1850c50 0x55a0b18580a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:49674/0 (socket says 172.21.15.87:49674) 2024-09-13T17:16:26.466 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.464+0000 7fc4b9b49640 1 -- 172.21.15.87:0/747940098 learned_addr learned my addr 172.21.15.87:0/747940098 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:26.467 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.465+0000 7fc4bab4b640 1 --2- 172.21.15.87:0/747940098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0b185b4f0 0x55a0b1858620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.467 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.465+0000 7fc4b9b49640 1 -- 172.21.15.87:0/747940098 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0b1850330 msgr2=0x55a0b185ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:26.468 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.465+0000 7fc4b9b49640 1 --2- 172.21.15.87:0/747940098 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0b1850330 0x55a0b185ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.468 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.465+0000 7fc4b9b49640 1 -- 172.21.15.87:0/747940098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0b185b4f0 msgr2=0x55a0b1858620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:26.468 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.465+0000 7fc4b9b49640 1 --2- 172.21.15.87:0/747940098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0b185b4f0 0x55a0b1858620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.468 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.465+0000 7fc4b9b49640 1 -- 172.21.15.87:0/747940098 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a400ba20 con 0x55a0b1850c50 2024-09-13T17:16:26.468 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.465+0000 7fc4b9b49640 1 --2- 172.21.15.87:0/747940098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0b1850c50 0x55a0b18580a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc4b000d6a0 tx=0x7fc4b0009f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0e6adbcad9870a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:26.468 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.465+0000 7fc49dffb640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-09-13T17:16:26.468 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.465+0000 7fc49dffb640 1 -- 172.21.15.87:0/747940098 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b009d710 con 0x55a0b1850c50 2024-09-13T17:16:26.468 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.466+0000 7fc4bf2d3740 1 -- 172.21.15.87:0/747940098 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a0b17dd680 con 0x55a0b1850c50 2024-09-13T17:16:26.468 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.466+0000 7fc49dffb640 1 -- 172.21.15.87:0/747940098 <== mon.1 v2:172.21.15.149:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fc4b00a1d60 con 0x55a0b1850c50 2024-09-13T17:16:26.468 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.466+0000 7fc49dffb640 1 -- 172.21.15.87:0/747940098 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4b0095ff0 con 0x55a0b1850c50 2024-09-13T17:16:26.468 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.466+0000 7fc4bf2d3740 10 client.25810 fetch_fsmap learned FSMap version 30 2024-09-13T17:16:26.469 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.466+0000 7fc4bf2d3740 1 -- 172.21.15.87:0/747940098 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55a0b17b3330 con 0x55a0b1850c50 2024-09-13T17:16:26.469 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.466+0000 7fc49dffb640 1 -- 172.21.15.87:0/747940098 <== mon.1 v2:172.21.15.149:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55a0b17dd680 con 0x55a0b1850c50 2024-09-13T17:16:26.470 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.467+0000 7fc49dffb640 1 -- 172.21.15.87:0/747940098 <== mon.1 v2:172.21.15.149:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fc4b00a1960 con 0x55a0b1850c50 2024-09-13T17:16:26.470 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.467+0000 7fc4bf2d3740 10 client.25810 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:16:26.470 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.467+0000 7fc4bf2d3740 10 client.25810 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-13T17:16:26.470 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.467+0000 7fc4bf2d3740 20 client.25810 populate_metadata read hostname 'smithi087' 2024-09-13T17:16:26.470 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.468+0000 7fc4bf2d3740 1 --2- 172.21.15.87:0/747940098 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55a0b186afc0 0x55a0b186d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.470 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.468+0000 7fc4bf2d3740 4 client.25810 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:16:26.470 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.468+0000 7fc4bf2d3740 1 -- 172.21.15.87:0/747940098 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a0b17a85d0 con 0x55a0b186afc0 2024-09-13T17:16:26.470 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.468+0000 7fc4ba34a640 1 --2- 172.21.15.87:0/747940098 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55a0b186afc0 0x55a0b186d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.470 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.469+0000 7fc4ba34a640 1 --2- 172.21.15.87:0/747940098 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55a0b186afc0 0x55a0b186d3e0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2f4dc10e767c934 server_cookie=34ed3fd4b44032d in_seq=0 out_seq=0 2024-09-13T17:16:26.471 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.469+0000 7fc49dffb640 10 client.25810 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:26.471 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.470+0000 7fc49dffb640 1 -- 172.21.15.87:0/747940098 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55a0b17a85d0 con 0x55a0b186afc0 2024-09-13T17:16:26.471 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.470+0000 7fc49dffb640 10 client.25810 handle_command_reply: tid=0 2024-09-13T17:16:26.471 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.470+0000 7fc4bf2d3740 1 client.25810 shutdown 2024-09-13T17:16:26.474 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.473+0000 7fc4bf2d3740 1 -- 172.21.15.87:0/747940098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0b1850c50 msgr2=0x55a0b18580a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:26.474 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.473+0000 7fc4bf2d3740 1 --2- 172.21.15.87:0/747940098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0b1850c50 0x55a0b18580a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc4b000d6a0 tx=0x7fc4b0009f80 comp rx=0 tx=0).stop 2024-09-13T17:16:26.474 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.473+0000 7fc4bf2d3740 1 -- 172.21.15.87:0/747940098 shutdown_connections 2024-09-13T17:16:26.474 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.473+0000 7fc4bf2d3740 1 --2- 172.21.15.87:0/747940098 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55a0b186afc0 0x55a0b186d3e0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.474 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.473+0000 7fc4bf2d3740 1 --2- 172.21.15.87:0/747940098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0b185b4f0 0x55a0b1858620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.474 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.473+0000 7fc4bf2d3740 1 --2- 172.21.15.87:0/747940098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0b1850c50 0x55a0b18580a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.474 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.473+0000 7fc4bf2d3740 1 --2- 172.21.15.87:0/747940098 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0b1850330 0x55a0b185ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.475 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.473+0000 7fc4bf2d3740 1 -- 172.21.15.87:0/747940098 >> 172.21.15.87:0/747940098 conn(0x55a0b184c8c0 msgr2=0x55a0b184bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:26.475 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.473+0000 7fc49dffb640 0 client.25810 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:26.475 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.473+0000 7fc4bf2d3740 1 -- 172.21.15.87:0/747940098 shutdown_connections 2024-09-13T17:16:26.475 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.473+0000 7fc4bf2d3740 1 -- 172.21.15.87:0/747940098 wait complete. 2024-09-13T17:16:26.481 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.481+0000 7fc4bf2d3740 20 client.25810 trim_cache size 0 max 16384 2024-09-13T17:16:26.507 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.506+0000 7fc4bf2d3740 1 Processor -- start 2024-09-13T17:16:26.507 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.506+0000 7fc4bf2d3740 1 -- start start 2024-09-13T17:16:26.508 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.506+0000 7fc4bf2d3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0b1850330 0x55a0b185a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.508 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.507+0000 7fc4bf2d3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0b1850c50 0x55a0b1862260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.509 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.507+0000 7fc4bf2d3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0b185b4f0 0x55a0b18627a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.509 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.507+0000 7fc4bf2d3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0b185e020 con 0x55a0b1850c50 2024-09-13T17:16:26.509 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.507+0000 7fc4bf2d3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0b1852e70 con 0x55a0b185b4f0 2024-09-13T17:16:26.509 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.507+0000 7fc4bf2d3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0b18565d0 con 0x55a0b1850330 2024-09-13T17:16:26.509 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.507+0000 7fc4b9b49640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0b1850c50 0x55a0b1862260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.509 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.507+0000 7fc4b9b49640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0b1850c50 0x55a0b1862260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41964/0 (socket says 172.21.15.87:41964) 2024-09-13T17:16:26.509 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.507+0000 7fc4b9b49640 1 -- 172.21.15.87:0/649626245 learned_addr learned my addr 172.21.15.87:0/649626245 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:26.509 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.507+0000 7fc4ba34a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0b1850330 0x55a0b185a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.509 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.507+0000 7fc4bab4b640 1 --2- 172.21.15.87:0/649626245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0b185b4f0 0x55a0b18627a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.509 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.507+0000 7fc4bab4b640 1 -- 172.21.15.87:0/649626245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0b1850330 msgr2=0x55a0b185a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:26.509 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.507+0000 7fc4bab4b640 1 --2- 172.21.15.87:0/649626245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0b1850330 0x55a0b185a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.510 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.507+0000 7fc4bab4b640 1 -- 172.21.15.87:0/649626245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0b1850c50 msgr2=0x55a0b1862260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:26.510 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.507+0000 7fc4bab4b640 1 --2- 172.21.15.87:0/649626245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0b1850c50 0x55a0b1862260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.510 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.507+0000 7fc4bab4b640 1 -- 172.21.15.87:0/649626245 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0b1755300 con 0x55a0b185b4f0 2024-09-13T17:16:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.508+0000 7fc4bab4b640 1 --2- 172.21.15.87:0/649626245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0b185b4f0 0x55a0b18627a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac02f2c0 tx=0x7fc4ac043000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ec141c1488367a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.508+0000 7fc4a97fa640 1 -- 172.21.15.87:0/649626245 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac003cf0 con 0x55a0b185b4f0 2024-09-13T17:16:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.508+0000 7fc4a97fa640 1 -- 172.21.15.87:0/649626245 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc4ac003e50 con 0x55a0b185b4f0 2024-09-13T17:16:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.508+0000 7fc4a97fa640 1 -- 172.21.15.87:0/649626245 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac037440 con 0x55a0b185b4f0 2024-09-13T17:16:26.513 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.509+0000 7fc4bf2d3740 1 -- 172.21.15.87:0/649626245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0b185b4f0 msgr2=0x55a0b18627a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:26.513 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.509+0000 7fc4bf2d3740 1 --2- 172.21.15.87:0/649626245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0b185b4f0 0x55a0b18627a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac02f2c0 tx=0x7fc4ac043000 comp rx=0 tx=0).stop 2024-09-13T17:16:26.513 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.509+0000 7fc4bf2d3740 1 -- 172.21.15.87:0/649626245 shutdown_connections 2024-09-13T17:16:26.513 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.509+0000 7fc4bf2d3740 1 --2- 172.21.15.87:0/649626245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0b185b4f0 0x55a0b18627a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.513 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.509+0000 7fc4bf2d3740 1 --2- 172.21.15.87:0/649626245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0b1850c50 0x55a0b1862260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.513 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.509+0000 7fc4bf2d3740 1 --2- 172.21.15.87:0/649626245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0b1850330 0x55a0b185a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.513 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.509+0000 7fc4bf2d3740 1 -- 172.21.15.87:0/649626245 >> 172.21.15.87:0/649626245 conn(0x55a0b184c8c0 msgr2=0x55a0b1853370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:26.513 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.510+0000 7fc4bf2d3740 1 -- 172.21.15.87:0/649626245 shutdown_connections 2024-09-13T17:16:26.513 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.510+0000 7fc4bf2d3740 1 -- 172.21.15.87:0/649626245 wait complete. 2024-09-13T17:16:26.513 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.511+0000 7fc4bf2d3740 1 -- start start 2024-09-13T17:16:26.513 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.511+0000 7fc4bf2d3740 1 Processor -- start 2024-09-13T17:16:26.514 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.513+0000 7fc4bf2d3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0b1850330 0x55a0b1862320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.515 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.513+0000 7fc4bf2d3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0b1850c50 0x55a0b1860820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.515 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.513+0000 7fc4bf2d3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0b185b4f0 0x55a0b1860d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.515 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.513+0000 7fc4bf2d3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0b18612a0 con 0x55a0b1850c50 2024-09-13T17:16:26.515 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.513+0000 7fc4bf2d3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0b1861410 con 0x55a0b185b4f0 2024-09-13T17:16:26.515 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.513+0000 7fc4bf2d3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0b18615d0 con 0x55a0b1850330 2024-09-13T17:16:26.515 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.513+0000 7fc4bf2d3740 10 client.0 _ll_register_callbacks cb 0x7fc4a400b580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:26.516 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.514+0000 7fc4bab4b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0b185b4f0 0x55a0b1860d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.516 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.514+0000 7fc4bab4b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0b185b4f0 0x55a0b1860d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.87:52350/0 (socket says 172.21.15.87:52350) 2024-09-13T17:16:26.516 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.514+0000 7fc4bab4b640 1 -- 172.21.15.87:0/771218703 learned_addr learned my addr 172.21.15.87:0/771218703 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:26.517 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.514+0000 7fc4ba34a640 1 --2- 172.21.15.87:0/771218703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0b1850330 0x55a0b1862320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.517 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.514+0000 7fc4bab4b640 1 -- 172.21.15.87:0/771218703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0b1850330 msgr2=0x55a0b1862320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:26.517 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.514+0000 7fc4bab4b640 1 --2- 172.21.15.87:0/771218703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0b1850330 0x55a0b1862320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.517 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.514+0000 7fc4bab4b640 1 -- 172.21.15.87:0/771218703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0b1850c50 msgr2=0x55a0b1860820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:26.517 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.514+0000 7fc4bab4b640 1 --2- 172.21.15.87:0/771218703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0b1850c50 0x55a0b1860820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.517 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.514+0000 7fc4bab4b640 1 -- 172.21.15.87:0/771218703 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4b4115c20 con 0x55a0b185b4f0 2024-09-13T17:16:26.517 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.515+0000 7fc4bab4b640 1 --2- 172.21.15.87:0/771218703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0b185b4f0 0x55a0b1860d60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac03a040 tx=0x7fc4ac02fae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2427f8bee80fb0b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:26.517 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.515+0000 7fc49dffb640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-09-13T17:16:26.517 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.515+0000 7fc49dffb640 1 -- 172.21.15.87:0/771218703 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac035a20 con 0x55a0b185b4f0 2024-09-13T17:16:26.517 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.515+0000 7fc49dffb640 1 -- 172.21.15.87:0/771218703 <== mon.2 v2:172.21.15.118:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fc4ac035b80 con 0x55a0b185b4f0 2024-09-13T17:16:26.518 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.516+0000 7fc4bf2d3740 1 -- 172.21.15.87:0/771218703 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc4a4011a50 con 0x55a0b185b4f0 2024-09-13T17:16:26.519 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.516+0000 7fc49dffb640 1 -- 172.21.15.87:0/771218703 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4ac035d40 con 0x55a0b185b4f0 2024-09-13T17:16:26.519 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.516+0000 7fc4bf2d3740 10 client.25739 fetch_fsmap learned FSMap version 30 2024-09-13T17:16:26.519 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.516+0000 7fc4bf2d3740 1 -- 172.21.15.87:0/771218703 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55a0b177a8e0 con 0x55a0b185b4f0 2024-09-13T17:16:26.519 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.516+0000 7fc49dffb640 1 -- 172.21.15.87:0/771218703 <== mon.2 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc4a4011a50 con 0x55a0b185b4f0 2024-09-13T17:16:26.519 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.516+0000 7fc49dffb640 1 -- 172.21.15.87:0/771218703 <== mon.2 v2:172.21.15.118:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fc4ac004000 con 0x55a0b185b4f0 2024-09-13T17:16:26.519 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.517+0000 7fc4bf2d3740 10 client.25739 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:16:26.520 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.517+0000 7fc4bf2d3740 10 client.25739 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-13T17:16:26.520 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.517+0000 7fc4bf2d3740 20 client.25739 populate_metadata read hostname 'smithi087' 2024-09-13T17:16:26.520 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.517+0000 7fc4bf2d3740 1 --2- 172.21.15.87:0/771218703 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55a0b18cae90 0x55a0b18cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:26.520 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.517+0000 7fc4bf2d3740 4 client.25739 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T17:16:26.520 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.517+0000 7fc4bf2d3740 1 -- 172.21.15.87:0/771218703 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a0b14a8300 con 0x55a0b18cae90 2024-09-13T17:16:26.520 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.518+0000 7fc4ba34a640 1 --2- 172.21.15.87:0/771218703 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55a0b18cae90 0x55a0b18cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:26.520 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.518+0000 7fc4ba34a640 1 --2- 172.21.15.87:0/771218703 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55a0b18cae90 0x55a0b18cd2b0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9afd89f28ae3621f server_cookie=20f662091b6396b6 in_seq=0 out_seq=0 2024-09-13T17:16:26.521 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.519+0000 7fc49dffb640 10 client.25739 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:26.802 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.800+0000 7fc49dffb640 1 -- 172.21.15.87:0/771218703 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a0b14a8300 con 0x55a0b18cae90 2024-09-13T17:16:26.802 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.800+0000 7fc49dffb640 10 client.25739 handle_command_reply: tid=0 2024-09-13T17:16:26.802 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.800+0000 7fc4bf2d3740 1 client.25739 shutdown 2024-09-13T17:16:26.802 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.801+0000 7fc4bf2d3740 1 -- 172.21.15.87:0/771218703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0b185b4f0 msgr2=0x55a0b1860d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:26.803 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.801+0000 7fc4bf2d3740 1 --2- 172.21.15.87:0/771218703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0b185b4f0 0x55a0b1860d60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac03a040 tx=0x7fc4ac02fae0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.803 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.801+0000 7fc4bf2d3740 1 -- 172.21.15.87:0/771218703 shutdown_connections 2024-09-13T17:16:26.803 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.801+0000 7fc4bf2d3740 1 --2- 172.21.15.87:0/771218703 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55a0b18cae90 0x55a0b18cd2b0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.803 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.801+0000 7fc4bf2d3740 1 --2- 172.21.15.87:0/771218703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0b185b4f0 0x55a0b1860d60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.803 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.801+0000 7fc4bf2d3740 1 --2- 172.21.15.87:0/771218703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0b1850c50 0x55a0b1860820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.803 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.801+0000 7fc4bf2d3740 1 --2- 172.21.15.87:0/771218703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0b1850330 0x55a0b1862320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.803 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.801+0000 7fc49dffb640 0 client.25739 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:26.803 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.801+0000 7fc4bf2d3740 1 -- 172.21.15.87:0/771218703 >> 172.21.15.87:0/771218703 conn(0x55a0b184c8c0 msgr2=0x55a0b1847a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:26.803 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.801+0000 7fc4bf2d3740 1 -- 172.21.15.87:0/771218703 shutdown_connections 2024-09-13T17:16:26.803 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.801+0000 7fc4bf2d3740 1 -- 172.21.15.87:0/771218703 wait complete. 2024-09-13T17:16:26.804 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.802+0000 7fc4bf2d3740 20 client.25739 trim_cache size 0 max 16384 2024-09-13T17:16:26.804 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout:{ 2024-09-13T17:16:26.804 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout: "message": "", 2024-09-13T17:16:26.804 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout: "return_code": 0 2024-09-13T17:16:26.805 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout:} 2024-09-13T17:16:26.805 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.802+0000 7fc4bc5ae640 1 -- 172.21.15.87:0/643137102 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc4a00a1240 msgr2=0x7fc4a00a3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.802+0000 7fc4bc5ae640 1 --2- 172.21.15.87:0/643137102 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc4a00a1240 0x7fc4a00a3700 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac006010 tx=0x7fc4ac031040 comp rx=0 tx=0).stop 2024-09-13T17:16:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.802+0000 7fc4bc5ae640 1 -- 172.21.15.87:0/643137102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4b4107dd0 msgr2=0x7fc4b41a2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.802+0000 7fc4bc5ae640 1 --2- 172.21.15.87:0/643137102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4b4107dd0 0x7fc4b41a2bc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc4b000d6d0 tx=0x7fc4b000db90 comp rx=0 tx=0).stop 2024-09-13T17:16:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.803+0000 7fc4bc5ae640 1 -- 172.21.15.87:0/643137102 shutdown_connections 2024-09-13T17:16:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.803+0000 7fc4bc5ae640 1 --2- 172.21.15.87:0/643137102 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc4a00a1240 0x7fc4a00a3700 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.803+0000 7fc4bc5ae640 1 --2- 172.21.15.87:0/643137102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4b4112d70 0x7fc4b419c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.803+0000 7fc4bc5ae640 1 --2- 172.21.15.87:0/643137102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4b4107dd0 0x7fc4b41a2bc0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.803+0000 7fc4bc5ae640 1 --2- 172.21.15.87:0/643137102 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4b41074b0 0x7fc4b41a2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.803+0000 7fc4bc5ae640 1 -- 172.21.15.87:0/643137102 >> 172.21.15.87:0/643137102 conn(0x7fc4b406af50 msgr2=0x7fc4b406ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.803+0000 7fc4bc5ae640 1 -- 172.21.15.87:0/643137102 shutdown_connections 2024-09-13T17:16:26.807 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:26.803+0000 7fc4bc5ae640 1 -- 172.21.15.87:0/643137102 wait complete. 2024-09-13T17:16:26.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:26 smithi149 ceph-mon[35496]: pgmap v81: 129 pgs: 129 active+clean; 180 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 403 op/s 2024-09-13T17:16:26.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:26 smithi118 ceph-mon[34374]: pgmap v81: 129 pgs: 129 active+clean; 180 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 403 op/s 2024-09-13T17:16:26.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:26 smithi087 ceph-mon[30934]: pgmap v81: 129 pgs: 129 active+clean; 180 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 403 op/s 2024-09-13T17:16:28.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:28 smithi149 ceph-mon[35496]: pgmap v82: 129 pgs: 129 active+clean; 180 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 347 op/s 2024-09-13T17:16:28.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:28 smithi118 ceph-mon[34374]: pgmap v82: 129 pgs: 129 active+clean; 180 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 347 op/s 2024-09-13T17:16:28.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:28 smithi087 ceph-mon[30934]: pgmap v82: 129 pgs: 129 active+clean; 180 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 347 op/s 2024-09-13T17:16:29.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:29 smithi149 ceph-mon[35496]: pgmap v83: 129 pgs: 129 active+clean; 180 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 340 op/s 2024-09-13T17:16:29.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:29 smithi118 ceph-mon[34374]: pgmap v83: 129 pgs: 129 active+clean; 180 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 340 op/s 2024-09-13T17:16:29.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:29 smithi087 ceph-mon[30934]: pgmap v83: 129 pgs: 129 active+clean; 180 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 340 op/s 2024-09-13T17:16:32.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:32 smithi149 ceph-mon[35496]: pgmap v84: 129 pgs: 129 active+clean; 172 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 643 op/s 2024-09-13T17:16:32.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:32 smithi118 ceph-mon[34374]: pgmap v84: 129 pgs: 129 active+clean; 172 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 643 op/s 2024-09-13T17:16:32.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:32 smithi087 ceph-mon[30934]: pgmap v84: 129 pgs: 129 active+clean; 172 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 643 op/s 2024-09-13T17:16:34.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:34 smithi149 ceph-mon[35496]: pgmap v85: 129 pgs: 129 active+clean; 172 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 439 op/s 2024-09-13T17:16:34.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:34 smithi118 ceph-mon[34374]: pgmap v85: 129 pgs: 129 active+clean; 172 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 439 op/s 2024-09-13T17:16:34.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:34 smithi087 ceph-mon[30934]: pgmap v85: 129 pgs: 129 active+clean; 172 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 439 op/s 2024-09-13T17:16:35.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:35 smithi149 ceph-mon[35496]: pgmap v86: 129 pgs: 129 active+clean; 189 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.0 MiB/s wr, 577 op/s 2024-09-13T17:16:35.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:35 smithi118 ceph-mon[34374]: pgmap v86: 129 pgs: 129 active+clean; 189 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.0 MiB/s wr, 577 op/s 2024-09-13T17:16:35.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:35 smithi087 ceph-mon[30934]: pgmap v86: 129 pgs: 129 active+clean; 189 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.0 MiB/s wr, 577 op/s 2024-09-13T17:16:36.639 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:16:36.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.751+0000 7f0eb4e80640 1 -- 172.21.15.87:0/1745464558 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0eb00ff800 msgr2=0x7f0eb0103840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:36.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.751+0000 7f0eb4e80640 1 --2- 172.21.15.87:0/1745464558 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0eb00ff800 0x7f0eb0103840 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4009930 tx=0x7f0ea402a420 comp rx=0 tx=0).stop 2024-09-13T17:16:36.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.751+0000 7f0eb4e80640 1 -- 172.21.15.87:0/1745464558 shutdown_connections 2024-09-13T17:16:36.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.751+0000 7f0eb4e80640 1 --2- 172.21.15.87:0/1745464558 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0eb0103fa0 0x7f0eb010baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.751+0000 7f0eb4e80640 1 --2- 172.21.15.87:0/1745464558 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0eb00ff800 0x7f0eb0103840 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.751+0000 7f0eb4e80640 1 --2- 172.21.15.87:0/1745464558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0eb00fee50 0x7f0eb00ff230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.751+0000 7f0eb4e80640 1 -- 172.21.15.87:0/1745464558 >> 172.21.15.87:0/1745464558 conn(0x7f0eb00fa8c0 msgr2=0x7f0eb00fcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:36.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.751+0000 7f0eb4e80640 1 -- 172.21.15.87:0/1745464558 shutdown_connections 2024-09-13T17:16:36.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.751+0000 7f0eb4e80640 1 -- 172.21.15.87:0/1745464558 wait complete. 2024-09-13T17:16:36.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.752+0000 7f0eb4e80640 1 Processor -- start 2024-09-13T17:16:36.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.752+0000 7f0eb4e80640 1 -- start start 2024-09-13T17:16:36.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.752+0000 7f0eb4e80640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0eb00fee50 0x7f0eb010c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.752+0000 7f0eb4e80640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0eb0103fa0 0x7f0eb010c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.752+0000 7f0eb4e80640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0eb010ce80 0x7f0eb01a4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.752+0000 7f0eb4e80640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb01a4ae0 con 0x7f0eb0103fa0 2024-09-13T17:16:36.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.752+0000 7f0eb4e80640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb01a4c50 con 0x7f0eb00fee50 2024-09-13T17:16:36.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.752+0000 7f0eb4e80640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb01a4e10 con 0x7f0eb010ce80 2024-09-13T17:16:36.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.752+0000 7f0eadd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0eb0103fa0 0x7f0eb010c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.752+0000 7f0eadd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0eb0103fa0 0x7f0eb010c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39410/0 (socket says 172.21.15.87:39410) 2024-09-13T17:16:36.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.753+0000 7f0eadd9b640 1 -- 172.21.15.87:0/2378921589 learned_addr learned my addr 172.21.15.87:0/2378921589 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:36.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.752+0000 7f0eaed9d640 1 --2- 172.21.15.87:0/2378921589 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0eb010ce80 0x7f0eb01a4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.753+0000 7f0eae59c640 1 --2- 172.21.15.87:0/2378921589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0eb00fee50 0x7f0eb010c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.753+0000 7f0eadd9b640 1 -- 172.21.15.87:0/2378921589 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0eb010ce80 msgr2=0x7f0eb01a4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:36.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.753+0000 7f0eadd9b640 1 --2- 172.21.15.87:0/2378921589 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0eb010ce80 0x7f0eb01a4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.753+0000 7f0eadd9b640 1 -- 172.21.15.87:0/2378921589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0eb00fee50 msgr2=0x7f0eb010c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:36.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.753+0000 7f0eadd9b640 1 --2- 172.21.15.87:0/2378921589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0eb00fee50 0x7f0eb010c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.753+0000 7f0eadd9b640 1 -- 172.21.15.87:0/2378921589 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea4009560 con 0x7f0eb0103fa0 2024-09-13T17:16:36.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.753+0000 7f0eadd9b640 1 --2- 172.21.15.87:0/2378921589 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0eb0103fa0 0x7f0eb010c940 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f0ea402a940 tx=0x7f0ea4003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:36.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.753+0000 7f0e9f7fe640 1 -- 172.21.15.87:0/2378921589 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea403b670 con 0x7f0eb0103fa0 2024-09-13T17:16:36.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.753+0000 7f0e9f7fe640 1 -- 172.21.15.87:0/2378921589 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0ea403bc80 con 0x7f0eb0103fa0 2024-09-13T17:16:36.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.753+0000 7f0eb4e80640 1 -- 172.21.15.87:0/2378921589 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb01a5090 con 0x7f0eb0103fa0 2024-09-13T17:16:36.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.753+0000 7f0e9f7fe640 1 -- 172.21.15.87:0/2378921589 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea4031c60 con 0x7f0eb0103fa0 2024-09-13T17:16:36.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.753+0000 7f0eb4e80640 1 -- 172.21.15.87:0/2378921589 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb01a5590 con 0x7f0eb0103fa0 2024-09-13T17:16:36.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.756+0000 7f0e9f7fe640 1 -- 172.21.15.87:0/2378921589 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f0ea4031400 con 0x7f0eb0103fa0 2024-09-13T17:16:36.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.756+0000 7f0eb7c7f740 1 Processor -- start 2024-09-13T17:16:36.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.756+0000 7f0eb7c7f740 1 -- start start 2024-09-13T17:16:36.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.756+0000 7f0eb7c7f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55df00158e10 0x55df001591f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.756+0000 7f0eb7c7f740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55df00159730 0x55df00163a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.756+0000 7f0eb7c7f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df00163fd0 0x55df001663c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.756+0000 7f0eb7c7f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df000c3f20 con 0x55df00163fd0 2024-09-13T17:16:36.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.756+0000 7f0eb7c7f740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df000c16b0 con 0x55df00159730 2024-09-13T17:16:36.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.756+0000 7f0eb7c7f740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df000bcfa0 con 0x55df00158e10 2024-09-13T17:16:36.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.757+0000 7f0e9f7fe640 1 --2- 172.21.15.87:0/2378921589 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0e980a12b0 0x7f0e980a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.757+0000 7f0eadd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df00163fd0 0x55df001663c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.757+0000 7f0eadd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df00163fd0 0x55df001663c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39420/0 (socket says 172.21.15.87:39420) 2024-09-13T17:16:36.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.757+0000 7f0eadd9b640 1 -- 172.21.15.87:0/3439160330 learned_addr learned my addr 172.21.15.87:0/3439160330 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:36.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.757+0000 7f0eaed9d640 1 --2- 172.21.15.87:0/3439160330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55df00158e10 0x55df001591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.757+0000 7f0eaed9d640 1 --2- 172.21.15.87:0/2378921589 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0e980a12b0 0x7f0e980a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.757+0000 7f0eae59c640 1 --2- 172.21.15.87:0/3439160330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55df00159730 0x55df00163a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.757+0000 7f0e9f7fe640 1 -- 172.21.15.87:0/2378921589 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f0ea40ed800 con 0x7f0eb0103fa0 2024-09-13T17:16:36.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.757+0000 7f0eadd9b640 1 -- 172.21.15.87:0/3439160330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55df00158e10 msgr2=0x55df001591f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:36.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.757+0000 7f0eadd9b640 1 --2- 172.21.15.87:0/3439160330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55df00158e10 0x55df001591f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.757+0000 7f0eadd9b640 1 -- 172.21.15.87:0/3439160330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55df00159730 msgr2=0x55df00163a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:36.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.757+0000 7f0eadd9b640 1 --2- 172.21.15.87:0/3439160330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55df00159730 0x55df00163a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.757+0000 7f0eadd9b640 1 -- 172.21.15.87:0/3439160330 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df00077840 con 0x55df00163fd0 2024-09-13T17:16:36.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.757+0000 7f0eaed9d640 1 --2- 172.21.15.87:0/2378921589 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0e980a12b0 0x7f0e980a3770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0ea800a780 tx=0x7f0ea800a4d0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:36.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.757+0000 7f0eadd9b640 1 --2- 172.21.15.87:0/3439160330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df00163fd0 0x55df001663c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f0ea40b7080 tx=0x7f0ea40ba280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45dc2f4f5ddc6817 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:36.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.757+0000 7f0e9cff9640 1 -- 172.21.15.87:0/3439160330 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea40be390 con 0x55df00163fd0 2024-09-13T17:16:36.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.757+0000 7f0e9cff9640 1 -- 172.21.15.87:0/3439160330 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0ea40ba610 con 0x55df00163fd0 2024-09-13T17:16:36.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.757+0000 7f0e9cff9640 1 -- 172.21.15.87:0/3439160330 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea40eaf80 con 0x55df00163fd0 2024-09-13T17:16:36.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.758+0000 7f0eb7c7f740 1 -- 172.21.15.87:0/3439160330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df00163fd0 msgr2=0x55df001663c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:36.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.758+0000 7f0eb7c7f740 1 --2- 172.21.15.87:0/3439160330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df00163fd0 0x55df001663c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f0ea40b7080 tx=0x7f0ea40ba280 comp rx=0 tx=0).stop 2024-09-13T17:16:36.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.758+0000 7f0eb7c7f740 1 -- 172.21.15.87:0/3439160330 shutdown_connections 2024-09-13T17:16:36.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.758+0000 7f0eb7c7f740 1 --2- 172.21.15.87:0/3439160330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df00163fd0 0x55df001663c0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.758+0000 7f0eb7c7f740 1 --2- 172.21.15.87:0/3439160330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55df00159730 0x55df00163a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.758+0000 7f0eb7c7f740 1 --2- 172.21.15.87:0/3439160330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55df00158e10 0x55df001591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.758+0000 7f0eb7c7f740 1 -- 172.21.15.87:0/3439160330 >> 172.21.15.87:0/3439160330 conn(0x55df00155380 msgr2=0x55df00155760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:36.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.758+0000 7f0eb7c7f740 1 -- 172.21.15.87:0/3439160330 shutdown_connections 2024-09-13T17:16:36.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.758+0000 7f0eb7c7f740 1 -- 172.21.15.87:0/3439160330 wait complete. 2024-09-13T17:16:36.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.759+0000 7f0eb7c7f740 1 -- start start 2024-09-13T17:16:36.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.759+0000 7f0eb7c7f740 1 Processor -- start 2024-09-13T17:16:36.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.759+0000 7f0eb7c7f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df00158e10 0x55df00163950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.759+0000 7f0eb7c7f740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55df00159730 0x55df00160c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.759+0000 7f0eb7c7f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55df00163fd0 0x55df00161230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.759+0000 7f0eb7c7f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df0005e2a0 con 0x55df00158e10 2024-09-13T17:16:36.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.759+0000 7f0eb7c7f740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55deffd95430 con 0x55df00159730 2024-09-13T17:16:36.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.759+0000 7f0eb7c7f740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df00040680 con 0x55df00163fd0 2024-09-13T17:16:36.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.759+0000 7f0eb7c7f740 10 client.0 _ll_register_callbacks cb 0x55df000b6610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:36.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.759+0000 7f0eae59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df00158e10 0x55df00163950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.759+0000 7f0eae59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df00158e10 0x55df00163950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39430/0 (socket says 172.21.15.87:39430) 2024-09-13T17:16:36.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.759+0000 7f0eae59c640 1 -- 172.21.15.87:0/397680095 learned_addr learned my addr 172.21.15.87:0/397680095 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:36.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.759+0000 7f0eaed9d640 1 --2- 172.21.15.87:0/397680095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55df00163fd0 0x55df00161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.759+0000 7f0eadd9b640 1 --2- 172.21.15.87:0/397680095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55df00159730 0x55df00160c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.759+0000 7f0eae59c640 1 -- 172.21.15.87:0/397680095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55df00163fd0 msgr2=0x55df00161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:36.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.759+0000 7f0eae59c640 1 --2- 172.21.15.87:0/397680095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55df00163fd0 0x55df00161230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.759+0000 7f0eae59c640 1 -- 172.21.15.87:0/397680095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55df00159730 msgr2=0x55df00160c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:36.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.759+0000 7f0eae59c640 1 --2- 172.21.15.87:0/397680095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55df00159730 0x55df00160c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.759+0000 7f0eae59c640 1 -- 172.21.15.87:0/397680095 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb01a5590 con 0x55df00158e10 2024-09-13T17:16:36.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.759+0000 7f0eaed9d640 1 --2- 172.21.15.87:0/397680095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55df00163fd0 0x55df00161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:36.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.759+0000 7f0eadd9b640 1 --2- 172.21.15.87:0/397680095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55df00159730 0x55df00160c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:36.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.760+0000 7f0eae59c640 1 --2- 172.21.15.87:0/397680095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df00158e10 0x55df00163950 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f0ea000b990 tx=0x7f0ea000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad86adde13e99b5b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:36.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.760+0000 7f0e95ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:16:36.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.760+0000 7f0e95ffb640 1 -- 172.21.15.87:0/397680095 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0016070 con 0x55df00158e10 2024-09-13T17:16:36.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.760+0000 7f0e95ffb640 1 -- 172.21.15.87:0/397680095 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f0ea0011440 con 0x55df00158e10 2024-09-13T17:16:36.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.760+0000 7f0eb7c7f740 1 -- 172.21.15.87:0/397680095 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55deffdb04e0 con 0x55df00158e10 2024-09-13T17:16:36.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.760+0000 7f0e95ffb640 1 -- 172.21.15.87:0/397680095 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ea0003ec0 con 0x55df00158e10 2024-09-13T17:16:36.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.760+0000 7f0eb7c7f740 10 client.16431 fetch_fsmap learned FSMap version 30 2024-09-13T17:16:36.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.760+0000 7f0eb7c7f740 1 -- 172.21.15.87:0/397680095 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55df000bb620 con 0x55df00158e10 2024-09-13T17:16:36.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.760+0000 7f0e95ffb640 1 -- 172.21.15.87:0/397680095 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55deffdb04e0 con 0x55df00158e10 2024-09-13T17:16:36.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.760+0000 7f0e95ffb640 1 -- 172.21.15.87:0/397680095 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f0ea001b670 con 0x55df00158e10 2024-09-13T17:16:36.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.760+0000 7f0eb7c7f740 10 client.16431 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:16:36.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.760+0000 7f0eb7c7f740 10 client.16431 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:16:36.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.760+0000 7f0eb7c7f740 20 client.16431 populate_metadata read hostname 'smithi087' 2024-09-13T17:16:36.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.760+0000 7f0eb7c7f740 1 --2- 172.21.15.87:0/397680095 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55df00173c60 0x55df00176080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.760+0000 7f0eb7c7f740 4 client.16431 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:16:36.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.760+0000 7f0eb7c7f740 1 -- 172.21.15.87:0/397680095 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55deffdc17e0 con 0x55df00173c60 2024-09-13T17:16:36.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.760+0000 7f0eadd9b640 1 --2- 172.21.15.87:0/397680095 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55df00173c60 0x55df00176080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.761+0000 7f0e95ffb640 10 client.16431 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:36.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.761+0000 7f0eadd9b640 1 --2- 172.21.15.87:0/397680095 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55df00173c60 0x55df00176080 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f1eea45b0d2a058 server_cookie=e8c5e8bd8f52002e in_seq=0 out_seq=0 2024-09-13T17:16:36.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.761+0000 7f0e95ffb640 1 -- 172.21.15.87:0/397680095 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55deffdc17e0 con 0x55df00173c60 2024-09-13T17:16:36.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.761+0000 7f0e95ffb640 10 client.16431 handle_command_reply: tid=0 2024-09-13T17:16:36.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.761+0000 7f0eb7c7f740 1 client.16431 shutdown 2024-09-13T17:16:36.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.762+0000 7f0eb7c7f740 1 -- 172.21.15.87:0/397680095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df00158e10 msgr2=0x55df00163950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:36.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.762+0000 7f0eb7c7f740 1 --2- 172.21.15.87:0/397680095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df00158e10 0x55df00163950 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f0ea000b990 tx=0x7f0ea000be50 comp rx=0 tx=0).stop 2024-09-13T17:16:36.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.762+0000 7f0eb7c7f740 1 -- 172.21.15.87:0/397680095 shutdown_connections 2024-09-13T17:16:36.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.762+0000 7f0eb7c7f740 1 --2- 172.21.15.87:0/397680095 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55df00173c60 0x55df00176080 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.762+0000 7f0eb7c7f740 1 --2- 172.21.15.87:0/397680095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55df00163fd0 0x55df00161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.762+0000 7f0eb7c7f740 1 --2- 172.21.15.87:0/397680095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55df00159730 0x55df00160c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.762+0000 7f0e95ffb640 0 client.16431 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:36.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.762+0000 7f0eb7c7f740 1 --2- 172.21.15.87:0/397680095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df00158e10 0x55df00163950 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.762+0000 7f0eb7c7f740 1 -- 172.21.15.87:0/397680095 >> 172.21.15.87:0/397680095 conn(0x55df00155380 msgr2=0x55df00154510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:36.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.762+0000 7f0eb7c7f740 1 -- 172.21.15.87:0/397680095 shutdown_connections 2024-09-13T17:16:36.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.762+0000 7f0eb7c7f740 1 -- 172.21.15.87:0/397680095 wait complete. 2024-09-13T17:16:36.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.762+0000 7f0eb7c7f740 20 client.16431 trim_cache size 0 max 16384 2024-09-13T17:16:36.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.776+0000 7f0eb7c7f740 1 Processor -- start 2024-09-13T17:16:36.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.776+0000 7f0eb7c7f740 1 -- start start 2024-09-13T17:16:36.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.776+0000 7f0eb7c7f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55df00158e10 0x55df00154d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.776+0000 7f0eb7c7f740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55df00159730 0x55df0015bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.776+0000 7f0eb7c7f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df00163fd0 0x55df0015c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.776+0000 7f0eb7c7f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55deffdb04e0 con 0x55df00163fd0 2024-09-13T17:16:36.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.776+0000 7f0eb7c7f740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df0016fa10 con 0x55df00159730 2024-09-13T17:16:36.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.776+0000 7f0eb7c7f740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df00161f50 con 0x55df00158e10 2024-09-13T17:16:36.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.776+0000 7f0eaed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df00163fd0 0x55df0015c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.776+0000 7f0eaed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df00163fd0 0x55df0015c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39434/0 (socket says 172.21.15.87:39434) 2024-09-13T17:16:36.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.776+0000 7f0eaed9d640 1 -- 172.21.15.87:0/3773071231 learned_addr learned my addr 172.21.15.87:0/3773071231 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:36.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.776+0000 7f0eae59c640 1 --2- 172.21.15.87:0/3773071231 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55df00158e10 0x55df00154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.776+0000 7f0eadd9b640 1 --2- 172.21.15.87:0/3773071231 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55df00159730 0x55df0015bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.776+0000 7f0eaed9d640 1 -- 172.21.15.87:0/3773071231 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55df00158e10 msgr2=0x55df00154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:36.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.776+0000 7f0eaed9d640 1 --2- 172.21.15.87:0/3773071231 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55df00158e10 0x55df00154d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.776+0000 7f0eaed9d640 1 -- 172.21.15.87:0/3773071231 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55df00159730 msgr2=0x55df0015bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:36.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.776+0000 7f0eaed9d640 1 --2- 172.21.15.87:0/3773071231 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55df00159730 0x55df0015bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.776+0000 7f0eaed9d640 1 -- 172.21.15.87:0/3773071231 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df0005d790 con 0x55df00163fd0 2024-09-13T17:16:36.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.776+0000 7f0eadd9b640 1 --2- 172.21.15.87:0/3773071231 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55df00159730 0x55df0015bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:36.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.776+0000 7f0eaed9d640 1 --2- 172.21.15.87:0/3773071231 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df00163fd0 0x55df0015c430 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8011d70 tx=0x7f0ea800a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db4a10ee4a291a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:36.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.777+0000 7f0e9d7fa640 1 -- 172.21.15.87:0/3773071231 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8004d20 con 0x55df00163fd0 2024-09-13T17:16:36.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.777+0000 7f0e9d7fa640 1 -- 172.21.15.87:0/3773071231 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0ea8024070 con 0x55df00163fd0 2024-09-13T17:16:36.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.777+0000 7f0e9d7fa640 1 -- 172.21.15.87:0/3773071231 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8004020 con 0x55df00163fd0 2024-09-13T17:16:36.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.777+0000 7f0eb7c7f740 1 -- 172.21.15.87:0/3773071231 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df00163fd0 msgr2=0x55df0015c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:36.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.777+0000 7f0eb7c7f740 1 --2- 172.21.15.87:0/3773071231 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df00163fd0 0x55df0015c430 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8011d70 tx=0x7f0ea800a890 comp rx=0 tx=0).stop 2024-09-13T17:16:36.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.777+0000 7f0eb7c7f740 1 -- 172.21.15.87:0/3773071231 shutdown_connections 2024-09-13T17:16:36.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.777+0000 7f0eb7c7f740 1 --2- 172.21.15.87:0/3773071231 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df00163fd0 0x55df0015c430 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.777+0000 7f0eb7c7f740 1 --2- 172.21.15.87:0/3773071231 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55df00159730 0x55df0015bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.777+0000 7f0eb7c7f740 1 --2- 172.21.15.87:0/3773071231 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55df00158e10 0x55df00154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.777+0000 7f0eb7c7f740 1 -- 172.21.15.87:0/3773071231 >> 172.21.15.87:0/3773071231 conn(0x55df00155380 msgr2=0x55df0017a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:36.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.777+0000 7f0eb7c7f740 1 -- 172.21.15.87:0/3773071231 shutdown_connections 2024-09-13T17:16:36.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.777+0000 7f0eb7c7f740 1 -- 172.21.15.87:0/3773071231 wait complete. 2024-09-13T17:16:36.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.778+0000 7f0eb7c7f740 1 -- start start 2024-09-13T17:16:36.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.778+0000 7f0eb7c7f740 1 Processor -- start 2024-09-13T17:16:36.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.778+0000 7f0eb7c7f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55df00158e10 0x55df0016ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.778+0000 7f0eb7c7f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df00159730 0x55df0016b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.778+0000 7f0eb7c7f740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55df00163fd0 0x55df0015d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.778+0000 7f0eb7c7f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df0015dd80 con 0x55df00159730 2024-09-13T17:16:36.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.778+0000 7f0eb7c7f740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df0015def0 con 0x55df00163fd0 2024-09-13T17:16:36.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.778+0000 7f0eb7c7f740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df0015e0b0 con 0x55df00158e10 2024-09-13T17:16:36.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.778+0000 7f0eb7c7f740 10 client.0 _ll_register_callbacks cb 0x7f0ea00042b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:36.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.778+0000 7f0eadd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df00159730 0x55df0016b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.778+0000 7f0eadd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df00159730 0x55df0016b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39438/0 (socket says 172.21.15.87:39438) 2024-09-13T17:16:36.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.778+0000 7f0eadd9b640 1 -- 172.21.15.87:0/3930938349 learned_addr learned my addr 172.21.15.87:0/3930938349 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:36.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.778+0000 7f0eae59c640 1 --2- 172.21.15.87:0/3930938349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55df00158e10 0x55df0016ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.778+0000 7f0eadd9b640 1 -- 172.21.15.87:0/3930938349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55df00158e10 msgr2=0x55df0016ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:36.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.778+0000 7f0eadd9b640 1 --2- 172.21.15.87:0/3930938349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55df00158e10 0x55df0016ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.778+0000 7f0eadd9b640 1 -- 172.21.15.87:0/3930938349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55df00163fd0 msgr2=0x55df0015d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:36.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.778+0000 7f0eaed9d640 1 --2- 172.21.15.87:0/3930938349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55df00163fd0 0x55df0015d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.778+0000 7f0eadd9b640 1 --2- 172.21.15.87:0/3930938349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55df00163fd0 0x55df0015d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.778+0000 7f0eadd9b640 1 -- 172.21.15.87:0/3930938349 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea8011a00 con 0x55df00159730 2024-09-13T17:16:36.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.778+0000 7f0eaed9d640 1 --2- 172.21.15.87:0/3930938349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55df00163fd0 0x55df0015d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:36.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.779+0000 7f0eadd9b640 1 --2- 172.21.15.87:0/3930938349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df00159730 0x55df0016b040 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f0ea40eb1a0 tx=0x7f0ea40b6950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a7eacac5afc476 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:36.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.779+0000 7f0e95ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:16:36.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.779+0000 7f0e95ffb640 1 -- 172.21.15.87:0/3930938349 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea40be410 con 0x55df00159730 2024-09-13T17:16:36.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.779+0000 7f0e95ffb640 1 -- 172.21.15.87:0/3930938349 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f0ea40c29e0 con 0x55df00159730 2024-09-13T17:16:36.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.779+0000 7f0eb7c7f740 1 -- 172.21.15.87:0/3930938349 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0ea40ba610 con 0x55df00159730 2024-09-13T17:16:36.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.779+0000 7f0e95ffb640 1 -- 172.21.15.87:0/3930938349 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ea40b89b0 con 0x55df00159730 2024-09-13T17:16:36.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.779+0000 7f0eb7c7f740 10 client.16437 fetch_fsmap learned FSMap version 30 2024-09-13T17:16:36.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.779+0000 7f0eb7c7f740 1 -- 172.21.15.87:0/3930938349 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55df00082ea0 con 0x55df00159730 2024-09-13T17:16:36.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.779+0000 7f0e95ffb640 1 -- 172.21.15.87:0/3930938349 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0ea40ba610 con 0x55df00159730 2024-09-13T17:16:36.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.779+0000 7f0e95ffb640 1 -- 172.21.15.87:0/3930938349 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f0ea40a50f0 con 0x55df00159730 2024-09-13T17:16:36.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.779+0000 7f0eb7c7f740 10 client.16437 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:16:36.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.779+0000 7f0eb7c7f740 10 client.16437 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:16:36.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.779+0000 7f0eb7c7f740 20 client.16437 populate_metadata read hostname 'smithi087' 2024-09-13T17:16:36.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.779+0000 7f0eb7c7f740 1 --2- 172.21.15.87:0/3930938349 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55df001cb1c0 0x55df001cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.779+0000 7f0eb7c7f740 4 client.16437 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:16:36.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.779+0000 7f0eb7c7f740 1 -- 172.21.15.87:0/3930938349 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55deffe14e30 con 0x55df001cb1c0 2024-09-13T17:16:36.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.779+0000 7f0eae59c640 1 --2- 172.21.15.87:0/3930938349 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55df001cb1c0 0x55df001cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.780+0000 7f0e95ffb640 10 client.16437 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:36.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.780+0000 7f0eae59c640 1 --2- 172.21.15.87:0/3930938349 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55df001cb1c0 0x55df001cd5e0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72950d7ee4ffa17d server_cookie=bb6cc52056536a56 in_seq=0 out_seq=0 2024-09-13T17:16:36.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.780+0000 7f0e95ffb640 1 -- 172.21.15.87:0/3930938349 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55deffe14e30 con 0x55df001cb1c0 2024-09-13T17:16:36.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.780+0000 7f0e95ffb640 10 client.16437 handle_command_reply: tid=0 2024-09-13T17:16:36.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.780+0000 7f0eb7c7f740 1 client.16437 shutdown 2024-09-13T17:16:36.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.780+0000 7f0eb7c7f740 1 -- 172.21.15.87:0/3930938349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df00159730 msgr2=0x55df0016b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:36.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.780+0000 7f0eb7c7f740 1 --2- 172.21.15.87:0/3930938349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df00159730 0x55df0016b040 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f0ea40eb1a0 tx=0x7f0ea40b6950 comp rx=0 tx=0).stop 2024-09-13T17:16:36.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.780+0000 7f0eb7c7f740 1 -- 172.21.15.87:0/3930938349 shutdown_connections 2024-09-13T17:16:36.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.780+0000 7f0eb7c7f740 1 --2- 172.21.15.87:0/3930938349 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55df001cb1c0 0x55df001cd5e0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.780+0000 7f0eb7c7f740 1 --2- 172.21.15.87:0/3930938349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55df00163fd0 0x55df0015d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.780+0000 7f0e95ffb640 0 client.16437 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:36.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.780+0000 7f0eb7c7f740 1 --2- 172.21.15.87:0/3930938349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55df00159730 0x55df0016b040 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.780+0000 7f0eb7c7f740 1 --2- 172.21.15.87:0/3930938349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55df00158e10 0x55df0016ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.780+0000 7f0eb7c7f740 1 -- 172.21.15.87:0/3930938349 >> 172.21.15.87:0/3930938349 conn(0x55df00155380 msgr2=0x55df00155760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:36.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.780+0000 7f0eb7c7f740 1 -- 172.21.15.87:0/3930938349 shutdown_connections 2024-09-13T17:16:36.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.780+0000 7f0eb7c7f740 1 -- 172.21.15.87:0/3930938349 wait complete. 2024-09-13T17:16:36.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.780+0000 7f0eb7c7f740 20 client.16437 trim_cache size 0 max 16384 2024-09-13T17:16:36.792 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:16:36.792 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "no active scrubs running", 2024-09-13T17:16:36.792 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": {} 2024-09-13T17:16:36.792 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:16:36.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.781+0000 7f0eb4e80640 1 -- 172.21.15.87:0/2378921589 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0e980a12b0 msgr2=0x7f0e980a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:36.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.781+0000 7f0eb4e80640 1 --2- 172.21.15.87:0/2378921589 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0e980a12b0 0x7f0e980a3770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0ea800a780 tx=0x7f0ea800a4d0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.781+0000 7f0eb4e80640 1 -- 172.21.15.87:0/2378921589 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0eb0103fa0 msgr2=0x7f0eb010c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:36.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.781+0000 7f0eb4e80640 1 --2- 172.21.15.87:0/2378921589 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0eb0103fa0 0x7f0eb010c940 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f0ea402a940 tx=0x7f0ea4003cd0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.781+0000 7f0eb4e80640 1 -- 172.21.15.87:0/2378921589 shutdown_connections 2024-09-13T17:16:36.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.781+0000 7f0eb4e80640 1 --2- 172.21.15.87:0/2378921589 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0eb010ce80 0x7f0eb01a4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.781+0000 7f0eb4e80640 1 --2- 172.21.15.87:0/2378921589 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0e980a12b0 0x7f0e980a3770 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.781+0000 7f0eb4e80640 1 --2- 172.21.15.87:0/2378921589 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0eb0103fa0 0x7f0eb010c940 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.781+0000 7f0eb4e80640 1 --2- 172.21.15.87:0/2378921589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0eb00fee50 0x7f0eb010c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.781+0000 7f0eb4e80640 1 -- 172.21.15.87:0/2378921589 >> 172.21.15.87:0/2378921589 conn(0x7f0eb00fa8c0 msgr2=0x7f0eb00fbd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:36.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.781+0000 7f0eb4e80640 1 -- 172.21.15.87:0/2378921589 shutdown_connections 2024-09-13T17:16:36.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.781+0000 7f0eb4e80640 1 -- 172.21.15.87:0/2378921589 wait complete. 2024-09-13T17:16:36.795 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T17:16:36.795 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:16:36.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.892+0000 7ff363cde640 1 -- 172.21.15.87:0/1752513420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff35c100920 msgr2=0x7ff35c104960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:36.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.892+0000 7ff363cde640 1 --2- 172.21.15.87:0/1752513420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff35c100920 0x7ff35c104960 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7ff34c009930 tx=0x7ff34c02a420 comp rx=0 tx=0).stop 2024-09-13T17:16:36.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.893+0000 7ff363cde640 1 -- 172.21.15.87:0/1752513420 shutdown_connections 2024-09-13T17:16:36.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.893+0000 7ff363cde640 1 --2- 172.21.15.87:0/1752513420 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff35c1050c0 0x7ff35c10cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.893+0000 7ff363cde640 1 --2- 172.21.15.87:0/1752513420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff35c100920 0x7ff35c104960 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.893+0000 7ff363cde640 1 --2- 172.21.15.87:0/1752513420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff35c0fff70 0x7ff35c100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.893+0000 7ff363cde640 1 -- 172.21.15.87:0/1752513420 >> 172.21.15.87:0/1752513420 conn(0x7ff35c0fba20 msgr2=0x7ff35c0fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:36.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.893+0000 7ff363cde640 1 -- 172.21.15.87:0/1752513420 shutdown_connections 2024-09-13T17:16:36.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.893+0000 7ff363cde640 1 -- 172.21.15.87:0/1752513420 wait complete. 2024-09-13T17:16:36.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.893+0000 7ff363cde640 1 Processor -- start 2024-09-13T17:16:36.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.893+0000 7ff363cde640 1 -- start start 2024-09-13T17:16:36.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.893+0000 7ff363cde640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff35c0fff70 0x7ff35c1962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.893+0000 7ff363cde640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff35c1050c0 0x7ff35c196800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.893+0000 7ff363cde640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff35c19abf0 0x7ff35c19b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.893+0000 7ff363cde640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c19b5e0 con 0x7ff35c19abf0 2024-09-13T17:16:36.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.893+0000 7ff363cde640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c19b750 con 0x7ff35c1050c0 2024-09-13T17:16:36.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.893+0000 7ff363cde640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c19b8c0 con 0x7ff35c0fff70 2024-09-13T17:16:36.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.894+0000 7ff36227b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff35c19abf0 0x7ff35c19b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.894+0000 7ff36227b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff35c19abf0 0x7ff35c19b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39442/0 (socket says 172.21.15.87:39442) 2024-09-13T17:16:36.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.894+0000 7ff36227b640 1 -- 172.21.15.87:0/3326381930 learned_addr learned my addr 172.21.15.87:0/3326381930 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:36.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.894+0000 7ff361a7a640 1 --2- 172.21.15.87:0/3326381930 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff35c0fff70 0x7ff35c1962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.894+0000 7ff361279640 1 --2- 172.21.15.87:0/3326381930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff35c1050c0 0x7ff35c196800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.894+0000 7ff36227b640 1 -- 172.21.15.87:0/3326381930 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff35c0fff70 msgr2=0x7ff35c1962c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:36.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.894+0000 7ff36227b640 1 --2- 172.21.15.87:0/3326381930 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff35c0fff70 0x7ff35c1962c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.894+0000 7ff36227b640 1 -- 172.21.15.87:0/3326381930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff35c1050c0 msgr2=0x7ff35c196800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:36.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.894+0000 7ff36227b640 1 --2- 172.21.15.87:0/3326381930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff35c1050c0 0x7ff35c196800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:36.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.894+0000 7ff36227b640 1 -- 172.21.15.87:0/3326381930 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff34c009560 con 0x7ff35c19abf0 2024-09-13T17:16:36.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.894+0000 7ff36227b640 1 --2- 172.21.15.87:0/3326381930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff35c19abf0 0x7ff35c19b0a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff35400eb10 tx=0x7ff35400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:36.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.894+0000 7ff352ffd640 1 -- 172.21.15.87:0/3326381930 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff354004b20 con 0x7ff35c19abf0 2024-09-13T17:16:36.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.894+0000 7ff352ffd640 1 -- 172.21.15.87:0/3326381930 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff354004c80 con 0x7ff35c19abf0 2024-09-13T17:16:36.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.894+0000 7ff352ffd640 1 -- 172.21.15.87:0/3326381930 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff354010690 con 0x7ff35c19abf0 2024-09-13T17:16:36.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.894+0000 7ff363cde640 1 -- 172.21.15.87:0/3326381930 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff35c1a2ea0 con 0x7ff35c19abf0 2024-09-13T17:16:36.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.894+0000 7ff363cde640 1 -- 172.21.15.87:0/3326381930 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff35c1a32d0 con 0x7ff35c19abf0 2024-09-13T17:16:36.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.895+0000 7ff363cde640 1 -- 172.21.15.87:0/3326381930 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff35c101440 con 0x7ff35c19abf0 2024-09-13T17:16:36.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.896+0000 7ff352ffd640 1 -- 172.21.15.87:0/3326381930 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7ff3540107f0 con 0x7ff35c19abf0 2024-09-13T17:16:36.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.897+0000 7ff352ffd640 1 --2- 172.21.15.87:0/3326381930 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff3480a1280 0x7ff3480a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:36.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.897+0000 7ff361a7a640 1 --2- 172.21.15.87:0/3326381930 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff3480a1280 0x7ff3480a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:36.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.897+0000 7ff352ffd640 1 -- 172.21.15.87:0/3326381930 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7ff354014070 con 0x7ff35c19abf0 2024-09-13T17:16:36.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.897+0000 7ff361a7a640 1 --2- 172.21.15.87:0/3326381930 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff3480a1280 0x7ff3480a3740 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff358009bd0 tx=0x7ff358005f90 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:36.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:36.900+0000 7ff352ffd640 1 -- 172.21.15.87:0/3326381930 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff3540967b0 con 0x7ff35c19abf0 2024-09-13T17:16:37.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.099+0000 7ff363cde640 1 -- 172.21.15.87:0/3326381930 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff35c108330 con 0x7ff35c19abf0 2024-09-13T17:16:37.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.099+0000 7ff352ffd640 1 -- 172.21.15.87:0/3326381930 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+10886 (secure 0 0 0) 0x7ff354099dd0 con 0x7ff35c19abf0 2024-09-13T17:16:37.101 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:16:37.101 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/3674545180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":3674545180},{"type":"v1","addr":"172.21.15.87:6841","nonce":3674545180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:11:23.313609+0000","modified":"2024-09-13T17:16:22.516744+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24484,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6839/3052680456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3052680456},{"type":"v1","addr":"172.21.15.118:6839","nonce":3052680456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:16:37.101 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 30 2024-09-13T17:16:37.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.101+0000 7ff363cde640 1 -- 172.21.15.87:0/3326381930 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff3480a1280 msgr2=0x7ff3480a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.101+0000 7ff363cde640 1 --2- 172.21.15.87:0/3326381930 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff3480a1280 0x7ff3480a3740 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff358009bd0 tx=0x7ff358005f90 comp rx=0 tx=0).stop 2024-09-13T17:16:37.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.101+0000 7ff363cde640 1 -- 172.21.15.87:0/3326381930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff35c19abf0 msgr2=0x7ff35c19b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.101+0000 7ff363cde640 1 --2- 172.21.15.87:0/3326381930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff35c19abf0 0x7ff35c19b0a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff35400eb10 tx=0x7ff35400c2d0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.101+0000 7ff363cde640 1 -- 172.21.15.87:0/3326381930 shutdown_connections 2024-09-13T17:16:37.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.101+0000 7ff363cde640 1 --2- 172.21.15.87:0/3326381930 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff3480a1280 0x7ff3480a3740 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.101+0000 7ff363cde640 1 --2- 172.21.15.87:0/3326381930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff35c19abf0 0x7ff35c19b0a0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.101+0000 7ff363cde640 1 --2- 172.21.15.87:0/3326381930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff35c1050c0 0x7ff35c196800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.101+0000 7ff363cde640 1 --2- 172.21.15.87:0/3326381930 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff35c0fff70 0x7ff35c1962c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.101+0000 7ff363cde640 1 -- 172.21.15.87:0/3326381930 >> 172.21.15.87:0/3326381930 conn(0x7ff35c0fba20 msgr2=0x7ff35c0fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:37.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.101+0000 7ff363cde640 1 -- 172.21.15.87:0/3326381930 shutdown_connections 2024-09-13T17:16:37.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.102+0000 7ff363cde640 1 -- 172.21.15.87:0/3326381930 wait complete. 2024-09-13T17:16:37.113 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-09-13T17:16:37.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.212+0000 7f18bd67d640 1 -- 172.21.15.87:0/4075292362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18b80ff810 msgr2=0x7f18b8103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.212+0000 7f18bd67d640 1 --2- 172.21.15.87:0/4075292362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18b80ff810 0x7f18b8103850 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f18ac009930 tx=0x7f18ac02a420 comp rx=0 tx=0).stop 2024-09-13T17:16:37.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.212+0000 7f18bd67d640 1 -- 172.21.15.87:0/4075292362 shutdown_connections 2024-09-13T17:16:37.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.212+0000 7f18bd67d640 1 --2- 172.21.15.87:0/4075292362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18b8103fb0 0x7f18b810bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.212+0000 7f18bd67d640 1 --2- 172.21.15.87:0/4075292362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18b80ff810 0x7f18b8103850 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.212+0000 7f18bd67d640 1 --2- 172.21.15.87:0/4075292362 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18b80fee60 0x7f18b80ff240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.212+0000 7f18bd67d640 1 -- 172.21.15.87:0/4075292362 >> 172.21.15.87:0/4075292362 conn(0x7f18b8075c60 msgr2=0x7f18b80fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:37.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.212+0000 7f18bd67d640 1 -- 172.21.15.87:0/4075292362 shutdown_connections 2024-09-13T17:16:37.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.213+0000 7f18bd67d640 1 -- 172.21.15.87:0/4075292362 wait complete. 2024-09-13T17:16:37.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.213+0000 7f18bd67d640 1 Processor -- start 2024-09-13T17:16:37.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.213+0000 7f18bd67d640 1 -- start start 2024-09-13T17:16:37.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.213+0000 7f18bd67d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18b80fee60 0x7f18b81970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.213+0000 7f18bd67d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18b8103fb0 0x7f18b8197610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.213+0000 7f18bd67d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18b8197b50 0x7f18b81a2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.213+0000 7f18bd67d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b81a27f0 con 0x7f18b80fee60 2024-09-13T17:16:37.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.213+0000 7f18bd67d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b81a2960 con 0x7f18b8103fb0 2024-09-13T17:16:37.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.213+0000 7f18bd67d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b81a2b20 con 0x7f18b8197b50 2024-09-13T17:16:37.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.213+0000 7f18b6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18b80fee60 0x7f18b81970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.214+0000 7f18b6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18b80fee60 0x7f18b81970d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39456/0 (socket says 172.21.15.87:39456) 2024-09-13T17:16:37.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.214+0000 7f18b6ffd640 1 -- 172.21.15.87:0/1967759554 learned_addr learned my addr 172.21.15.87:0/1967759554 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:37.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.214+0000 7f18b77fe640 1 --2- 172.21.15.87:0/1967759554 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18b8197b50 0x7f18b81a2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.214+0000 7f18b67fc640 1 --2- 172.21.15.87:0/1967759554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18b8103fb0 0x7f18b8197610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.214+0000 7f18b6ffd640 1 -- 172.21.15.87:0/1967759554 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18b8197b50 msgr2=0x7f18b81a2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.214+0000 7f18b6ffd640 1 --2- 172.21.15.87:0/1967759554 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18b8197b50 0x7f18b81a2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.214+0000 7f18b6ffd640 1 -- 172.21.15.87:0/1967759554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18b8103fb0 msgr2=0x7f18b8197610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.214+0000 7f18b6ffd640 1 --2- 172.21.15.87:0/1967759554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18b8103fb0 0x7f18b8197610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.214+0000 7f18b6ffd640 1 -- 172.21.15.87:0/1967759554 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ac009560 con 0x7f18b80fee60 2024-09-13T17:16:37.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.214+0000 7f18b67fc640 1 --2- 172.21.15.87:0/1967759554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18b8103fb0 0x7f18b8197610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:37.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.214+0000 7f18b6ffd640 1 --2- 172.21.15.87:0/1967759554 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18b80fee60 0x7f18b81970d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f18a800cce0 tx=0x7f18a800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:37.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.214+0000 7f189ffff640 1 -- 172.21.15.87:0/1967759554 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a800f650 con 0x7f18b80fee60 2024-09-13T17:16:37.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.214+0000 7f189ffff640 1 -- 172.21.15.87:0/1967759554 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f18a800ce90 con 0x7f18b80fee60 2024-09-13T17:16:37.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.214+0000 7f18bd67d640 1 -- 172.21.15.87:0/1967759554 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b81a2e00 con 0x7f18b80fee60 2024-09-13T17:16:37.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.214+0000 7f189ffff640 1 -- 172.21.15.87:0/1967759554 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a8018b10 con 0x7f18b80fee60 2024-09-13T17:16:37.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.214+0000 7f18bd67d640 1 -- 172.21.15.87:0/1967759554 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b81a3280 con 0x7f18b80fee60 2024-09-13T17:16:37.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.216+0000 7f189ffff640 1 -- 172.21.15.87:0/1967759554 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f18a8018c70 con 0x7f18b80fee60 2024-09-13T17:16:37.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.217+0000 7f18c0479740 1 Processor -- start 2024-09-13T17:16:37.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.217+0000 7f18c0479740 1 -- start start 2024-09-13T17:16:37.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.217+0000 7f18c0479740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636c0a0e790 0x5636c0a0eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.217+0000 7f18c0479740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636c0a0f0b0 0x5636c0a19410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.217+0000 7f189ffff640 1 --2- 172.21.15.87:0/1967759554 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f18a00a1200 0x7f18a00a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.217+0000 7f18c0479740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636c0a19950 0x5636c0a1bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.217+0000 7f18c0479740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636c0978cc0 con 0x5636c0a0e790 2024-09-13T17:16:37.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.217+0000 7f18c0479740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636c0976450 con 0x5636c0a19950 2024-09-13T17:16:37.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.217+0000 7f18c0479740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636c0971d40 con 0x5636c0a0f0b0 2024-09-13T17:16:37.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.217+0000 7f18b77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636c0a0e790 0x5636c0a0eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.217+0000 7f18b77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636c0a0e790 0x5636c0a0eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39458/0 (socket says 172.21.15.87:39458) 2024-09-13T17:16:37.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.217+0000 7f18b77fe640 1 -- 172.21.15.87:0/1962409609 learned_addr learned my addr 172.21.15.87:0/1962409609 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:37.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.217+0000 7f18b67fc640 1 --2- 172.21.15.87:0/1967759554 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f18a00a1200 0x7f18a00a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.217+0000 7f18b6ffd640 1 --2- 172.21.15.87:0/1962409609 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636c0a0f0b0 0x5636c0a19410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.217+0000 7f189ffff640 1 -- 172.21.15.87:0/1967759554 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f18a80cd4b0 con 0x7f18b80fee60 2024-09-13T17:16:37.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.217+0000 7f18b77fe640 1 --2- 172.21.15.87:0/1962409609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636c0a19950 0x5636c0a1bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.217+0000 7f18b77fe640 1 -- 172.21.15.87:0/1962409609 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636c0a0f0b0 msgr2=0x5636c0a19410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:37.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.217+0000 7f18b77fe640 1 --2- 172.21.15.87:0/1962409609 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636c0a0f0b0 0x5636c0a19410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.217+0000 7f18b77fe640 1 -- 172.21.15.87:0/1962409609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636c0a19950 msgr2=0x5636c0a1bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:37.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.217+0000 7f18b77fe640 1 --2- 172.21.15.87:0/1962409609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636c0a19950 0x5636c0a1bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.217+0000 7f18b77fe640 1 -- 172.21.15.87:0/1962409609 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636c0939620 con 0x5636c0a0e790 2024-09-13T17:16:37.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.218+0000 7f18b77fe640 1 --2- 172.21.15.87:0/1962409609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636c0a0e790 0x5636c0a0eb70 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f18b0009f70 tx=0x7f18b0009530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1c8389c98dbda69 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:37.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.218+0000 7f18b67fc640 1 --2- 172.21.15.87:0/1967759554 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f18a00a1200 0x7f18a00a36c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f18ac006010 tx=0x7f18ac000bc0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:37.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.218+0000 7f189d7fa640 1 -- 172.21.15.87:0/1962409609 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b0017610 con 0x5636c0a0e790 2024-09-13T17:16:37.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.218+0000 7f189d7fa640 1 -- 172.21.15.87:0/1962409609 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f18b0017c20 con 0x5636c0a0e790 2024-09-13T17:16:37.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.218+0000 7f189d7fa640 1 -- 172.21.15.87:0/1962409609 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b00158f0 con 0x5636c0a0e790 2024-09-13T17:16:37.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.218+0000 7f18c0479740 1 -- 172.21.15.87:0/1962409609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636c0a0e790 msgr2=0x5636c0a0eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.218+0000 7f18c0479740 1 --2- 172.21.15.87:0/1962409609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636c0a0e790 0x5636c0a0eb70 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f18b0009f70 tx=0x7f18b0009530 comp rx=0 tx=0).stop 2024-09-13T17:16:37.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.218+0000 7f18c0479740 1 -- 172.21.15.87:0/1962409609 shutdown_connections 2024-09-13T17:16:37.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.218+0000 7f18c0479740 1 --2- 172.21.15.87:0/1962409609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636c0a19950 0x5636c0a1bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.218+0000 7f18c0479740 1 --2- 172.21.15.87:0/1962409609 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636c0a0f0b0 0x5636c0a19410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.218+0000 7f18c0479740 1 --2- 172.21.15.87:0/1962409609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636c0a0e790 0x5636c0a0eb70 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.218+0000 7f18c0479740 1 -- 172.21.15.87:0/1962409609 >> 172.21.15.87:0/1962409609 conn(0x5636c0a0ad00 msgr2=0x5636c0a0b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:37.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.218+0000 7f18c0479740 1 -- 172.21.15.87:0/1962409609 shutdown_connections 2024-09-13T17:16:37.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.218+0000 7f18c0479740 1 -- 172.21.15.87:0/1962409609 wait complete. 2024-09-13T17:16:37.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.219+0000 7f18c0479740 1 -- start start 2024-09-13T17:16:37.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.219+0000 7f18c0479740 1 Processor -- start 2024-09-13T17:16:37.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.219+0000 7f18c0479740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636c0a0e790 0x5636c0a18eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.219+0000 7f18c0479740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636c0a0f0b0 0x5636c0a193f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.219+0000 7f18c0479740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636c0a19950 0x5636c0a16540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.219+0000 7f18c0479740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636c0930180 con 0x5636c0a0f0b0 2024-09-13T17:16:37.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.219+0000 7f18c0479740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636c064a430 con 0x5636c0a19950 2024-09-13T17:16:37.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.219+0000 7f18c0479740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636c08f55e0 con 0x5636c0a0e790 2024-09-13T17:16:37.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.219+0000 7f18c0479740 10 client.0 _ll_register_callbacks cb 0x5636c0961aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:37.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.219+0000 7f18b67fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636c0a0f0b0 0x5636c0a193f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.219+0000 7f18b67fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636c0a0f0b0 0x5636c0a193f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39474/0 (socket says 172.21.15.87:39474) 2024-09-13T17:16:37.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.219+0000 7f18b67fc640 1 -- 172.21.15.87:0/2429810869 learned_addr learned my addr 172.21.15.87:0/2429810869 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:37.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.219+0000 7f18b6ffd640 1 --2- 172.21.15.87:0/2429810869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636c0a0e790 0x5636c0a18eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.219+0000 7f18b77fe640 1 --2- 172.21.15.87:0/2429810869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636c0a19950 0x5636c0a16540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.219+0000 7f18b67fc640 1 -- 172.21.15.87:0/2429810869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636c0a0e790 msgr2=0x5636c0a18eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:37.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.219+0000 7f18b67fc640 1 --2- 172.21.15.87:0/2429810869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636c0a0e790 0x5636c0a18eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.219+0000 7f18b67fc640 1 -- 172.21.15.87:0/2429810869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636c0a19950 msgr2=0x5636c0a16540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:37.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.219+0000 7f18b67fc640 1 --2- 172.21.15.87:0/2429810869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636c0a19950 0x5636c0a16540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.219+0000 7f18b67fc640 1 -- 172.21.15.87:0/2429810869 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b0009af0 con 0x5636c0a0f0b0 2024-09-13T17:16:37.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.220+0000 7f18b67fc640 1 --2- 172.21.15.87:0/2429810869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636c0a0f0b0 0x5636c0a193f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f18ac033000 tx=0x7f18ac009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f874f6c7ac1b7ece server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:37.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.220+0000 7f189aff5640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:16:37.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.220+0000 7f189aff5640 1 -- 172.21.15.87:0/2429810869 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac003af0 con 0x5636c0a0f0b0 2024-09-13T17:16:37.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.220+0000 7f189aff5640 1 -- 172.21.15.87:0/2429810869 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f18ac043040 con 0x5636c0a0f0b0 2024-09-13T17:16:37.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.220+0000 7f18c0479740 1 -- 172.21.15.87:0/2429810869 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5636c099bb80 con 0x5636c0a0f0b0 2024-09-13T17:16:37.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.220+0000 7f189aff5640 1 -- 172.21.15.87:0/2429810869 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18ac003c50 con 0x5636c0a0f0b0 2024-09-13T17:16:37.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.220+0000 7f18c0479740 10 client.16455 fetch_fsmap learned FSMap version 30 2024-09-13T17:16:37.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.220+0000 7f18c0479740 1 -- 172.21.15.87:0/2429810869 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5636c09703c0 con 0x5636c0a0f0b0 2024-09-13T17:16:37.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.220+0000 7f189aff5640 1 -- 172.21.15.87:0/2429810869 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x5636c099bb80 con 0x5636c0a0f0b0 2024-09-13T17:16:37.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.220+0000 7f189aff5640 1 -- 172.21.15.87:0/2429810869 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f18ac047410 con 0x5636c0a0f0b0 2024-09-13T17:16:37.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.220+0000 7f18c0479740 10 client.16455 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:16:37.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.220+0000 7f18c0479740 10 client.16455 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:16:37.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.220+0000 7f18c0479740 20 client.16455 populate_metadata read hostname 'smithi087' 2024-09-13T17:16:37.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.220+0000 7f18c0479740 1 --2- 172.21.15.87:0/2429810869 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x5636c0a29330 0x5636c0a2b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.220+0000 7f18c0479740 4 client.16455 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:16:37.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.220+0000 7f18c0479740 1 -- 172.21.15.87:0/2429810869 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5636c09641f0 con 0x5636c0a29330 2024-09-13T17:16:37.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.221+0000 7f18b6ffd640 1 --2- 172.21.15.87:0/2429810869 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x5636c0a29330 0x5636c0a2b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.221+0000 7f189aff5640 10 client.16455 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:16:37.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.221+0000 7f18b6ffd640 1 --2- 172.21.15.87:0/2429810869 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x5636c0a29330 0x5636c0a2b750 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7a6726f4aac2679f server_cookie=1da2881c3ca24dca in_seq=0 out_seq=0 2024-09-13T17:16:37.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.222+0000 7f189aff5640 1 -- 172.21.15.87:0/2429810869 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5636c09641f0 con 0x5636c0a29330 2024-09-13T17:16:37.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.222+0000 7f189aff5640 10 client.16455 handle_command_reply: tid=0 2024-09-13T17:16:37.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.222+0000 7f18c0479740 1 client.16455 shutdown 2024-09-13T17:16:37.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.222+0000 7f18c0479740 1 -- 172.21.15.87:0/2429810869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636c0a0f0b0 msgr2=0x5636c0a193f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.222+0000 7f18c0479740 1 --2- 172.21.15.87:0/2429810869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636c0a0f0b0 0x5636c0a193f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f18ac033000 tx=0x7f18ac009260 comp rx=0 tx=0).stop 2024-09-13T17:16:37.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.222+0000 7f18c0479740 1 -- 172.21.15.87:0/2429810869 shutdown_connections 2024-09-13T17:16:37.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.222+0000 7f18c0479740 1 --2- 172.21.15.87:0/2429810869 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x5636c0a29330 0x5636c0a2b750 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.222+0000 7f18c0479740 1 --2- 172.21.15.87:0/2429810869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636c0a19950 0x5636c0a16540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.222+0000 7f18c0479740 1 --2- 172.21.15.87:0/2429810869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636c0a0f0b0 0x5636c0a193f0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.222+0000 7f18c0479740 1 --2- 172.21.15.87:0/2429810869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636c0a0e790 0x5636c0a18eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.222+0000 7f189aff5640 0 client.16455 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:16:37.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.222+0000 7f18c0479740 1 -- 172.21.15.87:0/2429810869 >> 172.21.15.87:0/2429810869 conn(0x5636c0a0ad00 msgr2=0x5636c0a10a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:37.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.222+0000 7f18c0479740 1 -- 172.21.15.87:0/2429810869 shutdown_connections 2024-09-13T17:16:37.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.222+0000 7f18c0479740 1 -- 172.21.15.87:0/2429810869 wait complete. 2024-09-13T17:16:37.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.222+0000 7f18c0479740 20 client.16455 trim_cache size 0 max 16384 2024-09-13T17:16:37.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.233+0000 7f18c0479740 1 Processor -- start 2024-09-13T17:16:37.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.233+0000 7f18c0479740 1 -- start start 2024-09-13T17:16:37.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.233+0000 7f18c0479740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636c0a0e790 0x5636c0a14bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.233+0000 7f18c0479740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636c0a0f0b0 0x5636c0a15100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.233+0000 7f18c0479740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636c0a19950 0x5636c0a18ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.233+0000 7f18c0479740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636c0a27ac0 con 0x5636c0a0e790 2024-09-13T17:16:37.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.233+0000 7f18c0479740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636c0a0f750 con 0x5636c0a0f0b0 2024-09-13T17:16:37.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.233+0000 7f18c0479740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636c0a15640 con 0x5636c0a19950 2024-09-13T17:16:37.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.233+0000 7f18b6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636c0a0e790 0x5636c0a14bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.233+0000 7f18b6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636c0a0e790 0x5636c0a14bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39486/0 (socket says 172.21.15.87:39486) 2024-09-13T17:16:37.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.233+0000 7f18b6ffd640 1 -- 172.21.15.87:0/2169187709 learned_addr learned my addr 172.21.15.87:0/2169187709 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:37.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.233+0000 7f18b6ffd640 1 -- 172.21.15.87:0/2169187709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636c0a19950 msgr2=0x5636c0a18ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:37.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.233+0000 7f18b6ffd640 1 --2- 172.21.15.87:0/2169187709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636c0a19950 0x5636c0a18ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.233+0000 7f18b6ffd640 1 -- 172.21.15.87:0/2169187709 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636c0a0f0b0 msgr2=0x5636c0a15100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:37.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.233+0000 7f18b67fc640 1 --2- 172.21.15.87:0/2169187709 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636c0a0f0b0 0x5636c0a15100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.233+0000 7f18b6ffd640 1 --2- 172.21.15.87:0/2169187709 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636c0a0f0b0 0x5636c0a15100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.233+0000 7f18b6ffd640 1 -- 172.21.15.87:0/2169187709 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636c0912770 con 0x5636c0a0e790 2024-09-13T17:16:37.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.233+0000 7f18b67fc640 1 --2- 172.21.15.87:0/2169187709 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636c0a0f0b0 0x5636c0a15100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:37.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.233+0000 7f18b6ffd640 1 --2- 172.21.15.87:0/2169187709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636c0a0e790 0x5636c0a14bc0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f18a800afd0 tx=0x7f18a8085040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66353156c3a13796 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:37.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.233+0000 7f189dffb640 1 -- 172.21.15.87:0/2169187709 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a809a2b0 con 0x5636c0a0e790 2024-09-13T17:16:37.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.234+0000 7f189dffb640 1 -- 172.21.15.87:0/2169187709 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f18a809e0e0 con 0x5636c0a0e790 2024-09-13T17:16:37.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.234+0000 7f189dffb640 1 -- 172.21.15.87:0/2169187709 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a80cab70 con 0x5636c0a0e790 2024-09-13T17:16:37.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.234+0000 7f18c0479740 1 -- 172.21.15.87:0/2169187709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636c0a0e790 msgr2=0x5636c0a14bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.234+0000 7f18c0479740 1 --2- 172.21.15.87:0/2169187709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636c0a0e790 0x5636c0a14bc0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f18a800afd0 tx=0x7f18a8085040 comp rx=0 tx=0).stop 2024-09-13T17:16:37.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.234+0000 7f18c0479740 1 -- 172.21.15.87:0/2169187709 shutdown_connections 2024-09-13T17:16:37.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.234+0000 7f18c0479740 1 --2- 172.21.15.87:0/2169187709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636c0a19950 0x5636c0a18ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.234+0000 7f18c0479740 1 --2- 172.21.15.87:0/2169187709 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636c0a0f0b0 0x5636c0a15100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.234+0000 7f18c0479740 1 --2- 172.21.15.87:0/2169187709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636c0a0e790 0x5636c0a14bc0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.234+0000 7f18c0479740 1 -- 172.21.15.87:0/2169187709 >> 172.21.15.87:0/2169187709 conn(0x5636c0a0ad00 msgr2=0x5636c0a30070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:37.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.234+0000 7f18c0479740 1 -- 172.21.15.87:0/2169187709 shutdown_connections 2024-09-13T17:16:37.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.234+0000 7f18c0479740 1 -- 172.21.15.87:0/2169187709 wait complete. 2024-09-13T17:16:37.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.234+0000 7f18c0479740 1 -- start start 2024-09-13T17:16:37.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.235+0000 7f18c0479740 1 Processor -- start 2024-09-13T17:16:37.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.235+0000 7f18c0479740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636c0a0e790 0x5636c0a209e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.235+0000 7f18c0479740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636c0a0f0b0 0x5636c0a12dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.235+0000 7f18c0479740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636c0a19950 0x5636c0a13390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.235+0000 7f18c0479740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636c0a13a90 con 0x5636c0a0e790 2024-09-13T17:16:37.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.235+0000 7f18c0479740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636c0a13c00 con 0x5636c0a0f0b0 2024-09-13T17:16:37.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.235+0000 7f18c0479740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636c0a7f7f0 con 0x5636c0a19950 2024-09-13T17:16:37.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.235+0000 7f18c0479740 10 client.0 _ll_register_callbacks cb 0x7f18b0009440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:37.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.235+0000 7f18b6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636c0a0e790 0x5636c0a209e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.235+0000 7f18b6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636c0a0e790 0x5636c0a209e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39494/0 (socket says 172.21.15.87:39494) 2024-09-13T17:16:37.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.235+0000 7f18b6ffd640 1 -- 172.21.15.87:0/1060073127 learned_addr learned my addr 172.21.15.87:0/1060073127 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:37.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.235+0000 7f18b67fc640 1 --2- 172.21.15.87:0/1060073127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636c0a0f0b0 0x5636c0a12dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.235+0000 7f18b77fe640 1 --2- 172.21.15.87:0/1060073127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636c0a19950 0x5636c0a13390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.235+0000 7f18b6ffd640 1 -- 172.21.15.87:0/1060073127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636c0a19950 msgr2=0x5636c0a13390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:37.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.235+0000 7f18b6ffd640 1 --2- 172.21.15.87:0/1060073127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636c0a19950 0x5636c0a13390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.235+0000 7f18b6ffd640 1 -- 172.21.15.87:0/1060073127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636c0a0f0b0 msgr2=0x5636c0a12dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:37.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.235+0000 7f18b6ffd640 1 --2- 172.21.15.87:0/1060073127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636c0a0f0b0 0x5636c0a12dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.235+0000 7f18b6ffd640 1 -- 172.21.15.87:0/1060073127 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a8065a90 con 0x5636c0a0e790 2024-09-13T17:16:37.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.235+0000 7f18b77fe640 1 --2- 172.21.15.87:0/1060073127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636c0a19950 0x5636c0a13390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:37.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.235+0000 7f18b6ffd640 1 --2- 172.21.15.87:0/1060073127 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636c0a0e790 0x5636c0a209e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f18a8000f80 tx=0x7f18a809ab00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5782b7982fbd7bf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:37.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.235+0000 7f189aff5640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:16:37.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.235+0000 7f189aff5640 1 -- 172.21.15.87:0/1060073127 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a809a2b0 con 0x5636c0a0e790 2024-09-13T17:16:37.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.235+0000 7f189aff5640 1 -- 172.21.15.87:0/1060073127 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f18a80b1050 con 0x5636c0a0e790 2024-09-13T17:16:37.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.236+0000 7f18c0479740 1 -- 172.21.15.87:0/1060073127 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f18b0017c20 con 0x5636c0a0e790 2024-09-13T17:16:37.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.236+0000 7f189aff5640 1 -- 172.21.15.87:0/1060073127 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18a8098650 con 0x5636c0a0e790 2024-09-13T17:16:37.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.236+0000 7f18c0479740 10 client.16461 fetch_fsmap learned FSMap version 30 2024-09-13T17:16:37.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.236+0000 7f18c0479740 1 -- 172.21.15.87:0/1060073127 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5636c0937e80 con 0x5636c0a0e790 2024-09-13T17:16:37.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.236+0000 7f189aff5640 1 -- 172.21.15.87:0/1060073127 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f18b0017c20 con 0x5636c0a0e790 2024-09-13T17:16:37.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.236+0000 7f189aff5640 1 -- 172.21.15.87:0/1060073127 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f18a8016020 con 0x5636c0a0e790 2024-09-13T17:16:37.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.236+0000 7f18c0479740 10 client.16461 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:16:37.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.236+0000 7f18c0479740 10 client.16461 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:16:37.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.236+0000 7f18c0479740 20 client.16461 populate_metadata read hostname 'smithi087' 2024-09-13T17:16:37.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.236+0000 7f18c0479740 1 --2- 172.21.15.87:0/1060073127 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x5636c0a80a80 0x5636c0a82e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.236+0000 7f18c0479740 4 client.16461 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:16:37.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.236+0000 7f18c0479740 1 -- 172.21.15.87:0/1060073127 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5636c06654e0 con 0x5636c0a80a80 2024-09-13T17:16:37.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.236+0000 7f18b67fc640 1 --2- 172.21.15.87:0/1060073127 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x5636c0a80a80 0x5636c0a82e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.237+0000 7f189aff5640 10 client.16461 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:16:37.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.237+0000 7f18b67fc640 1 --2- 172.21.15.87:0/1060073127 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x5636c0a80a80 0x5636c0a82e70 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=aec3b3ab298530e2 server_cookie=5558490b58e75df7 in_seq=0 out_seq=0 2024-09-13T17:16:37.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.237+0000 7f189aff5640 1 -- 172.21.15.87:0/1060073127 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5636c06654e0 con 0x5636c0a80a80 2024-09-13T17:16:37.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.237+0000 7f189aff5640 10 client.16461 handle_command_reply: tid=0 2024-09-13T17:16:37.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.237+0000 7f18c0479740 1 client.16461 shutdown 2024-09-13T17:16:37.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.237+0000 7f18c0479740 1 -- 172.21.15.87:0/1060073127 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636c0a0e790 msgr2=0x5636c0a209e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.237+0000 7f18c0479740 1 --2- 172.21.15.87:0/1060073127 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636c0a0e790 0x5636c0a209e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f18a8000f80 tx=0x7f18a809ab00 comp rx=0 tx=0).stop 2024-09-13T17:16:37.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.237+0000 7f18c0479740 1 -- 172.21.15.87:0/1060073127 shutdown_connections 2024-09-13T17:16:37.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.237+0000 7f18c0479740 1 --2- 172.21.15.87:0/1060073127 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x5636c0a80a80 0x5636c0a82e70 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.237+0000 7f18c0479740 1 --2- 172.21.15.87:0/1060073127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636c0a19950 0x5636c0a13390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.237+0000 7f189aff5640 0 client.16461 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:16:37.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.237+0000 7f18c0479740 1 --2- 172.21.15.87:0/1060073127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636c0a0f0b0 0x5636c0a12dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.237+0000 7f18c0479740 1 --2- 172.21.15.87:0/1060073127 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5636c0a0e790 0x5636c0a209e0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.237+0000 7f18c0479740 1 -- 172.21.15.87:0/1060073127 >> 172.21.15.87:0/1060073127 conn(0x5636c0a0ad00 msgr2=0x5636c0a18c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:37.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.237+0000 7f18c0479740 1 -- 172.21.15.87:0/1060073127 shutdown_connections 2024-09-13T17:16:37.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.237+0000 7f18c0479740 1 -- 172.21.15.87:0/1060073127 wait complete. 2024-09-13T17:16:37.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.237+0000 7f18c0479740 20 client.16461 trim_cache size 0 max 16384 2024-09-13T17:16:37.257 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:16:37.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.237+0000 7f18bd67d640 1 -- 172.21.15.87:0/1967759554 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f18a00a1200 msgr2=0x7f18a00a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.237+0000 7f18bd67d640 1 --2- 172.21.15.87:0/1967759554 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f18a00a1200 0x7f18a00a36c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f18ac006010 tx=0x7f18ac000bc0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.237+0000 7f18bd67d640 1 -- 172.21.15.87:0/1967759554 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18b80fee60 msgr2=0x7f18b81970d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.237+0000 7f18bd67d640 1 --2- 172.21.15.87:0/1967759554 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18b80fee60 0x7f18b81970d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f18a800cce0 tx=0x7f18a800a620 comp rx=0 tx=0).stop 2024-09-13T17:16:37.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.237+0000 7f18bd67d640 1 -- 172.21.15.87:0/1967759554 shutdown_connections 2024-09-13T17:16:37.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.237+0000 7f18bd67d640 1 --2- 172.21.15.87:0/1967759554 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18b8197b50 0x7f18b81a2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.237+0000 7f18bd67d640 1 --2- 172.21.15.87:0/1967759554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18b8103fb0 0x7f18b8197610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.237+0000 7f18bd67d640 1 --2- 172.21.15.87:0/1967759554 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f18a00a1200 0x7f18a00a36c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.237+0000 7f18bd67d640 1 --2- 172.21.15.87:0/1967759554 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18b80fee60 0x7f18b81970d0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.238+0000 7f18bd67d640 1 -- 172.21.15.87:0/1967759554 >> 172.21.15.87:0/1967759554 conn(0x7f18b8075c60 msgr2=0x7f18b80fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:37.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.238+0000 7f18bd67d640 1 -- 172.21.15.87:0/1967759554 shutdown_connections 2024-09-13T17:16:37.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.238+0000 7f18bd67d640 1 -- 172.21.15.87:0/1967759554 wait complete. 2024-09-13T17:16:37.261 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-09-13T17:16:37.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.373+0000 7fb53cab1640 1 -- 172.21.15.87:0/1879947380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5380fff50 msgr2=0x7fb538100330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.373+0000 7fb53cab1640 1 --2- 172.21.15.87:0/1879947380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5380fff50 0x7fb538100330 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fb528009930 tx=0x7fb52802a420 comp rx=0 tx=0).stop 2024-09-13T17:16:37.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.373+0000 7fb53cab1640 1 -- 172.21.15.87:0/1879947380 shutdown_connections 2024-09-13T17:16:37.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.373+0000 7fb53cab1640 1 --2- 172.21.15.87:0/1879947380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5381050a0 0x7fb53810cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.373+0000 7fb53cab1640 1 --2- 172.21.15.87:0/1879947380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb538100900 0x7fb538104940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.373+0000 7fb53cab1640 1 --2- 172.21.15.87:0/1879947380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5380fff50 0x7fb538100330 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.373+0000 7fb53cab1640 1 -- 172.21.15.87:0/1879947380 >> 172.21.15.87:0/1879947380 conn(0x7fb5380fb9e0 msgr2=0x7fb5380fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:37.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.373+0000 7fb53cab1640 1 -- 172.21.15.87:0/1879947380 shutdown_connections 2024-09-13T17:16:37.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.373+0000 7fb53cab1640 1 -- 172.21.15.87:0/1879947380 wait complete. 2024-09-13T17:16:37.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.374+0000 7fb53cab1640 1 Processor -- start 2024-09-13T17:16:37.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.374+0000 7fb53cab1640 1 -- start start 2024-09-13T17:16:37.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.374+0000 7fb53cab1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5380fff50 0x7fb5380727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.374+0000 7fb53cab1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5381050a0 0x7fb538072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.374+0000 7fb53cab1640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb538073230 0x7fb5381a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.374+0000 7fb53cab1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5381a49e0 con 0x7fb5380fff50 2024-09-13T17:16:37.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.374+0000 7fb53cab1640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5381a4b50 con 0x7fb5381050a0 2024-09-13T17:16:37.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.374+0000 7fb53cab1640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5381a4d10 con 0x7fb538073230 2024-09-13T17:16:37.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.374+0000 7fb53659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5380fff50 0x7fb5380727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.374+0000 7fb53659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5380fff50 0x7fb5380727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39508/0 (socket says 172.21.15.87:39508) 2024-09-13T17:16:37.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.374+0000 7fb53659c640 1 -- 172.21.15.87:0/3189810607 learned_addr learned my addr 172.21.15.87:0/3189810607 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:37.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.374+0000 7fb536d9d640 1 --2- 172.21.15.87:0/3189810607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb538073230 0x7fb5381a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.374+0000 7fb535d9b640 1 --2- 172.21.15.87:0/3189810607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5381050a0 0x7fb538072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.374+0000 7fb53659c640 1 -- 172.21.15.87:0/3189810607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb538073230 msgr2=0x7fb5381a4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.374+0000 7fb53659c640 1 --2- 172.21.15.87:0/3189810607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb538073230 0x7fb5381a4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.374+0000 7fb53659c640 1 -- 172.21.15.87:0/3189810607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5381050a0 msgr2=0x7fb538072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.374+0000 7fb53659c640 1 --2- 172.21.15.87:0/3189810607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5381050a0 0x7fb538072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.374+0000 7fb53659c640 1 -- 172.21.15.87:0/3189810607 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb528009560 con 0x7fb5380fff50 2024-09-13T17:16:37.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.374+0000 7fb535d9b640 1 --2- 172.21.15.87:0/3189810607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5381050a0 0x7fb538072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:37.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.374+0000 7fb53659c640 1 --2- 172.21.15.87:0/3189810607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5380fff50 0x7fb5380727b0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fb528009900 tx=0x7fb5280040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:37.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.374+0000 7fb5277fe640 1 -- 172.21.15.87:0/3189810607 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5280037f0 con 0x7fb5380fff50 2024-09-13T17:16:37.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.374+0000 7fb5277fe640 1 -- 172.21.15.87:0/3189810607 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb5280044c0 con 0x7fb5380fff50 2024-09-13T17:16:37.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.374+0000 7fb5277fe640 1 -- 172.21.15.87:0/3189810607 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52803bda0 con 0x7fb5380fff50 2024-09-13T17:16:37.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.375+0000 7fb53cab1640 1 -- 172.21.15.87:0/3189810607 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5381a4f90 con 0x7fb5380fff50 2024-09-13T17:16:37.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.375+0000 7fb53cab1640 1 -- 172.21.15.87:0/3189810607 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5381a53b0 con 0x7fb5380fff50 2024-09-13T17:16:37.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.377+0000 7fb5277fe640 1 -- 172.21.15.87:0/3189810607 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fb52803b560 con 0x7fb5380fff50 2024-09-13T17:16:37.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.377+0000 7fb53f7d5740 1 Processor -- start 2024-09-13T17:16:37.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.377+0000 7fb53f7d5740 1 -- start start 2024-09-13T17:16:37.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.377+0000 7fb53f7d5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55af9d196790 0x55af9d196b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.377+0000 7fb53f7d5740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55af9d1970b0 0x55af9d1a1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.377+0000 7fb53f7d5740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55af9d1a1950 0x55af9d1a3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.377+0000 7fb53f7d5740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af9d100cc0 con 0x55af9d1a1950 2024-09-13T17:16:37.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.377+0000 7fb53f7d5740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af9d0fe450 con 0x55af9d1970b0 2024-09-13T17:16:37.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.377+0000 7fb53f7d5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af9d0f9d40 con 0x55af9d196790 2024-09-13T17:16:37.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.378+0000 7fb535d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55af9d1a1950 0x55af9d1a3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.378+0000 7fb536d9d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55af9d196790 0x55af9d196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.378+0000 7fb535d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55af9d1a1950 0x55af9d1a3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39512/0 (socket says 172.21.15.87:39512) 2024-09-13T17:16:37.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.378+0000 7fb5277fe640 1 --2- 172.21.15.87:0/3189810607 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb5200a1280 0x7fb5200a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.378+0000 7fb535d9b640 1 -- 172.21.15.87:0/2563919636 learned_addr learned my addr 172.21.15.87:0/2563919636 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:37.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.378+0000 7fb53659c640 1 --2- 172.21.15.87:0/2563919636 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55af9d1970b0 0x55af9d1a1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.378+0000 7fb536d9d640 1 --2- 172.21.15.87:0/3189810607 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb5200a1280 0x7fb5200a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.378+0000 7fb536d9d640 1 -- 172.21.15.87:0/2563919636 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55af9d1970b0 msgr2=0x55af9d1a1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:37.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.378+0000 7fb5277fe640 1 -- 172.21.15.87:0/3189810607 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fb5280edbf0 con 0x7fb5380fff50 2024-09-13T17:16:37.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.378+0000 7fb536d9d640 1 --2- 172.21.15.87:0/2563919636 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55af9d1970b0 0x55af9d1a1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.378+0000 7fb536d9d640 1 -- 172.21.15.87:0/2563919636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55af9d1a1950 msgr2=0x55af9d1a3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:37.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.378+0000 7fb536d9d640 1 --2- 172.21.15.87:0/2563919636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55af9d1a1950 0x55af9d1a3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.378+0000 7fb536d9d640 1 -- 172.21.15.87:0/2563919636 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55af9d0c1620 con 0x55af9d196790 2024-09-13T17:16:37.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.378+0000 7fb535d9b640 1 --2- 172.21.15.87:0/2563919636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55af9d1a1950 0x55af9d1a3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:16:37.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.378+0000 7fb53659c640 1 --2- 172.21.15.87:0/2563919636 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55af9d1970b0 0x55af9d1a1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:37.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.378+0000 7fb536d9d640 1 --2- 172.21.15.87:0/2563919636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55af9d196790 0x55af9d196b70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb530005fd0 tx=0x7fb530013e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=981c4672703c62d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:37.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.378+0000 7fb536d9d640 1 --2- 172.21.15.87:0/3189810607 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb5200a1280 0x7fb5200a3740 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb53001e000 tx=0x7fb530020000 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:37.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.378+0000 7fb524ff9640 1 -- 172.21.15.87:0/2563919636 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53000fc60 con 0x55af9d196790 2024-09-13T17:16:37.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.379+0000 7fb524ff9640 1 -- 172.21.15.87:0/2563919636 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb53000fdc0 con 0x55af9d196790 2024-09-13T17:16:37.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.379+0000 7fb524ff9640 1 -- 172.21.15.87:0/2563919636 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb530010bd0 con 0x55af9d196790 2024-09-13T17:16:37.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.379+0000 7fb53f7d5740 1 -- 172.21.15.87:0/2563919636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55af9d196790 msgr2=0x55af9d196b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.379+0000 7fb53f7d5740 1 --2- 172.21.15.87:0/2563919636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55af9d196790 0x55af9d196b70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb530005fd0 tx=0x7fb530013e50 comp rx=0 tx=0).stop 2024-09-13T17:16:37.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.379+0000 7fb53f7d5740 1 -- 172.21.15.87:0/2563919636 shutdown_connections 2024-09-13T17:16:37.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.379+0000 7fb53f7d5740 1 --2- 172.21.15.87:0/2563919636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55af9d1a1950 0x55af9d1a3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.379+0000 7fb53f7d5740 1 --2- 172.21.15.87:0/2563919636 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55af9d1970b0 0x55af9d1a1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.379+0000 7fb53f7d5740 1 --2- 172.21.15.87:0/2563919636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55af9d196790 0x55af9d196b70 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.379+0000 7fb53f7d5740 1 -- 172.21.15.87:0/2563919636 >> 172.21.15.87:0/2563919636 conn(0x55af9d192d00 msgr2=0x55af9d1930e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:37.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.379+0000 7fb53f7d5740 1 -- 172.21.15.87:0/2563919636 shutdown_connections 2024-09-13T17:16:37.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.379+0000 7fb53f7d5740 1 -- 172.21.15.87:0/2563919636 wait complete. 2024-09-13T17:16:37.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.380+0000 7fb53f7d5740 1 -- start start 2024-09-13T17:16:37.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.380+0000 7fb53f7d5740 1 Processor -- start 2024-09-13T17:16:37.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.380+0000 7fb53f7d5740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55af9d196790 0x55af9d1a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.380+0000 7fb53f7d5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55af9d1970b0 0x55af9d19e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.380+0000 7fb53f7d5740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55af9d1a1950 0x55af9d19e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.380+0000 7fb53f7d5740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af9d0b8180 con 0x55af9d1a1950 2024-09-13T17:16:37.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.380+0000 7fb53f7d5740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af9cdd2430 con 0x55af9d196790 2024-09-13T17:16:37.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.380+0000 7fb53f7d5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af9d07d5e0 con 0x55af9d1970b0 2024-09-13T17:16:37.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.380+0000 7fb53f7d5740 10 client.0 _ll_register_callbacks cb 0x55af9d0e9aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:37.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.380+0000 7fb536d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55af9d1a1950 0x55af9d19e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.380+0000 7fb536d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55af9d1a1950 0x55af9d19e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39522/0 (socket says 172.21.15.87:39522) 2024-09-13T17:16:37.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.380+0000 7fb536d9d640 1 -- 172.21.15.87:0/2856784124 learned_addr learned my addr 172.21.15.87:0/2856784124 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:37.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.380+0000 7fb535d9b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55af9d1970b0 0x55af9d19e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.380+0000 7fb53659c640 1 --2- 172.21.15.87:0/2856784124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55af9d196790 0x55af9d1a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.380+0000 7fb536d9d640 1 -- 172.21.15.87:0/2856784124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55af9d1970b0 msgr2=0x55af9d19e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:37.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.380+0000 7fb536d9d640 1 --2- 172.21.15.87:0/2856784124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55af9d1970b0 0x55af9d19e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.380+0000 7fb536d9d640 1 -- 172.21.15.87:0/2856784124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55af9d196790 msgr2=0x55af9d1a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:37.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.380+0000 7fb536d9d640 1 --2- 172.21.15.87:0/2856784124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55af9d196790 0x55af9d1a0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.380+0000 7fb536d9d640 1 -- 172.21.15.87:0/2856784124 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb530013620 con 0x55af9d1a1950 2024-09-13T17:16:37.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.381+0000 7fb536d9d640 1 --2- 172.21.15.87:0/2856784124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55af9d1a1950 0x55af9d19e920 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fb530005b10 tx=0x7fb530013120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd237920934059dd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:37.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.381+0000 7fb51dffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:16:37.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.381+0000 7fb51dffb640 1 -- 172.21.15.87:0/2856784124 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb530010630 con 0x55af9d1a1950 2024-09-13T17:16:37.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.381+0000 7fb51dffb640 1 -- 172.21.15.87:0/2856784124 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fb530010950 con 0x55af9d1a1950 2024-09-13T17:16:37.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.381+0000 7fb53f7d5740 1 -- 172.21.15.87:0/2856784124 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55af9d123b80 con 0x55af9d1a1950 2024-09-13T17:16:37.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.381+0000 7fb51dffb640 1 -- 172.21.15.87:0/2856784124 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb530010b10 con 0x55af9d1a1950 2024-09-13T17:16:37.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.381+0000 7fb53f7d5740 10 client.16473 fetch_fsmap learned FSMap version 30 2024-09-13T17:16:37.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.381+0000 7fb53f7d5740 1 -- 172.21.15.87:0/2856784124 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55af9d0f83c0 con 0x55af9d1a1950 2024-09-13T17:16:37.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.381+0000 7fb51dffb640 1 -- 172.21.15.87:0/2856784124 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55af9d123b80 con 0x55af9d1a1950 2024-09-13T17:16:37.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.381+0000 7fb51dffb640 1 -- 172.21.15.87:0/2856784124 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fb530028ab0 con 0x55af9d1a1950 2024-09-13T17:16:37.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.381+0000 7fb53f7d5740 10 client.16473 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:16:37.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.381+0000 7fb53f7d5740 10 client.16473 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:16:37.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.381+0000 7fb53f7d5740 20 client.16473 populate_metadata read hostname 'smithi087' 2024-09-13T17:16:37.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.381+0000 7fb53f7d5740 1 --2- 172.21.15.87:0/2856784124 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55af9d1b1390 0x55af9d1b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.381+0000 7fb53f7d5740 4 client.16473 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:16:37.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.381+0000 7fb53f7d5740 1 -- 172.21.15.87:0/2856784124 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55af9d0ec1f0 con 0x55af9d1b1390 2024-09-13T17:16:37.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.382+0000 7fb53659c640 1 --2- 172.21.15.87:0/2856784124 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55af9d1b1390 0x55af9d1b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.382+0000 7fb51dffb640 10 client.16473 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:16:37.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.382+0000 7fb53659c640 1 --2- 172.21.15.87:0/2856784124 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55af9d1b1390 0x55af9d1b37b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3b19c1e943ad49eb server_cookie=9db4edbc2bf69b4d in_seq=0 out_seq=0 2024-09-13T17:16:37.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.382+0000 7fb51dffb640 1 -- 172.21.15.87:0/2856784124 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55af9d0ec1f0 con 0x55af9d1b1390 2024-09-13T17:16:37.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.382+0000 7fb51dffb640 10 client.16473 handle_command_reply: tid=0 2024-09-13T17:16:37.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.383+0000 7fb53f7d5740 1 client.16473 shutdown 2024-09-13T17:16:37.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.383+0000 7fb53f7d5740 1 -- 172.21.15.87:0/2856784124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55af9d1a1950 msgr2=0x55af9d19e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.383+0000 7fb53f7d5740 1 --2- 172.21.15.87:0/2856784124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55af9d1a1950 0x55af9d19e920 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fb530005b10 tx=0x7fb530013120 comp rx=0 tx=0).stop 2024-09-13T17:16:37.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.383+0000 7fb53f7d5740 1 -- 172.21.15.87:0/2856784124 shutdown_connections 2024-09-13T17:16:37.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.383+0000 7fb53f7d5740 1 --2- 172.21.15.87:0/2856784124 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55af9d1b1390 0x55af9d1b37b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.383+0000 7fb53f7d5740 1 --2- 172.21.15.87:0/2856784124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55af9d1a1950 0x55af9d19e920 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.383+0000 7fb51dffb640 0 client.16473 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:16:37.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.383+0000 7fb53f7d5740 1 --2- 172.21.15.87:0/2856784124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55af9d1970b0 0x55af9d19e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.383+0000 7fb53f7d5740 1 --2- 172.21.15.87:0/2856784124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55af9d196790 0x55af9d1a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.383+0000 7fb53f7d5740 1 -- 172.21.15.87:0/2856784124 >> 172.21.15.87:0/2856784124 conn(0x55af9d192d00 msgr2=0x55af9d198a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:37.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.383+0000 7fb53f7d5740 1 -- 172.21.15.87:0/2856784124 shutdown_connections 2024-09-13T17:16:37.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.383+0000 7fb53f7d5740 1 -- 172.21.15.87:0/2856784124 wait complete. 2024-09-13T17:16:37.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.383+0000 7fb53f7d5740 20 client.16473 trim_cache size 0 max 16384 2024-09-13T17:16:37.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.394+0000 7fb53f7d5740 1 Processor -- start 2024-09-13T17:16:37.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.394+0000 7fb53f7d5740 1 -- start start 2024-09-13T17:16:37.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.395+0000 7fb53f7d5740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55af9d192d00 0x55af9d1ad100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.395+0000 7fb53f7d5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55af9d196790 0x55af9d1ad640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.395+0000 7fb53f7d5740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55af9d1970b0 0x55af9d19cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.395+0000 7fb53f7d5740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af9d1a4400 con 0x55af9d192d00 2024-09-13T17:16:37.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.395+0000 7fb53f7d5740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af9d19f340 con 0x55af9d1970b0 2024-09-13T17:16:37.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.395+0000 7fb53f7d5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af9d1a15d0 con 0x55af9d196790 2024-09-13T17:16:37.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.395+0000 7fb53659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55af9d192d00 0x55af9d1ad100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.395+0000 7fb53659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55af9d192d00 0x55af9d1ad100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39538/0 (socket says 172.21.15.87:39538) 2024-09-13T17:16:37.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.395+0000 7fb53659c640 1 -- 172.21.15.87:0/1934072169 learned_addr learned my addr 172.21.15.87:0/1934072169 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:37.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.395+0000 7fb535d9b640 1 --2- 172.21.15.87:0/1934072169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55af9d196790 0x55af9d1ad640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.395+0000 7fb536d9d640 1 --2- 172.21.15.87:0/1934072169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55af9d1970b0 0x55af9d19cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.395+0000 7fb53659c640 1 -- 172.21.15.87:0/1934072169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55af9d196790 msgr2=0x55af9d1ad640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:37.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.395+0000 7fb53659c640 1 --2- 172.21.15.87:0/1934072169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55af9d196790 0x55af9d1ad640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.395+0000 7fb53659c640 1 -- 172.21.15.87:0/1934072169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55af9d1970b0 msgr2=0x55af9d19cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:37.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.395+0000 7fb53659c640 1 --2- 172.21.15.87:0/1934072169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55af9d1970b0 0x55af9d19cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.395+0000 7fb53659c640 1 -- 172.21.15.87:0/1934072169 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55af9d09a770 con 0x55af9d192d00 2024-09-13T17:16:37.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.395+0000 7fb536d9d640 1 --2- 172.21.15.87:0/1934072169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55af9d1970b0 0x55af9d19cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:37.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.395+0000 7fb53659c640 1 --2- 172.21.15.87:0/1934072169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55af9d192d00 0x55af9d1ad100 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fb528005940 tx=0x7fb52808cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f143341fa11cf937 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:37.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.395+0000 7fb5257fa640 1 -- 172.21.15.87:0/1934072169 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5280be8a0 con 0x55af9d192d00 2024-09-13T17:16:37.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.395+0000 7fb5257fa640 1 -- 172.21.15.87:0/1934072169 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb5280c2ef0 con 0x55af9d192d00 2024-09-13T17:16:37.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.395+0000 7fb5257fa640 1 -- 172.21.15.87:0/1934072169 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5280b9f60 con 0x55af9d192d00 2024-09-13T17:16:37.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.396+0000 7fb53f7d5740 1 -- 172.21.15.87:0/1934072169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55af9d192d00 msgr2=0x55af9d1ad100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.396+0000 7fb53f7d5740 1 --2- 172.21.15.87:0/1934072169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55af9d192d00 0x55af9d1ad100 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fb528005940 tx=0x7fb52808cc70 comp rx=0 tx=0).stop 2024-09-13T17:16:37.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.396+0000 7fb53f7d5740 1 -- 172.21.15.87:0/1934072169 shutdown_connections 2024-09-13T17:16:37.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.396+0000 7fb53f7d5740 1 --2- 172.21.15.87:0/1934072169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55af9d1970b0 0x55af9d19cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.396+0000 7fb53f7d5740 1 --2- 172.21.15.87:0/1934072169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55af9d196790 0x55af9d1ad640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.396+0000 7fb53f7d5740 1 --2- 172.21.15.87:0/1934072169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55af9d192d00 0x55af9d1ad100 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.396+0000 7fb53f7d5740 1 -- 172.21.15.87:0/1934072169 >> 172.21.15.87:0/1934072169 conn(0x55af9d1a1150 msgr2=0x55af9d19e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:37.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.396+0000 7fb53f7d5740 1 -- 172.21.15.87:0/1934072169 shutdown_connections 2024-09-13T17:16:37.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.396+0000 7fb53f7d5740 1 -- 172.21.15.87:0/1934072169 wait complete. 2024-09-13T17:16:37.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.396+0000 7fb53f7d5740 1 -- start start 2024-09-13T17:16:37.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.396+0000 7fb53f7d5740 1 Processor -- start 2024-09-13T17:16:37.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.397+0000 7fb53f7d5740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55af9d192d00 0x55af9d1a8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.397+0000 7fb53f7d5740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55af9d196790 0x55af9d19ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.397+0000 7fb53f7d5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55af9d1970b0 0x55af9d19b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.397+0000 7fb53f7d5740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af9d19b6c0 con 0x55af9d192d00 2024-09-13T17:16:37.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.397+0000 7fb53f7d5740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af9d19b830 con 0x55af9d196790 2024-09-13T17:16:37.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.397+0000 7fb53f7d5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af9d19b9f0 con 0x55af9d1970b0 2024-09-13T17:16:37.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.397+0000 7fb53f7d5740 10 client.0 _ll_register_callbacks cb 0x7fb530009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:37.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.397+0000 7fb53659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55af9d192d00 0x55af9d1a8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.397+0000 7fb53659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55af9d192d00 0x55af9d1a8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39542/0 (socket says 172.21.15.87:39542) 2024-09-13T17:16:37.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.397+0000 7fb53659c640 1 -- 172.21.15.87:0/250084142 learned_addr learned my addr 172.21.15.87:0/250084142 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:37.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.397+0000 7fb536d9d640 1 --2- 172.21.15.87:0/250084142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55af9d1970b0 0x55af9d19b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.397+0000 7fb535d9b640 1 --2- 172.21.15.87:0/250084142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55af9d196790 0x55af9d19ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.397+0000 7fb53659c640 1 -- 172.21.15.87:0/250084142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55af9d1970b0 msgr2=0x55af9d19b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:37.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.397+0000 7fb53659c640 1 --2- 172.21.15.87:0/250084142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55af9d1970b0 0x55af9d19b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.397+0000 7fb53659c640 1 -- 172.21.15.87:0/250084142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55af9d196790 msgr2=0x55af9d19ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:37.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.397+0000 7fb53659c640 1 --2- 172.21.15.87:0/250084142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55af9d196790 0x55af9d19ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.397+0000 7fb53659c640 1 -- 172.21.15.87:0/250084142 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5381a53b0 con 0x55af9d192d00 2024-09-13T17:16:37.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.397+0000 7fb53659c640 1 --2- 172.21.15.87:0/250084142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55af9d192d00 0x55af9d1a8840 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fb528006010 tx=0x7fb5280babf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b099ddd0c8fed3c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:37.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.397+0000 7fb51dffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:16:37.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.397+0000 7fb51dffb640 1 -- 172.21.15.87:0/250084142 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52803f070 con 0x55af9d192d00 2024-09-13T17:16:37.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.397+0000 7fb51dffb640 1 -- 172.21.15.87:0/250084142 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fb5280be8a0 con 0x55af9d192d00 2024-09-13T17:16:37.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.397+0000 7fb53f7d5740 1 -- 172.21.15.87:0/250084142 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb53000fdc0 con 0x55af9d192d00 2024-09-13T17:16:37.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.398+0000 7fb51dffb640 1 -- 172.21.15.87:0/250084142 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5280eb210 con 0x55af9d192d00 2024-09-13T17:16:37.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.398+0000 7fb53f7d5740 10 client.16479 fetch_fsmap learned FSMap version 30 2024-09-13T17:16:37.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.398+0000 7fb53f7d5740 1 -- 172.21.15.87:0/250084142 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55af9d0bfe80 con 0x55af9d192d00 2024-09-13T17:16:37.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.398+0000 7fb51dffb640 1 -- 172.21.15.87:0/250084142 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb5280d8020 con 0x55af9d192d00 2024-09-13T17:16:37.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.398+0000 7fb51dffb640 1 -- 172.21.15.87:0/250084142 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fb5280b99d0 con 0x55af9d192d00 2024-09-13T17:16:37.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.398+0000 7fb53f7d5740 10 client.16479 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:16:37.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.398+0000 7fb53f7d5740 10 client.16479 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:16:37.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.398+0000 7fb53f7d5740 20 client.16479 populate_metadata read hostname 'smithi087' 2024-09-13T17:16:37.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.398+0000 7fb53f7d5740 1 --2- 172.21.15.87:0/250084142 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55af9d1a1950 0x55af9d20a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.398+0000 7fb53f7d5740 4 client.16479 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:16:37.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.398+0000 7fb53f7d5740 1 -- 172.21.15.87:0/250084142 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55af9cded4e0 con 0x55af9d1a1950 2024-09-13T17:16:37.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.398+0000 7fb535d9b640 1 --2- 172.21.15.87:0/250084142 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55af9d1a1950 0x55af9d20a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.398+0000 7fb51dffb640 10 client.16479 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:16:37.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.398+0000 7fb535d9b640 1 --2- 172.21.15.87:0/250084142 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55af9d1a1950 0x55af9d20a9d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=70180af2b48efcd2 server_cookie=298487b251bffd56 in_seq=0 out_seq=0 2024-09-13T17:16:37.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.399+0000 7fb51dffb640 1 -- 172.21.15.87:0/250084142 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55af9cded4e0 con 0x55af9d1a1950 2024-09-13T17:16:37.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.399+0000 7fb51dffb640 10 client.16479 handle_command_reply: tid=0 2024-09-13T17:16:37.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.399+0000 7fb53f7d5740 1 client.16479 shutdown 2024-09-13T17:16:37.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.399+0000 7fb53f7d5740 1 -- 172.21.15.87:0/250084142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55af9d192d00 msgr2=0x55af9d1a8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.399+0000 7fb53f7d5740 1 --2- 172.21.15.87:0/250084142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55af9d192d00 0x55af9d1a8840 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fb528006010 tx=0x7fb5280babf0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.399+0000 7fb53f7d5740 1 -- 172.21.15.87:0/250084142 shutdown_connections 2024-09-13T17:16:37.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.399+0000 7fb53f7d5740 1 --2- 172.21.15.87:0/250084142 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55af9d1a1950 0x55af9d20a9d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.399+0000 7fb53f7d5740 1 --2- 172.21.15.87:0/250084142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55af9d1970b0 0x55af9d19b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.399+0000 7fb53f7d5740 1 --2- 172.21.15.87:0/250084142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55af9d196790 0x55af9d19ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.399+0000 7fb51dffb640 0 client.16479 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:16:37.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.399+0000 7fb53f7d5740 1 --2- 172.21.15.87:0/250084142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55af9d192d00 0x55af9d1a8840 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.399+0000 7fb53f7d5740 1 -- 172.21.15.87:0/250084142 >> 172.21.15.87:0/250084142 conn(0x55af9d1a1150 msgr2=0x55af9d19e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:37.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.399+0000 7fb53f7d5740 1 -- 172.21.15.87:0/250084142 shutdown_connections 2024-09-13T17:16:37.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.399+0000 7fb53f7d5740 1 -- 172.21.15.87:0/250084142 wait complete. 2024-09-13T17:16:37.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.399+0000 7fb53f7d5740 20 client.16479 trim_cache size 0 max 16384 2024-09-13T17:16:37.407 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:16:37.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.399+0000 7fb53cab1640 1 -- 172.21.15.87:0/3189810607 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb5200a1280 msgr2=0x7fb5200a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.399+0000 7fb53cab1640 1 --2- 172.21.15.87:0/3189810607 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb5200a1280 0x7fb5200a3740 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb53001e000 tx=0x7fb530020000 comp rx=0 tx=0).stop 2024-09-13T17:16:37.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.399+0000 7fb53cab1640 1 -- 172.21.15.87:0/3189810607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5380fff50 msgr2=0x7fb5380727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.399+0000 7fb53cab1640 1 --2- 172.21.15.87:0/3189810607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5380fff50 0x7fb5380727b0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fb528009900 tx=0x7fb5280040c0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.399+0000 7fb53cab1640 1 -- 172.21.15.87:0/3189810607 shutdown_connections 2024-09-13T17:16:37.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.399+0000 7fb53cab1640 1 --2- 172.21.15.87:0/3189810607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb538073230 0x7fb5381a4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.399+0000 7fb53cab1640 1 --2- 172.21.15.87:0/3189810607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5381050a0 0x7fb538072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.399+0000 7fb53cab1640 1 --2- 172.21.15.87:0/3189810607 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb5200a1280 0x7fb5200a3740 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.399+0000 7fb53cab1640 1 --2- 172.21.15.87:0/3189810607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5380fff50 0x7fb5380727b0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.399+0000 7fb53cab1640 1 -- 172.21.15.87:0/3189810607 >> 172.21.15.87:0/3189810607 conn(0x7fb5380fb9e0 msgr2=0x7fb5380fcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:37.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.400+0000 7fb53cab1640 1 -- 172.21.15.87:0/3189810607 shutdown_connections 2024-09-13T17:16:37.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.400+0000 7fb53cab1640 1 -- 172.21.15.87:0/3189810607 wait complete. 2024-09-13T17:16:37.410 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:37 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3326381930' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:16:37.411 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-09-13T17:16:37.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.514+0000 7fc06ca2b640 1 -- 172.21.15.87:0/2571599447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0680fff70 msgr2=0x7fc068100350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.514+0000 7fc06ca2b640 1 --2- 172.21.15.87:0/2571599447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0680fff70 0x7fc068100350 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fc058009930 tx=0x7fc05802a420 comp rx=0 tx=0).stop 2024-09-13T17:16:37.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.514+0000 7fc06ca2b640 1 -- 172.21.15.87:0/2571599447 shutdown_connections 2024-09-13T17:16:37.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.514+0000 7fc06ca2b640 1 --2- 172.21.15.87:0/2571599447 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0681050c0 0x7fc06810cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.514+0000 7fc06ca2b640 1 --2- 172.21.15.87:0/2571599447 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc068100920 0x7fc068104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.514+0000 7fc06ca2b640 1 --2- 172.21.15.87:0/2571599447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0680fff70 0x7fc068100350 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.514+0000 7fc06ca2b640 1 -- 172.21.15.87:0/2571599447 >> 172.21.15.87:0/2571599447 conn(0x7fc0680fba20 msgr2=0x7fc0680fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:37.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.514+0000 7fc06ca2b640 1 -- 172.21.15.87:0/2571599447 shutdown_connections 2024-09-13T17:16:37.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.514+0000 7fc06ca2b640 1 -- 172.21.15.87:0/2571599447 wait complete. 2024-09-13T17:16:37.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.515+0000 7fc06ca2b640 1 Processor -- start 2024-09-13T17:16:37.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.515+0000 7fc06ca2b640 1 -- start start 2024-09-13T17:16:37.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.515+0000 7fc06ca2b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0680fff70 0x7fc0681963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.515+0000 7fc06ca2b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0681050c0 0x7fc068196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.515+0000 7fc06ca2b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc06819ad10 0x7fc06819b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.515+0000 7fc06ca2b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06819b700 con 0x7fc06819ad10 2024-09-13T17:16:37.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.515+0000 7fc06ca2b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06819b870 con 0x7fc0680fff70 2024-09-13T17:16:37.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.515+0000 7fc06ca2b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06819b9e0 con 0x7fc0681050c0 2024-09-13T17:16:37.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.515+0000 7fc066d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc06819ad10 0x7fc06819b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.515+0000 7fc066d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc06819ad10 0x7fc06819b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39564/0 (socket says 172.21.15.87:39564) 2024-09-13T17:16:37.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.515+0000 7fc066d9d640 1 -- 172.21.15.87:0/3092780848 learned_addr learned my addr 172.21.15.87:0/3092780848 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:37.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.515+0000 7fc065d9b640 1 --2- 172.21.15.87:0/3092780848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0681050c0 0x7fc068196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.515+0000 7fc06659c640 1 --2- 172.21.15.87:0/3092780848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0680fff70 0x7fc0681963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.515+0000 7fc066d9d640 1 -- 172.21.15.87:0/3092780848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0681050c0 msgr2=0x7fc068196920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.515+0000 7fc066d9d640 1 --2- 172.21.15.87:0/3092780848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0681050c0 0x7fc068196920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.515+0000 7fc066d9d640 1 -- 172.21.15.87:0/3092780848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0680fff70 msgr2=0x7fc0681963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.515+0000 7fc066d9d640 1 --2- 172.21.15.87:0/3092780848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0680fff70 0x7fc0681963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.515+0000 7fc066d9d640 1 -- 172.21.15.87:0/3092780848 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc058009560 con 0x7fc06819ad10 2024-09-13T17:16:37.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.516+0000 7fc066d9d640 1 --2- 172.21.15.87:0/3092780848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc06819ad10 0x7fc06819b1c0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc06000eb10 tx=0x7fc06000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:37.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.516+0000 7fc0577fe640 1 -- 172.21.15.87:0/3092780848 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc060004b20 con 0x7fc06819ad10 2024-09-13T17:16:37.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.516+0000 7fc0577fe640 1 -- 172.21.15.87:0/3092780848 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc060004c80 con 0x7fc06819ad10 2024-09-13T17:16:37.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.516+0000 7fc06ca2b640 1 -- 172.21.15.87:0/3092780848 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0681a2fc0 con 0x7fc06819ad10 2024-09-13T17:16:37.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.516+0000 7fc0577fe640 1 -- 172.21.15.87:0/3092780848 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc060010690 con 0x7fc06819ad10 2024-09-13T17:16:37.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.516+0000 7fc06ca2b640 1 -- 172.21.15.87:0/3092780848 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0681a33f0 con 0x7fc06819ad10 2024-09-13T17:16:37.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.518+0000 7fc0577fe640 1 -- 172.21.15.87:0/3092780848 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fc060005020 con 0x7fc06819ad10 2024-09-13T17:16:37.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.518+0000 7fc06f828740 1 Processor -- start 2024-09-13T17:16:37.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.519+0000 7fc06f828740 1 -- start start 2024-09-13T17:16:37.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.519+0000 7fc06f828740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653e04fa670 0x5653e04faa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.519+0000 7fc06f828740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653e04faf90 0x5653e0509820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.519+0000 7fc06f828740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653e0509d60 0x5653e050c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.519+0000 7fc06f828740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653e0464cc0 con 0x5653e0509d60 2024-09-13T17:16:37.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.519+0000 7fc06f828740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653e0462450 con 0x5653e04fa670 2024-09-13T17:16:37.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.519+0000 7fc06f828740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653e045dd40 con 0x5653e04faf90 2024-09-13T17:16:37.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.519+0000 7fc0577fe640 1 --2- 172.21.15.87:0/3092780848 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc0500a1200 0x7fc0500a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.519+0000 7fc065d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653e0509d60 0x5653e050c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.519+0000 7fc06659c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653e04faf90 0x5653e0509820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.519+0000 7fc065d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653e0509d60 0x5653e050c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39572/0 (socket says 172.21.15.87:39572) 2024-09-13T17:16:37.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.519+0000 7fc065d9b640 1 -- 172.21.15.87:0/624396398 learned_addr learned my addr 172.21.15.87:0/624396398 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:37.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.519+0000 7fc065d9b640 1 --2- 172.21.15.87:0/624396398 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653e04fa670 0x5653e04faa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.519+0000 7fc066d9d640 1 --2- 172.21.15.87:0/3092780848 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc0500a1200 0x7fc0500a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.520+0000 7fc0577fe640 1 -- 172.21.15.87:0/3092780848 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fc060014070 con 0x7fc06819ad10 2024-09-13T17:16:37.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.520+0000 7fc065d9b640 1 -- 172.21.15.87:0/624396398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653e04faf90 msgr2=0x5653e0509820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:37.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.520+0000 7fc065d9b640 1 --2- 172.21.15.87:0/624396398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653e04faf90 0x5653e0509820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.520+0000 7fc065d9b640 1 -- 172.21.15.87:0/624396398 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653e04fa670 msgr2=0x5653e04faa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:37.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.520+0000 7fc065d9b640 1 --2- 172.21.15.87:0/624396398 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653e04fa670 0x5653e04faa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.520+0000 7fc065d9b640 1 -- 172.21.15.87:0/624396398 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653e0425620 con 0x5653e0509d60 2024-09-13T17:16:37.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.520+0000 7fc065d9b640 1 --2- 172.21.15.87:0/624396398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653e0509d60 0x5653e050c150 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fc05c0117e0 tx=0x7fc05c005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc063a0629c77e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:37.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.520+0000 7fc066d9d640 1 --2- 172.21.15.87:0/3092780848 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc0500a1200 0x7fc0500a36c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc0600caf90 tx=0x7fc060085040 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:37.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.520+0000 7fc054ff9640 1 -- 172.21.15.87:0/624396398 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c004030 con 0x5653e0509d60 2024-09-13T17:16:37.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.520+0000 7fc054ff9640 1 -- 172.21.15.87:0/624396398 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc05c005020 con 0x5653e0509d60 2024-09-13T17:16:37.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.520+0000 7fc054ff9640 1 -- 172.21.15.87:0/624396398 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c004b20 con 0x5653e0509d60 2024-09-13T17:16:37.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.521+0000 7fc06f828740 1 -- 172.21.15.87:0/624396398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653e0509d60 msgr2=0x5653e050c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.521+0000 7fc06f828740 1 --2- 172.21.15.87:0/624396398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653e0509d60 0x5653e050c150 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fc05c0117e0 tx=0x7fc05c005850 comp rx=0 tx=0).stop 2024-09-13T17:16:37.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.521+0000 7fc06f828740 1 -- 172.21.15.87:0/624396398 shutdown_connections 2024-09-13T17:16:37.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.521+0000 7fc06f828740 1 --2- 172.21.15.87:0/624396398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653e0509d60 0x5653e050c150 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.521+0000 7fc06f828740 1 --2- 172.21.15.87:0/624396398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653e04faf90 0x5653e0509820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.521+0000 7fc06f828740 1 --2- 172.21.15.87:0/624396398 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653e04fa670 0x5653e04faa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.521+0000 7fc06f828740 1 -- 172.21.15.87:0/624396398 >> 172.21.15.87:0/624396398 conn(0x5653e04f6d00 msgr2=0x5653e04f70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:37.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.521+0000 7fc06f828740 1 -- 172.21.15.87:0/624396398 shutdown_connections 2024-09-13T17:16:37.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.521+0000 7fc06f828740 1 -- 172.21.15.87:0/624396398 wait complete. 2024-09-13T17:16:37.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.521+0000 7fc06f828740 1 -- start start 2024-09-13T17:16:37.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.521+0000 7fc06f828740 1 Processor -- start 2024-09-13T17:16:37.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.522+0000 7fc06f828740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653e04fa670 0x5653e0509440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.522+0000 7fc06f828740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653e04faf90 0x5653e0506710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.522+0000 7fc06f828740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653e0509d60 0x5653e0506c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.522+0000 7fc06f828740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653e041c180 con 0x5653e0509d60 2024-09-13T17:16:37.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.522+0000 7fc06f828740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653e0136430 con 0x5653e04faf90 2024-09-13T17:16:37.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.522+0000 7fc06f828740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653e03e15e0 con 0x5653e04fa670 2024-09-13T17:16:37.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.522+0000 7fc06f828740 10 client.0 _ll_register_callbacks cb 0x5653e044daa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:37.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.522+0000 7fc065d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653e0509d60 0x5653e0506c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.522+0000 7fc065d9b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653e04fa670 0x5653e0509440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.522+0000 7fc065d9b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653e04fa670 0x5653e0509440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:42000/0 (socket says 172.21.15.87:42000) 2024-09-13T17:16:37.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.522+0000 7fc065d9b640 1 -- 172.21.15.87:0/1470804960 learned_addr learned my addr 172.21.15.87:0/1470804960 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:37.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.522+0000 7fc06659c640 1 --2- 172.21.15.87:0/1470804960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653e04faf90 0x5653e0506710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.522+0000 7fc065d9b640 1 -- 172.21.15.87:0/1470804960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653e04faf90 msgr2=0x5653e0506710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:37.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.522+0000 7fc065d9b640 1 --2- 172.21.15.87:0/1470804960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653e04faf90 0x5653e0506710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.522+0000 7fc065d9b640 1 -- 172.21.15.87:0/1470804960 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653e0509d60 msgr2=0x5653e0506c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:37.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.522+0000 7fc065d9b640 1 --2- 172.21.15.87:0/1470804960 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653e0509d60 0x5653e0506c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.522+0000 7fc065d9b640 1 -- 172.21.15.87:0/1470804960 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc05c019040 con 0x5653e04fa670 2024-09-13T17:16:37.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.522+0000 7fc065d9b640 1 --2- 172.21.15.87:0/1470804960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653e04fa670 0x5653e0509440 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc05c001eb0 tx=0x7fc05c005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a067764a4f72c11d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:37.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.522+0000 7fc04dffb640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-09-13T17:16:37.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.523+0000 7fc04dffb640 1 -- 172.21.15.87:0/1470804960 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c004a70 con 0x5653e04fa670 2024-09-13T17:16:37.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.523+0000 7fc06f828740 1 -- 172.21.15.87:0/1470804960 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5653e0487b80 con 0x5653e04fa670 2024-09-13T17:16:37.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.523+0000 7fc04dffb640 1 -- 172.21.15.87:0/1470804960 <== mon.1 v2:172.21.15.149:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fc05c004bd0 con 0x5653e04fa670 2024-09-13T17:16:37.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.523+0000 7fc04dffb640 1 -- 172.21.15.87:0/1470804960 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc05c004d90 con 0x5653e04fa670 2024-09-13T17:16:37.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.523+0000 7fc06f828740 10 client.25882 fetch_fsmap learned FSMap version 30 2024-09-13T17:16:37.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.523+0000 7fc06f828740 1 -- 172.21.15.87:0/1470804960 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5653e045c3c0 con 0x5653e04fa670 2024-09-13T17:16:37.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.523+0000 7fc04dffb640 1 -- 172.21.15.87:0/1470804960 <== mon.1 v2:172.21.15.149:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x5653e0487b80 con 0x5653e04fa670 2024-09-13T17:16:37.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.523+0000 7fc04dffb640 1 -- 172.21.15.87:0/1470804960 <== mon.1 v2:172.21.15.149:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fc05c01d070 con 0x5653e04fa670 2024-09-13T17:16:37.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.523+0000 7fc06f828740 10 client.25882 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:16:37.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.523+0000 7fc06f828740 10 client.25882 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:16:37.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.523+0000 7fc06f828740 20 client.25882 populate_metadata read hostname 'smithi087' 2024-09-13T17:16:37.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.523+0000 7fc06f828740 1 --2- 172.21.15.87:0/1470804960 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5653e05196d0 0x5653e051baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.523+0000 7fc06f828740 4 client.25882 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:16:37.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.523+0000 7fc06f828740 1 -- 172.21.15.87:0/1470804960 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5653e04501f0 con 0x5653e05196d0 2024-09-13T17:16:37.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.523+0000 7fc06659c640 1 --2- 172.21.15.87:0/1470804960 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5653e05196d0 0x5653e051baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.524+0000 7fc04dffb640 10 client.25882 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:37.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.524+0000 7fc06659c640 1 --2- 172.21.15.87:0/1470804960 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5653e05196d0 0x5653e051baf0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b534c24ae0af51be server_cookie=1e5da865b43f4049 in_seq=0 out_seq=0 2024-09-13T17:16:37.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.525+0000 7fc04dffb640 1 -- 172.21.15.87:0/1470804960 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5653e04501f0 con 0x5653e05196d0 2024-09-13T17:16:37.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.525+0000 7fc04dffb640 10 client.25882 handle_command_reply: tid=0 2024-09-13T17:16:37.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.525+0000 7fc06f828740 1 client.25882 shutdown 2024-09-13T17:16:37.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.525+0000 7fc06f828740 1 -- 172.21.15.87:0/1470804960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653e04fa670 msgr2=0x5653e0509440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.525+0000 7fc06f828740 1 --2- 172.21.15.87:0/1470804960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653e04fa670 0x5653e0509440 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc05c001eb0 tx=0x7fc05c005f90 comp rx=0 tx=0).stop 2024-09-13T17:16:37.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.525+0000 7fc06f828740 1 -- 172.21.15.87:0/1470804960 shutdown_connections 2024-09-13T17:16:37.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.525+0000 7fc06f828740 1 --2- 172.21.15.87:0/1470804960 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5653e05196d0 0x5653e051baf0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.525+0000 7fc06f828740 1 --2- 172.21.15.87:0/1470804960 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653e0509d60 0x5653e0506c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.525+0000 7fc06f828740 1 --2- 172.21.15.87:0/1470804960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653e04faf90 0x5653e0506710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.525+0000 7fc04dffb640 0 client.25882 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:37.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.525+0000 7fc06f828740 1 --2- 172.21.15.87:0/1470804960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653e04fa670 0x5653e0509440 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.525+0000 7fc06f828740 1 -- 172.21.15.87:0/1470804960 >> 172.21.15.87:0/1470804960 conn(0x5653e04f6d00 msgr2=0x5653e04fca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:37.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.525+0000 7fc06f828740 1 -- 172.21.15.87:0/1470804960 shutdown_connections 2024-09-13T17:16:37.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.525+0000 7fc06f828740 1 -- 172.21.15.87:0/1470804960 wait complete. 2024-09-13T17:16:37.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.525+0000 7fc06f828740 20 client.25882 trim_cache size 0 max 16384 2024-09-13T17:16:37.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.539+0000 7fc06f828740 1 Processor -- start 2024-09-13T17:16:37.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.539+0000 7fc06f828740 1 -- start start 2024-09-13T17:16:37.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.539+0000 7fc06f828740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653e04fa670 0x5653e0508ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.539+0000 7fc06f828740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653e04faf90 0x5653e0509420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.539+0000 7fc06f828740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653e0509d60 0x5653e05017c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.539+0000 7fc06f828740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653e0516540 con 0x5653e0509d60 2024-09-13T17:16:37.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.539+0000 7fc06f828740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653e04fbc40 con 0x5653e04fa670 2024-09-13T17:16:37.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.539+0000 7fc06f828740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653e0518070 con 0x5653e04faf90 2024-09-13T17:16:37.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.539+0000 7fc065d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653e0509d60 0x5653e05017c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.539+0000 7fc06659c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653e04faf90 0x5653e0509420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.539+0000 7fc065d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653e0509d60 0x5653e05017c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39588/0 (socket says 172.21.15.87:39588) 2024-09-13T17:16:37.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.540+0000 7fc06659c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653e04faf90 0x5653e0509420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:42010/0 (socket says 172.21.15.87:42010) 2024-09-13T17:16:37.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.540+0000 7fc065d9b640 1 -- 172.21.15.87:0/329039650 learned_addr learned my addr 172.21.15.87:0/329039650 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:37.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.540+0000 7fc065d9b640 1 --2- 172.21.15.87:0/329039650 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653e04fa670 0x5653e0508ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.540+0000 7fc065d9b640 1 -- 172.21.15.87:0/329039650 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653e04faf90 msgr2=0x5653e0509420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:37.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.540+0000 7fc065d9b640 1 --2- 172.21.15.87:0/329039650 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653e04faf90 0x5653e0509420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.540+0000 7fc065d9b640 1 -- 172.21.15.87:0/329039650 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653e04fa670 msgr2=0x5653e0508ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:37.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.540+0000 7fc065d9b640 1 --2- 172.21.15.87:0/329039650 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653e04fa670 0x5653e0508ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.540+0000 7fc065d9b640 1 -- 172.21.15.87:0/329039650 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653e03fe770 con 0x5653e0509d60 2024-09-13T17:16:37.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.540+0000 7fc065d9b640 1 --2- 172.21.15.87:0/329039650 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653e0509d60 0x5653e05017c0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fc05c011540 tx=0x7fc05c021040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c8611d0d9e18583 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:37.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.540+0000 7fc0557fa640 1 -- 172.21.15.87:0/329039650 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c0097d0 con 0x5653e0509d60 2024-09-13T17:16:37.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.540+0000 7fc0557fa640 1 -- 172.21.15.87:0/329039650 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc05c00e3b0 con 0x5653e0509d60 2024-09-13T17:16:37.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.540+0000 7fc0557fa640 1 -- 172.21.15.87:0/329039650 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c004dd0 con 0x5653e0509d60 2024-09-13T17:16:37.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.541+0000 7fc06f828740 1 -- 172.21.15.87:0/329039650 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653e0509d60 msgr2=0x5653e05017c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.541+0000 7fc06f828740 1 --2- 172.21.15.87:0/329039650 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653e0509d60 0x5653e05017c0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fc05c011540 tx=0x7fc05c021040 comp rx=0 tx=0).stop 2024-09-13T17:16:37.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.541+0000 7fc06f828740 1 -- 172.21.15.87:0/329039650 shutdown_connections 2024-09-13T17:16:37.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.541+0000 7fc06f828740 1 --2- 172.21.15.87:0/329039650 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653e0509d60 0x5653e05017c0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.541+0000 7fc06f828740 1 --2- 172.21.15.87:0/329039650 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653e04faf90 0x5653e0509420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.541+0000 7fc06f828740 1 --2- 172.21.15.87:0/329039650 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653e04fa670 0x5653e0508ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.541+0000 7fc06f828740 1 -- 172.21.15.87:0/329039650 >> 172.21.15.87:0/329039650 conn(0x5653e04f6d00 msgr2=0x5653e05066d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:37.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.541+0000 7fc06f828740 1 -- 172.21.15.87:0/329039650 shutdown_connections 2024-09-13T17:16:37.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.541+0000 7fc06f828740 1 -- 172.21.15.87:0/329039650 wait complete. 2024-09-13T17:16:37.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.541+0000 7fc06f828740 1 -- start start 2024-09-13T17:16:37.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.541+0000 7fc06f828740 1 Processor -- start 2024-09-13T17:16:37.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.541+0000 7fc06f828740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653e04fa670 0x5653e050d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.541+0000 7fc06f828740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653e04faf90 0x5653e050d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.541+0000 7fc06f828740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653e0509d60 0x5653e0567b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.541+0000 7fc06f828740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653e0568100 con 0x5653e0509d60 2024-09-13T17:16:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.541+0000 7fc06f828740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653e0568270 con 0x5653e04faf90 2024-09-13T17:16:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.541+0000 7fc06f828740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653e0568430 con 0x5653e04fa670 2024-09-13T17:16:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.542+0000 7fc06f828740 10 client.0 _ll_register_callbacks cb 0x7fc05c009a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.542+0000 7fc065d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653e0509d60 0x5653e0567b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.542+0000 7fc065d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653e0509d60 0x5653e0567b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39600/0 (socket says 172.21.15.87:39600) 2024-09-13T17:16:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.542+0000 7fc065d9b640 1 -- 172.21.15.87:0/4241633161 learned_addr learned my addr 172.21.15.87:0/4241633161 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.542+0000 7fc065d9b640 1 --2- 172.21.15.87:0/4241633161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653e04fa670 0x5653e050d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.542+0000 7fc06659c640 1 --2- 172.21.15.87:0/4241633161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653e04faf90 0x5653e050d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.542+0000 7fc065d9b640 1 -- 172.21.15.87:0/4241633161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653e04fa670 msgr2=0x5653e050d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.542+0000 7fc065d9b640 1 --2- 172.21.15.87:0/4241633161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653e04fa670 0x5653e050d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.542+0000 7fc065d9b640 1 -- 172.21.15.87:0/4241633161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653e04faf90 msgr2=0x5653e050d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.542+0000 7fc065d9b640 1 --2- 172.21.15.87:0/4241633161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653e04faf90 0x5653e050d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.542+0000 7fc065d9b640 1 -- 172.21.15.87:0/4241633161 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5653e045c3c0 con 0x5653e0509d60 2024-09-13T17:16:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.542+0000 7fc06659c640 1 --2- 172.21.15.87:0/4241633161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653e04faf90 0x5653e050d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.542+0000 7fc065d9b640 1 --2- 172.21.15.87:0/4241633161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653e0509d60 0x5653e0567b40 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fc05c00e600 tx=0x7fc05c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0a226286869381d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.542+0000 7fc04dffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:16:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.542+0000 7fc04dffb640 1 -- 172.21.15.87:0/4241633161 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c009b40 con 0x5653e0509d60 2024-09-13T17:16:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.542+0000 7fc04dffb640 1 -- 172.21.15.87:0/4241633161 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fc05c000e40 con 0x5653e0509d60 2024-09-13T17:16:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.542+0000 7fc06f828740 1 -- 172.21.15.87:0/4241633161 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc05c005020 con 0x5653e0509d60 2024-09-13T17:16:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.542+0000 7fc04dffb640 1 -- 172.21.15.87:0/4241633161 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc05c00f790 con 0x5653e0509d60 2024-09-13T17:16:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.543+0000 7fc06f828740 10 client.16497 fetch_fsmap learned FSMap version 30 2024-09-13T17:16:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.543+0000 7fc06f828740 1 -- 172.21.15.87:0/4241633161 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5653e0423e80 con 0x5653e0509d60 2024-09-13T17:16:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.543+0000 7fc04dffb640 1 -- 172.21.15.87:0/4241633161 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc05c005020 con 0x5653e0509d60 2024-09-13T17:16:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.543+0000 7fc04dffb640 1 -- 172.21.15.87:0/4241633161 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fc05c01d040 con 0x5653e0509d60 2024-09-13T17:16:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.543+0000 7fc06f828740 10 client.16497 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:16:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.543+0000 7fc06f828740 10 client.16497 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:16:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.543+0000 7fc06f828740 20 client.16497 populate_metadata read hostname 'smithi087' 2024-09-13T17:16:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.543+0000 7fc06f828740 1 --2- 172.21.15.87:0/4241633161 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5653e05708a0 0x5653e0572c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.543+0000 7fc06f828740 4 client.16497 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:16:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.543+0000 7fc06f828740 1 -- 172.21.15.87:0/4241633161 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5653e01514e0 con 0x5653e05708a0 2024-09-13T17:16:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.543+0000 7fc06659c640 1 --2- 172.21.15.87:0/4241633161 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5653e05708a0 0x5653e0572c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.544+0000 7fc04dffb640 10 client.16497 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.544+0000 7fc06659c640 1 --2- 172.21.15.87:0/4241633161 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5653e05708a0 0x5653e0572c90 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1836526acbe0ee6b server_cookie=12bfee172250ec88 in_seq=0 out_seq=0 2024-09-13T17:16:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.544+0000 7fc04dffb640 1 -- 172.21.15.87:0/4241633161 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5653e01514e0 con 0x5653e05708a0 2024-09-13T17:16:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.544+0000 7fc04dffb640 10 client.16497 handle_command_reply: tid=0 2024-09-13T17:16:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.544+0000 7fc06f828740 1 client.16497 shutdown 2024-09-13T17:16:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.544+0000 7fc06f828740 1 -- 172.21.15.87:0/4241633161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653e0509d60 msgr2=0x5653e0567b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.544+0000 7fc06f828740 1 --2- 172.21.15.87:0/4241633161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653e0509d60 0x5653e0567b40 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fc05c00e600 tx=0x7fc05c005800 comp rx=0 tx=0).stop 2024-09-13T17:16:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.544+0000 7fc06f828740 1 -- 172.21.15.87:0/4241633161 shutdown_connections 2024-09-13T17:16:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.544+0000 7fc06f828740 1 --2- 172.21.15.87:0/4241633161 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5653e05708a0 0x5653e0572c90 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.544+0000 7fc06f828740 1 --2- 172.21.15.87:0/4241633161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653e0509d60 0x5653e0567b40 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.544+0000 7fc04dffb640 0 client.16497 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:37.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.544+0000 7fc06f828740 1 --2- 172.21.15.87:0/4241633161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653e04faf90 0x5653e050d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.544+0000 7fc06f828740 1 --2- 172.21.15.87:0/4241633161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653e04fa670 0x5653e050d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.544+0000 7fc06f828740 1 -- 172.21.15.87:0/4241633161 >> 172.21.15.87:0/4241633161 conn(0x5653e04f6d00 msgr2=0x5653e05017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:37.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.544+0000 7fc06f828740 1 -- 172.21.15.87:0/4241633161 shutdown_connections 2024-09-13T17:16:37.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.544+0000 7fc06f828740 1 -- 172.21.15.87:0/4241633161 wait complete. 2024-09-13T17:16:37.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.545+0000 7fc06f828740 20 client.16497 trim_cache size 0 max 16384 2024-09-13T17:16:37.551 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:16:37.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.545+0000 7fc06ca2b640 1 -- 172.21.15.87:0/3092780848 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc0500a1200 msgr2=0x7fc0500a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.545+0000 7fc06ca2b640 1 --2- 172.21.15.87:0/3092780848 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc0500a1200 0x7fc0500a36c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc0600caf90 tx=0x7fc060085040 comp rx=0 tx=0).stop 2024-09-13T17:16:37.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.545+0000 7fc06ca2b640 1 -- 172.21.15.87:0/3092780848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc06819ad10 msgr2=0x7fc06819b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:37.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.545+0000 7fc06ca2b640 1 --2- 172.21.15.87:0/3092780848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc06819ad10 0x7fc06819b1c0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc06000eb10 tx=0x7fc06000c2d0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.545+0000 7fc06ca2b640 1 -- 172.21.15.87:0/3092780848 shutdown_connections 2024-09-13T17:16:37.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.545+0000 7fc06ca2b640 1 --2- 172.21.15.87:0/3092780848 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc0500a1200 0x7fc0500a36c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.545+0000 7fc06ca2b640 1 --2- 172.21.15.87:0/3092780848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc06819ad10 0x7fc06819b1c0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.545+0000 7fc06ca2b640 1 --2- 172.21.15.87:0/3092780848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0681050c0 0x7fc068196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.545+0000 7fc06ca2b640 1 --2- 172.21.15.87:0/3092780848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0680fff70 0x7fc0681963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:37.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.545+0000 7fc06ca2b640 1 -- 172.21.15.87:0/3092780848 >> 172.21.15.87:0/3092780848 conn(0x7fc0680fba20 msgr2=0x7fc0680fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:37.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.545+0000 7fc06ca2b640 1 -- 172.21.15.87:0/3092780848 shutdown_connections 2024-09-13T17:16:37.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:37.545+0000 7fc06ca2b640 1 -- 172.21.15.87:0/3092780848 wait complete. 2024-09-13T17:16:37.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:37 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3326381930' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:16:37.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:37 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3326381930' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:16:38.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:38 smithi087 ceph-mon[30934]: pgmap v87: 129 pgs: 129 active+clean; 191 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 2.5 MiB/s wr, 473 op/s 2024-09-13T17:16:38.557 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-13T17:16:38.558 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-09-13T17:16:38.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:38 smithi149 ceph-mon[35496]: pgmap v87: 129 pgs: 129 active+clean; 191 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 2.5 MiB/s wr, 473 op/s 2024-09-13T17:16:38.612 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:38 smithi118 ceph-mon[34374]: pgmap v87: 129 pgs: 129 active+clean; 191 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 2.5 MiB/s wr, 473 op/s 2024-09-13T17:16:38.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.687+0000 7f0a54d0f640 1 -- 172.21.15.87:0/1943381928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a50100000 msgr2=0x7f0a501003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:38.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.687+0000 7f0a54d0f640 1 --2- 172.21.15.87:0/1943381928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a50100000 0x7f0a501003e0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f0a40009930 tx=0x7f0a4002a420 comp rx=0 tx=0).stop 2024-09-13T17:16:38.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.688+0000 7f0a54d0f640 1 -- 172.21.15.87:0/1943381928 shutdown_connections 2024-09-13T17:16:38.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.688+0000 7f0a54d0f640 1 --2- 172.21.15.87:0/1943381928 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a50105150 0x7f0a5010cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.688+0000 7f0a54d0f640 1 --2- 172.21.15.87:0/1943381928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a501009b0 0x7f0a501049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.688+0000 7f0a54d0f640 1 --2- 172.21.15.87:0/1943381928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a50100000 0x7f0a501003e0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.688+0000 7f0a54d0f640 1 -- 172.21.15.87:0/1943381928 >> 172.21.15.87:0/1943381928 conn(0x7f0a500fbab0 msgr2=0x7f0a500fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:38.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.688+0000 7f0a54d0f640 1 -- 172.21.15.87:0/1943381928 shutdown_connections 2024-09-13T17:16:38.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.688+0000 7f0a54d0f640 1 -- 172.21.15.87:0/1943381928 wait complete. 2024-09-13T17:16:38.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.689+0000 7f0a54d0f640 1 Processor -- start 2024-09-13T17:16:38.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.689+0000 7f0a54d0f640 1 -- start start 2024-09-13T17:16:38.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.689+0000 7f0a54d0f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a50100000 0x7f0a501963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.689+0000 7f0a54d0f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a50105150 0x7f0a501968f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.689+0000 7f0a54d0f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a5019ace0 0x7f0a5019b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.689+0000 7f0a54d0f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5019b6d0 con 0x7f0a50100000 2024-09-13T17:16:38.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.689+0000 7f0a54d0f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5019b840 con 0x7f0a5019ace0 2024-09-13T17:16:38.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.689+0000 7f0a54d0f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5019b9b0 con 0x7f0a50105150 2024-09-13T17:16:38.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.689+0000 7f0a4dd9b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a50105150 0x7f0a501968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.689+0000 7f0a4e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a50100000 0x7f0a501963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.689+0000 7f0a4dd9b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a50105150 0x7f0a501968f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:42020/0 (socket says 172.21.15.87:42020) 2024-09-13T17:16:38.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.689+0000 7f0a4dd9b640 1 -- 172.21.15.87:0/688940528 learned_addr learned my addr 172.21.15.87:0/688940528 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:38.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.689+0000 7f0a4ed9d640 1 --2- 172.21.15.87:0/688940528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a5019ace0 0x7f0a5019b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.690+0000 7f0a4dd9b640 1 -- 172.21.15.87:0/688940528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a5019ace0 msgr2=0x7f0a5019b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:38.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.690+0000 7f0a4dd9b640 1 --2- 172.21.15.87:0/688940528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a5019ace0 0x7f0a5019b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.690+0000 7f0a4dd9b640 1 -- 172.21.15.87:0/688940528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a50100000 msgr2=0x7f0a501963b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:38.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.690+0000 7f0a4dd9b640 1 --2- 172.21.15.87:0/688940528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a50100000 0x7f0a501963b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.690+0000 7f0a4dd9b640 1 -- 172.21.15.87:0/688940528 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a40009560 con 0x7f0a50105150 2024-09-13T17:16:38.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.690+0000 7f0a4ed9d640 1 --2- 172.21.15.87:0/688940528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a5019ace0 0x7f0a5019b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:38.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.690+0000 7f0a4dd9b640 1 --2- 172.21.15.87:0/688940528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a50105150 0x7f0a501968f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0a4400e9c0 tx=0x7f0a4400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:38.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.690+0000 7f0a3f7fe640 1 -- 172.21.15.87:0/688940528 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a44009700 con 0x7f0a50105150 2024-09-13T17:16:38.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.690+0000 7f0a3f7fe640 1 -- 172.21.15.87:0/688940528 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0a4400cd80 con 0x7f0a50105150 2024-09-13T17:16:38.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.690+0000 7f0a3f7fe640 1 -- 172.21.15.87:0/688940528 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a44010430 con 0x7f0a50105150 2024-09-13T17:16:38.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.690+0000 7f0a54d0f640 1 -- 172.21.15.87:0/688940528 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a501a2f90 con 0x7f0a50105150 2024-09-13T17:16:38.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.691+0000 7f0a54d0f640 1 -- 172.21.15.87:0/688940528 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a501a3300 con 0x7f0a50105150 2024-09-13T17:16:38.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.693+0000 7f0a3f7fe640 1 -- 172.21.15.87:0/688940528 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f0a44005020 con 0x7f0a50105150 2024-09-13T17:16:38.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.694+0000 7f0a3f7fe640 1 --2- 172.21.15.87:0/688940528 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0a380a1280 0x7f0a380a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.694+0000 7f0a57a2e740 1 Processor -- start 2024-09-13T17:16:38.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.694+0000 7f0a3f7fe640 1 -- 172.21.15.87:0/688940528 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f0a44014070 con 0x7f0a50105150 2024-09-13T17:16:38.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.694+0000 7f0a4e59c640 1 --2- 172.21.15.87:0/688940528 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0a380a1280 0x7f0a380a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.694+0000 7f0a57a2e740 1 -- start start 2024-09-13T17:16:38.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.694+0000 7f0a57a2e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617a546a680 0x5617a546aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.694+0000 7f0a57a2e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617a546afa0 0x5617a5479850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.694+0000 7f0a57a2e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5617a5479d90 0x5617a547c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.694+0000 7f0a57a2e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617a53d5c60 con 0x5617a546afa0 2024-09-13T17:16:38.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.694+0000 7f0a57a2e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617a53d33f0 con 0x5617a546a680 2024-09-13T17:16:38.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.694+0000 7f0a57a2e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617a53cece0 con 0x5617a5479d90 2024-09-13T17:16:38.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.694+0000 7f0a4dd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617a546afa0 0x5617a5479850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.694+0000 7f0a4dd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617a546afa0 0x5617a5479850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39632/0 (socket says 172.21.15.87:39632) 2024-09-13T17:16:38.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.694+0000 7f0a4dd9b640 1 -- 172.21.15.87:0/662565097 learned_addr learned my addr 172.21.15.87:0/662565097 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:38.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.695+0000 7f0a4e59c640 1 --2- 172.21.15.87:0/688940528 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0a380a1280 0x7f0a380a3740 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0a40005ab0 tx=0x7f0a40005a20 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:38.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.695+0000 7f0a4e59c640 1 --2- 172.21.15.87:0/662565097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617a546a680 0x5617a546aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.695+0000 7f0a4dd9b640 1 -- 172.21.15.87:0/662565097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5617a5479d90 msgr2=0x5617a547c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:38.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.695+0000 7f0a4ed9d640 1 --2- 172.21.15.87:0/662565097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5617a5479d90 0x5617a547c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.695+0000 7f0a4dd9b640 1 --2- 172.21.15.87:0/662565097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5617a5479d90 0x5617a547c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.695+0000 7f0a4dd9b640 1 -- 172.21.15.87:0/662565097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617a546a680 msgr2=0x5617a546aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:38.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.695+0000 7f0a4dd9b640 1 --2- 172.21.15.87:0/662565097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617a546a680 0x5617a546aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.695+0000 7f0a4dd9b640 1 -- 172.21.15.87:0/662565097 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5617a538a970 con 0x5617a546afa0 2024-09-13T17:16:38.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.695+0000 7f0a4ed9d640 1 --2- 172.21.15.87:0/662565097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5617a5479d90 0x5617a547c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:38.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.695+0000 7f0a4dd9b640 1 --2- 172.21.15.87:0/662565097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617a546afa0 0x5617a5479850 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f0a4409a200 tx=0x7f0a440966e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c11f17ccbc530c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:38.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.695+0000 7f0a3cff9640 1 -- 172.21.15.87:0/662565097 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4409a270 con 0x5617a546afa0 2024-09-13T17:16:38.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.695+0000 7f0a3cff9640 1 -- 172.21.15.87:0/662565097 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0a440af070 con 0x5617a546afa0 2024-09-13T17:16:38.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.695+0000 7f0a3cff9640 1 -- 172.21.15.87:0/662565097 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a44096980 con 0x5617a546afa0 2024-09-13T17:16:38.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.696+0000 7f0a57a2e740 1 -- 172.21.15.87:0/662565097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617a546afa0 msgr2=0x5617a5479850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:38.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.696+0000 7f0a57a2e740 1 --2- 172.21.15.87:0/662565097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617a546afa0 0x5617a5479850 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f0a4409a200 tx=0x7f0a440966e0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.696+0000 7f0a57a2e740 1 -- 172.21.15.87:0/662565097 shutdown_connections 2024-09-13T17:16:38.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.696+0000 7f0a57a2e740 1 --2- 172.21.15.87:0/662565097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5617a5479d90 0x5617a547c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.696+0000 7f0a57a2e740 1 --2- 172.21.15.87:0/662565097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617a546afa0 0x5617a5479850 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.696+0000 7f0a57a2e740 1 --2- 172.21.15.87:0/662565097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617a546a680 0x5617a546aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.696+0000 7f0a57a2e740 1 -- 172.21.15.87:0/662565097 >> 172.21.15.87:0/662565097 conn(0x5617a5466d50 msgr2=0x5617a5467130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:38.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.696+0000 7f0a57a2e740 1 -- 172.21.15.87:0/662565097 shutdown_connections 2024-09-13T17:16:38.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.696+0000 7f0a57a2e740 1 -- 172.21.15.87:0/662565097 wait complete. 2024-09-13T17:16:38.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.696+0000 7f0a57a2e740 1 -- start start 2024-09-13T17:16:38.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.696+0000 7f0a57a2e740 1 Processor -- start 2024-09-13T17:16:38.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.697+0000 7f0a57a2e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617a546a680 0x5617a5476b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.697+0000 7f0a57a2e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5617a546afa0 0x5617a54770a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.697+0000 7f0a57a2e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617a5479d90 0x5617a54775e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.697+0000 7f0a57a2e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617a538cf80 con 0x5617a546a680 2024-09-13T17:16:38.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.697+0000 7f0a57a2e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617a538cc20 con 0x5617a5479d90 2024-09-13T17:16:38.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.697+0000 7f0a4e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617a546a680 0x5617a5476b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.697+0000 7f0a57a2e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617a5359ab0 con 0x5617a546afa0 2024-09-13T17:16:38.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.697+0000 7f0a4e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617a546a680 0x5617a5476b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39648/0 (socket says 172.21.15.87:39648) 2024-09-13T17:16:38.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.697+0000 7f0a4e59c640 1 -- 172.21.15.87:0/557891802 learned_addr learned my addr 172.21.15.87:0/557891802 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:38.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.697+0000 7f0a4dd9b640 1 --2- 172.21.15.87:0/557891802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5617a546afa0 0x5617a54770a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.697+0000 7f0a4ed9d640 1 --2- 172.21.15.87:0/557891802 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617a5479d90 0x5617a54775e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.697+0000 7f0a57a2e740 10 client.0 _ll_register_callbacks cb 0x5617a53c8350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:38.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.697+0000 7f0a4e59c640 1 -- 172.21.15.87:0/557891802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5617a546afa0 msgr2=0x5617a54770a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:38.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.697+0000 7f0a4e59c640 1 --2- 172.21.15.87:0/557891802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5617a546afa0 0x5617a54770a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.697+0000 7f0a4e59c640 1 -- 172.21.15.87:0/557891802 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617a5479d90 msgr2=0x5617a54775e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:38.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.697+0000 7f0a4e59c640 1 --2- 172.21.15.87:0/557891802 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617a5479d90 0x5617a54775e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.697+0000 7f0a4e59c640 1 -- 172.21.15.87:0/557891802 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a501a3300 con 0x5617a546a680 2024-09-13T17:16:38.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.697+0000 7f0a4e59c640 1 --2- 172.21.15.87:0/557891802 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617a546a680 0x5617a5476b60 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f0a400057c0 tx=0x7f0a4002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c35077f022a5d435 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:38.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.697+0000 7f0a35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:16:38.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.698+0000 7f0a35ffb640 1 -- 172.21.15.87:0/557891802 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a40003cc0 con 0x5617a546a680 2024-09-13T17:16:38.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.698+0000 7f0a35ffb640 1 -- 172.21.15.87:0/557891802 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f0a40042070 con 0x5617a546a680 2024-09-13T17:16:38.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.698+0000 7f0a57a2e740 1 -- 172.21.15.87:0/557891802 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5617a50c2590 con 0x5617a546a680 2024-09-13T17:16:38.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.698+0000 7f0a35ffb640 1 -- 172.21.15.87:0/557891802 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a40003e20 con 0x5617a546a680 2024-09-13T17:16:38.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.698+0000 7f0a57a2e740 10 client.16509 fetch_fsmap learned FSMap version 30 2024-09-13T17:16:38.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.698+0000 7f0a57a2e740 1 -- 172.21.15.87:0/557891802 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5617a53cd360 con 0x5617a546a680 2024-09-13T17:16:38.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.698+0000 7f0a35ffb640 1 -- 172.21.15.87:0/557891802 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x5617a50c2590 con 0x5617a546a680 2024-09-13T17:16:38.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.699+0000 7f0a35ffb640 1 -- 172.21.15.87:0/557891802 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f0a4003c440 con 0x5617a546a680 2024-09-13T17:16:38.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.699+0000 7f0a57a2e740 10 client.16509 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:16:38.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.699+0000 7f0a57a2e740 10 client.16509 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:16:38.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.699+0000 7f0a57a2e740 20 client.16509 populate_metadata read hostname 'smithi087' 2024-09-13T17:16:38.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.699+0000 7f0a57a2e740 1 --2- 172.21.15.87:0/557891802 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5617a5489c20 0x5617a548c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.699+0000 7f0a57a2e740 4 client.16509 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:16:38.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.699+0000 7f0a57a2e740 1 -- 172.21.15.87:0/557891802 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5617a50d3860 con 0x5617a5489c20 2024-09-13T17:16:38.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.699+0000 7f0a4dd9b640 1 --2- 172.21.15.87:0/557891802 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5617a5489c20 0x5617a548c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.700+0000 7f0a4dd9b640 1 --2- 172.21.15.87:0/557891802 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5617a5489c20 0x5617a548c040 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9830f4868b49ea08 server_cookie=a99ff62fe33a750f in_seq=0 out_seq=0 2024-09-13T17:16:38.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.700+0000 7f0a35ffb640 10 client.16509 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:38.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.700+0000 7f0a35ffb640 1 -- 172.21.15.87:0/557891802 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5617a50d3860 con 0x5617a5489c20 2024-09-13T17:16:38.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.700+0000 7f0a35ffb640 10 client.16509 handle_command_reply: tid=0 2024-09-13T17:16:38.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.700+0000 7f0a57a2e740 1 client.16509 shutdown 2024-09-13T17:16:38.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.700+0000 7f0a57a2e740 1 -- 172.21.15.87:0/557891802 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617a546a680 msgr2=0x5617a5476b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:38.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.700+0000 7f0a57a2e740 1 --2- 172.21.15.87:0/557891802 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617a546a680 0x5617a5476b60 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f0a400057c0 tx=0x7f0a4002a420 comp rx=0 tx=0).stop 2024-09-13T17:16:38.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.701+0000 7f0a57a2e740 1 -- 172.21.15.87:0/557891802 shutdown_connections 2024-09-13T17:16:38.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.701+0000 7f0a57a2e740 1 --2- 172.21.15.87:0/557891802 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5617a5489c20 0x5617a548c040 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.701+0000 7f0a57a2e740 1 --2- 172.21.15.87:0/557891802 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617a5479d90 0x5617a54775e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.701+0000 7f0a35ffb640 0 client.16509 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:38.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.701+0000 7f0a57a2e740 1 --2- 172.21.15.87:0/557891802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5617a546afa0 0x5617a54770a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.701+0000 7f0a57a2e740 1 --2- 172.21.15.87:0/557891802 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617a546a680 0x5617a5476b60 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.701+0000 7f0a57a2e740 1 -- 172.21.15.87:0/557891802 >> 172.21.15.87:0/557891802 conn(0x5617a5466d50 msgr2=0x5617a5466160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:38.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.701+0000 7f0a57a2e740 1 -- 172.21.15.87:0/557891802 shutdown_connections 2024-09-13T17:16:38.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.701+0000 7f0a57a2e740 1 -- 172.21.15.87:0/557891802 wait complete. 2024-09-13T17:16:38.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.701+0000 7f0a57a2e740 20 client.16509 trim_cache size 0 max 16384 2024-09-13T17:16:38.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.715+0000 7f0a57a2e740 1 Processor -- start 2024-09-13T17:16:38.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.715+0000 7f0a57a2e740 1 -- start start 2024-09-13T17:16:38.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.715+0000 7f0a57a2e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5617a546a680 0x5617a5477410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.715+0000 7f0a57a2e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617a546afa0 0x5617a5480a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.715+0000 7f0a57a2e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617a5479d90 0x5617a5480fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.715+0000 7f0a57a2e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617a5467cb0 con 0x5617a5479d90 2024-09-13T17:16:38.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.715+0000 7f0a57a2e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617a5458ef0 con 0x5617a546afa0 2024-09-13T17:16:38.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.715+0000 7f0a57a2e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617a5475090 con 0x5617a546a680 2024-09-13T17:16:38.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.715+0000 7f0a4ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617a5479d90 0x5617a5480fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.715+0000 7f0a4ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617a5479d90 0x5617a5480fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39656/0 (socket says 172.21.15.87:39656) 2024-09-13T17:16:38.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.715+0000 7f0a4ed9d640 1 -- 172.21.15.87:0/3862817426 learned_addr learned my addr 172.21.15.87:0/3862817426 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:38.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.716+0000 7f0a4e59c640 1 --2- 172.21.15.87:0/3862817426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5617a546a680 0x5617a5477410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.716+0000 7f0a4ed9d640 1 -- 172.21.15.87:0/3862817426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5617a546a680 msgr2=0x5617a5477410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:38.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.716+0000 7f0a4ed9d640 1 --2- 172.21.15.87:0/3862817426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5617a546a680 0x5617a5477410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.716+0000 7f0a4ed9d640 1 -- 172.21.15.87:0/3862817426 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617a546afa0 msgr2=0x5617a5480a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:38.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.716+0000 7f0a4ed9d640 1 --2- 172.21.15.87:0/3862817426 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617a546afa0 0x5617a5480a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.716+0000 7f0a4ed9d640 1 -- 172.21.15.87:0/3862817426 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5617a536f1c0 con 0x5617a5479d90 2024-09-13T17:16:38.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.716+0000 7f0a4ed9d640 1 --2- 172.21.15.87:0/3862817426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617a5479d90 0x5617a5480fb0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f0a48012420 tx=0x7f0a480128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd24633e4b6ae49 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:38.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.716+0000 7f0a3d7fa640 1 -- 172.21.15.87:0/3862817426 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a48017070 con 0x5617a5479d90 2024-09-13T17:16:38.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.716+0000 7f0a3d7fa640 1 -- 172.21.15.87:0/3862817426 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0a48011950 con 0x5617a5479d90 2024-09-13T17:16:38.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.716+0000 7f0a3d7fa640 1 -- 172.21.15.87:0/3862817426 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4800fab0 con 0x5617a5479d90 2024-09-13T17:16:38.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.717+0000 7f0a57a2e740 1 -- 172.21.15.87:0/3862817426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617a5479d90 msgr2=0x5617a5480fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:38.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.717+0000 7f0a57a2e740 1 --2- 172.21.15.87:0/3862817426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617a5479d90 0x5617a5480fb0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f0a48012420 tx=0x7f0a480128e0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.717+0000 7f0a57a2e740 1 -- 172.21.15.87:0/3862817426 shutdown_connections 2024-09-13T17:16:38.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.717+0000 7f0a57a2e740 1 --2- 172.21.15.87:0/3862817426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617a5479d90 0x5617a5480fb0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.717+0000 7f0a57a2e740 1 --2- 172.21.15.87:0/3862817426 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617a546afa0 0x5617a5480a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.717+0000 7f0a57a2e740 1 --2- 172.21.15.87:0/3862817426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5617a546a680 0x5617a5477410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.717+0000 7f0a57a2e740 1 -- 172.21.15.87:0/3862817426 >> 172.21.15.87:0/3862817426 conn(0x5617a5466d50 msgr2=0x5617a5475c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:38.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.717+0000 7f0a57a2e740 1 -- 172.21.15.87:0/3862817426 shutdown_connections 2024-09-13T17:16:38.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.717+0000 7f0a57a2e740 1 -- 172.21.15.87:0/3862817426 wait complete. 2024-09-13T17:16:38.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.717+0000 7f0a57a2e740 1 -- start start 2024-09-13T17:16:38.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.717+0000 7f0a57a2e740 1 Processor -- start 2024-09-13T17:16:38.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.717+0000 7f0a57a2e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617a546a680 0x5617a5480b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.717+0000 7f0a57a2e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617a546afa0 0x5617a547df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.717+0000 7f0a57a2e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5617a5479d90 0x5617a547e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.717+0000 7f0a57a2e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617a547e9c0 con 0x5617a546a680 2024-09-13T17:16:38.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.717+0000 7f0a57a2e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617a547eb30 con 0x5617a546afa0 2024-09-13T17:16:38.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.717+0000 7f0a57a2e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617a547ecf0 con 0x5617a5479d90 2024-09-13T17:16:38.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.717+0000 7f0a4e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617a546a680 0x5617a5480b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.718+0000 7f0a4e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617a546a680 0x5617a5480b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39672/0 (socket says 172.21.15.87:39672) 2024-09-13T17:16:38.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.718+0000 7f0a4e59c640 1 -- 172.21.15.87:0/900309099 learned_addr learned my addr 172.21.15.87:0/900309099 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:38.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.718+0000 7f0a57a2e740 10 client.0 _ll_register_callbacks cb 0x7f0a400314e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:38.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.718+0000 7f0a4dd9b640 1 --2- 172.21.15.87:0/900309099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617a546afa0 0x5617a547df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.718+0000 7f0a4ed9d640 1 --2- 172.21.15.87:0/900309099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5617a5479d90 0x5617a547e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.718+0000 7f0a4e59c640 1 -- 172.21.15.87:0/900309099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5617a5479d90 msgr2=0x5617a547e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:38.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.718+0000 7f0a4e59c640 1 --2- 172.21.15.87:0/900309099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5617a5479d90 0x5617a547e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.718+0000 7f0a4e59c640 1 -- 172.21.15.87:0/900309099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617a546afa0 msgr2=0x5617a547df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:38.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.718+0000 7f0a4e59c640 1 --2- 172.21.15.87:0/900309099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617a546afa0 0x5617a547df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.718+0000 7f0a4e59c640 1 -- 172.21.15.87:0/900309099 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a48009ce0 con 0x5617a546a680 2024-09-13T17:16:38.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.718+0000 7f0a4dd9b640 1 --2- 172.21.15.87:0/900309099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617a546afa0 0x5617a547df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:16:38.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.718+0000 7f0a4e59c640 1 --2- 172.21.15.87:0/900309099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617a546a680 0x5617a5480b60 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f0a4002a940 tx=0x7f0a40004590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0be7c1370904890 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:38.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.718+0000 7f0a35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:16:38.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.718+0000 7f0a35ffb640 1 -- 172.21.15.87:0/900309099 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4003ce20 con 0x5617a546a680 2024-09-13T17:16:38.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.718+0000 7f0a35ffb640 1 -- 172.21.15.87:0/900309099 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f0a40042040 con 0x5617a546a680 2024-09-13T17:16:38.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.718+0000 7f0a57a2e740 1 -- 172.21.15.87:0/900309099 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0a440af070 con 0x5617a546a680 2024-09-13T17:16:38.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.718+0000 7f0a35ffb640 1 -- 172.21.15.87:0/900309099 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a40031ca0 con 0x5617a546a680 2024-09-13T17:16:38.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.718+0000 7f0a57a2e740 10 client.16515 fetch_fsmap learned FSMap version 30 2024-09-13T17:16:38.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.718+0000 7f0a57a2e740 1 -- 172.21.15.87:0/900309099 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5617a5394990 con 0x5617a546a680 2024-09-13T17:16:38.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.718+0000 7f0a35ffb640 1 -- 172.21.15.87:0/900309099 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0a440af070 con 0x5617a546a680 2024-09-13T17:16:38.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.719+0000 7f0a35ffb640 1 -- 172.21.15.87:0/900309099 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f0a4003e530 con 0x5617a546a680 2024-09-13T17:16:38.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.719+0000 7f0a57a2e740 10 client.16515 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:16:38.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.719+0000 7f0a57a2e740 10 client.16515 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:16:38.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.719+0000 7f0a57a2e740 20 client.16515 populate_metadata read hostname 'smithi087' 2024-09-13T17:16:38.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.719+0000 7f0a57a2e740 1 --2- 172.21.15.87:0/900309099 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5617a5489c20 0x5617a54e4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.719+0000 7f0a57a2e740 4 client.16515 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-13T17:16:38.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.719+0000 7f0a57a2e740 1 -- 172.21.15.87:0/900309099 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5617a5126eb0 con 0x5617a5489c20 2024-09-13T17:16:38.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.719+0000 7f0a4dd9b640 1 --2- 172.21.15.87:0/900309099 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5617a5489c20 0x5617a54e4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.719+0000 7f0a4dd9b640 1 --2- 172.21.15.87:0/900309099 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5617a5489c20 0x5617a54e4420 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf29f2e5596f0bd4 server_cookie=415a027a734a6ee5 in_seq=0 out_seq=0 2024-09-13T17:16:38.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.719+0000 7f0a35ffb640 10 client.16515 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:38.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.720+0000 7f0a35ffb640 1 -- 172.21.15.87:0/900309099 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5617a5126eb0 con 0x5617a5489c20 2024-09-13T17:16:38.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.720+0000 7f0a35ffb640 10 client.16515 handle_command_reply: tid=0 2024-09-13T17:16:38.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.720+0000 7f0a57a2e740 1 client.16515 shutdown 2024-09-13T17:16:38.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.720+0000 7f0a57a2e740 1 -- 172.21.15.87:0/900309099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617a546a680 msgr2=0x5617a5480b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:38.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.720+0000 7f0a57a2e740 1 --2- 172.21.15.87:0/900309099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617a546a680 0x5617a5480b60 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f0a4002a940 tx=0x7f0a40004590 comp rx=0 tx=0).stop 2024-09-13T17:16:38.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.720+0000 7f0a57a2e740 1 -- 172.21.15.87:0/900309099 shutdown_connections 2024-09-13T17:16:38.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.720+0000 7f0a57a2e740 1 --2- 172.21.15.87:0/900309099 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5617a5489c20 0x5617a54e4420 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.720+0000 7f0a57a2e740 1 --2- 172.21.15.87:0/900309099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5617a5479d90 0x5617a547e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.720+0000 7f0a35ffb640 0 client.16515 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:38.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.720+0000 7f0a57a2e740 1 --2- 172.21.15.87:0/900309099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617a546afa0 0x5617a547df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.720+0000 7f0a57a2e740 1 --2- 172.21.15.87:0/900309099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5617a546a680 0x5617a5480b60 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.720+0000 7f0a57a2e740 1 -- 172.21.15.87:0/900309099 >> 172.21.15.87:0/900309099 conn(0x5617a5466d50 msgr2=0x5617a546c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:38.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.720+0000 7f0a57a2e740 1 -- 172.21.15.87:0/900309099 shutdown_connections 2024-09-13T17:16:38.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.720+0000 7f0a57a2e740 1 -- 172.21.15.87:0/900309099 wait complete. 2024-09-13T17:16:38.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.720+0000 7f0a57a2e740 20 client.16515 trim_cache size 0 max 16384 2024-09-13T17:16:38.729 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:16:38.730 INFO:teuthology.orchestra.run.smithi087.stdout: "return_code": 0, 2024-09-13T17:16:38.730 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_tag": "fd746e66-9e7f-4091-ad33-e9a0fc8905c7", 2024-09-13T17:16:38.730 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": "asynchronous" 2024-09-13T17:16:38.730 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:16:38.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.720+0000 7f0a54d0f640 1 -- 172.21.15.87:0/688940528 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0a380a1280 msgr2=0x7f0a380a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:38.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.720+0000 7f0a54d0f640 1 --2- 172.21.15.87:0/688940528 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0a380a1280 0x7f0a380a3740 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0a40005ab0 tx=0x7f0a40005a20 comp rx=0 tx=0).stop 2024-09-13T17:16:38.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.721+0000 7f0a54d0f640 1 -- 172.21.15.87:0/688940528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a50105150 msgr2=0x7f0a501968f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:38.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.721+0000 7f0a54d0f640 1 --2- 172.21.15.87:0/688940528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a50105150 0x7f0a501968f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0a4400e9c0 tx=0x7f0a4400ee80 comp rx=0 tx=0).stop 2024-09-13T17:16:38.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.721+0000 7f0a54d0f640 1 -- 172.21.15.87:0/688940528 shutdown_connections 2024-09-13T17:16:38.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.721+0000 7f0a54d0f640 1 --2- 172.21.15.87:0/688940528 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a5019ace0 0x7f0a5019b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.721+0000 7f0a54d0f640 1 --2- 172.21.15.87:0/688940528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a50105150 0x7f0a501968f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.721+0000 7f0a54d0f640 1 --2- 172.21.15.87:0/688940528 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0a380a1280 0x7f0a380a3740 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.721+0000 7f0a54d0f640 1 --2- 172.21.15.87:0/688940528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a50100000 0x7f0a501963b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.721+0000 7f0a54d0f640 1 -- 172.21.15.87:0/688940528 >> 172.21.15.87:0/688940528 conn(0x7f0a500fbab0 msgr2=0x7f0a500fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:38.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.721+0000 7f0a54d0f640 1 -- 172.21.15.87:0/688940528 shutdown_connections 2024-09-13T17:16:38.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.721+0000 7f0a54d0f640 1 -- 172.21.15.87:0/688940528 wait complete. 2024-09-13T17:16:38.733 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:16:38.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.831+0000 7f6e43b53640 1 -- 172.21.15.87:0/2885886223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e3c100620 msgr2=0x7f6e3c104ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:38.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.831+0000 7f6e43b53640 1 --2- 172.21.15.87:0/2885886223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e3c100620 0x7f6e3c104ac0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c009930 tx=0x7f6e2c02a420 comp rx=0 tx=0).stop 2024-09-13T17:16:38.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.831+0000 7f6e43b53640 1 -- 172.21.15.87:0/2885886223 shutdown_connections 2024-09-13T17:16:38.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.831+0000 7f6e43b53640 1 --2- 172.21.15.87:0/2885886223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e3c105220 0x7f6e3c10bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.831+0000 7f6e43b53640 1 --2- 172.21.15.87:0/2885886223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e3c100620 0x7f6e3c104ac0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.831+0000 7f6e43b53640 1 --2- 172.21.15.87:0/2885886223 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e3c0ffc70 0x7f6e3c100050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.831+0000 7f6e43b53640 1 -- 172.21.15.87:0/2885886223 >> 172.21.15.87:0/2885886223 conn(0x7f6e3c0741b0 msgr2=0x7f6e3c0745c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:38.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.831+0000 7f6e43b53640 1 -- 172.21.15.87:0/2885886223 shutdown_connections 2024-09-13T17:16:38.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.831+0000 7f6e43b53640 1 -- 172.21.15.87:0/2885886223 wait complete. 2024-09-13T17:16:38.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.832+0000 7f6e43b53640 1 Processor -- start 2024-09-13T17:16:38.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.832+0000 7f6e43b53640 1 -- start start 2024-09-13T17:16:38.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.832+0000 7f6e43b53640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e3c0ffc70 0x7f6e3c10c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.832+0000 7f6e43b53640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e3c105220 0x7f6e3c10ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.832+0000 7f6e43b53640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e3c10cfb0 0x7f6e3c1a4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.832+0000 7f6e43b53640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c1a4a90 con 0x7f6e3c105220 2024-09-13T17:16:38.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.832+0000 7f6e43b53640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c1a4c00 con 0x7f6e3c10cfb0 2024-09-13T17:16:38.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.832+0000 7f6e43b53640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c1a4dc0 con 0x7f6e3c0ffc70 2024-09-13T17:16:38.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.832+0000 7f6e410ee640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e3c105220 0x7f6e3c10ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.832+0000 7f6e410ee640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e3c105220 0x7f6e3c10ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39700/0 (socket says 172.21.15.87:39700) 2024-09-13T17:16:38.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.832+0000 7f6e410ee640 1 -- 172.21.15.87:0/78305770 learned_addr learned my addr 172.21.15.87:0/78305770 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:38.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.832+0000 7f6e420f0640 1 --2- 172.21.15.87:0/78305770 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e3c10cfb0 0x7f6e3c1a4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.832+0000 7f6e418ef640 1 --2- 172.21.15.87:0/78305770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e3c0ffc70 0x7f6e3c10c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.832+0000 7f6e410ee640 1 -- 172.21.15.87:0/78305770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e3c0ffc70 msgr2=0x7f6e3c10c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:38.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.832+0000 7f6e410ee640 1 --2- 172.21.15.87:0/78305770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e3c0ffc70 0x7f6e3c10c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.832+0000 7f6e410ee640 1 -- 172.21.15.87:0/78305770 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e3c10cfb0 msgr2=0x7f6e3c1a4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:38.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.832+0000 7f6e410ee640 1 --2- 172.21.15.87:0/78305770 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e3c10cfb0 0x7f6e3c1a4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.832+0000 7f6e410ee640 1 -- 172.21.15.87:0/78305770 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2c009560 con 0x7f6e3c105220 2024-09-13T17:16:38.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.832+0000 7f6e410ee640 1 --2- 172.21.15.87:0/78305770 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e3c105220 0x7f6e3c10ca70 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c009900 tx=0x7f6e2c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:38.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.832+0000 7f6e32ffd640 1 -- 172.21.15.87:0/78305770 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c0037f0 con 0x7f6e3c105220 2024-09-13T17:16:38.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.833+0000 7f6e32ffd640 1 -- 172.21.15.87:0/78305770 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6e2c0044c0 con 0x7f6e3c105220 2024-09-13T17:16:38.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.833+0000 7f6e43b53640 1 -- 172.21.15.87:0/78305770 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e3c1a5040 con 0x7f6e3c105220 2024-09-13T17:16:38.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.833+0000 7f6e32ffd640 1 -- 172.21.15.87:0/78305770 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c03bdd0 con 0x7f6e3c105220 2024-09-13T17:16:38.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.833+0000 7f6e43b53640 1 -- 172.21.15.87:0/78305770 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e3c1a54f0 con 0x7f6e3c105220 2024-09-13T17:16:38.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.835+0000 7f6e32ffd640 1 -- 172.21.15.87:0/78305770 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f6e2c03b560 con 0x7f6e3c105220 2024-09-13T17:16:38.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.835+0000 7f6e46872740 1 Processor -- start 2024-09-13T17:16:38.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.835+0000 7f6e46872740 1 -- start start 2024-09-13T17:16:38.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.835+0000 7f6e46872740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a613fce10 0x562a613fd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.835+0000 7f6e46872740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562a613fd730 0x562a61407a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.835+0000 7f6e32ffd640 1 --2- 172.21.15.87:0/78305770 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f6e280a1200 0x7f6e280a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.835+0000 7f6e46872740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562a61407fd0 0x562a6140a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.835+0000 7f6e46872740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a61367f20 con 0x562a613fd730 2024-09-13T17:16:38.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.835+0000 7f6e46872740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a613656b0 con 0x562a613fce10 2024-09-13T17:16:38.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.835+0000 7f6e46872740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a61360fa0 con 0x562a61407fd0 2024-09-13T17:16:38.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.836+0000 7f6e418ef640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562a613fd730 0x562a61407a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.836+0000 7f6e418ef640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562a613fd730 0x562a61407a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39716/0 (socket says 172.21.15.87:39716) 2024-09-13T17:16:38.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.836+0000 7f6e418ef640 1 -- 172.21.15.87:0/1674908565 learned_addr learned my addr 172.21.15.87:0/1674908565 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:38.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.836+0000 7f6e410ee640 1 --2- 172.21.15.87:0/78305770 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f6e280a1200 0x7f6e280a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.836+0000 7f6e32ffd640 1 -- 172.21.15.87:0/78305770 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f6e2c0edf10 con 0x7f6e3c105220 2024-09-13T17:16:38.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.836+0000 7f6e420f0640 1 --2- 172.21.15.87:0/1674908565 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562a61407fd0 0x562a6140a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.836+0000 7f6e420f0640 1 --2- 172.21.15.87:0/1674908565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a613fce10 0x562a613fd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.836+0000 7f6e418ef640 1 -- 172.21.15.87:0/1674908565 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562a61407fd0 msgr2=0x562a6140a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:38.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.836+0000 7f6e418ef640 1 --2- 172.21.15.87:0/1674908565 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562a61407fd0 0x562a6140a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.836+0000 7f6e418ef640 1 -- 172.21.15.87:0/1674908565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a613fce10 msgr2=0x562a613fd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:38.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.836+0000 7f6e418ef640 1 --2- 172.21.15.87:0/1674908565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a613fce10 0x562a613fd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.836+0000 7f6e418ef640 1 -- 172.21.15.87:0/1674908565 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a6131b840 con 0x562a613fd730 2024-09-13T17:16:38.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.836+0000 7f6e410ee640 1 --2- 172.21.15.87:0/78305770 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f6e280a1200 0x7f6e280a36c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c0b7790 tx=0x7f6e2c009260 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:38.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.836+0000 7f6e418ef640 1 --2- 172.21.15.87:0/1674908565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562a613fd730 0x562a61407a90 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f6e3800ac20 tx=0x7f6e3800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d12d325797d6bad8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:38.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.836+0000 7f6e27fff640 1 -- 172.21.15.87:0/1674908565 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3800a720 con 0x562a613fd730 2024-09-13T17:16:38.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.836+0000 7f6e27fff640 1 -- 172.21.15.87:0/1674908565 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6e38018af0 con 0x562a613fd730 2024-09-13T17:16:38.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.836+0000 7f6e27fff640 1 -- 172.21.15.87:0/1674908565 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e38010b20 con 0x562a613fd730 2024-09-13T17:16:38.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.837+0000 7f6e46872740 1 -- 172.21.15.87:0/1674908565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562a613fd730 msgr2=0x562a61407a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:38.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.837+0000 7f6e46872740 1 --2- 172.21.15.87:0/1674908565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562a613fd730 0x562a61407a90 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f6e3800ac20 tx=0x7f6e3800f790 comp rx=0 tx=0).stop 2024-09-13T17:16:38.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.837+0000 7f6e46872740 1 -- 172.21.15.87:0/1674908565 shutdown_connections 2024-09-13T17:16:38.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.837+0000 7f6e46872740 1 --2- 172.21.15.87:0/1674908565 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562a61407fd0 0x562a6140a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.837+0000 7f6e46872740 1 --2- 172.21.15.87:0/1674908565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562a613fd730 0x562a61407a90 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.837+0000 7f6e46872740 1 --2- 172.21.15.87:0/1674908565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a613fce10 0x562a613fd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.837+0000 7f6e46872740 1 -- 172.21.15.87:0/1674908565 >> 172.21.15.87:0/1674908565 conn(0x562a613f9380 msgr2=0x562a613f9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:38.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.837+0000 7f6e46872740 1 -- 172.21.15.87:0/1674908565 shutdown_connections 2024-09-13T17:16:38.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.837+0000 7f6e46872740 1 -- 172.21.15.87:0/1674908565 wait complete. 2024-09-13T17:16:38.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.837+0000 7f6e46872740 1 -- start start 2024-09-13T17:16:38.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.837+0000 7f6e46872740 1 Processor -- start 2024-09-13T17:16:38.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.838+0000 7f6e46872740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562a613fce10 0x562a61407990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.838+0000 7f6e46872740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562a613fd730 0x562a61404c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.838+0000 7f6e46872740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a61407fd0 0x562a614052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.838+0000 7f6e46872740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a613022a0 con 0x562a613fd730 2024-09-13T17:16:38.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.838+0000 7f6e46872740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a61039430 con 0x562a61407fd0 2024-09-13T17:16:38.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.838+0000 7f6e46872740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a612e4680 con 0x562a613fce10 2024-09-13T17:16:38.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.838+0000 7f6e46872740 10 client.0 _ll_register_callbacks cb 0x562a6135a610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:38.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.838+0000 7f6e418ef640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562a613fd730 0x562a61404c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.838+0000 7f6e418ef640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562a613fd730 0x562a61404c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39728/0 (socket says 172.21.15.87:39728) 2024-09-13T17:16:38.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.838+0000 7f6e418ef640 1 -- 172.21.15.87:0/3371476151 learned_addr learned my addr 172.21.15.87:0/3371476151 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:38.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.838+0000 7f6e420f0640 1 --2- 172.21.15.87:0/3371476151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562a613fce10 0x562a61407990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.838+0000 7f6e420f0640 1 --2- 172.21.15.87:0/3371476151 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a61407fd0 0x562a614052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.838+0000 7f6e418ef640 1 -- 172.21.15.87:0/3371476151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562a613fce10 msgr2=0x562a61407990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:38.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.838+0000 7f6e418ef640 1 --2- 172.21.15.87:0/3371476151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562a613fce10 0x562a61407990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.838+0000 7f6e418ef640 1 -- 172.21.15.87:0/3371476151 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a61407fd0 msgr2=0x562a614052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:38.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.838+0000 7f6e418ef640 1 --2- 172.21.15.87:0/3371476151 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a61407fd0 0x562a614052c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.838+0000 7f6e418ef640 1 -- 172.21.15.87:0/3371476151 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e3800a880 con 0x562a613fd730 2024-09-13T17:16:38.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.838+0000 7f6e418ef640 1 --2- 172.21.15.87:0/3371476151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562a613fd730 0x562a61404c60 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f6e38005c50 tx=0x7f6e380186f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e22a33e778c6318b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:38.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.838+0000 7f6e257fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:16:38.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.839+0000 7f6e257fa640 1 -- 172.21.15.87:0/3371476151 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3800a720 con 0x562a613fd730 2024-09-13T17:16:38.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.839+0000 7f6e257fa640 1 -- 172.21.15.87:0/3371476151 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f6e38010860 con 0x562a613fd730 2024-09-13T17:16:38.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.839+0000 7f6e46872740 1 -- 172.21.15.87:0/3371476151 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562a610544e0 con 0x562a613fd730 2024-09-13T17:16:38.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.839+0000 7f6e257fa640 1 -- 172.21.15.87:0/3371476151 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e38010a20 con 0x562a613fd730 2024-09-13T17:16:38.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.839+0000 7f6e46872740 10 client.16527 fetch_fsmap learned FSMap version 30 2024-09-13T17:16:38.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.839+0000 7f6e46872740 1 -- 172.21.15.87:0/3371476151 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x562a6135f620 con 0x562a613fd730 2024-09-13T17:16:38.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.839+0000 7f6e257fa640 1 -- 172.21.15.87:0/3371476151 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x562a610544e0 con 0x562a613fd730 2024-09-13T17:16:38.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.839+0000 7f6e257fa640 1 -- 172.21.15.87:0/3371476151 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f6e380046c0 con 0x562a613fd730 2024-09-13T17:16:38.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.839+0000 7f6e46872740 10 client.16527 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:16:38.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.839+0000 7f6e46872740 10 client.16527 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:16:38.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.839+0000 7f6e46872740 20 client.16527 populate_metadata read hostname 'smithi087' 2024-09-13T17:16:38.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.839+0000 7f6e46872740 1 --2- 172.21.15.87:0/3371476151 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x562a61417db0 0x562a6141a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.839+0000 7f6e46872740 4 client.16527 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:16:38.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.839+0000 7f6e46872740 1 -- 172.21.15.87:0/3371476151 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562a610657e0 con 0x562a61417db0 2024-09-13T17:16:38.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.839+0000 7f6e420f0640 1 --2- 172.21.15.87:0/3371476151 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x562a61417db0 0x562a6141a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.840+0000 7f6e420f0640 1 --2- 172.21.15.87:0/3371476151 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x562a61417db0 0x562a6141a1d0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52cc76020f7e7e1b server_cookie=16fcb3e7f51c124b in_seq=0 out_seq=0 2024-09-13T17:16:38.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.840+0000 7f6e257fa640 10 client.16527 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:38.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.840+0000 7f6e257fa640 1 -- 172.21.15.87:0/3371476151 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x562a610657e0 con 0x562a61417db0 2024-09-13T17:16:38.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.840+0000 7f6e257fa640 10 client.16527 handle_command_reply: tid=0 2024-09-13T17:16:38.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.840+0000 7f6e46872740 1 client.16527 shutdown 2024-09-13T17:16:38.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.840+0000 7f6e46872740 1 -- 172.21.15.87:0/3371476151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562a613fd730 msgr2=0x562a61404c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:38.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.840+0000 7f6e46872740 1 --2- 172.21.15.87:0/3371476151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562a613fd730 0x562a61404c60 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f6e38005c50 tx=0x7f6e380186f0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.840+0000 7f6e46872740 1 -- 172.21.15.87:0/3371476151 shutdown_connections 2024-09-13T17:16:38.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.840+0000 7f6e46872740 1 --2- 172.21.15.87:0/3371476151 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x562a61417db0 0x562a6141a1d0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.840+0000 7f6e46872740 1 --2- 172.21.15.87:0/3371476151 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a61407fd0 0x562a614052c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.840+0000 7f6e257fa640 0 client.16527 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:38.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.840+0000 7f6e46872740 1 --2- 172.21.15.87:0/3371476151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562a613fd730 0x562a61404c60 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.840+0000 7f6e46872740 1 --2- 172.21.15.87:0/3371476151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562a613fce10 0x562a61407990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.841+0000 7f6e46872740 1 -- 172.21.15.87:0/3371476151 >> 172.21.15.87:0/3371476151 conn(0x562a613f9380 msgr2=0x562a613ff0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:38.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.841+0000 7f6e46872740 1 -- 172.21.15.87:0/3371476151 shutdown_connections 2024-09-13T17:16:38.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.841+0000 7f6e46872740 1 -- 172.21.15.87:0/3371476151 wait complete. 2024-09-13T17:16:38.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.841+0000 7f6e46872740 20 client.16527 trim_cache size 0 max 16384 2024-09-13T17:16:38.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.854+0000 7f6e46872740 1 Processor -- start 2024-09-13T17:16:38.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.855+0000 7f6e46872740 1 -- start start 2024-09-13T17:16:38.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.855+0000 7f6e46872740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562a613fce10 0x562a613f8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.855+0000 7f6e46872740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562a613fd730 0x562a6140ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.855+0000 7f6e46872740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a61407fd0 0x562a6140f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.855+0000 7f6e46872740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a61054510 con 0x562a613fce10 2024-09-13T17:16:38.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.855+0000 7f6e46872740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a61407620 con 0x562a61407fd0 2024-09-13T17:16:38.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.855+0000 7f6e46872740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a614058a0 con 0x562a613fd730 2024-09-13T17:16:38.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.855+0000 7f6e420f0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562a613fce10 0x562a613f8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.855+0000 7f6e420f0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562a613fce10 0x562a613f8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39730/0 (socket says 172.21.15.87:39730) 2024-09-13T17:16:38.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.855+0000 7f6e420f0640 1 -- 172.21.15.87:0/2223832018 learned_addr learned my addr 172.21.15.87:0/2223832018 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:38.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.855+0000 7f6e420f0640 1 -- 172.21.15.87:0/2223832018 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562a613fd730 msgr2=0x562a6140ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:38.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.855+0000 7f6e420f0640 1 --2- 172.21.15.87:0/2223832018 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562a613fd730 0x562a6140ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.855+0000 7f6e420f0640 1 -- 172.21.15.87:0/2223832018 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a61407fd0 msgr2=0x562a6140f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:38.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.855+0000 7f6e420f0640 1 --2- 172.21.15.87:0/2223832018 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a61407fd0 0x562a6140f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.855+0000 7f6e420f0640 1 -- 172.21.15.87:0/2223832018 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a61301790 con 0x562a613fce10 2024-09-13T17:16:38.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.855+0000 7f6e420f0640 1 --2- 172.21.15.87:0/2223832018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562a613fce10 0x562a613f8d00 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f6e34005fd0 tx=0x7f6e34004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ccc37d333d8c1f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:38.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.855+0000 7f6e30e05640 1 -- 172.21.15.87:0/2223832018 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e34004b20 con 0x562a613fce10 2024-09-13T17:16:38.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.855+0000 7f6e30e05640 1 -- 172.21.15.87:0/2223832018 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6e34017040 con 0x562a613fce10 2024-09-13T17:16:38.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.855+0000 7f6e30e05640 1 -- 172.21.15.87:0/2223832018 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e34023820 con 0x562a613fce10 2024-09-13T17:16:38.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.856+0000 7f6e46872740 1 -- 172.21.15.87:0/2223832018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562a613fce10 msgr2=0x562a613f8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:38.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.856+0000 7f6e46872740 1 --2- 172.21.15.87:0/2223832018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562a613fce10 0x562a613f8d00 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f6e34005fd0 tx=0x7f6e34004a40 comp rx=0 tx=0).stop 2024-09-13T17:16:38.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.856+0000 7f6e46872740 1 -- 172.21.15.87:0/2223832018 shutdown_connections 2024-09-13T17:16:38.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.856+0000 7f6e46872740 1 --2- 172.21.15.87:0/2223832018 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a61407fd0 0x562a6140f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.856+0000 7f6e46872740 1 --2- 172.21.15.87:0/2223832018 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562a613fd730 0x562a6140ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.856+0000 7f6e46872740 1 --2- 172.21.15.87:0/2223832018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562a613fce10 0x562a613f8d00 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.856+0000 7f6e46872740 1 -- 172.21.15.87:0/2223832018 >> 172.21.15.87:0/2223832018 conn(0x562a613f9380 msgr2=0x562a613fff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:38.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.856+0000 7f6e46872740 1 -- 172.21.15.87:0/2223832018 shutdown_connections 2024-09-13T17:16:38.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.856+0000 7f6e46872740 1 -- 172.21.15.87:0/2223832018 wait complete. 2024-09-13T17:16:38.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.856+0000 7f6e46872740 1 -- start start 2024-09-13T17:16:38.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.856+0000 7f6e46872740 1 Processor -- start 2024-09-13T17:16:38.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.857+0000 7f6e46872740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562a613fce10 0x562a6140ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.857+0000 7f6e46872740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a613fd730 0x562a61400f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.857+0000 7f6e46872740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562a61407fd0 0x562a614014b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.857+0000 7f6e46872740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a6140f280 con 0x562a61407fd0 2024-09-13T17:16:38.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.857+0000 7f6e46872740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a6140f3f0 con 0x562a613fd730 2024-09-13T17:16:38.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.857+0000 7f6e46872740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a6140f5b0 con 0x562a613fce10 2024-09-13T17:16:38.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.857+0000 7f6e46872740 10 client.0 _ll_register_callbacks cb 0x7f6e3801b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:38.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.857+0000 7f6e420f0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562a61407fd0 0x562a614014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.857+0000 7f6e420f0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562a61407fd0 0x562a614014b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39732/0 (socket says 172.21.15.87:39732) 2024-09-13T17:16:38.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.857+0000 7f6e420f0640 1 -- 172.21.15.87:0/4203291837 learned_addr learned my addr 172.21.15.87:0/4203291837 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:38.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.857+0000 7f6e418ef640 1 --2- 172.21.15.87:0/4203291837 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a613fd730 0x562a61400f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.857+0000 7f6e420f0640 1 --2- 172.21.15.87:0/4203291837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562a613fce10 0x562a6140ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.857+0000 7f6e420f0640 1 -- 172.21.15.87:0/4203291837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562a613fce10 msgr2=0x562a6140ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:38.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.857+0000 7f6e420f0640 1 --2- 172.21.15.87:0/4203291837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562a613fce10 0x562a6140ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.857+0000 7f6e420f0640 1 -- 172.21.15.87:0/4203291837 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a613fd730 msgr2=0x562a61400f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:38.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.857+0000 7f6e420f0640 1 --2- 172.21.15.87:0/4203291837 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a613fd730 0x562a61400f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.857+0000 7f6e420f0640 1 -- 172.21.15.87:0/4203291837 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e34019040 con 0x562a61407fd0 2024-09-13T17:16:38.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.857+0000 7f6e418ef640 1 --2- 172.21.15.87:0/4203291837 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a613fd730 0x562a61400f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:16:38.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.857+0000 7f6e420f0640 1 --2- 172.21.15.87:0/4203291837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562a61407fd0 0x562a614014b0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x562a61409bf0 tx=0x7f6e34011710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d562c6a73a4ac36 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:38.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.857+0000 7f6e257fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:16:38.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.858+0000 7f6e257fa640 1 -- 172.21.15.87:0/4203291837 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3400fa70 con 0x562a61407fd0 2024-09-13T17:16:38.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.858+0000 7f6e257fa640 1 -- 172.21.15.87:0/4203291837 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f6e3400fbd0 con 0x562a61407fd0 2024-09-13T17:16:38.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.858+0000 7f6e46872740 1 -- 172.21.15.87:0/4203291837 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6e38018af0 con 0x562a61407fd0 2024-09-13T17:16:38.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.858+0000 7f6e257fa640 1 -- 172.21.15.87:0/4203291837 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e3400fd90 con 0x562a61407fd0 2024-09-13T17:16:38.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.858+0000 7f6e46872740 10 client.16533 fetch_fsmap learned FSMap version 30 2024-09-13T17:16:38.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.858+0000 7f6e46872740 1 -- 172.21.15.87:0/4203291837 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x562a61326ea0 con 0x562a61407fd0 2024-09-13T17:16:38.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.858+0000 7f6e257fa640 1 -- 172.21.15.87:0/4203291837 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6e38018af0 con 0x562a61407fd0 2024-09-13T17:16:38.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.858+0000 7f6e257fa640 1 -- 172.21.15.87:0/4203291837 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f6e34020420 con 0x562a61407fd0 2024-09-13T17:16:38.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.858+0000 7f6e46872740 10 client.16533 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:16:38.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.858+0000 7f6e46872740 10 client.16533 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:16:38.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.858+0000 7f6e46872740 20 client.16533 populate_metadata read hostname 'smithi087' 2024-09-13T17:16:38.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.858+0000 7f6e46872740 1 --2- 172.21.15.87:0/4203291837 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x562a61417db0 0x562a61471320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:38.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.858+0000 7f6e46872740 4 client.16533 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:16:38.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.858+0000 7f6e46872740 1 -- 172.21.15.87:0/4203291837 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562a610b8e30 con 0x562a61417db0 2024-09-13T17:16:38.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.858+0000 7f6e418ef640 1 --2- 172.21.15.87:0/4203291837 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x562a61417db0 0x562a61471320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:38.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.859+0000 7f6e257fa640 10 client.16533 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:38.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.859+0000 7f6e418ef640 1 --2- 172.21.15.87:0/4203291837 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x562a61417db0 0x562a61471320 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b643bb0a584d38af server_cookie=61a6b9538b08f90c in_seq=0 out_seq=0 2024-09-13T17:16:38.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.859+0000 7f6e257fa640 1 -- 172.21.15.87:0/4203291837 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x562a610b8e30 con 0x562a61417db0 2024-09-13T17:16:38.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.859+0000 7f6e257fa640 10 client.16533 handle_command_reply: tid=0 2024-09-13T17:16:38.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.859+0000 7f6e46872740 1 client.16533 shutdown 2024-09-13T17:16:38.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.859+0000 7f6e46872740 1 -- 172.21.15.87:0/4203291837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562a61407fd0 msgr2=0x562a614014b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:38.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.859+0000 7f6e46872740 1 --2- 172.21.15.87:0/4203291837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562a61407fd0 0x562a614014b0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x562a61409bf0 tx=0x7f6e34011710 comp rx=0 tx=0).stop 2024-09-13T17:16:38.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.859+0000 7f6e46872740 1 -- 172.21.15.87:0/4203291837 shutdown_connections 2024-09-13T17:16:38.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.859+0000 7f6e46872740 1 --2- 172.21.15.87:0/4203291837 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x562a61417db0 0x562a61471320 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.859+0000 7f6e46872740 1 --2- 172.21.15.87:0/4203291837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562a61407fd0 0x562a614014b0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.859+0000 7f6e257fa640 0 client.16533 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:38.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.859+0000 7f6e46872740 1 --2- 172.21.15.87:0/4203291837 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562a613fd730 0x562a61400f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.859+0000 7f6e46872740 1 --2- 172.21.15.87:0/4203291837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562a613fce10 0x562a6140ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.859+0000 7f6e46872740 1 -- 172.21.15.87:0/4203291837 >> 172.21.15.87:0/4203291837 conn(0x562a613f9380 msgr2=0x562a613f9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:38.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.859+0000 7f6e46872740 1 -- 172.21.15.87:0/4203291837 shutdown_connections 2024-09-13T17:16:38.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.859+0000 7f6e46872740 1 -- 172.21.15.87:0/4203291837 wait complete. 2024-09-13T17:16:38.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.859+0000 7f6e46872740 20 client.16533 trim_cache size 0 max 16384 2024-09-13T17:16:38.867 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:16:38.867 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "scrub active (283 inodes in the stack)", 2024-09-13T17:16:38.867 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": { 2024-09-13T17:16:38.867 INFO:teuthology.orchestra.run.smithi087.stdout: "fd746e66-9e7f-4091-ad33-e9a0fc8905c7": { 2024-09-13T17:16:38.868 INFO:teuthology.orchestra.run.smithi087.stdout: "path": "/", 2024-09-13T17:16:38.868 INFO:teuthology.orchestra.run.smithi087.stdout: "tag": "fd746e66-9e7f-4091-ad33-e9a0fc8905c7", 2024-09-13T17:16:38.868 INFO:teuthology.orchestra.run.smithi087.stdout: "options": "recursive,force" 2024-09-13T17:16:38.868 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:16:38.868 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:16:38.868 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:16:38.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.860+0000 7f6e43b53640 1 -- 172.21.15.87:0/78305770 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f6e280a1200 msgr2=0x7f6e280a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:38.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.860+0000 7f6e43b53640 1 --2- 172.21.15.87:0/78305770 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f6e280a1200 0x7f6e280a36c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c0b7790 tx=0x7f6e2c009260 comp rx=0 tx=0).stop 2024-09-13T17:16:38.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.860+0000 7f6e43b53640 1 -- 172.21.15.87:0/78305770 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e3c105220 msgr2=0x7f6e3c10ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:38.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.860+0000 7f6e43b53640 1 --2- 172.21.15.87:0/78305770 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e3c105220 0x7f6e3c10ca70 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c009900 tx=0x7f6e2c0040c0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.860+0000 7f6e43b53640 1 -- 172.21.15.87:0/78305770 shutdown_connections 2024-09-13T17:16:38.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.860+0000 7f6e43b53640 1 --2- 172.21.15.87:0/78305770 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e3c10cfb0 0x7f6e3c1a4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.860+0000 7f6e43b53640 1 --2- 172.21.15.87:0/78305770 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f6e280a1200 0x7f6e280a36c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.860+0000 7f6e43b53640 1 --2- 172.21.15.87:0/78305770 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e3c105220 0x7f6e3c10ca70 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.860+0000 7f6e43b53640 1 --2- 172.21.15.87:0/78305770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e3c0ffc70 0x7f6e3c10c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:38.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.860+0000 7f6e43b53640 1 -- 172.21.15.87:0/78305770 >> 172.21.15.87:0/78305770 conn(0x7f6e3c0741b0 msgr2=0x7f6e3c102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:38.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.860+0000 7f6e43b53640 1 -- 172.21.15.87:0/78305770 shutdown_connections 2024-09-13T17:16:38.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:16:38.860+0000 7f6e43b53640 1 -- 172.21.15.87:0/78305770 wait complete. 2024-09-13T17:16:38.871 INFO:tasks.cephfs.filesystem:scrub status for tag:fd746e66-9e7f-4091-ad33-e9a0fc8905c7 - {'path': '/', 'tag': 'fd746e66-9e7f-4091-ad33-e9a0fc8905c7', 'options': 'recursive,force'} 2024-09-13T17:16:39.906 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.904+0000 7f8142641640 1 -- 172.21.15.87:0/618354680 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f813c1017b0 msgr2=0x7f813c109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:39.906 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.904+0000 7f8142641640 1 --2- 172.21.15.87:0/618354680 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f813c1017b0 0x7f813c109c90 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f8130009900 tx=0x7f813002a480 comp rx=0 tx=0).stop 2024-09-13T17:16:39.906 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.904+0000 7f8142641640 1 -- 172.21.15.87:0/618354680 shutdown_connections 2024-09-13T17:16:39.906 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.904+0000 7f8142641640 1 --2- 172.21.15.87:0/618354680 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f813c10a2e0 0x7f813c10c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:39.906 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.904+0000 7f8142641640 1 --2- 172.21.15.87:0/618354680 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f813c1017b0 0x7f813c109c90 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:39.906 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.904+0000 7f8142641640 1 --2- 172.21.15.87:0/618354680 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f813c100e90 0x7f813c101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:39.906 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.904+0000 7f8142641640 1 -- 172.21.15.87:0/618354680 >> 172.21.15.87:0/618354680 conn(0x7f813c0fa8a0 msgr2=0x7f813c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:39.906 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.904+0000 7f8142641640 1 -- 172.21.15.87:0/618354680 shutdown_connections 2024-09-13T17:16:39.906 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.904+0000 7f8142641640 1 -- 172.21.15.87:0/618354680 wait complete. 2024-09-13T17:16:39.907 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.905+0000 7f8142641640 1 Processor -- start 2024-09-13T17:16:39.907 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.905+0000 7f8142641640 1 -- start start 2024-09-13T17:16:39.908 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.905+0000 7f8142641640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f813c100e90 0x7f813c1962f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:39.908 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.905+0000 7f8142641640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f813c1017b0 0x7f813c196830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.905+0000 7f8142641640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f813c10a2e0 0x7f813c19ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.905+0000 7f8142641640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813c19b220 con 0x7f813c100e90 2024-09-13T17:16:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.905+0000 7f8142641640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813c19b390 con 0x7f813c10a2e0 2024-09-13T17:16:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.905+0000 7f8142641640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813c19b550 con 0x7f813c1017b0 2024-09-13T17:16:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.905+0000 7f813bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f813c100e90 0x7f813c1962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.906+0000 7f813bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f813c100e90 0x7f813c1962f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52956/0 (socket says 172.21.15.87:52956) 2024-09-13T17:16:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.906+0000 7f813bfff640 1 -- 172.21.15.87:0/932394588 learned_addr learned my addr 172.21.15.87:0/932394588 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.906+0000 7f813b7fe640 1 --2- 172.21.15.87:0/932394588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f813c1017b0 0x7f813c196830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.906+0000 7f8140bde640 1 --2- 172.21.15.87:0/932394588 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f813c10a2e0 0x7f813c19ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.906+0000 7f813bfff640 1 -- 172.21.15.87:0/932394588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f813c1017b0 msgr2=0x7f813c196830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.906+0000 7f813bfff640 1 --2- 172.21.15.87:0/932394588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f813c1017b0 0x7f813c196830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.906+0000 7f813bfff640 1 -- 172.21.15.87:0/932394588 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f813c10a2e0 msgr2=0x7f813c19ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.906+0000 7f813bfff640 1 --2- 172.21.15.87:0/932394588 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f813c10a2e0 0x7f813c19ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.906+0000 7f813bfff640 1 -- 172.21.15.87:0/932394588 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8130009560 con 0x7f813c100e90 2024-09-13T17:16:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.906+0000 7f813bfff640 1 --2- 172.21.15.87:0/932394588 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f813c100e90 0x7f813c1962f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f812c00b4a0 tx=0x7f812c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.906+0000 7f81397fa640 1 -- 172.21.15.87:0/932394588 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c010610 con 0x7f813c100e90 2024-09-13T17:16:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.906+0000 7f81397fa640 1 -- 172.21.15.87:0/932394588 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f812c010c20 con 0x7f813c100e90 2024-09-13T17:16:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.906+0000 7f8142641640 1 -- 172.21.15.87:0/932394588 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f813c19b830 con 0x7f813c100e90 2024-09-13T17:16:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.906+0000 7f81397fa640 1 -- 172.21.15.87:0/932394588 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c017d50 con 0x7f813c100e90 2024-09-13T17:16:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.906+0000 7f8142641640 1 -- 172.21.15.87:0/932394588 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f813c1a30b0 con 0x7f813c100e90 2024-09-13T17:16:39.916 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.908+0000 7f81397fa640 1 -- 172.21.15.87:0/932394588 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f812c010770 con 0x7f813c100e90 2024-09-13T17:16:39.916 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.909+0000 7f8145443740 1 Processor -- start 2024-09-13T17:16:39.916 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.909+0000 7f8145443740 1 -- start start 2024-09-13T17:16:39.916 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.909+0000 7f8145443740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560d4d6b3330 0x560d4d6b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:39.916 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.909+0000 7f8145443740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560d4d6b3c50 0x560d4d6bdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:39.916 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.909+0000 7f8145443740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d4d6be4f0 0x560d4d6c08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:39.916 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.909+0000 7f8145443740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d4d61ec30 con 0x560d4d6be4f0 2024-09-13T17:16:39.916 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.909+0000 7f8145443740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d4d61c3c0 con 0x560d4d6b3330 2024-09-13T17:16:39.916 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.909+0000 7f8145443740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d4d617cb0 con 0x560d4d6b3c50 2024-09-13T17:16:39.916 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.909+0000 7f8140bde640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560d4d6b3330 0x560d4d6b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:39.917 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.909+0000 7f813b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d4d6be4f0 0x560d4d6c08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:39.917 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.909+0000 7f8140bde640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560d4d6b3330 0x560d4d6b3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.87:55630/0 (socket says 172.21.15.87:55630) 2024-09-13T17:16:39.917 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.909+0000 7f8140bde640 1 -- 172.21.15.87:0/2107375917 learned_addr learned my addr 172.21.15.87:0/2107375917 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:39.917 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.909+0000 7f813bfff640 1 --2- 172.21.15.87:0/2107375917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560d4d6b3c50 0x560d4d6bdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:39.917 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.909+0000 7f81397fa640 1 --2- 172.21.15.87:0/932394588 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f81240a1200 0x7f81240a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:39.917 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.910+0000 7f8140bde640 1 -- 172.21.15.87:0/2107375917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560d4d6b3c50 msgr2=0x560d4d6bdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:39.917 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.910+0000 7f8140bde640 1 --2- 172.21.15.87:0/2107375917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560d4d6b3c50 0x560d4d6bdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:39.917 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.910+0000 7f8140bde640 1 -- 172.21.15.87:0/2107375917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d4d6be4f0 msgr2=0x560d4d6c08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:39.917 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.910+0000 7f8140bde640 1 --2- 172.21.15.87:0/2107375917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d4d6be4f0 0x560d4d6c08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:39.917 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.910+0000 7f8140bde640 1 -- 172.21.15.87:0/2107375917 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d4d5be910 con 0x560d4d6b3330 2024-09-13T17:16:39.917 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.910+0000 7f813b7fe640 1 --2- 172.21.15.87:0/2107375917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d4d6be4f0 0x560d4d6c08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:16:39.917 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.910+0000 7f81397fa640 1 -- 172.21.15.87:0/932394588 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f812c0cc8e0 con 0x7f813c100e90 2024-09-13T17:16:39.918 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.910+0000 7f8140bde640 1 --2- 172.21.15.87:0/932394588 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f81240a1200 0x7f81240a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:39.918 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.910+0000 7f8140bde640 1 --2- 172.21.15.87:0/2107375917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560d4d6b3330 0x560d4d6b3710 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8134010510 tx=0x7f8134009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25ccc2fe34f9017e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:39.918 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.910+0000 7f81227fc640 1 -- 172.21.15.87:0/2107375917 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8134013600 con 0x560d4d6b3330 2024-09-13T17:16:39.918 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.910+0000 7f81227fc640 1 -- 172.21.15.87:0/2107375917 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f813401dab0 con 0x560d4d6b3330 2024-09-13T17:16:39.918 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.910+0000 7f81227fc640 1 -- 172.21.15.87:0/2107375917 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8134011930 con 0x560d4d6b3330 2024-09-13T17:16:39.918 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.910+0000 7f8140bde640 1 --2- 172.21.15.87:0/932394588 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f81240a1200 0x7f81240a36c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8134020000 tx=0x7f813401b000 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:39.918 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.911+0000 7f8145443740 1 -- 172.21.15.87:0/2107375917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560d4d6b3330 msgr2=0x560d4d6b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:39.918 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.911+0000 7f8145443740 1 --2- 172.21.15.87:0/2107375917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560d4d6b3330 0x560d4d6b3710 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8134010510 tx=0x7f8134009f90 comp rx=0 tx=0).stop 2024-09-13T17:16:39.918 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.911+0000 7f8145443740 1 -- 172.21.15.87:0/2107375917 shutdown_connections 2024-09-13T17:16:39.918 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.911+0000 7f8145443740 1 --2- 172.21.15.87:0/2107375917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d4d6be4f0 0x560d4d6c08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:39.918 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.911+0000 7f8145443740 1 --2- 172.21.15.87:0/2107375917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560d4d6b3c50 0x560d4d6bdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:39.918 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.911+0000 7f8145443740 1 --2- 172.21.15.87:0/2107375917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560d4d6b3330 0x560d4d6b3710 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:39.918 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.911+0000 7f8145443740 1 -- 172.21.15.87:0/2107375917 >> 172.21.15.87:0/2107375917 conn(0x560d4d6af8c0 msgr2=0x560d4d6afca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:39.919 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.911+0000 7f8145443740 1 -- 172.21.15.87:0/2107375917 shutdown_connections 2024-09-13T17:16:39.919 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.911+0000 7f8145443740 1 -- 172.21.15.87:0/2107375917 wait complete. 2024-09-13T17:16:39.919 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.911+0000 7f8145443740 1 -- start start 2024-09-13T17:16:39.919 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.911+0000 7f8145443740 1 Processor -- start 2024-09-13T17:16:39.919 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.911+0000 7f8145443740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560d4d6b3330 0x560d4d6bde50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:39.919 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.911+0000 7f8145443740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560d4d6b3c50 0x560d4d6bb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:39.919 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.912+0000 7f8145443740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d4d6be4f0 0x560d4d6bb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:39.919 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.912+0000 7f8145443740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d4d5d5e80 con 0x560d4d6be4f0 2024-09-13T17:16:39.919 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.912+0000 7f8145443740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d4d5d5b20 con 0x560d4d6b3330 2024-09-13T17:16:39.919 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.912+0000 7f8145443740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d4d59b260 con 0x560d4d6b3c50 2024-09-13T17:16:39.919 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.912+0000 7f8145443740 10 client.0 _ll_register_callbacks cb 0x560d4d5d0df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:39.919 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.912+0000 7f8140bde640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d4d6be4f0 0x560d4d6bb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:39.919 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.912+0000 7f8140bde640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d4d6be4f0 0x560d4d6bb630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52972/0 (socket says 172.21.15.87:52972) 2024-09-13T17:16:39.919 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.912+0000 7f8140bde640 1 -- 172.21.15.87:0/4060301249 learned_addr learned my addr 172.21.15.87:0/4060301249 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:39.920 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.912+0000 7f813bfff640 1 --2- 172.21.15.87:0/4060301249 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560d4d6b3330 0x560d4d6bde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:39.920 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.912+0000 7f813b7fe640 1 --2- 172.21.15.87:0/4060301249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560d4d6b3c50 0x560d4d6bb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:39.920 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.912+0000 7f813bfff640 1 -- 172.21.15.87:0/4060301249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560d4d6b3c50 msgr2=0x560d4d6bb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:39.920 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.912+0000 7f813bfff640 1 --2- 172.21.15.87:0/4060301249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560d4d6b3c50 0x560d4d6bb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:39.920 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.912+0000 7f813bfff640 1 -- 172.21.15.87:0/4060301249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d4d6be4f0 msgr2=0x560d4d6bb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:39.920 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.912+0000 7f813bfff640 1 --2- 172.21.15.87:0/4060301249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d4d6be4f0 0x560d4d6bb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:39.920 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.912+0000 7f813bfff640 1 -- 172.21.15.87:0/4060301249 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8134009ca0 con 0x560d4d6b3330 2024-09-13T17:16:39.920 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.912+0000 7f8140bde640 1 --2- 172.21.15.87:0/4060301249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d4d6be4f0 0x560d4d6bb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:16:39.920 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.912+0000 7f813bfff640 1 --2- 172.21.15.87:0/4060301249 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560d4d6b3330 0x560d4d6bde50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f812c0c9d30 tx=0x7f812c099630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6120e45ce85f041c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:39.920 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.912+0000 7f811b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-09-13T17:16:39.920 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.912+0000 7f811b7fe640 1 -- 172.21.15.87:0/4060301249 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c0997a0 con 0x560d4d6b3330 2024-09-13T17:16:39.920 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.912+0000 7f811b7fe640 1 -- 172.21.15.87:0/4060301249 <== mon.2 v2:172.21.15.118:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f812c09d520 con 0x560d4d6b3330 2024-09-13T17:16:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.912+0000 7f8145443740 1 -- 172.21.15.87:0/4060301249 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560d4d640680 con 0x560d4d6b3330 2024-09-13T17:16:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.912+0000 7f811b7fe640 1 -- 172.21.15.87:0/4060301249 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f812c0a1b70 con 0x560d4d6b3330 2024-09-13T17:16:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.912+0000 7f8145443740 10 client.25826 fetch_fsmap learned FSMap version 30 2024-09-13T17:16:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.912+0000 7f8145443740 1 -- 172.21.15.87:0/4060301249 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x560d4d616330 con 0x560d4d6b3330 2024-09-13T17:16:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.913+0000 7f811b7fe640 1 -- 172.21.15.87:0/4060301249 <== mon.2 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x560d4d640680 con 0x560d4d6b3330 2024-09-13T17:16:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.913+0000 7f811b7fe640 1 -- 172.21.15.87:0/4060301249 <== mon.2 v2:172.21.15.118:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f812c021070 con 0x560d4d6b3330 2024-09-13T17:16:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.913+0000 7f8145443740 10 client.25826 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:16:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.913+0000 7f8145443740 10 client.25826 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-13T17:16:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.913+0000 7f8145443740 20 client.25826 populate_metadata read hostname 'smithi087' 2024-09-13T17:16:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.913+0000 7f8145443740 1 --2- 172.21.15.87:0/4060301249 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560d4d6cdda0 0x560d4d6d0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.913+0000 7f8145443740 4 client.25826 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:16:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.913+0000 7f8145443740 1 -- 172.21.15.87:0/4060301249 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560d4d60b5d0 con 0x560d4d6cdda0 2024-09-13T17:16:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.913+0000 7f813b7fe640 1 --2- 172.21.15.87:0/4060301249 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560d4d6cdda0 0x560d4d6d0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.913+0000 7f811b7fe640 10 client.25826 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:39.922 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.913+0000 7f813b7fe640 1 --2- 172.21.15.87:0/4060301249 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560d4d6cdda0 0x560d4d6d0190 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36d5be86ba48e392 server_cookie=511c0d1eccd401c2 in_seq=0 out_seq=0 2024-09-13T17:16:39.922 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.914+0000 7f811b7fe640 1 -- 172.21.15.87:0/4060301249 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x560d4d60b5d0 con 0x560d4d6cdda0 2024-09-13T17:16:39.922 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.914+0000 7f811b7fe640 10 client.25826 handle_command_reply: tid=0 2024-09-13T17:16:39.922 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.914+0000 7f8145443740 1 client.25826 shutdown 2024-09-13T17:16:39.922 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.914+0000 7f8145443740 1 -- 172.21.15.87:0/4060301249 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560d4d6b3330 msgr2=0x560d4d6bde50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:39.922 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.914+0000 7f8145443740 1 --2- 172.21.15.87:0/4060301249 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560d4d6b3330 0x560d4d6bde50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f812c0c9d30 tx=0x7f812c099630 comp rx=0 tx=0).stop 2024-09-13T17:16:39.922 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.914+0000 7f8145443740 1 -- 172.21.15.87:0/4060301249 shutdown_connections 2024-09-13T17:16:39.922 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.914+0000 7f8145443740 1 --2- 172.21.15.87:0/4060301249 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560d4d6cdda0 0x560d4d6d0190 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:39.922 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.914+0000 7f8145443740 1 --2- 172.21.15.87:0/4060301249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d4d6be4f0 0x560d4d6bb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:39.922 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.914+0000 7f8145443740 1 --2- 172.21.15.87:0/4060301249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560d4d6b3c50 0x560d4d6bb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:39.922 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.914+0000 7f8145443740 1 --2- 172.21.15.87:0/4060301249 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560d4d6b3330 0x560d4d6bde50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:39.922 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.914+0000 7f811b7fe640 0 client.25826 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:39.922 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.914+0000 7f8145443740 1 -- 172.21.15.87:0/4060301249 >> 172.21.15.87:0/4060301249 conn(0x560d4d6af8c0 msgr2=0x560d4d6aeb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:39.923 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.914+0000 7f8145443740 1 -- 172.21.15.87:0/4060301249 shutdown_connections 2024-09-13T17:16:39.923 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.914+0000 7f8145443740 1 -- 172.21.15.87:0/4060301249 wait complete. 2024-09-13T17:16:39.923 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.914+0000 7f8145443740 20 client.25826 trim_cache size 0 max 16384 2024-09-13T17:16:39.932 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.926+0000 7f8145443740 1 Processor -- start 2024-09-13T17:16:39.932 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.926+0000 7f8145443740 1 -- start start 2024-09-13T17:16:39.932 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.927+0000 7f8145443740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d4d6b3330 0x560d4d6af300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:39.932 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.927+0000 7f8145443740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560d4d6b3c50 0x560d4d6bd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:39.932 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.927+0000 7f8145443740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560d4d6be4f0 0x560d4d6c51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:39.932 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.927+0000 7f8145443740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d4d6b4870 con 0x560d4d6b3330 2024-09-13T17:16:39.932 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.927+0000 7f8145443740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d4d6b42d0 con 0x560d4d6be4f0 2024-09-13T17:16:39.932 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.927+0000 7f8145443740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d4d6b9630 con 0x560d4d6b3c50 2024-09-13T17:16:39.933 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.927+0000 7f813bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d4d6b3330 0x560d4d6af300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:39.933 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.927+0000 7f813bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d4d6b3330 0x560d4d6af300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52974/0 (socket says 172.21.15.87:52974) 2024-09-13T17:16:39.933 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.927+0000 7f813bfff640 1 -- 172.21.15.87:0/2561357158 learned_addr learned my addr 172.21.15.87:0/2561357158 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:39.933 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.927+0000 7f813b7fe640 1 --2- 172.21.15.87:0/2561357158 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560d4d6b3c50 0x560d4d6bd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:39.933 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.927+0000 7f8140bde640 1 --2- 172.21.15.87:0/2561357158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560d4d6be4f0 0x560d4d6c51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:39.933 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.927+0000 7f813bfff640 1 -- 172.21.15.87:0/2561357158 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560d4d6b3c50 msgr2=0x560d4d6bd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:39.933 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.927+0000 7f813bfff640 1 --2- 172.21.15.87:0/2561357158 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560d4d6b3c50 0x560d4d6bd960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:39.933 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.927+0000 7f813bfff640 1 -- 172.21.15.87:0/2561357158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560d4d6be4f0 msgr2=0x560d4d6c51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:39.933 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.927+0000 7f813bfff640 1 --2- 172.21.15.87:0/2561357158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560d4d6be4f0 0x560d4d6c51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:39.933 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.927+0000 7f813bfff640 1 -- 172.21.15.87:0/2561357158 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d4d5b8300 con 0x560d4d6b3330 2024-09-13T17:16:39.933 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.927+0000 7f8140bde640 1 --2- 172.21.15.87:0/2561357158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560d4d6be4f0 0x560d4d6c51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:39.933 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.927+0000 7f813bfff640 1 --2- 172.21.15.87:0/2561357158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d4d6b3330 0x560d4d6af300 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f812c00be60 tx=0x7f812c017670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb94d318610e62c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:39.934 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.927+0000 7f8122ffd640 1 -- 172.21.15.87:0/2561357158 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c099100 con 0x560d4d6b3330 2024-09-13T17:16:39.934 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.927+0000 7f8122ffd640 1 -- 172.21.15.87:0/2561357158 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f812c095eb0 con 0x560d4d6b3330 2024-09-13T17:16:39.934 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.927+0000 7f8122ffd640 1 -- 172.21.15.87:0/2561357158 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c0a1b70 con 0x560d4d6b3330 2024-09-13T17:16:39.934 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.928+0000 7f8145443740 1 -- 172.21.15.87:0/2561357158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d4d6b3330 msgr2=0x560d4d6af300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:39.934 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.928+0000 7f8145443740 1 --2- 172.21.15.87:0/2561357158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d4d6b3330 0x560d4d6af300 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f812c00be60 tx=0x7f812c017670 comp rx=0 tx=0).stop 2024-09-13T17:16:39.934 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.928+0000 7f8145443740 1 -- 172.21.15.87:0/2561357158 shutdown_connections 2024-09-13T17:16:39.934 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.928+0000 7f8145443740 1 --2- 172.21.15.87:0/2561357158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560d4d6be4f0 0x560d4d6c51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:39.934 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.928+0000 7f8145443740 1 --2- 172.21.15.87:0/2561357158 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560d4d6b3c50 0x560d4d6bd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:39.934 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.928+0000 7f8145443740 1 --2- 172.21.15.87:0/2561357158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d4d6b3330 0x560d4d6af300 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:39.934 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.928+0000 7f8145443740 1 -- 172.21.15.87:0/2561357158 >> 172.21.15.87:0/2561357158 conn(0x560d4d6af8c0 msgr2=0x560d4d6b63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:39.934 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.928+0000 7f8145443740 1 -- 172.21.15.87:0/2561357158 shutdown_connections 2024-09-13T17:16:39.934 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.928+0000 7f8145443740 1 -- 172.21.15.87:0/2561357158 wait complete. 2024-09-13T17:16:39.934 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.928+0000 7f8145443740 1 -- start start 2024-09-13T17:16:39.934 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.928+0000 7f8145443740 1 Processor -- start 2024-09-13T17:16:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.929+0000 7f8145443740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560d4d6b3330 0x560d4d6c51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.929+0000 7f8145443740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d4d6b3c50 0x560d4d6c5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.929+0000 7f8145443740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560d4d6be4f0 0x560d4d6b7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.929+0000 7f8145443740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d4d6b8220 con 0x560d4d6b3c50 2024-09-13T17:16:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.929+0000 7f8145443740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d4d6b8390 con 0x560d4d6be4f0 2024-09-13T17:16:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.929+0000 7f8145443740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d4d6b8550 con 0x560d4d6b3330 2024-09-13T17:16:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.929+0000 7f8145443740 10 client.0 _ll_register_callbacks cb 0x7f8134009a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.929+0000 7f813b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d4d6b3c50 0x560d4d6c5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.929+0000 7f813b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d4d6b3c50 0x560d4d6c5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52988/0 (socket says 172.21.15.87:52988) 2024-09-13T17:16:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.929+0000 7f813b7fe640 1 -- 172.21.15.87:0/2300151283 learned_addr learned my addr 172.21.15.87:0/2300151283 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.929+0000 7f813bfff640 1 --2- 172.21.15.87:0/2300151283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560d4d6b3330 0x560d4d6c51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.929+0000 7f8140bde640 1 --2- 172.21.15.87:0/2300151283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560d4d6be4f0 0x560d4d6b7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.929+0000 7f813b7fe640 1 -- 172.21.15.87:0/2300151283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560d4d6b3330 msgr2=0x560d4d6c51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:39.936 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.929+0000 7f813b7fe640 1 --2- 172.21.15.87:0/2300151283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560d4d6b3330 0x560d4d6c51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:39.936 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.929+0000 7f813b7fe640 1 -- 172.21.15.87:0/2300151283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560d4d6be4f0 msgr2=0x560d4d6b7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:39.936 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.929+0000 7f813b7fe640 1 --2- 172.21.15.87:0/2300151283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560d4d6be4f0 0x560d4d6b7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:39.936 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.929+0000 7f813b7fe640 1 -- 172.21.15.87:0/2300151283 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560d4d616330 con 0x560d4d6b3c50 2024-09-13T17:16:39.936 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.929+0000 7f8140bde640 1 --2- 172.21.15.87:0/2300151283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560d4d6be4f0 0x560d4d6b7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:16:39.936 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.929+0000 7f813b7fe640 1 --2- 172.21.15.87:0/2300151283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d4d6b3c50 0x560d4d6c5700 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f8130005ec0 tx=0x7f8130031760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e6e5ba904cfc3c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:39.936 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.929+0000 7f811b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:16:39.936 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.929+0000 7f811b7fe640 1 -- 172.21.15.87:0/2300151283 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8130041040 con 0x560d4d6b3c50 2024-09-13T17:16:39.936 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.929+0000 7f811b7fe640 1 -- 172.21.15.87:0/2300151283 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f8130004450 con 0x560d4d6b3c50 2024-09-13T17:16:39.936 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.929+0000 7f8145443740 1 -- 172.21.15.87:0/2300151283 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f813401dab0 con 0x560d4d6b3c50 2024-09-13T17:16:39.936 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.930+0000 7f811b7fe640 1 -- 172.21.15.87:0/2300151283 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8130046370 con 0x560d4d6b3c50 2024-09-13T17:16:39.936 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.930+0000 7f8145443740 10 client.16551 fetch_fsmap learned FSMap version 30 2024-09-13T17:16:39.936 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.930+0000 7f8145443740 1 -- 172.21.15.87:0/2300151283 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x560d4d5dd8e0 con 0x560d4d6b3c50 2024-09-13T17:16:39.936 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.930+0000 7f811b7fe640 1 -- 172.21.15.87:0/2300151283 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f813401dab0 con 0x560d4d6b3c50 2024-09-13T17:16:39.937 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.930+0000 7f811b7fe640 1 -- 172.21.15.87:0/2300151283 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f8130003c50 con 0x560d4d6b3c50 2024-09-13T17:16:39.937 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.930+0000 7f8145443740 10 client.16551 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:16:39.937 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.930+0000 7f8145443740 10 client.16551 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-13T17:16:39.937 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.930+0000 7f8145443740 20 client.16551 populate_metadata read hostname 'smithi087' 2024-09-13T17:16:39.937 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.930+0000 7f8145443740 1 --2- 172.21.15.87:0/2300151283 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560d4d725680 0x560d4d727aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:39.937 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.930+0000 7f8145443740 4 client.16551 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T17:16:39.937 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.930+0000 7f8145443740 1 -- 172.21.15.87:0/2300151283 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560d4d30b300 con 0x560d4d725680 2024-09-13T17:16:39.937 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.930+0000 7f813bfff640 1 --2- 172.21.15.87:0/2300151283 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560d4d725680 0x560d4d727aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:39.937 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.931+0000 7f813bfff640 1 --2- 172.21.15.87:0/2300151283 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560d4d725680 0x560d4d727aa0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39d68299fcd74d24 server_cookie=1979ba7327995bac in_seq=0 out_seq=0 2024-09-13T17:16:39.937 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:39.931+0000 7f811b7fe640 10 client.16551 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:40.522 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:40.520+0000 7f811b7fe640 1 -- 172.21.15.87:0/2300151283 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560d4d30b300 con 0x560d4d725680 2024-09-13T17:16:40.522 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:40.520+0000 7f811b7fe640 10 client.16551 handle_command_reply: tid=0 2024-09-13T17:16:40.522 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:40.520+0000 7f8145443740 1 client.16551 shutdown 2024-09-13T17:16:40.522 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:40.520+0000 7f8145443740 1 -- 172.21.15.87:0/2300151283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d4d6b3c50 msgr2=0x560d4d6c5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:40.522 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:40.520+0000 7f8145443740 1 --2- 172.21.15.87:0/2300151283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d4d6b3c50 0x560d4d6c5700 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f8130005ec0 tx=0x7f8130031760 comp rx=0 tx=0).stop 2024-09-13T17:16:40.522 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:40.520+0000 7f8145443740 1 -- 172.21.15.87:0/2300151283 shutdown_connections 2024-09-13T17:16:40.522 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:40.520+0000 7f8145443740 1 --2- 172.21.15.87:0/2300151283 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560d4d725680 0x560d4d727aa0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:40.522 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:40.520+0000 7f8145443740 1 --2- 172.21.15.87:0/2300151283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560d4d6be4f0 0x560d4d6b7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:40.520+0000 7f8145443740 1 --2- 172.21.15.87:0/2300151283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d4d6b3c50 0x560d4d6c5700 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:40.520+0000 7f811b7fe640 0 client.16551 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:40.520+0000 7f8145443740 1 --2- 172.21.15.87:0/2300151283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560d4d6b3330 0x560d4d6c51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:40.520+0000 7f8145443740 1 -- 172.21.15.87:0/2300151283 >> 172.21.15.87:0/2300151283 conn(0x560d4d6af8c0 msgr2=0x560d4d6b9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:40.520+0000 7f8145443740 1 -- 172.21.15.87:0/2300151283 shutdown_connections 2024-09-13T17:16:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:40.520+0000 7f8145443740 1 -- 172.21.15.87:0/2300151283 wait complete. 2024-09-13T17:16:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:40.520+0000 7f8145443740 20 client.16551 trim_cache size 0 max 16384 2024-09-13T17:16:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout:{ 2024-09-13T17:16:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout: "message": "", 2024-09-13T17:16:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout: "return_code": 0 2024-09-13T17:16:40.524 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout:} 2024-09-13T17:16:40.524 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:40.521+0000 7f8142641640 1 -- 172.21.15.87:0/932394588 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f81240a1200 msgr2=0x7f81240a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:40.524 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:40.521+0000 7f8142641640 1 --2- 172.21.15.87:0/932394588 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f81240a1200 0x7f81240a36c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8134020000 tx=0x7f813401b000 comp rx=0 tx=0).stop 2024-09-13T17:16:40.524 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:40.521+0000 7f8142641640 1 -- 172.21.15.87:0/932394588 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f813c100e90 msgr2=0x7f813c1962f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:40.525 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:40.521+0000 7f8142641640 1 --2- 172.21.15.87:0/932394588 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f813c100e90 0x7f813c1962f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f812c00b4a0 tx=0x7f812c00b960 comp rx=0 tx=0).stop 2024-09-13T17:16:40.525 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:40.521+0000 7f8142641640 1 -- 172.21.15.87:0/932394588 shutdown_connections 2024-09-13T17:16:40.525 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:40.521+0000 7f8142641640 1 --2- 172.21.15.87:0/932394588 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f813c10a2e0 0x7f813c19ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:40.525 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:40.521+0000 7f8142641640 1 --2- 172.21.15.87:0/932394588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f813c1017b0 0x7f813c196830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:40.525 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:40.521+0000 7f8142641640 1 --2- 172.21.15.87:0/932394588 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f81240a1200 0x7f81240a36c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:40.525 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:40.521+0000 7f8142641640 1 --2- 172.21.15.87:0/932394588 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f813c100e90 0x7f813c1962f0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:40.525 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:40.521+0000 7f8142641640 1 -- 172.21.15.87:0/932394588 >> 172.21.15.87:0/932394588 conn(0x7f813c0fa8a0 msgr2=0x7f813c0fc140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:40.525 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:40.521+0000 7f8142641640 1 -- 172.21.15.87:0/932394588 shutdown_connections 2024-09-13T17:16:40.525 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:40.521+0000 7f8142641640 1 -- 172.21.15.87:0/932394588 wait complete. 2024-09-13T17:16:40.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:40 smithi149 ceph-mon[35496]: scrub queued for path: / 2024-09-13T17:16:40.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:40 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:40.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:40 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:40.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:40 smithi149 ceph-mon[35496]: pgmap v88: 129 pgs: 129 active+clean; 191 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 2.5 MiB/s wr, 460 op/s 2024-09-13T17:16:40.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:40 smithi118 ceph-mon[34374]: scrub queued for path: / 2024-09-13T17:16:40.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:40 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:40.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:40 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:40.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:40 smithi118 ceph-mon[34374]: pgmap v88: 129 pgs: 129 active+clean; 191 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 2.5 MiB/s wr, 460 op/s 2024-09-13T17:16:40.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:40 smithi087 ceph-mon[30934]: scrub queued for path: / 2024-09-13T17:16:40.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:40 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:40.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:40 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:40.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:40 smithi087 ceph-mon[30934]: pgmap v88: 129 pgs: 129 active+clean; 191 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 2.5 MiB/s wr, 460 op/s 2024-09-13T17:16:41.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.846 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.846 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.846 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.846 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.846 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.846 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.846 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.846 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.846 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.846 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.846 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.846 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.847 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.847 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.847 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.847 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.847 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.847 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.847 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.847 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.848 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.848 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.848 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.848 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.848 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.848 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.848 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.848 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.848 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.848 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.848 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.849 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.849 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.849 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.849 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.849 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.849 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.849 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.849 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.849 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.849 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.849 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.849 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.850 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.850 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.850 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.850 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.850 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.850 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.850 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.850 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.850 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.850 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.850 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.850 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.851 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.851 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.851 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.851 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.851 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.851 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.851 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.851 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.851 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.851 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.851 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.851 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.851 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.852 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.852 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:16:41.852 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.852 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.852 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:41 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.866 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.866 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.866 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.866 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.866 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.866 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.866 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.866 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.866 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.866 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.866 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.866 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.867 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.867 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.867 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.867 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.867 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.867 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.867 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.867 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.867 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.867 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.867 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.867 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.868 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.868 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.868 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.868 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.869 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.869 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.869 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.869 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.869 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.869 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.869 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.869 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.869 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.869 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.869 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.870 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.870 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.870 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.870 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.870 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.870 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.870 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.870 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.870 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.870 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.870 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.870 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.870 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.871 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.871 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.871 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.871 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.871 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.871 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.871 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.871 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.871 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.871 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.871 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.871 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.871 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.872 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.872 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.872 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.872 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.872 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.872 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.872 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.872 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.872 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.872 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.872 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.872 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.873 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.873 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.873 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:16:41.873 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.873 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.873 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:41 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.981 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.981 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.981 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.981 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.981 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.981 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.981 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.981 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.981 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.981 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.981 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.981 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.981 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.982 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.982 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.982 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.982 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.982 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.982 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.982 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.982 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.982 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.982 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.982 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.982 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.982 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.983 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.983 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.983 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.983 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.983 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.983 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.983 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.983 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.983 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.983 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.983 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.984 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.984 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.984 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.984 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.984 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.984 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.984 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.984 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.984 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.985 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.985 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.985 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.985 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.985 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.985 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.985 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.985 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.985 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.985 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.985 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.985 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.985 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.986 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.986 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.986 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.986 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.986 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.986 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.986 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.986 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.986 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.986 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.986 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.986 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.986 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.987 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.987 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.987 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.987 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.987 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.987 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.987 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.987 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.987 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.987 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.987 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.987 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.987 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.987 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.987 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.988 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.988 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:16:41.988 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.988 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:41.988 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:41 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:16:42.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:42 smithi149 ceph-mon[35496]: pgmap v89: 129 pgs: 129 active+clean; 202 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.5 MiB/s wr, 778 op/s 2024-09-13T17:16:42.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:42 smithi118 ceph-mon[34374]: pgmap v89: 129 pgs: 129 active+clean; 202 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.5 MiB/s wr, 778 op/s 2024-09-13T17:16:42.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:42 smithi087 ceph-mon[30934]: pgmap v89: 129 pgs: 129 active+clean; 202 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.5 MiB/s wr, 778 op/s 2024-09-13T17:16:43.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:43 smithi149 ceph-mon[35496]: pgmap v90: 129 pgs: 129 active+clean; 202 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.8 MiB/s wr, 474 op/s 2024-09-13T17:16:43.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:43 smithi118 ceph-mon[34374]: pgmap v90: 129 pgs: 129 active+clean; 202 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.8 MiB/s wr, 474 op/s 2024-09-13T17:16:43.980 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:43 smithi087 ceph-mon[30934]: pgmap v90: 129 pgs: 129 active+clean; 202 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.8 MiB/s wr, 474 op/s 2024-09-13T17:16:44.222 INFO:tasks.workunit.client.0.smithi087.stdout:Ok 2024-09-13T17:16:44.222 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T17:16:44.223 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-13T17:16:46.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:46 smithi149 ceph-mon[35496]: pgmap v91: 129 pgs: 129 active+clean; 194 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 488 op/s 2024-09-13T17:16:46.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:46 smithi118 ceph-mon[34374]: pgmap v91: 129 pgs: 129 active+clean; 194 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 488 op/s 2024-09-13T17:16:46.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:46 smithi087 ceph-mon[30934]: pgmap v91: 129 pgs: 129 active+clean; 194 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 488 op/s 2024-09-13T17:16:47.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:47 smithi149 ceph-mon[35496]: pgmap v92: 129 pgs: 129 active+clean; 193 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 977 KiB/s rd, 1.5 MiB/s wr, 350 op/s 2024-09-13T17:16:47.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:47 smithi118 ceph-mon[34374]: pgmap v92: 129 pgs: 129 active+clean; 193 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 977 KiB/s rd, 1.5 MiB/s wr, 350 op/s 2024-09-13T17:16:47.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:47 smithi087 ceph-mon[30934]: pgmap v92: 129 pgs: 129 active+clean; 193 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 977 KiB/s rd, 1.5 MiB/s wr, 350 op/s 2024-09-13T17:16:50.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:50 smithi149 ceph-mon[35496]: pgmap v93: 129 pgs: 129 active+clean; 193 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 977 KiB/s rd, 1.3 MiB/s wr, 331 op/s 2024-09-13T17:16:50.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:50 smithi149 ceph-mon[35496]: scrub summary: idle 2024-09-13T17:16:50.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:50 smithi149 ceph-mon[35496]: scrub summary: idle 2024-09-13T17:16:50.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:50 smithi118 ceph-mon[34374]: pgmap v93: 129 pgs: 129 active+clean; 193 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 977 KiB/s rd, 1.3 MiB/s wr, 331 op/s 2024-09-13T17:16:50.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:50 smithi118 ceph-mon[34374]: scrub summary: idle 2024-09-13T17:16:50.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:50 smithi118 ceph-mon[34374]: scrub summary: idle 2024-09-13T17:16:50.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:50 smithi087 ceph-mon[30934]: pgmap v93: 129 pgs: 129 active+clean; 193 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 977 KiB/s rd, 1.3 MiB/s wr, 331 op/s 2024-09-13T17:16:50.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:50 smithi087 ceph-mon[30934]: scrub summary: idle 2024-09-13T17:16:50.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:50 smithi087 ceph-mon[30934]: scrub summary: idle 2024-09-13T17:16:51.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:51 smithi149 ceph-mon[35496]: scrub summary: idle 2024-09-13T17:16:51.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:51 smithi149 ceph-mon[35496]: pgmap v94: 129 pgs: 129 active+clean; 199 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 463 op/s 2024-09-13T17:16:51.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:51 smithi118 ceph-mon[34374]: scrub summary: idle 2024-09-13T17:16:51.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:51 smithi118 ceph-mon[34374]: pgmap v94: 129 pgs: 129 active+clean; 199 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 463 op/s 2024-09-13T17:16:51.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:51 smithi087 ceph-mon[30934]: scrub summary: idle 2024-09-13T17:16:51.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:51 smithi087 ceph-mon[30934]: pgmap v94: 129 pgs: 129 active+clean; 199 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 463 op/s 2024-09-13T17:16:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.611+0000 7f8c952f0640 1 -- 172.21.15.87:0/3599356807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c900fea10 msgr2=0x7f8c900fedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.611+0000 7f8c952f0640 1 --2- 172.21.15.87:0/3599356807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c900fea10 0x7f8c900fedf0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f8c80009930 tx=0x7f8c8002a420 comp rx=0 tx=0).stop 2024-09-13T17:16:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.611+0000 7f8c952f0640 1 -- 172.21.15.87:0/3599356807 shutdown_connections 2024-09-13T17:16:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.611+0000 7f8c952f0640 1 --2- 172.21.15.87:0/3599356807 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c901062a0 0x7f8c9010cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.611+0000 7f8c952f0640 1 --2- 172.21.15.87:0/3599356807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c900ff3c0 0x7f8c90105b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.611+0000 7f8c952f0640 1 --2- 172.21.15.87:0/3599356807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c900fea10 0x7f8c900fedf0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.611+0000 7f8c952f0640 1 -- 172.21.15.87:0/3599356807 >> 172.21.15.87:0/3599356807 conn(0x7f8c90075380 msgr2=0x7f8c90075790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.611+0000 7f8c952f0640 1 -- 172.21.15.87:0/3599356807 shutdown_connections 2024-09-13T17:16:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.611+0000 7f8c952f0640 1 -- 172.21.15.87:0/3599356807 wait complete. 2024-09-13T17:16:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.612+0000 7f8c952f0640 1 Processor -- start 2024-09-13T17:16:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.612+0000 7f8c952f0640 1 -- start start 2024-09-13T17:16:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.612+0000 7f8c952f0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c900fea10 0x7f8c900ff980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.612+0000 7f8c952f0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c901062a0 0x7f8c900ffec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.612+0000 7f8c952f0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c90100400 0x7f8c901a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.612+0000 7f8c952f0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c901a49c0 con 0x7f8c900fea10 2024-09-13T17:16:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.612+0000 7f8c952f0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c901a4b30 con 0x7f8c901062a0 2024-09-13T17:16:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.612+0000 7f8c952f0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c901a4cf0 con 0x7f8c90100400 2024-09-13T17:16:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.612+0000 7f8c8effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c900fea10 0x7f8c900ff980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.612+0000 7f8c8effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c900fea10 0x7f8c900ff980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52540/0 (socket says 172.21.15.87:52540) 2024-09-13T17:16:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.612+0000 7f8c8effd640 1 -- 172.21.15.87:0/1676878000 learned_addr learned my addr 172.21.15.87:0/1676878000 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.612+0000 7f8c8f7fe640 1 --2- 172.21.15.87:0/1676878000 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c90100400 0x7f8c901a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.612+0000 7f8c867fc640 1 --2- 172.21.15.87:0/1676878000 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c901062a0 0x7f8c900ffec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.613+0000 7f8c8effd640 1 -- 172.21.15.87:0/1676878000 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c90100400 msgr2=0x7f8c901a43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.613+0000 7f8c8effd640 1 --2- 172.21.15.87:0/1676878000 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c90100400 0x7f8c901a43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.613+0000 7f8c8effd640 1 -- 172.21.15.87:0/1676878000 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c901062a0 msgr2=0x7f8c900ffec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.613+0000 7f8c8effd640 1 --2- 172.21.15.87:0/1676878000 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c901062a0 0x7f8c900ffec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.613+0000 7f8c8effd640 1 -- 172.21.15.87:0/1676878000 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c80009560 con 0x7f8c900fea10 2024-09-13T17:16:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.613+0000 7f8c8effd640 1 --2- 172.21.15.87:0/1676878000 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c900fea10 0x7f8c900ff980 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f8c80009900 tx=0x7f8c800042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.613+0000 7f8c8cff9640 1 -- 172.21.15.87:0/1676878000 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c80003a00 con 0x7f8c900fea10 2024-09-13T17:16:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.613+0000 7f8c8cff9640 1 -- 172.21.15.87:0/1676878000 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8c800044e0 con 0x7f8c900fea10 2024-09-13T17:16:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.613+0000 7f8c952f0640 1 -- 172.21.15.87:0/1676878000 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c901a4f70 con 0x7f8c900fea10 2024-09-13T17:16:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.613+0000 7f8c8cff9640 1 -- 172.21.15.87:0/1676878000 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8003a3c0 con 0x7f8c900fea10 2024-09-13T17:16:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.613+0000 7f8c952f0640 1 -- 172.21.15.87:0/1676878000 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c901a5390 con 0x7f8c900fea10 2024-09-13T17:16:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.615+0000 7f8c8cff9640 1 -- 172.21.15.87:0/1676878000 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f8c8003b460 con 0x7f8c900fea10 2024-09-13T17:16:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.616+0000 7f8c98016740 1 Processor -- start 2024-09-13T17:16:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.616+0000 7f8c98016740 1 -- start start 2024-09-13T17:16:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.616+0000 7f8c8cff9640 1 --2- 172.21.15.87:0/1676878000 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8c7c0a1230 0x7f8c7c0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.616+0000 7f8c98016740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7a85a3330 0x55b7a85a3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.616+0000 7f8c98016740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b7a85a3c50 0x55b7a85adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.616+0000 7f8c98016740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7a85ae4f0 0x55b7a85b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.616+0000 7f8c98016740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7a850ec30 con 0x55b7a85ae4f0 2024-09-13T17:16:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.616+0000 7f8c98016740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7a850c3c0 con 0x55b7a85a3330 2024-09-13T17:16:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.616+0000 7f8c98016740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7a8507cb0 con 0x55b7a85a3c50 2024-09-13T17:16:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.616+0000 7f8c8effd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7a85a3330 0x55b7a85a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.616+0000 7f8c8f7fe640 1 --2- 172.21.15.87:0/1676878000 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8c7c0a1230 0x7f8c7c0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.616+0000 7f8c8effd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7a85a3330 0x55b7a85a3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.87:33558/0 (socket says 172.21.15.87:33558) 2024-09-13T17:16:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.616+0000 7f8c8effd640 1 -- 172.21.15.87:0/2255933122 learned_addr learned my addr 172.21.15.87:0/2255933122 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.616+0000 7f8c867fc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b7a85a3c50 0x55b7a85adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.616+0000 7f8c8f7fe640 1 --2- 172.21.15.87:0/2255933122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7a85ae4f0 0x55b7a85b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.617+0000 7f8c8cff9640 1 -- 172.21.15.87:0/1676878000 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f8c800edc10 con 0x7f8c900fea10 2024-09-13T17:16:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.617+0000 7f8c8effd640 1 -- 172.21.15.87:0/2255933122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b7a85a3c50 msgr2=0x55b7a85adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.617+0000 7f8c8effd640 1 --2- 172.21.15.87:0/2255933122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b7a85a3c50 0x55b7a85adfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.617+0000 7f8c8effd640 1 -- 172.21.15.87:0/2255933122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7a85ae4f0 msgr2=0x55b7a85b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.617+0000 7f8c8effd640 1 --2- 172.21.15.87:0/2255933122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7a85ae4f0 0x55b7a85b08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.628 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.617+0000 7f8c8effd640 1 -- 172.21.15.87:0/2255933122 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7a84ae910 con 0x55b7a85a3330 2024-09-13T17:16:53.628 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.617+0000 7f8c867fc640 1 --2- 172.21.15.87:0/2255933122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b7a85a3c50 0x55b7a85adfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:16:53.628 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.617+0000 7f8c8effd640 1 --2- 172.21.15.87:0/2255933122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7a85a3330 0x55b7a85a3710 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8c800d3490 tx=0x7f8c8002a420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a17e064c2bbef35 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:53.628 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.617+0000 7f8c8f7fe640 1 --2- 172.21.15.87:0/1676878000 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8c7c0a1230 0x7f8c7c0a36f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8c880098e0 tx=0x7f8c88009d90 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:53.628 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.617+0000 7f8c857fa640 1 -- 172.21.15.87:0/2255933122 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8003b710 con 0x55b7a85a3330 2024-09-13T17:16:53.628 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.617+0000 7f8c857fa640 1 -- 172.21.15.87:0/2255933122 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8c800ccc30 con 0x55b7a85a3330 2024-09-13T17:16:53.628 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.617+0000 7f8c857fa640 1 -- 172.21.15.87:0/2255933122 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c80003d80 con 0x55b7a85a3330 2024-09-13T17:16:53.628 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.618+0000 7f8c98016740 1 -- 172.21.15.87:0/2255933122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7a85a3330 msgr2=0x55b7a85a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:53.628 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.618+0000 7f8c98016740 1 --2- 172.21.15.87:0/2255933122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7a85a3330 0x55b7a85a3710 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8c800d3490 tx=0x7f8c8002a420 comp rx=0 tx=0).stop 2024-09-13T17:16:53.628 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.618+0000 7f8c98016740 1 -- 172.21.15.87:0/2255933122 shutdown_connections 2024-09-13T17:16:53.628 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.618+0000 7f8c98016740 1 --2- 172.21.15.87:0/2255933122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7a85ae4f0 0x55b7a85b08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.628 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.618+0000 7f8c98016740 1 --2- 172.21.15.87:0/2255933122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b7a85a3c50 0x55b7a85adfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.628 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.618+0000 7f8c98016740 1 --2- 172.21.15.87:0/2255933122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7a85a3330 0x55b7a85a3710 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.628 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.618+0000 7f8c98016740 1 -- 172.21.15.87:0/2255933122 >> 172.21.15.87:0/2255933122 conn(0x55b7a859f8c0 msgr2=0x55b7a859fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.618+0000 7f8c98016740 1 -- 172.21.15.87:0/2255933122 shutdown_connections 2024-09-13T17:16:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.618+0000 7f8c98016740 1 -- 172.21.15.87:0/2255933122 wait complete. 2024-09-13T17:16:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.618+0000 7f8c98016740 1 -- start start 2024-09-13T17:16:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.618+0000 7f8c98016740 1 Processor -- start 2024-09-13T17:16:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.619+0000 7f8c98016740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b7a85a3330 0x55b7a85adda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.619+0000 7f8c98016740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7a85a3c50 0x55b7a85ab0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.619+0000 7f8c98016740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7a85ae4f0 0x55b7a85ab600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.619+0000 7f8c98016740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7a84c5e80 con 0x55b7a85ae4f0 2024-09-13T17:16:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.619+0000 7f8c98016740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7a84c5b20 con 0x55b7a85a3c50 2024-09-13T17:16:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.619+0000 7f8c98016740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7a848b260 con 0x55b7a85a3330 2024-09-13T17:16:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.619+0000 7f8c98016740 10 client.0 _ll_register_callbacks cb 0x55b7a84c0df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.619+0000 7f8c8f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7a85ae4f0 0x55b7a85ab600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:53.629 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.619+0000 7f8c8effd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b7a85a3330 0x55b7a85adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:53.630 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.619+0000 7f8c867fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7a85a3c50 0x55b7a85ab0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:53.630 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.619+0000 7f8c8effd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b7a85a3330 0x55b7a85adda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:56540/0 (socket says 172.21.15.87:56540) 2024-09-13T17:16:53.630 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.619+0000 7f8c8effd640 1 -- 172.21.15.87:0/499163763 learned_addr learned my addr 172.21.15.87:0/499163763 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:53.630 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.619+0000 7f8c8f7fe640 1 -- 172.21.15.87:0/499163763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b7a85a3330 msgr2=0x55b7a85adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:53.630 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.619+0000 7f8c8f7fe640 1 --2- 172.21.15.87:0/499163763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b7a85a3330 0x55b7a85adda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.630 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.619+0000 7f8c8f7fe640 1 -- 172.21.15.87:0/499163763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7a85a3c50 msgr2=0x55b7a85ab0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:53.630 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.619+0000 7f8c8f7fe640 1 --2- 172.21.15.87:0/499163763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7a85a3c50 0x55b7a85ab0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.630 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.619+0000 7f8c8f7fe640 1 -- 172.21.15.87:0/499163763 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c901a5390 con 0x55b7a85ae4f0 2024-09-13T17:16:53.630 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.619+0000 7f8c867fc640 1 --2- 172.21.15.87:0/499163763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7a85a3c50 0x55b7a85ab0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:16:53.630 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.619+0000 7f8c8f7fe640 1 --2- 172.21.15.87:0/499163763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7a85ae4f0 0x55b7a85ab600 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f8c88012440 tx=0x7f8c880095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38689c84d6560a9b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:53.630 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.619+0000 7f8c767fc640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:16:53.630 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.619+0000 7f8c767fc640 1 -- 172.21.15.87:0/499163763 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c88029460 con 0x55b7a85ae4f0 2024-09-13T17:16:53.630 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.619+0000 7f8c767fc640 1 -- 172.21.15.87:0/499163763 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f8c880295c0 con 0x55b7a85ae4f0 2024-09-13T17:16:53.630 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.619+0000 7f8c98016740 1 -- 172.21.15.87:0/499163763 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b7a8530680 con 0x55b7a85ae4f0 2024-09-13T17:16:53.630 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.620+0000 7f8c767fc640 1 -- 172.21.15.87:0/499163763 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c88029780 con 0x55b7a85ae4f0 2024-09-13T17:16:53.631 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.620+0000 7f8c98016740 10 client.16563 fetch_fsmap learned FSMap version 30 2024-09-13T17:16:53.631 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.620+0000 7f8c98016740 1 -- 172.21.15.87:0/499163763 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55b7a8506330 con 0x55b7a85ae4f0 2024-09-13T17:16:53.631 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.620+0000 7f8c767fc640 1 -- 172.21.15.87:0/499163763 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55b7a8530680 con 0x55b7a85ae4f0 2024-09-13T17:16:53.631 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.620+0000 7f8c767fc640 1 -- 172.21.15.87:0/499163763 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f8c88020850 con 0x55b7a85ae4f0 2024-09-13T17:16:53.631 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.620+0000 7f8c98016740 10 client.16563 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:16:53.631 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.620+0000 7f8c98016740 10 client.16563 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-13T17:16:53.631 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.620+0000 7f8c98016740 20 client.16563 populate_metadata read hostname 'smithi087' 2024-09-13T17:16:53.631 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.620+0000 7f8c98016740 1 --2- 172.21.15.87:0/499163763 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b7a85bdac0 0x55b7a85bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:53.631 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.620+0000 7f8c98016740 4 client.16563 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:16:53.631 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.620+0000 7f8c98016740 1 -- 172.21.15.87:0/499163763 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b7a84fb5d0 con 0x55b7a85bdac0 2024-09-13T17:16:53.631 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.620+0000 7f8c8effd640 1 --2- 172.21.15.87:0/499163763 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b7a85bdac0 0x55b7a85bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:53.631 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.621+0000 7f8c767fc640 10 client.16563 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:53.631 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.621+0000 7f8c8effd640 1 --2- 172.21.15.87:0/499163763 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b7a85bdac0 0x55b7a85bfee0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51e312a7de30b728 server_cookie=fda0d6929e4f15ca in_seq=0 out_seq=0 2024-09-13T17:16:53.631 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.621+0000 7f8c767fc640 1 -- 172.21.15.87:0/499163763 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55b7a84fb5d0 con 0x55b7a85bdac0 2024-09-13T17:16:53.631 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.621+0000 7f8c767fc640 10 client.16563 handle_command_reply: tid=0 2024-09-13T17:16:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.621+0000 7f8c98016740 1 client.16563 shutdown 2024-09-13T17:16:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.621+0000 7f8c98016740 1 -- 172.21.15.87:0/499163763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7a85ae4f0 msgr2=0x55b7a85ab600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.621+0000 7f8c98016740 1 --2- 172.21.15.87:0/499163763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7a85ae4f0 0x55b7a85ab600 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f8c88012440 tx=0x7f8c880095f0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.621+0000 7f8c98016740 1 -- 172.21.15.87:0/499163763 shutdown_connections 2024-09-13T17:16:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.621+0000 7f8c98016740 1 --2- 172.21.15.87:0/499163763 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b7a85bdac0 0x55b7a85bfee0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.621+0000 7f8c98016740 1 --2- 172.21.15.87:0/499163763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7a85ae4f0 0x55b7a85ab600 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.621+0000 7f8c767fc640 0 client.16563 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.621+0000 7f8c98016740 1 --2- 172.21.15.87:0/499163763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7a85a3c50 0x55b7a85ab0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.621+0000 7f8c98016740 1 --2- 172.21.15.87:0/499163763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b7a85a3330 0x55b7a85adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.621+0000 7f8c98016740 1 -- 172.21.15.87:0/499163763 >> 172.21.15.87:0/499163763 conn(0x55b7a859f8c0 msgr2=0x55b7a859eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.621+0000 7f8c98016740 1 -- 172.21.15.87:0/499163763 shutdown_connections 2024-09-13T17:16:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.621+0000 7f8c98016740 1 -- 172.21.15.87:0/499163763 wait complete. 2024-09-13T17:16:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.621+0000 7f8c98016740 20 client.16563 trim_cache size 0 max 16384 2024-09-13T17:16:53.637 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.634+0000 7f8c98016740 1 Processor -- start 2024-09-13T17:16:53.637 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.634+0000 7f8c98016740 1 -- start start 2024-09-13T17:16:53.637 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.634+0000 7f8c98016740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7a85a3330 0x55b7a85a9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:53.637 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.634+0000 7f8c98016740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b7a85a3c50 0x55b7a85a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:53.637 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.634+0000 7f8c98016740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7a85ae4f0 0x55b7a85b93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:53.637 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.634+0000 7f8c98016740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7a85c50f0 con 0x55b7a85ae4f0 2024-09-13T17:16:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.634+0000 7f8c98016740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7a85ab970 con 0x55b7a85a3330 2024-09-13T17:16:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.634+0000 7f8c98016740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7a85abe80 con 0x55b7a85a3c50 2024-09-13T17:16:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.634+0000 7f8c8f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7a85ae4f0 0x55b7a85b93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.634+0000 7f8c8f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7a85ae4f0 0x55b7a85b93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52568/0 (socket says 172.21.15.87:52568) 2024-09-13T17:16:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.634+0000 7f8c8f7fe640 1 -- 172.21.15.87:0/2462800858 learned_addr learned my addr 172.21.15.87:0/2462800858 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.634+0000 7f8c867fc640 1 --2- 172.21.15.87:0/2462800858 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b7a85a3c50 0x55b7a85a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.634+0000 7f8c8effd640 1 --2- 172.21.15.87:0/2462800858 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7a85a3330 0x55b7a85a9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.634+0000 7f8c8f7fe640 1 -- 172.21.15.87:0/2462800858 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b7a85a3c50 msgr2=0x55b7a85a9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.634+0000 7f8c8f7fe640 1 --2- 172.21.15.87:0/2462800858 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b7a85a3c50 0x55b7a85a9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.634+0000 7f8c8f7fe640 1 -- 172.21.15.87:0/2462800858 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7a85a3330 msgr2=0x55b7a85a9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.634+0000 7f8c8f7fe640 1 --2- 172.21.15.87:0/2462800858 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7a85a3330 0x55b7a85a9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.635+0000 7f8c8f7fe640 1 -- 172.21.15.87:0/2462800858 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7a84a8300 con 0x55b7a85ae4f0 2024-09-13T17:16:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.635+0000 7f8c8f7fe640 1 --2- 172.21.15.87:0/2462800858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7a85ae4f0 0x55b7a85b93c0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f8c88005d70 tx=0x7f8c880283c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46824c3c8eae4de9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:53.639 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.635+0000 7f8c85ffb640 1 -- 172.21.15.87:0/2462800858 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c88012470 con 0x55b7a85ae4f0 2024-09-13T17:16:53.639 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.635+0000 7f8c85ffb640 1 -- 172.21.15.87:0/2462800858 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8c880208b0 con 0x55b7a85ae4f0 2024-09-13T17:16:53.639 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.635+0000 7f8c85ffb640 1 -- 172.21.15.87:0/2462800858 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c88029880 con 0x55b7a85ae4f0 2024-09-13T17:16:53.639 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.635+0000 7f8c98016740 1 -- 172.21.15.87:0/2462800858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7a85ae4f0 msgr2=0x55b7a85b93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:53.639 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.635+0000 7f8c98016740 1 --2- 172.21.15.87:0/2462800858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7a85ae4f0 0x55b7a85b93c0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f8c88005d70 tx=0x7f8c880283c0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.636+0000 7f8c98016740 1 -- 172.21.15.87:0/2462800858 shutdown_connections 2024-09-13T17:16:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.636+0000 7f8c98016740 1 --2- 172.21.15.87:0/2462800858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7a85ae4f0 0x55b7a85b93c0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.636+0000 7f8c98016740 1 --2- 172.21.15.87:0/2462800858 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b7a85a3c50 0x55b7a85a9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.636+0000 7f8c98016740 1 --2- 172.21.15.87:0/2462800858 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7a85a3330 0x55b7a85a9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.636+0000 7f8c98016740 1 -- 172.21.15.87:0/2462800858 >> 172.21.15.87:0/2462800858 conn(0x55b7a859f8c0 msgr2=0x55b7a85a6330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.636+0000 7f8c98016740 1 -- 172.21.15.87:0/2462800858 shutdown_connections 2024-09-13T17:16:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.636+0000 7f8c98016740 1 -- 172.21.15.87:0/2462800858 wait complete. 2024-09-13T17:16:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.636+0000 7f8c98016740 1 -- start start 2024-09-13T17:16:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.636+0000 7f8c98016740 1 Processor -- start 2024-09-13T17:16:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.636+0000 7f8c98016740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b7a85a3330 0x55b7a85b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.636+0000 7f8c98016740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7a85a3c50 0x55b7a85b1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.636+0000 7f8c98016740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7a85ae4f0 0x55b7a85b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.636+0000 7f8c98016740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7a85b1c70 con 0x55b7a85a3c50 2024-09-13T17:16:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.636+0000 7f8c98016740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7a85b1de0 con 0x55b7a85ae4f0 2024-09-13T17:16:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.636+0000 7f8c98016740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7a8613fd0 con 0x55b7a85a3330 2024-09-13T17:16:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.636+0000 7f8c98016740 10 client.0 _ll_register_callbacks cb 0x7f8c800ba560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:16:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.636+0000 7f8c8effd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b7a85a3330 0x55b7a85b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.636+0000 7f8c867fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7a85a3c50 0x55b7a85b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.636+0000 7f8c8effd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b7a85a3330 0x55b7a85b2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:56554/0 (socket says 172.21.15.87:56554) 2024-09-13T17:16:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.636+0000 7f8c8effd640 1 -- 172.21.15.87:0/3316741926 learned_addr learned my addr 172.21.15.87:0/3316741926 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:16:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.637+0000 7f8c8f7fe640 1 --2- 172.21.15.87:0/3316741926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7a85ae4f0 0x55b7a85b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.637+0000 7f8c867fc640 1 -- 172.21.15.87:0/3316741926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b7a85a3330 msgr2=0x55b7a85b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.637+0000 7f8c867fc640 1 --2- 172.21.15.87:0/3316741926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b7a85a3330 0x55b7a85b2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.637+0000 7f8c867fc640 1 -- 172.21.15.87:0/3316741926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7a85ae4f0 msgr2=0x55b7a85b15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:16:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.637+0000 7f8c867fc640 1 --2- 172.21.15.87:0/3316741926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7a85ae4f0 0x55b7a85b15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.637+0000 7f8c867fc640 1 -- 172.21.15.87:0/3316741926 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b7a8506330 con 0x55b7a85a3c50 2024-09-13T17:16:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.637+0000 7f8c8effd640 1 --2- 172.21.15.87:0/3316741926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b7a85a3330 0x55b7a85b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:16:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.637+0000 7f8c867fc640 1 --2- 172.21.15.87:0/3316741926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7a85a3c50 0x55b7a85b1080 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x55b7a85ac640 tx=0x7f8c78003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb2cda176e94d4a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:16:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.637+0000 7f8c767fc640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:16:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.637+0000 7f8c767fc640 1 -- 172.21.15.87:0/3316741926 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c78016030 con 0x55b7a85a3c50 2024-09-13T17:16:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.637+0000 7f8c767fc640 1 -- 172.21.15.87:0/3316741926 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f8c78012b80 con 0x55b7a85a3c50 2024-09-13T17:16:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.637+0000 7f8c98016740 1 -- 172.21.15.87:0/3316741926 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8c800ccc30 con 0x55b7a85a3c50 2024-09-13T17:16:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.637+0000 7f8c767fc640 1 -- 172.21.15.87:0/3316741926 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c78012d40 con 0x55b7a85a3c50 2024-09-13T17:16:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.637+0000 7f8c98016740 10 client.16569 fetch_fsmap learned FSMap version 30 2024-09-13T17:16:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.637+0000 7f8c98016740 1 -- 172.21.15.87:0/3316741926 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55b7a84cd8e0 con 0x55b7a85a3c50 2024-09-13T17:16:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.637+0000 7f8c767fc640 1 -- 172.21.15.87:0/3316741926 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8c800ccc30 con 0x55b7a85a3c50 2024-09-13T17:16:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.637+0000 7f8c767fc640 1 -- 172.21.15.87:0/3316741926 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f8c78010430 con 0x55b7a85a3c50 2024-09-13T17:16:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.637+0000 7f8c98016740 10 client.16569 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:16:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.637+0000 7f8c98016740 10 client.16569 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-13T17:16:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.638+0000 7f8c98016740 20 client.16569 populate_metadata read hostname 'smithi087' 2024-09-13T17:16:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.638+0000 7f8c98016740 1 --2- 172.21.15.87:0/3316741926 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b7a8615720 0x55b7a8617b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:16:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.638+0000 7f8c98016740 4 client.16569 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T17:16:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.638+0000 7f8c98016740 1 -- 172.21.15.87:0/3316741926 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b7a81fb300 con 0x55b7a8615720 2024-09-13T17:16:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.638+0000 7f8c8effd640 1 --2- 172.21.15.87:0/3316741926 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b7a8615720 0x55b7a8617b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:16:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.638+0000 7f8c767fc640 10 client.16569 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.638+0000 7f8c8effd640 1 --2- 172.21.15.87:0/3316741926 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b7a8615720 0x55b7a8617b40 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29d93c5942adaaf3 server_cookie=242c70a8327f30f7 in_seq=0 out_seq=0 2024-09-13T17:16:53.831 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.828+0000 7f8c767fc640 1 -- 172.21.15.87:0/3316741926 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b7a81fb300 con 0x55b7a8615720 2024-09-13T17:16:53.831 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.829+0000 7f8c767fc640 10 client.16569 handle_command_reply: tid=0 2024-09-13T17:16:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.829+0000 7f8c98016740 1 client.16569 shutdown 2024-09-13T17:16:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.829+0000 7f8c98016740 1 -- 172.21.15.87:0/3316741926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7a85a3c50 msgr2=0x55b7a85b1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.829+0000 7f8c98016740 1 --2- 172.21.15.87:0/3316741926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7a85a3c50 0x55b7a85b1080 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x55b7a85ac640 tx=0x7f8c78003d00 comp rx=0 tx=0).stop 2024-09-13T17:16:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.829+0000 7f8c98016740 1 -- 172.21.15.87:0/3316741926 shutdown_connections 2024-09-13T17:16:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.829+0000 7f8c98016740 1 --2- 172.21.15.87:0/3316741926 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b7a8615720 0x55b7a8617b40 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.829+0000 7f8c98016740 1 --2- 172.21.15.87:0/3316741926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b7a85ae4f0 0x55b7a85b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.829+0000 7f8c98016740 1 --2- 172.21.15.87:0/3316741926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b7a85a3c50 0x55b7a85b1080 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.829+0000 7f8c767fc640 0 client.16569 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:16:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.829+0000 7f8c98016740 1 --2- 172.21.15.87:0/3316741926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b7a85a3330 0x55b7a85b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.829+0000 7f8c98016740 1 -- 172.21.15.87:0/3316741926 >> 172.21.15.87:0/3316741926 conn(0x55b7a859f8c0 msgr2=0x55b7a85a98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.829+0000 7f8c98016740 1 -- 172.21.15.87:0/3316741926 shutdown_connections 2024-09-13T17:16:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.829+0000 7f8c98016740 1 -- 172.21.15.87:0/3316741926 wait complete. 2024-09-13T17:16:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.829+0000 7f8c98016740 20 client.16569 trim_cache size 0 max 16384 2024-09-13T17:16:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout:{ 2024-09-13T17:16:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout: "message": "", 2024-09-13T17:16:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout: "return_code": 0 2024-09-13T17:16:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stdout:} 2024-09-13T17:16:53.834 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.829+0000 7f8c952f0640 1 -- 172.21.15.87:0/1676878000 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8c7c0a1230 msgr2=0x7f8c7c0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:53.834 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.829+0000 7f8c952f0640 1 --2- 172.21.15.87:0/1676878000 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8c7c0a1230 0x7f8c7c0a36f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8c880098e0 tx=0x7f8c88009d90 comp rx=0 tx=0).stop 2024-09-13T17:16:53.834 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.829+0000 7f8c952f0640 1 -- 172.21.15.87:0/1676878000 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c900fea10 msgr2=0x7f8c900ff980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:16:53.834 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.829+0000 7f8c952f0640 1 --2- 172.21.15.87:0/1676878000 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c900fea10 0x7f8c900ff980 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f8c80009900 tx=0x7f8c800042f0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.834 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.830+0000 7f8c952f0640 1 -- 172.21.15.87:0/1676878000 shutdown_connections 2024-09-13T17:16:53.834 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.830+0000 7f8c952f0640 1 --2- 172.21.15.87:0/1676878000 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c90100400 0x7f8c901a43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.834 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.830+0000 7f8c952f0640 1 --2- 172.21.15.87:0/1676878000 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c901062a0 0x7f8c900ffec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.834 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.830+0000 7f8c952f0640 1 --2- 172.21.15.87:0/1676878000 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8c7c0a1230 0x7f8c7c0a36f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.834 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.830+0000 7f8c952f0640 1 --2- 172.21.15.87:0/1676878000 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c900fea10 0x7f8c900ff980 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:16:53.835 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.830+0000 7f8c952f0640 1 -- 172.21.15.87:0/1676878000 >> 172.21.15.87:0/1676878000 conn(0x7f8c90075380 msgr2=0x7f8c90103dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:16:53.835 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.830+0000 7f8c952f0640 1 -- 172.21.15.87:0/1676878000 shutdown_connections 2024-09-13T17:16:53.835 INFO:teuthology.task.background_exec.ubuntu@smithi087.front.sepia.ceph.com.smithi087.stderr:2024-09-13T17:16:53.830+0000 7f8c952f0640 1 -- 172.21.15.87:0/1676878000 wait complete. 2024-09-13T17:16:54.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:54 smithi149 ceph-mon[35496]: pgmap v95: 129 pgs: 129 active+clean; 199 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 872 KiB/s rd, 953 KiB/s wr, 145 op/s 2024-09-13T17:16:54.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:54 smithi118 ceph-mon[34374]: pgmap v95: 129 pgs: 129 active+clean; 199 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 872 KiB/s rd, 953 KiB/s wr, 145 op/s 2024-09-13T17:16:54.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:54 smithi087 ceph-mon[30934]: pgmap v95: 129 pgs: 129 active+clean; 199 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 872 KiB/s rd, 953 KiB/s wr, 145 op/s 2024-09-13T17:16:55.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:55 smithi149 ceph-mon[35496]: pgmap v96: 129 pgs: 129 active+clean; 191 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 416 op/s 2024-09-13T17:16:55.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:55 smithi118 ceph-mon[34374]: pgmap v96: 129 pgs: 129 active+clean; 191 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 416 op/s 2024-09-13T17:16:55.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:55 smithi087 ceph-mon[30934]: pgmap v96: 129 pgs: 129 active+clean; 191 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 416 op/s 2024-09-13T17:16:57.285 INFO:tasks.workunit:Stopping ['fs/norstats'] on client.0... 2024-09-13T17:16:57.285 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-13T17:16:57.611 DEBUG:teuthology.parallel:result is None 2024-09-13T17:16:57.612 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T17:16:57.661 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T17:16:57.662 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-13T17:16:57.673 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T17:16:57.685 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-13T17:16:57.695 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-13T17:16:57.695 INFO:teuthology.task.exec:Executing custom commands... 2024-09-13T17:16:57.695 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T17:16:57.695 DEBUG:teuthology.orchestra.run.smithi087:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-13T17:16:57.761 DEBUG:teuthology.orchestra.run.smithi087:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-13T17:16:58.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:58 smithi149 ceph-mon[35496]: pgmap v97: 129 pgs: 129 active+clean; 192 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 443 op/s 2024-09-13T17:16:58.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:58 smithi118 ceph-mon[34374]: pgmap v97: 129 pgs: 129 active+clean; 192 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 443 op/s 2024-09-13T17:16:58.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:58 smithi087 ceph-mon[30934]: pgmap v97: 129 pgs: 129 active+clean; 192 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 443 op/s 2024-09-13T17:16:59.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:16:59 smithi149 ceph-mon[35496]: pgmap v98: 129 pgs: 129 active+clean; 192 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 442 op/s 2024-09-13T17:16:59.875 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:16:59 smithi118 ceph-mon[34374]: pgmap v98: 129 pgs: 129 active+clean; 192 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 442 op/s 2024-09-13T17:16:59.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:16:59 smithi087 ceph-mon[30934]: pgmap v98: 129 pgs: 129 active+clean; 192 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 442 op/s 2024-09-13T17:17:00.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:00 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:17:00.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:00 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:17:00.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:00 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:17:00.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:00 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:17:00.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:00 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:17:00.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:00 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:17:00.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:00 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:17:00.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:00 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:17:00.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:00 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:17:00.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:00 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:17:00.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:00 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:17:00.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:00 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:17:01.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:01 smithi149 ceph-mon[35496]: pgmap v99: 129 pgs: 129 active+clean; 187 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 542 op/s 2024-09-13T17:17:01.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:01 smithi118 ceph-mon[34374]: pgmap v99: 129 pgs: 129 active+clean; 187 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 542 op/s 2024-09-13T17:17:01.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:01 smithi087 ceph-mon[30934]: pgmap v99: 129 pgs: 129 active+clean; 187 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 542 op/s 2024-09-13T17:17:03.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:03 smithi149 ceph-mon[35496]: pgmap v100: 129 pgs: 129 active+clean; 187 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 833 KiB/s wr, 410 op/s 2024-09-13T17:17:03.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:03 smithi118 ceph-mon[34374]: pgmap v100: 129 pgs: 129 active+clean; 187 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 833 KiB/s wr, 410 op/s 2024-09-13T17:17:03.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:03 smithi087 ceph-mon[30934]: pgmap v100: 129 pgs: 129 active+clean; 187 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 833 KiB/s wr, 410 op/s 2024-09-13T17:17:05.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:05 smithi149 ceph-mon[35496]: pgmap v101: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 863 KiB/s wr, 427 op/s 2024-09-13T17:17:05.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:05 smithi118 ceph-mon[34374]: pgmap v101: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 863 KiB/s wr, 427 op/s 2024-09-13T17:17:05.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:05 smithi087 ceph-mon[30934]: pgmap v101: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 863 KiB/s wr, 427 op/s 2024-09-13T17:17:07.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:07 smithi149 ceph-mon[35496]: pgmap v102: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 519 KiB/s wr, 158 op/s 2024-09-13T17:17:07.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:07 smithi118 ceph-mon[34374]: pgmap v102: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 519 KiB/s wr, 158 op/s 2024-09-13T17:17:07.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:07 smithi087 ceph-mon[30934]: pgmap v102: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 519 KiB/s wr, 158 op/s 2024-09-13T17:17:08.872 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:17:08.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.984+0000 7f8ab139c640 1 -- 172.21.15.87:0/2361349089 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8aac103fa0 msgr2=0x7f8aac10baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:08.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.984+0000 7f8ab139c640 1 --2- 172.21.15.87:0/2361349089 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8aac103fa0 0x7f8aac10baf0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4009cd0 tx=0x7f8aa402a8e0 comp rx=0 tx=0).stop 2024-09-13T17:17:08.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.984+0000 7f8ab139c640 1 -- 172.21.15.87:0/2361349089 shutdown_connections 2024-09-13T17:17:08.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.984+0000 7f8ab139c640 1 --2- 172.21.15.87:0/2361349089 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8aac103fa0 0x7f8aac10baf0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:08.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.984+0000 7f8ab139c640 1 --2- 172.21.15.87:0/2361349089 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8aac0ff800 0x7f8aac103840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:08.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.984+0000 7f8ab139c640 1 --2- 172.21.15.87:0/2361349089 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8aac0fee50 0x7f8aac0ff230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:08.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.985+0000 7f8ab139c640 1 -- 172.21.15.87:0/2361349089 >> 172.21.15.87:0/2361349089 conn(0x7f8aac0fa8c0 msgr2=0x7f8aac0fcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:08.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.985+0000 7f8ab139c640 1 -- 172.21.15.87:0/2361349089 shutdown_connections 2024-09-13T17:17:08.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.985+0000 7f8ab139c640 1 -- 172.21.15.87:0/2361349089 wait complete. 2024-09-13T17:17:08.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.985+0000 7f8ab139c640 1 Processor -- start 2024-09-13T17:17:08.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.985+0000 7f8ab139c640 1 -- start start 2024-09-13T17:17:08.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.986+0000 7f8ab139c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8aac0fee50 0x7f8aac197220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:08.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.986+0000 7f8ab139c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8aac103fa0 0x7f8aac197760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:08.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.986+0000 7f8ab139c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8aac197d40 0x7f8aac1a22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:08.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.986+0000 7f8ab139c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac1a29e0 con 0x7f8aac103fa0 2024-09-13T17:17:08.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.986+0000 7f8ab139c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac1a2b50 con 0x7f8aac197d40 2024-09-13T17:17:08.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.986+0000 7f8ab139c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac1a2d10 con 0x7f8aac0fee50 2024-09-13T17:17:08.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.986+0000 7f8aa27fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8aac103fa0 0x7f8aac197760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:08.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.986+0000 7f8aa27fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8aac103fa0 0x7f8aac197760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45712/0 (socket says 172.21.15.87:45712) 2024-09-13T17:17:08.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.986+0000 7f8aa27fc640 1 -- 172.21.15.87:0/4170364345 learned_addr learned my addr 172.21.15.87:0/4170364345 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:08.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.986+0000 7f8aab7fe640 1 --2- 172.21.15.87:0/4170364345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8aac197d40 0x7f8aac1a22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:08.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.986+0000 7f8aaaffd640 1 --2- 172.21.15.87:0/4170364345 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8aac0fee50 0x7f8aac197220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:08.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.986+0000 7f8aa27fc640 1 -- 172.21.15.87:0/4170364345 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8aac0fee50 msgr2=0x7f8aac197220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:08.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.986+0000 7f8aa27fc640 1 --2- 172.21.15.87:0/4170364345 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8aac0fee50 0x7f8aac197220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:08.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.986+0000 7f8aa27fc640 1 -- 172.21.15.87:0/4170364345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8aac197d40 msgr2=0x7f8aac1a22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:08.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.986+0000 7f8aa27fc640 1 --2- 172.21.15.87:0/4170364345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8aac197d40 0x7f8aac1a22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:08.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.986+0000 7f8aa27fc640 1 -- 172.21.15.87:0/4170364345 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa4009900 con 0x7f8aac103fa0 2024-09-13T17:17:08.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.986+0000 7f8aaaffd640 1 --2- 172.21.15.87:0/4170364345 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8aac0fee50 0x7f8aac197220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:08.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.986+0000 7f8aa27fc640 1 --2- 172.21.15.87:0/4170364345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8aac103fa0 0x7f8aac197760 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f8a9400b450 tx=0x7f8a9400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:08.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.986+0000 7f8aa8ff9640 1 -- 172.21.15.87:0/4170364345 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a94011890 con 0x7f8aac103fa0 2024-09-13T17:17:08.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.986+0000 7f8ab139c640 1 -- 172.21.15.87:0/4170364345 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aac1a2ff0 con 0x7f8aac103fa0 2024-09-13T17:17:08.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.986+0000 7f8aa8ff9640 1 -- 172.21.15.87:0/4170364345 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8a940103e0 con 0x7f8aac103fa0 2024-09-13T17:17:08.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.986+0000 7f8aa8ff9640 1 -- 172.21.15.87:0/4170364345 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a94011ea0 con 0x7f8aac103fa0 2024-09-13T17:17:08.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.986+0000 7f8ab139c640 1 -- 172.21.15.87:0/4170364345 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aac1a3470 con 0x7f8aac103fa0 2024-09-13T17:17:08.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.989+0000 7f8aa8ff9640 1 -- 172.21.15.87:0/4170364345 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f8a94010550 con 0x7f8aac103fa0 2024-09-13T17:17:08.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.989+0000 7f8ab40c6740 1 Processor -- start 2024-09-13T17:17:08.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.989+0000 7f8ab40c6740 1 -- start start 2024-09-13T17:17:08.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.989+0000 7f8ab40c6740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557dd817fe10 0x557dd81801f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:08.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.989+0000 7f8ab40c6740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dd8180730 0x557dd818aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:08.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.989+0000 7f8ab40c6740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557dd818afd0 0x557dd818d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:08.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.989+0000 7f8aa8ff9640 1 --2- 172.21.15.87:0/4170364345 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8a980a1200 0x7f8a980a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:08.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.989+0000 7f8ab40c6740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dd80eaf20 con 0x557dd818afd0 2024-09-13T17:17:08.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.989+0000 7f8ab40c6740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dd80e86b0 con 0x557dd817fe10 2024-09-13T17:17:08.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.989+0000 7f8ab40c6740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dd80e3fa0 con 0x557dd8180730 2024-09-13T17:17:08.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.990+0000 7f8aab7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557dd818afd0 0x557dd818d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:08.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.990+0000 7f8aa8ff9640 1 -- 172.21.15.87:0/4170364345 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f8a940ccda0 con 0x7f8aac103fa0 2024-09-13T17:17:08.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.990+0000 7f8aa27fc640 1 --2- 172.21.15.87:0/4170364345 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8a980a1200 0x7f8a980a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:08.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.990+0000 7f8aab7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557dd818afd0 0x557dd818d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45722/0 (socket says 172.21.15.87:45722) 2024-09-13T17:17:08.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.990+0000 7f8aab7fe640 1 -- 172.21.15.87:0/3527177779 learned_addr learned my addr 172.21.15.87:0/3527177779 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:08.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.990+0000 7f8aaaffd640 1 --2- 172.21.15.87:0/3527177779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dd8180730 0x557dd818aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:08.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.990+0000 7f8aab7fe640 1 --2- 172.21.15.87:0/3527177779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557dd817fe10 0x557dd81801f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:08.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.990+0000 7f8aab7fe640 1 -- 172.21.15.87:0/3527177779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dd8180730 msgr2=0x557dd818aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:08.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.990+0000 7f8aab7fe640 1 --2- 172.21.15.87:0/3527177779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dd8180730 0x557dd818aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:08.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.990+0000 7f8aab7fe640 1 -- 172.21.15.87:0/3527177779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557dd817fe10 msgr2=0x557dd81801f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:08.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.990+0000 7f8aab7fe640 1 --2- 172.21.15.87:0/3527177779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557dd817fe10 0x557dd81801f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:08.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.990+0000 7f8aab7fe640 1 -- 172.21.15.87:0/3527177779 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557dd809e840 con 0x557dd818afd0 2024-09-13T17:17:08.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.990+0000 7f8aaaffd640 1 --2- 172.21.15.87:0/3527177779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dd8180730 0x557dd818aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:08.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.990+0000 7f8aa27fc640 1 --2- 172.21.15.87:0/4170364345 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8a980a1200 0x7f8a980a36c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8a94009fd0 tx=0x7f8a940047d0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:08.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.990+0000 7f8aab7fe640 1 --2- 172.21.15.87:0/3527177779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557dd818afd0 0x557dd818d3c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f8aa402ae00 tx=0x7f8aa4005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce577c906a0b576a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:08.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.990+0000 7f8aa17fa640 1 -- 172.21.15.87:0/3527177779 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa40305a0 con 0x557dd818afd0 2024-09-13T17:17:08.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.990+0000 7f8aa17fa640 1 -- 172.21.15.87:0/3527177779 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8aa4031d20 con 0x557dd818afd0 2024-09-13T17:17:08.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.990+0000 7f8aa17fa640 1 -- 172.21.15.87:0/3527177779 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4003ea0 con 0x557dd818afd0 2024-09-13T17:17:08.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.991+0000 7f8ab40c6740 1 -- 172.21.15.87:0/3527177779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557dd818afd0 msgr2=0x557dd818d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:08.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.991+0000 7f8ab40c6740 1 --2- 172.21.15.87:0/3527177779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557dd818afd0 0x557dd818d3c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f8aa402ae00 tx=0x7f8aa4005fa0 comp rx=0 tx=0).stop 2024-09-13T17:17:08.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.991+0000 7f8ab40c6740 1 -- 172.21.15.87:0/3527177779 shutdown_connections 2024-09-13T17:17:08.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.991+0000 7f8ab40c6740 1 --2- 172.21.15.87:0/3527177779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557dd818afd0 0x557dd818d3c0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:08.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.991+0000 7f8ab40c6740 1 --2- 172.21.15.87:0/3527177779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dd8180730 0x557dd818aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:08.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.991+0000 7f8ab40c6740 1 --2- 172.21.15.87:0/3527177779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557dd817fe10 0x557dd81801f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:08.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.991+0000 7f8ab40c6740 1 -- 172.21.15.87:0/3527177779 >> 172.21.15.87:0/3527177779 conn(0x557dd817c380 msgr2=0x557dd817c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:08.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.991+0000 7f8ab40c6740 1 -- 172.21.15.87:0/3527177779 shutdown_connections 2024-09-13T17:17:09.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.991+0000 7f8ab40c6740 1 -- 172.21.15.87:0/3527177779 wait complete. 2024-09-13T17:17:09.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.991+0000 7f8ab40c6740 1 -- start start 2024-09-13T17:17:09.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.992+0000 7f8ab40c6740 1 Processor -- start 2024-09-13T17:17:09.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.992+0000 7f8ab40c6740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dd817fe10 0x557dd818a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.992+0000 7f8ab40c6740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557dd8180730 0x557dd8187d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.992+0000 7f8ab40c6740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557dd818afd0 0x557dd8188330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.992+0000 7f8ab40c6740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dd80852a0 con 0x557dd818afd0 2024-09-13T17:17:09.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.992+0000 7f8ab40c6740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dd7dbc430 con 0x557dd8180730 2024-09-13T17:17:09.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.992+0000 7f8ab40c6740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dd8067680 con 0x557dd817fe10 2024-09-13T17:17:09.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.992+0000 7f8ab40c6740 10 client.0 _ll_register_callbacks cb 0x557dd80dd610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:17:09.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.992+0000 7f8aab7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557dd818afd0 0x557dd8188330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.992+0000 7f8aab7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557dd818afd0 0x557dd8188330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45738/0 (socket says 172.21.15.87:45738) 2024-09-13T17:17:09.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.992+0000 7f8aab7fe640 1 -- 172.21.15.87:0/1827979849 learned_addr learned my addr 172.21.15.87:0/1827979849 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:09.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.992+0000 7f8aaaffd640 1 --2- 172.21.15.87:0/1827979849 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557dd8180730 0x557dd8187d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.992+0000 7f8aab7fe640 1 -- 172.21.15.87:0/1827979849 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dd817fe10 msgr2=0x557dd818a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:09.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.992+0000 7f8aab7fe640 1 --2- 172.21.15.87:0/1827979849 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dd817fe10 0x557dd818a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.992+0000 7f8aab7fe640 1 -- 172.21.15.87:0/1827979849 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557dd8180730 msgr2=0x557dd8187d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:09.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.992+0000 7f8aab7fe640 1 --2- 172.21.15.87:0/1827979849 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557dd8180730 0x557dd8187d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.992+0000 7f8aab7fe640 1 -- 172.21.15.87:0/1827979849 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aac10c330 con 0x557dd818afd0 2024-09-13T17:17:09.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.992+0000 7f8aaaffd640 1 --2- 172.21.15.87:0/1827979849 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557dd8180730 0x557dd8187d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:09.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.992+0000 7f8aab7fe640 1 --2- 172.21.15.87:0/1827979849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557dd818afd0 0x557dd8188330 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4004280 tx=0x7f8aa4003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=671fd3d31899e604 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:09.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.992+0000 7f8a927fc640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:17:09.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.993+0000 7f8a927fc640 1 -- 172.21.15.87:0/1827979849 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4031a70 con 0x557dd818afd0 2024-09-13T17:17:09.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.993+0000 7f8a927fc640 1 -- 172.21.15.87:0/1827979849 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f8aa4030870 con 0x557dd818afd0 2024-09-13T17:17:09.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.993+0000 7f8ab40c6740 1 -- 172.21.15.87:0/1827979849 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557dd7dd74e0 con 0x557dd818afd0 2024-09-13T17:17:09.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.993+0000 7f8a927fc640 1 -- 172.21.15.87:0/1827979849 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8aa40042b0 con 0x557dd818afd0 2024-09-13T17:17:09.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.993+0000 7f8ab40c6740 10 client.16581 fetch_fsmap learned FSMap version 30 2024-09-13T17:17:09.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.993+0000 7f8ab40c6740 1 -- 172.21.15.87:0/1827979849 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x557dd80e2620 con 0x557dd818afd0 2024-09-13T17:17:09.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.993+0000 7f8a927fc640 1 -- 172.21.15.87:0/1827979849 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x557dd7dd74e0 con 0x557dd818afd0 2024-09-13T17:17:09.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.993+0000 7f8a927fc640 1 -- 172.21.15.87:0/1827979849 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f8aa404bac0 con 0x557dd818afd0 2024-09-13T17:17:09.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.993+0000 7f8ab40c6740 10 client.16581 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:17:09.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.993+0000 7f8ab40c6740 10 client.16581 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:17:09.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.993+0000 7f8ab40c6740 20 client.16581 populate_metadata read hostname 'smithi087' 2024-09-13T17:17:09.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.993+0000 7f8ab40c6740 1 --2- 172.21.15.87:0/1827979849 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x557dd819ab40 0x557dd819cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.993+0000 7f8ab40c6740 4 client.16581 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:17:09.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.993+0000 7f8ab40c6740 1 -- 172.21.15.87:0/1827979849 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557dd7de87e0 con 0x557dd819ab40 2024-09-13T17:17:09.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.994+0000 7f8aaaffd640 1 --2- 172.21.15.87:0/1827979849 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x557dd819ab40 0x557dd819cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.994+0000 7f8a927fc640 10 client.16581 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:17:09.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.994+0000 7f8aaaffd640 1 --2- 172.21.15.87:0/1827979849 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x557dd819ab40 0x557dd819cf60 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f80a6633055c7b3 server_cookie=8981481d6748499e in_seq=0 out_seq=0 2024-09-13T17:17:09.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.995+0000 7f8a927fc640 1 -- 172.21.15.87:0/1827979849 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x557dd7de87e0 con 0x557dd819ab40 2024-09-13T17:17:09.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.995+0000 7f8a927fc640 10 client.16581 handle_command_reply: tid=0 2024-09-13T17:17:09.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.995+0000 7f8ab40c6740 1 client.16581 shutdown 2024-09-13T17:17:09.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.995+0000 7f8ab40c6740 1 -- 172.21.15.87:0/1827979849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557dd818afd0 msgr2=0x557dd8188330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.995+0000 7f8ab40c6740 1 --2- 172.21.15.87:0/1827979849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557dd818afd0 0x557dd8188330 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4004280 tx=0x7f8aa4003bd0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.995+0000 7f8ab40c6740 1 -- 172.21.15.87:0/1827979849 shutdown_connections 2024-09-13T17:17:09.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.995+0000 7f8ab40c6740 1 --2- 172.21.15.87:0/1827979849 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x557dd819ab40 0x557dd819cf60 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.995+0000 7f8ab40c6740 1 --2- 172.21.15.87:0/1827979849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557dd818afd0 0x557dd8188330 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.995+0000 7f8ab40c6740 1 --2- 172.21.15.87:0/1827979849 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557dd8180730 0x557dd8187d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.995+0000 7f8a927fc640 0 client.16581 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:17:09.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.995+0000 7f8ab40c6740 1 --2- 172.21.15.87:0/1827979849 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dd817fe10 0x557dd818a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.995+0000 7f8ab40c6740 1 -- 172.21.15.87:0/1827979849 >> 172.21.15.87:0/1827979849 conn(0x557dd817c380 msgr2=0x557dd8182090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:09.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.995+0000 7f8ab40c6740 1 -- 172.21.15.87:0/1827979849 shutdown_connections 2024-09-13T17:17:09.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.995+0000 7f8ab40c6740 1 -- 172.21.15.87:0/1827979849 wait complete. 2024-09-13T17:17:09.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:08.995+0000 7f8ab40c6740 20 client.16581 trim_cache size 0 max 16384 2024-09-13T17:17:09.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.009+0000 7f8ab40c6740 1 Processor -- start 2024-09-13T17:17:09.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.009+0000 7f8ab40c6740 1 -- start start 2024-09-13T17:17:09.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.009+0000 7f8ab40c6740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557dd817fe10 0x557dd81a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.009+0000 7f8ab40c6740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dd8180730 0x557dd8182fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.009+0000 7f8ab40c6740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557dd818afd0 0x557dd8183510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.009+0000 7f8ab40c6740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dd8197520 con 0x557dd818afd0 2024-09-13T17:17:09.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.009+0000 7f8ab40c6740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dd7dd74e0 con 0x557dd817fe10 2024-09-13T17:17:09.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.009+0000 7f8ab40c6740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dd8189140 con 0x557dd8180730 2024-09-13T17:17:09.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.009+0000 7f8aab7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557dd818afd0 0x557dd8183510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.009+0000 7f8aab7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557dd818afd0 0x557dd8183510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45750/0 (socket says 172.21.15.87:45750) 2024-09-13T17:17:09.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.009+0000 7f8aab7fe640 1 -- 172.21.15.87:0/2129544812 learned_addr learned my addr 172.21.15.87:0/2129544812 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:09.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.009+0000 7f8aab7fe640 1 -- 172.21.15.87:0/2129544812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dd8180730 msgr2=0x557dd8182fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:09.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.009+0000 7f8aab7fe640 1 --2- 172.21.15.87:0/2129544812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dd8180730 0x557dd8182fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.009+0000 7f8aab7fe640 1 -- 172.21.15.87:0/2129544812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557dd817fe10 msgr2=0x557dd81a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:09.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.009+0000 7f8aab7fe640 1 --2- 172.21.15.87:0/2129544812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557dd817fe10 0x557dd81a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.009+0000 7f8aab7fe640 1 -- 172.21.15.87:0/2129544812 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557dd8084790 con 0x557dd818afd0 2024-09-13T17:17:09.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.010+0000 7f8aab7fe640 1 --2- 172.21.15.87:0/2129544812 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557dd818afd0 0x557dd8183510 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f8aa402aed0 tx=0x7f8aa4009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d6c9e15b661b41 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:09.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.010+0000 7f8aa1ffb640 1 -- 172.21.15.87:0/2129544812 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4003970 con 0x557dd818afd0 2024-09-13T17:17:09.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.010+0000 7f8aa1ffb640 1 -- 172.21.15.87:0/2129544812 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8aa4030c70 con 0x557dd818afd0 2024-09-13T17:17:09.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.010+0000 7f8aa1ffb640 1 -- 172.21.15.87:0/2129544812 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa403b6f0 con 0x557dd818afd0 2024-09-13T17:17:09.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.010+0000 7f8ab40c6740 1 -- 172.21.15.87:0/2129544812 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557dd818afd0 msgr2=0x557dd8183510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.010+0000 7f8ab40c6740 1 --2- 172.21.15.87:0/2129544812 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557dd818afd0 0x557dd8183510 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f8aa402aed0 tx=0x7f8aa4009800 comp rx=0 tx=0).stop 2024-09-13T17:17:09.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.010+0000 7f8ab40c6740 1 -- 172.21.15.87:0/2129544812 shutdown_connections 2024-09-13T17:17:09.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.010+0000 7f8ab40c6740 1 --2- 172.21.15.87:0/2129544812 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557dd818afd0 0x557dd8183510 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.010+0000 7f8ab40c6740 1 --2- 172.21.15.87:0/2129544812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dd8180730 0x557dd8182fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.011+0000 7f8ab40c6740 1 --2- 172.21.15.87:0/2129544812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557dd817fe10 0x557dd81a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.011+0000 7f8ab40c6740 1 -- 172.21.15.87:0/2129544812 >> 172.21.15.87:0/2129544812 conn(0x557dd817c380 msgr2=0x557dd817c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:09.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.011+0000 7f8ab40c6740 1 -- 172.21.15.87:0/2129544812 shutdown_connections 2024-09-13T17:17:09.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.011+0000 7f8ab40c6740 1 -- 172.21.15.87:0/2129544812 wait complete. 2024-09-13T17:17:09.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.011+0000 7f8ab40c6740 1 -- start start 2024-09-13T17:17:09.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.011+0000 7f8ab40c6740 1 Processor -- start 2024-09-13T17:17:09.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.011+0000 7f8ab40c6740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557dd817fe10 0x557dd818dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.011+0000 7f8ab40c6740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dd8180730 0x557dd818e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.011+0000 7f8ab40c6740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557dd818afd0 0x557dd818e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.011+0000 7f8ab40c6740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dd81f0030 con 0x557dd817fe10 2024-09-13T17:17:09.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.011+0000 7f8ab40c6740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dd81f0170 con 0x557dd818afd0 2024-09-13T17:17:09.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.011+0000 7f8ab40c6740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dd81f02b0 con 0x557dd8180730 2024-09-13T17:17:09.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.011+0000 7f8ab40c6740 10 client.0 _ll_register_callbacks cb 0x7f8aa4030bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:17:09.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.011+0000 7f8aab7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557dd817fe10 0x557dd818dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.011+0000 7f8aab7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557dd817fe10 0x557dd818dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45758/0 (socket says 172.21.15.87:45758) 2024-09-13T17:17:09.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.011+0000 7f8aab7fe640 1 -- 172.21.15.87:0/572067169 learned_addr learned my addr 172.21.15.87:0/572067169 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:09.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.012+0000 7f8aab7fe640 1 -- 172.21.15.87:0/572067169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dd8180730 msgr2=0x557dd818e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:09.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.012+0000 7f8aab7fe640 1 --2- 172.21.15.87:0/572067169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dd8180730 0x557dd818e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.012+0000 7f8aab7fe640 1 -- 172.21.15.87:0/572067169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557dd818afd0 msgr2=0x557dd818e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:09.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.012+0000 7f8aab7fe640 1 --2- 172.21.15.87:0/572067169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557dd818afd0 0x557dd818e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.012+0000 7f8aab7fe640 1 -- 172.21.15.87:0/572067169 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557dd80e2620 con 0x557dd817fe10 2024-09-13T17:17:09.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.012+0000 7f8aab7fe640 1 --2- 172.21.15.87:0/572067169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557dd817fe10 0x557dd818dd40 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4003dc0 tx=0x7f8aa4003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f31e089ea53e451 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:09.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.012+0000 7f8a927fc640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:17:09.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.012+0000 7f8a927fc640 1 -- 172.21.15.87:0/572067169 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4004280 con 0x557dd817fe10 2024-09-13T17:17:09.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.012+0000 7f8a927fc640 1 -- 172.21.15.87:0/572067169 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f8aa40043e0 con 0x557dd817fe10 2024-09-13T17:17:09.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.012+0000 7f8ab40c6740 1 -- 172.21.15.87:0/572067169 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8aa4031d20 con 0x557dd817fe10 2024-09-13T17:17:09.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.012+0000 7f8a927fc640 1 -- 172.21.15.87:0/572067169 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8aa4031870 con 0x557dd817fe10 2024-09-13T17:17:09.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.012+0000 7f8ab40c6740 10 client.16587 fetch_fsmap learned FSMap version 30 2024-09-13T17:17:09.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.012+0000 7f8ab40c6740 1 -- 172.21.15.87:0/572067169 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x557dd80a9ea0 con 0x557dd817fe10 2024-09-13T17:17:09.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.012+0000 7f8a927fc640 1 -- 172.21.15.87:0/572067169 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8aa4031d20 con 0x557dd817fe10 2024-09-13T17:17:09.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.012+0000 7f8a927fc640 1 -- 172.21.15.87:0/572067169 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f8aa404b460 con 0x557dd817fe10 2024-09-13T17:17:09.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.012+0000 7f8ab40c6740 10 client.16587 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:17:09.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.012+0000 7f8ab40c6740 10 client.16587 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:17:09.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.012+0000 7f8ab40c6740 20 client.16587 populate_metadata read hostname 'smithi087' 2024-09-13T17:17:09.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.012+0000 7f8ab40c6740 1 --2- 172.21.15.87:0/572067169 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x557dd819ab40 0x557dd81f3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.012+0000 7f8ab40c6740 4 client.16587 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:17:09.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.012+0000 7f8ab40c6740 1 -- 172.21.15.87:0/572067169 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557dd7e3be30 con 0x557dd819ab40 2024-09-13T17:17:09.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.013+0000 7f8aaaffd640 1 --2- 172.21.15.87:0/572067169 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x557dd819ab40 0x557dd81f3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.013+0000 7f8aaaffd640 1 --2- 172.21.15.87:0/572067169 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x557dd819ab40 0x557dd81f3540 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55abada81d7e8909 server_cookie=c289969023d48da9 in_seq=0 out_seq=0 2024-09-13T17:17:09.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.013+0000 7f8a927fc640 10 client.16587 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:17:09.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.013+0000 7f8a927fc640 1 -- 172.21.15.87:0/572067169 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x557dd7e3be30 con 0x557dd819ab40 2024-09-13T17:17:09.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.013+0000 7f8a927fc640 10 client.16587 handle_command_reply: tid=0 2024-09-13T17:17:09.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.013+0000 7f8ab40c6740 1 client.16587 shutdown 2024-09-13T17:17:09.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.013+0000 7f8ab40c6740 1 -- 172.21.15.87:0/572067169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557dd817fe10 msgr2=0x557dd818dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.013+0000 7f8ab40c6740 1 --2- 172.21.15.87:0/572067169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557dd817fe10 0x557dd818dd40 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4003dc0 tx=0x7f8aa4003c20 comp rx=0 tx=0).stop 2024-09-13T17:17:09.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.013+0000 7f8ab40c6740 1 -- 172.21.15.87:0/572067169 shutdown_connections 2024-09-13T17:17:09.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.013+0000 7f8ab40c6740 1 --2- 172.21.15.87:0/572067169 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x557dd819ab40 0x557dd81f3540 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.013+0000 7f8ab40c6740 1 --2- 172.21.15.87:0/572067169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557dd818afd0 0x557dd818e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.013+0000 7f8a927fc640 0 client.16587 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:17:09.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.013+0000 7f8ab40c6740 1 --2- 172.21.15.87:0/572067169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557dd8180730 0x557dd818e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.013+0000 7f8ab40c6740 1 --2- 172.21.15.87:0/572067169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557dd817fe10 0x557dd818dd40 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.013+0000 7f8ab40c6740 1 -- 172.21.15.87:0/572067169 >> 172.21.15.87:0/572067169 conn(0x557dd817c380 msgr2=0x557dd817c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:09.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.014+0000 7f8ab40c6740 1 -- 172.21.15.87:0/572067169 shutdown_connections 2024-09-13T17:17:09.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.014+0000 7f8ab40c6740 1 -- 172.21.15.87:0/572067169 wait complete. 2024-09-13T17:17:09.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.014+0000 7f8ab40c6740 20 client.16587 trim_cache size 0 max 16384 2024-09-13T17:17:09.021 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:17:09.022 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "no active scrubs running", 2024-09-13T17:17:09.022 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": {} 2024-09-13T17:17:09.022 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:17:09.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.014+0000 7f8ab139c640 1 -- 172.21.15.87:0/4170364345 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8a980a1200 msgr2=0x7f8a980a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.014+0000 7f8ab139c640 1 --2- 172.21.15.87:0/4170364345 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8a980a1200 0x7f8a980a36c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8a94009fd0 tx=0x7f8a940047d0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.014+0000 7f8ab139c640 1 -- 172.21.15.87:0/4170364345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8aac103fa0 msgr2=0x7f8aac197760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.014+0000 7f8ab139c640 1 --2- 172.21.15.87:0/4170364345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8aac103fa0 0x7f8aac197760 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f8a9400b450 tx=0x7f8a9400b910 comp rx=0 tx=0).stop 2024-09-13T17:17:09.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.014+0000 7f8ab139c640 1 -- 172.21.15.87:0/4170364345 shutdown_connections 2024-09-13T17:17:09.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.014+0000 7f8ab139c640 1 --2- 172.21.15.87:0/4170364345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8aac197d40 0x7f8aac1a22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.014+0000 7f8ab139c640 1 --2- 172.21.15.87:0/4170364345 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8a980a1200 0x7f8a980a36c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.014+0000 7f8ab139c640 1 --2- 172.21.15.87:0/4170364345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8aac103fa0 0x7f8aac197760 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.014+0000 7f8ab139c640 1 --2- 172.21.15.87:0/4170364345 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8aac0fee50 0x7f8aac197220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.014+0000 7f8ab139c640 1 -- 172.21.15.87:0/4170364345 >> 172.21.15.87:0/4170364345 conn(0x7f8aac0fa8c0 msgr2=0x7f8aac0fbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:09.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.014+0000 7f8ab139c640 1 -- 172.21.15.87:0/4170364345 shutdown_connections 2024-09-13T17:17:09.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.014+0000 7f8ab139c640 1 -- 172.21.15.87:0/4170364345 wait complete. 2024-09-13T17:17:09.026 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T17:17:09.026 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:17:09.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.124+0000 7f7d78212640 1 -- 172.21.15.87:0/959143337 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d700ff5e0 msgr2=0x7f7d70103aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.124+0000 7f7d78212640 1 --2- 172.21.15.87:0/959143337 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d700ff5e0 0x7f7d70103aa0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f7d60009960 tx=0x7f7d6002a4f0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.124+0000 7f7d78212640 1 -- 172.21.15.87:0/959143337 shutdown_connections 2024-09-13T17:17:09.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.124+0000 7f7d78212640 1 --2- 172.21.15.87:0/959143337 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d701040f0 0x7f7d701045a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.124+0000 7f7d78212640 1 --2- 172.21.15.87:0/959143337 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d700ff5e0 0x7f7d70103aa0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.124+0000 7f7d78212640 1 --2- 172.21.15.87:0/959143337 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d700fecc0 0x7f7d700ff0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.124+0000 7f7d78212640 1 -- 172.21.15.87:0/959143337 >> 172.21.15.87:0/959143337 conn(0x7f7d700fa920 msgr2=0x7f7d700fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:09.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.124+0000 7f7d78212640 1 -- 172.21.15.87:0/959143337 shutdown_connections 2024-09-13T17:17:09.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.124+0000 7f7d78212640 1 -- 172.21.15.87:0/959143337 wait complete. 2024-09-13T17:17:09.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.125+0000 7f7d78212640 1 Processor -- start 2024-09-13T17:17:09.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.125+0000 7f7d78212640 1 -- start start 2024-09-13T17:17:09.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.125+0000 7f7d78212640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d700fecc0 0x7f7d701a2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.125+0000 7f7d78212640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d700ff5e0 0x7f7d701a2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.125+0000 7f7d78212640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d701040f0 0x7f7d7019c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.125+0000 7f7d78212640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7019cee0 con 0x7f7d700fecc0 2024-09-13T17:17:09.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.125+0000 7f7d78212640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7019d050 con 0x7f7d700ff5e0 2024-09-13T17:17:09.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.125+0000 7f7d78212640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7019d210 con 0x7f7d701040f0 2024-09-13T17:17:09.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.125+0000 7f7d75fae640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d700fecc0 0x7f7d701a2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.125+0000 7f7d75fae640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d700fecc0 0x7f7d701a2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49078/0 (socket says 172.21.15.87:49078) 2024-09-13T17:17:09.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.125+0000 7f7d75fae640 1 -- 172.21.15.87:0/3069825759 learned_addr learned my addr 172.21.15.87:0/3069825759 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:09.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.125+0000 7f7d767af640 1 --2- 172.21.15.87:0/3069825759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d701040f0 0x7f7d7019c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.125+0000 7f7d75fae640 1 -- 172.21.15.87:0/3069825759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d701040f0 msgr2=0x7f7d7019c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.125+0000 7f7d757ad640 1 --2- 172.21.15.87:0/3069825759 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d700ff5e0 0x7f7d701a2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.125+0000 7f7d75fae640 1 --2- 172.21.15.87:0/3069825759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d701040f0 0x7f7d7019c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.125+0000 7f7d75fae640 1 -- 172.21.15.87:0/3069825759 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d700ff5e0 msgr2=0x7f7d701a2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.125+0000 7f7d75fae640 1 --2- 172.21.15.87:0/3069825759 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d700ff5e0 0x7f7d701a2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.125+0000 7f7d75fae640 1 -- 172.21.15.87:0/3069825759 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d60009560 con 0x7f7d700fecc0 2024-09-13T17:17:09.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.126+0000 7f7d75fae640 1 --2- 172.21.15.87:0/3069825759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d700fecc0 0x7f7d701a2670 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c00d950 tx=0x7f7d6c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:09.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.126+0000 7f7d66ffd640 1 -- 172.21.15.87:0/3069825759 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c009a30 con 0x7f7d700fecc0 2024-09-13T17:17:09.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.126+0000 7f7d66ffd640 1 -- 172.21.15.87:0/3069825759 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7d6c0044d0 con 0x7f7d700fecc0 2024-09-13T17:17:09.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.126+0000 7f7d78212640 1 -- 172.21.15.87:0/3069825759 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d7019d4f0 con 0x7f7d700fecc0 2024-09-13T17:17:09.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.126+0000 7f7d66ffd640 1 -- 172.21.15.87:0/3069825759 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c0047a0 con 0x7f7d700fecc0 2024-09-13T17:17:09.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.126+0000 7f7d78212640 1 -- 172.21.15.87:0/3069825759 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d701a9660 con 0x7f7d700fecc0 2024-09-13T17:17:09.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.127+0000 7f7d78212640 1 -- 172.21.15.87:0/3069825759 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d70068ef0 con 0x7f7d700fecc0 2024-09-13T17:17:09.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.128+0000 7f7d66ffd640 1 -- 172.21.15.87:0/3069825759 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f7d6c009b90 con 0x7f7d700fecc0 2024-09-13T17:17:09.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.128+0000 7f7d66ffd640 1 --2- 172.21.15.87:0/3069825759 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7d5c0a1280 0x7f7d5c0a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.128+0000 7f7d757ad640 1 --2- 172.21.15.87:0/3069825759 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7d5c0a1280 0x7f7d5c0a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.128+0000 7f7d66ffd640 1 -- 172.21.15.87:0/3069825759 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f7d6c0ccaf0 con 0x7f7d700fecc0 2024-09-13T17:17:09.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.129+0000 7f7d757ad640 1 --2- 172.21.15.87:0/3069825759 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7d5c0a1280 0x7f7d5c0a3740 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7d6002aa10 tx=0x7f7d60005fd0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:09.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.133+0000 7f7d66ffd640 1 -- 172.21.15.87:0/3069825759 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7d6c095b90 con 0x7f7d700fecc0 2024-09-13T17:17:09.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.329+0000 7f7d78212640 1 -- 172.21.15.87:0/3069825759 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d7019dc60 con 0x7f7d700fecc0 2024-09-13T17:17:09.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.330+0000 7f7d66ffd640 1 -- 172.21.15.87:0/3069825759 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+10886 (secure 0 0 0) 0x7f7d6c0991b0 con 0x7f7d700fecc0 2024-09-13T17:17:09.331 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:17:09.331 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/3674545180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":3674545180},{"type":"v1","addr":"172.21.15.87:6841","nonce":3674545180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:11:23.313609+0000","modified":"2024-09-13T17:16:22.516744+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24484,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6839/3052680456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3052680456},{"type":"v1","addr":"172.21.15.118:6839","nonce":3052680456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:17:09.331 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 30 2024-09-13T17:17:09.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.332+0000 7f7d78212640 1 -- 172.21.15.87:0/3069825759 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7d5c0a1280 msgr2=0x7f7d5c0a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.332+0000 7f7d78212640 1 --2- 172.21.15.87:0/3069825759 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7d5c0a1280 0x7f7d5c0a3740 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7d6002aa10 tx=0x7f7d60005fd0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.332+0000 7f7d78212640 1 -- 172.21.15.87:0/3069825759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d700fecc0 msgr2=0x7f7d701a2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.332+0000 7f7d78212640 1 --2- 172.21.15.87:0/3069825759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d700fecc0 0x7f7d701a2670 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c00d950 tx=0x7f7d6c00de10 comp rx=0 tx=0).stop 2024-09-13T17:17:09.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.332+0000 7f7d78212640 1 -- 172.21.15.87:0/3069825759 shutdown_connections 2024-09-13T17:17:09.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.332+0000 7f7d78212640 1 --2- 172.21.15.87:0/3069825759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d701040f0 0x7f7d7019c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.332+0000 7f7d78212640 1 --2- 172.21.15.87:0/3069825759 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d700ff5e0 0x7f7d701a2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.332+0000 7f7d78212640 1 --2- 172.21.15.87:0/3069825759 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7d5c0a1280 0x7f7d5c0a3740 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.332+0000 7f7d78212640 1 --2- 172.21.15.87:0/3069825759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d700fecc0 0x7f7d701a2670 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.332+0000 7f7d78212640 1 -- 172.21.15.87:0/3069825759 >> 172.21.15.87:0/3069825759 conn(0x7f7d700fa920 msgr2=0x7f7d700fbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:09.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.332+0000 7f7d78212640 1 -- 172.21.15.87:0/3069825759 shutdown_connections 2024-09-13T17:17:09.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.332+0000 7f7d78212640 1 -- 172.21.15.87:0/3069825759 wait complete. 2024-09-13T17:17:09.344 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-09-13T17:17:09.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.445+0000 7fde007ae640 1 -- 172.21.15.87:0/3297862967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddf8100920 msgr2=0x7fddf8104960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.445+0000 7fde007ae640 1 --2- 172.21.15.87:0/3297862967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddf8100920 0x7fddf8104960 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fddec009930 tx=0x7fddec02a420 comp rx=0 tx=0).stop 2024-09-13T17:17:09.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.445+0000 7fde007ae640 1 -- 172.21.15.87:0/3297862967 shutdown_connections 2024-09-13T17:17:09.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.445+0000 7fde007ae640 1 --2- 172.21.15.87:0/3297862967 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fddf81050c0 0x7fddf810cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.445+0000 7fde007ae640 1 --2- 172.21.15.87:0/3297862967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddf8100920 0x7fddf8104960 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.445+0000 7fde007ae640 1 --2- 172.21.15.87:0/3297862967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddf80fff70 0x7fddf8100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.445+0000 7fde007ae640 1 -- 172.21.15.87:0/3297862967 >> 172.21.15.87:0/3297862967 conn(0x7fddf80fba20 msgr2=0x7fddf80fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:09.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.445+0000 7fde007ae640 1 -- 172.21.15.87:0/3297862967 shutdown_connections 2024-09-13T17:17:09.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.445+0000 7fde007ae640 1 -- 172.21.15.87:0/3297862967 wait complete. 2024-09-13T17:17:09.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.445+0000 7fde007ae640 1 Processor -- start 2024-09-13T17:17:09.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.445+0000 7fde007ae640 1 -- start start 2024-09-13T17:17:09.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.445+0000 7fde007ae640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddf80fff70 0x7fddf8196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.446+0000 7fde007ae640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddf81050c0 0x7fddf8196880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.446+0000 7fde007ae640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fddf819ac70 0x7fddf819b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.446+0000 7fde007ae640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf819b660 con 0x7fddf80fff70 2024-09-13T17:17:09.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.446+0000 7fde007ae640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf819b7d0 con 0x7fddf81050c0 2024-09-13T17:17:09.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.446+0000 7fde007ae640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf819b940 con 0x7fddf819ac70 2024-09-13T17:17:09.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.446+0000 7fddfe54a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddf80fff70 0x7fddf8196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.446+0000 7fddfe54a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddf80fff70 0x7fddf8196340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49086/0 (socket says 172.21.15.87:49086) 2024-09-13T17:17:09.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.446+0000 7fddfe54a640 1 -- 172.21.15.87:0/957489906 learned_addr learned my addr 172.21.15.87:0/957489906 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:09.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.446+0000 7fddfdd49640 1 --2- 172.21.15.87:0/957489906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddf81050c0 0x7fddf8196880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.446+0000 7fddfed4b640 1 --2- 172.21.15.87:0/957489906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fddf819ac70 0x7fddf819b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.446+0000 7fddfe54a640 1 -- 172.21.15.87:0/957489906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fddf819ac70 msgr2=0x7fddf819b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.446+0000 7fddfe54a640 1 --2- 172.21.15.87:0/957489906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fddf819ac70 0x7fddf819b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.446+0000 7fddfe54a640 1 -- 172.21.15.87:0/957489906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddf81050c0 msgr2=0x7fddf8196880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.446+0000 7fddfe54a640 1 --2- 172.21.15.87:0/957489906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddf81050c0 0x7fddf8196880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.446+0000 7fddfe54a640 1 -- 172.21.15.87:0/957489906 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddec009560 con 0x7fddf80fff70 2024-09-13T17:17:09.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.446+0000 7fddfed4b640 1 --2- 172.21.15.87:0/957489906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fddf819ac70 0x7fddf819b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:09.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.446+0000 7fddfe54a640 1 --2- 172.21.15.87:0/957489906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddf80fff70 0x7fddf8196340 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fdde800cce0 tx=0x7fdde800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:09.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.446+0000 7fddf77fe640 1 -- 172.21.15.87:0/957489906 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde8004b20 con 0x7fddf80fff70 2024-09-13T17:17:09.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.446+0000 7fddf77fe640 1 -- 172.21.15.87:0/957489906 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdde8004c80 con 0x7fddf80fff70 2024-09-13T17:17:09.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.446+0000 7fddf77fe640 1 -- 172.21.15.87:0/957489906 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde800f6b0 con 0x7fddf80fff70 2024-09-13T17:17:09.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.446+0000 7fde007ae640 1 -- 172.21.15.87:0/957489906 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf81a2f20 con 0x7fddf80fff70 2024-09-13T17:17:09.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.446+0000 7fde007ae640 1 -- 172.21.15.87:0/957489906 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf81a32f0 con 0x7fddf80fff70 2024-09-13T17:17:09.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.448+0000 7fddf77fe640 1 -- 172.21.15.87:0/957489906 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fdde800f810 con 0x7fddf80fff70 2024-09-13T17:17:09.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.449+0000 7fde034ce740 1 Processor -- start 2024-09-13T17:17:09.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.449+0000 7fde034ce740 1 -- start start 2024-09-13T17:17:09.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.449+0000 7fde034ce740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5644a72cb790 0x5644a72cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.449+0000 7fde034ce740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5644a72cc0b0 0x5644a72d6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.449+0000 7fde034ce740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5644a72d6950 0x5644a72d8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.449+0000 7fde034ce740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a7235cc0 con 0x5644a72cb790 2024-09-13T17:17:09.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.449+0000 7fde034ce740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a7233450 con 0x5644a72d6950 2024-09-13T17:17:09.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.449+0000 7fde034ce740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a722ed40 con 0x5644a72cc0b0 2024-09-13T17:17:09.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.449+0000 7fddfed4b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5644a72cb790 0x5644a72cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.449+0000 7fddfed4b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5644a72cb790 0x5644a72cbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49088/0 (socket says 172.21.15.87:49088) 2024-09-13T17:17:09.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.449+0000 7fddfed4b640 1 -- 172.21.15.87:0/3877891893 learned_addr learned my addr 172.21.15.87:0/3877891893 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:09.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.450+0000 7fddf77fe640 1 --2- 172.21.15.87:0/957489906 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdde00a1200 0x7fdde00a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.450+0000 7fddfdd49640 1 --2- 172.21.15.87:0/3877891893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5644a72d6950 0x5644a72d8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.450+0000 7fddfe54a640 1 --2- 172.21.15.87:0/3877891893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5644a72cc0b0 0x5644a72d6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.450+0000 7fddfed4b640 1 --2- 172.21.15.87:0/957489906 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdde00a1200 0x7fdde00a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.450+0000 7fddfed4b640 1 -- 172.21.15.87:0/3877891893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5644a72cc0b0 msgr2=0x5644a72d6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:09.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.450+0000 7fddfed4b640 1 --2- 172.21.15.87:0/3877891893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5644a72cc0b0 0x5644a72d6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.450+0000 7fddfed4b640 1 -- 172.21.15.87:0/3877891893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5644a72d6950 msgr2=0x5644a72d8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:09.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.450+0000 7fddfed4b640 1 --2- 172.21.15.87:0/3877891893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5644a72d6950 0x5644a72d8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.450+0000 7fddfed4b640 1 -- 172.21.15.87:0/3877891893 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644a71f6620 con 0x5644a72cb790 2024-09-13T17:17:09.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.450+0000 7fddfdd49640 1 --2- 172.21.15.87:0/3877891893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5644a72d6950 0x5644a72d8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:17:09.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.450+0000 7fddf77fe640 1 -- 172.21.15.87:0/957489906 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fdde80cd170 con 0x7fddf80fff70 2024-09-13T17:17:09.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.450+0000 7fddfed4b640 1 --2- 172.21.15.87:0/3877891893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5644a72cb790 0x5644a72cbb70 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fddf00133b0 tx=0x7fddf0013870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a78bbd2b7034aa20 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:09.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.450+0000 7fddf4ff9640 1 -- 172.21.15.87:0/3877891893 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf0023070 con 0x5644a72cb790 2024-09-13T17:17:09.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.450+0000 7fddfed4b640 1 --2- 172.21.15.87:0/957489906 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdde00a1200 0x7fdde00a36c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fddf001e000 tx=0x7fddf001c000 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:09.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.450+0000 7fddf4ff9640 1 -- 172.21.15.87:0/3877891893 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fddf000c030 con 0x5644a72cb790 2024-09-13T17:17:09.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.450+0000 7fddf4ff9640 1 -- 172.21.15.87:0/3877891893 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf0016db0 con 0x5644a72cb790 2024-09-13T17:17:09.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.451+0000 7fde034ce740 1 -- 172.21.15.87:0/3877891893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5644a72cb790 msgr2=0x5644a72cbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.451+0000 7fde034ce740 1 --2- 172.21.15.87:0/3877891893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5644a72cb790 0x5644a72cbb70 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fddf00133b0 tx=0x7fddf0013870 comp rx=0 tx=0).stop 2024-09-13T17:17:09.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.451+0000 7fde034ce740 1 -- 172.21.15.87:0/3877891893 shutdown_connections 2024-09-13T17:17:09.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.451+0000 7fde034ce740 1 --2- 172.21.15.87:0/3877891893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5644a72d6950 0x5644a72d8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.451+0000 7fde034ce740 1 --2- 172.21.15.87:0/3877891893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5644a72cc0b0 0x5644a72d6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.451+0000 7fde034ce740 1 --2- 172.21.15.87:0/3877891893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5644a72cb790 0x5644a72cbb70 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.451+0000 7fde034ce740 1 -- 172.21.15.87:0/3877891893 >> 172.21.15.87:0/3877891893 conn(0x5644a72c7d00 msgr2=0x5644a72c80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:09.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.451+0000 7fde034ce740 1 -- 172.21.15.87:0/3877891893 shutdown_connections 2024-09-13T17:17:09.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.451+0000 7fde034ce740 1 -- 172.21.15.87:0/3877891893 wait complete. 2024-09-13T17:17:09.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.451+0000 7fde034ce740 1 -- start start 2024-09-13T17:17:09.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.451+0000 7fde034ce740 1 Processor -- start 2024-09-13T17:17:09.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.452+0000 7fde034ce740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5644a72cb790 0x5644a72d5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.452+0000 7fde034ce740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5644a72cc0b0 0x5644a72d32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.452+0000 7fde034ce740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5644a72d6950 0x5644a72d3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.452+0000 7fde034ce740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a71ed180 con 0x5644a72d6950 2024-09-13T17:17:09.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.452+0000 7fde034ce740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a6f07430 con 0x5644a72cb790 2024-09-13T17:17:09.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.452+0000 7fde034ce740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a71b25e0 con 0x5644a72cc0b0 2024-09-13T17:17:09.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.452+0000 7fde034ce740 10 client.0 _ll_register_callbacks cb 0x5644a721eaa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:17:09.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.452+0000 7fddfed4b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5644a72d6950 0x5644a72d3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.452+0000 7fddfed4b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5644a72d6950 0x5644a72d3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49096/0 (socket says 172.21.15.87:49096) 2024-09-13T17:17:09.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.452+0000 7fddfed4b640 1 -- 172.21.15.87:0/435788305 learned_addr learned my addr 172.21.15.87:0/435788305 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:09.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.452+0000 7fddfe54a640 1 --2- 172.21.15.87:0/435788305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5644a72cb790 0x5644a72d5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.452+0000 7fddfdd49640 1 --2- 172.21.15.87:0/435788305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5644a72cc0b0 0x5644a72d32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.452+0000 7fddfed4b640 1 -- 172.21.15.87:0/435788305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5644a72cc0b0 msgr2=0x5644a72d32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:09.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.452+0000 7fddfed4b640 1 --2- 172.21.15.87:0/435788305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5644a72cc0b0 0x5644a72d32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.452+0000 7fddfed4b640 1 -- 172.21.15.87:0/435788305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5644a72cb790 msgr2=0x5644a72d5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:09.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.452+0000 7fddfed4b640 1 --2- 172.21.15.87:0/435788305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5644a72cb790 0x5644a72d5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.452+0000 7fddfed4b640 1 -- 172.21.15.87:0/435788305 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf000ace0 con 0x5644a72d6950 2024-09-13T17:17:09.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.452+0000 7fddfdd49640 1 --2- 172.21.15.87:0/435788305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5644a72cc0b0 0x5644a72d32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:09.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.452+0000 7fddfed4b640 1 --2- 172.21.15.87:0/435788305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5644a72d6950 0x5644a72d3830 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fddf0016b50 tx=0x7fddf0016d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea12ca6447036f24 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:09.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.452+0000 7fddddffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:17:09.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.452+0000 7fddddffb640 1 -- 172.21.15.87:0/435788305 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf0023040 con 0x5644a72d6950 2024-09-13T17:17:09.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.452+0000 7fddddffb640 1 -- 172.21.15.87:0/435788305 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fddf000a320 con 0x5644a72d6950 2024-09-13T17:17:09.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.452+0000 7fde034ce740 1 -- 172.21.15.87:0/435788305 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5644a7258b80 con 0x5644a72d6950 2024-09-13T17:17:09.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.453+0000 7fddddffb640 1 -- 172.21.15.87:0/435788305 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fddf0016810 con 0x5644a72d6950 2024-09-13T17:17:09.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.453+0000 7fde034ce740 10 client.16605 fetch_fsmap learned FSMap version 30 2024-09-13T17:17:09.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.453+0000 7fde034ce740 1 -- 172.21.15.87:0/435788305 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5644a722d3c0 con 0x5644a72d6950 2024-09-13T17:17:09.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.453+0000 7fddddffb640 1 -- 172.21.15.87:0/435788305 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x5644a7258b80 con 0x5644a72d6950 2024-09-13T17:17:09.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.453+0000 7fddddffb640 1 -- 172.21.15.87:0/435788305 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fddf0029770 con 0x5644a72d6950 2024-09-13T17:17:09.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.453+0000 7fde034ce740 10 client.16605 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:17:09.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.453+0000 7fde034ce740 10 client.16605 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:17:09.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.453+0000 7fde034ce740 20 client.16605 populate_metadata read hostname 'smithi087' 2024-09-13T17:17:09.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.453+0000 7fde034ce740 1 --2- 172.21.15.87:0/435788305 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x5644a72e62c0 0x5644a72e86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.453+0000 7fde034ce740 4 client.16605 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:17:09.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.453+0000 7fde034ce740 1 -- 172.21.15.87:0/435788305 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5644a72211f0 con 0x5644a72e62c0 2024-09-13T17:17:09.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.453+0000 7fddfe54a640 1 --2- 172.21.15.87:0/435788305 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x5644a72e62c0 0x5644a72e86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.454+0000 7fddddffb640 10 client.16605 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:17:09.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.454+0000 7fddfe54a640 1 --2- 172.21.15.87:0/435788305 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x5644a72e62c0 0x5644a72e86e0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5f556079bf0db9a7 server_cookie=720e2cb038f8f9c2 in_seq=0 out_seq=0 2024-09-13T17:17:09.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.454+0000 7fddddffb640 1 -- 172.21.15.87:0/435788305 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5644a72211f0 con 0x5644a72e62c0 2024-09-13T17:17:09.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.454+0000 7fddddffb640 10 client.16605 handle_command_reply: tid=0 2024-09-13T17:17:09.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.454+0000 7fde034ce740 1 client.16605 shutdown 2024-09-13T17:17:09.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.454+0000 7fde034ce740 1 -- 172.21.15.87:0/435788305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5644a72d6950 msgr2=0x5644a72d3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.454+0000 7fde034ce740 1 --2- 172.21.15.87:0/435788305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5644a72d6950 0x5644a72d3830 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fddf0016b50 tx=0x7fddf0016d30 comp rx=0 tx=0).stop 2024-09-13T17:17:09.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.454+0000 7fde034ce740 1 -- 172.21.15.87:0/435788305 shutdown_connections 2024-09-13T17:17:09.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.454+0000 7fde034ce740 1 --2- 172.21.15.87:0/435788305 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x5644a72e62c0 0x5644a72e86e0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.454+0000 7fde034ce740 1 --2- 172.21.15.87:0/435788305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5644a72d6950 0x5644a72d3830 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.454+0000 7fddddffb640 0 client.16605 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:17:09.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.454+0000 7fde034ce740 1 --2- 172.21.15.87:0/435788305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5644a72cc0b0 0x5644a72d32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.454+0000 7fde034ce740 1 --2- 172.21.15.87:0/435788305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5644a72cb790 0x5644a72d5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.454+0000 7fde034ce740 1 -- 172.21.15.87:0/435788305 >> 172.21.15.87:0/435788305 conn(0x5644a72c7d00 msgr2=0x5644a72c6eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:09.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.454+0000 7fde034ce740 1 -- 172.21.15.87:0/435788305 shutdown_connections 2024-09-13T17:17:09.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.454+0000 7fde034ce740 1 -- 172.21.15.87:0/435788305 wait complete. 2024-09-13T17:17:09.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.455+0000 7fde034ce740 20 client.16605 trim_cache size 0 max 16384 2024-09-13T17:17:09.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.465+0000 7fde034ce740 1 Processor -- start 2024-09-13T17:17:09.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.465+0000 7fde034ce740 1 -- start start 2024-09-13T17:17:09.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.465+0000 7fde034ce740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5644a72cb790 0x5644a72c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.465+0000 7fde034ce740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5644a72cc0b0 0x5644a72dd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.465+0000 7fde034ce740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5644a72d6950 0x5644a72ddb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.465+0000 7fde034ce740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a72d1820 con 0x5644a72cc0b0 2024-09-13T17:17:09.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.465+0000 7fde034ce740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a72c3440 con 0x5644a72d6950 2024-09-13T17:17:09.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.465+0000 7fde034ce740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a72ed860 con 0x5644a72cb790 2024-09-13T17:17:09.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.466+0000 7fddfdd49640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5644a72cc0b0 0x5644a72dd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.466+0000 7fddfdd49640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5644a72cc0b0 0x5644a72dd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49100/0 (socket says 172.21.15.87:49100) 2024-09-13T17:17:09.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.466+0000 7fddfdd49640 1 -- 172.21.15.87:0/1734961738 learned_addr learned my addr 172.21.15.87:0/1734961738 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:09.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.466+0000 7fddfe54a640 1 --2- 172.21.15.87:0/1734961738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5644a72cb790 0x5644a72c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.466+0000 7fddfdd49640 1 -- 172.21.15.87:0/1734961738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5644a72cb790 msgr2=0x5644a72c76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:09.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.466+0000 7fddfdd49640 1 --2- 172.21.15.87:0/1734961738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5644a72cb790 0x5644a72c76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.466+0000 7fddfdd49640 1 -- 172.21.15.87:0/1734961738 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5644a72d6950 msgr2=0x5644a72ddb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:09.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.466+0000 7fddfdd49640 1 --2- 172.21.15.87:0/1734961738 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5644a72d6950 0x5644a72ddb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.466+0000 7fddfdd49640 1 -- 172.21.15.87:0/1734961738 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644a71cf770 con 0x5644a72cc0b0 2024-09-13T17:17:09.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.466+0000 7fddfdd49640 1 --2- 172.21.15.87:0/1734961738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5644a72cc0b0 0x5644a72dd610 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fddec005760 tx=0x7fddec031ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeb58539e3a8f7c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:09.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.466+0000 7fddf57fa640 1 -- 172.21.15.87:0/1734961738 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec041070 con 0x5644a72cc0b0 2024-09-13T17:17:09.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.466+0000 7fddf57fa640 1 -- 172.21.15.87:0/1734961738 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fddec031bd0 con 0x5644a72cc0b0 2024-09-13T17:17:09.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.466+0000 7fddf57fa640 1 -- 172.21.15.87:0/1734961738 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec003850 con 0x5644a72cc0b0 2024-09-13T17:17:09.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.467+0000 7fde034ce740 1 -- 172.21.15.87:0/1734961738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5644a72cc0b0 msgr2=0x5644a72dd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.467+0000 7fde034ce740 1 --2- 172.21.15.87:0/1734961738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5644a72cc0b0 0x5644a72dd610 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fddec005760 tx=0x7fddec031ae0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.467+0000 7fde034ce740 1 -- 172.21.15.87:0/1734961738 shutdown_connections 2024-09-13T17:17:09.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.467+0000 7fde034ce740 1 --2- 172.21.15.87:0/1734961738 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5644a72d6950 0x5644a72ddb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.467+0000 7fde034ce740 1 --2- 172.21.15.87:0/1734961738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5644a72cc0b0 0x5644a72dd610 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.467+0000 7fde034ce740 1 --2- 172.21.15.87:0/1734961738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5644a72cb790 0x5644a72c76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.467+0000 7fde034ce740 1 -- 172.21.15.87:0/1734961738 >> 172.21.15.87:0/1734961738 conn(0x5644a72c7d00 msgr2=0x5644a72e20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:09.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.467+0000 7fde034ce740 1 -- 172.21.15.87:0/1734961738 shutdown_connections 2024-09-13T17:17:09.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.467+0000 7fde034ce740 1 -- 172.21.15.87:0/1734961738 wait complete. 2024-09-13T17:17:09.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.467+0000 7fde034ce740 1 -- start start 2024-09-13T17:17:09.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.467+0000 7fde034ce740 1 Processor -- start 2024-09-13T17:17:09.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.467+0000 7fde034ce740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5644a72cb790 0x5644a72dd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.467+0000 7fde034ce740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5644a72cc0b0 0x5644a72d9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.467+0000 7fde034ce740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5644a72d6950 0x5644a72da190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.467+0000 7fde034ce740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a72da860 con 0x5644a72cb790 2024-09-13T17:17:09.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.467+0000 7fde034ce740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a72da9d0 con 0x5644a72cc0b0 2024-09-13T17:17:09.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.467+0000 7fde034ce740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a733c7c0 con 0x5644a72d6950 2024-09-13T17:17:09.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.467+0000 7fde034ce740 10 client.0 _ll_register_callbacks cb 0x7fddf000a220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:17:09.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.467+0000 7fddfe54a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5644a72cb790 0x5644a72dd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.467+0000 7fddfe54a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5644a72cb790 0x5644a72dd8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49112/0 (socket says 172.21.15.87:49112) 2024-09-13T17:17:09.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.467+0000 7fddfe54a640 1 -- 172.21.15.87:0/3658163223 learned_addr learned my addr 172.21.15.87:0/3658163223 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:09.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.468+0000 7fddfed4b640 1 --2- 172.21.15.87:0/3658163223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5644a72d6950 0x5644a72da190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.468+0000 7fddfdd49640 1 --2- 172.21.15.87:0/3658163223 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5644a72cc0b0 0x5644a72d9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.468+0000 7fddfe54a640 1 -- 172.21.15.87:0/3658163223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5644a72d6950 msgr2=0x5644a72da190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:09.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.468+0000 7fddfe54a640 1 --2- 172.21.15.87:0/3658163223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5644a72d6950 0x5644a72da190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.468+0000 7fddfe54a640 1 -- 172.21.15.87:0/3658163223 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5644a72cc0b0 msgr2=0x5644a72d9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:09.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.468+0000 7fddfe54a640 1 --2- 172.21.15.87:0/3658163223 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5644a72cc0b0 0x5644a72d9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.468+0000 7fddfe54a640 1 -- 172.21.15.87:0/3658163223 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddec032d50 con 0x5644a72cb790 2024-09-13T17:17:09.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.468+0000 7fddfdd49640 1 --2- 172.21.15.87:0/3658163223 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5644a72cc0b0 0x5644a72d9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:09.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.468+0000 7fddfe54a640 1 --2- 172.21.15.87:0/3658163223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5644a72cb790 0x5644a72dd8d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fdde8000f80 tx=0x7fdde8099d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a4c0ed5a59a608 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:09.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.468+0000 7fddddffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:17:09.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.468+0000 7fddddffb640 1 -- 172.21.15.87:0/3658163223 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde80ca730 con 0x5644a72cb790 2024-09-13T17:17:09.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.468+0000 7fddddffb640 1 -- 172.21.15.87:0/3658163223 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fdde80ca890 con 0x5644a72cb790 2024-09-13T17:17:09.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.468+0000 7fde034ce740 1 -- 172.21.15.87:0/3658163223 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fddf000c030 con 0x5644a72cb790 2024-09-13T17:17:09.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.468+0000 7fddddffb640 1 -- 172.21.15.87:0/3658163223 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdde80b9be0 con 0x5644a72cb790 2024-09-13T17:17:09.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.468+0000 7fde034ce740 10 client.16611 fetch_fsmap learned FSMap version 30 2024-09-13T17:17:09.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.468+0000 7fde034ce740 1 -- 172.21.15.87:0/3658163223 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5644a71f4e80 con 0x5644a72cb790 2024-09-13T17:17:09.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.468+0000 7fddddffb640 1 -- 172.21.15.87:0/3658163223 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdde80b8030 con 0x5644a72cb790 2024-09-13T17:17:09.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.468+0000 7fddddffb640 1 -- 172.21.15.87:0/3658163223 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fdde8016030 con 0x5644a72cb790 2024-09-13T17:17:09.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.468+0000 7fde034ce740 10 client.16611 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:17:09.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.468+0000 7fde034ce740 10 client.16611 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:17:09.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.468+0000 7fde034ce740 20 client.16611 populate_metadata read hostname 'smithi087' 2024-09-13T17:17:09.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.469+0000 7fde034ce740 1 --2- 172.21.15.87:0/3658163223 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x5644a733dda0 0x5644a73401c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.469+0000 7fde034ce740 4 client.16611 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:17:09.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.469+0000 7fde034ce740 1 -- 172.21.15.87:0/3658163223 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5644a6f224e0 con 0x5644a733dda0 2024-09-13T17:17:09.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.469+0000 7fddfdd49640 1 --2- 172.21.15.87:0/3658163223 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x5644a733dda0 0x5644a73401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.469+0000 7fddfdd49640 1 --2- 172.21.15.87:0/3658163223 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x5644a733dda0 0x5644a73401c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5227ca9f1c3149d4 server_cookie=de2f738381d722e8 in_seq=0 out_seq=0 2024-09-13T17:17:09.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.469+0000 7fddddffb640 10 client.16611 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:17:09.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.469+0000 7fddddffb640 1 -- 172.21.15.87:0/3658163223 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5644a6f224e0 con 0x5644a733dda0 2024-09-13T17:17:09.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.469+0000 7fddddffb640 10 client.16611 handle_command_reply: tid=0 2024-09-13T17:17:09.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.469+0000 7fde034ce740 1 client.16611 shutdown 2024-09-13T17:17:09.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.469+0000 7fde034ce740 1 -- 172.21.15.87:0/3658163223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5644a72cb790 msgr2=0x5644a72dd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.469+0000 7fde034ce740 1 --2- 172.21.15.87:0/3658163223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5644a72cb790 0x5644a72dd8d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fdde8000f80 tx=0x7fdde8099d70 comp rx=0 tx=0).stop 2024-09-13T17:17:09.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.469+0000 7fde034ce740 1 -- 172.21.15.87:0/3658163223 shutdown_connections 2024-09-13T17:17:09.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.469+0000 7fde034ce740 1 --2- 172.21.15.87:0/3658163223 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x5644a733dda0 0x5644a73401c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.469+0000 7fde034ce740 1 --2- 172.21.15.87:0/3658163223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5644a72d6950 0x5644a72da190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.469+0000 7fde034ce740 1 --2- 172.21.15.87:0/3658163223 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5644a72cc0b0 0x5644a72d9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.469+0000 7fde034ce740 1 --2- 172.21.15.87:0/3658163223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5644a72cb790 0x5644a72dd8d0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.469+0000 7fddddffb640 0 client.16611 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:17:09.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.469+0000 7fde034ce740 1 -- 172.21.15.87:0/3658163223 >> 172.21.15.87:0/3658163223 conn(0x5644a72c7d00 msgr2=0x5644a72d1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:09.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.470+0000 7fde034ce740 1 -- 172.21.15.87:0/3658163223 shutdown_connections 2024-09-13T17:17:09.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.470+0000 7fde034ce740 1 -- 172.21.15.87:0/3658163223 wait complete. 2024-09-13T17:17:09.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.470+0000 7fde034ce740 20 client.16611 trim_cache size 0 max 16384 2024-09-13T17:17:09.478 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:17:09.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.470+0000 7fde007ae640 1 -- 172.21.15.87:0/957489906 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdde00a1200 msgr2=0x7fdde00a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.470+0000 7fde007ae640 1 --2- 172.21.15.87:0/957489906 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdde00a1200 0x7fdde00a36c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fddf001e000 tx=0x7fddf001c000 comp rx=0 tx=0).stop 2024-09-13T17:17:09.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.470+0000 7fde007ae640 1 -- 172.21.15.87:0/957489906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddf80fff70 msgr2=0x7fddf8196340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.470+0000 7fde007ae640 1 --2- 172.21.15.87:0/957489906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddf80fff70 0x7fddf8196340 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fdde800cce0 tx=0x7fdde800a620 comp rx=0 tx=0).stop 2024-09-13T17:17:09.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.470+0000 7fde007ae640 1 -- 172.21.15.87:0/957489906 shutdown_connections 2024-09-13T17:17:09.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.470+0000 7fde007ae640 1 --2- 172.21.15.87:0/957489906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fddf819ac70 0x7fddf819b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.470+0000 7fde007ae640 1 --2- 172.21.15.87:0/957489906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddf81050c0 0x7fddf8196880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.470+0000 7fde007ae640 1 --2- 172.21.15.87:0/957489906 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdde00a1200 0x7fdde00a36c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.470+0000 7fde007ae640 1 --2- 172.21.15.87:0/957489906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddf80fff70 0x7fddf8196340 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.470+0000 7fde007ae640 1 -- 172.21.15.87:0/957489906 >> 172.21.15.87:0/957489906 conn(0x7fddf80fba20 msgr2=0x7fddf80fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:09.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.470+0000 7fde007ae640 1 -- 172.21.15.87:0/957489906 shutdown_connections 2024-09-13T17:17:09.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.470+0000 7fde007ae640 1 -- 172.21.15.87:0/957489906 wait complete. 2024-09-13T17:17:09.482 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-09-13T17:17:09.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.581+0000 7f01e75ce640 1 -- 172.21.15.87:0/3671430901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01e0104070 msgr2=0x7f01e010bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.581+0000 7f01e75ce640 1 --2- 172.21.15.87:0/3671430901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01e0104070 0x7f01e010bbc0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f01d8009cd0 tx=0x7f01d802a8e0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.581+0000 7f01e75ce640 1 -- 172.21.15.87:0/3671430901 shutdown_connections 2024-09-13T17:17:09.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.581+0000 7f01e75ce640 1 --2- 172.21.15.87:0/3671430901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01e0104070 0x7f01e010bbc0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.581+0000 7f01e75ce640 1 --2- 172.21.15.87:0/3671430901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01e00ff8d0 0x7f01e0103910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.581+0000 7f01e75ce640 1 --2- 172.21.15.87:0/3671430901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01e00fef20 0x7f01e00ff300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.581+0000 7f01e75ce640 1 -- 172.21.15.87:0/3671430901 >> 172.21.15.87:0/3671430901 conn(0x7f01e00fa970 msgr2=0x7f01e00fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:09.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.581+0000 7f01e75ce640 1 -- 172.21.15.87:0/3671430901 shutdown_connections 2024-09-13T17:17:09.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.581+0000 7f01e75ce640 1 -- 172.21.15.87:0/3671430901 wait complete. 2024-09-13T17:17:09.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.581+0000 7f01e75ce640 1 Processor -- start 2024-09-13T17:17:09.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.581+0000 7f01e75ce640 1 -- start start 2024-09-13T17:17:09.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.581+0000 7f01e75ce640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01e00fef20 0x7f01e0195590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.582+0000 7f01e75ce640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01e0104070 0x7f01e0195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.582+0000 7f01e75ce640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01e0199ec0 0x7f01e019a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.582+0000 7f01e75ce640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e019a8b0 con 0x7f01e0104070 2024-09-13T17:17:09.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.582+0000 7f01e75ce640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e019aa20 con 0x7f01e00fef20 2024-09-13T17:17:09.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.582+0000 7f01e75ce640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e019ab90 con 0x7f01e0199ec0 2024-09-13T17:17:09.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.582+0000 7f01e4b69640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01e0104070 0x7f01e0195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.582+0000 7f01e4b69640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01e0104070 0x7f01e0195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49132/0 (socket says 172.21.15.87:49132) 2024-09-13T17:17:09.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.582+0000 7f01e4b69640 1 -- 172.21.15.87:0/1192385132 learned_addr learned my addr 172.21.15.87:0/1192385132 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:09.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.582+0000 7f01e536a640 1 --2- 172.21.15.87:0/1192385132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01e00fef20 0x7f01e0195590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.582+0000 7f01e5b6b640 1 --2- 172.21.15.87:0/1192385132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01e0199ec0 0x7f01e019a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.582+0000 7f01e4b69640 1 -- 172.21.15.87:0/1192385132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01e0199ec0 msgr2=0x7f01e019a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.582+0000 7f01e4b69640 1 --2- 172.21.15.87:0/1192385132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01e0199ec0 0x7f01e019a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.582+0000 7f01e4b69640 1 -- 172.21.15.87:0/1192385132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01e00fef20 msgr2=0x7f01e0195590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.582+0000 7f01e4b69640 1 --2- 172.21.15.87:0/1192385132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01e00fef20 0x7f01e0195590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.582+0000 7f01e4b69640 1 -- 172.21.15.87:0/1192385132 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d8009900 con 0x7f01e0104070 2024-09-13T17:17:09.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.582+0000 7f01e5b6b640 1 --2- 172.21.15.87:0/1192385132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01e0199ec0 0x7f01e019a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:09.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.582+0000 7f01e4b69640 1 --2- 172.21.15.87:0/1192385132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01e0104070 0x7f01e0195ad0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f01d400d740 tx=0x7f01d400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:09.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.582+0000 7f01d27fc640 1 -- 172.21.15.87:0/1192385132 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d4009c30 con 0x7f01e0104070 2024-09-13T17:17:09.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.582+0000 7f01d27fc640 1 -- 172.21.15.87:0/1192385132 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f01d400de50 con 0x7f01e0104070 2024-09-13T17:17:09.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.582+0000 7f01e75ce640 1 -- 172.21.15.87:0/1192385132 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01e01a2170 con 0x7f01e0104070 2024-09-13T17:17:09.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.582+0000 7f01d27fc640 1 -- 172.21.15.87:0/1192385132 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d4004e40 con 0x7f01e0104070 2024-09-13T17:17:09.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.582+0000 7f01e75ce640 1 -- 172.21.15.87:0/1192385132 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01e01a2620 con 0x7f01e0104070 2024-09-13T17:17:09.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.585+0000 7f01d27fc640 1 -- 172.21.15.87:0/1192385132 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f01d4004fa0 con 0x7f01e0104070 2024-09-13T17:17:09.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.585+0000 7f01ea3cc740 1 Processor -- start 2024-09-13T17:17:09.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.585+0000 7f01ea3cc740 1 -- start start 2024-09-13T17:17:09.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.585+0000 7f01ea3cc740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55905e8e1790 0x55905e8e1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.585+0000 7f01ea3cc740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905e8e20b0 0x55905e8ec410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.585+0000 7f01ea3cc740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55905e8ec950 0x55905e8eed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.585+0000 7f01ea3cc740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55905e84bcc0 con 0x55905e8e20b0 2024-09-13T17:17:09.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.585+0000 7f01ea3cc740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55905e849450 con 0x55905e8ec950 2024-09-13T17:17:09.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.585+0000 7f01ea3cc740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55905e844d40 con 0x55905e8e1790 2024-09-13T17:17:09.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.586+0000 7f01e536a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905e8e20b0 0x55905e8ec410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.586+0000 7f01e536a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905e8e20b0 0x55905e8ec410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49148/0 (socket says 172.21.15.87:49148) 2024-09-13T17:17:09.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.586+0000 7f01e536a640 1 -- 172.21.15.87:0/2293472563 learned_addr learned my addr 172.21.15.87:0/2293472563 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:09.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.586+0000 7f01e5b6b640 1 --2- 172.21.15.87:0/2293472563 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55905e8e1790 0x55905e8e1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.586+0000 7f01d27fc640 1 --2- 172.21.15.87:0/1192385132 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f01cc0a1280 0x7f01cc0a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.586+0000 7f01e4b69640 1 --2- 172.21.15.87:0/2293472563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55905e8ec950 0x55905e8eed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.586+0000 7f01e5b6b640 1 --2- 172.21.15.87:0/1192385132 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f01cc0a1280 0x7f01cc0a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.586+0000 7f01e536a640 1 -- 172.21.15.87:0/2293472563 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55905e8e1790 msgr2=0x55905e8e1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:09.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.586+0000 7f01e536a640 1 --2- 172.21.15.87:0/2293472563 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55905e8e1790 0x55905e8e1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.586+0000 7f01e536a640 1 -- 172.21.15.87:0/2293472563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55905e8ec950 msgr2=0x55905e8eed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:09.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.586+0000 7f01e536a640 1 --2- 172.21.15.87:0/2293472563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55905e8ec950 0x55905e8eed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.586+0000 7f01e536a640 1 -- 172.21.15.87:0/2293472563 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55905e80c620 con 0x55905e8e20b0 2024-09-13T17:17:09.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.586+0000 7f01e4b69640 1 --2- 172.21.15.87:0/2293472563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55905e8ec950 0x55905e8eed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:09.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.586+0000 7f01d27fc640 1 -- 172.21.15.87:0/1192385132 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f01d40cca30 con 0x7f01e0104070 2024-09-13T17:17:09.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.586+0000 7f01e536a640 1 --2- 172.21.15.87:0/2293472563 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905e8e20b0 0x55905e8ec410 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f01dc00cbf0 tx=0x7f01dc00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b74a28d2ee568f31 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:09.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.586+0000 7f01e5b6b640 1 --2- 172.21.15.87:0/1192385132 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f01cc0a1280 0x7f01cc0a3740 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f01d802ae00 tx=0x7f01d802a8e0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:09.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.586+0000 7f01cb7fe640 1 -- 172.21.15.87:0/2293472563 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc010630 con 0x55905e8e20b0 2024-09-13T17:17:09.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.586+0000 7f01cb7fe640 1 -- 172.21.15.87:0/2293472563 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f01dc010c40 con 0x55905e8e20b0 2024-09-13T17:17:09.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.586+0000 7f01cb7fe640 1 -- 172.21.15.87:0/2293472563 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc019b30 con 0x55905e8e20b0 2024-09-13T17:17:09.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.587+0000 7f01ea3cc740 1 -- 172.21.15.87:0/2293472563 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905e8e20b0 msgr2=0x55905e8ec410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.587+0000 7f01ea3cc740 1 --2- 172.21.15.87:0/2293472563 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905e8e20b0 0x55905e8ec410 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f01dc00cbf0 tx=0x7f01dc00e720 comp rx=0 tx=0).stop 2024-09-13T17:17:09.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.587+0000 7f01ea3cc740 1 -- 172.21.15.87:0/2293472563 shutdown_connections 2024-09-13T17:17:09.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.587+0000 7f01ea3cc740 1 --2- 172.21.15.87:0/2293472563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55905e8ec950 0x55905e8eed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.587+0000 7f01ea3cc740 1 --2- 172.21.15.87:0/2293472563 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905e8e20b0 0x55905e8ec410 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.587+0000 7f01ea3cc740 1 --2- 172.21.15.87:0/2293472563 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55905e8e1790 0x55905e8e1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.587+0000 7f01ea3cc740 1 -- 172.21.15.87:0/2293472563 >> 172.21.15.87:0/2293472563 conn(0x55905e8ddd00 msgr2=0x55905e8de0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:09.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.587+0000 7f01ea3cc740 1 -- 172.21.15.87:0/2293472563 shutdown_connections 2024-09-13T17:17:09.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.587+0000 7f01ea3cc740 1 -- 172.21.15.87:0/2293472563 wait complete. 2024-09-13T17:17:09.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.587+0000 7f01ea3cc740 1 -- start start 2024-09-13T17:17:09.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.587+0000 7f01ea3cc740 1 Processor -- start 2024-09-13T17:17:09.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.588+0000 7f01ea3cc740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55905e8e1790 0x55905e8eb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.588+0000 7f01ea3cc740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905e8e20b0 0x55905e8ebc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.588+0000 7f01ea3cc740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55905e8ec950 0x55905e8f29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.588+0000 7f01ea3cc740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55905e803180 con 0x55905e8e20b0 2024-09-13T17:17:09.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.588+0000 7f01ea3cc740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55905e51d430 con 0x55905e8ec950 2024-09-13T17:17:09.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.588+0000 7f01ea3cc740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55905e7c85e0 con 0x55905e8e1790 2024-09-13T17:17:09.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.588+0000 7f01ea3cc740 10 client.0 _ll_register_callbacks cb 0x55905e834aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:17:09.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.588+0000 7f01e4b69640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905e8e20b0 0x55905e8ebc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.588+0000 7f01e4b69640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905e8e20b0 0x55905e8ebc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49162/0 (socket says 172.21.15.87:49162) 2024-09-13T17:17:09.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.588+0000 7f01e4b69640 1 -- 172.21.15.87:0/3434739252 learned_addr learned my addr 172.21.15.87:0/3434739252 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:09.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.588+0000 7f01e5b6b640 1 --2- 172.21.15.87:0/3434739252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55905e8ec950 0x55905e8f29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.588+0000 7f01e536a640 1 --2- 172.21.15.87:0/3434739252 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55905e8e1790 0x55905e8eb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.588+0000 7f01e4b69640 1 -- 172.21.15.87:0/3434739252 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55905e8e1790 msgr2=0x55905e8eb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:09.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.588+0000 7f01e4b69640 1 --2- 172.21.15.87:0/3434739252 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55905e8e1790 0x55905e8eb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.588+0000 7f01e4b69640 1 -- 172.21.15.87:0/3434739252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55905e8ec950 msgr2=0x55905e8f29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:09.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.588+0000 7f01e4b69640 1 --2- 172.21.15.87:0/3434739252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55905e8ec950 0x55905e8f29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.588+0000 7f01e4b69640 1 -- 172.21.15.87:0/3434739252 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01dc00c850 con 0x55905e8e20b0 2024-09-13T17:17:09.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.588+0000 7f01e4b69640 1 --2- 172.21.15.87:0/3434739252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905e8e20b0 0x55905e8ebc10 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f01d4009610 tx=0x7f01d4018860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec4fa8671237274e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:09.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.588+0000 7f01c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:17:09.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.588+0000 7f01c8ff9640 1 -- 172.21.15.87:0/3434739252 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d4099e30 con 0x55905e8e20b0 2024-09-13T17:17:09.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.588+0000 7f01c8ff9640 1 -- 172.21.15.87:0/3434739252 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f01d4099730 con 0x55905e8e20b0 2024-09-13T17:17:09.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.588+0000 7f01ea3cc740 1 -- 172.21.15.87:0/3434739252 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55905e86eb80 con 0x55905e8e20b0 2024-09-13T17:17:09.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.589+0000 7f01c8ff9640 1 -- 172.21.15.87:0/3434739252 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01d409d560 con 0x55905e8e20b0 2024-09-13T17:17:09.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.589+0000 7f01ea3cc740 10 client.16623 fetch_fsmap learned FSMap version 30 2024-09-13T17:17:09.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.589+0000 7f01ea3cc740 1 -- 172.21.15.87:0/3434739252 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55905e8433c0 con 0x55905e8e20b0 2024-09-13T17:17:09.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.589+0000 7f01c8ff9640 1 -- 172.21.15.87:0/3434739252 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55905e86eb80 con 0x55905e8e20b0 2024-09-13T17:17:09.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.589+0000 7f01c8ff9640 1 -- 172.21.15.87:0/3434739252 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f01d40b7d20 con 0x55905e8e20b0 2024-09-13T17:17:09.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.589+0000 7f01ea3cc740 10 client.16623 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:17:09.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.589+0000 7f01ea3cc740 10 client.16623 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:17:09.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.589+0000 7f01ea3cc740 20 client.16623 populate_metadata read hostname 'smithi087' 2024-09-13T17:17:09.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.589+0000 7f01ea3cc740 1 --2- 172.21.15.87:0/3434739252 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55905e8fe4a0 0x55905e9008c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.589+0000 7f01ea3cc740 4 client.16623 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:17:09.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.589+0000 7f01ea3cc740 1 -- 172.21.15.87:0/3434739252 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55905e8371f0 con 0x55905e8fe4a0 2024-09-13T17:17:09.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.589+0000 7f01e536a640 1 --2- 172.21.15.87:0/3434739252 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55905e8fe4a0 0x55905e9008c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.590+0000 7f01c8ff9640 10 client.16623 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:17:09.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.590+0000 7f01e536a640 1 --2- 172.21.15.87:0/3434739252 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55905e8fe4a0 0x55905e9008c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d7cb469b65e727b server_cookie=3cd7440a3e0bcc3e in_seq=0 out_seq=0 2024-09-13T17:17:09.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.590+0000 7f01c8ff9640 1 -- 172.21.15.87:0/3434739252 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55905e8371f0 con 0x55905e8fe4a0 2024-09-13T17:17:09.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.590+0000 7f01c8ff9640 10 client.16623 handle_command_reply: tid=0 2024-09-13T17:17:09.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.590+0000 7f01ea3cc740 1 client.16623 shutdown 2024-09-13T17:17:09.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.590+0000 7f01ea3cc740 1 -- 172.21.15.87:0/3434739252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905e8e20b0 msgr2=0x55905e8ebc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.590+0000 7f01ea3cc740 1 --2- 172.21.15.87:0/3434739252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905e8e20b0 0x55905e8ebc10 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f01d4009610 tx=0x7f01d4018860 comp rx=0 tx=0).stop 2024-09-13T17:17:09.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.590+0000 7f01ea3cc740 1 -- 172.21.15.87:0/3434739252 shutdown_connections 2024-09-13T17:17:09.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.590+0000 7f01ea3cc740 1 --2- 172.21.15.87:0/3434739252 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55905e8fe4a0 0x55905e9008c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.590+0000 7f01ea3cc740 1 --2- 172.21.15.87:0/3434739252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55905e8ec950 0x55905e8f29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.590+0000 7f01c8ff9640 0 client.16623 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:17:09.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.590+0000 7f01ea3cc740 1 --2- 172.21.15.87:0/3434739252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905e8e20b0 0x55905e8ebc10 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.590+0000 7f01ea3cc740 1 --2- 172.21.15.87:0/3434739252 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55905e8e1790 0x55905e8eb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.590+0000 7f01ea3cc740 1 -- 172.21.15.87:0/3434739252 >> 172.21.15.87:0/3434739252 conn(0x55905e8ddd00 msgr2=0x55905e8e3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:09.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.591+0000 7f01ea3cc740 1 -- 172.21.15.87:0/3434739252 shutdown_connections 2024-09-13T17:17:09.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.591+0000 7f01ea3cc740 1 -- 172.21.15.87:0/3434739252 wait complete. 2024-09-13T17:17:09.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.591+0000 7f01ea3cc740 20 client.16623 trim_cache size 0 max 16384 2024-09-13T17:17:09.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.601+0000 7f01ea3cc740 1 Processor -- start 2024-09-13T17:17:09.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.601+0000 7f01ea3cc740 1 -- start start 2024-09-13T17:17:09.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.602+0000 7f01ea3cc740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905e8e1790 0x55905e8f2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.602+0000 7f01ea3cc740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55905e8e20b0 0x55905e905220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.602+0000 7f01ea3cc740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55905e8ec950 0x55905e8eb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.602+0000 7f01ea3cc740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55905e8d8300 con 0x55905e8e1790 2024-09-13T17:17:09.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.602+0000 7f01ea3cc740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55905e8e9a10 con 0x55905e8ec950 2024-09-13T17:17:09.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.602+0000 7f01ea3cc740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55905e8ec410 con 0x55905e8e20b0 2024-09-13T17:17:09.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.602+0000 7f01e536a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905e8e1790 0x55905e8f2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.602+0000 7f01e536a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905e8e1790 0x55905e8f2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49168/0 (socket says 172.21.15.87:49168) 2024-09-13T17:17:09.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.602+0000 7f01e536a640 1 -- 172.21.15.87:0/3976557505 learned_addr learned my addr 172.21.15.87:0/3976557505 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:09.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.602+0000 7f01e4b69640 1 --2- 172.21.15.87:0/3976557505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55905e8e20b0 0x55905e905220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.602+0000 7f01e536a640 1 -- 172.21.15.87:0/3976557505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55905e8e20b0 msgr2=0x55905e905220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:09.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.602+0000 7f01e536a640 1 --2- 172.21.15.87:0/3976557505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55905e8e20b0 0x55905e905220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.602+0000 7f01e536a640 1 -- 172.21.15.87:0/3976557505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55905e8ec950 msgr2=0x55905e8eb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:09.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.602+0000 7f01e536a640 1 --2- 172.21.15.87:0/3976557505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55905e8ec950 0x55905e8eb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.602+0000 7f01e536a640 1 -- 172.21.15.87:0/3976557505 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55905e7e5770 con 0x55905e8e1790 2024-09-13T17:17:09.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.602+0000 7f01e4b69640 1 --2- 172.21.15.87:0/3976557505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55905e8e20b0 0x55905e905220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:09.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.602+0000 7f01e536a640 1 --2- 172.21.15.87:0/3976557505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905e8e1790 0x55905e8f2920 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f01dc00f010 tx=0x7f01dc0193c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c0ca688f4e19335 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:09.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.602+0000 7f01cbfff640 1 -- 172.21.15.87:0/3976557505 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc021040 con 0x55905e8e1790 2024-09-13T17:17:09.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.602+0000 7f01cbfff640 1 -- 172.21.15.87:0/3976557505 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f01dc0044d0 con 0x55905e8e1790 2024-09-13T17:17:09.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.602+0000 7f01cbfff640 1 -- 172.21.15.87:0/3976557505 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc019bb0 con 0x55905e8e1790 2024-09-13T17:17:09.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.603+0000 7f01ea3cc740 1 -- 172.21.15.87:0/3976557505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905e8e1790 msgr2=0x55905e8f2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.603+0000 7f01ea3cc740 1 --2- 172.21.15.87:0/3976557505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905e8e1790 0x55905e8f2920 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f01dc00f010 tx=0x7f01dc0193c0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.603+0000 7f01ea3cc740 1 -- 172.21.15.87:0/3976557505 shutdown_connections 2024-09-13T17:17:09.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.603+0000 7f01ea3cc740 1 --2- 172.21.15.87:0/3976557505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55905e8ec950 0x55905e8eb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.603+0000 7f01ea3cc740 1 --2- 172.21.15.87:0/3976557505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55905e8e20b0 0x55905e905220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.603+0000 7f01ea3cc740 1 --2- 172.21.15.87:0/3976557505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905e8e1790 0x55905e8f2920 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.603+0000 7f01ea3cc740 1 -- 172.21.15.87:0/3976557505 >> 172.21.15.87:0/3976557505 conn(0x55905e8ddd00 msgr2=0x55905e8e9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:09.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.603+0000 7f01ea3cc740 1 -- 172.21.15.87:0/3976557505 shutdown_connections 2024-09-13T17:17:09.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.603+0000 7f01ea3cc740 1 -- 172.21.15.87:0/3976557505 wait complete. 2024-09-13T17:17:09.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.603+0000 7f01ea3cc740 1 -- start start 2024-09-13T17:17:09.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.603+0000 7f01ea3cc740 1 Processor -- start 2024-09-13T17:17:09.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.603+0000 7f01ea3cc740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905e8e1790 0x55905e8fa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.604+0000 7f01ea3cc740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55905e8e20b0 0x55905e8f6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.604+0000 7f01ea3cc740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55905e8ec950 0x55905e8f6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.604+0000 7f01ea3cc740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55905e8f74c0 con 0x55905e8e1790 2024-09-13T17:17:09.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.604+0000 7f01ea3cc740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55905e8f7630 con 0x55905e8ec950 2024-09-13T17:17:09.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.604+0000 7f01ea3cc740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55905e8f77f0 con 0x55905e8e20b0 2024-09-13T17:17:09.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.604+0000 7f01ea3cc740 10 client.0 _ll_register_callbacks cb 0x7f01dc00c390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:17:09.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.604+0000 7f01e536a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905e8e1790 0x55905e8fa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.604+0000 7f01e536a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905e8e1790 0x55905e8fa5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49180/0 (socket says 172.21.15.87:49180) 2024-09-13T17:17:09.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.604+0000 7f01e536a640 1 -- 172.21.15.87:0/3132153480 learned_addr learned my addr 172.21.15.87:0/3132153480 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:09.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.604+0000 7f01e5b6b640 1 --2- 172.21.15.87:0/3132153480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55905e8ec950 0x55905e8f6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.604+0000 7f01e4b69640 1 --2- 172.21.15.87:0/3132153480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55905e8e20b0 0x55905e8f6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.604+0000 7f01e536a640 1 -- 172.21.15.87:0/3132153480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55905e8e20b0 msgr2=0x55905e8f6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:09.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.604+0000 7f01e536a640 1 --2- 172.21.15.87:0/3132153480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55905e8e20b0 0x55905e8f6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.604+0000 7f01e536a640 1 -- 172.21.15.87:0/3132153480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55905e8ec950 msgr2=0x55905e8f6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:09.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.604+0000 7f01e536a640 1 --2- 172.21.15.87:0/3132153480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55905e8ec950 0x55905e8f6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.604+0000 7f01e536a640 1 -- 172.21.15.87:0/3132153480 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55905e80c620 con 0x55905e8e1790 2024-09-13T17:17:09.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.604+0000 7f01e5b6b640 1 --2- 172.21.15.87:0/3132153480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55905e8ec950 0x55905e8f6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:09.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.604+0000 7f01e536a640 1 --2- 172.21.15.87:0/3132153480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905e8e1790 0x55905e8fa5a0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f01dc00e760 tx=0x7f01dc005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b9d5195fc3bc286 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:09.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.604+0000 7f01c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:17:09.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.604+0000 7f01c8ff9640 1 -- 172.21.15.87:0/3132153480 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc01f050 con 0x55905e8e1790 2024-09-13T17:17:09.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.604+0000 7f01c8ff9640 1 -- 172.21.15.87:0/3132153480 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f01dc019570 con 0x55905e8e1790 2024-09-13T17:17:09.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.604+0000 7f01ea3cc740 1 -- 172.21.15.87:0/3132153480 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f01dc010c40 con 0x55905e8e1790 2024-09-13T17:17:09.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.604+0000 7f01c8ff9640 1 -- 172.21.15.87:0/3132153480 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01dc021040 con 0x55905e8e1790 2024-09-13T17:17:09.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.604+0000 7f01ea3cc740 10 client.16629 fetch_fsmap learned FSMap version 30 2024-09-13T17:17:09.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.604+0000 7f01ea3cc740 1 -- 172.21.15.87:0/3132153480 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55905e80ae80 con 0x55905e8e1790 2024-09-13T17:17:09.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.605+0000 7f01c8ff9640 1 -- 172.21.15.87:0/3132153480 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f01dc010c40 con 0x55905e8e1790 2024-09-13T17:17:09.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.605+0000 7f01c8ff9640 1 -- 172.21.15.87:0/3132153480 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f01dc0105f0 con 0x55905e8e1790 2024-09-13T17:17:09.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.605+0000 7f01ea3cc740 10 client.16629 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:17:09.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.605+0000 7f01ea3cc740 10 client.16629 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:17:09.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.605+0000 7f01ea3cc740 20 client.16629 populate_metadata read hostname 'smithi087' 2024-09-13T17:17:09.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.605+0000 7f01ea3cc740 1 --2- 172.21.15.87:0/3132153480 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55905e955b70 0x55905e957f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.605+0000 7f01ea3cc740 4 client.16629 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:17:09.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.605+0000 7f01ea3cc740 1 -- 172.21.15.87:0/3132153480 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55905e5384e0 con 0x55905e955b70 2024-09-13T17:17:09.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.605+0000 7f01e4b69640 1 --2- 172.21.15.87:0/3132153480 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55905e955b70 0x55905e957f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.606+0000 7f01c8ff9640 10 client.16629 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:17:09.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.606+0000 7f01e4b69640 1 --2- 172.21.15.87:0/3132153480 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55905e955b70 0x55905e957f90 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7e83b15875d35719 server_cookie=d661a8ad718ef70b in_seq=0 out_seq=0 2024-09-13T17:17:09.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.606+0000 7f01c8ff9640 1 -- 172.21.15.87:0/3132153480 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55905e5384e0 con 0x55905e955b70 2024-09-13T17:17:09.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.606+0000 7f01c8ff9640 10 client.16629 handle_command_reply: tid=0 2024-09-13T17:17:09.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.606+0000 7f01ea3cc740 1 client.16629 shutdown 2024-09-13T17:17:09.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.606+0000 7f01ea3cc740 1 -- 172.21.15.87:0/3132153480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905e8e1790 msgr2=0x55905e8fa5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.606+0000 7f01ea3cc740 1 --2- 172.21.15.87:0/3132153480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905e8e1790 0x55905e8fa5a0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f01dc00e760 tx=0x7f01dc005bc0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.606+0000 7f01ea3cc740 1 -- 172.21.15.87:0/3132153480 shutdown_connections 2024-09-13T17:17:09.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.606+0000 7f01ea3cc740 1 --2- 172.21.15.87:0/3132153480 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55905e955b70 0x55905e957f90 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.606+0000 7f01ea3cc740 1 --2- 172.21.15.87:0/3132153480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55905e8ec950 0x55905e8f6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.606+0000 7f01ea3cc740 1 --2- 172.21.15.87:0/3132153480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55905e8e20b0 0x55905e8f6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.606+0000 7f01c8ff9640 0 client.16629 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:17:09.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.606+0000 7f01ea3cc740 1 --2- 172.21.15.87:0/3132153480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55905e8e1790 0x55905e8fa5a0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.606+0000 7f01ea3cc740 1 -- 172.21.15.87:0/3132153480 >> 172.21.15.87:0/3132153480 conn(0x55905e8ddd00 msgr2=0x55905e905220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:09.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.606+0000 7f01ea3cc740 1 -- 172.21.15.87:0/3132153480 shutdown_connections 2024-09-13T17:17:09.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.606+0000 7f01ea3cc740 1 -- 172.21.15.87:0/3132153480 wait complete. 2024-09-13T17:17:09.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.606+0000 7f01ea3cc740 20 client.16629 trim_cache size 0 max 16384 2024-09-13T17:17:09.614 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:17:09.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.607+0000 7f01e75ce640 1 -- 172.21.15.87:0/1192385132 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f01cc0a1280 msgr2=0x7f01cc0a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.607+0000 7f01e75ce640 1 --2- 172.21.15.87:0/1192385132 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f01cc0a1280 0x7f01cc0a3740 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f01d802ae00 tx=0x7f01d802a8e0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.607+0000 7f01e75ce640 1 -- 172.21.15.87:0/1192385132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01e0104070 msgr2=0x7f01e0195ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.607+0000 7f01e75ce640 1 --2- 172.21.15.87:0/1192385132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01e0104070 0x7f01e0195ad0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f01d400d740 tx=0x7f01d400dc00 comp rx=0 tx=0).stop 2024-09-13T17:17:09.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.607+0000 7f01e75ce640 1 -- 172.21.15.87:0/1192385132 shutdown_connections 2024-09-13T17:17:09.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.607+0000 7f01e75ce640 1 --2- 172.21.15.87:0/1192385132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01e0199ec0 0x7f01e019a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.607+0000 7f01e75ce640 1 --2- 172.21.15.87:0/1192385132 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f01cc0a1280 0x7f01cc0a3740 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.607+0000 7f01e75ce640 1 --2- 172.21.15.87:0/1192385132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01e0104070 0x7f01e0195ad0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.607+0000 7f01e75ce640 1 --2- 172.21.15.87:0/1192385132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01e00fef20 0x7f01e0195590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.607+0000 7f01e75ce640 1 -- 172.21.15.87:0/1192385132 >> 172.21.15.87:0/1192385132 conn(0x7f01e00fa970 msgr2=0x7f01e00fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:09.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.607+0000 7f01e75ce640 1 -- 172.21.15.87:0/1192385132 shutdown_connections 2024-09-13T17:17:09.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.607+0000 7f01e75ce640 1 -- 172.21.15.87:0/1192385132 wait complete. 2024-09-13T17:17:09.617 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:09 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3069825759' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:17:09.618 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-09-13T17:17:09.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.718+0000 7fa60db9c640 1 -- 172.21.15.87:0/3198397244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa608103840 msgr2=0x7fa60810b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.718+0000 7fa60db9c640 1 --2- 172.21.15.87:0/3198397244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa608103840 0x7fa60810b3e0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fa600009ca0 tx=0x7fa60002a8b0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.718+0000 7fa60db9c640 1 -- 172.21.15.87:0/3198397244 shutdown_connections 2024-09-13T17:17:09.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.718+0000 7fa60db9c640 1 --2- 172.21.15.87:0/3198397244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa608103840 0x7fa60810b3e0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.718+0000 7fa60db9c640 1 --2- 172.21.15.87:0/3198397244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6080ff530 0x7fa608103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.718+0000 7fa60db9c640 1 --2- 172.21.15.87:0/3198397244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6080feb80 0x7fa6080fef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.718+0000 7fa60db9c640 1 -- 172.21.15.87:0/3198397244 >> 172.21.15.87:0/3198397244 conn(0x7fa608074110 msgr2=0x7fa608074520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:09.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.718+0000 7fa60db9c640 1 -- 172.21.15.87:0/3198397244 shutdown_connections 2024-09-13T17:17:09.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.718+0000 7fa60db9c640 1 -- 172.21.15.87:0/3198397244 wait complete. 2024-09-13T17:17:09.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.718+0000 7fa60db9c640 1 Processor -- start 2024-09-13T17:17:09.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.719+0000 7fa60db9c640 1 -- start start 2024-09-13T17:17:09.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.719+0000 7fa60db9c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6080feb80 0x7fa608195220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.719+0000 7fa60db9c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa608103840 0x7fa608195760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.719+0000 7fa60db9c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa608199b50 0x7fa60819a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.719+0000 7fa60db9c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60819a540 con 0x7fa608103840 2024-09-13T17:17:09.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.719+0000 7fa60db9c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60819a6b0 con 0x7fa608199b50 2024-09-13T17:17:09.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.719+0000 7fa60db9c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60819a820 con 0x7fa6080feb80 2024-09-13T17:17:09.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.719+0000 7fa606ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa608103840 0x7fa608195760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.719+0000 7fa606ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa608103840 0x7fa608195760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49192/0 (socket says 172.21.15.87:49192) 2024-09-13T17:17:09.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.719+0000 7fa606ffd640 1 -- 172.21.15.87:0/3707086076 learned_addr learned my addr 172.21.15.87:0/3707086076 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:09.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.719+0000 7fa6077fe640 1 --2- 172.21.15.87:0/3707086076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6080feb80 0x7fa608195220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.719+0000 7fa607fff640 1 --2- 172.21.15.87:0/3707086076 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa608199b50 0x7fa60819a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.719+0000 7fa606ffd640 1 -- 172.21.15.87:0/3707086076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6080feb80 msgr2=0x7fa608195220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.719+0000 7fa606ffd640 1 --2- 172.21.15.87:0/3707086076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6080feb80 0x7fa608195220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.719+0000 7fa606ffd640 1 -- 172.21.15.87:0/3707086076 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa608199b50 msgr2=0x7fa60819a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.719+0000 7fa606ffd640 1 --2- 172.21.15.87:0/3707086076 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa608199b50 0x7fa60819a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.719+0000 7fa606ffd640 1 -- 172.21.15.87:0/3707086076 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa600009900 con 0x7fa608103840 2024-09-13T17:17:09.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.719+0000 7fa607fff640 1 --2- 172.21.15.87:0/3707086076 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa608199b50 0x7fa60819a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:09.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.719+0000 7fa606ffd640 1 --2- 172.21.15.87:0/3707086076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa608103840 0x7fa608195760 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fa5f800b450 tx=0x7fa5f800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:09.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.720+0000 7fa604ff9640 1 -- 172.21.15.87:0/3707086076 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f8011890 con 0x7fa608103840 2024-09-13T17:17:09.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.720+0000 7fa604ff9640 1 -- 172.21.15.87:0/3707086076 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa5f80103e0 con 0x7fa608103840 2024-09-13T17:17:09.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.720+0000 7fa604ff9640 1 -- 172.21.15.87:0/3707086076 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f8011ea0 con 0x7fa608103840 2024-09-13T17:17:09.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.720+0000 7fa60db9c640 1 -- 172.21.15.87:0/3707086076 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6081a1e00 con 0x7fa608103840 2024-09-13T17:17:09.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.720+0000 7fa60db9c640 1 -- 172.21.15.87:0/3707086076 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6081a2250 con 0x7fa608103840 2024-09-13T17:17:09.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.722+0000 7fa604ff9640 1 -- 172.21.15.87:0/3707086076 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fa5f8010550 con 0x7fa608103840 2024-09-13T17:17:09.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.723+0000 7fa6108c3740 1 Processor -- start 2024-09-13T17:17:09.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.723+0000 7fa6108c3740 1 -- start start 2024-09-13T17:17:09.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.723+0000 7fa6108c3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1300a3650 0x55b1300a3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.723+0000 7fa6108c3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1300a3f70 0x55b1300b0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.723+0000 7fa6108c3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b1300b0b60 0x55b1300b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.723+0000 7fa6108c3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b13000dcc0 con 0x55b1300a3f70 2024-09-13T17:17:09.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.723+0000 7fa6108c3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b13000b450 con 0x55b1300a3650 2024-09-13T17:17:09.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.723+0000 7fa6108c3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b130006d40 con 0x55b1300b0b60 2024-09-13T17:17:09.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.723+0000 7fa6077fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1300a3f70 0x55b1300b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.723+0000 7fa6077fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1300a3f70 0x55b1300b0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49200/0 (socket says 172.21.15.87:49200) 2024-09-13T17:17:09.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.723+0000 7fa6077fe640 1 -- 172.21.15.87:0/1413614442 learned_addr learned my addr 172.21.15.87:0/1413614442 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:09.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.723+0000 7fa607fff640 1 --2- 172.21.15.87:0/1413614442 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1300a3650 0x55b1300a3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.723+0000 7fa606ffd640 1 --2- 172.21.15.87:0/1413614442 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b1300b0b60 0x55b1300b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.723+0000 7fa6077fe640 1 -- 172.21.15.87:0/1413614442 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b1300b0b60 msgr2=0x55b1300b2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:09.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.723+0000 7fa604ff9640 1 --2- 172.21.15.87:0/3707086076 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa5f40a1280 0x7fa5f40a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.723+0000 7fa6077fe640 1 --2- 172.21.15.87:0/1413614442 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b1300b0b60 0x55b1300b2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.723+0000 7fa6077fe640 1 -- 172.21.15.87:0/1413614442 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1300a3650 msgr2=0x55b1300a3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:09.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.723+0000 7fa6077fe640 1 --2- 172.21.15.87:0/1413614442 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1300a3650 0x55b1300a3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.723+0000 7fa6077fe640 1 -- 172.21.15.87:0/1413614442 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b12ffce620 con 0x55b1300a3f70 2024-09-13T17:17:09.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.723+0000 7fa607fff640 1 --2- 172.21.15.87:0/3707086076 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa5f40a1280 0x7fa5f40a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.723+0000 7fa604ff9640 1 -- 172.21.15.87:0/3707086076 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fa5f80ccd50 con 0x7fa608103840 2024-09-13T17:17:09.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.723+0000 7fa6077fe640 1 --2- 172.21.15.87:0/1413614442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1300a3f70 0x55b1300b0620 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fa5f000cbf0 tx=0x7fa5f000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=899ee5de179164e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:09.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.724+0000 7fa5fdffb640 1 -- 172.21.15.87:0/1413614442 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0010630 con 0x55b1300a3f70 2024-09-13T17:17:09.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.724+0000 7fa5fdffb640 1 -- 172.21.15.87:0/1413614442 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa5f0010c40 con 0x55b1300a3f70 2024-09-13T17:17:09.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.724+0000 7fa5fdffb640 1 -- 172.21.15.87:0/1413614442 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0019ab0 con 0x55b1300a3f70 2024-09-13T17:17:09.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.724+0000 7fa6108c3740 1 -- 172.21.15.87:0/1413614442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1300a3f70 msgr2=0x55b1300b0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.724+0000 7fa607fff640 1 --2- 172.21.15.87:0/3707086076 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa5f40a1280 0x7fa5f40a3740 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa6000098d0 tx=0x7fa6000095c0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:09.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.724+0000 7fa6108c3740 1 --2- 172.21.15.87:0/1413614442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1300a3f70 0x55b1300b0620 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fa5f000cbf0 tx=0x7fa5f000e720 comp rx=0 tx=0).stop 2024-09-13T17:17:09.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.724+0000 7fa6108c3740 1 -- 172.21.15.87:0/1413614442 shutdown_connections 2024-09-13T17:17:09.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.724+0000 7fa6108c3740 1 --2- 172.21.15.87:0/1413614442 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b1300b0b60 0x55b1300b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.724+0000 7fa6108c3740 1 --2- 172.21.15.87:0/1413614442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1300a3f70 0x55b1300b0620 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.724+0000 7fa6108c3740 1 --2- 172.21.15.87:0/1413614442 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1300a3650 0x55b1300a3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.724+0000 7fa6108c3740 1 -- 172.21.15.87:0/1413614442 >> 172.21.15.87:0/1413614442 conn(0x55b13009fd00 msgr2=0x55b1300a00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:09.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.724+0000 7fa6108c3740 1 -- 172.21.15.87:0/1413614442 shutdown_connections 2024-09-13T17:17:09.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.725+0000 7fa6108c3740 1 -- 172.21.15.87:0/1413614442 wait complete. 2024-09-13T17:17:09.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.725+0000 7fa6108c3740 1 -- start start 2024-09-13T17:17:09.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.725+0000 7fa6108c3740 1 Processor -- start 2024-09-13T17:17:09.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.725+0000 7fa6108c3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b1300a3650 0x55b1300b0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.725+0000 7fa6108c3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1300a3f70 0x55b1300ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.725+0000 7fa6108c3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1300b0b60 0x55b1300ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.725+0000 7fa6108c3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b12ffc5180 con 0x55b1300a3f70 2024-09-13T17:17:09.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.725+0000 7fa6108c3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b12fcdf430 con 0x55b1300b0b60 2024-09-13T17:17:09.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.725+0000 7fa6108c3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b12ff8a5e0 con 0x55b1300a3650 2024-09-13T17:17:09.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.725+0000 7fa6108c3740 10 client.0 _ll_register_callbacks cb 0x55b12fff6aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:17:09.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.725+0000 7fa606ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1300a3f70 0x55b1300ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.725+0000 7fa606ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1300a3f70 0x55b1300ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49216/0 (socket says 172.21.15.87:49216) 2024-09-13T17:17:09.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.725+0000 7fa606ffd640 1 -- 172.21.15.87:0/705421750 learned_addr learned my addr 172.21.15.87:0/705421750 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:09.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.725+0000 7fa6077fe640 1 --2- 172.21.15.87:0/705421750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b1300a3650 0x55b1300b0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.726+0000 7fa607fff640 1 --2- 172.21.15.87:0/705421750 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1300b0b60 0x55b1300ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.726+0000 7fa606ffd640 1 -- 172.21.15.87:0/705421750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b1300a3650 msgr2=0x55b1300b0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:09.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.726+0000 7fa606ffd640 1 --2- 172.21.15.87:0/705421750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b1300a3650 0x55b1300b0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.726+0000 7fa606ffd640 1 -- 172.21.15.87:0/705421750 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1300b0b60 msgr2=0x55b1300ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:09.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.726+0000 7fa606ffd640 1 --2- 172.21.15.87:0/705421750 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1300b0b60 0x55b1300ad9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.726+0000 7fa606ffd640 1 -- 172.21.15.87:0/705421750 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f000c850 con 0x55b1300a3f70 2024-09-13T17:17:09.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.726+0000 7fa606ffd640 1 --2- 172.21.15.87:0/705421750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1300a3f70 0x55b1300ad460 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80ca260 tx=0x7fa5f8099800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c2ed2281b13d7c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:09.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.726+0000 7fa5e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:17:09.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.726+0000 7fa5e6ffd640 1 -- 172.21.15.87:0/705421750 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f8099bc0 con 0x55b1300a3f70 2024-09-13T17:17:09.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.726+0000 7fa5e6ffd640 1 -- 172.21.15.87:0/705421750 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fa5f809d9f0 con 0x55b1300a3f70 2024-09-13T17:17:09.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.726+0000 7fa6108c3740 1 -- 172.21.15.87:0/705421750 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b130030b80 con 0x55b1300a3f70 2024-09-13T17:17:09.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.726+0000 7fa5e6ffd640 1 -- 172.21.15.87:0/705421750 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5f80a2040 con 0x55b1300a3f70 2024-09-13T17:17:09.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.726+0000 7fa6108c3740 10 client.16641 fetch_fsmap learned FSMap version 30 2024-09-13T17:17:09.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.726+0000 7fa6108c3740 1 -- 172.21.15.87:0/705421750 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55b1300053c0 con 0x55b1300a3f70 2024-09-13T17:17:09.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.726+0000 7fa5e6ffd640 1 -- 172.21.15.87:0/705421750 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55b130030b80 con 0x55b1300a3f70 2024-09-13T17:17:09.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.726+0000 7fa5e6ffd640 1 -- 172.21.15.87:0/705421750 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fa5f80a1bb0 con 0x55b1300a3f70 2024-09-13T17:17:09.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.726+0000 7fa6108c3740 10 client.16641 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:17:09.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.726+0000 7fa6108c3740 10 client.16641 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:17:09.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.726+0000 7fa6108c3740 20 client.16641 populate_metadata read hostname 'smithi087' 2024-09-13T17:17:09.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.726+0000 7fa6108c3740 1 --2- 172.21.15.87:0/705421750 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b1300c0510 0x55b1300c2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.726+0000 7fa6108c3740 4 client.16641 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:17:09.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.727+0000 7fa6108c3740 1 -- 172.21.15.87:0/705421750 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b12fff91f0 con 0x55b1300c0510 2024-09-13T17:17:09.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.727+0000 7fa6077fe640 1 --2- 172.21.15.87:0/705421750 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b1300c0510 0x55b1300c2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.727+0000 7fa5e6ffd640 10 client.16641 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:17:09.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.727+0000 7fa6077fe640 1 --2- 172.21.15.87:0/705421750 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b1300c0510 0x55b1300c2930 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff50c01a1fa8ef30 server_cookie=af4e18a0a33000e7 in_seq=0 out_seq=0 2024-09-13T17:17:09.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.728+0000 7fa5e6ffd640 1 -- 172.21.15.87:0/705421750 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55b12fff91f0 con 0x55b1300c0510 2024-09-13T17:17:09.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.728+0000 7fa5e6ffd640 10 client.16641 handle_command_reply: tid=0 2024-09-13T17:17:09.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.728+0000 7fa6108c3740 1 client.16641 shutdown 2024-09-13T17:17:09.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.728+0000 7fa6108c3740 1 -- 172.21.15.87:0/705421750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1300a3f70 msgr2=0x55b1300ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.728+0000 7fa6108c3740 1 --2- 172.21.15.87:0/705421750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1300a3f70 0x55b1300ad460 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80ca260 tx=0x7fa5f8099800 comp rx=0 tx=0).stop 2024-09-13T17:17:09.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.728+0000 7fa6108c3740 1 -- 172.21.15.87:0/705421750 shutdown_connections 2024-09-13T17:17:09.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.728+0000 7fa6108c3740 1 --2- 172.21.15.87:0/705421750 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b1300c0510 0x55b1300c2930 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.728+0000 7fa6108c3740 1 --2- 172.21.15.87:0/705421750 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1300b0b60 0x55b1300ad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.728+0000 7fa6108c3740 1 --2- 172.21.15.87:0/705421750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1300a3f70 0x55b1300ad460 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.728+0000 7fa6108c3740 1 --2- 172.21.15.87:0/705421750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b1300a3650 0x55b1300b0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.728+0000 7fa5e6ffd640 0 client.16641 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:17:09.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.728+0000 7fa6108c3740 1 -- 172.21.15.87:0/705421750 >> 172.21.15.87:0/705421750 conn(0x55b13009fd00 msgr2=0x55b1300a59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:09.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.728+0000 7fa6108c3740 1 -- 172.21.15.87:0/705421750 shutdown_connections 2024-09-13T17:17:09.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.728+0000 7fa6108c3740 1 -- 172.21.15.87:0/705421750 wait complete. 2024-09-13T17:17:09.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.728+0000 7fa6108c3740 20 client.16641 trim_cache size 0 max 16384 2024-09-13T17:17:09.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.739+0000 7fa6108c3740 1 Processor -- start 2024-09-13T17:17:09.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.739+0000 7fa6108c3740 1 -- start start 2024-09-13T17:17:09.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.739+0000 7fa6108c3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1300b02a0 0x55b1300b7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.739+0000 7fa6108c3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b13009fd00 0x55b1300b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.739+0000 7fa6108c3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1300a3650 0x55b1300b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.739+0000 7fa6108c3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1300ae600 con 0x55b1300a3650 2024-09-13T17:17:09.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.739+0000 7fa6108c3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1300b3330 con 0x55b1300b02a0 2024-09-13T17:17:09.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.739+0000 7fa6108c3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b12fff91f0 con 0x55b13009fd00 2024-09-13T17:17:09.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.739+0000 7fa607fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1300a3650 0x55b1300b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.739+0000 7fa607fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1300a3650 0x55b1300b2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49218/0 (socket says 172.21.15.87:49218) 2024-09-13T17:17:09.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.739+0000 7fa607fff640 1 -- 172.21.15.87:0/2011180415 learned_addr learned my addr 172.21.15.87:0/2011180415 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:09.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.740+0000 7fa606ffd640 1 --2- 172.21.15.87:0/2011180415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b13009fd00 0x55b1300b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.740+0000 7fa6077fe640 1 --2- 172.21.15.87:0/2011180415 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1300b02a0 0x55b1300b7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.740+0000 7fa607fff640 1 -- 172.21.15.87:0/2011180415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b13009fd00 msgr2=0x55b1300b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:09.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.740+0000 7fa607fff640 1 --2- 172.21.15.87:0/2011180415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b13009fd00 0x55b1300b1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.740+0000 7fa607fff640 1 -- 172.21.15.87:0/2011180415 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1300b02a0 msgr2=0x55b1300b7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:09.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.740+0000 7fa607fff640 1 --2- 172.21.15.87:0/2011180415 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1300b02a0 0x55b1300b7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.740+0000 7fa607fff640 1 -- 172.21.15.87:0/2011180415 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b12ffa7770 con 0x55b1300a3650 2024-09-13T17:17:09.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.740+0000 7fa607fff640 1 --2- 172.21.15.87:0/2011180415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1300a3650 0x55b1300b2490 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fa600030890 tx=0x7fa600040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9516aecab402cc27 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:09.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.740+0000 7fa5fe7fc640 1 -- 172.21.15.87:0/2011180415 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa600003b70 con 0x55b1300a3650 2024-09-13T17:17:09.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.740+0000 7fa5fe7fc640 1 -- 172.21.15.87:0/2011180415 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa600030bf0 con 0x55b1300a3650 2024-09-13T17:17:09.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.740+0000 7fa5fe7fc640 1 -- 172.21.15.87:0/2011180415 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6000316f0 con 0x55b1300a3650 2024-09-13T17:17:09.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.740+0000 7fa6108c3740 1 -- 172.21.15.87:0/2011180415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1300a3650 msgr2=0x55b1300b2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.740+0000 7fa6108c3740 1 --2- 172.21.15.87:0/2011180415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1300a3650 0x55b1300b2490 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fa600030890 tx=0x7fa600040000 comp rx=0 tx=0).stop 2024-09-13T17:17:09.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.741+0000 7fa6108c3740 1 -- 172.21.15.87:0/2011180415 shutdown_connections 2024-09-13T17:17:09.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.741+0000 7fa6108c3740 1 --2- 172.21.15.87:0/2011180415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1300a3650 0x55b1300b2490 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.741+0000 7fa6108c3740 1 --2- 172.21.15.87:0/2011180415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b13009fd00 0x55b1300b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.741+0000 7fa6108c3740 1 --2- 172.21.15.87:0/2011180415 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1300b02a0 0x55b1300b7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.741+0000 7fa6108c3740 1 -- 172.21.15.87:0/2011180415 >> 172.21.15.87:0/2011180415 conn(0x55b1300a0680 msgr2=0x55b1300abd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:09.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.741+0000 7fa6108c3740 1 -- 172.21.15.87:0/2011180415 shutdown_connections 2024-09-13T17:17:09.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.741+0000 7fa6108c3740 1 -- 172.21.15.87:0/2011180415 wait complete. 2024-09-13T17:17:09.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.741+0000 7fa6108c3740 1 -- start start 2024-09-13T17:17:09.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.741+0000 7fa6108c3740 1 Processor -- start 2024-09-13T17:17:09.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.741+0000 7fa6108c3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b13009fd00 0x55b1300a7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.741+0000 7fa6108c3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1300a3650 0x55b1300a8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.741+0000 7fa6108c3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b1300b02a0 0x55b1301119f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.741+0000 7fa6108c3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b130111f30 con 0x55b1300a3650 2024-09-13T17:17:09.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.741+0000 7fa6108c3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1301120a0 con 0x55b13009fd00 2024-09-13T17:17:09.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.741+0000 7fa6108c3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b130112260 con 0x55b1300b02a0 2024-09-13T17:17:09.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.741+0000 7fa6108c3740 10 client.0 _ll_register_callbacks cb 0x7fa5f000c390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:17:09.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.741+0000 7fa606ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1300a3650 0x55b1300a8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.741+0000 7fa606ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1300a3650 0x55b1300a8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49230/0 (socket says 172.21.15.87:49230) 2024-09-13T17:17:09.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.741+0000 7fa606ffd640 1 -- 172.21.15.87:0/384782646 learned_addr learned my addr 172.21.15.87:0/384782646 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:09.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.742+0000 7fa6077fe640 1 --2- 172.21.15.87:0/384782646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b13009fd00 0x55b1300a7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.742+0000 7fa607fff640 1 --2- 172.21.15.87:0/384782646 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b1300b02a0 0x55b1301119f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.742+0000 7fa606ffd640 1 -- 172.21.15.87:0/384782646 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b1300b02a0 msgr2=0x55b1301119f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:09.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.742+0000 7fa606ffd640 1 --2- 172.21.15.87:0/384782646 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b1300b02a0 0x55b1301119f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.742+0000 7fa606ffd640 1 -- 172.21.15.87:0/384782646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b13009fd00 msgr2=0x55b1300a7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:09.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.742+0000 7fa606ffd640 1 --2- 172.21.15.87:0/384782646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b13009fd00 0x55b1300a7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.742+0000 7fa606ffd640 1 -- 172.21.15.87:0/384782646 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa608067d60 con 0x55b1300a3650 2024-09-13T17:17:09.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.742+0000 7fa6077fe640 1 --2- 172.21.15.87:0/384782646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b13009fd00 0x55b1300a7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:09.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.742+0000 7fa607fff640 1 --2- 172.21.15.87:0/384782646 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b1300b02a0 0x55b1301119f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:09.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.742+0000 7fa606ffd640 1 --2- 172.21.15.87:0/384782646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1300a3650 0x55b1300a8070 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8099b00 tx=0x7fa5f809a380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a6d8d54f31ad17 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:09.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.742+0000 7fa5e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:17:09.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.742+0000 7fa5e6ffd640 1 -- 172.21.15.87:0/384782646 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f80108e0 con 0x55b1300a3650 2024-09-13T17:17:09.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.742+0000 7fa5e6ffd640 1 -- 172.21.15.87:0/384782646 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fa5f809d9f0 con 0x55b1300a3650 2024-09-13T17:17:09.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.742+0000 7fa6108c3740 1 -- 172.21.15.87:0/384782646 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa5f0010c40 con 0x55b1300a3650 2024-09-13T17:17:09.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.742+0000 7fa5e6ffd640 1 -- 172.21.15.87:0/384782646 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5f8099bc0 con 0x55b1300a3650 2024-09-13T17:17:09.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.742+0000 7fa6108c3740 10 client.16647 fetch_fsmap learned FSMap version 30 2024-09-13T17:17:09.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.742+0000 7fa6108c3740 1 -- 172.21.15.87:0/384782646 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55b12ffcce80 con 0x55b1300a3650 2024-09-13T17:17:09.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.742+0000 7fa5e6ffd640 1 -- 172.21.15.87:0/384782646 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa5f0010c40 con 0x55b1300a3650 2024-09-13T17:17:09.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.742+0000 7fa5e6ffd640 1 -- 172.21.15.87:0/384782646 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fa5f8095a00 con 0x55b1300a3650 2024-09-13T17:17:09.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.742+0000 7fa6108c3740 10 client.16647 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:17:09.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.742+0000 7fa6108c3740 10 client.16647 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:17:09.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.742+0000 7fa6108c3740 20 client.16647 populate_metadata read hostname 'smithi087' 2024-09-13T17:17:09.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.742+0000 7fa6108c3740 1 --2- 172.21.15.87:0/384782646 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b1300a3f70 0x55b13011c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:09.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.742+0000 7fa6108c3740 4 client.16647 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:17:09.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.742+0000 7fa6108c3740 1 -- 172.21.15.87:0/384782646 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b12fcfa4e0 con 0x55b1300a3f70 2024-09-13T17:17:09.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.743+0000 7fa6077fe640 1 --2- 172.21.15.87:0/384782646 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b1300a3f70 0x55b13011c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:09.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.743+0000 7fa5e6ffd640 10 client.16647 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:17:09.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.743+0000 7fa6077fe640 1 --2- 172.21.15.87:0/384782646 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b1300a3f70 0x55b13011c8e0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8453496d5ea853c8 server_cookie=e3cf0a474c1f0955 in_seq=0 out_seq=0 2024-09-13T17:17:09.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.743+0000 7fa5e6ffd640 1 -- 172.21.15.87:0/384782646 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b12fcfa4e0 con 0x55b1300a3f70 2024-09-13T17:17:09.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.743+0000 7fa5e6ffd640 10 client.16647 handle_command_reply: tid=0 2024-09-13T17:17:09.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.743+0000 7fa6108c3740 1 client.16647 shutdown 2024-09-13T17:17:09.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.743+0000 7fa6108c3740 1 -- 172.21.15.87:0/384782646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1300a3650 msgr2=0x55b1300a8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.743+0000 7fa6108c3740 1 --2- 172.21.15.87:0/384782646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1300a3650 0x55b1300a8070 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8099b00 tx=0x7fa5f809a380 comp rx=0 tx=0).stop 2024-09-13T17:17:09.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.743+0000 7fa6108c3740 1 -- 172.21.15.87:0/384782646 shutdown_connections 2024-09-13T17:17:09.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.743+0000 7fa6108c3740 1 --2- 172.21.15.87:0/384782646 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b1300a3f70 0x55b13011c8e0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.743+0000 7fa6108c3740 1 --2- 172.21.15.87:0/384782646 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b1300b02a0 0x55b1301119f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.743+0000 7fa5e6ffd640 0 client.16647 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:17:09.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.743+0000 7fa6108c3740 1 --2- 172.21.15.87:0/384782646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b1300a3650 0x55b1300a8070 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.743+0000 7fa6108c3740 1 --2- 172.21.15.87:0/384782646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b13009fd00 0x55b1300a7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.743+0000 7fa6108c3740 1 -- 172.21.15.87:0/384782646 >> 172.21.15.87:0/384782646 conn(0x55b1300a0680 msgr2=0x55b13009e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:09.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.744+0000 7fa6108c3740 1 -- 172.21.15.87:0/384782646 shutdown_connections 2024-09-13T17:17:09.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.744+0000 7fa6108c3740 1 -- 172.21.15.87:0/384782646 wait complete. 2024-09-13T17:17:09.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.744+0000 7fa6108c3740 20 client.16647 trim_cache size 0 max 16384 2024-09-13T17:17:09.752 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:17:09.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.744+0000 7fa60db9c640 1 -- 172.21.15.87:0/3707086076 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa5f40a1280 msgr2=0x7fa5f40a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.744+0000 7fa60db9c640 1 --2- 172.21.15.87:0/3707086076 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa5f40a1280 0x7fa5f40a3740 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa6000098d0 tx=0x7fa6000095c0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.744+0000 7fa60db9c640 1 -- 172.21.15.87:0/3707086076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa608103840 msgr2=0x7fa608195760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:09.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.744+0000 7fa60db9c640 1 --2- 172.21.15.87:0/3707086076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa608103840 0x7fa608195760 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fa5f800b450 tx=0x7fa5f800b910 comp rx=0 tx=0).stop 2024-09-13T17:17:09.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.744+0000 7fa60db9c640 1 -- 172.21.15.87:0/3707086076 shutdown_connections 2024-09-13T17:17:09.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.744+0000 7fa60db9c640 1 --2- 172.21.15.87:0/3707086076 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa608199b50 0x7fa60819a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.744+0000 7fa60db9c640 1 --2- 172.21.15.87:0/3707086076 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa5f40a1280 0x7fa5f40a3740 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.744+0000 7fa60db9c640 1 --2- 172.21.15.87:0/3707086076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa608103840 0x7fa608195760 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.744+0000 7fa60db9c640 1 --2- 172.21.15.87:0/3707086076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6080feb80 0x7fa608195220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:09.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.744+0000 7fa60db9c640 1 -- 172.21.15.87:0/3707086076 >> 172.21.15.87:0/3707086076 conn(0x7fa608074110 msgr2=0x7fa6080fcb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:09.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.744+0000 7fa60db9c640 1 -- 172.21.15.87:0/3707086076 shutdown_connections 2024-09-13T17:17:09.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:09.744+0000 7fa60db9c640 1 -- 172.21.15.87:0/3707086076 wait complete. 2024-09-13T17:17:09.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:09 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3069825759' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:17:09.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:09 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3069825759' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:17:10.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:10 smithi087 ceph-mon[30934]: pgmap v103: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 335 KiB/s wr, 118 op/s 2024-09-13T17:17:10.756 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-13T17:17:10.757 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-09-13T17:17:10.764 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:10 smithi118 ceph-mon[34374]: pgmap v103: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 335 KiB/s wr, 118 op/s 2024-09-13T17:17:10.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:10 smithi149 ceph-mon[35496]: pgmap v103: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 335 KiB/s wr, 118 op/s 2024-09-13T17:17:10.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.869+0000 7f8f8d54c640 1 -- 172.21.15.87:0/2698355553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f881050a0 msgr2=0x7f8f8810cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:10.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.869+0000 7f8f8d54c640 1 --2- 172.21.15.87:0/2698355553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f881050a0 0x7f8f8810cbf0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f8f80009cd0 tx=0x7f8f8002a8e0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.869+0000 7f8f8d54c640 1 -- 172.21.15.87:0/2698355553 shutdown_connections 2024-09-13T17:17:10.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.869+0000 7f8f8d54c640 1 --2- 172.21.15.87:0/2698355553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f881050a0 0x7f8f8810cbf0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.869+0000 7f8f8d54c640 1 --2- 172.21.15.87:0/2698355553 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f88100900 0x7f8f88104940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.869+0000 7f8f8d54c640 1 --2- 172.21.15.87:0/2698355553 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f880fff50 0x7f8f88100330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.869+0000 7f8f8d54c640 1 -- 172.21.15.87:0/2698355553 >> 172.21.15.87:0/2698355553 conn(0x7f8f880fb9e0 msgr2=0x7f8f880fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:10.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.870+0000 7f8f8d54c640 1 -- 172.21.15.87:0/2698355553 shutdown_connections 2024-09-13T17:17:10.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.870+0000 7f8f8d54c640 1 -- 172.21.15.87:0/2698355553 wait complete. 2024-09-13T17:17:10.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.870+0000 7f8f8d54c640 1 Processor -- start 2024-09-13T17:17:10.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.870+0000 7f8f8d54c640 1 -- start start 2024-09-13T17:17:10.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.870+0000 7f8f8d54c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f880fff50 0x7f8f880727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:10.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.870+0000 7f8f8d54c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f881050a0 0x7f8f88072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:10.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.871+0000 7f8f8d54c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f88073230 0x7f8f881a44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:10.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.871+0000 7f8f8d54c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f881a4b40 con 0x7f8f881050a0 2024-09-13T17:17:10.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.871+0000 7f8f8d54c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f881a4cb0 con 0x7f8f880fff50 2024-09-13T17:17:10.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.871+0000 7f8f8d54c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f881a4e70 con 0x7f8f88073230 2024-09-13T17:17:10.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.871+0000 7f8f867fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f881050a0 0x7f8f88072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:10.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.871+0000 7f8f867fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f881050a0 0x7f8f88072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49248/0 (socket says 172.21.15.87:49248) 2024-09-13T17:17:10.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.871+0000 7f8f867fc640 1 -- 172.21.15.87:0/1095455924 learned_addr learned my addr 172.21.15.87:0/1095455924 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:10.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.871+0000 7f8f86ffd640 1 --2- 172.21.15.87:0/1095455924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f880fff50 0x7f8f880727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:10.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.871+0000 7f8f867fc640 1 -- 172.21.15.87:0/1095455924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f88073230 msgr2=0x7f8f881a44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:10.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.871+0000 7f8f877fe640 1 --2- 172.21.15.87:0/1095455924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f88073230 0x7f8f881a44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:10.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.871+0000 7f8f867fc640 1 --2- 172.21.15.87:0/1095455924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f88073230 0x7f8f881a44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.871+0000 7f8f867fc640 1 -- 172.21.15.87:0/1095455924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f880fff50 msgr2=0x7f8f880727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:10.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.871+0000 7f8f867fc640 1 --2- 172.21.15.87:0/1095455924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f880fff50 0x7f8f880727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.871+0000 7f8f867fc640 1 -- 172.21.15.87:0/1095455924 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f80009900 con 0x7f8f881050a0 2024-09-13T17:17:10.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.871+0000 7f8f877fe640 1 --2- 172.21.15.87:0/1095455924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f88073230 0x7f8f881a44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:10.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.871+0000 7f8f867fc640 1 --2- 172.21.15.87:0/1095455924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f881050a0 0x7f8f88072cf0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c005fd0 tx=0x7f8f7c00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:10.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.871+0000 7f8f6ffff640 1 -- 172.21.15.87:0/1095455924 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c009c30 con 0x7f8f881050a0 2024-09-13T17:17:10.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.871+0000 7f8f6ffff640 1 -- 172.21.15.87:0/1095455924 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8f7c0044d0 con 0x7f8f881050a0 2024-09-13T17:17:10.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.871+0000 7f8f6ffff640 1 -- 172.21.15.87:0/1095455924 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c003e50 con 0x7f8f881050a0 2024-09-13T17:17:10.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.871+0000 7f8f8d54c640 1 -- 172.21.15.87:0/1095455924 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f881a5150 con 0x7f8f881050a0 2024-09-13T17:17:10.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.871+0000 7f8f8d54c640 1 -- 172.21.15.87:0/1095455924 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f881a5660 con 0x7f8f881050a0 2024-09-13T17:17:10.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.873+0000 7f8f6ffff640 1 -- 172.21.15.87:0/1095455924 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f8f7c004000 con 0x7f8f881050a0 2024-09-13T17:17:10.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.874+0000 7f8f9026f740 1 Processor -- start 2024-09-13T17:17:10.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.874+0000 7f8f9026f740 1 -- start start 2024-09-13T17:17:10.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.874+0000 7f8f9026f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558fc5f7a7c0 0x558fc5f7aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:10.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.874+0000 7f8f9026f740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558fc5f7b0e0 0x558fc5f85440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:10.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.874+0000 7f8f9026f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558fc5f85980 0x558fc5f87d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:10.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.874+0000 7f8f9026f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc5ee5c60 con 0x558fc5f85980 2024-09-13T17:17:10.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.874+0000 7f8f9026f740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc5ee33f0 con 0x558fc5f7b0e0 2024-09-13T17:17:10.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.874+0000 7f8f9026f740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc5edece0 con 0x558fc5f7a7c0 2024-09-13T17:17:10.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.874+0000 7f8f6ffff640 1 --2- 172.21.15.87:0/1095455924 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8f700a1280 0x7f8f700a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:10.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.874+0000 7f8f867fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558fc5f85980 0x558fc5f87d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:10.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.874+0000 7f8f867fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558fc5f85980 0x558fc5f87d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49252/0 (socket says 172.21.15.87:49252) 2024-09-13T17:17:10.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.874+0000 7f8f867fc640 1 -- 172.21.15.87:0/1626927910 learned_addr learned my addr 172.21.15.87:0/1626927910 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:10.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.874+0000 7f8f877fe640 1 --2- 172.21.15.87:0/1626927910 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558fc5f7a7c0 0x558fc5f7aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:10.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.874+0000 7f8f877fe640 1 --2- 172.21.15.87:0/1095455924 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8f700a1280 0x7f8f700a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:10.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.874+0000 7f8f86ffd640 1 --2- 172.21.15.87:0/1626927910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558fc5f7b0e0 0x558fc5f85440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:10.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.874+0000 7f8f6ffff640 1 -- 172.21.15.87:0/1095455924 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f8f7c0ccd10 con 0x7f8f881050a0 2024-09-13T17:17:10.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.875+0000 7f8f867fc640 1 -- 172.21.15.87:0/1626927910 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558fc5f7a7c0 msgr2=0x558fc5f7aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:10.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.875+0000 7f8f867fc640 1 --2- 172.21.15.87:0/1626927910 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558fc5f7a7c0 0x558fc5f7aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.875+0000 7f8f867fc640 1 -- 172.21.15.87:0/1626927910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558fc5f7b0e0 msgr2=0x558fc5f85440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:10.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.875+0000 7f8f867fc640 1 --2- 172.21.15.87:0/1626927910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558fc5f7b0e0 0x558fc5f85440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.875+0000 7f8f867fc640 1 -- 172.21.15.87:0/1626927910 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558fc5e9a970 con 0x558fc5f85980 2024-09-13T17:17:10.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.875+0000 7f8f86ffd640 1 --2- 172.21.15.87:0/1626927910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558fc5f7b0e0 0x558fc5f85440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:10.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.875+0000 7f8f867fc640 1 --2- 172.21.15.87:0/1626927910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558fc5f85980 0x558fc5f87d70 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c0ca110 tx=0x7f8f7c021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6859f61cb2f36d05 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:10.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.875+0000 7f8f877fe640 1 --2- 172.21.15.87:0/1095455924 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8f700a1280 0x7f8f700a3740 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8f80009430 tx=0x7f8f8002a8e0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:10.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.875+0000 7f8f6d7fa640 1 -- 172.21.15.87:0/1626927910 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c0b2410 con 0x558fc5f85980 2024-09-13T17:17:10.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.875+0000 7f8f6d7fa640 1 -- 172.21.15.87:0/1626927910 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8f7c009d90 con 0x558fc5f85980 2024-09-13T17:17:10.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.875+0000 7f8f6d7fa640 1 -- 172.21.15.87:0/1626927910 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c097f20 con 0x558fc5f85980 2024-09-13T17:17:10.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.876+0000 7f8f9026f740 1 -- 172.21.15.87:0/1626927910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558fc5f85980 msgr2=0x558fc5f87d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:10.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.876+0000 7f8f9026f740 1 --2- 172.21.15.87:0/1626927910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558fc5f85980 0x558fc5f87d70 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c0ca110 tx=0x7f8f7c021000 comp rx=0 tx=0).stop 2024-09-13T17:17:10.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.876+0000 7f8f9026f740 1 -- 172.21.15.87:0/1626927910 shutdown_connections 2024-09-13T17:17:10.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.876+0000 7f8f9026f740 1 --2- 172.21.15.87:0/1626927910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558fc5f85980 0x558fc5f87d70 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.876+0000 7f8f9026f740 1 --2- 172.21.15.87:0/1626927910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558fc5f7b0e0 0x558fc5f85440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.876+0000 7f8f9026f740 1 --2- 172.21.15.87:0/1626927910 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558fc5f7a7c0 0x558fc5f7aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.876+0000 7f8f9026f740 1 -- 172.21.15.87:0/1626927910 >> 172.21.15.87:0/1626927910 conn(0x558fc5f76d50 msgr2=0x558fc5f77130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:10.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.876+0000 7f8f9026f740 1 -- 172.21.15.87:0/1626927910 shutdown_connections 2024-09-13T17:17:10.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.876+0000 7f8f9026f740 1 -- 172.21.15.87:0/1626927910 wait complete. 2024-09-13T17:17:10.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.876+0000 7f8f9026f740 1 -- start start 2024-09-13T17:17:10.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.876+0000 7f8f9026f740 1 Processor -- start 2024-09-13T17:17:10.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.876+0000 7f8f9026f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558fc5f7a7c0 0x558fc5f85360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:10.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.876+0000 7f8f9026f740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558fc5f7b0e0 0x558fc5f826a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:10.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.876+0000 7f8f9026f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558fc5f85980 0x558fc5f82c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:10.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.876+0000 7f8f9026f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc5e9cf80 con 0x558fc5f85980 2024-09-13T17:17:10.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.876+0000 7f8f9026f740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc5e9cc20 con 0x558fc5f7b0e0 2024-09-13T17:17:10.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.876+0000 7f8f9026f740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc5e69ab0 con 0x558fc5f7a7c0 2024-09-13T17:17:10.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.876+0000 7f8f9026f740 10 client.0 _ll_register_callbacks cb 0x558fc5ed8350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:17:10.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.876+0000 7f8f877fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558fc5f85980 0x558fc5f82c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:10.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.877+0000 7f8f877fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558fc5f85980 0x558fc5f82c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49260/0 (socket says 172.21.15.87:49260) 2024-09-13T17:17:10.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.877+0000 7f8f877fe640 1 -- 172.21.15.87:0/669979423 learned_addr learned my addr 172.21.15.87:0/669979423 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:10.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.877+0000 7f8f86ffd640 1 --2- 172.21.15.87:0/669979423 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558fc5f7a7c0 0x558fc5f85360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:10.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.877+0000 7f8f867fc640 1 --2- 172.21.15.87:0/669979423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558fc5f7b0e0 0x558fc5f826a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:10.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.877+0000 7f8f877fe640 1 -- 172.21.15.87:0/669979423 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558fc5f7a7c0 msgr2=0x558fc5f85360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:10.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.877+0000 7f8f877fe640 1 --2- 172.21.15.87:0/669979423 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558fc5f7a7c0 0x558fc5f85360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.877+0000 7f8f877fe640 1 -- 172.21.15.87:0/669979423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558fc5f7b0e0 msgr2=0x558fc5f826a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:10.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.877+0000 7f8f877fe640 1 --2- 172.21.15.87:0/669979423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558fc5f7b0e0 0x558fc5f826a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.877+0000 7f8f877fe640 1 -- 172.21.15.87:0/669979423 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f881a5660 con 0x558fc5f85980 2024-09-13T17:17:10.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.877+0000 7f8f867fc640 1 --2- 172.21.15.87:0/669979423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558fc5f7b0e0 0x558fc5f826a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:10.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.877+0000 7f8f877fe640 1 --2- 172.21.15.87:0/669979423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558fc5f85980 0x558fc5f82c70 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f8f80035000 tx=0x7f8f800095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e02c4b90f77c8159 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:10.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.877+0000 7f8f6aff5640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:17:10.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.877+0000 7f8f6aff5640 1 -- 172.21.15.87:0/669979423 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f80003d80 con 0x558fc5f85980 2024-09-13T17:17:10.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.877+0000 7f8f6aff5640 1 -- 172.21.15.87:0/669979423 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f8f80004040 con 0x558fc5f85980 2024-09-13T17:17:10.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.877+0000 7f8f9026f740 1 -- 172.21.15.87:0/669979423 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558fc5bd2590 con 0x558fc5f85980 2024-09-13T17:17:10.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.877+0000 7f8f6aff5640 1 -- 172.21.15.87:0/669979423 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f80004200 con 0x558fc5f85980 2024-09-13T17:17:10.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.877+0000 7f8f9026f740 10 client.16659 fetch_fsmap learned FSMap version 30 2024-09-13T17:17:10.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.877+0000 7f8f9026f740 1 -- 172.21.15.87:0/669979423 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x558fc5edd360 con 0x558fc5f85980 2024-09-13T17:17:10.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.878+0000 7f8f6aff5640 1 -- 172.21.15.87:0/669979423 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x558fc5bd2590 con 0x558fc5f85980 2024-09-13T17:17:10.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.878+0000 7f8f6aff5640 1 -- 172.21.15.87:0/669979423 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f8f8004b9a0 con 0x558fc5f85980 2024-09-13T17:17:10.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.878+0000 7f8f9026f740 10 client.16659 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:17:10.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.878+0000 7f8f9026f740 10 client.16659 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:17:10.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.878+0000 7f8f9026f740 20 client.16659 populate_metadata read hostname 'smithi087' 2024-09-13T17:17:10.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.878+0000 7f8f9026f740 1 --2- 172.21.15.87:0/669979423 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x558fc5f956b0 0x558fc5f97ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:10.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.878+0000 7f8f9026f740 4 client.16659 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:17:10.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.878+0000 7f8f9026f740 1 -- 172.21.15.87:0/669979423 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558fc5be3860 con 0x558fc5f956b0 2024-09-13T17:17:10.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.878+0000 7f8f86ffd640 1 --2- 172.21.15.87:0/669979423 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x558fc5f956b0 0x558fc5f97ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:10.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.879+0000 7f8f6aff5640 10 client.16659 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:17:10.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.879+0000 7f8f86ffd640 1 --2- 172.21.15.87:0/669979423 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x558fc5f956b0 0x558fc5f97ad0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=565ef2570d75f157 server_cookie=ae3cce2efb186680 in_seq=0 out_seq=0 2024-09-13T17:17:10.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.879+0000 7f8f6aff5640 1 -- 172.21.15.87:0/669979423 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x558fc5be3860 con 0x558fc5f956b0 2024-09-13T17:17:10.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.879+0000 7f8f6aff5640 10 client.16659 handle_command_reply: tid=0 2024-09-13T17:17:10.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.879+0000 7f8f9026f740 1 client.16659 shutdown 2024-09-13T17:17:10.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.879+0000 7f8f9026f740 1 -- 172.21.15.87:0/669979423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558fc5f85980 msgr2=0x558fc5f82c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:10.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.879+0000 7f8f9026f740 1 --2- 172.21.15.87:0/669979423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558fc5f85980 0x558fc5f82c70 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f8f80035000 tx=0x7f8f800095c0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.879+0000 7f8f9026f740 1 -- 172.21.15.87:0/669979423 shutdown_connections 2024-09-13T17:17:10.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.879+0000 7f8f9026f740 1 --2- 172.21.15.87:0/669979423 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x558fc5f956b0 0x558fc5f97ad0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.879+0000 7f8f9026f740 1 --2- 172.21.15.87:0/669979423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558fc5f85980 0x558fc5f82c70 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.879+0000 7f8f6aff5640 0 client.16659 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:17:10.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.879+0000 7f8f9026f740 1 --2- 172.21.15.87:0/669979423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558fc5f7b0e0 0x558fc5f826a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.879+0000 7f8f9026f740 1 --2- 172.21.15.87:0/669979423 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558fc5f7a7c0 0x558fc5f85360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.879+0000 7f8f9026f740 1 -- 172.21.15.87:0/669979423 >> 172.21.15.87:0/669979423 conn(0x558fc5f76d50 msgr2=0x558fc5f7c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:10.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.879+0000 7f8f9026f740 1 -- 172.21.15.87:0/669979423 shutdown_connections 2024-09-13T17:17:10.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.879+0000 7f8f9026f740 1 -- 172.21.15.87:0/669979423 wait complete. 2024-09-13T17:17:10.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.880+0000 7f8f9026f740 20 client.16659 trim_cache size 0 max 16384 2024-09-13T17:17:10.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.893+0000 7f8f9026f740 1 Processor -- start 2024-09-13T17:17:10.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.893+0000 7f8f9026f740 1 -- start start 2024-09-13T17:17:10.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.893+0000 7f8f9026f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558fc5f7a7c0 0x558fc5f8c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:10.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.893+0000 7f8f9026f740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558fc5f7b0e0 0x558fc5f8cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:10.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.893+0000 7f8f9026f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558fc5f85980 0x558fc5f80f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:10.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.893+0000 7f8f9026f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc5f93f20 con 0x558fc5f7a7c0 2024-09-13T17:17:10.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.893+0000 7f8f9026f740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc5f68ef0 con 0x558fc5f7b0e0 2024-09-13T17:17:10.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.893+0000 7f8f9026f740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc5f7b730 con 0x558fc5f85980 2024-09-13T17:17:10.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.894+0000 7f8f86ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558fc5f7a7c0 0x558fc5f8c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:10.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.894+0000 7f8f86ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558fc5f7a7c0 0x558fc5f8c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49274/0 (socket says 172.21.15.87:49274) 2024-09-13T17:17:10.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.894+0000 7f8f86ffd640 1 -- 172.21.15.87:0/3263754264 learned_addr learned my addr 172.21.15.87:0/3263754264 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:10.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.894+0000 7f8f877fe640 1 --2- 172.21.15.87:0/3263754264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558fc5f85980 0x558fc5f80f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:10.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.894+0000 7f8f86ffd640 1 -- 172.21.15.87:0/3263754264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558fc5f85980 msgr2=0x558fc5f80f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:10.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.894+0000 7f8f86ffd640 1 --2- 172.21.15.87:0/3263754264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558fc5f85980 0x558fc5f80f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.894+0000 7f8f86ffd640 1 -- 172.21.15.87:0/3263754264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558fc5f7b0e0 msgr2=0x558fc5f8cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:10.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.894+0000 7f8f86ffd640 1 --2- 172.21.15.87:0/3263754264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558fc5f7b0e0 0x558fc5f8cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.894+0000 7f8f86ffd640 1 -- 172.21.15.87:0/3263754264 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558fc5e7f1c0 con 0x558fc5f7a7c0 2024-09-13T17:17:10.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.894+0000 7f8f86ffd640 1 --2- 172.21.15.87:0/3263754264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558fc5f7a7c0 0x558fc5f8c650 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x558fc5f983e0 tx=0x7f8f780138f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d18c8498fa7c06a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:10.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.894+0000 7f8f6dffb640 1 -- 172.21.15.87:0/3263754264 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f78016040 con 0x558fc5f7a7c0 2024-09-13T17:17:10.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.894+0000 7f8f6dffb640 1 -- 172.21.15.87:0/3263754264 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8f780044d0 con 0x558fc5f7a7c0 2024-09-13T17:17:10.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.894+0000 7f8f6dffb640 1 -- 172.21.15.87:0/3263754264 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f78003970 con 0x558fc5f7a7c0 2024-09-13T17:17:10.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.895+0000 7f8f9026f740 1 -- 172.21.15.87:0/3263754264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558fc5f7a7c0 msgr2=0x558fc5f8c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:10.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.895+0000 7f8f9026f740 1 --2- 172.21.15.87:0/3263754264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558fc5f7a7c0 0x558fc5f8c650 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x558fc5f983e0 tx=0x7f8f780138f0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.895+0000 7f8f9026f740 1 -- 172.21.15.87:0/3263754264 shutdown_connections 2024-09-13T17:17:10.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.895+0000 7f8f9026f740 1 --2- 172.21.15.87:0/3263754264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558fc5f85980 0x558fc5f80f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.895+0000 7f8f9026f740 1 --2- 172.21.15.87:0/3263754264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558fc5f7b0e0 0x558fc5f8cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.895+0000 7f8f9026f740 1 --2- 172.21.15.87:0/3263754264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558fc5f7a7c0 0x558fc5f8c650 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.895+0000 7f8f9026f740 1 -- 172.21.15.87:0/3263754264 >> 172.21.15.87:0/3263754264 conn(0x558fc5f76d50 msgr2=0x558fc5f7d980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:10.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.895+0000 7f8f9026f740 1 -- 172.21.15.87:0/3263754264 shutdown_connections 2024-09-13T17:17:10.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.895+0000 7f8f9026f740 1 -- 172.21.15.87:0/3263754264 wait complete. 2024-09-13T17:17:10.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.895+0000 7f8f9026f740 1 -- start start 2024-09-13T17:17:10.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.895+0000 7f8f9026f740 1 Processor -- start 2024-09-13T17:17:10.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.895+0000 7f8f9026f740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558fc5f7a7c0 0x558fc5fe61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:10.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.895+0000 7f8f9026f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558fc5f7b0e0 0x558fc5fe66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:10.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.895+0000 7f8f9026f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558fc5f85980 0x558fc5f8bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:10.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.895+0000 7f8f9026f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc5f8c250 con 0x558fc5f7b0e0 2024-09-13T17:17:10.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.895+0000 7f8f9026f740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc5f8c3c0 con 0x558fc5f7a7c0 2024-09-13T17:17:10.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.895+0000 7f8f9026f740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc5f8c580 con 0x558fc5f85980 2024-09-13T17:17:10.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.895+0000 7f8f9026f740 10 client.0 _ll_register_callbacks cb 0x7f8f80030fa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:17:10.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.895+0000 7f8f867fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558fc5f7b0e0 0x558fc5fe66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:10.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.895+0000 7f8f867fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558fc5f7b0e0 0x558fc5fe66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49282/0 (socket says 172.21.15.87:49282) 2024-09-13T17:17:10.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.895+0000 7f8f867fc640 1 -- 172.21.15.87:0/2561330059 learned_addr learned my addr 172.21.15.87:0/2561330059 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:10.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.896+0000 7f8f877fe640 1 --2- 172.21.15.87:0/2561330059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558fc5f85980 0x558fc5f8bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:10.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.896+0000 7f8f86ffd640 1 --2- 172.21.15.87:0/2561330059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558fc5f7a7c0 0x558fc5fe61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:10.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.896+0000 7f8f867fc640 1 -- 172.21.15.87:0/2561330059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558fc5f85980 msgr2=0x558fc5f8bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:10.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.896+0000 7f8f867fc640 1 --2- 172.21.15.87:0/2561330059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558fc5f85980 0x558fc5f8bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.896+0000 7f8f867fc640 1 -- 172.21.15.87:0/2561330059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558fc5f7a7c0 msgr2=0x558fc5fe61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:10.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.896+0000 7f8f867fc640 1 --2- 172.21.15.87:0/2561330059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558fc5f7a7c0 0x558fc5fe61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.896+0000 7f8f867fc640 1 -- 172.21.15.87:0/2561330059 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558fc5ea4990 con 0x558fc5f7b0e0 2024-09-13T17:17:10.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.896+0000 7f8f86ffd640 1 --2- 172.21.15.87:0/2561330059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558fc5f7a7c0 0x558fc5fe61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:10.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.896+0000 7f8f867fc640 1 --2- 172.21.15.87:0/2561330059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558fc5f7b0e0 0x558fc5fe66f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c0ca160 tx=0x7f8f7c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a171f29dfa196cd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:10.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.896+0000 7f8f6aff5640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:17:10.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.896+0000 7f8f6aff5640 1 -- 172.21.15.87:0/2561330059 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c0b2410 con 0x558fc5f7b0e0 2024-09-13T17:17:10.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.896+0000 7f8f6aff5640 1 -- 172.21.15.87:0/2561330059 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f8f7c099a70 con 0x558fc5f7b0e0 2024-09-13T17:17:10.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.896+0000 7f8f9026f740 1 -- 172.21.15.87:0/2561330059 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8f7c009d90 con 0x558fc5f7b0e0 2024-09-13T17:17:10.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.896+0000 7f8f6aff5640 1 -- 172.21.15.87:0/2561330059 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f7c09d8a0 con 0x558fc5f7b0e0 2024-09-13T17:17:10.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.896+0000 7f8f9026f740 10 client.16665 fetch_fsmap learned FSMap version 30 2024-09-13T17:17:10.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.896+0000 7f8f9026f740 1 -- 172.21.15.87:0/2561330059 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x558fc5e8b1c0 con 0x558fc5f7b0e0 2024-09-13T17:17:10.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.896+0000 7f8f6aff5640 1 -- 172.21.15.87:0/2561330059 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8f7c009d90 con 0x558fc5f7b0e0 2024-09-13T17:17:10.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.896+0000 7f8f6aff5640 1 -- 172.21.15.87:0/2561330059 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f8f7c022020 con 0x558fc5f7b0e0 2024-09-13T17:17:10.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.896+0000 7f8f9026f740 10 client.16665 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:17:10.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.896+0000 7f8f9026f740 10 client.16665 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:17:10.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.897+0000 7f8f9026f740 20 client.16665 populate_metadata read hostname 'smithi087' 2024-09-13T17:17:10.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.897+0000 7f8f9026f740 1 --2- 172.21.15.87:0/2561330059 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x558fc5fedce0 0x558fc5ff0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:10.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.897+0000 7f8f9026f740 4 client.16665 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-13T17:17:10.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.897+0000 7f8f9026f740 1 -- 172.21.15.87:0/2561330059 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x558fc5c36eb0 con 0x558fc5fedce0 2024-09-13T17:17:10.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.897+0000 7f8f86ffd640 1 --2- 172.21.15.87:0/2561330059 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x558fc5fedce0 0x558fc5ff0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:10.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.897+0000 7f8f6aff5640 10 client.16665 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:17:10.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.897+0000 7f8f86ffd640 1 --2- 172.21.15.87:0/2561330059 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x558fc5fedce0 0x558fc5ff0100 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f47ea73bfc33d845 server_cookie=52de25822169b92d in_seq=0 out_seq=0 2024-09-13T17:17:10.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.898+0000 7f8f6aff5640 1 -- 172.21.15.87:0/2561330059 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x558fc5c36eb0 con 0x558fc5fedce0 2024-09-13T17:17:10.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.898+0000 7f8f6aff5640 10 client.16665 handle_command_reply: tid=0 2024-09-13T17:17:10.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.898+0000 7f8f9026f740 1 client.16665 shutdown 2024-09-13T17:17:10.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.898+0000 7f8f9026f740 1 -- 172.21.15.87:0/2561330059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558fc5f7b0e0 msgr2=0x558fc5fe66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:10.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.898+0000 7f8f9026f740 1 --2- 172.21.15.87:0/2561330059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558fc5f7b0e0 0x558fc5fe66f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c0ca160 tx=0x7f8f7c009f90 comp rx=0 tx=0).stop 2024-09-13T17:17:10.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.898+0000 7f8f9026f740 1 -- 172.21.15.87:0/2561330059 shutdown_connections 2024-09-13T17:17:10.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.898+0000 7f8f9026f740 1 --2- 172.21.15.87:0/2561330059 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x558fc5fedce0 0x558fc5ff0100 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.898+0000 7f8f9026f740 1 --2- 172.21.15.87:0/2561330059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558fc5f85980 0x558fc5f8bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.898+0000 7f8f9026f740 1 --2- 172.21.15.87:0/2561330059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558fc5f7b0e0 0x558fc5fe66f0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.898+0000 7f8f6aff5640 0 client.16665 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:17:10.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.898+0000 7f8f9026f740 1 --2- 172.21.15.87:0/2561330059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558fc5f7a7c0 0x558fc5fe61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.898+0000 7f8f9026f740 1 -- 172.21.15.87:0/2561330059 >> 172.21.15.87:0/2561330059 conn(0x558fc5f76d50 msgr2=0x558fc5f80de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:10.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.899+0000 7f8f9026f740 1 -- 172.21.15.87:0/2561330059 shutdown_connections 2024-09-13T17:17:10.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.899+0000 7f8f9026f740 1 -- 172.21.15.87:0/2561330059 wait complete. 2024-09-13T17:17:10.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.899+0000 7f8f9026f740 20 client.16665 trim_cache size 0 max 16384 2024-09-13T17:17:10.907 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:17:10.908 INFO:teuthology.orchestra.run.smithi087.stdout: "return_code": 0, 2024-09-13T17:17:10.908 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_tag": "3ecbe678-22c4-4d45-8a1c-8c59598befa6", 2024-09-13T17:17:10.908 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": "asynchronous" 2024-09-13T17:17:10.908 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:17:10.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.899+0000 7f8f8d54c640 1 -- 172.21.15.87:0/1095455924 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8f700a1280 msgr2=0x7f8f700a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:10.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.899+0000 7f8f8d54c640 1 --2- 172.21.15.87:0/1095455924 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8f700a1280 0x7f8f700a3740 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8f80009430 tx=0x7f8f8002a8e0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.899+0000 7f8f8d54c640 1 -- 172.21.15.87:0/1095455924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f881050a0 msgr2=0x7f8f88072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:10.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.899+0000 7f8f8d54c640 1 --2- 172.21.15.87:0/1095455924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f881050a0 0x7f8f88072cf0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c005fd0 tx=0x7f8f7c00dde0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.899+0000 7f8f8d54c640 1 -- 172.21.15.87:0/1095455924 shutdown_connections 2024-09-13T17:17:10.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.899+0000 7f8f8d54c640 1 --2- 172.21.15.87:0/1095455924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f88073230 0x7f8f881a44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.899+0000 7f8f8d54c640 1 --2- 172.21.15.87:0/1095455924 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8f700a1280 0x7f8f700a3740 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.899+0000 7f8f8d54c640 1 --2- 172.21.15.87:0/1095455924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f881050a0 0x7f8f88072cf0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.899+0000 7f8f8d54c640 1 --2- 172.21.15.87:0/1095455924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f880fff50 0x7f8f880727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:10.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.899+0000 7f8f8d54c640 1 -- 172.21.15.87:0/1095455924 >> 172.21.15.87:0/1095455924 conn(0x7f8f880fb9e0 msgr2=0x7f8f880fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:10.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.899+0000 7f8f8d54c640 1 -- 172.21.15.87:0/1095455924 shutdown_connections 2024-09-13T17:17:10.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:10.899+0000 7f8f8d54c640 1 -- 172.21.15.87:0/1095455924 wait complete. 2024-09-13T17:17:10.911 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:17:11.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.010+0000 7f23e8a61640 1 -- 172.21.15.87:0/3687860226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23e41017d0 msgr2=0x7f23e4109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:11.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.010+0000 7f23e8a61640 1 --2- 172.21.15.87:0/3687860226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23e41017d0 0x7f23e4109cb0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f23d8009900 tx=0x7f23d802a480 comp rx=0 tx=0).stop 2024-09-13T17:17:11.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.010+0000 7f23e8a61640 1 -- 172.21.15.87:0/3687860226 shutdown_connections 2024-09-13T17:17:11.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.010+0000 7f23e8a61640 1 --2- 172.21.15.87:0/3687860226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23e410a2d0 0x7f23e410c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.010+0000 7f23e8a61640 1 --2- 172.21.15.87:0/3687860226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23e41017d0 0x7f23e4109cb0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.010+0000 7f23e8a61640 1 --2- 172.21.15.87:0/3687860226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23e4100eb0 0x7f23e4101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.010+0000 7f23e8a61640 1 -- 172.21.15.87:0/3687860226 >> 172.21.15.87:0/3687860226 conn(0x7f23e40fa8c0 msgr2=0x7f23e40fcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:11.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.011+0000 7f23e8a61640 1 -- 172.21.15.87:0/3687860226 shutdown_connections 2024-09-13T17:17:11.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.011+0000 7f23e8a61640 1 -- 172.21.15.87:0/3687860226 wait complete. 2024-09-13T17:17:11.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.011+0000 7f23e8a61640 1 Processor -- start 2024-09-13T17:17:11.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.011+0000 7f23e8a61640 1 -- start start 2024-09-13T17:17:11.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.011+0000 7f23e8a61640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23e4100eb0 0x7f23e4196180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:11.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.011+0000 7f23e8a61640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23e41017d0 0x7f23e41966c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:11.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.011+0000 7f23e8a61640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23e410a2d0 0x7f23e419aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:11.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.011+0000 7f23e8a61640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e419b0b0 con 0x7f23e410a2d0 2024-09-13T17:17:11.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.012+0000 7f23e8a61640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e419b220 con 0x7f23e41017d0 2024-09-13T17:17:11.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.012+0000 7f23e8a61640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e419b3e0 con 0x7f23e4100eb0 2024-09-13T17:17:11.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.012+0000 7f23e2d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23e410a2d0 0x7f23e419aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:11.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.012+0000 7f23e2d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23e410a2d0 0x7f23e419aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49302/0 (socket says 172.21.15.87:49302) 2024-09-13T17:17:11.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.012+0000 7f23e2d9d640 1 -- 172.21.15.87:0/3948937625 learned_addr learned my addr 172.21.15.87:0/3948937625 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:11.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.012+0000 7f23e259c640 1 --2- 172.21.15.87:0/3948937625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23e4100eb0 0x7f23e4196180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:11.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.012+0000 7f23e1d9b640 1 --2- 172.21.15.87:0/3948937625 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23e41017d0 0x7f23e41966c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:11.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.012+0000 7f23e2d9d640 1 -- 172.21.15.87:0/3948937625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23e4100eb0 msgr2=0x7f23e4196180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:11.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.012+0000 7f23e2d9d640 1 --2- 172.21.15.87:0/3948937625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23e4100eb0 0x7f23e4196180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.012+0000 7f23e2d9d640 1 -- 172.21.15.87:0/3948937625 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23e41017d0 msgr2=0x7f23e41966c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:11.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.012+0000 7f23e2d9d640 1 --2- 172.21.15.87:0/3948937625 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23e41017d0 0x7f23e41966c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.012+0000 7f23e2d9d640 1 -- 172.21.15.87:0/3948937625 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d8009560 con 0x7f23e410a2d0 2024-09-13T17:17:11.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.012+0000 7f23e259c640 1 --2- 172.21.15.87:0/3948937625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23e4100eb0 0x7f23e4196180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:11.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.012+0000 7f23e2d9d640 1 --2- 172.21.15.87:0/3948937625 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23e410a2d0 0x7f23e419aab0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f23dc00cce0 tx=0x7f23dc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:11.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.012+0000 7f23d37fe640 1 -- 172.21.15.87:0/3948937625 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc00f450 con 0x7f23e410a2d0 2024-09-13T17:17:11.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.012+0000 7f23d37fe640 1 -- 172.21.15.87:0/3948937625 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f23dc00fa60 con 0x7f23e410a2d0 2024-09-13T17:17:11.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.012+0000 7f23e8a61640 1 -- 172.21.15.87:0/3948937625 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e419b6c0 con 0x7f23e410a2d0 2024-09-13T17:17:11.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.012+0000 7f23d37fe640 1 -- 172.21.15.87:0/3948937625 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc018b10 con 0x7f23e410a2d0 2024-09-13T17:17:11.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.012+0000 7f23e8a61640 1 -- 172.21.15.87:0/3948937625 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e41a2f40 con 0x7f23e410a2d0 2024-09-13T17:17:11.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.014+0000 7f23d37fe640 1 -- 172.21.15.87:0/3948937625 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f23dc00fbd0 con 0x7f23e410a2d0 2024-09-13T17:17:11.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.015+0000 7f23eb85f740 1 Processor -- start 2024-09-13T17:17:11.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.015+0000 7f23eb85f740 1 -- start start 2024-09-13T17:17:11.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.015+0000 7f23d37fe640 1 --2- 172.21.15.87:0/3948937625 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f23cc0a1280 0x7f23cc0a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:11.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.015+0000 7f23eb85f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564545ffbe10 0x564545ffc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:11.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.015+0000 7f23eb85f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564545ffc730 0x564546006a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:11.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.015+0000 7f23eb85f740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564546006fd0 0x5645460093c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:11.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.015+0000 7f23eb85f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564545f66f20 con 0x564545ffbe10 2024-09-13T17:17:11.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.015+0000 7f23eb85f740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564545f646b0 con 0x564546006fd0 2024-09-13T17:17:11.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.015+0000 7f23eb85f740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564545f5ffa0 con 0x564545ffc730 2024-09-13T17:17:11.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.015+0000 7f23e259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564545ffbe10 0x564545ffc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:11.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.015+0000 7f23e1d9b640 1 --2- 172.21.15.87:0/3948937625 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f23cc0a1280 0x7f23cc0a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:11.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.015+0000 7f23e259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564545ffbe10 0x564545ffc1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49318/0 (socket says 172.21.15.87:49318) 2024-09-13T17:17:11.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.015+0000 7f23d37fe640 1 -- 172.21.15.87:0/3948937625 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f23dc0cd460 con 0x7f23e410a2d0 2024-09-13T17:17:11.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.015+0000 7f23e259c640 1 -- 172.21.15.87:0/2790450127 learned_addr learned my addr 172.21.15.87:0/2790450127 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:11.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.016+0000 7f23e1d9b640 1 --2- 172.21.15.87:0/2790450127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564545ffc730 0x564546006a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:11.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.016+0000 7f23e2d9d640 1 --2- 172.21.15.87:0/2790450127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564546006fd0 0x5645460093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:11.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.016+0000 7f23e259c640 1 -- 172.21.15.87:0/2790450127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564545ffc730 msgr2=0x564546006a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:11.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.016+0000 7f23e259c640 1 --2- 172.21.15.87:0/2790450127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564545ffc730 0x564546006a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.016+0000 7f23e259c640 1 -- 172.21.15.87:0/2790450127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564546006fd0 msgr2=0x5645460093c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:11.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.016+0000 7f23e259c640 1 --2- 172.21.15.87:0/2790450127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564546006fd0 0x5645460093c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.016+0000 7f23e259c640 1 -- 172.21.15.87:0/2790450127 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564545f1a840 con 0x564545ffbe10 2024-09-13T17:17:11.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.016+0000 7f23e1d9b640 1 --2- 172.21.15.87:0/2790450127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564545ffc730 0x564546006a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:11.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.016+0000 7f23e259c640 1 --2- 172.21.15.87:0/2790450127 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564545ffbe10 0x564545ffc1f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f23d400bc20 tx=0x7f23d400d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=992c36b4e6c8d7fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:11.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.016+0000 7f23e1d9b640 1 --2- 172.21.15.87:0/3948937625 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f23cc0a1280 0x7f23cc0a3740 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f23d8006010 tx=0x7f23d8005e30 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:11.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.016+0000 7f23d0ff9640 1 -- 172.21.15.87:0/2790450127 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d4017620 con 0x564545ffbe10 2024-09-13T17:17:11.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.016+0000 7f23d0ff9640 1 -- 172.21.15.87:0/2790450127 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f23d4017c30 con 0x564545ffbe10 2024-09-13T17:17:11.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.016+0000 7f23d0ff9640 1 -- 172.21.15.87:0/2790450127 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d400fbb0 con 0x564545ffbe10 2024-09-13T17:17:11.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.017+0000 7f23eb85f740 1 -- 172.21.15.87:0/2790450127 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564545ffbe10 msgr2=0x564545ffc1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:11.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.017+0000 7f23eb85f740 1 --2- 172.21.15.87:0/2790450127 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564545ffbe10 0x564545ffc1f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f23d400bc20 tx=0x7f23d400d710 comp rx=0 tx=0).stop 2024-09-13T17:17:11.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.017+0000 7f23eb85f740 1 -- 172.21.15.87:0/2790450127 shutdown_connections 2024-09-13T17:17:11.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.017+0000 7f23eb85f740 1 --2- 172.21.15.87:0/2790450127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564546006fd0 0x5645460093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.017+0000 7f23eb85f740 1 --2- 172.21.15.87:0/2790450127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564545ffc730 0x564546006a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.017+0000 7f23eb85f740 1 --2- 172.21.15.87:0/2790450127 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564545ffbe10 0x564545ffc1f0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.017+0000 7f23eb85f740 1 -- 172.21.15.87:0/2790450127 >> 172.21.15.87:0/2790450127 conn(0x564545ff8380 msgr2=0x564545ff8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:11.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.017+0000 7f23eb85f740 1 -- 172.21.15.87:0/2790450127 shutdown_connections 2024-09-13T17:17:11.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.017+0000 7f23eb85f740 1 -- 172.21.15.87:0/2790450127 wait complete. 2024-09-13T17:17:11.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.017+0000 7f23eb85f740 1 -- start start 2024-09-13T17:17:11.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.017+0000 7f23eb85f740 1 Processor -- start 2024-09-13T17:17:11.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.017+0000 7f23eb85f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564545ffbe10 0x564546006940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:11.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.018+0000 7f23eb85f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564545ffc730 0x564546003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:11.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.018+0000 7f23eb85f740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564546006fd0 0x564546004140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:11.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.018+0000 7f23eb85f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564545f012a0 con 0x564545ffbe10 2024-09-13T17:17:11.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.018+0000 7f23eb85f740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564545c38430 con 0x564546006fd0 2024-09-13T17:17:11.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.018+0000 7f23eb85f740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564545ee3680 con 0x564545ffc730 2024-09-13T17:17:11.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.018+0000 7f23eb85f740 10 client.0 _ll_register_callbacks cb 0x564545f59610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:17:11.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.018+0000 7f23e259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564545ffbe10 0x564546006940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:11.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.018+0000 7f23e259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564545ffbe10 0x564546006940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49330/0 (socket says 172.21.15.87:49330) 2024-09-13T17:17:11.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.018+0000 7f23e259c640 1 -- 172.21.15.87:0/1659764980 learned_addr learned my addr 172.21.15.87:0/1659764980 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:11.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.018+0000 7f23e1d9b640 1 --2- 172.21.15.87:0/1659764980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564545ffc730 0x564546003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:11.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.018+0000 7f23e2d9d640 1 --2- 172.21.15.87:0/1659764980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564546006fd0 0x564546004140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:11.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.018+0000 7f23e259c640 1 -- 172.21.15.87:0/1659764980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564545ffc730 msgr2=0x564546003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:11.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.018+0000 7f23e259c640 1 --2- 172.21.15.87:0/1659764980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564545ffc730 0x564546003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.018+0000 7f23e259c640 1 -- 172.21.15.87:0/1659764980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564546006fd0 msgr2=0x564546004140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:11.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.018+0000 7f23e259c640 1 --2- 172.21.15.87:0/1659764980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564546006fd0 0x564546004140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.018+0000 7f23e259c640 1 -- 172.21.15.87:0/1659764980 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d400b850 con 0x564545ffbe10 2024-09-13T17:17:11.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.018+0000 7f23e259c640 1 --2- 172.21.15.87:0/1659764980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564545ffbe10 0x564546006940 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f23d400bbf0 tx=0x7f23d4005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e900bcf6baec83e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:11.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.018+0000 7f23c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:17:11.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.018+0000 7f23c9ffb640 1 -- 172.21.15.87:0/1659764980 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d4017da0 con 0x564545ffbe10 2024-09-13T17:17:11.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.018+0000 7f23c9ffb640 1 -- 172.21.15.87:0/1659764980 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f23d4013070 con 0x564545ffbe10 2024-09-13T17:17:11.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.018+0000 7f23eb85f740 1 -- 172.21.15.87:0/1659764980 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564545c534e0 con 0x564545ffbe10 2024-09-13T17:17:11.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.018+0000 7f23c9ffb640 1 -- 172.21.15.87:0/1659764980 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23d4017420 con 0x564545ffbe10 2024-09-13T17:17:11.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.018+0000 7f23eb85f740 10 client.16677 fetch_fsmap learned FSMap version 30 2024-09-13T17:17:11.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.018+0000 7f23eb85f740 1 -- 172.21.15.87:0/1659764980 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x564545f5e620 con 0x564545ffbe10 2024-09-13T17:17:11.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.019+0000 7f23c9ffb640 1 -- 172.21.15.87:0/1659764980 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x564545c534e0 con 0x564545ffbe10 2024-09-13T17:17:11.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.019+0000 7f23c9ffb640 1 -- 172.21.15.87:0/1659764980 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f23d401f070 con 0x564545ffbe10 2024-09-13T17:17:11.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.019+0000 7f23eb85f740 10 client.16677 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:17:11.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.019+0000 7f23eb85f740 10 client.16677 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:17:11.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.019+0000 7f23eb85f740 20 client.16677 populate_metadata read hostname 'smithi087' 2024-09-13T17:17:11.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.019+0000 7f23eb85f740 1 --2- 172.21.15.87:0/1659764980 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x564546016d30 0x564546019120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:11.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.019+0000 7f23eb85f740 4 client.16677 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:17:11.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.019+0000 7f23eb85f740 1 -- 172.21.15.87:0/1659764980 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564545c647e0 con 0x564546016d30 2024-09-13T17:17:11.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.019+0000 7f23e1d9b640 1 --2- 172.21.15.87:0/1659764980 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x564546016d30 0x564546019120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:11.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.020+0000 7f23c9ffb640 10 client.16677 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:17:11.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.020+0000 7f23e1d9b640 1 --2- 172.21.15.87:0/1659764980 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x564546016d30 0x564546019120 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bc9841926d99a07 server_cookie=4c0a9ccbe94f0b91 in_seq=0 out_seq=0 2024-09-13T17:17:11.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.020+0000 7f23c9ffb640 1 -- 172.21.15.87:0/1659764980 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x564545c647e0 con 0x564546016d30 2024-09-13T17:17:11.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.020+0000 7f23c9ffb640 10 client.16677 handle_command_reply: tid=0 2024-09-13T17:17:11.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.020+0000 7f23eb85f740 1 client.16677 shutdown 2024-09-13T17:17:11.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.020+0000 7f23eb85f740 1 -- 172.21.15.87:0/1659764980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564545ffbe10 msgr2=0x564546006940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:11.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.020+0000 7f23eb85f740 1 --2- 172.21.15.87:0/1659764980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564545ffbe10 0x564546006940 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f23d400bbf0 tx=0x7f23d4005c70 comp rx=0 tx=0).stop 2024-09-13T17:17:11.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.020+0000 7f23eb85f740 1 -- 172.21.15.87:0/1659764980 shutdown_connections 2024-09-13T17:17:11.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.020+0000 7f23eb85f740 1 --2- 172.21.15.87:0/1659764980 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x564546016d30 0x564546019120 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.020+0000 7f23eb85f740 1 --2- 172.21.15.87:0/1659764980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564546006fd0 0x564546004140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.020+0000 7f23eb85f740 1 --2- 172.21.15.87:0/1659764980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564545ffc730 0x564546003be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.020+0000 7f23c9ffb640 0 client.16677 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:17:11.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.020+0000 7f23eb85f740 1 --2- 172.21.15.87:0/1659764980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564545ffbe10 0x564546006940 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.020+0000 7f23eb85f740 1 -- 172.21.15.87:0/1659764980 >> 172.21.15.87:0/1659764980 conn(0x564545ff8380 msgr2=0x564545ff7510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:11.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.020+0000 7f23eb85f740 1 -- 172.21.15.87:0/1659764980 shutdown_connections 2024-09-13T17:17:11.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.020+0000 7f23eb85f740 1 -- 172.21.15.87:0/1659764980 wait complete. 2024-09-13T17:17:11.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.020+0000 7f23eb85f740 20 client.16677 trim_cache size 0 max 16384 2024-09-13T17:17:11.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.034+0000 7f23eb85f740 1 Processor -- start 2024-09-13T17:17:11.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.034+0000 7f23eb85f740 1 -- start start 2024-09-13T17:17:11.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.035+0000 7f23eb85f740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564545ffbe10 0x564545ff7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:11.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.035+0000 7f23eb85f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564545ffc730 0x56454600dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:11.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.035+0000 7f23eb85f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564546006fd0 0x56454600e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:11.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.035+0000 7f23eb85f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564546016b60 con 0x564545ffc730 2024-09-13T17:17:11.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.035+0000 7f23eb85f740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645460133b0 con 0x564545ffbe10 2024-09-13T17:17:11.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.035+0000 7f23eb85f740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564545ff3760 con 0x564546006fd0 2024-09-13T17:17:11.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.035+0000 7f23e1d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564545ffc730 0x56454600dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:11.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.035+0000 7f23e1d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564545ffc730 0x56454600dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49344/0 (socket says 172.21.15.87:49344) 2024-09-13T17:17:11.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.035+0000 7f23e1d9b640 1 -- 172.21.15.87:0/4085498242 learned_addr learned my addr 172.21.15.87:0/4085498242 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:11.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.035+0000 7f23e2d9d640 1 --2- 172.21.15.87:0/4085498242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564546006fd0 0x56454600e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:11.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.035+0000 7f23e1d9b640 1 -- 172.21.15.87:0/4085498242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564546006fd0 msgr2=0x56454600e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:11.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.035+0000 7f23e1d9b640 1 --2- 172.21.15.87:0/4085498242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564546006fd0 0x56454600e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.035+0000 7f23e1d9b640 1 -- 172.21.15.87:0/4085498242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564545ffbe10 msgr2=0x564545ff7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:11.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.035+0000 7f23e1d9b640 1 --2- 172.21.15.87:0/4085498242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564545ffbe10 0x564545ff7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.035+0000 7f23e1d9b640 1 -- 172.21.15.87:0/4085498242 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564545f00790 con 0x564545ffc730 2024-09-13T17:17:11.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.035+0000 7f23e1d9b640 1 --2- 172.21.15.87:0/4085498242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564545ffc730 0x56454600dd30 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f23d8009230 tx=0x7f23d802a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c69eea203bc16979 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:11.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.035+0000 7f23d17fa640 1 -- 172.21.15.87:0/4085498242 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d804f070 con 0x564545ffc730 2024-09-13T17:17:11.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.035+0000 7f23d17fa640 1 -- 172.21.15.87:0/4085498242 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f23d8004510 con 0x564545ffc730 2024-09-13T17:17:11.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.035+0000 7f23d17fa640 1 -- 172.21.15.87:0/4085498242 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d80503d0 con 0x564545ffc730 2024-09-13T17:17:11.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.036+0000 7f23eb85f740 1 -- 172.21.15.87:0/4085498242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564545ffc730 msgr2=0x56454600dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:11.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.036+0000 7f23eb85f740 1 --2- 172.21.15.87:0/4085498242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564545ffc730 0x56454600dd30 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f23d8009230 tx=0x7f23d802a480 comp rx=0 tx=0).stop 2024-09-13T17:17:11.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.036+0000 7f23eb85f740 1 -- 172.21.15.87:0/4085498242 shutdown_connections 2024-09-13T17:17:11.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.036+0000 7f23eb85f740 1 --2- 172.21.15.87:0/4085498242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564546006fd0 0x56454600e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.036+0000 7f23eb85f740 1 --2- 172.21.15.87:0/4085498242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564545ffc730 0x56454600dd30 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.036+0000 7f23eb85f740 1 --2- 172.21.15.87:0/4085498242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564545ffbe10 0x564545ff7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.036+0000 7f23eb85f740 1 -- 172.21.15.87:0/4085498242 >> 172.21.15.87:0/4085498242 conn(0x564545ff8380 msgr2=0x56454601da80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:11.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.036+0000 7f23eb85f740 1 -- 172.21.15.87:0/4085498242 shutdown_connections 2024-09-13T17:17:11.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.036+0000 7f23eb85f740 1 -- 172.21.15.87:0/4085498242 wait complete. 2024-09-13T17:17:11.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.036+0000 7f23eb85f740 1 -- start start 2024-09-13T17:17:11.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.036+0000 7f23eb85f740 1 Processor -- start 2024-09-13T17:17:11.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.036+0000 7f23eb85f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564545ffbe10 0x56454600dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:11.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.036+0000 7f23eb85f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564545ffc730 0x56454600e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:11.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.036+0000 7f23eb85f740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564546006fd0 0x56454600a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:11.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.036+0000 7f23eb85f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56454600aba0 con 0x564545ffc730 2024-09-13T17:17:11.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.036+0000 7f23eb85f740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56454600ad10 con 0x564546006fd0 2024-09-13T17:17:11.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.036+0000 7f23eb85f740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56454600aed0 con 0x564545ffbe10 2024-09-13T17:17:11.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.037+0000 7f23eb85f740 10 client.0 _ll_register_callbacks cb 0x7f23d400ba70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:17:11.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.037+0000 7f23e1d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564545ffc730 0x56454600e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:11.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.037+0000 7f23e1d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564545ffc730 0x56454600e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49346/0 (socket says 172.21.15.87:49346) 2024-09-13T17:17:11.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.037+0000 7f23e1d9b640 1 -- 172.21.15.87:0/969010216 learned_addr learned my addr 172.21.15.87:0/969010216 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:11.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.037+0000 7f23e259c640 1 --2- 172.21.15.87:0/969010216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564545ffbe10 0x56454600dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:11.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.037+0000 7f23e1d9b640 1 -- 172.21.15.87:0/969010216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564545ffbe10 msgr2=0x56454600dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:11.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.037+0000 7f23e1d9b640 1 --2- 172.21.15.87:0/969010216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564545ffbe10 0x56454600dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.037+0000 7f23e1d9b640 1 -- 172.21.15.87:0/969010216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564546006fd0 msgr2=0x56454600a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:11.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.037+0000 7f23e1d9b640 1 --2- 172.21.15.87:0/969010216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564546006fd0 0x56454600a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.037+0000 7f23e1d9b640 1 -- 172.21.15.87:0/969010216 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d8044070 con 0x564545ffc730 2024-09-13T17:17:11.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.037+0000 7f23e1d9b640 1 --2- 172.21.15.87:0/969010216 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564545ffc730 0x56454600e220 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f23d8032fd0 tx=0x7f23d8031860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33e5d50f1c76fbde server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:11.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.037+0000 7f23c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:17:11.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.037+0000 7f23c9ffb640 1 -- 172.21.15.87:0/969010216 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d804f070 con 0x564545ffc730 2024-09-13T17:17:11.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.037+0000 7f23c9ffb640 1 -- 172.21.15.87:0/969010216 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f23d8003ac0 con 0x564545ffc730 2024-09-13T17:17:11.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.037+0000 7f23eb85f740 1 -- 172.21.15.87:0/969010216 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f23d4017c30 con 0x564545ffc730 2024-09-13T17:17:11.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.037+0000 7f23c9ffb640 1 -- 172.21.15.87:0/969010216 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23d8003c80 con 0x564545ffc730 2024-09-13T17:17:11.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.037+0000 7f23eb85f740 10 client.16683 fetch_fsmap learned FSMap version 30 2024-09-13T17:17:11.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.037+0000 7f23eb85f740 1 -- 172.21.15.87:0/969010216 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x564545f25ea0 con 0x564545ffc730 2024-09-13T17:17:11.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.037+0000 7f23c9ffb640 1 -- 172.21.15.87:0/969010216 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f23d4017c30 con 0x564545ffc730 2024-09-13T17:17:11.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.038+0000 7f23c9ffb640 1 -- 172.21.15.87:0/969010216 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f23d8059410 con 0x564545ffc730 2024-09-13T17:17:11.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.038+0000 7f23eb85f740 10 client.16683 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:17:11.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.038+0000 7f23eb85f740 10 client.16683 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:17:11.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.038+0000 7f23eb85f740 20 client.16683 populate_metadata read hostname 'smithi087' 2024-09-13T17:17:11.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.038+0000 7f23eb85f740 1 --2- 172.21.15.87:0/969010216 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56454606e3b0 0x5645460707d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:11.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.038+0000 7f23eb85f740 4 client.16683 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:17:11.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.038+0000 7f23eb85f740 1 -- 172.21.15.87:0/969010216 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564545cb7e30 con 0x56454606e3b0 2024-09-13T17:17:11.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.038+0000 7f23e259c640 1 --2- 172.21.15.87:0/969010216 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56454606e3b0 0x5645460707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:11.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.038+0000 7f23c9ffb640 10 client.16683 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:17:11.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.038+0000 7f23e259c640 1 --2- 172.21.15.87:0/969010216 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56454606e3b0 0x5645460707d0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da6ee07ae0ef451a server_cookie=976c0ef990e8677c in_seq=0 out_seq=0 2024-09-13T17:17:11.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.039+0000 7f23c9ffb640 1 -- 172.21.15.87:0/969010216 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x564545cb7e30 con 0x56454606e3b0 2024-09-13T17:17:11.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.039+0000 7f23c9ffb640 10 client.16683 handle_command_reply: tid=0 2024-09-13T17:17:11.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.039+0000 7f23eb85f740 1 client.16683 shutdown 2024-09-13T17:17:11.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.039+0000 7f23eb85f740 1 -- 172.21.15.87:0/969010216 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564545ffc730 msgr2=0x56454600e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:11.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.039+0000 7f23eb85f740 1 --2- 172.21.15.87:0/969010216 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564545ffc730 0x56454600e220 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f23d8032fd0 tx=0x7f23d8031860 comp rx=0 tx=0).stop 2024-09-13T17:17:11.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.039+0000 7f23eb85f740 1 -- 172.21.15.87:0/969010216 shutdown_connections 2024-09-13T17:17:11.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.039+0000 7f23eb85f740 1 --2- 172.21.15.87:0/969010216 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56454606e3b0 0x5645460707d0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.039+0000 7f23eb85f740 1 --2- 172.21.15.87:0/969010216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564546006fd0 0x56454600a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.039+0000 7f23eb85f740 1 --2- 172.21.15.87:0/969010216 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564545ffc730 0x56454600e220 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.039+0000 7f23eb85f740 1 --2- 172.21.15.87:0/969010216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564545ffbe10 0x56454600dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.039+0000 7f23c9ffb640 0 client.16683 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:17:11.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.039+0000 7f23eb85f740 1 -- 172.21.15.87:0/969010216 >> 172.21.15.87:0/969010216 conn(0x564545ff8380 msgr2=0x564545ffeef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:11.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.039+0000 7f23eb85f740 1 -- 172.21.15.87:0/969010216 shutdown_connections 2024-09-13T17:17:11.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.039+0000 7f23eb85f740 1 -- 172.21.15.87:0/969010216 wait complete. 2024-09-13T17:17:11.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.039+0000 7f23eb85f740 20 client.16683 trim_cache size 0 max 16384 2024-09-13T17:17:11.047 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:17:11.047 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-13T17:17:11.047 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": { 2024-09-13T17:17:11.047 INFO:teuthology.orchestra.run.smithi087.stdout: "3ecbe678-22c4-4d45-8a1c-8c59598befa6": { 2024-09-13T17:17:11.047 INFO:teuthology.orchestra.run.smithi087.stdout: "path": "/", 2024-09-13T17:17:11.047 INFO:teuthology.orchestra.run.smithi087.stdout: "tag": "3ecbe678-22c4-4d45-8a1c-8c59598befa6", 2024-09-13T17:17:11.047 INFO:teuthology.orchestra.run.smithi087.stdout: "options": "recursive,force" 2024-09-13T17:17:11.047 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:17:11.047 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:17:11.048 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:17:11.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.039+0000 7f23e8a61640 1 -- 172.21.15.87:0/3948937625 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f23cc0a1280 msgr2=0x7f23cc0a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:11.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.039+0000 7f23e8a61640 1 --2- 172.21.15.87:0/3948937625 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f23cc0a1280 0x7f23cc0a3740 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f23d8006010 tx=0x7f23d8005e30 comp rx=0 tx=0).stop 2024-09-13T17:17:11.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.039+0000 7f23e8a61640 1 -- 172.21.15.87:0/3948937625 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23e410a2d0 msgr2=0x7f23e419aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:11.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.039+0000 7f23e8a61640 1 --2- 172.21.15.87:0/3948937625 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23e410a2d0 0x7f23e419aab0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f23dc00cce0 tx=0x7f23dc00a620 comp rx=0 tx=0).stop 2024-09-13T17:17:11.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.039+0000 7f23e8a61640 1 -- 172.21.15.87:0/3948937625 shutdown_connections 2024-09-13T17:17:11.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.039+0000 7f23e8a61640 1 --2- 172.21.15.87:0/3948937625 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f23cc0a1280 0x7f23cc0a3740 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.039+0000 7f23e8a61640 1 --2- 172.21.15.87:0/3948937625 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23e410a2d0 0x7f23e419aab0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.039+0000 7f23e8a61640 1 --2- 172.21.15.87:0/3948937625 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23e41017d0 0x7f23e41966c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.039+0000 7f23e8a61640 1 --2- 172.21.15.87:0/3948937625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23e4100eb0 0x7f23e4196180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:11.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.039+0000 7f23e8a61640 1 -- 172.21.15.87:0/3948937625 >> 172.21.15.87:0/3948937625 conn(0x7f23e40fa8c0 msgr2=0x7f23e40fc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:11.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.039+0000 7f23e8a61640 1 -- 172.21.15.87:0/3948937625 shutdown_connections 2024-09-13T17:17:11.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:11.039+0000 7f23e8a61640 1 -- 172.21.15.87:0/3948937625 wait complete. 2024-09-13T17:17:11.051 INFO:tasks.cephfs.filesystem:scrub status for tag:3ecbe678-22c4-4d45-8a1c-8c59598befa6 - {'path': '/', 'tag': '3ecbe678-22c4-4d45-8a1c-8c59598befa6', 'options': 'recursive,force'} 2024-09-13T17:17:11.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:11 smithi149 ceph-mon[35496]: pgmap v104: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 336 KiB/s wr, 122 op/s 2024-09-13T17:17:11.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:11 smithi118 ceph-mon[34374]: pgmap v104: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 336 KiB/s wr, 122 op/s 2024-09-13T17:17:11.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:11 smithi087 ceph-mon[30934]: pgmap v104: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 336 KiB/s wr, 122 op/s 2024-09-13T17:17:12.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:12 smithi149 ceph-mon[35496]: scrub queued for path: / 2024-09-13T17:17:12.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:12 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:17:12.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:12 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:17:12.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:12 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:17:12.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:12 smithi118 ceph-mon[34374]: scrub queued for path: / 2024-09-13T17:17:12.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:12 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:17:12.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:12 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:17:12.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:12 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:17:12.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:12 smithi087 ceph-mon[30934]: scrub queued for path: / 2024-09-13T17:17:12.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:12 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:17:12.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:12 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:17:12.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:12 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:17:13.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:13 smithi149 ceph-mon[35496]: pgmap v105: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 43 KiB/s wr, 22 op/s 2024-09-13T17:17:13.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:13 smithi118 ceph-mon[34374]: pgmap v105: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 43 KiB/s wr, 22 op/s 2024-09-13T17:17:13.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:13 smithi087 ceph-mon[30934]: pgmap v105: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 43 KiB/s wr, 22 op/s 2024-09-13T17:17:15.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:14 smithi149 ceph-mon[35496]: scrub summary: idle 2024-09-13T17:17:15.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:14 smithi118 ceph-mon[34374]: scrub summary: idle 2024-09-13T17:17:15.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:14 smithi087 ceph-mon[30934]: scrub summary: idle 2024-09-13T17:17:16.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:15 smithi149 ceph-mon[35496]: pgmap v106: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 43 KiB/s wr, 26 op/s 2024-09-13T17:17:16.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:15 smithi118 ceph-mon[34374]: pgmap v106: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 43 KiB/s wr, 26 op/s 2024-09-13T17:17:16.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:15 smithi087 ceph-mon[30934]: pgmap v106: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 43 KiB/s wr, 26 op/s 2024-09-13T17:17:17.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:17 smithi149 ceph-mon[35496]: pgmap v107: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 14 KiB/s wr, 10 op/s 2024-09-13T17:17:17.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:17 smithi118 ceph-mon[34374]: pgmap v107: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 14 KiB/s wr, 10 op/s 2024-09-13T17:17:17.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:17 smithi087 ceph-mon[30934]: pgmap v107: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 14 KiB/s wr, 10 op/s 2024-09-13T17:17:19.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:19 smithi149 ceph-mon[35496]: pgmap v108: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-13T17:17:19.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:19 smithi118 ceph-mon[34374]: pgmap v108: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-13T17:17:19.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:19 smithi087 ceph-mon[30934]: pgmap v108: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-13T17:17:21.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:21 smithi149 ceph-mon[35496]: pgmap v109: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-13T17:17:21.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:21 smithi118 ceph-mon[34374]: pgmap v109: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-13T17:17:21.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:21 smithi087 ceph-mon[30934]: pgmap v109: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-13T17:17:23.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:23 smithi149 ceph-mon[35496]: pgmap v110: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-13T17:17:23.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:23 smithi118 ceph-mon[34374]: pgmap v110: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-13T17:17:23.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:23 smithi087 ceph-mon[30934]: pgmap v110: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-13T17:17:25.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:25 smithi149 ceph-mon[35496]: pgmap v111: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-13T17:17:25.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:25 smithi118 ceph-mon[34374]: pgmap v111: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-13T17:17:25.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:25 smithi087 ceph-mon[30934]: pgmap v111: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-13T17:17:27.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:27 smithi149 ceph-mon[35496]: pgmap v112: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-13T17:17:27.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:27 smithi118 ceph-mon[34374]: pgmap v112: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-13T17:17:27.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:27 smithi087 ceph-mon[30934]: pgmap v112: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-13T17:17:29.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:29 smithi149 ceph-mon[35496]: pgmap v113: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:17:29.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:29 smithi118 ceph-mon[34374]: pgmap v113: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:17:29.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:29 smithi087 ceph-mon[30934]: pgmap v113: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:17:31.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:31 smithi149 ceph-mon[35496]: pgmap v114: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:17:31.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:31 smithi118 ceph-mon[34374]: pgmap v114: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:17:31.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:31 smithi087 ceph-mon[30934]: pgmap v114: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:17:33.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:33 smithi149 ceph-mon[35496]: pgmap v115: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:17:33.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:33 smithi118 ceph-mon[34374]: pgmap v115: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:17:33.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:33 smithi087 ceph-mon[30934]: pgmap v115: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:17:35.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:35 smithi149 ceph-mon[35496]: pgmap v116: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:17:35.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:35 smithi118 ceph-mon[34374]: pgmap v116: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:17:35.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:35 smithi087 ceph-mon[30934]: pgmap v116: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:17:37.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:37 smithi149 ceph-mon[35496]: pgmap v117: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:17:37.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:37 smithi118 ceph-mon[34374]: pgmap v117: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:17:37.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:37 smithi087 ceph-mon[30934]: pgmap v117: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:17:39.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:39 smithi149 ceph-mon[35496]: pgmap v118: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:17:39.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:39 smithi118 ceph-mon[34374]: pgmap v118: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:17:39.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:39 smithi087 ceph-mon[30934]: pgmap v118: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:17:41.052 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:17:41.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.164+0000 7f7850232640 1 -- 172.21.15.87:0/3286444563 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7848100f80 msgr2=0x7f7848101360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.164+0000 7f7850232640 1 --2- 172.21.15.87:0/3286444563 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7848100f80 0x7f7848101360 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f7844009ca0 tx=0x7f784402a950 comp rx=0 tx=0).stop 2024-09-13T17:17:41.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.164+0000 7f7850232640 1 -- 172.21.15.87:0/3286444563 shutdown_connections 2024-09-13T17:17:41.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.164+0000 7f7850232640 1 --2- 172.21.15.87:0/3286444563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f784810a350 0x7f784810c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.164+0000 7f7850232640 1 --2- 172.21.15.87:0/3286444563 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78481018a0 0x7f7848109d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.164+0000 7f7850232640 1 --2- 172.21.15.87:0/3286444563 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7848100f80 0x7f7848101360 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.164+0000 7f7850232640 1 -- 172.21.15.87:0/3286444563 >> 172.21.15.87:0/3286444563 conn(0x7f7848075c60 msgr2=0x7f78480fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:41.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.164+0000 7f7850232640 1 -- 172.21.15.87:0/3286444563 shutdown_connections 2024-09-13T17:17:41.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.164+0000 7f7850232640 1 -- 172.21.15.87:0/3286444563 wait complete. 2024-09-13T17:17:41.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.164+0000 7f7850232640 1 Processor -- start 2024-09-13T17:17:41.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.164+0000 7f7850232640 1 -- start start 2024-09-13T17:17:41.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.164+0000 7f7850232640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7848100f80 0x7f7848196240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.164+0000 7f7850232640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78481018a0 0x7f7848196780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.165+0000 7f7850232640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f784810a350 0x7f784819ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.165+0000 7f7850232640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784819b170 con 0x7f78481018a0 2024-09-13T17:17:41.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.165+0000 7f7850232640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784819b2e0 con 0x7f784810a350 2024-09-13T17:17:41.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.165+0000 7f7850232640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784819b4a0 con 0x7f7848100f80 2024-09-13T17:17:41.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.165+0000 7f784d7cd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78481018a0 0x7f7848196780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.165+0000 7f784d7cd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78481018a0 0x7f7848196780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44990/0 (socket says 172.21.15.87:44990) 2024-09-13T17:17:41.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.165+0000 7f784d7cd640 1 -- 172.21.15.87:0/3366503478 learned_addr learned my addr 172.21.15.87:0/3366503478 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:41.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.165+0000 7f784e7cf640 1 --2- 172.21.15.87:0/3366503478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f784810a350 0x7f784819ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.165+0000 7f784dfce640 1 --2- 172.21.15.87:0/3366503478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7848100f80 0x7f7848196240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.165+0000 7f784d7cd640 1 -- 172.21.15.87:0/3366503478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7848100f80 msgr2=0x7f7848196240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.165+0000 7f784d7cd640 1 --2- 172.21.15.87:0/3366503478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7848100f80 0x7f7848196240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.165+0000 7f784d7cd640 1 -- 172.21.15.87:0/3366503478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f784810a350 msgr2=0x7f784819ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.165+0000 7f784d7cd640 1 --2- 172.21.15.87:0/3366503478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f784810a350 0x7f784819ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.165+0000 7f784d7cd640 1 -- 172.21.15.87:0/3366503478 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7844009900 con 0x7f78481018a0 2024-09-13T17:17:41.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.165+0000 7f784dfce640 1 --2- 172.21.15.87:0/3366503478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7848100f80 0x7f7848196240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:41.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.165+0000 7f784d7cd640 1 --2- 172.21.15.87:0/3366503478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78481018a0 0x7f7848196780 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f783800c890 tx=0x7f783800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:41.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.165+0000 7f783effd640 1 -- 172.21.15.87:0/3366503478 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7838004220 con 0x7f78481018a0 2024-09-13T17:17:41.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.165+0000 7f7850232640 1 -- 172.21.15.87:0/3366503478 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f784819b780 con 0x7f78481018a0 2024-09-13T17:17:41.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.165+0000 7f783effd640 1 -- 172.21.15.87:0/3366503478 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7838007e60 con 0x7f78481018a0 2024-09-13T17:17:41.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.165+0000 7f783effd640 1 -- 172.21.15.87:0/3366503478 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7838004a00 con 0x7f78481018a0 2024-09-13T17:17:41.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.165+0000 7f7850232640 1 -- 172.21.15.87:0/3366503478 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78481a3000 con 0x7f78481018a0 2024-09-13T17:17:41.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.167+0000 7f783effd640 1 -- 172.21.15.87:0/3366503478 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f78380079b0 con 0x7f78481018a0 2024-09-13T17:17:41.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.168+0000 7f7853030740 1 Processor -- start 2024-09-13T17:17:41.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.168+0000 7f7853030740 1 -- start start 2024-09-13T17:17:41.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.168+0000 7f7853030740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c773f03e10 0x55c773f041f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.168+0000 7f7853030740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c773f04730 0x55c773f0ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.168+0000 7f7853030740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c773f0efd0 0x55c773f113c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.168+0000 7f7853030740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c773e6ef20 con 0x55c773f04730 2024-09-13T17:17:41.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.168+0000 7f7853030740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c773e6c6b0 con 0x55c773f03e10 2024-09-13T17:17:41.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.168+0000 7f783effd640 1 --2- 172.21.15.87:0/3366503478 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f78340a1200 0x7f78340a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.168+0000 7f7853030740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c773e67fa0 con 0x55c773f0efd0 2024-09-13T17:17:41.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.168+0000 7f784dfce640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c773f04730 0x55c773f0ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.169+0000 7f784dfce640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c773f04730 0x55c773f0ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45006/0 (socket says 172.21.15.87:45006) 2024-09-13T17:17:41.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.169+0000 7f784dfce640 1 -- 172.21.15.87:0/1773607900 learned_addr learned my addr 172.21.15.87:0/1773607900 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:41.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.169+0000 7f784e7cf640 1 --2- 172.21.15.87:0/1773607900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c773f03e10 0x55c773f041f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.169+0000 7f784e7cf640 1 --2- 172.21.15.87:0/3366503478 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f78340a1200 0x7f78340a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.169+0000 7f783effd640 1 -- 172.21.15.87:0/3366503478 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f78380ccda0 con 0x7f78481018a0 2024-09-13T17:17:41.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.169+0000 7f784d7cd640 1 --2- 172.21.15.87:0/1773607900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c773f0efd0 0x55c773f113c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.169+0000 7f784e7cf640 1 -- 172.21.15.87:0/1773607900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c773f0efd0 msgr2=0x55c773f113c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.169+0000 7f784e7cf640 1 --2- 172.21.15.87:0/1773607900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c773f0efd0 0x55c773f113c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.169+0000 7f784e7cf640 1 -- 172.21.15.87:0/1773607900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c773f04730 msgr2=0x55c773f0ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.169+0000 7f784e7cf640 1 --2- 172.21.15.87:0/1773607900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c773f04730 0x55c773f0ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.169+0000 7f784e7cf640 1 -- 172.21.15.87:0/1773607900 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c773e22840 con 0x55c773f03e10 2024-09-13T17:17:41.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.169+0000 7f784dfce640 1 --2- 172.21.15.87:0/1773607900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c773f04730 0x55c773f0ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:17:41.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.169+0000 7f784d7cd640 1 --2- 172.21.15.87:0/1773607900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c773f0efd0 0x55c773f113c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:41.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.169+0000 7f784e7cf640 1 --2- 172.21.15.87:0/3366503478 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f78340a1200 0x7f78340a36c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7840010740 tx=0x7f7840017000 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:41.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.169+0000 7f784e7cf640 1 --2- 172.21.15.87:0/1773607900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c773f03e10 0x55c773f041f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f78400128e0 tx=0x7f7840012da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e46047dc489e15fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:41.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.169+0000 7f7833fff640 1 -- 172.21.15.87:0/1773607900 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7840012480 con 0x55c773f03e10 2024-09-13T17:17:41.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.169+0000 7f7833fff640 1 -- 172.21.15.87:0/1773607900 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7840004500 con 0x55c773f03e10 2024-09-13T17:17:41.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.169+0000 7f7833fff640 1 -- 172.21.15.87:0/1773607900 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78400047a0 con 0x55c773f03e10 2024-09-13T17:17:41.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.170+0000 7f7853030740 1 -- 172.21.15.87:0/1773607900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c773f03e10 msgr2=0x55c773f041f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.170+0000 7f7853030740 1 --2- 172.21.15.87:0/1773607900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c773f03e10 0x55c773f041f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f78400128e0 tx=0x7f7840012da0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.170+0000 7f7853030740 1 -- 172.21.15.87:0/1773607900 shutdown_connections 2024-09-13T17:17:41.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.170+0000 7f7853030740 1 --2- 172.21.15.87:0/1773607900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c773f0efd0 0x55c773f113c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.170+0000 7f7853030740 1 --2- 172.21.15.87:0/1773607900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c773f04730 0x55c773f0ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.170+0000 7f7853030740 1 --2- 172.21.15.87:0/1773607900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c773f03e10 0x55c773f041f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.170+0000 7f7853030740 1 -- 172.21.15.87:0/1773607900 >> 172.21.15.87:0/1773607900 conn(0x55c773f00380 msgr2=0x55c773f00760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:41.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.170+0000 7f7853030740 1 -- 172.21.15.87:0/1773607900 shutdown_connections 2024-09-13T17:17:41.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.170+0000 7f7853030740 1 -- 172.21.15.87:0/1773607900 wait complete. 2024-09-13T17:17:41.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.171+0000 7f7853030740 1 -- start start 2024-09-13T17:17:41.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.171+0000 7f7853030740 1 Processor -- start 2024-09-13T17:17:41.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.171+0000 7f7853030740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c773f03e10 0x55c773f0ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.171+0000 7f7853030740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c773f04730 0x55c773f0bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.171+0000 7f7853030740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c773f0efd0 0x55c773f0c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.171+0000 7f7853030740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c773e092a0 con 0x55c773f0efd0 2024-09-13T17:17:41.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.171+0000 7f7853030740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c773b40430 con 0x55c773f03e10 2024-09-13T17:17:41.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.171+0000 7f7853030740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c773deb680 con 0x55c773f04730 2024-09-13T17:17:41.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.171+0000 7f7853030740 10 client.0 _ll_register_callbacks cb 0x55c773e61610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:17:41.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.171+0000 7f784e7cf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c773f0efd0 0x55c773f0c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.171+0000 7f784e7cf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c773f0efd0 0x55c773f0c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45020/0 (socket says 172.21.15.87:45020) 2024-09-13T17:17:41.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.171+0000 7f784e7cf640 1 -- 172.21.15.87:0/2514924664 learned_addr learned my addr 172.21.15.87:0/2514924664 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:41.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.171+0000 7f784dfce640 1 --2- 172.21.15.87:0/2514924664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c773f03e10 0x55c773f0ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.171+0000 7f784d7cd640 1 --2- 172.21.15.87:0/2514924664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c773f04730 0x55c773f0bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.172+0000 7f784e7cf640 1 -- 172.21.15.87:0/2514924664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c773f04730 msgr2=0x55c773f0bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.172+0000 7f784e7cf640 1 --2- 172.21.15.87:0/2514924664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c773f04730 0x55c773f0bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.172+0000 7f784e7cf640 1 -- 172.21.15.87:0/2514924664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c773f03e10 msgr2=0x55c773f0ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.172+0000 7f784e7cf640 1 --2- 172.21.15.87:0/2514924664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c773f03e10 0x55c773f0ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.172+0000 7f784e7cf640 1 -- 172.21.15.87:0/2514924664 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f784001a040 con 0x55c773f0efd0 2024-09-13T17:17:41.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.172+0000 7f784e7cf640 1 --2- 172.21.15.87:0/2514924664 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c773f0efd0 0x55c773f0c440 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f784000b2a0 tx=0x7f7840005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b879ba59a16b8b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:41.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.172+0000 7f78317fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:17:41.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.172+0000 7f78317fa640 1 -- 172.21.15.87:0/2514924664 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784000b8b0 con 0x55c773f0efd0 2024-09-13T17:17:41.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.172+0000 7f78317fa640 1 -- 172.21.15.87:0/2514924664 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f7840004050 con 0x55c773f0efd0 2024-09-13T17:17:41.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.172+0000 7f7853030740 1 -- 172.21.15.87:0/2514924664 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c773b6c7e0 con 0x55c773f0efd0 2024-09-13T17:17:41.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.172+0000 7f78317fa640 1 -- 172.21.15.87:0/2514924664 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7840004210 con 0x55c773f0efd0 2024-09-13T17:17:41.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.172+0000 7f7853030740 10 client.16695 fetch_fsmap learned FSMap version 30 2024-09-13T17:17:41.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.172+0000 7f7853030740 1 -- 172.21.15.87:0/2514924664 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55c773e66620 con 0x55c773f0efd0 2024-09-13T17:17:41.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.172+0000 7f78317fa640 1 -- 172.21.15.87:0/2514924664 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55c773b6c7e0 con 0x55c773f0efd0 2024-09-13T17:17:41.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.172+0000 7f78317fa640 1 -- 172.21.15.87:0/2514924664 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f784000da30 con 0x55c773f0efd0 2024-09-13T17:17:41.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.173+0000 7f7853030740 10 client.16695 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:17:41.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.173+0000 7f7853030740 10 client.16695 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:17:41.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.173+0000 7f7853030740 20 client.16695 populate_metadata read hostname 'smithi087' 2024-09-13T17:17:41.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.173+0000 7f7853030740 1 --2- 172.21.15.87:0/2514924664 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55c773f1ee10 0x55c773f21200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.173+0000 7f7853030740 4 client.16695 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:17:41.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.173+0000 7f7853030740 1 -- 172.21.15.87:0/2514924664 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c773bbfe30 con 0x55c773f1ee10 2024-09-13T17:17:41.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.173+0000 7f784dfce640 1 --2- 172.21.15.87:0/2514924664 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55c773f1ee10 0x55c773f21200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.173+0000 7f784dfce640 1 --2- 172.21.15.87:0/2514924664 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55c773f1ee10 0x55c773f21200 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=566aabd390c444e0 server_cookie=46afafe2d5cb0e13 in_seq=0 out_seq=0 2024-09-13T17:17:41.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.173+0000 7f78317fa640 10 client.16695 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:17:41.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.174+0000 7f78317fa640 1 -- 172.21.15.87:0/2514924664 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55c773bbfe30 con 0x55c773f1ee10 2024-09-13T17:17:41.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.174+0000 7f78317fa640 10 client.16695 handle_command_reply: tid=0 2024-09-13T17:17:41.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.174+0000 7f7853030740 1 client.16695 shutdown 2024-09-13T17:17:41.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.174+0000 7f7853030740 1 -- 172.21.15.87:0/2514924664 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c773f0efd0 msgr2=0x55c773f0c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.174+0000 7f7853030740 1 --2- 172.21.15.87:0/2514924664 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c773f0efd0 0x55c773f0c440 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f784000b2a0 tx=0x7f7840005780 comp rx=0 tx=0).stop 2024-09-13T17:17:41.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.174+0000 7f7853030740 1 -- 172.21.15.87:0/2514924664 shutdown_connections 2024-09-13T17:17:41.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.174+0000 7f7853030740 1 --2- 172.21.15.87:0/2514924664 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55c773f1ee10 0x55c773f21200 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.174+0000 7f7853030740 1 --2- 172.21.15.87:0/2514924664 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c773f0efd0 0x55c773f0c440 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.174+0000 7f7853030740 1 --2- 172.21.15.87:0/2514924664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c773f04730 0x55c773f0bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.174+0000 7f78317fa640 0 client.16695 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:17:41.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.174+0000 7f7853030740 1 --2- 172.21.15.87:0/2514924664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c773f03e10 0x55c773f0ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.174+0000 7f7853030740 1 -- 172.21.15.87:0/2514924664 >> 172.21.15.87:0/2514924664 conn(0x55c773f00380 msgr2=0x55c773eff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:41.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.174+0000 7f7853030740 1 -- 172.21.15.87:0/2514924664 shutdown_connections 2024-09-13T17:17:41.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.174+0000 7f7853030740 1 -- 172.21.15.87:0/2514924664 wait complete. 2024-09-13T17:17:41.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.175+0000 7f7853030740 20 client.16695 trim_cache size 0 max 16384 2024-09-13T17:17:41.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.188+0000 7f7853030740 1 Processor -- start 2024-09-13T17:17:41.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.188+0000 7f7853030740 1 -- start start 2024-09-13T17:17:41.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.189+0000 7f7853030740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c773f03e10 0x55c773effd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.189+0000 7f7853030740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c773f04730 0x55c773f15d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.189+0000 7f7853030740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c773f0efd0 0x55c773f16270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.189+0000 7f7853030740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c773f11740 con 0x55c773f0efd0 2024-09-13T17:17:41.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.189+0000 7f7853030740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c773efb760 con 0x55c773f03e10 2024-09-13T17:17:41.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.189+0000 7f7853030740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c773f04fb0 con 0x55c773f04730 2024-09-13T17:17:41.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.189+0000 7f784e7cf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c773f0efd0 0x55c773f16270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.189+0000 7f784e7cf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c773f0efd0 0x55c773f16270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45028/0 (socket says 172.21.15.87:45028) 2024-09-13T17:17:41.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.189+0000 7f784e7cf640 1 -- 172.21.15.87:0/3134211959 learned_addr learned my addr 172.21.15.87:0/3134211959 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:41.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.189+0000 7f784e7cf640 1 -- 172.21.15.87:0/3134211959 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c773f04730 msgr2=0x55c773f15d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.189+0000 7f784e7cf640 1 --2- 172.21.15.87:0/3134211959 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c773f04730 0x55c773f15d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.189+0000 7f784e7cf640 1 -- 172.21.15.87:0/3134211959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c773f03e10 msgr2=0x55c773effd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.189+0000 7f784e7cf640 1 --2- 172.21.15.87:0/3134211959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c773f03e10 0x55c773effd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.189+0000 7f784e7cf640 1 -- 172.21.15.87:0/3134211959 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c773e08790 con 0x55c773f0efd0 2024-09-13T17:17:41.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.189+0000 7f784e7cf640 1 --2- 172.21.15.87:0/3134211959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c773f0efd0 0x55c773f16270 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f7840001eb0 tx=0x7f7840005a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfaa05d48824d26d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:41.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.189+0000 7f783cff9640 1 -- 172.21.15.87:0/3134211959 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7840005380 con 0x55c773f0efd0 2024-09-13T17:17:41.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.189+0000 7f783cff9640 1 -- 172.21.15.87:0/3134211959 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7840012480 con 0x55c773f0efd0 2024-09-13T17:17:41.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.189+0000 7f783cff9640 1 -- 172.21.15.87:0/3134211959 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7840004db0 con 0x55c773f0efd0 2024-09-13T17:17:41.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.190+0000 7f7853030740 1 -- 172.21.15.87:0/3134211959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c773f0efd0 msgr2=0x55c773f16270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.190+0000 7f7853030740 1 --2- 172.21.15.87:0/3134211959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c773f0efd0 0x55c773f16270 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f7840001eb0 tx=0x7f7840005a70 comp rx=0 tx=0).stop 2024-09-13T17:17:41.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.190+0000 7f7853030740 1 -- 172.21.15.87:0/3134211959 shutdown_connections 2024-09-13T17:17:41.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.190+0000 7f7853030740 1 --2- 172.21.15.87:0/3134211959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c773f0efd0 0x55c773f16270 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.190+0000 7f7853030740 1 --2- 172.21.15.87:0/3134211959 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c773f04730 0x55c773f15d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.190+0000 7f7853030740 1 --2- 172.21.15.87:0/3134211959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c773f03e10 0x55c773effd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.190+0000 7f7853030740 1 -- 172.21.15.87:0/3134211959 >> 172.21.15.87:0/3134211959 conn(0x55c773f00380 msgr2=0x55c773f25b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:41.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.190+0000 7f7853030740 1 -- 172.21.15.87:0/3134211959 shutdown_connections 2024-09-13T17:17:41.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.190+0000 7f7853030740 1 -- 172.21.15.87:0/3134211959 wait complete. 2024-09-13T17:17:41.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.190+0000 7f7853030740 1 -- start start 2024-09-13T17:17:41.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.190+0000 7f7853030740 1 Processor -- start 2024-09-13T17:17:41.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.191+0000 7f7853030740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c773f03e10 0x55c773f15d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.191+0000 7f7853030740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c773f04730 0x55c773f122a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.191+0000 7f7853030740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c773f0efd0 0x55c773f127e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.191+0000 7f7853030740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c773f12d20 con 0x55c773f03e10 2024-09-13T17:17:41.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.191+0000 7f7853030740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c773f12e90 con 0x55c773f04730 2024-09-13T17:17:41.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.191+0000 7f7853030740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c773f13050 con 0x55c773f0efd0 2024-09-13T17:17:41.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.191+0000 7f7853030740 10 client.0 _ll_register_callbacks cb 0x7f7844009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:17:41.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.191+0000 7f784dfce640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c773f03e10 0x55c773f15d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.191+0000 7f784dfce640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c773f03e10 0x55c773f15d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45030/0 (socket says 172.21.15.87:45030) 2024-09-13T17:17:41.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.191+0000 7f784dfce640 1 -- 172.21.15.87:0/2234365264 learned_addr learned my addr 172.21.15.87:0/2234365264 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:41.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.191+0000 7f784d7cd640 1 --2- 172.21.15.87:0/2234365264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c773f04730 0x55c773f122a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.191+0000 7f784dfce640 1 -- 172.21.15.87:0/2234365264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c773f0efd0 msgr2=0x55c773f127e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.191+0000 7f784dfce640 1 --2- 172.21.15.87:0/2234365264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c773f0efd0 0x55c773f127e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.191+0000 7f784dfce640 1 -- 172.21.15.87:0/2234365264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c773f04730 msgr2=0x55c773f122a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.191+0000 7f784dfce640 1 --2- 172.21.15.87:0/2234365264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c773f04730 0x55c773f122a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.191+0000 7f784dfce640 1 -- 172.21.15.87:0/2234365264 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c773e66620 con 0x55c773f03e10 2024-09-13T17:17:41.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.191+0000 7f784d7cd640 1 --2- 172.21.15.87:0/2234365264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c773f04730 0x55c773f122a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:41.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.191+0000 7f784dfce640 1 --2- 172.21.15.87:0/2234365264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c773f03e10 0x55c773f15d60 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x55c773f011e0 tx=0x7f784402fe60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd97041134bf4349 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:41.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.191+0000 7f78317fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:17:41.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.191+0000 7f78317fa640 1 -- 172.21.15.87:0/2234365264 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7844041040 con 0x55c773f03e10 2024-09-13T17:17:41.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.191+0000 7f78317fa640 1 -- 172.21.15.87:0/2234365264 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f7844003970 con 0x55c773f03e10 2024-09-13T17:17:41.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.191+0000 7f7853030740 1 -- 172.21.15.87:0/2234365264 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c773b5b4e0 con 0x55c773f03e10 2024-09-13T17:17:41.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.191+0000 7f78317fa640 1 -- 172.21.15.87:0/2234365264 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f784402f7b0 con 0x55c773f03e10 2024-09-13T17:17:41.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.191+0000 7f7853030740 10 client.16701 fetch_fsmap learned FSMap version 30 2024-09-13T17:17:41.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.191+0000 7f7853030740 1 -- 172.21.15.87:0/2234365264 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55c773e2dea0 con 0x55c773f03e10 2024-09-13T17:17:41.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.192+0000 7f78317fa640 1 -- 172.21.15.87:0/2234365264 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55c773b5b4e0 con 0x55c773f03e10 2024-09-13T17:17:41.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.192+0000 7f78317fa640 1 -- 172.21.15.87:0/2234365264 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f784404a0e0 con 0x55c773f03e10 2024-09-13T17:17:41.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.192+0000 7f7853030740 10 client.16701 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:17:41.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.192+0000 7f7853030740 10 client.16701 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:17:41.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.192+0000 7f7853030740 20 client.16701 populate_metadata read hostname 'smithi087' 2024-09-13T17:17:41.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.192+0000 7f7853030740 1 --2- 172.21.15.87:0/2234365264 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55c773f76720 0x55c773f78b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.192+0000 7f7853030740 4 client.16701 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:17:41.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.192+0000 7f7853030740 1 -- 172.21.15.87:0/2234365264 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c773f79390 con 0x55c773f76720 2024-09-13T17:17:41.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.192+0000 7f784d7cd640 1 --2- 172.21.15.87:0/2234365264 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55c773f76720 0x55c773f78b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.192+0000 7f784d7cd640 1 --2- 172.21.15.87:0/2234365264 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55c773f76720 0x55c773f78b40 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bbf1df1b192909a server_cookie=7e58f38f0a5a9fd4 in_seq=0 out_seq=0 2024-09-13T17:17:41.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.192+0000 7f78317fa640 10 client.16701 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:17:41.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.193+0000 7f78317fa640 1 -- 172.21.15.87:0/2234365264 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55c773f79390 con 0x55c773f76720 2024-09-13T17:17:41.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.193+0000 7f78317fa640 10 client.16701 handle_command_reply: tid=0 2024-09-13T17:17:41.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.193+0000 7f7853030740 1 client.16701 shutdown 2024-09-13T17:17:41.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.193+0000 7f7853030740 1 -- 172.21.15.87:0/2234365264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c773f03e10 msgr2=0x55c773f15d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.193+0000 7f7853030740 1 --2- 172.21.15.87:0/2234365264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c773f03e10 0x55c773f15d60 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x55c773f011e0 tx=0x7f784402fe60 comp rx=0 tx=0).stop 2024-09-13T17:17:41.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.193+0000 7f7853030740 1 -- 172.21.15.87:0/2234365264 shutdown_connections 2024-09-13T17:17:41.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.193+0000 7f7853030740 1 --2- 172.21.15.87:0/2234365264 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55c773f76720 0x55c773f78b40 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.193+0000 7f7853030740 1 --2- 172.21.15.87:0/2234365264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c773f0efd0 0x55c773f127e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.193+0000 7f7853030740 1 --2- 172.21.15.87:0/2234365264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c773f04730 0x55c773f122a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.193+0000 7f78317fa640 0 client.16701 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:17:41.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.193+0000 7f7853030740 1 --2- 172.21.15.87:0/2234365264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c773f03e10 0x55c773f15d60 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.193+0000 7f7853030740 1 -- 172.21.15.87:0/2234365264 >> 172.21.15.87:0/2234365264 conn(0x55c773f00380 msgr2=0x55c773f06f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:41.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.193+0000 7f7853030740 1 -- 172.21.15.87:0/2234365264 shutdown_connections 2024-09-13T17:17:41.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.193+0000 7f7853030740 1 -- 172.21.15.87:0/2234365264 wait complete. 2024-09-13T17:17:41.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.193+0000 7f7853030740 20 client.16701 trim_cache size 0 max 16384 2024-09-13T17:17:41.202 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:17:41.202 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "no active scrubs running", 2024-09-13T17:17:41.202 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": {} 2024-09-13T17:17:41.203 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:17:41.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.193+0000 7f7850232640 1 -- 172.21.15.87:0/3366503478 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f78340a1200 msgr2=0x7f78340a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.193+0000 7f7850232640 1 --2- 172.21.15.87:0/3366503478 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f78340a1200 0x7f78340a36c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7840010740 tx=0x7f7840017000 comp rx=0 tx=0).stop 2024-09-13T17:17:41.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.193+0000 7f7850232640 1 -- 172.21.15.87:0/3366503478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78481018a0 msgr2=0x7f7848196780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.193+0000 7f7850232640 1 --2- 172.21.15.87:0/3366503478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78481018a0 0x7f7848196780 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f783800c890 tx=0x7f783800cd50 comp rx=0 tx=0).stop 2024-09-13T17:17:41.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.193+0000 7f7850232640 1 -- 172.21.15.87:0/3366503478 shutdown_connections 2024-09-13T17:17:41.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.193+0000 7f7850232640 1 --2- 172.21.15.87:0/3366503478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f784810a350 0x7f784819ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.193+0000 7f7850232640 1 --2- 172.21.15.87:0/3366503478 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f78340a1200 0x7f78340a36c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.193+0000 7f7850232640 1 --2- 172.21.15.87:0/3366503478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78481018a0 0x7f7848196780 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.193+0000 7f7850232640 1 --2- 172.21.15.87:0/3366503478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7848100f80 0x7f7848196240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.193+0000 7f7850232640 1 -- 172.21.15.87:0/3366503478 >> 172.21.15.87:0/3366503478 conn(0x7f7848075c60 msgr2=0x7f78480fb5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:41.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.194+0000 7f7850232640 1 -- 172.21.15.87:0/3366503478 shutdown_connections 2024-09-13T17:17:41.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.194+0000 7f7850232640 1 -- 172.21.15.87:0/3366503478 wait complete. 2024-09-13T17:17:41.207 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T17:17:41.207 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:17:41.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.304+0000 7f03cb59e640 1 -- 172.21.15.87:0/500931547 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03cc1004f0 msgr2=0x7f03cc10c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.304+0000 7f03cb59e640 1 --2- 172.21.15.87:0/500931547 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03cc1004f0 0x7f03cc10c9d0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f03c4009ca0 tx=0x7f03c402a8c0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.304+0000 7f03cb59e640 1 -- 172.21.15.87:0/500931547 shutdown_connections 2024-09-13T17:17:41.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.304+0000 7f03cb59e640 1 --2- 172.21.15.87:0/500931547 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03cc1004f0 0x7f03cc10c9d0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.304+0000 7f03cb59e640 1 --2- 172.21.15.87:0/500931547 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03cc0ffb50 0x7f03cc0fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.304+0000 7f03cb59e640 1 --2- 172.21.15.87:0/500931547 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03cc105c10 0x7f03cc105ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.304+0000 7f03cb59e640 1 -- 172.21.15.87:0/500931547 >> 172.21.15.87:0/500931547 conn(0x7f03cc0fb830 msgr2=0x7f03cc0fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:41.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.304+0000 7f03cb59e640 1 -- 172.21.15.87:0/500931547 shutdown_connections 2024-09-13T17:17:41.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.304+0000 7f03cb59e640 1 -- 172.21.15.87:0/500931547 wait complete. 2024-09-13T17:17:41.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.305+0000 7f03cb59e640 1 Processor -- start 2024-09-13T17:17:41.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.305+0000 7f03cb59e640 1 -- start start 2024-09-13T17:17:41.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.305+0000 7f03cb59e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03cc0ffb50 0x7f03cc195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.305+0000 7f03cb59e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03cc1004f0 0x7f03cc196510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.305+0000 7f03cb59e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03cc105c10 0x7f03cc19a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.305+0000 7f03cb59e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc19af00 con 0x7f03cc105c10 2024-09-13T17:17:41.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.305+0000 7f03cb59e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc19b070 con 0x7f03cc1004f0 2024-09-13T17:17:41.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.305+0000 7f03cb59e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc19b230 con 0x7f03cc0ffb50 2024-09-13T17:17:41.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.305+0000 7f03cad9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03cc105c10 0x7f03cc19a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.305+0000 7f03cad9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03cc105c10 0x7f03cc19a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45060/0 (socket says 172.21.15.87:45060) 2024-09-13T17:17:41.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.305+0000 7f03cad9d640 1 -- 172.21.15.87:0/457384198 learned_addr learned my addr 172.21.15.87:0/457384198 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:41.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.305+0000 7f03c9d9b640 1 --2- 172.21.15.87:0/457384198 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03cc1004f0 0x7f03cc196510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.305+0000 7f03ca59c640 1 --2- 172.21.15.87:0/457384198 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03cc0ffb50 0x7f03cc195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.305+0000 7f03cad9d640 1 -- 172.21.15.87:0/457384198 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03cc0ffb50 msgr2=0x7f03cc195fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.305+0000 7f03cad9d640 1 --2- 172.21.15.87:0/457384198 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03cc0ffb50 0x7f03cc195fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.305+0000 7f03cad9d640 1 -- 172.21.15.87:0/457384198 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03cc1004f0 msgr2=0x7f03cc196510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.305+0000 7f03cad9d640 1 --2- 172.21.15.87:0/457384198 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03cc1004f0 0x7f03cc196510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.305+0000 7f03cad9d640 1 -- 172.21.15.87:0/457384198 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c4009900 con 0x7f03cc105c10 2024-09-13T17:17:41.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.305+0000 7f03c9d9b640 1 --2- 172.21.15.87:0/457384198 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03cc1004f0 0x7f03cc196510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:41.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.305+0000 7f03cad9d640 1 --2- 172.21.15.87:0/457384198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03cc105c10 0x7f03cc19a900 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f03c40097b0 tx=0x7f03c40317a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:41.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.306+0000 7f03bb7fe640 1 -- 172.21.15.87:0/457384198 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c40309d0 con 0x7f03cc105c10 2024-09-13T17:17:41.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.306+0000 7f03bb7fe640 1 -- 172.21.15.87:0/457384198 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f03c403f070 con 0x7f03cc105c10 2024-09-13T17:17:41.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.306+0000 7f03cb59e640 1 -- 172.21.15.87:0/457384198 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03cc19b4b0 con 0x7f03cc105c10 2024-09-13T17:17:41.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.306+0000 7f03bb7fe640 1 -- 172.21.15.87:0/457384198 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c40466e0 con 0x7f03cc105c10 2024-09-13T17:17:41.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.306+0000 7f03cb59e640 1 -- 172.21.15.87:0/457384198 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03cc1a2d90 con 0x7f03cc105c10 2024-09-13T17:17:41.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.307+0000 7f03cb59e640 1 -- 172.21.15.87:0/457384198 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03cc101200 con 0x7f03cc105c10 2024-09-13T17:17:41.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.308+0000 7f03bb7fe640 1 -- 172.21.15.87:0/457384198 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f03c400a040 con 0x7f03cc105c10 2024-09-13T17:17:41.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.308+0000 7f03bb7fe640 1 --2- 172.21.15.87:0/457384198 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f03b40a1280 0x7f03b40a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.308+0000 7f03bb7fe640 1 -- 172.21.15.87:0/457384198 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f03c4041070 con 0x7f03cc105c10 2024-09-13T17:17:41.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.308+0000 7f03ca59c640 1 --2- 172.21.15.87:0/457384198 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f03b40a1280 0x7f03b40a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.309+0000 7f03ca59c640 1 --2- 172.21.15.87:0/457384198 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f03b40a1280 0x7f03b40a3740 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f03c0005fd0 tx=0x7f03c0005850 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:41.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.312+0000 7f03bb7fe640 1 -- 172.21.15.87:0/457384198 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f03c40b76e0 con 0x7f03cc105c10 2024-09-13T17:17:41.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.510+0000 7f03cb59e640 1 -- 172.21.15.87:0/457384198 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03cc0fffb0 con 0x7f03cc105c10 2024-09-13T17:17:41.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.511+0000 7f03bb7fe640 1 -- 172.21.15.87:0/457384198 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+10886 (secure 0 0 0) 0x7f03c40bad00 con 0x7f03cc105c10 2024-09-13T17:17:41.513 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:17:41.513 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/3674545180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":3674545180},{"type":"v1","addr":"172.21.15.87:6841","nonce":3674545180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:11:23.313609+0000","modified":"2024-09-13T17:16:22.516744+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24484,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6839/3052680456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3052680456},{"type":"v1","addr":"172.21.15.118:6839","nonce":3052680456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:17:41.514 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 30 2024-09-13T17:17:41.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.513+0000 7f03cb59e640 1 -- 172.21.15.87:0/457384198 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f03b40a1280 msgr2=0x7f03b40a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.513+0000 7f03cb59e640 1 --2- 172.21.15.87:0/457384198 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f03b40a1280 0x7f03b40a3740 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f03c0005fd0 tx=0x7f03c0005850 comp rx=0 tx=0).stop 2024-09-13T17:17:41.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.513+0000 7f03cb59e640 1 -- 172.21.15.87:0/457384198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03cc105c10 msgr2=0x7f03cc19a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.513+0000 7f03cb59e640 1 --2- 172.21.15.87:0/457384198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03cc105c10 0x7f03cc19a900 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f03c40097b0 tx=0x7f03c40317a0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.513+0000 7f03cb59e640 1 -- 172.21.15.87:0/457384198 shutdown_connections 2024-09-13T17:17:41.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.513+0000 7f03cb59e640 1 --2- 172.21.15.87:0/457384198 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f03b40a1280 0x7f03b40a3740 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.513+0000 7f03cb59e640 1 --2- 172.21.15.87:0/457384198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03cc105c10 0x7f03cc19a900 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.513+0000 7f03cb59e640 1 --2- 172.21.15.87:0/457384198 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03cc1004f0 0x7f03cc196510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.513+0000 7f03cb59e640 1 --2- 172.21.15.87:0/457384198 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03cc0ffb50 0x7f03cc195fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.513+0000 7f03cb59e640 1 -- 172.21.15.87:0/457384198 >> 172.21.15.87:0/457384198 conn(0x7f03cc0fb830 msgr2=0x7f03cc0fd100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:41.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.513+0000 7f03cb59e640 1 -- 172.21.15.87:0/457384198 shutdown_connections 2024-09-13T17:17:41.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.513+0000 7f03cb59e640 1 -- 172.21.15.87:0/457384198 wait complete. 2024-09-13T17:17:41.526 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-09-13T17:17:41.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.624+0000 7f8135620640 1 -- 172.21.15.87:0/3915347916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81300fee60 msgr2=0x7f81300ff240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.624+0000 7f8135620640 1 --2- 172.21.15.87:0/3915347916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81300fee60 0x7f81300ff240 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f8120009cd0 tx=0x7f812002a8e0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.624+0000 7f8135620640 1 -- 172.21.15.87:0/3915347916 shutdown_connections 2024-09-13T17:17:41.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.624+0000 7f8135620640 1 --2- 172.21.15.87:0/3915347916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8130103fb0 0x7f813010bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.624+0000 7f8135620640 1 --2- 172.21.15.87:0/3915347916 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81300ff810 0x7f8130103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.624+0000 7f8135620640 1 --2- 172.21.15.87:0/3915347916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81300fee60 0x7f81300ff240 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.624+0000 7f8135620640 1 -- 172.21.15.87:0/3915347916 >> 172.21.15.87:0/3915347916 conn(0x7f8130075c60 msgr2=0x7f81300fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:41.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.625+0000 7f8135620640 1 -- 172.21.15.87:0/3915347916 shutdown_connections 2024-09-13T17:17:41.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.625+0000 7f8135620640 1 -- 172.21.15.87:0/3915347916 wait complete. 2024-09-13T17:17:41.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.625+0000 7f8135620640 1 Processor -- start 2024-09-13T17:17:41.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.625+0000 7f8135620640 1 -- start start 2024-09-13T17:17:41.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.625+0000 7f8135620640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81300fee60 0x7f8130196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.625+0000 7f8135620640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8130103fb0 0x7f81301968d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.626+0000 7f8135620640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f813019acc0 0x7f813019b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.626+0000 7f8135620640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813019b6b0 con 0x7f81300fee60 2024-09-13T17:17:41.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.626+0000 7f8135620640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813019b820 con 0x7f8130103fb0 2024-09-13T17:17:41.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.626+0000 7f8135620640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813019b990 con 0x7f813019acc0 2024-09-13T17:17:41.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.626+0000 7f812effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81300fee60 0x7f8130196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.626+0000 7f812effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81300fee60 0x7f8130196390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45076/0 (socket says 172.21.15.87:45076) 2024-09-13T17:17:41.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.626+0000 7f812effd640 1 -- 172.21.15.87:0/1089994045 learned_addr learned my addr 172.21.15.87:0/1089994045 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:41.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.626+0000 7f812e7fc640 1 --2- 172.21.15.87:0/1089994045 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8130103fb0 0x7f81301968d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.626+0000 7f812effd640 1 -- 172.21.15.87:0/1089994045 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f813019acc0 msgr2=0x7f813019b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.626+0000 7f812effd640 1 --2- 172.21.15.87:0/1089994045 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f813019acc0 0x7f813019b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.626+0000 7f812effd640 1 -- 172.21.15.87:0/1089994045 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8130103fb0 msgr2=0x7f81301968d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.626+0000 7f812effd640 1 --2- 172.21.15.87:0/1089994045 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8130103fb0 0x7f81301968d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.626+0000 7f812effd640 1 -- 172.21.15.87:0/1089994045 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8120009900 con 0x7f81300fee60 2024-09-13T17:17:41.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.626+0000 7f812effd640 1 --2- 172.21.15.87:0/1089994045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81300fee60 0x7f8130196390 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f8120009880 tx=0x7f81200308c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:41.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.626+0000 7f8117fff640 1 -- 172.21.15.87:0/1089994045 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8120031d00 con 0x7f81300fee60 2024-09-13T17:17:41.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.626+0000 7f8117fff640 1 -- 172.21.15.87:0/1089994045 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8120003e20 con 0x7f81300fee60 2024-09-13T17:17:41.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.626+0000 7f8135620640 1 -- 172.21.15.87:0/1089994045 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81301a2f70 con 0x7f81300fee60 2024-09-13T17:17:41.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.626+0000 7f8117fff640 1 -- 172.21.15.87:0/1089994045 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8120045670 con 0x7f81300fee60 2024-09-13T17:17:41.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.626+0000 7f8135620640 1 -- 172.21.15.87:0/1089994045 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81301a3330 con 0x7f81300fee60 2024-09-13T17:17:41.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.628+0000 7f8117fff640 1 -- 172.21.15.87:0/1089994045 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f812000a040 con 0x7f81300fee60 2024-09-13T17:17:41.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.629+0000 7f813841f740 1 Processor -- start 2024-09-13T17:17:41.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.629+0000 7f813841f740 1 -- start start 2024-09-13T17:17:41.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.629+0000 7f813841f740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564b2fd68650 0x564b2fd68a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.629+0000 7f813841f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564b2fd68f70 0x564b2fd77820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.629+0000 7f813841f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b2fd77d60 0x564b2fd7a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.629+0000 7f813841f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b2fcd2cc0 con 0x564b2fd77d60 2024-09-13T17:17:41.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.629+0000 7f813841f740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b2fcd0450 con 0x564b2fd68650 2024-09-13T17:17:41.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.629+0000 7f813841f740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b2fccbd40 con 0x564b2fd68f70 2024-09-13T17:17:41.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.629+0000 7f8117fff640 1 --2- 172.21.15.87:0/1089994045 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f81180a1200 0x7f81180a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.629+0000 7f812e7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b2fd77d60 0x564b2fd7a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.629+0000 7f812e7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b2fd77d60 0x564b2fd7a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45078/0 (socket says 172.21.15.87:45078) 2024-09-13T17:17:41.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.629+0000 7f812e7fc640 1 -- 172.21.15.87:0/2391475575 learned_addr learned my addr 172.21.15.87:0/2391475575 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:41.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.629+0000 7f812f7fe640 1 --2- 172.21.15.87:0/2391475575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564b2fd68650 0x564b2fd68a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.629+0000 7f812f7fe640 1 --2- 172.21.15.87:0/1089994045 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f81180a1200 0x7f81180a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.629+0000 7f8117fff640 1 -- 172.21.15.87:0/1089994045 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f81200ee4f0 con 0x7f81300fee60 2024-09-13T17:17:41.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.629+0000 7f812effd640 1 --2- 172.21.15.87:0/2391475575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564b2fd68f70 0x564b2fd77820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.629+0000 7f812e7fc640 1 -- 172.21.15.87:0/2391475575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564b2fd68f70 msgr2=0x564b2fd77820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.629+0000 7f812e7fc640 1 --2- 172.21.15.87:0/2391475575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564b2fd68f70 0x564b2fd77820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.629+0000 7f812e7fc640 1 -- 172.21.15.87:0/2391475575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564b2fd68650 msgr2=0x564b2fd68a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.629+0000 7f812e7fc640 1 --2- 172.21.15.87:0/2391475575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564b2fd68650 0x564b2fd68a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.629+0000 7f812e7fc640 1 -- 172.21.15.87:0/2391475575 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b2fc93620 con 0x564b2fd77d60 2024-09-13T17:17:41.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.630+0000 7f812e7fc640 1 --2- 172.21.15.87:0/2391475575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b2fd77d60 0x564b2fd7a150 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f812400bc50 tx=0x7f812400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42284c36bea735b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:41.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.630+0000 7f812f7fe640 1 --2- 172.21.15.87:0/1089994045 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f81180a1200 0x7f81180a36c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f812800bfd0 tx=0x7f8128006a00 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:41.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.630+0000 7f81157fa640 1 -- 172.21.15.87:0/2391475575 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812401a460 con 0x564b2fd77d60 2024-09-13T17:17:41.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.630+0000 7f81157fa640 1 -- 172.21.15.87:0/2391475575 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f812401aa70 con 0x564b2fd77d60 2024-09-13T17:17:41.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.630+0000 7f81157fa640 1 -- 172.21.15.87:0/2391475575 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8124011a80 con 0x564b2fd77d60 2024-09-13T17:17:41.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.630+0000 7f813841f740 1 -- 172.21.15.87:0/2391475575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b2fd77d60 msgr2=0x564b2fd7a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.630+0000 7f813841f740 1 --2- 172.21.15.87:0/2391475575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b2fd77d60 0x564b2fd7a150 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f812400bc50 tx=0x7f812400f730 comp rx=0 tx=0).stop 2024-09-13T17:17:41.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.630+0000 7f813841f740 1 -- 172.21.15.87:0/2391475575 shutdown_connections 2024-09-13T17:17:41.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.630+0000 7f813841f740 1 --2- 172.21.15.87:0/2391475575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b2fd77d60 0x564b2fd7a150 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.630+0000 7f813841f740 1 --2- 172.21.15.87:0/2391475575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564b2fd68f70 0x564b2fd77820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.630+0000 7f813841f740 1 --2- 172.21.15.87:0/2391475575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564b2fd68650 0x564b2fd68a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.630+0000 7f813841f740 1 -- 172.21.15.87:0/2391475575 >> 172.21.15.87:0/2391475575 conn(0x564b2fd64d00 msgr2=0x564b2fd650e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:41.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.630+0000 7f813841f740 1 -- 172.21.15.87:0/2391475575 shutdown_connections 2024-09-13T17:17:41.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.630+0000 7f813841f740 1 -- 172.21.15.87:0/2391475575 wait complete. 2024-09-13T17:17:41.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.631+0000 7f813841f740 1 -- start start 2024-09-13T17:17:41.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.631+0000 7f813841f740 1 Processor -- start 2024-09-13T17:17:41.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.631+0000 7f813841f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564b2fd68650 0x564b2fd774c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.631+0000 7f813841f740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564b2fd68f70 0x564b2fd74790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.631+0000 7f813841f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b2fd77d60 0x564b2fd74cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.631+0000 7f813841f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b2fc8a180 con 0x564b2fd77d60 2024-09-13T17:17:41.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.631+0000 7f813841f740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b2f9a4430 con 0x564b2fd68f70 2024-09-13T17:17:41.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.631+0000 7f813841f740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b2fc4f5e0 con 0x564b2fd68650 2024-09-13T17:17:41.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.631+0000 7f813841f740 10 client.0 _ll_register_callbacks cb 0x564b2fcbbaa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:17:41.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.631+0000 7f812f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b2fd77d60 0x564b2fd74cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.631+0000 7f812f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b2fd77d60 0x564b2fd74cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45088/0 (socket says 172.21.15.87:45088) 2024-09-13T17:17:41.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.631+0000 7f812f7fe640 1 -- 172.21.15.87:0/2319690573 learned_addr learned my addr 172.21.15.87:0/2319690573 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:41.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.631+0000 7f812effd640 1 --2- 172.21.15.87:0/2319690573 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564b2fd68650 0x564b2fd774c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.631+0000 7f812e7fc640 1 --2- 172.21.15.87:0/2319690573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564b2fd68f70 0x564b2fd74790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.631+0000 7f812f7fe640 1 -- 172.21.15.87:0/2319690573 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564b2fd68650 msgr2=0x564b2fd774c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.631+0000 7f812f7fe640 1 --2- 172.21.15.87:0/2319690573 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564b2fd68650 0x564b2fd774c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.631+0000 7f812f7fe640 1 -- 172.21.15.87:0/2319690573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564b2fd68f70 msgr2=0x564b2fd74790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.631+0000 7f812f7fe640 1 --2- 172.21.15.87:0/2319690573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564b2fd68f70 0x564b2fd74790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.631+0000 7f812f7fe640 1 -- 172.21.15.87:0/2319690573 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f812400b8b0 con 0x564b2fd77d60 2024-09-13T17:17:41.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.631+0000 7f812e7fc640 1 --2- 172.21.15.87:0/2319690573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564b2fd68f70 0x564b2fd74790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:41.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.632+0000 7f812f7fe640 1 --2- 172.21.15.87:0/2319690573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b2fd77d60 0x564b2fd74cd0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f8128004b90 tx=0x7f8128004870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3420c2bc551f78c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:41.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.632+0000 7f8112ff5640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:17:41.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.632+0000 7f8112ff5640 1 -- 172.21.15.87:0/2319690573 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812800d030 con 0x564b2fd77d60 2024-09-13T17:17:41.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.632+0000 7f8112ff5640 1 -- 172.21.15.87:0/2319690573 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f812800d190 con 0x564b2fd77d60 2024-09-13T17:17:41.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.632+0000 7f813841f740 1 -- 172.21.15.87:0/2319690573 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564b2fcf5b80 con 0x564b2fd77d60 2024-09-13T17:17:41.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.632+0000 7f8112ff5640 1 -- 172.21.15.87:0/2319690573 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8128014810 con 0x564b2fd77d60 2024-09-13T17:17:41.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.632+0000 7f813841f740 10 client.16719 fetch_fsmap learned FSMap version 30 2024-09-13T17:17:41.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.632+0000 7f813841f740 1 -- 172.21.15.87:0/2319690573 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x564b2fcca3c0 con 0x564b2fd77d60 2024-09-13T17:17:41.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.632+0000 7f8112ff5640 1 -- 172.21.15.87:0/2319690573 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f812802d020 con 0x564b2fd77d60 2024-09-13T17:17:41.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.632+0000 7f8112ff5640 1 -- 172.21.15.87:0/2319690573 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f812800a070 con 0x564b2fd77d60 2024-09-13T17:17:41.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.632+0000 7f813841f740 10 client.16719 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:17:41.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.632+0000 7f813841f740 10 client.16719 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:17:41.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.632+0000 7f813841f740 20 client.16719 populate_metadata read hostname 'smithi087' 2024-09-13T17:17:41.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.632+0000 7f813841f740 1 --2- 172.21.15.87:0/2319690573 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x564b2fd878f0 0x564b2fd89d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.632+0000 7f813841f740 4 client.16719 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:17:41.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.632+0000 7f813841f740 1 -- 172.21.15.87:0/2319690573 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564b2fcbe1f0 con 0x564b2fd878f0 2024-09-13T17:17:41.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.633+0000 7f812effd640 1 --2- 172.21.15.87:0/2319690573 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x564b2fd878f0 0x564b2fd89d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.633+0000 7f8112ff5640 10 client.16719 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:17:41.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.633+0000 7f812effd640 1 --2- 172.21.15.87:0/2319690573 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x564b2fd878f0 0x564b2fd89d10 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=720959d13fabe847 server_cookie=a64e8f36c6010108 in_seq=0 out_seq=0 2024-09-13T17:17:41.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.634+0000 7f8112ff5640 1 -- 172.21.15.87:0/2319690573 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x564b2fcbe1f0 con 0x564b2fd878f0 2024-09-13T17:17:41.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.634+0000 7f8112ff5640 10 client.16719 handle_command_reply: tid=0 2024-09-13T17:17:41.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.634+0000 7f813841f740 1 client.16719 shutdown 2024-09-13T17:17:41.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.634+0000 7f813841f740 1 -- 172.21.15.87:0/2319690573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b2fd77d60 msgr2=0x564b2fd74cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.634+0000 7f813841f740 1 --2- 172.21.15.87:0/2319690573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b2fd77d60 0x564b2fd74cd0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f8128004b90 tx=0x7f8128004870 comp rx=0 tx=0).stop 2024-09-13T17:17:41.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.634+0000 7f813841f740 1 -- 172.21.15.87:0/2319690573 shutdown_connections 2024-09-13T17:17:41.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.634+0000 7f813841f740 1 --2- 172.21.15.87:0/2319690573 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x564b2fd878f0 0x564b2fd89d10 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.634+0000 7f813841f740 1 --2- 172.21.15.87:0/2319690573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b2fd77d60 0x564b2fd74cd0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.634+0000 7f813841f740 1 --2- 172.21.15.87:0/2319690573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564b2fd68f70 0x564b2fd74790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.634+0000 7f8112ff5640 0 client.16719 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:17:41.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.634+0000 7f813841f740 1 --2- 172.21.15.87:0/2319690573 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564b2fd68650 0x564b2fd774c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.634+0000 7f813841f740 1 -- 172.21.15.87:0/2319690573 >> 172.21.15.87:0/2319690573 conn(0x564b2fd64d00 msgr2=0x564b2fd6a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:41.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.634+0000 7f813841f740 1 -- 172.21.15.87:0/2319690573 shutdown_connections 2024-09-13T17:17:41.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.634+0000 7f813841f740 1 -- 172.21.15.87:0/2319690573 wait complete. 2024-09-13T17:17:41.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.634+0000 7f813841f740 20 client.16719 trim_cache size 0 max 16384 2024-09-13T17:17:41.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.645+0000 7f813841f740 1 Processor -- start 2024-09-13T17:17:41.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.645+0000 7f813841f740 1 -- start start 2024-09-13T17:17:41.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.645+0000 7f813841f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564b2fd68650 0x564b2fd646a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.645+0000 7f813841f740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564b2fd68f70 0x564b2fd7ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.645+0000 7f813841f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b2fd77d60 0x564b2fd7ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.645+0000 7f813841f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b2fd65c60 con 0x564b2fd77d60 2024-09-13T17:17:41.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.645+0000 7f813841f740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b2fd84550 con 0x564b2fd68f70 2024-09-13T17:17:41.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.645+0000 7f813841f740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b2fd83e70 con 0x564b2fd68650 2024-09-13T17:17:41.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.645+0000 7f812f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b2fd77d60 0x564b2fd7ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.645+0000 7f812f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b2fd77d60 0x564b2fd7ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45094/0 (socket says 172.21.15.87:45094) 2024-09-13T17:17:41.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.645+0000 7f812f7fe640 1 -- 172.21.15.87:0/3205737187 learned_addr learned my addr 172.21.15.87:0/3205737187 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:41.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.645+0000 7f812f7fe640 1 -- 172.21.15.87:0/3205737187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564b2fd68650 msgr2=0x564b2fd646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.645+0000 7f812f7fe640 1 --2- 172.21.15.87:0/3205737187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564b2fd68650 0x564b2fd646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.645+0000 7f812f7fe640 1 -- 172.21.15.87:0/3205737187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564b2fd68f70 msgr2=0x564b2fd7ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.645+0000 7f812f7fe640 1 --2- 172.21.15.87:0/3205737187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564b2fd68f70 0x564b2fd7ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.645+0000 7f812f7fe640 1 -- 172.21.15.87:0/3205737187 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b2fc6c770 con 0x564b2fd77d60 2024-09-13T17:17:41.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.646+0000 7f812f7fe640 1 --2- 172.21.15.87:0/3205737187 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b2fd77d60 0x564b2fd7ef60 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f8128014530 tx=0x7f8128006890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b54878427c7f91dd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:41.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.646+0000 7f8115ffb640 1 -- 172.21.15.87:0/3205737187 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812800b0e0 con 0x564b2fd77d60 2024-09-13T17:17:41.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.646+0000 7f8115ffb640 1 -- 172.21.15.87:0/3205737187 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x564b2fcf5b80 con 0x564b2fd77d60 2024-09-13T17:17:41.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.646+0000 7f8115ffb640 1 -- 172.21.15.87:0/3205737187 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812800d040 con 0x564b2fd77d60 2024-09-13T17:17:41.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.646+0000 7f813841f740 1 -- 172.21.15.87:0/3205737187 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b2fd77d60 msgr2=0x564b2fd7ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.646+0000 7f813841f740 1 --2- 172.21.15.87:0/3205737187 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b2fd77d60 0x564b2fd7ef60 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f8128014530 tx=0x7f8128006890 comp rx=0 tx=0).stop 2024-09-13T17:17:41.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.646+0000 7f813841f740 1 -- 172.21.15.87:0/3205737187 shutdown_connections 2024-09-13T17:17:41.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.646+0000 7f813841f740 1 --2- 172.21.15.87:0/3205737187 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b2fd77d60 0x564b2fd7ef60 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.646+0000 7f813841f740 1 --2- 172.21.15.87:0/3205737187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564b2fd68f70 0x564b2fd7ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.646+0000 7f813841f740 1 --2- 172.21.15.87:0/3205737187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564b2fd68650 0x564b2fd646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.646+0000 7f813841f740 1 -- 172.21.15.87:0/3205737187 >> 172.21.15.87:0/3205737187 conn(0x564b2fd64d00 msgr2=0x564b2fd73040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:41.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.646+0000 7f813841f740 1 -- 172.21.15.87:0/3205737187 shutdown_connections 2024-09-13T17:17:41.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.646+0000 7f813841f740 1 -- 172.21.15.87:0/3205737187 wait complete. 2024-09-13T17:17:41.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.647+0000 7f813841f740 1 -- start start 2024-09-13T17:17:41.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.647+0000 7f813841f740 1 Processor -- start 2024-09-13T17:17:41.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.647+0000 7f813841f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564b2fd68650 0x564b2fd7eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.647+0000 7f813841f740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564b2fd68f70 0x564b2fd7b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.647+0000 7f813841f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b2fd77d60 0x564b2fd7b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.647+0000 7f813841f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b2fd7c070 con 0x564b2fd77d60 2024-09-13T17:17:41.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.647+0000 7f813841f740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b2fd7c1e0 con 0x564b2fd68f70 2024-09-13T17:17:41.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.647+0000 7f813841f740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b2fddde60 con 0x564b2fd68650 2024-09-13T17:17:41.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.647+0000 7f813841f740 10 client.0 _ll_register_callbacks cb 0x7f812400b420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:17:41.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.647+0000 7f812f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b2fd77d60 0x564b2fd7b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.647+0000 7f812f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b2fd77d60 0x564b2fd7b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45096/0 (socket says 172.21.15.87:45096) 2024-09-13T17:17:41.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.647+0000 7f812f7fe640 1 -- 172.21.15.87:0/4270208143 learned_addr learned my addr 172.21.15.87:0/4270208143 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:41.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.647+0000 7f812e7fc640 1 --2- 172.21.15.87:0/4270208143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564b2fd68f70 0x564b2fd7b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.647+0000 7f812f7fe640 1 -- 172.21.15.87:0/4270208143 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564b2fd68650 msgr2=0x564b2fd7eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.647+0000 7f812f7fe640 1 --2- 172.21.15.87:0/4270208143 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564b2fd68650 0x564b2fd7eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.647+0000 7f812f7fe640 1 -- 172.21.15.87:0/4270208143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564b2fd68f70 msgr2=0x564b2fd7b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.647+0000 7f812f7fe640 1 --2- 172.21.15.87:0/4270208143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564b2fd68f70 0x564b2fd7b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.647+0000 7f812f7fe640 1 -- 172.21.15.87:0/4270208143 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564b2fcca3c0 con 0x564b2fd77d60 2024-09-13T17:17:41.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.647+0000 7f812f7fe640 1 --2- 172.21.15.87:0/4270208143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b2fd77d60 0x564b2fd7b970 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f81280069d0 tx=0x7f812800bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb436309fd2c8259 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:41.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.647+0000 7f8112ff5640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:17:41.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.648+0000 7f8112ff5640 1 -- 172.21.15.87:0/4270208143 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812800b0e0 con 0x564b2fd77d60 2024-09-13T17:17:41.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.648+0000 7f8112ff5640 1 -- 172.21.15.87:0/4270208143 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f812802e080 con 0x564b2fd77d60 2024-09-13T17:17:41.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.648+0000 7f813841f740 1 -- 172.21.15.87:0/4270208143 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f812401aa70 con 0x564b2fd77d60 2024-09-13T17:17:41.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.648+0000 7f8112ff5640 1 -- 172.21.15.87:0/4270208143 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f812800d4d0 con 0x564b2fd77d60 2024-09-13T17:17:41.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.648+0000 7f813841f740 10 client.16725 fetch_fsmap learned FSMap version 30 2024-09-13T17:17:41.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.648+0000 7f813841f740 1 -- 172.21.15.87:0/4270208143 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x564b2fc91e80 con 0x564b2fd77d60 2024-09-13T17:17:41.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.648+0000 7f8112ff5640 1 -- 172.21.15.87:0/4270208143 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f812401aa70 con 0x564b2fd77d60 2024-09-13T17:17:41.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.648+0000 7f8112ff5640 1 -- 172.21.15.87:0/4270208143 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f812800a040 con 0x564b2fd77d60 2024-09-13T17:17:41.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.648+0000 7f813841f740 10 client.16725 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:17:41.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.648+0000 7f813841f740 10 client.16725 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:17:41.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.648+0000 7f813841f740 20 client.16725 populate_metadata read hostname 'smithi087' 2024-09-13T17:17:41.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.648+0000 7f813841f740 1 --2- 172.21.15.87:0/4270208143 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x564b2fddf310 0x564b2fde1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.648+0000 7f813841f740 4 client.16725 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:17:41.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.648+0000 7f813841f740 1 -- 172.21.15.87:0/4270208143 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564b2f9bf4e0 con 0x564b2fddf310 2024-09-13T17:17:41.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.648+0000 7f812effd640 1 --2- 172.21.15.87:0/4270208143 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x564b2fddf310 0x564b2fde1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.649+0000 7f812effd640 1 --2- 172.21.15.87:0/4270208143 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x564b2fddf310 0x564b2fde1730 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=befe3b6a4de77d63 server_cookie=514dc6e4cd440731 in_seq=0 out_seq=0 2024-09-13T17:17:41.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.649+0000 7f8112ff5640 10 client.16725 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:17:41.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.649+0000 7f8112ff5640 1 -- 172.21.15.87:0/4270208143 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564b2f9bf4e0 con 0x564b2fddf310 2024-09-13T17:17:41.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.649+0000 7f8112ff5640 10 client.16725 handle_command_reply: tid=0 2024-09-13T17:17:41.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.649+0000 7f813841f740 1 client.16725 shutdown 2024-09-13T17:17:41.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.649+0000 7f813841f740 1 -- 172.21.15.87:0/4270208143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b2fd77d60 msgr2=0x564b2fd7b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.649+0000 7f813841f740 1 --2- 172.21.15.87:0/4270208143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b2fd77d60 0x564b2fd7b970 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f81280069d0 tx=0x7f812800bdf0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.649+0000 7f813841f740 1 -- 172.21.15.87:0/4270208143 shutdown_connections 2024-09-13T17:17:41.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.649+0000 7f813841f740 1 --2- 172.21.15.87:0/4270208143 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x564b2fddf310 0x564b2fde1730 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.649+0000 7f813841f740 1 --2- 172.21.15.87:0/4270208143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564b2fd77d60 0x564b2fd7b970 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.649+0000 7f813841f740 1 --2- 172.21.15.87:0/4270208143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564b2fd68f70 0x564b2fd7b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.649+0000 7f8112ff5640 0 client.16725 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:17:41.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.649+0000 7f813841f740 1 --2- 172.21.15.87:0/4270208143 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564b2fd68650 0x564b2fd7eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.649+0000 7f813841f740 1 -- 172.21.15.87:0/4270208143 >> 172.21.15.87:0/4270208143 conn(0x564b2fd64d00 msgr2=0x564b2fd6f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:41.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.649+0000 7f813841f740 1 -- 172.21.15.87:0/4270208143 shutdown_connections 2024-09-13T17:17:41.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.649+0000 7f813841f740 1 -- 172.21.15.87:0/4270208143 wait complete. 2024-09-13T17:17:41.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.649+0000 7f813841f740 20 client.16725 trim_cache size 0 max 16384 2024-09-13T17:17:41.658 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:17:41.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.650+0000 7f8135620640 1 -- 172.21.15.87:0/1089994045 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f81180a1200 msgr2=0x7f81180a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.650+0000 7f8135620640 1 --2- 172.21.15.87:0/1089994045 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f81180a1200 0x7f81180a36c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f812800bfd0 tx=0x7f8128006a00 comp rx=0 tx=0).stop 2024-09-13T17:17:41.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.650+0000 7f8135620640 1 -- 172.21.15.87:0/1089994045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81300fee60 msgr2=0x7f8130196390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.650+0000 7f8135620640 1 --2- 172.21.15.87:0/1089994045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81300fee60 0x7f8130196390 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f8120009880 tx=0x7f81200308c0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.650+0000 7f8135620640 1 -- 172.21.15.87:0/1089994045 shutdown_connections 2024-09-13T17:17:41.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.650+0000 7f8135620640 1 --2- 172.21.15.87:0/1089994045 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f813019acc0 0x7f813019b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.650+0000 7f8135620640 1 --2- 172.21.15.87:0/1089994045 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8130103fb0 0x7f81301968d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.650+0000 7f8135620640 1 --2- 172.21.15.87:0/1089994045 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f81180a1200 0x7f81180a36c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.650+0000 7f8135620640 1 --2- 172.21.15.87:0/1089994045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81300fee60 0x7f8130196390 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.650+0000 7f8135620640 1 -- 172.21.15.87:0/1089994045 >> 172.21.15.87:0/1089994045 conn(0x7f8130075c60 msgr2=0x7f8130102320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:41.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.650+0000 7f8135620640 1 -- 172.21.15.87:0/1089994045 shutdown_connections 2024-09-13T17:17:41.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.650+0000 7f8135620640 1 -- 172.21.15.87:0/1089994045 wait complete. 2024-09-13T17:17:41.663 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-09-13T17:17:41.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.760+0000 7f52090e9640 1 -- 172.21.15.87:0/1534064321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52040fee60 msgr2=0x7f52040ff240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.760+0000 7f52090e9640 1 --2- 172.21.15.87:0/1534064321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52040fee60 0x7f52040ff240 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f51f4009cd0 tx=0x7f51f402a8e0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.760+0000 7f52090e9640 1 -- 172.21.15.87:0/1534064321 shutdown_connections 2024-09-13T17:17:41.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.760+0000 7f52090e9640 1 --2- 172.21.15.87:0/1534064321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5204103fb0 0x7f520410bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.760+0000 7f52090e9640 1 --2- 172.21.15.87:0/1534064321 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52040ff810 0x7f5204103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.760+0000 7f52090e9640 1 --2- 172.21.15.87:0/1534064321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52040fee60 0x7f52040ff240 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.760+0000 7f52090e9640 1 -- 172.21.15.87:0/1534064321 >> 172.21.15.87:0/1534064321 conn(0x7f5204075c60 msgr2=0x7f52040fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:41.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.760+0000 7f52090e9640 1 -- 172.21.15.87:0/1534064321 shutdown_connections 2024-09-13T17:17:41.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.760+0000 7f52090e9640 1 -- 172.21.15.87:0/1534064321 wait complete. 2024-09-13T17:17:41.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.761+0000 7f52090e9640 1 Processor -- start 2024-09-13T17:17:41.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.761+0000 7f52090e9640 1 -- start start 2024-09-13T17:17:41.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.761+0000 7f52090e9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52040fee60 0x7f5204196330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.761+0000 7f52090e9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5204103fb0 0x7f5204196870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.761+0000 7f52090e9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f520419ac60 0x7f520419b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.761+0000 7f52090e9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520419b650 con 0x7f5204103fb0 2024-09-13T17:17:41.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.761+0000 7f52090e9640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520419b7c0 con 0x7f520419ac60 2024-09-13T17:17:41.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.761+0000 7f52090e9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520419b930 con 0x7f52040fee60 2024-09-13T17:17:41.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.762+0000 7f520259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5204103fb0 0x7f5204196870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.762+0000 7f520259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5204103fb0 0x7f5204196870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45110/0 (socket says 172.21.15.87:45110) 2024-09-13T17:17:41.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.762+0000 7f520259c640 1 -- 172.21.15.87:0/2631636713 learned_addr learned my addr 172.21.15.87:0/2631636713 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:41.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.762+0000 7f5202d9d640 1 --2- 172.21.15.87:0/2631636713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52040fee60 0x7f5204196330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.762+0000 7f520359e640 1 --2- 172.21.15.87:0/2631636713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f520419ac60 0x7f520419b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.762+0000 7f520259c640 1 -- 172.21.15.87:0/2631636713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52040fee60 msgr2=0x7f5204196330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.762+0000 7f520259c640 1 --2- 172.21.15.87:0/2631636713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52040fee60 0x7f5204196330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.762+0000 7f520259c640 1 -- 172.21.15.87:0/2631636713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f520419ac60 msgr2=0x7f520419b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.762+0000 7f520259c640 1 --2- 172.21.15.87:0/2631636713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f520419ac60 0x7f520419b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.762+0000 7f520259c640 1 -- 172.21.15.87:0/2631636713 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f4009900 con 0x7f5204103fb0 2024-09-13T17:17:41.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.762+0000 7f520359e640 1 --2- 172.21.15.87:0/2631636713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f520419ac60 0x7f520419b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:41.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.762+0000 7f5202d9d640 1 --2- 172.21.15.87:0/2631636713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52040fee60 0x7f5204196330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:41.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.762+0000 7f520259c640 1 --2- 172.21.15.87:0/2631636713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5204103fb0 0x7f5204196870 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f51f8005fd0 tx=0x7f51f800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:41.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.762+0000 7f51ebfff640 1 -- 172.21.15.87:0/2631636713 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f8009c30 con 0x7f5204103fb0 2024-09-13T17:17:41.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.762+0000 7f52090e9640 1 -- 172.21.15.87:0/2631636713 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52041a2f10 con 0x7f5204103fb0 2024-09-13T17:17:41.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.762+0000 7f51ebfff640 1 -- 172.21.15.87:0/2631636713 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f51f80044d0 con 0x7f5204103fb0 2024-09-13T17:17:41.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.762+0000 7f51ebfff640 1 -- 172.21.15.87:0/2631636713 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f8003e50 con 0x7f5204103fb0 2024-09-13T17:17:41.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.762+0000 7f52090e9640 1 -- 172.21.15.87:0/2631636713 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52041a3330 con 0x7f5204103fb0 2024-09-13T17:17:41.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.764+0000 7f51ebfff640 1 -- 172.21.15.87:0/2631636713 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f51f8004000 con 0x7f5204103fb0 2024-09-13T17:17:41.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.765+0000 7f520be0a740 1 Processor -- start 2024-09-13T17:17:41.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.765+0000 7f520be0a740 1 -- start start 2024-09-13T17:17:41.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.765+0000 7f51ebfff640 1 --2- 172.21.15.87:0/2631636713 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f51ec0a1200 0x7f51ec0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.765+0000 7f520be0a740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b68f652790 0x55b68f652b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.765+0000 7f520be0a740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b68f6530b0 0x55b68f65d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.765+0000 7f520be0a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b68f65d950 0x55b68f65fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.765+0000 7f520be0a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b68f5bccc0 con 0x55b68f65d950 2024-09-13T17:17:41.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.765+0000 7f520be0a740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b68f5ba450 con 0x55b68f6530b0 2024-09-13T17:17:41.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.765+0000 7f520be0a740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b68f5b5d40 con 0x55b68f652790 2024-09-13T17:17:41.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.765+0000 7f520359e640 1 --2- 172.21.15.87:0/2631636713 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f51ec0a1200 0x7f51ec0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.765+0000 7f51ebfff640 1 -- 172.21.15.87:0/2631636713 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f51f80cce30 con 0x7f5204103fb0 2024-09-13T17:17:41.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.765+0000 7f520359e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b68f65d950 0x55b68f65fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.765+0000 7f520359e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b68f65d950 0x55b68f65fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45114/0 (socket says 172.21.15.87:45114) 2024-09-13T17:17:41.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.765+0000 7f520359e640 1 -- 172.21.15.87:0/1954961603 learned_addr learned my addr 172.21.15.87:0/1954961603 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:41.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.765+0000 7f5202d9d640 1 --2- 172.21.15.87:0/1954961603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b68f652790 0x55b68f652b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.765+0000 7f520259c640 1 --2- 172.21.15.87:0/1954961603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b68f6530b0 0x55b68f65d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.766+0000 7f520359e640 1 -- 172.21.15.87:0/1954961603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b68f652790 msgr2=0x55b68f652b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.766+0000 7f520359e640 1 --2- 172.21.15.87:0/1954961603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b68f652790 0x55b68f652b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.766+0000 7f520359e640 1 -- 172.21.15.87:0/1954961603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b68f6530b0 msgr2=0x55b68f65d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.766+0000 7f520359e640 1 --2- 172.21.15.87:0/1954961603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b68f6530b0 0x55b68f65d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.766+0000 7f520359e640 1 -- 172.21.15.87:0/1954961603 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b68f57d620 con 0x55b68f65d950 2024-09-13T17:17:41.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.766+0000 7f520359e640 1 --2- 172.21.15.87:0/2631636713 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f51ec0a1200 0x7f51ec0a36c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f51fc0138a0 tx=0x7f51fc00bb90 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:41.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.766+0000 7f520359e640 1 --2- 172.21.15.87:0/1954961603 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b68f65d950 0x55b68f65fd40 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f51fc010bb0 tx=0x7f51fc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d95145756820e62 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:41.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.766+0000 7f51e97fa640 1 -- 172.21.15.87:0/1954961603 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc010ea0 con 0x55b68f65d950 2024-09-13T17:17:41.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.766+0000 7f51e97fa640 1 -- 172.21.15.87:0/1954961603 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f51fc019040 con 0x55b68f65d950 2024-09-13T17:17:41.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.766+0000 7f51e97fa640 1 -- 172.21.15.87:0/1954961603 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc01fb50 con 0x55b68f65d950 2024-09-13T17:17:41.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.766+0000 7f520be0a740 1 -- 172.21.15.87:0/1954961603 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b68f65d950 msgr2=0x55b68f65fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.766+0000 7f520be0a740 1 --2- 172.21.15.87:0/1954961603 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b68f65d950 0x55b68f65fd40 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f51fc010bb0 tx=0x7f51fc01a000 comp rx=0 tx=0).stop 2024-09-13T17:17:41.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.767+0000 7f520be0a740 1 -- 172.21.15.87:0/1954961603 shutdown_connections 2024-09-13T17:17:41.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.767+0000 7f520be0a740 1 --2- 172.21.15.87:0/1954961603 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b68f65d950 0x55b68f65fd40 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.767+0000 7f520be0a740 1 --2- 172.21.15.87:0/1954961603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b68f6530b0 0x55b68f65d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.767+0000 7f520be0a740 1 --2- 172.21.15.87:0/1954961603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b68f652790 0x55b68f652b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.767+0000 7f520be0a740 1 -- 172.21.15.87:0/1954961603 >> 172.21.15.87:0/1954961603 conn(0x55b68f64ed00 msgr2=0x55b68f64f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:41.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.767+0000 7f520be0a740 1 -- 172.21.15.87:0/1954961603 shutdown_connections 2024-09-13T17:17:41.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.767+0000 7f520be0a740 1 -- 172.21.15.87:0/1954961603 wait complete. 2024-09-13T17:17:41.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.767+0000 7f520be0a740 1 -- start start 2024-09-13T17:17:41.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.767+0000 7f520be0a740 1 Processor -- start 2024-09-13T17:17:41.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.767+0000 7f520be0a740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b68f652790 0x55b68f65cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.767+0000 7f520be0a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b68f6530b0 0x55b68f65a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.767+0000 7f520be0a740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b68f65d950 0x55b68f65a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.767+0000 7f520be0a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b68f574180 con 0x55b68f6530b0 2024-09-13T17:17:41.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.767+0000 7f520be0a740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b68f28e430 con 0x55b68f652790 2024-09-13T17:17:41.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.767+0000 7f520be0a740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b68f5395e0 con 0x55b68f65d950 2024-09-13T17:17:41.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.767+0000 7f520be0a740 10 client.0 _ll_register_callbacks cb 0x55b68f5a5aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:17:41.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.767+0000 7f520259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b68f6530b0 0x55b68f65a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.767+0000 7f520259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b68f6530b0 0x55b68f65a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45128/0 (socket says 172.21.15.87:45128) 2024-09-13T17:17:41.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.767+0000 7f520259c640 1 -- 172.21.15.87:0/3392280727 learned_addr learned my addr 172.21.15.87:0/3392280727 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:41.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.767+0000 7f520359e640 1 --2- 172.21.15.87:0/3392280727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b68f65d950 0x55b68f65a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.768+0000 7f520259c640 1 -- 172.21.15.87:0/3392280727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b68f65d950 msgr2=0x55b68f65a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.768+0000 7f520259c640 1 --2- 172.21.15.87:0/3392280727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b68f65d950 0x55b68f65a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.768+0000 7f520259c640 1 -- 172.21.15.87:0/3392280727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b68f652790 msgr2=0x55b68f65cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.768+0000 7f520259c640 1 --2- 172.21.15.87:0/3392280727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b68f652790 0x55b68f65cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.768+0000 7f520259c640 1 -- 172.21.15.87:0/3392280727 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51fc010970 con 0x55b68f6530b0 2024-09-13T17:17:41.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.768+0000 7f520259c640 1 --2- 172.21.15.87:0/3392280727 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b68f6530b0 0x55b68f65a2a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f51f8099830 tx=0x7f51f809a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48e15b2562c9dab2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:41.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.768+0000 7f51e6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:17:41.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.768+0000 7f51e6ff5640 1 -- 172.21.15.87:0/3392280727 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f8099b30 con 0x55b68f6530b0 2024-09-13T17:17:41.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.768+0000 7f51e6ff5640 1 -- 172.21.15.87:0/3392280727 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f51f809d960 con 0x55b68f6530b0 2024-09-13T17:17:41.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.768+0000 7f520be0a740 1 -- 172.21.15.87:0/3392280727 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b68f5dfb80 con 0x55b68f6530b0 2024-09-13T17:17:41.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.768+0000 7f51e6ff5640 1 -- 172.21.15.87:0/3392280727 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51f80a1fb0 con 0x55b68f6530b0 2024-09-13T17:17:41.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.768+0000 7f520be0a740 10 client.16737 fetch_fsmap learned FSMap version 30 2024-09-13T17:17:41.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.768+0000 7f520be0a740 1 -- 172.21.15.87:0/3392280727 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55b68f5b43c0 con 0x55b68f6530b0 2024-09-13T17:17:41.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.768+0000 7f51e6ff5640 1 -- 172.21.15.87:0/3392280727 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55b68f5dfb80 con 0x55b68f6530b0 2024-09-13T17:17:41.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.768+0000 7f51e6ff5640 1 -- 172.21.15.87:0/3392280727 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f51f8022020 con 0x55b68f6530b0 2024-09-13T17:17:41.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.768+0000 7f520be0a740 10 client.16737 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:17:41.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.768+0000 7f520be0a740 10 client.16737 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:17:41.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.768+0000 7f520be0a740 20 client.16737 populate_metadata read hostname 'smithi087' 2024-09-13T17:17:41.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.768+0000 7f520be0a740 1 --2- 172.21.15.87:0/3392280727 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55b68f66d270 0x55b68f66f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.768+0000 7f520be0a740 4 client.16737 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:17:41.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.768+0000 7f520be0a740 1 -- 172.21.15.87:0/3392280727 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b68f5a81f0 con 0x55b68f66d270 2024-09-13T17:17:41.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.769+0000 7f5202d9d640 1 --2- 172.21.15.87:0/3392280727 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55b68f66d270 0x55b68f66f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.769+0000 7f51e6ff5640 10 client.16737 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:17:41.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.769+0000 7f5202d9d640 1 --2- 172.21.15.87:0/3392280727 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55b68f66d270 0x55b68f66f690 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5fa9a9e0f8faa6c3 server_cookie=5390ea7dcfe39ebd in_seq=0 out_seq=0 2024-09-13T17:17:41.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.770+0000 7f51e6ff5640 1 -- 172.21.15.87:0/3392280727 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55b68f5a81f0 con 0x55b68f66d270 2024-09-13T17:17:41.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.770+0000 7f51e6ff5640 10 client.16737 handle_command_reply: tid=0 2024-09-13T17:17:41.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.770+0000 7f520be0a740 1 client.16737 shutdown 2024-09-13T17:17:41.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.770+0000 7f520be0a740 1 -- 172.21.15.87:0/3392280727 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b68f6530b0 msgr2=0x55b68f65a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.770+0000 7f520be0a740 1 --2- 172.21.15.87:0/3392280727 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b68f6530b0 0x55b68f65a2a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f51f8099830 tx=0x7f51f809a2f0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.770+0000 7f520be0a740 1 -- 172.21.15.87:0/3392280727 shutdown_connections 2024-09-13T17:17:41.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.770+0000 7f520be0a740 1 --2- 172.21.15.87:0/3392280727 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55b68f66d270 0x55b68f66f690 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.770+0000 7f520be0a740 1 --2- 172.21.15.87:0/3392280727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b68f65d950 0x55b68f65a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.770+0000 7f520be0a740 1 --2- 172.21.15.87:0/3392280727 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b68f6530b0 0x55b68f65a2a0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.770+0000 7f51e6ff5640 0 client.16737 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:17:41.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.770+0000 7f520be0a740 1 --2- 172.21.15.87:0/3392280727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b68f652790 0x55b68f65cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.770+0000 7f520be0a740 1 -- 172.21.15.87:0/3392280727 >> 172.21.15.87:0/3392280727 conn(0x55b68f64ed00 msgr2=0x55b68f654a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:41.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.770+0000 7f520be0a740 1 -- 172.21.15.87:0/3392280727 shutdown_connections 2024-09-13T17:17:41.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.770+0000 7f520be0a740 1 -- 172.21.15.87:0/3392280727 wait complete. 2024-09-13T17:17:41.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.770+0000 7f520be0a740 20 client.16737 trim_cache size 0 max 16384 2024-09-13T17:17:41.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.780+0000 7f520be0a740 1 Processor -- start 2024-09-13T17:17:41.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.781+0000 7f520be0a740 1 -- start start 2024-09-13T17:17:41.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.781+0000 7f520be0a740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b68f652790 0x55b68f664660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.781+0000 7f520be0a740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b68f6530b0 0x55b68f664ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.781+0000 7f520be0a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b68f65d950 0x55b68f658b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.781+0000 7f520be0a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b68f66bad0 con 0x55b68f65d950 2024-09-13T17:17:41.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.781+0000 7f520be0a740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b68f669fe0 con 0x55b68f6530b0 2024-09-13T17:17:41.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.781+0000 7f520be0a740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b68f64a8e0 con 0x55b68f652790 2024-09-13T17:17:41.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.781+0000 7f520359e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b68f65d950 0x55b68f658b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.781+0000 7f520359e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b68f65d950 0x55b68f658b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45142/0 (socket says 172.21.15.87:45142) 2024-09-13T17:17:41.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.781+0000 7f520359e640 1 -- 172.21.15.87:0/1312437635 learned_addr learned my addr 172.21.15.87:0/1312437635 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:41.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.781+0000 7f520259c640 1 --2- 172.21.15.87:0/1312437635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b68f6530b0 0x55b68f664ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.781+0000 7f520359e640 1 -- 172.21.15.87:0/1312437635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b68f652790 msgr2=0x55b68f664660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.781+0000 7f520359e640 1 --2- 172.21.15.87:0/1312437635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b68f652790 0x55b68f664660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.781+0000 7f520359e640 1 -- 172.21.15.87:0/1312437635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b68f6530b0 msgr2=0x55b68f664ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.781+0000 7f520359e640 1 --2- 172.21.15.87:0/1312437635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b68f6530b0 0x55b68f664ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.781+0000 7f520359e640 1 -- 172.21.15.87:0/1312437635 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b68f556770 con 0x55b68f65d950 2024-09-13T17:17:41.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.781+0000 7f520259c640 1 --2- 172.21.15.87:0/1312437635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b68f6530b0 0x55b68f664ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:41.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.781+0000 7f520359e640 1 --2- 172.21.15.87:0/1312437635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b68f65d950 0x55b68f658b90 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f51fc010bb0 tx=0x7f51fc00be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc3873f78bac9e6c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:41.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.781+0000 7f51e9ffb640 1 -- 172.21.15.87:0/1312437635 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc02d040 con 0x55b68f65d950 2024-09-13T17:17:41.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.781+0000 7f51e9ffb640 1 -- 172.21.15.87:0/1312437635 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f51fc00b650 con 0x55b68f65d950 2024-09-13T17:17:41.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.781+0000 7f51e9ffb640 1 -- 172.21.15.87:0/1312437635 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc004620 con 0x55b68f65d950 2024-09-13T17:17:41.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.782+0000 7f520be0a740 1 -- 172.21.15.87:0/1312437635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b68f65d950 msgr2=0x55b68f658b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.782+0000 7f520be0a740 1 --2- 172.21.15.87:0/1312437635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b68f65d950 0x55b68f658b90 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f51fc010bb0 tx=0x7f51fc00be00 comp rx=0 tx=0).stop 2024-09-13T17:17:41.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.782+0000 7f520be0a740 1 -- 172.21.15.87:0/1312437635 shutdown_connections 2024-09-13T17:17:41.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.782+0000 7f520be0a740 1 --2- 172.21.15.87:0/1312437635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b68f65d950 0x55b68f658b90 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.782+0000 7f520be0a740 1 --2- 172.21.15.87:0/1312437635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b68f6530b0 0x55b68f664ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.782+0000 7f520be0a740 1 --2- 172.21.15.87:0/1312437635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b68f652790 0x55b68f664660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.782+0000 7f520be0a740 1 -- 172.21.15.87:0/1312437635 >> 172.21.15.87:0/1312437635 conn(0x55b68f64ed00 msgr2=0x55b68f64f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:41.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.782+0000 7f520be0a740 1 -- 172.21.15.87:0/1312437635 shutdown_connections 2024-09-13T17:17:41.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.782+0000 7f520be0a740 1 -- 172.21.15.87:0/1312437635 wait complete. 2024-09-13T17:17:41.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.782+0000 7f520be0a740 1 -- start start 2024-09-13T17:17:41.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.782+0000 7f520be0a740 1 Processor -- start 2024-09-13T17:17:41.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.783+0000 7f520be0a740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b68f652790 0x55b68f6649a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.783+0000 7f520be0a740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b68f6530b0 0x55b68f656cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.783+0000 7f520be0a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b68f65d950 0x55b68f6571f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.783+0000 7f520be0a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b68f6578d0 con 0x55b68f65d950 2024-09-13T17:17:41.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.783+0000 7f520be0a740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b68f657a40 con 0x55b68f652790 2024-09-13T17:17:41.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.783+0000 7f520be0a740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b68f6c37b0 con 0x55b68f6530b0 2024-09-13T17:17:41.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.783+0000 7f520be0a740 10 client.0 _ll_register_callbacks cb 0x7f5204069b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:17:41.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.783+0000 7f520359e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b68f65d950 0x55b68f6571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.783+0000 7f520359e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b68f65d950 0x55b68f6571f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45148/0 (socket says 172.21.15.87:45148) 2024-09-13T17:17:41.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.783+0000 7f520359e640 1 -- 172.21.15.87:0/2742413518 learned_addr learned my addr 172.21.15.87:0/2742413518 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:41.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.783+0000 7f520259c640 1 --2- 172.21.15.87:0/2742413518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b68f6530b0 0x55b68f656cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.783+0000 7f5202d9d640 1 --2- 172.21.15.87:0/2742413518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b68f652790 0x55b68f6649a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.783+0000 7f520359e640 1 -- 172.21.15.87:0/2742413518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b68f6530b0 msgr2=0x55b68f656cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.783+0000 7f520359e640 1 --2- 172.21.15.87:0/2742413518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b68f6530b0 0x55b68f656cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.783+0000 7f520359e640 1 -- 172.21.15.87:0/2742413518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b68f652790 msgr2=0x55b68f6649a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.783+0000 7f520359e640 1 --2- 172.21.15.87:0/2742413518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b68f652790 0x55b68f6649a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.783+0000 7f520359e640 1 -- 172.21.15.87:0/2742413518 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b68f57d620 con 0x55b68f65d950 2024-09-13T17:17:41.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.783+0000 7f5202d9d640 1 --2- 172.21.15.87:0/2742413518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b68f652790 0x55b68f6649a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:41.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.783+0000 7f520259c640 1 --2- 172.21.15.87:0/2742413518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b68f6530b0 0x55b68f656cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:41.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.783+0000 7f520359e640 1 --2- 172.21.15.87:0/2742413518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b68f65d950 0x55b68f6571f0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00b3a0 tx=0x7f51fc00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65757122ecd94d6f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:41.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.783+0000 7f51e6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:17:41.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.783+0000 7f51e6ff5640 1 -- 172.21.15.87:0/2742413518 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc028450 con 0x55b68f65d950 2024-09-13T17:17:41.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.783+0000 7f51e6ff5640 1 -- 172.21.15.87:0/2742413518 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f51fc042030 con 0x55b68f65d950 2024-09-13T17:17:41.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.783+0000 7f520be0a740 1 -- 172.21.15.87:0/2742413518 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f51fc019040 con 0x55b68f65d950 2024-09-13T17:17:41.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.783+0000 7f51e6ff5640 1 -- 172.21.15.87:0/2742413518 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51fc0285b0 con 0x55b68f65d950 2024-09-13T17:17:41.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.783+0000 7f520be0a740 10 client.16743 fetch_fsmap learned FSMap version 30 2024-09-13T17:17:41.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.783+0000 7f520be0a740 1 -- 172.21.15.87:0/2742413518 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55b68f57be80 con 0x55b68f65d950 2024-09-13T17:17:41.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.784+0000 7f51e6ff5640 1 -- 172.21.15.87:0/2742413518 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f51fc019040 con 0x55b68f65d950 2024-09-13T17:17:41.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.784+0000 7f51e6ff5640 1 -- 172.21.15.87:0/2742413518 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f51fc03a040 con 0x55b68f65d950 2024-09-13T17:17:41.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.784+0000 7f520be0a740 10 client.16743 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:17:41.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.784+0000 7f520be0a740 10 client.16743 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:17:41.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.784+0000 7f520be0a740 20 client.16743 populate_metadata read hostname 'smithi087' 2024-09-13T17:17:41.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.784+0000 7f520be0a740 1 --2- 172.21.15.87:0/2742413518 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55b68f6c4a40 0x55b68f6c6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.784+0000 7f520be0a740 4 client.16743 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:17:41.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.784+0000 7f520be0a740 1 -- 172.21.15.87:0/2742413518 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b68f2a94e0 con 0x55b68f6c4a40 2024-09-13T17:17:41.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.784+0000 7f5202d9d640 1 --2- 172.21.15.87:0/2742413518 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55b68f6c4a40 0x55b68f6c6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.785+0000 7f51e6ff5640 10 client.16743 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:17:41.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.785+0000 7f5202d9d640 1 --2- 172.21.15.87:0/2742413518 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55b68f6c4a40 0x55b68f6c6e30 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a003d49ab6e9357c server_cookie=54096065970b2aa3 in_seq=0 out_seq=0 2024-09-13T17:17:41.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.785+0000 7f51e6ff5640 1 -- 172.21.15.87:0/2742413518 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b68f2a94e0 con 0x55b68f6c4a40 2024-09-13T17:17:41.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.785+0000 7f51e6ff5640 10 client.16743 handle_command_reply: tid=0 2024-09-13T17:17:41.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.785+0000 7f520be0a740 1 client.16743 shutdown 2024-09-13T17:17:41.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.785+0000 7f520be0a740 1 -- 172.21.15.87:0/2742413518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b68f65d950 msgr2=0x55b68f6571f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.785+0000 7f520be0a740 1 --2- 172.21.15.87:0/2742413518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b68f65d950 0x55b68f6571f0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00b3a0 tx=0x7f51fc00b910 comp rx=0 tx=0).stop 2024-09-13T17:17:41.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.785+0000 7f520be0a740 1 -- 172.21.15.87:0/2742413518 shutdown_connections 2024-09-13T17:17:41.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.785+0000 7f520be0a740 1 --2- 172.21.15.87:0/2742413518 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55b68f6c4a40 0x55b68f6c6e30 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.785+0000 7f520be0a740 1 --2- 172.21.15.87:0/2742413518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b68f65d950 0x55b68f6571f0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.785+0000 7f51e6ff5640 0 client.16743 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:17:41.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.785+0000 7f520be0a740 1 --2- 172.21.15.87:0/2742413518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b68f6530b0 0x55b68f656cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.785+0000 7f520be0a740 1 --2- 172.21.15.87:0/2742413518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b68f652790 0x55b68f6649a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.785+0000 7f520be0a740 1 -- 172.21.15.87:0/2742413518 >> 172.21.15.87:0/2742413518 conn(0x55b68f64ed00 msgr2=0x55b68f658aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:41.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.785+0000 7f520be0a740 1 -- 172.21.15.87:0/2742413518 shutdown_connections 2024-09-13T17:17:41.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.785+0000 7f520be0a740 1 -- 172.21.15.87:0/2742413518 wait complete. 2024-09-13T17:17:41.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.785+0000 7f520be0a740 20 client.16743 trim_cache size 0 max 16384 2024-09-13T17:17:41.794 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:17:41.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.786+0000 7f52090e9640 1 -- 172.21.15.87:0/2631636713 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f51ec0a1200 msgr2=0x7f51ec0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.786+0000 7f52090e9640 1 --2- 172.21.15.87:0/2631636713 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f51ec0a1200 0x7f51ec0a36c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f51fc0138a0 tx=0x7f51fc00bb90 comp rx=0 tx=0).stop 2024-09-13T17:17:41.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.786+0000 7f52090e9640 1 -- 172.21.15.87:0/2631636713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5204103fb0 msgr2=0x7f5204196870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.786+0000 7f52090e9640 1 --2- 172.21.15.87:0/2631636713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5204103fb0 0x7f5204196870 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f51f8005fd0 tx=0x7f51f800dde0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.786+0000 7f52090e9640 1 -- 172.21.15.87:0/2631636713 shutdown_connections 2024-09-13T17:17:41.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.786+0000 7f52090e9640 1 --2- 172.21.15.87:0/2631636713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f520419ac60 0x7f520419b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.786+0000 7f52090e9640 1 --2- 172.21.15.87:0/2631636713 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f51ec0a1200 0x7f51ec0a36c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.786+0000 7f52090e9640 1 --2- 172.21.15.87:0/2631636713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5204103fb0 0x7f5204196870 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.786+0000 7f52090e9640 1 --2- 172.21.15.87:0/2631636713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52040fee60 0x7f5204196330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.786+0000 7f52090e9640 1 -- 172.21.15.87:0/2631636713 >> 172.21.15.87:0/2631636713 conn(0x7f5204075c60 msgr2=0x7f5204067780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:41.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.786+0000 7f52090e9640 1 -- 172.21.15.87:0/2631636713 shutdown_connections 2024-09-13T17:17:41.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.786+0000 7f52090e9640 1 -- 172.21.15.87:0/2631636713 wait complete. 2024-09-13T17:17:41.797 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:41 smithi087 ceph-mon[30934]: pgmap v119: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:17:41.797 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:41 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/457384198' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:17:41.798 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-09-13T17:17:41.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:41 smithi149 ceph-mon[35496]: pgmap v119: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:17:41.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:41 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/457384198' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:17:41.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:41 smithi118 ceph-mon[34374]: pgmap v119: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:17:41.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:41 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/457384198' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:17:41.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.897+0000 7f0db4c9c640 1 -- 172.21.15.87:0/12023520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0db00fee60 msgr2=0x7f0db00ff240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.897+0000 7f0db4c9c640 1 --2- 172.21.15.87:0/12023520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0db00fee60 0x7f0db00ff240 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f0da0009cd0 tx=0x7f0da002a8e0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.897+0000 7f0db4c9c640 1 -- 172.21.15.87:0/12023520 shutdown_connections 2024-09-13T17:17:41.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.897+0000 7f0db4c9c640 1 --2- 172.21.15.87:0/12023520 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0db0103fb0 0x7f0db010bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.897+0000 7f0db4c9c640 1 --2- 172.21.15.87:0/12023520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0db00ff810 0x7f0db0103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.897+0000 7f0db4c9c640 1 --2- 172.21.15.87:0/12023520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0db00fee60 0x7f0db00ff240 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.897+0000 7f0db4c9c640 1 -- 172.21.15.87:0/12023520 >> 172.21.15.87:0/12023520 conn(0x7f0db0075c60 msgr2=0x7f0db00fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:41.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.897+0000 7f0db4c9c640 1 -- 172.21.15.87:0/12023520 shutdown_connections 2024-09-13T17:17:41.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.897+0000 7f0db4c9c640 1 -- 172.21.15.87:0/12023520 wait complete. 2024-09-13T17:17:41.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.897+0000 7f0db4c9c640 1 Processor -- start 2024-09-13T17:17:41.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.898+0000 7f0db4c9c640 1 -- start start 2024-09-13T17:17:41.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.898+0000 7f0db4c9c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0db00fee60 0x7f0db00fb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.898+0000 7f0db4c9c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0db0103fb0 0x7f0db00fb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.898+0000 7f0db4c9c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0db00fbb20 0x7f0db01a44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.898+0000 7f0db4c9c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db01a4ac0 con 0x7f0db0103fb0 2024-09-13T17:17:41.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.898+0000 7f0db4c9c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db01a4c30 con 0x7f0db00fee60 2024-09-13T17:17:41.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.898+0000 7f0db4c9c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db01a4df0 con 0x7f0db00fbb20 2024-09-13T17:17:41.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.898+0000 7f0dadd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0db0103fb0 0x7f0db00fb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.898+0000 7f0dadd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0db0103fb0 0x7f0db00fb5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45170/0 (socket says 172.21.15.87:45170) 2024-09-13T17:17:41.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.898+0000 7f0dadd9b640 1 -- 172.21.15.87:0/1987478544 learned_addr learned my addr 172.21.15.87:0/1987478544 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:41.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.898+0000 7f0dae59c640 1 --2- 172.21.15.87:0/1987478544 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0db00fee60 0x7f0db00fb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.898+0000 7f0dadd9b640 1 -- 172.21.15.87:0/1987478544 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0db00fbb20 msgr2=0x7f0db01a44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.898+0000 7f0dadd9b640 1 --2- 172.21.15.87:0/1987478544 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0db00fbb20 0x7f0db01a44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.898+0000 7f0dadd9b640 1 -- 172.21.15.87:0/1987478544 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0db00fee60 msgr2=0x7f0db00fb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.898+0000 7f0dadd9b640 1 --2- 172.21.15.87:0/1987478544 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0db00fee60 0x7f0db00fb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.898+0000 7f0dadd9b640 1 -- 172.21.15.87:0/1987478544 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da0009900 con 0x7f0db0103fb0 2024-09-13T17:17:41.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.898+0000 7f0dadd9b640 1 --2- 172.21.15.87:0/1987478544 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0db0103fb0 0x7f0db00fb5e0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f0d9800e9c0 tx=0x7f0d9800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:41.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.898+0000 7f0da77fe640 1 -- 172.21.15.87:0/1987478544 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d98009700 con 0x7f0db0103fb0 2024-09-13T17:17:41.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.898+0000 7f0da77fe640 1 -- 172.21.15.87:0/1987478544 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0d9800cd80 con 0x7f0db0103fb0 2024-09-13T17:17:41.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.898+0000 7f0db4c9c640 1 -- 172.21.15.87:0/1987478544 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db01a50d0 con 0x7f0db0103fb0 2024-09-13T17:17:41.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.898+0000 7f0da77fe640 1 -- 172.21.15.87:0/1987478544 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d98010430 con 0x7f0db0103fb0 2024-09-13T17:17:41.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.899+0000 7f0db4c9c640 1 -- 172.21.15.87:0/1987478544 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db01a5630 con 0x7f0db0103fb0 2024-09-13T17:17:41.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.901+0000 7f0da77fe640 1 -- 172.21.15.87:0/1987478544 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f0d98004f10 con 0x7f0db0103fb0 2024-09-13T17:17:41.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.901+0000 7f0db79c3740 1 Processor -- start 2024-09-13T17:17:41.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.902+0000 7f0db79c3740 1 -- start start 2024-09-13T17:17:41.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.902+0000 7f0db79c3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564c55ab790 0x5564c55abb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.902+0000 7f0db79c3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564c55ac0b0 0x5564c55b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.902+0000 7f0db79c3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564c55b6950 0x5564c55b8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.902+0000 7f0db79c3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564c5515cc0 con 0x5564c55b6950 2024-09-13T17:17:41.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.902+0000 7f0db79c3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564c5513450 con 0x5564c55ab790 2024-09-13T17:17:41.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.902+0000 7f0db79c3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564c550ed40 con 0x5564c55ac0b0 2024-09-13T17:17:41.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.902+0000 7f0dadd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564c55b6950 0x5564c55b8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.902+0000 7f0dadd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564c55b6950 0x5564c55b8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45186/0 (socket says 172.21.15.87:45186) 2024-09-13T17:17:41.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.902+0000 7f0dadd9b640 1 -- 172.21.15.87:0/3986438371 learned_addr learned my addr 172.21.15.87:0/3986438371 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:41.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.902+0000 7f0daed9d640 1 --2- 172.21.15.87:0/3986438371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564c55ab790 0x5564c55abb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.902+0000 7f0dae59c640 1 --2- 172.21.15.87:0/3986438371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564c55ac0b0 0x5564c55b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.902+0000 7f0dadd9b640 1 -- 172.21.15.87:0/3986438371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564c55ac0b0 msgr2=0x5564c55b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.902+0000 7f0dadd9b640 1 --2- 172.21.15.87:0/3986438371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564c55ac0b0 0x5564c55b6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.902+0000 7f0dadd9b640 1 -- 172.21.15.87:0/3986438371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564c55ab790 msgr2=0x5564c55abb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.902+0000 7f0dadd9b640 1 --2- 172.21.15.87:0/3986438371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564c55ab790 0x5564c55abb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.902+0000 7f0da77fe640 1 --2- 172.21.15.87:0/1987478544 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0d9c0a12b0 0x7f0d9c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.902+0000 7f0dadd9b640 1 -- 172.21.15.87:0/3986438371 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564c54d6620 con 0x5564c55b6950 2024-09-13T17:17:41.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.902+0000 7f0dae59c640 1 --2- 172.21.15.87:0/3986438371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564c55ac0b0 0x5564c55b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:41.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.902+0000 7f0daed9d640 1 --2- 172.21.15.87:0/1987478544 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0d9c0a12b0 0x7f0d9c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.902+0000 7f0dadd9b640 1 --2- 172.21.15.87:0/3986438371 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564c55b6950 0x5564c55b8d40 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f0d980ca7a0 tx=0x7f0d980965f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75184da6c8c4a7a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:41.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.903+0000 7f0da77fe640 1 -- 172.21.15.87:0/1987478544 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f0d98014070 con 0x7f0db0103fb0 2024-09-13T17:17:41.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.903+0000 7f0da4ff9640 1 -- 172.21.15.87:0/3986438371 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d98099fc0 con 0x5564c55b6950 2024-09-13T17:17:41.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.903+0000 7f0da4ff9640 1 -- 172.21.15.87:0/3986438371 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0d98099d30 con 0x5564c55b6950 2024-09-13T17:17:41.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.903+0000 7f0da4ff9640 1 -- 172.21.15.87:0/3986438371 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d98099b50 con 0x5564c55b6950 2024-09-13T17:17:41.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.903+0000 7f0db79c3740 1 -- 172.21.15.87:0/3986438371 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564c55b6950 msgr2=0x5564c55b8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.903+0000 7f0daed9d640 1 --2- 172.21.15.87:0/1987478544 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0d9c0a12b0 0x7f0d9c0a3770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0da8009b90 tx=0x7f0da8009590 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:41.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.903+0000 7f0db79c3740 1 --2- 172.21.15.87:0/3986438371 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564c55b6950 0x5564c55b8d40 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f0d980ca7a0 tx=0x7f0d980965f0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.903+0000 7f0db79c3740 1 -- 172.21.15.87:0/3986438371 shutdown_connections 2024-09-13T17:17:41.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.903+0000 7f0db79c3740 1 --2- 172.21.15.87:0/3986438371 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564c55b6950 0x5564c55b8d40 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.903+0000 7f0db79c3740 1 --2- 172.21.15.87:0/3986438371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564c55ac0b0 0x5564c55b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.903+0000 7f0db79c3740 1 --2- 172.21.15.87:0/3986438371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564c55ab790 0x5564c55abb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.903+0000 7f0db79c3740 1 -- 172.21.15.87:0/3986438371 >> 172.21.15.87:0/3986438371 conn(0x5564c55a7d00 msgr2=0x5564c55a80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:41.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.904+0000 7f0db79c3740 1 -- 172.21.15.87:0/3986438371 shutdown_connections 2024-09-13T17:17:41.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.904+0000 7f0db79c3740 1 -- 172.21.15.87:0/3986438371 wait complete. 2024-09-13T17:17:41.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.904+0000 7f0db79c3740 1 -- start start 2024-09-13T17:17:41.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.904+0000 7f0db79c3740 1 Processor -- start 2024-09-13T17:17:41.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.904+0000 7f0db79c3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564c55ab790 0x5564c55b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.904+0000 7f0db79c3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564c55ac0b0 0x5564c55b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.904+0000 7f0db79c3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564c55b6950 0x5564c55b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.904+0000 7f0db79c3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564c54cd180 con 0x5564c55ac0b0 2024-09-13T17:17:41.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.904+0000 7f0db79c3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564c51e7430 con 0x5564c55ab790 2024-09-13T17:17:41.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.904+0000 7f0db79c3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564c54925e0 con 0x5564c55b6950 2024-09-13T17:17:41.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.904+0000 7f0db79c3740 10 client.0 _ll_register_callbacks cb 0x5564c54feaa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:17:41.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.904+0000 7f0dadd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564c55ac0b0 0x5564c55b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.904+0000 7f0dadd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564c55ac0b0 0x5564c55b32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45200/0 (socket says 172.21.15.87:45200) 2024-09-13T17:17:41.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.904+0000 7f0dadd9b640 1 -- 172.21.15.87:0/1375276987 learned_addr learned my addr 172.21.15.87:0/1375276987 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:41.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.904+0000 7f0dae59c640 1 --2- 172.21.15.87:0/1375276987 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564c55ab790 0x5564c55b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.904+0000 7f0daed9d640 1 --2- 172.21.15.87:0/1375276987 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564c55b6950 0x5564c55b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.904+0000 7f0dadd9b640 1 -- 172.21.15.87:0/1375276987 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564c55b6950 msgr2=0x5564c55b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.905+0000 7f0dadd9b640 1 --2- 172.21.15.87:0/1375276987 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564c55b6950 0x5564c55b37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.905+0000 7f0dadd9b640 1 -- 172.21.15.87:0/1375276987 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564c55ab790 msgr2=0x5564c55b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.905+0000 7f0dadd9b640 1 --2- 172.21.15.87:0/1375276987 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564c55ab790 0x5564c55b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.905+0000 7f0dadd9b640 1 -- 172.21.15.87:0/1375276987 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db01a5630 con 0x5564c55ac0b0 2024-09-13T17:17:41.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.905+0000 7f0daed9d640 1 --2- 172.21.15.87:0/1375276987 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564c55b6950 0x5564c55b37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:41.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.905+0000 7f0dae59c640 1 --2- 172.21.15.87:0/1375276987 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564c55ab790 0x5564c55b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:41.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.905+0000 7f0dadd9b640 1 --2- 172.21.15.87:0/1375276987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564c55ac0b0 0x5564c55b32a0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f0d98099ef0 tx=0x7f0d980cd600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f55e7a204600ed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:41.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.905+0000 7f0d95ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:17:41.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.905+0000 7f0d95ffb640 1 -- 172.21.15.87:0/1375276987 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d98099fc0 con 0x5564c55ac0b0 2024-09-13T17:17:41.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.905+0000 7f0d95ffb640 1 -- 172.21.15.87:0/1375276987 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f0d9809a8f0 con 0x5564c55ac0b0 2024-09-13T17:17:41.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.905+0000 7f0db79c3740 1 -- 172.21.15.87:0/1375276987 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5564c5538b80 con 0x5564c55ac0b0 2024-09-13T17:17:41.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.905+0000 7f0d95ffb640 1 -- 172.21.15.87:0/1375276987 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d980d08f0 con 0x5564c55ac0b0 2024-09-13T17:17:41.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.905+0000 7f0db79c3740 10 client.16755 fetch_fsmap learned FSMap version 30 2024-09-13T17:17:41.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.905+0000 7f0db79c3740 1 -- 172.21.15.87:0/1375276987 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5564c550d3c0 con 0x5564c55ac0b0 2024-09-13T17:17:41.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.905+0000 7f0d95ffb640 1 -- 172.21.15.87:0/1375276987 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x5564c5538b80 con 0x5564c55ac0b0 2024-09-13T17:17:41.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.905+0000 7f0d95ffb640 1 -- 172.21.15.87:0/1375276987 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f0d9801f060 con 0x5564c55ac0b0 2024-09-13T17:17:41.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.905+0000 7f0db79c3740 10 client.16755 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:17:41.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.905+0000 7f0db79c3740 10 client.16755 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:17:41.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.905+0000 7f0db79c3740 20 client.16755 populate_metadata read hostname 'smithi087' 2024-09-13T17:17:41.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.905+0000 7f0db79c3740 1 --2- 172.21.15.87:0/1375276987 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5564c55c5e60 0x5564c55c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.905+0000 7f0db79c3740 4 client.16755 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:17:41.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.905+0000 7f0db79c3740 1 -- 172.21.15.87:0/1375276987 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5564c55011f0 con 0x5564c55c5e60 2024-09-13T17:17:41.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.906+0000 7f0dae59c640 1 --2- 172.21.15.87:0/1375276987 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5564c55c5e60 0x5564c55c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.906+0000 7f0d95ffb640 10 client.16755 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:17:41.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.906+0000 7f0dae59c640 1 --2- 172.21.15.87:0/1375276987 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5564c55c5e60 0x5564c55c82a0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5883d6400cc00fe4 server_cookie=99e293356cd5575b in_seq=0 out_seq=0 2024-09-13T17:17:41.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.907+0000 7f0d95ffb640 1 -- 172.21.15.87:0/1375276987 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5564c55011f0 con 0x5564c55c5e60 2024-09-13T17:17:41.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.907+0000 7f0d95ffb640 10 client.16755 handle_command_reply: tid=0 2024-09-13T17:17:41.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.907+0000 7f0db79c3740 1 client.16755 shutdown 2024-09-13T17:17:41.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.907+0000 7f0db79c3740 1 -- 172.21.15.87:0/1375276987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564c55ac0b0 msgr2=0x5564c55b32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.907+0000 7f0db79c3740 1 --2- 172.21.15.87:0/1375276987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564c55ac0b0 0x5564c55b32a0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f0d98099ef0 tx=0x7f0d980cd600 comp rx=0 tx=0).stop 2024-09-13T17:17:41.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.907+0000 7f0db79c3740 1 -- 172.21.15.87:0/1375276987 shutdown_connections 2024-09-13T17:17:41.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.907+0000 7f0db79c3740 1 --2- 172.21.15.87:0/1375276987 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5564c55c5e60 0x5564c55c82a0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.907+0000 7f0db79c3740 1 --2- 172.21.15.87:0/1375276987 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564c55b6950 0x5564c55b37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.907+0000 7f0d95ffb640 0 client.16755 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:17:41.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.907+0000 7f0db79c3740 1 --2- 172.21.15.87:0/1375276987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564c55ac0b0 0x5564c55b32a0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.907+0000 7f0db79c3740 1 --2- 172.21.15.87:0/1375276987 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564c55ab790 0x5564c55b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.907+0000 7f0db79c3740 1 -- 172.21.15.87:0/1375276987 >> 172.21.15.87:0/1375276987 conn(0x5564c55a7d00 msgr2=0x5564c55ada10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:41.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.907+0000 7f0db79c3740 1 -- 172.21.15.87:0/1375276987 shutdown_connections 2024-09-13T17:17:41.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.907+0000 7f0db79c3740 1 -- 172.21.15.87:0/1375276987 wait complete. 2024-09-13T17:17:41.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.907+0000 7f0db79c3740 20 client.16755 trim_cache size 0 max 16384 2024-09-13T17:17:41.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.918+0000 7f0db79c3740 1 Processor -- start 2024-09-13T17:17:41.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.918+0000 7f0db79c3740 1 -- start start 2024-09-13T17:17:41.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.918+0000 7f0db79c3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564c55a7d00 0x5564c55a76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.918+0000 7f0db79c3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564c55ab790 0x5564c55ae360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.918+0000 7f0db79c3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564c55ac0b0 0x5564c55ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.918+0000 7f0db79c3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564c55a88b0 con 0x5564c55ab790 2024-09-13T17:17:41.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.918+0000 7f0db79c3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564c5538b80 con 0x5564c55a7d00 2024-09-13T17:17:41.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.918+0000 7f0db79c3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564c55c3060 con 0x5564c55ac0b0 2024-09-13T17:17:41.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.918+0000 7f0dadd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564c55ab790 0x5564c55ae360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.918+0000 7f0dadd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564c55ab790 0x5564c55ae360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45212/0 (socket says 172.21.15.87:45212) 2024-09-13T17:17:41.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.918+0000 7f0dadd9b640 1 -- 172.21.15.87:0/1198061764 learned_addr learned my addr 172.21.15.87:0/1198061764 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:41.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.918+0000 7f0dae59c640 1 --2- 172.21.15.87:0/1198061764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564c55a7d00 0x5564c55a76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.918+0000 7f0dadd9b640 1 -- 172.21.15.87:0/1198061764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564c55ac0b0 msgr2=0x5564c55ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.918+0000 7f0dadd9b640 1 --2- 172.21.15.87:0/1198061764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564c55ac0b0 0x5564c55ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.918+0000 7f0dadd9b640 1 -- 172.21.15.87:0/1198061764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564c55a7d00 msgr2=0x5564c55a76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.918+0000 7f0dadd9b640 1 --2- 172.21.15.87:0/1198061764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564c55a7d00 0x5564c55a76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.918+0000 7f0dadd9b640 1 -- 172.21.15.87:0/1198061764 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564c54af770 con 0x5564c55ab790 2024-09-13T17:17:41.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.918+0000 7f0dae59c640 1 --2- 172.21.15.87:0/1198061764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564c55a7d00 0x5564c55a76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:41.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.918+0000 7f0dadd9b640 1 --2- 172.21.15.87:0/1198061764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564c55ab790 0x5564c55ae360 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f0d9800c6a0 tx=0x7f0d980ca8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1772e837940be03f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:41.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.918+0000 7f0da57fa640 1 -- 172.21.15.87:0/1198061764 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d980d08f0 con 0x5564c55ab790 2024-09-13T17:17:41.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.918+0000 7f0da57fa640 1 -- 172.21.15.87:0/1198061764 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0d98099fc0 con 0x5564c55ab790 2024-09-13T17:17:41.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.919+0000 7f0da57fa640 1 -- 172.21.15.87:0/1198061764 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9809a8f0 con 0x5564c55ab790 2024-09-13T17:17:41.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.919+0000 7f0db79c3740 1 -- 172.21.15.87:0/1198061764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564c55ab790 msgr2=0x5564c55ae360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.919+0000 7f0db79c3740 1 --2- 172.21.15.87:0/1198061764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564c55ab790 0x5564c55ae360 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f0d9800c6a0 tx=0x7f0d980ca8e0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.919+0000 7f0db79c3740 1 -- 172.21.15.87:0/1198061764 shutdown_connections 2024-09-13T17:17:41.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.919+0000 7f0db79c3740 1 --2- 172.21.15.87:0/1198061764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564c55ac0b0 0x5564c55ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.919+0000 7f0db79c3740 1 --2- 172.21.15.87:0/1198061764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564c55ab790 0x5564c55ae360 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.919+0000 7f0db79c3740 1 --2- 172.21.15.87:0/1198061764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564c55a7d00 0x5564c55a76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.919+0000 7f0db79c3740 1 -- 172.21.15.87:0/1198061764 >> 172.21.15.87:0/1198061764 conn(0x5564c55b60e0 msgr2=0x5564c55b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:41.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.919+0000 7f0db79c3740 1 -- 172.21.15.87:0/1198061764 shutdown_connections 2024-09-13T17:17:41.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.919+0000 7f0db79c3740 1 -- 172.21.15.87:0/1198061764 wait complete. 2024-09-13T17:17:41.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.919+0000 7f0db79c3740 1 -- start start 2024-09-13T17:17:41.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.919+0000 7f0db79c3740 1 Processor -- start 2024-09-13T17:17:41.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.920+0000 7f0db79c3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564c55a7d00 0x5564c55bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.920+0000 7f0db79c3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564c55ab790 0x5564c55bbb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.920+0000 7f0db79c3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564c55ac0b0 0x5564c55bc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.920+0000 7f0db79c3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564c55bc5c0 con 0x5564c55ac0b0 2024-09-13T17:17:41.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.920+0000 7f0db79c3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564c55bc730 con 0x5564c55a7d00 2024-09-13T17:17:41.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.920+0000 7f0db79c3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564c55bc8f0 con 0x5564c55ab790 2024-09-13T17:17:41.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.920+0000 7f0db79c3740 10 client.0 _ll_register_callbacks cb 0x7f0d980d0cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:17:41.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.920+0000 7f0daed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564c55ac0b0 0x5564c55bc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.920+0000 7f0daed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564c55ac0b0 0x5564c55bc080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45214/0 (socket says 172.21.15.87:45214) 2024-09-13T17:17:41.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.920+0000 7f0daed9d640 1 -- 172.21.15.87:0/898043502 learned_addr learned my addr 172.21.15.87:0/898043502 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:41.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.920+0000 7f0dae59c640 1 --2- 172.21.15.87:0/898043502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564c55a7d00 0x5564c55bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.920+0000 7f0dadd9b640 1 --2- 172.21.15.87:0/898043502 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564c55ab790 0x5564c55bbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.920+0000 7f0daed9d640 1 -- 172.21.15.87:0/898043502 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564c55ab790 msgr2=0x5564c55bbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.920+0000 7f0daed9d640 1 --2- 172.21.15.87:0/898043502 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564c55ab790 0x5564c55bbb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.920+0000 7f0daed9d640 1 -- 172.21.15.87:0/898043502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564c55a7d00 msgr2=0x5564c55bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:41.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.920+0000 7f0daed9d640 1 --2- 172.21.15.87:0/898043502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564c55a7d00 0x5564c55bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.920+0000 7f0daed9d640 1 -- 172.21.15.87:0/898043502 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5564c550d3c0 con 0x5564c55ac0b0 2024-09-13T17:17:41.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.920+0000 7f0daed9d640 1 --2- 172.21.15.87:0/898043502 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564c55ac0b0 0x5564c55bc080 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f0da8004490 tx=0x7f0da8005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b204b3c9dd7bd2d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:41.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.920+0000 7f0d95ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:17:41.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.920+0000 7f0d95ffb640 1 -- 172.21.15.87:0/898043502 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da801e830 con 0x5564c55ac0b0 2024-09-13T17:17:41.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.920+0000 7f0d95ffb640 1 -- 172.21.15.87:0/898043502 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f0da80044c0 con 0x5564c55ac0b0 2024-09-13T17:17:41.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.920+0000 7f0db79c3740 1 -- 172.21.15.87:0/898043502 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0d98099d30 con 0x5564c55ac0b0 2024-09-13T17:17:41.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.920+0000 7f0d95ffb640 1 -- 172.21.15.87:0/898043502 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0da801e990 con 0x5564c55ac0b0 2024-09-13T17:17:41.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.920+0000 7f0db79c3740 10 client.16761 fetch_fsmap learned FSMap version 30 2024-09-13T17:17:41.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.920+0000 7f0db79c3740 1 -- 172.21.15.87:0/898043502 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5564c54d4e80 con 0x5564c55ac0b0 2024-09-13T17:17:41.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.921+0000 7f0d95ffb640 1 -- 172.21.15.87:0/898043502 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0d98099d30 con 0x5564c55ac0b0 2024-09-13T17:17:41.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.921+0000 7f0d95ffb640 1 -- 172.21.15.87:0/898043502 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f0da801b410 con 0x5564c55ac0b0 2024-09-13T17:17:41.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.921+0000 7f0db79c3740 10 client.16761 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:17:41.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.921+0000 7f0db79c3740 10 client.16761 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:17:41.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.921+0000 7f0db79c3740 20 client.16761 populate_metadata read hostname 'smithi087' 2024-09-13T17:17:41.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.921+0000 7f0db79c3740 1 --2- 172.21.15.87:0/898043502 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5564c55b6950 0x5564c561f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:41.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.921+0000 7f0db79c3740 4 client.16761 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:17:41.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.921+0000 7f0db79c3740 1 -- 172.21.15.87:0/898043502 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5564c52024e0 con 0x5564c55b6950 2024-09-13T17:17:41.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.921+0000 7f0dae59c640 1 --2- 172.21.15.87:0/898043502 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5564c55b6950 0x5564c561f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:41.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.922+0000 7f0d95ffb640 10 client.16761 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:17:41.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.922+0000 7f0dae59c640 1 --2- 172.21.15.87:0/898043502 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5564c55b6950 0x5564c561f880 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4677de34b55c678e server_cookie=fdfed770d3ecf056 in_seq=0 out_seq=0 2024-09-13T17:17:41.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.922+0000 7f0d95ffb640 1 -- 172.21.15.87:0/898043502 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5564c52024e0 con 0x5564c55b6950 2024-09-13T17:17:41.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.922+0000 7f0d95ffb640 10 client.16761 handle_command_reply: tid=0 2024-09-13T17:17:41.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.922+0000 7f0db79c3740 1 client.16761 shutdown 2024-09-13T17:17:41.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.922+0000 7f0db79c3740 1 -- 172.21.15.87:0/898043502 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564c55ac0b0 msgr2=0x5564c55bc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.922+0000 7f0db79c3740 1 --2- 172.21.15.87:0/898043502 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564c55ac0b0 0x5564c55bc080 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f0da8004490 tx=0x7f0da8005f90 comp rx=0 tx=0).stop 2024-09-13T17:17:41.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.922+0000 7f0db79c3740 1 -- 172.21.15.87:0/898043502 shutdown_connections 2024-09-13T17:17:41.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.922+0000 7f0db79c3740 1 --2- 172.21.15.87:0/898043502 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5564c55b6950 0x5564c561f880 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.922+0000 7f0db79c3740 1 --2- 172.21.15.87:0/898043502 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5564c55ac0b0 0x5564c55bc080 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.922+0000 7f0db79c3740 1 --2- 172.21.15.87:0/898043502 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5564c55ab790 0x5564c55bbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.922+0000 7f0d95ffb640 0 client.16761 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:17:41.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.922+0000 7f0db79c3740 1 --2- 172.21.15.87:0/898043502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564c55a7d00 0x5564c55bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.922+0000 7f0db79c3740 1 -- 172.21.15.87:0/898043502 >> 172.21.15.87:0/898043502 conn(0x5564c55b60e0 msgr2=0x5564c55ae280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:41.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.922+0000 7f0db79c3740 1 -- 172.21.15.87:0/898043502 shutdown_connections 2024-09-13T17:17:41.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.922+0000 7f0db79c3740 1 -- 172.21.15.87:0/898043502 wait complete. 2024-09-13T17:17:41.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.922+0000 7f0db79c3740 20 client.16761 trim_cache size 0 max 16384 2024-09-13T17:17:41.931 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:17:41.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.923+0000 7f0db4c9c640 1 -- 172.21.15.87:0/1987478544 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0d9c0a12b0 msgr2=0x7f0d9c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.923+0000 7f0db4c9c640 1 --2- 172.21.15.87:0/1987478544 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0d9c0a12b0 0x7f0d9c0a3770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0da8009b90 tx=0x7f0da8009590 comp rx=0 tx=0).stop 2024-09-13T17:17:41.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.923+0000 7f0db4c9c640 1 -- 172.21.15.87:0/1987478544 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0db0103fb0 msgr2=0x7f0db00fb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:41.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.923+0000 7f0db4c9c640 1 --2- 172.21.15.87:0/1987478544 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0db0103fb0 0x7f0db00fb5e0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f0d9800e9c0 tx=0x7f0d9800ee80 comp rx=0 tx=0).stop 2024-09-13T17:17:41.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.923+0000 7f0db4c9c640 1 -- 172.21.15.87:0/1987478544 shutdown_connections 2024-09-13T17:17:41.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.923+0000 7f0db4c9c640 1 --2- 172.21.15.87:0/1987478544 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0db00fbb20 0x7f0db01a44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.923+0000 7f0db4c9c640 1 --2- 172.21.15.87:0/1987478544 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0d9c0a12b0 0x7f0d9c0a3770 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.923+0000 7f0db4c9c640 1 --2- 172.21.15.87:0/1987478544 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0db0103fb0 0x7f0db00fb5e0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.923+0000 7f0db4c9c640 1 --2- 172.21.15.87:0/1987478544 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0db00fee60 0x7f0db00fb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:41.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.923+0000 7f0db4c9c640 1 -- 172.21.15.87:0/1987478544 >> 172.21.15.87:0/1987478544 conn(0x7f0db0075c60 msgr2=0x7f0db0067820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:41.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.923+0000 7f0db4c9c640 1 -- 172.21.15.87:0/1987478544 shutdown_connections 2024-09-13T17:17:41.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:41.923+0000 7f0db4c9c640 1 -- 172.21.15.87:0/1987478544 wait complete. 2024-09-13T17:17:42.936 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-13T17:17:42.937 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-09-13T17:17:43.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.051+0000 7fa8cf365640 1 -- 172.21.15.87:0/3795629330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8c80ff810 msgr2=0x7fa8c8103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:43.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.051+0000 7fa8cf365640 1 --2- 172.21.15.87:0/3795629330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8c80ff810 0x7fa8c8103850 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8009930 tx=0x7fa8b802a420 comp rx=0 tx=0).stop 2024-09-13T17:17:43.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.051+0000 7fa8cf365640 1 -- 172.21.15.87:0/3795629330 shutdown_connections 2024-09-13T17:17:43.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.051+0000 7fa8cf365640 1 --2- 172.21.15.87:0/3795629330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8c8103fb0 0x7fa8c810bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.051+0000 7fa8cf365640 1 --2- 172.21.15.87:0/3795629330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8c80ff810 0x7fa8c8103850 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.051+0000 7fa8cf365640 1 --2- 172.21.15.87:0/3795629330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8c80fee60 0x7fa8c80ff240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.051+0000 7fa8cf365640 1 -- 172.21.15.87:0/3795629330 >> 172.21.15.87:0/3795629330 conn(0x7fa8c8075c60 msgr2=0x7fa8c80fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:43.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.051+0000 7fa8cf365640 1 -- 172.21.15.87:0/3795629330 shutdown_connections 2024-09-13T17:17:43.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.051+0000 7fa8cf365640 1 -- 172.21.15.87:0/3795629330 wait complete. 2024-09-13T17:17:43.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.051+0000 7fa8cf365640 1 Processor -- start 2024-09-13T17:17:43.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.052+0000 7fa8cf365640 1 -- start start 2024-09-13T17:17:43.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.052+0000 7fa8cf365640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8c80fee60 0x7fa8c8197190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.052+0000 7fa8cf365640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8c8103fb0 0x7fa8c81976d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.052+0000 7fa8cf365640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8c8197cb0 0x7fa8c81a2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.052+0000 7fa8cf365640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c81a2950 con 0x7fa8c80fee60 2024-09-13T17:17:43.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.052+0000 7fa8cf365640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c81a2ac0 con 0x7fa8c8197cb0 2024-09-13T17:17:43.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.052+0000 7fa8cf365640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c81a2c80 con 0x7fa8c8103fb0 2024-09-13T17:17:43.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.052+0000 7fa8cd101640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8c80fee60 0x7fa8c8197190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.052+0000 7fa8cd101640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8c80fee60 0x7fa8c8197190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45226/0 (socket says 172.21.15.87:45226) 2024-09-13T17:17:43.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.052+0000 7fa8cd101640 1 -- 172.21.15.87:0/1204206045 learned_addr learned my addr 172.21.15.87:0/1204206045 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:43.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.052+0000 7fa8cd902640 1 --2- 172.21.15.87:0/1204206045 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8c8197cb0 0x7fa8c81a2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.052+0000 7fa8cc900640 1 --2- 172.21.15.87:0/1204206045 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8c8103fb0 0x7fa8c81976d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.052+0000 7fa8cd101640 1 -- 172.21.15.87:0/1204206045 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8c8103fb0 msgr2=0x7fa8c81976d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:43.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.052+0000 7fa8cd101640 1 --2- 172.21.15.87:0/1204206045 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8c8103fb0 0x7fa8c81976d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.052+0000 7fa8cd101640 1 -- 172.21.15.87:0/1204206045 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8c8197cb0 msgr2=0x7fa8c81a2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:43.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.052+0000 7fa8cd101640 1 --2- 172.21.15.87:0/1204206045 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8c8197cb0 0x7fa8c81a2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.052+0000 7fa8cd101640 1 -- 172.21.15.87:0/1204206045 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b8009560 con 0x7fa8c80fee60 2024-09-13T17:17:43.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.052+0000 7fa8cc900640 1 --2- 172.21.15.87:0/1204206045 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8c8103fb0 0x7fa8c81976d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:43.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.052+0000 7fa8cd101640 1 --2- 172.21.15.87:0/1204206045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8c80fee60 0x7fa8c8197190 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400d770 tx=0x7fa8c400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:43.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.053+0000 7fa8be7fc640 1 -- 172.21.15.87:0/1204206045 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4009c30 con 0x7fa8c80fee60 2024-09-13T17:17:43.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.053+0000 7fa8be7fc640 1 -- 172.21.15.87:0/1204206045 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa8c400de80 con 0x7fa8c80fee60 2024-09-13T17:17:43.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.053+0000 7fa8cf365640 1 -- 172.21.15.87:0/1204206045 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8c81a2f60 con 0x7fa8c80fee60 2024-09-13T17:17:43.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.053+0000 7fa8be7fc640 1 -- 172.21.15.87:0/1204206045 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4004e00 con 0x7fa8c80fee60 2024-09-13T17:17:43.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.053+0000 7fa8cf365640 1 -- 172.21.15.87:0/1204206045 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c81a3390 con 0x7fa8c80fee60 2024-09-13T17:17:43.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.055+0000 7fa8be7fc640 1 -- 172.21.15.87:0/1204206045 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fa8c4004f60 con 0x7fa8c80fee60 2024-09-13T17:17:43.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.055+0000 7fa8d2091740 1 Processor -- start 2024-09-13T17:17:43.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.055+0000 7fa8d2091740 1 -- start start 2024-09-13T17:17:43.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.055+0000 7fa8d2091740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560de9bfd680 0x560de9bfda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.055+0000 7fa8d2091740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560de9bfdfa0 0x560de9c0c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.056+0000 7fa8d2091740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560de9c0cd90 0x560de9c0f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.056+0000 7fa8d2091740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560de9b68c60 con 0x560de9bfd680 2024-09-13T17:17:43.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.056+0000 7fa8d2091740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560de9b663f0 con 0x560de9bfdfa0 2024-09-13T17:17:43.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.056+0000 7fa8d2091740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560de9b61ce0 con 0x560de9c0cd90 2024-09-13T17:17:43.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.056+0000 7fa8be7fc640 1 --2- 172.21.15.87:0/1204206045 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa8b40a1200 0x7fa8b40a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.056+0000 7fa8cd902640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560de9bfd680 0x560de9bfda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.056+0000 7fa8cd902640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560de9bfd680 0x560de9bfda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45238/0 (socket says 172.21.15.87:45238) 2024-09-13T17:17:43.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.056+0000 7fa8cd902640 1 -- 172.21.15.87:0/3556327140 learned_addr learned my addr 172.21.15.87:0/3556327140 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:43.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.056+0000 7fa8cd902640 1 --2- 172.21.15.87:0/1204206045 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa8b40a1200 0x7fa8b40a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.056+0000 7fa8be7fc640 1 -- 172.21.15.87:0/1204206045 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fa8c40ccbb0 con 0x7fa8c80fee60 2024-09-13T17:17:43.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.056+0000 7fa8cd101640 1 --2- 172.21.15.87:0/3556327140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560de9bfdfa0 0x560de9c0c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.056+0000 7fa8cc900640 1 --2- 172.21.15.87:0/3556327140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560de9c0cd90 0x560de9c0f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.056+0000 7fa8cd902640 1 -- 172.21.15.87:0/3556327140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560de9c0cd90 msgr2=0x560de9c0f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:43.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.056+0000 7fa8cd902640 1 --2- 172.21.15.87:0/3556327140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560de9c0cd90 0x560de9c0f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.056+0000 7fa8cd902640 1 -- 172.21.15.87:0/3556327140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560de9bfdfa0 msgr2=0x560de9c0c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:43.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.056+0000 7fa8cd902640 1 --2- 172.21.15.87:0/3556327140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560de9bfdfa0 0x560de9c0c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.056+0000 7fa8cd902640 1 -- 172.21.15.87:0/3556327140 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560de9b1d970 con 0x560de9bfd680 2024-09-13T17:17:43.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.056+0000 7fa8cd101640 1 --2- 172.21.15.87:0/3556327140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560de9bfdfa0 0x560de9c0c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:43.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.056+0000 7fa8cd902640 1 --2- 172.21.15.87:0/3556327140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560de9bfd680 0x560de9bfda60 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0013e70 tx=0x7fa8c00107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab6d51267e22e5a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:43.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.056+0000 7fa8cd902640 1 --2- 172.21.15.87:0/1204206045 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa8b40a1200 0x7fa8b40a36c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0010ca0 tx=0x7fa8c0015000 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:43.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.056+0000 7fa8b37fe640 1 -- 172.21.15.87:0/3556327140 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c000ae10 con 0x560de9bfd680 2024-09-13T17:17:43.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.056+0000 7fa8b37fe640 1 -- 172.21.15.87:0/3556327140 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa8c0019040 con 0x560de9bfd680 2024-09-13T17:17:43.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.057+0000 7fa8b37fe640 1 -- 172.21.15.87:0/3556327140 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c001f400 con 0x560de9bfd680 2024-09-13T17:17:43.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.057+0000 7fa8d2091740 1 -- 172.21.15.87:0/3556327140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560de9bfd680 msgr2=0x560de9bfda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:43.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.057+0000 7fa8d2091740 1 --2- 172.21.15.87:0/3556327140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560de9bfd680 0x560de9bfda60 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0013e70 tx=0x7fa8c00107a0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.057+0000 7fa8d2091740 1 -- 172.21.15.87:0/3556327140 shutdown_connections 2024-09-13T17:17:43.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.057+0000 7fa8d2091740 1 --2- 172.21.15.87:0/3556327140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560de9c0cd90 0x560de9c0f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.057+0000 7fa8d2091740 1 --2- 172.21.15.87:0/3556327140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560de9bfdfa0 0x560de9c0c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.057+0000 7fa8d2091740 1 --2- 172.21.15.87:0/3556327140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560de9bfd680 0x560de9bfda60 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.057+0000 7fa8d2091740 1 -- 172.21.15.87:0/3556327140 >> 172.21.15.87:0/3556327140 conn(0x560de9bf9d50 msgr2=0x560de9bfa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:43.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.057+0000 7fa8d2091740 1 -- 172.21.15.87:0/3556327140 shutdown_connections 2024-09-13T17:17:43.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.057+0000 7fa8d2091740 1 -- 172.21.15.87:0/3556327140 wait complete. 2024-09-13T17:17:43.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.058+0000 7fa8d2091740 1 -- start start 2024-09-13T17:17:43.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.058+0000 7fa8d2091740 1 Processor -- start 2024-09-13T17:17:43.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.058+0000 7fa8d2091740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560de9bfd680 0x560de9c0c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.058+0000 7fa8d2091740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560de9bfdfa0 0x560de9c09aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.058+0000 7fa8d2091740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560de9c0cd90 0x560de9c0a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.058+0000 7fa8d2091740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560de9b1ff80 con 0x560de9bfd680 2024-09-13T17:17:43.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.058+0000 7fa8d2091740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560de9b1fc20 con 0x560de9c0cd90 2024-09-13T17:17:43.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.058+0000 7fa8d2091740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560de9aecab0 con 0x560de9bfdfa0 2024-09-13T17:17:43.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.058+0000 7fa8d2091740 10 client.0 _ll_register_callbacks cb 0x560de9b5b350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:17:43.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.058+0000 7fa8cd101640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560de9bfd680 0x560de9c0c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.058+0000 7fa8cd101640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560de9bfd680 0x560de9c0c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45248/0 (socket says 172.21.15.87:45248) 2024-09-13T17:17:43.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.058+0000 7fa8cd101640 1 -- 172.21.15.87:0/2970779871 learned_addr learned my addr 172.21.15.87:0/2970779871 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:43.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.058+0000 7fa8cd902640 1 --2- 172.21.15.87:0/2970779871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560de9c0cd90 0x560de9c0a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.058+0000 7fa8cd101640 1 -- 172.21.15.87:0/2970779871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560de9bfdfa0 msgr2=0x560de9c09aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T17:17:43.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.058+0000 7fa8cd101640 1 --2- 172.21.15.87:0/2970779871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560de9bfdfa0 0x560de9c09aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.058+0000 7fa8cd101640 1 -- 172.21.15.87:0/2970779871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560de9c0cd90 msgr2=0x560de9c0a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:43.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.058+0000 7fa8cd101640 1 --2- 172.21.15.87:0/2970779871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560de9c0cd90 0x560de9c0a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.058+0000 7fa8cd101640 1 -- 172.21.15.87:0/2970779871 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c0013a20 con 0x560de9bfd680 2024-09-13T17:17:43.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.059+0000 7fa8cd101640 1 --2- 172.21.15.87:0/2970779871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560de9bfd680 0x560de9c0c800 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4095e10 tx=0x7fa8c4099510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=151a574f144b0122 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:43.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.059+0000 7fa8b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:17:43.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.059+0000 7fa8b0ff9640 1 -- 172.21.15.87:0/2970779871 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c40652b0 con 0x560de9bfd680 2024-09-13T17:17:43.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.059+0000 7fa8b0ff9640 1 -- 172.21.15.87:0/2970779871 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fa8c4099910 con 0x560de9bfd680 2024-09-13T17:17:43.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.059+0000 7fa8d2091740 1 -- 172.21.15.87:0/2970779871 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560de9855590 con 0x560de9bfd680 2024-09-13T17:17:43.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.059+0000 7fa8b0ff9640 1 -- 172.21.15.87:0/2970779871 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8c409d740 con 0x560de9bfd680 2024-09-13T17:17:43.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.059+0000 7fa8d2091740 10 client.16773 fetch_fsmap learned FSMap version 30 2024-09-13T17:17:43.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.059+0000 7fa8d2091740 1 -- 172.21.15.87:0/2970779871 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x560de9b60360 con 0x560de9bfd680 2024-09-13T17:17:43.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.059+0000 7fa8b0ff9640 1 -- 172.21.15.87:0/2970779871 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x560de9855590 con 0x560de9bfd680 2024-09-13T17:17:43.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.059+0000 7fa8b0ff9640 1 -- 172.21.15.87:0/2970779871 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fa8c40b20c0 con 0x560de9bfd680 2024-09-13T17:17:43.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.059+0000 7fa8d2091740 10 client.16773 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:17:43.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.059+0000 7fa8d2091740 10 client.16773 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:17:43.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.059+0000 7fa8d2091740 20 client.16773 populate_metadata read hostname 'smithi087' 2024-09-13T17:17:43.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.059+0000 7fa8d2091740 1 --2- 172.21.15.87:0/2970779871 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560de9c1ca30 0x560de9c1ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.059+0000 7fa8d2091740 4 client.16773 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:17:43.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.059+0000 7fa8d2091740 1 -- 172.21.15.87:0/2970779871 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560de9866860 con 0x560de9c1ca30 2024-09-13T17:17:43.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.060+0000 7fa8cc900640 1 --2- 172.21.15.87:0/2970779871 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560de9c1ca30 0x560de9c1ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.060+0000 7fa8b0ff9640 10 client.16773 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:17:43.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.060+0000 7fa8cc900640 1 --2- 172.21.15.87:0/2970779871 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560de9c1ca30 0x560de9c1ee20 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1458d918d8c6e2c0 server_cookie=3b695c6016bad5a3 in_seq=0 out_seq=0 2024-09-13T17:17:43.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.061+0000 7fa8b0ff9640 1 -- 172.21.15.87:0/2970779871 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x560de9866860 con 0x560de9c1ca30 2024-09-13T17:17:43.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.061+0000 7fa8b0ff9640 10 client.16773 handle_command_reply: tid=0 2024-09-13T17:17:43.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.061+0000 7fa8d2091740 1 client.16773 shutdown 2024-09-13T17:17:43.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.061+0000 7fa8d2091740 1 -- 172.21.15.87:0/2970779871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560de9bfd680 msgr2=0x560de9c0c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:43.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.061+0000 7fa8d2091740 1 --2- 172.21.15.87:0/2970779871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560de9bfd680 0x560de9c0c800 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4095e10 tx=0x7fa8c4099510 comp rx=0 tx=0).stop 2024-09-13T17:17:43.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.061+0000 7fa8d2091740 1 -- 172.21.15.87:0/2970779871 shutdown_connections 2024-09-13T17:17:43.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.061+0000 7fa8d2091740 1 --2- 172.21.15.87:0/2970779871 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560de9c1ca30 0x560de9c1ee20 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.061+0000 7fa8d2091740 1 --2- 172.21.15.87:0/2970779871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560de9c0cd90 0x560de9c0a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.061+0000 7fa8d2091740 1 --2- 172.21.15.87:0/2970779871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560de9bfdfa0 0x560de9c09aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.061+0000 7fa8b0ff9640 0 client.16773 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:17:43.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.061+0000 7fa8d2091740 1 --2- 172.21.15.87:0/2970779871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560de9bfd680 0x560de9c0c800 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.061+0000 7fa8d2091740 1 -- 172.21.15.87:0/2970779871 >> 172.21.15.87:0/2970779871 conn(0x560de9bf9d50 msgr2=0x560de9bf9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:43.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.061+0000 7fa8d2091740 1 -- 172.21.15.87:0/2970779871 shutdown_connections 2024-09-13T17:17:43.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.061+0000 7fa8d2091740 1 -- 172.21.15.87:0/2970779871 wait complete. 2024-09-13T17:17:43.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.061+0000 7fa8d2091740 20 client.16773 trim_cache size 0 max 16384 2024-09-13T17:17:43.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.075+0000 7fa8d2091740 1 Processor -- start 2024-09-13T17:17:43.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.075+0000 7fa8d2091740 1 -- start start 2024-09-13T17:17:43.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.075+0000 7fa8d2091740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560de9bfd680 0x560de9c09a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.075+0000 7fa8d2091740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560de9bfdfa0 0x560de9c0c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.075+0000 7fa8d2091740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560de9c0cd90 0x560de9c0c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.075+0000 7fa8d2091740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560de9c0ac40 con 0x560de9bfd680 2024-09-13T17:17:43.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.075+0000 7fa8d2091740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560de9866860 con 0x560de9c0cd90 2024-09-13T17:17:43.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.075+0000 7fa8d2091740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560de9855590 con 0x560de9bfdfa0 2024-09-13T17:17:43.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.075+0000 7fa8cd101640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560de9bfd680 0x560de9c09a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.075+0000 7fa8cd101640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560de9bfd680 0x560de9c09a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45250/0 (socket says 172.21.15.87:45250) 2024-09-13T17:17:43.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.076+0000 7fa8cd101640 1 -- 172.21.15.87:0/565635212 learned_addr learned my addr 172.21.15.87:0/565635212 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:43.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.076+0000 7fa8cc900640 1 --2- 172.21.15.87:0/565635212 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560de9bfdfa0 0x560de9c0c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.076+0000 7fa8cd101640 1 -- 172.21.15.87:0/565635212 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560de9bfdfa0 msgr2=0x560de9c0c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:43.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.076+0000 7fa8cd101640 1 --2- 172.21.15.87:0/565635212 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560de9bfdfa0 0x560de9c0c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.076+0000 7fa8cd101640 1 -- 172.21.15.87:0/565635212 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560de9c0cd90 msgr2=0x560de9c0c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:43.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.076+0000 7fa8cd902640 1 --2- 172.21.15.87:0/565635212 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560de9c0cd90 0x560de9c0c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.076+0000 7fa8cd101640 1 --2- 172.21.15.87:0/565635212 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560de9c0cd90 0x560de9c0c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.076+0000 7fa8cd101640 1 -- 172.21.15.87:0/565635212 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560de9b021c0 con 0x560de9bfd680 2024-09-13T17:17:43.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.076+0000 7fa8cd101640 1 --2- 172.21.15.87:0/565635212 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560de9bfd680 0x560de9c09a50 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4096380 tx=0x7fa8c4097ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed69cd7c44bf9f81 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:43.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.076+0000 7fa8b3fff640 1 -- 172.21.15.87:0/565635212 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c40a1bc0 con 0x560de9bfd680 2024-09-13T17:17:43.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.076+0000 7fa8b3fff640 1 -- 172.21.15.87:0/565635212 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa8c4099910 con 0x560de9bfd680 2024-09-13T17:17:43.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.076+0000 7fa8b3fff640 1 -- 172.21.15.87:0/565635212 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4096020 con 0x560de9bfd680 2024-09-13T17:17:43.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.077+0000 7fa8d2091740 1 -- 172.21.15.87:0/565635212 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560de9bfd680 msgr2=0x560de9c09a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:43.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.077+0000 7fa8d2091740 1 --2- 172.21.15.87:0/565635212 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560de9bfd680 0x560de9c09a50 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4096380 tx=0x7fa8c4097ec0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.077+0000 7fa8d2091740 1 -- 172.21.15.87:0/565635212 shutdown_connections 2024-09-13T17:17:43.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.077+0000 7fa8d2091740 1 --2- 172.21.15.87:0/565635212 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560de9c0cd90 0x560de9c0c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.077+0000 7fa8d2091740 1 --2- 172.21.15.87:0/565635212 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560de9bfdfa0 0x560de9c0c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.077+0000 7fa8d2091740 1 --2- 172.21.15.87:0/565635212 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560de9bfd680 0x560de9c09a50 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.077+0000 7fa8d2091740 1 -- 172.21.15.87:0/565635212 >> 172.21.15.87:0/565635212 conn(0x560de9bf9d50 msgr2=0x560de9c09340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:43.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.077+0000 7fa8d2091740 1 -- 172.21.15.87:0/565635212 shutdown_connections 2024-09-13T17:17:43.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.077+0000 7fa8d2091740 1 -- 172.21.15.87:0/565635212 wait complete. 2024-09-13T17:17:43.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.077+0000 7fa8d2091740 1 -- start start 2024-09-13T17:17:43.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.077+0000 7fa8d2091740 1 Processor -- start 2024-09-13T17:17:43.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.077+0000 7fa8d2091740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560de9bfd680 0x560de9c10540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.077+0000 7fa8d2091740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560de9bfdfa0 0x560de9c10a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.077+0000 7fa8d2091740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560de9c0cd90 0x560de9c10fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.077+0000 7fa8d2091740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560de9c72f20 con 0x560de9bfd680 2024-09-13T17:17:43.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.077+0000 7fa8d2091740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560de9c73060 con 0x560de9c0cd90 2024-09-13T17:17:43.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.077+0000 7fa8d2091740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560de9c731a0 con 0x560de9bfdfa0 2024-09-13T17:17:43.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.077+0000 7fa8d2091740 10 client.0 _ll_register_callbacks cb 0x7fa8c400d6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:17:43.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.078+0000 7fa8cd101640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560de9bfd680 0x560de9c10540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.078+0000 7fa8cd101640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560de9bfd680 0x560de9c10540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45254/0 (socket says 172.21.15.87:45254) 2024-09-13T17:17:43.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.078+0000 7fa8cd101640 1 -- 172.21.15.87:0/2211138110 learned_addr learned my addr 172.21.15.87:0/2211138110 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:43.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.078+0000 7fa8cc900640 1 --2- 172.21.15.87:0/2211138110 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560de9bfdfa0 0x560de9c10a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.078+0000 7fa8cd902640 1 --2- 172.21.15.87:0/2211138110 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560de9c0cd90 0x560de9c10fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.078+0000 7fa8cd101640 1 -- 172.21.15.87:0/2211138110 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560de9bfdfa0 msgr2=0x560de9c10a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:43.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.078+0000 7fa8cd101640 1 --2- 172.21.15.87:0/2211138110 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560de9bfdfa0 0x560de9c10a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.078+0000 7fa8cd101640 1 -- 172.21.15.87:0/2211138110 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560de9c0cd90 msgr2=0x560de9c10fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:43.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.078+0000 7fa8cd101640 1 --2- 172.21.15.87:0/2211138110 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560de9c0cd90 0x560de9c10fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.078+0000 7fa8cd101640 1 -- 172.21.15.87:0/2211138110 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560de9b60360 con 0x560de9bfd680 2024-09-13T17:17:43.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.078+0000 7fa8cd902640 1 --2- 172.21.15.87:0/2211138110 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560de9c0cd90 0x560de9c10fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:43.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.078+0000 7fa8cd101640 1 --2- 172.21.15.87:0/2211138110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560de9bfd680 0x560de9c10540 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4012040 tx=0x7fa8c40b22f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7676a8c8f6afb5c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:43.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.078+0000 7fa8b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:17:43.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.078+0000 7fa8b0ff9640 1 -- 172.21.15.87:0/2211138110 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c40b92b0 con 0x560de9bfd680 2024-09-13T17:17:43.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.078+0000 7fa8b0ff9640 1 -- 172.21.15.87:0/2211138110 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fa8c409d740 con 0x560de9bfd680 2024-09-13T17:17:43.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.078+0000 7fa8d2091740 1 -- 172.21.15.87:0/2211138110 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa8c0019040 con 0x560de9bfd680 2024-09-13T17:17:43.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.078+0000 7fa8b0ff9640 1 -- 172.21.15.87:0/2211138110 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8c40a1bc0 con 0x560de9bfd680 2024-09-13T17:17:43.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.078+0000 7fa8d2091740 10 client.16779 fetch_fsmap learned FSMap version 30 2024-09-13T17:17:43.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.078+0000 7fa8d2091740 1 -- 172.21.15.87:0/2211138110 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x560de9b27990 con 0x560de9bfd680 2024-09-13T17:17:43.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.078+0000 7fa8b0ff9640 1 -- 172.21.15.87:0/2211138110 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa8c0019040 con 0x560de9bfd680 2024-09-13T17:17:43.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.079+0000 7fa8b0ff9640 1 -- 172.21.15.87:0/2211138110 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fa8c4095700 con 0x560de9bfd680 2024-09-13T17:17:43.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.079+0000 7fa8d2091740 10 client.16779 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:17:43.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.079+0000 7fa8d2091740 10 client.16779 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:17:43.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.079+0000 7fa8d2091740 20 client.16779 populate_metadata read hostname 'smithi087' 2024-09-13T17:17:43.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.079+0000 7fa8d2091740 1 --2- 172.21.15.87:0/2211138110 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560de9c744b0 0x560de9c768d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.079+0000 7fa8d2091740 4 client.16779 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-13T17:17:43.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.079+0000 7fa8d2091740 1 -- 172.21.15.87:0/2211138110 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x560de98b9eb0 con 0x560de9c744b0 2024-09-13T17:17:43.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.079+0000 7fa8cc900640 1 --2- 172.21.15.87:0/2211138110 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560de9c744b0 0x560de9c768d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.079+0000 7fa8cc900640 1 --2- 172.21.15.87:0/2211138110 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560de9c744b0 0x560de9c768d0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2268e73420a317a0 server_cookie=ecf796c431bba5dc in_seq=0 out_seq=0 2024-09-13T17:17:43.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.079+0000 7fa8b0ff9640 10 client.16779 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:17:43.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.080+0000 7fa8b0ff9640 1 -- 172.21.15.87:0/2211138110 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x560de98b9eb0 con 0x560de9c744b0 2024-09-13T17:17:43.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.080+0000 7fa8b0ff9640 10 client.16779 handle_command_reply: tid=0 2024-09-13T17:17:43.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.080+0000 7fa8d2091740 1 client.16779 shutdown 2024-09-13T17:17:43.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.081+0000 7fa8d2091740 1 -- 172.21.15.87:0/2211138110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560de9bfd680 msgr2=0x560de9c10540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:43.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.081+0000 7fa8d2091740 1 --2- 172.21.15.87:0/2211138110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560de9bfd680 0x560de9c10540 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4012040 tx=0x7fa8c40b22f0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.081+0000 7fa8d2091740 1 -- 172.21.15.87:0/2211138110 shutdown_connections 2024-09-13T17:17:43.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.081+0000 7fa8d2091740 1 --2- 172.21.15.87:0/2211138110 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560de9c744b0 0x560de9c768d0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.081+0000 7fa8d2091740 1 --2- 172.21.15.87:0/2211138110 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560de9c0cd90 0x560de9c10fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.081+0000 7fa8d2091740 1 --2- 172.21.15.87:0/2211138110 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560de9bfdfa0 0x560de9c10a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.081+0000 7fa8d2091740 1 --2- 172.21.15.87:0/2211138110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560de9bfd680 0x560de9c10540 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.081+0000 7fa8b0ff9640 0 client.16779 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:17:43.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.081+0000 7fa8d2091740 1 -- 172.21.15.87:0/2211138110 >> 172.21.15.87:0/2211138110 conn(0x560de9bf9d50 msgr2=0x560de9c08350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:43.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.081+0000 7fa8d2091740 1 -- 172.21.15.87:0/2211138110 shutdown_connections 2024-09-13T17:17:43.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.081+0000 7fa8d2091740 1 -- 172.21.15.87:0/2211138110 wait complete. 2024-09-13T17:17:43.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.081+0000 7fa8d2091740 20 client.16779 trim_cache size 0 max 16384 2024-09-13T17:17:43.088 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:17:43.088 INFO:teuthology.orchestra.run.smithi087.stdout: "return_code": 0, 2024-09-13T17:17:43.088 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_tag": "a8b0f995-6c36-4b07-a26d-8f717b04fa75", 2024-09-13T17:17:43.088 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": "asynchronous" 2024-09-13T17:17:43.089 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:17:43.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.081+0000 7fa8cf365640 1 -- 172.21.15.87:0/1204206045 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa8b40a1200 msgr2=0x7fa8b40a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:43.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.081+0000 7fa8cf365640 1 --2- 172.21.15.87:0/1204206045 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa8b40a1200 0x7fa8b40a36c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0010ca0 tx=0x7fa8c0015000 comp rx=0 tx=0).stop 2024-09-13T17:17:43.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.081+0000 7fa8cf365640 1 -- 172.21.15.87:0/1204206045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8c80fee60 msgr2=0x7fa8c8197190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:43.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.081+0000 7fa8cf365640 1 --2- 172.21.15.87:0/1204206045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8c80fee60 0x7fa8c8197190 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400d770 tx=0x7fa8c400dc30 comp rx=0 tx=0).stop 2024-09-13T17:17:43.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.081+0000 7fa8cf365640 1 -- 172.21.15.87:0/1204206045 shutdown_connections 2024-09-13T17:17:43.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.081+0000 7fa8cf365640 1 --2- 172.21.15.87:0/1204206045 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8c8197cb0 0x7fa8c81a2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.081+0000 7fa8cf365640 1 --2- 172.21.15.87:0/1204206045 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8c8103fb0 0x7fa8c81976d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.081+0000 7fa8cf365640 1 --2- 172.21.15.87:0/1204206045 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa8b40a1200 0x7fa8b40a36c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.081+0000 7fa8cf365640 1 --2- 172.21.15.87:0/1204206045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8c80fee60 0x7fa8c8197190 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.081+0000 7fa8cf365640 1 -- 172.21.15.87:0/1204206045 >> 172.21.15.87:0/1204206045 conn(0x7fa8c8075c60 msgr2=0x7fa8c80fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:43.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.082+0000 7fa8cf365640 1 -- 172.21.15.87:0/1204206045 shutdown_connections 2024-09-13T17:17:43.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.082+0000 7fa8cf365640 1 -- 172.21.15.87:0/1204206045 wait complete. 2024-09-13T17:17:43.093 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:17:43.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.193+0000 7f5a9820d640 1 -- 172.21.15.87:0/23334264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a90103fa0 msgr2=0x7f5a9010baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:43.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.193+0000 7f5a9820d640 1 --2- 172.21.15.87:0/23334264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a90103fa0 0x7f5a9010baf0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f5a88009cd0 tx=0x7f5a8802a8e0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.193+0000 7f5a9820d640 1 -- 172.21.15.87:0/23334264 shutdown_connections 2024-09-13T17:17:43.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.193+0000 7f5a9820d640 1 --2- 172.21.15.87:0/23334264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a90103fa0 0x7f5a9010baf0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.193+0000 7f5a9820d640 1 --2- 172.21.15.87:0/23334264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a900ff800 0x7f5a90103840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.193+0000 7f5a9820d640 1 --2- 172.21.15.87:0/23334264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a900fee50 0x7f5a900ff230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.193+0000 7f5a9820d640 1 -- 172.21.15.87:0/23334264 >> 172.21.15.87:0/23334264 conn(0x7f5a900fa8c0 msgr2=0x7f5a900fcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:43.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.193+0000 7f5a9820d640 1 -- 172.21.15.87:0/23334264 shutdown_connections 2024-09-13T17:17:43.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.193+0000 7f5a9820d640 1 -- 172.21.15.87:0/23334264 wait complete. 2024-09-13T17:17:43.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.194+0000 7f5a9820d640 1 Processor -- start 2024-09-13T17:17:43.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.194+0000 7f5a9820d640 1 -- start start 2024-09-13T17:17:43.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.194+0000 7f5a9820d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a900fee50 0x7f5a90196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.194+0000 7f5a9820d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a90103fa0 0x7f5a901967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.194+0000 7f5a9820d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a9019ab90 0x7f5a9019b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.194+0000 7f5a9820d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9019b580 con 0x7f5a90103fa0 2024-09-13T17:17:43.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.194+0000 7f5a9820d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9019b6f0 con 0x7f5a9019ab90 2024-09-13T17:17:43.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.194+0000 7f5a9820d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9019b860 con 0x7f5a900fee50 2024-09-13T17:17:43.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.194+0000 7f5a957a8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a90103fa0 0x7f5a901967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.194+0000 7f5a957a8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a90103fa0 0x7f5a901967a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45264/0 (socket says 172.21.15.87:45264) 2024-09-13T17:17:43.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.194+0000 7f5a957a8640 1 -- 172.21.15.87:0/2818139886 learned_addr learned my addr 172.21.15.87:0/2818139886 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:43.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.194+0000 7f5a95fa9640 1 --2- 172.21.15.87:0/2818139886 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a900fee50 0x7f5a90196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.194+0000 7f5a957a8640 1 -- 172.21.15.87:0/2818139886 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a900fee50 msgr2=0x7f5a90196260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:43.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.194+0000 7f5a957a8640 1 --2- 172.21.15.87:0/2818139886 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a900fee50 0x7f5a90196260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.194+0000 7f5a967aa640 1 --2- 172.21.15.87:0/2818139886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a9019ab90 0x7f5a9019b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.194+0000 7f5a957a8640 1 -- 172.21.15.87:0/2818139886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a9019ab90 msgr2=0x7f5a9019b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:43.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.194+0000 7f5a957a8640 1 --2- 172.21.15.87:0/2818139886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a9019ab90 0x7f5a9019b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.194+0000 7f5a957a8640 1 -- 172.21.15.87:0/2818139886 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a88009900 con 0x7f5a90103fa0 2024-09-13T17:17:43.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.194+0000 7f5a957a8640 1 --2- 172.21.15.87:0/2818139886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a90103fa0 0x7f5a901967a0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f5a8000d740 tx=0x7f5a8000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:43.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.194+0000 7f5a86ffd640 1 -- 172.21.15.87:0/2818139886 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a80009c30 con 0x7f5a90103fa0 2024-09-13T17:17:43.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.195+0000 7f5a86ffd640 1 -- 172.21.15.87:0/2818139886 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5a8000de50 con 0x7f5a90103fa0 2024-09-13T17:17:43.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.195+0000 7f5a9820d640 1 -- 172.21.15.87:0/2818139886 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a901a2e40 con 0x7f5a90103fa0 2024-09-13T17:17:43.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.195+0000 7f5a86ffd640 1 -- 172.21.15.87:0/2818139886 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a80004e40 con 0x7f5a90103fa0 2024-09-13T17:17:43.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.195+0000 7f5a9820d640 1 -- 172.21.15.87:0/2818139886 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a901a3210 con 0x7f5a90103fa0 2024-09-13T17:17:43.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.197+0000 7f5a86ffd640 1 -- 172.21.15.87:0/2818139886 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f5a80004fa0 con 0x7f5a90103fa0 2024-09-13T17:17:43.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.197+0000 7f5a9b00a740 1 Processor -- start 2024-09-13T17:17:43.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.197+0000 7f5a9b00a740 1 -- start start 2024-09-13T17:17:43.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.197+0000 7f5a9b00a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0dea8de10 0x55e0dea8e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.197+0000 7f5a9b00a740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0dea8e730 0x55e0dea98a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.197+0000 7f5a9b00a740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0dea98fd0 0x55e0dea9b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.197+0000 7f5a9b00a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0de9f8f20 con 0x55e0dea8de10 2024-09-13T17:17:43.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.197+0000 7f5a9b00a740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0de9f66b0 con 0x55e0dea98fd0 2024-09-13T17:17:43.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.197+0000 7f5a9b00a740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0de9f1fa0 con 0x55e0dea8e730 2024-09-13T17:17:43.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.197+0000 7f5a967aa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0dea8de10 0x55e0dea8e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.197+0000 7f5a967aa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0dea8de10 0x55e0dea8e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45276/0 (socket says 172.21.15.87:45276) 2024-09-13T17:17:43.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.197+0000 7f5a967aa640 1 -- 172.21.15.87:0/230703115 learned_addr learned my addr 172.21.15.87:0/230703115 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:43.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.198+0000 7f5a95fa9640 1 --2- 172.21.15.87:0/230703115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0dea8e730 0x55e0dea98a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.198+0000 7f5a86ffd640 1 --2- 172.21.15.87:0/2818139886 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5a7c0a1200 0x7f5a7c0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.198+0000 7f5a957a8640 1 --2- 172.21.15.87:0/230703115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0dea98fd0 0x55e0dea9b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.198+0000 7f5a967aa640 1 -- 172.21.15.87:0/230703115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0dea8e730 msgr2=0x55e0dea98a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:43.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.198+0000 7f5a967aa640 1 --2- 172.21.15.87:0/230703115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0dea8e730 0x55e0dea98a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.198+0000 7f5a967aa640 1 -- 172.21.15.87:0/230703115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0dea98fd0 msgr2=0x55e0dea9b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:43.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.198+0000 7f5a967aa640 1 --2- 172.21.15.87:0/230703115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0dea98fd0 0x55e0dea9b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.198+0000 7f5a967aa640 1 -- 172.21.15.87:0/230703115 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0de9ac840 con 0x55e0dea8de10 2024-09-13T17:17:43.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.198+0000 7f5a95fa9640 1 --2- 172.21.15.87:0/230703115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0dea8e730 0x55e0dea98a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:17:43.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.198+0000 7f5a967aa640 1 --2- 172.21.15.87:0/2818139886 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5a7c0a1200 0x7f5a7c0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.198+0000 7f5a86ffd640 1 -- 172.21.15.87:0/2818139886 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f5a800cca80 con 0x7f5a90103fa0 2024-09-13T17:17:43.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.198+0000 7f5a967aa640 1 --2- 172.21.15.87:0/230703115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0dea8de10 0x55e0dea8e1f0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f5a880315b0 tx=0x7f5a880315e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa05d2dd409a1f20 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:43.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.198+0000 7f5a7bfff640 1 -- 172.21.15.87:0/230703115 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a88003b70 con 0x55e0dea8de10 2024-09-13T17:17:43.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.198+0000 7f5a7bfff640 1 -- 172.21.15.87:0/230703115 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5a88003cd0 con 0x55e0dea8de10 2024-09-13T17:17:43.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.198+0000 7f5a7bfff640 1 -- 172.21.15.87:0/230703115 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a880048a0 con 0x55e0dea8de10 2024-09-13T17:17:43.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.199+0000 7f5a9b00a740 1 -- 172.21.15.87:0/230703115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0dea8de10 msgr2=0x55e0dea8e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:43.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.199+0000 7f5a9b00a740 1 --2- 172.21.15.87:0/230703115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0dea8de10 0x55e0dea8e1f0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f5a880315b0 tx=0x7f5a880315e0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.199+0000 7f5a967aa640 1 --2- 172.21.15.87:0/2818139886 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5a7c0a1200 0x7f5a7c0a36c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5a88046000 tx=0x7f5a8804b000 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:43.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.199+0000 7f5a9b00a740 1 -- 172.21.15.87:0/230703115 shutdown_connections 2024-09-13T17:17:43.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.199+0000 7f5a9b00a740 1 --2- 172.21.15.87:0/230703115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0dea98fd0 0x55e0dea9b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.199+0000 7f5a9b00a740 1 --2- 172.21.15.87:0/230703115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0dea8e730 0x55e0dea98a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.199+0000 7f5a9b00a740 1 --2- 172.21.15.87:0/230703115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0dea8de10 0x55e0dea8e1f0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.199+0000 7f5a9b00a740 1 -- 172.21.15.87:0/230703115 >> 172.21.15.87:0/230703115 conn(0x55e0dea8a380 msgr2=0x55e0dea8a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:43.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.199+0000 7f5a9b00a740 1 -- 172.21.15.87:0/230703115 shutdown_connections 2024-09-13T17:17:43.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.199+0000 7f5a9b00a740 1 -- 172.21.15.87:0/230703115 wait complete. 2024-09-13T17:17:43.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.199+0000 7f5a9b00a740 1 -- start start 2024-09-13T17:17:43.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.200+0000 7f5a9b00a740 1 Processor -- start 2024-09-13T17:17:43.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.200+0000 7f5a9b00a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0dea8de10 0x55e0dea98a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.200+0000 7f5a9b00a740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0dea8e730 0x55e0dea95ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.200+0000 7f5a9b00a740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0dea98fd0 0x55e0dea96420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.200+0000 7f5a9b00a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0de9932a0 con 0x55e0dea8de10 2024-09-13T17:17:43.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.200+0000 7f5a9b00a740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0de6ca430 con 0x55e0dea98fd0 2024-09-13T17:17:43.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.200+0000 7f5a9b00a740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0de975680 con 0x55e0dea8e730 2024-09-13T17:17:43.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.200+0000 7f5a95fa9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0dea8de10 0x55e0dea98a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.200+0000 7f5a9b00a740 10 client.0 _ll_register_callbacks cb 0x55e0de9eb610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:17:43.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.200+0000 7f5a95fa9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0dea8de10 0x55e0dea98a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45288/0 (socket says 172.21.15.87:45288) 2024-09-13T17:17:43.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.200+0000 7f5a95fa9640 1 -- 172.21.15.87:0/3785898125 learned_addr learned my addr 172.21.15.87:0/3785898125 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:43.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.200+0000 7f5a957a8640 1 --2- 172.21.15.87:0/3785898125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0dea8e730 0x55e0dea95ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.200+0000 7f5a95fa9640 1 -- 172.21.15.87:0/3785898125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0dea8e730 msgr2=0x55e0dea95ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:43.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.200+0000 7f5a95fa9640 1 --2- 172.21.15.87:0/3785898125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0dea8e730 0x55e0dea95ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.200+0000 7f5a95fa9640 1 -- 172.21.15.87:0/3785898125 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0dea98fd0 msgr2=0x55e0dea96420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:43.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.200+0000 7f5a95fa9640 1 --2- 172.21.15.87:0/3785898125 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0dea98fd0 0x55e0dea96420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.200+0000 7f5a95fa9640 1 -- 172.21.15.87:0/3785898125 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a90068570 con 0x55e0dea8de10 2024-09-13T17:17:43.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.200+0000 7f5a957a8640 1 --2- 172.21.15.87:0/3785898125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0dea8e730 0x55e0dea95ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:43.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.200+0000 7f5a95fa9640 1 --2- 172.21.15.87:0/3785898125 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0dea8de10 0x55e0dea98a40 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c010840 tx=0x7f5a8c010d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=873459aa5f063f5e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:43.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.200+0000 7f5a797fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:17:43.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.201+0000 7f5a797fa640 1 -- 172.21.15.87:0/3785898125 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c00ed40 con 0x55e0dea8de10 2024-09-13T17:17:43.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.201+0000 7f5a797fa640 1 -- 172.21.15.87:0/3785898125 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f5a8c017070 con 0x55e0dea8de10 2024-09-13T17:17:43.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.201+0000 7f5a9b00a740 1 -- 172.21.15.87:0/3785898125 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e0de6e54e0 con 0x55e0dea8de10 2024-09-13T17:17:43.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.201+0000 7f5a797fa640 1 -- 172.21.15.87:0/3785898125 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a8c00eea0 con 0x55e0dea8de10 2024-09-13T17:17:43.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.201+0000 7f5a9b00a740 10 client.16791 fetch_fsmap learned FSMap version 30 2024-09-13T17:17:43.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.201+0000 7f5a9b00a740 1 -- 172.21.15.87:0/3785898125 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55e0de9f0620 con 0x55e0dea8de10 2024-09-13T17:17:43.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.201+0000 7f5a797fa640 1 -- 172.21.15.87:0/3785898125 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55e0de6e54e0 con 0x55e0dea8de10 2024-09-13T17:17:43.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.201+0000 7f5a797fa640 1 -- 172.21.15.87:0/3785898125 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f5a8c0114f0 con 0x55e0dea8de10 2024-09-13T17:17:43.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.201+0000 7f5a9b00a740 10 client.16791 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:17:43.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.201+0000 7f5a9b00a740 10 client.16791 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:17:43.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.201+0000 7f5a9b00a740 20 client.16791 populate_metadata read hostname 'smithi087' 2024-09-13T17:17:43.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.201+0000 7f5a9b00a740 1 --2- 172.21.15.87:0/3785898125 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55e0deaa8f30 0x55e0deaab350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.201+0000 7f5a9b00a740 4 client.16791 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:17:43.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.201+0000 7f5a9b00a740 1 -- 172.21.15.87:0/3785898125 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e0de6f67e0 con 0x55e0deaa8f30 2024-09-13T17:17:43.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.201+0000 7f5a957a8640 1 --2- 172.21.15.87:0/3785898125 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55e0deaa8f30 0x55e0deaab350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.202+0000 7f5a797fa640 10 client.16791 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:17:43.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.202+0000 7f5a957a8640 1 --2- 172.21.15.87:0/3785898125 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55e0deaa8f30 0x55e0deaab350 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1e30c409ae94fcd server_cookie=c4466dd7c694609c in_seq=0 out_seq=0 2024-09-13T17:17:43.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.202+0000 7f5a797fa640 1 -- 172.21.15.87:0/3785898125 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55e0de6f67e0 con 0x55e0deaa8f30 2024-09-13T17:17:43.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.202+0000 7f5a797fa640 10 client.16791 handle_command_reply: tid=0 2024-09-13T17:17:43.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.202+0000 7f5a9b00a740 1 client.16791 shutdown 2024-09-13T17:17:43.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.203+0000 7f5a9b00a740 1 -- 172.21.15.87:0/3785898125 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0dea8de10 msgr2=0x55e0dea98a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:43.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.203+0000 7f5a9b00a740 1 --2- 172.21.15.87:0/3785898125 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0dea8de10 0x55e0dea98a40 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c010840 tx=0x7f5a8c010d00 comp rx=0 tx=0).stop 2024-09-13T17:17:43.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.203+0000 7f5a9b00a740 1 -- 172.21.15.87:0/3785898125 shutdown_connections 2024-09-13T17:17:43.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.203+0000 7f5a9b00a740 1 --2- 172.21.15.87:0/3785898125 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55e0deaa8f30 0x55e0deaab350 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.203+0000 7f5a9b00a740 1 --2- 172.21.15.87:0/3785898125 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0dea98fd0 0x55e0dea96420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.203+0000 7f5a9b00a740 1 --2- 172.21.15.87:0/3785898125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0dea8e730 0x55e0dea95ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.203+0000 7f5a797fa640 0 client.16791 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:17:43.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.203+0000 7f5a9b00a740 1 --2- 172.21.15.87:0/3785898125 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0dea8de10 0x55e0dea98a40 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.203+0000 7f5a9b00a740 1 -- 172.21.15.87:0/3785898125 >> 172.21.15.87:0/3785898125 conn(0x55e0dea8a380 msgr2=0x55e0dea89510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:43.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.203+0000 7f5a9b00a740 1 -- 172.21.15.87:0/3785898125 shutdown_connections 2024-09-13T17:17:43.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.203+0000 7f5a9b00a740 1 -- 172.21.15.87:0/3785898125 wait complete. 2024-09-13T17:17:43.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.203+0000 7f5a9b00a740 20 client.16791 trim_cache size 0 max 16384 2024-09-13T17:17:43.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.217+0000 7f5a9b00a740 1 Processor -- start 2024-09-13T17:17:43.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.217+0000 7f5a9b00a740 1 -- start start 2024-09-13T17:17:43.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.217+0000 7f5a9b00a740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0dea8de10 0x55e0dea95c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.217+0000 7f5a9b00a740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0dea8e730 0x55e0dea98550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.217+0000 7f5a9b00a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0dea98fd0 0x55e0dea98a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.217+0000 7f5a9b00a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0deaa76e0 con 0x55e0dea98fd0 2024-09-13T17:17:43.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.217+0000 7f5a9b00a740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0dea8efb0 con 0x55e0dea8e730 2024-09-13T17:17:43.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.217+0000 7f5a9b00a740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0dea94210 con 0x55e0dea8de10 2024-09-13T17:17:43.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.217+0000 7f5a967aa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0dea98fd0 0x55e0dea98a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.217+0000 7f5a967aa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0dea98fd0 0x55e0dea98a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45294/0 (socket says 172.21.15.87:45294) 2024-09-13T17:17:43.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.217+0000 7f5a967aa640 1 -- 172.21.15.87:0/968065547 learned_addr learned my addr 172.21.15.87:0/968065547 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:43.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.217+0000 7f5a957a8640 1 --2- 172.21.15.87:0/968065547 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0dea8e730 0x55e0dea98550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.217+0000 7f5a967aa640 1 -- 172.21.15.87:0/968065547 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0dea8de10 msgr2=0x55e0dea95c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:43.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.217+0000 7f5a967aa640 1 --2- 172.21.15.87:0/968065547 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0dea8de10 0x55e0dea95c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.217+0000 7f5a967aa640 1 -- 172.21.15.87:0/968065547 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0dea8e730 msgr2=0x55e0dea98550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:43.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.217+0000 7f5a967aa640 1 --2- 172.21.15.87:0/968065547 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0dea8e730 0x55e0dea98550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.218+0000 7f5a967aa640 1 -- 172.21.15.87:0/968065547 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0de992790 con 0x55e0dea98fd0 2024-09-13T17:17:43.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.218+0000 7f5a957a8640 1 --2- 172.21.15.87:0/968065547 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0dea8e730 0x55e0dea98550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:43.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.218+0000 7f5a967aa640 1 --2- 172.21.15.87:0/968065547 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0dea98fd0 0x55e0dea98a90 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f5a88031650 tx=0x7f5a88009890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4632b9163f6110f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:43.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.218+0000 7f5a84ff9640 1 -- 172.21.15.87:0/968065547 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a88056070 con 0x55e0dea98fd0 2024-09-13T17:17:43.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.218+0000 7f5a84ff9640 1 -- 172.21.15.87:0/968065547 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5a88030d00 con 0x55e0dea98fd0 2024-09-13T17:17:43.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.218+0000 7f5a84ff9640 1 -- 172.21.15.87:0/968065547 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a88004040 con 0x55e0dea98fd0 2024-09-13T17:17:43.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.218+0000 7f5a9b00a740 1 -- 172.21.15.87:0/968065547 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0dea98fd0 msgr2=0x55e0dea98a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:43.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.218+0000 7f5a9b00a740 1 --2- 172.21.15.87:0/968065547 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0dea98fd0 0x55e0dea98a90 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f5a88031650 tx=0x7f5a88009890 comp rx=0 tx=0).stop 2024-09-13T17:17:43.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.218+0000 7f5a9b00a740 1 -- 172.21.15.87:0/968065547 shutdown_connections 2024-09-13T17:17:43.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.218+0000 7f5a9b00a740 1 --2- 172.21.15.87:0/968065547 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0dea98fd0 0x55e0dea98a90 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.218+0000 7f5a9b00a740 1 --2- 172.21.15.87:0/968065547 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0dea8e730 0x55e0dea98550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.218+0000 7f5a9b00a740 1 --2- 172.21.15.87:0/968065547 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0dea8de10 0x55e0dea95c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.218+0000 7f5a9b00a740 1 -- 172.21.15.87:0/968065547 >> 172.21.15.87:0/968065547 conn(0x55e0dea8a380 msgr2=0x55e0dea95580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:43.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.219+0000 7f5a9b00a740 1 -- 172.21.15.87:0/968065547 shutdown_connections 2024-09-13T17:17:43.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.219+0000 7f5a9b00a740 1 -- 172.21.15.87:0/968065547 wait complete. 2024-09-13T17:17:43.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.219+0000 7f5a9b00a740 1 -- start start 2024-09-13T17:17:43.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.219+0000 7f5a9b00a740 1 Processor -- start 2024-09-13T17:17:43.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.219+0000 7f5a9b00a740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0dea8de10 0x55e0deaa0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.219+0000 7f5a9b00a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0dea8e730 0x55e0dea9c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.219+0000 7f5a9b00a740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0dea98fd0 0x55e0dea9cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.219+0000 7f5a9b00a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0dea9d2c0 con 0x55e0dea8e730 2024-09-13T17:17:43.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.219+0000 7f5a9b00a740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0dea9d430 con 0x55e0dea98fd0 2024-09-13T17:17:43.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.219+0000 7f5a9b00a740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0deaff470 con 0x55e0dea8de10 2024-09-13T17:17:43.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.219+0000 7f5a9b00a740 10 client.0 _ll_register_callbacks cb 0x7f5a8c00c430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:17:43.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.219+0000 7f5a957a8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0dea8e730 0x55e0dea9c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.219+0000 7f5a957a8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0dea8e730 0x55e0dea9c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45296/0 (socket says 172.21.15.87:45296) 2024-09-13T17:17:43.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.219+0000 7f5a957a8640 1 -- 172.21.15.87:0/4227045768 learned_addr learned my addr 172.21.15.87:0/4227045768 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:17:43.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.220+0000 7f5a967aa640 1 --2- 172.21.15.87:0/4227045768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0dea98fd0 0x55e0dea9cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.220+0000 7f5a957a8640 1 -- 172.21.15.87:0/4227045768 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0dea8de10 msgr2=0x55e0deaa0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:43.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.220+0000 7f5a957a8640 1 --2- 172.21.15.87:0/4227045768 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0dea8de10 0x55e0deaa0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.220+0000 7f5a957a8640 1 -- 172.21.15.87:0/4227045768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0dea98fd0 msgr2=0x55e0dea9cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:17:43.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.220+0000 7f5a957a8640 1 --2- 172.21.15.87:0/4227045768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0dea98fd0 0x55e0dea9cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.220+0000 7f5a957a8640 1 -- 172.21.15.87:0/4227045768 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e0de9ac840 con 0x55e0dea8e730 2024-09-13T17:17:43.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.220+0000 7f5a967aa640 1 --2- 172.21.15.87:0/4227045768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0dea98fd0 0x55e0dea9cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:17:43.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.220+0000 7f5a957a8640 1 --2- 172.21.15.87:0/4227045768 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0dea8e730 0x55e0dea9c620 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f5a800c9e80 tx=0x7f5a80084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40621be250a1fdf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:17:43.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.220+0000 7f5a797fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:17:43.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.220+0000 7f5a797fa640 1 -- 172.21.15.87:0/4227045768 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a800a1c60 con 0x55e0dea8e730 2024-09-13T17:17:43.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.220+0000 7f5a797fa640 1 -- 172.21.15.87:0/4227045768 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f5a800b20b0 con 0x55e0dea8e730 2024-09-13T17:17:43.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.220+0000 7f5a9b00a740 1 -- 172.21.15.87:0/4227045768 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e0de749e30 con 0x55e0dea8e730 2024-09-13T17:17:43.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.220+0000 7f5a797fa640 1 -- 172.21.15.87:0/4227045768 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a800046c0 con 0x55e0dea8e730 2024-09-13T17:17:43.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.220+0000 7f5a9b00a740 10 client.16797 fetch_fsmap learned FSMap version 30 2024-09-13T17:17:43.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.220+0000 7f5a9b00a740 1 -- 172.21.15.87:0/4227045768 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55e0de9b7ea0 con 0x55e0dea8e730 2024-09-13T17:17:43.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.220+0000 7f5a797fa640 1 -- 172.21.15.87:0/4227045768 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55e0de749e30 con 0x55e0dea8e730 2024-09-13T17:17:43.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.220+0000 7f5a797fa640 1 -- 172.21.15.87:0/4227045768 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f5a80005250 con 0x55e0dea8e730 2024-09-13T17:17:43.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.220+0000 7f5a9b00a740 10 client.16797 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:17:43.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.220+0000 7f5a9b00a740 10 client.16797 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:17:43.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.220+0000 7f5a9b00a740 20 client.16797 populate_metadata read hostname 'smithi087' 2024-09-13T17:17:43.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.220+0000 7f5a9b00a740 1 --2- 172.21.15.87:0/4227045768 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55e0deb00ba0 0x55e0deb02fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:17:43.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.220+0000 7f5a9b00a740 4 client.16797 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:17:43.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.220+0000 7f5a9b00a740 1 -- 172.21.15.87:0/4227045768 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e0deb037c0 con 0x55e0deb00ba0 2024-09-13T17:17:43.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.221+0000 7f5a95fa9640 1 --2- 172.21.15.87:0/4227045768 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55e0deb00ba0 0x55e0deb02fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:17:43.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.221+0000 7f5a797fa640 10 client.16797 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:17:43.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.221+0000 7f5a95fa9640 1 --2- 172.21.15.87:0/4227045768 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55e0deb00ba0 0x55e0deb02fc0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18d05cbf4bb128f6 server_cookie=c5e753f594d840f4 in_seq=0 out_seq=0 2024-09-13T17:17:43.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.221+0000 7f5a797fa640 1 -- 172.21.15.87:0/4227045768 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55e0deb037c0 con 0x55e0deb00ba0 2024-09-13T17:17:43.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.221+0000 7f5a797fa640 10 client.16797 handle_command_reply: tid=0 2024-09-13T17:17:43.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.221+0000 7f5a9b00a740 1 client.16797 shutdown 2024-09-13T17:17:43.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.221+0000 7f5a9b00a740 1 -- 172.21.15.87:0/4227045768 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0dea8e730 msgr2=0x55e0dea9c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:43.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.221+0000 7f5a9b00a740 1 --2- 172.21.15.87:0/4227045768 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0dea8e730 0x55e0dea9c620 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f5a800c9e80 tx=0x7f5a80084040 comp rx=0 tx=0).stop 2024-09-13T17:17:43.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.222+0000 7f5a9b00a740 1 -- 172.21.15.87:0/4227045768 shutdown_connections 2024-09-13T17:17:43.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.222+0000 7f5a9b00a740 1 --2- 172.21.15.87:0/4227045768 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55e0deb00ba0 0x55e0deb02fc0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.222+0000 7f5a9b00a740 1 --2- 172.21.15.87:0/4227045768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0dea98fd0 0x55e0dea9cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.222+0000 7f5a9b00a740 1 --2- 172.21.15.87:0/4227045768 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0dea8e730 0x55e0dea9c620 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.222+0000 7f5a9b00a740 1 --2- 172.21.15.87:0/4227045768 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e0dea8de10 0x55e0deaa0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.222+0000 7f5a797fa640 0 client.16797 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:17:43.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.222+0000 7f5a9b00a740 1 -- 172.21.15.87:0/4227045768 >> 172.21.15.87:0/4227045768 conn(0x55e0dea8a380 msgr2=0x55e0dea90090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:43.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.222+0000 7f5a9b00a740 1 -- 172.21.15.87:0/4227045768 shutdown_connections 2024-09-13T17:17:43.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.222+0000 7f5a9b00a740 1 -- 172.21.15.87:0/4227045768 wait complete. 2024-09-13T17:17:43.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.222+0000 7f5a9b00a740 20 client.16797 trim_cache size 0 max 16384 2024-09-13T17:17:43.230 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:17:43.230 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-13T17:17:43.230 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": { 2024-09-13T17:17:43.231 INFO:teuthology.orchestra.run.smithi087.stdout: "a8b0f995-6c36-4b07-a26d-8f717b04fa75": { 2024-09-13T17:17:43.231 INFO:teuthology.orchestra.run.smithi087.stdout: "path": "/", 2024-09-13T17:17:43.231 INFO:teuthology.orchestra.run.smithi087.stdout: "tag": "a8b0f995-6c36-4b07-a26d-8f717b04fa75", 2024-09-13T17:17:43.231 INFO:teuthology.orchestra.run.smithi087.stdout: "options": "recursive,force" 2024-09-13T17:17:43.231 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:17:43.231 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:17:43.231 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:17:43.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.222+0000 7f5a9820d640 1 -- 172.21.15.87:0/2818139886 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5a7c0a1200 msgr2=0x7f5a7c0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:43.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.222+0000 7f5a9820d640 1 --2- 172.21.15.87:0/2818139886 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5a7c0a1200 0x7f5a7c0a36c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5a88046000 tx=0x7f5a8804b000 comp rx=0 tx=0).stop 2024-09-13T17:17:43.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.222+0000 7f5a9820d640 1 -- 172.21.15.87:0/2818139886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a90103fa0 msgr2=0x7f5a901967a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:17:43.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.222+0000 7f5a9820d640 1 --2- 172.21.15.87:0/2818139886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a90103fa0 0x7f5a901967a0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f5a8000d740 tx=0x7f5a8000dc00 comp rx=0 tx=0).stop 2024-09-13T17:17:43.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.222+0000 7f5a9820d640 1 -- 172.21.15.87:0/2818139886 shutdown_connections 2024-09-13T17:17:43.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.222+0000 7f5a9820d640 1 --2- 172.21.15.87:0/2818139886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a9019ab90 0x7f5a9019b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.222+0000 7f5a9820d640 1 --2- 172.21.15.87:0/2818139886 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5a7c0a1200 0x7f5a7c0a36c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.222+0000 7f5a9820d640 1 --2- 172.21.15.87:0/2818139886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a90103fa0 0x7f5a901967a0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.222+0000 7f5a9820d640 1 --2- 172.21.15.87:0/2818139886 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a900fee50 0x7f5a90196260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:17:43.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.222+0000 7f5a9820d640 1 -- 172.21.15.87:0/2818139886 >> 172.21.15.87:0/2818139886 conn(0x7f5a900fa8c0 msgr2=0x7f5a900fbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:17:43.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.222+0000 7f5a9820d640 1 -- 172.21.15.87:0/2818139886 shutdown_connections 2024-09-13T17:17:43.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:17:43.222+0000 7f5a9820d640 1 -- 172.21.15.87:0/2818139886 wait complete. 2024-09-13T17:17:43.234 INFO:tasks.cephfs.filesystem:scrub status for tag:a8b0f995-6c36-4b07-a26d-8f717b04fa75 - {'path': '/', 'tag': 'a8b0f995-6c36-4b07-a26d-8f717b04fa75', 'options': 'recursive,force'} 2024-09-13T17:17:43.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:43 smithi149 ceph-mon[35496]: pgmap v120: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:17:43.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:43 smithi118 ceph-mon[34374]: pgmap v120: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:17:43.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:43 smithi087 ceph-mon[30934]: pgmap v120: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:17:44.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:44 smithi149 ceph-mon[35496]: scrub queued for path: / 2024-09-13T17:17:44.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:44 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:17:44.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:44 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:17:44.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:44 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:17:44.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:44 smithi118 ceph-mon[34374]: scrub queued for path: / 2024-09-13T17:17:44.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:44 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:17:44.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:44 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:17:44.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:44 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:17:44.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:44 smithi087 ceph-mon[30934]: scrub queued for path: / 2024-09-13T17:17:44.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:44 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:17:44.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:44 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:17:44.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:44 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:17:45.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:45 smithi149 ceph-mon[35496]: scrub summary: idle 2024-09-13T17:17:45.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:45 smithi149 ceph-mon[35496]: pgmap v121: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:17:45.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:45 smithi118 ceph-mon[34374]: scrub summary: idle 2024-09-13T17:17:45.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:45 smithi118 ceph-mon[34374]: pgmap v121: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:17:45.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:45 smithi087 ceph-mon[30934]: scrub summary: idle 2024-09-13T17:17:45.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:45 smithi087 ceph-mon[30934]: pgmap v121: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:17:47.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:47 smithi149 ceph-mon[35496]: pgmap v122: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:17:47.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:47 smithi118 ceph-mon[34374]: pgmap v122: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:17:47.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:47 smithi087 ceph-mon[30934]: pgmap v122: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:17:49.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:49 smithi149 ceph-mon[35496]: pgmap v123: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:17:49.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:49 smithi118 ceph-mon[34374]: pgmap v123: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:17:49.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:49 smithi087 ceph-mon[30934]: pgmap v123: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:17:51.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:51 smithi149 ceph-mon[35496]: pgmap v124: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:17:51.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:51 smithi118 ceph-mon[34374]: pgmap v124: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:17:51.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:51 smithi087 ceph-mon[30934]: pgmap v124: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:17:53.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:53 smithi149 ceph-mon[35496]: pgmap v125: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:17:53.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:53 smithi118 ceph-mon[34374]: pgmap v125: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:17:53.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:53 smithi087 ceph-mon[30934]: pgmap v125: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:17:55.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:55 smithi149 ceph-mon[35496]: pgmap v126: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:17:55.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:55 smithi118 ceph-mon[34374]: pgmap v126: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:17:55.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:55 smithi087 ceph-mon[30934]: pgmap v126: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:17:57.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:57 smithi149 ceph-mon[35496]: pgmap v127: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:17:57.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:57 smithi118 ceph-mon[34374]: pgmap v127: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:17:57.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:57 smithi087 ceph-mon[30934]: pgmap v127: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:17:59.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:17:59 smithi149 ceph-mon[35496]: pgmap v128: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:17:59.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:17:59 smithi118 ceph-mon[34374]: pgmap v128: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:17:59.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:17:59 smithi087 ceph-mon[30934]: pgmap v128: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:18:00.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:00 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:18:00.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:00 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:18:00.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:00 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:18:00.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:00 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:18:00.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:00 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:18:00.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:00 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:18:00.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:00 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:18:00.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:00 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:18:00.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:00 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:18:00.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:00 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:18:00.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:00 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:18:00.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:00 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:18:01.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:01 smithi149 ceph-mon[35496]: pgmap v129: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:18:01.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:01 smithi118 ceph-mon[34374]: pgmap v129: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:18:01.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:01 smithi087 ceph-mon[30934]: pgmap v129: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:18:03.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:03 smithi149 ceph-mon[35496]: pgmap v130: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:18:03.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:03 smithi118 ceph-mon[34374]: pgmap v130: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:18:03.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:03 smithi087 ceph-mon[30934]: pgmap v130: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:18:05.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:05 smithi149 ceph-mon[35496]: pgmap v131: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-13T17:18:05.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:05 smithi118 ceph-mon[34374]: pgmap v131: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-13T17:18:05.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:05 smithi087 ceph-mon[30934]: pgmap v131: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-13T17:18:07.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:07 smithi149 ceph-mon[35496]: pgmap v132: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-13T17:18:07.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:07 smithi118 ceph-mon[34374]: pgmap v132: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-13T17:18:07.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:07 smithi087 ceph-mon[30934]: pgmap v132: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-13T17:18:09.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:09 smithi149 ceph-mon[35496]: pgmap v133: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-13T17:18:09.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:09 smithi118 ceph-mon[34374]: pgmap v133: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-13T17:18:09.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:09 smithi087 ceph-mon[30934]: pgmap v133: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-13T17:18:11.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:11 smithi149 ceph-mon[35496]: pgmap v134: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-13T17:18:11.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:11 smithi118 ceph-mon[34374]: pgmap v134: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-13T17:18:11.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:11 smithi087 ceph-mon[30934]: pgmap v134: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-13T17:18:13.235 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:18:13.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.346+0000 7faa044aa640 1 -- 172.21.15.87:0/887081112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9fc0ff830 msgr2=0x7fa9fc103870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:13.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.346+0000 7faa044aa640 1 --2- 172.21.15.87:0/887081112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9fc0ff830 0x7fa9fc103870 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec009930 tx=0x7fa9ec02a420 comp rx=0 tx=0).stop 2024-09-13T17:18:13.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.346+0000 7faa044aa640 1 -- 172.21.15.87:0/887081112 shutdown_connections 2024-09-13T17:18:13.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.346+0000 7faa044aa640 1 --2- 172.21.15.87:0/887081112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9fc103fd0 0x7fa9fc10bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.346+0000 7faa044aa640 1 --2- 172.21.15.87:0/887081112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9fc0ff830 0x7fa9fc103870 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.346+0000 7faa044aa640 1 --2- 172.21.15.87:0/887081112 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9fc0fee80 0x7fa9fc0ff260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.346+0000 7faa044aa640 1 -- 172.21.15.87:0/887081112 >> 172.21.15.87:0/887081112 conn(0x7fa9fc0fa930 msgr2=0x7fa9fc0fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:13.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.346+0000 7faa044aa640 1 -- 172.21.15.87:0/887081112 shutdown_connections 2024-09-13T17:18:13.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.346+0000 7faa044aa640 1 -- 172.21.15.87:0/887081112 wait complete. 2024-09-13T17:18:13.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.346+0000 7faa044aa640 1 Processor -- start 2024-09-13T17:18:13.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.346+0000 7faa044aa640 1 -- start start 2024-09-13T17:18:13.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.347+0000 7faa044aa640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9fc0fee80 0x7fa9fc196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.347+0000 7faa044aa640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9fc103fd0 0x7fa9fc196790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.347+0000 7faa044aa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9fc19ab80 0x7fa9fc19b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.347+0000 7faa044aa640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc19b570 con 0x7fa9fc19ab80 2024-09-13T17:18:13.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.347+0000 7faa044aa640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc19b6e0 con 0x7fa9fc0fee80 2024-09-13T17:18:13.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.347+0000 7faa044aa640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc19b850 con 0x7fa9fc103fd0 2024-09-13T17:18:13.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.347+0000 7faa02a47640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9fc19ab80 0x7fa9fc19b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.347+0000 7faa02a47640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9fc19ab80 0x7fa9fc19b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45374/0 (socket says 172.21.15.87:45374) 2024-09-13T17:18:13.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.347+0000 7faa02a47640 1 -- 172.21.15.87:0/4106539408 learned_addr learned my addr 172.21.15.87:0/4106539408 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:13.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.347+0000 7faa02246640 1 --2- 172.21.15.87:0/4106539408 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9fc0fee80 0x7fa9fc196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.347+0000 7faa01a45640 1 --2- 172.21.15.87:0/4106539408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9fc103fd0 0x7fa9fc196790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.347+0000 7faa02a47640 1 -- 172.21.15.87:0/4106539408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9fc103fd0 msgr2=0x7fa9fc196790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:13.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.347+0000 7faa02a47640 1 --2- 172.21.15.87:0/4106539408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9fc103fd0 0x7fa9fc196790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.347+0000 7faa02a47640 1 -- 172.21.15.87:0/4106539408 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9fc0fee80 msgr2=0x7fa9fc196250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:13.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.347+0000 7faa02a47640 1 --2- 172.21.15.87:0/4106539408 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9fc0fee80 0x7fa9fc196250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.347+0000 7faa02a47640 1 -- 172.21.15.87:0/4106539408 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9ec009560 con 0x7fa9fc19ab80 2024-09-13T17:18:13.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.347+0000 7faa02a47640 1 --2- 172.21.15.87:0/4106539408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9fc19ab80 0x7fa9fc19b030 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fa9f400d750 tx=0x7fa9f400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:13.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.347+0000 7fa9f37fe640 1 -- 172.21.15.87:0/4106539408 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4009bd0 con 0x7fa9fc19ab80 2024-09-13T17:18:13.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.347+0000 7fa9f37fe640 1 -- 172.21.15.87:0/4106539408 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa9f400de60 con 0x7fa9fc19ab80 2024-09-13T17:18:13.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.347+0000 7faa044aa640 1 -- 172.21.15.87:0/4106539408 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9fc1a2e30 con 0x7fa9fc19ab80 2024-09-13T17:18:13.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.347+0000 7fa9f37fe640 1 -- 172.21.15.87:0/4106539408 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4004dd0 con 0x7fa9fc19ab80 2024-09-13T17:18:13.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.347+0000 7faa044aa640 1 -- 172.21.15.87:0/4106539408 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9fc1a32e0 con 0x7fa9fc19ab80 2024-09-13T17:18:13.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.349+0000 7fa9f37fe640 1 -- 172.21.15.87:0/4106539408 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fa9f4009d30 con 0x7fa9fc19ab80 2024-09-13T17:18:13.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.350+0000 7faa071ce740 1 Processor -- start 2024-09-13T17:18:13.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.350+0000 7faa071ce740 1 -- start start 2024-09-13T17:18:13.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.350+0000 7fa9f37fe640 1 --2- 172.21.15.87:0/4106539408 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa9e80a1280 0x7fa9e80a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.350+0000 7faa071ce740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb68f0e10 0x555bb68f11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.350+0000 7faa071ce740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bb68f1730 0x555bb68fba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.350+0000 7faa071ce740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bb68fbfd0 0x555bb68fe3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.350+0000 7faa071ce740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bb685bf20 con 0x555bb68fbfd0 2024-09-13T17:18:13.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.350+0000 7faa071ce740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bb68596b0 con 0x555bb68f0e10 2024-09-13T17:18:13.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.350+0000 7faa071ce740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bb6854fa0 con 0x555bb68f1730 2024-09-13T17:18:13.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.350+0000 7faa01a45640 1 --2- 172.21.15.87:0/4106539408 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa9e80a1280 0x7fa9e80a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.351+0000 7fa9f37fe640 1 -- 172.21.15.87:0/4106539408 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fa9f40cca10 con 0x7fa9fc19ab80 2024-09-13T17:18:13.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.351+0000 7faa02a47640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bb68fbfd0 0x555bb68fe3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.351+0000 7faa02a47640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bb68fbfd0 0x555bb68fe3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45390/0 (socket says 172.21.15.87:45390) 2024-09-13T17:18:13.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.351+0000 7faa02a47640 1 -- 172.21.15.87:0/3819672888 learned_addr learned my addr 172.21.15.87:0/3819672888 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:13.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.351+0000 7faa01a45640 1 --2- 172.21.15.87:0/3819672888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bb68f1730 0x555bb68fba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.351+0000 7faa02246640 1 --2- 172.21.15.87:0/3819672888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb68f0e10 0x555bb68f11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.351+0000 7faa02a47640 1 -- 172.21.15.87:0/3819672888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bb68f1730 msgr2=0x555bb68fba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:13.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.351+0000 7faa02a47640 1 --2- 172.21.15.87:0/3819672888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bb68f1730 0x555bb68fba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.351+0000 7faa02a47640 1 -- 172.21.15.87:0/3819672888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb68f0e10 msgr2=0x555bb68f11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:13.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.351+0000 7faa02a47640 1 --2- 172.21.15.87:0/3819672888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb68f0e10 0x555bb68f11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.351+0000 7faa02a47640 1 -- 172.21.15.87:0/3819672888 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555bb680f840 con 0x555bb68fbfd0 2024-09-13T17:18:13.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.351+0000 7faa01a45640 1 --2- 172.21.15.87:0/4106539408 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa9e80a1280 0x7fa9e80a3740 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec006010 tx=0x7fa9ec005e80 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:13.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.351+0000 7faa02a47640 1 --2- 172.21.15.87:0/3819672888 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bb68fbfd0 0x555bb68fe3c0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4095c10 tx=0x7fa9f40056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbfaa473989eba23 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:13.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.351+0000 7fa9f0ff9640 1 -- 172.21.15.87:0/3819672888 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f409d540 con 0x555bb68fbfd0 2024-09-13T17:18:13.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.351+0000 7fa9f0ff9640 1 -- 172.21.15.87:0/3819672888 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa9f40a1b90 con 0x555bb68fbfd0 2024-09-13T17:18:13.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.351+0000 7fa9f0ff9640 1 -- 172.21.15.87:0/3819672888 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f40c9fd0 con 0x555bb68fbfd0 2024-09-13T17:18:13.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.352+0000 7faa071ce740 1 -- 172.21.15.87:0/3819672888 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bb68fbfd0 msgr2=0x555bb68fe3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:13.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.352+0000 7faa071ce740 1 --2- 172.21.15.87:0/3819672888 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bb68fbfd0 0x555bb68fe3c0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4095c10 tx=0x7fa9f40056a0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.352+0000 7faa071ce740 1 -- 172.21.15.87:0/3819672888 shutdown_connections 2024-09-13T17:18:13.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.352+0000 7faa071ce740 1 --2- 172.21.15.87:0/3819672888 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bb68fbfd0 0x555bb68fe3c0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.352+0000 7faa071ce740 1 --2- 172.21.15.87:0/3819672888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bb68f1730 0x555bb68fba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.352+0000 7faa071ce740 1 --2- 172.21.15.87:0/3819672888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb68f0e10 0x555bb68f11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.352+0000 7faa071ce740 1 -- 172.21.15.87:0/3819672888 >> 172.21.15.87:0/3819672888 conn(0x555bb68ed380 msgr2=0x555bb68ed760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:13.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.352+0000 7faa071ce740 1 -- 172.21.15.87:0/3819672888 shutdown_connections 2024-09-13T17:18:13.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.352+0000 7faa071ce740 1 -- 172.21.15.87:0/3819672888 wait complete. 2024-09-13T17:18:13.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.352+0000 7faa071ce740 1 -- start start 2024-09-13T17:18:13.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.352+0000 7faa071ce740 1 Processor -- start 2024-09-13T17:18:13.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.353+0000 7faa071ce740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bb68f0e10 0x555bb68fb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.353+0000 7faa071ce740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bb68f1730 0x555bb68f8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.353+0000 7faa071ce740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb68fbfd0 0x555bb68f9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.353+0000 7faa071ce740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bb67f62a0 con 0x555bb68f1730 2024-09-13T17:18:13.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.353+0000 7faa071ce740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bb652d430 con 0x555bb68fbfd0 2024-09-13T17:18:13.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.353+0000 7faa071ce740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bb67d8680 con 0x555bb68f0e10 2024-09-13T17:18:13.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.353+0000 7faa071ce740 10 client.0 _ll_register_callbacks cb 0x555bb684e610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:18:13.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.353+0000 7faa01a45640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bb68f1730 0x555bb68f8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.353+0000 7faa01a45640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bb68f1730 0x555bb68f8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45394/0 (socket says 172.21.15.87:45394) 2024-09-13T17:18:13.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.353+0000 7faa01a45640 1 -- 172.21.15.87:0/2468766963 learned_addr learned my addr 172.21.15.87:0/2468766963 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:13.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.353+0000 7faa02a47640 1 --2- 172.21.15.87:0/2468766963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb68fbfd0 0x555bb68f9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.353+0000 7faa02246640 1 --2- 172.21.15.87:0/2468766963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bb68f0e10 0x555bb68fb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.353+0000 7faa01a45640 1 -- 172.21.15.87:0/2468766963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bb68f0e10 msgr2=0x555bb68fb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:13.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.353+0000 7faa01a45640 1 --2- 172.21.15.87:0/2468766963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bb68f0e10 0x555bb68fb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.353+0000 7faa01a45640 1 -- 172.21.15.87:0/2468766963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb68fbfd0 msgr2=0x555bb68f9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:13.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.353+0000 7faa01a45640 1 --2- 172.21.15.87:0/2468766963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb68fbfd0 0x555bb68f9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.353+0000 7faa01a45640 1 -- 172.21.15.87:0/2468766963 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9fc1a32e0 con 0x555bb68f1730 2024-09-13T17:18:13.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.353+0000 7faa02a47640 1 --2- 172.21.15.87:0/2468766963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb68fbfd0 0x555bb68f9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:13.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.353+0000 7faa02246640 1 --2- 172.21.15.87:0/2468766963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bb68f0e10 0x555bb68fb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:13.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.353+0000 7faa01a45640 1 --2- 172.21.15.87:0/2468766963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bb68f1730 0x555bb68f8b10 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec032fd0 tx=0x7fa9ec02a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18dacbb9a57f6cea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:13.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.353+0000 7fa9e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:18:13.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.353+0000 7fa9e5ffb640 1 -- 172.21.15.87:0/2468766963 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec0048d0 con 0x555bb68f1730 2024-09-13T17:18:13.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.353+0000 7fa9e5ffb640 1 -- 172.21.15.87:0/2468766963 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fa9ec004a30 con 0x555bb68f1730 2024-09-13T17:18:13.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.353+0000 7faa071ce740 1 -- 172.21.15.87:0/2468766963 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555bb65484e0 con 0x555bb68f1730 2024-09-13T17:18:13.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.354+0000 7fa9e5ffb640 1 -- 172.21.15.87:0/2468766963 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9ec004bf0 con 0x555bb68f1730 2024-09-13T17:18:13.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.354+0000 7faa071ce740 10 client.16809 fetch_fsmap learned FSMap version 30 2024-09-13T17:18:13.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.354+0000 7faa071ce740 1 -- 172.21.15.87:0/2468766963 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x555bb6853620 con 0x555bb68f1730 2024-09-13T17:18:13.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.354+0000 7fa9e5ffb640 1 -- 172.21.15.87:0/2468766963 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x555bb65484e0 con 0x555bb68f1730 2024-09-13T17:18:13.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.354+0000 7fa9e5ffb640 1 -- 172.21.15.87:0/2468766963 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fa9ec04a440 con 0x555bb68f1730 2024-09-13T17:18:13.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.354+0000 7faa071ce740 10 client.16809 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:18:13.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.354+0000 7faa071ce740 10 client.16809 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:18:13.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.354+0000 7faa071ce740 20 client.16809 populate_metadata read hostname 'smithi087' 2024-09-13T17:18:13.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.354+0000 7faa071ce740 1 --2- 172.21.15.87:0/2468766963 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x555bb690bd10 0x555bb690e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.354+0000 7faa071ce740 4 client.16809 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:18:13.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.354+0000 7faa071ce740 1 -- 172.21.15.87:0/2468766963 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555bb65597e0 con 0x555bb690bd10 2024-09-13T17:18:13.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.354+0000 7faa02246640 1 --2- 172.21.15.87:0/2468766963 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x555bb690bd10 0x555bb690e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.355+0000 7faa02246640 1 --2- 172.21.15.87:0/2468766963 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x555bb690bd10 0x555bb690e130 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3af8fbca750bdac server_cookie=fb1d78442b13a505 in_seq=0 out_seq=0 2024-09-13T17:18:13.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.355+0000 7fa9e5ffb640 10 client.16809 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:18:13.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.356+0000 7fa9e5ffb640 1 -- 172.21.15.87:0/2468766963 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x555bb65597e0 con 0x555bb690bd10 2024-09-13T17:18:13.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.356+0000 7fa9e5ffb640 10 client.16809 handle_command_reply: tid=0 2024-09-13T17:18:13.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.356+0000 7faa071ce740 1 client.16809 shutdown 2024-09-13T17:18:13.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.356+0000 7faa071ce740 1 -- 172.21.15.87:0/2468766963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bb68f1730 msgr2=0x555bb68f8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:13.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.356+0000 7faa071ce740 1 --2- 172.21.15.87:0/2468766963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bb68f1730 0x555bb68f8b10 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec032fd0 tx=0x7fa9ec02a420 comp rx=0 tx=0).stop 2024-09-13T17:18:13.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.356+0000 7faa071ce740 1 -- 172.21.15.87:0/2468766963 shutdown_connections 2024-09-13T17:18:13.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.356+0000 7faa071ce740 1 --2- 172.21.15.87:0/2468766963 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x555bb690bd10 0x555bb690e130 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.356+0000 7faa071ce740 1 --2- 172.21.15.87:0/2468766963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb68fbfd0 0x555bb68f9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.356+0000 7faa071ce740 1 --2- 172.21.15.87:0/2468766963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bb68f1730 0x555bb68f8b10 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.356+0000 7fa9e5ffb640 0 client.16809 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:18:13.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.356+0000 7faa071ce740 1 --2- 172.21.15.87:0/2468766963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bb68f0e10 0x555bb68fb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.356+0000 7faa071ce740 1 -- 172.21.15.87:0/2468766963 >> 172.21.15.87:0/2468766963 conn(0x555bb68ed380 msgr2=0x555bb68ec510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:13.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.356+0000 7faa071ce740 1 -- 172.21.15.87:0/2468766963 shutdown_connections 2024-09-13T17:18:13.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.356+0000 7faa071ce740 1 -- 172.21.15.87:0/2468766963 wait complete. 2024-09-13T17:18:13.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.356+0000 7faa071ce740 20 client.16809 trim_cache size 0 max 16384 2024-09-13T17:18:13.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.370+0000 7faa071ce740 1 Processor -- start 2024-09-13T17:18:13.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.370+0000 7faa071ce740 1 -- start start 2024-09-13T17:18:13.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.370+0000 7faa071ce740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb68f0e10 0x555bb68ecd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.370+0000 7faa071ce740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bb68f1730 0x555bb68f3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.370+0000 7faa071ce740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bb68fbfd0 0x555bb68f4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.370+0000 7faa071ce740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bb68f1dd0 con 0x555bb68f1730 2024-09-13T17:18:13.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.370+0000 7faa071ce740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bb68e8760 con 0x555bb68f0e10 2024-09-13T17:18:13.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.370+0000 7faa071ce740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bb690a510 con 0x555bb68fbfd0 2024-09-13T17:18:13.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.370+0000 7faa01a45640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bb68f1730 0x555bb68f3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.370+0000 7faa01a45640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bb68f1730 0x555bb68f3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45406/0 (socket says 172.21.15.87:45406) 2024-09-13T17:18:13.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.370+0000 7faa01a45640 1 -- 172.21.15.87:0/2079702066 learned_addr learned my addr 172.21.15.87:0/2079702066 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:13.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.371+0000 7faa01a45640 1 -- 172.21.15.87:0/2079702066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bb68fbfd0 msgr2=0x555bb68f4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:13.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.371+0000 7faa01a45640 1 --2- 172.21.15.87:0/2079702066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bb68fbfd0 0x555bb68f4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.371+0000 7faa01a45640 1 -- 172.21.15.87:0/2079702066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb68f0e10 msgr2=0x555bb68ecd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:13.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.371+0000 7faa01a45640 1 --2- 172.21.15.87:0/2079702066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb68f0e10 0x555bb68ecd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.371+0000 7faa01a45640 1 -- 172.21.15.87:0/2079702066 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555bb67f5790 con 0x555bb68f1730 2024-09-13T17:18:13.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.371+0000 7faa01a45640 1 --2- 172.21.15.87:0/2079702066 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bb68f1730 0x555bb68f3df0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec0057c0 tx=0x7fa9ec04a9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3c2bfca7e9ac66 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:13.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.371+0000 7fa9f17fa640 1 -- 172.21.15.87:0/2079702066 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec004350 con 0x555bb68f1730 2024-09-13T17:18:13.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.371+0000 7fa9f17fa640 1 -- 172.21.15.87:0/2079702066 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa9ec031400 con 0x555bb68f1730 2024-09-13T17:18:13.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.371+0000 7fa9f17fa640 1 -- 172.21.15.87:0/2079702066 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec0035f0 con 0x555bb68f1730 2024-09-13T17:18:13.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.372+0000 7faa071ce740 1 -- 172.21.15.87:0/2079702066 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bb68f1730 msgr2=0x555bb68f3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:13.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.372+0000 7faa071ce740 1 --2- 172.21.15.87:0/2079702066 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bb68f1730 0x555bb68f3df0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec0057c0 tx=0x7fa9ec04a9f0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.372+0000 7faa071ce740 1 -- 172.21.15.87:0/2079702066 shutdown_connections 2024-09-13T17:18:13.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.372+0000 7faa071ce740 1 --2- 172.21.15.87:0/2079702066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bb68fbfd0 0x555bb68f4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.372+0000 7faa071ce740 1 --2- 172.21.15.87:0/2079702066 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bb68f1730 0x555bb68f3df0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.372+0000 7faa071ce740 1 --2- 172.21.15.87:0/2079702066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb68f0e10 0x555bb68ecd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.372+0000 7faa071ce740 1 -- 172.21.15.87:0/2079702066 >> 172.21.15.87:0/2079702066 conn(0x555bb68ed380 msgr2=0x555bb6912a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:13.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.372+0000 7faa071ce740 1 -- 172.21.15.87:0/2079702066 shutdown_connections 2024-09-13T17:18:13.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.372+0000 7faa071ce740 1 -- 172.21.15.87:0/2079702066 wait complete. 2024-09-13T17:18:13.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.372+0000 7faa071ce740 1 -- start start 2024-09-13T17:18:13.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.372+0000 7faa071ce740 1 Processor -- start 2024-09-13T17:18:13.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.372+0000 7faa071ce740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb68f0e10 0x555bb6900e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.372+0000 7faa071ce740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bb68f1730 0x555bb69013b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.372+0000 7faa071ce740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bb68fbfd0 0x555bb69611d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.372+0000 7faa071ce740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bb6901a80 con 0x555bb68f1730 2024-09-13T17:18:13.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.372+0000 7faa071ce740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bb6961710 con 0x555bb68f0e10 2024-09-13T17:18:13.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.372+0000 7faa071ce740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bb6961850 con 0x555bb68fbfd0 2024-09-13T17:18:13.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.372+0000 7faa071ce740 10 client.0 _ll_register_callbacks cb 0x7fa9ec009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:18:13.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.372+0000 7faa01a45640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bb68f1730 0x555bb69013b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.372+0000 7faa01a45640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bb68f1730 0x555bb69013b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45414/0 (socket says 172.21.15.87:45414) 2024-09-13T17:18:13.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.372+0000 7faa01a45640 1 -- 172.21.15.87:0/2444685966 learned_addr learned my addr 172.21.15.87:0/2444685966 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:13.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.372+0000 7faa02246640 1 --2- 172.21.15.87:0/2444685966 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb68f0e10 0x555bb6900e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.373+0000 7faa02a47640 1 --2- 172.21.15.87:0/2444685966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bb68fbfd0 0x555bb69611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.373+0000 7faa01a45640 1 -- 172.21.15.87:0/2444685966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bb68fbfd0 msgr2=0x555bb69611d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:13.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.373+0000 7faa01a45640 1 --2- 172.21.15.87:0/2444685966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bb68fbfd0 0x555bb69611d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.373+0000 7faa01a45640 1 -- 172.21.15.87:0/2444685966 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb68f0e10 msgr2=0x555bb6900e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:13.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.373+0000 7faa01a45640 1 --2- 172.21.15.87:0/2444685966 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb68f0e10 0x555bb6900e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.373+0000 7faa01a45640 1 -- 172.21.15.87:0/2444685966 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555bb6853620 con 0x555bb68f1730 2024-09-13T17:18:13.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.373+0000 7faa02246640 1 --2- 172.21.15.87:0/2444685966 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb68f0e10 0x555bb6900e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:13.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.373+0000 7faa01a45640 1 --2- 172.21.15.87:0/2444685966 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bb68f1730 0x555bb69013b0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec05c040 tx=0x7fa9ec0043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a44b9e32336607 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:13.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.373+0000 7fa9e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:18:13.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.373+0000 7fa9e5ffb640 1 -- 172.21.15.87:0/2444685966 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec004ad0 con 0x555bb68f1730 2024-09-13T17:18:13.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.373+0000 7fa9e5ffb640 1 -- 172.21.15.87:0/2444685966 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fa9ec004c30 con 0x555bb68f1730 2024-09-13T17:18:13.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.373+0000 7faa071ce740 1 -- 172.21.15.87:0/2444685966 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa9f40a1b90 con 0x555bb68f1730 2024-09-13T17:18:13.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.373+0000 7fa9e5ffb640 1 -- 172.21.15.87:0/2444685966 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9ec004df0 con 0x555bb68f1730 2024-09-13T17:18:13.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.373+0000 7faa071ce740 10 client.16815 fetch_fsmap learned FSMap version 30 2024-09-13T17:18:13.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.373+0000 7faa071ce740 1 -- 172.21.15.87:0/2444685966 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x555bb681aea0 con 0x555bb68f1730 2024-09-13T17:18:13.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.373+0000 7fa9e5ffb640 1 -- 172.21.15.87:0/2444685966 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa9f40a1b90 con 0x555bb68f1730 2024-09-13T17:18:13.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.373+0000 7fa9e5ffb640 1 -- 172.21.15.87:0/2444685966 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fa9ec052040 con 0x555bb68f1730 2024-09-13T17:18:13.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.373+0000 7faa071ce740 10 client.16815 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:18:13.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.373+0000 7faa071ce740 10 client.16815 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:18:13.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.373+0000 7faa071ce740 20 client.16815 populate_metadata read hostname 'smithi087' 2024-09-13T17:18:13.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.373+0000 7faa071ce740 1 --2- 172.21.15.87:0/2444685966 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x555bb690bd10 0x555bb6964b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.373+0000 7faa071ce740 4 client.16815 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:18:13.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.374+0000 7faa071ce740 1 -- 172.21.15.87:0/2444685966 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555bb65ace30 con 0x555bb690bd10 2024-09-13T17:18:13.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.374+0000 7faa02246640 1 --2- 172.21.15.87:0/2444685966 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x555bb690bd10 0x555bb6964b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.374+0000 7fa9e5ffb640 10 client.16815 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:18:13.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.374+0000 7faa02246640 1 --2- 172.21.15.87:0/2444685966 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x555bb690bd10 0x555bb6964b20 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=241f97b91bc62ed4 server_cookie=a3712029222afbb1 in_seq=0 out_seq=0 2024-09-13T17:18:13.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.374+0000 7fa9e5ffb640 1 -- 172.21.15.87:0/2444685966 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x555bb65ace30 con 0x555bb690bd10 2024-09-13T17:18:13.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.374+0000 7fa9e5ffb640 10 client.16815 handle_command_reply: tid=0 2024-09-13T17:18:13.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.374+0000 7faa071ce740 1 client.16815 shutdown 2024-09-13T17:18:13.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.375+0000 7faa071ce740 1 -- 172.21.15.87:0/2444685966 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bb68f1730 msgr2=0x555bb69013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:13.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.375+0000 7faa071ce740 1 --2- 172.21.15.87:0/2444685966 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bb68f1730 0x555bb69013b0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec05c040 tx=0x7fa9ec0043d0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.375+0000 7faa071ce740 1 -- 172.21.15.87:0/2444685966 shutdown_connections 2024-09-13T17:18:13.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.375+0000 7faa071ce740 1 --2- 172.21.15.87:0/2444685966 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x555bb690bd10 0x555bb6964b20 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.375+0000 7faa071ce740 1 --2- 172.21.15.87:0/2444685966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bb68fbfd0 0x555bb69611d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.375+0000 7fa9e5ffb640 0 client.16815 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:18:13.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.375+0000 7faa071ce740 1 --2- 172.21.15.87:0/2444685966 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bb68f1730 0x555bb69013b0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.375+0000 7faa071ce740 1 --2- 172.21.15.87:0/2444685966 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb68f0e10 0x555bb6900e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.375+0000 7faa071ce740 1 -- 172.21.15.87:0/2444685966 >> 172.21.15.87:0/2444685966 conn(0x555bb68ed380 msgr2=0x555bb68ed760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:13.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.375+0000 7faa071ce740 1 -- 172.21.15.87:0/2444685966 shutdown_connections 2024-09-13T17:18:13.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.375+0000 7faa071ce740 1 -- 172.21.15.87:0/2444685966 wait complete. 2024-09-13T17:18:13.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.375+0000 7faa071ce740 20 client.16815 trim_cache size 0 max 16384 2024-09-13T17:18:13.385 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:18:13.385 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "no active scrubs running", 2024-09-13T17:18:13.385 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": {} 2024-09-13T17:18:13.385 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:18:13.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.375+0000 7faa044aa640 1 -- 172.21.15.87:0/4106539408 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa9e80a1280 msgr2=0x7fa9e80a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:13.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.375+0000 7faa044aa640 1 --2- 172.21.15.87:0/4106539408 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa9e80a1280 0x7fa9e80a3740 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec006010 tx=0x7fa9ec005e80 comp rx=0 tx=0).stop 2024-09-13T17:18:13.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.375+0000 7faa044aa640 1 -- 172.21.15.87:0/4106539408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9fc19ab80 msgr2=0x7fa9fc19b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:13.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.375+0000 7faa044aa640 1 --2- 172.21.15.87:0/4106539408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9fc19ab80 0x7fa9fc19b030 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fa9f400d750 tx=0x7fa9f400dc10 comp rx=0 tx=0).stop 2024-09-13T17:18:13.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.375+0000 7faa044aa640 1 -- 172.21.15.87:0/4106539408 shutdown_connections 2024-09-13T17:18:13.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.375+0000 7faa044aa640 1 --2- 172.21.15.87:0/4106539408 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa9e80a1280 0x7fa9e80a3740 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.375+0000 7faa044aa640 1 --2- 172.21.15.87:0/4106539408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9fc19ab80 0x7fa9fc19b030 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.375+0000 7faa044aa640 1 --2- 172.21.15.87:0/4106539408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9fc103fd0 0x7fa9fc196790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.375+0000 7faa044aa640 1 --2- 172.21.15.87:0/4106539408 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9fc0fee80 0x7fa9fc196250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.375+0000 7faa044aa640 1 -- 172.21.15.87:0/4106539408 >> 172.21.15.87:0/4106539408 conn(0x7fa9fc0fa930 msgr2=0x7fa9fc0fbcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:13.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.375+0000 7faa044aa640 1 -- 172.21.15.87:0/4106539408 shutdown_connections 2024-09-13T17:18:13.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.375+0000 7faa044aa640 1 -- 172.21.15.87:0/4106539408 wait complete. 2024-09-13T17:18:13.388 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T17:18:13.388 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:18:13.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.486+0000 7f5342b9d640 1 -- 172.21.15.87:0/2474753001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f533c104f10 msgr2=0x7f533c10ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:13.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.486+0000 7f5342b9d640 1 --2- 172.21.15.87:0/2474753001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f533c104f10 0x7f533c10ca60 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f5334009cd0 tx=0x7f533402a8e0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.486+0000 7f5342b9d640 1 -- 172.21.15.87:0/2474753001 shutdown_connections 2024-09-13T17:18:13.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.486+0000 7f5342b9d640 1 --2- 172.21.15.87:0/2474753001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f533c104f10 0x7f533c10ca60 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.486+0000 7f5342b9d640 1 --2- 172.21.15.87:0/2474753001 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f533c100770 0x7f533c1047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.486+0000 7f5342b9d640 1 --2- 172.21.15.87:0/2474753001 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f533c0ffdc0 0x7f533c1001a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.486+0000 7f5342b9d640 1 -- 172.21.15.87:0/2474753001 >> 172.21.15.87:0/2474753001 conn(0x7f533c0fb830 msgr2=0x7f533c0fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:13.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.486+0000 7f5342b9d640 1 -- 172.21.15.87:0/2474753001 shutdown_connections 2024-09-13T17:18:13.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.486+0000 7f5342b9d640 1 -- 172.21.15.87:0/2474753001 wait complete. 2024-09-13T17:18:13.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.487+0000 7f5342b9d640 1 Processor -- start 2024-09-13T17:18:13.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.487+0000 7f5342b9d640 1 -- start start 2024-09-13T17:18:13.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.487+0000 7f5342b9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f533c0ffdc0 0x7f533c0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.487+0000 7f5342b9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f533c104f10 0x7f533c072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.487+0000 7f5342b9d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f533c073230 0x7f533c1a41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.487+0000 7f5342b9d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533c1a4790 con 0x7f533c104f10 2024-09-13T17:18:13.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.487+0000 7f5342b9d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533c1a4900 con 0x7f533c0ffdc0 2024-09-13T17:18:13.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.487+0000 7f5342b9d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533c1a4ac0 con 0x7f533c073230 2024-09-13T17:18:13.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.487+0000 7f534139a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f533c104f10 0x7f533c072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.487+0000 7f534139a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f533c104f10 0x7f533c072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45422/0 (socket says 172.21.15.87:45422) 2024-09-13T17:18:13.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.487+0000 7f534139a640 1 -- 172.21.15.87:0/1913138622 learned_addr learned my addr 172.21.15.87:0/1913138622 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:13.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.487+0000 7f534239c640 1 --2- 172.21.15.87:0/1913138622 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f533c073230 0x7f533c1a41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.487+0000 7f5341b9b640 1 --2- 172.21.15.87:0/1913138622 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f533c0ffdc0 0x7f533c0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.487+0000 7f534139a640 1 -- 172.21.15.87:0/1913138622 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f533c073230 msgr2=0x7f533c1a41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:13.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.487+0000 7f534139a640 1 --2- 172.21.15.87:0/1913138622 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f533c073230 0x7f533c1a41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.487+0000 7f534139a640 1 -- 172.21.15.87:0/1913138622 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f533c0ffdc0 msgr2=0x7f533c0727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:13.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.487+0000 7f534139a640 1 --2- 172.21.15.87:0/1913138622 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f533c0ffdc0 0x7f533c0727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.487+0000 7f534139a640 1 -- 172.21.15.87:0/1913138622 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5334009900 con 0x7f533c104f10 2024-09-13T17:18:13.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.487+0000 7f534139a640 1 --2- 172.21.15.87:0/1913138622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f533c104f10 0x7f533c072cf0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f533000d740 tx=0x7f533000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:13.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.488+0000 7f532effd640 1 -- 172.21.15.87:0/1913138622 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5330009c30 con 0x7f533c104f10 2024-09-13T17:18:13.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.488+0000 7f532effd640 1 -- 172.21.15.87:0/1913138622 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f533000de50 con 0x7f533c104f10 2024-09-13T17:18:13.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.488+0000 7f5342b9d640 1 -- 172.21.15.87:0/1913138622 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f533c1a4da0 con 0x7f533c104f10 2024-09-13T17:18:13.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.488+0000 7f532effd640 1 -- 172.21.15.87:0/1913138622 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5330004e40 con 0x7f533c104f10 2024-09-13T17:18:13.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.488+0000 7f5342b9d640 1 -- 172.21.15.87:0/1913138622 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f533c1a5250 con 0x7f533c104f10 2024-09-13T17:18:13.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.489+0000 7f5342b9d640 1 -- 172.21.15.87:0/1913138622 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f533c101290 con 0x7f533c104f10 2024-09-13T17:18:13.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.490+0000 7f532effd640 1 -- 172.21.15.87:0/1913138622 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f5330004fa0 con 0x7f533c104f10 2024-09-13T17:18:13.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.490+0000 7f532effd640 1 --2- 172.21.15.87:0/1913138622 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f53280a12b0 0x7f53280a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.490+0000 7f532effd640 1 -- 172.21.15.87:0/1913138622 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f53300cc9e0 con 0x7f533c104f10 2024-09-13T17:18:13.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.490+0000 7f5341b9b640 1 --2- 172.21.15.87:0/1913138622 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f53280a12b0 0x7f53280a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.491+0000 7f5341b9b640 1 --2- 172.21.15.87:0/1913138622 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f53280a12b0 0x7f53280a3770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5338005e10 tx=0x7f5338005da0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:13.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.494+0000 7f532effd640 1 -- 172.21.15.87:0/1913138622 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5330095a20 con 0x7f533c104f10 2024-09-13T17:18:13.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.690+0000 7f5342b9d640 1 -- 172.21.15.87:0/1913138622 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f533c1001a0 con 0x7f533c104f10 2024-09-13T17:18:13.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.691+0000 7f532effd640 1 -- 172.21.15.87:0/1913138622 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+10886 (secure 0 0 0) 0x7f5330099040 con 0x7f533c104f10 2024-09-13T17:18:13.693 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:18:13.694 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/3674545180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":3674545180},{"type":"v1","addr":"172.21.15.87:6841","nonce":3674545180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:11:23.313609+0000","modified":"2024-09-13T17:16:22.516744+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24484,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6839/3052680456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3052680456},{"type":"v1","addr":"172.21.15.118:6839","nonce":3052680456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:18:13.694 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 30 2024-09-13T17:18:13.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.693+0000 7f5342b9d640 1 -- 172.21.15.87:0/1913138622 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f53280a12b0 msgr2=0x7f53280a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:13.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.693+0000 7f5342b9d640 1 --2- 172.21.15.87:0/1913138622 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f53280a12b0 0x7f53280a3770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5338005e10 tx=0x7f5338005da0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.693+0000 7f5342b9d640 1 -- 172.21.15.87:0/1913138622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f533c104f10 msgr2=0x7f533c072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:13.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.693+0000 7f5342b9d640 1 --2- 172.21.15.87:0/1913138622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f533c104f10 0x7f533c072cf0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f533000d740 tx=0x7f533000dc00 comp rx=0 tx=0).stop 2024-09-13T17:18:13.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.693+0000 7f5342b9d640 1 -- 172.21.15.87:0/1913138622 shutdown_connections 2024-09-13T17:18:13.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.693+0000 7f5342b9d640 1 --2- 172.21.15.87:0/1913138622 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f533c073230 0x7f533c1a41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.693+0000 7f5342b9d640 1 --2- 172.21.15.87:0/1913138622 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f53280a12b0 0x7f53280a3770 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.693+0000 7f5342b9d640 1 --2- 172.21.15.87:0/1913138622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f533c104f10 0x7f533c072cf0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.693+0000 7f5342b9d640 1 --2- 172.21.15.87:0/1913138622 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f533c0ffdc0 0x7f533c0727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.693+0000 7f5342b9d640 1 -- 172.21.15.87:0/1913138622 >> 172.21.15.87:0/1913138622 conn(0x7f533c0fb830 msgr2=0x7f533c0fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:13.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.693+0000 7f5342b9d640 1 -- 172.21.15.87:0/1913138622 shutdown_connections 2024-09-13T17:18:13.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.693+0000 7f5342b9d640 1 -- 172.21.15.87:0/1913138622 wait complete. 2024-09-13T17:18:13.707 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-09-13T17:18:13.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.805+0000 7fb5d9a87640 1 -- 172.21.15.87:0/1392948117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5d40ff810 msgr2=0x7fb5d4103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:13.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.805+0000 7fb5d9a87640 1 --2- 172.21.15.87:0/1392948117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5d40ff810 0x7fb5d4103850 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc009930 tx=0x7fb5bc02a420 comp rx=0 tx=0).stop 2024-09-13T17:18:13.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.806+0000 7fb5d9a87640 1 -- 172.21.15.87:0/1392948117 shutdown_connections 2024-09-13T17:18:13.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.806+0000 7fb5d9a87640 1 --2- 172.21.15.87:0/1392948117 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5d4103fb0 0x7fb5d410bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.806+0000 7fb5d9a87640 1 --2- 172.21.15.87:0/1392948117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5d40ff810 0x7fb5d4103850 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.806+0000 7fb5d9a87640 1 --2- 172.21.15.87:0/1392948117 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5d40fee60 0x7fb5d40ff240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.806+0000 7fb5d9a87640 1 -- 172.21.15.87:0/1392948117 >> 172.21.15.87:0/1392948117 conn(0x7fb5d4075c60 msgr2=0x7fb5d40fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:13.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.806+0000 7fb5d9a87640 1 -- 172.21.15.87:0/1392948117 shutdown_connections 2024-09-13T17:18:13.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.806+0000 7fb5d9a87640 1 -- 172.21.15.87:0/1392948117 wait complete. 2024-09-13T17:18:13.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.806+0000 7fb5d9a87640 1 Processor -- start 2024-09-13T17:18:13.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.806+0000 7fb5d9a87640 1 -- start start 2024-09-13T17:18:13.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.806+0000 7fb5d9a87640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5d40fee60 0x7fb5d41962f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.807+0000 7fb5d9a87640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5d4103fb0 0x7fb5d4196830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.807+0000 7fb5d9a87640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5d419ac20 0x7fb5d419b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.807+0000 7fb5d9a87640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d419b610 con 0x7fb5d4103fb0 2024-09-13T17:18:13.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.807+0000 7fb5d9a87640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d419b780 con 0x7fb5d419ac20 2024-09-13T17:18:13.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.807+0000 7fb5d9a87640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d419b8f0 con 0x7fb5d40fee60 2024-09-13T17:18:13.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.807+0000 7fb5caffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5d4103fb0 0x7fb5d4196830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.807+0000 7fb5caffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5d4103fb0 0x7fb5d4196830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45444/0 (socket says 172.21.15.87:45444) 2024-09-13T17:18:13.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.807+0000 7fb5caffd640 1 -- 172.21.15.87:0/3129984458 learned_addr learned my addr 172.21.15.87:0/3129984458 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:13.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.807+0000 7fb5d37fe640 1 --2- 172.21.15.87:0/3129984458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5d40fee60 0x7fb5d41962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.807+0000 7fb5d3fff640 1 --2- 172.21.15.87:0/3129984458 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5d419ac20 0x7fb5d419b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.807+0000 7fb5caffd640 1 -- 172.21.15.87:0/3129984458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5d40fee60 msgr2=0x7fb5d41962f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:13.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.807+0000 7fb5caffd640 1 --2- 172.21.15.87:0/3129984458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5d40fee60 0x7fb5d41962f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.807+0000 7fb5caffd640 1 -- 172.21.15.87:0/3129984458 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5d419ac20 msgr2=0x7fb5d419b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:13.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.807+0000 7fb5caffd640 1 --2- 172.21.15.87:0/3129984458 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5d419ac20 0x7fb5d419b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.807+0000 7fb5caffd640 1 -- 172.21.15.87:0/3129984458 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5bc009560 con 0x7fb5d4103fb0 2024-09-13T17:18:13.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.807+0000 7fb5d3fff640 1 --2- 172.21.15.87:0/3129984458 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5d419ac20 0x7fb5d419b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:13.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.807+0000 7fb5caffd640 1 --2- 172.21.15.87:0/3129984458 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5d4103fb0 0x7fb5d4196830 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc009900 tx=0x7fb5bc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:13.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.807+0000 7fb5d17fa640 1 -- 172.21.15.87:0/3129984458 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc003a00 con 0x7fb5d4103fb0 2024-09-13T17:18:13.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.807+0000 7fb5d17fa640 1 -- 172.21.15.87:0/3129984458 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb5bc0044e0 con 0x7fb5d4103fb0 2024-09-13T17:18:13.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.807+0000 7fb5d9a87640 1 -- 172.21.15.87:0/3129984458 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5d41a2ed0 con 0x7fb5d4103fb0 2024-09-13T17:18:13.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.807+0000 7fb5d17fa640 1 -- 172.21.15.87:0/3129984458 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc03a3c0 con 0x7fb5d4103fb0 2024-09-13T17:18:13.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.807+0000 7fb5d9a87640 1 -- 172.21.15.87:0/3129984458 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d41a3240 con 0x7fb5d4103fb0 2024-09-13T17:18:13.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.810+0000 7fb5dc886740 1 Processor -- start 2024-09-13T17:18:13.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.810+0000 7fb5dc886740 1 -- start start 2024-09-13T17:18:13.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.810+0000 7fb5d17fa640 1 -- 172.21.15.87:0/3129984458 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fb5bc03b460 con 0x7fb5d4103fb0 2024-09-13T17:18:13.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.810+0000 7fb5dc886740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608000be610 0x5608000be9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.810+0000 7fb5dc886740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608000bef30 0x5608000cd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.810+0000 7fb5dc886740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608000cdd60 0x5608000d0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.810+0000 7fb5dc886740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560800028cc0 con 0x5608000bef30 2024-09-13T17:18:13.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.810+0000 7fb5dc886740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560800026450 con 0x5608000cdd60 2024-09-13T17:18:13.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.810+0000 7fb5dc886740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560800021d40 con 0x5608000be610 2024-09-13T17:18:13.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.810+0000 7fb5d37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608000bef30 0x5608000cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.810+0000 7fb5d37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608000bef30 0x5608000cd820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45450/0 (socket says 172.21.15.87:45450) 2024-09-13T17:18:13.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.810+0000 7fb5d37fe640 1 -- 172.21.15.87:0/2492806224 learned_addr learned my addr 172.21.15.87:0/2492806224 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:13.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.810+0000 7fb5caffd640 1 --2- 172.21.15.87:0/2492806224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608000cdd60 0x5608000d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.810+0000 7fb5d3fff640 1 --2- 172.21.15.87:0/2492806224 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608000be610 0x5608000be9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.811+0000 7fb5d37fe640 1 -- 172.21.15.87:0/2492806224 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608000be610 msgr2=0x5608000be9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:13.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.811+0000 7fb5d37fe640 1 --2- 172.21.15.87:0/2492806224 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608000be610 0x5608000be9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.811+0000 7fb5d37fe640 1 -- 172.21.15.87:0/2492806224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608000cdd60 msgr2=0x5608000d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:13.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.811+0000 7fb5d37fe640 1 --2- 172.21.15.87:0/2492806224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608000cdd60 0x5608000d0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.811+0000 7fb5d37fe640 1 -- 172.21.15.87:0/2492806224 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607fffe9620 con 0x5608000bef30 2024-09-13T17:18:13.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.811+0000 7fb5d17fa640 1 --2- 172.21.15.87:0/3129984458 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb5c00a1200 0x7fb5c00a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.811+0000 7fb5d37fe640 1 --2- 172.21.15.87:0/2492806224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608000bef30 0x5608000cd820 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fb5c400ac10 tx=0x7fb5c400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db3b06f893a4e058 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:13.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.811+0000 7fb5d3fff640 1 --2- 172.21.15.87:0/3129984458 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb5c00a1200 0x7fb5c00a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.811+0000 7fb5d17fa640 1 -- 172.21.15.87:0/3129984458 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fb5bc0ee080 con 0x7fb5d4103fb0 2024-09-13T17:18:13.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.811+0000 7fb5c9ffb640 1 -- 172.21.15.87:0/2492806224 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c400a6e0 con 0x5608000bef30 2024-09-13T17:18:13.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.811+0000 7fb5c9ffb640 1 -- 172.21.15.87:0/2492806224 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb5c4018af0 con 0x5608000bef30 2024-09-13T17:18:13.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.811+0000 7fb5c9ffb640 1 -- 172.21.15.87:0/2492806224 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c4010ba0 con 0x5608000bef30 2024-09-13T17:18:13.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.812+0000 7fb5dc886740 1 -- 172.21.15.87:0/2492806224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608000bef30 msgr2=0x5608000cd820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:13.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.812+0000 7fb5d3fff640 1 --2- 172.21.15.87:0/3129984458 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb5c00a1200 0x7fb5c00a36c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc005fd0 tx=0x7fb5cc009770 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:13.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.812+0000 7fb5dc886740 1 --2- 172.21.15.87:0/2492806224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608000bef30 0x5608000cd820 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fb5c400ac10 tx=0x7fb5c400f790 comp rx=0 tx=0).stop 2024-09-13T17:18:13.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.812+0000 7fb5dc886740 1 -- 172.21.15.87:0/2492806224 shutdown_connections 2024-09-13T17:18:13.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.812+0000 7fb5dc886740 1 --2- 172.21.15.87:0/2492806224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608000cdd60 0x5608000d0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.812+0000 7fb5dc886740 1 --2- 172.21.15.87:0/2492806224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608000bef30 0x5608000cd820 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.812+0000 7fb5dc886740 1 --2- 172.21.15.87:0/2492806224 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608000be610 0x5608000be9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.812+0000 7fb5dc886740 1 -- 172.21.15.87:0/2492806224 >> 172.21.15.87:0/2492806224 conn(0x5608000bad00 msgr2=0x5608000bb0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:13.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.812+0000 7fb5dc886740 1 -- 172.21.15.87:0/2492806224 shutdown_connections 2024-09-13T17:18:13.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.812+0000 7fb5dc886740 1 -- 172.21.15.87:0/2492806224 wait complete. 2024-09-13T17:18:13.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.812+0000 7fb5dc886740 1 -- start start 2024-09-13T17:18:13.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.812+0000 7fb5dc886740 1 Processor -- start 2024-09-13T17:18:13.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.813+0000 7fb5dc886740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608000be610 0x5608000cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.813+0000 7fb5dc886740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608000bef30 0x5608000ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.813+0000 7fb5dc886740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608000cdd60 0x5608000cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.813+0000 7fb5dc886740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607fffe0180 con 0x5608000be610 2024-09-13T17:18:13.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.813+0000 7fb5dc886740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607ffcfa430 con 0x5608000cdd60 2024-09-13T17:18:13.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.813+0000 7fb5dc886740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607fffa55e0 con 0x5608000bef30 2024-09-13T17:18:13.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.813+0000 7fb5dc886740 10 client.0 _ll_register_callbacks cb 0x560800011aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:18:13.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.813+0000 7fb5d37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608000be610 0x5608000cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.813+0000 7fb5d37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608000be610 0x5608000cd3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45462/0 (socket says 172.21.15.87:45462) 2024-09-13T17:18:13.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.813+0000 7fb5d37fe640 1 -- 172.21.15.87:0/1120282601 learned_addr learned my addr 172.21.15.87:0/1120282601 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:13.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.813+0000 7fb5d3fff640 1 --2- 172.21.15.87:0/1120282601 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608000cdd60 0x5608000cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.813+0000 7fb5caffd640 1 --2- 172.21.15.87:0/1120282601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608000bef30 0x5608000ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.813+0000 7fb5d37fe640 1 -- 172.21.15.87:0/1120282601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608000bef30 msgr2=0x5608000ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:13.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.813+0000 7fb5d37fe640 1 --2- 172.21.15.87:0/1120282601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608000bef30 0x5608000ca770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.813+0000 7fb5d37fe640 1 -- 172.21.15.87:0/1120282601 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608000cdd60 msgr2=0x5608000cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:13.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.813+0000 7fb5d37fe640 1 --2- 172.21.15.87:0/1120282601 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608000cdd60 0x5608000cacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.813+0000 7fb5d37fe640 1 -- 172.21.15.87:0/1120282601 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c400a840 con 0x5608000be610 2024-09-13T17:18:13.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.813+0000 7fb5d37fe640 1 --2- 172.21.15.87:0/1120282601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608000be610 0x5608000cd3b0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fb5c400abe0 tx=0x7fb5c4005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c06697201d08169 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:13.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.813+0000 7fb5b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:18:13.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.813+0000 7fb5b2ffd640 1 -- 172.21.15.87:0/1120282601 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c400a6e0 con 0x5608000be610 2024-09-13T17:18:13.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.813+0000 7fb5b2ffd640 1 -- 172.21.15.87:0/1120282601 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fb5c4010920 con 0x5608000be610 2024-09-13T17:18:13.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.813+0000 7fb5dc886740 1 -- 172.21.15.87:0/1120282601 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56080004bb80 con 0x5608000be610 2024-09-13T17:18:13.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.814+0000 7fb5b2ffd640 1 -- 172.21.15.87:0/1120282601 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5c40105e0 con 0x5608000be610 2024-09-13T17:18:13.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.814+0000 7fb5dc886740 10 client.16833 fetch_fsmap learned FSMap version 30 2024-09-13T17:18:13.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.814+0000 7fb5dc886740 1 -- 172.21.15.87:0/1120282601 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5608000203c0 con 0x5608000be610 2024-09-13T17:18:13.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.814+0000 7fb5b2ffd640 1 -- 172.21.15.87:0/1120282601 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x56080004bb80 con 0x5608000be610 2024-09-13T17:18:13.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.814+0000 7fb5b2ffd640 1 -- 172.21.15.87:0/1120282601 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fb5c4004750 con 0x5608000be610 2024-09-13T17:18:13.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.814+0000 7fb5dc886740 10 client.16833 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:18:13.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.814+0000 7fb5dc886740 10 client.16833 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:18:13.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.814+0000 7fb5dc886740 20 client.16833 populate_metadata read hostname 'smithi087' 2024-09-13T17:18:13.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.814+0000 7fb5dc886740 1 --2- 172.21.15.87:0/1120282601 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x5608000dd5d0 0x5608000df9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.814+0000 7fb5dc886740 4 client.16833 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:18:13.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.814+0000 7fb5dc886740 1 -- 172.21.15.87:0/1120282601 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5608000141f0 con 0x5608000dd5d0 2024-09-13T17:18:13.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.814+0000 7fb5caffd640 1 --2- 172.21.15.87:0/1120282601 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x5608000dd5d0 0x5608000df9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.815+0000 7fb5b2ffd640 10 client.16833 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:18:13.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.815+0000 7fb5caffd640 1 --2- 172.21.15.87:0/1120282601 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x5608000dd5d0 0x5608000df9f0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=89af47187e0e6f5b server_cookie=f920cdf1cce22fa2 in_seq=0 out_seq=0 2024-09-13T17:18:13.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.815+0000 7fb5b2ffd640 1 -- 172.21.15.87:0/1120282601 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5608000141f0 con 0x5608000dd5d0 2024-09-13T17:18:13.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.815+0000 7fb5b2ffd640 10 client.16833 handle_command_reply: tid=0 2024-09-13T17:18:13.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.815+0000 7fb5dc886740 1 client.16833 shutdown 2024-09-13T17:18:13.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.816+0000 7fb5dc886740 1 -- 172.21.15.87:0/1120282601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608000be610 msgr2=0x5608000cd3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:13.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.816+0000 7fb5dc886740 1 --2- 172.21.15.87:0/1120282601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608000be610 0x5608000cd3b0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fb5c400abe0 tx=0x7fb5c4005e30 comp rx=0 tx=0).stop 2024-09-13T17:18:13.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.816+0000 7fb5dc886740 1 -- 172.21.15.87:0/1120282601 shutdown_connections 2024-09-13T17:18:13.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.816+0000 7fb5dc886740 1 --2- 172.21.15.87:0/1120282601 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x5608000dd5d0 0x5608000df9f0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.816+0000 7fb5dc886740 1 --2- 172.21.15.87:0/1120282601 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608000cdd60 0x5608000cacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.816+0000 7fb5dc886740 1 --2- 172.21.15.87:0/1120282601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608000bef30 0x5608000ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.816+0000 7fb5b2ffd640 0 client.16833 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:18:13.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.816+0000 7fb5dc886740 1 --2- 172.21.15.87:0/1120282601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608000be610 0x5608000cd3b0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.816+0000 7fb5dc886740 1 -- 172.21.15.87:0/1120282601 >> 172.21.15.87:0/1120282601 conn(0x5608000bad00 msgr2=0x5608000b9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:13.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.816+0000 7fb5dc886740 1 -- 172.21.15.87:0/1120282601 shutdown_connections 2024-09-13T17:18:13.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.816+0000 7fb5dc886740 1 -- 172.21.15.87:0/1120282601 wait complete. 2024-09-13T17:18:13.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.816+0000 7fb5dc886740 20 client.16833 trim_cache size 0 max 16384 2024-09-13T17:18:13.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.827+0000 7fb5dc886740 1 Processor -- start 2024-09-13T17:18:13.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.827+0000 7fb5dc886740 1 -- start start 2024-09-13T17:18:13.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.827+0000 7fb5dc886740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608000be610 0x5608000ba6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.827+0000 7fb5dc886740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608000bef30 0x5608000c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.827+0000 7fb5dc886740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608000cdd60 0x5608000ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.827+0000 7fb5dc886740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608000c6410 con 0x5608000cdd60 2024-09-13T17:18:13.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.827+0000 7fb5dc886740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608000bf4c0 con 0x5608000be610 2024-09-13T17:18:13.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.827+0000 7fb5dc886740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608000cb6d0 con 0x5608000bef30 2024-09-13T17:18:13.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.827+0000 7fb5d3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608000cdd60 0x5608000ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.827+0000 7fb5d3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608000cdd60 0x5608000ccea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45468/0 (socket says 172.21.15.87:45468) 2024-09-13T17:18:13.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.827+0000 7fb5d3fff640 1 -- 172.21.15.87:0/2985335064 learned_addr learned my addr 172.21.15.87:0/2985335064 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:13.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.827+0000 7fb5d3fff640 1 -- 172.21.15.87:0/2985335064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608000bef30 msgr2=0x5608000c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:13.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.827+0000 7fb5caffd640 1 --2- 172.21.15.87:0/2985335064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608000bef30 0x5608000c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.827+0000 7fb5d3fff640 1 --2- 172.21.15.87:0/2985335064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608000bef30 0x5608000c5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.827+0000 7fb5d3fff640 1 -- 172.21.15.87:0/2985335064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608000be610 msgr2=0x5608000ba6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:13.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.827+0000 7fb5d3fff640 1 --2- 172.21.15.87:0/2985335064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608000be610 0x5608000ba6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.827+0000 7fb5d3fff640 1 -- 172.21.15.87:0/2985335064 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607fffc2770 con 0x5608000cdd60 2024-09-13T17:18:13.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.827+0000 7fb5d3fff640 1 --2- 172.21.15.87:0/2985335064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608000cdd60 0x5608000ccea0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc011670 tx=0x7fb5cc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=589c4df19914ccb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:13.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.827+0000 7fb5ca7fc640 1 -- 172.21.15.87:0/2985335064 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc024070 con 0x5608000cdd60 2024-09-13T17:18:13.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.828+0000 7fb5ca7fc640 1 -- 172.21.15.87:0/2985335064 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb5cc011de0 con 0x5608000cdd60 2024-09-13T17:18:13.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.828+0000 7fb5ca7fc640 1 -- 172.21.15.87:0/2985335064 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc01f670 con 0x5608000cdd60 2024-09-13T17:18:13.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.828+0000 7fb5dc886740 1 -- 172.21.15.87:0/2985335064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608000cdd60 msgr2=0x5608000ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:13.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.828+0000 7fb5dc886740 1 --2- 172.21.15.87:0/2985335064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608000cdd60 0x5608000ccea0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc011670 tx=0x7fb5cc016000 comp rx=0 tx=0).stop 2024-09-13T17:18:13.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.828+0000 7fb5dc886740 1 -- 172.21.15.87:0/2985335064 shutdown_connections 2024-09-13T17:18:13.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.828+0000 7fb5dc886740 1 --2- 172.21.15.87:0/2985335064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608000cdd60 0x5608000ccea0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.828+0000 7fb5dc886740 1 --2- 172.21.15.87:0/2985335064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608000bef30 0x5608000c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.828+0000 7fb5dc886740 1 --2- 172.21.15.87:0/2985335064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608000be610 0x5608000ba6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.828+0000 7fb5dc886740 1 -- 172.21.15.87:0/2985335064 >> 172.21.15.87:0/2985335064 conn(0x5608000bad00 msgr2=0x5608000c57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:13.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.828+0000 7fb5dc886740 1 -- 172.21.15.87:0/2985335064 shutdown_connections 2024-09-13T17:18:13.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.828+0000 7fb5dc886740 1 -- 172.21.15.87:0/2985335064 wait complete. 2024-09-13T17:18:13.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.828+0000 7fb5dc886740 1 -- start start 2024-09-13T17:18:13.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.829+0000 7fb5dc886740 1 Processor -- start 2024-09-13T17:18:13.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.829+0000 7fb5dc886740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608000be610 0x5608000d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.829+0000 7fb5dc886740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608000bef30 0x5608000d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.829+0000 7fb5dc886740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608000cdd60 0x5608000d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.829+0000 7fb5dc886740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608000d1cf0 con 0x5608000bef30 2024-09-13T17:18:13.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.829+0000 7fb5dc886740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608000d1e60 con 0x5608000be610 2024-09-13T17:18:13.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.829+0000 7fb5dc886740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560800133af0 con 0x5608000cdd60 2024-09-13T17:18:13.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.829+0000 7fb5dc886740 10 client.0 _ll_register_callbacks cb 0x7fb5c400a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:18:13.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.829+0000 7fb5caffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608000bef30 0x5608000d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.829+0000 7fb5caffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608000bef30 0x5608000d1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45470/0 (socket says 172.21.15.87:45470) 2024-09-13T17:18:13.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.829+0000 7fb5caffd640 1 -- 172.21.15.87:0/821712073 learned_addr learned my addr 172.21.15.87:0/821712073 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:13.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.829+0000 7fb5d37fe640 1 --2- 172.21.15.87:0/821712073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608000be610 0x5608000d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.829+0000 7fb5d3fff640 1 --2- 172.21.15.87:0/821712073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608000cdd60 0x5608000d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.829+0000 7fb5caffd640 1 -- 172.21.15.87:0/821712073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608000cdd60 msgr2=0x5608000d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:13.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.829+0000 7fb5caffd640 1 --2- 172.21.15.87:0/821712073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608000cdd60 0x5608000d1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.829+0000 7fb5caffd640 1 -- 172.21.15.87:0/821712073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608000be610 msgr2=0x5608000d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:13.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.829+0000 7fb5caffd640 1 --2- 172.21.15.87:0/821712073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608000be610 0x5608000d4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.829+0000 7fb5caffd640 1 -- 172.21.15.87:0/821712073 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5cc019070 con 0x5608000bef30 2024-09-13T17:18:13.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.829+0000 7fb5d37fe640 1 --2- 172.21.15.87:0/821712073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608000be610 0x5608000d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:13.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.829+0000 7fb5caffd640 1 --2- 172.21.15.87:0/821712073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608000bef30 0x5608000d1100 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc0b7850 tx=0x7fb5bc04e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c4b1cfa3d8afeff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:13.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.829+0000 7fb5b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:18:13.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.829+0000 7fb5b2ffd640 1 -- 172.21.15.87:0/821712073 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc0ba740 con 0x5608000bef30 2024-09-13T17:18:13.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.829+0000 7fb5b2ffd640 1 -- 172.21.15.87:0/821712073 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fb5bc0bb4e0 con 0x5608000bef30 2024-09-13T17:18:13.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.829+0000 7fb5dc886740 1 -- 172.21.15.87:0/821712073 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb5c4018af0 con 0x5608000bef30 2024-09-13T17:18:13.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.830+0000 7fb5b2ffd640 1 -- 172.21.15.87:0/821712073 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5bc03b710 con 0x5608000bef30 2024-09-13T17:18:13.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.830+0000 7fb5dc886740 10 client.16839 fetch_fsmap learned FSMap version 30 2024-09-13T17:18:13.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.830+0000 7fb5dc886740 1 -- 172.21.15.87:0/821712073 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5607fffe7e80 con 0x5608000bef30 2024-09-13T17:18:13.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.830+0000 7fb5b2ffd640 1 -- 172.21.15.87:0/821712073 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb5c4018af0 con 0x5608000bef30 2024-09-13T17:18:13.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.830+0000 7fb5b2ffd640 1 -- 172.21.15.87:0/821712073 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fb5bc04e070 con 0x5608000bef30 2024-09-13T17:18:13.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.830+0000 7fb5dc886740 10 client.16839 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:18:13.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.830+0000 7fb5dc886740 10 client.16839 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:18:13.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.830+0000 7fb5dc886740 20 client.16839 populate_metadata read hostname 'smithi087' 2024-09-13T17:18:13.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.830+0000 7fb5dc886740 1 --2- 172.21.15.87:0/821712073 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x560800134ef0 0x560800137310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.830+0000 7fb5dc886740 4 client.16839 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:18:13.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.830+0000 7fb5dc886740 1 -- 172.21.15.87:0/821712073 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5607ffd154e0 con 0x560800134ef0 2024-09-13T17:18:13.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.830+0000 7fb5d37fe640 1 --2- 172.21.15.87:0/821712073 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x560800134ef0 0x560800137310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.831+0000 7fb5b2ffd640 10 client.16839 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:18:13.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.831+0000 7fb5d37fe640 1 --2- 172.21.15.87:0/821712073 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x560800134ef0 0x560800137310 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2c1a22f61f73310 server_cookie=64fe355146c58c40 in_seq=0 out_seq=0 2024-09-13T17:18:13.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.831+0000 7fb5b2ffd640 1 -- 172.21.15.87:0/821712073 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5607ffd154e0 con 0x560800134ef0 2024-09-13T17:18:13.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.831+0000 7fb5b2ffd640 10 client.16839 handle_command_reply: tid=0 2024-09-13T17:18:13.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.831+0000 7fb5dc886740 1 client.16839 shutdown 2024-09-13T17:18:13.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.831+0000 7fb5dc886740 1 -- 172.21.15.87:0/821712073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608000bef30 msgr2=0x5608000d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:13.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.831+0000 7fb5dc886740 1 --2- 172.21.15.87:0/821712073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608000bef30 0x5608000d1100 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc0b7850 tx=0x7fb5bc04e000 comp rx=0 tx=0).stop 2024-09-13T17:18:13.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.831+0000 7fb5dc886740 1 -- 172.21.15.87:0/821712073 shutdown_connections 2024-09-13T17:18:13.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.831+0000 7fb5dc886740 1 --2- 172.21.15.87:0/821712073 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x560800134ef0 0x560800137310 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.831+0000 7fb5dc886740 1 --2- 172.21.15.87:0/821712073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5608000cdd60 0x5608000d1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.831+0000 7fb5dc886740 1 --2- 172.21.15.87:0/821712073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5608000bef30 0x5608000d1100 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.831+0000 7fb5b2ffd640 0 client.16839 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:18:13.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.831+0000 7fb5dc886740 1 --2- 172.21.15.87:0/821712073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608000be610 0x5608000d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.831+0000 7fb5dc886740 1 -- 172.21.15.87:0/821712073 >> 172.21.15.87:0/821712073 conn(0x5608000bad00 msgr2=0x5608000c0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:13.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.831+0000 7fb5dc886740 1 -- 172.21.15.87:0/821712073 shutdown_connections 2024-09-13T17:18:13.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.831+0000 7fb5dc886740 1 -- 172.21.15.87:0/821712073 wait complete. 2024-09-13T17:18:13.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.831+0000 7fb5dc886740 20 client.16839 trim_cache size 0 max 16384 2024-09-13T17:18:13.846 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:18:13.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.832+0000 7fb5d9a87640 1 -- 172.21.15.87:0/3129984458 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb5c00a1200 msgr2=0x7fb5c00a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:13.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.832+0000 7fb5d9a87640 1 --2- 172.21.15.87:0/3129984458 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb5c00a1200 0x7fb5c00a36c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc005fd0 tx=0x7fb5cc009770 comp rx=0 tx=0).stop 2024-09-13T17:18:13.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.832+0000 7fb5d9a87640 1 -- 172.21.15.87:0/3129984458 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5d4103fb0 msgr2=0x7fb5d4196830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:13.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.832+0000 7fb5d9a87640 1 --2- 172.21.15.87:0/3129984458 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5d4103fb0 0x7fb5d4196830 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc009900 tx=0x7fb5bc0042f0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.832+0000 7fb5d9a87640 1 -- 172.21.15.87:0/3129984458 shutdown_connections 2024-09-13T17:18:13.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.832+0000 7fb5d9a87640 1 --2- 172.21.15.87:0/3129984458 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5d419ac20 0x7fb5d419b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.832+0000 7fb5d9a87640 1 --2- 172.21.15.87:0/3129984458 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb5c00a1200 0x7fb5c00a36c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.832+0000 7fb5d9a87640 1 --2- 172.21.15.87:0/3129984458 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5d4103fb0 0x7fb5d4196830 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.832+0000 7fb5d9a87640 1 --2- 172.21.15.87:0/3129984458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5d40fee60 0x7fb5d41962f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.832+0000 7fb5d9a87640 1 -- 172.21.15.87:0/3129984458 >> 172.21.15.87:0/3129984458 conn(0x7fb5d4075c60 msgr2=0x7fb5d40fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:13.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.832+0000 7fb5d9a87640 1 -- 172.21.15.87:0/3129984458 shutdown_connections 2024-09-13T17:18:13.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.832+0000 7fb5d9a87640 1 -- 172.21.15.87:0/3129984458 wait complete. 2024-09-13T17:18:13.848 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:13 smithi087 ceph-mon[30934]: pgmap v135: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-13T17:18:13.849 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-09-13T17:18:13.850 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:13 smithi149 ceph-mon[35496]: pgmap v135: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-13T17:18:13.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:13 smithi118 ceph-mon[34374]: pgmap v135: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-13T17:18:13.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.948+0000 7f6184e41640 1 -- 172.21.15.87:0/2763054797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61800ffc90 msgr2=0x7f6180100070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:13.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.948+0000 7f6184e41640 1 --2- 172.21.15.87:0/2763054797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61800ffc90 0x7f6180100070 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f6170009930 tx=0x7f617002a420 comp rx=0 tx=0).stop 2024-09-13T17:18:13.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.948+0000 7f6184e41640 1 -- 172.21.15.87:0/2763054797 shutdown_connections 2024-09-13T17:18:13.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.948+0000 7f6184e41640 1 --2- 172.21.15.87:0/2763054797 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61801051d0 0x7f618010bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.948+0000 7f6184e41640 1 --2- 172.21.15.87:0/2763054797 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6180100640 0x7f6180104a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.948+0000 7f6184e41640 1 --2- 172.21.15.87:0/2763054797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61800ffc90 0x7f6180100070 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.948+0000 7f6184e41640 1 -- 172.21.15.87:0/2763054797 >> 172.21.15.87:0/2763054797 conn(0x7f6180074110 msgr2=0x7f6180074520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:13.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.948+0000 7f6184e41640 1 -- 172.21.15.87:0/2763054797 shutdown_connections 2024-09-13T17:18:13.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.948+0000 7f6184e41640 1 -- 172.21.15.87:0/2763054797 wait complete. 2024-09-13T17:18:13.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.949+0000 7f6184e41640 1 Processor -- start 2024-09-13T17:18:13.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.949+0000 7f6184e41640 1 -- start start 2024-09-13T17:18:13.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.949+0000 7f6184e41640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61800ffc90 0x7f6180195350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.949+0000 7f6184e41640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61801051d0 0x7f6180195890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.949+0000 7f6184e41640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6180199c80 0x7f618019a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.949+0000 7f6184e41640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618019a670 con 0x7f6180199c80 2024-09-13T17:18:13.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.949+0000 7f6184e41640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618019a7e0 con 0x7f61800ffc90 2024-09-13T17:18:13.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.949+0000 7f6184e41640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618019a950 con 0x7f61801051d0 2024-09-13T17:18:13.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.949+0000 7f617ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6180199c80 0x7f618019a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.949+0000 7f617ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6180199c80 0x7f618019a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45500/0 (socket says 172.21.15.87:45500) 2024-09-13T17:18:13.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.949+0000 7f617ed9d640 1 -- 172.21.15.87:0/85968021 learned_addr learned my addr 172.21.15.87:0/85968021 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:13.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.949+0000 7f617dd9b640 1 --2- 172.21.15.87:0/85968021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61801051d0 0x7f6180195890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.949+0000 7f617e59c640 1 --2- 172.21.15.87:0/85968021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61800ffc90 0x7f6180195350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.950+0000 7f617ed9d640 1 -- 172.21.15.87:0/85968021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61801051d0 msgr2=0x7f6180195890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:13.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.950+0000 7f617ed9d640 1 --2- 172.21.15.87:0/85968021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61801051d0 0x7f6180195890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.950+0000 7f617ed9d640 1 -- 172.21.15.87:0/85968021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61800ffc90 msgr2=0x7f6180195350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:13.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.950+0000 7f617ed9d640 1 --2- 172.21.15.87:0/85968021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61800ffc90 0x7f6180195350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.950+0000 7f617ed9d640 1 -- 172.21.15.87:0/85968021 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6170009560 con 0x7f6180199c80 2024-09-13T17:18:13.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.950+0000 7f617ed9d640 1 --2- 172.21.15.87:0/85968021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6180199c80 0x7f618019a130 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f617800ebb0 tx=0x7f6178007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:13.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.950+0000 7f616f7fe640 1 -- 172.21.15.87:0/85968021 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6178013070 con 0x7f6180199c80 2024-09-13T17:18:13.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.950+0000 7f616f7fe640 1 -- 172.21.15.87:0/85968021 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6178007ca0 con 0x7f6180199c80 2024-09-13T17:18:13.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.950+0000 7f6184e41640 1 -- 172.21.15.87:0/85968021 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61800fe910 con 0x7f6180199c80 2024-09-13T17:18:13.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.950+0000 7f616f7fe640 1 -- 172.21.15.87:0/85968021 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61780055e0 con 0x7f6180199c80 2024-09-13T17:18:13.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.950+0000 7f6184e41640 1 -- 172.21.15.87:0/85968021 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61800fee20 con 0x7f6180199c80 2024-09-13T17:18:13.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.952+0000 7f616f7fe640 1 -- 172.21.15.87:0/85968021 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f6178005740 con 0x7f6180199c80 2024-09-13T17:18:13.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.952+0000 7f6187c45740 1 Processor -- start 2024-09-13T17:18:13.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.953+0000 7f6187c45740 1 -- start start 2024-09-13T17:18:13.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.953+0000 7f6187c45740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564d8e708790 0x564d8e708b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.953+0000 7f6187c45740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d8e7090b0 0x564d8e713410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.953+0000 7f6187c45740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564d8e713950 0x564d8e715d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.953+0000 7f6187c45740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d8e672cc0 con 0x564d8e7090b0 2024-09-13T17:18:13.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.953+0000 7f6187c45740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d8e670450 con 0x564d8e708790 2024-09-13T17:18:13.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.953+0000 7f6187c45740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d8e66bd40 con 0x564d8e713950 2024-09-13T17:18:13.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.953+0000 7f616f7fe640 1 --2- 172.21.15.87:0/85968021 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f61680a1200 0x7f61680a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.953+0000 7f617e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d8e7090b0 0x564d8e713410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.953+0000 7f617e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d8e7090b0 0x564d8e713410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45506/0 (socket says 172.21.15.87:45506) 2024-09-13T17:18:13.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.953+0000 7f617e59c640 1 -- 172.21.15.87:0/1921973393 learned_addr learned my addr 172.21.15.87:0/1921973393 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:13.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.953+0000 7f617ed9d640 1 --2- 172.21.15.87:0/85968021 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f61680a1200 0x7f61680a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.953+0000 7f617dd9b640 1 --2- 172.21.15.87:0/1921973393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564d8e713950 0x564d8e715d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.953+0000 7f617dd9b640 1 --2- 172.21.15.87:0/1921973393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564d8e708790 0x564d8e708b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.953+0000 7f616f7fe640 1 -- 172.21.15.87:0/85968021 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f61780ce380 con 0x7f6180199c80 2024-09-13T17:18:13.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.953+0000 7f617e59c640 1 -- 172.21.15.87:0/1921973393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564d8e713950 msgr2=0x564d8e715d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:13.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.953+0000 7f617e59c640 1 --2- 172.21.15.87:0/1921973393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564d8e713950 0x564d8e715d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.953+0000 7f617e59c640 1 -- 172.21.15.87:0/1921973393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564d8e708790 msgr2=0x564d8e708b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:13.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.953+0000 7f617e59c640 1 --2- 172.21.15.87:0/1921973393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564d8e708790 0x564d8e708b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.953+0000 7f617e59c640 1 -- 172.21.15.87:0/1921973393 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d8e633620 con 0x564d8e7090b0 2024-09-13T17:18:13.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.953+0000 7f617dd9b640 1 --2- 172.21.15.87:0/1921973393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564d8e708790 0x564d8e708b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:13.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.954+0000 7f617ed9d640 1 --2- 172.21.15.87:0/85968021 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f61680a1200 0x7f61680a36c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f61780cb7d0 tx=0x7f617806e320 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:13.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.954+0000 7f617e59c640 1 --2- 172.21.15.87:0/1921973393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d8e7090b0 0x564d8e713410 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f617002aa10 tx=0x7f6170031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=732d35ca6d99ea6c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:13.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.954+0000 7f616cff9640 1 -- 172.21.15.87:0/1921973393 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6170031600 con 0x564d8e7090b0 2024-09-13T17:18:13.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.954+0000 7f616cff9640 1 -- 172.21.15.87:0/1921973393 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6170040070 con 0x564d8e7090b0 2024-09-13T17:18:13.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.954+0000 7f616cff9640 1 -- 172.21.15.87:0/1921973393 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6170003bd0 con 0x564d8e7090b0 2024-09-13T17:18:13.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.954+0000 7f6187c45740 1 -- 172.21.15.87:0/1921973393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d8e7090b0 msgr2=0x564d8e713410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:13.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.954+0000 7f6187c45740 1 --2- 172.21.15.87:0/1921973393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d8e7090b0 0x564d8e713410 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f617002aa10 tx=0x7f6170031ca0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.955+0000 7f6187c45740 1 -- 172.21.15.87:0/1921973393 shutdown_connections 2024-09-13T17:18:13.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.955+0000 7f6187c45740 1 --2- 172.21.15.87:0/1921973393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564d8e713950 0x564d8e715d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.955+0000 7f6187c45740 1 --2- 172.21.15.87:0/1921973393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d8e7090b0 0x564d8e713410 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.955+0000 7f6187c45740 1 --2- 172.21.15.87:0/1921973393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564d8e708790 0x564d8e708b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.955+0000 7f6187c45740 1 -- 172.21.15.87:0/1921973393 >> 172.21.15.87:0/1921973393 conn(0x564d8e704d00 msgr2=0x564d8e7050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:13.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.955+0000 7f6187c45740 1 -- 172.21.15.87:0/1921973393 shutdown_connections 2024-09-13T17:18:13.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.955+0000 7f6187c45740 1 -- 172.21.15.87:0/1921973393 wait complete. 2024-09-13T17:18:13.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.955+0000 7f6187c45740 1 -- start start 2024-09-13T17:18:13.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.955+0000 7f6187c45740 1 Processor -- start 2024-09-13T17:18:13.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.955+0000 7f6187c45740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564d8e708790 0x564d8e712f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.955+0000 7f6187c45740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d8e7090b0 0x564d8e7101f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.955+0000 7f6187c45740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564d8e713950 0x564d8e710730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.955+0000 7f6187c45740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d8e62a180 con 0x564d8e7090b0 2024-09-13T17:18:13.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.955+0000 7f6187c45740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d8e344430 con 0x564d8e708790 2024-09-13T17:18:13.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.955+0000 7f6187c45740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d8e5ef5e0 con 0x564d8e713950 2024-09-13T17:18:13.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.955+0000 7f6187c45740 10 client.0 _ll_register_callbacks cb 0x564d8e65baa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:18:13.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.955+0000 7f617e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d8e7090b0 0x564d8e7101f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.955+0000 7f617e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d8e7090b0 0x564d8e7101f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45508/0 (socket says 172.21.15.87:45508) 2024-09-13T17:18:13.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.955+0000 7f617e59c640 1 -- 172.21.15.87:0/2769334158 learned_addr learned my addr 172.21.15.87:0/2769334158 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:13.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.955+0000 7f617dd9b640 1 --2- 172.21.15.87:0/2769334158 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564d8e713950 0x564d8e710730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.956+0000 7f617dd9b640 1 --2- 172.21.15.87:0/2769334158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564d8e708790 0x564d8e712f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.956+0000 7f617e59c640 1 -- 172.21.15.87:0/2769334158 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564d8e713950 msgr2=0x564d8e710730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:13.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.956+0000 7f617e59c640 1 --2- 172.21.15.87:0/2769334158 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564d8e713950 0x564d8e710730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.956+0000 7f617e59c640 1 -- 172.21.15.87:0/2769334158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564d8e708790 msgr2=0x564d8e712f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:13.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.956+0000 7f617e59c640 1 --2- 172.21.15.87:0/2769334158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564d8e708790 0x564d8e712f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.956+0000 7f617e59c640 1 -- 172.21.15.87:0/2769334158 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f618010c480 con 0x564d8e7090b0 2024-09-13T17:18:13.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.956+0000 7f617dd9b640 1 --2- 172.21.15.87:0/2769334158 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564d8e713950 0x564d8e710730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:13.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.956+0000 7f617e59c640 1 --2- 172.21.15.87:0/2769334158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d8e7090b0 0x564d8e7101f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f6170009900 tx=0x7f6170003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=328a8e8382fcff4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:13.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.956+0000 7f6165ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:18:13.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.956+0000 7f6165ffb640 1 -- 172.21.15.87:0/2769334158 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617004a070 con 0x564d8e7090b0 2024-09-13T17:18:13.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.956+0000 7f6165ffb640 1 -- 172.21.15.87:0/2769334158 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f6170031610 con 0x564d8e7090b0 2024-09-13T17:18:13.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.956+0000 7f6187c45740 1 -- 172.21.15.87:0/2769334158 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564d8e695b80 con 0x564d8e7090b0 2024-09-13T17:18:13.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.956+0000 7f6165ffb640 1 -- 172.21.15.87:0/2769334158 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61700317d0 con 0x564d8e7090b0 2024-09-13T17:18:13.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.956+0000 7f6187c45740 10 client.16851 fetch_fsmap learned FSMap version 30 2024-09-13T17:18:13.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.956+0000 7f6187c45740 1 -- 172.21.15.87:0/2769334158 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x564d8e66a3c0 con 0x564d8e7090b0 2024-09-13T17:18:13.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.956+0000 7f6165ffb640 1 -- 172.21.15.87:0/2769334158 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x564d8e695b80 con 0x564d8e7090b0 2024-09-13T17:18:13.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.956+0000 7f6165ffb640 1 -- 172.21.15.87:0/2769334158 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f617003c600 con 0x564d8e7090b0 2024-09-13T17:18:13.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.957+0000 7f6187c45740 10 client.16851 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:18:13.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.957+0000 7f6187c45740 10 client.16851 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:18:13.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.957+0000 7f6187c45740 20 client.16851 populate_metadata read hostname 'smithi087' 2024-09-13T17:18:13.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.957+0000 7f6187c45740 1 --2- 172.21.15.87:0/2769334158 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x564d8e722f60 0x564d8e725380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.957+0000 7f6187c45740 4 client.16851 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:18:13.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.957+0000 7f6187c45740 1 -- 172.21.15.87:0/2769334158 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564d8e65e1f0 con 0x564d8e722f60 2024-09-13T17:18:13.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.957+0000 7f617dd9b640 1 --2- 172.21.15.87:0/2769334158 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x564d8e722f60 0x564d8e725380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.957+0000 7f6165ffb640 10 client.16851 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:18:13.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.957+0000 7f617dd9b640 1 --2- 172.21.15.87:0/2769334158 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x564d8e722f60 0x564d8e725380 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=80e437e78a95ef2c server_cookie=423460ea70bd0c25 in_seq=0 out_seq=0 2024-09-13T17:18:13.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.958+0000 7f6165ffb640 1 -- 172.21.15.87:0/2769334158 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x564d8e65e1f0 con 0x564d8e722f60 2024-09-13T17:18:13.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.958+0000 7f6165ffb640 10 client.16851 handle_command_reply: tid=0 2024-09-13T17:18:13.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.958+0000 7f6187c45740 1 client.16851 shutdown 2024-09-13T17:18:13.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.958+0000 7f6187c45740 1 -- 172.21.15.87:0/2769334158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d8e7090b0 msgr2=0x564d8e7101f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:13.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.958+0000 7f6187c45740 1 --2- 172.21.15.87:0/2769334158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d8e7090b0 0x564d8e7101f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f6170009900 tx=0x7f6170003680 comp rx=0 tx=0).stop 2024-09-13T17:18:13.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.958+0000 7f6187c45740 1 -- 172.21.15.87:0/2769334158 shutdown_connections 2024-09-13T17:18:13.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.958+0000 7f6187c45740 1 --2- 172.21.15.87:0/2769334158 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x564d8e722f60 0x564d8e725380 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.958+0000 7f6187c45740 1 --2- 172.21.15.87:0/2769334158 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564d8e713950 0x564d8e710730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.958+0000 7f6187c45740 1 --2- 172.21.15.87:0/2769334158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d8e7090b0 0x564d8e7101f0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.958+0000 7f6165ffb640 0 client.16851 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:18:13.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.958+0000 7f6187c45740 1 --2- 172.21.15.87:0/2769334158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564d8e708790 0x564d8e712f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.958+0000 7f6187c45740 1 -- 172.21.15.87:0/2769334158 >> 172.21.15.87:0/2769334158 conn(0x564d8e704d00 msgr2=0x564d8e70aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:13.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.958+0000 7f6187c45740 1 -- 172.21.15.87:0/2769334158 shutdown_connections 2024-09-13T17:18:13.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.958+0000 7f6187c45740 1 -- 172.21.15.87:0/2769334158 wait complete. 2024-09-13T17:18:13.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.958+0000 7f6187c45740 20 client.16851 trim_cache size 0 max 16384 2024-09-13T17:18:13.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.969+0000 7f6187c45740 1 Processor -- start 2024-09-13T17:18:13.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.969+0000 7f6187c45740 1 -- start start 2024-09-13T17:18:13.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.969+0000 7f6187c45740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564d8e708790 0x564d8e7046a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.969+0000 7f6187c45740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564d8e7090b0 0x564d8e70eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.969+0000 7f6187c45740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d8e713950 0x564d8e70efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.969+0000 7f6187c45740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d8e716400 con 0x564d8e713950 2024-09-13T17:18:13.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.969+0000 7f6187c45740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d8e70f520 con 0x564d8e7090b0 2024-09-13T17:18:13.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.969+0000 7f6187c45740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d8e710ad0 con 0x564d8e708790 2024-09-13T17:18:13.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.969+0000 7f617dd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d8e713950 0x564d8e70efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.969+0000 7f617dd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d8e713950 0x564d8e70efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45522/0 (socket says 172.21.15.87:45522) 2024-09-13T17:18:13.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.969+0000 7f617dd9b640 1 -- 172.21.15.87:0/2598649369 learned_addr learned my addr 172.21.15.87:0/2598649369 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:13.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.969+0000 7f617dd9b640 1 -- 172.21.15.87:0/2598649369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564d8e708790 msgr2=0x564d8e7046a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:13.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.969+0000 7f617dd9b640 1 --2- 172.21.15.87:0/2598649369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564d8e708790 0x564d8e7046a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.969+0000 7f617dd9b640 1 -- 172.21.15.87:0/2598649369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564d8e7090b0 msgr2=0x564d8e70eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:13.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.969+0000 7f617dd9b640 1 --2- 172.21.15.87:0/2598649369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564d8e7090b0 0x564d8e70eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.970+0000 7f617dd9b640 1 -- 172.21.15.87:0/2598649369 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d8e60c770 con 0x564d8e713950 2024-09-13T17:18:13.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.970+0000 7f617dd9b640 1 --2- 172.21.15.87:0/2598649369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d8e713950 0x564d8e70efe0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f61801968f0 tx=0x7f617400a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a86bb1c5cbf3d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:13.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.970+0000 7f616d7fa640 1 -- 172.21.15.87:0/2598649369 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6174004020 con 0x564d8e713950 2024-09-13T17:18:13.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.970+0000 7f616d7fa640 1 -- 172.21.15.87:0/2598649369 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6174025070 con 0x564d8e713950 2024-09-13T17:18:13.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.970+0000 7f616d7fa640 1 -- 172.21.15.87:0/2598649369 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6174003a50 con 0x564d8e713950 2024-09-13T17:18:13.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.970+0000 7f6187c45740 1 -- 172.21.15.87:0/2598649369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d8e713950 msgr2=0x564d8e70efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:13.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.970+0000 7f6187c45740 1 --2- 172.21.15.87:0/2598649369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d8e713950 0x564d8e70efe0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f61801968f0 tx=0x7f617400a640 comp rx=0 tx=0).stop 2024-09-13T17:18:13.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.970+0000 7f6187c45740 1 -- 172.21.15.87:0/2598649369 shutdown_connections 2024-09-13T17:18:13.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.970+0000 7f6187c45740 1 --2- 172.21.15.87:0/2598649369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d8e713950 0x564d8e70efe0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.970+0000 7f6187c45740 1 --2- 172.21.15.87:0/2598649369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564d8e7090b0 0x564d8e70eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.970+0000 7f6187c45740 1 --2- 172.21.15.87:0/2598649369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564d8e708790 0x564d8e7046a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.970+0000 7f6187c45740 1 -- 172.21.15.87:0/2598649369 >> 172.21.15.87:0/2598649369 conn(0x564d8e704d00 msgr2=0x564d8e729d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:13.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.970+0000 7f6187c45740 1 -- 172.21.15.87:0/2598649369 shutdown_connections 2024-09-13T17:18:13.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.970+0000 7f6187c45740 1 -- 172.21.15.87:0/2598649369 wait complete. 2024-09-13T17:18:13.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.971+0000 7f6187c45740 1 -- start start 2024-09-13T17:18:13.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.971+0000 7f6187c45740 1 Processor -- start 2024-09-13T17:18:13.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.971+0000 7f6187c45740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d8e708790 0x564d8e71a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.971+0000 7f6187c45740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564d8e7090b0 0x564d8e718db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.971+0000 7f6187c45740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564d8e713950 0x564d8e7192f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.971+0000 7f6187c45740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d8e7199f0 con 0x564d8e708790 2024-09-13T17:18:13.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.971+0000 7f6187c45740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d8e719b60 con 0x564d8e713950 2024-09-13T17:18:13.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.971+0000 7f6187c45740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d8e779490 con 0x564d8e7090b0 2024-09-13T17:18:13.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.971+0000 7f6187c45740 10 client.0 _ll_register_callbacks cb 0x7f6170031a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:18:13.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.971+0000 7f617dd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d8e708790 0x564d8e71a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.971+0000 7f617dd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d8e708790 0x564d8e71a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45524/0 (socket says 172.21.15.87:45524) 2024-09-13T17:18:13.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.971+0000 7f617dd9b640 1 -- 172.21.15.87:0/3708070813 learned_addr learned my addr 172.21.15.87:0/3708070813 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:13.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.971+0000 7f617dd9b640 1 --2- 172.21.15.87:0/3708070813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564d8e713950 0x564d8e7192f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.971+0000 7f617e59c640 1 --2- 172.21.15.87:0/3708070813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564d8e7090b0 0x564d8e718db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.971+0000 7f617dd9b640 1 -- 172.21.15.87:0/3708070813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564d8e7090b0 msgr2=0x564d8e718db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:13.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.971+0000 7f617dd9b640 1 --2- 172.21.15.87:0/3708070813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564d8e7090b0 0x564d8e718db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.971+0000 7f617dd9b640 1 -- 172.21.15.87:0/3708070813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564d8e713950 msgr2=0x564d8e7192f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:13.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.971+0000 7f617dd9b640 1 --2- 172.21.15.87:0/3708070813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564d8e713950 0x564d8e7192f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.971+0000 7f617dd9b640 1 -- 172.21.15.87:0/3708070813 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6174019040 con 0x564d8e708790 2024-09-13T17:18:13.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.971+0000 7f617dd9b640 1 --2- 172.21.15.87:0/3708070813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d8e708790 0x564d8e71a940 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f61740036f0 tx=0x7f61740035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdac6467ab395fe0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:13.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.971+0000 7f6165ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:18:13.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.972+0000 7f6165ffb640 1 -- 172.21.15.87:0/3708070813 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61740214f0 con 0x564d8e708790 2024-09-13T17:18:13.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.972+0000 7f6165ffb640 1 -- 172.21.15.87:0/3708070813 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f6174000e40 con 0x564d8e708790 2024-09-13T17:18:13.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.972+0000 7f6187c45740 1 -- 172.21.15.87:0/3708070813 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6170040070 con 0x564d8e708790 2024-09-13T17:18:13.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.972+0000 7f6165ffb640 1 -- 172.21.15.87:0/3708070813 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6174021650 con 0x564d8e708790 2024-09-13T17:18:13.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.972+0000 7f6187c45740 10 client.16857 fetch_fsmap learned FSMap version 30 2024-09-13T17:18:13.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.972+0000 7f6187c45740 1 -- 172.21.15.87:0/3708070813 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x564d8e631e80 con 0x564d8e708790 2024-09-13T17:18:13.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.972+0000 7f6165ffb640 1 -- 172.21.15.87:0/3708070813 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6170040070 con 0x564d8e708790 2024-09-13T17:18:13.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.972+0000 7f6165ffb640 1 -- 172.21.15.87:0/3708070813 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f617402a630 con 0x564d8e708790 2024-09-13T17:18:13.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.972+0000 7f6187c45740 10 client.16857 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:18:13.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.972+0000 7f6187c45740 10 client.16857 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:18:13.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.972+0000 7f6187c45740 20 client.16857 populate_metadata read hostname 'smithi087' 2024-09-13T17:18:13.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.972+0000 7f6187c45740 1 --2- 172.21.15.87:0/3708070813 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x564d8e722f60 0x564d8e77ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:13.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.972+0000 7f6187c45740 4 client.16857 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:18:13.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.972+0000 7f6187c45740 1 -- 172.21.15.87:0/3708070813 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564d8e35f4e0 con 0x564d8e722f60 2024-09-13T17:18:13.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.972+0000 7f617e59c640 1 --2- 172.21.15.87:0/3708070813 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x564d8e722f60 0x564d8e77ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:13.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.973+0000 7f6165ffb640 10 client.16857 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:18:13.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.973+0000 7f617e59c640 1 --2- 172.21.15.87:0/3708070813 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x564d8e722f60 0x564d8e77ca40 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ef89ea20d0b05862 server_cookie=f0537645ada9893d in_seq=0 out_seq=0 2024-09-13T17:18:13.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.973+0000 7f6165ffb640 1 -- 172.21.15.87:0/3708070813 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564d8e35f4e0 con 0x564d8e722f60 2024-09-13T17:18:13.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.973+0000 7f6165ffb640 10 client.16857 handle_command_reply: tid=0 2024-09-13T17:18:13.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.973+0000 7f6187c45740 1 client.16857 shutdown 2024-09-13T17:18:13.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.973+0000 7f6187c45740 1 -- 172.21.15.87:0/3708070813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d8e708790 msgr2=0x564d8e71a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:13.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.973+0000 7f6187c45740 1 --2- 172.21.15.87:0/3708070813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d8e708790 0x564d8e71a940 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f61740036f0 tx=0x7f61740035f0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.973+0000 7f6187c45740 1 -- 172.21.15.87:0/3708070813 shutdown_connections 2024-09-13T17:18:13.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.973+0000 7f6187c45740 1 --2- 172.21.15.87:0/3708070813 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x564d8e722f60 0x564d8e77ca40 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.973+0000 7f6187c45740 1 --2- 172.21.15.87:0/3708070813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564d8e713950 0x564d8e7192f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.973+0000 7f6165ffb640 0 client.16857 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:18:13.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.973+0000 7f6187c45740 1 --2- 172.21.15.87:0/3708070813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564d8e7090b0 0x564d8e718db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.973+0000 7f6187c45740 1 --2- 172.21.15.87:0/3708070813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d8e708790 0x564d8e71a940 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.973+0000 7f6187c45740 1 -- 172.21.15.87:0/3708070813 >> 172.21.15.87:0/3708070813 conn(0x564d8e704d00 msgr2=0x564d8e70e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:13.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.973+0000 7f6187c45740 1 -- 172.21.15.87:0/3708070813 shutdown_connections 2024-09-13T17:18:13.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.973+0000 7f6187c45740 1 -- 172.21.15.87:0/3708070813 wait complete. 2024-09-13T17:18:13.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.973+0000 7f6187c45740 20 client.16857 trim_cache size 0 max 16384 2024-09-13T17:18:13.990 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:18:13.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.974+0000 7f6184e41640 1 -- 172.21.15.87:0/85968021 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f61680a1200 msgr2=0x7f61680a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:13.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.974+0000 7f6184e41640 1 --2- 172.21.15.87:0/85968021 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f61680a1200 0x7f61680a36c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f61780cb7d0 tx=0x7f617806e320 comp rx=0 tx=0).stop 2024-09-13T17:18:13.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.974+0000 7f6184e41640 1 -- 172.21.15.87:0/85968021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6180199c80 msgr2=0x7f618019a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:13.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.974+0000 7f6184e41640 1 --2- 172.21.15.87:0/85968021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6180199c80 0x7f618019a130 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f617800ebb0 tx=0x7f6178007590 comp rx=0 tx=0).stop 2024-09-13T17:18:13.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.974+0000 7f6184e41640 1 -- 172.21.15.87:0/85968021 shutdown_connections 2024-09-13T17:18:13.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.974+0000 7f6184e41640 1 --2- 172.21.15.87:0/85968021 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f61680a1200 0x7f61680a36c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.974+0000 7f6184e41640 1 --2- 172.21.15.87:0/85968021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6180199c80 0x7f618019a130 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.974+0000 7f6184e41640 1 --2- 172.21.15.87:0/85968021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61801051d0 0x7f6180195890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.974+0000 7f6184e41640 1 --2- 172.21.15.87:0/85968021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61800ffc90 0x7f6180195350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:13.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.974+0000 7f6184e41640 1 -- 172.21.15.87:0/85968021 >> 172.21.15.87:0/85968021 conn(0x7f6180074110 msgr2=0x7f6180102d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:13.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.974+0000 7f6184e41640 1 -- 172.21.15.87:0/85968021 shutdown_connections 2024-09-13T17:18:13.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:13.974+0000 7f6184e41640 1 -- 172.21.15.87:0/85968021 wait complete. 2024-09-13T17:18:13.993 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-09-13T17:18:14.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.091+0000 7fa2c7473640 1 -- 172.21.15.87:0/3243447985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2c01050a0 msgr2=0x7fa2c010cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:14.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.091+0000 7fa2c7473640 1 --2- 172.21.15.87:0/3243447985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2c01050a0 0x7fa2c010cbf0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8009cd0 tx=0x7fa2b802a8e0 comp rx=0 tx=0).stop 2024-09-13T17:18:14.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.091+0000 7fa2c7473640 1 -- 172.21.15.87:0/3243447985 shutdown_connections 2024-09-13T17:18:14.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.091+0000 7fa2c7473640 1 --2- 172.21.15.87:0/3243447985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2c01050a0 0x7fa2c010cbf0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:14.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.091+0000 7fa2c7473640 1 --2- 172.21.15.87:0/3243447985 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2c0100900 0x7fa2c0104940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:14.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.091+0000 7fa2c7473640 1 --2- 172.21.15.87:0/3243447985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2c00fff50 0x7fa2c0100330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:14.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.091+0000 7fa2c7473640 1 -- 172.21.15.87:0/3243447985 >> 172.21.15.87:0/3243447985 conn(0x7fa2c00fb9e0 msgr2=0x7fa2c00fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:14.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.091+0000 7fa2c7473640 1 -- 172.21.15.87:0/3243447985 shutdown_connections 2024-09-13T17:18:14.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.091+0000 7fa2c7473640 1 -- 172.21.15.87:0/3243447985 wait complete. 2024-09-13T17:18:14.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.092+0000 7fa2c7473640 1 Processor -- start 2024-09-13T17:18:14.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.092+0000 7fa2c7473640 1 -- start start 2024-09-13T17:18:14.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.092+0000 7fa2c7473640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2c00fff50 0x7fa2c01962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:14.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.092+0000 7fa2c7473640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2c01050a0 0x7fa2c0196800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:14.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.092+0000 7fa2c7473640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2c019abf0 0x7fa2c019b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:14.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.092+0000 7fa2c7473640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c019b5e0 con 0x7fa2c019abf0 2024-09-13T17:18:14.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.092+0000 7fa2c7473640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c019b750 con 0x7fa2c00fff50 2024-09-13T17:18:14.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.092+0000 7fa2c7473640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c019b8c0 con 0x7fa2c01050a0 2024-09-13T17:18:14.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.092+0000 7fa2c5a10640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2c019abf0 0x7fa2c019b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:14.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.092+0000 7fa2c5a10640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2c019abf0 0x7fa2c019b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45550/0 (socket says 172.21.15.87:45550) 2024-09-13T17:18:14.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.092+0000 7fa2c5a10640 1 -- 172.21.15.87:0/419026388 learned_addr learned my addr 172.21.15.87:0/419026388 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:14.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.092+0000 7fa2c4a0e640 1 --2- 172.21.15.87:0/419026388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2c01050a0 0x7fa2c0196800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:14.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.092+0000 7fa2c520f640 1 --2- 172.21.15.87:0/419026388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2c00fff50 0x7fa2c01962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:14.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.092+0000 7fa2c5a10640 1 -- 172.21.15.87:0/419026388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2c01050a0 msgr2=0x7fa2c0196800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:14.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.092+0000 7fa2c5a10640 1 --2- 172.21.15.87:0/419026388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2c01050a0 0x7fa2c0196800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:14.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.092+0000 7fa2c5a10640 1 -- 172.21.15.87:0/419026388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2c00fff50 msgr2=0x7fa2c01962c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:14.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.092+0000 7fa2c5a10640 1 --2- 172.21.15.87:0/419026388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2c00fff50 0x7fa2c01962c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:14.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.092+0000 7fa2c5a10640 1 -- 172.21.15.87:0/419026388 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b8009900 con 0x7fa2c019abf0 2024-09-13T17:18:14.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.092+0000 7fa2c4a0e640 1 --2- 172.21.15.87:0/419026388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2c01050a0 0x7fa2c0196800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:14.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.092+0000 7fa2c520f640 1 --2- 172.21.15.87:0/419026388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2c00fff50 0x7fa2c01962c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:14.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.092+0000 7fa2c5a10640 1 --2- 172.21.15.87:0/419026388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2c019abf0 0x7fa2c019b0a0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8005cc0 tx=0x7fa2b8030850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:14.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.093+0000 7fa2b67fc640 1 -- 172.21.15.87:0/419026388 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b8031d00 con 0x7fa2c019abf0 2024-09-13T17:18:14.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.093+0000 7fa2b67fc640 1 -- 172.21.15.87:0/419026388 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa2b8003e20 con 0x7fa2c019abf0 2024-09-13T17:18:14.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.093+0000 7fa2c7473640 1 -- 172.21.15.87:0/419026388 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2c01a2ea0 con 0x7fa2c019abf0 2024-09-13T17:18:14.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.093+0000 7fa2b67fc640 1 -- 172.21.15.87:0/419026388 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b8045410 con 0x7fa2c019abf0 2024-09-13T17:18:14.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.093+0000 7fa2c7473640 1 -- 172.21.15.87:0/419026388 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2c01a3320 con 0x7fa2c019abf0 2024-09-13T17:18:14.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.095+0000 7fa2b67fc640 1 -- 172.21.15.87:0/419026388 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fa2b800a040 con 0x7fa2c019abf0 2024-09-13T17:18:14.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.095+0000 7fa2ca266740 1 Processor -- start 2024-09-13T17:18:14.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.095+0000 7fa2ca266740 1 -- start start 2024-09-13T17:18:14.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.095+0000 7fa2ca266740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bea413dba0 0x55bea413df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:14.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.095+0000 7fa2ca266740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bea413e4c0 0x55bea4148820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:14.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.095+0000 7fa2ca266740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bea4148d60 0x55bea414b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:14.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.095+0000 7fa2ca266740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea40a3cc0 con 0x55bea413dba0 2024-09-13T17:18:14.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.095+0000 7fa2ca266740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea40a1450 con 0x55bea413e4c0 2024-09-13T17:18:14.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.095+0000 7fa2ca266740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea409cd40 con 0x55bea4148d60 2024-09-13T17:18:14.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.096+0000 7fa2b67fc640 1 --2- 172.21.15.87:0/419026388 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa2ac0a1200 0x7fa2ac0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:14.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.096+0000 7fa2c4a0e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bea413dba0 0x55bea413df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:14.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.096+0000 7fa2c4a0e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bea413dba0 0x55bea413df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45560/0 (socket says 172.21.15.87:45560) 2024-09-13T17:18:14.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.096+0000 7fa2c4a0e640 1 -- 172.21.15.87:0/352509313 learned_addr learned my addr 172.21.15.87:0/352509313 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:14.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.096+0000 7fa2c5a10640 1 --2- 172.21.15.87:0/419026388 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa2ac0a1200 0x7fa2ac0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:14.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.096+0000 7fa2c520f640 1 --2- 172.21.15.87:0/352509313 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bea413e4c0 0x55bea4148820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:14.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.096+0000 7fa2c4a0e640 1 --2- 172.21.15.87:0/352509313 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bea4148d60 0x55bea414b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:14.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.096+0000 7fa2b67fc640 1 -- 172.21.15.87:0/419026388 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fa2b80ee920 con 0x7fa2c019abf0 2024-09-13T17:18:14.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.096+0000 7fa2c4a0e640 1 -- 172.21.15.87:0/352509313 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bea4148d60 msgr2=0x55bea414b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:14.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.096+0000 7fa2c4a0e640 1 --2- 172.21.15.87:0/352509313 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bea4148d60 0x55bea414b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:14.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.096+0000 7fa2c4a0e640 1 -- 172.21.15.87:0/352509313 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bea413e4c0 msgr2=0x55bea4148820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:14.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.096+0000 7fa2c4a0e640 1 --2- 172.21.15.87:0/352509313 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bea413e4c0 0x55bea4148820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:14.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.096+0000 7fa2c4a0e640 1 -- 172.21.15.87:0/352509313 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bea4064620 con 0x55bea413dba0 2024-09-13T17:18:14.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.096+0000 7fa2c4a0e640 1 --2- 172.21.15.87:0/352509313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bea413dba0 0x55bea413df80 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0007e80 tx=0x7fa2b00073e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f0152cbc3ce1a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:14.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.096+0000 7fa2c5a10640 1 --2- 172.21.15.87:0/419026388 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa2ac0a1200 0x7fa2ac0a36c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa2b80ebd70 tx=0x7fa2b80a6040 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:14.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.096+0000 7fa2ab7fe640 1 -- 172.21.15.87:0/352509313 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b0017600 con 0x55bea413dba0 2024-09-13T17:18:14.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.096+0000 7fa2ab7fe640 1 -- 172.21.15.87:0/352509313 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa2b000fe60 con 0x55bea413dba0 2024-09-13T17:18:14.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.096+0000 7fa2ab7fe640 1 -- 172.21.15.87:0/352509313 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b00148a0 con 0x55bea413dba0 2024-09-13T17:18:14.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.097+0000 7fa2ca266740 1 -- 172.21.15.87:0/352509313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bea413dba0 msgr2=0x55bea413df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:14.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.097+0000 7fa2ca266740 1 --2- 172.21.15.87:0/352509313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bea413dba0 0x55bea413df80 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0007e80 tx=0x7fa2b00073e0 comp rx=0 tx=0).stop 2024-09-13T17:18:14.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.097+0000 7fa2ca266740 1 -- 172.21.15.87:0/352509313 shutdown_connections 2024-09-13T17:18:14.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.097+0000 7fa2ca266740 1 --2- 172.21.15.87:0/352509313 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bea4148d60 0x55bea414b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:14.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.097+0000 7fa2ca266740 1 --2- 172.21.15.87:0/352509313 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bea413e4c0 0x55bea4148820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:14.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.097+0000 7fa2ca266740 1 --2- 172.21.15.87:0/352509313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bea413dba0 0x55bea413df80 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:14.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.097+0000 7fa2ca266740 1 -- 172.21.15.87:0/352509313 >> 172.21.15.87:0/352509313 conn(0x55bea413a110 msgr2=0x55bea413a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:14.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.097+0000 7fa2ca266740 1 -- 172.21.15.87:0/352509313 shutdown_connections 2024-09-13T17:18:14.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.097+0000 7fa2ca266740 1 -- 172.21.15.87:0/352509313 wait complete. 2024-09-13T17:18:14.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.097+0000 7fa2ca266740 1 -- start start 2024-09-13T17:18:14.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.097+0000 7fa2ca266740 1 Processor -- start 2024-09-13T17:18:14.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.098+0000 7fa2ca266740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bea413dba0 0x55bea4148360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:14.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.098+0000 7fa2ca266740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bea413e4c0 0x55bea41457a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:14.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.098+0000 7fa2ca266740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bea4148d60 0x55bea4145ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:14.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.098+0000 7fa2ca266740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea405b180 con 0x55bea413e4c0 2024-09-13T17:18:14.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.098+0000 7fa2ca266740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea3d75430 con 0x55bea413dba0 2024-09-13T17:18:14.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.098+0000 7fa2ca266740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea40205e0 con 0x55bea4148d60 2024-09-13T17:18:14.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.098+0000 7fa2ca266740 10 client.0 _ll_register_callbacks cb 0x55bea408caa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:18:14.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.098+0000 7fa2c520f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bea413e4c0 0x55bea41457a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:14.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.098+0000 7fa2c520f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bea413e4c0 0x55bea41457a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45574/0 (socket says 172.21.15.87:45574) 2024-09-13T17:18:14.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.098+0000 7fa2c520f640 1 -- 172.21.15.87:0/532765366 learned_addr learned my addr 172.21.15.87:0/532765366 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:14.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.098+0000 7fa2c4a0e640 1 --2- 172.21.15.87:0/532765366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bea413dba0 0x55bea4148360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:14.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.098+0000 7fa2c4a0e640 1 --2- 172.21.15.87:0/532765366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bea4148d60 0x55bea4145ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:14.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.098+0000 7fa2c520f640 1 -- 172.21.15.87:0/532765366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bea4148d60 msgr2=0x55bea4145ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:14.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.098+0000 7fa2c520f640 1 --2- 172.21.15.87:0/532765366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bea4148d60 0x55bea4145ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:14.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.098+0000 7fa2c520f640 1 -- 172.21.15.87:0/532765366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bea413dba0 msgr2=0x55bea4148360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:14.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.098+0000 7fa2c520f640 1 --2- 172.21.15.87:0/532765366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bea413dba0 0x55bea4148360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:14.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.098+0000 7fa2c520f640 1 -- 172.21.15.87:0/532765366 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2b0007a80 con 0x55bea413e4c0 2024-09-13T17:18:14.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.098+0000 7fa2c4a0e640 1 --2- 172.21.15.87:0/532765366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bea4148d60 0x55bea4145ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:14.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.098+0000 7fa2c520f640 1 --2- 172.21.15.87:0/532765366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bea413e4c0 0x55bea41457a0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc009fc0 tx=0x7fa2bc011870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d8bd002f5dd0002 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:14.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.098+0000 7fa2a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:18:14.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.099+0000 7fa2a8ff9640 1 -- 172.21.15.87:0/532765366 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc012920 con 0x55bea413e4c0 2024-09-13T17:18:14.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.099+0000 7fa2a8ff9640 1 -- 172.21.15.87:0/532765366 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fa2bc012a80 con 0x55bea413e4c0 2024-09-13T17:18:14.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.099+0000 7fa2ca266740 1 -- 172.21.15.87:0/532765366 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bea40c6b80 con 0x55bea413e4c0 2024-09-13T17:18:14.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.099+0000 7fa2a8ff9640 1 -- 172.21.15.87:0/532765366 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2bc012c40 con 0x55bea413e4c0 2024-09-13T17:18:14.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.099+0000 7fa2ca266740 10 client.16869 fetch_fsmap learned FSMap version 30 2024-09-13T17:18:14.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.099+0000 7fa2ca266740 1 -- 172.21.15.87:0/532765366 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55bea409b3c0 con 0x55bea413e4c0 2024-09-13T17:18:14.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.099+0000 7fa2a8ff9640 1 -- 172.21.15.87:0/532765366 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55bea40c6b80 con 0x55bea413e4c0 2024-09-13T17:18:14.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.099+0000 7fa2a8ff9640 1 -- 172.21.15.87:0/532765366 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fa2bc00c070 con 0x55bea413e4c0 2024-09-13T17:18:14.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.099+0000 7fa2ca266740 10 client.16869 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:18:14.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.099+0000 7fa2ca266740 10 client.16869 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:18:14.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.099+0000 7fa2ca266740 20 client.16869 populate_metadata read hostname 'smithi087' 2024-09-13T17:18:14.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.099+0000 7fa2ca266740 1 --2- 172.21.15.87:0/532765366 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55bea41587d0 0x55bea415abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:14.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.099+0000 7fa2ca266740 4 client.16869 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:18:14.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.099+0000 7fa2ca266740 1 -- 172.21.15.87:0/532765366 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bea408f1f0 con 0x55bea41587d0 2024-09-13T17:18:14.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.099+0000 7fa2c4a0e640 1 --2- 172.21.15.87:0/532765366 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55bea41587d0 0x55bea415abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:14.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.100+0000 7fa2a8ff9640 10 client.16869 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:18:14.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.100+0000 7fa2c4a0e640 1 --2- 172.21.15.87:0/532765366 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55bea41587d0 0x55bea415abf0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28218546c0e44657 server_cookie=282ce2b794fe1c0d in_seq=0 out_seq=0 2024-09-13T17:18:14.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.100+0000 7fa2a8ff9640 1 -- 172.21.15.87:0/532765366 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55bea408f1f0 con 0x55bea41587d0 2024-09-13T17:18:14.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.100+0000 7fa2a8ff9640 10 client.16869 handle_command_reply: tid=0 2024-09-13T17:18:14.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.100+0000 7fa2ca266740 1 client.16869 shutdown 2024-09-13T17:18:14.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.100+0000 7fa2ca266740 1 -- 172.21.15.87:0/532765366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bea413e4c0 msgr2=0x55bea41457a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:14.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.101+0000 7fa2ca266740 1 --2- 172.21.15.87:0/532765366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bea413e4c0 0x55bea41457a0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc009fc0 tx=0x7fa2bc011870 comp rx=0 tx=0).stop 2024-09-13T17:18:14.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.101+0000 7fa2ca266740 1 -- 172.21.15.87:0/532765366 shutdown_connections 2024-09-13T17:18:14.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.101+0000 7fa2ca266740 1 --2- 172.21.15.87:0/532765366 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55bea41587d0 0x55bea415abf0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:14.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.101+0000 7fa2ca266740 1 --2- 172.21.15.87:0/532765366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bea4148d60 0x55bea4145ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:14.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.101+0000 7fa2a8ff9640 0 client.16869 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:18:14.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.101+0000 7fa2ca266740 1 --2- 172.21.15.87:0/532765366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bea413e4c0 0x55bea41457a0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:14.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.101+0000 7fa2ca266740 1 --2- 172.21.15.87:0/532765366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bea413dba0 0x55bea4148360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:14.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.101+0000 7fa2ca266740 1 -- 172.21.15.87:0/532765366 >> 172.21.15.87:0/532765366 conn(0x55bea413a110 msgr2=0x55bea413fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:14.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.101+0000 7fa2ca266740 1 -- 172.21.15.87:0/532765366 shutdown_connections 2024-09-13T17:18:14.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.101+0000 7fa2ca266740 1 -- 172.21.15.87:0/532765366 wait complete. 2024-09-13T17:18:14.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.101+0000 7fa2ca266740 20 client.16869 trim_cache size 0 max 16384 2024-09-13T17:18:14.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.112+0000 7fa2ca266740 1 Processor -- start 2024-09-13T17:18:14.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.112+0000 7fa2ca266740 1 -- start start 2024-09-13T17:18:14.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.112+0000 7fa2ca266740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bea413dba0 0x55bea414b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:14.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.112+0000 7fa2ca266740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bea413e4c0 0x55bea4145020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:14.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.112+0000 7fa2ca266740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bea4148d60 0x55bea415f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:14.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.112+0000 7fa2ca266740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea41468b0 con 0x55bea413e4c0 2024-09-13T17:18:14.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.112+0000 7fa2ca266740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea4145560 con 0x55bea413dba0 2024-09-13T17:18:14.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.112+0000 7fa2ca266740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea4139ae0 con 0x55bea4148d60 2024-09-13T17:18:14.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.112+0000 7fa2c520f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bea413e4c0 0x55bea4145020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:14.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.112+0000 7fa2c520f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bea413e4c0 0x55bea4145020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45576/0 (socket says 172.21.15.87:45576) 2024-09-13T17:18:14.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.112+0000 7fa2c520f640 1 -- 172.21.15.87:0/542794088 learned_addr learned my addr 172.21.15.87:0/542794088 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:14.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.112+0000 7fa2c520f640 1 -- 172.21.15.87:0/542794088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bea4148d60 msgr2=0x55bea415f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:14.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.112+0000 7fa2c520f640 1 --2- 172.21.15.87:0/542794088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bea4148d60 0x55bea415f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:14.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.112+0000 7fa2c520f640 1 -- 172.21.15.87:0/542794088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bea413dba0 msgr2=0x55bea414b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:14.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.112+0000 7fa2c520f640 1 --2- 172.21.15.87:0/542794088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bea413dba0 0x55bea414b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:14.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.112+0000 7fa2c520f640 1 -- 172.21.15.87:0/542794088 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bea403d770 con 0x55bea413e4c0 2024-09-13T17:18:14.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.112+0000 7fa2c520f640 1 --2- 172.21.15.87:0/542794088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bea413e4c0 0x55bea4145020 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc0193f0 tx=0x7fa2bc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a177827d545461f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:14.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.112+0000 7fa2abfff640 1 -- 172.21.15.87:0/542794088 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc011d70 con 0x55bea413e4c0 2024-09-13T17:18:14.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.113+0000 7fa2abfff640 1 -- 172.21.15.87:0/542794088 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa2bc019660 con 0x55bea413e4c0 2024-09-13T17:18:14.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.113+0000 7fa2abfff640 1 -- 172.21.15.87:0/542794088 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc012720 con 0x55bea413e4c0 2024-09-13T17:18:14.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.113+0000 7fa2ca266740 1 -- 172.21.15.87:0/542794088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bea413e4c0 msgr2=0x55bea4145020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:14.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.113+0000 7fa2ca266740 1 --2- 172.21.15.87:0/542794088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bea413e4c0 0x55bea4145020 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc0193f0 tx=0x7fa2bc009bb0 comp rx=0 tx=0).stop 2024-09-13T17:18:14.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.113+0000 7fa2ca266740 1 -- 172.21.15.87:0/542794088 shutdown_connections 2024-09-13T17:18:14.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.113+0000 7fa2ca266740 1 --2- 172.21.15.87:0/542794088 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bea4148d60 0x55bea415f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:14.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.113+0000 7fa2ca266740 1 --2- 172.21.15.87:0/542794088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bea413e4c0 0x55bea4145020 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:14.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.113+0000 7fa2ca266740 1 --2- 172.21.15.87:0/542794088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bea413dba0 0x55bea414b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:14.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.113+0000 7fa2ca266740 1 -- 172.21.15.87:0/542794088 >> 172.21.15.87:0/542794088 conn(0x55bea413a110 msgr2=0x55bea4148150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:14.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.113+0000 7fa2ca266740 1 -- 172.21.15.87:0/542794088 shutdown_connections 2024-09-13T17:18:14.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.113+0000 7fa2ca266740 1 -- 172.21.15.87:0/542794088 wait complete. 2024-09-13T17:18:14.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.113+0000 7fa2ca266740 1 -- start start 2024-09-13T17:18:14.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.113+0000 7fa2ca266740 1 Processor -- start 2024-09-13T17:18:14.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.114+0000 7fa2ca266740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bea413dba0 0x55bea414c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:14.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.114+0000 7fa2ca266740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bea413e4c0 0x55bea414c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:14.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.114+0000 7fa2ca266740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bea4148d60 0x55bea414f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:14.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.114+0000 7fa2ca266740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea414f8f0 con 0x55bea413e4c0 2024-09-13T17:18:14.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.114+0000 7fa2ca266740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea414fa60 con 0x55bea413dba0 2024-09-13T17:18:14.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.114+0000 7fa2ca266740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea414fc20 con 0x55bea4148d60 2024-09-13T17:18:14.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.114+0000 7fa2ca266740 10 client.0 _ll_register_callbacks cb 0x7fa2b0007240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:18:14.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.114+0000 7fa2c520f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bea413e4c0 0x55bea414c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:14.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.114+0000 7fa2c520f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bea413e4c0 0x55bea414c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45584/0 (socket says 172.21.15.87:45584) 2024-09-13T17:18:14.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.114+0000 7fa2c520f640 1 -- 172.21.15.87:0/279281253 learned_addr learned my addr 172.21.15.87:0/279281253 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:14.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.114+0000 7fa2c4a0e640 1 --2- 172.21.15.87:0/279281253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bea413dba0 0x55bea414c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:14.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.114+0000 7fa2c4a0e640 1 --2- 172.21.15.87:0/279281253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bea4148d60 0x55bea414f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:14.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.114+0000 7fa2c520f640 1 -- 172.21.15.87:0/279281253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bea4148d60 msgr2=0x55bea414f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:14.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.114+0000 7fa2c520f640 1 --2- 172.21.15.87:0/279281253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bea4148d60 0x55bea414f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:14.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.114+0000 7fa2c520f640 1 -- 172.21.15.87:0/279281253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bea413dba0 msgr2=0x55bea414c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:14.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.114+0000 7fa2c520f640 1 --2- 172.21.15.87:0/279281253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bea413dba0 0x55bea414c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:14.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.114+0000 7fa2c520f640 1 -- 172.21.15.87:0/279281253 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bea409b3c0 con 0x55bea413e4c0 2024-09-13T17:18:14.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.114+0000 7fa2c4a0e640 1 --2- 172.21.15.87:0/279281253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bea4148d60 0x55bea414f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:14.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.114+0000 7fa2c520f640 1 --2- 172.21.15.87:0/279281253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bea413e4c0 0x55bea414c550 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc009580 tx=0x7fa2bc011eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e098e8df2c2bfe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:14.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.114+0000 7fa2a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:18:14.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.115+0000 7fa2a8ff9640 1 -- 172.21.15.87:0/279281253 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc038070 con 0x55bea413e4c0 2024-09-13T17:18:14.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.115+0000 7fa2ca266740 1 -- 172.21.15.87:0/279281253 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa2b000fe60 con 0x55bea413e4c0 2024-09-13T17:18:14.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.115+0000 7fa2a8ff9640 1 -- 172.21.15.87:0/279281253 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fa2bc019b70 con 0x55bea413e4c0 2024-09-13T17:18:14.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.115+0000 7fa2a8ff9640 1 -- 172.21.15.87:0/279281253 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2bc019d30 con 0x55bea413e4c0 2024-09-13T17:18:14.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.115+0000 7fa2ca266740 10 client.16875 fetch_fsmap learned FSMap version 30 2024-09-13T17:18:14.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.115+0000 7fa2ca266740 1 -- 172.21.15.87:0/279281253 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55bea4062e80 con 0x55bea413e4c0 2024-09-13T17:18:14.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.115+0000 7fa2a8ff9640 1 -- 172.21.15.87:0/279281253 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa2b000fe60 con 0x55bea413e4c0 2024-09-13T17:18:14.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.115+0000 7fa2a8ff9640 1 -- 172.21.15.87:0/279281253 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fa2bc00c070 con 0x55bea413e4c0 2024-09-13T17:18:14.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.115+0000 7fa2ca266740 10 client.16875 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:18:14.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.115+0000 7fa2ca266740 10 client.16875 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:18:14.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.115+0000 7fa2ca266740 20 client.16875 populate_metadata read hostname 'smithi087' 2024-09-13T17:18:14.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.115+0000 7fa2ca266740 1 --2- 172.21.15.87:0/279281253 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55bea41af970 0x55bea41b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:14.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.115+0000 7fa2ca266740 4 client.16875 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:18:14.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.115+0000 7fa2ca266740 1 -- 172.21.15.87:0/279281253 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55bea3d904e0 con 0x55bea41af970 2024-09-13T17:18:14.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.115+0000 7fa2c4a0e640 1 --2- 172.21.15.87:0/279281253 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55bea41af970 0x55bea41b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:14.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.116+0000 7fa2c4a0e640 1 --2- 172.21.15.87:0/279281253 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55bea41af970 0x55bea41b1d90 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e653dad57d45ff4 server_cookie=569ef4d8e13f312d in_seq=0 out_seq=0 2024-09-13T17:18:14.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.116+0000 7fa2a8ff9640 10 client.16875 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:18:14.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.116+0000 7fa2a8ff9640 1 -- 172.21.15.87:0/279281253 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55bea3d904e0 con 0x55bea41af970 2024-09-13T17:18:14.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.116+0000 7fa2a8ff9640 10 client.16875 handle_command_reply: tid=0 2024-09-13T17:18:14.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.116+0000 7fa2ca266740 1 client.16875 shutdown 2024-09-13T17:18:14.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.116+0000 7fa2ca266740 1 -- 172.21.15.87:0/279281253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bea413e4c0 msgr2=0x55bea414c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:14.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.116+0000 7fa2ca266740 1 --2- 172.21.15.87:0/279281253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bea413e4c0 0x55bea414c550 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc009580 tx=0x7fa2bc011eb0 comp rx=0 tx=0).stop 2024-09-13T17:18:14.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.116+0000 7fa2ca266740 1 -- 172.21.15.87:0/279281253 shutdown_connections 2024-09-13T17:18:14.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.116+0000 7fa2ca266740 1 --2- 172.21.15.87:0/279281253 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55bea41af970 0x55bea41b1d90 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:14.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.116+0000 7fa2ca266740 1 --2- 172.21.15.87:0/279281253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bea4148d60 0x55bea414f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:14.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.116+0000 7fa2a8ff9640 0 client.16875 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:18:14.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.116+0000 7fa2ca266740 1 --2- 172.21.15.87:0/279281253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bea413e4c0 0x55bea414c550 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:14.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.116+0000 7fa2ca266740 1 --2- 172.21.15.87:0/279281253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bea413dba0 0x55bea414c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:14.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.116+0000 7fa2ca266740 1 -- 172.21.15.87:0/279281253 >> 172.21.15.87:0/279281253 conn(0x55bea413a110 msgr2=0x55bea415f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:14.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.116+0000 7fa2ca266740 1 -- 172.21.15.87:0/279281253 shutdown_connections 2024-09-13T17:18:14.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.116+0000 7fa2ca266740 1 -- 172.21.15.87:0/279281253 wait complete. 2024-09-13T17:18:14.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.116+0000 7fa2ca266740 20 client.16875 trim_cache size 0 max 16384 2024-09-13T17:18:14.131 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:18:14.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.117+0000 7fa2c7473640 1 -- 172.21.15.87:0/419026388 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa2ac0a1200 msgr2=0x7fa2ac0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:14.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.117+0000 7fa2c7473640 1 --2- 172.21.15.87:0/419026388 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa2ac0a1200 0x7fa2ac0a36c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa2b80ebd70 tx=0x7fa2b80a6040 comp rx=0 tx=0).stop 2024-09-13T17:18:14.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.117+0000 7fa2c7473640 1 -- 172.21.15.87:0/419026388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2c019abf0 msgr2=0x7fa2c019b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:14.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.117+0000 7fa2c7473640 1 --2- 172.21.15.87:0/419026388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2c019abf0 0x7fa2c019b0a0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8005cc0 tx=0x7fa2b8030850 comp rx=0 tx=0).stop 2024-09-13T17:18:14.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.117+0000 7fa2c7473640 1 -- 172.21.15.87:0/419026388 shutdown_connections 2024-09-13T17:18:14.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.117+0000 7fa2c7473640 1 --2- 172.21.15.87:0/419026388 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa2ac0a1200 0x7fa2ac0a36c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:14.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.117+0000 7fa2c7473640 1 --2- 172.21.15.87:0/419026388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2c019abf0 0x7fa2c019b0a0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:14.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.117+0000 7fa2c7473640 1 --2- 172.21.15.87:0/419026388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2c01050a0 0x7fa2c0196800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:14.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.117+0000 7fa2c7473640 1 --2- 172.21.15.87:0/419026388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa2c00fff50 0x7fa2c01962c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:14.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.117+0000 7fa2c7473640 1 -- 172.21.15.87:0/419026388 >> 172.21.15.87:0/419026388 conn(0x7fa2c00fb9e0 msgr2=0x7fa2c00fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:14.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.117+0000 7fa2c7473640 1 -- 172.21.15.87:0/419026388 shutdown_connections 2024-09-13T17:18:14.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:14.117+0000 7fa2c7473640 1 -- 172.21.15.87:0/419026388 wait complete. 2024-09-13T17:18:14.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:14 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1913138622' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:18:14.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:14 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1913138622' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:18:14.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:14 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1913138622' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:18:15.136 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-13T17:18:15.136 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-09-13T17:18:15.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.250+0000 7f90bda3d640 1 -- 172.21.15.87:0/2870453101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90b8100f40 msgr2=0x7f90b8101320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:15.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.250+0000 7f90bda3d640 1 --2- 172.21.15.87:0/2870453101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90b8100f40 0x7f90b8101320 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f90a8009900 tx=0x7f90a802a480 comp rx=0 tx=0).stop 2024-09-13T17:18:15.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.250+0000 7f90bda3d640 1 -- 172.21.15.87:0/2870453101 shutdown_connections 2024-09-13T17:18:15.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.250+0000 7f90bda3d640 1 --2- 172.21.15.87:0/2870453101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90b810a310 0x7f90b810c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.250+0000 7f90bda3d640 1 --2- 172.21.15.87:0/2870453101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90b8101860 0x7f90b8109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.250+0000 7f90bda3d640 1 --2- 172.21.15.87:0/2870453101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90b8100f40 0x7f90b8101320 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.250+0000 7f90bda3d640 1 -- 172.21.15.87:0/2870453101 >> 172.21.15.87:0/2870453101 conn(0x7f90b8075c60 msgr2=0x7f90b80fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:15.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.250+0000 7f90bda3d640 1 -- 172.21.15.87:0/2870453101 shutdown_connections 2024-09-13T17:18:15.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.250+0000 7f90bda3d640 1 -- 172.21.15.87:0/2870453101 wait complete. 2024-09-13T17:18:15.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.250+0000 7f90bda3d640 1 Processor -- start 2024-09-13T17:18:15.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.250+0000 7f90bda3d640 1 -- start start 2024-09-13T17:18:15.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.251+0000 7f90bda3d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90b8100f40 0x7f90b8196180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.251+0000 7f90bda3d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90b8101860 0x7f90b81966c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.251+0000 7f90bda3d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90b810a310 0x7f90b819aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.251+0000 7f90bda3d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b819b0b0 con 0x7f90b8101860 2024-09-13T17:18:15.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.251+0000 7f90bda3d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b819b220 con 0x7f90b8100f40 2024-09-13T17:18:15.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.251+0000 7f90bda3d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b819b3e0 con 0x7f90b810a310 2024-09-13T17:18:15.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.251+0000 7f90ae7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90b8101860 0x7f90b81966c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.251+0000 7f90ae7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90b8101860 0x7f90b81966c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45600/0 (socket says 172.21.15.87:45600) 2024-09-13T17:18:15.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.251+0000 7f90ae7fc640 1 -- 172.21.15.87:0/1440497742 learned_addr learned my addr 172.21.15.87:0/1440497742 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:15.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.251+0000 7f90b6ffd640 1 --2- 172.21.15.87:0/1440497742 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90b8100f40 0x7f90b8196180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.251+0000 7f90b77fe640 1 --2- 172.21.15.87:0/1440497742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90b810a310 0x7f90b819aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.251+0000 7f90ae7fc640 1 -- 172.21.15.87:0/1440497742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90b810a310 msgr2=0x7f90b819aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:15.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.251+0000 7f90ae7fc640 1 --2- 172.21.15.87:0/1440497742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90b810a310 0x7f90b819aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.251+0000 7f90ae7fc640 1 -- 172.21.15.87:0/1440497742 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90b8100f40 msgr2=0x7f90b8196180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:15.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.251+0000 7f90ae7fc640 1 --2- 172.21.15.87:0/1440497742 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90b8100f40 0x7f90b8196180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.251+0000 7f90ae7fc640 1 -- 172.21.15.87:0/1440497742 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a8009560 con 0x7f90b8101860 2024-09-13T17:18:15.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.251+0000 7f90ae7fc640 1 --2- 172.21.15.87:0/1440497742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90b8101860 0x7f90b81966c0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f90a000c920 tx=0x7f90a000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:15.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.251+0000 7f90bca3b640 1 -- 172.21.15.87:0/1440497742 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a0007c70 con 0x7f90b8101860 2024-09-13T17:18:15.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.251+0000 7f90bca3b640 1 -- 172.21.15.87:0/1440497742 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f90a0007dd0 con 0x7f90b8101860 2024-09-13T17:18:15.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.251+0000 7f90bda3d640 1 -- 172.21.15.87:0/1440497742 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b819b6c0 con 0x7f90b8101860 2024-09-13T17:18:15.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.251+0000 7f90bca3b640 1 -- 172.21.15.87:0/1440497742 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a00187c0 con 0x7f90b8101860 2024-09-13T17:18:15.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.252+0000 7f90bda3d640 1 -- 172.21.15.87:0/1440497742 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b81a2f40 con 0x7f90b8101860 2024-09-13T17:18:15.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.254+0000 7f90c0834740 1 Processor -- start 2024-09-13T17:18:15.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.254+0000 7f90bca3b640 1 -- 172.21.15.87:0/1440497742 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f90a000f450 con 0x7f90b8101860 2024-09-13T17:18:15.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.254+0000 7f90c0834740 1 -- start start 2024-09-13T17:18:15.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.255+0000 7f90c0834740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5559fca167c0 0x5559fca16ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.255+0000 7f90c0834740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559fca170e0 0x5559fca21440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.255+0000 7f90c0834740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5559fca21980 0x5559fca23d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.255+0000 7f90c0834740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559fc981c60 con 0x5559fca170e0 2024-09-13T17:18:15.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.255+0000 7f90c0834740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559fc97f3f0 con 0x5559fca167c0 2024-09-13T17:18:15.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.255+0000 7f90c0834740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559fc97ace0 con 0x5559fca21980 2024-09-13T17:18:15.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.255+0000 7f90b6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559fca170e0 0x5559fca21440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.255+0000 7f90b6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559fca170e0 0x5559fca21440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45612/0 (socket says 172.21.15.87:45612) 2024-09-13T17:18:15.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.255+0000 7f90b77fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5559fca167c0 0x5559fca16ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.255+0000 7f90b6ffd640 1 -- 172.21.15.87:0/760937530 learned_addr learned my addr 172.21.15.87:0/760937530 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:15.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.255+0000 7f90ae7fc640 1 --2- 172.21.15.87:0/760937530 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5559fca21980 0x5559fca23d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.255+0000 7f90b6ffd640 1 -- 172.21.15.87:0/760937530 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5559fca21980 msgr2=0x5559fca23d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:15.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.255+0000 7f90b6ffd640 1 --2- 172.21.15.87:0/760937530 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5559fca21980 0x5559fca23d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.255+0000 7f90b6ffd640 1 -- 172.21.15.87:0/760937530 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5559fca167c0 msgr2=0x5559fca16ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:15.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.255+0000 7f90b6ffd640 1 --2- 172.21.15.87:0/760937530 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5559fca167c0 0x5559fca16ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.255+0000 7f90b6ffd640 1 -- 172.21.15.87:0/760937530 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559fc936970 con 0x5559fca170e0 2024-09-13T17:18:15.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.255+0000 7f90bca3b640 1 --2- 172.21.15.87:0/1440497742 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f90a40a1200 0x7f90a40a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.255+0000 7f90ae7fc640 1 --2- 172.21.15.87:0/760937530 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5559fca21980 0x5559fca23d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:15.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.255+0000 7f90b77fe640 1 --2- 172.21.15.87:0/1440497742 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f90a40a1200 0x7f90a40a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.255+0000 7f90b6ffd640 1 --2- 172.21.15.87:0/760937530 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559fca170e0 0x5559fca21440 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f90a8000c00 tx=0x7f90a8031660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c82ee5465ce4760f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:15.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.255+0000 7f90bca3b640 1 -- 172.21.15.87:0/1440497742 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f90a00cd270 con 0x7f90b8101860 2024-09-13T17:18:15.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.256+0000 7f90adffb640 1 -- 172.21.15.87:0/760937530 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a8031bf0 con 0x5559fca170e0 2024-09-13T17:18:15.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.256+0000 7f90adffb640 1 -- 172.21.15.87:0/760937530 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f90a80044e0 con 0x5559fca170e0 2024-09-13T17:18:15.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.256+0000 7f90adffb640 1 -- 172.21.15.87:0/760937530 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a80046c0 con 0x5559fca170e0 2024-09-13T17:18:15.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.256+0000 7f90c0834740 1 -- 172.21.15.87:0/760937530 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559fca170e0 msgr2=0x5559fca21440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:15.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.256+0000 7f90c0834740 1 --2- 172.21.15.87:0/760937530 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559fca170e0 0x5559fca21440 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f90a8000c00 tx=0x7f90a8031660 comp rx=0 tx=0).stop 2024-09-13T17:18:15.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.256+0000 7f90b77fe640 1 --2- 172.21.15.87:0/1440497742 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f90a40a1200 0x7f90a40a36c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f90b0005fd0 tx=0x7f90b00096d0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:15.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.256+0000 7f90c0834740 1 -- 172.21.15.87:0/760937530 shutdown_connections 2024-09-13T17:18:15.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.256+0000 7f90c0834740 1 --2- 172.21.15.87:0/760937530 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5559fca21980 0x5559fca23d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.256+0000 7f90c0834740 1 --2- 172.21.15.87:0/760937530 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559fca170e0 0x5559fca21440 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.256+0000 7f90c0834740 1 --2- 172.21.15.87:0/760937530 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5559fca167c0 0x5559fca16ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.256+0000 7f90c0834740 1 -- 172.21.15.87:0/760937530 >> 172.21.15.87:0/760937530 conn(0x5559fca12d50 msgr2=0x5559fca13130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:15.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.256+0000 7f90c0834740 1 -- 172.21.15.87:0/760937530 shutdown_connections 2024-09-13T17:18:15.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.256+0000 7f90c0834740 1 -- 172.21.15.87:0/760937530 wait complete. 2024-09-13T17:18:15.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.257+0000 7f90c0834740 1 -- start start 2024-09-13T17:18:15.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.257+0000 7f90c0834740 1 Processor -- start 2024-09-13T17:18:15.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.257+0000 7f90c0834740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5559fca167c0 0x5559fca21400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.257+0000 7f90c0834740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5559fca170e0 0x5559fca1e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.257+0000 7f90c0834740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559fca21980 0x5559fca1ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.257+0000 7f90c0834740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559fc938f80 con 0x5559fca21980 2024-09-13T17:18:15.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.257+0000 7f90c0834740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559fc938c20 con 0x5559fca167c0 2024-09-13T17:18:15.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.257+0000 7f90c0834740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559fc905ab0 con 0x5559fca170e0 2024-09-13T17:18:15.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.257+0000 7f90c0834740 10 client.0 _ll_register_callbacks cb 0x5559fc974350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:18:15.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.257+0000 7f90b77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559fca21980 0x5559fca1ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.257+0000 7f90b77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559fca21980 0x5559fca1ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45618/0 (socket says 172.21.15.87:45618) 2024-09-13T17:18:15.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.257+0000 7f90b77fe640 1 -- 172.21.15.87:0/2703954205 learned_addr learned my addr 172.21.15.87:0/2703954205 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:15.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.257+0000 7f90b6ffd640 1 --2- 172.21.15.87:0/2703954205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5559fca167c0 0x5559fca21400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.258+0000 7f90ae7fc640 1 --2- 172.21.15.87:0/2703954205 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5559fca170e0 0x5559fca1e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.258+0000 7f90b77fe640 1 -- 172.21.15.87:0/2703954205 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5559fca170e0 msgr2=0x5559fca1e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:15.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.258+0000 7f90b77fe640 1 --2- 172.21.15.87:0/2703954205 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5559fca170e0 0x5559fca1e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.258+0000 7f90b77fe640 1 -- 172.21.15.87:0/2703954205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5559fca167c0 msgr2=0x5559fca21400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:15.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.258+0000 7f90b77fe640 1 --2- 172.21.15.87:0/2703954205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5559fca167c0 0x5559fca21400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.258+0000 7f90b77fe640 1 -- 172.21.15.87:0/2703954205 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b810d410 con 0x5559fca21980 2024-09-13T17:18:15.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.258+0000 7f90b77fe640 1 --2- 172.21.15.87:0/2703954205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559fca21980 0x5559fca1ede0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f90b00092f0 tx=0x7f90b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d361b7841ef4dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:15.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.258+0000 7f9096ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:18:15.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.258+0000 7f9096ffd640 1 -- 172.21.15.87:0/2703954205 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b0010950 con 0x5559fca21980 2024-09-13T17:18:15.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.258+0000 7f9096ffd640 1 -- 172.21.15.87:0/2703954205 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f90b0010ab0 con 0x5559fca21980 2024-09-13T17:18:15.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.258+0000 7f90c0834740 1 -- 172.21.15.87:0/2703954205 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5559fc66e590 con 0x5559fca21980 2024-09-13T17:18:15.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.258+0000 7f9096ffd640 1 -- 172.21.15.87:0/2703954205 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90b0010c70 con 0x5559fca21980 2024-09-13T17:18:15.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.258+0000 7f90c0834740 10 client.16887 fetch_fsmap learned FSMap version 30 2024-09-13T17:18:15.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.258+0000 7f90c0834740 1 -- 172.21.15.87:0/2703954205 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5559fc979360 con 0x5559fca21980 2024-09-13T17:18:15.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.258+0000 7f9096ffd640 1 -- 172.21.15.87:0/2703954205 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x5559fc66e590 con 0x5559fca21980 2024-09-13T17:18:15.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.258+0000 7f9096ffd640 1 -- 172.21.15.87:0/2703954205 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f90b0026440 con 0x5559fca21980 2024-09-13T17:18:15.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.258+0000 7f90c0834740 10 client.16887 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:18:15.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.258+0000 7f90c0834740 10 client.16887 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:18:15.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.259+0000 7f90c0834740 20 client.16887 populate_metadata read hostname 'smithi087' 2024-09-13T17:18:15.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.259+0000 7f90c0834740 1 --2- 172.21.15.87:0/2703954205 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5559fca317e0 0x5559fca33c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.259+0000 7f90c0834740 4 client.16887 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:18:15.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.259+0000 7f90c0834740 1 -- 172.21.15.87:0/2703954205 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5559fc67f860 con 0x5559fca317e0 2024-09-13T17:18:15.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.259+0000 7f90b6ffd640 1 --2- 172.21.15.87:0/2703954205 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5559fca317e0 0x5559fca33c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.259+0000 7f9096ffd640 10 client.16887 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:18:15.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.259+0000 7f90b6ffd640 1 --2- 172.21.15.87:0/2703954205 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5559fca317e0 0x5559fca33c20 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11ae2de9bdd8576e server_cookie=55d1fb50c24e770b in_seq=0 out_seq=0 2024-09-13T17:18:15.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.260+0000 7f9096ffd640 1 -- 172.21.15.87:0/2703954205 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5559fc67f860 con 0x5559fca317e0 2024-09-13T17:18:15.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.260+0000 7f9096ffd640 10 client.16887 handle_command_reply: tid=0 2024-09-13T17:18:15.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.260+0000 7f90c0834740 1 client.16887 shutdown 2024-09-13T17:18:15.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.260+0000 7f90c0834740 1 -- 172.21.15.87:0/2703954205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559fca21980 msgr2=0x5559fca1ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:15.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.260+0000 7f90c0834740 1 --2- 172.21.15.87:0/2703954205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559fca21980 0x5559fca1ede0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f90b00092f0 tx=0x7f90b0004a40 comp rx=0 tx=0).stop 2024-09-13T17:18:15.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.260+0000 7f90c0834740 1 -- 172.21.15.87:0/2703954205 shutdown_connections 2024-09-13T17:18:15.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.260+0000 7f90c0834740 1 --2- 172.21.15.87:0/2703954205 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5559fca317e0 0x5559fca33c20 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.260+0000 7f90c0834740 1 --2- 172.21.15.87:0/2703954205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559fca21980 0x5559fca1ede0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.260+0000 7f90c0834740 1 --2- 172.21.15.87:0/2703954205 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5559fca170e0 0x5559fca1e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.260+0000 7f9096ffd640 0 client.16887 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:18:15.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.260+0000 7f90c0834740 1 --2- 172.21.15.87:0/2703954205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5559fca167c0 0x5559fca21400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.260+0000 7f90c0834740 1 -- 172.21.15.87:0/2703954205 >> 172.21.15.87:0/2703954205 conn(0x5559fca12d50 msgr2=0x5559fca181a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:15.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.260+0000 7f90c0834740 1 -- 172.21.15.87:0/2703954205 shutdown_connections 2024-09-13T17:18:15.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.260+0000 7f90c0834740 1 -- 172.21.15.87:0/2703954205 wait complete. 2024-09-13T17:18:15.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.260+0000 7f90c0834740 20 client.16887 trim_cache size 0 max 16384 2024-09-13T17:18:15.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.274+0000 7f90c0834740 1 Processor -- start 2024-09-13T17:18:15.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.274+0000 7f90c0834740 1 -- start start 2024-09-13T17:18:15.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.274+0000 7f90c0834740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5559fca167c0 0x5559fca1df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.275+0000 7f90c0834740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559fca170e0 0x5559fca20f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.275+0000 7f90c0834740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5559fca21980 0x5559fca28650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.275+0000 7f90c0834740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559fca15fc0 con 0x5559fca170e0 2024-09-13T17:18:15.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.275+0000 7f90c0834740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559fca38e30 con 0x5559fca21980 2024-09-13T17:18:15.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.275+0000 7f90c0834740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559fca2ff60 con 0x5559fca167c0 2024-09-13T17:18:15.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.275+0000 7f90ae7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559fca170e0 0x5559fca20f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.275+0000 7f90ae7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559fca170e0 0x5559fca20f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45632/0 (socket says 172.21.15.87:45632) 2024-09-13T17:18:15.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.275+0000 7f90ae7fc640 1 -- 172.21.15.87:0/3911284582 learned_addr learned my addr 172.21.15.87:0/3911284582 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:15.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.275+0000 7f90b6ffd640 1 --2- 172.21.15.87:0/3911284582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5559fca167c0 0x5559fca1df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.275+0000 7f90ae7fc640 1 -- 172.21.15.87:0/3911284582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5559fca167c0 msgr2=0x5559fca1df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:15.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.275+0000 7f90ae7fc640 1 --2- 172.21.15.87:0/3911284582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5559fca167c0 0x5559fca1df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.275+0000 7f90b77fe640 1 --2- 172.21.15.87:0/3911284582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5559fca21980 0x5559fca28650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.275+0000 7f90ae7fc640 1 -- 172.21.15.87:0/3911284582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5559fca21980 msgr2=0x5559fca28650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:15.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.275+0000 7f90ae7fc640 1 --2- 172.21.15.87:0/3911284582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5559fca21980 0x5559fca28650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.275+0000 7f90ae7fc640 1 -- 172.21.15.87:0/3911284582 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559fc91b1c0 con 0x5559fca170e0 2024-09-13T17:18:15.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.275+0000 7f90ae7fc640 1 --2- 172.21.15.87:0/3911284582 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559fca170e0 0x5559fca20f10 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f90a00ca670 tx=0x7f90a0099e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f8b71a03974be60 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:15.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.275+0000 7f90aeffd640 1 -- 172.21.15.87:0/3911284582 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a00adea0 con 0x5559fca170e0 2024-09-13T17:18:15.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.275+0000 7f90aeffd640 1 -- 172.21.15.87:0/3911284582 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f90a000de20 con 0x5559fca170e0 2024-09-13T17:18:15.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.275+0000 7f90aeffd640 1 -- 172.21.15.87:0/3911284582 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a00a2450 con 0x5559fca170e0 2024-09-13T17:18:15.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.276+0000 7f90c0834740 1 -- 172.21.15.87:0/3911284582 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559fca170e0 msgr2=0x5559fca20f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:15.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.276+0000 7f90c0834740 1 --2- 172.21.15.87:0/3911284582 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559fca170e0 0x5559fca20f10 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f90a00ca670 tx=0x7f90a0099e60 comp rx=0 tx=0).stop 2024-09-13T17:18:15.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.276+0000 7f90c0834740 1 -- 172.21.15.87:0/3911284582 shutdown_connections 2024-09-13T17:18:15.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.276+0000 7f90c0834740 1 --2- 172.21.15.87:0/3911284582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5559fca21980 0x5559fca28650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.276+0000 7f90c0834740 1 --2- 172.21.15.87:0/3911284582 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559fca170e0 0x5559fca20f10 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.276+0000 7f90c0834740 1 --2- 172.21.15.87:0/3911284582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5559fca167c0 0x5559fca1df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.276+0000 7f90c0834740 1 -- 172.21.15.87:0/3911284582 >> 172.21.15.87:0/3911284582 conn(0x5559fca12d50 msgr2=0x5559fca13130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:15.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.276+0000 7f90c0834740 1 -- 172.21.15.87:0/3911284582 shutdown_connections 2024-09-13T17:18:15.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.276+0000 7f90c0834740 1 -- 172.21.15.87:0/3911284582 wait complete. 2024-09-13T17:18:15.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.276+0000 7f90c0834740 1 -- start start 2024-09-13T17:18:15.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.276+0000 7f90c0834740 1 Processor -- start 2024-09-13T17:18:15.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.277+0000 7f90c0834740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5559fca167c0 0x5559fca27280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.277+0000 7f90c0834740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559fca170e0 0x5559fca277c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.277+0000 7f90c0834740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5559fca21980 0x5559fca27d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.277+0000 7f90c0834740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559fca905c0 con 0x5559fca170e0 2024-09-13T17:18:15.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.277+0000 7f90c0834740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559fca90700 con 0x5559fca21980 2024-09-13T17:18:15.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.277+0000 7f90c0834740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559fca908c0 con 0x5559fca167c0 2024-09-13T17:18:15.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.277+0000 7f90c0834740 10 client.0 _ll_register_callbacks cb 0x7f90b0009c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:18:15.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.277+0000 7f90ae7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559fca170e0 0x5559fca277c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.277+0000 7f90ae7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559fca170e0 0x5559fca277c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45648/0 (socket says 172.21.15.87:45648) 2024-09-13T17:18:15.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.277+0000 7f90ae7fc640 1 -- 172.21.15.87:0/3102031605 learned_addr learned my addr 172.21.15.87:0/3102031605 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:15.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.277+0000 7f90b6ffd640 1 --2- 172.21.15.87:0/3102031605 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5559fca167c0 0x5559fca27280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.277+0000 7f90b77fe640 1 --2- 172.21.15.87:0/3102031605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5559fca21980 0x5559fca27d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.277+0000 7f90ae7fc640 1 -- 172.21.15.87:0/3102031605 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5559fca167c0 msgr2=0x5559fca27280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:15.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.277+0000 7f90ae7fc640 1 --2- 172.21.15.87:0/3102031605 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5559fca167c0 0x5559fca27280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.277+0000 7f90ae7fc640 1 -- 172.21.15.87:0/3102031605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5559fca21980 msgr2=0x5559fca27d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:15.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.277+0000 7f90ae7fc640 1 --2- 172.21.15.87:0/3102031605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5559fca21980 0x5559fca27d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.277+0000 7f90ae7fc640 1 -- 172.21.15.87:0/3102031605 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b81a2f40 con 0x5559fca170e0 2024-09-13T17:18:15.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.277+0000 7f90b77fe640 1 --2- 172.21.15.87:0/3102031605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5559fca21980 0x5559fca27d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:15.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.277+0000 7f90ae7fc640 1 --2- 172.21.15.87:0/3102031605 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559fca170e0 0x5559fca277c0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f90a00ca6c0 tx=0x7f90a00999b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2412c40307bada2b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:15.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.277+0000 7f9096ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:18:15.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.277+0000 7f9096ffd640 1 -- 172.21.15.87:0/3102031605 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a00adea0 con 0x5559fca170e0 2024-09-13T17:18:15.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.277+0000 7f9096ffd640 1 -- 172.21.15.87:0/3102031605 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f90a009a6d0 con 0x5559fca170e0 2024-09-13T17:18:15.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.277+0000 7f90c0834740 1 -- 172.21.15.87:0/3102031605 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f90a80044e0 con 0x5559fca170e0 2024-09-13T17:18:15.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.277+0000 7f9096ffd640 1 -- 172.21.15.87:0/3102031605 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90a000f900 con 0x5559fca170e0 2024-09-13T17:18:15.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.277+0000 7f90c0834740 10 client.16893 fetch_fsmap learned FSMap version 30 2024-09-13T17:18:15.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.277+0000 7f90c0834740 1 -- 172.21.15.87:0/3102031605 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5559fc940990 con 0x5559fca170e0 2024-09-13T17:18:15.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.278+0000 7f9096ffd640 1 -- 172.21.15.87:0/3102031605 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f90a80044e0 con 0x5559fca170e0 2024-09-13T17:18:15.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.278+0000 7f9096ffd640 1 -- 172.21.15.87:0/3102031605 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f90a0016020 con 0x5559fca170e0 2024-09-13T17:18:15.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.278+0000 7f90c0834740 10 client.16893 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:18:15.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.278+0000 7f90c0834740 10 client.16893 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:18:15.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.278+0000 7f90c0834740 20 client.16893 populate_metadata read hostname 'smithi087' 2024-09-13T17:18:15.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.278+0000 7f90c0834740 1 --2- 172.21.15.87:0/3102031605 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5559fca91d40 0x5559fca94160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.278+0000 7f90c0834740 4 client.16893 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-13T17:18:15.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.278+0000 7f90c0834740 1 -- 172.21.15.87:0/3102031605 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5559fc6d2eb0 con 0x5559fca91d40 2024-09-13T17:18:15.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.278+0000 7f90b6ffd640 1 --2- 172.21.15.87:0/3102031605 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5559fca91d40 0x5559fca94160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.279+0000 7f9096ffd640 10 client.16893 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:18:15.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.279+0000 7f90b6ffd640 1 --2- 172.21.15.87:0/3102031605 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5559fca91d40 0x5559fca94160 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d37bfb159355fe22 server_cookie=dd076febb26f916e in_seq=0 out_seq=0 2024-09-13T17:18:15.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.280+0000 7f9096ffd640 1 -- 172.21.15.87:0/3102031605 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5559fc6d2eb0 con 0x5559fca91d40 2024-09-13T17:18:15.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.280+0000 7f9096ffd640 10 client.16893 handle_command_reply: tid=0 2024-09-13T17:18:15.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.280+0000 7f90c0834740 1 client.16893 shutdown 2024-09-13T17:18:15.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.280+0000 7f90c0834740 1 -- 172.21.15.87:0/3102031605 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559fca170e0 msgr2=0x5559fca277c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:15.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.280+0000 7f90c0834740 1 --2- 172.21.15.87:0/3102031605 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559fca170e0 0x5559fca277c0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f90a00ca6c0 tx=0x7f90a00999b0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.280+0000 7f90c0834740 1 -- 172.21.15.87:0/3102031605 shutdown_connections 2024-09-13T17:18:15.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.280+0000 7f90c0834740 1 --2- 172.21.15.87:0/3102031605 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5559fca91d40 0x5559fca94160 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.280+0000 7f90c0834740 1 --2- 172.21.15.87:0/3102031605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5559fca21980 0x5559fca27d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.280+0000 7f90c0834740 1 --2- 172.21.15.87:0/3102031605 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559fca170e0 0x5559fca277c0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.280+0000 7f90c0834740 1 --2- 172.21.15.87:0/3102031605 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5559fca167c0 0x5559fca27280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.280+0000 7f90c0834740 1 -- 172.21.15.87:0/3102031605 >> 172.21.15.87:0/3102031605 conn(0x5559fca12d50 msgr2=0x5559fca19940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:15.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.280+0000 7f9096ffd640 0 client.16893 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:18:15.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.280+0000 7f90c0834740 1 -- 172.21.15.87:0/3102031605 shutdown_connections 2024-09-13T17:18:15.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.280+0000 7f90c0834740 1 -- 172.21.15.87:0/3102031605 wait complete. 2024-09-13T17:18:15.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.280+0000 7f90c0834740 20 client.16893 trim_cache size 0 max 16384 2024-09-13T17:18:15.288 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:18:15.288 INFO:teuthology.orchestra.run.smithi087.stdout: "return_code": 0, 2024-09-13T17:18:15.289 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_tag": "2f834fc6-b3eb-43dc-b0e7-c16833c8ae63", 2024-09-13T17:18:15.289 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": "asynchronous" 2024-09-13T17:18:15.289 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:18:15.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.281+0000 7f90bda3d640 1 -- 172.21.15.87:0/1440497742 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f90a40a1200 msgr2=0x7f90a40a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:15.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.281+0000 7f90bda3d640 1 --2- 172.21.15.87:0/1440497742 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f90a40a1200 0x7f90a40a36c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f90b0005fd0 tx=0x7f90b00096d0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.281+0000 7f90bda3d640 1 -- 172.21.15.87:0/1440497742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90b8101860 msgr2=0x7f90b81966c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:15.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.281+0000 7f90bda3d640 1 --2- 172.21.15.87:0/1440497742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90b8101860 0x7f90b81966c0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f90a000c920 tx=0x7f90a000cde0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.281+0000 7f90bda3d640 1 -- 172.21.15.87:0/1440497742 shutdown_connections 2024-09-13T17:18:15.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.281+0000 7f90bda3d640 1 --2- 172.21.15.87:0/1440497742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90b810a310 0x7f90b819aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.281+0000 7f90bda3d640 1 --2- 172.21.15.87:0/1440497742 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f90a40a1200 0x7f90a40a36c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.281+0000 7f90bda3d640 1 --2- 172.21.15.87:0/1440497742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90b8101860 0x7f90b81966c0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.281+0000 7f90bda3d640 1 --2- 172.21.15.87:0/1440497742 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90b8100f40 0x7f90b8196180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.281+0000 7f90bda3d640 1 -- 172.21.15.87:0/1440497742 >> 172.21.15.87:0/1440497742 conn(0x7f90b8075c60 msgr2=0x7f90b80fb400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:15.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.281+0000 7f90bda3d640 1 -- 172.21.15.87:0/1440497742 shutdown_connections 2024-09-13T17:18:15.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.281+0000 7f90bda3d640 1 -- 172.21.15.87:0/1440497742 wait complete. 2024-09-13T17:18:15.294 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:18:15.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.394+0000 7f60355e9640 1 -- 172.21.15.87:0/935940832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6030103fb0 msgr2=0x7f603010bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:15.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.394+0000 7f60355e9640 1 --2- 172.21.15.87:0/935940832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6030103fb0 0x7f603010bb00 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f6028009cd0 tx=0x7f602802a8e0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.394+0000 7f60355e9640 1 -- 172.21.15.87:0/935940832 shutdown_connections 2024-09-13T17:18:15.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.394+0000 7f60355e9640 1 --2- 172.21.15.87:0/935940832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6030103fb0 0x7f603010bb00 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.394+0000 7f60355e9640 1 --2- 172.21.15.87:0/935940832 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60300ff810 0x7f6030103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.394+0000 7f60355e9640 1 --2- 172.21.15.87:0/935940832 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60300fee60 0x7f60300ff240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.394+0000 7f60355e9640 1 -- 172.21.15.87:0/935940832 >> 172.21.15.87:0/935940832 conn(0x7f6030075c60 msgr2=0x7f60300fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:15.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.394+0000 7f60355e9640 1 -- 172.21.15.87:0/935940832 shutdown_connections 2024-09-13T17:18:15.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.394+0000 7f60355e9640 1 -- 172.21.15.87:0/935940832 wait complete. 2024-09-13T17:18:15.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.394+0000 7f60355e9640 1 Processor -- start 2024-09-13T17:18:15.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.394+0000 7f60355e9640 1 -- start start 2024-09-13T17:18:15.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.394+0000 7f60355e9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60300fee60 0x7f6030195110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.394+0000 7f60355e9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6030103fb0 0x7f6030195650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.394+0000 7f60355e9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6030199a40 0x7f6030199ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.394+0000 7f60355e9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603019a430 con 0x7f6030103fb0 2024-09-13T17:18:15.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.395+0000 7f60355e9640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603019a5a0 con 0x7f60300fee60 2024-09-13T17:18:15.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.395+0000 7f60355e9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603019a710 con 0x7f6030199a40 2024-09-13T17:18:15.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.395+0000 7f6027fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6030103fb0 0x7f6030195650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.395+0000 7f6027fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6030103fb0 0x7f6030195650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45666/0 (socket says 172.21.15.87:45666) 2024-09-13T17:18:15.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.395+0000 7f6027fff640 1 -- 172.21.15.87:0/350559845 learned_addr learned my addr 172.21.15.87:0/350559845 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:15.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.395+0000 7f602f7fe640 1 --2- 172.21.15.87:0/350559845 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6030199a40 0x7f6030199ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.395+0000 7f602effd640 1 --2- 172.21.15.87:0/350559845 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60300fee60 0x7f6030195110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.395+0000 7f6027fff640 1 -- 172.21.15.87:0/350559845 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6030199a40 msgr2=0x7f6030199ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:15.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.395+0000 7f6027fff640 1 --2- 172.21.15.87:0/350559845 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6030199a40 0x7f6030199ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.395+0000 7f6027fff640 1 -- 172.21.15.87:0/350559845 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60300fee60 msgr2=0x7f6030195110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:15.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.395+0000 7f6027fff640 1 --2- 172.21.15.87:0/350559845 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60300fee60 0x7f6030195110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.395+0000 7f6027fff640 1 -- 172.21.15.87:0/350559845 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6028009900 con 0x7f6030103fb0 2024-09-13T17:18:15.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.395+0000 7f6027fff640 1 --2- 172.21.15.87:0/350559845 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6030103fb0 0x7f6030195650 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f601800e9c0 tx=0x7f601800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:15.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.395+0000 7f602cff9640 1 -- 172.21.15.87:0/350559845 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6018009700 con 0x7f6030103fb0 2024-09-13T17:18:15.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.395+0000 7f602cff9640 1 -- 172.21.15.87:0/350559845 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f601800cd80 con 0x7f6030103fb0 2024-09-13T17:18:15.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.395+0000 7f60355e9640 1 -- 172.21.15.87:0/350559845 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60301a1cf0 con 0x7f6030103fb0 2024-09-13T17:18:15.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.395+0000 7f602cff9640 1 -- 172.21.15.87:0/350559845 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6018010430 con 0x7f6030103fb0 2024-09-13T17:18:15.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.395+0000 7f60355e9640 1 -- 172.21.15.87:0/350559845 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60301a21a0 con 0x7f6030103fb0 2024-09-13T17:18:15.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.397+0000 7f602cff9640 1 -- 172.21.15.87:0/350559845 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f6018004f50 con 0x7f6030103fb0 2024-09-13T17:18:15.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.397+0000 7f60383e3740 1 Processor -- start 2024-09-13T17:18:15.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.398+0000 7f60383e3740 1 -- start start 2024-09-13T17:18:15.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.398+0000 7f60383e3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a9054dcd0 0x564a9054e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.398+0000 7f60383e3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a9054e5f0 0x564a9055aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.398+0000 7f60383e3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564a9055b1e0 0x564a9055d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.398+0000 7f60383e3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a904b8f20 con 0x564a9054dcd0 2024-09-13T17:18:15.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.398+0000 7f60383e3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a904b66b0 con 0x564a9054e5f0 2024-09-13T17:18:15.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.398+0000 7f60383e3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a904b1fa0 con 0x564a9055b1e0 2024-09-13T17:18:15.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.398+0000 7f602f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a9054dcd0 0x564a9054e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.398+0000 7f602f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a9054dcd0 0x564a9054e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45676/0 (socket says 172.21.15.87:45676) 2024-09-13T17:18:15.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.398+0000 7f602f7fe640 1 -- 172.21.15.87:0/3334709217 learned_addr learned my addr 172.21.15.87:0/3334709217 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:15.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.398+0000 7f602effd640 1 --2- 172.21.15.87:0/3334709217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a9054e5f0 0x564a9055aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.398+0000 7f6027fff640 1 --2- 172.21.15.87:0/3334709217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564a9055b1e0 0x564a9055d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.398+0000 7f602f7fe640 1 -- 172.21.15.87:0/3334709217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564a9055b1e0 msgr2=0x564a9055d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:15.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.398+0000 7f602f7fe640 1 --2- 172.21.15.87:0/3334709217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564a9055b1e0 0x564a9055d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.398+0000 7f602f7fe640 1 -- 172.21.15.87:0/3334709217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a9054e5f0 msgr2=0x564a9055aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:15.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.398+0000 7f602f7fe640 1 --2- 172.21.15.87:0/3334709217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a9054e5f0 0x564a9055aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.398+0000 7f602f7fe640 1 -- 172.21.15.87:0/3334709217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a9046c840 con 0x564a9054dcd0 2024-09-13T17:18:15.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.398+0000 7f602effd640 1 --2- 172.21.15.87:0/3334709217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a9054e5f0 0x564a9055aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:15.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.398+0000 7f6027fff640 1 --2- 172.21.15.87:0/3334709217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564a9055b1e0 0x564a9055d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:15.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.398+0000 7f602cff9640 1 --2- 172.21.15.87:0/350559845 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f601c0a1200 0x7f601c0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.399+0000 7f602effd640 1 --2- 172.21.15.87:0/350559845 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f601c0a1200 0x7f601c0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.399+0000 7f602f7fe640 1 --2- 172.21.15.87:0/3334709217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a9054dcd0 0x564a9054e0b0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f6028009cd0 tx=0x7f6028005f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1acc2f343b6beec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:15.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.399+0000 7f602cff9640 1 -- 172.21.15.87:0/350559845 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f6018014070 con 0x7f6030103fb0 2024-09-13T17:18:15.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.399+0000 7f60257fa640 1 -- 172.21.15.87:0/3334709217 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6028030dc0 con 0x564a9054dcd0 2024-09-13T17:18:15.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.399+0000 7f60257fa640 1 -- 172.21.15.87:0/3334709217 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6028040070 con 0x564a9054dcd0 2024-09-13T17:18:15.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.399+0000 7f60257fa640 1 -- 172.21.15.87:0/3334709217 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6028003b90 con 0x564a9054dcd0 2024-09-13T17:18:15.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.399+0000 7f60383e3740 1 -- 172.21.15.87:0/3334709217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a9054dcd0 msgr2=0x564a9054e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:15.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.399+0000 7f60383e3740 1 --2- 172.21.15.87:0/3334709217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a9054dcd0 0x564a9054e0b0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f6028009cd0 tx=0x7f6028005f70 comp rx=0 tx=0).stop 2024-09-13T17:18:15.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.399+0000 7f602effd640 1 --2- 172.21.15.87:0/350559845 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f601c0a1200 0x7f601c0a36c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6020009db0 tx=0x7f6020005f90 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:15.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.400+0000 7f60383e3740 1 -- 172.21.15.87:0/3334709217 shutdown_connections 2024-09-13T17:18:15.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.400+0000 7f60383e3740 1 --2- 172.21.15.87:0/3334709217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564a9055b1e0 0x564a9055d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.400+0000 7f60383e3740 1 --2- 172.21.15.87:0/3334709217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a9054e5f0 0x564a9055aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.400+0000 7f60383e3740 1 --2- 172.21.15.87:0/3334709217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a9054dcd0 0x564a9054e0b0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.400+0000 7f60383e3740 1 -- 172.21.15.87:0/3334709217 >> 172.21.15.87:0/3334709217 conn(0x564a9054a380 msgr2=0x564a9054a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:15.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.400+0000 7f60383e3740 1 -- 172.21.15.87:0/3334709217 shutdown_connections 2024-09-13T17:18:15.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.400+0000 7f60383e3740 1 -- 172.21.15.87:0/3334709217 wait complete. 2024-09-13T17:18:15.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.400+0000 7f60383e3740 1 -- start start 2024-09-13T17:18:15.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.400+0000 7f60383e3740 1 Processor -- start 2024-09-13T17:18:15.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.400+0000 7f60383e3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a9054dcd0 0x564a9055abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.400+0000 7f60383e3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a9054e5f0 0x564a90557e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.400+0000 7f60383e3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564a9055b1e0 0x564a90558470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.400+0000 7f60383e3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a904532a0 con 0x564a9054dcd0 2024-09-13T17:18:15.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.400+0000 7f60383e3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a9018a430 con 0x564a9054e5f0 2024-09-13T17:18:15.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.400+0000 7f60383e3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a90435680 con 0x564a9055b1e0 2024-09-13T17:18:15.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.400+0000 7f60383e3740 10 client.0 _ll_register_callbacks cb 0x564a904ab610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:18:15.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.400+0000 7f602effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a9054dcd0 0x564a9055abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.400+0000 7f602effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a9054dcd0 0x564a9055abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45680/0 (socket says 172.21.15.87:45680) 2024-09-13T17:18:15.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.400+0000 7f602effd640 1 -- 172.21.15.87:0/3254911369 learned_addr learned my addr 172.21.15.87:0/3254911369 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:15.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.400+0000 7f602f7fe640 1 --2- 172.21.15.87:0/3254911369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564a9055b1e0 0x564a90558470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.400+0000 7f6027fff640 1 --2- 172.21.15.87:0/3254911369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a9054e5f0 0x564a90557e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.401+0000 7f602effd640 1 -- 172.21.15.87:0/3254911369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564a9055b1e0 msgr2=0x564a90558470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:15.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.401+0000 7f602effd640 1 --2- 172.21.15.87:0/3254911369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564a9055b1e0 0x564a90558470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.401+0000 7f602effd640 1 -- 172.21.15.87:0/3254911369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a9054e5f0 msgr2=0x564a90557e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:15.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.401+0000 7f602effd640 1 --2- 172.21.15.87:0/3254911369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a9054e5f0 0x564a90557e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.401+0000 7f602effd640 1 -- 172.21.15.87:0/3254911369 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f603010c340 con 0x564a9054dcd0 2024-09-13T17:18:15.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.401+0000 7f602f7fe640 1 --2- 172.21.15.87:0/3254911369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564a9055b1e0 0x564a90558470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:15.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.401+0000 7f6027fff640 1 --2- 172.21.15.87:0/3254911369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a9054e5f0 0x564a90557e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:15.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.401+0000 7f602effd640 1 --2- 172.21.15.87:0/3254911369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a9054dcd0 0x564a9055abe0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f602001ea00 tx=0x7f6020004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a8f0f79224664fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:15.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.401+0000 7f60167fc640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:18:15.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.401+0000 7f60167fc640 1 -- 172.21.15.87:0/3254911369 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6020023070 con 0x564a9054dcd0 2024-09-13T17:18:15.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.401+0000 7f60167fc640 1 -- 172.21.15.87:0/3254911369 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f6020029420 con 0x564a9054dcd0 2024-09-13T17:18:15.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.401+0000 7f60383e3740 1 -- 172.21.15.87:0/3254911369 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564a901a54e0 con 0x564a9054dcd0 2024-09-13T17:18:15.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.401+0000 7f60167fc640 1 -- 172.21.15.87:0/3254911369 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6020017070 con 0x564a9054dcd0 2024-09-13T17:18:15.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.401+0000 7f60383e3740 10 client.16905 fetch_fsmap learned FSMap version 30 2024-09-13T17:18:15.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.401+0000 7f60383e3740 1 -- 172.21.15.87:0/3254911369 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x564a904b0620 con 0x564a9054dcd0 2024-09-13T17:18:15.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.401+0000 7f60167fc640 1 -- 172.21.15.87:0/3254911369 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x564a901a54e0 con 0x564a9054dcd0 2024-09-13T17:18:15.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.401+0000 7f60167fc640 1 -- 172.21.15.87:0/3254911369 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f602001c3a0 con 0x564a9054dcd0 2024-09-13T17:18:15.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.401+0000 7f60383e3740 10 client.16905 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:18:15.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.401+0000 7f60383e3740 10 client.16905 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:18:15.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.401+0000 7f60383e3740 20 client.16905 populate_metadata read hostname 'smithi087' 2024-09-13T17:18:15.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.401+0000 7f60383e3740 1 --2- 172.21.15.87:0/3254911369 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x564a9056af50 0x564a9056d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.401+0000 7f60383e3740 4 client.16905 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:18:15.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.401+0000 7f60383e3740 1 -- 172.21.15.87:0/3254911369 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564a901b67e0 con 0x564a9056af50 2024-09-13T17:18:15.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.402+0000 7f6027fff640 1 --2- 172.21.15.87:0/3254911369 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x564a9056af50 0x564a9056d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.402+0000 7f60167fc640 10 client.16905 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:18:15.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.402+0000 7f6027fff640 1 --2- 172.21.15.87:0/3254911369 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x564a9056af50 0x564a9056d370 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f2d7daa6a764d12 server_cookie=26cd8e5867431a2f in_seq=0 out_seq=0 2024-09-13T17:18:15.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.403+0000 7f60167fc640 1 -- 172.21.15.87:0/3254911369 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x564a901b67e0 con 0x564a9056af50 2024-09-13T17:18:15.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.403+0000 7f60167fc640 10 client.16905 handle_command_reply: tid=0 2024-09-13T17:18:15.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.403+0000 7f60383e3740 1 client.16905 shutdown 2024-09-13T17:18:15.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.403+0000 7f60383e3740 1 -- 172.21.15.87:0/3254911369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a9054dcd0 msgr2=0x564a9055abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:15.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.403+0000 7f60383e3740 1 --2- 172.21.15.87:0/3254911369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a9054dcd0 0x564a9055abe0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f602001ea00 tx=0x7f6020004730 comp rx=0 tx=0).stop 2024-09-13T17:18:15.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.403+0000 7f60383e3740 1 -- 172.21.15.87:0/3254911369 shutdown_connections 2024-09-13T17:18:15.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.403+0000 7f60383e3740 1 --2- 172.21.15.87:0/3254911369 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x564a9056af50 0x564a9056d370 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.403+0000 7f60383e3740 1 --2- 172.21.15.87:0/3254911369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564a9055b1e0 0x564a90558470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.403+0000 7f60167fc640 0 client.16905 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:18:15.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.403+0000 7f60383e3740 1 --2- 172.21.15.87:0/3254911369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a9054e5f0 0x564a90557e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.403+0000 7f60383e3740 1 --2- 172.21.15.87:0/3254911369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a9054dcd0 0x564a9055abe0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.403+0000 7f60383e3740 1 -- 172.21.15.87:0/3254911369 >> 172.21.15.87:0/3254911369 conn(0x564a9054a380 msgr2=0x564a905500e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:15.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.403+0000 7f60383e3740 1 -- 172.21.15.87:0/3254911369 shutdown_connections 2024-09-13T17:18:15.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.403+0000 7f60383e3740 1 -- 172.21.15.87:0/3254911369 wait complete. 2024-09-13T17:18:15.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.403+0000 7f60383e3740 20 client.16905 trim_cache size 0 max 16384 2024-09-13T17:18:15.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.417+0000 7f60383e3740 1 Processor -- start 2024-09-13T17:18:15.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.417+0000 7f60383e3740 1 -- start start 2024-09-13T17:18:15.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.418+0000 7f60383e3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a9054dcd0 0x564a90558450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.418+0000 7f60383e3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564a9054e5f0 0x564a90549d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.418+0000 7f60383e3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a9055b1e0 0x564a9054a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.418+0000 7f60383e3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a9054f4a0 con 0x564a9054dcd0 2024-09-13T17:18:15.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.418+0000 7f60383e3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a9056ad30 con 0x564a9055b1e0 2024-09-13T17:18:15.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.418+0000 7f60383e3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a905489c0 con 0x564a9054e5f0 2024-09-13T17:18:15.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.418+0000 7f602effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a9054dcd0 0x564a90558450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.418+0000 7f602effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a9054dcd0 0x564a90558450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45688/0 (socket says 172.21.15.87:45688) 2024-09-13T17:18:15.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.418+0000 7f602effd640 1 -- 172.21.15.87:0/859604284 learned_addr learned my addr 172.21.15.87:0/859604284 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:15.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.418+0000 7f6027fff640 1 --2- 172.21.15.87:0/859604284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564a9054e5f0 0x564a90549d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.418+0000 7f602f7fe640 1 --2- 172.21.15.87:0/859604284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a9055b1e0 0x564a9054a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.418+0000 7f602effd640 1 -- 172.21.15.87:0/859604284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564a9054e5f0 msgr2=0x564a90549d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:15.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.418+0000 7f602effd640 1 --2- 172.21.15.87:0/859604284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564a9054e5f0 0x564a90549d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.418+0000 7f602effd640 1 -- 172.21.15.87:0/859604284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a9055b1e0 msgr2=0x564a9054a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:15.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.418+0000 7f602effd640 1 --2- 172.21.15.87:0/859604284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a9055b1e0 0x564a9054a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.418+0000 7f602effd640 1 -- 172.21.15.87:0/859604284 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a90452790 con 0x564a9054dcd0 2024-09-13T17:18:15.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.418+0000 7f602effd640 1 --2- 172.21.15.87:0/859604284 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a9054dcd0 0x564a90558450 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f6020005d60 tx=0x7f6020005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a3d6ddda52288b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:15.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.418+0000 7f6025ffb640 1 -- 172.21.15.87:0/859604284 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6020023070 con 0x564a9054dcd0 2024-09-13T17:18:15.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.418+0000 7f6025ffb640 1 -- 172.21.15.87:0/859604284 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f602001e7c0 con 0x564a9054dcd0 2024-09-13T17:18:15.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.418+0000 7f6025ffb640 1 -- 172.21.15.87:0/859604284 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60200298d0 con 0x564a9054dcd0 2024-09-13T17:18:15.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.419+0000 7f60383e3740 1 -- 172.21.15.87:0/859604284 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a9054dcd0 msgr2=0x564a90558450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:15.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.419+0000 7f60383e3740 1 --2- 172.21.15.87:0/859604284 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a9054dcd0 0x564a90558450 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f6020005d60 tx=0x7f6020005d90 comp rx=0 tx=0).stop 2024-09-13T17:18:15.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.419+0000 7f60383e3740 1 -- 172.21.15.87:0/859604284 shutdown_connections 2024-09-13T17:18:15.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.419+0000 7f60383e3740 1 --2- 172.21.15.87:0/859604284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a9055b1e0 0x564a9054a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.419+0000 7f60383e3740 1 --2- 172.21.15.87:0/859604284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564a9054e5f0 0x564a90549d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.419+0000 7f60383e3740 1 --2- 172.21.15.87:0/859604284 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a9054dcd0 0x564a90558450 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.419+0000 7f60383e3740 1 -- 172.21.15.87:0/859604284 >> 172.21.15.87:0/859604284 conn(0x564a9054a380 msgr2=0x564a905531a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:15.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.419+0000 7f60383e3740 1 -- 172.21.15.87:0/859604284 shutdown_connections 2024-09-13T17:18:15.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.419+0000 7f60383e3740 1 -- 172.21.15.87:0/859604284 wait complete. 2024-09-13T17:18:15.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.419+0000 7f60383e3740 1 -- start start 2024-09-13T17:18:15.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.419+0000 7f60383e3740 1 Processor -- start 2024-09-13T17:18:15.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.420+0000 7f60383e3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a9054dcd0 0x564a90561eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.420+0000 7f60383e3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a9054e5f0 0x564a905623f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.420+0000 7f60383e3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564a9055b1e0 0x564a9055e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.420+0000 7f60383e3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a9055ed50 con 0x564a9054e5f0 2024-09-13T17:18:15.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.420+0000 7f60383e3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a9055eec0 con 0x564a9054dcd0 2024-09-13T17:18:15.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.420+0000 7f60383e3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a9055f080 con 0x564a9055b1e0 2024-09-13T17:18:15.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.420+0000 7f60383e3740 10 client.0 _ll_register_callbacks cb 0x7f6020009aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:18:15.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.420+0000 7f6027fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a9054e5f0 0x564a905623f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.420+0000 7f6027fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a9054e5f0 0x564a905623f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45702/0 (socket says 172.21.15.87:45702) 2024-09-13T17:18:15.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.420+0000 7f6027fff640 1 -- 172.21.15.87:0/845198745 learned_addr learned my addr 172.21.15.87:0/845198745 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:15.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.420+0000 7f602f7fe640 1 --2- 172.21.15.87:0/845198745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564a9055b1e0 0x564a9055e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.420+0000 7f602effd640 1 --2- 172.21.15.87:0/845198745 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a9054dcd0 0x564a90561eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.420+0000 7f6027fff640 1 -- 172.21.15.87:0/845198745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564a9055b1e0 msgr2=0x564a9055e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:15.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.420+0000 7f6027fff640 1 --2- 172.21.15.87:0/845198745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564a9055b1e0 0x564a9055e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.420+0000 7f6027fff640 1 -- 172.21.15.87:0/845198745 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a9054dcd0 msgr2=0x564a90561eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:15.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.420+0000 7f6027fff640 1 --2- 172.21.15.87:0/845198745 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a9054dcd0 0x564a90561eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.420+0000 7f6027fff640 1 -- 172.21.15.87:0/845198745 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a904b0620 con 0x564a9054e5f0 2024-09-13T17:18:15.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.420+0000 7f602effd640 1 --2- 172.21.15.87:0/845198745 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a9054dcd0 0x564a90561eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:15.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.420+0000 7f6027fff640 1 --2- 172.21.15.87:0/845198745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a9054e5f0 0x564a905623f0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f6018096c00 tx=0x7f6018099af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc84723d84dc5ac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:15.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.420+0000 7f60167fc640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:18:15.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.420+0000 7f60167fc640 1 -- 172.21.15.87:0/845198745 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601809dfc0 con 0x564a9054e5f0 2024-09-13T17:18:15.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.420+0000 7f60167fc640 1 -- 172.21.15.87:0/845198745 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f60180a2610 con 0x564a9054e5f0 2024-09-13T17:18:15.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.420+0000 7f60383e3740 1 -- 172.21.15.87:0/845198745 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6028040070 con 0x564a9054e5f0 2024-09-13T17:18:15.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.421+0000 7f60167fc640 1 -- 172.21.15.87:0/845198745 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60180cd0b0 con 0x564a9054e5f0 2024-09-13T17:18:15.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.421+0000 7f60383e3740 10 client.16911 fetch_fsmap learned FSMap version 30 2024-09-13T17:18:15.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.421+0000 7f60383e3740 1 -- 172.21.15.87:0/845198745 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x564a90477ea0 con 0x564a9054e5f0 2024-09-13T17:18:15.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.421+0000 7f60167fc640 1 -- 172.21.15.87:0/845198745 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6028040070 con 0x564a9054e5f0 2024-09-13T17:18:15.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.421+0000 7f60167fc640 1 -- 172.21.15.87:0/845198745 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f601801f060 con 0x564a9054e5f0 2024-09-13T17:18:15.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.421+0000 7f60383e3740 10 client.16911 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:18:15.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.421+0000 7f60383e3740 10 client.16911 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:18:15.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.421+0000 7f60383e3740 20 client.16911 populate_metadata read hostname 'smithi087' 2024-09-13T17:18:15.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.421+0000 7f60383e3740 1 --2- 172.21.15.87:0/845198745 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x564a905c28e0 0x564a905c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:15.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.421+0000 7f60383e3740 4 client.16911 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:18:15.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.421+0000 7f60383e3740 1 -- 172.21.15.87:0/845198745 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564a90209e30 con 0x564a905c28e0 2024-09-13T17:18:15.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.421+0000 7f602effd640 1 --2- 172.21.15.87:0/845198745 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x564a905c28e0 0x564a905c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:15.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.422+0000 7f602effd640 1 --2- 172.21.15.87:0/845198745 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x564a905c28e0 0x564a905c4d00 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17576a2bfa998e50 server_cookie=24f8928462d48f60 in_seq=0 out_seq=0 2024-09-13T17:18:15.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.422+0000 7f60167fc640 10 client.16911 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:18:15.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.422+0000 7f60167fc640 1 -- 172.21.15.87:0/845198745 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x564a90209e30 con 0x564a905c28e0 2024-09-13T17:18:15.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.422+0000 7f60167fc640 10 client.16911 handle_command_reply: tid=0 2024-09-13T17:18:15.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.422+0000 7f60383e3740 1 client.16911 shutdown 2024-09-13T17:18:15.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.422+0000 7f60383e3740 1 -- 172.21.15.87:0/845198745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a9054e5f0 msgr2=0x564a905623f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:15.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.422+0000 7f60383e3740 1 --2- 172.21.15.87:0/845198745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a9054e5f0 0x564a905623f0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f6018096c00 tx=0x7f6018099af0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.422+0000 7f60383e3740 1 -- 172.21.15.87:0/845198745 shutdown_connections 2024-09-13T17:18:15.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.422+0000 7f60383e3740 1 --2- 172.21.15.87:0/845198745 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x564a905c28e0 0x564a905c4d00 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.422+0000 7f60383e3740 1 --2- 172.21.15.87:0/845198745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564a9055b1e0 0x564a9055e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.422+0000 7f60383e3740 1 --2- 172.21.15.87:0/845198745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564a9054e5f0 0x564a905623f0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.422+0000 7f60167fc640 0 client.16911 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:18:15.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.422+0000 7f60383e3740 1 --2- 172.21.15.87:0/845198745 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a9054dcd0 0x564a90561eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.422+0000 7f60383e3740 1 -- 172.21.15.87:0/845198745 >> 172.21.15.87:0/845198745 conn(0x564a9054a380 msgr2=0x564a9054a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:15.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.422+0000 7f60383e3740 1 -- 172.21.15.87:0/845198745 shutdown_connections 2024-09-13T17:18:15.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.422+0000 7f60383e3740 1 -- 172.21.15.87:0/845198745 wait complete. 2024-09-13T17:18:15.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.422+0000 7f60383e3740 20 client.16911 trim_cache size 0 max 16384 2024-09-13T17:18:15.432 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:18:15.432 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-13T17:18:15.432 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": { 2024-09-13T17:18:15.432 INFO:teuthology.orchestra.run.smithi087.stdout: "2f834fc6-b3eb-43dc-b0e7-c16833c8ae63": { 2024-09-13T17:18:15.432 INFO:teuthology.orchestra.run.smithi087.stdout: "path": "/", 2024-09-13T17:18:15.432 INFO:teuthology.orchestra.run.smithi087.stdout: "tag": "2f834fc6-b3eb-43dc-b0e7-c16833c8ae63", 2024-09-13T17:18:15.433 INFO:teuthology.orchestra.run.smithi087.stdout: "options": "recursive,force" 2024-09-13T17:18:15.433 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:18:15.433 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:18:15.433 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:18:15.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.422+0000 7f60355e9640 1 -- 172.21.15.87:0/350559845 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f601c0a1200 msgr2=0x7f601c0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:15.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.422+0000 7f60355e9640 1 --2- 172.21.15.87:0/350559845 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f601c0a1200 0x7f601c0a36c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6020009db0 tx=0x7f6020005f90 comp rx=0 tx=0).stop 2024-09-13T17:18:15.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.422+0000 7f60355e9640 1 -- 172.21.15.87:0/350559845 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6030103fb0 msgr2=0x7f6030195650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:15.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.422+0000 7f60355e9640 1 --2- 172.21.15.87:0/350559845 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6030103fb0 0x7f6030195650 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f601800e9c0 tx=0x7f601800ee80 comp rx=0 tx=0).stop 2024-09-13T17:18:15.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.423+0000 7f60355e9640 1 -- 172.21.15.87:0/350559845 shutdown_connections 2024-09-13T17:18:15.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.423+0000 7f60355e9640 1 --2- 172.21.15.87:0/350559845 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6030199a40 0x7f6030199ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.423+0000 7f60355e9640 1 --2- 172.21.15.87:0/350559845 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f601c0a1200 0x7f601c0a36c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.423+0000 7f60355e9640 1 --2- 172.21.15.87:0/350559845 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6030103fb0 0x7f6030195650 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.423+0000 7f60355e9640 1 --2- 172.21.15.87:0/350559845 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60300fee60 0x7f6030195110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:15.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.423+0000 7f60355e9640 1 -- 172.21.15.87:0/350559845 >> 172.21.15.87:0/350559845 conn(0x7f6030075c60 msgr2=0x7f60300fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:15.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.423+0000 7f60355e9640 1 -- 172.21.15.87:0/350559845 shutdown_connections 2024-09-13T17:18:15.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:15.423+0000 7f60355e9640 1 -- 172.21.15.87:0/350559845 wait complete. 2024-09-13T17:18:15.436 INFO:tasks.cephfs.filesystem:scrub status for tag:2f834fc6-b3eb-43dc-b0e7-c16833c8ae63 - {'path': '/', 'tag': '2f834fc6-b3eb-43dc-b0e7-c16833c8ae63', 'options': 'recursive,force'} 2024-09-13T17:18:15.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:15 smithi087 ceph-mon[30934]: pgmap v136: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 26 op/s 2024-09-13T17:18:15.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:15 smithi149 ceph-mon[35496]: pgmap v136: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 26 op/s 2024-09-13T17:18:15.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:15 smithi118 ceph-mon[34374]: pgmap v136: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 26 op/s 2024-09-13T17:18:16.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:16 smithi149 ceph-mon[35496]: scrub queued for path: / 2024-09-13T17:18:16.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:16 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:18:16.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:16 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:18:16.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:16 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:18:16.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:16 smithi118 ceph-mon[34374]: scrub queued for path: / 2024-09-13T17:18:16.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:16 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:18:16.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:16 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:18:16.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:16 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:18:16.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:16 smithi087 ceph-mon[30934]: scrub queued for path: / 2024-09-13T17:18:16.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:16 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:18:16.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:16 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:18:16.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:16 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:18:17.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:17 smithi149 ceph-mon[35496]: pgmap v137: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-13T17:18:17.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:17 smithi118 ceph-mon[34374]: pgmap v137: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-13T17:18:17.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:17 smithi087 ceph-mon[30934]: pgmap v137: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-13T17:18:19.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:19 smithi149 ceph-mon[35496]: pgmap v138: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-13T17:18:19.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:19 smithi118 ceph-mon[34374]: pgmap v138: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-13T17:18:19.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:19 smithi087 ceph-mon[30934]: pgmap v138: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-13T17:18:20.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:20 smithi149 ceph-mon[35496]: scrub summary: idle 2024-09-13T17:18:20.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:20 smithi118 ceph-mon[34374]: scrub summary: idle 2024-09-13T17:18:20.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:20 smithi087 ceph-mon[30934]: scrub summary: idle 2024-09-13T17:18:21.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:21 smithi149 ceph-mon[35496]: pgmap v139: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-13T17:18:21.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:21 smithi118 ceph-mon[34374]: pgmap v139: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-13T17:18:21.981 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:21 smithi087 ceph-mon[30934]: pgmap v139: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-13T17:18:23.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:23 smithi149 ceph-mon[35496]: pgmap v140: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:18:23.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:23 smithi118 ceph-mon[34374]: pgmap v140: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:18:23.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:23 smithi087 ceph-mon[30934]: pgmap v140: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:18:25.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:25 smithi149 ceph-mon[35496]: pgmap v141: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:18:25.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:25 smithi118 ceph-mon[34374]: pgmap v141: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:18:25.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:25 smithi087 ceph-mon[30934]: pgmap v141: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:18:27.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:27 smithi149 ceph-mon[35496]: pgmap v142: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:18:27.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:27 smithi118 ceph-mon[34374]: pgmap v142: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:18:27.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:27 smithi087 ceph-mon[30934]: pgmap v142: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:18:29.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:29 smithi149 ceph-mon[35496]: pgmap v143: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:18:29.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:29 smithi118 ceph-mon[34374]: pgmap v143: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:18:29.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:29 smithi087 ceph-mon[30934]: pgmap v143: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:18:31.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:31 smithi149 ceph-mon[35496]: pgmap v144: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:18:31.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:31 smithi118 ceph-mon[34374]: pgmap v144: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:18:31.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:31 smithi087 ceph-mon[30934]: pgmap v144: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:18:33.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:33 smithi149 ceph-mon[35496]: pgmap v145: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:18:33.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:33 smithi118 ceph-mon[34374]: pgmap v145: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:18:33.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:33 smithi087 ceph-mon[30934]: pgmap v145: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:18:35.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:35 smithi149 ceph-mon[35496]: pgmap v146: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:18:35.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:35 smithi118 ceph-mon[34374]: pgmap v146: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:18:35.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:35 smithi087 ceph-mon[30934]: pgmap v146: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:18:37.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:37 smithi149 ceph-mon[35496]: pgmap v147: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:18:37.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:37 smithi118 ceph-mon[34374]: pgmap v147: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:18:37.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:37 smithi087 ceph-mon[30934]: pgmap v147: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:18:39.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:39 smithi149 ceph-mon[35496]: pgmap v148: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:18:39.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:39 smithi118 ceph-mon[34374]: pgmap v148: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:18:39.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:39 smithi087 ceph-mon[30934]: pgmap v148: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:18:41.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:41 smithi149 ceph-mon[35496]: pgmap v149: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:18:41.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:41 smithi118 ceph-mon[34374]: pgmap v149: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:18:41.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:41 smithi087 ceph-mon[30934]: pgmap v149: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:18:43.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:43 smithi149 ceph-mon[35496]: pgmap v150: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:18:43.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:43 smithi118 ceph-mon[34374]: pgmap v150: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:18:43.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:43 smithi087 ceph-mon[30934]: pgmap v150: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:18:45.436 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:18:45.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.551+0000 7fa291261640 1 -- 172.21.15.87:0/3136469726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa28c0ff810 msgr2=0x7fa28c103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.551+0000 7fa291261640 1 --2- 172.21.15.87:0/3136469726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa28c0ff810 0x7fa28c103850 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fa280009930 tx=0x7fa28002a420 comp rx=0 tx=0).stop 2024-09-13T17:18:45.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.551+0000 7fa291261640 1 -- 172.21.15.87:0/3136469726 shutdown_connections 2024-09-13T17:18:45.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.551+0000 7fa291261640 1 --2- 172.21.15.87:0/3136469726 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa28c103fb0 0x7fa28c10bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.551+0000 7fa291261640 1 --2- 172.21.15.87:0/3136469726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa28c0ff810 0x7fa28c103850 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.551+0000 7fa291261640 1 --2- 172.21.15.87:0/3136469726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa28c0fee60 0x7fa28c0ff240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.551+0000 7fa291261640 1 -- 172.21.15.87:0/3136469726 >> 172.21.15.87:0/3136469726 conn(0x7fa28c075c60 msgr2=0x7fa28c0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:45.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.551+0000 7fa291261640 1 -- 172.21.15.87:0/3136469726 shutdown_connections 2024-09-13T17:18:45.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.551+0000 7fa291261640 1 -- 172.21.15.87:0/3136469726 wait complete. 2024-09-13T17:18:45.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.551+0000 7fa291261640 1 Processor -- start 2024-09-13T17:18:45.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.551+0000 7fa291261640 1 -- start start 2024-09-13T17:18:45.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.552+0000 7fa291261640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa28c0fee60 0x7fa28c1962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.552+0000 7fa291261640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa28c103fb0 0x7fa28c196810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.552+0000 7fa291261640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa28c19ac00 0x7fa28c19b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.552+0000 7fa291261640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c19b5f0 con 0x7fa28c103fb0 2024-09-13T17:18:45.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.552+0000 7fa291261640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c19b760 con 0x7fa28c19ac00 2024-09-13T17:18:45.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.552+0000 7fa291261640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c19b8d0 con 0x7fa28c0fee60 2024-09-13T17:18:45.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.552+0000 7fa28a7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa28c103fb0 0x7fa28c196810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.552+0000 7fa28a7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa28c103fb0 0x7fa28c196810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37090/0 (socket says 172.21.15.87:37090) 2024-09-13T17:18:45.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.552+0000 7fa28a7fc640 1 -- 172.21.15.87:0/617366620 learned_addr learned my addr 172.21.15.87:0/617366620 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:45.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.552+0000 7fa28b7fe640 1 --2- 172.21.15.87:0/617366620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa28c19ac00 0x7fa28c19b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.552+0000 7fa28affd640 1 --2- 172.21.15.87:0/617366620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa28c0fee60 0x7fa28c1962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.552+0000 7fa28a7fc640 1 -- 172.21.15.87:0/617366620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa28c0fee60 msgr2=0x7fa28c1962d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.552+0000 7fa28a7fc640 1 --2- 172.21.15.87:0/617366620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa28c0fee60 0x7fa28c1962d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.552+0000 7fa28a7fc640 1 -- 172.21.15.87:0/617366620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa28c19ac00 msgr2=0x7fa28c19b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.552+0000 7fa28a7fc640 1 --2- 172.21.15.87:0/617366620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa28c19ac00 0x7fa28c19b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.552+0000 7fa28a7fc640 1 -- 172.21.15.87:0/617366620 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa280009560 con 0x7fa28c103fb0 2024-09-13T17:18:45.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.552+0000 7fa28affd640 1 --2- 172.21.15.87:0/617366620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa28c0fee60 0x7fa28c1962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:45.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.552+0000 7fa28a7fc640 1 --2- 172.21.15.87:0/617366620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa28c103fb0 0x7fa28c196810 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fa280009900 tx=0x7fa2800042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:45.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.552+0000 7fa273fff640 1 -- 172.21.15.87:0/617366620 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa280003a00 con 0x7fa28c103fb0 2024-09-13T17:18:45.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.552+0000 7fa273fff640 1 -- 172.21.15.87:0/617366620 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa2800044e0 con 0x7fa28c103fb0 2024-09-13T17:18:45.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.553+0000 7fa291261640 1 -- 172.21.15.87:0/617366620 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa28c1a2eb0 con 0x7fa28c103fb0 2024-09-13T17:18:45.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.553+0000 7fa273fff640 1 -- 172.21.15.87:0/617366620 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28003a3c0 con 0x7fa28c103fb0 2024-09-13T17:18:45.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.553+0000 7fa291261640 1 -- 172.21.15.87:0/617366620 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa28c1a3220 con 0x7fa28c103fb0 2024-09-13T17:18:45.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.555+0000 7fa273fff640 1 -- 172.21.15.87:0/617366620 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fa28003b460 con 0x7fa28c103fb0 2024-09-13T17:18:45.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.555+0000 7fa29405e740 1 Processor -- start 2024-09-13T17:18:45.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.555+0000 7fa29405e740 1 -- start start 2024-09-13T17:18:45.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.555+0000 7fa29405e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55567f1cae10 0x55567f1cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.555+0000 7fa29405e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55567f1cb730 0x55567f1d5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.555+0000 7fa29405e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55567f1d5fd0 0x55567f1d83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.555+0000 7fa29405e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55567f135f20 con 0x55567f1cb730 2024-09-13T17:18:45.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.556+0000 7fa29405e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55567f1336b0 con 0x55567f1d5fd0 2024-09-13T17:18:45.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.556+0000 7fa29405e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55567f12efa0 con 0x55567f1cae10 2024-09-13T17:18:45.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.556+0000 7fa273fff640 1 --2- 172.21.15.87:0/617366620 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa2740a1200 0x7fa2740a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.556+0000 7fa28affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55567f1cb730 0x55567f1d5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.556+0000 7fa28affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55567f1cb730 0x55567f1d5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37094/0 (socket says 172.21.15.87:37094) 2024-09-13T17:18:45.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.556+0000 7fa28affd640 1 -- 172.21.15.87:0/2383409307 learned_addr learned my addr 172.21.15.87:0/2383409307 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:45.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.556+0000 7fa28b7fe640 1 --2- 172.21.15.87:0/2383409307 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55567f1cae10 0x55567f1cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.556+0000 7fa28b7fe640 1 --2- 172.21.15.87:0/617366620 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa2740a1200 0x7fa2740a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.556+0000 7fa273fff640 1 -- 172.21.15.87:0/617366620 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fa2800ee0b0 con 0x7fa28c103fb0 2024-09-13T17:18:45.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.556+0000 7fa28a7fc640 1 --2- 172.21.15.87:0/2383409307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55567f1d5fd0 0x55567f1d83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.556+0000 7fa28affd640 1 -- 172.21.15.87:0/2383409307 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55567f1cae10 msgr2=0x55567f1cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:45.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.556+0000 7fa28affd640 1 --2- 172.21.15.87:0/2383409307 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55567f1cae10 0x55567f1cb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.556+0000 7fa28affd640 1 -- 172.21.15.87:0/2383409307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55567f1d5fd0 msgr2=0x55567f1d83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:45.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.556+0000 7fa28affd640 1 --2- 172.21.15.87:0/2383409307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55567f1d5fd0 0x55567f1d83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.556+0000 7fa28affd640 1 -- 172.21.15.87:0/2383409307 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55567f0e9840 con 0x55567f1cb730 2024-09-13T17:18:45.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.556+0000 7fa28a7fc640 1 --2- 172.21.15.87:0/2383409307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55567f1d5fd0 0x55567f1d83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:45.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.556+0000 7fa28affd640 1 --2- 172.21.15.87:0/2383409307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55567f1cb730 0x55567f1d5a90 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fa27c0103a0 tx=0x7fa27c010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f417fb66d4bacbe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:45.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.556+0000 7fa28b7fe640 1 --2- 172.21.15.87:0/617366620 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa2740a1200 0x7fa2740a36c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa284005fd0 tx=0x7fa28400b260 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:45.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.556+0000 7fa2717fa640 1 -- 172.21.15.87:0/2383409307 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c012710 con 0x55567f1cb730 2024-09-13T17:18:45.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.556+0000 7fa2717fa640 1 -- 172.21.15.87:0/2383409307 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa27c012d20 con 0x55567f1cb730 2024-09-13T17:18:45.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.556+0000 7fa2717fa640 1 -- 172.21.15.87:0/2383409307 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c01bd20 con 0x55567f1cb730 2024-09-13T17:18:45.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.557+0000 7fa29405e740 1 -- 172.21.15.87:0/2383409307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55567f1cb730 msgr2=0x55567f1d5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.557+0000 7fa29405e740 1 --2- 172.21.15.87:0/2383409307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55567f1cb730 0x55567f1d5a90 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fa27c0103a0 tx=0x7fa27c010860 comp rx=0 tx=0).stop 2024-09-13T17:18:45.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.557+0000 7fa29405e740 1 -- 172.21.15.87:0/2383409307 shutdown_connections 2024-09-13T17:18:45.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.557+0000 7fa29405e740 1 --2- 172.21.15.87:0/2383409307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55567f1d5fd0 0x55567f1d83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.557+0000 7fa29405e740 1 --2- 172.21.15.87:0/2383409307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55567f1cb730 0x55567f1d5a90 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.557+0000 7fa29405e740 1 --2- 172.21.15.87:0/2383409307 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55567f1cae10 0x55567f1cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.557+0000 7fa29405e740 1 -- 172.21.15.87:0/2383409307 >> 172.21.15.87:0/2383409307 conn(0x55567f1c7380 msgr2=0x55567f1c7760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:45.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.557+0000 7fa29405e740 1 -- 172.21.15.87:0/2383409307 shutdown_connections 2024-09-13T17:18:45.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.557+0000 7fa29405e740 1 -- 172.21.15.87:0/2383409307 wait complete. 2024-09-13T17:18:45.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.557+0000 7fa29405e740 1 -- start start 2024-09-13T17:18:45.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.558+0000 7fa29405e740 1 Processor -- start 2024-09-13T17:18:45.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.558+0000 7fa29405e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55567f1cae10 0x55567f1da0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.558+0000 7fa29405e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55567f1cb730 0x55567f1da620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.558+0000 7fa29405e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55567f1d5fd0 0x55567f1de730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.558+0000 7fa29405e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55567f0d02a0 con 0x55567f1cae10 2024-09-13T17:18:45.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.558+0000 7fa29405e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55567ee07430 con 0x55567f1cb730 2024-09-13T17:18:45.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.558+0000 7fa29405e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55567f0b2680 con 0x55567f1d5fd0 2024-09-13T17:18:45.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.558+0000 7fa29405e740 10 client.0 _ll_register_callbacks cb 0x55567f128610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:18:45.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.558+0000 7fa28affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55567f1cae10 0x55567f1da0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.558+0000 7fa28affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55567f1cae10 0x55567f1da0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37104/0 (socket says 172.21.15.87:37104) 2024-09-13T17:18:45.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.558+0000 7fa28affd640 1 -- 172.21.15.87:0/3833624126 learned_addr learned my addr 172.21.15.87:0/3833624126 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:45.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.558+0000 7fa28a7fc640 1 --2- 172.21.15.87:0/3833624126 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55567f1cb730 0x55567f1da620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.558+0000 7fa28b7fe640 1 --2- 172.21.15.87:0/3833624126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55567f1d5fd0 0x55567f1de730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.558+0000 7fa28affd640 1 -- 172.21.15.87:0/3833624126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55567f1d5fd0 msgr2=0x55567f1de730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:45.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.558+0000 7fa28affd640 1 --2- 172.21.15.87:0/3833624126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55567f1d5fd0 0x55567f1de730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.558+0000 7fa28affd640 1 -- 172.21.15.87:0/3833624126 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55567f1cb730 msgr2=0x55567f1da620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:45.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.558+0000 7fa28affd640 1 --2- 172.21.15.87:0/3833624126 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55567f1cb730 0x55567f1da620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.558+0000 7fa28affd640 1 -- 172.21.15.87:0/3833624126 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa27c009c60 con 0x55567f1cae10 2024-09-13T17:18:45.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.558+0000 7fa28b7fe640 1 --2- 172.21.15.87:0/3833624126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55567f1d5fd0 0x55567f1de730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:45.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.558+0000 7fa28affd640 1 --2- 172.21.15.87:0/3833624126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55567f1cae10 0x55567f1da0e0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fa27c010370 tx=0x7fa27c01b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1c9cb882790e94 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:45.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.558+0000 7fa26eff5640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:18:45.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.558+0000 7fa26eff5640 1 -- 172.21.15.87:0/3833624126 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c021070 con 0x55567f1cae10 2024-09-13T17:18:45.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.558+0000 7fa26eff5640 1 -- 172.21.15.87:0/3833624126 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fa27c01bcb0 con 0x55567f1cae10 2024-09-13T17:18:45.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.559+0000 7fa29405e740 1 -- 172.21.15.87:0/3833624126 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55567ee224e0 con 0x55567f1cae10 2024-09-13T17:18:45.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.559+0000 7fa26eff5640 1 -- 172.21.15.87:0/3833624126 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa27c01be70 con 0x55567f1cae10 2024-09-13T17:18:45.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.559+0000 7fa29405e740 10 client.16923 fetch_fsmap learned FSMap version 30 2024-09-13T17:18:45.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.559+0000 7fa29405e740 1 -- 172.21.15.87:0/3833624126 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55567f12d620 con 0x55567f1cae10 2024-09-13T17:18:45.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.559+0000 7fa26eff5640 1 -- 172.21.15.87:0/3833624126 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55567ee224e0 con 0x55567f1cae10 2024-09-13T17:18:45.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.559+0000 7fa26eff5640 1 -- 172.21.15.87:0/3833624126 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fa27c0125a0 con 0x55567f1cae10 2024-09-13T17:18:45.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.559+0000 7fa29405e740 10 client.16923 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:18:45.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.559+0000 7fa29405e740 10 client.16923 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:18:45.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.559+0000 7fa29405e740 20 client.16923 populate_metadata read hostname 'smithi087' 2024-09-13T17:18:45.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.559+0000 7fa29405e740 1 --2- 172.21.15.87:0/3833624126 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55567f1ea130 0x55567f1ec550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.559+0000 7fa29405e740 4 client.16923 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:18:45.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.559+0000 7fa29405e740 1 -- 172.21.15.87:0/3833624126 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55567ee337e0 con 0x55567f1ea130 2024-09-13T17:18:45.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.559+0000 7fa28a7fc640 1 --2- 172.21.15.87:0/3833624126 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55567f1ea130 0x55567f1ec550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.560+0000 7fa26eff5640 10 client.16923 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:18:45.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.560+0000 7fa28a7fc640 1 --2- 172.21.15.87:0/3833624126 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55567f1ea130 0x55567f1ec550 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68eb0a629a431bd6 server_cookie=d22809e83ca83ec4 in_seq=0 out_seq=0 2024-09-13T17:18:45.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.560+0000 7fa26eff5640 1 -- 172.21.15.87:0/3833624126 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55567ee337e0 con 0x55567f1ea130 2024-09-13T17:18:45.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.560+0000 7fa26eff5640 10 client.16923 handle_command_reply: tid=0 2024-09-13T17:18:45.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.560+0000 7fa29405e740 1 client.16923 shutdown 2024-09-13T17:18:45.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.561+0000 7fa29405e740 1 -- 172.21.15.87:0/3833624126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55567f1cae10 msgr2=0x55567f1da0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.561+0000 7fa29405e740 1 --2- 172.21.15.87:0/3833624126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55567f1cae10 0x55567f1da0e0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fa27c010370 tx=0x7fa27c01b690 comp rx=0 tx=0).stop 2024-09-13T17:18:45.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.561+0000 7fa29405e740 1 -- 172.21.15.87:0/3833624126 shutdown_connections 2024-09-13T17:18:45.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.561+0000 7fa29405e740 1 --2- 172.21.15.87:0/3833624126 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55567f1ea130 0x55567f1ec550 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.561+0000 7fa29405e740 1 --2- 172.21.15.87:0/3833624126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55567f1d5fd0 0x55567f1de730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.561+0000 7fa29405e740 1 --2- 172.21.15.87:0/3833624126 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55567f1cb730 0x55567f1da620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.561+0000 7fa26eff5640 0 client.16923 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:18:45.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.561+0000 7fa29405e740 1 --2- 172.21.15.87:0/3833624126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55567f1cae10 0x55567f1da0e0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.561+0000 7fa29405e740 1 -- 172.21.15.87:0/3833624126 >> 172.21.15.87:0/3833624126 conn(0x55567f1c7380 msgr2=0x55567f1cd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:45.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.561+0000 7fa29405e740 1 -- 172.21.15.87:0/3833624126 shutdown_connections 2024-09-13T17:18:45.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.561+0000 7fa29405e740 1 -- 172.21.15.87:0/3833624126 wait complete. 2024-09-13T17:18:45.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.561+0000 7fa29405e740 20 client.16923 trim_cache size 0 max 16384 2024-09-13T17:18:45.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.575+0000 7fa29405e740 1 Processor -- start 2024-09-13T17:18:45.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.575+0000 7fa29405e740 1 -- start start 2024-09-13T17:18:45.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.575+0000 7fa29405e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55567f1cae10 0x55567f1de720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.575+0000 7fa29405e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55567f1cb730 0x55567f1e6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.575+0000 7fa29405e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55567f1d5fd0 0x55567f1c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.575+0000 7fa29405e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55567f1c7240 con 0x55567f1cb730 2024-09-13T17:18:45.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.575+0000 7fa29405e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55567f1e8a50 con 0x55567f1d5fd0 2024-09-13T17:18:45.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.575+0000 7fa29405e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55567f1e6fd0 con 0x55567f1cae10 2024-09-13T17:18:45.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.575+0000 7fa28a7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55567f1cb730 0x55567f1e6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.575+0000 7fa28a7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55567f1cb730 0x55567f1e6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37112/0 (socket says 172.21.15.87:37112) 2024-09-13T17:18:45.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.575+0000 7fa28a7fc640 1 -- 172.21.15.87:0/54164093 learned_addr learned my addr 172.21.15.87:0/54164093 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:45.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.575+0000 7fa28affd640 1 --2- 172.21.15.87:0/54164093 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55567f1cae10 0x55567f1de720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.575+0000 7fa28a7fc640 1 -- 172.21.15.87:0/54164093 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55567f1cae10 msgr2=0x55567f1de720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:45.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.575+0000 7fa28a7fc640 1 --2- 172.21.15.87:0/54164093 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55567f1cae10 0x55567f1de720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.575+0000 7fa28a7fc640 1 -- 172.21.15.87:0/54164093 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55567f1d5fd0 msgr2=0x55567f1c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:45.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.575+0000 7fa28b7fe640 1 --2- 172.21.15.87:0/54164093 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55567f1d5fd0 0x55567f1c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.575+0000 7fa28a7fc640 1 --2- 172.21.15.87:0/54164093 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55567f1d5fd0 0x55567f1c6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.576+0000 7fa28a7fc640 1 -- 172.21.15.87:0/54164093 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55567f0cf790 con 0x55567f1cb730 2024-09-13T17:18:45.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.576+0000 7fa28a7fc640 1 --2- 172.21.15.87:0/54164093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55567f1cb730 0x55567f1e6520 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fa2800b72b0 tx=0x7fa28002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd129837ab615dd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:45.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.576+0000 7fa271ffb640 1 -- 172.21.15.87:0/54164093 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2800d2070 con 0x55567f1cb730 2024-09-13T17:18:45.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.576+0000 7fa271ffb640 1 -- 172.21.15.87:0/54164093 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa2800bebe0 con 0x55567f1cb730 2024-09-13T17:18:45.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.576+0000 7fa271ffb640 1 -- 172.21.15.87:0/54164093 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2800b74c0 con 0x55567f1cb730 2024-09-13T17:18:45.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.576+0000 7fa29405e740 1 -- 172.21.15.87:0/54164093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55567f1cb730 msgr2=0x55567f1e6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.576+0000 7fa29405e740 1 --2- 172.21.15.87:0/54164093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55567f1cb730 0x55567f1e6520 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fa2800b72b0 tx=0x7fa28002a420 comp rx=0 tx=0).stop 2024-09-13T17:18:45.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.577+0000 7fa29405e740 1 -- 172.21.15.87:0/54164093 shutdown_connections 2024-09-13T17:18:45.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.577+0000 7fa29405e740 1 --2- 172.21.15.87:0/54164093 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55567f1d5fd0 0x55567f1c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.577+0000 7fa29405e740 1 --2- 172.21.15.87:0/54164093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55567f1cb730 0x55567f1e6520 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.577+0000 7fa29405e740 1 --2- 172.21.15.87:0/54164093 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55567f1cae10 0x55567f1de720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.577+0000 7fa29405e740 1 -- 172.21.15.87:0/54164093 >> 172.21.15.87:0/54164093 conn(0x55567f1c7380 msgr2=0x55567f1f0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:45.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.577+0000 7fa29405e740 1 -- 172.21.15.87:0/54164093 shutdown_connections 2024-09-13T17:18:45.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.577+0000 7fa29405e740 1 -- 172.21.15.87:0/54164093 wait complete. 2024-09-13T17:18:45.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.577+0000 7fa29405e740 1 -- start start 2024-09-13T17:18:45.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.577+0000 7fa29405e740 1 Processor -- start 2024-09-13T17:18:45.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.577+0000 7fa29405e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55567f1cae10 0x55567f1dfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.577+0000 7fa29405e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55567f1cb730 0x55567f1e0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.577+0000 7fa29405e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55567f1d5fd0 0x55567f1e31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.577+0000 7fa29405e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55567f1e3720 con 0x55567f1cae10 2024-09-13T17:18:45.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.577+0000 7fa29405e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55567f1e3890 con 0x55567f1d5fd0 2024-09-13T17:18:45.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.577+0000 7fa29405e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55567f1e3a50 con 0x55567f1cb730 2024-09-13T17:18:45.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.577+0000 7fa29405e740 10 client.0 _ll_register_callbacks cb 0x7fa28400bb40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:18:45.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.577+0000 7fa28affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55567f1cae10 0x55567f1dfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.577+0000 7fa28affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55567f1cae10 0x55567f1dfde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37114/0 (socket says 172.21.15.87:37114) 2024-09-13T17:18:45.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.577+0000 7fa28affd640 1 -- 172.21.15.87:0/878395574 learned_addr learned my addr 172.21.15.87:0/878395574 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:45.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.577+0000 7fa28a7fc640 1 --2- 172.21.15.87:0/878395574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55567f1cb730 0x55567f1e0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.578+0000 7fa28b7fe640 1 --2- 172.21.15.87:0/878395574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55567f1d5fd0 0x55567f1e31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.578+0000 7fa28affd640 1 -- 172.21.15.87:0/878395574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55567f1cb730 msgr2=0x55567f1e0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:45.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.578+0000 7fa28affd640 1 --2- 172.21.15.87:0/878395574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55567f1cb730 0x55567f1e0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.578+0000 7fa28affd640 1 -- 172.21.15.87:0/878395574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55567f1d5fd0 msgr2=0x55567f1e31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:45.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.578+0000 7fa28affd640 1 --2- 172.21.15.87:0/878395574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55567f1d5fd0 0x55567f1e31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.578+0000 7fa28affd640 1 -- 172.21.15.87:0/878395574 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa28c1a3220 con 0x55567f1cae10 2024-09-13T17:18:45.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.578+0000 7fa28affd640 1 --2- 172.21.15.87:0/878395574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55567f1cae10 0x55567f1dfde0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fa27c0108a0 tx=0x7fa27c005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f82c189e4d6e80c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:45.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.578+0000 7fa26eff5640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:18:45.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.578+0000 7fa26eff5640 1 -- 172.21.15.87:0/878395574 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c021040 con 0x55567f1cae10 2024-09-13T17:18:45.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.578+0000 7fa26eff5640 1 -- 172.21.15.87:0/878395574 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fa27c009e80 con 0x55567f1cae10 2024-09-13T17:18:45.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.578+0000 7fa29405e740 1 -- 172.21.15.87:0/878395574 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa27c012d20 con 0x55567f1cae10 2024-09-13T17:18:45.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.578+0000 7fa26eff5640 1 -- 172.21.15.87:0/878395574 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa27c009a30 con 0x55567f1cae10 2024-09-13T17:18:45.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.578+0000 7fa29405e740 10 client.16929 fetch_fsmap learned FSMap version 30 2024-09-13T17:18:45.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.578+0000 7fa29405e740 1 -- 172.21.15.87:0/878395574 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55567f0f4ea0 con 0x55567f1cae10 2024-09-13T17:18:45.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.578+0000 7fa26eff5640 1 -- 172.21.15.87:0/878395574 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa27c040020 con 0x55567f1cae10 2024-09-13T17:18:45.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.578+0000 7fa26eff5640 1 -- 172.21.15.87:0/878395574 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fa27c03d070 con 0x55567f1cae10 2024-09-13T17:18:45.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.578+0000 7fa29405e740 10 client.16929 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:18:45.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.578+0000 7fa29405e740 10 client.16929 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:18:45.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.578+0000 7fa29405e740 20 client.16929 populate_metadata read hostname 'smithi087' 2024-09-13T17:18:45.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.578+0000 7fa29405e740 1 --2- 172.21.15.87:0/878395574 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55567f241630 0x55567f243a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.578+0000 7fa29405e740 4 client.16929 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:18:45.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.578+0000 7fa29405e740 1 -- 172.21.15.87:0/878395574 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55567ee86e30 con 0x55567f241630 2024-09-13T17:18:45.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.579+0000 7fa28a7fc640 1 --2- 172.21.15.87:0/878395574 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55567f241630 0x55567f243a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.579+0000 7fa26eff5640 10 client.16929 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:18:45.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.579+0000 7fa28a7fc640 1 --2- 172.21.15.87:0/878395574 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55567f241630 0x55567f243a50 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ba0270610451060 server_cookie=d22e14c655f6fcf6 in_seq=0 out_seq=0 2024-09-13T17:18:45.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.579+0000 7fa26eff5640 1 -- 172.21.15.87:0/878395574 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55567ee86e30 con 0x55567f241630 2024-09-13T17:18:45.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.579+0000 7fa26eff5640 10 client.16929 handle_command_reply: tid=0 2024-09-13T17:18:45.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.579+0000 7fa29405e740 1 client.16929 shutdown 2024-09-13T17:18:45.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.580+0000 7fa29405e740 1 -- 172.21.15.87:0/878395574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55567f1cae10 msgr2=0x55567f1dfde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.580+0000 7fa29405e740 1 --2- 172.21.15.87:0/878395574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55567f1cae10 0x55567f1dfde0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fa27c0108a0 tx=0x7fa27c005f10 comp rx=0 tx=0).stop 2024-09-13T17:18:45.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.580+0000 7fa29405e740 1 -- 172.21.15.87:0/878395574 shutdown_connections 2024-09-13T17:18:45.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.580+0000 7fa29405e740 1 --2- 172.21.15.87:0/878395574 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55567f241630 0x55567f243a50 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.580+0000 7fa29405e740 1 --2- 172.21.15.87:0/878395574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55567f1d5fd0 0x55567f1e31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.580+0000 7fa26eff5640 0 client.16929 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:18:45.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.580+0000 7fa29405e740 1 --2- 172.21.15.87:0/878395574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55567f1cb730 0x55567f1e0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.580+0000 7fa29405e740 1 --2- 172.21.15.87:0/878395574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55567f1cae10 0x55567f1dfde0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.580+0000 7fa29405e740 1 -- 172.21.15.87:0/878395574 >> 172.21.15.87:0/878395574 conn(0x55567f1c7380 msgr2=0x55567f1d23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:45.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.580+0000 7fa29405e740 1 -- 172.21.15.87:0/878395574 shutdown_connections 2024-09-13T17:18:45.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.580+0000 7fa29405e740 1 -- 172.21.15.87:0/878395574 wait complete. 2024-09-13T17:18:45.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.580+0000 7fa29405e740 20 client.16929 trim_cache size 0 max 16384 2024-09-13T17:18:45.589 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:18:45.589 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "no active scrubs running", 2024-09-13T17:18:45.589 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": {} 2024-09-13T17:18:45.589 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:18:45.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.580+0000 7fa291261640 1 -- 172.21.15.87:0/617366620 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa2740a1200 msgr2=0x7fa2740a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.580+0000 7fa291261640 1 --2- 172.21.15.87:0/617366620 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa2740a1200 0x7fa2740a36c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa284005fd0 tx=0x7fa28400b260 comp rx=0 tx=0).stop 2024-09-13T17:18:45.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.580+0000 7fa291261640 1 -- 172.21.15.87:0/617366620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa28c103fb0 msgr2=0x7fa28c196810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.580+0000 7fa291261640 1 --2- 172.21.15.87:0/617366620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa28c103fb0 0x7fa28c196810 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fa280009900 tx=0x7fa2800042f0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.580+0000 7fa291261640 1 -- 172.21.15.87:0/617366620 shutdown_connections 2024-09-13T17:18:45.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.580+0000 7fa291261640 1 --2- 172.21.15.87:0/617366620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa28c19ac00 0x7fa28c19b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.580+0000 7fa291261640 1 --2- 172.21.15.87:0/617366620 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa2740a1200 0x7fa2740a36c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.580+0000 7fa291261640 1 --2- 172.21.15.87:0/617366620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa28c103fb0 0x7fa28c196810 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.580+0000 7fa291261640 1 --2- 172.21.15.87:0/617366620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa28c0fee60 0x7fa28c1962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.580+0000 7fa291261640 1 -- 172.21.15.87:0/617366620 >> 172.21.15.87:0/617366620 conn(0x7fa28c075c60 msgr2=0x7fa28c0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:45.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.580+0000 7fa291261640 1 -- 172.21.15.87:0/617366620 shutdown_connections 2024-09-13T17:18:45.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.580+0000 7fa291261640 1 -- 172.21.15.87:0/617366620 wait complete. 2024-09-13T17:18:45.592 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T17:18:45.593 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:18:45.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.690+0000 7f96a9508640 1 -- 172.21.15.87:0/3858276353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a4100f80 msgr2=0x7f96a4101360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.690+0000 7f96a9508640 1 --2- 172.21.15.87:0/3858276353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a4100f80 0x7f96a4101360 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f9694009900 tx=0x7f969402a480 comp rx=0 tx=0).stop 2024-09-13T17:18:45.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.690+0000 7f96a9508640 1 -- 172.21.15.87:0/3858276353 shutdown_connections 2024-09-13T17:18:45.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.690+0000 7f96a9508640 1 --2- 172.21.15.87:0/3858276353 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96a410a3d0 0x7f96a410c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.690+0000 7f96a9508640 1 --2- 172.21.15.87:0/3858276353 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96a41018a0 0x7f96a4109d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.690+0000 7f96a9508640 1 --2- 172.21.15.87:0/3858276353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a4100f80 0x7f96a4101360 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.690+0000 7f96a9508640 1 -- 172.21.15.87:0/3858276353 >> 172.21.15.87:0/3858276353 conn(0x7f96a40fa970 msgr2=0x7f96a40fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:45.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.690+0000 7f96a9508640 1 -- 172.21.15.87:0/3858276353 shutdown_connections 2024-09-13T17:18:45.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.690+0000 7f96a9508640 1 -- 172.21.15.87:0/3858276353 wait complete. 2024-09-13T17:18:45.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.691+0000 7f96a9508640 1 Processor -- start 2024-09-13T17:18:45.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.691+0000 7f96a9508640 1 -- start start 2024-09-13T17:18:45.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.691+0000 7f96a9508640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a4100f80 0x7f96a40febd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.691+0000 7f96a9508640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96a41018a0 0x7f96a40ff110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.691+0000 7f96a9508640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96a410a3d0 0x7f96a40ff650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.691+0000 7f96a9508640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a41a4650 con 0x7f96a4100f80 2024-09-13T17:18:45.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.691+0000 7f96a9508640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a41a47c0 con 0x7f96a41018a0 2024-09-13T17:18:45.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.691+0000 7f96a9508640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a41a4980 con 0x7f96a410a3d0 2024-09-13T17:18:45.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.691+0000 7f96a2ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a4100f80 0x7f96a40febd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.691+0000 7f96a2ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a4100f80 0x7f96a40febd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37132/0 (socket says 172.21.15.87:37132) 2024-09-13T17:18:45.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.691+0000 7f96a2ffd640 1 -- 172.21.15.87:0/3300264682 learned_addr learned my addr 172.21.15.87:0/3300264682 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:45.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.691+0000 7f969bfff640 1 --2- 172.21.15.87:0/3300264682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96a41018a0 0x7f96a40ff110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.691+0000 7f96a2ffd640 1 -- 172.21.15.87:0/3300264682 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96a410a3d0 msgr2=0x7f96a40ff650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.691+0000 7f96a2ffd640 1 --2- 172.21.15.87:0/3300264682 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96a410a3d0 0x7f96a40ff650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.691+0000 7f96a2ffd640 1 -- 172.21.15.87:0/3300264682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96a41018a0 msgr2=0x7f96a40ff110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.691+0000 7f96a2ffd640 1 --2- 172.21.15.87:0/3300264682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96a41018a0 0x7f96a40ff110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.691+0000 7f96a2ffd640 1 -- 172.21.15.87:0/3300264682 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9694009560 con 0x7f96a4100f80 2024-09-13T17:18:45.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.691+0000 7f969bfff640 1 --2- 172.21.15.87:0/3300264682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96a41018a0 0x7f96a40ff110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:45.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.691+0000 7f96a2ffd640 1 --2- 172.21.15.87:0/3300264682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a4100f80 0x7f96a40febd0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f969402aa70 tx=0x7f96940042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:45.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.692+0000 7f96a0ff9640 1 -- 172.21.15.87:0/3300264682 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9694003a00 con 0x7f96a4100f80 2024-09-13T17:18:45.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.692+0000 7f96a0ff9640 1 -- 172.21.15.87:0/3300264682 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f96940044e0 con 0x7f96a4100f80 2024-09-13T17:18:45.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.692+0000 7f96a0ff9640 1 -- 172.21.15.87:0/3300264682 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969403a3c0 con 0x7f96a4100f80 2024-09-13T17:18:45.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.692+0000 7f96a9508640 1 -- 172.21.15.87:0/3300264682 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a41a4c00 con 0x7f96a4100f80 2024-09-13T17:18:45.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.692+0000 7f96a9508640 1 -- 172.21.15.87:0/3300264682 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a41a5060 con 0x7f96a4100f80 2024-09-13T17:18:45.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.693+0000 7f96a9508640 1 -- 172.21.15.87:0/3300264682 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a4068e70 con 0x7f96a4100f80 2024-09-13T17:18:45.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.694+0000 7f96a0ff9640 1 -- 172.21.15.87:0/3300264682 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f969403b460 con 0x7f96a4100f80 2024-09-13T17:18:45.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.695+0000 7f96a0ff9640 1 --2- 172.21.15.87:0/3300264682 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f96900a1200 0x7f96900a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:45.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.695+0000 7f969bfff640 1 --2- 172.21.15.87:0/3300264682 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f96900a1200 0x7f96900a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:45.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.695+0000 7f96a0ff9640 1 -- 172.21.15.87:0/3300264682 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f96940eddc0 con 0x7f96a4100f80 2024-09-13T17:18:45.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.695+0000 7f969bfff640 1 --2- 172.21.15.87:0/3300264682 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f96900a1200 0x7f96900a36c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f96a4100350 tx=0x7f968c005e30 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:45.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.699+0000 7f96a0ff9640 1 -- 172.21.15.87:0/3300264682 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f96940b6e60 con 0x7f96a4100f80 2024-09-13T17:18:45.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:45 smithi087 ceph-mon[30934]: pgmap v151: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:18:45.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:45 smithi149 ceph-mon[35496]: pgmap v151: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:18:45.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:45 smithi118 ceph-mon[34374]: pgmap v151: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:18:45.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.896+0000 7f96a9508640 1 -- 172.21.15.87:0/3300264682 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96a4105420 con 0x7f96a4100f80 2024-09-13T17:18:45.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.897+0000 7f96a0ff9640 1 -- 172.21.15.87:0/3300264682 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+10886 (secure 0 0 0) 0x7f9694035090 con 0x7f96a4100f80 2024-09-13T17:18:45.898 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:18:45.898 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/3674545180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":3674545180},{"type":"v1","addr":"172.21.15.87:6841","nonce":3674545180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:11:23.313609+0000","modified":"2024-09-13T17:16:22.516744+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24484,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6839/3052680456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3052680456},{"type":"v1","addr":"172.21.15.118:6839","nonce":3052680456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:18:45.898 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 30 2024-09-13T17:18:45.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.899+0000 7f96a9508640 1 -- 172.21.15.87:0/3300264682 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f96900a1200 msgr2=0x7f96900a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.899+0000 7f96a9508640 1 --2- 172.21.15.87:0/3300264682 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f96900a1200 0x7f96900a36c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f96a4100350 tx=0x7f968c005e30 comp rx=0 tx=0).stop 2024-09-13T17:18:45.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.899+0000 7f96a9508640 1 -- 172.21.15.87:0/3300264682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a4100f80 msgr2=0x7f96a40febd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:45.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.899+0000 7f96a9508640 1 --2- 172.21.15.87:0/3300264682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a4100f80 0x7f96a40febd0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f969402aa70 tx=0x7f96940042f0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.899+0000 7f96a9508640 1 -- 172.21.15.87:0/3300264682 shutdown_connections 2024-09-13T17:18:45.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.899+0000 7f96a9508640 1 --2- 172.21.15.87:0/3300264682 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96a410a3d0 0x7f96a40ff650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.899+0000 7f96a9508640 1 --2- 172.21.15.87:0/3300264682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96a41018a0 0x7f96a40ff110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.899+0000 7f96a9508640 1 --2- 172.21.15.87:0/3300264682 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f96900a1200 0x7f96900a36c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.899+0000 7f96a9508640 1 --2- 172.21.15.87:0/3300264682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96a4100f80 0x7f96a40febd0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:45.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.899+0000 7f96a9508640 1 -- 172.21.15.87:0/3300264682 >> 172.21.15.87:0/3300264682 conn(0x7f96a40fa970 msgr2=0x7f96a40fc100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:45.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.899+0000 7f96a9508640 1 -- 172.21.15.87:0/3300264682 shutdown_connections 2024-09-13T17:18:45.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:45.899+0000 7f96a9508640 1 -- 172.21.15.87:0/3300264682 wait complete. 2024-09-13T17:18:45.911 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-09-13T17:18:46.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.010+0000 7f755a176640 1 -- 172.21.15.87:0/879378514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75540fff60 msgr2=0x7f7554100340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.010+0000 7f755a176640 1 --2- 172.21.15.87:0/879378514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75540fff60 0x7f7554100340 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f7544009930 tx=0x7f754402a420 comp rx=0 tx=0).stop 2024-09-13T17:18:46.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.010+0000 7f755a176640 1 -- 172.21.15.87:0/879378514 shutdown_connections 2024-09-13T17:18:46.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.010+0000 7f755a176640 1 --2- 172.21.15.87:0/879378514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75541050b0 0x7f755410cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.010+0000 7f755a176640 1 --2- 172.21.15.87:0/879378514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7554100910 0x7f7554104950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.010+0000 7f755a176640 1 --2- 172.21.15.87:0/879378514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75540fff60 0x7f7554100340 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.011+0000 7f755a176640 1 -- 172.21.15.87:0/879378514 >> 172.21.15.87:0/879378514 conn(0x7f75540fb9f0 msgr2=0x7f75540fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:46.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.011+0000 7f755a176640 1 -- 172.21.15.87:0/879378514 shutdown_connections 2024-09-13T17:18:46.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.011+0000 7f755a176640 1 -- 172.21.15.87:0/879378514 wait complete. 2024-09-13T17:18:46.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.011+0000 7f755a176640 1 Processor -- start 2024-09-13T17:18:46.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.011+0000 7f755a176640 1 -- start start 2024-09-13T17:18:46.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.011+0000 7f755a176640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75540fff60 0x7f75541963f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.011+0000 7f755a176640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75541050b0 0x7f7554196930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.011+0000 7f755a176640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f755419acd0 0x7f755419b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.011+0000 7f755a176640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755419b6c0 con 0x7f75540fff60 2024-09-13T17:18:46.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.011+0000 7f755a176640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755419b830 con 0x7f75541050b0 2024-09-13T17:18:46.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.011+0000 7f755a176640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755419b9a0 con 0x7f755419acd0 2024-09-13T17:18:46.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.012+0000 7f75537fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75540fff60 0x7f75541963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.012+0000 7f75537fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75540fff60 0x7f75541963f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37148/0 (socket says 172.21.15.87:37148) 2024-09-13T17:18:46.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.012+0000 7f75537fe640 1 -- 172.21.15.87:0/4013061983 learned_addr learned my addr 172.21.15.87:0/4013061983 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:46.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.012+0000 7f7553fff640 1 --2- 172.21.15.87:0/4013061983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f755419acd0 0x7f755419b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.012+0000 7f75537fe640 1 -- 172.21.15.87:0/4013061983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f755419acd0 msgr2=0x7f755419b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.012+0000 7f75537fe640 1 --2- 172.21.15.87:0/4013061983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f755419acd0 0x7f755419b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.012+0000 7f75537fe640 1 -- 172.21.15.87:0/4013061983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75541050b0 msgr2=0x7f7554196930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.012+0000 7f75537fe640 1 --2- 172.21.15.87:0/4013061983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75541050b0 0x7f7554196930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.012+0000 7f75537fe640 1 -- 172.21.15.87:0/4013061983 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7544009560 con 0x7f75540fff60 2024-09-13T17:18:46.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.012+0000 7f7553fff640 1 --2- 172.21.15.87:0/4013061983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f755419acd0 0x7f755419b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:46.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.012+0000 7f75537fe640 1 --2- 172.21.15.87:0/4013061983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75540fff60 0x7f75541963f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f7544005760 tx=0x7f7544004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:46.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.012+0000 7f75517fa640 1 -- 172.21.15.87:0/4013061983 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7544004520 con 0x7f75540fff60 2024-09-13T17:18:46.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.012+0000 7f75517fa640 1 -- 172.21.15.87:0/4013061983 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7544031c40 con 0x7f75540fff60 2024-09-13T17:18:46.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.012+0000 7f755a176640 1 -- 172.21.15.87:0/4013061983 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75541a2f80 con 0x7f75540fff60 2024-09-13T17:18:46.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.012+0000 7f75517fa640 1 -- 172.21.15.87:0/4013061983 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7544032440 con 0x7f75540fff60 2024-09-13T17:18:46.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.012+0000 7f755a176640 1 -- 172.21.15.87:0/4013061983 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75541a32f0 con 0x7f75540fff60 2024-09-13T17:18:46.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.014+0000 7f75517fa640 1 -- 172.21.15.87:0/4013061983 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f7544003ba0 con 0x7f75540fff60 2024-09-13T17:18:46.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.015+0000 7f755ce9a740 1 Processor -- start 2024-09-13T17:18:46.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.015+0000 7f755ce9a740 1 -- start start 2024-09-13T17:18:46.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.015+0000 7f755ce9a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a779255790 0x55a779255b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.015+0000 7f755ce9a740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a7792560b0 0x55a779260410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.015+0000 7f755ce9a740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a779260950 0x55a779262d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.015+0000 7f755ce9a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7791bfcc0 con 0x55a779255790 2024-09-13T17:18:46.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.015+0000 7f755ce9a740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7791bd450 con 0x55a779260950 2024-09-13T17:18:46.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.015+0000 7f755ce9a740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7791b8d40 con 0x55a7792560b0 2024-09-13T17:18:46.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.015+0000 7f75517fa640 1 --2- 172.21.15.87:0/4013061983 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f75400a1200 0x7f75400a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.015+0000 7f7553fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a779255790 0x55a779255b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.015+0000 7f7553fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a779255790 0x55a779255b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37156/0 (socket says 172.21.15.87:37156) 2024-09-13T17:18:46.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.015+0000 7f7553fff640 1 -- 172.21.15.87:0/85971684 learned_addr learned my addr 172.21.15.87:0/85971684 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:46.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.015+0000 7f75537fe640 1 --2- 172.21.15.87:0/85971684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a7792560b0 0x55a779260410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.015+0000 7f7553fff640 1 --2- 172.21.15.87:0/4013061983 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f75400a1200 0x7f75400a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.015+0000 7f754affd640 1 --2- 172.21.15.87:0/85971684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a779260950 0x55a779262d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.015+0000 7f7553fff640 1 -- 172.21.15.87:0/85971684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a7792560b0 msgr2=0x55a779260410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:46.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.015+0000 7f7553fff640 1 --2- 172.21.15.87:0/85971684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a7792560b0 0x55a779260410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.015+0000 7f75517fa640 1 -- 172.21.15.87:0/4013061983 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f75440edb60 con 0x7f75540fff60 2024-09-13T17:18:46.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.015+0000 7f7553fff640 1 -- 172.21.15.87:0/85971684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a779260950 msgr2=0x55a779262d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:46.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.015+0000 7f7553fff640 1 --2- 172.21.15.87:0/85971684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a779260950 0x55a779262d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.015+0000 7f7553fff640 1 -- 172.21.15.87:0/85971684 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a779180620 con 0x55a779255790 2024-09-13T17:18:46.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.015+0000 7f7553fff640 1 --2- 172.21.15.87:0/85971684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a779255790 0x55a779255b70 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f754c0149c0 tx=0x7f754c014e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ce268c5b511011c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:46.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.016+0000 7f7549ffb640 1 -- 172.21.15.87:0/85971684 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c01ce90 con 0x55a779255790 2024-09-13T17:18:46.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.016+0000 7f7553fff640 1 --2- 172.21.15.87:0/4013061983 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f75400a1200 0x7f75400a36c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f754c01e000 tx=0x7f754c01a000 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:46.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.016+0000 7f7549ffb640 1 -- 172.21.15.87:0/85971684 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f754c00e470 con 0x55a779255790 2024-09-13T17:18:46.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.016+0000 7f7549ffb640 1 -- 172.21.15.87:0/85971684 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c0136c0 con 0x55a779255790 2024-09-13T17:18:46.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.016+0000 7f755ce9a740 1 -- 172.21.15.87:0/85971684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a779255790 msgr2=0x55a779255b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.016+0000 7f755ce9a740 1 --2- 172.21.15.87:0/85971684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a779255790 0x55a779255b70 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f754c0149c0 tx=0x7f754c014e80 comp rx=0 tx=0).stop 2024-09-13T17:18:46.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.016+0000 7f755ce9a740 1 -- 172.21.15.87:0/85971684 shutdown_connections 2024-09-13T17:18:46.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.016+0000 7f755ce9a740 1 --2- 172.21.15.87:0/85971684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a779260950 0x55a779262d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.016+0000 7f755ce9a740 1 --2- 172.21.15.87:0/85971684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a7792560b0 0x55a779260410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.016+0000 7f755ce9a740 1 --2- 172.21.15.87:0/85971684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a779255790 0x55a779255b70 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.016+0000 7f755ce9a740 1 -- 172.21.15.87:0/85971684 >> 172.21.15.87:0/85971684 conn(0x55a779251d00 msgr2=0x55a7792520e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:46.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.016+0000 7f755ce9a740 1 -- 172.21.15.87:0/85971684 shutdown_connections 2024-09-13T17:18:46.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.016+0000 7f755ce9a740 1 -- 172.21.15.87:0/85971684 wait complete. 2024-09-13T17:18:46.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.017+0000 7f755ce9a740 1 -- start start 2024-09-13T17:18:46.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.017+0000 7f755ce9a740 1 Processor -- start 2024-09-13T17:18:46.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.017+0000 7f755ce9a740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a779255790 0x55a77925ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.017+0000 7f755ce9a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a7792560b0 0x55a77925d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.017+0000 7f755ce9a740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a779260950 0x55a77925d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.017+0000 7f755ce9a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a779177180 con 0x55a7792560b0 2024-09-13T17:18:46.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.017+0000 7f755ce9a740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a778e91430 con 0x55a779255790 2024-09-13T17:18:46.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.017+0000 7f755ce9a740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a77913c5e0 con 0x55a779260950 2024-09-13T17:18:46.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.017+0000 7f755ce9a740 10 client.0 _ll_register_callbacks cb 0x55a7791a8aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:18:46.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.017+0000 7f754affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a7792560b0 0x55a77925d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.017+0000 7f754affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a7792560b0 0x55a77925d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37166/0 (socket says 172.21.15.87:37166) 2024-09-13T17:18:46.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.017+0000 7f754affd640 1 -- 172.21.15.87:0/3172389417 learned_addr learned my addr 172.21.15.87:0/3172389417 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:46.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.017+0000 7f7553fff640 1 --2- 172.21.15.87:0/3172389417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a779260950 0x55a77925d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.017+0000 7f75537fe640 1 --2- 172.21.15.87:0/3172389417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a779255790 0x55a77925ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.017+0000 7f754affd640 1 -- 172.21.15.87:0/3172389417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a779260950 msgr2=0x55a77925d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:46.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.017+0000 7f754affd640 1 --2- 172.21.15.87:0/3172389417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a779260950 0x55a77925d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.017+0000 7f754affd640 1 -- 172.21.15.87:0/3172389417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a779255790 msgr2=0x55a77925ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:46.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.017+0000 7f754affd640 1 --2- 172.21.15.87:0/3172389417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a779255790 0x55a77925ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.017+0000 7f754affd640 1 -- 172.21.15.87:0/3172389417 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f754c014570 con 0x55a7792560b0 2024-09-13T17:18:46.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.017+0000 7f7553fff640 1 --2- 172.21.15.87:0/3172389417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a779260950 0x55a77925d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:46.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.018+0000 7f754affd640 1 --2- 172.21.15.87:0/3172389417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a7792560b0 0x55a77925d2c0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f753c00bfb0 tx=0x7f753c00d5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8483e5cdcceba2a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:46.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.018+0000 7f7532ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:18:46.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.018+0000 7f7532ffd640 1 -- 172.21.15.87:0/3172389417 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c00de20 con 0x55a7792560b0 2024-09-13T17:18:46.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.018+0000 7f7532ffd640 1 -- 172.21.15.87:0/3172389417 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f753c0125f0 con 0x55a7792560b0 2024-09-13T17:18:46.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.018+0000 7f755ce9a740 1 -- 172.21.15.87:0/3172389417 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a7791e2b80 con 0x55a7792560b0 2024-09-13T17:18:46.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.018+0000 7f7532ffd640 1 -- 172.21.15.87:0/3172389417 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f753c00b2d0 con 0x55a7792560b0 2024-09-13T17:18:46.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.018+0000 7f755ce9a740 10 client.16947 fetch_fsmap learned FSMap version 30 2024-09-13T17:18:46.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.018+0000 7f755ce9a740 1 -- 172.21.15.87:0/3172389417 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55a7791b73c0 con 0x55a7792560b0 2024-09-13T17:18:46.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.018+0000 7f7532ffd640 1 -- 172.21.15.87:0/3172389417 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55a7791e2b80 con 0x55a7792560b0 2024-09-13T17:18:46.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.018+0000 7f7532ffd640 1 -- 172.21.15.87:0/3172389417 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f753c014a00 con 0x55a7792560b0 2024-09-13T17:18:46.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.018+0000 7f755ce9a740 10 client.16947 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:18:46.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.018+0000 7f755ce9a740 10 client.16947 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:18:46.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.018+0000 7f755ce9a740 20 client.16947 populate_metadata read hostname 'smithi087' 2024-09-13T17:18:46.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.018+0000 7f755ce9a740 1 --2- 172.21.15.87:0/3172389417 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55a7792703f0 0x55a779272810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.018+0000 7f755ce9a740 4 client.16947 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:18:46.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.018+0000 7f755ce9a740 1 -- 172.21.15.87:0/3172389417 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a7791ab1f0 con 0x55a7792703f0 2024-09-13T17:18:46.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.019+0000 7f75537fe640 1 --2- 172.21.15.87:0/3172389417 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55a7792703f0 0x55a779272810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.019+0000 7f7532ffd640 10 client.16947 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:18:46.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.019+0000 7f75537fe640 1 --2- 172.21.15.87:0/3172389417 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55a7792703f0 0x55a779272810 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e79535cc4babebc server_cookie=224f619689e2df7f in_seq=0 out_seq=0 2024-09-13T17:18:46.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.020+0000 7f7532ffd640 1 -- 172.21.15.87:0/3172389417 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55a7791ab1f0 con 0x55a7792703f0 2024-09-13T17:18:46.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.020+0000 7f7532ffd640 10 client.16947 handle_command_reply: tid=0 2024-09-13T17:18:46.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.020+0000 7f755ce9a740 1 client.16947 shutdown 2024-09-13T17:18:46.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.020+0000 7f755ce9a740 1 -- 172.21.15.87:0/3172389417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a7792560b0 msgr2=0x55a77925d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.020+0000 7f755ce9a740 1 --2- 172.21.15.87:0/3172389417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a7792560b0 0x55a77925d2c0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f753c00bfb0 tx=0x7f753c00d5f0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.020+0000 7f755ce9a740 1 -- 172.21.15.87:0/3172389417 shutdown_connections 2024-09-13T17:18:46.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.020+0000 7f755ce9a740 1 --2- 172.21.15.87:0/3172389417 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55a7792703f0 0x55a779272810 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.020+0000 7f755ce9a740 1 --2- 172.21.15.87:0/3172389417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a779260950 0x55a77925d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.020+0000 7f755ce9a740 1 --2- 172.21.15.87:0/3172389417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a7792560b0 0x55a77925d2c0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.020+0000 7f755ce9a740 1 --2- 172.21.15.87:0/3172389417 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a779255790 0x55a77925ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.020+0000 7f7532ffd640 0 client.16947 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:18:46.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.020+0000 7f755ce9a740 1 -- 172.21.15.87:0/3172389417 >> 172.21.15.87:0/3172389417 conn(0x55a779251d00 msgr2=0x55a779250eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:46.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.020+0000 7f755ce9a740 1 -- 172.21.15.87:0/3172389417 shutdown_connections 2024-09-13T17:18:46.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.020+0000 7f755ce9a740 1 -- 172.21.15.87:0/3172389417 wait complete. 2024-09-13T17:18:46.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.020+0000 7f755ce9a740 20 client.16947 trim_cache size 0 max 16384 2024-09-13T17:18:46.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.031+0000 7f755ce9a740 1 Processor -- start 2024-09-13T17:18:46.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.031+0000 7f755ce9a740 1 -- start start 2024-09-13T17:18:46.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.031+0000 7f755ce9a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a779255790 0x55a7792516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.031+0000 7f755ce9a740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7792560b0 0x55a779267610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.031+0000 7f755ce9a740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a779260950 0x55a779267b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.031+0000 7f755ce9a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a77925e3d0 con 0x55a779255790 2024-09-13T17:18:46.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.031+0000 7f755ce9a740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a779256750 con 0x55a7792560b0 2024-09-13T17:18:46.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.031+0000 7f755ce9a740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a77926eaf0 con 0x55a779260950 2024-09-13T17:18:46.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.031+0000 7f75537fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a779255790 0x55a7792516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.031+0000 7f75537fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a779255790 0x55a7792516a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37176/0 (socket says 172.21.15.87:37176) 2024-09-13T17:18:46.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.031+0000 7f75537fe640 1 -- 172.21.15.87:0/1057283015 learned_addr learned my addr 172.21.15.87:0/1057283015 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:46.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.031+0000 7f754affd640 1 --2- 172.21.15.87:0/1057283015 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7792560b0 0x55a779267610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.031+0000 7f75537fe640 1 -- 172.21.15.87:0/1057283015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a779260950 msgr2=0x55a779267b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:46.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.031+0000 7f75537fe640 1 --2- 172.21.15.87:0/1057283015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a779260950 0x55a779267b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.031+0000 7f75537fe640 1 -- 172.21.15.87:0/1057283015 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7792560b0 msgr2=0x55a779267610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:46.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.031+0000 7f75537fe640 1 --2- 172.21.15.87:0/1057283015 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7792560b0 0x55a779267610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.031+0000 7f75537fe640 1 -- 172.21.15.87:0/1057283015 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a779159770 con 0x55a779255790 2024-09-13T17:18:46.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.031+0000 7f754affd640 1 --2- 172.21.15.87:0/1057283015 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7792560b0 0x55a779267610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:46.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.032+0000 7f75537fe640 1 --2- 172.21.15.87:0/1057283015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a779255790 0x55a7792516a0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f7544005ab0 tx=0x7f754404a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31fa35117b7ed45 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:46.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.032+0000 7f754a7fc640 1 -- 172.21.15.87:0/1057283015 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75440c2d40 con 0x55a779255790 2024-09-13T17:18:46.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.032+0000 7f754a7fc640 1 -- 172.21.15.87:0/1057283015 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f75440b8a00 con 0x55a779255790 2024-09-13T17:18:46.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.032+0000 7f754a7fc640 1 -- 172.21.15.87:0/1057283015 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7544040c80 con 0x55a779255790 2024-09-13T17:18:46.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.032+0000 7f755ce9a740 1 -- 172.21.15.87:0/1057283015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a779255790 msgr2=0x55a7792516a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.032+0000 7f755ce9a740 1 --2- 172.21.15.87:0/1057283015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a779255790 0x55a7792516a0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f7544005ab0 tx=0x7f754404a8f0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.032+0000 7f755ce9a740 1 -- 172.21.15.87:0/1057283015 shutdown_connections 2024-09-13T17:18:46.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.032+0000 7f755ce9a740 1 --2- 172.21.15.87:0/1057283015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a779260950 0x55a779267b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.032+0000 7f755ce9a740 1 --2- 172.21.15.87:0/1057283015 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7792560b0 0x55a779267610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.032+0000 7f755ce9a740 1 --2- 172.21.15.87:0/1057283015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a779255790 0x55a7792516a0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.032+0000 7f755ce9a740 1 -- 172.21.15.87:0/1057283015 >> 172.21.15.87:0/1057283015 conn(0x55a779251d00 msgr2=0x55a7792520e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:46.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.032+0000 7f755ce9a740 1 -- 172.21.15.87:0/1057283015 shutdown_connections 2024-09-13T17:18:46.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.032+0000 7f755ce9a740 1 -- 172.21.15.87:0/1057283015 wait complete. 2024-09-13T17:18:46.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.033+0000 7f755ce9a740 1 -- start start 2024-09-13T17:18:46.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.033+0000 7f755ce9a740 1 Processor -- start 2024-09-13T17:18:46.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.033+0000 7f755ce9a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a779255790 0x55a779263880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.033+0000 7f755ce9a740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7792560b0 0x55a779263dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.033+0000 7f755ce9a740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a779260950 0x55a7792c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.033+0000 7f755ce9a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7792c5de0 con 0x55a779255790 2024-09-13T17:18:46.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.033+0000 7f755ce9a740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7792c5f20 con 0x55a7792560b0 2024-09-13T17:18:46.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.033+0000 7f755ce9a740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7792c60e0 con 0x55a779260950 2024-09-13T17:18:46.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.033+0000 7f755ce9a740 10 client.0 _ll_register_callbacks cb 0x7f754c0086e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:18:46.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.033+0000 7f75537fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a779255790 0x55a779263880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.033+0000 7f75537fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a779255790 0x55a779263880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37190/0 (socket says 172.21.15.87:37190) 2024-09-13T17:18:46.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.033+0000 7f75537fe640 1 -- 172.21.15.87:0/907063892 learned_addr learned my addr 172.21.15.87:0/907063892 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:46.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.033+0000 7f754affd640 1 --2- 172.21.15.87:0/907063892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7792560b0 0x55a779263dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.033+0000 7f7553fff640 1 --2- 172.21.15.87:0/907063892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a779260950 0x55a7792c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.033+0000 7f75537fe640 1 -- 172.21.15.87:0/907063892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a779260950 msgr2=0x55a7792c58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:46.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.033+0000 7f75537fe640 1 --2- 172.21.15.87:0/907063892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a779260950 0x55a7792c58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.033+0000 7f75537fe640 1 -- 172.21.15.87:0/907063892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7792560b0 msgr2=0x55a779263dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:46.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.033+0000 7f75537fe640 1 --2- 172.21.15.87:0/907063892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7792560b0 0x55a779263dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.033+0000 7f75537fe640 1 -- 172.21.15.87:0/907063892 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75541a32f0 con 0x55a779255790 2024-09-13T17:18:46.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.033+0000 7f754affd640 1 --2- 172.21.15.87:0/907063892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7792560b0 0x55a779263dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:46.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.034+0000 7f75537fe640 1 --2- 172.21.15.87:0/907063892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a779255790 0x55a779263880 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f7544000c00 tx=0x7f75440be830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=312840eeceddc7cf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:46.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.034+0000 7f7532ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:18:46.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.034+0000 7f7532ffd640 1 -- 172.21.15.87:0/907063892 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75440d3240 con 0x55a779255790 2024-09-13T17:18:46.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.034+0000 7f7532ffd640 1 -- 172.21.15.87:0/907063892 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f75440eb180 con 0x55a779255790 2024-09-13T17:18:46.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.034+0000 7f755ce9a740 1 -- 172.21.15.87:0/907063892 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f754c00e470 con 0x55a779255790 2024-09-13T17:18:46.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.034+0000 7f7532ffd640 1 -- 172.21.15.87:0/907063892 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75440eb340 con 0x55a779255790 2024-09-13T17:18:46.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.034+0000 7f755ce9a740 10 client.16953 fetch_fsmap learned FSMap version 30 2024-09-13T17:18:46.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.034+0000 7f755ce9a740 1 -- 172.21.15.87:0/907063892 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55a77917ee80 con 0x55a779255790 2024-09-13T17:18:46.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.034+0000 7f7532ffd640 1 -- 172.21.15.87:0/907063892 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f754409d020 con 0x55a779255790 2024-09-13T17:18:46.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.034+0000 7f7532ffd640 1 -- 172.21.15.87:0/907063892 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f7544040d10 con 0x55a779255790 2024-09-13T17:18:46.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.034+0000 7f755ce9a740 10 client.16953 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:18:46.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.034+0000 7f755ce9a740 10 client.16953 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:18:46.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.034+0000 7f755ce9a740 20 client.16953 populate_metadata read hostname 'smithi087' 2024-09-13T17:18:46.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.034+0000 7f755ce9a740 1 --2- 172.21.15.87:0/907063892 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55a7792c7470 0x55a7792c9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.034+0000 7f755ce9a740 4 client.16953 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:18:46.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.034+0000 7f755ce9a740 1 -- 172.21.15.87:0/907063892 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a778eac4e0 con 0x55a7792c7470 2024-09-13T17:18:46.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.034+0000 7f754affd640 1 --2- 172.21.15.87:0/907063892 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55a7792c7470 0x55a7792c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.035+0000 7f7532ffd640 10 client.16953 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:18:46.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.035+0000 7f754affd640 1 --2- 172.21.15.87:0/907063892 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55a7792c7470 0x55a7792c9890 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e2e772ce06aca35 server_cookie=9814c86b18931778 in_seq=0 out_seq=0 2024-09-13T17:18:46.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.035+0000 7f7532ffd640 1 -- 172.21.15.87:0/907063892 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a778eac4e0 con 0x55a7792c7470 2024-09-13T17:18:46.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.035+0000 7f7532ffd640 10 client.16953 handle_command_reply: tid=0 2024-09-13T17:18:46.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.035+0000 7f755ce9a740 1 client.16953 shutdown 2024-09-13T17:18:46.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.035+0000 7f755ce9a740 1 -- 172.21.15.87:0/907063892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a779255790 msgr2=0x55a779263880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.035+0000 7f755ce9a740 1 --2- 172.21.15.87:0/907063892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a779255790 0x55a779263880 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f7544000c00 tx=0x7f75440be830 comp rx=0 tx=0).stop 2024-09-13T17:18:46.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.035+0000 7f755ce9a740 1 -- 172.21.15.87:0/907063892 shutdown_connections 2024-09-13T17:18:46.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.035+0000 7f755ce9a740 1 --2- 172.21.15.87:0/907063892 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55a7792c7470 0x55a7792c9890 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.035+0000 7f755ce9a740 1 --2- 172.21.15.87:0/907063892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a779260950 0x55a7792c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.035+0000 7f755ce9a740 1 --2- 172.21.15.87:0/907063892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7792560b0 0x55a779263dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.035+0000 7f7532ffd640 0 client.16953 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:18:46.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.035+0000 7f755ce9a740 1 --2- 172.21.15.87:0/907063892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a779255790 0x55a779263880 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.035+0000 7f755ce9a740 1 -- 172.21.15.87:0/907063892 >> 172.21.15.87:0/907063892 conn(0x55a779251d00 msgr2=0x55a77925bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:46.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.035+0000 7f755ce9a740 1 -- 172.21.15.87:0/907063892 shutdown_connections 2024-09-13T17:18:46.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.035+0000 7f755ce9a740 1 -- 172.21.15.87:0/907063892 wait complete. 2024-09-13T17:18:46.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.035+0000 7f755ce9a740 20 client.16953 trim_cache size 0 max 16384 2024-09-13T17:18:46.050 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:18:46.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.036+0000 7f755a176640 1 -- 172.21.15.87:0/4013061983 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f75400a1200 msgr2=0x7f75400a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.036+0000 7f755a176640 1 --2- 172.21.15.87:0/4013061983 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f75400a1200 0x7f75400a36c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f754c01e000 tx=0x7f754c01a000 comp rx=0 tx=0).stop 2024-09-13T17:18:46.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.036+0000 7f755a176640 1 -- 172.21.15.87:0/4013061983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75540fff60 msgr2=0x7f75541963f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.036+0000 7f755a176640 1 --2- 172.21.15.87:0/4013061983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75540fff60 0x7f75541963f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f7544005760 tx=0x7f7544004270 comp rx=0 tx=0).stop 2024-09-13T17:18:46.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.036+0000 7f755a176640 1 -- 172.21.15.87:0/4013061983 shutdown_connections 2024-09-13T17:18:46.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.036+0000 7f755a176640 1 --2- 172.21.15.87:0/4013061983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f755419acd0 0x7f755419b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.036+0000 7f755a176640 1 --2- 172.21.15.87:0/4013061983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75541050b0 0x7f7554196930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.036+0000 7f755a176640 1 --2- 172.21.15.87:0/4013061983 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f75400a1200 0x7f75400a36c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.036+0000 7f755a176640 1 --2- 172.21.15.87:0/4013061983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75540fff60 0x7f75541963f0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.036+0000 7f755a176640 1 -- 172.21.15.87:0/4013061983 >> 172.21.15.87:0/4013061983 conn(0x7f75540fb9f0 msgr2=0x7f75540fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:46.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.036+0000 7f755a176640 1 -- 172.21.15.87:0/4013061983 shutdown_connections 2024-09-13T17:18:46.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.036+0000 7f755a176640 1 -- 172.21.15.87:0/4013061983 wait complete. 2024-09-13T17:18:46.053 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-09-13T17:18:46.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.151+0000 7f4034d83640 1 -- 172.21.15.87:0/2334449374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40300ff800 msgr2=0x7f4030103840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.151+0000 7f4034d83640 1 --2- 172.21.15.87:0/2334449374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40300ff800 0x7f4030103840 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f4018009930 tx=0x7f401802a420 comp rx=0 tx=0).stop 2024-09-13T17:18:46.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.151+0000 7f4034d83640 1 -- 172.21.15.87:0/2334449374 shutdown_connections 2024-09-13T17:18:46.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.151+0000 7f4034d83640 1 --2- 172.21.15.87:0/2334449374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4030103fa0 0x7f403010baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.151+0000 7f4034d83640 1 --2- 172.21.15.87:0/2334449374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40300ff800 0x7f4030103840 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.151+0000 7f4034d83640 1 --2- 172.21.15.87:0/2334449374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40300fee50 0x7f40300ff230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.151+0000 7f4034d83640 1 -- 172.21.15.87:0/2334449374 >> 172.21.15.87:0/2334449374 conn(0x7f40300fa8e0 msgr2=0x7f40300fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:46.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.151+0000 7f4034d83640 1 -- 172.21.15.87:0/2334449374 shutdown_connections 2024-09-13T17:18:46.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.151+0000 7f4034d83640 1 -- 172.21.15.87:0/2334449374 wait complete. 2024-09-13T17:18:46.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.152+0000 7f4034d83640 1 Processor -- start 2024-09-13T17:18:46.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.152+0000 7f4034d83640 1 -- start start 2024-09-13T17:18:46.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.152+0000 7f4034d83640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40300fee50 0x7f4030195310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.152+0000 7f4034d83640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4030103fa0 0x7f4030195850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.152+0000 7f4034d83640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4030199c40 0x7f403019a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.152+0000 7f4034d83640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f403019a630 con 0x7f4030103fa0 2024-09-13T17:18:46.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.152+0000 7f4034d83640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f403019a7a0 con 0x7f4030199c40 2024-09-13T17:18:46.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.152+0000 7f4034d83640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f403019a910 con 0x7f40300fee50 2024-09-13T17:18:46.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.152+0000 7f4027fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4030103fa0 0x7f4030195850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.152+0000 7f4027fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4030103fa0 0x7f4030195850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37196/0 (socket says 172.21.15.87:37196) 2024-09-13T17:18:46.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.152+0000 7f4027fff640 1 -- 172.21.15.87:0/166655639 learned_addr learned my addr 172.21.15.87:0/166655639 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:46.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.152+0000 7f402e59c640 1 --2- 172.21.15.87:0/166655639 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40300fee50 0x7f4030195310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.152+0000 7f402ed9d640 1 --2- 172.21.15.87:0/166655639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4030199c40 0x7f403019a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.152+0000 7f4027fff640 1 -- 172.21.15.87:0/166655639 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40300fee50 msgr2=0x7f4030195310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.152+0000 7f4027fff640 1 --2- 172.21.15.87:0/166655639 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40300fee50 0x7f4030195310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.152+0000 7f4027fff640 1 -- 172.21.15.87:0/166655639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4030199c40 msgr2=0x7f403019a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.152+0000 7f4027fff640 1 --2- 172.21.15.87:0/166655639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4030199c40 0x7f403019a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.153+0000 7f4027fff640 1 -- 172.21.15.87:0/166655639 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4018009560 con 0x7f4030103fa0 2024-09-13T17:18:46.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.153+0000 7f402ed9d640 1 --2- 172.21.15.87:0/166655639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4030199c40 0x7f403019a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:46.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.153+0000 7f402e59c640 1 --2- 172.21.15.87:0/166655639 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40300fee50 0x7f4030195310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:46.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.153+0000 7f4027fff640 1 --2- 172.21.15.87:0/166655639 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4030103fa0 0x7f4030195850 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f40180057c0 tx=0x7f4018003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:46.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.153+0000 7f40277fe640 1 -- 172.21.15.87:0/166655639 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401803d070 con 0x7f4030103fa0 2024-09-13T17:18:46.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.153+0000 7f40277fe640 1 -- 172.21.15.87:0/166655639 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4018038b30 con 0x7f4030103fa0 2024-09-13T17:18:46.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.153+0000 7f4034d83640 1 -- 172.21.15.87:0/166655639 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4030068590 con 0x7f4030103fa0 2024-09-13T17:18:46.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.153+0000 7f40277fe640 1 -- 172.21.15.87:0/166655639 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4018041a80 con 0x7f4030103fa0 2024-09-13T17:18:46.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.153+0000 7f4034d83640 1 -- 172.21.15.87:0/166655639 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4030068a40 con 0x7f4030103fa0 2024-09-13T17:18:46.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.155+0000 7f40277fe640 1 -- 172.21.15.87:0/166655639 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f4018038680 con 0x7f4030103fa0 2024-09-13T17:18:46.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.155+0000 7f4037aaa740 1 Processor -- start 2024-09-13T17:18:46.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.156+0000 7f4037aaa740 1 -- start start 2024-09-13T17:18:46.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.156+0000 7f4037aaa740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561cf22ca790 0x561cf22cab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.156+0000 7f4037aaa740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561cf22cb0b0 0x561cf22d5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.156+0000 7f4037aaa740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cf22d5950 0x561cf22d7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.156+0000 7f4037aaa740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cf2234cc0 con 0x561cf22ca790 2024-09-13T17:18:46.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.156+0000 7f4037aaa740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cf2232450 con 0x561cf22cb0b0 2024-09-13T17:18:46.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.156+0000 7f4037aaa740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cf222dd40 con 0x561cf22d5950 2024-09-13T17:18:46.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.156+0000 7f402ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561cf22ca790 0x561cf22cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.156+0000 7f402ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561cf22ca790 0x561cf22cab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37202/0 (socket says 172.21.15.87:37202) 2024-09-13T17:18:46.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.156+0000 7f402ed9d640 1 -- 172.21.15.87:0/3773942321 learned_addr learned my addr 172.21.15.87:0/3773942321 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:46.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.156+0000 7f40277fe640 1 --2- 172.21.15.87:0/166655639 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f401c0a1200 0x7f401c0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.156+0000 7f402e59c640 1 --2- 172.21.15.87:0/3773942321 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561cf22cb0b0 0x561cf22d5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.156+0000 7f402ed9d640 1 -- 172.21.15.87:0/3773942321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cf22d5950 msgr2=0x561cf22d7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:46.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.156+0000 7f402ed9d640 1 --2- 172.21.15.87:0/3773942321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cf22d5950 0x561cf22d7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.156+0000 7f402ed9d640 1 -- 172.21.15.87:0/3773942321 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561cf22cb0b0 msgr2=0x561cf22d5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:46.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.156+0000 7f402ed9d640 1 --2- 172.21.15.87:0/3773942321 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561cf22cb0b0 0x561cf22d5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.156+0000 7f402ed9d640 1 -- 172.21.15.87:0/3773942321 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561cf21f5620 con 0x561cf22ca790 2024-09-13T17:18:46.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.156+0000 7f40277fe640 1 -- 172.21.15.87:0/166655639 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f40180ef520 con 0x7f4030103fa0 2024-09-13T17:18:46.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.156+0000 7f402ed9d640 1 --2- 172.21.15.87:0/166655639 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f401c0a1200 0x7f401c0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.157+0000 7f402ed9d640 1 --2- 172.21.15.87:0/3773942321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561cf22ca790 0x561cf22cab70 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f402800c370 tx=0x7f402800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eeaa9d8c4bfe790 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:46.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.157+0000 7f4024ff9640 1 -- 172.21.15.87:0/3773942321 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4028010680 con 0x561cf22ca790 2024-09-13T17:18:46.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.157+0000 7f4024ff9640 1 -- 172.21.15.87:0/3773942321 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4028011cd0 con 0x561cf22ca790 2024-09-13T17:18:46.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.157+0000 7f4024ff9640 1 -- 172.21.15.87:0/3773942321 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40280079e0 con 0x561cf22ca790 2024-09-13T17:18:46.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.157+0000 7f4037aaa740 1 -- 172.21.15.87:0/3773942321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561cf22ca790 msgr2=0x561cf22cab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.157+0000 7f402ed9d640 1 --2- 172.21.15.87:0/166655639 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f401c0a1200 0x7f401c0a36c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f402801d000 tx=0x7f402801e000 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:46.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.157+0000 7f4037aaa740 1 --2- 172.21.15.87:0/3773942321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561cf22ca790 0x561cf22cab70 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f402800c370 tx=0x7f402800c830 comp rx=0 tx=0).stop 2024-09-13T17:18:46.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.157+0000 7f4037aaa740 1 -- 172.21.15.87:0/3773942321 shutdown_connections 2024-09-13T17:18:46.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.157+0000 7f4037aaa740 1 --2- 172.21.15.87:0/3773942321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cf22d5950 0x561cf22d7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.157+0000 7f4037aaa740 1 --2- 172.21.15.87:0/3773942321 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561cf22cb0b0 0x561cf22d5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.157+0000 7f4037aaa740 1 --2- 172.21.15.87:0/3773942321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561cf22ca790 0x561cf22cab70 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.157+0000 7f4037aaa740 1 -- 172.21.15.87:0/3773942321 >> 172.21.15.87:0/3773942321 conn(0x561cf22c6d00 msgr2=0x561cf22c70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:46.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.158+0000 7f4037aaa740 1 -- 172.21.15.87:0/3773942321 shutdown_connections 2024-09-13T17:18:46.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.158+0000 7f4037aaa740 1 -- 172.21.15.87:0/3773942321 wait complete. 2024-09-13T17:18:46.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.158+0000 7f4037aaa740 1 -- start start 2024-09-13T17:18:46.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.158+0000 7f4037aaa740 1 Processor -- start 2024-09-13T17:18:46.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.158+0000 7f4037aaa740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561cf22ca790 0x561cf22d4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.158+0000 7f4037aaa740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cf22cb0b0 0x561cf22d2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.158+0000 7f4037aaa740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561cf22d5950 0x561cf22d2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.158+0000 7f4037aaa740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cf21ec180 con 0x561cf22d5950 2024-09-13T17:18:46.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.158+0000 7f4037aaa740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cf1f06430 con 0x561cf22ca790 2024-09-13T17:18:46.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.158+0000 7f4037aaa740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cf21b15e0 con 0x561cf22cb0b0 2024-09-13T17:18:46.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.158+0000 7f4037aaa740 10 client.0 _ll_register_callbacks cb 0x561cf221daa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:18:46.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.158+0000 7f402ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561cf22d5950 0x561cf22d2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.158+0000 7f402ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561cf22d5950 0x561cf22d2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37212/0 (socket says 172.21.15.87:37212) 2024-09-13T17:18:46.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.158+0000 7f402ed9d640 1 -- 172.21.15.87:0/2347238227 learned_addr learned my addr 172.21.15.87:0/2347238227 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:46.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.158+0000 7f4027fff640 1 --2- 172.21.15.87:0/2347238227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cf22cb0b0 0x561cf22d2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.159+0000 7f402e59c640 1 --2- 172.21.15.87:0/2347238227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561cf22ca790 0x561cf22d4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.159+0000 7f402ed9d640 1 -- 172.21.15.87:0/2347238227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cf22cb0b0 msgr2=0x561cf22d2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:46.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.159+0000 7f402ed9d640 1 --2- 172.21.15.87:0/2347238227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cf22cb0b0 0x561cf22d2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.159+0000 7f402ed9d640 1 -- 172.21.15.87:0/2347238227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561cf22ca790 msgr2=0x561cf22d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:46.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.159+0000 7f402ed9d640 1 --2- 172.21.15.87:0/2347238227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561cf22ca790 0x561cf22d4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.159+0000 7f402ed9d640 1 -- 172.21.15.87:0/2347238227 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4028007bb0 con 0x561cf22d5950 2024-09-13T17:18:46.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.159+0000 7f4027fff640 1 --2- 172.21.15.87:0/2347238227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cf22cb0b0 0x561cf22d2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:46.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.159+0000 7f402ed9d640 1 --2- 172.21.15.87:0/2347238227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561cf22d5950 0x561cf22d2850 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f4028007830 tx=0x7f402800f770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3856f21cc739d3a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:46.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.159+0000 7f4015ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:18:46.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.159+0000 7f4015ffb640 1 -- 172.21.15.87:0/2347238227 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4028011a30 con 0x561cf22d5950 2024-09-13T17:18:46.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.159+0000 7f4015ffb640 1 -- 172.21.15.87:0/2347238227 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f4028010620 con 0x561cf22d5950 2024-09-13T17:18:46.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.159+0000 7f4037aaa740 1 -- 172.21.15.87:0/2347238227 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561cf2257b80 con 0x561cf22d5950 2024-09-13T17:18:46.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.159+0000 7f4015ffb640 1 -- 172.21.15.87:0/2347238227 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4028026480 con 0x561cf22d5950 2024-09-13T17:18:46.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.159+0000 7f4037aaa740 10 client.16965 fetch_fsmap learned FSMap version 30 2024-09-13T17:18:46.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.159+0000 7f4037aaa740 1 -- 172.21.15.87:0/2347238227 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x561cf222c3c0 con 0x561cf22d5950 2024-09-13T17:18:46.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.159+0000 7f4015ffb640 1 -- 172.21.15.87:0/2347238227 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x561cf2257b80 con 0x561cf22d5950 2024-09-13T17:18:46.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.159+0000 7f4015ffb640 1 -- 172.21.15.87:0/2347238227 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f4028031560 con 0x561cf22d5950 2024-09-13T17:18:46.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.159+0000 7f4037aaa740 10 client.16965 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:18:46.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.159+0000 7f4037aaa740 10 client.16965 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:18:46.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.159+0000 7f4037aaa740 20 client.16965 populate_metadata read hostname 'smithi087' 2024-09-13T17:18:46.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.159+0000 7f4037aaa740 1 --2- 172.21.15.87:0/2347238227 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x561cf22e5170 0x561cf22e7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.159+0000 7f4037aaa740 4 client.16965 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:18:46.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.159+0000 7f4037aaa740 1 -- 172.21.15.87:0/2347238227 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561cf22201f0 con 0x561cf22e5170 2024-09-13T17:18:46.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.160+0000 7f402e59c640 1 --2- 172.21.15.87:0/2347238227 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x561cf22e5170 0x561cf22e7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.160+0000 7f4015ffb640 10 client.16965 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:18:46.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.160+0000 7f402e59c640 1 --2- 172.21.15.87:0/2347238227 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x561cf22e5170 0x561cf22e7590 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b0124851404d5ddb server_cookie=af6e1e220f42dcf7 in_seq=0 out_seq=0 2024-09-13T17:18:46.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.161+0000 7f4015ffb640 1 -- 172.21.15.87:0/2347238227 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x561cf22201f0 con 0x561cf22e5170 2024-09-13T17:18:46.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.161+0000 7f4015ffb640 10 client.16965 handle_command_reply: tid=0 2024-09-13T17:18:46.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.161+0000 7f4037aaa740 1 client.16965 shutdown 2024-09-13T17:18:46.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.161+0000 7f4037aaa740 1 -- 172.21.15.87:0/2347238227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561cf22d5950 msgr2=0x561cf22d2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.161+0000 7f4037aaa740 1 --2- 172.21.15.87:0/2347238227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561cf22d5950 0x561cf22d2850 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f4028007830 tx=0x7f402800f770 comp rx=0 tx=0).stop 2024-09-13T17:18:46.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.161+0000 7f4037aaa740 1 -- 172.21.15.87:0/2347238227 shutdown_connections 2024-09-13T17:18:46.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.161+0000 7f4037aaa740 1 --2- 172.21.15.87:0/2347238227 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x561cf22e5170 0x561cf22e7590 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.161+0000 7f4037aaa740 1 --2- 172.21.15.87:0/2347238227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561cf22d5950 0x561cf22d2850 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.161+0000 7f4037aaa740 1 --2- 172.21.15.87:0/2347238227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cf22cb0b0 0x561cf22d2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.161+0000 7f4015ffb640 0 client.16965 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:18:46.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.161+0000 7f4037aaa740 1 --2- 172.21.15.87:0/2347238227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561cf22ca790 0x561cf22d4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.161+0000 7f4037aaa740 1 -- 172.21.15.87:0/2347238227 >> 172.21.15.87:0/2347238227 conn(0x561cf22c6d00 msgr2=0x561cf22cca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:46.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.161+0000 7f4037aaa740 1 -- 172.21.15.87:0/2347238227 shutdown_connections 2024-09-13T17:18:46.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.161+0000 7f4037aaa740 1 -- 172.21.15.87:0/2347238227 wait complete. 2024-09-13T17:18:46.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.161+0000 7f4037aaa740 20 client.16965 trim_cache size 0 max 16384 2024-09-13T17:18:46.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.172+0000 7f4037aaa740 1 Processor -- start 2024-09-13T17:18:46.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.172+0000 7f4037aaa740 1 -- start start 2024-09-13T17:18:46.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.172+0000 7f4037aaa740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cf22ca790 0x561cf22ebef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.172+0000 7f4037aaa740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561cf22cb0b0 0x561cf22dc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.172+0000 7f4037aaa740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561cf22d5950 0x561cf22dcb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.172+0000 7f4037aaa740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cf22d5550 con 0x561cf22d5950 2024-09-13T17:18:46.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.172+0000 7f4037aaa740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cf22cb780 con 0x561cf22cb0b0 2024-09-13T17:18:46.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.172+0000 7f4037aaa740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cf22c2920 con 0x561cf22ca790 2024-09-13T17:18:46.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.172+0000 7f402ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561cf22d5950 0x561cf22dcb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.172+0000 7f402ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561cf22d5950 0x561cf22dcb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37228/0 (socket says 172.21.15.87:37228) 2024-09-13T17:18:46.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.172+0000 7f402ed9d640 1 -- 172.21.15.87:0/3106879942 learned_addr learned my addr 172.21.15.87:0/3106879942 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:46.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.173+0000 7f402ed9d640 1 -- 172.21.15.87:0/3106879942 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cf22ca790 msgr2=0x561cf22ebef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:46.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.173+0000 7f402ed9d640 1 --2- 172.21.15.87:0/3106879942 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cf22ca790 0x561cf22ebef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.173+0000 7f402ed9d640 1 -- 172.21.15.87:0/3106879942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561cf22cb0b0 msgr2=0x561cf22dc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:46.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.173+0000 7f402ed9d640 1 --2- 172.21.15.87:0/3106879942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561cf22cb0b0 0x561cf22dc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.173+0000 7f402ed9d640 1 -- 172.21.15.87:0/3106879942 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561cf21ce770 con 0x561cf22d5950 2024-09-13T17:18:46.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.173+0000 7f402ed9d640 1 --2- 172.21.15.87:0/3106879942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561cf22d5950 0x561cf22dcb50 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f4028001220 tx=0x7f402800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5c99f6e38e0691a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:46.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.173+0000 7f40257fa640 1 -- 172.21.15.87:0/3106879942 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4028007540 con 0x561cf22d5950 2024-09-13T17:18:46.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.173+0000 7f40257fa640 1 -- 172.21.15.87:0/3106879942 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4028010620 con 0x561cf22d5950 2024-09-13T17:18:46.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.173+0000 7f40257fa640 1 -- 172.21.15.87:0/3106879942 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4028011a90 con 0x561cf22d5950 2024-09-13T17:18:46.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.173+0000 7f4037aaa740 1 -- 172.21.15.87:0/3106879942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561cf22d5950 msgr2=0x561cf22dcb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.173+0000 7f4037aaa740 1 --2- 172.21.15.87:0/3106879942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561cf22d5950 0x561cf22dcb50 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f4028001220 tx=0x7f402800c830 comp rx=0 tx=0).stop 2024-09-13T17:18:46.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.174+0000 7f4037aaa740 1 -- 172.21.15.87:0/3106879942 shutdown_connections 2024-09-13T17:18:46.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.174+0000 7f4037aaa740 1 --2- 172.21.15.87:0/3106879942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561cf22d5950 0x561cf22dcb50 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.174+0000 7f4037aaa740 1 --2- 172.21.15.87:0/3106879942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561cf22cb0b0 0x561cf22dc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.174+0000 7f4037aaa740 1 --2- 172.21.15.87:0/3106879942 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cf22ca790 0x561cf22ebef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.174+0000 7f4037aaa740 1 -- 172.21.15.87:0/3106879942 >> 172.21.15.87:0/3106879942 conn(0x561cf22c6d00 msgr2=0x561cf22e10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:46.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.174+0000 7f4037aaa740 1 -- 172.21.15.87:0/3106879942 shutdown_connections 2024-09-13T17:18:46.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.174+0000 7f4037aaa740 1 -- 172.21.15.87:0/3106879942 wait complete. 2024-09-13T17:18:46.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.174+0000 7f4037aaa740 1 -- start start 2024-09-13T17:18:46.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.174+0000 7f4037aaa740 1 Processor -- start 2024-09-13T17:18:46.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.174+0000 7f4037aaa740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561cf22ca790 0x561cf22dc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.174+0000 7f4037aaa740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561cf22cb0b0 0x561cf22ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.174+0000 7f4037aaa740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cf22d5950 0x561cf22cf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.174+0000 7f4037aaa740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cf22cf580 con 0x561cf22ca790 2024-09-13T17:18:46.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.174+0000 7f4037aaa740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cf22cf6f0 con 0x561cf22cb0b0 2024-09-13T17:18:46.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.174+0000 7f4037aaa740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cf22cf8b0 con 0x561cf22d5950 2024-09-13T17:18:46.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.174+0000 7f4037aaa740 10 client.0 _ll_register_callbacks cb 0x7f40280076a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:18:46.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.174+0000 7f402e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561cf22ca790 0x561cf22dc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.174+0000 7f402e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561cf22ca790 0x561cf22dc810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37242/0 (socket says 172.21.15.87:37242) 2024-09-13T17:18:46.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.174+0000 7f402e59c640 1 -- 172.21.15.87:0/38056931 learned_addr learned my addr 172.21.15.87:0/38056931 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:46.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.174+0000 7f402e59c640 1 -- 172.21.15.87:0/38056931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cf22d5950 msgr2=0x561cf22cf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:46.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.174+0000 7f402e59c640 1 --2- 172.21.15.87:0/38056931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cf22d5950 0x561cf22cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.174+0000 7f402e59c640 1 -- 172.21.15.87:0/38056931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561cf22cb0b0 msgr2=0x561cf22ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:46.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.174+0000 7f4027fff640 1 --2- 172.21.15.87:0/38056931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561cf22cb0b0 0x561cf22ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.174+0000 7f402e59c640 1 --2- 172.21.15.87:0/38056931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561cf22cb0b0 0x561cf22ceb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.174+0000 7f402e59c640 1 -- 172.21.15.87:0/38056931 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561cf222c3c0 con 0x561cf22ca790 2024-09-13T17:18:46.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.174+0000 7f4027fff640 1 --2- 172.21.15.87:0/38056931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561cf22cb0b0 0x561cf22ceb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:46.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.175+0000 7f402e59c640 1 --2- 172.21.15.87:0/38056931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561cf22ca790 0x561cf22dc810 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f4020004810 tx=0x7f402000ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26fbf660341edd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:46.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.175+0000 7f4015ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:18:46.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.175+0000 7f4015ffb640 1 -- 172.21.15.87:0/38056931 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402000aee0 con 0x561cf22ca790 2024-09-13T17:18:46.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.175+0000 7f4015ffb640 1 -- 172.21.15.87:0/38056931 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f4020016b70 con 0x561cf22ca790 2024-09-13T17:18:46.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.175+0000 7f4037aaa740 1 -- 172.21.15.87:0/38056931 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4028011cd0 con 0x561cf22ca790 2024-09-13T17:18:46.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.175+0000 7f4015ffb640 1 -- 172.21.15.87:0/38056931 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4020016d30 con 0x561cf22ca790 2024-09-13T17:18:46.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.175+0000 7f4037aaa740 10 client.16971 fetch_fsmap learned FSMap version 30 2024-09-13T17:18:46.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.175+0000 7f4037aaa740 1 -- 172.21.15.87:0/38056931 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x561cf21f3e80 con 0x561cf22ca790 2024-09-13T17:18:46.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.175+0000 7f4015ffb640 1 -- 172.21.15.87:0/38056931 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4028011cd0 con 0x561cf22ca790 2024-09-13T17:18:46.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.175+0000 7f4015ffb640 1 -- 172.21.15.87:0/38056931 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f4020021710 con 0x561cf22ca790 2024-09-13T17:18:46.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.175+0000 7f4037aaa740 10 client.16971 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:18:46.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.175+0000 7f4037aaa740 10 client.16971 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:18:46.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.175+0000 7f4037aaa740 20 client.16971 populate_metadata read hostname 'smithi087' 2024-09-13T17:18:46.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.175+0000 7f4037aaa740 1 --2- 172.21.15.87:0/38056931 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x561cf233cb20 0x561cf233ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.175+0000 7f4037aaa740 4 client.16971 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:18:46.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.175+0000 7f4037aaa740 1 -- 172.21.15.87:0/38056931 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561cf1f214e0 con 0x561cf233cb20 2024-09-13T17:18:46.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.175+0000 7f4027fff640 1 --2- 172.21.15.87:0/38056931 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x561cf233cb20 0x561cf233ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.176+0000 7f4015ffb640 10 client.16971 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:18:46.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.176+0000 7f4027fff640 1 --2- 172.21.15.87:0/38056931 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x561cf233cb20 0x561cf233ef40 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=397d288aa9ed9773 server_cookie=2516927d457dff2 in_seq=0 out_seq=0 2024-09-13T17:18:46.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.176+0000 7f4015ffb640 1 -- 172.21.15.87:0/38056931 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561cf1f214e0 con 0x561cf233cb20 2024-09-13T17:18:46.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.176+0000 7f4015ffb640 10 client.16971 handle_command_reply: tid=0 2024-09-13T17:18:46.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.176+0000 7f4037aaa740 1 client.16971 shutdown 2024-09-13T17:18:46.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.176+0000 7f4037aaa740 1 -- 172.21.15.87:0/38056931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561cf22ca790 msgr2=0x561cf22dc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.176+0000 7f4037aaa740 1 --2- 172.21.15.87:0/38056931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561cf22ca790 0x561cf22dc810 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f4020004810 tx=0x7f402000ac90 comp rx=0 tx=0).stop 2024-09-13T17:18:46.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.176+0000 7f4037aaa740 1 -- 172.21.15.87:0/38056931 shutdown_connections 2024-09-13T17:18:46.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.176+0000 7f4037aaa740 1 --2- 172.21.15.87:0/38056931 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x561cf233cb20 0x561cf233ef40 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.176+0000 7f4037aaa740 1 --2- 172.21.15.87:0/38056931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cf22d5950 0x561cf22cf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.176+0000 7f4015ffb640 0 client.16971 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:18:46.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.176+0000 7f4037aaa740 1 --2- 172.21.15.87:0/38056931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561cf22cb0b0 0x561cf22ceb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.176+0000 7f4037aaa740 1 --2- 172.21.15.87:0/38056931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561cf22ca790 0x561cf22dc810 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.176+0000 7f4037aaa740 1 -- 172.21.15.87:0/38056931 >> 172.21.15.87:0/38056931 conn(0x561cf22c6d00 msgr2=0x561cf22e10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:46.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.176+0000 7f4037aaa740 1 -- 172.21.15.87:0/38056931 shutdown_connections 2024-09-13T17:18:46.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.176+0000 7f4037aaa740 1 -- 172.21.15.87:0/38056931 wait complete. 2024-09-13T17:18:46.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.176+0000 7f4037aaa740 20 client.16971 trim_cache size 0 max 16384 2024-09-13T17:18:46.184 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:18:46.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.177+0000 7f4034d83640 1 -- 172.21.15.87:0/166655639 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f401c0a1200 msgr2=0x7f401c0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.177+0000 7f4034d83640 1 --2- 172.21.15.87:0/166655639 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f401c0a1200 0x7f401c0a36c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f402801d000 tx=0x7f402801e000 comp rx=0 tx=0).stop 2024-09-13T17:18:46.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.177+0000 7f4034d83640 1 -- 172.21.15.87:0/166655639 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4030103fa0 msgr2=0x7f4030195850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.177+0000 7f4034d83640 1 --2- 172.21.15.87:0/166655639 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4030103fa0 0x7f4030195850 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f40180057c0 tx=0x7f4018003d40 comp rx=0 tx=0).stop 2024-09-13T17:18:46.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.177+0000 7f4034d83640 1 -- 172.21.15.87:0/166655639 shutdown_connections 2024-09-13T17:18:46.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.177+0000 7f4034d83640 1 --2- 172.21.15.87:0/166655639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4030199c40 0x7f403019a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.177+0000 7f4034d83640 1 --2- 172.21.15.87:0/166655639 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f401c0a1200 0x7f401c0a36c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.177+0000 7f4034d83640 1 --2- 172.21.15.87:0/166655639 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4030103fa0 0x7f4030195850 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.177+0000 7f4034d83640 1 --2- 172.21.15.87:0/166655639 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40300fee50 0x7f4030195310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.177+0000 7f4034d83640 1 -- 172.21.15.87:0/166655639 >> 172.21.15.87:0/166655639 conn(0x7f40300fa8e0 msgr2=0x7f40300fbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:46.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.177+0000 7f4034d83640 1 -- 172.21.15.87:0/166655639 shutdown_connections 2024-09-13T17:18:46.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.177+0000 7f4034d83640 1 -- 172.21.15.87:0/166655639 wait complete. 2024-09-13T17:18:46.189 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-09-13T17:18:46.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.287+0000 7fc183d18640 1 -- 172.21.15.87:0/1228942220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc17c0ff810 msgr2=0x7fc17c103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.287+0000 7fc183d18640 1 --2- 172.21.15.87:0/1228942220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc17c0ff810 0x7fc17c103850 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fc170009930 tx=0x7fc17002a420 comp rx=0 tx=0).stop 2024-09-13T17:18:46.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.287+0000 7fc183d18640 1 -- 172.21.15.87:0/1228942220 shutdown_connections 2024-09-13T17:18:46.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.287+0000 7fc183d18640 1 --2- 172.21.15.87:0/1228942220 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc17c103fb0 0x7fc17c10bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.287+0000 7fc183d18640 1 --2- 172.21.15.87:0/1228942220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc17c0ff810 0x7fc17c103850 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.287+0000 7fc183d18640 1 --2- 172.21.15.87:0/1228942220 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc17c0fee60 0x7fc17c0ff240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.287+0000 7fc183d18640 1 -- 172.21.15.87:0/1228942220 >> 172.21.15.87:0/1228942220 conn(0x7fc17c075c60 msgr2=0x7fc17c0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:46.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.288+0000 7fc183d18640 1 -- 172.21.15.87:0/1228942220 shutdown_connections 2024-09-13T17:18:46.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.288+0000 7fc183d18640 1 -- 172.21.15.87:0/1228942220 wait complete. 2024-09-13T17:18:46.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.288+0000 7fc183d18640 1 Processor -- start 2024-09-13T17:18:46.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.288+0000 7fc183d18640 1 -- start start 2024-09-13T17:18:46.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.288+0000 7fc183d18640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc17c0fee60 0x7fc17c197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.288+0000 7fc183d18640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc17c103fb0 0x7fc17c1976a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.288+0000 7fc183d18640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc17c197be0 0x7fc17c1a21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.288+0000 7fc183d18640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c1a2880 con 0x7fc17c103fb0 2024-09-13T17:18:46.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.288+0000 7fc183d18640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c1a29f0 con 0x7fc17c0fee60 2024-09-13T17:18:46.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.288+0000 7fc183d18640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c1a2bb0 con 0x7fc17c197be0 2024-09-13T17:18:46.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.288+0000 7fc1812b3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc17c103fb0 0x7fc17c1976a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.288+0000 7fc1812b3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc17c103fb0 0x7fc17c1976a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37270/0 (socket says 172.21.15.87:37270) 2024-09-13T17:18:46.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.288+0000 7fc1812b3640 1 -- 172.21.15.87:0/627011279 learned_addr learned my addr 172.21.15.87:0/627011279 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:46.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.289+0000 7fc1822b5640 1 --2- 172.21.15.87:0/627011279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc17c197be0 0x7fc17c1a21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.289+0000 7fc181ab4640 1 --2- 172.21.15.87:0/627011279 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc17c0fee60 0x7fc17c197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.289+0000 7fc1812b3640 1 -- 172.21.15.87:0/627011279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc17c197be0 msgr2=0x7fc17c1a21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.289+0000 7fc1812b3640 1 --2- 172.21.15.87:0/627011279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc17c197be0 0x7fc17c1a21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.289+0000 7fc1812b3640 1 -- 172.21.15.87:0/627011279 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc17c0fee60 msgr2=0x7fc17c197160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.289+0000 7fc1812b3640 1 --2- 172.21.15.87:0/627011279 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc17c0fee60 0x7fc17c197160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.289+0000 7fc1812b3640 1 -- 172.21.15.87:0/627011279 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc170009560 con 0x7fc17c103fb0 2024-09-13T17:18:46.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.289+0000 7fc1822b5640 1 --2- 172.21.15.87:0/627011279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc17c197be0 0x7fc17c1a21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:46.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.289+0000 7fc1812b3640 1 --2- 172.21.15.87:0/627011279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc17c103fb0 0x7fc17c1976a0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fc1700057c0 tx=0x7fc170003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:46.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.289+0000 7fc17affd640 1 -- 172.21.15.87:0/627011279 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17003b670 con 0x7fc17c103fb0 2024-09-13T17:18:46.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.289+0000 7fc17affd640 1 -- 172.21.15.87:0/627011279 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc17003bc80 con 0x7fc17c103fb0 2024-09-13T17:18:46.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.289+0000 7fc183d18640 1 -- 172.21.15.87:0/627011279 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc17c1a2e30 con 0x7fc17c103fb0 2024-09-13T17:18:46.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.289+0000 7fc17affd640 1 -- 172.21.15.87:0/627011279 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc170031c90 con 0x7fc17c103fb0 2024-09-13T17:18:46.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.289+0000 7fc183d18640 1 -- 172.21.15.87:0/627011279 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc17c1a32b0 con 0x7fc17c103fb0 2024-09-13T17:18:46.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.291+0000 7fc17affd640 1 -- 172.21.15.87:0/627011279 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fc170031490 con 0x7fc17c103fb0 2024-09-13T17:18:46.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.292+0000 7fc186a37740 1 Processor -- start 2024-09-13T17:18:46.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.292+0000 7fc186a37740 1 -- start start 2024-09-13T17:18:46.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.292+0000 7fc186a37740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56280b8df790 0x56280b8dfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.292+0000 7fc186a37740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56280b8e00b0 0x56280b8ea410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.292+0000 7fc186a37740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56280b8ea950 0x56280b8ecd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.292+0000 7fc186a37740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56280b849cc0 con 0x56280b8ea950 2024-09-13T17:18:46.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.292+0000 7fc186a37740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56280b847450 con 0x56280b8df790 2024-09-13T17:18:46.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.292+0000 7fc186a37740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56280b842d40 con 0x56280b8e00b0 2024-09-13T17:18:46.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.292+0000 7fc1812b3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56280b8ea950 0x56280b8ecd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.292+0000 7fc17affd640 1 --2- 172.21.15.87:0/627011279 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc1640a1280 0x7fc1640a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.292+0000 7fc1822b5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56280b8df790 0x56280b8dfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.292+0000 7fc1822b5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56280b8df790 0x56280b8dfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.87:60858/0 (socket says 172.21.15.87:60858) 2024-09-13T17:18:46.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.292+0000 7fc1822b5640 1 -- 172.21.15.87:0/3999352701 learned_addr learned my addr 172.21.15.87:0/3999352701 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:46.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.292+0000 7fc1812b3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56280b8ea950 0x56280b8ecd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37286/0 (socket says 172.21.15.87:37286) 2024-09-13T17:18:46.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.292+0000 7fc181ab4640 1 --2- 172.21.15.87:0/3999352701 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56280b8e00b0 0x56280b8ea410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.293+0000 7fc1822b5640 1 --2- 172.21.15.87:0/627011279 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc1640a1280 0x7fc1640a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.293+0000 7fc17affd640 1 -- 172.21.15.87:0/627011279 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fc1700eda20 con 0x7fc17c103fb0 2024-09-13T17:18:46.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.293+0000 7fc1812b3640 1 -- 172.21.15.87:0/3999352701 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56280b8e00b0 msgr2=0x56280b8ea410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:46.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.293+0000 7fc1812b3640 1 --2- 172.21.15.87:0/3999352701 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56280b8e00b0 0x56280b8ea410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.293+0000 7fc1812b3640 1 -- 172.21.15.87:0/3999352701 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56280b8df790 msgr2=0x56280b8dfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:46.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.293+0000 7fc1812b3640 1 --2- 172.21.15.87:0/3999352701 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56280b8df790 0x56280b8dfb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.293+0000 7fc1812b3640 1 -- 172.21.15.87:0/3999352701 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56280b80a620 con 0x56280b8ea950 2024-09-13T17:18:46.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.293+0000 7fc1822b5640 1 --2- 172.21.15.87:0/3999352701 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56280b8df790 0x56280b8dfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:18:46.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.293+0000 7fc1812b3640 1 --2- 172.21.15.87:0/3999352701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56280b8ea950 0x56280b8ecd40 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fc1700eadc0 tx=0x7fc170009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2804bfb77f7afde4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:46.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.293+0000 7fc1822b5640 1 --2- 172.21.15.87:0/627011279 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc1640a1280 0x7fc1640a3740 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc16c012d60 tx=0x7fc16c004ab0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:46.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.293+0000 7fc163fff640 1 -- 172.21.15.87:0/3999352701 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1700b6ac0 con 0x56280b8ea950 2024-09-13T17:18:46.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.293+0000 7fc163fff640 1 -- 172.21.15.87:0/3999352701 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc1700ede90 con 0x56280b8ea950 2024-09-13T17:18:46.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.293+0000 7fc163fff640 1 -- 172.21.15.87:0/3999352701 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1700ba780 con 0x56280b8ea950 2024-09-13T17:18:46.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.294+0000 7fc186a37740 1 -- 172.21.15.87:0/3999352701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56280b8ea950 msgr2=0x56280b8ecd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.294+0000 7fc186a37740 1 --2- 172.21.15.87:0/3999352701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56280b8ea950 0x56280b8ecd40 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fc1700eadc0 tx=0x7fc170009260 comp rx=0 tx=0).stop 2024-09-13T17:18:46.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.294+0000 7fc186a37740 1 -- 172.21.15.87:0/3999352701 shutdown_connections 2024-09-13T17:18:46.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.294+0000 7fc186a37740 1 --2- 172.21.15.87:0/3999352701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56280b8ea950 0x56280b8ecd40 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.294+0000 7fc186a37740 1 --2- 172.21.15.87:0/3999352701 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56280b8e00b0 0x56280b8ea410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.294+0000 7fc186a37740 1 --2- 172.21.15.87:0/3999352701 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56280b8df790 0x56280b8dfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.294+0000 7fc186a37740 1 -- 172.21.15.87:0/3999352701 >> 172.21.15.87:0/3999352701 conn(0x56280b8dbd00 msgr2=0x56280b8dc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:46.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.294+0000 7fc186a37740 1 -- 172.21.15.87:0/3999352701 shutdown_connections 2024-09-13T17:18:46.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.294+0000 7fc186a37740 1 -- 172.21.15.87:0/3999352701 wait complete. 2024-09-13T17:18:46.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.294+0000 7fc186a37740 1 -- start start 2024-09-13T17:18:46.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.294+0000 7fc186a37740 1 Processor -- start 2024-09-13T17:18:46.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.295+0000 7fc186a37740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56280b8df790 0x56280b8e9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.295+0000 7fc186a37740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56280b8e00b0 0x56280b8e7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.295+0000 7fc186a37740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56280b8ea950 0x56280b8e77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.295+0000 7fc186a37740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56280b801180 con 0x56280b8e00b0 2024-09-13T17:18:46.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.295+0000 7fc186a37740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56280b51b430 con 0x56280b8df790 2024-09-13T17:18:46.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.295+0000 7fc186a37740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56280b7c65e0 con 0x56280b8ea950 2024-09-13T17:18:46.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.295+0000 7fc186a37740 10 client.0 _ll_register_callbacks cb 0x56280b832aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:18:46.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.295+0000 7fc1812b3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56280b8e00b0 0x56280b8e7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.295+0000 7fc1812b3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56280b8e00b0 0x56280b8e7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37288/0 (socket says 172.21.15.87:37288) 2024-09-13T17:18:46.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.295+0000 7fc1812b3640 1 -- 172.21.15.87:0/2407321084 learned_addr learned my addr 172.21.15.87:0/2407321084 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:46.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.295+0000 7fc181ab4640 1 --2- 172.21.15.87:0/2407321084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56280b8df790 0x56280b8e9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.295+0000 7fc1822b5640 1 --2- 172.21.15.87:0/2407321084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56280b8ea950 0x56280b8e77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.295+0000 7fc1812b3640 1 -- 172.21.15.87:0/2407321084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56280b8ea950 msgr2=0x56280b8e77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:46.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.295+0000 7fc1812b3640 1 --2- 172.21.15.87:0/2407321084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56280b8ea950 0x56280b8e77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.295+0000 7fc1812b3640 1 -- 172.21.15.87:0/2407321084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56280b8df790 msgr2=0x56280b8e9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:46.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.295+0000 7fc1812b3640 1 --2- 172.21.15.87:0/2407321084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56280b8df790 0x56280b8e9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.295+0000 7fc1812b3640 1 -- 172.21.15.87:0/2407321084 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc17c1a32b0 con 0x56280b8e00b0 2024-09-13T17:18:46.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.295+0000 7fc1822b5640 1 --2- 172.21.15.87:0/2407321084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56280b8ea950 0x56280b8e77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:46.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.295+0000 7fc1812b3640 1 --2- 172.21.15.87:0/2407321084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56280b8e00b0 0x56280b8e7290 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fc1700ead90 tx=0x7fc1700da2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40f13b3e370d233 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:46.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.295+0000 7fc1617fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:18:46.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.295+0000 7fc1617fa640 1 -- 172.21.15.87:0/2407321084 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1700ba2c0 con 0x56280b8e00b0 2024-09-13T17:18:46.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.295+0000 7fc1617fa640 1 -- 172.21.15.87:0/2407321084 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fc1700bae80 con 0x56280b8e00b0 2024-09-13T17:18:46.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.295+0000 7fc186a37740 1 -- 172.21.15.87:0/2407321084 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56280b86cb80 con 0x56280b8e00b0 2024-09-13T17:18:46.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.295+0000 7fc1617fa640 1 -- 172.21.15.87:0/2407321084 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1700ba0e0 con 0x56280b8e00b0 2024-09-13T17:18:46.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.296+0000 7fc186a37740 10 client.16983 fetch_fsmap learned FSMap version 30 2024-09-13T17:18:46.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.296+0000 7fc186a37740 1 -- 172.21.15.87:0/2407321084 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x56280b8413c0 con 0x56280b8e00b0 2024-09-13T17:18:46.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.296+0000 7fc1617fa640 1 -- 172.21.15.87:0/2407321084 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc17009d020 con 0x56280b8e00b0 2024-09-13T17:18:46.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.296+0000 7fc1617fa640 1 -- 172.21.15.87:0/2407321084 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fc1700b9c70 con 0x56280b8e00b0 2024-09-13T17:18:46.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.296+0000 7fc186a37740 10 client.16983 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:18:46.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.296+0000 7fc186a37740 10 client.16983 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:18:46.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.296+0000 7fc186a37740 20 client.16983 populate_metadata read hostname 'smithi087' 2024-09-13T17:18:46.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.296+0000 7fc186a37740 1 --2- 172.21.15.87:0/2407321084 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56280b8f9c10 0x56280b8fc030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.296+0000 7fc186a37740 4 client.16983 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:18:46.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.296+0000 7fc186a37740 1 -- 172.21.15.87:0/2407321084 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56280b8351f0 con 0x56280b8f9c10 2024-09-13T17:18:46.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.296+0000 7fc181ab4640 1 --2- 172.21.15.87:0/2407321084 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56280b8f9c10 0x56280b8fc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.297+0000 7fc1617fa640 10 client.16983 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:18:46.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.297+0000 7fc181ab4640 1 --2- 172.21.15.87:0/2407321084 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56280b8f9c10 0x56280b8fc030 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30a2c078d78a432a server_cookie=2b5103cbfa5d2cb3 in_seq=0 out_seq=0 2024-09-13T17:18:46.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.297+0000 7fc1617fa640 1 -- 172.21.15.87:0/2407321084 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x56280b8351f0 con 0x56280b8f9c10 2024-09-13T17:18:46.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.297+0000 7fc1617fa640 10 client.16983 handle_command_reply: tid=0 2024-09-13T17:18:46.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.297+0000 7fc186a37740 1 client.16983 shutdown 2024-09-13T17:18:46.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.297+0000 7fc186a37740 1 -- 172.21.15.87:0/2407321084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56280b8e00b0 msgr2=0x56280b8e7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.297+0000 7fc186a37740 1 --2- 172.21.15.87:0/2407321084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56280b8e00b0 0x56280b8e7290 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fc1700ead90 tx=0x7fc1700da2f0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.297+0000 7fc186a37740 1 -- 172.21.15.87:0/2407321084 shutdown_connections 2024-09-13T17:18:46.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.297+0000 7fc186a37740 1 --2- 172.21.15.87:0/2407321084 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56280b8f9c10 0x56280b8fc030 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.297+0000 7fc186a37740 1 --2- 172.21.15.87:0/2407321084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56280b8ea950 0x56280b8e77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.297+0000 7fc1617fa640 0 client.16983 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:18:46.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.297+0000 7fc186a37740 1 --2- 172.21.15.87:0/2407321084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56280b8e00b0 0x56280b8e7290 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.297+0000 7fc186a37740 1 --2- 172.21.15.87:0/2407321084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56280b8df790 0x56280b8e9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.297+0000 7fc186a37740 1 -- 172.21.15.87:0/2407321084 >> 172.21.15.87:0/2407321084 conn(0x56280b8dbd00 msgr2=0x56280b8e1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:46.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.297+0000 7fc186a37740 1 -- 172.21.15.87:0/2407321084 shutdown_connections 2024-09-13T17:18:46.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.297+0000 7fc186a37740 1 -- 172.21.15.87:0/2407321084 wait complete. 2024-09-13T17:18:46.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.298+0000 7fc186a37740 20 client.16983 trim_cache size 0 max 16384 2024-09-13T17:18:46.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.308+0000 7fc186a37740 1 Processor -- start 2024-09-13T17:18:46.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.308+0000 7fc186a37740 1 -- start start 2024-09-13T17:18:46.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.308+0000 7fc186a37740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56280b8df790 0x56280b8f1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.308+0000 7fc186a37740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56280b8e00b0 0x56280b8f18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.308+0000 7fc186a37740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56280b8ea950 0x56280b8e5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.308+0000 7fc186a37740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56280b8e7b40 con 0x56280b8ea950 2024-09-13T17:18:46.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.308+0000 7fc186a37740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56280b8dce70 con 0x56280b8e00b0 2024-09-13T17:18:46.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.308+0000 7fc186a37740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56280b8d6d80 con 0x56280b8df790 2024-09-13T17:18:46.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.309+0000 7fc1822b5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56280b8ea950 0x56280b8e5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.309+0000 7fc1822b5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56280b8ea950 0x56280b8e5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37304/0 (socket says 172.21.15.87:37304) 2024-09-13T17:18:46.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.309+0000 7fc1822b5640 1 -- 172.21.15.87:0/1603447500 learned_addr learned my addr 172.21.15.87:0/1603447500 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:46.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.309+0000 7fc181ab4640 1 --2- 172.21.15.87:0/1603447500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56280b8df790 0x56280b8f1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.309+0000 7fc1822b5640 1 -- 172.21.15.87:0/1603447500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56280b8df790 msgr2=0x56280b8f1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:46.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.309+0000 7fc1822b5640 1 --2- 172.21.15.87:0/1603447500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56280b8df790 0x56280b8f1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.309+0000 7fc1822b5640 1 -- 172.21.15.87:0/1603447500 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56280b8e00b0 msgr2=0x56280b8f18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:46.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.309+0000 7fc1822b5640 1 --2- 172.21.15.87:0/1603447500 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56280b8e00b0 0x56280b8f18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.309+0000 7fc1822b5640 1 -- 172.21.15.87:0/1603447500 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56280b7e3770 con 0x56280b8ea950 2024-09-13T17:18:46.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.309+0000 7fc1822b5640 1 --2- 172.21.15.87:0/1603447500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56280b8ea950 0x56280b8e5b40 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fc16c012e40 tx=0x7fc16c00a860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35dabf6d813118b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:46.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.309+0000 7fc178ff9640 1 -- 172.21.15.87:0/1603447500 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c003970 con 0x56280b8ea950 2024-09-13T17:18:46.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.309+0000 7fc178ff9640 1 -- 172.21.15.87:0/1603447500 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc16c004020 con 0x56280b8ea950 2024-09-13T17:18:46.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.309+0000 7fc178ff9640 1 -- 172.21.15.87:0/1603447500 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c01e6a0 con 0x56280b8ea950 2024-09-13T17:18:46.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.310+0000 7fc186a37740 1 -- 172.21.15.87:0/1603447500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56280b8ea950 msgr2=0x56280b8e5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.310+0000 7fc186a37740 1 --2- 172.21.15.87:0/1603447500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56280b8ea950 0x56280b8e5b40 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fc16c012e40 tx=0x7fc16c00a860 comp rx=0 tx=0).stop 2024-09-13T17:18:46.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.310+0000 7fc186a37740 1 -- 172.21.15.87:0/1603447500 shutdown_connections 2024-09-13T17:18:46.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.310+0000 7fc186a37740 1 --2- 172.21.15.87:0/1603447500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56280b8ea950 0x56280b8e5b40 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.310+0000 7fc186a37740 1 --2- 172.21.15.87:0/1603447500 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56280b8e00b0 0x56280b8f18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.310+0000 7fc186a37740 1 --2- 172.21.15.87:0/1603447500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56280b8df790 0x56280b8f1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.310+0000 7fc186a37740 1 -- 172.21.15.87:0/1603447500 >> 172.21.15.87:0/1603447500 conn(0x56280b8dbd00 msgr2=0x56280b8f5e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:46.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.310+0000 7fc186a37740 1 -- 172.21.15.87:0/1603447500 shutdown_connections 2024-09-13T17:18:46.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.310+0000 7fc186a37740 1 -- 172.21.15.87:0/1603447500 wait complete. 2024-09-13T17:18:46.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.310+0000 7fc186a37740 1 -- start start 2024-09-13T17:18:46.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.310+0000 7fc186a37740 1 Processor -- start 2024-09-13T17:18:46.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.310+0000 7fc186a37740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56280b8df790 0x56280b8f1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.310+0000 7fc186a37740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56280b8e00b0 0x56280b8edd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.310+0000 7fc186a37740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56280b8ea950 0x56280b8ee460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.310+0000 7fc186a37740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56280b8eeb30 con 0x56280b8ea950 2024-09-13T17:18:46.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.310+0000 7fc186a37740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56280b954520 con 0x56280b8e00b0 2024-09-13T17:18:46.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.310+0000 7fc186a37740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56280b954660 con 0x56280b8df790 2024-09-13T17:18:46.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.310+0000 7fc186a37740 10 client.0 _ll_register_callbacks cb 0x7fc1700b6f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:18:46.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.311+0000 7fc1822b5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56280b8ea950 0x56280b8ee460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.311+0000 7fc1822b5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56280b8ea950 0x56280b8ee460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37312/0 (socket says 172.21.15.87:37312) 2024-09-13T17:18:46.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.311+0000 7fc1822b5640 1 -- 172.21.15.87:0/670331645 learned_addr learned my addr 172.21.15.87:0/670331645 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:46.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.311+0000 7fc181ab4640 1 --2- 172.21.15.87:0/670331645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56280b8df790 0x56280b8f1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.311+0000 7fc1812b3640 1 --2- 172.21.15.87:0/670331645 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56280b8e00b0 0x56280b8edd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.311+0000 7fc1822b5640 1 -- 172.21.15.87:0/670331645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56280b8df790 msgr2=0x56280b8f1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:46.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.311+0000 7fc1822b5640 1 --2- 172.21.15.87:0/670331645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56280b8df790 0x56280b8f1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.311+0000 7fc1822b5640 1 -- 172.21.15.87:0/670331645 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56280b8e00b0 msgr2=0x56280b8edd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:46.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.311+0000 7fc1822b5640 1 --2- 172.21.15.87:0/670331645 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56280b8e00b0 0x56280b8edd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.311+0000 7fc1822b5640 1 -- 172.21.15.87:0/670331645 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc16c00a450 con 0x56280b8ea950 2024-09-13T17:18:46.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.311+0000 7fc1812b3640 1 --2- 172.21.15.87:0/670331645 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56280b8e00b0 0x56280b8edd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:46.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.311+0000 7fc1822b5640 1 --2- 172.21.15.87:0/670331645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56280b8ea950 0x56280b8ee460 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fc16c005c90 tx=0x7fc16c003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a12ca84b7109b931 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:46.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.311+0000 7fc1617fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:18:46.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.311+0000 7fc1617fa640 1 -- 172.21.15.87:0/670331645 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c0047b0 con 0x56280b8ea950 2024-09-13T17:18:46.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.311+0000 7fc1617fa640 1 -- 172.21.15.87:0/670331645 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fc16c004b20 con 0x56280b8ea950 2024-09-13T17:18:46.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.311+0000 7fc186a37740 1 -- 172.21.15.87:0/670331645 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc1700ede90 con 0x56280b8ea950 2024-09-13T17:18:46.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.311+0000 7fc1617fa640 1 -- 172.21.15.87:0/670331645 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc16c008eb0 con 0x56280b8ea950 2024-09-13T17:18:46.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.311+0000 7fc186a37740 10 client.16989 fetch_fsmap learned FSMap version 30 2024-09-13T17:18:46.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.311+0000 7fc186a37740 1 -- 172.21.15.87:0/670331645 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x56280b808e80 con 0x56280b8ea950 2024-09-13T17:18:46.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.311+0000 7fc1617fa640 1 -- 172.21.15.87:0/670331645 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc1700ede90 con 0x56280b8ea950 2024-09-13T17:18:46.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.312+0000 7fc1617fa640 1 -- 172.21.15.87:0/670331645 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fc16c005810 con 0x56280b8ea950 2024-09-13T17:18:46.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.312+0000 7fc186a37740 10 client.16989 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:18:46.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.312+0000 7fc186a37740 10 client.16989 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:18:46.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.312+0000 7fc186a37740 20 client.16989 populate_metadata read hostname 'smithi087' 2024-09-13T17:18:46.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.312+0000 7fc186a37740 1 --2- 172.21.15.87:0/670331645 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56280b955c50 0x56280b958070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:46.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.312+0000 7fc186a37740 4 client.16989 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:18:46.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.312+0000 7fc186a37740 1 -- 172.21.15.87:0/670331645 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56280b5364e0 con 0x56280b955c50 2024-09-13T17:18:46.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.312+0000 7fc181ab4640 1 --2- 172.21.15.87:0/670331645 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56280b955c50 0x56280b958070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:46.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.312+0000 7fc1617fa640 10 client.16989 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:18:46.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.312+0000 7fc181ab4640 1 --2- 172.21.15.87:0/670331645 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56280b955c50 0x56280b958070 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c465a35047f67f11 server_cookie=9e7fdfebc08eec58 in_seq=0 out_seq=0 2024-09-13T17:18:46.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.313+0000 7fc1617fa640 1 -- 172.21.15.87:0/670331645 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56280b5364e0 con 0x56280b955c50 2024-09-13T17:18:46.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.313+0000 7fc1617fa640 10 client.16989 handle_command_reply: tid=0 2024-09-13T17:18:46.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.313+0000 7fc186a37740 1 client.16989 shutdown 2024-09-13T17:18:46.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.313+0000 7fc186a37740 1 -- 172.21.15.87:0/670331645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56280b8ea950 msgr2=0x56280b8ee460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.313+0000 7fc186a37740 1 --2- 172.21.15.87:0/670331645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56280b8ea950 0x56280b8ee460 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fc16c005c90 tx=0x7fc16c003c00 comp rx=0 tx=0).stop 2024-09-13T17:18:46.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.313+0000 7fc186a37740 1 -- 172.21.15.87:0/670331645 shutdown_connections 2024-09-13T17:18:46.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.313+0000 7fc186a37740 1 --2- 172.21.15.87:0/670331645 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x56280b955c50 0x56280b958070 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.313+0000 7fc186a37740 1 --2- 172.21.15.87:0/670331645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56280b8ea950 0x56280b8ee460 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.313+0000 7fc1617fa640 0 client.16989 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:18:46.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.313+0000 7fc186a37740 1 --2- 172.21.15.87:0/670331645 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56280b8e00b0 0x56280b8edd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.313+0000 7fc186a37740 1 --2- 172.21.15.87:0/670331645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56280b8df790 0x56280b8f1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.313+0000 7fc186a37740 1 -- 172.21.15.87:0/670331645 >> 172.21.15.87:0/670331645 conn(0x56280b8dbd00 msgr2=0x56280b8f5e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:46.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.313+0000 7fc186a37740 1 -- 172.21.15.87:0/670331645 shutdown_connections 2024-09-13T17:18:46.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.313+0000 7fc186a37740 1 -- 172.21.15.87:0/670331645 wait complete. 2024-09-13T17:18:46.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.313+0000 7fc186a37740 20 client.16989 trim_cache size 0 max 16384 2024-09-13T17:18:46.324 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:18:46.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.313+0000 7fc183d18640 1 -- 172.21.15.87:0/627011279 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc1640a1280 msgr2=0x7fc1640a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.313+0000 7fc183d18640 1 --2- 172.21.15.87:0/627011279 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc1640a1280 0x7fc1640a3740 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc16c012d60 tx=0x7fc16c004ab0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.313+0000 7fc183d18640 1 -- 172.21.15.87:0/627011279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc17c103fb0 msgr2=0x7fc17c1976a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:46.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.313+0000 7fc183d18640 1 --2- 172.21.15.87:0/627011279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc17c103fb0 0x7fc17c1976a0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fc1700057c0 tx=0x7fc170003d40 comp rx=0 tx=0).stop 2024-09-13T17:18:46.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.313+0000 7fc183d18640 1 -- 172.21.15.87:0/627011279 shutdown_connections 2024-09-13T17:18:46.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.313+0000 7fc183d18640 1 --2- 172.21.15.87:0/627011279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc17c197be0 0x7fc17c1a21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.313+0000 7fc183d18640 1 --2- 172.21.15.87:0/627011279 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc1640a1280 0x7fc1640a3740 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.313+0000 7fc183d18640 1 --2- 172.21.15.87:0/627011279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc17c103fb0 0x7fc17c1976a0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.313+0000 7fc183d18640 1 --2- 172.21.15.87:0/627011279 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc17c0fee60 0x7fc17c197160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:46.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.313+0000 7fc183d18640 1 -- 172.21.15.87:0/627011279 >> 172.21.15.87:0/627011279 conn(0x7fc17c075c60 msgr2=0x7fc17c102380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:46.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.313+0000 7fc183d18640 1 -- 172.21.15.87:0/627011279 shutdown_connections 2024-09-13T17:18:46.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:46.313+0000 7fc183d18640 1 -- 172.21.15.87:0/627011279 wait complete. 2024-09-13T17:18:46.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:46 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3300264682' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:18:46.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:46 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3300264682' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:18:46.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:46 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3300264682' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:18:47.327 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-13T17:18:47.328 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-09-13T17:18:47.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.443+0000 7f84a7c19640 1 -- 172.21.15.87:0/2680071032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84a01041c0 msgr2=0x7f84a0104670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.443+0000 7f84a7c19640 1 --2- 172.21.15.87:0/2680071032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84a01041c0 0x7f84a0104670 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f8498009cd0 tx=0x7f849802a8e0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.443+0000 7f84a7c19640 1 -- 172.21.15.87:0/2680071032 shutdown_connections 2024-09-13T17:18:47.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.443+0000 7f84a7c19640 1 --2- 172.21.15.87:0/2680071032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84a01041c0 0x7f84a0104670 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.443+0000 7f84a7c19640 1 --2- 172.21.15.87:0/2680071032 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84a00ff5f0 0x7f84a0103ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.443+0000 7f84a7c19640 1 --2- 172.21.15.87:0/2680071032 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84a00fec40 0x7f84a00ff020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.443+0000 7f84a7c19640 1 -- 172.21.15.87:0/2680071032 >> 172.21.15.87:0/2680071032 conn(0x7f84a00fa930 msgr2=0x7f84a00fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:47.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.443+0000 7f84a7c19640 1 -- 172.21.15.87:0/2680071032 shutdown_connections 2024-09-13T17:18:47.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.443+0000 7f84a7c19640 1 -- 172.21.15.87:0/2680071032 wait complete. 2024-09-13T17:18:47.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.444+0000 7f84a7c19640 1 Processor -- start 2024-09-13T17:18:47.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.444+0000 7f84a7c19640 1 -- start start 2024-09-13T17:18:47.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.444+0000 7f84a7c19640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84a00fec40 0x7f84a01a2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.444+0000 7f84a7c19640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84a00ff5f0 0x7f84a01a2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.444+0000 7f84a7c19640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84a01041c0 0x7f84a019c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.444+0000 7f84a7c19640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a019cc50 con 0x7f84a01041c0 2024-09-13T17:18:47.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.444+0000 7f84a7c19640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a019cdc0 con 0x7f84a00ff5f0 2024-09-13T17:18:47.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.444+0000 7f84a7c19640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a019cf80 con 0x7f84a00fec40 2024-09-13T17:18:47.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.444+0000 7f84a61b6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84a01041c0 0x7f84a019c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.444+0000 7f84a61b6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84a01041c0 0x7f84a019c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37324/0 (socket says 172.21.15.87:37324) 2024-09-13T17:18:47.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.444+0000 7f84a61b6640 1 -- 172.21.15.87:0/405272385 learned_addr learned my addr 172.21.15.87:0/405272385 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:47.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.444+0000 7f84a51b4640 1 --2- 172.21.15.87:0/405272385 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84a00ff5f0 0x7f84a01a2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.444+0000 7f84a61b6640 1 -- 172.21.15.87:0/405272385 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84a00fec40 msgr2=0x7f84a01a2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.444+0000 7f84a59b5640 1 --2- 172.21.15.87:0/405272385 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84a00fec40 0x7f84a01a2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.444+0000 7f84a61b6640 1 --2- 172.21.15.87:0/405272385 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84a00fec40 0x7f84a01a2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.444+0000 7f84a61b6640 1 -- 172.21.15.87:0/405272385 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84a00ff5f0 msgr2=0x7f84a01a2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.444+0000 7f84a61b6640 1 --2- 172.21.15.87:0/405272385 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84a00ff5f0 0x7f84a01a2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.445+0000 7f84a61b6640 1 -- 172.21.15.87:0/405272385 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8498009900 con 0x7f84a01041c0 2024-09-13T17:18:47.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.445+0000 7f84a59b5640 1 --2- 172.21.15.87:0/405272385 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84a00fec40 0x7f84a01a2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:47.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.445+0000 7f84a51b4640 1 --2- 172.21.15.87:0/405272385 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84a00ff5f0 0x7f84a01a2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:47.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.445+0000 7f84a61b6640 1 --2- 172.21.15.87:0/405272385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84a01041c0 0x7f84a019c630 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f8498005cc0 tx=0x7f8498030990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:47.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.445+0000 7f8496ffd640 1 -- 172.21.15.87:0/405272385 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8498003b70 con 0x7f84a01041c0 2024-09-13T17:18:47.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.445+0000 7f8496ffd640 1 -- 172.21.15.87:0/405272385 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8498031cc0 con 0x7f84a01041c0 2024-09-13T17:18:47.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.445+0000 7f8496ffd640 1 -- 172.21.15.87:0/405272385 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84980446a0 con 0x7f84a01041c0 2024-09-13T17:18:47.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.445+0000 7f84a7c19640 1 -- 172.21.15.87:0/405272385 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a019d200 con 0x7f84a01041c0 2024-09-13T17:18:47.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.445+0000 7f84a7c19640 1 -- 172.21.15.87:0/405272385 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84a01a9540 con 0x7f84a01041c0 2024-09-13T17:18:47.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.447+0000 7f8496ffd640 1 -- 172.21.15.87:0/405272385 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f849800a040 con 0x7f84a01041c0 2024-09-13T17:18:47.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.448+0000 7f84aaa18740 1 Processor -- start 2024-09-13T17:18:47.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.448+0000 7f84aaa18740 1 -- start start 2024-09-13T17:18:47.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.448+0000 7f84aaa18740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f81bbe67c0 0x55f81bbe6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.448+0000 7f84aaa18740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f81bbe70e0 0x55f81bbf1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.448+0000 7f84aaa18740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f81bbf1980 0x55f81bbf3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.448+0000 7f84aaa18740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f81bb51c60 con 0x55f81bbe70e0 2024-09-13T17:18:47.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.448+0000 7f84aaa18740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f81bb4f3f0 con 0x55f81bbf1980 2024-09-13T17:18:47.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.448+0000 7f84aaa18740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f81bb4ace0 con 0x55f81bbe67c0 2024-09-13T17:18:47.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.448+0000 7f84a59b5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f81bbe70e0 0x55f81bbf1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.448+0000 7f84a59b5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f81bbe70e0 0x55f81bbf1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37340/0 (socket says 172.21.15.87:37340) 2024-09-13T17:18:47.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.448+0000 7f84a59b5640 1 -- 172.21.15.87:0/142469495 learned_addr learned my addr 172.21.15.87:0/142469495 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:47.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.448+0000 7f84a51b4640 1 --2- 172.21.15.87:0/142469495 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f81bbe67c0 0x55f81bbe6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.448+0000 7f8496ffd640 1 --2- 172.21.15.87:0/405272385 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f848c0a1280 0x7f848c0a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.448+0000 7f84a51b4640 1 --2- 172.21.15.87:0/142469495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f81bbf1980 0x55f81bbf3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.448+0000 7f84a59b5640 1 -- 172.21.15.87:0/142469495 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f81bbe67c0 msgr2=0x55f81bbe6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:47.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.448+0000 7f84a59b5640 1 --2- 172.21.15.87:0/142469495 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f81bbe67c0 0x55f81bbe6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.448+0000 7f84a61b6640 1 --2- 172.21.15.87:0/405272385 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f848c0a1280 0x7f848c0a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.449+0000 7f84a59b5640 1 -- 172.21.15.87:0/142469495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f81bbf1980 msgr2=0x55f81bbf3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:47.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.449+0000 7f84a59b5640 1 --2- 172.21.15.87:0/142469495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f81bbf1980 0x55f81bbf3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.449+0000 7f84a59b5640 1 -- 172.21.15.87:0/142469495 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f81bb06970 con 0x55f81bbe70e0 2024-09-13T17:18:47.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.449+0000 7f84a51b4640 1 --2- 172.21.15.87:0/142469495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f81bbf1980 0x55f81bbf3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:47.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.449+0000 7f8496ffd640 1 -- 172.21.15.87:0/405272385 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f84980eeb60 con 0x7f84a01041c0 2024-09-13T17:18:47.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.449+0000 7f84a59b5640 1 --2- 172.21.15.87:0/142469495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f81bbe70e0 0x55f81bbf1440 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f849c00aa10 tx=0x7f849c00aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf2eaeb426f7d6e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:47.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.449+0000 7f848bfff640 1 -- 172.21.15.87:0/142469495 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849c00cc60 con 0x55f81bbe70e0 2024-09-13T17:18:47.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.449+0000 7f848bfff640 1 -- 172.21.15.87:0/142469495 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f849c00cdc0 con 0x55f81bbe70e0 2024-09-13T17:18:47.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.449+0000 7f848bfff640 1 -- 172.21.15.87:0/142469495 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849c010750 con 0x55f81bbe70e0 2024-09-13T17:18:47.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.450+0000 7f84aaa18740 1 -- 172.21.15.87:0/142469495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f81bbe70e0 msgr2=0x55f81bbf1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.450+0000 7f84aaa18740 1 --2- 172.21.15.87:0/142469495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f81bbe70e0 0x55f81bbf1440 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f849c00aa10 tx=0x7f849c00aed0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.450+0000 7f84a61b6640 1 --2- 172.21.15.87:0/405272385 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f848c0a1280 0x7f848c0a3740 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f84980bb850 tx=0x7f84980b2040 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:47.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.450+0000 7f84aaa18740 1 -- 172.21.15.87:0/142469495 shutdown_connections 2024-09-13T17:18:47.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.450+0000 7f84aaa18740 1 --2- 172.21.15.87:0/142469495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f81bbf1980 0x55f81bbf3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.450+0000 7f84aaa18740 1 --2- 172.21.15.87:0/142469495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f81bbe70e0 0x55f81bbf1440 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.450+0000 7f84aaa18740 1 --2- 172.21.15.87:0/142469495 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f81bbe67c0 0x55f81bbe6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.450+0000 7f84aaa18740 1 -- 172.21.15.87:0/142469495 >> 172.21.15.87:0/142469495 conn(0x55f81bbe2d50 msgr2=0x55f81bbe3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:47.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.450+0000 7f84aaa18740 1 -- 172.21.15.87:0/142469495 shutdown_connections 2024-09-13T17:18:47.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.450+0000 7f84aaa18740 1 -- 172.21.15.87:0/142469495 wait complete. 2024-09-13T17:18:47.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.450+0000 7f84aaa18740 1 -- start start 2024-09-13T17:18:47.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.450+0000 7f84aaa18740 1 Processor -- start 2024-09-13T17:18:47.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.451+0000 7f84aaa18740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f81bbe67c0 0x55f81bbf1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.451+0000 7f84aaa18740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f81bbe70e0 0x55f81bbee5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.451+0000 7f84aaa18740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f81bbf1980 0x55f81bbeeb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.451+0000 7f84aaa18740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f81bb08f80 con 0x55f81bbe70e0 2024-09-13T17:18:47.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.451+0000 7f84aaa18740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f81bb08c20 con 0x55f81bbf1980 2024-09-13T17:18:47.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.451+0000 7f84aaa18740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f81bad5ab0 con 0x55f81bbe67c0 2024-09-13T17:18:47.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.451+0000 7f84aaa18740 10 client.0 _ll_register_callbacks cb 0x55f81bb44350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:18:47.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.451+0000 7f84a59b5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f81bbe70e0 0x55f81bbee5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.451+0000 7f84a59b5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f81bbe70e0 0x55f81bbee5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37354/0 (socket says 172.21.15.87:37354) 2024-09-13T17:18:47.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.451+0000 7f84a59b5640 1 -- 172.21.15.87:0/346234561 learned_addr learned my addr 172.21.15.87:0/346234561 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:47.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.451+0000 7f84a51b4640 1 --2- 172.21.15.87:0/346234561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f81bbf1980 0x55f81bbeeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.451+0000 7f84a51b4640 1 --2- 172.21.15.87:0/346234561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f81bbe67c0 0x55f81bbf1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.451+0000 7f84a59b5640 1 -- 172.21.15.87:0/346234561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f81bbe67c0 msgr2=0x55f81bbf1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:47.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.451+0000 7f84a59b5640 1 --2- 172.21.15.87:0/346234561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f81bbe67c0 0x55f81bbf1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.451+0000 7f84a59b5640 1 -- 172.21.15.87:0/346234561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f81bbf1980 msgr2=0x55f81bbeeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:47.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.451+0000 7f84a59b5640 1 --2- 172.21.15.87:0/346234561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f81bbf1980 0x55f81bbeeb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.451+0000 7f84a59b5640 1 -- 172.21.15.87:0/346234561 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f849c00a640 con 0x55f81bbe70e0 2024-09-13T17:18:47.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.451+0000 7f84a51b4640 1 --2- 172.21.15.87:0/346234561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f81bbf1980 0x55f81bbeeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:47.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.451+0000 7f84a59b5640 1 --2- 172.21.15.87:0/346234561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f81bbe70e0 0x55f81bbee5b0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f849c008010 tx=0x7f849c0116a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30048fbe36e07b79 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:47.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.451+0000 7f84897fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:18:47.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.451+0000 7f84897fa640 1 -- 172.21.15.87:0/346234561 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849c011a90 con 0x55f81bbe70e0 2024-09-13T17:18:47.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.451+0000 7f84897fa640 1 -- 172.21.15.87:0/346234561 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f849c01a450 con 0x55f81bbe70e0 2024-09-13T17:18:47.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.451+0000 7f84aaa18740 1 -- 172.21.15.87:0/346234561 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f81b83e590 con 0x55f81bbe70e0 2024-09-13T17:18:47.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.452+0000 7f84897fa640 1 -- 172.21.15.87:0/346234561 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f849c01a610 con 0x55f81bbe70e0 2024-09-13T17:18:47.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.452+0000 7f84aaa18740 10 client.17001 fetch_fsmap learned FSMap version 30 2024-09-13T17:18:47.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.452+0000 7f84aaa18740 1 -- 172.21.15.87:0/346234561 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55f81bb49360 con 0x55f81bbe70e0 2024-09-13T17:18:47.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.452+0000 7f84897fa640 1 -- 172.21.15.87:0/346234561 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55f81b83e590 con 0x55f81bbe70e0 2024-09-13T17:18:47.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.452+0000 7f84897fa640 1 -- 172.21.15.87:0/346234561 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f849c010820 con 0x55f81bbe70e0 2024-09-13T17:18:47.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.452+0000 7f84aaa18740 10 client.17001 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:18:47.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.452+0000 7f84aaa18740 10 client.17001 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:18:47.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.452+0000 7f84aaa18740 20 client.17001 populate_metadata read hostname 'smithi087' 2024-09-13T17:18:47.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.452+0000 7f84aaa18740 1 --2- 172.21.15.87:0/346234561 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55f81bc014f0 0x55f81bc03910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.452+0000 7f84aaa18740 4 client.17001 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:18:47.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.452+0000 7f84aaa18740 1 -- 172.21.15.87:0/346234561 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f81b84f860 con 0x55f81bc014f0 2024-09-13T17:18:47.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.452+0000 7f84a51b4640 1 --2- 172.21.15.87:0/346234561 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55f81bc014f0 0x55f81bc03910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.453+0000 7f84897fa640 10 client.17001 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:18:47.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.453+0000 7f84a51b4640 1 --2- 172.21.15.87:0/346234561 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55f81bc014f0 0x55f81bc03910 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=421f96514710c16 server_cookie=e0d194cbbbbcde11 in_seq=0 out_seq=0 2024-09-13T17:18:47.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.453+0000 7f84897fa640 1 -- 172.21.15.87:0/346234561 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55f81b84f860 con 0x55f81bc014f0 2024-09-13T17:18:47.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.453+0000 7f84897fa640 10 client.17001 handle_command_reply: tid=0 2024-09-13T17:18:47.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.453+0000 7f84aaa18740 1 client.17001 shutdown 2024-09-13T17:18:47.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.453+0000 7f84aaa18740 1 -- 172.21.15.87:0/346234561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f81bbe70e0 msgr2=0x55f81bbee5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.453+0000 7f84aaa18740 1 --2- 172.21.15.87:0/346234561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f81bbe70e0 0x55f81bbee5b0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f849c008010 tx=0x7f849c0116a0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.453+0000 7f84aaa18740 1 -- 172.21.15.87:0/346234561 shutdown_connections 2024-09-13T17:18:47.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.453+0000 7f84aaa18740 1 --2- 172.21.15.87:0/346234561 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55f81bc014f0 0x55f81bc03910 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.453+0000 7f84aaa18740 1 --2- 172.21.15.87:0/346234561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f81bbf1980 0x55f81bbeeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.453+0000 7f84aaa18740 1 --2- 172.21.15.87:0/346234561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f81bbe70e0 0x55f81bbee5b0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.453+0000 7f84aaa18740 1 --2- 172.21.15.87:0/346234561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f81bbe67c0 0x55f81bbf1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.453+0000 7f84897fa640 0 client.17001 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:18:47.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.453+0000 7f84aaa18740 1 -- 172.21.15.87:0/346234561 >> 172.21.15.87:0/346234561 conn(0x55f81bbe2d50 msgr2=0x55f81bbe81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:47.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.454+0000 7f84aaa18740 1 -- 172.21.15.87:0/346234561 shutdown_connections 2024-09-13T17:18:47.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.454+0000 7f84aaa18740 1 -- 172.21.15.87:0/346234561 wait complete. 2024-09-13T17:18:47.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.454+0000 7f84aaa18740 20 client.17001 trim_cache size 0 max 16384 2024-09-13T17:18:47.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.468+0000 7f84aaa18740 1 Processor -- start 2024-09-13T17:18:47.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.468+0000 7f84aaa18740 1 -- start start 2024-09-13T17:18:47.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.468+0000 7f84aaa18740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f81bbe67c0 0x55f81bbf8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.468+0000 7f84aaa18740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f81bbe70e0 0x55f81bbf8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.468+0000 7f84aaa18740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f81bbf1980 0x55f81bbe98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.468+0000 7f84aaa18740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f81bbe90e0 con 0x55f81bbe70e0 2024-09-13T17:18:47.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.468+0000 7f84aaa18740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f81bc01230 con 0x55f81bbe67c0 2024-09-13T17:18:47.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.468+0000 7f84aaa18740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f81bbe7ce0 con 0x55f81bbf1980 2024-09-13T17:18:47.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.469+0000 7f84a59b5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f81bbe70e0 0x55f81bbf8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.469+0000 7f84a59b5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f81bbe70e0 0x55f81bbf8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37358/0 (socket says 172.21.15.87:37358) 2024-09-13T17:18:47.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.469+0000 7f84a59b5640 1 -- 172.21.15.87:0/566625514 learned_addr learned my addr 172.21.15.87:0/566625514 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:47.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.469+0000 7f84a51b4640 1 --2- 172.21.15.87:0/566625514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f81bbf1980 0x55f81bbe98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.469+0000 7f84a51b4640 1 --2- 172.21.15.87:0/566625514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f81bbe67c0 0x55f81bbf8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.469+0000 7f84a59b5640 1 -- 172.21.15.87:0/566625514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f81bbf1980 msgr2=0x55f81bbe98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:47.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.469+0000 7f84a59b5640 1 --2- 172.21.15.87:0/566625514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f81bbf1980 0x55f81bbe98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.469+0000 7f84a59b5640 1 -- 172.21.15.87:0/566625514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f81bbe67c0 msgr2=0x55f81bbf8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:47.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.469+0000 7f84a59b5640 1 --2- 172.21.15.87:0/566625514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f81bbe67c0 0x55f81bbf8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.469+0000 7f84a59b5640 1 -- 172.21.15.87:0/566625514 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f81baeb1c0 con 0x55f81bbe70e0 2024-09-13T17:18:47.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.469+0000 7f84a51b4640 1 --2- 172.21.15.87:0/566625514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f81bbe67c0 0x55f81bbf8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:18:47.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.469+0000 7f84a59b5640 1 --2- 172.21.15.87:0/566625514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f81bbe70e0 0x55f81bbf8b90 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f849c00cd90 tx=0x7f849c006ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e0852fc10e0a9f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:47.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.469+0000 7f8494e05640 1 -- 172.21.15.87:0/566625514 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849c022520 con 0x55f81bbe70e0 2024-09-13T17:18:47.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.469+0000 7f8494e05640 1 -- 172.21.15.87:0/566625514 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f849c011bc0 con 0x55f81bbe70e0 2024-09-13T17:18:47.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.469+0000 7f8494e05640 1 -- 172.21.15.87:0/566625514 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849c022e10 con 0x55f81bbe70e0 2024-09-13T17:18:47.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.470+0000 7f84aaa18740 1 -- 172.21.15.87:0/566625514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f81bbe70e0 msgr2=0x55f81bbf8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.470+0000 7f84aaa18740 1 --2- 172.21.15.87:0/566625514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f81bbe70e0 0x55f81bbf8b90 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f849c00cd90 tx=0x7f849c006ba0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.470+0000 7f84aaa18740 1 -- 172.21.15.87:0/566625514 shutdown_connections 2024-09-13T17:18:47.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.470+0000 7f84aaa18740 1 --2- 172.21.15.87:0/566625514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f81bbf1980 0x55f81bbe98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.470+0000 7f84aaa18740 1 --2- 172.21.15.87:0/566625514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f81bbe70e0 0x55f81bbf8b90 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.470+0000 7f84aaa18740 1 --2- 172.21.15.87:0/566625514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f81bbe67c0 0x55f81bbf8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.470+0000 7f84aaa18740 1 -- 172.21.15.87:0/566625514 >> 172.21.15.87:0/566625514 conn(0x55f81bbe2d50 msgr2=0x55f81bc08230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:47.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.470+0000 7f84aaa18740 1 -- 172.21.15.87:0/566625514 shutdown_connections 2024-09-13T17:18:47.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.470+0000 7f84aaa18740 1 -- 172.21.15.87:0/566625514 wait complete. 2024-09-13T17:18:47.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.470+0000 7f84aaa18740 1 -- start start 2024-09-13T17:18:47.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.470+0000 7f84aaa18740 1 Processor -- start 2024-09-13T17:18:47.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.471+0000 7f84aaa18740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f81bbe67c0 0x55f81bbf8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.471+0000 7f84aaa18740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f81bbe70e0 0x55f81bbf6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.471+0000 7f84aaa18740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f81bbf1980 0x55f81bbf7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.471+0000 7f84aaa18740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f81bbf7a60 con 0x55f81bbe70e0 2024-09-13T17:18:47.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.471+0000 7f84aaa18740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f81bbf7bd0 con 0x55f81bbf1980 2024-09-13T17:18:47.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.471+0000 7f84aaa18740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f81bc579c0 con 0x55f81bbe67c0 2024-09-13T17:18:47.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.471+0000 7f84aaa18740 10 client.0 _ll_register_callbacks cb 0x7f849000d5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:18:47.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.471+0000 7f84a59b5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f81bbe70e0 0x55f81bbf6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.471+0000 7f84a59b5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f81bbe70e0 0x55f81bbf6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37362/0 (socket says 172.21.15.87:37362) 2024-09-13T17:18:47.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.471+0000 7f84a59b5640 1 -- 172.21.15.87:0/1151618987 learned_addr learned my addr 172.21.15.87:0/1151618987 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:47.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.471+0000 7f84a51b4640 1 --2- 172.21.15.87:0/1151618987 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f81bbe67c0 0x55f81bbf8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.471+0000 7f84a59b5640 1 -- 172.21.15.87:0/1151618987 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f81bbe67c0 msgr2=0x55f81bbf8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:47.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.471+0000 7f84a59b5640 1 --2- 172.21.15.87:0/1151618987 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f81bbe67c0 0x55f81bbf8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.471+0000 7f84a59b5640 1 -- 172.21.15.87:0/1151618987 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f81bbf1980 msgr2=0x55f81bbf7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:47.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.471+0000 7f84a59b5640 1 --2- 172.21.15.87:0/1151618987 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f81bbf1980 0x55f81bbf7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.471+0000 7f84a59b5640 1 -- 172.21.15.87:0/1151618987 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f81bb49360 con 0x55f81bbe70e0 2024-09-13T17:18:47.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.471+0000 7f84a59b5640 1 --2- 172.21.15.87:0/1151618987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f81bbe70e0 0x55f81bbf6dc0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f849c006d60 tx=0x7f849c022550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d3c46706b789fb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:47.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.471+0000 7f84897fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:18:47.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.471+0000 7f84897fa640 1 -- 172.21.15.87:0/1151618987 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849c022880 con 0x55f81bbe70e0 2024-09-13T17:18:47.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.472+0000 7f84aaa18740 1 -- 172.21.15.87:0/1151618987 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f849c00cdc0 con 0x55f81bbe70e0 2024-09-13T17:18:47.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.472+0000 7f84897fa640 1 -- 172.21.15.87:0/1151618987 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f849c000e40 con 0x55f81bbe70e0 2024-09-13T17:18:47.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.472+0000 7f84897fa640 1 -- 172.21.15.87:0/1151618987 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f849c010dd0 con 0x55f81bbe70e0 2024-09-13T17:18:47.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.472+0000 7f84aaa18740 10 client.17007 fetch_fsmap learned FSMap version 30 2024-09-13T17:18:47.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.472+0000 7f84aaa18740 1 -- 172.21.15.87:0/1151618987 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55f81bb10990 con 0x55f81bbe70e0 2024-09-13T17:18:47.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.472+0000 7f84897fa640 1 -- 172.21.15.87:0/1151618987 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f849c00cdc0 con 0x55f81bbe70e0 2024-09-13T17:18:47.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.472+0000 7f84897fa640 1 -- 172.21.15.87:0/1151618987 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f849c02c030 con 0x55f81bbe70e0 2024-09-13T17:18:47.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.472+0000 7f84aaa18740 10 client.17007 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:18:47.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.472+0000 7f84aaa18740 10 client.17007 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:18:47.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.472+0000 7f84aaa18740 20 client.17007 populate_metadata read hostname 'smithi087' 2024-09-13T17:18:47.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.472+0000 7f84aaa18740 1 --2- 172.21.15.87:0/1151618987 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55f81bc58cc0 0x55f81bc5b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.472+0000 7f84aaa18740 4 client.17007 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-13T17:18:47.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.472+0000 7f84aaa18740 1 -- 172.21.15.87:0/1151618987 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55f81b8a2eb0 con 0x55f81bc58cc0 2024-09-13T17:18:47.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.472+0000 7f84a51b4640 1 --2- 172.21.15.87:0/1151618987 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55f81bc58cc0 0x55f81bc5b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.473+0000 7f84a51b4640 1 --2- 172.21.15.87:0/1151618987 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55f81bc58cc0 0x55f81bc5b0b0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a6c2a4fdcec7e10 server_cookie=f396a2b57ed1b4f6 in_seq=0 out_seq=0 2024-09-13T17:18:47.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.473+0000 7f84897fa640 10 client.17007 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:18:47.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.474+0000 7f84897fa640 1 -- 172.21.15.87:0/1151618987 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55f81b8a2eb0 con 0x55f81bc58cc0 2024-09-13T17:18:47.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.474+0000 7f84897fa640 10 client.17007 handle_command_reply: tid=0 2024-09-13T17:18:47.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.474+0000 7f84aaa18740 1 client.17007 shutdown 2024-09-13T17:18:47.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.474+0000 7f84aaa18740 1 -- 172.21.15.87:0/1151618987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f81bbe70e0 msgr2=0x55f81bbf6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.474+0000 7f84aaa18740 1 --2- 172.21.15.87:0/1151618987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f81bbe70e0 0x55f81bbf6dc0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f849c006d60 tx=0x7f849c022550 comp rx=0 tx=0).stop 2024-09-13T17:18:47.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.474+0000 7f84aaa18740 1 -- 172.21.15.87:0/1151618987 shutdown_connections 2024-09-13T17:18:47.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.474+0000 7f84aaa18740 1 --2- 172.21.15.87:0/1151618987 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55f81bc58cc0 0x55f81bc5b0b0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.474+0000 7f84aaa18740 1 --2- 172.21.15.87:0/1151618987 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f81bbf1980 0x55f81bbf7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.474+0000 7f84897fa640 0 client.17007 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:18:47.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.474+0000 7f84aaa18740 1 --2- 172.21.15.87:0/1151618987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f81bbe70e0 0x55f81bbf6dc0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.474+0000 7f84aaa18740 1 --2- 172.21.15.87:0/1151618987 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f81bbe67c0 0x55f81bbf8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.474+0000 7f84aaa18740 1 -- 172.21.15.87:0/1151618987 >> 172.21.15.87:0/1151618987 conn(0x55f81bbe2d50 msgr2=0x55f81bbe98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:47.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.474+0000 7f84aaa18740 1 -- 172.21.15.87:0/1151618987 shutdown_connections 2024-09-13T17:18:47.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.474+0000 7f84aaa18740 1 -- 172.21.15.87:0/1151618987 wait complete. 2024-09-13T17:18:47.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.474+0000 7f84aaa18740 20 client.17007 trim_cache size 0 max 16384 2024-09-13T17:18:47.482 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:18:47.482 INFO:teuthology.orchestra.run.smithi087.stdout: "return_code": 0, 2024-09-13T17:18:47.482 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_tag": "77aa740f-f6fd-452b-b255-828ad1f149a2", 2024-09-13T17:18:47.482 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": "asynchronous" 2024-09-13T17:18:47.482 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:18:47.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.475+0000 7f84a7c19640 1 -- 172.21.15.87:0/405272385 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f848c0a1280 msgr2=0x7f848c0a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.475+0000 7f84a7c19640 1 --2- 172.21.15.87:0/405272385 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f848c0a1280 0x7f848c0a3740 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f84980bb850 tx=0x7f84980b2040 comp rx=0 tx=0).stop 2024-09-13T17:18:47.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.475+0000 7f84a7c19640 1 -- 172.21.15.87:0/405272385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84a01041c0 msgr2=0x7f84a019c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.475+0000 7f84a7c19640 1 --2- 172.21.15.87:0/405272385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84a01041c0 0x7f84a019c630 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f8498005cc0 tx=0x7f8498030990 comp rx=0 tx=0).stop 2024-09-13T17:18:47.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.475+0000 7f84a7c19640 1 -- 172.21.15.87:0/405272385 shutdown_connections 2024-09-13T17:18:47.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.475+0000 7f84a7c19640 1 --2- 172.21.15.87:0/405272385 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f848c0a1280 0x7f848c0a3740 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.475+0000 7f84a7c19640 1 --2- 172.21.15.87:0/405272385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84a01041c0 0x7f84a019c630 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.475+0000 7f84a7c19640 1 --2- 172.21.15.87:0/405272385 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84a00ff5f0 0x7f84a01a2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.475+0000 7f84a7c19640 1 --2- 172.21.15.87:0/405272385 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84a00fec40 0x7f84a01a2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.475+0000 7f84a7c19640 1 -- 172.21.15.87:0/405272385 >> 172.21.15.87:0/405272385 conn(0x7f84a00fa930 msgr2=0x7f84a00fb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:47.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.475+0000 7f84a7c19640 1 -- 172.21.15.87:0/405272385 shutdown_connections 2024-09-13T17:18:47.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.475+0000 7f84a7c19640 1 -- 172.21.15.87:0/405272385 wait complete. 2024-09-13T17:18:47.487 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:18:47.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.588+0000 7f080a311640 1 -- 172.21.15.87:0/1002210511 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08040fff90 msgr2=0x7f0804100370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.588+0000 7f080a311640 1 --2- 172.21.15.87:0/1002210511 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08040fff90 0x7f0804100370 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f07f4009930 tx=0x7f07f402a420 comp rx=0 tx=0).stop 2024-09-13T17:18:47.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.588+0000 7f080a311640 1 -- 172.21.15.87:0/1002210511 shutdown_connections 2024-09-13T17:18:47.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.588+0000 7f080a311640 1 --2- 172.21.15.87:0/1002210511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f08041050e0 0x7f080410cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.588+0000 7f080a311640 1 --2- 172.21.15.87:0/1002210511 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0804100940 0x7f0804104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.588+0000 7f080a311640 1 --2- 172.21.15.87:0/1002210511 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08040fff90 0x7f0804100370 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.588+0000 7f080a311640 1 -- 172.21.15.87:0/1002210511 >> 172.21.15.87:0/1002210511 conn(0x7f08040fba20 msgr2=0x7f08040fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:47.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.588+0000 7f080a311640 1 -- 172.21.15.87:0/1002210511 shutdown_connections 2024-09-13T17:18:47.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.588+0000 7f080a311640 1 -- 172.21.15.87:0/1002210511 wait complete. 2024-09-13T17:18:47.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.588+0000 7f080a311640 1 Processor -- start 2024-09-13T17:18:47.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.588+0000 7f080a311640 1 -- start start 2024-09-13T17:18:47.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.589+0000 7f080a311640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08040fff90 0x7f08041962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.589+0000 7f080a311640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f08041050e0 0x7f0804196820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.589+0000 7f080a311640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f080419ac10 0x7f080419b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.589+0000 7f080a311640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080419b600 con 0x7f08040fff90 2024-09-13T17:18:47.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.589+0000 7f080a311640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080419b770 con 0x7f08041050e0 2024-09-13T17:18:47.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.589+0000 7f080a311640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080419b8e0 con 0x7f080419ac10 2024-09-13T17:18:47.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.589+0000 7f0803fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08040fff90 0x7f08041962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.589+0000 7f0803fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08040fff90 0x7f08041962e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37368/0 (socket says 172.21.15.87:37368) 2024-09-13T17:18:47.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.589+0000 7f0803fff640 1 -- 172.21.15.87:0/1106707150 learned_addr learned my addr 172.21.15.87:0/1106707150 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:47.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.589+0000 7f08088ae640 1 --2- 172.21.15.87:0/1106707150 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f080419ac10 0x7f080419b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.589+0000 7f08037fe640 1 --2- 172.21.15.87:0/1106707150 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f08041050e0 0x7f0804196820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.589+0000 7f0803fff640 1 -- 172.21.15.87:0/1106707150 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f080419ac10 msgr2=0x7f080419b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.589+0000 7f0803fff640 1 --2- 172.21.15.87:0/1106707150 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f080419ac10 0x7f080419b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.589+0000 7f0803fff640 1 -- 172.21.15.87:0/1106707150 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f08041050e0 msgr2=0x7f0804196820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.589+0000 7f0803fff640 1 --2- 172.21.15.87:0/1106707150 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f08041050e0 0x7f0804196820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.589+0000 7f0803fff640 1 -- 172.21.15.87:0/1106707150 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f4009560 con 0x7f08040fff90 2024-09-13T17:18:47.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.589+0000 7f08088ae640 1 --2- 172.21.15.87:0/1106707150 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f080419ac10 0x7f080419b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:47.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.589+0000 7f0803fff640 1 --2- 172.21.15.87:0/1106707150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08040fff90 0x7f08041962e0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f07f4005760 tx=0x7f07f4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:47.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.590+0000 7f08017fa640 1 -- 172.21.15.87:0/1106707150 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f4004520 con 0x7f08040fff90 2024-09-13T17:18:47.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.590+0000 7f08017fa640 1 -- 172.21.15.87:0/1106707150 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f07f4031c40 con 0x7f08040fff90 2024-09-13T17:18:47.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.590+0000 7f080a311640 1 -- 172.21.15.87:0/1106707150 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08041a2ec0 con 0x7f08040fff90 2024-09-13T17:18:47.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.590+0000 7f08017fa640 1 -- 172.21.15.87:0/1106707150 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f4032440 con 0x7f08040fff90 2024-09-13T17:18:47.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.590+0000 7f080a311640 1 -- 172.21.15.87:0/1106707150 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08041a3230 con 0x7f08040fff90 2024-09-13T17:18:47.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.592+0000 7f08017fa640 1 -- 172.21.15.87:0/1106707150 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f07f4003ba0 con 0x7f08040fff90 2024-09-13T17:18:47.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.592+0000 7f080d034740 1 Processor -- start 2024-09-13T17:18:47.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.593+0000 7f080d034740 1 -- start start 2024-09-13T17:18:47.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.593+0000 7f080d034740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5626f5b73cf0 0x5626f5b740d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.593+0000 7f080d034740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5626f5b74610 0x5626f5b82ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.593+0000 7f080d034740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626f5b833e0 0x5626f5b857d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.593+0000 7f080d034740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626f5adef20 con 0x5626f5b833e0 2024-09-13T17:18:47.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.593+0000 7f080d034740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626f5adc6b0 con 0x5626f5b74610 2024-09-13T17:18:47.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.593+0000 7f080d034740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626f5ad7fa0 con 0x5626f5b73cf0 2024-09-13T17:18:47.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.593+0000 7f08037fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626f5b833e0 0x5626f5b857d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.593+0000 7f08037fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626f5b833e0 0x5626f5b857d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37372/0 (socket says 172.21.15.87:37372) 2024-09-13T17:18:47.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.593+0000 7f08037fe640 1 -- 172.21.15.87:0/1066603948 learned_addr learned my addr 172.21.15.87:0/1066603948 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:47.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.593+0000 7f08088ae640 1 --2- 172.21.15.87:0/1066603948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5626f5b73cf0 0x5626f5b740d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.593+0000 7f08017fa640 1 --2- 172.21.15.87:0/1106707150 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f07ec0a1200 0x7f07ec0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.593+0000 7f0803fff640 1 --2- 172.21.15.87:0/1066603948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5626f5b74610 0x5626f5b82ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.593+0000 7f08037fe640 1 -- 172.21.15.87:0/1066603948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5626f5b73cf0 msgr2=0x5626f5b740d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:47.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.593+0000 7f08037fe640 1 --2- 172.21.15.87:0/1066603948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5626f5b73cf0 0x5626f5b740d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.593+0000 7f08037fe640 1 -- 172.21.15.87:0/1066603948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5626f5b74610 msgr2=0x5626f5b82ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:47.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.593+0000 7f08037fe640 1 --2- 172.21.15.87:0/1066603948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5626f5b74610 0x5626f5b82ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.593+0000 7f08037fe640 1 -- 172.21.15.87:0/1066603948 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626f5a92840 con 0x5626f5b833e0 2024-09-13T17:18:47.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.593+0000 7f0803fff640 1 --2- 172.21.15.87:0/1066603948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5626f5b74610 0x5626f5b82ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:47.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.593+0000 7f08088ae640 1 --2- 172.21.15.87:0/1106707150 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f07ec0a1200 0x7f07ec0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.593+0000 7f08017fa640 1 -- 172.21.15.87:0/1106707150 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f07f40edb40 con 0x7f08040fff90 2024-09-13T17:18:47.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.593+0000 7f08037fe640 1 --2- 172.21.15.87:0/1066603948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626f5b833e0 0x5626f5b857d0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f07f800bb10 tx=0x7f07f800d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dbafa8d464542bd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:47.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.594+0000 7f07ea7fc640 1 -- 172.21.15.87:0/1066603948 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f8017420 con 0x5626f5b833e0 2024-09-13T17:18:47.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.594+0000 7f07ea7fc640 1 -- 172.21.15.87:0/1066603948 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f07f800b590 con 0x5626f5b833e0 2024-09-13T17:18:47.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.594+0000 7f07ea7fc640 1 -- 172.21.15.87:0/1066603948 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f800f960 con 0x5626f5b833e0 2024-09-13T17:18:47.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.594+0000 7f080d034740 1 -- 172.21.15.87:0/1066603948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626f5b833e0 msgr2=0x5626f5b857d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.594+0000 7f08088ae640 1 --2- 172.21.15.87:0/1106707150 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f07ec0a1200 0x7f07ec0a36c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f07fc005fd0 tx=0x7f07fc004a40 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:47.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.594+0000 7f080d034740 1 --2- 172.21.15.87:0/1066603948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626f5b833e0 0x5626f5b857d0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f07f800bb10 tx=0x7f07f800d340 comp rx=0 tx=0).stop 2024-09-13T17:18:47.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.594+0000 7f080d034740 1 -- 172.21.15.87:0/1066603948 shutdown_connections 2024-09-13T17:18:47.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.594+0000 7f080d034740 1 --2- 172.21.15.87:0/1066603948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626f5b833e0 0x5626f5b857d0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.594+0000 7f080d034740 1 --2- 172.21.15.87:0/1066603948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5626f5b74610 0x5626f5b82ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.594+0000 7f080d034740 1 --2- 172.21.15.87:0/1066603948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5626f5b73cf0 0x5626f5b740d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.594+0000 7f080d034740 1 -- 172.21.15.87:0/1066603948 >> 172.21.15.87:0/1066603948 conn(0x5626f5b70380 msgr2=0x5626f5b70760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:47.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.594+0000 7f080d034740 1 -- 172.21.15.87:0/1066603948 shutdown_connections 2024-09-13T17:18:47.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.594+0000 7f080d034740 1 -- 172.21.15.87:0/1066603948 wait complete. 2024-09-13T17:18:47.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.595+0000 7f080d034740 1 -- start start 2024-09-13T17:18:47.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.595+0000 7f080d034740 1 Processor -- start 2024-09-13T17:18:47.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.595+0000 7f080d034740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5626f5b73cf0 0x5626f5b82ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.595+0000 7f080d034740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5626f5b74610 0x5626f5b80070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.595+0000 7f080d034740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626f5b833e0 0x5626f5b805d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.595+0000 7f080d034740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626f5a792a0 con 0x5626f5b833e0 2024-09-13T17:18:47.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.595+0000 7f080d034740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626f57b0430 con 0x5626f5b74610 2024-09-13T17:18:47.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.595+0000 7f080d034740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626f5a5b680 con 0x5626f5b73cf0 2024-09-13T17:18:47.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.595+0000 7f080d034740 10 client.0 _ll_register_callbacks cb 0x5626f5ad1610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:18:47.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.595+0000 7f08088ae640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626f5b833e0 0x5626f5b805d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.595+0000 7f08088ae640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626f5b833e0 0x5626f5b805d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37388/0 (socket says 172.21.15.87:37388) 2024-09-13T17:18:47.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.595+0000 7f08088ae640 1 -- 172.21.15.87:0/2158237949 learned_addr learned my addr 172.21.15.87:0/2158237949 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:47.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.595+0000 7f0803fff640 1 --2- 172.21.15.87:0/2158237949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5626f5b73cf0 0x5626f5b82ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.595+0000 7f08037fe640 1 --2- 172.21.15.87:0/2158237949 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5626f5b74610 0x5626f5b80070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.596+0000 7f08088ae640 1 -- 172.21.15.87:0/2158237949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5626f5b73cf0 msgr2=0x5626f5b82ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:47.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.596+0000 7f08088ae640 1 --2- 172.21.15.87:0/2158237949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5626f5b73cf0 0x5626f5b82ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.596+0000 7f08088ae640 1 -- 172.21.15.87:0/2158237949 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5626f5b74610 msgr2=0x5626f5b80070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:47.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.596+0000 7f08088ae640 1 --2- 172.21.15.87:0/2158237949 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5626f5b74610 0x5626f5b80070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.596+0000 7f08088ae640 1 -- 172.21.15.87:0/2158237949 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f800b710 con 0x5626f5b833e0 2024-09-13T17:18:47.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.596+0000 7f08037fe640 1 --2- 172.21.15.87:0/2158237949 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5626f5b74610 0x5626f5b80070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:47.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.596+0000 7f08088ae640 1 --2- 172.21.15.87:0/2158237949 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626f5b833e0 0x5626f5b805d0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f07fc0119f0 tx=0x7f07fc008420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=155f03b94c5f57b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:47.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.596+0000 7f07e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:18:47.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.596+0000 7f07e37fe640 1 -- 172.21.15.87:0/2158237949 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc01cd80 con 0x5626f5b833e0 2024-09-13T17:18:47.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.596+0000 7f080d034740 1 -- 172.21.15.87:0/2158237949 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5626f57dc7e0 con 0x5626f5b833e0 2024-09-13T17:18:47.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.596+0000 7f07e37fe640 1 -- 172.21.15.87:0/2158237949 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f07fc015070 con 0x5626f5b833e0 2024-09-13T17:18:47.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.596+0000 7f07e37fe640 1 -- 172.21.15.87:0/2158237949 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07fc01a450 con 0x5626f5b833e0 2024-09-13T17:18:47.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.596+0000 7f080d034740 10 client.17019 fetch_fsmap learned FSMap version 30 2024-09-13T17:18:47.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.596+0000 7f080d034740 1 -- 172.21.15.87:0/2158237949 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5626f5ad6620 con 0x5626f5b833e0 2024-09-13T17:18:47.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.596+0000 7f07e37fe640 1 -- 172.21.15.87:0/2158237949 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x5626f57dc7e0 con 0x5626f5b833e0 2024-09-13T17:18:47.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.596+0000 7f07e37fe640 1 -- 172.21.15.87:0/2158237949 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f07fc025520 con 0x5626f5b833e0 2024-09-13T17:18:47.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.596+0000 7f080d034740 10 client.17019 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:18:47.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.596+0000 7f080d034740 10 client.17019 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:18:47.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.596+0000 7f080d034740 20 client.17019 populate_metadata read hostname 'smithi087' 2024-09-13T17:18:47.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.596+0000 7f080d034740 1 --2- 172.21.15.87:0/2158237949 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5626f5b931c0 0x5626f5b955e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.596+0000 7f080d034740 4 client.17019 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:18:47.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.596+0000 7f080d034740 1 -- 172.21.15.87:0/2158237949 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5626f582fe30 con 0x5626f5b931c0 2024-09-13T17:18:47.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.597+0000 7f0803fff640 1 --2- 172.21.15.87:0/2158237949 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5626f5b931c0 0x5626f5b955e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.597+0000 7f07e37fe640 10 client.17019 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:18:47.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.597+0000 7f0803fff640 1 --2- 172.21.15.87:0/2158237949 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5626f5b931c0 0x5626f5b955e0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bf2ff564ce92bf4 server_cookie=1bc118dbd58a21b7 in_seq=0 out_seq=0 2024-09-13T17:18:47.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.598+0000 7f07e37fe640 1 -- 172.21.15.87:0/2158237949 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5626f582fe30 con 0x5626f5b931c0 2024-09-13T17:18:47.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.598+0000 7f07e37fe640 10 client.17019 handle_command_reply: tid=0 2024-09-13T17:18:47.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.598+0000 7f080d034740 1 client.17019 shutdown 2024-09-13T17:18:47.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.598+0000 7f080d034740 1 -- 172.21.15.87:0/2158237949 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626f5b833e0 msgr2=0x5626f5b805d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.598+0000 7f080d034740 1 --2- 172.21.15.87:0/2158237949 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626f5b833e0 0x5626f5b805d0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f07fc0119f0 tx=0x7f07fc008420 comp rx=0 tx=0).stop 2024-09-13T17:18:47.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.598+0000 7f080d034740 1 -- 172.21.15.87:0/2158237949 shutdown_connections 2024-09-13T17:18:47.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.598+0000 7f080d034740 1 --2- 172.21.15.87:0/2158237949 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5626f5b931c0 0x5626f5b955e0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.598+0000 7f080d034740 1 --2- 172.21.15.87:0/2158237949 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626f5b833e0 0x5626f5b805d0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.598+0000 7f080d034740 1 --2- 172.21.15.87:0/2158237949 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5626f5b74610 0x5626f5b80070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.598+0000 7f080d034740 1 --2- 172.21.15.87:0/2158237949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5626f5b73cf0 0x5626f5b82ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.598+0000 7f07e37fe640 0 client.17019 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:18:47.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.598+0000 7f080d034740 1 -- 172.21.15.87:0/2158237949 >> 172.21.15.87:0/2158237949 conn(0x5626f5b70380 msgr2=0x5626f5b6f510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:47.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.598+0000 7f080d034740 1 -- 172.21.15.87:0/2158237949 shutdown_connections 2024-09-13T17:18:47.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.598+0000 7f080d034740 1 -- 172.21.15.87:0/2158237949 wait complete. 2024-09-13T17:18:47.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.598+0000 7f080d034740 20 client.17019 trim_cache size 0 max 16384 2024-09-13T17:18:47.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.612+0000 7f080d034740 1 Processor -- start 2024-09-13T17:18:47.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.612+0000 7f080d034740 1 -- start start 2024-09-13T17:18:47.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.612+0000 7f080d034740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626f5b73cf0 0x5626f5b6fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.612+0000 7f080d034740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5626f5b74610 0x5626f5b7e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.612+0000 7f080d034740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5626f5b833e0 0x5626f5b7ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.612+0000 7f080d034740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626f5b6bc90 con 0x5626f5b73cf0 2024-09-13T17:18:47.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.612+0000 7f080d034740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626f5b73b90 con 0x5626f5b74610 2024-09-13T17:18:47.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.612+0000 7f080d034740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626f57dc7e0 con 0x5626f5b833e0 2024-09-13T17:18:47.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.612+0000 7f0803fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626f5b73cf0 0x5626f5b6fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.612+0000 7f0803fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626f5b73cf0 0x5626f5b6fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37390/0 (socket says 172.21.15.87:37390) 2024-09-13T17:18:47.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.612+0000 7f0803fff640 1 -- 172.21.15.87:0/1060025548 learned_addr learned my addr 172.21.15.87:0/1060025548 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:47.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.613+0000 7f0803fff640 1 -- 172.21.15.87:0/1060025548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5626f5b833e0 msgr2=0x5626f5b7ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:47.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.613+0000 7f0803fff640 1 --2- 172.21.15.87:0/1060025548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5626f5b833e0 0x5626f5b7ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.613+0000 7f0803fff640 1 -- 172.21.15.87:0/1060025548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5626f5b74610 msgr2=0x5626f5b7e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:47.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.613+0000 7f0803fff640 1 --2- 172.21.15.87:0/1060025548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5626f5b74610 0x5626f5b7e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.613+0000 7f0803fff640 1 -- 172.21.15.87:0/1060025548 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626f5a78790 con 0x5626f5b73cf0 2024-09-13T17:18:47.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.613+0000 7f0803fff640 1 --2- 172.21.15.87:0/1060025548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626f5b73cf0 0x5626f5b6fd00 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f07f4032020 tx=0x7f07f40da040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56b97159f69d3192 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:47.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.613+0000 7f07eaffd640 1 -- 172.21.15.87:0/1060025548 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f40b89e0 con 0x5626f5b73cf0 2024-09-13T17:18:47.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.613+0000 7f07eaffd640 1 -- 172.21.15.87:0/1060025548 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f07f40d8e90 con 0x5626f5b73cf0 2024-09-13T17:18:47.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.613+0000 7f07eaffd640 1 -- 172.21.15.87:0/1060025548 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f40bab00 con 0x5626f5b73cf0 2024-09-13T17:18:47.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.613+0000 7f080d034740 1 -- 172.21.15.87:0/1060025548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626f5b73cf0 msgr2=0x5626f5b6fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.613+0000 7f080d034740 1 --2- 172.21.15.87:0/1060025548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626f5b73cf0 0x5626f5b6fd00 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f07f4032020 tx=0x7f07f40da040 comp rx=0 tx=0).stop 2024-09-13T17:18:47.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.613+0000 7f080d034740 1 -- 172.21.15.87:0/1060025548 shutdown_connections 2024-09-13T17:18:47.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.613+0000 7f080d034740 1 --2- 172.21.15.87:0/1060025548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5626f5b833e0 0x5626f5b7ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.613+0000 7f080d034740 1 --2- 172.21.15.87:0/1060025548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5626f5b74610 0x5626f5b7e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.613+0000 7f080d034740 1 --2- 172.21.15.87:0/1060025548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626f5b73cf0 0x5626f5b6fd00 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.613+0000 7f080d034740 1 -- 172.21.15.87:0/1060025548 >> 172.21.15.87:0/1060025548 conn(0x5626f5b70380 msgr2=0x5626f5b7b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:47.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.614+0000 7f080d034740 1 -- 172.21.15.87:0/1060025548 shutdown_connections 2024-09-13T17:18:47.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.614+0000 7f080d034740 1 -- 172.21.15.87:0/1060025548 wait complete. 2024-09-13T17:18:47.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.614+0000 7f080d034740 1 -- start start 2024-09-13T17:18:47.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.614+0000 7f080d034740 1 Processor -- start 2024-09-13T17:18:47.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.614+0000 7f080d034740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5626f5b73cf0 0x5626f5b7a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.614+0000 7f080d034740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5626f5b74610 0x5626f5b8a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.614+0000 7f080d034740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626f5b833e0 0x5626f5b87640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.614+0000 7f080d034740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626f5b8a9b0 con 0x5626f5b833e0 2024-09-13T17:18:47.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.614+0000 7f080d034740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626f5b87b80 con 0x5626f5b74610 2024-09-13T17:18:47.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.614+0000 7f080d034740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626f5b87d40 con 0x5626f5b73cf0 2024-09-13T17:18:47.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.614+0000 7f080d034740 10 client.0 _ll_register_callbacks cb 0x7f07fc008590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:18:47.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.614+0000 7f08088ae640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626f5b833e0 0x5626f5b87640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.614+0000 7f08088ae640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626f5b833e0 0x5626f5b87640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37398/0 (socket says 172.21.15.87:37398) 2024-09-13T17:18:47.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.614+0000 7f08088ae640 1 -- 172.21.15.87:0/2146142858 learned_addr learned my addr 172.21.15.87:0/2146142858 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:18:47.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.614+0000 7f0803fff640 1 --2- 172.21.15.87:0/2146142858 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5626f5b73cf0 0x5626f5b7a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.615+0000 7f08037fe640 1 --2- 172.21.15.87:0/2146142858 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5626f5b74610 0x5626f5b8a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.615+0000 7f08088ae640 1 -- 172.21.15.87:0/2146142858 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5626f5b73cf0 msgr2=0x5626f5b7a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:47.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.615+0000 7f08088ae640 1 --2- 172.21.15.87:0/2146142858 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5626f5b73cf0 0x5626f5b7a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.615+0000 7f08088ae640 1 -- 172.21.15.87:0/2146142858 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5626f5b74610 msgr2=0x5626f5b8a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:18:47.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.615+0000 7f08088ae640 1 --2- 172.21.15.87:0/2146142858 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5626f5b74610 0x5626f5b8a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.615+0000 7f08088ae640 1 -- 172.21.15.87:0/2146142858 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08041a3230 con 0x5626f5b833e0 2024-09-13T17:18:47.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.615+0000 7f08037fe640 1 --2- 172.21.15.87:0/2146142858 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5626f5b74610 0x5626f5b8a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:18:47.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.615+0000 7f08088ae640 1 --2- 172.21.15.87:0/2146142858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626f5b833e0 0x5626f5b87640 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f07fc0259d0 tx=0x7f07fc01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce713b159dfa78f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:18:47.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.615+0000 7f07e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:18:47.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.615+0000 7f07e37fe640 1 -- 172.21.15.87:0/2146142858 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc01cd80 con 0x5626f5b833e0 2024-09-13T17:18:47.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.615+0000 7f080d034740 1 -- 172.21.15.87:0/2146142858 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5626f57cb4e0 con 0x5626f5b833e0 2024-09-13T17:18:47.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.615+0000 7f07e37fe640 1 -- 172.21.15.87:0/2146142858 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f07fc015070 con 0x5626f5b833e0 2024-09-13T17:18:47.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.615+0000 7f07e37fe640 1 -- 172.21.15.87:0/2146142858 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07fc019f00 con 0x5626f5b833e0 2024-09-13T17:18:47.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.615+0000 7f080d034740 10 client.17025 fetch_fsmap learned FSMap version 30 2024-09-13T17:18:47.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.615+0000 7f080d034740 1 -- 172.21.15.87:0/2146142858 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5626f5a9dea0 con 0x5626f5b833e0 2024-09-13T17:18:47.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.615+0000 7f07e37fe640 1 -- 172.21.15.87:0/2146142858 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x5626f57cb4e0 con 0x5626f5b833e0 2024-09-13T17:18:47.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.615+0000 7f07e37fe640 1 -- 172.21.15.87:0/2146142858 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f07fc024c60 con 0x5626f5b833e0 2024-09-13T17:18:47.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.615+0000 7f080d034740 10 client.17025 fetch_fsmap finished waiting for FSMap version 30 2024-09-13T17:18:47.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.615+0000 7f080d034740 10 client.17025 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:18:47.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.615+0000 7f080d034740 20 client.17025 populate_metadata read hostname 'smithi087' 2024-09-13T17:18:47.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.615+0000 7f080d034740 1 --2- 172.21.15.87:0/2146142858 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5626f5beebc0 0x5626f5bf0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:18:47.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.615+0000 7f080d034740 4 client.17025 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:18:47.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.615+0000 7f080d034740 1 -- 172.21.15.87:0/2146142858 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5626f5bf1830 con 0x5626f5beebc0 2024-09-13T17:18:47.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.616+0000 7f0803fff640 1 --2- 172.21.15.87:0/2146142858 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5626f5beebc0 0x5626f5bf0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:18:47.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.616+0000 7f07e37fe640 10 client.17025 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:18:47.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.616+0000 7f0803fff640 1 --2- 172.21.15.87:0/2146142858 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5626f5beebc0 0x5626f5bf0fe0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b048840c10a1a29 server_cookie=c3d21c5d9f4364e1 in_seq=0 out_seq=0 2024-09-13T17:18:47.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.616+0000 7f07e37fe640 1 -- 172.21.15.87:0/2146142858 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5626f5bf1830 con 0x5626f5beebc0 2024-09-13T17:18:47.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.616+0000 7f07e37fe640 10 client.17025 handle_command_reply: tid=0 2024-09-13T17:18:47.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.616+0000 7f080d034740 1 client.17025 shutdown 2024-09-13T17:18:47.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.616+0000 7f080d034740 1 -- 172.21.15.87:0/2146142858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626f5b833e0 msgr2=0x5626f5b87640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.616+0000 7f080d034740 1 --2- 172.21.15.87:0/2146142858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626f5b833e0 0x5626f5b87640 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f07fc0259d0 tx=0x7f07fc01c900 comp rx=0 tx=0).stop 2024-09-13T17:18:47.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.616+0000 7f080d034740 1 -- 172.21.15.87:0/2146142858 shutdown_connections 2024-09-13T17:18:47.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.616+0000 7f080d034740 1 --2- 172.21.15.87:0/2146142858 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5626f5beebc0 0x5626f5bf0fe0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.616+0000 7f080d034740 1 --2- 172.21.15.87:0/2146142858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5626f5b833e0 0x5626f5b87640 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.616+0000 7f07e37fe640 0 client.17025 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:18:47.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.616+0000 7f080d034740 1 --2- 172.21.15.87:0/2146142858 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5626f5b74610 0x5626f5b8a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.616+0000 7f080d034740 1 --2- 172.21.15.87:0/2146142858 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5626f5b73cf0 0x5626f5b7a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.616+0000 7f080d034740 1 -- 172.21.15.87:0/2146142858 >> 172.21.15.87:0/2146142858 conn(0x5626f5b70380 msgr2=0x5626f5b7e870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:47.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.616+0000 7f080d034740 1 -- 172.21.15.87:0/2146142858 shutdown_connections 2024-09-13T17:18:47.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.616+0000 7f080d034740 1 -- 172.21.15.87:0/2146142858 wait complete. 2024-09-13T17:18:47.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.617+0000 7f080d034740 20 client.17025 trim_cache size 0 max 16384 2024-09-13T17:18:47.626 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:18:47.626 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-13T17:18:47.626 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": { 2024-09-13T17:18:47.626 INFO:teuthology.orchestra.run.smithi087.stdout: "77aa740f-f6fd-452b-b255-828ad1f149a2": { 2024-09-13T17:18:47.626 INFO:teuthology.orchestra.run.smithi087.stdout: "path": "/", 2024-09-13T17:18:47.626 INFO:teuthology.orchestra.run.smithi087.stdout: "tag": "77aa740f-f6fd-452b-b255-828ad1f149a2", 2024-09-13T17:18:47.626 INFO:teuthology.orchestra.run.smithi087.stdout: "options": "recursive,force" 2024-09-13T17:18:47.627 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:18:47.627 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:18:47.627 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:18:47.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.617+0000 7f080a311640 1 -- 172.21.15.87:0/1106707150 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f07ec0a1200 msgr2=0x7f07ec0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.617+0000 7f080a311640 1 --2- 172.21.15.87:0/1106707150 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f07ec0a1200 0x7f07ec0a36c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f07fc005fd0 tx=0x7f07fc004a40 comp rx=0 tx=0).stop 2024-09-13T17:18:47.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.617+0000 7f080a311640 1 -- 172.21.15.87:0/1106707150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08040fff90 msgr2=0x7f08041962e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:18:47.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.617+0000 7f080a311640 1 --2- 172.21.15.87:0/1106707150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08040fff90 0x7f08041962e0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f07f4005760 tx=0x7f07f4004270 comp rx=0 tx=0).stop 2024-09-13T17:18:47.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.617+0000 7f080a311640 1 -- 172.21.15.87:0/1106707150 shutdown_connections 2024-09-13T17:18:47.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.617+0000 7f080a311640 1 --2- 172.21.15.87:0/1106707150 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f080419ac10 0x7f080419b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.617+0000 7f080a311640 1 --2- 172.21.15.87:0/1106707150 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f08041050e0 0x7f0804196820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.617+0000 7f080a311640 1 --2- 172.21.15.87:0/1106707150 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f07ec0a1200 0x7f07ec0a36c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.617+0000 7f080a311640 1 --2- 172.21.15.87:0/1106707150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08040fff90 0x7f08041962e0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:18:47.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.617+0000 7f080a311640 1 -- 172.21.15.87:0/1106707150 >> 172.21.15.87:0/1106707150 conn(0x7f08040fba20 msgr2=0x7f08040fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:18:47.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.617+0000 7f080a311640 1 -- 172.21.15.87:0/1106707150 shutdown_connections 2024-09-13T17:18:47.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:18:47.617+0000 7f080a311640 1 -- 172.21.15.87:0/1106707150 wait complete. 2024-09-13T17:18:47.629 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:47 smithi087 ceph-mon[30934]: pgmap v152: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:18:47.630 INFO:tasks.cephfs.filesystem:scrub status for tag:77aa740f-f6fd-452b-b255-828ad1f149a2 - {'path': '/', 'tag': '77aa740f-f6fd-452b-b255-828ad1f149a2', 'options': 'recursive,force'} 2024-09-13T17:18:47.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:47 smithi149 ceph-mon[35496]: pgmap v152: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:18:47.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:47 smithi118 ceph-mon[34374]: pgmap v152: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:18:48.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:48 smithi149 ceph-mon[35496]: scrub queued for path: / 2024-09-13T17:18:48.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:48 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:18:48.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:48 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:18:48.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:48 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:18:48.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:48 smithi118 ceph-mon[34374]: scrub queued for path: / 2024-09-13T17:18:48.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:48 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:18:48.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:48 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:18:48.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:48 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:18:48.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:48 smithi087 ceph-mon[30934]: scrub queued for path: / 2024-09-13T17:18:48.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:48 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:18:48.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:48 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:18:48.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:48 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:18:49.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:49 smithi149 ceph-mon[35496]: pgmap v153: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:18:49.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:49 smithi118 ceph-mon[34374]: pgmap v153: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:18:49.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:49 smithi087 ceph-mon[30934]: pgmap v153: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:18:50.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:50 smithi149 ceph-mon[35496]: scrub summary: idle 2024-09-13T17:18:50.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:50 smithi118 ceph-mon[34374]: scrub summary: idle 2024-09-13T17:18:50.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:50 smithi087 ceph-mon[30934]: scrub summary: idle 2024-09-13T17:18:51.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:51 smithi149 ceph-mon[35496]: pgmap v154: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:18:51.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:51 smithi118 ceph-mon[34374]: pgmap v154: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:18:51.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:51 smithi087 ceph-mon[30934]: pgmap v154: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:18:53.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:53 smithi149 ceph-mon[35496]: pgmap v155: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:18:53.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:53 smithi118 ceph-mon[34374]: pgmap v155: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:18:53.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:53 smithi087 ceph-mon[30934]: pgmap v155: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:18:55.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:55 smithi149 ceph-mon[35496]: pgmap v156: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:18:55.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:55 smithi118 ceph-mon[34374]: pgmap v156: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:18:55.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:55 smithi087 ceph-mon[30934]: pgmap v156: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:18:57.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:57 smithi149 ceph-mon[35496]: pgmap v157: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:18:57.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:57 smithi118 ceph-mon[34374]: pgmap v157: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:18:57.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:57 smithi087 ceph-mon[30934]: pgmap v157: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:18:59.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:18:59 smithi149 ceph-mon[35496]: pgmap v158: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:18:59.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:18:59 smithi118 ceph-mon[34374]: pgmap v158: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:18:59.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:18:59 smithi087 ceph-mon[30934]: pgmap v158: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:19:00.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:00 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:19:01.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:00 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:19:01.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:00 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:19:01.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:01 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:19:01.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:01 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:19:01.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:01 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:19:01.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:01 smithi087 ceph-mon[30934]: pgmap v159: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:19:02.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:01 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:19:02.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:01 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:19:02.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:01 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:19:02.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:01 smithi149 ceph-mon[35496]: pgmap v159: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:19:02.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:01 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:19:02.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:01 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:19:02.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:01 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:19:02.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:01 smithi118 ceph-mon[34374]: pgmap v159: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:19:04.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:03 smithi149 ceph-mon[35496]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:19:04.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:03 smithi149 ceph-mon[35496]: pgmap v160: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:19:04.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:03 smithi118 ceph-mon[34374]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:19:04.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:03 smithi118 ceph-mon[34374]: pgmap v160: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:19:04.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:03 smithi087 ceph-mon[30934]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:19:04.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:03 smithi087 ceph-mon[30934]: pgmap v160: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:19:05.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:05 smithi149 ceph-mon[35496]: pgmap v161: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-13T17:19:05.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:05 smithi118 ceph-mon[34374]: pgmap v161: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-13T17:19:05.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:05 smithi087 ceph-mon[30934]: pgmap v161: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-13T17:19:07.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:07 smithi149 ceph-mon[35496]: pgmap v162: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-13T17:19:07.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:07 smithi118 ceph-mon[34374]: pgmap v162: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-13T17:19:07.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:07 smithi087 ceph-mon[30934]: pgmap v162: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-13T17:19:09.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:09 smithi149 ceph-mon[35496]: pgmap v163: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-13T17:19:09.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:09 smithi118 ceph-mon[34374]: pgmap v163: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-13T17:19:09.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:09 smithi087 ceph-mon[30934]: pgmap v163: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-13T17:19:11.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:11 smithi149 ceph-mon[35496]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:19:11.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:11 smithi149 ceph-mon[35496]: pgmap v164: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-13T17:19:11.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:11 smithi118 ceph-mon[34374]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:19:11.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:11 smithi118 ceph-mon[34374]: pgmap v164: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-13T17:19:11.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:11 smithi087 ceph-mon[30934]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:19:11.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:11 smithi087 ceph-mon[30934]: pgmap v164: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-13T17:19:13.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:13 smithi149 ceph-mon[35496]: pgmap v165: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-13T17:19:13.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:13 smithi118 ceph-mon[34374]: pgmap v165: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-13T17:19:13.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:13 smithi087 ceph-mon[30934]: pgmap v165: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-13T17:19:15.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:15 smithi149 ceph-mon[35496]: pgmap v166: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-13T17:19:15.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:15 smithi118 ceph-mon[34374]: pgmap v166: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-13T17:19:15.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:15 smithi087 ceph-mon[30934]: pgmap v166: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-09-13T17:19:17.631 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:19:17.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.743+0000 7f3f382d0640 1 -- 172.21.15.87:0/1491716570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f30100f80 msgr2=0x7f3f30101360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:17.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.743+0000 7f3f382d0640 1 --2- 172.21.15.87:0/1491716570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f30100f80 0x7f3f30101360 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c009ca0 tx=0x7f3f2c02a950 comp rx=0 tx=0).stop 2024-09-13T17:19:17.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.743+0000 7f3f382d0640 1 -- 172.21.15.87:0/1491716570 shutdown_connections 2024-09-13T17:19:17.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.743+0000 7f3f382d0640 1 --2- 172.21.15.87:0/1491716570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f3010a350 0x7f3f3010c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.743+0000 7f3f382d0640 1 --2- 172.21.15.87:0/1491716570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f301018a0 0x7f3f30109d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.743+0000 7f3f382d0640 1 --2- 172.21.15.87:0/1491716570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f30100f80 0x7f3f30101360 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.743+0000 7f3f382d0640 1 -- 172.21.15.87:0/1491716570 >> 172.21.15.87:0/1491716570 conn(0x7f3f30075c60 msgr2=0x7f3f300fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:17.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.743+0000 7f3f382d0640 1 -- 172.21.15.87:0/1491716570 shutdown_connections 2024-09-13T17:19:17.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.743+0000 7f3f382d0640 1 -- 172.21.15.87:0/1491716570 wait complete. 2024-09-13T17:19:17.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.743+0000 7f3f382d0640 1 Processor -- start 2024-09-13T17:19:17.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.743+0000 7f3f382d0640 1 -- start start 2024-09-13T17:19:17.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.744+0000 7f3f382d0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f30100f80 0x7f3f300febd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:17.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.744+0000 7f3f382d0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f301018a0 0x7f3f300ff110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:17.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.744+0000 7f3f382d0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f3010a350 0x7f3f300ff650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:17.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.744+0000 7f3f382d0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f301a4610 con 0x7f3f30100f80 2024-09-13T17:19:17.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.744+0000 7f3f382d0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f301a4780 con 0x7f3f3010a350 2024-09-13T17:19:17.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.744+0000 7f3f382d0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f301a4940 con 0x7f3f301018a0 2024-09-13T17:19:17.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.744+0000 7f3f3606c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f30100f80 0x7f3f300febd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:17.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.744+0000 7f3f3606c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f30100f80 0x7f3f300febd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48148/0 (socket says 172.21.15.87:48148) 2024-09-13T17:19:17.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.744+0000 7f3f3606c640 1 -- 172.21.15.87:0/2500615873 learned_addr learned my addr 172.21.15.87:0/2500615873 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:17.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.744+0000 7f3f3586b640 1 --2- 172.21.15.87:0/2500615873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f301018a0 0x7f3f300ff110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:17.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.744+0000 7f3f3686d640 1 --2- 172.21.15.87:0/2500615873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f3010a350 0x7f3f300ff650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:17.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.744+0000 7f3f3606c640 1 -- 172.21.15.87:0/2500615873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f301018a0 msgr2=0x7f3f300ff110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:17.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.744+0000 7f3f3606c640 1 --2- 172.21.15.87:0/2500615873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f301018a0 0x7f3f300ff110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.744+0000 7f3f3606c640 1 -- 172.21.15.87:0/2500615873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f3010a350 msgr2=0x7f3f300ff650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:17.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.744+0000 7f3f3606c640 1 --2- 172.21.15.87:0/2500615873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f3010a350 0x7f3f300ff650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.744+0000 7f3f3606c640 1 -- 172.21.15.87:0/2500615873 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2c009900 con 0x7f3f30100f80 2024-09-13T17:19:17.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.744+0000 7f3f3606c640 1 --2- 172.21.15.87:0/2500615873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f30100f80 0x7f3f300febd0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c000f80 tx=0x7f3f2c031f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:17.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.744+0000 7f3f277fe640 1 -- 172.21.15.87:0/2500615873 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c030440 con 0x7f3f30100f80 2024-09-13T17:19:17.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.744+0000 7f3f277fe640 1 -- 172.21.15.87:0/2500615873 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3f2c030a50 con 0x7f3f30100f80 2024-09-13T17:19:17.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.744+0000 7f3f382d0640 1 -- 172.21.15.87:0/2500615873 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f301a4bc0 con 0x7f3f30100f80 2024-09-13T17:19:17.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.744+0000 7f3f277fe640 1 -- 172.21.15.87:0/2500615873 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c0396b0 con 0x7f3f30100f80 2024-09-13T17:19:17.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.744+0000 7f3f382d0640 1 -- 172.21.15.87:0/2500615873 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f301a5070 con 0x7f3f30100f80 2024-09-13T17:19:17.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.746+0000 7f3f277fe640 1 -- 172.21.15.87:0/2500615873 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f3f2c02e050 con 0x7f3f30100f80 2024-09-13T17:19:17.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.747+0000 7f3f3aff1740 1 Processor -- start 2024-09-13T17:19:17.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.747+0000 7f3f3aff1740 1 -- start start 2024-09-13T17:19:17.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.747+0000 7f3f3aff1740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5574afdd1e10 0x5574afdd21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:17.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.747+0000 7f3f277fe640 1 --2- 172.21.15.87:0/2500615873 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f3f1c0a1200 0x7f3f1c0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:17.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.747+0000 7f3f3aff1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574afdd2730 0x5574afddca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:17.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.747+0000 7f3f3aff1740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574afddcfd0 0x5574afddf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:17.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.747+0000 7f3f3aff1740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574afd3cf20 con 0x5574afdd2730 2024-09-13T17:19:17.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.747+0000 7f3f3aff1740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574afd3a6b0 con 0x5574afddcfd0 2024-09-13T17:19:17.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.747+0000 7f3f3aff1740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574afd35fa0 con 0x5574afdd1e10 2024-09-13T17:19:17.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.747+0000 7f3f3586b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574afdd2730 0x5574afddca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:17.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.747+0000 7f3f3606c640 1 --2- 172.21.15.87:0/2500615873 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f3f1c0a1200 0x7f3f1c0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:17.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.748+0000 7f3f3586b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574afdd2730 0x5574afddca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48152/0 (socket says 172.21.15.87:48152) 2024-09-13T17:19:17.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.748+0000 7f3f3586b640 1 -- 172.21.15.87:0/74475849 learned_addr learned my addr 172.21.15.87:0/74475849 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:17.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.748+0000 7f3f277fe640 1 -- 172.21.15.87:0/2500615873 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f3f2c0ee200 con 0x7f3f30100f80 2024-09-13T17:19:17.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.748+0000 7f3f3686d640 1 --2- 172.21.15.87:0/74475849 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5574afdd1e10 0x5574afdd21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:17.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.748+0000 7f3f3686d640 1 --2- 172.21.15.87:0/74475849 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574afddcfd0 0x5574afddf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:17.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.748+0000 7f3f3586b640 1 -- 172.21.15.87:0/74475849 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5574afdd1e10 msgr2=0x5574afdd21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:17.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.748+0000 7f3f3586b640 1 --2- 172.21.15.87:0/74475849 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5574afdd1e10 0x5574afdd21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.748+0000 7f3f3586b640 1 -- 172.21.15.87:0/74475849 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574afddcfd0 msgr2=0x5574afddf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:17.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.748+0000 7f3f3586b640 1 --2- 172.21.15.87:0/74475849 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574afddcfd0 0x5574afddf3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.748+0000 7f3f3586b640 1 -- 172.21.15.87:0/74475849 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5574afcf0840 con 0x5574afdd2730 2024-09-13T17:19:17.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.748+0000 7f3f3606c640 1 --2- 172.21.15.87:0/2500615873 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f3f1c0a1200 0x7f3f1c0a36c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c0bac60 tx=0x7f3f2c0b06b0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:17.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.748+0000 7f3f3586b640 1 --2- 172.21.15.87:0/74475849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574afdd2730 0x5574afddca90 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f3f2000cc40 tx=0x7f3f2000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cdf811377aa1278 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:17.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.748+0000 7f3f24e05640 1 -- 172.21.15.87:0/74475849 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f20005220 con 0x5574afdd2730 2024-09-13T17:19:17.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.748+0000 7f3f24e05640 1 -- 172.21.15.87:0/74475849 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3f20004c50 con 0x5574afdd2730 2024-09-13T17:19:17.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.748+0000 7f3f24e05640 1 -- 172.21.15.87:0/74475849 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f200107b0 con 0x5574afdd2730 2024-09-13T17:19:17.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.749+0000 7f3f3aff1740 1 -- 172.21.15.87:0/74475849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574afdd2730 msgr2=0x5574afddca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:17.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.749+0000 7f3f3aff1740 1 --2- 172.21.15.87:0/74475849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574afdd2730 0x5574afddca90 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f3f2000cc40 tx=0x7f3f2000e720 comp rx=0 tx=0).stop 2024-09-13T17:19:17.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.749+0000 7f3f3aff1740 1 -- 172.21.15.87:0/74475849 shutdown_connections 2024-09-13T17:19:17.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.749+0000 7f3f3aff1740 1 --2- 172.21.15.87:0/74475849 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574afddcfd0 0x5574afddf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.749+0000 7f3f3aff1740 1 --2- 172.21.15.87:0/74475849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574afdd2730 0x5574afddca90 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.749+0000 7f3f3aff1740 1 --2- 172.21.15.87:0/74475849 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5574afdd1e10 0x5574afdd21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.749+0000 7f3f3aff1740 1 -- 172.21.15.87:0/74475849 >> 172.21.15.87:0/74475849 conn(0x5574afdce380 msgr2=0x5574afdce760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:17.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.749+0000 7f3f3aff1740 1 -- 172.21.15.87:0/74475849 shutdown_connections 2024-09-13T17:19:17.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.749+0000 7f3f3aff1740 1 -- 172.21.15.87:0/74475849 wait complete. 2024-09-13T17:19:17.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.749+0000 7f3f3aff1740 1 -- start start 2024-09-13T17:19:17.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.749+0000 7f3f3aff1740 1 Processor -- start 2024-09-13T17:19:17.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.750+0000 7f3f3aff1740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5574afdd1e10 0x5574afddc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:17.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.750+0000 7f3f3aff1740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574afdd2730 0x5574afdd9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:17.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.750+0000 7f3f3aff1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574afddcfd0 0x5574afdda100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:17.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.750+0000 7f3f3aff1740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574afcd72a0 con 0x5574afddcfd0 2024-09-13T17:19:17.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.750+0000 7f3f3aff1740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574afa0e430 con 0x5574afdd2730 2024-09-13T17:19:17.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.750+0000 7f3f3aff1740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574afcb9680 con 0x5574afdd1e10 2024-09-13T17:19:17.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.750+0000 7f3f3aff1740 10 client.0 _ll_register_callbacks cb 0x5574afd2f610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:17.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.750+0000 7f3f3686d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574afddcfd0 0x5574afdda100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:17.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.750+0000 7f3f3686d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574afddcfd0 0x5574afdda100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48164/0 (socket says 172.21.15.87:48164) 2024-09-13T17:19:17.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.750+0000 7f3f3686d640 1 -- 172.21.15.87:0/790666983 learned_addr learned my addr 172.21.15.87:0/790666983 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:17.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.750+0000 7f3f3586b640 1 --2- 172.21.15.87:0/790666983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574afdd2730 0x5574afdd9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:17.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.750+0000 7f3f3686d640 1 --2- 172.21.15.87:0/790666983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5574afdd1e10 0x5574afddc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:17.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.750+0000 7f3f3686d640 1 -- 172.21.15.87:0/790666983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5574afdd1e10 msgr2=0x5574afddc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:17.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.750+0000 7f3f3686d640 1 --2- 172.21.15.87:0/790666983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5574afdd1e10 0x5574afddc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.750+0000 7f3f3686d640 1 -- 172.21.15.87:0/790666983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574afdd2730 msgr2=0x5574afdd9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:17.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.750+0000 7f3f3686d640 1 --2- 172.21.15.87:0/790666983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574afdd2730 0x5574afdd9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.750+0000 7f3f3686d640 1 -- 172.21.15.87:0/790666983 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f2000c870 con 0x5574afddcfd0 2024-09-13T17:19:17.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.750+0000 7f3f3686d640 1 --2- 172.21.15.87:0/790666983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574afddcfd0 0x5574afdda100 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800a4e0 tx=0x7f3f280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47156caf82d088be server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:17.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.750+0000 7f3f19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:19:17.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.750+0000 7f3f19ffb640 1 -- 172.21.15.87:0/790666983 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f280129e0 con 0x5574afddcfd0 2024-09-13T17:19:17.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.750+0000 7f3f19ffb640 1 -- 172.21.15.87:0/790666983 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f3f28012b40 con 0x5574afddcfd0 2024-09-13T17:19:17.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.750+0000 7f3f3aff1740 1 -- 172.21.15.87:0/790666983 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5574afa294e0 con 0x5574afddcfd0 2024-09-13T17:19:17.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.751+0000 7f3f19ffb640 1 -- 172.21.15.87:0/790666983 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f28012d00 con 0x5574afddcfd0 2024-09-13T17:19:17.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.751+0000 7f3f3aff1740 10 client.17037 fetch_fsmap learned FSMap version 32 2024-09-13T17:19:17.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.751+0000 7f3f3aff1740 1 -- 172.21.15.87:0/790666983 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x5574afd34620 con 0x5574afddcfd0 2024-09-13T17:19:17.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.751+0000 7f3f19ffb640 1 -- 172.21.15.87:0/790666983 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x5574afa294e0 con 0x5574afddcfd0 2024-09-13T17:19:17.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.751+0000 7f3f19ffb640 1 -- 172.21.15.87:0/790666983 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 32) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f3f280173e0 con 0x5574afddcfd0 2024-09-13T17:19:17.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.751+0000 7f3f3aff1740 10 client.17037 fetch_fsmap finished waiting for FSMap version 32 2024-09-13T17:19:17.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.751+0000 7f3f3aff1740 10 client.17037 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:19:17.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.751+0000 7f3f3aff1740 20 client.17037 populate_metadata read hostname 'smithi087' 2024-09-13T17:19:17.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.751+0000 7f3f3aff1740 1 --2- 172.21.15.87:0/790666983 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5574afdece70 0x5574afdef290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:17.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.751+0000 7f3f3aff1740 4 client.17037 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:19:17.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.751+0000 7f3f3aff1740 1 -- 172.21.15.87:0/790666983 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5574afa3a7e0 con 0x5574afdece70 2024-09-13T17:19:17.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.751+0000 7f3f3586b640 1 --2- 172.21.15.87:0/790666983 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5574afdece70 0x5574afdef290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:17.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.752+0000 7f3f19ffb640 10 client.17037 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:17.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.752+0000 7f3f3586b640 1 --2- 172.21.15.87:0/790666983 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5574afdece70 0x5574afdef290 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2bf7626a4d09f2b server_cookie=f68c51951252a31a in_seq=0 out_seq=0 2024-09-13T17:19:17.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.752+0000 7f3f19ffb640 1 -- 172.21.15.87:0/790666983 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5574afa3a7e0 con 0x5574afdece70 2024-09-13T17:19:17.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.752+0000 7f3f19ffb640 10 client.17037 handle_command_reply: tid=0 2024-09-13T17:19:17.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.752+0000 7f3f3aff1740 1 client.17037 shutdown 2024-09-13T17:19:17.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.753+0000 7f3f3aff1740 1 -- 172.21.15.87:0/790666983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574afddcfd0 msgr2=0x5574afdda100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:17.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.753+0000 7f3f3aff1740 1 --2- 172.21.15.87:0/790666983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574afddcfd0 0x5574afdda100 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800a4e0 tx=0x7f3f280046c0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.753+0000 7f3f3aff1740 1 -- 172.21.15.87:0/790666983 shutdown_connections 2024-09-13T17:19:17.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.753+0000 7f3f3aff1740 1 --2- 172.21.15.87:0/790666983 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5574afdece70 0x5574afdef290 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.753+0000 7f3f3aff1740 1 --2- 172.21.15.87:0/790666983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574afddcfd0 0x5574afdda100 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.753+0000 7f3f3aff1740 1 --2- 172.21.15.87:0/790666983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574afdd2730 0x5574afdd9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.753+0000 7f3f3aff1740 1 --2- 172.21.15.87:0/790666983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5574afdd1e10 0x5574afddc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.753+0000 7f3f3aff1740 1 -- 172.21.15.87:0/790666983 >> 172.21.15.87:0/790666983 conn(0x5574afdce380 msgr2=0x5574afdcd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:17.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.753+0000 7f3f19ffb640 0 client.17037 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:17.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.753+0000 7f3f3aff1740 1 -- 172.21.15.87:0/790666983 shutdown_connections 2024-09-13T17:19:17.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.753+0000 7f3f3aff1740 1 -- 172.21.15.87:0/790666983 wait complete. 2024-09-13T17:19:17.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.753+0000 7f3f3aff1740 20 client.17037 trim_cache size 0 max 16384 2024-09-13T17:19:17.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.767+0000 7f3f3aff1740 1 Processor -- start 2024-09-13T17:19:17.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.767+0000 7f3f3aff1740 1 -- start start 2024-09-13T17:19:17.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.767+0000 7f3f3aff1740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5574afdd1e10 0x5574afdcde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:17.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.767+0000 7f3f3aff1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574afdd2730 0x5574afdf3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:17.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.767+0000 7f3f3aff1740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574afddcfd0 0x5574afdd4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:17.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.767+0000 7f3f3aff1740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574afddacf0 con 0x5574afdd2730 2024-09-13T17:19:17.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.767+0000 7f3f3aff1740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574afa3a7e0 con 0x5574afddcfd0 2024-09-13T17:19:17.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.767+0000 7f3f3aff1740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574afdeb5f0 con 0x5574afdd1e10 2024-09-13T17:19:17.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.767+0000 7f3f3586b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574afdd2730 0x5574afdf3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:17.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.767+0000 7f3f3586b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574afdd2730 0x5574afdf3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48172/0 (socket says 172.21.15.87:48172) 2024-09-13T17:19:17.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.767+0000 7f3f3586b640 1 -- 172.21.15.87:0/1847298404 learned_addr learned my addr 172.21.15.87:0/1847298404 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:17.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.767+0000 7f3f3686d640 1 --2- 172.21.15.87:0/1847298404 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5574afdd1e10 0x5574afdcde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:17.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.767+0000 7f3f3686d640 1 --2- 172.21.15.87:0/1847298404 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574afddcfd0 0x5574afdd4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:17.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.767+0000 7f3f3586b640 1 -- 172.21.15.87:0/1847298404 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5574afdd1e10 msgr2=0x5574afdcde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:17.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.767+0000 7f3f3586b640 1 --2- 172.21.15.87:0/1847298404 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5574afdd1e10 0x5574afdcde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.767+0000 7f3f3586b640 1 -- 172.21.15.87:0/1847298404 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574afddcfd0 msgr2=0x5574afdd4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:17.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.767+0000 7f3f3586b640 1 --2- 172.21.15.87:0/1847298404 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574afddcfd0 0x5574afdd4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.767+0000 7f3f3586b640 1 -- 172.21.15.87:0/1847298404 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5574afcd6790 con 0x5574afdd2730 2024-09-13T17:19:17.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.767+0000 7f3f3686d640 1 --2- 172.21.15.87:0/1847298404 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574afddcfd0 0x5574afdd4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:17.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.768+0000 7f3f3586b640 1 --2- 172.21.15.87:0/1847298404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574afdd2730 0x5574afdf3bb0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f3f2000cc40 tx=0x7f3f20005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c256f6862d4d2c91 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:17.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.768+0000 7f3f25606640 1 -- 172.21.15.87:0/1847298404 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2001f070 con 0x5574afdd2730 2024-09-13T17:19:17.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.768+0000 7f3f25606640 1 -- 172.21.15.87:0/1847298404 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3f20020040 con 0x5574afdd2730 2024-09-13T17:19:17.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.768+0000 7f3f25606640 1 -- 172.21.15.87:0/1847298404 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f200272b0 con 0x5574afdd2730 2024-09-13T17:19:17.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.768+0000 7f3f3aff1740 1 -- 172.21.15.87:0/1847298404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574afdd2730 msgr2=0x5574afdf3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:17.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.768+0000 7f3f3aff1740 1 --2- 172.21.15.87:0/1847298404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574afdd2730 0x5574afdf3bb0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f3f2000cc40 tx=0x7f3f20005760 comp rx=0 tx=0).stop 2024-09-13T17:19:17.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.768+0000 7f3f3aff1740 1 -- 172.21.15.87:0/1847298404 shutdown_connections 2024-09-13T17:19:17.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.768+0000 7f3f3aff1740 1 --2- 172.21.15.87:0/1847298404 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574afddcfd0 0x5574afdd4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.768+0000 7f3f3aff1740 1 --2- 172.21.15.87:0/1847298404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574afdd2730 0x5574afdf3bb0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.768+0000 7f3f3aff1740 1 --2- 172.21.15.87:0/1847298404 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5574afdd1e10 0x5574afdcde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.768+0000 7f3f3aff1740 1 -- 172.21.15.87:0/1847298404 >> 172.21.15.87:0/1847298404 conn(0x5574afdce380 msgr2=0x5574afdeee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:17.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.768+0000 7f3f3aff1740 1 -- 172.21.15.87:0/1847298404 shutdown_connections 2024-09-13T17:19:17.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.768+0000 7f3f3aff1740 1 -- 172.21.15.87:0/1847298404 wait complete. 2024-09-13T17:19:17.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.769+0000 7f3f3aff1740 1 -- start start 2024-09-13T17:19:17.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.769+0000 7f3f3aff1740 1 Processor -- start 2024-09-13T17:19:17.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.769+0000 7f3f3aff1740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574afdd1e10 0x5574afde0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:17.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.769+0000 7f3f3aff1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574afdd2730 0x5574afde0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:17.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.769+0000 7f3f3aff1740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5574afddcfd0 0x5574afe3b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:17.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.769+0000 7f3f3aff1740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574afe3b9b0 con 0x5574afdd2730 2024-09-13T17:19:17.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.769+0000 7f3f3aff1740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574afe3bb20 con 0x5574afdd1e10 2024-09-13T17:19:17.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.769+0000 7f3f3aff1740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574afe3bce0 con 0x5574afddcfd0 2024-09-13T17:19:17.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.769+0000 7f3f3aff1740 10 client.0 _ll_register_callbacks cb 0x7f3f2800aa90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:17.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.769+0000 7f3f3586b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574afdd2730 0x5574afde0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:17.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.769+0000 7f3f3586b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574afdd2730 0x5574afde0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48178/0 (socket says 172.21.15.87:48178) 2024-09-13T17:19:17.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.769+0000 7f3f3586b640 1 -- 172.21.15.87:0/2552794217 learned_addr learned my addr 172.21.15.87:0/2552794217 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:17.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.769+0000 7f3f3686d640 1 --2- 172.21.15.87:0/2552794217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5574afddcfd0 0x5574afe3b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:17.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.769+0000 7f3f3686d640 1 --2- 172.21.15.87:0/2552794217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574afdd1e10 0x5574afde0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:17.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.769+0000 7f3f3586b640 1 -- 172.21.15.87:0/2552794217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5574afddcfd0 msgr2=0x5574afe3b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:17.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.769+0000 7f3f3586b640 1 --2- 172.21.15.87:0/2552794217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5574afddcfd0 0x5574afe3b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.769+0000 7f3f3586b640 1 -- 172.21.15.87:0/2552794217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574afdd1e10 msgr2=0x5574afde0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:17.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.769+0000 7f3f3586b640 1 --2- 172.21.15.87:0/2552794217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574afdd1e10 0x5574afde0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.769+0000 7f3f3586b640 1 -- 172.21.15.87:0/2552794217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5574afcf0840 con 0x5574afdd2730 2024-09-13T17:19:17.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.769+0000 7f3f3686d640 1 --2- 172.21.15.87:0/2552794217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574afdd1e10 0x5574afde0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:17.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.769+0000 7f3f3586b640 1 --2- 172.21.15.87:0/2552794217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574afdd2730 0x5574afde0a60 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f3f2000f010 tx=0x7f3f20004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87b268c1852fa32b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:17.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.769+0000 7f3f19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:19:17.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.770+0000 7f3f19ffb640 1 -- 172.21.15.87:0/2552794217 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2001f070 con 0x5574afdd2730 2024-09-13T17:19:17.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.770+0000 7f3f19ffb640 1 -- 172.21.15.87:0/2552794217 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f3f200035f0 con 0x5574afdd2730 2024-09-13T17:19:17.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.770+0000 7f3f3aff1740 1 -- 172.21.15.87:0/2552794217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3f20004c50 con 0x5574afdd2730 2024-09-13T17:19:17.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.770+0000 7f3f19ffb640 1 -- 172.21.15.87:0/2552794217 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f200037b0 con 0x5574afdd2730 2024-09-13T17:19:17.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.770+0000 7f3f3aff1740 10 client.17043 fetch_fsmap learned FSMap version 32 2024-09-13T17:19:17.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.770+0000 7f3f3aff1740 1 -- 172.21.15.87:0/2552794217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x5574afcfbea0 con 0x5574afdd2730 2024-09-13T17:19:17.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.770+0000 7f3f19ffb640 1 -- 172.21.15.87:0/2552794217 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3f20004c50 con 0x5574afdd2730 2024-09-13T17:19:17.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.770+0000 7f3f19ffb640 1 -- 172.21.15.87:0/2552794217 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 32) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f3f20027680 con 0x5574afdd2730 2024-09-13T17:19:17.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.770+0000 7f3f3aff1740 10 client.17043 fetch_fsmap finished waiting for FSMap version 32 2024-09-13T17:19:17.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.770+0000 7f3f3aff1740 10 client.17043 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:19:17.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.770+0000 7f3f3aff1740 20 client.17043 populate_metadata read hostname 'smithi087' 2024-09-13T17:19:17.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.770+0000 7f3f3aff1740 1 --2- 172.21.15.87:0/2552794217 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5574afe44030 0x5574afe46450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:17.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.770+0000 7f3f3aff1740 4 client.17043 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:19:17.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.770+0000 7f3f3aff1740 1 -- 172.21.15.87:0/2552794217 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5574afa8de30 con 0x5574afe44030 2024-09-13T17:19:17.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.770+0000 7f3f3686d640 1 --2- 172.21.15.87:0/2552794217 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5574afe44030 0x5574afe46450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:17.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.771+0000 7f3f19ffb640 10 client.17043 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:17.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.771+0000 7f3f3686d640 1 --2- 172.21.15.87:0/2552794217 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5574afe44030 0x5574afe46450 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ec8f698bc47f475 server_cookie=838180b2c84cdd88 in_seq=0 out_seq=0 2024-09-13T17:19:17.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.771+0000 7f3f19ffb640 1 -- 172.21.15.87:0/2552794217 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5574afa8de30 con 0x5574afe44030 2024-09-13T17:19:17.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.771+0000 7f3f19ffb640 10 client.17043 handle_command_reply: tid=0 2024-09-13T17:19:17.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.771+0000 7f3f3aff1740 1 client.17043 shutdown 2024-09-13T17:19:17.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.771+0000 7f3f3aff1740 1 -- 172.21.15.87:0/2552794217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574afdd2730 msgr2=0x5574afde0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:17.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.771+0000 7f3f3aff1740 1 --2- 172.21.15.87:0/2552794217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574afdd2730 0x5574afde0a60 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f3f2000f010 tx=0x7f3f20004f90 comp rx=0 tx=0).stop 2024-09-13T17:19:17.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.771+0000 7f3f3aff1740 1 -- 172.21.15.87:0/2552794217 shutdown_connections 2024-09-13T17:19:17.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.771+0000 7f3f3aff1740 1 --2- 172.21.15.87:0/2552794217 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5574afe44030 0x5574afe46450 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.771+0000 7f3f3aff1740 1 --2- 172.21.15.87:0/2552794217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5574afddcfd0 0x5574afe3b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.771+0000 7f3f3aff1740 1 --2- 172.21.15.87:0/2552794217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5574afdd2730 0x5574afde0a60 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.771+0000 7f3f19ffb640 0 client.17043 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:17.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.771+0000 7f3f3aff1740 1 --2- 172.21.15.87:0/2552794217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574afdd1e10 0x5574afde0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.771+0000 7f3f3aff1740 1 -- 172.21.15.87:0/2552794217 >> 172.21.15.87:0/2552794217 conn(0x5574afdce380 msgr2=0x5574afdf3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:17.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.771+0000 7f3f3aff1740 1 -- 172.21.15.87:0/2552794217 shutdown_connections 2024-09-13T17:19:17.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.771+0000 7f3f3aff1740 1 -- 172.21.15.87:0/2552794217 wait complete. 2024-09-13T17:19:17.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.771+0000 7f3f3aff1740 20 client.17043 trim_cache size 0 max 16384 2024-09-13T17:19:17.781 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:19:17.781 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "no active scrubs running", 2024-09-13T17:19:17.781 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": {} 2024-09-13T17:19:17.781 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:19:17.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.772+0000 7f3f382d0640 1 -- 172.21.15.87:0/2500615873 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f3f1c0a1200 msgr2=0x7f3f1c0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:17.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.772+0000 7f3f382d0640 1 --2- 172.21.15.87:0/2500615873 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f3f1c0a1200 0x7f3f1c0a36c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c0bac60 tx=0x7f3f2c0b06b0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.772+0000 7f3f382d0640 1 -- 172.21.15.87:0/2500615873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f30100f80 msgr2=0x7f3f300febd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:17.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.772+0000 7f3f382d0640 1 --2- 172.21.15.87:0/2500615873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f30100f80 0x7f3f300febd0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c000f80 tx=0x7f3f2c031f90 comp rx=0 tx=0).stop 2024-09-13T17:19:17.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.772+0000 7f3f382d0640 1 -- 172.21.15.87:0/2500615873 shutdown_connections 2024-09-13T17:19:17.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.772+0000 7f3f382d0640 1 --2- 172.21.15.87:0/2500615873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f3010a350 0x7f3f300ff650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.772+0000 7f3f382d0640 1 --2- 172.21.15.87:0/2500615873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f301018a0 0x7f3f300ff110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.772+0000 7f3f382d0640 1 --2- 172.21.15.87:0/2500615873 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f3f1c0a1200 0x7f3f1c0a36c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.772+0000 7f3f382d0640 1 --2- 172.21.15.87:0/2500615873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f30100f80 0x7f3f300febd0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.772+0000 7f3f382d0640 1 -- 172.21.15.87:0/2500615873 >> 172.21.15.87:0/2500615873 conn(0x7f3f30075c60 msgr2=0x7f3f300fb380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:17.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.772+0000 7f3f382d0640 1 -- 172.21.15.87:0/2500615873 shutdown_connections 2024-09-13T17:19:17.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.772+0000 7f3f382d0640 1 -- 172.21.15.87:0/2500615873 wait complete. 2024-09-13T17:19:17.784 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T17:19:17.784 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:19:17.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:17 smithi149 ceph-mon[35496]: pgmap v167: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-13T17:19:17.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:17 smithi118 ceph-mon[34374]: pgmap v167: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-13T17:19:17.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.882+0000 7ff86d7c7640 1 -- 172.21.15.87:0/1144797151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff868103fd0 msgr2=0x7ff86810bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:17.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.882+0000 7ff86d7c7640 1 --2- 172.21.15.87:0/1144797151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff868103fd0 0x7ff86810bb20 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7ff858009cd0 tx=0x7ff85802a8e0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.882+0000 7ff86d7c7640 1 -- 172.21.15.87:0/1144797151 shutdown_connections 2024-09-13T17:19:17.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.882+0000 7ff86d7c7640 1 --2- 172.21.15.87:0/1144797151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff868103fd0 0x7ff86810bb20 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.882+0000 7ff86d7c7640 1 --2- 172.21.15.87:0/1144797151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8680ff830 0x7ff868103870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.882+0000 7ff86d7c7640 1 --2- 172.21.15.87:0/1144797151 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8680fee80 0x7ff8680ff260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.882+0000 7ff86d7c7640 1 -- 172.21.15.87:0/1144797151 >> 172.21.15.87:0/1144797151 conn(0x7ff868075c60 msgr2=0x7ff8680fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:17.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.882+0000 7ff86d7c7640 1 -- 172.21.15.87:0/1144797151 shutdown_connections 2024-09-13T17:19:17.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.882+0000 7ff86d7c7640 1 -- 172.21.15.87:0/1144797151 wait complete. 2024-09-13T17:19:17.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.883+0000 7ff86d7c7640 1 Processor -- start 2024-09-13T17:19:17.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.883+0000 7ff86d7c7640 1 -- start start 2024-09-13T17:19:17.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.883+0000 7ff86d7c7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8680fee80 0x7ff868197030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:17.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.883+0000 7ff86d7c7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff868103fd0 0x7ff868197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:17.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.883+0000 7ff86d7c7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff868197ab0 0x7ff8681a20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:17.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.883+0000 7ff86d7c7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8681a2750 con 0x7ff868103fd0 2024-09-13T17:19:17.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.883+0000 7ff86d7c7640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8681a28c0 con 0x7ff868197ab0 2024-09-13T17:19:17.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.883+0000 7ff86d7c7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8681a2a80 con 0x7ff8680fee80 2024-09-13T17:19:17.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.883+0000 7ff8667fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff868103fd0 0x7ff868197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:17.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.884+0000 7ff8667fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff868103fd0 0x7ff868197570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48186/0 (socket says 172.21.15.87:48186) 2024-09-13T17:19:17.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.884+0000 7ff8667fc640 1 -- 172.21.15.87:0/1852194216 learned_addr learned my addr 172.21.15.87:0/1852194216 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:17.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.884+0000 7ff866ffd640 1 --2- 172.21.15.87:0/1852194216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8680fee80 0x7ff868197030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:17.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.884+0000 7ff8677fe640 1 --2- 172.21.15.87:0/1852194216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff868197ab0 0x7ff8681a20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:17.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.884+0000 7ff8667fc640 1 -- 172.21.15.87:0/1852194216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8680fee80 msgr2=0x7ff868197030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:17.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.884+0000 7ff8667fc640 1 --2- 172.21.15.87:0/1852194216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8680fee80 0x7ff868197030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.884+0000 7ff8667fc640 1 -- 172.21.15.87:0/1852194216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff868197ab0 msgr2=0x7ff8681a20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:17.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.884+0000 7ff8667fc640 1 --2- 172.21.15.87:0/1852194216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff868197ab0 0x7ff8681a20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:17.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.884+0000 7ff8667fc640 1 -- 172.21.15.87:0/1852194216 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff858009900 con 0x7ff868103fd0 2024-09-13T17:19:17.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.884+0000 7ff866ffd640 1 --2- 172.21.15.87:0/1852194216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8680fee80 0x7ff868197030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:17.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.884+0000 7ff8667fc640 1 --2- 172.21.15.87:0/1852194216 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff868103fd0 0x7ff868197570 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7ff85000c970 tx=0x7ff85000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:17.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.884+0000 7ff85ffff640 1 -- 172.21.15.87:0/1852194216 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff850007bb0 con 0x7ff868103fd0 2024-09-13T17:19:17.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.884+0000 7ff85ffff640 1 -- 172.21.15.87:0/1852194216 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff850007d10 con 0x7ff868103fd0 2024-09-13T17:19:17.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.884+0000 7ff86d7c7640 1 -- 172.21.15.87:0/1852194216 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8681a2d60 con 0x7ff868103fd0 2024-09-13T17:19:17.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.884+0000 7ff85ffff640 1 -- 172.21.15.87:0/1852194216 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff850018660 con 0x7ff868103fd0 2024-09-13T17:19:17.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.884+0000 7ff86d7c7640 1 -- 172.21.15.87:0/1852194216 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8681a31c0 con 0x7ff868103fd0 2024-09-13T17:19:17.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.885+0000 7ff86d7c7640 1 -- 172.21.15.87:0/1852194216 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff868100350 con 0x7ff868103fd0 2024-09-13T17:19:17.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.886+0000 7ff85ffff640 1 -- 172.21.15.87:0/1852194216 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7ff85000f450 con 0x7ff868103fd0 2024-09-13T17:19:17.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.887+0000 7ff85ffff640 1 --2- 172.21.15.87:0/1852194216 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff8540a1200 0x7ff8540a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:17.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.887+0000 7ff866ffd640 1 --2- 172.21.15.87:0/1852194216 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff8540a1200 0x7ff8540a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:17.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.887+0000 7ff85ffff640 1 -- 172.21.15.87:0/1852194216 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7ff8500cd190 con 0x7ff868103fd0 2024-09-13T17:19:17.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.887+0000 7ff866ffd640 1 --2- 172.21.15.87:0/1852194216 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff8540a1200 0x7ff8540a36c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff86000abe0 tx=0x7ff86000a5c0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:17.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:17.891+0000 7ff85ffff640 1 -- 172.21.15.87:0/1852194216 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff850096230 con 0x7ff868103fd0 2024-09-13T17:19:17.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:17 smithi087 ceph-mon[30934]: pgmap v167: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-13T17:19:18.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.088+0000 7ff86d7c7640 1 -- 172.21.15.87:0/1852194216 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff868107220 con 0x7ff868103fd0 2024-09-13T17:19:18.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.088+0000 7ff85ffff640 1 -- 172.21.15.87:0/1852194216 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+10882 (secure 0 0 0) 0x7ff850099850 con 0x7ff868103fd0 2024-09-13T17:19:18.090 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:19:18.090 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/3674545180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":3674545180},{"type":"v1","addr":"172.21.15.87:6841","nonce":3674545180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":32,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:11:23.313609+0000","modified":"2024-09-13T17:19:10.567661+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24484,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6839/3052680456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3052680456},{"type":"v1","addr":"172.21.15.118:6839","nonce":3052680456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:19:18.090 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 32 2024-09-13T17:19:18.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.090+0000 7ff86d7c7640 1 -- 172.21.15.87:0/1852194216 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff8540a1200 msgr2=0x7ff8540a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:18.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.090+0000 7ff86d7c7640 1 --2- 172.21.15.87:0/1852194216 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff8540a1200 0x7ff8540a36c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff86000abe0 tx=0x7ff86000a5c0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.090+0000 7ff86d7c7640 1 -- 172.21.15.87:0/1852194216 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff868103fd0 msgr2=0x7ff868197570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:18.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.090+0000 7ff86d7c7640 1 --2- 172.21.15.87:0/1852194216 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff868103fd0 0x7ff868197570 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7ff85000c970 tx=0x7ff85000ce30 comp rx=0 tx=0).stop 2024-09-13T17:19:18.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.090+0000 7ff86d7c7640 1 -- 172.21.15.87:0/1852194216 shutdown_connections 2024-09-13T17:19:18.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.090+0000 7ff86d7c7640 1 --2- 172.21.15.87:0/1852194216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff868197ab0 0x7ff8681a20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.090+0000 7ff86d7c7640 1 --2- 172.21.15.87:0/1852194216 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff8540a1200 0x7ff8540a36c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.090+0000 7ff86d7c7640 1 --2- 172.21.15.87:0/1852194216 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff868103fd0 0x7ff868197570 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.090+0000 7ff86d7c7640 1 --2- 172.21.15.87:0/1852194216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8680fee80 0x7ff868197030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.090+0000 7ff86d7c7640 1 -- 172.21.15.87:0/1852194216 >> 172.21.15.87:0/1852194216 conn(0x7ff868075c60 msgr2=0x7ff8680fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:18.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.090+0000 7ff86d7c7640 1 -- 172.21.15.87:0/1852194216 shutdown_connections 2024-09-13T17:19:18.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.090+0000 7ff86d7c7640 1 -- 172.21.15.87:0/1852194216 wait complete. 2024-09-13T17:19:18.102 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-09-13T17:19:18.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.201+0000 7fc45845a640 1 -- 172.21.15.87:0/3063337991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4500fff50 msgr2=0x7fc450100330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:18.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.201+0000 7fc45845a640 1 --2- 172.21.15.87:0/3063337991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4500fff50 0x7fc450100330 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fc444009930 tx=0x7fc44402a420 comp rx=0 tx=0).stop 2024-09-13T17:19:18.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.201+0000 7fc45845a640 1 -- 172.21.15.87:0/3063337991 shutdown_connections 2024-09-13T17:19:18.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.201+0000 7fc45845a640 1 --2- 172.21.15.87:0/3063337991 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4501050a0 0x7fc45010cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.201+0000 7fc45845a640 1 --2- 172.21.15.87:0/3063337991 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc450100900 0x7fc450104940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.201+0000 7fc45845a640 1 --2- 172.21.15.87:0/3063337991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4500fff50 0x7fc450100330 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.201+0000 7fc45845a640 1 -- 172.21.15.87:0/3063337991 >> 172.21.15.87:0/3063337991 conn(0x7fc4500fb9e0 msgr2=0x7fc4500fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:18.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.201+0000 7fc45845a640 1 -- 172.21.15.87:0/3063337991 shutdown_connections 2024-09-13T17:19:18.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.201+0000 7fc45845a640 1 -- 172.21.15.87:0/3063337991 wait complete. 2024-09-13T17:19:18.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.202+0000 7fc45845a640 1 Processor -- start 2024-09-13T17:19:18.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.202+0000 7fc45845a640 1 -- start start 2024-09-13T17:19:18.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.202+0000 7fc45845a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4500fff50 0x7fc4500727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.202+0000 7fc45845a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4501050a0 0x7fc450072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.202+0000 7fc45845a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc450073230 0x7fc4501a45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.202+0000 7fc45845a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4501a4c10 con 0x7fc450073230 2024-09-13T17:19:18.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.202+0000 7fc45845a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4501a4d80 con 0x7fc4500fff50 2024-09-13T17:19:18.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.202+0000 7fc45845a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4501a4f40 con 0x7fc4501050a0 2024-09-13T17:19:18.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.202+0000 7fc4569f7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc450073230 0x7fc4501a45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.202+0000 7fc4569f7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc450073230 0x7fc4501a45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48196/0 (socket says 172.21.15.87:48196) 2024-09-13T17:19:18.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.202+0000 7fc4569f7640 1 -- 172.21.15.87:0/2513909123 learned_addr learned my addr 172.21.15.87:0/2513909123 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:18.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.202+0000 7fc4561f6640 1 --2- 172.21.15.87:0/2513909123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4500fff50 0x7fc4500727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.202+0000 7fc4559f5640 1 --2- 172.21.15.87:0/2513909123 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4501050a0 0x7fc450072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.202+0000 7fc4569f7640 1 -- 172.21.15.87:0/2513909123 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4501050a0 msgr2=0x7fc450072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:18.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.202+0000 7fc4569f7640 1 --2- 172.21.15.87:0/2513909123 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4501050a0 0x7fc450072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.202+0000 7fc4569f7640 1 -- 172.21.15.87:0/2513909123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4500fff50 msgr2=0x7fc4500727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:18.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.202+0000 7fc4569f7640 1 --2- 172.21.15.87:0/2513909123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4500fff50 0x7fc4500727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.202+0000 7fc4569f7640 1 -- 172.21.15.87:0/2513909123 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc444009560 con 0x7fc450073230 2024-09-13T17:19:18.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.202+0000 7fc4559f5640 1 --2- 172.21.15.87:0/2513909123 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4501050a0 0x7fc450072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:18.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.203+0000 7fc4569f7640 1 --2- 172.21.15.87:0/2513909123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc450073230 0x7fc4501a45c0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fc44800cad0 tx=0x7fc44800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:18.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.203+0000 7fc4437fe640 1 -- 172.21.15.87:0/2513909123 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44800ae20 con 0x7fc450073230 2024-09-13T17:19:18.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.203+0000 7fc4437fe640 1 -- 172.21.15.87:0/2513909123 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc448005020 con 0x7fc450073230 2024-09-13T17:19:18.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.203+0000 7fc45845a640 1 -- 172.21.15.87:0/2513909123 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4501a5220 con 0x7fc450073230 2024-09-13T17:19:18.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.203+0000 7fc4437fe640 1 -- 172.21.15.87:0/2513909123 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44800f690 con 0x7fc450073230 2024-09-13T17:19:18.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.203+0000 7fc45845a640 1 -- 172.21.15.87:0/2513909123 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4501a5730 con 0x7fc450073230 2024-09-13T17:19:18.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.205+0000 7fc4437fe640 1 -- 172.21.15.87:0/2513909123 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fc448005190 con 0x7fc450073230 2024-09-13T17:19:18.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.205+0000 7fc45b259740 1 Processor -- start 2024-09-13T17:19:18.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.205+0000 7fc45b259740 1 -- start start 2024-09-13T17:19:18.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.206+0000 7fc45b259740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564406b82790 0x564406b82b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.206+0000 7fc45b259740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564406b830b0 0x564406b8d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.206+0000 7fc45b259740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564406b8d950 0x564406b8fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.206+0000 7fc45b259740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564406aeccc0 con 0x564406b830b0 2024-09-13T17:19:18.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.206+0000 7fc4437fe640 1 --2- 172.21.15.87:0/2513909123 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc43c0a1200 0x7fc43c0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.206+0000 7fc45b259740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564406aea450 con 0x564406b8d950 2024-09-13T17:19:18.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.206+0000 7fc45b259740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564406ae5d40 con 0x564406b82790 2024-09-13T17:19:18.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.206+0000 7fc4561f6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564406b830b0 0x564406b8d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.206+0000 7fc4561f6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564406b830b0 0x564406b8d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48202/0 (socket says 172.21.15.87:48202) 2024-09-13T17:19:18.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.206+0000 7fc4561f6640 1 -- 172.21.15.87:0/994732506 learned_addr learned my addr 172.21.15.87:0/994732506 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:18.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.206+0000 7fc4569f7640 1 --2- 172.21.15.87:0/2513909123 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc43c0a1200 0x7fc43c0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.206+0000 7fc4559f5640 1 --2- 172.21.15.87:0/994732506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564406b8d950 0x564406b8fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.206+0000 7fc4437fe640 1 -- 172.21.15.87:0/2513909123 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fc4480cd090 con 0x7fc450073230 2024-09-13T17:19:18.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.206+0000 7fc4559f5640 1 --2- 172.21.15.87:0/994732506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564406b82790 0x564406b82b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.206+0000 7fc4561f6640 1 -- 172.21.15.87:0/994732506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564406b82790 msgr2=0x564406b82b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:18.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.206+0000 7fc4561f6640 1 --2- 172.21.15.87:0/994732506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564406b82790 0x564406b82b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.206+0000 7fc4561f6640 1 -- 172.21.15.87:0/994732506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564406b8d950 msgr2=0x564406b8fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:18.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.206+0000 7fc4561f6640 1 --2- 172.21.15.87:0/994732506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564406b8d950 0x564406b8fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.206+0000 7fc4561f6640 1 -- 172.21.15.87:0/994732506 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564406aad620 con 0x564406b830b0 2024-09-13T17:19:18.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.206+0000 7fc4569f7640 1 --2- 172.21.15.87:0/2513909123 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc43c0a1200 0x7fc43c0a36c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc448096800 tx=0x7fc448000f40 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:18.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.206+0000 7fc4561f6640 1 --2- 172.21.15.87:0/994732506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564406b830b0 0x564406b8d410 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fc444005ab0 tx=0x7fc4440042b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f72269978bfedbed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:18.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.206+0000 7fc440e05640 1 -- 172.21.15.87:0/994732506 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc444005230 con 0x564406b830b0 2024-09-13T17:19:18.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.207+0000 7fc440e05640 1 -- 172.21.15.87:0/994732506 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc444040070 con 0x564406b830b0 2024-09-13T17:19:18.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.207+0000 7fc440e05640 1 -- 172.21.15.87:0/994732506 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc444003850 con 0x564406b830b0 2024-09-13T17:19:18.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.207+0000 7fc45b259740 1 -- 172.21.15.87:0/994732506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564406b830b0 msgr2=0x564406b8d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:18.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.207+0000 7fc45b259740 1 --2- 172.21.15.87:0/994732506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564406b830b0 0x564406b8d410 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fc444005ab0 tx=0x7fc4440042b0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.207+0000 7fc45b259740 1 -- 172.21.15.87:0/994732506 shutdown_connections 2024-09-13T17:19:18.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.207+0000 7fc45b259740 1 --2- 172.21.15.87:0/994732506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564406b8d950 0x564406b8fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.207+0000 7fc45b259740 1 --2- 172.21.15.87:0/994732506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564406b830b0 0x564406b8d410 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.207+0000 7fc45b259740 1 --2- 172.21.15.87:0/994732506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564406b82790 0x564406b82b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.207+0000 7fc45b259740 1 -- 172.21.15.87:0/994732506 >> 172.21.15.87:0/994732506 conn(0x564406b7ed00 msgr2=0x564406b7f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:18.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.207+0000 7fc45b259740 1 -- 172.21.15.87:0/994732506 shutdown_connections 2024-09-13T17:19:18.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.207+0000 7fc45b259740 1 -- 172.21.15.87:0/994732506 wait complete. 2024-09-13T17:19:18.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.208+0000 7fc45b259740 1 -- start start 2024-09-13T17:19:18.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.208+0000 7fc45b259740 1 Processor -- start 2024-09-13T17:19:18.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.208+0000 7fc45b259740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564406b82790 0x564406b8cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.208+0000 7fc45b259740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564406b830b0 0x564406b8a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.208+0000 7fc45b259740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564406b8d950 0x564406b8a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.208+0000 7fc45b259740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564406aa4180 con 0x564406b8d950 2024-09-13T17:19:18.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.208+0000 7fc45b259740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644067be430 con 0x564406b82790 2024-09-13T17:19:18.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.208+0000 7fc45b259740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564406a695e0 con 0x564406b830b0 2024-09-13T17:19:18.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.208+0000 7fc45b259740 10 client.0 _ll_register_callbacks cb 0x564406ad5aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:18.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.208+0000 7fc4559f5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564406b8d950 0x564406b8a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.208+0000 7fc4559f5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564406b8d950 0x564406b8a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48212/0 (socket says 172.21.15.87:48212) 2024-09-13T17:19:18.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.208+0000 7fc4559f5640 1 -- 172.21.15.87:0/772928750 learned_addr learned my addr 172.21.15.87:0/772928750 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:18.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.208+0000 7fc4559f5640 1 --2- 172.21.15.87:0/772928750 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564406b82790 0x564406b8cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.208+0000 7fc4561f6640 1 --2- 172.21.15.87:0/772928750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564406b830b0 0x564406b8a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.208+0000 7fc4559f5640 1 -- 172.21.15.87:0/772928750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564406b830b0 msgr2=0x564406b8a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:18.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.208+0000 7fc4559f5640 1 --2- 172.21.15.87:0/772928750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564406b830b0 0x564406b8a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.208+0000 7fc4559f5640 1 -- 172.21.15.87:0/772928750 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564406b82790 msgr2=0x564406b8cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:18.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.208+0000 7fc4559f5640 1 --2- 172.21.15.87:0/772928750 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564406b82790 0x564406b8cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.208+0000 7fc4559f5640 1 -- 172.21.15.87:0/772928750 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc45010d430 con 0x564406b8d950 2024-09-13T17:19:18.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.209+0000 7fc4559f5640 1 --2- 172.21.15.87:0/772928750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564406b8d950 0x564406b8a790 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fc450069630 tx=0x7fc44c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=114f95c6baa63249 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:18.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.209+0000 7fc439ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:19:18.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.209+0000 7fc439ffb640 1 -- 172.21.15.87:0/772928750 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c00ceb0 con 0x564406b8d950 2024-09-13T17:19:18.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.209+0000 7fc439ffb640 1 -- 172.21.15.87:0/772928750 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fc44c011e40 con 0x564406b8d950 2024-09-13T17:19:18.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.209+0000 7fc45b259740 1 -- 172.21.15.87:0/772928750 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564406b0fb80 con 0x564406b8d950 2024-09-13T17:19:18.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.209+0000 7fc439ffb640 1 -- 172.21.15.87:0/772928750 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc44c004030 con 0x564406b8d950 2024-09-13T17:19:18.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.209+0000 7fc45b259740 10 client.17061 fetch_fsmap learned FSMap version 32 2024-09-13T17:19:18.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.209+0000 7fc45b259740 1 -- 172.21.15.87:0/772928750 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x564406ae43c0 con 0x564406b8d950 2024-09-13T17:19:18.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.209+0000 7fc439ffb640 1 -- 172.21.15.87:0/772928750 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x564406b0fb80 con 0x564406b8d950 2024-09-13T17:19:18.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.209+0000 7fc439ffb640 1 -- 172.21.15.87:0/772928750 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 32) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fc44c00e5c0 con 0x564406b8d950 2024-09-13T17:19:18.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.209+0000 7fc45b259740 10 client.17061 fetch_fsmap finished waiting for FSMap version 32 2024-09-13T17:19:18.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.209+0000 7fc45b259740 10 client.17061 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:19:18.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.209+0000 7fc45b259740 20 client.17061 populate_metadata read hostname 'smithi087' 2024-09-13T17:19:18.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.209+0000 7fc45b259740 1 --2- 172.21.15.87:0/772928750 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x564406b9d2a0 0x564406b9f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.209+0000 7fc45b259740 4 client.17061 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:19:18.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.209+0000 7fc45b259740 1 -- 172.21.15.87:0/772928750 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564406ad81f0 con 0x564406b9d2a0 2024-09-13T17:19:18.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.210+0000 7fc4561f6640 1 --2- 172.21.15.87:0/772928750 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x564406b9d2a0 0x564406b9f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.210+0000 7fc4561f6640 1 --2- 172.21.15.87:0/772928750 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x564406b9d2a0 0x564406b9f6c0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3c9cf7c6d82b35ff server_cookie=ca2f750c3aa05959 in_seq=0 out_seq=0 2024-09-13T17:19:18.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.210+0000 7fc439ffb640 10 client.17061 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:19:18.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.210+0000 7fc439ffb640 1 -- 172.21.15.87:0/772928750 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x564406ad81f0 con 0x564406b9d2a0 2024-09-13T17:19:18.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.210+0000 7fc439ffb640 10 client.17061 handle_command_reply: tid=0 2024-09-13T17:19:18.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.211+0000 7fc45b259740 1 client.17061 shutdown 2024-09-13T17:19:18.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.211+0000 7fc45b259740 1 -- 172.21.15.87:0/772928750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564406b8d950 msgr2=0x564406b8a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:18.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.211+0000 7fc45b259740 1 --2- 172.21.15.87:0/772928750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564406b8d950 0x564406b8a790 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fc450069630 tx=0x7fc44c0046c0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.211+0000 7fc45b259740 1 -- 172.21.15.87:0/772928750 shutdown_connections 2024-09-13T17:19:18.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.211+0000 7fc45b259740 1 --2- 172.21.15.87:0/772928750 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x564406b9d2a0 0x564406b9f6c0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.211+0000 7fc45b259740 1 --2- 172.21.15.87:0/772928750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564406b8d950 0x564406b8a790 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.211+0000 7fc45b259740 1 --2- 172.21.15.87:0/772928750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564406b830b0 0x564406b8a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.211+0000 7fc45b259740 1 --2- 172.21.15.87:0/772928750 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564406b82790 0x564406b8cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.211+0000 7fc439ffb640 0 client.17061 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:19:18.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.211+0000 7fc45b259740 1 -- 172.21.15.87:0/772928750 >> 172.21.15.87:0/772928750 conn(0x564406b7ed00 msgr2=0x564406b7deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:18.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.211+0000 7fc45b259740 1 -- 172.21.15.87:0/772928750 shutdown_connections 2024-09-13T17:19:18.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.211+0000 7fc45b259740 1 -- 172.21.15.87:0/772928750 wait complete. 2024-09-13T17:19:18.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.211+0000 7fc45b259740 20 client.17061 trim_cache size 0 max 16384 2024-09-13T17:19:18.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.222+0000 7fc45b259740 1 Processor -- start 2024-09-13T17:19:18.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.222+0000 7fc45b259740 1 -- start start 2024-09-13T17:19:18.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.222+0000 7fc45b259740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564406b82790 0x564406b7f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.222+0000 7fc45b259740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564406b830b0 0x564406b7f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.222+0000 7fc45b259740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564406b8d950 0x564406b8a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.222+0000 7fc45b259740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564406b7a4b0 con 0x564406b8d950 2024-09-13T17:19:18.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.222+0000 7fc45b259740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564406b9d080 con 0x564406b82790 2024-09-13T17:19:18.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.222+0000 7fc45b259740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564406b82580 con 0x564406b830b0 2024-09-13T17:19:18.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.222+0000 7fc4559f5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564406b8d950 0x564406b8a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.222+0000 7fc4559f5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564406b8d950 0x564406b8a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48228/0 (socket says 172.21.15.87:48228) 2024-09-13T17:19:18.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.222+0000 7fc4559f5640 1 -- 172.21.15.87:0/1852059983 learned_addr learned my addr 172.21.15.87:0/1852059983 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:18.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.222+0000 7fc4559f5640 1 --2- 172.21.15.87:0/1852059983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564406b82790 0x564406b7f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.222+0000 7fc4561f6640 1 --2- 172.21.15.87:0/1852059983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564406b830b0 0x564406b7f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.222+0000 7fc4559f5640 1 -- 172.21.15.87:0/1852059983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564406b830b0 msgr2=0x564406b7f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:18.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.222+0000 7fc4559f5640 1 --2- 172.21.15.87:0/1852059983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564406b830b0 0x564406b7f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.222+0000 7fc4559f5640 1 -- 172.21.15.87:0/1852059983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564406b82790 msgr2=0x564406b7f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:18.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.222+0000 7fc4559f5640 1 --2- 172.21.15.87:0/1852059983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564406b82790 0x564406b7f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.222+0000 7fc4559f5640 1 -- 172.21.15.87:0/1852059983 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564406a86770 con 0x564406b8d950 2024-09-13T17:19:18.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.222+0000 7fc4559f5640 1 --2- 172.21.15.87:0/1852059983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564406b8d950 0x564406b8a210 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fc44c0057a0 tx=0x7fc44c005970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59fe0ccd03fdfd2a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:18.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.223+0000 7fc441606640 1 -- 172.21.15.87:0/1852059983 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c00c3f0 con 0x564406b8d950 2024-09-13T17:19:18.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.223+0000 7fc441606640 1 -- 172.21.15.87:0/1852059983 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc44c01a070 con 0x564406b8d950 2024-09-13T17:19:18.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.223+0000 7fc441606640 1 -- 172.21.15.87:0/1852059983 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c00e5c0 con 0x564406b8d950 2024-09-13T17:19:18.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.223+0000 7fc45b259740 1 -- 172.21.15.87:0/1852059983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564406b8d950 msgr2=0x564406b8a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:18.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.223+0000 7fc45b259740 1 --2- 172.21.15.87:0/1852059983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564406b8d950 0x564406b8a210 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fc44c0057a0 tx=0x7fc44c005970 comp rx=0 tx=0).stop 2024-09-13T17:19:18.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.223+0000 7fc45b259740 1 -- 172.21.15.87:0/1852059983 shutdown_connections 2024-09-13T17:19:18.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.223+0000 7fc45b259740 1 --2- 172.21.15.87:0/1852059983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564406b8d950 0x564406b8a210 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.223+0000 7fc45b259740 1 --2- 172.21.15.87:0/1852059983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564406b830b0 0x564406b7f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.223+0000 7fc45b259740 1 --2- 172.21.15.87:0/1852059983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564406b82790 0x564406b7f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.223+0000 7fc45b259740 1 -- 172.21.15.87:0/1852059983 >> 172.21.15.87:0/1852059983 conn(0x564406b7ed00 msgr2=0x564406ba4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:18.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.223+0000 7fc45b259740 1 -- 172.21.15.87:0/1852059983 shutdown_connections 2024-09-13T17:19:18.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.223+0000 7fc45b259740 1 -- 172.21.15.87:0/1852059983 wait complete. 2024-09-13T17:19:18.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.223+0000 7fc45b259740 1 -- start start 2024-09-13T17:19:18.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.223+0000 7fc45b259740 1 Processor -- start 2024-09-13T17:19:18.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.224+0000 7fc45b259740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564406b82790 0x564406b94760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.224+0000 7fc45b259740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564406b830b0 0x564406b90bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.224+0000 7fc45b259740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564406b8d950 0x564406b910f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.224+0000 7fc45b259740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564406b91630 con 0x564406b8d950 2024-09-13T17:19:18.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.224+0000 7fc45b259740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564406b917a0 con 0x564406b82790 2024-09-13T17:19:18.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.224+0000 7fc45b259740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x564406b91960 con 0x564406b830b0 2024-09-13T17:19:18.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.224+0000 7fc45b259740 10 client.0 _ll_register_callbacks cb 0x7fc444004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:18.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.224+0000 7fc4559f5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564406b8d950 0x564406b910f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.224+0000 7fc4559f5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564406b8d950 0x564406b910f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48230/0 (socket says 172.21.15.87:48230) 2024-09-13T17:19:18.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.224+0000 7fc4559f5640 1 -- 172.21.15.87:0/1814973574 learned_addr learned my addr 172.21.15.87:0/1814973574 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:18.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.224+0000 7fc4559f5640 1 --2- 172.21.15.87:0/1814973574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564406b82790 0x564406b94760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.224+0000 7fc4561f6640 1 --2- 172.21.15.87:0/1814973574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564406b830b0 0x564406b90bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.224+0000 7fc4559f5640 1 -- 172.21.15.87:0/1814973574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564406b830b0 msgr2=0x564406b90bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:18.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.224+0000 7fc4559f5640 1 --2- 172.21.15.87:0/1814973574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564406b830b0 0x564406b90bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.224+0000 7fc4559f5640 1 -- 172.21.15.87:0/1814973574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564406b82790 msgr2=0x564406b94760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:18.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.224+0000 7fc4559f5640 1 --2- 172.21.15.87:0/1814973574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564406b82790 0x564406b94760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.224+0000 7fc4559f5640 1 -- 172.21.15.87:0/1814973574 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564406ae43c0 con 0x564406b8d950 2024-09-13T17:19:18.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.224+0000 7fc4559f5640 1 --2- 172.21.15.87:0/1814973574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564406b8d950 0x564406b910f0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fc44c013da0 tx=0x7fc44c013e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd06167ec18347f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:18.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.224+0000 7fc439ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:19:18.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.224+0000 7fc439ffb640 1 -- 172.21.15.87:0/1814973574 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c00ce10 con 0x564406b8d950 2024-09-13T17:19:18.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.224+0000 7fc439ffb640 1 -- 172.21.15.87:0/1814973574 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fc44c000e40 con 0x564406b8d950 2024-09-13T17:19:18.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.224+0000 7fc45b259740 1 -- 172.21.15.87:0/1814973574 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc444040070 con 0x564406b8d950 2024-09-13T17:19:18.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.225+0000 7fc439ffb640 1 -- 172.21.15.87:0/1814973574 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc44c004240 con 0x564406b8d950 2024-09-13T17:19:18.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.225+0000 7fc45b259740 10 client.17067 fetch_fsmap learned FSMap version 32 2024-09-13T17:19:18.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.225+0000 7fc45b259740 1 -- 172.21.15.87:0/1814973574 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x564406aabe80 con 0x564406b8d950 2024-09-13T17:19:18.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.225+0000 7fc439ffb640 1 -- 172.21.15.87:0/1814973574 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc44c044020 con 0x564406b8d950 2024-09-13T17:19:18.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.225+0000 7fc439ffb640 1 -- 172.21.15.87:0/1814973574 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 32) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fc44c003cd0 con 0x564406b8d950 2024-09-13T17:19:18.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.225+0000 7fc45b259740 10 client.17067 fetch_fsmap finished waiting for FSMap version 32 2024-09-13T17:19:18.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.225+0000 7fc45b259740 10 client.17067 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:19:18.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.225+0000 7fc45b259740 20 client.17067 populate_metadata read hostname 'smithi087' 2024-09-13T17:19:18.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.225+0000 7fc45b259740 1 --2- 172.21.15.87:0/1814973574 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x564406bf4770 0x564406bf6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.225+0000 7fc45b259740 4 client.17067 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:19:18.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.225+0000 7fc45b259740 1 -- 172.21.15.87:0/1814973574 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5644067d94e0 con 0x564406bf4770 2024-09-13T17:19:18.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.225+0000 7fc4561f6640 1 --2- 172.21.15.87:0/1814973574 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x564406bf4770 0x564406bf6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.226+0000 7fc439ffb640 10 client.17067 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:19:18.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.226+0000 7fc4561f6640 1 --2- 172.21.15.87:0/1814973574 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x564406bf4770 0x564406bf6b60 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c197796378ea16ae server_cookie=acce60118ed37801 in_seq=0 out_seq=0 2024-09-13T17:19:18.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.226+0000 7fc439ffb640 1 -- 172.21.15.87:0/1814973574 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5644067d94e0 con 0x564406bf4770 2024-09-13T17:19:18.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.226+0000 7fc439ffb640 10 client.17067 handle_command_reply: tid=0 2024-09-13T17:19:18.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.226+0000 7fc45b259740 1 client.17067 shutdown 2024-09-13T17:19:18.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.226+0000 7fc45b259740 1 -- 172.21.15.87:0/1814973574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564406b8d950 msgr2=0x564406b910f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:18.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.226+0000 7fc45b259740 1 --2- 172.21.15.87:0/1814973574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564406b8d950 0x564406b910f0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fc44c013da0 tx=0x7fc44c013e40 comp rx=0 tx=0).stop 2024-09-13T17:19:18.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.226+0000 7fc45b259740 1 -- 172.21.15.87:0/1814973574 shutdown_connections 2024-09-13T17:19:18.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.226+0000 7fc45b259740 1 --2- 172.21.15.87:0/1814973574 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x564406bf4770 0x564406bf6b60 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.226+0000 7fc45b259740 1 --2- 172.21.15.87:0/1814973574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564406b8d950 0x564406b910f0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.226+0000 7fc439ffb640 0 client.17067 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:19:18.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.226+0000 7fc45b259740 1 --2- 172.21.15.87:0/1814973574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564406b830b0 0x564406b90bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.226+0000 7fc45b259740 1 --2- 172.21.15.87:0/1814973574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564406b82790 0x564406b94760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.226+0000 7fc45b259740 1 -- 172.21.15.87:0/1814973574 >> 172.21.15.87:0/1814973574 conn(0x564406b7ed00 msgr2=0x564406b8a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:18.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.226+0000 7fc45b259740 1 -- 172.21.15.87:0/1814973574 shutdown_connections 2024-09-13T17:19:18.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.226+0000 7fc45b259740 1 -- 172.21.15.87:0/1814973574 wait complete. 2024-09-13T17:19:18.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.226+0000 7fc45b259740 20 client.17067 trim_cache size 0 max 16384 2024-09-13T17:19:18.240 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:19:18.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.227+0000 7fc45845a640 1 -- 172.21.15.87:0/2513909123 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc43c0a1200 msgr2=0x7fc43c0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:18.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.227+0000 7fc45845a640 1 --2- 172.21.15.87:0/2513909123 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc43c0a1200 0x7fc43c0a36c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc448096800 tx=0x7fc448000f40 comp rx=0 tx=0).stop 2024-09-13T17:19:18.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.227+0000 7fc45845a640 1 -- 172.21.15.87:0/2513909123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc450073230 msgr2=0x7fc4501a45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:18.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.227+0000 7fc45845a640 1 --2- 172.21.15.87:0/2513909123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc450073230 0x7fc4501a45c0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fc44800cad0 tx=0x7fc44800cf90 comp rx=0 tx=0).stop 2024-09-13T17:19:18.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.227+0000 7fc45845a640 1 -- 172.21.15.87:0/2513909123 shutdown_connections 2024-09-13T17:19:18.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.227+0000 7fc45845a640 1 --2- 172.21.15.87:0/2513909123 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc43c0a1200 0x7fc43c0a36c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.227+0000 7fc45845a640 1 --2- 172.21.15.87:0/2513909123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc450073230 0x7fc4501a45c0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.227+0000 7fc45845a640 1 --2- 172.21.15.87:0/2513909123 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4501050a0 0x7fc450072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.227+0000 7fc45845a640 1 --2- 172.21.15.87:0/2513909123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4500fff50 0x7fc4500727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.227+0000 7fc45845a640 1 -- 172.21.15.87:0/2513909123 >> 172.21.15.87:0/2513909123 conn(0x7fc4500fb9e0 msgr2=0x7fc4500fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:18.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.227+0000 7fc45845a640 1 -- 172.21.15.87:0/2513909123 shutdown_connections 2024-09-13T17:19:18.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.227+0000 7fc45845a640 1 -- 172.21.15.87:0/2513909123 wait complete. 2024-09-13T17:19:18.242 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-09-13T17:19:18.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.342+0000 7ffb5717d640 1 -- 172.21.15.87:0/3148980047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb50073200 msgr2=0x7ffb5010c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:18.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.342+0000 7ffb5717d640 1 --2- 172.21.15.87:0/3148980047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb50073200 0x7ffb5010c020 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7ffb40009900 tx=0x7ffb4002a480 comp rx=0 tx=0).stop 2024-09-13T17:19:18.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.342+0000 7ffb5717d640 1 -- 172.21.15.87:0/3148980047 shutdown_connections 2024-09-13T17:19:18.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.342+0000 7ffb5717d640 1 --2- 172.21.15.87:0/3148980047 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb5010c560 0x7ffb5010e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.342+0000 7ffb5717d640 1 --2- 172.21.15.87:0/3148980047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb50073200 0x7ffb5010c020 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.342+0000 7ffb5717d640 1 --2- 172.21.15.87:0/3148980047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb500728e0 0x7ffb50072cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.342+0000 7ffb5717d640 1 -- 172.21.15.87:0/3148980047 >> 172.21.15.87:0/3148980047 conn(0x7ffb500fba20 msgr2=0x7ffb500fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:18.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.342+0000 7ffb5717d640 1 -- 172.21.15.87:0/3148980047 shutdown_connections 2024-09-13T17:19:18.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.342+0000 7ffb5717d640 1 -- 172.21.15.87:0/3148980047 wait complete. 2024-09-13T17:19:18.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.343+0000 7ffb5717d640 1 Processor -- start 2024-09-13T17:19:18.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.343+0000 7ffb5717d640 1 -- start start 2024-09-13T17:19:18.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.343+0000 7ffb5717d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb500728e0 0x7ffb50198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.343+0000 7ffb5717d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb50073200 0x7ffb50198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.343+0000 7ffb5717d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb5010c560 0x7ffb5019ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.343+0000 7ffb5717d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5019d490 con 0x7ffb50073200 2024-09-13T17:19:18.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.343+0000 7ffb5717d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5019d600 con 0x7ffb5010c560 2024-09-13T17:19:18.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.343+0000 7ffb5717d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5019d7c0 con 0x7ffb500728e0 2024-09-13T17:19:18.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.343+0000 7ffb47fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb50073200 0x7ffb50198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.343+0000 7ffb47fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb50073200 0x7ffb50198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48238/0 (socket says 172.21.15.87:48238) 2024-09-13T17:19:18.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.343+0000 7ffb47fff640 1 -- 172.21.15.87:0/3672043764 learned_addr learned my addr 172.21.15.87:0/3672043764 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:18.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.343+0000 7ffb5571a640 1 --2- 172.21.15.87:0/3672043764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb5010c560 0x7ffb5019ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.343+0000 7ffb54f19640 1 --2- 172.21.15.87:0/3672043764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb500728e0 0x7ffb50198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.343+0000 7ffb47fff640 1 -- 172.21.15.87:0/3672043764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb500728e0 msgr2=0x7ffb50198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:18.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.343+0000 7ffb47fff640 1 --2- 172.21.15.87:0/3672043764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb500728e0 0x7ffb50198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.343+0000 7ffb47fff640 1 -- 172.21.15.87:0/3672043764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb5010c560 msgr2=0x7ffb5019ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:18.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.343+0000 7ffb47fff640 1 --2- 172.21.15.87:0/3672043764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb5010c560 0x7ffb5019ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.344+0000 7ffb47fff640 1 -- 172.21.15.87:0/3672043764 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb40009560 con 0x7ffb50073200 2024-09-13T17:19:18.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.344+0000 7ffb54f19640 1 --2- 172.21.15.87:0/3672043764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb500728e0 0x7ffb50198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:18.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.344+0000 7ffb5571a640 1 --2- 172.21.15.87:0/3672043764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb5010c560 0x7ffb5019ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:18.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.344+0000 7ffb47fff640 1 --2- 172.21.15.87:0/3672043764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb50073200 0x7ffb50198aa0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7ffb4002aa70 tx=0x7ffb400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:18.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.344+0000 7ffb45ffb640 1 -- 172.21.15.87:0/3672043764 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb40003a00 con 0x7ffb50073200 2024-09-13T17:19:18.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.344+0000 7ffb45ffb640 1 -- 172.21.15.87:0/3672043764 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffb400044e0 con 0x7ffb50073200 2024-09-13T17:19:18.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.344+0000 7ffb45ffb640 1 -- 172.21.15.87:0/3672043764 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4003a3c0 con 0x7ffb50073200 2024-09-13T17:19:18.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.344+0000 7ffb5717d640 1 -- 172.21.15.87:0/3672043764 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb5019da40 con 0x7ffb50073200 2024-09-13T17:19:18.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.344+0000 7ffb5717d640 1 -- 172.21.15.87:0/3672043764 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb501a5140 con 0x7ffb50073200 2024-09-13T17:19:18.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.346+0000 7ffb45ffb640 1 -- 172.21.15.87:0/3672043764 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7ffb4003b460 con 0x7ffb50073200 2024-09-13T17:19:18.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.346+0000 7ffb59e9e740 1 Processor -- start 2024-09-13T17:19:18.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.347+0000 7ffb59e9e740 1 -- start start 2024-09-13T17:19:18.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.347+0000 7ffb59e9e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d4f9cba790 0x55d4f9cbab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.347+0000 7ffb59e9e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d4f9cbb0b0 0x55d4f9cc5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.347+0000 7ffb59e9e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d4f9cc5950 0x55d4f9cc7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.347+0000 7ffb59e9e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4f9c24cc0 con 0x55d4f9cba790 2024-09-13T17:19:18.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.347+0000 7ffb59e9e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4f9c22450 con 0x55d4f9cbb0b0 2024-09-13T17:19:18.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.347+0000 7ffb59e9e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4f9c1dd40 con 0x55d4f9cc5950 2024-09-13T17:19:18.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.347+0000 7ffb5571a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d4f9cba790 0x55d4f9cbab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.347+0000 7ffb45ffb640 1 --2- 172.21.15.87:0/3672043764 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ffb380a1200 0x7ffb380a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.347+0000 7ffb5571a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d4f9cba790 0x55d4f9cbab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48244/0 (socket says 172.21.15.87:48244) 2024-09-13T17:19:18.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.347+0000 7ffb5571a640 1 -- 172.21.15.87:0/3325605321 learned_addr learned my addr 172.21.15.87:0/3325605321 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:18.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.347+0000 7ffb47fff640 1 --2- 172.21.15.87:0/3325605321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d4f9cc5950 0x55d4f9cc7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.347+0000 7ffb54f19640 1 --2- 172.21.15.87:0/3325605321 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d4f9cbb0b0 0x55d4f9cc5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.347+0000 7ffb5571a640 1 --2- 172.21.15.87:0/3672043764 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ffb380a1200 0x7ffb380a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.347+0000 7ffb45ffb640 1 -- 172.21.15.87:0/3672043764 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7ffb400ede00 con 0x7ffb50073200 2024-09-13T17:19:18.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.347+0000 7ffb5571a640 1 -- 172.21.15.87:0/3325605321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d4f9cc5950 msgr2=0x55d4f9cc7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:18.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.347+0000 7ffb5571a640 1 --2- 172.21.15.87:0/3325605321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d4f9cc5950 0x55d4f9cc7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.347+0000 7ffb5571a640 1 -- 172.21.15.87:0/3325605321 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d4f9cbb0b0 msgr2=0x55d4f9cc5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:18.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.347+0000 7ffb5571a640 1 --2- 172.21.15.87:0/3325605321 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d4f9cbb0b0 0x55d4f9cc5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.347+0000 7ffb5571a640 1 -- 172.21.15.87:0/3325605321 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4f9be5620 con 0x55d4f9cba790 2024-09-13T17:19:18.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.347+0000 7ffb54f19640 1 --2- 172.21.15.87:0/3325605321 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d4f9cbb0b0 0x55d4f9cc5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:18.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.347+0000 7ffb5571a640 1 --2- 172.21.15.87:0/3325605321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d4f9cba790 0x55d4f9cbab70 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7ffb480149a0 tx=0x7ffb48014e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f6c251eec41f9d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:18.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.348+0000 7ffb36ffd640 1 -- 172.21.15.87:0/3325605321 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4801ce90 con 0x55d4f9cba790 2024-09-13T17:19:18.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.348+0000 7ffb36ffd640 1 -- 172.21.15.87:0/3325605321 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffb48013460 con 0x55d4f9cba790 2024-09-13T17:19:18.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.348+0000 7ffb36ffd640 1 -- 172.21.15.87:0/3325605321 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4800f5f0 con 0x55d4f9cba790 2024-09-13T17:19:18.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.348+0000 7ffb59e9e740 1 -- 172.21.15.87:0/3325605321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d4f9cba790 msgr2=0x55d4f9cbab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:18.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.348+0000 7ffb5571a640 1 --2- 172.21.15.87:0/3672043764 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ffb380a1200 0x7ffb380a36c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ffb4801e000 tx=0x7ffb48019000 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:18.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.348+0000 7ffb59e9e740 1 --2- 172.21.15.87:0/3325605321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d4f9cba790 0x55d4f9cbab70 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7ffb480149a0 tx=0x7ffb48014e60 comp rx=0 tx=0).stop 2024-09-13T17:19:18.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.348+0000 7ffb59e9e740 1 -- 172.21.15.87:0/3325605321 shutdown_connections 2024-09-13T17:19:18.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.348+0000 7ffb59e9e740 1 --2- 172.21.15.87:0/3325605321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d4f9cc5950 0x55d4f9cc7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.348+0000 7ffb59e9e740 1 --2- 172.21.15.87:0/3325605321 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d4f9cbb0b0 0x55d4f9cc5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.348+0000 7ffb59e9e740 1 --2- 172.21.15.87:0/3325605321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d4f9cba790 0x55d4f9cbab70 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.348+0000 7ffb59e9e740 1 -- 172.21.15.87:0/3325605321 >> 172.21.15.87:0/3325605321 conn(0x55d4f9cb6d00 msgr2=0x55d4f9cb70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:18.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.348+0000 7ffb59e9e740 1 -- 172.21.15.87:0/3325605321 shutdown_connections 2024-09-13T17:19:18.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.348+0000 7ffb59e9e740 1 -- 172.21.15.87:0/3325605321 wait complete. 2024-09-13T17:19:18.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.349+0000 7ffb59e9e740 1 -- start start 2024-09-13T17:19:18.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.349+0000 7ffb59e9e740 1 Processor -- start 2024-09-13T17:19:18.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.349+0000 7ffb59e9e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d4f9cba790 0x55d4f9cc4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.349+0000 7ffb59e9e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d4f9cbb0b0 0x55d4f9cc2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.349+0000 7ffb59e9e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d4f9cc5950 0x55d4f9cc27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.349+0000 7ffb59e9e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4f9bdc180 con 0x55d4f9cbb0b0 2024-09-13T17:19:18.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.349+0000 7ffb59e9e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4f98f6430 con 0x55d4f9cba790 2024-09-13T17:19:18.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.349+0000 7ffb59e9e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4f9ba15e0 con 0x55d4f9cc5950 2024-09-13T17:19:18.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.349+0000 7ffb59e9e740 10 client.0 _ll_register_callbacks cb 0x55d4f9c0daa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:18.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.349+0000 7ffb47fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d4f9cbb0b0 0x55d4f9cc2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.349+0000 7ffb47fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d4f9cbb0b0 0x55d4f9cc2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48250/0 (socket says 172.21.15.87:48250) 2024-09-13T17:19:18.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.349+0000 7ffb47fff640 1 -- 172.21.15.87:0/3342582475 learned_addr learned my addr 172.21.15.87:0/3342582475 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:18.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.349+0000 7ffb5571a640 1 --2- 172.21.15.87:0/3342582475 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d4f9cc5950 0x55d4f9cc27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.350+0000 7ffb47fff640 1 -- 172.21.15.87:0/3342582475 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d4f9cc5950 msgr2=0x55d4f9cc27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:18.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.350+0000 7ffb47fff640 1 --2- 172.21.15.87:0/3342582475 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d4f9cc5950 0x55d4f9cc27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.350+0000 7ffb47fff640 1 -- 172.21.15.87:0/3342582475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d4f9cba790 msgr2=0x55d4f9cc4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:18.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.350+0000 7ffb47fff640 1 --2- 172.21.15.87:0/3342582475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d4f9cba790 0x55d4f9cc4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.350+0000 7ffb47fff640 1 -- 172.21.15.87:0/3342582475 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb48014550 con 0x55d4f9cbb0b0 2024-09-13T17:19:18.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.350+0000 7ffb47fff640 1 --2- 172.21.15.87:0/3342582475 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d4f9cbb0b0 0x55d4f9cc2280 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7ffb400ba860 tx=0x7ffb4008aae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7132c31432815c23 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:18.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.350+0000 7ffb2ffff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:19:18.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.350+0000 7ffb2ffff640 1 -- 172.21.15.87:0/3342582475 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb400be990 con 0x55d4f9cbb0b0 2024-09-13T17:19:18.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.350+0000 7ffb2ffff640 1 -- 172.21.15.87:0/3342582475 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7ffb400c2fe0 con 0x55d4f9cbb0b0 2024-09-13T17:19:18.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.350+0000 7ffb59e9e740 1 -- 172.21.15.87:0/3342582475 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d4f9c47b80 con 0x55d4f9cbb0b0 2024-09-13T17:19:18.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.350+0000 7ffb2ffff640 1 -- 172.21.15.87:0/3342582475 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb400eb420 con 0x55d4f9cbb0b0 2024-09-13T17:19:18.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.350+0000 7ffb59e9e740 10 client.17079 fetch_fsmap learned FSMap version 32 2024-09-13T17:19:18.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.350+0000 7ffb59e9e740 1 -- 172.21.15.87:0/3342582475 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55d4f9c1c3c0 con 0x55d4f9cbb0b0 2024-09-13T17:19:18.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.350+0000 7ffb2ffff640 1 -- 172.21.15.87:0/3342582475 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55d4f9c47b80 con 0x55d4f9cbb0b0 2024-09-13T17:19:18.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.350+0000 7ffb2ffff640 1 -- 172.21.15.87:0/3342582475 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 32) v1 ==== 7486+0+0 (secure 0 0 0) 0x7ffb400ba0e0 con 0x55d4f9cbb0b0 2024-09-13T17:19:18.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.350+0000 7ffb59e9e740 10 client.17079 fetch_fsmap finished waiting for FSMap version 32 2024-09-13T17:19:18.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.350+0000 7ffb59e9e740 10 client.17079 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:19:18.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.350+0000 7ffb59e9e740 20 client.17079 populate_metadata read hostname 'smithi087' 2024-09-13T17:19:18.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.350+0000 7ffb59e9e740 1 --2- 172.21.15.87:0/3342582475 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55d4f9cd4df0 0x55d4f9cd71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.350+0000 7ffb59e9e740 4 client.17079 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:19:18.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.350+0000 7ffb59e9e740 1 -- 172.21.15.87:0/3342582475 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d4f9c101f0 con 0x55d4f9cd4df0 2024-09-13T17:19:18.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.351+0000 7ffb54f19640 1 --2- 172.21.15.87:0/3342582475 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55d4f9cd4df0 0x55d4f9cd71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.351+0000 7ffb54f19640 1 --2- 172.21.15.87:0/3342582475 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55d4f9cd4df0 0x55d4f9cd71e0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=417ad037c60de04e server_cookie=1701654add3d01ee in_seq=0 out_seq=0 2024-09-13T17:19:18.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.351+0000 7ffb2ffff640 10 client.17079 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:19:18.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.352+0000 7ffb2ffff640 1 -- 172.21.15.87:0/3342582475 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55d4f9c101f0 con 0x55d4f9cd4df0 2024-09-13T17:19:18.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.352+0000 7ffb2ffff640 10 client.17079 handle_command_reply: tid=0 2024-09-13T17:19:18.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.352+0000 7ffb59e9e740 1 client.17079 shutdown 2024-09-13T17:19:18.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.352+0000 7ffb59e9e740 1 -- 172.21.15.87:0/3342582475 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d4f9cbb0b0 msgr2=0x55d4f9cc2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:18.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.352+0000 7ffb59e9e740 1 --2- 172.21.15.87:0/3342582475 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d4f9cbb0b0 0x55d4f9cc2280 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7ffb400ba860 tx=0x7ffb4008aae0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.352+0000 7ffb59e9e740 1 -- 172.21.15.87:0/3342582475 shutdown_connections 2024-09-13T17:19:18.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.352+0000 7ffb59e9e740 1 --2- 172.21.15.87:0/3342582475 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55d4f9cd4df0 0x55d4f9cd71e0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.352+0000 7ffb59e9e740 1 --2- 172.21.15.87:0/3342582475 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d4f9cc5950 0x55d4f9cc27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.352+0000 7ffb59e9e740 1 --2- 172.21.15.87:0/3342582475 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d4f9cbb0b0 0x55d4f9cc2280 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.352+0000 7ffb2ffff640 0 client.17079 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:19:18.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.352+0000 7ffb59e9e740 1 --2- 172.21.15.87:0/3342582475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d4f9cba790 0x55d4f9cc4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.352+0000 7ffb59e9e740 1 -- 172.21.15.87:0/3342582475 >> 172.21.15.87:0/3342582475 conn(0x55d4f9cb6d00 msgr2=0x55d4f9cbca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:18.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.352+0000 7ffb59e9e740 1 -- 172.21.15.87:0/3342582475 shutdown_connections 2024-09-13T17:19:18.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.352+0000 7ffb59e9e740 1 -- 172.21.15.87:0/3342582475 wait complete. 2024-09-13T17:19:18.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.352+0000 7ffb59e9e740 20 client.17079 trim_cache size 0 max 16384 2024-09-13T17:19:18.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.363+0000 7ffb59e9e740 1 Processor -- start 2024-09-13T17:19:18.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.363+0000 7ffb59e9e740 1 -- start start 2024-09-13T17:19:18.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.363+0000 7ffb59e9e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d4f9cba790 0x55d4f9cb66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.363+0000 7ffb59e9e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d4f9cbb0b0 0x55d4f9ccc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.363+0000 7ffb59e9e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d4f9cc5950 0x55d4f9cccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.363+0000 7ffb59e9e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4f9cbaea0 con 0x55d4f9cbb0b0 2024-09-13T17:19:18.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.363+0000 7ffb59e9e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4f9cb2440 con 0x55d4f9cba790 2024-09-13T17:19:18.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.363+0000 7ffb59e9e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4f9cd18f0 con 0x55d4f9cc5950 2024-09-13T17:19:18.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.363+0000 7ffb47fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d4f9cbb0b0 0x55d4f9ccc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.363+0000 7ffb47fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d4f9cbb0b0 0x55d4f9ccc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48264/0 (socket says 172.21.15.87:48264) 2024-09-13T17:19:18.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.363+0000 7ffb47fff640 1 -- 172.21.15.87:0/3704135983 learned_addr learned my addr 172.21.15.87:0/3704135983 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:18.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.363+0000 7ffb54f19640 1 --2- 172.21.15.87:0/3704135983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d4f9cba790 0x55d4f9cb66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.363+0000 7ffb47fff640 1 -- 172.21.15.87:0/3704135983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d4f9cc5950 msgr2=0x55d4f9cccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:18.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.363+0000 7ffb47fff640 1 --2- 172.21.15.87:0/3704135983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d4f9cc5950 0x55d4f9cccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.363+0000 7ffb47fff640 1 -- 172.21.15.87:0/3704135983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d4f9cba790 msgr2=0x55d4f9cb66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:18.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.363+0000 7ffb47fff640 1 --2- 172.21.15.87:0/3704135983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d4f9cba790 0x55d4f9cb66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.363+0000 7ffb47fff640 1 -- 172.21.15.87:0/3704135983 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4f9bbe770 con 0x55d4f9cbb0b0 2024-09-13T17:19:18.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.363+0000 7ffb47fff640 1 --2- 172.21.15.87:0/3704135983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d4f9cbb0b0 0x55d4f9ccc610 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7ffb40004650 tx=0x7ffb40009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b19bd1ae136ce70 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:18.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.364+0000 7ffb377fe640 1 -- 172.21.15.87:0/3704135983 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4003f070 con 0x55d4f9cbb0b0 2024-09-13T17:19:18.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.364+0000 7ffb377fe640 1 -- 172.21.15.87:0/3704135983 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffb400c2bf0 con 0x55d4f9cbb0b0 2024-09-13T17:19:18.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.364+0000 7ffb377fe640 1 -- 172.21.15.87:0/3704135983 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb400b7270 con 0x55d4f9cbb0b0 2024-09-13T17:19:18.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.364+0000 7ffb59e9e740 1 -- 172.21.15.87:0/3704135983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d4f9cbb0b0 msgr2=0x55d4f9ccc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:18.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.364+0000 7ffb59e9e740 1 --2- 172.21.15.87:0/3704135983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d4f9cbb0b0 0x55d4f9ccc610 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7ffb40004650 tx=0x7ffb40009260 comp rx=0 tx=0).stop 2024-09-13T17:19:18.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.364+0000 7ffb59e9e740 1 -- 172.21.15.87:0/3704135983 shutdown_connections 2024-09-13T17:19:18.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.364+0000 7ffb59e9e740 1 --2- 172.21.15.87:0/3704135983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d4f9cc5950 0x55d4f9cccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.364+0000 7ffb59e9e740 1 --2- 172.21.15.87:0/3704135983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d4f9cbb0b0 0x55d4f9ccc610 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.364+0000 7ffb59e9e740 1 --2- 172.21.15.87:0/3704135983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d4f9cba790 0x55d4f9cb66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.364+0000 7ffb59e9e740 1 -- 172.21.15.87:0/3704135983 >> 172.21.15.87:0/3704135983 conn(0x55d4f9cb6d00 msgr2=0x55d4f9cc0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:18.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.364+0000 7ffb59e9e740 1 -- 172.21.15.87:0/3704135983 shutdown_connections 2024-09-13T17:19:18.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.364+0000 7ffb59e9e740 1 -- 172.21.15.87:0/3704135983 wait complete. 2024-09-13T17:19:18.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.364+0000 7ffb59e9e740 1 -- start start 2024-09-13T17:19:18.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.365+0000 7ffb59e9e740 1 Processor -- start 2024-09-13T17:19:18.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.365+0000 7ffb59e9e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d4f9cba790 0x55d4f9cbf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.365+0000 7ffb59e9e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d4f9cbb0b0 0x55d4f9cbf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.365+0000 7ffb59e9e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d4f9cc5950 0x55d4f9cbfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.365+0000 7ffb59e9e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4f9d2b2a0 con 0x55d4f9cba790 2024-09-13T17:19:18.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.365+0000 7ffb59e9e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4f9d2b3e0 con 0x55d4f9cbb0b0 2024-09-13T17:19:18.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.365+0000 7ffb59e9e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4f9d2b520 con 0x55d4f9cc5950 2024-09-13T17:19:18.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.365+0000 7ffb59e9e740 10 client.0 _ll_register_callbacks cb 0x7ffb48008660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:18.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.365+0000 7ffb54f19640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d4f9cba790 0x55d4f9cbf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.365+0000 7ffb54f19640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d4f9cba790 0x55d4f9cbf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48278/0 (socket says 172.21.15.87:48278) 2024-09-13T17:19:18.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.365+0000 7ffb54f19640 1 -- 172.21.15.87:0/4008299345 learned_addr learned my addr 172.21.15.87:0/4008299345 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:18.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.365+0000 7ffb47fff640 1 --2- 172.21.15.87:0/4008299345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d4f9cbb0b0 0x55d4f9cbf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.365+0000 7ffb5571a640 1 --2- 172.21.15.87:0/4008299345 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d4f9cc5950 0x55d4f9cbfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.365+0000 7ffb54f19640 1 -- 172.21.15.87:0/4008299345 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d4f9cc5950 msgr2=0x55d4f9cbfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:18.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.365+0000 7ffb54f19640 1 --2- 172.21.15.87:0/4008299345 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d4f9cc5950 0x55d4f9cbfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.365+0000 7ffb54f19640 1 -- 172.21.15.87:0/4008299345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d4f9cbb0b0 msgr2=0x55d4f9cbf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:18.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.365+0000 7ffb54f19640 1 --2- 172.21.15.87:0/4008299345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d4f9cbb0b0 0x55d4f9cbf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.365+0000 7ffb54f19640 1 -- 172.21.15.87:0/4008299345 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d4f9c1c3c0 con 0x55d4f9cba790 2024-09-13T17:19:18.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.365+0000 7ffb5571a640 1 --2- 172.21.15.87:0/4008299345 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d4f9cc5950 0x55d4f9cbfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:18.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.365+0000 7ffb54f19640 1 --2- 172.21.15.87:0/4008299345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d4f9cba790 0x55d4f9cbf050 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c009ba0 tx=0x7ffb4c018ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f303223cdb51bb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:18.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.365+0000 7ffb2ffff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:19:18.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.366+0000 7ffb2ffff640 1 -- 172.21.15.87:0/4008299345 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c014ac0 con 0x55d4f9cba790 2024-09-13T17:19:18.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.366+0000 7ffb2ffff640 1 -- 172.21.15.87:0/4008299345 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7ffb4c014c20 con 0x55d4f9cba790 2024-09-13T17:19:18.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.366+0000 7ffb59e9e740 1 -- 172.21.15.87:0/4008299345 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffb48013460 con 0x55d4f9cba790 2024-09-13T17:19:18.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.366+0000 7ffb2ffff640 1 -- 172.21.15.87:0/4008299345 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb4c014de0 con 0x55d4f9cba790 2024-09-13T17:19:18.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.366+0000 7ffb59e9e740 10 client.17085 fetch_fsmap learned FSMap version 32 2024-09-13T17:19:18.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.366+0000 7ffb59e9e740 1 -- 172.21.15.87:0/4008299345 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55d4f9be3e80 con 0x55d4f9cba790 2024-09-13T17:19:18.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.366+0000 7ffb2ffff640 1 -- 172.21.15.87:0/4008299345 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffb48013460 con 0x55d4f9cba790 2024-09-13T17:19:18.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.366+0000 7ffb2ffff640 1 -- 172.21.15.87:0/4008299345 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 32) v1 ==== 7486+0+0 (secure 0 0 0) 0x7ffb4c004c90 con 0x55d4f9cba790 2024-09-13T17:19:18.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.366+0000 7ffb59e9e740 10 client.17085 fetch_fsmap finished waiting for FSMap version 32 2024-09-13T17:19:18.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.366+0000 7ffb59e9e740 10 client.17085 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:19:18.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.366+0000 7ffb59e9e740 20 client.17085 populate_metadata read hostname 'smithi087' 2024-09-13T17:19:18.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.366+0000 7ffb59e9e740 1 --2- 172.21.15.87:0/4008299345 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55d4f9d2cd00 0x55d4f9d2f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.366+0000 7ffb59e9e740 4 client.17085 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:19:18.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.366+0000 7ffb59e9e740 1 -- 172.21.15.87:0/4008299345 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d4f99114e0 con 0x55d4f9d2cd00 2024-09-13T17:19:18.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.366+0000 7ffb47fff640 1 --2- 172.21.15.87:0/4008299345 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55d4f9d2cd00 0x55d4f9d2f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.367+0000 7ffb2ffff640 10 client.17085 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:19:18.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.367+0000 7ffb47fff640 1 --2- 172.21.15.87:0/4008299345 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55d4f9d2cd00 0x55d4f9d2f120 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=71c54be8d8e4383 server_cookie=ba9826024b7110d0 in_seq=0 out_seq=0 2024-09-13T17:19:18.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.367+0000 7ffb2ffff640 1 -- 172.21.15.87:0/4008299345 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d4f99114e0 con 0x55d4f9d2cd00 2024-09-13T17:19:18.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.367+0000 7ffb2ffff640 10 client.17085 handle_command_reply: tid=0 2024-09-13T17:19:18.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.367+0000 7ffb59e9e740 1 client.17085 shutdown 2024-09-13T17:19:18.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.367+0000 7ffb59e9e740 1 -- 172.21.15.87:0/4008299345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d4f9cba790 msgr2=0x55d4f9cbf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:18.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.367+0000 7ffb59e9e740 1 --2- 172.21.15.87:0/4008299345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d4f9cba790 0x55d4f9cbf050 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c009ba0 tx=0x7ffb4c018ed0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.367+0000 7ffb59e9e740 1 -- 172.21.15.87:0/4008299345 shutdown_connections 2024-09-13T17:19:18.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.367+0000 7ffb59e9e740 1 --2- 172.21.15.87:0/4008299345 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55d4f9d2cd00 0x55d4f9d2f120 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.367+0000 7ffb59e9e740 1 --2- 172.21.15.87:0/4008299345 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d4f9cc5950 0x55d4f9cbfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.367+0000 7ffb2ffff640 0 client.17085 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:19:18.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.367+0000 7ffb59e9e740 1 --2- 172.21.15.87:0/4008299345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d4f9cbb0b0 0x55d4f9cbf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.367+0000 7ffb59e9e740 1 --2- 172.21.15.87:0/4008299345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d4f9cba790 0x55d4f9cbf050 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.367+0000 7ffb59e9e740 1 -- 172.21.15.87:0/4008299345 >> 172.21.15.87:0/4008299345 conn(0x55d4f9cb6d00 msgr2=0x55d4f9cc38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:18.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.367+0000 7ffb59e9e740 1 -- 172.21.15.87:0/4008299345 shutdown_connections 2024-09-13T17:19:18.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.367+0000 7ffb59e9e740 1 -- 172.21.15.87:0/4008299345 wait complete. 2024-09-13T17:19:18.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.368+0000 7ffb59e9e740 20 client.17085 trim_cache size 0 max 16384 2024-09-13T17:19:18.375 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:19:18.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.368+0000 7ffb5717d640 1 -- 172.21.15.87:0/3672043764 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ffb380a1200 msgr2=0x7ffb380a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:18.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.368+0000 7ffb5717d640 1 --2- 172.21.15.87:0/3672043764 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ffb380a1200 0x7ffb380a36c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ffb4801e000 tx=0x7ffb48019000 comp rx=0 tx=0).stop 2024-09-13T17:19:18.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.368+0000 7ffb5717d640 1 -- 172.21.15.87:0/3672043764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb50073200 msgr2=0x7ffb50198aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:18.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.368+0000 7ffb5717d640 1 --2- 172.21.15.87:0/3672043764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb50073200 0x7ffb50198aa0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7ffb4002aa70 tx=0x7ffb400042f0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.368+0000 7ffb5717d640 1 -- 172.21.15.87:0/3672043764 shutdown_connections 2024-09-13T17:19:18.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.368+0000 7ffb5717d640 1 --2- 172.21.15.87:0/3672043764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb5010c560 0x7ffb5019ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.368+0000 7ffb5717d640 1 --2- 172.21.15.87:0/3672043764 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ffb380a1200 0x7ffb380a36c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.368+0000 7ffb5717d640 1 --2- 172.21.15.87:0/3672043764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb50073200 0x7ffb50198aa0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.368+0000 7ffb5717d640 1 --2- 172.21.15.87:0/3672043764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb500728e0 0x7ffb50198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.368+0000 7ffb5717d640 1 -- 172.21.15.87:0/3672043764 >> 172.21.15.87:0/3672043764 conn(0x7ffb500fba20 msgr2=0x7ffb500fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:18.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.368+0000 7ffb5717d640 1 -- 172.21.15.87:0/3672043764 shutdown_connections 2024-09-13T17:19:18.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.368+0000 7ffb5717d640 1 -- 172.21.15.87:0/3672043764 wait complete. 2024-09-13T17:19:18.380 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-09-13T17:19:18.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.479+0000 7f6552690640 1 -- 172.21.15.87:0/258445217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f654c0ff800 msgr2=0x7f654c103840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:18.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.479+0000 7f6552690640 1 --2- 172.21.15.87:0/258445217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f654c0ff800 0x7f654c103840 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f6534009930 tx=0x7f653402a420 comp rx=0 tx=0).stop 2024-09-13T17:19:18.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.479+0000 7f6552690640 1 -- 172.21.15.87:0/258445217 shutdown_connections 2024-09-13T17:19:18.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.479+0000 7f6552690640 1 --2- 172.21.15.87:0/258445217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f654c103fa0 0x7f654c10baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.479+0000 7f6552690640 1 --2- 172.21.15.87:0/258445217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f654c0ff800 0x7f654c103840 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.479+0000 7f6552690640 1 --2- 172.21.15.87:0/258445217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f654c0fee50 0x7f654c0ff230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.479+0000 7f6552690640 1 -- 172.21.15.87:0/258445217 >> 172.21.15.87:0/258445217 conn(0x7f654c0fa8e0 msgr2=0x7f654c0fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:18.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.479+0000 7f6552690640 1 -- 172.21.15.87:0/258445217 shutdown_connections 2024-09-13T17:19:18.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.479+0000 7f6552690640 1 -- 172.21.15.87:0/258445217 wait complete. 2024-09-13T17:19:18.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.479+0000 7f6552690640 1 Processor -- start 2024-09-13T17:19:18.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.479+0000 7f6552690640 1 -- start start 2024-09-13T17:19:18.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.480+0000 7f6552690640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f654c0fee50 0x7f654c1962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.480+0000 7f6552690640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f654c103fa0 0x7f654c1967e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.480+0000 7f6552690640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f654c19abd0 0x7f654c19b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.480+0000 7f6552690640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654c19b5c0 con 0x7f654c19abd0 2024-09-13T17:19:18.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.480+0000 7f6552690640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654c19b730 con 0x7f654c103fa0 2024-09-13T17:19:18.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.480+0000 7f6552690640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654c19b8a0 con 0x7f654c0fee50 2024-09-13T17:19:18.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.480+0000 7f6550c2d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f654c19abd0 0x7f654c19b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.480+0000 7f6550c2d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f654c19abd0 0x7f654c19b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48286/0 (socket says 172.21.15.87:48286) 2024-09-13T17:19:18.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.480+0000 7f6550c2d640 1 -- 172.21.15.87:0/2774484517 learned_addr learned my addr 172.21.15.87:0/2774484517 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:18.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.480+0000 7f654bfff640 1 --2- 172.21.15.87:0/2774484517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f654c0fee50 0x7f654c1962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.480+0000 7f654b7fe640 1 --2- 172.21.15.87:0/2774484517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f654c103fa0 0x7f654c1967e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.480+0000 7f6550c2d640 1 -- 172.21.15.87:0/2774484517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f654c0fee50 msgr2=0x7f654c1962a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:18.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.480+0000 7f6550c2d640 1 --2- 172.21.15.87:0/2774484517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f654c0fee50 0x7f654c1962a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.480+0000 7f6550c2d640 1 -- 172.21.15.87:0/2774484517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f654c103fa0 msgr2=0x7f654c1967e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:18.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.480+0000 7f6550c2d640 1 --2- 172.21.15.87:0/2774484517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f654c103fa0 0x7f654c1967e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.480+0000 7f6550c2d640 1 -- 172.21.15.87:0/2774484517 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6534009560 con 0x7f654c19abd0 2024-09-13T17:19:18.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.480+0000 7f654bfff640 1 --2- 172.21.15.87:0/2774484517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f654c0fee50 0x7f654c1962a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:18.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.480+0000 7f6550c2d640 1 --2- 172.21.15.87:0/2774484517 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f654c19abd0 0x7f654c19b080 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f6544009fd0 tx=0x7f654400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:18.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.480+0000 7f65497fa640 1 -- 172.21.15.87:0/2774484517 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654400bea0 con 0x7f654c19abd0 2024-09-13T17:19:18.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.480+0000 7f65497fa640 1 -- 172.21.15.87:0/2774484517 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6544009940 con 0x7f654c19abd0 2024-09-13T17:19:18.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.480+0000 7f6552690640 1 -- 172.21.15.87:0/2774484517 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f654c1a2e80 con 0x7f654c19abd0 2024-09-13T17:19:18.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.480+0000 7f65497fa640 1 -- 172.21.15.87:0/2774484517 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65440106c0 con 0x7f654c19abd0 2024-09-13T17:19:18.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.480+0000 7f6552690640 1 -- 172.21.15.87:0/2774484517 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f654c1a32b0 con 0x7f654c19abd0 2024-09-13T17:19:18.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.483+0000 7f65497fa640 1 -- 172.21.15.87:0/2774484517 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f6544003970 con 0x7f654c19abd0 2024-09-13T17:19:18.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.483+0000 7f655548c740 1 Processor -- start 2024-09-13T17:19:18.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.483+0000 7f655548c740 1 -- start start 2024-09-13T17:19:18.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.483+0000 7f655548c740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c54db9f790 0x55c54db9fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.483+0000 7f655548c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c54dba00b0 0x55c54dbaa410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.483+0000 7f655548c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c54dbaa950 0x55c54dbacd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.483+0000 7f655548c740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c54db09cc0 con 0x55c54dba00b0 2024-09-13T17:19:18.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.483+0000 7f655548c740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c54db07450 con 0x55c54db9f790 2024-09-13T17:19:18.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.483+0000 7f655548c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c54db02d40 con 0x55c54dbaa950 2024-09-13T17:19:18.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.483+0000 7f654bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c54dba00b0 0x55c54dbaa410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.483+0000 7f65497fa640 1 --2- 172.21.15.87:0/2774484517 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f65380a1200 0x7f65380a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.483+0000 7f654bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c54dba00b0 0x55c54dbaa410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48290/0 (socket says 172.21.15.87:48290) 2024-09-13T17:19:18.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.483+0000 7f654bfff640 1 -- 172.21.15.87:0/2277459877 learned_addr learned my addr 172.21.15.87:0/2277459877 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:18.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.483+0000 7f654b7fe640 1 --2- 172.21.15.87:0/2277459877 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c54db9f790 0x55c54db9fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.483+0000 7f6550c2d640 1 --2- 172.21.15.87:0/2774484517 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f65380a1200 0x7f65380a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.483+0000 7f654b7fe640 1 --2- 172.21.15.87:0/2277459877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c54dbaa950 0x55c54dbacd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.483+0000 7f654bfff640 1 -- 172.21.15.87:0/2277459877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c54dbaa950 msgr2=0x55c54dbacd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:18.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.483+0000 7f65497fa640 1 -- 172.21.15.87:0/2774484517 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f65440cce00 con 0x7f654c19abd0 2024-09-13T17:19:18.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.483+0000 7f654bfff640 1 --2- 172.21.15.87:0/2277459877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c54dbaa950 0x55c54dbacd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.483+0000 7f654bfff640 1 -- 172.21.15.87:0/2277459877 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c54db9f790 msgr2=0x55c54db9fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:18.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.483+0000 7f654bfff640 1 --2- 172.21.15.87:0/2277459877 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c54db9f790 0x55c54db9fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.483+0000 7f654bfff640 1 -- 172.21.15.87:0/2277459877 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c54daca620 con 0x55c54dba00b0 2024-09-13T17:19:18.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.484+0000 7f654b7fe640 1 --2- 172.21.15.87:0/2277459877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c54dbaa950 0x55c54dbacd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:18.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.484+0000 7f654bfff640 1 --2- 172.21.15.87:0/2277459877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c54dba00b0 0x55c54dbaa410 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f653c00bcc0 tx=0x7f653c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d7b6406c9daef54 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:18.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.484+0000 7f65427fc640 1 -- 172.21.15.87:0/2277459877 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653c005020 con 0x55c54dba00b0 2024-09-13T17:19:18.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.484+0000 7f6550c2d640 1 --2- 172.21.15.87:0/2774484517 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f65380a1200 0x7f65380a36c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f65440ca7a0 tx=0x7f654408f2b0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:18.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.484+0000 7f65427fc640 1 -- 172.21.15.87:0/2277459877 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f653c005630 con 0x55c54dba00b0 2024-09-13T17:19:18.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.484+0000 7f65427fc640 1 -- 172.21.15.87:0/2277459877 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653c011680 con 0x55c54dba00b0 2024-09-13T17:19:18.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.484+0000 7f655548c740 1 -- 172.21.15.87:0/2277459877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c54dba00b0 msgr2=0x55c54dbaa410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:18.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.484+0000 7f655548c740 1 --2- 172.21.15.87:0/2277459877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c54dba00b0 0x55c54dbaa410 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f653c00bcc0 tx=0x7f653c00f730 comp rx=0 tx=0).stop 2024-09-13T17:19:18.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.485+0000 7f655548c740 1 -- 172.21.15.87:0/2277459877 shutdown_connections 2024-09-13T17:19:18.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.485+0000 7f655548c740 1 --2- 172.21.15.87:0/2277459877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c54dbaa950 0x55c54dbacd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.485+0000 7f655548c740 1 --2- 172.21.15.87:0/2277459877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c54dba00b0 0x55c54dbaa410 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.485+0000 7f655548c740 1 --2- 172.21.15.87:0/2277459877 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c54db9f790 0x55c54db9fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.485+0000 7f655548c740 1 -- 172.21.15.87:0/2277459877 >> 172.21.15.87:0/2277459877 conn(0x55c54db9bd00 msgr2=0x55c54db9c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:18.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.485+0000 7f655548c740 1 -- 172.21.15.87:0/2277459877 shutdown_connections 2024-09-13T17:19:18.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.485+0000 7f655548c740 1 -- 172.21.15.87:0/2277459877 wait complete. 2024-09-13T17:19:18.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.485+0000 7f655548c740 1 -- start start 2024-09-13T17:19:18.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.485+0000 7f655548c740 1 Processor -- start 2024-09-13T17:19:18.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.485+0000 7f655548c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c54db9f790 0x55c54dba9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.485+0000 7f655548c740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c54dba00b0 0x55c54dba7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.485+0000 7f655548c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c54dbaa950 0x55c54dba7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.485+0000 7f655548c740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c54dac1180 con 0x55c54db9f790 2024-09-13T17:19:18.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.485+0000 7f655548c740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c54d7db430 con 0x55c54dba00b0 2024-09-13T17:19:18.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.485+0000 7f655548c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c54da865e0 con 0x55c54dbaa950 2024-09-13T17:19:18.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.485+0000 7f655548c740 10 client.0 _ll_register_callbacks cb 0x55c54daf2aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:18.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.485+0000 7f654b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c54db9f790 0x55c54dba9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.485+0000 7f654b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c54db9f790 0x55c54dba9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48294/0 (socket says 172.21.15.87:48294) 2024-09-13T17:19:18.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.486+0000 7f654b7fe640 1 -- 172.21.15.87:0/1234992251 learned_addr learned my addr 172.21.15.87:0/1234992251 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:18.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.486+0000 7f654b7fe640 1 --2- 172.21.15.87:0/1234992251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c54dbaa950 0x55c54dba7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.486+0000 7f654bfff640 1 --2- 172.21.15.87:0/1234992251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c54dba00b0 0x55c54dba7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.486+0000 7f654b7fe640 1 -- 172.21.15.87:0/1234992251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c54dbaa950 msgr2=0x55c54dba7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:18.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.486+0000 7f654b7fe640 1 --2- 172.21.15.87:0/1234992251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c54dbaa950 0x55c54dba7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.486+0000 7f654b7fe640 1 -- 172.21.15.87:0/1234992251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c54dba00b0 msgr2=0x55c54dba7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:18.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.486+0000 7f654b7fe640 1 --2- 172.21.15.87:0/1234992251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c54dba00b0 0x55c54dba7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.486+0000 7f654b7fe640 1 -- 172.21.15.87:0/1234992251 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f653c00b920 con 0x55c54db9f790 2024-09-13T17:19:18.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.486+0000 7f654b7fe640 1 --2- 172.21.15.87:0/1234992251 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c54db9f790 0x55c54dba9ee0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f65340057c0 tx=0x7f653402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a35c4232ee8daeda server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:18.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.486+0000 7f652b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:19:18.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.486+0000 7f652b7fe640 1 -- 172.21.15.87:0/1234992251 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6534031c30 con 0x55c54db9f790 2024-09-13T17:19:18.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.486+0000 7f652b7fe640 1 -- 172.21.15.87:0/1234992251 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f6534031d90 con 0x55c54db9f790 2024-09-13T17:19:18.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.486+0000 7f655548c740 1 -- 172.21.15.87:0/1234992251 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c54db2cb80 con 0x55c54db9f790 2024-09-13T17:19:18.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.486+0000 7f652b7fe640 1 -- 172.21.15.87:0/1234992251 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6534004500 con 0x55c54db9f790 2024-09-13T17:19:18.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.486+0000 7f655548c740 10 client.17097 fetch_fsmap learned FSMap version 32 2024-09-13T17:19:18.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.486+0000 7f655548c740 1 -- 172.21.15.87:0/1234992251 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55c54db013c0 con 0x55c54db9f790 2024-09-13T17:19:18.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.486+0000 7f652b7fe640 1 -- 172.21.15.87:0/1234992251 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55c54db2cb80 con 0x55c54db9f790 2024-09-13T17:19:18.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.486+0000 7f652b7fe640 1 -- 172.21.15.87:0/1234992251 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 32) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f6534032250 con 0x55c54db9f790 2024-09-13T17:19:18.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.487+0000 7f655548c740 10 client.17097 fetch_fsmap finished waiting for FSMap version 32 2024-09-13T17:19:18.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.487+0000 7f655548c740 10 client.17097 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:19:18.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.487+0000 7f655548c740 20 client.17097 populate_metadata read hostname 'smithi087' 2024-09-13T17:19:18.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.487+0000 7f655548c740 1 --2- 172.21.15.87:0/1234992251 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55c54dbba140 0x55c54dbbc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.487+0000 7f655548c740 4 client.17097 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:19:18.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.487+0000 7f655548c740 1 -- 172.21.15.87:0/1234992251 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c54daf51f0 con 0x55c54dbba140 2024-09-13T17:19:18.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.487+0000 7f654bfff640 1 --2- 172.21.15.87:0/1234992251 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55c54dbba140 0x55c54dbbc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.487+0000 7f652b7fe640 10 client.17097 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:18.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.487+0000 7f654bfff640 1 --2- 172.21.15.87:0/1234992251 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55c54dbba140 0x55c54dbbc560 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a887232fde1475ef server_cookie=e0b8378339abcd82 in_seq=0 out_seq=0 2024-09-13T17:19:18.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.488+0000 7f652b7fe640 1 -- 172.21.15.87:0/1234992251 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55c54daf51f0 con 0x55c54dbba140 2024-09-13T17:19:18.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.488+0000 7f652b7fe640 10 client.17097 handle_command_reply: tid=0 2024-09-13T17:19:18.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.488+0000 7f655548c740 1 client.17097 shutdown 2024-09-13T17:19:18.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.488+0000 7f655548c740 1 -- 172.21.15.87:0/1234992251 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c54db9f790 msgr2=0x55c54dba9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:18.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.488+0000 7f655548c740 1 --2- 172.21.15.87:0/1234992251 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c54db9f790 0x55c54dba9ee0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f65340057c0 tx=0x7f653402a420 comp rx=0 tx=0).stop 2024-09-13T17:19:18.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.488+0000 7f655548c740 1 -- 172.21.15.87:0/1234992251 shutdown_connections 2024-09-13T17:19:18.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.488+0000 7f655548c740 1 --2- 172.21.15.87:0/1234992251 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55c54dbba140 0x55c54dbbc560 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.488+0000 7f655548c740 1 --2- 172.21.15.87:0/1234992251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c54dbaa950 0x55c54dba7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.488+0000 7f655548c740 1 --2- 172.21.15.87:0/1234992251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c54dba00b0 0x55c54dba7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.488+0000 7f652b7fe640 0 client.17097 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:18.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.488+0000 7f655548c740 1 --2- 172.21.15.87:0/1234992251 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c54db9f790 0x55c54dba9ee0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.488+0000 7f655548c740 1 -- 172.21.15.87:0/1234992251 >> 172.21.15.87:0/1234992251 conn(0x55c54db9bd00 msgr2=0x55c54dba1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:18.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.488+0000 7f655548c740 1 -- 172.21.15.87:0/1234992251 shutdown_connections 2024-09-13T17:19:18.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.488+0000 7f655548c740 1 -- 172.21.15.87:0/1234992251 wait complete. 2024-09-13T17:19:18.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.488+0000 7f655548c740 20 client.17097 trim_cache size 0 max 16384 2024-09-13T17:19:18.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.499+0000 7f655548c740 1 Processor -- start 2024-09-13T17:19:18.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.499+0000 7f655548c740 1 -- start start 2024-09-13T17:19:18.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.499+0000 7f655548c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c54db9f790 0x55c54dba7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.499+0000 7f655548c740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c54dba00b0 0x55c54db9ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.499+0000 7f655548c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c54dbaa950 0x55c54dbb1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.499+0000 7f655548c740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c54db2cb80 con 0x55c54dbaa950 2024-09-13T17:19:18.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.499+0000 7f655548c740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c54db9f510 con 0x55c54dba00b0 2024-09-13T17:19:18.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.499+0000 7f655548c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c54dbb8a20 con 0x55c54db9f790 2024-09-13T17:19:18.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.499+0000 7f654b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c54dbaa950 0x55c54dbb1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.499+0000 7f654b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c54dbaa950 0x55c54dbb1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48302/0 (socket says 172.21.15.87:48302) 2024-09-13T17:19:18.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.499+0000 7f654b7fe640 1 -- 172.21.15.87:0/459590938 learned_addr learned my addr 172.21.15.87:0/459590938 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:18.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.499+0000 7f654b7fe640 1 -- 172.21.15.87:0/459590938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c54db9f790 msgr2=0x55c54dba7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:18.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.499+0000 7f654b7fe640 1 --2- 172.21.15.87:0/459590938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c54db9f790 0x55c54dba7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.499+0000 7f654b7fe640 1 -- 172.21.15.87:0/459590938 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c54dba00b0 msgr2=0x55c54db9ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:18.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.499+0000 7f654b7fe640 1 --2- 172.21.15.87:0/459590938 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c54dba00b0 0x55c54db9ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.499+0000 7f654b7fe640 1 -- 172.21.15.87:0/459590938 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c54daa3770 con 0x55c54dbaa950 2024-09-13T17:19:18.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.500+0000 7f654b7fe640 1 --2- 172.21.15.87:0/459590938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c54dbaa950 0x55c54dbb1620 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f6534005a60 tx=0x7f6534032700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97821196da9bc19a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:18.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.500+0000 7f6542ffd640 1 -- 172.21.15.87:0/459590938 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6534032ed0 con 0x55c54dbaa950 2024-09-13T17:19:18.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.500+0000 7f6542ffd640 1 -- 172.21.15.87:0/459590938 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6534004500 con 0x55c54dbaa950 2024-09-13T17:19:18.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.500+0000 7f6542ffd640 1 -- 172.21.15.87:0/459590938 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6534004cb0 con 0x55c54dbaa950 2024-09-13T17:19:18.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.500+0000 7f655548c740 1 -- 172.21.15.87:0/459590938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c54dbaa950 msgr2=0x55c54dbb1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:18.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.500+0000 7f655548c740 1 --2- 172.21.15.87:0/459590938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c54dbaa950 0x55c54dbb1620 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f6534005a60 tx=0x7f6534032700 comp rx=0 tx=0).stop 2024-09-13T17:19:18.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.500+0000 7f655548c740 1 -- 172.21.15.87:0/459590938 shutdown_connections 2024-09-13T17:19:18.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.500+0000 7f655548c740 1 --2- 172.21.15.87:0/459590938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c54dbaa950 0x55c54dbb1620 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.500+0000 7f655548c740 1 --2- 172.21.15.87:0/459590938 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c54dba00b0 0x55c54db9ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.500+0000 7f655548c740 1 --2- 172.21.15.87:0/459590938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c54db9f790 0x55c54dba7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.500+0000 7f655548c740 1 -- 172.21.15.87:0/459590938 >> 172.21.15.87:0/459590938 conn(0x55c54db9bd00 msgr2=0x55c54db9a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:18.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.500+0000 7f655548c740 1 -- 172.21.15.87:0/459590938 shutdown_connections 2024-09-13T17:19:18.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.500+0000 7f655548c740 1 -- 172.21.15.87:0/459590938 wait complete. 2024-09-13T17:19:18.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.500+0000 7f655548c740 1 -- start start 2024-09-13T17:19:18.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.501+0000 7f655548c740 1 Processor -- start 2024-09-13T17:19:18.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.501+0000 7f655548c740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c54db9f790 0x55c54dbb16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.501+0000 7f655548c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c54dba00b0 0x55c54dbafae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.501+0000 7f655548c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c54dbaa950 0x55c54dbb0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.501+0000 7f655548c740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c54dbb0560 con 0x55c54dba00b0 2024-09-13T17:19:18.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.501+0000 7f655548c740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c54dbb06d0 con 0x55c54db9f790 2024-09-13T17:19:18.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.501+0000 7f655548c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c54dbb0890 con 0x55c54dbaa950 2024-09-13T17:19:18.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.501+0000 7f655548c740 10 client.0 _ll_register_callbacks cb 0x7f653c00b480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:18.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.501+0000 7f654bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c54dba00b0 0x55c54dbafae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.501+0000 7f654bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c54dba00b0 0x55c54dbafae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48316/0 (socket says 172.21.15.87:48316) 2024-09-13T17:19:18.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.501+0000 7f654bfff640 1 -- 172.21.15.87:0/2067035383 learned_addr learned my addr 172.21.15.87:0/2067035383 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:18.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.501+0000 7f654b7fe640 1 --2- 172.21.15.87:0/2067035383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c54db9f790 0x55c54dbb16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.501+0000 7f654b7fe640 1 --2- 172.21.15.87:0/2067035383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c54dbaa950 0x55c54dbb0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.501+0000 7f654bfff640 1 -- 172.21.15.87:0/2067035383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c54dbaa950 msgr2=0x55c54dbb0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:18.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.501+0000 7f654bfff640 1 --2- 172.21.15.87:0/2067035383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c54dbaa950 0x55c54dbb0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.501+0000 7f654bfff640 1 -- 172.21.15.87:0/2067035383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c54db9f790 msgr2=0x55c54dbb16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:18.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.501+0000 7f654bfff640 1 --2- 172.21.15.87:0/2067035383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c54db9f790 0x55c54dbb16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.501+0000 7f654bfff640 1 -- 172.21.15.87:0/2067035383 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c54db013c0 con 0x55c54dba00b0 2024-09-13T17:19:18.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.501+0000 7f654b7fe640 1 --2- 172.21.15.87:0/2067035383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c54db9f790 0x55c54dbb16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:18.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.501+0000 7f654bfff640 1 --2- 172.21.15.87:0/2067035383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c54dba00b0 0x55c54dbafae0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f653c004c50 tx=0x7f653c005ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ac5eb3984aeaec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:18.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.501+0000 7f652b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:19:18.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.502+0000 7f652b7fe640 1 -- 172.21.15.87:0/2067035383 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653c027880 con 0x55c54dba00b0 2024-09-13T17:19:18.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.502+0000 7f652b7fe640 1 -- 172.21.15.87:0/2067035383 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f653c004da0 con 0x55c54dba00b0 2024-09-13T17:19:18.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.502+0000 7f655548c740 1 -- 172.21.15.87:0/2067035383 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c54d7f64e0 con 0x55c54dba00b0 2024-09-13T17:19:18.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.502+0000 7f652b7fe640 1 -- 172.21.15.87:0/2067035383 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f653c004f60 con 0x55c54dba00b0 2024-09-13T17:19:18.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.502+0000 7f655548c740 10 client.17103 fetch_fsmap learned FSMap version 32 2024-09-13T17:19:18.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.502+0000 7f655548c740 1 -- 172.21.15.87:0/2067035383 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55c54dac8e80 con 0x55c54dba00b0 2024-09-13T17:19:18.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.502+0000 7f652b7fe640 1 -- 172.21.15.87:0/2067035383 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55c54d7f64e0 con 0x55c54dba00b0 2024-09-13T17:19:18.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.502+0000 7f652b7fe640 1 -- 172.21.15.87:0/2067035383 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 32) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f653c003cc0 con 0x55c54dba00b0 2024-09-13T17:19:18.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.502+0000 7f655548c740 10 client.17103 fetch_fsmap finished waiting for FSMap version 32 2024-09-13T17:19:18.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.502+0000 7f655548c740 10 client.17103 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:19:18.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.502+0000 7f655548c740 20 client.17103 populate_metadata read hostname 'smithi087' 2024-09-13T17:19:18.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.502+0000 7f655548c740 1 --2- 172.21.15.87:0/2067035383 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55c54dbba140 0x55c54dc13b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:18.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.502+0000 7f655548c740 4 client.17103 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:19:18.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.502+0000 7f655548c740 1 -- 172.21.15.87:0/2067035383 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c54d8077e0 con 0x55c54dbba140 2024-09-13T17:19:18.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.502+0000 7f654b7fe640 1 --2- 172.21.15.87:0/2067035383 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55c54dbba140 0x55c54dc13b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:18.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.503+0000 7f652b7fe640 10 client.17103 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:18.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.503+0000 7f654b7fe640 1 --2- 172.21.15.87:0/2067035383 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55c54dbba140 0x55c54dc13b80 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9012fb7b5c2fc6e server_cookie=8dd6e92b7973061c in_seq=0 out_seq=0 2024-09-13T17:19:18.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.503+0000 7f652b7fe640 1 -- 172.21.15.87:0/2067035383 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c54d8077e0 con 0x55c54dbba140 2024-09-13T17:19:18.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.503+0000 7f652b7fe640 10 client.17103 handle_command_reply: tid=0 2024-09-13T17:19:18.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.503+0000 7f655548c740 1 client.17103 shutdown 2024-09-13T17:19:18.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.503+0000 7f655548c740 1 -- 172.21.15.87:0/2067035383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c54dba00b0 msgr2=0x55c54dbafae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:18.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.503+0000 7f655548c740 1 --2- 172.21.15.87:0/2067035383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c54dba00b0 0x55c54dbafae0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f653c004c50 tx=0x7f653c005ab0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.503+0000 7f655548c740 1 -- 172.21.15.87:0/2067035383 shutdown_connections 2024-09-13T17:19:18.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.503+0000 7f655548c740 1 --2- 172.21.15.87:0/2067035383 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55c54dbba140 0x55c54dc13b80 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.503+0000 7f655548c740 1 --2- 172.21.15.87:0/2067035383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c54dbaa950 0x55c54dbb0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.503+0000 7f652b7fe640 0 client.17103 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:18.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.503+0000 7f655548c740 1 --2- 172.21.15.87:0/2067035383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c54dba00b0 0x55c54dbafae0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.503+0000 7f655548c740 1 --2- 172.21.15.87:0/2067035383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c54db9f790 0x55c54dbb16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.503+0000 7f655548c740 1 -- 172.21.15.87:0/2067035383 >> 172.21.15.87:0/2067035383 conn(0x55c54db9bd00 msgr2=0x55c54db9aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:18.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.503+0000 7f655548c740 1 -- 172.21.15.87:0/2067035383 shutdown_connections 2024-09-13T17:19:18.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.503+0000 7f655548c740 1 -- 172.21.15.87:0/2067035383 wait complete. 2024-09-13T17:19:18.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.503+0000 7f655548c740 20 client.17103 trim_cache size 0 max 16384 2024-09-13T17:19:18.515 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:19:18.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.504+0000 7f6552690640 1 -- 172.21.15.87:0/2774484517 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f65380a1200 msgr2=0x7f65380a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:18.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.504+0000 7f6552690640 1 --2- 172.21.15.87:0/2774484517 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f65380a1200 0x7f65380a36c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f65440ca7a0 tx=0x7f654408f2b0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.504+0000 7f6552690640 1 -- 172.21.15.87:0/2774484517 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f654c19abd0 msgr2=0x7f654c19b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:18.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.504+0000 7f6552690640 1 --2- 172.21.15.87:0/2774484517 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f654c19abd0 0x7f654c19b080 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f6544009fd0 tx=0x7f654400b260 comp rx=0 tx=0).stop 2024-09-13T17:19:18.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.504+0000 7f6552690640 1 -- 172.21.15.87:0/2774484517 shutdown_connections 2024-09-13T17:19:18.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.504+0000 7f6552690640 1 --2- 172.21.15.87:0/2774484517 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f65380a1200 0x7f65380a36c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.504+0000 7f6552690640 1 --2- 172.21.15.87:0/2774484517 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f654c19abd0 0x7f654c19b080 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.504+0000 7f6552690640 1 --2- 172.21.15.87:0/2774484517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f654c103fa0 0x7f654c1967e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.504+0000 7f6552690640 1 --2- 172.21.15.87:0/2774484517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f654c0fee50 0x7f654c1962a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:18.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.504+0000 7f6552690640 1 -- 172.21.15.87:0/2774484517 >> 172.21.15.87:0/2774484517 conn(0x7f654c0fa8e0 msgr2=0x7f654c0fbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:18.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.504+0000 7f6552690640 1 -- 172.21.15.87:0/2774484517 shutdown_connections 2024-09-13T17:19:18.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:18.504+0000 7f6552690640 1 -- 172.21.15.87:0/2774484517 wait complete. 2024-09-13T17:19:18.728 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:18 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1852194216' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:19:18.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:18 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1852194216' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:19:18.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:18 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1852194216' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:19:19.519 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-13T17:19:19.519 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-09-13T17:19:19.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.636+0000 7f4f3315e640 1 -- 172.21.15.87:0/1279126589 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f2c0fee60 msgr2=0x7f4f2c0ff240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:19.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.636+0000 7f4f3315e640 1 --2- 172.21.15.87:0/1279126589 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f2c0fee60 0x7f4f2c0ff240 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009930 tx=0x7f4f2002a420 comp rx=0 tx=0).stop 2024-09-13T17:19:19.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.636+0000 7f4f3315e640 1 -- 172.21.15.87:0/1279126589 shutdown_connections 2024-09-13T17:19:19.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.636+0000 7f4f3315e640 1 --2- 172.21.15.87:0/1279126589 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f2c103fb0 0x7f4f2c10bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.636+0000 7f4f3315e640 1 --2- 172.21.15.87:0/1279126589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f2c0ff810 0x7f4f2c103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.636+0000 7f4f3315e640 1 --2- 172.21.15.87:0/1279126589 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f2c0fee60 0x7f4f2c0ff240 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.636+0000 7f4f3315e640 1 -- 172.21.15.87:0/1279126589 >> 172.21.15.87:0/1279126589 conn(0x7f4f2c075c60 msgr2=0x7f4f2c0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:19.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.636+0000 7f4f3315e640 1 -- 172.21.15.87:0/1279126589 shutdown_connections 2024-09-13T17:19:19.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.636+0000 7f4f3315e640 1 -- 172.21.15.87:0/1279126589 wait complete. 2024-09-13T17:19:19.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.636+0000 7f4f3315e640 1 Processor -- start 2024-09-13T17:19:19.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.636+0000 7f4f3315e640 1 -- start start 2024-09-13T17:19:19.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.637+0000 7f4f3315e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f2c0fee60 0x7f4f2c196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.637+0000 7f4f3315e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f2c103fb0 0x7f4f2c196840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.637+0000 7f4f3315e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f2c19ac30 0x7f4f2c19b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.637+0000 7f4f3315e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c19b620 con 0x7f4f2c19ac30 2024-09-13T17:19:19.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.637+0000 7f4f3315e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c19b790 con 0x7f4f2c0fee60 2024-09-13T17:19:19.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.637+0000 7f4f3315e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c19b900 con 0x7f4f2c103fb0 2024-09-13T17:19:19.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.637+0000 7f4f316fb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f2c19ac30 0x7f4f2c19b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:19.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.637+0000 7f4f316fb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f2c19ac30 0x7f4f2c19b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44750/0 (socket says 172.21.15.87:44750) 2024-09-13T17:19:19.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.637+0000 7f4f316fb640 1 -- 172.21.15.87:0/3407433046 learned_addr learned my addr 172.21.15.87:0/3407433046 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:19.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.637+0000 7f4f2bfff640 1 --2- 172.21.15.87:0/3407433046 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f2c103fb0 0x7f4f2c196840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:19.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.637+0000 7f4f30efa640 1 --2- 172.21.15.87:0/3407433046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f2c0fee60 0x7f4f2c196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:19.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.637+0000 7f4f316fb640 1 -- 172.21.15.87:0/3407433046 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f2c103fb0 msgr2=0x7f4f2c196840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:19.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.637+0000 7f4f316fb640 1 --2- 172.21.15.87:0/3407433046 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f2c103fb0 0x7f4f2c196840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.637+0000 7f4f316fb640 1 -- 172.21.15.87:0/3407433046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f2c0fee60 msgr2=0x7f4f2c196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:19.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.637+0000 7f4f316fb640 1 --2- 172.21.15.87:0/3407433046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f2c0fee60 0x7f4f2c196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.637+0000 7f4f316fb640 1 -- 172.21.15.87:0/3407433046 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f20009560 con 0x7f4f2c19ac30 2024-09-13T17:19:19.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.637+0000 7f4f2bfff640 1 --2- 172.21.15.87:0/3407433046 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f2c103fb0 0x7f4f2c196840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:19.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.637+0000 7f4f316fb640 1 --2- 172.21.15.87:0/3407433046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f2c19ac30 0x7f4f2c19b0e0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f4f2400b9e0 tx=0x7f4f2400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:19.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.637+0000 7f4f29ffb640 1 -- 172.21.15.87:0/3407433046 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2400caa0 con 0x7f4f2c19ac30 2024-09-13T17:19:19.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.637+0000 7f4f29ffb640 1 -- 172.21.15.87:0/3407433046 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4f2400cc00 con 0x7f4f2c19ac30 2024-09-13T17:19:19.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.637+0000 7f4f3315e640 1 -- 172.21.15.87:0/3407433046 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2c1a2ee0 con 0x7f4f2c19ac30 2024-09-13T17:19:19.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.637+0000 7f4f29ffb640 1 -- 172.21.15.87:0/3407433046 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f240075d0 con 0x7f4f2c19ac30 2024-09-13T17:19:19.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.638+0000 7f4f3315e640 1 -- 172.21.15.87:0/3407433046 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f2c1a3360 con 0x7f4f2c19ac30 2024-09-13T17:19:19.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.640+0000 7f4f29ffb640 1 -- 172.21.15.87:0/3407433046 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f4f24014440 con 0x7f4f2c19ac30 2024-09-13T17:19:19.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.640+0000 7f4f35e87740 1 Processor -- start 2024-09-13T17:19:19.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.640+0000 7f4f35e87740 1 -- start start 2024-09-13T17:19:19.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.640+0000 7f4f29ffb640 1 --2- 172.21.15.87:0/3407433046 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4f1c0a1280 0x7f4f1c0a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.640+0000 7f4f35e87740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55697dd027c0 0x55697dd02ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.640+0000 7f4f35e87740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697dd030e0 0x55697dd0d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.640+0000 7f4f2bfff640 1 --2- 172.21.15.87:0/3407433046 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4f1c0a1280 0x7f4f1c0a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:19.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.640+0000 7f4f29ffb640 1 -- 172.21.15.87:0/3407433046 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f4f240cc810 con 0x7f4f2c19ac30 2024-09-13T17:19:19.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.640+0000 7f4f35e87740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55697dd0d980 0x55697dd0fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.640+0000 7f4f35e87740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55697dc6dc60 con 0x55697dd030e0 2024-09-13T17:19:19.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.640+0000 7f4f35e87740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55697dc6b3f0 con 0x55697dd027c0 2024-09-13T17:19:19.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.641+0000 7f4f35e87740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55697dc66ce0 con 0x55697dd0d980 2024-09-13T17:19:19.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.641+0000 7f4f2bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697dd030e0 0x55697dd0d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:19.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.641+0000 7f4f2bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697dd030e0 0x55697dd0d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44762/0 (socket says 172.21.15.87:44762) 2024-09-13T17:19:19.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.641+0000 7f4f2bfff640 1 -- 172.21.15.87:0/1069546152 learned_addr learned my addr 172.21.15.87:0/1069546152 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:19.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.641+0000 7f4f30efa640 1 --2- 172.21.15.87:0/1069546152 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55697dd027c0 0x55697dd02ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:19.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.641+0000 7f4f316fb640 1 --2- 172.21.15.87:0/1069546152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55697dd0d980 0x55697dd0fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:19.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.641+0000 7f4f2bfff640 1 -- 172.21.15.87:0/1069546152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55697dd0d980 msgr2=0x55697dd0fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:19.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.641+0000 7f4f2bfff640 1 --2- 172.21.15.87:0/1069546152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55697dd0d980 0x55697dd0fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.641+0000 7f4f2bfff640 1 -- 172.21.15.87:0/1069546152 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55697dd027c0 msgr2=0x55697dd02ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:19.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.641+0000 7f4f2bfff640 1 --2- 172.21.15.87:0/1069546152 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55697dd027c0 0x55697dd02ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.641+0000 7f4f2bfff640 1 -- 172.21.15.87:0/1069546152 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55697dc22970 con 0x55697dd030e0 2024-09-13T17:19:19.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.641+0000 7f4f2bfff640 1 --2- 172.21.15.87:0/3407433046 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4f1c0a1280 0x7f4f1c0a3740 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4f18013930 tx=0x7f4f1800ab60 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:19.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.641+0000 7f4f2bfff640 1 --2- 172.21.15.87:0/1069546152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697dd030e0 0x55697dd0d440 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f4f18010740 tx=0x7f4f1801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62be94b411318a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:19.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.641+0000 7f4f16ffd640 1 -- 172.21.15.87:0/1069546152 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1800edf0 con 0x55697dd030e0 2024-09-13T17:19:19.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.641+0000 7f4f16ffd640 1 -- 172.21.15.87:0/1069546152 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4f18019040 con 0x55697dd030e0 2024-09-13T17:19:19.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.641+0000 7f4f16ffd640 1 -- 172.21.15.87:0/1069546152 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f180049e0 con 0x55697dd030e0 2024-09-13T17:19:19.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.642+0000 7f4f35e87740 1 -- 172.21.15.87:0/1069546152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697dd030e0 msgr2=0x55697dd0d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:19.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.642+0000 7f4f35e87740 1 --2- 172.21.15.87:0/1069546152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697dd030e0 0x55697dd0d440 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f4f18010740 tx=0x7f4f1801a000 comp rx=0 tx=0).stop 2024-09-13T17:19:19.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.642+0000 7f4f35e87740 1 -- 172.21.15.87:0/1069546152 shutdown_connections 2024-09-13T17:19:19.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.642+0000 7f4f35e87740 1 --2- 172.21.15.87:0/1069546152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55697dd0d980 0x55697dd0fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.642+0000 7f4f35e87740 1 --2- 172.21.15.87:0/1069546152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697dd030e0 0x55697dd0d440 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.642+0000 7f4f35e87740 1 --2- 172.21.15.87:0/1069546152 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55697dd027c0 0x55697dd02ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.642+0000 7f4f35e87740 1 -- 172.21.15.87:0/1069546152 >> 172.21.15.87:0/1069546152 conn(0x55697dcfed50 msgr2=0x55697dcff130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:19.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.642+0000 7f4f35e87740 1 -- 172.21.15.87:0/1069546152 shutdown_connections 2024-09-13T17:19:19.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.642+0000 7f4f35e87740 1 -- 172.21.15.87:0/1069546152 wait complete. 2024-09-13T17:19:19.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.642+0000 7f4f35e87740 1 -- start start 2024-09-13T17:19:19.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.642+0000 7f4f35e87740 1 Processor -- start 2024-09-13T17:19:19.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.643+0000 7f4f35e87740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55697dd027c0 0x55697dd0d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.643+0000 7f4f35e87740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55697dd030e0 0x55697dd0a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.643+0000 7f4f35e87740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697dd0d980 0x55697dd0ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.643+0000 7f4f35e87740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55697dc24f80 con 0x55697dd0d980 2024-09-13T17:19:19.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.643+0000 7f4f35e87740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55697dc24c20 con 0x55697dd030e0 2024-09-13T17:19:19.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.643+0000 7f4f35e87740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55697dbf1ab0 con 0x55697dd027c0 2024-09-13T17:19:19.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.643+0000 7f4f35e87740 10 client.0 _ll_register_callbacks cb 0x55697dc60350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:19.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.643+0000 7f4f316fb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697dd0d980 0x55697dd0ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:19.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.643+0000 7f4f316fb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697dd0d980 0x55697dd0ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44764/0 (socket says 172.21.15.87:44764) 2024-09-13T17:19:19.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.643+0000 7f4f316fb640 1 -- 172.21.15.87:0/2637893246 learned_addr learned my addr 172.21.15.87:0/2637893246 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:19.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.643+0000 7f4f2bfff640 1 --2- 172.21.15.87:0/2637893246 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55697dd030e0 0x55697dd0a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:19.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.643+0000 7f4f30efa640 1 --2- 172.21.15.87:0/2637893246 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55697dd027c0 0x55697dd0d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:19.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.643+0000 7f4f316fb640 1 -- 172.21.15.87:0/2637893246 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55697dd027c0 msgr2=0x55697dd0d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:19.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.643+0000 7f4f316fb640 1 --2- 172.21.15.87:0/2637893246 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55697dd027c0 0x55697dd0d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.643+0000 7f4f316fb640 1 -- 172.21.15.87:0/2637893246 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55697dd030e0 msgr2=0x55697dd0a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:19.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.643+0000 7f4f316fb640 1 --2- 172.21.15.87:0/2637893246 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55697dd030e0 0x55697dd0a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.643+0000 7f4f316fb640 1 -- 172.21.15.87:0/2637893246 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f18010970 con 0x55697dd0d980 2024-09-13T17:19:19.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.643+0000 7f4f30efa640 1 --2- 172.21.15.87:0/2637893246 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55697dd027c0 0x55697dd0d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:19.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.643+0000 7f4f2bfff640 1 --2- 172.21.15.87:0/2637893246 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55697dd030e0 0x55697dd0a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:19.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.643+0000 7f4f316fb640 1 --2- 172.21.15.87:0/2637893246 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697dd0d980 0x55697dd0ab90 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f4f24096050 tx=0x7f4f24099da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee5ba8fbce06171 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:19.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.643+0000 7f4f0bfff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:19:19.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.644+0000 7f4f0bfff640 1 -- 172.21.15.87:0/2637893246 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2409d410 con 0x55697dd0d980 2024-09-13T17:19:19.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.644+0000 7f4f0bfff640 1 -- 172.21.15.87:0/2637893246 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f4f240a1a60 con 0x55697dd0d980 2024-09-13T17:19:19.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.644+0000 7f4f35e87740 1 -- 172.21.15.87:0/2637893246 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55697d95a590 con 0x55697dd0d980 2024-09-13T17:19:19.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.644+0000 7f4f0bfff640 1 -- 172.21.15.87:0/2637893246 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f24095cf0 con 0x55697dd0d980 2024-09-13T17:19:19.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.644+0000 7f4f35e87740 10 client.17115 fetch_fsmap learned FSMap version 32 2024-09-13T17:19:19.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.644+0000 7f4f35e87740 1 -- 172.21.15.87:0/2637893246 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55697dc65360 con 0x55697dd0d980 2024-09-13T17:19:19.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.644+0000 7f4f0bfff640 1 -- 172.21.15.87:0/2637893246 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55697d95a590 con 0x55697dd0d980 2024-09-13T17:19:19.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.644+0000 7f4f0bfff640 1 -- 172.21.15.87:0/2637893246 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 32) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f4f24014780 con 0x55697dd0d980 2024-09-13T17:19:19.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.644+0000 7f4f35e87740 10 client.17115 fetch_fsmap finished waiting for FSMap version 32 2024-09-13T17:19:19.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.644+0000 7f4f35e87740 10 client.17115 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:19:19.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.644+0000 7f4f35e87740 20 client.17115 populate_metadata read hostname 'smithi087' 2024-09-13T17:19:19.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.644+0000 7f4f35e87740 1 --2- 172.21.15.87:0/2637893246 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55697dd1d7b0 0x55697dd1fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.644+0000 7f4f35e87740 4 client.17115 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:19:19.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.644+0000 7f4f35e87740 1 -- 172.21.15.87:0/2637893246 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55697d96b860 con 0x55697dd1d7b0 2024-09-13T17:19:19.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.644+0000 7f4f30efa640 1 --2- 172.21.15.87:0/2637893246 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55697dd1d7b0 0x55697dd1fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:19.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.645+0000 7f4f30efa640 1 --2- 172.21.15.87:0/2637893246 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55697dd1d7b0 0x55697dd1fbd0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=757ac4c74830b8eb server_cookie=db9cf47ecc7f1b78 in_seq=0 out_seq=0 2024-09-13T17:19:19.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.645+0000 7f4f0bfff640 10 client.17115 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:19.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.645+0000 7f4f0bfff640 1 -- 172.21.15.87:0/2637893246 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55697d96b860 con 0x55697dd1d7b0 2024-09-13T17:19:19.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.646+0000 7f4f0bfff640 10 client.17115 handle_command_reply: tid=0 2024-09-13T17:19:19.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.646+0000 7f4f35e87740 1 client.17115 shutdown 2024-09-13T17:19:19.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.646+0000 7f4f35e87740 1 -- 172.21.15.87:0/2637893246 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697dd0d980 msgr2=0x55697dd0ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:19.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.646+0000 7f4f35e87740 1 --2- 172.21.15.87:0/2637893246 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697dd0d980 0x55697dd0ab90 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f4f24096050 tx=0x7f4f24099da0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.646+0000 7f4f35e87740 1 -- 172.21.15.87:0/2637893246 shutdown_connections 2024-09-13T17:19:19.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.646+0000 7f4f35e87740 1 --2- 172.21.15.87:0/2637893246 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55697dd1d7b0 0x55697dd1fbd0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.646+0000 7f4f35e87740 1 --2- 172.21.15.87:0/2637893246 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697dd0d980 0x55697dd0ab90 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.646+0000 7f4f35e87740 1 --2- 172.21.15.87:0/2637893246 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55697dd030e0 0x55697dd0a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.646+0000 7f4f0bfff640 0 client.17115 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:19.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.646+0000 7f4f35e87740 1 --2- 172.21.15.87:0/2637893246 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55697dd027c0 0x55697dd0d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.646+0000 7f4f35e87740 1 -- 172.21.15.87:0/2637893246 >> 172.21.15.87:0/2637893246 conn(0x55697dcfed50 msgr2=0x55697dd041a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:19.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.646+0000 7f4f35e87740 1 -- 172.21.15.87:0/2637893246 shutdown_connections 2024-09-13T17:19:19.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.646+0000 7f4f35e87740 1 -- 172.21.15.87:0/2637893246 wait complete. 2024-09-13T17:19:19.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.646+0000 7f4f35e87740 20 client.17115 trim_cache size 0 max 16384 2024-09-13T17:19:19.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.660+0000 7f4f35e87740 1 Processor -- start 2024-09-13T17:19:19.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.660+0000 7f4f35e87740 1 -- start start 2024-09-13T17:19:19.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.660+0000 7f4f35e87740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697dcfed50 0x55697dd14a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.660+0000 7f4f35e87740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55697dd027c0 0x55697dcfd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.660+0000 7f4f35e87740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55697dd030e0 0x55697dcfde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.660+0000 7f4f35e87740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55697dd1d5e0 con 0x55697dcfed50 2024-09-13T17:19:19.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.660+0000 7f4f35e87740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55697dd195b0 con 0x55697dd027c0 2024-09-13T17:19:19.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.660+0000 7f4f35e87740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55697dd10430 con 0x55697dd030e0 2024-09-13T17:19:19.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.660+0000 7f4f30efa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697dcfed50 0x55697dd14a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:19.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.660+0000 7f4f30efa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697dcfed50 0x55697dd14a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44774/0 (socket says 172.21.15.87:44774) 2024-09-13T17:19:19.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.660+0000 7f4f30efa640 1 -- 172.21.15.87:0/2131738690 learned_addr learned my addr 172.21.15.87:0/2131738690 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:19.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.660+0000 7f4f2bfff640 1 --2- 172.21.15.87:0/2131738690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55697dd027c0 0x55697dcfd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:19.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.660+0000 7f4f30efa640 1 -- 172.21.15.87:0/2131738690 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55697dd030e0 msgr2=0x55697dcfde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:19.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.660+0000 7f4f30efa640 1 --2- 172.21.15.87:0/2131738690 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55697dd030e0 0x55697dcfde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.660+0000 7f4f30efa640 1 -- 172.21.15.87:0/2131738690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55697dd027c0 msgr2=0x55697dcfd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:19.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.660+0000 7f4f30efa640 1 --2- 172.21.15.87:0/2131738690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55697dd027c0 0x55697dcfd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.660+0000 7f4f30efa640 1 -- 172.21.15.87:0/2131738690 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55697dc071c0 con 0x55697dcfed50 2024-09-13T17:19:19.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.660+0000 7f4f2bfff640 1 --2- 172.21.15.87:0/2131738690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55697dd027c0 0x55697dcfd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:19.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.661+0000 7f4f30efa640 1 --2- 172.21.15.87:0/2131738690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697dcfed50 0x55697dd14a80 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f4f2002aa10 tx=0x7f4f20005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=552d0d712ce85547 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:19.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.661+0000 7f4f177fe640 1 -- 172.21.15.87:0/2131738690 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f20042070 con 0x55697dcfed50 2024-09-13T17:19:19.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.661+0000 7f4f177fe640 1 -- 172.21.15.87:0/2131738690 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4f20004100 con 0x55697dcfed50 2024-09-13T17:19:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.661+0000 7f4f177fe640 1 -- 172.21.15.87:0/2131738690 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f20043270 con 0x55697dcfed50 2024-09-13T17:19:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.661+0000 7f4f35e87740 1 -- 172.21.15.87:0/2131738690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697dcfed50 msgr2=0x55697dd14a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.661+0000 7f4f35e87740 1 --2- 172.21.15.87:0/2131738690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697dcfed50 0x55697dd14a80 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f4f2002aa10 tx=0x7f4f20005e30 comp rx=0 tx=0).stop 2024-09-13T17:19:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.661+0000 7f4f35e87740 1 -- 172.21.15.87:0/2131738690 shutdown_connections 2024-09-13T17:19:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.661+0000 7f4f35e87740 1 --2- 172.21.15.87:0/2131738690 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55697dd030e0 0x55697dcfde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.661+0000 7f4f35e87740 1 --2- 172.21.15.87:0/2131738690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55697dd027c0 0x55697dcfd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.661+0000 7f4f35e87740 1 --2- 172.21.15.87:0/2131738690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697dcfed50 0x55697dd14a80 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.661+0000 7f4f35e87740 1 -- 172.21.15.87:0/2131738690 >> 172.21.15.87:0/2131738690 conn(0x55697dd0d460 msgr2=0x55697dd08e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.661+0000 7f4f35e87740 1 -- 172.21.15.87:0/2131738690 shutdown_connections 2024-09-13T17:19:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.661+0000 7f4f35e87740 1 -- 172.21.15.87:0/2131738690 wait complete. 2024-09-13T17:19:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.662+0000 7f4f35e87740 1 -- start start 2024-09-13T17:19:19.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.662+0000 7f4f35e87740 1 Processor -- start 2024-09-13T17:19:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.662+0000 7f4f35e87740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697dcfed50 0x55697dd6c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.662+0000 7f4f35e87740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55697dd027c0 0x55697dd6cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.662+0000 7f4f35e87740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55697dd030e0 0x55697dd70d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.662+0000 7f4f35e87740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55697dd712f0 con 0x55697dcfed50 2024-09-13T17:19:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.662+0000 7f4f35e87740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55697dd71460 con 0x55697dd027c0 2024-09-13T17:19:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.662+0000 7f4f35e87740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55697dd71620 con 0x55697dd030e0 2024-09-13T17:19:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.662+0000 7f4f35e87740 10 client.0 _ll_register_callbacks cb 0x7f4f24095260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.662+0000 7f4f30efa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697dcfed50 0x55697dd6c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.662+0000 7f4f30efa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697dcfed50 0x55697dd6c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44790/0 (socket says 172.21.15.87:44790) 2024-09-13T17:19:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.662+0000 7f4f30efa640 1 -- 172.21.15.87:0/294237117 learned_addr learned my addr 172.21.15.87:0/294237117 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.662+0000 7f4f30efa640 1 -- 172.21.15.87:0/294237117 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55697dd030e0 msgr2=0x55697dd70d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.662+0000 7f4f30efa640 1 --2- 172.21.15.87:0/294237117 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55697dd030e0 0x55697dd70d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.662+0000 7f4f30efa640 1 -- 172.21.15.87:0/294237117 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55697dd027c0 msgr2=0x55697dd6cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:19.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.662+0000 7f4f30efa640 1 --2- 172.21.15.87:0/294237117 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55697dd027c0 0x55697dd6cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.662+0000 7f4f30efa640 1 -- 172.21.15.87:0/294237117 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f2c10c340 con 0x55697dcfed50 2024-09-13T17:19:19.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.663+0000 7f4f30efa640 1 --2- 172.21.15.87:0/294237117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697dcfed50 0x55697dd6c760 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f4f20004270 tx=0x7f4f200042a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae0247da77705457 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:19.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.663+0000 7f4f0bfff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:19:19.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.663+0000 7f4f0bfff640 1 -- 172.21.15.87:0/294237117 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f20042040 con 0x55697dcfed50 2024-09-13T17:19:19.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.663+0000 7f4f0bfff640 1 -- 172.21.15.87:0/294237117 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f4f20032460 con 0x55697dcfed50 2024-09-13T17:19:19.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.663+0000 7f4f35e87740 1 -- 172.21.15.87:0/294237117 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4f18019040 con 0x55697dcfed50 2024-09-13T17:19:19.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.663+0000 7f4f0bfff640 1 -- 172.21.15.87:0/294237117 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f200044c0 con 0x55697dcfed50 2024-09-13T17:19:19.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.663+0000 7f4f35e87740 10 client.17121 fetch_fsmap learned FSMap version 32 2024-09-13T17:19:19.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.663+0000 7f4f35e87740 1 -- 172.21.15.87:0/294237117 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55697dc2c990 con 0x55697dcfed50 2024-09-13T17:19:19.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.663+0000 7f4f0bfff640 1 -- 172.21.15.87:0/294237117 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4f18019040 con 0x55697dcfed50 2024-09-13T17:19:19.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.663+0000 7f4f0bfff640 1 -- 172.21.15.87:0/294237117 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 32) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f4f200315a0 con 0x55697dcfed50 2024-09-13T17:19:19.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.663+0000 7f4f35e87740 10 client.17121 fetch_fsmap finished waiting for FSMap version 32 2024-09-13T17:19:19.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.663+0000 7f4f35e87740 10 client.17121 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:19:19.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.663+0000 7f4f35e87740 20 client.17121 populate_metadata read hostname 'smithi087' 2024-09-13T17:19:19.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.663+0000 7f4f35e87740 1 --2- 172.21.15.87:0/294237117 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55697dd0d980 0x55697dd7bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.663+0000 7f4f35e87740 4 client.17121 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-13T17:19:19.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.663+0000 7f4f35e87740 1 -- 172.21.15.87:0/294237117 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55697d9beeb0 con 0x55697dd0d980 2024-09-13T17:19:19.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.664+0000 7f4f2bfff640 1 --2- 172.21.15.87:0/294237117 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55697dd0d980 0x55697dd7bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:19.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.664+0000 7f4f2bfff640 1 --2- 172.21.15.87:0/294237117 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55697dd0d980 0x55697dd7bed0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1599c5146e4ccd3c server_cookie=4ca0ce3a7004e19c in_seq=0 out_seq=0 2024-09-13T17:19:19.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.664+0000 7f4f0bfff640 10 client.17121 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:19.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.665+0000 7f4f0bfff640 1 -- 172.21.15.87:0/294237117 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55697d9beeb0 con 0x55697dd0d980 2024-09-13T17:19:19.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.665+0000 7f4f0bfff640 10 client.17121 handle_command_reply: tid=0 2024-09-13T17:19:19.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.665+0000 7f4f35e87740 1 client.17121 shutdown 2024-09-13T17:19:19.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.665+0000 7f4f35e87740 1 -- 172.21.15.87:0/294237117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697dcfed50 msgr2=0x55697dd6c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:19.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.665+0000 7f4f35e87740 1 --2- 172.21.15.87:0/294237117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697dcfed50 0x55697dd6c760 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f4f20004270 tx=0x7f4f200042a0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.665+0000 7f4f35e87740 1 -- 172.21.15.87:0/294237117 shutdown_connections 2024-09-13T17:19:19.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.665+0000 7f4f35e87740 1 --2- 172.21.15.87:0/294237117 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55697dd0d980 0x55697dd7bed0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.665+0000 7f4f35e87740 1 --2- 172.21.15.87:0/294237117 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55697dd030e0 0x55697dd70d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.665+0000 7f4f0bfff640 0 client.17121 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:19.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.665+0000 7f4f35e87740 1 --2- 172.21.15.87:0/294237117 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55697dd027c0 0x55697dd6cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.665+0000 7f4f35e87740 1 --2- 172.21.15.87:0/294237117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55697dcfed50 0x55697dd6c760 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.665+0000 7f4f35e87740 1 -- 172.21.15.87:0/294237117 >> 172.21.15.87:0/294237117 conn(0x55697dd0d460 msgr2=0x55697dcfd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:19.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.665+0000 7f4f35e87740 1 -- 172.21.15.87:0/294237117 shutdown_connections 2024-09-13T17:19:19.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.665+0000 7f4f35e87740 1 -- 172.21.15.87:0/294237117 wait complete. 2024-09-13T17:19:19.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.665+0000 7f4f35e87740 20 client.17121 trim_cache size 0 max 16384 2024-09-13T17:19:19.675 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:19:19.676 INFO:teuthology.orchestra.run.smithi087.stdout: "return_code": 0, 2024-09-13T17:19:19.676 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_tag": "2ebb3789-e30d-45b6-99f9-9fe92b08081c", 2024-09-13T17:19:19.676 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": "asynchronous" 2024-09-13T17:19:19.676 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:19:19.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.666+0000 7f4f3315e640 1 -- 172.21.15.87:0/3407433046 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4f1c0a1280 msgr2=0x7f4f1c0a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:19.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.666+0000 7f4f3315e640 1 --2- 172.21.15.87:0/3407433046 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4f1c0a1280 0x7f4f1c0a3740 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4f18013930 tx=0x7f4f1800ab60 comp rx=0 tx=0).stop 2024-09-13T17:19:19.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.666+0000 7f4f3315e640 1 -- 172.21.15.87:0/3407433046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f2c19ac30 msgr2=0x7f4f2c19b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:19.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.666+0000 7f4f3315e640 1 --2- 172.21.15.87:0/3407433046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f2c19ac30 0x7f4f2c19b0e0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f4f2400b9e0 tx=0x7f4f2400bea0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.666+0000 7f4f3315e640 1 -- 172.21.15.87:0/3407433046 shutdown_connections 2024-09-13T17:19:19.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.666+0000 7f4f3315e640 1 --2- 172.21.15.87:0/3407433046 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4f1c0a1280 0x7f4f1c0a3740 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.666+0000 7f4f3315e640 1 --2- 172.21.15.87:0/3407433046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f2c19ac30 0x7f4f2c19b0e0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.666+0000 7f4f3315e640 1 --2- 172.21.15.87:0/3407433046 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f2c103fb0 0x7f4f2c196840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.666+0000 7f4f3315e640 1 --2- 172.21.15.87:0/3407433046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f2c0fee60 0x7f4f2c196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.666+0000 7f4f3315e640 1 -- 172.21.15.87:0/3407433046 >> 172.21.15.87:0/3407433046 conn(0x7f4f2c075c60 msgr2=0x7f4f2c0677c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:19.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.666+0000 7f4f3315e640 1 -- 172.21.15.87:0/3407433046 shutdown_connections 2024-09-13T17:19:19.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.666+0000 7f4f3315e640 1 -- 172.21.15.87:0/3407433046 wait complete. 2024-09-13T17:19:19.679 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:19:19.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.777+0000 7eff6ac2b640 1 -- 172.21.15.87:0/1843888952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff640ff800 msgr2=0x7eff64103840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:19.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.777+0000 7eff6ac2b640 1 --2- 172.21.15.87:0/1843888952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff640ff800 0x7eff64103840 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7eff54009930 tx=0x7eff5402a420 comp rx=0 tx=0).stop 2024-09-13T17:19:19.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.777+0000 7eff6ac2b640 1 -- 172.21.15.87:0/1843888952 shutdown_connections 2024-09-13T17:19:19.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.777+0000 7eff6ac2b640 1 --2- 172.21.15.87:0/1843888952 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff64103fa0 0x7eff6410baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.777+0000 7eff6ac2b640 1 --2- 172.21.15.87:0/1843888952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff640ff800 0x7eff64103840 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.777+0000 7eff6ac2b640 1 --2- 172.21.15.87:0/1843888952 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff640fee50 0x7eff640ff230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.777+0000 7eff6ac2b640 1 -- 172.21.15.87:0/1843888952 >> 172.21.15.87:0/1843888952 conn(0x7eff640fa8c0 msgr2=0x7eff640fcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:19.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.777+0000 7eff6ac2b640 1 -- 172.21.15.87:0/1843888952 shutdown_connections 2024-09-13T17:19:19.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.777+0000 7eff6ac2b640 1 -- 172.21.15.87:0/1843888952 wait complete. 2024-09-13T17:19:19.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.778+0000 7eff6ac2b640 1 Processor -- start 2024-09-13T17:19:19.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.778+0000 7eff6ac2b640 1 -- start start 2024-09-13T17:19:19.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.778+0000 7eff6ac2b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff640fee50 0x7eff641008e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.778+0000 7eff6ac2b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff64103fa0 0x7eff64100e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.778+0000 7eff6ac2b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff64101360 0x7eff641a4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.778+0000 7eff6ac2b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff641a4a80 con 0x7eff640fee50 2024-09-13T17:19:19.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.778+0000 7eff6ac2b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff641a4bf0 con 0x7eff64101360 2024-09-13T17:19:19.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.778+0000 7eff6ac2b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff641a4db0 con 0x7eff64103fa0 2024-09-13T17:19:19.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.778+0000 7eff689c7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff640fee50 0x7eff641008e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:19.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.778+0000 7eff689c7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff640fee50 0x7eff641008e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44804/0 (socket says 172.21.15.87:44804) 2024-09-13T17:19:19.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.778+0000 7eff689c7640 1 -- 172.21.15.87:0/2980758221 learned_addr learned my addr 172.21.15.87:0/2980758221 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:19.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.778+0000 7eff5bfff640 1 --2- 172.21.15.87:0/2980758221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff64103fa0 0x7eff64100e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:19.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.779+0000 7eff689c7640 1 -- 172.21.15.87:0/2980758221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff64103fa0 msgr2=0x7eff64100e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:19.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.779+0000 7eff689c7640 1 --2- 172.21.15.87:0/2980758221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff64103fa0 0x7eff64100e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.779+0000 7eff689c7640 1 -- 172.21.15.87:0/2980758221 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff64101360 msgr2=0x7eff641a4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:19.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.779+0000 7eff689c7640 1 --2- 172.21.15.87:0/2980758221 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff64101360 0x7eff641a4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.779+0000 7eff689c7640 1 -- 172.21.15.87:0/2980758221 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff54009560 con 0x7eff640fee50 2024-09-13T17:19:19.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.779+0000 7eff689c7640 1 --2- 172.21.15.87:0/2980758221 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff640fee50 0x7eff641008e0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7eff6000d950 tx=0x7eff6000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:19.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.779+0000 7eff59ffb640 1 -- 172.21.15.87:0/2980758221 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff60009c30 con 0x7eff640fee50 2024-09-13T17:19:19.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.779+0000 7eff59ffb640 1 -- 172.21.15.87:0/2980758221 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7eff60009d90 con 0x7eff640fee50 2024-09-13T17:19:19.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.779+0000 7eff6ac2b640 1 -- 172.21.15.87:0/2980758221 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff641a5090 con 0x7eff640fee50 2024-09-13T17:19:19.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.779+0000 7eff59ffb640 1 -- 172.21.15.87:0/2980758221 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6000f6b0 con 0x7eff640fee50 2024-09-13T17:19:19.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.779+0000 7eff6ac2b640 1 -- 172.21.15.87:0/2980758221 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff641a55c0 con 0x7eff640fee50 2024-09-13T17:19:19.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.781+0000 7eff59ffb640 1 -- 172.21.15.87:0/2980758221 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7eff60010aa0 con 0x7eff640fee50 2024-09-13T17:19:19.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.782+0000 7eff6da29740 1 Processor -- start 2024-09-13T17:19:19.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.782+0000 7eff6da29740 1 -- start start 2024-09-13T17:19:19.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.782+0000 7eff59ffb640 1 --2- 172.21.15.87:0/2980758221 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7eff4c0a1280 0x7eff4c0a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.782+0000 7eff6da29740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558a7ff1be10 0x558a7ff1c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.782+0000 7eff6da29740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558a7ff1c730 0x558a7ff26a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.782+0000 7eff6da29740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558a7ff26fd0 0x558a7ff293c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.782+0000 7eff6da29740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7fe86f20 con 0x558a7ff1be10 2024-09-13T17:19:19.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.782+0000 7eff6da29740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7fe846b0 con 0x558a7ff1c730 2024-09-13T17:19:19.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.782+0000 7eff6da29740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7fe7ffa0 con 0x558a7ff26fd0 2024-09-13T17:19:19.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.782+0000 7eff59ffb640 1 -- 172.21.15.87:0/2980758221 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7eff600ccdc0 con 0x7eff640fee50 2024-09-13T17:19:19.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.782+0000 7eff691c8640 1 --2- 172.21.15.87:0/2980758221 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7eff4c0a1280 0x7eff4c0a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:19.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.782+0000 7eff689c7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558a7ff1be10 0x558a7ff1c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:19.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.782+0000 7eff689c7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558a7ff1be10 0x558a7ff1c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44820/0 (socket says 172.21.15.87:44820) 2024-09-13T17:19:19.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.782+0000 7eff689c7640 1 -- 172.21.15.87:0/1868900219 learned_addr learned my addr 172.21.15.87:0/1868900219 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:19.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.782+0000 7eff689c7640 1 -- 172.21.15.87:0/1868900219 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558a7ff26fd0 msgr2=0x558a7ff293c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:19.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.782+0000 7eff689c7640 1 --2- 172.21.15.87:0/1868900219 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558a7ff26fd0 0x558a7ff293c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.782+0000 7eff5bfff640 1 --2- 172.21.15.87:0/1868900219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558a7ff1c730 0x558a7ff26a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:19.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.782+0000 7eff689c7640 1 -- 172.21.15.87:0/1868900219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558a7ff1c730 msgr2=0x558a7ff26a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:19.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.782+0000 7eff689c7640 1 --2- 172.21.15.87:0/1868900219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558a7ff1c730 0x558a7ff26a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.782+0000 7eff689c7640 1 -- 172.21.15.87:0/1868900219 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a7fe3a840 con 0x558a7ff1be10 2024-09-13T17:19:19.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.782+0000 7eff5bfff640 1 --2- 172.21.15.87:0/1868900219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558a7ff1c730 0x558a7ff26a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:19.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.783+0000 7eff691c8640 1 --2- 172.21.15.87:0/2980758221 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7eff4c0a1280 0x7eff4c0a3740 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7eff5c005c40 tx=0x7eff5c010740 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:19.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.783+0000 7eff689c7640 1 --2- 172.21.15.87:0/1868900219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558a7ff1be10 0x558a7ff1c1f0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7eff60096590 tx=0x7eff60049060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ffc93925e88ff16 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:19.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.783+0000 7eff4affd640 1 -- 172.21.15.87:0/1868900219 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff60099b20 con 0x558a7ff1be10 2024-09-13T17:19:19.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.783+0000 7eff4affd640 1 -- 172.21.15.87:0/1868900219 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7eff6009d950 con 0x558a7ff1be10 2024-09-13T17:19:19.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.783+0000 7eff4affd640 1 -- 172.21.15.87:0/1868900219 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff600ca540 con 0x558a7ff1be10 2024-09-13T17:19:19.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.783+0000 7eff6da29740 1 -- 172.21.15.87:0/1868900219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558a7ff1be10 msgr2=0x558a7ff1c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:19.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.783+0000 7eff6da29740 1 --2- 172.21.15.87:0/1868900219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558a7ff1be10 0x558a7ff1c1f0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7eff60096590 tx=0x7eff60049060 comp rx=0 tx=0).stop 2024-09-13T17:19:19.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.783+0000 7eff6da29740 1 -- 172.21.15.87:0/1868900219 shutdown_connections 2024-09-13T17:19:19.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.783+0000 7eff6da29740 1 --2- 172.21.15.87:0/1868900219 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558a7ff26fd0 0x558a7ff293c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.783+0000 7eff6da29740 1 --2- 172.21.15.87:0/1868900219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558a7ff1c730 0x558a7ff26a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.783+0000 7eff6da29740 1 --2- 172.21.15.87:0/1868900219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558a7ff1be10 0x558a7ff1c1f0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.783+0000 7eff6da29740 1 -- 172.21.15.87:0/1868900219 >> 172.21.15.87:0/1868900219 conn(0x558a7ff18380 msgr2=0x558a7ff18760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:19.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.784+0000 7eff6da29740 1 -- 172.21.15.87:0/1868900219 shutdown_connections 2024-09-13T17:19:19.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.784+0000 7eff6da29740 1 -- 172.21.15.87:0/1868900219 wait complete. 2024-09-13T17:19:19.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.784+0000 7eff6da29740 1 -- start start 2024-09-13T17:19:19.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.784+0000 7eff6da29740 1 Processor -- start 2024-09-13T17:19:19.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.784+0000 7eff6da29740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558a7ff1be10 0x558a7ff269a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.784+0000 7eff6da29740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558a7ff1c730 0x558a7ff23c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.784+0000 7eff6da29740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558a7ff26fd0 0x558a7ff24280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.784+0000 7eff6da29740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7fe212a0 con 0x558a7ff26fd0 2024-09-13T17:19:19.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.784+0000 7eff6da29740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7fb58430 con 0x558a7ff1be10 2024-09-13T17:19:19.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.784+0000 7eff6da29740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7fe03680 con 0x558a7ff1c730 2024-09-13T17:19:19.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.784+0000 7eff6da29740 10 client.0 _ll_register_callbacks cb 0x558a7fe79610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:19.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.784+0000 7eff691c8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558a7ff26fd0 0x558a7ff24280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:19.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.784+0000 7eff691c8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558a7ff26fd0 0x558a7ff24280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44826/0 (socket says 172.21.15.87:44826) 2024-09-13T17:19:19.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.784+0000 7eff691c8640 1 -- 172.21.15.87:0/465760710 learned_addr learned my addr 172.21.15.87:0/465760710 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:19.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.785+0000 7eff5bfff640 1 --2- 172.21.15.87:0/465760710 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558a7ff1c730 0x558a7ff23c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:19.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.785+0000 7eff689c7640 1 --2- 172.21.15.87:0/465760710 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558a7ff1be10 0x558a7ff269a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:19.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.785+0000 7eff691c8640 1 -- 172.21.15.87:0/465760710 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558a7ff1c730 msgr2=0x558a7ff23c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:19.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.785+0000 7eff691c8640 1 --2- 172.21.15.87:0/465760710 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558a7ff1c730 0x558a7ff23c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.785+0000 7eff691c8640 1 -- 172.21.15.87:0/465760710 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558a7ff1be10 msgr2=0x558a7ff269a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:19.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.785+0000 7eff691c8640 1 --2- 172.21.15.87:0/465760710 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558a7ff1be10 0x558a7ff269a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.785+0000 7eff691c8640 1 -- 172.21.15.87:0/465760710 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff641a55c0 con 0x558a7ff26fd0 2024-09-13T17:19:19.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.785+0000 7eff5bfff640 1 --2- 172.21.15.87:0/465760710 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558a7ff1c730 0x558a7ff23c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:19.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.785+0000 7eff691c8640 1 --2- 172.21.15.87:0/465760710 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558a7ff26fd0 0x558a7ff24280 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7eff5c012c10 tx=0x7eff5c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=897695916ad3091b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:19.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.785+0000 7eff43fff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:19:19.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.785+0000 7eff43fff640 1 -- 172.21.15.87:0/465760710 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c012d00 con 0x558a7ff26fd0 2024-09-13T17:19:19.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.785+0000 7eff43fff640 1 -- 172.21.15.87:0/465760710 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7eff5c004b20 con 0x558a7ff26fd0 2024-09-13T17:19:19.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.785+0000 7eff6da29740 1 -- 172.21.15.87:0/465760710 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558a7fb734e0 con 0x558a7ff26fd0 2024-09-13T17:19:19.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.785+0000 7eff43fff640 1 -- 172.21.15.87:0/465760710 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff5c012e60 con 0x558a7ff26fd0 2024-09-13T17:19:19.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.785+0000 7eff6da29740 10 client.17133 fetch_fsmap learned FSMap version 32 2024-09-13T17:19:19.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.785+0000 7eff6da29740 1 -- 172.21.15.87:0/465760710 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x558a7fe7e620 con 0x558a7ff26fd0 2024-09-13T17:19:19.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.785+0000 7eff43fff640 1 -- 172.21.15.87:0/465760710 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x558a7fb734e0 con 0x558a7ff26fd0 2024-09-13T17:19:19.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.785+0000 7eff43fff640 1 -- 172.21.15.87:0/465760710 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 32) v1 ==== 7486+0+0 (secure 0 0 0) 0x7eff5c01d040 con 0x558a7ff26fd0 2024-09-13T17:19:19.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.786+0000 7eff6da29740 10 client.17133 fetch_fsmap finished waiting for FSMap version 32 2024-09-13T17:19:19.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.786+0000 7eff6da29740 10 client.17133 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:19:19.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.786+0000 7eff6da29740 20 client.17133 populate_metadata read hostname 'smithi087' 2024-09-13T17:19:19.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.786+0000 7eff6da29740 1 --2- 172.21.15.87:0/465760710 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x558a7ff36d30 0x558a7ff39150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.786+0000 7eff6da29740 4 client.17133 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:19:19.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.786+0000 7eff6da29740 1 -- 172.21.15.87:0/465760710 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558a7fb847e0 con 0x558a7ff36d30 2024-09-13T17:19:19.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.786+0000 7eff689c7640 1 --2- 172.21.15.87:0/465760710 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x558a7ff36d30 0x558a7ff39150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:19.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.786+0000 7eff43fff640 10 client.17133 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:19.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.786+0000 7eff689c7640 1 --2- 172.21.15.87:0/465760710 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x558a7ff36d30 0x558a7ff39150 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d47ee5e65c6fb28 server_cookie=1605875631dababf in_seq=0 out_seq=0 2024-09-13T17:19:19.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.787+0000 7eff43fff640 1 -- 172.21.15.87:0/465760710 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x558a7fb847e0 con 0x558a7ff36d30 2024-09-13T17:19:19.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.787+0000 7eff43fff640 10 client.17133 handle_command_reply: tid=0 2024-09-13T17:19:19.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.787+0000 7eff6da29740 1 client.17133 shutdown 2024-09-13T17:19:19.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.787+0000 7eff6da29740 1 -- 172.21.15.87:0/465760710 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558a7ff26fd0 msgr2=0x558a7ff24280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:19.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.787+0000 7eff6da29740 1 --2- 172.21.15.87:0/465760710 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558a7ff26fd0 0x558a7ff24280 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7eff5c012c10 tx=0x7eff5c004a40 comp rx=0 tx=0).stop 2024-09-13T17:19:19.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.787+0000 7eff6da29740 1 -- 172.21.15.87:0/465760710 shutdown_connections 2024-09-13T17:19:19.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.787+0000 7eff6da29740 1 --2- 172.21.15.87:0/465760710 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x558a7ff36d30 0x558a7ff39150 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.787+0000 7eff6da29740 1 --2- 172.21.15.87:0/465760710 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558a7ff26fd0 0x558a7ff24280 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.787+0000 7eff43fff640 0 client.17133 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:19.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.787+0000 7eff6da29740 1 --2- 172.21.15.87:0/465760710 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558a7ff1c730 0x558a7ff23c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.787+0000 7eff6da29740 1 --2- 172.21.15.87:0/465760710 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558a7ff1be10 0x558a7ff269a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.787+0000 7eff6da29740 1 -- 172.21.15.87:0/465760710 >> 172.21.15.87:0/465760710 conn(0x558a7ff18380 msgr2=0x558a7ff1e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:19.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.787+0000 7eff6da29740 1 -- 172.21.15.87:0/465760710 shutdown_connections 2024-09-13T17:19:19.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.787+0000 7eff6da29740 1 -- 172.21.15.87:0/465760710 wait complete. 2024-09-13T17:19:19.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.787+0000 7eff6da29740 20 client.17133 trim_cache size 0 max 16384 2024-09-13T17:19:19.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.801+0000 7eff6da29740 1 Processor -- start 2024-09-13T17:19:19.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.801+0000 7eff6da29740 1 -- start start 2024-09-13T17:19:19.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.801+0000 7eff6da29740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558a7ff18380 0x558a7ff17d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.801+0000 7eff6da29740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558a7ff1be10 0x558a7ff2dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.801+0000 7eff6da29740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558a7ff1c730 0x558a7ff2e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.801+0000 7eff6da29740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7ff24880 con 0x558a7ff1c730 2024-09-13T17:19:19.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.801+0000 7eff6da29740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7ff26590 con 0x558a7ff1be10 2024-09-13T17:19:19.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.801+0000 7eff6da29740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7ff35490 con 0x558a7ff18380 2024-09-13T17:19:19.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.801+0000 7eff691c8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558a7ff1c730 0x558a7ff2e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:19.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.801+0000 7eff691c8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558a7ff1c730 0x558a7ff2e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44832/0 (socket says 172.21.15.87:44832) 2024-09-13T17:19:19.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.801+0000 7eff691c8640 1 -- 172.21.15.87:0/3942471627 learned_addr learned my addr 172.21.15.87:0/3942471627 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:19.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.801+0000 7eff689c7640 1 --2- 172.21.15.87:0/3942471627 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558a7ff18380 0x558a7ff17d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:19.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.802+0000 7eff5bfff640 1 --2- 172.21.15.87:0/3942471627 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558a7ff1be10 0x558a7ff2dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:19.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.802+0000 7eff691c8640 1 -- 172.21.15.87:0/3942471627 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558a7ff18380 msgr2=0x558a7ff17d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:19.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.802+0000 7eff691c8640 1 --2- 172.21.15.87:0/3942471627 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558a7ff18380 0x558a7ff17d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.802+0000 7eff691c8640 1 -- 172.21.15.87:0/3942471627 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558a7ff1be10 msgr2=0x558a7ff2dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:19.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.802+0000 7eff691c8640 1 --2- 172.21.15.87:0/3942471627 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558a7ff1be10 0x558a7ff2dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.802+0000 7eff691c8640 1 -- 172.21.15.87:0/3942471627 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a7fe20790 con 0x558a7ff1c730 2024-09-13T17:19:19.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.802+0000 7eff5bfff640 1 --2- 172.21.15.87:0/3942471627 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558a7ff1be10 0x558a7ff2dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:19.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.802+0000 7eff689c7640 1 --2- 172.21.15.87:0/3942471627 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558a7ff18380 0x558a7ff17d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:19.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.802+0000 7eff691c8640 1 --2- 172.21.15.87:0/3942471627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558a7ff1c730 0x558a7ff2e150 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7eff5c0127f0 tx=0x7eff5c012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b9d0ba2385a96fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:19.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.802+0000 7eff4b7fe640 1 -- 172.21.15.87:0/3942471627 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c011c40 con 0x558a7ff1c730 2024-09-13T17:19:19.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.802+0000 7eff4b7fe640 1 -- 172.21.15.87:0/3942471627 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7eff5c009c40 con 0x558a7ff1c730 2024-09-13T17:19:19.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.802+0000 7eff4b7fe640 1 -- 172.21.15.87:0/3942471627 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c027600 con 0x558a7ff1c730 2024-09-13T17:19:19.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.802+0000 7eff6da29740 1 -- 172.21.15.87:0/3942471627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558a7ff1c730 msgr2=0x558a7ff2e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:19.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.803+0000 7eff6da29740 1 --2- 172.21.15.87:0/3942471627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558a7ff1c730 0x558a7ff2e150 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7eff5c0127f0 tx=0x7eff5c012820 comp rx=0 tx=0).stop 2024-09-13T17:19:19.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.803+0000 7eff6da29740 1 -- 172.21.15.87:0/3942471627 shutdown_connections 2024-09-13T17:19:19.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.803+0000 7eff6da29740 1 --2- 172.21.15.87:0/3942471627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558a7ff1c730 0x558a7ff2e150 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.803+0000 7eff6da29740 1 --2- 172.21.15.87:0/3942471627 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558a7ff1be10 0x558a7ff2dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.803+0000 7eff6da29740 1 --2- 172.21.15.87:0/3942471627 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558a7ff18380 0x558a7ff17d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.803+0000 7eff6da29740 1 -- 172.21.15.87:0/3942471627 >> 172.21.15.87:0/3942471627 conn(0x558a7ff26b00 msgr2=0x558a7ff3dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:19.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.803+0000 7eff6da29740 1 -- 172.21.15.87:0/3942471627 shutdown_connections 2024-09-13T17:19:19.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.803+0000 7eff6da29740 1 -- 172.21.15.87:0/3942471627 wait complete. 2024-09-13T17:19:19.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.803+0000 7eff6da29740 1 -- start start 2024-09-13T17:19:19.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.803+0000 7eff6da29740 1 Processor -- start 2024-09-13T17:19:19.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.803+0000 7eff6da29740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558a7ff18380 0x558a7ff2dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.803+0000 7eff6da29740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558a7ff1be10 0x558a7ff2a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.803+0000 7eff6da29740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558a7ff1c730 0x558a7ff2a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.803+0000 7eff6da29740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7ff2ac50 con 0x558a7ff1be10 2024-09-13T17:19:19.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.803+0000 7eff6da29740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7ff2adc0 con 0x558a7ff1c730 2024-09-13T17:19:19.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.803+0000 7eff6da29740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7ff2af80 con 0x558a7ff18380 2024-09-13T17:19:19.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.803+0000 7eff6da29740 10 client.0 _ll_register_callbacks cb 0x7eff5c016050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:19.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.803+0000 7eff5bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558a7ff1be10 0x558a7ff2a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:19.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.803+0000 7eff5bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558a7ff1be10 0x558a7ff2a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44844/0 (socket says 172.21.15.87:44844) 2024-09-13T17:19:19.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.803+0000 7eff5bfff640 1 -- 172.21.15.87:0/1497431535 learned_addr learned my addr 172.21.15.87:0/1497431535 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:19.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.804+0000 7eff689c7640 1 --2- 172.21.15.87:0/1497431535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558a7ff18380 0x558a7ff2dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:19.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.804+0000 7eff691c8640 1 --2- 172.21.15.87:0/1497431535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558a7ff1c730 0x558a7ff2a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:19.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.804+0000 7eff5bfff640 1 -- 172.21.15.87:0/1497431535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558a7ff18380 msgr2=0x558a7ff2dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:19.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.804+0000 7eff5bfff640 1 --2- 172.21.15.87:0/1497431535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558a7ff18380 0x558a7ff2dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.804+0000 7eff5bfff640 1 -- 172.21.15.87:0/1497431535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558a7ff1c730 msgr2=0x558a7ff2a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:19.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.804+0000 7eff5bfff640 1 --2- 172.21.15.87:0/1497431535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558a7ff1c730 0x558a7ff2a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.804+0000 7eff5bfff640 1 -- 172.21.15.87:0/1497431535 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558a7fe7e620 con 0x558a7ff1be10 2024-09-13T17:19:19.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.804+0000 7eff5bfff640 1 --2- 172.21.15.87:0/1497431535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558a7ff1be10 0x558a7ff2a1d0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7eff54005940 tx=0x7eff54032f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df29806cbeba5be8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:19.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.804+0000 7eff43fff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:19:19.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.804+0000 7eff43fff640 1 -- 172.21.15.87:0/1497431535 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff54031780 con 0x558a7ff1be10 2024-09-13T17:19:19.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.804+0000 7eff43fff640 1 -- 172.21.15.87:0/1497431535 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7eff54004040 con 0x558a7ff1be10 2024-09-13T17:19:19.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.804+0000 7eff6da29740 1 -- 172.21.15.87:0/1497431535 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7eff6009d950 con 0x558a7ff1be10 2024-09-13T17:19:19.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.804+0000 7eff43fff640 1 -- 172.21.15.87:0/1497431535 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff54004200 con 0x558a7ff1be10 2024-09-13T17:19:19.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.804+0000 7eff6da29740 10 client.17139 fetch_fsmap learned FSMap version 32 2024-09-13T17:19:19.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.804+0000 7eff6da29740 1 -- 172.21.15.87:0/1497431535 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x558a7fe45ea0 con 0x558a7ff1be10 2024-09-13T17:19:19.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.804+0000 7eff43fff640 1 -- 172.21.15.87:0/1497431535 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7eff6009d950 con 0x558a7ff1be10 2024-09-13T17:19:19.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.805+0000 7eff43fff640 1 -- 172.21.15.87:0/1497431535 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 32) v1 ==== 7486+0+0 (secure 0 0 0) 0x7eff540049c0 con 0x558a7ff1be10 2024-09-13T17:19:19.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.805+0000 7eff6da29740 10 client.17139 fetch_fsmap finished waiting for FSMap version 32 2024-09-13T17:19:19.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.805+0000 7eff6da29740 10 client.17139 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:19:19.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.805+0000 7eff6da29740 20 client.17139 populate_metadata read hostname 'smithi087' 2024-09-13T17:19:19.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.805+0000 7eff6da29740 1 --2- 172.21.15.87:0/1497431535 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x558a7ff26fd0 0x558a7ff905d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.805+0000 7eff6da29740 4 client.17139 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:19:19.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.805+0000 7eff6da29740 1 -- 172.21.15.87:0/1497431535 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558a7fbd7e30 con 0x558a7ff26fd0 2024-09-13T17:19:19.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.805+0000 7eff689c7640 1 --2- 172.21.15.87:0/1497431535 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x558a7ff26fd0 0x558a7ff905d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:19.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.805+0000 7eff43fff640 10 client.17139 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:19.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.805+0000 7eff689c7640 1 --2- 172.21.15.87:0/1497431535 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x558a7ff26fd0 0x558a7ff905d0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b646c146e566b3c server_cookie=5172ebe1d9ee2f79 in_seq=0 out_seq=0 2024-09-13T17:19:19.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.805+0000 7eff43fff640 1 -- 172.21.15.87:0/1497431535 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x558a7fbd7e30 con 0x558a7ff26fd0 2024-09-13T17:19:19.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.805+0000 7eff43fff640 10 client.17139 handle_command_reply: tid=0 2024-09-13T17:19:19.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.805+0000 7eff6da29740 1 client.17139 shutdown 2024-09-13T17:19:19.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.805+0000 7eff6da29740 1 -- 172.21.15.87:0/1497431535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558a7ff1be10 msgr2=0x558a7ff2a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:19.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.805+0000 7eff6da29740 1 --2- 172.21.15.87:0/1497431535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558a7ff1be10 0x558a7ff2a1d0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7eff54005940 tx=0x7eff54032f90 comp rx=0 tx=0).stop 2024-09-13T17:19:19.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.806+0000 7eff6da29740 1 -- 172.21.15.87:0/1497431535 shutdown_connections 2024-09-13T17:19:19.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.806+0000 7eff6da29740 1 --2- 172.21.15.87:0/1497431535 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x558a7ff26fd0 0x558a7ff905d0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.806+0000 7eff6da29740 1 --2- 172.21.15.87:0/1497431535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558a7ff1c730 0x558a7ff2a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.806+0000 7eff6da29740 1 --2- 172.21.15.87:0/1497431535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558a7ff1be10 0x558a7ff2a1d0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.806+0000 7eff43fff640 0 client.17139 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:19.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.806+0000 7eff6da29740 1 --2- 172.21.15.87:0/1497431535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558a7ff18380 0x558a7ff2dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.806+0000 7eff6da29740 1 -- 172.21.15.87:0/1497431535 >> 172.21.15.87:0/1497431535 conn(0x558a7ff26b00 msgr2=0x558a7ff1eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:19.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.806+0000 7eff6da29740 1 -- 172.21.15.87:0/1497431535 shutdown_connections 2024-09-13T17:19:19.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.806+0000 7eff6da29740 1 -- 172.21.15.87:0/1497431535 wait complete. 2024-09-13T17:19:19.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.806+0000 7eff6da29740 20 client.17139 trim_cache size 0 max 16384 2024-09-13T17:19:19.816 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:19:19.816 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "no active scrubs running", 2024-09-13T17:19:19.816 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": {} 2024-09-13T17:19:19.816 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:19:19.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.806+0000 7eff6ac2b640 1 -- 172.21.15.87:0/2980758221 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7eff4c0a1280 msgr2=0x7eff4c0a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:19.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.806+0000 7eff6ac2b640 1 --2- 172.21.15.87:0/2980758221 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7eff4c0a1280 0x7eff4c0a3740 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7eff5c005c40 tx=0x7eff5c010740 comp rx=0 tx=0).stop 2024-09-13T17:19:19.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.806+0000 7eff6ac2b640 1 -- 172.21.15.87:0/2980758221 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff640fee50 msgr2=0x7eff641008e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:19.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.806+0000 7eff6ac2b640 1 --2- 172.21.15.87:0/2980758221 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff640fee50 0x7eff641008e0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7eff6000d950 tx=0x7eff6000de10 comp rx=0 tx=0).stop 2024-09-13T17:19:19.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.806+0000 7eff6ac2b640 1 -- 172.21.15.87:0/2980758221 shutdown_connections 2024-09-13T17:19:19.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.806+0000 7eff6ac2b640 1 --2- 172.21.15.87:0/2980758221 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff64101360 0x7eff641a4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.806+0000 7eff6ac2b640 1 --2- 172.21.15.87:0/2980758221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff64103fa0 0x7eff64100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.806+0000 7eff6ac2b640 1 --2- 172.21.15.87:0/2980758221 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7eff4c0a1280 0x7eff4c0a3740 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.806+0000 7eff6ac2b640 1 --2- 172.21.15.87:0/2980758221 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff640fee50 0x7eff641008e0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.806+0000 7eff6ac2b640 1 -- 172.21.15.87:0/2980758221 >> 172.21.15.87:0/2980758221 conn(0x7eff640fa8c0 msgr2=0x7eff640689e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:19.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.806+0000 7eff6ac2b640 1 -- 172.21.15.87:0/2980758221 shutdown_connections 2024-09-13T17:19:19.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.806+0000 7eff6ac2b640 1 -- 172.21.15.87:0/2980758221 wait complete. 2024-09-13T17:19:19.818 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:19 smithi087 ceph-mon[30934]: pgmap v168: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-13T17:19:19.819 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T17:19:19.819 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:19:19.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:19 smithi149 ceph-mon[35496]: pgmap v168: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-13T17:19:19.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:19 smithi118 ceph-mon[34374]: pgmap v168: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-13T17:19:19.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.917+0000 7f79719ff640 1 -- 172.21.15.87:0/1722864340 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f796c104070 msgr2=0x7f796c10bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:19.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.917+0000 7f79719ff640 1 --2- 172.21.15.87:0/1722864340 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f796c104070 0x7f796c10bbc0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f7964009cd0 tx=0x7f796402a8e0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.917+0000 7f79719ff640 1 -- 172.21.15.87:0/1722864340 shutdown_connections 2024-09-13T17:19:19.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.917+0000 7f79719ff640 1 --2- 172.21.15.87:0/1722864340 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f796c104070 0x7f796c10bbc0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.917+0000 7f79719ff640 1 --2- 172.21.15.87:0/1722864340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f796c0ff8d0 0x7f796c103910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.917+0000 7f79719ff640 1 --2- 172.21.15.87:0/1722864340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f796c0fef20 0x7f796c0ff300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.917+0000 7f79719ff640 1 -- 172.21.15.87:0/1722864340 >> 172.21.15.87:0/1722864340 conn(0x7f796c0fa970 msgr2=0x7f796c0fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:19.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.917+0000 7f79719ff640 1 -- 172.21.15.87:0/1722864340 shutdown_connections 2024-09-13T17:19:19.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.917+0000 7f79719ff640 1 -- 172.21.15.87:0/1722864340 wait complete. 2024-09-13T17:19:19.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.918+0000 7f79719ff640 1 Processor -- start 2024-09-13T17:19:19.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.918+0000 7f79719ff640 1 -- start start 2024-09-13T17:19:19.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.918+0000 7f79719ff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f796c0fef20 0x7f796c1009b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.918+0000 7f79719ff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f796c104070 0x7f796c100ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.918+0000 7f79719ff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f796c101430 0x7f796c1a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.918+0000 7f79719ff640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c1a4aa0 con 0x7f796c101430 2024-09-13T17:19:19.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.918+0000 7f79719ff640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c1a4c10 con 0x7f796c0fef20 2024-09-13T17:19:19.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.918+0000 7f79719ff640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c1a4dd0 con 0x7f796c104070 2024-09-13T17:19:19.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.918+0000 7f796b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f796c101430 0x7f796c1a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:19.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.918+0000 7f796b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f796c101430 0x7f796c1a44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44864/0 (socket says 172.21.15.87:44864) 2024-09-13T17:19:19.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.918+0000 7f796b7fe640 1 -- 172.21.15.87:0/275671563 learned_addr learned my addr 172.21.15.87:0/275671563 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:19.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.918+0000 7f796b7fe640 1 -- 172.21.15.87:0/275671563 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f796c104070 msgr2=0x7f796c100ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:19.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.918+0000 7f796a7fc640 1 --2- 172.21.15.87:0/275671563 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f796c104070 0x7f796c100ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:19.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.918+0000 7f796b7fe640 1 --2- 172.21.15.87:0/275671563 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f796c104070 0x7f796c100ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.918+0000 7f796b7fe640 1 -- 172.21.15.87:0/275671563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f796c0fef20 msgr2=0x7f796c1009b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:19.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.918+0000 7f796b7fe640 1 --2- 172.21.15.87:0/275671563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f796c0fef20 0x7f796c1009b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:19.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.918+0000 7f796b7fe640 1 -- 172.21.15.87:0/275671563 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7964009900 con 0x7f796c101430 2024-09-13T17:19:19.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.919+0000 7f796b7fe640 1 --2- 172.21.15.87:0/275671563 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f796c101430 0x7f796c1a44d0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f7964005cc0 tx=0x7f7964030850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:19.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.919+0000 7f79709fd640 1 -- 172.21.15.87:0/275671563 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7964031d00 con 0x7f796c101430 2024-09-13T17:19:19.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.919+0000 7f79719ff640 1 -- 172.21.15.87:0/275671563 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f796c1a5050 con 0x7f796c101430 2024-09-13T17:19:19.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.919+0000 7f79709fd640 1 -- 172.21.15.87:0/275671563 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7964003e20 con 0x7f796c101430 2024-09-13T17:19:19.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.919+0000 7f79709fd640 1 -- 172.21.15.87:0/275671563 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7964045410 con 0x7f796c101430 2024-09-13T17:19:19.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.919+0000 7f79719ff640 1 -- 172.21.15.87:0/275671563 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796c1a55b0 con 0x7f796c101430 2024-09-13T17:19:19.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.920+0000 7f79719ff640 1 -- 172.21.15.87:0/275671563 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f796c1003f0 con 0x7f796c101430 2024-09-13T17:19:19.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.921+0000 7f79709fd640 1 -- 172.21.15.87:0/275671563 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f796400a040 con 0x7f796c101430 2024-09-13T17:19:19.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.921+0000 7f79709fd640 1 --2- 172.21.15.87:0/275671563 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f79540a1230 0x7f79540a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:19.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.922+0000 7f79709fd640 1 -- 172.21.15.87:0/275671563 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f79640eeaa0 con 0x7f796c101430 2024-09-13T17:19:19.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.922+0000 7f796affd640 1 --2- 172.21.15.87:0/275671563 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f79540a1230 0x7f79540a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:19.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.922+0000 7f796affd640 1 --2- 172.21.15.87:0/275671563 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f79540a1230 0x7f79540a36f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f795c005fd0 tx=0x7f795c005850 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:19.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:19.925+0000 7f79709fd640 1 -- 172.21.15.87:0/275671563 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f796407fe20 con 0x7f796c101430 2024-09-13T17:19:20.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.121+0000 7f79719ff640 1 -- 172.21.15.87:0/275671563 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f796c0ff300 con 0x7f796c101430 2024-09-13T17:19:20.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.121+0000 7f79709fd640 1 -- 172.21.15.87:0/275671563 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+10882 (secure 0 0 0) 0x7f79640bb660 con 0x7f796c101430 2024-09-13T17:19:20.122 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:19:20.123 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/3674545180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":3674545180},{"type":"v1","addr":"172.21.15.87:6841","nonce":3674545180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":32,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:11:23.313609+0000","modified":"2024-09-13T17:19:10.567661+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24484,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6839/3052680456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3052680456},{"type":"v1","addr":"172.21.15.118:6839","nonce":3052680456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:19:20.123 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 32 2024-09-13T17:19:20.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.123+0000 7f79719ff640 1 -- 172.21.15.87:0/275671563 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f79540a1230 msgr2=0x7f79540a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:20.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.123+0000 7f79719ff640 1 --2- 172.21.15.87:0/275671563 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f79540a1230 0x7f79540a36f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f795c005fd0 tx=0x7f795c005850 comp rx=0 tx=0).stop 2024-09-13T17:19:20.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.123+0000 7f79719ff640 1 -- 172.21.15.87:0/275671563 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f796c101430 msgr2=0x7f796c1a44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:20.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.123+0000 7f79719ff640 1 --2- 172.21.15.87:0/275671563 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f796c101430 0x7f796c1a44d0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f7964005cc0 tx=0x7f7964030850 comp rx=0 tx=0).stop 2024-09-13T17:19:20.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.123+0000 7f79719ff640 1 -- 172.21.15.87:0/275671563 shutdown_connections 2024-09-13T17:19:20.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.123+0000 7f79719ff640 1 --2- 172.21.15.87:0/275671563 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f79540a1230 0x7f79540a36f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.123+0000 7f79719ff640 1 --2- 172.21.15.87:0/275671563 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f796c101430 0x7f796c1a44d0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.123+0000 7f79719ff640 1 --2- 172.21.15.87:0/275671563 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f796c104070 0x7f796c100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.123+0000 7f79719ff640 1 --2- 172.21.15.87:0/275671563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f796c0fef20 0x7f796c1009b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.123+0000 7f79719ff640 1 -- 172.21.15.87:0/275671563 >> 172.21.15.87:0/275671563 conn(0x7f796c0fa970 msgr2=0x7f796c0688c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:20.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.124+0000 7f79719ff640 1 -- 172.21.15.87:0/275671563 shutdown_connections 2024-09-13T17:19:20.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.124+0000 7f79719ff640 1 -- 172.21.15.87:0/275671563 wait complete. 2024-09-13T17:19:20.136 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-09-13T17:19:20.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.235+0000 7fda32fb5640 1 -- 172.21.15.87:0/3589252537 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda2c1050a0 msgr2=0x7fda2c10cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:20.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.235+0000 7fda32fb5640 1 --2- 172.21.15.87:0/3589252537 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda2c1050a0 0x7fda2c10cbf0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fda24009cd0 tx=0x7fda2402a8e0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.235+0000 7fda32fb5640 1 -- 172.21.15.87:0/3589252537 shutdown_connections 2024-09-13T17:19:20.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.235+0000 7fda32fb5640 1 --2- 172.21.15.87:0/3589252537 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda2c1050a0 0x7fda2c10cbf0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.235+0000 7fda32fb5640 1 --2- 172.21.15.87:0/3589252537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda2c100900 0x7fda2c104940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.235+0000 7fda32fb5640 1 --2- 172.21.15.87:0/3589252537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda2c0fff50 0x7fda2c100330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.235+0000 7fda32fb5640 1 -- 172.21.15.87:0/3589252537 >> 172.21.15.87:0/3589252537 conn(0x7fda2c0fb9e0 msgr2=0x7fda2c0fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:20.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.235+0000 7fda32fb5640 1 -- 172.21.15.87:0/3589252537 shutdown_connections 2024-09-13T17:19:20.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.235+0000 7fda32fb5640 1 -- 172.21.15.87:0/3589252537 wait complete. 2024-09-13T17:19:20.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.235+0000 7fda32fb5640 1 Processor -- start 2024-09-13T17:19:20.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.235+0000 7fda32fb5640 1 -- start start 2024-09-13T17:19:20.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.235+0000 7fda32fb5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda2c0fff50 0x7fda2c1962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.235+0000 7fda32fb5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda2c1050a0 0x7fda2c196820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.235+0000 7fda32fb5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda2c19ac10 0x7fda2c19b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.235+0000 7fda32fb5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c19b600 con 0x7fda2c19ac10 2024-09-13T17:19:20.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.235+0000 7fda32fb5640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c19b770 con 0x7fda2c0fff50 2024-09-13T17:19:20.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.235+0000 7fda32fb5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c19b8e0 con 0x7fda2c1050a0 2024-09-13T17:19:20.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.236+0000 7fda31552640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda2c19ac10 0x7fda2c19b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.236+0000 7fda31552640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda2c19ac10 0x7fda2c19b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44882/0 (socket says 172.21.15.87:44882) 2024-09-13T17:19:20.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.236+0000 7fda31552640 1 -- 172.21.15.87:0/2320894910 learned_addr learned my addr 172.21.15.87:0/2320894910 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:20.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.236+0000 7fda2bfff640 1 --2- 172.21.15.87:0/2320894910 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda2c1050a0 0x7fda2c196820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.236+0000 7fda30d51640 1 --2- 172.21.15.87:0/2320894910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda2c0fff50 0x7fda2c1962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.236+0000 7fda31552640 1 -- 172.21.15.87:0/2320894910 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda2c1050a0 msgr2=0x7fda2c196820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:20.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.236+0000 7fda31552640 1 --2- 172.21.15.87:0/2320894910 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda2c1050a0 0x7fda2c196820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.236+0000 7fda31552640 1 -- 172.21.15.87:0/2320894910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda2c0fff50 msgr2=0x7fda2c1962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:20.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.236+0000 7fda31552640 1 --2- 172.21.15.87:0/2320894910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda2c0fff50 0x7fda2c1962e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.236+0000 7fda31552640 1 -- 172.21.15.87:0/2320894910 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda24009900 con 0x7fda2c19ac10 2024-09-13T17:19:20.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.236+0000 7fda30d51640 1 --2- 172.21.15.87:0/2320894910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda2c0fff50 0x7fda2c1962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:20.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.236+0000 7fda31552640 1 --2- 172.21.15.87:0/2320894910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda2c19ac10 0x7fda2c19b0c0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fda24005cc0 tx=0x7fda24030850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:20.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.236+0000 7fda29ffb640 1 -- 172.21.15.87:0/2320894910 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda24031d00 con 0x7fda2c19ac10 2024-09-13T17:19:20.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.236+0000 7fda29ffb640 1 -- 172.21.15.87:0/2320894910 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fda24003e20 con 0x7fda2c19ac10 2024-09-13T17:19:20.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.236+0000 7fda32fb5640 1 -- 172.21.15.87:0/2320894910 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda2c1a2ec0 con 0x7fda2c19ac10 2024-09-13T17:19:20.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.236+0000 7fda29ffb640 1 -- 172.21.15.87:0/2320894910 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda24045410 con 0x7fda2c19ac10 2024-09-13T17:19:20.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.236+0000 7fda32fb5640 1 -- 172.21.15.87:0/2320894910 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda2c1a3340 con 0x7fda2c19ac10 2024-09-13T17:19:20.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.239+0000 7fda29ffb640 1 -- 172.21.15.87:0/2320894910 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fda2400a040 con 0x7fda2c19ac10 2024-09-13T17:19:20.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.239+0000 7fda35cd5740 1 Processor -- start 2024-09-13T17:19:20.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.239+0000 7fda35cd5740 1 -- start start 2024-09-13T17:19:20.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.239+0000 7fda35cd5740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56154d610790 0x56154d610b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.239+0000 7fda35cd5740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56154d6110b0 0x56154d61b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.239+0000 7fda35cd5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56154d61b950 0x56154d61dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.239+0000 7fda35cd5740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56154d57acc0 con 0x56154d610790 2024-09-13T17:19:20.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.239+0000 7fda35cd5740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56154d578450 con 0x56154d6110b0 2024-09-13T17:19:20.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.239+0000 7fda35cd5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56154d573d40 con 0x56154d61b950 2024-09-13T17:19:20.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.239+0000 7fda29ffb640 1 --2- 172.21.15.87:0/2320894910 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fda1c0a1200 0x7fda1c0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.239+0000 7fda2bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56154d610790 0x56154d610b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.239+0000 7fda2bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56154d610790 0x56154d610b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44888/0 (socket says 172.21.15.87:44888) 2024-09-13T17:19:20.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.239+0000 7fda2bfff640 1 -- 172.21.15.87:0/390798957 learned_addr learned my addr 172.21.15.87:0/390798957 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:20.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.239+0000 7fda31552640 1 --2- 172.21.15.87:0/2320894910 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fda1c0a1200 0x7fda1c0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.240+0000 7fda2bfff640 1 --2- 172.21.15.87:0/390798957 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56154d61b950 0x56154d61dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.240+0000 7fda30d51640 1 --2- 172.21.15.87:0/390798957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56154d6110b0 0x56154d61b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.240+0000 7fda2bfff640 1 -- 172.21.15.87:0/390798957 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56154d61b950 msgr2=0x56154d61dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:20.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.240+0000 7fda29ffb640 1 -- 172.21.15.87:0/2320894910 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fda240ee920 con 0x7fda2c19ac10 2024-09-13T17:19:20.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.240+0000 7fda2bfff640 1 --2- 172.21.15.87:0/390798957 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56154d61b950 0x56154d61dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.240+0000 7fda2bfff640 1 -- 172.21.15.87:0/390798957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56154d6110b0 msgr2=0x56154d61b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:20.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.240+0000 7fda2bfff640 1 --2- 172.21.15.87:0/390798957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56154d6110b0 0x56154d61b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.240+0000 7fda2bfff640 1 -- 172.21.15.87:0/390798957 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56154d53b620 con 0x56154d610790 2024-09-13T17:19:20.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.240+0000 7fda2bfff640 1 --2- 172.21.15.87:0/390798957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56154d610790 0x56154d610b70 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fda18013470 tx=0x7fda1800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc652f6adc86d814 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:20.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.240+0000 7fda31552640 1 --2- 172.21.15.87:0/2320894910 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fda1c0a1200 0x7fda1c0a36c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fda240ebd70 tx=0x7fda240db040 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:20.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.240+0000 7fda16ffd640 1 -- 172.21.15.87:0/390798957 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda18019070 con 0x56154d610790 2024-09-13T17:19:20.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.240+0000 7fda16ffd640 1 -- 172.21.15.87:0/390798957 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fda18013110 con 0x56154d610790 2024-09-13T17:19:20.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.240+0000 7fda16ffd640 1 -- 172.21.15.87:0/390798957 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1800f620 con 0x56154d610790 2024-09-13T17:19:20.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.241+0000 7fda35cd5740 1 -- 172.21.15.87:0/390798957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56154d610790 msgr2=0x56154d610b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:20.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.241+0000 7fda35cd5740 1 --2- 172.21.15.87:0/390798957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56154d610790 0x56154d610b70 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fda18013470 tx=0x7fda1800b890 comp rx=0 tx=0).stop 2024-09-13T17:19:20.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.241+0000 7fda35cd5740 1 -- 172.21.15.87:0/390798957 shutdown_connections 2024-09-13T17:19:20.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.241+0000 7fda35cd5740 1 --2- 172.21.15.87:0/390798957 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56154d61b950 0x56154d61dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.241+0000 7fda35cd5740 1 --2- 172.21.15.87:0/390798957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56154d6110b0 0x56154d61b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.241+0000 7fda35cd5740 1 --2- 172.21.15.87:0/390798957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56154d610790 0x56154d610b70 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.241+0000 7fda35cd5740 1 -- 172.21.15.87:0/390798957 >> 172.21.15.87:0/390798957 conn(0x56154d60cd00 msgr2=0x56154d60d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:20.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.241+0000 7fda35cd5740 1 -- 172.21.15.87:0/390798957 shutdown_connections 2024-09-13T17:19:20.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.241+0000 7fda35cd5740 1 -- 172.21.15.87:0/390798957 wait complete. 2024-09-13T17:19:20.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.241+0000 7fda35cd5740 1 -- start start 2024-09-13T17:19:20.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.241+0000 7fda35cd5740 1 Processor -- start 2024-09-13T17:19:20.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.241+0000 7fda35cd5740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56154d610790 0x56154d61ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.241+0000 7fda35cd5740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56154d6110b0 0x56154d61b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.241+0000 7fda35cd5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56154d61b950 0x56154d618400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.242+0000 7fda35cd5740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56154d532180 con 0x56154d610790 2024-09-13T17:19:20.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.242+0000 7fda35cd5740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56154d24c430 con 0x56154d6110b0 2024-09-13T17:19:20.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.242+0000 7fda35cd5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56154d4f75e0 con 0x56154d61b950 2024-09-13T17:19:20.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.242+0000 7fda35cd5740 10 client.0 _ll_register_callbacks cb 0x56154d563aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:20.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.242+0000 7fda2bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56154d610790 0x56154d61ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.242+0000 7fda2bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56154d610790 0x56154d61ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44898/0 (socket says 172.21.15.87:44898) 2024-09-13T17:19:20.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.242+0000 7fda2bfff640 1 -- 172.21.15.87:0/132848957 learned_addr learned my addr 172.21.15.87:0/132848957 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:20.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.242+0000 7fda2bfff640 1 -- 172.21.15.87:0/132848957 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56154d61b950 msgr2=0x56154d618400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:20.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.242+0000 7fda2bfff640 1 --2- 172.21.15.87:0/132848957 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56154d61b950 0x56154d618400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.242+0000 7fda2bfff640 1 -- 172.21.15.87:0/132848957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56154d6110b0 msgr2=0x56154d61b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:20.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.242+0000 7fda2bfff640 1 --2- 172.21.15.87:0/132848957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56154d6110b0 0x56154d61b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.242+0000 7fda2bfff640 1 -- 172.21.15.87:0/132848957 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1800bd30 con 0x56154d610790 2024-09-13T17:19:20.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.242+0000 7fda2bfff640 1 --2- 172.21.15.87:0/132848957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56154d610790 0x56154d61ae90 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fda18011cd0 tx=0x7fda180042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2d383f5cdad79ac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:20.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.242+0000 7fda0bfff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:19:20.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.242+0000 7fda0bfff640 1 -- 172.21.15.87:0/132848957 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda18019040 con 0x56154d610790 2024-09-13T17:19:20.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.242+0000 7fda0bfff640 1 -- 172.21.15.87:0/132848957 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fda18011840 con 0x56154d610790 2024-09-13T17:19:20.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.242+0000 7fda35cd5740 1 -- 172.21.15.87:0/132848957 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56154d59db80 con 0x56154d610790 2024-09-13T17:19:20.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.242+0000 7fda0bfff640 1 -- 172.21.15.87:0/132848957 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda180044b0 con 0x56154d610790 2024-09-13T17:19:20.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.242+0000 7fda35cd5740 10 client.17157 fetch_fsmap learned FSMap version 32 2024-09-13T17:19:20.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.242+0000 7fda35cd5740 1 -- 172.21.15.87:0/132848957 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x56154d5723c0 con 0x56154d610790 2024-09-13T17:19:20.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.243+0000 7fda0bfff640 1 -- 172.21.15.87:0/132848957 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x56154d59db80 con 0x56154d610790 2024-09-13T17:19:20.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.243+0000 7fda0bfff640 1 -- 172.21.15.87:0/132848957 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 32) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fda1801e530 con 0x56154d610790 2024-09-13T17:19:20.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.243+0000 7fda35cd5740 10 client.17157 fetch_fsmap finished waiting for FSMap version 32 2024-09-13T17:19:20.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.243+0000 7fda35cd5740 10 client.17157 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:19:20.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.243+0000 7fda35cd5740 20 client.17157 populate_metadata read hostname 'smithi087' 2024-09-13T17:19:20.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.243+0000 7fda35cd5740 1 --2- 172.21.15.87:0/132848957 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x56154d62b1c0 0x56154d62d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.243+0000 7fda35cd5740 4 client.17157 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:19:20.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.243+0000 7fda35cd5740 1 -- 172.21.15.87:0/132848957 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56154d5661f0 con 0x56154d62b1c0 2024-09-13T17:19:20.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.243+0000 7fda30d51640 1 --2- 172.21.15.87:0/132848957 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x56154d62b1c0 0x56154d62d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.244+0000 7fda30d51640 1 --2- 172.21.15.87:0/132848957 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x56154d62b1c0 0x56154d62d5e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=48ac635638ab0a00 server_cookie=e56f24ab31e7d7e8 in_seq=0 out_seq=0 2024-09-13T17:19:20.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.244+0000 7fda0bfff640 10 client.17157 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:19:20.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.244+0000 7fda0bfff640 1 -- 172.21.15.87:0/132848957 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x56154d5661f0 con 0x56154d62b1c0 2024-09-13T17:19:20.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.244+0000 7fda0bfff640 10 client.17157 handle_command_reply: tid=0 2024-09-13T17:19:20.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.244+0000 7fda35cd5740 1 client.17157 shutdown 2024-09-13T17:19:20.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.244+0000 7fda35cd5740 1 -- 172.21.15.87:0/132848957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56154d610790 msgr2=0x56154d61ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:20.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.244+0000 7fda35cd5740 1 --2- 172.21.15.87:0/132848957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56154d610790 0x56154d61ae90 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fda18011cd0 tx=0x7fda180042c0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.244+0000 7fda35cd5740 1 -- 172.21.15.87:0/132848957 shutdown_connections 2024-09-13T17:19:20.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.244+0000 7fda35cd5740 1 --2- 172.21.15.87:0/132848957 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x56154d62b1c0 0x56154d62d5e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.244+0000 7fda35cd5740 1 --2- 172.21.15.87:0/132848957 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56154d61b950 0x56154d618400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.244+0000 7fda35cd5740 1 --2- 172.21.15.87:0/132848957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56154d6110b0 0x56154d61b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.244+0000 7fda35cd5740 1 --2- 172.21.15.87:0/132848957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56154d610790 0x56154d61ae90 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.244+0000 7fda0bfff640 0 client.17157 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:19:20.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.244+0000 7fda35cd5740 1 -- 172.21.15.87:0/132848957 >> 172.21.15.87:0/132848957 conn(0x56154d60cd00 msgr2=0x56154d612a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:20.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.244+0000 7fda35cd5740 1 -- 172.21.15.87:0/132848957 shutdown_connections 2024-09-13T17:19:20.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.244+0000 7fda35cd5740 1 -- 172.21.15.87:0/132848957 wait complete. 2024-09-13T17:19:20.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.245+0000 7fda35cd5740 20 client.17157 trim_cache size 0 max 16384 2024-09-13T17:19:20.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.255+0000 7fda35cd5740 1 Processor -- start 2024-09-13T17:19:20.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.255+0000 7fda35cd5740 1 -- start start 2024-09-13T17:19:20.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.255+0000 7fda35cd5740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56154d610790 0x56154d622a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.255+0000 7fda35cd5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56154d6110b0 0x56154d616a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.255+0000 7fda35cd5740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56154d61b950 0x56154d616fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.255+0000 7fda35cd5740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56154d60d8b0 con 0x56154d610790 2024-09-13T17:19:20.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.255+0000 7fda35cd5740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56154d566220 con 0x56154d61b950 2024-09-13T17:19:20.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.255+0000 7fda35cd5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56154d622f70 con 0x56154d6110b0 2024-09-13T17:19:20.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.255+0000 7fda2bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56154d610790 0x56154d622a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.255+0000 7fda2bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56154d610790 0x56154d622a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44900/0 (socket says 172.21.15.87:44900) 2024-09-13T17:19:20.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.255+0000 7fda2bfff640 1 -- 172.21.15.87:0/3057216094 learned_addr learned my addr 172.21.15.87:0/3057216094 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:20.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.256+0000 7fda30d51640 1 --2- 172.21.15.87:0/3057216094 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56154d6110b0 0x56154d616a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.256+0000 7fda2bfff640 1 -- 172.21.15.87:0/3057216094 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56154d6110b0 msgr2=0x56154d616a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:20.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.256+0000 7fda2bfff640 1 --2- 172.21.15.87:0/3057216094 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56154d6110b0 0x56154d616a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.256+0000 7fda2bfff640 1 -- 172.21.15.87:0/3057216094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56154d61b950 msgr2=0x56154d616fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:20.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.256+0000 7fda2bfff640 1 --2- 172.21.15.87:0/3057216094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56154d61b950 0x56154d616fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.256+0000 7fda2bfff640 1 -- 172.21.15.87:0/3057216094 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56154d514770 con 0x56154d610790 2024-09-13T17:19:20.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.256+0000 7fda30d51640 1 --2- 172.21.15.87:0/3057216094 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56154d6110b0 0x56154d616a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:20.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.256+0000 7fda2bfff640 1 --2- 172.21.15.87:0/3057216094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56154d610790 0x56154d622a30 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fda1800b910 tx=0x7fda18013070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb39aed34325e2f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:20.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.256+0000 7fda177fe640 1 -- 172.21.15.87:0/3057216094 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1800bec0 con 0x56154d610790 2024-09-13T17:19:20.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.256+0000 7fda177fe640 1 -- 172.21.15.87:0/3057216094 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fda1801eb30 con 0x56154d610790 2024-09-13T17:19:20.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.256+0000 7fda177fe640 1 -- 172.21.15.87:0/3057216094 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda180267e0 con 0x56154d610790 2024-09-13T17:19:20.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.256+0000 7fda35cd5740 1 -- 172.21.15.87:0/3057216094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56154d610790 msgr2=0x56154d622a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:20.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.256+0000 7fda35cd5740 1 --2- 172.21.15.87:0/3057216094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56154d610790 0x56154d622a30 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fda1800b910 tx=0x7fda18013070 comp rx=0 tx=0).stop 2024-09-13T17:19:20.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.256+0000 7fda35cd5740 1 -- 172.21.15.87:0/3057216094 shutdown_connections 2024-09-13T17:19:20.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.256+0000 7fda35cd5740 1 --2- 172.21.15.87:0/3057216094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56154d61b950 0x56154d616fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.256+0000 7fda35cd5740 1 --2- 172.21.15.87:0/3057216094 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56154d6110b0 0x56154d616a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.256+0000 7fda35cd5740 1 --2- 172.21.15.87:0/3057216094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56154d610790 0x56154d622a30 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.256+0000 7fda35cd5740 1 -- 172.21.15.87:0/3057216094 >> 172.21.15.87:0/3057216094 conn(0x56154d60cd00 msgr2=0x56154d631f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:20.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.257+0000 7fda35cd5740 1 -- 172.21.15.87:0/3057216094 shutdown_connections 2024-09-13T17:19:20.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.257+0000 7fda35cd5740 1 -- 172.21.15.87:0/3057216094 wait complete. 2024-09-13T17:19:20.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.257+0000 7fda35cd5740 1 -- start start 2024-09-13T17:19:20.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.257+0000 7fda35cd5740 1 Processor -- start 2024-09-13T17:19:20.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.257+0000 7fda35cd5740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56154d610790 0x56154d67e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.257+0000 7fda35cd5740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56154d6110b0 0x56154d67e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.257+0000 7fda35cd5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56154d61b950 0x56154d679750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.257+0000 7fda35cd5740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56154d679d10 con 0x56154d610790 2024-09-13T17:19:20.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.257+0000 7fda35cd5740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56154d679e80 con 0x56154d6110b0 2024-09-13T17:19:20.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.257+0000 7fda35cd5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56154d67a040 con 0x56154d61b950 2024-09-13T17:19:20.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.257+0000 7fda35cd5740 10 client.0 _ll_register_callbacks cb 0x7fda1800b420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:20.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.257+0000 7fda2bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56154d610790 0x56154d67e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.257+0000 7fda2bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56154d610790 0x56154d67e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44910/0 (socket says 172.21.15.87:44910) 2024-09-13T17:19:20.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.257+0000 7fda2bfff640 1 -- 172.21.15.87:0/2610267124 learned_addr learned my addr 172.21.15.87:0/2610267124 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:20.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.257+0000 7fda2bfff640 1 -- 172.21.15.87:0/2610267124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56154d61b950 msgr2=0x56154d679750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:20.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.258+0000 7fda2bfff640 1 --2- 172.21.15.87:0/2610267124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56154d61b950 0x56154d679750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.258+0000 7fda2bfff640 1 -- 172.21.15.87:0/2610267124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56154d6110b0 msgr2=0x56154d67e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:20.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.258+0000 7fda30d51640 1 --2- 172.21.15.87:0/2610267124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56154d6110b0 0x56154d67e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.258+0000 7fda2bfff640 1 --2- 172.21.15.87:0/2610267124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56154d6110b0 0x56154d67e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.258+0000 7fda2bfff640 1 -- 172.21.15.87:0/2610267124 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56154d5723c0 con 0x56154d610790 2024-09-13T17:19:20.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.258+0000 7fda30d51640 1 --2- 172.21.15.87:0/2610267124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56154d6110b0 0x56154d67e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:20.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.258+0000 7fda2bfff640 1 --2- 172.21.15.87:0/2610267124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56154d610790 0x56154d67e110 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fda18005d80 tx=0x7fda1800bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c984090950cd96cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:20.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.258+0000 7fda0bfff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:19:20.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.258+0000 7fda0bfff640 1 -- 172.21.15.87:0/2610267124 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda18019030 con 0x56154d610790 2024-09-13T17:19:20.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.258+0000 7fda0bfff640 1 -- 172.21.15.87:0/2610267124 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fda18000e40 con 0x56154d610790 2024-09-13T17:19:20.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.258+0000 7fda35cd5740 1 -- 172.21.15.87:0/2610267124 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fda18013110 con 0x56154d610790 2024-09-13T17:19:20.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.258+0000 7fda0bfff640 1 -- 172.21.15.87:0/2610267124 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda18026a70 con 0x56154d610790 2024-09-13T17:19:20.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.258+0000 7fda35cd5740 10 client.17163 fetch_fsmap learned FSMap version 32 2024-09-13T17:19:20.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.258+0000 7fda35cd5740 1 -- 172.21.15.87:0/2610267124 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x56154d539e80 con 0x56154d610790 2024-09-13T17:19:20.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.258+0000 7fda0bfff640 1 -- 172.21.15.87:0/2610267124 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fda18013110 con 0x56154d610790 2024-09-13T17:19:20.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.258+0000 7fda0bfff640 1 -- 172.21.15.87:0/2610267124 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 32) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fda1803f070 con 0x56154d610790 2024-09-13T17:19:20.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.258+0000 7fda35cd5740 10 client.17163 fetch_fsmap finished waiting for FSMap version 32 2024-09-13T17:19:20.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.258+0000 7fda35cd5740 10 client.17163 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:19:20.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.258+0000 7fda35cd5740 20 client.17163 populate_metadata read hostname 'smithi087' 2024-09-13T17:19:20.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.258+0000 7fda35cd5740 1 --2- 172.21.15.87:0/2610267124 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x56154d686bd0 0x56154d688fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.258+0000 7fda35cd5740 4 client.17163 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:19:20.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.258+0000 7fda35cd5740 1 -- 172.21.15.87:0/2610267124 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56154d2674e0 con 0x56154d686bd0 2024-09-13T17:19:20.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.259+0000 7fda30d51640 1 --2- 172.21.15.87:0/2610267124 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x56154d686bd0 0x56154d688fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.259+0000 7fda0bfff640 10 client.17163 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:19:20.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.259+0000 7fda30d51640 1 --2- 172.21.15.87:0/2610267124 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x56154d686bd0 0x56154d688fc0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=67b0e8b00037057b server_cookie=d7af7612a2274839 in_seq=0 out_seq=0 2024-09-13T17:19:20.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.259+0000 7fda0bfff640 1 -- 172.21.15.87:0/2610267124 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56154d2674e0 con 0x56154d686bd0 2024-09-13T17:19:20.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.259+0000 7fda0bfff640 10 client.17163 handle_command_reply: tid=0 2024-09-13T17:19:20.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.259+0000 7fda35cd5740 1 client.17163 shutdown 2024-09-13T17:19:20.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.259+0000 7fda35cd5740 1 -- 172.21.15.87:0/2610267124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56154d610790 msgr2=0x56154d67e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:20.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.259+0000 7fda35cd5740 1 --2- 172.21.15.87:0/2610267124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56154d610790 0x56154d67e110 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fda18005d80 tx=0x7fda1800bec0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.259+0000 7fda35cd5740 1 -- 172.21.15.87:0/2610267124 shutdown_connections 2024-09-13T17:19:20.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.259+0000 7fda35cd5740 1 --2- 172.21.15.87:0/2610267124 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x56154d686bd0 0x56154d688fc0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.259+0000 7fda35cd5740 1 --2- 172.21.15.87:0/2610267124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56154d61b950 0x56154d679750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.259+0000 7fda35cd5740 1 --2- 172.21.15.87:0/2610267124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56154d6110b0 0x56154d67e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.259+0000 7fda0bfff640 0 client.17163 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:19:20.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.259+0000 7fda35cd5740 1 --2- 172.21.15.87:0/2610267124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56154d610790 0x56154d67e110 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.259+0000 7fda35cd5740 1 -- 172.21.15.87:0/2610267124 >> 172.21.15.87:0/2610267124 conn(0x56154d60cd00 msgr2=0x56154d613310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:20.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.259+0000 7fda35cd5740 1 -- 172.21.15.87:0/2610267124 shutdown_connections 2024-09-13T17:19:20.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.259+0000 7fda35cd5740 1 -- 172.21.15.87:0/2610267124 wait complete. 2024-09-13T17:19:20.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.259+0000 7fda35cd5740 20 client.17163 trim_cache size 0 max 16384 2024-09-13T17:19:20.268 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:19:20.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.260+0000 7fda32fb5640 1 -- 172.21.15.87:0/2320894910 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fda1c0a1200 msgr2=0x7fda1c0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:20.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.260+0000 7fda32fb5640 1 --2- 172.21.15.87:0/2320894910 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fda1c0a1200 0x7fda1c0a36c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fda240ebd70 tx=0x7fda240db040 comp rx=0 tx=0).stop 2024-09-13T17:19:20.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.260+0000 7fda32fb5640 1 -- 172.21.15.87:0/2320894910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda2c19ac10 msgr2=0x7fda2c19b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:20.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.260+0000 7fda32fb5640 1 --2- 172.21.15.87:0/2320894910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda2c19ac10 0x7fda2c19b0c0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fda24005cc0 tx=0x7fda24030850 comp rx=0 tx=0).stop 2024-09-13T17:19:20.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.260+0000 7fda32fb5640 1 -- 172.21.15.87:0/2320894910 shutdown_connections 2024-09-13T17:19:20.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.260+0000 7fda32fb5640 1 --2- 172.21.15.87:0/2320894910 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fda1c0a1200 0x7fda1c0a36c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.260+0000 7fda32fb5640 1 --2- 172.21.15.87:0/2320894910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda2c19ac10 0x7fda2c19b0c0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.260+0000 7fda32fb5640 1 --2- 172.21.15.87:0/2320894910 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda2c1050a0 0x7fda2c196820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.260+0000 7fda32fb5640 1 --2- 172.21.15.87:0/2320894910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda2c0fff50 0x7fda2c1962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.260+0000 7fda32fb5640 1 -- 172.21.15.87:0/2320894910 >> 172.21.15.87:0/2320894910 conn(0x7fda2c0fb9e0 msgr2=0x7fda2c0fcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:20.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.260+0000 7fda32fb5640 1 -- 172.21.15.87:0/2320894910 shutdown_connections 2024-09-13T17:19:20.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.260+0000 7fda32fb5640 1 -- 172.21.15.87:0/2320894910 wait complete. 2024-09-13T17:19:20.272 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-09-13T17:19:20.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.372+0000 7f19b30e5640 1 -- 172.21.15.87:0/2596346540 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19ac0ff3f0 msgr2=0x7f19ac105bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:20.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.372+0000 7f19b30e5640 1 --2- 172.21.15.87:0/2596346540 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19ac0ff3f0 0x7f19ac105bc0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f1998009960 tx=0x7f199802a4f0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.372+0000 7f19b30e5640 1 -- 172.21.15.87:0/2596346540 shutdown_connections 2024-09-13T17:19:20.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.372+0000 7f19b30e5640 1 --2- 172.21.15.87:0/2596346540 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19ac106320 0x7f19ac10cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.372+0000 7f19b30e5640 1 --2- 172.21.15.87:0/2596346540 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19ac0ff3f0 0x7f19ac105bc0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.372+0000 7f19b30e5640 1 --2- 172.21.15.87:0/2596346540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19ac0fead0 0x7f19ac0feeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.372+0000 7f19b30e5640 1 -- 172.21.15.87:0/2596346540 >> 172.21.15.87:0/2596346540 conn(0x7f19ac0741b0 msgr2=0x7f19ac0745c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:20.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.372+0000 7f19b30e5640 1 -- 172.21.15.87:0/2596346540 shutdown_connections 2024-09-13T17:19:20.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.372+0000 7f19b30e5640 1 -- 172.21.15.87:0/2596346540 wait complete. 2024-09-13T17:19:20.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.372+0000 7f19b30e5640 1 Processor -- start 2024-09-13T17:19:20.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.372+0000 7f19b30e5640 1 -- start start 2024-09-13T17:19:20.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.372+0000 7f19b30e5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19ac0fead0 0x7f19ac196330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.372+0000 7f19b30e5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19ac0ff3f0 0x7f19ac196870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.372+0000 7f19b30e5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19ac106320 0x7f19ac19ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.372+0000 7f19b30e5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac19b260 con 0x7f19ac0fead0 2024-09-13T17:19:20.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.372+0000 7f19b30e5640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac19b3d0 con 0x7f19ac106320 2024-09-13T17:19:20.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.372+0000 7f19b30e5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac19b590 con 0x7f19ac0ff3f0 2024-09-13T17:19:20.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.372+0000 7f19b0e81640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19ac0fead0 0x7f19ac196330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.372+0000 7f19b0e81640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19ac0fead0 0x7f19ac196330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44920/0 (socket says 172.21.15.87:44920) 2024-09-13T17:19:20.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.373+0000 7f19b0e81640 1 -- 172.21.15.87:0/3430438633 learned_addr learned my addr 172.21.15.87:0/3430438633 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:20.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.373+0000 7f19b1682640 1 --2- 172.21.15.87:0/3430438633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19ac106320 0x7f19ac19ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.373+0000 7f19abfff640 1 --2- 172.21.15.87:0/3430438633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19ac0ff3f0 0x7f19ac196870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.373+0000 7f19b0e81640 1 -- 172.21.15.87:0/3430438633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19ac0ff3f0 msgr2=0x7f19ac196870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:20.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.373+0000 7f19b0e81640 1 --2- 172.21.15.87:0/3430438633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19ac0ff3f0 0x7f19ac196870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.373+0000 7f19b0e81640 1 -- 172.21.15.87:0/3430438633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19ac106320 msgr2=0x7f19ac19ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:20.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.373+0000 7f19b0e81640 1 --2- 172.21.15.87:0/3430438633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19ac106320 0x7f19ac19ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.373+0000 7f19b0e81640 1 -- 172.21.15.87:0/3430438633 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1998009560 con 0x7f19ac0fead0 2024-09-13T17:19:20.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.373+0000 7f19abfff640 1 --2- 172.21.15.87:0/3430438633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19ac0ff3f0 0x7f19ac196870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:20.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.373+0000 7f19b1682640 1 --2- 172.21.15.87:0/3430438633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19ac106320 0x7f19ac19ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:20.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.373+0000 7f19b0e81640 1 --2- 172.21.15.87:0/3430438633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19ac0fead0 0x7f19ac196330 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f19a000e9f0 tx=0x7f19a000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:20.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.373+0000 7f19a9ffb640 1 -- 172.21.15.87:0/3430438633 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a0009720 con 0x7f19ac0fead0 2024-09-13T17:19:20.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.373+0000 7f19a9ffb640 1 -- 172.21.15.87:0/3430438633 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f19a000cd80 con 0x7f19ac0fead0 2024-09-13T17:19:20.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.373+0000 7f19b30e5640 1 -- 172.21.15.87:0/3430438633 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19ac19b870 con 0x7f19ac0fead0 2024-09-13T17:19:20.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.373+0000 7f19a9ffb640 1 -- 172.21.15.87:0/3430438633 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a0010430 con 0x7f19ac0fead0 2024-09-13T17:19:20.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.373+0000 7f19b30e5640 1 -- 172.21.15.87:0/3430438633 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19ac1a30f0 con 0x7f19ac0fead0 2024-09-13T17:19:20.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.375+0000 7f19a9ffb640 1 -- 172.21.15.87:0/3430438633 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f19a0005020 con 0x7f19ac0fead0 2024-09-13T17:19:20.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.376+0000 7f19b5e02740 1 Processor -- start 2024-09-13T17:19:20.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.376+0000 7f19b5e02740 1 -- start start 2024-09-13T17:19:20.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.376+0000 7f19a9ffb640 1 --2- 172.21.15.87:0/3430438633 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f199c0a1300 0x7f199c0a37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.376+0000 7f19b5e02740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558306a29790 0x558306a29b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.376+0000 7f19b5e02740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558306a2a0b0 0x558306a34410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.376+0000 7f19b5e02740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558306a34950 0x558306a36d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.376+0000 7f19b5e02740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558306993cc0 con 0x558306a2a0b0 2024-09-13T17:19:20.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.376+0000 7f19b5e02740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558306991450 con 0x558306a34950 2024-09-13T17:19:20.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.376+0000 7f19b5e02740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55830698cd40 con 0x558306a29790 2024-09-13T17:19:20.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.376+0000 7f19b1682640 1 --2- 172.21.15.87:0/3430438633 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f199c0a1300 0x7f199c0a37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.376+0000 7f19a9ffb640 1 -- 172.21.15.87:0/3430438633 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f19a0014070 con 0x7f19ac0fead0 2024-09-13T17:19:20.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.376+0000 7f19abfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558306a2a0b0 0x558306a34410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.376+0000 7f19abfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558306a2a0b0 0x558306a34410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44924/0 (socket says 172.21.15.87:44924) 2024-09-13T17:19:20.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.376+0000 7f19abfff640 1 -- 172.21.15.87:0/4111795018 learned_addr learned my addr 172.21.15.87:0/4111795018 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:20.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.376+0000 7f19b0e81640 1 --2- 172.21.15.87:0/4111795018 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558306a29790 0x558306a29b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.376+0000 7f19b1682640 1 --2- 172.21.15.87:0/4111795018 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558306a34950 0x558306a36d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.377+0000 7f19abfff640 1 -- 172.21.15.87:0/4111795018 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558306a29790 msgr2=0x558306a29b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:20.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.377+0000 7f19abfff640 1 --2- 172.21.15.87:0/4111795018 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558306a29790 0x558306a29b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.377+0000 7f19abfff640 1 -- 172.21.15.87:0/4111795018 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558306a34950 msgr2=0x558306a36d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:20.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.377+0000 7f19abfff640 1 --2- 172.21.15.87:0/4111795018 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558306a34950 0x558306a36d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.377+0000 7f19abfff640 1 -- 172.21.15.87:0/4111795018 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558306954620 con 0x558306a2a0b0 2024-09-13T17:19:20.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.377+0000 7f19b1682640 1 --2- 172.21.15.87:0/3430438633 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f199c0a1300 0x7f199c0a37c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f19a4005fd0 tx=0x7f19a40117b0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:20.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.377+0000 7f19abfff640 1 --2- 172.21.15.87:0/4111795018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558306a2a0b0 0x558306a34410 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f1998005ec0 tx=0x7f1998031510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fea9b5aa751903b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:20.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.377+0000 7f1996ffd640 1 -- 172.21.15.87:0/4111795018 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19980319f0 con 0x558306a2a0b0 2024-09-13T17:19:20.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.377+0000 7f1996ffd640 1 -- 172.21.15.87:0/4111795018 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f19980050c0 con 0x558306a2a0b0 2024-09-13T17:19:20.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.377+0000 7f1996ffd640 1 -- 172.21.15.87:0/4111795018 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1998003b00 con 0x558306a2a0b0 2024-09-13T17:19:20.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.378+0000 7f19b5e02740 1 -- 172.21.15.87:0/4111795018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558306a2a0b0 msgr2=0x558306a34410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:20.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.378+0000 7f19b5e02740 1 --2- 172.21.15.87:0/4111795018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558306a2a0b0 0x558306a34410 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f1998005ec0 tx=0x7f1998031510 comp rx=0 tx=0).stop 2024-09-13T17:19:20.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.378+0000 7f19b5e02740 1 -- 172.21.15.87:0/4111795018 shutdown_connections 2024-09-13T17:19:20.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.378+0000 7f19b5e02740 1 --2- 172.21.15.87:0/4111795018 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558306a34950 0x558306a36d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.378+0000 7f19b5e02740 1 --2- 172.21.15.87:0/4111795018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558306a2a0b0 0x558306a34410 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.378+0000 7f19b5e02740 1 --2- 172.21.15.87:0/4111795018 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558306a29790 0x558306a29b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.378+0000 7f19b5e02740 1 -- 172.21.15.87:0/4111795018 >> 172.21.15.87:0/4111795018 conn(0x558306a25d00 msgr2=0x558306a260e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:20.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.378+0000 7f19b5e02740 1 -- 172.21.15.87:0/4111795018 shutdown_connections 2024-09-13T17:19:20.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.378+0000 7f19b5e02740 1 -- 172.21.15.87:0/4111795018 wait complete. 2024-09-13T17:19:20.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.378+0000 7f19b5e02740 1 -- start start 2024-09-13T17:19:20.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.378+0000 7f19b5e02740 1 Processor -- start 2024-09-13T17:19:20.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.378+0000 7f19b5e02740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558306a29790 0x558306a33f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.378+0000 7f19b5e02740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558306a2a0b0 0x558306a31260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.378+0000 7f19b5e02740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558306a34950 0x558306a317a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.378+0000 7f19b5e02740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55830694b180 con 0x558306a29790 2024-09-13T17:19:20.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.378+0000 7f19b5e02740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558306665430 con 0x558306a2a0b0 2024-09-13T17:19:20.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.378+0000 7f19b5e02740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583069105e0 con 0x558306a34950 2024-09-13T17:19:20.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.379+0000 7f19b5e02740 10 client.0 _ll_register_callbacks cb 0x55830697caa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:20.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.379+0000 7f19b0e81640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558306a29790 0x558306a33f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.379+0000 7f19b0e81640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558306a29790 0x558306a33f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44932/0 (socket says 172.21.15.87:44932) 2024-09-13T17:19:20.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.379+0000 7f19b0e81640 1 -- 172.21.15.87:0/614475170 learned_addr learned my addr 172.21.15.87:0/614475170 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:20.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.379+0000 7f19b1682640 1 --2- 172.21.15.87:0/614475170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558306a34950 0x558306a317a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.379+0000 7f19abfff640 1 --2- 172.21.15.87:0/614475170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558306a2a0b0 0x558306a31260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.379+0000 7f19b0e81640 1 -- 172.21.15.87:0/614475170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558306a34950 msgr2=0x558306a317a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:20.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.379+0000 7f19b0e81640 1 --2- 172.21.15.87:0/614475170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558306a34950 0x558306a317a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.379+0000 7f19b0e81640 1 -- 172.21.15.87:0/614475170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558306a2a0b0 msgr2=0x558306a31260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:20.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.379+0000 7f19b0e81640 1 --2- 172.21.15.87:0/614475170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558306a2a0b0 0x558306a31260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.379+0000 7f19b0e81640 1 -- 172.21.15.87:0/614475170 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19ac10d480 con 0x558306a29790 2024-09-13T17:19:20.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.379+0000 7f19abfff640 1 --2- 172.21.15.87:0/614475170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558306a2a0b0 0x558306a31260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:20.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.379+0000 7f19b0e81640 1 --2- 172.21.15.87:0/614475170 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558306a29790 0x558306a33f40 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f19a0096760 tx=0x7f19a0004780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60385ba427311459 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:20.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.379+0000 7f198bfff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:19:20.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.379+0000 7f198bfff640 1 -- 172.21.15.87:0/614475170 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a00af020 con 0x558306a29790 2024-09-13T17:19:20.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.379+0000 7f198bfff640 1 -- 172.21.15.87:0/614475170 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f19a009e090 con 0x558306a29790 2024-09-13T17:19:20.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.379+0000 7f19b5e02740 1 -- 172.21.15.87:0/614475170 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5583069b6b80 con 0x558306a29790 2024-09-13T17:19:20.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.379+0000 7f198bfff640 1 -- 172.21.15.87:0/614475170 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19a00a26e0 con 0x558306a29790 2024-09-13T17:19:20.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.379+0000 7f19b5e02740 10 client.17175 fetch_fsmap learned FSMap version 32 2024-09-13T17:19:20.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.379+0000 7f19b5e02740 1 -- 172.21.15.87:0/614475170 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55830698b3c0 con 0x558306a29790 2024-09-13T17:19:20.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.379+0000 7f198bfff640 1 -- 172.21.15.87:0/614475170 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x5583069b6b80 con 0x558306a29790 2024-09-13T17:19:20.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.380+0000 7f198bfff640 1 -- 172.21.15.87:0/614475170 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 32) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f19a001f060 con 0x558306a29790 2024-09-13T17:19:20.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.380+0000 7f19b5e02740 10 client.17175 fetch_fsmap finished waiting for FSMap version 32 2024-09-13T17:19:20.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.380+0000 7f19b5e02740 10 client.17175 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:19:20.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.380+0000 7f19b5e02740 20 client.17175 populate_metadata read hostname 'smithi087' 2024-09-13T17:19:20.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.380+0000 7f19b5e02740 1 --2- 172.21.15.87:0/614475170 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x558306a442e0 0x558306a46700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.380+0000 7f19b5e02740 4 client.17175 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:19:20.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.380+0000 7f19b5e02740 1 -- 172.21.15.87:0/614475170 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55830697f1f0 con 0x558306a442e0 2024-09-13T17:19:20.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.380+0000 7f19abfff640 1 --2- 172.21.15.87:0/614475170 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x558306a442e0 0x558306a46700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.380+0000 7f198bfff640 10 client.17175 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:19:20.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.380+0000 7f19abfff640 1 --2- 172.21.15.87:0/614475170 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x558306a442e0 0x558306a46700 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=59c1f940349f70d0 server_cookie=d027f7811f37f44b in_seq=0 out_seq=0 2024-09-13T17:19:20.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.381+0000 7f198bfff640 1 -- 172.21.15.87:0/614475170 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55830697f1f0 con 0x558306a442e0 2024-09-13T17:19:20.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.381+0000 7f198bfff640 10 client.17175 handle_command_reply: tid=0 2024-09-13T17:19:20.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.381+0000 7f19b5e02740 1 client.17175 shutdown 2024-09-13T17:19:20.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.381+0000 7f19b5e02740 1 -- 172.21.15.87:0/614475170 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558306a29790 msgr2=0x558306a33f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:20.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.381+0000 7f19b5e02740 1 --2- 172.21.15.87:0/614475170 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558306a29790 0x558306a33f40 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f19a0096760 tx=0x7f19a0004780 comp rx=0 tx=0).stop 2024-09-13T17:19:20.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.381+0000 7f19b5e02740 1 -- 172.21.15.87:0/614475170 shutdown_connections 2024-09-13T17:19:20.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.381+0000 7f19b5e02740 1 --2- 172.21.15.87:0/614475170 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x558306a442e0 0x558306a46700 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.381+0000 7f19b5e02740 1 --2- 172.21.15.87:0/614475170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558306a34950 0x558306a317a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.381+0000 7f198bfff640 0 client.17175 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:19:20.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.381+0000 7f19b5e02740 1 --2- 172.21.15.87:0/614475170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558306a2a0b0 0x558306a31260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.381+0000 7f19b5e02740 1 --2- 172.21.15.87:0/614475170 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558306a29790 0x558306a33f40 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.381+0000 7f19b5e02740 1 -- 172.21.15.87:0/614475170 >> 172.21.15.87:0/614475170 conn(0x558306a25d00 msgr2=0x558306a24eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:20.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.381+0000 7f19b5e02740 1 -- 172.21.15.87:0/614475170 shutdown_connections 2024-09-13T17:19:20.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.381+0000 7f19b5e02740 1 -- 172.21.15.87:0/614475170 wait complete. 2024-09-13T17:19:20.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.382+0000 7f19b5e02740 20 client.17175 trim_cache size 0 max 16384 2024-09-13T17:19:20.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.393+0000 7f19b5e02740 1 Processor -- start 2024-09-13T17:19:20.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.393+0000 7f19b5e02740 1 -- start start 2024-09-13T17:19:20.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.393+0000 7f19b5e02740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558306a29790 0x558306a256a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.393+0000 7f19b5e02740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558306a2a0b0 0x558306a3b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.393+0000 7f19b5e02740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558306a34950 0x558306a3bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.393+0000 7f19b5e02740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558306a203b0 con 0x558306a34950 2024-09-13T17:19:20.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.393+0000 7f19b5e02740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558306a42b90 con 0x558306a29790 2024-09-13T17:19:20.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.393+0000 7f19b5e02740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x558306a31b10 con 0x558306a2a0b0 2024-09-13T17:19:20.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.393+0000 7f19b1682640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558306a34950 0x558306a3bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.393+0000 7f19b1682640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558306a34950 0x558306a3bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44934/0 (socket says 172.21.15.87:44934) 2024-09-13T17:19:20.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.393+0000 7f19b1682640 1 -- 172.21.15.87:0/4264534517 learned_addr learned my addr 172.21.15.87:0/4264534517 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:20.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.393+0000 7f19b0e81640 1 --2- 172.21.15.87:0/4264534517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558306a29790 0x558306a256a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.393+0000 7f19abfff640 1 --2- 172.21.15.87:0/4264534517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558306a2a0b0 0x558306a3b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.393+0000 7f19b1682640 1 -- 172.21.15.87:0/4264534517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558306a2a0b0 msgr2=0x558306a3b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:20.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.393+0000 7f19b1682640 1 --2- 172.21.15.87:0/4264534517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558306a2a0b0 0x558306a3b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.393+0000 7f19b1682640 1 -- 172.21.15.87:0/4264534517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558306a29790 msgr2=0x558306a256a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:20.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.393+0000 7f19b1682640 1 --2- 172.21.15.87:0/4264534517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558306a29790 0x558306a256a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.393+0000 7f19b1682640 1 -- 172.21.15.87:0/4264534517 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55830692d770 con 0x558306a34950 2024-09-13T17:19:20.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.393+0000 7f19abfff640 1 --2- 172.21.15.87:0/4264534517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558306a2a0b0 0x558306a3b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:20.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.393+0000 7f19b0e81640 1 --2- 172.21.15.87:0/4264534517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558306a29790 0x558306a256a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:20.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.393+0000 7f19b1682640 1 --2- 172.21.15.87:0/4264534517 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558306a34950 0x558306a3bb80 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f19a4011cb0 tx=0x7f19a4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e38e720dabb2061 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:20.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.394+0000 7f19977fe640 1 -- 172.21.15.87:0/4264534517 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a401eaa0 con 0x558306a34950 2024-09-13T17:19:20.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.394+0000 7f19977fe640 1 -- 172.21.15.87:0/4264534517 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f19a4023070 con 0x558306a34950 2024-09-13T17:19:20.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.394+0000 7f19977fe640 1 -- 172.21.15.87:0/4264534517 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a401f6b0 con 0x558306a34950 2024-09-13T17:19:20.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.394+0000 7f19b5e02740 1 -- 172.21.15.87:0/4264534517 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558306a34950 msgr2=0x558306a3bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:20.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.394+0000 7f19b5e02740 1 --2- 172.21.15.87:0/4264534517 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558306a34950 0x558306a3bb80 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f19a4011cb0 tx=0x7f19a4014000 comp rx=0 tx=0).stop 2024-09-13T17:19:20.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.394+0000 7f19b5e02740 1 -- 172.21.15.87:0/4264534517 shutdown_connections 2024-09-13T17:19:20.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.394+0000 7f19b5e02740 1 --2- 172.21.15.87:0/4264534517 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558306a34950 0x558306a3bb80 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.394+0000 7f19b5e02740 1 --2- 172.21.15.87:0/4264534517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558306a2a0b0 0x558306a3b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.394+0000 7f19b5e02740 1 --2- 172.21.15.87:0/4264534517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558306a29790 0x558306a256a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.394+0000 7f19b5e02740 1 -- 172.21.15.87:0/4264534517 >> 172.21.15.87:0/4264534517 conn(0x558306a25d00 msgr2=0x558306a2fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:20.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.394+0000 7f19b5e02740 1 -- 172.21.15.87:0/4264534517 shutdown_connections 2024-09-13T17:19:20.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.394+0000 7f19b5e02740 1 -- 172.21.15.87:0/4264534517 wait complete. 2024-09-13T17:19:20.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.395+0000 7f19b5e02740 1 -- start start 2024-09-13T17:19:20.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.395+0000 7f19b5e02740 1 Processor -- start 2024-09-13T17:19:20.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.395+0000 7f19b5e02740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558306a29790 0x558306a2e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.395+0000 7f19b5e02740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558306a2a0b0 0x558306a2e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.395+0000 7f19b5e02740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558306a34950 0x558306a2ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.395+0000 7f19b5e02740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558306a9a8d0 con 0x558306a34950 2024-09-13T17:19:20.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.395+0000 7f19b5e02740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558306a9aa40 con 0x558306a2a0b0 2024-09-13T17:19:20.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.395+0000 7f19b5e02740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x558306a9ac00 con 0x558306a29790 2024-09-13T17:19:20.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.395+0000 7f19b5e02740 10 client.0 _ll_register_callbacks cb 0x7f19a0005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:20.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.395+0000 7f19b1682640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558306a34950 0x558306a2ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.395+0000 7f19b1682640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558306a34950 0x558306a2ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44944/0 (socket says 172.21.15.87:44944) 2024-09-13T17:19:20.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.395+0000 7f19b1682640 1 -- 172.21.15.87:0/849427647 learned_addr learned my addr 172.21.15.87:0/849427647 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:20.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.395+0000 7f19b0e81640 1 --2- 172.21.15.87:0/849427647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558306a29790 0x558306a2e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.395+0000 7f19b1682640 1 -- 172.21.15.87:0/849427647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558306a29790 msgr2=0x558306a2e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:20.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.395+0000 7f19b1682640 1 --2- 172.21.15.87:0/849427647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558306a29790 0x558306a2e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.395+0000 7f19b1682640 1 -- 172.21.15.87:0/849427647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558306a2a0b0 msgr2=0x558306a2e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:20.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.395+0000 7f19b1682640 1 --2- 172.21.15.87:0/849427647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558306a2a0b0 0x558306a2e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.395+0000 7f19b1682640 1 -- 172.21.15.87:0/849427647 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a40124b0 con 0x558306a34950 2024-09-13T17:19:20.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.396+0000 7f19b1682640 1 --2- 172.21.15.87:0/849427647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558306a34950 0x558306a2ec60 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f19a4005cc0 tx=0x7f19a402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cc9952e799c4a1f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:20.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.396+0000 7f198bfff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:19:20.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.396+0000 7f198bfff640 1 -- 172.21.15.87:0/849427647 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a401e8a0 con 0x558306a34950 2024-09-13T17:19:20.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.396+0000 7f198bfff640 1 -- 172.21.15.87:0/849427647 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f19a4025070 con 0x558306a34950 2024-09-13T17:19:20.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.396+0000 7f19b5e02740 1 -- 172.21.15.87:0/849427647 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f19980050c0 con 0x558306a34950 2024-09-13T17:19:20.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.396+0000 7f198bfff640 1 -- 172.21.15.87:0/849427647 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19a401ea00 con 0x558306a34950 2024-09-13T17:19:20.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.396+0000 7f19b5e02740 10 client.17181 fetch_fsmap learned FSMap version 32 2024-09-13T17:19:20.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.396+0000 7f19b5e02740 1 -- 172.21.15.87:0/849427647 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x558306952e80 con 0x558306a34950 2024-09-13T17:19:20.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.396+0000 7f198bfff640 1 -- 172.21.15.87:0/849427647 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f19980050c0 con 0x558306a34950 2024-09-13T17:19:20.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.396+0000 7f198bfff640 1 -- 172.21.15.87:0/849427647 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 32) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f19a400b050 con 0x558306a34950 2024-09-13T17:19:20.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.396+0000 7f19b5e02740 10 client.17181 fetch_fsmap finished waiting for FSMap version 32 2024-09-13T17:19:20.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.396+0000 7f19b5e02740 10 client.17181 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:19:20.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.396+0000 7f19b5e02740 20 client.17181 populate_metadata read hostname 'smithi087' 2024-09-13T17:19:20.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.396+0000 7f19b5e02740 1 --2- 172.21.15.87:0/849427647 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x558306a9c290 0x558306a9e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.396+0000 7f19b5e02740 4 client.17181 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:19:20.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.396+0000 7f19b5e02740 1 -- 172.21.15.87:0/849427647 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5583066804e0 con 0x558306a9c290 2024-09-13T17:19:20.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.397+0000 7f19b0e81640 1 --2- 172.21.15.87:0/849427647 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x558306a9c290 0x558306a9e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.397+0000 7f198bfff640 10 client.17181 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:19:20.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.397+0000 7f19b0e81640 1 --2- 172.21.15.87:0/849427647 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x558306a9c290 0x558306a9e6b0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ea13655a967c5de6 server_cookie=da41846f1db8c719 in_seq=0 out_seq=0 2024-09-13T17:19:20.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.397+0000 7f198bfff640 1 -- 172.21.15.87:0/849427647 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5583066804e0 con 0x558306a9c290 2024-09-13T17:19:20.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.397+0000 7f198bfff640 10 client.17181 handle_command_reply: tid=0 2024-09-13T17:19:20.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.397+0000 7f19b5e02740 1 client.17181 shutdown 2024-09-13T17:19:20.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.397+0000 7f19b5e02740 1 -- 172.21.15.87:0/849427647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558306a34950 msgr2=0x558306a2ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:20.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.397+0000 7f19b5e02740 1 --2- 172.21.15.87:0/849427647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558306a34950 0x558306a2ec60 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f19a4005cc0 tx=0x7f19a402a730 comp rx=0 tx=0).stop 2024-09-13T17:19:20.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.398+0000 7f19b5e02740 1 -- 172.21.15.87:0/849427647 shutdown_connections 2024-09-13T17:19:20.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.398+0000 7f19b5e02740 1 --2- 172.21.15.87:0/849427647 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x558306a9c290 0x558306a9e6b0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.398+0000 7f19b5e02740 1 --2- 172.21.15.87:0/849427647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558306a34950 0x558306a2ec60 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.398+0000 7f198bfff640 0 client.17181 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:19:20.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.398+0000 7f19b5e02740 1 --2- 172.21.15.87:0/849427647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558306a2a0b0 0x558306a2e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.398+0000 7f19b5e02740 1 --2- 172.21.15.87:0/849427647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558306a29790 0x558306a2e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.398+0000 7f19b5e02740 1 -- 172.21.15.87:0/849427647 >> 172.21.15.87:0/849427647 conn(0x558306a25d00 msgr2=0x558306a2c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:20.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.398+0000 7f19b5e02740 1 -- 172.21.15.87:0/849427647 shutdown_connections 2024-09-13T17:19:20.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.398+0000 7f19b5e02740 1 -- 172.21.15.87:0/849427647 wait complete. 2024-09-13T17:19:20.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.398+0000 7f19b5e02740 20 client.17181 trim_cache size 0 max 16384 2024-09-13T17:19:20.406 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:19:20.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.398+0000 7f19b30e5640 1 -- 172.21.15.87:0/3430438633 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f199c0a1300 msgr2=0x7f199c0a37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:20.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.398+0000 7f19b30e5640 1 --2- 172.21.15.87:0/3430438633 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f199c0a1300 0x7f199c0a37c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f19a4005fd0 tx=0x7f19a40117b0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.398+0000 7f19b30e5640 1 -- 172.21.15.87:0/3430438633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19ac0fead0 msgr2=0x7f19ac196330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:20.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.398+0000 7f19b30e5640 1 --2- 172.21.15.87:0/3430438633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19ac0fead0 0x7f19ac196330 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f19a000e9f0 tx=0x7f19a000edf0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.398+0000 7f19b30e5640 1 -- 172.21.15.87:0/3430438633 shutdown_connections 2024-09-13T17:19:20.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.398+0000 7f19b30e5640 1 --2- 172.21.15.87:0/3430438633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19ac106320 0x7f19ac19ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.398+0000 7f19b30e5640 1 --2- 172.21.15.87:0/3430438633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19ac0ff3f0 0x7f19ac196870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.398+0000 7f19b30e5640 1 --2- 172.21.15.87:0/3430438633 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f199c0a1300 0x7f199c0a37c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.398+0000 7f19b30e5640 1 --2- 172.21.15.87:0/3430438633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19ac0fead0 0x7f19ac196330 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.398+0000 7f19b30e5640 1 -- 172.21.15.87:0/3430438633 >> 172.21.15.87:0/3430438633 conn(0x7f19ac0741b0 msgr2=0x7f19ac103ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:20.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.398+0000 7f19b30e5640 1 -- 172.21.15.87:0/3430438633 shutdown_connections 2024-09-13T17:19:20.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.398+0000 7f19b30e5640 1 -- 172.21.15.87:0/3430438633 wait complete. 2024-09-13T17:19:20.410 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-09-13T17:19:20.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.510+0000 7fa958296640 1 -- 172.21.15.87:0/446506262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa950103fb0 msgr2=0x7fa95010bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:20.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.510+0000 7fa958296640 1 --2- 172.21.15.87:0/446506262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa950103fb0 0x7fa95010bb00 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fa948009cd0 tx=0x7fa94802a8e0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.510+0000 7fa958296640 1 -- 172.21.15.87:0/446506262 shutdown_connections 2024-09-13T17:19:20.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.510+0000 7fa958296640 1 --2- 172.21.15.87:0/446506262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa950103fb0 0x7fa95010bb00 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.510+0000 7fa958296640 1 --2- 172.21.15.87:0/446506262 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9500ff810 0x7fa950103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.510+0000 7fa958296640 1 --2- 172.21.15.87:0/446506262 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9500fee60 0x7fa9500ff240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.510+0000 7fa958296640 1 -- 172.21.15.87:0/446506262 >> 172.21.15.87:0/446506262 conn(0x7fa950075c60 msgr2=0x7fa9500fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:20.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.510+0000 7fa958296640 1 -- 172.21.15.87:0/446506262 shutdown_connections 2024-09-13T17:19:20.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.510+0000 7fa958296640 1 -- 172.21.15.87:0/446506262 wait complete. 2024-09-13T17:19:20.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.510+0000 7fa958296640 1 Processor -- start 2024-09-13T17:19:20.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.510+0000 7fa958296640 1 -- start start 2024-09-13T17:19:20.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.510+0000 7fa958296640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9500fee60 0x7fa950197010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.511+0000 7fa958296640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa950103fb0 0x7fa950197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.511+0000 7fa958296640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa950197a90 0x7fa9501a2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.511+0000 7fa958296640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9501a2730 con 0x7fa9500fee60 2024-09-13T17:19:20.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.511+0000 7fa958296640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9501a28a0 con 0x7fa950103fb0 2024-09-13T17:19:20.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.511+0000 7fa958296640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9501a2a60 con 0x7fa950197a90 2024-09-13T17:19:20.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.511+0000 7fa956032640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9500fee60 0x7fa950197010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.511+0000 7fa956032640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9500fee60 0x7fa950197010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44962/0 (socket says 172.21.15.87:44962) 2024-09-13T17:19:20.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.511+0000 7fa956032640 1 -- 172.21.15.87:0/3064411900 learned_addr learned my addr 172.21.15.87:0/3064411900 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:20.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.511+0000 7fa955831640 1 --2- 172.21.15.87:0/3064411900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa950103fb0 0x7fa950197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.511+0000 7fa956032640 1 -- 172.21.15.87:0/3064411900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa950197a90 msgr2=0x7fa9501a2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:20.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.511+0000 7fa956032640 1 --2- 172.21.15.87:0/3064411900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa950197a90 0x7fa9501a2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.511+0000 7fa956032640 1 -- 172.21.15.87:0/3064411900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa950103fb0 msgr2=0x7fa950197550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:20.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.511+0000 7fa956032640 1 --2- 172.21.15.87:0/3064411900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa950103fb0 0x7fa950197550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.511+0000 7fa956032640 1 -- 172.21.15.87:0/3064411900 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa948009900 con 0x7fa9500fee60 2024-09-13T17:19:20.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.511+0000 7fa955831640 1 --2- 172.21.15.87:0/3064411900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa950103fb0 0x7fa950197550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:20.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.511+0000 7fa956032640 1 --2- 172.21.15.87:0/3064411900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9500fee60 0x7fa950197010 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fa94c00c890 tx=0x7fa94c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:20.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.511+0000 7fa9477fe640 1 -- 172.21.15.87:0/3064411900 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c004220 con 0x7fa9500fee60 2024-09-13T17:19:20.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.511+0000 7fa9477fe640 1 -- 172.21.15.87:0/3064411900 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa94c007e60 con 0x7fa9500fee60 2024-09-13T17:19:20.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.511+0000 7fa958296640 1 -- 172.21.15.87:0/3064411900 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9501a2d40 con 0x7fa9500fee60 2024-09-13T17:19:20.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.511+0000 7fa9477fe640 1 -- 172.21.15.87:0/3064411900 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c004a00 con 0x7fa9500fee60 2024-09-13T17:19:20.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.511+0000 7fa958296640 1 -- 172.21.15.87:0/3064411900 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9501a31f0 con 0x7fa9500fee60 2024-09-13T17:19:20.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.513+0000 7fa9477fe640 1 -- 172.21.15.87:0/3064411900 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fa94c0079b0 con 0x7fa9500fee60 2024-09-13T17:19:20.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.514+0000 7fa95abfd740 1 Processor -- start 2024-09-13T17:19:20.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.514+0000 7fa95abfd740 1 -- start start 2024-09-13T17:19:20.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.514+0000 7fa95abfd740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556688794790 0x556688794b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.514+0000 7fa95abfd740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5566887950b0 0x55668879f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.514+0000 7fa95abfd740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55668879f950 0x5566887a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.514+0000 7fa95abfd740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566886fecc0 con 0x55668879f950 2024-09-13T17:19:20.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.514+0000 7fa95abfd740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566886fc450 con 0x5566887950b0 2024-09-13T17:19:20.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.514+0000 7fa95abfd740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566886f7d40 con 0x556688794790 2024-09-13T17:19:20.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.514+0000 7fa9477fe640 1 --2- 172.21.15.87:0/3064411900 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa93c0a1200 0x7fa93c0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.514+0000 7fa955831640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55668879f950 0x5566887a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.514+0000 7fa956833640 1 --2- 172.21.15.87:0/3064411900 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa93c0a1200 0x7fa93c0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.514+0000 7fa955831640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55668879f950 0x5566887a1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44978/0 (socket says 172.21.15.87:44978) 2024-09-13T17:19:20.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.514+0000 7fa955831640 1 -- 172.21.15.87:0/1420138896 learned_addr learned my addr 172.21.15.87:0/1420138896 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:20.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.514+0000 7fa956032640 1 --2- 172.21.15.87:0/1420138896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5566887950b0 0x55668879f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.514+0000 7fa9477fe640 1 -- 172.21.15.87:0/3064411900 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fa94c0cce50 con 0x7fa9500fee60 2024-09-13T17:19:20.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.514+0000 7fa956833640 1 --2- 172.21.15.87:0/1420138896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556688794790 0x556688794b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.514+0000 7fa955831640 1 -- 172.21.15.87:0/1420138896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556688794790 msgr2=0x556688794b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:20.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.514+0000 7fa955831640 1 --2- 172.21.15.87:0/1420138896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556688794790 0x556688794b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.514+0000 7fa955831640 1 -- 172.21.15.87:0/1420138896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5566887950b0 msgr2=0x55668879f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:20.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.514+0000 7fa955831640 1 --2- 172.21.15.87:0/1420138896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5566887950b0 0x55668879f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.514+0000 7fa955831640 1 -- 172.21.15.87:0/1420138896 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5566886bf620 con 0x55668879f950 2024-09-13T17:19:20.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.515+0000 7fa955831640 1 --2- 172.21.15.87:0/1420138896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55668879f950 0x5566887a1d40 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fa94000bb40 tx=0x7fa94000d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4219b9acc5743bc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:20.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.515+0000 7fa956833640 1 --2- 172.21.15.87:0/3064411900 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa93c0a1200 0x7fa93c0a36c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa948009cd0 tx=0x7fa948031650 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:20.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.515+0000 7fa944e05640 1 -- 172.21.15.87:0/1420138896 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9400127c0 con 0x55668879f950 2024-09-13T17:19:20.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.515+0000 7fa944e05640 1 -- 172.21.15.87:0/1420138896 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa940012dd0 con 0x55668879f950 2024-09-13T17:19:20.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.515+0000 7fa944e05640 1 -- 172.21.15.87:0/1420138896 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94001ae70 con 0x55668879f950 2024-09-13T17:19:20.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.515+0000 7fa95abfd740 1 -- 172.21.15.87:0/1420138896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55668879f950 msgr2=0x5566887a1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:20.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.515+0000 7fa95abfd740 1 --2- 172.21.15.87:0/1420138896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55668879f950 0x5566887a1d40 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fa94000bb40 tx=0x7fa94000d340 comp rx=0 tx=0).stop 2024-09-13T17:19:20.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.516+0000 7fa95abfd740 1 -- 172.21.15.87:0/1420138896 shutdown_connections 2024-09-13T17:19:20.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.516+0000 7fa95abfd740 1 --2- 172.21.15.87:0/1420138896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55668879f950 0x5566887a1d40 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.516+0000 7fa95abfd740 1 --2- 172.21.15.87:0/1420138896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5566887950b0 0x55668879f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.516+0000 7fa95abfd740 1 --2- 172.21.15.87:0/1420138896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556688794790 0x556688794b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.516+0000 7fa95abfd740 1 -- 172.21.15.87:0/1420138896 >> 172.21.15.87:0/1420138896 conn(0x556688790d00 msgr2=0x5566887910e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:20.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.516+0000 7fa95abfd740 1 -- 172.21.15.87:0/1420138896 shutdown_connections 2024-09-13T17:19:20.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.516+0000 7fa95abfd740 1 -- 172.21.15.87:0/1420138896 wait complete. 2024-09-13T17:19:20.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.516+0000 7fa95abfd740 1 -- start start 2024-09-13T17:19:20.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.516+0000 7fa95abfd740 1 Processor -- start 2024-09-13T17:19:20.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.516+0000 7fa95abfd740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556688794790 0x55668879ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.516+0000 7fa95abfd740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5566887950b0 0x55668879f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.516+0000 7fa95abfd740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55668879f950 0x55668879c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.516+0000 7fa95abfd740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566886b6180 con 0x55668879f950 2024-09-13T17:19:20.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.516+0000 7fa95abfd740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566883d0430 con 0x556688794790 2024-09-13T17:19:20.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.516+0000 7fa95abfd740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55668867b5e0 con 0x5566887950b0 2024-09-13T17:19:20.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.516+0000 7fa95abfd740 10 client.0 _ll_register_callbacks cb 0x5566886e7aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:20.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.516+0000 7fa956833640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55668879f950 0x55668879c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.516+0000 7fa956833640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55668879f950 0x55668879c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44980/0 (socket says 172.21.15.87:44980) 2024-09-13T17:19:20.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.516+0000 7fa956833640 1 -- 172.21.15.87:0/1111807184 learned_addr learned my addr 172.21.15.87:0/1111807184 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:20.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.517+0000 7fa956032640 1 --2- 172.21.15.87:0/1111807184 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556688794790 0x55668879ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.517+0000 7fa955831640 1 --2- 172.21.15.87:0/1111807184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5566887950b0 0x55668879f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.517+0000 7fa956833640 1 -- 172.21.15.87:0/1111807184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5566887950b0 msgr2=0x55668879f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:20.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.517+0000 7fa956833640 1 --2- 172.21.15.87:0/1111807184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5566887950b0 0x55668879f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.517+0000 7fa956833640 1 -- 172.21.15.87:0/1111807184 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556688794790 msgr2=0x55668879ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:20.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.517+0000 7fa956833640 1 --2- 172.21.15.87:0/1111807184 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556688794790 0x55668879ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.517+0000 7fa956833640 1 -- 172.21.15.87:0/1111807184 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94000b770 con 0x55668879f950 2024-09-13T17:19:20.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.517+0000 7fa955831640 1 --2- 172.21.15.87:0/1111807184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5566887950b0 0x55668879f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:20.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.517+0000 7fa956833640 1 --2- 172.21.15.87:0/1111807184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55668879f950 0x55668879c3a0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fa948030850 tx=0x7fa948009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3519d0600f181584 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:20.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.517+0000 7fa939ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:19:20.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.517+0000 7fa939ffb640 1 -- 172.21.15.87:0/1111807184 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa948042070 con 0x55668879f950 2024-09-13T17:19:20.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.517+0000 7fa939ffb640 1 -- 172.21.15.87:0/1111807184 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fa948030e70 con 0x55668879f950 2024-09-13T17:19:20.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.517+0000 7fa95abfd740 1 -- 172.21.15.87:0/1111807184 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556688721b80 con 0x55668879f950 2024-09-13T17:19:20.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.517+0000 7fa939ffb640 1 -- 172.21.15.87:0/1111807184 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa94803b980 con 0x55668879f950 2024-09-13T17:19:20.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.517+0000 7fa95abfd740 10 client.17193 fetch_fsmap learned FSMap version 32 2024-09-13T17:19:20.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.517+0000 7fa95abfd740 1 -- 172.21.15.87:0/1111807184 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x5566886f63c0 con 0x55668879f950 2024-09-13T17:19:20.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.517+0000 7fa939ffb640 1 -- 172.21.15.87:0/1111807184 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x556688721b80 con 0x55668879f950 2024-09-13T17:19:20.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.517+0000 7fa939ffb640 1 -- 172.21.15.87:0/1111807184 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 32) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fa948048b50 con 0x55668879f950 2024-09-13T17:19:20.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.517+0000 7fa95abfd740 10 client.17193 fetch_fsmap finished waiting for FSMap version 32 2024-09-13T17:19:20.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.517+0000 7fa95abfd740 10 client.17193 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:19:20.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.518+0000 7fa95abfd740 20 client.17193 populate_metadata read hostname 'smithi087' 2024-09-13T17:19:20.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.518+0000 7fa95abfd740 1 --2- 172.21.15.87:0/1111807184 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5566887af280 0x5566887b16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.518+0000 7fa95abfd740 4 client.17193 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:19:20.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.518+0000 7fa95abfd740 1 -- 172.21.15.87:0/1111807184 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5566886ea1f0 con 0x5566887af280 2024-09-13T17:19:20.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.518+0000 7fa956032640 1 --2- 172.21.15.87:0/1111807184 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5566887af280 0x5566887b16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.518+0000 7fa956032640 1 --2- 172.21.15.87:0/1111807184 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5566887af280 0x5566887b16a0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89f8d1a03533d151 server_cookie=de6e357231387f3f in_seq=0 out_seq=0 2024-09-13T17:19:20.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.518+0000 7fa939ffb640 10 client.17193 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:20.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.519+0000 7fa939ffb640 1 -- 172.21.15.87:0/1111807184 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5566886ea1f0 con 0x5566887af280 2024-09-13T17:19:20.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.519+0000 7fa939ffb640 10 client.17193 handle_command_reply: tid=0 2024-09-13T17:19:20.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.519+0000 7fa95abfd740 1 client.17193 shutdown 2024-09-13T17:19:20.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.519+0000 7fa95abfd740 1 -- 172.21.15.87:0/1111807184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55668879f950 msgr2=0x55668879c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:20.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.519+0000 7fa95abfd740 1 --2- 172.21.15.87:0/1111807184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55668879f950 0x55668879c3a0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fa948030850 tx=0x7fa948009800 comp rx=0 tx=0).stop 2024-09-13T17:19:20.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.519+0000 7fa95abfd740 1 -- 172.21.15.87:0/1111807184 shutdown_connections 2024-09-13T17:19:20.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.519+0000 7fa95abfd740 1 --2- 172.21.15.87:0/1111807184 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5566887af280 0x5566887b16a0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.519+0000 7fa95abfd740 1 --2- 172.21.15.87:0/1111807184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55668879f950 0x55668879c3a0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.519+0000 7fa939ffb640 0 client.17193 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:20.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.519+0000 7fa95abfd740 1 --2- 172.21.15.87:0/1111807184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5566887950b0 0x55668879f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.519+0000 7fa95abfd740 1 --2- 172.21.15.87:0/1111807184 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556688794790 0x55668879ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.519+0000 7fa95abfd740 1 -- 172.21.15.87:0/1111807184 >> 172.21.15.87:0/1111807184 conn(0x556688790d00 msgr2=0x55668878feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:20.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.519+0000 7fa95abfd740 1 -- 172.21.15.87:0/1111807184 shutdown_connections 2024-09-13T17:19:20.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.519+0000 7fa95abfd740 1 -- 172.21.15.87:0/1111807184 wait complete. 2024-09-13T17:19:20.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.519+0000 7fa95abfd740 20 client.17193 trim_cache size 0 max 16384 2024-09-13T17:19:20.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.530+0000 7fa95abfd740 1 Processor -- start 2024-09-13T17:19:20.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.530+0000 7fa95abfd740 1 -- start start 2024-09-13T17:19:20.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.530+0000 7fa95abfd740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556688794790 0x5566887906a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.530+0000 7fa95abfd740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5566887950b0 0x5566887a6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.530+0000 7fa95abfd740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55668879f950 0x5566887a6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.530+0000 7fa95abfd740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566887918b0 con 0x5566887950b0 2024-09-13T17:19:20.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.530+0000 7fa95abfd740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556688791c60 con 0x55668879f950 2024-09-13T17:19:20.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.530+0000 7fa95abfd740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566887ab8f0 con 0x556688794790 2024-09-13T17:19:20.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.530+0000 7fa955831640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5566887950b0 0x5566887a6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.530+0000 7fa955831640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5566887950b0 0x5566887a6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44986/0 (socket says 172.21.15.87:44986) 2024-09-13T17:19:20.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.530+0000 7fa955831640 1 -- 172.21.15.87:0/2043203261 learned_addr learned my addr 172.21.15.87:0/2043203261 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:20.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.531+0000 7fa956833640 1 --2- 172.21.15.87:0/2043203261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55668879f950 0x5566887a6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.531+0000 7fa955831640 1 -- 172.21.15.87:0/2043203261 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556688794790 msgr2=0x5566887906a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:20.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.531+0000 7fa955831640 1 --2- 172.21.15.87:0/2043203261 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556688794790 0x5566887906a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.531+0000 7fa955831640 1 -- 172.21.15.87:0/2043203261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55668879f950 msgr2=0x5566887a6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:20.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.531+0000 7fa955831640 1 --2- 172.21.15.87:0/2043203261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55668879f950 0x5566887a6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.531+0000 7fa955831640 1 -- 172.21.15.87:0/2043203261 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556688698770 con 0x5566887950b0 2024-09-13T17:19:20.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.531+0000 7fa956833640 1 --2- 172.21.15.87:0/2043203261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55668879f950 0x5566887a6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:20.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.531+0000 7fa955831640 1 --2- 172.21.15.87:0/2043203261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5566887950b0 0x5566887a6620 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fa94001d040 tx=0x7fa94000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57b6314915e3faab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:20.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.531+0000 7fa945606640 1 -- 172.21.15.87:0/2043203261 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9400129c0 con 0x5566887950b0 2024-09-13T17:19:20.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.531+0000 7fa945606640 1 -- 172.21.15.87:0/2043203261 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa94001a8f0 con 0x5566887950b0 2024-09-13T17:19:20.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.531+0000 7fa945606640 1 -- 172.21.15.87:0/2043203261 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa940005630 con 0x5566887950b0 2024-09-13T17:19:20.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.531+0000 7fa95abfd740 1 -- 172.21.15.87:0/2043203261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5566887950b0 msgr2=0x5566887a6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:20.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.531+0000 7fa95abfd740 1 --2- 172.21.15.87:0/2043203261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5566887950b0 0x5566887a6620 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fa94001d040 tx=0x7fa94000b6d0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.532+0000 7fa95abfd740 1 -- 172.21.15.87:0/2043203261 shutdown_connections 2024-09-13T17:19:20.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.532+0000 7fa95abfd740 1 --2- 172.21.15.87:0/2043203261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55668879f950 0x5566887a6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.532+0000 7fa95abfd740 1 --2- 172.21.15.87:0/2043203261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5566887950b0 0x5566887a6620 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.532+0000 7fa95abfd740 1 --2- 172.21.15.87:0/2043203261 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556688794790 0x5566887906a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.532+0000 7fa95abfd740 1 -- 172.21.15.87:0/2043203261 >> 172.21.15.87:0/2043203261 conn(0x556688790d00 msgr2=0x5566887b6020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:20.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.532+0000 7fa95abfd740 1 -- 172.21.15.87:0/2043203261 shutdown_connections 2024-09-13T17:19:20.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.532+0000 7fa95abfd740 1 -- 172.21.15.87:0/2043203261 wait complete. 2024-09-13T17:19:20.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.532+0000 7fa95abfd740 1 -- start start 2024-09-13T17:19:20.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.532+0000 7fa95abfd740 1 Processor -- start 2024-09-13T17:19:20.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.532+0000 7fa95abfd740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556688794790 0x5566887a6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.532+0000 7fa95abfd740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5566887950b0 0x5566887a4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.532+0000 7fa95abfd740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55668879f950 0x5566887a5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.532+0000 7fa95abfd740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566887a5640 con 0x556688794790 2024-09-13T17:19:20.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.532+0000 7fa95abfd740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566887a57b0 con 0x55668879f950 2024-09-13T17:19:20.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.532+0000 7fa95abfd740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566887a5970 con 0x5566887950b0 2024-09-13T17:19:20.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.532+0000 7fa95abfd740 10 client.0 _ll_register_callbacks cb 0x7fa94000b340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:20.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.532+0000 7fa956032640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556688794790 0x5566887a6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.532+0000 7fa956032640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556688794790 0x5566887a6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44996/0 (socket says 172.21.15.87:44996) 2024-09-13T17:19:20.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.532+0000 7fa956032640 1 -- 172.21.15.87:0/2251873512 learned_addr learned my addr 172.21.15.87:0/2251873512 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:20.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.532+0000 7fa956833640 1 --2- 172.21.15.87:0/2251873512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55668879f950 0x5566887a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.532+0000 7fa956032640 1 -- 172.21.15.87:0/2251873512 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5566887950b0 msgr2=0x5566887a4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:20.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.532+0000 7fa956032640 1 --2- 172.21.15.87:0/2251873512 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5566887950b0 0x5566887a4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.532+0000 7fa956032640 1 -- 172.21.15.87:0/2251873512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55668879f950 msgr2=0x5566887a5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:20.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.532+0000 7fa956032640 1 --2- 172.21.15.87:0/2251873512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55668879f950 0x5566887a5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.532+0000 7fa956032640 1 -- 172.21.15.87:0/2251873512 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5566886bf620 con 0x556688794790 2024-09-13T17:19:20.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.532+0000 7fa956833640 1 --2- 172.21.15.87:0/2251873512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55668879f950 0x5566887a5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:20.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.533+0000 7fa956032640 1 --2- 172.21.15.87:0/2251873512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556688794790 0x5566887a6800 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fa94c0ca250 tx=0x7fa94c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f3d4146802249f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:20.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.533+0000 7fa939ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:19:20.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.533+0000 7fa939ffb640 1 -- 172.21.15.87:0/2251873512 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c0a2030 con 0x556688794790 2024-09-13T17:19:20.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.533+0000 7fa939ffb640 1 -- 172.21.15.87:0/2251873512 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fa94c097f50 con 0x556688794790 2024-09-13T17:19:20.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.533+0000 7fa95abfd740 1 -- 172.21.15.87:0/2251873512 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa940012dd0 con 0x556688794790 2024-09-13T17:19:20.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.533+0000 7fa939ffb640 1 -- 172.21.15.87:0/2251873512 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa94c0ca470 con 0x556688794790 2024-09-13T17:19:20.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.533+0000 7fa95abfd740 10 client.17199 fetch_fsmap learned FSMap version 32 2024-09-13T17:19:20.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.533+0000 7fa95abfd740 1 -- 172.21.15.87:0/2251873512 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x5566886bde80 con 0x556688794790 2024-09-13T17:19:20.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.533+0000 7fa939ffb640 1 -- 172.21.15.87:0/2251873512 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa940012dd0 con 0x556688794790 2024-09-13T17:19:20.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.533+0000 7fa939ffb640 1 -- 172.21.15.87:0/2251873512 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 32) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fa94c016030 con 0x556688794790 2024-09-13T17:19:20.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.533+0000 7fa95abfd740 10 client.17199 fetch_fsmap finished waiting for FSMap version 32 2024-09-13T17:19:20.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.533+0000 7fa95abfd740 10 client.17199 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:19:20.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.533+0000 7fa95abfd740 20 client.17199 populate_metadata read hostname 'smithi087' 2024-09-13T17:19:20.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.533+0000 7fa95abfd740 1 --2- 172.21.15.87:0/2251873512 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x556688806cf0 0x556688809110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:20.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.533+0000 7fa95abfd740 4 client.17199 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:19:20.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.533+0000 7fa95abfd740 1 -- 172.21.15.87:0/2251873512 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5566883eb4e0 con 0x556688806cf0 2024-09-13T17:19:20.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.533+0000 7fa955831640 1 --2- 172.21.15.87:0/2251873512 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x556688806cf0 0x556688809110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:20.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.534+0000 7fa939ffb640 10 client.17199 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:20.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.534+0000 7fa955831640 1 --2- 172.21.15.87:0/2251873512 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x556688806cf0 0x556688809110 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2171ae76d723b75b server_cookie=87d5f24fbed9105b in_seq=0 out_seq=0 2024-09-13T17:19:20.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.534+0000 7fa939ffb640 1 -- 172.21.15.87:0/2251873512 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5566883eb4e0 con 0x556688806cf0 2024-09-13T17:19:20.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.534+0000 7fa939ffb640 10 client.17199 handle_command_reply: tid=0 2024-09-13T17:19:20.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.534+0000 7fa95abfd740 1 client.17199 shutdown 2024-09-13T17:19:20.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.534+0000 7fa95abfd740 1 -- 172.21.15.87:0/2251873512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556688794790 msgr2=0x5566887a6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:20.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.534+0000 7fa95abfd740 1 --2- 172.21.15.87:0/2251873512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556688794790 0x5566887a6800 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fa94c0ca250 tx=0x7fa94c00c810 comp rx=0 tx=0).stop 2024-09-13T17:19:20.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.534+0000 7fa95abfd740 1 -- 172.21.15.87:0/2251873512 shutdown_connections 2024-09-13T17:19:20.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.534+0000 7fa95abfd740 1 --2- 172.21.15.87:0/2251873512 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x556688806cf0 0x556688809110 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.534+0000 7fa95abfd740 1 --2- 172.21.15.87:0/2251873512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55668879f950 0x5566887a5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.534+0000 7fa95abfd740 1 --2- 172.21.15.87:0/2251873512 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5566887950b0 0x5566887a4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.534+0000 7fa939ffb640 0 client.17199 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:20.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.534+0000 7fa95abfd740 1 --2- 172.21.15.87:0/2251873512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556688794790 0x5566887a6800 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.534+0000 7fa95abfd740 1 -- 172.21.15.87:0/2251873512 >> 172.21.15.87:0/2251873512 conn(0x556688790d00 msgr2=0x556688797360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:20.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.534+0000 7fa95abfd740 1 -- 172.21.15.87:0/2251873512 shutdown_connections 2024-09-13T17:19:20.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.534+0000 7fa95abfd740 1 -- 172.21.15.87:0/2251873512 wait complete. 2024-09-13T17:19:20.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.534+0000 7fa95abfd740 20 client.17199 trim_cache size 0 max 16384 2024-09-13T17:19:20.543 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:19:20.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.535+0000 7fa958296640 1 -- 172.21.15.87:0/3064411900 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa93c0a1200 msgr2=0x7fa93c0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:20.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.535+0000 7fa958296640 1 --2- 172.21.15.87:0/3064411900 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa93c0a1200 0x7fa93c0a36c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa948009cd0 tx=0x7fa948031650 comp rx=0 tx=0).stop 2024-09-13T17:19:20.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.535+0000 7fa958296640 1 -- 172.21.15.87:0/3064411900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9500fee60 msgr2=0x7fa950197010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:20.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.535+0000 7fa958296640 1 --2- 172.21.15.87:0/3064411900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9500fee60 0x7fa950197010 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fa94c00c890 tx=0x7fa94c00cd50 comp rx=0 tx=0).stop 2024-09-13T17:19:20.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.535+0000 7fa958296640 1 -- 172.21.15.87:0/3064411900 shutdown_connections 2024-09-13T17:19:20.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.535+0000 7fa958296640 1 --2- 172.21.15.87:0/3064411900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa950197a90 0x7fa9501a2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.535+0000 7fa958296640 1 --2- 172.21.15.87:0/3064411900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa950103fb0 0x7fa950197550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.535+0000 7fa958296640 1 --2- 172.21.15.87:0/3064411900 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa93c0a1200 0x7fa93c0a36c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.535+0000 7fa958296640 1 --2- 172.21.15.87:0/3064411900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9500fee60 0x7fa950197010 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:20.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.535+0000 7fa958296640 1 -- 172.21.15.87:0/3064411900 >> 172.21.15.87:0/3064411900 conn(0x7fa950075c60 msgr2=0x7fa9501027a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:20.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.535+0000 7fa958296640 1 -- 172.21.15.87:0/3064411900 shutdown_connections 2024-09-13T17:19:20.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:20.535+0000 7fa958296640 1 -- 172.21.15.87:0/3064411900 wait complete. 2024-09-13T17:19:20.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:20 smithi087 ceph-mon[30934]: scrub queued for path: / 2024-09-13T17:19:20.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:20 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:19:20.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:20 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:19:20.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:20 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:19:20.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:20 smithi087 ceph-mon[30934]: scrub summary: idle 2024-09-13T17:19:20.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:20 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/275671563' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:19:20.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:20 smithi149 ceph-mon[35496]: scrub queued for path: / 2024-09-13T17:19:20.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:20 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:19:20.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:20 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:19:20.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:20 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:19:20.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:20 smithi149 ceph-mon[35496]: scrub summary: idle 2024-09-13T17:19:20.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:20 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/275671563' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:19:20.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:20 smithi118 ceph-mon[34374]: scrub queued for path: / 2024-09-13T17:19:20.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:20 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:19:20.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:20 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:19:20.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:20 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:19:20.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:20 smithi118 ceph-mon[34374]: scrub summary: idle 2024-09-13T17:19:20.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:20 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/275671563' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:19:21.547 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-13T17:19:21.547 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-09-13T17:19:21.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.662+0000 7f045ec44640 1 -- 172.21.15.87:0/4265629374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0458100900 msgr2=0x7f0458104940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:21.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.662+0000 7f045ec44640 1 --2- 172.21.15.87:0/4265629374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0458100900 0x7f0458104940 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f0444009930 tx=0x7f044402a420 comp rx=0 tx=0).stop 2024-09-13T17:19:21.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.662+0000 7f045ec44640 1 -- 172.21.15.87:0/4265629374 shutdown_connections 2024-09-13T17:19:21.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.662+0000 7f045ec44640 1 --2- 172.21.15.87:0/4265629374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04581050a0 0x7f045810cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.662+0000 7f045ec44640 1 --2- 172.21.15.87:0/4265629374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0458100900 0x7f0458104940 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.662+0000 7f045ec44640 1 --2- 172.21.15.87:0/4265629374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04580fff50 0x7f0458100330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.662+0000 7f045ec44640 1 -- 172.21.15.87:0/4265629374 >> 172.21.15.87:0/4265629374 conn(0x7f04580fb9e0 msgr2=0x7f04580fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:21.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.662+0000 7f045ec44640 1 -- 172.21.15.87:0/4265629374 shutdown_connections 2024-09-13T17:19:21.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.662+0000 7f045ec44640 1 -- 172.21.15.87:0/4265629374 wait complete. 2024-09-13T17:19:21.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.663+0000 7f045ec44640 1 Processor -- start 2024-09-13T17:19:21.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.663+0000 7f045ec44640 1 -- start start 2024-09-13T17:19:21.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.663+0000 7f045ec44640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04580fff50 0x7f04580727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.663+0000 7f045ec44640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04581050a0 0x7f0458072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.663+0000 7f045ec44640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0458073230 0x7f04581a4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.663+0000 7f045ec44640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04581a4ac0 con 0x7f04581050a0 2024-09-13T17:19:21.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.663+0000 7f045ec44640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04581a4c30 con 0x7f04580fff50 2024-09-13T17:19:21.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.663+0000 7f045ec44640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04581a4df0 con 0x7f0458073230 2024-09-13T17:19:21.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.663+0000 7f0457fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04581050a0 0x7f0458072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.663+0000 7f0457fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04581050a0 0x7f0458072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45020/0 (socket says 172.21.15.87:45020) 2024-09-13T17:19:21.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.663+0000 7f0457fff640 1 -- 172.21.15.87:0/3137527983 learned_addr learned my addr 172.21.15.87:0/3137527983 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:21.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.663+0000 7f045c9e0640 1 --2- 172.21.15.87:0/3137527983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04580fff50 0x7f04580727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.663+0000 7f045d1e1640 1 --2- 172.21.15.87:0/3137527983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0458073230 0x7f04581a4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.664+0000 7f0457fff640 1 -- 172.21.15.87:0/3137527983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0458073230 msgr2=0x7f04581a4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:21.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.664+0000 7f0457fff640 1 --2- 172.21.15.87:0/3137527983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0458073230 0x7f04581a4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.664+0000 7f0457fff640 1 -- 172.21.15.87:0/3137527983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04580fff50 msgr2=0x7f04580727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:21.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.664+0000 7f0457fff640 1 --2- 172.21.15.87:0/3137527983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04580fff50 0x7f04580727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.664+0000 7f0457fff640 1 -- 172.21.15.87:0/3137527983 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0444009560 con 0x7f04581050a0 2024-09-13T17:19:21.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.664+0000 7f0457fff640 1 --2- 172.21.15.87:0/3137527983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04581050a0 0x7f0458072cf0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f0444009900 tx=0x7f04440042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:21.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.664+0000 7f0455ffb640 1 -- 172.21.15.87:0/3137527983 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0444003a00 con 0x7f04581050a0 2024-09-13T17:19:21.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.664+0000 7f0455ffb640 1 -- 172.21.15.87:0/3137527983 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f04440044e0 con 0x7f04581050a0 2024-09-13T17:19:21.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.664+0000 7f045ec44640 1 -- 172.21.15.87:0/3137527983 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04581a5070 con 0x7f04581050a0 2024-09-13T17:19:21.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.664+0000 7f0455ffb640 1 -- 172.21.15.87:0/3137527983 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044403a3c0 con 0x7f04581050a0 2024-09-13T17:19:21.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.664+0000 7f045ec44640 1 -- 172.21.15.87:0/3137527983 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04581a5570 con 0x7f04581050a0 2024-09-13T17:19:21.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.666+0000 7f0455ffb640 1 -- 172.21.15.87:0/3137527983 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f044403b460 con 0x7f04581050a0 2024-09-13T17:19:21.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.667+0000 7f0461a38740 1 Processor -- start 2024-09-13T17:19:21.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.667+0000 7f0461a38740 1 -- start start 2024-09-13T17:19:21.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.667+0000 7f0455ffb640 1 --2- 172.21.15.87:0/3137527983 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f04480a1280 0x7f04480a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.667+0000 7f0461a38740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55855550a7c0 0x55855550aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.667+0000 7f0461a38740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55855550b0e0 0x558555515440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.667+0000 7f0461a38740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558555515980 0x558555517d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.667+0000 7f0461a38740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558555475c60 con 0x55855550b0e0 2024-09-13T17:19:21.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.667+0000 7f0461a38740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585554733f0 con 0x55855550a7c0 2024-09-13T17:19:21.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.667+0000 7f0461a38740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55855546ece0 con 0x558555515980 2024-09-13T17:19:21.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.667+0000 7f0455ffb640 1 -- 172.21.15.87:0/3137527983 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f04440ee0c0 con 0x7f04581050a0 2024-09-13T17:19:21.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.667+0000 7f045d1e1640 1 --2- 172.21.15.87:0/3137527983 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f04480a1280 0x7f04480a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.667+0000 7f0457fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55855550b0e0 0x558555515440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.667+0000 7f0457fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55855550b0e0 0x558555515440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45036/0 (socket says 172.21.15.87:45036) 2024-09-13T17:19:21.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.667+0000 7f0457fff640 1 -- 172.21.15.87:0/3631130631 learned_addr learned my addr 172.21.15.87:0/3631130631 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:21.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.667+0000 7f045d1e1640 1 --2- 172.21.15.87:0/3631130631 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558555515980 0x558555517d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.667+0000 7f045c9e0640 1 --2- 172.21.15.87:0/3631130631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55855550a7c0 0x55855550aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.668+0000 7f0457fff640 1 -- 172.21.15.87:0/3631130631 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558555515980 msgr2=0x558555517d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:21.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.668+0000 7f0457fff640 1 --2- 172.21.15.87:0/3631130631 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558555515980 0x558555517d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.668+0000 7f0457fff640 1 -- 172.21.15.87:0/3631130631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55855550a7c0 msgr2=0x55855550aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:21.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.668+0000 7f0457fff640 1 --2- 172.21.15.87:0/3631130631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55855550a7c0 0x55855550aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.668+0000 7f0457fff640 1 -- 172.21.15.87:0/3631130631 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55855542a970 con 0x55855550b0e0 2024-09-13T17:19:21.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.668+0000 7f045d1e1640 1 --2- 172.21.15.87:0/3137527983 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f04480a1280 0x7f04480a3740 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f04500092f0 tx=0x7f0450014a70 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:21.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.668+0000 7f0457fff640 1 --2- 172.21.15.87:0/3631130631 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55855550b0e0 0x558555515440 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f04440b79b0 tx=0x7f04440ba960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d5e9d2087cb3bc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:21.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.668+0000 7f0442ffd640 1 -- 172.21.15.87:0/3631130631 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04440bed70 con 0x55855550b0e0 2024-09-13T17:19:21.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.668+0000 7f0442ffd640 1 -- 172.21.15.87:0/3631130631 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f04440c33c0 con 0x55855550b0e0 2024-09-13T17:19:21.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.668+0000 7f0442ffd640 1 -- 172.21.15.87:0/3631130631 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04440b7650 con 0x55855550b0e0 2024-09-13T17:19:21.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.669+0000 7f0461a38740 1 -- 172.21.15.87:0/3631130631 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55855550b0e0 msgr2=0x558555515440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:21.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.669+0000 7f0461a38740 1 --2- 172.21.15.87:0/3631130631 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55855550b0e0 0x558555515440 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f04440b79b0 tx=0x7f04440ba960 comp rx=0 tx=0).stop 2024-09-13T17:19:21.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.669+0000 7f0461a38740 1 -- 172.21.15.87:0/3631130631 shutdown_connections 2024-09-13T17:19:21.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.669+0000 7f0461a38740 1 --2- 172.21.15.87:0/3631130631 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558555515980 0x558555517d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.669+0000 7f0461a38740 1 --2- 172.21.15.87:0/3631130631 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55855550b0e0 0x558555515440 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.669+0000 7f0461a38740 1 --2- 172.21.15.87:0/3631130631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55855550a7c0 0x55855550aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.669+0000 7f0461a38740 1 -- 172.21.15.87:0/3631130631 >> 172.21.15.87:0/3631130631 conn(0x558555506d50 msgr2=0x558555507130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:21.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.669+0000 7f0461a38740 1 -- 172.21.15.87:0/3631130631 shutdown_connections 2024-09-13T17:19:21.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.669+0000 7f0461a38740 1 -- 172.21.15.87:0/3631130631 wait complete. 2024-09-13T17:19:21.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.669+0000 7f0461a38740 1 -- start start 2024-09-13T17:19:21.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.669+0000 7f0461a38740 1 Processor -- start 2024-09-13T17:19:21.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.670+0000 7f0461a38740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55855550a7c0 0x558555512690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.670+0000 7f0461a38740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55855550b0e0 0x558555512bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.670+0000 7f0461a38740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558555515980 0x558555513110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.670+0000 7f0461a38740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55855542cf80 con 0x558555515980 2024-09-13T17:19:21.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.670+0000 7f0461a38740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55855542cc20 con 0x55855550b0e0 2024-09-13T17:19:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.670+0000 7f0461a38740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585553f9ab0 con 0x55855550a7c0 2024-09-13T17:19:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.670+0000 7f0461a38740 10 client.0 _ll_register_callbacks cb 0x558555468350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.670+0000 7f045d1e1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558555515980 0x558555513110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.670+0000 7f045d1e1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558555515980 0x558555513110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45040/0 (socket says 172.21.15.87:45040) 2024-09-13T17:19:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.670+0000 7f045d1e1640 1 -- 172.21.15.87:0/196614953 learned_addr learned my addr 172.21.15.87:0/196614953 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.670+0000 7f045c9e0640 1 --2- 172.21.15.87:0/196614953 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55855550a7c0 0x558555512690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.670+0000 7f0457fff640 1 --2- 172.21.15.87:0/196614953 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55855550b0e0 0x558555512bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.670+0000 7f045d1e1640 1 -- 172.21.15.87:0/196614953 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55855550a7c0 msgr2=0x558555512690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.670+0000 7f045d1e1640 1 --2- 172.21.15.87:0/196614953 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55855550a7c0 0x558555512690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.670+0000 7f045d1e1640 1 -- 172.21.15.87:0/196614953 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55855550b0e0 msgr2=0x558555512bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.670+0000 7f045d1e1640 1 --2- 172.21.15.87:0/196614953 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55855550b0e0 0x558555512bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.670+0000 7f045d1e1640 1 -- 172.21.15.87:0/196614953 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04581a5570 con 0x558555515980 2024-09-13T17:19:21.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.670+0000 7f045d1e1640 1 --2- 172.21.15.87:0/196614953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558555515980 0x558555513110 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f0450012a40 tx=0x7f0450004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd9f6b562405be53 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:21.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.670+0000 7f0437fff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:19:21.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.670+0000 7f0437fff640 1 -- 172.21.15.87:0/196614953 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0450004d20 con 0x558555515980 2024-09-13T17:19:21.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.670+0000 7f0437fff640 1 -- 172.21.15.87:0/196614953 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f045000fa70 con 0x558555515980 2024-09-13T17:19:21.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.670+0000 7f0461a38740 1 -- 172.21.15.87:0/196614953 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558555162590 con 0x558555515980 2024-09-13T17:19:21.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.670+0000 7f0437fff640 1 -- 172.21.15.87:0/196614953 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0450004e80 con 0x558555515980 2024-09-13T17:19:21.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.670+0000 7f0461a38740 10 client.17211 fetch_fsmap learned FSMap version 32 2024-09-13T17:19:21.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.671+0000 7f0461a38740 1 -- 172.21.15.87:0/196614953 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55855546d360 con 0x558555515980 2024-09-13T17:19:21.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.671+0000 7f0437fff640 1 -- 172.21.15.87:0/196614953 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x558555162590 con 0x558555515980 2024-09-13T17:19:21.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.671+0000 7f0437fff640 1 -- 172.21.15.87:0/196614953 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 32) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f0450020440 con 0x558555515980 2024-09-13T17:19:21.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.671+0000 7f0461a38740 10 client.17211 fetch_fsmap finished waiting for FSMap version 32 2024-09-13T17:19:21.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.671+0000 7f0461a38740 10 client.17211 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:19:21.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.671+0000 7f0461a38740 20 client.17211 populate_metadata read hostname 'smithi087' 2024-09-13T17:19:21.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.671+0000 7f0461a38740 1 --2- 172.21.15.87:0/196614953 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x558555525420 0x558555527840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.671+0000 7f0461a38740 4 client.17211 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:19:21.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.671+0000 7f0461a38740 1 -- 172.21.15.87:0/196614953 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558555173860 con 0x558555525420 2024-09-13T17:19:21.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.671+0000 7f045c9e0640 1 --2- 172.21.15.87:0/196614953 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x558555525420 0x558555527840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.672+0000 7f045c9e0640 1 --2- 172.21.15.87:0/196614953 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x558555525420 0x558555527840 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f5265d897f198a3 server_cookie=e3228d6156593c28 in_seq=0 out_seq=0 2024-09-13T17:19:21.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.672+0000 7f0437fff640 10 client.17211 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:21.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.672+0000 7f0437fff640 1 -- 172.21.15.87:0/196614953 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x558555173860 con 0x558555525420 2024-09-13T17:19:21.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.672+0000 7f0437fff640 10 client.17211 handle_command_reply: tid=0 2024-09-13T17:19:21.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.672+0000 7f0461a38740 1 client.17211 shutdown 2024-09-13T17:19:21.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.672+0000 7f0461a38740 1 -- 172.21.15.87:0/196614953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558555515980 msgr2=0x558555513110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:21.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.672+0000 7f0461a38740 1 --2- 172.21.15.87:0/196614953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558555515980 0x558555513110 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f0450012a40 tx=0x7f0450004ab0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.672+0000 7f0461a38740 1 -- 172.21.15.87:0/196614953 shutdown_connections 2024-09-13T17:19:21.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.672+0000 7f0461a38740 1 --2- 172.21.15.87:0/196614953 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x558555525420 0x558555527840 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.672+0000 7f0461a38740 1 --2- 172.21.15.87:0/196614953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558555515980 0x558555513110 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.672+0000 7f0461a38740 1 --2- 172.21.15.87:0/196614953 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55855550b0e0 0x558555512bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.672+0000 7f0437fff640 0 client.17211 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:21.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.672+0000 7f0461a38740 1 --2- 172.21.15.87:0/196614953 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55855550a7c0 0x558555512690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.672+0000 7f0461a38740 1 -- 172.21.15.87:0/196614953 >> 172.21.15.87:0/196614953 conn(0x558555506d50 msgr2=0x55855550c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:21.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.672+0000 7f0461a38740 1 -- 172.21.15.87:0/196614953 shutdown_connections 2024-09-13T17:19:21.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.672+0000 7f0461a38740 1 -- 172.21.15.87:0/196614953 wait complete. 2024-09-13T17:19:21.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.673+0000 7f0461a38740 20 client.17211 trim_cache size 0 max 16384 2024-09-13T17:19:21.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.686+0000 7f0461a38740 1 Processor -- start 2024-09-13T17:19:21.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.687+0000 7f0461a38740 1 -- start start 2024-09-13T17:19:21.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.687+0000 7f0461a38740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55855550a7c0 0x55855551c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.687+0000 7f0461a38740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55855550b0e0 0x55855551c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.687+0000 7f0461a38740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558555515980 0x55855550c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.687+0000 7f0461a38740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558555525250 con 0x55855550b0e0 2024-09-13T17:19:21.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.687+0000 7f0461a38740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558555515520 con 0x558555515980 2024-09-13T17:19:21.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.687+0000 7f0461a38740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x558555523ce0 con 0x55855550a7c0 2024-09-13T17:19:21.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.687+0000 7f0457fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55855550b0e0 0x55855551c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.687+0000 7f0457fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55855550b0e0 0x55855551c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45044/0 (socket says 172.21.15.87:45044) 2024-09-13T17:19:21.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.687+0000 7f0457fff640 1 -- 172.21.15.87:0/2955569689 learned_addr learned my addr 172.21.15.87:0/2955569689 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:21.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.687+0000 7f0457fff640 1 -- 172.21.15.87:0/2955569689 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55855550a7c0 msgr2=0x55855551c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:21.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.687+0000 7f0457fff640 1 --2- 172.21.15.87:0/2955569689 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55855550a7c0 0x55855551c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.687+0000 7f0457fff640 1 -- 172.21.15.87:0/2955569689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558555515980 msgr2=0x55855550c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:21.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.687+0000 7f0457fff640 1 --2- 172.21.15.87:0/2955569689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558555515980 0x55855550c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.687+0000 7f0457fff640 1 -- 172.21.15.87:0/2955569689 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55855540f1c0 con 0x55855550b0e0 2024-09-13T17:19:21.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.687+0000 7f0457fff640 1 --2- 172.21.15.87:0/2955569689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55855550b0e0 0x55855551c880 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f04440b6cc0 tx=0x7f04440bab30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78db78dcbe4bcb19 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:21.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.687+0000 7f04437fe640 1 -- 172.21.15.87:0/2955569689 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04440bed70 con 0x55855550b0e0 2024-09-13T17:19:21.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.687+0000 7f04437fe640 1 -- 172.21.15.87:0/2955569689 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f04440b92e0 con 0x55855550b0e0 2024-09-13T17:19:21.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.687+0000 7f04437fe640 1 -- 172.21.15.87:0/2955569689 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04440bb1a0 con 0x55855550b0e0 2024-09-13T17:19:21.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.688+0000 7f0461a38740 1 -- 172.21.15.87:0/2955569689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55855550b0e0 msgr2=0x55855551c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:21.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.688+0000 7f0461a38740 1 --2- 172.21.15.87:0/2955569689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55855550b0e0 0x55855551c880 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f04440b6cc0 tx=0x7f04440bab30 comp rx=0 tx=0).stop 2024-09-13T17:19:21.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.688+0000 7f0461a38740 1 -- 172.21.15.87:0/2955569689 shutdown_connections 2024-09-13T17:19:21.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.688+0000 7f0461a38740 1 --2- 172.21.15.87:0/2955569689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558555515980 0x55855550c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.688+0000 7f0461a38740 1 --2- 172.21.15.87:0/2955569689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55855550b0e0 0x55855551c880 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.688+0000 7f0461a38740 1 --2- 172.21.15.87:0/2955569689 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55855550a7c0 0x55855551c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.688+0000 7f0461a38740 1 -- 172.21.15.87:0/2955569689 >> 172.21.15.87:0/2955569689 conn(0x558555506d50 msgr2=0x55855550d980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:21.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.688+0000 7f0461a38740 1 -- 172.21.15.87:0/2955569689 shutdown_connections 2024-09-13T17:19:21.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.688+0000 7f0461a38740 1 -- 172.21.15.87:0/2955569689 wait complete. 2024-09-13T17:19:21.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.688+0000 7f0461a38740 1 -- start start 2024-09-13T17:19:21.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.688+0000 7f0461a38740 1 Processor -- start 2024-09-13T17:19:21.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.689+0000 7f0461a38740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55855550a7c0 0x558555575c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.689+0000 7f0461a38740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55855550b0e0 0x558555576170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.689+0000 7f0461a38740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558555515980 0x55855551b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.689+0000 7f0461a38740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55855551bd40 con 0x55855550a7c0 2024-09-13T17:19:21.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.689+0000 7f0461a38740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55855551beb0 con 0x55855550b0e0 2024-09-13T17:19:21.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.689+0000 7f0461a38740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55855551c070 con 0x558555515980 2024-09-13T17:19:21.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.689+0000 7f0461a38740 10 client.0 _ll_register_callbacks cb 0x7f04500127a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:21.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.689+0000 7f045c9e0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55855550a7c0 0x558555575c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.689+0000 7f045c9e0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55855550a7c0 0x558555575c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45050/0 (socket says 172.21.15.87:45050) 2024-09-13T17:19:21.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.689+0000 7f045c9e0640 1 -- 172.21.15.87:0/1750329337 learned_addr learned my addr 172.21.15.87:0/1750329337 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:21.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.689+0000 7f045d1e1640 1 --2- 172.21.15.87:0/1750329337 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558555515980 0x55855551b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.689+0000 7f0457fff640 1 --2- 172.21.15.87:0/1750329337 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55855550b0e0 0x558555576170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.689+0000 7f045c9e0640 1 -- 172.21.15.87:0/1750329337 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558555515980 msgr2=0x55855551b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:21.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.689+0000 7f045c9e0640 1 --2- 172.21.15.87:0/1750329337 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558555515980 0x55855551b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.689+0000 7f045c9e0640 1 -- 172.21.15.87:0/1750329337 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55855550b0e0 msgr2=0x558555576170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:21.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.689+0000 7f045c9e0640 1 --2- 172.21.15.87:0/1750329337 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55855550b0e0 0x558555576170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.689+0000 7f045c9e0640 1 -- 172.21.15.87:0/1750329337 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55855542a970 con 0x55855550a7c0 2024-09-13T17:19:21.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.689+0000 7f045c9e0640 1 --2- 172.21.15.87:0/1750329337 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55855550a7c0 0x558555575c30 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x558555528150 tx=0x7f044c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a69ef5c585a339 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:21.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.689+0000 7f0437fff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:19:21.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.689+0000 7f0437fff640 1 -- 172.21.15.87:0/1750329337 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c016040 con 0x55855550a7c0 2024-09-13T17:19:21.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.689+0000 7f0437fff640 1 -- 172.21.15.87:0/1750329337 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f044c003e60 con 0x55855550a7c0 2024-09-13T17:19:21.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.689+0000 7f0461a38740 1 -- 172.21.15.87:0/1750329337 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f04440c33c0 con 0x55855550a7c0 2024-09-13T17:19:21.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.690+0000 7f0437fff640 1 -- 172.21.15.87:0/1750329337 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f044c01b5d0 con 0x55855550a7c0 2024-09-13T17:19:21.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.690+0000 7f0461a38740 10 client.17217 fetch_fsmap learned FSMap version 32 2024-09-13T17:19:21.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.690+0000 7f0461a38740 1 -- 172.21.15.87:0/1750329337 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x558555434990 con 0x55855550a7c0 2024-09-13T17:19:21.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.690+0000 7f0437fff640 1 -- 172.21.15.87:0/1750329337 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f04440c33c0 con 0x55855550a7c0 2024-09-13T17:19:21.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.690+0000 7f0437fff640 1 -- 172.21.15.87:0/1750329337 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 32) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f044c00f3c0 con 0x55855550a7c0 2024-09-13T17:19:21.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.690+0000 7f0461a38740 10 client.17217 fetch_fsmap finished waiting for FSMap version 32 2024-09-13T17:19:21.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.690+0000 7f0461a38740 10 client.17217 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:19:21.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.690+0000 7f0461a38740 20 client.17217 populate_metadata read hostname 'smithi087' 2024-09-13T17:19:21.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.690+0000 7f0461a38740 1 --2- 172.21.15.87:0/1750329337 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55855557dc00 0x558555580020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.690+0000 7f0461a38740 4 client.17217 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-13T17:19:21.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.690+0000 7f0461a38740 1 -- 172.21.15.87:0/1750329337 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5585551c6eb0 con 0x55855557dc00 2024-09-13T17:19:21.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.690+0000 7f0457fff640 1 --2- 172.21.15.87:0/1750329337 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55855557dc00 0x558555580020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.691+0000 7f0457fff640 1 --2- 172.21.15.87:0/1750329337 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55855557dc00 0x558555580020 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a562712f2e7ca39 server_cookie=af3012093d22927d in_seq=0 out_seq=0 2024-09-13T17:19:21.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.691+0000 7f0437fff640 10 client.17217 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:21.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.692+0000 7f0437fff640 1 -- 172.21.15.87:0/1750329337 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x7f044409b080 con 0x55855557dc00 2024-09-13T17:19:21.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.692+0000 7f0437fff640 10 client.17217 handle_command_reply: tid=0 2024-09-13T17:19:21.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.692+0000 7f0461a38740 1 client.17217 shutdown 2024-09-13T17:19:21.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.692+0000 7f0461a38740 1 -- 172.21.15.87:0/1750329337 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55855550a7c0 msgr2=0x558555575c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:21.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.692+0000 7f0461a38740 1 --2- 172.21.15.87:0/1750329337 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55855550a7c0 0x558555575c30 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x558555528150 tx=0x7f044c00cf60 comp rx=0 tx=0).stop 2024-09-13T17:19:21.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.692+0000 7f0461a38740 1 -- 172.21.15.87:0/1750329337 shutdown_connections 2024-09-13T17:19:21.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.692+0000 7f0461a38740 1 --2- 172.21.15.87:0/1750329337 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55855557dc00 0x558555580020 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.692+0000 7f0461a38740 1 --2- 172.21.15.87:0/1750329337 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558555515980 0x55855551b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.692+0000 7f0461a38740 1 --2- 172.21.15.87:0/1750329337 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55855550b0e0 0x558555576170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.692+0000 7f0461a38740 1 --2- 172.21.15.87:0/1750329337 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55855550a7c0 0x558555575c30 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.692+0000 7f0461a38740 1 -- 172.21.15.87:0/1750329337 >> 172.21.15.87:0/1750329337 conn(0x558555506d50 msgr2=0x55855550c180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:21.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.692+0000 7f0437fff640 0 client.17217 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:21.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.692+0000 7f0461a38740 1 -- 172.21.15.87:0/1750329337 shutdown_connections 2024-09-13T17:19:21.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.692+0000 7f0461a38740 1 -- 172.21.15.87:0/1750329337 wait complete. 2024-09-13T17:19:21.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.692+0000 7f0461a38740 20 client.17217 trim_cache size 0 max 16384 2024-09-13T17:19:21.700 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:19:21.700 INFO:teuthology.orchestra.run.smithi087.stdout: "return_code": 0, 2024-09-13T17:19:21.700 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_tag": "b0c459b6-39cb-4524-99dc-1fe81fff586c", 2024-09-13T17:19:21.700 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": "asynchronous" 2024-09-13T17:19:21.700 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:19:21.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.693+0000 7f045ec44640 1 -- 172.21.15.87:0/3137527983 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f04480a1280 msgr2=0x7f04480a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:21.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.693+0000 7f045ec44640 1 --2- 172.21.15.87:0/3137527983 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f04480a1280 0x7f04480a3740 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f04500092f0 tx=0x7f0450014a70 comp rx=0 tx=0).stop 2024-09-13T17:19:21.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.693+0000 7f045ec44640 1 -- 172.21.15.87:0/3137527983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04581050a0 msgr2=0x7f0458072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:21.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.693+0000 7f045ec44640 1 --2- 172.21.15.87:0/3137527983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04581050a0 0x7f0458072cf0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f0444009900 tx=0x7f04440042f0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.693+0000 7f045ec44640 1 -- 172.21.15.87:0/3137527983 shutdown_connections 2024-09-13T17:19:21.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.693+0000 7f045ec44640 1 --2- 172.21.15.87:0/3137527983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0458073230 0x7f04581a4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.693+0000 7f045ec44640 1 --2- 172.21.15.87:0/3137527983 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f04480a1280 0x7f04480a3740 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.693+0000 7f045ec44640 1 --2- 172.21.15.87:0/3137527983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04581050a0 0x7f0458072cf0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.693+0000 7f045ec44640 1 --2- 172.21.15.87:0/3137527983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04580fff50 0x7f04580727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.693+0000 7f045ec44640 1 -- 172.21.15.87:0/3137527983 >> 172.21.15.87:0/3137527983 conn(0x7f04580fb9e0 msgr2=0x7f04580fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:21.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.693+0000 7f045ec44640 1 -- 172.21.15.87:0/3137527983 shutdown_connections 2024-09-13T17:19:21.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.693+0000 7f045ec44640 1 -- 172.21.15.87:0/3137527983 wait complete. 2024-09-13T17:19:21.706 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:19:21.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.805+0000 7fb44555e640 1 -- 172.21.15.87:0/3133511069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb440100f40 msgr2=0x7fb440101320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:21.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.805+0000 7fb44555e640 1 --2- 172.21.15.87:0/3133511069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb440100f40 0x7fb440101320 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fb430009ca0 tx=0x7fb43002a950 comp rx=0 tx=0).stop 2024-09-13T17:19:21.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.805+0000 7fb44555e640 1 -- 172.21.15.87:0/3133511069 shutdown_connections 2024-09-13T17:19:21.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.805+0000 7fb44555e640 1 --2- 172.21.15.87:0/3133511069 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb44010a310 0x7fb44010c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.805+0000 7fb44555e640 1 --2- 172.21.15.87:0/3133511069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb440101860 0x7fb440109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.805+0000 7fb44555e640 1 --2- 172.21.15.87:0/3133511069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb440100f40 0x7fb440101320 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.805+0000 7fb44555e640 1 -- 172.21.15.87:0/3133511069 >> 172.21.15.87:0/3133511069 conn(0x7fb440075c60 msgr2=0x7fb4400fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:21.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.806+0000 7fb44555e640 1 -- 172.21.15.87:0/3133511069 shutdown_connections 2024-09-13T17:19:21.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.806+0000 7fb44555e640 1 -- 172.21.15.87:0/3133511069 wait complete. 2024-09-13T17:19:21.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.806+0000 7fb44555e640 1 Processor -- start 2024-09-13T17:19:21.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.806+0000 7fb44555e640 1 -- start start 2024-09-13T17:19:21.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.806+0000 7fb44555e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb440100f40 0x7fb440196200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.806+0000 7fb44555e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb440101860 0x7fb440196740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.806+0000 7fb44555e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb44010a310 0x7fb44019ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.806+0000 7fb44555e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44019b130 con 0x7fb44010a310 2024-09-13T17:19:21.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.806+0000 7fb44555e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44019b2a0 con 0x7fb440101860 2024-09-13T17:19:21.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.806+0000 7fb44555e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44019b460 con 0x7fb440100f40 2024-09-13T17:19:21.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.807+0000 7fb43f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb44010a310 0x7fb44019ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.807+0000 7fb43f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb44010a310 0x7fb44019ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45070/0 (socket says 172.21.15.87:45070) 2024-09-13T17:19:21.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.807+0000 7fb43f7fe640 1 -- 172.21.15.87:0/3396866989 learned_addr learned my addr 172.21.15.87:0/3396866989 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:21.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.807+0000 7fb43effd640 1 --2- 172.21.15.87:0/3396866989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb440100f40 0x7fb440196200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.807+0000 7fb43e7fc640 1 --2- 172.21.15.87:0/3396866989 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb440101860 0x7fb440196740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.807+0000 7fb43f7fe640 1 -- 172.21.15.87:0/3396866989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb440100f40 msgr2=0x7fb440196200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:21.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.807+0000 7fb43f7fe640 1 --2- 172.21.15.87:0/3396866989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb440100f40 0x7fb440196200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.807+0000 7fb43f7fe640 1 -- 172.21.15.87:0/3396866989 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb440101860 msgr2=0x7fb440196740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:21.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.807+0000 7fb43f7fe640 1 --2- 172.21.15.87:0/3396866989 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb440101860 0x7fb440196740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.807+0000 7fb43f7fe640 1 -- 172.21.15.87:0/3396866989 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb430009900 con 0x7fb44010a310 2024-09-13T17:19:21.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.807+0000 7fb43f7fe640 1 --2- 172.21.15.87:0/3396866989 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb44010a310 0x7fb44019ab30 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fb43800e970 tx=0x7fb43800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:21.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.807+0000 7fb437fff640 1 -- 172.21.15.87:0/3396866989 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb438009670 con 0x7fb44010a310 2024-09-13T17:19:21.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.807+0000 7fb437fff640 1 -- 172.21.15.87:0/3396866989 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb4380054d0 con 0x7fb44010a310 2024-09-13T17:19:21.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.807+0000 7fb44555e640 1 -- 172.21.15.87:0/3396866989 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb44019b740 con 0x7fb44010a310 2024-09-13T17:19:21.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.807+0000 7fb437fff640 1 -- 172.21.15.87:0/3396866989 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb438004e60 con 0x7fb44010a310 2024-09-13T17:19:21.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.807+0000 7fb44555e640 1 -- 172.21.15.87:0/3396866989 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4401a2fc0 con 0x7fb44010a310 2024-09-13T17:19:21.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.809+0000 7fb437fff640 1 -- 172.21.15.87:0/3396866989 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fb438005020 con 0x7fb44010a310 2024-09-13T17:19:21.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.810+0000 7fb44827e740 1 Processor -- start 2024-09-13T17:19:21.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.810+0000 7fb44827e740 1 -- start start 2024-09-13T17:19:21.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.810+0000 7fb44827e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558b858e5e10 0x558b858e61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.810+0000 7fb437fff640 1 --2- 172.21.15.87:0/3396866989 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb42c0a1200 0x7fb42c0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.810+0000 7fb44827e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558b858e6730 0x558b858f0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.810+0000 7fb44827e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558b858f0fd0 0x558b858f33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.810+0000 7fb44827e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b85850f20 con 0x558b858e5e10 2024-09-13T17:19:21.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.810+0000 7fb44827e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b8584e6b0 con 0x558b858e6730 2024-09-13T17:19:21.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.810+0000 7fb44827e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b85849fa0 con 0x558b858f0fd0 2024-09-13T17:19:21.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.810+0000 7fb43e7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558b858e5e10 0x558b858e61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.810+0000 7fb43effd640 1 --2- 172.21.15.87:0/3396866989 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb42c0a1200 0x7fb42c0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.810+0000 7fb43e7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558b858e5e10 0x558b858e61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45084/0 (socket says 172.21.15.87:45084) 2024-09-13T17:19:21.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.810+0000 7fb43e7fc640 1 -- 172.21.15.87:0/1366777029 learned_addr learned my addr 172.21.15.87:0/1366777029 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:21.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.810+0000 7fb437fff640 1 -- 172.21.15.87:0/3396866989 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fb438014070 con 0x7fb44010a310 2024-09-13T17:19:21.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.811+0000 7fb43e7fc640 1 --2- 172.21.15.87:0/1366777029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558b858e6730 0x558b858f0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.811+0000 7fb43f7fe640 1 --2- 172.21.15.87:0/1366777029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558b858f0fd0 0x558b858f33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.811+0000 7fb43e7fc640 1 -- 172.21.15.87:0/1366777029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558b858f0fd0 msgr2=0x558b858f33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:21.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.811+0000 7fb43e7fc640 1 --2- 172.21.15.87:0/1366777029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558b858f0fd0 0x558b858f33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.811+0000 7fb43e7fc640 1 -- 172.21.15.87:0/1366777029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558b858e6730 msgr2=0x558b858f0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:21.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.811+0000 7fb43e7fc640 1 --2- 172.21.15.87:0/1366777029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558b858e6730 0x558b858f0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.811+0000 7fb43e7fc640 1 -- 172.21.15.87:0/1366777029 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b85804840 con 0x558b858e5e10 2024-09-13T17:19:21.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.811+0000 7fb43effd640 1 --2- 172.21.15.87:0/3396866989 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb42c0a1200 0x7fb42c0a36c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb43002af40 tx=0x7fb43003d040 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:21.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.811+0000 7fb43e7fc640 1 --2- 172.21.15.87:0/1366777029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558b858e5e10 0x558b858e61f0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fb428005bc0 tx=0x7fb428009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7712cc870a19f668 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:21.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.811+0000 7fb4357fa640 1 -- 172.21.15.87:0/1366777029 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb428004030 con 0x558b858e5e10 2024-09-13T17:19:21.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.811+0000 7fb4357fa640 1 -- 172.21.15.87:0/1366777029 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb4280035f0 con 0x558b858e5e10 2024-09-13T17:19:21.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.811+0000 7fb4357fa640 1 -- 172.21.15.87:0/1366777029 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42800f760 con 0x558b858e5e10 2024-09-13T17:19:21.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.812+0000 7fb44827e740 1 -- 172.21.15.87:0/1366777029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558b858e5e10 msgr2=0x558b858e61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:21.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.812+0000 7fb44827e740 1 --2- 172.21.15.87:0/1366777029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558b858e5e10 0x558b858e61f0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fb428005bc0 tx=0x7fb428009850 comp rx=0 tx=0).stop 2024-09-13T17:19:21.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.812+0000 7fb44827e740 1 -- 172.21.15.87:0/1366777029 shutdown_connections 2024-09-13T17:19:21.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.812+0000 7fb44827e740 1 --2- 172.21.15.87:0/1366777029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558b858f0fd0 0x558b858f33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.812+0000 7fb44827e740 1 --2- 172.21.15.87:0/1366777029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558b858e6730 0x558b858f0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.812+0000 7fb44827e740 1 --2- 172.21.15.87:0/1366777029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558b858e5e10 0x558b858e61f0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.812+0000 7fb44827e740 1 -- 172.21.15.87:0/1366777029 >> 172.21.15.87:0/1366777029 conn(0x558b858e2380 msgr2=0x558b858e2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:21.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.812+0000 7fb44827e740 1 -- 172.21.15.87:0/1366777029 shutdown_connections 2024-09-13T17:19:21.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.812+0000 7fb44827e740 1 -- 172.21.15.87:0/1366777029 wait complete. 2024-09-13T17:19:21.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.812+0000 7fb44827e740 1 -- start start 2024-09-13T17:19:21.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.812+0000 7fb44827e740 1 Processor -- start 2024-09-13T17:19:21.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.813+0000 7fb44827e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558b858e5e10 0x558b858f09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.813+0000 7fb44827e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558b858e6730 0x558b858edc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.813+0000 7fb44827e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558b858f0fd0 0x558b858ee230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.813+0000 7fb44827e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b857eb2a0 con 0x558b858e5e10 2024-09-13T17:19:21.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.813+0000 7fb44827e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b85522430 con 0x558b858f0fd0 2024-09-13T17:19:21.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.813+0000 7fb44827e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b857cd680 con 0x558b858e6730 2024-09-13T17:19:21.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.813+0000 7fb44827e740 10 client.0 _ll_register_callbacks cb 0x558b85843610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:21.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.813+0000 7fb43effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558b858e5e10 0x558b858f09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.813+0000 7fb43effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558b858e5e10 0x558b858f09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45096/0 (socket says 172.21.15.87:45096) 2024-09-13T17:19:21.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.813+0000 7fb43effd640 1 -- 172.21.15.87:0/165523784 learned_addr learned my addr 172.21.15.87:0/165523784 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:21.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.813+0000 7fb43e7fc640 1 --2- 172.21.15.87:0/165523784 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558b858e6730 0x558b858edc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.813+0000 7fb43effd640 1 -- 172.21.15.87:0/165523784 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558b858e6730 msgr2=0x558b858edc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:21.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.813+0000 7fb43effd640 1 --2- 172.21.15.87:0/165523784 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558b858e6730 0x558b858edc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.813+0000 7fb43effd640 1 -- 172.21.15.87:0/165523784 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558b858f0fd0 msgr2=0x558b858ee230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:21.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.813+0000 7fb43f7fe640 1 --2- 172.21.15.87:0/165523784 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558b858f0fd0 0x558b858ee230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.813+0000 7fb43effd640 1 --2- 172.21.15.87:0/165523784 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558b858f0fd0 0x558b858ee230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.813+0000 7fb43effd640 1 -- 172.21.15.87:0/165523784 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb428009d70 con 0x558b858e5e10 2024-09-13T17:19:21.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.813+0000 7fb43effd640 1 --2- 172.21.15.87:0/165523784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558b858e5e10 0x558b858f09a0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fb430035000 tx=0x7fb4300095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5711723f9882e4c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:21.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.813+0000 7fb4267fc640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:19:21.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.813+0000 7fb4267fc640 1 -- 172.21.15.87:0/165523784 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb430040040 con 0x558b858e5e10 2024-09-13T17:19:21.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.813+0000 7fb4267fc640 1 -- 172.21.15.87:0/165523784 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fb430030640 con 0x558b858e5e10 2024-09-13T17:19:21.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.813+0000 7fb44827e740 1 -- 172.21.15.87:0/165523784 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558b8553d4e0 con 0x558b858e5e10 2024-09-13T17:19:21.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.813+0000 7fb4267fc640 1 -- 172.21.15.87:0/165523784 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb430030800 con 0x558b858e5e10 2024-09-13T17:19:21.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.813+0000 7fb44827e740 10 client.17229 fetch_fsmap learned FSMap version 32 2024-09-13T17:19:21.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.813+0000 7fb44827e740 1 -- 172.21.15.87:0/165523784 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x558b85848620 con 0x558b858e5e10 2024-09-13T17:19:21.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.814+0000 7fb4267fc640 1 -- 172.21.15.87:0/165523784 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x558b8553d4e0 con 0x558b858e5e10 2024-09-13T17:19:21.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.814+0000 7fb4267fc640 1 -- 172.21.15.87:0/165523784 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 32) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fb430046430 con 0x558b858e5e10 2024-09-13T17:19:21.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.814+0000 7fb44827e740 10 client.17229 fetch_fsmap finished waiting for FSMap version 32 2024-09-13T17:19:21.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.814+0000 7fb44827e740 10 client.17229 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:19:21.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.814+0000 7fb44827e740 20 client.17229 populate_metadata read hostname 'smithi087' 2024-09-13T17:19:21.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.814+0000 7fb44827e740 1 --2- 172.21.15.87:0/165523784 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x558b85900e20 0x558b85903240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.814+0000 7fb44827e740 4 client.17229 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:19:21.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.814+0000 7fb44827e740 1 -- 172.21.15.87:0/165523784 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558b8554e7e0 con 0x558b85900e20 2024-09-13T17:19:21.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.814+0000 7fb43e7fc640 1 --2- 172.21.15.87:0/165523784 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x558b85900e20 0x558b85903240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.815+0000 7fb4267fc640 10 client.17229 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:21.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.815+0000 7fb43e7fc640 1 --2- 172.21.15.87:0/165523784 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x558b85900e20 0x558b85903240 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9383e4e022412b9b server_cookie=578a79d82a62627a in_seq=0 out_seq=0 2024-09-13T17:19:21.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.815+0000 7fb4267fc640 1 -- 172.21.15.87:0/165523784 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x558b8554e7e0 con 0x558b85900e20 2024-09-13T17:19:21.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.815+0000 7fb4267fc640 10 client.17229 handle_command_reply: tid=0 2024-09-13T17:19:21.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.815+0000 7fb44827e740 1 client.17229 shutdown 2024-09-13T17:19:21.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.815+0000 7fb44827e740 1 -- 172.21.15.87:0/165523784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558b858e5e10 msgr2=0x558b858f09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:21.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.815+0000 7fb44827e740 1 --2- 172.21.15.87:0/165523784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558b858e5e10 0x558b858f09a0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fb430035000 tx=0x7fb4300095c0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.815+0000 7fb44827e740 1 -- 172.21.15.87:0/165523784 shutdown_connections 2024-09-13T17:19:21.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.815+0000 7fb44827e740 1 --2- 172.21.15.87:0/165523784 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x558b85900e20 0x558b85903240 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.815+0000 7fb44827e740 1 --2- 172.21.15.87:0/165523784 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558b858f0fd0 0x558b858ee230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.815+0000 7fb44827e740 1 --2- 172.21.15.87:0/165523784 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558b858e6730 0x558b858edc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.815+0000 7fb44827e740 1 --2- 172.21.15.87:0/165523784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558b858e5e10 0x558b858f09a0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.815+0000 7fb4267fc640 0 client.17229 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:21.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.815+0000 7fb44827e740 1 -- 172.21.15.87:0/165523784 >> 172.21.15.87:0/165523784 conn(0x558b858e2380 msgr2=0x558b858e80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:21.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.815+0000 7fb44827e740 1 -- 172.21.15.87:0/165523784 shutdown_connections 2024-09-13T17:19:21.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.815+0000 7fb44827e740 1 -- 172.21.15.87:0/165523784 wait complete. 2024-09-13T17:19:21.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.816+0000 7fb44827e740 20 client.17229 trim_cache size 0 max 16384 2024-09-13T17:19:21.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.829+0000 7fb44827e740 1 Processor -- start 2024-09-13T17:19:21.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.829+0000 7fb44827e740 1 -- start start 2024-09-13T17:19:21.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.830+0000 7fb44827e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558b858e5e10 0x558b858f04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.830+0000 7fb44827e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558b858e6730 0x558b858ec4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.830+0000 7fb44827e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558b858f0fd0 0x558b858eca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.830+0000 7fb44827e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b8553d4e0 con 0x558b858f0fd0 2024-09-13T17:19:21.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.830+0000 7fb44827e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b858ff620 con 0x558b858e5e10 2024-09-13T17:19:21.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.830+0000 7fb44827e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b858fdad0 con 0x558b858e6730 2024-09-13T17:19:21.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.830+0000 7fb43f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558b858f0fd0 0x558b858eca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.830+0000 7fb43f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558b858f0fd0 0x558b858eca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45108/0 (socket says 172.21.15.87:45108) 2024-09-13T17:19:21.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.830+0000 7fb43f7fe640 1 -- 172.21.15.87:0/1350875538 learned_addr learned my addr 172.21.15.87:0/1350875538 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:21.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.830+0000 7fb43e7fc640 1 --2- 172.21.15.87:0/1350875538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558b858e6730 0x558b858ec4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.830+0000 7fb43effd640 1 --2- 172.21.15.87:0/1350875538 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558b858e5e10 0x558b858f04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.830+0000 7fb43f7fe640 1 -- 172.21.15.87:0/1350875538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558b858e6730 msgr2=0x558b858ec4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:21.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.830+0000 7fb43f7fe640 1 --2- 172.21.15.87:0/1350875538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558b858e6730 0x558b858ec4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.830+0000 7fb43f7fe640 1 -- 172.21.15.87:0/1350875538 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558b858e5e10 msgr2=0x558b858f04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:21.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.830+0000 7fb43f7fe640 1 --2- 172.21.15.87:0/1350875538 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558b858e5e10 0x558b858f04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.830+0000 7fb43f7fe640 1 -- 172.21.15.87:0/1350875538 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b857ea790 con 0x558b858f0fd0 2024-09-13T17:19:21.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.830+0000 7fb43effd640 1 --2- 172.21.15.87:0/1350875538 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558b858e5e10 0x558b858f04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:21.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.830+0000 7fb43f7fe640 1 --2- 172.21.15.87:0/1350875538 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558b858f0fd0 0x558b858eca30 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fb438096a70 tx=0x7fb4380963c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4dfdd1876dccd04 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:21.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.830+0000 7fb435ffb640 1 -- 172.21.15.87:0/1350875538 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb438099960 con 0x558b858f0fd0 2024-09-13T17:19:21.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.830+0000 7fb435ffb640 1 -- 172.21.15.87:0/1350875538 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb43809a700 con 0x558b858f0fd0 2024-09-13T17:19:21.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.830+0000 7fb435ffb640 1 -- 172.21.15.87:0/1350875538 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43809a990 con 0x558b858f0fd0 2024-09-13T17:19:21.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.831+0000 7fb44827e740 1 -- 172.21.15.87:0/1350875538 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558b858f0fd0 msgr2=0x558b858eca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:21.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.831+0000 7fb44827e740 1 --2- 172.21.15.87:0/1350875538 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558b858f0fd0 0x558b858eca30 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fb438096a70 tx=0x7fb4380963c0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.831+0000 7fb44827e740 1 -- 172.21.15.87:0/1350875538 shutdown_connections 2024-09-13T17:19:21.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.831+0000 7fb44827e740 1 --2- 172.21.15.87:0/1350875538 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558b858f0fd0 0x558b858eca30 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.831+0000 7fb44827e740 1 --2- 172.21.15.87:0/1350875538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558b858e6730 0x558b858ec4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.831+0000 7fb44827e740 1 --2- 172.21.15.87:0/1350875538 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558b858e5e10 0x558b858f04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.831+0000 7fb44827e740 1 -- 172.21.15.87:0/1350875538 >> 172.21.15.87:0/1350875538 conn(0x558b858e2380 msgr2=0x558b858e8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:21.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.831+0000 7fb44827e740 1 -- 172.21.15.87:0/1350875538 shutdown_connections 2024-09-13T17:19:21.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.831+0000 7fb44827e740 1 -- 172.21.15.87:0/1350875538 wait complete. 2024-09-13T17:19:21.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.831+0000 7fb44827e740 1 -- start start 2024-09-13T17:19:21.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.831+0000 7fb44827e740 1 Processor -- start 2024-09-13T17:19:21.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.832+0000 7fb44827e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558b858e5e10 0x558b858f7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.832+0000 7fb44827e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558b858e6730 0x558b858f42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.832+0000 7fb44827e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558b858f0fd0 0x558b858f4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.832+0000 7fb44827e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b858f4d70 con 0x558b858f0fd0 2024-09-13T17:19:21.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.832+0000 7fb44827e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b858f4ee0 con 0x558b858e5e10 2024-09-13T17:19:21.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.832+0000 7fb44827e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b858f50a0 con 0x558b858e6730 2024-09-13T17:19:21.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.832+0000 7fb44827e740 10 client.0 _ll_register_callbacks cb 0x7fb438005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:21.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.832+0000 7fb43f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558b858f0fd0 0x558b858f4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.832+0000 7fb43f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558b858f0fd0 0x558b858f4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45124/0 (socket says 172.21.15.87:45124) 2024-09-13T17:19:21.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.832+0000 7fb43f7fe640 1 -- 172.21.15.87:0/3011638272 learned_addr learned my addr 172.21.15.87:0/3011638272 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:21.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.832+0000 7fb43effd640 1 --2- 172.21.15.87:0/3011638272 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558b858e5e10 0x558b858f7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.832+0000 7fb43e7fc640 1 --2- 172.21.15.87:0/3011638272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558b858e6730 0x558b858f42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.832+0000 7fb43f7fe640 1 -- 172.21.15.87:0/3011638272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558b858e6730 msgr2=0x558b858f42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:21.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.832+0000 7fb43f7fe640 1 --2- 172.21.15.87:0/3011638272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558b858e6730 0x558b858f42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.832+0000 7fb43f7fe640 1 -- 172.21.15.87:0/3011638272 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558b858e5e10 msgr2=0x558b858f7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:21.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.832+0000 7fb43f7fe640 1 --2- 172.21.15.87:0/3011638272 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558b858e5e10 0x558b858f7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.832+0000 7fb43f7fe640 1 -- 172.21.15.87:0/3011638272 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4401a2fc0 con 0x558b858f0fd0 2024-09-13T17:19:21.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.832+0000 7fb43f7fe640 1 --2- 172.21.15.87:0/3011638272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558b858f0fd0 0x558b858f4830 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fb438099d00 tx=0x7fb438009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44fc616796cd6bc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:21.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.832+0000 7fb4267fc640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:19:21.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.832+0000 7fb4267fc640 1 -- 172.21.15.87:0/3011638272 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4380ca3c0 con 0x558b858f0fd0 2024-09-13T17:19:21.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.832+0000 7fb4267fc640 1 -- 172.21.15.87:0/3011638272 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fb43809de30 con 0x558b858f0fd0 2024-09-13T17:19:21.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.832+0000 7fb44827e740 1 -- 172.21.15.87:0/3011638272 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb4280035f0 con 0x558b858f0fd0 2024-09-13T17:19:21.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.832+0000 7fb4267fc640 1 -- 172.21.15.87:0/3011638272 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4380a2480 con 0x558b858f0fd0 2024-09-13T17:19:21.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.833+0000 7fb44827e740 10 client.17235 fetch_fsmap learned FSMap version 32 2024-09-13T17:19:21.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.833+0000 7fb44827e740 1 -- 172.21.15.87:0/3011638272 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x558b8580fea0 con 0x558b858f0fd0 2024-09-13T17:19:21.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.833+0000 7fb4267fc640 1 -- 172.21.15.87:0/3011638272 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb43807f080 con 0x558b858f0fd0 2024-09-13T17:19:21.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.833+0000 7fb4267fc640 1 -- 172.21.15.87:0/3011638272 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 32) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fb43801f060 con 0x558b858f0fd0 2024-09-13T17:19:21.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.833+0000 7fb44827e740 10 client.17235 fetch_fsmap finished waiting for FSMap version 32 2024-09-13T17:19:21.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.833+0000 7fb44827e740 10 client.17235 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:19:21.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.833+0000 7fb44827e740 20 client.17235 populate_metadata read hostname 'smithi087' 2024-09-13T17:19:21.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.833+0000 7fb44827e740 1 --2- 172.21.15.87:0/3011638272 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x558b8595c7e0 0x558b8595ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:21.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.833+0000 7fb44827e740 4 client.17235 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:19:21.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.833+0000 7fb44827e740 1 -- 172.21.15.87:0/3011638272 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558b855a1e30 con 0x558b8595c7e0 2024-09-13T17:19:21.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.833+0000 7fb43effd640 1 --2- 172.21.15.87:0/3011638272 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x558b8595c7e0 0x558b8595ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:21.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.834+0000 7fb4267fc640 10 client.17235 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:21.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.834+0000 7fb43effd640 1 --2- 172.21.15.87:0/3011638272 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x558b8595c7e0 0x558b8595ec00 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b8684c92ad797c3 server_cookie=4b9711c927c6533c in_seq=0 out_seq=0 2024-09-13T17:19:21.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.834+0000 7fb4267fc640 1 -- 172.21.15.87:0/3011638272 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x558b855a1e30 con 0x558b8595c7e0 2024-09-13T17:19:21.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.834+0000 7fb4267fc640 10 client.17235 handle_command_reply: tid=0 2024-09-13T17:19:21.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.834+0000 7fb44827e740 1 client.17235 shutdown 2024-09-13T17:19:21.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.834+0000 7fb44827e740 1 -- 172.21.15.87:0/3011638272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558b858f0fd0 msgr2=0x558b858f4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:21.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.834+0000 7fb44827e740 1 --2- 172.21.15.87:0/3011638272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558b858f0fd0 0x558b858f4830 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fb438099d00 tx=0x7fb438009f50 comp rx=0 tx=0).stop 2024-09-13T17:19:21.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.834+0000 7fb44827e740 1 -- 172.21.15.87:0/3011638272 shutdown_connections 2024-09-13T17:19:21.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.834+0000 7fb44827e740 1 --2- 172.21.15.87:0/3011638272 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x558b8595c7e0 0x558b8595ec00 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.834+0000 7fb44827e740 1 --2- 172.21.15.87:0/3011638272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558b858f0fd0 0x558b858f4830 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.834+0000 7fb44827e740 1 --2- 172.21.15.87:0/3011638272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558b858e6730 0x558b858f42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.834+0000 7fb4267fc640 0 client.17235 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:21.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.834+0000 7fb44827e740 1 --2- 172.21.15.87:0/3011638272 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558b858e5e10 0x558b858f7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.834+0000 7fb44827e740 1 -- 172.21.15.87:0/3011638272 >> 172.21.15.87:0/3011638272 conn(0x558b858e2380 msgr2=0x558b858ed4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:21.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.834+0000 7fb44827e740 1 -- 172.21.15.87:0/3011638272 shutdown_connections 2024-09-13T17:19:21.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.834+0000 7fb44827e740 1 -- 172.21.15.87:0/3011638272 wait complete. 2024-09-13T17:19:21.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.834+0000 7fb44827e740 20 client.17235 trim_cache size 0 max 16384 2024-09-13T17:19:21.842 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:19:21.842 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-13T17:19:21.842 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": { 2024-09-13T17:19:21.842 INFO:teuthology.orchestra.run.smithi087.stdout: "b0c459b6-39cb-4524-99dc-1fe81fff586c": { 2024-09-13T17:19:21.842 INFO:teuthology.orchestra.run.smithi087.stdout: "path": "/", 2024-09-13T17:19:21.842 INFO:teuthology.orchestra.run.smithi087.stdout: "tag": "b0c459b6-39cb-4524-99dc-1fe81fff586c", 2024-09-13T17:19:21.842 INFO:teuthology.orchestra.run.smithi087.stdout: "options": "recursive,force" 2024-09-13T17:19:21.842 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:19:21.842 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:19:21.843 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:19:21.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.834+0000 7fb44555e640 1 -- 172.21.15.87:0/3396866989 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb42c0a1200 msgr2=0x7fb42c0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:21.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.834+0000 7fb44555e640 1 --2- 172.21.15.87:0/3396866989 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb42c0a1200 0x7fb42c0a36c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb43002af40 tx=0x7fb43003d040 comp rx=0 tx=0).stop 2024-09-13T17:19:21.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.834+0000 7fb44555e640 1 -- 172.21.15.87:0/3396866989 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb44010a310 msgr2=0x7fb44019ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:21.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.834+0000 7fb44555e640 1 --2- 172.21.15.87:0/3396866989 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb44010a310 0x7fb44019ab30 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fb43800e970 tx=0x7fb43800ee30 comp rx=0 tx=0).stop 2024-09-13T17:19:21.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.834+0000 7fb44555e640 1 -- 172.21.15.87:0/3396866989 shutdown_connections 2024-09-13T17:19:21.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.834+0000 7fb44555e640 1 --2- 172.21.15.87:0/3396866989 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb42c0a1200 0x7fb42c0a36c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.834+0000 7fb44555e640 1 --2- 172.21.15.87:0/3396866989 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb44010a310 0x7fb44019ab30 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.834+0000 7fb44555e640 1 --2- 172.21.15.87:0/3396866989 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb440101860 0x7fb440196740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.835+0000 7fb44555e640 1 --2- 172.21.15.87:0/3396866989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb440100f40 0x7fb440196200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:21.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.835+0000 7fb44555e640 1 -- 172.21.15.87:0/3396866989 >> 172.21.15.87:0/3396866989 conn(0x7fb440075c60 msgr2=0x7fb4400fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:21.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.835+0000 7fb44555e640 1 -- 172.21.15.87:0/3396866989 shutdown_connections 2024-09-13T17:19:21.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:21.835+0000 7fb44555e640 1 -- 172.21.15.87:0/3396866989 wait complete. 2024-09-13T17:19:21.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:21 smithi149 ceph-mon[35496]: pgmap v169: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-13T17:19:21.845 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:21 smithi087 ceph-mon[30934]: pgmap v169: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-13T17:19:21.846 INFO:tasks.cephfs.filesystem:scrub status for tag:b0c459b6-39cb-4524-99dc-1fe81fff586c - {'path': '/', 'tag': 'b0c459b6-39cb-4524-99dc-1fe81fff586c', 'options': 'recursive,force'} 2024-09-13T17:19:21.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:21 smithi118 ceph-mon[34374]: pgmap v169: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-13T17:19:22.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:22 smithi149 ceph-mon[35496]: scrub queued for path: / 2024-09-13T17:19:22.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:22 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:19:22.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:22 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:19:22.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:22 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:19:22.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:22 smithi118 ceph-mon[34374]: scrub queued for path: / 2024-09-13T17:19:22.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:22 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:19:22.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:22 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:19:22.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:22 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:19:22.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:22 smithi087 ceph-mon[30934]: scrub queued for path: / 2024-09-13T17:19:22.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:22 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:19:22.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:22 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:19:22.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:22 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:19:23.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:23 smithi149 ceph-mon[35496]: pgmap v170: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-09-13T17:19:23.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:23 smithi118 ceph-mon[34374]: pgmap v170: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-09-13T17:19:23.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:23 smithi087 ceph-mon[30934]: pgmap v170: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-09-13T17:19:25.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:25 smithi118 ceph-mon[34374]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:19:25.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:25 smithi118 ceph-mon[34374]: scrub summary: idle 2024-09-13T17:19:25.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:25 smithi118 ceph-mon[34374]: pgmap v171: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2024-09-13T17:19:25.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:25 smithi087 ceph-mon[30934]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:19:25.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:25 smithi087 ceph-mon[30934]: scrub summary: idle 2024-09-13T17:19:25.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:25 smithi087 ceph-mon[30934]: pgmap v171: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2024-09-13T17:19:26.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:25 smithi149 ceph-mon[35496]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:19:26.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:25 smithi149 ceph-mon[35496]: scrub summary: idle 2024-09-13T17:19:26.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:25 smithi149 ceph-mon[35496]: pgmap v171: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2024-09-13T17:19:28.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:28 smithi118 ceph-mon[34374]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:19:28.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:28 smithi118 ceph-mon[34374]: pgmap v172: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-09-13T17:19:28.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:28 smithi087 ceph-mon[30934]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:19:28.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:28 smithi087 ceph-mon[30934]: pgmap v172: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-09-13T17:19:28.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:28 smithi149 ceph-mon[35496]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:19:28.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:28 smithi149 ceph-mon[35496]: pgmap v172: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-09-13T17:19:29.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:29 smithi149 ceph-mon[35496]: pgmap v173: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-09-13T17:19:29.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:29 smithi118 ceph-mon[34374]: pgmap v173: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-09-13T17:19:29.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:29 smithi087 ceph-mon[30934]: pgmap v173: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-09-13T17:19:31.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:31 smithi149 ceph-mon[35496]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:19:31.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:31 smithi149 ceph-mon[35496]: pgmap v174: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2024-09-13T17:19:31.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:31 smithi118 ceph-mon[34374]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:19:31.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:31 smithi118 ceph-mon[34374]: pgmap v174: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2024-09-13T17:19:31.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:31 smithi087 ceph-mon[30934]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:19:31.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:31 smithi087 ceph-mon[30934]: pgmap v174: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2024-09-13T17:19:33.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:33 smithi149 ceph-mon[35496]: pgmap v175: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:19:33.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:33 smithi118 ceph-mon[34374]: pgmap v175: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:19:33.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:33 smithi087 ceph-mon[30934]: pgmap v175: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:19:35.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:35 smithi149 ceph-mon[35496]: pgmap v176: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:19:35.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:35 smithi118 ceph-mon[34374]: pgmap v176: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:19:35.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:35 smithi087 ceph-mon[30934]: pgmap v176: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:19:37.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:37 smithi149 ceph-mon[35496]: pgmap v177: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:19:37.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:37 smithi118 ceph-mon[34374]: pgmap v177: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:19:37.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:37 smithi087 ceph-mon[30934]: pgmap v177: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:19:39.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:39 smithi149 ceph-mon[35496]: pgmap v178: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:19:39.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:39 smithi118 ceph-mon[34374]: pgmap v178: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:19:39.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:39 smithi087 ceph-mon[30934]: pgmap v178: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:19:41.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:41 smithi149 ceph-mon[35496]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:19:41.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:41 smithi149 ceph-mon[35496]: pgmap v179: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:19:41.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:41 smithi118 ceph-mon[34374]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:19:41.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:41 smithi118 ceph-mon[34374]: pgmap v179: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:19:41.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:41 smithi087 ceph-mon[30934]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-09-13T17:19:41.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:41 smithi087 ceph-mon[30934]: pgmap v179: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:19:43.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:43 smithi149 ceph-mon[35496]: pgmap v180: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:19:43.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:43 smithi118 ceph-mon[34374]: pgmap v180: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:19:43.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:43 smithi087 ceph-mon[30934]: pgmap v180: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:19:45.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:45 smithi149 ceph-mon[35496]: pgmap v181: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:19:45.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:45 smithi118 ceph-mon[34374]: pgmap v181: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:19:45.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:45 smithi087 ceph-mon[30934]: pgmap v181: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:19:47.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:47 smithi149 ceph-mon[35496]: pgmap v182: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:19:47.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:47 smithi118 ceph-mon[34374]: pgmap v182: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:19:47.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:47 smithi087 ceph-mon[30934]: pgmap v182: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:19:49.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:49 smithi149 ceph-mon[35496]: pgmap v183: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:19:49.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:49 smithi118 ceph-mon[34374]: pgmap v183: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:19:49.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:49 smithi087 ceph-mon[30934]: pgmap v183: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:19:51.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:51 smithi149 ceph-mon[35496]: pgmap v184: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:19:51.847 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:19:51.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:51 smithi118 ceph-mon[34374]: pgmap v184: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:19:51.873 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:51 smithi087 ceph-mon[30934]: pgmap v184: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:19:51.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.959+0000 7f3176ec9640 1 -- 172.21.15.87:0/3458600545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31700ff810 msgr2=0x7f3170103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:51.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.959+0000 7f3176ec9640 1 --2- 172.21.15.87:0/3458600545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31700ff810 0x7f3170103850 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f315c009930 tx=0x7f315c02a420 comp rx=0 tx=0).stop 2024-09-13T17:19:51.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.959+0000 7f3176ec9640 1 -- 172.21.15.87:0/3458600545 shutdown_connections 2024-09-13T17:19:51.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.959+0000 7f3176ec9640 1 --2- 172.21.15.87:0/3458600545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3170103fb0 0x7f317010bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:51.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.959+0000 7f3176ec9640 1 --2- 172.21.15.87:0/3458600545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31700ff810 0x7f3170103850 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:51.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.959+0000 7f3176ec9640 1 --2- 172.21.15.87:0/3458600545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31700fee60 0x7f31700ff240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:51.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.959+0000 7f3176ec9640 1 -- 172.21.15.87:0/3458600545 >> 172.21.15.87:0/3458600545 conn(0x7f3170075c60 msgr2=0x7f31700fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:51.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.959+0000 7f3176ec9640 1 -- 172.21.15.87:0/3458600545 shutdown_connections 2024-09-13T17:19:51.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.959+0000 7f3176ec9640 1 -- 172.21.15.87:0/3458600545 wait complete. 2024-09-13T17:19:51.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.959+0000 7f3176ec9640 1 Processor -- start 2024-09-13T17:19:51.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.960+0000 7f3176ec9640 1 -- start start 2024-09-13T17:19:51.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.960+0000 7f3176ec9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31700fee60 0x7f31701962f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:51.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.960+0000 7f3176ec9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3170103fb0 0x7f3170196830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:51.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.960+0000 7f3176ec9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f317019ac20 0x7f317019b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:51.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.960+0000 7f3176ec9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317019b610 con 0x7f3170103fb0 2024-09-13T17:19:51.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.960+0000 7f3176ec9640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317019b780 con 0x7f31700fee60 2024-09-13T17:19:51.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.960+0000 7f3176ec9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317019b8f0 con 0x7f317019ac20 2024-09-13T17:19:51.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.960+0000 7f316ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3170103fb0 0x7f3170196830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:51.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.960+0000 7f316ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3170103fb0 0x7f3170196830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48266/0 (socket says 172.21.15.87:48266) 2024-09-13T17:19:51.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.960+0000 7f316ffff640 1 -- 172.21.15.87:0/1224426468 learned_addr learned my addr 172.21.15.87:0/1224426468 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:51.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.960+0000 7f3174c65640 1 --2- 172.21.15.87:0/1224426468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31700fee60 0x7f31701962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:51.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.960+0000 7f316ffff640 1 -- 172.21.15.87:0/1224426468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f317019ac20 msgr2=0x7f317019b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:51.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.960+0000 7f316ffff640 1 --2- 172.21.15.87:0/1224426468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f317019ac20 0x7f317019b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:51.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.960+0000 7f316ffff640 1 -- 172.21.15.87:0/1224426468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31700fee60 msgr2=0x7f31701962f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:51.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.960+0000 7f316ffff640 1 --2- 172.21.15.87:0/1224426468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31700fee60 0x7f31701962f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:51.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.960+0000 7f316ffff640 1 -- 172.21.15.87:0/1224426468 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315c009560 con 0x7f3170103fb0 2024-09-13T17:19:51.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.960+0000 7f3174c65640 1 --2- 172.21.15.87:0/1224426468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31700fee60 0x7f31701962f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:51.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.960+0000 7f316ffff640 1 --2- 172.21.15.87:0/1224426468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3170103fb0 0x7f3170196830 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f315c009900 tx=0x7f315c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:51.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.960+0000 7f316dffb640 1 -- 172.21.15.87:0/1224426468 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c003a00 con 0x7f3170103fb0 2024-09-13T17:19:51.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.960+0000 7f316dffb640 1 -- 172.21.15.87:0/1224426468 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f315c0044e0 con 0x7f3170103fb0 2024-09-13T17:19:51.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.960+0000 7f3176ec9640 1 -- 172.21.15.87:0/1224426468 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31701a2ed0 con 0x7f3170103fb0 2024-09-13T17:19:51.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.961+0000 7f316dffb640 1 -- 172.21.15.87:0/1224426468 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c03a3c0 con 0x7f3170103fb0 2024-09-13T17:19:51.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.961+0000 7f3176ec9640 1 -- 172.21.15.87:0/1224426468 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31701a3290 con 0x7f3170103fb0 2024-09-13T17:19:51.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.963+0000 7f316dffb640 1 -- 172.21.15.87:0/1224426468 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f315c03b460 con 0x7f3170103fb0 2024-09-13T17:19:51.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.963+0000 7f3179bea740 1 Processor -- start 2024-09-13T17:19:51.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.963+0000 7f3179bea740 1 -- start start 2024-09-13T17:19:51.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.963+0000 7f3179bea740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad0fd9de10 0x55ad0fd9e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:51.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.963+0000 7f3179bea740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad0fd9e730 0x55ad0fda8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:51.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.963+0000 7f3179bea740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad0fda8fd0 0x55ad0fdab3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:51.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.963+0000 7f3179bea740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad0fd08f20 con 0x55ad0fda8fd0 2024-09-13T17:19:51.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.963+0000 7f3179bea740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad0fd066b0 con 0x55ad0fd9de10 2024-09-13T17:19:51.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.963+0000 7f3179bea740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad0fd01fa0 con 0x55ad0fd9e730 2024-09-13T17:19:51.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.964+0000 7f316ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad0fda8fd0 0x55ad0fdab3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:51.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.964+0000 7f316ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad0fda8fd0 0x55ad0fdab3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48268/0 (socket says 172.21.15.87:48268) 2024-09-13T17:19:51.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.964+0000 7f316ffff640 1 -- 172.21.15.87:0/1838369931 learned_addr learned my addr 172.21.15.87:0/1838369931 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:51.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.964+0000 7f3174c65640 1 --2- 172.21.15.87:0/1838369931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad0fd9e730 0x55ad0fda8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:51.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.964+0000 7f316dffb640 1 --2- 172.21.15.87:0/1224426468 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f31600a1200 0x7f31600a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:51.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.964+0000 7f3175466640 1 --2- 172.21.15.87:0/1838369931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad0fd9de10 0x55ad0fd9e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:51.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.964+0000 7f3175466640 1 --2- 172.21.15.87:0/1224426468 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f31600a1200 0x7f31600a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:51.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.964+0000 7f316dffb640 1 -- 172.21.15.87:0/1224426468 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f315c0ee120 con 0x7f3170103fb0 2024-09-13T17:19:51.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.964+0000 7f316ffff640 1 -- 172.21.15.87:0/1838369931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad0fd9e730 msgr2=0x55ad0fda8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:51.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.964+0000 7f316ffff640 1 --2- 172.21.15.87:0/1838369931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad0fd9e730 0x55ad0fda8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:51.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.964+0000 7f316ffff640 1 -- 172.21.15.87:0/1838369931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad0fd9de10 msgr2=0x55ad0fd9e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:51.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.964+0000 7f316ffff640 1 --2- 172.21.15.87:0/1838369931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad0fd9de10 0x55ad0fd9e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:51.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.964+0000 7f316ffff640 1 -- 172.21.15.87:0/1838369931 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad0fcbc840 con 0x55ad0fda8fd0 2024-09-13T17:19:51.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.964+0000 7f316ffff640 1 --2- 172.21.15.87:0/1838369931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad0fda8fd0 0x55ad0fdab3c0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f315c0eb520 tx=0x7f315c0b76c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=decaa615199477bc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:51.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.964+0000 7f315affd640 1 -- 172.21.15.87:0/1838369931 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c0ba7e0 con 0x55ad0fda8fd0 2024-09-13T17:19:51.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.964+0000 7f3175466640 1 --2- 172.21.15.87:0/1224426468 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f31600a1200 0x7f31600a36c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3168005fd0 tx=0x7f3168004a40 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:51.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.964+0000 7f315affd640 1 -- 172.21.15.87:0/1838369931 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f315c03b710 con 0x55ad0fda8fd0 2024-09-13T17:19:51.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.964+0000 7f315affd640 1 -- 172.21.15.87:0/1838369931 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c003d80 con 0x55ad0fda8fd0 2024-09-13T17:19:51.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.965+0000 7f3179bea740 1 -- 172.21.15.87:0/1838369931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad0fda8fd0 msgr2=0x55ad0fdab3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:51.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.965+0000 7f3179bea740 1 --2- 172.21.15.87:0/1838369931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad0fda8fd0 0x55ad0fdab3c0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f315c0eb520 tx=0x7f315c0b76c0 comp rx=0 tx=0).stop 2024-09-13T17:19:51.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.965+0000 7f3179bea740 1 -- 172.21.15.87:0/1838369931 shutdown_connections 2024-09-13T17:19:51.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.965+0000 7f3179bea740 1 --2- 172.21.15.87:0/1838369931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad0fda8fd0 0x55ad0fdab3c0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:51.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.965+0000 7f3179bea740 1 --2- 172.21.15.87:0/1838369931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad0fd9e730 0x55ad0fda8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:51.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.965+0000 7f3179bea740 1 --2- 172.21.15.87:0/1838369931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad0fd9de10 0x55ad0fd9e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:51.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.965+0000 7f3179bea740 1 -- 172.21.15.87:0/1838369931 >> 172.21.15.87:0/1838369931 conn(0x55ad0fd9a380 msgr2=0x55ad0fd9a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:51.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.965+0000 7f3179bea740 1 -- 172.21.15.87:0/1838369931 shutdown_connections 2024-09-13T17:19:51.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.965+0000 7f3179bea740 1 -- 172.21.15.87:0/1838369931 wait complete. 2024-09-13T17:19:51.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.965+0000 7f3179bea740 1 -- start start 2024-09-13T17:19:51.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.966+0000 7f3179bea740 1 Processor -- start 2024-09-13T17:19:51.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.966+0000 7f3179bea740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad0fd9de10 0x55ad0fda88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:51.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.966+0000 7f3179bea740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad0fd9e730 0x55ad0fda5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:51.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.966+0000 7f3179bea740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad0fda8fd0 0x55ad0fda60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:51.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.966+0000 7f3179bea740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad0fca32a0 con 0x55ad0fd9e730 2024-09-13T17:19:51.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.966+0000 7f3179bea740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad0f9da430 con 0x55ad0fd9de10 2024-09-13T17:19:51.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.966+0000 7f3179bea740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad0fc85680 con 0x55ad0fda8fd0 2024-09-13T17:19:51.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.966+0000 7f3179bea740 10 client.0 _ll_register_callbacks cb 0x55ad0fcfb610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:51.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.966+0000 7f316ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad0fd9e730 0x55ad0fda5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:51.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.966+0000 7f316ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad0fd9e730 0x55ad0fda5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48274/0 (socket says 172.21.15.87:48274) 2024-09-13T17:19:51.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.966+0000 7f316ffff640 1 -- 172.21.15.87:0/3478989097 learned_addr learned my addr 172.21.15.87:0/3478989097 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:51.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.966+0000 7f3174c65640 1 --2- 172.21.15.87:0/3478989097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad0fd9de10 0x55ad0fda88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:51.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.966+0000 7f3175466640 1 --2- 172.21.15.87:0/3478989097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad0fda8fd0 0x55ad0fda60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:51.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.966+0000 7f316ffff640 1 -- 172.21.15.87:0/3478989097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad0fda8fd0 msgr2=0x55ad0fda60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:51.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.966+0000 7f316ffff640 1 --2- 172.21.15.87:0/3478989097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad0fda8fd0 0x55ad0fda60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:51.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.966+0000 7f316ffff640 1 -- 172.21.15.87:0/3478989097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad0fd9de10 msgr2=0x55ad0fda88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:51.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.966+0000 7f316ffff640 1 --2- 172.21.15.87:0/3478989097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad0fd9de10 0x55ad0fda88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:51.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.966+0000 7f316ffff640 1 -- 172.21.15.87:0/3478989097 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31701a3290 con 0x55ad0fd9e730 2024-09-13T17:19:51.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.966+0000 7f316ffff640 1 --2- 172.21.15.87:0/3478989097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad0fd9e730 0x55ad0fda5b60 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f315c0b7380 tx=0x7f315c0b7730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b2b9856298eaa07 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:51.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.966+0000 7f314ffff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:19:51.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.967+0000 7f314ffff640 1 -- 172.21.15.87:0/3478989097 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c0becb0 con 0x55ad0fd9e730 2024-09-13T17:19:51.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.967+0000 7f314ffff640 1 -- 172.21.15.87:0/3478989097 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f315c0bb580 con 0x55ad0fd9e730 2024-09-13T17:19:51.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.967+0000 7f3179bea740 1 -- 172.21.15.87:0/3478989097 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ad0f9f54e0 con 0x55ad0fd9e730 2024-09-13T17:19:51.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.967+0000 7f314ffff640 1 -- 172.21.15.87:0/3478989097 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f315c0eb740 con 0x55ad0fd9e730 2024-09-13T17:19:51.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.967+0000 7f3179bea740 10 client.17247 fetch_fsmap learned FSMap version 36 2024-09-13T17:19:51.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.967+0000 7f3179bea740 1 -- 172.21.15.87:0/3478989097 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55ad0fd00620 con 0x55ad0fd9e730 2024-09-13T17:19:51.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.967+0000 7f314ffff640 1 -- 172.21.15.87:0/3478989097 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55ad0f9f54e0 con 0x55ad0fd9e730 2024-09-13T17:19:51.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.967+0000 7f314ffff640 1 -- 172.21.15.87:0/3478989097 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f315c08e040 con 0x55ad0fd9e730 2024-09-13T17:19:51.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.967+0000 7f3179bea740 10 client.17247 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:19:51.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.967+0000 7f3179bea740 10 client.17247 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:19:51.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.967+0000 7f3179bea740 20 client.17247 populate_metadata read hostname 'smithi087' 2024-09-13T17:19:51.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.967+0000 7f3179bea740 1 --2- 172.21.15.87:0/3478989097 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55ad0fdb8500 0x55ad0fdba8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:51.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.967+0000 7f3179bea740 4 client.17247 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:19:51.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.967+0000 7f3179bea740 1 -- 172.21.15.87:0/3478989097 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ad0fa067e0 con 0x55ad0fdb8500 2024-09-13T17:19:51.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.967+0000 7f3174c65640 1 --2- 172.21.15.87:0/3478989097 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55ad0fdb8500 0x55ad0fdba8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:51.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.968+0000 7f3174c65640 1 --2- 172.21.15.87:0/3478989097 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55ad0fdb8500 0x55ad0fdba8f0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e27fd5d4e37cec4 server_cookie=dc8fc3b6d2b8aaa1 in_seq=0 out_seq=0 2024-09-13T17:19:51.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.968+0000 7f314ffff640 10 client.17247 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:51.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.968+0000 7f314ffff640 1 -- 172.21.15.87:0/3478989097 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55ad0fa067e0 con 0x55ad0fdb8500 2024-09-13T17:19:51.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.968+0000 7f314ffff640 10 client.17247 handle_command_reply: tid=0 2024-09-13T17:19:51.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.968+0000 7f3179bea740 1 client.17247 shutdown 2024-09-13T17:19:51.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.969+0000 7f3179bea740 1 -- 172.21.15.87:0/3478989097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad0fd9e730 msgr2=0x55ad0fda5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:51.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.969+0000 7f3179bea740 1 --2- 172.21.15.87:0/3478989097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad0fd9e730 0x55ad0fda5b60 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f315c0b7380 tx=0x7f315c0b7730 comp rx=0 tx=0).stop 2024-09-13T17:19:51.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.969+0000 7f3179bea740 1 -- 172.21.15.87:0/3478989097 shutdown_connections 2024-09-13T17:19:51.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.969+0000 7f3179bea740 1 --2- 172.21.15.87:0/3478989097 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55ad0fdb8500 0x55ad0fdba8f0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:51.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.969+0000 7f3179bea740 1 --2- 172.21.15.87:0/3478989097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad0fda8fd0 0x55ad0fda60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:51.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.969+0000 7f3179bea740 1 --2- 172.21.15.87:0/3478989097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad0fd9e730 0x55ad0fda5b60 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:51.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.969+0000 7f314ffff640 0 client.17247 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:51.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.969+0000 7f3179bea740 1 --2- 172.21.15.87:0/3478989097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad0fd9de10 0x55ad0fda88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:51.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.969+0000 7f3179bea740 1 -- 172.21.15.87:0/3478989097 >> 172.21.15.87:0/3478989097 conn(0x55ad0fd9a380 msgr2=0x55ad0fda0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:51.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.969+0000 7f3179bea740 1 -- 172.21.15.87:0/3478989097 shutdown_connections 2024-09-13T17:19:51.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.969+0000 7f3179bea740 1 -- 172.21.15.87:0/3478989097 wait complete. 2024-09-13T17:19:51.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.969+0000 7f3179bea740 20 client.17247 trim_cache size 0 max 16384 2024-09-13T17:19:51.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.983+0000 7f3179bea740 1 Processor -- start 2024-09-13T17:19:51.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.983+0000 7f3179bea740 1 -- start start 2024-09-13T17:19:51.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.983+0000 7f3179bea740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad0fd9de10 0x55ad0fd99d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:51.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.983+0000 7f3179bea740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad0fd9e730 0x55ad0fdafe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:51.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.983+0000 7f3179bea740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad0fda8fd0 0x55ad0fda0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:51.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.983+0000 7f3179bea740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad0fdb0340 con 0x55ad0fda8fd0 2024-09-13T17:19:51.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.983+0000 7f3179bea740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad0fdb5670 con 0x55ad0fd9e730 2024-09-13T17:19:51.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.983+0000 7f3179bea740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad0fd9db90 con 0x55ad0fd9de10 2024-09-13T17:19:51.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.983+0000 7f3175466640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad0fda8fd0 0x55ad0fda0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:51.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.983+0000 7f3175466640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad0fda8fd0 0x55ad0fda0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48288/0 (socket says 172.21.15.87:48288) 2024-09-13T17:19:51.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.983+0000 7f3175466640 1 -- 172.21.15.87:0/2662953085 learned_addr learned my addr 172.21.15.87:0/2662953085 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:51.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.983+0000 7f316ffff640 1 --2- 172.21.15.87:0/2662953085 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad0fd9e730 0x55ad0fdafe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:51.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.983+0000 7f3175466640 1 -- 172.21.15.87:0/2662953085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad0fd9de10 msgr2=0x55ad0fd99d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:51.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.983+0000 7f3175466640 1 --2- 172.21.15.87:0/2662953085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad0fd9de10 0x55ad0fd99d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:51.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.983+0000 7f3175466640 1 -- 172.21.15.87:0/2662953085 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad0fd9e730 msgr2=0x55ad0fdafe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:51.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.983+0000 7f3175466640 1 --2- 172.21.15.87:0/2662953085 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad0fd9e730 0x55ad0fdafe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:51.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.983+0000 7f3175466640 1 -- 172.21.15.87:0/2662953085 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad0fca2790 con 0x55ad0fda8fd0 2024-09-13T17:19:51.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.984+0000 7f3175466640 1 --2- 172.21.15.87:0/2662953085 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad0fda8fd0 0x55ad0fda0e10 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f3168012710 tx=0x7f316800c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba736405718c8688 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:51.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.984+0000 7f315b7fe640 1 -- 172.21.15.87:0/2662953085 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3168004b20 con 0x55ad0fda8fd0 2024-09-13T17:19:51.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.984+0000 7f315b7fe640 1 -- 172.21.15.87:0/2662953085 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3168004c80 con 0x55ad0fda8fd0 2024-09-13T17:19:51.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.984+0000 7f315b7fe640 1 -- 172.21.15.87:0/2662953085 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31680053a0 con 0x55ad0fda8fd0 2024-09-13T17:19:51.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.984+0000 7f3179bea740 1 -- 172.21.15.87:0/2662953085 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad0fda8fd0 msgr2=0x55ad0fda0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:51.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.984+0000 7f3179bea740 1 --2- 172.21.15.87:0/2662953085 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad0fda8fd0 0x55ad0fda0e10 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f3168012710 tx=0x7f316800c000 comp rx=0 tx=0).stop 2024-09-13T17:19:51.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.984+0000 7f3179bea740 1 -- 172.21.15.87:0/2662953085 shutdown_connections 2024-09-13T17:19:51.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.984+0000 7f3179bea740 1 --2- 172.21.15.87:0/2662953085 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad0fda8fd0 0x55ad0fda0e10 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:51.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.984+0000 7f3179bea740 1 --2- 172.21.15.87:0/2662953085 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad0fd9e730 0x55ad0fdafe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:51.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.984+0000 7f3179bea740 1 --2- 172.21.15.87:0/2662953085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad0fd9de10 0x55ad0fd99d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:51.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.984+0000 7f3179bea740 1 -- 172.21.15.87:0/2662953085 >> 172.21.15.87:0/2662953085 conn(0x55ad0fd9a380 msgr2=0x55ad0fdbf1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:51.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.984+0000 7f3179bea740 1 -- 172.21.15.87:0/2662953085 shutdown_connections 2024-09-13T17:19:51.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.984+0000 7f3179bea740 1 -- 172.21.15.87:0/2662953085 wait complete. 2024-09-13T17:19:51.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.985+0000 7f3179bea740 1 -- start start 2024-09-13T17:19:51.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.985+0000 7f3179bea740 1 Processor -- start 2024-09-13T17:19:51.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.985+0000 7f3179bea740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad0fd9de10 0x55ad0fe0b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:51.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.985+0000 7f3179bea740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad0fd9e730 0x55ad0fe0b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:51.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.985+0000 7f3179bea740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad0fda8fd0 0x55ad0fe06700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:51.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.985+0000 7f3179bea740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad0fe06cc0 con 0x55ad0fda8fd0 2024-09-13T17:19:51.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.985+0000 7f3179bea740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad0fe06e30 con 0x55ad0fd9de10 2024-09-13T17:19:51.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.985+0000 7f3179bea740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad0fe06ff0 con 0x55ad0fd9e730 2024-09-13T17:19:51.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.985+0000 7f3179bea740 10 client.0 _ll_register_callbacks cb 0x7f3170069b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:51.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.985+0000 7f3175466640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad0fda8fd0 0x55ad0fe06700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:51.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.985+0000 7f3175466640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad0fda8fd0 0x55ad0fe06700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48298/0 (socket says 172.21.15.87:48298) 2024-09-13T17:19:51.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.985+0000 7f3175466640 1 -- 172.21.15.87:0/3984358986 learned_addr learned my addr 172.21.15.87:0/3984358986 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:51.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.985+0000 7f3174c65640 1 --2- 172.21.15.87:0/3984358986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad0fd9de10 0x55ad0fe0b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:51.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.986+0000 7f3175466640 1 -- 172.21.15.87:0/3984358986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad0fd9e730 msgr2=0x55ad0fe0b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:51.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.986+0000 7f3175466640 1 --2- 172.21.15.87:0/3984358986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad0fd9e730 0x55ad0fe0b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:51.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.986+0000 7f3175466640 1 -- 172.21.15.87:0/3984358986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad0fd9de10 msgr2=0x55ad0fe0b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:51.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.986+0000 7f3175466640 1 --2- 172.21.15.87:0/3984358986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad0fd9de10 0x55ad0fe0b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:51.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.986+0000 7f3175466640 1 -- 172.21.15.87:0/3984358986 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3168012450 con 0x55ad0fda8fd0 2024-09-13T17:19:51.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.986+0000 7f3175466640 1 --2- 172.21.15.87:0/3984358986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad0fda8fd0 0x55ad0fe06700 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f3168013010 tx=0x7f316800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab1f01ac54d47e15 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:51.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.986+0000 7f314ffff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:19:51.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.986+0000 7f314ffff640 1 -- 172.21.15.87:0/3984358986 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316800fb90 con 0x55ad0fda8fd0 2024-09-13T17:19:51.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.986+0000 7f314ffff640 1 -- 172.21.15.87:0/3984358986 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f316801b040 con 0x55ad0fda8fd0 2024-09-13T17:19:51.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.986+0000 7f3179bea740 1 -- 172.21.15.87:0/3984358986 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f315c03b710 con 0x55ad0fda8fd0 2024-09-13T17:19:51.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.986+0000 7f314ffff640 1 -- 172.21.15.87:0/3984358986 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f316800fcf0 con 0x55ad0fda8fd0 2024-09-13T17:19:51.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.986+0000 7f3179bea740 10 client.17253 fetch_fsmap learned FSMap version 36 2024-09-13T17:19:51.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.986+0000 7f3179bea740 1 -- 172.21.15.87:0/3984358986 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55ad0fcc7ea0 con 0x55ad0fda8fd0 2024-09-13T17:19:51.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.986+0000 7f314ffff640 1 -- 172.21.15.87:0/3984358986 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f315c03b710 con 0x55ad0fda8fd0 2024-09-13T17:19:51.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.986+0000 7f314ffff640 1 -- 172.21.15.87:0/3984358986 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f31680215d0 con 0x55ad0fda8fd0 2024-09-13T17:19:51.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.986+0000 7f3179bea740 10 client.17253 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:19:51.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.986+0000 7f3179bea740 10 client.17253 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:19:51.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.986+0000 7f3179bea740 20 client.17253 populate_metadata read hostname 'smithi087' 2024-09-13T17:19:51.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.986+0000 7f3179bea740 1 --2- 172.21.15.87:0/3984358986 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55ad0fe14060 0x55ad0fe16480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:51.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.986+0000 7f3179bea740 4 client.17253 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:19:51.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.986+0000 7f3179bea740 1 -- 172.21.15.87:0/3984358986 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ad0fa59e30 con 0x55ad0fe14060 2024-09-13T17:19:51.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.987+0000 7f3174c65640 1 --2- 172.21.15.87:0/3984358986 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55ad0fe14060 0x55ad0fe16480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:51.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.987+0000 7f3174c65640 1 --2- 172.21.15.87:0/3984358986 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55ad0fe14060 0x55ad0fe16480 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=256058941b2e006b server_cookie=df6b8c841e01e177 in_seq=0 out_seq=0 2024-09-13T17:19:51.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.987+0000 7f314ffff640 10 client.17253 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:51.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.987+0000 7f314ffff640 1 -- 172.21.15.87:0/3984358986 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55ad0fa59e30 con 0x55ad0fe14060 2024-09-13T17:19:51.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.987+0000 7f314ffff640 10 client.17253 handle_command_reply: tid=0 2024-09-13T17:19:51.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.987+0000 7f3179bea740 1 client.17253 shutdown 2024-09-13T17:19:52.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.988+0000 7f3179bea740 1 -- 172.21.15.87:0/3984358986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad0fda8fd0 msgr2=0x55ad0fe06700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:52.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.988+0000 7f3179bea740 1 --2- 172.21.15.87:0/3984358986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad0fda8fd0 0x55ad0fe06700 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f3168013010 tx=0x7f316800f790 comp rx=0 tx=0).stop 2024-09-13T17:19:52.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.988+0000 7f3179bea740 1 -- 172.21.15.87:0/3984358986 shutdown_connections 2024-09-13T17:19:52.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.988+0000 7f3179bea740 1 --2- 172.21.15.87:0/3984358986 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55ad0fe14060 0x55ad0fe16480 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.988+0000 7f3179bea740 1 --2- 172.21.15.87:0/3984358986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad0fda8fd0 0x55ad0fe06700 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.988+0000 7f3179bea740 1 --2- 172.21.15.87:0/3984358986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad0fd9e730 0x55ad0fe0b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.988+0000 7f3179bea740 1 --2- 172.21.15.87:0/3984358986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad0fd9de10 0x55ad0fe0b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.988+0000 7f314ffff640 0 client.17253 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:52.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.988+0000 7f3179bea740 1 -- 172.21.15.87:0/3984358986 >> 172.21.15.87:0/3984358986 conn(0x55ad0fd9a380 msgr2=0x55ad0fda0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:52.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.988+0000 7f3179bea740 1 -- 172.21.15.87:0/3984358986 shutdown_connections 2024-09-13T17:19:52.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.988+0000 7f3179bea740 1 -- 172.21.15.87:0/3984358986 wait complete. 2024-09-13T17:19:52.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.988+0000 7f3179bea740 20 client.17253 trim_cache size 0 max 16384 2024-09-13T17:19:52.001 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:19:52.001 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "no active scrubs running", 2024-09-13T17:19:52.001 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": {} 2024-09-13T17:19:52.001 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:19:52.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.988+0000 7f3176ec9640 1 -- 172.21.15.87:0/1224426468 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f31600a1200 msgr2=0x7f31600a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:52.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.988+0000 7f3176ec9640 1 --2- 172.21.15.87:0/1224426468 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f31600a1200 0x7f31600a36c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3168005fd0 tx=0x7f3168004a40 comp rx=0 tx=0).stop 2024-09-13T17:19:52.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.988+0000 7f3176ec9640 1 -- 172.21.15.87:0/1224426468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3170103fb0 msgr2=0x7f3170196830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:52.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.988+0000 7f3176ec9640 1 --2- 172.21.15.87:0/1224426468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3170103fb0 0x7f3170196830 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f315c009900 tx=0x7f315c0042f0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.988+0000 7f3176ec9640 1 -- 172.21.15.87:0/1224426468 shutdown_connections 2024-09-13T17:19:52.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.988+0000 7f3176ec9640 1 --2- 172.21.15.87:0/1224426468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f317019ac20 0x7f317019b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.988+0000 7f3176ec9640 1 --2- 172.21.15.87:0/1224426468 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f31600a1200 0x7f31600a36c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.988+0000 7f3176ec9640 1 --2- 172.21.15.87:0/1224426468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3170103fb0 0x7f3170196830 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.988+0000 7f3176ec9640 1 --2- 172.21.15.87:0/1224426468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31700fee60 0x7f31701962f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.988+0000 7f3176ec9640 1 -- 172.21.15.87:0/1224426468 >> 172.21.15.87:0/1224426468 conn(0x7f3170075c60 msgr2=0x7f3170102320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:52.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.989+0000 7f3176ec9640 1 -- 172.21.15.87:0/1224426468 shutdown_connections 2024-09-13T17:19:52.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:51.989+0000 7f3176ec9640 1 -- 172.21.15.87:0/1224426468 wait complete. 2024-09-13T17:19:52.003 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T17:19:52.003 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:19:52.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.141+0000 7f4a11795640 1 -- 172.21.15.87:0/2922026268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a0c0ff8d0 msgr2=0x7f4a0c103910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:52.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.141+0000 7f4a11795640 1 --2- 172.21.15.87:0/2922026268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a0c0ff8d0 0x7f4a0c103910 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f49f4009930 tx=0x7f49f402a420 comp rx=0 tx=0).stop 2024-09-13T17:19:52.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.141+0000 7f4a11795640 1 -- 172.21.15.87:0/2922026268 shutdown_connections 2024-09-13T17:19:52.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.141+0000 7f4a11795640 1 --2- 172.21.15.87:0/2922026268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a0c104070 0x7f4a0c10bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.141+0000 7f4a11795640 1 --2- 172.21.15.87:0/2922026268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a0c0ff8d0 0x7f4a0c103910 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.141+0000 7f4a11795640 1 --2- 172.21.15.87:0/2922026268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a0c0fef20 0x7f4a0c0ff300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.141+0000 7f4a11795640 1 -- 172.21.15.87:0/2922026268 >> 172.21.15.87:0/2922026268 conn(0x7f4a0c0fa970 msgr2=0x7f4a0c0fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:52.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.141+0000 7f4a11795640 1 -- 172.21.15.87:0/2922026268 shutdown_connections 2024-09-13T17:19:52.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.141+0000 7f4a11795640 1 -- 172.21.15.87:0/2922026268 wait complete. 2024-09-13T17:19:52.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.142+0000 7f4a11795640 1 Processor -- start 2024-09-13T17:19:52.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.142+0000 7f4a11795640 1 -- start start 2024-09-13T17:19:52.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.142+0000 7f4a11795640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a0c0fef20 0x7f4a0c197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.142+0000 7f4a11795640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a0c104070 0x7f4a0c197770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.142+0000 7f4a11795640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a0c197d50 0x7f4a0c1a22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.142+0000 7f4a11795640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0c1a2a20 con 0x7f4a0c104070 2024-09-13T17:19:52.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.142+0000 7f4a11795640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0c1a2b90 con 0x7f4a0c197d50 2024-09-13T17:19:52.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.142+0000 7f4a11795640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0c1a2d50 con 0x7f4a0c0fef20 2024-09-13T17:19:52.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.142+0000 7f4a03fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a0c104070 0x7f4a0c197770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.142+0000 7f4a03fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a0c104070 0x7f4a0c197770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48322/0 (socket says 172.21.15.87:48322) 2024-09-13T17:19:52.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.142+0000 7f4a03fff640 1 -- 172.21.15.87:0/258725466 learned_addr learned my addr 172.21.15.87:0/258725466 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:52.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.142+0000 7f4a0affd640 1 --2- 172.21.15.87:0/258725466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a0c0fef20 0x7f4a0c197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.142+0000 7f4a0b7fe640 1 --2- 172.21.15.87:0/258725466 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a0c197d50 0x7f4a0c1a22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.142+0000 7f4a03fff640 1 -- 172.21.15.87:0/258725466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a0c0fef20 msgr2=0x7f4a0c197230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:52.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.142+0000 7f4a03fff640 1 --2- 172.21.15.87:0/258725466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a0c0fef20 0x7f4a0c197230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.142+0000 7f4a03fff640 1 -- 172.21.15.87:0/258725466 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a0c197d50 msgr2=0x7f4a0c1a22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:52.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.142+0000 7f4a03fff640 1 --2- 172.21.15.87:0/258725466 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a0c197d50 0x7f4a0c1a22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.142+0000 7f4a03fff640 1 -- 172.21.15.87:0/258725466 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f4009560 con 0x7f4a0c104070 2024-09-13T17:19:52.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.142+0000 7f4a0affd640 1 --2- 172.21.15.87:0/258725466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a0c0fef20 0x7f4a0c197230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:52.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.143+0000 7f4a03fff640 1 --2- 172.21.15.87:0/258725466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a0c104070 0x7f4a0c197770 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f49f4005760 tx=0x7f49f4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:52.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.143+0000 7f4a08ff9640 1 -- 172.21.15.87:0/258725466 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f4004520 con 0x7f4a0c104070 2024-09-13T17:19:52.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.143+0000 7f4a08ff9640 1 -- 172.21.15.87:0/258725466 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f49f4031e40 con 0x7f4a0c104070 2024-09-13T17:19:52.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.143+0000 7f4a11795640 1 -- 172.21.15.87:0/258725466 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a0c1a2fd0 con 0x7f4a0c104070 2024-09-13T17:19:52.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.143+0000 7f4a08ff9640 1 -- 172.21.15.87:0/258725466 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f40325b0 con 0x7f4a0c104070 2024-09-13T17:19:52.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.143+0000 7f4a11795640 1 -- 172.21.15.87:0/258725466 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a0c1a33f0 con 0x7f4a0c104070 2024-09-13T17:19:52.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.144+0000 7f4a11795640 1 -- 172.21.15.87:0/258725466 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a0c1003f0 con 0x7f4a0c104070 2024-09-13T17:19:52.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.145+0000 7f4a08ff9640 1 -- 172.21.15.87:0/258725466 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f49f4032770 con 0x7f4a0c104070 2024-09-13T17:19:52.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.145+0000 7f4a08ff9640 1 --2- 172.21.15.87:0/258725466 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f49f80a1200 0x7f49f80a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.146+0000 7f4a0affd640 1 --2- 172.21.15.87:0/258725466 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f49f80a1200 0x7f49f80a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.146+0000 7f4a08ff9640 1 -- 172.21.15.87:0/258725466 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f49f40ed650 con 0x7f4a0c104070 2024-09-13T17:19:52.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.146+0000 7f4a0affd640 1 --2- 172.21.15.87:0/258725466 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f49f80a1200 0x7f49f80a36c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f49fc005fd0 tx=0x7f49fc005ea0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:52.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.149+0000 7f4a08ff9640 1 -- 172.21.15.87:0/258725466 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f49f40b66f0 con 0x7f4a0c104070 2024-09-13T17:19:52.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.345+0000 7f4a11795640 1 -- 172.21.15.87:0/258725466 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a0c107220 con 0x7f4a0c104070 2024-09-13T17:19:52.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.345+0000 7f4a08ff9640 1 -- 172.21.15.87:0/258725466 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+10877 (secure 0 0 0) 0x7f49f40b9d10 con 0x7f4a0c104070 2024-09-13T17:19:52.347 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:19:52.347 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/3674545180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":3674545180},{"type":"v1","addr":"172.21.15.87:6841","nonce":3674545180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:11:23.313609+0000","modified":"2024-09-13T17:19:40.570296+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24484,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6839/3052680456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3052680456},{"type":"v1","addr":"172.21.15.118:6839","nonce":3052680456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:19:52.347 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 36 2024-09-13T17:19:52.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.347+0000 7f4a11795640 1 -- 172.21.15.87:0/258725466 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f49f80a1200 msgr2=0x7f49f80a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:52.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.347+0000 7f4a11795640 1 --2- 172.21.15.87:0/258725466 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f49f80a1200 0x7f49f80a36c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f49fc005fd0 tx=0x7f49fc005ea0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.347+0000 7f4a11795640 1 -- 172.21.15.87:0/258725466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a0c104070 msgr2=0x7f4a0c197770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:52.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.347+0000 7f4a11795640 1 --2- 172.21.15.87:0/258725466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a0c104070 0x7f4a0c197770 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f49f4005760 tx=0x7f49f4004270 comp rx=0 tx=0).stop 2024-09-13T17:19:52.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.347+0000 7f4a11795640 1 -- 172.21.15.87:0/258725466 shutdown_connections 2024-09-13T17:19:52.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.347+0000 7f4a11795640 1 --2- 172.21.15.87:0/258725466 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4a0c197d50 0x7f4a0c1a22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.347+0000 7f4a11795640 1 --2- 172.21.15.87:0/258725466 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f49f80a1200 0x7f49f80a36c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.347+0000 7f4a11795640 1 --2- 172.21.15.87:0/258725466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a0c104070 0x7f4a0c197770 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.347+0000 7f4a11795640 1 --2- 172.21.15.87:0/258725466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a0c0fef20 0x7f4a0c197230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.347+0000 7f4a11795640 1 -- 172.21.15.87:0/258725466 >> 172.21.15.87:0/258725466 conn(0x7f4a0c0fa970 msgr2=0x7f4a0c0fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:52.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.347+0000 7f4a11795640 1 -- 172.21.15.87:0/258725466 shutdown_connections 2024-09-13T17:19:52.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.348+0000 7f4a11795640 1 -- 172.21.15.87:0/258725466 wait complete. 2024-09-13T17:19:52.360 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-09-13T17:19:52.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.459+0000 7fd5127e2640 1 -- 172.21.15.87:0/1540361196 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd50c101870 msgr2=0x7fd50c109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:52.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.459+0000 7fd5127e2640 1 --2- 172.21.15.87:0/1540361196 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd50c101870 0x7fd50c109d50 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4009900 tx=0x7fd4f402a480 comp rx=0 tx=0).stop 2024-09-13T17:19:52.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.459+0000 7fd5127e2640 1 -- 172.21.15.87:0/1540361196 shutdown_connections 2024-09-13T17:19:52.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.459+0000 7fd5127e2640 1 --2- 172.21.15.87:0/1540361196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd50c10a2e0 0x7fd50c10c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.459+0000 7fd5127e2640 1 --2- 172.21.15.87:0/1540361196 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd50c101870 0x7fd50c109d50 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.459+0000 7fd5127e2640 1 --2- 172.21.15.87:0/1540361196 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd50c100f50 0x7fd50c101330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.459+0000 7fd5127e2640 1 -- 172.21.15.87:0/1540361196 >> 172.21.15.87:0/1540361196 conn(0x7fd50c0fa8c0 msgr2=0x7fd50c0fcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:52.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.460+0000 7fd5127e2640 1 -- 172.21.15.87:0/1540361196 shutdown_connections 2024-09-13T17:19:52.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.460+0000 7fd5127e2640 1 -- 172.21.15.87:0/1540361196 wait complete. 2024-09-13T17:19:52.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.460+0000 7fd5127e2640 1 Processor -- start 2024-09-13T17:19:52.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.460+0000 7fd5127e2640 1 -- start start 2024-09-13T17:19:52.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.460+0000 7fd5127e2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd50c100f50 0x7fd50c1962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.460+0000 7fd5127e2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd50c101870 0x7fd50c196810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.460+0000 7fd5127e2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd50c10a2e0 0x7fd50c19ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.460+0000 7fd5127e2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c19b200 con 0x7fd50c101870 2024-09-13T17:19:52.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.460+0000 7fd5127e2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c19b370 con 0x7fd50c10a2e0 2024-09-13T17:19:52.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.460+0000 7fd5127e2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c19b530 con 0x7fd50c100f50 2024-09-13T17:19:52.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.460+0000 7fd503fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd50c101870 0x7fd50c196810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.460+0000 7fd503fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd50c101870 0x7fd50c196810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48342/0 (socket says 172.21.15.87:48342) 2024-09-13T17:19:52.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.460+0000 7fd503fff640 1 -- 172.21.15.87:0/1183443037 learned_addr learned my addr 172.21.15.87:0/1183443037 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:52.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.461+0000 7fd50bfff640 1 --2- 172.21.15.87:0/1183443037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd50c100f50 0x7fd50c1962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.461+0000 7fd503fff640 1 -- 172.21.15.87:0/1183443037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd50c100f50 msgr2=0x7fd50c1962d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:52.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.461+0000 7fd503fff640 1 --2- 172.21.15.87:0/1183443037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd50c100f50 0x7fd50c1962d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.461+0000 7fd503fff640 1 -- 172.21.15.87:0/1183443037 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd50c10a2e0 msgr2=0x7fd50c19ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:52.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.461+0000 7fd503fff640 1 --2- 172.21.15.87:0/1183443037 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd50c10a2e0 0x7fd50c19ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.461+0000 7fd503fff640 1 -- 172.21.15.87:0/1183443037 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f4009560 con 0x7fd50c101870 2024-09-13T17:19:52.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.461+0000 7fd50bfff640 1 --2- 172.21.15.87:0/1183443037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd50c100f50 0x7fd50c1962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:52.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.461+0000 7fd503fff640 1 --2- 172.21.15.87:0/1183443037 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd50c101870 0x7fd50c196810 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fd4f402aa70 tx=0x7fd4f40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:52.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.461+0000 7fd509ffb640 1 -- 172.21.15.87:0/1183443037 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f4003a00 con 0x7fd50c101870 2024-09-13T17:19:52.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.461+0000 7fd509ffb640 1 -- 172.21.15.87:0/1183443037 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd4f40044e0 con 0x7fd50c101870 2024-09-13T17:19:52.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.461+0000 7fd509ffb640 1 -- 172.21.15.87:0/1183443037 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f403be30 con 0x7fd50c101870 2024-09-13T17:19:52.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.461+0000 7fd5127e2640 1 -- 172.21.15.87:0/1183443037 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd50c19b7b0 con 0x7fd50c101870 2024-09-13T17:19:52.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.461+0000 7fd5127e2640 1 -- 172.21.15.87:0/1183443037 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd50c1a2eb0 con 0x7fd50c101870 2024-09-13T17:19:52.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.463+0000 7fd509ffb640 1 -- 172.21.15.87:0/1183443037 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fd4f4003cf0 con 0x7fd50c101870 2024-09-13T17:19:52.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.464+0000 7fd5155dd740 1 Processor -- start 2024-09-13T17:19:52.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.464+0000 7fd5155dd740 1 -- start start 2024-09-13T17:19:52.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.464+0000 7fd5155dd740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef89a22790 0x55ef89a22b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.464+0000 7fd5155dd740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef89a230b0 0x55ef89a2d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.464+0000 7fd5155dd740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef89a2d950 0x55ef89a2fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.464+0000 7fd5155dd740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef8998ccc0 con 0x55ef89a230b0 2024-09-13T17:19:52.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.464+0000 7fd5155dd740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef8998a450 con 0x55ef89a2d950 2024-09-13T17:19:52.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.464+0000 7fd5155dd740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef89985d40 con 0x55ef89a22790 2024-09-13T17:19:52.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.464+0000 7fd50bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef89a230b0 0x55ef89a2d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.464+0000 7fd50bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef89a230b0 0x55ef89a2d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48348/0 (socket says 172.21.15.87:48348) 2024-09-13T17:19:52.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.464+0000 7fd50bfff640 1 -- 172.21.15.87:0/3311056976 learned_addr learned my addr 172.21.15.87:0/3311056976 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:52.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.464+0000 7fd509ffb640 1 --2- 172.21.15.87:0/1183443037 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd4f80a1200 0x7fd4f80a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.464+0000 7fd503fff640 1 --2- 172.21.15.87:0/3311056976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef89a2d950 0x55ef89a2fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.464+0000 7fd510d7f640 1 --2- 172.21.15.87:0/3311056976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef89a22790 0x55ef89a22b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.464+0000 7fd510d7f640 1 --2- 172.21.15.87:0/1183443037 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd4f80a1200 0x7fd4f80a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.464+0000 7fd50bfff640 1 -- 172.21.15.87:0/3311056976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef89a22790 msgr2=0x55ef89a22b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:52.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.464+0000 7fd50bfff640 1 --2- 172.21.15.87:0/3311056976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef89a22790 0x55ef89a22b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.464+0000 7fd50bfff640 1 -- 172.21.15.87:0/3311056976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef89a2d950 msgr2=0x55ef89a2fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:52.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.464+0000 7fd509ffb640 1 -- 172.21.15.87:0/1183443037 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fd4f40ede40 con 0x7fd50c101870 2024-09-13T17:19:52.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.464+0000 7fd50bfff640 1 --2- 172.21.15.87:0/3311056976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef89a2d950 0x55ef89a2fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.464+0000 7fd50bfff640 1 -- 172.21.15.87:0/3311056976 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef8994d620 con 0x55ef89a230b0 2024-09-13T17:19:52.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.464+0000 7fd503fff640 1 --2- 172.21.15.87:0/3311056976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef89a2d950 0x55ef89a2fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:52.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.465+0000 7fd50bfff640 1 --2- 172.21.15.87:0/3311056976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef89a230b0 0x55ef89a2d410 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc009c50 tx=0x7fd4fc00e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8585dc04984a3b4e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:52.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.465+0000 7fd510d7f640 1 --2- 172.21.15.87:0/1183443037 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd4f80a1200 0x7fd4f80a36c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd504005c40 tx=0x7fd504009200 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:52.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.465+0000 7fd5027fc640 1 -- 172.21.15.87:0/3311056976 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc017b70 con 0x55ef89a230b0 2024-09-13T17:19:52.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.465+0000 7fd5027fc640 1 -- 172.21.15.87:0/3311056976 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd4fc017cd0 con 0x55ef89a230b0 2024-09-13T17:19:52.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.465+0000 7fd5027fc640 1 -- 172.21.15.87:0/3311056976 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc01e3a0 con 0x55ef89a230b0 2024-09-13T17:19:52.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.465+0000 7fd5155dd740 1 -- 172.21.15.87:0/3311056976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef89a230b0 msgr2=0x55ef89a2d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:52.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.465+0000 7fd5155dd740 1 --2- 172.21.15.87:0/3311056976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef89a230b0 0x55ef89a2d410 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc009c50 tx=0x7fd4fc00e6c0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.465+0000 7fd5155dd740 1 -- 172.21.15.87:0/3311056976 shutdown_connections 2024-09-13T17:19:52.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.465+0000 7fd5155dd740 1 --2- 172.21.15.87:0/3311056976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef89a2d950 0x55ef89a2fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.465+0000 7fd5155dd740 1 --2- 172.21.15.87:0/3311056976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef89a230b0 0x55ef89a2d410 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.465+0000 7fd5155dd740 1 --2- 172.21.15.87:0/3311056976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef89a22790 0x55ef89a22b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.465+0000 7fd5155dd740 1 -- 172.21.15.87:0/3311056976 >> 172.21.15.87:0/3311056976 conn(0x55ef89a1ed00 msgr2=0x55ef89a1f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:52.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.465+0000 7fd5155dd740 1 -- 172.21.15.87:0/3311056976 shutdown_connections 2024-09-13T17:19:52.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.465+0000 7fd5155dd740 1 -- 172.21.15.87:0/3311056976 wait complete. 2024-09-13T17:19:52.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.466+0000 7fd5155dd740 1 -- start start 2024-09-13T17:19:52.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.466+0000 7fd5155dd740 1 Processor -- start 2024-09-13T17:19:52.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.466+0000 7fd5155dd740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef89a22790 0x55ef89a2ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.466+0000 7fd5155dd740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef89a230b0 0x55ef89a2d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.466+0000 7fd5155dd740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef89a2d950 0x55ef89a2a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.466+0000 7fd5155dd740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef89944180 con 0x55ef89a230b0 2024-09-13T17:19:52.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.466+0000 7fd5155dd740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef8965e430 con 0x55ef89a22790 2024-09-13T17:19:52.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.466+0000 7fd5155dd740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef899095e0 con 0x55ef89a2d950 2024-09-13T17:19:52.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.466+0000 7fd5155dd740 10 client.0 _ll_register_callbacks cb 0x55ef89975aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:52.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.466+0000 7fd503fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef89a230b0 0x55ef89a2d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.466+0000 7fd503fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef89a230b0 0x55ef89a2d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48364/0 (socket says 172.21.15.87:48364) 2024-09-13T17:19:52.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.466+0000 7fd503fff640 1 -- 172.21.15.87:0/3485281069 learned_addr learned my addr 172.21.15.87:0/3485281069 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:52.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.466+0000 7fd510d7f640 1 --2- 172.21.15.87:0/3485281069 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef89a2d950 0x55ef89a2a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.466+0000 7fd50bfff640 1 --2- 172.21.15.87:0/3485281069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef89a22790 0x55ef89a2ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.467+0000 7fd503fff640 1 -- 172.21.15.87:0/3485281069 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef89a2d950 msgr2=0x55ef89a2a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:52.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.467+0000 7fd503fff640 1 --2- 172.21.15.87:0/3485281069 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef89a2d950 0x55ef89a2a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.467+0000 7fd503fff640 1 -- 172.21.15.87:0/3485281069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef89a22790 msgr2=0x55ef89a2ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:52.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.467+0000 7fd503fff640 1 --2- 172.21.15.87:0/3485281069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef89a22790 0x55ef89a2ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.467+0000 7fd503fff640 1 -- 172.21.15.87:0/3485281069 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4fc009880 con 0x55ef89a230b0 2024-09-13T17:19:52.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.467+0000 7fd510d7f640 1 --2- 172.21.15.87:0/3485281069 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef89a2d950 0x55ef89a2a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:52.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.467+0000 7fd50bfff640 1 --2- 172.21.15.87:0/3485281069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef89a22790 0x55ef89a2ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:52.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.467+0000 7fd503fff640 1 --2- 172.21.15.87:0/3485281069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef89a230b0 0x55ef89a2d3a0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fd4f40b70a0 tx=0x7fd4f4089e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=682dfa28244e7aab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:52.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.467+0000 7fd4eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:19:52.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.467+0000 7fd4eb7fe640 1 -- 172.21.15.87:0/3485281069 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f40bb2a0 con 0x55ef89a230b0 2024-09-13T17:19:52.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.467+0000 7fd4eb7fe640 1 -- 172.21.15.87:0/3485281069 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fd4f40da040 con 0x55ef89a230b0 2024-09-13T17:19:52.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.467+0000 7fd5155dd740 1 -- 172.21.15.87:0/3485281069 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ef899afb80 con 0x55ef89a230b0 2024-09-13T17:19:52.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.467+0000 7fd4eb7fe640 1 -- 172.21.15.87:0/3485281069 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd4f40baba0 con 0x55ef89a230b0 2024-09-13T17:19:52.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.467+0000 7fd5155dd740 10 client.17271 fetch_fsmap learned FSMap version 36 2024-09-13T17:19:52.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.467+0000 7fd5155dd740 1 -- 172.21.15.87:0/3485281069 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55ef899843c0 con 0x55ef89a230b0 2024-09-13T17:19:52.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.467+0000 7fd4eb7fe640 1 -- 172.21.15.87:0/3485281069 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55ef899afb80 con 0x55ef89a230b0 2024-09-13T17:19:52.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.467+0000 7fd4eb7fe640 1 -- 172.21.15.87:0/3485281069 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd4f40ef070 con 0x55ef89a230b0 2024-09-13T17:19:52.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.467+0000 7fd5155dd740 10 client.17271 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:19:52.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.467+0000 7fd5155dd740 10 client.17271 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:19:52.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.467+0000 7fd5155dd740 20 client.17271 populate_metadata read hostname 'smithi087' 2024-09-13T17:19:52.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.467+0000 7fd5155dd740 1 --2- 172.21.15.87:0/3485281069 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55ef89a3cdf0 0x55ef89a3f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.467+0000 7fd5155dd740 4 client.17271 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:19:52.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.467+0000 7fd5155dd740 1 -- 172.21.15.87:0/3485281069 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ef899781f0 con 0x55ef89a3cdf0 2024-09-13T17:19:52.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.468+0000 7fd50bfff640 1 --2- 172.21.15.87:0/3485281069 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55ef89a3cdf0 0x55ef89a3f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.468+0000 7fd4eb7fe640 10 client.17271 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:19:52.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.468+0000 7fd50bfff640 1 --2- 172.21.15.87:0/3485281069 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55ef89a3cdf0 0x55ef89a3f1e0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ce8e17ce6b47407 server_cookie=85345303479cdc0b in_seq=0 out_seq=0 2024-09-13T17:19:52.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.469+0000 7fd4eb7fe640 1 -- 172.21.15.87:0/3485281069 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55ef899781f0 con 0x55ef89a3cdf0 2024-09-13T17:19:52.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.469+0000 7fd4eb7fe640 10 client.17271 handle_command_reply: tid=0 2024-09-13T17:19:52.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.469+0000 7fd5155dd740 1 client.17271 shutdown 2024-09-13T17:19:52.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.469+0000 7fd5155dd740 1 -- 172.21.15.87:0/3485281069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef89a230b0 msgr2=0x55ef89a2d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:52.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.469+0000 7fd5155dd740 1 --2- 172.21.15.87:0/3485281069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef89a230b0 0x55ef89a2d3a0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fd4f40b70a0 tx=0x7fd4f4089e60 comp rx=0 tx=0).stop 2024-09-13T17:19:52.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.469+0000 7fd5155dd740 1 -- 172.21.15.87:0/3485281069 shutdown_connections 2024-09-13T17:19:52.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.469+0000 7fd5155dd740 1 --2- 172.21.15.87:0/3485281069 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55ef89a3cdf0 0x55ef89a3f1e0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.469+0000 7fd5155dd740 1 --2- 172.21.15.87:0/3485281069 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef89a2d950 0x55ef89a2a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.469+0000 7fd4eb7fe640 0 client.17271 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:19:52.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.469+0000 7fd5155dd740 1 --2- 172.21.15.87:0/3485281069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef89a230b0 0x55ef89a2d3a0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.469+0000 7fd5155dd740 1 --2- 172.21.15.87:0/3485281069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef89a22790 0x55ef89a2ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.469+0000 7fd5155dd740 1 -- 172.21.15.87:0/3485281069 >> 172.21.15.87:0/3485281069 conn(0x55ef89a1ed00 msgr2=0x55ef89a24a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:52.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.469+0000 7fd5155dd740 1 -- 172.21.15.87:0/3485281069 shutdown_connections 2024-09-13T17:19:52.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.469+0000 7fd5155dd740 1 -- 172.21.15.87:0/3485281069 wait complete. 2024-09-13T17:19:52.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.469+0000 7fd5155dd740 20 client.17271 trim_cache size 0 max 16384 2024-09-13T17:19:52.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.480+0000 7fd5155dd740 1 Processor -- start 2024-09-13T17:19:52.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.480+0000 7fd5155dd740 1 -- start start 2024-09-13T17:19:52.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.480+0000 7fd5155dd740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef89a22790 0x55ef89a34620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.480+0000 7fd5155dd740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef89a230b0 0x55ef89a34b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.480+0000 7fd5155dd740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef89a2d950 0x55ef89a25200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.480+0000 7fd5155dd740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef89a2b640 con 0x55ef89a230b0 2024-09-13T17:19:52.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.480+0000 7fd5155dd740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef899781f0 con 0x55ef89a22790 2024-09-13T17:19:52.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.480+0000 7fd5155dd740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef899afb80 con 0x55ef89a2d950 2024-09-13T17:19:52.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.480+0000 7fd503fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef89a230b0 0x55ef89a34b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.480+0000 7fd503fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef89a230b0 0x55ef89a34b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48370/0 (socket says 172.21.15.87:48370) 2024-09-13T17:19:52.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.480+0000 7fd503fff640 1 -- 172.21.15.87:0/79783861 learned_addr learned my addr 172.21.15.87:0/79783861 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:52.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.480+0000 7fd503fff640 1 -- 172.21.15.87:0/79783861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef89a2d950 msgr2=0x55ef89a25200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:52.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.480+0000 7fd503fff640 1 --2- 172.21.15.87:0/79783861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef89a2d950 0x55ef89a25200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.480+0000 7fd503fff640 1 -- 172.21.15.87:0/79783861 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef89a22790 msgr2=0x55ef89a34620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:52.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.480+0000 7fd503fff640 1 --2- 172.21.15.87:0/79783861 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef89a22790 0x55ef89a34620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.480+0000 7fd503fff640 1 -- 172.21.15.87:0/79783861 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef89926770 con 0x55ef89a230b0 2024-09-13T17:19:52.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.481+0000 7fd503fff640 1 --2- 172.21.15.87:0/79783861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef89a230b0 0x55ef89a34b60 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fd4f40ba8a0 tx=0x7fd4f4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c2451f098a94bf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:52.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.481+0000 7fd502ffd640 1 -- 172.21.15.87:0/79783861 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f403f070 con 0x55ef89a230b0 2024-09-13T17:19:52.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.481+0000 7fd502ffd640 1 -- 172.21.15.87:0/79783861 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd4f40b72b0 con 0x55ef89a230b0 2024-09-13T17:19:52.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.481+0000 7fd502ffd640 1 -- 172.21.15.87:0/79783861 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f40c3020 con 0x55ef89a230b0 2024-09-13T17:19:52.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.481+0000 7fd5155dd740 1 -- 172.21.15.87:0/79783861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef89a230b0 msgr2=0x55ef89a34b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:52.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.481+0000 7fd5155dd740 1 --2- 172.21.15.87:0/79783861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef89a230b0 0x55ef89a34b60 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fd4f40ba8a0 tx=0x7fd4f4009260 comp rx=0 tx=0).stop 2024-09-13T17:19:52.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.481+0000 7fd5155dd740 1 -- 172.21.15.87:0/79783861 shutdown_connections 2024-09-13T17:19:52.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.481+0000 7fd5155dd740 1 --2- 172.21.15.87:0/79783861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef89a2d950 0x55ef89a25200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.481+0000 7fd5155dd740 1 --2- 172.21.15.87:0/79783861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef89a230b0 0x55ef89a34b60 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.481+0000 7fd5155dd740 1 --2- 172.21.15.87:0/79783861 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef89a22790 0x55ef89a34620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.481+0000 7fd5155dd740 1 -- 172.21.15.87:0/79783861 >> 172.21.15.87:0/79783861 conn(0x55ef89a1ed00 msgr2=0x55ef89a43b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:52.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.481+0000 7fd5155dd740 1 -- 172.21.15.87:0/79783861 shutdown_connections 2024-09-13T17:19:52.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.481+0000 7fd5155dd740 1 -- 172.21.15.87:0/79783861 wait complete. 2024-09-13T17:19:52.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.482+0000 7fd5155dd740 1 -- start start 2024-09-13T17:19:52.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.482+0000 7fd5155dd740 1 Processor -- start 2024-09-13T17:19:52.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.482+0000 7fd5155dd740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef89a22790 0x55ef89a348a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.482+0000 7fd5155dd740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef89a230b0 0x55ef89a32d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.482+0000 7fd5155dd740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef89a2d950 0x55ef89a332a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.482+0000 7fd5155dd740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef89a339a0 con 0x55ef89a22790 2024-09-13T17:19:52.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.482+0000 7fd5155dd740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef89a33b10 con 0x55ef89a230b0 2024-09-13T17:19:52.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.482+0000 7fd5155dd740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef89a932a0 con 0x55ef89a2d950 2024-09-13T17:19:52.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.482+0000 7fd5155dd740 10 client.0 _ll_register_callbacks cb 0x7fd4fc009400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:52.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.482+0000 7fd50bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef89a22790 0x55ef89a348a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.482+0000 7fd50bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef89a22790 0x55ef89a348a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48380/0 (socket says 172.21.15.87:48380) 2024-09-13T17:19:52.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.482+0000 7fd50bfff640 1 -- 172.21.15.87:0/518109259 learned_addr learned my addr 172.21.15.87:0/518109259 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:52.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.482+0000 7fd50bfff640 1 -- 172.21.15.87:0/518109259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef89a2d950 msgr2=0x55ef89a332a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:52.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.482+0000 7fd50bfff640 1 --2- 172.21.15.87:0/518109259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef89a2d950 0x55ef89a332a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.482+0000 7fd503fff640 1 --2- 172.21.15.87:0/518109259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef89a230b0 0x55ef89a32d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.482+0000 7fd50bfff640 1 -- 172.21.15.87:0/518109259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef89a230b0 msgr2=0x55ef89a32d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:52.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.482+0000 7fd50bfff640 1 --2- 172.21.15.87:0/518109259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef89a230b0 0x55ef89a32d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.482+0000 7fd50bfff640 1 -- 172.21.15.87:0/518109259 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ef899843c0 con 0x55ef89a22790 2024-09-13T17:19:52.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.482+0000 7fd503fff640 1 --2- 172.21.15.87:0/518109259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef89a230b0 0x55ef89a32d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:52.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.483+0000 7fd50bfff640 1 --2- 172.21.15.87:0/518109259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef89a22790 0x55ef89a348a0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc009fd0 tx=0x7fd4fc0097f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb9ab57a65b0489 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:52.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.483+0000 7fd4eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:19:52.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.483+0000 7fd4eb7fe640 1 -- 172.21.15.87:0/518109259 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc005040 con 0x55ef89a22790 2024-09-13T17:19:52.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.483+0000 7fd4eb7fe640 1 -- 172.21.15.87:0/518109259 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fd4fc0051a0 con 0x55ef89a22790 2024-09-13T17:19:52.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.483+0000 7fd5155dd740 1 -- 172.21.15.87:0/518109259 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd4fc017cd0 con 0x55ef89a22790 2024-09-13T17:19:52.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.483+0000 7fd4eb7fe640 1 -- 172.21.15.87:0/518109259 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd4fc005360 con 0x55ef89a22790 2024-09-13T17:19:52.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.483+0000 7fd5155dd740 10 client.17277 fetch_fsmap learned FSMap version 36 2024-09-13T17:19:52.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.483+0000 7fd5155dd740 1 -- 172.21.15.87:0/518109259 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55ef8994be80 con 0x55ef89a22790 2024-09-13T17:19:52.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.483+0000 7fd4eb7fe640 1 -- 172.21.15.87:0/518109259 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd4fc017cd0 con 0x55ef89a22790 2024-09-13T17:19:52.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.483+0000 7fd4eb7fe640 1 -- 172.21.15.87:0/518109259 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd4fc027040 con 0x55ef89a22790 2024-09-13T17:19:52.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.483+0000 7fd5155dd740 10 client.17277 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:19:52.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.483+0000 7fd5155dd740 10 client.17277 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:19:52.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.483+0000 7fd5155dd740 20 client.17277 populate_metadata read hostname 'smithi087' 2024-09-13T17:19:52.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.483+0000 7fd5155dd740 1 --2- 172.21.15.87:0/518109259 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55ef89a948a0 0x55ef89a96cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.483+0000 7fd5155dd740 4 client.17277 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:19:52.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.483+0000 7fd5155dd740 1 -- 172.21.15.87:0/518109259 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ef896794e0 con 0x55ef89a948a0 2024-09-13T17:19:52.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.483+0000 7fd503fff640 1 --2- 172.21.15.87:0/518109259 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55ef89a948a0 0x55ef89a96cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.484+0000 7fd503fff640 1 --2- 172.21.15.87:0/518109259 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55ef89a948a0 0x55ef89a96cc0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=791298718363e9be server_cookie=bf6ea171729a90dc in_seq=0 out_seq=0 2024-09-13T17:19:52.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.484+0000 7fd4eb7fe640 10 client.17277 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:19:52.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.484+0000 7fd4eb7fe640 1 -- 172.21.15.87:0/518109259 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ef896794e0 con 0x55ef89a948a0 2024-09-13T17:19:52.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.484+0000 7fd4eb7fe640 10 client.17277 handle_command_reply: tid=0 2024-09-13T17:19:52.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.484+0000 7fd5155dd740 1 client.17277 shutdown 2024-09-13T17:19:52.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.484+0000 7fd5155dd740 1 -- 172.21.15.87:0/518109259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef89a22790 msgr2=0x55ef89a348a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:52.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.484+0000 7fd5155dd740 1 --2- 172.21.15.87:0/518109259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef89a22790 0x55ef89a348a0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc009fd0 tx=0x7fd4fc0097f0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.484+0000 7fd5155dd740 1 -- 172.21.15.87:0/518109259 shutdown_connections 2024-09-13T17:19:52.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.484+0000 7fd5155dd740 1 --2- 172.21.15.87:0/518109259 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55ef89a948a0 0x55ef89a96cc0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.484+0000 7fd5155dd740 1 --2- 172.21.15.87:0/518109259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef89a2d950 0x55ef89a332a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.484+0000 7fd5155dd740 1 --2- 172.21.15.87:0/518109259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef89a230b0 0x55ef89a32d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.484+0000 7fd5155dd740 1 --2- 172.21.15.87:0/518109259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ef89a22790 0x55ef89a348a0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.484+0000 7fd4eb7fe640 0 client.17277 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:19:52.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.484+0000 7fd5155dd740 1 -- 172.21.15.87:0/518109259 >> 172.21.15.87:0/518109259 conn(0x55ef89a1ed00 msgr2=0x55ef89a2c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:52.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.484+0000 7fd5155dd740 1 -- 172.21.15.87:0/518109259 shutdown_connections 2024-09-13T17:19:52.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.484+0000 7fd5155dd740 1 -- 172.21.15.87:0/518109259 wait complete. 2024-09-13T17:19:52.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.484+0000 7fd5155dd740 20 client.17277 trim_cache size 0 max 16384 2024-09-13T17:19:52.492 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:19:52.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.485+0000 7fd5127e2640 1 -- 172.21.15.87:0/1183443037 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd4f80a1200 msgr2=0x7fd4f80a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:52.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.485+0000 7fd5127e2640 1 --2- 172.21.15.87:0/1183443037 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd4f80a1200 0x7fd4f80a36c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd504005c40 tx=0x7fd504009200 comp rx=0 tx=0).stop 2024-09-13T17:19:52.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.485+0000 7fd5127e2640 1 -- 172.21.15.87:0/1183443037 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd50c101870 msgr2=0x7fd50c196810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:52.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.485+0000 7fd5127e2640 1 --2- 172.21.15.87:0/1183443037 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd50c101870 0x7fd50c196810 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fd4f402aa70 tx=0x7fd4f40042f0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.485+0000 7fd5127e2640 1 -- 172.21.15.87:0/1183443037 shutdown_connections 2024-09-13T17:19:52.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.485+0000 7fd5127e2640 1 --2- 172.21.15.87:0/1183443037 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd50c10a2e0 0x7fd50c19ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.485+0000 7fd5127e2640 1 --2- 172.21.15.87:0/1183443037 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd4f80a1200 0x7fd4f80a36c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.485+0000 7fd5127e2640 1 --2- 172.21.15.87:0/1183443037 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd50c101870 0x7fd50c196810 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.485+0000 7fd5127e2640 1 --2- 172.21.15.87:0/1183443037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd50c100f50 0x7fd50c1962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.485+0000 7fd5127e2640 1 -- 172.21.15.87:0/1183443037 >> 172.21.15.87:0/1183443037 conn(0x7fd50c0fa8c0 msgr2=0x7fd50c0fc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:52.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.485+0000 7fd5127e2640 1 -- 172.21.15.87:0/1183443037 shutdown_connections 2024-09-13T17:19:52.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.485+0000 7fd5127e2640 1 -- 172.21.15.87:0/1183443037 wait complete. 2024-09-13T17:19:52.497 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-09-13T17:19:52.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.597+0000 7f8537784640 1 -- 172.21.15.87:0/2553561413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8530105190 msgr2=0x7f853010bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:52.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.597+0000 7f8537784640 1 --2- 172.21.15.87:0/2553561413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8530105190 0x7f853010bb40 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f8528009cd0 tx=0x7f852802a8e0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.598+0000 7f8537784640 1 -- 172.21.15.87:0/2553561413 shutdown_connections 2024-09-13T17:19:52.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.598+0000 7f8537784640 1 --2- 172.21.15.87:0/2553561413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8530105190 0x7f853010bb40 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.598+0000 7f8537784640 1 --2- 172.21.15.87:0/2553561413 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8530100590 0x7f8530104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.598+0000 7f8537784640 1 --2- 172.21.15.87:0/2553561413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85300ffbe0 0x7f85300fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.598+0000 7f8537784640 1 -- 172.21.15.87:0/2553561413 >> 172.21.15.87:0/2553561413 conn(0x7f85300741b0 msgr2=0x7f85300745c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:52.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.598+0000 7f8537784640 1 -- 172.21.15.87:0/2553561413 shutdown_connections 2024-09-13T17:19:52.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.598+0000 7f8537784640 1 -- 172.21.15.87:0/2553561413 wait complete. 2024-09-13T17:19:52.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.598+0000 7f8537784640 1 Processor -- start 2024-09-13T17:19:52.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.598+0000 7f8537784640 1 -- start start 2024-09-13T17:19:52.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.598+0000 7f8537784640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85300ffbe0 0x7f8530195190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.598+0000 7f8537784640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8530105190 0x7f85301956d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.598+0000 7f8537784640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8530199ac0 0x7f8530199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.598+0000 7f8537784640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853019a4b0 con 0x7f8530105190 2024-09-13T17:19:52.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.598+0000 7f8537784640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853019a620 con 0x7f8530199ac0 2024-09-13T17:19:52.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.598+0000 7f8537784640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853019a790 con 0x7f85300ffbe0 2024-09-13T17:19:52.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.599+0000 7f8534d1f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8530105190 0x7f85301956d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.599+0000 7f8534d1f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8530105190 0x7f85301956d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48404/0 (socket says 172.21.15.87:48404) 2024-09-13T17:19:52.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.599+0000 7f8534d1f640 1 -- 172.21.15.87:0/2941455340 learned_addr learned my addr 172.21.15.87:0/2941455340 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:52.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.599+0000 7f8535520640 1 --2- 172.21.15.87:0/2941455340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85300ffbe0 0x7f8530195190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.599+0000 7f8535d21640 1 --2- 172.21.15.87:0/2941455340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8530199ac0 0x7f8530199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.599+0000 7f8534d1f640 1 -- 172.21.15.87:0/2941455340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85300ffbe0 msgr2=0x7f8530195190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:52.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.599+0000 7f8534d1f640 1 --2- 172.21.15.87:0/2941455340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85300ffbe0 0x7f8530195190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.599+0000 7f8534d1f640 1 -- 172.21.15.87:0/2941455340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8530199ac0 msgr2=0x7f8530199f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:52.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.599+0000 7f8534d1f640 1 --2- 172.21.15.87:0/2941455340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8530199ac0 0x7f8530199f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.599+0000 7f8534d1f640 1 -- 172.21.15.87:0/2941455340 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8528009900 con 0x7f8530105190 2024-09-13T17:19:52.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.599+0000 7f8535d21640 1 --2- 172.21.15.87:0/2941455340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8530199ac0 0x7f8530199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:52.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.599+0000 7f8534d1f640 1 --2- 172.21.15.87:0/2941455340 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8530105190 0x7f85301956d0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f852c00c970 tx=0x7f852c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:52.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.599+0000 7f85227fc640 1 -- 172.21.15.87:0/2941455340 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852c007bb0 con 0x7f8530105190 2024-09-13T17:19:52.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.599+0000 7f85227fc640 1 -- 172.21.15.87:0/2941455340 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f852c007d10 con 0x7f8530105190 2024-09-13T17:19:52.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.599+0000 7f85227fc640 1 -- 172.21.15.87:0/2941455340 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852c00f450 con 0x7f8530105190 2024-09-13T17:19:52.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.599+0000 7f8537784640 1 -- 172.21.15.87:0/2941455340 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85301a1d70 con 0x7f8530105190 2024-09-13T17:19:52.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.599+0000 7f8537784640 1 -- 172.21.15.87:0/2941455340 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85301a21d0 con 0x7f8530105190 2024-09-13T17:19:52.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.602+0000 7f853a4a3740 1 Processor -- start 2024-09-13T17:19:52.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.602+0000 7f85227fc640 1 -- 172.21.15.87:0/2941455340 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f852c004eb0 con 0x7f8530105190 2024-09-13T17:19:52.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.602+0000 7f853a4a3740 1 -- start start 2024-09-13T17:19:52.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.602+0000 7f853a4a3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5609f7baa650 0x5609f7baaa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.602+0000 7f853a4a3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5609f7baaf70 0x5609f7bb7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.603+0000 7f853a4a3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5609f7bb7b60 0x5609f7bb9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.603+0000 7f853a4a3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f7b14cc0 con 0x5609f7bb7b60 2024-09-13T17:19:52.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.603+0000 7f853a4a3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f7b12450 con 0x5609f7baaf70 2024-09-13T17:19:52.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.603+0000 7f853a4a3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f7b0dd40 con 0x5609f7baa650 2024-09-13T17:19:52.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.603+0000 7f8534d1f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5609f7bb7b60 0x5609f7bb9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.603+0000 7f8534d1f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5609f7bb7b60 0x5609f7bb9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48418/0 (socket says 172.21.15.87:48418) 2024-09-13T17:19:52.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.603+0000 7f8534d1f640 1 -- 172.21.15.87:0/4167145236 learned_addr learned my addr 172.21.15.87:0/4167145236 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:52.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.603+0000 7f8535d21640 1 --2- 172.21.15.87:0/4167145236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5609f7baa650 0x5609f7baaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.603+0000 7f8535520640 1 --2- 172.21.15.87:0/4167145236 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5609f7baaf70 0x5609f7bb7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.603+0000 7f85227fc640 1 --2- 172.21.15.87:0/2941455340 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f851c0a1280 0x7f851c0a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.603+0000 7f8534d1f640 1 -- 172.21.15.87:0/4167145236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5609f7baa650 msgr2=0x5609f7baaa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:52.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.603+0000 7f8534d1f640 1 --2- 172.21.15.87:0/4167145236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5609f7baa650 0x5609f7baaa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.603+0000 7f8534d1f640 1 -- 172.21.15.87:0/4167145236 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5609f7baaf70 msgr2=0x5609f7bb7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:52.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.603+0000 7f8534d1f640 1 --2- 172.21.15.87:0/4167145236 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5609f7baaf70 0x5609f7bb7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.603+0000 7f8534d1f640 1 -- 172.21.15.87:0/4167145236 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609f7ad5620 con 0x5609f7bb7b60 2024-09-13T17:19:52.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.603+0000 7f8535d21640 1 --2- 172.21.15.87:0/2941455340 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f851c0a1280 0x7f851c0a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.603+0000 7f85227fc640 1 -- 172.21.15.87:0/2941455340 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f852c0cd090 con 0x7f8530105190 2024-09-13T17:19:52.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.603+0000 7f8534d1f640 1 --2- 172.21.15.87:0/4167145236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5609f7bb7b60 0x5609f7bb9f50 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f852c0ca3a0 tx=0x7f852c0c4330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=651109cbeef1e8e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:52.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.603+0000 7f851b7fe640 1 -- 172.21.15.87:0/4167145236 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852c00a4a0 con 0x5609f7bb7b60 2024-09-13T17:19:52.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.603+0000 7f851b7fe640 1 -- 172.21.15.87:0/4167145236 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f852c099930 con 0x5609f7bb7b60 2024-09-13T17:19:52.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.604+0000 7f851b7fe640 1 -- 172.21.15.87:0/4167145236 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852c06d480 con 0x5609f7bb7b60 2024-09-13T17:19:52.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.604+0000 7f853a4a3740 1 -- 172.21.15.87:0/4167145236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5609f7bb7b60 msgr2=0x5609f7bb9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:52.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.604+0000 7f8535d21640 1 --2- 172.21.15.87:0/2941455340 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f851c0a1280 0x7f851c0a3740 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8528004af0 tx=0x7f85280095c0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:52.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.604+0000 7f853a4a3740 1 --2- 172.21.15.87:0/4167145236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5609f7bb7b60 0x5609f7bb9f50 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f852c0ca3a0 tx=0x7f852c0c4330 comp rx=0 tx=0).stop 2024-09-13T17:19:52.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.604+0000 7f853a4a3740 1 -- 172.21.15.87:0/4167145236 shutdown_connections 2024-09-13T17:19:52.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.604+0000 7f853a4a3740 1 --2- 172.21.15.87:0/4167145236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5609f7bb7b60 0x5609f7bb9f50 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.604+0000 7f853a4a3740 1 --2- 172.21.15.87:0/4167145236 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5609f7baaf70 0x5609f7bb7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.604+0000 7f853a4a3740 1 --2- 172.21.15.87:0/4167145236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5609f7baa650 0x5609f7baaa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.604+0000 7f853a4a3740 1 -- 172.21.15.87:0/4167145236 >> 172.21.15.87:0/4167145236 conn(0x5609f7ba6d00 msgr2=0x5609f7ba70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:52.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.604+0000 7f853a4a3740 1 -- 172.21.15.87:0/4167145236 shutdown_connections 2024-09-13T17:19:52.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.604+0000 7f853a4a3740 1 -- 172.21.15.87:0/4167145236 wait complete. 2024-09-13T17:19:52.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.605+0000 7f853a4a3740 1 -- start start 2024-09-13T17:19:52.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.605+0000 7f853a4a3740 1 Processor -- start 2024-09-13T17:19:52.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.605+0000 7f853a4a3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5609f7baa650 0x5609f7bb7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.605+0000 7f853a4a3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5609f7baaf70 0x5609f7bb4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.605+0000 7f853a4a3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5609f7bb7b60 0x5609f7bb4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.605+0000 7f853a4a3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f7acc180 con 0x5609f7bb7b60 2024-09-13T17:19:52.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.605+0000 7f853a4a3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f77e6430 con 0x5609f7baaf70 2024-09-13T17:19:52.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.605+0000 7f853a4a3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f7a915e0 con 0x5609f7baa650 2024-09-13T17:19:52.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.605+0000 7f853a4a3740 10 client.0 _ll_register_callbacks cb 0x5609f7afdaa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:52.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.605+0000 7f8535d21640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5609f7bb7b60 0x5609f7bb4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.605+0000 7f8535d21640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5609f7bb7b60 0x5609f7bb4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48432/0 (socket says 172.21.15.87:48432) 2024-09-13T17:19:52.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.605+0000 7f8535d21640 1 -- 172.21.15.87:0/3514217835 learned_addr learned my addr 172.21.15.87:0/3514217835 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:52.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.605+0000 7f8534d1f640 1 --2- 172.21.15.87:0/3514217835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5609f7baaf70 0x5609f7bb4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.605+0000 7f8535520640 1 --2- 172.21.15.87:0/3514217835 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5609f7baa650 0x5609f7bb7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.606+0000 7f8535d21640 1 -- 172.21.15.87:0/3514217835 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5609f7baa650 msgr2=0x5609f7bb7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:52.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.606+0000 7f8535d21640 1 --2- 172.21.15.87:0/3514217835 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5609f7baa650 0x5609f7bb7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.606+0000 7f8535d21640 1 -- 172.21.15.87:0/3514217835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5609f7baaf70 msgr2=0x5609f7bb4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:52.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.606+0000 7f8535d21640 1 --2- 172.21.15.87:0/3514217835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5609f7baaf70 0x5609f7bb4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.606+0000 7f8535d21640 1 -- 172.21.15.87:0/3514217835 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85301a21d0 con 0x5609f7bb7b60 2024-09-13T17:19:52.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.606+0000 7f8535d21640 1 --2- 172.21.15.87:0/3514217835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5609f7bb7b60 0x5609f7bb4980 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f8528030ff0 tx=0x7f852802a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11ef73053713227e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:52.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.606+0000 7f8518ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:19:52.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.606+0000 7f8518ff9640 1 -- 172.21.15.87:0/3514217835 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8528004040 con 0x5609f7bb7b60 2024-09-13T17:19:52.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.606+0000 7f8518ff9640 1 -- 172.21.15.87:0/3514217835 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f85280041a0 con 0x5609f7bb7b60 2024-09-13T17:19:52.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.606+0000 7f853a4a3740 1 -- 172.21.15.87:0/3514217835 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5609f7b37b80 con 0x5609f7bb7b60 2024-09-13T17:19:52.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.606+0000 7f8518ff9640 1 -- 172.21.15.87:0/3514217835 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8528004360 con 0x5609f7bb7b60 2024-09-13T17:19:52.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.606+0000 7f853a4a3740 10 client.17289 fetch_fsmap learned FSMap version 36 2024-09-13T17:19:52.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.606+0000 7f853a4a3740 1 -- 172.21.15.87:0/3514217835 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5609f7b0c3c0 con 0x5609f7bb7b60 2024-09-13T17:19:52.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.606+0000 7f8518ff9640 1 -- 172.21.15.87:0/3514217835 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x5609f7b37b80 con 0x5609f7bb7b60 2024-09-13T17:19:52.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.606+0000 7f8518ff9640 1 -- 172.21.15.87:0/3514217835 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f852803dc20 con 0x5609f7bb7b60 2024-09-13T17:19:52.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.606+0000 7f853a4a3740 10 client.17289 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:19:52.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.606+0000 7f853a4a3740 10 client.17289 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:19:52.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.606+0000 7f853a4a3740 20 client.17289 populate_metadata read hostname 'smithi087' 2024-09-13T17:19:52.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.606+0000 7f853a4a3740 1 --2- 172.21.15.87:0/3514217835 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5609f7bc7470 0x5609f7bc9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.606+0000 7f853a4a3740 4 client.17289 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:19:52.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.606+0000 7f853a4a3740 1 -- 172.21.15.87:0/3514217835 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5609f7b001f0 con 0x5609f7bc7470 2024-09-13T17:19:52.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.607+0000 7f8535520640 1 --2- 172.21.15.87:0/3514217835 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5609f7bc7470 0x5609f7bc9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.607+0000 7f8518ff9640 10 client.17289 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:19:52.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.607+0000 7f8535520640 1 --2- 172.21.15.87:0/3514217835 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5609f7bc7470 0x5609f7bc9890 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=317da56f99fa96cb server_cookie=cab96077f5f6ab1f in_seq=0 out_seq=0 2024-09-13T17:19:52.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.608+0000 7f8518ff9640 1 -- 172.21.15.87:0/3514217835 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5609f7b001f0 con 0x5609f7bc7470 2024-09-13T17:19:52.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.608+0000 7f8518ff9640 10 client.17289 handle_command_reply: tid=0 2024-09-13T17:19:52.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.608+0000 7f853a4a3740 1 client.17289 shutdown 2024-09-13T17:19:52.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.608+0000 7f853a4a3740 1 -- 172.21.15.87:0/3514217835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5609f7bb7b60 msgr2=0x5609f7bb4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:52.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.608+0000 7f853a4a3740 1 --2- 172.21.15.87:0/3514217835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5609f7bb7b60 0x5609f7bb4980 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f8528030ff0 tx=0x7f852802a8e0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.608+0000 7f853a4a3740 1 -- 172.21.15.87:0/3514217835 shutdown_connections 2024-09-13T17:19:52.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.608+0000 7f853a4a3740 1 --2- 172.21.15.87:0/3514217835 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5609f7bc7470 0x5609f7bc9890 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.608+0000 7f853a4a3740 1 --2- 172.21.15.87:0/3514217835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5609f7bb7b60 0x5609f7bb4980 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.608+0000 7f8518ff9640 0 client.17289 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:19:52.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.608+0000 7f853a4a3740 1 --2- 172.21.15.87:0/3514217835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5609f7baaf70 0x5609f7bb4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.608+0000 7f853a4a3740 1 --2- 172.21.15.87:0/3514217835 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5609f7baa650 0x5609f7bb7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.608+0000 7f853a4a3740 1 -- 172.21.15.87:0/3514217835 >> 172.21.15.87:0/3514217835 conn(0x5609f7ba6d00 msgr2=0x5609f7ba5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:52.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.608+0000 7f853a4a3740 1 -- 172.21.15.87:0/3514217835 shutdown_connections 2024-09-13T17:19:52.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.608+0000 7f853a4a3740 1 -- 172.21.15.87:0/3514217835 wait complete. 2024-09-13T17:19:52.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.608+0000 7f853a4a3740 20 client.17289 trim_cache size 0 max 16384 2024-09-13T17:19:52.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.619+0000 7f853a4a3740 1 Processor -- start 2024-09-13T17:19:52.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.619+0000 7f853a4a3740 1 -- start start 2024-09-13T17:19:52.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.619+0000 7f853a4a3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5609f7baa650 0x5609f7ba66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.619+0000 7f853a4a3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5609f7baaf70 0x5609f7bbe7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.619+0000 7f853a4a3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5609f7bb7b60 0x5609f7bbed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.619+0000 7f853a4a3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f7bb79c0 con 0x5609f7baaf70 2024-09-13T17:19:52.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.619+0000 7f853a4a3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f7bb7770 con 0x5609f7baa650 2024-09-13T17:19:52.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.619+0000 7f853a4a3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f7bc7290 con 0x5609f7bb7b60 2024-09-13T17:19:52.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.619+0000 7f8534d1f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5609f7baaf70 0x5609f7bbe7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.619+0000 7f8534d1f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5609f7baaf70 0x5609f7bbe7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48436/0 (socket says 172.21.15.87:48436) 2024-09-13T17:19:52.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.619+0000 7f8534d1f640 1 -- 172.21.15.87:0/3079200657 learned_addr learned my addr 172.21.15.87:0/3079200657 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:52.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.620+0000 7f8535520640 1 --2- 172.21.15.87:0/3079200657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5609f7baa650 0x5609f7ba66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.620+0000 7f8534d1f640 1 -- 172.21.15.87:0/3079200657 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5609f7bb7b60 msgr2=0x5609f7bbed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:52.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.620+0000 7f8534d1f640 1 --2- 172.21.15.87:0/3079200657 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5609f7bb7b60 0x5609f7bbed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.620+0000 7f8534d1f640 1 -- 172.21.15.87:0/3079200657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5609f7baa650 msgr2=0x5609f7ba66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:52.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.620+0000 7f8534d1f640 1 --2- 172.21.15.87:0/3079200657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5609f7baa650 0x5609f7ba66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.620+0000 7f8534d1f640 1 -- 172.21.15.87:0/3079200657 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609f7aae770 con 0x5609f7baaf70 2024-09-13T17:19:52.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.620+0000 7f8535520640 1 --2- 172.21.15.87:0/3079200657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5609f7baa650 0x5609f7ba66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:52.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.620+0000 7f8534d1f640 1 --2- 172.21.15.87:0/3079200657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5609f7baaf70 0x5609f7bbe7f0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f852c0caa30 tx=0x7f852c0048b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed70cc015b47ba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:52.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.620+0000 7f851bfff640 1 -- 172.21.15.87:0/3079200657 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852c00a4a0 con 0x5609f7baaf70 2024-09-13T17:19:52.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.620+0000 7f851bfff640 1 -- 172.21.15.87:0/3079200657 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f852c099750 con 0x5609f7baaf70 2024-09-13T17:19:52.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.620+0000 7f851bfff640 1 -- 172.21.15.87:0/3079200657 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852c09dc20 con 0x5609f7baaf70 2024-09-13T17:19:52.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.620+0000 7f853a4a3740 1 -- 172.21.15.87:0/3079200657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5609f7baaf70 msgr2=0x5609f7bbe7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:52.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.620+0000 7f853a4a3740 1 --2- 172.21.15.87:0/3079200657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5609f7baaf70 0x5609f7bbe7f0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f852c0caa30 tx=0x7f852c0048b0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.621+0000 7f853a4a3740 1 -- 172.21.15.87:0/3079200657 shutdown_connections 2024-09-13T17:19:52.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.621+0000 7f853a4a3740 1 --2- 172.21.15.87:0/3079200657 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5609f7bb7b60 0x5609f7bbed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.621+0000 7f853a4a3740 1 --2- 172.21.15.87:0/3079200657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5609f7baaf70 0x5609f7bbe7f0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.621+0000 7f853a4a3740 1 --2- 172.21.15.87:0/3079200657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5609f7baa650 0x5609f7ba66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.621+0000 7f853a4a3740 1 -- 172.21.15.87:0/3079200657 >> 172.21.15.87:0/3079200657 conn(0x5609f7ba6d00 msgr2=0x5609f7bb2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:52.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.621+0000 7f853a4a3740 1 -- 172.21.15.87:0/3079200657 shutdown_connections 2024-09-13T17:19:52.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.621+0000 7f853a4a3740 1 -- 172.21.15.87:0/3079200657 wait complete. 2024-09-13T17:19:52.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.621+0000 7f853a4a3740 1 -- start start 2024-09-13T17:19:52.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.621+0000 7f853a4a3740 1 Processor -- start 2024-09-13T17:19:52.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.621+0000 7f853a4a3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5609f7baa650 0x5609f7bbeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.621+0000 7f853a4a3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5609f7baaf70 0x5609f7bbaf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.621+0000 7f853a4a3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5609f7bb7b60 0x5609f7bbb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.621+0000 7f853a4a3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f7bbbb60 con 0x5609f7bb7b60 2024-09-13T17:19:52.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.621+0000 7f853a4a3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f7bbbcd0 con 0x5609f7baa650 2024-09-13T17:19:52.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.621+0000 7f853a4a3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f7c1d970 con 0x5609f7baaf70 2024-09-13T17:19:52.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.621+0000 7f853a4a3740 10 client.0 _ll_register_callbacks cb 0x7f852c0d0a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:52.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.621+0000 7f8535d21640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5609f7bb7b60 0x5609f7bbb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.621+0000 7f8535d21640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5609f7bb7b60 0x5609f7bbb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48440/0 (socket says 172.21.15.87:48440) 2024-09-13T17:19:52.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.621+0000 7f8535d21640 1 -- 172.21.15.87:0/2103653022 learned_addr learned my addr 172.21.15.87:0/2103653022 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:52.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.622+0000 7f8534d1f640 1 --2- 172.21.15.87:0/2103653022 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5609f7baaf70 0x5609f7bbaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.622+0000 7f8535520640 1 --2- 172.21.15.87:0/2103653022 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5609f7baa650 0x5609f7bbeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.622+0000 7f8535d21640 1 -- 172.21.15.87:0/2103653022 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5609f7baaf70 msgr2=0x5609f7bbaf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:52.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.622+0000 7f8535d21640 1 --2- 172.21.15.87:0/2103653022 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5609f7baaf70 0x5609f7bbaf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.622+0000 7f8535d21640 1 -- 172.21.15.87:0/2103653022 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5609f7baa650 msgr2=0x5609f7bbeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:52.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.622+0000 7f8535d21640 1 --2- 172.21.15.87:0/2103653022 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5609f7baa650 0x5609f7bbeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.622+0000 7f8535d21640 1 -- 172.21.15.87:0/2103653022 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5609f7ad5620 con 0x5609f7bb7b60 2024-09-13T17:19:52.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.622+0000 7f8534d1f640 1 --2- 172.21.15.87:0/2103653022 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5609f7baaf70 0x5609f7bbaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:52.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.622+0000 7f8535d21640 1 --2- 172.21.15.87:0/2103653022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5609f7bb7b60 0x5609f7bbb4b0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f8528048ed0 tx=0x7f8528048f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b12e254bd47ab77 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:52.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.622+0000 7f8518ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:19:52.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.622+0000 7f8518ff9640 1 -- 172.21.15.87:0/2103653022 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8528031d00 con 0x5609f7bb7b60 2024-09-13T17:19:52.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.622+0000 7f8518ff9640 1 -- 172.21.15.87:0/2103653022 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7f8528030bc0 con 0x5609f7bb7b60 2024-09-13T17:19:52.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.622+0000 7f853a4a3740 1 -- 172.21.15.87:0/2103653022 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f852c099930 con 0x5609f7bb7b60 2024-09-13T17:19:52.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.622+0000 7f8518ff9640 1 -- 172.21.15.87:0/2103653022 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8528048580 con 0x5609f7bb7b60 2024-09-13T17:19:52.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.622+0000 7f853a4a3740 10 client.17295 fetch_fsmap learned FSMap version 36 2024-09-13T17:19:52.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.622+0000 7f853a4a3740 1 -- 172.21.15.87:0/2103653022 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5609f7ad3e80 con 0x5609f7bb7b60 2024-09-13T17:19:52.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.622+0000 7f8518ff9640 1 -- 172.21.15.87:0/2103653022 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f852c099930 con 0x5609f7bb7b60 2024-09-13T17:19:52.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.622+0000 7f8518ff9640 1 -- 172.21.15.87:0/2103653022 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f8528066070 con 0x5609f7bb7b60 2024-09-13T17:19:52.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.622+0000 7f853a4a3740 10 client.17295 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:19:52.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.622+0000 7f853a4a3740 10 client.17295 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:19:52.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.622+0000 7f853a4a3740 20 client.17295 populate_metadata read hostname 'smithi087' 2024-09-13T17:19:52.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.622+0000 7f853a4a3740 1 --2- 172.21.15.87:0/2103653022 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5609f7c1eb40 0x5609f7c20f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.622+0000 7f853a4a3740 4 client.17295 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:19:52.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.622+0000 7f853a4a3740 1 -- 172.21.15.87:0/2103653022 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5609f78014e0 con 0x5609f7c1eb40 2024-09-13T17:19:52.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.623+0000 7f8535520640 1 --2- 172.21.15.87:0/2103653022 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5609f7c1eb40 0x5609f7c20f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.623+0000 7f8535520640 1 --2- 172.21.15.87:0/2103653022 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5609f7c1eb40 0x5609f7c20f60 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f77992e0bf516806 server_cookie=d67fb515da9806df in_seq=0 out_seq=0 2024-09-13T17:19:52.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.623+0000 7f8518ff9640 10 client.17295 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:19:52.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.623+0000 7f8518ff9640 1 -- 172.21.15.87:0/2103653022 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5609f78014e0 con 0x5609f7c1eb40 2024-09-13T17:19:52.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.623+0000 7f8518ff9640 10 client.17295 handle_command_reply: tid=0 2024-09-13T17:19:52.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.623+0000 7f853a4a3740 1 client.17295 shutdown 2024-09-13T17:19:52.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.624+0000 7f853a4a3740 1 -- 172.21.15.87:0/2103653022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5609f7bb7b60 msgr2=0x5609f7bbb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:52.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.624+0000 7f853a4a3740 1 --2- 172.21.15.87:0/2103653022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5609f7bb7b60 0x5609f7bbb4b0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f8528048ed0 tx=0x7f8528048f00 comp rx=0 tx=0).stop 2024-09-13T17:19:52.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.624+0000 7f853a4a3740 1 -- 172.21.15.87:0/2103653022 shutdown_connections 2024-09-13T17:19:52.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.624+0000 7f853a4a3740 1 --2- 172.21.15.87:0/2103653022 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5609f7c1eb40 0x5609f7c20f60 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.624+0000 7f853a4a3740 1 --2- 172.21.15.87:0/2103653022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5609f7bb7b60 0x5609f7bbb4b0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.624+0000 7f853a4a3740 1 --2- 172.21.15.87:0/2103653022 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5609f7baaf70 0x5609f7bbaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.624+0000 7f8518ff9640 0 client.17295 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:19:52.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.624+0000 7f853a4a3740 1 --2- 172.21.15.87:0/2103653022 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5609f7baa650 0x5609f7bbeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.624+0000 7f853a4a3740 1 -- 172.21.15.87:0/2103653022 >> 172.21.15.87:0/2103653022 conn(0x5609f7ba6d00 msgr2=0x5609f7bb2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:52.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.624+0000 7f853a4a3740 1 -- 172.21.15.87:0/2103653022 shutdown_connections 2024-09-13T17:19:52.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.624+0000 7f853a4a3740 1 -- 172.21.15.87:0/2103653022 wait complete. 2024-09-13T17:19:52.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.624+0000 7f853a4a3740 20 client.17295 trim_cache size 0 max 16384 2024-09-13T17:19:52.634 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:19:52.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.624+0000 7f8537784640 1 -- 172.21.15.87:0/2941455340 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f851c0a1280 msgr2=0x7f851c0a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:52.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.624+0000 7f8537784640 1 --2- 172.21.15.87:0/2941455340 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f851c0a1280 0x7f851c0a3740 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8528004af0 tx=0x7f85280095c0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.624+0000 7f8537784640 1 -- 172.21.15.87:0/2941455340 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8530105190 msgr2=0x7f85301956d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:52.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.624+0000 7f8537784640 1 --2- 172.21.15.87:0/2941455340 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8530105190 0x7f85301956d0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f852c00c970 tx=0x7f852c00ce30 comp rx=0 tx=0).stop 2024-09-13T17:19:52.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.624+0000 7f8537784640 1 -- 172.21.15.87:0/2941455340 shutdown_connections 2024-09-13T17:19:52.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.624+0000 7f8537784640 1 --2- 172.21.15.87:0/2941455340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8530199ac0 0x7f8530199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.624+0000 7f8537784640 1 --2- 172.21.15.87:0/2941455340 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f851c0a1280 0x7f851c0a3740 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.624+0000 7f8537784640 1 --2- 172.21.15.87:0/2941455340 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8530105190 0x7f85301956d0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.624+0000 7f8537784640 1 --2- 172.21.15.87:0/2941455340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85300ffbe0 0x7f8530195190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.624+0000 7f8537784640 1 -- 172.21.15.87:0/2941455340 >> 172.21.15.87:0/2941455340 conn(0x7f85300741b0 msgr2=0x7f8530102c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:52.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.624+0000 7f8537784640 1 -- 172.21.15.87:0/2941455340 shutdown_connections 2024-09-13T17:19:52.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.624+0000 7f8537784640 1 -- 172.21.15.87:0/2941455340 wait complete. 2024-09-13T17:19:52.636 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:52 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/258725466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:19:52.637 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-09-13T17:19:52.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.737+0000 7fc81e853640 1 -- 172.21.15.87:0/2497071407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8180ff810 msgr2=0x7fc818103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:52.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.737+0000 7fc81e853640 1 --2- 172.21.15.87:0/2497071407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8180ff810 0x7fc818103850 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fc800009930 tx=0x7fc80002a420 comp rx=0 tx=0).stop 2024-09-13T17:19:52.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.737+0000 7fc81e853640 1 -- 172.21.15.87:0/2497071407 shutdown_connections 2024-09-13T17:19:52.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.737+0000 7fc81e853640 1 --2- 172.21.15.87:0/2497071407 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc818103fb0 0x7fc81810bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.737+0000 7fc81e853640 1 --2- 172.21.15.87:0/2497071407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8180ff810 0x7fc818103850 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.737+0000 7fc81e853640 1 --2- 172.21.15.87:0/2497071407 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8180fee60 0x7fc8180ff240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.737+0000 7fc81e853640 1 -- 172.21.15.87:0/2497071407 >> 172.21.15.87:0/2497071407 conn(0x7fc818075c60 msgr2=0x7fc8180fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:52.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.737+0000 7fc81e853640 1 -- 172.21.15.87:0/2497071407 shutdown_connections 2024-09-13T17:19:52.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.737+0000 7fc81e853640 1 -- 172.21.15.87:0/2497071407 wait complete. 2024-09-13T17:19:52.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.738+0000 7fc81e853640 1 Processor -- start 2024-09-13T17:19:52.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.738+0000 7fc81e853640 1 -- start start 2024-09-13T17:19:52.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.738+0000 7fc81e853640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8180fee60 0x7fc818197150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.738+0000 7fc81e853640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc818103fb0 0x7fc818197690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.738+0000 7fc81e853640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc818197bd0 0x7fc8181a21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.738+0000 7fc81e853640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8181a2870 con 0x7fc818103fb0 2024-09-13T17:19:52.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.738+0000 7fc81e853640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8181a29e0 con 0x7fc818197bd0 2024-09-13T17:19:52.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.738+0000 7fc81e853640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8181a2ba0 con 0x7fc8180fee60 2024-09-13T17:19:52.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.738+0000 7fc8177fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc818103fb0 0x7fc818197690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.738+0000 7fc8177fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc818103fb0 0x7fc818197690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48448/0 (socket says 172.21.15.87:48448) 2024-09-13T17:19:52.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.738+0000 7fc8177fe640 1 -- 172.21.15.87:0/1591291181 learned_addr learned my addr 172.21.15.87:0/1591291181 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:52.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.738+0000 7fc81cdf0640 1 --2- 172.21.15.87:0/1591291181 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc818197bd0 0x7fc8181a21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.738+0000 7fc817fff640 1 --2- 172.21.15.87:0/1591291181 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8180fee60 0x7fc818197150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.738+0000 7fc8177fe640 1 -- 172.21.15.87:0/1591291181 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8180fee60 msgr2=0x7fc818197150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:52.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.738+0000 7fc8177fe640 1 --2- 172.21.15.87:0/1591291181 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8180fee60 0x7fc818197150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.738+0000 7fc8177fe640 1 -- 172.21.15.87:0/1591291181 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc818197bd0 msgr2=0x7fc8181a21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:52.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.738+0000 7fc8177fe640 1 --2- 172.21.15.87:0/1591291181 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc818197bd0 0x7fc8181a21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.738+0000 7fc8177fe640 1 -- 172.21.15.87:0/1591291181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc800009560 con 0x7fc818103fb0 2024-09-13T17:19:52.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.738+0000 7fc8177fe640 1 --2- 172.21.15.87:0/1591291181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc818103fb0 0x7fc818197690 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fc800009900 tx=0x7fc8000042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:52.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.739+0000 7fc8157fa640 1 -- 172.21.15.87:0/1591291181 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc800003a00 con 0x7fc818103fb0 2024-09-13T17:19:52.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.739+0000 7fc8157fa640 1 -- 172.21.15.87:0/1591291181 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc8000044e0 con 0x7fc818103fb0 2024-09-13T17:19:52.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.739+0000 7fc81e853640 1 -- 172.21.15.87:0/1591291181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8181a2e20 con 0x7fc818103fb0 2024-09-13T17:19:52.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.739+0000 7fc8157fa640 1 -- 172.21.15.87:0/1591291181 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80003a3c0 con 0x7fc818103fb0 2024-09-13T17:19:52.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.739+0000 7fc81e853640 1 -- 172.21.15.87:0/1591291181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8181a32a0 con 0x7fc818103fb0 2024-09-13T17:19:52.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.741+0000 7fc8157fa640 1 -- 172.21.15.87:0/1591291181 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fc80003b460 con 0x7fc818103fb0 2024-09-13T17:19:52.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.741+0000 7fc82164e740 1 Processor -- start 2024-09-13T17:19:52.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.741+0000 7fc82164e740 1 -- start start 2024-09-13T17:19:52.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.741+0000 7fc82164e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec40a70790 0x55ec40a70b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.741+0000 7fc82164e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ec40a710b0 0x55ec40a7b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.742+0000 7fc82164e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ec40a7b950 0x55ec40a7dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.742+0000 7fc82164e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec409dacc0 con 0x55ec40a7b950 2024-09-13T17:19:52.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.742+0000 7fc82164e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec409d8450 con 0x55ec40a70790 2024-09-13T17:19:52.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.742+0000 7fc82164e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec409d3d40 con 0x55ec40a710b0 2024-09-13T17:19:52.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.742+0000 7fc8157fa640 1 --2- 172.21.15.87:0/1591291181 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc8040a1280 0x7fc8040a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.742+0000 7fc8177fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ec40a7b950 0x55ec40a7dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.742+0000 7fc817fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ec40a710b0 0x55ec40a7b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.742+0000 7fc817fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ec40a710b0 0x55ec40a7b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:49914/0 (socket says 172.21.15.87:49914) 2024-09-13T17:19:52.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.742+0000 7fc817fff640 1 -- 172.21.15.87:0/1243453536 learned_addr learned my addr 172.21.15.87:0/1243453536 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:52.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.742+0000 7fc81cdf0640 1 --2- 172.21.15.87:0/1591291181 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc8040a1280 0x7fc8040a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.742+0000 7fc81cdf0640 1 --2- 172.21.15.87:0/1243453536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec40a70790 0x55ec40a70b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.742+0000 7fc8157fa640 1 -- 172.21.15.87:0/1591291181 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fc8000ee0c0 con 0x7fc818103fb0 2024-09-13T17:19:52.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.742+0000 7fc817fff640 1 -- 172.21.15.87:0/1243453536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec40a70790 msgr2=0x55ec40a70b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:52.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.742+0000 7fc817fff640 1 --2- 172.21.15.87:0/1243453536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec40a70790 0x55ec40a70b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.742+0000 7fc817fff640 1 -- 172.21.15.87:0/1243453536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ec40a7b950 msgr2=0x55ec40a7dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:52.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.742+0000 7fc817fff640 1 --2- 172.21.15.87:0/1243453536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ec40a7b950 0x55ec40a7dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.742+0000 7fc817fff640 1 -- 172.21.15.87:0/1243453536 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec4099b620 con 0x55ec40a710b0 2024-09-13T17:19:52.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.742+0000 7fc81cdf0640 1 --2- 172.21.15.87:0/1243453536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec40a70790 0x55ec40a70b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:52.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.742+0000 7fc81cdf0640 1 --2- 172.21.15.87:0/1591291181 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc8040a1280 0x7fc8040a3740 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc810005c40 tx=0x7fc810009590 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:52.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.742+0000 7fc817fff640 1 --2- 172.21.15.87:0/1243453536 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ec40a710b0 0x55ec40a7b410 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc80800dcb0 tx=0x7fc80800f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69f3938b44ea7c1a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:52.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.742+0000 7fc80e7fc640 1 -- 172.21.15.87:0/1243453536 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc808011440 con 0x55ec40a710b0 2024-09-13T17:19:52.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.742+0000 7fc80e7fc640 1 -- 172.21.15.87:0/1243453536 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc808011a50 con 0x55ec40a710b0 2024-09-13T17:19:52.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.742+0000 7fc80e7fc640 1 -- 172.21.15.87:0/1243453536 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80801b960 con 0x55ec40a710b0 2024-09-13T17:19:52.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.743+0000 7fc82164e740 1 -- 172.21.15.87:0/1243453536 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ec40a710b0 msgr2=0x55ec40a7b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:52.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.743+0000 7fc82164e740 1 --2- 172.21.15.87:0/1243453536 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ec40a710b0 0x55ec40a7b410 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc80800dcb0 tx=0x7fc80800f730 comp rx=0 tx=0).stop 2024-09-13T17:19:52.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.743+0000 7fc82164e740 1 -- 172.21.15.87:0/1243453536 shutdown_connections 2024-09-13T17:19:52.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.743+0000 7fc82164e740 1 --2- 172.21.15.87:0/1243453536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ec40a7b950 0x55ec40a7dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.743+0000 7fc82164e740 1 --2- 172.21.15.87:0/1243453536 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ec40a710b0 0x55ec40a7b410 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.743+0000 7fc82164e740 1 --2- 172.21.15.87:0/1243453536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec40a70790 0x55ec40a70b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.743+0000 7fc82164e740 1 -- 172.21.15.87:0/1243453536 >> 172.21.15.87:0/1243453536 conn(0x55ec40a6cd00 msgr2=0x55ec40a6d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:52.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.743+0000 7fc82164e740 1 -- 172.21.15.87:0/1243453536 shutdown_connections 2024-09-13T17:19:52.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.743+0000 7fc82164e740 1 -- 172.21.15.87:0/1243453536 wait complete. 2024-09-13T17:19:52.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.743+0000 7fc82164e740 1 -- start start 2024-09-13T17:19:52.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.744+0000 7fc82164e740 1 Processor -- start 2024-09-13T17:19:52.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.744+0000 7fc82164e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ec40a70790 0x55ec40a7af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.744+0000 7fc82164e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec40a710b0 0x55ec40a78240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.744+0000 7fc82164e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ec40a7b950 0x55ec40a78780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.744+0000 7fc82164e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec40992180 con 0x55ec40a70790 2024-09-13T17:19:52.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.744+0000 7fc82164e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec406ac430 con 0x55ec40a710b0 2024-09-13T17:19:52.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.744+0000 7fc82164e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec409575e0 con 0x55ec40a7b950 2024-09-13T17:19:52.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.744+0000 7fc82164e740 10 client.0 _ll_register_callbacks cb 0x55ec409c3aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:52.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.744+0000 7fc817fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ec40a70790 0x55ec40a7af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.744+0000 7fc817fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ec40a70790 0x55ec40a7af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48452/0 (socket says 172.21.15.87:48452) 2024-09-13T17:19:52.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.744+0000 7fc817fff640 1 -- 172.21.15.87:0/4135638483 learned_addr learned my addr 172.21.15.87:0/4135638483 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:52.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.744+0000 7fc8177fe640 1 --2- 172.21.15.87:0/4135638483 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec40a710b0 0x55ec40a78240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.744+0000 7fc81cdf0640 1 --2- 172.21.15.87:0/4135638483 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ec40a7b950 0x55ec40a78780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.744+0000 7fc817fff640 1 -- 172.21.15.87:0/4135638483 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ec40a7b950 msgr2=0x55ec40a78780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:52.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.744+0000 7fc817fff640 1 --2- 172.21.15.87:0/4135638483 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ec40a7b950 0x55ec40a78780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.744+0000 7fc817fff640 1 -- 172.21.15.87:0/4135638483 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec40a710b0 msgr2=0x55ec40a78240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:52.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.744+0000 7fc817fff640 1 --2- 172.21.15.87:0/4135638483 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec40a710b0 0x55ec40a78240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.744+0000 7fc817fff640 1 -- 172.21.15.87:0/4135638483 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc80800d8e0 con 0x55ec40a70790 2024-09-13T17:19:52.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.744+0000 7fc817fff640 1 --2- 172.21.15.87:0/4135638483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ec40a70790 0x55ec40a7af00 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fc808006010 tx=0x7fc8080056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cbfce5f760debd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:52.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.744+0000 7fc7f77fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:19:52.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.745+0000 7fc7f77fe640 1 -- 172.21.15.87:0/4135638483 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc808020070 con 0x55ec40a70790 2024-09-13T17:19:52.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.745+0000 7fc7f77fe640 1 -- 172.21.15.87:0/4135638483 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fc808012d10 con 0x55ec40a70790 2024-09-13T17:19:52.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.745+0000 7fc82164e740 1 -- 172.21.15.87:0/4135638483 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ec409fdb80 con 0x55ec40a70790 2024-09-13T17:19:52.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.745+0000 7fc7f77fe640 1 -- 172.21.15.87:0/4135638483 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc808011440 con 0x55ec40a70790 2024-09-13T17:19:52.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.745+0000 7fc82164e740 10 client.17307 fetch_fsmap learned FSMap version 36 2024-09-13T17:19:52.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.745+0000 7fc82164e740 1 -- 172.21.15.87:0/4135638483 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55ec409d23c0 con 0x55ec40a70790 2024-09-13T17:19:52.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.745+0000 7fc7f77fe640 1 -- 172.21.15.87:0/4135638483 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55ec409fdb80 con 0x55ec40a70790 2024-09-13T17:19:52.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.745+0000 7fc7f77fe640 1 -- 172.21.15.87:0/4135638483 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc80801b8e0 con 0x55ec40a70790 2024-09-13T17:19:52.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.745+0000 7fc82164e740 10 client.17307 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:19:52.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.745+0000 7fc82164e740 10 client.17307 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:19:52.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.745+0000 7fc82164e740 20 client.17307 populate_metadata read hostname 'smithi087' 2024-09-13T17:19:52.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.745+0000 7fc82164e740 1 --2- 172.21.15.87:0/4135638483 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55ec40a8b1e0 0x55ec40a8d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.745+0000 7fc82164e740 4 client.17307 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:19:52.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.745+0000 7fc82164e740 1 -- 172.21.15.87:0/4135638483 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ec409c61f0 con 0x55ec40a8b1e0 2024-09-13T17:19:52.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.746+0000 7fc8177fe640 1 --2- 172.21.15.87:0/4135638483 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55ec40a8b1e0 0x55ec40a8d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.746+0000 7fc8177fe640 1 --2- 172.21.15.87:0/4135638483 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55ec40a8b1e0 0x55ec40a8d5d0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd041172381d71ac server_cookie=93b245676b0e6976 in_seq=0 out_seq=0 2024-09-13T17:19:52.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.746+0000 7fc7f77fe640 10 client.17307 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:52.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.746+0000 7fc7f77fe640 1 -- 172.21.15.87:0/4135638483 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55ec409c61f0 con 0x55ec40a8b1e0 2024-09-13T17:19:52.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.746+0000 7fc7f77fe640 10 client.17307 handle_command_reply: tid=0 2024-09-13T17:19:52.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.746+0000 7fc82164e740 1 client.17307 shutdown 2024-09-13T17:19:52.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.747+0000 7fc82164e740 1 -- 172.21.15.87:0/4135638483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ec40a70790 msgr2=0x55ec40a7af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:52.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.747+0000 7fc82164e740 1 --2- 172.21.15.87:0/4135638483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ec40a70790 0x55ec40a7af00 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fc808006010 tx=0x7fc8080056d0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.747+0000 7fc82164e740 1 -- 172.21.15.87:0/4135638483 shutdown_connections 2024-09-13T17:19:52.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.747+0000 7fc82164e740 1 --2- 172.21.15.87:0/4135638483 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55ec40a8b1e0 0x55ec40a8d5d0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.747+0000 7fc82164e740 1 --2- 172.21.15.87:0/4135638483 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ec40a7b950 0x55ec40a78780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.747+0000 7fc82164e740 1 --2- 172.21.15.87:0/4135638483 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec40a710b0 0x55ec40a78240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.747+0000 7fc82164e740 1 --2- 172.21.15.87:0/4135638483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ec40a70790 0x55ec40a7af00 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.747+0000 7fc82164e740 1 -- 172.21.15.87:0/4135638483 >> 172.21.15.87:0/4135638483 conn(0x55ec40a6cd00 msgr2=0x55ec40a6beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:52.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.747+0000 7fc7f77fe640 0 client.17307 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:52.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.747+0000 7fc82164e740 1 -- 172.21.15.87:0/4135638483 shutdown_connections 2024-09-13T17:19:52.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.747+0000 7fc82164e740 1 -- 172.21.15.87:0/4135638483 wait complete. 2024-09-13T17:19:52.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.747+0000 7fc82164e740 20 client.17307 trim_cache size 0 max 16384 2024-09-13T17:19:52.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.758+0000 7fc82164e740 1 Processor -- start 2024-09-13T17:19:52.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.758+0000 7fc82164e740 1 -- start start 2024-09-13T17:19:52.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.758+0000 7fc82164e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec40a70790 0x55ec40a6c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.758+0000 7fc82164e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ec40a710b0 0x55ec40a91ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.758+0000 7fc82164e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ec40a7b950 0x55ec40a82610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.758+0000 7fc82164e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec40a71620 con 0x55ec40a710b0 2024-09-13T17:19:52.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.758+0000 7fc82164e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec40a673b0 con 0x55ec40a70790 2024-09-13T17:19:52.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.758+0000 7fc82164e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec40a6dc60 con 0x55ec40a7b950 2024-09-13T17:19:52.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.758+0000 7fc8177fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ec40a710b0 0x55ec40a91ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.758+0000 7fc8177fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ec40a710b0 0x55ec40a91ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48466/0 (socket says 172.21.15.87:48466) 2024-09-13T17:19:52.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.758+0000 7fc8177fe640 1 -- 172.21.15.87:0/2973300352 learned_addr learned my addr 172.21.15.87:0/2973300352 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:52.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.758+0000 7fc81cdf0640 1 --2- 172.21.15.87:0/2973300352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ec40a7b950 0x55ec40a82610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.758+0000 7fc8177fe640 1 -- 172.21.15.87:0/2973300352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ec40a7b950 msgr2=0x55ec40a82610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:52.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.758+0000 7fc8177fe640 1 --2- 172.21.15.87:0/2973300352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ec40a7b950 0x55ec40a82610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.758+0000 7fc817fff640 1 --2- 172.21.15.87:0/2973300352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec40a70790 0x55ec40a6c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.758+0000 7fc8177fe640 1 -- 172.21.15.87:0/2973300352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec40a70790 msgr2=0x55ec40a6c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:52.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.758+0000 7fc8177fe640 1 --2- 172.21.15.87:0/2973300352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec40a70790 0x55ec40a6c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.758+0000 7fc8177fe640 1 -- 172.21.15.87:0/2973300352 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec40974770 con 0x55ec40a710b0 2024-09-13T17:19:52.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.758+0000 7fc81cdf0640 1 --2- 172.21.15.87:0/2973300352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ec40a7b950 0x55ec40a82610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:52.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.758+0000 7fc817fff640 1 --2- 172.21.15.87:0/2973300352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec40a70790 0x55ec40a6c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:52.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.758+0000 7fc8177fe640 1 --2- 172.21.15.87:0/2973300352 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ec40a710b0 0x55ec40a91ed0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fc800000c00 tx=0x7fc800049000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a095166d3594f46a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:52.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.758+0000 7fc80effd640 1 -- 172.21.15.87:0/2973300352 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80003f070 con 0x55ec40a710b0 2024-09-13T17:19:52.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.758+0000 7fc80effd640 1 -- 172.21.15.87:0/2973300352 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc8000c8040 con 0x55ec40a710b0 2024-09-13T17:19:52.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.758+0000 7fc80effd640 1 -- 172.21.15.87:0/2973300352 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc800003d80 con 0x55ec40a710b0 2024-09-13T17:19:52.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.759+0000 7fc82164e740 1 -- 172.21.15.87:0/2973300352 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ec40a710b0 msgr2=0x55ec40a91ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:52.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.759+0000 7fc82164e740 1 --2- 172.21.15.87:0/2973300352 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ec40a710b0 0x55ec40a91ed0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fc800000c00 tx=0x7fc800049000 comp rx=0 tx=0).stop 2024-09-13T17:19:52.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.759+0000 7fc82164e740 1 -- 172.21.15.87:0/2973300352 shutdown_connections 2024-09-13T17:19:52.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.759+0000 7fc82164e740 1 --2- 172.21.15.87:0/2973300352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ec40a7b950 0x55ec40a82610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.759+0000 7fc82164e740 1 --2- 172.21.15.87:0/2973300352 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ec40a710b0 0x55ec40a91ed0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.759+0000 7fc82164e740 1 --2- 172.21.15.87:0/2973300352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec40a70790 0x55ec40a6c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.759+0000 7fc82164e740 1 -- 172.21.15.87:0/2973300352 >> 172.21.15.87:0/2973300352 conn(0x55ec40a6cd00 msgr2=0x55ec40a870d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:52.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.759+0000 7fc82164e740 1 -- 172.21.15.87:0/2973300352 shutdown_connections 2024-09-13T17:19:52.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.759+0000 7fc82164e740 1 -- 172.21.15.87:0/2973300352 wait complete. 2024-09-13T17:19:52.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.759+0000 7fc82164e740 1 -- start start 2024-09-13T17:19:52.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.760+0000 7fc82164e740 1 Processor -- start 2024-09-13T17:19:52.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.760+0000 7fc82164e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ec40a70790 0x55ec40a7e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.760+0000 7fc82164e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec40a710b0 0x55ec40a7eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.760+0000 7fc82164e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ec40a7b950 0x55ec40ae0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.760+0000 7fc82164e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec40a7f2c0 con 0x55ec40a7b950 2024-09-13T17:19:52.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.760+0000 7fc82164e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec40a7f430 con 0x55ec40a710b0 2024-09-13T17:19:52.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.760+0000 7fc82164e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec40ae0b80 con 0x55ec40a70790 2024-09-13T17:19:52.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.760+0000 7fc82164e740 10 client.0 _ll_register_callbacks cb 0x7fc80800d440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:52.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.760+0000 7fc81cdf0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ec40a7b950 0x55ec40ae0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.760+0000 7fc817fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ec40a70790 0x55ec40a7e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.760+0000 7fc8177fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec40a710b0 0x55ec40a7eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.760+0000 7fc817fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ec40a70790 0x55ec40a7e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:49954/0 (socket says 172.21.15.87:49954) 2024-09-13T17:19:52.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.760+0000 7fc81cdf0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ec40a7b950 0x55ec40ae0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48482/0 (socket says 172.21.15.87:48482) 2024-09-13T17:19:52.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.760+0000 7fc817fff640 1 -- 172.21.15.87:0/3077654212 learned_addr learned my addr 172.21.15.87:0/3077654212 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:52.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.760+0000 7fc817fff640 1 -- 172.21.15.87:0/3077654212 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec40a710b0 msgr2=0x55ec40a7eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:52.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.760+0000 7fc817fff640 1 --2- 172.21.15.87:0/3077654212 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec40a710b0 0x55ec40a7eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.760+0000 7fc817fff640 1 -- 172.21.15.87:0/3077654212 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ec40a7b950 msgr2=0x55ec40ae0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:52.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.760+0000 7fc817fff640 1 --2- 172.21.15.87:0/3077654212 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ec40a7b950 0x55ec40ae0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.760+0000 7fc817fff640 1 -- 172.21.15.87:0/3077654212 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8181a32a0 con 0x55ec40a70790 2024-09-13T17:19:52.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.760+0000 7fc81cdf0640 1 --2- 172.21.15.87:0/3077654212 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ec40a7b950 0x55ec40ae0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:19:52.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.760+0000 7fc817fff640 1 --2- 172.21.15.87:0/3077654212 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ec40a70790 0x55ec40a7e5f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc8080059d0 tx=0x7fc80800d520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60302fd3f668b88b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:52.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.760+0000 7fc7f77fe640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-09-13T17:19:52.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.761+0000 7fc7f77fe640 1 -- 172.21.15.87:0/3077654212 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc808020070 con 0x55ec40a70790 2024-09-13T17:19:52.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.761+0000 7fc82164e740 1 -- 172.21.15.87:0/3077654212 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc808011a50 con 0x55ec40a70790 2024-09-13T17:19:52.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.761+0000 7fc7f77fe640 1 -- 172.21.15.87:0/3077654212 <== mon.1 v2:172.21.15.149:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fc808000e40 con 0x55ec40a70790 2024-09-13T17:19:52.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.761+0000 7fc7f77fe640 1 -- 172.21.15.87:0/3077654212 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc808011dd0 con 0x55ec40a70790 2024-09-13T17:19:52.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.761+0000 7fc82164e740 10 client.26395 fetch_fsmap learned FSMap version 36 2024-09-13T17:19:52.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.761+0000 7fc82164e740 1 -- 172.21.15.87:0/3077654212 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55ec40999e80 con 0x55ec40a70790 2024-09-13T17:19:52.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.761+0000 7fc7f77fe640 1 -- 172.21.15.87:0/3077654212 <== mon.1 v2:172.21.15.149:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc808011a50 con 0x55ec40a70790 2024-09-13T17:19:52.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.761+0000 7fc7f77fe640 1 -- 172.21.15.87:0/3077654212 <== mon.1 v2:172.21.15.149:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc80802e040 con 0x55ec40a70790 2024-09-13T17:19:52.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.761+0000 7fc82164e740 10 client.26395 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:19:52.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.761+0000 7fc82164e740 10 client.26395 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:19:52.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.761+0000 7fc82164e740 20 client.26395 populate_metadata read hostname 'smithi087' 2024-09-13T17:19:52.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.761+0000 7fc82164e740 1 --2- 172.21.15.87:0/3077654212 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55ec40ae1f70 0x55ec40ae4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:52.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.761+0000 7fc82164e740 4 client.26395 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:19:52.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.761+0000 7fc82164e740 1 -- 172.21.15.87:0/3077654212 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ec406c74e0 con 0x55ec40ae1f70 2024-09-13T17:19:52.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.761+0000 7fc8177fe640 1 --2- 172.21.15.87:0/3077654212 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55ec40ae1f70 0x55ec40ae4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:52.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.762+0000 7fc7f77fe640 10 client.26395 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:52.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.762+0000 7fc8177fe640 1 --2- 172.21.15.87:0/3077654212 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55ec40ae1f70 0x55ec40ae4390 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f64f8a55e6d4441 server_cookie=f451d02d7d314266 in_seq=0 out_seq=0 2024-09-13T17:19:52.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.762+0000 7fc7f77fe640 1 -- 172.21.15.87:0/3077654212 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ec406c74e0 con 0x55ec40ae1f70 2024-09-13T17:19:52.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.762+0000 7fc7f77fe640 10 client.26395 handle_command_reply: tid=0 2024-09-13T17:19:52.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.762+0000 7fc82164e740 1 client.26395 shutdown 2024-09-13T17:19:52.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.762+0000 7fc82164e740 1 -- 172.21.15.87:0/3077654212 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ec40a70790 msgr2=0x55ec40a7e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:52.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.762+0000 7fc82164e740 1 --2- 172.21.15.87:0/3077654212 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ec40a70790 0x55ec40a7e5f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc8080059d0 tx=0x7fc80800d520 comp rx=0 tx=0).stop 2024-09-13T17:19:52.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.762+0000 7fc82164e740 1 -- 172.21.15.87:0/3077654212 shutdown_connections 2024-09-13T17:19:52.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.762+0000 7fc82164e740 1 --2- 172.21.15.87:0/3077654212 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55ec40ae1f70 0x55ec40ae4390 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.762+0000 7fc82164e740 1 --2- 172.21.15.87:0/3077654212 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ec40a7b950 0x55ec40ae0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.762+0000 7fc7f77fe640 0 client.26395 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:52.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.762+0000 7fc82164e740 1 --2- 172.21.15.87:0/3077654212 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec40a710b0 0x55ec40a7eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.762+0000 7fc82164e740 1 --2- 172.21.15.87:0/3077654212 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ec40a70790 0x55ec40a7e5f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.762+0000 7fc82164e740 1 -- 172.21.15.87:0/3077654212 >> 172.21.15.87:0/3077654212 conn(0x55ec40a6cd00 msgr2=0x55ec40a870d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:52.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.762+0000 7fc82164e740 1 -- 172.21.15.87:0/3077654212 shutdown_connections 2024-09-13T17:19:52.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.762+0000 7fc82164e740 1 -- 172.21.15.87:0/3077654212 wait complete. 2024-09-13T17:19:52.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.762+0000 7fc82164e740 20 client.26395 trim_cache size 0 max 16384 2024-09-13T17:19:52.771 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:19:52.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.763+0000 7fc81e853640 1 -- 172.21.15.87:0/1591291181 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc8040a1280 msgr2=0x7fc8040a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:52.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.763+0000 7fc81e853640 1 --2- 172.21.15.87:0/1591291181 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc8040a1280 0x7fc8040a3740 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc810005c40 tx=0x7fc810009590 comp rx=0 tx=0).stop 2024-09-13T17:19:52.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.763+0000 7fc81e853640 1 -- 172.21.15.87:0/1591291181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc818103fb0 msgr2=0x7fc818197690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:52.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.763+0000 7fc81e853640 1 --2- 172.21.15.87:0/1591291181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc818103fb0 0x7fc818197690 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fc800009900 tx=0x7fc8000042f0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.763+0000 7fc81e853640 1 -- 172.21.15.87:0/1591291181 shutdown_connections 2024-09-13T17:19:52.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.763+0000 7fc81e853640 1 --2- 172.21.15.87:0/1591291181 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc818197bd0 0x7fc8181a21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.763+0000 7fc81e853640 1 --2- 172.21.15.87:0/1591291181 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc8040a1280 0x7fc8040a3740 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.763+0000 7fc81e853640 1 --2- 172.21.15.87:0/1591291181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc818103fb0 0x7fc818197690 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.763+0000 7fc81e853640 1 --2- 172.21.15.87:0/1591291181 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8180fee60 0x7fc818197150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:52.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.763+0000 7fc81e853640 1 -- 172.21.15.87:0/1591291181 >> 172.21.15.87:0/1591291181 conn(0x7fc818075c60 msgr2=0x7fc818102320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:52.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.763+0000 7fc81e853640 1 -- 172.21.15.87:0/1591291181 shutdown_connections 2024-09-13T17:19:52.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:52.763+0000 7fc81e853640 1 -- 172.21.15.87:0/1591291181 wait complete. 2024-09-13T17:19:52.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:52 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/258725466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:19:52.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:52 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/258725466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:19:53.775 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-13T17:19:53.775 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-09-13T17:19:53.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:53 smithi149 ceph-mon[35496]: pgmap v185: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:19:53.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:53 smithi118 ceph-mon[34374]: pgmap v185: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:19:53.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.888+0000 7fb2fbcd0640 1 -- 172.21.15.87:0/2013389587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2f41050a0 msgr2=0x7fb2f410cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:53.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.888+0000 7fb2fbcd0640 1 --2- 172.21.15.87:0/2013389587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2f41050a0 0x7fb2f410cbf0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec009cd0 tx=0x7fb2ec02a8e0 comp rx=0 tx=0).stop 2024-09-13T17:19:53.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.888+0000 7fb2fbcd0640 1 -- 172.21.15.87:0/2013389587 shutdown_connections 2024-09-13T17:19:53.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.888+0000 7fb2fbcd0640 1 --2- 172.21.15.87:0/2013389587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2f41050a0 0x7fb2f410cbf0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:53.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.888+0000 7fb2fbcd0640 1 --2- 172.21.15.87:0/2013389587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2f4100900 0x7fb2f4104940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:53.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.888+0000 7fb2fbcd0640 1 --2- 172.21.15.87:0/2013389587 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2f40fff50 0x7fb2f4100330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:53.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.888+0000 7fb2fbcd0640 1 -- 172.21.15.87:0/2013389587 >> 172.21.15.87:0/2013389587 conn(0x7fb2f40fb9e0 msgr2=0x7fb2f40fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:53.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.888+0000 7fb2fbcd0640 1 -- 172.21.15.87:0/2013389587 shutdown_connections 2024-09-13T17:19:53.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.888+0000 7fb2fbcd0640 1 -- 172.21.15.87:0/2013389587 wait complete. 2024-09-13T17:19:53.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.889+0000 7fb2fbcd0640 1 Processor -- start 2024-09-13T17:19:53.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.889+0000 7fb2fbcd0640 1 -- start start 2024-09-13T17:19:53.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.889+0000 7fb2fbcd0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2f40fff50 0x7fb2f4196320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:53.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.889+0000 7fb2fbcd0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2f41050a0 0x7fb2f4196860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:53.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.889+0000 7fb2fbcd0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2f419ac50 0x7fb2f419b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:53.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.889+0000 7fb2fbcd0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f419b640 con 0x7fb2f41050a0 2024-09-13T17:19:53.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.889+0000 7fb2fbcd0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f419b7b0 con 0x7fb2f419ac50 2024-09-13T17:19:53.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.889+0000 7fb2fbcd0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f419b920 con 0x7fb2f40fff50 2024-09-13T17:19:53.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.889+0000 7fb2f926b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2f41050a0 0x7fb2f4196860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:53.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.889+0000 7fb2f926b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2f41050a0 0x7fb2f4196860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48494/0 (socket says 172.21.15.87:48494) 2024-09-13T17:19:53.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.889+0000 7fb2f926b640 1 -- 172.21.15.87:0/2218794419 learned_addr learned my addr 172.21.15.87:0/2218794419 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:53.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.889+0000 7fb2f9a6c640 1 --2- 172.21.15.87:0/2218794419 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2f40fff50 0x7fb2f4196320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:53.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.889+0000 7fb2fa26d640 1 --2- 172.21.15.87:0/2218794419 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2f419ac50 0x7fb2f419b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:53.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.889+0000 7fb2f926b640 1 -- 172.21.15.87:0/2218794419 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2f40fff50 msgr2=0x7fb2f4196320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:53.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.889+0000 7fb2f926b640 1 --2- 172.21.15.87:0/2218794419 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2f40fff50 0x7fb2f4196320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:53.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.889+0000 7fb2f926b640 1 -- 172.21.15.87:0/2218794419 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2f419ac50 msgr2=0x7fb2f419b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:53.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.889+0000 7fb2f926b640 1 --2- 172.21.15.87:0/2218794419 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2f419ac50 0x7fb2f419b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:53.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.889+0000 7fb2f926b640 1 -- 172.21.15.87:0/2218794419 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ec009900 con 0x7fb2f41050a0 2024-09-13T17:19:53.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.889+0000 7fb2fa26d640 1 --2- 172.21.15.87:0/2218794419 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2f419ac50 0x7fb2f419b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:53.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.890+0000 7fb2f926b640 1 --2- 172.21.15.87:0/2218794419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2f41050a0 0x7fb2f4196860 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fb2e800d770 tx=0x7fb2e800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:53.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.890+0000 7fb2e6ffd640 1 -- 172.21.15.87:0/2218794419 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e8009c30 con 0x7fb2f41050a0 2024-09-13T17:19:53.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.890+0000 7fb2e6ffd640 1 -- 172.21.15.87:0/2218794419 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb2e800de80 con 0x7fb2f41050a0 2024-09-13T17:19:53.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.890+0000 7fb2e6ffd640 1 -- 172.21.15.87:0/2218794419 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e800f600 con 0x7fb2f41050a0 2024-09-13T17:19:53.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.890+0000 7fb2fbcd0640 1 -- 172.21.15.87:0/2218794419 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f41a2f00 con 0x7fb2f41050a0 2024-09-13T17:19:53.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.890+0000 7fb2fbcd0640 1 -- 172.21.15.87:0/2218794419 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f41a32d0 con 0x7fb2f41050a0 2024-09-13T17:19:53.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.892+0000 7fb2e6ffd640 1 -- 172.21.15.87:0/2218794419 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fb2e8010460 con 0x7fb2f41050a0 2024-09-13T17:19:53.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.892+0000 7fb2fe9f2740 1 Processor -- start 2024-09-13T17:19:53.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.893+0000 7fb2fe9f2740 1 -- start start 2024-09-13T17:19:53.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.893+0000 7fb2fe9f2740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c375a4c7c0 0x55c375a4cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:53.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.893+0000 7fb2fe9f2740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c375a4d0e0 0x55c375a57440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:53.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.893+0000 7fb2fe9f2740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c375a57980 0x55c375a59d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:53.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.893+0000 7fb2fe9f2740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3759b7c60 con 0x55c375a4c7c0 2024-09-13T17:19:53.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.893+0000 7fb2fe9f2740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3759b53f0 con 0x55c375a57980 2024-09-13T17:19:53.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.893+0000 7fb2fe9f2740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3759b0ce0 con 0x55c375a4d0e0 2024-09-13T17:19:53.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.893+0000 7fb2e6ffd640 1 --2- 172.21.15.87:0/2218794419 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb2e00a1200 0x7fb2e00a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:53.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.893+0000 7fb2fa26d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c375a4c7c0 0x55c375a4cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:53.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.893+0000 7fb2fa26d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c375a4c7c0 0x55c375a4cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48496/0 (socket says 172.21.15.87:48496) 2024-09-13T17:19:53.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.893+0000 7fb2fa26d640 1 -- 172.21.15.87:0/129057244 learned_addr learned my addr 172.21.15.87:0/129057244 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:53.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.893+0000 7fb2fa26d640 1 --2- 172.21.15.87:0/2218794419 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb2e00a1200 0x7fb2e00a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:53.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.893+0000 7fb2f926b640 1 --2- 172.21.15.87:0/129057244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c375a57980 0x55c375a59d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:53.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.893+0000 7fb2f9a6c640 1 --2- 172.21.15.87:0/129057244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c375a4d0e0 0x55c375a57440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:53.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.893+0000 7fb2e6ffd640 1 -- 172.21.15.87:0/2218794419 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fb2e80cceb0 con 0x7fb2f41050a0 2024-09-13T17:19:53.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.893+0000 7fb2fa26d640 1 -- 172.21.15.87:0/129057244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c375a4d0e0 msgr2=0x55c375a57440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:53.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.893+0000 7fb2fa26d640 1 --2- 172.21.15.87:0/129057244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c375a4d0e0 0x55c375a57440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:53.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.893+0000 7fb2fa26d640 1 -- 172.21.15.87:0/129057244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c375a57980 msgr2=0x55c375a59d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:53.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.893+0000 7fb2fa26d640 1 --2- 172.21.15.87:0/129057244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c375a57980 0x55c375a59d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:53.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.894+0000 7fb2fa26d640 1 -- 172.21.15.87:0/129057244 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c37596c970 con 0x55c375a4c7c0 2024-09-13T17:19:53.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.894+0000 7fb2f9a6c640 1 --2- 172.21.15.87:0/129057244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c375a4d0e0 0x55c375a57440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:53.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.894+0000 7fb2f926b640 1 --2- 172.21.15.87:0/129057244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c375a57980 0x55c375a59d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:53.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.894+0000 7fb2fa26d640 1 --2- 172.21.15.87:0/129057244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c375a4c7c0 0x55c375a4cba0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec004af0 tx=0x7fb2ec0306a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2adb3f5694f17e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:53.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.894+0000 7fb2fa26d640 1 --2- 172.21.15.87:0/2218794419 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb2e00a1200 0x7fb2e00a36c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec009880 tx=0x7fb2ec047000 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:53.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.894+0000 7fb2dffff640 1 -- 172.21.15.87:0/129057244 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec031d00 con 0x55c375a4c7c0 2024-09-13T17:19:53.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.894+0000 7fb2dffff640 1 -- 172.21.15.87:0/129057244 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb2ec045040 con 0x55c375a4c7c0 2024-09-13T17:19:53.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.894+0000 7fb2dffff640 1 -- 172.21.15.87:0/129057244 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec049430 con 0x55c375a4c7c0 2024-09-13T17:19:53.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.895+0000 7fb2fe9f2740 1 -- 172.21.15.87:0/129057244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c375a4c7c0 msgr2=0x55c375a4cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:53.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.895+0000 7fb2fe9f2740 1 --2- 172.21.15.87:0/129057244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c375a4c7c0 0x55c375a4cba0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec004af0 tx=0x7fb2ec0306a0 comp rx=0 tx=0).stop 2024-09-13T17:19:53.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.895+0000 7fb2fe9f2740 1 -- 172.21.15.87:0/129057244 shutdown_connections 2024-09-13T17:19:53.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.895+0000 7fb2fe9f2740 1 --2- 172.21.15.87:0/129057244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c375a57980 0x55c375a59d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:53.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.895+0000 7fb2fe9f2740 1 --2- 172.21.15.87:0/129057244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c375a4d0e0 0x55c375a57440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:53.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.895+0000 7fb2fe9f2740 1 --2- 172.21.15.87:0/129057244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c375a4c7c0 0x55c375a4cba0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:53.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.895+0000 7fb2fe9f2740 1 -- 172.21.15.87:0/129057244 >> 172.21.15.87:0/129057244 conn(0x55c375a48d50 msgr2=0x55c375a49130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:53.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.895+0000 7fb2fe9f2740 1 -- 172.21.15.87:0/129057244 shutdown_connections 2024-09-13T17:19:53.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.895+0000 7fb2fe9f2740 1 -- 172.21.15.87:0/129057244 wait complete. 2024-09-13T17:19:53.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.895+0000 7fb2fe9f2740 1 -- start start 2024-09-13T17:19:53.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.895+0000 7fb2fe9f2740 1 Processor -- start 2024-09-13T17:19:53.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.896+0000 7fb2fe9f2740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c375a4c7c0 0x55c375a573c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:53.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.896+0000 7fb2fe9f2740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c375a4d0e0 0x55c375a54690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:53.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.896+0000 7fb2fe9f2740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c375a57980 0x55c375a54e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:53.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.896+0000 7fb2fe9f2740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c37596ef80 con 0x55c375a4d0e0 2024-09-13T17:19:53.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.896+0000 7fb2fe9f2740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c37596ec20 con 0x55c375a4c7c0 2024-09-13T17:19:53.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.896+0000 7fb2fe9f2740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c37593bab0 con 0x55c375a57980 2024-09-13T17:19:53.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.896+0000 7fb2fe9f2740 10 client.0 _ll_register_callbacks cb 0x55c3759aa350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:53.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.896+0000 7fb2f926b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c375a4d0e0 0x55c375a54690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:53.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.896+0000 7fb2f926b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c375a4d0e0 0x55c375a54690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48504/0 (socket says 172.21.15.87:48504) 2024-09-13T17:19:53.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.896+0000 7fb2f926b640 1 -- 172.21.15.87:0/1457320420 learned_addr learned my addr 172.21.15.87:0/1457320420 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:53.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.896+0000 7fb2f9a6c640 1 --2- 172.21.15.87:0/1457320420 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c375a4c7c0 0x55c375a573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:53.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.896+0000 7fb2fa26d640 1 --2- 172.21.15.87:0/1457320420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c375a57980 0x55c375a54e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:53.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.896+0000 7fb2f926b640 1 -- 172.21.15.87:0/1457320420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c375a57980 msgr2=0x55c375a54e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:53.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.896+0000 7fb2f926b640 1 --2- 172.21.15.87:0/1457320420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c375a57980 0x55c375a54e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:53.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.896+0000 7fb2f926b640 1 -- 172.21.15.87:0/1457320420 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c375a4c7c0 msgr2=0x55c375a573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:53.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.896+0000 7fb2f926b640 1 --2- 172.21.15.87:0/1457320420 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c375a4c7c0 0x55c375a573c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:53.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.896+0000 7fb2f926b640 1 -- 172.21.15.87:0/1457320420 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f410d430 con 0x55c375a4d0e0 2024-09-13T17:19:53.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.896+0000 7fb2f9a6c640 1 --2- 172.21.15.87:0/1457320420 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c375a4c7c0 0x55c375a573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:19:53.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.896+0000 7fb2f926b640 1 --2- 172.21.15.87:0/1457320420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c375a4d0e0 0x55c375a54690 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8099910 tx=0x7fb2e8021850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e1bb802a35be74 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:53.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.896+0000 7fb2dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:19:53.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.896+0000 7fb2dd7fa640 1 -- 172.21.15.87:0/1457320420 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e809a310 con 0x55c375a4d0e0 2024-09-13T17:19:53.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.896+0000 7fb2dd7fa640 1 -- 172.21.15.87:0/1457320420 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fb2e8099c10 con 0x55c375a4d0e0 2024-09-13T17:19:53.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.896+0000 7fb2fe9f2740 1 -- 172.21.15.87:0/1457320420 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c3756a4590 con 0x55c375a4d0e0 2024-09-13T17:19:53.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.897+0000 7fb2dd7fa640 1 -- 172.21.15.87:0/1457320420 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2e809da40 con 0x55c375a4d0e0 2024-09-13T17:19:53.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.897+0000 7fb2fe9f2740 10 client.17325 fetch_fsmap learned FSMap version 36 2024-09-13T17:19:53.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.897+0000 7fb2fe9f2740 1 -- 172.21.15.87:0/1457320420 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55c3759af360 con 0x55c375a4d0e0 2024-09-13T17:19:53.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.897+0000 7fb2dd7fa640 1 -- 172.21.15.87:0/1457320420 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55c3756a4590 con 0x55c375a4d0e0 2024-09-13T17:19:53.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.897+0000 7fb2dd7fa640 1 -- 172.21.15.87:0/1457320420 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fb2e8099100 con 0x55c375a4d0e0 2024-09-13T17:19:53.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.897+0000 7fb2fe9f2740 10 client.17325 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:19:53.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.897+0000 7fb2fe9f2740 10 client.17325 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:19:53.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.897+0000 7fb2fe9f2740 20 client.17325 populate_metadata read hostname 'smithi087' 2024-09-13T17:19:53.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.897+0000 7fb2fe9f2740 1 --2- 172.21.15.87:0/1457320420 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55c375a676e0 0x55c375a69ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:53.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.897+0000 7fb2fe9f2740 4 client.17325 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:19:53.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.897+0000 7fb2fe9f2740 1 -- 172.21.15.87:0/1457320420 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c3756b5860 con 0x55c375a676e0 2024-09-13T17:19:53.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.897+0000 7fb2f9a6c640 1 --2- 172.21.15.87:0/1457320420 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55c375a676e0 0x55c375a69ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:53.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.898+0000 7fb2dd7fa640 10 client.17325 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:53.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.898+0000 7fb2f9a6c640 1 --2- 172.21.15.87:0/1457320420 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55c375a676e0 0x55c375a69ad0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=307422e1ef6c7054 server_cookie=be4cb240c1659a2e in_seq=0 out_seq=0 2024-09-13T17:19:53.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.898+0000 7fb2dd7fa640 1 -- 172.21.15.87:0/1457320420 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55c3756b5860 con 0x55c375a676e0 2024-09-13T17:19:53.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.898+0000 7fb2dd7fa640 10 client.17325 handle_command_reply: tid=0 2024-09-13T17:19:53.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.898+0000 7fb2fe9f2740 1 client.17325 shutdown 2024-09-13T17:19:53.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.898+0000 7fb2fe9f2740 1 -- 172.21.15.87:0/1457320420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c375a4d0e0 msgr2=0x55c375a54690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:53.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.898+0000 7fb2fe9f2740 1 --2- 172.21.15.87:0/1457320420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c375a4d0e0 0x55c375a54690 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8099910 tx=0x7fb2e8021850 comp rx=0 tx=0).stop 2024-09-13T17:19:53.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.899+0000 7fb2fe9f2740 1 -- 172.21.15.87:0/1457320420 shutdown_connections 2024-09-13T17:19:53.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.899+0000 7fb2fe9f2740 1 --2- 172.21.15.87:0/1457320420 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55c375a676e0 0x55c375a69ad0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:53.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.899+0000 7fb2fe9f2740 1 --2- 172.21.15.87:0/1457320420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c375a57980 0x55c375a54e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:53.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.899+0000 7fb2fe9f2740 1 --2- 172.21.15.87:0/1457320420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c375a4d0e0 0x55c375a54690 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:53.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.899+0000 7fb2fe9f2740 1 --2- 172.21.15.87:0/1457320420 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c375a4c7c0 0x55c375a573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:53.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.899+0000 7fb2dd7fa640 0 client.17325 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:53.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.899+0000 7fb2fe9f2740 1 -- 172.21.15.87:0/1457320420 >> 172.21.15.87:0/1457320420 conn(0x55c375a48d50 msgr2=0x55c375a4e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:53.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.899+0000 7fb2fe9f2740 1 -- 172.21.15.87:0/1457320420 shutdown_connections 2024-09-13T17:19:53.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.899+0000 7fb2fe9f2740 1 -- 172.21.15.87:0/1457320420 wait complete. 2024-09-13T17:19:53.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.899+0000 7fb2fe9f2740 20 client.17325 trim_cache size 0 max 16384 2024-09-13T17:19:53.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.913+0000 7fb2fe9f2740 1 Processor -- start 2024-09-13T17:19:53.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.913+0000 7fb2fe9f2740 1 -- start start 2024-09-13T17:19:53.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.913+0000 7fb2fe9f2740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c375a4c7c0 0x55c375a5ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:53.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.913+0000 7fb2fe9f2740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c375a4d0e0 0x55c375a56ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:53.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.913+0000 7fb2fe9f2740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c375a57980 0x55c375a57410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:53.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.913+0000 7fb2fe9f2740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3756a4590 con 0x55c375a4c7c0 2024-09-13T17:19:53.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.913+0000 7fb2fe9f2740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c375a49e00 con 0x55c375a4d0e0 2024-09-13T17:19:53.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.913+0000 7fb2fe9f2740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c375a4dd20 con 0x55c375a57980 2024-09-13T17:19:53.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.913+0000 7fb2f9a6c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c375a4c7c0 0x55c375a5ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:53.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.913+0000 7fb2f9a6c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c375a4c7c0 0x55c375a5ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48514/0 (socket says 172.21.15.87:48514) 2024-09-13T17:19:53.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.913+0000 7fb2f9a6c640 1 -- 172.21.15.87:0/1565517380 learned_addr learned my addr 172.21.15.87:0/1565517380 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:53.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.913+0000 7fb2f926b640 1 --2- 172.21.15.87:0/1565517380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c375a4d0e0 0x55c375a56ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:53.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.913+0000 7fb2f9a6c640 1 -- 172.21.15.87:0/1565517380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c375a57980 msgr2=0x55c375a57410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:53.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.913+0000 7fb2f9a6c640 1 --2- 172.21.15.87:0/1565517380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c375a57980 0x55c375a57410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:53.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.913+0000 7fb2f9a6c640 1 -- 172.21.15.87:0/1565517380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c375a4d0e0 msgr2=0x55c375a56ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:53.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.913+0000 7fb2f9a6c640 1 --2- 172.21.15.87:0/1565517380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c375a4d0e0 0x55c375a56ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:53.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.913+0000 7fb2f9a6c640 1 -- 172.21.15.87:0/1565517380 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3759511c0 con 0x55c375a4c7c0 2024-09-13T17:19:53.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.913+0000 7fb2f926b640 1 --2- 172.21.15.87:0/1565517380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c375a4d0e0 0x55c375a56ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:19:53.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.913+0000 7fb2f9a6c640 1 --2- 172.21.15.87:0/1565517380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c375a4c7c0 0x55c375a5ea30 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x55c375a6a3f0 tx=0x7fb2f0005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05e8f355ea18ea9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:53.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.914+0000 7fb2e4ff9640 1 -- 172.21.15.87:0/1565517380 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f0017070 con 0x55c375a4c7c0 2024-09-13T17:19:53.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.914+0000 7fb2e4ff9640 1 -- 172.21.15.87:0/1565517380 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb2f0018040 con 0x55c375a4c7c0 2024-09-13T17:19:53.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.914+0000 7fb2e4ff9640 1 -- 172.21.15.87:0/1565517380 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f0021900 con 0x55c375a4c7c0 2024-09-13T17:19:53.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.914+0000 7fb2fe9f2740 1 -- 172.21.15.87:0/1565517380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c375a4c7c0 msgr2=0x55c375a5ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:53.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.914+0000 7fb2fe9f2740 1 --2- 172.21.15.87:0/1565517380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c375a4c7c0 0x55c375a5ea30 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x55c375a6a3f0 tx=0x7fb2f0005f30 comp rx=0 tx=0).stop 2024-09-13T17:19:53.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.914+0000 7fb2fe9f2740 1 -- 172.21.15.87:0/1565517380 shutdown_connections 2024-09-13T17:19:53.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.914+0000 7fb2fe9f2740 1 --2- 172.21.15.87:0/1565517380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c375a57980 0x55c375a57410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:53.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.914+0000 7fb2fe9f2740 1 --2- 172.21.15.87:0/1565517380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c375a4d0e0 0x55c375a56ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:53.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.914+0000 7fb2fe9f2740 1 --2- 172.21.15.87:0/1565517380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c375a4c7c0 0x55c375a5ea30 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:53.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.914+0000 7fb2fe9f2740 1 -- 172.21.15.87:0/1565517380 >> 172.21.15.87:0/1565517380 conn(0x55c375a48d50 msgr2=0x55c375a52f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:53.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.914+0000 7fb2fe9f2740 1 -- 172.21.15.87:0/1565517380 shutdown_connections 2024-09-13T17:19:53.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.914+0000 7fb2fe9f2740 1 -- 172.21.15.87:0/1565517380 wait complete. 2024-09-13T17:19:53.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.914+0000 7fb2fe9f2740 1 -- start start 2024-09-13T17:19:53.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.915+0000 7fb2fe9f2740 1 Processor -- start 2024-09-13T17:19:53.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.915+0000 7fb2fe9f2740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c375a4c7c0 0x55c375abb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:53.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.915+0000 7fb2fe9f2740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c375a4d0e0 0x55c375abbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:53.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.915+0000 7fb2fe9f2740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c375a57980 0x55c375ab6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:53.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.915+0000 7fb2fe9f2740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c375ab7280 con 0x55c375a57980 2024-09-13T17:19:53.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.915+0000 7fb2fe9f2740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c375ab73f0 con 0x55c375a4c7c0 2024-09-13T17:19:53.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.915+0000 7fb2fe9f2740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c375ab75b0 con 0x55c375a4d0e0 2024-09-13T17:19:53.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.915+0000 7fb2fe9f2740 10 client.0 _ll_register_callbacks cb 0x7fb2e800d6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:53.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.915+0000 7fb2fa26d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c375a57980 0x55c375ab6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:53.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.915+0000 7fb2fa26d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c375a57980 0x55c375ab6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48522/0 (socket says 172.21.15.87:48522) 2024-09-13T17:19:53.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.915+0000 7fb2fa26d640 1 -- 172.21.15.87:0/3877525730 learned_addr learned my addr 172.21.15.87:0/3877525730 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:53.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.915+0000 7fb2f9a6c640 1 --2- 172.21.15.87:0/3877525730 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c375a4c7c0 0x55c375abb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:53.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.915+0000 7fb2fa26d640 1 -- 172.21.15.87:0/3877525730 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c375a4d0e0 msgr2=0x55c375abbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:53.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.915+0000 7fb2fa26d640 1 --2- 172.21.15.87:0/3877525730 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c375a4d0e0 0x55c375abbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:53.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.915+0000 7fb2fa26d640 1 -- 172.21.15.87:0/3877525730 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c375a4c7c0 msgr2=0x55c375abb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:53.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.915+0000 7fb2fa26d640 1 --2- 172.21.15.87:0/3877525730 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c375a4c7c0 0x55c375abb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:53.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.915+0000 7fb2fa26d640 1 -- 172.21.15.87:0/3877525730 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f000e8c0 con 0x55c375a57980 2024-09-13T17:19:53.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.916+0000 7fb2fa26d640 1 --2- 172.21.15.87:0/3877525730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c375a57980 0x55c375ab6cc0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec031040 tx=0x7fb2ec049d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87a0f739130bf824 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:53.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.916+0000 7fb2dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:19:53.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.916+0000 7fb2dd7fa640 1 -- 172.21.15.87:0/3877525730 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec031d00 con 0x55c375a57980 2024-09-13T17:19:53.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.916+0000 7fb2dd7fa640 1 -- 172.21.15.87:0/3877525730 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fb2ec049430 con 0x55c375a57980 2024-09-13T17:19:53.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.916+0000 7fb2fe9f2740 1 -- 172.21.15.87:0/3877525730 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb2ec045040 con 0x55c375a57980 2024-09-13T17:19:53.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.916+0000 7fb2dd7fa640 1 -- 172.21.15.87:0/3877525730 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2ec049de0 con 0x55c375a57980 2024-09-13T17:19:53.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.916+0000 7fb2fe9f2740 10 client.17331 fetch_fsmap learned FSMap version 36 2024-09-13T17:19:53.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.916+0000 7fb2fe9f2740 1 -- 172.21.15.87:0/3877525730 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55c375976990 con 0x55c375a57980 2024-09-13T17:19:53.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.916+0000 7fb2dd7fa640 1 -- 172.21.15.87:0/3877525730 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb2ec063080 con 0x55c375a57980 2024-09-13T17:19:53.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.916+0000 7fb2dd7fa640 1 -- 172.21.15.87:0/3877525730 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fb2ec0042e0 con 0x55c375a57980 2024-09-13T17:19:53.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.916+0000 7fb2fe9f2740 10 client.17331 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:19:53.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.916+0000 7fb2fe9f2740 10 client.17331 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:19:53.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.916+0000 7fb2fe9f2740 20 client.17331 populate_metadata read hostname 'smithi087' 2024-09-13T17:19:53.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.916+0000 7fb2fe9f2740 1 --2- 172.21.15.87:0/3877525730 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55c375ac4250 0x55c375ac6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:53.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.916+0000 7fb2fe9f2740 4 client.17331 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-13T17:19:53.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.916+0000 7fb2fe9f2740 1 -- 172.21.15.87:0/3877525730 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55c375708eb0 con 0x55c375ac4250 2024-09-13T17:19:53.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.916+0000 7fb2f9a6c640 1 --2- 172.21.15.87:0/3877525730 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55c375ac4250 0x55c375ac6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:53.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.917+0000 7fb2f9a6c640 1 --2- 172.21.15.87:0/3877525730 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55c375ac4250 0x55c375ac6670 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12fe437d9a0a169 server_cookie=4ef982ec021ff3d3 in_seq=0 out_seq=0 2024-09-13T17:19:53.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.917+0000 7fb2dd7fa640 10 client.17331 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:53.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.918+0000 7fb2dd7fa640 1 -- 172.21.15.87:0/3877525730 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55c375708eb0 con 0x55c375ac4250 2024-09-13T17:19:53.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.918+0000 7fb2dd7fa640 10 client.17331 handle_command_reply: tid=0 2024-09-13T17:19:53.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.918+0000 7fb2fe9f2740 1 client.17331 shutdown 2024-09-13T17:19:53.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.918+0000 7fb2fe9f2740 1 -- 172.21.15.87:0/3877525730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c375a57980 msgr2=0x55c375ab6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:53.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.918+0000 7fb2fe9f2740 1 --2- 172.21.15.87:0/3877525730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c375a57980 0x55c375ab6cc0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec031040 tx=0x7fb2ec049d40 comp rx=0 tx=0).stop 2024-09-13T17:19:53.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.918+0000 7fb2fe9f2740 1 -- 172.21.15.87:0/3877525730 shutdown_connections 2024-09-13T17:19:53.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.918+0000 7fb2fe9f2740 1 --2- 172.21.15.87:0/3877525730 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55c375ac4250 0x55c375ac6670 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:53.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.918+0000 7fb2fe9f2740 1 --2- 172.21.15.87:0/3877525730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c375a57980 0x55c375ab6cc0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:53.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.918+0000 7fb2fe9f2740 1 --2- 172.21.15.87:0/3877525730 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c375a4d0e0 0x55c375abbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:53.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.918+0000 7fb2dd7fa640 0 client.17331 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:53.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.918+0000 7fb2fe9f2740 1 --2- 172.21.15.87:0/3877525730 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c375a4c7c0 0x55c375abb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:53.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.918+0000 7fb2fe9f2740 1 -- 172.21.15.87:0/3877525730 >> 172.21.15.87:0/3877525730 conn(0x55c375a48d50 msgr2=0x55c375a52e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:53.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.918+0000 7fb2fe9f2740 1 -- 172.21.15.87:0/3877525730 shutdown_connections 2024-09-13T17:19:53.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.918+0000 7fb2fe9f2740 1 -- 172.21.15.87:0/3877525730 wait complete. 2024-09-13T17:19:53.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.918+0000 7fb2fe9f2740 20 client.17331 trim_cache size 0 max 16384 2024-09-13T17:19:53.925 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:19:53.925 INFO:teuthology.orchestra.run.smithi087.stdout: "return_code": 0, 2024-09-13T17:19:53.925 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_tag": "096ca015-0b57-4451-9b49-285796065568", 2024-09-13T17:19:53.926 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": "asynchronous" 2024-09-13T17:19:53.926 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:19:53.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.919+0000 7fb2fbcd0640 1 -- 172.21.15.87:0/2218794419 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb2e00a1200 msgr2=0x7fb2e00a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:53.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.919+0000 7fb2fbcd0640 1 --2- 172.21.15.87:0/2218794419 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb2e00a1200 0x7fb2e00a36c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec009880 tx=0x7fb2ec047000 comp rx=0 tx=0).stop 2024-09-13T17:19:53.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.919+0000 7fb2fbcd0640 1 -- 172.21.15.87:0/2218794419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2f41050a0 msgr2=0x7fb2f4196860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:53.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.919+0000 7fb2fbcd0640 1 --2- 172.21.15.87:0/2218794419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2f41050a0 0x7fb2f4196860 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fb2e800d770 tx=0x7fb2e800dc30 comp rx=0 tx=0).stop 2024-09-13T17:19:53.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.919+0000 7fb2fbcd0640 1 -- 172.21.15.87:0/2218794419 shutdown_connections 2024-09-13T17:19:53.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.919+0000 7fb2fbcd0640 1 --2- 172.21.15.87:0/2218794419 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2f419ac50 0x7fb2f419b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:53.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.919+0000 7fb2fbcd0640 1 --2- 172.21.15.87:0/2218794419 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fb2e00a1200 0x7fb2e00a36c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:53.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.919+0000 7fb2fbcd0640 1 --2- 172.21.15.87:0/2218794419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2f41050a0 0x7fb2f4196860 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:53.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.919+0000 7fb2fbcd0640 1 --2- 172.21.15.87:0/2218794419 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2f40fff50 0x7fb2f4196320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:53.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.919+0000 7fb2fbcd0640 1 -- 172.21.15.87:0/2218794419 >> 172.21.15.87:0/2218794419 conn(0x7fb2f40fb9e0 msgr2=0x7fb2f40fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:53.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.919+0000 7fb2fbcd0640 1 -- 172.21.15.87:0/2218794419 shutdown_connections 2024-09-13T17:19:53.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:53.919+0000 7fb2fbcd0640 1 -- 172.21.15.87:0/2218794419 wait complete. 2024-09-13T17:19:53.929 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:53 smithi087 ceph-mon[30934]: pgmap v185: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:19:53.931 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:19:54.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.030+0000 7fc8b2b1f640 1 -- 172.21.15.87:0/1522751442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8ac0ff810 msgr2=0x7fc8ac103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:54.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.030+0000 7fc8b2b1f640 1 --2- 172.21.15.87:0/1522751442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8ac0ff810 0x7fc8ac103850 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0009930 tx=0x7fc8a002a420 comp rx=0 tx=0).stop 2024-09-13T17:19:54.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.030+0000 7fc8b2b1f640 1 -- 172.21.15.87:0/1522751442 shutdown_connections 2024-09-13T17:19:54.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.030+0000 7fc8b2b1f640 1 --2- 172.21.15.87:0/1522751442 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8ac103fb0 0x7fc8ac10bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:54.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.030+0000 7fc8b2b1f640 1 --2- 172.21.15.87:0/1522751442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8ac0ff810 0x7fc8ac103850 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:54.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.030+0000 7fc8b2b1f640 1 --2- 172.21.15.87:0/1522751442 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8ac0fee60 0x7fc8ac0ff240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:54.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.030+0000 7fc8b2b1f640 1 -- 172.21.15.87:0/1522751442 >> 172.21.15.87:0/1522751442 conn(0x7fc8ac075c60 msgr2=0x7fc8ac0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:54.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.030+0000 7fc8b2b1f640 1 -- 172.21.15.87:0/1522751442 shutdown_connections 2024-09-13T17:19:54.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.030+0000 7fc8b2b1f640 1 -- 172.21.15.87:0/1522751442 wait complete. 2024-09-13T17:19:54.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.030+0000 7fc8b2b1f640 1 Processor -- start 2024-09-13T17:19:54.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.030+0000 7fc8b2b1f640 1 -- start start 2024-09-13T17:19:54.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.030+0000 7fc8b2b1f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8ac0fee60 0x7fc8ac1962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:54.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.030+0000 7fc8b2b1f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8ac103fb0 0x7fc8ac196810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:54.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.030+0000 7fc8b2b1f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8ac19ac00 0x7fc8ac19b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:54.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.030+0000 7fc8b2b1f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ac19b5f0 con 0x7fc8ac103fb0 2024-09-13T17:19:54.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.031+0000 7fc8b2b1f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ac19b760 con 0x7fc8ac0fee60 2024-09-13T17:19:54.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.031+0000 7fc8b2b1f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ac19b8d0 con 0x7fc8ac19ac00 2024-09-13T17:19:54.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.031+0000 7fc8abfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8ac103fb0 0x7fc8ac196810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:54.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.031+0000 7fc8abfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8ac103fb0 0x7fc8ac196810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48544/0 (socket says 172.21.15.87:48544) 2024-09-13T17:19:54.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.031+0000 7fc8abfff640 1 -- 172.21.15.87:0/3529825130 learned_addr learned my addr 172.21.15.87:0/3529825130 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:54.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.031+0000 7fc8b08bb640 1 --2- 172.21.15.87:0/3529825130 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8ac0fee60 0x7fc8ac1962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:54.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.031+0000 7fc8b10bc640 1 --2- 172.21.15.87:0/3529825130 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8ac19ac00 0x7fc8ac19b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:54.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.031+0000 7fc8abfff640 1 -- 172.21.15.87:0/3529825130 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8ac19ac00 msgr2=0x7fc8ac19b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:54.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.031+0000 7fc8abfff640 1 --2- 172.21.15.87:0/3529825130 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8ac19ac00 0x7fc8ac19b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:54.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.031+0000 7fc8abfff640 1 -- 172.21.15.87:0/3529825130 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8ac0fee60 msgr2=0x7fc8ac1962d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:54.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.031+0000 7fc8abfff640 1 --2- 172.21.15.87:0/3529825130 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8ac0fee60 0x7fc8ac1962d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:54.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.031+0000 7fc8abfff640 1 -- 172.21.15.87:0/3529825130 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a0009560 con 0x7fc8ac103fb0 2024-09-13T17:19:54.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.031+0000 7fc8abfff640 1 --2- 172.21.15.87:0/3529825130 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8ac103fb0 0x7fc8ac196810 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0009900 tx=0x7fc8a00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:54.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.031+0000 7fc8a9ffb640 1 -- 172.21.15.87:0/3529825130 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a0003a00 con 0x7fc8ac103fb0 2024-09-13T17:19:54.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.031+0000 7fc8a9ffb640 1 -- 172.21.15.87:0/3529825130 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc8a00044e0 con 0x7fc8ac103fb0 2024-09-13T17:19:54.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.031+0000 7fc8a9ffb640 1 -- 172.21.15.87:0/3529825130 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a003a3c0 con 0x7fc8ac103fb0 2024-09-13T17:19:54.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.031+0000 7fc8b2b1f640 1 -- 172.21.15.87:0/3529825130 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8ac1a2eb0 con 0x7fc8ac103fb0 2024-09-13T17:19:54.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.032+0000 7fc8b2b1f640 1 -- 172.21.15.87:0/3529825130 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8ac1a3220 con 0x7fc8ac103fb0 2024-09-13T17:19:54.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.034+0000 7fc8a9ffb640 1 -- 172.21.15.87:0/3529825130 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fc8a003b460 con 0x7fc8ac103fb0 2024-09-13T17:19:54.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.034+0000 7fc8b583e740 1 Processor -- start 2024-09-13T17:19:54.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.034+0000 7fc8b583e740 1 -- start start 2024-09-13T17:19:54.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.034+0000 7fc8b583e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5587bb23fe10 0x5587bb2401f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:54.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.034+0000 7fc8b583e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5587bb240730 0x5587bb24aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:54.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.034+0000 7fc8b583e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5587bb24afd0 0x5587bb24d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:54.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.034+0000 7fc8b583e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587bb1aaf20 con 0x5587bb24afd0 2024-09-13T17:19:54.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.034+0000 7fc8b583e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587bb1a86b0 con 0x5587bb240730 2024-09-13T17:19:54.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.034+0000 7fc8b583e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587bb1a3fa0 con 0x5587bb23fe10 2024-09-13T17:19:54.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.034+0000 7fc8a9ffb640 1 --2- 172.21.15.87:0/3529825130 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc8940a1200 0x7fc8940a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:54.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.035+0000 7fc8abfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5587bb24afd0 0x5587bb24d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:54.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.035+0000 7fc8b10bc640 1 --2- 172.21.15.87:0/3529825130 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc8940a1200 0x7fc8940a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:54.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.035+0000 7fc8b08bb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5587bb240730 0x5587bb24aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:54.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.035+0000 7fc8b10bc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5587bb23fe10 0x5587bb2401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:54.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.035+0000 7fc8b08bb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5587bb240730 0x5587bb24aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.87:34182/0 (socket says 172.21.15.87:34182) 2024-09-13T17:19:54.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.035+0000 7fc8abfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5587bb24afd0 0x5587bb24d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48552/0 (socket says 172.21.15.87:48552) 2024-09-13T17:19:54.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.035+0000 7fc8b08bb640 1 -- 172.21.15.87:0/3367750526 learned_addr learned my addr 172.21.15.87:0/3367750526 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:54.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.035+0000 7fc8a9ffb640 1 -- 172.21.15.87:0/3529825130 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fc8a00edfc0 con 0x7fc8ac103fb0 2024-09-13T17:19:54.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.035+0000 7fc8abfff640 1 -- 172.21.15.87:0/3367750526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5587bb23fe10 msgr2=0x5587bb2401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:54.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.035+0000 7fc8abfff640 1 --2- 172.21.15.87:0/3367750526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5587bb23fe10 0x5587bb2401f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:54.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.035+0000 7fc8abfff640 1 -- 172.21.15.87:0/3367750526 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5587bb240730 msgr2=0x5587bb24aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:54.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.035+0000 7fc8abfff640 1 --2- 172.21.15.87:0/3367750526 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5587bb240730 0x5587bb24aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:54.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.035+0000 7fc8abfff640 1 -- 172.21.15.87:0/3367750526 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587bb15e840 con 0x5587bb24afd0 2024-09-13T17:19:54.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.035+0000 7fc8b10bc640 1 --2- 172.21.15.87:0/3529825130 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc8940a1200 0x7fc8940a36c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4009fd0 tx=0x7fc8a4009d60 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:54.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.035+0000 7fc8abfff640 1 --2- 172.21.15.87:0/3367750526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5587bb24afd0 0x5587bb24d3c0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fc8a00eb360 tx=0x7fc8a004e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c970585eb976d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:54.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.035+0000 7fc892ffd640 1 -- 172.21.15.87:0/3367750526 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a003b710 con 0x5587bb24afd0 2024-09-13T17:19:54.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.035+0000 7fc892ffd640 1 -- 172.21.15.87:0/3367750526 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc8a00badd0 con 0x5587bb24afd0 2024-09-13T17:19:54.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.035+0000 7fc892ffd640 1 -- 172.21.15.87:0/3367750526 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a00b74e0 con 0x5587bb24afd0 2024-09-13T17:19:54.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.036+0000 7fc8b583e740 1 -- 172.21.15.87:0/3367750526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5587bb24afd0 msgr2=0x5587bb24d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:54.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.036+0000 7fc8b583e740 1 --2- 172.21.15.87:0/3367750526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5587bb24afd0 0x5587bb24d3c0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fc8a00eb360 tx=0x7fc8a004e000 comp rx=0 tx=0).stop 2024-09-13T17:19:54.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.036+0000 7fc8b583e740 1 -- 172.21.15.87:0/3367750526 shutdown_connections 2024-09-13T17:19:54.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.036+0000 7fc8b583e740 1 --2- 172.21.15.87:0/3367750526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5587bb24afd0 0x5587bb24d3c0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:54.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.036+0000 7fc8b583e740 1 --2- 172.21.15.87:0/3367750526 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5587bb240730 0x5587bb24aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:54.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.036+0000 7fc8b583e740 1 --2- 172.21.15.87:0/3367750526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5587bb23fe10 0x5587bb2401f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:54.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.036+0000 7fc8b583e740 1 -- 172.21.15.87:0/3367750526 >> 172.21.15.87:0/3367750526 conn(0x5587bb23c380 msgr2=0x5587bb23c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:54.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.036+0000 7fc8b583e740 1 -- 172.21.15.87:0/3367750526 shutdown_connections 2024-09-13T17:19:54.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.036+0000 7fc8b583e740 1 -- 172.21.15.87:0/3367750526 wait complete. 2024-09-13T17:19:54.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.036+0000 7fc8b583e740 1 -- start start 2024-09-13T17:19:54.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.036+0000 7fc8b583e740 1 Processor -- start 2024-09-13T17:19:54.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.037+0000 7fc8b583e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5587bb23fe10 0x5587bb24a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:54.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.037+0000 7fc8b583e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5587bb240730 0x5587bb247ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:54.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.037+0000 7fc8b583e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5587bb24afd0 0x5587bb248100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:54.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.037+0000 7fc8b583e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587bb1452a0 con 0x5587bb24afd0 2024-09-13T17:19:54.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.037+0000 7fc8b583e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587bae7c430 con 0x5587bb23fe10 2024-09-13T17:19:54.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.037+0000 7fc8b583e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587bb127680 con 0x5587bb240730 2024-09-13T17:19:54.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.037+0000 7fc8b583e740 10 client.0 _ll_register_callbacks cb 0x5587bb19d610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:54.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.037+0000 7fc8b10bc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5587bb24afd0 0x5587bb248100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:54.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.037+0000 7fc8b10bc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5587bb24afd0 0x5587bb248100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48554/0 (socket says 172.21.15.87:48554) 2024-09-13T17:19:54.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.037+0000 7fc8b10bc640 1 -- 172.21.15.87:0/83518244 learned_addr learned my addr 172.21.15.87:0/83518244 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:54.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.037+0000 7fc8b08bb640 1 --2- 172.21.15.87:0/83518244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5587bb23fe10 0x5587bb24a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:54.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.037+0000 7fc8b10bc640 1 -- 172.21.15.87:0/83518244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5587bb240730 msgr2=0x5587bb247ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:54.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.037+0000 7fc8abfff640 1 --2- 172.21.15.87:0/83518244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5587bb240730 0x5587bb247ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:54.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.037+0000 7fc8b10bc640 1 --2- 172.21.15.87:0/83518244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5587bb240730 0x5587bb247ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:54.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.037+0000 7fc8b10bc640 1 -- 172.21.15.87:0/83518244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5587bb23fe10 msgr2=0x5587bb24a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:54.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.037+0000 7fc8b10bc640 1 --2- 172.21.15.87:0/83518244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5587bb23fe10 0x5587bb24a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:54.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.037+0000 7fc8b10bc640 1 -- 172.21.15.87:0/83518244 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8ac1a3220 con 0x5587bb24afd0 2024-09-13T17:19:54.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.037+0000 7fc8b10bc640 1 --2- 172.21.15.87:0/83518244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5587bb24afd0 0x5587bb248100 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4010dc0 tx=0x7fc8a4009550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3dca3a5c587b39c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:54.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.037+0000 7fc88bfff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:19:54.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.038+0000 7fc88bfff640 1 -- 172.21.15.87:0/83518244 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4004530 con 0x5587bb24afd0 2024-09-13T17:19:54.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.038+0000 7fc88bfff640 1 -- 172.21.15.87:0/83518244 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fc8a4004690 con 0x5587bb24afd0 2024-09-13T17:19:54.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.038+0000 7fc8b583e740 1 -- 172.21.15.87:0/83518244 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5587bae974e0 con 0x5587bb24afd0 2024-09-13T17:19:54.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.038+0000 7fc88bfff640 1 -- 172.21.15.87:0/83518244 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8a4004850 con 0x5587bb24afd0 2024-09-13T17:19:54.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.038+0000 7fc8b583e740 10 client.17343 fetch_fsmap learned FSMap version 36 2024-09-13T17:19:54.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.038+0000 7fc8b583e740 1 -- 172.21.15.87:0/83518244 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5587bb1a2620 con 0x5587bb24afd0 2024-09-13T17:19:54.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.038+0000 7fc88bfff640 1 -- 172.21.15.87:0/83518244 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x5587bae974e0 con 0x5587bb24afd0 2024-09-13T17:19:54.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.038+0000 7fc88bfff640 1 -- 172.21.15.87:0/83518244 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc8a4026020 con 0x5587bb24afd0 2024-09-13T17:19:54.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.038+0000 7fc8b583e740 10 client.17343 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:19:54.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.038+0000 7fc8b583e740 10 client.17343 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:19:54.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.038+0000 7fc8b583e740 20 client.17343 populate_metadata read hostname 'smithi087' 2024-09-13T17:19:54.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.038+0000 7fc8b583e740 1 --2- 172.21.15.87:0/83518244 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5587bb25a9d0 0x5587bb25cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:54.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.038+0000 7fc8b583e740 4 client.17343 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:19:54.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.038+0000 7fc8b583e740 1 -- 172.21.15.87:0/83518244 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5587baea87e0 con 0x5587bb25a9d0 2024-09-13T17:19:54.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.039+0000 7fc8b08bb640 1 --2- 172.21.15.87:0/83518244 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5587bb25a9d0 0x5587bb25cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:54.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.039+0000 7fc88bfff640 10 client.17343 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:54.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.039+0000 7fc8b08bb640 1 --2- 172.21.15.87:0/83518244 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5587bb25a9d0 0x5587bb25cdf0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2caef536f20eb808 server_cookie=28edd9268ae025e9 in_seq=0 out_seq=0 2024-09-13T17:19:54.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.039+0000 7fc88bfff640 1 -- 172.21.15.87:0/83518244 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5587baea87e0 con 0x5587bb25a9d0 2024-09-13T17:19:54.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.039+0000 7fc88bfff640 10 client.17343 handle_command_reply: tid=0 2024-09-13T17:19:54.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.039+0000 7fc8b583e740 1 client.17343 shutdown 2024-09-13T17:19:54.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.040+0000 7fc8b583e740 1 -- 172.21.15.87:0/83518244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5587bb24afd0 msgr2=0x5587bb248100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:54.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.040+0000 7fc8b583e740 1 --2- 172.21.15.87:0/83518244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5587bb24afd0 0x5587bb248100 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4010dc0 tx=0x7fc8a4009550 comp rx=0 tx=0).stop 2024-09-13T17:19:54.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.040+0000 7fc8b583e740 1 -- 172.21.15.87:0/83518244 shutdown_connections 2024-09-13T17:19:54.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.040+0000 7fc8b583e740 1 --2- 172.21.15.87:0/83518244 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5587bb25a9d0 0x5587bb25cdf0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:54.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.040+0000 7fc8b583e740 1 --2- 172.21.15.87:0/83518244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5587bb24afd0 0x5587bb248100 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:54.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.040+0000 7fc88bfff640 0 client.17343 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:54.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.040+0000 7fc8b583e740 1 --2- 172.21.15.87:0/83518244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5587bb240730 0x5587bb247ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:54.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.040+0000 7fc8b583e740 1 --2- 172.21.15.87:0/83518244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5587bb23fe10 0x5587bb24a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:54.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.040+0000 7fc8b583e740 1 -- 172.21.15.87:0/83518244 >> 172.21.15.87:0/83518244 conn(0x5587bb23c380 msgr2=0x5587bb23b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:54.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.040+0000 7fc8b583e740 1 -- 172.21.15.87:0/83518244 shutdown_connections 2024-09-13T17:19:54.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.040+0000 7fc8b583e740 1 -- 172.21.15.87:0/83518244 wait complete. 2024-09-13T17:19:54.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.040+0000 7fc8b583e740 20 client.17343 trim_cache size 0 max 16384 2024-09-13T17:19:54.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.054+0000 7fc8b583e740 1 Processor -- start 2024-09-13T17:19:54.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.054+0000 7fc8b583e740 1 -- start start 2024-09-13T17:19:54.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.054+0000 7fc8b583e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5587bb23fe10 0x5587bb23bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:54.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.054+0000 7fc8b583e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5587bb240730 0x5587bb242e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:54.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.054+0000 7fc8b583e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5587bb24afd0 0x5587bb243390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:54.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.054+0000 7fc8b583e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587bb23a9c0 con 0x5587bb23fe10 2024-09-13T17:19:54.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.054+0000 7fc8b583e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587baea87e0 con 0x5587bb24afd0 2024-09-13T17:19:54.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.054+0000 7fc8b583e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587bb23d2e0 con 0x5587bb240730 2024-09-13T17:19:54.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.054+0000 7fc8b08bb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5587bb23fe10 0x5587bb23bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:54.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.054+0000 7fc8b08bb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5587bb23fe10 0x5587bb23bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48562/0 (socket says 172.21.15.87:48562) 2024-09-13T17:19:54.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.054+0000 7fc8b08bb640 1 -- 172.21.15.87:0/2433424261 learned_addr learned my addr 172.21.15.87:0/2433424261 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:54.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.055+0000 7fc8b08bb640 1 -- 172.21.15.87:0/2433424261 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5587bb240730 msgr2=0x5587bb242e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:54.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.055+0000 7fc8b08bb640 1 --2- 172.21.15.87:0/2433424261 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5587bb240730 0x5587bb242e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:54.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.055+0000 7fc8b08bb640 1 -- 172.21.15.87:0/2433424261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5587bb24afd0 msgr2=0x5587bb243390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:54.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.055+0000 7fc8b08bb640 1 --2- 172.21.15.87:0/2433424261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5587bb24afd0 0x5587bb243390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:54.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.055+0000 7fc8b08bb640 1 -- 172.21.15.87:0/2433424261 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587bb144790 con 0x5587bb23fe10 2024-09-13T17:19:54.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.055+0000 7fc8b08bb640 1 --2- 172.21.15.87:0/2433424261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5587bb23fe10 0x5587bb23bd00 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x5587bb25d740 tx=0x7fc89c00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85a3c6ccf014b2e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:54.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.055+0000 7fc8937fe640 1 -- 172.21.15.87:0/2433424261 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89c003d80 con 0x5587bb23fe10 2024-09-13T17:19:54.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.055+0000 7fc8937fe640 1 -- 172.21.15.87:0/2433424261 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc89c017040 con 0x5587bb23fe10 2024-09-13T17:19:54.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.055+0000 7fc8937fe640 1 -- 172.21.15.87:0/2433424261 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89c01e070 con 0x5587bb23fe10 2024-09-13T17:19:54.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.056+0000 7fc8b583e740 1 -- 172.21.15.87:0/2433424261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5587bb23fe10 msgr2=0x5587bb23bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:54.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.056+0000 7fc8b583e740 1 --2- 172.21.15.87:0/2433424261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5587bb23fe10 0x5587bb23bd00 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x5587bb25d740 tx=0x7fc89c00b390 comp rx=0 tx=0).stop 2024-09-13T17:19:54.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.056+0000 7fc8b583e740 1 -- 172.21.15.87:0/2433424261 shutdown_connections 2024-09-13T17:19:54.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.056+0000 7fc8b583e740 1 --2- 172.21.15.87:0/2433424261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5587bb24afd0 0x5587bb243390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:54.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.056+0000 7fc8b583e740 1 --2- 172.21.15.87:0/2433424261 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5587bb240730 0x5587bb242e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:54.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.056+0000 7fc8b583e740 1 --2- 172.21.15.87:0/2433424261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5587bb23fe10 0x5587bb23bd00 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:54.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.056+0000 7fc8b583e740 1 -- 172.21.15.87:0/2433424261 >> 172.21.15.87:0/2433424261 conn(0x5587bb23c380 msgr2=0x5587bb23c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:54.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.056+0000 7fc8b583e740 1 -- 172.21.15.87:0/2433424261 shutdown_connections 2024-09-13T17:19:54.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.056+0000 7fc8b583e740 1 -- 172.21.15.87:0/2433424261 wait complete. 2024-09-13T17:19:54.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.056+0000 7fc8b583e740 1 -- start start 2024-09-13T17:19:54.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.056+0000 7fc8b583e740 1 Processor -- start 2024-09-13T17:19:54.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.056+0000 7fc8b583e740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5587bb23fe10 0x5587bb24fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:54.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.056+0000 7fc8b583e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5587bb240730 0x5587bb250100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:54.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.056+0000 7fc8b583e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5587bb24afd0 0x5587bb2aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:54.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.056+0000 7fc8b583e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587bb250860 con 0x5587bb24afd0 2024-09-13T17:19:54.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.056+0000 7fc8b583e740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587bb2b0450 con 0x5587bb23fe10 2024-09-13T17:19:54.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.056+0000 7fc8b583e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587bb2b0610 con 0x5587bb240730 2024-09-13T17:19:54.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.056+0000 7fc8b583e740 10 client.0 _ll_register_callbacks cb 0x7fc8a40124b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:19:54.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.056+0000 7fc8b10bc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5587bb24afd0 0x5587bb2aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:54.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.056+0000 7fc8b10bc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5587bb24afd0 0x5587bb2aff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48566/0 (socket says 172.21.15.87:48566) 2024-09-13T17:19:54.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.057+0000 7fc8b10bc640 1 -- 172.21.15.87:0/936379752 learned_addr learned my addr 172.21.15.87:0/936379752 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:19:54.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.057+0000 7fc8b08bb640 1 --2- 172.21.15.87:0/936379752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5587bb23fe10 0x5587bb24fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:54.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.057+0000 7fc8abfff640 1 --2- 172.21.15.87:0/936379752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5587bb240730 0x5587bb250100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:54.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.057+0000 7fc8b10bc640 1 -- 172.21.15.87:0/936379752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5587bb240730 msgr2=0x5587bb250100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:54.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.057+0000 7fc8b10bc640 1 --2- 172.21.15.87:0/936379752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5587bb240730 0x5587bb250100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:54.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.057+0000 7fc8b10bc640 1 -- 172.21.15.87:0/936379752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5587bb23fe10 msgr2=0x5587bb24fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:19:54.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.057+0000 7fc8b10bc640 1 --2- 172.21.15.87:0/936379752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5587bb23fe10 0x5587bb24fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:54.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.057+0000 7fc8b10bc640 1 -- 172.21.15.87:0/936379752 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc89c00b840 con 0x5587bb24afd0 2024-09-13T17:19:54.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.057+0000 7fc8b10bc640 1 --2- 172.21.15.87:0/936379752 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5587bb24afd0 0x5587bb2aff10 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fc8a401e3e0 tx=0x7fc8a401d5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d884b2847dcd9bf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:19:54.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.057+0000 7fc88bfff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:19:54.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.057+0000 7fc88bfff640 1 -- 172.21.15.87:0/936379752 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4009960 con 0x5587bb24afd0 2024-09-13T17:19:54.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.057+0000 7fc88bfff640 1 -- 172.21.15.87:0/936379752 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9468+0+0 (secure 0 0 0) 0x7fc8a401e6d0 con 0x5587bb24afd0 2024-09-13T17:19:54.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.057+0000 7fc8b583e740 1 -- 172.21.15.87:0/936379752 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc8a00badd0 con 0x5587bb24afd0 2024-09-13T17:19:54.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.057+0000 7fc88bfff640 1 -- 172.21.15.87:0/936379752 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8a4004610 con 0x5587bb24afd0 2024-09-13T17:19:54.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.057+0000 7fc8b583e740 10 client.17349 fetch_fsmap learned FSMap version 36 2024-09-13T17:19:54.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.057+0000 7fc8b583e740 1 -- 172.21.15.87:0/936379752 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5587bb169ea0 con 0x5587bb24afd0 2024-09-13T17:19:54.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.057+0000 7fc88bfff640 1 -- 172.21.15.87:0/936379752 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc8a00badd0 con 0x5587bb24afd0 2024-09-13T17:19:54.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.057+0000 7fc88bfff640 1 -- 172.21.15.87:0/936379752 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc8a4026070 con 0x5587bb24afd0 2024-09-13T17:19:54.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.058+0000 7fc8b583e740 10 client.17349 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:19:54.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.058+0000 7fc8b583e740 10 client.17349 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:19:54.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.058+0000 7fc8b583e740 20 client.17349 populate_metadata read hostname 'smithi087' 2024-09-13T17:19:54.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.058+0000 7fc8b583e740 1 --2- 172.21.15.87:0/936379752 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5587bb2b1be0 0x5587bb2b4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:19:54.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.058+0000 7fc8b583e740 4 client.17349 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:19:54.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.058+0000 7fc8b583e740 1 -- 172.21.15.87:0/936379752 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5587baefbe30 con 0x5587bb2b1be0 2024-09-13T17:19:54.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.058+0000 7fc8b08bb640 1 --2- 172.21.15.87:0/936379752 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5587bb2b1be0 0x5587bb2b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:19:54.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.058+0000 7fc8b08bb640 1 --2- 172.21.15.87:0/936379752 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5587bb2b1be0 0x5587bb2b4000 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98b8425f6f3c764d server_cookie=e9ad3aa3b1185f97 in_seq=0 out_seq=0 2024-09-13T17:19:54.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.058+0000 7fc88bfff640 10 client.17349 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:54.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.058+0000 7fc88bfff640 1 -- 172.21.15.87:0/936379752 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5587baefbe30 con 0x5587bb2b1be0 2024-09-13T17:19:54.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.058+0000 7fc88bfff640 10 client.17349 handle_command_reply: tid=0 2024-09-13T17:19:54.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.058+0000 7fc8b583e740 1 client.17349 shutdown 2024-09-13T17:19:54.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.058+0000 7fc8b583e740 1 -- 172.21.15.87:0/936379752 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5587bb24afd0 msgr2=0x5587bb2aff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:54.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.058+0000 7fc8b583e740 1 --2- 172.21.15.87:0/936379752 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5587bb24afd0 0x5587bb2aff10 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fc8a401e3e0 tx=0x7fc8a401d5f0 comp rx=0 tx=0).stop 2024-09-13T17:19:54.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.058+0000 7fc8b583e740 1 -- 172.21.15.87:0/936379752 shutdown_connections 2024-09-13T17:19:54.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.058+0000 7fc8b583e740 1 --2- 172.21.15.87:0/936379752 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5587bb2b1be0 0x5587bb2b4000 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:54.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.058+0000 7fc8b583e740 1 --2- 172.21.15.87:0/936379752 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5587bb24afd0 0x5587bb2aff10 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:54.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.059+0000 7fc8b583e740 1 --2- 172.21.15.87:0/936379752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5587bb240730 0x5587bb250100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:54.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.059+0000 7fc8b583e740 1 --2- 172.21.15.87:0/936379752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5587bb23fe10 0x5587bb24fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:54.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.059+0000 7fc88bfff640 0 client.17349 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:19:54.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.059+0000 7fc8b583e740 1 -- 172.21.15.87:0/936379752 >> 172.21.15.87:0/936379752 conn(0x5587bb23c380 msgr2=0x5587bb23c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:54.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.059+0000 7fc8b583e740 1 -- 172.21.15.87:0/936379752 shutdown_connections 2024-09-13T17:19:54.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.059+0000 7fc8b583e740 1 -- 172.21.15.87:0/936379752 wait complete. 2024-09-13T17:19:54.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.059+0000 7fc8b583e740 20 client.17349 trim_cache size 0 max 16384 2024-09-13T17:19:54.066 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:19:54.066 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-13T17:19:54.066 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": { 2024-09-13T17:19:54.067 INFO:teuthology.orchestra.run.smithi087.stdout: "096ca015-0b57-4451-9b49-285796065568": { 2024-09-13T17:19:54.067 INFO:teuthology.orchestra.run.smithi087.stdout: "path": "/", 2024-09-13T17:19:54.067 INFO:teuthology.orchestra.run.smithi087.stdout: "tag": "096ca015-0b57-4451-9b49-285796065568", 2024-09-13T17:19:54.067 INFO:teuthology.orchestra.run.smithi087.stdout: "options": "recursive,force" 2024-09-13T17:19:54.067 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:19:54.067 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:19:54.067 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:19:54.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.059+0000 7fc8b2b1f640 1 -- 172.21.15.87:0/3529825130 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc8940a1200 msgr2=0x7fc8940a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:54.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.059+0000 7fc8b2b1f640 1 --2- 172.21.15.87:0/3529825130 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc8940a1200 0x7fc8940a36c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4009fd0 tx=0x7fc8a4009d60 comp rx=0 tx=0).stop 2024-09-13T17:19:54.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.059+0000 7fc8b2b1f640 1 -- 172.21.15.87:0/3529825130 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8ac103fb0 msgr2=0x7fc8ac196810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:19:54.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.059+0000 7fc8b2b1f640 1 --2- 172.21.15.87:0/3529825130 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8ac103fb0 0x7fc8ac196810 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0009900 tx=0x7fc8a00042f0 comp rx=0 tx=0).stop 2024-09-13T17:19:54.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.059+0000 7fc8b2b1f640 1 -- 172.21.15.87:0/3529825130 shutdown_connections 2024-09-13T17:19:54.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.059+0000 7fc8b2b1f640 1 --2- 172.21.15.87:0/3529825130 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8ac19ac00 0x7fc8ac19b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:54.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.059+0000 7fc8b2b1f640 1 --2- 172.21.15.87:0/3529825130 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc8940a1200 0x7fc8940a36c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:54.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.059+0000 7fc8b2b1f640 1 --2- 172.21.15.87:0/3529825130 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8ac103fb0 0x7fc8ac196810 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:54.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.059+0000 7fc8b2b1f640 1 --2- 172.21.15.87:0/3529825130 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8ac0fee60 0x7fc8ac1962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:19:54.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.059+0000 7fc8b2b1f640 1 -- 172.21.15.87:0/3529825130 >> 172.21.15.87:0/3529825130 conn(0x7fc8ac075c60 msgr2=0x7fc8ac102350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:19:54.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.059+0000 7fc8b2b1f640 1 -- 172.21.15.87:0/3529825130 shutdown_connections 2024-09-13T17:19:54.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:19:54.059+0000 7fc8b2b1f640 1 -- 172.21.15.87:0/3529825130 wait complete. 2024-09-13T17:19:54.071 INFO:tasks.cephfs.filesystem:scrub status for tag:096ca015-0b57-4451-9b49-285796065568 - {'path': '/', 'tag': '096ca015-0b57-4451-9b49-285796065568', 'options': 'recursive,force'} 2024-09-13T17:19:55.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:54 smithi149 ceph-mon[35496]: scrub queued for path: / 2024-09-13T17:19:55.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:54 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:19:55.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:54 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:19:55.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:54 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:19:55.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:54 smithi149 ceph-mon[35496]: scrub summary: idle 2024-09-13T17:19:55.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:54 smithi118 ceph-mon[34374]: scrub queued for path: / 2024-09-13T17:19:55.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:54 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:19:55.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:54 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:19:55.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:54 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:19:55.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:54 smithi118 ceph-mon[34374]: scrub summary: idle 2024-09-13T17:19:55.130 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:54 smithi087 ceph-mon[30934]: scrub queued for path: / 2024-09-13T17:19:55.130 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:54 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:19:55.130 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:54 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:19:55.131 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:54 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:19:55.131 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:54 smithi087 ceph-mon[30934]: scrub summary: idle 2024-09-13T17:19:56.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:55 smithi149 ceph-mon[35496]: pgmap v186: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:19:56.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:55 smithi118 ceph-mon[34374]: pgmap v186: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:19:56.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:55 smithi087 ceph-mon[30934]: pgmap v186: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:19:57.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:57 smithi149 ceph-mon[35496]: pgmap v187: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:19:57.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:57 smithi118 ceph-mon[34374]: pgmap v187: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:19:57.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:57 smithi087 ceph-mon[30934]: pgmap v187: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:19:59.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:19:59 smithi149 ceph-mon[35496]: pgmap v188: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:19:59.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:19:59 smithi118 ceph-mon[34374]: pgmap v188: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:19:59.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:19:59 smithi087 ceph-mon[30934]: pgmap v188: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:20:00.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:00 smithi149 ceph-mon[35496]: overall HEALTH_OK 2024-09-13T17:20:00.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:00 smithi118 ceph-mon[34374]: overall HEALTH_OK 2024-09-13T17:20:00.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:00 smithi087 ceph-mon[30934]: overall HEALTH_OK 2024-09-13T17:20:01.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:01 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:20:01.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:01 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:20:01.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:01 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:20:01.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:01 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:20:01.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:01 smithi149 ceph-mon[35496]: pgmap v189: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2024-09-13T17:20:01.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:01 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:20:01.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:01 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:20:01.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:01 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:20:01.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:01 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:20:01.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:01 smithi118 ceph-mon[34374]: pgmap v189: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2024-09-13T17:20:01.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:01 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:20:01.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:01 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:20:01.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:01 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:20:01.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:01 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:20:01.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:01 smithi087 ceph-mon[30934]: pgmap v189: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2024-09-13T17:20:04.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:03 smithi087 ceph-mon[30934]: pgmap v190: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-13T17:20:04.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:03 smithi149 ceph-mon[35496]: pgmap v190: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-13T17:20:04.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:03 smithi118 ceph-mon[34374]: pgmap v190: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-13T17:20:05.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:05 smithi149 ceph-mon[35496]: pgmap v191: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2024-09-13T17:20:05.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:05 smithi118 ceph-mon[34374]: pgmap v191: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2024-09-13T17:20:05.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:05 smithi087 ceph-mon[30934]: pgmap v191: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2024-09-13T17:20:07.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:07 smithi149 ceph-mon[35496]: pgmap v192: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-09-13T17:20:07.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:07 smithi118 ceph-mon[34374]: pgmap v192: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-09-13T17:20:07.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:07 smithi087 ceph-mon[30934]: pgmap v192: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-09-13T17:20:09.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:09 smithi087 ceph-mon[30934]: pgmap v193: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-09-13T17:20:09.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:09 smithi149 ceph-mon[35496]: pgmap v193: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-09-13T17:20:09.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:09 smithi118 ceph-mon[34374]: pgmap v193: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-09-13T17:20:11.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:11 smithi149 ceph-mon[35496]: osdmap e95: 12 total, 12 up, 12 in 2024-09-13T17:20:11.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:11 smithi149 ceph-mon[35496]: pgmap v195: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:20:11.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:11 smithi118 ceph-mon[34374]: osdmap e95: 12 total, 12 up, 12 in 2024-09-13T17:20:11.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:11 smithi118 ceph-mon[34374]: pgmap v195: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:20:11.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:11 smithi087 ceph-mon[30934]: osdmap e95: 12 total, 12 up, 12 in 2024-09-13T17:20:11.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:11 smithi087 ceph-mon[30934]: pgmap v195: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:20:13.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:13 smithi149 ceph-mon[35496]: pgmap v196: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:20:13.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:13 smithi118 ceph-mon[34374]: pgmap v196: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:20:13.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:13 smithi087 ceph-mon[30934]: pgmap v196: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:20:15.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:15 smithi149 ceph-mon[35496]: pgmap v197: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:20:15.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:15 smithi118 ceph-mon[34374]: pgmap v197: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:20:15.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:15 smithi087 ceph-mon[30934]: pgmap v197: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:20:17.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:17 smithi149 ceph-mon[35496]: pgmap v198: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:20:17.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:17 smithi118 ceph-mon[34374]: pgmap v198: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:20:17.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:17 smithi087 ceph-mon[30934]: pgmap v198: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:20:19.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:18 smithi087 ceph-mon[30934]: osdmap e96: 12 total, 12 up, 12 in 2024-09-13T17:20:19.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:18 smithi149 ceph-mon[35496]: osdmap e96: 12 total, 12 up, 12 in 2024-09-13T17:20:19.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:18 smithi118 ceph-mon[34374]: osdmap e96: 12 total, 12 up, 12 in 2024-09-13T17:20:20.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:19 smithi087 ceph-mon[30934]: pgmap v200: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 114 B/s wr, 4 op/s 2024-09-13T17:20:20.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:19 smithi149 ceph-mon[35496]: pgmap v200: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 114 B/s wr, 4 op/s 2024-09-13T17:20:20.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:19 smithi118 ceph-mon[34374]: pgmap v200: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 114 B/s wr, 4 op/s 2024-09-13T17:20:21.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:21 smithi149 ceph-mon[35496]: pgmap v201: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 8 op/s 2024-09-13T17:20:21.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:21 smithi118 ceph-mon[34374]: pgmap v201: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 8 op/s 2024-09-13T17:20:21.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:21 smithi087 ceph-mon[30934]: pgmap v201: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 8 op/s 2024-09-13T17:20:23.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:23 smithi149 ceph-mon[35496]: pgmap v202: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 8 op/s 2024-09-13T17:20:23.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:23 smithi118 ceph-mon[34374]: pgmap v202: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 8 op/s 2024-09-13T17:20:23.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:23 smithi087 ceph-mon[30934]: pgmap v202: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 8 op/s 2024-09-13T17:20:24.072 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:20:24.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.184+0000 7f380329c640 1 -- 172.21.15.87:0/1639239786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37fc1050e0 msgr2=0x7f37fc10cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.184+0000 7f380329c640 1 --2- 172.21.15.87:0/1639239786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37fc1050e0 0x7f37fc10cc30 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009cd0 tx=0x7f37f402a8e0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.184+0000 7f380329c640 1 -- 172.21.15.87:0/1639239786 shutdown_connections 2024-09-13T17:20:24.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.184+0000 7f380329c640 1 --2- 172.21.15.87:0/1639239786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37fc1050e0 0x7f37fc10cc30 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.184+0000 7f380329c640 1 --2- 172.21.15.87:0/1639239786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37fc100940 0x7f37fc104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.184+0000 7f380329c640 1 --2- 172.21.15.87:0/1639239786 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37fc0fff90 0x7f37fc100370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.184+0000 7f380329c640 1 -- 172.21.15.87:0/1639239786 >> 172.21.15.87:0/1639239786 conn(0x7f37fc0fba20 msgr2=0x7f37fc0fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:24.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.184+0000 7f380329c640 1 -- 172.21.15.87:0/1639239786 shutdown_connections 2024-09-13T17:20:24.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.184+0000 7f380329c640 1 -- 172.21.15.87:0/1639239786 wait complete. 2024-09-13T17:20:24.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.185+0000 7f380329c640 1 Processor -- start 2024-09-13T17:20:24.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.185+0000 7f380329c640 1 -- start start 2024-09-13T17:20:24.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.185+0000 7f380329c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37fc0fff90 0x7f37fc1961a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.185+0000 7f380329c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37fc1050e0 0x7f37fc1966e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.185+0000 7f380329c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37fc19aad0 0x7f37fc19af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.185+0000 7f380329c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc19b4c0 con 0x7f37fc0fff90 2024-09-13T17:20:24.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.185+0000 7f380329c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc19b630 con 0x7f37fc19aad0 2024-09-13T17:20:24.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.185+0000 7f380329c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc19b7a0 con 0x7f37fc1050e0 2024-09-13T17:20:24.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.185+0000 7f3801038640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37fc0fff90 0x7f37fc1961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.185+0000 7f3801038640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37fc0fff90 0x7f37fc1961a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38946/0 (socket says 172.21.15.87:38946) 2024-09-13T17:20:24.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.185+0000 7f3801038640 1 -- 172.21.15.87:0/2982063129 learned_addr learned my addr 172.21.15.87:0/2982063129 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:24.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.185+0000 7f3801839640 1 --2- 172.21.15.87:0/2982063129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37fc19aad0 0x7f37fc19af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.186+0000 7f3800837640 1 --2- 172.21.15.87:0/2982063129 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37fc1050e0 0x7f37fc1966e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.186+0000 7f3801038640 1 -- 172.21.15.87:0/2982063129 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37fc1050e0 msgr2=0x7f37fc1966e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.186+0000 7f3801038640 1 --2- 172.21.15.87:0/2982063129 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37fc1050e0 0x7f37fc1966e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.186+0000 7f3801038640 1 -- 172.21.15.87:0/2982063129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37fc19aad0 msgr2=0x7f37fc19af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.186+0000 7f3801038640 1 --2- 172.21.15.87:0/2982063129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37fc19aad0 0x7f37fc19af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.186+0000 7f3801038640 1 -- 172.21.15.87:0/2982063129 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f4009900 con 0x7f37fc0fff90 2024-09-13T17:20:24.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.186+0000 7f3801839640 1 --2- 172.21.15.87:0/2982063129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37fc19aad0 0x7f37fc19af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:20:24.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.186+0000 7f3801038640 1 --2- 172.21.15.87:0/2982063129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37fc0fff90 0x7f37fc1961a0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f37f800c890 tx=0x7f37f800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:24.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.186+0000 7f37ee7fc640 1 -- 172.21.15.87:0/2982063129 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f8004220 con 0x7f37fc0fff90 2024-09-13T17:20:24.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.186+0000 7f380329c640 1 -- 172.21.15.87:0/2982063129 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37fc1a2d80 con 0x7f37fc0fff90 2024-09-13T17:20:24.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.186+0000 7f37ee7fc640 1 -- 172.21.15.87:0/2982063129 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f37f8007e60 con 0x7f37fc0fff90 2024-09-13T17:20:24.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.186+0000 7f37ee7fc640 1 -- 172.21.15.87:0/2982063129 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f8004a00 con 0x7f37fc0fff90 2024-09-13T17:20:24.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.186+0000 7f380329c640 1 -- 172.21.15.87:0/2982063129 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37fc1a3220 con 0x7f37fc0fff90 2024-09-13T17:20:24.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.188+0000 7f37ee7fc640 1 -- 172.21.15.87:0/2982063129 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f37f80079b0 con 0x7f37fc0fff90 2024-09-13T17:20:24.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.189+0000 7f3805fc6740 1 Processor -- start 2024-09-13T17:20:24.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.189+0000 7f3805fc6740 1 -- start start 2024-09-13T17:20:24.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.189+0000 7f3805fc6740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5615174ced30 0x5615174cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.189+0000 7f3805fc6740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5615174cf650 0x5615174ddea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.189+0000 7f3805fc6740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615174de3e0 0x5615174e07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.189+0000 7f3805fc6740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x561517439f20 con 0x5615174cf650 2024-09-13T17:20:24.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.189+0000 7f3805fc6740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615174376b0 con 0x5615174ced30 2024-09-13T17:20:24.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.189+0000 7f3805fc6740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x561517432fa0 con 0x5615174de3e0 2024-09-13T17:20:24.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.189+0000 7f37ee7fc640 1 --2- 172.21.15.87:0/2982063129 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f37e80a1200 0x7f37e80a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.189+0000 7f3801038640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5615174cf650 0x5615174ddea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.189+0000 7f3801038640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5615174cf650 0x5615174ddea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38956/0 (socket says 172.21.15.87:38956) 2024-09-13T17:20:24.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.189+0000 7f3801038640 1 -- 172.21.15.87:0/2054262988 learned_addr learned my addr 172.21.15.87:0/2054262988 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:24.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.189+0000 7f3800837640 1 --2- 172.21.15.87:0/2054262988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615174de3e0 0x5615174e07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.189+0000 7f3801839640 1 --2- 172.21.15.87:0/2982063129 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f37e80a1200 0x7f37e80a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.189+0000 7f3801839640 1 --2- 172.21.15.87:0/2054262988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5615174ced30 0x5615174cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.189+0000 7f37ee7fc640 1 -- 172.21.15.87:0/2982063129 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f37f80cceb0 con 0x7f37fc0fff90 2024-09-13T17:20:24.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.190+0000 7f3800837640 1 -- 172.21.15.87:0/2054262988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5615174ced30 msgr2=0x5615174cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:24.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.190+0000 7f3800837640 1 --2- 172.21.15.87:0/2054262988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5615174ced30 0x5615174cf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.190+0000 7f3800837640 1 -- 172.21.15.87:0/2054262988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5615174cf650 msgr2=0x5615174ddea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:24.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.190+0000 7f3800837640 1 --2- 172.21.15.87:0/2054262988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5615174cf650 0x5615174ddea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.190+0000 7f3800837640 1 -- 172.21.15.87:0/2054262988 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5615173ed840 con 0x5615174de3e0 2024-09-13T17:20:24.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.190+0000 7f3801839640 1 --2- 172.21.15.87:0/2982063129 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f37e80a1200 0x7f37e80a36c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009430 tx=0x7f37f4009360 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:24.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.190+0000 7f3800837640 1 --2- 172.21.15.87:0/2054262988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615174de3e0 0x5615174e07d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f37fc0695f0 tx=0x7f37f000cf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3db5609aa6de0067 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:24.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.190+0000 7f37e77fe640 1 -- 172.21.15.87:0/2054262988 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f0004050 con 0x5615174de3e0 2024-09-13T17:20:24.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.190+0000 7f37e77fe640 1 -- 172.21.15.87:0/2054262988 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f37f0005020 con 0x5615174de3e0 2024-09-13T17:20:24.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.190+0000 7f37e77fe640 1 -- 172.21.15.87:0/2054262988 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f0004c60 con 0x5615174de3e0 2024-09-13T17:20:24.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.191+0000 7f3805fc6740 1 -- 172.21.15.87:0/2054262988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615174de3e0 msgr2=0x5615174e07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.191+0000 7f3805fc6740 1 --2- 172.21.15.87:0/2054262988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615174de3e0 0x5615174e07d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f37fc0695f0 tx=0x7f37f000cf80 comp rx=0 tx=0).stop 2024-09-13T17:20:24.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.191+0000 7f3805fc6740 1 -- 172.21.15.87:0/2054262988 shutdown_connections 2024-09-13T17:20:24.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.191+0000 7f3805fc6740 1 --2- 172.21.15.87:0/2054262988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615174de3e0 0x5615174e07d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.191+0000 7f3805fc6740 1 --2- 172.21.15.87:0/2054262988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5615174cf650 0x5615174ddea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.191+0000 7f3805fc6740 1 --2- 172.21.15.87:0/2054262988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5615174ced30 0x5615174cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.191+0000 7f3805fc6740 1 -- 172.21.15.87:0/2054262988 >> 172.21.15.87:0/2054262988 conn(0x5615174cb380 msgr2=0x5615174cb760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:24.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.191+0000 7f3805fc6740 1 -- 172.21.15.87:0/2054262988 shutdown_connections 2024-09-13T17:20:24.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.191+0000 7f3805fc6740 1 -- 172.21.15.87:0/2054262988 wait complete. 2024-09-13T17:20:24.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.191+0000 7f3805fc6740 1 -- start start 2024-09-13T17:20:24.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.191+0000 7f3805fc6740 1 Processor -- start 2024-09-13T17:20:24.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.192+0000 7f3805fc6740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5615174ced30 0x5615174ddd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.192+0000 7f3805fc6740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615174cf650 0x5615174daf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.192+0000 7f3805fc6740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5615174de3e0 0x5615174db470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.192+0000 7f3805fc6740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615173d42a0 con 0x5615174ced30 2024-09-13T17:20:24.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.192+0000 7f3805fc6740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56151710b430 con 0x5615174de3e0 2024-09-13T17:20:24.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.192+0000 7f3805fc6740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615173b6680 con 0x5615174cf650 2024-09-13T17:20:24.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.192+0000 7f3805fc6740 10 client.0 _ll_register_callbacks cb 0x56151742c610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:20:24.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.192+0000 7f3801038640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5615174ced30 0x5615174ddd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.192+0000 7f3801038640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5615174ced30 0x5615174ddd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38968/0 (socket says 172.21.15.87:38968) 2024-09-13T17:20:24.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.192+0000 7f3801038640 1 -- 172.21.15.87:0/735721816 learned_addr learned my addr 172.21.15.87:0/735721816 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:24.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.192+0000 7f3800837640 1 --2- 172.21.15.87:0/735721816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615174cf650 0x5615174daf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.192+0000 7f3801839640 1 --2- 172.21.15.87:0/735721816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5615174de3e0 0x5615174db470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.192+0000 7f3801038640 1 -- 172.21.15.87:0/735721816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615174cf650 msgr2=0x5615174daf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:24.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.192+0000 7f3801038640 1 --2- 172.21.15.87:0/735721816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615174cf650 0x5615174daf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.192+0000 7f3801038640 1 -- 172.21.15.87:0/735721816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5615174de3e0 msgr2=0x5615174db470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:24.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.192+0000 7f3801038640 1 --2- 172.21.15.87:0/735721816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5615174de3e0 0x5615174db470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.192+0000 7f3801038640 1 -- 172.21.15.87:0/735721816 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37f000c750 con 0x5615174ced30 2024-09-13T17:20:24.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.192+0000 7f3800837640 1 --2- 172.21.15.87:0/735721816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615174cf650 0x5615174daf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:24.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.192+0000 7f3801038640 1 --2- 172.21.15.87:0/735721816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5615174ced30 0x5615174ddd00 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f37f8096620 tx=0x7f37f800a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b141692fb94fa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:24.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.192+0000 7f37e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:20:24.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.192+0000 7f37e4ff9640 1 -- 172.21.15.87:0/735721816 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f809d9e0 con 0x5615174ced30 2024-09-13T17:20:24.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.192+0000 7f37e4ff9640 1 -- 172.21.15.87:0/735721816 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f37f80962c0 con 0x5615174ced30 2024-09-13T17:20:24.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.192+0000 7f3805fc6740 1 -- 172.21.15.87:0/735721816 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5615171264e0 con 0x5615174ced30 2024-09-13T17:20:24.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.193+0000 7f37e4ff9640 1 -- 172.21.15.87:0/735721816 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37f8096480 con 0x5615174ced30 2024-09-13T17:20:24.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.193+0000 7f3805fc6740 10 client.17361 fetch_fsmap learned FSMap version 36 2024-09-13T17:20:24.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.193+0000 7f3805fc6740 1 -- 172.21.15.87:0/735721816 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x561517431620 con 0x5615174ced30 2024-09-13T17:20:24.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.193+0000 7f37e4ff9640 1 -- 172.21.15.87:0/735721816 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x5615171264e0 con 0x5615174ced30 2024-09-13T17:20:24.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.193+0000 7f37e4ff9640 1 -- 172.21.15.87:0/735721816 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f37f8016030 con 0x5615174ced30 2024-09-13T17:20:24.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.193+0000 7f3805fc6740 10 client.17361 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:20:24.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.193+0000 7f3805fc6740 10 client.17361 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:20:24.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.193+0000 7f3805fc6740 20 client.17361 populate_metadata read hostname 'smithi087' 2024-09-13T17:20:24.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.193+0000 7f3805fc6740 1 --2- 172.21.15.87:0/735721816 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5615174ee130 0x5615174f0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.193+0000 7f3805fc6740 4 client.17361 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:20:24.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.193+0000 7f3805fc6740 1 -- 172.21.15.87:0/735721816 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5615171377e0 con 0x5615174ee130 2024-09-13T17:20:24.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.193+0000 7f3800837640 1 --2- 172.21.15.87:0/735721816 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5615174ee130 0x5615174f0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.194+0000 7f37e4ff9640 10 client.17361 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:20:24.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.194+0000 7f3800837640 1 --2- 172.21.15.87:0/735721816 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5615174ee130 0x5615174f0550 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ce6e66d62ab003a server_cookie=99be634b5ddabf92 in_seq=0 out_seq=0 2024-09-13T17:20:24.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.194+0000 7f37e4ff9640 1 -- 172.21.15.87:0/735721816 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5615171377e0 con 0x5615174ee130 2024-09-13T17:20:24.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.194+0000 7f37e4ff9640 10 client.17361 handle_command_reply: tid=0 2024-09-13T17:20:24.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.194+0000 7f3805fc6740 1 client.17361 shutdown 2024-09-13T17:20:24.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.194+0000 7f3805fc6740 1 -- 172.21.15.87:0/735721816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5615174ced30 msgr2=0x5615174ddd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.194+0000 7f3805fc6740 1 --2- 172.21.15.87:0/735721816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5615174ced30 0x5615174ddd00 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f37f8096620 tx=0x7f37f800a5d0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.194+0000 7f3805fc6740 1 -- 172.21.15.87:0/735721816 shutdown_connections 2024-09-13T17:20:24.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.194+0000 7f3805fc6740 1 --2- 172.21.15.87:0/735721816 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5615174ee130 0x5615174f0550 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.194+0000 7f3805fc6740 1 --2- 172.21.15.87:0/735721816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5615174de3e0 0x5615174db470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.194+0000 7f37e4ff9640 0 client.17361 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:20:24.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.194+0000 7f3805fc6740 1 --2- 172.21.15.87:0/735721816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615174cf650 0x5615174daf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.194+0000 7f3805fc6740 1 --2- 172.21.15.87:0/735721816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5615174ced30 0x5615174ddd00 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.194+0000 7f3805fc6740 1 -- 172.21.15.87:0/735721816 >> 172.21.15.87:0/735721816 conn(0x5615174cb380 msgr2=0x5615174ca510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:24.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.195+0000 7f3805fc6740 1 -- 172.21.15.87:0/735721816 shutdown_connections 2024-09-13T17:20:24.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.195+0000 7f3805fc6740 1 -- 172.21.15.87:0/735721816 wait complete. 2024-09-13T17:20:24.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.195+0000 7f3805fc6740 20 client.17361 trim_cache size 0 max 16384 2024-09-13T17:20:24.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.209+0000 7f3805fc6740 1 Processor -- start 2024-09-13T17:20:24.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.209+0000 7f3805fc6740 1 -- start start 2024-09-13T17:20:24.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.209+0000 7f3805fc6740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5615174ced30 0x5615174cad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.209+0000 7f3805fc6740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615174cf650 0x5615174dd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.209+0000 7f3805fc6740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5615174de3e0 0x5615174d8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.209+0000 7f3805fc6740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615171264e0 con 0x5615174ced30 2024-09-13T17:20:24.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.209+0000 7f3805fc6740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615174ceb90 con 0x5615174de3e0 2024-09-13T17:20:24.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.209+0000 7f3805fc6740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615174f5780 con 0x5615174cf650 2024-09-13T17:20:24.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.209+0000 7f3801038640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5615174ced30 0x5615174cad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.209+0000 7f3801038640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5615174ced30 0x5615174cad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38984/0 (socket says 172.21.15.87:38984) 2024-09-13T17:20:24.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.209+0000 7f3801038640 1 -- 172.21.15.87:0/2614734978 learned_addr learned my addr 172.21.15.87:0/2614734978 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:24.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.209+0000 7f3801038640 1 -- 172.21.15.87:0/2614734978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615174cf650 msgr2=0x5615174dd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:24.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.209+0000 7f3801038640 1 --2- 172.21.15.87:0/2614734978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615174cf650 0x5615174dd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.209+0000 7f3801038640 1 -- 172.21.15.87:0/2614734978 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5615174de3e0 msgr2=0x5615174d8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:24.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.209+0000 7f3801038640 1 --2- 172.21.15.87:0/2614734978 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5615174de3e0 0x5615174d8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.209+0000 7f3801038640 1 -- 172.21.15.87:0/2614734978 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5615173d3790 con 0x5615174ced30 2024-09-13T17:20:24.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.209+0000 7f3801038640 1 --2- 172.21.15.87:0/2614734978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5615174ced30 0x5615174cad00 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f37f8005fd0 tx=0x7f37f80959a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=295c617cba979136 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:24.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.210+0000 7f37e7fff640 1 -- 172.21.15.87:0/2614734978 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f809d9e0 con 0x5615174ced30 2024-09-13T17:20:24.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.210+0000 7f37e7fff640 1 -- 172.21.15.87:0/2614734978 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f37f80a2030 con 0x5615174ced30 2024-09-13T17:20:24.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.210+0000 7f37e7fff640 1 -- 172.21.15.87:0/2614734978 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f80a1ba0 con 0x5615174ced30 2024-09-13T17:20:24.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.210+0000 7f3805fc6740 1 -- 172.21.15.87:0/2614734978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5615174ced30 msgr2=0x5615174cad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.210+0000 7f3805fc6740 1 --2- 172.21.15.87:0/2614734978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5615174ced30 0x5615174cad00 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f37f8005fd0 tx=0x7f37f80959a0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.210+0000 7f3805fc6740 1 -- 172.21.15.87:0/2614734978 shutdown_connections 2024-09-13T17:20:24.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.210+0000 7f3805fc6740 1 --2- 172.21.15.87:0/2614734978 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5615174de3e0 0x5615174d8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.210+0000 7f3805fc6740 1 --2- 172.21.15.87:0/2614734978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615174cf650 0x5615174dd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.210+0000 7f3805fc6740 1 --2- 172.21.15.87:0/2614734978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5615174ced30 0x5615174cad00 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.210+0000 7f3805fc6740 1 -- 172.21.15.87:0/2614734978 >> 172.21.15.87:0/2614734978 conn(0x5615174cb380 msgr2=0x5615174d97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:24.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.210+0000 7f3805fc6740 1 -- 172.21.15.87:0/2614734978 shutdown_connections 2024-09-13T17:20:24.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.210+0000 7f3805fc6740 1 -- 172.21.15.87:0/2614734978 wait complete. 2024-09-13T17:20:24.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.210+0000 7f3805fc6740 1 -- start start 2024-09-13T17:20:24.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.211+0000 7f3805fc6740 1 Processor -- start 2024-09-13T17:20:24.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.211+0000 7f3805fc6740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5615174ced30 0x5615174e5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.211+0000 7f3805fc6740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615174cf650 0x5615174e3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.211+0000 7f3805fc6740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5615174de3e0 0x5615174e3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.211+0000 7f3805fc6740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615174e4650 con 0x5615174ced30 2024-09-13T17:20:24.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.211+0000 7f3805fc6740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615174e47c0 con 0x5615174de3e0 2024-09-13T17:20:24.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.211+0000 7f3805fc6740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x561517544660 con 0x5615174cf650 2024-09-13T17:20:24.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.211+0000 7f3805fc6740 10 client.0 _ll_register_callbacks cb 0x7f37f80058c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:20:24.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.211+0000 7f3801038640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5615174ced30 0x5615174e5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.211+0000 7f3801038640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5615174ced30 0x5615174e5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38994/0 (socket says 172.21.15.87:38994) 2024-09-13T17:20:24.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.211+0000 7f3801038640 1 -- 172.21.15.87:0/420321294 learned_addr learned my addr 172.21.15.87:0/420321294 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:24.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.211+0000 7f3800837640 1 --2- 172.21.15.87:0/420321294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615174cf650 0x5615174e3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.211+0000 7f3801839640 1 --2- 172.21.15.87:0/420321294 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5615174de3e0 0x5615174e3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.211+0000 7f3801038640 1 -- 172.21.15.87:0/420321294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615174cf650 msgr2=0x5615174e3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:24.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.211+0000 7f3801038640 1 --2- 172.21.15.87:0/420321294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615174cf650 0x5615174e3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.211+0000 7f3801038640 1 -- 172.21.15.87:0/420321294 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5615174de3e0 msgr2=0x5615174e3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:24.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.211+0000 7f3801038640 1 --2- 172.21.15.87:0/420321294 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5615174de3e0 0x5615174e3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.211+0000 7f3801038640 1 -- 172.21.15.87:0/420321294 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561517431620 con 0x5615174ced30 2024-09-13T17:20:24.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.211+0000 7f3801839640 1 --2- 172.21.15.87:0/420321294 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5615174de3e0 0x5615174e3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:24.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.212+0000 7f3801038640 1 --2- 172.21.15.87:0/420321294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5615174ced30 0x5615174e5550 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f37f809ad80 tx=0x7f37f80a1dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53de2b206e4b7585 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:24.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.212+0000 7f37e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:20:24.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.212+0000 7f37e4ff9640 1 -- 172.21.15.87:0/420321294 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f807e070 con 0x5615174ced30 2024-09-13T17:20:24.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.212+0000 7f37e4ff9640 1 -- 172.21.15.87:0/420321294 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f37f8007c60 con 0x5615174ced30 2024-09-13T17:20:24.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.212+0000 7f3805fc6740 1 -- 172.21.15.87:0/420321294 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f37f0005020 con 0x5615174ced30 2024-09-13T17:20:24.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.212+0000 7f37e4ff9640 1 -- 172.21.15.87:0/420321294 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37f80962c0 con 0x5615174ced30 2024-09-13T17:20:24.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.212+0000 7f3805fc6740 10 client.17367 fetch_fsmap learned FSMap version 36 2024-09-13T17:20:24.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.212+0000 7f3805fc6740 1 -- 172.21.15.87:0/420321294 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5615173f8ea0 con 0x5615174ced30 2024-09-13T17:20:24.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.212+0000 7f37e4ff9640 1 -- 172.21.15.87:0/420321294 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f37f80aa080 con 0x5615174ced30 2024-09-13T17:20:24.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.212+0000 7f37e4ff9640 1 -- 172.21.15.87:0/420321294 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f37f8081020 con 0x5615174ced30 2024-09-13T17:20:24.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.212+0000 7f3805fc6740 10 client.17367 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:20:24.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.212+0000 7f3805fc6740 10 client.17367 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:20:24.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.212+0000 7f3805fc6740 20 client.17367 populate_metadata read hostname 'smithi087' 2024-09-13T17:20:24.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.212+0000 7f3805fc6740 1 --2- 172.21.15.87:0/420321294 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5615175458c0 0x561517547cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.212+0000 7f3805fc6740 4 client.17367 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:20:24.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.212+0000 7f3805fc6740 1 -- 172.21.15.87:0/420321294 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56151718ae30 con 0x5615175458c0 2024-09-13T17:20:24.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.212+0000 7f3800837640 1 --2- 172.21.15.87:0/420321294 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5615175458c0 0x561517547cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.213+0000 7f37e4ff9640 10 client.17367 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:20:24.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.213+0000 7f3800837640 1 --2- 172.21.15.87:0/420321294 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5615175458c0 0x561517547cb0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68244acb2cc532bf server_cookie=cebfaa3ad786ca9e in_seq=0 out_seq=0 2024-09-13T17:20:24.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.213+0000 7f37e4ff9640 1 -- 172.21.15.87:0/420321294 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x56151718ae30 con 0x5615175458c0 2024-09-13T17:20:24.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.213+0000 7f37e4ff9640 10 client.17367 handle_command_reply: tid=0 2024-09-13T17:20:24.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.213+0000 7f3805fc6740 1 client.17367 shutdown 2024-09-13T17:20:24.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.213+0000 7f3805fc6740 1 -- 172.21.15.87:0/420321294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5615174ced30 msgr2=0x5615174e5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.213+0000 7f3805fc6740 1 --2- 172.21.15.87:0/420321294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5615174ced30 0x5615174e5550 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f37f809ad80 tx=0x7f37f80a1dd0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.213+0000 7f3805fc6740 1 -- 172.21.15.87:0/420321294 shutdown_connections 2024-09-13T17:20:24.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.213+0000 7f3805fc6740 1 --2- 172.21.15.87:0/420321294 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5615175458c0 0x561517547cb0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.213+0000 7f3805fc6740 1 --2- 172.21.15.87:0/420321294 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5615174de3e0 0x5615174e3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.213+0000 7f37e4ff9640 0 client.17367 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:20:24.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.213+0000 7f3805fc6740 1 --2- 172.21.15.87:0/420321294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615174cf650 0x5615174e3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.213+0000 7f3805fc6740 1 --2- 172.21.15.87:0/420321294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5615174ced30 0x5615174e5550 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.213+0000 7f3805fc6740 1 -- 172.21.15.87:0/420321294 >> 172.21.15.87:0/420321294 conn(0x5615174cb380 msgr2=0x5615174d9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:24.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.213+0000 7f3805fc6740 1 -- 172.21.15.87:0/420321294 shutdown_connections 2024-09-13T17:20:24.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.213+0000 7f3805fc6740 1 -- 172.21.15.87:0/420321294 wait complete. 2024-09-13T17:20:24.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.213+0000 7f3805fc6740 20 client.17367 trim_cache size 0 max 16384 2024-09-13T17:20:24.224 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:20:24.224 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "no active scrubs running", 2024-09-13T17:20:24.224 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": {} 2024-09-13T17:20:24.224 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:20:24.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.214+0000 7f380329c640 1 -- 172.21.15.87:0/2982063129 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f37e80a1200 msgr2=0x7f37e80a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.214+0000 7f380329c640 1 --2- 172.21.15.87:0/2982063129 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f37e80a1200 0x7f37e80a36c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009430 tx=0x7f37f4009360 comp rx=0 tx=0).stop 2024-09-13T17:20:24.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.214+0000 7f380329c640 1 -- 172.21.15.87:0/2982063129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37fc0fff90 msgr2=0x7f37fc1961a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.214+0000 7f380329c640 1 --2- 172.21.15.87:0/2982063129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37fc0fff90 0x7f37fc1961a0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f37f800c890 tx=0x7f37f800cd50 comp rx=0 tx=0).stop 2024-09-13T17:20:24.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.214+0000 7f380329c640 1 -- 172.21.15.87:0/2982063129 shutdown_connections 2024-09-13T17:20:24.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.214+0000 7f380329c640 1 --2- 172.21.15.87:0/2982063129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37fc19aad0 0x7f37fc19af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.214+0000 7f380329c640 1 --2- 172.21.15.87:0/2982063129 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37fc1050e0 0x7f37fc1966e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.214+0000 7f380329c640 1 --2- 172.21.15.87:0/2982063129 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f37e80a1200 0x7f37e80a36c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.214+0000 7f380329c640 1 --2- 172.21.15.87:0/2982063129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37fc0fff90 0x7f37fc1961a0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.214+0000 7f380329c640 1 -- 172.21.15.87:0/2982063129 >> 172.21.15.87:0/2982063129 conn(0x7f37fc0fba20 msgr2=0x7f37fc0fcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:24.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.214+0000 7f380329c640 1 -- 172.21.15.87:0/2982063129 shutdown_connections 2024-09-13T17:20:24.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.214+0000 7f380329c640 1 -- 172.21.15.87:0/2982063129 wait complete. 2024-09-13T17:20:24.227 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T17:20:24.227 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:20:24.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.323+0000 7f3b0a4e5640 1 -- 172.21.15.87:0/3588504785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b04100920 msgr2=0x7f3b04104960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.323+0000 7f3b0a4e5640 1 --2- 172.21.15.87:0/3588504785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b04100920 0x7f3b04104960 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f3aec009930 tx=0x7f3aec02a420 comp rx=0 tx=0).stop 2024-09-13T17:20:24.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.323+0000 7f3b0a4e5640 1 -- 172.21.15.87:0/3588504785 shutdown_connections 2024-09-13T17:20:24.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.323+0000 7f3b0a4e5640 1 --2- 172.21.15.87:0/3588504785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b041050c0 0x7f3b0410cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.323+0000 7f3b0a4e5640 1 --2- 172.21.15.87:0/3588504785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b04100920 0x7f3b04104960 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.323+0000 7f3b0a4e5640 1 --2- 172.21.15.87:0/3588504785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b040fff70 0x7f3b04100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.323+0000 7f3b0a4e5640 1 -- 172.21.15.87:0/3588504785 >> 172.21.15.87:0/3588504785 conn(0x7f3b040fba20 msgr2=0x7f3b040fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:24.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.323+0000 7f3b0a4e5640 1 -- 172.21.15.87:0/3588504785 shutdown_connections 2024-09-13T17:20:24.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.323+0000 7f3b0a4e5640 1 -- 172.21.15.87:0/3588504785 wait complete. 2024-09-13T17:20:24.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.323+0000 7f3b0a4e5640 1 Processor -- start 2024-09-13T17:20:24.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.323+0000 7f3b0a4e5640 1 -- start start 2024-09-13T17:20:24.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.324+0000 7f3b0a4e5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b040fff70 0x7f3b041963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.324+0000 7f3b0a4e5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b041050c0 0x7f3b041968f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.324+0000 7f3b0a4e5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b0419ace0 0x7f3b0419b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.324+0000 7f3b0a4e5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0419b6d0 con 0x7f3b0419ace0 2024-09-13T17:20:24.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.324+0000 7f3b0a4e5640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0419b840 con 0x7f3b041050c0 2024-09-13T17:20:24.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.324+0000 7f3b0a4e5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0419b9b0 con 0x7f3b040fff70 2024-09-13T17:20:24.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.324+0000 7f3b08a82640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b0419ace0 0x7f3b0419b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.324+0000 7f3b08a82640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b0419ace0 0x7f3b0419b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39024/0 (socket says 172.21.15.87:39024) 2024-09-13T17:20:24.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.324+0000 7f3b08a82640 1 -- 172.21.15.87:0/1481482256 learned_addr learned my addr 172.21.15.87:0/1481482256 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:24.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.324+0000 7f3afbfff640 1 --2- 172.21.15.87:0/1481482256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b041050c0 0x7f3b041968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.324+0000 7f3b03fff640 1 --2- 172.21.15.87:0/1481482256 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b040fff70 0x7f3b041963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.324+0000 7f3b08a82640 1 -- 172.21.15.87:0/1481482256 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b040fff70 msgr2=0x7f3b041963b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.324+0000 7f3b08a82640 1 --2- 172.21.15.87:0/1481482256 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b040fff70 0x7f3b041963b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.324+0000 7f3b08a82640 1 -- 172.21.15.87:0/1481482256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b041050c0 msgr2=0x7f3b041968f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.324+0000 7f3b08a82640 1 --2- 172.21.15.87:0/1481482256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b041050c0 0x7f3b041968f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.324+0000 7f3b08a82640 1 -- 172.21.15.87:0/1481482256 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aec009560 con 0x7f3b0419ace0 2024-09-13T17:20:24.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.324+0000 7f3b08a82640 1 --2- 172.21.15.87:0/1481482256 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b0419ace0 0x7f3b0419b190 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f3afc00cad0 tx=0x7f3afc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:24.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.324+0000 7f3b01ffb640 1 -- 172.21.15.87:0/1481482256 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc00ae20 con 0x7f3b0419ace0 2024-09-13T17:20:24.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.324+0000 7f3b01ffb640 1 -- 172.21.15.87:0/1481482256 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3afc005020 con 0x7f3b0419ace0 2024-09-13T17:20:24.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.324+0000 7f3b0a4e5640 1 -- 172.21.15.87:0/1481482256 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b041a2f90 con 0x7f3b0419ace0 2024-09-13T17:20:24.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.324+0000 7f3b01ffb640 1 -- 172.21.15.87:0/1481482256 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc00f690 con 0x7f3b0419ace0 2024-09-13T17:20:24.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.325+0000 7f3b0a4e5640 1 -- 172.21.15.87:0/1481482256 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b041a3440 con 0x7f3b0419ace0 2024-09-13T17:20:24.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.325+0000 7f3b0a4e5640 1 -- 172.21.15.87:0/1481482256 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b04101440 con 0x7f3b0419ace0 2024-09-13T17:20:24.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.327+0000 7f3b01ffb640 1 -- 172.21.15.87:0/1481482256 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f3afc005190 con 0x7f3b0419ace0 2024-09-13T17:20:24.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.327+0000 7f3b01ffb640 1 --2- 172.21.15.87:0/1481482256 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f3af00a1280 0x7f3af00a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.327+0000 7f3b03fff640 1 --2- 172.21.15.87:0/1481482256 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f3af00a1280 0x7f3af00a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.327+0000 7f3b01ffb640 1 -- 172.21.15.87:0/1481482256 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f3afc0cd3d0 con 0x7f3b0419ace0 2024-09-13T17:20:24.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.328+0000 7f3b03fff640 1 --2- 172.21.15.87:0/1481482256 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f3af00a1280 0x7f3af00a3740 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3af400bbe0 tx=0x7f3af400b390 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:24.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.330+0000 7f3b01ffb640 1 -- 172.21.15.87:0/1481482256 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3afc0964e0 con 0x7f3b0419ace0 2024-09-13T17:20:24.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.529+0000 7f3b0a4e5640 1 -- 172.21.15.87:0/1481482256 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b04100350 con 0x7f3b0419ace0 2024-09-13T17:20:24.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.530+0000 7f3b01ffb640 1 -- 172.21.15.87:0/1481482256 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+10877 (secure 0 0 0) 0x7f3afc01d070 con 0x7f3b0419ace0 2024-09-13T17:20:24.532 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:20:24.532 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/3674545180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":3674545180},{"type":"v1","addr":"172.21.15.87:6841","nonce":3674545180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:11:23.313609+0000","modified":"2024-09-13T17:19:40.570296+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24484,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6839/3052680456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3052680456},{"type":"v1","addr":"172.21.15.118:6839","nonce":3052680456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:20:24.532 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 36 2024-09-13T17:20:24.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.532+0000 7f3b0a4e5640 1 -- 172.21.15.87:0/1481482256 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f3af00a1280 msgr2=0x7f3af00a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.532+0000 7f3b0a4e5640 1 --2- 172.21.15.87:0/1481482256 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f3af00a1280 0x7f3af00a3740 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3af400bbe0 tx=0x7f3af400b390 comp rx=0 tx=0).stop 2024-09-13T17:20:24.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.532+0000 7f3b0a4e5640 1 -- 172.21.15.87:0/1481482256 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b0419ace0 msgr2=0x7f3b0419b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.532+0000 7f3b0a4e5640 1 --2- 172.21.15.87:0/1481482256 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b0419ace0 0x7f3b0419b190 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f3afc00cad0 tx=0x7f3afc00cf90 comp rx=0 tx=0).stop 2024-09-13T17:20:24.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.532+0000 7f3b0a4e5640 1 -- 172.21.15.87:0/1481482256 shutdown_connections 2024-09-13T17:20:24.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.532+0000 7f3b0a4e5640 1 --2- 172.21.15.87:0/1481482256 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f3af00a1280 0x7f3af00a3740 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.532+0000 7f3b0a4e5640 1 --2- 172.21.15.87:0/1481482256 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b0419ace0 0x7f3b0419b190 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.532+0000 7f3b0a4e5640 1 --2- 172.21.15.87:0/1481482256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b041050c0 0x7f3b041968f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.532+0000 7f3b0a4e5640 1 --2- 172.21.15.87:0/1481482256 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b040fff70 0x7f3b041963b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.532+0000 7f3b0a4e5640 1 -- 172.21.15.87:0/1481482256 >> 172.21.15.87:0/1481482256 conn(0x7f3b040fba20 msgr2=0x7f3b040fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:24.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.532+0000 7f3b0a4e5640 1 -- 172.21.15.87:0/1481482256 shutdown_connections 2024-09-13T17:20:24.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.532+0000 7f3b0a4e5640 1 -- 172.21.15.87:0/1481482256 wait complete. 2024-09-13T17:20:24.545 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-09-13T17:20:24.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.644+0000 7fded82b1640 1 -- 172.21.15.87:0/1927235416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fded00ff800 msgr2=0x7fded0103840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.644+0000 7fded82b1640 1 --2- 172.21.15.87:0/1927235416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fded00ff800 0x7fded0103840 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fdec4009930 tx=0x7fdec402a420 comp rx=0 tx=0).stop 2024-09-13T17:20:24.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.644+0000 7fded82b1640 1 -- 172.21.15.87:0/1927235416 shutdown_connections 2024-09-13T17:20:24.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.644+0000 7fded82b1640 1 --2- 172.21.15.87:0/1927235416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fded0103fa0 0x7fded010baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.644+0000 7fded82b1640 1 --2- 172.21.15.87:0/1927235416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fded00ff800 0x7fded0103840 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.644+0000 7fded82b1640 1 --2- 172.21.15.87:0/1927235416 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fded00fee50 0x7fded00ff230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.644+0000 7fded82b1640 1 -- 172.21.15.87:0/1927235416 >> 172.21.15.87:0/1927235416 conn(0x7fded00fa8c0 msgr2=0x7fded00fcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:24.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.644+0000 7fded82b1640 1 -- 172.21.15.87:0/1927235416 shutdown_connections 2024-09-13T17:20:24.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.644+0000 7fded82b1640 1 -- 172.21.15.87:0/1927235416 wait complete. 2024-09-13T17:20:24.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.644+0000 7fded82b1640 1 Processor -- start 2024-09-13T17:20:24.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.645+0000 7fded82b1640 1 -- start start 2024-09-13T17:20:24.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.645+0000 7fded82b1640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fded00fee50 0x7fded01962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.645+0000 7fded82b1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fded0103fa0 0x7fded0196820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.645+0000 7fded82b1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fded019ac10 0x7fded019b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.645+0000 7fded82b1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded019b600 con 0x7fded0103fa0 2024-09-13T17:20:24.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.645+0000 7fded82b1640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded019b770 con 0x7fded019ac10 2024-09-13T17:20:24.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.645+0000 7fded82b1640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded019b8e0 con 0x7fded00fee50 2024-09-13T17:20:24.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.645+0000 7fded584c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fded0103fa0 0x7fded0196820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.645+0000 7fded584c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fded0103fa0 0x7fded0196820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39040/0 (socket says 172.21.15.87:39040) 2024-09-13T17:20:24.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.645+0000 7fded584c640 1 -- 172.21.15.87:0/398450419 learned_addr learned my addr 172.21.15.87:0/398450419 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:24.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.645+0000 7fded604d640 1 --2- 172.21.15.87:0/398450419 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fded00fee50 0x7fded01962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.645+0000 7fded684e640 1 --2- 172.21.15.87:0/398450419 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fded019ac10 0x7fded019b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.645+0000 7fded584c640 1 -- 172.21.15.87:0/398450419 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fded00fee50 msgr2=0x7fded01962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.645+0000 7fded584c640 1 --2- 172.21.15.87:0/398450419 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fded00fee50 0x7fded01962e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.645+0000 7fded584c640 1 -- 172.21.15.87:0/398450419 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fded019ac10 msgr2=0x7fded019b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.645+0000 7fded584c640 1 --2- 172.21.15.87:0/398450419 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fded019ac10 0x7fded019b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.645+0000 7fded584c640 1 -- 172.21.15.87:0/398450419 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec4009560 con 0x7fded0103fa0 2024-09-13T17:20:24.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.645+0000 7fded684e640 1 --2- 172.21.15.87:0/398450419 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fded019ac10 0x7fded019b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:24.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.645+0000 7fded584c640 1 --2- 172.21.15.87:0/398450419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fded0103fa0 0x7fded0196820 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fdec4009900 tx=0x7fdec40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:24.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.645+0000 7fdecf7fe640 1 -- 172.21.15.87:0/398450419 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec4003a00 con 0x7fded0103fa0 2024-09-13T17:20:24.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.645+0000 7fdecf7fe640 1 -- 172.21.15.87:0/398450419 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdec40044e0 con 0x7fded0103fa0 2024-09-13T17:20:24.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.646+0000 7fded82b1640 1 -- 172.21.15.87:0/398450419 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded01a2ec0 con 0x7fded0103fa0 2024-09-13T17:20:24.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.646+0000 7fdecf7fe640 1 -- 172.21.15.87:0/398450419 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec403bdb0 con 0x7fded0103fa0 2024-09-13T17:20:24.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.646+0000 7fded82b1640 1 -- 172.21.15.87:0/398450419 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded01a3230 con 0x7fded0103fa0 2024-09-13T17:20:24.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.648+0000 7fdecf7fe640 1 -- 172.21.15.87:0/398450419 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fdec4003c60 con 0x7fded0103fa0 2024-09-13T17:20:24.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.648+0000 7fdedafd1740 1 Processor -- start 2024-09-13T17:20:24.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.648+0000 7fdedafd1740 1 -- start start 2024-09-13T17:20:24.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.648+0000 7fdedafd1740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5556871d9790 0x5556871d9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.648+0000 7fdedafd1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556871da0b0 0x5556871e4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.648+0000 7fdedafd1740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5556871e4950 0x5556871e6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.648+0000 7fdedafd1740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555687143cc0 con 0x5556871da0b0 2024-09-13T17:20:24.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.648+0000 7fdedafd1740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555687141450 con 0x5556871e4950 2024-09-13T17:20:24.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.648+0000 7fdedafd1740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55568713cd40 con 0x5556871d9790 2024-09-13T17:20:24.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.648+0000 7fded604d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556871da0b0 0x5556871e4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.648+0000 7fdecf7fe640 1 --2- 172.21.15.87:0/398450419 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdeb80a1200 0x7fdeb80a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.648+0000 7fded604d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556871da0b0 0x5556871e4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39056/0 (socket says 172.21.15.87:39056) 2024-09-13T17:20:24.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.648+0000 7fded604d640 1 -- 172.21.15.87:0/1245570410 learned_addr learned my addr 172.21.15.87:0/1245570410 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:24.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.649+0000 7fded684e640 1 --2- 172.21.15.87:0/1245570410 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5556871d9790 0x5556871d9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.649+0000 7fded684e640 1 --2- 172.21.15.87:0/398450419 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdeb80a1200 0x7fdeb80a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.649+0000 7fdecf7fe640 1 -- 172.21.15.87:0/398450419 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fdec40ee0e0 con 0x7fded0103fa0 2024-09-13T17:20:24.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.649+0000 7fded584c640 1 --2- 172.21.15.87:0/1245570410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5556871e4950 0x5556871e6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.649+0000 7fded604d640 1 -- 172.21.15.87:0/1245570410 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5556871d9790 msgr2=0x5556871d9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:24.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.649+0000 7fded604d640 1 --2- 172.21.15.87:0/1245570410 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5556871d9790 0x5556871d9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.649+0000 7fded604d640 1 -- 172.21.15.87:0/1245570410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5556871e4950 msgr2=0x5556871e6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:24.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.649+0000 7fded604d640 1 --2- 172.21.15.87:0/1245570410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5556871e4950 0x5556871e6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.649+0000 7fded604d640 1 -- 172.21.15.87:0/1245570410 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555687104620 con 0x5556871da0b0 2024-09-13T17:20:24.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.649+0000 7fded584c640 1 --2- 172.21.15.87:0/1245570410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5556871e4950 0x5556871e6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:24.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.649+0000 7fded604d640 1 --2- 172.21.15.87:0/1245570410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556871da0b0 0x5556871e4410 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fdec800acf0 tx=0x7fdec800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba4cb5729b091888 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:24.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.649+0000 7fded684e640 1 --2- 172.21.15.87:0/398450419 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdeb80a1200 0x7fdeb80a36c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdec0005c40 tx=0x7fdec0009200 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:24.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.649+0000 7fdecce05640 1 -- 172.21.15.87:0/1245570410 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec800a7c0 con 0x5556871da0b0 2024-09-13T17:20:24.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.649+0000 7fdecce05640 1 -- 172.21.15.87:0/1245570410 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdec8018af0 con 0x5556871da0b0 2024-09-13T17:20:24.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.649+0000 7fdecce05640 1 -- 172.21.15.87:0/1245570410 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec8010c90 con 0x5556871da0b0 2024-09-13T17:20:24.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.650+0000 7fdedafd1740 1 -- 172.21.15.87:0/1245570410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556871da0b0 msgr2=0x5556871e4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.650+0000 7fdedafd1740 1 --2- 172.21.15.87:0/1245570410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556871da0b0 0x5556871e4410 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fdec800acf0 tx=0x7fdec800f790 comp rx=0 tx=0).stop 2024-09-13T17:20:24.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.650+0000 7fdedafd1740 1 -- 172.21.15.87:0/1245570410 shutdown_connections 2024-09-13T17:20:24.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.650+0000 7fdedafd1740 1 --2- 172.21.15.87:0/1245570410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5556871e4950 0x5556871e6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.650+0000 7fdedafd1740 1 --2- 172.21.15.87:0/1245570410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556871da0b0 0x5556871e4410 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.650+0000 7fdedafd1740 1 --2- 172.21.15.87:0/1245570410 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5556871d9790 0x5556871d9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.650+0000 7fdedafd1740 1 -- 172.21.15.87:0/1245570410 >> 172.21.15.87:0/1245570410 conn(0x5556871d5d00 msgr2=0x5556871d60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:24.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.650+0000 7fdedafd1740 1 -- 172.21.15.87:0/1245570410 shutdown_connections 2024-09-13T17:20:24.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.650+0000 7fdedafd1740 1 -- 172.21.15.87:0/1245570410 wait complete. 2024-09-13T17:20:24.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.650+0000 7fdedafd1740 1 -- start start 2024-09-13T17:20:24.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.650+0000 7fdedafd1740 1 Processor -- start 2024-09-13T17:20:24.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.651+0000 7fdedafd1740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5556871d9790 0x5556871e3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.651+0000 7fdedafd1740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5556871da0b0 0x5556871e12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.651+0000 7fdedafd1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556871e4950 0x5556871e1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.651+0000 7fdedafd1740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556870fb180 con 0x5556871e4950 2024-09-13T17:20:24.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.651+0000 7fdedafd1740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555686e15430 con 0x5556871da0b0 2024-09-13T17:20:24.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.651+0000 7fdedafd1740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556870c05e0 con 0x5556871d9790 2024-09-13T17:20:24.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.651+0000 7fdedafd1740 10 client.0 _ll_register_callbacks cb 0x55568712caa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:20:24.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.651+0000 7fded684e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556871e4950 0x5556871e1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.651+0000 7fded684e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556871e4950 0x5556871e1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39068/0 (socket says 172.21.15.87:39068) 2024-09-13T17:20:24.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.651+0000 7fded684e640 1 -- 172.21.15.87:0/2548253550 learned_addr learned my addr 172.21.15.87:0/2548253550 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:24.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.651+0000 7fded604d640 1 --2- 172.21.15.87:0/2548253550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5556871d9790 0x5556871e3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.651+0000 7fded584c640 1 --2- 172.21.15.87:0/2548253550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5556871da0b0 0x5556871e12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.651+0000 7fded684e640 1 -- 172.21.15.87:0/2548253550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5556871d9790 msgr2=0x5556871e3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:24.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.651+0000 7fded684e640 1 --2- 172.21.15.87:0/2548253550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5556871d9790 0x5556871e3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.651+0000 7fded684e640 1 -- 172.21.15.87:0/2548253550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5556871da0b0 msgr2=0x5556871e12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:24.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.651+0000 7fded684e640 1 --2- 172.21.15.87:0/2548253550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5556871da0b0 0x5556871e12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.651+0000 7fded684e640 1 -- 172.21.15.87:0/2548253550 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec800a920 con 0x5556871e4950 2024-09-13T17:20:24.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.651+0000 7fded684e640 1 --2- 172.21.15.87:0/2548253550 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556871e4950 0x5556871e1830 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fdec0014310 tx=0x7fdec0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14e932bb6093442 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:24.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.651+0000 7fdeb5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:20:24.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.651+0000 7fdeb5ffb640 1 -- 172.21.15.87:0/2548253550 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec000fba0 con 0x5556871e4950 2024-09-13T17:20:24.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.651+0000 7fdeb5ffb640 1 -- 172.21.15.87:0/2548253550 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fdec000fd00 con 0x5556871e4950 2024-09-13T17:20:24.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.651+0000 7fdedafd1740 1 -- 172.21.15.87:0/2548253550 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555687166b80 con 0x5556871e4950 2024-09-13T17:20:24.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.651+0000 7fdeb5ffb640 1 -- 172.21.15.87:0/2548253550 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdec000fec0 con 0x5556871e4950 2024-09-13T17:20:24.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.651+0000 7fdedafd1740 10 client.17385 fetch_fsmap learned FSMap version 36 2024-09-13T17:20:24.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.651+0000 7fdedafd1740 1 -- 172.21.15.87:0/2548253550 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55568713b3c0 con 0x5556871e4950 2024-09-13T17:20:24.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.652+0000 7fdeb5ffb640 1 -- 172.21.15.87:0/2548253550 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x555687166b80 con 0x5556871e4950 2024-09-13T17:20:24.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.652+0000 7fdeb5ffb640 1 -- 172.21.15.87:0/2548253550 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fdec001f040 con 0x5556871e4950 2024-09-13T17:20:24.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.652+0000 7fdedafd1740 10 client.17385 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:20:24.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.652+0000 7fdedafd1740 10 client.17385 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:20:24.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.652+0000 7fdedafd1740 20 client.17385 populate_metadata read hostname 'smithi087' 2024-09-13T17:20:24.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.652+0000 7fdedafd1740 1 --2- 172.21.15.87:0/2548253550 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x5556871f4200 0x5556871f6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.652+0000 7fdedafd1740 4 client.17385 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:20:24.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.652+0000 7fdedafd1740 1 -- 172.21.15.87:0/2548253550 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55568712f1f0 con 0x5556871f4200 2024-09-13T17:20:24.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.652+0000 7fded604d640 1 --2- 172.21.15.87:0/2548253550 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x5556871f4200 0x5556871f6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.653+0000 7fdeb5ffb640 10 client.17385 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:20:24.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.653+0000 7fded604d640 1 --2- 172.21.15.87:0/2548253550 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x5556871f4200 0x5556871f6620 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=966920c1c62923e8 server_cookie=e4e5fa57d998e0b8 in_seq=0 out_seq=0 2024-09-13T17:20:24.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.653+0000 7fdeb5ffb640 1 -- 172.21.15.87:0/2548253550 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55568712f1f0 con 0x5556871f4200 2024-09-13T17:20:24.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.653+0000 7fdeb5ffb640 10 client.17385 handle_command_reply: tid=0 2024-09-13T17:20:24.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.653+0000 7fdedafd1740 1 client.17385 shutdown 2024-09-13T17:20:24.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.653+0000 7fdedafd1740 1 -- 172.21.15.87:0/2548253550 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556871e4950 msgr2=0x5556871e1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.653+0000 7fdedafd1740 1 --2- 172.21.15.87:0/2548253550 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556871e4950 0x5556871e1830 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fdec0014310 tx=0x7fdec0004a40 comp rx=0 tx=0).stop 2024-09-13T17:20:24.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.653+0000 7fdedafd1740 1 -- 172.21.15.87:0/2548253550 shutdown_connections 2024-09-13T17:20:24.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.653+0000 7fdedafd1740 1 --2- 172.21.15.87:0/2548253550 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x5556871f4200 0x5556871f6620 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.653+0000 7fdedafd1740 1 --2- 172.21.15.87:0/2548253550 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556871e4950 0x5556871e1830 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.653+0000 7fdeb5ffb640 0 client.17385 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:20:24.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.653+0000 7fdedafd1740 1 --2- 172.21.15.87:0/2548253550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5556871da0b0 0x5556871e12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.653+0000 7fdedafd1740 1 --2- 172.21.15.87:0/2548253550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5556871d9790 0x5556871e3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.653+0000 7fdedafd1740 1 -- 172.21.15.87:0/2548253550 >> 172.21.15.87:0/2548253550 conn(0x5556871d5d00 msgr2=0x5556871dba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:24.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.654+0000 7fdedafd1740 1 -- 172.21.15.87:0/2548253550 shutdown_connections 2024-09-13T17:20:24.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.654+0000 7fdedafd1740 1 -- 172.21.15.87:0/2548253550 wait complete. 2024-09-13T17:20:24.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.654+0000 7fdedafd1740 20 client.17385 trim_cache size 0 max 16384 2024-09-13T17:20:24.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.664+0000 7fdedafd1740 1 Processor -- start 2024-09-13T17:20:24.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.664+0000 7fdedafd1740 1 -- start start 2024-09-13T17:20:24.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.664+0000 7fdedafd1740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5556871d9790 0x5556871eb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.664+0000 7fdedafd1740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5556871da0b0 0x5556871ebb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.664+0000 7fdedafd1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556871e4950 0x5556871dfba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.665+0000 7fdedafd1740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556871e47b0 con 0x5556871e4950 2024-09-13T17:20:24.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.665+0000 7fdedafd1740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556871d0300 con 0x5556871da0b0 2024-09-13T17:20:24.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.665+0000 7fdedafd1740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556871e1ba0 con 0x5556871d9790 2024-09-13T17:20:24.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.665+0000 7fded684e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556871e4950 0x5556871dfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.665+0000 7fded684e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556871e4950 0x5556871dfba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39084/0 (socket says 172.21.15.87:39084) 2024-09-13T17:20:24.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.665+0000 7fded684e640 1 -- 172.21.15.87:0/844283119 learned_addr learned my addr 172.21.15.87:0/844283119 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:24.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.665+0000 7fded604d640 1 --2- 172.21.15.87:0/844283119 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5556871d9790 0x5556871eb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.665+0000 7fded584c640 1 --2- 172.21.15.87:0/844283119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5556871da0b0 0x5556871ebb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.665+0000 7fded684e640 1 -- 172.21.15.87:0/844283119 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5556871d9790 msgr2=0x5556871eb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:24.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.665+0000 7fded684e640 1 --2- 172.21.15.87:0/844283119 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5556871d9790 0x5556871eb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.665+0000 7fded684e640 1 -- 172.21.15.87:0/844283119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5556871da0b0 msgr2=0x5556871ebb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:24.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.665+0000 7fded684e640 1 --2- 172.21.15.87:0/844283119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5556871da0b0 0x5556871ebb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.665+0000 7fded684e640 1 -- 172.21.15.87:0/844283119 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5556870dd770 con 0x5556871e4950 2024-09-13T17:20:24.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.665+0000 7fded584c640 1 --2- 172.21.15.87:0/844283119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5556871da0b0 0x5556871ebb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:24.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.665+0000 7fded684e640 1 --2- 172.21.15.87:0/844283119 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556871e4950 0x5556871dfba0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fdec0009970 tx=0x7fdec00135c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb1b08002b1f8e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:24.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.665+0000 7fdecd606640 1 -- 172.21.15.87:0/844283119 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec0013690 con 0x5556871e4950 2024-09-13T17:20:24.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.665+0000 7fdecd606640 1 -- 172.21.15.87:0/844283119 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdec001a040 con 0x5556871e4950 2024-09-13T17:20:24.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.665+0000 7fdecd606640 1 -- 172.21.15.87:0/844283119 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec000f7f0 con 0x5556871e4950 2024-09-13T17:20:24.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.666+0000 7fdedafd1740 1 -- 172.21.15.87:0/844283119 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556871e4950 msgr2=0x5556871dfba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.666+0000 7fdedafd1740 1 --2- 172.21.15.87:0/844283119 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556871e4950 0x5556871dfba0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fdec0009970 tx=0x7fdec00135c0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.666+0000 7fdedafd1740 1 -- 172.21.15.87:0/844283119 shutdown_connections 2024-09-13T17:20:24.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.666+0000 7fdedafd1740 1 --2- 172.21.15.87:0/844283119 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556871e4950 0x5556871dfba0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.666+0000 7fdedafd1740 1 --2- 172.21.15.87:0/844283119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5556871da0b0 0x5556871ebb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.666+0000 7fdedafd1740 1 --2- 172.21.15.87:0/844283119 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5556871d9790 0x5556871eb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.666+0000 7fdedafd1740 1 -- 172.21.15.87:0/844283119 >> 172.21.15.87:0/844283119 conn(0x5556871d5d00 msgr2=0x5556871f00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:24.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.666+0000 7fdedafd1740 1 -- 172.21.15.87:0/844283119 shutdown_connections 2024-09-13T17:20:24.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.666+0000 7fdedafd1740 1 -- 172.21.15.87:0/844283119 wait complete. 2024-09-13T17:20:24.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.666+0000 7fdedafd1740 1 -- start start 2024-09-13T17:20:24.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.666+0000 7fdedafd1740 1 Processor -- start 2024-09-13T17:20:24.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.666+0000 7fdedafd1740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5556871d9790 0x5556871eb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.666+0000 7fdedafd1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556871da0b0 0x5556871e7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.666+0000 7fdedafd1740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5556871e4950 0x5556871e8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.666+0000 7fdedafd1740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556871e8900 con 0x5556871da0b0 2024-09-13T17:20:24.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.666+0000 7fdedafd1740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556871e8a70 con 0x5556871d9790 2024-09-13T17:20:24.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.666+0000 7fdedafd1740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55568724a700 con 0x5556871e4950 2024-09-13T17:20:24.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.666+0000 7fdedafd1740 10 client.0 _ll_register_callbacks cb 0x7fdec800a710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:20:24.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.667+0000 7fded584c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556871da0b0 0x5556871e7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.667+0000 7fded584c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556871da0b0 0x5556871e7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39096/0 (socket says 172.21.15.87:39096) 2024-09-13T17:20:24.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.667+0000 7fded584c640 1 -- 172.21.15.87:0/2862495620 learned_addr learned my addr 172.21.15.87:0/2862495620 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:24.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.667+0000 7fded684e640 1 --2- 172.21.15.87:0/2862495620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5556871e4950 0x5556871e8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.667+0000 7fded604d640 1 --2- 172.21.15.87:0/2862495620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5556871d9790 0x5556871eb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.667+0000 7fded584c640 1 -- 172.21.15.87:0/2862495620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5556871e4950 msgr2=0x5556871e8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:24.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.667+0000 7fded584c640 1 --2- 172.21.15.87:0/2862495620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5556871e4950 0x5556871e8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.667+0000 7fded584c640 1 -- 172.21.15.87:0/2862495620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5556871d9790 msgr2=0x5556871eb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:24.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.667+0000 7fded584c640 1 --2- 172.21.15.87:0/2862495620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5556871d9790 0x5556871eb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.667+0000 7fded584c640 1 -- 172.21.15.87:0/2862495620 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55568713b3c0 con 0x5556871da0b0 2024-09-13T17:20:24.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.667+0000 7fded604d640 1 --2- 172.21.15.87:0/2862495620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5556871d9790 0x5556871eb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:24.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.667+0000 7fded584c640 1 --2- 172.21.15.87:0/2862495620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556871da0b0 0x5556871e7cf0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fdec40bac00 tx=0x7fdec40bab00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84da6601a95694c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:24.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.667+0000 7fdeb5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:20:24.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.667+0000 7fdeb5ffb640 1 -- 172.21.15.87:0/2862495620 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec40baf00 con 0x5556871da0b0 2024-09-13T17:20:24.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.667+0000 7fdeb5ffb640 1 -- 172.21.15.87:0/2862495620 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fdec40bed30 con 0x5556871da0b0 2024-09-13T17:20:24.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.667+0000 7fdedafd1740 1 -- 172.21.15.87:0/2862495620 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdec8018af0 con 0x5556871da0b0 2024-09-13T17:20:24.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.667+0000 7fdeb5ffb640 1 -- 172.21.15.87:0/2862495620 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdec40c3380 con 0x5556871da0b0 2024-09-13T17:20:24.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.667+0000 7fdedafd1740 10 client.17391 fetch_fsmap learned FSMap version 36 2024-09-13T17:20:24.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.667+0000 7fdedafd1740 1 -- 172.21.15.87:0/2862495620 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x555687102e80 con 0x5556871da0b0 2024-09-13T17:20:24.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.667+0000 7fdeb5ffb640 1 -- 172.21.15.87:0/2862495620 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdec8018af0 con 0x5556871da0b0 2024-09-13T17:20:24.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.667+0000 7fdeb5ffb640 1 -- 172.21.15.87:0/2862495620 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fdec404e070 con 0x5556871da0b0 2024-09-13T17:20:24.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.668+0000 7fdedafd1740 10 client.17391 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:20:24.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.668+0000 7fdedafd1740 10 client.17391 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:20:24.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.668+0000 7fdedafd1740 20 client.17391 populate_metadata read hostname 'smithi087' 2024-09-13T17:20:24.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.668+0000 7fdedafd1740 1 --2- 172.21.15.87:0/2862495620 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55568724bab0 0x55568724dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.668+0000 7fdedafd1740 4 client.17391 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:20:24.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.668+0000 7fdedafd1740 1 -- 172.21.15.87:0/2862495620 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x555686e304e0 con 0x55568724bab0 2024-09-13T17:20:24.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.668+0000 7fded604d640 1 --2- 172.21.15.87:0/2862495620 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55568724bab0 0x55568724dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.668+0000 7fdeb5ffb640 10 client.17391 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:20:24.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.668+0000 7fded604d640 1 --2- 172.21.15.87:0/2862495620 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55568724bab0 0x55568724dea0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3e3cbb4b11668977 server_cookie=5097a67e660a3555 in_seq=0 out_seq=0 2024-09-13T17:20:24.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.668+0000 7fdeb5ffb640 1 -- 172.21.15.87:0/2862495620 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x555686e304e0 con 0x55568724bab0 2024-09-13T17:20:24.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.668+0000 7fdeb5ffb640 10 client.17391 handle_command_reply: tid=0 2024-09-13T17:20:24.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.668+0000 7fdedafd1740 1 client.17391 shutdown 2024-09-13T17:20:24.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.669+0000 7fdedafd1740 1 -- 172.21.15.87:0/2862495620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556871da0b0 msgr2=0x5556871e7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.669+0000 7fdedafd1740 1 --2- 172.21.15.87:0/2862495620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556871da0b0 0x5556871e7cf0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fdec40bac00 tx=0x7fdec40bab00 comp rx=0 tx=0).stop 2024-09-13T17:20:24.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.669+0000 7fdedafd1740 1 -- 172.21.15.87:0/2862495620 shutdown_connections 2024-09-13T17:20:24.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.669+0000 7fdedafd1740 1 --2- 172.21.15.87:0/2862495620 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55568724bab0 0x55568724dea0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.669+0000 7fdedafd1740 1 --2- 172.21.15.87:0/2862495620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5556871e4950 0x5556871e8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.669+0000 7fdeb5ffb640 0 client.17391 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:20:24.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.669+0000 7fdedafd1740 1 --2- 172.21.15.87:0/2862495620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5556871da0b0 0x5556871e7cf0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.669+0000 7fdedafd1740 1 --2- 172.21.15.87:0/2862495620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5556871d9790 0x5556871eb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.669+0000 7fdedafd1740 1 -- 172.21.15.87:0/2862495620 >> 172.21.15.87:0/2862495620 conn(0x5556871d5d00 msgr2=0x5556871dfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:24.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.669+0000 7fdedafd1740 1 -- 172.21.15.87:0/2862495620 shutdown_connections 2024-09-13T17:20:24.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.669+0000 7fdedafd1740 1 -- 172.21.15.87:0/2862495620 wait complete. 2024-09-13T17:20:24.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.669+0000 7fdedafd1740 20 client.17391 trim_cache size 0 max 16384 2024-09-13T17:20:24.684 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:20:24.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.669+0000 7fded82b1640 1 -- 172.21.15.87:0/398450419 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdeb80a1200 msgr2=0x7fdeb80a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.669+0000 7fded82b1640 1 --2- 172.21.15.87:0/398450419 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdeb80a1200 0x7fdeb80a36c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdec0005c40 tx=0x7fdec0009200 comp rx=0 tx=0).stop 2024-09-13T17:20:24.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.669+0000 7fded82b1640 1 -- 172.21.15.87:0/398450419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fded0103fa0 msgr2=0x7fded0196820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.669+0000 7fded82b1640 1 --2- 172.21.15.87:0/398450419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fded0103fa0 0x7fded0196820 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fdec4009900 tx=0x7fdec40042f0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.669+0000 7fded82b1640 1 -- 172.21.15.87:0/398450419 shutdown_connections 2024-09-13T17:20:24.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.669+0000 7fded82b1640 1 --2- 172.21.15.87:0/398450419 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fded019ac10 0x7fded019b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.669+0000 7fded82b1640 1 --2- 172.21.15.87:0/398450419 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdeb80a1200 0x7fdeb80a36c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.669+0000 7fded82b1640 1 --2- 172.21.15.87:0/398450419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fded0103fa0 0x7fded0196820 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.669+0000 7fded82b1640 1 --2- 172.21.15.87:0/398450419 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fded00fee50 0x7fded01962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.669+0000 7fded82b1640 1 -- 172.21.15.87:0/398450419 >> 172.21.15.87:0/398450419 conn(0x7fded00fa8c0 msgr2=0x7fded00fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:24.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.669+0000 7fded82b1640 1 -- 172.21.15.87:0/398450419 shutdown_connections 2024-09-13T17:20:24.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.669+0000 7fded82b1640 1 -- 172.21.15.87:0/398450419 wait complete. 2024-09-13T17:20:24.686 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-09-13T17:20:24.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.785+0000 7fc32675a640 1 -- 172.21.15.87:0/1455758230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc320100f40 msgr2=0x7fc320101320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.785+0000 7fc32675a640 1 --2- 172.21.15.87:0/1455758230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc320100f40 0x7fc320101320 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fc310009900 tx=0x7fc31002a480 comp rx=0 tx=0).stop 2024-09-13T17:20:24.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.785+0000 7fc32675a640 1 -- 172.21.15.87:0/1455758230 shutdown_connections 2024-09-13T17:20:24.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.785+0000 7fc32675a640 1 --2- 172.21.15.87:0/1455758230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc32010a310 0x7fc32010c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.785+0000 7fc32675a640 1 --2- 172.21.15.87:0/1455758230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc320101860 0x7fc320109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.785+0000 7fc32675a640 1 --2- 172.21.15.87:0/1455758230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc320100f40 0x7fc320101320 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.785+0000 7fc32675a640 1 -- 172.21.15.87:0/1455758230 >> 172.21.15.87:0/1455758230 conn(0x7fc320075c60 msgr2=0x7fc3200fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:24.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.785+0000 7fc32675a640 1 -- 172.21.15.87:0/1455758230 shutdown_connections 2024-09-13T17:20:24.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.785+0000 7fc32675a640 1 -- 172.21.15.87:0/1455758230 wait complete. 2024-09-13T17:20:24.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.785+0000 7fc32675a640 1 Processor -- start 2024-09-13T17:20:24.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.785+0000 7fc32675a640 1 -- start start 2024-09-13T17:20:24.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.785+0000 7fc32675a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc320100f40 0x7fc320196240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.785+0000 7fc32675a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc320101860 0x7fc320196780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.785+0000 7fc32675a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc32010a310 0x7fc32019ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.785+0000 7fc32675a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32019b170 con 0x7fc320101860 2024-09-13T17:20:24.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.785+0000 7fc32675a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32019b2e0 con 0x7fc32010a310 2024-09-13T17:20:24.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.785+0000 7fc32675a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32019b4a0 con 0x7fc320100f40 2024-09-13T17:20:24.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.786+0000 7fc317fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc320101860 0x7fc320196780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.786+0000 7fc317fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc320101860 0x7fc320196780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39116/0 (socket says 172.21.15.87:39116) 2024-09-13T17:20:24.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.786+0000 7fc317fff640 1 -- 172.21.15.87:0/3996827989 learned_addr learned my addr 172.21.15.87:0/3996827989 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:24.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.786+0000 7fc31ffff640 1 --2- 172.21.15.87:0/3996827989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc320100f40 0x7fc320196240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.786+0000 7fc324cf7640 1 --2- 172.21.15.87:0/3996827989 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc32010a310 0x7fc32019ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.786+0000 7fc317fff640 1 -- 172.21.15.87:0/3996827989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc320100f40 msgr2=0x7fc320196240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.786+0000 7fc317fff640 1 --2- 172.21.15.87:0/3996827989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc320100f40 0x7fc320196240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.786+0000 7fc317fff640 1 -- 172.21.15.87:0/3996827989 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc32010a310 msgr2=0x7fc32019ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.786+0000 7fc317fff640 1 --2- 172.21.15.87:0/3996827989 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc32010a310 0x7fc32019ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.786+0000 7fc317fff640 1 -- 172.21.15.87:0/3996827989 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc310009560 con 0x7fc320101860 2024-09-13T17:20:24.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.786+0000 7fc317fff640 1 --2- 172.21.15.87:0/3996827989 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc320101860 0x7fc320196780 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fc30800d950 tx=0x7fc30800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:24.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.786+0000 7fc31dffb640 1 -- 172.21.15.87:0/3996827989 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc308009c30 con 0x7fc320101860 2024-09-13T17:20:24.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.786+0000 7fc31dffb640 1 -- 172.21.15.87:0/3996827989 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc308009d90 con 0x7fc320101860 2024-09-13T17:20:24.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.786+0000 7fc31dffb640 1 -- 172.21.15.87:0/3996827989 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30800f6b0 con 0x7fc320101860 2024-09-13T17:20:24.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.786+0000 7fc32675a640 1 -- 172.21.15.87:0/3996827989 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc32019b780 con 0x7fc320101860 2024-09-13T17:20:24.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.786+0000 7fc32675a640 1 -- 172.21.15.87:0/3996827989 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3201a3000 con 0x7fc320101860 2024-09-13T17:20:24.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.788+0000 7fc31dffb640 1 -- 172.21.15.87:0/3996827989 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fc308010aa0 con 0x7fc320101860 2024-09-13T17:20:24.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.789+0000 7fc329476740 1 Processor -- start 2024-09-13T17:20:24.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.789+0000 7fc329476740 1 -- start start 2024-09-13T17:20:24.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.789+0000 7fc329476740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627eefea690 0x5627eefeaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.789+0000 7fc329476740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627eefeafb0 0x5627eeff9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.789+0000 7fc329476740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627eeff9d60 0x5627eeffc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.789+0000 7fc329476740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627eef54cc0 con 0x5627eeff9d60 2024-09-13T17:20:24.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.789+0000 7fc329476740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627eef52450 con 0x5627eefeafb0 2024-09-13T17:20:24.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.789+0000 7fc329476740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627eef4dd40 con 0x5627eefea690 2024-09-13T17:20:24.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.789+0000 7fc317fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627eeff9d60 0x5627eeffc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.789+0000 7fc317fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627eeff9d60 0x5627eeffc150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39132/0 (socket says 172.21.15.87:39132) 2024-09-13T17:20:24.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.789+0000 7fc317fff640 1 -- 172.21.15.87:0/2956602476 learned_addr learned my addr 172.21.15.87:0/2956602476 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:24.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.789+0000 7fc31ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627eefeafb0 0x5627eeff9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.789+0000 7fc31dffb640 1 --2- 172.21.15.87:0/3996827989 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc30c0a1200 0x7fc30c0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.789+0000 7fc324cf7640 1 --2- 172.21.15.87:0/2956602476 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627eefea690 0x5627eefeaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.789+0000 7fc324cf7640 1 --2- 172.21.15.87:0/3996827989 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc30c0a1200 0x7fc30c0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.789+0000 7fc317fff640 1 -- 172.21.15.87:0/2956602476 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627eefea690 msgr2=0x5627eefeaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:24.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.789+0000 7fc317fff640 1 --2- 172.21.15.87:0/2956602476 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627eefea690 0x5627eefeaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.789+0000 7fc317fff640 1 -- 172.21.15.87:0/2956602476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627eefeafb0 msgr2=0x5627eeff9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:24.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.789+0000 7fc317fff640 1 --2- 172.21.15.87:0/2956602476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627eefeafb0 0x5627eeff9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.789+0000 7fc31dffb640 1 -- 172.21.15.87:0/3996827989 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fc3080ccef0 con 0x7fc320101860 2024-09-13T17:20:24.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.789+0000 7fc317fff640 1 -- 172.21.15.87:0/2956602476 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627eef15620 con 0x5627eeff9d60 2024-09-13T17:20:24.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.789+0000 7fc31ffff640 1 --2- 172.21.15.87:0/2956602476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627eefeafb0 0x5627eeff9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:20:24.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.790+0000 7fc317fff640 1 --2- 172.21.15.87:0/2956602476 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627eeff9d60 0x5627eeffc150 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fc308099890 tx=0x7fc308005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adfadb8f28e063fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:24.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.790+0000 7fc324cf7640 1 --2- 172.21.15.87:0/3996827989 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc30c0a1200 0x7fc30c0a36c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc318005fd0 tx=0x7fc318009240 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:24.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.790+0000 7fc3167fc640 1 -- 172.21.15.87:0/2956602476 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc308054110 con 0x5627eeff9d60 2024-09-13T17:20:24.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.790+0000 7fc3167fc640 1 -- 172.21.15.87:0/2956602476 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc3080994f0 con 0x5627eeff9d60 2024-09-13T17:20:24.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.790+0000 7fc3167fc640 1 -- 172.21.15.87:0/2956602476 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc308095980 con 0x5627eeff9d60 2024-09-13T17:20:24.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.790+0000 7fc329476740 1 -- 172.21.15.87:0/2956602476 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627eeff9d60 msgr2=0x5627eeffc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.790+0000 7fc329476740 1 --2- 172.21.15.87:0/2956602476 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627eeff9d60 0x5627eeffc150 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fc308099890 tx=0x7fc308005880 comp rx=0 tx=0).stop 2024-09-13T17:20:24.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.790+0000 7fc329476740 1 -- 172.21.15.87:0/2956602476 shutdown_connections 2024-09-13T17:20:24.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.790+0000 7fc329476740 1 --2- 172.21.15.87:0/2956602476 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627eeff9d60 0x5627eeffc150 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.790+0000 7fc329476740 1 --2- 172.21.15.87:0/2956602476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627eefeafb0 0x5627eeff9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.790+0000 7fc329476740 1 --2- 172.21.15.87:0/2956602476 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627eefea690 0x5627eefeaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.790+0000 7fc329476740 1 -- 172.21.15.87:0/2956602476 >> 172.21.15.87:0/2956602476 conn(0x5627eefe6d00 msgr2=0x5627eefe70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:24.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.791+0000 7fc329476740 1 -- 172.21.15.87:0/2956602476 shutdown_connections 2024-09-13T17:20:24.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.791+0000 7fc329476740 1 -- 172.21.15.87:0/2956602476 wait complete. 2024-09-13T17:20:24.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.791+0000 7fc329476740 1 -- start start 2024-09-13T17:20:24.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.791+0000 7fc329476740 1 Processor -- start 2024-09-13T17:20:24.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.791+0000 7fc329476740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627eefea690 0x5627eeff9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.791+0000 7fc329476740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627eefeafb0 0x5627eeff6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.791+0000 7fc329476740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627eeff9d60 0x5627eeff6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.791+0000 7fc329476740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627eef0c180 con 0x5627eefeafb0 2024-09-13T17:20:24.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.791+0000 7fc329476740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627eec26430 con 0x5627eeff9d60 2024-09-13T17:20:24.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.791+0000 7fc329476740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627eeed15e0 con 0x5627eefea690 2024-09-13T17:20:24.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.791+0000 7fc329476740 10 client.0 _ll_register_callbacks cb 0x5627eef3daa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:20:24.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.791+0000 7fc317fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627eefeafb0 0x5627eeff6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.791+0000 7fc317fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627eefeafb0 0x5627eeff6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39138/0 (socket says 172.21.15.87:39138) 2024-09-13T17:20:24.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.791+0000 7fc317fff640 1 -- 172.21.15.87:0/568500446 learned_addr learned my addr 172.21.15.87:0/568500446 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:24.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.792+0000 7fc31ffff640 1 --2- 172.21.15.87:0/568500446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627eefea690 0x5627eeff9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.792+0000 7fc317fff640 1 -- 172.21.15.87:0/568500446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627eefea690 msgr2=0x5627eeff9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:24.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.792+0000 7fc317fff640 1 --2- 172.21.15.87:0/568500446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627eefea690 0x5627eeff9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.792+0000 7fc317fff640 1 -- 172.21.15.87:0/568500446 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627eeff9d60 msgr2=0x5627eeff6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:24.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.792+0000 7fc317fff640 1 --2- 172.21.15.87:0/568500446 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627eeff9d60 0x5627eeff6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.792+0000 7fc317fff640 1 -- 172.21.15.87:0/568500446 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3201a3000 con 0x5627eefeafb0 2024-09-13T17:20:24.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.792+0000 7fc317fff640 1 --2- 172.21.15.87:0/568500446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627eefeafb0 0x5627eeff6680 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fc308096090 tx=0x7fc3080964d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa80e9fcc1029492 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:24.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.792+0000 7fc2ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:20:24.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.792+0000 7fc2ff7fe640 1 -- 172.21.15.87:0/568500446 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc308095b90 con 0x5627eefeafb0 2024-09-13T17:20:24.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.792+0000 7fc2ff7fe640 1 -- 172.21.15.87:0/568500446 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fc30809a290 con 0x5627eefeafb0 2024-09-13T17:20:24.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.792+0000 7fc329476740 1 -- 172.21.15.87:0/568500446 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5627eef77b80 con 0x5627eefeafb0 2024-09-13T17:20:24.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.792+0000 7fc2ff7fe640 1 -- 172.21.15.87:0/568500446 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc308095ed0 con 0x5627eefeafb0 2024-09-13T17:20:24.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.792+0000 7fc329476740 10 client.17403 fetch_fsmap learned FSMap version 36 2024-09-13T17:20:24.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.792+0000 7fc329476740 1 -- 172.21.15.87:0/568500446 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5627eef4c3c0 con 0x5627eefeafb0 2024-09-13T17:20:24.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.792+0000 7fc2ff7fe640 1 -- 172.21.15.87:0/568500446 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x5627eef77b80 con 0x5627eefeafb0 2024-09-13T17:20:24.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.792+0000 7fc2ff7fe640 1 -- 172.21.15.87:0/568500446 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc30809aba0 con 0x5627eefeafb0 2024-09-13T17:20:24.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.792+0000 7fc329476740 10 client.17403 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:20:24.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.792+0000 7fc329476740 10 client.17403 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:20:24.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.792+0000 7fc329476740 20 client.17403 populate_metadata read hostname 'smithi087' 2024-09-13T17:20:24.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.792+0000 7fc329476740 1 --2- 172.21.15.87:0/568500446 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5627ef009240 0x5627ef00b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.792+0000 7fc329476740 4 client.17403 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:20:24.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.792+0000 7fc329476740 1 -- 172.21.15.87:0/568500446 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5627eef401f0 con 0x5627ef009240 2024-09-13T17:20:24.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.793+0000 7fc31ffff640 1 --2- 172.21.15.87:0/568500446 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5627ef009240 0x5627ef00b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.793+0000 7fc2ff7fe640 10 client.17403 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:20:24.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.793+0000 7fc31ffff640 1 --2- 172.21.15.87:0/568500446 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5627ef009240 0x5627ef00b660 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=aa78b2a50a50cebf server_cookie=584f3bf212958b22 in_seq=0 out_seq=0 2024-09-13T17:20:24.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.794+0000 7fc2ff7fe640 1 -- 172.21.15.87:0/568500446 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5627eef401f0 con 0x5627ef009240 2024-09-13T17:20:24.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.794+0000 7fc2ff7fe640 10 client.17403 handle_command_reply: tid=0 2024-09-13T17:20:24.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.794+0000 7fc329476740 1 client.17403 shutdown 2024-09-13T17:20:24.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.794+0000 7fc329476740 1 -- 172.21.15.87:0/568500446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627eefeafb0 msgr2=0x5627eeff6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.794+0000 7fc329476740 1 --2- 172.21.15.87:0/568500446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627eefeafb0 0x5627eeff6680 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fc308096090 tx=0x7fc3080964d0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.794+0000 7fc329476740 1 -- 172.21.15.87:0/568500446 shutdown_connections 2024-09-13T17:20:24.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.794+0000 7fc329476740 1 --2- 172.21.15.87:0/568500446 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5627ef009240 0x5627ef00b660 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.794+0000 7fc329476740 1 --2- 172.21.15.87:0/568500446 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627eeff9d60 0x5627eeff6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.794+0000 7fc329476740 1 --2- 172.21.15.87:0/568500446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627eefeafb0 0x5627eeff6680 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.794+0000 7fc329476740 1 --2- 172.21.15.87:0/568500446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627eefea690 0x5627eeff9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.794+0000 7fc2ff7fe640 0 client.17403 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:20:24.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.794+0000 7fc329476740 1 -- 172.21.15.87:0/568500446 >> 172.21.15.87:0/568500446 conn(0x5627eefe6d00 msgr2=0x5627eefeca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:24.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.794+0000 7fc329476740 1 -- 172.21.15.87:0/568500446 shutdown_connections 2024-09-13T17:20:24.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.794+0000 7fc329476740 1 -- 172.21.15.87:0/568500446 wait complete. 2024-09-13T17:20:24.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.794+0000 7fc329476740 20 client.17403 trim_cache size 0 max 16384 2024-09-13T17:20:24.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.805+0000 7fc329476740 1 Processor -- start 2024-09-13T17:20:24.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.805+0000 7fc329476740 1 -- start start 2024-09-13T17:20:24.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.805+0000 7fc329476740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627eefe6d00 0x5627ef0009f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.805+0000 7fc329476740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627eefea690 0x5627ef000f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.805+0000 7fc329476740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627eefeafb0 0x5627eeff4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.805+0000 7fc329476740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627eefeba60 con 0x5627eefeafb0 2024-09-13T17:20:24.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.805+0000 7fc329476740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627eefe1300 con 0x5627eefe6d00 2024-09-13T17:20:24.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.805+0000 7fc329476740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627eeff6f30 con 0x5627eefea690 2024-09-13T17:20:24.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.805+0000 7fc324cf7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627eefeafb0 0x5627eeff4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.805+0000 7fc324cf7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627eefeafb0 0x5627eeff4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39154/0 (socket says 172.21.15.87:39154) 2024-09-13T17:20:24.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.805+0000 7fc324cf7640 1 -- 172.21.15.87:0/2483864299 learned_addr learned my addr 172.21.15.87:0/2483864299 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:24.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.806+0000 7fc31ffff640 1 --2- 172.21.15.87:0/2483864299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627eefe6d00 0x5627ef0009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.806+0000 7fc324cf7640 1 -- 172.21.15.87:0/2483864299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627eefea690 msgr2=0x5627ef000f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:24.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.806+0000 7fc324cf7640 1 --2- 172.21.15.87:0/2483864299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627eefea690 0x5627ef000f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.806+0000 7fc324cf7640 1 -- 172.21.15.87:0/2483864299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627eefe6d00 msgr2=0x5627ef0009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:24.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.806+0000 7fc324cf7640 1 --2- 172.21.15.87:0/2483864299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627eefe6d00 0x5627ef0009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.806+0000 7fc324cf7640 1 -- 172.21.15.87:0/2483864299 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627eeeee770 con 0x5627eefeafb0 2024-09-13T17:20:24.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.806+0000 7fc31ffff640 1 --2- 172.21.15.87:0/2483864299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627eefe6d00 0x5627ef0009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:24.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.806+0000 7fc324cf7640 1 --2- 172.21.15.87:0/2483864299 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627eefeafb0 0x5627eeff4f30 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fc318003cc0 tx=0x7fc318004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e886bfca2b20f1b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:24.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.806+0000 7fc316ffd640 1 -- 172.21.15.87:0/2483864299 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3180115a0 con 0x5627eefeafb0 2024-09-13T17:20:24.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.806+0000 7fc316ffd640 1 -- 172.21.15.87:0/2483864299 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc318011bb0 con 0x5627eefeafb0 2024-09-13T17:20:24.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.806+0000 7fc316ffd640 1 -- 172.21.15.87:0/2483864299 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31800fb20 con 0x5627eefeafb0 2024-09-13T17:20:24.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.806+0000 7fc329476740 1 -- 172.21.15.87:0/2483864299 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627eefeafb0 msgr2=0x5627eeff4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.806+0000 7fc329476740 1 --2- 172.21.15.87:0/2483864299 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627eefeafb0 0x5627eeff4f30 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fc318003cc0 tx=0x7fc318004ab0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.806+0000 7fc329476740 1 -- 172.21.15.87:0/2483864299 shutdown_connections 2024-09-13T17:20:24.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.806+0000 7fc329476740 1 --2- 172.21.15.87:0/2483864299 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627eefeafb0 0x5627eeff4f30 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.806+0000 7fc329476740 1 --2- 172.21.15.87:0/2483864299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627eefea690 0x5627ef000f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.806+0000 7fc329476740 1 --2- 172.21.15.87:0/2483864299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627eefe6d00 0x5627ef0009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.807+0000 7fc329476740 1 -- 172.21.15.87:0/2483864299 >> 172.21.15.87:0/2483864299 conn(0x5627eeff94c0 msgr2=0x5627ef0054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:24.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.807+0000 7fc329476740 1 -- 172.21.15.87:0/2483864299 shutdown_connections 2024-09-13T17:20:24.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.807+0000 7fc329476740 1 -- 172.21.15.87:0/2483864299 wait complete. 2024-09-13T17:20:24.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.807+0000 7fc329476740 1 -- start start 2024-09-13T17:20:24.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.807+0000 7fc329476740 1 Processor -- start 2024-09-13T17:20:24.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.807+0000 7fc329476740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627eefe6d00 0x5627ef000ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.807+0000 7fc329476740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627eefea690 0x5627eeffd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.807+0000 7fc329476740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627eefeafb0 0x5627eeffd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.807+0000 7fc329476740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627eeffddc0 con 0x5627eefe6d00 2024-09-13T17:20:24.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.807+0000 7fc329476740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627eeffdf30 con 0x5627eefea690 2024-09-13T17:20:24.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.807+0000 7fc329476740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627ef05f700 con 0x5627eefeafb0 2024-09-13T17:20:24.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.807+0000 7fc329476740 10 client.0 _ll_register_callbacks cb 0x7fc308095d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:20:24.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.807+0000 7fc31ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627eefe6d00 0x5627ef000ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.807+0000 7fc31ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627eefe6d00 0x5627ef000ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39166/0 (socket says 172.21.15.87:39166) 2024-09-13T17:20:24.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.807+0000 7fc31ffff640 1 -- 172.21.15.87:0/2052078715 learned_addr learned my addr 172.21.15.87:0/2052078715 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:24.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.808+0000 7fc324cf7640 1 --2- 172.21.15.87:0/2052078715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627eefeafb0 0x5627eeffd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.808+0000 7fc31ffff640 1 -- 172.21.15.87:0/2052078715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627eefeafb0 msgr2=0x5627eeffd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:24.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.808+0000 7fc31ffff640 1 --2- 172.21.15.87:0/2052078715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627eefeafb0 0x5627eeffd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.808+0000 7fc31ffff640 1 -- 172.21.15.87:0/2052078715 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627eefea690 msgr2=0x5627eeffd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:24.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.808+0000 7fc31ffff640 1 --2- 172.21.15.87:0/2052078715 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627eefea690 0x5627eeffd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.808+0000 7fc31ffff640 1 -- 172.21.15.87:0/2052078715 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc318003970 con 0x5627eefe6d00 2024-09-13T17:20:24.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.808+0000 7fc324cf7640 1 --2- 172.21.15.87:0/2052078715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627eefeafb0 0x5627eeffd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:24.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.808+0000 7fc31ffff640 1 --2- 172.21.15.87:0/2052078715 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627eefe6d00 0x5627ef000ce0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fc310005ec0 tx=0x7fc310004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b90624e9a0ff45 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:24.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.808+0000 7fc2ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:20:24.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.808+0000 7fc2ff7fe640 1 -- 172.21.15.87:0/2052078715 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc310043070 con 0x5627eefe6d00 2024-09-13T17:20:24.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.808+0000 7fc2ff7fe640 1 -- 172.21.15.87:0/2052078715 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fc310043d00 con 0x5627eefe6d00 2024-09-13T17:20:24.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.808+0000 7fc329476740 1 -- 172.21.15.87:0/2052078715 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc3080994f0 con 0x5627eefe6d00 2024-09-13T17:20:24.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.808+0000 7fc2ff7fe640 1 -- 172.21.15.87:0/2052078715 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc310005040 con 0x5627eefe6d00 2024-09-13T17:20:24.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.808+0000 7fc329476740 10 client.17409 fetch_fsmap learned FSMap version 36 2024-09-13T17:20:24.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.808+0000 7fc329476740 1 -- 172.21.15.87:0/2052078715 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5627eef13e80 con 0x5627eefe6d00 2024-09-13T17:20:24.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.808+0000 7fc2ff7fe640 1 -- 172.21.15.87:0/2052078715 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc3080994f0 con 0x5627eefe6d00 2024-09-13T17:20:24.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.808+0000 7fc2ff7fe640 1 -- 172.21.15.87:0/2052078715 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc3100431d0 con 0x5627eefe6d00 2024-09-13T17:20:24.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.808+0000 7fc329476740 10 client.17409 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:20:24.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.808+0000 7fc329476740 10 client.17409 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:20:24.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.808+0000 7fc329476740 20 client.17409 populate_metadata read hostname 'smithi087' 2024-09-13T17:20:24.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.808+0000 7fc329476740 1 --2- 172.21.15.87:0/2052078715 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5627eeff9d60 0x5627ef062d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.808+0000 7fc329476740 4 client.17409 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:20:24.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.808+0000 7fc329476740 1 -- 172.21.15.87:0/2052078715 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5627eec414e0 con 0x5627eeff9d60 2024-09-13T17:20:24.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.809+0000 7fc317fff640 1 --2- 172.21.15.87:0/2052078715 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5627eeff9d60 0x5627ef062d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.809+0000 7fc2ff7fe640 10 client.17409 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:20:24.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.809+0000 7fc317fff640 1 --2- 172.21.15.87:0/2052078715 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5627eeff9d60 0x5627ef062d00 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=83ac65d8c7f58cb0 server_cookie=34d842b070a45206 in_seq=0 out_seq=0 2024-09-13T17:20:24.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.809+0000 7fc2ff7fe640 1 -- 172.21.15.87:0/2052078715 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5627eec414e0 con 0x5627eeff9d60 2024-09-13T17:20:24.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.809+0000 7fc2ff7fe640 10 client.17409 handle_command_reply: tid=0 2024-09-13T17:20:24.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.809+0000 7fc329476740 1 client.17409 shutdown 2024-09-13T17:20:24.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.809+0000 7fc329476740 1 -- 172.21.15.87:0/2052078715 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627eefe6d00 msgr2=0x5627ef000ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.809+0000 7fc329476740 1 --2- 172.21.15.87:0/2052078715 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627eefe6d00 0x5627ef000ce0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fc310005ec0 tx=0x7fc310004290 comp rx=0 tx=0).stop 2024-09-13T17:20:24.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.809+0000 7fc329476740 1 -- 172.21.15.87:0/2052078715 shutdown_connections 2024-09-13T17:20:24.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.809+0000 7fc329476740 1 --2- 172.21.15.87:0/2052078715 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5627eeff9d60 0x5627ef062d00 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.809+0000 7fc329476740 1 --2- 172.21.15.87:0/2052078715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627eefeafb0 0x5627eeffd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.809+0000 7fc329476740 1 --2- 172.21.15.87:0/2052078715 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627eefea690 0x5627eeffd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.809+0000 7fc329476740 1 --2- 172.21.15.87:0/2052078715 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627eefe6d00 0x5627ef000ce0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.809+0000 7fc2ff7fe640 0 client.17409 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:20:24.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.809+0000 7fc329476740 1 -- 172.21.15.87:0/2052078715 >> 172.21.15.87:0/2052078715 conn(0x5627eeff94c0 msgr2=0x5627eeff4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:24.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.809+0000 7fc329476740 1 -- 172.21.15.87:0/2052078715 shutdown_connections 2024-09-13T17:20:24.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.809+0000 7fc329476740 1 -- 172.21.15.87:0/2052078715 wait complete. 2024-09-13T17:20:24.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.810+0000 7fc329476740 20 client.17409 trim_cache size 0 max 16384 2024-09-13T17:20:24.818 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:20:24.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.810+0000 7fc32675a640 1 -- 172.21.15.87:0/3996827989 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc30c0a1200 msgr2=0x7fc30c0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.810+0000 7fc32675a640 1 --2- 172.21.15.87:0/3996827989 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc30c0a1200 0x7fc30c0a36c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc318005fd0 tx=0x7fc318009240 comp rx=0 tx=0).stop 2024-09-13T17:20:24.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.810+0000 7fc32675a640 1 -- 172.21.15.87:0/3996827989 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc320101860 msgr2=0x7fc320196780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.810+0000 7fc32675a640 1 --2- 172.21.15.87:0/3996827989 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc320101860 0x7fc320196780 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fc30800d950 tx=0x7fc30800de10 comp rx=0 tx=0).stop 2024-09-13T17:20:24.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.810+0000 7fc32675a640 1 -- 172.21.15.87:0/3996827989 shutdown_connections 2024-09-13T17:20:24.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.810+0000 7fc32675a640 1 --2- 172.21.15.87:0/3996827989 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc32010a310 0x7fc32019ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.810+0000 7fc32675a640 1 --2- 172.21.15.87:0/3996827989 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc30c0a1200 0x7fc30c0a36c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.810+0000 7fc32675a640 1 --2- 172.21.15.87:0/3996827989 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc320101860 0x7fc320196780 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.810+0000 7fc32675a640 1 --2- 172.21.15.87:0/3996827989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc320100f40 0x7fc320196240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.810+0000 7fc32675a640 1 -- 172.21.15.87:0/3996827989 >> 172.21.15.87:0/3996827989 conn(0x7fc320075c60 msgr2=0x7fc3200fb5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:24.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.810+0000 7fc32675a640 1 -- 172.21.15.87:0/3996827989 shutdown_connections 2024-09-13T17:20:24.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.810+0000 7fc32675a640 1 -- 172.21.15.87:0/3996827989 wait complete. 2024-09-13T17:20:24.822 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:24 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1481482256' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:20:24.823 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-09-13T17:20:24.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:24 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1481482256' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:20:24.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:24 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1481482256' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:20:24.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.920+0000 7f17f4872640 1 -- 172.21.15.87:0/2480683251 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17f00fee60 msgr2=0x7f17f00ff240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.920+0000 7f17f4872640 1 --2- 172.21.15.87:0/2480683251 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17f00fee60 0x7f17f00ff240 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f17e0009930 tx=0x7f17e002a420 comp rx=0 tx=0).stop 2024-09-13T17:20:24.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.920+0000 7f17f4872640 1 -- 172.21.15.87:0/2480683251 shutdown_connections 2024-09-13T17:20:24.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.920+0000 7f17f4872640 1 --2- 172.21.15.87:0/2480683251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17f0103fb0 0x7f17f010bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.920+0000 7f17f4872640 1 --2- 172.21.15.87:0/2480683251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17f00ff810 0x7f17f0103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.920+0000 7f17f4872640 1 --2- 172.21.15.87:0/2480683251 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17f00fee60 0x7f17f00ff240 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.920+0000 7f17f4872640 1 -- 172.21.15.87:0/2480683251 >> 172.21.15.87:0/2480683251 conn(0x7f17f0075c60 msgr2=0x7f17f00fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:24.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.920+0000 7f17f4872640 1 -- 172.21.15.87:0/2480683251 shutdown_connections 2024-09-13T17:20:24.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.920+0000 7f17f4872640 1 -- 172.21.15.87:0/2480683251 wait complete. 2024-09-13T17:20:24.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.921+0000 7f17f4872640 1 Processor -- start 2024-09-13T17:20:24.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.921+0000 7f17f4872640 1 -- start start 2024-09-13T17:20:24.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.921+0000 7f17f4872640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17f00fee60 0x7f17f0197150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.921+0000 7f17f4872640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17f0103fb0 0x7f17f0197690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.921+0000 7f17f4872640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17f0197bd0 0x7f17f01a21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.921+0000 7f17f4872640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f01a2870 con 0x7f17f0197bd0 2024-09-13T17:20:24.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.921+0000 7f17f4872640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f01a29e0 con 0x7f17f0103fb0 2024-09-13T17:20:24.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.921+0000 7f17f4872640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f01a2ba0 con 0x7f17f00fee60 2024-09-13T17:20:24.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.922+0000 7f17eed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17f0197bd0 0x7f17f01a21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.922+0000 7f17eed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17f0197bd0 0x7f17f01a21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39184/0 (socket says 172.21.15.87:39184) 2024-09-13T17:20:24.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.922+0000 7f17eed9d640 1 -- 172.21.15.87:0/3868901502 learned_addr learned my addr 172.21.15.87:0/3868901502 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:24.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.922+0000 7f17e5d9b640 1 --2- 172.21.15.87:0/3868901502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17f0103fb0 0x7f17f0197690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.922+0000 7f17ee59c640 1 --2- 172.21.15.87:0/3868901502 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17f00fee60 0x7f17f0197150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.922+0000 7f17eed9d640 1 -- 172.21.15.87:0/3868901502 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17f00fee60 msgr2=0x7f17f0197150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.922+0000 7f17eed9d640 1 --2- 172.21.15.87:0/3868901502 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17f00fee60 0x7f17f0197150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.922+0000 7f17eed9d640 1 -- 172.21.15.87:0/3868901502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17f0103fb0 msgr2=0x7f17f0197690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.922+0000 7f17eed9d640 1 --2- 172.21.15.87:0/3868901502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17f0103fb0 0x7f17f0197690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.922+0000 7f17eed9d640 1 -- 172.21.15.87:0/3868901502 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e0009560 con 0x7f17f0197bd0 2024-09-13T17:20:24.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.922+0000 7f17eed9d640 1 --2- 172.21.15.87:0/3868901502 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17f0197bd0 0x7f17f01a21d0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f17e800cab0 tx=0x7f17e800cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:24.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.922+0000 7f17e7fff640 1 -- 172.21.15.87:0/3868901502 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e800adc0 con 0x7f17f0197bd0 2024-09-13T17:20:24.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.922+0000 7f17e7fff640 1 -- 172.21.15.87:0/3868901502 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f17e800f900 con 0x7f17f0197bd0 2024-09-13T17:20:24.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.922+0000 7f17f4872640 1 -- 172.21.15.87:0/3868901502 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f01a2e80 con 0x7f17f0197bd0 2024-09-13T17:20:24.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.922+0000 7f17e7fff640 1 -- 172.21.15.87:0/3868901502 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e8018920 con 0x7f17f0197bd0 2024-09-13T17:20:24.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.922+0000 7f17f4872640 1 -- 172.21.15.87:0/3868901502 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f01a3300 con 0x7f17f0197bd0 2024-09-13T17:20:24.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.924+0000 7f17e7fff640 1 -- 172.21.15.87:0/3868901502 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f17e800fa70 con 0x7f17f0197bd0 2024-09-13T17:20:24.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.925+0000 7f17f7672740 1 Processor -- start 2024-09-13T17:20:24.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.925+0000 7f17f7672740 1 -- start start 2024-09-13T17:20:24.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.925+0000 7f17f7672740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbca75f790 0x55bbca75fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.925+0000 7f17f7672740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bbca7600b0 0x55bbca76a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.925+0000 7f17f7672740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbca76a950 0x55bbca76cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.925+0000 7f17f7672740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbca6c9cc0 con 0x55bbca76a950 2024-09-13T17:20:24.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.925+0000 7f17f7672740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbca6c7450 con 0x55bbca75f790 2024-09-13T17:20:24.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.925+0000 7f17f7672740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbca6c2d40 con 0x55bbca7600b0 2024-09-13T17:20:24.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.925+0000 7f17e7fff640 1 --2- 172.21.15.87:0/3868901502 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f17dc0a1200 0x7f17dc0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.925+0000 7f17e5d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbca76a950 0x55bbca76cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.925+0000 7f17e5d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbca76a950 0x55bbca76cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39200/0 (socket says 172.21.15.87:39200) 2024-09-13T17:20:24.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.925+0000 7f17e5d9b640 1 -- 172.21.15.87:0/2579412562 learned_addr learned my addr 172.21.15.87:0/2579412562 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:24.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.925+0000 7f17eed9d640 1 --2- 172.21.15.87:0/3868901502 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f17dc0a1200 0x7f17dc0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.926+0000 7f17ee59c640 1 --2- 172.21.15.87:0/2579412562 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bbca7600b0 0x55bbca76a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.926+0000 7f17e5d9b640 1 --2- 172.21.15.87:0/2579412562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbca75f790 0x55bbca75fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.926+0000 7f17e7fff640 1 -- 172.21.15.87:0/3868901502 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f17e80cd260 con 0x7f17f0197bd0 2024-09-13T17:20:24.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.926+0000 7f17e5d9b640 1 -- 172.21.15.87:0/2579412562 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bbca7600b0 msgr2=0x55bbca76a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:24.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.926+0000 7f17e5d9b640 1 --2- 172.21.15.87:0/2579412562 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bbca7600b0 0x55bbca76a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.926+0000 7f17e5d9b640 1 -- 172.21.15.87:0/2579412562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbca75f790 msgr2=0x55bbca75fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:24.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.926+0000 7f17e5d9b640 1 --2- 172.21.15.87:0/2579412562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbca75f790 0x55bbca75fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.926+0000 7f17e5d9b640 1 -- 172.21.15.87:0/2579412562 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbca68a620 con 0x55bbca76a950 2024-09-13T17:20:24.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.926+0000 7f17e5d9b640 1 --2- 172.21.15.87:0/2579412562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbca76a950 0x55bbca76cd40 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f17d8012580 tx=0x7f17d800b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8825946a994d20 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:24.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.926+0000 7f17eed9d640 1 --2- 172.21.15.87:0/3868901502 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f17dc0a1200 0x7f17dc0a36c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f17e8099c60 tx=0x7f17e800fd20 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:24.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.926+0000 7f17e4d99640 1 -- 172.21.15.87:0/2579412562 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d801e640 con 0x55bbca76a950 2024-09-13T17:20:24.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.926+0000 7f17e4d99640 1 -- 172.21.15.87:0/2579412562 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f17d80108e0 con 0x55bbca76a950 2024-09-13T17:20:24.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.926+0000 7f17e4d99640 1 -- 172.21.15.87:0/2579412562 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d801d840 con 0x55bbca76a950 2024-09-13T17:20:24.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.927+0000 7f17f7672740 1 -- 172.21.15.87:0/2579412562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbca76a950 msgr2=0x55bbca76cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.927+0000 7f17f7672740 1 --2- 172.21.15.87:0/2579412562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbca76a950 0x55bbca76cd40 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f17d8012580 tx=0x7f17d800b9d0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.927+0000 7f17f7672740 1 -- 172.21.15.87:0/2579412562 shutdown_connections 2024-09-13T17:20:24.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.927+0000 7f17f7672740 1 --2- 172.21.15.87:0/2579412562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbca76a950 0x55bbca76cd40 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.927+0000 7f17f7672740 1 --2- 172.21.15.87:0/2579412562 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bbca7600b0 0x55bbca76a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.927+0000 7f17f7672740 1 --2- 172.21.15.87:0/2579412562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbca75f790 0x55bbca75fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.927+0000 7f17f7672740 1 -- 172.21.15.87:0/2579412562 >> 172.21.15.87:0/2579412562 conn(0x55bbca75bd00 msgr2=0x55bbca75c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:24.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.927+0000 7f17f7672740 1 -- 172.21.15.87:0/2579412562 shutdown_connections 2024-09-13T17:20:24.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.927+0000 7f17f7672740 1 -- 172.21.15.87:0/2579412562 wait complete. 2024-09-13T17:20:24.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.927+0000 7f17f7672740 1 -- start start 2024-09-13T17:20:24.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.927+0000 7f17f7672740 1 Processor -- start 2024-09-13T17:20:24.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.927+0000 7f17f7672740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbca75f790 0x55bbca769ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.928+0000 7f17f7672740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbca7600b0 0x55bbca767390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.928+0000 7f17f7672740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bbca76a950 0x55bbca7678d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.928+0000 7f17f7672740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbca681180 con 0x55bbca7600b0 2024-09-13T17:20:24.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.928+0000 7f17f7672740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbca39b430 con 0x55bbca75f790 2024-09-13T17:20:24.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.928+0000 7f17f7672740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbca6465e0 con 0x55bbca76a950 2024-09-13T17:20:24.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.928+0000 7f17f7672740 10 client.0 _ll_register_callbacks cb 0x55bbca6b2aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:20:24.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.928+0000 7f17ee59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbca7600b0 0x55bbca767390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.928+0000 7f17ee59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbca7600b0 0x55bbca767390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39212/0 (socket says 172.21.15.87:39212) 2024-09-13T17:20:24.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.928+0000 7f17ee59c640 1 -- 172.21.15.87:0/1491832987 learned_addr learned my addr 172.21.15.87:0/1491832987 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:24.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.928+0000 7f17e5d9b640 1 --2- 172.21.15.87:0/1491832987 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bbca76a950 0x55bbca7678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.928+0000 7f17e5d9b640 1 --2- 172.21.15.87:0/1491832987 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbca75f790 0x55bbca769ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.928+0000 7f17ee59c640 1 -- 172.21.15.87:0/1491832987 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bbca76a950 msgr2=0x55bbca7678d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:24.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.928+0000 7f17ee59c640 1 --2- 172.21.15.87:0/1491832987 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bbca76a950 0x55bbca7678d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.928+0000 7f17ee59c640 1 -- 172.21.15.87:0/1491832987 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbca75f790 msgr2=0x55bbca769ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:24.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.928+0000 7f17ee59c640 1 --2- 172.21.15.87:0/1491832987 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbca75f790 0x55bbca769ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.928+0000 7f17ee59c640 1 -- 172.21.15.87:0/1491832987 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17d800bd90 con 0x55bbca7600b0 2024-09-13T17:20:24.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.928+0000 7f17e5d9b640 1 --2- 172.21.15.87:0/1491832987 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbca75f790 0x55bbca769ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:24.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.928+0000 7f17ee59c640 1 --2- 172.21.15.87:0/1491832987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbca7600b0 0x55bbca767390 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f17e0000c00 tx=0x7f17e0031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13e82ddb9094ea05 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:24.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.928+0000 7f17d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:20:24.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.928+0000 7f17d5ffb640 1 -- 172.21.15.87:0/1491832987 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e0004250 con 0x55bbca7600b0 2024-09-13T17:20:24.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.928+0000 7f17d5ffb640 1 -- 172.21.15.87:0/1491832987 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f17e00043b0 con 0x55bbca7600b0 2024-09-13T17:20:24.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.928+0000 7f17f7672740 1 -- 172.21.15.87:0/1491832987 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bbca6ecb80 con 0x55bbca7600b0 2024-09-13T17:20:24.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.928+0000 7f17d5ffb640 1 -- 172.21.15.87:0/1491832987 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17e00035f0 con 0x55bbca7600b0 2024-09-13T17:20:24.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.928+0000 7f17f7672740 10 client.17421 fetch_fsmap learned FSMap version 36 2024-09-13T17:20:24.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.928+0000 7f17f7672740 1 -- 172.21.15.87:0/1491832987 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55bbca6c13c0 con 0x55bbca7600b0 2024-09-13T17:20:24.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.929+0000 7f17d5ffb640 1 -- 172.21.15.87:0/1491832987 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55bbca6ecb80 con 0x55bbca7600b0 2024-09-13T17:20:24.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.929+0000 7f17d5ffb640 1 -- 172.21.15.87:0/1491832987 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f17e00467e0 con 0x55bbca7600b0 2024-09-13T17:20:24.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.929+0000 7f17f7672740 10 client.17421 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:20:24.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.929+0000 7f17f7672740 10 client.17421 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:20:24.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.929+0000 7f17f7672740 20 client.17421 populate_metadata read hostname 'smithi087' 2024-09-13T17:20:24.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.929+0000 7f17f7672740 1 --2- 172.21.15.87:0/1491832987 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55bbca77a220 0x55bbca77c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.929+0000 7f17f7672740 4 client.17421 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:20:24.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.929+0000 7f17f7672740 1 -- 172.21.15.87:0/1491832987 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bbca6b51f0 con 0x55bbca77a220 2024-09-13T17:20:24.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.929+0000 7f17e5d9b640 1 --2- 172.21.15.87:0/1491832987 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55bbca77a220 0x55bbca77c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.930+0000 7f17d5ffb640 10 client.17421 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:20:24.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.930+0000 7f17e5d9b640 1 --2- 172.21.15.87:0/1491832987 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55bbca77a220 0x55bbca77c640 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=400811c2236cb05b server_cookie=846e54b5bd3fb059 in_seq=0 out_seq=0 2024-09-13T17:20:24.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.930+0000 7f17d5ffb640 1 -- 172.21.15.87:0/1491832987 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55bbca6b51f0 con 0x55bbca77a220 2024-09-13T17:20:24.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.930+0000 7f17d5ffb640 10 client.17421 handle_command_reply: tid=0 2024-09-13T17:20:24.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.930+0000 7f17f7672740 1 client.17421 shutdown 2024-09-13T17:20:24.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.930+0000 7f17f7672740 1 -- 172.21.15.87:0/1491832987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbca7600b0 msgr2=0x55bbca767390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.930+0000 7f17f7672740 1 --2- 172.21.15.87:0/1491832987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbca7600b0 0x55bbca767390 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f17e0000c00 tx=0x7f17e0031630 comp rx=0 tx=0).stop 2024-09-13T17:20:24.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.930+0000 7f17f7672740 1 -- 172.21.15.87:0/1491832987 shutdown_connections 2024-09-13T17:20:24.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.930+0000 7f17f7672740 1 --2- 172.21.15.87:0/1491832987 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55bbca77a220 0x55bbca77c640 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.930+0000 7f17f7672740 1 --2- 172.21.15.87:0/1491832987 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bbca76a950 0x55bbca7678d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.930+0000 7f17d5ffb640 0 client.17421 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:20:24.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.930+0000 7f17f7672740 1 --2- 172.21.15.87:0/1491832987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbca7600b0 0x55bbca767390 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.930+0000 7f17f7672740 1 --2- 172.21.15.87:0/1491832987 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbca75f790 0x55bbca769ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.930+0000 7f17f7672740 1 -- 172.21.15.87:0/1491832987 >> 172.21.15.87:0/1491832987 conn(0x55bbca75bd00 msgr2=0x55bbca761a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:24.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.930+0000 7f17f7672740 1 -- 172.21.15.87:0/1491832987 shutdown_connections 2024-09-13T17:20:24.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.931+0000 7f17f7672740 1 -- 172.21.15.87:0/1491832987 wait complete. 2024-09-13T17:20:24.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.931+0000 7f17f7672740 20 client.17421 trim_cache size 0 max 16384 2024-09-13T17:20:24.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.941+0000 7f17f7672740 1 Processor -- start 2024-09-13T17:20:24.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.941+0000 7f17f7672740 1 -- start start 2024-09-13T17:20:24.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.942+0000 7f17f7672740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbca75bd00 0x55bbca75b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.942+0000 7f17f7672740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbca75f790 0x55bbca780fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.942+0000 7f17f7672740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bbca7600b0 0x55bbca767390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.942+0000 7f17f7672740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbca6ecb80 con 0x55bbca75bd00 2024-09-13T17:20:24.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.942+0000 7f17f7672740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbca7686f0 con 0x55bbca75f790 2024-09-13T17:20:24.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.942+0000 7f17f7672740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbca766330 con 0x55bbca7600b0 2024-09-13T17:20:24.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.942+0000 7f17e5d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbca75bd00 0x55bbca75b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.942+0000 7f17e5d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbca75bd00 0x55bbca75b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39228/0 (socket says 172.21.15.87:39228) 2024-09-13T17:20:24.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.942+0000 7f17e5d9b640 1 -- 172.21.15.87:0/2678471736 learned_addr learned my addr 172.21.15.87:0/2678471736 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:24.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.942+0000 7f17ee59c640 1 --2- 172.21.15.87:0/2678471736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbca75f790 0x55bbca780fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.942+0000 7f17e5d9b640 1 -- 172.21.15.87:0/2678471736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bbca7600b0 msgr2=0x55bbca767390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:24.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.942+0000 7f17e5d9b640 1 --2- 172.21.15.87:0/2678471736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bbca7600b0 0x55bbca767390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.942+0000 7f17e5d9b640 1 -- 172.21.15.87:0/2678471736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbca75f790 msgr2=0x55bbca780fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:24.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.942+0000 7f17e5d9b640 1 --2- 172.21.15.87:0/2678471736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbca75f790 0x55bbca780fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.942+0000 7f17e5d9b640 1 -- 172.21.15.87:0/2678471736 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbca663770 con 0x55bbca75bd00 2024-09-13T17:20:24.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.942+0000 7f17ee59c640 1 --2- 172.21.15.87:0/2678471736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbca75f790 0x55bbca780fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:24.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.942+0000 7f17e5d9b640 1 --2- 172.21.15.87:0/2678471736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbca75bd00 0x55bbca75b6a0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x55bbca762330 tx=0x7f17d800b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c1df4f17502cdfd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:24.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.942+0000 7f17e559a640 1 -- 172.21.15.87:0/2678471736 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d8010a50 con 0x55bbca75bd00 2024-09-13T17:20:24.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.942+0000 7f17e559a640 1 -- 172.21.15.87:0/2678471736 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f17d8005560 con 0x55bbca75bd00 2024-09-13T17:20:24.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.942+0000 7f17e559a640 1 -- 172.21.15.87:0/2678471736 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d802a7f0 con 0x55bbca75bd00 2024-09-13T17:20:24.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.943+0000 7f17f7672740 1 -- 172.21.15.87:0/2678471736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbca75bd00 msgr2=0x55bbca75b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.943+0000 7f17f7672740 1 --2- 172.21.15.87:0/2678471736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbca75bd00 0x55bbca75b6a0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x55bbca762330 tx=0x7f17d800b9d0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.943+0000 7f17f7672740 1 -- 172.21.15.87:0/2678471736 shutdown_connections 2024-09-13T17:20:24.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.943+0000 7f17f7672740 1 --2- 172.21.15.87:0/2678471736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bbca7600b0 0x55bbca767390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.943+0000 7f17f7672740 1 --2- 172.21.15.87:0/2678471736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbca75f790 0x55bbca780fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.943+0000 7f17f7672740 1 --2- 172.21.15.87:0/2678471736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbca75bd00 0x55bbca75b6a0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.943+0000 7f17f7672740 1 -- 172.21.15.87:0/2678471736 >> 172.21.15.87:0/2678471736 conn(0x55bbca76a040 msgr2=0x55bbca765c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:24.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.943+0000 7f17f7672740 1 -- 172.21.15.87:0/2678471736 shutdown_connections 2024-09-13T17:20:24.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.943+0000 7f17f7672740 1 -- 172.21.15.87:0/2678471736 wait complete. 2024-09-13T17:20:24.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.943+0000 7f17f7672740 1 -- start start 2024-09-13T17:20:24.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.943+0000 7f17f7672740 1 Processor -- start 2024-09-13T17:20:24.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.943+0000 7f17f7672740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbca75bd00 0x55bbca76e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.943+0000 7f17f7672740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbca75f790 0x55bbca76e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.943+0000 7f17f7672740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bbca7600b0 0x55bbca76ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.943+0000 7f17f7672740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbca7d07e0 con 0x55bbca75bd00 2024-09-13T17:20:24.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.943+0000 7f17f7672740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbca7d0920 con 0x55bbca75f790 2024-09-13T17:20:24.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.943+0000 7f17f7672740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbca7d0ae0 con 0x55bbca7600b0 2024-09-13T17:20:24.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.943+0000 7f17f7672740 10 client.0 _ll_register_callbacks cb 0x7f17d800b7c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:20:24.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.944+0000 7f17e5d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbca75bd00 0x55bbca76e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.944+0000 7f17e5d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbca75bd00 0x55bbca76e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39242/0 (socket says 172.21.15.87:39242) 2024-09-13T17:20:24.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.944+0000 7f17e5d9b640 1 -- 172.21.15.87:0/3825382901 learned_addr learned my addr 172.21.15.87:0/3825382901 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:24.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.944+0000 7f17ee59c640 1 --2- 172.21.15.87:0/3825382901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbca75f790 0x55bbca76e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.944+0000 7f17e5d9b640 1 --2- 172.21.15.87:0/3825382901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bbca7600b0 0x55bbca76ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.944+0000 7f17e5d9b640 1 -- 172.21.15.87:0/3825382901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bbca7600b0 msgr2=0x55bbca76ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:24.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.944+0000 7f17e5d9b640 1 --2- 172.21.15.87:0/3825382901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bbca7600b0 0x55bbca76ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.944+0000 7f17e5d9b640 1 -- 172.21.15.87:0/3825382901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbca75f790 msgr2=0x55bbca76e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:24.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.944+0000 7f17e5d9b640 1 --2- 172.21.15.87:0/3825382901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbca75f790 0x55bbca76e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.944+0000 7f17e5d9b640 1 -- 172.21.15.87:0/3825382901 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17d8022040 con 0x55bbca75bd00 2024-09-13T17:20:24.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.944+0000 7f17e5d9b640 1 --2- 172.21.15.87:0/3825382901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbca75bd00 0x55bbca76e130 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f17d800c010 tx=0x7f17d802a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a7a226f06ef1aac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:24.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.944+0000 7f17d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:20:24.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.944+0000 7f17d5ffb640 1 -- 172.21.15.87:0/3825382901 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d8010b20 con 0x55bbca75bd00 2024-09-13T17:20:24.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.944+0000 7f17d5ffb640 1 -- 172.21.15.87:0/3825382901 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f17d8000e40 con 0x55bbca75bd00 2024-09-13T17:20:24.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.944+0000 7f17f7672740 1 -- 172.21.15.87:0/3825382901 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f17d80108e0 con 0x55bbca75bd00 2024-09-13T17:20:24.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.944+0000 7f17d5ffb640 1 -- 172.21.15.87:0/3825382901 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17d8012030 con 0x55bbca75bd00 2024-09-13T17:20:24.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.944+0000 7f17f7672740 10 client.17427 fetch_fsmap learned FSMap version 36 2024-09-13T17:20:24.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.944+0000 7f17f7672740 1 -- 172.21.15.87:0/3825382901 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55bbca688e80 con 0x55bbca75bd00 2024-09-13T17:20:24.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.944+0000 7f17d5ffb640 1 -- 172.21.15.87:0/3825382901 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f17d80108e0 con 0x55bbca75bd00 2024-09-13T17:20:24.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.945+0000 7f17d5ffb640 1 -- 172.21.15.87:0/3825382901 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f17d80035f0 con 0x55bbca75bd00 2024-09-13T17:20:24.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.945+0000 7f17f7672740 10 client.17427 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:20:24.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.945+0000 7f17f7672740 10 client.17427 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:20:24.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.945+0000 7f17f7672740 20 client.17427 populate_metadata read hostname 'smithi087' 2024-09-13T17:20:24.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.945+0000 7f17f7672740 1 --2- 172.21.15.87:0/3825382901 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55bbca76a950 0x55bbca7d3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:24.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.945+0000 7f17f7672740 4 client.17427 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:20:24.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.945+0000 7f17f7672740 1 -- 172.21.15.87:0/3825382901 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55bbca3b64e0 con 0x55bbca76a950 2024-09-13T17:20:24.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.945+0000 7f17ee59c640 1 --2- 172.21.15.87:0/3825382901 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55bbca76a950 0x55bbca7d3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:24.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.945+0000 7f17d5ffb640 10 client.17427 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:20:24.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.945+0000 7f17ee59c640 1 --2- 172.21.15.87:0/3825382901 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55bbca76a950 0x55bbca7d3e70 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bf506cd9750d6e2 server_cookie=b6c1e4e90c322f01 in_seq=0 out_seq=0 2024-09-13T17:20:24.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.946+0000 7f17d5ffb640 1 -- 172.21.15.87:0/3825382901 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55bbca3b64e0 con 0x55bbca76a950 2024-09-13T17:20:24.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.946+0000 7f17d5ffb640 10 client.17427 handle_command_reply: tid=0 2024-09-13T17:20:24.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.946+0000 7f17f7672740 1 client.17427 shutdown 2024-09-13T17:20:24.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.946+0000 7f17f7672740 1 -- 172.21.15.87:0/3825382901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbca75bd00 msgr2=0x55bbca76e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.946+0000 7f17f7672740 1 --2- 172.21.15.87:0/3825382901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbca75bd00 0x55bbca76e130 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f17d800c010 tx=0x7f17d802a430 comp rx=0 tx=0).stop 2024-09-13T17:20:24.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.946+0000 7f17f7672740 1 -- 172.21.15.87:0/3825382901 shutdown_connections 2024-09-13T17:20:24.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.946+0000 7f17f7672740 1 --2- 172.21.15.87:0/3825382901 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55bbca76a950 0x55bbca7d3e70 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.946+0000 7f17f7672740 1 --2- 172.21.15.87:0/3825382901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bbca7600b0 0x55bbca76ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.946+0000 7f17d5ffb640 0 client.17427 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:20:24.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.946+0000 7f17f7672740 1 --2- 172.21.15.87:0/3825382901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbca75f790 0x55bbca76e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.946+0000 7f17f7672740 1 --2- 172.21.15.87:0/3825382901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bbca75bd00 0x55bbca76e130 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.946+0000 7f17f7672740 1 -- 172.21.15.87:0/3825382901 >> 172.21.15.87:0/3825382901 conn(0x55bbca76a040 msgr2=0x55bbca780fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:24.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.946+0000 7f17f7672740 1 -- 172.21.15.87:0/3825382901 shutdown_connections 2024-09-13T17:20:24.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.946+0000 7f17f7672740 1 -- 172.21.15.87:0/3825382901 wait complete. 2024-09-13T17:20:24.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.946+0000 7f17f7672740 20 client.17427 trim_cache size 0 max 16384 2024-09-13T17:20:24.956 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:20:24.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.946+0000 7f17f4872640 1 -- 172.21.15.87:0/3868901502 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f17dc0a1200 msgr2=0x7f17dc0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.946+0000 7f17f4872640 1 --2- 172.21.15.87:0/3868901502 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f17dc0a1200 0x7f17dc0a36c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f17e8099c60 tx=0x7f17e800fd20 comp rx=0 tx=0).stop 2024-09-13T17:20:24.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.946+0000 7f17f4872640 1 -- 172.21.15.87:0/3868901502 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17f0197bd0 msgr2=0x7f17f01a21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:24.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.946+0000 7f17f4872640 1 --2- 172.21.15.87:0/3868901502 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17f0197bd0 0x7f17f01a21d0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f17e800cab0 tx=0x7f17e800cf70 comp rx=0 tx=0).stop 2024-09-13T17:20:24.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.946+0000 7f17f4872640 1 -- 172.21.15.87:0/3868901502 shutdown_connections 2024-09-13T17:20:24.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.946+0000 7f17f4872640 1 --2- 172.21.15.87:0/3868901502 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f17dc0a1200 0x7f17dc0a36c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.946+0000 7f17f4872640 1 --2- 172.21.15.87:0/3868901502 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17f0197bd0 0x7f17f01a21d0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.946+0000 7f17f4872640 1 --2- 172.21.15.87:0/3868901502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17f0103fb0 0x7f17f0197690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.946+0000 7f17f4872640 1 --2- 172.21.15.87:0/3868901502 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17f00fee60 0x7f17f0197150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:24.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.946+0000 7f17f4872640 1 -- 172.21.15.87:0/3868901502 >> 172.21.15.87:0/3868901502 conn(0x7f17f0075c60 msgr2=0x7f17f01022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:24.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.947+0000 7f17f4872640 1 -- 172.21.15.87:0/3868901502 shutdown_connections 2024-09-13T17:20:24.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:24.947+0000 7f17f4872640 1 -- 172.21.15.87:0/3868901502 wait complete. 2024-09-13T17:20:25.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:25 smithi149 ceph-mon[35496]: pgmap v203: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 8 op/s 2024-09-13T17:20:25.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:25 smithi118 ceph-mon[34374]: pgmap v203: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 8 op/s 2024-09-13T17:20:25.960 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-13T17:20:25.960 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-09-13T17:20:25.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:25 smithi087 ceph-mon[30934]: pgmap v203: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 8 op/s 2024-09-13T17:20:26.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.072+0000 7f2708e02640 1 -- 172.21.15.87:0/3206601763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27040fee60 msgr2=0x7f27040ff240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:26.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.072+0000 7f2708e02640 1 --2- 172.21.15.87:0/3206601763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27040fee60 0x7f27040ff240 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f26f4009cd0 tx=0x7f26f402a8e0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.072+0000 7f2708e02640 1 -- 172.21.15.87:0/3206601763 shutdown_connections 2024-09-13T17:20:26.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.072+0000 7f2708e02640 1 --2- 172.21.15.87:0/3206601763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2704103fb0 0x7f270410bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.072+0000 7f2708e02640 1 --2- 172.21.15.87:0/3206601763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27040ff810 0x7f2704103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.072+0000 7f2708e02640 1 --2- 172.21.15.87:0/3206601763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27040fee60 0x7f27040ff240 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.072+0000 7f2708e02640 1 -- 172.21.15.87:0/3206601763 >> 172.21.15.87:0/3206601763 conn(0x7f2704075c60 msgr2=0x7f27040fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:26.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.072+0000 7f2708e02640 1 -- 172.21.15.87:0/3206601763 shutdown_connections 2024-09-13T17:20:26.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.072+0000 7f2708e02640 1 -- 172.21.15.87:0/3206601763 wait complete. 2024-09-13T17:20:26.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.073+0000 7f2708e02640 1 Processor -- start 2024-09-13T17:20:26.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.073+0000 7f2708e02640 1 -- start start 2024-09-13T17:20:26.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.073+0000 7f2708e02640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27040fee60 0x7f27040fb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.073+0000 7f2708e02640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2704103fb0 0x7f27040fb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.073+0000 7f2708e02640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27040fbb20 0x7f27041a4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.073+0000 7f2708e02640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27041a4a20 con 0x7f27040fbb20 2024-09-13T17:20:26.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.073+0000 7f2708e02640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27041a4b90 con 0x7f27040fee60 2024-09-13T17:20:26.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.073+0000 7f2708e02640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27041a4d50 con 0x7f2704103fb0 2024-09-13T17:20:26.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.073+0000 7f2702d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27040fbb20 0x7f27041a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.073+0000 7f2702d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27040fbb20 0x7f27041a4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39268/0 (socket says 172.21.15.87:39268) 2024-09-13T17:20:26.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.073+0000 7f2702d9d640 1 -- 172.21.15.87:0/2610293674 learned_addr learned my addr 172.21.15.87:0/2610293674 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:26.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.073+0000 7f270259c640 1 --2- 172.21.15.87:0/2610293674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27040fee60 0x7f27040fb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.073+0000 7f2701d9b640 1 --2- 172.21.15.87:0/2610293674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2704103fb0 0x7f27040fb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.073+0000 7f2702d9d640 1 -- 172.21.15.87:0/2610293674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2704103fb0 msgr2=0x7f27040fb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:26.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.073+0000 7f2702d9d640 1 --2- 172.21.15.87:0/2610293674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2704103fb0 0x7f27040fb5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.073+0000 7f2702d9d640 1 -- 172.21.15.87:0/2610293674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27040fee60 msgr2=0x7f27040fb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:26.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.073+0000 7f2702d9d640 1 --2- 172.21.15.87:0/2610293674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27040fee60 0x7f27040fb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.073+0000 7f2702d9d640 1 -- 172.21.15.87:0/2610293674 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f4009900 con 0x7f27040fbb20 2024-09-13T17:20:26.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.074+0000 7f2702d9d640 1 --2- 172.21.15.87:0/2610293674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27040fbb20 0x7f27041a4450 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f26fc00d700 tx=0x7f26fc00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:26.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.074+0000 7f26f37fe640 1 -- 172.21.15.87:0/2610293674 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc004020 con 0x7f27040fbb20 2024-09-13T17:20:26.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.074+0000 7f26f37fe640 1 -- 172.21.15.87:0/2610293674 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f26fc009820 con 0x7f27040fbb20 2024-09-13T17:20:26.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.074+0000 7f2708e02640 1 -- 172.21.15.87:0/2610293674 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27041a5030 con 0x7f27040fbb20 2024-09-13T17:20:26.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.074+0000 7f26f37fe640 1 -- 172.21.15.87:0/2610293674 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc003bf0 con 0x7f27040fbb20 2024-09-13T17:20:26.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.074+0000 7f2708e02640 1 -- 172.21.15.87:0/2610293674 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27041a54c0 con 0x7f27040fbb20 2024-09-13T17:20:26.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.076+0000 7f26f37fe640 1 -- 172.21.15.87:0/2610293674 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f26fc003d50 con 0x7f27040fbb20 2024-09-13T17:20:26.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.076+0000 7f270bc06740 1 Processor -- start 2024-09-13T17:20:26.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.077+0000 7f270bc06740 1 -- start start 2024-09-13T17:20:26.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.077+0000 7f270bc06740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7f476d7c0 0x55e7f476dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.077+0000 7f270bc06740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7f476e0e0 0x55e7f4778440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.077+0000 7f270bc06740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e7f4778980 0x55e7f477ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.077+0000 7f270bc06740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f46d8c60 con 0x55e7f476d7c0 2024-09-13T17:20:26.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.077+0000 7f270bc06740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f46d63f0 con 0x55e7f476e0e0 2024-09-13T17:20:26.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.077+0000 7f270bc06740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f46d1ce0 con 0x55e7f4778980 2024-09-13T17:20:26.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.077+0000 7f2701d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7f476d7c0 0x55e7f476dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.077+0000 7f2701d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7f476d7c0 0x55e7f476dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39284/0 (socket says 172.21.15.87:39284) 2024-09-13T17:20:26.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.077+0000 7f2701d9b640 1 -- 172.21.15.87:0/538281363 learned_addr learned my addr 172.21.15.87:0/538281363 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:26.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.077+0000 7f270259c640 1 --2- 172.21.15.87:0/538281363 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7f476e0e0 0x55e7f4778440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.077+0000 7f26f37fe640 1 --2- 172.21.15.87:0/2610293674 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f26ec0a1230 0x7f26ec0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.077+0000 7f2701d9b640 1 -- 172.21.15.87:0/538281363 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e7f4778980 msgr2=0x55e7f477ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:26.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.077+0000 7f2701d9b640 1 --2- 172.21.15.87:0/538281363 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e7f4778980 0x55e7f477ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.077+0000 7f2701d9b640 1 -- 172.21.15.87:0/538281363 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7f476e0e0 msgr2=0x55e7f4778440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:26.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.077+0000 7f2701d9b640 1 --2- 172.21.15.87:0/538281363 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7f476e0e0 0x55e7f4778440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.077+0000 7f2701d9b640 1 -- 172.21.15.87:0/538281363 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7f468d970 con 0x55e7f476d7c0 2024-09-13T17:20:26.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.077+0000 7f2702d9d640 1 --2- 172.21.15.87:0/2610293674 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f26ec0a1230 0x7f26ec0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.078+0000 7f26f37fe640 1 -- 172.21.15.87:0/2610293674 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f26fc0cca50 con 0x7f27040fbb20 2024-09-13T17:20:26.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.078+0000 7f2701d9b640 1 --2- 172.21.15.87:0/538281363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7f476d7c0 0x55e7f476dba0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009bb0 tx=0x7f26f80106e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b50f55cd328a80 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:26.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.078+0000 7f26f0ff9640 1 -- 172.21.15.87:0/538281363 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f8009ea0 con 0x55e7f476d7c0 2024-09-13T17:20:26.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.078+0000 7f26f0ff9640 1 -- 172.21.15.87:0/538281363 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f26f80054d0 con 0x55e7f476d7c0 2024-09-13T17:20:26.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.078+0000 7f26f0ff9640 1 -- 172.21.15.87:0/538281363 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f8012420 con 0x55e7f476d7c0 2024-09-13T17:20:26.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.078+0000 7f270bc06740 1 -- 172.21.15.87:0/538281363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7f476d7c0 msgr2=0x55e7f476dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:26.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.078+0000 7f2702d9d640 1 --2- 172.21.15.87:0/2610293674 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f26ec0a1230 0x7f26ec0a36f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f26fc095be0 tx=0x7f26fc0c3c70 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:26.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.078+0000 7f270bc06740 1 --2- 172.21.15.87:0/538281363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7f476d7c0 0x55e7f476dba0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009bb0 tx=0x7f26f80106e0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.079+0000 7f270bc06740 1 -- 172.21.15.87:0/538281363 shutdown_connections 2024-09-13T17:20:26.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.079+0000 7f270bc06740 1 --2- 172.21.15.87:0/538281363 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e7f4778980 0x55e7f477ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.079+0000 7f270bc06740 1 --2- 172.21.15.87:0/538281363 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7f476e0e0 0x55e7f4778440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.079+0000 7f270bc06740 1 --2- 172.21.15.87:0/538281363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7f476d7c0 0x55e7f476dba0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.079+0000 7f270bc06740 1 -- 172.21.15.87:0/538281363 >> 172.21.15.87:0/538281363 conn(0x55e7f4769d50 msgr2=0x55e7f476a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:26.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.079+0000 7f270bc06740 1 -- 172.21.15.87:0/538281363 shutdown_connections 2024-09-13T17:20:26.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.079+0000 7f270bc06740 1 -- 172.21.15.87:0/538281363 wait complete. 2024-09-13T17:20:26.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.079+0000 7f270bc06740 1 -- start start 2024-09-13T17:20:26.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.079+0000 7f270bc06740 1 Processor -- start 2024-09-13T17:20:26.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.079+0000 7f270bc06740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e7f476d7c0 0x55e7f4778290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.079+0000 7f270bc06740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7f476e0e0 0x55e7f47755e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.079+0000 7f270bc06740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7f4778980 0x55e7f4775b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.079+0000 7f270bc06740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f468ff80 con 0x55e7f4778980 2024-09-13T17:20:26.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.079+0000 7f270bc06740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f468fc20 con 0x55e7f476e0e0 2024-09-13T17:20:26.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.079+0000 7f270bc06740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f465cab0 con 0x55e7f476d7c0 2024-09-13T17:20:26.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.079+0000 7f270bc06740 10 client.0 _ll_register_callbacks cb 0x55e7f46cb350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:20:26.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.079+0000 7f2701d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7f4778980 0x55e7f4775b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.079+0000 7f2701d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7f4778980 0x55e7f4775b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39298/0 (socket says 172.21.15.87:39298) 2024-09-13T17:20:26.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.079+0000 7f2701d9b640 1 -- 172.21.15.87:0/2025442218 learned_addr learned my addr 172.21.15.87:0/2025442218 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:26.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.080+0000 7f2701d9b640 1 --2- 172.21.15.87:0/2025442218 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e7f476d7c0 0x55e7f4778290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.080+0000 7f270259c640 1 --2- 172.21.15.87:0/2025442218 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7f476e0e0 0x55e7f47755e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.080+0000 7f2701d9b640 1 -- 172.21.15.87:0/2025442218 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e7f476d7c0 msgr2=0x55e7f4778290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:26.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.080+0000 7f2701d9b640 1 --2- 172.21.15.87:0/2025442218 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e7f476d7c0 0x55e7f4778290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.080+0000 7f2701d9b640 1 -- 172.21.15.87:0/2025442218 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7f476e0e0 msgr2=0x55e7f47755e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:26.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.080+0000 7f2701d9b640 1 --2- 172.21.15.87:0/2025442218 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7f476e0e0 0x55e7f47755e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.080+0000 7f2701d9b640 1 -- 172.21.15.87:0/2025442218 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26f8009890 con 0x55e7f4778980 2024-09-13T17:20:26.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.080+0000 7f270259c640 1 --2- 172.21.15.87:0/2025442218 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7f476e0e0 0x55e7f47755e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:26.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.080+0000 7f2701d9b640 1 --2- 172.21.15.87:0/2025442218 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7f4778980 0x55e7f4775b20 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009860 tx=0x7f26f80097f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403e8f8c958bac9c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:26.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.080+0000 7f26e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:20:26.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.080+0000 7f26e9ffb640 1 -- 172.21.15.87:0/2025442218 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f8005230 con 0x55e7f4778980 2024-09-13T17:20:26.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.080+0000 7f26e9ffb640 1 -- 172.21.15.87:0/2025442218 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f26f80046c0 con 0x55e7f4778980 2024-09-13T17:20:26.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.080+0000 7f270bc06740 1 -- 172.21.15.87:0/2025442218 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e7f43c5590 con 0x55e7f4778980 2024-09-13T17:20:26.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.080+0000 7f26e9ffb640 1 -- 172.21.15.87:0/2025442218 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26f8004880 con 0x55e7f4778980 2024-09-13T17:20:26.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.080+0000 7f270bc06740 10 client.17439 fetch_fsmap learned FSMap version 36 2024-09-13T17:20:26.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.080+0000 7f270bc06740 1 -- 172.21.15.87:0/2025442218 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55e7f46d0360 con 0x55e7f4778980 2024-09-13T17:20:26.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.080+0000 7f26e9ffb640 1 -- 172.21.15.87:0/2025442218 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55e7f43c5590 con 0x55e7f4778980 2024-09-13T17:20:26.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.080+0000 7f26e9ffb640 1 -- 172.21.15.87:0/2025442218 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f26f800c070 con 0x55e7f4778980 2024-09-13T17:20:26.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.081+0000 7f270bc06740 10 client.17439 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:20:26.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.081+0000 7f270bc06740 10 client.17439 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:20:26.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.081+0000 7f270bc06740 20 client.17439 populate_metadata read hostname 'smithi087' 2024-09-13T17:20:26.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.081+0000 7f270bc06740 1 --2- 172.21.15.87:0/2025442218 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55e7f4788430 0x55e7f478a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.081+0000 7f270bc06740 4 client.17439 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:20:26.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.081+0000 7f270bc06740 1 -- 172.21.15.87:0/2025442218 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e7f43d6860 con 0x55e7f4788430 2024-09-13T17:20:26.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.081+0000 7f270259c640 1 --2- 172.21.15.87:0/2025442218 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55e7f4788430 0x55e7f478a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.081+0000 7f270259c640 1 --2- 172.21.15.87:0/2025442218 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55e7f4788430 0x55e7f478a820 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3c9d4a040285d81 server_cookie=3facf495e92839f9 in_seq=0 out_seq=0 2024-09-13T17:20:26.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.081+0000 7f26e9ffb640 10 client.17439 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:20:26.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.082+0000 7f26e9ffb640 1 -- 172.21.15.87:0/2025442218 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55e7f43d6860 con 0x55e7f4788430 2024-09-13T17:20:26.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.082+0000 7f26e9ffb640 10 client.17439 handle_command_reply: tid=0 2024-09-13T17:20:26.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.082+0000 7f270bc06740 1 client.17439 shutdown 2024-09-13T17:20:26.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.082+0000 7f270bc06740 1 -- 172.21.15.87:0/2025442218 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7f4778980 msgr2=0x55e7f4775b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:26.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.082+0000 7f270bc06740 1 --2- 172.21.15.87:0/2025442218 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7f4778980 0x55e7f4775b20 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009860 tx=0x7f26f80097f0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.082+0000 7f270bc06740 1 -- 172.21.15.87:0/2025442218 shutdown_connections 2024-09-13T17:20:26.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.082+0000 7f270bc06740 1 --2- 172.21.15.87:0/2025442218 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55e7f4788430 0x55e7f478a820 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.082+0000 7f270bc06740 1 --2- 172.21.15.87:0/2025442218 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7f4778980 0x55e7f4775b20 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.082+0000 7f26e9ffb640 0 client.17439 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:20:26.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.082+0000 7f270bc06740 1 --2- 172.21.15.87:0/2025442218 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7f476e0e0 0x55e7f47755e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.082+0000 7f270bc06740 1 --2- 172.21.15.87:0/2025442218 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e7f476d7c0 0x55e7f4778290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.082+0000 7f270bc06740 1 -- 172.21.15.87:0/2025442218 >> 172.21.15.87:0/2025442218 conn(0x55e7f4769d50 msgr2=0x55e7f476f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:26.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.082+0000 7f270bc06740 1 -- 172.21.15.87:0/2025442218 shutdown_connections 2024-09-13T17:20:26.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.082+0000 7f270bc06740 1 -- 172.21.15.87:0/2025442218 wait complete. 2024-09-13T17:20:26.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.082+0000 7f270bc06740 20 client.17439 trim_cache size 0 max 16384 2024-09-13T17:20:26.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.096+0000 7f270bc06740 1 Processor -- start 2024-09-13T17:20:26.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.096+0000 7f270bc06740 1 -- start start 2024-09-13T17:20:26.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.096+0000 7f270bc06740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7f476d7c0 0x55e7f477f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.096+0000 7f270bc06740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e7f476e0e0 0x55e7f477fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.096+0000 7f270bc06740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7f4778980 0x55e7f476a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.096+0000 7f270bc06740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f4784cf0 con 0x55e7f4778980 2024-09-13T17:20:26.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.096+0000 7f270bc06740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f43d6890 con 0x55e7f476d7c0 2024-09-13T17:20:26.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.096+0000 7f270bc06740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f4776a70 con 0x55e7f476e0e0 2024-09-13T17:20:26.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.097+0000 7f2701d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7f4778980 0x55e7f476a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.097+0000 7f2701d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7f4778980 0x55e7f476a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39310/0 (socket says 172.21.15.87:39310) 2024-09-13T17:20:26.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.097+0000 7f2701d9b640 1 -- 172.21.15.87:0/2498080769 learned_addr learned my addr 172.21.15.87:0/2498080769 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:26.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.097+0000 7f2701d9b640 1 --2- 172.21.15.87:0/2498080769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7f476d7c0 0x55e7f477f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.097+0000 7f2701d9b640 1 -- 172.21.15.87:0/2498080769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e7f476e0e0 msgr2=0x55e7f477fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:26.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.097+0000 7f270259c640 1 --2- 172.21.15.87:0/2498080769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e7f476e0e0 0x55e7f477fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.097+0000 7f2701d9b640 1 --2- 172.21.15.87:0/2498080769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e7f476e0e0 0x55e7f477fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.097+0000 7f2701d9b640 1 -- 172.21.15.87:0/2498080769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7f476d7c0 msgr2=0x55e7f477f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:26.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.097+0000 7f2701d9b640 1 --2- 172.21.15.87:0/2498080769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7f476d7c0 0x55e7f477f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.097+0000 7f2701d9b640 1 -- 172.21.15.87:0/2498080769 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7f46721c0 con 0x55e7f4778980 2024-09-13T17:20:26.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.097+0000 7f270259c640 1 --2- 172.21.15.87:0/2498080769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e7f476e0e0 0x55e7f477fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:26.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.097+0000 7f2701d9b640 1 --2- 172.21.15.87:0/2498080769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7f4778980 0x55e7f476a130 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f26f8005fd0 tx=0x7f26f80106e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7887a0753e524658 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:26.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.097+0000 7f26f17fa640 1 -- 172.21.15.87:0/2498080769 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f801a520 con 0x55e7f4778980 2024-09-13T17:20:26.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.097+0000 7f26f17fa640 1 -- 172.21.15.87:0/2498080769 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f26f8004e10 con 0x55e7f4778980 2024-09-13T17:20:26.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.097+0000 7f26f17fa640 1 -- 172.21.15.87:0/2498080769 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f801aa50 con 0x55e7f4778980 2024-09-13T17:20:26.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.098+0000 7f270bc06740 1 -- 172.21.15.87:0/2498080769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7f4778980 msgr2=0x55e7f476a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:26.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.098+0000 7f270bc06740 1 --2- 172.21.15.87:0/2498080769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7f4778980 0x55e7f476a130 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f26f8005fd0 tx=0x7f26f80106e0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.098+0000 7f270bc06740 1 -- 172.21.15.87:0/2498080769 shutdown_connections 2024-09-13T17:20:26.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.098+0000 7f270bc06740 1 --2- 172.21.15.87:0/2498080769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7f4778980 0x55e7f476a130 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.098+0000 7f270bc06740 1 --2- 172.21.15.87:0/2498080769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e7f476e0e0 0x55e7f477fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.098+0000 7f270bc06740 1 --2- 172.21.15.87:0/2498080769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7f476d7c0 0x55e7f477f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.098+0000 7f270bc06740 1 -- 172.21.15.87:0/2498080769 >> 172.21.15.87:0/2498080769 conn(0x55e7f4769d50 msgr2=0x55e7f47755e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:26.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.098+0000 7f270bc06740 1 -- 172.21.15.87:0/2498080769 shutdown_connections 2024-09-13T17:20:26.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.098+0000 7f270bc06740 1 -- 172.21.15.87:0/2498080769 wait complete. 2024-09-13T17:20:26.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.098+0000 7f270bc06740 1 -- start start 2024-09-13T17:20:26.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.098+0000 7f270bc06740 1 Processor -- start 2024-09-13T17:20:26.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.098+0000 7f270bc06740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e7f476d7c0 0x55e7f477f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.098+0000 7f270bc06740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7f476e0e0 0x55e7f477de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.098+0000 7f270bc06740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7f4778980 0x55e7f477e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.098+0000 7f270bc06740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f477eab0 con 0x55e7f476e0e0 2024-09-13T17:20:26.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.098+0000 7f270bc06740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f477ec20 con 0x55e7f4778980 2024-09-13T17:20:26.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.098+0000 7f270bc06740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f47de910 con 0x55e7f476d7c0 2024-09-13T17:20:26.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.098+0000 7f270bc06740 10 client.0 _ll_register_callbacks cb 0x7f26f8009ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:20:26.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.099+0000 7f270259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7f476e0e0 0x55e7f477de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.099+0000 7f270259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7f476e0e0 0x55e7f477de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39312/0 (socket says 172.21.15.87:39312) 2024-09-13T17:20:26.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.099+0000 7f270259c640 1 -- 172.21.15.87:0/144016241 learned_addr learned my addr 172.21.15.87:0/144016241 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:26.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.099+0000 7f2701d9b640 1 --2- 172.21.15.87:0/144016241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e7f476d7c0 0x55e7f477f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.099+0000 7f270259c640 1 -- 172.21.15.87:0/144016241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e7f476d7c0 msgr2=0x55e7f477f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:26.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.099+0000 7f270259c640 1 --2- 172.21.15.87:0/144016241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e7f476d7c0 0x55e7f477f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.099+0000 7f270259c640 1 -- 172.21.15.87:0/144016241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7f4778980 msgr2=0x55e7f477e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:26.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.099+0000 7f2701d9b640 1 --2- 172.21.15.87:0/144016241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7f4778980 0x55e7f477e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.099+0000 7f270259c640 1 --2- 172.21.15.87:0/144016241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7f4778980 0x55e7f477e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.099+0000 7f270259c640 1 -- 172.21.15.87:0/144016241 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e7f46d0360 con 0x55e7f476e0e0 2024-09-13T17:20:26.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.099+0000 7f270259c640 1 --2- 172.21.15.87:0/144016241 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7f476e0e0 0x55e7f477de70 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f26f4009bf0 tx=0x7f26f4030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75fafcc789e8e96e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:26.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.099+0000 7f26e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:20:26.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.099+0000 7f26e9ffb640 1 -- 172.21.15.87:0/144016241 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f4040070 con 0x55e7f476e0e0 2024-09-13T17:20:26.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.099+0000 7f26e9ffb640 1 -- 172.21.15.87:0/144016241 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f26f4031870 con 0x55e7f476e0e0 2024-09-13T17:20:26.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.099+0000 7f270bc06740 1 -- 172.21.15.87:0/144016241 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f26f80054d0 con 0x55e7f476e0e0 2024-09-13T17:20:26.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.099+0000 7f26e9ffb640 1 -- 172.21.15.87:0/144016241 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26f4031a30 con 0x55e7f476e0e0 2024-09-13T17:20:26.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.099+0000 7f270bc06740 10 client.17445 fetch_fsmap learned FSMap version 36 2024-09-13T17:20:26.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.099+0000 7f270bc06740 1 -- 172.21.15.87:0/144016241 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55e7f4697990 con 0x55e7f476e0e0 2024-09-13T17:20:26.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.099+0000 7f26e9ffb640 1 -- 172.21.15.87:0/144016241 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f26f80054d0 con 0x55e7f476e0e0 2024-09-13T17:20:26.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.099+0000 7f26e9ffb640 1 -- 172.21.15.87:0/144016241 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f26f40476c0 con 0x55e7f476e0e0 2024-09-13T17:20:26.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.100+0000 7f270bc06740 10 client.17445 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:20:26.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.100+0000 7f270bc06740 10 client.17445 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:20:26.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.100+0000 7f270bc06740 20 client.17445 populate_metadata read hostname 'smithi087' 2024-09-13T17:20:26.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.100+0000 7f270bc06740 1 --2- 172.21.15.87:0/144016241 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55e7f4788430 0x55e7f47e2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.100+0000 7f270bc06740 4 client.17445 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-13T17:20:26.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.100+0000 7f270bc06740 1 -- 172.21.15.87:0/144016241 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55e7f4429eb0 con 0x55e7f4788430 2024-09-13T17:20:26.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.100+0000 7f2701d9b640 1 --2- 172.21.15.87:0/144016241 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55e7f4788430 0x55e7f47e2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.100+0000 7f26e9ffb640 10 client.17445 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:20:26.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.100+0000 7f2701d9b640 1 --2- 172.21.15.87:0/144016241 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55e7f4788430 0x55e7f47e2020 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ba252b80d427c5f server_cookie=55fedeafc7a1cdaf in_seq=0 out_seq=0 2024-09-13T17:20:26.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.101+0000 7f26e9ffb640 1 -- 172.21.15.87:0/144016241 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55e7f4429eb0 con 0x55e7f4788430 2024-09-13T17:20:26.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.101+0000 7f26e9ffb640 10 client.17445 handle_command_reply: tid=0 2024-09-13T17:20:26.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.101+0000 7f270bc06740 1 client.17445 shutdown 2024-09-13T17:20:26.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.101+0000 7f270bc06740 1 -- 172.21.15.87:0/144016241 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7f476e0e0 msgr2=0x55e7f477de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:26.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.101+0000 7f270bc06740 1 --2- 172.21.15.87:0/144016241 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7f476e0e0 0x55e7f477de70 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f26f4009bf0 tx=0x7f26f4030d70 comp rx=0 tx=0).stop 2024-09-13T17:20:26.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.101+0000 7f270bc06740 1 -- 172.21.15.87:0/144016241 shutdown_connections 2024-09-13T17:20:26.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.101+0000 7f270bc06740 1 --2- 172.21.15.87:0/144016241 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55e7f4788430 0x55e7f47e2020 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.101+0000 7f270bc06740 1 --2- 172.21.15.87:0/144016241 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7f4778980 0x55e7f477e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.101+0000 7f270bc06740 1 --2- 172.21.15.87:0/144016241 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e7f476e0e0 0x55e7f477de70 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.101+0000 7f270bc06740 1 --2- 172.21.15.87:0/144016241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e7f476d7c0 0x55e7f477f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.101+0000 7f270bc06740 1 -- 172.21.15.87:0/144016241 >> 172.21.15.87:0/144016241 conn(0x55e7f4769d50 msgr2=0x55e7f4775550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:26.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.101+0000 7f26e9ffb640 0 client.17445 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:20:26.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.102+0000 7f270bc06740 1 -- 172.21.15.87:0/144016241 shutdown_connections 2024-09-13T17:20:26.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.102+0000 7f270bc06740 1 -- 172.21.15.87:0/144016241 wait complete. 2024-09-13T17:20:26.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.102+0000 7f270bc06740 20 client.17445 trim_cache size 0 max 16384 2024-09-13T17:20:26.112 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:20:26.113 INFO:teuthology.orchestra.run.smithi087.stdout: "return_code": 0, 2024-09-13T17:20:26.113 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_tag": "5575d1b9-3a3f-4640-8911-7738d75c8319", 2024-09-13T17:20:26.113 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": "asynchronous" 2024-09-13T17:20:26.113 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:20:26.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.102+0000 7f2708e02640 1 -- 172.21.15.87:0/2610293674 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f26ec0a1230 msgr2=0x7f26ec0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:26.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.102+0000 7f2708e02640 1 --2- 172.21.15.87:0/2610293674 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f26ec0a1230 0x7f26ec0a36f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f26fc095be0 tx=0x7f26fc0c3c70 comp rx=0 tx=0).stop 2024-09-13T17:20:26.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.102+0000 7f2708e02640 1 -- 172.21.15.87:0/2610293674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27040fbb20 msgr2=0x7f27041a4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:26.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.102+0000 7f2708e02640 1 --2- 172.21.15.87:0/2610293674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27040fbb20 0x7f27041a4450 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f26fc00d700 tx=0x7f26fc00dbc0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.102+0000 7f2708e02640 1 -- 172.21.15.87:0/2610293674 shutdown_connections 2024-09-13T17:20:26.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.102+0000 7f2708e02640 1 --2- 172.21.15.87:0/2610293674 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f26ec0a1230 0x7f26ec0a36f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.102+0000 7f2708e02640 1 --2- 172.21.15.87:0/2610293674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27040fbb20 0x7f27041a4450 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.102+0000 7f2708e02640 1 --2- 172.21.15.87:0/2610293674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2704103fb0 0x7f27040fb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.102+0000 7f2708e02640 1 --2- 172.21.15.87:0/2610293674 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27040fee60 0x7f27040fb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.102+0000 7f2708e02640 1 -- 172.21.15.87:0/2610293674 >> 172.21.15.87:0/2610293674 conn(0x7f2704075c60 msgr2=0x7f2704067a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:26.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.102+0000 7f2708e02640 1 -- 172.21.15.87:0/2610293674 shutdown_connections 2024-09-13T17:20:26.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.102+0000 7f2708e02640 1 -- 172.21.15.87:0/2610293674 wait complete. 2024-09-13T17:20:26.115 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:20:26.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.256+0000 7fc4fa765640 1 -- 172.21.15.87:0/1471720499 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4f4101860 msgr2=0x7fc4f4109d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:26.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.256+0000 7fc4fa765640 1 --2- 172.21.15.87:0/1471720499 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4f4101860 0x7fc4f4109d40 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc009900 tx=0x7fc4dc02a480 comp rx=0 tx=0).stop 2024-09-13T17:20:26.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.256+0000 7fc4fa765640 1 -- 172.21.15.87:0/1471720499 shutdown_connections 2024-09-13T17:20:26.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.256+0000 7fc4fa765640 1 --2- 172.21.15.87:0/1471720499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4f410a310 0x7fc4f410c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.256+0000 7fc4fa765640 1 --2- 172.21.15.87:0/1471720499 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4f4101860 0x7fc4f4109d40 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.256+0000 7fc4fa765640 1 --2- 172.21.15.87:0/1471720499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4f4100f40 0x7fc4f4101320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.256+0000 7fc4fa765640 1 -- 172.21.15.87:0/1471720499 >> 172.21.15.87:0/1471720499 conn(0x7fc4f4075c60 msgr2=0x7fc4f40fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:26.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.256+0000 7fc4fa765640 1 -- 172.21.15.87:0/1471720499 shutdown_connections 2024-09-13T17:20:26.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.256+0000 7fc4fa765640 1 -- 172.21.15.87:0/1471720499 wait complete. 2024-09-13T17:20:26.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.256+0000 7fc4fa765640 1 Processor -- start 2024-09-13T17:20:26.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.256+0000 7fc4fa765640 1 -- start start 2024-09-13T17:20:26.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.257+0000 7fc4fa765640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4f4100f40 0x7fc4f4196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.257+0000 7fc4fa765640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4f4101860 0x7fc4f41967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.257+0000 7fc4fa765640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4f410a310 0x7fc4f419ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.257+0000 7fc4fa765640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f419b190 con 0x7fc4f4100f40 2024-09-13T17:20:26.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.257+0000 7fc4fa765640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f419b300 con 0x7fc4f4101860 2024-09-13T17:20:26.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.257+0000 7fc4fa765640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f419b4c0 con 0x7fc4f410a310 2024-09-13T17:20:26.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.257+0000 7fc4f3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4f4100f40 0x7fc4f4196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.257+0000 7fc4f3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4f4100f40 0x7fc4f4196260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39324/0 (socket says 172.21.15.87:39324) 2024-09-13T17:20:26.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.257+0000 7fc4f3fff640 1 -- 172.21.15.87:0/535701750 learned_addr learned my addr 172.21.15.87:0/535701750 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:26.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.257+0000 7fc4f8d02640 1 --2- 172.21.15.87:0/535701750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4f410a310 0x7fc4f419ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.257+0000 7fc4ebfff640 1 --2- 172.21.15.87:0/535701750 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4f4101860 0x7fc4f41967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.257+0000 7fc4f3fff640 1 -- 172.21.15.87:0/535701750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4f410a310 msgr2=0x7fc4f419ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:26.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.257+0000 7fc4f3fff640 1 --2- 172.21.15.87:0/535701750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4f410a310 0x7fc4f419ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.257+0000 7fc4f3fff640 1 -- 172.21.15.87:0/535701750 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4f4101860 msgr2=0x7fc4f41967a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:26.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.257+0000 7fc4f3fff640 1 --2- 172.21.15.87:0/535701750 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4f4101860 0x7fc4f41967a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.257+0000 7fc4f3fff640 1 -- 172.21.15.87:0/535701750 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4dc009560 con 0x7fc4f4100f40 2024-09-13T17:20:26.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.257+0000 7fc4f8d02640 1 --2- 172.21.15.87:0/535701750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4f410a310 0x7fc4f419ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:20:26.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.257+0000 7fc4f3fff640 1 --2- 172.21.15.87:0/535701750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4f4100f40 0x7fc4f4196260 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fc4e400d950 tx=0x7fc4e400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:26.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.257+0000 7fc4f1ffb640 1 -- 172.21.15.87:0/535701750 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e4009c30 con 0x7fc4f4100f40 2024-09-13T17:20:26.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.257+0000 7fc4f1ffb640 1 -- 172.21.15.87:0/535701750 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc4e4009d90 con 0x7fc4f4100f40 2024-09-13T17:20:26.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.257+0000 7fc4fa765640 1 -- 172.21.15.87:0/535701750 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4f419b7a0 con 0x7fc4f4100f40 2024-09-13T17:20:26.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.257+0000 7fc4f1ffb640 1 -- 172.21.15.87:0/535701750 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e400f6b0 con 0x7fc4f4100f40 2024-09-13T17:20:26.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.257+0000 7fc4fa765640 1 -- 172.21.15.87:0/535701750 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4f41a3020 con 0x7fc4f4100f40 2024-09-13T17:20:26.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.260+0000 7fc4f1ffb640 1 -- 172.21.15.87:0/535701750 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fc4e4010aa0 con 0x7fc4f4100f40 2024-09-13T17:20:26.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.260+0000 7fc4fd48a740 1 Processor -- start 2024-09-13T17:20:26.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.260+0000 7fc4fd48a740 1 -- start start 2024-09-13T17:20:26.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.260+0000 7fc4fd48a740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fd3968de10 0x55fd3968e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.260+0000 7fc4fd48a740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fd3968e730 0x55fd39698a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.260+0000 7fc4fd48a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fd39698fd0 0x55fd3969b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.260+0000 7fc4fd48a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd395f8f20 con 0x55fd39698fd0 2024-09-13T17:20:26.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.260+0000 7fc4fd48a740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd395f66b0 con 0x55fd3968e730 2024-09-13T17:20:26.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.260+0000 7fc4fd48a740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd395f1fa0 con 0x55fd3968de10 2024-09-13T17:20:26.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.260+0000 7fc4ebfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fd39698fd0 0x55fd3969b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.260+0000 7fc4ebfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fd39698fd0 0x55fd3969b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39330/0 (socket says 172.21.15.87:39330) 2024-09-13T17:20:26.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.260+0000 7fc4ebfff640 1 -- 172.21.15.87:0/2082110064 learned_addr learned my addr 172.21.15.87:0/2082110064 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:26.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.260+0000 7fc4f3fff640 1 --2- 172.21.15.87:0/2082110064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fd3968e730 0x55fd39698a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.260+0000 7fc4f8d02640 1 --2- 172.21.15.87:0/2082110064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fd3968de10 0x55fd3968e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.260+0000 7fc4f1ffb640 1 --2- 172.21.15.87:0/535701750 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc4e00a1200 0x7fc4e00a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.261+0000 7fc4ebfff640 1 -- 172.21.15.87:0/2082110064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fd3968de10 msgr2=0x55fd3968e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:26.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.261+0000 7fc4ebfff640 1 --2- 172.21.15.87:0/2082110064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fd3968de10 0x55fd3968e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.261+0000 7fc4f8d02640 1 --2- 172.21.15.87:0/535701750 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc4e00a1200 0x7fc4e00a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.261+0000 7fc4ebfff640 1 -- 172.21.15.87:0/2082110064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fd3968e730 msgr2=0x55fd39698a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:26.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.261+0000 7fc4ebfff640 1 --2- 172.21.15.87:0/2082110064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fd3968e730 0x55fd39698a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.261+0000 7fc4ebfff640 1 -- 172.21.15.87:0/2082110064 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd395ac840 con 0x55fd39698fd0 2024-09-13T17:20:26.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.261+0000 7fc4f1ffb640 1 -- 172.21.15.87:0/535701750 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fc4e40cce90 con 0x7fc4f4100f40 2024-09-13T17:20:26.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.261+0000 7fc4ebfff640 1 --2- 172.21.15.87:0/2082110064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fd39698fd0 0x55fd3969b3c0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc000c00 tx=0x7fc4dc0315c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c118b845777e2b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:26.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.261+0000 7fc4ea7fc640 1 -- 172.21.15.87:0/2082110064 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc031bf0 con 0x55fd39698fd0 2024-09-13T17:20:26.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.261+0000 7fc4f8d02640 1 --2- 172.21.15.87:0/535701750 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc4e00a1200 0x7fc4e00a36c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec005fd0 tx=0x7fc4ec004ab0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:26.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.261+0000 7fc4ea7fc640 1 -- 172.21.15.87:0/2082110064 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc4dc0044e0 con 0x55fd39698fd0 2024-09-13T17:20:26.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.261+0000 7fc4ea7fc640 1 -- 172.21.15.87:0/2082110064 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc0046c0 con 0x55fd39698fd0 2024-09-13T17:20:26.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.262+0000 7fc4fd48a740 1 -- 172.21.15.87:0/2082110064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fd39698fd0 msgr2=0x55fd3969b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:26.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.262+0000 7fc4fd48a740 1 --2- 172.21.15.87:0/2082110064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fd39698fd0 0x55fd3969b3c0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc000c00 tx=0x7fc4dc0315c0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.262+0000 7fc4fd48a740 1 -- 172.21.15.87:0/2082110064 shutdown_connections 2024-09-13T17:20:26.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.262+0000 7fc4fd48a740 1 --2- 172.21.15.87:0/2082110064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fd39698fd0 0x55fd3969b3c0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.262+0000 7fc4fd48a740 1 --2- 172.21.15.87:0/2082110064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fd3968e730 0x55fd39698a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.262+0000 7fc4fd48a740 1 --2- 172.21.15.87:0/2082110064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fd3968de10 0x55fd3968e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.262+0000 7fc4fd48a740 1 -- 172.21.15.87:0/2082110064 >> 172.21.15.87:0/2082110064 conn(0x55fd3968a380 msgr2=0x55fd3968a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:26.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.262+0000 7fc4fd48a740 1 -- 172.21.15.87:0/2082110064 shutdown_connections 2024-09-13T17:20:26.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.262+0000 7fc4fd48a740 1 -- 172.21.15.87:0/2082110064 wait complete. 2024-09-13T17:20:26.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.262+0000 7fc4fd48a740 1 -- start start 2024-09-13T17:20:26.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.262+0000 7fc4fd48a740 1 Processor -- start 2024-09-13T17:20:26.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.263+0000 7fc4fd48a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fd3968de10 0x55fd39698960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.263+0000 7fc4fd48a740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fd3968e730 0x55fd39695be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.263+0000 7fc4fd48a740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fd39698fd0 0x55fd396961d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.263+0000 7fc4fd48a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd395932a0 con 0x55fd3968de10 2024-09-13T17:20:26.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.263+0000 7fc4fd48a740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd392ca430 con 0x55fd3968e730 2024-09-13T17:20:26.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.263+0000 7fc4fd48a740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd39575680 con 0x55fd39698fd0 2024-09-13T17:20:26.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.263+0000 7fc4fd48a740 10 client.0 _ll_register_callbacks cb 0x55fd395eb610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:20:26.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.263+0000 7fc4f3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fd3968de10 0x55fd39698960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.263+0000 7fc4f3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fd3968de10 0x55fd39698960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39338/0 (socket says 172.21.15.87:39338) 2024-09-13T17:20:26.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.263+0000 7fc4f3fff640 1 -- 172.21.15.87:0/2669387920 learned_addr learned my addr 172.21.15.87:0/2669387920 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:26.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.263+0000 7fc4ebfff640 1 --2- 172.21.15.87:0/2669387920 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fd3968e730 0x55fd39695be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.263+0000 7fc4f8d02640 1 --2- 172.21.15.87:0/2669387920 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fd39698fd0 0x55fd396961d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.263+0000 7fc4f3fff640 1 -- 172.21.15.87:0/2669387920 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fd39698fd0 msgr2=0x55fd396961d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:26.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.263+0000 7fc4f3fff640 1 --2- 172.21.15.87:0/2669387920 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fd39698fd0 0x55fd396961d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.263+0000 7fc4f3fff640 1 -- 172.21.15.87:0/2669387920 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fd3968e730 msgr2=0x55fd39695be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:26.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.263+0000 7fc4f3fff640 1 --2- 172.21.15.87:0/2669387920 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fd3968e730 0x55fd39695be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.263+0000 7fc4f3fff640 1 -- 172.21.15.87:0/2669387920 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4f410d410 con 0x55fd3968de10 2024-09-13T17:20:26.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.263+0000 7fc4f8d02640 1 --2- 172.21.15.87:0/2669387920 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fd39698fd0 0x55fd396961d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:26.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.263+0000 7fc4f3fff640 1 --2- 172.21.15.87:0/2669387920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fd3968de10 0x55fd39698960 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4096600 tx=0x7fc4e400bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d826593e1ac3f420 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:26.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.263+0000 7fc4d37fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:20:26.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.263+0000 7fc4d37fe640 1 -- 172.21.15.87:0/2669387920 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e409a290 con 0x55fd3968de10 2024-09-13T17:20:26.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.263+0000 7fc4d37fe640 1 -- 172.21.15.87:0/2669387920 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fc4e4099b90 con 0x55fd3968de10 2024-09-13T17:20:26.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.263+0000 7fc4fd48a740 1 -- 172.21.15.87:0/2669387920 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fd392e54e0 con 0x55fd3968de10 2024-09-13T17:20:26.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.263+0000 7fc4d37fe640 1 -- 172.21.15.87:0/2669387920 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4e409d9c0 con 0x55fd3968de10 2024-09-13T17:20:26.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.263+0000 7fc4fd48a740 10 client.17457 fetch_fsmap learned FSMap version 36 2024-09-13T17:20:26.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.263+0000 7fc4fd48a740 1 -- 172.21.15.87:0/2669387920 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55fd395f0620 con 0x55fd3968de10 2024-09-13T17:20:26.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.264+0000 7fc4d37fe640 1 -- 172.21.15.87:0/2669387920 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55fd392e54e0 con 0x55fd3968de10 2024-09-13T17:20:26.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.264+0000 7fc4d37fe640 1 -- 172.21.15.87:0/2669387920 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc4e409aba0 con 0x55fd3968de10 2024-09-13T17:20:26.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.264+0000 7fc4fd48a740 10 client.17457 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:20:26.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.264+0000 7fc4fd48a740 10 client.17457 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:20:26.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.264+0000 7fc4fd48a740 20 client.17457 populate_metadata read hostname 'smithi087' 2024-09-13T17:20:26.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.264+0000 7fc4fd48a740 1 --2- 172.21.15.87:0/2669387920 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55fd396a8e10 0x55fd396ab200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.264+0000 7fc4fd48a740 4 client.17457 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:20:26.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.264+0000 7fc4fd48a740 1 -- 172.21.15.87:0/2669387920 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fd392f67e0 con 0x55fd396a8e10 2024-09-13T17:20:26.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.264+0000 7fc4ebfff640 1 --2- 172.21.15.87:0/2669387920 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55fd396a8e10 0x55fd396ab200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.265+0000 7fc4d37fe640 10 client.17457 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:20:26.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.265+0000 7fc4ebfff640 1 --2- 172.21.15.87:0/2669387920 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55fd396a8e10 0x55fd396ab200 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4accbd4ce40e7295 server_cookie=14e2ea6a278c57b7 in_seq=0 out_seq=0 2024-09-13T17:20:26.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.265+0000 7fc4d37fe640 1 -- 172.21.15.87:0/2669387920 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55fd392f67e0 con 0x55fd396a8e10 2024-09-13T17:20:26.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.265+0000 7fc4d37fe640 10 client.17457 handle_command_reply: tid=0 2024-09-13T17:20:26.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.265+0000 7fc4fd48a740 1 client.17457 shutdown 2024-09-13T17:20:26.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.265+0000 7fc4fd48a740 1 -- 172.21.15.87:0/2669387920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fd3968de10 msgr2=0x55fd39698960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:26.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.265+0000 7fc4fd48a740 1 --2- 172.21.15.87:0/2669387920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fd3968de10 0x55fd39698960 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4096600 tx=0x7fc4e400bf60 comp rx=0 tx=0).stop 2024-09-13T17:20:26.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.265+0000 7fc4fd48a740 1 -- 172.21.15.87:0/2669387920 shutdown_connections 2024-09-13T17:20:26.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.265+0000 7fc4fd48a740 1 --2- 172.21.15.87:0/2669387920 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55fd396a8e10 0x55fd396ab200 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.265+0000 7fc4fd48a740 1 --2- 172.21.15.87:0/2669387920 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fd39698fd0 0x55fd396961d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.266+0000 7fc4fd48a740 1 --2- 172.21.15.87:0/2669387920 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fd3968e730 0x55fd39695be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.265+0000 7fc4d37fe640 0 client.17457 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:20:26.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.266+0000 7fc4fd48a740 1 --2- 172.21.15.87:0/2669387920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fd3968de10 0x55fd39698960 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.266+0000 7fc4fd48a740 1 -- 172.21.15.87:0/2669387920 >> 172.21.15.87:0/2669387920 conn(0x55fd3968a380 msgr2=0x55fd39690090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:26.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.266+0000 7fc4fd48a740 1 -- 172.21.15.87:0/2669387920 shutdown_connections 2024-09-13T17:20:26.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.266+0000 7fc4fd48a740 1 -- 172.21.15.87:0/2669387920 wait complete. 2024-09-13T17:20:26.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.266+0000 7fc4fd48a740 20 client.17457 trim_cache size 0 max 16384 2024-09-13T17:20:26.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.280+0000 7fc4fd48a740 1 Processor -- start 2024-09-13T17:20:26.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.280+0000 7fc4fd48a740 1 -- start start 2024-09-13T17:20:26.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.280+0000 7fc4fd48a740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fd3968de10 0x55fd396a47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.280+0000 7fc4fd48a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fd3968e730 0x55fd396944d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.280+0000 7fc4fd48a740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fd39698fd0 0x55fd39694a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.280+0000 7fc4fd48a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd3968eca0 con 0x55fd3968e730 2024-09-13T17:20:26.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.280+0000 7fc4fd48a740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd396a5ad0 con 0x55fd3968de10 2024-09-13T17:20:26.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.280+0000 7fc4fd48a740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd3968db90 con 0x55fd39698fd0 2024-09-13T17:20:26.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.280+0000 7fc4ebfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fd3968e730 0x55fd396944d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.280+0000 7fc4ebfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fd3968e730 0x55fd396944d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39348/0 (socket says 172.21.15.87:39348) 2024-09-13T17:20:26.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.280+0000 7fc4ebfff640 1 -- 172.21.15.87:0/2192687642 learned_addr learned my addr 172.21.15.87:0/2192687642 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:26.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.280+0000 7fc4f3fff640 1 --2- 172.21.15.87:0/2192687642 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fd3968de10 0x55fd396a47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.280+0000 7fc4ebfff640 1 -- 172.21.15.87:0/2192687642 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fd39698fd0 msgr2=0x55fd39694a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:26.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.280+0000 7fc4ebfff640 1 --2- 172.21.15.87:0/2192687642 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fd39698fd0 0x55fd39694a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.280+0000 7fc4ebfff640 1 -- 172.21.15.87:0/2192687642 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fd3968de10 msgr2=0x55fd396a47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:26.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.280+0000 7fc4ebfff640 1 --2- 172.21.15.87:0/2192687642 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fd3968de10 0x55fd396a47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.280+0000 7fc4ebfff640 1 -- 172.21.15.87:0/2192687642 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd39592790 con 0x55fd3968e730 2024-09-13T17:20:26.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.280+0000 7fc4f3fff640 1 --2- 172.21.15.87:0/2192687642 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fd3968de10 0x55fd396a47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:20:26.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.280+0000 7fc4ebfff640 1 --2- 172.21.15.87:0/2192687642 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fd3968e730 0x55fd396944d0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc006010 tx=0x7fc4dc031540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78105d9594a0511d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:26.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.280+0000 7fc4eaffd640 1 -- 172.21.15.87:0/2192687642 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc049050 con 0x55fd3968e730 2024-09-13T17:20:26.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.280+0000 7fc4eaffd640 1 -- 172.21.15.87:0/2192687642 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc4dc04b040 con 0x55fd3968e730 2024-09-13T17:20:26.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.280+0000 7fc4eaffd640 1 -- 172.21.15.87:0/2192687642 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc03c730 con 0x55fd3968e730 2024-09-13T17:20:26.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.281+0000 7fc4fd48a740 1 -- 172.21.15.87:0/2192687642 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fd3968e730 msgr2=0x55fd396944d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:26.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.281+0000 7fc4fd48a740 1 --2- 172.21.15.87:0/2192687642 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fd3968e730 0x55fd396944d0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc006010 tx=0x7fc4dc031540 comp rx=0 tx=0).stop 2024-09-13T17:20:26.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.281+0000 7fc4fd48a740 1 -- 172.21.15.87:0/2192687642 shutdown_connections 2024-09-13T17:20:26.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.281+0000 7fc4fd48a740 1 --2- 172.21.15.87:0/2192687642 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fd39698fd0 0x55fd39694a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.281+0000 7fc4fd48a740 1 --2- 172.21.15.87:0/2192687642 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fd3968e730 0x55fd396944d0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.281+0000 7fc4fd48a740 1 --2- 172.21.15.87:0/2192687642 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fd3968de10 0x55fd396a47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.281+0000 7fc4fd48a740 1 -- 172.21.15.87:0/2192687642 >> 172.21.15.87:0/2192687642 conn(0x55fd3968a380 msgr2=0x55fd39690ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:26.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.281+0000 7fc4fd48a740 1 -- 172.21.15.87:0/2192687642 shutdown_connections 2024-09-13T17:20:26.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.281+0000 7fc4fd48a740 1 -- 172.21.15.87:0/2192687642 wait complete. 2024-09-13T17:20:26.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.281+0000 7fc4fd48a740 1 -- start start 2024-09-13T17:20:26.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.281+0000 7fc4fd48a740 1 Processor -- start 2024-09-13T17:20:26.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.282+0000 7fc4fd48a740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fd3968de10 0x55fd3969fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.282+0000 7fc4fd48a740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fd3968e730 0x55fd3969ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.282+0000 7fc4fd48a740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fd39698fd0 0x55fd3969beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.282+0000 7fc4fd48a740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd3969c5b0 con 0x55fd39698fd0 2024-09-13T17:20:26.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.282+0000 7fc4fd48a740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd3969c720 con 0x55fd3968e730 2024-09-13T17:20:26.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.282+0000 7fc4fd48a740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd3969c8e0 con 0x55fd3968de10 2024-09-13T17:20:26.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.282+0000 7fc4fd48a740 10 client.0 _ll_register_callbacks cb 0x7fc4e40d0690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:20:26.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.282+0000 7fc4f8d02640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fd39698fd0 0x55fd3969beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.282+0000 7fc4f8d02640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fd39698fd0 0x55fd3969beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39362/0 (socket says 172.21.15.87:39362) 2024-09-13T17:20:26.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.282+0000 7fc4f8d02640 1 -- 172.21.15.87:0/3592408878 learned_addr learned my addr 172.21.15.87:0/3592408878 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:26.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.282+0000 7fc4ebfff640 1 --2- 172.21.15.87:0/3592408878 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fd3968e730 0x55fd3969ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.282+0000 7fc4f8d02640 1 -- 172.21.15.87:0/3592408878 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fd3968de10 msgr2=0x55fd3969fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:26.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.282+0000 7fc4f8d02640 1 --2- 172.21.15.87:0/3592408878 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fd3968de10 0x55fd3969fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.282+0000 7fc4f8d02640 1 -- 172.21.15.87:0/3592408878 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fd3968e730 msgr2=0x55fd3969ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:26.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.282+0000 7fc4f8d02640 1 --2- 172.21.15.87:0/3592408878 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fd3968e730 0x55fd3969ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.282+0000 7fc4f8d02640 1 -- 172.21.15.87:0/3592408878 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fd395ac840 con 0x55fd39698fd0 2024-09-13T17:20:26.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.282+0000 7fc4f8d02640 1 --2- 172.21.15.87:0/3592408878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fd39698fd0 0x55fd3969beb0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec011990 tx=0x7fc4ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78262789c144cf61 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:26.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.282+0000 7fc4d37fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:20:26.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.282+0000 7fc4d37fe640 1 -- 172.21.15.87:0/3592408878 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec01fd40 con 0x55fd39698fd0 2024-09-13T17:20:26.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.282+0000 7fc4d37fe640 1 -- 172.21.15.87:0/3592408878 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fc4ec004b20 con 0x55fd39698fd0 2024-09-13T17:20:26.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.282+0000 7fc4fd48a740 1 -- 172.21.15.87:0/3592408878 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc4dc0044e0 con 0x55fd39698fd0 2024-09-13T17:20:26.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.283+0000 7fc4d37fe640 1 -- 172.21.15.87:0/3592408878 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4ec01fea0 con 0x55fd39698fd0 2024-09-13T17:20:26.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.283+0000 7fc4fd48a740 10 client.17463 fetch_fsmap learned FSMap version 36 2024-09-13T17:20:26.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.283+0000 7fc4fd48a740 1 -- 172.21.15.87:0/3592408878 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55fd395b7ea0 con 0x55fd39698fd0 2024-09-13T17:20:26.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.283+0000 7fc4d37fe640 1 -- 172.21.15.87:0/3592408878 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc4dc0044e0 con 0x55fd39698fd0 2024-09-13T17:20:26.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.283+0000 7fc4d37fe640 1 -- 172.21.15.87:0/3592408878 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc4ec01a040 con 0x55fd39698fd0 2024-09-13T17:20:26.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.283+0000 7fc4fd48a740 10 client.17463 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:20:26.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.283+0000 7fc4fd48a740 10 client.17463 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:20:26.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.283+0000 7fc4fd48a740 20 client.17463 populate_metadata read hostname 'smithi087' 2024-09-13T17:20:26.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.283+0000 7fc4fd48a740 1 --2- 172.21.15.87:0/3592408878 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55fd396a8e10 0x55fd39702560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:26.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.283+0000 7fc4fd48a740 4 client.17463 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:20:26.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.283+0000 7fc4fd48a740 1 -- 172.21.15.87:0/3592408878 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55fd39349e30 con 0x55fd396a8e10 2024-09-13T17:20:26.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.283+0000 7fc4f3fff640 1 --2- 172.21.15.87:0/3592408878 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55fd396a8e10 0x55fd39702560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:26.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.283+0000 7fc4f3fff640 1 --2- 172.21.15.87:0/3592408878 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55fd396a8e10 0x55fd39702560 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4eb29b71a52d5aa1 server_cookie=fbc1eaae8128f651 in_seq=0 out_seq=0 2024-09-13T17:20:26.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.283+0000 7fc4d37fe640 10 client.17463 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:20:26.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.284+0000 7fc4d37fe640 1 -- 172.21.15.87:0/3592408878 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55fd39349e30 con 0x55fd396a8e10 2024-09-13T17:20:26.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.284+0000 7fc4d37fe640 10 client.17463 handle_command_reply: tid=0 2024-09-13T17:20:26.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.284+0000 7fc4fd48a740 1 client.17463 shutdown 2024-09-13T17:20:26.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.284+0000 7fc4fd48a740 1 -- 172.21.15.87:0/3592408878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fd39698fd0 msgr2=0x55fd3969beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:26.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.284+0000 7fc4fd48a740 1 --2- 172.21.15.87:0/3592408878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fd39698fd0 0x55fd3969beb0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec011990 tx=0x7fc4ec004a40 comp rx=0 tx=0).stop 2024-09-13T17:20:26.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.284+0000 7fc4fd48a740 1 -- 172.21.15.87:0/3592408878 shutdown_connections 2024-09-13T17:20:26.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.284+0000 7fc4fd48a740 1 --2- 172.21.15.87:0/3592408878 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55fd396a8e10 0x55fd39702560 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.284+0000 7fc4fd48a740 1 --2- 172.21.15.87:0/3592408878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fd39698fd0 0x55fd3969beb0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.284+0000 7fc4d37fe640 0 client.17463 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:20:26.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.284+0000 7fc4fd48a740 1 --2- 172.21.15.87:0/3592408878 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fd3968e730 0x55fd3969ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.284+0000 7fc4fd48a740 1 --2- 172.21.15.87:0/3592408878 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fd3968de10 0x55fd3969fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.284+0000 7fc4fd48a740 1 -- 172.21.15.87:0/3592408878 >> 172.21.15.87:0/3592408878 conn(0x55fd3968a380 msgr2=0x55fd39694490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:26.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.284+0000 7fc4fd48a740 1 -- 172.21.15.87:0/3592408878 shutdown_connections 2024-09-13T17:20:26.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.284+0000 7fc4fd48a740 1 -- 172.21.15.87:0/3592408878 wait complete. 2024-09-13T17:20:26.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.284+0000 7fc4fd48a740 20 client.17463 trim_cache size 0 max 16384 2024-09-13T17:20:26.293 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:20:26.293 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-13T17:20:26.293 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": { 2024-09-13T17:20:26.293 INFO:teuthology.orchestra.run.smithi087.stdout: "5575d1b9-3a3f-4640-8911-7738d75c8319": { 2024-09-13T17:20:26.293 INFO:teuthology.orchestra.run.smithi087.stdout: "path": "/", 2024-09-13T17:20:26.293 INFO:teuthology.orchestra.run.smithi087.stdout: "tag": "5575d1b9-3a3f-4640-8911-7738d75c8319", 2024-09-13T17:20:26.293 INFO:teuthology.orchestra.run.smithi087.stdout: "options": "recursive,force" 2024-09-13T17:20:26.293 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:20:26.293 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:20:26.294 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:20:26.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.284+0000 7fc4fa765640 1 -- 172.21.15.87:0/535701750 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc4e00a1200 msgr2=0x7fc4e00a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:26.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.284+0000 7fc4fa765640 1 --2- 172.21.15.87:0/535701750 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc4e00a1200 0x7fc4e00a36c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec005fd0 tx=0x7fc4ec004ab0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.284+0000 7fc4fa765640 1 -- 172.21.15.87:0/535701750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4f4100f40 msgr2=0x7fc4f4196260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:26.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.284+0000 7fc4fa765640 1 --2- 172.21.15.87:0/535701750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4f4100f40 0x7fc4f4196260 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fc4e400d950 tx=0x7fc4e400de10 comp rx=0 tx=0).stop 2024-09-13T17:20:26.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.285+0000 7fc4fa765640 1 -- 172.21.15.87:0/535701750 shutdown_connections 2024-09-13T17:20:26.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.285+0000 7fc4fa765640 1 --2- 172.21.15.87:0/535701750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4f410a310 0x7fc4f419ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.285+0000 7fc4fa765640 1 --2- 172.21.15.87:0/535701750 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4f4101860 0x7fc4f41967a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.285+0000 7fc4fa765640 1 --2- 172.21.15.87:0/535701750 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc4e00a1200 0x7fc4e00a36c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.285+0000 7fc4fa765640 1 --2- 172.21.15.87:0/535701750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4f4100f40 0x7fc4f4196260 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:26.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.285+0000 7fc4fa765640 1 -- 172.21.15.87:0/535701750 >> 172.21.15.87:0/535701750 conn(0x7fc4f4075c60 msgr2=0x7fc4f40fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:26.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.285+0000 7fc4fa765640 1 -- 172.21.15.87:0/535701750 shutdown_connections 2024-09-13T17:20:26.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:26.285+0000 7fc4fa765640 1 -- 172.21.15.87:0/535701750 wait complete. 2024-09-13T17:20:26.297 INFO:tasks.cephfs.filesystem:scrub status for tag:5575d1b9-3a3f-4640-8911-7738d75c8319 - {'path': '/', 'tag': '5575d1b9-3a3f-4640-8911-7738d75c8319', 'options': 'recursive,force'} 2024-09-13T17:20:27.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:26 smithi149 ceph-mon[35496]: scrub queued for path: / 2024-09-13T17:20:27.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:26 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:20:27.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:26 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:20:27.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:26 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:20:27.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:26 smithi118 ceph-mon[34374]: scrub queued for path: / 2024-09-13T17:20:27.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:26 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:20:27.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:26 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:20:27.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:26 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:20:27.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:26 smithi087 ceph-mon[30934]: scrub queued for path: / 2024-09-13T17:20:27.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:26 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:20:27.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:26 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:20:27.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:26 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:20:28.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:27 smithi149 ceph-mon[35496]: pgmap v204: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 8 op/s 2024-09-13T17:20:28.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:27 smithi118 ceph-mon[34374]: pgmap v204: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 8 op/s 2024-09-13T17:20:28.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:27 smithi087 ceph-mon[30934]: pgmap v204: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 8 op/s 2024-09-13T17:20:29.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:29 smithi149 ceph-mon[35496]: pgmap v205: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-13T17:20:29.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:29 smithi118 ceph-mon[34374]: pgmap v205: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-13T17:20:29.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:29 smithi087 ceph-mon[30934]: pgmap v205: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-13T17:20:30.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:30 smithi149 ceph-mon[35496]: scrub summary: idle 2024-09-13T17:20:30.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:30 smithi118 ceph-mon[34374]: scrub summary: idle 2024-09-13T17:20:30.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:30 smithi087 ceph-mon[30934]: scrub summary: idle 2024-09-13T17:20:31.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:31 smithi149 ceph-mon[35496]: pgmap v206: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 11 op/s 2024-09-13T17:20:31.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:31 smithi118 ceph-mon[34374]: pgmap v206: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 11 op/s 2024-09-13T17:20:31.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:31 smithi087 ceph-mon[30934]: pgmap v206: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 11 op/s 2024-09-13T17:20:33.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:33 smithi149 ceph-mon[35496]: pgmap v207: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:20:33.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:33 smithi118 ceph-mon[34374]: pgmap v207: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:20:33.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:33 smithi087 ceph-mon[30934]: pgmap v207: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:20:35.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:35 smithi149 ceph-mon[35496]: pgmap v208: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:20:35.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:35 smithi118 ceph-mon[34374]: pgmap v208: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:20:35.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:35 smithi087 ceph-mon[30934]: pgmap v208: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:20:37.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:37 smithi149 ceph-mon[35496]: pgmap v209: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:20:37.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:37 smithi118 ceph-mon[34374]: pgmap v209: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:20:37.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:37 smithi087 ceph-mon[30934]: pgmap v209: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:20:39.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:39 smithi149 ceph-mon[35496]: pgmap v210: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:20:39.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:39 smithi118 ceph-mon[34374]: pgmap v210: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:20:39.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:39 smithi087 ceph-mon[30934]: pgmap v210: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:20:41.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:41 smithi149 ceph-mon[35496]: pgmap v211: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:20:41.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:41 smithi118 ceph-mon[34374]: pgmap v211: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:20:41.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:41 smithi087 ceph-mon[30934]: pgmap v211: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:20:43.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:43 smithi149 ceph-mon[35496]: pgmap v212: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:20:43.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:43 smithi118 ceph-mon[34374]: pgmap v212: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:20:43.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:43 smithi087 ceph-mon[30934]: pgmap v212: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:20:45.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:45 smithi149 ceph-mon[35496]: pgmap v213: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:20:45.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:45 smithi118 ceph-mon[34374]: pgmap v213: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:20:45.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:45 smithi087 ceph-mon[30934]: pgmap v213: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:20:47.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:47 smithi149 ceph-mon[35496]: pgmap v214: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:20:47.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:47 smithi118 ceph-mon[34374]: pgmap v214: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:20:47.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:47 smithi087 ceph-mon[30934]: pgmap v214: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:20:49.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:49 smithi149 ceph-mon[35496]: pgmap v215: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:20:49.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:49 smithi118 ceph-mon[34374]: pgmap v215: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:20:49.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:49 smithi087 ceph-mon[30934]: pgmap v215: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:20:51.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:51 smithi149 ceph-mon[35496]: pgmap v216: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:20:51.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:51 smithi118 ceph-mon[34374]: pgmap v216: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:20:51.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:51 smithi087 ceph-mon[30934]: pgmap v216: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:20:53.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:53 smithi149 ceph-mon[35496]: pgmap v217: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:20:53.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:53 smithi118 ceph-mon[34374]: pgmap v217: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:20:53.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:53 smithi087 ceph-mon[30934]: pgmap v217: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:20:55.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:55 smithi149 ceph-mon[35496]: pgmap v218: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:20:55.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:55 smithi118 ceph-mon[34374]: pgmap v218: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:20:55.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:55 smithi087 ceph-mon[30934]: pgmap v218: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:20:56.298 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:20:56.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.411+0000 7f5c7fb1f640 1 -- 172.21.15.87:0/3269007354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c781050b0 msgr2=0x7f5c7810cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.411+0000 7f5c7fb1f640 1 --2- 172.21.15.87:0/3269007354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c781050b0 0x7f5c7810cc00 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f5c70009930 tx=0x7f5c7002a420 comp rx=0 tx=0).stop 2024-09-13T17:20:56.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.411+0000 7f5c7fb1f640 1 -- 172.21.15.87:0/3269007354 shutdown_connections 2024-09-13T17:20:56.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.411+0000 7f5c7fb1f640 1 --2- 172.21.15.87:0/3269007354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c781050b0 0x7f5c7810cc00 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.411+0000 7f5c7fb1f640 1 --2- 172.21.15.87:0/3269007354 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c78100910 0x7f5c78104950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.411+0000 7f5c7fb1f640 1 --2- 172.21.15.87:0/3269007354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c780fff60 0x7f5c78100340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.411+0000 7f5c7fb1f640 1 -- 172.21.15.87:0/3269007354 >> 172.21.15.87:0/3269007354 conn(0x7f5c780fba10 msgr2=0x7f5c780fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:56.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.411+0000 7f5c7fb1f640 1 -- 172.21.15.87:0/3269007354 shutdown_connections 2024-09-13T17:20:56.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.411+0000 7f5c7fb1f640 1 -- 172.21.15.87:0/3269007354 wait complete. 2024-09-13T17:20:56.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.411+0000 7f5c7fb1f640 1 Processor -- start 2024-09-13T17:20:56.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.411+0000 7f5c7fb1f640 1 -- start start 2024-09-13T17:20:56.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.412+0000 7f5c7fb1f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c780fff60 0x7f5c78196330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.412+0000 7f5c7fb1f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c781050b0 0x7f5c78196870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.412+0000 7f5c7fb1f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c7819ac60 0x7f5c7819b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.412+0000 7f5c7fb1f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7819b650 con 0x7f5c781050b0 2024-09-13T17:20:56.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.412+0000 7f5c7fb1f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7819b7c0 con 0x7f5c7819ac60 2024-09-13T17:20:56.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.412+0000 7f5c7fb1f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7819b930 con 0x7f5c780fff60 2024-09-13T17:20:56.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.412+0000 7f5c7d0ba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c781050b0 0x7f5c78196870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.412+0000 7f5c7d0ba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c781050b0 0x7f5c78196870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56918/0 (socket says 172.21.15.87:56918) 2024-09-13T17:20:56.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.412+0000 7f5c7d0ba640 1 -- 172.21.15.87:0/3576514835 learned_addr learned my addr 172.21.15.87:0/3576514835 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:56.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.412+0000 7f5c7d8bb640 1 --2- 172.21.15.87:0/3576514835 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c780fff60 0x7f5c78196330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.412+0000 7f5c7e0bc640 1 --2- 172.21.15.87:0/3576514835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c7819ac60 0x7f5c7819b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.412+0000 7f5c7d0ba640 1 -- 172.21.15.87:0/3576514835 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c780fff60 msgr2=0x7f5c78196330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.412+0000 7f5c7d0ba640 1 --2- 172.21.15.87:0/3576514835 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c780fff60 0x7f5c78196330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.412+0000 7f5c7d0ba640 1 -- 172.21.15.87:0/3576514835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c7819ac60 msgr2=0x7f5c7819b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.412+0000 7f5c7d0ba640 1 --2- 172.21.15.87:0/3576514835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c7819ac60 0x7f5c7819b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.412+0000 7f5c7d0ba640 1 -- 172.21.15.87:0/3576514835 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c70009560 con 0x7f5c781050b0 2024-09-13T17:20:56.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.412+0000 7f5c7e0bc640 1 --2- 172.21.15.87:0/3576514835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c7819ac60 0x7f5c7819b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:20:56.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.412+0000 7f5c7d0ba640 1 --2- 172.21.15.87:0/3576514835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c781050b0 0x7f5c78196870 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c00d740 tx=0x7f5c6c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:56.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.412+0000 7f5c76ffd640 1 -- 172.21.15.87:0/3576514835 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c009c30 con 0x7f5c781050b0 2024-09-13T17:20:56.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.412+0000 7f5c76ffd640 1 -- 172.21.15.87:0/3576514835 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5c6c00de50 con 0x7f5c781050b0 2024-09-13T17:20:56.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.412+0000 7f5c76ffd640 1 -- 172.21.15.87:0/3576514835 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c004e40 con 0x7f5c781050b0 2024-09-13T17:20:56.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.412+0000 7f5c7fb1f640 1 -- 172.21.15.87:0/3576514835 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c781a2f10 con 0x7f5c781050b0 2024-09-13T17:20:56.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.412+0000 7f5c7fb1f640 1 -- 172.21.15.87:0/3576514835 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c781a32e0 con 0x7f5c781050b0 2024-09-13T17:20:56.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.414+0000 7f5c76ffd640 1 -- 172.21.15.87:0/3576514835 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f5c6c004fa0 con 0x7f5c781050b0 2024-09-13T17:20:56.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.415+0000 7f5c82844740 1 Processor -- start 2024-09-13T17:20:56.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.415+0000 7f5c82844740 1 -- start start 2024-09-13T17:20:56.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.415+0000 7f5c82844740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e5670cd30 0x560e5670d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.415+0000 7f5c82844740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e5670d650 0x560e5671bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.415+0000 7f5c82844740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560e5671c3e0 0x560e5671e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.415+0000 7f5c82844740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e56677f20 con 0x560e5670d650 2024-09-13T17:20:56.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.415+0000 7f5c82844740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e566756b0 con 0x560e5670cd30 2024-09-13T17:20:56.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.415+0000 7f5c82844740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e56670fa0 con 0x560e5671c3e0 2024-09-13T17:20:56.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.415+0000 7f5c76ffd640 1 --2- 172.21.15.87:0/3576514835 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5c600a1280 0x7f5c600a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.416+0000 7f5c7d8bb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e5670d650 0x560e5671bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.416+0000 7f5c7d8bb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e5670d650 0x560e5671bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56926/0 (socket says 172.21.15.87:56926) 2024-09-13T17:20:56.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.416+0000 7f5c7d8bb640 1 -- 172.21.15.87:0/838545834 learned_addr learned my addr 172.21.15.87:0/838545834 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:56.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.416+0000 7f5c7e0bc640 1 --2- 172.21.15.87:0/3576514835 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5c600a1280 0x7f5c600a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.416+0000 7f5c7d0ba640 1 --2- 172.21.15.87:0/838545834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560e5671c3e0 0x560e5671e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.416+0000 7f5c7e0bc640 1 --2- 172.21.15.87:0/838545834 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e5670cd30 0x560e5670d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.416+0000 7f5c76ffd640 1 -- 172.21.15.87:0/3576514835 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f5c6c0cc9c0 con 0x7f5c781050b0 2024-09-13T17:20:56.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.416+0000 7f5c7d8bb640 1 -- 172.21.15.87:0/838545834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560e5671c3e0 msgr2=0x560e5671e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:56.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.416+0000 7f5c7d8bb640 1 --2- 172.21.15.87:0/838545834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560e5671c3e0 0x560e5671e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.416+0000 7f5c7d8bb640 1 -- 172.21.15.87:0/838545834 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e5670cd30 msgr2=0x560e5670d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:56.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.416+0000 7f5c7d8bb640 1 --2- 172.21.15.87:0/838545834 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e5670cd30 0x560e5670d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.416+0000 7f5c7d8bb640 1 -- 172.21.15.87:0/838545834 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e5662b840 con 0x560e5670d650 2024-09-13T17:20:56.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.416+0000 7f5c7e0bc640 1 --2- 172.21.15.87:0/838545834 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e5670cd30 0x560e5670d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:20:56.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.416+0000 7f5c7d8bb640 1 --2- 172.21.15.87:0/838545834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e5670d650 0x560e5671bea0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f5c680039f0 tx=0x7f5c68003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f37c0cb6dc62e96 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:56.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.416+0000 7f5c7e0bc640 1 --2- 172.21.15.87:0/3576514835 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5c600a1280 0x7f5c600a3740 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5c700057c0 tx=0x7f5c70005e30 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:56.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.416+0000 7f5c5ffff640 1 -- 172.21.15.87:0/838545834 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c68004b20 con 0x560e5670d650 2024-09-13T17:20:56.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.416+0000 7f5c5ffff640 1 -- 172.21.15.87:0/838545834 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5c68004c80 con 0x560e5670d650 2024-09-13T17:20:56.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.416+0000 7f5c5ffff640 1 -- 172.21.15.87:0/838545834 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c680126b0 con 0x560e5670d650 2024-09-13T17:20:56.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.417+0000 7f5c82844740 1 -- 172.21.15.87:0/838545834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e5670d650 msgr2=0x560e5671bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.417+0000 7f5c82844740 1 --2- 172.21.15.87:0/838545834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e5670d650 0x560e5671bea0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f5c680039f0 tx=0x7f5c68003eb0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.417+0000 7f5c82844740 1 -- 172.21.15.87:0/838545834 shutdown_connections 2024-09-13T17:20:56.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.417+0000 7f5c82844740 1 --2- 172.21.15.87:0/838545834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560e5671c3e0 0x560e5671e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.417+0000 7f5c82844740 1 --2- 172.21.15.87:0/838545834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e5670d650 0x560e5671bea0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.417+0000 7f5c82844740 1 --2- 172.21.15.87:0/838545834 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e5670cd30 0x560e5670d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.417+0000 7f5c82844740 1 -- 172.21.15.87:0/838545834 >> 172.21.15.87:0/838545834 conn(0x560e56709380 msgr2=0x560e56709760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:56.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.417+0000 7f5c82844740 1 -- 172.21.15.87:0/838545834 shutdown_connections 2024-09-13T17:20:56.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.417+0000 7f5c82844740 1 -- 172.21.15.87:0/838545834 wait complete. 2024-09-13T17:20:56.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.417+0000 7f5c82844740 1 -- start start 2024-09-13T17:20:56.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.418+0000 7f5c82844740 1 Processor -- start 2024-09-13T17:20:56.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.418+0000 7f5c82844740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e5670cd30 0x560e5671bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.418+0000 7f5c82844740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560e5670d650 0x560e56719040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.418+0000 7f5c82844740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e5671c3e0 0x560e567195c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.418+0000 7f5c82844740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e566122a0 con 0x560e5670cd30 2024-09-13T17:20:56.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.418+0000 7f5c82844740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e56349430 con 0x560e5671c3e0 2024-09-13T17:20:56.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.418+0000 7f5c82844740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e565f4680 con 0x560e5670d650 2024-09-13T17:20:56.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.418+0000 7f5c82844740 10 client.0 _ll_register_callbacks cb 0x560e5666a610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:20:56.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.418+0000 7f5c7d8bb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e5670cd30 0x560e5671bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.418+0000 7f5c7d8bb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e5670cd30 0x560e5671bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56934/0 (socket says 172.21.15.87:56934) 2024-09-13T17:20:56.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.418+0000 7f5c7d8bb640 1 -- 172.21.15.87:0/589323095 learned_addr learned my addr 172.21.15.87:0/589323095 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:56.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.418+0000 7f5c7d0ba640 1 --2- 172.21.15.87:0/589323095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560e5670d650 0x560e56719040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.418+0000 7f5c7d8bb640 1 -- 172.21.15.87:0/589323095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560e5670d650 msgr2=0x560e56719040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:56.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.418+0000 7f5c7d8bb640 1 --2- 172.21.15.87:0/589323095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560e5670d650 0x560e56719040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.418+0000 7f5c7d8bb640 1 -- 172.21.15.87:0/589323095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e5671c3e0 msgr2=0x560e567195c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:56.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.418+0000 7f5c7e0bc640 1 --2- 172.21.15.87:0/589323095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e5671c3e0 0x560e567195c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.418+0000 7f5c7d8bb640 1 --2- 172.21.15.87:0/589323095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e5671c3e0 0x560e567195c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.418+0000 7f5c7d8bb640 1 -- 172.21.15.87:0/589323095 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c68009cd0 con 0x560e5670cd30 2024-09-13T17:20:56.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.419+0000 7f5c7d8bb640 1 --2- 172.21.15.87:0/589323095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e5670cd30 0x560e5671bd20 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f5c68004950 tx=0x7f5c68004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e926dd3849f54d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:56.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.419+0000 7f5c5d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:20:56.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.419+0000 7f5c5d7fa640 1 -- 172.21.15.87:0/589323095 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c68005340 con 0x560e5670cd30 2024-09-13T17:20:56.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.419+0000 7f5c5d7fa640 1 -- 172.21.15.87:0/589323095 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f5c680054a0 con 0x560e5670cd30 2024-09-13T17:20:56.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.419+0000 7f5c82844740 1 -- 172.21.15.87:0/589323095 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560e563644e0 con 0x560e5670cd30 2024-09-13T17:20:56.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.419+0000 7f5c5d7fa640 1 -- 172.21.15.87:0/589323095 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5c68005680 con 0x560e5670cd30 2024-09-13T17:20:56.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.419+0000 7f5c82844740 10 client.17475 fetch_fsmap learned FSMap version 36 2024-09-13T17:20:56.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.419+0000 7f5c82844740 1 -- 172.21.15.87:0/589323095 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x560e5666f620 con 0x560e5670cd30 2024-09-13T17:20:56.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.419+0000 7f5c5d7fa640 1 -- 172.21.15.87:0/589323095 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x560e563644e0 con 0x560e5670cd30 2024-09-13T17:20:56.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.419+0000 7f5c5d7fa640 1 -- 172.21.15.87:0/589323095 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f5c68018030 con 0x560e5670cd30 2024-09-13T17:20:56.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.419+0000 7f5c82844740 10 client.17475 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:20:56.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.419+0000 7f5c82844740 10 client.17475 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:20:56.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.419+0000 7f5c82844740 20 client.17475 populate_metadata read hostname 'smithi087' 2024-09-13T17:20:56.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.419+0000 7f5c82844740 1 --2- 172.21.15.87:0/589323095 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560e5672c1d0 0x560e5672e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.419+0000 7f5c82844740 4 client.17475 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:20:56.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.419+0000 7f5c82844740 1 -- 172.21.15.87:0/589323095 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560e563757e0 con 0x560e5672c1d0 2024-09-13T17:20:56.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.420+0000 7f5c7d0ba640 1 --2- 172.21.15.87:0/589323095 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560e5672c1d0 0x560e5672e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.420+0000 7f5c7d0ba640 1 --2- 172.21.15.87:0/589323095 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560e5672c1d0 0x560e5672e5c0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d39c55d62b20bb68 server_cookie=35f795cfcb3b78c8 in_seq=0 out_seq=0 2024-09-13T17:20:56.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.420+0000 7f5c5d7fa640 10 client.17475 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:20:56.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.421+0000 7f5c5d7fa640 1 -- 172.21.15.87:0/589323095 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x560e563757e0 con 0x560e5672c1d0 2024-09-13T17:20:56.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.421+0000 7f5c5d7fa640 10 client.17475 handle_command_reply: tid=0 2024-09-13T17:20:56.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.421+0000 7f5c82844740 1 client.17475 shutdown 2024-09-13T17:20:56.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.421+0000 7f5c82844740 1 -- 172.21.15.87:0/589323095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e5670cd30 msgr2=0x560e5671bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.421+0000 7f5c82844740 1 --2- 172.21.15.87:0/589323095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e5670cd30 0x560e5671bd20 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f5c68004950 tx=0x7f5c68004ab0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.421+0000 7f5c82844740 1 -- 172.21.15.87:0/589323095 shutdown_connections 2024-09-13T17:20:56.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.421+0000 7f5c82844740 1 --2- 172.21.15.87:0/589323095 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560e5672c1d0 0x560e5672e5c0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.421+0000 7f5c82844740 1 --2- 172.21.15.87:0/589323095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e5671c3e0 0x560e567195c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.421+0000 7f5c82844740 1 --2- 172.21.15.87:0/589323095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560e5670d650 0x560e56719040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.421+0000 7f5c82844740 1 --2- 172.21.15.87:0/589323095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e5670cd30 0x560e5671bd20 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.421+0000 7f5c5d7fa640 0 client.17475 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:20:56.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.421+0000 7f5c82844740 1 -- 172.21.15.87:0/589323095 >> 172.21.15.87:0/589323095 conn(0x560e56709380 msgr2=0x560e5670f040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:56.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.421+0000 7f5c82844740 1 -- 172.21.15.87:0/589323095 shutdown_connections 2024-09-13T17:20:56.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.421+0000 7f5c82844740 1 -- 172.21.15.87:0/589323095 wait complete. 2024-09-13T17:20:56.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.421+0000 7f5c82844740 20 client.17475 trim_cache size 0 max 16384 2024-09-13T17:20:56.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.435+0000 7f5c82844740 1 Processor -- start 2024-09-13T17:20:56.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.435+0000 7f5c82844740 1 -- start start 2024-09-13T17:20:56.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.436+0000 7f5c82844740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e5670cd30 0x560e567040e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.436+0000 7f5c82844740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560e5670d650 0x560e5671b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.436+0000 7f5c82844740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e5671c3e0 0x560e567178f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.436+0000 7f5c82844740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e56704650 con 0x560e5670cd30 2024-09-13T17:20:56.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.436+0000 7f5c82844740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e56713e40 con 0x560e5671c3e0 2024-09-13T17:20:56.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.436+0000 7f5c82844740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e567337d0 con 0x560e5670d650 2024-09-13T17:20:56.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.436+0000 7f5c7d8bb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e5670cd30 0x560e567040e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.436+0000 7f5c7d8bb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e5670cd30 0x560e567040e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56942/0 (socket says 172.21.15.87:56942) 2024-09-13T17:20:56.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.436+0000 7f5c7d8bb640 1 -- 172.21.15.87:0/1161396184 learned_addr learned my addr 172.21.15.87:0/1161396184 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:56.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.436+0000 7f5c7d8bb640 1 -- 172.21.15.87:0/1161396184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560e5670d650 msgr2=0x560e5671b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:56.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.436+0000 7f5c7d8bb640 1 --2- 172.21.15.87:0/1161396184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560e5670d650 0x560e5671b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.436+0000 7f5c7d8bb640 1 -- 172.21.15.87:0/1161396184 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e5671c3e0 msgr2=0x560e567178f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:56.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.436+0000 7f5c7d8bb640 1 --2- 172.21.15.87:0/1161396184 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e5671c3e0 0x560e567178f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.436+0000 7f5c7d8bb640 1 -- 172.21.15.87:0/1161396184 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e56611790 con 0x560e5670cd30 2024-09-13T17:20:56.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.436+0000 7f5c7d8bb640 1 --2- 172.21.15.87:0/1161396184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e5670cd30 0x560e567040e0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f5c68002230 tx=0x7f5c680098a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67bd6749e89c6c0c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:56.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.436+0000 7f5c74e05640 1 -- 172.21.15.87:0/1161396184 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c68004b20 con 0x560e5670cd30 2024-09-13T17:20:56.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.436+0000 7f5c74e05640 1 -- 172.21.15.87:0/1161396184 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5c6801e070 con 0x560e5670cd30 2024-09-13T17:20:56.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.436+0000 7f5c74e05640 1 -- 172.21.15.87:0/1161396184 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c68025850 con 0x560e5670cd30 2024-09-13T17:20:56.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.437+0000 7f5c82844740 1 -- 172.21.15.87:0/1161396184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e5670cd30 msgr2=0x560e567040e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.437+0000 7f5c82844740 1 --2- 172.21.15.87:0/1161396184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e5670cd30 0x560e567040e0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f5c68002230 tx=0x7f5c680098a0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.437+0000 7f5c82844740 1 -- 172.21.15.87:0/1161396184 shutdown_connections 2024-09-13T17:20:56.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.437+0000 7f5c82844740 1 --2- 172.21.15.87:0/1161396184 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e5671c3e0 0x560e567178f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.437+0000 7f5c82844740 1 --2- 172.21.15.87:0/1161396184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560e5670d650 0x560e5671b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.437+0000 7f5c82844740 1 --2- 172.21.15.87:0/1161396184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e5670cd30 0x560e567040e0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.437+0000 7f5c82844740 1 -- 172.21.15.87:0/1161396184 >> 172.21.15.87:0/1161396184 conn(0x560e56709380 msgr2=0x560e56714300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:56.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.437+0000 7f5c82844740 1 -- 172.21.15.87:0/1161396184 shutdown_connections 2024-09-13T17:20:56.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.437+0000 7f5c82844740 1 -- 172.21.15.87:0/1161396184 wait complete. 2024-09-13T17:20:56.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.437+0000 7f5c82844740 1 -- start start 2024-09-13T17:20:56.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.437+0000 7f5c82844740 1 Processor -- start 2024-09-13T17:20:56.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.438+0000 7f5c82844740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e5670cd30 0x560e5671f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.438+0000 7f5c82844740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560e5670d650 0x560e5671f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.438+0000 7f5c82844740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e5671c3e0 0x560e5671fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.438+0000 7f5c82844740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e56723a30 con 0x560e5670cd30 2024-09-13T17:20:56.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.438+0000 7f5c82844740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e56781690 con 0x560e5671c3e0 2024-09-13T17:20:56.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.438+0000 7f5c82844740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e567817d0 con 0x560e5670d650 2024-09-13T17:20:56.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.438+0000 7f5c82844740 10 client.0 _ll_register_callbacks cb 0x7f5c6c019ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:20:56.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.438+0000 7f5c7d8bb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e5670cd30 0x560e5671f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.438+0000 7f5c7d8bb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e5670cd30 0x560e5671f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56950/0 (socket says 172.21.15.87:56950) 2024-09-13T17:20:56.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.438+0000 7f5c7d8bb640 1 -- 172.21.15.87:0/111232733 learned_addr learned my addr 172.21.15.87:0/111232733 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:56.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.438+0000 7f5c7d0ba640 1 --2- 172.21.15.87:0/111232733 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560e5670d650 0x560e5671f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.438+0000 7f5c7e0bc640 1 --2- 172.21.15.87:0/111232733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e5671c3e0 0x560e5671fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.438+0000 7f5c7d8bb640 1 -- 172.21.15.87:0/111232733 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560e5670d650 msgr2=0x560e5671f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:56.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.438+0000 7f5c7d8bb640 1 --2- 172.21.15.87:0/111232733 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560e5670d650 0x560e5671f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.438+0000 7f5c7d8bb640 1 -- 172.21.15.87:0/111232733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e5671c3e0 msgr2=0x560e5671fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:56.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.438+0000 7f5c7d8bb640 1 --2- 172.21.15.87:0/111232733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e5671c3e0 0x560e5671fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.438+0000 7f5c7d8bb640 1 -- 172.21.15.87:0/111232733 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560e5666f620 con 0x560e5670cd30 2024-09-13T17:20:56.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.438+0000 7f5c7e0bc640 1 --2- 172.21.15.87:0/111232733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e5671c3e0 0x560e5671fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:56.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.438+0000 7f5c7d8bb640 1 --2- 172.21.15.87:0/111232733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e5670cd30 0x560e5671f120 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f5c68025670 tx=0x7f5c680256a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b671d588fd2f9cef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:56.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.438+0000 7f5c5d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:20:56.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.438+0000 7f5c5d7fa640 1 -- 172.21.15.87:0/111232733 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c68002030 con 0x560e5670cd30 2024-09-13T17:20:56.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.438+0000 7f5c5d7fa640 1 -- 172.21.15.87:0/111232733 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f5c680104e0 con 0x560e5670cd30 2024-09-13T17:20:56.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.438+0000 7f5c82844740 1 -- 172.21.15.87:0/111232733 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5c68004c80 con 0x560e5670cd30 2024-09-13T17:20:56.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.439+0000 7f5c5d7fa640 1 -- 172.21.15.87:0/111232733 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5c68010860 con 0x560e5670cd30 2024-09-13T17:20:56.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.439+0000 7f5c82844740 10 client.17481 fetch_fsmap learned FSMap version 36 2024-09-13T17:20:56.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.439+0000 7f5c82844740 1 -- 172.21.15.87:0/111232733 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x560e56636ea0 con 0x560e5670cd30 2024-09-13T17:20:56.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.439+0000 7f5c5d7fa640 1 -- 172.21.15.87:0/111232733 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5c68004c80 con 0x560e5670cd30 2024-09-13T17:20:56.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.439+0000 7f5c5d7fa640 1 -- 172.21.15.87:0/111232733 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f5c68018070 con 0x560e5670cd30 2024-09-13T17:20:56.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.439+0000 7f5c82844740 10 client.17481 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:20:56.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.439+0000 7f5c82844740 10 client.17481 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:20:56.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.439+0000 7f5c82844740 20 client.17481 populate_metadata read hostname 'smithi087' 2024-09-13T17:20:56.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.439+0000 7f5c82844740 1 --2- 172.21.15.87:0/111232733 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560e56782a00 0x560e56784df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.439+0000 7f5c82844740 4 client.17481 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:20:56.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.439+0000 7f5c82844740 1 -- 172.21.15.87:0/111232733 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560e563c8e30 con 0x560e56782a00 2024-09-13T17:20:56.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.439+0000 7f5c7d0ba640 1 --2- 172.21.15.87:0/111232733 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560e56782a00 0x560e56784df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.439+0000 7f5c5d7fa640 10 client.17481 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:20:56.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.439+0000 7f5c7d0ba640 1 --2- 172.21.15.87:0/111232733 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560e56782a00 0x560e56784df0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8a5d245da8bb6e4 server_cookie=7193f8dc0d204057 in_seq=0 out_seq=0 2024-09-13T17:20:56.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.440+0000 7f5c5d7fa640 1 -- 172.21.15.87:0/111232733 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x560e563c8e30 con 0x560e56782a00 2024-09-13T17:20:56.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.440+0000 7f5c5d7fa640 10 client.17481 handle_command_reply: tid=0 2024-09-13T17:20:56.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.440+0000 7f5c82844740 1 client.17481 shutdown 2024-09-13T17:20:56.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.440+0000 7f5c82844740 1 -- 172.21.15.87:0/111232733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e5670cd30 msgr2=0x560e5671f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.440+0000 7f5c82844740 1 --2- 172.21.15.87:0/111232733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e5670cd30 0x560e5671f120 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f5c68025670 tx=0x7f5c680256a0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.440+0000 7f5c82844740 1 -- 172.21.15.87:0/111232733 shutdown_connections 2024-09-13T17:20:56.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.440+0000 7f5c82844740 1 --2- 172.21.15.87:0/111232733 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560e56782a00 0x560e56784df0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.440+0000 7f5c82844740 1 --2- 172.21.15.87:0/111232733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e5671c3e0 0x560e5671fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.440+0000 7f5c82844740 1 --2- 172.21.15.87:0/111232733 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560e5670d650 0x560e5671f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.440+0000 7f5c5d7fa640 0 client.17481 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:20:56.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.440+0000 7f5c82844740 1 --2- 172.21.15.87:0/111232733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560e5670cd30 0x560e5671f120 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.440+0000 7f5c82844740 1 -- 172.21.15.87:0/111232733 >> 172.21.15.87:0/111232733 conn(0x560e56709380 msgr2=0x560e56718890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:56.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.440+0000 7f5c82844740 1 -- 172.21.15.87:0/111232733 shutdown_connections 2024-09-13T17:20:56.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.440+0000 7f5c82844740 1 -- 172.21.15.87:0/111232733 wait complete. 2024-09-13T17:20:56.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.440+0000 7f5c82844740 20 client.17481 trim_cache size 0 max 16384 2024-09-13T17:20:56.452 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:20:56.452 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "no active scrubs running", 2024-09-13T17:20:56.452 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": {} 2024-09-13T17:20:56.452 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:20:56.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.441+0000 7f5c7fb1f640 1 -- 172.21.15.87:0/3576514835 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5c600a1280 msgr2=0x7f5c600a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.441+0000 7f5c7fb1f640 1 --2- 172.21.15.87:0/3576514835 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5c600a1280 0x7f5c600a3740 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5c700057c0 tx=0x7f5c70005e30 comp rx=0 tx=0).stop 2024-09-13T17:20:56.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.441+0000 7f5c7fb1f640 1 -- 172.21.15.87:0/3576514835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c781050b0 msgr2=0x7f5c78196870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.441+0000 7f5c7fb1f640 1 --2- 172.21.15.87:0/3576514835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c781050b0 0x7f5c78196870 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c00d740 tx=0x7f5c6c00dc00 comp rx=0 tx=0).stop 2024-09-13T17:20:56.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.441+0000 7f5c7fb1f640 1 -- 172.21.15.87:0/3576514835 shutdown_connections 2024-09-13T17:20:56.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.441+0000 7f5c7fb1f640 1 --2- 172.21.15.87:0/3576514835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c7819ac60 0x7f5c7819b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.441+0000 7f5c7fb1f640 1 --2- 172.21.15.87:0/3576514835 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5c600a1280 0x7f5c600a3740 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.441+0000 7f5c7fb1f640 1 --2- 172.21.15.87:0/3576514835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c781050b0 0x7f5c78196870 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.441+0000 7f5c7fb1f640 1 --2- 172.21.15.87:0/3576514835 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c780fff60 0x7f5c78196330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.441+0000 7f5c7fb1f640 1 -- 172.21.15.87:0/3576514835 >> 172.21.15.87:0/3576514835 conn(0x7f5c780fba10 msgr2=0x7f5c780fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:56.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.441+0000 7f5c7fb1f640 1 -- 172.21.15.87:0/3576514835 shutdown_connections 2024-09-13T17:20:56.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.441+0000 7f5c7fb1f640 1 -- 172.21.15.87:0/3576514835 wait complete. 2024-09-13T17:20:56.454 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T17:20:56.455 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:20:56.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.551+0000 7f73a343a640 1 -- 172.21.15.87:0/2691654490 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f739c103fd0 msgr2=0x7f739c10bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.552+0000 7f73a343a640 1 --2- 172.21.15.87:0/2691654490 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f739c103fd0 0x7f739c10bb20 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f7394009cd0 tx=0x7f739402a8e0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.552+0000 7f73a343a640 1 -- 172.21.15.87:0/2691654490 shutdown_connections 2024-09-13T17:20:56.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.552+0000 7f73a343a640 1 --2- 172.21.15.87:0/2691654490 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f739c103fd0 0x7f739c10bb20 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.552+0000 7f73a343a640 1 --2- 172.21.15.87:0/2691654490 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f739c0ff830 0x7f739c103870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.552+0000 7f73a343a640 1 --2- 172.21.15.87:0/2691654490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f739c0fee80 0x7f739c0ff260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.552+0000 7f73a343a640 1 -- 172.21.15.87:0/2691654490 >> 172.21.15.87:0/2691654490 conn(0x7f739c075c60 msgr2=0x7f739c0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:56.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.552+0000 7f73a343a640 1 -- 172.21.15.87:0/2691654490 shutdown_connections 2024-09-13T17:20:56.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.552+0000 7f73a343a640 1 -- 172.21.15.87:0/2691654490 wait complete. 2024-09-13T17:20:56.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.552+0000 7f73a343a640 1 Processor -- start 2024-09-13T17:20:56.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.552+0000 7f73a343a640 1 -- start start 2024-09-13T17:20:56.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.552+0000 7f73a343a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f739c0fee80 0x7f739c197030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.552+0000 7f73a343a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f739c103fd0 0x7f739c197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.552+0000 7f73a343a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f739c197ab0 0x7f739c1a20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.552+0000 7f73a343a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739c1a2750 con 0x7f739c103fd0 2024-09-13T17:20:56.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.552+0000 7f73a343a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739c1a28c0 con 0x7f739c197ab0 2024-09-13T17:20:56.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.552+0000 7f73a343a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739c1a2a80 con 0x7f739c0fee80 2024-09-13T17:20:56.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.553+0000 7f73a09d5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f739c103fd0 0x7f739c197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.553+0000 7f73a09d5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f739c103fd0 0x7f739c197570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56978/0 (socket says 172.21.15.87:56978) 2024-09-13T17:20:56.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.553+0000 7f73a09d5640 1 -- 172.21.15.87:0/1236270548 learned_addr learned my addr 172.21.15.87:0/1236270548 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:56.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.553+0000 7f73a11d6640 1 --2- 172.21.15.87:0/1236270548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f739c0fee80 0x7f739c197030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.553+0000 7f73a19d7640 1 --2- 172.21.15.87:0/1236270548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f739c197ab0 0x7f739c1a20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.553+0000 7f73a09d5640 1 -- 172.21.15.87:0/1236270548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f739c0fee80 msgr2=0x7f739c197030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.553+0000 7f73a09d5640 1 --2- 172.21.15.87:0/1236270548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f739c0fee80 0x7f739c197030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.553+0000 7f73a09d5640 1 -- 172.21.15.87:0/1236270548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f739c197ab0 msgr2=0x7f739c1a20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.553+0000 7f73a09d5640 1 --2- 172.21.15.87:0/1236270548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f739c197ab0 0x7f739c1a20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.553+0000 7f73a09d5640 1 -- 172.21.15.87:0/1236270548 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7394009900 con 0x7f739c103fd0 2024-09-13T17:20:56.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.553+0000 7f73a11d6640 1 --2- 172.21.15.87:0/1236270548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f739c0fee80 0x7f739c197030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:20:56.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.553+0000 7f73a09d5640 1 --2- 172.21.15.87:0/1236270548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f739c103fd0 0x7f739c197570 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f739000c970 tx=0x7f739000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:56.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.553+0000 7f738e7fc640 1 -- 172.21.15.87:0/1236270548 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7390007bb0 con 0x7f739c103fd0 2024-09-13T17:20:56.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.553+0000 7f738e7fc640 1 -- 172.21.15.87:0/1236270548 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7390007d10 con 0x7f739c103fd0 2024-09-13T17:20:56.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.553+0000 7f738e7fc640 1 -- 172.21.15.87:0/1236270548 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7390018660 con 0x7f739c103fd0 2024-09-13T17:20:56.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.553+0000 7f73a343a640 1 -- 172.21.15.87:0/1236270548 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f739c1a2d60 con 0x7f739c103fd0 2024-09-13T17:20:56.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.553+0000 7f73a343a640 1 -- 172.21.15.87:0/1236270548 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f739c1a31c0 con 0x7f739c103fd0 2024-09-13T17:20:56.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.554+0000 7f73a343a640 1 -- 172.21.15.87:0/1236270548 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f739c100350 con 0x7f739c103fd0 2024-09-13T17:20:56.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.556+0000 7f738e7fc640 1 -- 172.21.15.87:0/1236270548 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f739000f450 con 0x7f739c103fd0 2024-09-13T17:20:56.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.557+0000 7f738e7fc640 1 --2- 172.21.15.87:0/1236270548 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f73880a1280 0x7f73880a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.557+0000 7f73a11d6640 1 --2- 172.21.15.87:0/1236270548 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f73880a1280 0x7f73880a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.557+0000 7f738e7fc640 1 -- 172.21.15.87:0/1236270548 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f73900cd550 con 0x7f739c103fd0 2024-09-13T17:20:56.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.557+0000 7f73a11d6640 1 --2- 172.21.15.87:0/1236270548 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f73880a1280 0x7f73880a3740 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f739800abe0 tx=0x7f739800a5c0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:56.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.560+0000 7f738e7fc640 1 -- 172.21.15.87:0/1236270548 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7390096610 con 0x7f739c103fd0 2024-09-13T17:20:56.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.757+0000 7f73a343a640 1 -- 172.21.15.87:0/1236270548 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f739c107220 con 0x7f739c103fd0 2024-09-13T17:20:56.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.758+0000 7f738e7fc640 1 -- 172.21.15.87:0/1236270548 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+10877 (secure 0 0 0) 0x7f7390099c30 con 0x7f739c103fd0 2024-09-13T17:20:56.759 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:20:56.759 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/3674545180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":3674545180},{"type":"v1","addr":"172.21.15.87:6841","nonce":3674545180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:11:23.313609+0000","modified":"2024-09-13T17:19:40.570296+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24484,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6839/3052680456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3052680456},{"type":"v1","addr":"172.21.15.118:6839","nonce":3052680456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:20:56.759 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 36 2024-09-13T17:20:56.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.760+0000 7f73a343a640 1 -- 172.21.15.87:0/1236270548 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f73880a1280 msgr2=0x7f73880a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.760+0000 7f73a343a640 1 --2- 172.21.15.87:0/1236270548 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f73880a1280 0x7f73880a3740 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f739800abe0 tx=0x7f739800a5c0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.760+0000 7f73a343a640 1 -- 172.21.15.87:0/1236270548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f739c103fd0 msgr2=0x7f739c197570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.760+0000 7f73a343a640 1 --2- 172.21.15.87:0/1236270548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f739c103fd0 0x7f739c197570 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f739000c970 tx=0x7f739000ce30 comp rx=0 tx=0).stop 2024-09-13T17:20:56.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.760+0000 7f73a343a640 1 -- 172.21.15.87:0/1236270548 shutdown_connections 2024-09-13T17:20:56.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.760+0000 7f73a343a640 1 --2- 172.21.15.87:0/1236270548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f739c197ab0 0x7f739c1a20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.760+0000 7f73a343a640 1 --2- 172.21.15.87:0/1236270548 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f73880a1280 0x7f73880a3740 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.760+0000 7f73a343a640 1 --2- 172.21.15.87:0/1236270548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f739c103fd0 0x7f739c197570 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.760+0000 7f73a343a640 1 --2- 172.21.15.87:0/1236270548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f739c0fee80 0x7f739c197030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.760+0000 7f73a343a640 1 -- 172.21.15.87:0/1236270548 >> 172.21.15.87:0/1236270548 conn(0x7f739c075c60 msgr2=0x7f739c0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:56.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.760+0000 7f73a343a640 1 -- 172.21.15.87:0/1236270548 shutdown_connections 2024-09-13T17:20:56.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.760+0000 7f73a343a640 1 -- 172.21.15.87:0/1236270548 wait complete. 2024-09-13T17:20:56.773 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-09-13T17:20:56.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.873+0000 7f2a767db640 1 -- 172.21.15.87:0/1984446621 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a700fee60 msgr2=0x7f2a700ff240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.873+0000 7f2a767db640 1 --2- 172.21.15.87:0/1984446621 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a700fee60 0x7f2a700ff240 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f2a60009930 tx=0x7f2a6002a420 comp rx=0 tx=0).stop 2024-09-13T17:20:56.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.873+0000 7f2a767db640 1 -- 172.21.15.87:0/1984446621 shutdown_connections 2024-09-13T17:20:56.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.873+0000 7f2a767db640 1 --2- 172.21.15.87:0/1984446621 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a70103fb0 0x7f2a7010bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.873+0000 7f2a767db640 1 --2- 172.21.15.87:0/1984446621 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a700ff810 0x7f2a70103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.873+0000 7f2a767db640 1 --2- 172.21.15.87:0/1984446621 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a700fee60 0x7f2a700ff240 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.873+0000 7f2a767db640 1 -- 172.21.15.87:0/1984446621 >> 172.21.15.87:0/1984446621 conn(0x7f2a70075c60 msgr2=0x7f2a700fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:56.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.874+0000 7f2a767db640 1 -- 172.21.15.87:0/1984446621 shutdown_connections 2024-09-13T17:20:56.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.874+0000 7f2a767db640 1 -- 172.21.15.87:0/1984446621 wait complete. 2024-09-13T17:20:56.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.874+0000 7f2a767db640 1 Processor -- start 2024-09-13T17:20:56.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.874+0000 7f2a767db640 1 -- start start 2024-09-13T17:20:56.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.874+0000 7f2a767db640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a700fee60 0x7f2a70197150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.874+0000 7f2a767db640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a70103fb0 0x7f2a70197690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.874+0000 7f2a767db640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a70197bd0 0x7f2a701a21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.874+0000 7f2a767db640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a701a2870 con 0x7f2a70103fb0 2024-09-13T17:20:56.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.874+0000 7f2a767db640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a701a29e0 con 0x7f2a70197bd0 2024-09-13T17:20:56.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.874+0000 7f2a767db640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a701a2ba0 con 0x7f2a700fee60 2024-09-13T17:20:56.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.874+0000 7f2a67fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a70103fb0 0x7f2a70197690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.874+0000 7f2a67fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a70103fb0 0x7f2a70197690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56996/0 (socket says 172.21.15.87:56996) 2024-09-13T17:20:56.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.874+0000 7f2a67fff640 1 -- 172.21.15.87:0/4044778513 learned_addr learned my addr 172.21.15.87:0/4044778513 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:56.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.875+0000 7f2a6ffff640 1 --2- 172.21.15.87:0/4044778513 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a700fee60 0x7f2a70197150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.875+0000 7f2a67fff640 1 -- 172.21.15.87:0/4044778513 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a700fee60 msgr2=0x7f2a70197150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.875+0000 7f2a67fff640 1 --2- 172.21.15.87:0/4044778513 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a700fee60 0x7f2a70197150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.875+0000 7f2a67fff640 1 -- 172.21.15.87:0/4044778513 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a70197bd0 msgr2=0x7f2a701a21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.875+0000 7f2a67fff640 1 --2- 172.21.15.87:0/4044778513 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a70197bd0 0x7f2a701a21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.875+0000 7f2a67fff640 1 -- 172.21.15.87:0/4044778513 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a60009560 con 0x7f2a70103fb0 2024-09-13T17:20:56.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.875+0000 7f2a6ffff640 1 --2- 172.21.15.87:0/4044778513 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a700fee60 0x7f2a70197150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:56.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.875+0000 7f2a67fff640 1 --2- 172.21.15.87:0/4044778513 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a70103fb0 0x7f2a70197690 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f2a5800c970 tx=0x7f2a5800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:56.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.875+0000 7f2a6dffb640 1 -- 172.21.15.87:0/4044778513 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a58007bb0 con 0x7f2a70103fb0 2024-09-13T17:20:56.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.875+0000 7f2a6dffb640 1 -- 172.21.15.87:0/4044778513 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2a58007d10 con 0x7f2a70103fb0 2024-09-13T17:20:56.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.875+0000 7f2a767db640 1 -- 172.21.15.87:0/4044778513 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a701a2e80 con 0x7f2a70103fb0 2024-09-13T17:20:56.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.875+0000 7f2a6dffb640 1 -- 172.21.15.87:0/4044778513 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5800f450 con 0x7f2a70103fb0 2024-09-13T17:20:56.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.875+0000 7f2a767db640 1 -- 172.21.15.87:0/4044778513 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a701a3300 con 0x7f2a70103fb0 2024-09-13T17:20:56.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.877+0000 7f2a6dffb640 1 -- 172.21.15.87:0/4044778513 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f2a58004eb0 con 0x7f2a70103fb0 2024-09-13T17:20:56.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.878+0000 7f2a795d6740 1 Processor -- start 2024-09-13T17:20:56.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.878+0000 7f2a795d6740 1 -- start start 2024-09-13T17:20:56.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.878+0000 7f2a795d6740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ca613cd790 0x55ca613cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.878+0000 7f2a795d6740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca613ce0b0 0x55ca613d8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.878+0000 7f2a795d6740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca613d8950 0x55ca613dad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.878+0000 7f2a795d6740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca61337cc0 con 0x55ca613d8950 2024-09-13T17:20:56.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.878+0000 7f2a795d6740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca61335450 con 0x55ca613ce0b0 2024-09-13T17:20:56.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.878+0000 7f2a795d6740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca61330d40 con 0x55ca613cd790 2024-09-13T17:20:56.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.878+0000 7f2a67fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca613d8950 0x55ca613dad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.878+0000 7f2a67fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca613d8950 0x55ca613dad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57008/0 (socket says 172.21.15.87:57008) 2024-09-13T17:20:56.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.878+0000 7f2a67fff640 1 -- 172.21.15.87:0/1779818652 learned_addr learned my addr 172.21.15.87:0/1779818652 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:56.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.878+0000 7f2a6ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca613ce0b0 0x55ca613d8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.878+0000 7f2a74d78640 1 --2- 172.21.15.87:0/1779818652 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ca613cd790 0x55ca613cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.878+0000 7f2a6dffb640 1 --2- 172.21.15.87:0/4044778513 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f2a5c0a1280 0x7f2a5c0a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.878+0000 7f2a67fff640 1 -- 172.21.15.87:0/1779818652 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ca613cd790 msgr2=0x55ca613cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:56.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.878+0000 7f2a67fff640 1 --2- 172.21.15.87:0/1779818652 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ca613cd790 0x55ca613cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.878+0000 7f2a67fff640 1 -- 172.21.15.87:0/1779818652 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca613ce0b0 msgr2=0x55ca613d8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:56.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.878+0000 7f2a67fff640 1 --2- 172.21.15.87:0/1779818652 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca613ce0b0 0x55ca613d8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.878+0000 7f2a67fff640 1 -- 172.21.15.87:0/1779818652 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca612f8620 con 0x55ca613d8950 2024-09-13T17:20:56.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.878+0000 7f2a74d78640 1 --2- 172.21.15.87:0/4044778513 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f2a5c0a1280 0x7f2a5c0a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.879+0000 7f2a6dffb640 1 -- 172.21.15.87:0/4044778513 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f2a580cd2e0 con 0x7f2a70103fb0 2024-09-13T17:20:56.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.879+0000 7f2a67fff640 1 --2- 172.21.15.87:0/1779818652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca613d8950 0x55ca613dad40 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f2a580ca500 tx=0x7f2a58065410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bbbaaff2cc09ade server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:56.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.879+0000 7f2a667fc640 1 -- 172.21.15.87:0/1779818652 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a580d0ea0 con 0x55ca613d8950 2024-09-13T17:20:56.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.879+0000 7f2a667fc640 1 -- 172.21.15.87:0/1779818652 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2a5800a4a0 con 0x55ca613d8950 2024-09-13T17:20:56.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.879+0000 7f2a667fc640 1 -- 172.21.15.87:0/1779818652 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5809a680 con 0x55ca613d8950 2024-09-13T17:20:56.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.879+0000 7f2a795d6740 1 -- 172.21.15.87:0/1779818652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca613d8950 msgr2=0x55ca613dad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.879+0000 7f2a74d78640 1 --2- 172.21.15.87:0/4044778513 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f2a5c0a1280 0x7f2a5c0a3740 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2a68007d00 tx=0x7f2a68004a40 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:56.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.879+0000 7f2a795d6740 1 --2- 172.21.15.87:0/1779818652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca613d8950 0x55ca613dad40 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f2a580ca500 tx=0x7f2a58065410 comp rx=0 tx=0).stop 2024-09-13T17:20:56.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.879+0000 7f2a795d6740 1 -- 172.21.15.87:0/1779818652 shutdown_connections 2024-09-13T17:20:56.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.879+0000 7f2a795d6740 1 --2- 172.21.15.87:0/1779818652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca613d8950 0x55ca613dad40 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.879+0000 7f2a795d6740 1 --2- 172.21.15.87:0/1779818652 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca613ce0b0 0x55ca613d8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.879+0000 7f2a795d6740 1 --2- 172.21.15.87:0/1779818652 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ca613cd790 0x55ca613cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.879+0000 7f2a795d6740 1 -- 172.21.15.87:0/1779818652 >> 172.21.15.87:0/1779818652 conn(0x55ca613c9d00 msgr2=0x55ca613ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:56.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.880+0000 7f2a795d6740 1 -- 172.21.15.87:0/1779818652 shutdown_connections 2024-09-13T17:20:56.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.880+0000 7f2a795d6740 1 -- 172.21.15.87:0/1779818652 wait complete. 2024-09-13T17:20:56.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.880+0000 7f2a795d6740 1 -- start start 2024-09-13T17:20:56.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.880+0000 7f2a795d6740 1 Processor -- start 2024-09-13T17:20:56.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.880+0000 7f2a795d6740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ca613cd790 0x55ca613d7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.880+0000 7f2a795d6740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca613ce0b0 0x55ca613d8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.880+0000 7f2a795d6740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca613d8950 0x55ca613d5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.880+0000 7f2a795d6740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca612ef180 con 0x55ca613ce0b0 2024-09-13T17:20:56.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.880+0000 7f2a795d6740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca61009430 con 0x55ca613d8950 2024-09-13T17:20:56.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.880+0000 7f2a795d6740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca612b45e0 con 0x55ca613cd790 2024-09-13T17:20:56.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.880+0000 7f2a795d6740 10 client.0 _ll_register_callbacks cb 0x55ca61320aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:20:56.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.880+0000 7f2a67fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca613ce0b0 0x55ca613d8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.880+0000 7f2a67fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca613ce0b0 0x55ca613d8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57018/0 (socket says 172.21.15.87:57018) 2024-09-13T17:20:56.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.880+0000 7f2a67fff640 1 -- 172.21.15.87:0/1415427709 learned_addr learned my addr 172.21.15.87:0/1415427709 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:56.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.881+0000 7f2a6ffff640 1 --2- 172.21.15.87:0/1415427709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ca613cd790 0x55ca613d7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.881+0000 7f2a67fff640 1 -- 172.21.15.87:0/1415427709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ca613cd790 msgr2=0x55ca613d7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:56.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.881+0000 7f2a74d78640 1 --2- 172.21.15.87:0/1415427709 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca613d8950 0x55ca613d5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.881+0000 7f2a67fff640 1 --2- 172.21.15.87:0/1415427709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ca613cd790 0x55ca613d7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.881+0000 7f2a67fff640 1 -- 172.21.15.87:0/1415427709 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca613d8950 msgr2=0x55ca613d5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:56.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.881+0000 7f2a67fff640 1 --2- 172.21.15.87:0/1415427709 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca613d8950 0x55ca613d5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.881+0000 7f2a67fff640 1 -- 172.21.15.87:0/1415427709 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a701a3300 con 0x55ca613ce0b0 2024-09-13T17:20:56.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.881+0000 7f2a6ffff640 1 --2- 172.21.15.87:0/1415427709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ca613cd790 0x55ca613d7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:20:56.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.881+0000 7f2a67fff640 1 --2- 172.21.15.87:0/1415427709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca613ce0b0 0x55ca613d8410 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f2a580969f0 tx=0x7f2a58065990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5cefced9946008b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:56.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.881+0000 7f2a4f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:20:56.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.881+0000 7f2a4f7fe640 1 -- 172.21.15.87:0/1415427709 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a580998e0 con 0x55ca613ce0b0 2024-09-13T17:20:56.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.881+0000 7f2a4f7fe640 1 -- 172.21.15.87:0/1415427709 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f2a580046c0 con 0x55ca613ce0b0 2024-09-13T17:20:56.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.881+0000 7f2a795d6740 1 -- 172.21.15.87:0/1415427709 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ca613231f0 con 0x55ca613ce0b0 2024-09-13T17:20:56.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.881+0000 7f2a4f7fe640 1 -- 172.21.15.87:0/1415427709 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a5809a680 con 0x55ca613ce0b0 2024-09-13T17:20:56.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.881+0000 7f2a795d6740 10 client.17499 fetch_fsmap learned FSMap version 36 2024-09-13T17:20:56.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.881+0000 7f2a795d6740 1 -- 172.21.15.87:0/1415427709 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55ca6132f3c0 con 0x55ca613ce0b0 2024-09-13T17:20:56.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.881+0000 7f2a4f7fe640 1 -- 172.21.15.87:0/1415427709 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55ca613231f0 con 0x55ca613ce0b0 2024-09-13T17:20:56.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.881+0000 7f2a4f7fe640 1 -- 172.21.15.87:0/1415427709 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2a58020070 con 0x55ca613ce0b0 2024-09-13T17:20:56.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.881+0000 7f2a795d6740 10 client.17499 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:20:56.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.881+0000 7f2a795d6740 10 client.17499 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:20:56.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.881+0000 7f2a795d6740 20 client.17499 populate_metadata read hostname 'smithi087' 2024-09-13T17:20:56.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.881+0000 7f2a795d6740 1 --2- 172.21.15.87:0/1415427709 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55ca613e7db0 0x55ca613ea1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.881+0000 7f2a795d6740 4 client.17499 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:20:56.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.881+0000 7f2a795d6740 1 -- 172.21.15.87:0/1415427709 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ca610244e0 con 0x55ca613e7db0 2024-09-13T17:20:56.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.882+0000 7f2a6ffff640 1 --2- 172.21.15.87:0/1415427709 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55ca613e7db0 0x55ca613ea1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.882+0000 7f2a4f7fe640 10 client.17499 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:20:56.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.882+0000 7f2a6ffff640 1 --2- 172.21.15.87:0/1415427709 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55ca613e7db0 0x55ca613ea1a0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=97ece86a256d1c5 server_cookie=4090c6cbbf94e226 in_seq=0 out_seq=0 2024-09-13T17:20:56.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.883+0000 7f2a4f7fe640 1 -- 172.21.15.87:0/1415427709 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55ca610244e0 con 0x55ca613e7db0 2024-09-13T17:20:56.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.883+0000 7f2a4f7fe640 10 client.17499 handle_command_reply: tid=0 2024-09-13T17:20:56.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.883+0000 7f2a795d6740 1 client.17499 shutdown 2024-09-13T17:20:56.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.883+0000 7f2a795d6740 1 -- 172.21.15.87:0/1415427709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca613ce0b0 msgr2=0x55ca613d8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.883+0000 7f2a795d6740 1 --2- 172.21.15.87:0/1415427709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca613ce0b0 0x55ca613d8410 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f2a580969f0 tx=0x7f2a58065990 comp rx=0 tx=0).stop 2024-09-13T17:20:56.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.883+0000 7f2a795d6740 1 -- 172.21.15.87:0/1415427709 shutdown_connections 2024-09-13T17:20:56.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.883+0000 7f2a795d6740 1 --2- 172.21.15.87:0/1415427709 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55ca613e7db0 0x55ca613ea1a0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.883+0000 7f2a795d6740 1 --2- 172.21.15.87:0/1415427709 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca613d8950 0x55ca613d5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.883+0000 7f2a795d6740 1 --2- 172.21.15.87:0/1415427709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca613ce0b0 0x55ca613d8410 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.883+0000 7f2a4f7fe640 0 client.17499 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:20:56.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.883+0000 7f2a795d6740 1 --2- 172.21.15.87:0/1415427709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ca613cd790 0x55ca613d7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.883+0000 7f2a795d6740 1 -- 172.21.15.87:0/1415427709 >> 172.21.15.87:0/1415427709 conn(0x55ca613c9d00 msgr2=0x55ca613cfa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:56.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.883+0000 7f2a795d6740 1 -- 172.21.15.87:0/1415427709 shutdown_connections 2024-09-13T17:20:56.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.883+0000 7f2a795d6740 1 -- 172.21.15.87:0/1415427709 wait complete. 2024-09-13T17:20:56.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.883+0000 7f2a795d6740 20 client.17499 trim_cache size 0 max 16384 2024-09-13T17:20:56.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.894+0000 7f2a795d6740 1 Processor -- start 2024-09-13T17:20:56.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.894+0000 7f2a795d6740 1 -- start start 2024-09-13T17:20:56.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.894+0000 7f2a795d6740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ca613cd790 0x55ca613d7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.894+0000 7f2a795d6740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca613ce0b0 0x55ca613d8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.894+0000 7f2a795d6740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca613d8950 0x55ca613d9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.894+0000 7f2a795d6740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca61323220 con 0x55ca613ce0b0 2024-09-13T17:20:56.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.894+0000 7f2a795d6740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca613e4ff0 con 0x55ca613d8950 2024-09-13T17:20:56.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.894+0000 7f2a795d6740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca613ca760 con 0x55ca613cd790 2024-09-13T17:20:56.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.894+0000 7f2a67fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca613ce0b0 0x55ca613d8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.894+0000 7f2a67fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca613ce0b0 0x55ca613d8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57032/0 (socket says 172.21.15.87:57032) 2024-09-13T17:20:56.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.894+0000 7f2a67fff640 1 -- 172.21.15.87:0/1222113186 learned_addr learned my addr 172.21.15.87:0/1222113186 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:56.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.894+0000 7f2a74d78640 1 --2- 172.21.15.87:0/1222113186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca613d8950 0x55ca613d9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.894+0000 7f2a67fff640 1 -- 172.21.15.87:0/1222113186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ca613cd790 msgr2=0x55ca613d7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:56.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.894+0000 7f2a6ffff640 1 --2- 172.21.15.87:0/1222113186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ca613cd790 0x55ca613d7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.894+0000 7f2a67fff640 1 --2- 172.21.15.87:0/1222113186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ca613cd790 0x55ca613d7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.894+0000 7f2a67fff640 1 -- 172.21.15.87:0/1222113186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca613d8950 msgr2=0x55ca613d9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:56.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.894+0000 7f2a67fff640 1 --2- 172.21.15.87:0/1222113186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca613d8950 0x55ca613d9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.894+0000 7f2a67fff640 1 -- 172.21.15.87:0/1222113186 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca612d1770 con 0x55ca613ce0b0 2024-09-13T17:20:56.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.894+0000 7f2a74d78640 1 --2- 172.21.15.87:0/1222113186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca613d8950 0x55ca613d9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:56.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.894+0000 7f2a6ffff640 1 --2- 172.21.15.87:0/1222113186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ca613cd790 0x55ca613d7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:56.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.894+0000 7f2a67fff640 1 --2- 172.21.15.87:0/1222113186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca613ce0b0 0x55ca613d8200 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f2a58096480 tx=0x7f2a580a24f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec1afd8f8f917e4d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:56.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.895+0000 7f2a66ffd640 1 -- 172.21.15.87:0/1222113186 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a580d0ea0 con 0x55ca613ce0b0 2024-09-13T17:20:56.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.895+0000 7f2a66ffd640 1 -- 172.21.15.87:0/1222113186 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2a580998e0 con 0x55ca613ce0b0 2024-09-13T17:20:56.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.895+0000 7f2a66ffd640 1 -- 172.21.15.87:0/1222113186 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5809ddb0 con 0x55ca613ce0b0 2024-09-13T17:20:56.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.895+0000 7f2a795d6740 1 -- 172.21.15.87:0/1222113186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca613ce0b0 msgr2=0x55ca613d8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.895+0000 7f2a795d6740 1 --2- 172.21.15.87:0/1222113186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca613ce0b0 0x55ca613d8200 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f2a58096480 tx=0x7f2a580a24f0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.895+0000 7f2a795d6740 1 -- 172.21.15.87:0/1222113186 shutdown_connections 2024-09-13T17:20:56.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.895+0000 7f2a795d6740 1 --2- 172.21.15.87:0/1222113186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca613d8950 0x55ca613d9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.895+0000 7f2a795d6740 1 --2- 172.21.15.87:0/1222113186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca613ce0b0 0x55ca613d8200 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.895+0000 7f2a795d6740 1 --2- 172.21.15.87:0/1222113186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ca613cd790 0x55ca613d7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.895+0000 7f2a795d6740 1 -- 172.21.15.87:0/1222113186 >> 172.21.15.87:0/1222113186 conn(0x55ca613c9d00 msgr2=0x55ca613d3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:56.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.895+0000 7f2a795d6740 1 -- 172.21.15.87:0/1222113186 shutdown_connections 2024-09-13T17:20:56.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.895+0000 7f2a795d6740 1 -- 172.21.15.87:0/1222113186 wait complete. 2024-09-13T17:20:56.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.895+0000 7f2a795d6740 1 -- start start 2024-09-13T17:20:56.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.896+0000 7f2a795d6740 1 Processor -- start 2024-09-13T17:20:56.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.896+0000 7f2a795d6740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ca613cd790 0x55ca613df8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.896+0000 7f2a795d6740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca613ce0b0 0x55ca613d1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.896+0000 7f2a795d6740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca613d8950 0x55ca613d2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.896+0000 7f2a795d6740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca613d2780 con 0x55ca613ce0b0 2024-09-13T17:20:56.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.896+0000 7f2a795d6740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca613d28f0 con 0x55ca613d8950 2024-09-13T17:20:56.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.896+0000 7f2a795d6740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca6143e260 con 0x55ca613cd790 2024-09-13T17:20:56.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.896+0000 7f2a795d6740 10 client.0 _ll_register_callbacks cb 0x7f2a580d0c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:20:56.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.896+0000 7f2a67fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca613ce0b0 0x55ca613d1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.896+0000 7f2a67fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca613ce0b0 0x55ca613d1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57046/0 (socket says 172.21.15.87:57046) 2024-09-13T17:20:56.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.896+0000 7f2a67fff640 1 -- 172.21.15.87:0/2480596871 learned_addr learned my addr 172.21.15.87:0/2480596871 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:56.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.896+0000 7f2a6ffff640 1 --2- 172.21.15.87:0/2480596871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ca613cd790 0x55ca613df8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.896+0000 7f2a74d78640 1 --2- 172.21.15.87:0/2480596871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca613d8950 0x55ca613d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.896+0000 7f2a67fff640 1 -- 172.21.15.87:0/2480596871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ca613cd790 msgr2=0x55ca613df8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:56.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.896+0000 7f2a67fff640 1 --2- 172.21.15.87:0/2480596871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ca613cd790 0x55ca613df8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.896+0000 7f2a67fff640 1 -- 172.21.15.87:0/2480596871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca613d8950 msgr2=0x55ca613d2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:56.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.896+0000 7f2a67fff640 1 --2- 172.21.15.87:0/2480596871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca613d8950 0x55ca613d2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.896+0000 7f2a67fff640 1 -- 172.21.15.87:0/2480596871 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca6132f3c0 con 0x55ca613ce0b0 2024-09-13T17:20:56.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.896+0000 7f2a6ffff640 1 --2- 172.21.15.87:0/2480596871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ca613cd790 0x55ca613df8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:20:56.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.897+0000 7f2a67fff640 1 --2- 172.21.15.87:0/2480596871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca613ce0b0 0x55ca613d1b40 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f2a58004960 tx=0x7f2a580d0c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22378ab2d008157e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:56.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.897+0000 7f2a4f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:20:56.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.897+0000 7f2a4f7fe640 1 -- 172.21.15.87:0/2480596871 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a580d0ea0 con 0x55ca613ce0b0 2024-09-13T17:20:56.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.897+0000 7f2a4f7fe640 1 -- 172.21.15.87:0/2480596871 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f2a58099f80 con 0x55ca613ce0b0 2024-09-13T17:20:56.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.897+0000 7f2a795d6740 1 -- 172.21.15.87:0/2480596871 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ca6135ab80 con 0x55ca613ce0b0 2024-09-13T17:20:56.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.897+0000 7f2a4f7fe640 1 -- 172.21.15.87:0/2480596871 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a580caa40 con 0x55ca613ce0b0 2024-09-13T17:20:56.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.897+0000 7f2a795d6740 10 client.17505 fetch_fsmap learned FSMap version 36 2024-09-13T17:20:56.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.897+0000 7f2a795d6740 1 -- 172.21.15.87:0/2480596871 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55ca612f6e80 con 0x55ca613ce0b0 2024-09-13T17:20:56.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.897+0000 7f2a4f7fe640 1 -- 172.21.15.87:0/2480596871 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55ca6135ab80 con 0x55ca613ce0b0 2024-09-13T17:20:56.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.897+0000 7f2a4f7fe640 1 -- 172.21.15.87:0/2480596871 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2a58020070 con 0x55ca613ce0b0 2024-09-13T17:20:56.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.897+0000 7f2a795d6740 10 client.17505 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:20:56.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.897+0000 7f2a795d6740 10 client.17505 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:20:56.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.897+0000 7f2a795d6740 20 client.17505 populate_metadata read hostname 'smithi087' 2024-09-13T17:20:56.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.897+0000 7f2a795d6740 1 --2- 172.21.15.87:0/2480596871 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55ca6143f320 0x55ca61441710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:56.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.897+0000 7f2a795d6740 4 client.17505 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:20:56.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.897+0000 7f2a795d6740 1 -- 172.21.15.87:0/2480596871 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ca610357e0 con 0x55ca6143f320 2024-09-13T17:20:56.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.898+0000 7f2a6ffff640 1 --2- 172.21.15.87:0/2480596871 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55ca6143f320 0x55ca61441710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:56.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.898+0000 7f2a4f7fe640 10 client.17505 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:20:56.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.898+0000 7f2a6ffff640 1 --2- 172.21.15.87:0/2480596871 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55ca6143f320 0x55ca61441710 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8ed7f719cde361e server_cookie=9dfa5173420c137a in_seq=0 out_seq=0 2024-09-13T17:20:56.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.898+0000 7f2a4f7fe640 1 -- 172.21.15.87:0/2480596871 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ca610357e0 con 0x55ca6143f320 2024-09-13T17:20:56.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.898+0000 7f2a4f7fe640 10 client.17505 handle_command_reply: tid=0 2024-09-13T17:20:56.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.898+0000 7f2a795d6740 1 client.17505 shutdown 2024-09-13T17:20:56.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.898+0000 7f2a795d6740 1 -- 172.21.15.87:0/2480596871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca613ce0b0 msgr2=0x55ca613d1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.898+0000 7f2a795d6740 1 --2- 172.21.15.87:0/2480596871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca613ce0b0 0x55ca613d1b40 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f2a58004960 tx=0x7f2a580d0c10 comp rx=0 tx=0).stop 2024-09-13T17:20:56.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.898+0000 7f2a795d6740 1 -- 172.21.15.87:0/2480596871 shutdown_connections 2024-09-13T17:20:56.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.898+0000 7f2a795d6740 1 --2- 172.21.15.87:0/2480596871 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55ca6143f320 0x55ca61441710 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.898+0000 7f2a795d6740 1 --2- 172.21.15.87:0/2480596871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca613d8950 0x55ca613d2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.898+0000 7f2a4f7fe640 0 client.17505 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:20:56.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.898+0000 7f2a795d6740 1 --2- 172.21.15.87:0/2480596871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ca613ce0b0 0x55ca613d1b40 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.898+0000 7f2a795d6740 1 --2- 172.21.15.87:0/2480596871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ca613cd790 0x55ca613df8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.898+0000 7f2a795d6740 1 -- 172.21.15.87:0/2480596871 >> 172.21.15.87:0/2480596871 conn(0x55ca613c9d00 msgr2=0x55ca613d7ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:56.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.898+0000 7f2a795d6740 1 -- 172.21.15.87:0/2480596871 shutdown_connections 2024-09-13T17:20:56.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.899+0000 7f2a795d6740 1 -- 172.21.15.87:0/2480596871 wait complete. 2024-09-13T17:20:56.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.899+0000 7f2a795d6740 20 client.17505 trim_cache size 0 max 16384 2024-09-13T17:20:56.908 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:20:56.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.899+0000 7f2a767db640 1 -- 172.21.15.87:0/4044778513 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f2a5c0a1280 msgr2=0x7f2a5c0a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.899+0000 7f2a767db640 1 --2- 172.21.15.87:0/4044778513 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f2a5c0a1280 0x7f2a5c0a3740 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2a68007d00 tx=0x7f2a68004a40 comp rx=0 tx=0).stop 2024-09-13T17:20:56.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.899+0000 7f2a767db640 1 -- 172.21.15.87:0/4044778513 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a70103fb0 msgr2=0x7f2a70197690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:56.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.899+0000 7f2a767db640 1 --2- 172.21.15.87:0/4044778513 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a70103fb0 0x7f2a70197690 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f2a5800c970 tx=0x7f2a5800ce30 comp rx=0 tx=0).stop 2024-09-13T17:20:56.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.899+0000 7f2a767db640 1 -- 172.21.15.87:0/4044778513 shutdown_connections 2024-09-13T17:20:56.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.899+0000 7f2a767db640 1 --2- 172.21.15.87:0/4044778513 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a70197bd0 0x7f2a701a21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.899+0000 7f2a767db640 1 --2- 172.21.15.87:0/4044778513 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f2a5c0a1280 0x7f2a5c0a3740 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.899+0000 7f2a767db640 1 --2- 172.21.15.87:0/4044778513 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a70103fb0 0x7f2a70197690 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.899+0000 7f2a767db640 1 --2- 172.21.15.87:0/4044778513 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a700fee60 0x7f2a70197150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:56.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.899+0000 7f2a767db640 1 -- 172.21.15.87:0/4044778513 >> 172.21.15.87:0/4044778513 conn(0x7f2a70075c60 msgr2=0x7f2a701022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:56.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.899+0000 7f2a767db640 1 -- 172.21.15.87:0/4044778513 shutdown_connections 2024-09-13T17:20:56.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:56.899+0000 7f2a767db640 1 -- 172.21.15.87:0/4044778513 wait complete. 2024-09-13T17:20:56.911 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-09-13T17:20:57.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.011+0000 7f5f87bed640 1 -- 172.21.15.87:0/1113153053 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f800feb80 msgr2=0x7f5f800fef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:57.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.011+0000 7f5f87bed640 1 --2- 172.21.15.87:0/1113153053 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f800feb80 0x7f5f800fef60 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f5f70009cd0 tx=0x7f5f7002a8e0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.011+0000 7f5f87bed640 1 -- 172.21.15.87:0/1113153053 shutdown_connections 2024-09-13T17:20:57.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.011+0000 7f5f87bed640 1 --2- 172.21.15.87:0/1113153053 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f80106440 0x7f5f8010cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.011+0000 7f5f87bed640 1 --2- 172.21.15.87:0/1113153053 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f800ff530 0x7f5f80105ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.011+0000 7f5f87bed640 1 --2- 172.21.15.87:0/1113153053 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f800feb80 0x7f5f800fef60 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.011+0000 7f5f87bed640 1 -- 172.21.15.87:0/1113153053 >> 172.21.15.87:0/1113153053 conn(0x7f5f80074110 msgr2=0x7f5f80074520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:57.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.011+0000 7f5f87bed640 1 -- 172.21.15.87:0/1113153053 shutdown_connections 2024-09-13T17:20:57.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.011+0000 7f5f87bed640 1 -- 172.21.15.87:0/1113153053 wait complete. 2024-09-13T17:20:57.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.012+0000 7f5f87bed640 1 Processor -- start 2024-09-13T17:20:57.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.012+0000 7f5f87bed640 1 -- start start 2024-09-13T17:20:57.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.012+0000 7f5f87bed640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f800feb80 0x7f5f800ffaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.012+0000 7f5f87bed640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f80106440 0x7f5f80100030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.012+0000 7f5f87bed640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f80100570 0x7f5f801a4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.012+0000 7f5f87bed640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f801a4b30 con 0x7f5f80106440 2024-09-13T17:20:57.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.012+0000 7f5f87bed640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f801a4ca0 con 0x7f5f80100570 2024-09-13T17:20:57.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.012+0000 7f5f87bed640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f801a4e60 con 0x7f5f800feb80 2024-09-13T17:20:57.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.012+0000 7f5f85188640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f80106440 0x7f5f80100030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.012+0000 7f5f85188640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f80106440 0x7f5f80100030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57074/0 (socket says 172.21.15.87:57074) 2024-09-13T17:20:57.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.012+0000 7f5f85188640 1 -- 172.21.15.87:0/1044586061 learned_addr learned my addr 172.21.15.87:0/1044586061 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:57.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.012+0000 7f5f85989640 1 --2- 172.21.15.87:0/1044586061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f800feb80 0x7f5f800ffaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.013+0000 7f5f8618a640 1 --2- 172.21.15.87:0/1044586061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f80100570 0x7f5f801a4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.013+0000 7f5f85188640 1 -- 172.21.15.87:0/1044586061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f800feb80 msgr2=0x7f5f800ffaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:57.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.013+0000 7f5f85188640 1 --2- 172.21.15.87:0/1044586061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f800feb80 0x7f5f800ffaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.013+0000 7f5f85188640 1 -- 172.21.15.87:0/1044586061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f80100570 msgr2=0x7f5f801a4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:57.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.013+0000 7f5f85188640 1 --2- 172.21.15.87:0/1044586061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f80100570 0x7f5f801a4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.013+0000 7f5f85188640 1 -- 172.21.15.87:0/1044586061 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f70009900 con 0x7f5f80106440 2024-09-13T17:20:57.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.013+0000 7f5f85188640 1 --2- 172.21.15.87:0/1044586061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f80106440 0x7f5f80100030 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f5f7400d950 tx=0x7f5f7400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:57.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.013+0000 7f5f7effd640 1 -- 172.21.15.87:0/1044586061 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f74009a30 con 0x7f5f80106440 2024-09-13T17:20:57.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.013+0000 7f5f7effd640 1 -- 172.21.15.87:0/1044586061 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5f740044d0 con 0x7f5f80106440 2024-09-13T17:20:57.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.013+0000 7f5f87bed640 1 -- 172.21.15.87:0/1044586061 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f801a5140 con 0x7f5f80106440 2024-09-13T17:20:57.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.013+0000 7f5f7effd640 1 -- 172.21.15.87:0/1044586061 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f740047a0 con 0x7f5f80106440 2024-09-13T17:20:57.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.013+0000 7f5f87bed640 1 -- 172.21.15.87:0/1044586061 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f801a56a0 con 0x7f5f80106440 2024-09-13T17:20:57.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.015+0000 7f5f7effd640 1 -- 172.21.15.87:0/1044586061 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f5f74009b90 con 0x7f5f80106440 2024-09-13T17:20:57.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.015+0000 7f5f8a9ec740 1 Processor -- start 2024-09-13T17:20:57.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.016+0000 7f5f8a9ec740 1 -- start start 2024-09-13T17:20:57.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.016+0000 7f5f7effd640 1 --2- 172.21.15.87:0/1044586061 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5f680a12b0 0x7f5f680a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.016+0000 7f5f8a9ec740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d58d89b790 0x55d58d89bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.016+0000 7f5f8a9ec740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58d89c0b0 0x55d58d8a6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.016+0000 7f5f8a9ec740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d58d8a6950 0x55d58d8a8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.016+0000 7f5f8a9ec740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d58d805cc0 con 0x55d58d89b790 2024-09-13T17:20:57.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.016+0000 7f5f8a9ec740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d58d803450 con 0x55d58d8a6950 2024-09-13T17:20:57.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.016+0000 7f5f8a9ec740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d58d7fed40 con 0x55d58d89c0b0 2024-09-13T17:20:57.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.016+0000 7f5f85989640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d58d89b790 0x55d58d89bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.016+0000 7f5f8618a640 1 --2- 172.21.15.87:0/1044586061 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5f680a12b0 0x7f5f680a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.016+0000 7f5f85989640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d58d89b790 0x55d58d89bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57078/0 (socket says 172.21.15.87:57078) 2024-09-13T17:20:57.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.016+0000 7f5f85989640 1 -- 172.21.15.87:0/3331705745 learned_addr learned my addr 172.21.15.87:0/3331705745 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:57.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.016+0000 7f5f7effd640 1 -- 172.21.15.87:0/1044586061 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f5f740ccaa0 con 0x7f5f80106440 2024-09-13T17:20:57.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.016+0000 7f5f85188640 1 --2- 172.21.15.87:0/3331705745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58d89c0b0 0x55d58d8a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.016+0000 7f5f85989640 1 -- 172.21.15.87:0/3331705745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58d89c0b0 msgr2=0x55d58d8a6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:57.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.016+0000 7f5f85989640 1 --2- 172.21.15.87:0/3331705745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58d89c0b0 0x55d58d8a6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.016+0000 7f5f85989640 1 -- 172.21.15.87:0/3331705745 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d58d8a6950 msgr2=0x55d58d8a8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:57.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.016+0000 7f5f85989640 1 --2- 172.21.15.87:0/3331705745 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d58d8a6950 0x55d58d8a8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.016+0000 7f5f85989640 1 -- 172.21.15.87:0/3331705745 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d58d7c6620 con 0x55d58d89b790 2024-09-13T17:20:57.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.016+0000 7f5f85188640 1 --2- 172.21.15.87:0/3331705745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58d89c0b0 0x55d58d8a6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:20:57.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.016+0000 7f5f8618a640 1 --2- 172.21.15.87:0/1044586061 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5f680a12b0 0x7f5f680a3770 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5f78005fd0 tx=0x7f5f7800b510 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:57.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.016+0000 7f5f85989640 1 --2- 172.21.15.87:0/3331705745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d58d89b790 0x55d58d89bb70 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f5f70004af0 tx=0x7f5f700314e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=523c624babc26746 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:57.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.017+0000 7f5f67fff640 1 -- 172.21.15.87:0/3331705745 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f70030dc0 con 0x55d58d89b790 2024-09-13T17:20:57.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.017+0000 7f5f67fff640 1 -- 172.21.15.87:0/3331705745 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5f70040070 con 0x55d58d89b790 2024-09-13T17:20:57.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.017+0000 7f5f67fff640 1 -- 172.21.15.87:0/3331705745 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f70003bb0 con 0x55d58d89b790 2024-09-13T17:20:57.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.017+0000 7f5f8a9ec740 1 -- 172.21.15.87:0/3331705745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d58d89b790 msgr2=0x55d58d89bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:57.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.017+0000 7f5f8a9ec740 1 --2- 172.21.15.87:0/3331705745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d58d89b790 0x55d58d89bb70 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f5f70004af0 tx=0x7f5f700314e0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.017+0000 7f5f8a9ec740 1 -- 172.21.15.87:0/3331705745 shutdown_connections 2024-09-13T17:20:57.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.017+0000 7f5f8a9ec740 1 --2- 172.21.15.87:0/3331705745 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d58d8a6950 0x55d58d8a8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.017+0000 7f5f8a9ec740 1 --2- 172.21.15.87:0/3331705745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58d89c0b0 0x55d58d8a6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.017+0000 7f5f8a9ec740 1 --2- 172.21.15.87:0/3331705745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d58d89b790 0x55d58d89bb70 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.017+0000 7f5f8a9ec740 1 -- 172.21.15.87:0/3331705745 >> 172.21.15.87:0/3331705745 conn(0x55d58d897d00 msgr2=0x55d58d8980e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:57.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.018+0000 7f5f8a9ec740 1 -- 172.21.15.87:0/3331705745 shutdown_connections 2024-09-13T17:20:57.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.018+0000 7f5f8a9ec740 1 -- 172.21.15.87:0/3331705745 wait complete. 2024-09-13T17:20:57.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.018+0000 7f5f8a9ec740 1 -- start start 2024-09-13T17:20:57.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.018+0000 7f5f8a9ec740 1 Processor -- start 2024-09-13T17:20:57.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.018+0000 7f5f8a9ec740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d58d89b790 0x55d58d8a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.018+0000 7f5f8a9ec740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58d89c0b0 0x55d58d8a3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.018+0000 7f5f8a9ec740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d58d8a6950 0x55d58d8a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.018+0000 7f5f8a9ec740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d58d7bd180 con 0x55d58d8a6950 2024-09-13T17:20:57.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.018+0000 7f5f8a9ec740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d58d4d7430 con 0x55d58d89b790 2024-09-13T17:20:57.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.018+0000 7f5f8a9ec740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d58d7825e0 con 0x55d58d89c0b0 2024-09-13T17:20:57.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.018+0000 7f5f8a9ec740 10 client.0 _ll_register_callbacks cb 0x55d58d7eeaa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:20:57.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.018+0000 7f5f8618a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d58d8a6950 0x55d58d8a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.018+0000 7f5f8618a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d58d8a6950 0x55d58d8a38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57086/0 (socket says 172.21.15.87:57086) 2024-09-13T17:20:57.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.019+0000 7f5f8618a640 1 -- 172.21.15.87:0/1942468675 learned_addr learned my addr 172.21.15.87:0/1942468675 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:57.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.019+0000 7f5f85188640 1 --2- 172.21.15.87:0/1942468675 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58d89c0b0 0x55d58d8a3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.019+0000 7f5f85989640 1 --2- 172.21.15.87:0/1942468675 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d58d89b790 0x55d58d8a5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.019+0000 7f5f8618a640 1 -- 172.21.15.87:0/1942468675 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58d89c0b0 msgr2=0x55d58d8a3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:57.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.019+0000 7f5f8618a640 1 --2- 172.21.15.87:0/1942468675 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58d89c0b0 0x55d58d8a3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.019+0000 7f5f8618a640 1 -- 172.21.15.87:0/1942468675 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d58d89b790 msgr2=0x55d58d8a5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:57.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.019+0000 7f5f8618a640 1 --2- 172.21.15.87:0/1942468675 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d58d89b790 0x55d58d8a5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.019+0000 7f5f8618a640 1 -- 172.21.15.87:0/1942468675 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f8010d580 con 0x55d58d8a6950 2024-09-13T17:20:57.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.019+0000 7f5f85188640 1 --2- 172.21.15.87:0/1942468675 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58d89c0b0 0x55d58d8a3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:20:57.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.019+0000 7f5f8618a640 1 --2- 172.21.15.87:0/1942468675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d58d8a6950 0x55d58d8a38a0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f5f78012010 tx=0x7f5f78004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba8ee8850e4d8ec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:57.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.019+0000 7f5f657fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:20:57.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.019+0000 7f5f657fa640 1 -- 172.21.15.87:0/1942468675 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7801f830 con 0x55d58d8a6950 2024-09-13T17:20:57.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.019+0000 7f5f657fa640 1 -- 172.21.15.87:0/1942468675 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f5f78018040 con 0x55d58d8a6950 2024-09-13T17:20:57.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.019+0000 7f5f8a9ec740 1 -- 172.21.15.87:0/1942468675 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d58d828b80 con 0x55d58d8a6950 2024-09-13T17:20:57.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.019+0000 7f5f657fa640 1 -- 172.21.15.87:0/1942468675 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f7801f990 con 0x55d58d8a6950 2024-09-13T17:20:57.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.019+0000 7f5f8a9ec740 10 client.17517 fetch_fsmap learned FSMap version 36 2024-09-13T17:20:57.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.019+0000 7f5f8a9ec740 1 -- 172.21.15.87:0/1942468675 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55d58d7fd3c0 con 0x55d58d8a6950 2024-09-13T17:20:57.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.019+0000 7f5f657fa640 1 -- 172.21.15.87:0/1942468675 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55d58d828b80 con 0x55d58d8a6950 2024-09-13T17:20:57.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.020+0000 7f5f657fa640 1 -- 172.21.15.87:0/1942468675 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f5f78027ca0 con 0x55d58d8a6950 2024-09-13T17:20:57.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.020+0000 7f5f8a9ec740 10 client.17517 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:20:57.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.020+0000 7f5f8a9ec740 10 client.17517 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:20:57.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.020+0000 7f5f8a9ec740 20 client.17517 populate_metadata read hostname 'smithi087' 2024-09-13T17:20:57.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.020+0000 7f5f8a9ec740 1 --2- 172.21.15.87:0/1942468675 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55d58d8b6270 0x55d58d8b8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.020+0000 7f5f8a9ec740 4 client.17517 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:20:57.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.020+0000 7f5f8a9ec740 1 -- 172.21.15.87:0/1942468675 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d58d7f11f0 con 0x55d58d8b6270 2024-09-13T17:20:57.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.020+0000 7f5f85989640 1 --2- 172.21.15.87:0/1942468675 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55d58d8b6270 0x55d58d8b8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.020+0000 7f5f657fa640 10 client.17517 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:20:57.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.020+0000 7f5f85989640 1 --2- 172.21.15.87:0/1942468675 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55d58d8b6270 0x55d58d8b8690 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a7857adfba789c21 server_cookie=bcf0510096edbc49 in_seq=0 out_seq=0 2024-09-13T17:20:57.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.021+0000 7f5f657fa640 1 -- 172.21.15.87:0/1942468675 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55d58d7f11f0 con 0x55d58d8b6270 2024-09-13T17:20:57.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.021+0000 7f5f657fa640 10 client.17517 handle_command_reply: tid=0 2024-09-13T17:20:57.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.021+0000 7f5f8a9ec740 1 client.17517 shutdown 2024-09-13T17:20:57.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.021+0000 7f5f8a9ec740 1 -- 172.21.15.87:0/1942468675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d58d8a6950 msgr2=0x55d58d8a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:57.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.021+0000 7f5f8a9ec740 1 --2- 172.21.15.87:0/1942468675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d58d8a6950 0x55d58d8a38a0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f5f78012010 tx=0x7f5f78004730 comp rx=0 tx=0).stop 2024-09-13T17:20:57.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.021+0000 7f5f8a9ec740 1 -- 172.21.15.87:0/1942468675 shutdown_connections 2024-09-13T17:20:57.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.021+0000 7f5f8a9ec740 1 --2- 172.21.15.87:0/1942468675 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55d58d8b6270 0x55d58d8b8690 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.021+0000 7f5f8a9ec740 1 --2- 172.21.15.87:0/1942468675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d58d8a6950 0x55d58d8a38a0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.021+0000 7f5f8a9ec740 1 --2- 172.21.15.87:0/1942468675 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58d89c0b0 0x55d58d8a3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.021+0000 7f5f8a9ec740 1 --2- 172.21.15.87:0/1942468675 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d58d89b790 0x55d58d8a5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.021+0000 7f5f657fa640 0 client.17517 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:20:57.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.021+0000 7f5f8a9ec740 1 -- 172.21.15.87:0/1942468675 >> 172.21.15.87:0/1942468675 conn(0x55d58d897d00 msgr2=0x55d58d89da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:57.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.021+0000 7f5f8a9ec740 1 -- 172.21.15.87:0/1942468675 shutdown_connections 2024-09-13T17:20:57.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.021+0000 7f5f8a9ec740 1 -- 172.21.15.87:0/1942468675 wait complete. 2024-09-13T17:20:57.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.021+0000 7f5f8a9ec740 20 client.17517 trim_cache size 0 max 16384 2024-09-13T17:20:57.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.032+0000 7f5f8a9ec740 1 Processor -- start 2024-09-13T17:20:57.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.032+0000 7f5f8a9ec740 1 -- start start 2024-09-13T17:20:57.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.032+0000 7f5f8a9ec740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d58d897d00 0x55d58d8a3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.032+0000 7f5f8a9ec740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d58d89b790 0x55d58d8a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.032+0000 7f5f8a9ec740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58d89c0b0 0x55d58d8a1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.032+0000 7f5f8a9ec740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d58d8936b0 con 0x55d58d897d00 2024-09-13T17:20:57.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.032+0000 7f5f8a9ec740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d58d8989f0 con 0x55d58d89b790 2024-09-13T17:20:57.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.032+0000 7f5f8a9ec740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d58d892300 con 0x55d58d89c0b0 2024-09-13T17:20:57.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.033+0000 7f5f85989640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d58d897d00 0x55d58d8a3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.033+0000 7f5f85989640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d58d897d00 0x55d58d8a3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57092/0 (socket says 172.21.15.87:57092) 2024-09-13T17:20:57.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.033+0000 7f5f85989640 1 -- 172.21.15.87:0/3255421242 learned_addr learned my addr 172.21.15.87:0/3255421242 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:57.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.033+0000 7f5f8618a640 1 --2- 172.21.15.87:0/3255421242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58d89c0b0 0x55d58d8a1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.033+0000 7f5f85188640 1 --2- 172.21.15.87:0/3255421242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d58d89b790 0x55d58d8a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.033+0000 7f5f85989640 1 -- 172.21.15.87:0/3255421242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58d89c0b0 msgr2=0x55d58d8a1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:57.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.033+0000 7f5f85989640 1 --2- 172.21.15.87:0/3255421242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58d89c0b0 0x55d58d8a1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.033+0000 7f5f85989640 1 -- 172.21.15.87:0/3255421242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d58d89b790 msgr2=0x55d58d8a38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:57.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.033+0000 7f5f85989640 1 --2- 172.21.15.87:0/3255421242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d58d89b790 0x55d58d8a38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.033+0000 7f5f85989640 1 -- 172.21.15.87:0/3255421242 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d58d79f770 con 0x55d58d897d00 2024-09-13T17:20:57.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.033+0000 7f5f85188640 1 --2- 172.21.15.87:0/3255421242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d58d89b790 0x55d58d8a38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:20:57.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.033+0000 7f5f85989640 1 --2- 172.21.15.87:0/3255421242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d58d897d00 0x55d58d8a3360 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f5f70005fe0 tx=0x7f5f70049040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe4454fe7765844 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:57.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.033+0000 7f5f7ce05640 1 -- 172.21.15.87:0/3255421242 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7004c040 con 0x55d58d897d00 2024-09-13T17:20:57.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.033+0000 7f5f7ce05640 1 -- 172.21.15.87:0/3255421242 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5f70031bd0 con 0x55d58d897d00 2024-09-13T17:20:57.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.033+0000 7f5f7ce05640 1 -- 172.21.15.87:0/3255421242 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f70051610 con 0x55d58d897d00 2024-09-13T17:20:57.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.034+0000 7f5f8a9ec740 1 -- 172.21.15.87:0/3255421242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d58d897d00 msgr2=0x55d58d8a3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:57.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.034+0000 7f5f8a9ec740 1 --2- 172.21.15.87:0/3255421242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d58d897d00 0x55d58d8a3360 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f5f70005fe0 tx=0x7f5f70049040 comp rx=0 tx=0).stop 2024-09-13T17:20:57.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.034+0000 7f5f8a9ec740 1 -- 172.21.15.87:0/3255421242 shutdown_connections 2024-09-13T17:20:57.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.034+0000 7f5f8a9ec740 1 --2- 172.21.15.87:0/3255421242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58d89c0b0 0x55d58d8a1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.034+0000 7f5f8a9ec740 1 --2- 172.21.15.87:0/3255421242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d58d89b790 0x55d58d8a38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.034+0000 7f5f8a9ec740 1 --2- 172.21.15.87:0/3255421242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d58d897d00 0x55d58d8a3360 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.034+0000 7f5f8a9ec740 1 -- 172.21.15.87:0/3255421242 >> 172.21.15.87:0/3255421242 conn(0x55d58d8a6060 msgr2=0x55d58d8bcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:57.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.034+0000 7f5f8a9ec740 1 -- 172.21.15.87:0/3255421242 shutdown_connections 2024-09-13T17:20:57.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.034+0000 7f5f8a9ec740 1 -- 172.21.15.87:0/3255421242 wait complete. 2024-09-13T17:20:57.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.034+0000 7f5f8a9ec740 1 -- start start 2024-09-13T17:20:57.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.034+0000 7f5f8a9ec740 1 Processor -- start 2024-09-13T17:20:57.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.034+0000 7f5f8a9ec740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d58d897d00 0x55d58d8aa180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.034+0000 7f5f8a9ec740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58d89b790 0x55d58d8aa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.034+0000 7f5f8a9ec740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d58d89c0b0 0x55d58d8aac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.034+0000 7f5f8a9ec740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d58d90c770 con 0x55d58d89c0b0 2024-09-13T17:20:57.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.034+0000 7f5f8a9ec740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d58d90c8b0 con 0x55d58d897d00 2024-09-13T17:20:57.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.034+0000 7f5f8a9ec740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d58d90ca70 con 0x55d58d89b790 2024-09-13T17:20:57.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.035+0000 7f5f8a9ec740 10 client.0 _ll_register_callbacks cb 0x7f5f70009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:20:57.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.035+0000 7f5f8618a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d58d89c0b0 0x55d58d8aac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.035+0000 7f5f8618a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d58d89c0b0 0x55d58d8aac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57106/0 (socket says 172.21.15.87:57106) 2024-09-13T17:20:57.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.035+0000 7f5f8618a640 1 -- 172.21.15.87:0/2379165790 learned_addr learned my addr 172.21.15.87:0/2379165790 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:57.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.035+0000 7f5f85188640 1 --2- 172.21.15.87:0/2379165790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58d89b790 0x55d58d8aa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.035+0000 7f5f85989640 1 --2- 172.21.15.87:0/2379165790 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d58d897d00 0x55d58d8aa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.035+0000 7f5f8618a640 1 -- 172.21.15.87:0/2379165790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58d89b790 msgr2=0x55d58d8aa6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:57.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.035+0000 7f5f8618a640 1 --2- 172.21.15.87:0/2379165790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58d89b790 0x55d58d8aa6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.035+0000 7f5f8618a640 1 -- 172.21.15.87:0/2379165790 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d58d897d00 msgr2=0x55d58d8aa180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:57.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.035+0000 7f5f8618a640 1 --2- 172.21.15.87:0/2379165790 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d58d897d00 0x55d58d8aa180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.035+0000 7f5f8618a640 1 -- 172.21.15.87:0/2379165790 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d58d7c6620 con 0x55d58d89c0b0 2024-09-13T17:20:57.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.035+0000 7f5f8618a640 1 --2- 172.21.15.87:0/2379165790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d58d89c0b0 0x55d58d8aac00 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f5f78011c40 tx=0x7f5f78011c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f7ea47f68c92d50 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:57.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.035+0000 7f5f657fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:20:57.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.035+0000 7f5f657fa640 1 -- 172.21.15.87:0/2379165790 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f780269b0 con 0x55d58d89c0b0 2024-09-13T17:20:57.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.035+0000 7f5f657fa640 1 -- 172.21.15.87:0/2379165790 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f5f78018040 con 0x55d58d89c0b0 2024-09-13T17:20:57.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.035+0000 7f5f8a9ec740 1 -- 172.21.15.87:0/2379165790 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5f70040070 con 0x55d58d89c0b0 2024-09-13T17:20:57.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.035+0000 7f5f657fa640 1 -- 172.21.15.87:0/2379165790 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f78012ca0 con 0x55d58d89c0b0 2024-09-13T17:20:57.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.035+0000 7f5f8a9ec740 10 client.17523 fetch_fsmap learned FSMap version 36 2024-09-13T17:20:57.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.035+0000 7f5f8a9ec740 1 -- 172.21.15.87:0/2379165790 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55d58d7c4e80 con 0x55d58d89c0b0 2024-09-13T17:20:57.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.036+0000 7f5f657fa640 1 -- 172.21.15.87:0/2379165790 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5f70040070 con 0x55d58d89c0b0 2024-09-13T17:20:57.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.036+0000 7f5f657fa640 1 -- 172.21.15.87:0/2379165790 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f5f7801ec90 con 0x55d58d89c0b0 2024-09-13T17:20:57.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.036+0000 7f5f8a9ec740 10 client.17523 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:20:57.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.036+0000 7f5f8a9ec740 10 client.17523 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:20:57.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.036+0000 7f5f8a9ec740 20 client.17523 populate_metadata read hostname 'smithi087' 2024-09-13T17:20:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.036+0000 7f5f8a9ec740 1 --2- 172.21.15.87:0/2379165790 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55d58d8a6950 0x55d58d910200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.036+0000 7f5f8a9ec740 4 client.17523 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:20:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.036+0000 7f5f8a9ec740 1 -- 172.21.15.87:0/2379165790 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d58d4f24e0 con 0x55d58d8a6950 2024-09-13T17:20:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.036+0000 7f5f85989640 1 --2- 172.21.15.87:0/2379165790 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55d58d8a6950 0x55d58d910200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.036+0000 7f5f657fa640 10 client.17523 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:20:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.036+0000 7f5f85989640 1 --2- 172.21.15.87:0/2379165790 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55d58d8a6950 0x55d58d910200 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e27d0c69f5834d73 server_cookie=3691c5725e2d65df in_seq=0 out_seq=0 2024-09-13T17:20:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.036+0000 7f5f657fa640 1 -- 172.21.15.87:0/2379165790 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d58d4f24e0 con 0x55d58d8a6950 2024-09-13T17:20:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.036+0000 7f5f657fa640 10 client.17523 handle_command_reply: tid=0 2024-09-13T17:20:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.036+0000 7f5f8a9ec740 1 client.17523 shutdown 2024-09-13T17:20:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.037+0000 7f5f8a9ec740 1 -- 172.21.15.87:0/2379165790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d58d89c0b0 msgr2=0x55d58d8aac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.037+0000 7f5f8a9ec740 1 --2- 172.21.15.87:0/2379165790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d58d89c0b0 0x55d58d8aac00 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f5f78011c40 tx=0x7f5f78011c70 comp rx=0 tx=0).stop 2024-09-13T17:20:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.037+0000 7f5f8a9ec740 1 -- 172.21.15.87:0/2379165790 shutdown_connections 2024-09-13T17:20:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.037+0000 7f5f8a9ec740 1 --2- 172.21.15.87:0/2379165790 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55d58d8a6950 0x55d58d910200 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.037+0000 7f5f8a9ec740 1 --2- 172.21.15.87:0/2379165790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d58d89c0b0 0x55d58d8aac00 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.037+0000 7f5f657fa640 0 client.17523 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:20:57.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.037+0000 7f5f8a9ec740 1 --2- 172.21.15.87:0/2379165790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58d89b790 0x55d58d8aa6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.037+0000 7f5f8a9ec740 1 --2- 172.21.15.87:0/2379165790 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d58d897d00 0x55d58d8aa180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.037+0000 7f5f8a9ec740 1 -- 172.21.15.87:0/2379165790 >> 172.21.15.87:0/2379165790 conn(0x55d58d8a6060 msgr2=0x55d58d8a3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:57.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.037+0000 7f5f8a9ec740 1 -- 172.21.15.87:0/2379165790 shutdown_connections 2024-09-13T17:20:57.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.037+0000 7f5f8a9ec740 1 -- 172.21.15.87:0/2379165790 wait complete. 2024-09-13T17:20:57.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.037+0000 7f5f8a9ec740 20 client.17523 trim_cache size 0 max 16384 2024-09-13T17:20:57.047 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:20:57.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.037+0000 7f5f87bed640 1 -- 172.21.15.87:0/1044586061 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5f680a12b0 msgr2=0x7f5f680a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:57.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.037+0000 7f5f87bed640 1 --2- 172.21.15.87:0/1044586061 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5f680a12b0 0x7f5f680a3770 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5f78005fd0 tx=0x7f5f7800b510 comp rx=0 tx=0).stop 2024-09-13T17:20:57.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.037+0000 7f5f87bed640 1 -- 172.21.15.87:0/1044586061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f80106440 msgr2=0x7f5f80100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:57.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.037+0000 7f5f87bed640 1 --2- 172.21.15.87:0/1044586061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f80106440 0x7f5f80100030 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f5f7400d950 tx=0x7f5f7400de10 comp rx=0 tx=0).stop 2024-09-13T17:20:57.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.037+0000 7f5f87bed640 1 -- 172.21.15.87:0/1044586061 shutdown_connections 2024-09-13T17:20:57.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.037+0000 7f5f87bed640 1 --2- 172.21.15.87:0/1044586061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f80100570 0x7f5f801a4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.037+0000 7f5f87bed640 1 --2- 172.21.15.87:0/1044586061 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5f680a12b0 0x7f5f680a3770 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.037+0000 7f5f87bed640 1 --2- 172.21.15.87:0/1044586061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f80106440 0x7f5f80100030 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.037+0000 7f5f87bed640 1 --2- 172.21.15.87:0/1044586061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f800feb80 0x7f5f800ffaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.037+0000 7f5f87bed640 1 -- 172.21.15.87:0/1044586061 >> 172.21.15.87:0/1044586061 conn(0x7f5f80074110 msgr2=0x7f5f80103f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:57.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.037+0000 7f5f87bed640 1 -- 172.21.15.87:0/1044586061 shutdown_connections 2024-09-13T17:20:57.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.037+0000 7f5f87bed640 1 -- 172.21.15.87:0/1044586061 wait complete. 2024-09-13T17:20:57.049 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:56 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1236270548' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:20:57.051 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-09-13T17:20:57.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:56 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1236270548' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:20:57.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:56 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1236270548' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:20:57.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.149+0000 7f134bcb1640 1 -- 172.21.15.87:0/4047985544 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1344103fe0 msgr2=0x7f134410bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:57.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.149+0000 7f134bcb1640 1 --2- 172.21.15.87:0/4047985544 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1344103fe0 0x7f134410bb30 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f133c009cd0 tx=0x7f133c02a8e0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.149+0000 7f134bcb1640 1 -- 172.21.15.87:0/4047985544 shutdown_connections 2024-09-13T17:20:57.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.149+0000 7f134bcb1640 1 --2- 172.21.15.87:0/4047985544 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1344103fe0 0x7f134410bb30 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.149+0000 7f134bcb1640 1 --2- 172.21.15.87:0/4047985544 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13440ff840 0x7f1344103880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.149+0000 7f134bcb1640 1 --2- 172.21.15.87:0/4047985544 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13440fee90 0x7f13440ff270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.149+0000 7f134bcb1640 1 -- 172.21.15.87:0/4047985544 >> 172.21.15.87:0/4047985544 conn(0x7f13440fa900 msgr2=0x7f13440fcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:57.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.150+0000 7f134bcb1640 1 -- 172.21.15.87:0/4047985544 shutdown_connections 2024-09-13T17:20:57.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.150+0000 7f134bcb1640 1 -- 172.21.15.87:0/4047985544 wait complete. 2024-09-13T17:20:57.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.150+0000 7f134bcb1640 1 Processor -- start 2024-09-13T17:20:57.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.150+0000 7f134bcb1640 1 -- start start 2024-09-13T17:20:57.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.150+0000 7f134bcb1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13440fee90 0x7f1344196210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.150+0000 7f134bcb1640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1344103fe0 0x7f1344196750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.150+0000 7f134bcb1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f134419ab40 0x7f134419aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.150+0000 7f134bcb1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134419b530 con 0x7f13440fee90 2024-09-13T17:20:57.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.150+0000 7f134bcb1640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134419b6a0 con 0x7f134419ab40 2024-09-13T17:20:57.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.150+0000 7f134bcb1640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134419b810 con 0x7f1344103fe0 2024-09-13T17:20:57.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.150+0000 7f1349a4d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13440fee90 0x7f1344196210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.150+0000 7f1349a4d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13440fee90 0x7f1344196210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57132/0 (socket says 172.21.15.87:57132) 2024-09-13T17:20:57.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.150+0000 7f1349a4d640 1 -- 172.21.15.87:0/4039152656 learned_addr learned my addr 172.21.15.87:0/4039152656 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:57.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.151+0000 7f134924c640 1 --2- 172.21.15.87:0/4039152656 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1344103fe0 0x7f1344196750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.151+0000 7f134a24e640 1 --2- 172.21.15.87:0/4039152656 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f134419ab40 0x7f134419aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.151+0000 7f1349a4d640 1 -- 172.21.15.87:0/4039152656 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1344103fe0 msgr2=0x7f1344196750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:57.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.151+0000 7f1349a4d640 1 --2- 172.21.15.87:0/4039152656 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1344103fe0 0x7f1344196750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.151+0000 7f1349a4d640 1 -- 172.21.15.87:0/4039152656 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f134419ab40 msgr2=0x7f134419aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:57.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.151+0000 7f1349a4d640 1 --2- 172.21.15.87:0/4039152656 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f134419ab40 0x7f134419aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.151+0000 7f1349a4d640 1 -- 172.21.15.87:0/4039152656 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f133c009900 con 0x7f13440fee90 2024-09-13T17:20:57.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.151+0000 7f134a24e640 1 --2- 172.21.15.87:0/4039152656 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f134419ab40 0x7f134419aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:57.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.151+0000 7f134924c640 1 --2- 172.21.15.87:0/4039152656 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1344103fe0 0x7f1344196750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:20:57.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.151+0000 7f1349a4d640 1 --2- 172.21.15.87:0/4039152656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13440fee90 0x7f1344196210 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f134000d770 tx=0x7f134000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:57.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.151+0000 7f133affd640 1 -- 172.21.15.87:0/4039152656 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1340009c30 con 0x7f13440fee90 2024-09-13T17:20:57.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.151+0000 7f133affd640 1 -- 172.21.15.87:0/4039152656 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f134000de80 con 0x7f13440fee90 2024-09-13T17:20:57.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.151+0000 7f134bcb1640 1 -- 172.21.15.87:0/4039152656 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13441a2df0 con 0x7f13440fee90 2024-09-13T17:20:57.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.151+0000 7f133affd640 1 -- 172.21.15.87:0/4039152656 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1340004e00 con 0x7f13440fee90 2024-09-13T17:20:57.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.151+0000 7f134bcb1640 1 -- 172.21.15.87:0/4039152656 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13441a3240 con 0x7f13440fee90 2024-09-13T17:20:57.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.153+0000 7f133affd640 1 -- 172.21.15.87:0/4039152656 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f1340004f60 con 0x7f13440fee90 2024-09-13T17:20:57.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.153+0000 7f134e9d3740 1 Processor -- start 2024-09-13T17:20:57.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.154+0000 7f134e9d3740 1 -- start start 2024-09-13T17:20:57.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.154+0000 7f134e9d3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55abb56fe670 0x55abb56fea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.154+0000 7f134e9d3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55abb56fef90 0x55abb570d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.154+0000 7f134e9d3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abb570dd60 0x55abb5710150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.154+0000 7f134e9d3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abb5668cc0 con 0x55abb570dd60 2024-09-13T17:20:57.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.154+0000 7f134e9d3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abb5666450 con 0x55abb56fef90 2024-09-13T17:20:57.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.154+0000 7f134e9d3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abb5661d40 con 0x55abb56fe670 2024-09-13T17:20:57.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.154+0000 7f133affd640 1 --2- 172.21.15.87:0/4039152656 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f13300a1280 0x7f13300a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.154+0000 7f134924c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abb570dd60 0x55abb5710150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.154+0000 7f134924c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abb570dd60 0x55abb5710150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57144/0 (socket says 172.21.15.87:57144) 2024-09-13T17:20:57.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.154+0000 7f134924c640 1 -- 172.21.15.87:0/988772933 learned_addr learned my addr 172.21.15.87:0/988772933 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:57.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.154+0000 7f134a24e640 1 --2- 172.21.15.87:0/4039152656 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f13300a1280 0x7f13300a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.154+0000 7f134a24e640 1 --2- 172.21.15.87:0/988772933 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55abb56fe670 0x55abb56fea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.154+0000 7f133affd640 1 -- 172.21.15.87:0/4039152656 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f13400ccbb0 con 0x7f13440fee90 2024-09-13T17:20:57.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.154+0000 7f1349a4d640 1 --2- 172.21.15.87:0/988772933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55abb56fef90 0x55abb570d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.154+0000 7f134924c640 1 -- 172.21.15.87:0/988772933 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55abb56fe670 msgr2=0x55abb56fea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:57.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.154+0000 7f134924c640 1 --2- 172.21.15.87:0/988772933 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55abb56fe670 0x55abb56fea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.154+0000 7f134924c640 1 -- 172.21.15.87:0/988772933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55abb56fef90 msgr2=0x55abb570d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:57.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.154+0000 7f134924c640 1 --2- 172.21.15.87:0/988772933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55abb56fef90 0x55abb570d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.154+0000 7f134924c640 1 -- 172.21.15.87:0/988772933 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55abb5629620 con 0x55abb570dd60 2024-09-13T17:20:57.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.155+0000 7f134924c640 1 --2- 172.21.15.87:0/988772933 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abb570dd60 0x55abb5710150 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f1334008bb0 tx=0x7f133400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ad21449a1509a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:57.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.155+0000 7f134a24e640 1 --2- 172.21.15.87:0/4039152656 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f13300a1280 0x7f13300a3740 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f133c009880 tx=0x7f133c005d80 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:57.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.155+0000 7f132ffff640 1 -- 172.21.15.87:0/988772933 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1334005220 con 0x55abb570dd60 2024-09-13T17:20:57.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.155+0000 7f132ffff640 1 -- 172.21.15.87:0/988772933 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1334004c50 con 0x55abb570dd60 2024-09-13T17:20:57.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.155+0000 7f132ffff640 1 -- 172.21.15.87:0/988772933 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1334010690 con 0x55abb570dd60 2024-09-13T17:20:57.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.155+0000 7f134e9d3740 1 -- 172.21.15.87:0/988772933 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abb570dd60 msgr2=0x55abb5710150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:57.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.155+0000 7f134e9d3740 1 --2- 172.21.15.87:0/988772933 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abb570dd60 0x55abb5710150 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f1334008bb0 tx=0x7f133400e720 comp rx=0 tx=0).stop 2024-09-13T17:20:57.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.156+0000 7f134e9d3740 1 -- 172.21.15.87:0/988772933 shutdown_connections 2024-09-13T17:20:57.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.156+0000 7f134e9d3740 1 --2- 172.21.15.87:0/988772933 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abb570dd60 0x55abb5710150 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.156+0000 7f134e9d3740 1 --2- 172.21.15.87:0/988772933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55abb56fef90 0x55abb570d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.156+0000 7f134e9d3740 1 --2- 172.21.15.87:0/988772933 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55abb56fe670 0x55abb56fea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.156+0000 7f134e9d3740 1 -- 172.21.15.87:0/988772933 >> 172.21.15.87:0/988772933 conn(0x55abb56fad00 msgr2=0x55abb56fb0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:57.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.156+0000 7f134e9d3740 1 -- 172.21.15.87:0/988772933 shutdown_connections 2024-09-13T17:20:57.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.156+0000 7f134e9d3740 1 -- 172.21.15.87:0/988772933 wait complete. 2024-09-13T17:20:57.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.156+0000 7f134e9d3740 1 -- start start 2024-09-13T17:20:57.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.156+0000 7f134e9d3740 1 Processor -- start 2024-09-13T17:20:57.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.156+0000 7f134e9d3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55abb56fe670 0x55abb570d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.156+0000 7f134e9d3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abb56fef90 0x55abb570a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.156+0000 7f134e9d3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55abb570dd60 0x55abb570aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.156+0000 7f134e9d3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abb5620180 con 0x55abb56fef90 2024-09-13T17:20:57.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.156+0000 7f134e9d3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abb533a430 con 0x55abb56fe670 2024-09-13T17:20:57.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.156+0000 7f134e9d3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abb55e55e0 con 0x55abb570dd60 2024-09-13T17:20:57.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.156+0000 7f134e9d3740 10 client.0 _ll_register_callbacks cb 0x55abb5651aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:20:57.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.157+0000 7f134924c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abb56fef90 0x55abb570a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.157+0000 7f134924c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abb56fef90 0x55abb570a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57156/0 (socket says 172.21.15.87:57156) 2024-09-13T17:20:57.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.157+0000 7f134924c640 1 -- 172.21.15.87:0/83147340 learned_addr learned my addr 172.21.15.87:0/83147340 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:57.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.157+0000 7f134a24e640 1 --2- 172.21.15.87:0/83147340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55abb570dd60 0x55abb570aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.157+0000 7f1349a4d640 1 --2- 172.21.15.87:0/83147340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55abb56fe670 0x55abb570d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.157+0000 7f134924c640 1 -- 172.21.15.87:0/83147340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55abb570dd60 msgr2=0x55abb570aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:57.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.157+0000 7f134924c640 1 --2- 172.21.15.87:0/83147340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55abb570dd60 0x55abb570aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.157+0000 7f134924c640 1 -- 172.21.15.87:0/83147340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55abb56fe670 msgr2=0x55abb570d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:57.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.157+0000 7f134924c640 1 --2- 172.21.15.87:0/83147340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55abb56fe670 0x55abb570d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.157+0000 7f134924c640 1 -- 172.21.15.87:0/83147340 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13340087b0 con 0x55abb56fef90 2024-09-13T17:20:57.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.157+0000 7f1349a4d640 1 --2- 172.21.15.87:0/83147340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55abb56fe670 0x55abb570d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:20:57.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.157+0000 7f134924c640 1 --2- 172.21.15.87:0/83147340 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abb56fef90 0x55abb570a660 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f1334008b80 tx=0x7f13340048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ed8431f94e82f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:57.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.157+0000 7f132d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:20:57.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.157+0000 7f132d7fa640 1 -- 172.21.15.87:0/83147340 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133401f070 con 0x55abb56fef90 2024-09-13T17:20:57.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.157+0000 7f132d7fa640 1 -- 172.21.15.87:0/83147340 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f1334004dc0 con 0x55abb56fef90 2024-09-13T17:20:57.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.157+0000 7f134e9d3740 1 -- 172.21.15.87:0/83147340 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55abb568bb80 con 0x55abb56fef90 2024-09-13T17:20:57.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.157+0000 7f132d7fa640 1 -- 172.21.15.87:0/83147340 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1334004ae0 con 0x55abb56fef90 2024-09-13T17:20:57.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.157+0000 7f134e9d3740 10 client.17535 fetch_fsmap learned FSMap version 36 2024-09-13T17:20:57.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.157+0000 7f134e9d3740 1 -- 172.21.15.87:0/83147340 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55abb56603c0 con 0x55abb56fef90 2024-09-13T17:20:57.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.157+0000 7f132d7fa640 1 -- 172.21.15.87:0/83147340 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55abb568bb80 con 0x55abb56fef90 2024-09-13T17:20:57.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.158+0000 7f132d7fa640 1 -- 172.21.15.87:0/83147340 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1334023530 con 0x55abb56fef90 2024-09-13T17:20:57.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.158+0000 7f134e9d3740 10 client.17535 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:20:57.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.158+0000 7f134e9d3740 10 client.17535 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:20:57.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.158+0000 7f134e9d3740 20 client.17535 populate_metadata read hostname 'smithi087' 2024-09-13T17:20:57.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.158+0000 7f134e9d3740 1 --2- 172.21.15.87:0/83147340 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55abb571d620 0x55abb571fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.158+0000 7f134e9d3740 4 client.17535 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:20:57.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.158+0000 7f134e9d3740 1 -- 172.21.15.87:0/83147340 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55abb56541f0 con 0x55abb571d620 2024-09-13T17:20:57.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.158+0000 7f1349a4d640 1 --2- 172.21.15.87:0/83147340 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55abb571d620 0x55abb571fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.158+0000 7f1349a4d640 1 --2- 172.21.15.87:0/83147340 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55abb571d620 0x55abb571fa40 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d373436e9ad672d3 server_cookie=ad24a8284ea81400 in_seq=0 out_seq=0 2024-09-13T17:20:57.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.158+0000 7f132d7fa640 10 client.17535 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:20:57.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.159+0000 7f132d7fa640 1 -- 172.21.15.87:0/83147340 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55abb56541f0 con 0x55abb571d620 2024-09-13T17:20:57.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.159+0000 7f132d7fa640 10 client.17535 handle_command_reply: tid=0 2024-09-13T17:20:57.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.159+0000 7f134e9d3740 1 client.17535 shutdown 2024-09-13T17:20:57.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.159+0000 7f134e9d3740 1 -- 172.21.15.87:0/83147340 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abb56fef90 msgr2=0x55abb570a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:57.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.159+0000 7f134e9d3740 1 --2- 172.21.15.87:0/83147340 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abb56fef90 0x55abb570a660 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f1334008b80 tx=0x7f13340048f0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.159+0000 7f134e9d3740 1 -- 172.21.15.87:0/83147340 shutdown_connections 2024-09-13T17:20:57.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.159+0000 7f134e9d3740 1 --2- 172.21.15.87:0/83147340 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55abb571d620 0x55abb571fa40 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.159+0000 7f134e9d3740 1 --2- 172.21.15.87:0/83147340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55abb570dd60 0x55abb570aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.159+0000 7f134e9d3740 1 --2- 172.21.15.87:0/83147340 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abb56fef90 0x55abb570a660 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.159+0000 7f134e9d3740 1 --2- 172.21.15.87:0/83147340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55abb56fe670 0x55abb570d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.159+0000 7f132d7fa640 0 client.17535 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:20:57.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.159+0000 7f134e9d3740 1 -- 172.21.15.87:0/83147340 >> 172.21.15.87:0/83147340 conn(0x55abb56fad00 msgr2=0x55abb56f9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:57.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.159+0000 7f134e9d3740 1 -- 172.21.15.87:0/83147340 shutdown_connections 2024-09-13T17:20:57.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.159+0000 7f134e9d3740 1 -- 172.21.15.87:0/83147340 wait complete. 2024-09-13T17:20:57.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.159+0000 7f134e9d3740 20 client.17535 trim_cache size 0 max 16384 2024-09-13T17:20:57.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.170+0000 7f134e9d3740 1 Processor -- start 2024-09-13T17:20:57.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.170+0000 7f134e9d3740 1 -- start start 2024-09-13T17:20:57.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.170+0000 7f134e9d3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abb56fe670 0x55abb56fa6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.170+0000 7f134e9d3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55abb56fef90 0x55abb5714a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.170+0000 7f134e9d3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55abb570dd60 0x55abb5714f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.170+0000 7f134e9d3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abb568bb80 con 0x55abb56fe670 2024-09-13T17:20:57.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.170+0000 7f134e9d3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abb571a4d0 con 0x55abb56fef90 2024-09-13T17:20:57.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.170+0000 7f134e9d3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abb56f6790 con 0x55abb570dd60 2024-09-13T17:20:57.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.170+0000 7f1349a4d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abb56fe670 0x55abb56fa6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.170+0000 7f1349a4d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abb56fe670 0x55abb56fa6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57168/0 (socket says 172.21.15.87:57168) 2024-09-13T17:20:57.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.170+0000 7f1349a4d640 1 -- 172.21.15.87:0/3659304134 learned_addr learned my addr 172.21.15.87:0/3659304134 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:57.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.171+0000 7f1349a4d640 1 -- 172.21.15.87:0/3659304134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55abb570dd60 msgr2=0x55abb5714f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:57.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.171+0000 7f1349a4d640 1 --2- 172.21.15.87:0/3659304134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55abb570dd60 0x55abb5714f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.171+0000 7f1349a4d640 1 -- 172.21.15.87:0/3659304134 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55abb56fef90 msgr2=0x55abb5714a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:57.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.171+0000 7f1349a4d640 1 --2- 172.21.15.87:0/3659304134 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55abb56fef90 0x55abb5714a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.171+0000 7f1349a4d640 1 -- 172.21.15.87:0/3659304134 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55abb5602770 con 0x55abb56fe670 2024-09-13T17:20:57.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.171+0000 7f1349a4d640 1 --2- 172.21.15.87:0/3659304134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abb56fe670 0x55abb56fa6a0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f13400995b0 tx=0x7f134001d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e7e96cbd7c3c4f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:57.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.171+0000 7f1338ff9640 1 -- 172.21.15.87:0/3659304134 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13400b7ea0 con 0x55abb56fe670 2024-09-13T17:20:57.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.171+0000 7f1338ff9640 1 -- 172.21.15.87:0/3659304134 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f13400b2260 con 0x55abb56fe670 2024-09-13T17:20:57.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.171+0000 7f1338ff9640 1 -- 172.21.15.87:0/3659304134 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13400ca170 con 0x55abb56fe670 2024-09-13T17:20:57.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.171+0000 7f134e9d3740 1 -- 172.21.15.87:0/3659304134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abb56fe670 msgr2=0x55abb56fa6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:57.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.171+0000 7f134e9d3740 1 --2- 172.21.15.87:0/3659304134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abb56fe670 0x55abb56fa6a0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f13400995b0 tx=0x7f134001d040 comp rx=0 tx=0).stop 2024-09-13T17:20:57.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.171+0000 7f134e9d3740 1 -- 172.21.15.87:0/3659304134 shutdown_connections 2024-09-13T17:20:57.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.171+0000 7f134e9d3740 1 --2- 172.21.15.87:0/3659304134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55abb570dd60 0x55abb5714f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.171+0000 7f134e9d3740 1 --2- 172.21.15.87:0/3659304134 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55abb56fef90 0x55abb5714a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.171+0000 7f134e9d3740 1 --2- 172.21.15.87:0/3659304134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abb56fe670 0x55abb56fa6a0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.171+0000 7f134e9d3740 1 -- 172.21.15.87:0/3659304134 >> 172.21.15.87:0/3659304134 conn(0x55abb56fad00 msgr2=0x55abb56fb0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:57.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.171+0000 7f134e9d3740 1 -- 172.21.15.87:0/3659304134 shutdown_connections 2024-09-13T17:20:57.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.172+0000 7f134e9d3740 1 -- 172.21.15.87:0/3659304134 wait complete. 2024-09-13T17:20:57.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.172+0000 7f134e9d3740 1 -- start start 2024-09-13T17:20:57.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.172+0000 7f134e9d3740 1 Processor -- start 2024-09-13T17:20:57.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.172+0000 7f134e9d3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55abb56fe670 0x55abb5714a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.172+0000 7f134e9d3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abb56fef90 0x55abb5706cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.172+0000 7f134e9d3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55abb570dd60 0x55abb5707200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.172+0000 7f134e9d3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abb5715200 con 0x55abb56fef90 2024-09-13T17:20:57.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.172+0000 7f134e9d3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abb5715370 con 0x55abb570dd60 2024-09-13T17:20:57.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.172+0000 7f134e9d3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abb57077c0 con 0x55abb56fe670 2024-09-13T17:20:57.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.172+0000 7f134e9d3740 10 client.0 _ll_register_callbacks cb 0x7f1334008310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:20:57.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.172+0000 7f134924c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abb56fef90 0x55abb5706cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.172+0000 7f134924c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abb56fef90 0x55abb5706cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57184/0 (socket says 172.21.15.87:57184) 2024-09-13T17:20:57.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.172+0000 7f134924c640 1 -- 172.21.15.87:0/1293241573 learned_addr learned my addr 172.21.15.87:0/1293241573 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:57.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.172+0000 7f134a24e640 1 --2- 172.21.15.87:0/1293241573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55abb570dd60 0x55abb5707200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.173+0000 7f134924c640 1 -- 172.21.15.87:0/1293241573 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55abb56fe670 msgr2=0x55abb5714a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:57.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.173+0000 7f134924c640 1 --2- 172.21.15.87:0/1293241573 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55abb56fe670 0x55abb5714a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.173+0000 7f134924c640 1 -- 172.21.15.87:0/1293241573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55abb570dd60 msgr2=0x55abb5707200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:57.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.173+0000 7f134924c640 1 --2- 172.21.15.87:0/1293241573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55abb570dd60 0x55abb5707200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.173+0000 7f134924c640 1 -- 172.21.15.87:0/1293241573 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13441a3240 con 0x55abb56fef90 2024-09-13T17:20:57.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.173+0000 7f134a24e640 1 --2- 172.21.15.87:0/1293241573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55abb570dd60 0x55abb5707200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:20:57.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.173+0000 7f134924c640 1 --2- 172.21.15.87:0/1293241573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abb56fef90 0x55abb5706cc0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f1334006010 tx=0x7f1334005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c435738611ae78a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:57.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.173+0000 7f132d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:20:57.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.173+0000 7f132d7fa640 1 -- 172.21.15.87:0/1293241573 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133401f070 con 0x55abb56fef90 2024-09-13T17:20:57.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.173+0000 7f132d7fa640 1 -- 172.21.15.87:0/1293241573 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f1334000e40 con 0x55abb56fef90 2024-09-13T17:20:57.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.173+0000 7f134e9d3740 1 -- 172.21.15.87:0/1293241573 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1334004c50 con 0x55abb56fef90 2024-09-13T17:20:57.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.173+0000 7f132d7fa640 1 -- 172.21.15.87:0/1293241573 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1334023b80 con 0x55abb56fef90 2024-09-13T17:20:57.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.173+0000 7f134e9d3740 10 client.17541 fetch_fsmap learned FSMap version 36 2024-09-13T17:20:57.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.173+0000 7f134e9d3740 1 -- 172.21.15.87:0/1293241573 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55abb5627e80 con 0x55abb56fef90 2024-09-13T17:20:57.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.173+0000 7f132d7fa640 1 -- 172.21.15.87:0/1293241573 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1334004c50 con 0x55abb56fef90 2024-09-13T17:20:57.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.173+0000 7f132d7fa640 1 -- 172.21.15.87:0/1293241573 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f13340048d0 con 0x55abb56fef90 2024-09-13T17:20:57.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.173+0000 7f134e9d3740 10 client.17541 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:20:57.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.173+0000 7f134e9d3740 10 client.17541 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:20:57.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.173+0000 7f134e9d3740 20 client.17541 populate_metadata read hostname 'smithi087' 2024-09-13T17:20:57.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.173+0000 7f134e9d3740 1 --2- 172.21.15.87:0/1293241573 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55abb5774c90 0x55abb57770b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:57.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.173+0000 7f134e9d3740 4 client.17541 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:20:57.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.173+0000 7f134e9d3740 1 -- 172.21.15.87:0/1293241573 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55abb53554e0 con 0x55abb5774c90 2024-09-13T17:20:57.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.174+0000 7f1349a4d640 1 --2- 172.21.15.87:0/1293241573 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55abb5774c90 0x55abb57770b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:57.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.174+0000 7f1349a4d640 1 --2- 172.21.15.87:0/1293241573 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55abb5774c90 0x55abb57770b0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23d287f1166c46b5 server_cookie=fb3e61198bbc751 in_seq=0 out_seq=0 2024-09-13T17:20:57.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.174+0000 7f132d7fa640 10 client.17541 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:20:57.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.174+0000 7f132d7fa640 1 -- 172.21.15.87:0/1293241573 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55abb53554e0 con 0x55abb5774c90 2024-09-13T17:20:57.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.174+0000 7f132d7fa640 10 client.17541 handle_command_reply: tid=0 2024-09-13T17:20:57.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.174+0000 7f134e9d3740 1 client.17541 shutdown 2024-09-13T17:20:57.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.174+0000 7f134e9d3740 1 -- 172.21.15.87:0/1293241573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abb56fef90 msgr2=0x55abb5706cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:57.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.174+0000 7f134e9d3740 1 --2- 172.21.15.87:0/1293241573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abb56fef90 0x55abb5706cc0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f1334006010 tx=0x7f1334005be0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.174+0000 7f134e9d3740 1 -- 172.21.15.87:0/1293241573 shutdown_connections 2024-09-13T17:20:57.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.174+0000 7f134e9d3740 1 --2- 172.21.15.87:0/1293241573 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55abb5774c90 0x55abb57770b0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.174+0000 7f134e9d3740 1 --2- 172.21.15.87:0/1293241573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55abb570dd60 0x55abb5707200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.174+0000 7f132d7fa640 0 client.17541 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:20:57.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.174+0000 7f134e9d3740 1 --2- 172.21.15.87:0/1293241573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abb56fef90 0x55abb5706cc0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.174+0000 7f134e9d3740 1 --2- 172.21.15.87:0/1293241573 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55abb56fe670 0x55abb5714a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.174+0000 7f134e9d3740 1 -- 172.21.15.87:0/1293241573 >> 172.21.15.87:0/1293241573 conn(0x55abb56fad00 msgr2=0x55abb5708ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:57.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.174+0000 7f134e9d3740 1 -- 172.21.15.87:0/1293241573 shutdown_connections 2024-09-13T17:20:57.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.175+0000 7f134e9d3740 1 -- 172.21.15.87:0/1293241573 wait complete. 2024-09-13T17:20:57.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.175+0000 7f134e9d3740 20 client.17541 trim_cache size 0 max 16384 2024-09-13T17:20:57.183 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:20:57.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.175+0000 7f134bcb1640 1 -- 172.21.15.87:0/4039152656 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f13300a1280 msgr2=0x7f13300a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:57.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.175+0000 7f134bcb1640 1 --2- 172.21.15.87:0/4039152656 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f13300a1280 0x7f13300a3740 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f133c009880 tx=0x7f133c005d80 comp rx=0 tx=0).stop 2024-09-13T17:20:57.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.175+0000 7f134bcb1640 1 -- 172.21.15.87:0/4039152656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13440fee90 msgr2=0x7f1344196210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:57.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.175+0000 7f134bcb1640 1 --2- 172.21.15.87:0/4039152656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13440fee90 0x7f1344196210 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f134000d770 tx=0x7f134000dc30 comp rx=0 tx=0).stop 2024-09-13T17:20:57.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.175+0000 7f134bcb1640 1 -- 172.21.15.87:0/4039152656 shutdown_connections 2024-09-13T17:20:57.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.175+0000 7f134bcb1640 1 --2- 172.21.15.87:0/4039152656 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f134419ab40 0x7f134419aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.175+0000 7f134bcb1640 1 --2- 172.21.15.87:0/4039152656 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1344103fe0 0x7f1344196750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.175+0000 7f134bcb1640 1 --2- 172.21.15.87:0/4039152656 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f13300a1280 0x7f13300a3740 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.175+0000 7f134bcb1640 1 --2- 172.21.15.87:0/4039152656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13440fee90 0x7f1344196210 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:57.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.175+0000 7f134bcb1640 1 -- 172.21.15.87:0/4039152656 >> 172.21.15.87:0/4039152656 conn(0x7f13440fa900 msgr2=0x7f13440fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:57.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.175+0000 7f134bcb1640 1 -- 172.21.15.87:0/4039152656 shutdown_connections 2024-09-13T17:20:57.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:57.175+0000 7f134bcb1640 1 -- 172.21.15.87:0/4039152656 wait complete. 2024-09-13T17:20:58.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:57 smithi149 ceph-mon[35496]: pgmap v219: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:20:58.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:57 smithi118 ceph-mon[34374]: pgmap v219: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:20:58.187 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-13T17:20:58.188 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-09-13T17:20:58.213 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:57 smithi087 ceph-mon[30934]: pgmap v219: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:20:58.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.296+0000 7ffb44e41640 1 -- 172.21.15.87:0/1731263150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb401050e0 msgr2=0x7ffb4010cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:58.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.296+0000 7ffb44e41640 1 --2- 172.21.15.87:0/1731263150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb401050e0 0x7ffb4010cc30 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7ffb38009cd0 tx=0x7ffb3802a8e0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.296+0000 7ffb44e41640 1 -- 172.21.15.87:0/1731263150 shutdown_connections 2024-09-13T17:20:58.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.296+0000 7ffb44e41640 1 --2- 172.21.15.87:0/1731263150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb401050e0 0x7ffb4010cc30 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.296+0000 7ffb44e41640 1 --2- 172.21.15.87:0/1731263150 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb40100940 0x7ffb40104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.296+0000 7ffb44e41640 1 --2- 172.21.15.87:0/1731263150 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb400fff90 0x7ffb40100370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.296+0000 7ffb44e41640 1 -- 172.21.15.87:0/1731263150 >> 172.21.15.87:0/1731263150 conn(0x7ffb400fba20 msgr2=0x7ffb400fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:58.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.296+0000 7ffb44e41640 1 -- 172.21.15.87:0/1731263150 shutdown_connections 2024-09-13T17:20:58.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.296+0000 7ffb44e41640 1 -- 172.21.15.87:0/1731263150 wait complete. 2024-09-13T17:20:58.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.297+0000 7ffb44e41640 1 Processor -- start 2024-09-13T17:20:58.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.297+0000 7ffb44e41640 1 -- start start 2024-09-13T17:20:58.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.297+0000 7ffb44e41640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb400fff90 0x7ffb40196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.297+0000 7ffb44e41640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb401050e0 0x7ffb401967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.297+0000 7ffb44e41640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb4019ab90 0x7ffb4019b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.297+0000 7ffb44e41640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4019b580 con 0x7ffb4019ab90 2024-09-13T17:20:58.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.297+0000 7ffb44e41640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4019b6f0 con 0x7ffb401050e0 2024-09-13T17:20:58.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.297+0000 7ffb44e41640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4019b860 con 0x7ffb400fff90 2024-09-13T17:20:58.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.297+0000 7ffb3ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb4019ab90 0x7ffb4019b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:58.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.298+0000 7ffb3ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb4019ab90 0x7ffb4019b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57192/0 (socket says 172.21.15.87:57192) 2024-09-13T17:20:58.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.298+0000 7ffb3ed9d640 1 -- 172.21.15.87:0/3230959629 learned_addr learned my addr 172.21.15.87:0/3230959629 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:58.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.298+0000 7ffb3dd9b640 1 --2- 172.21.15.87:0/3230959629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb401050e0 0x7ffb401967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:58.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.298+0000 7ffb3e59c640 1 --2- 172.21.15.87:0/3230959629 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb400fff90 0x7ffb40196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:58.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.298+0000 7ffb3ed9d640 1 -- 172.21.15.87:0/3230959629 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb400fff90 msgr2=0x7ffb40196260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:58.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.298+0000 7ffb3ed9d640 1 --2- 172.21.15.87:0/3230959629 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb400fff90 0x7ffb40196260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.298+0000 7ffb3ed9d640 1 -- 172.21.15.87:0/3230959629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb401050e0 msgr2=0x7ffb401967a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:58.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.298+0000 7ffb3ed9d640 1 --2- 172.21.15.87:0/3230959629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb401050e0 0x7ffb401967a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.298+0000 7ffb3ed9d640 1 -- 172.21.15.87:0/3230959629 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb38009900 con 0x7ffb4019ab90 2024-09-13T17:20:58.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.298+0000 7ffb3ed9d640 1 --2- 172.21.15.87:0/3230959629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb4019ab90 0x7ffb4019b040 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7ffb38005cc0 tx=0x7ffb38030850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:58.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.298+0000 7ffb2f7fe640 1 -- 172.21.15.87:0/3230959629 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb38031d00 con 0x7ffb4019ab90 2024-09-13T17:20:58.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.298+0000 7ffb44e41640 1 -- 172.21.15.87:0/3230959629 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb401a2e40 con 0x7ffb4019ab90 2024-09-13T17:20:58.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.298+0000 7ffb2f7fe640 1 -- 172.21.15.87:0/3230959629 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffb38003e20 con 0x7ffb4019ab90 2024-09-13T17:20:58.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.298+0000 7ffb2f7fe640 1 -- 172.21.15.87:0/3230959629 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb38045410 con 0x7ffb4019ab90 2024-09-13T17:20:58.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.298+0000 7ffb44e41640 1 -- 172.21.15.87:0/3230959629 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb401a32c0 con 0x7ffb4019ab90 2024-09-13T17:20:58.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.301+0000 7ffb2f7fe640 1 -- 172.21.15.87:0/3230959629 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7ffb3800a040 con 0x7ffb4019ab90 2024-09-13T17:20:58.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.301+0000 7ffb47c42740 1 Processor -- start 2024-09-13T17:20:58.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.301+0000 7ffb47c42740 1 -- start start 2024-09-13T17:20:58.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.302+0000 7ffb47c42740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56373851c7c0 0x56373851cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.302+0000 7ffb47c42740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56373851d0e0 0x563738527440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.302+0000 7ffb47c42740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563738527980 0x563738529d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.302+0000 7ffb47c42740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x563738487c60 con 0x56373851c7c0 2024-09-13T17:20:58.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.302+0000 7ffb47c42740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637384853f0 con 0x56373851d0e0 2024-09-13T17:20:58.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.302+0000 7ffb47c42740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x563738480ce0 con 0x563738527980 2024-09-13T17:20:58.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.302+0000 7ffb3dd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56373851c7c0 0x56373851cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:58.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.302+0000 7ffb3dd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56373851c7c0 0x56373851cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57196/0 (socket says 172.21.15.87:57196) 2024-09-13T17:20:58.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.302+0000 7ffb3dd9b640 1 -- 172.21.15.87:0/2715371126 learned_addr learned my addr 172.21.15.87:0/2715371126 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:58.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.302+0000 7ffb3e59c640 1 --2- 172.21.15.87:0/2715371126 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56373851d0e0 0x563738527440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:58.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.302+0000 7ffb2f7fe640 1 --2- 172.21.15.87:0/3230959629 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ffb280a1200 0x7ffb280a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.302+0000 7ffb3dd9b640 1 --2- 172.21.15.87:0/2715371126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563738527980 0x563738529d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:58.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.302+0000 7ffb3ed9d640 1 --2- 172.21.15.87:0/3230959629 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ffb280a1200 0x7ffb280a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:58.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.302+0000 7ffb3dd9b640 1 -- 172.21.15.87:0/2715371126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563738527980 msgr2=0x563738529d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:58.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.302+0000 7ffb3dd9b640 1 --2- 172.21.15.87:0/2715371126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563738527980 0x563738529d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.302+0000 7ffb3dd9b640 1 -- 172.21.15.87:0/2715371126 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56373851d0e0 msgr2=0x563738527440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:58.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.302+0000 7ffb3dd9b640 1 --2- 172.21.15.87:0/2715371126 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56373851d0e0 0x563738527440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.302+0000 7ffb3dd9b640 1 -- 172.21.15.87:0/2715371126 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56373843c970 con 0x56373851c7c0 2024-09-13T17:20:58.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.302+0000 7ffb2f7fe640 1 -- 172.21.15.87:0/3230959629 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7ffb380ee830 con 0x7ffb4019ab90 2024-09-13T17:20:58.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.302+0000 7ffb3dd9b640 1 --2- 172.21.15.87:0/2715371126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56373851c7c0 0x56373851cba0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7ffb3400b6c0 tx=0x7ffb3400b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e257680027873a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:58.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.302+0000 7ffb2cff9640 1 -- 172.21.15.87:0/2715371126 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3400b800 con 0x56373851c7c0 2024-09-13T17:20:58.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.302+0000 7ffb3ed9d640 1 --2- 172.21.15.87:0/3230959629 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ffb280a1200 0x7ffb280a36c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ffb380ebc20 tx=0x7ffb380b79b0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:58.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.302+0000 7ffb2cff9640 1 -- 172.21.15.87:0/2715371126 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffb340044d0 con 0x56373851c7c0 2024-09-13T17:20:58.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.302+0000 7ffb2cff9640 1 -- 172.21.15.87:0/2715371126 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb34005280 con 0x56373851c7c0 2024-09-13T17:20:58.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.303+0000 7ffb47c42740 1 -- 172.21.15.87:0/2715371126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56373851c7c0 msgr2=0x56373851cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:58.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.303+0000 7ffb47c42740 1 --2- 172.21.15.87:0/2715371126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56373851c7c0 0x56373851cba0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7ffb3400b6c0 tx=0x7ffb3400b650 comp rx=0 tx=0).stop 2024-09-13T17:20:58.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.303+0000 7ffb47c42740 1 -- 172.21.15.87:0/2715371126 shutdown_connections 2024-09-13T17:20:58.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.303+0000 7ffb47c42740 1 --2- 172.21.15.87:0/2715371126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563738527980 0x563738529d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.303+0000 7ffb47c42740 1 --2- 172.21.15.87:0/2715371126 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56373851d0e0 0x563738527440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.303+0000 7ffb47c42740 1 --2- 172.21.15.87:0/2715371126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56373851c7c0 0x56373851cba0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.303+0000 7ffb47c42740 1 -- 172.21.15.87:0/2715371126 >> 172.21.15.87:0/2715371126 conn(0x563738518d50 msgr2=0x563738519130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:58.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.303+0000 7ffb47c42740 1 -- 172.21.15.87:0/2715371126 shutdown_connections 2024-09-13T17:20:58.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.303+0000 7ffb47c42740 1 -- 172.21.15.87:0/2715371126 wait complete. 2024-09-13T17:20:58.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.304+0000 7ffb47c42740 1 -- start start 2024-09-13T17:20:58.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.304+0000 7ffb47c42740 1 Processor -- start 2024-09-13T17:20:58.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.304+0000 7ffb47c42740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56373851c7c0 0x5637385272e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.304+0000 7ffb47c42740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56373851d0e0 0x563738524650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.304+0000 7ffb47c42740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563738527980 0x563738524bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.304+0000 7ffb47c42740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56373843ef80 con 0x56373851d0e0 2024-09-13T17:20:58.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.304+0000 7ffb47c42740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56373843ec20 con 0x56373851c7c0 2024-09-13T17:20:58.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.304+0000 7ffb47c42740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56373840bab0 con 0x563738527980 2024-09-13T17:20:58.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.304+0000 7ffb47c42740 10 client.0 _ll_register_callbacks cb 0x56373847a350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:20:58.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.304+0000 7ffb3e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56373851d0e0 0x563738524650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:58.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.304+0000 7ffb3e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56373851d0e0 0x563738524650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57204/0 (socket says 172.21.15.87:57204) 2024-09-13T17:20:58.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.304+0000 7ffb3e59c640 1 -- 172.21.15.87:0/2734829457 learned_addr learned my addr 172.21.15.87:0/2734829457 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:58.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.304+0000 7ffb3dd9b640 1 --2- 172.21.15.87:0/2734829457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56373851c7c0 0x5637385272e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:58.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.304+0000 7ffb3e59c640 1 -- 172.21.15.87:0/2734829457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563738527980 msgr2=0x563738524bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:58.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.304+0000 7ffb3dd9b640 1 --2- 172.21.15.87:0/2734829457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563738527980 0x563738524bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:58.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.304+0000 7ffb3e59c640 1 --2- 172.21.15.87:0/2734829457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563738527980 0x563738524bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.304+0000 7ffb3e59c640 1 -- 172.21.15.87:0/2734829457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56373851c7c0 msgr2=0x5637385272e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:58.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.304+0000 7ffb3e59c640 1 --2- 172.21.15.87:0/2734829457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56373851c7c0 0x5637385272e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.304+0000 7ffb3e59c640 1 -- 172.21.15.87:0/2734829457 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb3400bcb0 con 0x56373851d0e0 2024-09-13T17:20:58.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.304+0000 7ffb3dd9b640 1 --2- 172.21.15.87:0/2734829457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563738527980 0x563738524bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:58.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.304+0000 7ffb3e59c640 1 --2- 172.21.15.87:0/2734829457 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56373851d0e0 0x563738524650 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7ffb30010820 tx=0x7ffb30010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=955ebb97a763250d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:58.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.304+0000 7ffb25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:20:58.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.305+0000 7ffb25ffb640 1 -- 172.21.15.87:0/2734829457 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb30015070 con 0x56373851d0e0 2024-09-13T17:20:58.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.305+0000 7ffb25ffb640 1 -- 172.21.15.87:0/2734829457 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7ffb3000fb90 con 0x56373851d0e0 2024-09-13T17:20:58.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.305+0000 7ffb47c42740 1 -- 172.21.15.87:0/2734829457 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563738174590 con 0x56373851d0e0 2024-09-13T17:20:58.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.305+0000 7ffb25ffb640 1 -- 172.21.15.87:0/2734829457 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb3000fd90 con 0x56373851d0e0 2024-09-13T17:20:58.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.305+0000 7ffb47c42740 10 client.17553 fetch_fsmap learned FSMap version 36 2024-09-13T17:20:58.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.305+0000 7ffb47c42740 1 -- 172.21.15.87:0/2734829457 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x56373847f360 con 0x56373851d0e0 2024-09-13T17:20:58.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.305+0000 7ffb25ffb640 1 -- 172.21.15.87:0/2734829457 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x563738174590 con 0x56373851d0e0 2024-09-13T17:20:58.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.305+0000 7ffb25ffb640 1 -- 172.21.15.87:0/2734829457 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7ffb30018400 con 0x56373851d0e0 2024-09-13T17:20:58.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.305+0000 7ffb47c42740 10 client.17553 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:20:58.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.305+0000 7ffb47c42740 10 client.17553 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:20:58.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.305+0000 7ffb47c42740 20 client.17553 populate_metadata read hostname 'smithi087' 2024-09-13T17:20:58.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.305+0000 7ffb47c42740 1 --2- 172.21.15.87:0/2734829457 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x563738537650 0x563738539a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.305+0000 7ffb47c42740 4 client.17553 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:20:58.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.305+0000 7ffb47c42740 1 -- 172.21.15.87:0/2734829457 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563738185860 con 0x563738537650 2024-09-13T17:20:58.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.305+0000 7ffb3dd9b640 1 --2- 172.21.15.87:0/2734829457 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x563738537650 0x563738539a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:58.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.306+0000 7ffb25ffb640 10 client.17553 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:20:58.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.306+0000 7ffb3dd9b640 1 --2- 172.21.15.87:0/2734829457 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x563738537650 0x563738539a70 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42757017ce4fb80f server_cookie=2ca15ebd7a210c5b in_seq=0 out_seq=0 2024-09-13T17:20:58.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.306+0000 7ffb25ffb640 1 -- 172.21.15.87:0/2734829457 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x563738185860 con 0x563738537650 2024-09-13T17:20:58.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.306+0000 7ffb25ffb640 10 client.17553 handle_command_reply: tid=0 2024-09-13T17:20:58.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.306+0000 7ffb47c42740 1 client.17553 shutdown 2024-09-13T17:20:58.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.307+0000 7ffb47c42740 1 -- 172.21.15.87:0/2734829457 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56373851d0e0 msgr2=0x563738524650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:58.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.307+0000 7ffb47c42740 1 --2- 172.21.15.87:0/2734829457 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56373851d0e0 0x563738524650 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7ffb30010820 tx=0x7ffb30010ce0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.307+0000 7ffb47c42740 1 -- 172.21.15.87:0/2734829457 shutdown_connections 2024-09-13T17:20:58.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.307+0000 7ffb47c42740 1 --2- 172.21.15.87:0/2734829457 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x563738537650 0x563738539a70 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.307+0000 7ffb47c42740 1 --2- 172.21.15.87:0/2734829457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563738527980 0x563738524bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.307+0000 7ffb25ffb640 0 client.17553 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:20:58.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.307+0000 7ffb47c42740 1 --2- 172.21.15.87:0/2734829457 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56373851d0e0 0x563738524650 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.307+0000 7ffb47c42740 1 --2- 172.21.15.87:0/2734829457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56373851c7c0 0x5637385272e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.307+0000 7ffb47c42740 1 -- 172.21.15.87:0/2734829457 >> 172.21.15.87:0/2734829457 conn(0x563738518d50 msgr2=0x56373851e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:58.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.307+0000 7ffb47c42740 1 -- 172.21.15.87:0/2734829457 shutdown_connections 2024-09-13T17:20:58.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.307+0000 7ffb47c42740 1 -- 172.21.15.87:0/2734829457 wait complete. 2024-09-13T17:20:58.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.307+0000 7ffb47c42740 20 client.17553 trim_cache size 0 max 16384 2024-09-13T17:20:58.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.321+0000 7ffb47c42740 1 Processor -- start 2024-09-13T17:20:58.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.321+0000 7ffb47c42740 1 -- start start 2024-09-13T17:20:58.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.321+0000 7ffb47c42740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56373851c7c0 0x56373852e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.321+0000 7ffb47c42740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56373851d0e0 0x56373852eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.321+0000 7ffb47c42740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563738527980 0x563738522f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.321+0000 7ffb47c42740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637385256b0 con 0x56373851c7c0 2024-09-13T17:20:58.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.321+0000 7ffb47c42740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563738185890 con 0x56373851d0e0 2024-09-13T17:20:58.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.321+0000 7ffb47c42740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x563738535f00 con 0x563738527980 2024-09-13T17:20:58.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.321+0000 7ffb3dd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56373851c7c0 0x56373852e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:58.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.321+0000 7ffb3dd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56373851c7c0 0x56373852e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57210/0 (socket says 172.21.15.87:57210) 2024-09-13T17:20:58.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.321+0000 7ffb3dd9b640 1 -- 172.21.15.87:0/3588172321 learned_addr learned my addr 172.21.15.87:0/3588172321 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:58.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.321+0000 7ffb3e59c640 1 --2- 172.21.15.87:0/3588172321 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56373851d0e0 0x56373852eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:58.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.321+0000 7ffb3dd9b640 1 -- 172.21.15.87:0/3588172321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563738527980 msgr2=0x563738522f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:58.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.321+0000 7ffb3dd9b640 1 --2- 172.21.15.87:0/3588172321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563738527980 0x563738522f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.321+0000 7ffb3dd9b640 1 -- 172.21.15.87:0/3588172321 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56373851d0e0 msgr2=0x56373852eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:58.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.321+0000 7ffb3dd9b640 1 --2- 172.21.15.87:0/3588172321 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56373851d0e0 0x56373852eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.321+0000 7ffb3dd9b640 1 -- 172.21.15.87:0/3588172321 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637384211c0 con 0x56373851c7c0 2024-09-13T17:20:58.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.321+0000 7ffb3e59c640 1 --2- 172.21.15.87:0/3588172321 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56373851d0e0 0x56373852eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:58.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.321+0000 7ffb3dd9b640 1 --2- 172.21.15.87:0/3588172321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56373851c7c0 0x56373852e650 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7ffb34000c00 tx=0x7ffb3400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=665b8a876e5b12e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:58.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.321+0000 7ffb2d7fa640 1 -- 172.21.15.87:0/3588172321 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb34026070 con 0x56373851c7c0 2024-09-13T17:20:58.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.322+0000 7ffb2d7fa640 1 -- 172.21.15.87:0/3588172321 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffb34029b80 con 0x56373851c7c0 2024-09-13T17:20:58.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.322+0000 7ffb2d7fa640 1 -- 172.21.15.87:0/3588172321 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb34029890 con 0x56373851c7c0 2024-09-13T17:20:58.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.322+0000 7ffb47c42740 1 -- 172.21.15.87:0/3588172321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56373851c7c0 msgr2=0x56373852e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:58.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.322+0000 7ffb47c42740 1 --2- 172.21.15.87:0/3588172321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56373851c7c0 0x56373852e650 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7ffb34000c00 tx=0x7ffb3400bed0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.322+0000 7ffb47c42740 1 -- 172.21.15.87:0/3588172321 shutdown_connections 2024-09-13T17:20:58.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.322+0000 7ffb47c42740 1 --2- 172.21.15.87:0/3588172321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563738527980 0x563738522f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.322+0000 7ffb47c42740 1 --2- 172.21.15.87:0/3588172321 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56373851d0e0 0x56373852eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.322+0000 7ffb47c42740 1 --2- 172.21.15.87:0/3588172321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56373851c7c0 0x56373852e650 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.322+0000 7ffb47c42740 1 -- 172.21.15.87:0/3588172321 >> 172.21.15.87:0/3588172321 conn(0x563738518d50 msgr2=0x56373851f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:58.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.322+0000 7ffb47c42740 1 -- 172.21.15.87:0/3588172321 shutdown_connections 2024-09-13T17:20:58.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.322+0000 7ffb47c42740 1 -- 172.21.15.87:0/3588172321 wait complete. 2024-09-13T17:20:58.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.322+0000 7ffb47c42740 1 -- start start 2024-09-13T17:20:58.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.322+0000 7ffb47c42740 1 Processor -- start 2024-09-13T17:20:58.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.323+0000 7ffb47c42740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56373851c7c0 0x56373852d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.323+0000 7ffb47c42740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56373851d0e0 0x56373852dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.323+0000 7ffb47c42740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563738527980 0x56373858db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.323+0000 7ffb47c42740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56373852e4c0 con 0x56373851d0e0 2024-09-13T17:20:58.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.323+0000 7ffb47c42740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56373858e0d0 con 0x563738527980 2024-09-13T17:20:58.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.323+0000 7ffb47c42740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x56373858e290 con 0x56373851c7c0 2024-09-13T17:20:58.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.323+0000 7ffb47c42740 10 client.0 _ll_register_callbacks cb 0x7ffb3000a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:20:58.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.323+0000 7ffb3e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56373851d0e0 0x56373852dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:58.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.323+0000 7ffb3e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56373851d0e0 0x56373852dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57218/0 (socket says 172.21.15.87:57218) 2024-09-13T17:20:58.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.323+0000 7ffb3e59c640 1 -- 172.21.15.87:0/2934376119 learned_addr learned my addr 172.21.15.87:0/2934376119 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:58.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.323+0000 7ffb3dd9b640 1 --2- 172.21.15.87:0/2934376119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563738527980 0x56373858db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:58.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.323+0000 7ffb3dd9b640 1 --2- 172.21.15.87:0/2934376119 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56373851c7c0 0x56373852d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:58.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.323+0000 7ffb3e59c640 1 -- 172.21.15.87:0/2934376119 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56373851c7c0 msgr2=0x56373852d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:58.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.323+0000 7ffb3e59c640 1 --2- 172.21.15.87:0/2934376119 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56373851c7c0 0x56373852d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.323+0000 7ffb3e59c640 1 -- 172.21.15.87:0/2934376119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563738527980 msgr2=0x56373858db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:58.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.323+0000 7ffb3e59c640 1 --2- 172.21.15.87:0/2934376119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563738527980 0x56373858db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.323+0000 7ffb3e59c640 1 -- 172.21.15.87:0/2934376119 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56373843c970 con 0x56373851d0e0 2024-09-13T17:20:58.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.323+0000 7ffb3dd9b640 1 --2- 172.21.15.87:0/2934376119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563738527980 0x56373858db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:20:58.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.323+0000 7ffb3e59c640 1 --2- 172.21.15.87:0/2934376119 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56373851d0e0 0x56373852dd30 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7ffb30010820 tx=0x7ffb3000f870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a483f4c917eb5a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:58.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.323+0000 7ffb25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:20:58.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.323+0000 7ffb25ffb640 1 -- 172.21.15.87:0/2934376119 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb30015040 con 0x56373851d0e0 2024-09-13T17:20:58.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.323+0000 7ffb25ffb640 1 -- 172.21.15.87:0/2934376119 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7ffb30000e40 con 0x56373851d0e0 2024-09-13T17:20:58.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.323+0000 7ffb47c42740 1 -- 172.21.15.87:0/2934376119 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffb340044d0 con 0x56373851d0e0 2024-09-13T17:20:58.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.324+0000 7ffb25ffb640 1 -- 172.21.15.87:0/2934376119 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb30018990 con 0x56373851d0e0 2024-09-13T17:20:58.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.324+0000 7ffb47c42740 10 client.17559 fetch_fsmap learned FSMap version 36 2024-09-13T17:20:58.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.324+0000 7ffb47c42740 1 -- 172.21.15.87:0/2934376119 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x563738446990 con 0x56373851d0e0 2024-09-13T17:20:58.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.324+0000 7ffb25ffb640 1 -- 172.21.15.87:0/2934376119 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffb340044d0 con 0x56373851d0e0 2024-09-13T17:20:58.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.324+0000 7ffb25ffb640 1 -- 172.21.15.87:0/2934376119 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7ffb30021070 con 0x56373851d0e0 2024-09-13T17:20:58.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.324+0000 7ffb47c42740 10 client.17559 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:20:58.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.324+0000 7ffb47c42740 10 client.17559 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:20:58.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.324+0000 7ffb47c42740 20 client.17559 populate_metadata read hostname 'smithi087' 2024-09-13T17:20:58.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.324+0000 7ffb47c42740 1 --2- 172.21.15.87:0/2934376119 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x563738537650 0x563738591ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.324+0000 7ffb47c42740 4 client.17559 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-13T17:20:58.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.324+0000 7ffb47c42740 1 -- 172.21.15.87:0/2934376119 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5637381d8eb0 con 0x563738537650 2024-09-13T17:20:58.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.324+0000 7ffb3dd9b640 1 --2- 172.21.15.87:0/2934376119 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x563738537650 0x563738591ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:58.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.324+0000 7ffb25ffb640 10 client.17559 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:20:58.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.324+0000 7ffb3dd9b640 1 --2- 172.21.15.87:0/2934376119 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x563738537650 0x563738591ac0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5aaaaff80d642949 server_cookie=98e9da4fde527385 in_seq=0 out_seq=0 2024-09-13T17:20:58.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.326+0000 7ffb25ffb640 1 -- 172.21.15.87:0/2934376119 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5637381d8eb0 con 0x563738537650 2024-09-13T17:20:58.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.326+0000 7ffb25ffb640 10 client.17559 handle_command_reply: tid=0 2024-09-13T17:20:58.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.326+0000 7ffb47c42740 1 client.17559 shutdown 2024-09-13T17:20:58.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.326+0000 7ffb47c42740 1 -- 172.21.15.87:0/2934376119 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56373851d0e0 msgr2=0x56373852dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:58.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.326+0000 7ffb47c42740 1 --2- 172.21.15.87:0/2934376119 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56373851d0e0 0x56373852dd30 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7ffb30010820 tx=0x7ffb3000f870 comp rx=0 tx=0).stop 2024-09-13T17:20:58.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.326+0000 7ffb47c42740 1 -- 172.21.15.87:0/2934376119 shutdown_connections 2024-09-13T17:20:58.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.326+0000 7ffb47c42740 1 --2- 172.21.15.87:0/2934376119 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x563738537650 0x563738591ac0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.326+0000 7ffb47c42740 1 --2- 172.21.15.87:0/2934376119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563738527980 0x56373858db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.326+0000 7ffb47c42740 1 --2- 172.21.15.87:0/2934376119 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56373851d0e0 0x56373852dd30 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.326+0000 7ffb25ffb640 0 client.17559 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:20:58.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.326+0000 7ffb47c42740 1 --2- 172.21.15.87:0/2934376119 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56373851c7c0 0x56373852d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.326+0000 7ffb47c42740 1 -- 172.21.15.87:0/2934376119 >> 172.21.15.87:0/2934376119 conn(0x563738518d50 msgr2=0x563738522f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:58.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.326+0000 7ffb47c42740 1 -- 172.21.15.87:0/2934376119 shutdown_connections 2024-09-13T17:20:58.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.326+0000 7ffb47c42740 1 -- 172.21.15.87:0/2934376119 wait complete. 2024-09-13T17:20:58.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.326+0000 7ffb47c42740 20 client.17559 trim_cache size 0 max 16384 2024-09-13T17:20:58.334 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:20:58.335 INFO:teuthology.orchestra.run.smithi087.stdout: "return_code": 0, 2024-09-13T17:20:58.335 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_tag": "69951929-4c61-473b-8b3d-bbd6a50cec89", 2024-09-13T17:20:58.335 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": "asynchronous" 2024-09-13T17:20:58.335 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:20:58.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.326+0000 7ffb44e41640 1 -- 172.21.15.87:0/3230959629 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ffb280a1200 msgr2=0x7ffb280a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:58.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.326+0000 7ffb44e41640 1 --2- 172.21.15.87:0/3230959629 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ffb280a1200 0x7ffb280a36c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ffb380ebc20 tx=0x7ffb380b79b0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.326+0000 7ffb44e41640 1 -- 172.21.15.87:0/3230959629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb4019ab90 msgr2=0x7ffb4019b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:58.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.326+0000 7ffb44e41640 1 --2- 172.21.15.87:0/3230959629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb4019ab90 0x7ffb4019b040 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7ffb38005cc0 tx=0x7ffb38030850 comp rx=0 tx=0).stop 2024-09-13T17:20:58.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.326+0000 7ffb44e41640 1 -- 172.21.15.87:0/3230959629 shutdown_connections 2024-09-13T17:20:58.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.326+0000 7ffb44e41640 1 --2- 172.21.15.87:0/3230959629 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ffb280a1200 0x7ffb280a36c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.326+0000 7ffb44e41640 1 --2- 172.21.15.87:0/3230959629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb4019ab90 0x7ffb4019b040 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.326+0000 7ffb44e41640 1 --2- 172.21.15.87:0/3230959629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb401050e0 0x7ffb401967a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.326+0000 7ffb44e41640 1 --2- 172.21.15.87:0/3230959629 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb400fff90 0x7ffb40196260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.326+0000 7ffb44e41640 1 -- 172.21.15.87:0/3230959629 >> 172.21.15.87:0/3230959629 conn(0x7ffb400fba20 msgr2=0x7ffb400fcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:58.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.327+0000 7ffb44e41640 1 -- 172.21.15.87:0/3230959629 shutdown_connections 2024-09-13T17:20:58.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.327+0000 7ffb44e41640 1 -- 172.21.15.87:0/3230959629 wait complete. 2024-09-13T17:20:58.339 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:20:58.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.477+0000 7f4bb6e3d640 1 -- 172.21.15.87:0/2608839000 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4bb00ff830 msgr2=0x7f4bb0103870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:58.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.477+0000 7f4bb6e3d640 1 --2- 172.21.15.87:0/2608839000 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4bb00ff830 0x7f4bb0103870 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c009930 tx=0x7f4b9c02a420 comp rx=0 tx=0).stop 2024-09-13T17:20:58.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.477+0000 7f4bb6e3d640 1 -- 172.21.15.87:0/2608839000 shutdown_connections 2024-09-13T17:20:58.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.477+0000 7f4bb6e3d640 1 --2- 172.21.15.87:0/2608839000 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bb0103fd0 0x7f4bb010bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.477+0000 7f4bb6e3d640 1 --2- 172.21.15.87:0/2608839000 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4bb00ff830 0x7f4bb0103870 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.477+0000 7f4bb6e3d640 1 --2- 172.21.15.87:0/2608839000 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bb00fee80 0x7f4bb00ff260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.477+0000 7f4bb6e3d640 1 -- 172.21.15.87:0/2608839000 >> 172.21.15.87:0/2608839000 conn(0x7f4bb00fa930 msgr2=0x7f4bb00fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:58.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.477+0000 7f4bb6e3d640 1 -- 172.21.15.87:0/2608839000 shutdown_connections 2024-09-13T17:20:58.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.478+0000 7f4bb6e3d640 1 -- 172.21.15.87:0/2608839000 wait complete. 2024-09-13T17:20:58.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.478+0000 7f4bb6e3d640 1 Processor -- start 2024-09-13T17:20:58.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.478+0000 7f4bb6e3d640 1 -- start start 2024-09-13T17:20:58.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.478+0000 7f4bb6e3d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bb00fee80 0x7f4bb0100910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.478+0000 7f4bb6e3d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4bb0103fd0 0x7f4bb0100e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.478+0000 7f4bb6e3d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bb0101390 0x7f4bb01a4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.478+0000 7f4bb6e3d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb01a4b70 con 0x7f4bb0103fd0 2024-09-13T17:20:58.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.478+0000 7f4bb6e3d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb01a4ce0 con 0x7f4bb00fee80 2024-09-13T17:20:58.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.478+0000 7f4bb6e3d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb01a4ea0 con 0x7f4bb0101390 2024-09-13T17:20:58.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.478+0000 7f4baffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4bb0103fd0 0x7f4bb0100e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:58.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.478+0000 7f4baffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4bb0103fd0 0x7f4bb0100e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57244/0 (socket says 172.21.15.87:57244) 2024-09-13T17:20:58.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.478+0000 7f4baffff640 1 -- 172.21.15.87:0/1848405826 learned_addr learned my addr 172.21.15.87:0/1848405826 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:58.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.479+0000 7f4bb53da640 1 --2- 172.21.15.87:0/1848405826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bb0101390 0x7f4bb01a4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:58.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.479+0000 7f4bb4bd9640 1 --2- 172.21.15.87:0/1848405826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bb00fee80 0x7f4bb0100910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:58.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.479+0000 7f4baffff640 1 -- 172.21.15.87:0/1848405826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bb0101390 msgr2=0x7f4bb01a4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:58.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.479+0000 7f4baffff640 1 --2- 172.21.15.87:0/1848405826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bb0101390 0x7f4bb01a4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.479+0000 7f4baffff640 1 -- 172.21.15.87:0/1848405826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bb00fee80 msgr2=0x7f4bb0100910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:58.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.479+0000 7f4baffff640 1 --2- 172.21.15.87:0/1848405826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bb00fee80 0x7f4bb0100910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.479+0000 7f4baffff640 1 -- 172.21.15.87:0/1848405826 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9c009560 con 0x7f4bb0103fd0 2024-09-13T17:20:58.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.479+0000 7f4bb4bd9640 1 --2- 172.21.15.87:0/1848405826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bb00fee80 0x7f4bb0100910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:20:58.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.479+0000 7f4baffff640 1 --2- 172.21.15.87:0/1848405826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4bb0103fd0 0x7f4bb0100e50 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c02a940 tx=0x7f4b9c003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:58.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.479+0000 7f4badffb640 1 -- 172.21.15.87:0/1848405826 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c03b460 con 0x7f4bb0103fd0 2024-09-13T17:20:58.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.479+0000 7f4badffb640 1 -- 172.21.15.87:0/1848405826 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4b9c03ba70 con 0x7f4bb0103fd0 2024-09-13T17:20:58.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.479+0000 7f4bb6e3d640 1 -- 172.21.15.87:0/1848405826 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb01a5120 con 0x7f4bb0103fd0 2024-09-13T17:20:58.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.479+0000 7f4badffb640 1 -- 172.21.15.87:0/1848405826 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c031b00 con 0x7f4bb0103fd0 2024-09-13T17:20:58.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.479+0000 7f4bb6e3d640 1 -- 172.21.15.87:0/1848405826 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb01a55d0 con 0x7f4bb0103fd0 2024-09-13T17:20:58.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.481+0000 7f4badffb640 1 -- 172.21.15.87:0/1848405826 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f4b9c03bbe0 con 0x7f4bb0103fd0 2024-09-13T17:20:58.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.482+0000 7f4bb9c34740 1 Processor -- start 2024-09-13T17:20:58.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.482+0000 7f4bb9c34740 1 -- start start 2024-09-13T17:20:58.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.482+0000 7f4badffb640 1 --2- 172.21.15.87:0/1848405826 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4ba00a1200 0x7f4ba00a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.482+0000 7f4bb9c34740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557a5d14be10 0x557a5d14c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.482+0000 7f4bb9c34740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557a5d14c730 0x557a5d156a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.482+0000 7f4bb9c34740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a5d156fd0 0x557a5d1593c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.482+0000 7f4bb9c34740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a5d0b6f20 con 0x557a5d14be10 2024-09-13T17:20:58.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.482+0000 7f4bb9c34740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a5d0b46b0 con 0x557a5d156fd0 2024-09-13T17:20:58.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.482+0000 7f4bb9c34740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a5d0affa0 con 0x557a5d14c730 2024-09-13T17:20:58.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.482+0000 7f4badffb640 1 -- 172.21.15.87:0/1848405826 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f4b9c0ed900 con 0x7f4bb0103fd0 2024-09-13T17:20:58.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.482+0000 7f4bb53da640 1 --2- 172.21.15.87:0/1848405826 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4ba00a1200 0x7f4ba00a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:58.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.482+0000 7f4bb4bd9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557a5d14be10 0x557a5d14c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:58.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.482+0000 7f4bb4bd9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557a5d14be10 0x557a5d14c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57256/0 (socket says 172.21.15.87:57256) 2024-09-13T17:20:58.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.482+0000 7f4bb4bd9640 1 -- 172.21.15.87:0/1377410596 learned_addr learned my addr 172.21.15.87:0/1377410596 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:58.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.482+0000 7f4bb53da640 1 --2- 172.21.15.87:0/1377410596 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a5d156fd0 0x557a5d1593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:58.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.483+0000 7f4baffff640 1 --2- 172.21.15.87:0/1377410596 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557a5d14c730 0x557a5d156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:58.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.483+0000 7f4bb4bd9640 1 -- 172.21.15.87:0/1377410596 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557a5d14c730 msgr2=0x557a5d156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:58.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.483+0000 7f4bb4bd9640 1 --2- 172.21.15.87:0/1377410596 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557a5d14c730 0x557a5d156a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.483+0000 7f4bb4bd9640 1 -- 172.21.15.87:0/1377410596 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a5d156fd0 msgr2=0x557a5d1593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:58.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.483+0000 7f4bb4bd9640 1 --2- 172.21.15.87:0/1377410596 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a5d156fd0 0x557a5d1593c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.483+0000 7f4bb4bd9640 1 -- 172.21.15.87:0/1377410596 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a5d06a840 con 0x557a5d14be10 2024-09-13T17:20:58.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.483+0000 7f4bb53da640 1 --2- 172.21.15.87:0/1848405826 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4ba00a1200 0x7f4ba00a36c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8005fd0 tx=0x7f4ba8012ad0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:58.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.483+0000 7f4bb4bd9640 1 --2- 172.21.15.87:0/1377410596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557a5d14be10 0x557a5d14c1f0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4009d50 tx=0x7f4ba40117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ca92043347926b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:58.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.483+0000 7f4b9affd640 1 -- 172.21.15.87:0/1377410596 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4012650 con 0x557a5d14be10 2024-09-13T17:20:58.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.483+0000 7f4b9affd640 1 -- 172.21.15.87:0/1377410596 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4ba4009e40 con 0x557a5d14be10 2024-09-13T17:20:58.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.483+0000 7f4b9affd640 1 -- 172.21.15.87:0/1377410596 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba400faf0 con 0x557a5d14be10 2024-09-13T17:20:58.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.484+0000 7f4bb9c34740 1 -- 172.21.15.87:0/1377410596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557a5d14be10 msgr2=0x557a5d14c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:58.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.484+0000 7f4bb9c34740 1 --2- 172.21.15.87:0/1377410596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557a5d14be10 0x557a5d14c1f0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4009d50 tx=0x7f4ba40117b0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.484+0000 7f4bb9c34740 1 -- 172.21.15.87:0/1377410596 shutdown_connections 2024-09-13T17:20:58.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.484+0000 7f4bb9c34740 1 --2- 172.21.15.87:0/1377410596 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a5d156fd0 0x557a5d1593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.484+0000 7f4bb9c34740 1 --2- 172.21.15.87:0/1377410596 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557a5d14c730 0x557a5d156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.484+0000 7f4bb9c34740 1 --2- 172.21.15.87:0/1377410596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557a5d14be10 0x557a5d14c1f0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.484+0000 7f4bb9c34740 1 -- 172.21.15.87:0/1377410596 >> 172.21.15.87:0/1377410596 conn(0x557a5d148380 msgr2=0x557a5d148760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:58.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.484+0000 7f4bb9c34740 1 -- 172.21.15.87:0/1377410596 shutdown_connections 2024-09-13T17:20:58.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.484+0000 7f4bb9c34740 1 -- 172.21.15.87:0/1377410596 wait complete. 2024-09-13T17:20:58.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.484+0000 7f4bb9c34740 1 -- start start 2024-09-13T17:20:58.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.484+0000 7f4bb9c34740 1 Processor -- start 2024-09-13T17:20:58.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.484+0000 7f4bb9c34740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a5d14be10 0x557a5d156970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.484+0000 7f4bb9c34740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557a5d14c730 0x557a5d153c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.484+0000 7f4bb9c34740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557a5d156fd0 0x557a5d1541e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.484+0000 7f4bb9c34740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a5d0512a0 con 0x557a5d156fd0 2024-09-13T17:20:58.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.484+0000 7f4bb9c34740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a5cd88430 con 0x557a5d14be10 2024-09-13T17:20:58.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.485+0000 7f4bb9c34740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a5d033680 con 0x557a5d14c730 2024-09-13T17:20:58.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.485+0000 7f4bb9c34740 10 client.0 _ll_register_callbacks cb 0x557a5d0a9610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:20:58.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.485+0000 7f4bb53da640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557a5d156fd0 0x557a5d1541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:58.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.485+0000 7f4bb53da640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557a5d156fd0 0x557a5d1541e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57258/0 (socket says 172.21.15.87:57258) 2024-09-13T17:20:58.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.485+0000 7f4bb53da640 1 -- 172.21.15.87:0/1876415820 learned_addr learned my addr 172.21.15.87:0/1876415820 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:58.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.485+0000 7f4bb4bd9640 1 --2- 172.21.15.87:0/1876415820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a5d14be10 0x557a5d156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:58.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.485+0000 7f4baffff640 1 --2- 172.21.15.87:0/1876415820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557a5d14c730 0x557a5d153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:58.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.485+0000 7f4bb53da640 1 -- 172.21.15.87:0/1876415820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557a5d14c730 msgr2=0x557a5d153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:58.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.485+0000 7f4bb53da640 1 --2- 172.21.15.87:0/1876415820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557a5d14c730 0x557a5d153c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.485+0000 7f4bb53da640 1 -- 172.21.15.87:0/1876415820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a5d14be10 msgr2=0x557a5d156970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:58.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.485+0000 7f4bb53da640 1 --2- 172.21.15.87:0/1876415820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a5d14be10 0x557a5d156970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.485+0000 7f4bb53da640 1 -- 172.21.15.87:0/1876415820 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba4009980 con 0x557a5d156fd0 2024-09-13T17:20:58.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.485+0000 7f4bb53da640 1 --2- 172.21.15.87:0/1876415820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557a5d156fd0 0x557a5d1541e0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f4ba800eb20 tx=0x7f4ba8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef2534842aa48198 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:58.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.485+0000 7f4b8ffff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:20:58.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.485+0000 7f4b8ffff640 1 -- 172.21.15.87:0/1876415820 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba800fe10 con 0x557a5d156fd0 2024-09-13T17:20:58.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.485+0000 7f4b8ffff640 1 -- 172.21.15.87:0/1876415820 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f4ba801f3f0 con 0x557a5d156fd0 2024-09-13T17:20:58.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.485+0000 7f4bb9c34740 1 -- 172.21.15.87:0/1876415820 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557a5cda34e0 con 0x557a5d156fd0 2024-09-13T17:20:58.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.485+0000 7f4b8ffff640 1 -- 172.21.15.87:0/1876415820 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ba801f5b0 con 0x557a5d156fd0 2024-09-13T17:20:58.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.485+0000 7f4bb9c34740 10 client.17571 fetch_fsmap learned FSMap version 36 2024-09-13T17:20:58.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.485+0000 7f4bb9c34740 1 -- 172.21.15.87:0/1876415820 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x557a5d0ae620 con 0x557a5d156fd0 2024-09-13T17:20:58.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.486+0000 7f4b8ffff640 1 -- 172.21.15.87:0/1876415820 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x557a5cda34e0 con 0x557a5d156fd0 2024-09-13T17:20:58.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.486+0000 7f4b8ffff640 1 -- 172.21.15.87:0/1876415820 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f4ba8025020 con 0x557a5d156fd0 2024-09-13T17:20:58.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.486+0000 7f4bb9c34740 10 client.17571 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:20:58.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.486+0000 7f4bb9c34740 10 client.17571 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:20:58.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.486+0000 7f4bb9c34740 20 client.17571 populate_metadata read hostname 'smithi087' 2024-09-13T17:20:58.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.486+0000 7f4bb9c34740 1 --2- 172.21.15.87:0/1876415820 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x557a5d166d40 0x557a5d169160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.486+0000 7f4bb9c34740 4 client.17571 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:20:58.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.486+0000 7f4bb9c34740 1 -- 172.21.15.87:0/1876415820 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557a5cdb47e0 con 0x557a5d166d40 2024-09-13T17:20:58.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.486+0000 7f4bb4bd9640 1 --2- 172.21.15.87:0/1876415820 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x557a5d166d40 0x557a5d169160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:58.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.486+0000 7f4b8ffff640 10 client.17571 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:20:58.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.486+0000 7f4bb4bd9640 1 --2- 172.21.15.87:0/1876415820 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x557a5d166d40 0x557a5d169160 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ce77226ea51a5a2 server_cookie=9b45af9e8b054a21 in_seq=0 out_seq=0 2024-09-13T17:20:58.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.487+0000 7f4b8ffff640 1 -- 172.21.15.87:0/1876415820 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x557a5cdb47e0 con 0x557a5d166d40 2024-09-13T17:20:58.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.487+0000 7f4b8ffff640 10 client.17571 handle_command_reply: tid=0 2024-09-13T17:20:58.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.487+0000 7f4bb9c34740 1 client.17571 shutdown 2024-09-13T17:20:58.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.487+0000 7f4bb9c34740 1 -- 172.21.15.87:0/1876415820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557a5d156fd0 msgr2=0x557a5d1541e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:58.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.487+0000 7f4bb9c34740 1 --2- 172.21.15.87:0/1876415820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557a5d156fd0 0x557a5d1541e0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f4ba800eb20 tx=0x7f4ba8004ab0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.487+0000 7f4bb9c34740 1 -- 172.21.15.87:0/1876415820 shutdown_connections 2024-09-13T17:20:58.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.487+0000 7f4bb9c34740 1 --2- 172.21.15.87:0/1876415820 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x557a5d166d40 0x557a5d169160 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.487+0000 7f4bb9c34740 1 --2- 172.21.15.87:0/1876415820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557a5d156fd0 0x557a5d1541e0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.487+0000 7f4bb9c34740 1 --2- 172.21.15.87:0/1876415820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557a5d14c730 0x557a5d153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.487+0000 7f4b8ffff640 0 client.17571 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:20:58.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.487+0000 7f4bb9c34740 1 --2- 172.21.15.87:0/1876415820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a5d14be10 0x557a5d156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.487+0000 7f4bb9c34740 1 -- 172.21.15.87:0/1876415820 >> 172.21.15.87:0/1876415820 conn(0x557a5d148380 msgr2=0x557a5d14e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:58.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.488+0000 7f4bb9c34740 1 -- 172.21.15.87:0/1876415820 shutdown_connections 2024-09-13T17:20:58.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.488+0000 7f4bb9c34740 1 -- 172.21.15.87:0/1876415820 wait complete. 2024-09-13T17:20:58.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.488+0000 7f4bb9c34740 20 client.17571 trim_cache size 0 max 16384 2024-09-13T17:20:58.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.501+0000 7f4bb9c34740 1 Processor -- start 2024-09-13T17:20:58.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.501+0000 7f4bb9c34740 1 -- start start 2024-09-13T17:20:58.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.502+0000 7f4bb9c34740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557a5d14be10 0x557a5d147d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.502+0000 7f4bb9c34740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a5d14c730 0x557a5d15dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.502+0000 7f4bb9c34740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557a5d156fd0 0x557a5d15e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.502+0000 7f4bb9c34740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a5d14cdd0 con 0x557a5d14be10 2024-09-13T17:20:58.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.502+0000 7f4bb9c34740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a5d14bb90 con 0x557a5d14c730 2024-09-13T17:20:58.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.502+0000 7f4bb9c34740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a5d1633b0 con 0x557a5d156fd0 2024-09-13T17:20:58.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.502+0000 7f4bb4bd9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557a5d14be10 0x557a5d147d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:58.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.502+0000 7f4bb4bd9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557a5d14be10 0x557a5d147d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57260/0 (socket says 172.21.15.87:57260) 2024-09-13T17:20:58.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.502+0000 7f4bb4bd9640 1 -- 172.21.15.87:0/1712512083 learned_addr learned my addr 172.21.15.87:0/1712512083 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:58.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.502+0000 7f4bb53da640 1 --2- 172.21.15.87:0/1712512083 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557a5d156fd0 0x557a5d15e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:58.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.502+0000 7f4bb4bd9640 1 -- 172.21.15.87:0/1712512083 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557a5d156fd0 msgr2=0x557a5d15e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:58.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.502+0000 7f4bb4bd9640 1 --2- 172.21.15.87:0/1712512083 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557a5d156fd0 0x557a5d15e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.502+0000 7f4bb4bd9640 1 -- 172.21.15.87:0/1712512083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a5d14c730 msgr2=0x557a5d15dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:58.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.502+0000 7f4bb4bd9640 1 --2- 172.21.15.87:0/1712512083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a5d14c730 0x557a5d15dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.502+0000 7f4bb4bd9640 1 -- 172.21.15.87:0/1712512083 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a5d050790 con 0x557a5d14be10 2024-09-13T17:20:58.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.502+0000 7f4bb53da640 1 --2- 172.21.15.87:0/1712512083 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557a5d156fd0 0x557a5d15e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:20:58.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.502+0000 7f4bb4bd9640 1 --2- 172.21.15.87:0/1712512083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557a5d14be10 0x557a5d147d00 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4011cb0 tx=0x7f4ba40058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42cc47d057cd7d3d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:58.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.502+0000 7f4b9b7fe640 1 -- 172.21.15.87:0/1712512083 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4005240 con 0x557a5d14be10 2024-09-13T17:20:58.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.502+0000 7f4b9b7fe640 1 -- 172.21.15.87:0/1712512083 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4ba4028070 con 0x557a5d14be10 2024-09-13T17:20:58.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.502+0000 7f4b9b7fe640 1 -- 172.21.15.87:0/1712512083 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4028560 con 0x557a5d14be10 2024-09-13T17:20:58.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.503+0000 7f4bb9c34740 1 -- 172.21.15.87:0/1712512083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557a5d14be10 msgr2=0x557a5d147d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:58.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.503+0000 7f4bb9c34740 1 --2- 172.21.15.87:0/1712512083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557a5d14be10 0x557a5d147d00 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4011cb0 tx=0x7f4ba40058d0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.503+0000 7f4bb9c34740 1 -- 172.21.15.87:0/1712512083 shutdown_connections 2024-09-13T17:20:58.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.503+0000 7f4bb9c34740 1 --2- 172.21.15.87:0/1712512083 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557a5d156fd0 0x557a5d15e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.503+0000 7f4bb9c34740 1 --2- 172.21.15.87:0/1712512083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a5d14c730 0x557a5d15dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.503+0000 7f4bb9c34740 1 --2- 172.21.15.87:0/1712512083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557a5d14be10 0x557a5d147d00 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.503+0000 7f4bb9c34740 1 -- 172.21.15.87:0/1712512083 >> 172.21.15.87:0/1712512083 conn(0x557a5d148380 msgr2=0x557a5d14eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:58.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.503+0000 7f4bb9c34740 1 -- 172.21.15.87:0/1712512083 shutdown_connections 2024-09-13T17:20:58.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.503+0000 7f4bb9c34740 1 -- 172.21.15.87:0/1712512083 wait complete. 2024-09-13T17:20:58.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.503+0000 7f4bb9c34740 1 -- start start 2024-09-13T17:20:58.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.503+0000 7f4bb9c34740 1 Processor -- start 2024-09-13T17:20:58.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.504+0000 7f4bb9c34740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557a5d14be10 0x557a5d15e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.504+0000 7f4bb9c34740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557a5d14c730 0x557a5d15a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.504+0000 7f4bb9c34740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a5d156fd0 0x557a5d15a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.504+0000 7f4bb9c34740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a5d15aff0 con 0x557a5d14c730 2024-09-13T17:20:58.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.504+0000 7f4bb9c34740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a5d15b160 con 0x557a5d156fd0 2024-09-13T17:20:58.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.504+0000 7f4bb9c34740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a5d1bd240 con 0x557a5d14be10 2024-09-13T17:20:58.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.504+0000 7f4bb9c34740 10 client.0 _ll_register_callbacks cb 0x7f4ba800e7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:20:58.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.504+0000 7f4baffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557a5d14c730 0x557a5d15a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:58.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.504+0000 7f4baffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557a5d14c730 0x557a5d15a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57266/0 (socket says 172.21.15.87:57266) 2024-09-13T17:20:58.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.504+0000 7f4baffff640 1 -- 172.21.15.87:0/1941373863 learned_addr learned my addr 172.21.15.87:0/1941373863 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:20:58.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.504+0000 7f4bb4bd9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557a5d14be10 0x557a5d15e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:58.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.504+0000 7f4bb53da640 1 --2- 172.21.15.87:0/1941373863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a5d156fd0 0x557a5d15a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:58.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.504+0000 7f4baffff640 1 -- 172.21.15.87:0/1941373863 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557a5d14be10 msgr2=0x557a5d15e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:58.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.504+0000 7f4baffff640 1 --2- 172.21.15.87:0/1941373863 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557a5d14be10 0x557a5d15e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.504+0000 7f4baffff640 1 -- 172.21.15.87:0/1941373863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a5d156fd0 msgr2=0x557a5d15a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:20:58.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.504+0000 7f4baffff640 1 --2- 172.21.15.87:0/1941373863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a5d156fd0 0x557a5d15a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.504+0000 7f4baffff640 1 -- 172.21.15.87:0/1941373863 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557a5d06a840 con 0x557a5d14c730 2024-09-13T17:20:58.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.504+0000 7f4bb53da640 1 --2- 172.21.15.87:0/1941373863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a5d156fd0 0x557a5d15a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:20:58.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.504+0000 7f4baffff640 1 --2- 172.21.15.87:0/1941373863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557a5d14c730 0x557a5d15a3b0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c000c00 tx=0x7f4b9c0ba200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a182d8f524dac8ae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:20:58.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.504+0000 7f4b8ffff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:20:58.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.504+0000 7f4b8ffff640 1 -- 172.21.15.87:0/1941373863 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c0ba600 con 0x557a5d14c730 2024-09-13T17:20:58.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.504+0000 7f4b8ffff640 1 -- 172.21.15.87:0/1941373863 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f4b9c0be430 con 0x557a5d14c730 2024-09-13T17:20:58.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.504+0000 7f4bb9c34740 1 -- 172.21.15.87:0/1941373863 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4ba4009e40 con 0x557a5d14c730 2024-09-13T17:20:58.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.504+0000 7f4b8ffff640 1 -- 172.21.15.87:0/1941373863 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b9c0c2a80 con 0x557a5d14c730 2024-09-13T17:20:58.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.505+0000 7f4bb9c34740 10 client.17577 fetch_fsmap learned FSMap version 36 2024-09-13T17:20:58.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.505+0000 7f4bb9c34740 1 -- 172.21.15.87:0/1941373863 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x557a5d075ea0 con 0x557a5d14c730 2024-09-13T17:20:58.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.505+0000 7f4b8ffff640 1 -- 172.21.15.87:0/1941373863 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4ba4009e40 con 0x557a5d14c730 2024-09-13T17:20:58.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.505+0000 7f4b8ffff640 1 -- 172.21.15.87:0/1941373863 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f4b9c0b6d10 con 0x557a5d14c730 2024-09-13T17:20:58.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.505+0000 7f4bb9c34740 10 client.17577 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:20:58.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.505+0000 7f4bb9c34740 10 client.17577 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:20:58.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.505+0000 7f4bb9c34740 20 client.17577 populate_metadata read hostname 'smithi087' 2024-09-13T17:20:58.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.505+0000 7f4bb9c34740 1 --2- 172.21.15.87:0/1941373863 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x557a5d1be660 0x557a5d1c0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:20:58.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.505+0000 7f4bb9c34740 4 client.17577 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:20:58.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.505+0000 7f4bb9c34740 1 -- 172.21.15.87:0/1941373863 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557a5ce07e30 con 0x557a5d1be660 2024-09-13T17:20:58.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.505+0000 7f4bb4bd9640 1 --2- 172.21.15.87:0/1941373863 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x557a5d1be660 0x557a5d1c0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:20:58.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.505+0000 7f4b8ffff640 10 client.17577 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:20:58.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.505+0000 7f4bb4bd9640 1 --2- 172.21.15.87:0/1941373863 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x557a5d1be660 0x557a5d1c0a80 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a4d33809bae501c server_cookie=e2ab52d430ec27ec in_seq=0 out_seq=0 2024-09-13T17:20:58.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.506+0000 7f4b8ffff640 1 -- 172.21.15.87:0/1941373863 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x557a5ce07e30 con 0x557a5d1be660 2024-09-13T17:20:58.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.506+0000 7f4b8ffff640 10 client.17577 handle_command_reply: tid=0 2024-09-13T17:20:58.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.506+0000 7f4bb9c34740 1 client.17577 shutdown 2024-09-13T17:20:58.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.506+0000 7f4bb9c34740 1 -- 172.21.15.87:0/1941373863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557a5d14c730 msgr2=0x557a5d15a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:58.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.506+0000 7f4bb9c34740 1 --2- 172.21.15.87:0/1941373863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557a5d14c730 0x557a5d15a3b0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c000c00 tx=0x7f4b9c0ba200 comp rx=0 tx=0).stop 2024-09-13T17:20:58.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.506+0000 7f4bb9c34740 1 -- 172.21.15.87:0/1941373863 shutdown_connections 2024-09-13T17:20:58.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.506+0000 7f4bb9c34740 1 --2- 172.21.15.87:0/1941373863 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x557a5d1be660 0x557a5d1c0a80 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.506+0000 7f4bb9c34740 1 --2- 172.21.15.87:0/1941373863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a5d156fd0 0x557a5d15a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.506+0000 7f4b8ffff640 0 client.17577 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:20:58.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.506+0000 7f4bb9c34740 1 --2- 172.21.15.87:0/1941373863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557a5d14c730 0x557a5d15a3b0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.506+0000 7f4bb9c34740 1 --2- 172.21.15.87:0/1941373863 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557a5d14be10 0x557a5d15e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.506+0000 7f4bb9c34740 1 -- 172.21.15.87:0/1941373863 >> 172.21.15.87:0/1941373863 conn(0x557a5d148380 msgr2=0x557a5d152430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:58.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.506+0000 7f4bb9c34740 1 -- 172.21.15.87:0/1941373863 shutdown_connections 2024-09-13T17:20:58.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.506+0000 7f4bb9c34740 1 -- 172.21.15.87:0/1941373863 wait complete. 2024-09-13T17:20:58.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.506+0000 7f4bb9c34740 20 client.17577 trim_cache size 0 max 16384 2024-09-13T17:20:58.515 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:20:58.515 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-13T17:20:58.515 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": { 2024-09-13T17:20:58.516 INFO:teuthology.orchestra.run.smithi087.stdout: "69951929-4c61-473b-8b3d-bbd6a50cec89": { 2024-09-13T17:20:58.516 INFO:teuthology.orchestra.run.smithi087.stdout: "path": "/", 2024-09-13T17:20:58.516 INFO:teuthology.orchestra.run.smithi087.stdout: "tag": "69951929-4c61-473b-8b3d-bbd6a50cec89", 2024-09-13T17:20:58.516 INFO:teuthology.orchestra.run.smithi087.stdout: "options": "recursive,force" 2024-09-13T17:20:58.516 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:20:58.516 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:20:58.516 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:20:58.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.506+0000 7f4bb6e3d640 1 -- 172.21.15.87:0/1848405826 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4ba00a1200 msgr2=0x7f4ba00a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:58.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.506+0000 7f4bb6e3d640 1 --2- 172.21.15.87:0/1848405826 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4ba00a1200 0x7f4ba00a36c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8005fd0 tx=0x7f4ba8012ad0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.506+0000 7f4bb6e3d640 1 -- 172.21.15.87:0/1848405826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4bb0103fd0 msgr2=0x7f4bb0100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:20:58.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.506+0000 7f4bb6e3d640 1 --2- 172.21.15.87:0/1848405826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4bb0103fd0 0x7f4bb0100e50 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c02a940 tx=0x7f4b9c003c00 comp rx=0 tx=0).stop 2024-09-13T17:20:58.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.506+0000 7f4bb6e3d640 1 -- 172.21.15.87:0/1848405826 shutdown_connections 2024-09-13T17:20:58.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.506+0000 7f4bb6e3d640 1 --2- 172.21.15.87:0/1848405826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bb0101390 0x7f4bb01a4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.506+0000 7f4bb6e3d640 1 --2- 172.21.15.87:0/1848405826 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4ba00a1200 0x7f4ba00a36c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.507+0000 7f4bb6e3d640 1 --2- 172.21.15.87:0/1848405826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4bb0103fd0 0x7f4bb0100e50 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.507+0000 7f4bb6e3d640 1 --2- 172.21.15.87:0/1848405826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bb00fee80 0x7f4bb0100910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:20:58.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.507+0000 7f4bb6e3d640 1 -- 172.21.15.87:0/1848405826 >> 172.21.15.87:0/1848405826 conn(0x7f4bb00fa930 msgr2=0x7f4bb00688f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:20:58.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.507+0000 7f4bb6e3d640 1 -- 172.21.15.87:0/1848405826 shutdown_connections 2024-09-13T17:20:58.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:20:58.507+0000 7f4bb6e3d640 1 -- 172.21.15.87:0/1848405826 wait complete. 2024-09-13T17:20:58.519 INFO:tasks.cephfs.filesystem:scrub status for tag:69951929-4c61-473b-8b3d-bbd6a50cec89 - {'path': '/', 'tag': '69951929-4c61-473b-8b3d-bbd6a50cec89', 'options': 'recursive,force'} 2024-09-13T17:20:59.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:58 smithi149 ceph-mon[35496]: scrub queued for path: / 2024-09-13T17:20:59.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:58 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:20:59.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:58 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:20:59.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:58 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:20:59.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:58 smithi118 ceph-mon[34374]: scrub queued for path: / 2024-09-13T17:20:59.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:58 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:20:59.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:58 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:20:59.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:58 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:20:59.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:58 smithi087 ceph-mon[30934]: scrub queued for path: / 2024-09-13T17:20:59.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:58 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:20:59.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:58 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:20:59.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:58 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:21:00.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:59 smithi149 ceph-mon[35496]: pgmap v220: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:21:00.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:20:59 smithi149 ceph-mon[35496]: scrub summary: idle 2024-09-13T17:21:00.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:59 smithi118 ceph-mon[34374]: pgmap v220: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:21:00.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:20:59 smithi118 ceph-mon[34374]: scrub summary: idle 2024-09-13T17:21:00.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:59 smithi087 ceph-mon[30934]: pgmap v220: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:21:00.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:20:59 smithi087 ceph-mon[30934]: scrub summary: idle 2024-09-13T17:21:01.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:01 smithi149 ceph-mon[35496]: pgmap v221: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-09-13T17:21:01.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:01 smithi118 ceph-mon[34374]: pgmap v221: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-09-13T17:21:01.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:01 smithi087 ceph-mon[30934]: pgmap v221: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-09-13T17:21:02.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:02 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:21:02.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:02 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:21:02.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:02 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:21:02.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:02 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:21:02.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:02 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:21:02.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:02 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:21:02.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:02 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:21:02.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:02 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:21:02.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:02 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:21:02.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:02 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:21:02.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:02 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:21:02.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:02 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:21:03.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:03 smithi149 ceph-mon[35496]: pgmap v222: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-13T17:21:03.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:03 smithi118 ceph-mon[34374]: pgmap v222: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-13T17:21:03.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:03 smithi087 ceph-mon[30934]: pgmap v222: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-13T17:21:05.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:05 smithi149 ceph-mon[35496]: pgmap v223: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-09-13T17:21:05.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:05 smithi118 ceph-mon[34374]: pgmap v223: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-09-13T17:21:05.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:05 smithi087 ceph-mon[30934]: pgmap v223: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-09-13T17:21:07.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:07 smithi149 ceph-mon[35496]: pgmap v224: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-13T17:21:07.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:07 smithi118 ceph-mon[34374]: pgmap v224: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-13T17:21:07.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:07 smithi087 ceph-mon[30934]: pgmap v224: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-13T17:21:09.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:09 smithi149 ceph-mon[35496]: pgmap v225: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-13T17:21:09.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:09 smithi118 ceph-mon[34374]: pgmap v225: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-13T17:21:09.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:09 smithi087 ceph-mon[30934]: pgmap v225: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-13T17:21:11.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:11 smithi118 ceph-mon[34374]: osdmap e97: 12 total, 12 up, 12 in 2024-09-13T17:21:11.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:11 smithi118 ceph-mon[34374]: pgmap v227: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:21:11.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:11 smithi087 ceph-mon[30934]: osdmap e97: 12 total, 12 up, 12 in 2024-09-13T17:21:11.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:11 smithi087 ceph-mon[30934]: pgmap v227: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:21:12.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:11 smithi149 ceph-mon[35496]: osdmap e97: 12 total, 12 up, 12 in 2024-09-13T17:21:12.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:11 smithi149 ceph-mon[35496]: pgmap v227: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:21:13.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:13 smithi149 ceph-mon[35496]: pgmap v228: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:21:13.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:13 smithi118 ceph-mon[34374]: pgmap v228: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:21:13.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:13 smithi087 ceph-mon[30934]: pgmap v228: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:21:15.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:15 smithi149 ceph-mon[35496]: pgmap v229: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:21:15.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:15 smithi118 ceph-mon[34374]: pgmap v229: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:21:15.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:15 smithi087 ceph-mon[30934]: pgmap v229: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:21:17.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:17 smithi149 ceph-mon[35496]: pgmap v230: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:21:17.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:17 smithi118 ceph-mon[34374]: pgmap v230: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:21:17.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:17 smithi087 ceph-mon[30934]: pgmap v230: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:21:19.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:18 smithi087 ceph-mon[30934]: osdmap e98: 12 total, 12 up, 12 in 2024-09-13T17:21:19.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:18 smithi149 ceph-mon[35496]: osdmap e98: 12 total, 12 up, 12 in 2024-09-13T17:21:19.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:18 smithi118 ceph-mon[34374]: osdmap e98: 12 total, 12 up, 12 in 2024-09-13T17:21:20.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:19 smithi087 ceph-mon[30934]: pgmap v232: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 114 B/s wr, 4 op/s 2024-09-13T17:21:20.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:19 smithi149 ceph-mon[35496]: pgmap v232: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 114 B/s wr, 4 op/s 2024-09-13T17:21:20.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:19 smithi118 ceph-mon[34374]: pgmap v232: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 114 B/s wr, 4 op/s 2024-09-13T17:21:21.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:21 smithi149 ceph-mon[35496]: pgmap v233: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 8 op/s 2024-09-13T17:21:21.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:21 smithi118 ceph-mon[34374]: pgmap v233: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 8 op/s 2024-09-13T17:21:21.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:21 smithi087 ceph-mon[30934]: pgmap v233: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 8 op/s 2024-09-13T17:21:23.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:23 smithi149 ceph-mon[35496]: pgmap v234: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 8 op/s 2024-09-13T17:21:23.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:23 smithi118 ceph-mon[34374]: pgmap v234: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 8 op/s 2024-09-13T17:21:23.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:23 smithi087 ceph-mon[30934]: pgmap v234: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 8 op/s 2024-09-13T17:21:25.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:25 smithi149 ceph-mon[35496]: pgmap v235: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 8 op/s 2024-09-13T17:21:25.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:25 smithi118 ceph-mon[34374]: pgmap v235: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 8 op/s 2024-09-13T17:21:25.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:25 smithi087 ceph-mon[30934]: pgmap v235: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 8 op/s 2024-09-13T17:21:27.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:27 smithi149 ceph-mon[35496]: pgmap v236: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 8 op/s 2024-09-13T17:21:27.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:27 smithi118 ceph-mon[34374]: pgmap v236: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 8 op/s 2024-09-13T17:21:27.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:27 smithi087 ceph-mon[30934]: pgmap v236: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 8 op/s 2024-09-13T17:21:28.520 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:21:28.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.632+0000 7fd23b518640 1 -- 172.21.15.87:0/1825180661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2340fee50 msgr2=0x7fd2340ff230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:28.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.632+0000 7fd23b518640 1 --2- 172.21.15.87:0/1825180661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2340fee50 0x7fd2340ff230 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fd228009930 tx=0x7fd22802a420 comp rx=0 tx=0).stop 2024-09-13T17:21:28.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.632+0000 7fd23b518640 1 -- 172.21.15.87:0/1825180661 shutdown_connections 2024-09-13T17:21:28.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.632+0000 7fd23b518640 1 --2- 172.21.15.87:0/1825180661 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd234103fa0 0x7fd23410baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.632+0000 7fd23b518640 1 --2- 172.21.15.87:0/1825180661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2340ff800 0x7fd234103840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.632+0000 7fd23b518640 1 --2- 172.21.15.87:0/1825180661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2340fee50 0x7fd2340ff230 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.632+0000 7fd23b518640 1 -- 172.21.15.87:0/1825180661 >> 172.21.15.87:0/1825180661 conn(0x7fd2340fa8e0 msgr2=0x7fd2340fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:28.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.632+0000 7fd23b518640 1 -- 172.21.15.87:0/1825180661 shutdown_connections 2024-09-13T17:21:28.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.632+0000 7fd23b518640 1 -- 172.21.15.87:0/1825180661 wait complete. 2024-09-13T17:21:28.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.633+0000 7fd23b518640 1 Processor -- start 2024-09-13T17:21:28.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.633+0000 7fd23b518640 1 -- start start 2024-09-13T17:21:28.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.633+0000 7fd23b518640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2340fee50 0x7fd2341962f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:28.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.633+0000 7fd23b518640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd234103fa0 0x7fd234196830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:28.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.633+0000 7fd23b518640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd23419ac20 0x7fd23419b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:28.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.633+0000 7fd23b518640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23419b610 con 0x7fd23419ac20 2024-09-13T17:21:28.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.633+0000 7fd23b518640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23419b780 con 0x7fd234103fa0 2024-09-13T17:21:28.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.633+0000 7fd23b518640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23419b8f0 con 0x7fd2340fee50 2024-09-13T17:21:28.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.633+0000 7fd239ab5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd23419ac20 0x7fd23419b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:28.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.633+0000 7fd239ab5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd23419ac20 0x7fd23419b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37568/0 (socket says 172.21.15.87:37568) 2024-09-13T17:21:28.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.633+0000 7fd239ab5640 1 -- 172.21.15.87:0/4000752366 learned_addr learned my addr 172.21.15.87:0/4000752366 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:21:28.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.633+0000 7fd238ab3640 1 --2- 172.21.15.87:0/4000752366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd234103fa0 0x7fd234196830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:28.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.633+0000 7fd2392b4640 1 --2- 172.21.15.87:0/4000752366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2340fee50 0x7fd2341962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:28.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.633+0000 7fd239ab5640 1 -- 172.21.15.87:0/4000752366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2340fee50 msgr2=0x7fd2341962f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:28.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.633+0000 7fd239ab5640 1 --2- 172.21.15.87:0/4000752366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2340fee50 0x7fd2341962f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.633+0000 7fd239ab5640 1 -- 172.21.15.87:0/4000752366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd234103fa0 msgr2=0x7fd234196830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:28.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.633+0000 7fd239ab5640 1 --2- 172.21.15.87:0/4000752366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd234103fa0 0x7fd234196830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.633+0000 7fd239ab5640 1 -- 172.21.15.87:0/4000752366 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd228009560 con 0x7fd23419ac20 2024-09-13T17:21:28.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.634+0000 7fd239ab5640 1 --2- 172.21.15.87:0/4000752366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd23419ac20 0x7fd23419b0d0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fd22c00eaa0 tx=0x7fd22c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:28.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.634+0000 7fd2267fc640 1 -- 172.21.15.87:0/4000752366 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c00cdb0 con 0x7fd23419ac20 2024-09-13T17:21:28.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.634+0000 7fd2267fc640 1 -- 172.21.15.87:0/4000752366 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd22c005020 con 0x7fd23419ac20 2024-09-13T17:21:28.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.634+0000 7fd23b518640 1 -- 172.21.15.87:0/4000752366 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2341a2ed0 con 0x7fd23419ac20 2024-09-13T17:21:28.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.634+0000 7fd2267fc640 1 -- 172.21.15.87:0/4000752366 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c0116b0 con 0x7fd23419ac20 2024-09-13T17:21:28.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.634+0000 7fd23b518640 1 -- 172.21.15.87:0/4000752366 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2341a33a0 con 0x7fd23419ac20 2024-09-13T17:21:28.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.636+0000 7fd2267fc640 1 -- 172.21.15.87:0/4000752366 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fd22c005190 con 0x7fd23419ac20 2024-09-13T17:21:28.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.637+0000 7fd23e237740 1 Processor -- start 2024-09-13T17:21:28.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.637+0000 7fd23e237740 1 -- start start 2024-09-13T17:21:28.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.637+0000 7fd23e237740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc72b43e10 0x55fc72b441f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:28.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.637+0000 7fd23e237740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fc72b44730 0x55fc72b4ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:28.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.637+0000 7fd23e237740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc72b4efd0 0x55fc72b513c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:28.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.637+0000 7fd23e237740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc72aaef20 con 0x55fc72b4efd0 2024-09-13T17:21:28.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.637+0000 7fd23e237740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc72aac6b0 con 0x55fc72b44730 2024-09-13T17:21:28.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.637+0000 7fd23e237740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc72aa7fa0 con 0x55fc72b43e10 2024-09-13T17:21:28.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.637+0000 7fd238ab3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc72b4efd0 0x55fc72b513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:28.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.637+0000 7fd238ab3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc72b4efd0 0x55fc72b513c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37584/0 (socket says 172.21.15.87:37584) 2024-09-13T17:21:28.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.637+0000 7fd238ab3640 1 -- 172.21.15.87:0/3811976761 learned_addr learned my addr 172.21.15.87:0/3811976761 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:21:28.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.637+0000 7fd2267fc640 1 --2- 172.21.15.87:0/4000752366 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd2200a1280 0x7fd2200a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:28.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.637+0000 7fd238ab3640 1 --2- 172.21.15.87:0/3811976761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc72b43e10 0x55fc72b441f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:28.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.637+0000 7fd2392b4640 1 --2- 172.21.15.87:0/3811976761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fc72b44730 0x55fc72b4ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:28.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.637+0000 7fd239ab5640 1 --2- 172.21.15.87:0/4000752366 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd2200a1280 0x7fd2200a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:28.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.637+0000 7fd238ab3640 1 -- 172.21.15.87:0/3811976761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc72b43e10 msgr2=0x55fc72b441f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:28.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.637+0000 7fd238ab3640 1 --2- 172.21.15.87:0/3811976761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc72b43e10 0x55fc72b441f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.637+0000 7fd2267fc640 1 -- 172.21.15.87:0/4000752366 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fd22c0cd260 con 0x7fd23419ac20 2024-09-13T17:21:28.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.637+0000 7fd238ab3640 1 -- 172.21.15.87:0/3811976761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fc72b44730 msgr2=0x55fc72b4ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:28.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.637+0000 7fd238ab3640 1 --2- 172.21.15.87:0/3811976761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fc72b44730 0x55fc72b4ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.637+0000 7fd238ab3640 1 -- 172.21.15.87:0/3811976761 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc72a62840 con 0x55fc72b4efd0 2024-09-13T17:21:28.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.638+0000 7fd238ab3640 1 --2- 172.21.15.87:0/3811976761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc72b4efd0 0x55fc72b513c0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fd230014990 tx=0x7fd23000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0185d1abee42d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:28.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.638+0000 7fd21f7fe640 1 -- 172.21.15.87:0/3811976761 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2300142d0 con 0x55fc72b4efd0 2024-09-13T17:21:28.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.638+0000 7fd239ab5640 1 --2- 172.21.15.87:0/4000752366 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd2200a1280 0x7fd2200a3740 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd22c0ca650 tx=0x7fd22c06c040 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:28.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.638+0000 7fd21f7fe640 1 -- 172.21.15.87:0/3811976761 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd23001a020 con 0x55fc72b4efd0 2024-09-13T17:21:28.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.638+0000 7fd21f7fe640 1 -- 172.21.15.87:0/3811976761 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd230012820 con 0x55fc72b4efd0 2024-09-13T17:21:28.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.638+0000 7fd23e237740 1 -- 172.21.15.87:0/3811976761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc72b4efd0 msgr2=0x55fc72b513c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:28.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.638+0000 7fd23e237740 1 --2- 172.21.15.87:0/3811976761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc72b4efd0 0x55fc72b513c0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fd230014990 tx=0x7fd23000c490 comp rx=0 tx=0).stop 2024-09-13T17:21:28.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.639+0000 7fd23e237740 1 -- 172.21.15.87:0/3811976761 shutdown_connections 2024-09-13T17:21:28.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.639+0000 7fd23e237740 1 --2- 172.21.15.87:0/3811976761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc72b4efd0 0x55fc72b513c0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.639+0000 7fd23e237740 1 --2- 172.21.15.87:0/3811976761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fc72b44730 0x55fc72b4ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.639+0000 7fd23e237740 1 --2- 172.21.15.87:0/3811976761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc72b43e10 0x55fc72b441f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.639+0000 7fd23e237740 1 -- 172.21.15.87:0/3811976761 >> 172.21.15.87:0/3811976761 conn(0x55fc72b40380 msgr2=0x55fc72b40760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:28.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.639+0000 7fd23e237740 1 -- 172.21.15.87:0/3811976761 shutdown_connections 2024-09-13T17:21:28.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.639+0000 7fd23e237740 1 -- 172.21.15.87:0/3811976761 wait complete. 2024-09-13T17:21:28.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.639+0000 7fd23e237740 1 -- start start 2024-09-13T17:21:28.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.639+0000 7fd23e237740 1 Processor -- start 2024-09-13T17:21:28.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.639+0000 7fd23e237740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc72b43e10 0x55fc72b4ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:28.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.639+0000 7fd23e237740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc72b44730 0x55fc72b4bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:28.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.639+0000 7fd23e237740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fc72b4efd0 0x55fc72b4c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:28.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.639+0000 7fd23e237740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc72a492a0 con 0x55fc72b43e10 2024-09-13T17:21:28.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.639+0000 7fd23e237740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc72780430 con 0x55fc72b4efd0 2024-09-13T17:21:28.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.639+0000 7fd23e237740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc72a2b680 con 0x55fc72b44730 2024-09-13T17:21:28.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.640+0000 7fd23e237740 10 client.0 _ll_register_callbacks cb 0x55fc72aa1610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:21:28.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.640+0000 7fd238ab3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc72b43e10 0x55fc72b4ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:28.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.640+0000 7fd238ab3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc72b43e10 0x55fc72b4ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37596/0 (socket says 172.21.15.87:37596) 2024-09-13T17:21:28.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.640+0000 7fd238ab3640 1 -- 172.21.15.87:0/920343226 learned_addr learned my addr 172.21.15.87:0/920343226 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:21:28.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.640+0000 7fd238ab3640 1 --2- 172.21.15.87:0/920343226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fc72b4efd0 0x55fc72b4c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:28.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.640+0000 7fd2392b4640 1 --2- 172.21.15.87:0/920343226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc72b44730 0x55fc72b4bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:28.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.640+0000 7fd238ab3640 1 -- 172.21.15.87:0/920343226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc72b44730 msgr2=0x55fc72b4bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:28.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.640+0000 7fd238ab3640 1 --2- 172.21.15.87:0/920343226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc72b44730 0x55fc72b4bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.640+0000 7fd238ab3640 1 -- 172.21.15.87:0/920343226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fc72b4efd0 msgr2=0x55fc72b4c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:28.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.640+0000 7fd238ab3640 1 --2- 172.21.15.87:0/920343226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fc72b4efd0 0x55fc72b4c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.640+0000 7fd238ab3640 1 -- 172.21.15.87:0/920343226 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd230014640 con 0x55fc72b43e10 2024-09-13T17:21:28.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.640+0000 7fd238ab3640 1 --2- 172.21.15.87:0/920343226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc72b43e10 0x55fc72b4ea00 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fd2300145a0 tx=0x7fd23000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e26b5f2864c102d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:28.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.640+0000 7fd21cff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:21:28.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.640+0000 7fd21cff9640 1 -- 172.21.15.87:0/920343226 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2300042f0 con 0x55fc72b43e10 2024-09-13T17:21:28.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.640+0000 7fd21cff9640 1 -- 172.21.15.87:0/920343226 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fd23001b030 con 0x55fc72b43e10 2024-09-13T17:21:28.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.640+0000 7fd23e237740 1 -- 172.21.15.87:0/920343226 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fc7279b4e0 con 0x55fc72b43e10 2024-09-13T17:21:28.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.640+0000 7fd21cff9640 1 -- 172.21.15.87:0/920343226 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd230004450 con 0x55fc72b43e10 2024-09-13T17:21:28.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.640+0000 7fd23e237740 10 client.17589 fetch_fsmap learned FSMap version 36 2024-09-13T17:21:28.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.640+0000 7fd23e237740 1 -- 172.21.15.87:0/920343226 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55fc72aa6620 con 0x55fc72b43e10 2024-09-13T17:21:28.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.641+0000 7fd21cff9640 1 -- 172.21.15.87:0/920343226 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55fc7279b4e0 con 0x55fc72b43e10 2024-09-13T17:21:28.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.641+0000 7fd21cff9640 1 -- 172.21.15.87:0/920343226 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd230003b20 con 0x55fc72b43e10 2024-09-13T17:21:28.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.641+0000 7fd23e237740 10 client.17589 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:21:28.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.641+0000 7fd23e237740 10 client.17589 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:21:28.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.641+0000 7fd23e237740 20 client.17589 populate_metadata read hostname 'smithi087' 2024-09-13T17:21:28.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.641+0000 7fd23e237740 1 --2- 172.21.15.87:0/920343226 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55fc72b5ec60 0x55fc72b61050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:28.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.641+0000 7fd23e237740 4 client.17589 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:21:28.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.641+0000 7fd23e237740 1 -- 172.21.15.87:0/920343226 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fc727ac7e0 con 0x55fc72b5ec60 2024-09-13T17:21:28.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.641+0000 7fd2392b4640 1 --2- 172.21.15.87:0/920343226 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55fc72b5ec60 0x55fc72b61050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:28.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.642+0000 7fd2392b4640 1 --2- 172.21.15.87:0/920343226 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55fc72b5ec60 0x55fc72b61050 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d83f585c6c8a4e8b server_cookie=f3a39d81a6e897fb in_seq=0 out_seq=0 2024-09-13T17:21:28.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.642+0000 7fd21cff9640 10 client.17589 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:21:28.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.642+0000 7fd21cff9640 1 -- 172.21.15.87:0/920343226 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55fc727ac7e0 con 0x55fc72b5ec60 2024-09-13T17:21:28.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.642+0000 7fd21cff9640 10 client.17589 handle_command_reply: tid=0 2024-09-13T17:21:28.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.642+0000 7fd23e237740 1 client.17589 shutdown 2024-09-13T17:21:28.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.642+0000 7fd23e237740 1 -- 172.21.15.87:0/920343226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc72b43e10 msgr2=0x55fc72b4ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:28.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.642+0000 7fd23e237740 1 --2- 172.21.15.87:0/920343226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc72b43e10 0x55fc72b4ea00 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fd2300145a0 tx=0x7fd23000cca0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.642+0000 7fd23e237740 1 -- 172.21.15.87:0/920343226 shutdown_connections 2024-09-13T17:21:28.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.642+0000 7fd23e237740 1 --2- 172.21.15.87:0/920343226 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55fc72b5ec60 0x55fc72b61050 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.642+0000 7fd23e237740 1 --2- 172.21.15.87:0/920343226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fc72b4efd0 0x55fc72b4c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.642+0000 7fd23e237740 1 --2- 172.21.15.87:0/920343226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc72b44730 0x55fc72b4bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.642+0000 7fd21cff9640 0 client.17589 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:21:28.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.642+0000 7fd23e237740 1 --2- 172.21.15.87:0/920343226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc72b43e10 0x55fc72b4ea00 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.642+0000 7fd23e237740 1 -- 172.21.15.87:0/920343226 >> 172.21.15.87:0/920343226 conn(0x55fc72b40380 msgr2=0x55fc72b46090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:28.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.643+0000 7fd23e237740 1 -- 172.21.15.87:0/920343226 shutdown_connections 2024-09-13T17:21:28.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.643+0000 7fd23e237740 1 -- 172.21.15.87:0/920343226 wait complete. 2024-09-13T17:21:28.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.643+0000 7fd23e237740 20 client.17589 trim_cache size 0 max 16384 2024-09-13T17:21:28.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.657+0000 7fd23e237740 1 Processor -- start 2024-09-13T17:21:28.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.657+0000 7fd23e237740 1 -- start start 2024-09-13T17:21:28.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.657+0000 7fd23e237740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc72b43e10 0x55fc72b55d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:28.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.657+0000 7fd23e237740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc72b44730 0x55fc72b56270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:28.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.657+0000 7fd23e237740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fc72b4efd0 0x55fc72b4e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:28.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.657+0000 7fd23e237740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc72b43b90 con 0x55fc72b43e10 2024-09-13T17:21:28.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.657+0000 7fd23e237740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc72b3e9c0 con 0x55fc72b4efd0 2024-09-13T17:21:28.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.657+0000 7fd23e237740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc72b66200 con 0x55fc72b44730 2024-09-13T17:21:28.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.657+0000 7fd238ab3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc72b43e10 0x55fc72b55d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:28.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.657+0000 7fd238ab3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc72b43e10 0x55fc72b55d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37612/0 (socket says 172.21.15.87:37612) 2024-09-13T17:21:28.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.657+0000 7fd238ab3640 1 -- 172.21.15.87:0/500947328 learned_addr learned my addr 172.21.15.87:0/500947328 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:21:28.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.657+0000 7fd2392b4640 1 --2- 172.21.15.87:0/500947328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc72b44730 0x55fc72b56270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:28.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.657+0000 7fd238ab3640 1 -- 172.21.15.87:0/500947328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc72b44730 msgr2=0x55fc72b56270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:28.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.657+0000 7fd238ab3640 1 --2- 172.21.15.87:0/500947328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc72b44730 0x55fc72b56270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.657+0000 7fd238ab3640 1 -- 172.21.15.87:0/500947328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fc72b4efd0 msgr2=0x55fc72b4e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:28.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.657+0000 7fd238ab3640 1 --2- 172.21.15.87:0/500947328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fc72b4efd0 0x55fc72b4e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.657+0000 7fd238ab3640 1 -- 172.21.15.87:0/500947328 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc72a48790 con 0x55fc72b43e10 2024-09-13T17:21:28.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.658+0000 7fd238ab3640 1 --2- 172.21.15.87:0/500947328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc72b43e10 0x55fc72b55d30 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fd230014570 tx=0x7fd23000c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa507edd8c6ed29 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:28.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.658+0000 7fd21ffff640 1 -- 172.21.15.87:0/500947328 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd230014860 con 0x55fc72b43e10 2024-09-13T17:21:28.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.658+0000 7fd21ffff640 1 -- 172.21.15.87:0/500947328 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd230027070 con 0x55fc72b43e10 2024-09-13T17:21:28.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.658+0000 7fd21ffff640 1 -- 172.21.15.87:0/500947328 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23000fc50 con 0x55fc72b43e10 2024-09-13T17:21:28.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.658+0000 7fd23e237740 1 -- 172.21.15.87:0/500947328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc72b43e10 msgr2=0x55fc72b55d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:28.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.658+0000 7fd23e237740 1 --2- 172.21.15.87:0/500947328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc72b43e10 0x55fc72b55d30 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fd230014570 tx=0x7fd23000c410 comp rx=0 tx=0).stop 2024-09-13T17:21:28.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.658+0000 7fd23e237740 1 -- 172.21.15.87:0/500947328 shutdown_connections 2024-09-13T17:21:28.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.658+0000 7fd23e237740 1 --2- 172.21.15.87:0/500947328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fc72b4efd0 0x55fc72b4e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.658+0000 7fd23e237740 1 --2- 172.21.15.87:0/500947328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc72b44730 0x55fc72b56270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.658+0000 7fd23e237740 1 --2- 172.21.15.87:0/500947328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc72b43e10 0x55fc72b55d30 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.658+0000 7fd23e237740 1 -- 172.21.15.87:0/500947328 >> 172.21.15.87:0/500947328 conn(0x55fc72b40380 msgr2=0x55fc72b46fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:28.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.658+0000 7fd23e237740 1 -- 172.21.15.87:0/500947328 shutdown_connections 2024-09-13T17:21:28.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.658+0000 7fd23e237740 1 -- 172.21.15.87:0/500947328 wait complete. 2024-09-13T17:21:28.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.659+0000 7fd23e237740 1 -- start start 2024-09-13T17:21:28.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.659+0000 7fd23e237740 1 Processor -- start 2024-09-13T17:21:28.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.659+0000 7fd23e237740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fc72b43e10 0x55fc72b51d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:28.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.659+0000 7fd23e237740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc72b44730 0x55fc72b52250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:28.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.659+0000 7fd23e237740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc72b4efd0 0x55fc72b52790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:28.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.659+0000 7fd23e237740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc72bb40c0 con 0x55fc72b4efd0 2024-09-13T17:21:28.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.659+0000 7fd23e237740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc72bb4200 con 0x55fc72b43e10 2024-09-13T17:21:28.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.659+0000 7fd23e237740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc72bb4340 con 0x55fc72b44730 2024-09-13T17:21:28.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.659+0000 7fd23e237740 10 client.0 _ll_register_callbacks cb 0x7fd228009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:21:28.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.659+0000 7fd238ab3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc72b4efd0 0x55fc72b52790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:28.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.659+0000 7fd238ab3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc72b4efd0 0x55fc72b52790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37616/0 (socket says 172.21.15.87:37616) 2024-09-13T17:21:28.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.659+0000 7fd238ab3640 1 -- 172.21.15.87:0/1808398479 learned_addr learned my addr 172.21.15.87:0/1808398479 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:21:28.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.659+0000 7fd238ab3640 1 --2- 172.21.15.87:0/1808398479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fc72b43e10 0x55fc72b51d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:28.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.659+0000 7fd2392b4640 1 --2- 172.21.15.87:0/1808398479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc72b44730 0x55fc72b52250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:28.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.659+0000 7fd238ab3640 1 -- 172.21.15.87:0/1808398479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc72b44730 msgr2=0x55fc72b52250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:28.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.659+0000 7fd238ab3640 1 --2- 172.21.15.87:0/1808398479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc72b44730 0x55fc72b52250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.660+0000 7fd238ab3640 1 -- 172.21.15.87:0/1808398479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fc72b43e10 msgr2=0x55fc72b51d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:28.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.660+0000 7fd238ab3640 1 --2- 172.21.15.87:0/1808398479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fc72b43e10 0x55fc72b51d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.660+0000 7fd238ab3640 1 -- 172.21.15.87:0/1808398479 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fc72aa6620 con 0x55fc72b4efd0 2024-09-13T17:21:28.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.660+0000 7fd238ab3640 1 --2- 172.21.15.87:0/1808398479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc72b4efd0 0x55fc72b52790 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fd23000cf20 tx=0x7fd23001f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b625baa1f56ca78 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:28.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.660+0000 7fd21cff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:21:28.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.660+0000 7fd21cff9640 1 -- 172.21.15.87:0/1808398479 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2300042f0 con 0x55fc72b4efd0 2024-09-13T17:21:28.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.660+0000 7fd21cff9640 1 -- 172.21.15.87:0/1808398479 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fd230000e40 con 0x55fc72b4efd0 2024-09-13T17:21:28.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.660+0000 7fd23e237740 1 -- 172.21.15.87:0/1808398479 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd23001a020 con 0x55fc72b4efd0 2024-09-13T17:21:28.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.660+0000 7fd21cff9640 1 -- 172.21.15.87:0/1808398479 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2300126c0 con 0x55fc72b4efd0 2024-09-13T17:21:28.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.660+0000 7fd23e237740 10 client.17595 fetch_fsmap learned FSMap version 36 2024-09-13T17:21:28.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.660+0000 7fd23e237740 1 -- 172.21.15.87:0/1808398479 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55fc72a6dea0 con 0x55fc72b4efd0 2024-09-13T17:21:28.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.660+0000 7fd21cff9640 1 -- 172.21.15.87:0/1808398479 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd23001a020 con 0x55fc72b4efd0 2024-09-13T17:21:28.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.660+0000 7fd21cff9640 1 -- 172.21.15.87:0/1808398479 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd23001fc80 con 0x55fc72b4efd0 2024-09-13T17:21:28.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.660+0000 7fd23e237740 10 client.17595 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:21:28.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.660+0000 7fd23e237740 10 client.17595 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:21:28.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.660+0000 7fd23e237740 20 client.17595 populate_metadata read hostname 'smithi087' 2024-09-13T17:21:28.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.660+0000 7fd23e237740 1 --2- 172.21.15.87:0/1808398479 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55fc72b5ec60 0x55fc72bb75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:28.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.660+0000 7fd23e237740 4 client.17595 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:21:28.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.660+0000 7fd23e237740 1 -- 172.21.15.87:0/1808398479 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55fc727ffe30 con 0x55fc72b5ec60 2024-09-13T17:21:28.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.661+0000 7fd2392b4640 1 --2- 172.21.15.87:0/1808398479 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55fc72b5ec60 0x55fc72bb75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:28.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.661+0000 7fd21cff9640 10 client.17595 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:21:28.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.661+0000 7fd2392b4640 1 --2- 172.21.15.87:0/1808398479 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55fc72b5ec60 0x55fc72bb75b0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e2bbd825a9f524b server_cookie=e7208e7a78559e20 in_seq=0 out_seq=0 2024-09-13T17:21:28.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.661+0000 7fd21cff9640 1 -- 172.21.15.87:0/1808398479 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55fc727ffe30 con 0x55fc72b5ec60 2024-09-13T17:21:28.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.661+0000 7fd21cff9640 10 client.17595 handle_command_reply: tid=0 2024-09-13T17:21:28.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.661+0000 7fd23e237740 1 client.17595 shutdown 2024-09-13T17:21:28.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.661+0000 7fd23e237740 1 -- 172.21.15.87:0/1808398479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc72b4efd0 msgr2=0x55fc72b52790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:28.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.661+0000 7fd23e237740 1 --2- 172.21.15.87:0/1808398479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc72b4efd0 0x55fc72b52790 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fd23000cf20 tx=0x7fd23001f520 comp rx=0 tx=0).stop 2024-09-13T17:21:28.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.661+0000 7fd23e237740 1 -- 172.21.15.87:0/1808398479 shutdown_connections 2024-09-13T17:21:28.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.661+0000 7fd23e237740 1 --2- 172.21.15.87:0/1808398479 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55fc72b5ec60 0x55fc72bb75b0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.661+0000 7fd23e237740 1 --2- 172.21.15.87:0/1808398479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc72b4efd0 0x55fc72b52790 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.661+0000 7fd23e237740 1 --2- 172.21.15.87:0/1808398479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fc72b44730 0x55fc72b52250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.661+0000 7fd21cff9640 0 client.17595 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:21:28.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.661+0000 7fd23e237740 1 --2- 172.21.15.87:0/1808398479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fc72b43e10 0x55fc72b51d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.661+0000 7fd23e237740 1 -- 172.21.15.87:0/1808398479 >> 172.21.15.87:0/1808398479 conn(0x55fc72b40380 msgr2=0x55fc72b4b260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:28.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.661+0000 7fd23e237740 1 -- 172.21.15.87:0/1808398479 shutdown_connections 2024-09-13T17:21:28.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.661+0000 7fd23e237740 1 -- 172.21.15.87:0/1808398479 wait complete. 2024-09-13T17:21:28.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.662+0000 7fd23e237740 20 client.17595 trim_cache size 0 max 16384 2024-09-13T17:21:28.671 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:21:28.671 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "no active scrubs running", 2024-09-13T17:21:28.671 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": {} 2024-09-13T17:21:28.671 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:21:28.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.662+0000 7fd23b518640 1 -- 172.21.15.87:0/4000752366 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd2200a1280 msgr2=0x7fd2200a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:28.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.662+0000 7fd23b518640 1 --2- 172.21.15.87:0/4000752366 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd2200a1280 0x7fd2200a3740 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd22c0ca650 tx=0x7fd22c06c040 comp rx=0 tx=0).stop 2024-09-13T17:21:28.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.662+0000 7fd23b518640 1 -- 172.21.15.87:0/4000752366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd23419ac20 msgr2=0x7fd23419b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:28.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.662+0000 7fd23b518640 1 --2- 172.21.15.87:0/4000752366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd23419ac20 0x7fd23419b0d0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fd22c00eaa0 tx=0x7fd22c00ef60 comp rx=0 tx=0).stop 2024-09-13T17:21:28.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.662+0000 7fd23b518640 1 -- 172.21.15.87:0/4000752366 shutdown_connections 2024-09-13T17:21:28.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.662+0000 7fd23b518640 1 --2- 172.21.15.87:0/4000752366 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd2200a1280 0x7fd2200a3740 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.662+0000 7fd23b518640 1 --2- 172.21.15.87:0/4000752366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd23419ac20 0x7fd23419b0d0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.662+0000 7fd23b518640 1 --2- 172.21.15.87:0/4000752366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd234103fa0 0x7fd234196830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.662+0000 7fd23b518640 1 --2- 172.21.15.87:0/4000752366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2340fee50 0x7fd2341962f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.662+0000 7fd23b518640 1 -- 172.21.15.87:0/4000752366 >> 172.21.15.87:0/4000752366 conn(0x7fd2340fa8e0 msgr2=0x7fd2340688f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:28.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.662+0000 7fd23b518640 1 -- 172.21.15.87:0/4000752366 shutdown_connections 2024-09-13T17:21:28.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.662+0000 7fd23b518640 1 -- 172.21.15.87:0/4000752366 wait complete. 2024-09-13T17:21:28.674 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T17:21:28.674 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:21:28.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.772+0000 7f0b8a325640 1 -- 172.21.15.87:0/1939580907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b840ff830 msgr2=0x7f0b84103870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:28.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.772+0000 7f0b8a325640 1 --2- 172.21.15.87:0/1939580907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b840ff830 0x7f0b84103870 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c009930 tx=0x7f0b6c02a420 comp rx=0 tx=0).stop 2024-09-13T17:21:28.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.772+0000 7f0b8a325640 1 -- 172.21.15.87:0/1939580907 shutdown_connections 2024-09-13T17:21:28.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.772+0000 7f0b8a325640 1 --2- 172.21.15.87:0/1939580907 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b84103fd0 0x7f0b8410bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.772+0000 7f0b8a325640 1 --2- 172.21.15.87:0/1939580907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b840ff830 0x7f0b84103870 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.772+0000 7f0b8a325640 1 --2- 172.21.15.87:0/1939580907 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b840fee80 0x7f0b840ff260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.772+0000 7f0b8a325640 1 -- 172.21.15.87:0/1939580907 >> 172.21.15.87:0/1939580907 conn(0x7f0b84075c60 msgr2=0x7f0b840fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:28.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.772+0000 7f0b8a325640 1 -- 172.21.15.87:0/1939580907 shutdown_connections 2024-09-13T17:21:28.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.772+0000 7f0b8a325640 1 -- 172.21.15.87:0/1939580907 wait complete. 2024-09-13T17:21:28.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.772+0000 7f0b8a325640 1 Processor -- start 2024-09-13T17:21:28.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.772+0000 7f0b8a325640 1 -- start start 2024-09-13T17:21:28.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.773+0000 7f0b8a325640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b840fee80 0x7f0b8410c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:28.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.773+0000 7f0b8a325640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b84103fd0 0x7f0b8410c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:28.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.773+0000 7f0b8a325640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b8410ceb0 0x7f0b841a4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:28.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.773+0000 7f0b8a325640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b841a49f0 con 0x7f0b84103fd0 2024-09-13T17:21:28.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.773+0000 7f0b8a325640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b841a4b60 con 0x7f0b840fee80 2024-09-13T17:21:28.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.773+0000 7f0b8a325640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b841a4d20 con 0x7f0b8410ceb0 2024-09-13T17:21:28.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.773+0000 7f0b837fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b84103fd0 0x7f0b8410c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:28.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.773+0000 7f0b837fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b84103fd0 0x7f0b8410c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37638/0 (socket says 172.21.15.87:37638) 2024-09-13T17:21:28.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.773+0000 7f0b837fe640 1 -- 172.21.15.87:0/58008422 learned_addr learned my addr 172.21.15.87:0/58008422 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:21:28.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.773+0000 7f0b83fff640 1 --2- 172.21.15.87:0/58008422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b840fee80 0x7f0b8410c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:28.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.773+0000 7f0b837fe640 1 -- 172.21.15.87:0/58008422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b8410ceb0 msgr2=0x7f0b841a4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:28.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.773+0000 7f0b888c2640 1 --2- 172.21.15.87:0/58008422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b8410ceb0 0x7f0b841a4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:28.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.773+0000 7f0b837fe640 1 --2- 172.21.15.87:0/58008422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b8410ceb0 0x7f0b841a4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.773+0000 7f0b837fe640 1 -- 172.21.15.87:0/58008422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b840fee80 msgr2=0x7f0b8410c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:28.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.773+0000 7f0b837fe640 1 --2- 172.21.15.87:0/58008422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b840fee80 0x7f0b8410c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.773+0000 7f0b837fe640 1 -- 172.21.15.87:0/58008422 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6c009560 con 0x7f0b84103fd0 2024-09-13T17:21:28.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.773+0000 7f0b837fe640 1 --2- 172.21.15.87:0/58008422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b84103fd0 0x7f0b8410c970 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c009900 tx=0x7f0b6c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:28.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.773+0000 7f0b817fa640 1 -- 172.21.15.87:0/58008422 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c003a00 con 0x7f0b84103fd0 2024-09-13T17:21:28.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.773+0000 7f0b817fa640 1 -- 172.21.15.87:0/58008422 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0b6c0044e0 con 0x7f0b84103fd0 2024-09-13T17:21:28.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.773+0000 7f0b8a325640 1 -- 172.21.15.87:0/58008422 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b841a4fa0 con 0x7f0b84103fd0 2024-09-13T17:21:28.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.773+0000 7f0b817fa640 1 -- 172.21.15.87:0/58008422 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c03bdb0 con 0x7f0b84103fd0 2024-09-13T17:21:28.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.773+0000 7f0b8a325640 1 -- 172.21.15.87:0/58008422 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b841a53c0 con 0x7f0b84103fd0 2024-09-13T17:21:28.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.775+0000 7f0b8a325640 1 -- 172.21.15.87:0/58008422 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b84100350 con 0x7f0b84103fd0 2024-09-13T17:21:28.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.776+0000 7f0b817fa640 1 -- 172.21.15.87:0/58008422 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f0b6c003c60 con 0x7f0b84103fd0 2024-09-13T17:21:28.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.776+0000 7f0b817fa640 1 --2- 172.21.15.87:0/58008422 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0b700a1230 0x7f0b700a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:28.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.776+0000 7f0b83fff640 1 --2- 172.21.15.87:0/58008422 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0b700a1230 0x7f0b700a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:28.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.776+0000 7f0b817fa640 1 -- 172.21.15.87:0/58008422 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f0b6c0edd20 con 0x7f0b84103fd0 2024-09-13T17:21:28.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.777+0000 7f0b83fff640 1 --2- 172.21.15.87:0/58008422 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0b700a1230 0x7f0b700a36f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0b7400abe0 tx=0x7f0b7400a2d0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:28.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.780+0000 7f0b817fa640 1 -- 172.21.15.87:0/58008422 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0b6c0b6d60 con 0x7f0b84103fd0 2024-09-13T17:21:28.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.976+0000 7f0b8a325640 1 -- 172.21.15.87:0/58008422 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b84107220 con 0x7f0b84103fd0 2024-09-13T17:21:28.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.976+0000 7f0b817fa640 1 -- 172.21.15.87:0/58008422 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+10877 (secure 0 0 0) 0x7f0b6c0ba380 con 0x7f0b84103fd0 2024-09-13T17:21:28.978 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:21:28.978 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/3674545180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":3674545180},{"type":"v1","addr":"172.21.15.87:6841","nonce":3674545180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:11:23.313609+0000","modified":"2024-09-13T17:19:40.570296+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24484,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6839/3052680456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3052680456},{"type":"v1","addr":"172.21.15.118:6839","nonce":3052680456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:21:28.978 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 36 2024-09-13T17:21:28.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.978+0000 7f0b8a325640 1 -- 172.21.15.87:0/58008422 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0b700a1230 msgr2=0x7f0b700a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:28.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.978+0000 7f0b8a325640 1 --2- 172.21.15.87:0/58008422 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0b700a1230 0x7f0b700a36f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0b7400abe0 tx=0x7f0b7400a2d0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.978+0000 7f0b8a325640 1 -- 172.21.15.87:0/58008422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b84103fd0 msgr2=0x7f0b8410c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:28.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.978+0000 7f0b8a325640 1 --2- 172.21.15.87:0/58008422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b84103fd0 0x7f0b8410c970 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c009900 tx=0x7f0b6c0042f0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.978+0000 7f0b8a325640 1 -- 172.21.15.87:0/58008422 shutdown_connections 2024-09-13T17:21:28.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.978+0000 7f0b8a325640 1 --2- 172.21.15.87:0/58008422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b8410ceb0 0x7f0b841a4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.978+0000 7f0b8a325640 1 --2- 172.21.15.87:0/58008422 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0b700a1230 0x7f0b700a36f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.978+0000 7f0b8a325640 1 --2- 172.21.15.87:0/58008422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b84103fd0 0x7f0b8410c970 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.978+0000 7f0b8a325640 1 --2- 172.21.15.87:0/58008422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b840fee80 0x7f0b8410c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:28.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.978+0000 7f0b8a325640 1 -- 172.21.15.87:0/58008422 >> 172.21.15.87:0/58008422 conn(0x7f0b84075c60 msgr2=0x7f0b840fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:28.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.979+0000 7f0b8a325640 1 -- 172.21.15.87:0/58008422 shutdown_connections 2024-09-13T17:21:28.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:28.979+0000 7f0b8a325640 1 -- 172.21.15.87:0/58008422 wait complete. 2024-09-13T17:21:28.990 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-09-13T17:21:29.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.090+0000 7f2541009640 1 -- 172.21.15.87:0/2989061960 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f253c100f80 msgr2=0x7f253c101360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:29.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.090+0000 7f2541009640 1 --2- 172.21.15.87:0/2989061960 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f253c100f80 0x7f253c101360 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f252c009900 tx=0x7f252c02a410 comp rx=0 tx=0).stop 2024-09-13T17:21:29.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.090+0000 7f2541009640 1 -- 172.21.15.87:0/2989061960 shutdown_connections 2024-09-13T17:21:29.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.090+0000 7f2541009640 1 --2- 172.21.15.87:0/2989061960 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f253c10a350 0x7f253c10c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.090+0000 7f2541009640 1 --2- 172.21.15.87:0/2989061960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f253c1018a0 0x7f253c109d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.090+0000 7f2541009640 1 --2- 172.21.15.87:0/2989061960 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f253c100f80 0x7f253c101360 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.090+0000 7f2541009640 1 -- 172.21.15.87:0/2989061960 >> 172.21.15.87:0/2989061960 conn(0x7f253c0fa930 msgr2=0x7f253c0fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:29.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.090+0000 7f2541009640 1 -- 172.21.15.87:0/2989061960 shutdown_connections 2024-09-13T17:21:29.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.090+0000 7f2541009640 1 -- 172.21.15.87:0/2989061960 wait complete. 2024-09-13T17:21:29.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.091+0000 7f2541009640 1 Processor -- start 2024-09-13T17:21:29.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.091+0000 7f2541009640 1 -- start start 2024-09-13T17:21:29.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.091+0000 7f2541009640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f253c100f80 0x7f253c196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.091+0000 7f2541009640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f253c1018a0 0x7f253c1967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.091+0000 7f2541009640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f253c10a350 0x7f253c19abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.091+0000 7f2541009640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253c19b1c0 con 0x7f253c100f80 2024-09-13T17:21:29.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.091+0000 7f2541009640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253c19b330 con 0x7f253c10a350 2024-09-13T17:21:29.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.091+0000 7f2541009640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253c19b4f0 con 0x7f253c1018a0 2024-09-13T17:21:29.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.091+0000 7f253ad9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f253c100f80 0x7f253c196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.092+0000 7f253ad9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f253c100f80 0x7f253c196290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57638/0 (socket says 172.21.15.87:57638) 2024-09-13T17:21:29.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.092+0000 7f253ad9d640 1 -- 172.21.15.87:0/2222772240 learned_addr learned my addr 172.21.15.87:0/2222772240 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:21:29.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.092+0000 7f253b59e640 1 --2- 172.21.15.87:0/2222772240 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f253c10a350 0x7f253c19abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.092+0000 7f253259c640 1 --2- 172.21.15.87:0/2222772240 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f253c1018a0 0x7f253c1967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.092+0000 7f253ad9d640 1 -- 172.21.15.87:0/2222772240 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f253c1018a0 msgr2=0x7f253c1967d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:29.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.092+0000 7f253ad9d640 1 --2- 172.21.15.87:0/2222772240 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f253c1018a0 0x7f253c1967d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.092+0000 7f253ad9d640 1 -- 172.21.15.87:0/2222772240 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f253c10a350 msgr2=0x7f253c19abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:29.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.092+0000 7f253ad9d640 1 --2- 172.21.15.87:0/2222772240 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f253c10a350 0x7f253c19abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.092+0000 7f253ad9d640 1 -- 172.21.15.87:0/2222772240 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f252c009560 con 0x7f253c100f80 2024-09-13T17:21:29.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.092+0000 7f253ad9d640 1 --2- 172.21.15.87:0/2222772240 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f253c100f80 0x7f253c196290 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f252c02aa00 tx=0x7f252c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:29.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.092+0000 7f2538d99640 1 -- 172.21.15.87:0/2222772240 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c003a00 con 0x7f253c100f80 2024-09-13T17:21:29.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.092+0000 7f2541009640 1 -- 172.21.15.87:0/2222772240 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f253c19b770 con 0x7f253c100f80 2024-09-13T17:21:29.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.092+0000 7f2538d99640 1 -- 172.21.15.87:0/2222772240 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f252c0044e0 con 0x7f253c100f80 2024-09-13T17:21:29.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.092+0000 7f2538d99640 1 -- 172.21.15.87:0/2222772240 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c03be30 con 0x7f253c100f80 2024-09-13T17:21:29.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.092+0000 7f2541009640 1 -- 172.21.15.87:0/2222772240 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f253c19ba40 con 0x7f253c100f80 2024-09-13T17:21:29.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.094+0000 7f2538d99640 1 -- 172.21.15.87:0/2222772240 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f252c003cf0 con 0x7f253c100f80 2024-09-13T17:21:29.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.095+0000 7f2543e08740 1 Processor -- start 2024-09-13T17:21:29.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.095+0000 7f2543e08740 1 -- start start 2024-09-13T17:21:29.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.095+0000 7f2543e08740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d64a58d790 0x55d64a58db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.095+0000 7f2543e08740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d64a58e0b0 0x55d64a598410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.095+0000 7f2543e08740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d64a598950 0x55d64a59ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.095+0000 7f2543e08740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64a4f7cc0 con 0x55d64a58e0b0 2024-09-13T17:21:29.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.095+0000 7f2543e08740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64a4f5450 con 0x55d64a58d790 2024-09-13T17:21:29.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.095+0000 7f2543e08740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64a4f0d40 con 0x55d64a598950 2024-09-13T17:21:29.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.095+0000 7f253ad9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d64a58e0b0 0x55d64a598410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.095+0000 7f253ad9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d64a58e0b0 0x55d64a598410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57652/0 (socket says 172.21.15.87:57652) 2024-09-13T17:21:29.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.095+0000 7f253ad9d640 1 -- 172.21.15.87:0/970151043 learned_addr learned my addr 172.21.15.87:0/970151043 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:21:29.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.095+0000 7f253b59e640 1 --2- 172.21.15.87:0/970151043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d64a58d790 0x55d64a58db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.095+0000 7f253ad9d640 1 -- 172.21.15.87:0/970151043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d64a598950 msgr2=0x55d64a59ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:29.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.095+0000 7f253259c640 1 --2- 172.21.15.87:0/970151043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d64a598950 0x55d64a59ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.095+0000 7f253ad9d640 1 --2- 172.21.15.87:0/970151043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d64a598950 0x55d64a59ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.095+0000 7f2538d99640 1 --2- 172.21.15.87:0/2222772240 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f25280a1200 0x7f25280a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.095+0000 7f253ad9d640 1 -- 172.21.15.87:0/970151043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d64a58d790 msgr2=0x55d64a58db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:29.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.095+0000 7f253ad9d640 1 --2- 172.21.15.87:0/970151043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d64a58d790 0x55d64a58db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.095+0000 7f253ad9d640 1 -- 172.21.15.87:0/970151043 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d64a4b8620 con 0x55d64a58e0b0 2024-09-13T17:21:29.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.095+0000 7f253b59e640 1 --2- 172.21.15.87:0/970151043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d64a58d790 0x55d64a58db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:21:29.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.096+0000 7f253b59e640 1 --2- 172.21.15.87:0/2222772240 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f25280a1200 0x7f25280a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.096+0000 7f253ad9d640 1 --2- 172.21.15.87:0/970151043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d64a58e0b0 0x55d64a598410 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f252c0eb080 tx=0x7f252c0b6c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb1deb45860df36d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:29.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.096+0000 7f2538d99640 1 -- 172.21.15.87:0/2222772240 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f252c0eddd0 con 0x7f253c100f80 2024-09-13T17:21:29.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.096+0000 7f253159a640 1 -- 172.21.15.87:0/970151043 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c003b60 con 0x55d64a58e0b0 2024-09-13T17:21:29.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.096+0000 7f253159a640 1 -- 172.21.15.87:0/970151043 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f252c0ba8a0 con 0x55d64a58e0b0 2024-09-13T17:21:29.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.096+0000 7f253159a640 1 -- 172.21.15.87:0/970151043 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c0ba610 con 0x55d64a58e0b0 2024-09-13T17:21:29.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.097+0000 7f2543e08740 1 -- 172.21.15.87:0/970151043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d64a58e0b0 msgr2=0x55d64a598410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:29.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.097+0000 7f2543e08740 1 --2- 172.21.15.87:0/970151043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d64a58e0b0 0x55d64a598410 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f252c0eb080 tx=0x7f252c0b6c40 comp rx=0 tx=0).stop 2024-09-13T17:21:29.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.097+0000 7f253b59e640 1 --2- 172.21.15.87:0/2222772240 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f25280a1200 0x7f25280a36c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2534005fd0 tx=0x7f2534004a40 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:29.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.097+0000 7f2543e08740 1 -- 172.21.15.87:0/970151043 shutdown_connections 2024-09-13T17:21:29.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.097+0000 7f2543e08740 1 --2- 172.21.15.87:0/970151043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d64a598950 0x55d64a59ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.097+0000 7f2543e08740 1 --2- 172.21.15.87:0/970151043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d64a58e0b0 0x55d64a598410 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.097+0000 7f2543e08740 1 --2- 172.21.15.87:0/970151043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d64a58d790 0x55d64a58db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.097+0000 7f2543e08740 1 -- 172.21.15.87:0/970151043 >> 172.21.15.87:0/970151043 conn(0x55d64a589d00 msgr2=0x55d64a58a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:29.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.097+0000 7f2543e08740 1 -- 172.21.15.87:0/970151043 shutdown_connections 2024-09-13T17:21:29.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.097+0000 7f2543e08740 1 -- 172.21.15.87:0/970151043 wait complete. 2024-09-13T17:21:29.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.097+0000 7f2543e08740 1 -- start start 2024-09-13T17:21:29.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.097+0000 7f2543e08740 1 Processor -- start 2024-09-13T17:21:29.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.097+0000 7f2543e08740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d64a58d790 0x55d64a597ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.097+0000 7f2543e08740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d64a58e0b0 0x55d64a598400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.097+0000 7f2543e08740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d64a598950 0x55d64a595480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.097+0000 7f2543e08740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64a4af180 con 0x55d64a58d790 2024-09-13T17:21:29.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.097+0000 7f2543e08740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64a1c9430 con 0x55d64a58e0b0 2024-09-13T17:21:29.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.097+0000 7f2543e08740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64a4745e0 con 0x55d64a598950 2024-09-13T17:21:29.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.097+0000 7f2543e08740 10 client.0 _ll_register_callbacks cb 0x55d64a4e0aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:21:29.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.097+0000 7f253ad9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d64a58d790 0x55d64a597ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.097+0000 7f253ad9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d64a58d790 0x55d64a597ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57662/0 (socket says 172.21.15.87:57662) 2024-09-13T17:21:29.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.098+0000 7f253ad9d640 1 -- 172.21.15.87:0/1290623398 learned_addr learned my addr 172.21.15.87:0/1290623398 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:21:29.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.098+0000 7f253b59e640 1 --2- 172.21.15.87:0/1290623398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d64a598950 0x55d64a595480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.098+0000 7f253259c640 1 --2- 172.21.15.87:0/1290623398 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d64a58e0b0 0x55d64a598400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.098+0000 7f253ad9d640 1 -- 172.21.15.87:0/1290623398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d64a598950 msgr2=0x55d64a595480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:29.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.098+0000 7f253ad9d640 1 --2- 172.21.15.87:0/1290623398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d64a598950 0x55d64a595480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.098+0000 7f253ad9d640 1 -- 172.21.15.87:0/1290623398 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d64a58e0b0 msgr2=0x55d64a598400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:29.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.098+0000 7f253ad9d640 1 --2- 172.21.15.87:0/1290623398 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d64a58e0b0 0x55d64a598400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.098+0000 7f253ad9d640 1 -- 172.21.15.87:0/1290623398 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f253c19ba40 con 0x55d64a58d790 2024-09-13T17:21:29.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.098+0000 7f253ad9d640 1 --2- 172.21.15.87:0/1290623398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d64a58d790 0x55d64a597ec0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f252c0b8e20 tx=0x7f252c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ff5af3e35b26879 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:29.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.098+0000 7f25227fc640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:21:29.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.098+0000 7f25227fc640 1 -- 172.21.15.87:0/1290623398 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c003b60 con 0x55d64a58d790 2024-09-13T17:21:29.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.098+0000 7f25227fc640 1 -- 172.21.15.87:0/1290623398 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f252c0bb1d0 con 0x55d64a58d790 2024-09-13T17:21:29.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.098+0000 7f2543e08740 1 -- 172.21.15.87:0/1290623398 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d64a51ab80 con 0x55d64a58d790 2024-09-13T17:21:29.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.098+0000 7f25227fc640 1 -- 172.21.15.87:0/1290623398 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f252c0ba430 con 0x55d64a58d790 2024-09-13T17:21:29.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.098+0000 7f2543e08740 10 client.17613 fetch_fsmap learned FSMap version 36 2024-09-13T17:21:29.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.098+0000 7f2543e08740 1 -- 172.21.15.87:0/1290623398 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55d64a4ef3c0 con 0x55d64a58d790 2024-09-13T17:21:29.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.098+0000 7f25227fc640 1 -- 172.21.15.87:0/1290623398 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f252c09d020 con 0x55d64a58d790 2024-09-13T17:21:29.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.099+0000 7f25227fc640 1 -- 172.21.15.87:0/1290623398 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f252c0b71e0 con 0x55d64a58d790 2024-09-13T17:21:29.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.099+0000 7f2543e08740 10 client.17613 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:21:29.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.099+0000 7f2543e08740 10 client.17613 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:21:29.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.099+0000 7f2543e08740 20 client.17613 populate_metadata read hostname 'smithi087' 2024-09-13T17:21:29.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.099+0000 7f2543e08740 1 --2- 172.21.15.87:0/1290623398 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55d64a5a7a70 0x55d64a5a9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.099+0000 7f2543e08740 4 client.17613 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:21:29.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.099+0000 7f2543e08740 1 -- 172.21.15.87:0/1290623398 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d64a4e31f0 con 0x55d64a5a7a70 2024-09-13T17:21:29.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.099+0000 7f253259c640 1 --2- 172.21.15.87:0/1290623398 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55d64a5a7a70 0x55d64a5a9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.099+0000 7f253259c640 1 --2- 172.21.15.87:0/1290623398 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55d64a5a7a70 0x55d64a5a9e60 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c5d9b515189b7281 server_cookie=6b5a702acf8be225 in_seq=0 out_seq=0 2024-09-13T17:21:29.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.099+0000 7f25227fc640 10 client.17613 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:21:29.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.100+0000 7f25227fc640 1 -- 172.21.15.87:0/1290623398 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55d64a4e31f0 con 0x55d64a5a7a70 2024-09-13T17:21:29.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.100+0000 7f25227fc640 10 client.17613 handle_command_reply: tid=0 2024-09-13T17:21:29.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.100+0000 7f2543e08740 1 client.17613 shutdown 2024-09-13T17:21:29.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.100+0000 7f2543e08740 1 -- 172.21.15.87:0/1290623398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d64a58d790 msgr2=0x55d64a597ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:29.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.100+0000 7f2543e08740 1 --2- 172.21.15.87:0/1290623398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d64a58d790 0x55d64a597ec0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f252c0b8e20 tx=0x7f252c02a410 comp rx=0 tx=0).stop 2024-09-13T17:21:29.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.100+0000 7f2543e08740 1 -- 172.21.15.87:0/1290623398 shutdown_connections 2024-09-13T17:21:29.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.100+0000 7f2543e08740 1 --2- 172.21.15.87:0/1290623398 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55d64a5a7a70 0x55d64a5a9e60 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.100+0000 7f2543e08740 1 --2- 172.21.15.87:0/1290623398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d64a598950 0x55d64a595480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.100+0000 7f2543e08740 1 --2- 172.21.15.87:0/1290623398 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d64a58e0b0 0x55d64a598400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.100+0000 7f2543e08740 1 --2- 172.21.15.87:0/1290623398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d64a58d790 0x55d64a597ec0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.100+0000 7f25227fc640 0 client.17613 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:21:29.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.100+0000 7f2543e08740 1 -- 172.21.15.87:0/1290623398 >> 172.21.15.87:0/1290623398 conn(0x55d64a589d00 msgr2=0x55d64a58fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:29.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.100+0000 7f2543e08740 1 -- 172.21.15.87:0/1290623398 shutdown_connections 2024-09-13T17:21:29.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.100+0000 7f2543e08740 1 -- 172.21.15.87:0/1290623398 wait complete. 2024-09-13T17:21:29.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.100+0000 7f2543e08740 20 client.17613 trim_cache size 0 max 16384 2024-09-13T17:21:29.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.111+0000 7f2543e08740 1 Processor -- start 2024-09-13T17:21:29.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.111+0000 7f2543e08740 1 -- start start 2024-09-13T17:21:29.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.111+0000 7f2543e08740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d64a589d00 0x55d64a590a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.111+0000 7f2543e08740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d64a58d790 0x55d64a5896a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.111+0000 7f2543e08740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d64a58e0b0 0x55d64a59ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.111+0000 7f2543e08740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64a58e930 con 0x55d64a589d00 2024-09-13T17:21:29.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.111+0000 7f2543e08740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64a595030 con 0x55d64a58d790 2024-09-13T17:21:29.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.111+0000 7f2543e08740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64a58ac60 con 0x55d64a58e0b0 2024-09-13T17:21:29.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.111+0000 7f253ad9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d64a589d00 0x55d64a590a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.111+0000 7f253ad9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d64a589d00 0x55d64a590a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57676/0 (socket says 172.21.15.87:57676) 2024-09-13T17:21:29.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.111+0000 7f253ad9d640 1 -- 172.21.15.87:0/309578613 learned_addr learned my addr 172.21.15.87:0/309578613 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:21:29.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.111+0000 7f253259c640 1 --2- 172.21.15.87:0/309578613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d64a58d790 0x55d64a5896a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.111+0000 7f253ad9d640 1 -- 172.21.15.87:0/309578613 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d64a58e0b0 msgr2=0x55d64a59ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:29.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.111+0000 7f253ad9d640 1 --2- 172.21.15.87:0/309578613 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d64a58e0b0 0x55d64a59ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.111+0000 7f253ad9d640 1 -- 172.21.15.87:0/309578613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d64a58d790 msgr2=0x55d64a5896a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:29.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.111+0000 7f253ad9d640 1 --2- 172.21.15.87:0/309578613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d64a58d790 0x55d64a5896a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.111+0000 7f253ad9d640 1 -- 172.21.15.87:0/309578613 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d64a491770 con 0x55d64a589d00 2024-09-13T17:21:29.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.112+0000 7f253ad9d640 1 --2- 172.21.15.87:0/309578613 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d64a589d00 0x55d64a590a70 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f252c004650 tx=0x7f252c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aab27c42ad52470 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:29.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.112+0000 7f2531d9b640 1 -- 172.21.15.87:0/309578613 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c0f13f0 con 0x55d64a589d00 2024-09-13T17:21:29.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.112+0000 7f2531d9b640 1 -- 172.21.15.87:0/309578613 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f252c09d030 con 0x55d64a589d00 2024-09-13T17:21:29.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.112+0000 7f2531d9b640 1 -- 172.21.15.87:0/309578613 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c0b6b20 con 0x55d64a589d00 2024-09-13T17:21:29.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.112+0000 7f2543e08740 1 -- 172.21.15.87:0/309578613 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d64a589d00 msgr2=0x55d64a590a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:29.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.112+0000 7f2543e08740 1 --2- 172.21.15.87:0/309578613 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d64a589d00 0x55d64a590a70 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f252c004650 tx=0x7f252c009260 comp rx=0 tx=0).stop 2024-09-13T17:21:29.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.112+0000 7f2543e08740 1 -- 172.21.15.87:0/309578613 shutdown_connections 2024-09-13T17:21:29.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.112+0000 7f2543e08740 1 --2- 172.21.15.87:0/309578613 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d64a58e0b0 0x55d64a59ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.112+0000 7f2543e08740 1 --2- 172.21.15.87:0/309578613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d64a58d790 0x55d64a5896a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.112+0000 7f2543e08740 1 --2- 172.21.15.87:0/309578613 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d64a589d00 0x55d64a590a70 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.112+0000 7f2543e08740 1 -- 172.21.15.87:0/309578613 >> 172.21.15.87:0/309578613 conn(0x55d64a58a680 msgr2=0x55d64a590360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:29.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.112+0000 7f2543e08740 1 -- 172.21.15.87:0/309578613 shutdown_connections 2024-09-13T17:21:29.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.112+0000 7f2543e08740 1 -- 172.21.15.87:0/309578613 wait complete. 2024-09-13T17:21:29.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.113+0000 7f2543e08740 1 -- start start 2024-09-13T17:21:29.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.113+0000 7f2543e08740 1 Processor -- start 2024-09-13T17:21:29.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.113+0000 7f2543e08740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d64a589d00 0x55d64a59ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.113+0000 7f2543e08740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d64a58d790 0x55d64a59b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.113+0000 7f2543e08740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d64a58e0b0 0x55d64a59b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.113+0000 7f2543e08740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64a59bb30 con 0x55d64a58e0b0 2024-09-13T17:21:29.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.113+0000 7f2543e08740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64a59bca0 con 0x55d64a589d00 2024-09-13T17:21:29.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.113+0000 7f2543e08740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64a59be60 con 0x55d64a58d790 2024-09-13T17:21:29.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.113+0000 7f2543e08740 10 client.0 _ll_register_callbacks cb 0x7f252c0f17b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:21:29.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.113+0000 7f253b59e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d64a58e0b0 0x55d64a59b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.113+0000 7f253b59e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d64a58e0b0 0x55d64a59b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57682/0 (socket says 172.21.15.87:57682) 2024-09-13T17:21:29.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.113+0000 7f253b59e640 1 -- 172.21.15.87:0/1713020476 learned_addr learned my addr 172.21.15.87:0/1713020476 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:21:29.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.113+0000 7f253ad9d640 1 --2- 172.21.15.87:0/1713020476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d64a589d00 0x55d64a59ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.113+0000 7f253b59e640 1 -- 172.21.15.87:0/1713020476 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d64a58d790 msgr2=0x55d64a59b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:29.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.113+0000 7f253b59e640 1 --2- 172.21.15.87:0/1713020476 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d64a58d790 0x55d64a59b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.113+0000 7f253b59e640 1 -- 172.21.15.87:0/1713020476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d64a589d00 msgr2=0x55d64a59ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:29.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.113+0000 7f253b59e640 1 --2- 172.21.15.87:0/1713020476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d64a589d00 0x55d64a59ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.113+0000 7f253b59e640 1 -- 172.21.15.87:0/1713020476 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d64a4ef3c0 con 0x55d64a58e0b0 2024-09-13T17:21:29.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.113+0000 7f253ad9d640 1 --2- 172.21.15.87:0/1713020476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d64a589d00 0x55d64a59ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:21:29.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.113+0000 7f253b59e640 1 --2- 172.21.15.87:0/1713020476 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d64a58e0b0 0x55d64a59b5f0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f2534013a00 tx=0x7f2534009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6f667879a37a03e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:29.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.113+0000 7f25227fc640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:21:29.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.114+0000 7f25227fc640 1 -- 172.21.15.87:0/1713020476 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2534024070 con 0x55d64a58e0b0 2024-09-13T17:21:29.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.114+0000 7f25227fc640 1 -- 172.21.15.87:0/1713020476 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f253401fb20 con 0x55d64a58e0b0 2024-09-13T17:21:29.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.114+0000 7f2543e08740 1 -- 172.21.15.87:0/1713020476 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f252c0ba8a0 con 0x55d64a58e0b0 2024-09-13T17:21:29.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.114+0000 7f25227fc640 1 -- 172.21.15.87:0/1713020476 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f253401fce0 con 0x55d64a58e0b0 2024-09-13T17:21:29.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.114+0000 7f2543e08740 10 client.17619 fetch_fsmap learned FSMap version 36 2024-09-13T17:21:29.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.114+0000 7f2543e08740 1 -- 172.21.15.87:0/1713020476 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55d64a4b6e80 con 0x55d64a58e0b0 2024-09-13T17:21:29.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.114+0000 7f25227fc640 1 -- 172.21.15.87:0/1713020476 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f252c0ba8a0 con 0x55d64a58e0b0 2024-09-13T17:21:29.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.114+0000 7f25227fc640 1 -- 172.21.15.87:0/1713020476 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f253401c4d0 con 0x55d64a58e0b0 2024-09-13T17:21:29.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.114+0000 7f2543e08740 10 client.17619 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:21:29.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.114+0000 7f2543e08740 10 client.17619 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:21:29.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.114+0000 7f2543e08740 20 client.17619 populate_metadata read hostname 'smithi087' 2024-09-13T17:21:29.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.114+0000 7f2543e08740 1 --2- 172.21.15.87:0/1713020476 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55d64a598950 0x55d64a601300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.114+0000 7f2543e08740 4 client.17619 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:21:29.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.114+0000 7f2543e08740 1 -- 172.21.15.87:0/1713020476 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d64a1e44e0 con 0x55d64a598950 2024-09-13T17:21:29.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.115+0000 7f253ad9d640 1 --2- 172.21.15.87:0/1713020476 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55d64a598950 0x55d64a601300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.115+0000 7f253ad9d640 1 --2- 172.21.15.87:0/1713020476 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55d64a598950 0x55d64a601300 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b2329be06867b45f server_cookie=e4503284090be27c in_seq=0 out_seq=0 2024-09-13T17:21:29.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.115+0000 7f25227fc640 10 client.17619 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:21:29.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.115+0000 7f25227fc640 1 -- 172.21.15.87:0/1713020476 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d64a1e44e0 con 0x55d64a598950 2024-09-13T17:21:29.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.115+0000 7f25227fc640 10 client.17619 handle_command_reply: tid=0 2024-09-13T17:21:29.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.115+0000 7f2543e08740 1 client.17619 shutdown 2024-09-13T17:21:29.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.115+0000 7f2543e08740 1 -- 172.21.15.87:0/1713020476 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d64a58e0b0 msgr2=0x55d64a59b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:29.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.115+0000 7f2543e08740 1 --2- 172.21.15.87:0/1713020476 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d64a58e0b0 0x55d64a59b5f0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f2534013a00 tx=0x7f2534009600 comp rx=0 tx=0).stop 2024-09-13T17:21:29.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.115+0000 7f2543e08740 1 -- 172.21.15.87:0/1713020476 shutdown_connections 2024-09-13T17:21:29.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.115+0000 7f2543e08740 1 --2- 172.21.15.87:0/1713020476 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55d64a598950 0x55d64a601300 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.115+0000 7f2543e08740 1 --2- 172.21.15.87:0/1713020476 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d64a58e0b0 0x55d64a59b5f0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.115+0000 7f25227fc640 0 client.17619 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:21:29.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.115+0000 7f2543e08740 1 --2- 172.21.15.87:0/1713020476 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d64a58d790 0x55d64a59b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.115+0000 7f2543e08740 1 --2- 172.21.15.87:0/1713020476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d64a589d00 0x55d64a59ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.115+0000 7f2543e08740 1 -- 172.21.15.87:0/1713020476 >> 172.21.15.87:0/1713020476 conn(0x55d64a58a680 msgr2=0x55d64a58f160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:29.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.115+0000 7f2543e08740 1 -- 172.21.15.87:0/1713020476 shutdown_connections 2024-09-13T17:21:29.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.115+0000 7f2543e08740 1 -- 172.21.15.87:0/1713020476 wait complete. 2024-09-13T17:21:29.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.115+0000 7f2543e08740 20 client.17619 trim_cache size 0 max 16384 2024-09-13T17:21:29.126 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:21:29.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.116+0000 7f2541009640 1 -- 172.21.15.87:0/2222772240 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f25280a1200 msgr2=0x7f25280a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:29.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.116+0000 7f2541009640 1 --2- 172.21.15.87:0/2222772240 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f25280a1200 0x7f25280a36c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2534005fd0 tx=0x7f2534004a40 comp rx=0 tx=0).stop 2024-09-13T17:21:29.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.116+0000 7f2541009640 1 -- 172.21.15.87:0/2222772240 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f253c100f80 msgr2=0x7f253c196290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:29.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.116+0000 7f2541009640 1 --2- 172.21.15.87:0/2222772240 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f253c100f80 0x7f253c196290 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f252c02aa00 tx=0x7f252c0042f0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.116+0000 7f2541009640 1 -- 172.21.15.87:0/2222772240 shutdown_connections 2024-09-13T17:21:29.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.116+0000 7f2541009640 1 --2- 172.21.15.87:0/2222772240 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f253c10a350 0x7f253c19abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.116+0000 7f2541009640 1 --2- 172.21.15.87:0/2222772240 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f253c1018a0 0x7f253c1967d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.116+0000 7f2541009640 1 --2- 172.21.15.87:0/2222772240 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f25280a1200 0x7f25280a36c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.116+0000 7f2541009640 1 --2- 172.21.15.87:0/2222772240 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f253c100f80 0x7f253c196290 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.116+0000 7f2541009640 1 -- 172.21.15.87:0/2222772240 >> 172.21.15.87:0/2222772240 conn(0x7f253c0fa930 msgr2=0x7f253c0fc290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:29.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.116+0000 7f2541009640 1 -- 172.21.15.87:0/2222772240 shutdown_connections 2024-09-13T17:21:29.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.116+0000 7f2541009640 1 -- 172.21.15.87:0/2222772240 wait complete. 2024-09-13T17:21:29.129 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-09-13T17:21:29.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.228+0000 7fa175032640 1 -- 172.21.15.87:0/3060801601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1701050e0 msgr2=0x7fa17010cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:29.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.228+0000 7fa175032640 1 --2- 172.21.15.87:0/3060801601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1701050e0 0x7fa17010cc30 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fa168009cd0 tx=0x7fa16802a8e0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.228+0000 7fa175032640 1 -- 172.21.15.87:0/3060801601 shutdown_connections 2024-09-13T17:21:29.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.228+0000 7fa175032640 1 --2- 172.21.15.87:0/3060801601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1701050e0 0x7fa17010cc30 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.228+0000 7fa175032640 1 --2- 172.21.15.87:0/3060801601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa170100940 0x7fa170104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.228+0000 7fa175032640 1 --2- 172.21.15.87:0/3060801601 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1700fff90 0x7fa170100370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.228+0000 7fa175032640 1 -- 172.21.15.87:0/3060801601 >> 172.21.15.87:0/3060801601 conn(0x7fa1700fba20 msgr2=0x7fa1700fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:29.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.228+0000 7fa175032640 1 -- 172.21.15.87:0/3060801601 shutdown_connections 2024-09-13T17:21:29.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.228+0000 7fa175032640 1 -- 172.21.15.87:0/3060801601 wait complete. 2024-09-13T17:21:29.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.229+0000 7fa175032640 1 Processor -- start 2024-09-13T17:21:29.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.229+0000 7fa175032640 1 -- start start 2024-09-13T17:21:29.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.229+0000 7fa175032640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1700fff90 0x7fa170196240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.229+0000 7fa175032640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1701050e0 0x7fa170196780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.229+0000 7fa175032640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa17019ab70 0x7fa17019b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.229+0000 7fa175032640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17019b560 con 0x7fa1701050e0 2024-09-13T17:21:29.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.229+0000 7fa175032640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17019b6d0 con 0x7fa1700fff90 2024-09-13T17:21:29.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.229+0000 7fa175032640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17019b840 con 0x7fa17019ab70 2024-09-13T17:21:29.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.229+0000 7fa16e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1701050e0 0x7fa170196780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.229+0000 7fa16e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1701050e0 0x7fa170196780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57706/0 (socket says 172.21.15.87:57706) 2024-09-13T17:21:29.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.229+0000 7fa16e59c640 1 -- 172.21.15.87:0/1308765197 learned_addr learned my addr 172.21.15.87:0/1308765197 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:21:29.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.230+0000 7fa16ed9d640 1 --2- 172.21.15.87:0/1308765197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1700fff90 0x7fa170196240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.230+0000 7fa16f59e640 1 --2- 172.21.15.87:0/1308765197 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa17019ab70 0x7fa17019b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.230+0000 7fa16e59c640 1 -- 172.21.15.87:0/1308765197 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa17019ab70 msgr2=0x7fa17019b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:29.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.230+0000 7fa16e59c640 1 --2- 172.21.15.87:0/1308765197 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa17019ab70 0x7fa17019b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.230+0000 7fa16e59c640 1 -- 172.21.15.87:0/1308765197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1700fff90 msgr2=0x7fa170196240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:29.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.230+0000 7fa16e59c640 1 --2- 172.21.15.87:0/1308765197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1700fff90 0x7fa170196240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.230+0000 7fa16e59c640 1 -- 172.21.15.87:0/1308765197 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa168009900 con 0x7fa1701050e0 2024-09-13T17:21:29.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.230+0000 7fa16f59e640 1 --2- 172.21.15.87:0/1308765197 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa17019ab70 0x7fa17019b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:29.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.230+0000 7fa16ed9d640 1 --2- 172.21.15.87:0/1308765197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1700fff90 0x7fa170196240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:29.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.230+0000 7fa16e59c640 1 --2- 172.21.15.87:0/1308765197 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1701050e0 0x7fa170196780 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fa16400d770 tx=0x7fa16400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:29.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.230+0000 7fa157fff640 1 -- 172.21.15.87:0/1308765197 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa164009c30 con 0x7fa1701050e0 2024-09-13T17:21:29.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.230+0000 7fa175032640 1 -- 172.21.15.87:0/1308765197 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1701a2e20 con 0x7fa1701050e0 2024-09-13T17:21:29.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.230+0000 7fa157fff640 1 -- 172.21.15.87:0/1308765197 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa16400de80 con 0x7fa1701050e0 2024-09-13T17:21:29.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.230+0000 7fa157fff640 1 -- 172.21.15.87:0/1308765197 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16400f600 con 0x7fa1701050e0 2024-09-13T17:21:29.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.230+0000 7fa175032640 1 -- 172.21.15.87:0/1308765197 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1701a3250 con 0x7fa1701050e0 2024-09-13T17:21:29.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.232+0000 7fa157fff640 1 -- 172.21.15.87:0/1308765197 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fa164010460 con 0x7fa1701050e0 2024-09-13T17:21:29.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.233+0000 7fa177e30740 1 Processor -- start 2024-09-13T17:21:29.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.233+0000 7fa177e30740 1 -- start start 2024-09-13T17:21:29.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.233+0000 7fa157fff640 1 --2- 172.21.15.87:0/1308765197 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa1580a1200 0x7fa1580a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.233+0000 7fa177e30740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d3ff787790 0x55d3ff787b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.233+0000 7fa177e30740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d3ff7880b0 0x55d3ff792410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.233+0000 7fa177e30740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3ff792950 0x55d3ff794d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.233+0000 7fa177e30740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3ff6f1cc0 con 0x55d3ff792950 2024-09-13T17:21:29.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.233+0000 7fa177e30740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3ff6ef450 con 0x55d3ff7880b0 2024-09-13T17:21:29.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.233+0000 7fa177e30740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3ff6ead40 con 0x55d3ff787790 2024-09-13T17:21:29.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.233+0000 7fa16f59e640 1 --2- 172.21.15.87:0/1308765197 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa1580a1200 0x7fa1580a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.233+0000 7fa157fff640 1 -- 172.21.15.87:0/1308765197 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fa1640ccf70 con 0x7fa1701050e0 2024-09-13T17:21:29.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.233+0000 7fa16f59e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3ff792950 0x55d3ff794d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.233+0000 7fa16f59e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3ff792950 0x55d3ff794d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57716/0 (socket says 172.21.15.87:57716) 2024-09-13T17:21:29.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.233+0000 7fa16f59e640 1 -- 172.21.15.87:0/2278118775 learned_addr learned my addr 172.21.15.87:0/2278118775 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:21:29.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.233+0000 7fa16ed9d640 1 --2- 172.21.15.87:0/2278118775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d3ff787790 0x55d3ff787b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.233+0000 7fa16e59c640 1 --2- 172.21.15.87:0/2278118775 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d3ff7880b0 0x55d3ff792410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.233+0000 7fa16ed9d640 1 -- 172.21.15.87:0/2278118775 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d3ff7880b0 msgr2=0x55d3ff792410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:29.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.233+0000 7fa16ed9d640 1 --2- 172.21.15.87:0/2278118775 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d3ff7880b0 0x55d3ff792410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.233+0000 7fa16ed9d640 1 -- 172.21.15.87:0/2278118775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3ff792950 msgr2=0x55d3ff794d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:29.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.233+0000 7fa16ed9d640 1 --2- 172.21.15.87:0/2278118775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3ff792950 0x55d3ff794d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.233+0000 7fa16ed9d640 1 -- 172.21.15.87:0/2278118775 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d3ff6b2620 con 0x55d3ff787790 2024-09-13T17:21:29.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.233+0000 7fa16f59e640 1 --2- 172.21.15.87:0/2278118775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3ff792950 0x55d3ff794d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:21:29.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.234+0000 7fa16f59e640 1 --2- 172.21.15.87:0/1308765197 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa1580a1200 0x7fa1580a36c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa168031810 tx=0x7fa168031540 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:29.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.234+0000 7fa16ed9d640 1 --2- 172.21.15.87:0/2278118775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d3ff787790 0x55d3ff787b70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa160009c40 tx=0x7fa160010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d500d69500232e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:29.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.234+0000 7fa1557fa640 1 -- 172.21.15.87:0/2278118775 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa160004030 con 0x55d3ff787790 2024-09-13T17:21:29.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.234+0000 7fa1557fa640 1 -- 172.21.15.87:0/2278118775 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa1600035f0 con 0x55d3ff787790 2024-09-13T17:21:29.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.234+0000 7fa1557fa640 1 -- 172.21.15.87:0/2278118775 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa160012650 con 0x55d3ff787790 2024-09-13T17:21:29.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.234+0000 7fa177e30740 1 -- 172.21.15.87:0/2278118775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d3ff787790 msgr2=0x55d3ff787b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:29.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.234+0000 7fa177e30740 1 --2- 172.21.15.87:0/2278118775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d3ff787790 0x55d3ff787b70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa160009c40 tx=0x7fa160010740 comp rx=0 tx=0).stop 2024-09-13T17:21:29.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.235+0000 7fa177e30740 1 -- 172.21.15.87:0/2278118775 shutdown_connections 2024-09-13T17:21:29.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.235+0000 7fa177e30740 1 --2- 172.21.15.87:0/2278118775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3ff792950 0x55d3ff794d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.235+0000 7fa177e30740 1 --2- 172.21.15.87:0/2278118775 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d3ff7880b0 0x55d3ff792410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.235+0000 7fa177e30740 1 --2- 172.21.15.87:0/2278118775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d3ff787790 0x55d3ff787b70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.235+0000 7fa177e30740 1 -- 172.21.15.87:0/2278118775 >> 172.21.15.87:0/2278118775 conn(0x55d3ff783d00 msgr2=0x55d3ff7840e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:29.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.235+0000 7fa177e30740 1 -- 172.21.15.87:0/2278118775 shutdown_connections 2024-09-13T17:21:29.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.235+0000 7fa177e30740 1 -- 172.21.15.87:0/2278118775 wait complete. 2024-09-13T17:21:29.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.235+0000 7fa177e30740 1 -- start start 2024-09-13T17:21:29.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.235+0000 7fa177e30740 1 Processor -- start 2024-09-13T17:21:29.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.235+0000 7fa177e30740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d3ff787790 0x55d3ff791f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.235+0000 7fa177e30740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d3ff7880b0 0x55d3ff78f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.235+0000 7fa177e30740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3ff792950 0x55d3ff78f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.235+0000 7fa177e30740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3ff6a9180 con 0x55d3ff792950 2024-09-13T17:21:29.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.235+0000 7fa177e30740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3ff3c3430 con 0x55d3ff7880b0 2024-09-13T17:21:29.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.235+0000 7fa177e30740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3ff66e5e0 con 0x55d3ff787790 2024-09-13T17:21:29.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.235+0000 7fa177e30740 10 client.0 _ll_register_callbacks cb 0x55d3ff6daaa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:21:29.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.235+0000 7fa16f59e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3ff792950 0x55d3ff78f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.235+0000 7fa16f59e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3ff792950 0x55d3ff78f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57728/0 (socket says 172.21.15.87:57728) 2024-09-13T17:21:29.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.235+0000 7fa16f59e640 1 -- 172.21.15.87:0/3273139719 learned_addr learned my addr 172.21.15.87:0/3273139719 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:21:29.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.235+0000 7fa16e59c640 1 --2- 172.21.15.87:0/3273139719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d3ff7880b0 0x55d3ff78f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.235+0000 7fa16ed9d640 1 --2- 172.21.15.87:0/3273139719 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d3ff787790 0x55d3ff791f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.236+0000 7fa16f59e640 1 -- 172.21.15.87:0/3273139719 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d3ff787790 msgr2=0x55d3ff791f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:29.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.236+0000 7fa16f59e640 1 --2- 172.21.15.87:0/3273139719 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d3ff787790 0x55d3ff791f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.236+0000 7fa16f59e640 1 -- 172.21.15.87:0/3273139719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d3ff7880b0 msgr2=0x55d3ff78f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:29.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.236+0000 7fa16f59e640 1 --2- 172.21.15.87:0/3273139719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d3ff7880b0 0x55d3ff78f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.236+0000 7fa16f59e640 1 -- 172.21.15.87:0/3273139719 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa160009870 con 0x55d3ff792950 2024-09-13T17:21:29.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.236+0000 7fa16e59c640 1 --2- 172.21.15.87:0/3273139719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d3ff7880b0 0x55d3ff78f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:21:29.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.236+0000 7fa16f59e640 1 --2- 172.21.15.87:0/3273139719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3ff792950 0x55d3ff78f790 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fa168009ca0 tx=0x7fa168046000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc988f54957a608 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:29.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.236+0000 7fa152ff5640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:21:29.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.236+0000 7fa152ff5640 1 -- 172.21.15.87:0/3273139719 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa168003c40 con 0x55d3ff792950 2024-09-13T17:21:29.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.236+0000 7fa152ff5640 1 -- 172.21.15.87:0/3273139719 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fa168003da0 con 0x55d3ff792950 2024-09-13T17:21:29.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.236+0000 7fa177e30740 1 -- 172.21.15.87:0/3273139719 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d3ff714b80 con 0x55d3ff792950 2024-09-13T17:21:29.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.236+0000 7fa152ff5640 1 -- 172.21.15.87:0/3273139719 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa168004030 con 0x55d3ff792950 2024-09-13T17:21:29.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.236+0000 7fa177e30740 10 client.17631 fetch_fsmap learned FSMap version 36 2024-09-13T17:21:29.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.236+0000 7fa177e30740 1 -- 172.21.15.87:0/3273139719 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55d3ff6e93c0 con 0x55d3ff792950 2024-09-13T17:21:29.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.236+0000 7fa152ff5640 1 -- 172.21.15.87:0/3273139719 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55d3ff714b80 con 0x55d3ff792950 2024-09-13T17:21:29.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.236+0000 7fa152ff5640 1 -- 172.21.15.87:0/3273139719 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fa16804b980 con 0x55d3ff792950 2024-09-13T17:21:29.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.236+0000 7fa177e30740 10 client.17631 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:21:29.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.236+0000 7fa177e30740 10 client.17631 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:21:29.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.237+0000 7fa177e30740 20 client.17631 populate_metadata read hostname 'smithi087' 2024-09-13T17:21:29.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.237+0000 7fa177e30740 1 --2- 172.21.15.87:0/3273139719 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55d3ff7a2250 0x55d3ff7a4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.237+0000 7fa177e30740 4 client.17631 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:21:29.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.237+0000 7fa177e30740 1 -- 172.21.15.87:0/3273139719 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d3ff6dd1f0 con 0x55d3ff7a2250 2024-09-13T17:21:29.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.237+0000 7fa16ed9d640 1 --2- 172.21.15.87:0/3273139719 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55d3ff7a2250 0x55d3ff7a4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.237+0000 7fa152ff5640 10 client.17631 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:21:29.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.237+0000 7fa16ed9d640 1 --2- 172.21.15.87:0/3273139719 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55d3ff7a2250 0x55d3ff7a4640 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=356aadd007c86837 server_cookie=c059f80fa3f4f8c6 in_seq=0 out_seq=0 2024-09-13T17:21:29.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.238+0000 7fa152ff5640 1 -- 172.21.15.87:0/3273139719 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55d3ff6dd1f0 con 0x55d3ff7a2250 2024-09-13T17:21:29.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.238+0000 7fa152ff5640 10 client.17631 handle_command_reply: tid=0 2024-09-13T17:21:29.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.238+0000 7fa177e30740 1 client.17631 shutdown 2024-09-13T17:21:29.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.238+0000 7fa177e30740 1 -- 172.21.15.87:0/3273139719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3ff792950 msgr2=0x55d3ff78f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:29.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.238+0000 7fa177e30740 1 --2- 172.21.15.87:0/3273139719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3ff792950 0x55d3ff78f790 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fa168009ca0 tx=0x7fa168046000 comp rx=0 tx=0).stop 2024-09-13T17:21:29.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.238+0000 7fa177e30740 1 -- 172.21.15.87:0/3273139719 shutdown_connections 2024-09-13T17:21:29.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.238+0000 7fa177e30740 1 --2- 172.21.15.87:0/3273139719 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55d3ff7a2250 0x55d3ff7a4640 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.238+0000 7fa177e30740 1 --2- 172.21.15.87:0/3273139719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3ff792950 0x55d3ff78f790 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.238+0000 7fa152ff5640 0 client.17631 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:21:29.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.238+0000 7fa177e30740 1 --2- 172.21.15.87:0/3273139719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d3ff7880b0 0x55d3ff78f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.238+0000 7fa177e30740 1 --2- 172.21.15.87:0/3273139719 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d3ff787790 0x55d3ff791f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.238+0000 7fa177e30740 1 -- 172.21.15.87:0/3273139719 >> 172.21.15.87:0/3273139719 conn(0x55d3ff783d00 msgr2=0x55d3ff782eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:29.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.238+0000 7fa177e30740 1 -- 172.21.15.87:0/3273139719 shutdown_connections 2024-09-13T17:21:29.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.238+0000 7fa177e30740 1 -- 172.21.15.87:0/3273139719 wait complete. 2024-09-13T17:21:29.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.238+0000 7fa177e30740 20 client.17631 trim_cache size 0 max 16384 2024-09-13T17:21:29.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.249+0000 7fa177e30740 1 Processor -- start 2024-09-13T17:21:29.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.249+0000 7fa177e30740 1 -- start start 2024-09-13T17:21:29.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.249+0000 7fa177e30740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3ff787790 0x55d3ff7836a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.249+0000 7fa177e30740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d3ff7880b0 0x55d3ff79e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.249+0000 7fa177e30740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d3ff792950 0x55d3ff79e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.249+0000 7fa177e30740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3ff78d780 con 0x55d3ff787790 2024-09-13T17:21:29.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.249+0000 7fa177e30740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3ff790710 con 0x55d3ff792950 2024-09-13T17:21:29.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.249+0000 7fa177e30740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3ff784900 con 0x55d3ff7880b0 2024-09-13T17:21:29.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.249+0000 7fa16ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3ff787790 0x55d3ff7836a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.249+0000 7fa16ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3ff787790 0x55d3ff7836a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57742/0 (socket says 172.21.15.87:57742) 2024-09-13T17:21:29.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.249+0000 7fa16ed9d640 1 -- 172.21.15.87:0/3072455510 learned_addr learned my addr 172.21.15.87:0/3072455510 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:21:29.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.249+0000 7fa16ed9d640 1 -- 172.21.15.87:0/3072455510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d3ff7880b0 msgr2=0x55d3ff79e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:29.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.249+0000 7fa16ed9d640 1 --2- 172.21.15.87:0/3072455510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d3ff7880b0 0x55d3ff79e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.249+0000 7fa16ed9d640 1 -- 172.21.15.87:0/3072455510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d3ff792950 msgr2=0x55d3ff79e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:29.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.249+0000 7fa16ed9d640 1 --2- 172.21.15.87:0/3072455510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d3ff792950 0x55d3ff79e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.249+0000 7fa16ed9d640 1 -- 172.21.15.87:0/3072455510 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d3ff68b770 con 0x55d3ff787790 2024-09-13T17:21:29.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.249+0000 7fa16ed9d640 1 --2- 172.21.15.87:0/3072455510 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3ff787790 0x55d3ff7836a0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fa160009b60 tx=0x7fa160005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df3f79a6039f220 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:29.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.249+0000 7fa155ffb640 1 -- 172.21.15.87:0/3072455510 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa160021040 con 0x55d3ff787790 2024-09-13T17:21:29.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.249+0000 7fa155ffb640 1 -- 172.21.15.87:0/3072455510 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa160022040 con 0x55d3ff787790 2024-09-13T17:21:29.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.249+0000 7fa155ffb640 1 -- 172.21.15.87:0/3072455510 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1600290d0 con 0x55d3ff787790 2024-09-13T17:21:29.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.250+0000 7fa177e30740 1 -- 172.21.15.87:0/3072455510 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3ff787790 msgr2=0x55d3ff7836a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:29.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.250+0000 7fa177e30740 1 --2- 172.21.15.87:0/3072455510 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3ff787790 0x55d3ff7836a0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fa160009b60 tx=0x7fa160005d50 comp rx=0 tx=0).stop 2024-09-13T17:21:29.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.250+0000 7fa177e30740 1 -- 172.21.15.87:0/3072455510 shutdown_connections 2024-09-13T17:21:29.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.250+0000 7fa177e30740 1 --2- 172.21.15.87:0/3072455510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d3ff792950 0x55d3ff79e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.250+0000 7fa177e30740 1 --2- 172.21.15.87:0/3072455510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d3ff7880b0 0x55d3ff79e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.250+0000 7fa177e30740 1 --2- 172.21.15.87:0/3072455510 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3ff787790 0x55d3ff7836a0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.250+0000 7fa177e30740 1 -- 172.21.15.87:0/3072455510 >> 172.21.15.87:0/3072455510 conn(0x55d3ff783d00 msgr2=0x55d3ff7a8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:29.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.250+0000 7fa177e30740 1 -- 172.21.15.87:0/3072455510 shutdown_connections 2024-09-13T17:21:29.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.250+0000 7fa177e30740 1 -- 172.21.15.87:0/3072455510 wait complete. 2024-09-13T17:21:29.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.250+0000 7fa177e30740 1 -- start start 2024-09-13T17:21:29.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.250+0000 7fa177e30740 1 Processor -- start 2024-09-13T17:21:29.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.251+0000 7fa177e30740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d3ff787790 0x55d3ff7957e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.251+0000 7fa177e30740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3ff7880b0 0x55d3ff795d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.251+0000 7fa177e30740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d3ff792950 0x55d3ff7f7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.251+0000 7fa177e30740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3ff7f7c70 con 0x55d3ff7880b0 2024-09-13T17:21:29.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.251+0000 7fa177e30740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3ff7f7db0 con 0x55d3ff787790 2024-09-13T17:21:29.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.251+0000 7fa177e30740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3ff7f7f20 con 0x55d3ff792950 2024-09-13T17:21:29.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.251+0000 7fa177e30740 10 client.0 _ll_register_callbacks cb 0x7fa1600095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:21:29.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.251+0000 7fa16e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3ff7880b0 0x55d3ff795d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.251+0000 7fa16e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3ff7880b0 0x55d3ff795d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57750/0 (socket says 172.21.15.87:57750) 2024-09-13T17:21:29.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.251+0000 7fa16e59c640 1 -- 172.21.15.87:0/2784511418 learned_addr learned my addr 172.21.15.87:0/2784511418 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:21:29.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.251+0000 7fa16ed9d640 1 --2- 172.21.15.87:0/2784511418 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d3ff787790 0x55d3ff7957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.251+0000 7fa16f59e640 1 --2- 172.21.15.87:0/2784511418 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d3ff792950 0x55d3ff7f7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.251+0000 7fa16e59c640 1 -- 172.21.15.87:0/2784511418 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d3ff792950 msgr2=0x55d3ff7f7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:29.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.251+0000 7fa16e59c640 1 --2- 172.21.15.87:0/2784511418 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d3ff792950 0x55d3ff7f7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.251+0000 7fa16e59c640 1 -- 172.21.15.87:0/2784511418 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d3ff787790 msgr2=0x55d3ff7957e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:29.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.251+0000 7fa16e59c640 1 --2- 172.21.15.87:0/2784511418 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d3ff787790 0x55d3ff7957e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.251+0000 7fa16e59c640 1 -- 172.21.15.87:0/2784511418 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d3ff6b2620 con 0x55d3ff7880b0 2024-09-13T17:21:29.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.251+0000 7fa16e59c640 1 --2- 172.21.15.87:0/2784511418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3ff7880b0 0x55d3ff795d20 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fa164099910 tx=0x7fa164099cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e60c554f4f3bd3f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:29.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.251+0000 7fa152ff5640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:21:29.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.251+0000 7fa152ff5640 1 -- 172.21.15.87:0/2784511418 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16406a180 con 0x55d3ff7880b0 2024-09-13T17:21:29.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.251+0000 7fa152ff5640 1 -- 172.21.15.87:0/2784511418 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fa1640ca4d0 con 0x55d3ff7880b0 2024-09-13T17:21:29.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.251+0000 7fa177e30740 1 -- 172.21.15.87:0/2784511418 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa1600035f0 con 0x55d3ff7880b0 2024-09-13T17:21:29.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.251+0000 7fa152ff5640 1 -- 172.21.15.87:0/2784511418 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1640ca690 con 0x55d3ff7880b0 2024-09-13T17:21:29.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.251+0000 7fa177e30740 10 client.17637 fetch_fsmap learned FSMap version 36 2024-09-13T17:21:29.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.251+0000 7fa177e30740 1 -- 172.21.15.87:0/2784511418 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55d3ff6b0e80 con 0x55d3ff7880b0 2024-09-13T17:21:29.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.252+0000 7fa152ff5640 1 -- 172.21.15.87:0/2784511418 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa1600035f0 con 0x55d3ff7880b0 2024-09-13T17:21:29.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.252+0000 7fa152ff5640 1 -- 172.21.15.87:0/2784511418 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fa1640a1ce0 con 0x55d3ff7880b0 2024-09-13T17:21:29.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.252+0000 7fa177e30740 10 client.17637 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:21:29.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.252+0000 7fa177e30740 10 client.17637 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:21:29.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.252+0000 7fa177e30740 20 client.17637 populate_metadata read hostname 'smithi087' 2024-09-13T17:21:29.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.252+0000 7fa177e30740 1 --2- 172.21.15.87:0/2784511418 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55d3ff7f9770 0x55d3ff7fbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.252+0000 7fa177e30740 4 client.17637 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:21:29.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.252+0000 7fa177e30740 1 -- 172.21.15.87:0/2784511418 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d3ff3de4e0 con 0x55d3ff7f9770 2024-09-13T17:21:29.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.252+0000 7fa16ed9d640 1 --2- 172.21.15.87:0/2784511418 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55d3ff7f9770 0x55d3ff7fbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.252+0000 7fa152ff5640 10 client.17637 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:21:29.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.252+0000 7fa16ed9d640 1 --2- 172.21.15.87:0/2784511418 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55d3ff7f9770 0x55d3ff7fbb90 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=688105b7bb3a40fb server_cookie=d26da3e2ee91f0f4 in_seq=0 out_seq=0 2024-09-13T17:21:29.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.252+0000 7fa152ff5640 1 -- 172.21.15.87:0/2784511418 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d3ff3de4e0 con 0x55d3ff7f9770 2024-09-13T17:21:29.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.253+0000 7fa152ff5640 10 client.17637 handle_command_reply: tid=0 2024-09-13T17:21:29.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.253+0000 7fa177e30740 1 client.17637 shutdown 2024-09-13T17:21:29.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.253+0000 7fa177e30740 1 -- 172.21.15.87:0/2784511418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3ff7880b0 msgr2=0x55d3ff795d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:29.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.253+0000 7fa177e30740 1 --2- 172.21.15.87:0/2784511418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3ff7880b0 0x55d3ff795d20 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fa164099910 tx=0x7fa164099cd0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.253+0000 7fa177e30740 1 -- 172.21.15.87:0/2784511418 shutdown_connections 2024-09-13T17:21:29.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.253+0000 7fa177e30740 1 --2- 172.21.15.87:0/2784511418 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55d3ff7f9770 0x55d3ff7fbb90 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.253+0000 7fa177e30740 1 --2- 172.21.15.87:0/2784511418 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d3ff792950 0x55d3ff7f7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.253+0000 7fa152ff5640 0 client.17637 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:21:29.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.253+0000 7fa177e30740 1 --2- 172.21.15.87:0/2784511418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d3ff7880b0 0x55d3ff795d20 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.253+0000 7fa177e30740 1 --2- 172.21.15.87:0/2784511418 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d3ff787790 0x55d3ff7957e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.253+0000 7fa177e30740 1 -- 172.21.15.87:0/2784511418 >> 172.21.15.87:0/2784511418 conn(0x55d3ff783d00 msgr2=0x55d3ff79e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:29.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.253+0000 7fa177e30740 1 -- 172.21.15.87:0/2784511418 shutdown_connections 2024-09-13T17:21:29.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.253+0000 7fa177e30740 1 -- 172.21.15.87:0/2784511418 wait complete. 2024-09-13T17:21:29.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.253+0000 7fa177e30740 20 client.17637 trim_cache size 0 max 16384 2024-09-13T17:21:29.262 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:21:29.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.253+0000 7fa175032640 1 -- 172.21.15.87:0/1308765197 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa1580a1200 msgr2=0x7fa1580a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:29.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.253+0000 7fa175032640 1 --2- 172.21.15.87:0/1308765197 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa1580a1200 0x7fa1580a36c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa168031810 tx=0x7fa168031540 comp rx=0 tx=0).stop 2024-09-13T17:21:29.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.253+0000 7fa175032640 1 -- 172.21.15.87:0/1308765197 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1701050e0 msgr2=0x7fa170196780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:29.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.253+0000 7fa175032640 1 --2- 172.21.15.87:0/1308765197 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1701050e0 0x7fa170196780 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fa16400d770 tx=0x7fa16400dc30 comp rx=0 tx=0).stop 2024-09-13T17:21:29.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.253+0000 7fa175032640 1 -- 172.21.15.87:0/1308765197 shutdown_connections 2024-09-13T17:21:29.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.253+0000 7fa175032640 1 --2- 172.21.15.87:0/1308765197 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa17019ab70 0x7fa17019b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.253+0000 7fa175032640 1 --2- 172.21.15.87:0/1308765197 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa1580a1200 0x7fa1580a36c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.253+0000 7fa175032640 1 --2- 172.21.15.87:0/1308765197 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1701050e0 0x7fa170196780 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.253+0000 7fa175032640 1 --2- 172.21.15.87:0/1308765197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1700fff90 0x7fa170196240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.253+0000 7fa175032640 1 -- 172.21.15.87:0/1308765197 >> 172.21.15.87:0/1308765197 conn(0x7fa1700fba20 msgr2=0x7fa1700fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:29.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.253+0000 7fa175032640 1 -- 172.21.15.87:0/1308765197 shutdown_connections 2024-09-13T17:21:29.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.253+0000 7fa175032640 1 -- 172.21.15.87:0/1308765197 wait complete. 2024-09-13T17:21:29.266 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:29 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/58008422' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:21:29.267 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-09-13T17:21:29.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:29 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/58008422' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:21:29.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:29 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/58008422' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:21:29.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.367+0000 7f45f9820640 1 -- 172.21.15.87:0/1459182342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45f40ff810 msgr2=0x7f45f4103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:29.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.367+0000 7f45f9820640 1 --2- 172.21.15.87:0/1459182342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45f40ff810 0x7f45f4103850 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009930 tx=0x7f45dc02a420 comp rx=0 tx=0).stop 2024-09-13T17:21:29.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.367+0000 7f45f9820640 1 -- 172.21.15.87:0/1459182342 shutdown_connections 2024-09-13T17:21:29.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.367+0000 7f45f9820640 1 --2- 172.21.15.87:0/1459182342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45f4103fb0 0x7f45f410bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.367+0000 7f45f9820640 1 --2- 172.21.15.87:0/1459182342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45f40ff810 0x7f45f4103850 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.367+0000 7f45f9820640 1 --2- 172.21.15.87:0/1459182342 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45f40fee60 0x7f45f40ff240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.367+0000 7f45f9820640 1 -- 172.21.15.87:0/1459182342 >> 172.21.15.87:0/1459182342 conn(0x7f45f4075c60 msgr2=0x7f45f40fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:29.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.367+0000 7f45f9820640 1 -- 172.21.15.87:0/1459182342 shutdown_connections 2024-09-13T17:21:29.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.367+0000 7f45f9820640 1 -- 172.21.15.87:0/1459182342 wait complete. 2024-09-13T17:21:29.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.368+0000 7f45f9820640 1 Processor -- start 2024-09-13T17:21:29.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.368+0000 7f45f9820640 1 -- start start 2024-09-13T17:21:29.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.368+0000 7f45f9820640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45f40fee60 0x7f45f4195190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.368+0000 7f45f9820640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45f4103fb0 0x7f45f41956d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.368+0000 7f45f9820640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45f4199a70 0x7f45f4199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.368+0000 7f45f9820640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f419a460 con 0x7f45f40fee60 2024-09-13T17:21:29.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.368+0000 7f45f9820640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f419a5d0 con 0x7f45f4103fb0 2024-09-13T17:21:29.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.368+0000 7f45f9820640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f419a740 con 0x7f45f4199a70 2024-09-13T17:21:29.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.368+0000 7f45f2ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45f40fee60 0x7f45f4195190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.369+0000 7f45f2ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45f40fee60 0x7f45f4195190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57770/0 (socket says 172.21.15.87:57770) 2024-09-13T17:21:29.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.369+0000 7f45f2ffd640 1 -- 172.21.15.87:0/2436494649 learned_addr learned my addr 172.21.15.87:0/2436494649 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:21:29.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.369+0000 7f45ea7fc640 1 --2- 172.21.15.87:0/2436494649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45f4103fb0 0x7f45f41956d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.369+0000 7f45f37fe640 1 --2- 172.21.15.87:0/2436494649 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45f4199a70 0x7f45f4199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.369+0000 7f45f2ffd640 1 -- 172.21.15.87:0/2436494649 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45f4199a70 msgr2=0x7f45f4199f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:29.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.369+0000 7f45f2ffd640 1 --2- 172.21.15.87:0/2436494649 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45f4199a70 0x7f45f4199f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.369+0000 7f45f2ffd640 1 -- 172.21.15.87:0/2436494649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45f4103fb0 msgr2=0x7f45f41956d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:29.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.369+0000 7f45f2ffd640 1 --2- 172.21.15.87:0/2436494649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45f4103fb0 0x7f45f41956d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.369+0000 7f45f2ffd640 1 -- 172.21.15.87:0/2436494649 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45dc009560 con 0x7f45f40fee60 2024-09-13T17:21:29.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.369+0000 7f45f37fe640 1 --2- 172.21.15.87:0/2436494649 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45f4199a70 0x7f45f4199f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:29.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.369+0000 7f45f2ffd640 1 --2- 172.21.15.87:0/2436494649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45f40fee60 0x7f45f4195190 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f45e400c920 tx=0x7f45e400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:29.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.369+0000 7f45f881e640 1 -- 172.21.15.87:0/2436494649 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e4007c70 con 0x7f45f40fee60 2024-09-13T17:21:29.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.369+0000 7f45f881e640 1 -- 172.21.15.87:0/2436494649 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f45e4007dd0 con 0x7f45f40fee60 2024-09-13T17:21:29.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.369+0000 7f45f881e640 1 -- 172.21.15.87:0/2436494649 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e40187c0 con 0x7f45f40fee60 2024-09-13T17:21:29.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.369+0000 7f45f9820640 1 -- 172.21.15.87:0/2436494649 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f41a1d20 con 0x7f45f40fee60 2024-09-13T17:21:29.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.369+0000 7f45f9820640 1 -- 172.21.15.87:0/2436494649 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f41a2150 con 0x7f45f40fee60 2024-09-13T17:21:29.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.371+0000 7f45f881e640 1 -- 172.21.15.87:0/2436494649 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f45e400f450 con 0x7f45f40fee60 2024-09-13T17:21:29.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.371+0000 7f45fc61d740 1 Processor -- start 2024-09-13T17:21:29.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.372+0000 7f45fc61d740 1 -- start start 2024-09-13T17:21:29.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.372+0000 7f45fc61d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5586a38f3690 0x5586a38f3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.372+0000 7f45fc61d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5586a38f3fb0 0x5586a3900620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.372+0000 7f45fc61d740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5586a3900b60 0x5586a3902f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.372+0000 7f45fc61d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a385dcc0 con 0x5586a38f3fb0 2024-09-13T17:21:29.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.372+0000 7f45fc61d740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a385b450 con 0x5586a3900b60 2024-09-13T17:21:29.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.372+0000 7f45fc61d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a3856d40 con 0x5586a38f3690 2024-09-13T17:21:29.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.372+0000 7f45f2ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5586a38f3fb0 0x5586a3900620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.372+0000 7f45f2ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5586a38f3fb0 0x5586a3900620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57784/0 (socket says 172.21.15.87:57784) 2024-09-13T17:21:29.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.372+0000 7f45f2ffd640 1 -- 172.21.15.87:0/2789530107 learned_addr learned my addr 172.21.15.87:0/2789530107 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:21:29.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.372+0000 7f45f881e640 1 --2- 172.21.15.87:0/2436494649 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f45e00a1200 0x7f45e00a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.372+0000 7f45ea7fc640 1 --2- 172.21.15.87:0/2789530107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5586a3900b60 0x5586a3902f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.372+0000 7f45f37fe640 1 --2- 172.21.15.87:0/2789530107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5586a38f3690 0x5586a38f3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.372+0000 7f45f37fe640 1 --2- 172.21.15.87:0/2436494649 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f45e00a1200 0x7f45e00a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.372+0000 7f45f881e640 1 -- 172.21.15.87:0/2436494649 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f45e40cd2d0 con 0x7f45f40fee60 2024-09-13T17:21:29.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.372+0000 7f45f2ffd640 1 -- 172.21.15.87:0/2789530107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5586a38f3690 msgr2=0x5586a38f3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:29.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.372+0000 7f45f2ffd640 1 --2- 172.21.15.87:0/2789530107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5586a38f3690 0x5586a38f3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.372+0000 7f45f2ffd640 1 -- 172.21.15.87:0/2789530107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5586a3900b60 msgr2=0x5586a3902f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:29.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.372+0000 7f45f2ffd640 1 --2- 172.21.15.87:0/2789530107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5586a3900b60 0x5586a3902f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.372+0000 7f45f2ffd640 1 -- 172.21.15.87:0/2789530107 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5586a381e620 con 0x5586a38f3fb0 2024-09-13T17:21:29.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.372+0000 7f45f2ffd640 1 --2- 172.21.15.87:0/2789530107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5586a38f3fb0 0x5586a3900620 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f45e4099cd0 tx=0x7f45e400a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=308ab9d58532ad4e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:29.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.373+0000 7f45f37fe640 1 --2- 172.21.15.87:0/2436494649 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f45e00a1200 0x7f45e00a36c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f45ec012790 tx=0x7f45ec005c80 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:29.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.373+0000 7f45e9ffb640 1 -- 172.21.15.87:0/2789530107 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e4099930 con 0x5586a38f3fb0 2024-09-13T17:21:29.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.373+0000 7f45e9ffb640 1 -- 172.21.15.87:0/2789530107 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f45e400fa90 con 0x5586a38f3fb0 2024-09-13T17:21:29.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.373+0000 7f45e9ffb640 1 -- 172.21.15.87:0/2789530107 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e40a2450 con 0x5586a38f3fb0 2024-09-13T17:21:29.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.373+0000 7f45fc61d740 1 -- 172.21.15.87:0/2789530107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5586a38f3fb0 msgr2=0x5586a3900620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:29.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.373+0000 7f45fc61d740 1 --2- 172.21.15.87:0/2789530107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5586a38f3fb0 0x5586a3900620 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f45e4099cd0 tx=0x7f45e400a560 comp rx=0 tx=0).stop 2024-09-13T17:21:29.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.373+0000 7f45fc61d740 1 -- 172.21.15.87:0/2789530107 shutdown_connections 2024-09-13T17:21:29.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.373+0000 7f45fc61d740 1 --2- 172.21.15.87:0/2789530107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5586a3900b60 0x5586a3902f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.373+0000 7f45fc61d740 1 --2- 172.21.15.87:0/2789530107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5586a38f3fb0 0x5586a3900620 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.373+0000 7f45fc61d740 1 --2- 172.21.15.87:0/2789530107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5586a38f3690 0x5586a38f3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.373+0000 7f45fc61d740 1 -- 172.21.15.87:0/2789530107 >> 172.21.15.87:0/2789530107 conn(0x5586a38efd00 msgr2=0x5586a38f00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:29.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.373+0000 7f45fc61d740 1 -- 172.21.15.87:0/2789530107 shutdown_connections 2024-09-13T17:21:29.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.373+0000 7f45fc61d740 1 -- 172.21.15.87:0/2789530107 wait complete. 2024-09-13T17:21:29.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.374+0000 7f45fc61d740 1 -- start start 2024-09-13T17:21:29.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.374+0000 7f45fc61d740 1 Processor -- start 2024-09-13T17:21:29.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.374+0000 7f45fc61d740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5586a38f3690 0x5586a39001d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.374+0000 7f45fc61d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5586a38f3fb0 0x5586a38fd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.374+0000 7f45fc61d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5586a3900b60 0x5586a38fda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.374+0000 7f45fc61d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a3815180 con 0x5586a38f3fb0 2024-09-13T17:21:29.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.374+0000 7f45fc61d740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a352f430 con 0x5586a38f3690 2024-09-13T17:21:29.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.374+0000 7f45fc61d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a37da5e0 con 0x5586a3900b60 2024-09-13T17:21:29.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.374+0000 7f45fc61d740 10 client.0 _ll_register_callbacks cb 0x5586a3846aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:21:29.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.374+0000 7f45ea7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5586a38f3fb0 0x5586a38fd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.374+0000 7f45ea7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5586a38f3fb0 0x5586a38fd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57794/0 (socket says 172.21.15.87:57794) 2024-09-13T17:21:29.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.374+0000 7f45ea7fc640 1 -- 172.21.15.87:0/2111498824 learned_addr learned my addr 172.21.15.87:0/2111498824 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:21:29.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.374+0000 7f45f2ffd640 1 --2- 172.21.15.87:0/2111498824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5586a38f3690 0x5586a39001d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.375+0000 7f45f37fe640 1 --2- 172.21.15.87:0/2111498824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5586a3900b60 0x5586a38fda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.375+0000 7f45ea7fc640 1 -- 172.21.15.87:0/2111498824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5586a3900b60 msgr2=0x5586a38fda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:29.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.375+0000 7f45ea7fc640 1 --2- 172.21.15.87:0/2111498824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5586a3900b60 0x5586a38fda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.375+0000 7f45ea7fc640 1 -- 172.21.15.87:0/2111498824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5586a38f3690 msgr2=0x5586a39001d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:29.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.375+0000 7f45ea7fc640 1 --2- 172.21.15.87:0/2111498824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5586a38f3690 0x5586a39001d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.375+0000 7f45ea7fc640 1 -- 172.21.15.87:0/2111498824 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f41a2150 con 0x5586a38f3fb0 2024-09-13T17:21:29.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.375+0000 7f45f2ffd640 1 --2- 172.21.15.87:0/2111498824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5586a38f3690 0x5586a39001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:21:29.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.375+0000 7f45f37fe640 1 --2- 172.21.15.87:0/2111498824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5586a3900b60 0x5586a38fda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:29.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.375+0000 7f45ea7fc640 1 --2- 172.21.15.87:0/2111498824 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5586a38f3fb0 0x5586a38fd540 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f45dc005ec0 tx=0x7f45dc031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4977b5f97ef44b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:29.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.375+0000 7f45d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:21:29.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.375+0000 7f45d2ffd640 1 -- 172.21.15.87:0/2111498824 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc004240 con 0x5586a38f3fb0 2024-09-13T17:21:29.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.375+0000 7f45d2ffd640 1 -- 172.21.15.87:0/2111498824 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f45dc0043a0 con 0x5586a38f3fb0 2024-09-13T17:21:29.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.375+0000 7f45fc61d740 1 -- 172.21.15.87:0/2111498824 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5586a3880b80 con 0x5586a38f3fb0 2024-09-13T17:21:29.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.375+0000 7f45d2ffd640 1 -- 172.21.15.87:0/2111498824 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45dc005030 con 0x5586a38f3fb0 2024-09-13T17:21:29.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.375+0000 7f45fc61d740 10 client.17649 fetch_fsmap learned FSMap version 36 2024-09-13T17:21:29.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.375+0000 7f45fc61d740 1 -- 172.21.15.87:0/2111498824 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5586a38553c0 con 0x5586a38f3fb0 2024-09-13T17:21:29.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.375+0000 7f45d2ffd640 1 -- 172.21.15.87:0/2111498824 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x5586a3880b80 con 0x5586a38f3fb0 2024-09-13T17:21:29.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.375+0000 7f45d2ffd640 1 -- 172.21.15.87:0/2111498824 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f45dc004bb0 con 0x5586a38f3fb0 2024-09-13T17:21:29.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.375+0000 7f45fc61d740 10 client.17649 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:21:29.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.375+0000 7f45fc61d740 10 client.17649 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:21:29.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.375+0000 7f45fc61d740 20 client.17649 populate_metadata read hostname 'smithi087' 2024-09-13T17:21:29.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.375+0000 7f45fc61d740 1 --2- 172.21.15.87:0/2111498824 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5586a39105a0 0x5586a39129c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.375+0000 7f45fc61d740 4 client.17649 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:21:29.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.375+0000 7f45fc61d740 1 -- 172.21.15.87:0/2111498824 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5586a38491f0 con 0x5586a39105a0 2024-09-13T17:21:29.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.376+0000 7f45f2ffd640 1 --2- 172.21.15.87:0/2111498824 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5586a39105a0 0x5586a39129c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.376+0000 7f45d2ffd640 10 client.17649 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:21:29.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.376+0000 7f45f2ffd640 1 --2- 172.21.15.87:0/2111498824 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5586a39105a0 0x5586a39129c0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c776d80f78edc012 server_cookie=a608ee8190a3ed6f in_seq=0 out_seq=0 2024-09-13T17:21:29.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.377+0000 7f45d2ffd640 1 -- 172.21.15.87:0/2111498824 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5586a38491f0 con 0x5586a39105a0 2024-09-13T17:21:29.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.377+0000 7f45d2ffd640 10 client.17649 handle_command_reply: tid=0 2024-09-13T17:21:29.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.377+0000 7f45fc61d740 1 client.17649 shutdown 2024-09-13T17:21:29.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.377+0000 7f45fc61d740 1 -- 172.21.15.87:0/2111498824 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5586a38f3fb0 msgr2=0x5586a38fd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:29.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.377+0000 7f45fc61d740 1 --2- 172.21.15.87:0/2111498824 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5586a38f3fb0 0x5586a38fd540 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f45dc005ec0 tx=0x7f45dc031630 comp rx=0 tx=0).stop 2024-09-13T17:21:29.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.377+0000 7f45fc61d740 1 -- 172.21.15.87:0/2111498824 shutdown_connections 2024-09-13T17:21:29.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.377+0000 7f45fc61d740 1 --2- 172.21.15.87:0/2111498824 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5586a39105a0 0x5586a39129c0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.377+0000 7f45fc61d740 1 --2- 172.21.15.87:0/2111498824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5586a3900b60 0x5586a38fda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.377+0000 7f45fc61d740 1 --2- 172.21.15.87:0/2111498824 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5586a38f3fb0 0x5586a38fd540 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.377+0000 7f45fc61d740 1 --2- 172.21.15.87:0/2111498824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5586a38f3690 0x5586a39001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.377+0000 7f45d2ffd640 0 client.17649 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:21:29.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.377+0000 7f45fc61d740 1 -- 172.21.15.87:0/2111498824 >> 172.21.15.87:0/2111498824 conn(0x5586a38efd00 msgr2=0x5586a38f5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:29.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.377+0000 7f45fc61d740 1 -- 172.21.15.87:0/2111498824 shutdown_connections 2024-09-13T17:21:29.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.377+0000 7f45fc61d740 1 -- 172.21.15.87:0/2111498824 wait complete. 2024-09-13T17:21:29.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.377+0000 7f45fc61d740 20 client.17649 trim_cache size 0 max 16384 2024-09-13T17:21:29.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.388+0000 7f45fc61d740 1 Processor -- start 2024-09-13T17:21:29.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.388+0000 7f45fc61d740 1 -- start start 2024-09-13T17:21:29.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.388+0000 7f45fc61d740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5586a38f3690 0x5586a38ef6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.388+0000 7f45fc61d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5586a38f3fb0 0x5586a39078b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.388+0000 7f45fc61d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5586a3900b60 0x5586a3907df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.388+0000 7f45fc61d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a38f3510 con 0x5586a38f3fb0 2024-09-13T17:21:29.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.388+0000 7f45fc61d740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a38fe4a0 con 0x5586a38f3690 2024-09-13T17:21:29.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.388+0000 7f45fc61d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a38fddf0 con 0x5586a3900b60 2024-09-13T17:21:29.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.388+0000 7f45ea7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5586a38f3fb0 0x5586a39078b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.389+0000 7f45ea7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5586a38f3fb0 0x5586a39078b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57808/0 (socket says 172.21.15.87:57808) 2024-09-13T17:21:29.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.389+0000 7f45ea7fc640 1 -- 172.21.15.87:0/3290274487 learned_addr learned my addr 172.21.15.87:0/3290274487 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:21:29.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.389+0000 7f45f2ffd640 1 --2- 172.21.15.87:0/3290274487 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5586a38f3690 0x5586a38ef6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.389+0000 7f45f37fe640 1 --2- 172.21.15.87:0/3290274487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5586a3900b60 0x5586a3907df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.389+0000 7f45ea7fc640 1 -- 172.21.15.87:0/3290274487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5586a3900b60 msgr2=0x5586a3907df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:29.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.389+0000 7f45ea7fc640 1 --2- 172.21.15.87:0/3290274487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5586a3900b60 0x5586a3907df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.389+0000 7f45ea7fc640 1 -- 172.21.15.87:0/3290274487 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5586a38f3690 msgr2=0x5586a38ef6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:29.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.389+0000 7f45ea7fc640 1 --2- 172.21.15.87:0/3290274487 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5586a38f3690 0x5586a38ef6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.389+0000 7f45ea7fc640 1 -- 172.21.15.87:0/3290274487 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5586a37f7770 con 0x5586a38f3fb0 2024-09-13T17:21:29.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.389+0000 7f45f37fe640 1 --2- 172.21.15.87:0/3290274487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5586a3900b60 0x5586a3907df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:29.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.389+0000 7f45ea7fc640 1 --2- 172.21.15.87:0/3290274487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5586a38f3fb0 0x5586a39078b0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f45dc02aa10 tx=0x7f45dc02a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d7c9b610992d30 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:29.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.389+0000 7f45eaffd640 1 -- 172.21.15.87:0/3290274487 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc03cc80 con 0x5586a38f3fb0 2024-09-13T17:21:29.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.389+0000 7f45eaffd640 1 -- 172.21.15.87:0/3290274487 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f45dc041070 con 0x5586a38f3fb0 2024-09-13T17:21:29.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.389+0000 7f45eaffd640 1 -- 172.21.15.87:0/3290274487 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc004fc0 con 0x5586a38f3fb0 2024-09-13T17:21:29.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.390+0000 7f45fc61d740 1 -- 172.21.15.87:0/3290274487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5586a38f3fb0 msgr2=0x5586a39078b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:29.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.390+0000 7f45fc61d740 1 --2- 172.21.15.87:0/3290274487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5586a38f3fb0 0x5586a39078b0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f45dc02aa10 tx=0x7f45dc02a420 comp rx=0 tx=0).stop 2024-09-13T17:21:29.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.390+0000 7f45fc61d740 1 -- 172.21.15.87:0/3290274487 shutdown_connections 2024-09-13T17:21:29.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.390+0000 7f45fc61d740 1 --2- 172.21.15.87:0/3290274487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5586a3900b60 0x5586a3907df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.390+0000 7f45fc61d740 1 --2- 172.21.15.87:0/3290274487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5586a38f3fb0 0x5586a39078b0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.390+0000 7f45fc61d740 1 --2- 172.21.15.87:0/3290274487 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5586a38f3690 0x5586a38ef6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.390+0000 7f45fc61d740 1 -- 172.21.15.87:0/3290274487 >> 172.21.15.87:0/3290274487 conn(0x5586a38efd00 msgr2=0x5586a38fbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:29.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.390+0000 7f45fc61d740 1 -- 172.21.15.87:0/3290274487 shutdown_connections 2024-09-13T17:21:29.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.390+0000 7f45fc61d740 1 -- 172.21.15.87:0/3290274487 wait complete. 2024-09-13T17:21:29.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.390+0000 7f45fc61d740 1 -- start start 2024-09-13T17:21:29.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.390+0000 7f45fc61d740 1 Processor -- start 2024-09-13T17:21:29.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.390+0000 7f45fc61d740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5586a38f3690 0x5586a3907930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.390+0000 7f45fc61d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5586a38f3fb0 0x5586a3903ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.390+0000 7f45fc61d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5586a3900b60 0x5586a39043e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.390+0000 7f45fc61d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a3904920 con 0x5586a3900b60 2024-09-13T17:21:29.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.390+0000 7f45fc61d740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a3904a90 con 0x5586a38f3690 2024-09-13T17:21:29.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.390+0000 7f45fc61d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a3904c50 con 0x5586a38f3fb0 2024-09-13T17:21:29.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.390+0000 7f45fc61d740 10 client.0 _ll_register_callbacks cb 0x7f45e4096140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:21:29.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.391+0000 7f45f37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5586a3900b60 0x5586a39043e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.391+0000 7f45f37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5586a3900b60 0x5586a39043e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57824/0 (socket says 172.21.15.87:57824) 2024-09-13T17:21:29.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.391+0000 7f45f37fe640 1 -- 172.21.15.87:0/80233487 learned_addr learned my addr 172.21.15.87:0/80233487 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:21:29.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.391+0000 7f45f2ffd640 1 --2- 172.21.15.87:0/80233487 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5586a38f3690 0x5586a3907930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.391+0000 7f45ea7fc640 1 --2- 172.21.15.87:0/80233487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5586a38f3fb0 0x5586a3903ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.391+0000 7f45f37fe640 1 -- 172.21.15.87:0/80233487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5586a38f3fb0 msgr2=0x5586a3903ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:29.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.391+0000 7f45f37fe640 1 --2- 172.21.15.87:0/80233487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5586a38f3fb0 0x5586a3903ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.391+0000 7f45f37fe640 1 -- 172.21.15.87:0/80233487 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5586a38f3690 msgr2=0x5586a3907930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:29.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.391+0000 7f45f37fe640 1 --2- 172.21.15.87:0/80233487 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5586a38f3690 0x5586a3907930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.391+0000 7f45f37fe640 1 -- 172.21.15.87:0/80233487 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5586a38553c0 con 0x5586a3900b60 2024-09-13T17:21:29.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.391+0000 7f45f37fe640 1 --2- 172.21.15.87:0/80233487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5586a3900b60 0x5586a39043e0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f45ec006010 tx=0x7f45ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d55fd5b9b81c0c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:29.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.391+0000 7f45d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:21:29.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.391+0000 7f45d2ffd640 1 -- 172.21.15.87:0/80233487 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec021070 con 0x5586a3900b60 2024-09-13T17:21:29.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.391+0000 7f45d2ffd640 1 -- 172.21.15.87:0/80233487 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f45ec011b50 con 0x5586a3900b60 2024-09-13T17:21:29.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.391+0000 7f45fc61d740 1 -- 172.21.15.87:0/80233487 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f45e400fa90 con 0x5586a3900b60 2024-09-13T17:21:29.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.391+0000 7f45d2ffd640 1 -- 172.21.15.87:0/80233487 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45ec011d10 con 0x5586a3900b60 2024-09-13T17:21:29.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.391+0000 7f45fc61d740 10 client.17655 fetch_fsmap learned FSMap version 36 2024-09-13T17:21:29.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.391+0000 7f45fc61d740 1 -- 172.21.15.87:0/80233487 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5586a381ce80 con 0x5586a3900b60 2024-09-13T17:21:29.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.392+0000 7f45d2ffd640 1 -- 172.21.15.87:0/80233487 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f45e400fa90 con 0x5586a3900b60 2024-09-13T17:21:29.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.392+0000 7f45d2ffd640 1 -- 172.21.15.87:0/80233487 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f45ec01b3f0 con 0x5586a3900b60 2024-09-13T17:21:29.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.392+0000 7f45fc61d740 10 client.17655 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:21:29.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.392+0000 7f45fc61d740 10 client.17655 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:21:29.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.392+0000 7f45fc61d740 20 client.17655 populate_metadata read hostname 'smithi087' 2024-09-13T17:21:29.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.392+0000 7f45fc61d740 1 --2- 172.21.15.87:0/80233487 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5586a3967f10 0x5586a396a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:29.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.392+0000 7f45fc61d740 4 client.17655 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:21:29.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.392+0000 7f45fc61d740 1 -- 172.21.15.87:0/80233487 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5586a354a4e0 con 0x5586a3967f10 2024-09-13T17:21:29.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.392+0000 7f45f2ffd640 1 --2- 172.21.15.87:0/80233487 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5586a3967f10 0x5586a396a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:29.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.392+0000 7f45d2ffd640 10 client.17655 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:21:29.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.392+0000 7f45f2ffd640 1 --2- 172.21.15.87:0/80233487 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5586a3967f10 0x5586a396a330 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9316406ee76ca1b server_cookie=8cb755047d823caf in_seq=0 out_seq=0 2024-09-13T17:21:29.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.393+0000 7f45d2ffd640 1 -- 172.21.15.87:0/80233487 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5586a354a4e0 con 0x5586a3967f10 2024-09-13T17:21:29.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.393+0000 7f45d2ffd640 10 client.17655 handle_command_reply: tid=0 2024-09-13T17:21:29.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.393+0000 7f45fc61d740 1 client.17655 shutdown 2024-09-13T17:21:29.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.393+0000 7f45fc61d740 1 -- 172.21.15.87:0/80233487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5586a3900b60 msgr2=0x5586a39043e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:29.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.393+0000 7f45fc61d740 1 --2- 172.21.15.87:0/80233487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5586a3900b60 0x5586a39043e0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f45ec006010 tx=0x7f45ec004a40 comp rx=0 tx=0).stop 2024-09-13T17:21:29.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.393+0000 7f45fc61d740 1 -- 172.21.15.87:0/80233487 shutdown_connections 2024-09-13T17:21:29.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.393+0000 7f45fc61d740 1 --2- 172.21.15.87:0/80233487 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5586a3967f10 0x5586a396a330 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.393+0000 7f45fc61d740 1 --2- 172.21.15.87:0/80233487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5586a3900b60 0x5586a39043e0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.393+0000 7f45fc61d740 1 --2- 172.21.15.87:0/80233487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5586a38f3fb0 0x5586a3903ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.393+0000 7f45d2ffd640 0 client.17655 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:21:29.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.393+0000 7f45fc61d740 1 --2- 172.21.15.87:0/80233487 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5586a38f3690 0x5586a3907930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.393+0000 7f45fc61d740 1 -- 172.21.15.87:0/80233487 >> 172.21.15.87:0/80233487 conn(0x5586a38efd00 msgr2=0x5586a38f85c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:29.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.393+0000 7f45fc61d740 1 -- 172.21.15.87:0/80233487 shutdown_connections 2024-09-13T17:21:29.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.393+0000 7f45fc61d740 1 -- 172.21.15.87:0/80233487 wait complete. 2024-09-13T17:21:29.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.393+0000 7f45fc61d740 20 client.17655 trim_cache size 0 max 16384 2024-09-13T17:21:29.406 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:21:29.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.393+0000 7f45f9820640 1 -- 172.21.15.87:0/2436494649 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f45e00a1200 msgr2=0x7f45e00a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:29.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.393+0000 7f45f9820640 1 --2- 172.21.15.87:0/2436494649 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f45e00a1200 0x7f45e00a36c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f45ec012790 tx=0x7f45ec005c80 comp rx=0 tx=0).stop 2024-09-13T17:21:29.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.393+0000 7f45f9820640 1 -- 172.21.15.87:0/2436494649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45f40fee60 msgr2=0x7f45f4195190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:29.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.393+0000 7f45f9820640 1 --2- 172.21.15.87:0/2436494649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45f40fee60 0x7f45f4195190 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f45e400c920 tx=0x7f45e400cde0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.394+0000 7f45f9820640 1 -- 172.21.15.87:0/2436494649 shutdown_connections 2024-09-13T17:21:29.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.394+0000 7f45f9820640 1 --2- 172.21.15.87:0/2436494649 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45f4199a70 0x7f45f4199f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.394+0000 7f45f9820640 1 --2- 172.21.15.87:0/2436494649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45f4103fb0 0x7f45f41956d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.394+0000 7f45f9820640 1 --2- 172.21.15.87:0/2436494649 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f45e00a1200 0x7f45e00a36c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.394+0000 7f45f9820640 1 --2- 172.21.15.87:0/2436494649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45f40fee60 0x7f45f4195190 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:29.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.394+0000 7f45f9820640 1 -- 172.21.15.87:0/2436494649 >> 172.21.15.87:0/2436494649 conn(0x7f45f4075c60 msgr2=0x7f45f40fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:29.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.394+0000 7f45f9820640 1 -- 172.21.15.87:0/2436494649 shutdown_connections 2024-09-13T17:21:29.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:29.394+0000 7f45f9820640 1 -- 172.21.15.87:0/2436494649 wait complete. 2024-09-13T17:21:30.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:30 smithi149 ceph-mon[35496]: pgmap v237: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-13T17:21:30.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:30 smithi118 ceph-mon[34374]: pgmap v237: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-13T17:21:30.411 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-13T17:21:30.411 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-09-13T17:21:30.436 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:30 smithi087 ceph-mon[30934]: pgmap v237: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-13T17:21:30.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.520+0000 7ff80f99c640 1 -- 172.21.15.87:0/1407773875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff808100940 msgr2=0x7ff808104980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:30.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.520+0000 7ff80f99c640 1 --2- 172.21.15.87:0/1407773875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff808100940 0x7ff808104980 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8009930 tx=0x7ff7f802a420 comp rx=0 tx=0).stop 2024-09-13T17:21:30.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.520+0000 7ff80f99c640 1 -- 172.21.15.87:0/1407773875 shutdown_connections 2024-09-13T17:21:30.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.520+0000 7ff80f99c640 1 --2- 172.21.15.87:0/1407773875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8081050e0 0x7ff80810cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.520+0000 7ff80f99c640 1 --2- 172.21.15.87:0/1407773875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff808100940 0x7ff808104980 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.520+0000 7ff80f99c640 1 --2- 172.21.15.87:0/1407773875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8080fff90 0x7ff808100370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.520+0000 7ff80f99c640 1 -- 172.21.15.87:0/1407773875 >> 172.21.15.87:0/1407773875 conn(0x7ff8080fba20 msgr2=0x7ff8080fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:30.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.520+0000 7ff80f99c640 1 -- 172.21.15.87:0/1407773875 shutdown_connections 2024-09-13T17:21:30.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.520+0000 7ff80f99c640 1 -- 172.21.15.87:0/1407773875 wait complete. 2024-09-13T17:21:30.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.520+0000 7ff80f99c640 1 Processor -- start 2024-09-13T17:21:30.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.520+0000 7ff80f99c640 1 -- start start 2024-09-13T17:21:30.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.520+0000 7ff80f99c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8080fff90 0x7ff8080727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.520+0000 7ff80f99c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8081050e0 0x7ff808072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.521+0000 7ff80f99c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff808073230 0x7ff8081a4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.521+0000 7ff80f99c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8081a4ac0 con 0x7ff8080fff90 2024-09-13T17:21:30.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.521+0000 7ff80f99c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8081a4c30 con 0x7ff808073230 2024-09-13T17:21:30.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.521+0000 7ff80f99c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8081a4df0 con 0x7ff8081050e0 2024-09-13T17:21:30.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.521+0000 7ff80d738640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8080fff90 0x7ff8080727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:30.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.521+0000 7ff80d738640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8080fff90 0x7ff8080727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57856/0 (socket says 172.21.15.87:57856) 2024-09-13T17:21:30.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.521+0000 7ff80d738640 1 -- 172.21.15.87:0/3905523117 learned_addr learned my addr 172.21.15.87:0/3905523117 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:21:30.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.521+0000 7ff80cf37640 1 --2- 172.21.15.87:0/3905523117 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8081050e0 0x7ff808072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:30.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.521+0000 7ff80d738640 1 -- 172.21.15.87:0/3905523117 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8081050e0 msgr2=0x7ff808072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:30.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.521+0000 7ff80df39640 1 --2- 172.21.15.87:0/3905523117 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff808073230 0x7ff8081a4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:30.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.521+0000 7ff80d738640 1 --2- 172.21.15.87:0/3905523117 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8081050e0 0x7ff808072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.521+0000 7ff80d738640 1 -- 172.21.15.87:0/3905523117 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff808073230 msgr2=0x7ff8081a4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:30.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.521+0000 7ff80d738640 1 --2- 172.21.15.87:0/3905523117 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff808073230 0x7ff8081a4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.521+0000 7ff80d738640 1 -- 172.21.15.87:0/3905523117 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f8009560 con 0x7ff8080fff90 2024-09-13T17:21:30.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.521+0000 7ff80df39640 1 --2- 172.21.15.87:0/3905523117 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff808073230 0x7ff8081a4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:30.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.521+0000 7ff80d738640 1 --2- 172.21.15.87:0/3905523117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8080fff90 0x7ff8080727b0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7ff80400d770 tx=0x7ff80400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:30.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.521+0000 7ff7fe7fc640 1 -- 172.21.15.87:0/3905523117 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff804009c30 con 0x7ff8080fff90 2024-09-13T17:21:30.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.521+0000 7ff7fe7fc640 1 -- 172.21.15.87:0/3905523117 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff80400de80 con 0x7ff8080fff90 2024-09-13T17:21:30.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.521+0000 7ff80f99c640 1 -- 172.21.15.87:0/3905523117 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8081a50d0 con 0x7ff8080fff90 2024-09-13T17:21:30.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.521+0000 7ff7fe7fc640 1 -- 172.21.15.87:0/3905523117 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff804004e00 con 0x7ff8080fff90 2024-09-13T17:21:30.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.521+0000 7ff80f99c640 1 -- 172.21.15.87:0/3905523117 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8081a5590 con 0x7ff8080fff90 2024-09-13T17:21:30.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.523+0000 7ff7fe7fc640 1 -- 172.21.15.87:0/3905523117 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7ff804004f60 con 0x7ff8080fff90 2024-09-13T17:21:30.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.524+0000 7ff8126c0740 1 Processor -- start 2024-09-13T17:21:30.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.524+0000 7ff8126c0740 1 -- start start 2024-09-13T17:21:30.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.524+0000 7ff8126c0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a85b697c0 0x560a85b69ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.524+0000 7ff8126c0740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a85b6a0e0 0x560a85b74440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.524+0000 7ff8126c0740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a85b74980 0x560a85b76d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.524+0000 7ff8126c0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a85ad4c60 con 0x560a85b697c0 2024-09-13T17:21:30.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.524+0000 7ff8126c0740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a85ad23f0 con 0x560a85b6a0e0 2024-09-13T17:21:30.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.524+0000 7ff8126c0740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a85acdce0 con 0x560a85b74980 2024-09-13T17:21:30.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.524+0000 7ff80df39640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a85b697c0 0x560a85b69ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:30.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.524+0000 7ff7fe7fc640 1 --2- 172.21.15.87:0/3905523117 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff7f40a1200 0x7ff7f40a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.524+0000 7ff80df39640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a85b697c0 0x560a85b69ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57870/0 (socket says 172.21.15.87:57870) 2024-09-13T17:21:30.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.524+0000 7ff80df39640 1 -- 172.21.15.87:0/1174212226 learned_addr learned my addr 172.21.15.87:0/1174212226 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:21:30.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.525+0000 7ff80d738640 1 --2- 172.21.15.87:0/1174212226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a85b6a0e0 0x560a85b74440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:30.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.525+0000 7ff80df39640 1 --2- 172.21.15.87:0/3905523117 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff7f40a1200 0x7ff7f40a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:30.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.525+0000 7ff80cf37640 1 --2- 172.21.15.87:0/1174212226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a85b74980 0x560a85b76d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:30.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.525+0000 7ff7fe7fc640 1 -- 172.21.15.87:0/3905523117 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7ff8040ccca0 con 0x7ff8080fff90 2024-09-13T17:21:30.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.525+0000 7ff80df39640 1 -- 172.21.15.87:0/1174212226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a85b74980 msgr2=0x560a85b76d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:30.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.525+0000 7ff80df39640 1 --2- 172.21.15.87:0/1174212226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a85b74980 0x560a85b76d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.525+0000 7ff80df39640 1 -- 172.21.15.87:0/1174212226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a85b6a0e0 msgr2=0x560a85b74440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:30.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.525+0000 7ff80df39640 1 --2- 172.21.15.87:0/1174212226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a85b6a0e0 0x560a85b74440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.525+0000 7ff80df39640 1 -- 172.21.15.87:0/1174212226 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a85a89970 con 0x560a85b697c0 2024-09-13T17:21:30.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.525+0000 7ff80d738640 1 --2- 172.21.15.87:0/1174212226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a85b6a0e0 0x560a85b74440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:21:30.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.525+0000 7ff80df39640 1 --2- 172.21.15.87:0/1174212226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a85b697c0 0x560a85b69ba0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7ff800014930 tx=0x7ff800014df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=766f8a57500a8586 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:30.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.525+0000 7ff7f37fe640 1 -- 172.21.15.87:0/1174212226 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80001ce90 con 0x560a85b697c0 2024-09-13T17:21:30.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.525+0000 7ff7f37fe640 1 -- 172.21.15.87:0/1174212226 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff800008df0 con 0x560a85b697c0 2024-09-13T17:21:30.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.525+0000 7ff7f37fe640 1 -- 172.21.15.87:0/1174212226 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff800013c90 con 0x560a85b697c0 2024-09-13T17:21:30.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.526+0000 7ff8126c0740 1 -- 172.21.15.87:0/1174212226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a85b697c0 msgr2=0x560a85b69ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:30.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.526+0000 7ff80df39640 1 --2- 172.21.15.87:0/3905523117 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff7f40a1200 0x7ff7f40a36c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff80001e000 tx=0x7ff80001a000 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:30.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.526+0000 7ff8126c0740 1 --2- 172.21.15.87:0/1174212226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a85b697c0 0x560a85b69ba0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7ff800014930 tx=0x7ff800014df0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.526+0000 7ff8126c0740 1 -- 172.21.15.87:0/1174212226 shutdown_connections 2024-09-13T17:21:30.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.526+0000 7ff8126c0740 1 --2- 172.21.15.87:0/1174212226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a85b74980 0x560a85b76d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.526+0000 7ff8126c0740 1 --2- 172.21.15.87:0/1174212226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a85b6a0e0 0x560a85b74440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.526+0000 7ff8126c0740 1 --2- 172.21.15.87:0/1174212226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a85b697c0 0x560a85b69ba0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.526+0000 7ff8126c0740 1 -- 172.21.15.87:0/1174212226 >> 172.21.15.87:0/1174212226 conn(0x560a85b65d50 msgr2=0x560a85b66130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:30.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.526+0000 7ff8126c0740 1 -- 172.21.15.87:0/1174212226 shutdown_connections 2024-09-13T17:21:30.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.526+0000 7ff8126c0740 1 -- 172.21.15.87:0/1174212226 wait complete. 2024-09-13T17:21:30.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.526+0000 7ff8126c0740 1 -- start start 2024-09-13T17:21:30.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.526+0000 7ff8126c0740 1 Processor -- start 2024-09-13T17:21:30.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.527+0000 7ff8126c0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a85b697c0 0x560a85b74400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.527+0000 7ff8126c0740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a85b6a0e0 0x560a85b716f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.527+0000 7ff8126c0740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a85b74980 0x560a85b71e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.527+0000 7ff8126c0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a85a8bf80 con 0x560a85b697c0 2024-09-13T17:21:30.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.527+0000 7ff8126c0740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a85a8bc20 con 0x560a85b74980 2024-09-13T17:21:30.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.527+0000 7ff8126c0740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a85a58ab0 con 0x560a85b6a0e0 2024-09-13T17:21:30.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.527+0000 7ff80d738640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a85b697c0 0x560a85b74400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:30.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.527+0000 7ff8126c0740 10 client.0 _ll_register_callbacks cb 0x560a85ac7350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:21:30.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.527+0000 7ff80d738640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a85b697c0 0x560a85b74400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57880/0 (socket says 172.21.15.87:57880) 2024-09-13T17:21:30.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.527+0000 7ff80d738640 1 -- 172.21.15.87:0/3428397205 learned_addr learned my addr 172.21.15.87:0/3428397205 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:21:30.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.527+0000 7ff80df39640 1 --2- 172.21.15.87:0/3428397205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a85b74980 0x560a85b71e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:30.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.527+0000 7ff80cf37640 1 --2- 172.21.15.87:0/3428397205 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a85b6a0e0 0x560a85b716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:30.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.527+0000 7ff80d738640 1 -- 172.21.15.87:0/3428397205 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a85b6a0e0 msgr2=0x560a85b716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:30.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.527+0000 7ff80d738640 1 --2- 172.21.15.87:0/3428397205 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a85b6a0e0 0x560a85b716f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.527+0000 7ff80d738640 1 -- 172.21.15.87:0/3428397205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a85b74980 msgr2=0x560a85b71e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:30.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.527+0000 7ff80d738640 1 --2- 172.21.15.87:0/3428397205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a85b74980 0x560a85b71e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.527+0000 7ff80d738640 1 -- 172.21.15.87:0/3428397205 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff800014510 con 0x560a85b697c0 2024-09-13T17:21:30.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.527+0000 7ff80cf37640 1 --2- 172.21.15.87:0/3428397205 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a85b6a0e0 0x560a85b716f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:30.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.527+0000 7ff80d738640 1 --2- 172.21.15.87:0/3428397205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a85b697c0 0x560a85b74400 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7ff80400d740 tx=0x7ff804068c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6b341adea6fbe7b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:30.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.527+0000 7ff7f0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:21:30.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.527+0000 7ff7f0ff9640 1 -- 172.21.15.87:0/3428397205 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80409d770 con 0x560a85b697c0 2024-09-13T17:21:30.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.527+0000 7ff7f0ff9640 1 -- 172.21.15.87:0/3428397205 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7ff8040a1dc0 con 0x560a85b697c0 2024-09-13T17:21:30.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.527+0000 7ff8126c0740 1 -- 172.21.15.87:0/3428397205 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560a857d2860 con 0x560a85b697c0 2024-09-13T17:21:30.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.528+0000 7ff7f0ff9640 1 -- 172.21.15.87:0/3428397205 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8040ca200 con 0x560a85b697c0 2024-09-13T17:21:30.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.528+0000 7ff8126c0740 10 client.17667 fetch_fsmap learned FSMap version 36 2024-09-13T17:21:30.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.528+0000 7ff8126c0740 1 -- 172.21.15.87:0/3428397205 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x560a85acc360 con 0x560a85b697c0 2024-09-13T17:21:30.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.528+0000 7ff7f0ff9640 1 -- 172.21.15.87:0/3428397205 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x560a857d2860 con 0x560a85b697c0 2024-09-13T17:21:30.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.528+0000 7ff7f0ff9640 1 -- 172.21.15.87:0/3428397205 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7ff804098e30 con 0x560a85b697c0 2024-09-13T17:21:30.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.528+0000 7ff8126c0740 10 client.17667 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:21:30.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.528+0000 7ff8126c0740 10 client.17667 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:21:30.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.528+0000 7ff8126c0740 20 client.17667 populate_metadata read hostname 'smithi087' 2024-09-13T17:21:30.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.528+0000 7ff8126c0740 1 --2- 172.21.15.87:0/3428397205 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560a85b84730 0x560a85b86b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.528+0000 7ff8126c0740 4 client.17667 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:21:30.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.528+0000 7ff8126c0740 1 -- 172.21.15.87:0/3428397205 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560a85825eb0 con 0x560a85b84730 2024-09-13T17:21:30.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.528+0000 7ff80cf37640 1 --2- 172.21.15.87:0/3428397205 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560a85b84730 0x560a85b86b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:30.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.529+0000 7ff80cf37640 1 --2- 172.21.15.87:0/3428397205 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560a85b84730 0x560a85b86b40 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e39d8dd56b2692f server_cookie=e793dfa81c355e3d in_seq=0 out_seq=0 2024-09-13T17:21:30.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.529+0000 7ff7f0ff9640 10 client.17667 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:21:30.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.529+0000 7ff7f0ff9640 1 -- 172.21.15.87:0/3428397205 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x560a85825eb0 con 0x560a85b84730 2024-09-13T17:21:30.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.529+0000 7ff7f0ff9640 10 client.17667 handle_command_reply: tid=0 2024-09-13T17:21:30.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.529+0000 7ff8126c0740 1 client.17667 shutdown 2024-09-13T17:21:30.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.529+0000 7ff8126c0740 1 -- 172.21.15.87:0/3428397205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a85b697c0 msgr2=0x560a85b74400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:30.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.529+0000 7ff8126c0740 1 --2- 172.21.15.87:0/3428397205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a85b697c0 0x560a85b74400 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7ff80400d740 tx=0x7ff804068c00 comp rx=0 tx=0).stop 2024-09-13T17:21:30.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.529+0000 7ff8126c0740 1 -- 172.21.15.87:0/3428397205 shutdown_connections 2024-09-13T17:21:30.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.529+0000 7ff8126c0740 1 --2- 172.21.15.87:0/3428397205 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560a85b84730 0x560a85b86b40 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.529+0000 7ff8126c0740 1 --2- 172.21.15.87:0/3428397205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a85b74980 0x560a85b71e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.529+0000 7ff8126c0740 1 --2- 172.21.15.87:0/3428397205 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a85b6a0e0 0x560a85b716f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.529+0000 7ff7f0ff9640 0 client.17667 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:21:30.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.529+0000 7ff8126c0740 1 --2- 172.21.15.87:0/3428397205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a85b697c0 0x560a85b74400 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.529+0000 7ff8126c0740 1 -- 172.21.15.87:0/3428397205 >> 172.21.15.87:0/3428397205 conn(0x560a85b65d50 msgr2=0x560a85b6b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:30.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.530+0000 7ff8126c0740 1 -- 172.21.15.87:0/3428397205 shutdown_connections 2024-09-13T17:21:30.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.530+0000 7ff8126c0740 1 -- 172.21.15.87:0/3428397205 wait complete. 2024-09-13T17:21:30.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.530+0000 7ff8126c0740 20 client.17667 trim_cache size 0 max 16384 2024-09-13T17:21:30.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.543+0000 7ff8126c0740 1 Processor -- start 2024-09-13T17:21:30.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.544+0000 7ff8126c0740 1 -- start start 2024-09-13T17:21:30.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.544+0000 7ff8126c0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a85b697c0 0x560a85b7b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.544+0000 7ff8126c0740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a85b6a0e0 0x560a85b7bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.544+0000 7ff8126c0740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a85b74980 0x560a85b70f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.544+0000 7ff8126c0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a85b69f50 con 0x560a85b697c0 2024-09-13T17:21:30.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.544+0000 7ff8126c0740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a85b66950 con 0x560a85b74980 2024-09-13T17:21:30.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.544+0000 7ff8126c0740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a85b6d0f0 con 0x560a85b6a0e0 2024-09-13T17:21:30.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.544+0000 7ff80d738640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a85b697c0 0x560a85b7b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:30.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.544+0000 7ff80d738640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a85b697c0 0x560a85b7b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57884/0 (socket says 172.21.15.87:57884) 2024-09-13T17:21:30.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.544+0000 7ff80d738640 1 -- 172.21.15.87:0/3581882110 learned_addr learned my addr 172.21.15.87:0/3581882110 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:21:30.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.544+0000 7ff80df39640 1 --2- 172.21.15.87:0/3581882110 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a85b74980 0x560a85b70f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:30.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.544+0000 7ff80d738640 1 -- 172.21.15.87:0/3581882110 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a85b6a0e0 msgr2=0x560a85b7bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:30.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.544+0000 7ff80d738640 1 --2- 172.21.15.87:0/3581882110 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a85b6a0e0 0x560a85b7bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.544+0000 7ff80d738640 1 -- 172.21.15.87:0/3581882110 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a85b74980 msgr2=0x560a85b70f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:30.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.544+0000 7ff80d738640 1 --2- 172.21.15.87:0/3581882110 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a85b74980 0x560a85b70f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.544+0000 7ff80d738640 1 -- 172.21.15.87:0/3581882110 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a85a6e1c0 con 0x560a85b697c0 2024-09-13T17:21:30.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.544+0000 7ff80df39640 1 --2- 172.21.15.87:0/3581882110 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a85b74980 0x560a85b70f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:30.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.544+0000 7ff80d738640 1 --2- 172.21.15.87:0/3581882110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a85b697c0 0x560a85b7b650 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7ff804067040 tx=0x7ff8040a19e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=748f2a73f41d6156 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:30.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.544+0000 7ff7f3fff640 1 -- 172.21.15.87:0/3581882110 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff804095c80 con 0x560a85b697c0 2024-09-13T17:21:30.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.544+0000 7ff7f3fff640 1 -- 172.21.15.87:0/3581882110 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff804084040 con 0x560a85b697c0 2024-09-13T17:21:30.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.544+0000 7ff7f3fff640 1 -- 172.21.15.87:0/3581882110 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff804098e30 con 0x560a85b697c0 2024-09-13T17:21:30.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.545+0000 7ff8126c0740 1 -- 172.21.15.87:0/3581882110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a85b697c0 msgr2=0x560a85b7b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:30.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.545+0000 7ff8126c0740 1 --2- 172.21.15.87:0/3581882110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a85b697c0 0x560a85b7b650 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7ff804067040 tx=0x7ff8040a19e0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.545+0000 7ff8126c0740 1 -- 172.21.15.87:0/3581882110 shutdown_connections 2024-09-13T17:21:30.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.545+0000 7ff8126c0740 1 --2- 172.21.15.87:0/3581882110 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a85b74980 0x560a85b70f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.545+0000 7ff8126c0740 1 --2- 172.21.15.87:0/3581882110 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a85b6a0e0 0x560a85b7bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.545+0000 7ff8126c0740 1 --2- 172.21.15.87:0/3581882110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a85b697c0 0x560a85b7b650 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.545+0000 7ff8126c0740 1 -- 172.21.15.87:0/3581882110 >> 172.21.15.87:0/3581882110 conn(0x560a85b65d50 msgr2=0x560a85b6c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:30.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.545+0000 7ff8126c0740 1 -- 172.21.15.87:0/3581882110 shutdown_connections 2024-09-13T17:21:30.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.545+0000 7ff8126c0740 1 -- 172.21.15.87:0/3581882110 wait complete. 2024-09-13T17:21:30.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.545+0000 7ff8126c0740 1 -- start start 2024-09-13T17:21:30.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.545+0000 7ff8126c0740 1 Processor -- start 2024-09-13T17:21:30.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.546+0000 7ff8126c0740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a85b697c0 0x560a85b7a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.546+0000 7ff8126c0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a85b6a0e0 0x560a85b7aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.546+0000 7ff8126c0740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a85b74980 0x560a85bdac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.546+0000 7ff8126c0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a85b7b3d0 con 0x560a85b6a0e0 2024-09-13T17:21:30.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.546+0000 7ff8126c0740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a85bdb180 con 0x560a85b74980 2024-09-13T17:21:30.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.546+0000 7ff8126c0740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a85bdb2c0 con 0x560a85b697c0 2024-09-13T17:21:30.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.546+0000 7ff8126c0740 10 client.0 _ll_register_callbacks cb 0x7ff804005730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:21:30.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.546+0000 7ff80cf37640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a85b6a0e0 0x560a85b7aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:30.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.546+0000 7ff80cf37640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a85b6a0e0 0x560a85b7aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57890/0 (socket says 172.21.15.87:57890) 2024-09-13T17:21:30.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.546+0000 7ff80cf37640 1 -- 172.21.15.87:0/3653922586 learned_addr learned my addr 172.21.15.87:0/3653922586 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:21:30.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.546+0000 7ff80df39640 1 --2- 172.21.15.87:0/3653922586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a85b74980 0x560a85bdac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:30.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.546+0000 7ff80d738640 1 --2- 172.21.15.87:0/3653922586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a85b697c0 0x560a85b7a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:30.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.546+0000 7ff80cf37640 1 -- 172.21.15.87:0/3653922586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a85b697c0 msgr2=0x560a85b7a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:30.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.546+0000 7ff80cf37640 1 --2- 172.21.15.87:0/3653922586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a85b697c0 0x560a85b7a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.546+0000 7ff80cf37640 1 -- 172.21.15.87:0/3653922586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a85b74980 msgr2=0x560a85bdac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:30.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.546+0000 7ff80cf37640 1 --2- 172.21.15.87:0/3653922586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a85b74980 0x560a85bdac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.546+0000 7ff80cf37640 1 -- 172.21.15.87:0/3653922586 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560a85acc360 con 0x560a85b6a0e0 2024-09-13T17:21:30.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.546+0000 7ff80df39640 1 --2- 172.21.15.87:0/3653922586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a85b74980 0x560a85bdac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:21:30.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.546+0000 7ff80cf37640 1 --2- 172.21.15.87:0/3653922586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a85b6a0e0 0x560a85b7aa80 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7ff7f802a940 tx=0x7ff7f8032570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d1fedd1e1ede64a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:30.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.546+0000 7ff7f0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:21:30.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.546+0000 7ff7f0ff9640 1 -- 172.21.15.87:0/3653922586 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f8041070 con 0x560a85b6a0e0 2024-09-13T17:21:30.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.546+0000 7ff7f0ff9640 1 -- 172.21.15.87:0/3653922586 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7ff7f8004050 con 0x560a85b6a0e0 2024-09-13T17:21:30.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.546+0000 7ff8126c0740 1 -- 172.21.15.87:0/3653922586 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560a857c1590 con 0x560a85b6a0e0 2024-09-13T17:21:30.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.547+0000 7ff7f0ff9640 1 -- 172.21.15.87:0/3653922586 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7f8004210 con 0x560a85b6a0e0 2024-09-13T17:21:30.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.547+0000 7ff8126c0740 10 client.17673 fetch_fsmap learned FSMap version 36 2024-09-13T17:21:30.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.547+0000 7ff8126c0740 1 -- 172.21.15.87:0/3653922586 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x560a85a93990 con 0x560a85b6a0e0 2024-09-13T17:21:30.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.547+0000 7ff7f0ff9640 1 -- 172.21.15.87:0/3653922586 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x560a857c1590 con 0x560a85b6a0e0 2024-09-13T17:21:30.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.547+0000 7ff7f0ff9640 1 -- 172.21.15.87:0/3653922586 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7ff7f8004880 con 0x560a85b6a0e0 2024-09-13T17:21:30.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.547+0000 7ff8126c0740 10 client.17673 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:21:30.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.547+0000 7ff8126c0740 10 client.17673 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:21:30.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.547+0000 7ff8126c0740 20 client.17673 populate_metadata read hostname 'smithi087' 2024-09-13T17:21:30.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.547+0000 7ff8126c0740 1 --2- 172.21.15.87:0/3653922586 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560a85bdca40 0x560a85bdee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.547+0000 7ff8126c0740 4 client.17673 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-13T17:21:30.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.547+0000 7ff8126c0740 1 -- 172.21.15.87:0/3653922586 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x560a85bdf690 con 0x560a85bdca40 2024-09-13T17:21:30.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.547+0000 7ff80d738640 1 --2- 172.21.15.87:0/3653922586 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560a85bdca40 0x560a85bdee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:30.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.548+0000 7ff80d738640 1 --2- 172.21.15.87:0/3653922586 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560a85bdca40 0x560a85bdee60 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0aabe5bd0c68af1 server_cookie=2f929e0ac7420447 in_seq=0 out_seq=0 2024-09-13T17:21:30.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.548+0000 7ff7f0ff9640 10 client.17673 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:21:30.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.549+0000 7ff7f0ff9640 1 -- 172.21.15.87:0/3653922586 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x560a85bdf690 con 0x560a85bdca40 2024-09-13T17:21:30.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.549+0000 7ff7f0ff9640 10 client.17673 handle_command_reply: tid=0 2024-09-13T17:21:30.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.549+0000 7ff8126c0740 1 client.17673 shutdown 2024-09-13T17:21:30.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.549+0000 7ff8126c0740 1 -- 172.21.15.87:0/3653922586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a85b6a0e0 msgr2=0x560a85b7aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:30.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.549+0000 7ff8126c0740 1 --2- 172.21.15.87:0/3653922586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a85b6a0e0 0x560a85b7aa80 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7ff7f802a940 tx=0x7ff7f8032570 comp rx=0 tx=0).stop 2024-09-13T17:21:30.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.549+0000 7ff8126c0740 1 -- 172.21.15.87:0/3653922586 shutdown_connections 2024-09-13T17:21:30.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.549+0000 7ff8126c0740 1 --2- 172.21.15.87:0/3653922586 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560a85bdca40 0x560a85bdee60 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.549+0000 7ff8126c0740 1 --2- 172.21.15.87:0/3653922586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560a85b74980 0x560a85bdac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.549+0000 7ff7f0ff9640 0 client.17673 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:21:30.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.549+0000 7ff8126c0740 1 --2- 172.21.15.87:0/3653922586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560a85b6a0e0 0x560a85b7aa80 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.549+0000 7ff8126c0740 1 --2- 172.21.15.87:0/3653922586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560a85b697c0 0x560a85b7a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.549+0000 7ff8126c0740 1 -- 172.21.15.87:0/3653922586 >> 172.21.15.87:0/3653922586 conn(0x560a85b65d50 msgr2=0x560a85b6b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:30.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.549+0000 7ff8126c0740 1 -- 172.21.15.87:0/3653922586 shutdown_connections 2024-09-13T17:21:30.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.549+0000 7ff8126c0740 1 -- 172.21.15.87:0/3653922586 wait complete. 2024-09-13T17:21:30.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.549+0000 7ff8126c0740 20 client.17673 trim_cache size 0 max 16384 2024-09-13T17:21:30.556 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:21:30.556 INFO:teuthology.orchestra.run.smithi087.stdout: "return_code": 0, 2024-09-13T17:21:30.556 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_tag": "4e55a1a5-ead3-4d8b-a6cb-e964b49694f4", 2024-09-13T17:21:30.556 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": "asynchronous" 2024-09-13T17:21:30.556 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:21:30.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.550+0000 7ff80f99c640 1 -- 172.21.15.87:0/3905523117 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff7f40a1200 msgr2=0x7ff7f40a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:30.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.550+0000 7ff80f99c640 1 --2- 172.21.15.87:0/3905523117 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff7f40a1200 0x7ff7f40a36c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff80001e000 tx=0x7ff80001a000 comp rx=0 tx=0).stop 2024-09-13T17:21:30.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.550+0000 7ff80f99c640 1 -- 172.21.15.87:0/3905523117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8080fff90 msgr2=0x7ff8080727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:30.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.550+0000 7ff80f99c640 1 --2- 172.21.15.87:0/3905523117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8080fff90 0x7ff8080727b0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7ff80400d770 tx=0x7ff80400dc30 comp rx=0 tx=0).stop 2024-09-13T17:21:30.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.550+0000 7ff80f99c640 1 -- 172.21.15.87:0/3905523117 shutdown_connections 2024-09-13T17:21:30.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.550+0000 7ff80f99c640 1 --2- 172.21.15.87:0/3905523117 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff808073230 0x7ff8081a4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.550+0000 7ff80f99c640 1 --2- 172.21.15.87:0/3905523117 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8081050e0 0x7ff808072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.550+0000 7ff80f99c640 1 --2- 172.21.15.87:0/3905523117 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff7f40a1200 0x7ff7f40a36c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.550+0000 7ff80f99c640 1 --2- 172.21.15.87:0/3905523117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8080fff90 0x7ff8080727b0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.550+0000 7ff80f99c640 1 -- 172.21.15.87:0/3905523117 >> 172.21.15.87:0/3905523117 conn(0x7ff8080fba20 msgr2=0x7ff8080fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:30.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.550+0000 7ff80f99c640 1 -- 172.21.15.87:0/3905523117 shutdown_connections 2024-09-13T17:21:30.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.550+0000 7ff80f99c640 1 -- 172.21.15.87:0/3905523117 wait complete. 2024-09-13T17:21:30.562 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:21:30.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.704+0000 7fe00745a640 1 -- 172.21.15.87:0/1277063305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe000100910 msgr2=0x7fe000104950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:30.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.704+0000 7fe00745a640 1 --2- 172.21.15.87:0/1277063305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe000100910 0x7fe000104950 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fdff0009930 tx=0x7fdff002a420 comp rx=0 tx=0).stop 2024-09-13T17:21:30.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.704+0000 7fe00745a640 1 -- 172.21.15.87:0/1277063305 shutdown_connections 2024-09-13T17:21:30.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.704+0000 7fe00745a640 1 --2- 172.21.15.87:0/1277063305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0001050b0 0x7fe00010cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.704+0000 7fe00745a640 1 --2- 172.21.15.87:0/1277063305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe000100910 0x7fe000104950 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.704+0000 7fe00745a640 1 --2- 172.21.15.87:0/1277063305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0000fff60 0x7fe000100340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.704+0000 7fe00745a640 1 -- 172.21.15.87:0/1277063305 >> 172.21.15.87:0/1277063305 conn(0x7fe0000fb9f0 msgr2=0x7fe0000fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:30.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.704+0000 7fe00745a640 1 -- 172.21.15.87:0/1277063305 shutdown_connections 2024-09-13T17:21:30.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.704+0000 7fe00745a640 1 -- 172.21.15.87:0/1277063305 wait complete. 2024-09-13T17:21:30.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.705+0000 7fe00745a640 1 Processor -- start 2024-09-13T17:21:30.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.705+0000 7fe00745a640 1 -- start start 2024-09-13T17:21:30.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.705+0000 7fe00745a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0000fff60 0x7fe000196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.705+0000 7fe00745a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0001050b0 0x7fe0001967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.705+0000 7fe00745a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe00019abc0 0x7fe00019b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.705+0000 7fe00745a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00019b5b0 con 0x7fe0000fff60 2024-09-13T17:21:30.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.705+0000 7fe00745a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00019b720 con 0x7fe00019abc0 2024-09-13T17:21:30.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.705+0000 7fe00745a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00019b890 con 0x7fe0001050b0 2024-09-13T17:21:30.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.705+0000 7fe0051f6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0000fff60 0x7fe000196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:30.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.705+0000 7fe0051f6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0000fff60 0x7fe000196290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57910/0 (socket says 172.21.15.87:57910) 2024-09-13T17:21:30.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.705+0000 7fe0051f6640 1 -- 172.21.15.87:0/461944778 learned_addr learned my addr 172.21.15.87:0/461944778 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:21:30.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.706+0000 7fe0049f5640 1 --2- 172.21.15.87:0/461944778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0001050b0 0x7fe0001967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:30.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.706+0000 7fe0051f6640 1 -- 172.21.15.87:0/461944778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0001050b0 msgr2=0x7fe0001967d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:30.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.706+0000 7fe0051f6640 1 --2- 172.21.15.87:0/461944778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0001050b0 0x7fe0001967d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.706+0000 7fe0051f6640 1 -- 172.21.15.87:0/461944778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe00019abc0 msgr2=0x7fe00019b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:30.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.706+0000 7fe0051f6640 1 --2- 172.21.15.87:0/461944778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe00019abc0 0x7fe00019b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.706+0000 7fe0051f6640 1 -- 172.21.15.87:0/461944778 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff0009560 con 0x7fe0000fff60 2024-09-13T17:21:30.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.706+0000 7fe0051f6640 1 --2- 172.21.15.87:0/461944778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0000fff60 0x7fe000196290 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fdffc00e9f0 tx=0x7fdffc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:30.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.706+0000 7fdff67fc640 1 -- 172.21.15.87:0/461944778 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc009700 con 0x7fe0000fff60 2024-09-13T17:21:30.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.706+0000 7fdff67fc640 1 -- 172.21.15.87:0/461944778 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdffc00cd80 con 0x7fe0000fff60 2024-09-13T17:21:30.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.706+0000 7fe00745a640 1 -- 172.21.15.87:0/461944778 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0001a2e70 con 0x7fe0000fff60 2024-09-13T17:21:30.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.706+0000 7fdff67fc640 1 -- 172.21.15.87:0/461944778 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc018840 con 0x7fe0000fff60 2024-09-13T17:21:30.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.706+0000 7fe00745a640 1 -- 172.21.15.87:0/461944778 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0001a32e0 con 0x7fe0000fff60 2024-09-13T17:21:30.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.708+0000 7fdff67fc640 1 -- 172.21.15.87:0/461944778 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fdffc0189a0 con 0x7fe0000fff60 2024-09-13T17:21:30.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.708+0000 7fe00a254740 1 Processor -- start 2024-09-13T17:21:30.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.709+0000 7fe00a254740 1 -- start start 2024-09-13T17:21:30.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.709+0000 7fe00a254740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ccf286e10 0x560ccf2871f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.709+0000 7fe00a254740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ccf287730 0x560ccf291a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.709+0000 7fe00a254740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ccf291fd0 0x560ccf2943c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.709+0000 7fdff67fc640 1 --2- 172.21.15.87:0/461944778 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdfec0a1280 0x7fdfec0a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.709+0000 7fe00a254740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ccf1f1f20 con 0x560ccf291fd0 2024-09-13T17:21:30.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.709+0000 7fe00a254740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ccf1ef6b0 con 0x560ccf286e10 2024-09-13T17:21:30.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.709+0000 7fe00a254740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ccf1eafa0 con 0x560ccf287730 2024-09-13T17:21:30.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.709+0000 7fe0049f5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ccf291fd0 0x560ccf2943c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:30.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.709+0000 7fe0059f7640 1 --2- 172.21.15.87:0/461944778 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdfec0a1280 0x7fdfec0a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:30.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.709+0000 7fe0049f5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ccf291fd0 0x560ccf2943c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57914/0 (socket says 172.21.15.87:57914) 2024-09-13T17:21:30.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.709+0000 7fe0049f5640 1 -- 172.21.15.87:0/1329841333 learned_addr learned my addr 172.21.15.87:0/1329841333 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:21:30.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.709+0000 7fdff67fc640 1 -- 172.21.15.87:0/461944778 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fdffc014070 con 0x7fe0000fff60 2024-09-13T17:21:30.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.709+0000 7fe0051f6640 1 --2- 172.21.15.87:0/1329841333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ccf287730 0x560ccf291a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:30.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.709+0000 7fe0059f7640 1 --2- 172.21.15.87:0/1329841333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ccf286e10 0x560ccf2871f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:30.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.709+0000 7fe0049f5640 1 -- 172.21.15.87:0/1329841333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ccf287730 msgr2=0x560ccf291a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:30.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.709+0000 7fe0049f5640 1 --2- 172.21.15.87:0/1329841333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ccf287730 0x560ccf291a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.709+0000 7fe0049f5640 1 -- 172.21.15.87:0/1329841333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ccf286e10 msgr2=0x560ccf2871f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:30.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.709+0000 7fe0049f5640 1 --2- 172.21.15.87:0/1329841333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ccf286e10 0x560ccf2871f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.709+0000 7fe0049f5640 1 -- 172.21.15.87:0/1329841333 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ccf1a5840 con 0x560ccf291fd0 2024-09-13T17:21:30.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.709+0000 7fe0059f7640 1 --2- 172.21.15.87:0/461944778 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdfec0a1280 0x7fdfec0a3740 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdff80092f0 tx=0x7fdff8009bf0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:30.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.709+0000 7fe0049f5640 1 --2- 172.21.15.87:0/1329841333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ccf291fd0 0x560ccf2943c0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fdff0006010 tx=0x7fdff0032ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0b23ddc2930695 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:30.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.710+0000 7fdfeb7fe640 1 -- 172.21.15.87:0/1329841333 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff0031a30 con 0x560ccf291fd0 2024-09-13T17:21:30.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.710+0000 7fdfeb7fe640 1 -- 172.21.15.87:0/1329841333 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdff0031b90 con 0x560ccf291fd0 2024-09-13T17:21:30.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.710+0000 7fdfeb7fe640 1 -- 172.21.15.87:0/1329841333 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff0005040 con 0x560ccf291fd0 2024-09-13T17:21:30.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.710+0000 7fe00a254740 1 -- 172.21.15.87:0/1329841333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ccf291fd0 msgr2=0x560ccf2943c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:30.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.710+0000 7fe00a254740 1 --2- 172.21.15.87:0/1329841333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ccf291fd0 0x560ccf2943c0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fdff0006010 tx=0x7fdff0032ac0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.710+0000 7fe00a254740 1 -- 172.21.15.87:0/1329841333 shutdown_connections 2024-09-13T17:21:30.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.710+0000 7fe00a254740 1 --2- 172.21.15.87:0/1329841333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ccf291fd0 0x560ccf2943c0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.710+0000 7fe00a254740 1 --2- 172.21.15.87:0/1329841333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ccf287730 0x560ccf291a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.710+0000 7fe00a254740 1 --2- 172.21.15.87:0/1329841333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ccf286e10 0x560ccf2871f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.710+0000 7fe00a254740 1 -- 172.21.15.87:0/1329841333 >> 172.21.15.87:0/1329841333 conn(0x560ccf283380 msgr2=0x560ccf283760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:30.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.710+0000 7fe00a254740 1 -- 172.21.15.87:0/1329841333 shutdown_connections 2024-09-13T17:21:30.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.710+0000 7fe00a254740 1 -- 172.21.15.87:0/1329841333 wait complete. 2024-09-13T17:21:30.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.711+0000 7fe00a254740 1 -- start start 2024-09-13T17:21:30.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.711+0000 7fe00a254740 1 Processor -- start 2024-09-13T17:21:30.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.711+0000 7fe00a254740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ccf286e10 0x560ccf2919f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.711+0000 7fe00a254740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ccf287730 0x560ccf28ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.711+0000 7fe00a254740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ccf291fd0 0x560ccf28f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.711+0000 7fe00a254740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ccf18c2a0 con 0x560ccf286e10 2024-09-13T17:21:30.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.711+0000 7fe00a254740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cceec3430 con 0x560ccf291fd0 2024-09-13T17:21:30.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.711+0000 7fe00a254740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ccf16e680 con 0x560ccf287730 2024-09-13T17:21:30.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.711+0000 7fe00a254740 10 client.0 _ll_register_callbacks cb 0x560ccf1e4610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:21:30.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.711+0000 7fe0051f6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ccf286e10 0x560ccf2919f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:30.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.711+0000 7fe0051f6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ccf286e10 0x560ccf2919f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57922/0 (socket says 172.21.15.87:57922) 2024-09-13T17:21:30.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.711+0000 7fe0051f6640 1 -- 172.21.15.87:0/2864065125 learned_addr learned my addr 172.21.15.87:0/2864065125 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:21:30.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.712+0000 7fe0051f6640 1 -- 172.21.15.87:0/2864065125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ccf287730 msgr2=0x560ccf28ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:30.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.712+0000 7fe0049f5640 1 --2- 172.21.15.87:0/2864065125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ccf287730 0x560ccf28ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:30.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.712+0000 7fe0051f6640 1 --2- 172.21.15.87:0/2864065125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ccf287730 0x560ccf28ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.712+0000 7fe0051f6640 1 -- 172.21.15.87:0/2864065125 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ccf291fd0 msgr2=0x560ccf28f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:30.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.712+0000 7fe0051f6640 1 --2- 172.21.15.87:0/2864065125 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ccf291fd0 0x560ccf28f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.712+0000 7fe0051f6640 1 -- 172.21.15.87:0/2864065125 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe00010d440 con 0x560ccf286e10 2024-09-13T17:21:30.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.712+0000 7fe0051f6640 1 --2- 172.21.15.87:0/2864065125 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ccf286e10 0x560ccf2919f0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fdffc00e9c0 tx=0x7fdffc09aa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d322ae67c75afe9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:30.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.712+0000 7fdfe8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:21:30.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.712+0000 7fdfe8ff9640 1 -- 172.21.15.87:0/2864065125 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc0968e0 con 0x560ccf286e10 2024-09-13T17:21:30.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.712+0000 7fdfe8ff9640 1 -- 172.21.15.87:0/2864065125 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fdffc0b1060 con 0x560ccf286e10 2024-09-13T17:21:30.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.712+0000 7fe00a254740 1 -- 172.21.15.87:0/2864065125 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560cceede4e0 con 0x560ccf286e10 2024-09-13T17:21:30.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.712+0000 7fdfe8ff9640 1 -- 172.21.15.87:0/2864065125 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdffc096a40 con 0x560ccf286e10 2024-09-13T17:21:30.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.712+0000 7fe00a254740 10 client.17685 fetch_fsmap learned FSMap version 36 2024-09-13T17:21:30.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.712+0000 7fe00a254740 1 -- 172.21.15.87:0/2864065125 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x560ccf1e9620 con 0x560ccf286e10 2024-09-13T17:21:30.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.712+0000 7fdfe8ff9640 1 -- 172.21.15.87:0/2864065125 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x560cceede4e0 con 0x560ccf286e10 2024-09-13T17:21:30.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.712+0000 7fdfe8ff9640 1 -- 172.21.15.87:0/2864065125 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fdffc0a2250 con 0x560ccf286e10 2024-09-13T17:21:30.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.712+0000 7fe00a254740 10 client.17685 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:21:30.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.712+0000 7fe00a254740 10 client.17685 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:21:30.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.712+0000 7fe00a254740 20 client.17685 populate_metadata read hostname 'smithi087' 2024-09-13T17:21:30.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.712+0000 7fe00a254740 1 --2- 172.21.15.87:0/2864065125 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560ccf2a1d00 0x560ccf2a4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.712+0000 7fe00a254740 4 client.17685 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:21:30.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.712+0000 7fe00a254740 1 -- 172.21.15.87:0/2864065125 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560cceeef7e0 con 0x560ccf2a1d00 2024-09-13T17:21:30.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.713+0000 7fe0049f5640 1 --2- 172.21.15.87:0/2864065125 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560ccf2a1d00 0x560ccf2a4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:30.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.713+0000 7fdfe8ff9640 10 client.17685 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:21:30.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.713+0000 7fe0049f5640 1 --2- 172.21.15.87:0/2864065125 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560ccf2a1d00 0x560ccf2a4130 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91d910f3bc6e23ae server_cookie=b3fe428ba38f64a4 in_seq=0 out_seq=0 2024-09-13T17:21:30.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.714+0000 7fdfe8ff9640 1 -- 172.21.15.87:0/2864065125 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x560cceeef7e0 con 0x560ccf2a1d00 2024-09-13T17:21:30.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.714+0000 7fdfe8ff9640 10 client.17685 handle_command_reply: tid=0 2024-09-13T17:21:30.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.714+0000 7fe00a254740 1 client.17685 shutdown 2024-09-13T17:21:30.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.714+0000 7fe00a254740 1 -- 172.21.15.87:0/2864065125 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ccf286e10 msgr2=0x560ccf2919f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:30.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.714+0000 7fe00a254740 1 --2- 172.21.15.87:0/2864065125 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ccf286e10 0x560ccf2919f0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fdffc00e9c0 tx=0x7fdffc09aa10 comp rx=0 tx=0).stop 2024-09-13T17:21:30.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.714+0000 7fe00a254740 1 -- 172.21.15.87:0/2864065125 shutdown_connections 2024-09-13T17:21:30.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.714+0000 7fe00a254740 1 --2- 172.21.15.87:0/2864065125 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560ccf2a1d00 0x560ccf2a4130 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.714+0000 7fe00a254740 1 --2- 172.21.15.87:0/2864065125 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ccf291fd0 0x560ccf28f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.714+0000 7fdfe8ff9640 0 client.17685 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:21:30.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.714+0000 7fe00a254740 1 --2- 172.21.15.87:0/2864065125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ccf287730 0x560ccf28ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.714+0000 7fe00a254740 1 --2- 172.21.15.87:0/2864065125 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ccf286e10 0x560ccf2919f0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.714+0000 7fe00a254740 1 -- 172.21.15.87:0/2864065125 >> 172.21.15.87:0/2864065125 conn(0x560ccf283380 msgr2=0x560ccf289090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:30.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.714+0000 7fe00a254740 1 -- 172.21.15.87:0/2864065125 shutdown_connections 2024-09-13T17:21:30.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.714+0000 7fe00a254740 1 -- 172.21.15.87:0/2864065125 wait complete. 2024-09-13T17:21:30.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.714+0000 7fe00a254740 20 client.17685 trim_cache size 0 max 16384 2024-09-13T17:21:30.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.728+0000 7fe00a254740 1 Processor -- start 2024-09-13T17:21:30.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.728+0000 7fe00a254740 1 -- start start 2024-09-13T17:21:30.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.728+0000 7fe00a254740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ccf286e10 0x560ccf282e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.728+0000 7fe00a254740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ccf287730 0x560ccf29d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.728+0000 7fe00a254740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ccf291fd0 0x560ccf291500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.728+0000 7fe00a254740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ccf27e760 con 0x560ccf286e10 2024-09-13T17:21:30.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.728+0000 7fe00a254740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ccf284070 con 0x560ccf291fd0 2024-09-13T17:21:30.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.728+0000 7fe00a254740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ccf28d260 con 0x560ccf287730 2024-09-13T17:21:30.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.728+0000 7fe0051f6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ccf286e10 0x560ccf282e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:30.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.729+0000 7fe0051f6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ccf286e10 0x560ccf282e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57926/0 (socket says 172.21.15.87:57926) 2024-09-13T17:21:30.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.729+0000 7fe0051f6640 1 -- 172.21.15.87:0/2616033861 learned_addr learned my addr 172.21.15.87:0/2616033861 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:21:30.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.729+0000 7fe0049f5640 1 --2- 172.21.15.87:0/2616033861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ccf287730 0x560ccf29d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:30.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.729+0000 7fe0051f6640 1 -- 172.21.15.87:0/2616033861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ccf287730 msgr2=0x560ccf29d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:30.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.729+0000 7fe0051f6640 1 --2- 172.21.15.87:0/2616033861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ccf287730 0x560ccf29d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.729+0000 7fe0051f6640 1 -- 172.21.15.87:0/2616033861 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ccf291fd0 msgr2=0x560ccf291500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:30.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.729+0000 7fe0051f6640 1 --2- 172.21.15.87:0/2616033861 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ccf291fd0 0x560ccf291500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.729+0000 7fe0051f6640 1 -- 172.21.15.87:0/2616033861 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ccf18b790 con 0x560ccf286e10 2024-09-13T17:21:30.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.729+0000 7fe0049f5640 1 --2- 172.21.15.87:0/2616033861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ccf287730 0x560ccf29d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:21:30.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.729+0000 7fe0051f6640 1 --2- 172.21.15.87:0/2616033861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ccf286e10 0x560ccf282e20 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fdffc0ca8c0 tx=0x7fdffc095ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab15cab59b3aae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:30.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.729+0000 7fdfebfff640 1 -- 172.21.15.87:0/2616033861 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc0994c0 con 0x560ccf286e10 2024-09-13T17:21:30.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.729+0000 7fdfebfff640 1 -- 172.21.15.87:0/2616033861 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdffc0b0020 con 0x560ccf286e10 2024-09-13T17:21:30.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.729+0000 7fdfebfff640 1 -- 172.21.15.87:0/2616033861 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc0cd170 con 0x560ccf286e10 2024-09-13T17:21:30.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.730+0000 7fe00a254740 1 -- 172.21.15.87:0/2616033861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ccf286e10 msgr2=0x560ccf282e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:30.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.730+0000 7fe00a254740 1 --2- 172.21.15.87:0/2616033861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ccf286e10 0x560ccf282e20 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fdffc0ca8c0 tx=0x7fdffc095ee0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.730+0000 7fe00a254740 1 -- 172.21.15.87:0/2616033861 shutdown_connections 2024-09-13T17:21:30.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.730+0000 7fe00a254740 1 --2- 172.21.15.87:0/2616033861 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ccf291fd0 0x560ccf291500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.730+0000 7fe00a254740 1 --2- 172.21.15.87:0/2616033861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ccf287730 0x560ccf29d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.730+0000 7fe00a254740 1 --2- 172.21.15.87:0/2616033861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ccf286e10 0x560ccf282e20 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.730+0000 7fe00a254740 1 -- 172.21.15.87:0/2616033861 >> 172.21.15.87:0/2616033861 conn(0x560ccf283380 msgr2=0x560ccf28e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:30.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.730+0000 7fe00a254740 1 -- 172.21.15.87:0/2616033861 shutdown_connections 2024-09-13T17:21:30.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.730+0000 7fe00a254740 1 -- 172.21.15.87:0/2616033861 wait complete. 2024-09-13T17:21:30.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.730+0000 7fe00a254740 1 -- start start 2024-09-13T17:21:30.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.730+0000 7fe00a254740 1 Processor -- start 2024-09-13T17:21:30.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.730+0000 7fe00a254740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ccf286e10 0x560ccf298d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.730+0000 7fe00a254740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ccf287730 0x560ccf299280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.730+0000 7fe00a254740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ccf291fd0 0x560ccf28af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.730+0000 7fe00a254740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ccf28b4c0 con 0x560ccf286e10 2024-09-13T17:21:30.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.730+0000 7fe00a254740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ccf28b630 con 0x560ccf291fd0 2024-09-13T17:21:30.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.730+0000 7fe00a254740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ccf28b7f0 con 0x560ccf287730 2024-09-13T17:21:30.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.730+0000 7fe00a254740 10 client.0 _ll_register_callbacks cb 0x7fdffc099b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:21:30.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.730+0000 7fe0051f6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ccf286e10 0x560ccf298d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:30.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.730+0000 7fe0051f6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ccf286e10 0x560ccf298d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57938/0 (socket says 172.21.15.87:57938) 2024-09-13T17:21:30.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.730+0000 7fe0051f6640 1 -- 172.21.15.87:0/219823359 learned_addr learned my addr 172.21.15.87:0/219823359 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:21:30.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.731+0000 7fe0059f7640 1 --2- 172.21.15.87:0/219823359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ccf291fd0 0x560ccf28af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:30.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.731+0000 7fe0049f5640 1 --2- 172.21.15.87:0/219823359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ccf287730 0x560ccf299280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:30.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.731+0000 7fe0051f6640 1 -- 172.21.15.87:0/219823359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ccf287730 msgr2=0x560ccf299280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:30.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.731+0000 7fe0051f6640 1 --2- 172.21.15.87:0/219823359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ccf287730 0x560ccf299280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.731+0000 7fe0051f6640 1 -- 172.21.15.87:0/219823359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ccf291fd0 msgr2=0x560ccf28af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:21:30.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.731+0000 7fe0051f6640 1 --2- 172.21.15.87:0/219823359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ccf291fd0 0x560ccf28af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.731+0000 7fe0051f6640 1 -- 172.21.15.87:0/219823359 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560ccf1e9620 con 0x560ccf286e10 2024-09-13T17:21:30.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.731+0000 7fe0049f5640 1 --2- 172.21.15.87:0/219823359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ccf287730 0x560ccf299280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:21:30.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.731+0000 7fe0051f6640 1 --2- 172.21.15.87:0/219823359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ccf286e10 0x560ccf298d40 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fdffc093040 tx=0x7fdffc09aa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fbfff03cd012227 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:21:30.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.731+0000 7fdfe8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:21:30.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.731+0000 7fdfe8ff9640 1 -- 172.21.15.87:0/219823359 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc0cd370 con 0x560ccf286e10 2024-09-13T17:21:30.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.731+0000 7fdfe8ff9640 1 -- 172.21.15.87:0/219823359 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fdffc0b82b0 con 0x560ccf286e10 2024-09-13T17:21:30.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.731+0000 7fe00a254740 1 -- 172.21.15.87:0/219823359 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdff0031b90 con 0x560ccf286e10 2024-09-13T17:21:30.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.731+0000 7fdfe8ff9640 1 -- 172.21.15.87:0/219823359 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdffc0969e0 con 0x560ccf286e10 2024-09-13T17:21:30.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.731+0000 7fe00a254740 10 client.17691 fetch_fsmap learned FSMap version 36 2024-09-13T17:21:30.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.731+0000 7fe00a254740 1 -- 172.21.15.87:0/219823359 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x560ccf1b0ea0 con 0x560ccf286e10 2024-09-13T17:21:30.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.731+0000 7fdfe8ff9640 1 -- 172.21.15.87:0/219823359 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdff0031b90 con 0x560ccf286e10 2024-09-13T17:21:30.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.732+0000 7fdfe8ff9640 1 -- 172.21.15.87:0/219823359 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fdffc09ef20 con 0x560ccf286e10 2024-09-13T17:21:30.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.732+0000 7fe00a254740 10 client.17691 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:21:30.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.732+0000 7fe00a254740 10 client.17691 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:21:30.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.732+0000 7fe00a254740 20 client.17691 populate_metadata read hostname 'smithi087' 2024-09-13T17:21:30.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.732+0000 7fe00a254740 1 --2- 172.21.15.87:0/219823359 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560ccf2f8c10 0x560ccf2fb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:21:30.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.732+0000 7fe00a254740 4 client.17691 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:21:30.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.732+0000 7fe00a254740 1 -- 172.21.15.87:0/219823359 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560ccef42e30 con 0x560ccf2f8c10 2024-09-13T17:21:30.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.732+0000 7fe0049f5640 1 --2- 172.21.15.87:0/219823359 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560ccf2f8c10 0x560ccf2fb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:21:30.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.732+0000 7fdfe8ff9640 10 client.17691 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:21:30.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.732+0000 7fe0049f5640 1 --2- 172.21.15.87:0/219823359 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560ccf2f8c10 0x560ccf2fb000 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c66f015da9cc998f server_cookie=13d450216060a42d in_seq=0 out_seq=0 2024-09-13T17:21:30.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.732+0000 7fdfe8ff9640 1 -- 172.21.15.87:0/219823359 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x560ccef42e30 con 0x560ccf2f8c10 2024-09-13T17:21:30.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.732+0000 7fdfe8ff9640 10 client.17691 handle_command_reply: tid=0 2024-09-13T17:21:30.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.732+0000 7fe00a254740 1 client.17691 shutdown 2024-09-13T17:21:30.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.733+0000 7fe00a254740 1 -- 172.21.15.87:0/219823359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ccf286e10 msgr2=0x560ccf298d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:30.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.733+0000 7fe00a254740 1 --2- 172.21.15.87:0/219823359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ccf286e10 0x560ccf298d40 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fdffc093040 tx=0x7fdffc09aa10 comp rx=0 tx=0).stop 2024-09-13T17:21:30.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.733+0000 7fe00a254740 1 -- 172.21.15.87:0/219823359 shutdown_connections 2024-09-13T17:21:30.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.733+0000 7fe00a254740 1 --2- 172.21.15.87:0/219823359 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560ccf2f8c10 0x560ccf2fb000 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.733+0000 7fe00a254740 1 --2- 172.21.15.87:0/219823359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ccf291fd0 0x560ccf28af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.733+0000 7fdfe8ff9640 0 client.17691 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:21:30.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.733+0000 7fe00a254740 1 --2- 172.21.15.87:0/219823359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ccf287730 0x560ccf299280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.733+0000 7fe00a254740 1 --2- 172.21.15.87:0/219823359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ccf286e10 0x560ccf298d40 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.733+0000 7fe00a254740 1 -- 172.21.15.87:0/219823359 >> 172.21.15.87:0/219823359 conn(0x560ccf283380 msgr2=0x560ccf28d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:30.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.733+0000 7fe00a254740 1 -- 172.21.15.87:0/219823359 shutdown_connections 2024-09-13T17:21:30.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.733+0000 7fe00a254740 1 -- 172.21.15.87:0/219823359 wait complete. 2024-09-13T17:21:30.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.733+0000 7fe00a254740 20 client.17691 trim_cache size 0 max 16384 2024-09-13T17:21:30.742 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:21:30.742 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-13T17:21:30.742 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": { 2024-09-13T17:21:30.742 INFO:teuthology.orchestra.run.smithi087.stdout: "4e55a1a5-ead3-4d8b-a6cb-e964b49694f4": { 2024-09-13T17:21:30.742 INFO:teuthology.orchestra.run.smithi087.stdout: "path": "/", 2024-09-13T17:21:30.742 INFO:teuthology.orchestra.run.smithi087.stdout: "tag": "4e55a1a5-ead3-4d8b-a6cb-e964b49694f4", 2024-09-13T17:21:30.742 INFO:teuthology.orchestra.run.smithi087.stdout: "options": "recursive,force" 2024-09-13T17:21:30.742 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:21:30.743 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:21:30.743 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:21:30.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.733+0000 7fe00745a640 1 -- 172.21.15.87:0/461944778 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdfec0a1280 msgr2=0x7fdfec0a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:30.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.733+0000 7fe00745a640 1 --2- 172.21.15.87:0/461944778 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdfec0a1280 0x7fdfec0a3740 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdff80092f0 tx=0x7fdff8009bf0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.733+0000 7fe00745a640 1 -- 172.21.15.87:0/461944778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0000fff60 msgr2=0x7fe000196290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:21:30.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.733+0000 7fe00745a640 1 --2- 172.21.15.87:0/461944778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0000fff60 0x7fe000196290 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fdffc00e9f0 tx=0x7fdffc00eeb0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.733+0000 7fe00745a640 1 -- 172.21.15.87:0/461944778 shutdown_connections 2024-09-13T17:21:30.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.733+0000 7fe00745a640 1 --2- 172.21.15.87:0/461944778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe00019abc0 0x7fe00019b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.733+0000 7fe00745a640 1 --2- 172.21.15.87:0/461944778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0001050b0 0x7fe0001967d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.733+0000 7fe00745a640 1 --2- 172.21.15.87:0/461944778 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdfec0a1280 0x7fdfec0a3740 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.733+0000 7fe00745a640 1 --2- 172.21.15.87:0/461944778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0000fff60 0x7fe000196290 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:21:30.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.733+0000 7fe00745a640 1 -- 172.21.15.87:0/461944778 >> 172.21.15.87:0/461944778 conn(0x7fe0000fb9f0 msgr2=0x7fe0000fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:21:30.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.733+0000 7fe00745a640 1 -- 172.21.15.87:0/461944778 shutdown_connections 2024-09-13T17:21:30.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:21:30.733+0000 7fe00745a640 1 -- 172.21.15.87:0/461944778 wait complete. 2024-09-13T17:21:30.745 INFO:tasks.cephfs.filesystem:scrub status for tag:4e55a1a5-ead3-4d8b-a6cb-e964b49694f4 - {'path': '/', 'tag': '4e55a1a5-ead3-4d8b-a6cb-e964b49694f4', 'options': 'recursive,force'} 2024-09-13T17:21:31.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:31 smithi149 ceph-mon[35496]: scrub queued for path: / 2024-09-13T17:21:31.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:31 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:21:31.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:31 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:21:31.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:31 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:21:31.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:31 smithi118 ceph-mon[34374]: scrub queued for path: / 2024-09-13T17:21:31.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:31 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:21:31.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:31 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:21:31.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:31 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:21:31.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:31 smithi087 ceph-mon[30934]: scrub queued for path: / 2024-09-13T17:21:31.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:31 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:21:31.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:31 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:21:31.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:31 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:21:32.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:32 smithi149 ceph-mon[35496]: pgmap v238: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 10 op/s 2024-09-13T17:21:32.366 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:32 smithi118 ceph-mon[34374]: pgmap v238: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 10 op/s 2024-09-13T17:21:32.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:32 smithi087 ceph-mon[30934]: pgmap v238: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 10 op/s 2024-09-13T17:21:33.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:33 smithi149 ceph-mon[35496]: pgmap v239: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:21:33.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:33 smithi118 ceph-mon[34374]: pgmap v239: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:21:33.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:33 smithi087 ceph-mon[30934]: pgmap v239: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:21:35.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:34 smithi149 ceph-mon[35496]: scrub summary: idle 2024-09-13T17:21:35.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:34 smithi118 ceph-mon[34374]: scrub summary: idle 2024-09-13T17:21:35.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:34 smithi087 ceph-mon[30934]: scrub summary: idle 2024-09-13T17:21:36.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:35 smithi149 ceph-mon[35496]: pgmap v240: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:21:36.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:35 smithi118 ceph-mon[34374]: pgmap v240: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:21:36.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:35 smithi087 ceph-mon[30934]: pgmap v240: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:21:37.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:37 smithi149 ceph-mon[35496]: pgmap v241: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:21:37.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:37 smithi118 ceph-mon[34374]: pgmap v241: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:21:37.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:37 smithi087 ceph-mon[30934]: pgmap v241: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:21:39.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:39 smithi149 ceph-mon[35496]: pgmap v242: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:21:39.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:39 smithi118 ceph-mon[34374]: pgmap v242: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:21:39.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:39 smithi087 ceph-mon[30934]: pgmap v242: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:21:41.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:41 smithi149 ceph-mon[35496]: pgmap v243: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:21:41.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:41 smithi118 ceph-mon[34374]: pgmap v243: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:21:41.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:41 smithi087 ceph-mon[30934]: pgmap v243: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:21:43.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:43 smithi149 ceph-mon[35496]: pgmap v244: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:21:43.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:43 smithi118 ceph-mon[34374]: pgmap v244: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:21:43.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:43 smithi087 ceph-mon[30934]: pgmap v244: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:21:45.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:45 smithi149 ceph-mon[35496]: pgmap v245: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:21:45.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:45 smithi118 ceph-mon[34374]: pgmap v245: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:21:45.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:45 smithi087 ceph-mon[30934]: pgmap v245: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:21:47.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:47 smithi118 ceph-mon[34374]: pgmap v246: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:21:47.981 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:47 smithi087 ceph-mon[30934]: pgmap v246: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:21:48.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:47 smithi149 ceph-mon[35496]: pgmap v246: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:21:49.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:49 smithi118 ceph-mon[34374]: pgmap v247: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:21:49.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:49 smithi087 ceph-mon[30934]: pgmap v247: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:21:50.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:49 smithi149 ceph-mon[35496]: pgmap v247: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:21:51.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:51 smithi118 ceph-mon[34374]: pgmap v248: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:21:51.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:51 smithi087 ceph-mon[30934]: pgmap v248: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:21:52.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:51 smithi149 ceph-mon[35496]: pgmap v248: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:21:53.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:53 smithi149 ceph-mon[35496]: pgmap v249: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:21:53.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:53 smithi118 ceph-mon[34374]: pgmap v249: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:21:53.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:53 smithi087 ceph-mon[30934]: pgmap v249: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:21:55.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:55 smithi149 ceph-mon[35496]: pgmap v250: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:21:55.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:55 smithi118 ceph-mon[34374]: pgmap v250: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:21:55.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:55 smithi087 ceph-mon[30934]: pgmap v250: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:21:57.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:57 smithi149 ceph-mon[35496]: pgmap v251: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:21:57.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:57 smithi118 ceph-mon[34374]: pgmap v251: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:21:57.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:57 smithi087 ceph-mon[30934]: pgmap v251: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:21:59.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:21:59 smithi118 ceph-mon[34374]: pgmap v252: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:21:59.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:21:59 smithi087 ceph-mon[30934]: pgmap v252: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:22:00.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:21:59 smithi149 ceph-mon[35496]: pgmap v252: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:22:00.746 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:22:00.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.859+0000 7fe49b308640 1 -- 172.21.15.87:0/1910882927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4941040d0 msgr2=0x7fe494104580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:00.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.859+0000 7fe49b308640 1 --2- 172.21.15.87:0/1910882927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4941040d0 0x7fe494104580 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fe48c009d00 tx=0x7fe48c02a9a0 comp rx=0 tx=0).stop 2024-09-13T17:22:00.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.859+0000 7fe49b308640 1 -- 172.21.15.87:0/1910882927 shutdown_connections 2024-09-13T17:22:00.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.859+0000 7fe49b308640 1 --2- 172.21.15.87:0/1910882927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4941040d0 0x7fe494104580 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:00.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.859+0000 7fe49b308640 1 --2- 172.21.15.87:0/1910882927 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4940ff5c0 0x7fe494103a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:00.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.859+0000 7fe49b308640 1 --2- 172.21.15.87:0/1910882927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4940feca0 0x7fe4940ff080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:00.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.859+0000 7fe49b308640 1 -- 172.21.15.87:0/1910882927 >> 172.21.15.87:0/1910882927 conn(0x7fe4940fa8e0 msgr2=0x7fe4940fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:00.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.859+0000 7fe49b308640 1 -- 172.21.15.87:0/1910882927 shutdown_connections 2024-09-13T17:22:00.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.859+0000 7fe49b308640 1 -- 172.21.15.87:0/1910882927 wait complete. 2024-09-13T17:22:00.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.860+0000 7fe49b308640 1 Processor -- start 2024-09-13T17:22:00.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.860+0000 7fe49b308640 1 -- start start 2024-09-13T17:22:00.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.860+0000 7fe49b308640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4940feca0 0x7fe4941a2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:00.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.860+0000 7fe49b308640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4940ff5c0 0x7fe4941a2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:00.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.860+0000 7fe49b308640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4941040d0 0x7fe49419c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:00.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.860+0000 7fe49b308640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49419cc90 con 0x7fe4940feca0 2024-09-13T17:22:00.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.860+0000 7fe49b308640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49419ce00 con 0x7fe4940ff5c0 2024-09-13T17:22:00.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.860+0000 7fe49b308640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49419cfc0 con 0x7fe4941040d0 2024-09-13T17:22:00.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.860+0000 7fe4990a4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4940feca0 0x7fe4941a2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:00.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.860+0000 7fe4990a4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4940feca0 0x7fe4941a2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49450/0 (socket says 172.21.15.87:49450) 2024-09-13T17:22:00.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.860+0000 7fe4990a4640 1 -- 172.21.15.87:0/856294776 learned_addr learned my addr 172.21.15.87:0/856294776 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:00.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.861+0000 7fe4998a5640 1 --2- 172.21.15.87:0/856294776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4941040d0 0x7fe49419c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:00.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.861+0000 7fe4988a3640 1 --2- 172.21.15.87:0/856294776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4940ff5c0 0x7fe4941a2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:00.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.861+0000 7fe4990a4640 1 -- 172.21.15.87:0/856294776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4941040d0 msgr2=0x7fe49419c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:00.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.861+0000 7fe4990a4640 1 --2- 172.21.15.87:0/856294776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4941040d0 0x7fe49419c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:00.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.861+0000 7fe4990a4640 1 -- 172.21.15.87:0/856294776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4940ff5c0 msgr2=0x7fe4941a2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:00.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.861+0000 7fe4990a4640 1 --2- 172.21.15.87:0/856294776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4940ff5c0 0x7fe4941a2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:00.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.861+0000 7fe4990a4640 1 -- 172.21.15.87:0/856294776 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48c009900 con 0x7fe4940feca0 2024-09-13T17:22:00.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.861+0000 7fe4998a5640 1 --2- 172.21.15.87:0/856294776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4941040d0 0x7fe49419c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:22:00.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.861+0000 7fe4988a3640 1 --2- 172.21.15.87:0/856294776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4940ff5c0 0x7fe4941a2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:22:00.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.861+0000 7fe4990a4640 1 --2- 172.21.15.87:0/856294776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4940feca0 0x7fe4941a2590 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fe49000d950 tx=0x7fe49000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:00.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.861+0000 7fe48a7fc640 1 -- 172.21.15.87:0/856294776 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe490009a30 con 0x7fe4940feca0 2024-09-13T17:22:00.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.861+0000 7fe48a7fc640 1 -- 172.21.15.87:0/856294776 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe4900044d0 con 0x7fe4940feca0 2024-09-13T17:22:00.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.861+0000 7fe49b308640 1 -- 172.21.15.87:0/856294776 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe49419d2a0 con 0x7fe4940feca0 2024-09-13T17:22:00.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.861+0000 7fe48a7fc640 1 -- 172.21.15.87:0/856294776 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4900047a0 con 0x7fe4940feca0 2024-09-13T17:22:00.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.861+0000 7fe49b308640 1 -- 172.21.15.87:0/856294776 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4941a9580 con 0x7fe4940feca0 2024-09-13T17:22:00.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.863+0000 7fe48a7fc640 1 -- 172.21.15.87:0/856294776 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fe490009b90 con 0x7fe4940feca0 2024-09-13T17:22:00.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.864+0000 7fe49e025740 1 Processor -- start 2024-09-13T17:22:00.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.864+0000 7fe49e025740 1 -- start start 2024-09-13T17:22:00.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.864+0000 7fe49e025740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556a07b08e10 0x556a07b091f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:00.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.864+0000 7fe49e025740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556a07b09730 0x556a07b13a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:00.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.864+0000 7fe49e025740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a07b13fd0 0x556a07b163c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:00.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.864+0000 7fe49e025740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a07a73f20 con 0x556a07b13fd0 2024-09-13T17:22:00.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.864+0000 7fe49e025740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a07a716b0 con 0x556a07b08e10 2024-09-13T17:22:00.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.864+0000 7fe49e025740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a07a6cfa0 con 0x556a07b09730 2024-09-13T17:22:00.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.864+0000 7fe48a7fc640 1 --2- 172.21.15.87:0/856294776 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe4800a1200 0x7fe4800a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:00.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.864+0000 7fe4988a3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a07b13fd0 0x556a07b163c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:00.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.864+0000 7fe4988a3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a07b13fd0 0x556a07b163c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49464/0 (socket says 172.21.15.87:49464) 2024-09-13T17:22:00.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.864+0000 7fe4988a3640 1 -- 172.21.15.87:0/3508413869 learned_addr learned my addr 172.21.15.87:0/3508413869 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:00.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.864+0000 7fe4998a5640 1 --2- 172.21.15.87:0/856294776 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe4800a1200 0x7fe4800a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:00.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.865+0000 7fe4998a5640 1 --2- 172.21.15.87:0/3508413869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556a07b08e10 0x556a07b091f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:00.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.865+0000 7fe4990a4640 1 --2- 172.21.15.87:0/3508413869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556a07b09730 0x556a07b13a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:00.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.865+0000 7fe48a7fc640 1 -- 172.21.15.87:0/856294776 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fe4900ccba0 con 0x7fe4940feca0 2024-09-13T17:22:00.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.865+0000 7fe4988a3640 1 -- 172.21.15.87:0/3508413869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556a07b09730 msgr2=0x556a07b13a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:00.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.865+0000 7fe4988a3640 1 --2- 172.21.15.87:0/3508413869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556a07b09730 0x556a07b13a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:00.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.865+0000 7fe4988a3640 1 -- 172.21.15.87:0/3508413869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556a07b08e10 msgr2=0x556a07b091f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:00.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.865+0000 7fe4988a3640 1 --2- 172.21.15.87:0/3508413869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556a07b08e10 0x556a07b091f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:00.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.865+0000 7fe4988a3640 1 -- 172.21.15.87:0/3508413869 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a07a27840 con 0x556a07b13fd0 2024-09-13T17:22:00.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.865+0000 7fe4988a3640 1 --2- 172.21.15.87:0/3508413869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a07b13fd0 0x556a07b163c0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fe48400bcb0 tx=0x7fe48400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6895ac66d2b8f7d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:00.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.865+0000 7fe4998a5640 1 --2- 172.21.15.87:0/856294776 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe4800a1200 0x7fe4800a36c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe48c006010 tx=0x7fe48c005d80 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:00.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.865+0000 7fe47f7fe640 1 -- 172.21.15.87:0/3508413869 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48401a460 con 0x556a07b13fd0 2024-09-13T17:22:00.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.865+0000 7fe47f7fe640 1 -- 172.21.15.87:0/3508413869 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe4840118f0 con 0x556a07b13fd0 2024-09-13T17:22:00.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.865+0000 7fe47f7fe640 1 -- 172.21.15.87:0/3508413869 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4840108e0 con 0x556a07b13fd0 2024-09-13T17:22:00.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.866+0000 7fe49e025740 1 -- 172.21.15.87:0/3508413869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a07b13fd0 msgr2=0x556a07b163c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:00.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.866+0000 7fe49e025740 1 --2- 172.21.15.87:0/3508413869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a07b13fd0 0x556a07b163c0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fe48400bcb0 tx=0x7fe48400f730 comp rx=0 tx=0).stop 2024-09-13T17:22:00.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.866+0000 7fe49e025740 1 -- 172.21.15.87:0/3508413869 shutdown_connections 2024-09-13T17:22:00.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.866+0000 7fe49e025740 1 --2- 172.21.15.87:0/3508413869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a07b13fd0 0x556a07b163c0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:00.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.866+0000 7fe49e025740 1 --2- 172.21.15.87:0/3508413869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556a07b09730 0x556a07b13a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:00.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.866+0000 7fe49e025740 1 --2- 172.21.15.87:0/3508413869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556a07b08e10 0x556a07b091f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:00.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.866+0000 7fe49e025740 1 -- 172.21.15.87:0/3508413869 >> 172.21.15.87:0/3508413869 conn(0x556a07b05380 msgr2=0x556a07b05760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:00.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.866+0000 7fe49e025740 1 -- 172.21.15.87:0/3508413869 shutdown_connections 2024-09-13T17:22:00.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.866+0000 7fe49e025740 1 -- 172.21.15.87:0/3508413869 wait complete. 2024-09-13T17:22:00.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.866+0000 7fe49e025740 1 -- start start 2024-09-13T17:22:00.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.866+0000 7fe49e025740 1 Processor -- start 2024-09-13T17:22:00.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.867+0000 7fe49e025740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a07b08e10 0x556a07b13960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:00.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.867+0000 7fe49e025740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556a07b09730 0x556a07b10c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:00.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.867+0000 7fe49e025740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556a07b13fd0 0x556a07b11220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:00.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.867+0000 7fe49e025740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a07a0e2a0 con 0x556a07b08e10 2024-09-13T17:22:00.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.867+0000 7fe49e025740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a07745430 con 0x556a07b09730 2024-09-13T17:22:00.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.867+0000 7fe49e025740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a079f0680 con 0x556a07b13fd0 2024-09-13T17:22:00.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.867+0000 7fe49e025740 10 client.0 _ll_register_callbacks cb 0x556a07a66610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:22:00.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.867+0000 7fe4990a4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a07b08e10 0x556a07b13960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:00.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.867+0000 7fe4990a4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a07b08e10 0x556a07b13960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49478/0 (socket says 172.21.15.87:49478) 2024-09-13T17:22:00.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.867+0000 7fe4990a4640 1 -- 172.21.15.87:0/1791915160 learned_addr learned my addr 172.21.15.87:0/1791915160 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:00.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.867+0000 7fe4988a3640 1 --2- 172.21.15.87:0/1791915160 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556a07b09730 0x556a07b10c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:00.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.867+0000 7fe4998a5640 1 --2- 172.21.15.87:0/1791915160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556a07b13fd0 0x556a07b11220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:00.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.867+0000 7fe4990a4640 1 -- 172.21.15.87:0/1791915160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556a07b13fd0 msgr2=0x556a07b11220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:00.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.867+0000 7fe4990a4640 1 --2- 172.21.15.87:0/1791915160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556a07b13fd0 0x556a07b11220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:00.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.867+0000 7fe4990a4640 1 -- 172.21.15.87:0/1791915160 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556a07b09730 msgr2=0x556a07b10c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:00.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.867+0000 7fe4990a4640 1 --2- 172.21.15.87:0/1791915160 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556a07b09730 0x556a07b10c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:00.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.867+0000 7fe4990a4640 1 -- 172.21.15.87:0/1791915160 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe48400b8e0 con 0x556a07b08e10 2024-09-13T17:22:00.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.867+0000 7fe4990a4640 1 --2- 172.21.15.87:0/1791915160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a07b08e10 0x556a07b13960 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fe490096310 tx=0x7fe4900215f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a1d2073f4082090 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:00.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.867+0000 7fe47cff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:22:00.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.867+0000 7fe47cff9640 1 -- 172.21.15.87:0/1791915160 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe490099200 con 0x556a07b08e10 2024-09-13T17:22:00.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.867+0000 7fe47cff9640 1 -- 172.21.15.87:0/1791915160 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fe490099fa0 con 0x556a07b08e10 2024-09-13T17:22:00.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.867+0000 7fe49e025740 1 -- 172.21.15.87:0/1791915160 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556a077604e0 con 0x556a07b08e10 2024-09-13T17:22:00.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.868+0000 7fe47cff9640 1 -- 172.21.15.87:0/1791915160 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4900998a0 con 0x556a07b08e10 2024-09-13T17:22:00.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.868+0000 7fe49e025740 10 client.17703 fetch_fsmap learned FSMap version 36 2024-09-13T17:22:00.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.868+0000 7fe49e025740 1 -- 172.21.15.87:0/1791915160 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x556a07a6b620 con 0x556a07b08e10 2024-09-13T17:22:00.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.868+0000 7fe47cff9640 1 -- 172.21.15.87:0/1791915160 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x556a077604e0 con 0x556a07b08e10 2024-09-13T17:22:00.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.868+0000 7fe47cff9640 1 -- 172.21.15.87:0/1791915160 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fe490018270 con 0x556a07b08e10 2024-09-13T17:22:00.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.868+0000 7fe49e025740 10 client.17703 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:22:00.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.868+0000 7fe49e025740 10 client.17703 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:22:00.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.868+0000 7fe49e025740 20 client.17703 populate_metadata read hostname 'smithi087' 2024-09-13T17:22:00.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.868+0000 7fe49e025740 1 --2- 172.21.15.87:0/1791915160 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x556a07b23c50 0x556a07b26040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:00.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.868+0000 7fe49e025740 4 client.17703 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:22:00.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.868+0000 7fe49e025740 1 -- 172.21.15.87:0/1791915160 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556a077717e0 con 0x556a07b23c50 2024-09-13T17:22:00.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.868+0000 7fe4988a3640 1 --2- 172.21.15.87:0/1791915160 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x556a07b23c50 0x556a07b26040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:00.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.869+0000 7fe4988a3640 1 --2- 172.21.15.87:0/1791915160 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x556a07b23c50 0x556a07b26040 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75e30bb3c2a03f33 server_cookie=8c18753883102714 in_seq=0 out_seq=0 2024-09-13T17:22:00.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.869+0000 7fe47cff9640 10 client.17703 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:22:00.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.869+0000 7fe47cff9640 1 -- 172.21.15.87:0/1791915160 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x556a077717e0 con 0x556a07b23c50 2024-09-13T17:22:00.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.869+0000 7fe47cff9640 10 client.17703 handle_command_reply: tid=0 2024-09-13T17:22:00.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.869+0000 7fe49e025740 1 client.17703 shutdown 2024-09-13T17:22:00.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.870+0000 7fe49e025740 1 -- 172.21.15.87:0/1791915160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a07b08e10 msgr2=0x556a07b13960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:00.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.870+0000 7fe49e025740 1 --2- 172.21.15.87:0/1791915160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a07b08e10 0x556a07b13960 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fe490096310 tx=0x7fe4900215f0 comp rx=0 tx=0).stop 2024-09-13T17:22:00.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.870+0000 7fe49e025740 1 -- 172.21.15.87:0/1791915160 shutdown_connections 2024-09-13T17:22:00.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.870+0000 7fe49e025740 1 --2- 172.21.15.87:0/1791915160 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x556a07b23c50 0x556a07b26040 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:00.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.870+0000 7fe49e025740 1 --2- 172.21.15.87:0/1791915160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556a07b13fd0 0x556a07b11220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:00.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.870+0000 7fe49e025740 1 --2- 172.21.15.87:0/1791915160 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556a07b09730 0x556a07b10c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:00.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.870+0000 7fe47cff9640 0 client.17703 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:22:00.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.870+0000 7fe49e025740 1 --2- 172.21.15.87:0/1791915160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a07b08e10 0x556a07b13960 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:00.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.870+0000 7fe49e025740 1 -- 172.21.15.87:0/1791915160 >> 172.21.15.87:0/1791915160 conn(0x556a07b05380 msgr2=0x556a07b04510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:00.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.870+0000 7fe49e025740 1 -- 172.21.15.87:0/1791915160 shutdown_connections 2024-09-13T17:22:00.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.870+0000 7fe49e025740 1 -- 172.21.15.87:0/1791915160 wait complete. 2024-09-13T17:22:00.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.870+0000 7fe49e025740 20 client.17703 trim_cache size 0 max 16384 2024-09-13T17:22:00.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.885+0000 7fe49e025740 1 Processor -- start 2024-09-13T17:22:00.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.885+0000 7fe49e025740 1 -- start start 2024-09-13T17:22:00.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.885+0000 7fe49e025740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556a07b08e10 0x556a07b04d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:00.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.885+0000 7fe49e025740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a07b09730 0x556a07b0bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:00.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.885+0000 7fe49e025740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556a07b13fd0 0x556a07b0c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:00.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.885+0000 7fe49e025740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a07b09ca0 con 0x556a07b09730 2024-09-13T17:22:00.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.885+0000 7fe49e025740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a07b1fc50 con 0x556a07b08e10 2024-09-13T17:22:00.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.885+0000 7fe49e025740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a07b00760 con 0x556a07b13fd0 2024-09-13T17:22:00.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.885+0000 7fe4988a3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a07b09730 0x556a07b0bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:00.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.885+0000 7fe4988a3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a07b09730 0x556a07b0bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49484/0 (socket says 172.21.15.87:49484) 2024-09-13T17:22:00.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.885+0000 7fe4988a3640 1 -- 172.21.15.87:0/658748926 learned_addr learned my addr 172.21.15.87:0/658748926 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:00.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.885+0000 7fe4988a3640 1 -- 172.21.15.87:0/658748926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556a07b13fd0 msgr2=0x556a07b0c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:00.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.885+0000 7fe4988a3640 1 --2- 172.21.15.87:0/658748926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556a07b13fd0 0x556a07b0c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:00.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.885+0000 7fe4988a3640 1 -- 172.21.15.87:0/658748926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556a07b08e10 msgr2=0x556a07b04d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:00.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.885+0000 7fe4988a3640 1 --2- 172.21.15.87:0/658748926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556a07b08e10 0x556a07b04d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:00.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.885+0000 7fe4988a3640 1 -- 172.21.15.87:0/658748926 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a07a0d790 con 0x556a07b09730 2024-09-13T17:22:00.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.885+0000 7fe4988a3640 1 --2- 172.21.15.87:0/658748926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a07b09730 0x556a07b0bef0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fe484006010 tx=0x7fe48400b5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87718a43409496d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:00.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.885+0000 7fe47ffff640 1 -- 172.21.15.87:0/658748926 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe484020050 con 0x556a07b09730 2024-09-13T17:22:00.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.885+0000 7fe47ffff640 1 -- 172.21.15.87:0/658748926 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe484021040 con 0x556a07b09730 2024-09-13T17:22:00.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.885+0000 7fe47ffff640 1 -- 172.21.15.87:0/658748926 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe484005040 con 0x556a07b09730 2024-09-13T17:22:00.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.885+0000 7fe49e025740 1 -- 172.21.15.87:0/658748926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a07b09730 msgr2=0x556a07b0bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:00.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.885+0000 7fe49e025740 1 --2- 172.21.15.87:0/658748926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a07b09730 0x556a07b0bef0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fe484006010 tx=0x7fe48400b5a0 comp rx=0 tx=0).stop 2024-09-13T17:22:00.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.885+0000 7fe49e025740 1 -- 172.21.15.87:0/658748926 shutdown_connections 2024-09-13T17:22:00.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.885+0000 7fe49e025740 1 --2- 172.21.15.87:0/658748926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556a07b13fd0 0x556a07b0c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:00.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.885+0000 7fe49e025740 1 --2- 172.21.15.87:0/658748926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a07b09730 0x556a07b0bef0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:00.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.885+0000 7fe49e025740 1 --2- 172.21.15.87:0/658748926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556a07b08e10 0x556a07b04d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:00.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.885+0000 7fe49e025740 1 -- 172.21.15.87:0/658748926 >> 172.21.15.87:0/658748926 conn(0x556a07b05380 msgr2=0x556a07b2a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:00.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.885+0000 7fe49e025740 1 -- 172.21.15.87:0/658748926 shutdown_connections 2024-09-13T17:22:00.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.885+0000 7fe49e025740 1 -- 172.21.15.87:0/658748926 wait complete. 2024-09-13T17:22:00.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.885+0000 7fe49e025740 1 -- start start 2024-09-13T17:22:00.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.885+0000 7fe49e025740 1 Processor -- start 2024-09-13T17:22:00.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.886+0000 7fe49e025740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556a07b08e10 0x556a07b1ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:00.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.886+0000 7fe49e025740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556a07b09730 0x556a07b1b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:00.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.886+0000 7fe49e025740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a07b13fd0 0x556a07b17540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:00.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.886+0000 7fe49e025740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a07b17c40 con 0x556a07b13fd0 2024-09-13T17:22:00.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.886+0000 7fe49e025740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a07b17db0 con 0x556a07b08e10 2024-09-13T17:22:00.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.886+0000 7fe49e025740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a07b17f70 con 0x556a07b09730 2024-09-13T17:22:00.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.886+0000 7fe49e025740 10 client.0 _ll_register_callbacks cb 0x7fe490095500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:22:00.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.886+0000 7fe4998a5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a07b13fd0 0x556a07b17540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:00.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.886+0000 7fe4998a5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a07b13fd0 0x556a07b17540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49490/0 (socket says 172.21.15.87:49490) 2024-09-13T17:22:00.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.886+0000 7fe4998a5640 1 -- 172.21.15.87:0/2071573243 learned_addr learned my addr 172.21.15.87:0/2071573243 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:00.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.886+0000 7fe4990a4640 1 --2- 172.21.15.87:0/2071573243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556a07b08e10 0x556a07b1ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:00.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.886+0000 7fe4998a5640 1 -- 172.21.15.87:0/2071573243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556a07b09730 msgr2=0x556a07b1b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:00.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.886+0000 7fe4998a5640 1 --2- 172.21.15.87:0/2071573243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556a07b09730 0x556a07b1b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:00.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.886+0000 7fe4998a5640 1 -- 172.21.15.87:0/2071573243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556a07b08e10 msgr2=0x556a07b1ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:00.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.886+0000 7fe4998a5640 1 --2- 172.21.15.87:0/2071573243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556a07b08e10 0x556a07b1ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:00.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.886+0000 7fe4998a5640 1 -- 172.21.15.87:0/2071573243 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556a07a27840 con 0x556a07b13fd0 2024-09-13T17:22:00.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.886+0000 7fe4998a5640 1 --2- 172.21.15.87:0/2071573243 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a07b13fd0 0x556a07b17540 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fe48c035000 tx=0x7fe48c02a9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3087cee686227735 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:00.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.886+0000 7fe47cff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:22:00.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.887+0000 7fe47cff9640 1 -- 172.21.15.87:0/2071573243 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c04d040 con 0x556a07b13fd0 2024-09-13T17:22:00.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.887+0000 7fe47cff9640 1 -- 172.21.15.87:0/2071573243 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fe48c02e540 con 0x556a07b13fd0 2024-09-13T17:22:00.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.887+0000 7fe49e025740 1 -- 172.21.15.87:0/2071573243 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe4840118f0 con 0x556a07b13fd0 2024-09-13T17:22:00.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.887+0000 7fe47cff9640 1 -- 172.21.15.87:0/2071573243 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe48c02ff10 con 0x556a07b13fd0 2024-09-13T17:22:00.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.887+0000 7fe49e025740 10 client.17709 fetch_fsmap learned FSMap version 36 2024-09-13T17:22:00.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.887+0000 7fe49e025740 1 -- 172.21.15.87:0/2071573243 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x556a07a32ea0 con 0x556a07b13fd0 2024-09-13T17:22:00.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.887+0000 7fe47cff9640 1 -- 172.21.15.87:0/2071573243 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe4840118f0 con 0x556a07b13fd0 2024-09-13T17:22:00.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.887+0000 7fe47cff9640 1 -- 172.21.15.87:0/2071573243 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fe48c050030 con 0x556a07b13fd0 2024-09-13T17:22:00.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.887+0000 7fe49e025740 10 client.17709 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:22:00.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.887+0000 7fe49e025740 10 client.17709 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:22:00.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.887+0000 7fe49e025740 20 client.17709 populate_metadata read hostname 'smithi087' 2024-09-13T17:22:00.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.887+0000 7fe49e025740 1 --2- 172.21.15.87:0/2071573243 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x556a07b7b520 0x556a07b7d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:00.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.887+0000 7fe49e025740 4 client.17709 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:22:00.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.887+0000 7fe49e025740 1 -- 172.21.15.87:0/2071573243 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556a077c4e30 con 0x556a07b7b520 2024-09-13T17:22:00.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.887+0000 7fe4990a4640 1 --2- 172.21.15.87:0/2071573243 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x556a07b7b520 0x556a07b7d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:00.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.888+0000 7fe4990a4640 1 --2- 172.21.15.87:0/2071573243 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x556a07b7b520 0x556a07b7d940 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=891728007a2c29cf server_cookie=273f0fee9d6251ff in_seq=0 out_seq=0 2024-09-13T17:22:00.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.888+0000 7fe47cff9640 10 client.17709 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:22:00.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.888+0000 7fe47cff9640 1 -- 172.21.15.87:0/2071573243 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x556a077c4e30 con 0x556a07b7b520 2024-09-13T17:22:00.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.888+0000 7fe47cff9640 10 client.17709 handle_command_reply: tid=0 2024-09-13T17:22:00.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.888+0000 7fe49e025740 1 client.17709 shutdown 2024-09-13T17:22:00.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.888+0000 7fe49e025740 1 -- 172.21.15.87:0/2071573243 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a07b13fd0 msgr2=0x556a07b17540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:00.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.888+0000 7fe49e025740 1 --2- 172.21.15.87:0/2071573243 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a07b13fd0 0x556a07b17540 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fe48c035000 tx=0x7fe48c02a9a0 comp rx=0 tx=0).stop 2024-09-13T17:22:00.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.888+0000 7fe49e025740 1 -- 172.21.15.87:0/2071573243 shutdown_connections 2024-09-13T17:22:00.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.888+0000 7fe49e025740 1 --2- 172.21.15.87:0/2071573243 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x556a07b7b520 0x556a07b7d940 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:00.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.888+0000 7fe49e025740 1 --2- 172.21.15.87:0/2071573243 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a07b13fd0 0x556a07b17540 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:00.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.888+0000 7fe49e025740 1 --2- 172.21.15.87:0/2071573243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556a07b09730 0x556a07b1b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:00.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.888+0000 7fe47cff9640 0 client.17709 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:22:00.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.888+0000 7fe49e025740 1 --2- 172.21.15.87:0/2071573243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556a07b08e10 0x556a07b1ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:00.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.888+0000 7fe49e025740 1 -- 172.21.15.87:0/2071573243 >> 172.21.15.87:0/2071573243 conn(0x556a07b05380 msgr2=0x556a07b05760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:00.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.888+0000 7fe49e025740 1 -- 172.21.15.87:0/2071573243 shutdown_connections 2024-09-13T17:22:00.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.888+0000 7fe49e025740 1 -- 172.21.15.87:0/2071573243 wait complete. 2024-09-13T17:22:00.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.888+0000 7fe49e025740 20 client.17709 trim_cache size 0 max 16384 2024-09-13T17:22:00.901 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:22:00.901 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "no active scrubs running", 2024-09-13T17:22:00.901 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": {} 2024-09-13T17:22:00.901 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:22:00.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.889+0000 7fe49b308640 1 -- 172.21.15.87:0/856294776 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe4800a1200 msgr2=0x7fe4800a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:00.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.889+0000 7fe49b308640 1 --2- 172.21.15.87:0/856294776 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe4800a1200 0x7fe4800a36c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe48c006010 tx=0x7fe48c005d80 comp rx=0 tx=0).stop 2024-09-13T17:22:00.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.889+0000 7fe49b308640 1 -- 172.21.15.87:0/856294776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4940feca0 msgr2=0x7fe4941a2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:00.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.889+0000 7fe49b308640 1 --2- 172.21.15.87:0/856294776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4940feca0 0x7fe4941a2590 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fe49000d950 tx=0x7fe49000de10 comp rx=0 tx=0).stop 2024-09-13T17:22:00.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.889+0000 7fe49b308640 1 -- 172.21.15.87:0/856294776 shutdown_connections 2024-09-13T17:22:00.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.889+0000 7fe49b308640 1 --2- 172.21.15.87:0/856294776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4941040d0 0x7fe49419c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:00.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.889+0000 7fe49b308640 1 --2- 172.21.15.87:0/856294776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4940ff5c0 0x7fe4941a2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:00.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.889+0000 7fe49b308640 1 --2- 172.21.15.87:0/856294776 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe4800a1200 0x7fe4800a36c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:00.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.889+0000 7fe49b308640 1 --2- 172.21.15.87:0/856294776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4940feca0 0x7fe4941a2590 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:00.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.889+0000 7fe49b308640 1 -- 172.21.15.87:0/856294776 >> 172.21.15.87:0/856294776 conn(0x7fe4940fa8e0 msgr2=0x7fe4940fba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:00.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.889+0000 7fe49b308640 1 -- 172.21.15.87:0/856294776 shutdown_connections 2024-09-13T17:22:00.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.889+0000 7fe49b308640 1 -- 172.21.15.87:0/856294776 wait complete. 2024-09-13T17:22:00.903 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T17:22:00.904 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:22:01.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.999+0000 7f87cfd25640 1 -- 172.21.15.87:0/3705682810 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87c80feeb0 msgr2=0x7f87c80ff290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:01.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.999+0000 7f87cfd25640 1 --2- 172.21.15.87:0/3705682810 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87c80feeb0 0x7f87c80ff290 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f87c4009930 tx=0x7f87c402a420 comp rx=0 tx=0).stop 2024-09-13T17:22:01.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.999+0000 7f87cfd25640 1 -- 172.21.15.87:0/3705682810 shutdown_connections 2024-09-13T17:22:01.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.999+0000 7f87cfd25640 1 --2- 172.21.15.87:0/3705682810 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87c8104000 0x7f87c810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.999+0000 7f87cfd25640 1 --2- 172.21.15.87:0/3705682810 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87c80ff860 0x7f87c81038a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.999+0000 7f87cfd25640 1 --2- 172.21.15.87:0/3705682810 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87c80feeb0 0x7f87c80ff290 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.999+0000 7f87cfd25640 1 -- 172.21.15.87:0/3705682810 >> 172.21.15.87:0/3705682810 conn(0x7f87c80fa900 msgr2=0x7f87c80fcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:01.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.999+0000 7f87cfd25640 1 -- 172.21.15.87:0/3705682810 shutdown_connections 2024-09-13T17:22:01.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:00.999+0000 7f87cfd25640 1 -- 172.21.15.87:0/3705682810 wait complete. 2024-09-13T17:22:01.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.000+0000 7f87cfd25640 1 Processor -- start 2024-09-13T17:22:01.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.000+0000 7f87cfd25640 1 -- start start 2024-09-13T17:22:01.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.000+0000 7f87cfd25640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87c80feeb0 0x7f87c8196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.000+0000 7f87cfd25640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87c8104000 0x7f87c8196840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.000+0000 7f87cfd25640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87c819ac30 0x7f87c819b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.000+0000 7f87cfd25640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c819b620 con 0x7f87c819ac30 2024-09-13T17:22:01.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.000+0000 7f87cfd25640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c819b790 con 0x7f87c8104000 2024-09-13T17:22:01.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.000+0000 7f87cfd25640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c819b900 con 0x7f87c80feeb0 2024-09-13T17:22:01.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.000+0000 7f87ce2c2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87c819ac30 0x7f87c819b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.000+0000 7f87ce2c2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87c819ac30 0x7f87c819b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49512/0 (socket says 172.21.15.87:49512) 2024-09-13T17:22:01.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.000+0000 7f87ce2c2640 1 -- 172.21.15.87:0/148206802 learned_addr learned my addr 172.21.15.87:0/148206802 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:01.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.000+0000 7f87cd2c0640 1 --2- 172.21.15.87:0/148206802 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87c8104000 0x7f87c8196840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.000+0000 7f87cdac1640 1 --2- 172.21.15.87:0/148206802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87c80feeb0 0x7f87c8196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.000+0000 7f87ce2c2640 1 -- 172.21.15.87:0/148206802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87c80feeb0 msgr2=0x7f87c8196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:01.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.000+0000 7f87ce2c2640 1 --2- 172.21.15.87:0/148206802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87c80feeb0 0x7f87c8196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.000+0000 7f87ce2c2640 1 -- 172.21.15.87:0/148206802 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87c8104000 msgr2=0x7f87c8196840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:01.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.000+0000 7f87ce2c2640 1 --2- 172.21.15.87:0/148206802 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87c8104000 0x7f87c8196840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.000+0000 7f87ce2c2640 1 -- 172.21.15.87:0/148206802 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c4009560 con 0x7f87c819ac30 2024-09-13T17:22:01.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.000+0000 7f87cdac1640 1 --2- 172.21.15.87:0/148206802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87c80feeb0 0x7f87c8196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:22:01.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.001+0000 7f87ce2c2640 1 --2- 172.21.15.87:0/148206802 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87c819ac30 0x7f87c819b0e0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f87c000cad0 tx=0x7f87c000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:01.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.001+0000 7f87beffd640 1 -- 172.21.15.87:0/148206802 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c000ae20 con 0x7f87c819ac30 2024-09-13T17:22:01.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.001+0000 7f87beffd640 1 -- 172.21.15.87:0/148206802 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f87c0005020 con 0x7f87c819ac30 2024-09-13T17:22:01.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.001+0000 7f87cfd25640 1 -- 172.21.15.87:0/148206802 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c81a2ee0 con 0x7f87c819ac30 2024-09-13T17:22:01.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.001+0000 7f87beffd640 1 -- 172.21.15.87:0/148206802 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c000f690 con 0x7f87c819ac30 2024-09-13T17:22:01.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.001+0000 7f87cfd25640 1 -- 172.21.15.87:0/148206802 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c81a3310 con 0x7f87c819ac30 2024-09-13T17:22:01.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.002+0000 7f87cfd25640 1 -- 172.21.15.87:0/148206802 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c8100380 con 0x7f87c819ac30 2024-09-13T17:22:01.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.004+0000 7f87beffd640 1 -- 172.21.15.87:0/148206802 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f87c0005190 con 0x7f87c819ac30 2024-09-13T17:22:01.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.004+0000 7f87beffd640 1 --2- 172.21.15.87:0/148206802 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f87b40a1200 0x7f87b40a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.004+0000 7f87cdac1640 1 --2- 172.21.15.87:0/148206802 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f87b40a1200 0x7f87b40a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.004+0000 7f87beffd640 1 -- 172.21.15.87:0/148206802 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f87c00cd460 con 0x7f87c819ac30 2024-09-13T17:22:01.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.005+0000 7f87cdac1640 1 --2- 172.21.15.87:0/148206802 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f87b40a1200 0x7f87b40a36c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f87c40057c0 tx=0x7f87c4005a40 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:01.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.007+0000 7f87beffd640 1 -- 172.21.15.87:0/148206802 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f87c00964a0 con 0x7f87c819ac30 2024-09-13T17:22:01.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.213+0000 7f87cfd25640 1 -- 172.21.15.87:0/148206802 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87c80ff290 con 0x7f87c819ac30 2024-09-13T17:22:01.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.214+0000 7f87beffd640 1 -- 172.21.15.87:0/148206802 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+10877 (secure 0 0 0) 0x7f87c001d020 con 0x7f87c819ac30 2024-09-13T17:22:01.215 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:22:01.215 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/3674545180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":3674545180},{"type":"v1","addr":"172.21.15.87:6841","nonce":3674545180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:11:23.313609+0000","modified":"2024-09-13T17:19:40.570296+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24484,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6839/3052680456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3052680456},{"type":"v1","addr":"172.21.15.118:6839","nonce":3052680456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:22:01.215 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 36 2024-09-13T17:22:01.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.216+0000 7f87cfd25640 1 -- 172.21.15.87:0/148206802 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f87b40a1200 msgr2=0x7f87b40a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:01.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.216+0000 7f87cfd25640 1 --2- 172.21.15.87:0/148206802 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f87b40a1200 0x7f87b40a36c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f87c40057c0 tx=0x7f87c4005a40 comp rx=0 tx=0).stop 2024-09-13T17:22:01.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.216+0000 7f87cfd25640 1 -- 172.21.15.87:0/148206802 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87c819ac30 msgr2=0x7f87c819b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:01.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.216+0000 7f87cfd25640 1 --2- 172.21.15.87:0/148206802 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87c819ac30 0x7f87c819b0e0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f87c000cad0 tx=0x7f87c000cf90 comp rx=0 tx=0).stop 2024-09-13T17:22:01.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.216+0000 7f87cfd25640 1 -- 172.21.15.87:0/148206802 shutdown_connections 2024-09-13T17:22:01.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.216+0000 7f87cfd25640 1 --2- 172.21.15.87:0/148206802 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f87b40a1200 0x7f87b40a36c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.216+0000 7f87cfd25640 1 --2- 172.21.15.87:0/148206802 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87c819ac30 0x7f87c819b0e0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.216+0000 7f87cfd25640 1 --2- 172.21.15.87:0/148206802 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87c8104000 0x7f87c8196840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.216+0000 7f87cfd25640 1 --2- 172.21.15.87:0/148206802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87c80feeb0 0x7f87c8196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.216+0000 7f87cfd25640 1 -- 172.21.15.87:0/148206802 >> 172.21.15.87:0/148206802 conn(0x7f87c80fa900 msgr2=0x7f87c80fbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:01.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.216+0000 7f87cfd25640 1 -- 172.21.15.87:0/148206802 shutdown_connections 2024-09-13T17:22:01.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.216+0000 7f87cfd25640 1 -- 172.21.15.87:0/148206802 wait complete. 2024-09-13T17:22:01.228 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-09-13T17:22:01.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.329+0000 7fa1645bc640 1 -- 172.21.15.87:0/2802685041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa15c0fee60 msgr2=0x7fa15c0ff240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:01.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.329+0000 7fa1645bc640 1 --2- 172.21.15.87:0/2802685041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa15c0fee60 0x7fa15c0ff240 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fa14c009cd0 tx=0x7fa14c02a8e0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.329+0000 7fa1645bc640 1 -- 172.21.15.87:0/2802685041 shutdown_connections 2024-09-13T17:22:01.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.329+0000 7fa1645bc640 1 --2- 172.21.15.87:0/2802685041 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa15c103fb0 0x7fa15c10bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.329+0000 7fa1645bc640 1 --2- 172.21.15.87:0/2802685041 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa15c0ff810 0x7fa15c103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.329+0000 7fa1645bc640 1 --2- 172.21.15.87:0/2802685041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa15c0fee60 0x7fa15c0ff240 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.329+0000 7fa1645bc640 1 -- 172.21.15.87:0/2802685041 >> 172.21.15.87:0/2802685041 conn(0x7fa15c075c60 msgr2=0x7fa15c0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:01.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.329+0000 7fa1645bc640 1 -- 172.21.15.87:0/2802685041 shutdown_connections 2024-09-13T17:22:01.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.329+0000 7fa1645bc640 1 -- 172.21.15.87:0/2802685041 wait complete. 2024-09-13T17:22:01.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.329+0000 7fa1645bc640 1 Processor -- start 2024-09-13T17:22:01.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.329+0000 7fa1645bc640 1 -- start start 2024-09-13T17:22:01.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.329+0000 7fa1645bc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa15c0fee60 0x7fa15c197110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.329+0000 7fa1645bc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa15c103fb0 0x7fa15c197650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.329+0000 7fa1645bc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa15c197b90 0x7fa15c1a2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.330+0000 7fa1645bc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15c1a2830 con 0x7fa15c103fb0 2024-09-13T17:22:01.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.330+0000 7fa1645bc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15c1a29a0 con 0x7fa15c0fee60 2024-09-13T17:22:01.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.330+0000 7fa1645bc640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15c1a2b60 con 0x7fa15c197b90 2024-09-13T17:22:01.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.330+0000 7fa161b57640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa15c103fb0 0x7fa15c197650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.330+0000 7fa161b57640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa15c103fb0 0x7fa15c197650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49538/0 (socket says 172.21.15.87:49538) 2024-09-13T17:22:01.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.330+0000 7fa161b57640 1 -- 172.21.15.87:0/224082128 learned_addr learned my addr 172.21.15.87:0/224082128 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:01.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.330+0000 7fa162b59640 1 --2- 172.21.15.87:0/224082128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa15c197b90 0x7fa15c1a2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.330+0000 7fa161b57640 1 -- 172.21.15.87:0/224082128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa15c197b90 msgr2=0x7fa15c1a2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:01.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.330+0000 7fa161b57640 1 --2- 172.21.15.87:0/224082128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa15c197b90 0x7fa15c1a2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.330+0000 7fa162358640 1 --2- 172.21.15.87:0/224082128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa15c0fee60 0x7fa15c197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.330+0000 7fa161b57640 1 -- 172.21.15.87:0/224082128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa15c0fee60 msgr2=0x7fa15c197110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:01.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.330+0000 7fa161b57640 1 --2- 172.21.15.87:0/224082128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa15c0fee60 0x7fa15c197110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.330+0000 7fa161b57640 1 -- 172.21.15.87:0/224082128 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa14c009900 con 0x7fa15c103fb0 2024-09-13T17:22:01.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.330+0000 7fa162b59640 1 --2- 172.21.15.87:0/224082128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa15c197b90 0x7fa15c1a2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:22:01.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.330+0000 7fa161b57640 1 --2- 172.21.15.87:0/224082128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa15c103fb0 0x7fa15c197650 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fa15000d770 tx=0x7fa15000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:01.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.330+0000 7fa15b7fe640 1 -- 172.21.15.87:0/224082128 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa150009c30 con 0x7fa15c103fb0 2024-09-13T17:22:01.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.330+0000 7fa1645bc640 1 -- 172.21.15.87:0/224082128 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa15c1a2e40 con 0x7fa15c103fb0 2024-09-13T17:22:01.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.330+0000 7fa15b7fe640 1 -- 172.21.15.87:0/224082128 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa15000de80 con 0x7fa15c103fb0 2024-09-13T17:22:01.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.330+0000 7fa15b7fe640 1 -- 172.21.15.87:0/224082128 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15000f600 con 0x7fa15c103fb0 2024-09-13T17:22:01.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.330+0000 7fa1645bc640 1 -- 172.21.15.87:0/224082128 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa15c1a32c0 con 0x7fa15c103fb0 2024-09-13T17:22:01.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.332+0000 7fa15b7fe640 1 -- 172.21.15.87:0/224082128 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fa150010460 con 0x7fa15c103fb0 2024-09-13T17:22:01.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.333+0000 7fa1673bb740 1 Processor -- start 2024-09-13T17:22:01.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.333+0000 7fa1673bb740 1 -- start start 2024-09-13T17:22:01.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.333+0000 7fa1673bb740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fbdb55a690 0x55fbdb55aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.333+0000 7fa1673bb740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fbdb55afb0 0x55fbdb569820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.333+0000 7fa1673bb740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fbdb569d60 0x55fbdb56c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.333+0000 7fa1673bb740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbdb4c4cc0 con 0x55fbdb55afb0 2024-09-13T17:22:01.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.333+0000 7fa1673bb740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbdb4c2450 con 0x55fbdb55a690 2024-09-13T17:22:01.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.333+0000 7fa1673bb740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbdb4bdd40 con 0x55fbdb569d60 2024-09-13T17:22:01.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.333+0000 7fa162358640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fbdb55afb0 0x55fbdb569820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.333+0000 7fa162358640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fbdb55afb0 0x55fbdb569820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49550/0 (socket says 172.21.15.87:49550) 2024-09-13T17:22:01.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.333+0000 7fa162358640 1 -- 172.21.15.87:0/255812669 learned_addr learned my addr 172.21.15.87:0/255812669 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:01.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.333+0000 7fa15b7fe640 1 --2- 172.21.15.87:0/224082128 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa1440a1200 0x7fa1440a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.333+0000 7fa161b57640 1 --2- 172.21.15.87:0/255812669 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fbdb569d60 0x55fbdb56c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.333+0000 7fa162b59640 1 --2- 172.21.15.87:0/255812669 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fbdb55a690 0x55fbdb55aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.333+0000 7fa162b59640 1 --2- 172.21.15.87:0/224082128 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa1440a1200 0x7fa1440a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.333+0000 7fa162358640 1 -- 172.21.15.87:0/255812669 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fbdb569d60 msgr2=0x55fbdb56c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:01.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.333+0000 7fa162358640 1 --2- 172.21.15.87:0/255812669 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fbdb569d60 0x55fbdb56c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.333+0000 7fa162358640 1 -- 172.21.15.87:0/255812669 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fbdb55a690 msgr2=0x55fbdb55aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:01.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.333+0000 7fa162358640 1 --2- 172.21.15.87:0/255812669 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fbdb55a690 0x55fbdb55aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.334+0000 7fa162358640 1 -- 172.21.15.87:0/255812669 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbdb485620 con 0x55fbdb55afb0 2024-09-13T17:22:01.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.334+0000 7fa162b59640 1 --2- 172.21.15.87:0/255812669 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fbdb55a690 0x55fbdb55aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:22:01.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.334+0000 7fa15b7fe640 1 -- 172.21.15.87:0/224082128 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fa1500ccf80 con 0x7fa15c103fb0 2024-09-13T17:22:01.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.334+0000 7fa162358640 1 --2- 172.21.15.87:0/255812669 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fbdb55afb0 0x55fbdb569820 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fa14c009880 tx=0x7fa14c031430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92704a98caa43cfb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:01.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.334+0000 7fa162b59640 1 --2- 172.21.15.87:0/224082128 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa1440a1200 0x7fa1440a36c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa1540058c0 tx=0x7fa154005850 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:01.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.334+0000 7fa158ff9640 1 -- 172.21.15.87:0/255812669 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c030bc0 con 0x55fbdb55afb0 2024-09-13T17:22:01.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.334+0000 7fa158ff9640 1 -- 172.21.15.87:0/255812669 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa14c030d20 con 0x55fbdb55afb0 2024-09-13T17:22:01.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.334+0000 7fa158ff9640 1 -- 172.21.15.87:0/255812669 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c003c60 con 0x55fbdb55afb0 2024-09-13T17:22:01.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.335+0000 7fa1673bb740 1 -- 172.21.15.87:0/255812669 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fbdb55afb0 msgr2=0x55fbdb569820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:01.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.335+0000 7fa1673bb740 1 --2- 172.21.15.87:0/255812669 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fbdb55afb0 0x55fbdb569820 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fa14c009880 tx=0x7fa14c031430 comp rx=0 tx=0).stop 2024-09-13T17:22:01.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.335+0000 7fa1673bb740 1 -- 172.21.15.87:0/255812669 shutdown_connections 2024-09-13T17:22:01.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.335+0000 7fa1673bb740 1 --2- 172.21.15.87:0/255812669 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fbdb569d60 0x55fbdb56c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.335+0000 7fa1673bb740 1 --2- 172.21.15.87:0/255812669 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fbdb55afb0 0x55fbdb569820 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.335+0000 7fa1673bb740 1 --2- 172.21.15.87:0/255812669 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fbdb55a690 0x55fbdb55aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.335+0000 7fa1673bb740 1 -- 172.21.15.87:0/255812669 >> 172.21.15.87:0/255812669 conn(0x55fbdb556d00 msgr2=0x55fbdb5570e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:01.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.335+0000 7fa1673bb740 1 -- 172.21.15.87:0/255812669 shutdown_connections 2024-09-13T17:22:01.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.335+0000 7fa1673bb740 1 -- 172.21.15.87:0/255812669 wait complete. 2024-09-13T17:22:01.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.335+0000 7fa1673bb740 1 -- start start 2024-09-13T17:22:01.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.335+0000 7fa1673bb740 1 Processor -- start 2024-09-13T17:22:01.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.335+0000 7fa1673bb740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fbdb55a690 0x55fbdb5692d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.335+0000 7fa1673bb740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fbdb55afb0 0x55fbdb569810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.335+0000 7fa1673bb740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fbdb569d60 0x55fbdb566840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.335+0000 7fa1673bb740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbdb47c180 con 0x55fbdb569d60 2024-09-13T17:22:01.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.335+0000 7fa1673bb740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbdb196430 con 0x55fbdb55afb0 2024-09-13T17:22:01.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.335+0000 7fa1673bb740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbdb4415e0 con 0x55fbdb55a690 2024-09-13T17:22:01.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.336+0000 7fa1673bb740 10 client.0 _ll_register_callbacks cb 0x55fbdb4adaa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:22:01.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.336+0000 7fa162b59640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fbdb569d60 0x55fbdb566840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.336+0000 7fa162b59640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fbdb569d60 0x55fbdb566840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49562/0 (socket says 172.21.15.87:49562) 2024-09-13T17:22:01.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.336+0000 7fa162b59640 1 -- 172.21.15.87:0/1916906594 learned_addr learned my addr 172.21.15.87:0/1916906594 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:01.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.336+0000 7fa162358640 1 --2- 172.21.15.87:0/1916906594 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fbdb55a690 0x55fbdb5692d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.336+0000 7fa161b57640 1 --2- 172.21.15.87:0/1916906594 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fbdb55afb0 0x55fbdb569810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.336+0000 7fa162b59640 1 -- 172.21.15.87:0/1916906594 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fbdb55a690 msgr2=0x55fbdb5692d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:01.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.336+0000 7fa162b59640 1 --2- 172.21.15.87:0/1916906594 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fbdb55a690 0x55fbdb5692d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.336+0000 7fa162b59640 1 -- 172.21.15.87:0/1916906594 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fbdb55afb0 msgr2=0x55fbdb569810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:01.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.336+0000 7fa162b59640 1 --2- 172.21.15.87:0/1916906594 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fbdb55afb0 0x55fbdb569810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.336+0000 7fa162b59640 1 -- 172.21.15.87:0/1916906594 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa15c10c340 con 0x55fbdb569d60 2024-09-13T17:22:01.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.336+0000 7fa161b57640 1 --2- 172.21.15.87:0/1916906594 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fbdb55afb0 0x55fbdb569810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:22:01.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.336+0000 7fa162b59640 1 --2- 172.21.15.87:0/1916906594 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fbdb569d60 0x55fbdb566840 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fa15400e670 tx=0x7fa154004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac8ff2138a7eb255 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:01.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.336+0000 7fa141ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:22:01.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.336+0000 7fa141ffb640 1 -- 172.21.15.87:0/1916906594 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15400bc30 con 0x55fbdb569d60 2024-09-13T17:22:01.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.336+0000 7fa1673bb740 1 -- 172.21.15.87:0/1916906594 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fbdb4e7b80 con 0x55fbdb569d60 2024-09-13T17:22:01.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.336+0000 7fa141ffb640 1 -- 172.21.15.87:0/1916906594 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fa154017070 con 0x55fbdb569d60 2024-09-13T17:22:01.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.336+0000 7fa141ffb640 1 -- 172.21.15.87:0/1916906594 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa15400bd90 con 0x55fbdb569d60 2024-09-13T17:22:01.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.336+0000 7fa1673bb740 10 client.17727 fetch_fsmap learned FSMap version 36 2024-09-13T17:22:01.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.336+0000 7fa1673bb740 1 -- 172.21.15.87:0/1916906594 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55fbdb4bc3c0 con 0x55fbdb569d60 2024-09-13T17:22:01.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.336+0000 7fa141ffb640 1 -- 172.21.15.87:0/1916906594 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55fbdb4e7b80 con 0x55fbdb569d60 2024-09-13T17:22:01.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.337+0000 7fa141ffb640 1 -- 172.21.15.87:0/1916906594 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fa1540263f0 con 0x55fbdb569d60 2024-09-13T17:22:01.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.337+0000 7fa1673bb740 10 client.17727 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:22:01.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.337+0000 7fa1673bb740 10 client.17727 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:22:01.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.337+0000 7fa1673bb740 20 client.17727 populate_metadata read hostname 'smithi087' 2024-09-13T17:22:01.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.337+0000 7fa1673bb740 1 --2- 172.21.15.87:0/1916906594 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55fbdb579640 0x55fbdb57ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.337+0000 7fa1673bb740 4 client.17727 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:22:01.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.337+0000 7fa1673bb740 1 -- 172.21.15.87:0/1916906594 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fbdb4b01f0 con 0x55fbdb579640 2024-09-13T17:22:01.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.337+0000 7fa162358640 1 --2- 172.21.15.87:0/1916906594 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55fbdb579640 0x55fbdb57ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.337+0000 7fa141ffb640 10 client.17727 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:22:01.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.337+0000 7fa162358640 1 --2- 172.21.15.87:0/1916906594 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55fbdb579640 0x55fbdb57ba60 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4fef725ea2be81d server_cookie=46bd7d6a69f50f72 in_seq=0 out_seq=0 2024-09-13T17:22:01.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.338+0000 7fa141ffb640 1 -- 172.21.15.87:0/1916906594 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55fbdb4b01f0 con 0x55fbdb579640 2024-09-13T17:22:01.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.338+0000 7fa141ffb640 10 client.17727 handle_command_reply: tid=0 2024-09-13T17:22:01.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.338+0000 7fa1673bb740 1 client.17727 shutdown 2024-09-13T17:22:01.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.338+0000 7fa1673bb740 1 -- 172.21.15.87:0/1916906594 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fbdb569d60 msgr2=0x55fbdb566840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:01.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.338+0000 7fa1673bb740 1 --2- 172.21.15.87:0/1916906594 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fbdb569d60 0x55fbdb566840 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fa15400e670 tx=0x7fa154004730 comp rx=0 tx=0).stop 2024-09-13T17:22:01.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.338+0000 7fa1673bb740 1 -- 172.21.15.87:0/1916906594 shutdown_connections 2024-09-13T17:22:01.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.338+0000 7fa1673bb740 1 --2- 172.21.15.87:0/1916906594 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55fbdb579640 0x55fbdb57ba60 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.338+0000 7fa1673bb740 1 --2- 172.21.15.87:0/1916906594 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fbdb569d60 0x55fbdb566840 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.338+0000 7fa1673bb740 1 --2- 172.21.15.87:0/1916906594 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fbdb55afb0 0x55fbdb569810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.338+0000 7fa141ffb640 0 client.17727 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:22:01.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.338+0000 7fa1673bb740 1 --2- 172.21.15.87:0/1916906594 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fbdb55a690 0x55fbdb5692d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.338+0000 7fa1673bb740 1 -- 172.21.15.87:0/1916906594 >> 172.21.15.87:0/1916906594 conn(0x55fbdb556d00 msgr2=0x55fbdb55ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:01.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.338+0000 7fa1673bb740 1 -- 172.21.15.87:0/1916906594 shutdown_connections 2024-09-13T17:22:01.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.338+0000 7fa1673bb740 1 -- 172.21.15.87:0/1916906594 wait complete. 2024-09-13T17:22:01.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.339+0000 7fa1673bb740 20 client.17727 trim_cache size 0 max 16384 2024-09-13T17:22:01.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.349+0000 7fa1673bb740 1 Processor -- start 2024-09-13T17:22:01.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.349+0000 7fa1673bb740 1 -- start start 2024-09-13T17:22:01.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.349+0000 7fa1673bb740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fbdb55a690 0x55fbdb5803c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.349+0000 7fa1673bb740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fbdb55afb0 0x55fbdb570a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.349+0000 7fa1673bb740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fbdb569d60 0x55fbdb570fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.349+0000 7fa1673bb740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbdb4e7b80 con 0x55fbdb55afb0 2024-09-13T17:22:01.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.349+0000 7fa1673bb740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbdb566c10 con 0x55fbdb569d60 2024-09-13T17:22:01.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.349+0000 7fa1673bb740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbdb579470 con 0x55fbdb55a690 2024-09-13T17:22:01.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.350+0000 7fa161b57640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fbdb55afb0 0x55fbdb570a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.350+0000 7fa161b57640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fbdb55afb0 0x55fbdb570a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49576/0 (socket says 172.21.15.87:49576) 2024-09-13T17:22:01.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.350+0000 7fa161b57640 1 -- 172.21.15.87:0/3767297409 learned_addr learned my addr 172.21.15.87:0/3767297409 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:01.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.350+0000 7fa162358640 1 --2- 172.21.15.87:0/3767297409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fbdb55a690 0x55fbdb5803c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.350+0000 7fa162b59640 1 --2- 172.21.15.87:0/3767297409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fbdb569d60 0x55fbdb570fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.350+0000 7fa161b57640 1 -- 172.21.15.87:0/3767297409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fbdb55a690 msgr2=0x55fbdb5803c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:01.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.350+0000 7fa161b57640 1 --2- 172.21.15.87:0/3767297409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fbdb55a690 0x55fbdb5803c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.350+0000 7fa161b57640 1 -- 172.21.15.87:0/3767297409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fbdb569d60 msgr2=0x55fbdb570fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:01.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.350+0000 7fa161b57640 1 --2- 172.21.15.87:0/3767297409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fbdb569d60 0x55fbdb570fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.350+0000 7fa161b57640 1 -- 172.21.15.87:0/3767297409 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbdb45e770 con 0x55fbdb55afb0 2024-09-13T17:22:01.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.350+0000 7fa162b59640 1 --2- 172.21.15.87:0/3767297409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fbdb569d60 0x55fbdb570fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:22:01.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.350+0000 7fa162358640 1 --2- 172.21.15.87:0/3767297409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fbdb55a690 0x55fbdb5803c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:22:01.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.350+0000 7fa161b57640 1 --2- 172.21.15.87:0/3767297409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fbdb55afb0 0x55fbdb570a60 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fa150099c10 tx=0x7fa1500cf450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6368447d1768108 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:01.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.350+0000 7fa1597fa640 1 -- 172.21.15.87:0/3767297409 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15009dab0 con 0x55fbdb55afb0 2024-09-13T17:22:01.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.350+0000 7fa1597fa640 1 -- 172.21.15.87:0/3767297409 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa1500a2100 con 0x55fbdb55afb0 2024-09-13T17:22:01.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.350+0000 7fa1597fa640 1 -- 172.21.15.87:0/3767297409 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1500cf070 con 0x55fbdb55afb0 2024-09-13T17:22:01.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.350+0000 7fa1673bb740 1 -- 172.21.15.87:0/3767297409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fbdb55afb0 msgr2=0x55fbdb570a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:01.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.351+0000 7fa1673bb740 1 --2- 172.21.15.87:0/3767297409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fbdb55afb0 0x55fbdb570a60 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fa150099c10 tx=0x7fa1500cf450 comp rx=0 tx=0).stop 2024-09-13T17:22:01.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.351+0000 7fa1673bb740 1 -- 172.21.15.87:0/3767297409 shutdown_connections 2024-09-13T17:22:01.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.351+0000 7fa1673bb740 1 --2- 172.21.15.87:0/3767297409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fbdb569d60 0x55fbdb570fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.351+0000 7fa1673bb740 1 --2- 172.21.15.87:0/3767297409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fbdb55afb0 0x55fbdb570a60 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.351+0000 7fa1673bb740 1 --2- 172.21.15.87:0/3767297409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fbdb55a690 0x55fbdb5803c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.351+0000 7fa1673bb740 1 -- 172.21.15.87:0/3767297409 >> 172.21.15.87:0/3767297409 conn(0x55fbdb556d00 msgr2=0x55fbdb575510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:01.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.351+0000 7fa1673bb740 1 -- 172.21.15.87:0/3767297409 shutdown_connections 2024-09-13T17:22:01.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.351+0000 7fa1673bb740 1 -- 172.21.15.87:0/3767297409 wait complete. 2024-09-13T17:22:01.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.351+0000 7fa1673bb740 1 -- start start 2024-09-13T17:22:01.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.351+0000 7fa1673bb740 1 Processor -- start 2024-09-13T17:22:01.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.351+0000 7fa1673bb740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fbdb55a690 0x55fbdb56ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.351+0000 7fa1673bb740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fbdb55afb0 0x55fbdb56f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.351+0000 7fa1673bb740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fbdb569d60 0x55fbdb5c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.351+0000 7fa1673bb740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbdb5c90c0 con 0x55fbdb55afb0 2024-09-13T17:22:01.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.351+0000 7fa1673bb740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbdb5c9230 con 0x55fbdb569d60 2024-09-13T17:22:01.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.351+0000 7fa1673bb740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbdb5c93a0 con 0x55fbdb55a690 2024-09-13T17:22:01.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.351+0000 7fa1673bb740 10 client.0 _ll_register_callbacks cb 0x7fa14c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:22:01.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.351+0000 7fa161b57640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fbdb55afb0 0x55fbdb56f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.351+0000 7fa161b57640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fbdb55afb0 0x55fbdb56f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49582/0 (socket says 172.21.15.87:49582) 2024-09-13T17:22:01.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.351+0000 7fa161b57640 1 -- 172.21.15.87:0/2668724347 learned_addr learned my addr 172.21.15.87:0/2668724347 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:01.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.351+0000 7fa162358640 1 --2- 172.21.15.87:0/2668724347 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fbdb55a690 0x55fbdb56ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.351+0000 7fa161b57640 1 -- 172.21.15.87:0/2668724347 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fbdb55a690 msgr2=0x55fbdb56ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:01.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.351+0000 7fa161b57640 1 --2- 172.21.15.87:0/2668724347 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fbdb55a690 0x55fbdb56ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.352+0000 7fa161b57640 1 -- 172.21.15.87:0/2668724347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fbdb569d60 msgr2=0x55fbdb5c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:01.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.352+0000 7fa162b59640 1 --2- 172.21.15.87:0/2668724347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fbdb569d60 0x55fbdb5c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.352+0000 7fa161b57640 1 --2- 172.21.15.87:0/2668724347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fbdb569d60 0x55fbdb5c8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.352+0000 7fa161b57640 1 -- 172.21.15.87:0/2668724347 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa15c1a32c0 con 0x55fbdb55afb0 2024-09-13T17:22:01.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.352+0000 7fa161b57640 1 --2- 172.21.15.87:0/2668724347 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fbdb55afb0 0x55fbdb56f2c0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fa150009610 tx=0x7fa1500ca540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd0ae884ba271b24 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:01.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.352+0000 7fa141ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:22:01.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.352+0000 7fa141ffb640 1 -- 172.21.15.87:0/2668724347 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1500cf0e0 con 0x55fbdb55afb0 2024-09-13T17:22:01.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.352+0000 7fa141ffb640 1 -- 172.21.15.87:0/2668724347 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fa1500cf240 con 0x55fbdb55afb0 2024-09-13T17:22:01.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.352+0000 7fa1673bb740 1 -- 172.21.15.87:0/2668724347 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa14c030d20 con 0x55fbdb55afb0 2024-09-13T17:22:01.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.352+0000 7fa141ffb640 1 -- 172.21.15.87:0/2668724347 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa150096390 con 0x55fbdb55afb0 2024-09-13T17:22:01.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.352+0000 7fa1673bb740 10 client.17733 fetch_fsmap learned FSMap version 36 2024-09-13T17:22:01.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.352+0000 7fa1673bb740 1 -- 172.21.15.87:0/2668724347 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55fbdb483e80 con 0x55fbdb55afb0 2024-09-13T17:22:01.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.352+0000 7fa141ffb640 1 -- 172.21.15.87:0/2668724347 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa14c030d20 con 0x55fbdb55afb0 2024-09-13T17:22:01.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.352+0000 7fa141ffb640 1 -- 172.21.15.87:0/2668724347 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fa150095a70 con 0x55fbdb55afb0 2024-09-13T17:22:01.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.352+0000 7fa1673bb740 10 client.17733 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:22:01.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.352+0000 7fa1673bb740 10 client.17733 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:22:01.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.352+0000 7fa1673bb740 20 client.17733 populate_metadata read hostname 'smithi087' 2024-09-13T17:22:01.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.352+0000 7fa1673bb740 1 --2- 172.21.15.87:0/2668724347 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55fbdb5d0720 0x55fbdb5d2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.352+0000 7fa1673bb740 4 client.17733 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:22:01.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.352+0000 7fa1673bb740 1 -- 172.21.15.87:0/2668724347 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55fbdb1b14e0 con 0x55fbdb5d0720 2024-09-13T17:22:01.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.353+0000 7fa162358640 1 --2- 172.21.15.87:0/2668724347 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55fbdb5d0720 0x55fbdb5d2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.353+0000 7fa141ffb640 10 client.17733 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:22:01.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.353+0000 7fa162358640 1 --2- 172.21.15.87:0/2668724347 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55fbdb5d0720 0x55fbdb5d2b10 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=880bcc475cf3b89d server_cookie=d4e757736ca2ccc3 in_seq=0 out_seq=0 2024-09-13T17:22:01.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.353+0000 7fa141ffb640 1 -- 172.21.15.87:0/2668724347 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55fbdb1b14e0 con 0x55fbdb5d0720 2024-09-13T17:22:01.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.353+0000 7fa141ffb640 10 client.17733 handle_command_reply: tid=0 2024-09-13T17:22:01.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.353+0000 7fa1673bb740 1 client.17733 shutdown 2024-09-13T17:22:01.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.353+0000 7fa1673bb740 1 -- 172.21.15.87:0/2668724347 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fbdb55afb0 msgr2=0x55fbdb56f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:01.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.353+0000 7fa1673bb740 1 --2- 172.21.15.87:0/2668724347 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fbdb55afb0 0x55fbdb56f2c0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fa150009610 tx=0x7fa1500ca540 comp rx=0 tx=0).stop 2024-09-13T17:22:01.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.353+0000 7fa1673bb740 1 -- 172.21.15.87:0/2668724347 shutdown_connections 2024-09-13T17:22:01.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.353+0000 7fa1673bb740 1 --2- 172.21.15.87:0/2668724347 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55fbdb5d0720 0x55fbdb5d2b10 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.353+0000 7fa1673bb740 1 --2- 172.21.15.87:0/2668724347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fbdb569d60 0x55fbdb5c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.353+0000 7fa141ffb640 0 client.17733 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:22:01.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.353+0000 7fa1673bb740 1 --2- 172.21.15.87:0/2668724347 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fbdb55afb0 0x55fbdb56f2c0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.353+0000 7fa1673bb740 1 --2- 172.21.15.87:0/2668724347 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fbdb55a690 0x55fbdb56ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.353+0000 7fa1673bb740 1 -- 172.21.15.87:0/2668724347 >> 172.21.15.87:0/2668724347 conn(0x55fbdb556d00 msgr2=0x55fbdb575510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:01.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.353+0000 7fa1673bb740 1 -- 172.21.15.87:0/2668724347 shutdown_connections 2024-09-13T17:22:01.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.353+0000 7fa1673bb740 1 -- 172.21.15.87:0/2668724347 wait complete. 2024-09-13T17:22:01.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.353+0000 7fa1673bb740 20 client.17733 trim_cache size 0 max 16384 2024-09-13T17:22:01.363 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:22:01.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.354+0000 7fa1645bc640 1 -- 172.21.15.87:0/224082128 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa1440a1200 msgr2=0x7fa1440a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:01.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.354+0000 7fa1645bc640 1 --2- 172.21.15.87:0/224082128 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa1440a1200 0x7fa1440a36c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa1540058c0 tx=0x7fa154005850 comp rx=0 tx=0).stop 2024-09-13T17:22:01.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.354+0000 7fa1645bc640 1 -- 172.21.15.87:0/224082128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa15c103fb0 msgr2=0x7fa15c197650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:01.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.354+0000 7fa1645bc640 1 --2- 172.21.15.87:0/224082128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa15c103fb0 0x7fa15c197650 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fa15000d770 tx=0x7fa15000dc30 comp rx=0 tx=0).stop 2024-09-13T17:22:01.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.354+0000 7fa1645bc640 1 -- 172.21.15.87:0/224082128 shutdown_connections 2024-09-13T17:22:01.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.354+0000 7fa1645bc640 1 --2- 172.21.15.87:0/224082128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa15c197b90 0x7fa15c1a2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.354+0000 7fa1645bc640 1 --2- 172.21.15.87:0/224082128 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa1440a1200 0x7fa1440a36c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.354+0000 7fa1645bc640 1 --2- 172.21.15.87:0/224082128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa15c103fb0 0x7fa15c197650 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.354+0000 7fa1645bc640 1 --2- 172.21.15.87:0/224082128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa15c0fee60 0x7fa15c197110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.354+0000 7fa1645bc640 1 -- 172.21.15.87:0/224082128 >> 172.21.15.87:0/224082128 conn(0x7fa15c075c60 msgr2=0x7fa15c102380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:01.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.354+0000 7fa1645bc640 1 -- 172.21.15.87:0/224082128 shutdown_connections 2024-09-13T17:22:01.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.354+0000 7fa1645bc640 1 -- 172.21.15.87:0/224082128 wait complete. 2024-09-13T17:22:01.366 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-09-13T17:22:01.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.464+0000 7f31d499c640 1 -- 172.21.15.87:0/2702675336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31d00ff800 msgr2=0x7f31d0103840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:01.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.464+0000 7f31d499c640 1 --2- 172.21.15.87:0/2702675336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31d00ff800 0x7f31d0103840 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f31b8009930 tx=0x7f31b802a420 comp rx=0 tx=0).stop 2024-09-13T17:22:01.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.465+0000 7f31d499c640 1 -- 172.21.15.87:0/2702675336 shutdown_connections 2024-09-13T17:22:01.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.465+0000 7f31d499c640 1 --2- 172.21.15.87:0/2702675336 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31d0103fa0 0x7f31d010baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.465+0000 7f31d499c640 1 --2- 172.21.15.87:0/2702675336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31d00ff800 0x7f31d0103840 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.465+0000 7f31d499c640 1 --2- 172.21.15.87:0/2702675336 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31d00fee50 0x7f31d00ff230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.465+0000 7f31d499c640 1 -- 172.21.15.87:0/2702675336 >> 172.21.15.87:0/2702675336 conn(0x7f31d00fa8e0 msgr2=0x7f31d00fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:01.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.465+0000 7f31d499c640 1 -- 172.21.15.87:0/2702675336 shutdown_connections 2024-09-13T17:22:01.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.465+0000 7f31d499c640 1 -- 172.21.15.87:0/2702675336 wait complete. 2024-09-13T17:22:01.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.465+0000 7f31d499c640 1 Processor -- start 2024-09-13T17:22:01.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.465+0000 7f31d499c640 1 -- start start 2024-09-13T17:22:01.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.466+0000 7f31d499c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31d00fee50 0x7f31d0197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.466+0000 7f31d499c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31d0103fa0 0x7f31d0197640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.466+0000 7f31d499c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31d0197b80 0x7f31d01a2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.466+0000 7f31d499c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d01a2820 con 0x7f31d00fee50 2024-09-13T17:22:01.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.466+0000 7f31d499c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d01a2990 con 0x7f31d0197b80 2024-09-13T17:22:01.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.466+0000 7f31d499c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d01a2b50 con 0x7f31d0103fa0 2024-09-13T17:22:01.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.466+0000 7f31ce59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31d00fee50 0x7f31d0197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.466+0000 7f31ce59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31d00fee50 0x7f31d0197100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49614/0 (socket says 172.21.15.87:49614) 2024-09-13T17:22:01.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.466+0000 7f31ce59c640 1 -- 172.21.15.87:0/1121601963 learned_addr learned my addr 172.21.15.87:0/1121601963 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:01.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.466+0000 7f31ced9d640 1 --2- 172.21.15.87:0/1121601963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31d0197b80 0x7f31d01a2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.466+0000 7f31c5d9b640 1 --2- 172.21.15.87:0/1121601963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31d0103fa0 0x7f31d0197640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.466+0000 7f31ce59c640 1 -- 172.21.15.87:0/1121601963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31d0103fa0 msgr2=0x7f31d0197640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:01.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.466+0000 7f31ce59c640 1 --2- 172.21.15.87:0/1121601963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31d0103fa0 0x7f31d0197640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.466+0000 7f31ce59c640 1 -- 172.21.15.87:0/1121601963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31d0197b80 msgr2=0x7f31d01a2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:01.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.466+0000 7f31ce59c640 1 --2- 172.21.15.87:0/1121601963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31d0197b80 0x7f31d01a2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.466+0000 7f31ce59c640 1 -- 172.21.15.87:0/1121601963 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b8009560 con 0x7f31d00fee50 2024-09-13T17:22:01.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.466+0000 7f31ce59c640 1 --2- 172.21.15.87:0/1121601963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31d00fee50 0x7f31d0197100 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f31c000c970 tx=0x7f31c000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:01.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.466+0000 7f31c7fff640 1 -- 172.21.15.87:0/1121601963 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c0007bb0 con 0x7f31d00fee50 2024-09-13T17:22:01.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.466+0000 7f31c7fff640 1 -- 172.21.15.87:0/1121601963 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f31c0007d10 con 0x7f31d00fee50 2024-09-13T17:22:01.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.466+0000 7f31d499c640 1 -- 172.21.15.87:0/1121601963 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d01a2e30 con 0x7f31d00fee50 2024-09-13T17:22:01.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.466+0000 7f31c7fff640 1 -- 172.21.15.87:0/1121601963 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c0004e80 con 0x7f31d00fee50 2024-09-13T17:22:01.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.467+0000 7f31d499c640 1 -- 172.21.15.87:0/1121601963 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d01a3260 con 0x7f31d00fee50 2024-09-13T17:22:01.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.469+0000 7f31c7fff640 1 -- 172.21.15.87:0/1121601963 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f31c0005020 con 0x7f31d00fee50 2024-09-13T17:22:01.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.469+0000 7f31d76c3740 1 Processor -- start 2024-09-13T17:22:01.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.470+0000 7f31d76c3740 1 -- start start 2024-09-13T17:22:01.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.470+0000 7f31d76c3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bc590b790 0x555bc590bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.470+0000 7f31d76c3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bc590c0b0 0x555bc5916410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.470+0000 7f31d76c3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bc5916950 0x555bc5918d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.470+0000 7f31d76c3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bc5875cc0 con 0x555bc590c0b0 2024-09-13T17:22:01.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.470+0000 7f31d76c3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bc5873450 con 0x555bc590b790 2024-09-13T17:22:01.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.470+0000 7f31d76c3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bc586ed40 con 0x555bc5916950 2024-09-13T17:22:01.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.470+0000 7f31ce59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bc590c0b0 0x555bc5916410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.470+0000 7f31ce59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bc590c0b0 0x555bc5916410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49628/0 (socket says 172.21.15.87:49628) 2024-09-13T17:22:01.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.470+0000 7f31ce59c640 1 -- 172.21.15.87:0/1185617450 learned_addr learned my addr 172.21.15.87:0/1185617450 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:01.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.470+0000 7f31ced9d640 1 --2- 172.21.15.87:0/1185617450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bc590b790 0x555bc590bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.470+0000 7f31c7fff640 1 --2- 172.21.15.87:0/1121601963 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f31bc0a1200 0x7f31bc0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.470+0000 7f31c5d9b640 1 --2- 172.21.15.87:0/1185617450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bc5916950 0x555bc5918d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.470+0000 7f31ced9d640 1 --2- 172.21.15.87:0/1121601963 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f31bc0a1200 0x7f31bc0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.470+0000 7f31ced9d640 1 -- 172.21.15.87:0/1185617450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bc5916950 msgr2=0x555bc5918d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:01.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.470+0000 7f31c7fff640 1 -- 172.21.15.87:0/1121601963 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f31c00cce40 con 0x7f31d00fee50 2024-09-13T17:22:01.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.470+0000 7f31ced9d640 1 --2- 172.21.15.87:0/1185617450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bc5916950 0x555bc5918d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.470+0000 7f31ced9d640 1 -- 172.21.15.87:0/1185617450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bc590c0b0 msgr2=0x555bc5916410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:01.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.470+0000 7f31ced9d640 1 --2- 172.21.15.87:0/1185617450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bc590c0b0 0x555bc5916410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.470+0000 7f31ced9d640 1 -- 172.21.15.87:0/1185617450 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555bc5836620 con 0x555bc590b790 2024-09-13T17:22:01.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.470+0000 7f31ce59c640 1 --2- 172.21.15.87:0/1185617450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bc590c0b0 0x555bc5916410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:22:01.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.471+0000 7f31ced9d640 1 --2- 172.21.15.87:0/1185617450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bc590b790 0x555bc590bb70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f31c80149a0 tx=0x7f31c8014e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8da16ab40a4550da server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:01.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.471+0000 7f31ced9d640 1 --2- 172.21.15.87:0/1121601963 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f31bc0a1200 0x7f31bc0a36c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f31c801c000 tx=0x7f31c801e000 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:01.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.471+0000 7f31c4d99640 1 -- 172.21.15.87:0/1185617450 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c8012e90 con 0x555bc590b790 2024-09-13T17:22:01.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.471+0000 7f31c4d99640 1 -- 172.21.15.87:0/1185617450 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f31c801a070 con 0x555bc590b790 2024-09-13T17:22:01.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.471+0000 7f31c4d99640 1 -- 172.21.15.87:0/1185617450 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c80138b0 con 0x555bc590b790 2024-09-13T17:22:01.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.472+0000 7f31d76c3740 1 -- 172.21.15.87:0/1185617450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bc590b790 msgr2=0x555bc590bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:01.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.472+0000 7f31d76c3740 1 --2- 172.21.15.87:0/1185617450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bc590b790 0x555bc590bb70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f31c80149a0 tx=0x7f31c8014e60 comp rx=0 tx=0).stop 2024-09-13T17:22:01.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.472+0000 7f31d76c3740 1 -- 172.21.15.87:0/1185617450 shutdown_connections 2024-09-13T17:22:01.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.472+0000 7f31d76c3740 1 --2- 172.21.15.87:0/1185617450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bc5916950 0x555bc5918d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.472+0000 7f31d76c3740 1 --2- 172.21.15.87:0/1185617450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bc590c0b0 0x555bc5916410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.472+0000 7f31d76c3740 1 --2- 172.21.15.87:0/1185617450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bc590b790 0x555bc590bb70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.472+0000 7f31d76c3740 1 -- 172.21.15.87:0/1185617450 >> 172.21.15.87:0/1185617450 conn(0x555bc5907d00 msgr2=0x555bc59080e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:01.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.472+0000 7f31d76c3740 1 -- 172.21.15.87:0/1185617450 shutdown_connections 2024-09-13T17:22:01.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.472+0000 7f31d76c3740 1 -- 172.21.15.87:0/1185617450 wait complete. 2024-09-13T17:22:01.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.472+0000 7f31d76c3740 1 -- start start 2024-09-13T17:22:01.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.472+0000 7f31d76c3740 1 Processor -- start 2024-09-13T17:22:01.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.472+0000 7f31d76c3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bc590b790 0x555bc5915f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.472+0000 7f31d76c3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bc590c0b0 0x555bc5913230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.472+0000 7f31d76c3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bc5916950 0x555bc5913770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.472+0000 7f31d76c3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bc582d180 con 0x555bc590c0b0 2024-09-13T17:22:01.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.472+0000 7f31d76c3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bc5547430 con 0x555bc590b790 2024-09-13T17:22:01.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.472+0000 7f31d76c3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bc57f25e0 con 0x555bc5916950 2024-09-13T17:22:01.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.472+0000 7f31d76c3740 10 client.0 _ll_register_callbacks cb 0x555bc585eaa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:22:01.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.472+0000 7f31c5d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bc590c0b0 0x555bc5913230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.472+0000 7f31c5d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bc590c0b0 0x555bc5913230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49638/0 (socket says 172.21.15.87:49638) 2024-09-13T17:22:01.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.472+0000 7f31c5d9b640 1 -- 172.21.15.87:0/3500784891 learned_addr learned my addr 172.21.15.87:0/3500784891 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:01.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.473+0000 7f31ce59c640 1 --2- 172.21.15.87:0/3500784891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bc590b790 0x555bc5915f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.473+0000 7f31ced9d640 1 --2- 172.21.15.87:0/3500784891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bc5916950 0x555bc5913770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.473+0000 7f31c5d9b640 1 -- 172.21.15.87:0/3500784891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bc5916950 msgr2=0x555bc5913770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:01.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.473+0000 7f31c5d9b640 1 --2- 172.21.15.87:0/3500784891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bc5916950 0x555bc5913770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.473+0000 7f31c5d9b640 1 -- 172.21.15.87:0/3500784891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bc590b790 msgr2=0x555bc5915f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:01.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.473+0000 7f31c5d9b640 1 --2- 172.21.15.87:0/3500784891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bc590b790 0x555bc5915f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.473+0000 7f31c5d9b640 1 -- 172.21.15.87:0/3500784891 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c8014610 con 0x555bc590c0b0 2024-09-13T17:22:01.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.473+0000 7f31ced9d640 1 --2- 172.21.15.87:0/3500784891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bc5916950 0x555bc5913770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:22:01.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.473+0000 7f31c5d9b640 1 --2- 172.21.15.87:0/3500784891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bc590c0b0 0x555bc5913230 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f31b8006010 tx=0x7f31b8031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2975b9e53bfe65 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:01.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.473+0000 7f31b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:22:01.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.473+0000 7f31b5ffb640 1 -- 172.21.15.87:0/3500784891 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b8004240 con 0x555bc590c0b0 2024-09-13T17:22:01.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.473+0000 7f31b5ffb640 1 -- 172.21.15.87:0/3500784891 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f31b8031800 con 0x555bc590c0b0 2024-09-13T17:22:01.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.473+0000 7f31d76c3740 1 -- 172.21.15.87:0/3500784891 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555bc5898b80 con 0x555bc590c0b0 2024-09-13T17:22:01.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.473+0000 7f31b5ffb640 1 -- 172.21.15.87:0/3500784891 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31b80043a0 con 0x555bc590c0b0 2024-09-13T17:22:01.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.473+0000 7f31d76c3740 10 client.17745 fetch_fsmap learned FSMap version 36 2024-09-13T17:22:01.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.473+0000 7f31d76c3740 1 -- 172.21.15.87:0/3500784891 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x555bc586d3c0 con 0x555bc590c0b0 2024-09-13T17:22:01.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.473+0000 7f31b5ffb640 1 -- 172.21.15.87:0/3500784891 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x555bc5898b80 con 0x555bc590c0b0 2024-09-13T17:22:01.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.474+0000 7f31b5ffb640 1 -- 172.21.15.87:0/3500784891 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f31b8042030 con 0x555bc590c0b0 2024-09-13T17:22:01.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.474+0000 7f31d76c3740 10 client.17745 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:22:01.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.474+0000 7f31d76c3740 10 client.17745 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:22:01.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.474+0000 7f31d76c3740 20 client.17745 populate_metadata read hostname 'smithi087' 2024-09-13T17:22:01.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.474+0000 7f31d76c3740 1 --2- 172.21.15.87:0/3500784891 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x555bc59262b0 0x555bc59286d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.474+0000 7f31d76c3740 4 client.17745 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:22:01.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.474+0000 7f31d76c3740 1 -- 172.21.15.87:0/3500784891 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555bc58611f0 con 0x555bc59262b0 2024-09-13T17:22:01.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.474+0000 7f31ce59c640 1 --2- 172.21.15.87:0/3500784891 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x555bc59262b0 0x555bc59286d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.474+0000 7f31ce59c640 1 --2- 172.21.15.87:0/3500784891 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x555bc59262b0 0x555bc59286d0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=60ef9810a01411f2 server_cookie=52e7ff7d2ece2cc5 in_seq=0 out_seq=0 2024-09-13T17:22:01.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.474+0000 7f31b5ffb640 10 client.17745 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:22:01.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.475+0000 7f31b5ffb640 1 -- 172.21.15.87:0/3500784891 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x555bc58611f0 con 0x555bc59262b0 2024-09-13T17:22:01.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.475+0000 7f31b5ffb640 10 client.17745 handle_command_reply: tid=0 2024-09-13T17:22:01.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.475+0000 7f31d76c3740 1 client.17745 shutdown 2024-09-13T17:22:01.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.475+0000 7f31d76c3740 1 -- 172.21.15.87:0/3500784891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bc590c0b0 msgr2=0x555bc5913230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:01.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.475+0000 7f31d76c3740 1 --2- 172.21.15.87:0/3500784891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bc590c0b0 0x555bc5913230 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f31b8006010 tx=0x7f31b8031400 comp rx=0 tx=0).stop 2024-09-13T17:22:01.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.475+0000 7f31d76c3740 1 -- 172.21.15.87:0/3500784891 shutdown_connections 2024-09-13T17:22:01.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.475+0000 7f31d76c3740 1 --2- 172.21.15.87:0/3500784891 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x555bc59262b0 0x555bc59286d0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.475+0000 7f31d76c3740 1 --2- 172.21.15.87:0/3500784891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bc5916950 0x555bc5913770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.475+0000 7f31d76c3740 1 --2- 172.21.15.87:0/3500784891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bc590c0b0 0x555bc5913230 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.475+0000 7f31d76c3740 1 --2- 172.21.15.87:0/3500784891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bc590b790 0x555bc5915f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.475+0000 7f31b5ffb640 0 client.17745 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:22:01.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.475+0000 7f31d76c3740 1 -- 172.21.15.87:0/3500784891 >> 172.21.15.87:0/3500784891 conn(0x555bc5907d00 msgr2=0x555bc590da60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:01.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.475+0000 7f31d76c3740 1 -- 172.21.15.87:0/3500784891 shutdown_connections 2024-09-13T17:22:01.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.475+0000 7f31d76c3740 1 -- 172.21.15.87:0/3500784891 wait complete. 2024-09-13T17:22:01.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.475+0000 7f31d76c3740 20 client.17745 trim_cache size 0 max 16384 2024-09-13T17:22:01.484 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:01 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/148206802' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:22:01.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.486+0000 7f31d76c3740 1 Processor -- start 2024-09-13T17:22:01.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.486+0000 7f31d76c3740 1 -- start start 2024-09-13T17:22:01.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.486+0000 7f31d76c3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bc5907d00 0x555bc5915100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.486+0000 7f31d76c3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bc590b790 0x555bc5917d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.486+0000 7f31d76c3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bc590c0b0 0x555bc5918280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.486+0000 7f31d76c3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bc5898b80 con 0x555bc590b790 2024-09-13T17:22:01.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.486+0000 7f31d76c3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bc5915b70 con 0x555bc5907d00 2024-09-13T17:22:01.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.486+0000 7f31d76c3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bc590afb0 con 0x555bc590c0b0 2024-09-13T17:22:01.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.486+0000 7f31c5d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bc590b790 0x555bc5917d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.486+0000 7f31c5d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bc590b790 0x555bc5917d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49648/0 (socket says 172.21.15.87:49648) 2024-09-13T17:22:01.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.486+0000 7f31c5d9b640 1 -- 172.21.15.87:0/2599146764 learned_addr learned my addr 172.21.15.87:0/2599146764 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:01.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.487+0000 7f31c5d9b640 1 -- 172.21.15.87:0/2599146764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bc590c0b0 msgr2=0x555bc5918280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:01.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.487+0000 7f31c5d9b640 1 --2- 172.21.15.87:0/2599146764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bc590c0b0 0x555bc5918280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.487+0000 7f31c5d9b640 1 -- 172.21.15.87:0/2599146764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bc5907d00 msgr2=0x555bc5915100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:01.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.487+0000 7f31c5d9b640 1 --2- 172.21.15.87:0/2599146764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bc5907d00 0x555bc5915100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.487+0000 7f31c5d9b640 1 -- 172.21.15.87:0/2599146764 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555bc580f770 con 0x555bc590b790 2024-09-13T17:22:01.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.487+0000 7f31c5d9b640 1 --2- 172.21.15.87:0/2599146764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bc590b790 0x555bc5917d40 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f31b802a940 tx=0x7f31b8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ddcc29119621970 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:01.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.487+0000 7f31c559a640 1 -- 172.21.15.87:0/2599146764 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b8031470 con 0x555bc590b790 2024-09-13T17:22:01.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.487+0000 7f31c559a640 1 -- 172.21.15.87:0/2599146764 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f31b80044e0 con 0x555bc590b790 2024-09-13T17:22:01.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.487+0000 7f31c559a640 1 -- 172.21.15.87:0/2599146764 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b803ce60 con 0x555bc590b790 2024-09-13T17:22:01.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.487+0000 7f31d76c3740 1 -- 172.21.15.87:0/2599146764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bc590b790 msgr2=0x555bc5917d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:01.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.487+0000 7f31d76c3740 1 --2- 172.21.15.87:0/2599146764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bc590b790 0x555bc5917d40 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f31b802a940 tx=0x7f31b8001e70 comp rx=0 tx=0).stop 2024-09-13T17:22:01.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.487+0000 7f31d76c3740 1 -- 172.21.15.87:0/2599146764 shutdown_connections 2024-09-13T17:22:01.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.487+0000 7f31d76c3740 1 --2- 172.21.15.87:0/2599146764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bc590c0b0 0x555bc5918280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.487+0000 7f31d76c3740 1 --2- 172.21.15.87:0/2599146764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bc590b790 0x555bc5917d40 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.487+0000 7f31d76c3740 1 --2- 172.21.15.87:0/2599146764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bc5907d00 0x555bc5915100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.487+0000 7f31d76c3740 1 -- 172.21.15.87:0/2599146764 >> 172.21.15.87:0/2599146764 conn(0x555bc5916070 msgr2=0x555bc59149f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:01.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.487+0000 7f31d76c3740 1 -- 172.21.15.87:0/2599146764 shutdown_connections 2024-09-13T17:22:01.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.487+0000 7f31d76c3740 1 -- 172.21.15.87:0/2599146764 wait complete. 2024-09-13T17:22:01.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.488+0000 7f31d76c3740 1 -- start start 2024-09-13T17:22:01.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.488+0000 7f31d76c3740 1 Processor -- start 2024-09-13T17:22:01.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.488+0000 7f31d76c3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bc5907d00 0x555bc59101f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.488+0000 7f31d76c3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bc590b790 0x555bc5910730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.488+0000 7f31d76c3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bc590c0b0 0x555bc597c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.488+0000 7f31d76c3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bc5910e90 con 0x555bc5907d00 2024-09-13T17:22:01.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.488+0000 7f31d76c3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bc5911000 con 0x555bc590c0b0 2024-09-13T17:22:01.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.488+0000 7f31d76c3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bc597ccf0 con 0x555bc590b790 2024-09-13T17:22:01.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.488+0000 7f31d76c3740 10 client.0 _ll_register_callbacks cb 0x7f31c8009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:22:01.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.488+0000 7f31ce59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bc5907d00 0x555bc59101f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.488+0000 7f31ce59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bc5907d00 0x555bc59101f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49656/0 (socket says 172.21.15.87:49656) 2024-09-13T17:22:01.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.488+0000 7f31ce59c640 1 -- 172.21.15.87:0/1525396635 learned_addr learned my addr 172.21.15.87:0/1525396635 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:01.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.488+0000 7f31ced9d640 1 --2- 172.21.15.87:0/1525396635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bc590c0b0 0x555bc597c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.488+0000 7f31ce59c640 1 -- 172.21.15.87:0/1525396635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bc590b790 msgr2=0x555bc5910730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:01.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.488+0000 7f31ce59c640 1 --2- 172.21.15.87:0/1525396635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bc590b790 0x555bc5910730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.488+0000 7f31ce59c640 1 -- 172.21.15.87:0/1525396635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bc590c0b0 msgr2=0x555bc597c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:01.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.488+0000 7f31ce59c640 1 --2- 172.21.15.87:0/1525396635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bc590c0b0 0x555bc597c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.488+0000 7f31ce59c640 1 -- 172.21.15.87:0/1525396635 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555bc586d3c0 con 0x555bc5907d00 2024-09-13T17:22:01.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.489+0000 7f31ce59c640 1 --2- 172.21.15.87:0/1525396635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bc5907d00 0x555bc59101f0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f31c00ca230 tx=0x7f31c00d0560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc5a97014d783954 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:01.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.489+0000 7f31b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:22:01.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.489+0000 7f31b5ffb640 1 -- 172.21.15.87:0/1525396635 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c00b9040 con 0x555bc5907d00 2024-09-13T17:22:01.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.489+0000 7f31b5ffb640 1 -- 172.21.15.87:0/1525396635 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f31c0099b40 con 0x555bc5907d00 2024-09-13T17:22:01.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.489+0000 7f31d76c3740 1 -- 172.21.15.87:0/1525396635 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f31c801a070 con 0x555bc5907d00 2024-09-13T17:22:01.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.489+0000 7f31b5ffb640 1 -- 172.21.15.87:0/1525396635 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31c009d970 con 0x555bc5907d00 2024-09-13T17:22:01.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.489+0000 7f31d76c3740 10 client.17751 fetch_fsmap learned FSMap version 36 2024-09-13T17:22:01.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.489+0000 7f31d76c3740 1 -- 172.21.15.87:0/1525396635 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x555bc5834e80 con 0x555bc5907d00 2024-09-13T17:22:01.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.489+0000 7f31b5ffb640 1 -- 172.21.15.87:0/1525396635 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f31c0063030 con 0x555bc5907d00 2024-09-13T17:22:01.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.489+0000 7f31b5ffb640 1 -- 172.21.15.87:0/1525396635 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f31c00ce040 con 0x555bc5907d00 2024-09-13T17:22:01.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.489+0000 7f31d76c3740 10 client.17751 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:22:01.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.489+0000 7f31d76c3740 10 client.17751 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:22:01.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.489+0000 7f31d76c3740 20 client.17751 populate_metadata read hostname 'smithi087' 2024-09-13T17:22:01.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.489+0000 7f31d76c3740 1 --2- 172.21.15.87:0/1525396635 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x555bc5916950 0x555bc59804b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.489+0000 7f31d76c3740 4 client.17751 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:22:01.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.489+0000 7f31d76c3740 1 -- 172.21.15.87:0/1525396635 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x555bc55624e0 con 0x555bc5916950 2024-09-13T17:22:01.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.489+0000 7f31c5d9b640 1 --2- 172.21.15.87:0/1525396635 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x555bc5916950 0x555bc59804b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.490+0000 7f31c5d9b640 1 --2- 172.21.15.87:0/1525396635 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x555bc5916950 0x555bc59804b0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1138cb540a771599 server_cookie=e8bedde2f2bb0d7e in_seq=0 out_seq=0 2024-09-13T17:22:01.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.490+0000 7f31b5ffb640 10 client.17751 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:22:01.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.490+0000 7f31b5ffb640 1 -- 172.21.15.87:0/1525396635 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x555bc55624e0 con 0x555bc5916950 2024-09-13T17:22:01.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.490+0000 7f31b5ffb640 10 client.17751 handle_command_reply: tid=0 2024-09-13T17:22:01.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.490+0000 7f31d76c3740 1 client.17751 shutdown 2024-09-13T17:22:01.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.490+0000 7f31d76c3740 1 -- 172.21.15.87:0/1525396635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bc5907d00 msgr2=0x555bc59101f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:01.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.490+0000 7f31d76c3740 1 --2- 172.21.15.87:0/1525396635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bc5907d00 0x555bc59101f0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f31c00ca230 tx=0x7f31c00d0560 comp rx=0 tx=0).stop 2024-09-13T17:22:01.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.490+0000 7f31d76c3740 1 -- 172.21.15.87:0/1525396635 shutdown_connections 2024-09-13T17:22:01.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.490+0000 7f31d76c3740 1 --2- 172.21.15.87:0/1525396635 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x555bc5916950 0x555bc59804b0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.490+0000 7f31d76c3740 1 --2- 172.21.15.87:0/1525396635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bc590c0b0 0x555bc597c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.490+0000 7f31b5ffb640 0 client.17751 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:22:01.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.490+0000 7f31d76c3740 1 --2- 172.21.15.87:0/1525396635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555bc590b790 0x555bc5910730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.490+0000 7f31d76c3740 1 --2- 172.21.15.87:0/1525396635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555bc5907d00 0x555bc59101f0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.490+0000 7f31d76c3740 1 -- 172.21.15.87:0/1525396635 >> 172.21.15.87:0/1525396635 conn(0x555bc5916070 msgr2=0x555bc5915170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:01.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.490+0000 7f31d76c3740 1 -- 172.21.15.87:0/1525396635 shutdown_connections 2024-09-13T17:22:01.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.490+0000 7f31d76c3740 1 -- 172.21.15.87:0/1525396635 wait complete. 2024-09-13T17:22:01.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.490+0000 7f31d76c3740 20 client.17751 trim_cache size 0 max 16384 2024-09-13T17:22:01.498 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:22:01.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.491+0000 7f31d499c640 1 -- 172.21.15.87:0/1121601963 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f31bc0a1200 msgr2=0x7f31bc0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:01.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.491+0000 7f31d499c640 1 --2- 172.21.15.87:0/1121601963 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f31bc0a1200 0x7f31bc0a36c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f31c801c000 tx=0x7f31c801e000 comp rx=0 tx=0).stop 2024-09-13T17:22:01.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.491+0000 7f31d499c640 1 -- 172.21.15.87:0/1121601963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31d00fee50 msgr2=0x7f31d0197100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:01.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.491+0000 7f31d499c640 1 --2- 172.21.15.87:0/1121601963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31d00fee50 0x7f31d0197100 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f31c000c970 tx=0x7f31c000ce30 comp rx=0 tx=0).stop 2024-09-13T17:22:01.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.491+0000 7f31d499c640 1 -- 172.21.15.87:0/1121601963 shutdown_connections 2024-09-13T17:22:01.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.491+0000 7f31d499c640 1 --2- 172.21.15.87:0/1121601963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31d0197b80 0x7f31d01a2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.491+0000 7f31d499c640 1 --2- 172.21.15.87:0/1121601963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31d0103fa0 0x7f31d0197640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.491+0000 7f31d499c640 1 --2- 172.21.15.87:0/1121601963 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f31bc0a1200 0x7f31bc0a36c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.491+0000 7f31d499c640 1 --2- 172.21.15.87:0/1121601963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31d00fee50 0x7f31d0197100 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.491+0000 7f31d499c640 1 -- 172.21.15.87:0/1121601963 >> 172.21.15.87:0/1121601963 conn(0x7f31d00fa8e0 msgr2=0x7f31d00fbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:01.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.491+0000 7f31d499c640 1 -- 172.21.15.87:0/1121601963 shutdown_connections 2024-09-13T17:22:01.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.491+0000 7f31d499c640 1 -- 172.21.15.87:0/1121601963 wait complete. 2024-09-13T17:22:01.503 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-09-13T17:22:01.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:01 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/148206802' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:22:01.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.601+0000 7f7239926640 1 -- 172.21.15.87:0/3121735893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7234100f40 msgr2=0x7f7234101320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:01.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.601+0000 7f7239926640 1 --2- 172.21.15.87:0/3121735893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7234100f40 0x7f7234101320 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f7224009ca0 tx=0x7f722402a950 comp rx=0 tx=0).stop 2024-09-13T17:22:01.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.601+0000 7f7239926640 1 -- 172.21.15.87:0/3121735893 shutdown_connections 2024-09-13T17:22:01.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.601+0000 7f7239926640 1 --2- 172.21.15.87:0/3121735893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f723410a310 0x7f723410c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.601+0000 7f7239926640 1 --2- 172.21.15.87:0/3121735893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7234101860 0x7f7234109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.601+0000 7f7239926640 1 --2- 172.21.15.87:0/3121735893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7234100f40 0x7f7234101320 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.601+0000 7f7239926640 1 -- 172.21.15.87:0/3121735893 >> 172.21.15.87:0/3121735893 conn(0x7f7234075c60 msgr2=0x7f72340fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:01.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.601+0000 7f7239926640 1 -- 172.21.15.87:0/3121735893 shutdown_connections 2024-09-13T17:22:01.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.601+0000 7f7239926640 1 -- 172.21.15.87:0/3121735893 wait complete. 2024-09-13T17:22:01.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.602+0000 7f7239926640 1 Processor -- start 2024-09-13T17:22:01.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.602+0000 7f7239926640 1 -- start start 2024-09-13T17:22:01.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.602+0000 7f7239926640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7234100f40 0x7f7234196280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.602+0000 7f7239926640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7234101860 0x7f72341967c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.602+0000 7f7239926640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f723410a310 0x7f723419abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.602+0000 7f7239926640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723419b1b0 con 0x7f723410a310 2024-09-13T17:22:01.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.602+0000 7f7239926640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723419b320 con 0x7f7234100f40 2024-09-13T17:22:01.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.602+0000 7f7239926640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723419b4e0 con 0x7f7234101860 2024-09-13T17:22:01.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.602+0000 7f72337fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f723410a310 0x7f723419abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.602+0000 7f72337fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f723410a310 0x7f723419abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49672/0 (socket says 172.21.15.87:49672) 2024-09-13T17:22:01.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.602+0000 7f72337fe640 1 -- 172.21.15.87:0/4088776524 learned_addr learned my addr 172.21.15.87:0/4088776524 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:01.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.603+0000 7f7232ffd640 1 --2- 172.21.15.87:0/4088776524 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7234100f40 0x7f7234196280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.603+0000 7f72327fc640 1 --2- 172.21.15.87:0/4088776524 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7234101860 0x7f72341967c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.603+0000 7f72337fe640 1 -- 172.21.15.87:0/4088776524 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7234101860 msgr2=0x7f72341967c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:01.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.603+0000 7f72337fe640 1 --2- 172.21.15.87:0/4088776524 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7234101860 0x7f72341967c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.603+0000 7f72337fe640 1 -- 172.21.15.87:0/4088776524 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7234100f40 msgr2=0x7f7234196280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:01.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.603+0000 7f72337fe640 1 --2- 172.21.15.87:0/4088776524 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7234100f40 0x7f7234196280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.603+0000 7f72337fe640 1 -- 172.21.15.87:0/4088776524 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7224009900 con 0x7f723410a310 2024-09-13T17:22:01.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.603+0000 7f72337fe640 1 --2- 172.21.15.87:0/4088776524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f723410a310 0x7f723419abb0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f722c00c720 tx=0x7f722c00cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:01.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.603+0000 7f7238924640 1 -- 172.21.15.87:0/4088776524 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722c007bb0 con 0x7f723410a310 2024-09-13T17:22:01.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.603+0000 7f7239926640 1 -- 172.21.15.87:0/4088776524 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f723419b7c0 con 0x7f723410a310 2024-09-13T17:22:01.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.603+0000 7f7238924640 1 -- 172.21.15.87:0/4088776524 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f722c00ce30 con 0x7f723410a310 2024-09-13T17:22:01.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.603+0000 7f7238924640 1 -- 172.21.15.87:0/4088776524 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722c004d40 con 0x7f723410a310 2024-09-13T17:22:01.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.603+0000 7f7239926640 1 -- 172.21.15.87:0/4088776524 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72341a3040 con 0x7f723410a310 2024-09-13T17:22:01.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:01 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/148206802' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:22:01.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.605+0000 7f7238924640 1 -- 172.21.15.87:0/4088776524 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f722c004ec0 con 0x7f723410a310 2024-09-13T17:22:01.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.606+0000 7f723c648740 1 Processor -- start 2024-09-13T17:22:01.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.606+0000 7f723c648740 1 -- start start 2024-09-13T17:22:01.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.606+0000 7f723c648740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561d5ab41790 0x561d5ab41b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.606+0000 7f723c648740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d5ab420b0 0x561d5ab4c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.606+0000 7f723c648740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d5ab4c950 0x561d5ab4ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.606+0000 7f723c648740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d5aaabcc0 con 0x561d5ab41790 2024-09-13T17:22:01.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.606+0000 7f723c648740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d5aaa9450 con 0x561d5ab4c950 2024-09-13T17:22:01.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.606+0000 7f723c648740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d5aaa4d40 con 0x561d5ab420b0 2024-09-13T17:22:01.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.606+0000 7f72327fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561d5ab41790 0x561d5ab41b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.606+0000 7f72327fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561d5ab41790 0x561d5ab41b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49686/0 (socket says 172.21.15.87:49686) 2024-09-13T17:22:01.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.606+0000 7f72327fc640 1 -- 172.21.15.87:0/1676396217 learned_addr learned my addr 172.21.15.87:0/1676396217 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:01.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.606+0000 7f7232ffd640 1 --2- 172.21.15.87:0/1676396217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d5ab420b0 0x561d5ab4c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.606+0000 7f7238924640 1 --2- 172.21.15.87:0/4088776524 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f72200a1200 0x7f72200a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.606+0000 7f72327fc640 1 -- 172.21.15.87:0/1676396217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d5ab420b0 msgr2=0x561d5ab4c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:01.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.606+0000 7f72327fc640 1 --2- 172.21.15.87:0/1676396217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d5ab420b0 0x561d5ab4c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.606+0000 7f72327fc640 1 -- 172.21.15.87:0/1676396217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d5ab4c950 msgr2=0x561d5ab4ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:01.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.606+0000 7f72327fc640 1 --2- 172.21.15.87:0/1676396217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d5ab4c950 0x561d5ab4ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.606+0000 7f72327fc640 1 -- 172.21.15.87:0/1676396217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d5aa6c620 con 0x561d5ab41790 2024-09-13T17:22:01.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.607+0000 7f72337fe640 1 --2- 172.21.15.87:0/4088776524 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f72200a1200 0x7f72200a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.607+0000 7f7238924640 1 -- 172.21.15.87:0/4088776524 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f722c0cccf0 con 0x7f723410a310 2024-09-13T17:22:01.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.607+0000 7f72327fc640 1 --2- 172.21.15.87:0/1676396217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561d5ab41790 0x561d5ab41b70 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f721c00cc50 tx=0x7f721c010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b8d7546f9e7eb7f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:01.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.607+0000 7f7229ffb640 1 -- 172.21.15.87:0/1676396217 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721c012480 con 0x561d5ab41790 2024-09-13T17:22:01.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.607+0000 7f7229ffb640 1 -- 172.21.15.87:0/1676396217 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f721c012a90 con 0x561d5ab41790 2024-09-13T17:22:01.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.607+0000 7f7229ffb640 1 -- 172.21.15.87:0/1676396217 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721c011980 con 0x561d5ab41790 2024-09-13T17:22:01.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.607+0000 7f723c648740 1 -- 172.21.15.87:0/1676396217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561d5ab41790 msgr2=0x561d5ab41b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:01.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.607+0000 7f72337fe640 1 --2- 172.21.15.87:0/4088776524 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f72200a1200 0x7f72200a36c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f722c0ca0e0 tx=0x7f722c069970 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:01.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.607+0000 7f723c648740 1 --2- 172.21.15.87:0/1676396217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561d5ab41790 0x561d5ab41b70 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f721c00cc50 tx=0x7f721c010740 comp rx=0 tx=0).stop 2024-09-13T17:22:01.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.608+0000 7f723c648740 1 -- 172.21.15.87:0/1676396217 shutdown_connections 2024-09-13T17:22:01.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.608+0000 7f723c648740 1 --2- 172.21.15.87:0/1676396217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d5ab4c950 0x561d5ab4ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.608+0000 7f723c648740 1 --2- 172.21.15.87:0/1676396217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d5ab420b0 0x561d5ab4c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.608+0000 7f723c648740 1 --2- 172.21.15.87:0/1676396217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561d5ab41790 0x561d5ab41b70 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.608+0000 7f723c648740 1 -- 172.21.15.87:0/1676396217 >> 172.21.15.87:0/1676396217 conn(0x561d5ab3dd00 msgr2=0x561d5ab3e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:01.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.608+0000 7f723c648740 1 -- 172.21.15.87:0/1676396217 shutdown_connections 2024-09-13T17:22:01.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.608+0000 7f723c648740 1 -- 172.21.15.87:0/1676396217 wait complete. 2024-09-13T17:22:01.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.608+0000 7f723c648740 1 -- start start 2024-09-13T17:22:01.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.608+0000 7f723c648740 1 Processor -- start 2024-09-13T17:22:01.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.608+0000 7f723c648740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d5ab41790 0x561d5ab4bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.608+0000 7f723c648740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d5ab420b0 0x561d5ab49350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.608+0000 7f723c648740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561d5ab4c950 0x561d5ab49890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.608+0000 7f723c648740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d5aa63180 con 0x561d5ab4c950 2024-09-13T17:22:01.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.608+0000 7f723c648740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d5a77d430 con 0x561d5ab420b0 2024-09-13T17:22:01.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.608+0000 7f723c648740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d5aa285e0 con 0x561d5ab41790 2024-09-13T17:22:01.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.608+0000 7f723c648740 10 client.0 _ll_register_callbacks cb 0x561d5aa94aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:22:01.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.608+0000 7f72327fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561d5ab4c950 0x561d5ab49890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.609+0000 7f72327fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561d5ab4c950 0x561d5ab49890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49696/0 (socket says 172.21.15.87:49696) 2024-09-13T17:22:01.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.609+0000 7f72327fc640 1 -- 172.21.15.87:0/298903752 learned_addr learned my addr 172.21.15.87:0/298903752 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:01.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.609+0000 7f72327fc640 1 --2- 172.21.15.87:0/298903752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d5ab41790 0x561d5ab4bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.609+0000 7f7232ffd640 1 --2- 172.21.15.87:0/298903752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d5ab420b0 0x561d5ab49350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.609+0000 7f72327fc640 1 -- 172.21.15.87:0/298903752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d5ab41790 msgr2=0x561d5ab4bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:01.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.609+0000 7f72327fc640 1 --2- 172.21.15.87:0/298903752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d5ab41790 0x561d5ab4bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.609+0000 7f72327fc640 1 -- 172.21.15.87:0/298903752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d5ab420b0 msgr2=0x561d5ab49350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:01.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.609+0000 7f72327fc640 1 --2- 172.21.15.87:0/298903752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d5ab420b0 0x561d5ab49350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.609+0000 7f72327fc640 1 -- 172.21.15.87:0/298903752 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f721c00c900 con 0x561d5ab4c950 2024-09-13T17:22:01.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.609+0000 7f72327fc640 1 --2- 172.21.15.87:0/298903752 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561d5ab4c950 0x561d5ab49890 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f721c0058c0 tx=0x7f721c010f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59c36f34f49f8e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:01.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.609+0000 7f7212ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:22:01.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.609+0000 7f7212ffd640 1 -- 172.21.15.87:0/298903752 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721c005320 con 0x561d5ab4c950 2024-09-13T17:22:01.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.609+0000 7f7212ffd640 1 -- 172.21.15.87:0/298903752 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f721c005480 con 0x561d5ab4c950 2024-09-13T17:22:01.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.609+0000 7f723c648740 1 -- 172.21.15.87:0/298903752 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561d5aaceb80 con 0x561d5ab4c950 2024-09-13T17:22:01.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.609+0000 7f7212ffd640 1 -- 172.21.15.87:0/298903752 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f721c005640 con 0x561d5ab4c950 2024-09-13T17:22:01.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.609+0000 7f723c648740 10 client.17763 fetch_fsmap learned FSMap version 36 2024-09-13T17:22:01.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.609+0000 7f723c648740 1 -- 172.21.15.87:0/298903752 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x561d5aaa33c0 con 0x561d5ab4c950 2024-09-13T17:22:01.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.609+0000 7f7212ffd640 1 -- 172.21.15.87:0/298903752 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x561d5aaceb80 con 0x561d5ab4c950 2024-09-13T17:22:01.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.610+0000 7f7212ffd640 1 -- 172.21.15.87:0/298903752 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f721c004a70 con 0x561d5ab4c950 2024-09-13T17:22:01.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.610+0000 7f723c648740 10 client.17763 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:22:01.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.610+0000 7f723c648740 10 client.17763 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:22:01.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.610+0000 7f723c648740 20 client.17763 populate_metadata read hostname 'smithi087' 2024-09-13T17:22:01.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.610+0000 7f723c648740 1 --2- 172.21.15.87:0/298903752 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x561d5ab5c210 0x561d5ab5e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.610+0000 7f723c648740 4 client.17763 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:22:01.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.610+0000 7f723c648740 1 -- 172.21.15.87:0/298903752 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561d5aa971f0 con 0x561d5ab5c210 2024-09-13T17:22:01.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.610+0000 7f7232ffd640 1 --2- 172.21.15.87:0/298903752 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x561d5ab5c210 0x561d5ab5e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.610+0000 7f7212ffd640 10 client.17763 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:22:01.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.610+0000 7f7232ffd640 1 --2- 172.21.15.87:0/298903752 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x561d5ab5c210 0x561d5ab5e600 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1b6c102e39c1df1 server_cookie=3505891e28c4b65b in_seq=0 out_seq=0 2024-09-13T17:22:01.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.611+0000 7f7212ffd640 1 -- 172.21.15.87:0/298903752 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x561d5aa971f0 con 0x561d5ab5c210 2024-09-13T17:22:01.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.611+0000 7f7212ffd640 10 client.17763 handle_command_reply: tid=0 2024-09-13T17:22:01.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.611+0000 7f723c648740 1 client.17763 shutdown 2024-09-13T17:22:01.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.611+0000 7f723c648740 1 -- 172.21.15.87:0/298903752 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561d5ab4c950 msgr2=0x561d5ab49890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:01.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.611+0000 7f723c648740 1 --2- 172.21.15.87:0/298903752 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561d5ab4c950 0x561d5ab49890 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f721c0058c0 tx=0x7f721c010f70 comp rx=0 tx=0).stop 2024-09-13T17:22:01.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.611+0000 7f723c648740 1 -- 172.21.15.87:0/298903752 shutdown_connections 2024-09-13T17:22:01.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.611+0000 7f723c648740 1 --2- 172.21.15.87:0/298903752 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x561d5ab5c210 0x561d5ab5e600 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.611+0000 7f723c648740 1 --2- 172.21.15.87:0/298903752 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561d5ab4c950 0x561d5ab49890 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.611+0000 7f723c648740 1 --2- 172.21.15.87:0/298903752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d5ab420b0 0x561d5ab49350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.611+0000 7f7212ffd640 0 client.17763 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:22:01.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.611+0000 7f723c648740 1 --2- 172.21.15.87:0/298903752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d5ab41790 0x561d5ab4bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.611+0000 7f723c648740 1 -- 172.21.15.87:0/298903752 >> 172.21.15.87:0/298903752 conn(0x561d5ab3dd00 msgr2=0x561d5ab43a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:01.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.611+0000 7f723c648740 1 -- 172.21.15.87:0/298903752 shutdown_connections 2024-09-13T17:22:01.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.611+0000 7f723c648740 1 -- 172.21.15.87:0/298903752 wait complete. 2024-09-13T17:22:01.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.612+0000 7f723c648740 20 client.17763 trim_cache size 0 max 16384 2024-09-13T17:22:01.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.622+0000 7f723c648740 1 Processor -- start 2024-09-13T17:22:01.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.622+0000 7f723c648740 1 -- start start 2024-09-13T17:22:01.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.622+0000 7f723c648740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561d5ab3dd00 0x561d5ab48870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.622+0000 7f723c648740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d5ab41790 0x561d5ab48db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.622+0000 7f723c648740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d5ab420b0 0x561d5ab49310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.622+0000 7f723c648740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d5ab3e9f0 con 0x561d5ab3dd00 2024-09-13T17:22:01.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.622+0000 7f723c648740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d5ab58980 con 0x561d5ab420b0 2024-09-13T17:22:01.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.622+0000 7f723c648740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d5ab4c4d0 con 0x561d5ab41790 2024-09-13T17:22:01.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.623+0000 7f72327fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561d5ab3dd00 0x561d5ab48870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.623+0000 7f72327fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561d5ab3dd00 0x561d5ab48870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49700/0 (socket says 172.21.15.87:49700) 2024-09-13T17:22:01.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.623+0000 7f72327fc640 1 -- 172.21.15.87:0/2843383591 learned_addr learned my addr 172.21.15.87:0/2843383591 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:01.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.623+0000 7f7232ffd640 1 --2- 172.21.15.87:0/2843383591 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d5ab41790 0x561d5ab48db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.623+0000 7f72327fc640 1 -- 172.21.15.87:0/2843383591 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d5ab41790 msgr2=0x561d5ab48db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:01.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.623+0000 7f72327fc640 1 --2- 172.21.15.87:0/2843383591 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d5ab41790 0x561d5ab48db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.623+0000 7f72327fc640 1 -- 172.21.15.87:0/2843383591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d5ab420b0 msgr2=0x561d5ab49310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:01.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.623+0000 7f72327fc640 1 --2- 172.21.15.87:0/2843383591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d5ab420b0 0x561d5ab49310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.623+0000 7f72327fc640 1 -- 172.21.15.87:0/2843383591 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d5aa45770 con 0x561d5ab3dd00 2024-09-13T17:22:01.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.623+0000 7f7232ffd640 1 --2- 172.21.15.87:0/2843383591 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d5ab41790 0x561d5ab48db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:22:01.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.623+0000 7f72327fc640 1 --2- 172.21.15.87:0/2843383591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561d5ab3dd00 0x561d5ab48870 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f721c005d60 tx=0x7f721c012550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f406f15a17eb67 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:01.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.623+0000 7f722a7fc640 1 -- 172.21.15.87:0/2843383591 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721c0114c0 con 0x561d5ab3dd00 2024-09-13T17:22:01.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.623+0000 7f722a7fc640 1 -- 172.21.15.87:0/2843383591 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f721c0128c0 con 0x561d5ab3dd00 2024-09-13T17:22:01.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.623+0000 7f722a7fc640 1 -- 172.21.15.87:0/2843383591 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721c004920 con 0x561d5ab3dd00 2024-09-13T17:22:01.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.624+0000 7f723c648740 1 -- 172.21.15.87:0/2843383591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561d5ab3dd00 msgr2=0x561d5ab48870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:01.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.624+0000 7f723c648740 1 --2- 172.21.15.87:0/2843383591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561d5ab3dd00 0x561d5ab48870 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f721c005d60 tx=0x7f721c012550 comp rx=0 tx=0).stop 2024-09-13T17:22:01.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.624+0000 7f723c648740 1 -- 172.21.15.87:0/2843383591 shutdown_connections 2024-09-13T17:22:01.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.624+0000 7f723c648740 1 --2- 172.21.15.87:0/2843383591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d5ab420b0 0x561d5ab49310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.624+0000 7f723c648740 1 --2- 172.21.15.87:0/2843383591 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d5ab41790 0x561d5ab48db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.624+0000 7f723c648740 1 --2- 172.21.15.87:0/2843383591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561d5ab3dd00 0x561d5ab48870 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.624+0000 7f723c648740 1 -- 172.21.15.87:0/2843383591 >> 172.21.15.87:0/2843383591 conn(0x561d5ab4c050 msgr2=0x561d5ab62ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:01.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.624+0000 7f723c648740 1 -- 172.21.15.87:0/2843383591 shutdown_connections 2024-09-13T17:22:01.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.624+0000 7f723c648740 1 -- 172.21.15.87:0/2843383591 wait complete. 2024-09-13T17:22:01.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.624+0000 7f723c648740 1 -- start start 2024-09-13T17:22:01.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.624+0000 7f723c648740 1 Processor -- start 2024-09-13T17:22:01.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.624+0000 7f723c648740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561d5ab3dd00 0x561d5ab4f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.624+0000 7f723c648740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d5ab41790 0x561d5ab4fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.624+0000 7f723c648740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d5ab420b0 0x561d5abb1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.624+0000 7f723c648740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d5abb1ba0 con 0x561d5ab3dd00 2024-09-13T17:22:01.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.624+0000 7f723c648740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d5abb1ce0 con 0x561d5ab41790 2024-09-13T17:22:01.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.624+0000 7f723c648740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d5abb1e20 con 0x561d5ab420b0 2024-09-13T17:22:01.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.624+0000 7f723c648740 10 client.0 _ll_register_callbacks cb 0x7f721c00c400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:22:01.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.624+0000 7f72327fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561d5ab3dd00 0x561d5ab4f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.625+0000 7f72327fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561d5ab3dd00 0x561d5ab4f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49714/0 (socket says 172.21.15.87:49714) 2024-09-13T17:22:01.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.625+0000 7f72327fc640 1 -- 172.21.15.87:0/1319905279 learned_addr learned my addr 172.21.15.87:0/1319905279 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:01.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.625+0000 7f7232ffd640 1 --2- 172.21.15.87:0/1319905279 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d5ab41790 0x561d5ab4fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.625+0000 7f72327fc640 1 --2- 172.21.15.87:0/1319905279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d5ab420b0 0x561d5abb1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.625+0000 7f72327fc640 1 -- 172.21.15.87:0/1319905279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d5ab420b0 msgr2=0x561d5abb1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:01.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.625+0000 7f72327fc640 1 --2- 172.21.15.87:0/1319905279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d5ab420b0 0x561d5abb1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.625+0000 7f72327fc640 1 -- 172.21.15.87:0/1319905279 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d5ab41790 msgr2=0x561d5ab4fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:01.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.625+0000 7f72327fc640 1 --2- 172.21.15.87:0/1319905279 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d5ab41790 0x561d5ab4fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.625+0000 7f72327fc640 1 -- 172.21.15.87:0/1319905279 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561d5aaa33c0 con 0x561d5ab3dd00 2024-09-13T17:22:01.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.625+0000 7f7232ffd640 1 --2- 172.21.15.87:0/1319905279 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d5ab41790 0x561d5ab4fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:22:01.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.625+0000 7f72327fc640 1 --2- 172.21.15.87:0/1319905279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561d5ab3dd00 0x561d5ab4f8a0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f721c004e80 tx=0x7f721c004700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1b544cea09f5942 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:01.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.625+0000 7f7212ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:22:01.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.625+0000 7f7212ffd640 1 -- 172.21.15.87:0/1319905279 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721c0055b0 con 0x561d5ab3dd00 2024-09-13T17:22:01.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.625+0000 7f7212ffd640 1 -- 172.21.15.87:0/1319905279 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f721c0048a0 con 0x561d5ab3dd00 2024-09-13T17:22:01.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.625+0000 7f723c648740 1 -- 172.21.15.87:0/1319905279 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f721c012a90 con 0x561d5ab3dd00 2024-09-13T17:22:01.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.625+0000 7f7212ffd640 1 -- 172.21.15.87:0/1319905279 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f721c005710 con 0x561d5ab3dd00 2024-09-13T17:22:01.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.625+0000 7f723c648740 10 client.17769 fetch_fsmap learned FSMap version 36 2024-09-13T17:22:01.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.625+0000 7f723c648740 1 -- 172.21.15.87:0/1319905279 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x561d5aa6ae80 con 0x561d5ab3dd00 2024-09-13T17:22:01.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.625+0000 7f7212ffd640 1 -- 172.21.15.87:0/1319905279 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f721c012a90 con 0x561d5ab3dd00 2024-09-13T17:22:01.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.626+0000 7f7212ffd640 1 -- 172.21.15.87:0/1319905279 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f721c01b610 con 0x561d5ab3dd00 2024-09-13T17:22:01.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.626+0000 7f723c648740 10 client.17769 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:22:01.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.626+0000 7f723c648740 10 client.17769 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:22:01.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.626+0000 7f723c648740 20 client.17769 populate_metadata read hostname 'smithi087' 2024-09-13T17:22:01.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.626+0000 7f723c648740 1 --2- 172.21.15.87:0/1319905279 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x561d5ab4c950 0x561d5abb5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:01.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.626+0000 7f723c648740 4 client.17769 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:22:01.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.626+0000 7f723c648740 1 -- 172.21.15.87:0/1319905279 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561d5a7984e0 con 0x561d5ab4c950 2024-09-13T17:22:01.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.626+0000 7f7232ffd640 1 --2- 172.21.15.87:0/1319905279 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x561d5ab4c950 0x561d5abb5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:01.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.626+0000 7f7212ffd640 10 client.17769 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:22:01.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.626+0000 7f7232ffd640 1 --2- 172.21.15.87:0/1319905279 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x561d5ab4c950 0x561d5abb5100 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=583292da5fc5a3ba server_cookie=370b4ba030f7b9a8 in_seq=0 out_seq=0 2024-09-13T17:22:01.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.626+0000 7f7212ffd640 1 -- 172.21.15.87:0/1319905279 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561d5a7984e0 con 0x561d5ab4c950 2024-09-13T17:22:01.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.626+0000 7f7212ffd640 10 client.17769 handle_command_reply: tid=0 2024-09-13T17:22:01.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.626+0000 7f723c648740 1 client.17769 shutdown 2024-09-13T17:22:01.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.627+0000 7f723c648740 1 -- 172.21.15.87:0/1319905279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561d5ab3dd00 msgr2=0x561d5ab4f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:01.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.627+0000 7f723c648740 1 --2- 172.21.15.87:0/1319905279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561d5ab3dd00 0x561d5ab4f8a0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f721c004e80 tx=0x7f721c004700 comp rx=0 tx=0).stop 2024-09-13T17:22:01.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.627+0000 7f723c648740 1 -- 172.21.15.87:0/1319905279 shutdown_connections 2024-09-13T17:22:01.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.627+0000 7f723c648740 1 --2- 172.21.15.87:0/1319905279 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x561d5ab4c950 0x561d5abb5100 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.627+0000 7f723c648740 1 --2- 172.21.15.87:0/1319905279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d5ab420b0 0x561d5abb1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.627+0000 7f7212ffd640 0 client.17769 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:22:01.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.627+0000 7f723c648740 1 --2- 172.21.15.87:0/1319905279 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561d5ab41790 0x561d5ab4fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.627+0000 7f723c648740 1 --2- 172.21.15.87:0/1319905279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561d5ab3dd00 0x561d5ab4f8a0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.627+0000 7f723c648740 1 -- 172.21.15.87:0/1319905279 >> 172.21.15.87:0/1319905279 conn(0x561d5ab4c050 msgr2=0x561d5ab47ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:01.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.627+0000 7f723c648740 1 -- 172.21.15.87:0/1319905279 shutdown_connections 2024-09-13T17:22:01.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.627+0000 7f723c648740 1 -- 172.21.15.87:0/1319905279 wait complete. 2024-09-13T17:22:01.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.627+0000 7f723c648740 20 client.17769 trim_cache size 0 max 16384 2024-09-13T17:22:01.635 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:22:01.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.627+0000 7f7239926640 1 -- 172.21.15.87:0/4088776524 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f72200a1200 msgr2=0x7f72200a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:01.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.627+0000 7f7239926640 1 --2- 172.21.15.87:0/4088776524 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f72200a1200 0x7f72200a36c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f722c0ca0e0 tx=0x7f722c069970 comp rx=0 tx=0).stop 2024-09-13T17:22:01.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.627+0000 7f7239926640 1 -- 172.21.15.87:0/4088776524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f723410a310 msgr2=0x7f723419abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:01.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.627+0000 7f7239926640 1 --2- 172.21.15.87:0/4088776524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f723410a310 0x7f723419abb0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f722c00c720 tx=0x7f722c00cbe0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.627+0000 7f7239926640 1 -- 172.21.15.87:0/4088776524 shutdown_connections 2024-09-13T17:22:01.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.627+0000 7f7239926640 1 --2- 172.21.15.87:0/4088776524 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f72200a1200 0x7f72200a36c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.627+0000 7f7239926640 1 --2- 172.21.15.87:0/4088776524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f723410a310 0x7f723419abb0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.627+0000 7f7239926640 1 --2- 172.21.15.87:0/4088776524 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7234101860 0x7f72341967c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.627+0000 7f7239926640 1 --2- 172.21.15.87:0/4088776524 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7234100f40 0x7f7234196280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:01.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.627+0000 7f7239926640 1 -- 172.21.15.87:0/4088776524 >> 172.21.15.87:0/4088776524 conn(0x7f7234075c60 msgr2=0x7f72340fb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:01.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.627+0000 7f7239926640 1 -- 172.21.15.87:0/4088776524 shutdown_connections 2024-09-13T17:22:01.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:01.627+0000 7f7239926640 1 -- 172.21.15.87:0/4088776524 wait complete. 2024-09-13T17:22:02.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:02 smithi149 ceph-mon[35496]: pgmap v253: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-09-13T17:22:02.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:02 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:22:02.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:02 smithi118 ceph-mon[34374]: pgmap v253: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-09-13T17:22:02.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:02 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:22:02.639 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-13T17:22:02.640 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-09-13T17:22:02.662 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:02 smithi087 ceph-mon[30934]: pgmap v253: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-09-13T17:22:02.662 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:02 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:22:02.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.741+0000 7f6bb6533640 1 -- 172.21.15.87:0/3435154775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6bb00ff800 msgr2=0x7f6bb0103840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:02.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.741+0000 7f6bb6533640 1 --2- 172.21.15.87:0/3435154775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6bb00ff800 0x7f6bb0103840 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f6b98009930 tx=0x7f6b9802a420 comp rx=0 tx=0).stop 2024-09-13T17:22:02.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.741+0000 7f6bb6533640 1 -- 172.21.15.87:0/3435154775 shutdown_connections 2024-09-13T17:22:02.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.741+0000 7f6bb6533640 1 --2- 172.21.15.87:0/3435154775 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bb0103fa0 0x7f6bb010baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.741+0000 7f6bb6533640 1 --2- 172.21.15.87:0/3435154775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6bb00ff800 0x7f6bb0103840 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.741+0000 7f6bb6533640 1 --2- 172.21.15.87:0/3435154775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bb00fee50 0x7f6bb00ff230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.741+0000 7f6bb6533640 1 -- 172.21.15.87:0/3435154775 >> 172.21.15.87:0/3435154775 conn(0x7f6bb00fa8c0 msgr2=0x7f6bb00fcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:02.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.741+0000 7f6bb6533640 1 -- 172.21.15.87:0/3435154775 shutdown_connections 2024-09-13T17:22:02.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.741+0000 7f6bb6533640 1 -- 172.21.15.87:0/3435154775 wait complete. 2024-09-13T17:22:02.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.742+0000 7f6bb6533640 1 Processor -- start 2024-09-13T17:22:02.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.742+0000 7f6bb6533640 1 -- start start 2024-09-13T17:22:02.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.742+0000 7f6bb6533640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bb00fee50 0x7f6bb0196360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.742+0000 7f6bb6533640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bb0103fa0 0x7f6bb01968a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.742+0000 7f6bb6533640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6bb019ac90 0x7f6bb019b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.742+0000 7f6bb6533640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb019b680 con 0x7f6bb019ac90 2024-09-13T17:22:02.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.742+0000 7f6bb6533640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb019b7f0 con 0x7f6bb00fee50 2024-09-13T17:22:02.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.742+0000 7f6bb6533640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb019b960 con 0x7f6bb0103fa0 2024-09-13T17:22:02.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.742+0000 7f6bb4ad0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6bb019ac90 0x7f6bb019b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:02.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.742+0000 7f6bb4ad0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6bb019ac90 0x7f6bb019b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49736/0 (socket says 172.21.15.87:49736) 2024-09-13T17:22:02.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.742+0000 7f6bb4ad0640 1 -- 172.21.15.87:0/1140873424 learned_addr learned my addr 172.21.15.87:0/1140873424 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:02.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.742+0000 7f6baffff640 1 --2- 172.21.15.87:0/1140873424 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bb00fee50 0x7f6bb0196360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:02.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.742+0000 7f6ba7fff640 1 --2- 172.21.15.87:0/1140873424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bb0103fa0 0x7f6bb01968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:02.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.743+0000 7f6bb4ad0640 1 -- 172.21.15.87:0/1140873424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bb0103fa0 msgr2=0x7f6bb01968a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:02.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.743+0000 7f6bb4ad0640 1 --2- 172.21.15.87:0/1140873424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bb0103fa0 0x7f6bb01968a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.743+0000 7f6bb4ad0640 1 -- 172.21.15.87:0/1140873424 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bb00fee50 msgr2=0x7f6bb0196360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:02.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.743+0000 7f6bb4ad0640 1 --2- 172.21.15.87:0/1140873424 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bb00fee50 0x7f6bb0196360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.743+0000 7f6bb4ad0640 1 -- 172.21.15.87:0/1140873424 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b98009560 con 0x7f6bb019ac90 2024-09-13T17:22:02.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.743+0000 7f6bb4ad0640 1 --2- 172.21.15.87:0/1140873424 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6bb019ac90 0x7f6bb019b140 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8009fd0 tx=0x7f6ba800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:02.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.743+0000 7f6badffb640 1 -- 172.21.15.87:0/1140873424 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba800bea0 con 0x7f6bb019ac90 2024-09-13T17:22:02.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.743+0000 7f6badffb640 1 -- 172.21.15.87:0/1140873424 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6ba8009940 con 0x7f6bb019ac90 2024-09-13T17:22:02.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.743+0000 7f6bb6533640 1 -- 172.21.15.87:0/1140873424 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb01a2f40 con 0x7f6bb019ac90 2024-09-13T17:22:02.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.743+0000 7f6badffb640 1 -- 172.21.15.87:0/1140873424 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba80106c0 con 0x7f6bb019ac90 2024-09-13T17:22:02.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.743+0000 7f6bb6533640 1 -- 172.21.15.87:0/1140873424 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb01a3370 con 0x7f6bb019ac90 2024-09-13T17:22:02.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.745+0000 7f6badffb640 1 -- 172.21.15.87:0/1140873424 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f6ba8003970 con 0x7f6bb019ac90 2024-09-13T17:22:02.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.745+0000 7f6bb9259740 1 Processor -- start 2024-09-13T17:22:02.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.745+0000 7f6bb9259740 1 -- start start 2024-09-13T17:22:02.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.746+0000 7f6bb9259740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a7daede6a0 0x55a7daedea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.746+0000 7f6bb9259740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7daedefc0 0x55a7daeed850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.746+0000 7f6bb9259740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a7daeedd90 0x55a7daef0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.746+0000 7f6bb9259740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7dae49c60 con 0x55a7daede6a0 2024-09-13T17:22:02.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.746+0000 7f6bb9259740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7dae473f0 con 0x55a7daedefc0 2024-09-13T17:22:02.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.746+0000 7f6bb9259740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7dae42ce0 con 0x55a7daeedd90 2024-09-13T17:22:02.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.746+0000 7f6ba7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a7daede6a0 0x55a7daedea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:02.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.746+0000 7f6ba7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a7daede6a0 0x55a7daedea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49738/0 (socket says 172.21.15.87:49738) 2024-09-13T17:22:02.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.746+0000 7f6ba7fff640 1 -- 172.21.15.87:0/1187422633 learned_addr learned my addr 172.21.15.87:0/1187422633 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:02.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.746+0000 7f6baffff640 1 --2- 172.21.15.87:0/1187422633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7daedefc0 0x55a7daeed850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:02.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.746+0000 7f6ba7fff640 1 --2- 172.21.15.87:0/1187422633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a7daeedd90 0x55a7daef0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:02.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.746+0000 7f6ba7fff640 1 -- 172.21.15.87:0/1187422633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a7daeedd90 msgr2=0x55a7daef0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:02.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.746+0000 7f6ba7fff640 1 --2- 172.21.15.87:0/1187422633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a7daeedd90 0x55a7daef0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.746+0000 7f6ba7fff640 1 -- 172.21.15.87:0/1187422633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7daedefc0 msgr2=0x55a7daeed850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:02.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.746+0000 7f6ba7fff640 1 --2- 172.21.15.87:0/1187422633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7daedefc0 0x55a7daeed850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.746+0000 7f6ba7fff640 1 -- 172.21.15.87:0/1187422633 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7dadfe970 con 0x55a7daede6a0 2024-09-13T17:22:02.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.746+0000 7f6baffff640 1 --2- 172.21.15.87:0/1187422633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7daedefc0 0x55a7daeed850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:22:02.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.746+0000 7f6badffb640 1 --2- 172.21.15.87:0/1140873424 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f6b9c0a1200 0x7f6b9c0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.746+0000 7f6ba7fff640 1 --2- 172.21.15.87:0/1187422633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a7daede6a0 0x55a7daedea80 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f6b980057c0 tx=0x7f6b98005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cbc7f4f83a443ac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:02.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.746+0000 7f6baffff640 1 --2- 172.21.15.87:0/1140873424 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f6b9c0a1200 0x7f6b9c0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:02.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.746+0000 7f6ba67fc640 1 -- 172.21.15.87:0/1187422633 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b98031580 con 0x55a7daede6a0 2024-09-13T17:22:02.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.746+0000 7f6badffb640 1 -- 172.21.15.87:0/1140873424 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f6ba80ccdb0 con 0x7f6bb019ac90 2024-09-13T17:22:02.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.746+0000 7f6ba67fc640 1 -- 172.21.15.87:0/1187422633 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6b980044d0 con 0x55a7daede6a0 2024-09-13T17:22:02.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.746+0000 7f6ba67fc640 1 -- 172.21.15.87:0/1187422633 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b980046c0 con 0x55a7daede6a0 2024-09-13T17:22:02.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.747+0000 7f6bb9259740 1 -- 172.21.15.87:0/1187422633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a7daede6a0 msgr2=0x55a7daedea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:02.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.747+0000 7f6baffff640 1 --2- 172.21.15.87:0/1140873424 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f6b9c0a1200 0x7f6b9c0a36c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00058c0 tx=0x7f6ba000a2d0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:02.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.747+0000 7f6bb9259740 1 --2- 172.21.15.87:0/1187422633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a7daede6a0 0x55a7daedea80 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f6b980057c0 tx=0x7f6b98005d50 comp rx=0 tx=0).stop 2024-09-13T17:22:02.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.747+0000 7f6bb9259740 1 -- 172.21.15.87:0/1187422633 shutdown_connections 2024-09-13T17:22:02.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.747+0000 7f6bb9259740 1 --2- 172.21.15.87:0/1187422633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a7daeedd90 0x55a7daef0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.747+0000 7f6bb9259740 1 --2- 172.21.15.87:0/1187422633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7daedefc0 0x55a7daeed850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.747+0000 7f6bb9259740 1 --2- 172.21.15.87:0/1187422633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a7daede6a0 0x55a7daedea80 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.747+0000 7f6bb9259740 1 -- 172.21.15.87:0/1187422633 >> 172.21.15.87:0/1187422633 conn(0x55a7daedad50 msgr2=0x55a7daedb130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:02.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.747+0000 7f6bb9259740 1 -- 172.21.15.87:0/1187422633 shutdown_connections 2024-09-13T17:22:02.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.747+0000 7f6bb9259740 1 -- 172.21.15.87:0/1187422633 wait complete. 2024-09-13T17:22:02.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.747+0000 7f6bb9259740 1 -- start start 2024-09-13T17:22:02.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.748+0000 7f6bb9259740 1 Processor -- start 2024-09-13T17:22:02.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.748+0000 7f6bb9259740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a7daede6a0 0x55a7daeed720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.748+0000 7f6bb9259740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a7daedefc0 0x55a7daeea9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.748+0000 7f6bb9259740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7daeedd90 0x55a7daeeaf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.748+0000 7f6bb9259740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7dae00f80 con 0x55a7daedefc0 2024-09-13T17:22:02.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.748+0000 7f6bb9259740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7dae00c20 con 0x55a7daeedd90 2024-09-13T17:22:02.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.748+0000 7f6bb9259740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7dadcdab0 con 0x55a7daede6a0 2024-09-13T17:22:02.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.748+0000 7f6bb9259740 10 client.0 _ll_register_callbacks cb 0x55a7dae3c350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:22:02.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.748+0000 7f6ba7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a7daedefc0 0x55a7daeea9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:02.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.748+0000 7f6ba7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a7daedefc0 0x55a7daeea9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49740/0 (socket says 172.21.15.87:49740) 2024-09-13T17:22:02.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.748+0000 7f6ba7fff640 1 -- 172.21.15.87:0/787633664 learned_addr learned my addr 172.21.15.87:0/787633664 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:02.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.748+0000 7f6baffff640 1 --2- 172.21.15.87:0/787633664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a7daede6a0 0x55a7daeed720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:02.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.748+0000 7f6bb4ad0640 1 --2- 172.21.15.87:0/787633664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7daeedd90 0x55a7daeeaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:02.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.748+0000 7f6ba7fff640 1 -- 172.21.15.87:0/787633664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a7daede6a0 msgr2=0x55a7daeed720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:02.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.748+0000 7f6ba7fff640 1 --2- 172.21.15.87:0/787633664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a7daede6a0 0x55a7daeed720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.748+0000 7f6ba7fff640 1 -- 172.21.15.87:0/787633664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7daeedd90 msgr2=0x55a7daeeaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:02.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.748+0000 7f6ba7fff640 1 --2- 172.21.15.87:0/787633664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7daeedd90 0x55a7daeeaf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.748+0000 7f6ba7fff640 1 -- 172.21.15.87:0/787633664 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb0068570 con 0x55a7daedefc0 2024-09-13T17:22:02.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.749+0000 7f6ba7fff640 1 --2- 172.21.15.87:0/787633664 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a7daedefc0 0x55a7daeea9a0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f6b98009900 tx=0x7f6b98005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68efc14405355d8a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:02.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.749+0000 7f6b8f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:22:02.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.749+0000 7f6b8f7fe640 1 -- 172.21.15.87:0/787633664 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b98049440 con 0x55a7daedefc0 2024-09-13T17:22:02.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.749+0000 7f6b8f7fe640 1 -- 172.21.15.87:0/787633664 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f6b980495a0 con 0x55a7daedefc0 2024-09-13T17:22:02.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.749+0000 7f6bb9259740 1 -- 172.21.15.87:0/787633664 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a7dab36590 con 0x55a7daedefc0 2024-09-13T17:22:02.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.749+0000 7f6b8f7fe640 1 -- 172.21.15.87:0/787633664 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b98049760 con 0x55a7daedefc0 2024-09-13T17:22:02.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.749+0000 7f6bb9259740 10 client.17781 fetch_fsmap learned FSMap version 36 2024-09-13T17:22:02.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.749+0000 7f6bb9259740 1 -- 172.21.15.87:0/787633664 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55a7dae41360 con 0x55a7daedefc0 2024-09-13T17:22:02.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.749+0000 7f6b8f7fe640 1 -- 172.21.15.87:0/787633664 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55a7dab36590 con 0x55a7daedefc0 2024-09-13T17:22:02.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.749+0000 7f6b8f7fe640 1 -- 172.21.15.87:0/787633664 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f6b9803aa30 con 0x55a7daedefc0 2024-09-13T17:22:02.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.749+0000 7f6bb9259740 10 client.17781 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:22:02.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.749+0000 7f6bb9259740 10 client.17781 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:22:02.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.749+0000 7f6bb9259740 20 client.17781 populate_metadata read hostname 'smithi087' 2024-09-13T17:22:02.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.749+0000 7f6bb9259740 1 --2- 172.21.15.87:0/787633664 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55a7daefd7d0 0x55a7daeffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.749+0000 7f6bb9259740 4 client.17781 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:22:02.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.749+0000 7f6bb9259740 1 -- 172.21.15.87:0/787633664 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a7dab47860 con 0x55a7daefd7d0 2024-09-13T17:22:02.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.749+0000 7f6baffff640 1 --2- 172.21.15.87:0/787633664 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55a7daefd7d0 0x55a7daeffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:02.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.750+0000 7f6baffff640 1 --2- 172.21.15.87:0/787633664 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55a7daefd7d0 0x55a7daeffbf0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73cfe9695e8c3409 server_cookie=bb39d0a8347f5772 in_seq=0 out_seq=0 2024-09-13T17:22:02.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.750+0000 7f6b8f7fe640 10 client.17781 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:22:02.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.750+0000 7f6b8f7fe640 1 -- 172.21.15.87:0/787633664 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55a7dab47860 con 0x55a7daefd7d0 2024-09-13T17:22:02.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.750+0000 7f6b8f7fe640 10 client.17781 handle_command_reply: tid=0 2024-09-13T17:22:02.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.750+0000 7f6bb9259740 1 client.17781 shutdown 2024-09-13T17:22:02.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.750+0000 7f6bb9259740 1 -- 172.21.15.87:0/787633664 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a7daedefc0 msgr2=0x55a7daeea9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:02.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.750+0000 7f6bb9259740 1 --2- 172.21.15.87:0/787633664 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a7daedefc0 0x55a7daeea9a0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f6b98009900 tx=0x7f6b98005a20 comp rx=0 tx=0).stop 2024-09-13T17:22:02.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.750+0000 7f6bb9259740 1 -- 172.21.15.87:0/787633664 shutdown_connections 2024-09-13T17:22:02.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.750+0000 7f6bb9259740 1 --2- 172.21.15.87:0/787633664 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55a7daefd7d0 0x55a7daeffbf0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.750+0000 7f6bb9259740 1 --2- 172.21.15.87:0/787633664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7daeedd90 0x55a7daeeaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.750+0000 7f6bb9259740 1 --2- 172.21.15.87:0/787633664 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a7daedefc0 0x55a7daeea9a0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.750+0000 7f6b8f7fe640 0 client.17781 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:22:02.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.750+0000 7f6bb9259740 1 --2- 172.21.15.87:0/787633664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a7daede6a0 0x55a7daeed720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.750+0000 7f6bb9259740 1 -- 172.21.15.87:0/787633664 >> 172.21.15.87:0/787633664 conn(0x55a7daedad50 msgr2=0x55a7daeda160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:02.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.751+0000 7f6bb9259740 1 -- 172.21.15.87:0/787633664 shutdown_connections 2024-09-13T17:22:02.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.751+0000 7f6bb9259740 1 -- 172.21.15.87:0/787633664 wait complete. 2024-09-13T17:22:02.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.751+0000 7f6bb9259740 20 client.17781 trim_cache size 0 max 16384 2024-09-13T17:22:02.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.764+0000 7f6bb9259740 1 Processor -- start 2024-09-13T17:22:02.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.765+0000 7f6bb9259740 1 -- start start 2024-09-13T17:22:02.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.765+0000 7f6bb9259740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a7daede6a0 0x55a7daee9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.765+0000 7f6bb9259740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7daedefc0 0x55a7daee9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.765+0000 7f6bb9259740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a7daeedd90 0x55a7daeea240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.765+0000 7f6bb9259740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7dab36590 con 0x55a7daeedd90 2024-09-13T17:22:02.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.765+0000 7f6bb9259740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7daefa850 con 0x55a7daedefc0 2024-09-13T17:22:02.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.765+0000 7f6bb9259740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7daeebe30 con 0x55a7daede6a0 2024-09-13T17:22:02.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.765+0000 7f6bb4ad0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a7daeedd90 0x55a7daeea240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:02.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.765+0000 7f6bb4ad0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a7daeedd90 0x55a7daeea240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49742/0 (socket says 172.21.15.87:49742) 2024-09-13T17:22:02.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.765+0000 7f6bb4ad0640 1 -- 172.21.15.87:0/1566240333 learned_addr learned my addr 172.21.15.87:0/1566240333 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:02.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.765+0000 7f6ba7fff640 1 --2- 172.21.15.87:0/1566240333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7daedefc0 0x55a7daee9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:02.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.765+0000 7f6baffff640 1 --2- 172.21.15.87:0/1566240333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a7daede6a0 0x55a7daee9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:02.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.765+0000 7f6bb4ad0640 1 -- 172.21.15.87:0/1566240333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a7daede6a0 msgr2=0x55a7daee9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:02.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.765+0000 7f6bb4ad0640 1 --2- 172.21.15.87:0/1566240333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a7daede6a0 0x55a7daee9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.765+0000 7f6bb4ad0640 1 -- 172.21.15.87:0/1566240333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7daedefc0 msgr2=0x55a7daee9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:02.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.765+0000 7f6bb4ad0640 1 --2- 172.21.15.87:0/1566240333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7daedefc0 0x55a7daee9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.765+0000 7f6bb4ad0640 1 -- 172.21.15.87:0/1566240333 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7dade31c0 con 0x55a7daeedd90 2024-09-13T17:22:02.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.765+0000 7f6bb4ad0640 1 --2- 172.21.15.87:0/1566240333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a7daeedd90 0x55a7daeea240 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f6ba80997b0 tx=0x7f6ba8099410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6010dfb06783306 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:02.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.765+0000 7f6ba6ffd640 1 -- 172.21.15.87:0/1566240333 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba8099ab0 con 0x55a7daeedd90 2024-09-13T17:22:02.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.765+0000 7f6ba6ffd640 1 -- 172.21.15.87:0/1566240333 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6ba809d8e0 con 0x55a7daeedd90 2024-09-13T17:22:02.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.765+0000 7f6ba6ffd640 1 -- 172.21.15.87:0/1566240333 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba8098fa0 con 0x55a7daeedd90 2024-09-13T17:22:02.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.766+0000 7f6bb9259740 1 -- 172.21.15.87:0/1566240333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a7daeedd90 msgr2=0x55a7daeea240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:02.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.766+0000 7f6bb9259740 1 --2- 172.21.15.87:0/1566240333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a7daeedd90 0x55a7daeea240 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f6ba80997b0 tx=0x7f6ba8099410 comp rx=0 tx=0).stop 2024-09-13T17:22:02.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.766+0000 7f6bb9259740 1 -- 172.21.15.87:0/1566240333 shutdown_connections 2024-09-13T17:22:02.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.766+0000 7f6bb9259740 1 --2- 172.21.15.87:0/1566240333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a7daeedd90 0x55a7daeea240 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.766+0000 7f6bb9259740 1 --2- 172.21.15.87:0/1566240333 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7daedefc0 0x55a7daee9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.766+0000 7f6bb9259740 1 --2- 172.21.15.87:0/1566240333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a7daede6a0 0x55a7daee9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.766+0000 7f6bb9259740 1 -- 172.21.15.87:0/1566240333 >> 172.21.15.87:0/1566240333 conn(0x55a7daedad50 msgr2=0x55a7daee5c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:02.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.766+0000 7f6bb9259740 1 -- 172.21.15.87:0/1566240333 shutdown_connections 2024-09-13T17:22:02.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.766+0000 7f6bb9259740 1 -- 172.21.15.87:0/1566240333 wait complete. 2024-09-13T17:22:02.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.766+0000 7f6bb9259740 1 -- start start 2024-09-13T17:22:02.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.766+0000 7f6bb9259740 1 Processor -- start 2024-09-13T17:22:02.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.767+0000 7f6bb9259740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7daede6a0 0x55a7daf4e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.767+0000 7f6bb9259740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a7daedefc0 0x55a7daf4e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.767+0000 7f6bb9259740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a7daeedd90 0x55a7daef1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.767+0000 7f6bb9259740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7daef23f0 con 0x55a7daeedd90 2024-09-13T17:22:02.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.767+0000 7f6bb9259740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7daef2560 con 0x55a7daede6a0 2024-09-13T17:22:02.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.767+0000 7f6bb9259740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7daef2720 con 0x55a7daedefc0 2024-09-13T17:22:02.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.767+0000 7f6bb9259740 10 client.0 _ll_register_callbacks cb 0x7f6ba000a590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:22:02.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.767+0000 7f6bb4ad0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a7daeedd90 0x55a7daef1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:02.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.767+0000 7f6baffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7daede6a0 0x55a7daf4e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:02.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.767+0000 7f6bb4ad0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a7daeedd90 0x55a7daef1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49752/0 (socket says 172.21.15.87:49752) 2024-09-13T17:22:02.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.767+0000 7f6bb4ad0640 1 -- 172.21.15.87:0/1349590283 learned_addr learned my addr 172.21.15.87:0/1349590283 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:02.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.767+0000 7f6ba7fff640 1 --2- 172.21.15.87:0/1349590283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a7daedefc0 0x55a7daf4e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:02.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.767+0000 7f6bb4ad0640 1 -- 172.21.15.87:0/1349590283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a7daedefc0 msgr2=0x55a7daf4e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:02.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.767+0000 7f6bb4ad0640 1 --2- 172.21.15.87:0/1349590283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a7daedefc0 0x55a7daf4e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.767+0000 7f6bb4ad0640 1 -- 172.21.15.87:0/1349590283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7daede6a0 msgr2=0x55a7daf4e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:02.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.767+0000 7f6bb4ad0640 1 --2- 172.21.15.87:0/1349590283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7daede6a0 0x55a7daf4e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.767+0000 7f6bb4ad0640 1 -- 172.21.15.87:0/1349590283 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb01a3370 con 0x55a7daeedd90 2024-09-13T17:22:02.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.767+0000 7f6baffff640 1 --2- 172.21.15.87:0/1349590283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7daede6a0 0x55a7daf4e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:22:02.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.767+0000 7f6bb4ad0640 1 --2- 172.21.15.87:0/1349590283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a7daeedd90 0x55a7daef1d70 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f6ba80ca6f0 tx=0x7f6ba809a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de569a3b95f8bde6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:02.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.767+0000 7f6b8f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:22:02.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.767+0000 7f6b8f7fe640 1 -- 172.21.15.87:0/1349590283 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba8099ab0 con 0x55a7daeedd90 2024-09-13T17:22:02.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.767+0000 7f6b8f7fe640 1 -- 172.21.15.87:0/1349590283 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f6ba80b2260 con 0x55a7daeedd90 2024-09-13T17:22:02.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.767+0000 7f6bb9259740 1 -- 172.21.15.87:0/1349590283 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6b980044d0 con 0x55a7daeedd90 2024-09-13T17:22:02.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.767+0000 7f6b8f7fe640 1 -- 172.21.15.87:0/1349590283 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ba80b2420 con 0x55a7daeedd90 2024-09-13T17:22:02.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.767+0000 7f6bb9259740 10 client.17787 fetch_fsmap learned FSMap version 36 2024-09-13T17:22:02.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.767+0000 7f6bb9259740 1 -- 172.21.15.87:0/1349590283 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55a7dae08990 con 0x55a7daeedd90 2024-09-13T17:22:02.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.768+0000 7f6b8f7fe640 1 -- 172.21.15.87:0/1349590283 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6b980044d0 con 0x55a7daeedd90 2024-09-13T17:22:02.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.768+0000 7f6b8f7fe640 1 -- 172.21.15.87:0/1349590283 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f6ba8084040 con 0x55a7daeedd90 2024-09-13T17:22:02.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.768+0000 7f6bb9259740 10 client.17787 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:22:02.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.768+0000 7f6bb9259740 10 client.17787 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:22:02.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.768+0000 7f6bb9259740 20 client.17787 populate_metadata read hostname 'smithi087' 2024-09-13T17:22:02.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.768+0000 7f6bb9259740 1 --2- 172.21.15.87:0/1349590283 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55a7daf55b30 0x55a7daf57f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.768+0000 7f6bb9259740 4 client.17787 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-13T17:22:02.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.768+0000 7f6bb9259740 1 -- 172.21.15.87:0/1349590283 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55a7dab9aeb0 con 0x55a7daf55b30 2024-09-13T17:22:02.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.768+0000 7f6baffff640 1 --2- 172.21.15.87:0/1349590283 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55a7daf55b30 0x55a7daf57f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:02.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.768+0000 7f6b8f7fe640 10 client.17787 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:22:02.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.768+0000 7f6baffff640 1 --2- 172.21.15.87:0/1349590283 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55a7daf55b30 0x55a7daf57f20 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a374a38c6f6a9f52 server_cookie=f4fd4e2ef03e7405 in_seq=0 out_seq=0 2024-09-13T17:22:02.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.769+0000 7f6b8f7fe640 1 -- 172.21.15.87:0/1349590283 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55a7dab9aeb0 con 0x55a7daf55b30 2024-09-13T17:22:02.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.769+0000 7f6b8f7fe640 10 client.17787 handle_command_reply: tid=0 2024-09-13T17:22:02.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.769+0000 7f6bb9259740 1 client.17787 shutdown 2024-09-13T17:22:02.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.770+0000 7f6bb9259740 1 -- 172.21.15.87:0/1349590283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a7daeedd90 msgr2=0x55a7daef1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:02.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.770+0000 7f6bb9259740 1 --2- 172.21.15.87:0/1349590283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a7daeedd90 0x55a7daef1d70 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f6ba80ca6f0 tx=0x7f6ba809a270 comp rx=0 tx=0).stop 2024-09-13T17:22:02.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.770+0000 7f6bb9259740 1 -- 172.21.15.87:0/1349590283 shutdown_connections 2024-09-13T17:22:02.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.770+0000 7f6bb9259740 1 --2- 172.21.15.87:0/1349590283 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55a7daf55b30 0x55a7daf57f20 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.770+0000 7f6bb9259740 1 --2- 172.21.15.87:0/1349590283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a7daeedd90 0x55a7daef1d70 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.770+0000 7f6b8f7fe640 0 client.17787 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:22:02.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.770+0000 7f6bb9259740 1 --2- 172.21.15.87:0/1349590283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a7daedefc0 0x55a7daf4e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.770+0000 7f6bb9259740 1 --2- 172.21.15.87:0/1349590283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7daede6a0 0x55a7daf4e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.770+0000 7f6bb9259740 1 -- 172.21.15.87:0/1349590283 >> 172.21.15.87:0/1349590283 conn(0x55a7daedad50 msgr2=0x55a7daee9190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:02.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.770+0000 7f6bb9259740 1 -- 172.21.15.87:0/1349590283 shutdown_connections 2024-09-13T17:22:02.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.770+0000 7f6bb9259740 1 -- 172.21.15.87:0/1349590283 wait complete. 2024-09-13T17:22:02.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.770+0000 7f6bb9259740 20 client.17787 trim_cache size 0 max 16384 2024-09-13T17:22:02.778 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:22:02.778 INFO:teuthology.orchestra.run.smithi087.stdout: "return_code": 0, 2024-09-13T17:22:02.778 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_tag": "2cd2ccb4-faf0-43b2-99af-68ec80c272a5", 2024-09-13T17:22:02.778 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": "asynchronous" 2024-09-13T17:22:02.778 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:22:02.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.770+0000 7f6bb6533640 1 -- 172.21.15.87:0/1140873424 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f6b9c0a1200 msgr2=0x7f6b9c0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:02.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.770+0000 7f6bb6533640 1 --2- 172.21.15.87:0/1140873424 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f6b9c0a1200 0x7f6b9c0a36c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00058c0 tx=0x7f6ba000a2d0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.770+0000 7f6bb6533640 1 -- 172.21.15.87:0/1140873424 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6bb019ac90 msgr2=0x7f6bb019b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:02.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.770+0000 7f6bb6533640 1 --2- 172.21.15.87:0/1140873424 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6bb019ac90 0x7f6bb019b140 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8009fd0 tx=0x7f6ba800b260 comp rx=0 tx=0).stop 2024-09-13T17:22:02.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.770+0000 7f6bb6533640 1 -- 172.21.15.87:0/1140873424 shutdown_connections 2024-09-13T17:22:02.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.770+0000 7f6bb6533640 1 --2- 172.21.15.87:0/1140873424 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f6b9c0a1200 0x7f6b9c0a36c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.770+0000 7f6bb6533640 1 --2- 172.21.15.87:0/1140873424 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6bb019ac90 0x7f6bb019b140 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.770+0000 7f6bb6533640 1 --2- 172.21.15.87:0/1140873424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bb0103fa0 0x7f6bb01968a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.770+0000 7f6bb6533640 1 --2- 172.21.15.87:0/1140873424 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6bb00fee50 0x7f6bb0196360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.770+0000 7f6bb6533640 1 -- 172.21.15.87:0/1140873424 >> 172.21.15.87:0/1140873424 conn(0x7f6bb00fa8c0 msgr2=0x7f6bb00fbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:02.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.770+0000 7f6bb6533640 1 -- 172.21.15.87:0/1140873424 shutdown_connections 2024-09-13T17:22:02.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.770+0000 7f6bb6533640 1 -- 172.21.15.87:0/1140873424 wait complete. 2024-09-13T17:22:02.782 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:22:02.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.922+0000 7f7281be9640 1 -- 172.21.15.87:0/391184330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f727c10a2d0 msgr2=0x7f727c10c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:02.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.922+0000 7f7281be9640 1 --2- 172.21.15.87:0/391184330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f727c10a2d0 0x7f727c10c790 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f7274009900 tx=0x7f727402a480 comp rx=0 tx=0).stop 2024-09-13T17:22:02.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.922+0000 7f7281be9640 1 -- 172.21.15.87:0/391184330 shutdown_connections 2024-09-13T17:22:02.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.922+0000 7f7281be9640 1 --2- 172.21.15.87:0/391184330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f727c10a2d0 0x7f727c10c790 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.922+0000 7f7281be9640 1 --2- 172.21.15.87:0/391184330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f727c1017d0 0x7f727c109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.922+0000 7f7281be9640 1 --2- 172.21.15.87:0/391184330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f727c100eb0 0x7f727c101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.922+0000 7f7281be9640 1 -- 172.21.15.87:0/391184330 >> 172.21.15.87:0/391184330 conn(0x7f727c0fa8c0 msgr2=0x7f727c0fcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:02.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.922+0000 7f7281be9640 1 -- 172.21.15.87:0/391184330 shutdown_connections 2024-09-13T17:22:02.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.922+0000 7f7281be9640 1 -- 172.21.15.87:0/391184330 wait complete. 2024-09-13T17:22:02.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.923+0000 7f7281be9640 1 Processor -- start 2024-09-13T17:22:02.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.923+0000 7f7281be9640 1 -- start start 2024-09-13T17:22:02.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.923+0000 7f7281be9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f727c100eb0 0x7f727c1962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.923+0000 7f7281be9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f727c1017d0 0x7f727c1967e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.923+0000 7f7281be9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f727c10a2d0 0x7f727c19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.923+0000 7f7281be9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727c19b180 con 0x7f727c10a2d0 2024-09-13T17:22:02.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.923+0000 7f7281be9640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727c19b2f0 con 0x7f727c100eb0 2024-09-13T17:22:02.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.923+0000 7f7281be9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727c19b4b0 con 0x7f727c1017d0 2024-09-13T17:22:02.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.923+0000 7f727bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f727c10a2d0 0x7f727c19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:02.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.923+0000 7f727bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f727c10a2d0 0x7f727c19ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49776/0 (socket says 172.21.15.87:49776) 2024-09-13T17:22:02.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.923+0000 7f727bfff640 1 -- 172.21.15.87:0/2568578481 learned_addr learned my addr 172.21.15.87:0/2568578481 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:02.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.924+0000 7f727affd640 1 --2- 172.21.15.87:0/2568578481 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f727c1017d0 0x7f727c1967e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:02.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.924+0000 7f727b7fe640 1 --2- 172.21.15.87:0/2568578481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f727c100eb0 0x7f727c1962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:02.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.924+0000 7f727bfff640 1 -- 172.21.15.87:0/2568578481 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f727c1017d0 msgr2=0x7f727c1967e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:02.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.924+0000 7f727bfff640 1 --2- 172.21.15.87:0/2568578481 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f727c1017d0 0x7f727c1967e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.924+0000 7f727bfff640 1 -- 172.21.15.87:0/2568578481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f727c100eb0 msgr2=0x7f727c1962a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:02.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.924+0000 7f727bfff640 1 --2- 172.21.15.87:0/2568578481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f727c100eb0 0x7f727c1962a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.924+0000 7f727bfff640 1 -- 172.21.15.87:0/2568578481 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7274009560 con 0x7f727c10a2d0 2024-09-13T17:22:02.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.924+0000 7f727b7fe640 1 --2- 172.21.15.87:0/2568578481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f727c100eb0 0x7f727c1962a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:22:02.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.924+0000 7f727bfff640 1 --2- 172.21.15.87:0/2568578481 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f727c10a2d0 0x7f727c19ab80 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f7274005ab0 tx=0x7f7274004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:02.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.924+0000 7f7278ff9640 1 -- 172.21.15.87:0/2568578481 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7274003a00 con 0x7f727c10a2d0 2024-09-13T17:22:02.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.924+0000 7f7278ff9640 1 -- 172.21.15.87:0/2568578481 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7274003b60 con 0x7f727c10a2d0 2024-09-13T17:22:02.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.924+0000 7f7281be9640 1 -- 172.21.15.87:0/2568578481 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f727c19b730 con 0x7f727c10a2d0 2024-09-13T17:22:02.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.924+0000 7f7278ff9640 1 -- 172.21.15.87:0/2568578481 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727403a3c0 con 0x7f727c10a2d0 2024-09-13T17:22:02.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.924+0000 7f7281be9640 1 -- 172.21.15.87:0/2568578481 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f727c19ba00 con 0x7f727c10a2d0 2024-09-13T17:22:02.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.926+0000 7f7278ff9640 1 -- 172.21.15.87:0/2568578481 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f7274003cd0 con 0x7f727c10a2d0 2024-09-13T17:22:02.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.927+0000 7f72849e7740 1 Processor -- start 2024-09-13T17:22:02.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.927+0000 7f72849e7740 1 -- start start 2024-09-13T17:22:02.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.927+0000 7f72849e7740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc4dfc3cf0 0x55cc4dfc40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.927+0000 7f72849e7740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cc4dfc4610 0x55cc4dfd2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.927+0000 7f72849e7740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cc4dfd33e0 0x55cc4dfd57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.927+0000 7f72849e7740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc4df2ef20 con 0x55cc4dfc3cf0 2024-09-13T17:22:02.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.927+0000 7f72849e7740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc4df2c6b0 con 0x55cc4dfc4610 2024-09-13T17:22:02.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.927+0000 7f72849e7740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc4df27fa0 con 0x55cc4dfd33e0 2024-09-13T17:22:02.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.927+0000 7f7278ff9640 1 --2- 172.21.15.87:0/2568578481 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f72640a1200 0x7f72640a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.927+0000 7f727affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc4dfc3cf0 0x55cc4dfc40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:02.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.927+0000 7f727bfff640 1 --2- 172.21.15.87:0/2568578481 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f72640a1200 0x7f72640a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:02.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.927+0000 7f727affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc4dfc3cf0 0x55cc4dfc40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49790/0 (socket says 172.21.15.87:49790) 2024-09-13T17:22:02.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.927+0000 7f727affd640 1 -- 172.21.15.87:0/2424391745 learned_addr learned my addr 172.21.15.87:0/2424391745 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:02.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.927+0000 7f727b7fe640 1 --2- 172.21.15.87:0/2424391745 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cc4dfc4610 0x55cc4dfd2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:02.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.927+0000 7f7278ff9640 1 -- 172.21.15.87:0/2568578481 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f72740edfb0 con 0x7f727c10a2d0 2024-09-13T17:22:02.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.927+0000 7f727affd640 1 --2- 172.21.15.87:0/2424391745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cc4dfd33e0 0x55cc4dfd57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:02.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.927+0000 7f727affd640 1 -- 172.21.15.87:0/2424391745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cc4dfd33e0 msgr2=0x55cc4dfd57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:02.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.927+0000 7f727affd640 1 --2- 172.21.15.87:0/2424391745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cc4dfd33e0 0x55cc4dfd57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.927+0000 7f727affd640 1 -- 172.21.15.87:0/2424391745 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cc4dfc4610 msgr2=0x55cc4dfd2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:02.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.927+0000 7f727affd640 1 --2- 172.21.15.87:0/2424391745 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cc4dfc4610 0x55cc4dfd2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.927+0000 7f727affd640 1 -- 172.21.15.87:0/2424391745 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc4dee2840 con 0x55cc4dfc3cf0 2024-09-13T17:22:02.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.927+0000 7f727bfff640 1 --2- 172.21.15.87:0/2568578481 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f72640a1200 0x7f72640a36c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f72740ba9b0 tx=0x7f72740be040 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:02.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.927+0000 7f727affd640 1 --2- 172.21.15.87:0/2424391745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc4dfc3cf0 0x55cc4dfc40d0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f727000ce10 tx=0x7f727000c5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98193b1ae08c4e5d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:02.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.928+0000 7f7261ffb640 1 -- 172.21.15.87:0/2424391745 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7270012660 con 0x55cc4dfc3cf0 2024-09-13T17:22:02.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.928+0000 7f7261ffb640 1 -- 172.21.15.87:0/2424391745 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7270016070 con 0x55cc4dfc3cf0 2024-09-13T17:22:02.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.928+0000 7f7261ffb640 1 -- 172.21.15.87:0/2424391745 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727000ea90 con 0x55cc4dfc3cf0 2024-09-13T17:22:02.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.928+0000 7f72849e7740 1 -- 172.21.15.87:0/2424391745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc4dfc3cf0 msgr2=0x55cc4dfc40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:02.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.928+0000 7f72849e7740 1 --2- 172.21.15.87:0/2424391745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc4dfc3cf0 0x55cc4dfc40d0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f727000ce10 tx=0x7f727000c5c0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.928+0000 7f72849e7740 1 -- 172.21.15.87:0/2424391745 shutdown_connections 2024-09-13T17:22:02.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.928+0000 7f72849e7740 1 --2- 172.21.15.87:0/2424391745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cc4dfd33e0 0x55cc4dfd57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.928+0000 7f72849e7740 1 --2- 172.21.15.87:0/2424391745 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cc4dfc4610 0x55cc4dfd2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.928+0000 7f72849e7740 1 --2- 172.21.15.87:0/2424391745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc4dfc3cf0 0x55cc4dfc40d0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.928+0000 7f72849e7740 1 -- 172.21.15.87:0/2424391745 >> 172.21.15.87:0/2424391745 conn(0x55cc4dfc0380 msgr2=0x55cc4dfc0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:02.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.928+0000 7f72849e7740 1 -- 172.21.15.87:0/2424391745 shutdown_connections 2024-09-13T17:22:02.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.928+0000 7f72849e7740 1 -- 172.21.15.87:0/2424391745 wait complete. 2024-09-13T17:22:02.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.929+0000 7f72849e7740 1 -- start start 2024-09-13T17:22:02.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.929+0000 7f72849e7740 1 Processor -- start 2024-09-13T17:22:02.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.929+0000 7f72849e7740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cc4dfc3cf0 0x55cc4dfd2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.929+0000 7f72849e7740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc4dfc4610 0x55cc4dfd0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.929+0000 7f72849e7740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cc4dfd33e0 0x55cc4dfd05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.929+0000 7f72849e7740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc4dec92a0 con 0x55cc4dfc4610 2024-09-13T17:22:02.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.929+0000 7f72849e7740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc4dc00430 con 0x55cc4dfd33e0 2024-09-13T17:22:02.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.929+0000 7f72849e7740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc4deab680 con 0x55cc4dfc3cf0 2024-09-13T17:22:02.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.929+0000 7f72849e7740 10 client.0 _ll_register_callbacks cb 0x55cc4df21610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:22:02.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.929+0000 7f727b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc4dfc4610 0x55cc4dfd0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:02.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.929+0000 7f727b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc4dfc4610 0x55cc4dfd0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49800/0 (socket says 172.21.15.87:49800) 2024-09-13T17:22:02.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.929+0000 7f727b7fe640 1 -- 172.21.15.87:0/1996680689 learned_addr learned my addr 172.21.15.87:0/1996680689 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:02.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.929+0000 7f727affd640 1 --2- 172.21.15.87:0/1996680689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cc4dfd33e0 0x55cc4dfd05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:02.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.929+0000 7f727affd640 1 --2- 172.21.15.87:0/1996680689 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cc4dfc3cf0 0x55cc4dfd2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:02.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.929+0000 7f727b7fe640 1 -- 172.21.15.87:0/1996680689 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cc4dfc3cf0 msgr2=0x55cc4dfd2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:02.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.929+0000 7f727b7fe640 1 --2- 172.21.15.87:0/1996680689 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cc4dfc3cf0 0x55cc4dfd2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.929+0000 7f727b7fe640 1 -- 172.21.15.87:0/1996680689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cc4dfd33e0 msgr2=0x55cc4dfd05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:02.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.929+0000 7f727b7fe640 1 --2- 172.21.15.87:0/1996680689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cc4dfd33e0 0x55cc4dfd05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.929+0000 7f727b7fe640 1 -- 172.21.15.87:0/1996680689 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f727000c980 con 0x55cc4dfc4610 2024-09-13T17:22:02.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.930+0000 7f727b7fe640 1 --2- 172.21.15.87:0/1996680689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc4dfc4610 0x55cc4dfd0000 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f726c00ac50 tx=0x7f726c007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbc22f9da483720d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:02.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.930+0000 7f725affd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:22:02.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.930+0000 7f725affd640 1 -- 172.21.15.87:0/1996680689 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c0165f0 con 0x55cc4dfc4610 2024-09-13T17:22:02.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.930+0000 7f725affd640 1 -- 172.21.15.87:0/1996680689 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f726c016750 con 0x55cc4dfc4610 2024-09-13T17:22:02.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.930+0000 7f72849e7740 1 -- 172.21.15.87:0/1996680689 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cc4dc1b4e0 con 0x55cc4dfc4610 2024-09-13T17:22:02.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.930+0000 7f725affd640 1 -- 172.21.15.87:0/1996680689 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f726c016910 con 0x55cc4dfc4610 2024-09-13T17:22:02.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.930+0000 7f72849e7740 10 client.17799 fetch_fsmap learned FSMap version 36 2024-09-13T17:22:02.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.930+0000 7f72849e7740 1 -- 172.21.15.87:0/1996680689 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55cc4df26620 con 0x55cc4dfc4610 2024-09-13T17:22:02.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.930+0000 7f725affd640 1 -- 172.21.15.87:0/1996680689 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55cc4dc1b4e0 con 0x55cc4dfc4610 2024-09-13T17:22:02.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.930+0000 7f725affd640 1 -- 172.21.15.87:0/1996680689 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f726c008040 con 0x55cc4dfc4610 2024-09-13T17:22:02.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.930+0000 7f72849e7740 10 client.17799 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:22:02.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.930+0000 7f72849e7740 10 client.17799 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:22:02.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.930+0000 7f72849e7740 20 client.17799 populate_metadata read hostname 'smithi087' 2024-09-13T17:22:02.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.930+0000 7f72849e7740 1 --2- 172.21.15.87:0/1996680689 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55cc4dfe32f0 0x55cc4dfe5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.930+0000 7f72849e7740 4 client.17799 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:22:02.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.930+0000 7f72849e7740 1 -- 172.21.15.87:0/1996680689 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cc4dc2c7e0 con 0x55cc4dfe32f0 2024-09-13T17:22:02.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.931+0000 7f727affd640 1 --2- 172.21.15.87:0/1996680689 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55cc4dfe32f0 0x55cc4dfe5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:02.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.931+0000 7f725affd640 10 client.17799 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:22:02.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.931+0000 7f727affd640 1 --2- 172.21.15.87:0/1996680689 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55cc4dfe32f0 0x55cc4dfe5710 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46d648a6211f413e server_cookie=6be7981fb3cbce88 in_seq=0 out_seq=0 2024-09-13T17:22:02.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.931+0000 7f725affd640 1 -- 172.21.15.87:0/1996680689 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55cc4dc2c7e0 con 0x55cc4dfe32f0 2024-09-13T17:22:02.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.931+0000 7f725affd640 10 client.17799 handle_command_reply: tid=0 2024-09-13T17:22:02.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.931+0000 7f72849e7740 1 client.17799 shutdown 2024-09-13T17:22:02.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.932+0000 7f72849e7740 1 -- 172.21.15.87:0/1996680689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc4dfc4610 msgr2=0x55cc4dfd0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:02.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.932+0000 7f72849e7740 1 --2- 172.21.15.87:0/1996680689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc4dfc4610 0x55cc4dfd0000 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f726c00ac50 tx=0x7f726c007680 comp rx=0 tx=0).stop 2024-09-13T17:22:02.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.932+0000 7f72849e7740 1 -- 172.21.15.87:0/1996680689 shutdown_connections 2024-09-13T17:22:02.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.932+0000 7f72849e7740 1 --2- 172.21.15.87:0/1996680689 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55cc4dfe32f0 0x55cc4dfe5710 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.932+0000 7f72849e7740 1 --2- 172.21.15.87:0/1996680689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cc4dfd33e0 0x55cc4dfd05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.932+0000 7f72849e7740 1 --2- 172.21.15.87:0/1996680689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc4dfc4610 0x55cc4dfd0000 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.932+0000 7f72849e7740 1 --2- 172.21.15.87:0/1996680689 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cc4dfc3cf0 0x55cc4dfd2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.932+0000 7f725affd640 0 client.17799 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:22:02.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.932+0000 7f72849e7740 1 -- 172.21.15.87:0/1996680689 >> 172.21.15.87:0/1996680689 conn(0x55cc4dfc0380 msgr2=0x55cc4dfc60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:02.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.932+0000 7f72849e7740 1 -- 172.21.15.87:0/1996680689 shutdown_connections 2024-09-13T17:22:02.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.932+0000 7f72849e7740 1 -- 172.21.15.87:0/1996680689 wait complete. 2024-09-13T17:22:02.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.932+0000 7f72849e7740 20 client.17799 trim_cache size 0 max 16384 2024-09-13T17:22:02.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.946+0000 7f72849e7740 1 Processor -- start 2024-09-13T17:22:02.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.946+0000 7f72849e7740 1 -- start start 2024-09-13T17:22:02.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.946+0000 7f72849e7740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cc4dfc3cf0 0x55cc4dfbfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.946+0000 7f72849e7740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc4dfc4610 0x55cc4dfc0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.946+0000 7f72849e7740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cc4dfd33e0 0x55cc4dfc0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.946+0000 7f72849e7740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc4dfe1b20 con 0x55cc4dfc4610 2024-09-13T17:22:02.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.946+0000 7f72849e7740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc4dfba730 con 0x55cc4dfc3cf0 2024-09-13T17:22:02.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.946+0000 7f72849e7740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc4dfcae40 con 0x55cc4dfd33e0 2024-09-13T17:22:02.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.946+0000 7f727b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc4dfc4610 0x55cc4dfc0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:02.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.946+0000 7f727b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc4dfc4610 0x55cc4dfc0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49816/0 (socket says 172.21.15.87:49816) 2024-09-13T17:22:02.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.946+0000 7f727b7fe640 1 -- 172.21.15.87:0/2240273594 learned_addr learned my addr 172.21.15.87:0/2240273594 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:02.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.946+0000 7f727b7fe640 1 -- 172.21.15.87:0/2240273594 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cc4dfd33e0 msgr2=0x55cc4dfc0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:02.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.946+0000 7f727affd640 1 --2- 172.21.15.87:0/2240273594 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cc4dfd33e0 0x55cc4dfc0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:02.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.946+0000 7f727b7fe640 1 --2- 172.21.15.87:0/2240273594 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cc4dfd33e0 0x55cc4dfc0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.946+0000 7f727b7fe640 1 -- 172.21.15.87:0/2240273594 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cc4dfc3cf0 msgr2=0x55cc4dfbfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:02.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.946+0000 7f727b7fe640 1 --2- 172.21.15.87:0/2240273594 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cc4dfc3cf0 0x55cc4dfbfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.946+0000 7f727b7fe640 1 -- 172.21.15.87:0/2240273594 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc4dec8790 con 0x55cc4dfc4610 2024-09-13T17:22:02.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.946+0000 7f727affd640 1 --2- 172.21.15.87:0/2240273594 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cc4dfd33e0 0x55cc4dfc0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:22:02.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.946+0000 7f727b7fe640 1 --2- 172.21.15.87:0/2240273594 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc4dfc4610 0x55cc4dfc0760 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f726c002230 tx=0x7f726c00a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d38278c5e787a4ae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:02.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.946+0000 7f72627fc640 1 -- 172.21.15.87:0/2240273594 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c007b80 con 0x55cc4dfc4610 2024-09-13T17:22:02.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.946+0000 7f72627fc640 1 -- 172.21.15.87:0/2240273594 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f726c012040 con 0x55cc4dfc4610 2024-09-13T17:22:02.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.946+0000 7f72627fc640 1 -- 172.21.15.87:0/2240273594 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c0144d0 con 0x55cc4dfc4610 2024-09-13T17:22:02.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.947+0000 7f72849e7740 1 -- 172.21.15.87:0/2240273594 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc4dfc4610 msgr2=0x55cc4dfc0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:02.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.947+0000 7f72849e7740 1 --2- 172.21.15.87:0/2240273594 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc4dfc4610 0x55cc4dfc0760 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f726c002230 tx=0x7f726c00a7c0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.947+0000 7f72849e7740 1 -- 172.21.15.87:0/2240273594 shutdown_connections 2024-09-13T17:22:02.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.947+0000 7f72849e7740 1 --2- 172.21.15.87:0/2240273594 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cc4dfd33e0 0x55cc4dfc0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.947+0000 7f72849e7740 1 --2- 172.21.15.87:0/2240273594 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc4dfc4610 0x55cc4dfc0760 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.947+0000 7f72849e7740 1 --2- 172.21.15.87:0/2240273594 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cc4dfc3cf0 0x55cc4dfbfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.947+0000 7f72849e7740 1 -- 172.21.15.87:0/2240273594 >> 172.21.15.87:0/2240273594 conn(0x55cc4dfc0380 msgr2=0x55cc4dfcb300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:02.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.947+0000 7f72849e7740 1 -- 172.21.15.87:0/2240273594 shutdown_connections 2024-09-13T17:22:02.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.947+0000 7f72849e7740 1 -- 172.21.15.87:0/2240273594 wait complete. 2024-09-13T17:22:02.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.947+0000 7f72849e7740 1 -- start start 2024-09-13T17:22:02.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.948+0000 7f72849e7740 1 Processor -- start 2024-09-13T17:22:02.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.948+0000 7f72849e7740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cc4dfc3cf0 0x55cc4dfd6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.948+0000 7f72849e7740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cc4dfc4610 0x55cc4dfd6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.948+0000 7f72849e7740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc4dfd33e0 0x55cc4e0327e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.948+0000 7f72849e7740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc4e032d20 con 0x55cc4dfd33e0 2024-09-13T17:22:02.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.948+0000 7f72849e7740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc4e032e90 con 0x55cc4dfc3cf0 2024-09-13T17:22:02.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.948+0000 7f72849e7740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc4e033000 con 0x55cc4dfc4610 2024-09-13T17:22:02.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.948+0000 7f72849e7740 10 client.0 _ll_register_callbacks cb 0x7f726c009890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:22:02.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.948+0000 7f727affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc4dfd33e0 0x55cc4e0327e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:02.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.948+0000 7f727affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc4dfd33e0 0x55cc4e0327e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49830/0 (socket says 172.21.15.87:49830) 2024-09-13T17:22:02.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.948+0000 7f727affd640 1 -- 172.21.15.87:0/1047406196 learned_addr learned my addr 172.21.15.87:0/1047406196 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:02.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.948+0000 7f727b7fe640 1 --2- 172.21.15.87:0/1047406196 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cc4dfc4610 0x55cc4dfd6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:02.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.948+0000 7f727affd640 1 --2- 172.21.15.87:0/1047406196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cc4dfc3cf0 0x55cc4dfd6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:02.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.948+0000 7f727affd640 1 -- 172.21.15.87:0/1047406196 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cc4dfc4610 msgr2=0x55cc4dfd6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:02.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.948+0000 7f727affd640 1 --2- 172.21.15.87:0/1047406196 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cc4dfc4610 0x55cc4dfd6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.948+0000 7f727affd640 1 -- 172.21.15.87:0/1047406196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cc4dfc3cf0 msgr2=0x55cc4dfd6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:02.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.948+0000 7f727affd640 1 --2- 172.21.15.87:0/1047406196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cc4dfc3cf0 0x55cc4dfd6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.948+0000 7f727affd640 1 -- 172.21.15.87:0/1047406196 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cc4df26620 con 0x55cc4dfd33e0 2024-09-13T17:22:02.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.948+0000 7f727affd640 1 --2- 172.21.15.87:0/1047406196 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc4dfd33e0 0x55cc4e0327e0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f727000c3f0 tx=0x7f727000e670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f90269b736cf471a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:02.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.948+0000 7f725affd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:22:02.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.948+0000 7f725affd640 1 -- 172.21.15.87:0/1047406196 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7270028790 con 0x55cc4dfd33e0 2024-09-13T17:22:02.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.948+0000 7f725affd640 1 -- 172.21.15.87:0/1047406196 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f7270004020 con 0x55cc4dfd33e0 2024-09-13T17:22:02.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.948+0000 7f72849e7740 1 -- 172.21.15.87:0/1047406196 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7270016070 con 0x55cc4dfd33e0 2024-09-13T17:22:02.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.949+0000 7f725affd640 1 -- 172.21.15.87:0/1047406196 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72700288f0 con 0x55cc4dfd33e0 2024-09-13T17:22:02.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.949+0000 7f72849e7740 10 client.17805 fetch_fsmap learned FSMap version 36 2024-09-13T17:22:02.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.949+0000 7f72849e7740 1 -- 172.21.15.87:0/1047406196 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55cc4deedea0 con 0x55cc4dfd33e0 2024-09-13T17:22:02.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.949+0000 7f725affd640 1 -- 172.21.15.87:0/1047406196 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7270030020 con 0x55cc4dfd33e0 2024-09-13T17:22:02.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.949+0000 7f725affd640 1 -- 172.21.15.87:0/1047406196 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f7270026040 con 0x55cc4dfd33e0 2024-09-13T17:22:02.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.949+0000 7f72849e7740 10 client.17805 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:22:02.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.949+0000 7f72849e7740 10 client.17805 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:22:02.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.949+0000 7f72849e7740 20 client.17805 populate_metadata read hostname 'smithi087' 2024-09-13T17:22:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.949+0000 7f72849e7740 1 --2- 172.21.15.87:0/1047406196 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55cc4e03a760 0x55cc4e03cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.949+0000 7f72849e7740 4 client.17805 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:22:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.949+0000 7f72849e7740 1 -- 172.21.15.87:0/1047406196 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55cc4dc7fe30 con 0x55cc4e03a760 2024-09-13T17:22:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.949+0000 7f727b7fe640 1 --2- 172.21.15.87:0/1047406196 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55cc4e03a760 0x55cc4e03cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.949+0000 7f725affd640 10 client.17805 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:22:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.949+0000 7f727b7fe640 1 --2- 172.21.15.87:0/1047406196 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55cc4e03a760 0x55cc4e03cb50 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfdd1aa0ba8d3999 server_cookie=e35d55b67bdae59c in_seq=0 out_seq=0 2024-09-13T17:22:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.950+0000 7f725affd640 1 -- 172.21.15.87:0/1047406196 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55cc4dc7fe30 con 0x55cc4e03a760 2024-09-13T17:22:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.950+0000 7f725affd640 10 client.17805 handle_command_reply: tid=0 2024-09-13T17:22:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.950+0000 7f72849e7740 1 client.17805 shutdown 2024-09-13T17:22:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.950+0000 7f72849e7740 1 -- 172.21.15.87:0/1047406196 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc4dfd33e0 msgr2=0x55cc4e0327e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.950+0000 7f72849e7740 1 --2- 172.21.15.87:0/1047406196 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc4dfd33e0 0x55cc4e0327e0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f727000c3f0 tx=0x7f727000e670 comp rx=0 tx=0).stop 2024-09-13T17:22:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.950+0000 7f72849e7740 1 -- 172.21.15.87:0/1047406196 shutdown_connections 2024-09-13T17:22:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.950+0000 7f72849e7740 1 --2- 172.21.15.87:0/1047406196 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55cc4e03a760 0x55cc4e03cb50 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.950+0000 7f72849e7740 1 --2- 172.21.15.87:0/1047406196 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc4dfd33e0 0x55cc4e0327e0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.950+0000 7f725affd640 0 client.17805 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:22:02.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.950+0000 7f72849e7740 1 --2- 172.21.15.87:0/1047406196 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cc4dfc4610 0x55cc4dfd6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.950+0000 7f72849e7740 1 --2- 172.21.15.87:0/1047406196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cc4dfc3cf0 0x55cc4dfd6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.950+0000 7f72849e7740 1 -- 172.21.15.87:0/1047406196 >> 172.21.15.87:0/1047406196 conn(0x55cc4dfc0380 msgr2=0x55cc4dfcb300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:02.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.950+0000 7f72849e7740 1 -- 172.21.15.87:0/1047406196 shutdown_connections 2024-09-13T17:22:02.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.950+0000 7f72849e7740 1 -- 172.21.15.87:0/1047406196 wait complete. 2024-09-13T17:22:02.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.950+0000 7f72849e7740 20 client.17805 trim_cache size 0 max 16384 2024-09-13T17:22:02.958 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:22:02.958 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-13T17:22:02.958 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": { 2024-09-13T17:22:02.958 INFO:teuthology.orchestra.run.smithi087.stdout: "2cd2ccb4-faf0-43b2-99af-68ec80c272a5": { 2024-09-13T17:22:02.959 INFO:teuthology.orchestra.run.smithi087.stdout: "path": "/", 2024-09-13T17:22:02.959 INFO:teuthology.orchestra.run.smithi087.stdout: "tag": "2cd2ccb4-faf0-43b2-99af-68ec80c272a5", 2024-09-13T17:22:02.959 INFO:teuthology.orchestra.run.smithi087.stdout: "options": "recursive,force" 2024-09-13T17:22:02.959 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:22:02.959 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:22:02.959 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:22:02.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.950+0000 7f7281be9640 1 -- 172.21.15.87:0/2568578481 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f72640a1200 msgr2=0x7f72640a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:02.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.950+0000 7f7281be9640 1 --2- 172.21.15.87:0/2568578481 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f72640a1200 0x7f72640a36c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f72740ba9b0 tx=0x7f72740be040 comp rx=0 tx=0).stop 2024-09-13T17:22:02.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.950+0000 7f7281be9640 1 -- 172.21.15.87:0/2568578481 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f727c10a2d0 msgr2=0x7f727c19ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:02.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.950+0000 7f7281be9640 1 --2- 172.21.15.87:0/2568578481 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f727c10a2d0 0x7f727c19ab80 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f7274005ab0 tx=0x7f7274004360 comp rx=0 tx=0).stop 2024-09-13T17:22:02.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.950+0000 7f7281be9640 1 -- 172.21.15.87:0/2568578481 shutdown_connections 2024-09-13T17:22:02.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.950+0000 7f7281be9640 1 --2- 172.21.15.87:0/2568578481 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f72640a1200 0x7f72640a36c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.950+0000 7f7281be9640 1 --2- 172.21.15.87:0/2568578481 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f727c10a2d0 0x7f727c19ab80 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.950+0000 7f7281be9640 1 --2- 172.21.15.87:0/2568578481 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f727c1017d0 0x7f727c1967e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.950+0000 7f7281be9640 1 --2- 172.21.15.87:0/2568578481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f727c100eb0 0x7f727c1962a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:02.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.950+0000 7f7281be9640 1 -- 172.21.15.87:0/2568578481 >> 172.21.15.87:0/2568578481 conn(0x7f727c0fa8c0 msgr2=0x7f727c0fc160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:02.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.951+0000 7f7281be9640 1 -- 172.21.15.87:0/2568578481 shutdown_connections 2024-09-13T17:22:02.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:02.951+0000 7f7281be9640 1 -- 172.21.15.87:0/2568578481 wait complete. 2024-09-13T17:22:02.962 INFO:tasks.cephfs.filesystem:scrub status for tag:2cd2ccb4-faf0-43b2-99af-68ec80c272a5 - {'path': '/', 'tag': '2cd2ccb4-faf0-43b2-99af-68ec80c272a5', 'options': 'recursive,force'} 2024-09-13T17:22:03.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:03 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:22:03.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:03 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:22:03.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:03 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:22:03.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:03 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:22:03.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:03 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:22:03.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:03 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:22:03.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:03 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:22:03.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:03 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:22:03.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:03 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:22:04.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:04 smithi149 ceph-mon[35496]: scrub queued for path: / 2024-09-13T17:22:04.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:04 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:22:04.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:04 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:22:04.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:04 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:22:04.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:04 smithi149 ceph-mon[35496]: pgmap v254: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-13T17:22:04.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:04 smithi118 ceph-mon[34374]: scrub queued for path: / 2024-09-13T17:22:04.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:04 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:22:04.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:04 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:22:04.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:04 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:22:04.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:04 smithi118 ceph-mon[34374]: pgmap v254: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-13T17:22:04.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:04 smithi087 ceph-mon[30934]: scrub queued for path: / 2024-09-13T17:22:04.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:04 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:22:04.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:04 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:22:04.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:04 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:22:04.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:04 smithi087 ceph-mon[30934]: pgmap v254: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-13T17:22:05.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:05 smithi149 ceph-mon[35496]: scrub summary: idle 2024-09-13T17:22:05.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:05 smithi118 ceph-mon[34374]: scrub summary: idle 2024-09-13T17:22:05.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:05 smithi087 ceph-mon[30934]: scrub summary: idle 2024-09-13T17:22:06.592 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:06 smithi149 ceph-mon[35496]: pgmap v255: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-09-13T17:22:06.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:06 smithi118 ceph-mon[34374]: pgmap v255: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-09-13T17:22:06.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:06 smithi087 ceph-mon[30934]: pgmap v255: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-09-13T17:22:07.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:07 smithi118 ceph-mon[34374]: pgmap v256: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-13T17:22:07.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:07 smithi087 ceph-mon[30934]: pgmap v256: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-13T17:22:08.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:07 smithi149 ceph-mon[35496]: pgmap v256: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-13T17:22:09.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:09 smithi118 ceph-mon[34374]: pgmap v257: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-13T17:22:09.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:09 smithi087 ceph-mon[30934]: pgmap v257: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-13T17:22:10.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:09 smithi149 ceph-mon[35496]: pgmap v257: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-13T17:22:11.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:11 smithi118 ceph-mon[34374]: osdmap e99: 12 total, 12 up, 12 in 2024-09-13T17:22:11.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:11 smithi118 ceph-mon[34374]: pgmap v259: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 9 op/s 2024-09-13T17:22:11.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:11 smithi087 ceph-mon[30934]: osdmap e99: 12 total, 12 up, 12 in 2024-09-13T17:22:11.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:11 smithi087 ceph-mon[30934]: pgmap v259: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 9 op/s 2024-09-13T17:22:12.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:11 smithi149 ceph-mon[35496]: osdmap e99: 12 total, 12 up, 12 in 2024-09-13T17:22:12.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:11 smithi149 ceph-mon[35496]: pgmap v259: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 9 op/s 2024-09-13T17:22:13.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:13 smithi118 ceph-mon[34374]: pgmap v260: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 9 op/s 2024-09-13T17:22:13.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:13 smithi087 ceph-mon[30934]: pgmap v260: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 9 op/s 2024-09-13T17:22:14.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:13 smithi149 ceph-mon[35496]: pgmap v260: 129 pgs: 129 active+clean; 188 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 9 op/s 2024-09-13T17:22:15.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:15 smithi118 ceph-mon[34374]: pgmap v261: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:22:15.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:15 smithi087 ceph-mon[30934]: pgmap v261: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:22:16.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:15 smithi149 ceph-mon[35496]: pgmap v261: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:22:17.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:17 smithi118 ceph-mon[34374]: pgmap v262: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:22:17.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:17 smithi087 ceph-mon[30934]: pgmap v262: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:22:18.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:17 smithi149 ceph-mon[35496]: pgmap v262: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:22:19.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:18 smithi087 ceph-mon[30934]: osdmap e100: 12 total, 12 up, 12 in 2024-09-13T17:22:19.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:18 smithi149 ceph-mon[35496]: osdmap e100: 12 total, 12 up, 12 in 2024-09-13T17:22:19.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:18 smithi118 ceph-mon[34374]: osdmap e100: 12 total, 12 up, 12 in 2024-09-13T17:22:20.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:19 smithi087 ceph-mon[30934]: pgmap v264: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 114 B/s wr, 4 op/s 2024-09-13T17:22:20.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:19 smithi149 ceph-mon[35496]: pgmap v264: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 114 B/s wr, 4 op/s 2024-09-13T17:22:20.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:19 smithi118 ceph-mon[34374]: pgmap v264: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 114 B/s wr, 4 op/s 2024-09-13T17:22:21.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:21 smithi118 ceph-mon[34374]: pgmap v265: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-09-13T17:22:21.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:21 smithi087 ceph-mon[30934]: pgmap v265: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-09-13T17:22:22.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:21 smithi149 ceph-mon[35496]: pgmap v265: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-09-13T17:22:23.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:23 smithi118 ceph-mon[34374]: pgmap v266: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-09-13T17:22:23.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:23 smithi087 ceph-mon[30934]: pgmap v266: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-09-13T17:22:24.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:23 smithi149 ceph-mon[35496]: pgmap v266: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-09-13T17:22:25.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:25 smithi118 ceph-mon[34374]: pgmap v267: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s 2024-09-13T17:22:25.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:25 smithi087 ceph-mon[30934]: pgmap v267: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s 2024-09-13T17:22:26.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:25 smithi149 ceph-mon[35496]: pgmap v267: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s 2024-09-13T17:22:27.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:27 smithi118 ceph-mon[34374]: pgmap v268: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s 2024-09-13T17:22:27.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:27 smithi087 ceph-mon[30934]: pgmap v268: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s 2024-09-13T17:22:28.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:27 smithi149 ceph-mon[35496]: pgmap v268: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s 2024-09-13T17:22:29.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:29 smithi118 ceph-mon[34374]: pgmap v269: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 6 op/s 2024-09-13T17:22:29.894 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:29 smithi149 ceph-mon[35496]: pgmap v269: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 6 op/s 2024-09-13T17:22:29.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:29 smithi087 ceph-mon[30934]: pgmap v269: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 6 op/s 2024-09-13T17:22:31.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:31 smithi118 ceph-mon[34374]: pgmap v270: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:22:31.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:31 smithi087 ceph-mon[30934]: pgmap v270: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:22:32.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:31 smithi149 ceph-mon[35496]: pgmap v270: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:22:32.964 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:22:33.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.075+0000 7f1f5998a640 1 -- 172.21.15.87:0/1426988871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f540ff880 msgr2=0x7f1f541038c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.075+0000 7f1f5998a640 1 --2- 172.21.15.87:0/1426988871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f540ff880 0x7f1f541038c0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f1f44009930 tx=0x7f1f4402a420 comp rx=0 tx=0).stop 2024-09-13T17:22:33.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.075+0000 7f1f5998a640 1 -- 172.21.15.87:0/1426988871 shutdown_connections 2024-09-13T17:22:33.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.075+0000 7f1f5998a640 1 --2- 172.21.15.87:0/1426988871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f54104020 0x7f1f5410bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.075+0000 7f1f5998a640 1 --2- 172.21.15.87:0/1426988871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f540ff880 0x7f1f541038c0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.075+0000 7f1f5998a640 1 --2- 172.21.15.87:0/1426988871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f540feed0 0x7f1f540ff2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.075+0000 7f1f5998a640 1 -- 172.21.15.87:0/1426988871 >> 172.21.15.87:0/1426988871 conn(0x7f1f540fa9a0 msgr2=0x7f1f540fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:33.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.075+0000 7f1f5998a640 1 -- 172.21.15.87:0/1426988871 shutdown_connections 2024-09-13T17:22:33.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.075+0000 7f1f5998a640 1 -- 172.21.15.87:0/1426988871 wait complete. 2024-09-13T17:22:33.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.075+0000 7f1f5998a640 1 Processor -- start 2024-09-13T17:22:33.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.076+0000 7f1f5998a640 1 -- start start 2024-09-13T17:22:33.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.076+0000 7f1f5998a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f540feed0 0x7f1f541970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.076+0000 7f1f5998a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f54104020 0x7f1f54197620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.076+0000 7f1f5998a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f54197b60 0x7f1f541a2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.076+0000 7f1f5998a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f541a2800 con 0x7f1f54197b60 2024-09-13T17:22:33.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.076+0000 7f1f5998a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f541a2970 con 0x7f1f54104020 2024-09-13T17:22:33.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.076+0000 7f1f5998a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f541a2b30 con 0x7f1f540feed0 2024-09-13T17:22:33.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.076+0000 7f1f537fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f54197b60 0x7f1f541a2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.076+0000 7f1f537fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f54197b60 0x7f1f541a2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51886/0 (socket says 172.21.15.87:51886) 2024-09-13T17:22:33.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.076+0000 7f1f537fe640 1 -- 172.21.15.87:0/278036994 learned_addr learned my addr 172.21.15.87:0/278036994 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:33.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.076+0000 7f1f52ffd640 1 --2- 172.21.15.87:0/278036994 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f540feed0 0x7f1f541970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.076+0000 7f1f527fc640 1 --2- 172.21.15.87:0/278036994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f54104020 0x7f1f54197620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.076+0000 7f1f537fe640 1 -- 172.21.15.87:0/278036994 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f540feed0 msgr2=0x7f1f541970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.076+0000 7f1f537fe640 1 --2- 172.21.15.87:0/278036994 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f540feed0 0x7f1f541970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.076+0000 7f1f537fe640 1 -- 172.21.15.87:0/278036994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f54104020 msgr2=0x7f1f54197620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.076+0000 7f1f537fe640 1 --2- 172.21.15.87:0/278036994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f54104020 0x7f1f54197620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.076+0000 7f1f537fe640 1 -- 172.21.15.87:0/278036994 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f44009560 con 0x7f1f54197b60 2024-09-13T17:22:33.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.077+0000 7f1f537fe640 1 --2- 172.21.15.87:0/278036994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f54197b60 0x7f1f541a2160 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c00c970 tx=0x7f1f4c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:33.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.077+0000 7f1f58988640 1 -- 172.21.15.87:0/278036994 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c007bb0 con 0x7f1f54197b60 2024-09-13T17:22:33.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.077+0000 7f1f58988640 1 -- 172.21.15.87:0/278036994 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1f4c007d10 con 0x7f1f54197b60 2024-09-13T17:22:33.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.077+0000 7f1f5998a640 1 -- 172.21.15.87:0/278036994 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f541a2e10 con 0x7f1f54197b60 2024-09-13T17:22:33.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.077+0000 7f1f58988640 1 -- 172.21.15.87:0/278036994 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c0186a0 con 0x7f1f54197b60 2024-09-13T17:22:33.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.077+0000 7f1f5998a640 1 -- 172.21.15.87:0/278036994 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f541a32f0 con 0x7f1f54197b60 2024-09-13T17:22:33.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.079+0000 7f1f58988640 1 -- 172.21.15.87:0/278036994 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f1f4c00f450 con 0x7f1f54197b60 2024-09-13T17:22:33.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.079+0000 7f1f5c6ae740 1 Processor -- start 2024-09-13T17:22:33.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.079+0000 7f1f5c6ae740 1 -- start start 2024-09-13T17:22:33.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.080+0000 7f1f5c6ae740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653a6fede10 0x5653a6fee1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.080+0000 7f1f5c6ae740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653a6fee730 0x5653a6ff8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.080+0000 7f1f5c6ae740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653a6ff8fd0 0x5653a6ffb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.080+0000 7f1f5c6ae740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653a6f58f20 con 0x5653a6fee730 2024-09-13T17:22:33.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.080+0000 7f1f5c6ae740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653a6f566b0 con 0x5653a6ff8fd0 2024-09-13T17:22:33.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.080+0000 7f1f5c6ae740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653a6f51fa0 con 0x5653a6fede10 2024-09-13T17:22:33.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.080+0000 7f1f52ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653a6fee730 0x5653a6ff8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.080+0000 7f1f52ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653a6fee730 0x5653a6ff8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51890/0 (socket says 172.21.15.87:51890) 2024-09-13T17:22:33.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.080+0000 7f1f52ffd640 1 -- 172.21.15.87:0/624401160 learned_addr learned my addr 172.21.15.87:0/624401160 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:33.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.080+0000 7f1f527fc640 1 --2- 172.21.15.87:0/624401160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653a6fede10 0x5653a6fee1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.080+0000 7f1f58988640 1 --2- 172.21.15.87:0/278036994 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f1f3c0a1280 0x7f1f3c0a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.080+0000 7f1f527fc640 1 --2- 172.21.15.87:0/624401160 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653a6ff8fd0 0x5653a6ffb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.080+0000 7f1f52ffd640 1 -- 172.21.15.87:0/624401160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653a6fede10 msgr2=0x5653a6fee1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:33.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.080+0000 7f1f52ffd640 1 --2- 172.21.15.87:0/624401160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653a6fede10 0x5653a6fee1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.080+0000 7f1f52ffd640 1 -- 172.21.15.87:0/624401160 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653a6ff8fd0 msgr2=0x5653a6ffb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:33.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.080+0000 7f1f52ffd640 1 --2- 172.21.15.87:0/624401160 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653a6ff8fd0 0x5653a6ffb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.080+0000 7f1f52ffd640 1 -- 172.21.15.87:0/624401160 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653a6f0c840 con 0x5653a6fee730 2024-09-13T17:22:33.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.080+0000 7f1f527fc640 1 --2- 172.21.15.87:0/624401160 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653a6ff8fd0 0x5653a6ffb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:22:33.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.080+0000 7f1f537fe640 1 --2- 172.21.15.87:0/278036994 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f1f3c0a1280 0x7f1f3c0a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.080+0000 7f1f58988640 1 -- 172.21.15.87:0/278036994 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f1f4c0cd040 con 0x7f1f54197b60 2024-09-13T17:22:33.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.080+0000 7f1f52ffd640 1 --2- 172.21.15.87:0/624401160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653a6fee730 0x5653a6ff8a90 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f1f48007f90 tx=0x7f1f4800f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2452dd2e672321da server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:33.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.080+0000 7f1f39ffb640 1 -- 172.21.15.87:0/624401160 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f48004d20 con 0x5653a6fee730 2024-09-13T17:22:33.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.080+0000 7f1f39ffb640 1 -- 172.21.15.87:0/624401160 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1f48004e80 con 0x5653a6fee730 2024-09-13T17:22:33.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.080+0000 7f1f39ffb640 1 -- 172.21.15.87:0/624401160 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f48005640 con 0x5653a6fee730 2024-09-13T17:22:33.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.081+0000 7f1f5c6ae740 1 -- 172.21.15.87:0/624401160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653a6fee730 msgr2=0x5653a6ff8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.081+0000 7f1f537fe640 1 --2- 172.21.15.87:0/278036994 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f1f3c0a1280 0x7f1f3c0a3740 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c099a40 tx=0x7f1f4c06be20 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:33.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.081+0000 7f1f5c6ae740 1 --2- 172.21.15.87:0/624401160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653a6fee730 0x5653a6ff8a90 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f1f48007f90 tx=0x7f1f4800f850 comp rx=0 tx=0).stop 2024-09-13T17:22:33.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.081+0000 7f1f5c6ae740 1 -- 172.21.15.87:0/624401160 shutdown_connections 2024-09-13T17:22:33.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.081+0000 7f1f5c6ae740 1 --2- 172.21.15.87:0/624401160 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653a6ff8fd0 0x5653a6ffb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.081+0000 7f1f5c6ae740 1 --2- 172.21.15.87:0/624401160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653a6fee730 0x5653a6ff8a90 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.081+0000 7f1f5c6ae740 1 --2- 172.21.15.87:0/624401160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653a6fede10 0x5653a6fee1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.081+0000 7f1f5c6ae740 1 -- 172.21.15.87:0/624401160 >> 172.21.15.87:0/624401160 conn(0x5653a6fea380 msgr2=0x5653a6fea760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:33.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.081+0000 7f1f5c6ae740 1 -- 172.21.15.87:0/624401160 shutdown_connections 2024-09-13T17:22:33.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.081+0000 7f1f5c6ae740 1 -- 172.21.15.87:0/624401160 wait complete. 2024-09-13T17:22:33.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.081+0000 7f1f5c6ae740 1 -- start start 2024-09-13T17:22:33.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.082+0000 7f1f5c6ae740 1 Processor -- start 2024-09-13T17:22:33.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.082+0000 7f1f5c6ae740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653a6fede10 0x5653a6ff89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.082+0000 7f1f5c6ae740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653a6fee730 0x5653a6ff5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.082+0000 7f1f5c6ae740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653a6ff8fd0 0x5653a6ff6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.082+0000 7f1f5c6ae740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653a6ef32a0 con 0x5653a6ff8fd0 2024-09-13T17:22:33.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.082+0000 7f1f5c6ae740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653a6c2a430 con 0x5653a6fede10 2024-09-13T17:22:33.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.082+0000 7f1f5c6ae740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653a6ed5680 con 0x5653a6fee730 2024-09-13T17:22:33.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.082+0000 7f1f5c6ae740 10 client.0 _ll_register_callbacks cb 0x5653a6f4b610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:22:33.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.082+0000 7f1f527fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653a6ff8fd0 0x5653a6ff6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.082+0000 7f1f527fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653a6ff8fd0 0x5653a6ff6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51904/0 (socket says 172.21.15.87:51904) 2024-09-13T17:22:33.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.082+0000 7f1f527fc640 1 -- 172.21.15.87:0/4134222079 learned_addr learned my addr 172.21.15.87:0/4134222079 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:33.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.082+0000 7f1f527fc640 1 --2- 172.21.15.87:0/4134222079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653a6fede10 0x5653a6ff89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.082+0000 7f1f52ffd640 1 --2- 172.21.15.87:0/4134222079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653a6fee730 0x5653a6ff5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.082+0000 7f1f527fc640 1 -- 172.21.15.87:0/4134222079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653a6fee730 msgr2=0x5653a6ff5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:33.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.082+0000 7f1f527fc640 1 --2- 172.21.15.87:0/4134222079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653a6fee730 0x5653a6ff5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.082+0000 7f1f527fc640 1 -- 172.21.15.87:0/4134222079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653a6fede10 msgr2=0x5653a6ff89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:33.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.082+0000 7f1f527fc640 1 --2- 172.21.15.87:0/4134222079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653a6fede10 0x5653a6ff89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.083+0000 7f1f527fc640 1 -- 172.21.15.87:0/4134222079 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f48007bc0 con 0x5653a6ff8fd0 2024-09-13T17:22:33.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.083+0000 7f1f527fc640 1 --2- 172.21.15.87:0/4134222079 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653a6ff8fd0 0x5653a6ff6330 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f1f4402a940 tx=0x7f1f44009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139e5a1533df607e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:33.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.083+0000 7f1f32ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:22:33.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.083+0000 7f1f32ffd640 1 -- 172.21.15.87:0/4134222079 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f440035f0 con 0x5653a6ff8fd0 2024-09-13T17:22:33.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.083+0000 7f1f32ffd640 1 -- 172.21.15.87:0/4134222079 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f1f44003750 con 0x5653a6ff8fd0 2024-09-13T17:22:33.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.083+0000 7f1f5c6ae740 1 -- 172.21.15.87:0/4134222079 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5653a6c567e0 con 0x5653a6ff8fd0 2024-09-13T17:22:33.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.083+0000 7f1f32ffd640 1 -- 172.21.15.87:0/4134222079 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f44003910 con 0x5653a6ff8fd0 2024-09-13T17:22:33.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.083+0000 7f1f5c6ae740 10 client.17817 fetch_fsmap learned FSMap version 36 2024-09-13T17:22:33.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.083+0000 7f1f5c6ae740 1 -- 172.21.15.87:0/4134222079 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5653a6f50620 con 0x5653a6ff8fd0 2024-09-13T17:22:33.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.083+0000 7f1f32ffd640 1 -- 172.21.15.87:0/4134222079 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x5653a6c567e0 con 0x5653a6ff8fd0 2024-09-13T17:22:33.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.083+0000 7f1f32ffd640 1 -- 172.21.15.87:0/4134222079 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1f4403d9f0 con 0x5653a6ff8fd0 2024-09-13T17:22:33.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.083+0000 7f1f5c6ae740 10 client.17817 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:22:33.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.083+0000 7f1f5c6ae740 10 client.17817 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:22:33.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.083+0000 7f1f5c6ae740 20 client.17817 populate_metadata read hostname 'smithi087' 2024-09-13T17:22:33.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.083+0000 7f1f5c6ae740 1 --2- 172.21.15.87:0/4134222079 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5653a7008ce0 0x5653a700b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.083+0000 7f1f5c6ae740 4 client.17817 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:22:33.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.083+0000 7f1f5c6ae740 1 -- 172.21.15.87:0/4134222079 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5653a6ca9e30 con 0x5653a7008ce0 2024-09-13T17:22:33.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.084+0000 7f1f52ffd640 1 --2- 172.21.15.87:0/4134222079 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5653a7008ce0 0x5653a700b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.084+0000 7f1f32ffd640 10 client.17817 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:22:33.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.084+0000 7f1f52ffd640 1 --2- 172.21.15.87:0/4134222079 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5653a7008ce0 0x5653a700b0d0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ee4563d26237c27 server_cookie=3fccd2b441080a6b in_seq=0 out_seq=0 2024-09-13T17:22:33.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.085+0000 7f1f32ffd640 1 -- 172.21.15.87:0/4134222079 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5653a6ca9e30 con 0x5653a7008ce0 2024-09-13T17:22:33.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.085+0000 7f1f32ffd640 10 client.17817 handle_command_reply: tid=0 2024-09-13T17:22:33.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.085+0000 7f1f5c6ae740 1 client.17817 shutdown 2024-09-13T17:22:33.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.085+0000 7f1f5c6ae740 1 -- 172.21.15.87:0/4134222079 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653a6ff8fd0 msgr2=0x5653a6ff6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.085+0000 7f1f5c6ae740 1 --2- 172.21.15.87:0/4134222079 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653a6ff8fd0 0x5653a6ff6330 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f1f4402a940 tx=0x7f1f44009260 comp rx=0 tx=0).stop 2024-09-13T17:22:33.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.085+0000 7f1f5c6ae740 1 -- 172.21.15.87:0/4134222079 shutdown_connections 2024-09-13T17:22:33.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.085+0000 7f1f5c6ae740 1 --2- 172.21.15.87:0/4134222079 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5653a7008ce0 0x5653a700b0d0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.085+0000 7f1f5c6ae740 1 --2- 172.21.15.87:0/4134222079 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653a6ff8fd0 0x5653a6ff6330 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.085+0000 7f1f32ffd640 0 client.17817 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:22:33.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.085+0000 7f1f5c6ae740 1 --2- 172.21.15.87:0/4134222079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653a6fee730 0x5653a6ff5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.085+0000 7f1f5c6ae740 1 --2- 172.21.15.87:0/4134222079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653a6fede10 0x5653a6ff89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.085+0000 7f1f5c6ae740 1 -- 172.21.15.87:0/4134222079 >> 172.21.15.87:0/4134222079 conn(0x5653a6fea380 msgr2=0x5653a6fe9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:33.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.085+0000 7f1f5c6ae740 1 -- 172.21.15.87:0/4134222079 shutdown_connections 2024-09-13T17:22:33.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.085+0000 7f1f5c6ae740 1 -- 172.21.15.87:0/4134222079 wait complete. 2024-09-13T17:22:33.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.085+0000 7f1f5c6ae740 20 client.17817 trim_cache size 0 max 16384 2024-09-13T17:22:33.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.099+0000 7f1f5c6ae740 1 Processor -- start 2024-09-13T17:22:33.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.099+0000 7f1f5c6ae740 1 -- start start 2024-09-13T17:22:33.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.099+0000 7f1f5c6ae740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653a6fede10 0x5653a6fe9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.099+0000 7f1f5c6ae740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653a6fee730 0x5653a6ff0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.099+0000 7f1f5c6ae740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653a6ff8fd0 0x5653a6ff14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.099+0000 7f1f5c6ae740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653a6ca9e30 con 0x5653a6ff8fd0 2024-09-13T17:22:33.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.099+0000 7f1f5c6ae740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653a6c567e0 con 0x5653a6fede10 2024-09-13T17:22:33.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.099+0000 7f1f5c6ae740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653a6feb050 con 0x5653a6fee730 2024-09-13T17:22:33.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.100+0000 7f1f527fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653a6ff8fd0 0x5653a6ff14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.100+0000 7f1f527fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653a6ff8fd0 0x5653a6ff14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51916/0 (socket says 172.21.15.87:51916) 2024-09-13T17:22:33.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.100+0000 7f1f527fc640 1 -- 172.21.15.87:0/1539652520 learned_addr learned my addr 172.21.15.87:0/1539652520 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:33.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.100+0000 7f1f527fc640 1 --2- 172.21.15.87:0/1539652520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653a6fede10 0x5653a6fe9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.100+0000 7f1f52ffd640 1 --2- 172.21.15.87:0/1539652520 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653a6fee730 0x5653a6ff0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.100+0000 7f1f527fc640 1 -- 172.21.15.87:0/1539652520 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653a6fee730 msgr2=0x5653a6ff0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:33.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.100+0000 7f1f527fc640 1 --2- 172.21.15.87:0/1539652520 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653a6fee730 0x5653a6ff0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.100+0000 7f1f527fc640 1 -- 172.21.15.87:0/1539652520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653a6fede10 msgr2=0x5653a6fe9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:33.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.100+0000 7f1f527fc640 1 --2- 172.21.15.87:0/1539652520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653a6fede10 0x5653a6fe9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.100+0000 7f1f527fc640 1 -- 172.21.15.87:0/1539652520 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653a6ef2790 con 0x5653a6ff8fd0 2024-09-13T17:22:33.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.100+0000 7f1f52ffd640 1 --2- 172.21.15.87:0/1539652520 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653a6fee730 0x5653a6ff0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:22:33.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.100+0000 7f1f527fc640 1 --2- 172.21.15.87:0/1539652520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653a6ff8fd0 0x5653a6ff14d0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f1f44005820 tx=0x7f1f44043040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=353ccdd800e9c258 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:33.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.100+0000 7f1f3a7fc640 1 -- 172.21.15.87:0/1539652520 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4403beb0 con 0x5653a6ff8fd0 2024-09-13T17:22:33.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.100+0000 7f1f3a7fc640 1 -- 172.21.15.87:0/1539652520 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1f44031e90 con 0x5653a6ff8fd0 2024-09-13T17:22:33.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.100+0000 7f1f3a7fc640 1 -- 172.21.15.87:0/1539652520 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f44005560 con 0x5653a6ff8fd0 2024-09-13T17:22:33.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.101+0000 7f1f5c6ae740 1 -- 172.21.15.87:0/1539652520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653a6ff8fd0 msgr2=0x5653a6ff14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.101+0000 7f1f5c6ae740 1 --2- 172.21.15.87:0/1539652520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653a6ff8fd0 0x5653a6ff14d0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f1f44005820 tx=0x7f1f44043040 comp rx=0 tx=0).stop 2024-09-13T17:22:33.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.101+0000 7f1f5c6ae740 1 -- 172.21.15.87:0/1539652520 shutdown_connections 2024-09-13T17:22:33.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.101+0000 7f1f5c6ae740 1 --2- 172.21.15.87:0/1539652520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653a6ff8fd0 0x5653a6ff14d0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.101+0000 7f1f5c6ae740 1 --2- 172.21.15.87:0/1539652520 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653a6fee730 0x5653a6ff0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.101+0000 7f1f5c6ae740 1 --2- 172.21.15.87:0/1539652520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653a6fede10 0x5653a6fe9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.101+0000 7f1f5c6ae740 1 -- 172.21.15.87:0/1539652520 >> 172.21.15.87:0/1539652520 conn(0x5653a6fea380 msgr2=0x5653a700fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:33.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.101+0000 7f1f5c6ae740 1 -- 172.21.15.87:0/1539652520 shutdown_connections 2024-09-13T17:22:33.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.101+0000 7f1f5c6ae740 1 -- 172.21.15.87:0/1539652520 wait complete. 2024-09-13T17:22:33.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.101+0000 7f1f5c6ae740 1 -- start start 2024-09-13T17:22:33.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.101+0000 7f1f5c6ae740 1 Processor -- start 2024-09-13T17:22:33.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.101+0000 7f1f5c6ae740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653a6fede10 0x5653a6fffb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.101+0000 7f1f5c6ae740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653a6fee730 0x5653a70000a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.101+0000 7f1f5c6ae740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653a6ff8fd0 0x5653a6ffc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.101+0000 7f1f5c6ae740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653a6ffc840 con 0x5653a6ff8fd0 2024-09-13T17:22:33.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.101+0000 7f1f5c6ae740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653a6ffc9b0 con 0x5653a6fee730 2024-09-13T17:22:33.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.101+0000 7f1f5c6ae740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653a6ffcb70 con 0x5653a6fede10 2024-09-13T17:22:33.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.102+0000 7f1f5c6ae740 10 client.0 _ll_register_callbacks cb 0x7f1f44009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:22:33.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.102+0000 7f1f527fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653a6ff8fd0 0x5653a6ffc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.102+0000 7f1f527fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653a6ff8fd0 0x5653a6ffc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51930/0 (socket says 172.21.15.87:51930) 2024-09-13T17:22:33.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.102+0000 7f1f527fc640 1 -- 172.21.15.87:0/233893202 learned_addr learned my addr 172.21.15.87:0/233893202 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:33.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.102+0000 7f1f527fc640 1 --2- 172.21.15.87:0/233893202 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653a6fede10 0x5653a6fffb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.102+0000 7f1f52ffd640 1 --2- 172.21.15.87:0/233893202 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653a6fee730 0x5653a70000a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.102+0000 7f1f527fc640 1 -- 172.21.15.87:0/233893202 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653a6fede10 msgr2=0x5653a6fffb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:33.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.102+0000 7f1f527fc640 1 --2- 172.21.15.87:0/233893202 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653a6fede10 0x5653a6fffb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.102+0000 7f1f527fc640 1 -- 172.21.15.87:0/233893202 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653a6fee730 msgr2=0x5653a70000a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:33.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.102+0000 7f1f527fc640 1 --2- 172.21.15.87:0/233893202 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653a6fee730 0x5653a70000a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.102+0000 7f1f527fc640 1 -- 172.21.15.87:0/233893202 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f44050040 con 0x5653a6ff8fd0 2024-09-13T17:22:33.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.102+0000 7f1f527fc640 1 --2- 172.21.15.87:0/233893202 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653a6ff8fd0 0x5653a6ffc140 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x5653a6ffae80 tx=0x7f1f44000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87d9b62bad2941f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:33.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.102+0000 7f1f32ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:22:33.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.102+0000 7f1f32ffd640 1 -- 172.21.15.87:0/233893202 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f440054f0 con 0x5653a6ff8fd0 2024-09-13T17:22:33.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.102+0000 7f1f32ffd640 1 -- 172.21.15.87:0/233893202 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f1f44000e40 con 0x5653a6ff8fd0 2024-09-13T17:22:33.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.102+0000 7f1f5c6ae740 1 -- 172.21.15.87:0/233893202 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5653a6c454e0 con 0x5653a6ff8fd0 2024-09-13T17:22:33.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.102+0000 7f1f32ffd640 1 -- 172.21.15.87:0/233893202 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f44031910 con 0x5653a6ff8fd0 2024-09-13T17:22:33.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.102+0000 7f1f5c6ae740 10 client.17823 fetch_fsmap learned FSMap version 36 2024-09-13T17:22:33.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.102+0000 7f1f5c6ae740 1 -- 172.21.15.87:0/233893202 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5653a6f17ea0 con 0x5653a6ff8fd0 2024-09-13T17:22:33.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.103+0000 7f1f32ffd640 1 -- 172.21.15.87:0/233893202 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x5653a6c454e0 con 0x5653a6ff8fd0 2024-09-13T17:22:33.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.103+0000 7f1f32ffd640 1 -- 172.21.15.87:0/233893202 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1f44032000 con 0x5653a6ff8fd0 2024-09-13T17:22:33.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.103+0000 7f1f5c6ae740 10 client.17823 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:22:33.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.103+0000 7f1f5c6ae740 10 client.17823 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:22:33.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.103+0000 7f1f5c6ae740 20 client.17823 populate_metadata read hostname 'smithi087' 2024-09-13T17:22:33.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.103+0000 7f1f5c6ae740 1 --2- 172.21.15.87:0/233893202 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5653a7008ce0 0x5653a7061e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.103+0000 7f1f5c6ae740 4 client.17823 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:22:33.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.103+0000 7f1f5c6ae740 1 -- 172.21.15.87:0/233893202 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5653a7062560 con 0x5653a7008ce0 2024-09-13T17:22:33.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.103+0000 7f1f52ffd640 1 --2- 172.21.15.87:0/233893202 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5653a7008ce0 0x5653a7061e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.103+0000 7f1f32ffd640 10 client.17823 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:22:33.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.103+0000 7f1f52ffd640 1 --2- 172.21.15.87:0/233893202 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5653a7008ce0 0x5653a7061e90 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce95339b908ce1d7 server_cookie=3d5dd67a41e17128 in_seq=0 out_seq=0 2024-09-13T17:22:33.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.104+0000 7f1f32ffd640 1 -- 172.21.15.87:0/233893202 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5653a7062560 con 0x5653a7008ce0 2024-09-13T17:22:33.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.104+0000 7f1f32ffd640 10 client.17823 handle_command_reply: tid=0 2024-09-13T17:22:33.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.104+0000 7f1f5c6ae740 1 client.17823 shutdown 2024-09-13T17:22:33.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.104+0000 7f1f5c6ae740 1 -- 172.21.15.87:0/233893202 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653a6ff8fd0 msgr2=0x5653a6ffc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.104+0000 7f1f5c6ae740 1 --2- 172.21.15.87:0/233893202 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653a6ff8fd0 0x5653a6ffc140 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x5653a6ffae80 tx=0x7f1f44000bc0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.104+0000 7f1f5c6ae740 1 -- 172.21.15.87:0/233893202 shutdown_connections 2024-09-13T17:22:33.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.104+0000 7f1f5c6ae740 1 --2- 172.21.15.87:0/233893202 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5653a7008ce0 0x5653a7061e90 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.104+0000 7f1f5c6ae740 1 --2- 172.21.15.87:0/233893202 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5653a6ff8fd0 0x5653a6ffc140 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.104+0000 7f1f32ffd640 0 client.17823 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:22:33.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.104+0000 7f1f5c6ae740 1 --2- 172.21.15.87:0/233893202 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653a6fee730 0x5653a70000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.104+0000 7f1f5c6ae740 1 --2- 172.21.15.87:0/233893202 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653a6fede10 0x5653a6fffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.104+0000 7f1f5c6ae740 1 -- 172.21.15.87:0/233893202 >> 172.21.15.87:0/233893202 conn(0x5653a6fea380 msgr2=0x5653a6ff0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:33.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.104+0000 7f1f5c6ae740 1 -- 172.21.15.87:0/233893202 shutdown_connections 2024-09-13T17:22:33.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.104+0000 7f1f5c6ae740 1 -- 172.21.15.87:0/233893202 wait complete. 2024-09-13T17:22:33.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.104+0000 7f1f5c6ae740 20 client.17823 trim_cache size 0 max 16384 2024-09-13T17:22:33.113 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:22:33.113 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "no active scrubs running", 2024-09-13T17:22:33.113 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": {} 2024-09-13T17:22:33.114 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:22:33.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.104+0000 7f1f5998a640 1 -- 172.21.15.87:0/278036994 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f1f3c0a1280 msgr2=0x7f1f3c0a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.104+0000 7f1f5998a640 1 --2- 172.21.15.87:0/278036994 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f1f3c0a1280 0x7f1f3c0a3740 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c099a40 tx=0x7f1f4c06be20 comp rx=0 tx=0).stop 2024-09-13T17:22:33.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.104+0000 7f1f5998a640 1 -- 172.21.15.87:0/278036994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f54197b60 msgr2=0x7f1f541a2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.104+0000 7f1f5998a640 1 --2- 172.21.15.87:0/278036994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f54197b60 0x7f1f541a2160 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c00c970 tx=0x7f1f4c00ce30 comp rx=0 tx=0).stop 2024-09-13T17:22:33.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.104+0000 7f1f5998a640 1 -- 172.21.15.87:0/278036994 shutdown_connections 2024-09-13T17:22:33.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.104+0000 7f1f5998a640 1 --2- 172.21.15.87:0/278036994 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f1f3c0a1280 0x7f1f3c0a3740 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.104+0000 7f1f5998a640 1 --2- 172.21.15.87:0/278036994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f54197b60 0x7f1f541a2160 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.104+0000 7f1f5998a640 1 --2- 172.21.15.87:0/278036994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f54104020 0x7f1f54197620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.104+0000 7f1f5998a640 1 --2- 172.21.15.87:0/278036994 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f540feed0 0x7f1f541970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.104+0000 7f1f5998a640 1 -- 172.21.15.87:0/278036994 >> 172.21.15.87:0/278036994 conn(0x7f1f540fa9a0 msgr2=0x7f1f540fbd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:33.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.105+0000 7f1f5998a640 1 -- 172.21.15.87:0/278036994 shutdown_connections 2024-09-13T17:22:33.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.105+0000 7f1f5998a640 1 -- 172.21.15.87:0/278036994 wait complete. 2024-09-13T17:22:33.117 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T17:22:33.118 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:22:33.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.213+0000 7f7b03b2c640 1 -- 172.21.15.87:0/4152023357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7afc0ff830 msgr2=0x7f7afc103870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.213+0000 7f7b03b2c640 1 --2- 172.21.15.87:0/4152023357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7afc0ff830 0x7f7afc103870 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f7aec009930 tx=0x7f7aec02a420 comp rx=0 tx=0).stop 2024-09-13T17:22:33.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.213+0000 7f7b03b2c640 1 -- 172.21.15.87:0/4152023357 shutdown_connections 2024-09-13T17:22:33.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.213+0000 7f7b03b2c640 1 --2- 172.21.15.87:0/4152023357 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7afc103fd0 0x7f7afc10bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.213+0000 7f7b03b2c640 1 --2- 172.21.15.87:0/4152023357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7afc0ff830 0x7f7afc103870 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.213+0000 7f7b03b2c640 1 --2- 172.21.15.87:0/4152023357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7afc0fee80 0x7f7afc0ff260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.213+0000 7f7b03b2c640 1 -- 172.21.15.87:0/4152023357 >> 172.21.15.87:0/4152023357 conn(0x7f7afc075c60 msgr2=0x7f7afc0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:33.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.214+0000 7f7b03b2c640 1 -- 172.21.15.87:0/4152023357 shutdown_connections 2024-09-13T17:22:33.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.214+0000 7f7b03b2c640 1 -- 172.21.15.87:0/4152023357 wait complete. 2024-09-13T17:22:33.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.214+0000 7f7b03b2c640 1 Processor -- start 2024-09-13T17:22:33.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.214+0000 7f7b03b2c640 1 -- start start 2024-09-13T17:22:33.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.214+0000 7f7b03b2c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7afc0fee80 0x7f7afc1951d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.214+0000 7f7b03b2c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7afc103fd0 0x7f7afc195710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.214+0000 7f7b03b2c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7afc199b00 0x7f7afc199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.214+0000 7f7b03b2c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7afc19a4f0 con 0x7f7afc0fee80 2024-09-13T17:22:33.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.214+0000 7f7b03b2c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7afc19a660 con 0x7f7afc199b00 2024-09-13T17:22:33.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.214+0000 7f7b03b2c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7afc19a7d0 con 0x7f7afc103fd0 2024-09-13T17:22:33.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.214+0000 7f7b018c8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7afc0fee80 0x7f7afc1951d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.214+0000 7f7b018c8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7afc0fee80 0x7f7afc1951d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51954/0 (socket says 172.21.15.87:51954) 2024-09-13T17:22:33.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.214+0000 7f7b018c8640 1 -- 172.21.15.87:0/773146948 learned_addr learned my addr 172.21.15.87:0/773146948 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:33.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.215+0000 7f7b010c7640 1 --2- 172.21.15.87:0/773146948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7afc103fd0 0x7f7afc195710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.215+0000 7f7b020c9640 1 --2- 172.21.15.87:0/773146948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7afc199b00 0x7f7afc199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.215+0000 7f7b018c8640 1 -- 172.21.15.87:0/773146948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7afc103fd0 msgr2=0x7f7afc195710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.215+0000 7f7b018c8640 1 --2- 172.21.15.87:0/773146948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7afc103fd0 0x7f7afc195710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.215+0000 7f7b018c8640 1 -- 172.21.15.87:0/773146948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7afc199b00 msgr2=0x7f7afc199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.215+0000 7f7b018c8640 1 --2- 172.21.15.87:0/773146948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7afc199b00 0x7f7afc199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.215+0000 7f7b018c8640 1 -- 172.21.15.87:0/773146948 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aec009560 con 0x7f7afc0fee80 2024-09-13T17:22:33.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.215+0000 7f7b020c9640 1 --2- 172.21.15.87:0/773146948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7afc199b00 0x7f7afc199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:22:33.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.215+0000 7f7b018c8640 1 --2- 172.21.15.87:0/773146948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7afc0fee80 0x7f7afc1951d0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f7af8007c70 tx=0x7f7af800e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:33.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.215+0000 7f7af2ffd640 1 -- 172.21.15.87:0/773146948 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af8011070 con 0x7f7afc0fee80 2024-09-13T17:22:33.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.215+0000 7f7af2ffd640 1 -- 172.21.15.87:0/773146948 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7af8007e80 con 0x7f7afc0fee80 2024-09-13T17:22:33.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.215+0000 7f7af2ffd640 1 -- 172.21.15.87:0/773146948 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af80055b0 con 0x7f7afc0fee80 2024-09-13T17:22:33.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.215+0000 7f7b03b2c640 1 -- 172.21.15.87:0/773146948 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7afc0675a0 con 0x7f7afc0fee80 2024-09-13T17:22:33.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.215+0000 7f7b03b2c640 1 -- 172.21.15.87:0/773146948 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7afc0679d0 con 0x7f7afc0fee80 2024-09-13T17:22:33.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.216+0000 7f7b03b2c640 1 -- 172.21.15.87:0/773146948 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7afc100350 con 0x7f7afc0fee80 2024-09-13T17:22:33.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.218+0000 7f7af2ffd640 1 -- 172.21.15.87:0/773146948 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f7af8005710 con 0x7f7afc0fee80 2024-09-13T17:22:33.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.218+0000 7f7af2ffd640 1 --2- 172.21.15.87:0/773146948 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7ae80a1200 0x7f7ae80a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.219+0000 7f7b010c7640 1 --2- 172.21.15.87:0/773146948 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7ae80a1200 0x7f7ae80a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.219+0000 7f7af2ffd640 1 -- 172.21.15.87:0/773146948 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f7af80cef50 con 0x7f7afc0fee80 2024-09-13T17:22:33.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.219+0000 7f7b010c7640 1 --2- 172.21.15.87:0/773146948 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7ae80a1200 0x7f7ae80a36c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7aec009900 tx=0x7f7aec005a20 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:33.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.222+0000 7f7af2ffd640 1 -- 172.21.15.87:0/773146948 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7af809bab0 con 0x7f7afc0fee80 2024-09-13T17:22:33.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.418+0000 7f7b03b2c640 1 -- 172.21.15.87:0/773146948 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7afc0ff260 con 0x7f7afc0fee80 2024-09-13T17:22:33.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.419+0000 7f7af2ffd640 1 -- 172.21.15.87:0/773146948 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+10877 (secure 0 0 0) 0x7f7af809b640 con 0x7f7afc0fee80 2024-09-13T17:22:33.421 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:22:33.422 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/3674545180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":3674545180},{"type":"v1","addr":"172.21.15.87:6841","nonce":3674545180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:11:23.313609+0000","modified":"2024-09-13T17:19:40.570296+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24484,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6839/3052680456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3052680456},{"type":"v1","addr":"172.21.15.118:6839","nonce":3052680456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:22:33.422 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 36 2024-09-13T17:22:33.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.421+0000 7f7b03b2c640 1 -- 172.21.15.87:0/773146948 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7ae80a1200 msgr2=0x7f7ae80a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.421+0000 7f7b03b2c640 1 --2- 172.21.15.87:0/773146948 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7ae80a1200 0x7f7ae80a36c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7aec009900 tx=0x7f7aec005a20 comp rx=0 tx=0).stop 2024-09-13T17:22:33.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.421+0000 7f7b03b2c640 1 -- 172.21.15.87:0/773146948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7afc0fee80 msgr2=0x7f7afc1951d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.421+0000 7f7b03b2c640 1 --2- 172.21.15.87:0/773146948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7afc0fee80 0x7f7afc1951d0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f7af8007c70 tx=0x7f7af800e420 comp rx=0 tx=0).stop 2024-09-13T17:22:33.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.421+0000 7f7b03b2c640 1 -- 172.21.15.87:0/773146948 shutdown_connections 2024-09-13T17:22:33.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.421+0000 7f7b03b2c640 1 --2- 172.21.15.87:0/773146948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7afc199b00 0x7f7afc199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.421+0000 7f7b03b2c640 1 --2- 172.21.15.87:0/773146948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7afc103fd0 0x7f7afc195710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.421+0000 7f7b03b2c640 1 --2- 172.21.15.87:0/773146948 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7ae80a1200 0x7f7ae80a36c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.421+0000 7f7b03b2c640 1 --2- 172.21.15.87:0/773146948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7afc0fee80 0x7f7afc1951d0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.421+0000 7f7b03b2c640 1 -- 172.21.15.87:0/773146948 >> 172.21.15.87:0/773146948 conn(0x7f7afc075c60 msgr2=0x7f7afc102400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:33.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.421+0000 7f7b03b2c640 1 -- 172.21.15.87:0/773146948 shutdown_connections 2024-09-13T17:22:33.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.421+0000 7f7b03b2c640 1 -- 172.21.15.87:0/773146948 wait complete. 2024-09-13T17:22:33.434 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-09-13T17:22:33.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.533+0000 7f84ecfa0640 1 -- 172.21.15.87:0/309189536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84e8105150 msgr2=0x7f84e810baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.533+0000 7f84ecfa0640 1 --2- 172.21.15.87:0/309189536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84e8105150 0x7f84e810baf0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009ca0 tx=0x7f84e002a8c0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.533+0000 7f84ecfa0640 1 -- 172.21.15.87:0/309189536 shutdown_connections 2024-09-13T17:22:33.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.533+0000 7f84ecfa0640 1 --2- 172.21.15.87:0/309189536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84e8105150 0x7f84e810baf0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.533+0000 7f84ecfa0640 1 --2- 172.21.15.87:0/309189536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84e81004f0 0x7f84e8104a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.533+0000 7f84ecfa0640 1 --2- 172.21.15.87:0/309189536 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84e80ffb40 0x7f84e80fff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.533+0000 7f84ecfa0640 1 -- 172.21.15.87:0/309189536 >> 172.21.15.87:0/309189536 conn(0x7f84e8075380 msgr2=0x7f84e8075790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:33.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.533+0000 7f84ecfa0640 1 -- 172.21.15.87:0/309189536 shutdown_connections 2024-09-13T17:22:33.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.533+0000 7f84ecfa0640 1 -- 172.21.15.87:0/309189536 wait complete. 2024-09-13T17:22:33.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.534+0000 7f84ecfa0640 1 Processor -- start 2024-09-13T17:22:33.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.534+0000 7f84ecfa0640 1 -- start start 2024-09-13T17:22:33.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.534+0000 7f84ecfa0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84e80ffb40 0x7f84e810c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.534+0000 7f84ecfa0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84e8105150 0x7f84e810c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.534+0000 7f84ecfa0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84e810ceb0 0x7f84e81a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.534+0000 7f84ecfa0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e81a49c0 con 0x7f84e810ceb0 2024-09-13T17:22:33.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.534+0000 7f84ecfa0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e81a4b30 con 0x7f84e8105150 2024-09-13T17:22:33.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.534+0000 7f84ecfa0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e81a4cf0 con 0x7f84e80ffb40 2024-09-13T17:22:33.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.534+0000 7f84e7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84e810ceb0 0x7f84e81a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.534+0000 7f84e7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84e810ceb0 0x7f84e81a43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51976/0 (socket says 172.21.15.87:51976) 2024-09-13T17:22:33.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.534+0000 7f84e7fff640 1 -- 172.21.15.87:0/3033448663 learned_addr learned my addr 172.21.15.87:0/3033448663 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:33.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.534+0000 7f84e6ffd640 1 --2- 172.21.15.87:0/3033448663 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84e8105150 0x7f84e810c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.534+0000 7f84e77fe640 1 --2- 172.21.15.87:0/3033448663 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84e80ffb40 0x7f84e810c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.534+0000 7f84e7fff640 1 -- 172.21.15.87:0/3033448663 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84e80ffb40 msgr2=0x7f84e810c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.534+0000 7f84e7fff640 1 --2- 172.21.15.87:0/3033448663 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84e80ffb40 0x7f84e810c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.534+0000 7f84e7fff640 1 -- 172.21.15.87:0/3033448663 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84e8105150 msgr2=0x7f84e810c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.534+0000 7f84e7fff640 1 --2- 172.21.15.87:0/3033448663 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84e8105150 0x7f84e810c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.534+0000 7f84e7fff640 1 -- 172.21.15.87:0/3033448663 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e0009900 con 0x7f84e810ceb0 2024-09-13T17:22:33.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.534+0000 7f84e6ffd640 1 --2- 172.21.15.87:0/3033448663 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84e8105150 0x7f84e810c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:22:33.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.535+0000 7f84e7fff640 1 --2- 172.21.15.87:0/3033448663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84e810ceb0 0x7f84e81a43f0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f84e00097b0 tx=0x7f84e0031680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:33.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.535+0000 7f84e4ff9640 1 -- 172.21.15.87:0/3033448663 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e0003e20 con 0x7f84e810ceb0 2024-09-13T17:22:33.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.535+0000 7f84e4ff9640 1 -- 172.21.15.87:0/3033448663 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f84e0040070 con 0x7f84e810ceb0 2024-09-13T17:22:33.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.535+0000 7f84ecfa0640 1 -- 172.21.15.87:0/3033448663 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e81a4f70 con 0x7f84e810ceb0 2024-09-13T17:22:33.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.535+0000 7f84e4ff9640 1 -- 172.21.15.87:0/3033448663 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e00046b0 con 0x7f84e810ceb0 2024-09-13T17:22:33.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.535+0000 7f84ecfa0640 1 -- 172.21.15.87:0/3033448663 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e81a54a0 con 0x7f84e810ceb0 2024-09-13T17:22:33.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.537+0000 7f84e4ff9640 1 -- 172.21.15.87:0/3033448663 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f84e0042030 con 0x7f84e810ceb0 2024-09-13T17:22:33.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.538+0000 7f84f1002740 1 Processor -- start 2024-09-13T17:22:33.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.538+0000 7f84f1002740 1 -- start start 2024-09-13T17:22:33.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.538+0000 7f84f1002740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55808c84a970 0x55808c84ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.538+0000 7f84f1002740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55808c84b290 0x55808c8555f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.538+0000 7f84e4ff9640 1 --2- 172.21.15.87:0/3033448663 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f84d40a12b0 0x7f84d40a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.538+0000 7f84f1002740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55808c855b30 0x55808c857f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.538+0000 7f84f1002740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55808c7b4cc0 con 0x55808c855b30 2024-09-13T17:22:33.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.538+0000 7f84f1002740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55808c7b2450 con 0x55808c84b290 2024-09-13T17:22:33.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.538+0000 7f84f1002740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55808c7add40 con 0x55808c84a970 2024-09-13T17:22:33.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.538+0000 7f84e6ffd640 1 --2- 172.21.15.87:0/3033448663 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f84d40a12b0 0x7f84d40a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.538+0000 7f84e7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55808c855b30 0x55808c857f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.538+0000 7f84e7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55808c855b30 0x55808c857f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51986/0 (socket says 172.21.15.87:51986) 2024-09-13T17:22:33.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.538+0000 7f84e7fff640 1 -- 172.21.15.87:0/3424905776 learned_addr learned my addr 172.21.15.87:0/3424905776 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:33.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.538+0000 7f84e6ffd640 1 --2- 172.21.15.87:0/3424905776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55808c84a970 0x55808c84ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.538+0000 7f84e77fe640 1 --2- 172.21.15.87:0/3424905776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55808c84b290 0x55808c8555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.538+0000 7f84e4ff9640 1 -- 172.21.15.87:0/3033448663 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f84e00ee900 con 0x7f84e810ceb0 2024-09-13T17:22:33.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.538+0000 7f84e7fff640 1 -- 172.21.15.87:0/3424905776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55808c84a970 msgr2=0x55808c84ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:33.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.538+0000 7f84e7fff640 1 --2- 172.21.15.87:0/3424905776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55808c84a970 0x55808c84ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.538+0000 7f84e7fff640 1 -- 172.21.15.87:0/3424905776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55808c84b290 msgr2=0x55808c8555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:33.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.538+0000 7f84e7fff640 1 --2- 172.21.15.87:0/3424905776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55808c84b290 0x55808c8555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.538+0000 7f84e7fff640 1 -- 172.21.15.87:0/3424905776 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55808c775620 con 0x55808c855b30 2024-09-13T17:22:33.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.538+0000 7f84e77fe640 1 --2- 172.21.15.87:0/3424905776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55808c84b290 0x55808c8555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:22:33.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.539+0000 7f84e6ffd640 1 --2- 172.21.15.87:0/3033448663 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f84d40a12b0 0x7f84d40a3770 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f84d8005fd0 tx=0x7f84d800bb70 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:33.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.539+0000 7f84e7fff640 1 --2- 172.21.15.87:0/3424905776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55808c855b30 0x55808c857f20 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f84e00bb410 tx=0x7f84e004e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=873387b07356e0bf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:33.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.539+0000 7f84ddffb640 1 -- 172.21.15.87:0/3424905776 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e0004040 con 0x55808c855b30 2024-09-13T17:22:33.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.539+0000 7f84ddffb640 1 -- 172.21.15.87:0/3424905776 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f84e00bbe10 con 0x55808c855b30 2024-09-13T17:22:33.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.539+0000 7f84ddffb640 1 -- 172.21.15.87:0/3424905776 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e00c1900 con 0x55808c855b30 2024-09-13T17:22:33.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.539+0000 7f84f1002740 1 -- 172.21.15.87:0/3424905776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55808c855b30 msgr2=0x55808c857f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.539+0000 7f84f1002740 1 --2- 172.21.15.87:0/3424905776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55808c855b30 0x55808c857f20 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f84e00bb410 tx=0x7f84e004e000 comp rx=0 tx=0).stop 2024-09-13T17:22:33.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.540+0000 7f84f1002740 1 -- 172.21.15.87:0/3424905776 shutdown_connections 2024-09-13T17:22:33.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.540+0000 7f84f1002740 1 --2- 172.21.15.87:0/3424905776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55808c855b30 0x55808c857f20 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.540+0000 7f84f1002740 1 --2- 172.21.15.87:0/3424905776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55808c84b290 0x55808c8555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.540+0000 7f84f1002740 1 --2- 172.21.15.87:0/3424905776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55808c84a970 0x55808c84ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.540+0000 7f84f1002740 1 -- 172.21.15.87:0/3424905776 >> 172.21.15.87:0/3424905776 conn(0x55808c846ee0 msgr2=0x55808c8472c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:33.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.540+0000 7f84f1002740 1 -- 172.21.15.87:0/3424905776 shutdown_connections 2024-09-13T17:22:33.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.540+0000 7f84f1002740 1 -- 172.21.15.87:0/3424905776 wait complete. 2024-09-13T17:22:33.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.540+0000 7f84f1002740 1 -- start start 2024-09-13T17:22:33.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.540+0000 7f84f1002740 1 Processor -- start 2024-09-13T17:22:33.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.540+0000 7f84f1002740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55808c84a970 0x55808c8550c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.540+0000 7f84f1002740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55808c84b290 0x55808c8523e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.540+0000 7f84f1002740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55808c855b30 0x55808c852920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.540+0000 7f84f1002740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55808c76c180 con 0x55808c84a970 2024-09-13T17:22:33.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.540+0000 7f84f1002740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55808c486430 con 0x55808c855b30 2024-09-13T17:22:33.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.540+0000 7f84f1002740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55808c7315e0 con 0x55808c84b290 2024-09-13T17:22:33.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.540+0000 7f84f1002740 10 client.0 _ll_register_callbacks cb 0x55808c79daa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:22:33.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.540+0000 7f84e77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55808c84a970 0x55808c8550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.540+0000 7f84e77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55808c84a970 0x55808c8550c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51994/0 (socket says 172.21.15.87:51994) 2024-09-13T17:22:33.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.540+0000 7f84e77fe640 1 -- 172.21.15.87:0/108344330 learned_addr learned my addr 172.21.15.87:0/108344330 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:33.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.541+0000 7f84e6ffd640 1 --2- 172.21.15.87:0/108344330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55808c84b290 0x55808c8523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.541+0000 7f84e77fe640 1 -- 172.21.15.87:0/108344330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55808c84b290 msgr2=0x55808c8523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:33.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.541+0000 7f84e77fe640 1 --2- 172.21.15.87:0/108344330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55808c84b290 0x55808c8523e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.541+0000 7f84e77fe640 1 -- 172.21.15.87:0/108344330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55808c855b30 msgr2=0x55808c852920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:33.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.541+0000 7f84e77fe640 1 --2- 172.21.15.87:0/108344330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55808c855b30 0x55808c852920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.541+0000 7f84e77fe640 1 -- 172.21.15.87:0/108344330 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e81a54a0 con 0x55808c84a970 2024-09-13T17:22:33.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.541+0000 7f84e77fe640 1 --2- 172.21.15.87:0/108344330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55808c84a970 0x55808c8550c0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f84d000bfd0 tx=0x7f84d000f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cae8263172c00ee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:33.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.541+0000 7f84c6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:22:33.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.541+0000 7f84c6ffd640 1 -- 172.21.15.87:0/108344330 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d0014660 con 0x55808c84a970 2024-09-13T17:22:33.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.541+0000 7f84c6ffd640 1 -- 172.21.15.87:0/108344330 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f84d00147c0 con 0x55808c84a970 2024-09-13T17:22:33.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.541+0000 7f84f1002740 1 -- 172.21.15.87:0/108344330 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55808c7d7b80 con 0x55808c84a970 2024-09-13T17:22:33.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.541+0000 7f84c6ffd640 1 -- 172.21.15.87:0/108344330 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84d0014980 con 0x55808c84a970 2024-09-13T17:22:33.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.541+0000 7f84f1002740 10 client.17841 fetch_fsmap learned FSMap version 36 2024-09-13T17:22:33.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.541+0000 7f84f1002740 1 -- 172.21.15.87:0/108344330 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55808c7ac3c0 con 0x55808c84a970 2024-09-13T17:22:33.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.541+0000 7f84c6ffd640 1 -- 172.21.15.87:0/108344330 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55808c7d7b80 con 0x55808c84a970 2024-09-13T17:22:33.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.541+0000 7f84c6ffd640 1 -- 172.21.15.87:0/108344330 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f84d0013c00 con 0x55808c84a970 2024-09-13T17:22:33.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.542+0000 7f84f1002740 10 client.17841 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:22:33.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.542+0000 7f84f1002740 10 client.17841 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:22:33.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.542+0000 7f84f1002740 20 client.17841 populate_metadata read hostname 'smithi087' 2024-09-13T17:22:33.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.542+0000 7f84f1002740 1 --2- 172.21.15.87:0/108344330 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55808c8652b0 0x55808c8676d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.542+0000 7f84f1002740 4 client.17841 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:22:33.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.542+0000 7f84f1002740 1 -- 172.21.15.87:0/108344330 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55808c7a01f0 con 0x55808c8652b0 2024-09-13T17:22:33.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.542+0000 7f84e6ffd640 1 --2- 172.21.15.87:0/108344330 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55808c8652b0 0x55808c8676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.542+0000 7f84c6ffd640 10 client.17841 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:22:33.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.542+0000 7f84e6ffd640 1 --2- 172.21.15.87:0/108344330 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55808c8652b0 0x55808c8676d0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5205057d47442982 server_cookie=bee09ef91e4a719b in_seq=0 out_seq=0 2024-09-13T17:22:33.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.543+0000 7f84c6ffd640 1 -- 172.21.15.87:0/108344330 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55808c7a01f0 con 0x55808c8652b0 2024-09-13T17:22:33.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.543+0000 7f84c6ffd640 10 client.17841 handle_command_reply: tid=0 2024-09-13T17:22:33.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.543+0000 7f84f1002740 1 client.17841 shutdown 2024-09-13T17:22:33.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.543+0000 7f84f1002740 1 -- 172.21.15.87:0/108344330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55808c84a970 msgr2=0x55808c8550c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.543+0000 7f84f1002740 1 --2- 172.21.15.87:0/108344330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55808c84a970 0x55808c8550c0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f84d000bfd0 tx=0x7f84d000f5b0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.543+0000 7f84f1002740 1 -- 172.21.15.87:0/108344330 shutdown_connections 2024-09-13T17:22:33.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.543+0000 7f84f1002740 1 --2- 172.21.15.87:0/108344330 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55808c8652b0 0x55808c8676d0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.543+0000 7f84f1002740 1 --2- 172.21.15.87:0/108344330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55808c855b30 0x55808c852920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.543+0000 7f84c6ffd640 0 client.17841 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:22:33.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.543+0000 7f84f1002740 1 --2- 172.21.15.87:0/108344330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55808c84b290 0x55808c8523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.543+0000 7f84f1002740 1 --2- 172.21.15.87:0/108344330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55808c84a970 0x55808c8550c0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.543+0000 7f84f1002740 1 -- 172.21.15.87:0/108344330 >> 172.21.15.87:0/108344330 conn(0x55808c846ee0 msgr2=0x55808c846230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:33.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.543+0000 7f84f1002740 1 -- 172.21.15.87:0/108344330 shutdown_connections 2024-09-13T17:22:33.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.543+0000 7f84f1002740 1 -- 172.21.15.87:0/108344330 wait complete. 2024-09-13T17:22:33.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.543+0000 7f84f1002740 20 client.17841 trim_cache size 0 max 16384 2024-09-13T17:22:33.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.554+0000 7f84f1002740 1 Processor -- start 2024-09-13T17:22:33.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.554+0000 7f84f1002740 1 -- start start 2024-09-13T17:22:33.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.554+0000 7f84f1002740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55808c84a970 0x55808c84dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.554+0000 7f84f1002740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55808c84b290 0x55808c86c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.554+0000 7f84f1002740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55808c855b30 0x55808c854bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.554+0000 7f84f1002740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55808c863b10 con 0x55808c855b30 2024-09-13T17:22:33.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.554+0000 7f84f1002740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55808c861920 con 0x55808c84a970 2024-09-13T17:22:33.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.554+0000 7f84f1002740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55808c86c5b0 con 0x55808c84b290 2024-09-13T17:22:33.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.554+0000 7f84e7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55808c855b30 0x55808c854bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.554+0000 7f84e7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55808c855b30 0x55808c854bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51996/0 (socket says 172.21.15.87:51996) 2024-09-13T17:22:33.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.554+0000 7f84e7fff640 1 -- 172.21.15.87:0/3338877121 learned_addr learned my addr 172.21.15.87:0/3338877121 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:33.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.555+0000 7f84e7fff640 1 -- 172.21.15.87:0/3338877121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55808c84b290 msgr2=0x55808c86c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:33.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.555+0000 7f84e7fff640 1 --2- 172.21.15.87:0/3338877121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55808c84b290 0x55808c86c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.555+0000 7f84e7fff640 1 -- 172.21.15.87:0/3338877121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55808c84a970 msgr2=0x55808c84dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:33.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.555+0000 7f84e7fff640 1 --2- 172.21.15.87:0/3338877121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55808c84a970 0x55808c84dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.555+0000 7f84e7fff640 1 -- 172.21.15.87:0/3338877121 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55808c74e770 con 0x55808c855b30 2024-09-13T17:22:33.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.555+0000 7f84e7fff640 1 --2- 172.21.15.87:0/3338877121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55808c855b30 0x55808c854bb0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f84e002aeb0 tx=0x7f84e00c0b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb28481456a0807 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:33.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.555+0000 7f84de7fc640 1 -- 172.21.15.87:0/3338877121 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e00bb710 con 0x55808c855b30 2024-09-13T17:22:33.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.555+0000 7f84de7fc640 1 -- 172.21.15.87:0/3338877121 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f84e00c0200 con 0x55808c855b30 2024-09-13T17:22:33.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.555+0000 7f84de7fc640 1 -- 172.21.15.87:0/3338877121 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e00db030 con 0x55808c855b30 2024-09-13T17:22:33.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.555+0000 7f84f1002740 1 -- 172.21.15.87:0/3338877121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55808c855b30 msgr2=0x55808c854bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.555+0000 7f84f1002740 1 --2- 172.21.15.87:0/3338877121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55808c855b30 0x55808c854bb0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f84e002aeb0 tx=0x7f84e00c0b60 comp rx=0 tx=0).stop 2024-09-13T17:22:33.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.555+0000 7f84f1002740 1 -- 172.21.15.87:0/3338877121 shutdown_connections 2024-09-13T17:22:33.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.555+0000 7f84f1002740 1 --2- 172.21.15.87:0/3338877121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55808c855b30 0x55808c854bb0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.555+0000 7f84f1002740 1 --2- 172.21.15.87:0/3338877121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55808c84b290 0x55808c86c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.555+0000 7f84f1002740 1 --2- 172.21.15.87:0/3338877121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55808c84a970 0x55808c84dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.555+0000 7f84f1002740 1 -- 172.21.15.87:0/3338877121 >> 172.21.15.87:0/3338877121 conn(0x55808c846ee0 msgr2=0x55808c84d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:33.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.555+0000 7f84f1002740 1 -- 172.21.15.87:0/3338877121 shutdown_connections 2024-09-13T17:22:33.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.555+0000 7f84f1002740 1 -- 172.21.15.87:0/3338877121 wait complete. 2024-09-13T17:22:33.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.556+0000 7f84f1002740 1 -- start start 2024-09-13T17:22:33.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.556+0000 7f84f1002740 1 Processor -- start 2024-09-13T17:22:33.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.556+0000 7f84f1002740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55808c84a970 0x55808c85afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.556+0000 7f84f1002740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55808c84b290 0x55808c85b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.556+0000 7f84f1002740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55808c855b30 0x55808c85c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.556+0000 7f84f1002740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55808c85c6b0 con 0x55808c84b290 2024-09-13T17:22:33.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.556+0000 7f84f1002740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55808c85c820 con 0x55808c84a970 2024-09-13T17:22:33.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.556+0000 7f84f1002740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55808c85c9e0 con 0x55808c855b30 2024-09-13T17:22:33.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.556+0000 7f84f1002740 10 client.0 _ll_register_callbacks cb 0x7f84e00b7ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:22:33.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.556+0000 7f84e6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55808c84b290 0x55808c85b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.556+0000 7f84e6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55808c84b290 0x55808c85b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52008/0 (socket says 172.21.15.87:52008) 2024-09-13T17:22:33.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.556+0000 7f84e6ffd640 1 -- 172.21.15.87:0/1059982225 learned_addr learned my addr 172.21.15.87:0/1059982225 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:33.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.556+0000 7f84e6ffd640 1 -- 172.21.15.87:0/1059982225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55808c855b30 msgr2=0x55808c85c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:33.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.556+0000 7f84e77fe640 1 --2- 172.21.15.87:0/1059982225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55808c84a970 0x55808c85afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.556+0000 7f84e6ffd640 1 --2- 172.21.15.87:0/1059982225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55808c855b30 0x55808c85c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.556+0000 7f84e6ffd640 1 -- 172.21.15.87:0/1059982225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55808c84a970 msgr2=0x55808c85afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:33.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.556+0000 7f84e6ffd640 1 --2- 172.21.15.87:0/1059982225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55808c84a970 0x55808c85afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.556+0000 7f84e6ffd640 1 -- 172.21.15.87:0/1059982225 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55808c775620 con 0x55808c84b290 2024-09-13T17:22:33.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.557+0000 7f84e6ffd640 1 --2- 172.21.15.87:0/1059982225 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55808c84b290 0x55808c85b520 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f84d8014010 tx=0x7f84d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e89311b87ecc75 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:33.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.557+0000 7f84c6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:22:33.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.557+0000 7f84c6ffd640 1 -- 172.21.15.87:0/1059982225 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d8005690 con 0x55808c84b290 2024-09-13T17:22:33.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.557+0000 7f84c6ffd640 1 -- 172.21.15.87:0/1059982225 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f84d802d030 con 0x55808c84b290 2024-09-13T17:22:33.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.557+0000 7f84f1002740 1 -- 172.21.15.87:0/1059982225 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f84e00bbe10 con 0x55808c84b290 2024-09-13T17:22:33.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.557+0000 7f84c6ffd640 1 -- 172.21.15.87:0/1059982225 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84d8013320 con 0x55808c84b290 2024-09-13T17:22:33.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.557+0000 7f84f1002740 10 client.17847 fetch_fsmap learned FSMap version 36 2024-09-13T17:22:33.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.557+0000 7f84f1002740 1 -- 172.21.15.87:0/1059982225 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55808c773e80 con 0x55808c84b290 2024-09-13T17:22:33.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.557+0000 7f84c6ffd640 1 -- 172.21.15.87:0/1059982225 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f84e00bbe10 con 0x55808c84b290 2024-09-13T17:22:33.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.557+0000 7f84c6ffd640 1 -- 172.21.15.87:0/1059982225 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f84d8004a80 con 0x55808c84b290 2024-09-13T17:22:33.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.557+0000 7f84f1002740 10 client.17847 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:22:33.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.557+0000 7f84f1002740 10 client.17847 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:22:33.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.557+0000 7f84f1002740 20 client.17847 populate_metadata read hostname 'smithi087' 2024-09-13T17:22:33.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.557+0000 7f84f1002740 1 --2- 172.21.15.87:0/1059982225 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55808c8bcb70 0x55808c8bef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.557+0000 7f84f1002740 4 client.17847 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:22:33.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.557+0000 7f84f1002740 1 -- 172.21.15.87:0/1059982225 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55808c4a14e0 con 0x55808c8bcb70 2024-09-13T17:22:33.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.558+0000 7f84e77fe640 1 --2- 172.21.15.87:0/1059982225 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55808c8bcb70 0x55808c8bef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.558+0000 7f84c6ffd640 10 client.17847 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:22:33.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.558+0000 7f84e77fe640 1 --2- 172.21.15.87:0/1059982225 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55808c8bcb70 0x55808c8bef90 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dc1f1a758b8b38be server_cookie=fea9f4fd9582a2c8 in_seq=0 out_seq=0 2024-09-13T17:22:33.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.558+0000 7f84c6ffd640 1 -- 172.21.15.87:0/1059982225 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55808c4a14e0 con 0x55808c8bcb70 2024-09-13T17:22:33.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.558+0000 7f84c6ffd640 10 client.17847 handle_command_reply: tid=0 2024-09-13T17:22:33.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.558+0000 7f84f1002740 1 client.17847 shutdown 2024-09-13T17:22:33.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.558+0000 7f84f1002740 1 -- 172.21.15.87:0/1059982225 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55808c84b290 msgr2=0x55808c85b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.558+0000 7f84f1002740 1 --2- 172.21.15.87:0/1059982225 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55808c84b290 0x55808c85b520 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f84d8014010 tx=0x7f84d80046c0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.558+0000 7f84f1002740 1 -- 172.21.15.87:0/1059982225 shutdown_connections 2024-09-13T17:22:33.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.558+0000 7f84f1002740 1 --2- 172.21.15.87:0/1059982225 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55808c8bcb70 0x55808c8bef90 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.558+0000 7f84f1002740 1 --2- 172.21.15.87:0/1059982225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55808c855b30 0x55808c85c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.558+0000 7f84f1002740 1 --2- 172.21.15.87:0/1059982225 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55808c84b290 0x55808c85b520 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.558+0000 7f84f1002740 1 --2- 172.21.15.87:0/1059982225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55808c84a970 0x55808c85afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.558+0000 7f84c6ffd640 0 client.17847 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:22:33.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.558+0000 7f84f1002740 1 -- 172.21.15.87:0/1059982225 >> 172.21.15.87:0/1059982225 conn(0x55808c846ee0 msgr2=0x55808c84c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:33.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.558+0000 7f84f1002740 1 -- 172.21.15.87:0/1059982225 shutdown_connections 2024-09-13T17:22:33.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.558+0000 7f84f1002740 1 -- 172.21.15.87:0/1059982225 wait complete. 2024-09-13T17:22:33.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.559+0000 7f84f1002740 20 client.17847 trim_cache size 0 max 16384 2024-09-13T17:22:33.567 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:22:33.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.559+0000 7f84ecfa0640 1 -- 172.21.15.87:0/3033448663 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f84d40a12b0 msgr2=0x7f84d40a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.559+0000 7f84ecfa0640 1 --2- 172.21.15.87:0/3033448663 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f84d40a12b0 0x7f84d40a3770 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f84d8005fd0 tx=0x7f84d800bb70 comp rx=0 tx=0).stop 2024-09-13T17:22:33.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.559+0000 7f84ecfa0640 1 -- 172.21.15.87:0/3033448663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84e810ceb0 msgr2=0x7f84e81a43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.559+0000 7f84ecfa0640 1 --2- 172.21.15.87:0/3033448663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84e810ceb0 0x7f84e81a43f0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f84e00097b0 tx=0x7f84e0031680 comp rx=0 tx=0).stop 2024-09-13T17:22:33.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.559+0000 7f84ecfa0640 1 -- 172.21.15.87:0/3033448663 shutdown_connections 2024-09-13T17:22:33.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.559+0000 7f84ecfa0640 1 --2- 172.21.15.87:0/3033448663 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f84d40a12b0 0x7f84d40a3770 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.559+0000 7f84ecfa0640 1 --2- 172.21.15.87:0/3033448663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84e810ceb0 0x7f84e81a43f0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.559+0000 7f84ecfa0640 1 --2- 172.21.15.87:0/3033448663 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84e8105150 0x7f84e810c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.559+0000 7f84ecfa0640 1 --2- 172.21.15.87:0/3033448663 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84e80ffb40 0x7f84e810c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.559+0000 7f84ecfa0640 1 -- 172.21.15.87:0/3033448663 >> 172.21.15.87:0/3033448663 conn(0x7f84e8075380 msgr2=0x7f84e8102ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:33.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.559+0000 7f84ecfa0640 1 -- 172.21.15.87:0/3033448663 shutdown_connections 2024-09-13T17:22:33.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.559+0000 7f84ecfa0640 1 -- 172.21.15.87:0/3033448663 wait complete. 2024-09-13T17:22:33.571 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-09-13T17:22:33.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.670+0000 7f4be1b1f640 1 -- 172.21.15.87:0/3598312005 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4bdc0fee60 msgr2=0x7f4bdc0ff240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.670+0000 7f4be1b1f640 1 --2- 172.21.15.87:0/3598312005 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4bdc0fee60 0x7f4bdc0ff240 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc009930 tx=0x7f4bcc02a420 comp rx=0 tx=0).stop 2024-09-13T17:22:33.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.670+0000 7f4be1b1f640 1 -- 172.21.15.87:0/3598312005 shutdown_connections 2024-09-13T17:22:33.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.670+0000 7f4be1b1f640 1 --2- 172.21.15.87:0/3598312005 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bdc103fb0 0x7f4bdc10bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.670+0000 7f4be1b1f640 1 --2- 172.21.15.87:0/3598312005 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bdc0ff810 0x7f4bdc103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.670+0000 7f4be1b1f640 1 --2- 172.21.15.87:0/3598312005 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4bdc0fee60 0x7f4bdc0ff240 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.670+0000 7f4be1b1f640 1 -- 172.21.15.87:0/3598312005 >> 172.21.15.87:0/3598312005 conn(0x7f4bdc075c60 msgr2=0x7f4bdc0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:33.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.670+0000 7f4be1b1f640 1 -- 172.21.15.87:0/3598312005 shutdown_connections 2024-09-13T17:22:33.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.670+0000 7f4be1b1f640 1 -- 172.21.15.87:0/3598312005 wait complete. 2024-09-13T17:22:33.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.670+0000 7f4be1b1f640 1 Processor -- start 2024-09-13T17:22:33.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.670+0000 7f4be1b1f640 1 -- start start 2024-09-13T17:22:33.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.671+0000 7f4be1b1f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4bdc0fee60 0x7f4bdc197150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.671+0000 7f4be1b1f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bdc103fb0 0x7f4bdc197690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.671+0000 7f4be1b1f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bdc197bd0 0x7f4bdc1a21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.671+0000 7f4be1b1f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc1a2870 con 0x7f4bdc0fee60 2024-09-13T17:22:33.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.671+0000 7f4be1b1f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc1a29e0 con 0x7f4bdc197bd0 2024-09-13T17:22:33.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.671+0000 7f4be1b1f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc1a2ba0 con 0x7f4bdc103fb0 2024-09-13T17:22:33.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.671+0000 7f4bdb7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4bdc0fee60 0x7f4bdc197150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.671+0000 7f4bdb7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4bdc0fee60 0x7f4bdc197150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52028/0 (socket says 172.21.15.87:52028) 2024-09-13T17:22:33.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.671+0000 7f4bdb7fe640 1 -- 172.21.15.87:0/3499249552 learned_addr learned my addr 172.21.15.87:0/3499249552 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:33.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.671+0000 7f4bdbfff640 1 --2- 172.21.15.87:0/3499249552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bdc197bd0 0x7f4bdc1a21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.671+0000 7f4bdaffd640 1 --2- 172.21.15.87:0/3499249552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bdc103fb0 0x7f4bdc197690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.671+0000 7f4bdb7fe640 1 -- 172.21.15.87:0/3499249552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bdc103fb0 msgr2=0x7f4bdc197690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.671+0000 7f4bdb7fe640 1 --2- 172.21.15.87:0/3499249552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bdc103fb0 0x7f4bdc197690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.671+0000 7f4bdb7fe640 1 -- 172.21.15.87:0/3499249552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bdc197bd0 msgr2=0x7f4bdc1a21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.671+0000 7f4bdb7fe640 1 --2- 172.21.15.87:0/3499249552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bdc197bd0 0x7f4bdc1a21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.671+0000 7f4bdb7fe640 1 -- 172.21.15.87:0/3499249552 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bcc009560 con 0x7f4bdc0fee60 2024-09-13T17:22:33.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.671+0000 7f4bdb7fe640 1 --2- 172.21.15.87:0/3499249552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4bdc0fee60 0x7f4bdc197150 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc009900 tx=0x7f4bcc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:33.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.671+0000 7f4bd8ff9640 1 -- 172.21.15.87:0/3499249552 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc003a00 con 0x7f4bdc0fee60 2024-09-13T17:22:33.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.671+0000 7f4bd8ff9640 1 -- 172.21.15.87:0/3499249552 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4bcc0044e0 con 0x7f4bdc0fee60 2024-09-13T17:22:33.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.671+0000 7f4bd8ff9640 1 -- 172.21.15.87:0/3499249552 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc03a3c0 con 0x7f4bdc0fee60 2024-09-13T17:22:33.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.671+0000 7f4be1b1f640 1 -- 172.21.15.87:0/3499249552 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bdc1a2e20 con 0x7f4bdc0fee60 2024-09-13T17:22:33.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.671+0000 7f4be1b1f640 1 -- 172.21.15.87:0/3499249552 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bdc1a3220 con 0x7f4bdc0fee60 2024-09-13T17:22:33.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.674+0000 7f4bd8ff9640 1 -- 172.21.15.87:0/3499249552 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f4bcc03b460 con 0x7f4bdc0fee60 2024-09-13T17:22:33.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.674+0000 7f4be4843740 1 Processor -- start 2024-09-13T17:22:33.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.674+0000 7f4be4843740 1 -- start start 2024-09-13T17:22:33.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.674+0000 7f4be4843740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a3e7aeb790 0x55a3e7aebb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.674+0000 7f4be4843740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3e7aec0b0 0x55a3e7af6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.674+0000 7f4be4843740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a3e7af6950 0x55a3e7af8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.674+0000 7f4be4843740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3e7a55cc0 con 0x55a3e7aeb790 2024-09-13T17:22:33.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.674+0000 7f4be4843740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3e7a53450 con 0x55a3e7aec0b0 2024-09-13T17:22:33.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.674+0000 7f4be4843740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3e7a4ed40 con 0x55a3e7af6950 2024-09-13T17:22:33.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.674+0000 7f4bd8ff9640 1 --2- 172.21.15.87:0/3499249552 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4bc40a1200 0x7f4bc40a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.674+0000 7f4bdbfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a3e7aeb790 0x55a3e7aebb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.674+0000 7f4bdbfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a3e7aeb790 0x55a3e7aebb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52036/0 (socket says 172.21.15.87:52036) 2024-09-13T17:22:33.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.674+0000 7f4bdbfff640 1 -- 172.21.15.87:0/90428619 learned_addr learned my addr 172.21.15.87:0/90428619 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:33.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.674+0000 7f4bdb7fe640 1 --2- 172.21.15.87:0/90428619 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3e7aec0b0 0x55a3e7af6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.674+0000 7f4bdbfff640 1 --2- 172.21.15.87:0/3499249552 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4bc40a1200 0x7f4bc40a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.674+0000 7f4bd8ff9640 1 -- 172.21.15.87:0/3499249552 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f4bcc0ee1e0 con 0x7f4bdc0fee60 2024-09-13T17:22:33.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.674+0000 7f4bdaffd640 1 --2- 172.21.15.87:0/90428619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a3e7af6950 0x55a3e7af8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.675+0000 7f4bdb7fe640 1 -- 172.21.15.87:0/90428619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a3e7af6950 msgr2=0x55a3e7af8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:33.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.675+0000 7f4bdb7fe640 1 --2- 172.21.15.87:0/90428619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a3e7af6950 0x55a3e7af8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.675+0000 7f4bdb7fe640 1 -- 172.21.15.87:0/90428619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a3e7aeb790 msgr2=0x55a3e7aebb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:33.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.675+0000 7f4bdb7fe640 1 --2- 172.21.15.87:0/90428619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a3e7aeb790 0x55a3e7aebb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.675+0000 7f4bdb7fe640 1 -- 172.21.15.87:0/90428619 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3e7a16620 con 0x55a3e7aec0b0 2024-09-13T17:22:33.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.675+0000 7f4bdbfff640 1 --2- 172.21.15.87:0/90428619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a3e7aeb790 0x55a3e7aebb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:22:33.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.675+0000 7f4bdbfff640 1 --2- 172.21.15.87:0/3499249552 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4bc40a1200 0x7f4bc40a36c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4bd40138f0 tx=0x7f4bd400e750 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:33.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.675+0000 7f4bdb7fe640 1 --2- 172.21.15.87:0/90428619 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3e7aec0b0 0x55a3e7af6410 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc0eb4c0 tx=0x7f4bcc0868d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5e4221af1690848 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:33.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.675+0000 7f4bc1ffb640 1 -- 172.21.15.87:0/90428619 <== mon.2 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc0bb580 con 0x55a3e7aec0b0 2024-09-13T17:22:33.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.675+0000 7f4bc1ffb640 1 -- 172.21.15.87:0/90428619 <== mon.2 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4bcc0bbe90 con 0x55a3e7aec0b0 2024-09-13T17:22:33.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.675+0000 7f4bc1ffb640 1 -- 172.21.15.87:0/90428619 <== mon.2 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc0c3300 con 0x55a3e7aec0b0 2024-09-13T17:22:33.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.676+0000 7f4be4843740 1 -- 172.21.15.87:0/90428619 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3e7aec0b0 msgr2=0x55a3e7af6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.676+0000 7f4be4843740 1 --2- 172.21.15.87:0/90428619 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3e7aec0b0 0x55a3e7af6410 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc0eb4c0 tx=0x7f4bcc0868d0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.676+0000 7f4be4843740 1 -- 172.21.15.87:0/90428619 shutdown_connections 2024-09-13T17:22:33.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.676+0000 7f4be4843740 1 --2- 172.21.15.87:0/90428619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a3e7af6950 0x55a3e7af8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.676+0000 7f4be4843740 1 --2- 172.21.15.87:0/90428619 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3e7aec0b0 0x55a3e7af6410 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.676+0000 7f4be4843740 1 --2- 172.21.15.87:0/90428619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a3e7aeb790 0x55a3e7aebb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.676+0000 7f4be4843740 1 -- 172.21.15.87:0/90428619 >> 172.21.15.87:0/90428619 conn(0x55a3e7ae7d00 msgr2=0x55a3e7ae80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:33.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.676+0000 7f4be4843740 1 -- 172.21.15.87:0/90428619 shutdown_connections 2024-09-13T17:22:33.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.676+0000 7f4be4843740 1 -- 172.21.15.87:0/90428619 wait complete. 2024-09-13T17:22:33.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.676+0000 7f4be4843740 1 -- start start 2024-09-13T17:22:33.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.676+0000 7f4be4843740 1 Processor -- start 2024-09-13T17:22:33.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.677+0000 7f4be4843740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a3e7aeb790 0x55a3e7af5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.677+0000 7f4be4843740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3e7aec0b0 0x55a3e7af3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.677+0000 7f4be4843740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a3e7af6950 0x55a3e7af3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.677+0000 7f4be4843740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3e7a0d180 con 0x55a3e7af6950 2024-09-13T17:22:33.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.677+0000 7f4be4843740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3e7727430 con 0x55a3e7aec0b0 2024-09-13T17:22:33.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.677+0000 7f4be4843740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3e79d25e0 con 0x55a3e7aeb790 2024-09-13T17:22:33.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.677+0000 7f4be4843740 10 client.0 _ll_register_callbacks cb 0x55a3e7a3eaa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:22:33.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.677+0000 7f4bdbfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a3e7af6950 0x55a3e7af3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.677+0000 7f4bdbfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a3e7af6950 0x55a3e7af3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52040/0 (socket says 172.21.15.87:52040) 2024-09-13T17:22:33.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.677+0000 7f4bdbfff640 1 -- 172.21.15.87:0/84914908 learned_addr learned my addr 172.21.15.87:0/84914908 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:33.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.677+0000 7f4bdb7fe640 1 --2- 172.21.15.87:0/84914908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a3e7aeb790 0x55a3e7af5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.677+0000 7f4bdaffd640 1 --2- 172.21.15.87:0/84914908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3e7aec0b0 0x55a3e7af3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.677+0000 7f4bdbfff640 1 -- 172.21.15.87:0/84914908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a3e7aeb790 msgr2=0x55a3e7af5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:33.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.677+0000 7f4bdbfff640 1 --2- 172.21.15.87:0/84914908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a3e7aeb790 0x55a3e7af5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.677+0000 7f4bdbfff640 1 -- 172.21.15.87:0/84914908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3e7aec0b0 msgr2=0x55a3e7af3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:33.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.677+0000 7f4bdbfff640 1 --2- 172.21.15.87:0/84914908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3e7aec0b0 0x55a3e7af3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.677+0000 7f4bdbfff640 1 -- 172.21.15.87:0/84914908 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bdc1a3220 con 0x55a3e7af6950 2024-09-13T17:22:33.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.677+0000 7f4bdbfff640 1 --2- 172.21.15.87:0/84914908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a3e7af6950 0x55a3e7af3780 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4010fb0 tx=0x7f4bd400e430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce05e3cc1148a0c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:33.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.677+0000 7f4bbaffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:22:33.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.677+0000 7f4bbaffd640 1 -- 172.21.15.87:0/84914908 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4004220 con 0x55a3e7af6950 2024-09-13T17:22:33.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.677+0000 7f4bbaffd640 1 -- 172.21.15.87:0/84914908 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f4bd400ea20 con 0x55a3e7af6950 2024-09-13T17:22:33.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.677+0000 7f4be4843740 1 -- 172.21.15.87:0/84914908 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a3e7a78b80 con 0x55a3e7af6950 2024-09-13T17:22:33.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.678+0000 7f4bbaffd640 1 -- 172.21.15.87:0/84914908 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4bd400ece0 con 0x55a3e7af6950 2024-09-13T17:22:33.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.678+0000 7f4be4843740 10 client.17859 fetch_fsmap learned FSMap version 36 2024-09-13T17:22:33.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.678+0000 7f4be4843740 1 -- 172.21.15.87:0/84914908 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55a3e7a4d3c0 con 0x55a3e7af6950 2024-09-13T17:22:33.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.678+0000 7f4bbaffd640 1 -- 172.21.15.87:0/84914908 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55a3e7a78b80 con 0x55a3e7af6950 2024-09-13T17:22:33.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.678+0000 7f4bbaffd640 1 -- 172.21.15.87:0/84914908 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f4bd401f480 con 0x55a3e7af6950 2024-09-13T17:22:33.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.678+0000 7f4be4843740 10 client.17859 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:22:33.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.678+0000 7f4be4843740 10 client.17859 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:22:33.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.678+0000 7f4be4843740 20 client.17859 populate_metadata read hostname 'smithi087' 2024-09-13T17:22:33.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.678+0000 7f4be4843740 1 --2- 172.21.15.87:0/84914908 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55a3e7b05ee0 0x55a3e7b08300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.678+0000 7f4be4843740 4 client.17859 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:22:33.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.678+0000 7f4be4843740 1 -- 172.21.15.87:0/84914908 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a3e7a411f0 con 0x55a3e7b05ee0 2024-09-13T17:22:33.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.678+0000 7f4bdb7fe640 1 --2- 172.21.15.87:0/84914908 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55a3e7b05ee0 0x55a3e7b08300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.679+0000 7f4bbaffd640 10 client.17859 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:22:33.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.679+0000 7f4bdb7fe640 1 --2- 172.21.15.87:0/84914908 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55a3e7b05ee0 0x55a3e7b08300 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bfb57e1649fec7d7 server_cookie=7f2f1b01de736ae in_seq=0 out_seq=0 2024-09-13T17:22:33.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.679+0000 7f4bbaffd640 1 -- 172.21.15.87:0/84914908 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55a3e7a411f0 con 0x55a3e7b05ee0 2024-09-13T17:22:33.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.679+0000 7f4bbaffd640 10 client.17859 handle_command_reply: tid=0 2024-09-13T17:22:33.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.679+0000 7f4be4843740 1 client.17859 shutdown 2024-09-13T17:22:33.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.680+0000 7f4be4843740 1 -- 172.21.15.87:0/84914908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a3e7af6950 msgr2=0x55a3e7af3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.680+0000 7f4be4843740 1 --2- 172.21.15.87:0/84914908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a3e7af6950 0x55a3e7af3780 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4010fb0 tx=0x7f4bd400e430 comp rx=0 tx=0).stop 2024-09-13T17:22:33.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.680+0000 7f4be4843740 1 -- 172.21.15.87:0/84914908 shutdown_connections 2024-09-13T17:22:33.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.680+0000 7f4be4843740 1 --2- 172.21.15.87:0/84914908 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55a3e7b05ee0 0x55a3e7b08300 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.680+0000 7f4be4843740 1 --2- 172.21.15.87:0/84914908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a3e7af6950 0x55a3e7af3780 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.680+0000 7f4bbaffd640 0 client.17859 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:22:33.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.680+0000 7f4be4843740 1 --2- 172.21.15.87:0/84914908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3e7aec0b0 0x55a3e7af3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.680+0000 7f4be4843740 1 --2- 172.21.15.87:0/84914908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a3e7aeb790 0x55a3e7af5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.680+0000 7f4be4843740 1 -- 172.21.15.87:0/84914908 >> 172.21.15.87:0/84914908 conn(0x55a3e7ae7d00 msgr2=0x55a3e7aeda60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:33.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.680+0000 7f4be4843740 1 -- 172.21.15.87:0/84914908 shutdown_connections 2024-09-13T17:22:33.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.680+0000 7f4be4843740 1 -- 172.21.15.87:0/84914908 wait complete. 2024-09-13T17:22:33.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.680+0000 7f4be4843740 20 client.17859 trim_cache size 0 max 16384 2024-09-13T17:22:33.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.691+0000 7f4be4843740 1 Processor -- start 2024-09-13T17:22:33.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.691+0000 7f4be4843740 1 -- start start 2024-09-13T17:22:33.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.691+0000 7f4be4843740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a3e7aeb790 0x55a3e7ae76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.691+0000 7f4be4843740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3e7aec0b0 0x55a3e7aeea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.691+0000 7f4be4843740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a3e7af6950 0x55a3e7af0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.691+0000 7f4be4843740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3e7a78b80 con 0x55a3e7af6950 2024-09-13T17:22:33.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.691+0000 7f4be4843740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3e7aeb510 con 0x55a3e7aec0b0 2024-09-13T17:22:33.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.691+0000 7f4be4843740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3e7af64e0 con 0x55a3e7aeb790 2024-09-13T17:22:33.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.691+0000 7f4bdbfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a3e7af6950 0x55a3e7af0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.691+0000 7f4bdbfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a3e7af6950 0x55a3e7af0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52048/0 (socket says 172.21.15.87:52048) 2024-09-13T17:22:33.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.691+0000 7f4bdbfff640 1 -- 172.21.15.87:0/2481123948 learned_addr learned my addr 172.21.15.87:0/2481123948 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:33.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.691+0000 7f4bdb7fe640 1 --2- 172.21.15.87:0/2481123948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a3e7aeb790 0x55a3e7ae76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.691+0000 7f4bdbfff640 1 -- 172.21.15.87:0/2481123948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a3e7aeb790 msgr2=0x55a3e7ae76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:33.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.691+0000 7f4bdbfff640 1 --2- 172.21.15.87:0/2481123948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a3e7aeb790 0x55a3e7ae76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.691+0000 7f4bdbfff640 1 -- 172.21.15.87:0/2481123948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3e7aec0b0 msgr2=0x55a3e7aeea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:33.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.691+0000 7f4bdaffd640 1 --2- 172.21.15.87:0/2481123948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3e7aec0b0 0x55a3e7aeea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.691+0000 7f4bdbfff640 1 --2- 172.21.15.87:0/2481123948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3e7aec0b0 0x55a3e7aeea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.691+0000 7f4bdbfff640 1 -- 172.21.15.87:0/2481123948 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3e79ef770 con 0x55a3e7af6950 2024-09-13T17:22:33.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.691+0000 7f4bdaffd640 1 --2- 172.21.15.87:0/2481123948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3e7aec0b0 0x55a3e7aeea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:22:33.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.691+0000 7f4bdbfff640 1 --2- 172.21.15.87:0/2481123948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a3e7af6950 0x55a3e7af0480 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f4bd401f9a0 tx=0x7f4bd401f9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=989c478415c7a03d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:33.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.691+0000 7f4bc27fc640 1 -- 172.21.15.87:0/2481123948 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd400ea20 con 0x55a3e7af6950 2024-09-13T17:22:33.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.691+0000 7f4bc27fc640 1 -- 172.21.15.87:0/2481123948 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4bd4019040 con 0x55a3e7af6950 2024-09-13T17:22:33.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.691+0000 7f4bc27fc640 1 -- 172.21.15.87:0/2481123948 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4004aa0 con 0x55a3e7af6950 2024-09-13T17:22:33.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.692+0000 7f4be4843740 1 -- 172.21.15.87:0/2481123948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a3e7af6950 msgr2=0x55a3e7af0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.692+0000 7f4be4843740 1 --2- 172.21.15.87:0/2481123948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a3e7af6950 0x55a3e7af0480 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f4bd401f9a0 tx=0x7f4bd401f9d0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.692+0000 7f4be4843740 1 -- 172.21.15.87:0/2481123948 shutdown_connections 2024-09-13T17:22:33.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.692+0000 7f4be4843740 1 --2- 172.21.15.87:0/2481123948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a3e7af6950 0x55a3e7af0480 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.692+0000 7f4be4843740 1 --2- 172.21.15.87:0/2481123948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3e7aec0b0 0x55a3e7aeea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.692+0000 7f4be4843740 1 --2- 172.21.15.87:0/2481123948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a3e7aeb790 0x55a3e7ae76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.692+0000 7f4be4843740 1 -- 172.21.15.87:0/2481123948 >> 172.21.15.87:0/2481123948 conn(0x55a3e7ae7d00 msgr2=0x55a3e7aee360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:33.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.692+0000 7f4be4843740 1 -- 172.21.15.87:0/2481123948 shutdown_connections 2024-09-13T17:22:33.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.692+0000 7f4be4843740 1 -- 172.21.15.87:0/2481123948 wait complete. 2024-09-13T17:22:33.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.692+0000 7f4be4843740 1 -- start start 2024-09-13T17:22:33.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.692+0000 7f4be4843740 1 Processor -- start 2024-09-13T17:22:33.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.693+0000 7f4be4843740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a3e7aeb790 0x55a3e7afafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.693+0000 7f4be4843740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a3e7aec0b0 0x55a3e7af9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.693+0000 7f4be4843740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3e7af6950 0x55a3e7af9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.693+0000 7f4be4843740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3e7af9e90 con 0x55a3e7aeb790 2024-09-13T17:22:33.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.693+0000 7f4be4843740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3e7afa000 con 0x55a3e7af6950 2024-09-13T17:22:33.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.693+0000 7f4be4843740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3e7afa1c0 con 0x55a3e7aec0b0 2024-09-13T17:22:33.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.693+0000 7f4be4843740 10 client.0 _ll_register_callbacks cb 0x7f4bcc005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:22:33.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.693+0000 7f4bdb7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a3e7aeb790 0x55a3e7afafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.693+0000 7f4bdb7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a3e7aeb790 0x55a3e7afafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52058/0 (socket says 172.21.15.87:52058) 2024-09-13T17:22:33.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.693+0000 7f4bdb7fe640 1 -- 172.21.15.87:0/1863021317 learned_addr learned my addr 172.21.15.87:0/1863021317 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:33.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.693+0000 7f4bdaffd640 1 --2- 172.21.15.87:0/1863021317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a3e7aec0b0 0x55a3e7af9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.693+0000 7f4bdbfff640 1 --2- 172.21.15.87:0/1863021317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3e7af6950 0x55a3e7af9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.693+0000 7f4bdb7fe640 1 -- 172.21.15.87:0/1863021317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a3e7aec0b0 msgr2=0x55a3e7af9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:33.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.693+0000 7f4bdb7fe640 1 --2- 172.21.15.87:0/1863021317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a3e7aec0b0 0x55a3e7af9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.693+0000 7f4bdb7fe640 1 -- 172.21.15.87:0/1863021317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3e7af6950 msgr2=0x55a3e7af9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:33.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.693+0000 7f4bdb7fe640 1 --2- 172.21.15.87:0/1863021317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3e7af6950 0x55a3e7af9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.693+0000 7f4bdb7fe640 1 -- 172.21.15.87:0/1863021317 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a3e7a4d3c0 con 0x55a3e7aeb790 2024-09-13T17:22:33.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.693+0000 7f4bdbfff640 1 --2- 172.21.15.87:0/1863021317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3e7af6950 0x55a3e7af9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:22:33.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.693+0000 7f4bdb7fe640 1 --2- 172.21.15.87:0/1863021317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a3e7aeb790 0x55a3e7afafa0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc0b7380 tx=0x7f4bcc04e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c60d71b824a6c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:33.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.693+0000 7f4bbaffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:22:33.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.693+0000 7f4bbaffd640 1 -- 172.21.15.87:0/1863021317 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc03f040 con 0x55a3e7aeb790 2024-09-13T17:22:33.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.693+0000 7f4bbaffd640 1 -- 172.21.15.87:0/1863021317 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f4bcc0c3300 con 0x55a3e7aeb790 2024-09-13T17:22:33.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.693+0000 7f4be4843740 1 -- 172.21.15.87:0/1863021317 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4bcc0bbe90 con 0x55a3e7aeb790 2024-09-13T17:22:33.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.694+0000 7f4bbaffd640 1 -- 172.21.15.87:0/1863021317 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4bcc0869c0 con 0x55a3e7aeb790 2024-09-13T17:22:33.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.694+0000 7f4be4843740 10 client.17865 fetch_fsmap learned FSMap version 36 2024-09-13T17:22:33.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.694+0000 7f4be4843740 1 -- 172.21.15.87:0/1863021317 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55a3e7a14e80 con 0x55a3e7aeb790 2024-09-13T17:22:33.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.694+0000 7f4bbaffd640 1 -- 172.21.15.87:0/1863021317 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4bcc0bbe90 con 0x55a3e7aeb790 2024-09-13T17:22:33.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.694+0000 7f4bbaffd640 1 -- 172.21.15.87:0/1863021317 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f4bcc04e070 con 0x55a3e7aeb790 2024-09-13T17:22:33.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.694+0000 7f4be4843740 10 client.17865 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:22:33.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.694+0000 7f4be4843740 10 client.17865 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:22:33.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.694+0000 7f4be4843740 20 client.17865 populate_metadata read hostname 'smithi087' 2024-09-13T17:22:33.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.694+0000 7f4be4843740 1 --2- 172.21.15.87:0/1863021317 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55a3e7b5d560 0x55a3e7b5f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.694+0000 7f4be4843740 4 client.17865 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:22:33.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.694+0000 7f4be4843740 1 -- 172.21.15.87:0/1863021317 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a3e77424e0 con 0x55a3e7b5d560 2024-09-13T17:22:33.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.694+0000 7f4bdaffd640 1 --2- 172.21.15.87:0/1863021317 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55a3e7b5d560 0x55a3e7b5f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.694+0000 7f4bdaffd640 1 --2- 172.21.15.87:0/1863021317 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55a3e7b5d560 0x55a3e7b5f980 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4cfc1c08c339c985 server_cookie=727e91eedd4539c6 in_seq=0 out_seq=0 2024-09-13T17:22:33.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.694+0000 7f4bbaffd640 10 client.17865 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:22:33.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.695+0000 7f4bbaffd640 1 -- 172.21.15.87:0/1863021317 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a3e77424e0 con 0x55a3e7b5d560 2024-09-13T17:22:33.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.695+0000 7f4bbaffd640 10 client.17865 handle_command_reply: tid=0 2024-09-13T17:22:33.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.695+0000 7f4be4843740 1 client.17865 shutdown 2024-09-13T17:22:33.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.695+0000 7f4be4843740 1 -- 172.21.15.87:0/1863021317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a3e7aeb790 msgr2=0x55a3e7afafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.695+0000 7f4be4843740 1 --2- 172.21.15.87:0/1863021317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a3e7aeb790 0x55a3e7afafa0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc0b7380 tx=0x7f4bcc04e000 comp rx=0 tx=0).stop 2024-09-13T17:22:33.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.695+0000 7f4be4843740 1 -- 172.21.15.87:0/1863021317 shutdown_connections 2024-09-13T17:22:33.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.695+0000 7f4be4843740 1 --2- 172.21.15.87:0/1863021317 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55a3e7b5d560 0x55a3e7b5f980 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.695+0000 7f4be4843740 1 --2- 172.21.15.87:0/1863021317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3e7af6950 0x55a3e7af9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.695+0000 7f4bbaffd640 0 client.17865 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:22:33.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.695+0000 7f4be4843740 1 --2- 172.21.15.87:0/1863021317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a3e7aec0b0 0x55a3e7af9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.695+0000 7f4be4843740 1 --2- 172.21.15.87:0/1863021317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a3e7aeb790 0x55a3e7afafa0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.695+0000 7f4be4843740 1 -- 172.21.15.87:0/1863021317 >> 172.21.15.87:0/1863021317 conn(0x55a3e7ae7d00 msgr2=0x55a3e7af1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:33.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.695+0000 7f4be4843740 1 -- 172.21.15.87:0/1863021317 shutdown_connections 2024-09-13T17:22:33.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.695+0000 7f4be4843740 1 -- 172.21.15.87:0/1863021317 wait complete. 2024-09-13T17:22:33.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.695+0000 7f4be4843740 20 client.17865 trim_cache size 0 max 16384 2024-09-13T17:22:33.705 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:22:33.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.695+0000 7f4be1b1f640 1 -- 172.21.15.87:0/3499249552 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4bc40a1200 msgr2=0x7f4bc40a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.695+0000 7f4be1b1f640 1 --2- 172.21.15.87:0/3499249552 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4bc40a1200 0x7f4bc40a36c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4bd40138f0 tx=0x7f4bd400e750 comp rx=0 tx=0).stop 2024-09-13T17:22:33.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.695+0000 7f4be1b1f640 1 -- 172.21.15.87:0/3499249552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4bdc0fee60 msgr2=0x7f4bdc197150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.695+0000 7f4be1b1f640 1 --2- 172.21.15.87:0/3499249552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4bdc0fee60 0x7f4bdc197150 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc009900 tx=0x7f4bcc0042f0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.695+0000 7f4be1b1f640 1 -- 172.21.15.87:0/3499249552 shutdown_connections 2024-09-13T17:22:33.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.696+0000 7f4be1b1f640 1 --2- 172.21.15.87:0/3499249552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bdc197bd0 0x7f4bdc1a21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.696+0000 7f4be1b1f640 1 --2- 172.21.15.87:0/3499249552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bdc103fb0 0x7f4bdc197690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.696+0000 7f4be1b1f640 1 --2- 172.21.15.87:0/3499249552 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4bc40a1200 0x7f4bc40a36c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.696+0000 7f4be1b1f640 1 --2- 172.21.15.87:0/3499249552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4bdc0fee60 0x7f4bdc197150 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.696+0000 7f4be1b1f640 1 -- 172.21.15.87:0/3499249552 >> 172.21.15.87:0/3499249552 conn(0x7f4bdc075c60 msgr2=0x7f4bdc1022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:33.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.696+0000 7f4be1b1f640 1 -- 172.21.15.87:0/3499249552 shutdown_connections 2024-09-13T17:22:33.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.696+0000 7f4be1b1f640 1 -- 172.21.15.87:0/3499249552 wait complete. 2024-09-13T17:22:33.707 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:33 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/773146948' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:22:33.708 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-09-13T17:22:33.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.806+0000 7fed7a696640 1 -- 172.21.15.87:0/2815086489 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed740fee50 msgr2=0x7fed740ff230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.806+0000 7fed7a696640 1 --2- 172.21.15.87:0/2815086489 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed740fee50 0x7fed740ff230 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fed64009930 tx=0x7fed6402a420 comp rx=0 tx=0).stop 2024-09-13T17:22:33.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.806+0000 7fed7a696640 1 -- 172.21.15.87:0/2815086489 shutdown_connections 2024-09-13T17:22:33.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.806+0000 7fed7a696640 1 --2- 172.21.15.87:0/2815086489 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed74103fa0 0x7fed7410baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.806+0000 7fed7a696640 1 --2- 172.21.15.87:0/2815086489 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed740ff800 0x7fed74103840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.806+0000 7fed7a696640 1 --2- 172.21.15.87:0/2815086489 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed740fee50 0x7fed740ff230 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.806+0000 7fed7a696640 1 -- 172.21.15.87:0/2815086489 >> 172.21.15.87:0/2815086489 conn(0x7fed740fa8e0 msgr2=0x7fed740fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:33.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.806+0000 7fed7a696640 1 -- 172.21.15.87:0/2815086489 shutdown_connections 2024-09-13T17:22:33.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.806+0000 7fed7a696640 1 -- 172.21.15.87:0/2815086489 wait complete. 2024-09-13T17:22:33.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.806+0000 7fed7a696640 1 Processor -- start 2024-09-13T17:22:33.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.807+0000 7fed7a696640 1 -- start start 2024-09-13T17:22:33.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.807+0000 7fed7a696640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed740fee50 0x7fed741951c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.807+0000 7fed7a696640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed74103fa0 0x7fed74195700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.807+0000 7fed7a696640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed74199af0 0x7fed74199fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.807+0000 7fed7a696640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7419a4e0 con 0x7fed74199af0 2024-09-13T17:22:33.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.807+0000 7fed7a696640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7419a650 con 0x7fed74103fa0 2024-09-13T17:22:33.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.807+0000 7fed7a696640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7419a7c0 con 0x7fed740fee50 2024-09-13T17:22:33.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.807+0000 7fed78c33640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed74199af0 0x7fed74199fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.807+0000 7fed78c33640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed74199af0 0x7fed74199fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52070/0 (socket says 172.21.15.87:52070) 2024-09-13T17:22:33.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.807+0000 7fed78c33640 1 -- 172.21.15.87:0/2038510351 learned_addr learned my addr 172.21.15.87:0/2038510351 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:33.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.807+0000 7fed73fff640 1 --2- 172.21.15.87:0/2038510351 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed740fee50 0x7fed741951c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.807+0000 7fed6bfff640 1 --2- 172.21.15.87:0/2038510351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed74103fa0 0x7fed74195700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.807+0000 7fed78c33640 1 -- 172.21.15.87:0/2038510351 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed740fee50 msgr2=0x7fed741951c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.807+0000 7fed78c33640 1 --2- 172.21.15.87:0/2038510351 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed740fee50 0x7fed741951c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.807+0000 7fed78c33640 1 -- 172.21.15.87:0/2038510351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed74103fa0 msgr2=0x7fed74195700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.807+0000 7fed78c33640 1 --2- 172.21.15.87:0/2038510351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed74103fa0 0x7fed74195700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.807+0000 7fed78c33640 1 -- 172.21.15.87:0/2038510351 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed64009560 con 0x7fed74199af0 2024-09-13T17:22:33.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.807+0000 7fed78c33640 1 --2- 172.21.15.87:0/2038510351 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed74199af0 0x7fed74199fa0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fed6c007c30 tx=0x7fed6c00e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:33.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.807+0000 7fed71ffb640 1 -- 172.21.15.87:0/2038510351 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6c011070 con 0x7fed74199af0 2024-09-13T17:22:33.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.808+0000 7fed7a696640 1 -- 172.21.15.87:0/2038510351 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed740685b0 con 0x7fed74199af0 2024-09-13T17:22:33.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.808+0000 7fed71ffb640 1 -- 172.21.15.87:0/2038510351 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fed6c00c2e0 con 0x7fed74199af0 2024-09-13T17:22:33.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.808+0000 7fed71ffb640 1 -- 172.21.15.87:0/2038510351 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6c0054c0 con 0x7fed74199af0 2024-09-13T17:22:33.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.808+0000 7fed7a696640 1 -- 172.21.15.87:0/2038510351 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed74068a60 con 0x7fed74199af0 2024-09-13T17:22:33.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.810+0000 7fed71ffb640 1 -- 172.21.15.87:0/2038510351 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fed6c00eb60 con 0x7fed74199af0 2024-09-13T17:22:33.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.810+0000 7fed7d3ba740 1 Processor -- start 2024-09-13T17:22:33.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.810+0000 7fed7d3ba740 1 -- start start 2024-09-13T17:22:33.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.810+0000 7fed7d3ba740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610c7d34790 0x5610c7d34b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.810+0000 7fed7d3ba740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5610c7d350b0 0x5610c7d3f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.810+0000 7fed7d3ba740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5610c7d3f950 0x5610c7d41d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.810+0000 7fed7d3ba740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c7c9ecc0 con 0x5610c7d34790 2024-09-13T17:22:33.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.810+0000 7fed7d3ba740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c7c9c450 con 0x5610c7d3f950 2024-09-13T17:22:33.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.810+0000 7fed7d3ba740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c7c97d40 con 0x5610c7d350b0 2024-09-13T17:22:33.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.811+0000 7fed6bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610c7d34790 0x5610c7d34b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.811+0000 7fed6bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610c7d34790 0x5610c7d34b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52078/0 (socket says 172.21.15.87:52078) 2024-09-13T17:22:33.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.811+0000 7fed6bfff640 1 -- 172.21.15.87:0/513428938 learned_addr learned my addr 172.21.15.87:0/513428938 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:33.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.811+0000 7fed73fff640 1 --2- 172.21.15.87:0/513428938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5610c7d350b0 0x5610c7d3f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.811+0000 7fed6bfff640 1 -- 172.21.15.87:0/513428938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5610c7d350b0 msgr2=0x5610c7d3f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:33.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.811+0000 7fed6bfff640 1 --2- 172.21.15.87:0/513428938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5610c7d350b0 0x5610c7d3f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.811+0000 7fed6bfff640 1 -- 172.21.15.87:0/513428938 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5610c7d3f950 msgr2=0x5610c7d41d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:33.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.811+0000 7fed6bfff640 1 --2- 172.21.15.87:0/513428938 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5610c7d3f950 0x5610c7d41d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.811+0000 7fed6bfff640 1 -- 172.21.15.87:0/513428938 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610c7c5f620 con 0x5610c7d34790 2024-09-13T17:22:33.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.811+0000 7fed71ffb640 1 --2- 172.21.15.87:0/2038510351 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fed600a1200 0x7fed600a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.811+0000 7fed6bfff640 1 --2- 172.21.15.87:0/513428938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610c7d34790 0x5610c7d34b70 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fed5c004650 tx=0x7fed5c00bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941e6124dc80672c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:33.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.811+0000 7fed73fff640 1 --2- 172.21.15.87:0/2038510351 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fed600a1200 0x7fed600a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.811+0000 7fed71ffb640 1 -- 172.21.15.87:0/2038510351 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fed6c0ce740 con 0x7fed74199af0 2024-09-13T17:22:33.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.811+0000 7fed6a7fc640 1 -- 172.21.15.87:0/513428938 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c0042a0 con 0x5610c7d34790 2024-09-13T17:22:33.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.811+0000 7fed6a7fc640 1 -- 172.21.15.87:0/513428938 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fed5c00be70 con 0x5610c7d34790 2024-09-13T17:22:33.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.811+0000 7fed6a7fc640 1 -- 172.21.15.87:0/513428938 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c004de0 con 0x5610c7d34790 2024-09-13T17:22:33.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.812+0000 7fed7d3ba740 1 -- 172.21.15.87:0/513428938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610c7d34790 msgr2=0x5610c7d34b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.812+0000 7fed73fff640 1 --2- 172.21.15.87:0/2038510351 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fed600a1200 0x7fed600a36c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fed64005ab0 tx=0x7fed64005a20 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:33.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.812+0000 7fed7d3ba740 1 --2- 172.21.15.87:0/513428938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610c7d34790 0x5610c7d34b70 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fed5c004650 tx=0x7fed5c00bc20 comp rx=0 tx=0).stop 2024-09-13T17:22:33.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.812+0000 7fed7d3ba740 1 -- 172.21.15.87:0/513428938 shutdown_connections 2024-09-13T17:22:33.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.812+0000 7fed7d3ba740 1 --2- 172.21.15.87:0/513428938 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5610c7d3f950 0x5610c7d41d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.812+0000 7fed7d3ba740 1 --2- 172.21.15.87:0/513428938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5610c7d350b0 0x5610c7d3f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.812+0000 7fed7d3ba740 1 --2- 172.21.15.87:0/513428938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610c7d34790 0x5610c7d34b70 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.812+0000 7fed7d3ba740 1 -- 172.21.15.87:0/513428938 >> 172.21.15.87:0/513428938 conn(0x5610c7d30d00 msgr2=0x5610c7d310e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:33.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.812+0000 7fed7d3ba740 1 -- 172.21.15.87:0/513428938 shutdown_connections 2024-09-13T17:22:33.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.812+0000 7fed7d3ba740 1 -- 172.21.15.87:0/513428938 wait complete. 2024-09-13T17:22:33.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.812+0000 7fed7d3ba740 1 -- start start 2024-09-13T17:22:33.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.812+0000 7fed7d3ba740 1 Processor -- start 2024-09-13T17:22:33.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.813+0000 7fed7d3ba740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610c7d34790 0x5610c7d43630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.813+0000 7fed7d3ba740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5610c7d350b0 0x5610c7d43b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.813+0000 7fed7d3ba740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5610c7d3f950 0x5610c7d47b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.813+0000 7fed7d3ba740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c7c56180 con 0x5610c7d34790 2024-09-13T17:22:33.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.813+0000 7fed7d3ba740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c7970430 con 0x5610c7d3f950 2024-09-13T17:22:33.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.813+0000 7fed7d3ba740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c7c1b5e0 con 0x5610c7d350b0 2024-09-13T17:22:33.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.813+0000 7fed7d3ba740 10 client.0 _ll_register_callbacks cb 0x5610c7c87aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:22:33.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.813+0000 7fed73fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610c7d34790 0x5610c7d43630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.813+0000 7fed73fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610c7d34790 0x5610c7d43630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52090/0 (socket says 172.21.15.87:52090) 2024-09-13T17:22:33.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.813+0000 7fed73fff640 1 -- 172.21.15.87:0/1522824659 learned_addr learned my addr 172.21.15.87:0/1522824659 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:33.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.813+0000 7fed78c33640 1 --2- 172.21.15.87:0/1522824659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5610c7d3f950 0x5610c7d47b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.813+0000 7fed6bfff640 1 --2- 172.21.15.87:0/1522824659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5610c7d350b0 0x5610c7d43b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.813+0000 7fed73fff640 1 -- 172.21.15.87:0/1522824659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5610c7d350b0 msgr2=0x5610c7d43b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:33.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.813+0000 7fed73fff640 1 --2- 172.21.15.87:0/1522824659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5610c7d350b0 0x5610c7d43b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.813+0000 7fed73fff640 1 -- 172.21.15.87:0/1522824659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5610c7d3f950 msgr2=0x5610c7d47b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:33.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.813+0000 7fed73fff640 1 --2- 172.21.15.87:0/1522824659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5610c7d3f950 0x5610c7d47b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.813+0000 7fed73fff640 1 -- 172.21.15.87:0/1522824659 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed5c004400 con 0x5610c7d34790 2024-09-13T17:22:33.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.813+0000 7fed73fff640 1 --2- 172.21.15.87:0/1522824659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610c7d34790 0x5610c7d43630 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fed64000c00 tx=0x7fed64009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef1296e59e9e6d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:33.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.813+0000 7fed537fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:22:33.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.814+0000 7fed537fe640 1 -- 172.21.15.87:0/1522824659 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed64003970 con 0x5610c7d34790 2024-09-13T17:22:33.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.814+0000 7fed7d3ba740 1 -- 172.21.15.87:0/1522824659 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5610c7cc1b80 con 0x5610c7d34790 2024-09-13T17:22:33.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.814+0000 7fed537fe640 1 -- 172.21.15.87:0/1522824659 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fed64003ad0 con 0x5610c7d34790 2024-09-13T17:22:33.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.814+0000 7fed537fe640 1 -- 172.21.15.87:0/1522824659 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed64003c90 con 0x5610c7d34790 2024-09-13T17:22:33.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.814+0000 7fed7d3ba740 10 client.17877 fetch_fsmap learned FSMap version 36 2024-09-13T17:22:33.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.814+0000 7fed7d3ba740 1 -- 172.21.15.87:0/1522824659 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5610c7c963c0 con 0x5610c7d34790 2024-09-13T17:22:33.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.814+0000 7fed537fe640 1 -- 172.21.15.87:0/1522824659 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x5610c7cc1b80 con 0x5610c7d34790 2024-09-13T17:22:33.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.814+0000 7fed537fe640 1 -- 172.21.15.87:0/1522824659 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fed640453f0 con 0x5610c7d34790 2024-09-13T17:22:33.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.814+0000 7fed7d3ba740 10 client.17877 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:22:33.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.814+0000 7fed7d3ba740 10 client.17877 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:22:33.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.814+0000 7fed7d3ba740 20 client.17877 populate_metadata read hostname 'smithi087' 2024-09-13T17:22:33.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.814+0000 7fed7d3ba740 1 --2- 172.21.15.87:0/1522824659 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5610c7d536f0 0x5610c7d55b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.814+0000 7fed7d3ba740 4 client.17877 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:22:33.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.814+0000 7fed7d3ba740 1 -- 172.21.15.87:0/1522824659 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5610c7c8a1f0 con 0x5610c7d536f0 2024-09-13T17:22:33.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.814+0000 7fed6bfff640 1 --2- 172.21.15.87:0/1522824659 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5610c7d536f0 0x5610c7d55b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.815+0000 7fed537fe640 10 client.17877 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:22:33.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.815+0000 7fed6bfff640 1 --2- 172.21.15.87:0/1522824659 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5610c7d536f0 0x5610c7d55b10 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bd9f879b729b67e server_cookie=614cb89062a0b5ac in_seq=0 out_seq=0 2024-09-13T17:22:33.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.815+0000 7fed537fe640 1 -- 172.21.15.87:0/1522824659 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5610c7c8a1f0 con 0x5610c7d536f0 2024-09-13T17:22:33.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.815+0000 7fed537fe640 10 client.17877 handle_command_reply: tid=0 2024-09-13T17:22:33.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.815+0000 7fed7d3ba740 1 client.17877 shutdown 2024-09-13T17:22:33.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.815+0000 7fed7d3ba740 1 -- 172.21.15.87:0/1522824659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610c7d34790 msgr2=0x5610c7d43630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.815+0000 7fed7d3ba740 1 --2- 172.21.15.87:0/1522824659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610c7d34790 0x5610c7d43630 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fed64000c00 tx=0x7fed64009260 comp rx=0 tx=0).stop 2024-09-13T17:22:33.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.815+0000 7fed7d3ba740 1 -- 172.21.15.87:0/1522824659 shutdown_connections 2024-09-13T17:22:33.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.815+0000 7fed7d3ba740 1 --2- 172.21.15.87:0/1522824659 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5610c7d536f0 0x5610c7d55b10 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.815+0000 7fed7d3ba740 1 --2- 172.21.15.87:0/1522824659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5610c7d3f950 0x5610c7d47b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.815+0000 7fed7d3ba740 1 --2- 172.21.15.87:0/1522824659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5610c7d350b0 0x5610c7d43b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.815+0000 7fed7d3ba740 1 --2- 172.21.15.87:0/1522824659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610c7d34790 0x5610c7d43630 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.815+0000 7fed7d3ba740 1 -- 172.21.15.87:0/1522824659 >> 172.21.15.87:0/1522824659 conn(0x5610c7d30d00 msgr2=0x5610c7d36a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:33.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.816+0000 7fed537fe640 0 client.17877 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:22:33.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.816+0000 7fed7d3ba740 1 -- 172.21.15.87:0/1522824659 shutdown_connections 2024-09-13T17:22:33.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.816+0000 7fed7d3ba740 1 -- 172.21.15.87:0/1522824659 wait complete. 2024-09-13T17:22:33.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.816+0000 7fed7d3ba740 20 client.17877 trim_cache size 0 max 16384 2024-09-13T17:22:33.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.826+0000 7fed7d3ba740 1 Processor -- start 2024-09-13T17:22:33.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.826+0000 7fed7d3ba740 1 -- start start 2024-09-13T17:22:33.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.826+0000 7fed7d3ba740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5610c7d34790 0x5610c7d4f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.826+0000 7fed7d3ba740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610c7d350b0 0x5610c7d47ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.826+0000 7fed7d3ba740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5610c7d3f950 0x5610c7d43990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.826+0000 7fed7d3ba740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c7d2c8e0 con 0x5610c7d350b0 2024-09-13T17:22:33.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.826+0000 7fed7d3ba740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c7d50340 con 0x5610c7d3f950 2024-09-13T17:22:33.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.826+0000 7fed7d3ba740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c7d3ec50 con 0x5610c7d34790 2024-09-13T17:22:33.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.827+0000 7fed6bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610c7d350b0 0x5610c7d47ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.827+0000 7fed6bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610c7d350b0 0x5610c7d47ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52092/0 (socket says 172.21.15.87:52092) 2024-09-13T17:22:33.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.827+0000 7fed6bfff640 1 -- 172.21.15.87:0/667623172 learned_addr learned my addr 172.21.15.87:0/667623172 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:33.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.827+0000 7fed73fff640 1 --2- 172.21.15.87:0/667623172 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5610c7d34790 0x5610c7d4f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.827+0000 7fed6bfff640 1 -- 172.21.15.87:0/667623172 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5610c7d34790 msgr2=0x5610c7d4f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:33.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.827+0000 7fed6bfff640 1 --2- 172.21.15.87:0/667623172 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5610c7d34790 0x5610c7d4f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.827+0000 7fed6bfff640 1 -- 172.21.15.87:0/667623172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5610c7d3f950 msgr2=0x5610c7d43990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:33.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.827+0000 7fed6bfff640 1 --2- 172.21.15.87:0/667623172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5610c7d3f950 0x5610c7d43990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.827+0000 7fed6bfff640 1 -- 172.21.15.87:0/667623172 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610c7c38770 con 0x5610c7d350b0 2024-09-13T17:22:33.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.827+0000 7fed6bfff640 1 --2- 172.21.15.87:0/667623172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610c7d350b0 0x5610c7d47ae0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fed5c0049b0 tx=0x7fed5c0049e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a692dc7f4d5f726 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:33.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.827+0000 7fed6affd640 1 -- 172.21.15.87:0/667623172 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c003e80 con 0x5610c7d350b0 2024-09-13T17:22:33.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.827+0000 7fed6affd640 1 -- 172.21.15.87:0/667623172 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fed5c014040 con 0x5610c7d350b0 2024-09-13T17:22:33.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.827+0000 7fed6affd640 1 -- 172.21.15.87:0/667623172 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c01bac0 con 0x5610c7d350b0 2024-09-13T17:22:33.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.828+0000 7fed7d3ba740 1 -- 172.21.15.87:0/667623172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610c7d350b0 msgr2=0x5610c7d47ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.828+0000 7fed7d3ba740 1 --2- 172.21.15.87:0/667623172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610c7d350b0 0x5610c7d47ae0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fed5c0049b0 tx=0x7fed5c0049e0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.828+0000 7fed7d3ba740 1 -- 172.21.15.87:0/667623172 shutdown_connections 2024-09-13T17:22:33.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.828+0000 7fed7d3ba740 1 --2- 172.21.15.87:0/667623172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5610c7d3f950 0x5610c7d43990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.828+0000 7fed7d3ba740 1 --2- 172.21.15.87:0/667623172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610c7d350b0 0x5610c7d47ae0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.828+0000 7fed7d3ba740 1 --2- 172.21.15.87:0/667623172 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5610c7d34790 0x5610c7d4f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.828+0000 7fed7d3ba740 1 -- 172.21.15.87:0/667623172 >> 172.21.15.87:0/667623172 conn(0x5610c7d30d00 msgr2=0x5610c7d3efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:33.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.828+0000 7fed7d3ba740 1 -- 172.21.15.87:0/667623172 shutdown_connections 2024-09-13T17:22:33.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.828+0000 7fed7d3ba740 1 -- 172.21.15.87:0/667623172 wait complete. 2024-09-13T17:22:33.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.828+0000 7fed7d3ba740 1 -- start start 2024-09-13T17:22:33.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.828+0000 7fed7d3ba740 1 Processor -- start 2024-09-13T17:22:33.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.828+0000 7fed7d3ba740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5610c7d34790 0x5610c7d3dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.828+0000 7fed7d3ba740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610c7d350b0 0x5610c7d3e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.828+0000 7fed7d3ba740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5610c7d3f950 0x5610c7d3c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.828+0000 7fed7d3ba740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c7d4d3a0 con 0x5610c7d350b0 2024-09-13T17:22:33.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.828+0000 7fed7d3ba740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c7d4d510 con 0x5610c7d34790 2024-09-13T17:22:33.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.828+0000 7fed7d3ba740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c7d3ceb0 con 0x5610c7d3f950 2024-09-13T17:22:33.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.829+0000 7fed7d3ba740 10 client.0 _ll_register_callbacks cb 0x7fed5c004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:22:33.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.829+0000 7fed6bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610c7d350b0 0x5610c7d3e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.829+0000 7fed6bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610c7d350b0 0x5610c7d3e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52104/0 (socket says 172.21.15.87:52104) 2024-09-13T17:22:33.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.829+0000 7fed6bfff640 1 -- 172.21.15.87:0/2541508651 learned_addr learned my addr 172.21.15.87:0/2541508651 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:33.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.829+0000 7fed78c33640 1 --2- 172.21.15.87:0/2541508651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5610c7d3f950 0x5610c7d3c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.829+0000 7fed73fff640 1 --2- 172.21.15.87:0/2541508651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5610c7d34790 0x5610c7d3dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.829+0000 7fed6bfff640 1 -- 172.21.15.87:0/2541508651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5610c7d3f950 msgr2=0x5610c7d3c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:33.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.829+0000 7fed6bfff640 1 --2- 172.21.15.87:0/2541508651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5610c7d3f950 0x5610c7d3c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.829+0000 7fed6bfff640 1 -- 172.21.15.87:0/2541508651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5610c7d34790 msgr2=0x5610c7d3dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:33.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.829+0000 7fed6bfff640 1 --2- 172.21.15.87:0/2541508651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5610c7d34790 0x5610c7d3dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.829+0000 7fed6bfff640 1 -- 172.21.15.87:0/2541508651 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5610c7c5f620 con 0x5610c7d350b0 2024-09-13T17:22:33.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.829+0000 7fed73fff640 1 --2- 172.21.15.87:0/2541508651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5610c7d34790 0x5610c7d3dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:22:33.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.829+0000 7fed6bfff640 1 --2- 172.21.15.87:0/2541508651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610c7d350b0 0x5610c7d3e200 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fed5c00b3f0 tx=0x7fed5c003f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3609fa693a0719ba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:33.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.829+0000 7fed537fe640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:22:33.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.829+0000 7fed537fe640 1 -- 172.21.15.87:0/2541508651 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c0274c0 con 0x5610c7d350b0 2024-09-13T17:22:33.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.829+0000 7fed537fe640 1 -- 172.21.15.87:0/2541508651 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fed5c027620 con 0x5610c7d350b0 2024-09-13T17:22:33.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.829+0000 7fed7d3ba740 1 -- 172.21.15.87:0/2541508651 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fed5c00be70 con 0x5610c7d350b0 2024-09-13T17:22:33.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.829+0000 7fed537fe640 1 -- 172.21.15.87:0/2541508651 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed5c0277e0 con 0x5610c7d350b0 2024-09-13T17:22:33.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.829+0000 7fed7d3ba740 10 client.17883 fetch_fsmap learned FSMap version 36 2024-09-13T17:22:33.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.829+0000 7fed7d3ba740 1 -- 172.21.15.87:0/2541508651 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5610c7c5de80 con 0x5610c7d350b0 2024-09-13T17:22:33.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.829+0000 7fed537fe640 1 -- 172.21.15.87:0/2541508651 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fed5c00be70 con 0x5610c7d350b0 2024-09-13T17:22:33.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.830+0000 7fed537fe640 1 -- 172.21.15.87:0/2541508651 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fed5c025040 con 0x5610c7d350b0 2024-09-13T17:22:33.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.830+0000 7fed7d3ba740 10 client.17883 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:22:33.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.830+0000 7fed7d3ba740 10 client.17883 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:22:33.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.830+0000 7fed7d3ba740 20 client.17883 populate_metadata read hostname 'smithi087' 2024-09-13T17:22:33.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.830+0000 7fed7d3ba740 1 --2- 172.21.15.87:0/2541508651 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5610c7daa4a0 0x5610c7dac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:33.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.830+0000 7fed7d3ba740 4 client.17883 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:22:33.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.830+0000 7fed7d3ba740 1 -- 172.21.15.87:0/2541508651 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5610c798b4e0 con 0x5610c7daa4a0 2024-09-13T17:22:33.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.830+0000 7fed73fff640 1 --2- 172.21.15.87:0/2541508651 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5610c7daa4a0 0x5610c7dac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:33.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.830+0000 7fed537fe640 10 client.17883 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:22:33.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.830+0000 7fed73fff640 1 --2- 172.21.15.87:0/2541508651 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5610c7daa4a0 0x5610c7dac8c0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97fcf8b7626832fd server_cookie=f2c780c8c495e045 in_seq=0 out_seq=0 2024-09-13T17:22:33.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.831+0000 7fed537fe640 1 -- 172.21.15.87:0/2541508651 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5610c798b4e0 con 0x5610c7daa4a0 2024-09-13T17:22:33.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.831+0000 7fed537fe640 10 client.17883 handle_command_reply: tid=0 2024-09-13T17:22:33.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.831+0000 7fed7d3ba740 1 client.17883 shutdown 2024-09-13T17:22:33.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.831+0000 7fed7d3ba740 1 -- 172.21.15.87:0/2541508651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610c7d350b0 msgr2=0x5610c7d3e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.831+0000 7fed7d3ba740 1 --2- 172.21.15.87:0/2541508651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610c7d350b0 0x5610c7d3e200 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fed5c00b3f0 tx=0x7fed5c003f00 comp rx=0 tx=0).stop 2024-09-13T17:22:33.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.831+0000 7fed7d3ba740 1 -- 172.21.15.87:0/2541508651 shutdown_connections 2024-09-13T17:22:33.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.831+0000 7fed7d3ba740 1 --2- 172.21.15.87:0/2541508651 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5610c7daa4a0 0x5610c7dac8c0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.831+0000 7fed7d3ba740 1 --2- 172.21.15.87:0/2541508651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5610c7d3f950 0x5610c7d3c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.831+0000 7fed7d3ba740 1 --2- 172.21.15.87:0/2541508651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610c7d350b0 0x5610c7d3e200 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.831+0000 7fed537fe640 0 client.17883 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:22:33.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.831+0000 7fed7d3ba740 1 --2- 172.21.15.87:0/2541508651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5610c7d34790 0x5610c7d3dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.831+0000 7fed7d3ba740 1 -- 172.21.15.87:0/2541508651 >> 172.21.15.87:0/2541508651 conn(0x5610c7d30d00 msgr2=0x5610c7d5a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:33.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.831+0000 7fed7d3ba740 1 -- 172.21.15.87:0/2541508651 shutdown_connections 2024-09-13T17:22:33.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.831+0000 7fed7d3ba740 1 -- 172.21.15.87:0/2541508651 wait complete. 2024-09-13T17:22:33.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.831+0000 7fed7d3ba740 20 client.17883 trim_cache size 0 max 16384 2024-09-13T17:22:33.840 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:22:33.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.831+0000 7fed7a696640 1 -- 172.21.15.87:0/2038510351 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fed600a1200 msgr2=0x7fed600a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.831+0000 7fed7a696640 1 --2- 172.21.15.87:0/2038510351 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fed600a1200 0x7fed600a36c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fed64005ab0 tx=0x7fed64005a20 comp rx=0 tx=0).stop 2024-09-13T17:22:33.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.831+0000 7fed7a696640 1 -- 172.21.15.87:0/2038510351 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed74199af0 msgr2=0x7fed74199fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:33.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.831+0000 7fed7a696640 1 --2- 172.21.15.87:0/2038510351 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed74199af0 0x7fed74199fa0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fed6c007c30 tx=0x7fed6c00e420 comp rx=0 tx=0).stop 2024-09-13T17:22:33.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.831+0000 7fed7a696640 1 -- 172.21.15.87:0/2038510351 shutdown_connections 2024-09-13T17:22:33.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.831+0000 7fed7a696640 1 --2- 172.21.15.87:0/2038510351 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fed600a1200 0x7fed600a36c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.831+0000 7fed7a696640 1 --2- 172.21.15.87:0/2038510351 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed74199af0 0x7fed74199fa0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.831+0000 7fed7a696640 1 --2- 172.21.15.87:0/2038510351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed74103fa0 0x7fed74195700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.831+0000 7fed7a696640 1 --2- 172.21.15.87:0/2038510351 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed740fee50 0x7fed741951c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:33.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.831+0000 7fed7a696640 1 -- 172.21.15.87:0/2038510351 >> 172.21.15.87:0/2038510351 conn(0x7fed740fa8e0 msgr2=0x7fed740fbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:33.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.831+0000 7fed7a696640 1 -- 172.21.15.87:0/2038510351 shutdown_connections 2024-09-13T17:22:33.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:33.831+0000 7fed7a696640 1 -- 172.21.15.87:0/2038510351 wait complete. 2024-09-13T17:22:33.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:33 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/773146948' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:22:33.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:33 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/773146948' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:22:34.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:34 smithi149 ceph-mon[35496]: pgmap v271: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:22:34.846 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-13T17:22:34.846 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-09-13T17:22:34.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:34 smithi118 ceph-mon[34374]: pgmap v271: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:22:34.873 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:34 smithi087 ceph-mon[30934]: pgmap v271: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:22:34.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.958+0000 7fa408090640 1 -- 172.21.15.87:0/3951535197 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4000fee50 msgr2=0x7fa4000ff230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:34.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.958+0000 7fa408090640 1 --2- 172.21.15.87:0/3951535197 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4000fee50 0x7fa4000ff230 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0009930 tx=0x7fa3f002a420 comp rx=0 tx=0).stop 2024-09-13T17:22:34.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.958+0000 7fa408090640 1 -- 172.21.15.87:0/3951535197 shutdown_connections 2024-09-13T17:22:34.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.958+0000 7fa408090640 1 --2- 172.21.15.87:0/3951535197 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa400103fa0 0x7fa40010baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:34.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.958+0000 7fa408090640 1 --2- 172.21.15.87:0/3951535197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4000ff800 0x7fa400103840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:34.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.958+0000 7fa408090640 1 --2- 172.21.15.87:0/3951535197 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4000fee50 0x7fa4000ff230 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:34.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.958+0000 7fa408090640 1 -- 172.21.15.87:0/3951535197 >> 172.21.15.87:0/3951535197 conn(0x7fa4000fa8c0 msgr2=0x7fa4000fcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:34.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.958+0000 7fa408090640 1 -- 172.21.15.87:0/3951535197 shutdown_connections 2024-09-13T17:22:34.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.958+0000 7fa408090640 1 -- 172.21.15.87:0/3951535197 wait complete. 2024-09-13T17:22:34.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.959+0000 7fa408090640 1 Processor -- start 2024-09-13T17:22:34.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.959+0000 7fa408090640 1 -- start start 2024-09-13T17:22:34.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.959+0000 7fa408090640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4000fee50 0x7fa4001971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:34.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.959+0000 7fa408090640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa400103fa0 0x7fa4001976f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:34.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.959+0000 7fa408090640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa400197c30 0x7fa4001a2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:34.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.959+0000 7fa408090640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4001a28d0 con 0x7fa4000fee50 2024-09-13T17:22:34.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.959+0000 7fa408090640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4001a2a40 con 0x7fa400103fa0 2024-09-13T17:22:34.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.959+0000 7fa408090640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4001a2c00 con 0x7fa400197c30 2024-09-13T17:22:34.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.959+0000 7fa405e2c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4000fee50 0x7fa4001971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:34.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.959+0000 7fa405e2c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4000fee50 0x7fa4001971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52114/0 (socket says 172.21.15.87:52114) 2024-09-13T17:22:34.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.959+0000 7fa405e2c640 1 -- 172.21.15.87:0/2968983234 learned_addr learned my addr 172.21.15.87:0/2968983234 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:34.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.959+0000 7fa40562b640 1 --2- 172.21.15.87:0/2968983234 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa400103fa0 0x7fa4001976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:34.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.959+0000 7fa405e2c640 1 -- 172.21.15.87:0/2968983234 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa400197c30 msgr2=0x7fa4001a2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:34.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.959+0000 7fa405e2c640 1 --2- 172.21.15.87:0/2968983234 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa400197c30 0x7fa4001a2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:34.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.959+0000 7fa405e2c640 1 -- 172.21.15.87:0/2968983234 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa400103fa0 msgr2=0x7fa4001976f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:34.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.959+0000 7fa405e2c640 1 --2- 172.21.15.87:0/2968983234 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa400103fa0 0x7fa4001976f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:34.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.959+0000 7fa405e2c640 1 -- 172.21.15.87:0/2968983234 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f0009560 con 0x7fa4000fee50 2024-09-13T17:22:34.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.960+0000 7fa405e2c640 1 --2- 172.21.15.87:0/2968983234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4000fee50 0x7fa4001971b0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fa3f00057c0 tx=0x7fa3f0003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:34.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.960+0000 7fa3f6ffd640 1 -- 172.21.15.87:0/2968983234 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f003b670 con 0x7fa4000fee50 2024-09-13T17:22:34.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.960+0000 7fa3f6ffd640 1 -- 172.21.15.87:0/2968983234 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa3f003bc80 con 0x7fa4000fee50 2024-09-13T17:22:34.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.960+0000 7fa408090640 1 -- 172.21.15.87:0/2968983234 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4001a2e80 con 0x7fa4000fee50 2024-09-13T17:22:34.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.960+0000 7fa3f6ffd640 1 -- 172.21.15.87:0/2968983234 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0031cc0 con 0x7fa4000fee50 2024-09-13T17:22:34.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.960+0000 7fa408090640 1 -- 172.21.15.87:0/2968983234 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4001a32a0 con 0x7fa4000fee50 2024-09-13T17:22:34.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.962+0000 7fa3f6ffd640 1 -- 172.21.15.87:0/2968983234 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fa3f0031490 con 0x7fa4000fee50 2024-09-13T17:22:34.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.963+0000 7fa40ae8c740 1 Processor -- start 2024-09-13T17:22:34.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.963+0000 7fa40ae8c740 1 -- start start 2024-09-13T17:22:34.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.963+0000 7fa40ae8c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6a0a567c0 0x55b6a0a56ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:34.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.963+0000 7fa40ae8c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6a0a570e0 0x55b6a0a61440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:34.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.963+0000 7fa40ae8c740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b6a0a61980 0x55b6a0a63d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:34.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.963+0000 7fa40ae8c740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6a09c1c60 con 0x55b6a0a570e0 2024-09-13T17:22:34.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.963+0000 7fa40ae8c740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6a09bf3f0 con 0x55b6a0a61980 2024-09-13T17:22:34.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.963+0000 7fa40ae8c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6a09bace0 con 0x55b6a0a567c0 2024-09-13T17:22:34.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.963+0000 7fa405e2c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6a0a570e0 0x55b6a0a61440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:34.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.963+0000 7fa405e2c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6a0a570e0 0x55b6a0a61440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52124/0 (socket says 172.21.15.87:52124) 2024-09-13T17:22:34.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.963+0000 7fa405e2c640 1 -- 172.21.15.87:0/1370877004 learned_addr learned my addr 172.21.15.87:0/1370877004 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:34.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.963+0000 7fa3f6ffd640 1 --2- 172.21.15.87:0/2968983234 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa3ec0a1200 0x7fa3ec0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:34.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.964+0000 7fa40562b640 1 --2- 172.21.15.87:0/1370877004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b6a0a61980 0x55b6a0a63d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:34.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.964+0000 7fa40662d640 1 --2- 172.21.15.87:0/1370877004 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6a0a567c0 0x55b6a0a56ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:34.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.964+0000 7fa40662d640 1 --2- 172.21.15.87:0/2968983234 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa3ec0a1200 0x7fa3ec0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:34.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.964+0000 7fa405e2c640 1 -- 172.21.15.87:0/1370877004 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6a0a567c0 msgr2=0x55b6a0a56ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:34.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.964+0000 7fa405e2c640 1 --2- 172.21.15.87:0/1370877004 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6a0a567c0 0x55b6a0a56ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:34.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.964+0000 7fa405e2c640 1 -- 172.21.15.87:0/1370877004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b6a0a61980 msgr2=0x55b6a0a63d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:34.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.964+0000 7fa405e2c640 1 --2- 172.21.15.87:0/1370877004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b6a0a61980 0x55b6a0a63d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:34.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.964+0000 7fa3f6ffd640 1 -- 172.21.15.87:0/2968983234 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fa3f00edbf0 con 0x7fa4000fee50 2024-09-13T17:22:34.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.964+0000 7fa405e2c640 1 -- 172.21.15.87:0/1370877004 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6a0976970 con 0x55b6a0a570e0 2024-09-13T17:22:34.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.964+0000 7fa40562b640 1 --2- 172.21.15.87:0/1370877004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b6a0a61980 0x55b6a0a63d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:22:34.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.964+0000 7fa405e2c640 1 --2- 172.21.15.87:0/1370877004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6a0a570e0 0x55b6a0a61440 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fa3f00eae40 tx=0x7fa3f0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc35a14dd9323fa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:34.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.964+0000 7fa40662d640 1 --2- 172.21.15.87:0/2968983234 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa3ec0a1200 0x7fa3ec0a36c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8009e90 tx=0x7fa3f8005d90 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:34.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.964+0000 7fa3ebfff640 1 -- 172.21.15.87:0/1370877004 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f00ba1f0 con 0x55b6a0a570e0 2024-09-13T17:22:34.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.964+0000 7fa3ebfff640 1 -- 172.21.15.87:0/1370877004 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa3f00baf90 con 0x55b6a0a570e0 2024-09-13T17:22:34.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.964+0000 7fa3ebfff640 1 -- 172.21.15.87:0/1370877004 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f00b8cc0 con 0x55b6a0a570e0 2024-09-13T17:22:34.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.965+0000 7fa40ae8c740 1 -- 172.21.15.87:0/1370877004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6a0a570e0 msgr2=0x55b6a0a61440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:34.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.965+0000 7fa40ae8c740 1 --2- 172.21.15.87:0/1370877004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6a0a570e0 0x55b6a0a61440 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fa3f00eae40 tx=0x7fa3f0009260 comp rx=0 tx=0).stop 2024-09-13T17:22:34.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.965+0000 7fa40ae8c740 1 -- 172.21.15.87:0/1370877004 shutdown_connections 2024-09-13T17:22:34.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.965+0000 7fa40ae8c740 1 --2- 172.21.15.87:0/1370877004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b6a0a61980 0x55b6a0a63d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:34.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.965+0000 7fa40ae8c740 1 --2- 172.21.15.87:0/1370877004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6a0a570e0 0x55b6a0a61440 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:34.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.965+0000 7fa40ae8c740 1 --2- 172.21.15.87:0/1370877004 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6a0a567c0 0x55b6a0a56ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:34.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.965+0000 7fa40ae8c740 1 -- 172.21.15.87:0/1370877004 >> 172.21.15.87:0/1370877004 conn(0x55b6a0a52d50 msgr2=0x55b6a0a53130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:34.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.965+0000 7fa40ae8c740 1 -- 172.21.15.87:0/1370877004 shutdown_connections 2024-09-13T17:22:34.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.965+0000 7fa40ae8c740 1 -- 172.21.15.87:0/1370877004 wait complete. 2024-09-13T17:22:34.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.965+0000 7fa40ae8c740 1 -- start start 2024-09-13T17:22:34.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.965+0000 7fa40ae8c740 1 Processor -- start 2024-09-13T17:22:34.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.966+0000 7fa40ae8c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6a0a567c0 0x55b6a0a61320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:34.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.966+0000 7fa40ae8c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6a0a570e0 0x55b6a0a5e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:34.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.966+0000 7fa40ae8c740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b6a0a61980 0x55b6a0a5eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:34.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.966+0000 7fa40ae8c740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6a0978f80 con 0x55b6a0a567c0 2024-09-13T17:22:34.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.966+0000 7fa40ae8c740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6a0978c20 con 0x55b6a0a61980 2024-09-13T17:22:34.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.966+0000 7fa40ae8c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6a0945ab0 con 0x55b6a0a570e0 2024-09-13T17:22:34.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.966+0000 7fa40ae8c740 10 client.0 _ll_register_callbacks cb 0x55b6a09b4350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:22:34.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.966+0000 7fa405e2c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6a0a567c0 0x55b6a0a61320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:34.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.966+0000 7fa405e2c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6a0a567c0 0x55b6a0a61320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52134/0 (socket says 172.21.15.87:52134) 2024-09-13T17:22:34.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.966+0000 7fa405e2c640 1 -- 172.21.15.87:0/532955767 learned_addr learned my addr 172.21.15.87:0/532955767 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:34.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.966+0000 7fa40562b640 1 --2- 172.21.15.87:0/532955767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6a0a570e0 0x55b6a0a5e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:34.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.966+0000 7fa40662d640 1 --2- 172.21.15.87:0/532955767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b6a0a61980 0x55b6a0a5eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:34.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.966+0000 7fa405e2c640 1 -- 172.21.15.87:0/532955767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6a0a570e0 msgr2=0x55b6a0a5e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:34.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.966+0000 7fa405e2c640 1 --2- 172.21.15.87:0/532955767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6a0a570e0 0x55b6a0a5e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:34.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.966+0000 7fa405e2c640 1 -- 172.21.15.87:0/532955767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b6a0a61980 msgr2=0x55b6a0a5eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:34.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.966+0000 7fa405e2c640 1 --2- 172.21.15.87:0/532955767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b6a0a61980 0x55b6a0a5eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:34.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.966+0000 7fa405e2c640 1 -- 172.21.15.87:0/532955767 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4001a32a0 con 0x55b6a0a567c0 2024-09-13T17:22:34.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.966+0000 7fa405e2c640 1 --2- 172.21.15.87:0/532955767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6a0a567c0 0x55b6a0a61320 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fa3f00c27e0 tx=0x7fa3f00c2d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f48477dd77a4cb7a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:34.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.966+0000 7fa3e97fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:22:34.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.967+0000 7fa3e97fa640 1 -- 172.21.15.87:0/532955767 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f00d3250 con 0x55b6a0a567c0 2024-09-13T17:22:34.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.967+0000 7fa3e97fa640 1 -- 172.21.15.87:0/532955767 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fa3f00f2040 con 0x55b6a0a567c0 2024-09-13T17:22:34.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.967+0000 7fa40ae8c740 1 -- 172.21.15.87:0/532955767 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b6a06ae590 con 0x55b6a0a567c0 2024-09-13T17:22:34.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.967+0000 7fa3e97fa640 1 -- 172.21.15.87:0/532955767 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3f0031e20 con 0x55b6a0a567c0 2024-09-13T17:22:34.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.967+0000 7fa40ae8c740 10 client.17895 fetch_fsmap learned FSMap version 36 2024-09-13T17:22:34.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.967+0000 7fa40ae8c740 1 -- 172.21.15.87:0/532955767 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55b6a09b9360 con 0x55b6a0a567c0 2024-09-13T17:22:34.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.967+0000 7fa3e97fa640 1 -- 172.21.15.87:0/532955767 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55b6a06ae590 con 0x55b6a0a567c0 2024-09-13T17:22:34.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.967+0000 7fa3e97fa640 1 -- 172.21.15.87:0/532955767 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fa3f00b9d80 con 0x55b6a0a567c0 2024-09-13T17:22:34.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.967+0000 7fa40ae8c740 10 client.17895 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:22:34.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.967+0000 7fa40ae8c740 10 client.17895 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:22:34.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.967+0000 7fa40ae8c740 20 client.17895 populate_metadata read hostname 'smithi087' 2024-09-13T17:22:34.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.967+0000 7fa40ae8c740 1 --2- 172.21.15.87:0/532955767 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b6a0a71050 0x55b6a0a73440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:34.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.967+0000 7fa40ae8c740 4 client.17895 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:22:34.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.967+0000 7fa40ae8c740 1 -- 172.21.15.87:0/532955767 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b6a06bf860 con 0x55b6a0a71050 2024-09-13T17:22:34.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.967+0000 7fa40562b640 1 --2- 172.21.15.87:0/532955767 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b6a0a71050 0x55b6a0a73440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:34.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.968+0000 7fa3e97fa640 10 client.17895 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:22:34.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.968+0000 7fa40562b640 1 --2- 172.21.15.87:0/532955767 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b6a0a71050 0x55b6a0a73440 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2de094ac2effb013 server_cookie=a83b9dfaa31593aa in_seq=0 out_seq=0 2024-09-13T17:22:34.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.968+0000 7fa3e97fa640 1 -- 172.21.15.87:0/532955767 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55b6a06bf860 con 0x55b6a0a71050 2024-09-13T17:22:34.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.968+0000 7fa3e97fa640 10 client.17895 handle_command_reply: tid=0 2024-09-13T17:22:34.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.968+0000 7fa40ae8c740 1 client.17895 shutdown 2024-09-13T17:22:34.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.969+0000 7fa40ae8c740 1 -- 172.21.15.87:0/532955767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6a0a567c0 msgr2=0x55b6a0a61320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:34.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.969+0000 7fa40ae8c740 1 --2- 172.21.15.87:0/532955767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6a0a567c0 0x55b6a0a61320 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fa3f00c27e0 tx=0x7fa3f00c2d90 comp rx=0 tx=0).stop 2024-09-13T17:22:34.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.969+0000 7fa40ae8c740 1 -- 172.21.15.87:0/532955767 shutdown_connections 2024-09-13T17:22:34.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.969+0000 7fa40ae8c740 1 --2- 172.21.15.87:0/532955767 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b6a0a71050 0x55b6a0a73440 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:34.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.969+0000 7fa40ae8c740 1 --2- 172.21.15.87:0/532955767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b6a0a61980 0x55b6a0a5eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:34.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.969+0000 7fa3e97fa640 0 client.17895 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:22:34.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.969+0000 7fa40ae8c740 1 --2- 172.21.15.87:0/532955767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6a0a570e0 0x55b6a0a5e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:34.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.969+0000 7fa40ae8c740 1 --2- 172.21.15.87:0/532955767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6a0a567c0 0x55b6a0a61320 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:34.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.969+0000 7fa40ae8c740 1 -- 172.21.15.87:0/532955767 >> 172.21.15.87:0/532955767 conn(0x55b6a0a52d50 msgr2=0x55b6a0a581a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:34.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.969+0000 7fa40ae8c740 1 -- 172.21.15.87:0/532955767 shutdown_connections 2024-09-13T17:22:34.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.969+0000 7fa40ae8c740 1 -- 172.21.15.87:0/532955767 wait complete. 2024-09-13T17:22:34.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.969+0000 7fa40ae8c740 20 client.17895 trim_cache size 0 max 16384 2024-09-13T17:22:34.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.983+0000 7fa40ae8c740 1 Processor -- start 2024-09-13T17:22:34.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.983+0000 7fa40ae8c740 1 -- start start 2024-09-13T17:22:34.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.983+0000 7fa40ae8c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6a0a567c0 0x55b6a0a683d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:34.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.983+0000 7fa40ae8c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6a0a570e0 0x55b6a0a68910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:34.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.983+0000 7fa40ae8c740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b6a0a61980 0x55b6a0a5ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:34.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.983+0000 7fa40ae8c740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6a0a5cb40 con 0x55b6a0a567c0 2024-09-13T17:22:34.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.983+0000 7fa40ae8c740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6a0a56ed0 con 0x55b6a0a61980 2024-09-13T17:22:34.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.983+0000 7fa40ae8c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6a0a785c0 con 0x55b6a0a570e0 2024-09-13T17:22:34.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.983+0000 7fa405e2c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6a0a567c0 0x55b6a0a683d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:34.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.983+0000 7fa405e2c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6a0a567c0 0x55b6a0a683d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52144/0 (socket says 172.21.15.87:52144) 2024-09-13T17:22:34.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.983+0000 7fa405e2c640 1 -- 172.21.15.87:0/2661351058 learned_addr learned my addr 172.21.15.87:0/2661351058 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:34.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.983+0000 7fa40662d640 1 --2- 172.21.15.87:0/2661351058 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b6a0a61980 0x55b6a0a5ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:34.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.983+0000 7fa405e2c640 1 -- 172.21.15.87:0/2661351058 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6a0a570e0 msgr2=0x55b6a0a68910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:34.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.983+0000 7fa405e2c640 1 --2- 172.21.15.87:0/2661351058 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6a0a570e0 0x55b6a0a68910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:34.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.983+0000 7fa405e2c640 1 -- 172.21.15.87:0/2661351058 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b6a0a61980 msgr2=0x55b6a0a5ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:34.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.983+0000 7fa405e2c640 1 --2- 172.21.15.87:0/2661351058 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b6a0a61980 0x55b6a0a5ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:34.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.984+0000 7fa405e2c640 1 -- 172.21.15.87:0/2661351058 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6a095b1c0 con 0x55b6a0a567c0 2024-09-13T17:22:34.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.984+0000 7fa40662d640 1 --2- 172.21.15.87:0/2661351058 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b6a0a61980 0x55b6a0a5ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:22:34.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.984+0000 7fa405e2c640 1 --2- 172.21.15.87:0/2661351058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6a0a567c0 0x55b6a0a683d0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0005760 tx=0x7fa3f002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b014ae157b5b2b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:34.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.984+0000 7fa3f4ff9640 1 -- 172.21.15.87:0/2661351058 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f00f2070 con 0x55b6a0a567c0 2024-09-13T17:22:34.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.984+0000 7fa3f4ff9640 1 -- 172.21.15.87:0/2661351058 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa3f00d3250 con 0x55b6a0a567c0 2024-09-13T17:22:34.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.984+0000 7fa3f4ff9640 1 -- 172.21.15.87:0/2661351058 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0031e20 con 0x55b6a0a567c0 2024-09-13T17:22:34.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.985+0000 7fa40ae8c740 1 -- 172.21.15.87:0/2661351058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6a0a567c0 msgr2=0x55b6a0a683d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:34.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.985+0000 7fa40ae8c740 1 --2- 172.21.15.87:0/2661351058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6a0a567c0 0x55b6a0a683d0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0005760 tx=0x7fa3f002a420 comp rx=0 tx=0).stop 2024-09-13T17:22:34.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.985+0000 7fa40ae8c740 1 -- 172.21.15.87:0/2661351058 shutdown_connections 2024-09-13T17:22:34.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.985+0000 7fa40ae8c740 1 --2- 172.21.15.87:0/2661351058 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b6a0a61980 0x55b6a0a5ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:34.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.985+0000 7fa40ae8c740 1 --2- 172.21.15.87:0/2661351058 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6a0a570e0 0x55b6a0a68910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:34.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.985+0000 7fa40ae8c740 1 --2- 172.21.15.87:0/2661351058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6a0a567c0 0x55b6a0a683d0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:34.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.985+0000 7fa40ae8c740 1 -- 172.21.15.87:0/2661351058 >> 172.21.15.87:0/2661351058 conn(0x55b6a0a52d50 msgr2=0x55b6a0a598a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:34.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.985+0000 7fa40ae8c740 1 -- 172.21.15.87:0/2661351058 shutdown_connections 2024-09-13T17:22:34.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.985+0000 7fa40ae8c740 1 -- 172.21.15.87:0/2661351058 wait complete. 2024-09-13T17:22:34.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.985+0000 7fa40ae8c740 1 -- start start 2024-09-13T17:22:34.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.985+0000 7fa40ae8c740 1 Processor -- start 2024-09-13T17:22:34.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.985+0000 7fa40ae8c740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b6a0a567c0 0x55b6a0a670a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:34.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.985+0000 7fa40ae8c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6a0a570e0 0x55b6a0a675e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:34.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.985+0000 7fa40ae8c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6a0a61980 0x55b6a0a67b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:34.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.985+0000 7fa40ae8c740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6a0ac7600 con 0x55b6a0a570e0 2024-09-13T17:22:34.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.985+0000 7fa40ae8c740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6a0ac7770 con 0x55b6a0a567c0 2024-09-13T17:22:34.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.985+0000 7fa40ae8c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6a0ac7930 con 0x55b6a0a61980 2024-09-13T17:22:34.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.985+0000 7fa40ae8c740 10 client.0 _ll_register_callbacks cb 0x7fa3f00ba6f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:22:34.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.985+0000 7fa40562b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6a0a570e0 0x55b6a0a675e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:34.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.986+0000 7fa40562b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6a0a570e0 0x55b6a0a675e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52160/0 (socket says 172.21.15.87:52160) 2024-09-13T17:22:34.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.986+0000 7fa40562b640 1 -- 172.21.15.87:0/2406364164 learned_addr learned my addr 172.21.15.87:0/2406364164 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:34.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.986+0000 7fa405e2c640 1 --2- 172.21.15.87:0/2406364164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b6a0a567c0 0x55b6a0a670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:34.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.986+0000 7fa40662d640 1 --2- 172.21.15.87:0/2406364164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6a0a61980 0x55b6a0a67b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:34.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.986+0000 7fa40562b640 1 -- 172.21.15.87:0/2406364164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6a0a61980 msgr2=0x55b6a0a67b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:34.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.986+0000 7fa40562b640 1 --2- 172.21.15.87:0/2406364164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6a0a61980 0x55b6a0a67b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:34.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.986+0000 7fa40562b640 1 -- 172.21.15.87:0/2406364164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b6a0a567c0 msgr2=0x55b6a0a670a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:34.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.986+0000 7fa40562b640 1 --2- 172.21.15.87:0/2406364164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b6a0a567c0 0x55b6a0a670a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:34.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.986+0000 7fa40562b640 1 -- 172.21.15.87:0/2406364164 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b6a09b9360 con 0x55b6a0a570e0 2024-09-13T17:22:34.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.986+0000 7fa40662d640 1 --2- 172.21.15.87:0/2406364164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6a0a61980 0x55b6a0a67b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:22:34.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.986+0000 7fa40562b640 1 --2- 172.21.15.87:0/2406364164 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6a0a570e0 0x55b6a0a675e0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fa400068db0 tx=0x7fa3fc013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48290e9cde599f5a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:34.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.986+0000 7fa3e97fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:22:34.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.986+0000 7fa3e97fa640 1 -- 172.21.15.87:0/2406364164 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc016040 con 0x55b6a0a570e0 2024-09-13T17:22:34.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.986+0000 7fa3e97fa640 1 -- 172.21.15.87:0/2406364164 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fa3fc01c610 con 0x55b6a0a570e0 2024-09-13T17:22:34.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.986+0000 7fa40ae8c740 1 -- 172.21.15.87:0/2406364164 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa3f00baf90 con 0x55b6a0a570e0 2024-09-13T17:22:34.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.986+0000 7fa3e97fa640 1 -- 172.21.15.87:0/2406364164 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3fc013ed0 con 0x55b6a0a570e0 2024-09-13T17:22:34.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.986+0000 7fa40ae8c740 10 client.17901 fetch_fsmap learned FSMap version 36 2024-09-13T17:22:34.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.986+0000 7fa40ae8c740 1 -- 172.21.15.87:0/2406364164 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55b6a0980990 con 0x55b6a0a570e0 2024-09-13T17:22:34.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.987+0000 7fa3e97fa640 1 -- 172.21.15.87:0/2406364164 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa3f00baf90 con 0x55b6a0a570e0 2024-09-13T17:22:34.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.987+0000 7fa3e97fa640 1 -- 172.21.15.87:0/2406364164 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fa3fc025420 con 0x55b6a0a570e0 2024-09-13T17:22:34.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.987+0000 7fa40ae8c740 10 client.17901 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:22:34.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.987+0000 7fa40ae8c740 10 client.17901 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:22:34.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.987+0000 7fa40ae8c740 20 client.17901 populate_metadata read hostname 'smithi087' 2024-09-13T17:22:34.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.987+0000 7fa40ae8c740 1 --2- 172.21.15.87:0/2406364164 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b6a0ac9120 0x55b6a0acb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:34.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.987+0000 7fa40ae8c740 4 client.17901 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-13T17:22:34.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.987+0000 7fa40ae8c740 1 -- 172.21.15.87:0/2406364164 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55b6a0712eb0 con 0x55b6a0ac9120 2024-09-13T17:22:34.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.987+0000 7fa405e2c640 1 --2- 172.21.15.87:0/2406364164 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b6a0ac9120 0x55b6a0acb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:34.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.987+0000 7fa405e2c640 1 --2- 172.21.15.87:0/2406364164 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b6a0ac9120 0x55b6a0acb540 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4927a2586db3557 server_cookie=c8bb899cfda47cc6 in_seq=0 out_seq=0 2024-09-13T17:22:34.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.987+0000 7fa3e97fa640 10 client.17901 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:22:34.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.988+0000 7fa3e97fa640 1 -- 172.21.15.87:0/2406364164 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55b6a0712eb0 con 0x55b6a0ac9120 2024-09-13T17:22:34.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.988+0000 7fa3e97fa640 10 client.17901 handle_command_reply: tid=0 2024-09-13T17:22:34.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.989+0000 7fa40ae8c740 1 client.17901 shutdown 2024-09-13T17:22:34.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.989+0000 7fa40ae8c740 1 -- 172.21.15.87:0/2406364164 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6a0a570e0 msgr2=0x55b6a0a675e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:34.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.989+0000 7fa40ae8c740 1 --2- 172.21.15.87:0/2406364164 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6a0a570e0 0x55b6a0a675e0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fa400068db0 tx=0x7fa3fc013830 comp rx=0 tx=0).stop 2024-09-13T17:22:34.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.989+0000 7fa40ae8c740 1 -- 172.21.15.87:0/2406364164 shutdown_connections 2024-09-13T17:22:34.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.989+0000 7fa40ae8c740 1 --2- 172.21.15.87:0/2406364164 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b6a0ac9120 0x55b6a0acb540 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:34.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.989+0000 7fa40ae8c740 1 --2- 172.21.15.87:0/2406364164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6a0a61980 0x55b6a0a67b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:34.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.989+0000 7fa40ae8c740 1 --2- 172.21.15.87:0/2406364164 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b6a0a570e0 0x55b6a0a675e0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:34.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.989+0000 7fa40ae8c740 1 --2- 172.21.15.87:0/2406364164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b6a0a567c0 0x55b6a0a670a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:34.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.989+0000 7fa40ae8c740 1 -- 172.21.15.87:0/2406364164 >> 172.21.15.87:0/2406364164 conn(0x55b6a0a52d50 msgr2=0x55b6a0a5ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:34.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.989+0000 7fa3e97fa640 0 client.17901 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:22:34.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.989+0000 7fa40ae8c740 1 -- 172.21.15.87:0/2406364164 shutdown_connections 2024-09-13T17:22:35.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.989+0000 7fa40ae8c740 1 -- 172.21.15.87:0/2406364164 wait complete. 2024-09-13T17:22:35.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.989+0000 7fa40ae8c740 20 client.17901 trim_cache size 0 max 16384 2024-09-13T17:22:35.000 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:22:35.000 INFO:teuthology.orchestra.run.smithi087.stdout: "return_code": 0, 2024-09-13T17:22:35.000 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_tag": "287fc58e-bf82-47b2-b5d3-9e7337d5a273", 2024-09-13T17:22:35.001 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": "asynchronous" 2024-09-13T17:22:35.001 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:22:35.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.989+0000 7fa408090640 1 -- 172.21.15.87:0/2968983234 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa3ec0a1200 msgr2=0x7fa3ec0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:35.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.989+0000 7fa408090640 1 --2- 172.21.15.87:0/2968983234 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa3ec0a1200 0x7fa3ec0a36c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8009e90 tx=0x7fa3f8005d90 comp rx=0 tx=0).stop 2024-09-13T17:22:35.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.989+0000 7fa408090640 1 -- 172.21.15.87:0/2968983234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4000fee50 msgr2=0x7fa4001971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:35.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.989+0000 7fa408090640 1 --2- 172.21.15.87:0/2968983234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4000fee50 0x7fa4001971b0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fa3f00057c0 tx=0x7fa3f0003d40 comp rx=0 tx=0).stop 2024-09-13T17:22:35.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.990+0000 7fa408090640 1 -- 172.21.15.87:0/2968983234 shutdown_connections 2024-09-13T17:22:35.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.990+0000 7fa408090640 1 --2- 172.21.15.87:0/2968983234 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa400197c30 0x7fa4001a2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.990+0000 7fa408090640 1 --2- 172.21.15.87:0/2968983234 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa400103fa0 0x7fa4001976f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.990+0000 7fa408090640 1 --2- 172.21.15.87:0/2968983234 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa3ec0a1200 0x7fa3ec0a36c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.990+0000 7fa408090640 1 --2- 172.21.15.87:0/2968983234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4000fee50 0x7fa4001971b0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.990+0000 7fa408090640 1 -- 172.21.15.87:0/2968983234 >> 172.21.15.87:0/2968983234 conn(0x7fa4000fa8c0 msgr2=0x7fa4000fbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:35.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.990+0000 7fa408090640 1 -- 172.21.15.87:0/2968983234 shutdown_connections 2024-09-13T17:22:35.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:34.990+0000 7fa408090640 1 -- 172.21.15.87:0/2968983234 wait complete. 2024-09-13T17:22:35.004 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:22:35.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.143+0000 7fde03726640 1 -- 172.21.15.87:0/454588523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddfc0ff830 msgr2=0x7fddfc103870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:35.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.143+0000 7fde03726640 1 --2- 172.21.15.87:0/454588523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddfc0ff830 0x7fddfc103870 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fddf0009930 tx=0x7fddf002a420 comp rx=0 tx=0).stop 2024-09-13T17:22:35.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.143+0000 7fde03726640 1 -- 172.21.15.87:0/454588523 shutdown_connections 2024-09-13T17:22:35.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.143+0000 7fde03726640 1 --2- 172.21.15.87:0/454588523 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fddfc103fd0 0x7fddfc10bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.143+0000 7fde03726640 1 --2- 172.21.15.87:0/454588523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddfc0ff830 0x7fddfc103870 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.143+0000 7fde03726640 1 --2- 172.21.15.87:0/454588523 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddfc0fee80 0x7fddfc0ff260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.143+0000 7fde03726640 1 -- 172.21.15.87:0/454588523 >> 172.21.15.87:0/454588523 conn(0x7fddfc0fa930 msgr2=0x7fddfc0fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:35.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.143+0000 7fde03726640 1 -- 172.21.15.87:0/454588523 shutdown_connections 2024-09-13T17:22:35.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.143+0000 7fde03726640 1 -- 172.21.15.87:0/454588523 wait complete. 2024-09-13T17:22:35.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.144+0000 7fde03726640 1 Processor -- start 2024-09-13T17:22:35.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.144+0000 7fde03726640 1 -- start start 2024-09-13T17:22:35.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.144+0000 7fde03726640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddfc0fee80 0x7fddfc1951b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:35.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.144+0000 7fde03726640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddfc103fd0 0x7fddfc1956f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:35.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.144+0000 7fde03726640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fddfc199a90 0x7fddfc199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:35.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.144+0000 7fde03726640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc19a480 con 0x7fddfc0fee80 2024-09-13T17:22:35.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.144+0000 7fde03726640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc19a5f0 con 0x7fddfc103fd0 2024-09-13T17:22:35.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.144+0000 7fde03726640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc19a760 con 0x7fddfc199a90 2024-09-13T17:22:35.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.144+0000 7fde014c2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddfc0fee80 0x7fddfc1951b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:35.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.144+0000 7fde014c2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddfc0fee80 0x7fddfc1951b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52172/0 (socket says 172.21.15.87:52172) 2024-09-13T17:22:35.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.144+0000 7fde014c2640 1 -- 172.21.15.87:0/259337227 learned_addr learned my addr 172.21.15.87:0/259337227 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:35.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.144+0000 7fde01cc3640 1 --2- 172.21.15.87:0/259337227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fddfc199a90 0x7fddfc199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:35.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.144+0000 7fde014c2640 1 -- 172.21.15.87:0/259337227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fddfc199a90 msgr2=0x7fddfc199f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:35.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.144+0000 7fde014c2640 1 --2- 172.21.15.87:0/259337227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fddfc199a90 0x7fddfc199f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.144+0000 7fde014c2640 1 -- 172.21.15.87:0/259337227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddfc103fd0 msgr2=0x7fddfc1956f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:35.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.144+0000 7fde014c2640 1 --2- 172.21.15.87:0/259337227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddfc103fd0 0x7fddfc1956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.144+0000 7fde014c2640 1 -- 172.21.15.87:0/259337227 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf0009560 con 0x7fddfc0fee80 2024-09-13T17:22:35.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.144+0000 7fde014c2640 1 --2- 172.21.15.87:0/259337227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddfc0fee80 0x7fddfc1951b0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fddf400c890 tx=0x7fddf400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:35.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.144+0000 7fddfa7fc640 1 -- 172.21.15.87:0/259337227 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf4004220 con 0x7fddfc0fee80 2024-09-13T17:22:35.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.145+0000 7fde03726640 1 -- 172.21.15.87:0/259337227 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddfc068570 con 0x7fddfc0fee80 2024-09-13T17:22:35.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.145+0000 7fddfa7fc640 1 -- 172.21.15.87:0/259337227 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fddf4007e60 con 0x7fddfc0fee80 2024-09-13T17:22:35.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.145+0000 7fddfa7fc640 1 -- 172.21.15.87:0/259337227 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf4004a00 con 0x7fddfc0fee80 2024-09-13T17:22:35.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.145+0000 7fde03726640 1 -- 172.21.15.87:0/259337227 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddfc068a20 con 0x7fddfc0fee80 2024-09-13T17:22:35.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.147+0000 7fddfa7fc640 1 -- 172.21.15.87:0/259337227 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fddf40079b0 con 0x7fddfc0fee80 2024-09-13T17:22:35.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.148+0000 7fde06448740 1 Processor -- start 2024-09-13T17:22:35.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.148+0000 7fde06448740 1 -- start start 2024-09-13T17:22:35.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.148+0000 7fde06448740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55accabb6e10 0x55accabb71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:35.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.148+0000 7fde06448740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55accabb7730 0x55accabc1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:35.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.148+0000 7fde06448740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55accabc1fd0 0x55accabc43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:35.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.148+0000 7fde06448740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55accab21f20 con 0x55accabb7730 2024-09-13T17:22:35.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.148+0000 7fde06448740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55accab1f6b0 con 0x55accabb6e10 2024-09-13T17:22:35.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.148+0000 7fde06448740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55accab1afa0 con 0x55accabc1fd0 2024-09-13T17:22:35.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.148+0000 7fde014c2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55accabb7730 0x55accabc1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:35.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.148+0000 7fde014c2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55accabb7730 0x55accabc1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52180/0 (socket says 172.21.15.87:52180) 2024-09-13T17:22:35.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.148+0000 7fde014c2640 1 -- 172.21.15.87:0/1176369084 learned_addr learned my addr 172.21.15.87:0/1176369084 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:35.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.148+0000 7fddfa7fc640 1 --2- 172.21.15.87:0/259337227 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdde40a1200 0x7fdde40a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:35.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.148+0000 7fde01cc3640 1 --2- 172.21.15.87:0/1176369084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55accabb6e10 0x55accabb71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:35.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.148+0000 7fde00cc1640 1 --2- 172.21.15.87:0/1176369084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55accabc1fd0 0x55accabc43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:35.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.148+0000 7fde01cc3640 1 --2- 172.21.15.87:0/259337227 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdde40a1200 0x7fdde40a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:35.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.148+0000 7fddfa7fc640 1 -- 172.21.15.87:0/259337227 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fddf40cceb0 con 0x7fddfc0fee80 2024-09-13T17:22:35.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.148+0000 7fde014c2640 1 -- 172.21.15.87:0/1176369084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55accabc1fd0 msgr2=0x55accabc43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:35.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.148+0000 7fde014c2640 1 --2- 172.21.15.87:0/1176369084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55accabc1fd0 0x55accabc43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.148+0000 7fde014c2640 1 -- 172.21.15.87:0/1176369084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55accabb6e10 msgr2=0x55accabb71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:35.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.148+0000 7fde014c2640 1 --2- 172.21.15.87:0/1176369084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55accabb6e10 0x55accabb71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.148+0000 7fde014c2640 1 -- 172.21.15.87:0/1176369084 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55accaad5840 con 0x55accabb7730 2024-09-13T17:22:35.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.148+0000 7fde00cc1640 1 --2- 172.21.15.87:0/1176369084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55accabc1fd0 0x55accabc43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:22:35.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.148+0000 7fde01cc3640 1 --2- 172.21.15.87:0/1176369084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55accabb6e10 0x55accabb71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:22:35.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.149+0000 7fde014c2640 1 --2- 172.21.15.87:0/1176369084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55accabb7730 0x55accabc1a90 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fddf4096620 tx=0x7fddf4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abe9efce6758bab9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:35.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.149+0000 7fdde37fe640 1 -- 172.21.15.87:0/1176369084 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf409a2b0 con 0x55accabb7730 2024-09-13T17:22:35.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.149+0000 7fde01cc3640 1 --2- 172.21.15.87:0/259337227 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdde40a1200 0x7fdde40a36c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fddec009fd0 tx=0x7fddec005bd0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:35.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.149+0000 7fdde37fe640 1 -- 172.21.15.87:0/1176369084 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fddf4099bb0 con 0x55accabb7730 2024-09-13T17:22:35.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.149+0000 7fdde37fe640 1 -- 172.21.15.87:0/1176369084 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf4097f50 con 0x55accabb7730 2024-09-13T17:22:35.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.149+0000 7fde06448740 1 -- 172.21.15.87:0/1176369084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55accabb7730 msgr2=0x55accabc1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:35.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.149+0000 7fde06448740 1 --2- 172.21.15.87:0/1176369084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55accabb7730 0x55accabc1a90 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fddf4096620 tx=0x7fddf4000bc0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.150+0000 7fde06448740 1 -- 172.21.15.87:0/1176369084 shutdown_connections 2024-09-13T17:22:35.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.150+0000 7fde06448740 1 --2- 172.21.15.87:0/1176369084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55accabc1fd0 0x55accabc43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.150+0000 7fde06448740 1 --2- 172.21.15.87:0/1176369084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55accabb7730 0x55accabc1a90 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.150+0000 7fde06448740 1 --2- 172.21.15.87:0/1176369084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55accabb6e10 0x55accabb71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.150+0000 7fde06448740 1 -- 172.21.15.87:0/1176369084 >> 172.21.15.87:0/1176369084 conn(0x55accabb3380 msgr2=0x55accabb3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:35.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.150+0000 7fde06448740 1 -- 172.21.15.87:0/1176369084 shutdown_connections 2024-09-13T17:22:35.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.150+0000 7fde06448740 1 -- 172.21.15.87:0/1176369084 wait complete. 2024-09-13T17:22:35.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.150+0000 7fde06448740 1 -- start start 2024-09-13T17:22:35.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.150+0000 7fde06448740 1 Processor -- start 2024-09-13T17:22:35.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.150+0000 7fde06448740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55accabb6e10 0x55accabbed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:35.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.150+0000 7fde06448740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55accabb7730 0x55accabbf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:35.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.150+0000 7fde06448740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55accabc1fd0 0x55accabbf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:35.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.150+0000 7fde06448740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55accaabc2a0 con 0x55accabc1fd0 2024-09-13T17:22:35.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.150+0000 7fde06448740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acca7f3430 con 0x55accabb6e10 2024-09-13T17:22:35.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.150+0000 7fde06448740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55accaa9e680 con 0x55accabb7730 2024-09-13T17:22:35.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.150+0000 7fde06448740 10 client.0 _ll_register_callbacks cb 0x55accab14610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:22:35.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.150+0000 7fde01cc3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55accabc1fd0 0x55accabbf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:35.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.150+0000 7fde01cc3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55accabc1fd0 0x55accabbf7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52182/0 (socket says 172.21.15.87:52182) 2024-09-13T17:22:35.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.150+0000 7fde01cc3640 1 -- 172.21.15.87:0/3138466457 learned_addr learned my addr 172.21.15.87:0/3138466457 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:35.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.151+0000 7fde00cc1640 1 --2- 172.21.15.87:0/3138466457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55accabb7730 0x55accabbf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:35.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.151+0000 7fde014c2640 1 --2- 172.21.15.87:0/3138466457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55accabb6e10 0x55accabbed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:35.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.151+0000 7fde01cc3640 1 -- 172.21.15.87:0/3138466457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55accabb7730 msgr2=0x55accabbf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:35.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.151+0000 7fde01cc3640 1 --2- 172.21.15.87:0/3138466457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55accabb7730 0x55accabbf260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.151+0000 7fde01cc3640 1 -- 172.21.15.87:0/3138466457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55accabb6e10 msgr2=0x55accabbed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:35.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.151+0000 7fde01cc3640 1 --2- 172.21.15.87:0/3138466457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55accabb6e10 0x55accabbed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.151+0000 7fde01cc3640 1 -- 172.21.15.87:0/3138466457 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddfc068a20 con 0x55accabc1fd0 2024-09-13T17:22:35.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.151+0000 7fde014c2640 1 --2- 172.21.15.87:0/3138466457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55accabb6e10 0x55accabbed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:22:35.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.151+0000 7fde01cc3640 1 --2- 172.21.15.87:0/3138466457 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55accabc1fd0 0x55accabbf7a0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fddec009b40 tx=0x7fddec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a1241ec01048744 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:35.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.151+0000 7fdde0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:22:35.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.151+0000 7fdde0ff9640 1 -- 172.21.15.87:0/3138466457 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec018070 con 0x55accabc1fd0 2024-09-13T17:22:35.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.151+0000 7fdde0ff9640 1 -- 172.21.15.87:0/3138466457 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fddec00fb50 con 0x55accabc1fd0 2024-09-13T17:22:35.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.151+0000 7fde06448740 1 -- 172.21.15.87:0/3138466457 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55acca80e4e0 con 0x55accabc1fd0 2024-09-13T17:22:35.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.151+0000 7fdde0ff9640 1 -- 172.21.15.87:0/3138466457 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fddec00fd10 con 0x55accabc1fd0 2024-09-13T17:22:35.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.151+0000 7fde06448740 10 client.17913 fetch_fsmap learned FSMap version 36 2024-09-13T17:22:35.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.151+0000 7fde06448740 1 -- 172.21.15.87:0/3138466457 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55accab19620 con 0x55accabc1fd0 2024-09-13T17:22:35.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.151+0000 7fdde0ff9640 1 -- 172.21.15.87:0/3138466457 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55acca80e4e0 con 0x55accabc1fd0 2024-09-13T17:22:35.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.152+0000 7fdde0ff9640 1 -- 172.21.15.87:0/3138466457 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fddec025020 con 0x55accabc1fd0 2024-09-13T17:22:35.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.152+0000 7fde06448740 10 client.17913 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:22:35.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.152+0000 7fde06448740 10 client.17913 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:22:35.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.152+0000 7fde06448740 20 client.17913 populate_metadata read hostname 'smithi087' 2024-09-13T17:22:35.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.152+0000 7fde06448740 1 --2- 172.21.15.87:0/3138466457 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55accabd1de0 0x55accabd41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:35.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.152+0000 7fde06448740 4 client.17913 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:22:35.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.152+0000 7fde06448740 1 -- 172.21.15.87:0/3138466457 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55acca81f7e0 con 0x55accabd1de0 2024-09-13T17:22:35.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.152+0000 7fde014c2640 1 --2- 172.21.15.87:0/3138466457 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55accabd1de0 0x55accabd41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:35.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.152+0000 7fdde0ff9640 10 client.17913 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:22:35.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.152+0000 7fde014c2640 1 --2- 172.21.15.87:0/3138466457 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55accabd1de0 0x55accabd41d0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47cd5be5d7645116 server_cookie=49924af320a5554e in_seq=0 out_seq=0 2024-09-13T17:22:35.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.153+0000 7fdde0ff9640 1 -- 172.21.15.87:0/3138466457 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55acca81f7e0 con 0x55accabd1de0 2024-09-13T17:22:35.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.153+0000 7fdde0ff9640 10 client.17913 handle_command_reply: tid=0 2024-09-13T17:22:35.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.153+0000 7fde06448740 1 client.17913 shutdown 2024-09-13T17:22:35.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.153+0000 7fde06448740 1 -- 172.21.15.87:0/3138466457 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55accabc1fd0 msgr2=0x55accabbf7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:35.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.153+0000 7fde06448740 1 --2- 172.21.15.87:0/3138466457 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55accabc1fd0 0x55accabbf7a0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fddec009b40 tx=0x7fddec004a40 comp rx=0 tx=0).stop 2024-09-13T17:22:35.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.153+0000 7fde06448740 1 -- 172.21.15.87:0/3138466457 shutdown_connections 2024-09-13T17:22:35.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.153+0000 7fde06448740 1 --2- 172.21.15.87:0/3138466457 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55accabd1de0 0x55accabd41d0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.153+0000 7fde06448740 1 --2- 172.21.15.87:0/3138466457 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55accabc1fd0 0x55accabbf7a0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.153+0000 7fde06448740 1 --2- 172.21.15.87:0/3138466457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55accabb7730 0x55accabbf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.153+0000 7fdde0ff9640 0 client.17913 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:22:35.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.153+0000 7fde06448740 1 --2- 172.21.15.87:0/3138466457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55accabb6e10 0x55accabbed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.153+0000 7fde06448740 1 -- 172.21.15.87:0/3138466457 >> 172.21.15.87:0/3138466457 conn(0x55accabb3380 msgr2=0x55accabb90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:35.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.153+0000 7fde06448740 1 -- 172.21.15.87:0/3138466457 shutdown_connections 2024-09-13T17:22:35.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.153+0000 7fde06448740 1 -- 172.21.15.87:0/3138466457 wait complete. 2024-09-13T17:22:35.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.153+0000 7fde06448740 20 client.17913 trim_cache size 0 max 16384 2024-09-13T17:22:35.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.167+0000 7fde06448740 1 Processor -- start 2024-09-13T17:22:35.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.167+0000 7fde06448740 1 -- start start 2024-09-13T17:22:35.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.167+0000 7fde06448740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55accabb6e10 0x55accabc90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:35.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.167+0000 7fde06448740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55accabb7730 0x55accabbf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:35.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.167+0000 7fde06448740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55accabc1fd0 0x55accabb9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:35.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.167+0000 7fde06448740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55accabc9600 con 0x55accabc1fd0 2024-09-13T17:22:35.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.167+0000 7fde06448740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55accabd06f0 con 0x55accabb6e10 2024-09-13T17:22:35.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.167+0000 7fde06448740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55accabd1c00 con 0x55accabb7730 2024-09-13T17:22:35.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.167+0000 7fde01cc3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55accabc1fd0 0x55accabb9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:35.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.167+0000 7fde01cc3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55accabc1fd0 0x55accabb9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52186/0 (socket says 172.21.15.87:52186) 2024-09-13T17:22:35.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.167+0000 7fde01cc3640 1 -- 172.21.15.87:0/227009567 learned_addr learned my addr 172.21.15.87:0/227009567 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:35.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.168+0000 7fde00cc1640 1 --2- 172.21.15.87:0/227009567 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55accabb7730 0x55accabbf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:35.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.168+0000 7fde01cc3640 1 -- 172.21.15.87:0/227009567 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55accabb7730 msgr2=0x55accabbf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:35.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.168+0000 7fde01cc3640 1 --2- 172.21.15.87:0/227009567 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55accabb7730 0x55accabbf5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.168+0000 7fde01cc3640 1 -- 172.21.15.87:0/227009567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55accabb6e10 msgr2=0x55accabc90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:35.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.168+0000 7fde01cc3640 1 --2- 172.21.15.87:0/227009567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55accabb6e10 0x55accabc90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.168+0000 7fde01cc3640 1 -- 172.21.15.87:0/227009567 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55accaabb790 con 0x55accabc1fd0 2024-09-13T17:22:35.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.168+0000 7fde01cc3640 1 --2- 172.21.15.87:0/227009567 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55accabc1fd0 0x55accabb9f90 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fddec009d00 tx=0x7fddec009d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33947e2fe5aa53c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:35.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.168+0000 7fdde3fff640 1 -- 172.21.15.87:0/227009567 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec018070 con 0x55accabc1fd0 2024-09-13T17:22:35.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.168+0000 7fdde3fff640 1 -- 172.21.15.87:0/227009567 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fddec019040 con 0x55accabc1fd0 2024-09-13T17:22:35.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.168+0000 7fdde3fff640 1 -- 172.21.15.87:0/227009567 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec034670 con 0x55accabc1fd0 2024-09-13T17:22:35.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.168+0000 7fde06448740 1 -- 172.21.15.87:0/227009567 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55accabc1fd0 msgr2=0x55accabb9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:35.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.168+0000 7fde06448740 1 --2- 172.21.15.87:0/227009567 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55accabc1fd0 0x55accabb9f90 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fddec009d00 tx=0x7fddec009d30 comp rx=0 tx=0).stop 2024-09-13T17:22:35.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.169+0000 7fde06448740 1 -- 172.21.15.87:0/227009567 shutdown_connections 2024-09-13T17:22:35.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.169+0000 7fde06448740 1 --2- 172.21.15.87:0/227009567 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55accabc1fd0 0x55accabb9f90 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.169+0000 7fde06448740 1 --2- 172.21.15.87:0/227009567 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55accabb7730 0x55accabbf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.169+0000 7fde06448740 1 --2- 172.21.15.87:0/227009567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55accabb6e10 0x55accabc90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.169+0000 7fde06448740 1 -- 172.21.15.87:0/227009567 >> 172.21.15.87:0/227009567 conn(0x55accabb3380 msgr2=0x55accabb3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:35.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.169+0000 7fde06448740 1 -- 172.21.15.87:0/227009567 shutdown_connections 2024-09-13T17:22:35.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.169+0000 7fde06448740 1 -- 172.21.15.87:0/227009567 wait complete. 2024-09-13T17:22:35.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.169+0000 7fde06448740 1 -- start start 2024-09-13T17:22:35.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.169+0000 7fde06448740 1 Processor -- start 2024-09-13T17:22:35.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.170+0000 7fde06448740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55accabb6e10 0x55accac258a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:35.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.170+0000 7fde06448740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55accabb7730 0x55accac25de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:35.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.170+0000 7fde06448740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55accabc1fd0 0x55accac20230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:35.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.170+0000 7fde06448740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55accac20900 con 0x55accabb6e10 2024-09-13T17:22:35.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.170+0000 7fde06448740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55accac20a70 con 0x55accabb7730 2024-09-13T17:22:35.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.170+0000 7fde06448740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55accac20c30 con 0x55accabc1fd0 2024-09-13T17:22:35.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.170+0000 7fde06448740 10 client.0 _ll_register_callbacks cb 0x7fddec009c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:22:35.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.170+0000 7fde014c2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55accabb6e10 0x55accac258a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:35.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.170+0000 7fde014c2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55accabb6e10 0x55accac258a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52192/0 (socket says 172.21.15.87:52192) 2024-09-13T17:22:35.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.170+0000 7fde014c2640 1 -- 172.21.15.87:0/984270704 learned_addr learned my addr 172.21.15.87:0/984270704 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:22:35.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.170+0000 7fde00cc1640 1 --2- 172.21.15.87:0/984270704 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55accabb7730 0x55accac25de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:35.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.170+0000 7fde014c2640 1 -- 172.21.15.87:0/984270704 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55accabc1fd0 msgr2=0x55accac20230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:35.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.170+0000 7fde014c2640 1 --2- 172.21.15.87:0/984270704 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55accabc1fd0 0x55accac20230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.170+0000 7fde014c2640 1 -- 172.21.15.87:0/984270704 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55accabb7730 msgr2=0x55accac25de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:22:35.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.170+0000 7fde014c2640 1 --2- 172.21.15.87:0/984270704 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55accabb7730 0x55accac25de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.170+0000 7fde014c2640 1 -- 172.21.15.87:0/984270704 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55accab19620 con 0x55accabb6e10 2024-09-13T17:22:35.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.170+0000 7fde00cc1640 1 --2- 172.21.15.87:0/984270704 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55accabb7730 0x55accac25de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:22:35.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.170+0000 7fde014c2640 1 --2- 172.21.15.87:0/984270704 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55accabb6e10 0x55accac258a0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fddf4099b40 tx=0x7fddf4004480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce1f2f940a5fe0b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:22:35.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.170+0000 7fdde0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:22:35.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.170+0000 7fdde0ff9640 1 -- 172.21.15.87:0/984270704 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf40b1070 con 0x55accabb6e10 2024-09-13T17:22:35.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.170+0000 7fdde0ff9640 1 -- 172.21.15.87:0/984270704 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fddf4005670 con 0x55accabb6e10 2024-09-13T17:22:35.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.170+0000 7fde06448740 1 -- 172.21.15.87:0/984270704 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fddf4099bb0 con 0x55accabb6e10 2024-09-13T17:22:35.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.170+0000 7fdde0ff9640 1 -- 172.21.15.87:0/984270704 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fddf4007c60 con 0x55accabb6e10 2024-09-13T17:22:35.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.170+0000 7fde06448740 10 client.17919 fetch_fsmap learned FSMap version 36 2024-09-13T17:22:35.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.170+0000 7fde06448740 1 -- 172.21.15.87:0/984270704 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55accaae0ea0 con 0x55accabb6e10 2024-09-13T17:22:35.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.171+0000 7fdde0ff9640 1 -- 172.21.15.87:0/984270704 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fddf4099bb0 con 0x55accabb6e10 2024-09-13T17:22:35.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.171+0000 7fdde0ff9640 1 -- 172.21.15.87:0/984270704 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fddf4016030 con 0x55accabb6e10 2024-09-13T17:22:35.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.171+0000 7fde06448740 10 client.17919 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:22:35.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.171+0000 7fde06448740 10 client.17919 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:22:35.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.171+0000 7fde06448740 20 client.17919 populate_metadata read hostname 'smithi087' 2024-09-13T17:22:35.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.171+0000 7fde06448740 1 --2- 172.21.15.87:0/984270704 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55accac2d2c0 0x55accac2f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:22:35.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.171+0000 7fde06448740 4 client.17919 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:22:35.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.171+0000 7fde06448740 1 -- 172.21.15.87:0/984270704 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55acca872e30 con 0x55accac2d2c0 2024-09-13T17:22:35.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.171+0000 7fde00cc1640 1 --2- 172.21.15.87:0/984270704 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55accac2d2c0 0x55accac2f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:22:35.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.172+0000 7fdde0ff9640 10 client.17919 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:22:35.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.172+0000 7fde00cc1640 1 --2- 172.21.15.87:0/984270704 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55accac2d2c0 0x55accac2f6b0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a5ed46a261e502d server_cookie=d418705ed0948282 in_seq=0 out_seq=0 2024-09-13T17:22:35.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.172+0000 7fdde0ff9640 1 -- 172.21.15.87:0/984270704 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55acca872e30 con 0x55accac2d2c0 2024-09-13T17:22:35.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.172+0000 7fdde0ff9640 10 client.17919 handle_command_reply: tid=0 2024-09-13T17:22:35.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.172+0000 7fde06448740 1 client.17919 shutdown 2024-09-13T17:22:35.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.172+0000 7fde06448740 1 -- 172.21.15.87:0/984270704 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55accabb6e10 msgr2=0x55accac258a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:35.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.172+0000 7fde06448740 1 --2- 172.21.15.87:0/984270704 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55accabb6e10 0x55accac258a0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fddf4099b40 tx=0x7fddf4004480 comp rx=0 tx=0).stop 2024-09-13T17:22:35.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.172+0000 7fde06448740 1 -- 172.21.15.87:0/984270704 shutdown_connections 2024-09-13T17:22:35.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.172+0000 7fde06448740 1 --2- 172.21.15.87:0/984270704 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55accac2d2c0 0x55accac2f6b0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.172+0000 7fde06448740 1 --2- 172.21.15.87:0/984270704 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55accabc1fd0 0x55accac20230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.172+0000 7fde06448740 1 --2- 172.21.15.87:0/984270704 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55accabb7730 0x55accac25de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.172+0000 7fde06448740 1 --2- 172.21.15.87:0/984270704 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55accabb6e10 0x55accac258a0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.172+0000 7fdde0ff9640 0 client.17919 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:22:35.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.172+0000 7fde06448740 1 -- 172.21.15.87:0/984270704 >> 172.21.15.87:0/984270704 conn(0x55accabb3380 msgr2=0x55accabb9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:35.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.172+0000 7fde06448740 1 -- 172.21.15.87:0/984270704 shutdown_connections 2024-09-13T17:22:35.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.172+0000 7fde06448740 1 -- 172.21.15.87:0/984270704 wait complete. 2024-09-13T17:22:35.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.172+0000 7fde06448740 20 client.17919 trim_cache size 0 max 16384 2024-09-13T17:22:35.187 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:22:35.187 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-13T17:22:35.187 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": { 2024-09-13T17:22:35.187 INFO:teuthology.orchestra.run.smithi087.stdout: "287fc58e-bf82-47b2-b5d3-9e7337d5a273": { 2024-09-13T17:22:35.187 INFO:teuthology.orchestra.run.smithi087.stdout: "path": "/", 2024-09-13T17:22:35.187 INFO:teuthology.orchestra.run.smithi087.stdout: "tag": "287fc58e-bf82-47b2-b5d3-9e7337d5a273", 2024-09-13T17:22:35.187 INFO:teuthology.orchestra.run.smithi087.stdout: "options": "recursive,force" 2024-09-13T17:22:35.187 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:22:35.188 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:22:35.188 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:22:35.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.173+0000 7fde03726640 1 -- 172.21.15.87:0/259337227 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdde40a1200 msgr2=0x7fdde40a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:35.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.173+0000 7fde03726640 1 --2- 172.21.15.87:0/259337227 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdde40a1200 0x7fdde40a36c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fddec009fd0 tx=0x7fddec005bd0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.173+0000 7fde03726640 1 -- 172.21.15.87:0/259337227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddfc0fee80 msgr2=0x7fddfc1951b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:22:35.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.173+0000 7fde03726640 1 --2- 172.21.15.87:0/259337227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddfc0fee80 0x7fddfc1951b0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fddf400c890 tx=0x7fddf400cd50 comp rx=0 tx=0).stop 2024-09-13T17:22:35.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.173+0000 7fde03726640 1 -- 172.21.15.87:0/259337227 shutdown_connections 2024-09-13T17:22:35.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.173+0000 7fde03726640 1 --2- 172.21.15.87:0/259337227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fddfc199a90 0x7fddfc199f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.173+0000 7fde03726640 1 --2- 172.21.15.87:0/259337227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddfc103fd0 0x7fddfc1956f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.173+0000 7fde03726640 1 --2- 172.21.15.87:0/259337227 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdde40a1200 0x7fdde40a36c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.173+0000 7fde03726640 1 --2- 172.21.15.87:0/259337227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddfc0fee80 0x7fddfc1951b0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:22:35.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.173+0000 7fde03726640 1 -- 172.21.15.87:0/259337227 >> 172.21.15.87:0/259337227 conn(0x7fddfc0fa930 msgr2=0x7fddfc0fbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:22:35.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.173+0000 7fde03726640 1 -- 172.21.15.87:0/259337227 shutdown_connections 2024-09-13T17:22:35.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:22:35.173+0000 7fde03726640 1 -- 172.21.15.87:0/259337227 wait complete. 2024-09-13T17:22:35.190 INFO:tasks.cephfs.filesystem:scrub status for tag:287fc58e-bf82-47b2-b5d3-9e7337d5a273 - {'path': '/', 'tag': '287fc58e-bf82-47b2-b5d3-9e7337d5a273', 'options': 'recursive,force'} 2024-09-13T17:22:35.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:35 smithi118 ceph-mon[34374]: pgmap v272: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:22:35.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:35 smithi087 ceph-mon[30934]: pgmap v272: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:22:36.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:35 smithi149 ceph-mon[35496]: pgmap v272: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:22:36.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:36 smithi118 ceph-mon[34374]: scrub queued for path: / 2024-09-13T17:22:36.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:36 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:22:36.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:36 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:22:36.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:36 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:22:36.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:36 smithi087 ceph-mon[30934]: scrub queued for path: / 2024-09-13T17:22:36.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:36 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:22:36.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:36 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:22:36.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:36 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:22:37.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:36 smithi149 ceph-mon[35496]: scrub queued for path: / 2024-09-13T17:22:37.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:36 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:22:37.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:36 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:22:37.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:36 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:22:37.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:37 smithi118 ceph-mon[34374]: pgmap v273: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:22:37.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:37 smithi087 ceph-mon[30934]: pgmap v273: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:22:38.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:37 smithi149 ceph-mon[35496]: pgmap v273: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:22:39.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:39 smithi118 ceph-mon[34374]: pgmap v274: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:22:39.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:39 smithi087 ceph-mon[30934]: pgmap v274: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:22:40.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:39 smithi149 ceph-mon[35496]: pgmap v274: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:22:40.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:40 smithi118 ceph-mon[34374]: scrub summary: idle 2024-09-13T17:22:40.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:40 smithi087 ceph-mon[30934]: scrub summary: idle 2024-09-13T17:22:41.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:40 smithi149 ceph-mon[35496]: scrub summary: idle 2024-09-13T17:22:41.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:41 smithi118 ceph-mon[34374]: pgmap v275: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:22:41.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:41 smithi087 ceph-mon[30934]: pgmap v275: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:22:42.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:41 smithi149 ceph-mon[35496]: pgmap v275: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:22:43.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:43 smithi118 ceph-mon[34374]: pgmap v276: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:22:43.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:43 smithi087 ceph-mon[30934]: pgmap v276: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:22:44.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:43 smithi149 ceph-mon[35496]: pgmap v276: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:22:45.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:45 smithi118 ceph-mon[34374]: pgmap v277: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:22:45.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:45 smithi087 ceph-mon[30934]: pgmap v277: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:22:46.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:45 smithi149 ceph-mon[35496]: pgmap v277: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:22:47.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:47 smithi118 ceph-mon[34374]: pgmap v278: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:22:47.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:47 smithi087 ceph-mon[30934]: pgmap v278: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:22:48.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:47 smithi149 ceph-mon[35496]: pgmap v278: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:22:49.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:49 smithi118 ceph-mon[34374]: pgmap v279: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:22:49.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:49 smithi087 ceph-mon[30934]: pgmap v279: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:22:50.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:49 smithi149 ceph-mon[35496]: pgmap v279: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:22:51.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:51 smithi118 ceph-mon[34374]: pgmap v280: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:22:51.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:51 smithi087 ceph-mon[30934]: pgmap v280: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:22:52.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:51 smithi149 ceph-mon[35496]: pgmap v280: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:22:53.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:53 smithi118 ceph-mon[34374]: pgmap v281: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:22:53.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:53 smithi087 ceph-mon[30934]: pgmap v281: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:22:54.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:53 smithi149 ceph-mon[35496]: pgmap v281: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:22:55.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:55 smithi118 ceph-mon[34374]: pgmap v282: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:22:55.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:55 smithi087 ceph-mon[30934]: pgmap v282: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:22:56.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:55 smithi149 ceph-mon[35496]: pgmap v282: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:22:57.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:57 smithi118 ceph-mon[34374]: pgmap v283: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:22:57.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:57 smithi087 ceph-mon[30934]: pgmap v283: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:22:58.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:57 smithi149 ceph-mon[35496]: pgmap v283: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:22:59.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:22:59 smithi118 ceph-mon[34374]: pgmap v284: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:22:59.895 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:22:59 smithi149 ceph-mon[35496]: pgmap v284: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:22:59.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:22:59 smithi087 ceph-mon[30934]: pgmap v284: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:23:02.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:02 smithi118 ceph-mon[34374]: pgmap v285: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-09-13T17:23:02.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:02 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:23:02.978 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:02 smithi087 ceph-mon[30934]: pgmap v285: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-09-13T17:23:02.979 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:02 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:23:03.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:02 smithi149 ceph-mon[35496]: pgmap v285: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-09-13T17:23:03.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:02 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:23:04.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:03 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:23:04.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:03 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:23:04.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:03 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:23:04.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:03 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:23:04.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:03 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:23:04.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:03 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:23:04.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:03 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:23:04.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:03 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:23:04.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:03 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:23:05.191 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:23:05.223 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:04 smithi087 ceph-mon[30934]: pgmap v286: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-13T17:23:05.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.309+0000 7f9cc5619640 1 -- 172.21.15.87:0/1452486530 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cc0103fb0 msgr2=0x7f9cc010bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:05.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.309+0000 7f9cc5619640 1 --2- 172.21.15.87:0/1452486530 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cc0103fb0 0x7f9cc010bb00 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8009930 tx=0x7f9cb802a420 comp rx=0 tx=0).stop 2024-09-13T17:23:05.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.309+0000 7f9cc5619640 1 -- 172.21.15.87:0/1452486530 shutdown_connections 2024-09-13T17:23:05.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.309+0000 7f9cc5619640 1 --2- 172.21.15.87:0/1452486530 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cc0103fb0 0x7f9cc010bb00 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.309+0000 7f9cc5619640 1 --2- 172.21.15.87:0/1452486530 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cc00ff810 0x7f9cc0103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.309+0000 7f9cc5619640 1 --2- 172.21.15.87:0/1452486530 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cc00fee60 0x7f9cc00ff240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.309+0000 7f9cc5619640 1 -- 172.21.15.87:0/1452486530 >> 172.21.15.87:0/1452486530 conn(0x7f9cc0075c60 msgr2=0x7f9cc00fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:05.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.309+0000 7f9cc5619640 1 -- 172.21.15.87:0/1452486530 shutdown_connections 2024-09-13T17:23:05.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.309+0000 7f9cc5619640 1 -- 172.21.15.87:0/1452486530 wait complete. 2024-09-13T17:23:05.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.309+0000 7f9cc5619640 1 Processor -- start 2024-09-13T17:23:05.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.310+0000 7f9cc5619640 1 -- start start 2024-09-13T17:23:05.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.310+0000 7f9cc5619640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cc00fee60 0x7f9cc0196270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.310+0000 7f9cc5619640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cc0103fb0 0x7f9cc01967b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.310+0000 7f9cc5619640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cc019aba0 0x7f9cc019b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.310+0000 7f9cc5619640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc019b590 con 0x7f9cc019aba0 2024-09-13T17:23:05.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.310+0000 7f9cc5619640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc019b700 con 0x7f9cc00fee60 2024-09-13T17:23:05.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.310+0000 7f9cc5619640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc019b870 con 0x7f9cc0103fb0 2024-09-13T17:23:05.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.310+0000 7f9cbf7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cc019aba0 0x7f9cc019b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.310+0000 7f9cbf7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cc019aba0 0x7f9cc019b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51940/0 (socket says 172.21.15.87:51940) 2024-09-13T17:23:05.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.310+0000 7f9cbf7fe640 1 -- 172.21.15.87:0/323230583 learned_addr learned my addr 172.21.15.87:0/323230583 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:05.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.310+0000 7f9cbeffd640 1 --2- 172.21.15.87:0/323230583 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cc00fee60 0x7f9cc0196270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.310+0000 7f9cbe7fc640 1 --2- 172.21.15.87:0/323230583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cc0103fb0 0x7f9cc01967b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.310+0000 7f9cbf7fe640 1 -- 172.21.15.87:0/323230583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cc0103fb0 msgr2=0x7f9cc01967b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.310+0000 7f9cbf7fe640 1 --2- 172.21.15.87:0/323230583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cc0103fb0 0x7f9cc01967b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.310+0000 7f9cbf7fe640 1 -- 172.21.15.87:0/323230583 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cc00fee60 msgr2=0x7f9cc0196270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.310+0000 7f9cbf7fe640 1 --2- 172.21.15.87:0/323230583 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cc00fee60 0x7f9cc0196270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.310+0000 7f9cbf7fe640 1 -- 172.21.15.87:0/323230583 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb8009560 con 0x7f9cc019aba0 2024-09-13T17:23:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.310+0000 7f9cbf7fe640 1 --2- 172.21.15.87:0/323230583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cc019aba0 0x7f9cc019b050 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f9cb80057c0 tx=0x7f9cb80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.311+0000 7f9ca7fff640 1 -- 172.21.15.87:0/323230583 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb8031c30 con 0x7f9cc019aba0 2024-09-13T17:23:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.311+0000 7f9cc5619640 1 -- 172.21.15.87:0/323230583 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc01a2e50 con 0x7f9cc019aba0 2024-09-13T17:23:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.311+0000 7f9ca7fff640 1 -- 172.21.15.87:0/323230583 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9cb80044e0 con 0x7f9cc019aba0 2024-09-13T17:23:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.311+0000 7f9ca7fff640 1 -- 172.21.15.87:0/323230583 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb80324c0 con 0x7f9cc019aba0 2024-09-13T17:23:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.311+0000 7f9cc5619640 1 -- 172.21.15.87:0/323230583 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc01a3270 con 0x7f9cc019aba0 2024-09-13T17:23:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.313+0000 7f9ca7fff640 1 -- 172.21.15.87:0/323230583 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f9cb8032620 con 0x7f9cc019aba0 2024-09-13T17:23:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.313+0000 7f9cc8418740 1 Processor -- start 2024-09-13T17:23:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.313+0000 7f9cc8418740 1 -- start start 2024-09-13T17:23:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.313+0000 7f9ca7fff640 1 --2- 172.21.15.87:0/323230583 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f9ca80a1200 0x7f9ca80a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.313+0000 7f9cc8418740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ede7d0e10 0x560ede7d11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.313+0000 7f9cc8418740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ede7d1730 0x560ede7dba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.313+0000 7f9cc8418740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ede7dbfd0 0x560ede7de3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.313+0000 7f9cc8418740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ede73bf20 con 0x560ede7dbfd0 2024-09-13T17:23:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.313+0000 7f9cc8418740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ede7396b0 con 0x560ede7d0e10 2024-09-13T17:23:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.313+0000 7f9cc8418740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ede734fa0 con 0x560ede7d1730 2024-09-13T17:23:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.314+0000 7f9cbe7fc640 1 --2- 172.21.15.87:0/323230583 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f9ca80a1200 0x7f9ca80a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.314+0000 7f9cbf7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ede7dbfd0 0x560ede7de3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.314+0000 7f9cbf7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ede7dbfd0 0x560ede7de3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51942/0 (socket says 172.21.15.87:51942) 2024-09-13T17:23:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.314+0000 7f9ca7fff640 1 -- 172.21.15.87:0/323230583 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f9cb80eda10 con 0x7f9cc019aba0 2024-09-13T17:23:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.314+0000 7f9cbf7fe640 1 -- 172.21.15.87:0/844394362 learned_addr learned my addr 172.21.15.87:0/844394362 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:05.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.314+0000 7f9cbeffd640 1 --2- 172.21.15.87:0/844394362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ede7d0e10 0x560ede7d11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.314+0000 7f9cbe7fc640 1 --2- 172.21.15.87:0/844394362 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ede7d1730 0x560ede7dba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.314+0000 7f9cbf7fe640 1 -- 172.21.15.87:0/844394362 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ede7d1730 msgr2=0x560ede7dba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:05.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.314+0000 7f9cbf7fe640 1 --2- 172.21.15.87:0/844394362 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ede7d1730 0x560ede7dba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.314+0000 7f9cbf7fe640 1 -- 172.21.15.87:0/844394362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ede7d0e10 msgr2=0x560ede7d11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:05.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.314+0000 7f9cbf7fe640 1 --2- 172.21.15.87:0/844394362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ede7d0e10 0x560ede7d11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.314+0000 7f9cbf7fe640 1 -- 172.21.15.87:0/844394362 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ede6ef840 con 0x560ede7dbfd0 2024-09-13T17:23:05.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.314+0000 7f9cbe7fc640 1 --2- 172.21.15.87:0/323230583 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f9ca80a1200 0x7f9ca80a36c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9cb40058c0 tx=0x7f9cb40137d0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:05.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.314+0000 7f9cbf7fe640 1 --2- 172.21.15.87:0/844394362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ede7dbfd0 0x560ede7de3c0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f9cb80ead50 tx=0x7f9cb802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab862a533c9af00 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:05.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.314+0000 7f9ca57fa640 1 -- 172.21.15.87:0/844394362 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb80ba6b0 con 0x560ede7dbfd0 2024-09-13T17:23:05.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.314+0000 7f9ca57fa640 1 -- 172.21.15.87:0/844394362 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9cb80be4e0 con 0x560ede7dbfd0 2024-09-13T17:23:05.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.314+0000 7f9ca57fa640 1 -- 172.21.15.87:0/844394362 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb80b8a50 con 0x560ede7dbfd0 2024-09-13T17:23:05.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.315+0000 7f9cc8418740 1 -- 172.21.15.87:0/844394362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ede7dbfd0 msgr2=0x560ede7de3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:05.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.315+0000 7f9cc8418740 1 --2- 172.21.15.87:0/844394362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ede7dbfd0 0x560ede7de3c0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f9cb80ead50 tx=0x7f9cb802a420 comp rx=0 tx=0).stop 2024-09-13T17:23:05.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.315+0000 7f9cc8418740 1 -- 172.21.15.87:0/844394362 shutdown_connections 2024-09-13T17:23:05.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.315+0000 7f9cc8418740 1 --2- 172.21.15.87:0/844394362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ede7dbfd0 0x560ede7de3c0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.315+0000 7f9cc8418740 1 --2- 172.21.15.87:0/844394362 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ede7d1730 0x560ede7dba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.315+0000 7f9cc8418740 1 --2- 172.21.15.87:0/844394362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ede7d0e10 0x560ede7d11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.315+0000 7f9cc8418740 1 -- 172.21.15.87:0/844394362 >> 172.21.15.87:0/844394362 conn(0x560ede7cd380 msgr2=0x560ede7cd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:05.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.315+0000 7f9cc8418740 1 -- 172.21.15.87:0/844394362 shutdown_connections 2024-09-13T17:23:05.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.315+0000 7f9cc8418740 1 -- 172.21.15.87:0/844394362 wait complete. 2024-09-13T17:23:05.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.315+0000 7f9cc8418740 1 -- start start 2024-09-13T17:23:05.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.315+0000 7f9cc8418740 1 Processor -- start 2024-09-13T17:23:05.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.316+0000 7f9cc8418740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ede7d0e10 0x560ede7db960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.316+0000 7f9cc8418740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ede7d1730 0x560ede7d8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.316+0000 7f9cc8418740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ede7dbfd0 0x560ede7d9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.316+0000 7f9cc8418740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ede6d62a0 con 0x560ede7dbfd0 2024-09-13T17:23:05.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.316+0000 7f9cc8418740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ede40d430 con 0x560ede7d0e10 2024-09-13T17:23:05.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.316+0000 7f9cc8418740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ede6b8680 con 0x560ede7d1730 2024-09-13T17:23:05.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.316+0000 7f9cc8418740 10 client.0 _ll_register_callbacks cb 0x560ede72e610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:23:05.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.316+0000 7f9cbf7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ede7dbfd0 0x560ede7d9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.316+0000 7f9cbf7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ede7dbfd0 0x560ede7d9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51950/0 (socket says 172.21.15.87:51950) 2024-09-13T17:23:05.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.316+0000 7f9cbf7fe640 1 -- 172.21.15.87:0/960932101 learned_addr learned my addr 172.21.15.87:0/960932101 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:05.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.316+0000 7f9cbeffd640 1 --2- 172.21.15.87:0/960932101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ede7d0e10 0x560ede7db960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.316+0000 7f9cbe7fc640 1 --2- 172.21.15.87:0/960932101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ede7d1730 0x560ede7d8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.316+0000 7f9cbf7fe640 1 -- 172.21.15.87:0/960932101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ede7d1730 msgr2=0x560ede7d8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:05.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.316+0000 7f9cbf7fe640 1 --2- 172.21.15.87:0/960932101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ede7d1730 0x560ede7d8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.316+0000 7f9cbf7fe640 1 -- 172.21.15.87:0/960932101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ede7d0e10 msgr2=0x560ede7db960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:05.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.316+0000 7f9cbf7fe640 1 --2- 172.21.15.87:0/960932101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ede7d0e10 0x560ede7db960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.316+0000 7f9cbf7fe640 1 -- 172.21.15.87:0/960932101 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc01a3270 con 0x560ede7dbfd0 2024-09-13T17:23:05.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.316+0000 7f9cbf7fe640 1 --2- 172.21.15.87:0/960932101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ede7dbfd0 0x560ede7d9220 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8031f90 tx=0x7f9cb80baf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9568780a25a235b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:05.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.316+0000 7f9ca2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:23:05.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.316+0000 7f9ca2ff5640 1 -- 172.21.15.87:0/960932101 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb80c2b30 con 0x560ede7dbfd0 2024-09-13T17:23:05.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.316+0000 7f9ca2ff5640 1 -- 172.21.15.87:0/960932101 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f9cb80ba6b0 con 0x560ede7dbfd0 2024-09-13T17:23:05.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.316+0000 7f9cc8418740 1 -- 172.21.15.87:0/960932101 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560ede4284e0 con 0x560ede7dbfd0 2024-09-13T17:23:05.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.317+0000 7f9ca2ff5640 1 -- 172.21.15.87:0/960932101 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9cb80b6dc0 con 0x560ede7dbfd0 2024-09-13T17:23:05.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.317+0000 7f9cc8418740 10 client.17931 fetch_fsmap learned FSMap version 36 2024-09-13T17:23:05.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.317+0000 7f9cc8418740 1 -- 172.21.15.87:0/960932101 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x560ede733620 con 0x560ede7dbfd0 2024-09-13T17:23:05.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.317+0000 7f9ca2ff5640 1 -- 172.21.15.87:0/960932101 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x560ede4284e0 con 0x560ede7dbfd0 2024-09-13T17:23:05.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.317+0000 7f9ca2ff5640 1 -- 172.21.15.87:0/960932101 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f9cb80a5110 con 0x560ede7dbfd0 2024-09-13T17:23:05.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.317+0000 7f9cc8418740 10 client.17931 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:23:05.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.317+0000 7f9cc8418740 10 client.17931 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:23:05.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.317+0000 7f9cc8418740 20 client.17931 populate_metadata read hostname 'smithi087' 2024-09-13T17:23:05.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.317+0000 7f9cc8418740 1 --2- 172.21.15.87:0/960932101 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560ede7eb5b0 0x560ede7ed9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.317+0000 7f9cc8418740 4 client.17931 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:23:05.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.317+0000 7f9cc8418740 1 -- 172.21.15.87:0/960932101 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560ede4397e0 con 0x560ede7eb5b0 2024-09-13T17:23:05.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.317+0000 7f9cbeffd640 1 --2- 172.21.15.87:0/960932101 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560ede7eb5b0 0x560ede7ed9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.318+0000 7f9ca2ff5640 10 client.17931 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:23:05.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.318+0000 7f9cbeffd640 1 --2- 172.21.15.87:0/960932101 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560ede7eb5b0 0x560ede7ed9a0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=696a14e3c15c28a2 server_cookie=2bf92268329fda77 in_seq=0 out_seq=0 2024-09-13T17:23:05.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.318+0000 7f9ca2ff5640 1 -- 172.21.15.87:0/960932101 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x560ede4397e0 con 0x560ede7eb5b0 2024-09-13T17:23:05.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.318+0000 7f9ca2ff5640 10 client.17931 handle_command_reply: tid=0 2024-09-13T17:23:05.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.318+0000 7f9cc8418740 1 client.17931 shutdown 2024-09-13T17:23:05.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.318+0000 7f9cc8418740 1 -- 172.21.15.87:0/960932101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ede7dbfd0 msgr2=0x560ede7d9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:05.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.318+0000 7f9cc8418740 1 --2- 172.21.15.87:0/960932101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ede7dbfd0 0x560ede7d9220 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8031f90 tx=0x7f9cb80baf00 comp rx=0 tx=0).stop 2024-09-13T17:23:05.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.318+0000 7f9cc8418740 1 -- 172.21.15.87:0/960932101 shutdown_connections 2024-09-13T17:23:05.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.318+0000 7f9cc8418740 1 --2- 172.21.15.87:0/960932101 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560ede7eb5b0 0x560ede7ed9a0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.318+0000 7f9cc8418740 1 --2- 172.21.15.87:0/960932101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ede7dbfd0 0x560ede7d9220 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.318+0000 7f9cc8418740 1 --2- 172.21.15.87:0/960932101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ede7d1730 0x560ede7d8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.318+0000 7f9ca2ff5640 0 client.17931 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:23:05.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.318+0000 7f9cc8418740 1 --2- 172.21.15.87:0/960932101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ede7d0e10 0x560ede7db960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.318+0000 7f9cc8418740 1 -- 172.21.15.87:0/960932101 >> 172.21.15.87:0/960932101 conn(0x560ede7cd380 msgr2=0x560ede7d30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:05.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.319+0000 7f9cc8418740 1 -- 172.21.15.87:0/960932101 shutdown_connections 2024-09-13T17:23:05.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.319+0000 7f9cc8418740 1 -- 172.21.15.87:0/960932101 wait complete. 2024-09-13T17:23:05.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.319+0000 7f9cc8418740 20 client.17931 trim_cache size 0 max 16384 2024-09-13T17:23:05.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.333+0000 7f9cc8418740 1 Processor -- start 2024-09-13T17:23:05.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.333+0000 7f9cc8418740 1 -- start start 2024-09-13T17:23:05.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.333+0000 7f9cc8418740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ede7d0e10 0x560ede7ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.333+0000 7f9cc8418740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ede7d1730 0x560ede7e2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.333+0000 7f9cc8418740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ede7dbfd0 0x560ede7e2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.333+0000 7f9cc8418740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ede7ce510 con 0x560ede7d0e10 2024-09-13T17:23:05.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.333+0000 7f9cc8418740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ede7ee000 con 0x560ede7d1730 2024-09-13T17:23:05.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.333+0000 7f9cc8418740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ede7d71d0 con 0x560ede7dbfd0 2024-09-13T17:23:05.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.333+0000 7f9cbeffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ede7d0e10 0x560ede7ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.333+0000 7f9cbeffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ede7d0e10 0x560ede7ccd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51956/0 (socket says 172.21.15.87:51956) 2024-09-13T17:23:05.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.333+0000 7f9cbeffd640 1 -- 172.21.15.87:0/12087328 learned_addr learned my addr 172.21.15.87:0/12087328 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:05.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.333+0000 7f9cbeffd640 1 -- 172.21.15.87:0/12087328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ede7dbfd0 msgr2=0x560ede7e2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:05.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.333+0000 7f9cbeffd640 1 --2- 172.21.15.87:0/12087328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ede7dbfd0 0x560ede7e2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.333+0000 7f9cbeffd640 1 -- 172.21.15.87:0/12087328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ede7d1730 msgr2=0x560ede7e2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:05.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.333+0000 7f9cbe7fc640 1 --2- 172.21.15.87:0/12087328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ede7d1730 0x560ede7e2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.333+0000 7f9cbeffd640 1 --2- 172.21.15.87:0/12087328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ede7d1730 0x560ede7e2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.333+0000 7f9cbeffd640 1 -- 172.21.15.87:0/12087328 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ede6d5790 con 0x560ede7d0e10 2024-09-13T17:23:05.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.333+0000 7f9cbe7fc640 1 --2- 172.21.15.87:0/12087328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ede7d1730 0x560ede7e2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:23:05.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.333+0000 7f9cbeffd640 1 --2- 172.21.15.87:0/12087328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ede7d0e10 0x560ede7ccd00 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0009a70 tx=0x7f9cb0012bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed25096180856012 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:05.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.334+0000 7f9ca5ffb640 1 -- 172.21.15.87:0/12087328 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0017040 con 0x560ede7d0e10 2024-09-13T17:23:05.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.334+0000 7f9ca5ffb640 1 -- 172.21.15.87:0/12087328 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9cb001d830 con 0x560ede7d0e10 2024-09-13T17:23:05.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.334+0000 7f9ca5ffb640 1 -- 172.21.15.87:0/12087328 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0010630 con 0x560ede7d0e10 2024-09-13T17:23:05.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.334+0000 7f9cc8418740 1 -- 172.21.15.87:0/12087328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ede7d0e10 msgr2=0x560ede7ccd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:05.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.334+0000 7f9cc8418740 1 --2- 172.21.15.87:0/12087328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ede7d0e10 0x560ede7ccd00 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0009a70 tx=0x7f9cb0012bb0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.334+0000 7f9cc8418740 1 -- 172.21.15.87:0/12087328 shutdown_connections 2024-09-13T17:23:05.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.334+0000 7f9cc8418740 1 --2- 172.21.15.87:0/12087328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ede7dbfd0 0x560ede7e2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.334+0000 7f9cc8418740 1 --2- 172.21.15.87:0/12087328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ede7d1730 0x560ede7e2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.334+0000 7f9cc8418740 1 --2- 172.21.15.87:0/12087328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ede7d0e10 0x560ede7ccd00 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.334+0000 7f9cc8418740 1 -- 172.21.15.87:0/12087328 >> 172.21.15.87:0/12087328 conn(0x560ede7cd380 msgr2=0x560ede7d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:05.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.334+0000 7f9cc8418740 1 -- 172.21.15.87:0/12087328 shutdown_connections 2024-09-13T17:23:05.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.334+0000 7f9cc8418740 1 -- 172.21.15.87:0/12087328 wait complete. 2024-09-13T17:23:05.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.335+0000 7f9cc8418740 1 -- start start 2024-09-13T17:23:05.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.335+0000 7f9cc8418740 1 Processor -- start 2024-09-13T17:23:05.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.335+0000 7f9cc8418740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ede7d0e10 0x560ede7e2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.335+0000 7f9cc8418740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ede7d1730 0x560ede7df090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.335+0000 7f9cc8418740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ede7dbfd0 0x560ede7df5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.335+0000 7f9cc8418740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ede7dfc80 con 0x560ede7d1730 2024-09-13T17:23:05.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.335+0000 7f9cc8418740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ede7dfdf0 con 0x560ede7d0e10 2024-09-13T17:23:05.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.335+0000 7f9cc8418740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ede841a40 con 0x560ede7dbfd0 2024-09-13T17:23:05.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.335+0000 7f9cc8418740 10 client.0 _ll_register_callbacks cb 0x7f9cb0009aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:23:05.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.335+0000 7f9cbe7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ede7d1730 0x560ede7df090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.335+0000 7f9cbe7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ede7d1730 0x560ede7df090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51958/0 (socket says 172.21.15.87:51958) 2024-09-13T17:23:05.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.335+0000 7f9cbe7fc640 1 -- 172.21.15.87:0/3987246647 learned_addr learned my addr 172.21.15.87:0/3987246647 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:05.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.335+0000 7f9cbeffd640 1 --2- 172.21.15.87:0/3987246647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ede7d0e10 0x560ede7e2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.335+0000 7f9cbe7fc640 1 -- 172.21.15.87:0/3987246647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ede7dbfd0 msgr2=0x560ede7df5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:05.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.335+0000 7f9cbe7fc640 1 --2- 172.21.15.87:0/3987246647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ede7dbfd0 0x560ede7df5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.335+0000 7f9cbe7fc640 1 -- 172.21.15.87:0/3987246647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ede7d0e10 msgr2=0x560ede7e2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:05.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.335+0000 7f9cbe7fc640 1 --2- 172.21.15.87:0/3987246647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ede7d0e10 0x560ede7e2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.335+0000 7f9cbe7fc640 1 -- 172.21.15.87:0/3987246647 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb0012450 con 0x560ede7d1730 2024-09-13T17:23:05.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.335+0000 7f9cbeffd640 1 --2- 172.21.15.87:0/3987246647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ede7d0e10 0x560ede7e2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:23:05.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.335+0000 7f9cbe7fc640 1 --2- 172.21.15.87:0/3987246647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ede7d1730 0x560ede7df090 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x560ede7ce1e0 tx=0x7f9cb4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf0924a1869ec91 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:05.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.335+0000 7f9ca2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:23:05.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.336+0000 7f9ca2ff5640 1 -- 172.21.15.87:0/3987246647 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb4004220 con 0x560ede7d1730 2024-09-13T17:23:05.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.336+0000 7f9ca2ff5640 1 -- 172.21.15.87:0/3987246647 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f9cb4004380 con 0x560ede7d1730 2024-09-13T17:23:05.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.336+0000 7f9cc8418740 1 -- 172.21.15.87:0/3987246647 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9cb80be4e0 con 0x560ede7d1730 2024-09-13T17:23:05.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.336+0000 7f9ca2ff5640 1 -- 172.21.15.87:0/3987246647 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9cb400f8c0 con 0x560ede7d1730 2024-09-13T17:23:05.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.336+0000 7f9cc8418740 10 client.17937 fetch_fsmap learned FSMap version 36 2024-09-13T17:23:05.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.336+0000 7f9cc8418740 1 -- 172.21.15.87:0/3987246647 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x560ede6faea0 con 0x560ede7d1730 2024-09-13T17:23:05.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.336+0000 7f9ca2ff5640 1 -- 172.21.15.87:0/3987246647 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9cb80be4e0 con 0x560ede7d1730 2024-09-13T17:23:05.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.336+0000 7f9ca2ff5640 1 -- 172.21.15.87:0/3987246647 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f9cb4003af0 con 0x560ede7d1730 2024-09-13T17:23:05.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.336+0000 7f9cc8418740 10 client.17937 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:23:05.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.336+0000 7f9cc8418740 10 client.17937 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:23:05.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.336+0000 7f9cc8418740 20 client.17937 populate_metadata read hostname 'smithi087' 2024-09-13T17:23:05.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.336+0000 7f9cc8418740 1 --2- 172.21.15.87:0/3987246647 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560ede843100 0x560ede845520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.336+0000 7f9cc8418740 4 client.17937 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:23:05.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.336+0000 7f9cc8418740 1 -- 172.21.15.87:0/3987246647 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560ede48ce30 con 0x560ede843100 2024-09-13T17:23:05.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.336+0000 7f9cbeffd640 1 --2- 172.21.15.87:0/3987246647 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560ede843100 0x560ede845520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.337+0000 7f9ca2ff5640 10 client.17937 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:23:05.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.337+0000 7f9cbeffd640 1 --2- 172.21.15.87:0/3987246647 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560ede843100 0x560ede845520 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72873e89501a2df8 server_cookie=c395aa5a1f72a520 in_seq=0 out_seq=0 2024-09-13T17:23:05.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.337+0000 7f9ca2ff5640 1 -- 172.21.15.87:0/3987246647 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x560ede48ce30 con 0x560ede843100 2024-09-13T17:23:05.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.337+0000 7f9ca2ff5640 10 client.17937 handle_command_reply: tid=0 2024-09-13T17:23:05.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.337+0000 7f9cc8418740 1 client.17937 shutdown 2024-09-13T17:23:05.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.337+0000 7f9cc8418740 1 -- 172.21.15.87:0/3987246647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ede7d1730 msgr2=0x560ede7df090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:05.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.337+0000 7f9cc8418740 1 --2- 172.21.15.87:0/3987246647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ede7d1730 0x560ede7df090 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x560ede7ce1e0 tx=0x7f9cb4004730 comp rx=0 tx=0).stop 2024-09-13T17:23:05.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.337+0000 7f9cc8418740 1 -- 172.21.15.87:0/3987246647 shutdown_connections 2024-09-13T17:23:05.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.337+0000 7f9cc8418740 1 --2- 172.21.15.87:0/3987246647 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x560ede843100 0x560ede845520 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.337+0000 7f9cc8418740 1 --2- 172.21.15.87:0/3987246647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560ede7dbfd0 0x560ede7df5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.337+0000 7f9cc8418740 1 --2- 172.21.15.87:0/3987246647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ede7d1730 0x560ede7df090 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.337+0000 7f9ca2ff5640 0 client.17937 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:23:05.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.337+0000 7f9cc8418740 1 --2- 172.21.15.87:0/3987246647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ede7d0e10 0x560ede7e2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.337+0000 7f9cc8418740 1 -- 172.21.15.87:0/3987246647 >> 172.21.15.87:0/3987246647 conn(0x560ede7cd380 msgr2=0x560ede7d7510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:05.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.337+0000 7f9cc8418740 1 -- 172.21.15.87:0/3987246647 shutdown_connections 2024-09-13T17:23:05.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.337+0000 7f9cc8418740 1 -- 172.21.15.87:0/3987246647 wait complete. 2024-09-13T17:23:05.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.337+0000 7f9cc8418740 20 client.17937 trim_cache size 0 max 16384 2024-09-13T17:23:05.345 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:23:05.345 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "no active scrubs running", 2024-09-13T17:23:05.345 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": {} 2024-09-13T17:23:05.345 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:23:05.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.338+0000 7f9cc5619640 1 -- 172.21.15.87:0/323230583 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f9ca80a1200 msgr2=0x7f9ca80a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:05.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.338+0000 7f9cc5619640 1 --2- 172.21.15.87:0/323230583 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f9ca80a1200 0x7f9ca80a36c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9cb40058c0 tx=0x7f9cb40137d0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.338+0000 7f9cc5619640 1 -- 172.21.15.87:0/323230583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cc019aba0 msgr2=0x7f9cc019b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:05.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.338+0000 7f9cc5619640 1 --2- 172.21.15.87:0/323230583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cc019aba0 0x7f9cc019b050 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f9cb80057c0 tx=0x7f9cb80042f0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.338+0000 7f9cc5619640 1 -- 172.21.15.87:0/323230583 shutdown_connections 2024-09-13T17:23:05.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.338+0000 7f9cc5619640 1 --2- 172.21.15.87:0/323230583 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f9ca80a1200 0x7f9ca80a36c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.338+0000 7f9cc5619640 1 --2- 172.21.15.87:0/323230583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cc019aba0 0x7f9cc019b050 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.338+0000 7f9cc5619640 1 --2- 172.21.15.87:0/323230583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cc0103fb0 0x7f9cc01967b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.338+0000 7f9cc5619640 1 --2- 172.21.15.87:0/323230583 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cc00fee60 0x7f9cc0196270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.338+0000 7f9cc5619640 1 -- 172.21.15.87:0/323230583 >> 172.21.15.87:0/323230583 conn(0x7f9cc0075c60 msgr2=0x7f9cc00fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:05.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.338+0000 7f9cc5619640 1 -- 172.21.15.87:0/323230583 shutdown_connections 2024-09-13T17:23:05.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.338+0000 7f9cc5619640 1 -- 172.21.15.87:0/323230583 wait complete. 2024-09-13T17:23:05.347 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:04 smithi149 ceph-mon[35496]: pgmap v286: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-13T17:23:05.349 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T17:23:05.350 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:23:05.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:04 smithi118 ceph-mon[34374]: pgmap v286: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-13T17:23:05.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.490+0000 7feee5901640 1 -- 172.21.15.87:0/56411306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feee00feaf0 msgr2=0x7feee00feed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:05.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.490+0000 7feee5901640 1 --2- 172.21.15.87:0/56411306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feee00feaf0 0x7feee00feed0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7feed0009930 tx=0x7feed002a420 comp rx=0 tx=0).stop 2024-09-13T17:23:05.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.490+0000 7feee5901640 1 -- 172.21.15.87:0/56411306 shutdown_connections 2024-09-13T17:23:05.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.490+0000 7feee5901640 1 --2- 172.21.15.87:0/56411306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feee0106340 0x7feee010cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.490+0000 7feee5901640 1 --2- 172.21.15.87:0/56411306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feee00ff4a0 0x7feee0105be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.490+0000 7feee5901640 1 --2- 172.21.15.87:0/56411306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feee00feaf0 0x7feee00feed0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.490+0000 7feee5901640 1 -- 172.21.15.87:0/56411306 >> 172.21.15.87:0/56411306 conn(0x7feee00741b0 msgr2=0x7feee00745c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:05.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.490+0000 7feee5901640 1 -- 172.21.15.87:0/56411306 shutdown_connections 2024-09-13T17:23:05.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.490+0000 7feee5901640 1 -- 172.21.15.87:0/56411306 wait complete. 2024-09-13T17:23:05.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.491+0000 7feee5901640 1 Processor -- start 2024-09-13T17:23:05.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.491+0000 7feee5901640 1 -- start start 2024-09-13T17:23:05.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.491+0000 7feee5901640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feee00feaf0 0x7feee0196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.491+0000 7feee5901640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feee0106340 0x7feee0196790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.491+0000 7feee5901640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feee019ab80 0x7feee019b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.491+0000 7feee5901640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee019b570 con 0x7feee0106340 2024-09-13T17:23:05.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.491+0000 7feee5901640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee019b6e0 con 0x7feee019ab80 2024-09-13T17:23:05.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.491+0000 7feee5901640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee019b850 con 0x7feee00feaf0 2024-09-13T17:23:05.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.491+0000 7feede7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feee0106340 0x7feee0196790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.491+0000 7feede7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feee0106340 0x7feee0196790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51978/0 (socket says 172.21.15.87:51978) 2024-09-13T17:23:05.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.491+0000 7feede7fc640 1 -- 172.21.15.87:0/1147533591 learned_addr learned my addr 172.21.15.87:0/1147533591 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:05.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.491+0000 7feedeffd640 1 --2- 172.21.15.87:0/1147533591 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feee00feaf0 0x7feee0196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.491+0000 7feedf7fe640 1 --2- 172.21.15.87:0/1147533591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feee019ab80 0x7feee019b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.491+0000 7feede7fc640 1 -- 172.21.15.87:0/1147533591 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feee00feaf0 msgr2=0x7feee0196250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:05.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.491+0000 7feede7fc640 1 --2- 172.21.15.87:0/1147533591 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feee00feaf0 0x7feee0196250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.491+0000 7feede7fc640 1 -- 172.21.15.87:0/1147533591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feee019ab80 msgr2=0x7feee019b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:05.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.491+0000 7feede7fc640 1 --2- 172.21.15.87:0/1147533591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feee019ab80 0x7feee019b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.491+0000 7feede7fc640 1 -- 172.21.15.87:0/1147533591 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed0009560 con 0x7feee0106340 2024-09-13T17:23:05.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.491+0000 7feedf7fe640 1 --2- 172.21.15.87:0/1147533591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feee019ab80 0x7feee019b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:23:05.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.492+0000 7feede7fc640 1 --2- 172.21.15.87:0/1147533591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feee0106340 0x7feee0196790 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7feed400d770 tx=0x7feed400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:05.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.492+0000 7feee48ff640 1 -- 172.21.15.87:0/1147533591 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed4009c30 con 0x7feee0106340 2024-09-13T17:23:05.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.492+0000 7feee48ff640 1 -- 172.21.15.87:0/1147533591 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7feed400de80 con 0x7feee0106340 2024-09-13T17:23:05.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.492+0000 7feee5901640 1 -- 172.21.15.87:0/1147533591 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee01a2e30 con 0x7feee0106340 2024-09-13T17:23:05.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.492+0000 7feee48ff640 1 -- 172.21.15.87:0/1147533591 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed400f600 con 0x7feee0106340 2024-09-13T17:23:05.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.492+0000 7feee5901640 1 -- 172.21.15.87:0/1147533591 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee01a32b0 con 0x7feee0106340 2024-09-13T17:23:05.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.493+0000 7feee5901640 1 -- 172.21.15.87:0/1147533591 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee0067ff0 con 0x7feee0106340 2024-09-13T17:23:05.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.494+0000 7feee48ff640 1 -- 172.21.15.87:0/1147533591 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7feed4010460 con 0x7feee0106340 2024-09-13T17:23:05.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.494+0000 7feee48ff640 1 --2- 172.21.15.87:0/1147533591 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7feec80a1280 0x7feec80a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.495+0000 7feedeffd640 1 --2- 172.21.15.87:0/1147533591 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7feec80a1280 0x7feec80a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.495+0000 7feee48ff640 1 -- 172.21.15.87:0/1147533591 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7feed40ccf00 con 0x7feee0106340 2024-09-13T17:23:05.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.495+0000 7feedeffd640 1 --2- 172.21.15.87:0/1147533591 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7feec80a1280 0x7feec80a3740 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7feed002a940 tx=0x7feed0000bc0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:05.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.499+0000 7feee48ff640 1 -- 172.21.15.87:0/1147533591 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7feed4095f40 con 0x7feee0106340 2024-09-13T17:23:05.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.696+0000 7feee5901640 1 -- 172.21.15.87:0/1147533591 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feee00feed0 con 0x7feee0106340 2024-09-13T17:23:05.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.697+0000 7feee48ff640 1 -- 172.21.15.87:0/1147533591 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+10877 (secure 0 0 0) 0x7feed4017090 con 0x7feee0106340 2024-09-13T17:23:05.698 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:23:05.698 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/3674545180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":3674545180},{"type":"v1","addr":"172.21.15.87:6841","nonce":3674545180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:11:23.313609+0000","modified":"2024-09-13T17:19:40.570296+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24484,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6839/3052680456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3052680456},{"type":"v1","addr":"172.21.15.118:6839","nonce":3052680456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:23:05.698 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 36 2024-09-13T17:23:05.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.699+0000 7feee5901640 1 -- 172.21.15.87:0/1147533591 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7feec80a1280 msgr2=0x7feec80a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:05.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.699+0000 7feee5901640 1 --2- 172.21.15.87:0/1147533591 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7feec80a1280 0x7feec80a3740 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7feed002a940 tx=0x7feed0000bc0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.699+0000 7feee5901640 1 -- 172.21.15.87:0/1147533591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feee0106340 msgr2=0x7feee0196790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:05.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.699+0000 7feee5901640 1 --2- 172.21.15.87:0/1147533591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feee0106340 0x7feee0196790 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7feed400d770 tx=0x7feed400dc30 comp rx=0 tx=0).stop 2024-09-13T17:23:05.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.699+0000 7feee5901640 1 -- 172.21.15.87:0/1147533591 shutdown_connections 2024-09-13T17:23:05.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.699+0000 7feee5901640 1 --2- 172.21.15.87:0/1147533591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feee019ab80 0x7feee019b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.699+0000 7feee5901640 1 --2- 172.21.15.87:0/1147533591 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7feec80a1280 0x7feec80a3740 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.699+0000 7feee5901640 1 --2- 172.21.15.87:0/1147533591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feee0106340 0x7feee0196790 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.699+0000 7feee5901640 1 --2- 172.21.15.87:0/1147533591 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feee00feaf0 0x7feee0196250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.699+0000 7feee5901640 1 -- 172.21.15.87:0/1147533591 >> 172.21.15.87:0/1147533591 conn(0x7feee00741b0 msgr2=0x7feee0103d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:05.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.699+0000 7feee5901640 1 -- 172.21.15.87:0/1147533591 shutdown_connections 2024-09-13T17:23:05.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.699+0000 7feee5901640 1 -- 172.21.15.87:0/1147533591 wait complete. 2024-09-13T17:23:05.711 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-09-13T17:23:05.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.810+0000 7f4b47545640 1 -- 172.21.15.87:0/1823265743 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b400fe8f0 msgr2=0x7f4b400fed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:05.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.810+0000 7f4b47545640 1 --2- 172.21.15.87:0/1823265743 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b400fe8f0 0x7f4b400fed50 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f4b30009900 tx=0x7f4b3002a480 comp rx=0 tx=0).stop 2024-09-13T17:23:05.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.810+0000 7f4b47545640 1 -- 172.21.15.87:0/1823265743 shutdown_connections 2024-09-13T17:23:05.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.810+0000 7f4b47545640 1 --2- 172.21.15.87:0/1823265743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b400ff290 0x7f4b4010b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.810+0000 7f4b47545640 1 --2- 172.21.15.87:0/1823265743 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b400fe8f0 0x7f4b400fed50 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.810+0000 7f4b47545640 1 --2- 172.21.15.87:0/1823265743 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b401023d0 0x7f4b401027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.810+0000 7f4b47545640 1 -- 172.21.15.87:0/1823265743 >> 172.21.15.87:0/1823265743 conn(0x7f4b400741b0 msgr2=0x7f4b400745c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:05.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.810+0000 7f4b47545640 1 -- 172.21.15.87:0/1823265743 shutdown_connections 2024-09-13T17:23:05.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.810+0000 7f4b47545640 1 -- 172.21.15.87:0/1823265743 wait complete. 2024-09-13T17:23:05.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.811+0000 7f4b47545640 1 Processor -- start 2024-09-13T17:23:05.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.811+0000 7f4b47545640 1 -- start start 2024-09-13T17:23:05.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.811+0000 7f4b47545640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b400fe8f0 0x7f4b401962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.811+0000 7f4b47545640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b400ff290 0x7f4b401967e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.811+0000 7f4b47545640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b401023d0 0x7f4b4019abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.811+0000 7f4b47545640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4019b1d0 con 0x7f4b401023d0 2024-09-13T17:23:05.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.811+0000 7f4b47545640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4019b340 con 0x7f4b400fe8f0 2024-09-13T17:23:05.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.811+0000 7f4b47545640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4019b500 con 0x7f4b400ff290 2024-09-13T17:23:05.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.811+0000 7f4b45ae2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b401023d0 0x7f4b4019abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.811+0000 7f4b45ae2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b401023d0 0x7f4b4019abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51998/0 (socket says 172.21.15.87:51998) 2024-09-13T17:23:05.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.811+0000 7f4b45ae2640 1 -- 172.21.15.87:0/829430664 learned_addr learned my addr 172.21.15.87:0/829430664 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:05.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.811+0000 7f4b452e1640 1 --2- 172.21.15.87:0/829430664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b400fe8f0 0x7f4b401962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.811+0000 7f4b44ae0640 1 --2- 172.21.15.87:0/829430664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b400ff290 0x7f4b401967e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.811+0000 7f4b45ae2640 1 -- 172.21.15.87:0/829430664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b400ff290 msgr2=0x7f4b401967e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:05.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.811+0000 7f4b45ae2640 1 --2- 172.21.15.87:0/829430664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b400ff290 0x7f4b401967e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.811+0000 7f4b45ae2640 1 -- 172.21.15.87:0/829430664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b400fe8f0 msgr2=0x7f4b401962a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:05.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.811+0000 7f4b45ae2640 1 --2- 172.21.15.87:0/829430664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b400fe8f0 0x7f4b401962a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.811+0000 7f4b45ae2640 1 -- 172.21.15.87:0/829430664 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b30009560 con 0x7f4b401023d0 2024-09-13T17:23:05.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.811+0000 7f4b44ae0640 1 --2- 172.21.15.87:0/829430664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b400ff290 0x7f4b401967e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:23:05.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.811+0000 7f4b45ae2640 1 --2- 172.21.15.87:0/829430664 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b401023d0 0x7f4b4019abd0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f4b3800cce0 tx=0x7f4b3800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:05.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.812+0000 7f4b367fc640 1 -- 172.21.15.87:0/829430664 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3800f450 con 0x7f4b401023d0 2024-09-13T17:23:05.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.812+0000 7f4b367fc640 1 -- 172.21.15.87:0/829430664 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4b3800fa60 con 0x7f4b401023d0 2024-09-13T17:23:05.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.812+0000 7f4b47545640 1 -- 172.21.15.87:0/829430664 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b4019b7e0 con 0x7f4b401023d0 2024-09-13T17:23:05.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.812+0000 7f4b367fc640 1 -- 172.21.15.87:0/829430664 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b38018b10 con 0x7f4b401023d0 2024-09-13T17:23:05.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.812+0000 7f4b47545640 1 -- 172.21.15.87:0/829430664 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b401a3060 con 0x7f4b401023d0 2024-09-13T17:23:05.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.814+0000 7f4b367fc640 1 -- 172.21.15.87:0/829430664 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f4b3800fbd0 con 0x7f4b401023d0 2024-09-13T17:23:05.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.814+0000 7f4b4a268740 1 Processor -- start 2024-09-13T17:23:05.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.814+0000 7f4b4a268740 1 -- start start 2024-09-13T17:23:05.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.814+0000 7f4b4a268740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb16ead790 0x55cb16eadb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.814+0000 7f4b4a268740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb16eae0b0 0x55cb16eb8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.814+0000 7f4b4a268740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb16eb8950 0x55cb16ebad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.815+0000 7f4b4a268740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb16e17cc0 con 0x55cb16eb8950 2024-09-13T17:23:05.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.815+0000 7f4b4a268740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb16e15450 con 0x55cb16eae0b0 2024-09-13T17:23:05.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.815+0000 7f4b4a268740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb16e10d40 con 0x55cb16ead790 2024-09-13T17:23:05.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.815+0000 7f4b44ae0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb16eb8950 0x55cb16ebad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.815+0000 7f4b44ae0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb16eb8950 0x55cb16ebad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52010/0 (socket says 172.21.15.87:52010) 2024-09-13T17:23:05.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.815+0000 7f4b44ae0640 1 -- 172.21.15.87:0/3895496363 learned_addr learned my addr 172.21.15.87:0/3895496363 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:05.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.815+0000 7f4b44ae0640 1 --2- 172.21.15.87:0/3895496363 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb16ead790 0x55cb16eadb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.815+0000 7f4b452e1640 1 --2- 172.21.15.87:0/3895496363 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb16eae0b0 0x55cb16eb8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.815+0000 7f4b367fc640 1 --2- 172.21.15.87:0/829430664 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4b2c0a1280 0x7f4b2c0a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.815+0000 7f4b44ae0640 1 -- 172.21.15.87:0/3895496363 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb16ead790 msgr2=0x55cb16eadb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:05.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.815+0000 7f4b44ae0640 1 --2- 172.21.15.87:0/3895496363 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb16ead790 0x55cb16eadb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.815+0000 7f4b44ae0640 1 -- 172.21.15.87:0/3895496363 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb16eae0b0 msgr2=0x55cb16eb8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:05.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.815+0000 7f4b44ae0640 1 --2- 172.21.15.87:0/3895496363 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb16eae0b0 0x55cb16eb8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.815+0000 7f4b44ae0640 1 -- 172.21.15.87:0/3895496363 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb16dd8620 con 0x55cb16eb8950 2024-09-13T17:23:05.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.815+0000 7f4b45ae2640 1 --2- 172.21.15.87:0/829430664 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4b2c0a1280 0x7f4b2c0a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.815+0000 7f4b367fc640 1 -- 172.21.15.87:0/829430664 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f4b380cd5b0 con 0x7f4b401023d0 2024-09-13T17:23:05.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.815+0000 7f4b44ae0640 1 --2- 172.21.15.87:0/3895496363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb16eb8950 0x55cb16ebad40 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f4b30033000 tx=0x7f4b30000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42921026fc7deb28 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:05.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.815+0000 7f4b2b7fe640 1 -- 172.21.15.87:0/3895496363 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b30004030 con 0x55cb16eb8950 2024-09-13T17:23:05.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.815+0000 7f4b2b7fe640 1 -- 172.21.15.87:0/3895496363 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4b30044030 con 0x55cb16eb8950 2024-09-13T17:23:05.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.815+0000 7f4b2b7fe640 1 -- 172.21.15.87:0/3895496363 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b30004920 con 0x55cb16eb8950 2024-09-13T17:23:05.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.816+0000 7f4b4a268740 1 -- 172.21.15.87:0/3895496363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb16eb8950 msgr2=0x55cb16ebad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:05.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.816+0000 7f4b45ae2640 1 --2- 172.21.15.87:0/829430664 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4b2c0a1280 0x7f4b2c0a3740 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4b38096750 tx=0x7f4b3800af30 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:05.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.816+0000 7f4b4a268740 1 --2- 172.21.15.87:0/3895496363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb16eb8950 0x55cb16ebad40 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f4b30033000 tx=0x7f4b30000bc0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.816+0000 7f4b4a268740 1 -- 172.21.15.87:0/3895496363 shutdown_connections 2024-09-13T17:23:05.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.816+0000 7f4b4a268740 1 --2- 172.21.15.87:0/3895496363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb16eb8950 0x55cb16ebad40 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.816+0000 7f4b4a268740 1 --2- 172.21.15.87:0/3895496363 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb16eae0b0 0x55cb16eb8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.816+0000 7f4b4a268740 1 --2- 172.21.15.87:0/3895496363 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb16ead790 0x55cb16eadb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.816+0000 7f4b4a268740 1 -- 172.21.15.87:0/3895496363 >> 172.21.15.87:0/3895496363 conn(0x55cb16ea9d00 msgr2=0x55cb16eaa0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:05.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.816+0000 7f4b4a268740 1 -- 172.21.15.87:0/3895496363 shutdown_connections 2024-09-13T17:23:05.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.816+0000 7f4b4a268740 1 -- 172.21.15.87:0/3895496363 wait complete. 2024-09-13T17:23:05.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.816+0000 7f4b4a268740 1 -- start start 2024-09-13T17:23:05.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.816+0000 7f4b4a268740 1 Processor -- start 2024-09-13T17:23:05.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.817+0000 7f4b4a268740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb16ead790 0x55cb16eb7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.817+0000 7f4b4a268740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb16eae0b0 0x55cb16eb5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.817+0000 7f4b4a268740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb16eb8950 0x55cb16eb5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.817+0000 7f4b4a268740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb16dcf180 con 0x55cb16eb8950 2024-09-13T17:23:05.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.817+0000 7f4b4a268740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb16ae9430 con 0x55cb16ead790 2024-09-13T17:23:05.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.817+0000 7f4b4a268740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb16d945e0 con 0x55cb16eae0b0 2024-09-13T17:23:05.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.817+0000 7f4b4a268740 10 client.0 _ll_register_callbacks cb 0x55cb16e00aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:23:05.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.817+0000 7f4b44ae0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb16eb8950 0x55cb16eb5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.817+0000 7f4b44ae0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb16eb8950 0x55cb16eb5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52024/0 (socket says 172.21.15.87:52024) 2024-09-13T17:23:05.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.817+0000 7f4b44ae0640 1 -- 172.21.15.87:0/3117660562 learned_addr learned my addr 172.21.15.87:0/3117660562 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:05.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.817+0000 7f4b44ae0640 1 -- 172.21.15.87:0/3117660562 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb16eae0b0 msgr2=0x55cb16eb5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:05.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.817+0000 7f4b44ae0640 1 --2- 172.21.15.87:0/3117660562 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb16eae0b0 0x55cb16eb5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.817+0000 7f4b44ae0640 1 -- 172.21.15.87:0/3117660562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb16ead790 msgr2=0x55cb16eb7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:05.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.817+0000 7f4b44ae0640 1 --2- 172.21.15.87:0/3117660562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb16ead790 0x55cb16eb7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.817+0000 7f4b44ae0640 1 -- 172.21.15.87:0/3117660562 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b40067d20 con 0x55cb16eb8950 2024-09-13T17:23:05.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.817+0000 7f4b44ae0640 1 --2- 172.21.15.87:0/3117660562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb16eb8950 0x55cb16eb5870 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f4b3002a9a0 tx=0x7f4b30032b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f690e3036a201ed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:05.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.817+0000 7f4b28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:23:05.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.818+0000 7f4b28ff9640 1 -- 172.21.15.87:0/3117660562 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b30004220 con 0x55cb16eb8950 2024-09-13T17:23:05.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.818+0000 7f4b28ff9640 1 -- 172.21.15.87:0/3117660562 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f4b30000e40 con 0x55cb16eb8950 2024-09-13T17:23:05.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.818+0000 7f4b4a268740 1 -- 172.21.15.87:0/3117660562 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cb16e3ab80 con 0x55cb16eb8950 2024-09-13T17:23:05.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.818+0000 7f4b28ff9640 1 -- 172.21.15.87:0/3117660562 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b30004380 con 0x55cb16eb8950 2024-09-13T17:23:05.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.818+0000 7f4b4a268740 10 client.17955 fetch_fsmap learned FSMap version 36 2024-09-13T17:23:05.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.818+0000 7f4b4a268740 1 -- 172.21.15.87:0/3117660562 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55cb16e0f3c0 con 0x55cb16eb8950 2024-09-13T17:23:05.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.818+0000 7f4b28ff9640 1 -- 172.21.15.87:0/3117660562 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55cb16e3ab80 con 0x55cb16eb8950 2024-09-13T17:23:05.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.818+0000 7f4b28ff9640 1 -- 172.21.15.87:0/3117660562 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f4b3004b5b0 con 0x55cb16eb8950 2024-09-13T17:23:05.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.818+0000 7f4b4a268740 10 client.17955 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:23:05.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.818+0000 7f4b4a268740 10 client.17955 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:23:05.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.818+0000 7f4b4a268740 20 client.17955 populate_metadata read hostname 'smithi087' 2024-09-13T17:23:05.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.818+0000 7f4b4a268740 1 --2- 172.21.15.87:0/3117660562 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55cb16ec7f50 0x55cb16eca340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.818+0000 7f4b4a268740 4 client.17955 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:23:05.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.818+0000 7f4b4a268740 1 -- 172.21.15.87:0/3117660562 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cb16e031f0 con 0x55cb16ec7f50 2024-09-13T17:23:05.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.819+0000 7f4b452e1640 1 --2- 172.21.15.87:0/3117660562 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55cb16ec7f50 0x55cb16eca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.819+0000 7f4b452e1640 1 --2- 172.21.15.87:0/3117660562 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55cb16ec7f50 0x55cb16eca340 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2d9a1cd90b5013cd server_cookie=c49c7095e2d865e0 in_seq=0 out_seq=0 2024-09-13T17:23:05.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.819+0000 7f4b28ff9640 10 client.17955 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:23:05.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.819+0000 7f4b28ff9640 1 -- 172.21.15.87:0/3117660562 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55cb16e031f0 con 0x55cb16ec7f50 2024-09-13T17:23:05.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.819+0000 7f4b28ff9640 10 client.17955 handle_command_reply: tid=0 2024-09-13T17:23:05.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.819+0000 7f4b4a268740 1 client.17955 shutdown 2024-09-13T17:23:05.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.820+0000 7f4b4a268740 1 -- 172.21.15.87:0/3117660562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb16eb8950 msgr2=0x55cb16eb5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:05.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.820+0000 7f4b4a268740 1 --2- 172.21.15.87:0/3117660562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb16eb8950 0x55cb16eb5870 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f4b3002a9a0 tx=0x7f4b30032b20 comp rx=0 tx=0).stop 2024-09-13T17:23:05.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.820+0000 7f4b4a268740 1 -- 172.21.15.87:0/3117660562 shutdown_connections 2024-09-13T17:23:05.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.820+0000 7f4b4a268740 1 --2- 172.21.15.87:0/3117660562 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55cb16ec7f50 0x55cb16eca340 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.820+0000 7f4b4a268740 1 --2- 172.21.15.87:0/3117660562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb16eb8950 0x55cb16eb5870 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.820+0000 7f4b28ff9640 0 client.17955 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:23:05.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.820+0000 7f4b4a268740 1 --2- 172.21.15.87:0/3117660562 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb16eae0b0 0x55cb16eb5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.820+0000 7f4b4a268740 1 --2- 172.21.15.87:0/3117660562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb16ead790 0x55cb16eb7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.820+0000 7f4b4a268740 1 -- 172.21.15.87:0/3117660562 >> 172.21.15.87:0/3117660562 conn(0x55cb16ea9d00 msgr2=0x55cb16eafa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:05.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.820+0000 7f4b4a268740 1 -- 172.21.15.87:0/3117660562 shutdown_connections 2024-09-13T17:23:05.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.820+0000 7f4b4a268740 1 -- 172.21.15.87:0/3117660562 wait complete. 2024-09-13T17:23:05.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.820+0000 7f4b4a268740 20 client.17955 trim_cache size 0 max 16384 2024-09-13T17:23:05.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.831+0000 7f4b4a268740 1 Processor -- start 2024-09-13T17:23:05.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.831+0000 7f4b4a268740 1 -- start start 2024-09-13T17:23:05.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.831+0000 7f4b4a268740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb16ead790 0x55cb16eb52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.831+0000 7f4b4a268740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb16eae0b0 0x55cb16eb5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.831+0000 7f4b4a268740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb16eb8950 0x55cb16eb3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.831+0000 7f4b4a268740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb16eb8530 con 0x55cb16eae0b0 2024-09-13T17:23:05.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.831+0000 7f4b4a268740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb16eb82c0 con 0x55cb16ead790 2024-09-13T17:23:05.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.831+0000 7f4b4a268740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb16eb3860 con 0x55cb16eb8950 2024-09-13T17:23:05.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.831+0000 7f4b452e1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb16eae0b0 0x55cb16eb5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.831+0000 7f4b452e1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb16eae0b0 0x55cb16eb5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52034/0 (socket says 172.21.15.87:52034) 2024-09-13T17:23:05.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.831+0000 7f4b452e1640 1 -- 172.21.15.87:0/2385163990 learned_addr learned my addr 172.21.15.87:0/2385163990 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:05.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.831+0000 7f4b452e1640 1 -- 172.21.15.87:0/2385163990 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb16eb8950 msgr2=0x55cb16eb3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:05.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.831+0000 7f4b452e1640 1 --2- 172.21.15.87:0/2385163990 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb16eb8950 0x55cb16eb3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.831+0000 7f4b452e1640 1 -- 172.21.15.87:0/2385163990 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb16ead790 msgr2=0x55cb16eb52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:05.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.831+0000 7f4b452e1640 1 --2- 172.21.15.87:0/2385163990 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb16ead790 0x55cb16eb52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.831+0000 7f4b452e1640 1 -- 172.21.15.87:0/2385163990 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb16db1770 con 0x55cb16eae0b0 2024-09-13T17:23:05.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.831+0000 7f4b452e1640 1 --2- 172.21.15.87:0/2385163990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb16eae0b0 0x55cb16eb5830 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x55cb16eaab60 tx=0x7f4b3c00c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1055c7989f9942 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:05.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.831+0000 7f4b2bfff640 1 -- 172.21.15.87:0/2385163990 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c016050 con 0x55cb16eae0b0 2024-09-13T17:23:05.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.831+0000 7f4b2bfff640 1 -- 172.21.15.87:0/2385163990 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4b3c017040 con 0x55cb16eae0b0 2024-09-13T17:23:05.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.831+0000 7f4b2bfff640 1 -- 172.21.15.87:0/2385163990 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c018640 con 0x55cb16eae0b0 2024-09-13T17:23:05.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.832+0000 7f4b4a268740 1 -- 172.21.15.87:0/2385163990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb16eae0b0 msgr2=0x55cb16eb5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:05.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.832+0000 7f4b4a268740 1 --2- 172.21.15.87:0/2385163990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb16eae0b0 0x55cb16eb5830 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x55cb16eaab60 tx=0x7f4b3c00c780 comp rx=0 tx=0).stop 2024-09-13T17:23:05.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.832+0000 7f4b4a268740 1 -- 172.21.15.87:0/2385163990 shutdown_connections 2024-09-13T17:23:05.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.832+0000 7f4b4a268740 1 --2- 172.21.15.87:0/2385163990 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb16eb8950 0x55cb16eb3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.832+0000 7f4b4a268740 1 --2- 172.21.15.87:0/2385163990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb16eae0b0 0x55cb16eb5830 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.832+0000 7f4b4a268740 1 --2- 172.21.15.87:0/2385163990 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb16ead790 0x55cb16eb52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.832+0000 7f4b4a268740 1 -- 172.21.15.87:0/2385163990 >> 172.21.15.87:0/2385163990 conn(0x55cb16ea9d00 msgr2=0x55cb16ececc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:05.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.832+0000 7f4b4a268740 1 -- 172.21.15.87:0/2385163990 shutdown_connections 2024-09-13T17:23:05.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.832+0000 7f4b4a268740 1 -- 172.21.15.87:0/2385163990 wait complete. 2024-09-13T17:23:05.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.832+0000 7f4b4a268740 1 -- start start 2024-09-13T17:23:05.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.832+0000 7f4b4a268740 1 Processor -- start 2024-09-13T17:23:05.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.833+0000 7f4b4a268740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb16ead790 0x55cb16ebc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.833+0000 7f4b4a268740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb16eae0b0 0x55cb16ebc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.833+0000 7f4b4a268740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb16eb8950 0x55cb16ebcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.833+0000 7f4b4a268740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb16f26d20 con 0x55cb16eae0b0 2024-09-13T17:23:05.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.833+0000 7f4b4a268740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb16f26e90 con 0x55cb16eb8950 2024-09-13T17:23:05.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.833+0000 7f4b4a268740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb16f27050 con 0x55cb16ead790 2024-09-13T17:23:05.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.833+0000 7f4b4a268740 10 client.0 _ll_register_callbacks cb 0x7f4b30009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:23:05.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.833+0000 7f4b452e1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb16eae0b0 0x55cb16ebc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.833+0000 7f4b452e1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb16eae0b0 0x55cb16ebc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52042/0 (socket says 172.21.15.87:52042) 2024-09-13T17:23:05.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.833+0000 7f4b452e1640 1 -- 172.21.15.87:0/1327808643 learned_addr learned my addr 172.21.15.87:0/1327808643 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:05.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.833+0000 7f4b44ae0640 1 --2- 172.21.15.87:0/1327808643 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb16eb8950 0x55cb16ebcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.833+0000 7f4b452e1640 1 -- 172.21.15.87:0/1327808643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb16ead790 msgr2=0x55cb16ebc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:05.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.833+0000 7f4b452e1640 1 --2- 172.21.15.87:0/1327808643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb16ead790 0x55cb16ebc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.833+0000 7f4b452e1640 1 -- 172.21.15.87:0/1327808643 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb16eb8950 msgr2=0x55cb16ebcdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:05.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.833+0000 7f4b452e1640 1 --2- 172.21.15.87:0/1327808643 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb16eb8950 0x55cb16ebcdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.833+0000 7f4b452e1640 1 -- 172.21.15.87:0/1327808643 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b3c00c910 con 0x55cb16eae0b0 2024-09-13T17:23:05.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.833+0000 7f4b44ae0640 1 --2- 172.21.15.87:0/1327808643 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb16eb8950 0x55cb16ebcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:23:05.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.833+0000 7f4b452e1640 1 --2- 172.21.15.87:0/1327808643 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb16eae0b0 0x55cb16ebc890 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c018260 tx=0x7f4b3c00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88366608b5f22f38 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:05.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.833+0000 7f4b28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:23:05.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.833+0000 7f4b28ff9640 1 -- 172.21.15.87:0/1327808643 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c025070 con 0x55cb16eae0b0 2024-09-13T17:23:05.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.833+0000 7f4b28ff9640 1 -- 172.21.15.87:0/1327808643 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f4b3c004330 con 0x55cb16eae0b0 2024-09-13T17:23:05.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.833+0000 7f4b4a268740 1 -- 172.21.15.87:0/1327808643 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4b30044030 con 0x55cb16eae0b0 2024-09-13T17:23:05.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.834+0000 7f4b28ff9640 1 -- 172.21.15.87:0/1327808643 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b3c016030 con 0x55cb16eae0b0 2024-09-13T17:23:05.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.834+0000 7f4b4a268740 10 client.17961 fetch_fsmap learned FSMap version 36 2024-09-13T17:23:05.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.834+0000 7f4b4a268740 1 -- 172.21.15.87:0/1327808643 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55cb16dd6e80 con 0x55cb16eae0b0 2024-09-13T17:23:05.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.834+0000 7f4b28ff9640 1 -- 172.21.15.87:0/1327808643 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4b3c033080 con 0x55cb16eae0b0 2024-09-13T17:23:05.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.834+0000 7f4b28ff9640 1 -- 172.21.15.87:0/1327808643 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f4b3c004b50 con 0x55cb16eae0b0 2024-09-13T17:23:05.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.834+0000 7f4b4a268740 10 client.17961 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:23:05.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.834+0000 7f4b4a268740 10 client.17961 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:23:05.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.834+0000 7f4b4a268740 20 client.17961 populate_metadata read hostname 'smithi087' 2024-09-13T17:23:05.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.834+0000 7f4b4a268740 1 --2- 172.21.15.87:0/1327808643 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55cb16f28780 0x55cb16f2aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.834+0000 7f4b4a268740 4 client.17961 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:23:05.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.834+0000 7f4b4a268740 1 -- 172.21.15.87:0/1327808643 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55cb16b044e0 con 0x55cb16f28780 2024-09-13T17:23:05.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.834+0000 7f4b44ae0640 1 --2- 172.21.15.87:0/1327808643 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55cb16f28780 0x55cb16f2aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.835+0000 7f4b28ff9640 10 client.17961 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:23:05.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.835+0000 7f4b44ae0640 1 --2- 172.21.15.87:0/1327808643 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55cb16f28780 0x55cb16f2aba0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=47555e73ce03b7a7 server_cookie=c744368d81a58a4a in_seq=0 out_seq=0 2024-09-13T17:23:05.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.835+0000 7f4b28ff9640 1 -- 172.21.15.87:0/1327808643 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55cb16b044e0 con 0x55cb16f28780 2024-09-13T17:23:05.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.835+0000 7f4b28ff9640 10 client.17961 handle_command_reply: tid=0 2024-09-13T17:23:05.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.835+0000 7f4b4a268740 1 client.17961 shutdown 2024-09-13T17:23:05.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.835+0000 7f4b4a268740 1 -- 172.21.15.87:0/1327808643 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb16eae0b0 msgr2=0x55cb16ebc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:05.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.835+0000 7f4b4a268740 1 --2- 172.21.15.87:0/1327808643 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb16eae0b0 0x55cb16ebc890 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c018260 tx=0x7f4b3c00cf40 comp rx=0 tx=0).stop 2024-09-13T17:23:05.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.835+0000 7f4b4a268740 1 -- 172.21.15.87:0/1327808643 shutdown_connections 2024-09-13T17:23:05.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.835+0000 7f4b4a268740 1 --2- 172.21.15.87:0/1327808643 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55cb16f28780 0x55cb16f2aba0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.835+0000 7f4b4a268740 1 --2- 172.21.15.87:0/1327808643 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cb16eb8950 0x55cb16ebcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.835+0000 7f4b4a268740 1 --2- 172.21.15.87:0/1327808643 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb16eae0b0 0x55cb16ebc890 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.835+0000 7f4b28ff9640 0 client.17961 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:23:05.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.835+0000 7f4b4a268740 1 --2- 172.21.15.87:0/1327808643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cb16ead790 0x55cb16ebc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.835+0000 7f4b4a268740 1 -- 172.21.15.87:0/1327808643 >> 172.21.15.87:0/1327808643 conn(0x55cb16ea9d00 msgr2=0x55cb16eb52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:05.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.835+0000 7f4b4a268740 1 -- 172.21.15.87:0/1327808643 shutdown_connections 2024-09-13T17:23:05.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.835+0000 7f4b4a268740 1 -- 172.21.15.87:0/1327808643 wait complete. 2024-09-13T17:23:05.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.835+0000 7f4b4a268740 20 client.17961 trim_cache size 0 max 16384 2024-09-13T17:23:05.845 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:23:05.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.836+0000 7f4b47545640 1 -- 172.21.15.87:0/829430664 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4b2c0a1280 msgr2=0x7f4b2c0a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:05.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.836+0000 7f4b47545640 1 --2- 172.21.15.87:0/829430664 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4b2c0a1280 0x7f4b2c0a3740 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4b38096750 tx=0x7f4b3800af30 comp rx=0 tx=0).stop 2024-09-13T17:23:05.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.836+0000 7f4b47545640 1 -- 172.21.15.87:0/829430664 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b401023d0 msgr2=0x7f4b4019abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:05.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.836+0000 7f4b47545640 1 --2- 172.21.15.87:0/829430664 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b401023d0 0x7f4b4019abd0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f4b3800cce0 tx=0x7f4b3800a620 comp rx=0 tx=0).stop 2024-09-13T17:23:05.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.836+0000 7f4b47545640 1 -- 172.21.15.87:0/829430664 shutdown_connections 2024-09-13T17:23:05.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.836+0000 7f4b47545640 1 --2- 172.21.15.87:0/829430664 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4b2c0a1280 0x7f4b2c0a3740 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.836+0000 7f4b47545640 1 --2- 172.21.15.87:0/829430664 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b401023d0 0x7f4b4019abd0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.836+0000 7f4b47545640 1 --2- 172.21.15.87:0/829430664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b400ff290 0x7f4b401967e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.836+0000 7f4b47545640 1 --2- 172.21.15.87:0/829430664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b400fe8f0 0x7f4b401962a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.836+0000 7f4b47545640 1 -- 172.21.15.87:0/829430664 >> 172.21.15.87:0/829430664 conn(0x7f4b400741b0 msgr2=0x7f4b400fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:05.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.836+0000 7f4b47545640 1 -- 172.21.15.87:0/829430664 shutdown_connections 2024-09-13T17:23:05.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.836+0000 7f4b47545640 1 -- 172.21.15.87:0/829430664 wait complete. 2024-09-13T17:23:05.848 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-09-13T17:23:05.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.946+0000 7f03ced25640 1 -- 172.21.15.87:0/3560515737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03c80fe1b0 msgr2=0x7f03c80fe610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:05.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.946+0000 7f03ced25640 1 --2- 172.21.15.87:0/3560515737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03c80fe1b0 0x7f03c80fe610 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f03b8009900 tx=0x7f03b802a410 comp rx=0 tx=0).stop 2024-09-13T17:23:05.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.946+0000 7f03ced25640 1 -- 172.21.15.87:0/3560515737 shutdown_connections 2024-09-13T17:23:05.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.946+0000 7f03ced25640 1 --2- 172.21.15.87:0/3560515737 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03c80feb50 0x7f03c810cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.946+0000 7f03ced25640 1 --2- 172.21.15.87:0/3560515737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03c80fe1b0 0x7f03c80fe610 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.947+0000 7f03ced25640 1 --2- 172.21.15.87:0/3560515737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03c8105dd0 0x7f03c81061b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.947+0000 7f03ced25640 1 -- 172.21.15.87:0/3560515737 >> 172.21.15.87:0/3560515737 conn(0x7f03c8075380 msgr2=0x7f03c80fc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:05.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.947+0000 7f03ced25640 1 -- 172.21.15.87:0/3560515737 shutdown_connections 2024-09-13T17:23:05.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.947+0000 7f03ced25640 1 -- 172.21.15.87:0/3560515737 wait complete. 2024-09-13T17:23:05.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.947+0000 7f03ced25640 1 Processor -- start 2024-09-13T17:23:05.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.947+0000 7f03ced25640 1 -- start start 2024-09-13T17:23:05.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.947+0000 7f03ced25640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03c80fe1b0 0x7f03c81961e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.947+0000 7f03ced25640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03c80feb50 0x7f03c8196720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.947+0000 7f03ced25640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03c8105dd0 0x7f03c819ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.947+0000 7f03ced25640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c819b110 con 0x7f03c80fe1b0 2024-09-13T17:23:05.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.947+0000 7f03ced25640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c819b280 con 0x7f03c8105dd0 2024-09-13T17:23:05.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.947+0000 7f03ced25640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c819b440 con 0x7f03c80feb50 2024-09-13T17:23:05.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.947+0000 7f03ccac1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03c80fe1b0 0x7f03c81961e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.947+0000 7f03ccac1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03c80fe1b0 0x7f03c81961e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52056/0 (socket says 172.21.15.87:52056) 2024-09-13T17:23:05.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.947+0000 7f03ccac1640 1 -- 172.21.15.87:0/649165744 learned_addr learned my addr 172.21.15.87:0/649165744 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:05.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.948+0000 7f03cd2c2640 1 --2- 172.21.15.87:0/649165744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03c8105dd0 0x7f03c819ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.948+0000 7f03ccac1640 1 -- 172.21.15.87:0/649165744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03c80feb50 msgr2=0x7f03c8196720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:05.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.948+0000 7f03bffff640 1 --2- 172.21.15.87:0/649165744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03c80feb50 0x7f03c8196720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.948+0000 7f03ccac1640 1 --2- 172.21.15.87:0/649165744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03c80feb50 0x7f03c8196720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.948+0000 7f03ccac1640 1 -- 172.21.15.87:0/649165744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03c8105dd0 msgr2=0x7f03c819ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:05.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.948+0000 7f03ccac1640 1 --2- 172.21.15.87:0/649165744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03c8105dd0 0x7f03c819ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.948+0000 7f03ccac1640 1 -- 172.21.15.87:0/649165744 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b8009560 con 0x7f03c80fe1b0 2024-09-13T17:23:05.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.948+0000 7f03cd2c2640 1 --2- 172.21.15.87:0/649165744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03c8105dd0 0x7f03c819ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:23:05.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.948+0000 7f03bffff640 1 --2- 172.21.15.87:0/649165744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03c80feb50 0x7f03c8196720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:23:05.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.948+0000 7f03ccac1640 1 --2- 172.21.15.87:0/649165744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03c80fe1b0 0x7f03c81961e0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f03c400d770 tx=0x7f03c400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:05.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.948+0000 7f03bdffb640 1 -- 172.21.15.87:0/649165744 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c4009c30 con 0x7f03c80fe1b0 2024-09-13T17:23:05.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.948+0000 7f03bdffb640 1 -- 172.21.15.87:0/649165744 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f03c400de80 con 0x7f03c80fe1b0 2024-09-13T17:23:05.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.948+0000 7f03ced25640 1 -- 172.21.15.87:0/649165744 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c819b720 con 0x7f03c80fe1b0 2024-09-13T17:23:05.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.948+0000 7f03bdffb640 1 -- 172.21.15.87:0/649165744 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c4004e00 con 0x7f03c80fe1b0 2024-09-13T17:23:05.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.948+0000 7f03ced25640 1 -- 172.21.15.87:0/649165744 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c81a2fa0 con 0x7f03c80fe1b0 2024-09-13T17:23:05.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.950+0000 7f03bdffb640 1 -- 172.21.15.87:0/649165744 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f03c4004f60 con 0x7f03c80fe1b0 2024-09-13T17:23:05.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.951+0000 7f03d1a51740 1 Processor -- start 2024-09-13T17:23:05.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.951+0000 7f03d1a51740 1 -- start start 2024-09-13T17:23:05.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.951+0000 7f03d1a51740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5614be041670 0x5614be041a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.951+0000 7f03d1a51740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614be041f90 0x5614be050820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.951+0000 7f03d1a51740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5614be050d60 0x5614be053150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.951+0000 7f03d1a51740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614bdfabcc0 con 0x5614be041670 2024-09-13T17:23:05.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.951+0000 7f03d1a51740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614bdfa9450 con 0x5614be050d60 2024-09-13T17:23:05.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.951+0000 7f03d1a51740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614bdfa4d40 con 0x5614be041f90 2024-09-13T17:23:05.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.951+0000 7f03bdffb640 1 --2- 172.21.15.87:0/649165744 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f03b00a1200 0x7f03b00a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.951+0000 7f03cd2c2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5614be041670 0x5614be041a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.951+0000 7f03cd2c2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5614be041670 0x5614be041a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52062/0 (socket says 172.21.15.87:52062) 2024-09-13T17:23:05.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.951+0000 7f03cd2c2640 1 -- 172.21.15.87:0/3286051172 learned_addr learned my addr 172.21.15.87:0/3286051172 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:05.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.951+0000 7f03bffff640 1 --2- 172.21.15.87:0/3286051172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5614be050d60 0x5614be053150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.951+0000 7f03cd2c2640 1 --2- 172.21.15.87:0/649165744 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f03b00a1200 0x7f03b00a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.951+0000 7f03bdffb640 1 -- 172.21.15.87:0/649165744 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f03c40ccca0 con 0x7f03c80fe1b0 2024-09-13T17:23:05.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.951+0000 7f03ccac1640 1 --2- 172.21.15.87:0/3286051172 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614be041f90 0x5614be050820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.951+0000 7f03cd2c2640 1 -- 172.21.15.87:0/3286051172 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614be041f90 msgr2=0x5614be050820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:05.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.951+0000 7f03cd2c2640 1 --2- 172.21.15.87:0/3286051172 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614be041f90 0x5614be050820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.951+0000 7f03cd2c2640 1 -- 172.21.15.87:0/3286051172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5614be050d60 msgr2=0x5614be053150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:05.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.951+0000 7f03cd2c2640 1 --2- 172.21.15.87:0/3286051172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5614be050d60 0x5614be053150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.951+0000 7f03cd2c2640 1 -- 172.21.15.87:0/3286051172 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614bdf6c620 con 0x5614be041670 2024-09-13T17:23:05.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.951+0000 7f03bffff640 1 --2- 172.21.15.87:0/3286051172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5614be050d60 0x5614be053150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:23:05.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.952+0000 7f03cd2c2640 1 --2- 172.21.15.87:0/3286051172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5614be041670 0x5614be041a50 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f03c0013980 tx=0x7f03c0013e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5772df2f0f96892 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:05.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.952+0000 7f03aeffd640 1 -- 172.21.15.87:0/3286051172 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c0021070 con 0x5614be041670 2024-09-13T17:23:05.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.952+0000 7f03aeffd640 1 -- 172.21.15.87:0/3286051172 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f03c0019070 con 0x5614be041670 2024-09-13T17:23:05.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.952+0000 7f03aeffd640 1 -- 172.21.15.87:0/3286051172 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c001dc10 con 0x5614be041670 2024-09-13T17:23:05.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.952+0000 7f03cd2c2640 1 --2- 172.21.15.87:0/649165744 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f03b00a1200 0x7f03b00a36c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f03c0020000 tx=0x7f03c001f000 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:05.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.952+0000 7f03d1a51740 1 -- 172.21.15.87:0/3286051172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5614be041670 msgr2=0x5614be041a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:05.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.952+0000 7f03d1a51740 1 --2- 172.21.15.87:0/3286051172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5614be041670 0x5614be041a50 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f03c0013980 tx=0x7f03c0013e40 comp rx=0 tx=0).stop 2024-09-13T17:23:05.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.952+0000 7f03d1a51740 1 -- 172.21.15.87:0/3286051172 shutdown_connections 2024-09-13T17:23:05.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.952+0000 7f03d1a51740 1 --2- 172.21.15.87:0/3286051172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5614be050d60 0x5614be053150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.952+0000 7f03d1a51740 1 --2- 172.21.15.87:0/3286051172 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614be041f90 0x5614be050820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.952+0000 7f03d1a51740 1 --2- 172.21.15.87:0/3286051172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5614be041670 0x5614be041a50 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.953+0000 7f03d1a51740 1 -- 172.21.15.87:0/3286051172 >> 172.21.15.87:0/3286051172 conn(0x5614be03dd00 msgr2=0x5614be03e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:05.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.953+0000 7f03d1a51740 1 -- 172.21.15.87:0/3286051172 shutdown_connections 2024-09-13T17:23:05.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.953+0000 7f03d1a51740 1 -- 172.21.15.87:0/3286051172 wait complete. 2024-09-13T17:23:05.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.953+0000 7f03d1a51740 1 -- start start 2024-09-13T17:23:05.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.953+0000 7f03d1a51740 1 Processor -- start 2024-09-13T17:23:05.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.953+0000 7f03d1a51740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5614be041670 0x5614be0503b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.953+0000 7f03d1a51740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5614be041f90 0x5614be04d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.953+0000 7f03d1a51740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614be050d60 0x5614be04dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.953+0000 7f03d1a51740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614bdf63180 con 0x5614be041670 2024-09-13T17:23:05.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.953+0000 7f03d1a51740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614bdc7d430 con 0x5614be041f90 2024-09-13T17:23:05.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.953+0000 7f03d1a51740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614bdf285e0 con 0x5614be050d60 2024-09-13T17:23:05.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.953+0000 7f03d1a51740 10 client.0 _ll_register_callbacks cb 0x5614bdf94aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:23:05.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.953+0000 7f03ccac1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5614be041670 0x5614be0503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.953+0000 7f03ccac1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5614be041670 0x5614be0503b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52072/0 (socket says 172.21.15.87:52072) 2024-09-13T17:23:05.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.953+0000 7f03ccac1640 1 -- 172.21.15.87:0/2174055174 learned_addr learned my addr 172.21.15.87:0/2174055174 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:05.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.954+0000 7f03cd2c2640 1 --2- 172.21.15.87:0/2174055174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614be050d60 0x5614be04dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.954+0000 7f03ccac1640 1 -- 172.21.15.87:0/2174055174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614be050d60 msgr2=0x5614be04dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:05.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.954+0000 7f03ccac1640 1 --2- 172.21.15.87:0/2174055174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614be050d60 0x5614be04dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.954+0000 7f03ccac1640 1 -- 172.21.15.87:0/2174055174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5614be041f90 msgr2=0x5614be04d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:05.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.954+0000 7f03ccac1640 1 --2- 172.21.15.87:0/2174055174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5614be041f90 0x5614be04d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.954+0000 7f03ccac1640 1 -- 172.21.15.87:0/2174055174 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c00135c0 con 0x5614be041670 2024-09-13T17:23:05.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.954+0000 7f03ccac1640 1 --2- 172.21.15.87:0/2174055174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5614be041670 0x5614be0503b0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f03c40c9fe0 tx=0x7f03c4099a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3d20fd078d41001 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:05.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.954+0000 7f03a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:23:05.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.954+0000 7f03a7fff640 1 -- 172.21.15.87:0/2174055174 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c40ca400 con 0x5614be041670 2024-09-13T17:23:05.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.954+0000 7f03a7fff640 1 -- 172.21.15.87:0/2174055174 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f03c4097da0 con 0x5614be041670 2024-09-13T17:23:05.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.954+0000 7f03d1a51740 1 -- 172.21.15.87:0/2174055174 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5614bdfceb80 con 0x5614be041670 2024-09-13T17:23:05.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.954+0000 7f03a7fff640 1 -- 172.21.15.87:0/2174055174 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03c40a1930 con 0x5614be041670 2024-09-13T17:23:05.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.954+0000 7f03d1a51740 10 client.17973 fetch_fsmap learned FSMap version 36 2024-09-13T17:23:05.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.954+0000 7f03d1a51740 1 -- 172.21.15.87:0/2174055174 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5614bdfa33c0 con 0x5614be041670 2024-09-13T17:23:05.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.954+0000 7f03a7fff640 1 -- 172.21.15.87:0/2174055174 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x5614bdfceb80 con 0x5614be041670 2024-09-13T17:23:05.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.954+0000 7f03a7fff640 1 -- 172.21.15.87:0/2174055174 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f03c4095730 con 0x5614be041670 2024-09-13T17:23:05.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.954+0000 7f03d1a51740 10 client.17973 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:23:05.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.954+0000 7f03d1a51740 10 client.17973 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:23:05.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.954+0000 7f03d1a51740 20 client.17973 populate_metadata read hostname 'smithi087' 2024-09-13T17:23:05.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.954+0000 7f03d1a51740 1 --2- 172.21.15.87:0/2174055174 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5614be0606e0 0x5614be062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.954+0000 7f03d1a51740 4 client.17973 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:23:05.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.954+0000 7f03d1a51740 1 -- 172.21.15.87:0/2174055174 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5614bdf971f0 con 0x5614be0606e0 2024-09-13T17:23:05.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.955+0000 7f03bffff640 1 --2- 172.21.15.87:0/2174055174 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5614be0606e0 0x5614be062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.955+0000 7f03a7fff640 10 client.17973 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:23:05.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.955+0000 7f03bffff640 1 --2- 172.21.15.87:0/2174055174 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5614be0606e0 0x5614be062ad0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dc1e946bc6cd9d7f server_cookie=917db0b75fc55c53 in_seq=0 out_seq=0 2024-09-13T17:23:05.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.956+0000 7f03a7fff640 1 -- 172.21.15.87:0/2174055174 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5614bdf971f0 con 0x5614be0606e0 2024-09-13T17:23:05.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.956+0000 7f03a7fff640 10 client.17973 handle_command_reply: tid=0 2024-09-13T17:23:05.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.956+0000 7f03d1a51740 1 client.17973 shutdown 2024-09-13T17:23:05.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.956+0000 7f03d1a51740 1 -- 172.21.15.87:0/2174055174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5614be041670 msgr2=0x5614be0503b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:05.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.956+0000 7f03d1a51740 1 --2- 172.21.15.87:0/2174055174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5614be041670 0x5614be0503b0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f03c40c9fe0 tx=0x7f03c4099a80 comp rx=0 tx=0).stop 2024-09-13T17:23:05.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.956+0000 7f03d1a51740 1 -- 172.21.15.87:0/2174055174 shutdown_connections 2024-09-13T17:23:05.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.956+0000 7f03d1a51740 1 --2- 172.21.15.87:0/2174055174 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5614be0606e0 0x5614be062ad0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.956+0000 7f03d1a51740 1 --2- 172.21.15.87:0/2174055174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614be050d60 0x5614be04dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.956+0000 7f03a7fff640 0 client.17973 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:23:05.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.956+0000 7f03d1a51740 1 --2- 172.21.15.87:0/2174055174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5614be041f90 0x5614be04d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.956+0000 7f03d1a51740 1 --2- 172.21.15.87:0/2174055174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5614be041670 0x5614be0503b0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.956+0000 7f03d1a51740 1 -- 172.21.15.87:0/2174055174 >> 172.21.15.87:0/2174055174 conn(0x5614be03dd00 msgr2=0x5614be043a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:05.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.956+0000 7f03d1a51740 1 -- 172.21.15.87:0/2174055174 shutdown_connections 2024-09-13T17:23:05.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.956+0000 7f03d1a51740 1 -- 172.21.15.87:0/2174055174 wait complete. 2024-09-13T17:23:05.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.956+0000 7f03d1a51740 20 client.17973 trim_cache size 0 max 16384 2024-09-13T17:23:05.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.967+0000 7f03d1a51740 1 Processor -- start 2024-09-13T17:23:05.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.968+0000 7f03d1a51740 1 -- start start 2024-09-13T17:23:05.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.968+0000 7f03d1a51740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614be041670 0x5614be03d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.968+0000 7f03d1a51740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5614be041f90 0x5614be057a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.968+0000 7f03d1a51740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5614be050d60 0x5614be057f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.968+0000 7f03d1a51740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614be03e9a0 con 0x5614be041f90 2024-09-13T17:23:05.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.968+0000 7f03d1a51740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614be05d4b0 con 0x5614be050d60 2024-09-13T17:23:05.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.968+0000 7f03d1a51740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614be0396b0 con 0x5614be041670 2024-09-13T17:23:05.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.968+0000 7f03bffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5614be041f90 0x5614be057a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.968+0000 7f03bffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5614be041f90 0x5614be057a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52080/0 (socket says 172.21.15.87:52080) 2024-09-13T17:23:05.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.968+0000 7f03bffff640 1 -- 172.21.15.87:0/3573403791 learned_addr learned my addr 172.21.15.87:0/3573403791 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:05.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.968+0000 7f03ccac1640 1 --2- 172.21.15.87:0/3573403791 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614be041670 0x5614be03d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.968+0000 7f03cd2c2640 1 --2- 172.21.15.87:0/3573403791 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5614be050d60 0x5614be057f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.968+0000 7f03bffff640 1 -- 172.21.15.87:0/3573403791 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614be041670 msgr2=0x5614be03d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:05.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.968+0000 7f03bffff640 1 --2- 172.21.15.87:0/3573403791 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614be041670 0x5614be03d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.968+0000 7f03bffff640 1 -- 172.21.15.87:0/3573403791 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5614be050d60 msgr2=0x5614be057f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:05.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.968+0000 7f03bffff640 1 --2- 172.21.15.87:0/3573403791 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5614be050d60 0x5614be057f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.968+0000 7f03bffff640 1 -- 172.21.15.87:0/3573403791 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614bdf45770 con 0x5614be041f90 2024-09-13T17:23:05.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.968+0000 7f03bffff640 1 --2- 172.21.15.87:0/3573403791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5614be041f90 0x5614be057a40 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f03b80057c0 tx=0x7f03b8004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=924ac6b68d5249b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:05.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.971+0000 7f03af7fe640 1 -- 172.21.15.87:0/3573403791 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b8043070 con 0x5614be041f90 2024-09-13T17:23:05.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.971+0000 7f03af7fe640 1 -- 172.21.15.87:0/3573403791 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f03b80054e0 con 0x5614be041f90 2024-09-13T17:23:05.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.971+0000 7f03af7fe640 1 -- 172.21.15.87:0/3573403791 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b8004c90 con 0x5614be041f90 2024-09-13T17:23:05.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.971+0000 7f03d1a51740 1 -- 172.21.15.87:0/3573403791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5614be041f90 msgr2=0x5614be057a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:05.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.971+0000 7f03d1a51740 1 --2- 172.21.15.87:0/3573403791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5614be041f90 0x5614be057a40 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f03b80057c0 tx=0x7f03b8004180 comp rx=0 tx=0).stop 2024-09-13T17:23:05.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.971+0000 7f03d1a51740 1 -- 172.21.15.87:0/3573403791 shutdown_connections 2024-09-13T17:23:05.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.971+0000 7f03d1a51740 1 --2- 172.21.15.87:0/3573403791 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5614be050d60 0x5614be057f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.971+0000 7f03d1a51740 1 --2- 172.21.15.87:0/3573403791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5614be041f90 0x5614be057a40 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.971+0000 7f03d1a51740 1 --2- 172.21.15.87:0/3573403791 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614be041670 0x5614be03d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.971+0000 7f03d1a51740 1 -- 172.21.15.87:0/3573403791 >> 172.21.15.87:0/3573403791 conn(0x5614be03dd00 msgr2=0x5614be04bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:05.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.971+0000 7f03d1a51740 1 -- 172.21.15.87:0/3573403791 shutdown_connections 2024-09-13T17:23:05.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.971+0000 7f03d1a51740 1 -- 172.21.15.87:0/3573403791 wait complete. 2024-09-13T17:23:05.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.972+0000 7f03d1a51740 1 -- start start 2024-09-13T17:23:05.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.972+0000 7f03d1a51740 1 Processor -- start 2024-09-13T17:23:05.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.972+0000 7f03d1a51740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5614be041670 0x5614be057b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.972+0000 7f03d1a51740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614be041f90 0x5614be054000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.972+0000 7f03d1a51740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5614be050d60 0x5614be054540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.972+0000 7f03d1a51740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614be054a80 con 0x5614be050d60 2024-09-13T17:23:05.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.972+0000 7f03d1a51740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614be054bf0 con 0x5614be041670 2024-09-13T17:23:05.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.972+0000 7f03d1a51740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614be054db0 con 0x5614be041f90 2024-09-13T17:23:05.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.972+0000 7f03d1a51740 10 client.0 _ll_register_callbacks cb 0x7f03c00096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:23:05.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.972+0000 7f03cd2c2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5614be050d60 0x5614be054540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.972+0000 7f03cd2c2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5614be050d60 0x5614be054540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52082/0 (socket says 172.21.15.87:52082) 2024-09-13T17:23:05.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.972+0000 7f03cd2c2640 1 -- 172.21.15.87:0/1593052808 learned_addr learned my addr 172.21.15.87:0/1593052808 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:05.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.972+0000 7f03ccac1640 1 --2- 172.21.15.87:0/1593052808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5614be041670 0x5614be057b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.972+0000 7f03bffff640 1 --2- 172.21.15.87:0/1593052808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614be041f90 0x5614be054000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.973+0000 7f03cd2c2640 1 -- 172.21.15.87:0/1593052808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614be041f90 msgr2=0x5614be054000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:05.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.973+0000 7f03cd2c2640 1 --2- 172.21.15.87:0/1593052808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614be041f90 0x5614be054000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.973+0000 7f03cd2c2640 1 -- 172.21.15.87:0/1593052808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5614be041670 msgr2=0x5614be057b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:05.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.973+0000 7f03cd2c2640 1 --2- 172.21.15.87:0/1593052808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5614be041670 0x5614be057b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.973+0000 7f03cd2c2640 1 -- 172.21.15.87:0/1593052808 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b8032cd0 con 0x5614be050d60 2024-09-13T17:23:05.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.973+0000 7f03bffff640 1 --2- 172.21.15.87:0/1593052808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614be041f90 0x5614be054000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:23:05.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.973+0000 7f03cd2c2640 1 --2- 172.21.15.87:0/1593052808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5614be050d60 0x5614be054540 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f03c0005fd0 tx=0x7f03c0009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=765b36c663672a87 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:05.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.973+0000 7f03a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:23:05.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.973+0000 7f03a7fff640 1 -- 172.21.15.87:0/1593052808 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c002c070 con 0x5614be050d60 2024-09-13T17:23:05.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.973+0000 7f03a7fff640 1 -- 172.21.15.87:0/1593052808 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f03c001d440 con 0x5614be050d60 2024-09-13T17:23:05.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.973+0000 7f03d1a51740 1 -- 172.21.15.87:0/1593052808 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f03c0019070 con 0x5614be050d60 2024-09-13T17:23:05.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.973+0000 7f03a7fff640 1 -- 172.21.15.87:0/1593052808 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03c0021050 con 0x5614be050d60 2024-09-13T17:23:05.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.973+0000 7f03d1a51740 10 client.17979 fetch_fsmap learned FSMap version 36 2024-09-13T17:23:05.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.973+0000 7f03d1a51740 1 -- 172.21.15.87:0/1593052808 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5614bdf6ae80 con 0x5614be050d60 2024-09-13T17:23:05.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.973+0000 7f03a7fff640 1 -- 172.21.15.87:0/1593052808 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f03c0019070 con 0x5614be050d60 2024-09-13T17:23:05.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.973+0000 7f03a7fff640 1 -- 172.21.15.87:0/1593052808 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f03c0026a10 con 0x5614be050d60 2024-09-13T17:23:05.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.973+0000 7f03d1a51740 10 client.17979 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:23:05.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.973+0000 7f03d1a51740 10 client.17979 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:23:05.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.973+0000 7f03d1a51740 20 client.17979 populate_metadata read hostname 'smithi087' 2024-09-13T17:23:05.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.973+0000 7f03d1a51740 1 --2- 172.21.15.87:0/1593052808 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5614be0b7f60 0x5614be0ba350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:05.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.973+0000 7f03d1a51740 4 client.17979 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:23:05.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.973+0000 7f03d1a51740 1 -- 172.21.15.87:0/1593052808 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5614bdc984e0 con 0x5614be0b7f60 2024-09-13T17:23:05.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.974+0000 7f03ccac1640 1 --2- 172.21.15.87:0/1593052808 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5614be0b7f60 0x5614be0ba350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:05.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.974+0000 7f03a7fff640 10 client.17979 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:23:05.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.974+0000 7f03ccac1640 1 --2- 172.21.15.87:0/1593052808 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5614be0b7f60 0x5614be0ba350 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=32a4cc7678447500 server_cookie=e9e47d3308210bcb in_seq=0 out_seq=0 2024-09-13T17:23:05.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.974+0000 7f03a7fff640 1 -- 172.21.15.87:0/1593052808 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5614bdc984e0 con 0x5614be0b7f60 2024-09-13T17:23:05.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.974+0000 7f03a7fff640 10 client.17979 handle_command_reply: tid=0 2024-09-13T17:23:05.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.974+0000 7f03d1a51740 1 client.17979 shutdown 2024-09-13T17:23:05.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.974+0000 7f03d1a51740 1 -- 172.21.15.87:0/1593052808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5614be050d60 msgr2=0x5614be054540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:05.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.974+0000 7f03d1a51740 1 --2- 172.21.15.87:0/1593052808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5614be050d60 0x5614be054540 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f03c0005fd0 tx=0x7f03c0009880 comp rx=0 tx=0).stop 2024-09-13T17:23:05.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.974+0000 7f03d1a51740 1 -- 172.21.15.87:0/1593052808 shutdown_connections 2024-09-13T17:23:05.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.974+0000 7f03d1a51740 1 --2- 172.21.15.87:0/1593052808 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x5614be0b7f60 0x5614be0ba350 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.974+0000 7f03d1a51740 1 --2- 172.21.15.87:0/1593052808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5614be050d60 0x5614be054540 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.974+0000 7f03a7fff640 0 client.17979 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:23:05.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.974+0000 7f03d1a51740 1 --2- 172.21.15.87:0/1593052808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614be041f90 0x5614be054000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.974+0000 7f03d1a51740 1 --2- 172.21.15.87:0/1593052808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5614be041670 0x5614be057b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.974+0000 7f03d1a51740 1 -- 172.21.15.87:0/1593052808 >> 172.21.15.87:0/1593052808 conn(0x5614be03dd00 msgr2=0x5614be04be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:05.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.974+0000 7f03d1a51740 1 -- 172.21.15.87:0/1593052808 shutdown_connections 2024-09-13T17:23:05.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.974+0000 7f03d1a51740 1 -- 172.21.15.87:0/1593052808 wait complete. 2024-09-13T17:23:05.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.975+0000 7f03d1a51740 20 client.17979 trim_cache size 0 max 16384 2024-09-13T17:23:05.982 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:23:05.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.975+0000 7f03ced25640 1 -- 172.21.15.87:0/649165744 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f03b00a1200 msgr2=0x7f03b00a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:05.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.975+0000 7f03ced25640 1 --2- 172.21.15.87:0/649165744 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f03b00a1200 0x7f03b00a36c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f03c0020000 tx=0x7f03c001f000 comp rx=0 tx=0).stop 2024-09-13T17:23:05.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.975+0000 7f03ced25640 1 -- 172.21.15.87:0/649165744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03c80fe1b0 msgr2=0x7f03c81961e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:05.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.975+0000 7f03ced25640 1 --2- 172.21.15.87:0/649165744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03c80fe1b0 0x7f03c81961e0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f03c400d770 tx=0x7f03c400dc30 comp rx=0 tx=0).stop 2024-09-13T17:23:05.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.975+0000 7f03ced25640 1 -- 172.21.15.87:0/649165744 shutdown_connections 2024-09-13T17:23:05.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.975+0000 7f03ced25640 1 --2- 172.21.15.87:0/649165744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03c8105dd0 0x7f03c819ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.975+0000 7f03ced25640 1 --2- 172.21.15.87:0/649165744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03c80feb50 0x7f03c8196720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.975+0000 7f03ced25640 1 --2- 172.21.15.87:0/649165744 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f03b00a1200 0x7f03b00a36c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.975+0000 7f03ced25640 1 --2- 172.21.15.87:0/649165744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03c80fe1b0 0x7f03c81961e0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:05.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.975+0000 7f03ced25640 1 -- 172.21.15.87:0/649165744 >> 172.21.15.87:0/649165744 conn(0x7f03c8075380 msgr2=0x7f03c80fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:05.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.975+0000 7f03ced25640 1 -- 172.21.15.87:0/649165744 shutdown_connections 2024-09-13T17:23:05.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:05.975+0000 7f03ced25640 1 -- 172.21.15.87:0/649165744 wait complete. 2024-09-13T17:23:05.987 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-09-13T17:23:06.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.086+0000 7fd35f853640 1 -- 172.21.15.87:0/1889762851 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd358103fa0 msgr2=0x7fd35810baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:06.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.086+0000 7fd35f853640 1 --2- 172.21.15.87:0/1889762851 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd358103fa0 0x7fd35810baf0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fd350009cd0 tx=0x7fd35002a8e0 comp rx=0 tx=0).stop 2024-09-13T17:23:06.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.086+0000 7fd35f853640 1 -- 172.21.15.87:0/1889762851 shutdown_connections 2024-09-13T17:23:06.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.086+0000 7fd35f853640 1 --2- 172.21.15.87:0/1889762851 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd358103fa0 0x7fd35810baf0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:06.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.086+0000 7fd35f853640 1 --2- 172.21.15.87:0/1889762851 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3580ff800 0x7fd358103840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:06.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.086+0000 7fd35f853640 1 --2- 172.21.15.87:0/1889762851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3580fee50 0x7fd3580ff230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:06.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.086+0000 7fd35f853640 1 -- 172.21.15.87:0/1889762851 >> 172.21.15.87:0/1889762851 conn(0x7fd3580fa8c0 msgr2=0x7fd3580fcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:06.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.086+0000 7fd35f853640 1 -- 172.21.15.87:0/1889762851 shutdown_connections 2024-09-13T17:23:06.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.086+0000 7fd35f853640 1 -- 172.21.15.87:0/1889762851 wait complete. 2024-09-13T17:23:06.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.087+0000 7fd35f853640 1 Processor -- start 2024-09-13T17:23:06.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.087+0000 7fd35f853640 1 -- start start 2024-09-13T17:23:06.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.087+0000 7fd35f853640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3580fee50 0x7fd358197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:06.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.087+0000 7fd35f853640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd358103fa0 0x7fd358197660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:06.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.087+0000 7fd35f853640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd358197c40 0x7fd3581a21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:06.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.087+0000 7fd35f853640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3581a28e0 con 0x7fd3580fee50 2024-09-13T17:23:06.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.087+0000 7fd35f853640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3581a2a50 con 0x7fd358197c40 2024-09-13T17:23:06.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.087+0000 7fd35f853640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3581a2c10 con 0x7fd358103fa0 2024-09-13T17:23:06.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.087+0000 7fd35d5ef640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3580fee50 0x7fd358197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:06.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.087+0000 7fd35d5ef640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3580fee50 0x7fd358197120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52098/0 (socket says 172.21.15.87:52098) 2024-09-13T17:23:06.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.087+0000 7fd35d5ef640 1 -- 172.21.15.87:0/3783960906 learned_addr learned my addr 172.21.15.87:0/3783960906 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:06.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.087+0000 7fd35ddf0640 1 --2- 172.21.15.87:0/3783960906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd358197c40 0x7fd3581a21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:06.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.087+0000 7fd35cdee640 1 --2- 172.21.15.87:0/3783960906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd358103fa0 0x7fd358197660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:06.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.087+0000 7fd35d5ef640 1 -- 172.21.15.87:0/3783960906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd358103fa0 msgr2=0x7fd358197660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:06.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.087+0000 7fd35d5ef640 1 --2- 172.21.15.87:0/3783960906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd358103fa0 0x7fd358197660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:06.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.087+0000 7fd35d5ef640 1 -- 172.21.15.87:0/3783960906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd358197c40 msgr2=0x7fd3581a21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:06.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.087+0000 7fd35d5ef640 1 --2- 172.21.15.87:0/3783960906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd358197c40 0x7fd3581a21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:06.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.087+0000 7fd35d5ef640 1 -- 172.21.15.87:0/3783960906 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd350009900 con 0x7fd3580fee50 2024-09-13T17:23:06.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.087+0000 7fd35cdee640 1 --2- 172.21.15.87:0/3783960906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd358103fa0 0x7fd358197660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:23:06.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.087+0000 7fd35ddf0640 1 --2- 172.21.15.87:0/3783960906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd358197c40 0x7fd3581a21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:23:06.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.087+0000 7fd35d5ef640 1 --2- 172.21.15.87:0/3783960906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3580fee50 0x7fd358197120 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fd35400c890 tx=0x7fd35400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:06.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.088+0000 7fd34a7fc640 1 -- 172.21.15.87:0/3783960906 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd354004220 con 0x7fd3580fee50 2024-09-13T17:23:06.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.088+0000 7fd34a7fc640 1 -- 172.21.15.87:0/3783960906 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd354007e60 con 0x7fd3580fee50 2024-09-13T17:23:06.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.088+0000 7fd35f853640 1 -- 172.21.15.87:0/3783960906 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3581a2ef0 con 0x7fd3580fee50 2024-09-13T17:23:06.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.088+0000 7fd34a7fc640 1 -- 172.21.15.87:0/3783960906 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd354004a00 con 0x7fd3580fee50 2024-09-13T17:23:06.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.088+0000 7fd35f853640 1 -- 172.21.15.87:0/3783960906 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3581a3370 con 0x7fd3580fee50 2024-09-13T17:23:06.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.090+0000 7fd34a7fc640 1 -- 172.21.15.87:0/3783960906 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fd3540079b0 con 0x7fd3580fee50 2024-09-13T17:23:06.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.090+0000 7fd362650740 1 Processor -- start 2024-09-13T17:23:06.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.090+0000 7fd362650740 1 -- start start 2024-09-13T17:23:06.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.091+0000 7fd34a7fc640 1 --2- 172.21.15.87:0/3783960906 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd3440a1200 0x7fd3440a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:06.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.091+0000 7fd362650740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559114f06790 0x559114f06b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:06.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.091+0000 7fd362650740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559114f070b0 0x559114f11410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:06.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.091+0000 7fd362650740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559114f11950 0x559114f13d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:06.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.091+0000 7fd362650740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559114e70cc0 con 0x559114f070b0 2024-09-13T17:23:06.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.091+0000 7fd362650740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559114e6e450 con 0x559114f06790 2024-09-13T17:23:06.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.091+0000 7fd362650740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x559114e69d40 con 0x559114f11950 2024-09-13T17:23:06.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.091+0000 7fd34a7fc640 1 -- 172.21.15.87:0/3783960906 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fd3540cce80 con 0x7fd3580fee50 2024-09-13T17:23:06.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.091+0000 7fd35ddf0640 1 --2- 172.21.15.87:0/3783960906 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd3440a1200 0x7fd3440a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:06.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.091+0000 7fd35cdee640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559114f070b0 0x559114f11410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:06.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.091+0000 7fd35cdee640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559114f070b0 0x559114f11410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52110/0 (socket says 172.21.15.87:52110) 2024-09-13T17:23:06.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.091+0000 7fd35cdee640 1 -- 172.21.15.87:0/3727814659 learned_addr learned my addr 172.21.15.87:0/3727814659 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:06.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.091+0000 7fd35ddf0640 1 --2- 172.21.15.87:0/3727814659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559114f11950 0x559114f13d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:06.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.091+0000 7fd35d5ef640 1 --2- 172.21.15.87:0/3727814659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559114f06790 0x559114f06b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:06.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.091+0000 7fd35cdee640 1 -- 172.21.15.87:0/3727814659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559114f11950 msgr2=0x559114f13d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:06.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.091+0000 7fd35cdee640 1 --2- 172.21.15.87:0/3727814659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559114f11950 0x559114f13d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:06.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.091+0000 7fd35cdee640 1 -- 172.21.15.87:0/3727814659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559114f06790 msgr2=0x559114f06b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:06.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.091+0000 7fd35cdee640 1 --2- 172.21.15.87:0/3727814659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559114f06790 0x559114f06b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:06.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.091+0000 7fd35cdee640 1 -- 172.21.15.87:0/3727814659 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559114e31620 con 0x559114f070b0 2024-09-13T17:23:06.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.091+0000 7fd35ddf0640 1 --2- 172.21.15.87:0/3783960906 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd3440a1200 0x7fd3440a36c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd350009430 tx=0x7fd350030d20 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:06.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.091+0000 7fd35cdee640 1 --2- 172.21.15.87:0/3727814659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559114f070b0 0x559114f11410 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fd34c009b60 tx=0x7fd34c00e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60261a274a672f24 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:06.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.091+0000 7fd3437fe640 1 -- 172.21.15.87:0/3727814659 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c009e50 con 0x559114f070b0 2024-09-13T17:23:06.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.091+0000 7fd3437fe640 1 -- 172.21.15.87:0/3727814659 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd34c011920 con 0x559114f070b0 2024-09-13T17:23:06.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.091+0000 7fd3437fe640 1 -- 172.21.15.87:0/3727814659 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c010750 con 0x559114f070b0 2024-09-13T17:23:06.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.092+0000 7fd362650740 1 -- 172.21.15.87:0/3727814659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559114f070b0 msgr2=0x559114f11410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:06.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.092+0000 7fd362650740 1 --2- 172.21.15.87:0/3727814659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559114f070b0 0x559114f11410 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fd34c009b60 tx=0x7fd34c00e6c0 comp rx=0 tx=0).stop 2024-09-13T17:23:06.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.092+0000 7fd362650740 1 -- 172.21.15.87:0/3727814659 shutdown_connections 2024-09-13T17:23:06.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.092+0000 7fd362650740 1 --2- 172.21.15.87:0/3727814659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559114f11950 0x559114f13d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:06.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.092+0000 7fd362650740 1 --2- 172.21.15.87:0/3727814659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559114f070b0 0x559114f11410 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:06.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.092+0000 7fd362650740 1 --2- 172.21.15.87:0/3727814659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559114f06790 0x559114f06b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:06.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.092+0000 7fd362650740 1 -- 172.21.15.87:0/3727814659 >> 172.21.15.87:0/3727814659 conn(0x559114f02d00 msgr2=0x559114f030e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:06.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.092+0000 7fd362650740 1 -- 172.21.15.87:0/3727814659 shutdown_connections 2024-09-13T17:23:06.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.092+0000 7fd362650740 1 -- 172.21.15.87:0/3727814659 wait complete. 2024-09-13T17:23:06.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.092+0000 7fd362650740 1 -- start start 2024-09-13T17:23:06.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.093+0000 7fd362650740 1 Processor -- start 2024-09-13T17:23:06.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.093+0000 7fd362650740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559114f06790 0x559114f10ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:06.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.093+0000 7fd362650740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559114f070b0 0x559114f11400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:06.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.093+0000 7fd362650740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559114f11950 0x559114f0e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:06.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.093+0000 7fd362650740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559114e28180 con 0x559114f06790 2024-09-13T17:23:06.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.093+0000 7fd362650740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559114b42430 con 0x559114f11950 2024-09-13T17:23:06.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.093+0000 7fd362650740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x559114ded5e0 con 0x559114f070b0 2024-09-13T17:23:06.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.093+0000 7fd362650740 10 client.0 _ll_register_callbacks cb 0x559114e59aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:23:06.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.093+0000 7fd35d5ef640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559114f06790 0x559114f10ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:06.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.093+0000 7fd35d5ef640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559114f06790 0x559114f10ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52118/0 (socket says 172.21.15.87:52118) 2024-09-13T17:23:06.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.093+0000 7fd35d5ef640 1 -- 172.21.15.87:0/1972653592 learned_addr learned my addr 172.21.15.87:0/1972653592 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:06.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.093+0000 7fd35cdee640 1 --2- 172.21.15.87:0/1972653592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559114f070b0 0x559114f11400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:06.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.093+0000 7fd35d5ef640 1 -- 172.21.15.87:0/1972653592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559114f070b0 msgr2=0x559114f11400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:06.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.093+0000 7fd35d5ef640 1 --2- 172.21.15.87:0/1972653592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559114f070b0 0x559114f11400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:06.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.093+0000 7fd35ddf0640 1 --2- 172.21.15.87:0/1972653592 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559114f11950 0x559114f0e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:06.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.093+0000 7fd35d5ef640 1 -- 172.21.15.87:0/1972653592 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559114f11950 msgr2=0x559114f0e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:06.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.093+0000 7fd35d5ef640 1 --2- 172.21.15.87:0/1972653592 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559114f11950 0x559114f0e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:06.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.093+0000 7fd35d5ef640 1 -- 172.21.15.87:0/1972653592 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd34c0097c0 con 0x559114f06790 2024-09-13T17:23:06.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.094+0000 7fd35d5ef640 1 --2- 172.21.15.87:0/1972653592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559114f06790 0x559114f10ec0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fd354096080 tx=0x7fd35409d9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b6eeebc326edde server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:06.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.094+0000 7fd340ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:23:06.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.094+0000 7fd340ff9640 1 -- 172.21.15.87:0/1972653592 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd354085ea0 con 0x559114f06790 2024-09-13T17:23:06.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.094+0000 7fd340ff9640 1 -- 172.21.15.87:0/1972653592 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fd354097f20 con 0x559114f06790 2024-09-13T17:23:06.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.094+0000 7fd362650740 1 -- 172.21.15.87:0/1972653592 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559114e93b80 con 0x559114f06790 2024-09-13T17:23:06.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.094+0000 7fd340ff9640 1 -- 172.21.15.87:0/1972653592 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd354096290 con 0x559114f06790 2024-09-13T17:23:06.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.094+0000 7fd362650740 10 client.17991 fetch_fsmap learned FSMap version 36 2024-09-13T17:23:06.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.094+0000 7fd362650740 1 -- 172.21.15.87:0/1972653592 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x559114e683c0 con 0x559114f06790 2024-09-13T17:23:06.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.094+0000 7fd340ff9640 1 -- 172.21.15.87:0/1972653592 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x559114e93b80 con 0x559114f06790 2024-09-13T17:23:06.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.094+0000 7fd340ff9640 1 -- 172.21.15.87:0/1972653592 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd354016030 con 0x559114f06790 2024-09-13T17:23:06.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.094+0000 7fd362650740 10 client.17991 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:23:06.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.094+0000 7fd362650740 10 client.17991 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:23:06.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.094+0000 7fd362650740 20 client.17991 populate_metadata read hostname 'smithi087' 2024-09-13T17:23:06.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.094+0000 7fd362650740 1 --2- 172.21.15.87:0/1972653592 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x559114f21210 0x559114f23600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:06.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.094+0000 7fd362650740 4 client.17991 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:23:06.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.094+0000 7fd362650740 1 -- 172.21.15.87:0/1972653592 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559114e5c1f0 con 0x559114f21210 2024-09-13T17:23:06.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.094+0000 7fd35cdee640 1 --2- 172.21.15.87:0/1972653592 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x559114f21210 0x559114f23600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:06.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.095+0000 7fd340ff9640 10 client.17991 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:23:06.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.095+0000 7fd35cdee640 1 --2- 172.21.15.87:0/1972653592 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x559114f21210 0x559114f23600 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6311b15ab1192f8 server_cookie=cf2ce76c5d6acfdd in_seq=0 out_seq=0 2024-09-13T17:23:06.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.095+0000 7fd340ff9640 1 -- 172.21.15.87:0/1972653592 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x559114e5c1f0 con 0x559114f21210 2024-09-13T17:23:06.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.095+0000 7fd340ff9640 10 client.17991 handle_command_reply: tid=0 2024-09-13T17:23:06.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.095+0000 7fd362650740 1 client.17991 shutdown 2024-09-13T17:23:06.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.096+0000 7fd362650740 1 -- 172.21.15.87:0/1972653592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559114f06790 msgr2=0x559114f10ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:06.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.096+0000 7fd362650740 1 --2- 172.21.15.87:0/1972653592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559114f06790 0x559114f10ec0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fd354096080 tx=0x7fd35409d9b0 comp rx=0 tx=0).stop 2024-09-13T17:23:06.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.096+0000 7fd362650740 1 -- 172.21.15.87:0/1972653592 shutdown_connections 2024-09-13T17:23:06.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.096+0000 7fd362650740 1 --2- 172.21.15.87:0/1972653592 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x559114f21210 0x559114f23600 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:06.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.096+0000 7fd362650740 1 --2- 172.21.15.87:0/1972653592 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559114f11950 0x559114f0e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:06.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.096+0000 7fd340ff9640 0 client.17991 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:23:06.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.096+0000 7fd362650740 1 --2- 172.21.15.87:0/1972653592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559114f070b0 0x559114f11400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:06.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.096+0000 7fd362650740 1 --2- 172.21.15.87:0/1972653592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559114f06790 0x559114f10ec0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:06.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.096+0000 7fd362650740 1 -- 172.21.15.87:0/1972653592 >> 172.21.15.87:0/1972653592 conn(0x559114f02d00 msgr2=0x559114f08a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:06.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.096+0000 7fd362650740 1 -- 172.21.15.87:0/1972653592 shutdown_connections 2024-09-13T17:23:06.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.096+0000 7fd362650740 1 -- 172.21.15.87:0/1972653592 wait complete. 2024-09-13T17:23:06.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.096+0000 7fd362650740 20 client.17991 trim_cache size 0 max 16384 2024-09-13T17:23:06.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.107+0000 7fd362650740 1 Processor -- start 2024-09-13T17:23:06.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.107+0000 7fd362650740 1 -- start start 2024-09-13T17:23:06.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.107+0000 7fd362650740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559114f06790 0x559114f18620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:06.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.107+0000 7fd362650740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559114f070b0 0x559114f18b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:06.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.107+0000 7fd362650740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559114f11950 0x559114f0cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:06.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.107+0000 7fd362650740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559114f1fb30 con 0x559114f070b0 2024-09-13T17:23:06.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.107+0000 7fd362650740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559114f0f370 con 0x559114f11950 2024-09-13T17:23:06.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.107+0000 7fd362650740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x559114f065c0 con 0x559114f06790 2024-09-13T17:23:06.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.107+0000 7fd35cdee640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559114f070b0 0x559114f18b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:06.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.107+0000 7fd35cdee640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559114f070b0 0x559114f18b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52132/0 (socket says 172.21.15.87:52132) 2024-09-13T17:23:06.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.107+0000 7fd35cdee640 1 -- 172.21.15.87:0/3116297222 learned_addr learned my addr 172.21.15.87:0/3116297222 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:06.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.107+0000 7fd35d5ef640 1 --2- 172.21.15.87:0/3116297222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559114f06790 0x559114f18620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:06.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.107+0000 7fd35cdee640 1 -- 172.21.15.87:0/3116297222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559114f06790 msgr2=0x559114f18620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:06.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.107+0000 7fd35cdee640 1 --2- 172.21.15.87:0/3116297222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559114f06790 0x559114f18620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:06.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.107+0000 7fd35cdee640 1 -- 172.21.15.87:0/3116297222 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559114f11950 msgr2=0x559114f0cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:06.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.107+0000 7fd35cdee640 1 --2- 172.21.15.87:0/3116297222 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559114f11950 0x559114f0cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:06.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.107+0000 7fd35cdee640 1 -- 172.21.15.87:0/3116297222 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559114e0a770 con 0x559114f070b0 2024-09-13T17:23:06.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.107+0000 7fd35cdee640 1 --2- 172.21.15.87:0/3116297222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559114f070b0 0x559114f18b60 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fd34c00f010 tx=0x7fd34c009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=707b3cc393b956a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:06.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.108+0000 7fd343fff640 1 -- 172.21.15.87:0/3116297222 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c02d030 con 0x559114f070b0 2024-09-13T17:23:06.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.108+0000 7fd343fff640 1 -- 172.21.15.87:0/3116297222 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd34c009de0 con 0x559114f070b0 2024-09-13T17:23:06.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.108+0000 7fd343fff640 1 -- 172.21.15.87:0/3116297222 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c0295c0 con 0x559114f070b0 2024-09-13T17:23:06.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.108+0000 7fd362650740 1 -- 172.21.15.87:0/3116297222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559114f070b0 msgr2=0x559114f18b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:06.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.108+0000 7fd362650740 1 --2- 172.21.15.87:0/3116297222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559114f070b0 0x559114f18b60 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fd34c00f010 tx=0x7fd34c009740 comp rx=0 tx=0).stop 2024-09-13T17:23:06.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.108+0000 7fd362650740 1 -- 172.21.15.87:0/3116297222 shutdown_connections 2024-09-13T17:23:06.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.108+0000 7fd362650740 1 --2- 172.21.15.87:0/3116297222 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559114f11950 0x559114f0cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:06.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.108+0000 7fd362650740 1 --2- 172.21.15.87:0/3116297222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559114f070b0 0x559114f18b60 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:06.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.108+0000 7fd362650740 1 --2- 172.21.15.87:0/3116297222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559114f06790 0x559114f18620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:06.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.108+0000 7fd362650740 1 -- 172.21.15.87:0/3116297222 >> 172.21.15.87:0/3116297222 conn(0x559114f02d00 msgr2=0x559114f0d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:06.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.108+0000 7fd362650740 1 -- 172.21.15.87:0/3116297222 shutdown_connections 2024-09-13T17:23:06.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.108+0000 7fd362650740 1 -- 172.21.15.87:0/3116297222 wait complete. 2024-09-13T17:23:06.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.108+0000 7fd362650740 1 -- start start 2024-09-13T17:23:06.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.108+0000 7fd362650740 1 Processor -- start 2024-09-13T17:23:06.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.109+0000 7fd362650740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559114f06790 0x559114f189d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:06.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.109+0000 7fd362650740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559114f070b0 0x559114f16e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:06.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.109+0000 7fd362650740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559114f11950 0x559114f173d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:06.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.109+0000 7fd362650740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559114f17aa0 con 0x559114f070b0 2024-09-13T17:23:06.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.109+0000 7fd362650740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559114f17c10 con 0x559114f06790 2024-09-13T17:23:06.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.109+0000 7fd362650740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x559114f776c0 con 0x559114f11950 2024-09-13T17:23:06.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.109+0000 7fd362650740 10 client.0 _ll_register_callbacks cb 0x7fd34c009320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:23:06.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.109+0000 7fd35cdee640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559114f070b0 0x559114f16e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:06.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.109+0000 7fd35cdee640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559114f070b0 0x559114f16e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52146/0 (socket says 172.21.15.87:52146) 2024-09-13T17:23:06.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.109+0000 7fd35cdee640 1 -- 172.21.15.87:0/2090760759 learned_addr learned my addr 172.21.15.87:0/2090760759 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:06.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.109+0000 7fd35d5ef640 1 --2- 172.21.15.87:0/2090760759 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559114f06790 0x559114f189d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:06.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.109+0000 7fd35ddf0640 1 --2- 172.21.15.87:0/2090760759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559114f11950 0x559114f173d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:06.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.109+0000 7fd35cdee640 1 -- 172.21.15.87:0/2090760759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559114f11950 msgr2=0x559114f173d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:06.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.109+0000 7fd35cdee640 1 --2- 172.21.15.87:0/2090760759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559114f11950 0x559114f173d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:06.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.109+0000 7fd35cdee640 1 -- 172.21.15.87:0/2090760759 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559114f06790 msgr2=0x559114f189d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:06.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.109+0000 7fd35cdee640 1 --2- 172.21.15.87:0/2090760759 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559114f06790 0x559114f189d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:06.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.109+0000 7fd35cdee640 1 -- 172.21.15.87:0/2090760759 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559114e31620 con 0x559114f070b0 2024-09-13T17:23:06.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.109+0000 7fd35cdee640 1 --2- 172.21.15.87:0/2090760759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559114f070b0 0x559114f16e90 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fd34c00ebc0 tx=0x7fd34c0117a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4d11fc3c7f4080 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:06.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.109+0000 7fd340ff9640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:23:06.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.110+0000 7fd340ff9640 1 -- 172.21.15.87:0/2090760759 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c02d070 con 0x559114f070b0 2024-09-13T17:23:06.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.110+0000 7fd340ff9640 1 -- 172.21.15.87:0/2090760759 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fd34c02e070 con 0x559114f070b0 2024-09-13T17:23:06.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.110+0000 7fd362650740 1 -- 172.21.15.87:0/2090760759 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd34c011920 con 0x559114f070b0 2024-09-13T17:23:06.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.110+0000 7fd340ff9640 1 -- 172.21.15.87:0/2090760759 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd34c011ea0 con 0x559114f070b0 2024-09-13T17:23:06.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.110+0000 7fd362650740 10 client.17997 fetch_fsmap learned FSMap version 36 2024-09-13T17:23:06.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.110+0000 7fd362650740 1 -- 172.21.15.87:0/2090760759 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x559114e2fe80 con 0x559114f070b0 2024-09-13T17:23:06.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.110+0000 7fd340ff9640 1 -- 172.21.15.87:0/2090760759 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd34c011920 con 0x559114f070b0 2024-09-13T17:23:06.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.110+0000 7fd340ff9640 1 -- 172.21.15.87:0/2090760759 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd34c00c070 con 0x559114f070b0 2024-09-13T17:23:06.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.110+0000 7fd362650740 10 client.17997 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:23:06.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.110+0000 7fd362650740 10 client.17997 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:23:06.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.110+0000 7fd362650740 20 client.17997 populate_metadata read hostname 'smithi087' 2024-09-13T17:23:06.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.110+0000 7fd362650740 1 --2- 172.21.15.87:0/2090760759 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x559114f21210 0x559114f7a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:06.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.110+0000 7fd362650740 4 client.17997 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:23:06.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.110+0000 7fd362650740 1 -- 172.21.15.87:0/2090760759 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559114b5d4e0 con 0x559114f21210 2024-09-13T17:23:06.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.110+0000 7fd35d5ef640 1 --2- 172.21.15.87:0/2090760759 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x559114f21210 0x559114f7a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:06.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.111+0000 7fd340ff9640 10 client.17997 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:23:06.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.111+0000 7fd35d5ef640 1 --2- 172.21.15.87:0/2090760759 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x559114f21210 0x559114f7a9a0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d15113a5fe81072e server_cookie=a73de8bd0600b65f in_seq=0 out_seq=0 2024-09-13T17:23:06.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.111+0000 7fd340ff9640 1 -- 172.21.15.87:0/2090760759 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559114b5d4e0 con 0x559114f21210 2024-09-13T17:23:06.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.111+0000 7fd340ff9640 10 client.17997 handle_command_reply: tid=0 2024-09-13T17:23:06.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.111+0000 7fd362650740 1 client.17997 shutdown 2024-09-13T17:23:06.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.111+0000 7fd362650740 1 -- 172.21.15.87:0/2090760759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559114f070b0 msgr2=0x559114f16e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:06.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.111+0000 7fd362650740 1 --2- 172.21.15.87:0/2090760759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559114f070b0 0x559114f16e90 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fd34c00ebc0 tx=0x7fd34c0117a0 comp rx=0 tx=0).stop 2024-09-13T17:23:06.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.111+0000 7fd362650740 1 -- 172.21.15.87:0/2090760759 shutdown_connections 2024-09-13T17:23:06.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.111+0000 7fd362650740 1 --2- 172.21.15.87:0/2090760759 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x559114f21210 0x559114f7a9a0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:06.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.111+0000 7fd362650740 1 --2- 172.21.15.87:0/2090760759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559114f11950 0x559114f173d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:06.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.111+0000 7fd362650740 1 --2- 172.21.15.87:0/2090760759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559114f070b0 0x559114f16e90 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:06.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.111+0000 7fd340ff9640 0 client.17997 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:23:06.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.111+0000 7fd362650740 1 --2- 172.21.15.87:0/2090760759 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559114f06790 0x559114f189d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:06.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.111+0000 7fd362650740 1 -- 172.21.15.87:0/2090760759 >> 172.21.15.87:0/2090760759 conn(0x559114f02d00 msgr2=0x559114f09360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:06.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.111+0000 7fd362650740 1 -- 172.21.15.87:0/2090760759 shutdown_connections 2024-09-13T17:23:06.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.111+0000 7fd362650740 1 -- 172.21.15.87:0/2090760759 wait complete. 2024-09-13T17:23:06.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.111+0000 7fd362650740 20 client.17997 trim_cache size 0 max 16384 2024-09-13T17:23:06.120 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:23:06.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.112+0000 7fd35f853640 1 -- 172.21.15.87:0/3783960906 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd3440a1200 msgr2=0x7fd3440a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:06.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.112+0000 7fd35f853640 1 --2- 172.21.15.87:0/3783960906 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd3440a1200 0x7fd3440a36c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd350009430 tx=0x7fd350030d20 comp rx=0 tx=0).stop 2024-09-13T17:23:06.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.112+0000 7fd35f853640 1 -- 172.21.15.87:0/3783960906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3580fee50 msgr2=0x7fd358197120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:06.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.112+0000 7fd35f853640 1 --2- 172.21.15.87:0/3783960906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3580fee50 0x7fd358197120 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fd35400c890 tx=0x7fd35400cd50 comp rx=0 tx=0).stop 2024-09-13T17:23:06.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.112+0000 7fd35f853640 1 -- 172.21.15.87:0/3783960906 shutdown_connections 2024-09-13T17:23:06.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.112+0000 7fd35f853640 1 --2- 172.21.15.87:0/3783960906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd358197c40 0x7fd3581a21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:06.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.112+0000 7fd35f853640 1 --2- 172.21.15.87:0/3783960906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd358103fa0 0x7fd358197660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:06.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.112+0000 7fd35f853640 1 --2- 172.21.15.87:0/3783960906 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd3440a1200 0x7fd3440a36c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:06.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.112+0000 7fd35f853640 1 --2- 172.21.15.87:0/3783960906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3580fee50 0x7fd358197120 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:06.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.112+0000 7fd35f853640 1 -- 172.21.15.87:0/3783960906 >> 172.21.15.87:0/3783960906 conn(0x7fd3580fa8c0 msgr2=0x7fd3580fbcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:06.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.112+0000 7fd35f853640 1 -- 172.21.15.87:0/3783960906 shutdown_connections 2024-09-13T17:23:06.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:06.112+0000 7fd35f853640 1 -- 172.21.15.87:0/3783960906 wait complete. 2024-09-13T17:23:06.228 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:05 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1147533591' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:23:06.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:05 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1147533591' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:23:06.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:05 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1147533591' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:23:07.125 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-13T17:23:07.125 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-09-13T17:23:07.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:06 smithi087 ceph-mon[30934]: pgmap v287: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-09-13T17:23:07.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.237+0000 7f5a1d365640 1 -- 172.21.15.87:0/86396557 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a18100f40 msgr2=0x7f5a18101320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:07.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.237+0000 7f5a1d365640 1 --2- 172.21.15.87:0/86396557 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a18100f40 0x7f5a18101320 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f5a08009900 tx=0x7f5a0802a480 comp rx=0 tx=0).stop 2024-09-13T17:23:07.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.237+0000 7f5a1d365640 1 -- 172.21.15.87:0/86396557 shutdown_connections 2024-09-13T17:23:07.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.237+0000 7f5a1d365640 1 --2- 172.21.15.87:0/86396557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a1810a310 0x7f5a1810c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.237+0000 7f5a1d365640 1 --2- 172.21.15.87:0/86396557 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a18101860 0x7f5a18109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.237+0000 7f5a1d365640 1 --2- 172.21.15.87:0/86396557 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a18100f40 0x7f5a18101320 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.237+0000 7f5a1d365640 1 -- 172.21.15.87:0/86396557 >> 172.21.15.87:0/86396557 conn(0x7f5a18075c60 msgr2=0x7f5a180fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:07.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.237+0000 7f5a1d365640 1 -- 172.21.15.87:0/86396557 shutdown_connections 2024-09-13T17:23:07.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.238+0000 7f5a1d365640 1 -- 172.21.15.87:0/86396557 wait complete. 2024-09-13T17:23:07.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.238+0000 7f5a1d365640 1 Processor -- start 2024-09-13T17:23:07.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.238+0000 7f5a1d365640 1 -- start start 2024-09-13T17:23:07.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.238+0000 7f5a1d365640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a18100f40 0x7f5a180feb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.238+0000 7f5a1d365640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a18101860 0x7f5a180ff0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.239+0000 7f5a1d365640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a1810a310 0x7f5a180ff610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.239+0000 7f5a1d365640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a181a4640 con 0x7f5a18101860 2024-09-13T17:23:07.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.239+0000 7f5a1d365640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a181a47b0 con 0x7f5a18100f40 2024-09-13T17:23:07.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.239+0000 7f5a1d365640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a181a4970 con 0x7f5a1810a310 2024-09-13T17:23:07.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.239+0000 7f5a0e7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a18101860 0x7f5a180ff0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:07.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.239+0000 7f5a0e7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a18101860 0x7f5a180ff0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52164/0 (socket says 172.21.15.87:52164) 2024-09-13T17:23:07.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.239+0000 7f5a0e7fc640 1 -- 172.21.15.87:0/1669273204 learned_addr learned my addr 172.21.15.87:0/1669273204 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:07.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.239+0000 7f5a16ffd640 1 --2- 172.21.15.87:0/1669273204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a18100f40 0x7f5a180feb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:07.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.239+0000 7f5a177fe640 1 --2- 172.21.15.87:0/1669273204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a1810a310 0x7f5a180ff610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:07.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.239+0000 7f5a0e7fc640 1 -- 172.21.15.87:0/1669273204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a1810a310 msgr2=0x7f5a180ff610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:07.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.239+0000 7f5a0e7fc640 1 --2- 172.21.15.87:0/1669273204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a1810a310 0x7f5a180ff610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.239+0000 7f5a0e7fc640 1 -- 172.21.15.87:0/1669273204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a18100f40 msgr2=0x7f5a180feb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:07.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.239+0000 7f5a0e7fc640 1 --2- 172.21.15.87:0/1669273204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a18100f40 0x7f5a180feb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.239+0000 7f5a0e7fc640 1 -- 172.21.15.87:0/1669273204 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a08009560 con 0x7f5a18101860 2024-09-13T17:23:07.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.239+0000 7f5a177fe640 1 --2- 172.21.15.87:0/1669273204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a1810a310 0x7f5a180ff610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:23:07.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.239+0000 7f5a16ffd640 1 --2- 172.21.15.87:0/1669273204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a18100f40 0x7f5a180feb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:23:07.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.239+0000 7f5a0e7fc640 1 --2- 172.21.15.87:0/1669273204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a18101860 0x7f5a180ff0d0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f5a0000d950 tx=0x7f5a0000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:07.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.239+0000 7f5a14ff9640 1 -- 172.21.15.87:0/1669273204 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a00009a30 con 0x7f5a18101860 2024-09-13T17:23:07.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.239+0000 7f5a14ff9640 1 -- 172.21.15.87:0/1669273204 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5a000044d0 con 0x7f5a18101860 2024-09-13T17:23:07.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.239+0000 7f5a14ff9640 1 -- 172.21.15.87:0/1669273204 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a000047a0 con 0x7f5a18101860 2024-09-13T17:23:07.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.239+0000 7f5a1d365640 1 -- 172.21.15.87:0/1669273204 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a181a4c50 con 0x7f5a18101860 2024-09-13T17:23:07.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.239+0000 7f5a1d365640 1 -- 172.21.15.87:0/1669273204 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a181a5110 con 0x7f5a18101860 2024-09-13T17:23:07.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.242+0000 7f5a14ff9640 1 -- 172.21.15.87:0/1669273204 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f5a00009b90 con 0x7f5a18101860 2024-09-13T17:23:07.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.242+0000 7f5a20092740 1 Processor -- start 2024-09-13T17:23:07.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.242+0000 7f5a20092740 1 -- start start 2024-09-13T17:23:07.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.242+0000 7f5a20092740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5486197c0 0x55e548619ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.242+0000 7f5a20092740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e54861a0e0 0x55e548624440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.242+0000 7f5a20092740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e548624980 0x55e548626d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.242+0000 7f5a20092740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e548584c60 con 0x55e5486197c0 2024-09-13T17:23:07.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.242+0000 7f5a20092740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5485823f0 con 0x55e548624980 2024-09-13T17:23:07.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.242+0000 7f5a20092740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e54857dce0 con 0x55e54861a0e0 2024-09-13T17:23:07.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.243+0000 7f5a177fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5486197c0 0x55e548619ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:07.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.243+0000 7f5a177fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5486197c0 0x55e548619ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52170/0 (socket says 172.21.15.87:52170) 2024-09-13T17:23:07.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.243+0000 7f5a177fe640 1 -- 172.21.15.87:0/3995992036 learned_addr learned my addr 172.21.15.87:0/3995992036 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:07.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.243+0000 7f5a16ffd640 1 --2- 172.21.15.87:0/3995992036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e54861a0e0 0x55e548624440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:07.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.243+0000 7f5a0e7fc640 1 --2- 172.21.15.87:0/3995992036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e548624980 0x55e548626d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:07.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.243+0000 7f5a14ff9640 1 --2- 172.21.15.87:0/1669273204 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5a040a1280 0x7f5a040a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.243+0000 7f5a177fe640 1 -- 172.21.15.87:0/3995992036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e54861a0e0 msgr2=0x55e548624440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:07.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.243+0000 7f5a177fe640 1 --2- 172.21.15.87:0/3995992036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e54861a0e0 0x55e548624440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.243+0000 7f5a177fe640 1 -- 172.21.15.87:0/3995992036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e548624980 msgr2=0x55e548626d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:07.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.243+0000 7f5a177fe640 1 --2- 172.21.15.87:0/3995992036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e548624980 0x55e548626d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.243+0000 7f5a177fe640 1 -- 172.21.15.87:0/3995992036 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e548539970 con 0x55e5486197c0 2024-09-13T17:23:07.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.243+0000 7f5a0e7fc640 1 --2- 172.21.15.87:0/3995992036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e548624980 0x55e548626d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:23:07.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.243+0000 7f5a16ffd640 1 --2- 172.21.15.87:0/3995992036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e54861a0e0 0x55e548624440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:23:07.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.243+0000 7f5a177fe640 1 --2- 172.21.15.87:0/1669273204 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5a040a1280 0x7f5a040a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:07.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.243+0000 7f5a14ff9640 1 -- 172.21.15.87:0/1669273204 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f5a000ccb50 con 0x7f5a18101860 2024-09-13T17:23:07.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.243+0000 7f5a177fe640 1 --2- 172.21.15.87:0/3995992036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5486197c0 0x55e548619ba0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f5a10008f00 tx=0x7f5a1000d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5cffdccbd02b011 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:07.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.243+0000 7f5a0d7fa640 1 -- 172.21.15.87:0/3995992036 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1001f070 con 0x55e5486197c0 2024-09-13T17:23:07.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.244+0000 7f5a0d7fa640 1 -- 172.21.15.87:0/3995992036 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5a1001ad90 con 0x55e5486197c0 2024-09-13T17:23:07.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.244+0000 7f5a0d7fa640 1 -- 172.21.15.87:0/3995992036 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a10019a60 con 0x55e5486197c0 2024-09-13T17:23:07.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.244+0000 7f5a20092740 1 -- 172.21.15.87:0/3995992036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5486197c0 msgr2=0x55e548619ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:07.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.244+0000 7f5a177fe640 1 --2- 172.21.15.87:0/1669273204 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5a040a1280 0x7f5a040a3740 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5a1001e000 tx=0x7f5a1001f000 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:07.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.244+0000 7f5a20092740 1 --2- 172.21.15.87:0/3995992036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5486197c0 0x55e548619ba0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f5a10008f00 tx=0x7f5a1000d710 comp rx=0 tx=0).stop 2024-09-13T17:23:07.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.244+0000 7f5a20092740 1 -- 172.21.15.87:0/3995992036 shutdown_connections 2024-09-13T17:23:07.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.244+0000 7f5a20092740 1 --2- 172.21.15.87:0/3995992036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e548624980 0x55e548626d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.244+0000 7f5a20092740 1 --2- 172.21.15.87:0/3995992036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e54861a0e0 0x55e548624440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.244+0000 7f5a20092740 1 --2- 172.21.15.87:0/3995992036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5486197c0 0x55e548619ba0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.244+0000 7f5a20092740 1 -- 172.21.15.87:0/3995992036 >> 172.21.15.87:0/3995992036 conn(0x55e548615d50 msgr2=0x55e548616130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:07.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.244+0000 7f5a20092740 1 -- 172.21.15.87:0/3995992036 shutdown_connections 2024-09-13T17:23:07.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.244+0000 7f5a20092740 1 -- 172.21.15.87:0/3995992036 wait complete. 2024-09-13T17:23:07.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.245+0000 7f5a20092740 1 -- start start 2024-09-13T17:23:07.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.245+0000 7f5a20092740 1 Processor -- start 2024-09-13T17:23:07.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.245+0000 7f5a20092740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5486197c0 0x55e548624330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.245+0000 7f5a20092740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e54861a0e0 0x55e548621620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.245+0000 7f5a20092740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e548624980 0x55e548621bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.245+0000 7f5a20092740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e54853bf80 con 0x55e5486197c0 2024-09-13T17:23:07.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.245+0000 7f5a20092740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e54853bc20 con 0x55e54861a0e0 2024-09-13T17:23:07.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.245+0000 7f5a20092740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e548508ab0 con 0x55e548624980 2024-09-13T17:23:07.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.245+0000 7f5a20092740 10 client.0 _ll_register_callbacks cb 0x55e548577350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:23:07.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.245+0000 7f5a16ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5486197c0 0x55e548624330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:07.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.245+0000 7f5a16ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5486197c0 0x55e548624330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52174/0 (socket says 172.21.15.87:52174) 2024-09-13T17:23:07.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.245+0000 7f5a16ffd640 1 -- 172.21.15.87:0/3304780348 learned_addr learned my addr 172.21.15.87:0/3304780348 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:07.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.245+0000 7f5a177fe640 1 --2- 172.21.15.87:0/3304780348 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e548624980 0x55e548621bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:07.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.245+0000 7f5a0e7fc640 1 --2- 172.21.15.87:0/3304780348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e54861a0e0 0x55e548621620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:07.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.245+0000 7f5a16ffd640 1 -- 172.21.15.87:0/3304780348 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e548624980 msgr2=0x55e548621bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:07.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.245+0000 7f5a16ffd640 1 --2- 172.21.15.87:0/3304780348 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e548624980 0x55e548621bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.245+0000 7f5a16ffd640 1 -- 172.21.15.87:0/3304780348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e54861a0e0 msgr2=0x55e548621620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:07.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.245+0000 7f5a16ffd640 1 --2- 172.21.15.87:0/3304780348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e54861a0e0 0x55e548621620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.245+0000 7f5a16ffd640 1 -- 172.21.15.87:0/3304780348 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a10008a00 con 0x55e5486197c0 2024-09-13T17:23:07.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.246+0000 7f5a16ffd640 1 --2- 172.21.15.87:0/3304780348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5486197c0 0x55e548624330 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f5a08009900 tx=0x7f5a08005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb7e5f5a7d93079 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:07.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.246+0000 7f59fe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:23:07.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.246+0000 7f59fe7fc640 1 -- 172.21.15.87:0/3304780348 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a08004120 con 0x55e5486197c0 2024-09-13T17:23:07.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.246+0000 7f59fe7fc640 1 -- 172.21.15.87:0/3304780348 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f5a080048c0 con 0x55e5486197c0 2024-09-13T17:23:07.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.246+0000 7f5a20092740 1 -- 172.21.15.87:0/3304780348 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e548271590 con 0x55e5486197c0 2024-09-13T17:23:07.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.246+0000 7f59fe7fc640 1 -- 172.21.15.87:0/3304780348 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a08004ac0 con 0x55e5486197c0 2024-09-13T17:23:07.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.246+0000 7f5a20092740 10 client.18009 fetch_fsmap learned FSMap version 36 2024-09-13T17:23:07.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.246+0000 7f5a20092740 1 -- 172.21.15.87:0/3304780348 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55e54857c360 con 0x55e5486197c0 2024-09-13T17:23:07.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.246+0000 7f59fe7fc640 1 -- 172.21.15.87:0/3304780348 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55e548271590 con 0x55e5486197c0 2024-09-13T17:23:07.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.246+0000 7f59fe7fc640 1 -- 172.21.15.87:0/3304780348 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f5a0803d450 con 0x55e5486197c0 2024-09-13T17:23:07.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.246+0000 7f5a20092740 10 client.18009 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:23:07.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.246+0000 7f5a20092740 10 client.18009 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:23:07.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.246+0000 7f5a20092740 20 client.18009 populate_metadata read hostname 'smithi087' 2024-09-13T17:23:07.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.246+0000 7f5a20092740 1 --2- 172.21.15.87:0/3304780348 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55e548634650 0x55e548636a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.246+0000 7f5a20092740 4 client.18009 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:23:07.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.246+0000 7f5a20092740 1 -- 172.21.15.87:0/3304780348 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e548282860 con 0x55e548634650 2024-09-13T17:23:07.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.247+0000 7f5a0e7fc640 1 --2- 172.21.15.87:0/3304780348 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55e548634650 0x55e548636a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:07.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.247+0000 7f59fe7fc640 10 client.18009 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:23:07.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.247+0000 7f5a0e7fc640 1 --2- 172.21.15.87:0/3304780348 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55e548634650 0x55e548636a40 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49fd79469855745f server_cookie=dc31627d6bb02321 in_seq=0 out_seq=0 2024-09-13T17:23:07.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.248+0000 7f59fe7fc640 1 -- 172.21.15.87:0/3304780348 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55e548282860 con 0x55e548634650 2024-09-13T17:23:07.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.248+0000 7f59fe7fc640 10 client.18009 handle_command_reply: tid=0 2024-09-13T17:23:07.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.248+0000 7f5a20092740 1 client.18009 shutdown 2024-09-13T17:23:07.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.248+0000 7f5a20092740 1 -- 172.21.15.87:0/3304780348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5486197c0 msgr2=0x55e548624330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:07.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.248+0000 7f5a20092740 1 --2- 172.21.15.87:0/3304780348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5486197c0 0x55e548624330 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f5a08009900 tx=0x7f5a08005270 comp rx=0 tx=0).stop 2024-09-13T17:23:07.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.248+0000 7f5a20092740 1 -- 172.21.15.87:0/3304780348 shutdown_connections 2024-09-13T17:23:07.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.248+0000 7f5a20092740 1 --2- 172.21.15.87:0/3304780348 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55e548634650 0x55e548636a40 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.248+0000 7f5a20092740 1 --2- 172.21.15.87:0/3304780348 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e548624980 0x55e548621bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.248+0000 7f59fe7fc640 0 client.18009 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:23:07.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.248+0000 7f5a20092740 1 --2- 172.21.15.87:0/3304780348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e54861a0e0 0x55e548621620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.248+0000 7f5a20092740 1 --2- 172.21.15.87:0/3304780348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5486197c0 0x55e548624330 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.248+0000 7f5a20092740 1 -- 172.21.15.87:0/3304780348 >> 172.21.15.87:0/3304780348 conn(0x55e548615d50 msgr2=0x55e54861b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:07.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.248+0000 7f5a20092740 1 -- 172.21.15.87:0/3304780348 shutdown_connections 2024-09-13T17:23:07.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.248+0000 7f5a20092740 1 -- 172.21.15.87:0/3304780348 wait complete. 2024-09-13T17:23:07.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.248+0000 7f5a20092740 20 client.18009 trim_cache size 0 max 16384 2024-09-13T17:23:07.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.262+0000 7f5a20092740 1 Processor -- start 2024-09-13T17:23:07.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.262+0000 7f5a20092740 1 -- start start 2024-09-13T17:23:07.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.262+0000 7f5a20092740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e5486197c0 0x55e54862b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.262+0000 7f5a20092740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e54861a0e0 0x55e54862bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.262+0000 7f5a20092740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e548624980 0x55e54861fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.262+0000 7f5a20092740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e548618fd0 con 0x55e54861a0e0 2024-09-13T17:23:07.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.262+0000 7f5a20092740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e54863bc50 con 0x55e5486197c0 2024-09-13T17:23:07.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.262+0000 7f5a20092740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5486116e0 con 0x55e548624980 2024-09-13T17:23:07.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.262+0000 7f5a0e7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e54861a0e0 0x55e54862bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:07.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.263+0000 7f5a0e7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e54861a0e0 0x55e54862bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52188/0 (socket says 172.21.15.87:52188) 2024-09-13T17:23:07.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.263+0000 7f5a0e7fc640 1 -- 172.21.15.87:0/789281995 learned_addr learned my addr 172.21.15.87:0/789281995 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:07.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.263+0000 7f5a177fe640 1 --2- 172.21.15.87:0/789281995 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e548624980 0x55e54861fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:07.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.263+0000 7f5a0e7fc640 1 -- 172.21.15.87:0/789281995 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e548624980 msgr2=0x55e54861fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:07.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.263+0000 7f5a0e7fc640 1 --2- 172.21.15.87:0/789281995 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e548624980 0x55e54861fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.263+0000 7f5a0e7fc640 1 -- 172.21.15.87:0/789281995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e5486197c0 msgr2=0x55e54862b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:07.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.263+0000 7f5a16ffd640 1 --2- 172.21.15.87:0/789281995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e5486197c0 0x55e54862b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:07.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.263+0000 7f5a0e7fc640 1 --2- 172.21.15.87:0/789281995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e5486197c0 0x55e54862b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.263+0000 7f5a0e7fc640 1 -- 172.21.15.87:0/789281995 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e54851e1c0 con 0x55e54861a0e0 2024-09-13T17:23:07.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.263+0000 7f5a177fe640 1 --2- 172.21.15.87:0/789281995 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e548624980 0x55e54861fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:23:07.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.263+0000 7f5a0e7fc640 1 --2- 172.21.15.87:0/789281995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e54861a0e0 0x55e54862bb90 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f5a00009610 tx=0x7f5a000cf020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd34e67f4340aea0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:07.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.263+0000 7f5a0dffb640 1 -- 172.21.15.87:0/789281995 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a000991b0 con 0x55e54861a0e0 2024-09-13T17:23:07.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.263+0000 7f5a0dffb640 1 -- 172.21.15.87:0/789281995 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5a00099f50 con 0x55e54861a0e0 2024-09-13T17:23:07.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.263+0000 7f5a0dffb640 1 -- 172.21.15.87:0/789281995 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a00095f60 con 0x55e54861a0e0 2024-09-13T17:23:07.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.264+0000 7f5a20092740 1 -- 172.21.15.87:0/789281995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e54861a0e0 msgr2=0x55e54862bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:07.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.264+0000 7f5a20092740 1 --2- 172.21.15.87:0/789281995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e54861a0e0 0x55e54862bb90 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f5a00009610 tx=0x7f5a000cf020 comp rx=0 tx=0).stop 2024-09-13T17:23:07.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.264+0000 7f5a20092740 1 -- 172.21.15.87:0/789281995 shutdown_connections 2024-09-13T17:23:07.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.264+0000 7f5a20092740 1 --2- 172.21.15.87:0/789281995 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e548624980 0x55e54861fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.264+0000 7f5a20092740 1 --2- 172.21.15.87:0/789281995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e54861a0e0 0x55e54862bb90 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.264+0000 7f5a20092740 1 --2- 172.21.15.87:0/789281995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e5486197c0 0x55e54862b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.264+0000 7f5a20092740 1 -- 172.21.15.87:0/789281995 >> 172.21.15.87:0/789281995 conn(0x55e548615d50 msgr2=0x55e54861c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:07.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.264+0000 7f5a20092740 1 -- 172.21.15.87:0/789281995 shutdown_connections 2024-09-13T17:23:07.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.264+0000 7f5a20092740 1 -- 172.21.15.87:0/789281995 wait complete. 2024-09-13T17:23:07.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.264+0000 7f5a20092740 1 -- start start 2024-09-13T17:23:07.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.264+0000 7f5a20092740 1 Processor -- start 2024-09-13T17:23:07.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.264+0000 7f5a20092740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5486197c0 0x55e54862a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.264+0000 7f5a20092740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e54861a0e0 0x55e54862a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.264+0000 7f5a20092740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e548624980 0x55e54862abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.265+0000 7f5a20092740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e54868ab30 con 0x55e5486197c0 2024-09-13T17:23:07.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.265+0000 7f5a20092740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e54868ac70 con 0x55e548624980 2024-09-13T17:23:07.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.265+0000 7f5a20092740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e54868adb0 con 0x55e54861a0e0 2024-09-13T17:23:07.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.265+0000 7f5a20092740 10 client.0 _ll_register_callbacks cb 0x7f5a08004450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:23:07.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.265+0000 7f5a16ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5486197c0 0x55e54862a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:07.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.265+0000 7f5a16ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5486197c0 0x55e54862a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52190/0 (socket says 172.21.15.87:52190) 2024-09-13T17:23:07.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.265+0000 7f5a16ffd640 1 -- 172.21.15.87:0/2865313786 learned_addr learned my addr 172.21.15.87:0/2865313786 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:07.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.265+0000 7f5a16ffd640 1 -- 172.21.15.87:0/2865313786 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e54861a0e0 msgr2=0x55e54862a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:07.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.265+0000 7f5a16ffd640 1 --2- 172.21.15.87:0/2865313786 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e54861a0e0 0x55e54862a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.265+0000 7f5a16ffd640 1 -- 172.21.15.87:0/2865313786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e548624980 msgr2=0x55e54862abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:07.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.265+0000 7f5a16ffd640 1 --2- 172.21.15.87:0/2865313786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e548624980 0x55e54862abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.265+0000 7f5a16ffd640 1 -- 172.21.15.87:0/2865313786 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a181a5110 con 0x55e5486197c0 2024-09-13T17:23:07.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.265+0000 7f5a16ffd640 1 --2- 172.21.15.87:0/2865313786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5486197c0 0x55e54862a140 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f5a0802a9a0 tx=0x7f5a080056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6be9a593c16e0f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:07.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.265+0000 7f59fe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:23:07.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.265+0000 7f59fe7fc640 1 -- 172.21.15.87:0/2865313786 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0803b7e0 con 0x55e5486197c0 2024-09-13T17:23:07.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.265+0000 7f59fe7fc640 1 -- 172.21.15.87:0/2865313786 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f5a08000e40 con 0x55e5486197c0 2024-09-13T17:23:07.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.265+0000 7f5a20092740 1 -- 172.21.15.87:0/2865313786 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5a1001ad90 con 0x55e5486197c0 2024-09-13T17:23:07.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.265+0000 7f59fe7fc640 1 -- 172.21.15.87:0/2865313786 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a0803da80 con 0x55e5486197c0 2024-09-13T17:23:07.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.265+0000 7f5a20092740 10 client.18015 fetch_fsmap learned FSMap version 36 2024-09-13T17:23:07.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.265+0000 7f5a20092740 1 -- 172.21.15.87:0/2865313786 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55e548543990 con 0x55e5486197c0 2024-09-13T17:23:07.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.265+0000 7f59fe7fc640 1 -- 172.21.15.87:0/2865313786 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5a1001ad90 con 0x55e5486197c0 2024-09-13T17:23:07.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.266+0000 7f59fe7fc640 1 -- 172.21.15.87:0/2865313786 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f5a08004b80 con 0x55e5486197c0 2024-09-13T17:23:07.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.266+0000 7f5a20092740 10 client.18015 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:23:07.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.266+0000 7f5a20092740 10 client.18015 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:23:07.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.266+0000 7f5a20092740 20 client.18015 populate_metadata read hostname 'smithi087' 2024-09-13T17:23:07.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.266+0000 7f5a20092740 1 --2- 172.21.15.87:0/2865313786 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55e54868c2c0 0x55e54868e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.266+0000 7f5a20092740 4 client.18015 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-13T17:23:07.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.266+0000 7f5a20092740 1 -- 172.21.15.87:0/2865313786 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55e5482d5eb0 con 0x55e54868c2c0 2024-09-13T17:23:07.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.266+0000 7f5a0e7fc640 1 --2- 172.21.15.87:0/2865313786 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55e54868c2c0 0x55e54868e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:07.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.266+0000 7f59fe7fc640 10 client.18015 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:23:07.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.266+0000 7f5a0e7fc640 1 --2- 172.21.15.87:0/2865313786 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55e54868c2c0 0x55e54868e6e0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93af6d77f5bc6fb8 server_cookie=55b6b071431a73d4 in_seq=0 out_seq=0 2024-09-13T17:23:07.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.267+0000 7f59fe7fc640 1 -- 172.21.15.87:0/2865313786 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55e5482d5eb0 con 0x55e54868c2c0 2024-09-13T17:23:07.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.267+0000 7f59fe7fc640 10 client.18015 handle_command_reply: tid=0 2024-09-13T17:23:07.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.267+0000 7f5a20092740 1 client.18015 shutdown 2024-09-13T17:23:07.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.267+0000 7f5a20092740 1 -- 172.21.15.87:0/2865313786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5486197c0 msgr2=0x55e54862a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:07.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.267+0000 7f5a20092740 1 --2- 172.21.15.87:0/2865313786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5486197c0 0x55e54862a140 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f5a0802a9a0 tx=0x7f5a080056e0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.268+0000 7f5a20092740 1 -- 172.21.15.87:0/2865313786 shutdown_connections 2024-09-13T17:23:07.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.268+0000 7f5a20092740 1 --2- 172.21.15.87:0/2865313786 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55e54868c2c0 0x55e54868e6e0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.268+0000 7f5a20092740 1 --2- 172.21.15.87:0/2865313786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e548624980 0x55e54862abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.268+0000 7f5a20092740 1 --2- 172.21.15.87:0/2865313786 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e54861a0e0 0x55e54862a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.268+0000 7f5a20092740 1 --2- 172.21.15.87:0/2865313786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e5486197c0 0x55e54862a140 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.268+0000 7f5a20092740 1 -- 172.21.15.87:0/2865313786 >> 172.21.15.87:0/2865313786 conn(0x55e548615d50 msgr2=0x55e54861fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:07.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.268+0000 7f59fe7fc640 0 client.18015 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:23:07.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.268+0000 7f5a20092740 1 -- 172.21.15.87:0/2865313786 shutdown_connections 2024-09-13T17:23:07.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.268+0000 7f5a20092740 1 -- 172.21.15.87:0/2865313786 wait complete. 2024-09-13T17:23:07.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.268+0000 7f5a20092740 20 client.18015 trim_cache size 0 max 16384 2024-09-13T17:23:07.275 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:23:07.276 INFO:teuthology.orchestra.run.smithi087.stdout: "return_code": 0, 2024-09-13T17:23:07.276 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_tag": "ef54272a-51a1-42d0-958b-956f9cee720a", 2024-09-13T17:23:07.276 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": "asynchronous" 2024-09-13T17:23:07.276 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:23:07.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.268+0000 7f5a1d365640 1 -- 172.21.15.87:0/1669273204 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5a040a1280 msgr2=0x7f5a040a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:07.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.268+0000 7f5a1d365640 1 --2- 172.21.15.87:0/1669273204 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5a040a1280 0x7f5a040a3740 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5a1001e000 tx=0x7f5a1001f000 comp rx=0 tx=0).stop 2024-09-13T17:23:07.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.268+0000 7f5a1d365640 1 -- 172.21.15.87:0/1669273204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a18101860 msgr2=0x7f5a180ff0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:07.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.268+0000 7f5a1d365640 1 --2- 172.21.15.87:0/1669273204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a18101860 0x7f5a180ff0d0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f5a0000d950 tx=0x7f5a0000de10 comp rx=0 tx=0).stop 2024-09-13T17:23:07.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.268+0000 7f5a1d365640 1 -- 172.21.15.87:0/1669273204 shutdown_connections 2024-09-13T17:23:07.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.268+0000 7f5a1d365640 1 --2- 172.21.15.87:0/1669273204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a1810a310 0x7f5a180ff610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.268+0000 7f5a1d365640 1 --2- 172.21.15.87:0/1669273204 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5a040a1280 0x7f5a040a3740 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.268+0000 7f5a1d365640 1 --2- 172.21.15.87:0/1669273204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a18101860 0x7f5a180ff0d0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.268+0000 7f5a1d365640 1 --2- 172.21.15.87:0/1669273204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a18100f40 0x7f5a180feb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.268+0000 7f5a1d365640 1 -- 172.21.15.87:0/1669273204 >> 172.21.15.87:0/1669273204 conn(0x7f5a18075c60 msgr2=0x7f5a180fb530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:07.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.268+0000 7f5a1d365640 1 -- 172.21.15.87:0/1669273204 shutdown_connections 2024-09-13T17:23:07.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.269+0000 7f5a1d365640 1 -- 172.21.15.87:0/1669273204 wait complete. 2024-09-13T17:23:07.281 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:23:07.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:06 smithi149 ceph-mon[35496]: pgmap v287: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-09-13T17:23:07.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:06 smithi118 ceph-mon[34374]: pgmap v287: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-09-13T17:23:07.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.383+0000 7f3d46232640 1 -- 172.21.15.87:0/3310005728 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d4010a310 msgr2=0x7f3d4010c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:07.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.383+0000 7f3d46232640 1 --2- 172.21.15.87:0/3310005728 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d4010a310 0x7f3d4010c790 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f3d38009ca0 tx=0x7f3d3802a950 comp rx=0 tx=0).stop 2024-09-13T17:23:07.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.383+0000 7f3d46232640 1 -- 172.21.15.87:0/3310005728 shutdown_connections 2024-09-13T17:23:07.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.383+0000 7f3d46232640 1 --2- 172.21.15.87:0/3310005728 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d4010a310 0x7f3d4010c790 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.383+0000 7f3d46232640 1 --2- 172.21.15.87:0/3310005728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d40101860 0x7f3d40109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.383+0000 7f3d46232640 1 --2- 172.21.15.87:0/3310005728 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d40100f40 0x7f3d40101320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.383+0000 7f3d46232640 1 -- 172.21.15.87:0/3310005728 >> 172.21.15.87:0/3310005728 conn(0x7f3d40075c60 msgr2=0x7f3d400fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:07.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.383+0000 7f3d46232640 1 -- 172.21.15.87:0/3310005728 shutdown_connections 2024-09-13T17:23:07.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.383+0000 7f3d46232640 1 -- 172.21.15.87:0/3310005728 wait complete. 2024-09-13T17:23:07.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.383+0000 7f3d46232640 1 Processor -- start 2024-09-13T17:23:07.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.383+0000 7f3d46232640 1 -- start start 2024-09-13T17:23:07.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.384+0000 7f3d46232640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d40100f40 0x7f3d40196230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.384+0000 7f3d46232640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d40101860 0x7f3d40196770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.384+0000 7f3d46232640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d4010a310 0x7f3d4019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.384+0000 7f3d46232640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4019b160 con 0x7f3d40101860 2024-09-13T17:23:07.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.384+0000 7f3d46232640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4019b2d0 con 0x7f3d4010a310 2024-09-13T17:23:07.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.384+0000 7f3d46232640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4019b490 con 0x7f3d40100f40 2024-09-13T17:23:07.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.384+0000 7f3d37fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d40101860 0x7f3d40196770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:07.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.384+0000 7f3d37fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d40101860 0x7f3d40196770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52196/0 (socket says 172.21.15.87:52196) 2024-09-13T17:23:07.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.384+0000 7f3d37fff640 1 -- 172.21.15.87:0/3281361331 learned_addr learned my addr 172.21.15.87:0/3281361331 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:07.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.384+0000 7f3d3f7fe640 1 --2- 172.21.15.87:0/3281361331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d40100f40 0x7f3d40196230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:07.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.384+0000 7f3d3ffff640 1 --2- 172.21.15.87:0/3281361331 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d4010a310 0x7f3d4019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:07.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.384+0000 7f3d37fff640 1 -- 172.21.15.87:0/3281361331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d40100f40 msgr2=0x7f3d40196230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:07.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.384+0000 7f3d37fff640 1 --2- 172.21.15.87:0/3281361331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d40100f40 0x7f3d40196230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.384+0000 7f3d37fff640 1 -- 172.21.15.87:0/3281361331 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d4010a310 msgr2=0x7f3d4019ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:07.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.384+0000 7f3d37fff640 1 --2- 172.21.15.87:0/3281361331 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d4010a310 0x7f3d4019ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.384+0000 7f3d37fff640 1 -- 172.21.15.87:0/3281361331 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d38009900 con 0x7f3d40101860 2024-09-13T17:23:07.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.384+0000 7f3d37fff640 1 --2- 172.21.15.87:0/3281361331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d40101860 0x7f3d40196770 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f3d2800d950 tx=0x7f3d2800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:07.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.384+0000 7f3d3d7fa640 1 -- 172.21.15.87:0/3281361331 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d28009c30 con 0x7f3d40101860 2024-09-13T17:23:07.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.384+0000 7f3d3d7fa640 1 -- 172.21.15.87:0/3281361331 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3d28009d90 con 0x7f3d40101860 2024-09-13T17:23:07.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.384+0000 7f3d46232640 1 -- 172.21.15.87:0/3281361331 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d4019b770 con 0x7f3d40101860 2024-09-13T17:23:07.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.384+0000 7f3d3d7fa640 1 -- 172.21.15.87:0/3281361331 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2800f6b0 con 0x7f3d40101860 2024-09-13T17:23:07.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.384+0000 7f3d46232640 1 -- 172.21.15.87:0/3281361331 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d401a2ff0 con 0x7f3d40101860 2024-09-13T17:23:07.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.386+0000 7f3d3d7fa640 1 -- 172.21.15.87:0/3281361331 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f3d28010aa0 con 0x7f3d40101860 2024-09-13T17:23:07.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.387+0000 7f3d4902f740 1 Processor -- start 2024-09-13T17:23:07.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.387+0000 7f3d4902f740 1 -- start start 2024-09-13T17:23:07.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.387+0000 7f3d4902f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f6d030e10 0x556f6d0311f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.387+0000 7f3d4902f740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556f6d031730 0x556f6d03ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.387+0000 7f3d4902f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556f6d03bfd0 0x556f6d03e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.387+0000 7f3d4902f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f6cf9bf20 con 0x556f6d03bfd0 2024-09-13T17:23:07.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.387+0000 7f3d4902f740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f6cf996b0 con 0x556f6d031730 2024-09-13T17:23:07.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.387+0000 7f3d4902f740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f6cf94fa0 con 0x556f6d030e10 2024-09-13T17:23:07.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.387+0000 7f3d3d7fa640 1 --2- 172.21.15.87:0/3281361331 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f3d2c0a1280 0x7f3d2c0a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.387+0000 7f3d37fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556f6d03bfd0 0x556f6d03e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:07.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.387+0000 7f3d37fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556f6d03bfd0 0x556f6d03e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52200/0 (socket says 172.21.15.87:52200) 2024-09-13T17:23:07.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.387+0000 7f3d37fff640 1 -- 172.21.15.87:0/2898804549 learned_addr learned my addr 172.21.15.87:0/2898804549 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:07.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.387+0000 7f3d3f7fe640 1 --2- 172.21.15.87:0/2898804549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556f6d031730 0x556f6d03ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:07.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.387+0000 7f3d3ffff640 1 --2- 172.21.15.87:0/3281361331 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f3d2c0a1280 0x7f3d2c0a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:07.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.387+0000 7f3d3ffff640 1 --2- 172.21.15.87:0/2898804549 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f6d030e10 0x556f6d0311f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:07.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.387+0000 7f3d3d7fa640 1 -- 172.21.15.87:0/3281361331 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f3d280cccb0 con 0x7f3d40101860 2024-09-13T17:23:07.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.388+0000 7f3d37fff640 1 -- 172.21.15.87:0/2898804549 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f6d030e10 msgr2=0x556f6d0311f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:07.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.388+0000 7f3d37fff640 1 --2- 172.21.15.87:0/2898804549 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f6d030e10 0x556f6d0311f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.388+0000 7f3d37fff640 1 -- 172.21.15.87:0/2898804549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556f6d031730 msgr2=0x556f6d03ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:07.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.388+0000 7f3d37fff640 1 --2- 172.21.15.87:0/2898804549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556f6d031730 0x556f6d03ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.388+0000 7f3d37fff640 1 -- 172.21.15.87:0/2898804549 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f6cf4f840 con 0x556f6d03bfd0 2024-09-13T17:23:07.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.388+0000 7f3d3ffff640 1 --2- 172.21.15.87:0/2898804549 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f6d030e10 0x556f6d0311f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:23:07.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.388+0000 7f3d37fff640 1 --2- 172.21.15.87:0/2898804549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556f6d03bfd0 0x556f6d03e3c0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f3d28095eb0 tx=0x7f3d28000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37430cd348f2ab9f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:07.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.388+0000 7f3d3ffff640 1 --2- 172.21.15.87:0/3281361331 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f3d2c0a1280 0x7f3d2c0a3740 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3d38004af0 tx=0x7f3d38004a40 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:07.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.388+0000 7f3d35ffb640 1 -- 172.21.15.87:0/2898804549 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2809a0b0 con 0x556f6d03bfd0 2024-09-13T17:23:07.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.388+0000 7f3d35ffb640 1 -- 172.21.15.87:0/2898804549 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3d280999b0 con 0x556f6d03bfd0 2024-09-13T17:23:07.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.388+0000 7f3d35ffb640 1 -- 172.21.15.87:0/2898804549 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d280a4480 con 0x556f6d03bfd0 2024-09-13T17:23:07.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.388+0000 7f3d4902f740 1 -- 172.21.15.87:0/2898804549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556f6d03bfd0 msgr2=0x556f6d03e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:07.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.388+0000 7f3d4902f740 1 --2- 172.21.15.87:0/2898804549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556f6d03bfd0 0x556f6d03e3c0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f3d28095eb0 tx=0x7f3d28000bc0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.389+0000 7f3d4902f740 1 -- 172.21.15.87:0/2898804549 shutdown_connections 2024-09-13T17:23:07.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.389+0000 7f3d4902f740 1 --2- 172.21.15.87:0/2898804549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556f6d03bfd0 0x556f6d03e3c0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.389+0000 7f3d4902f740 1 --2- 172.21.15.87:0/2898804549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556f6d031730 0x556f6d03ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.389+0000 7f3d4902f740 1 --2- 172.21.15.87:0/2898804549 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f6d030e10 0x556f6d0311f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.389+0000 7f3d4902f740 1 -- 172.21.15.87:0/2898804549 >> 172.21.15.87:0/2898804549 conn(0x556f6d02d380 msgr2=0x556f6d02d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:07.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.389+0000 7f3d4902f740 1 -- 172.21.15.87:0/2898804549 shutdown_connections 2024-09-13T17:23:07.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.389+0000 7f3d4902f740 1 -- 172.21.15.87:0/2898804549 wait complete. 2024-09-13T17:23:07.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.389+0000 7f3d4902f740 1 -- start start 2024-09-13T17:23:07.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.389+0000 7f3d4902f740 1 Processor -- start 2024-09-13T17:23:07.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.389+0000 7f3d4902f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556f6d030e10 0x556f6d03b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.389+0000 7f3d4902f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f6d031730 0x556f6d038be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.389+0000 7f3d4902f740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556f6d03bfd0 0x556f6d039140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.389+0000 7f3d4902f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f6cf362a0 con 0x556f6d030e10 2024-09-13T17:23:07.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.389+0000 7f3d4902f740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f6cc6d430 con 0x556f6d03bfd0 2024-09-13T17:23:07.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.389+0000 7f3d4902f740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f6cf18680 con 0x556f6d031730 2024-09-13T17:23:07.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.389+0000 7f3d4902f740 10 client.0 _ll_register_callbacks cb 0x556f6cf8e610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:23:07.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.389+0000 7f3d3f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556f6d030e10 0x556f6d03b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:07.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.390+0000 7f3d3f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556f6d030e10 0x556f6d03b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52216/0 (socket says 172.21.15.87:52216) 2024-09-13T17:23:07.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.390+0000 7f3d3f7fe640 1 -- 172.21.15.87:0/3637710720 learned_addr learned my addr 172.21.15.87:0/3637710720 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:07.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.390+0000 7f3d37fff640 1 --2- 172.21.15.87:0/3637710720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f6d031730 0x556f6d038be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:07.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.390+0000 7f3d3f7fe640 1 -- 172.21.15.87:0/3637710720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f6d031730 msgr2=0x556f6d038be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:07.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.390+0000 7f3d3f7fe640 1 --2- 172.21.15.87:0/3637710720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f6d031730 0x556f6d038be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.390+0000 7f3d3f7fe640 1 -- 172.21.15.87:0/3637710720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556f6d03bfd0 msgr2=0x556f6d039140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:07.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.390+0000 7f3d3ffff640 1 --2- 172.21.15.87:0/3637710720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556f6d03bfd0 0x556f6d039140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:07.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.390+0000 7f3d3f7fe640 1 --2- 172.21.15.87:0/3637710720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556f6d03bfd0 0x556f6d039140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.390+0000 7f3d3f7fe640 1 -- 172.21.15.87:0/3637710720 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d401a2ff0 con 0x556f6d030e10 2024-09-13T17:23:07.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.390+0000 7f3d37fff640 1 --2- 172.21.15.87:0/3637710720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f6d031730 0x556f6d038be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:23:07.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.390+0000 7f3d3f7fe640 1 --2- 172.21.15.87:0/3637710720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556f6d030e10 0x556f6d03b940 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f3d3000bad0 tx=0x7f3d3000bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f5c585591e64f27 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:07.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.390+0000 7f3d1effd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:23:07.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.390+0000 7f3d1effd640 1 -- 172.21.15.87:0/3637710720 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d30016070 con 0x556f6d030e10 2024-09-13T17:23:07.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.390+0000 7f3d1effd640 1 -- 172.21.15.87:0/3637710720 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f3d30003e00 con 0x556f6d030e10 2024-09-13T17:23:07.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.390+0000 7f3d4902f740 1 -- 172.21.15.87:0/3637710720 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556f6cc884e0 con 0x556f6d030e10 2024-09-13T17:23:07.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.390+0000 7f3d1effd640 1 -- 172.21.15.87:0/3637710720 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d30005020 con 0x556f6d030e10 2024-09-13T17:23:07.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.390+0000 7f3d4902f740 10 client.18027 fetch_fsmap learned FSMap version 36 2024-09-13T17:23:07.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.390+0000 7f3d4902f740 1 -- 172.21.15.87:0/3637710720 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x556f6cf93620 con 0x556f6d030e10 2024-09-13T17:23:07.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.390+0000 7f3d1effd640 1 -- 172.21.15.87:0/3637710720 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x556f6cc884e0 con 0x556f6d030e10 2024-09-13T17:23:07.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.391+0000 7f3d1effd640 1 -- 172.21.15.87:0/3637710720 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f3d3001b470 con 0x556f6d030e10 2024-09-13T17:23:07.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.391+0000 7f3d4902f740 10 client.18027 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:23:07.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.391+0000 7f3d4902f740 10 client.18027 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:23:07.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.391+0000 7f3d4902f740 20 client.18027 populate_metadata read hostname 'smithi087' 2024-09-13T17:23:07.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.391+0000 7f3d4902f740 1 --2- 172.21.15.87:0/3637710720 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x556f6d04bde0 0x556f6d04e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.391+0000 7f3d4902f740 4 client.18027 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:23:07.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.391+0000 7f3d4902f740 1 -- 172.21.15.87:0/3637710720 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556f6cc997e0 con 0x556f6d04bde0 2024-09-13T17:23:07.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.391+0000 7f3d37fff640 1 --2- 172.21.15.87:0/3637710720 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x556f6d04bde0 0x556f6d04e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:07.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.391+0000 7f3d1effd640 10 client.18027 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:23:07.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.391+0000 7f3d37fff640 1 --2- 172.21.15.87:0/3637710720 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x556f6d04bde0 0x556f6d04e200 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=256011eaf6f325d server_cookie=59bdaf2b01790614 in_seq=0 out_seq=0 2024-09-13T17:23:07.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.392+0000 7f3d1effd640 1 -- 172.21.15.87:0/3637710720 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x556f6cc997e0 con 0x556f6d04bde0 2024-09-13T17:23:07.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.392+0000 7f3d1effd640 10 client.18027 handle_command_reply: tid=0 2024-09-13T17:23:07.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.392+0000 7f3d4902f740 1 client.18027 shutdown 2024-09-13T17:23:07.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.392+0000 7f3d4902f740 1 -- 172.21.15.87:0/3637710720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556f6d030e10 msgr2=0x556f6d03b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:07.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.392+0000 7f3d4902f740 1 --2- 172.21.15.87:0/3637710720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556f6d030e10 0x556f6d03b940 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f3d3000bad0 tx=0x7f3d3000bf90 comp rx=0 tx=0).stop 2024-09-13T17:23:07.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.392+0000 7f3d4902f740 1 -- 172.21.15.87:0/3637710720 shutdown_connections 2024-09-13T17:23:07.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.392+0000 7f3d4902f740 1 --2- 172.21.15.87:0/3637710720 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x556f6d04bde0 0x556f6d04e200 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.392+0000 7f3d4902f740 1 --2- 172.21.15.87:0/3637710720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556f6d03bfd0 0x556f6d039140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.392+0000 7f3d4902f740 1 --2- 172.21.15.87:0/3637710720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f6d031730 0x556f6d038be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.392+0000 7f3d4902f740 1 --2- 172.21.15.87:0/3637710720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556f6d030e10 0x556f6d03b940 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.392+0000 7f3d4902f740 1 -- 172.21.15.87:0/3637710720 >> 172.21.15.87:0/3637710720 conn(0x556f6d02d380 msgr2=0x556f6d033090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:07.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.392+0000 7f3d1effd640 0 client.18027 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:23:07.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.392+0000 7f3d4902f740 1 -- 172.21.15.87:0/3637710720 shutdown_connections 2024-09-13T17:23:07.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.392+0000 7f3d4902f740 1 -- 172.21.15.87:0/3637710720 wait complete. 2024-09-13T17:23:07.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.392+0000 7f3d4902f740 20 client.18027 trim_cache size 0 max 16384 2024-09-13T17:23:07.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.406+0000 7f3d4902f740 1 Processor -- start 2024-09-13T17:23:07.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.406+0000 7f3d4902f740 1 -- start start 2024-09-13T17:23:07.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.406+0000 7f3d4902f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556f6d030e10 0x556f6d02cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.406+0000 7f3d4902f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f6d031730 0x556f6d052b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.406+0000 7f3d4902f740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556f6d03bfd0 0x556f6d042d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.406+0000 7f3d4902f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f6d0339e0 con 0x556f6d030e10 2024-09-13T17:23:07.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.406+0000 7f3d4902f740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f6d027660 con 0x556f6d03bfd0 2024-09-13T17:23:07.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.406+0000 7f3d4902f740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f6d037110 con 0x556f6d031730 2024-09-13T17:23:07.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.406+0000 7f3d3f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556f6d030e10 0x556f6d02cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:07.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.406+0000 7f3d3f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556f6d030e10 0x556f6d02cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52222/0 (socket says 172.21.15.87:52222) 2024-09-13T17:23:07.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.406+0000 7f3d3f7fe640 1 -- 172.21.15.87:0/2275155397 learned_addr learned my addr 172.21.15.87:0/2275155397 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:07.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.407+0000 7f3d3ffff640 1 --2- 172.21.15.87:0/2275155397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556f6d03bfd0 0x556f6d042d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:07.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.407+0000 7f3d37fff640 1 --2- 172.21.15.87:0/2275155397 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f6d031730 0x556f6d052b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:07.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.407+0000 7f3d3f7fe640 1 -- 172.21.15.87:0/2275155397 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f6d031730 msgr2=0x556f6d052b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:07.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.407+0000 7f3d3f7fe640 1 --2- 172.21.15.87:0/2275155397 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f6d031730 0x556f6d052b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.407+0000 7f3d3f7fe640 1 -- 172.21.15.87:0/2275155397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556f6d03bfd0 msgr2=0x556f6d042d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:07.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.407+0000 7f3d3f7fe640 1 --2- 172.21.15.87:0/2275155397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556f6d03bfd0 0x556f6d042d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.407+0000 7f3d3f7fe640 1 -- 172.21.15.87:0/2275155397 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f6cf35790 con 0x556f6d030e10 2024-09-13T17:23:07.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.407+0000 7f3d37fff640 1 --2- 172.21.15.87:0/2275155397 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f6d031730 0x556f6d052b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:23:07.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.407+0000 7f3d3f7fe640 1 --2- 172.21.15.87:0/2275155397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556f6d030e10 0x556f6d02cd00 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f3d30005cd0 tx=0x7f3d30005d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4748b1e94e0ef811 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:07.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.407+0000 7f3d367fc640 1 -- 172.21.15.87:0/2275155397 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d30016070 con 0x556f6d030e10 2024-09-13T17:23:07.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.407+0000 7f3d367fc640 1 -- 172.21.15.87:0/2275155397 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3d30017040 con 0x556f6d030e10 2024-09-13T17:23:07.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.407+0000 7f3d367fc640 1 -- 172.21.15.87:0/2275155397 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d30028ba0 con 0x556f6d030e10 2024-09-13T17:23:07.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.408+0000 7f3d4902f740 1 -- 172.21.15.87:0/2275155397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556f6d030e10 msgr2=0x556f6d02cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:07.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.408+0000 7f3d4902f740 1 --2- 172.21.15.87:0/2275155397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556f6d030e10 0x556f6d02cd00 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f3d30005cd0 tx=0x7f3d30005d00 comp rx=0 tx=0).stop 2024-09-13T17:23:07.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.408+0000 7f3d4902f740 1 -- 172.21.15.87:0/2275155397 shutdown_connections 2024-09-13T17:23:07.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.408+0000 7f3d4902f740 1 --2- 172.21.15.87:0/2275155397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556f6d03bfd0 0x556f6d042d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.408+0000 7f3d4902f740 1 --2- 172.21.15.87:0/2275155397 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f6d031730 0x556f6d052b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.408+0000 7f3d4902f740 1 --2- 172.21.15.87:0/2275155397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556f6d030e10 0x556f6d02cd00 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.408+0000 7f3d4902f740 1 -- 172.21.15.87:0/2275155397 >> 172.21.15.87:0/2275155397 conn(0x556f6d02d380 msgr2=0x556f6d02d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:07.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.408+0000 7f3d4902f740 1 -- 172.21.15.87:0/2275155397 shutdown_connections 2024-09-13T17:23:07.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.408+0000 7f3d4902f740 1 -- 172.21.15.87:0/2275155397 wait complete. 2024-09-13T17:23:07.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.408+0000 7f3d4902f740 1 -- start start 2024-09-13T17:23:07.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.408+0000 7f3d4902f740 1 Processor -- start 2024-09-13T17:23:07.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.408+0000 7f3d4902f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f6d030e10 0x556f6d040f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.408+0000 7f3d4902f740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556f6d031730 0x556f6d0414d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.408+0000 7f3d4902f740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556f6d03bfd0 0x556f6d0a56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.408+0000 7f3d4902f740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f6d0a5c30 con 0x556f6d031730 2024-09-13T17:23:07.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.408+0000 7f3d4902f740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f6d0a5d70 con 0x556f6d03bfd0 2024-09-13T17:23:07.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.408+0000 7f3d4902f740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f6d0a5f30 con 0x556f6d030e10 2024-09-13T17:23:07.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.408+0000 7f3d4902f740 10 client.0 _ll_register_callbacks cb 0x7f3d30004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:23:07.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.408+0000 7f3d37fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556f6d031730 0x556f6d0414d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:07.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.409+0000 7f3d37fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556f6d031730 0x556f6d0414d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52232/0 (socket says 172.21.15.87:52232) 2024-09-13T17:23:07.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.409+0000 7f3d37fff640 1 -- 172.21.15.87:0/2754669817 learned_addr learned my addr 172.21.15.87:0/2754669817 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:07.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.409+0000 7f3d3ffff640 1 --2- 172.21.15.87:0/2754669817 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556f6d03bfd0 0x556f6d0a56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:07.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.409+0000 7f3d3f7fe640 1 --2- 172.21.15.87:0/2754669817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f6d030e10 0x556f6d040f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:07.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.409+0000 7f3d37fff640 1 -- 172.21.15.87:0/2754669817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f6d030e10 msgr2=0x556f6d040f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:07.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.409+0000 7f3d37fff640 1 --2- 172.21.15.87:0/2754669817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f6d030e10 0x556f6d040f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.409+0000 7f3d37fff640 1 -- 172.21.15.87:0/2754669817 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556f6d03bfd0 msgr2=0x556f6d0a56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:07.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.409+0000 7f3d37fff640 1 --2- 172.21.15.87:0/2754669817 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556f6d03bfd0 0x556f6d0a56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.409+0000 7f3d37fff640 1 -- 172.21.15.87:0/2754669817 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556f6cf93620 con 0x556f6d031730 2024-09-13T17:23:07.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.409+0000 7f3d37fff640 1 --2- 172.21.15.87:0/2754669817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556f6d031730 0x556f6d0414d0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f3d28005fd0 tx=0x7f3d2800bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb6236776c45b271 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:07.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.409+0000 7f3d1effd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:23:07.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.409+0000 7f3d1effd640 1 -- 172.21.15.87:0/2754669817 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2809d7e0 con 0x556f6d031730 2024-09-13T17:23:07.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.409+0000 7f3d1effd640 1 -- 172.21.15.87:0/2754669817 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f3d280960c0 con 0x556f6d031730 2024-09-13T17:23:07.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.409+0000 7f3d4902f740 1 -- 172.21.15.87:0/2754669817 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3d280999b0 con 0x556f6d031730 2024-09-13T17:23:07.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.409+0000 7f3d1effd640 1 -- 172.21.15.87:0/2754669817 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d28096280 con 0x556f6d031730 2024-09-13T17:23:07.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.409+0000 7f3d4902f740 10 client.18033 fetch_fsmap learned FSMap version 36 2024-09-13T17:23:07.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.409+0000 7f3d4902f740 1 -- 172.21.15.87:0/2754669817 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x556f6cf5aea0 con 0x556f6d031730 2024-09-13T17:23:07.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.409+0000 7f3d1effd640 1 -- 172.21.15.87:0/2754669817 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3d280999b0 con 0x556f6d031730 2024-09-13T17:23:07.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.409+0000 7f3d1effd640 1 -- 172.21.15.87:0/2754669817 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f3d28099c10 con 0x556f6d031730 2024-09-13T17:23:07.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.409+0000 7f3d4902f740 10 client.18033 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:23:07.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.409+0000 7f3d4902f740 10 client.18033 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:23:07.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.409+0000 7f3d4902f740 20 client.18033 populate_metadata read hostname 'smithi087' 2024-09-13T17:23:07.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.409+0000 7f3d4902f740 1 --2- 172.21.15.87:0/2754669817 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x556f6d0a7240 0x556f6d0a9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:07.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.409+0000 7f3d4902f740 4 client.18033 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:23:07.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.409+0000 7f3d4902f740 1 -- 172.21.15.87:0/2754669817 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556f6ccece30 con 0x556f6d0a7240 2024-09-13T17:23:07.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.410+0000 7f3d3f7fe640 1 --2- 172.21.15.87:0/2754669817 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x556f6d0a7240 0x556f6d0a9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:07.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.410+0000 7f3d3f7fe640 1 --2- 172.21.15.87:0/2754669817 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x556f6d0a7240 0x556f6d0a9630 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90283d3e42fe22d server_cookie=2075c2e5a4c66b6f in_seq=0 out_seq=0 2024-09-13T17:23:07.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.410+0000 7f3d1effd640 10 client.18033 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:23:07.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.410+0000 7f3d1effd640 1 -- 172.21.15.87:0/2754669817 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x556f6ccece30 con 0x556f6d0a7240 2024-09-13T17:23:07.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.410+0000 7f3d1effd640 10 client.18033 handle_command_reply: tid=0 2024-09-13T17:23:07.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.410+0000 7f3d4902f740 1 client.18033 shutdown 2024-09-13T17:23:07.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.410+0000 7f3d4902f740 1 -- 172.21.15.87:0/2754669817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556f6d031730 msgr2=0x556f6d0414d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:07.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.410+0000 7f3d4902f740 1 --2- 172.21.15.87:0/2754669817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556f6d031730 0x556f6d0414d0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f3d28005fd0 tx=0x7f3d2800bf60 comp rx=0 tx=0).stop 2024-09-13T17:23:07.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.410+0000 7f3d4902f740 1 -- 172.21.15.87:0/2754669817 shutdown_connections 2024-09-13T17:23:07.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.410+0000 7f3d4902f740 1 --2- 172.21.15.87:0/2754669817 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x556f6d0a7240 0x556f6d0a9630 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.410+0000 7f3d4902f740 1 --2- 172.21.15.87:0/2754669817 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556f6d03bfd0 0x556f6d0a56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.410+0000 7f3d1effd640 0 client.18033 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:23:07.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.410+0000 7f3d4902f740 1 --2- 172.21.15.87:0/2754669817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556f6d031730 0x556f6d0414d0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.410+0000 7f3d4902f740 1 --2- 172.21.15.87:0/2754669817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f6d030e10 0x556f6d040f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.410+0000 7f3d4902f740 1 -- 172.21.15.87:0/2754669817 >> 172.21.15.87:0/2754669817 conn(0x556f6d02d380 msgr2=0x556f6d02d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:07.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.410+0000 7f3d4902f740 1 -- 172.21.15.87:0/2754669817 shutdown_connections 2024-09-13T17:23:07.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.411+0000 7f3d4902f740 1 -- 172.21.15.87:0/2754669817 wait complete. 2024-09-13T17:23:07.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.411+0000 7f3d4902f740 20 client.18033 trim_cache size 0 max 16384 2024-09-13T17:23:07.419 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:23:07.420 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-13T17:23:07.420 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": { 2024-09-13T17:23:07.420 INFO:teuthology.orchestra.run.smithi087.stdout: "ef54272a-51a1-42d0-958b-956f9cee720a": { 2024-09-13T17:23:07.420 INFO:teuthology.orchestra.run.smithi087.stdout: "path": "/", 2024-09-13T17:23:07.420 INFO:teuthology.orchestra.run.smithi087.stdout: "tag": "ef54272a-51a1-42d0-958b-956f9cee720a", 2024-09-13T17:23:07.420 INFO:teuthology.orchestra.run.smithi087.stdout: "options": "recursive,force" 2024-09-13T17:23:07.420 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:23:07.420 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:23:07.420 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:23:07.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.411+0000 7f3d46232640 1 -- 172.21.15.87:0/3281361331 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f3d2c0a1280 msgr2=0x7f3d2c0a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:07.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.411+0000 7f3d46232640 1 --2- 172.21.15.87:0/3281361331 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f3d2c0a1280 0x7f3d2c0a3740 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3d38004af0 tx=0x7f3d38004a40 comp rx=0 tx=0).stop 2024-09-13T17:23:07.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.411+0000 7f3d46232640 1 -- 172.21.15.87:0/3281361331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d40101860 msgr2=0x7f3d40196770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:07.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.411+0000 7f3d46232640 1 --2- 172.21.15.87:0/3281361331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d40101860 0x7f3d40196770 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f3d2800d950 tx=0x7f3d2800de10 comp rx=0 tx=0).stop 2024-09-13T17:23:07.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.411+0000 7f3d46232640 1 -- 172.21.15.87:0/3281361331 shutdown_connections 2024-09-13T17:23:07.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.411+0000 7f3d46232640 1 --2- 172.21.15.87:0/3281361331 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d4010a310 0x7f3d4019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.411+0000 7f3d46232640 1 --2- 172.21.15.87:0/3281361331 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f3d2c0a1280 0x7f3d2c0a3740 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.411+0000 7f3d46232640 1 --2- 172.21.15.87:0/3281361331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d40101860 0x7f3d40196770 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.411+0000 7f3d46232640 1 --2- 172.21.15.87:0/3281361331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d40100f40 0x7f3d40196230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:07.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.411+0000 7f3d46232640 1 -- 172.21.15.87:0/3281361331 >> 172.21.15.87:0/3281361331 conn(0x7f3d40075c60 msgr2=0x7f3d400fb400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:07.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.411+0000 7f3d46232640 1 -- 172.21.15.87:0/3281361331 shutdown_connections 2024-09-13T17:23:07.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:07.411+0000 7f3d46232640 1 -- 172.21.15.87:0/3281361331 wait complete. 2024-09-13T17:23:07.423 INFO:tasks.cephfs.filesystem:scrub status for tag:ef54272a-51a1-42d0-958b-956f9cee720a - {'path': '/', 'tag': 'ef54272a-51a1-42d0-958b-956f9cee720a', 'options': 'recursive,force'} 2024-09-13T17:23:08.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:07 smithi087 ceph-mon[30934]: scrub queued for path: / 2024-09-13T17:23:08.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:07 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:23:08.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:07 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:23:08.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:07 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:23:08.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:07 smithi149 ceph-mon[35496]: scrub queued for path: / 2024-09-13T17:23:08.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:07 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:23:08.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:07 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:23:08.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:07 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:23:08.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:07 smithi118 ceph-mon[34374]: scrub queued for path: / 2024-09-13T17:23:08.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:07 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:23:08.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:07 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:23:08.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:07 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:23:09.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:08 smithi149 ceph-mon[35496]: pgmap v288: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-13T17:23:09.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:08 smithi118 ceph-mon[34374]: pgmap v288: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-13T17:23:09.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:08 smithi087 ceph-mon[30934]: pgmap v288: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-13T17:23:10.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:09 smithi149 ceph-mon[35496]: scrub summary: idle 2024-09-13T17:23:10.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:09 smithi118 ceph-mon[34374]: scrub summary: idle 2024-09-13T17:23:10.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:09 smithi087 ceph-mon[30934]: scrub summary: idle 2024-09-13T17:23:11.264 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:10 smithi118 ceph-mon[34374]: pgmap v289: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-13T17:23:11.265 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:10 smithi118 ceph-mon[34374]: osdmap e101: 12 total, 12 up, 12 in 2024-09-13T17:23:11.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:10 smithi149 ceph-mon[35496]: pgmap v289: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-13T17:23:11.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:10 smithi149 ceph-mon[35496]: osdmap e101: 12 total, 12 up, 12 in 2024-09-13T17:23:11.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:10 smithi087 ceph-mon[30934]: pgmap v289: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-13T17:23:11.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:10 smithi087 ceph-mon[30934]: osdmap e101: 12 total, 12 up, 12 in 2024-09-13T17:23:13.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:12 smithi149 ceph-mon[35496]: pgmap v291: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2024-09-13T17:23:13.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:12 smithi149 ceph-mon[35496]: osdmap e102: 12 total, 12 up, 12 in 2024-09-13T17:23:13.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:12 smithi118 ceph-mon[34374]: pgmap v291: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2024-09-13T17:23:13.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:12 smithi118 ceph-mon[34374]: osdmap e102: 12 total, 12 up, 12 in 2024-09-13T17:23:13.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:12 smithi087 ceph-mon[30934]: pgmap v291: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2024-09-13T17:23:13.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:12 smithi087 ceph-mon[30934]: osdmap e102: 12 total, 12 up, 12 in 2024-09-13T17:23:15.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:14 smithi149 ceph-mon[35496]: pgmap v293: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 127 B/s wr, 6 op/s 2024-09-13T17:23:15.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:14 smithi118 ceph-mon[34374]: pgmap v293: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 127 B/s wr, 6 op/s 2024-09-13T17:23:15.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:14 smithi087 ceph-mon[30934]: pgmap v293: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 127 B/s wr, 6 op/s 2024-09-13T17:23:17.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:16 smithi149 ceph-mon[35496]: pgmap v294: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-13T17:23:17.365 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:16 smithi118 ceph-mon[34374]: pgmap v294: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-13T17:23:17.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:16 smithi087 ceph-mon[30934]: pgmap v294: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-13T17:23:19.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:18 smithi149 ceph-mon[35496]: pgmap v295: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-13T17:23:19.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:18 smithi118 ceph-mon[34374]: pgmap v295: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-13T17:23:19.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:18 smithi087 ceph-mon[30934]: pgmap v295: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-13T17:23:21.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:21 smithi149 ceph-mon[35496]: pgmap v296: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 214 B/s wr, 10 op/s 2024-09-13T17:23:21.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:21 smithi118 ceph-mon[34374]: pgmap v296: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 214 B/s wr, 10 op/s 2024-09-13T17:23:21.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:21 smithi087 ceph-mon[30934]: pgmap v296: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 214 B/s wr, 10 op/s 2024-09-13T17:23:23.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:23 smithi149 ceph-mon[35496]: pgmap v297: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-09-13T17:23:23.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:23 smithi118 ceph-mon[34374]: pgmap v297: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-09-13T17:23:23.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:23 smithi087 ceph-mon[30934]: pgmap v297: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-09-13T17:23:25.281 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:25 smithi087 ceph-mon[30934]: pgmap v298: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 7 op/s 2024-09-13T17:23:25.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:25 smithi149 ceph-mon[35496]: pgmap v298: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 7 op/s 2024-09-13T17:23:25.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:25 smithi118 ceph-mon[34374]: pgmap v298: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 7 op/s 2024-09-13T17:23:27.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:27 smithi149 ceph-mon[35496]: pgmap v299: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-13T17:23:27.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:27 smithi118 ceph-mon[34374]: pgmap v299: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-13T17:23:27.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:27 smithi087 ceph-mon[30934]: pgmap v299: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-13T17:23:29.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:29 smithi149 ceph-mon[35496]: pgmap v300: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:23:29.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:29 smithi118 ceph-mon[34374]: pgmap v300: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:23:29.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:29 smithi087 ceph-mon[30934]: pgmap v300: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:23:31.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:31 smithi149 ceph-mon[35496]: pgmap v301: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:23:31.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:31 smithi118 ceph-mon[34374]: pgmap v301: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:23:31.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:31 smithi087 ceph-mon[30934]: pgmap v301: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:23:33.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:33 smithi149 ceph-mon[35496]: pgmap v302: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:23:33.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:33 smithi118 ceph-mon[34374]: pgmap v302: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:23:33.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:33 smithi087 ceph-mon[30934]: pgmap v302: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:23:35.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:35 smithi149 ceph-mon[35496]: pgmap v303: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:23:35.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:35 smithi118 ceph-mon[34374]: pgmap v303: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:23:35.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:35 smithi087 ceph-mon[30934]: pgmap v303: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:23:37.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:37 smithi149 ceph-mon[35496]: pgmap v304: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:23:37.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:37 smithi118 ceph-mon[34374]: pgmap v304: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:23:37.425 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:23:37.451 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:37 smithi087 ceph-mon[30934]: pgmap v304: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:23:37.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.537+0000 7fc84406c640 1 -- 172.21.15.87:0/2163011673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc83c10a330 msgr2=0x7fc83c10c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:37.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.537+0000 7fc84406c640 1 --2- 172.21.15.87:0/2163011673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc83c10a330 0x7fc83c10c7a0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fc834009ca0 tx=0x7fc83402a950 comp rx=0 tx=0).stop 2024-09-13T17:23:37.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.537+0000 7fc84406c640 1 -- 172.21.15.87:0/2163011673 shutdown_connections 2024-09-13T17:23:37.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.537+0000 7fc84406c640 1 --2- 172.21.15.87:0/2163011673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc83c10a330 0x7fc83c10c7a0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.537+0000 7fc84406c640 1 --2- 172.21.15.87:0/2163011673 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc83c101880 0x7fc83c109d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.537+0000 7fc84406c640 1 --2- 172.21.15.87:0/2163011673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc83c100f60 0x7fc83c101340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.537+0000 7fc84406c640 1 -- 172.21.15.87:0/2163011673 >> 172.21.15.87:0/2163011673 conn(0x7fc83c075c60 msgr2=0x7fc83c0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:37.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.537+0000 7fc84406c640 1 -- 172.21.15.87:0/2163011673 shutdown_connections 2024-09-13T17:23:37.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.537+0000 7fc84406c640 1 -- 172.21.15.87:0/2163011673 wait complete. 2024-09-13T17:23:37.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.537+0000 7fc84406c640 1 Processor -- start 2024-09-13T17:23:37.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.538+0000 7fc84406c640 1 -- start start 2024-09-13T17:23:37.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.538+0000 7fc84406c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc83c100f60 0x7fc83c196310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:37.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.538+0000 7fc84406c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc83c101880 0x7fc83c196850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:37.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.538+0000 7fc84406c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc83c10a330 0x7fc83c19abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:37.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.538+0000 7fc84406c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c19b1f0 con 0x7fc83c101880 2024-09-13T17:23:37.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.538+0000 7fc84406c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c19b360 con 0x7fc83c100f60 2024-09-13T17:23:37.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.538+0000 7fc84406c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c19b520 con 0x7fc83c10a330 2024-09-13T17:23:37.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.538+0000 7fc841607640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc83c101880 0x7fc83c196850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:37.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.538+0000 7fc841607640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc83c101880 0x7fc83c196850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56646/0 (socket says 172.21.15.87:56646) 2024-09-13T17:23:37.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.538+0000 7fc841607640 1 -- 172.21.15.87:0/3339661175 learned_addr learned my addr 172.21.15.87:0/3339661175 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:37.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.538+0000 7fc841e08640 1 --2- 172.21.15.87:0/3339661175 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc83c100f60 0x7fc83c196310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:37.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.538+0000 7fc842609640 1 --2- 172.21.15.87:0/3339661175 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc83c10a330 0x7fc83c19abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:37.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.538+0000 7fc841607640 1 -- 172.21.15.87:0/3339661175 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc83c10a330 msgr2=0x7fc83c19abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:37.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.538+0000 7fc841607640 1 --2- 172.21.15.87:0/3339661175 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc83c10a330 0x7fc83c19abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.538+0000 7fc841607640 1 -- 172.21.15.87:0/3339661175 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc83c100f60 msgr2=0x7fc83c196310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:37.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.538+0000 7fc841607640 1 --2- 172.21.15.87:0/3339661175 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc83c100f60 0x7fc83c196310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.538+0000 7fc841607640 1 -- 172.21.15.87:0/3339661175 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc834009900 con 0x7fc83c101880 2024-09-13T17:23:37.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.538+0000 7fc841607640 1 --2- 172.21.15.87:0/3339661175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc83c101880 0x7fc83c196850 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00b4a0 tx=0x7fc82c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:37.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.539+0000 7fc832ffd640 1 -- 172.21.15.87:0/3339661175 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c010610 con 0x7fc83c101880 2024-09-13T17:23:37.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.539+0000 7fc832ffd640 1 -- 172.21.15.87:0/3339661175 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc82c010c20 con 0x7fc83c101880 2024-09-13T17:23:37.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.539+0000 7fc84406c640 1 -- 172.21.15.87:0/3339661175 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc83c19b800 con 0x7fc83c101880 2024-09-13T17:23:37.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.539+0000 7fc832ffd640 1 -- 172.21.15.87:0/3339661175 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c017d50 con 0x7fc83c101880 2024-09-13T17:23:37.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.539+0000 7fc84406c640 1 -- 172.21.15.87:0/3339661175 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83c1a3080 con 0x7fc83c101880 2024-09-13T17:23:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.541+0000 7fc832ffd640 1 -- 172.21.15.87:0/3339661175 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fc82c010770 con 0x7fc83c101880 2024-09-13T17:23:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.542+0000 7fc846e65740 1 Processor -- start 2024-09-13T17:23:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.542+0000 7fc846e65740 1 -- start start 2024-09-13T17:23:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.542+0000 7fc846e65740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55730b3bbe10 0x55730b3bc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.542+0000 7fc846e65740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55730b3bc730 0x55730b3c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.542+0000 7fc846e65740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55730b3c6fd0 0x55730b3c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.542+0000 7fc846e65740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55730b326f20 con 0x55730b3c6fd0 2024-09-13T17:23:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.542+0000 7fc846e65740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55730b3246b0 con 0x55730b3bc730 2024-09-13T17:23:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.542+0000 7fc846e65740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55730b31ffa0 con 0x55730b3bbe10 2024-09-13T17:23:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.542+0000 7fc841607640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55730b3c6fd0 0x55730b3c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.542+0000 7fc841607640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55730b3c6fd0 0x55730b3c93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56654/0 (socket says 172.21.15.87:56654) 2024-09-13T17:23:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.542+0000 7fc841607640 1 -- 172.21.15.87:0/2069846974 learned_addr learned my addr 172.21.15.87:0/2069846974 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.542+0000 7fc841e08640 1 --2- 172.21.15.87:0/2069846974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55730b3bc730 0x55730b3c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.542+0000 7fc832ffd640 1 --2- 172.21.15.87:0/3339661175 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc8280a1200 0x7fc8280a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.542+0000 7fc842609640 1 --2- 172.21.15.87:0/2069846974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55730b3bbe10 0x55730b3bc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.543+0000 7fc841607640 1 -- 172.21.15.87:0/2069846974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55730b3bbe10 msgr2=0x55730b3bc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.543+0000 7fc841607640 1 --2- 172.21.15.87:0/2069846974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55730b3bbe10 0x55730b3bc1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.543+0000 7fc841607640 1 -- 172.21.15.87:0/2069846974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55730b3bc730 msgr2=0x55730b3c6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.543+0000 7fc841607640 1 --2- 172.21.15.87:0/2069846974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55730b3bc730 0x55730b3c6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.543+0000 7fc841607640 1 -- 172.21.15.87:0/2069846974 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55730b2da840 con 0x55730b3c6fd0 2024-09-13T17:23:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.543+0000 7fc842609640 1 --2- 172.21.15.87:0/3339661175 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc8280a1200 0x7fc8280a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.543+0000 7fc832ffd640 1 -- 172.21.15.87:0/3339661175 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fc82c0cc990 con 0x7fc83c101880 2024-09-13T17:23:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.543+0000 7fc841607640 1 --2- 172.21.15.87:0/2069846974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55730b3c6fd0 0x55730b3c93c0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fc82c0c9d50 tx=0x7fc82c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68eea2d872855d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.543+0000 7fc827fff640 1 -- 172.21.15.87:0/2069846974 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c099570 con 0x55730b3c6fd0 2024-09-13T17:23:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.543+0000 7fc842609640 1 --2- 172.21.15.87:0/3339661175 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc8280a1200 0x7fc8280a36c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc83402af40 tx=0x7fc8340095c0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.543+0000 7fc827fff640 1 -- 172.21.15.87:0/2069846974 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc82c0992e0 con 0x55730b3c6fd0 2024-09-13T17:23:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.543+0000 7fc827fff640 1 -- 172.21.15.87:0/2069846974 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c09d5d0 con 0x55730b3c6fd0 2024-09-13T17:23:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.544+0000 7fc846e65740 1 -- 172.21.15.87:0/2069846974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55730b3c6fd0 msgr2=0x55730b3c93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.544+0000 7fc846e65740 1 --2- 172.21.15.87:0/2069846974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55730b3c6fd0 0x55730b3c93c0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fc82c0c9d50 tx=0x7fc82c0046c0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.544+0000 7fc846e65740 1 -- 172.21.15.87:0/2069846974 shutdown_connections 2024-09-13T17:23:37.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.544+0000 7fc846e65740 1 --2- 172.21.15.87:0/2069846974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55730b3c6fd0 0x55730b3c93c0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.544+0000 7fc846e65740 1 --2- 172.21.15.87:0/2069846974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55730b3bc730 0x55730b3c6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.544+0000 7fc846e65740 1 --2- 172.21.15.87:0/2069846974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55730b3bbe10 0x55730b3bc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.544+0000 7fc846e65740 1 -- 172.21.15.87:0/2069846974 >> 172.21.15.87:0/2069846974 conn(0x55730b3b8380 msgr2=0x55730b3b8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:37.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.544+0000 7fc846e65740 1 -- 172.21.15.87:0/2069846974 shutdown_connections 2024-09-13T17:23:37.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.544+0000 7fc846e65740 1 -- 172.21.15.87:0/2069846974 wait complete. 2024-09-13T17:23:37.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.544+0000 7fc846e65740 1 -- start start 2024-09-13T17:23:37.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.544+0000 7fc846e65740 1 Processor -- start 2024-09-13T17:23:37.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.545+0000 7fc846e65740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55730b3bbe10 0x55730b3c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:37.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.545+0000 7fc846e65740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55730b3bc730 0x55730b3c3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:37.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.545+0000 7fc846e65740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55730b3c6fd0 0x55730b3c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:37.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.545+0000 7fc846e65740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55730b2c12a0 con 0x55730b3bbe10 2024-09-13T17:23:37.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.545+0000 7fc846e65740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55730aff8430 con 0x55730b3bc730 2024-09-13T17:23:37.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.545+0000 7fc846e65740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55730b2a3680 con 0x55730b3c6fd0 2024-09-13T17:23:37.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.545+0000 7fc841e08640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55730b3bbe10 0x55730b3c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:37.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.545+0000 7fc846e65740 10 client.0 _ll_register_callbacks cb 0x55730b319610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:23:37.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.545+0000 7fc841e08640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55730b3bbe10 0x55730b3c68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56660/0 (socket says 172.21.15.87:56660) 2024-09-13T17:23:37.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.545+0000 7fc841e08640 1 -- 172.21.15.87:0/3042702151 learned_addr learned my addr 172.21.15.87:0/3042702151 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:37.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.545+0000 7fc841607640 1 --2- 172.21.15.87:0/3042702151 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55730b3bc730 0x55730b3c3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:37.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.545+0000 7fc842609640 1 --2- 172.21.15.87:0/3042702151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55730b3c6fd0 0x55730b3c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:37.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.545+0000 7fc841e08640 1 -- 172.21.15.87:0/3042702151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55730b3c6fd0 msgr2=0x55730b3c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:37.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.545+0000 7fc841e08640 1 --2- 172.21.15.87:0/3042702151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55730b3c6fd0 0x55730b3c40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.545+0000 7fc841e08640 1 -- 172.21.15.87:0/3042702151 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55730b3bc730 msgr2=0x55730b3c3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:37.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.545+0000 7fc841e08640 1 --2- 172.21.15.87:0/3042702151 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55730b3bc730 0x55730b3c3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.545+0000 7fc841e08640 1 -- 172.21.15.87:0/3042702151 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83c1a3080 con 0x55730b3bbe10 2024-09-13T17:23:37.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.545+0000 7fc841e08640 1 --2- 172.21.15.87:0/3042702151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55730b3bbe10 0x55730b3c68b0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fc838010820 tx=0x7fc838010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=109c9079eb3083f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:37.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.545+0000 7fc8257fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:23:37.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.546+0000 7fc8257fa640 1 -- 172.21.15.87:0/3042702151 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc838015070 con 0x55730b3bbe10 2024-09-13T17:23:37.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.546+0000 7fc8257fa640 1 -- 172.21.15.87:0/3042702151 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fc83800fb90 con 0x55730b3bbe10 2024-09-13T17:23:37.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.546+0000 7fc846e65740 1 -- 172.21.15.87:0/3042702151 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55730b0134e0 con 0x55730b3bbe10 2024-09-13T17:23:37.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.546+0000 7fc8257fa640 1 -- 172.21.15.87:0/3042702151 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc83800fd90 con 0x55730b3bbe10 2024-09-13T17:23:37.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.546+0000 7fc846e65740 10 client.18045 fetch_fsmap learned FSMap version 36 2024-09-13T17:23:37.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.546+0000 7fc846e65740 1 -- 172.21.15.87:0/3042702151 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55730b31e620 con 0x55730b3bbe10 2024-09-13T17:23:37.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.546+0000 7fc8257fa640 1 -- 172.21.15.87:0/3042702151 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55730b0134e0 con 0x55730b3bbe10 2024-09-13T17:23:37.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.546+0000 7fc8257fa640 1 -- 172.21.15.87:0/3042702151 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc83800e440 con 0x55730b3bbe10 2024-09-13T17:23:37.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.546+0000 7fc846e65740 10 client.18045 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:23:37.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.546+0000 7fc846e65740 10 client.18045 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:23:37.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.546+0000 7fc846e65740 20 client.18045 populate_metadata read hostname 'smithi087' 2024-09-13T17:23:37.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.546+0000 7fc846e65740 1 --2- 172.21.15.87:0/3042702151 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55730b3d6e00 0x55730b3d9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:37.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.546+0000 7fc846e65740 4 client.18045 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:23:37.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.546+0000 7fc846e65740 1 -- 172.21.15.87:0/3042702151 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55730b0247e0 con 0x55730b3d6e00 2024-09-13T17:23:37.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.546+0000 7fc841607640 1 --2- 172.21.15.87:0/3042702151 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55730b3d6e00 0x55730b3d9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:37.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.547+0000 7fc8257fa640 10 client.18045 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:23:37.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.547+0000 7fc841607640 1 --2- 172.21.15.87:0/3042702151 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55730b3d6e00 0x55730b3d9220 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81beddbfaca7687c server_cookie=7e1179bde25b347b in_seq=0 out_seq=0 2024-09-13T17:23:37.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.547+0000 7fc8257fa640 1 -- 172.21.15.87:0/3042702151 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55730b0247e0 con 0x55730b3d6e00 2024-09-13T17:23:37.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.547+0000 7fc8257fa640 10 client.18045 handle_command_reply: tid=0 2024-09-13T17:23:37.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.547+0000 7fc846e65740 1 client.18045 shutdown 2024-09-13T17:23:37.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.548+0000 7fc846e65740 1 -- 172.21.15.87:0/3042702151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55730b3bbe10 msgr2=0x55730b3c68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:37.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.548+0000 7fc846e65740 1 --2- 172.21.15.87:0/3042702151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55730b3bbe10 0x55730b3c68b0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fc838010820 tx=0x7fc838010ce0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.548+0000 7fc846e65740 1 -- 172.21.15.87:0/3042702151 shutdown_connections 2024-09-13T17:23:37.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.548+0000 7fc846e65740 1 --2- 172.21.15.87:0/3042702151 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55730b3d6e00 0x55730b3d9220 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.548+0000 7fc846e65740 1 --2- 172.21.15.87:0/3042702151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55730b3c6fd0 0x55730b3c40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.548+0000 7fc8257fa640 0 client.18045 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:23:37.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.548+0000 7fc846e65740 1 --2- 172.21.15.87:0/3042702151 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55730b3bc730 0x55730b3c3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.548+0000 7fc846e65740 1 --2- 172.21.15.87:0/3042702151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55730b3bbe10 0x55730b3c68b0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.548+0000 7fc846e65740 1 -- 172.21.15.87:0/3042702151 >> 172.21.15.87:0/3042702151 conn(0x55730b3b8380 msgr2=0x55730b3be090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:37.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.548+0000 7fc846e65740 1 -- 172.21.15.87:0/3042702151 shutdown_connections 2024-09-13T17:23:37.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.548+0000 7fc846e65740 1 -- 172.21.15.87:0/3042702151 wait complete. 2024-09-13T17:23:37.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.548+0000 7fc846e65740 20 client.18045 trim_cache size 0 max 16384 2024-09-13T17:23:37.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.563+0000 7fc846e65740 1 Processor -- start 2024-09-13T17:23:37.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.563+0000 7fc846e65740 1 -- start start 2024-09-13T17:23:37.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.563+0000 7fc846e65740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55730b3bbe10 0x55730b3b7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:37.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.563+0000 7fc846e65740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55730b3bc730 0x55730b3ddba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:37.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.563+0000 7fc846e65740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55730b3c6fd0 0x55730b3bee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:37.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.563+0000 7fc846e65740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55730b3c4eb0 con 0x55730b3bc730 2024-09-13T17:23:37.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.563+0000 7fc846e65740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55730b3bcca0 con 0x55730b3c6fd0 2024-09-13T17:23:37.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.563+0000 7fc846e65740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55730b3c20b0 con 0x55730b3bbe10 2024-09-13T17:23:37.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.563+0000 7fc841607640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55730b3bc730 0x55730b3ddba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:37.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.563+0000 7fc841607640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55730b3bc730 0x55730b3ddba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56662/0 (socket says 172.21.15.87:56662) 2024-09-13T17:23:37.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.563+0000 7fc841607640 1 -- 172.21.15.87:0/1994287734 learned_addr learned my addr 172.21.15.87:0/1994287734 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:37.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.563+0000 7fc842609640 1 --2- 172.21.15.87:0/1994287734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55730b3c6fd0 0x55730b3bee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:37.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.563+0000 7fc841e08640 1 --2- 172.21.15.87:0/1994287734 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55730b3bbe10 0x55730b3b7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:37.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.563+0000 7fc841607640 1 -- 172.21.15.87:0/1994287734 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55730b3bbe10 msgr2=0x55730b3b7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:37.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.563+0000 7fc841607640 1 --2- 172.21.15.87:0/1994287734 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55730b3bbe10 0x55730b3b7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.563+0000 7fc841607640 1 -- 172.21.15.87:0/1994287734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55730b3c6fd0 msgr2=0x55730b3bee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:37.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.563+0000 7fc841607640 1 --2- 172.21.15.87:0/1994287734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55730b3c6fd0 0x55730b3bee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.563+0000 7fc841607640 1 -- 172.21.15.87:0/1994287734 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55730b2c0790 con 0x55730b3bc730 2024-09-13T17:23:37.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.563+0000 7fc841e08640 1 --2- 172.21.15.87:0/1994287734 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55730b3bbe10 0x55730b3b7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:23:37.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.564+0000 7fc841607640 1 --2- 172.21.15.87:0/1994287734 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55730b3bc730 0x55730b3ddba0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fc82c0ca2d0 tx=0x7fc82c0ce040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48f0018e662db01b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:37.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.564+0000 7fc830ff9640 1 -- 172.21.15.87:0/1994287734 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c0ccc50 con 0x55730b3bc730 2024-09-13T17:23:37.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.564+0000 7fc830ff9640 1 -- 172.21.15.87:0/1994287734 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc82c010d90 con 0x55730b3bc730 2024-09-13T17:23:37.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.564+0000 7fc830ff9640 1 -- 172.21.15.87:0/1994287734 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c0d21e0 con 0x55730b3bc730 2024-09-13T17:23:37.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.564+0000 7fc846e65740 1 -- 172.21.15.87:0/1994287734 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55730b3bc730 msgr2=0x55730b3ddba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:37.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.564+0000 7fc846e65740 1 --2- 172.21.15.87:0/1994287734 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55730b3bc730 0x55730b3ddba0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fc82c0ca2d0 tx=0x7fc82c0ce040 comp rx=0 tx=0).stop 2024-09-13T17:23:37.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.564+0000 7fc846e65740 1 -- 172.21.15.87:0/1994287734 shutdown_connections 2024-09-13T17:23:37.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.564+0000 7fc846e65740 1 --2- 172.21.15.87:0/1994287734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55730b3c6fd0 0x55730b3bee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.564+0000 7fc846e65740 1 --2- 172.21.15.87:0/1994287734 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55730b3bc730 0x55730b3ddba0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.564+0000 7fc846e65740 1 --2- 172.21.15.87:0/1994287734 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55730b3bbe10 0x55730b3b7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.564+0000 7fc846e65740 1 -- 172.21.15.87:0/1994287734 >> 172.21.15.87:0/1994287734 conn(0x55730b3b8380 msgr2=0x55730b3b8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:37.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.564+0000 7fc846e65740 1 -- 172.21.15.87:0/1994287734 shutdown_connections 2024-09-13T17:23:37.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.564+0000 7fc846e65740 1 -- 172.21.15.87:0/1994287734 wait complete. 2024-09-13T17:23:37.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.565+0000 7fc846e65740 1 -- start start 2024-09-13T17:23:37.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.565+0000 7fc846e65740 1 Processor -- start 2024-09-13T17:23:37.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.565+0000 7fc846e65740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55730b3bbe10 0x55730b3ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:37.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.565+0000 7fc846e65740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55730b3bc730 0x55730b3cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:37.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.565+0000 7fc846e65740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55730b3c6fd0 0x55730b3cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:37.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.565+0000 7fc846e65740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55730b42c320 con 0x55730b3bbe10 2024-09-13T17:23:37.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.565+0000 7fc846e65740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55730b42c460 con 0x55730b3c6fd0 2024-09-13T17:23:37.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.565+0000 7fc846e65740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55730b42c5a0 con 0x55730b3bc730 2024-09-13T17:23:37.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.565+0000 7fc846e65740 10 client.0 _ll_register_callbacks cb 0x7fc83800a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:23:37.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.565+0000 7fc841e08640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55730b3bbe10 0x55730b3ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:37.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.565+0000 7fc841e08640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55730b3bbe10 0x55730b3ccf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56672/0 (socket says 172.21.15.87:56672) 2024-09-13T17:23:37.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.565+0000 7fc841e08640 1 -- 172.21.15.87:0/3145189287 learned_addr learned my addr 172.21.15.87:0/3145189287 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:37.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.565+0000 7fc842609640 1 --2- 172.21.15.87:0/3145189287 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55730b3c6fd0 0x55730b3cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:37.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.565+0000 7fc841607640 1 --2- 172.21.15.87:0/3145189287 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55730b3bc730 0x55730b3cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:37.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.566+0000 7fc841e08640 1 -- 172.21.15.87:0/3145189287 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55730b3bc730 msgr2=0x55730b3cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:37.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.566+0000 7fc841e08640 1 --2- 172.21.15.87:0/3145189287 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55730b3bc730 0x55730b3cd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.566+0000 7fc841e08640 1 -- 172.21.15.87:0/3145189287 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55730b3c6fd0 msgr2=0x55730b3cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:37.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.566+0000 7fc841e08640 1 --2- 172.21.15.87:0/3145189287 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55730b3c6fd0 0x55730b3cda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.566+0000 7fc841e08640 1 -- 172.21.15.87:0/3145189287 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55730b2da840 con 0x55730b3bbe10 2024-09-13T17:23:37.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.566+0000 7fc841607640 1 --2- 172.21.15.87:0/3145189287 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55730b3bc730 0x55730b3cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:23:37.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.566+0000 7fc841e08640 1 --2- 172.21.15.87:0/3145189287 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55730b3bbe10 0x55730b3ccf90 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fc83800f870 tx=0x7fc83800f8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59db540735678370 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:37.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.566+0000 7fc8257fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:23:37.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.566+0000 7fc8257fa640 1 -- 172.21.15.87:0/3145189287 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc838015040 con 0x55730b3bbe10 2024-09-13T17:23:37.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.566+0000 7fc8257fa640 1 -- 172.21.15.87:0/3145189287 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fc83800fb90 con 0x55730b3bbe10 2024-09-13T17:23:37.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.566+0000 7fc846e65740 1 -- 172.21.15.87:0/3145189287 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc82c0992e0 con 0x55730b3bbe10 2024-09-13T17:23:37.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.566+0000 7fc8257fa640 1 -- 172.21.15.87:0/3145189287 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc83800e5b0 con 0x55730b3bbe10 2024-09-13T17:23:37.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.566+0000 7fc846e65740 10 client.18051 fetch_fsmap learned FSMap version 36 2024-09-13T17:23:37.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.566+0000 7fc846e65740 1 -- 172.21.15.87:0/3145189287 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55730b2e5ea0 con 0x55730b3bbe10 2024-09-13T17:23:37.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.566+0000 7fc8257fa640 1 -- 172.21.15.87:0/3145189287 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc82c0992e0 con 0x55730b3bbe10 2024-09-13T17:23:37.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.566+0000 7fc8257fa640 1 -- 172.21.15.87:0/3145189287 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc838004660 con 0x55730b3bbe10 2024-09-13T17:23:37.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.566+0000 7fc846e65740 10 client.18051 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:23:37.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.566+0000 7fc846e65740 10 client.18051 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:23:37.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.566+0000 7fc846e65740 20 client.18051 populate_metadata read hostname 'smithi087' 2024-09-13T17:23:37.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.566+0000 7fc846e65740 1 --2- 172.21.15.87:0/3145189287 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55730b42dcf0 0x55730b430110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:37.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.566+0000 7fc846e65740 4 client.18051 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:23:37.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.566+0000 7fc846e65740 1 -- 172.21.15.87:0/3145189287 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55730b077e30 con 0x55730b42dcf0 2024-09-13T17:23:37.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.567+0000 7fc841607640 1 --2- 172.21.15.87:0/3145189287 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55730b42dcf0 0x55730b430110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:37.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.567+0000 7fc8257fa640 10 client.18051 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:23:37.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.567+0000 7fc841607640 1 --2- 172.21.15.87:0/3145189287 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55730b42dcf0 0x55730b430110 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9e69442fa88945e server_cookie=327b0cb58f13440b in_seq=0 out_seq=0 2024-09-13T17:23:37.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.567+0000 7fc8257fa640 1 -- 172.21.15.87:0/3145189287 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55730b077e30 con 0x55730b42dcf0 2024-09-13T17:23:37.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.567+0000 7fc8257fa640 10 client.18051 handle_command_reply: tid=0 2024-09-13T17:23:37.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.567+0000 7fc846e65740 1 client.18051 shutdown 2024-09-13T17:23:37.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.567+0000 7fc846e65740 1 -- 172.21.15.87:0/3145189287 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55730b3bbe10 msgr2=0x55730b3ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:37.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.567+0000 7fc846e65740 1 --2- 172.21.15.87:0/3145189287 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55730b3bbe10 0x55730b3ccf90 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fc83800f870 tx=0x7fc83800f8a0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.567+0000 7fc846e65740 1 -- 172.21.15.87:0/3145189287 shutdown_connections 2024-09-13T17:23:37.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.567+0000 7fc846e65740 1 --2- 172.21.15.87:0/3145189287 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55730b42dcf0 0x55730b430110 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.567+0000 7fc846e65740 1 --2- 172.21.15.87:0/3145189287 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55730b3c6fd0 0x55730b3cda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.567+0000 7fc846e65740 1 --2- 172.21.15.87:0/3145189287 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55730b3bc730 0x55730b3cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.567+0000 7fc8257fa640 0 client.18051 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:23:37.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.567+0000 7fc846e65740 1 --2- 172.21.15.87:0/3145189287 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55730b3bbe10 0x55730b3ccf90 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.567+0000 7fc846e65740 1 -- 172.21.15.87:0/3145189287 >> 172.21.15.87:0/3145189287 conn(0x55730b3b8380 msgr2=0x55730b3ddba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:37.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.567+0000 7fc846e65740 1 -- 172.21.15.87:0/3145189287 shutdown_connections 2024-09-13T17:23:37.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.567+0000 7fc846e65740 1 -- 172.21.15.87:0/3145189287 wait complete. 2024-09-13T17:23:37.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.568+0000 7fc846e65740 20 client.18051 trim_cache size 0 max 16384 2024-09-13T17:23:37.576 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:23:37.576 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "no active scrubs running", 2024-09-13T17:23:37.576 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": {} 2024-09-13T17:23:37.576 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:23:37.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.568+0000 7fc84406c640 1 -- 172.21.15.87:0/3339661175 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc8280a1200 msgr2=0x7fc8280a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:37.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.568+0000 7fc84406c640 1 --2- 172.21.15.87:0/3339661175 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc8280a1200 0x7fc8280a36c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc83402af40 tx=0x7fc8340095c0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.568+0000 7fc84406c640 1 -- 172.21.15.87:0/3339661175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc83c101880 msgr2=0x7fc83c196850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:37.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.568+0000 7fc84406c640 1 --2- 172.21.15.87:0/3339661175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc83c101880 0x7fc83c196850 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00b4a0 tx=0x7fc82c00b960 comp rx=0 tx=0).stop 2024-09-13T17:23:37.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.568+0000 7fc84406c640 1 -- 172.21.15.87:0/3339661175 shutdown_connections 2024-09-13T17:23:37.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.568+0000 7fc84406c640 1 --2- 172.21.15.87:0/3339661175 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc83c10a330 0x7fc83c19abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.568+0000 7fc84406c640 1 --2- 172.21.15.87:0/3339661175 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc8280a1200 0x7fc8280a36c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.568+0000 7fc84406c640 1 --2- 172.21.15.87:0/3339661175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc83c101880 0x7fc83c196850 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.568+0000 7fc84406c640 1 --2- 172.21.15.87:0/3339661175 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc83c100f60 0x7fc83c196310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.568+0000 7fc84406c640 1 -- 172.21.15.87:0/3339661175 >> 172.21.15.87:0/3339661175 conn(0x7fc83c075c60 msgr2=0x7fc83c0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:37.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.568+0000 7fc84406c640 1 -- 172.21.15.87:0/3339661175 shutdown_connections 2024-09-13T17:23:37.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.568+0000 7fc84406c640 1 -- 172.21.15.87:0/3339661175 wait complete. 2024-09-13T17:23:37.580 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T17:23:37.580 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:23:37.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.718+0000 7f2b1dd11640 1 -- 172.21.15.87:0/2101414017 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b180fee90 msgr2=0x7f2b180ff270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:37.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.718+0000 7f2b1dd11640 1 --2- 172.21.15.87:0/2101414017 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b180fee90 0x7f2b180ff270 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f2b08009930 tx=0x7f2b0802a420 comp rx=0 tx=0).stop 2024-09-13T17:23:37.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.718+0000 7f2b1dd11640 1 -- 172.21.15.87:0/2101414017 shutdown_connections 2024-09-13T17:23:37.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.718+0000 7f2b1dd11640 1 --2- 172.21.15.87:0/2101414017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b18103fe0 0x7f2b1810bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.718+0000 7f2b1dd11640 1 --2- 172.21.15.87:0/2101414017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b180ff840 0x7f2b18103880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.718+0000 7f2b1dd11640 1 --2- 172.21.15.87:0/2101414017 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b180fee90 0x7f2b180ff270 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.718+0000 7f2b1dd11640 1 -- 172.21.15.87:0/2101414017 >> 172.21.15.87:0/2101414017 conn(0x7f2b180fa900 msgr2=0x7f2b180fcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:37.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.718+0000 7f2b1dd11640 1 -- 172.21.15.87:0/2101414017 shutdown_connections 2024-09-13T17:23:37.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.718+0000 7f2b1dd11640 1 -- 172.21.15.87:0/2101414017 wait complete. 2024-09-13T17:23:37.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.718+0000 7f2b1dd11640 1 Processor -- start 2024-09-13T17:23:37.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.719+0000 7f2b1dd11640 1 -- start start 2024-09-13T17:23:37.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.719+0000 7f2b1dd11640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b180fee90 0x7f2b181971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:37.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.719+0000 7f2b1dd11640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b18103fe0 0x7f2b18197720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:37.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.719+0000 7f2b1dd11640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b18197c60 0x7f2b181a2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:37.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.719+0000 7f2b1dd11640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b181a2900 con 0x7f2b18197c60 2024-09-13T17:23:37.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.719+0000 7f2b1dd11640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b181a2a70 con 0x7f2b18103fe0 2024-09-13T17:23:37.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.719+0000 7f2b1dd11640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b181a2c30 con 0x7f2b180fee90 2024-09-13T17:23:37.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.719+0000 7f2b17fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b18197c60 0x7f2b181a2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:37.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.719+0000 7f2b17fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b18197c60 0x7f2b181a2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56698/0 (socket says 172.21.15.87:56698) 2024-09-13T17:23:37.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.719+0000 7f2b17fff640 1 -- 172.21.15.87:0/147715715 learned_addr learned my addr 172.21.15.87:0/147715715 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:37.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.719+0000 7f2b177fe640 1 --2- 172.21.15.87:0/147715715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b180fee90 0x7f2b181971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:37.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.719+0000 7f2b16ffd640 1 --2- 172.21.15.87:0/147715715 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b18103fe0 0x7f2b18197720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:37.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.719+0000 7f2b17fff640 1 -- 172.21.15.87:0/147715715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b180fee90 msgr2=0x7f2b181971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:37.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.719+0000 7f2b17fff640 1 --2- 172.21.15.87:0/147715715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b180fee90 0x7f2b181971e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.719+0000 7f2b17fff640 1 -- 172.21.15.87:0/147715715 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b18103fe0 msgr2=0x7f2b18197720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:37.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.719+0000 7f2b17fff640 1 --2- 172.21.15.87:0/147715715 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b18103fe0 0x7f2b18197720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.719+0000 7f2b17fff640 1 -- 172.21.15.87:0/147715715 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b08009560 con 0x7f2b18197c60 2024-09-13T17:23:37.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.719+0000 7f2b177fe640 1 --2- 172.21.15.87:0/147715715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b180fee90 0x7f2b181971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:23:37.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.719+0000 7f2b17fff640 1 --2- 172.21.15.87:0/147715715 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b18197c60 0x7f2b181a2260 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f2b1000eaa0 tx=0x7f2b1000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:37.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.720+0000 7f2b14ff9640 1 -- 172.21.15.87:0/147715715 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1000cdb0 con 0x7f2b18197c60 2024-09-13T17:23:37.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.720+0000 7f2b14ff9640 1 -- 172.21.15.87:0/147715715 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2b10005020 con 0x7f2b18197c60 2024-09-13T17:23:37.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.720+0000 7f2b14ff9640 1 -- 172.21.15.87:0/147715715 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b100116b0 con 0x7f2b18197c60 2024-09-13T17:23:37.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.720+0000 7f2b1dd11640 1 -- 172.21.15.87:0/147715715 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b181a2f10 con 0x7f2b18197c60 2024-09-13T17:23:37.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.720+0000 7f2b1dd11640 1 -- 172.21.15.87:0/147715715 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b181a33a0 con 0x7f2b18197c60 2024-09-13T17:23:37.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.721+0000 7f2b1dd11640 1 -- 172.21.15.87:0/147715715 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b18100360 con 0x7f2b18197c60 2024-09-13T17:23:37.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.722+0000 7f2b14ff9640 1 -- 172.21.15.87:0/147715715 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f2b10005190 con 0x7f2b18197c60 2024-09-13T17:23:37.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.723+0000 7f2b14ff9640 1 --2- 172.21.15.87:0/147715715 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f2b000a1280 0x7f2b000a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:37.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.723+0000 7f2b14ff9640 1 -- 172.21.15.87:0/147715715 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f2b100cd690 con 0x7f2b18197c60 2024-09-13T17:23:37.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.723+0000 7f2b177fe640 1 --2- 172.21.15.87:0/147715715 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f2b000a1280 0x7f2b000a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:37.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.723+0000 7f2b177fe640 1 --2- 172.21.15.87:0/147715715 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f2b000a1280 0x7f2b000a3740 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2b080057c0 tx=0x7f2b08005a40 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:37.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.725+0000 7f2b14ff9640 1 -- 172.21.15.87:0/147715715 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2b100966f0 con 0x7f2b18197c60 2024-09-13T17:23:37.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.921+0000 7f2b1dd11640 1 -- 172.21.15.87:0/147715715 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b18107190 con 0x7f2b18197c60 2024-09-13T17:23:37.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.922+0000 7f2b14ff9640 1 -- 172.21.15.87:0/147715715 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+10877 (secure 0 0 0) 0x7f2b1001f020 con 0x7f2b18197c60 2024-09-13T17:23:37.923 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:23:37.923 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/3674545180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":3674545180},{"type":"v1","addr":"172.21.15.87:6841","nonce":3674545180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:11:23.313609+0000","modified":"2024-09-13T17:19:40.570296+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24484,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6839/3052680456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3052680456},{"type":"v1","addr":"172.21.15.118:6839","nonce":3052680456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:23:37.923 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 36 2024-09-13T17:23:37.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.924+0000 7f2b1dd11640 1 -- 172.21.15.87:0/147715715 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f2b000a1280 msgr2=0x7f2b000a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:37.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.924+0000 7f2b1dd11640 1 --2- 172.21.15.87:0/147715715 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f2b000a1280 0x7f2b000a3740 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2b080057c0 tx=0x7f2b08005a40 comp rx=0 tx=0).stop 2024-09-13T17:23:37.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.924+0000 7f2b1dd11640 1 -- 172.21.15.87:0/147715715 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b18197c60 msgr2=0x7f2b181a2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:37.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.924+0000 7f2b1dd11640 1 --2- 172.21.15.87:0/147715715 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b18197c60 0x7f2b181a2260 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f2b1000eaa0 tx=0x7f2b1000ef60 comp rx=0 tx=0).stop 2024-09-13T17:23:37.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.924+0000 7f2b1dd11640 1 -- 172.21.15.87:0/147715715 shutdown_connections 2024-09-13T17:23:37.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.924+0000 7f2b1dd11640 1 --2- 172.21.15.87:0/147715715 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f2b000a1280 0x7f2b000a3740 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.924+0000 7f2b1dd11640 1 --2- 172.21.15.87:0/147715715 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b18197c60 0x7f2b181a2260 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.924+0000 7f2b1dd11640 1 --2- 172.21.15.87:0/147715715 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b18103fe0 0x7f2b18197720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.924+0000 7f2b1dd11640 1 --2- 172.21.15.87:0/147715715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b180fee90 0x7f2b181971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:37.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.924+0000 7f2b1dd11640 1 -- 172.21.15.87:0/147715715 >> 172.21.15.87:0/147715715 conn(0x7f2b180fa900 msgr2=0x7f2b180fbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:37.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.924+0000 7f2b1dd11640 1 -- 172.21.15.87:0/147715715 shutdown_connections 2024-09-13T17:23:37.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:37.924+0000 7f2b1dd11640 1 -- 172.21.15.87:0/147715715 wait complete. 2024-09-13T17:23:37.936 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-09-13T17:23:38.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.038+0000 7fa99d584640 1 -- 172.21.15.87:0/1213837015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9980ffc80 msgr2=0x7fa998103920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:38.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.038+0000 7fa99d584640 1 --2- 172.21.15.87:0/1213837015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9980ffc80 0x7fa998103920 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fa980009930 tx=0x7fa98002a420 comp rx=0 tx=0).stop 2024-09-13T17:23:38.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.038+0000 7fa99d584640 1 -- 172.21.15.87:0/1213837015 shutdown_connections 2024-09-13T17:23:38.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.038+0000 7fa99d584640 1 --2- 172.21.15.87:0/1213837015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa998104080 0x7fa99810bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.038+0000 7fa99d584640 1 --2- 172.21.15.87:0/1213837015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9980ffc80 0x7fa998103920 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.038+0000 7fa99d584640 1 --2- 172.21.15.87:0/1213837015 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9980ff2d0 0x7fa9980ff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.038+0000 7fa99d584640 1 -- 172.21.15.87:0/1213837015 >> 172.21.15.87:0/1213837015 conn(0x7fa9980749b0 msgr2=0x7fa998074dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:38.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.038+0000 7fa99d584640 1 -- 172.21.15.87:0/1213837015 shutdown_connections 2024-09-13T17:23:38.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.038+0000 7fa99d584640 1 -- 172.21.15.87:0/1213837015 wait complete. 2024-09-13T17:23:38.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.038+0000 7fa99d584640 1 Processor -- start 2024-09-13T17:23:38.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.039+0000 7fa99d584640 1 -- start start 2024-09-13T17:23:38.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.039+0000 7fa99d584640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9980ff2d0 0x7fa998196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.039+0000 7fa99d584640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa998104080 0x7fa998196840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.039+0000 7fa99d584640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa99819ac30 0x7fa99819b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.039+0000 7fa99d584640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99819b620 con 0x7fa99819ac30 2024-09-13T17:23:38.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.039+0000 7fa99d584640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99819b790 con 0x7fa9980ff2d0 2024-09-13T17:23:38.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.039+0000 7fa99d584640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99819b900 con 0x7fa998104080 2024-09-13T17:23:38.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.039+0000 7fa9977fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa99819ac30 0x7fa99819b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.039+0000 7fa9977fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa99819ac30 0x7fa99819b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56710/0 (socket says 172.21.15.87:56710) 2024-09-13T17:23:38.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.039+0000 7fa9977fe640 1 -- 172.21.15.87:0/2219007245 learned_addr learned my addr 172.21.15.87:0/2219007245 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:38.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.039+0000 7fa996ffd640 1 --2- 172.21.15.87:0/2219007245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9980ff2d0 0x7fa998196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.039+0000 7fa98ffff640 1 --2- 172.21.15.87:0/2219007245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa998104080 0x7fa998196840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.039+0000 7fa9977fe640 1 -- 172.21.15.87:0/2219007245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa998104080 msgr2=0x7fa998196840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:38.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.039+0000 7fa9977fe640 1 --2- 172.21.15.87:0/2219007245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa998104080 0x7fa998196840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.039+0000 7fa9977fe640 1 -- 172.21.15.87:0/2219007245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9980ff2d0 msgr2=0x7fa998196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:38.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.039+0000 7fa9977fe640 1 --2- 172.21.15.87:0/2219007245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9980ff2d0 0x7fa998196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.039+0000 7fa9977fe640 1 -- 172.21.15.87:0/2219007245 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa980009560 con 0x7fa99819ac30 2024-09-13T17:23:38.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.039+0000 7fa98ffff640 1 --2- 172.21.15.87:0/2219007245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa998104080 0x7fa998196840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:23:38.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.039+0000 7fa9977fe640 1 --2- 172.21.15.87:0/2219007245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa99819ac30 0x7fa99819b0e0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fa99000eaa0 tx=0x7fa99000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:38.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.039+0000 7fa994ff9640 1 -- 172.21.15.87:0/2219007245 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99000cdb0 con 0x7fa99819ac30 2024-09-13T17:23:38.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.039+0000 7fa994ff9640 1 -- 172.21.15.87:0/2219007245 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa990005020 con 0x7fa99819ac30 2024-09-13T17:23:38.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.039+0000 7fa99d584640 1 -- 172.21.15.87:0/2219007245 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9981a2ee0 con 0x7fa99819ac30 2024-09-13T17:23:38.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.039+0000 7fa994ff9640 1 -- 172.21.15.87:0/2219007245 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9900116b0 con 0x7fa99819ac30 2024-09-13T17:23:38.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.040+0000 7fa99d584640 1 -- 172.21.15.87:0/2219007245 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9981a3360 con 0x7fa99819ac30 2024-09-13T17:23:38.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.042+0000 7fa994ff9640 1 -- 172.21.15.87:0/2219007245 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fa990005190 con 0x7fa99819ac30 2024-09-13T17:23:38.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.042+0000 7fa9a02a4740 1 Processor -- start 2024-09-13T17:23:38.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.042+0000 7fa9a02a4740 1 -- start start 2024-09-13T17:23:38.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.043+0000 7fa9a02a4740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad03cc9790 0x55ad03cc9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.043+0000 7fa9a02a4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad03cca0b0 0x55ad03cd4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.043+0000 7fa9a02a4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad03cd4950 0x55ad03cd6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.043+0000 7fa9a02a4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad03c33cc0 con 0x55ad03cca0b0 2024-09-13T17:23:38.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.043+0000 7fa9a02a4740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad03c31450 con 0x55ad03cc9790 2024-09-13T17:23:38.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.043+0000 7fa9a02a4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad03c2cd40 con 0x55ad03cd4950 2024-09-13T17:23:38.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.043+0000 7fa996ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad03cca0b0 0x55ad03cd4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.043+0000 7fa996ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad03cca0b0 0x55ad03cd4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56720/0 (socket says 172.21.15.87:56720) 2024-09-13T17:23:38.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.043+0000 7fa996ffd640 1 -- 172.21.15.87:0/3418902352 learned_addr learned my addr 172.21.15.87:0/3418902352 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:38.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.043+0000 7fa98ffff640 1 --2- 172.21.15.87:0/3418902352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad03cc9790 0x55ad03cc9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.043+0000 7fa994ff9640 1 --2- 172.21.15.87:0/2219007245 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa9840a1280 0x7fa9840a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.043+0000 7fa996ffd640 1 -- 172.21.15.87:0/3418902352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad03cd4950 msgr2=0x55ad03cd6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:38.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.043+0000 7fa996ffd640 1 --2- 172.21.15.87:0/3418902352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad03cd4950 0x55ad03cd6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.043+0000 7fa996ffd640 1 -- 172.21.15.87:0/3418902352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad03cc9790 msgr2=0x55ad03cc9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:38.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.043+0000 7fa996ffd640 1 --2- 172.21.15.87:0/3418902352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad03cc9790 0x55ad03cc9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.043+0000 7fa996ffd640 1 -- 172.21.15.87:0/3418902352 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad03bf4620 con 0x55ad03cca0b0 2024-09-13T17:23:38.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.043+0000 7fa9977fe640 1 --2- 172.21.15.87:0/2219007245 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa9840a1280 0x7fa9840a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.043+0000 7fa994ff9640 1 -- 172.21.15.87:0/2219007245 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fa9900cd1b0 con 0x7fa99819ac30 2024-09-13T17:23:38.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.043+0000 7fa996ffd640 1 --2- 172.21.15.87:0/3418902352 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad03cca0b0 0x55ad03cd4410 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fa98800bd50 tx=0x7fa9880107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=487608ec58b0a924 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:38.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.044+0000 7fa98d7fa640 1 -- 172.21.15.87:0/3418902352 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa988005220 con 0x55ad03cca0b0 2024-09-13T17:23:38.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.044+0000 7fa98d7fa640 1 -- 172.21.15.87:0/3418902352 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa988015070 con 0x55ad03cca0b0 2024-09-13T17:23:38.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.044+0000 7fa98d7fa640 1 -- 172.21.15.87:0/3418902352 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9880116a0 con 0x55ad03cca0b0 2024-09-13T17:23:38.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.044+0000 7fa9a02a4740 1 -- 172.21.15.87:0/3418902352 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad03cca0b0 msgr2=0x55ad03cd4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:38.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.044+0000 7fa9977fe640 1 --2- 172.21.15.87:0/2219007245 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa9840a1280 0x7fa9840a3740 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa9900ca5a0 tx=0x7fa990000f40 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:38.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.044+0000 7fa9a02a4740 1 --2- 172.21.15.87:0/3418902352 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad03cca0b0 0x55ad03cd4410 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fa98800bd50 tx=0x7fa9880107a0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.044+0000 7fa9a02a4740 1 -- 172.21.15.87:0/3418902352 shutdown_connections 2024-09-13T17:23:38.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.044+0000 7fa9a02a4740 1 --2- 172.21.15.87:0/3418902352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad03cd4950 0x55ad03cd6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.044+0000 7fa9a02a4740 1 --2- 172.21.15.87:0/3418902352 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad03cca0b0 0x55ad03cd4410 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.044+0000 7fa9a02a4740 1 --2- 172.21.15.87:0/3418902352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad03cc9790 0x55ad03cc9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.044+0000 7fa9a02a4740 1 -- 172.21.15.87:0/3418902352 >> 172.21.15.87:0/3418902352 conn(0x55ad03cc5d00 msgr2=0x55ad03cc60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:38.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.044+0000 7fa9a02a4740 1 -- 172.21.15.87:0/3418902352 shutdown_connections 2024-09-13T17:23:38.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.045+0000 7fa9a02a4740 1 -- 172.21.15.87:0/3418902352 wait complete. 2024-09-13T17:23:38.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.045+0000 7fa9a02a4740 1 -- start start 2024-09-13T17:23:38.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.045+0000 7fa9a02a4740 1 Processor -- start 2024-09-13T17:23:38.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.045+0000 7fa9a02a4740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad03cc9790 0x55ad03cd3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.045+0000 7fa9a02a4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad03cca0b0 0x55ad03cd1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.045+0000 7fa9a02a4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad03cd4950 0x55ad03cd17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.045+0000 7fa9a02a4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad03beb180 con 0x55ad03cca0b0 2024-09-13T17:23:38.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.045+0000 7fa9a02a4740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad03905430 con 0x55ad03cc9790 2024-09-13T17:23:38.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.045+0000 7fa9a02a4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad03bb05e0 con 0x55ad03cd4950 2024-09-13T17:23:38.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.045+0000 7fa9a02a4740 10 client.0 _ll_register_callbacks cb 0x55ad03c1caa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:23:38.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.045+0000 7fa996ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad03cca0b0 0x55ad03cd1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.045+0000 7fa996ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad03cca0b0 0x55ad03cd1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56722/0 (socket says 172.21.15.87:56722) 2024-09-13T17:23:38.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.045+0000 7fa996ffd640 1 -- 172.21.15.87:0/4229471069 learned_addr learned my addr 172.21.15.87:0/4229471069 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:38.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.045+0000 7fa98ffff640 1 --2- 172.21.15.87:0/4229471069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad03cc9790 0x55ad03cd3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.045+0000 7fa996ffd640 1 -- 172.21.15.87:0/4229471069 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad03cd4950 msgr2=0x55ad03cd17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:38.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.045+0000 7fa996ffd640 1 --2- 172.21.15.87:0/4229471069 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad03cd4950 0x55ad03cd17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.045+0000 7fa996ffd640 1 -- 172.21.15.87:0/4229471069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad03cc9790 msgr2=0x55ad03cd3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:38.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.045+0000 7fa996ffd640 1 --2- 172.21.15.87:0/4229471069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad03cc9790 0x55ad03cd3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.045+0000 7fa996ffd640 1 -- 172.21.15.87:0/4229471069 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa98800b980 con 0x55ad03cca0b0 2024-09-13T17:23:38.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.046+0000 7fa996ffd640 1 --2- 172.21.15.87:0/4229471069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad03cca0b0 0x55ad03cd1280 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fa9880051e0 tx=0x7fa988005210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4359458c271051 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:38.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.046+0000 7fa97e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:23:38.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.046+0000 7fa97e7fc640 1 -- 172.21.15.87:0/4229471069 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98801f070 con 0x55ad03cca0b0 2024-09-13T17:23:38.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.046+0000 7fa9a02a4740 1 -- 172.21.15.87:0/4229471069 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ad03c56b80 con 0x55ad03cca0b0 2024-09-13T17:23:38.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.046+0000 7fa97e7fc640 1 -- 172.21.15.87:0/4229471069 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fa988017070 con 0x55ad03cca0b0 2024-09-13T17:23:38.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.046+0000 7fa97e7fc640 1 -- 172.21.15.87:0/4229471069 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa988004220 con 0x55ad03cca0b0 2024-09-13T17:23:38.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.046+0000 7fa9a02a4740 10 client.18069 fetch_fsmap learned FSMap version 36 2024-09-13T17:23:38.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.046+0000 7fa9a02a4740 1 -- 172.21.15.87:0/4229471069 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55ad03c2b3c0 con 0x55ad03cca0b0 2024-09-13T17:23:38.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.046+0000 7fa97e7fc640 1 -- 172.21.15.87:0/4229471069 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55ad03c56b80 con 0x55ad03cca0b0 2024-09-13T17:23:38.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.046+0000 7fa97e7fc640 1 -- 172.21.15.87:0/4229471069 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fa988003960 con 0x55ad03cca0b0 2024-09-13T17:23:38.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.046+0000 7fa9a02a4740 10 client.18069 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:23:38.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.046+0000 7fa9a02a4740 10 client.18069 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:23:38.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.046+0000 7fa9a02a4740 20 client.18069 populate_metadata read hostname 'smithi087' 2024-09-13T17:23:38.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.046+0000 7fa9a02a4740 1 --2- 172.21.15.87:0/4229471069 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55ad03ce4250 0x55ad03ce6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.046+0000 7fa9a02a4740 4 client.18069 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:23:38.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.046+0000 7fa9a02a4740 1 -- 172.21.15.87:0/4229471069 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ad03c1f1f0 con 0x55ad03ce4250 2024-09-13T17:23:38.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.047+0000 7fa98ffff640 1 --2- 172.21.15.87:0/4229471069 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55ad03ce4250 0x55ad03ce6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.047+0000 7fa97e7fc640 10 client.18069 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:23:38.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.047+0000 7fa98ffff640 1 --2- 172.21.15.87:0/4229471069 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55ad03ce4250 0x55ad03ce6670 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=29e2fa6ac1c1908c server_cookie=c6c749b27055017c in_seq=0 out_seq=0 2024-09-13T17:23:38.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.047+0000 7fa97e7fc640 1 -- 172.21.15.87:0/4229471069 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55ad03c1f1f0 con 0x55ad03ce4250 2024-09-13T17:23:38.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.047+0000 7fa97e7fc640 10 client.18069 handle_command_reply: tid=0 2024-09-13T17:23:38.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.048+0000 7fa9a02a4740 1 client.18069 shutdown 2024-09-13T17:23:38.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.048+0000 7fa9a02a4740 1 -- 172.21.15.87:0/4229471069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad03cca0b0 msgr2=0x55ad03cd1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:38.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.048+0000 7fa9a02a4740 1 --2- 172.21.15.87:0/4229471069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad03cca0b0 0x55ad03cd1280 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fa9880051e0 tx=0x7fa988005210 comp rx=0 tx=0).stop 2024-09-13T17:23:38.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.048+0000 7fa9a02a4740 1 -- 172.21.15.87:0/4229471069 shutdown_connections 2024-09-13T17:23:38.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.048+0000 7fa9a02a4740 1 --2- 172.21.15.87:0/4229471069 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55ad03ce4250 0x55ad03ce6670 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.048+0000 7fa9a02a4740 1 --2- 172.21.15.87:0/4229471069 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad03cd4950 0x55ad03cd17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.048+0000 7fa97e7fc640 0 client.18069 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:23:38.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.048+0000 7fa9a02a4740 1 --2- 172.21.15.87:0/4229471069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad03cca0b0 0x55ad03cd1280 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.048+0000 7fa9a02a4740 1 --2- 172.21.15.87:0/4229471069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad03cc9790 0x55ad03cd3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.048+0000 7fa9a02a4740 1 -- 172.21.15.87:0/4229471069 >> 172.21.15.87:0/4229471069 conn(0x55ad03cc5d00 msgr2=0x55ad03ccba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:38.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.048+0000 7fa9a02a4740 1 -- 172.21.15.87:0/4229471069 shutdown_connections 2024-09-13T17:23:38.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.048+0000 7fa9a02a4740 1 -- 172.21.15.87:0/4229471069 wait complete. 2024-09-13T17:23:38.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.048+0000 7fa9a02a4740 20 client.18069 trim_cache size 0 max 16384 2024-09-13T17:23:38.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.059+0000 7fa9a02a4740 1 Processor -- start 2024-09-13T17:23:38.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.059+0000 7fa9a02a4740 1 -- start start 2024-09-13T17:23:38.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.059+0000 7fa9a02a4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad03cc9790 0x55ad03cc56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.059+0000 7fa9a02a4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad03cca0b0 0x55ad03cdb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.059+0000 7fa9a02a4740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad03cd4950 0x55ad03cdbb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.059+0000 7fa9a02a4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad03c56b80 con 0x55ad03cc9790 2024-09-13T17:23:38.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.059+0000 7fa9a02a4740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad03cca750 con 0x55ad03cd4950 2024-09-13T17:23:38.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.059+0000 7fa9a02a4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad03ce4080 con 0x55ad03cca0b0 2024-09-13T17:23:38.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.059+0000 7fa98ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad03cc9790 0x55ad03cc56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.059+0000 7fa98ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad03cc9790 0x55ad03cc56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56736/0 (socket says 172.21.15.87:56736) 2024-09-13T17:23:38.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.059+0000 7fa98ffff640 1 -- 172.21.15.87:0/1014120766 learned_addr learned my addr 172.21.15.87:0/1014120766 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:38.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.059+0000 7fa996ffd640 1 --2- 172.21.15.87:0/1014120766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad03cca0b0 0x55ad03cdb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.059+0000 7fa98ffff640 1 -- 172.21.15.87:0/1014120766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad03cca0b0 msgr2=0x55ad03cdb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:38.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.059+0000 7fa98ffff640 1 --2- 172.21.15.87:0/1014120766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad03cca0b0 0x55ad03cdb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.059+0000 7fa98ffff640 1 -- 172.21.15.87:0/1014120766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad03cd4950 msgr2=0x55ad03cdbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:38.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.059+0000 7fa98ffff640 1 --2- 172.21.15.87:0/1014120766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad03cd4950 0x55ad03cdbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.059+0000 7fa98ffff640 1 -- 172.21.15.87:0/1014120766 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad03bcd770 con 0x55ad03cc9790 2024-09-13T17:23:38.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.059+0000 7fa996ffd640 1 --2- 172.21.15.87:0/1014120766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad03cca0b0 0x55ad03cdb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:23:38.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.059+0000 7fa98ffff640 1 --2- 172.21.15.87:0/1014120766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad03cc9790 0x55ad03cc56a0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fa980005ec0 tx=0x7fa980005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c4413fc21e97224 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:38.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.060+0000 7fa98dffb640 1 -- 172.21.15.87:0/1014120766 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa980042070 con 0x55ad03cc9790 2024-09-13T17:23:38.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.060+0000 7fa98dffb640 1 -- 172.21.15.87:0/1014120766 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa9800318b0 con 0x55ad03cc9790 2024-09-13T17:23:38.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.060+0000 7fa98dffb640 1 -- 172.21.15.87:0/1014120766 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa980005290 con 0x55ad03cc9790 2024-09-13T17:23:38.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.060+0000 7fa9a02a4740 1 -- 172.21.15.87:0/1014120766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad03cc9790 msgr2=0x55ad03cc56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:38.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.060+0000 7fa9a02a4740 1 --2- 172.21.15.87:0/1014120766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad03cc9790 0x55ad03cc56a0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fa980005ec0 tx=0x7fa980005c00 comp rx=0 tx=0).stop 2024-09-13T17:23:38.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.060+0000 7fa9a02a4740 1 -- 172.21.15.87:0/1014120766 shutdown_connections 2024-09-13T17:23:38.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.060+0000 7fa9a02a4740 1 --2- 172.21.15.87:0/1014120766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad03cd4950 0x55ad03cdbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.060+0000 7fa9a02a4740 1 --2- 172.21.15.87:0/1014120766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad03cca0b0 0x55ad03cdb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.060+0000 7fa9a02a4740 1 --2- 172.21.15.87:0/1014120766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad03cc9790 0x55ad03cc56a0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.060+0000 7fa9a02a4740 1 -- 172.21.15.87:0/1014120766 >> 172.21.15.87:0/1014120766 conn(0x55ad03cc5d00 msgr2=0x55ad03ce00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:38.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.060+0000 7fa9a02a4740 1 -- 172.21.15.87:0/1014120766 shutdown_connections 2024-09-13T17:23:38.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.060+0000 7fa9a02a4740 1 -- 172.21.15.87:0/1014120766 wait complete. 2024-09-13T17:23:38.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.061+0000 7fa9a02a4740 1 -- start start 2024-09-13T17:23:38.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.061+0000 7fa9a02a4740 1 Processor -- start 2024-09-13T17:23:38.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.061+0000 7fa9a02a4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad03cc9790 0x55ad03cdb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.061+0000 7fa9a02a4740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad03cca0b0 0x55ad03cd7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.061+0000 7fa9a02a4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad03cd4950 0x55ad03cd8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.061+0000 7fa9a02a4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad03cd8a20 con 0x55ad03cd4950 2024-09-13T17:23:38.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.061+0000 7fa9a02a4740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad03cd8b90 con 0x55ad03cca0b0 2024-09-13T17:23:38.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.061+0000 7fa9a02a4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad03d3eb80 con 0x55ad03cc9790 2024-09-13T17:23:38.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.061+0000 7fa9a02a4740 10 client.0 _ll_register_callbacks cb 0x7fa98800b810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:23:38.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.061+0000 7fa98ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad03cd4950 0x55ad03cd8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.061+0000 7fa98ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad03cd4950 0x55ad03cd8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56746/0 (socket says 172.21.15.87:56746) 2024-09-13T17:23:38.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.061+0000 7fa98ffff640 1 -- 172.21.15.87:0/3397427958 learned_addr learned my addr 172.21.15.87:0/3397427958 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:38.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.061+0000 7fa98ffff640 1 --2- 172.21.15.87:0/3397427958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad03cc9790 0x55ad03cdb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.061+0000 7fa996ffd640 1 --2- 172.21.15.87:0/3397427958 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad03cca0b0 0x55ad03cd7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.061+0000 7fa98ffff640 1 -- 172.21.15.87:0/3397427958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad03cc9790 msgr2=0x55ad03cdb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:38.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.061+0000 7fa98ffff640 1 --2- 172.21.15.87:0/3397427958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad03cc9790 0x55ad03cdb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.061+0000 7fa98ffff640 1 -- 172.21.15.87:0/3397427958 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad03cca0b0 msgr2=0x55ad03cd7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:38.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.061+0000 7fa98ffff640 1 --2- 172.21.15.87:0/3397427958 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad03cca0b0 0x55ad03cd7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.061+0000 7fa98ffff640 1 -- 172.21.15.87:0/3397427958 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9980675a0 con 0x55ad03cd4950 2024-09-13T17:23:38.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.061+0000 7fa98ffff640 1 --2- 172.21.15.87:0/3397427958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad03cd4950 0x55ad03cd8350 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fa98002a940 tx=0x7fa980000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33e20870a9a8ba89 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:38.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.061+0000 7fa97e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:23:38.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.062+0000 7fa97e7fc640 1 -- 172.21.15.87:0/3397427958 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa980042040 con 0x55ad03cd4950 2024-09-13T17:23:38.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.062+0000 7fa97e7fc640 1 -- 172.21.15.87:0/3397427958 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fa980031400 con 0x55ad03cd4950 2024-09-13T17:23:38.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.062+0000 7fa9a02a4740 1 -- 172.21.15.87:0/3397427958 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ad039204e0 con 0x55ad03cd4950 2024-09-13T17:23:38.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.062+0000 7fa97e7fc640 1 -- 172.21.15.87:0/3397427958 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9800315c0 con 0x55ad03cd4950 2024-09-13T17:23:38.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.062+0000 7fa9a02a4740 10 client.18075 fetch_fsmap learned FSMap version 36 2024-09-13T17:23:38.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.062+0000 7fa9a02a4740 1 -- 172.21.15.87:0/3397427958 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55ad03bf2e80 con 0x55ad03cd4950 2024-09-13T17:23:38.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.062+0000 7fa97e7fc640 1 -- 172.21.15.87:0/3397427958 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55ad039204e0 con 0x55ad03cd4950 2024-09-13T17:23:38.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.062+0000 7fa97e7fc640 1 -- 172.21.15.87:0/3397427958 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fa980003680 con 0x55ad03cd4950 2024-09-13T17:23:38.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.062+0000 7fa9a02a4740 10 client.18075 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:23:38.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.062+0000 7fa9a02a4740 10 client.18075 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:23:38.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.062+0000 7fa9a02a4740 20 client.18075 populate_metadata read hostname 'smithi087' 2024-09-13T17:23:38.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.062+0000 7fa9a02a4740 1 --2- 172.21.15.87:0/3397427958 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55ad03d3fea0 0x55ad03d42290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.062+0000 7fa9a02a4740 4 client.18075 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:23:38.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.062+0000 7fa9a02a4740 1 -- 172.21.15.87:0/3397427958 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ad039317e0 con 0x55ad03d3fea0 2024-09-13T17:23:38.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.062+0000 7fa996ffd640 1 --2- 172.21.15.87:0/3397427958 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55ad03d3fea0 0x55ad03d42290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.063+0000 7fa97e7fc640 10 client.18075 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:23:38.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.063+0000 7fa996ffd640 1 --2- 172.21.15.87:0/3397427958 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55ad03d3fea0 0x55ad03d42290 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c1ab0119fd01f6a9 server_cookie=2aec301d44e56eb5 in_seq=0 out_seq=0 2024-09-13T17:23:38.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.063+0000 7fa97e7fc640 1 -- 172.21.15.87:0/3397427958 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ad039317e0 con 0x55ad03d3fea0 2024-09-13T17:23:38.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.063+0000 7fa97e7fc640 10 client.18075 handle_command_reply: tid=0 2024-09-13T17:23:38.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.063+0000 7fa9a02a4740 1 client.18075 shutdown 2024-09-13T17:23:38.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.063+0000 7fa9a02a4740 1 -- 172.21.15.87:0/3397427958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad03cd4950 msgr2=0x55ad03cd8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:38.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.063+0000 7fa9a02a4740 1 --2- 172.21.15.87:0/3397427958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad03cd4950 0x55ad03cd8350 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fa98002a940 tx=0x7fa980000bc0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.063+0000 7fa9a02a4740 1 -- 172.21.15.87:0/3397427958 shutdown_connections 2024-09-13T17:23:38.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.063+0000 7fa9a02a4740 1 --2- 172.21.15.87:0/3397427958 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x55ad03d3fea0 0x55ad03d42290 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.063+0000 7fa9a02a4740 1 --2- 172.21.15.87:0/3397427958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ad03cd4950 0x55ad03cd8350 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.063+0000 7fa9a02a4740 1 --2- 172.21.15.87:0/3397427958 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ad03cca0b0 0x55ad03cd7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.063+0000 7fa97e7fc640 0 client.18075 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:23:38.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.063+0000 7fa9a02a4740 1 --2- 172.21.15.87:0/3397427958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ad03cc9790 0x55ad03cdb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.063+0000 7fa9a02a4740 1 -- 172.21.15.87:0/3397427958 >> 172.21.15.87:0/3397427958 conn(0x55ad03cc5d00 msgr2=0x55ad03ccfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:38.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.063+0000 7fa9a02a4740 1 -- 172.21.15.87:0/3397427958 shutdown_connections 2024-09-13T17:23:38.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.063+0000 7fa9a02a4740 1 -- 172.21.15.87:0/3397427958 wait complete. 2024-09-13T17:23:38.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.063+0000 7fa9a02a4740 20 client.18075 trim_cache size 0 max 16384 2024-09-13T17:23:38.072 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:23:38.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.064+0000 7fa99d584640 1 -- 172.21.15.87:0/2219007245 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa9840a1280 msgr2=0x7fa9840a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:38.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.064+0000 7fa99d584640 1 --2- 172.21.15.87:0/2219007245 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa9840a1280 0x7fa9840a3740 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa9900ca5a0 tx=0x7fa990000f40 comp rx=0 tx=0).stop 2024-09-13T17:23:38.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.064+0000 7fa99d584640 1 -- 172.21.15.87:0/2219007245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa99819ac30 msgr2=0x7fa99819b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:38.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.064+0000 7fa99d584640 1 --2- 172.21.15.87:0/2219007245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa99819ac30 0x7fa99819b0e0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fa99000eaa0 tx=0x7fa99000ef60 comp rx=0 tx=0).stop 2024-09-13T17:23:38.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.064+0000 7fa99d584640 1 -- 172.21.15.87:0/2219007245 shutdown_connections 2024-09-13T17:23:38.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.064+0000 7fa99d584640 1 --2- 172.21.15.87:0/2219007245 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa9840a1280 0x7fa9840a3740 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.064+0000 7fa99d584640 1 --2- 172.21.15.87:0/2219007245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa99819ac30 0x7fa99819b0e0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.064+0000 7fa99d584640 1 --2- 172.21.15.87:0/2219007245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa998104080 0x7fa998196840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.064+0000 7fa99d584640 1 --2- 172.21.15.87:0/2219007245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9980ff2d0 0x7fa998196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.064+0000 7fa99d584640 1 -- 172.21.15.87:0/2219007245 >> 172.21.15.87:0/2219007245 conn(0x7fa9980749b0 msgr2=0x7fa9980fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:38.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.064+0000 7fa99d584640 1 -- 172.21.15.87:0/2219007245 shutdown_connections 2024-09-13T17:23:38.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.064+0000 7fa99d584640 1 -- 172.21.15.87:0/2219007245 wait complete. 2024-09-13T17:23:38.075 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-09-13T17:23:38.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.174+0000 7fe2919b5640 1 -- 172.21.15.87:0/3518187637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe28c0ff8d0 msgr2=0x7fe28c103910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:38.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.174+0000 7fe2919b5640 1 --2- 172.21.15.87:0/3518187637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe28c0ff8d0 0x7fe28c103910 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fe274009930 tx=0x7fe27402a420 comp rx=0 tx=0).stop 2024-09-13T17:23:38.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.174+0000 7fe2919b5640 1 -- 172.21.15.87:0/3518187637 shutdown_connections 2024-09-13T17:23:38.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.174+0000 7fe2919b5640 1 --2- 172.21.15.87:0/3518187637 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe28c104070 0x7fe28c10bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.174+0000 7fe2919b5640 1 --2- 172.21.15.87:0/3518187637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe28c0ff8d0 0x7fe28c103910 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.174+0000 7fe2919b5640 1 --2- 172.21.15.87:0/3518187637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe28c0fef20 0x7fe28c0ff300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.174+0000 7fe2919b5640 1 -- 172.21.15.87:0/3518187637 >> 172.21.15.87:0/3518187637 conn(0x7fe28c0fa970 msgr2=0x7fe28c0fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:38.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.174+0000 7fe2919b5640 1 -- 172.21.15.87:0/3518187637 shutdown_connections 2024-09-13T17:23:38.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.174+0000 7fe2919b5640 1 -- 172.21.15.87:0/3518187637 wait complete. 2024-09-13T17:23:38.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.175+0000 7fe2919b5640 1 Processor -- start 2024-09-13T17:23:38.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.175+0000 7fe2919b5640 1 -- start start 2024-09-13T17:23:38.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.175+0000 7fe2919b5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe28c0fef20 0x7fe28c197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.175+0000 7fe2919b5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe28c104070 0x7fe28c1979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.175+0000 7fe2919b5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe28c197f80 0x7fe28c1a24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.175+0000 7fe2919b5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c1a2c20 con 0x7fe28c197f80 2024-09-13T17:23:38.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.175+0000 7fe2919b5640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c1a2d90 con 0x7fe28c0fef20 2024-09-13T17:23:38.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.175+0000 7fe2919b5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c1a2f50 con 0x7fe28c104070 2024-09-13T17:23:38.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.175+0000 7fe28b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe28c197f80 0x7fe28c1a24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.175+0000 7fe28b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe28c197f80 0x7fe28c1a24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56758/0 (socket says 172.21.15.87:56758) 2024-09-13T17:23:38.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.175+0000 7fe28b7fe640 1 -- 172.21.15.87:0/2580626844 learned_addr learned my addr 172.21.15.87:0/2580626844 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:38.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.175+0000 7fe2827fc640 1 --2- 172.21.15.87:0/2580626844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe28c104070 0x7fe28c1979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.176+0000 7fe28affd640 1 --2- 172.21.15.87:0/2580626844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe28c0fef20 0x7fe28c197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.176+0000 7fe28b7fe640 1 -- 172.21.15.87:0/2580626844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe28c104070 msgr2=0x7fe28c1979a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:38.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.176+0000 7fe28b7fe640 1 --2- 172.21.15.87:0/2580626844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe28c104070 0x7fe28c1979a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.176+0000 7fe28b7fe640 1 -- 172.21.15.87:0/2580626844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe28c0fef20 msgr2=0x7fe28c197460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:38.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.176+0000 7fe28b7fe640 1 --2- 172.21.15.87:0/2580626844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe28c0fef20 0x7fe28c197460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.176+0000 7fe28b7fe640 1 -- 172.21.15.87:0/2580626844 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe274009560 con 0x7fe28c197f80 2024-09-13T17:23:38.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.176+0000 7fe2827fc640 1 --2- 172.21.15.87:0/2580626844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe28c104070 0x7fe28c1979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:23:38.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.176+0000 7fe28b7fe640 1 --2- 172.21.15.87:0/2580626844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe28c197f80 0x7fe28c1a24e0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fe28400cce0 tx=0x7fe28400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:38.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.176+0000 7fe2909b3640 1 -- 172.21.15.87:0/2580626844 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28400f450 con 0x7fe28c197f80 2024-09-13T17:23:38.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.176+0000 7fe2909b3640 1 -- 172.21.15.87:0/2580626844 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe28400fa60 con 0x7fe28c197f80 2024-09-13T17:23:38.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.176+0000 7fe2919b5640 1 -- 172.21.15.87:0/2580626844 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe28c1a3230 con 0x7fe28c197f80 2024-09-13T17:23:38.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.176+0000 7fe2909b3640 1 -- 172.21.15.87:0/2580626844 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe284018b10 con 0x7fe28c197f80 2024-09-13T17:23:38.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.176+0000 7fe2919b5640 1 -- 172.21.15.87:0/2580626844 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe28c1a36c0 con 0x7fe28c197f80 2024-09-13T17:23:38.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.178+0000 7fe2946d4740 1 Processor -- start 2024-09-13T17:23:38.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.178+0000 7fe2909b3640 1 -- 172.21.15.87:0/2580626844 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fe28400fbd0 con 0x7fe28c197f80 2024-09-13T17:23:38.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.178+0000 7fe2946d4740 1 -- start start 2024-09-13T17:23:38.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.179+0000 7fe2946d4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8787df790 0x55d8787dfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.179+0000 7fe2946d4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8787e00b0 0x55d8787ea410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.179+0000 7fe2946d4740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8787ea950 0x55d8787ecd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.179+0000 7fe2946d4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d878749cc0 con 0x55d8787e00b0 2024-09-13T17:23:38.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.179+0000 7fe2946d4740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d878747450 con 0x55d8787ea950 2024-09-13T17:23:38.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.179+0000 7fe2946d4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d878742d40 con 0x55d8787df790 2024-09-13T17:23:38.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.179+0000 7fe28affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8787e00b0 0x55d8787ea410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.179+0000 7fe28affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8787e00b0 0x55d8787ea410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56766/0 (socket says 172.21.15.87:56766) 2024-09-13T17:23:38.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.179+0000 7fe28affd640 1 -- 172.21.15.87:0/4203628234 learned_addr learned my addr 172.21.15.87:0/4203628234 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:38.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.179+0000 7fe2827fc640 1 --2- 172.21.15.87:0/4203628234 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8787df790 0x55d8787dfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.179+0000 7fe2827fc640 1 --2- 172.21.15.87:0/4203628234 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8787ea950 0x55d8787ecd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.179+0000 7fe28affd640 1 -- 172.21.15.87:0/4203628234 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8787df790 msgr2=0x55d8787dfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:38.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.179+0000 7fe28affd640 1 --2- 172.21.15.87:0/4203628234 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8787df790 0x55d8787dfb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.179+0000 7fe28affd640 1 -- 172.21.15.87:0/4203628234 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8787ea950 msgr2=0x55d8787ecd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:38.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.179+0000 7fe28affd640 1 --2- 172.21.15.87:0/4203628234 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8787ea950 0x55d8787ecd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.179+0000 7fe28affd640 1 -- 172.21.15.87:0/4203628234 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d87870a620 con 0x55d8787e00b0 2024-09-13T17:23:38.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.179+0000 7fe2827fc640 1 --2- 172.21.15.87:0/4203628234 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8787ea950 0x55d8787ecd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:23:38.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.179+0000 7fe2909b3640 1 --2- 172.21.15.87:0/2580626844 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe2780a1200 0x7fe2780a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.179+0000 7fe2827fc640 1 --2- 172.21.15.87:0/2580626844 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe2780a1200 0x7fe2780a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.179+0000 7fe28affd640 1 --2- 172.21.15.87:0/4203628234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8787e00b0 0x55d8787ea410 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00cbf0 tx=0x7fe27c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a5f51058604f18 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:38.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.179+0000 7fe2909b3640 1 -- 172.21.15.87:0/2580626844 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fe2840cd540 con 0x7fe28c197f80 2024-09-13T17:23:38.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.179+0000 7fe281ffb640 1 -- 172.21.15.87:0/4203628234 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c010630 con 0x55d8787e00b0 2024-09-13T17:23:38.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.179+0000 7fe281ffb640 1 -- 172.21.15.87:0/4203628234 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe27c010c40 con 0x55d8787e00b0 2024-09-13T17:23:38.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.180+0000 7fe281ffb640 1 -- 172.21.15.87:0/4203628234 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c019ab0 con 0x55d8787e00b0 2024-09-13T17:23:38.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.180+0000 7fe2946d4740 1 -- 172.21.15.87:0/4203628234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8787e00b0 msgr2=0x55d8787ea410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:38.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.180+0000 7fe2827fc640 1 --2- 172.21.15.87:0/2580626844 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe2780a1200 0x7fe2780a36c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe274009900 tx=0x7fe274000bc0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:38.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.180+0000 7fe2946d4740 1 --2- 172.21.15.87:0/4203628234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8787e00b0 0x55d8787ea410 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00cbf0 tx=0x7fe27c00e720 comp rx=0 tx=0).stop 2024-09-13T17:23:38.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.180+0000 7fe2946d4740 1 -- 172.21.15.87:0/4203628234 shutdown_connections 2024-09-13T17:23:38.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.180+0000 7fe2946d4740 1 --2- 172.21.15.87:0/4203628234 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8787ea950 0x55d8787ecd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.180+0000 7fe2946d4740 1 --2- 172.21.15.87:0/4203628234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8787e00b0 0x55d8787ea410 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.180+0000 7fe2946d4740 1 --2- 172.21.15.87:0/4203628234 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8787df790 0x55d8787dfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.180+0000 7fe2946d4740 1 -- 172.21.15.87:0/4203628234 >> 172.21.15.87:0/4203628234 conn(0x55d8787dbd00 msgr2=0x55d8787dc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:38.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.180+0000 7fe2946d4740 1 -- 172.21.15.87:0/4203628234 shutdown_connections 2024-09-13T17:23:38.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.180+0000 7fe2946d4740 1 -- 172.21.15.87:0/4203628234 wait complete. 2024-09-13T17:23:38.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.181+0000 7fe2946d4740 1 -- start start 2024-09-13T17:23:38.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.181+0000 7fe2946d4740 1 Processor -- start 2024-09-13T17:23:38.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.181+0000 7fe2946d4740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8787df790 0x55d8787e9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.181+0000 7fe2946d4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8787e00b0 0x55d8787ea410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.181+0000 7fe2946d4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8787ea950 0x55d8787e7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.181+0000 7fe2946d4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d878701180 con 0x55d8787ea950 2024-09-13T17:23:38.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.181+0000 7fe2946d4740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d87841b430 con 0x55d8787df790 2024-09-13T17:23:38.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.181+0000 7fe2946d4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8786c65e0 con 0x55d8787e00b0 2024-09-13T17:23:38.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.181+0000 7fe2946d4740 10 client.0 _ll_register_callbacks cb 0x55d878732aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:23:38.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.181+0000 7fe28b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8787ea950 0x55d8787e7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.181+0000 7fe28b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8787ea950 0x55d8787e7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56780/0 (socket says 172.21.15.87:56780) 2024-09-13T17:23:38.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.181+0000 7fe28b7fe640 1 -- 172.21.15.87:0/3877558099 learned_addr learned my addr 172.21.15.87:0/3877558099 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:38.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.181+0000 7fe2827fc640 1 --2- 172.21.15.87:0/3877558099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8787e00b0 0x55d8787ea410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.181+0000 7fe28affd640 1 --2- 172.21.15.87:0/3877558099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8787df790 0x55d8787e9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.181+0000 7fe28b7fe640 1 -- 172.21.15.87:0/3877558099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8787e00b0 msgr2=0x55d8787ea410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:38.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.181+0000 7fe28b7fe640 1 --2- 172.21.15.87:0/3877558099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8787e00b0 0x55d8787ea410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.181+0000 7fe28b7fe640 1 -- 172.21.15.87:0/3877558099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8787df790 msgr2=0x55d8787e9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:38.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.181+0000 7fe28b7fe640 1 --2- 172.21.15.87:0/3877558099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8787df790 0x55d8787e9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.181+0000 7fe28b7fe640 1 -- 172.21.15.87:0/3877558099 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe27c00c850 con 0x55d8787ea950 2024-09-13T17:23:38.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.181+0000 7fe2827fc640 1 --2- 172.21.15.87:0/3877558099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8787e00b0 0x55d8787ea410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:23:38.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.182+0000 7fe28b7fe640 1 --2- 172.21.15.87:0/3877558099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8787ea950 0x55d8787e7460 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fe2840a21d0 tx=0x7fe284099eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f412f587c1235dcf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:38.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.182+0000 7fe26affd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:23:38.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.182+0000 7fe26affd640 1 -- 172.21.15.87:0/3877558099 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28409e0b0 con 0x55d8787ea950 2024-09-13T17:23:38.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.182+0000 7fe26affd640 1 -- 172.21.15.87:0/3877558099 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fe2840a2700 con 0x55d8787ea950 2024-09-13T17:23:38.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.182+0000 7fe2946d4740 1 -- 172.21.15.87:0/3877558099 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d87876cb80 con 0x55d8787ea950 2024-09-13T17:23:38.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.182+0000 7fe26affd640 1 -- 172.21.15.87:0/3877558099 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe284061070 con 0x55d8787ea950 2024-09-13T17:23:38.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.182+0000 7fe2946d4740 10 client.18087 fetch_fsmap learned FSMap version 36 2024-09-13T17:23:38.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.182+0000 7fe2946d4740 1 -- 172.21.15.87:0/3877558099 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55d8787413c0 con 0x55d8787ea950 2024-09-13T17:23:38.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.182+0000 7fe26affd640 1 -- 172.21.15.87:0/3877558099 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55d87876cb80 con 0x55d8787ea950 2024-09-13T17:23:38.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.182+0000 7fe26affd640 1 -- 172.21.15.87:0/3877558099 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fe284016020 con 0x55d8787ea950 2024-09-13T17:23:38.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.182+0000 7fe2946d4740 10 client.18087 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:23:38.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.182+0000 7fe2946d4740 10 client.18087 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:23:38.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.182+0000 7fe2946d4740 20 client.18087 populate_metadata read hostname 'smithi087' 2024-09-13T17:23:38.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.182+0000 7fe2946d4740 1 --2- 172.21.15.87:0/3877558099 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55d8787fa180 0x55d8787fc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.182+0000 7fe2946d4740 4 client.18087 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:23:38.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.182+0000 7fe2946d4740 1 -- 172.21.15.87:0/3877558099 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d8787351f0 con 0x55d8787fa180 2024-09-13T17:23:38.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.182+0000 7fe28affd640 1 --2- 172.21.15.87:0/3877558099 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55d8787fa180 0x55d8787fc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.183+0000 7fe28affd640 1 --2- 172.21.15.87:0/3877558099 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55d8787fa180 0x55d8787fc5a0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=72553072a46de01 server_cookie=2aee9951816db565 in_seq=0 out_seq=0 2024-09-13T17:23:38.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.183+0000 7fe26affd640 10 client.18087 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:23:38.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.183+0000 7fe26affd640 1 -- 172.21.15.87:0/3877558099 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55d8787351f0 con 0x55d8787fa180 2024-09-13T17:23:38.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.183+0000 7fe26affd640 10 client.18087 handle_command_reply: tid=0 2024-09-13T17:23:38.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.183+0000 7fe2946d4740 1 client.18087 shutdown 2024-09-13T17:23:38.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.184+0000 7fe2946d4740 1 -- 172.21.15.87:0/3877558099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8787ea950 msgr2=0x55d8787e7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:38.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.184+0000 7fe2946d4740 1 --2- 172.21.15.87:0/3877558099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8787ea950 0x55d8787e7460 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fe2840a21d0 tx=0x7fe284099eb0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.184+0000 7fe2946d4740 1 -- 172.21.15.87:0/3877558099 shutdown_connections 2024-09-13T17:23:38.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.184+0000 7fe2946d4740 1 --2- 172.21.15.87:0/3877558099 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55d8787fa180 0x55d8787fc5a0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.184+0000 7fe2946d4740 1 --2- 172.21.15.87:0/3877558099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8787ea950 0x55d8787e7460 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.184+0000 7fe2946d4740 1 --2- 172.21.15.87:0/3877558099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8787e00b0 0x55d8787ea410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.184+0000 7fe2946d4740 1 --2- 172.21.15.87:0/3877558099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8787df790 0x55d8787e9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.184+0000 7fe26affd640 0 client.18087 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:23:38.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.184+0000 7fe2946d4740 1 -- 172.21.15.87:0/3877558099 >> 172.21.15.87:0/3877558099 conn(0x55d8787dbd00 msgr2=0x55d8787e1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:38.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.184+0000 7fe2946d4740 1 -- 172.21.15.87:0/3877558099 shutdown_connections 2024-09-13T17:23:38.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.184+0000 7fe2946d4740 1 -- 172.21.15.87:0/3877558099 wait complete. 2024-09-13T17:23:38.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.184+0000 7fe2946d4740 20 client.18087 trim_cache size 0 max 16384 2024-09-13T17:23:38.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.194+0000 7fe2946d4740 1 Processor -- start 2024-09-13T17:23:38.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.195+0000 7fe2946d4740 1 -- start start 2024-09-13T17:23:38.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.195+0000 7fe2946d4740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8787df790 0x55d8787f1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.195+0000 7fe2946d4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8787e00b0 0x55d8787f1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.195+0000 7fe2946d4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8787ea950 0x55d8787e5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.195+0000 7fe2946d4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8787dc9f0 con 0x55d8787e00b0 2024-09-13T17:23:38.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.195+0000 7fe2946d4740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8787f9fa0 con 0x55d8787df790 2024-09-13T17:23:38.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.195+0000 7fe2946d4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8787f6f50 con 0x55d8787ea950 2024-09-13T17:23:38.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.195+0000 7fe2827fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8787e00b0 0x55d8787f1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.195+0000 7fe2827fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8787e00b0 0x55d8787f1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56794/0 (socket says 172.21.15.87:56794) 2024-09-13T17:23:38.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.195+0000 7fe2827fc640 1 -- 172.21.15.87:0/3131116167 learned_addr learned my addr 172.21.15.87:0/3131116167 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:38.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.195+0000 7fe28affd640 1 --2- 172.21.15.87:0/3131116167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8787df790 0x55d8787f1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.195+0000 7fe2827fc640 1 -- 172.21.15.87:0/3131116167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8787ea950 msgr2=0x55d8787e5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:38.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.195+0000 7fe2827fc640 1 --2- 172.21.15.87:0/3131116167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8787ea950 0x55d8787e5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.195+0000 7fe2827fc640 1 -- 172.21.15.87:0/3131116167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8787df790 msgr2=0x55d8787f1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:38.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.195+0000 7fe2827fc640 1 --2- 172.21.15.87:0/3131116167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8787df790 0x55d8787f1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.195+0000 7fe2827fc640 1 -- 172.21.15.87:0/3131116167 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8786e3770 con 0x55d8787e00b0 2024-09-13T17:23:38.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.195+0000 7fe2827fc640 1 --2- 172.21.15.87:0/3131116167 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8787e00b0 0x55d8787f1b60 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fe2740057c0 tx=0x7fe27403f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d96881d352ae171 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:38.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.195+0000 7fe282ffd640 1 -- 172.21.15.87:0/3131116167 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2740036b0 con 0x55d8787e00b0 2024-09-13T17:23:38.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.195+0000 7fe282ffd640 1 -- 172.21.15.87:0/3131116167 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe274003cc0 con 0x55d8787e00b0 2024-09-13T17:23:38.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.195+0000 7fe282ffd640 1 -- 172.21.15.87:0/3131116167 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27403ddb0 con 0x55d8787e00b0 2024-09-13T17:23:38.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.196+0000 7fe2946d4740 1 -- 172.21.15.87:0/3131116167 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8787e00b0 msgr2=0x55d8787f1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:38.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.196+0000 7fe2946d4740 1 --2- 172.21.15.87:0/3131116167 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8787e00b0 0x55d8787f1b60 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fe2740057c0 tx=0x7fe27403f040 comp rx=0 tx=0).stop 2024-09-13T17:23:38.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.196+0000 7fe2946d4740 1 -- 172.21.15.87:0/3131116167 shutdown_connections 2024-09-13T17:23:38.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.196+0000 7fe2946d4740 1 --2- 172.21.15.87:0/3131116167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8787ea950 0x55d8787e5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.196+0000 7fe2946d4740 1 --2- 172.21.15.87:0/3131116167 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8787e00b0 0x55d8787f1b60 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.196+0000 7fe2946d4740 1 --2- 172.21.15.87:0/3131116167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8787df790 0x55d8787f1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.196+0000 7fe2946d4740 1 -- 172.21.15.87:0/3131116167 >> 172.21.15.87:0/3131116167 conn(0x55d8787dbd00 msgr2=0x55d878800f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:38.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.196+0000 7fe2946d4740 1 -- 172.21.15.87:0/3131116167 shutdown_connections 2024-09-13T17:23:38.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.196+0000 7fe2946d4740 1 -- 172.21.15.87:0/3131116167 wait complete. 2024-09-13T17:23:38.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.196+0000 7fe2946d4740 1 -- start start 2024-09-13T17:23:38.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.196+0000 7fe2946d4740 1 Processor -- start 2024-09-13T17:23:38.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.197+0000 7fe2946d4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8787df790 0x55d8787f1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.197+0000 7fe2946d4740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8787e00b0 0x55d8787f0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.197+0000 7fe2946d4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8787ea950 0x55d8787f07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.197+0000 7fe2946d4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8787f0ea0 con 0x55d8787ea950 2024-09-13T17:23:38.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.197+0000 7fe2946d4740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8788506b0 con 0x55d8787e00b0 2024-09-13T17:23:38.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.197+0000 7fe2946d4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d878850840 con 0x55d8787df790 2024-09-13T17:23:38.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.197+0000 7fe2946d4740 10 client.0 _ll_register_callbacks cb 0x7fe27c00c390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:23:38.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.197+0000 7fe28b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8787ea950 0x55d8787f07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.197+0000 7fe28b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8787ea950 0x55d8787f07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56798/0 (socket says 172.21.15.87:56798) 2024-09-13T17:23:38.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.197+0000 7fe28b7fe640 1 -- 172.21.15.87:0/4255234380 learned_addr learned my addr 172.21.15.87:0/4255234380 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:38.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.197+0000 7fe28affd640 1 --2- 172.21.15.87:0/4255234380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8787df790 0x55d8787f1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.197+0000 7fe2827fc640 1 --2- 172.21.15.87:0/4255234380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8787e00b0 0x55d8787f0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.197+0000 7fe28b7fe640 1 -- 172.21.15.87:0/4255234380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8787df790 msgr2=0x55d8787f1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:38.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.197+0000 7fe28b7fe640 1 --2- 172.21.15.87:0/4255234380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8787df790 0x55d8787f1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.197+0000 7fe28b7fe640 1 -- 172.21.15.87:0/4255234380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8787e00b0 msgr2=0x55d8787f0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:38.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.197+0000 7fe28b7fe640 1 --2- 172.21.15.87:0/4255234380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8787e00b0 0x55d8787f0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.197+0000 7fe28b7fe640 1 -- 172.21.15.87:0/4255234380 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe28c10c400 con 0x55d8787ea950 2024-09-13T17:23:38.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.197+0000 7fe2827fc640 1 --2- 172.21.15.87:0/4255234380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8787e00b0 0x55d8787f0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:23:38.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.197+0000 7fe28b7fe640 1 --2- 172.21.15.87:0/4255234380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8787ea950 0x55d8787f07d0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fe2840ca970 tx=0x7fe2840077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ac8d5226331cbe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:38.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.197+0000 7fe26affd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:23:38.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.197+0000 7fe26affd640 1 -- 172.21.15.87:0/4255234380 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe284061030 con 0x55d8787ea950 2024-09-13T17:23:38.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.197+0000 7fe26affd640 1 -- 172.21.15.87:0/4255234380 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fe28409a980 con 0x55d8787ea950 2024-09-13T17:23:38.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.197+0000 7fe2946d4740 1 -- 172.21.15.87:0/4255234380 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe27c010c40 con 0x55d8787ea950 2024-09-13T17:23:38.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.197+0000 7fe26affd640 1 -- 172.21.15.87:0/4255234380 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2840a2700 con 0x55d8787ea950 2024-09-13T17:23:38.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.198+0000 7fe2946d4740 10 client.18093 fetch_fsmap learned FSMap version 36 2024-09-13T17:23:38.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.198+0000 7fe2946d4740 1 -- 172.21.15.87:0/4255234380 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55d878708e80 con 0x55d8787ea950 2024-09-13T17:23:38.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.198+0000 7fe26affd640 1 -- 172.21.15.87:0/4255234380 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe27c010c40 con 0x55d8787ea950 2024-09-13T17:23:38.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.198+0000 7fe26affd640 1 -- 172.21.15.87:0/4255234380 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fe284016070 con 0x55d8787ea950 2024-09-13T17:23:38.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.198+0000 7fe2946d4740 10 client.18093 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:23:38.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.198+0000 7fe2946d4740 10 client.18093 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:23:38.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.198+0000 7fe2946d4740 20 client.18093 populate_metadata read hostname 'smithi087' 2024-09-13T17:23:38.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.198+0000 7fe2946d4740 1 --2- 172.21.15.87:0/4255234380 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55d878851c50 0x55d878854070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.198+0000 7fe2946d4740 4 client.18093 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:23:38.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.198+0000 7fe2946d4740 1 -- 172.21.15.87:0/4255234380 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d8784364e0 con 0x55d878851c50 2024-09-13T17:23:38.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.198+0000 7fe28affd640 1 --2- 172.21.15.87:0/4255234380 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55d878851c50 0x55d878854070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.198+0000 7fe26affd640 10 client.18093 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:23:38.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.198+0000 7fe28affd640 1 --2- 172.21.15.87:0/4255234380 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55d878851c50 0x55d878854070 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=522f2aa164745215 server_cookie=5dad730255feece9 in_seq=0 out_seq=0 2024-09-13T17:23:38.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.199+0000 7fe26affd640 1 -- 172.21.15.87:0/4255234380 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d8784364e0 con 0x55d878851c50 2024-09-13T17:23:38.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.199+0000 7fe26affd640 10 client.18093 handle_command_reply: tid=0 2024-09-13T17:23:38.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.199+0000 7fe2946d4740 1 client.18093 shutdown 2024-09-13T17:23:38.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.199+0000 7fe2946d4740 1 -- 172.21.15.87:0/4255234380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8787ea950 msgr2=0x55d8787f07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:38.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.199+0000 7fe2946d4740 1 --2- 172.21.15.87:0/4255234380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8787ea950 0x55d8787f07d0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fe2840ca970 tx=0x7fe2840077a0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.199+0000 7fe2946d4740 1 -- 172.21.15.87:0/4255234380 shutdown_connections 2024-09-13T17:23:38.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.199+0000 7fe2946d4740 1 --2- 172.21.15.87:0/4255234380 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55d878851c50 0x55d878854070 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.199+0000 7fe2946d4740 1 --2- 172.21.15.87:0/4255234380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8787ea950 0x55d8787f07d0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.199+0000 7fe2946d4740 1 --2- 172.21.15.87:0/4255234380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8787e00b0 0x55d8787f0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.199+0000 7fe26affd640 0 client.18093 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:23:38.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.199+0000 7fe2946d4740 1 --2- 172.21.15.87:0/4255234380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d8787df790 0x55d8787f1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.199+0000 7fe2946d4740 1 -- 172.21.15.87:0/4255234380 >> 172.21.15.87:0/4255234380 conn(0x55d8787dbd00 msgr2=0x55d8787e5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:38.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.199+0000 7fe2946d4740 1 -- 172.21.15.87:0/4255234380 shutdown_connections 2024-09-13T17:23:38.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.199+0000 7fe2946d4740 1 -- 172.21.15.87:0/4255234380 wait complete. 2024-09-13T17:23:38.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.199+0000 7fe2946d4740 20 client.18093 trim_cache size 0 max 16384 2024-09-13T17:23:38.207 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:23:38.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.199+0000 7fe2919b5640 1 -- 172.21.15.87:0/2580626844 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe2780a1200 msgr2=0x7fe2780a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:38.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.199+0000 7fe2919b5640 1 --2- 172.21.15.87:0/2580626844 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe2780a1200 0x7fe2780a36c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe274009900 tx=0x7fe274000bc0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.199+0000 7fe2919b5640 1 -- 172.21.15.87:0/2580626844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe28c197f80 msgr2=0x7fe28c1a24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:38.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.199+0000 7fe2919b5640 1 --2- 172.21.15.87:0/2580626844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe28c197f80 0x7fe28c1a24e0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fe28400cce0 tx=0x7fe28400a620 comp rx=0 tx=0).stop 2024-09-13T17:23:38.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.199+0000 7fe2919b5640 1 -- 172.21.15.87:0/2580626844 shutdown_connections 2024-09-13T17:23:38.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.199+0000 7fe2919b5640 1 --2- 172.21.15.87:0/2580626844 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fe2780a1200 0x7fe2780a36c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.199+0000 7fe2919b5640 1 --2- 172.21.15.87:0/2580626844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe28c197f80 0x7fe28c1a24e0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.199+0000 7fe2919b5640 1 --2- 172.21.15.87:0/2580626844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe28c104070 0x7fe28c1979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.199+0000 7fe2919b5640 1 --2- 172.21.15.87:0/2580626844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe28c0fef20 0x7fe28c197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.199+0000 7fe2919b5640 1 -- 172.21.15.87:0/2580626844 >> 172.21.15.87:0/2580626844 conn(0x7fe28c0fa970 msgr2=0x7fe28c0fbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:38.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.200+0000 7fe2919b5640 1 -- 172.21.15.87:0/2580626844 shutdown_connections 2024-09-13T17:23:38.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.200+0000 7fe2919b5640 1 -- 172.21.15.87:0/2580626844 wait complete. 2024-09-13T17:23:38.209 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:38 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/147715715' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:23:38.211 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-09-13T17:23:38.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.310+0000 7f27f4d3a640 1 -- 172.21.15.87:0/2997845322 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27f00fee50 msgr2=0x7f27f00ff230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:38.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.310+0000 7f27f4d3a640 1 --2- 172.21.15.87:0/2997845322 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27f00fee50 0x7f27f00ff230 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f27e0009930 tx=0x7f27e002a420 comp rx=0 tx=0).stop 2024-09-13T17:23:38.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.310+0000 7f27f4d3a640 1 -- 172.21.15.87:0/2997845322 shutdown_connections 2024-09-13T17:23:38.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.310+0000 7f27f4d3a640 1 --2- 172.21.15.87:0/2997845322 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27f0103fa0 0x7f27f010baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.310+0000 7f27f4d3a640 1 --2- 172.21.15.87:0/2997845322 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27f00ff800 0x7f27f0103840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.310+0000 7f27f4d3a640 1 --2- 172.21.15.87:0/2997845322 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27f00fee50 0x7f27f00ff230 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.310+0000 7f27f4d3a640 1 -- 172.21.15.87:0/2997845322 >> 172.21.15.87:0/2997845322 conn(0x7f27f00fa8c0 msgr2=0x7f27f00fcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:38.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.310+0000 7f27f4d3a640 1 -- 172.21.15.87:0/2997845322 shutdown_connections 2024-09-13T17:23:38.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.310+0000 7f27f4d3a640 1 -- 172.21.15.87:0/2997845322 wait complete. 2024-09-13T17:23:38.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.311+0000 7f27f4d3a640 1 Processor -- start 2024-09-13T17:23:38.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.311+0000 7f27f4d3a640 1 -- start start 2024-09-13T17:23:38.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.311+0000 7f27f4d3a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27f00fee50 0x7f27f01962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.311+0000 7f27f4d3a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27f0103fa0 0x7f27f01967e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.311+0000 7f27f4d3a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27f019abd0 0x7f27f019b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.311+0000 7f27f4d3a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f019b5c0 con 0x7f27f019abd0 2024-09-13T17:23:38.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.311+0000 7f27f4d3a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f019b730 con 0x7f27f00fee50 2024-09-13T17:23:38.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.311+0000 7f27f4d3a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f019b8a0 con 0x7f27f0103fa0 2024-09-13T17:23:38.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.311+0000 7f27eed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27f019abd0 0x7f27f019b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.311+0000 7f27eed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27f019abd0 0x7f27f019b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56824/0 (socket says 172.21.15.87:56824) 2024-09-13T17:23:38.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.311+0000 7f27eed9d640 1 -- 172.21.15.87:0/1139229936 learned_addr learned my addr 172.21.15.87:0/1139229936 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:38.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.311+0000 7f27ee59c640 1 --2- 172.21.15.87:0/1139229936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27f00fee50 0x7f27f01962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.311+0000 7f27edd9b640 1 --2- 172.21.15.87:0/1139229936 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27f0103fa0 0x7f27f01967e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.311+0000 7f27eed9d640 1 -- 172.21.15.87:0/1139229936 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27f0103fa0 msgr2=0x7f27f01967e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:38.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.311+0000 7f27eed9d640 1 --2- 172.21.15.87:0/1139229936 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27f0103fa0 0x7f27f01967e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.311+0000 7f27eed9d640 1 -- 172.21.15.87:0/1139229936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27f00fee50 msgr2=0x7f27f01962a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:38.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.311+0000 7f27eed9d640 1 --2- 172.21.15.87:0/1139229936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27f00fee50 0x7f27f01962a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.311+0000 7f27eed9d640 1 -- 172.21.15.87:0/1139229936 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e0009560 con 0x7f27f019abd0 2024-09-13T17:23:38.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.311+0000 7f27edd9b640 1 --2- 172.21.15.87:0/1139229936 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27f0103fa0 0x7f27f01967e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:23:38.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.311+0000 7f27ee59c640 1 --2- 172.21.15.87:0/1139229936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27f00fee50 0x7f27f01962a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:23:38.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.312+0000 7f27eed9d640 1 --2- 172.21.15.87:0/1139229936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27f019abd0 0x7f27f019b080 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f27e800b970 tx=0x7f27e800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:38.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.312+0000 7f27df7fe640 1 -- 172.21.15.87:0/1139229936 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e800cb40 con 0x7f27f019abd0 2024-09-13T17:23:38.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.312+0000 7f27df7fe640 1 -- 172.21.15.87:0/1139229936 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f27e800cca0 con 0x7f27f019abd0 2024-09-13T17:23:38.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.312+0000 7f27f4d3a640 1 -- 172.21.15.87:0/1139229936 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f01a2e80 con 0x7f27f019abd0 2024-09-13T17:23:38.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.312+0000 7f27df7fe640 1 -- 172.21.15.87:0/1139229936 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e80076e0 con 0x7f27f019abd0 2024-09-13T17:23:38.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.312+0000 7f27f4d3a640 1 -- 172.21.15.87:0/1139229936 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f01a3300 con 0x7f27f019abd0 2024-09-13T17:23:38.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.314+0000 7f27df7fe640 1 -- 172.21.15.87:0/1139229936 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f27e8014440 con 0x7f27f019abd0 2024-09-13T17:23:38.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.314+0000 7f27f7a5d740 1 Processor -- start 2024-09-13T17:23:38.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.314+0000 7f27f7a5d740 1 -- start start 2024-09-13T17:23:38.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.315+0000 7f27f7a5d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627d6e25790 0x5627d6e25b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.315+0000 7f27f7a5d740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627d6e260b0 0x5627d6e30410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.315+0000 7f27f7a5d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627d6e30950 0x5627d6e32d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.315+0000 7f27f7a5d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d6d8fcc0 con 0x5627d6e30950 2024-09-13T17:23:38.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.315+0000 7f27f7a5d740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d6d8d450 con 0x5627d6e260b0 2024-09-13T17:23:38.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.315+0000 7f27f7a5d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d6d88d40 con 0x5627d6e25790 2024-09-13T17:23:38.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.315+0000 7f27df7fe640 1 --2- 172.21.15.87:0/1139229936 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f27d80a1200 0x7f27d80a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.315+0000 7f27edd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627d6e30950 0x5627d6e32d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.315+0000 7f27edd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627d6e30950 0x5627d6e32d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56838/0 (socket says 172.21.15.87:56838) 2024-09-13T17:23:38.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.315+0000 7f27edd9b640 1 -- 172.21.15.87:0/3738602833 learned_addr learned my addr 172.21.15.87:0/3738602833 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:38.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.315+0000 7f27eed9d640 1 --2- 172.21.15.87:0/1139229936 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f27d80a1200 0x7f27d80a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.315+0000 7f27edd9b640 1 --2- 172.21.15.87:0/3738602833 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627d6e25790 0x5627d6e25b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.315+0000 7f27ee59c640 1 --2- 172.21.15.87:0/3738602833 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627d6e260b0 0x5627d6e30410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.315+0000 7f27df7fe640 1 -- 172.21.15.87:0/1139229936 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f27e80cc8f0 con 0x7f27f019abd0 2024-09-13T17:23:38.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.315+0000 7f27edd9b640 1 -- 172.21.15.87:0/3738602833 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627d6e25790 msgr2=0x5627d6e25b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:38.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.315+0000 7f27edd9b640 1 --2- 172.21.15.87:0/3738602833 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627d6e25790 0x5627d6e25b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.315+0000 7f27edd9b640 1 -- 172.21.15.87:0/3738602833 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627d6e260b0 msgr2=0x5627d6e30410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:38.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.315+0000 7f27edd9b640 1 --2- 172.21.15.87:0/3738602833 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627d6e260b0 0x5627d6e30410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.315+0000 7f27edd9b640 1 -- 172.21.15.87:0/3738602833 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627d6d50620 con 0x5627d6e30950 2024-09-13T17:23:38.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.315+0000 7f27ee59c640 1 --2- 172.21.15.87:0/3738602833 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627d6e260b0 0x5627d6e30410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:23:38.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.315+0000 7f27edd9b640 1 --2- 172.21.15.87:0/3738602833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627d6e30950 0x5627d6e32d40 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f27e4005fd0 tx=0x7f27e400d420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23951d1596fd1083 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:38.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.315+0000 7f27eed9d640 1 --2- 172.21.15.87:0/1139229936 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f27d80a1200 0x7f27d80a36c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f27e8099690 tx=0x7f27e800f300 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:38.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.315+0000 7f27dcff9640 1 -- 172.21.15.87:0/3738602833 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e400aa60 con 0x5627d6e30950 2024-09-13T17:23:38.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.316+0000 7f27dcff9640 1 -- 172.21.15.87:0/3738602833 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f27e4018070 con 0x5627d6e30950 2024-09-13T17:23:38.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.316+0000 7f27dcff9640 1 -- 172.21.15.87:0/3738602833 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e4004a00 con 0x5627d6e30950 2024-09-13T17:23:38.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.316+0000 7f27f7a5d740 1 -- 172.21.15.87:0/3738602833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627d6e30950 msgr2=0x5627d6e32d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:38.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.316+0000 7f27f7a5d740 1 --2- 172.21.15.87:0/3738602833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627d6e30950 0x5627d6e32d40 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f27e4005fd0 tx=0x7f27e400d420 comp rx=0 tx=0).stop 2024-09-13T17:23:38.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.316+0000 7f27f7a5d740 1 -- 172.21.15.87:0/3738602833 shutdown_connections 2024-09-13T17:23:38.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.316+0000 7f27f7a5d740 1 --2- 172.21.15.87:0/3738602833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627d6e30950 0x5627d6e32d40 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.316+0000 7f27f7a5d740 1 --2- 172.21.15.87:0/3738602833 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627d6e260b0 0x5627d6e30410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.316+0000 7f27f7a5d740 1 --2- 172.21.15.87:0/3738602833 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627d6e25790 0x5627d6e25b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.316+0000 7f27f7a5d740 1 -- 172.21.15.87:0/3738602833 >> 172.21.15.87:0/3738602833 conn(0x5627d6e21d00 msgr2=0x5627d6e220e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:38.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.316+0000 7f27f7a5d740 1 -- 172.21.15.87:0/3738602833 shutdown_connections 2024-09-13T17:23:38.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.316+0000 7f27f7a5d740 1 -- 172.21.15.87:0/3738602833 wait complete. 2024-09-13T17:23:38.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.317+0000 7f27f7a5d740 1 -- start start 2024-09-13T17:23:38.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.317+0000 7f27f7a5d740 1 Processor -- start 2024-09-13T17:23:38.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.317+0000 7f27f7a5d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627d6e25790 0x5627d6e2ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.317+0000 7f27f7a5d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627d6e260b0 0x5627d6e2d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.317+0000 7f27f7a5d740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627d6e30950 0x5627d6e2d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.317+0000 7f27f7a5d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d6d47180 con 0x5627d6e25790 2024-09-13T17:23:38.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.317+0000 7f27f7a5d740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d6a61430 con 0x5627d6e30950 2024-09-13T17:23:38.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.317+0000 7f27f7a5d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d6d0c5e0 con 0x5627d6e260b0 2024-09-13T17:23:38.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.317+0000 7f27f7a5d740 10 client.0 _ll_register_callbacks cb 0x5627d6d78aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:23:38.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.317+0000 7f27edd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627d6e25790 0x5627d6e2ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.317+0000 7f27edd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627d6e25790 0x5627d6e2ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56842/0 (socket says 172.21.15.87:56842) 2024-09-13T17:23:38.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.317+0000 7f27edd9b640 1 -- 172.21.15.87:0/4078053725 learned_addr learned my addr 172.21.15.87:0/4078053725 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:38.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.317+0000 7f27edd9b640 1 -- 172.21.15.87:0/4078053725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627d6e260b0 msgr2=0x5627d6e2d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:38.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.317+0000 7f27edd9b640 1 --2- 172.21.15.87:0/4078053725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627d6e260b0 0x5627d6e2d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.317+0000 7f27edd9b640 1 -- 172.21.15.87:0/4078053725 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627d6e30950 msgr2=0x5627d6e2d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:38.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.317+0000 7f27edd9b640 1 --2- 172.21.15.87:0/4078053725 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627d6e30950 0x5627d6e2d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.317+0000 7f27edd9b640 1 -- 172.21.15.87:0/4078053725 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e4012560 con 0x5627d6e25790 2024-09-13T17:23:38.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.317+0000 7f27edd9b640 1 --2- 172.21.15.87:0/4078053725 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627d6e25790 0x5627d6e2ff80 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f27e400dd60 tx=0x7f27e400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=339568be5dca7ac7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:38.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.317+0000 7f27d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:23:38.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.318+0000 7f27d5ffb640 1 -- 172.21.15.87:0/4078053725 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e4027440 con 0x5627d6e25790 2024-09-13T17:23:38.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.318+0000 7f27d5ffb640 1 -- 172.21.15.87:0/4078053725 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f27e4000e40 con 0x5627d6e25790 2024-09-13T17:23:38.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.318+0000 7f27f7a5d740 1 -- 172.21.15.87:0/4078053725 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5627d6db2b80 con 0x5627d6e25790 2024-09-13T17:23:38.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.318+0000 7f27d5ffb640 1 -- 172.21.15.87:0/4078053725 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27e401d430 con 0x5627d6e25790 2024-09-13T17:23:38.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.318+0000 7f27f7a5d740 10 client.18105 fetch_fsmap learned FSMap version 36 2024-09-13T17:23:38.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.318+0000 7f27f7a5d740 1 -- 172.21.15.87:0/4078053725 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5627d6d873c0 con 0x5627d6e25790 2024-09-13T17:23:38.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.318+0000 7f27d5ffb640 1 -- 172.21.15.87:0/4078053725 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x5627d6db2b80 con 0x5627d6e25790 2024-09-13T17:23:38.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.318+0000 7f27d5ffb640 1 -- 172.21.15.87:0/4078053725 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f27e4026670 con 0x5627d6e25790 2024-09-13T17:23:38.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.318+0000 7f27f7a5d740 10 client.18105 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:23:38.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.318+0000 7f27f7a5d740 10 client.18105 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:23:38.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.318+0000 7f27f7a5d740 20 client.18105 populate_metadata read hostname 'smithi087' 2024-09-13T17:23:38.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.318+0000 7f27f7a5d740 1 --2- 172.21.15.87:0/4078053725 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5627d6e401d0 0x5627d6e425c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.318+0000 7f27f7a5d740 4 client.18105 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:23:38.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.318+0000 7f27f7a5d740 1 -- 172.21.15.87:0/4078053725 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5627d6d7b1f0 con 0x5627d6e401d0 2024-09-13T17:23:38.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.319+0000 7f27ee59c640 1 --2- 172.21.15.87:0/4078053725 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5627d6e401d0 0x5627d6e425c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.319+0000 7f27d5ffb640 10 client.18105 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:23:38.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.319+0000 7f27ee59c640 1 --2- 172.21.15.87:0/4078053725 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5627d6e401d0 0x5627d6e425c0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=567ea1174d0af69d server_cookie=21d06ab7ecdb6586 in_seq=0 out_seq=0 2024-09-13T17:23:38.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.319+0000 7f27d5ffb640 1 -- 172.21.15.87:0/4078053725 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5627d6d7b1f0 con 0x5627d6e401d0 2024-09-13T17:23:38.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.319+0000 7f27d5ffb640 10 client.18105 handle_command_reply: tid=0 2024-09-13T17:23:38.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.319+0000 7f27f7a5d740 1 client.18105 shutdown 2024-09-13T17:23:38.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.320+0000 7f27f7a5d740 1 -- 172.21.15.87:0/4078053725 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627d6e25790 msgr2=0x5627d6e2ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:38.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.320+0000 7f27f7a5d740 1 --2- 172.21.15.87:0/4078053725 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627d6e25790 0x5627d6e2ff80 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f27e400dd60 tx=0x7f27e400dd90 comp rx=0 tx=0).stop 2024-09-13T17:23:38.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.320+0000 7f27f7a5d740 1 -- 172.21.15.87:0/4078053725 shutdown_connections 2024-09-13T17:23:38.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.320+0000 7f27f7a5d740 1 --2- 172.21.15.87:0/4078053725 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5627d6e401d0 0x5627d6e425c0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.320+0000 7f27f7a5d740 1 --2- 172.21.15.87:0/4078053725 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627d6e30950 0x5627d6e2d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.320+0000 7f27d5ffb640 0 client.18105 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:23:38.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.320+0000 7f27f7a5d740 1 --2- 172.21.15.87:0/4078053725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627d6e260b0 0x5627d6e2d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.320+0000 7f27f7a5d740 1 --2- 172.21.15.87:0/4078053725 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627d6e25790 0x5627d6e2ff80 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.320+0000 7f27f7a5d740 1 -- 172.21.15.87:0/4078053725 >> 172.21.15.87:0/4078053725 conn(0x5627d6e21d00 msgr2=0x5627d6e27a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:38.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.320+0000 7f27f7a5d740 1 -- 172.21.15.87:0/4078053725 shutdown_connections 2024-09-13T17:23:38.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.320+0000 7f27f7a5d740 1 -- 172.21.15.87:0/4078053725 wait complete. 2024-09-13T17:23:38.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.320+0000 7f27f7a5d740 20 client.18105 trim_cache size 0 max 16384 2024-09-13T17:23:38.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.331+0000 7f27f7a5d740 1 Processor -- start 2024-09-13T17:23:38.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.331+0000 7f27f7a5d740 1 -- start start 2024-09-13T17:23:38.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.331+0000 7f27f7a5d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627d6e25790 0x5627d6e216a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.331+0000 7f27f7a5d740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627d6e260b0 0x5627d6e2d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.331+0000 7f27f7a5d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627d6e30950 0x5627d6e2d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.331+0000 7f27f7a5d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d6e1c3d0 con 0x5627d6e30950 2024-09-13T17:23:38.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.331+0000 7f27f7a5d740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d6e428f0 con 0x5627d6e260b0 2024-09-13T17:23:38.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.331+0000 7f27f7a5d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d6e47310 con 0x5627d6e25790 2024-09-13T17:23:38.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.331+0000 7f27edd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627d6e30950 0x5627d6e2d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.331+0000 7f27edd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627d6e30950 0x5627d6e2d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56854/0 (socket says 172.21.15.87:56854) 2024-09-13T17:23:38.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.331+0000 7f27edd9b640 1 -- 172.21.15.87:0/2052107679 learned_addr learned my addr 172.21.15.87:0/2052107679 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:38.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.331+0000 7f27edd9b640 1 -- 172.21.15.87:0/2052107679 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627d6e25790 msgr2=0x5627d6e216a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:38.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.331+0000 7f27edd9b640 1 --2- 172.21.15.87:0/2052107679 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627d6e25790 0x5627d6e216a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.331+0000 7f27edd9b640 1 -- 172.21.15.87:0/2052107679 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627d6e260b0 msgr2=0x5627d6e2d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:38.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.331+0000 7f27edd9b640 1 --2- 172.21.15.87:0/2052107679 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627d6e260b0 0x5627d6e2d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.331+0000 7f27edd9b640 1 -- 172.21.15.87:0/2052107679 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627d6d29770 con 0x5627d6e30950 2024-09-13T17:23:38.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.331+0000 7f27edd9b640 1 --2- 172.21.15.87:0/2052107679 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627d6e30950 0x5627d6e2d850 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f27e400adb0 tx=0x7f27e400aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da3ed92f3f518696 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:38.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.332+0000 7f27dd7fa640 1 -- 172.21.15.87:0/2052107679 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e400db40 con 0x5627d6e30950 2024-09-13T17:23:38.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.332+0000 7f27dd7fa640 1 -- 172.21.15.87:0/2052107679 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f27e4012e90 con 0x5627d6e30950 2024-09-13T17:23:38.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.332+0000 7f27dd7fa640 1 -- 172.21.15.87:0/2052107679 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e4005030 con 0x5627d6e30950 2024-09-13T17:23:38.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.332+0000 7f27f7a5d740 1 -- 172.21.15.87:0/2052107679 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627d6e30950 msgr2=0x5627d6e2d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:38.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.332+0000 7f27f7a5d740 1 --2- 172.21.15.87:0/2052107679 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627d6e30950 0x5627d6e2d850 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f27e400adb0 tx=0x7f27e400aed0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.332+0000 7f27f7a5d740 1 -- 172.21.15.87:0/2052107679 shutdown_connections 2024-09-13T17:23:38.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.332+0000 7f27f7a5d740 1 --2- 172.21.15.87:0/2052107679 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627d6e30950 0x5627d6e2d850 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.332+0000 7f27f7a5d740 1 --2- 172.21.15.87:0/2052107679 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627d6e260b0 0x5627d6e2d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.332+0000 7f27f7a5d740 1 --2- 172.21.15.87:0/2052107679 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627d6e25790 0x5627d6e216a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.332+0000 7f27f7a5d740 1 -- 172.21.15.87:0/2052107679 >> 172.21.15.87:0/2052107679 conn(0x5627d6e21d00 msgr2=0x5627d6e2cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:38.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.332+0000 7f27f7a5d740 1 -- 172.21.15.87:0/2052107679 shutdown_connections 2024-09-13T17:23:38.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.332+0000 7f27f7a5d740 1 -- 172.21.15.87:0/2052107679 wait complete. 2024-09-13T17:23:38.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.332+0000 7f27f7a5d740 1 -- start start 2024-09-13T17:23:38.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.332+0000 7f27f7a5d740 1 Processor -- start 2024-09-13T17:23:38.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.333+0000 7f27f7a5d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627d6e25790 0x5627d6e34060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.333+0000 7f27f7a5d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627d6e260b0 0x5627d6e345a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.333+0000 7f27f7a5d740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627d6e30950 0x5627d6e34ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.333+0000 7f27f7a5d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d6e96630 con 0x5627d6e25790 2024-09-13T17:23:38.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.333+0000 7f27f7a5d740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d6e96770 con 0x5627d6e30950 2024-09-13T17:23:38.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.333+0000 7f27f7a5d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d6e968b0 con 0x5627d6e260b0 2024-09-13T17:23:38.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.333+0000 7f27f7a5d740 10 client.0 _ll_register_callbacks cb 0x7f27e400d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:23:38.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.333+0000 7f27edd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627d6e25790 0x5627d6e34060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.333+0000 7f27edd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627d6e25790 0x5627d6e34060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56868/0 (socket says 172.21.15.87:56868) 2024-09-13T17:23:38.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.333+0000 7f27edd9b640 1 -- 172.21.15.87:0/1461275792 learned_addr learned my addr 172.21.15.87:0/1461275792 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:38.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.333+0000 7f27ee59c640 1 --2- 172.21.15.87:0/1461275792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627d6e260b0 0x5627d6e345a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.333+0000 7f27edd9b640 1 -- 172.21.15.87:0/1461275792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627d6e260b0 msgr2=0x5627d6e345a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:38.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.333+0000 7f27edd9b640 1 --2- 172.21.15.87:0/1461275792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627d6e260b0 0x5627d6e345a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.333+0000 7f27edd9b640 1 -- 172.21.15.87:0/1461275792 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627d6e30950 msgr2=0x5627d6e34ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:38.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.333+0000 7f27edd9b640 1 --2- 172.21.15.87:0/1461275792 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627d6e30950 0x5627d6e34ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.333+0000 7f27edd9b640 1 -- 172.21.15.87:0/1461275792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5627d6d873c0 con 0x5627d6e25790 2024-09-13T17:23:38.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.333+0000 7f27ee59c640 1 --2- 172.21.15.87:0/1461275792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627d6e260b0 0x5627d6e345a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:23:38.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.333+0000 7f27edd9b640 1 --2- 172.21.15.87:0/1461275792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627d6e25790 0x5627d6e34060 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f27e4026aa0 tx=0x7f27e400df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d9a010c5d4c23 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:38.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.333+0000 7f27d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:23:38.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.333+0000 7f27d5ffb640 1 -- 172.21.15.87:0/1461275792 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e4044070 con 0x5627d6e25790 2024-09-13T17:23:38.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.333+0000 7f27d5ffb640 1 -- 172.21.15.87:0/1461275792 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f27e400db40 con 0x5627d6e25790 2024-09-13T17:23:38.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.333+0000 7f27f7a5d740 1 -- 172.21.15.87:0/1461275792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f27e4018070 con 0x5627d6e25790 2024-09-13T17:23:38.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.333+0000 7f27d5ffb640 1 -- 172.21.15.87:0/1461275792 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27e400aa70 con 0x5627d6e25790 2024-09-13T17:23:38.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.333+0000 7f27f7a5d740 10 client.18111 fetch_fsmap learned FSMap version 36 2024-09-13T17:23:38.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.333+0000 7f27f7a5d740 1 -- 172.21.15.87:0/1461275792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5627d6d4ee80 con 0x5627d6e25790 2024-09-13T17:23:38.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.334+0000 7f27d5ffb640 1 -- 172.21.15.87:0/1461275792 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f27e4018070 con 0x5627d6e25790 2024-09-13T17:23:38.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.334+0000 7f27d5ffb640 1 -- 172.21.15.87:0/1461275792 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f27e4047020 con 0x5627d6e25790 2024-09-13T17:23:38.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.334+0000 7f27f7a5d740 10 client.18111 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:23:38.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.334+0000 7f27f7a5d740 10 client.18111 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:23:38.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.334+0000 7f27f7a5d740 20 client.18111 populate_metadata read hostname 'smithi087' 2024-09-13T17:23:38.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.334+0000 7f27f7a5d740 1 --2- 172.21.15.87:0/1461275792 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5627d6e97ac0 0x5627d6e99eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:38.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.334+0000 7f27f7a5d740 4 client.18111 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:23:38.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.334+0000 7f27f7a5d740 1 -- 172.21.15.87:0/1461275792 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5627d6a7c4e0 con 0x5627d6e97ac0 2024-09-13T17:23:38.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.334+0000 7f27ee59c640 1 --2- 172.21.15.87:0/1461275792 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5627d6e97ac0 0x5627d6e99eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:38.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.334+0000 7f27d5ffb640 10 client.18111 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:23:38.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.334+0000 7f27ee59c640 1 --2- 172.21.15.87:0/1461275792 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5627d6e97ac0 0x5627d6e99eb0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e02947416b6893db server_cookie=44cec20eb112d0de in_seq=0 out_seq=0 2024-09-13T17:23:38.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.334+0000 7f27d5ffb640 1 -- 172.21.15.87:0/1461275792 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5627d6a7c4e0 con 0x5627d6e97ac0 2024-09-13T17:23:38.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.334+0000 7f27d5ffb640 10 client.18111 handle_command_reply: tid=0 2024-09-13T17:23:38.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.334+0000 7f27f7a5d740 1 client.18111 shutdown 2024-09-13T17:23:38.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.335+0000 7f27f7a5d740 1 -- 172.21.15.87:0/1461275792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627d6e25790 msgr2=0x5627d6e34060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:38.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.335+0000 7f27f7a5d740 1 --2- 172.21.15.87:0/1461275792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627d6e25790 0x5627d6e34060 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f27e4026aa0 tx=0x7f27e400df90 comp rx=0 tx=0).stop 2024-09-13T17:23:38.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.335+0000 7f27f7a5d740 1 -- 172.21.15.87:0/1461275792 shutdown_connections 2024-09-13T17:23:38.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.335+0000 7f27f7a5d740 1 --2- 172.21.15.87:0/1461275792 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x5627d6e97ac0 0x5627d6e99eb0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.335+0000 7f27f7a5d740 1 --2- 172.21.15.87:0/1461275792 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5627d6e30950 0x5627d6e34ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.335+0000 7f27d5ffb640 0 client.18111 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:23:38.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.335+0000 7f27f7a5d740 1 --2- 172.21.15.87:0/1461275792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5627d6e260b0 0x5627d6e345a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.335+0000 7f27f7a5d740 1 --2- 172.21.15.87:0/1461275792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627d6e25790 0x5627d6e34060 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.335+0000 7f27f7a5d740 1 -- 172.21.15.87:0/1461275792 >> 172.21.15.87:0/1461275792 conn(0x5627d6e21d00 msgr2=0x5627d6e2d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:38.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.335+0000 7f27f7a5d740 1 -- 172.21.15.87:0/1461275792 shutdown_connections 2024-09-13T17:23:38.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.335+0000 7f27f7a5d740 1 -- 172.21.15.87:0/1461275792 wait complete. 2024-09-13T17:23:38.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.335+0000 7f27f7a5d740 20 client.18111 trim_cache size 0 max 16384 2024-09-13T17:23:38.343 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:23:38.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.335+0000 7f27f4d3a640 1 -- 172.21.15.87:0/1139229936 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f27d80a1200 msgr2=0x7f27d80a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:38.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.335+0000 7f27f4d3a640 1 --2- 172.21.15.87:0/1139229936 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f27d80a1200 0x7f27d80a36c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f27e8099690 tx=0x7f27e800f300 comp rx=0 tx=0).stop 2024-09-13T17:23:38.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.335+0000 7f27f4d3a640 1 -- 172.21.15.87:0/1139229936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27f019abd0 msgr2=0x7f27f019b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:38.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.335+0000 7f27f4d3a640 1 --2- 172.21.15.87:0/1139229936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27f019abd0 0x7f27f019b080 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f27e800b970 tx=0x7f27e800be30 comp rx=0 tx=0).stop 2024-09-13T17:23:38.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.335+0000 7f27f4d3a640 1 -- 172.21.15.87:0/1139229936 shutdown_connections 2024-09-13T17:23:38.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.335+0000 7f27f4d3a640 1 --2- 172.21.15.87:0/1139229936 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f27d80a1200 0x7f27d80a36c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.335+0000 7f27f4d3a640 1 --2- 172.21.15.87:0/1139229936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27f019abd0 0x7f27f019b080 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.335+0000 7f27f4d3a640 1 --2- 172.21.15.87:0/1139229936 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27f0103fa0 0x7f27f01967e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.335+0000 7f27f4d3a640 1 --2- 172.21.15.87:0/1139229936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27f00fee50 0x7f27f01962a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:38.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.335+0000 7f27f4d3a640 1 -- 172.21.15.87:0/1139229936 >> 172.21.15.87:0/1139229936 conn(0x7f27f00fa8c0 msgr2=0x7f27f00fbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:38.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.335+0000 7f27f4d3a640 1 -- 172.21.15.87:0/1139229936 shutdown_connections 2024-09-13T17:23:38.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:38.335+0000 7f27f4d3a640 1 -- 172.21.15.87:0/1139229936 wait complete. 2024-09-13T17:23:38.345 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:38 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/147715715' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:23:38.362 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:38 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/147715715' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:23:39.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:39 smithi149 ceph-mon[35496]: pgmap v305: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:23:39.347 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-13T17:23:39.348 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-09-13T17:23:39.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:39 smithi118 ceph-mon[34374]: pgmap v305: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:23:39.375 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:39 smithi087 ceph-mon[30934]: pgmap v305: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:23:39.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.463+0000 7fd289be9640 1 -- 172.21.15.87:0/4210424938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2841050a0 msgr2=0x7fd28410cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:39.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.463+0000 7fd289be9640 1 --2- 172.21.15.87:0/4210424938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2841050a0 0x7fd28410cbf0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fd27c009cd0 tx=0x7fd27c02a8e0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.463+0000 7fd289be9640 1 -- 172.21.15.87:0/4210424938 shutdown_connections 2024-09-13T17:23:39.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.463+0000 7fd289be9640 1 --2- 172.21.15.87:0/4210424938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2841050a0 0x7fd28410cbf0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.463+0000 7fd289be9640 1 --2- 172.21.15.87:0/4210424938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd284100900 0x7fd284104940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.463+0000 7fd289be9640 1 --2- 172.21.15.87:0/4210424938 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2840fff50 0x7fd284100330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.463+0000 7fd289be9640 1 -- 172.21.15.87:0/4210424938 >> 172.21.15.87:0/4210424938 conn(0x7fd2840fb9e0 msgr2=0x7fd2840fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:39.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.463+0000 7fd289be9640 1 -- 172.21.15.87:0/4210424938 shutdown_connections 2024-09-13T17:23:39.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.463+0000 7fd289be9640 1 -- 172.21.15.87:0/4210424938 wait complete. 2024-09-13T17:23:39.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.464+0000 7fd289be9640 1 Processor -- start 2024-09-13T17:23:39.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.464+0000 7fd289be9640 1 -- start start 2024-09-13T17:23:39.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.464+0000 7fd289be9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2840fff50 0x7fd2841984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.464+0000 7fd289be9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2841050a0 0x7fd284198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.464+0000 7fd289be9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd28419ce20 0x7fd28419d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.464+0000 7fd289be9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28419d810 con 0x7fd2841050a0 2024-09-13T17:23:39.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.464+0000 7fd289be9640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28419d980 con 0x7fd2840fff50 2024-09-13T17:23:39.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.464+0000 7fd289be9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28419daf0 con 0x7fd28419ce20 2024-09-13T17:23:39.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.464+0000 7fd282ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2841050a0 0x7fd284198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:39.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.464+0000 7fd282ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2841050a0 0x7fd284198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37524/0 (socket says 172.21.15.87:37524) 2024-09-13T17:23:39.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.464+0000 7fd282ffd640 1 -- 172.21.15.87:0/3267209474 learned_addr learned my addr 172.21.15.87:0/3267209474 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:39.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.464+0000 7fd282ffd640 1 -- 172.21.15.87:0/3267209474 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd28419ce20 msgr2=0x7fd28419d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:39.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.464+0000 7fd282ffd640 1 --2- 172.21.15.87:0/3267209474 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd28419ce20 0x7fd28419d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.464+0000 7fd282ffd640 1 -- 172.21.15.87:0/3267209474 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2840fff50 msgr2=0x7fd2841984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:39.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.464+0000 7fd2837fe640 1 --2- 172.21.15.87:0/3267209474 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2840fff50 0x7fd2841984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:39.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.464+0000 7fd282ffd640 1 --2- 172.21.15.87:0/3267209474 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2840fff50 0x7fd2841984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.464+0000 7fd282ffd640 1 -- 172.21.15.87:0/3267209474 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd27c009900 con 0x7fd2841050a0 2024-09-13T17:23:39.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.465+0000 7fd282ffd640 1 --2- 172.21.15.87:0/3267209474 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2841050a0 0x7fd284198a30 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fd27800d740 tx=0x7fd27800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:39.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.465+0000 7fd280ff9640 1 -- 172.21.15.87:0/3267209474 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd278009c30 con 0x7fd2841050a0 2024-09-13T17:23:39.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.465+0000 7fd289be9640 1 -- 172.21.15.87:0/3267209474 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2841a50d0 con 0x7fd2841050a0 2024-09-13T17:23:39.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.465+0000 7fd280ff9640 1 -- 172.21.15.87:0/3267209474 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd27800de50 con 0x7fd2841050a0 2024-09-13T17:23:39.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.465+0000 7fd280ff9640 1 -- 172.21.15.87:0/3267209474 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd278004e40 con 0x7fd2841050a0 2024-09-13T17:23:39.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.465+0000 7fd289be9640 1 -- 172.21.15.87:0/3267209474 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2841a5580 con 0x7fd2841050a0 2024-09-13T17:23:39.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.467+0000 7fd280ff9640 1 -- 172.21.15.87:0/3267209474 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fd278004fa0 con 0x7fd2841050a0 2024-09-13T17:23:39.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.467+0000 7fd28c9e4740 1 Processor -- start 2024-09-13T17:23:39.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.467+0000 7fd28c9e4740 1 -- start start 2024-09-13T17:23:39.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.467+0000 7fd28c9e4740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f89c827c0 0x562f89c82ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.468+0000 7fd28c9e4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562f89c830e0 0x562f89c8d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.468+0000 7fd28c9e4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f89c8d980 0x562f89c8fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.468+0000 7fd28c9e4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f89bedc60 con 0x562f89c830e0 2024-09-13T17:23:39.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.468+0000 7fd28c9e4740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f89beb3f0 con 0x562f89c827c0 2024-09-13T17:23:39.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.468+0000 7fd28c9e4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f89be6ce0 con 0x562f89c8d980 2024-09-13T17:23:39.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.468+0000 7fd280ff9640 1 --2- 172.21.15.87:0/3267209474 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd26c0a1200 0x7fd26c0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.468+0000 7fd2837fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562f89c830e0 0x562f89c8d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:39.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.468+0000 7fd2837fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562f89c830e0 0x562f89c8d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37528/0 (socket says 172.21.15.87:37528) 2024-09-13T17:23:39.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.468+0000 7fd2837fe640 1 -- 172.21.15.87:0/659237688 learned_addr learned my addr 172.21.15.87:0/659237688 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:39.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.468+0000 7fd283fff640 1 --2- 172.21.15.87:0/3267209474 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd26c0a1200 0x7fd26c0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:39.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.468+0000 7fd283fff640 1 --2- 172.21.15.87:0/659237688 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f89c827c0 0x562f89c82ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:39.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.468+0000 7fd282ffd640 1 --2- 172.21.15.87:0/659237688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f89c8d980 0x562f89c8fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:39.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.468+0000 7fd2837fe640 1 -- 172.21.15.87:0/659237688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f89c8d980 msgr2=0x562f89c8fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:39.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.468+0000 7fd280ff9640 1 -- 172.21.15.87:0/3267209474 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fd2780ccab0 con 0x7fd2841050a0 2024-09-13T17:23:39.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.468+0000 7fd2837fe640 1 --2- 172.21.15.87:0/659237688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f89c8d980 0x562f89c8fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.468+0000 7fd2837fe640 1 -- 172.21.15.87:0/659237688 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f89c827c0 msgr2=0x562f89c82ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:39.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.468+0000 7fd2837fe640 1 --2- 172.21.15.87:0/659237688 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f89c827c0 0x562f89c82ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.468+0000 7fd2837fe640 1 -- 172.21.15.87:0/659237688 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f89ba2970 con 0x562f89c830e0 2024-09-13T17:23:39.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.468+0000 7fd283fff640 1 --2- 172.21.15.87:0/659237688 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f89c827c0 0x562f89c82ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:23:39.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.468+0000 7fd282ffd640 1 --2- 172.21.15.87:0/659237688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f89c8d980 0x562f89c8fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:23:39.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.468+0000 7fd2837fe640 1 --2- 172.21.15.87:0/659237688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562f89c830e0 0x562f89c8d440 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fd27400baa0 tx=0x7fd27400bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7134dde2c6d508fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:39.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.468+0000 7fd283fff640 1 --2- 172.21.15.87:0/3267209474 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd26c0a1200 0x7fd26c0a36c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd27c02ae00 tx=0x7fd27c009360 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:39.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.468+0000 7fd269ffb640 1 -- 172.21.15.87:0/659237688 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd274017420 con 0x562f89c830e0 2024-09-13T17:23:39.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.468+0000 7fd269ffb640 1 -- 172.21.15.87:0/659237688 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd274017a30 con 0x562f89c830e0 2024-09-13T17:23:39.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.468+0000 7fd269ffb640 1 -- 172.21.15.87:0/659237688 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27400f9e0 con 0x562f89c830e0 2024-09-13T17:23:39.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.469+0000 7fd28c9e4740 1 -- 172.21.15.87:0/659237688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562f89c830e0 msgr2=0x562f89c8d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:39.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.469+0000 7fd28c9e4740 1 --2- 172.21.15.87:0/659237688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562f89c830e0 0x562f89c8d440 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fd27400baa0 tx=0x7fd27400bf60 comp rx=0 tx=0).stop 2024-09-13T17:23:39.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.469+0000 7fd28c9e4740 1 -- 172.21.15.87:0/659237688 shutdown_connections 2024-09-13T17:23:39.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.469+0000 7fd28c9e4740 1 --2- 172.21.15.87:0/659237688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f89c8d980 0x562f89c8fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.469+0000 7fd28c9e4740 1 --2- 172.21.15.87:0/659237688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562f89c830e0 0x562f89c8d440 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.469+0000 7fd28c9e4740 1 --2- 172.21.15.87:0/659237688 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f89c827c0 0x562f89c82ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.469+0000 7fd28c9e4740 1 -- 172.21.15.87:0/659237688 >> 172.21.15.87:0/659237688 conn(0x562f89c7ed50 msgr2=0x562f89c7f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:39.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.469+0000 7fd28c9e4740 1 -- 172.21.15.87:0/659237688 shutdown_connections 2024-09-13T17:23:39.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.469+0000 7fd28c9e4740 1 -- 172.21.15.87:0/659237688 wait complete. 2024-09-13T17:23:39.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.469+0000 7fd28c9e4740 1 -- start start 2024-09-13T17:23:39.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.470+0000 7fd28c9e4740 1 Processor -- start 2024-09-13T17:23:39.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.470+0000 7fd28c9e4740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f89c827c0 0x562f89c8d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.470+0000 7fd28c9e4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562f89c830e0 0x562f89c8a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.470+0000 7fd28c9e4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f89c8d980 0x562f89c8a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.470+0000 7fd28c9e4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f89ba4f80 con 0x562f89c830e0 2024-09-13T17:23:39.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.470+0000 7fd28c9e4740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f89ba4c20 con 0x562f89c827c0 2024-09-13T17:23:39.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.470+0000 7fd28c9e4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f89b71ab0 con 0x562f89c8d980 2024-09-13T17:23:39.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.470+0000 7fd28c9e4740 10 client.0 _ll_register_callbacks cb 0x562f89be0350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:23:39.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.470+0000 7fd282ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562f89c830e0 0x562f89c8a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:39.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.470+0000 7fd282ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562f89c830e0 0x562f89c8a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37540/0 (socket says 172.21.15.87:37540) 2024-09-13T17:23:39.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.470+0000 7fd282ffd640 1 -- 172.21.15.87:0/4056045718 learned_addr learned my addr 172.21.15.87:0/4056045718 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:39.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.470+0000 7fd2837fe640 1 --2- 172.21.15.87:0/4056045718 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f89c827c0 0x562f89c8d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:39.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.470+0000 7fd282ffd640 1 -- 172.21.15.87:0/4056045718 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f89c8d980 msgr2=0x562f89c8a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:39.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.470+0000 7fd282ffd640 1 --2- 172.21.15.87:0/4056045718 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f89c8d980 0x562f89c8a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.470+0000 7fd282ffd640 1 -- 172.21.15.87:0/4056045718 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f89c827c0 msgr2=0x562f89c8d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:39.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.470+0000 7fd282ffd640 1 --2- 172.21.15.87:0/4056045718 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f89c827c0 0x562f89c8d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.470+0000 7fd282ffd640 1 -- 172.21.15.87:0/4056045718 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd27400b6d0 con 0x562f89c830e0 2024-09-13T17:23:39.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.471+0000 7fd282ffd640 1 --2- 172.21.15.87:0/4056045718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562f89c830e0 0x562f89c8a4a0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fd2780ca3f0 tx=0x7fd278007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c5abdbde154dab9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:39.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.471+0000 7fd262ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:23:39.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.471+0000 7fd262ffd640 1 -- 172.21.15.87:0/4056045718 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2780997b0 con 0x562f89c830e0 2024-09-13T17:23:39.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.471+0000 7fd262ffd640 1 -- 172.21.15.87:0/4056045718 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fd27809d5e0 con 0x562f89c830e0 2024-09-13T17:23:39.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.471+0000 7fd28c9e4740 1 -- 172.21.15.87:0/4056045718 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562f898da590 con 0x562f89c830e0 2024-09-13T17:23:39.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.471+0000 7fd262ffd640 1 -- 172.21.15.87:0/4056045718 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2780b2140 con 0x562f89c830e0 2024-09-13T17:23:39.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.471+0000 7fd28c9e4740 10 client.18123 fetch_fsmap learned FSMap version 36 2024-09-13T17:23:39.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.471+0000 7fd28c9e4740 1 -- 172.21.15.87:0/4056045718 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x562f89be5360 con 0x562f89c830e0 2024-09-13T17:23:39.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.471+0000 7fd262ffd640 1 -- 172.21.15.87:0/4056045718 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x562f898da590 con 0x562f89c830e0 2024-09-13T17:23:39.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.471+0000 7fd262ffd640 1 -- 172.21.15.87:0/4056045718 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd2780b90b0 con 0x562f89c830e0 2024-09-13T17:23:39.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.471+0000 7fd28c9e4740 10 client.18123 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:23:39.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.471+0000 7fd28c9e4740 10 client.18123 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:23:39.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.471+0000 7fd28c9e4740 20 client.18123 populate_metadata read hostname 'smithi087' 2024-09-13T17:23:39.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.471+0000 7fd28c9e4740 1 --2- 172.21.15.87:0/4056045718 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x562f89c9d420 0x562f89c9f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.471+0000 7fd28c9e4740 4 client.18123 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:23:39.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.471+0000 7fd28c9e4740 1 -- 172.21.15.87:0/4056045718 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562f898eb860 con 0x562f89c9d420 2024-09-13T17:23:39.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.471+0000 7fd2837fe640 1 --2- 172.21.15.87:0/4056045718 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x562f89c9d420 0x562f89c9f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:39.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.472+0000 7fd262ffd640 10 client.18123 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:23:39.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.472+0000 7fd2837fe640 1 --2- 172.21.15.87:0/4056045718 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x562f89c9d420 0x562f89c9f810 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff7ee262c889f1d4 server_cookie=db6ee4062cc0aef4 in_seq=0 out_seq=0 2024-09-13T17:23:39.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.473+0000 7fd262ffd640 1 -- 172.21.15.87:0/4056045718 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x562f898eb860 con 0x562f89c9d420 2024-09-13T17:23:39.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.473+0000 7fd262ffd640 10 client.18123 handle_command_reply: tid=0 2024-09-13T17:23:39.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.473+0000 7fd28c9e4740 1 client.18123 shutdown 2024-09-13T17:23:39.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.473+0000 7fd28c9e4740 1 -- 172.21.15.87:0/4056045718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562f89c830e0 msgr2=0x562f89c8a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:39.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.473+0000 7fd28c9e4740 1 --2- 172.21.15.87:0/4056045718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562f89c830e0 0x562f89c8a4a0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fd2780ca3f0 tx=0x7fd278007f90 comp rx=0 tx=0).stop 2024-09-13T17:23:39.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.473+0000 7fd28c9e4740 1 -- 172.21.15.87:0/4056045718 shutdown_connections 2024-09-13T17:23:39.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.473+0000 7fd28c9e4740 1 --2- 172.21.15.87:0/4056045718 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x562f89c9d420 0x562f89c9f810 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.473+0000 7fd28c9e4740 1 --2- 172.21.15.87:0/4056045718 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f89c8d980 0x562f89c8a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.473+0000 7fd28c9e4740 1 --2- 172.21.15.87:0/4056045718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562f89c830e0 0x562f89c8a4a0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.473+0000 7fd262ffd640 0 client.18123 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:23:39.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.473+0000 7fd28c9e4740 1 --2- 172.21.15.87:0/4056045718 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f89c827c0 0x562f89c8d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.473+0000 7fd28c9e4740 1 -- 172.21.15.87:0/4056045718 >> 172.21.15.87:0/4056045718 conn(0x562f89c7ed50 msgr2=0x562f89c841a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:39.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.473+0000 7fd28c9e4740 1 -- 172.21.15.87:0/4056045718 shutdown_connections 2024-09-13T17:23:39.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.473+0000 7fd28c9e4740 1 -- 172.21.15.87:0/4056045718 wait complete. 2024-09-13T17:23:39.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.473+0000 7fd28c9e4740 20 client.18123 trim_cache size 0 max 16384 2024-09-13T17:23:39.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.487+0000 7fd28c9e4740 1 Processor -- start 2024-09-13T17:23:39.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.487+0000 7fd28c9e4740 1 -- start start 2024-09-13T17:23:39.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.488+0000 7fd28c9e4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562f89c827c0 0x562f89c8cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.488+0000 7fd28c9e4740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f89c830e0 0x562f89c94650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.488+0000 7fd28c9e4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f89c8d980 0x562f89c94b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.488+0000 7fd28c9e4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f89c9d250 con 0x562f89c827c0 2024-09-13T17:23:39.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.488+0000 7fd28c9e4740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f89c99560 con 0x562f89c830e0 2024-09-13T17:23:39.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.488+0000 7fd28c9e4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f89c8b260 con 0x562f89c8d980 2024-09-13T17:23:39.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.488+0000 7fd2837fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562f89c827c0 0x562f89c8cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:39.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.488+0000 7fd2837fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562f89c827c0 0x562f89c8cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37546/0 (socket says 172.21.15.87:37546) 2024-09-13T17:23:39.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.488+0000 7fd2837fe640 1 -- 172.21.15.87:0/1164649762 learned_addr learned my addr 172.21.15.87:0/1164649762 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:39.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.488+0000 7fd282ffd640 1 --2- 172.21.15.87:0/1164649762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f89c830e0 0x562f89c94650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:39.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.488+0000 7fd2837fe640 1 -- 172.21.15.87:0/1164649762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f89c8d980 msgr2=0x562f89c94b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:39.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.488+0000 7fd2837fe640 1 --2- 172.21.15.87:0/1164649762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f89c8d980 0x562f89c94b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.488+0000 7fd2837fe640 1 -- 172.21.15.87:0/1164649762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f89c830e0 msgr2=0x562f89c94650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:39.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.488+0000 7fd2837fe640 1 --2- 172.21.15.87:0/1164649762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f89c830e0 0x562f89c94650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.488+0000 7fd2837fe640 1 -- 172.21.15.87:0/1164649762 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f89b871c0 con 0x562f89c827c0 2024-09-13T17:23:39.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.488+0000 7fd2837fe640 1 --2- 172.21.15.87:0/1164649762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562f89c827c0 0x562f89c8cd80 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fd274005be0 tx=0x7fd27400b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c524ece4e1fd87d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:39.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.488+0000 7fd26a7fc640 1 -- 172.21.15.87:0/1164649762 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27400f490 con 0x562f89c827c0 2024-09-13T17:23:39.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.488+0000 7fd26a7fc640 1 -- 172.21.15.87:0/1164649762 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd274017ba0 con 0x562f89c827c0 2024-09-13T17:23:39.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.488+0000 7fd26a7fc640 1 -- 172.21.15.87:0/1164649762 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd274005570 con 0x562f89c827c0 2024-09-13T17:23:39.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.489+0000 7fd28c9e4740 1 -- 172.21.15.87:0/1164649762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562f89c827c0 msgr2=0x562f89c8cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:39.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.489+0000 7fd28c9e4740 1 --2- 172.21.15.87:0/1164649762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562f89c827c0 0x562f89c8cd80 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fd274005be0 tx=0x7fd27400b3b0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.489+0000 7fd28c9e4740 1 -- 172.21.15.87:0/1164649762 shutdown_connections 2024-09-13T17:23:39.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.489+0000 7fd28c9e4740 1 --2- 172.21.15.87:0/1164649762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f89c8d980 0x562f89c94b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.489+0000 7fd28c9e4740 1 --2- 172.21.15.87:0/1164649762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f89c830e0 0x562f89c94650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.489+0000 7fd28c9e4740 1 --2- 172.21.15.87:0/1164649762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562f89c827c0 0x562f89c8cd80 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.489+0000 7fd28c9e4740 1 -- 172.21.15.87:0/1164649762 >> 172.21.15.87:0/1164649762 conn(0x562f89c7ed50 msgr2=0x562f89c88db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:39.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.489+0000 7fd28c9e4740 1 -- 172.21.15.87:0/1164649762 shutdown_connections 2024-09-13T17:23:39.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.489+0000 7fd28c9e4740 1 -- 172.21.15.87:0/1164649762 wait complete. 2024-09-13T17:23:39.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.489+0000 7fd28c9e4740 1 -- start start 2024-09-13T17:23:39.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.490+0000 7fd28c9e4740 1 Processor -- start 2024-09-13T17:23:39.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.490+0000 7fd28c9e4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f89c830e0 0x562f89c93950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.490+0000 7fd28c9e4740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f89c8d980 0x562f89c93e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.490+0000 7fd28c9e4740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562f89ced980 0x562f89cede00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.490+0000 7fd28c9e4740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f89cee340 con 0x562f89ced980 2024-09-13T17:23:39.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.490+0000 7fd28c9e4740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f89cee4b0 con 0x562f89c8d980 2024-09-13T17:23:39.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.490+0000 7fd28c9e4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f89cee670 con 0x562f89c830e0 2024-09-13T17:23:39.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.490+0000 7fd28c9e4740 10 client.0 _ll_register_callbacks cb 0x7fd278095410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:23:39.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.490+0000 7fd283fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562f89ced980 0x562f89cede00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:39.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.490+0000 7fd283fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562f89ced980 0x562f89cede00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37558/0 (socket says 172.21.15.87:37558) 2024-09-13T17:23:39.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.490+0000 7fd283fff640 1 -- 172.21.15.87:0/2944503973 learned_addr learned my addr 172.21.15.87:0/2944503973 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:39.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.490+0000 7fd282ffd640 1 --2- 172.21.15.87:0/2944503973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f89c8d980 0x562f89c93e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:39.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.490+0000 7fd2837fe640 1 --2- 172.21.15.87:0/2944503973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f89c830e0 0x562f89c93950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:39.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.490+0000 7fd283fff640 1 -- 172.21.15.87:0/2944503973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f89c830e0 msgr2=0x562f89c93950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:39.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.490+0000 7fd283fff640 1 --2- 172.21.15.87:0/2944503973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f89c830e0 0x562f89c93950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.490+0000 7fd283fff640 1 -- 172.21.15.87:0/2944503973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f89c8d980 msgr2=0x562f89c93e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:39.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.490+0000 7fd283fff640 1 --2- 172.21.15.87:0/2944503973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f89c8d980 0x562f89c93e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.490+0000 7fd283fff640 1 -- 172.21.15.87:0/2944503973 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562f89ba2970 con 0x562f89ced980 2024-09-13T17:23:39.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.490+0000 7fd283fff640 1 --2- 172.21.15.87:0/2944503973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562f89ced980 0x562f89cede00 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fd27c009cd0 tx=0x7fd27c030970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cf010d1f6011482 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:39.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.490+0000 7fd262ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:23:39.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.491+0000 7fd262ffd640 1 -- 172.21.15.87:0/2944503973 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c003e40 con 0x562f89ced980 2024-09-13T17:23:39.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.491+0000 7fd262ffd640 1 -- 172.21.15.87:0/2944503973 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fd27c004040 con 0x562f89ced980 2024-09-13T17:23:39.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.491+0000 7fd28c9e4740 1 -- 172.21.15.87:0/2944503973 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd274017a30 con 0x562f89ced980 2024-09-13T17:23:39.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.491+0000 7fd262ffd640 1 -- 172.21.15.87:0/2944503973 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd27c004200 con 0x562f89ced980 2024-09-13T17:23:39.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.491+0000 7fd28c9e4740 10 client.18129 fetch_fsmap learned FSMap version 36 2024-09-13T17:23:39.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.491+0000 7fd28c9e4740 1 -- 172.21.15.87:0/2944503973 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x562f89bac990 con 0x562f89ced980 2024-09-13T17:23:39.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.491+0000 7fd262ffd640 1 -- 172.21.15.87:0/2944503973 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd274017a30 con 0x562f89ced980 2024-09-13T17:23:39.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.491+0000 7fd262ffd640 1 -- 172.21.15.87:0/2944503973 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd27c04fa70 con 0x562f89ced980 2024-09-13T17:23:39.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.491+0000 7fd28c9e4740 10 client.18129 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:23:39.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.491+0000 7fd28c9e4740 10 client.18129 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:23:39.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.491+0000 7fd28c9e4740 20 client.18129 populate_metadata read hostname 'smithi087' 2024-09-13T17:23:39.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.491+0000 7fd28c9e4740 1 --2- 172.21.15.87:0/2944503973 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x562f89cf5f50 0x562f89cf8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.491+0000 7fd28c9e4740 4 client.18129 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-13T17:23:39.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.491+0000 7fd28c9e4740 1 -- 172.21.15.87:0/2944503973 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x562f8993eeb0 con 0x562f89cf5f50 2024-09-13T17:23:39.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.491+0000 7fd2837fe640 1 --2- 172.21.15.87:0/2944503973 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x562f89cf5f50 0x562f89cf8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:39.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.492+0000 7fd262ffd640 10 client.18129 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:23:39.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.492+0000 7fd2837fe640 1 --2- 172.21.15.87:0/2944503973 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x562f89cf5f50 0x562f89cf8370 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b869a3055cfc168 server_cookie=fc3d939cec59d741 in_seq=0 out_seq=0 2024-09-13T17:23:39.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.493+0000 7fd262ffd640 1 -- 172.21.15.87:0/2944503973 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x562f8993eeb0 con 0x562f89cf5f50 2024-09-13T17:23:39.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.493+0000 7fd262ffd640 10 client.18129 handle_command_reply: tid=0 2024-09-13T17:23:39.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.493+0000 7fd28c9e4740 1 client.18129 shutdown 2024-09-13T17:23:39.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.493+0000 7fd28c9e4740 1 -- 172.21.15.87:0/2944503973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562f89ced980 msgr2=0x562f89cede00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:39.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.493+0000 7fd28c9e4740 1 --2- 172.21.15.87:0/2944503973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562f89ced980 0x562f89cede00 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fd27c009cd0 tx=0x7fd27c030970 comp rx=0 tx=0).stop 2024-09-13T17:23:39.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.493+0000 7fd28c9e4740 1 -- 172.21.15.87:0/2944503973 shutdown_connections 2024-09-13T17:23:39.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.493+0000 7fd28c9e4740 1 --2- 172.21.15.87:0/2944503973 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x562f89cf5f50 0x562f89cf8370 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.493+0000 7fd28c9e4740 1 --2- 172.21.15.87:0/2944503973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x562f89ced980 0x562f89cede00 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.493+0000 7fd28c9e4740 1 --2- 172.21.15.87:0/2944503973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f89c8d980 0x562f89c93e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.493+0000 7fd28c9e4740 1 --2- 172.21.15.87:0/2944503973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f89c830e0 0x562f89c93950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.493+0000 7fd28c9e4740 1 -- 172.21.15.87:0/2944503973 >> 172.21.15.87:0/2944503973 conn(0x562f89c7ed50 msgr2=0x562f89c88ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:39.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.493+0000 7fd262ffd640 0 client.18129 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:23:39.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.494+0000 7fd28c9e4740 1 -- 172.21.15.87:0/2944503973 shutdown_connections 2024-09-13T17:23:39.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.494+0000 7fd28c9e4740 1 -- 172.21.15.87:0/2944503973 wait complete. 2024-09-13T17:23:39.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.494+0000 7fd28c9e4740 20 client.18129 trim_cache size 0 max 16384 2024-09-13T17:23:39.505 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:23:39.505 INFO:teuthology.orchestra.run.smithi087.stdout: "return_code": 0, 2024-09-13T17:23:39.505 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_tag": "df67b394-4145-4458-bed5-bb51dd985e78", 2024-09-13T17:23:39.505 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": "asynchronous" 2024-09-13T17:23:39.505 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:23:39.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.494+0000 7fd289be9640 1 -- 172.21.15.87:0/3267209474 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd26c0a1200 msgr2=0x7fd26c0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:39.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.494+0000 7fd289be9640 1 --2- 172.21.15.87:0/3267209474 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd26c0a1200 0x7fd26c0a36c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd27c02ae00 tx=0x7fd27c009360 comp rx=0 tx=0).stop 2024-09-13T17:23:39.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.494+0000 7fd289be9640 1 -- 172.21.15.87:0/3267209474 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2841050a0 msgr2=0x7fd284198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:39.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.494+0000 7fd289be9640 1 --2- 172.21.15.87:0/3267209474 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2841050a0 0x7fd284198a30 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fd27800d740 tx=0x7fd27800dc00 comp rx=0 tx=0).stop 2024-09-13T17:23:39.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.494+0000 7fd289be9640 1 -- 172.21.15.87:0/3267209474 shutdown_connections 2024-09-13T17:23:39.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.494+0000 7fd289be9640 1 --2- 172.21.15.87:0/3267209474 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd28419ce20 0x7fd28419d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.494+0000 7fd289be9640 1 --2- 172.21.15.87:0/3267209474 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd26c0a1200 0x7fd26c0a36c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.494+0000 7fd289be9640 1 --2- 172.21.15.87:0/3267209474 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2841050a0 0x7fd284198a30 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.494+0000 7fd289be9640 1 --2- 172.21.15.87:0/3267209474 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2840fff50 0x7fd2841984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.494+0000 7fd289be9640 1 -- 172.21.15.87:0/3267209474 >> 172.21.15.87:0/3267209474 conn(0x7fd2840fb9e0 msgr2=0x7fd2840fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:39.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.494+0000 7fd289be9640 1 -- 172.21.15.87:0/3267209474 shutdown_connections 2024-09-13T17:23:39.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.494+0000 7fd289be9640 1 -- 172.21.15.87:0/3267209474 wait complete. 2024-09-13T17:23:39.508 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:23:39.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.646+0000 7f17a14aa640 1 -- 172.21.15.87:0/316020365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f179c0fee60 msgr2=0x7f179c0ff240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:39.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.646+0000 7f17a14aa640 1 --2- 172.21.15.87:0/316020365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f179c0fee60 0x7f179c0ff240 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f178c009cd0 tx=0x7f178c02a8e0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.647+0000 7f17a14aa640 1 -- 172.21.15.87:0/316020365 shutdown_connections 2024-09-13T17:23:39.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.647+0000 7f17a14aa640 1 --2- 172.21.15.87:0/316020365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f179c103fb0 0x7f179c10bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.647+0000 7f17a14aa640 1 --2- 172.21.15.87:0/316020365 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f179c0ff810 0x7f179c103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.647+0000 7f17a14aa640 1 --2- 172.21.15.87:0/316020365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f179c0fee60 0x7f179c0ff240 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.647+0000 7f17a14aa640 1 -- 172.21.15.87:0/316020365 >> 172.21.15.87:0/316020365 conn(0x7f179c075c60 msgr2=0x7f179c0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:39.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.647+0000 7f17a14aa640 1 -- 172.21.15.87:0/316020365 shutdown_connections 2024-09-13T17:23:39.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.647+0000 7f17a14aa640 1 -- 172.21.15.87:0/316020365 wait complete. 2024-09-13T17:23:39.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.647+0000 7f17a14aa640 1 Processor -- start 2024-09-13T17:23:39.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.647+0000 7f17a14aa640 1 -- start start 2024-09-13T17:23:39.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.648+0000 7f17a14aa640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f179c0fee60 0x7f179c196310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.648+0000 7f17a14aa640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f179c103fb0 0x7f179c196850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.648+0000 7f17a14aa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f179c19ac40 0x7f179c19b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.648+0000 7f17a14aa640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c19b630 con 0x7f179c19ac40 2024-09-13T17:23:39.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.648+0000 7f17a14aa640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c19b7a0 con 0x7f179c103fb0 2024-09-13T17:23:39.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.648+0000 7f17a14aa640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c19b910 con 0x7f179c0fee60 2024-09-13T17:23:39.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.648+0000 7f179b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f179c19ac40 0x7f179c19b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:39.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.648+0000 7f179b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f179c19ac40 0x7f179c19b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37564/0 (socket says 172.21.15.87:37564) 2024-09-13T17:23:39.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.648+0000 7f179b7fe640 1 -- 172.21.15.87:0/2779419661 learned_addr learned my addr 172.21.15.87:0/2779419661 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:39.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.648+0000 7f179a7fc640 1 --2- 172.21.15.87:0/2779419661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f179c103fb0 0x7f179c196850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:39.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.648+0000 7f179affd640 1 --2- 172.21.15.87:0/2779419661 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f179c0fee60 0x7f179c196310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:39.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.648+0000 7f179b7fe640 1 -- 172.21.15.87:0/2779419661 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f179c0fee60 msgr2=0x7f179c196310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:39.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.648+0000 7f179b7fe640 1 --2- 172.21.15.87:0/2779419661 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f179c0fee60 0x7f179c196310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.648+0000 7f179b7fe640 1 -- 172.21.15.87:0/2779419661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f179c103fb0 msgr2=0x7f179c196850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:39.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.648+0000 7f179b7fe640 1 --2- 172.21.15.87:0/2779419661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f179c103fb0 0x7f179c196850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.648+0000 7f179b7fe640 1 -- 172.21.15.87:0/2779419661 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178c009900 con 0x7f179c19ac40 2024-09-13T17:23:39.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.648+0000 7f179a7fc640 1 --2- 172.21.15.87:0/2779419661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f179c103fb0 0x7f179c196850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:23:39.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.648+0000 7f179b7fe640 1 --2- 172.21.15.87:0/2779419661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f179c19ac40 0x7f179c19b0f0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f179400d680 tx=0x7f179400db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:39.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.648+0000 7f1793fff640 1 -- 172.21.15.87:0/2779419661 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1794005220 con 0x7f179c19ac40 2024-09-13T17:23:39.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.648+0000 7f1793fff640 1 -- 172.21.15.87:0/2779419661 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1794009cd0 con 0x7f179c19ac40 2024-09-13T17:23:39.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.648+0000 7f17a14aa640 1 -- 172.21.15.87:0/2779419661 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f179c1a2ef0 con 0x7f179c19ac40 2024-09-13T17:23:39.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.648+0000 7f1793fff640 1 -- 172.21.15.87:0/2779419661 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1794004d60 con 0x7f179c19ac40 2024-09-13T17:23:39.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.648+0000 7f17a14aa640 1 -- 172.21.15.87:0/2779419661 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f179c1a3320 con 0x7f179c19ac40 2024-09-13T17:23:39.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.651+0000 7f1793fff640 1 -- 172.21.15.87:0/2779419661 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f1794009820 con 0x7f179c19ac40 2024-09-13T17:23:39.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.651+0000 7f17a41cf740 1 Processor -- start 2024-09-13T17:23:39.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.651+0000 7f17a41cf740 1 -- start start 2024-09-13T17:23:39.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.651+0000 7f17a41cf740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555b029ede10 0x555b029ee1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.651+0000 7f17a41cf740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b029ee730 0x555b029f8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.651+0000 7f17a41cf740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555b029f8fd0 0x555b029fb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.651+0000 7f17a41cf740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b02958f20 con 0x555b029f8fd0 2024-09-13T17:23:39.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.651+0000 7f17a41cf740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b029566b0 con 0x555b029ee730 2024-09-13T17:23:39.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.651+0000 7f17a41cf740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b02951fa0 con 0x555b029ede10 2024-09-13T17:23:39.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.651+0000 7f1793fff640 1 --2- 172.21.15.87:0/2779419661 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f17880a1200 0x7f17880a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.652+0000 7f179a7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555b029f8fd0 0x555b029fb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:39.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.652+0000 7f179a7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555b029f8fd0 0x555b029fb3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37576/0 (socket says 172.21.15.87:37576) 2024-09-13T17:23:39.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.652+0000 7f179a7fc640 1 -- 172.21.15.87:0/3876532908 learned_addr learned my addr 172.21.15.87:0/3876532908 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:39.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.652+0000 7f179affd640 1 --2- 172.21.15.87:0/3876532908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b029ee730 0x555b029f8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:39.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.652+0000 7f179a7fc640 1 --2- 172.21.15.87:0/3876532908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555b029ede10 0x555b029ee1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:39.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.652+0000 7f179b7fe640 1 --2- 172.21.15.87:0/2779419661 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f17880a1200 0x7f17880a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:39.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.652+0000 7f1793fff640 1 -- 172.21.15.87:0/2779419661 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f17940cca90 con 0x7f179c19ac40 2024-09-13T17:23:39.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.652+0000 7f179a7fc640 1 -- 172.21.15.87:0/3876532908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555b029ede10 msgr2=0x555b029ee1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:39.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.652+0000 7f179a7fc640 1 --2- 172.21.15.87:0/3876532908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555b029ede10 0x555b029ee1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.652+0000 7f179a7fc640 1 -- 172.21.15.87:0/3876532908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b029ee730 msgr2=0x555b029f8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:39.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.652+0000 7f179a7fc640 1 --2- 172.21.15.87:0/3876532908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b029ee730 0x555b029f8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.652+0000 7f179a7fc640 1 -- 172.21.15.87:0/3876532908 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b0290c840 con 0x555b029f8fd0 2024-09-13T17:23:39.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.652+0000 7f179a7fc640 1 --2- 172.21.15.87:0/3876532908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555b029f8fd0 0x555b029fb3c0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f1784014a20 tx=0x7f178400c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc00acca70a10431 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:39.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.652+0000 7f179b7fe640 1 --2- 172.21.15.87:0/2779419661 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f17880a1200 0x7f17880a36c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f17940c9e80 tx=0x7f1794084040 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:39.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.652+0000 7f17917fa640 1 -- 172.21.15.87:0/3876532908 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17840142d0 con 0x555b029f8fd0 2024-09-13T17:23:39.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.652+0000 7f17917fa640 1 -- 172.21.15.87:0/3876532908 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f178401a030 con 0x555b029f8fd0 2024-09-13T17:23:39.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.652+0000 7f17917fa640 1 -- 172.21.15.87:0/3876532908 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1784004d70 con 0x555b029f8fd0 2024-09-13T17:23:39.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.653+0000 7f17a41cf740 1 -- 172.21.15.87:0/3876532908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555b029f8fd0 msgr2=0x555b029fb3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:39.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.653+0000 7f17a41cf740 1 --2- 172.21.15.87:0/3876532908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555b029f8fd0 0x555b029fb3c0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f1784014a20 tx=0x7f178400c540 comp rx=0 tx=0).stop 2024-09-13T17:23:39.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.653+0000 7f17a41cf740 1 -- 172.21.15.87:0/3876532908 shutdown_connections 2024-09-13T17:23:39.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.653+0000 7f17a41cf740 1 --2- 172.21.15.87:0/3876532908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555b029f8fd0 0x555b029fb3c0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.653+0000 7f17a41cf740 1 --2- 172.21.15.87:0/3876532908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b029ee730 0x555b029f8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.653+0000 7f17a41cf740 1 --2- 172.21.15.87:0/3876532908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555b029ede10 0x555b029ee1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.653+0000 7f17a41cf740 1 -- 172.21.15.87:0/3876532908 >> 172.21.15.87:0/3876532908 conn(0x555b029ea380 msgr2=0x555b029ea760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:39.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.653+0000 7f17a41cf740 1 -- 172.21.15.87:0/3876532908 shutdown_connections 2024-09-13T17:23:39.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.653+0000 7f17a41cf740 1 -- 172.21.15.87:0/3876532908 wait complete. 2024-09-13T17:23:39.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.653+0000 7f17a41cf740 1 -- start start 2024-09-13T17:23:39.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.653+0000 7f17a41cf740 1 Processor -- start 2024-09-13T17:23:39.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.654+0000 7f17a41cf740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b029ede10 0x555b029f8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.654+0000 7f17a41cf740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555b029ee730 0x555b029f5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.654+0000 7f17a41cf740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555b029f8fd0 0x555b029f6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.654+0000 7f17a41cf740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b028f32a0 con 0x555b029ee730 2024-09-13T17:23:39.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.654+0000 7f17a41cf740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b0262a430 con 0x555b029ede10 2024-09-13T17:23:39.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.654+0000 7f17a41cf740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b028d5680 con 0x555b029f8fd0 2024-09-13T17:23:39.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.654+0000 7f17a41cf740 10 client.0 _ll_register_callbacks cb 0x555b0294b610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:23:39.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.654+0000 7f179affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555b029ee730 0x555b029f5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:39.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.654+0000 7f179affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555b029ee730 0x555b029f5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37580/0 (socket says 172.21.15.87:37580) 2024-09-13T17:23:39.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.654+0000 7f179affd640 1 -- 172.21.15.87:0/1320507604 learned_addr learned my addr 172.21.15.87:0/1320507604 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:39.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.654+0000 7f179a7fc640 1 --2- 172.21.15.87:0/1320507604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b029ede10 0x555b029f8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:39.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.654+0000 7f179a7fc640 1 --2- 172.21.15.87:0/1320507604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555b029f8fd0 0x555b029f6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:39.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.654+0000 7f179affd640 1 -- 172.21.15.87:0/1320507604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555b029f8fd0 msgr2=0x555b029f6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:39.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.654+0000 7f179affd640 1 --2- 172.21.15.87:0/1320507604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555b029f8fd0 0x555b029f6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.654+0000 7f179affd640 1 -- 172.21.15.87:0/1320507604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b029ede10 msgr2=0x555b029f8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:39.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.654+0000 7f179affd640 1 --2- 172.21.15.87:0/1320507604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b029ede10 0x555b029f8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.654+0000 7f179affd640 1 -- 172.21.15.87:0/1320507604 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17840146d0 con 0x555b029ee730 2024-09-13T17:23:39.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.654+0000 7f179affd640 1 --2- 172.21.15.87:0/1320507604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555b029ee730 0x555b029f5c60 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f178c005cc0 tx=0x7f178c030fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f826ee0da74e78 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:39.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.654+0000 7f17827fc640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:23:39.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.654+0000 7f17827fc640 1 -- 172.21.15.87:0/1320507604 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c04b070 con 0x555b029ee730 2024-09-13T17:23:39.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.654+0000 7f17827fc640 1 -- 172.21.15.87:0/1320507604 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f178c030870 con 0x555b029ee730 2024-09-13T17:23:39.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.654+0000 7f17a41cf740 1 -- 172.21.15.87:0/1320507604 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555b026454e0 con 0x555b029ee730 2024-09-13T17:23:39.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.655+0000 7f17827fc640 1 -- 172.21.15.87:0/1320507604 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f178c041040 con 0x555b029ee730 2024-09-13T17:23:39.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.655+0000 7f17a41cf740 10 client.18141 fetch_fsmap learned FSMap version 36 2024-09-13T17:23:39.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.655+0000 7f17a41cf740 1 -- 172.21.15.87:0/1320507604 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x555b02950620 con 0x555b029ee730 2024-09-13T17:23:39.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.655+0000 7f17827fc640 1 -- 172.21.15.87:0/1320507604 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x555b026454e0 con 0x555b029ee730 2024-09-13T17:23:39.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.655+0000 7f17827fc640 1 -- 172.21.15.87:0/1320507604 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f178c04e020 con 0x555b029ee730 2024-09-13T17:23:39.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.655+0000 7f17a41cf740 10 client.18141 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:23:39.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.655+0000 7f17a41cf740 10 client.18141 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:23:39.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.655+0000 7f17a41cf740 20 client.18141 populate_metadata read hostname 'smithi087' 2024-09-13T17:23:39.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.655+0000 7f17a41cf740 1 --2- 172.21.15.87:0/1320507604 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x555b02a08df0 0x555b02a0b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.655+0000 7f17a41cf740 4 client.18141 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:23:39.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.655+0000 7f17a41cf740 1 -- 172.21.15.87:0/1320507604 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555b026567e0 con 0x555b02a08df0 2024-09-13T17:23:39.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.655+0000 7f179a7fc640 1 --2- 172.21.15.87:0/1320507604 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x555b02a08df0 0x555b02a0b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:39.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.656+0000 7f17827fc640 10 client.18141 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:23:39.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.656+0000 7f179a7fc640 1 --2- 172.21.15.87:0/1320507604 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x555b02a08df0 0x555b02a0b210 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2b8a2f584c56f91 server_cookie=a724f61c3aa230bb in_seq=0 out_seq=0 2024-09-13T17:23:39.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.656+0000 7f17827fc640 1 -- 172.21.15.87:0/1320507604 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x555b026567e0 con 0x555b02a08df0 2024-09-13T17:23:39.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.656+0000 7f17827fc640 10 client.18141 handle_command_reply: tid=0 2024-09-13T17:23:39.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.656+0000 7f17a41cf740 1 client.18141 shutdown 2024-09-13T17:23:39.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.656+0000 7f17a41cf740 1 -- 172.21.15.87:0/1320507604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555b029ee730 msgr2=0x555b029f5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:39.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.656+0000 7f17a41cf740 1 --2- 172.21.15.87:0/1320507604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555b029ee730 0x555b029f5c60 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f178c005cc0 tx=0x7f178c030fb0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.656+0000 7f17a41cf740 1 -- 172.21.15.87:0/1320507604 shutdown_connections 2024-09-13T17:23:39.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.656+0000 7f17a41cf740 1 --2- 172.21.15.87:0/1320507604 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x555b02a08df0 0x555b02a0b210 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.656+0000 7f17a41cf740 1 --2- 172.21.15.87:0/1320507604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555b029f8fd0 0x555b029f6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.656+0000 7f17a41cf740 1 --2- 172.21.15.87:0/1320507604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555b029ee730 0x555b029f5c60 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.656+0000 7f17827fc640 0 client.18141 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:23:39.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.656+0000 7f17a41cf740 1 --2- 172.21.15.87:0/1320507604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b029ede10 0x555b029f8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.656+0000 7f17a41cf740 1 -- 172.21.15.87:0/1320507604 >> 172.21.15.87:0/1320507604 conn(0x555b029ea380 msgr2=0x555b029f0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:39.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.656+0000 7f17a41cf740 1 -- 172.21.15.87:0/1320507604 shutdown_connections 2024-09-13T17:23:39.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.656+0000 7f17a41cf740 1 -- 172.21.15.87:0/1320507604 wait complete. 2024-09-13T17:23:39.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.656+0000 7f17a41cf740 20 client.18141 trim_cache size 0 max 16384 2024-09-13T17:23:39.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.670+0000 7f17a41cf740 1 Processor -- start 2024-09-13T17:23:39.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.670+0000 7f17a41cf740 1 -- start start 2024-09-13T17:23:39.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.671+0000 7f17a41cf740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555b029ede10 0x555b02a047f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.671+0000 7f17a41cf740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b029ee730 0x555b029f8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.671+0000 7f17a41cf740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555b029f8fd0 0x555b029f4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.671+0000 7f17a41cf740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b02656810 con 0x555b029f8fd0 2024-09-13T17:23:39.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.671+0000 7f17a41cf740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b02645510 con 0x555b029ee730 2024-09-13T17:23:39.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.671+0000 7f17a41cf740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b029ef030 con 0x555b029ede10 2024-09-13T17:23:39.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.671+0000 7f179a7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555b029f8fd0 0x555b029f4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:39.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.671+0000 7f179a7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555b029f8fd0 0x555b029f4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37588/0 (socket says 172.21.15.87:37588) 2024-09-13T17:23:39.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.671+0000 7f179a7fc640 1 -- 172.21.15.87:0/54456169 learned_addr learned my addr 172.21.15.87:0/54456169 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:39.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.671+0000 7f179a7fc640 1 --2- 172.21.15.87:0/54456169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555b029ede10 0x555b02a047f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:39.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.671+0000 7f179affd640 1 --2- 172.21.15.87:0/54456169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b029ee730 0x555b029f8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:39.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.671+0000 7f179a7fc640 1 -- 172.21.15.87:0/54456169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555b029ede10 msgr2=0x555b02a047f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:39.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.671+0000 7f179a7fc640 1 --2- 172.21.15.87:0/54456169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555b029ede10 0x555b02a047f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.671+0000 7f179a7fc640 1 -- 172.21.15.87:0/54456169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b029ee730 msgr2=0x555b029f8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:39.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.671+0000 7f179a7fc640 1 --2- 172.21.15.87:0/54456169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b029ee730 0x555b029f8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.671+0000 7f179a7fc640 1 -- 172.21.15.87:0/54456169 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b028f2790 con 0x555b029f8fd0 2024-09-13T17:23:39.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.671+0000 7f179affd640 1 --2- 172.21.15.87:0/54456169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b029ee730 0x555b029f8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:23:39.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.671+0000 7f179a7fc640 1 --2- 172.21.15.87:0/54456169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555b029f8fd0 0x555b029f4510 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f1784000c00 tx=0x7f178400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da81e4542166ae8d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:39.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.671+0000 7f1791ffb640 1 -- 172.21.15.87:0/54456169 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1784026070 con 0x555b029f8fd0 2024-09-13T17:23:39.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.671+0000 7f1791ffb640 1 -- 172.21.15.87:0/54456169 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1784027040 con 0x555b029f8fd0 2024-09-13T17:23:39.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.671+0000 7f1791ffb640 1 -- 172.21.15.87:0/54456169 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178400f730 con 0x555b029f8fd0 2024-09-13T17:23:39.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.672+0000 7f17a41cf740 1 -- 172.21.15.87:0/54456169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555b029f8fd0 msgr2=0x555b029f4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:39.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.672+0000 7f17a41cf740 1 --2- 172.21.15.87:0/54456169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555b029f8fd0 0x555b029f4510 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f1784000c00 tx=0x7f178400ccb0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.672+0000 7f17a41cf740 1 -- 172.21.15.87:0/54456169 shutdown_connections 2024-09-13T17:23:39.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.672+0000 7f17a41cf740 1 --2- 172.21.15.87:0/54456169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555b029f8fd0 0x555b029f4510 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.672+0000 7f17a41cf740 1 --2- 172.21.15.87:0/54456169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b029ee730 0x555b029f8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.672+0000 7f17a41cf740 1 --2- 172.21.15.87:0/54456169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555b029ede10 0x555b02a047f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.672+0000 7f17a41cf740 1 -- 172.21.15.87:0/54456169 >> 172.21.15.87:0/54456169 conn(0x555b029ea380 msgr2=0x555b029f0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:39.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.672+0000 7f17a41cf740 1 -- 172.21.15.87:0/54456169 shutdown_connections 2024-09-13T17:23:39.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.672+0000 7f17a41cf740 1 -- 172.21.15.87:0/54456169 wait complete. 2024-09-13T17:23:39.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.672+0000 7f17a41cf740 1 -- start start 2024-09-13T17:23:39.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.673+0000 7f17a41cf740 1 Processor -- start 2024-09-13T17:23:39.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.673+0000 7f17a41cf740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b029ede10 0x555b029fbf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.673+0000 7f17a41cf740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555b029ee730 0x555b029fc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.673+0000 7f17a41cf740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555b029f8fd0 0x555b02a582b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.673+0000 7f17a41cf740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b02a58820 con 0x555b029f8fd0 2024-09-13T17:23:39.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.673+0000 7f17a41cf740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b02a58990 con 0x555b029ede10 2024-09-13T17:23:39.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.673+0000 7f17a41cf740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b02a58b50 con 0x555b029ee730 2024-09-13T17:23:39.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.673+0000 7f17a41cf740 10 client.0 _ll_register_callbacks cb 0x7f178c009800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:23:39.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.673+0000 7f179a7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555b029f8fd0 0x555b02a582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:39.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.673+0000 7f179a7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555b029f8fd0 0x555b02a582b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37590/0 (socket says 172.21.15.87:37590) 2024-09-13T17:23:39.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.673+0000 7f179a7fc640 1 -- 172.21.15.87:0/2839626826 learned_addr learned my addr 172.21.15.87:0/2839626826 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:39.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.673+0000 7f179a7fc640 1 --2- 172.21.15.87:0/2839626826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b029ede10 0x555b029fbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:39.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.673+0000 7f179affd640 1 --2- 172.21.15.87:0/2839626826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555b029ee730 0x555b029fc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:39.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.673+0000 7f179a7fc640 1 -- 172.21.15.87:0/2839626826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555b029ee730 msgr2=0x555b029fc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:39.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.673+0000 7f179a7fc640 1 --2- 172.21.15.87:0/2839626826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555b029ee730 0x555b029fc4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.673+0000 7f179a7fc640 1 -- 172.21.15.87:0/2839626826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b029ede10 msgr2=0x555b029fbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:23:39.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.673+0000 7f179a7fc640 1 --2- 172.21.15.87:0/2839626826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b029ede10 0x555b029fbf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.673+0000 7f179a7fc640 1 -- 172.21.15.87:0/2839626826 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555b0290c840 con 0x555b029f8fd0 2024-09-13T17:23:39.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.673+0000 7f179a7fc640 1 --2- 172.21.15.87:0/2839626826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555b029f8fd0 0x555b02a582b0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f1784029fa0 tx=0x7f1784022040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1b2055876359f23 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:39.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.673+0000 7f17827fc640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:23:39.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.673+0000 7f17827fc640 1 -- 172.21.15.87:0/2839626826 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1784026070 con 0x555b029f8fd0 2024-09-13T17:23:39.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.673+0000 7f17827fc640 1 -- 172.21.15.87:0/2839626826 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f1784000e40 con 0x555b029f8fd0 2024-09-13T17:23:39.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.673+0000 7f17a41cf740 1 -- 172.21.15.87:0/2839626826 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f178401a030 con 0x555b029f8fd0 2024-09-13T17:23:39.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.674+0000 7f17827fc640 1 -- 172.21.15.87:0/2839626826 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1784029430 con 0x555b029f8fd0 2024-09-13T17:23:39.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.674+0000 7f17a41cf740 10 client.18147 fetch_fsmap learned FSMap version 36 2024-09-13T17:23:39.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.674+0000 7f17a41cf740 1 -- 172.21.15.87:0/2839626826 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x555b02917ea0 con 0x555b029f8fd0 2024-09-13T17:23:39.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.674+0000 7f17827fc640 1 -- 172.21.15.87:0/2839626826 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1784044020 con 0x555b029f8fd0 2024-09-13T17:23:39.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.674+0000 7f17827fc640 1 -- 172.21.15.87:0/2839626826 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1784012450 con 0x555b029f8fd0 2024-09-13T17:23:39.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.674+0000 7f17a41cf740 10 client.18147 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:23:39.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.674+0000 7f17a41cf740 10 client.18147 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:23:39.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.674+0000 7f17a41cf740 20 client.18147 populate_metadata read hostname 'smithi087' 2024-09-13T17:23:39.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.674+0000 7f17a41cf740 1 --2- 172.21.15.87:0/2839626826 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x555b02a60060 0x555b02a62480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:39.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.674+0000 7f17a41cf740 4 client.18147 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:23:39.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.674+0000 7f17a41cf740 1 -- 172.21.15.87:0/2839626826 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555b026a9e30 con 0x555b02a60060 2024-09-13T17:23:39.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.674+0000 7f179affd640 1 --2- 172.21.15.87:0/2839626826 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x555b02a60060 0x555b02a62480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:39.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.675+0000 7f17827fc640 10 client.18147 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:23:39.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.675+0000 7f179affd640 1 --2- 172.21.15.87:0/2839626826 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x555b02a60060 0x555b02a62480 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b7baecc5c33dc84 server_cookie=72ddb242a64f4cca in_seq=0 out_seq=0 2024-09-13T17:23:39.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.675+0000 7f17827fc640 1 -- 172.21.15.87:0/2839626826 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x555b026a9e30 con 0x555b02a60060 2024-09-13T17:23:39.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.675+0000 7f17827fc640 10 client.18147 handle_command_reply: tid=0 2024-09-13T17:23:39.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.675+0000 7f17a41cf740 1 client.18147 shutdown 2024-09-13T17:23:39.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.675+0000 7f17a41cf740 1 -- 172.21.15.87:0/2839626826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555b029f8fd0 msgr2=0x555b02a582b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:39.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.675+0000 7f17a41cf740 1 --2- 172.21.15.87:0/2839626826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555b029f8fd0 0x555b02a582b0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f1784029fa0 tx=0x7f1784022040 comp rx=0 tx=0).stop 2024-09-13T17:23:39.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.675+0000 7f17a41cf740 1 -- 172.21.15.87:0/2839626826 shutdown_connections 2024-09-13T17:23:39.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.675+0000 7f17a41cf740 1 --2- 172.21.15.87:0/2839626826 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x555b02a60060 0x555b02a62480 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.675+0000 7f17a41cf740 1 --2- 172.21.15.87:0/2839626826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555b029f8fd0 0x555b02a582b0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.675+0000 7f17827fc640 0 client.18147 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:23:39.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.675+0000 7f17a41cf740 1 --2- 172.21.15.87:0/2839626826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555b029ee730 0x555b029fc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.675+0000 7f17a41cf740 1 --2- 172.21.15.87:0/2839626826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b029ede10 0x555b029fbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.675+0000 7f17a41cf740 1 -- 172.21.15.87:0/2839626826 >> 172.21.15.87:0/2839626826 conn(0x555b029ea380 msgr2=0x555b029f4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:39.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.675+0000 7f17a41cf740 1 -- 172.21.15.87:0/2839626826 shutdown_connections 2024-09-13T17:23:39.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.675+0000 7f17a41cf740 1 -- 172.21.15.87:0/2839626826 wait complete. 2024-09-13T17:23:39.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.675+0000 7f17a41cf740 20 client.18147 trim_cache size 0 max 16384 2024-09-13T17:23:39.684 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:23:39.684 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-13T17:23:39.685 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": { 2024-09-13T17:23:39.685 INFO:teuthology.orchestra.run.smithi087.stdout: "df67b394-4145-4458-bed5-bb51dd985e78": { 2024-09-13T17:23:39.685 INFO:teuthology.orchestra.run.smithi087.stdout: "path": "/", 2024-09-13T17:23:39.685 INFO:teuthology.orchestra.run.smithi087.stdout: "tag": "df67b394-4145-4458-bed5-bb51dd985e78", 2024-09-13T17:23:39.685 INFO:teuthology.orchestra.run.smithi087.stdout: "options": "recursive,force" 2024-09-13T17:23:39.685 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:23:39.685 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:23:39.685 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:23:39.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.675+0000 7f17a14aa640 1 -- 172.21.15.87:0/2779419661 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f17880a1200 msgr2=0x7f17880a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:39.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.675+0000 7f17a14aa640 1 --2- 172.21.15.87:0/2779419661 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f17880a1200 0x7f17880a36c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f17940c9e80 tx=0x7f1794084040 comp rx=0 tx=0).stop 2024-09-13T17:23:39.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.675+0000 7f17a14aa640 1 -- 172.21.15.87:0/2779419661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f179c19ac40 msgr2=0x7f179c19b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:39.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.675+0000 7f17a14aa640 1 --2- 172.21.15.87:0/2779419661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f179c19ac40 0x7f179c19b0f0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f179400d680 tx=0x7f179400db40 comp rx=0 tx=0).stop 2024-09-13T17:23:39.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.675+0000 7f17a14aa640 1 -- 172.21.15.87:0/2779419661 shutdown_connections 2024-09-13T17:23:39.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.676+0000 7f17a14aa640 1 --2- 172.21.15.87:0/2779419661 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f17880a1200 0x7f17880a36c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.676+0000 7f17a14aa640 1 --2- 172.21.15.87:0/2779419661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f179c19ac40 0x7f179c19b0f0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.676+0000 7f17a14aa640 1 --2- 172.21.15.87:0/2779419661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f179c103fb0 0x7f179c196850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.676+0000 7f17a14aa640 1 --2- 172.21.15.87:0/2779419661 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f179c0fee60 0x7f179c196310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:39.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.676+0000 7f17a14aa640 1 -- 172.21.15.87:0/2779419661 >> 172.21.15.87:0/2779419661 conn(0x7f179c075c60 msgr2=0x7f179c102350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:39.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.676+0000 7f17a14aa640 1 -- 172.21.15.87:0/2779419661 shutdown_connections 2024-09-13T17:23:39.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:39.676+0000 7f17a14aa640 1 -- 172.21.15.87:0/2779419661 wait complete. 2024-09-13T17:23:39.687 INFO:tasks.cephfs.filesystem:scrub status for tag:df67b394-4145-4458-bed5-bb51dd985e78 - {'path': '/', 'tag': 'df67b394-4145-4458-bed5-bb51dd985e78', 'options': 'recursive,force'} 2024-09-13T17:23:40.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:40 smithi149 ceph-mon[35496]: scrub queued for path: / 2024-09-13T17:23:40.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:40 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:23:40.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:40 smithi149 ceph-mon[35496]: scrub summary: active paths [/] 2024-09-13T17:23:40.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:40 smithi149 ceph-mon[35496]: scrub summary: idle+waiting paths [/] 2024-09-13T17:23:40.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:40 smithi149 ceph-mon[35496]: scrub summary: idle 2024-09-13T17:23:40.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:40 smithi118 ceph-mon[34374]: scrub queued for path: / 2024-09-13T17:23:40.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:40 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:23:40.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:40 smithi118 ceph-mon[34374]: scrub summary: active paths [/] 2024-09-13T17:23:40.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:40 smithi118 ceph-mon[34374]: scrub summary: idle+waiting paths [/] 2024-09-13T17:23:40.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:40 smithi118 ceph-mon[34374]: scrub summary: idle 2024-09-13T17:23:40.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:40 smithi087 ceph-mon[30934]: scrub queued for path: / 2024-09-13T17:23:40.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:40 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:23:40.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:40 smithi087 ceph-mon[30934]: scrub summary: active paths [/] 2024-09-13T17:23:40.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:40 smithi087 ceph-mon[30934]: scrub summary: idle+waiting paths [/] 2024-09-13T17:23:40.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:40 smithi087 ceph-mon[30934]: scrub summary: idle 2024-09-13T17:23:41.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:41 smithi149 ceph-mon[35496]: pgmap v306: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:23:41.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:41 smithi118 ceph-mon[34374]: pgmap v306: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:23:41.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:41 smithi087 ceph-mon[30934]: pgmap v306: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:23:43.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:43 smithi149 ceph-mon[35496]: pgmap v307: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:23:43.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:43 smithi118 ceph-mon[34374]: pgmap v307: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:23:43.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:43 smithi087 ceph-mon[30934]: pgmap v307: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:23:45.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:45 smithi149 ceph-mon[35496]: pgmap v308: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:23:45.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:45 smithi118 ceph-mon[34374]: pgmap v308: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:23:45.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:45 smithi087 ceph-mon[30934]: pgmap v308: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:23:47.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:47 smithi149 ceph-mon[35496]: pgmap v309: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:23:47.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:47 smithi118 ceph-mon[34374]: pgmap v309: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:23:47.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:47 smithi087 ceph-mon[30934]: pgmap v309: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:23:49.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:49 smithi149 ceph-mon[35496]: pgmap v310: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:23:49.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:49 smithi118 ceph-mon[34374]: pgmap v310: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:23:49.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:49 smithi087 ceph-mon[30934]: pgmap v310: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:23:51.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:51 smithi149 ceph-mon[35496]: pgmap v311: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:23:51.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:51 smithi118 ceph-mon[34374]: pgmap v311: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:23:51.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:51 smithi087 ceph-mon[30934]: pgmap v311: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-13T17:23:53.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:53 smithi149 ceph-mon[35496]: pgmap v312: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:23:53.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:53 smithi118 ceph-mon[34374]: pgmap v312: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:23:53.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:53 smithi087 ceph-mon[30934]: pgmap v312: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-09-13T17:23:55.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:55 smithi149 ceph-mon[35496]: pgmap v313: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:23:55.362 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:55 smithi118 ceph-mon[34374]: pgmap v313: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:23:55.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:55 smithi087 ceph-mon[30934]: pgmap v313: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:23:57.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:57 smithi149 ceph-mon[35496]: pgmap v314: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:23:57.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:57 smithi118 ceph-mon[34374]: pgmap v314: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:23:57.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:57 smithi087 ceph-mon[30934]: pgmap v314: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:23:59.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:23:59 smithi149 ceph-mon[35496]: pgmap v315: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:23:59.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:23:59 smithi118 ceph-mon[34374]: pgmap v315: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:23:59.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:23:59 smithi087 ceph-mon[30934]: pgmap v315: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:23:59.829 DEBUG:teuthology.orchestra.run.smithi087:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-13T17:23:59.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.938+0000 7fc2520aa640 1 -- 172.21.15.87:0/1692195124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc24c1017a0 msgr2=0x7fc24c109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:59.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.938+0000 7fc2520aa640 1 --2- 172.21.15.87:0/1692195124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc24c1017a0 0x7fc24c109c80 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fc240009900 tx=0x7fc24002a480 comp rx=0 tx=0).stop 2024-09-13T17:23:59.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.938+0000 7fc2520aa640 1 -- 172.21.15.87:0/1692195124 shutdown_connections 2024-09-13T17:23:59.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.938+0000 7fc2520aa640 1 --2- 172.21.15.87:0/1692195124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc24c10a2a0 0x7fc24c10c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:59.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.938+0000 7fc2520aa640 1 --2- 172.21.15.87:0/1692195124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc24c1017a0 0x7fc24c109c80 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:59.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.938+0000 7fc2520aa640 1 --2- 172.21.15.87:0/1692195124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc24c100e80 0x7fc24c101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:59.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.938+0000 7fc2520aa640 1 -- 172.21.15.87:0/1692195124 >> 172.21.15.87:0/1692195124 conn(0x7fc24c0fa8f0 msgr2=0x7fc24c0fcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:23:59.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.938+0000 7fc2520aa640 1 -- 172.21.15.87:0/1692195124 shutdown_connections 2024-09-13T17:23:59.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.938+0000 7fc2520aa640 1 -- 172.21.15.87:0/1692195124 wait complete. 2024-09-13T17:23:59.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.939+0000 7fc2520aa640 1 Processor -- start 2024-09-13T17:23:59.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.939+0000 7fc2520aa640 1 -- start start 2024-09-13T17:23:59.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.939+0000 7fc2520aa640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc24c100e80 0x7fc24c1963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:59.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.939+0000 7fc2520aa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc24c1017a0 0x7fc24c1968f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:59.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.939+0000 7fc2520aa640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc24c10a2a0 0x7fc24c19ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:59.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.939+0000 7fc2520aa640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c19b290 con 0x7fc24c1017a0 2024-09-13T17:23:59.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.939+0000 7fc2520aa640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c19b400 con 0x7fc24c10a2a0 2024-09-13T17:23:59.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.939+0000 7fc2520aa640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c19b5c0 con 0x7fc24c100e80 2024-09-13T17:23:59.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.939+0000 7fc24affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc24c1017a0 0x7fc24c1968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:59.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.939+0000 7fc24affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc24c1017a0 0x7fc24c1968f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57484/0 (socket says 172.21.15.87:57484) 2024-09-13T17:23:59.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.939+0000 7fc24affd640 1 -- 172.21.15.87:0/1331586415 learned_addr learned my addr 172.21.15.87:0/1331586415 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:23:59.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.940+0000 7fc24bfff640 1 --2- 172.21.15.87:0/1331586415 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc24c10a2a0 0x7fc24c19ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:59.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.940+0000 7fc24b7fe640 1 --2- 172.21.15.87:0/1331586415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc24c100e80 0x7fc24c1963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:59.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.940+0000 7fc24affd640 1 -- 172.21.15.87:0/1331586415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc24c100e80 msgr2=0x7fc24c1963b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:59.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.940+0000 7fc24affd640 1 --2- 172.21.15.87:0/1331586415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc24c100e80 0x7fc24c1963b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:59.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.940+0000 7fc24affd640 1 -- 172.21.15.87:0/1331586415 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc24c10a2a0 msgr2=0x7fc24c19ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:23:59.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.940+0000 7fc24affd640 1 --2- 172.21.15.87:0/1331586415 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc24c10a2a0 0x7fc24c19ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:23:59.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.940+0000 7fc24affd640 1 -- 172.21.15.87:0/1331586415 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc240009560 con 0x7fc24c1017a0 2024-09-13T17:23:59.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.940+0000 7fc24b7fe640 1 --2- 172.21.15.87:0/1331586415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc24c100e80 0x7fc24c1963b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:23:59.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.940+0000 7fc24affd640 1 --2- 172.21.15.87:0/1331586415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc24c1017a0 0x7fc24c1968f0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fc240005ab0 tx=0x7fc2400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:59.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.940+0000 7fc248ff9640 1 -- 172.21.15.87:0/1331586415 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc240003a00 con 0x7fc24c1017a0 2024-09-13T17:23:59.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.940+0000 7fc248ff9640 1 -- 172.21.15.87:0/1331586415 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc2400044e0 con 0x7fc24c1017a0 2024-09-13T17:23:59.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.940+0000 7fc2520aa640 1 -- 172.21.15.87:0/1331586415 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc24c19b840 con 0x7fc24c1017a0 2024-09-13T17:23:59.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.940+0000 7fc248ff9640 1 -- 172.21.15.87:0/1331586415 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24003a3c0 con 0x7fc24c1017a0 2024-09-13T17:23:59.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.940+0000 7fc2520aa640 1 -- 172.21.15.87:0/1331586415 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc24c1a3120 con 0x7fc24c1017a0 2024-09-13T17:23:59.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.941+0000 7fc2520aa640 1 -- 172.21.15.87:0/1331586415 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc24c068e10 con 0x7fc24c1017a0 2024-09-13T17:23:59.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.942+0000 7fc248ff9640 1 -- 172.21.15.87:0/1331586415 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fc24003b460 con 0x7fc24c1017a0 2024-09-13T17:23:59.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.943+0000 7fc248ff9640 1 --2- 172.21.15.87:0/1331586415 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc2340a1280 0x7fc2340a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:23:59.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.943+0000 7fc24b7fe640 1 --2- 172.21.15.87:0/1331586415 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc2340a1280 0x7fc2340a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:23:59.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.943+0000 7fc248ff9640 1 -- 172.21.15.87:0/1331586415 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fc2400edec0 con 0x7fc24c1017a0 2024-09-13T17:23:59.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.944+0000 7fc24b7fe640 1 --2- 172.21.15.87:0/1331586415 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc2340a1280 0x7fc2340a3740 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc23c007eb0 tx=0x7fc23c0073c0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:23:59.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:23:59.947+0000 7fc248ff9640 1 -- 172.21.15.87:0/1331586415 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc2400b6f00 con 0x7fc24c1017a0 2024-09-13T17:24:00.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.129+0000 7fc2520aa640 1 -- 172.21.15.87:0/1331586415 --> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7fc24c10fdb0 con 0x7fc2340a1280 2024-09-13T17:24:00.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.136+0000 7fc248ff9640 1 -- 172.21.15.87:0/1331586415 <== mgr.15507 v2:172.21.15.87:6800/157129242 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+350 (secure 0 0 0) 0x7fc24c10fdb0 con 0x7fc2340a1280 2024-09-13T17:24:00.139 INFO:teuthology.orchestra.run.smithi087.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-13T00:00:00", "created": "2024-09-13T17:13:58", "first": "2024-09-13T17:14:00", "last": "2024-09-13T17:23:00", "last_pruned": "2024-09-13T17:23:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-09-13T17:24:00.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.139+0000 7fc2520aa640 1 -- 172.21.15.87:0/1331586415 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc2340a1280 msgr2=0x7fc2340a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:00.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.139+0000 7fc2520aa640 1 --2- 172.21.15.87:0/1331586415 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc2340a1280 0x7fc2340a3740 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc23c007eb0 tx=0x7fc23c0073c0 comp rx=0 tx=0).stop 2024-09-13T17:24:00.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.139+0000 7fc2520aa640 1 -- 172.21.15.87:0/1331586415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc24c1017a0 msgr2=0x7fc24c1968f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:00.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.139+0000 7fc2520aa640 1 --2- 172.21.15.87:0/1331586415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc24c1017a0 0x7fc24c1968f0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fc240005ab0 tx=0x7fc2400042f0 comp rx=0 tx=0).stop 2024-09-13T17:24:00.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.139+0000 7fc2520aa640 1 -- 172.21.15.87:0/1331586415 shutdown_connections 2024-09-13T17:24:00.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.139+0000 7fc2520aa640 1 --2- 172.21.15.87:0/1331586415 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc24c10a2a0 0x7fc24c19ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:00.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.139+0000 7fc2520aa640 1 --2- 172.21.15.87:0/1331586415 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc2340a1280 0x7fc2340a3740 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:00.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.139+0000 7fc2520aa640 1 --2- 172.21.15.87:0/1331586415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc24c1017a0 0x7fc24c1968f0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:00.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.139+0000 7fc2520aa640 1 --2- 172.21.15.87:0/1331586415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc24c100e80 0x7fc24c1963b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:00.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.139+0000 7fc2520aa640 1 -- 172.21.15.87:0/1331586415 >> 172.21.15.87:0/1331586415 conn(0x7fc24c0fa8f0 msgr2=0x7fc24c0fc370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:00.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.139+0000 7fc2520aa640 1 -- 172.21.15.87:0/1331586415 shutdown_connections 2024-09-13T17:24:00.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.139+0000 7fc2520aa640 1 -- 172.21.15.87:0/1331586415 wait complete. 2024-09-13T17:24:00.151 DEBUG:teuthology.orchestra.run.smithi087:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-13T17:24:00.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.249+0000 7f1fb8b65640 1 -- 172.21.15.87:0/1090566944 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1fb4103f40 msgr2=0x7f1fb410ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:00.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.249+0000 7f1fb8b65640 1 --2- 172.21.15.87:0/1090566944 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1fb4103f40 0x7f1fb410ba90 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f1fac009cd0 tx=0x7f1fac02a8e0 comp rx=0 tx=0).stop 2024-09-13T17:24:00.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.249+0000 7f1fb8b65640 1 -- 172.21.15.87:0/1090566944 shutdown_connections 2024-09-13T17:24:00.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.249+0000 7f1fb8b65640 1 --2- 172.21.15.87:0/1090566944 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1fb4103f40 0x7f1fb410ba90 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:00.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.249+0000 7f1fb8b65640 1 --2- 172.21.15.87:0/1090566944 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fb40ff7a0 0x7f1fb41037e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:00.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.249+0000 7f1fb8b65640 1 --2- 172.21.15.87:0/1090566944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fb40fedf0 0x7f1fb40ff1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:00.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.249+0000 7f1fb8b65640 1 -- 172.21.15.87:0/1090566944 >> 172.21.15.87:0/1090566944 conn(0x7f1fb40fa8a0 msgr2=0x7f1fb40fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:00.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.249+0000 7f1fb8b65640 1 -- 172.21.15.87:0/1090566944 shutdown_connections 2024-09-13T17:24:00.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.249+0000 7f1fb8b65640 1 -- 172.21.15.87:0/1090566944 wait complete. 2024-09-13T17:24:00.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.250+0000 7f1fb8b65640 1 Processor -- start 2024-09-13T17:24:00.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.250+0000 7f1fb8b65640 1 -- start start 2024-09-13T17:24:00.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.250+0000 7f1fb8b65640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fb40fedf0 0x7f1fb4196360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:00.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.250+0000 7f1fb8b65640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fb4103f40 0x7f1fb41968a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:00.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.250+0000 7f1fb8b65640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1fb419ac90 0x7f1fb419b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:00.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.250+0000 7f1fb8b65640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb419b680 con 0x7f1fb419ac90 2024-09-13T17:24:00.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.250+0000 7f1fb8b65640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb419b7f0 con 0x7f1fb4103f40 2024-09-13T17:24:00.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.250+0000 7f1fb8b65640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb419b960 con 0x7f1fb40fedf0 2024-09-13T17:24:00.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.250+0000 7f1fb2d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1fb419ac90 0x7f1fb419b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:00.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.250+0000 7f1fb2d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1fb419ac90 0x7f1fb419b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57508/0 (socket says 172.21.15.87:57508) 2024-09-13T17:24:00.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.250+0000 7f1fb2d9d640 1 -- 172.21.15.87:0/3307811024 learned_addr learned my addr 172.21.15.87:0/3307811024 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:00.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.250+0000 7f1fb1d9b640 1 --2- 172.21.15.87:0/3307811024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fb4103f40 0x7f1fb41968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:00.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.250+0000 7f1fb259c640 1 --2- 172.21.15.87:0/3307811024 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fb40fedf0 0x7f1fb4196360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:00.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.250+0000 7f1fb2d9d640 1 -- 172.21.15.87:0/3307811024 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fb40fedf0 msgr2=0x7f1fb4196360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:00.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.251+0000 7f1fb2d9d640 1 --2- 172.21.15.87:0/3307811024 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fb40fedf0 0x7f1fb4196360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:00.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.251+0000 7f1fb2d9d640 1 -- 172.21.15.87:0/3307811024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fb4103f40 msgr2=0x7f1fb41968a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:00.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.251+0000 7f1fb2d9d640 1 --2- 172.21.15.87:0/3307811024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fb4103f40 0x7f1fb41968a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:00.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.251+0000 7f1fb2d9d640 1 -- 172.21.15.87:0/3307811024 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fac009900 con 0x7f1fb419ac90 2024-09-13T17:24:00.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.251+0000 7f1fb259c640 1 --2- 172.21.15.87:0/3307811024 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fb40fedf0 0x7f1fb4196360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:00.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.251+0000 7f1fb2d9d640 1 --2- 172.21.15.87:0/3307811024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1fb419ac90 0x7f1fb419b140 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f1fac005cc0 tx=0x7f1fac030990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:00.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.251+0000 7f1fa37fe640 1 -- 172.21.15.87:0/3307811024 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac003b70 con 0x7f1fb419ac90 2024-09-13T17:24:00.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.251+0000 7f1fa37fe640 1 -- 172.21.15.87:0/3307811024 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1fac031cc0 con 0x7f1fb419ac90 2024-09-13T17:24:00.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.251+0000 7f1fa37fe640 1 -- 172.21.15.87:0/3307811024 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac0446a0 con 0x7f1fb419ac90 2024-09-13T17:24:00.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.251+0000 7f1fb8b65640 1 -- 172.21.15.87:0/3307811024 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb41a2f40 con 0x7f1fb419ac90 2024-09-13T17:24:00.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.251+0000 7f1fb8b65640 1 -- 172.21.15.87:0/3307811024 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb41a3300 con 0x7f1fb419ac90 2024-09-13T17:24:00.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.252+0000 7f1fb8b65640 1 -- 172.21.15.87:0/3307811024 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb41002c0 con 0x7f1fb419ac90 2024-09-13T17:24:00.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.253+0000 7f1fa37fe640 1 -- 172.21.15.87:0/3307811024 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f1fac00a040 con 0x7f1fb419ac90 2024-09-13T17:24:00.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.253+0000 7f1fa37fe640 1 --2- 172.21.15.87:0/3307811024 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f1f9c0a1200 0x7f1f9c0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:00.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.254+0000 7f1fb259c640 1 --2- 172.21.15.87:0/3307811024 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f1f9c0a1200 0x7f1f9c0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:00.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.254+0000 7f1fa37fe640 1 -- 172.21.15.87:0/3307811024 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f1fac0eebb0 con 0x7f1fb419ac90 2024-09-13T17:24:00.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.254+0000 7f1fb259c640 1 --2- 172.21.15.87:0/3307811024 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f1f9c0a1200 0x7f1f9c0a36c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4006fd0 tx=0x7f1fa4008040 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:00.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.258+0000 7f1fa37fe640 1 -- 172.21.15.87:0/3307811024 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1fac0b7bf0 con 0x7f1fb419ac90 2024-09-13T17:24:00.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.458+0000 7f1fb8b65640 1 -- 172.21.15.87:0/3307811024 --> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f1fb40ff840 con 0x7f1f9c0a1200 2024-09-13T17:24:00.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.465+0000 7f1fa37fe640 1 -- 172.21.15.87:0/3307811024 <== mgr.15507 v2:172.21.15.87:6800/157129242 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7f1fb40ff840 con 0x7f1f9c0a1200 2024-09-13T17:24:00.467 INFO:teuthology.orchestra.run.smithi087.stdout:/ 1m 6m3h 2024-09-13T17:24:00.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.467+0000 7f1fb8b65640 1 -- 172.21.15.87:0/3307811024 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f1f9c0a1200 msgr2=0x7f1f9c0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:00.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.467+0000 7f1fb8b65640 1 --2- 172.21.15.87:0/3307811024 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f1f9c0a1200 0x7f1f9c0a36c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4006fd0 tx=0x7f1fa4008040 comp rx=0 tx=0).stop 2024-09-13T17:24:00.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.467+0000 7f1fb8b65640 1 -- 172.21.15.87:0/3307811024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1fb419ac90 msgr2=0x7f1fb419b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:00.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.467+0000 7f1fb8b65640 1 --2- 172.21.15.87:0/3307811024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1fb419ac90 0x7f1fb419b140 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f1fac005cc0 tx=0x7f1fac030990 comp rx=0 tx=0).stop 2024-09-13T17:24:00.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.467+0000 7f1fb8b65640 1 -- 172.21.15.87:0/3307811024 shutdown_connections 2024-09-13T17:24:00.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.467+0000 7f1fb8b65640 1 --2- 172.21.15.87:0/3307811024 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f1f9c0a1200 0x7f1f9c0a36c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:00.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.467+0000 7f1fb8b65640 1 --2- 172.21.15.87:0/3307811024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1fb419ac90 0x7f1fb419b140 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:00.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.467+0000 7f1fb8b65640 1 --2- 172.21.15.87:0/3307811024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fb4103f40 0x7f1fb41968a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:00.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.467+0000 7f1fb8b65640 1 --2- 172.21.15.87:0/3307811024 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fb40fedf0 0x7f1fb4196360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:00.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.467+0000 7f1fb8b65640 1 -- 172.21.15.87:0/3307811024 >> 172.21.15.87:0/3307811024 conn(0x7f1fb40fa8a0 msgr2=0x7f1fb4102c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:00.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.467+0000 7f1fb8b65640 1 -- 172.21.15.87:0/3307811024 shutdown_connections 2024-09-13T17:24:00.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:00.467+0000 7f1fb8b65640 1 -- 172.21.15.87:0/3307811024 wait complete. 2024-09-13T17:24:00.480 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-13T17:24:00.491 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-13T17:24:01.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:01 smithi149 ceph-mon[35496]: pgmap v316: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:24:01.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:01 smithi149 ceph-mon[35496]: from='client.18153 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:24:01.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:01 smithi149 ceph-mon[35496]: from='client.18159 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:24:01.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:01 smithi118 ceph-mon[34374]: pgmap v316: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:24:01.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:01 smithi118 ceph-mon[34374]: from='client.18153 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:24:01.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:01 smithi118 ceph-mon[34374]: from='client.18159 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:24:01.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:01 smithi087 ceph-mon[30934]: pgmap v316: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:24:01.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:01 smithi087 ceph-mon[30934]: from='client.18153 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:24:01.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:01 smithi087 ceph-mon[30934]: from='client.18159 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:24:03.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:03 smithi149 ceph-mon[35496]: pgmap v317: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-13T17:24:03.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:03 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:24:03.362 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:03 smithi118 ceph-mon[34374]: pgmap v317: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-13T17:24:03.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:03 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:24:03.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:03 smithi087 ceph-mon[30934]: pgmap v317: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-13T17:24:03.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:03 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:24:05.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:05 smithi087 ceph-mon[30934]: pgmap v318: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-13T17:24:05.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:05 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:24:05.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:05 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:24:05.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:05 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:24:05.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:05 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:24:05.730 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:05 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:24:05.730 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:05 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:24:05.730 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:05 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.730 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:05 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.730 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:05 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.730 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:05 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.730 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:05 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.730 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:05 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.730 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:05 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.730 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:05 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.730 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:05 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.730 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:05 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.731 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:05 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.731 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:05 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.731 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:05 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.731 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:05 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.731 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:05 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.731 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:05 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.731 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:05 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.731 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:05 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.731 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:05 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:24:05.731 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:05 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:24:05.731 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:05 smithi087 ceph-mon[30934]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:24:05.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:05 smithi149 ceph-mon[35496]: pgmap v318: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-13T17:24:05.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:05 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:24:05.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:05 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:24:05.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:05 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:24:05.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:05 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:24:05.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:05 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:24:05.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:05 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:24:05.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:05 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:05 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:05 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:05 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:05 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:05 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:05 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:05 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:05 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:05 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:05 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:05 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:05 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:05 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:05 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.844 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:05 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:05 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:05 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:05 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:24:05.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:05 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:24:05.845 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:05 smithi149 ceph-mon[35496]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:24:05.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:05 smithi118 ceph-mon[34374]: pgmap v318: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-13T17:24:05.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:05 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:24:05.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:05 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:24:05.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:05 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:24:05.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:05 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:24:05.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:05 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:24:05.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:05 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:24:05.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:05 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:05 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:05 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:05 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:05 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:05 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:05 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:05 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.864 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:05 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:05 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:05 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:05 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:05 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:05 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:05 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:05 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:05 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:05 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:24:05.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:05 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:24:05.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:05 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:24:05.865 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:05 smithi118 ceph-mon[34374]: from='mgr.15507 ' entity='mgr.x' 2024-09-13T17:24:06.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:06 smithi087 ceph-mon[30934]: Adjusting osd_memory_target on smithi087 to 176.0M 2024-09-13T17:24:06.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:06 smithi087 ceph-mon[30934]: Unable to set osd_memory_target on smithi087 to 184555929: error parsing value: Value '184555929' is below minimum 939524096 2024-09-13T17:24:06.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:06 smithi087 ceph-mon[30934]: Adjusting osd_memory_target on smithi118 to 176.0M 2024-09-13T17:24:06.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:06 smithi087 ceph-mon[30934]: Unable to set osd_memory_target on smithi118 to 184556646: error parsing value: Value '184556646' is below minimum 939524096 2024-09-13T17:24:06.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:06 smithi149 ceph-mon[35496]: Adjusting osd_memory_target on smithi087 to 176.0M 2024-09-13T17:24:06.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:06 smithi149 ceph-mon[35496]: Unable to set osd_memory_target on smithi087 to 184555929: error parsing value: Value '184555929' is below minimum 939524096 2024-09-13T17:24:06.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:06 smithi149 ceph-mon[35496]: Adjusting osd_memory_target on smithi118 to 176.0M 2024-09-13T17:24:06.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:06 smithi149 ceph-mon[35496]: Unable to set osd_memory_target on smithi118 to 184556646: error parsing value: Value '184556646' is below minimum 939524096 2024-09-13T17:24:06.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:06 smithi118 ceph-mon[34374]: Adjusting osd_memory_target on smithi087 to 176.0M 2024-09-13T17:24:06.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:06 smithi118 ceph-mon[34374]: Unable to set osd_memory_target on smithi087 to 184555929: error parsing value: Value '184555929' is below minimum 939524096 2024-09-13T17:24:06.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:06 smithi118 ceph-mon[34374]: Adjusting osd_memory_target on smithi118 to 176.0M 2024-09-13T17:24:06.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:06 smithi118 ceph-mon[34374]: Unable to set osd_memory_target on smithi118 to 184556646: error parsing value: Value '184556646' is below minimum 939524096 2024-09-13T17:24:07.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:07 smithi087 ceph-mon[30934]: pgmap v319: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-13T17:24:07.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:07 smithi149 ceph-mon[35496]: pgmap v319: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-13T17:24:07.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:07 smithi118 ceph-mon[34374]: pgmap v319: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-13T17:24:09.688 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-09-13T17:24:09.716 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:09 smithi087 ceph-mon[30934]: pgmap v320: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-13T17:24:09.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.802+0000 7fbd3db8a640 1 -- 172.21.15.87:0/541379591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd381050a0 msgr2=0x7fbd3810cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:09.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.802+0000 7fbd3db8a640 1 --2- 172.21.15.87:0/541379591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd381050a0 0x7fbd3810cbf0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fbd30009cd0 tx=0x7fbd3002a8e0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.802+0000 7fbd3db8a640 1 -- 172.21.15.87:0/541379591 shutdown_connections 2024-09-13T17:24:09.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.802+0000 7fbd3db8a640 1 --2- 172.21.15.87:0/541379591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd381050a0 0x7fbd3810cbf0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.802+0000 7fbd3db8a640 1 --2- 172.21.15.87:0/541379591 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd38100900 0x7fbd38104940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.802+0000 7fbd3db8a640 1 --2- 172.21.15.87:0/541379591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd380fff50 0x7fbd38100330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.802+0000 7fbd3db8a640 1 -- 172.21.15.87:0/541379591 >> 172.21.15.87:0/541379591 conn(0x7fbd380fb9e0 msgr2=0x7fbd380fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:09.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.802+0000 7fbd3db8a640 1 -- 172.21.15.87:0/541379591 shutdown_connections 2024-09-13T17:24:09.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.802+0000 7fbd3db8a640 1 -- 172.21.15.87:0/541379591 wait complete. 2024-09-13T17:24:09.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.803+0000 7fbd3db8a640 1 Processor -- start 2024-09-13T17:24:09.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.803+0000 7fbd3db8a640 1 -- start start 2024-09-13T17:24:09.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.803+0000 7fbd3db8a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd380fff50 0x7fbd381961a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:09.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.803+0000 7fbd3db8a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd381050a0 0x7fbd381966e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:09.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.803+0000 7fbd3db8a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd3819aad0 0x7fbd3819af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:09.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.803+0000 7fbd3db8a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3819b4c0 con 0x7fbd381050a0 2024-09-13T17:24:09.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.803+0000 7fbd3db8a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3819b630 con 0x7fbd3819aad0 2024-09-13T17:24:09.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.803+0000 7fbd3db8a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3819b7a0 con 0x7fbd380fff50 2024-09-13T17:24:09.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.804+0000 7fbd2effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd381050a0 0x7fbd381966e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:09.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.804+0000 7fbd2effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd381050a0 0x7fbd381966e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40596/0 (socket says 172.21.15.87:40596) 2024-09-13T17:24:09.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.804+0000 7fbd2effd640 1 -- 172.21.15.87:0/3669825788 learned_addr learned my addr 172.21.15.87:0/3669825788 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:09.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.804+0000 7fbd2effd640 1 -- 172.21.15.87:0/3669825788 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd380fff50 msgr2=0x7fbd381961a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:09.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.804+0000 7fbd2effd640 1 --2- 172.21.15.87:0/3669825788 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd380fff50 0x7fbd381961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.804+0000 7fbd2effd640 1 -- 172.21.15.87:0/3669825788 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd3819aad0 msgr2=0x7fbd3819af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:09.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.804+0000 7fbd2effd640 1 --2- 172.21.15.87:0/3669825788 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd3819aad0 0x7fbd3819af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.804+0000 7fbd2effd640 1 -- 172.21.15.87:0/3669825788 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd30009900 con 0x7fbd381050a0 2024-09-13T17:24:09.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.804+0000 7fbd2effd640 1 --2- 172.21.15.87:0/3669825788 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd381050a0 0x7fbd381966e0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000c970 tx=0x7fbd2000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:09.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.804+0000 7fbd357fa640 1 -- 172.21.15.87:0/3669825788 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd20007bb0 con 0x7fbd381050a0 2024-09-13T17:24:09.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.804+0000 7fbd357fa640 1 -- 172.21.15.87:0/3669825788 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbd20007d10 con 0x7fbd381050a0 2024-09-13T17:24:09.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.804+0000 7fbd3db8a640 1 -- 172.21.15.87:0/3669825788 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd381a2d80 con 0x7fbd381050a0 2024-09-13T17:24:09.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.804+0000 7fbd357fa640 1 -- 172.21.15.87:0/3669825788 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd20018660 con 0x7fbd381050a0 2024-09-13T17:24:09.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.804+0000 7fbd3db8a640 1 -- 172.21.15.87:0/3669825788 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd381a3180 con 0x7fbd381050a0 2024-09-13T17:24:09.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.806+0000 7fbd357fa640 1 -- 172.21.15.87:0/3669825788 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fbd2000f450 con 0x7fbd381050a0 2024-09-13T17:24:09.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.807+0000 7fbd408b0740 1 Processor -- start 2024-09-13T17:24:09.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.807+0000 7fbd408b0740 1 -- start start 2024-09-13T17:24:09.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.807+0000 7fbd408b0740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b179450e10 0x55b1794511f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:09.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.807+0000 7fbd408b0740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b179451730 0x55b17945ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:09.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.807+0000 7fbd408b0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b17945bfd0 0x55b17945e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:09.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.807+0000 7fbd408b0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1793bbf20 con 0x55b17945bfd0 2024-09-13T17:24:09.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.807+0000 7fbd408b0740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1793b96b0 con 0x55b179451730 2024-09-13T17:24:09.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.807+0000 7fbd408b0740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1793b4fa0 con 0x55b179450e10 2024-09-13T17:24:09.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.807+0000 7fbd2effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b17945bfd0 0x55b17945e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:09.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.807+0000 7fbd357fa640 1 --2- 172.21.15.87:0/3669825788 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fbd240a1200 0x7fbd240a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:09.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.807+0000 7fbd2effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b17945bfd0 0x55b17945e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40598/0 (socket says 172.21.15.87:40598) 2024-09-13T17:24:09.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.807+0000 7fbd2effd640 1 -- 172.21.15.87:0/3319912314 learned_addr learned my addr 172.21.15.87:0/3319912314 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:09.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.807+0000 7fbd377fe640 1 --2- 172.21.15.87:0/3319912314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b179451730 0x55b17945ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:09.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.807+0000 7fbd37fff640 1 --2- 172.21.15.87:0/3669825788 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fbd240a1200 0x7fbd240a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:09.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.807+0000 7fbd37fff640 1 --2- 172.21.15.87:0/3319912314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b179450e10 0x55b1794511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:09.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.807+0000 7fbd357fa640 1 -- 172.21.15.87:0/3669825788 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fbd200cd220 con 0x7fbd381050a0 2024-09-13T17:24:09.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.807+0000 7fbd2effd640 1 -- 172.21.15.87:0/3319912314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b179450e10 msgr2=0x55b1794511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:09.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.807+0000 7fbd2effd640 1 --2- 172.21.15.87:0/3319912314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b179450e10 0x55b1794511f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.807+0000 7fbd2effd640 1 -- 172.21.15.87:0/3319912314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b179451730 msgr2=0x55b17945ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:09.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.807+0000 7fbd2effd640 1 --2- 172.21.15.87:0/3319912314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b179451730 0x55b17945ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.808+0000 7fbd2effd640 1 -- 172.21.15.87:0/3319912314 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b17936f840 con 0x55b17945bfd0 2024-09-13T17:24:09.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.808+0000 7fbd2effd640 1 --2- 172.21.15.87:0/3319912314 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b17945bfd0 0x55b17945e3c0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fbd200ca500 tx=0x7fbd2000af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc565b6f41eca4f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:09.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.808+0000 7fbd37fff640 1 --2- 172.21.15.87:0/3669825788 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fbd240a1200 0x7fbd240a36c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbd3002ae00 tx=0x7fbd300095c0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:09.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.808+0000 7fbd2dffb640 1 -- 172.21.15.87:0/3319912314 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd20099f20 con 0x55b17945bfd0 2024-09-13T17:24:09.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.808+0000 7fbd2dffb640 1 -- 172.21.15.87:0/3319912314 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbd2009a620 con 0x55b17945bfd0 2024-09-13T17:24:09.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.808+0000 7fbd2dffb640 1 -- 172.21.15.87:0/3319912314 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd200ca7e0 con 0x55b17945bfd0 2024-09-13T17:24:09.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.808+0000 7fbd408b0740 1 -- 172.21.15.87:0/3319912314 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b17945bfd0 msgr2=0x55b17945e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:09.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.809+0000 7fbd408b0740 1 --2- 172.21.15.87:0/3319912314 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b17945bfd0 0x55b17945e3c0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fbd200ca500 tx=0x7fbd2000af90 comp rx=0 tx=0).stop 2024-09-13T17:24:09.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.809+0000 7fbd408b0740 1 -- 172.21.15.87:0/3319912314 shutdown_connections 2024-09-13T17:24:09.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.809+0000 7fbd408b0740 1 --2- 172.21.15.87:0/3319912314 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b17945bfd0 0x55b17945e3c0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.809+0000 7fbd408b0740 1 --2- 172.21.15.87:0/3319912314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b179451730 0x55b17945ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.809+0000 7fbd408b0740 1 --2- 172.21.15.87:0/3319912314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b179450e10 0x55b1794511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.809+0000 7fbd408b0740 1 -- 172.21.15.87:0/3319912314 >> 172.21.15.87:0/3319912314 conn(0x55b17944d380 msgr2=0x55b17944d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:09.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.809+0000 7fbd408b0740 1 -- 172.21.15.87:0/3319912314 shutdown_connections 2024-09-13T17:24:09.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.809+0000 7fbd408b0740 1 -- 172.21.15.87:0/3319912314 wait complete. 2024-09-13T17:24:09.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.809+0000 7fbd408b0740 1 -- start start 2024-09-13T17:24:09.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.809+0000 7fbd408b0740 1 Processor -- start 2024-09-13T17:24:09.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.809+0000 7fbd408b0740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b179450e10 0x55b17945ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:09.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.809+0000 7fbd408b0740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b179451730 0x55b179458d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:09.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.809+0000 7fbd408b0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b17945bfd0 0x55b1794594a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:09.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.809+0000 7fbd408b0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1793562a0 con 0x55b17945bfd0 2024-09-13T17:24:09.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.809+0000 7fbd408b0740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b17908d430 con 0x55b179451730 2024-09-13T17:24:09.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.809+0000 7fbd408b0740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b179338680 con 0x55b179450e10 2024-09-13T17:24:09.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.809+0000 7fbd408b0740 10 client.0 _ll_register_callbacks cb 0x55b1793ae610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:24:09.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.810+0000 7fbd37fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b17945bfd0 0x55b1794594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:09.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.810+0000 7fbd37fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b17945bfd0 0x55b1794594a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40612/0 (socket says 172.21.15.87:40612) 2024-09-13T17:24:09.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.810+0000 7fbd37fff640 1 -- 172.21.15.87:0/2984983096 learned_addr learned my addr 172.21.15.87:0/2984983096 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:09.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.810+0000 7fbd377fe640 1 --2- 172.21.15.87:0/2984983096 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b179450e10 0x55b17945ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:09.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.810+0000 7fbd2effd640 1 --2- 172.21.15.87:0/2984983096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b179451730 0x55b179458d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:09.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.810+0000 7fbd37fff640 1 -- 172.21.15.87:0/2984983096 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b179450e10 msgr2=0x55b17945ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:09.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.810+0000 7fbd37fff640 1 --2- 172.21.15.87:0/2984983096 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b179450e10 0x55b17945ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.810+0000 7fbd37fff640 1 -- 172.21.15.87:0/2984983096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b179451730 msgr2=0x55b179458d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:09.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.810+0000 7fbd37fff640 1 --2- 172.21.15.87:0/2984983096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b179451730 0x55b179458d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.810+0000 7fbd37fff640 1 -- 172.21.15.87:0/2984983096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd381a3180 con 0x55b17945bfd0 2024-09-13T17:24:09.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.810+0000 7fbd2effd640 1 --2- 172.21.15.87:0/2984983096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b179451730 0x55b179458d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:09.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.810+0000 7fbd37fff640 1 --2- 172.21.15.87:0/2984983096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b17945bfd0 0x55b1794594a0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fbd30031af0 tx=0x7fbd30009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9fee07f3091f5ed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:09.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.810+0000 7fbd16ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:24:09.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.810+0000 7fbd16ffd640 1 -- 172.21.15.87:0/2984983096 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3003f9c0 con 0x55b17945bfd0 2024-09-13T17:24:09.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.810+0000 7fbd16ffd640 1 -- 172.21.15.87:0/2984983096 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fbd3003fb20 con 0x55b17945bfd0 2024-09-13T17:24:09.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.810+0000 7fbd408b0740 1 -- 172.21.15.87:0/2984983096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b1790a84e0 con 0x55b17945bfd0 2024-09-13T17:24:09.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.810+0000 7fbd16ffd640 1 -- 172.21.15.87:0/2984983096 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd3003fce0 con 0x55b17945bfd0 2024-09-13T17:24:09.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.810+0000 7fbd408b0740 10 client.18171 fetch_fsmap learned FSMap version 36 2024-09-13T17:24:09.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.810+0000 7fbd408b0740 1 -- 172.21.15.87:0/2984983096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55b1793b3620 con 0x55b17945bfd0 2024-09-13T17:24:09.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.811+0000 7fbd16ffd640 1 -- 172.21.15.87:0/2984983096 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55b1790a84e0 con 0x55b17945bfd0 2024-09-13T17:24:09.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.811+0000 7fbd16ffd640 1 -- 172.21.15.87:0/2984983096 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fbd3003c410 con 0x55b17945bfd0 2024-09-13T17:24:09.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.811+0000 7fbd408b0740 10 client.18171 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:24:09.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.811+0000 7fbd408b0740 10 client.18171 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:24:09.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.811+0000 7fbd408b0740 20 client.18171 populate_metadata read hostname 'smithi087' 2024-09-13T17:24:09.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.811+0000 7fbd408b0740 1 --2- 172.21.15.87:0/2984983096 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b17946bed0 0x55b17946e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:09.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.811+0000 7fbd408b0740 4 client.18171 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:24:09.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.811+0000 7fbd408b0740 1 -- 172.21.15.87:0/2984983096 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b1790b97e0 con 0x55b17946bed0 2024-09-13T17:24:09.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.811+0000 7fbd377fe640 1 --2- 172.21.15.87:0/2984983096 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b17946bed0 0x55b17946e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:09.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.812+0000 7fbd16ffd640 10 client.18171 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:24:09.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.812+0000 7fbd377fe640 1 --2- 172.21.15.87:0/2984983096 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b17946bed0 0x55b17946e2f0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55a0a388741f7d63 server_cookie=37d092415d2287fc in_seq=0 out_seq=0 2024-09-13T17:24:09.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.812+0000 7fbd16ffd640 1 -- 172.21.15.87:0/2984983096 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55b1790b97e0 con 0x55b17946bed0 2024-09-13T17:24:09.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.812+0000 7fbd16ffd640 10 client.18171 handle_command_reply: tid=0 2024-09-13T17:24:09.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.812+0000 7fbd408b0740 1 client.18171 shutdown 2024-09-13T17:24:09.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.812+0000 7fbd408b0740 1 -- 172.21.15.87:0/2984983096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b17945bfd0 msgr2=0x55b1794594a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:09.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.812+0000 7fbd408b0740 1 --2- 172.21.15.87:0/2984983096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b17945bfd0 0x55b1794594a0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fbd30031af0 tx=0x7fbd30009840 comp rx=0 tx=0).stop 2024-09-13T17:24:09.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.812+0000 7fbd408b0740 1 -- 172.21.15.87:0/2984983096 shutdown_connections 2024-09-13T17:24:09.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.812+0000 7fbd408b0740 1 --2- 172.21.15.87:0/2984983096 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b17946bed0 0x55b17946e2f0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.812+0000 7fbd408b0740 1 --2- 172.21.15.87:0/2984983096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b17945bfd0 0x55b1794594a0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.812+0000 7fbd408b0740 1 --2- 172.21.15.87:0/2984983096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b179451730 0x55b179458d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.812+0000 7fbd16ffd640 0 client.18171 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:24:09.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.812+0000 7fbd408b0740 1 --2- 172.21.15.87:0/2984983096 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b179450e10 0x55b17945ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.812+0000 7fbd408b0740 1 -- 172.21.15.87:0/2984983096 >> 172.21.15.87:0/2984983096 conn(0x55b17944d380 msgr2=0x55b17944c510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:09.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.812+0000 7fbd408b0740 1 -- 172.21.15.87:0/2984983096 shutdown_connections 2024-09-13T17:24:09.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.812+0000 7fbd408b0740 1 -- 172.21.15.87:0/2984983096 wait complete. 2024-09-13T17:24:09.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.813+0000 7fbd408b0740 20 client.18171 trim_cache size 0 max 16384 2024-09-13T17:24:09.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.826+0000 7fbd408b0740 1 Processor -- start 2024-09-13T17:24:09.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.826+0000 7fbd408b0740 1 -- start start 2024-09-13T17:24:09.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.827+0000 7fbd408b0740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b17944d380 0x55b179462d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:09.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.827+0000 7fbd408b0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b179450e10 0x55b179463280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:09.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.827+0000 7fbd408b0740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b179451730 0x55b1794585b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:09.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.827+0000 7fbd408b0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b179473550 con 0x55b179450e10 2024-09-13T17:24:09.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.827+0000 7fbd408b0740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b179450c40 con 0x55b179451730 2024-09-13T17:24:09.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.827+0000 7fbd408b0740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b17945b610 con 0x55b17944d380 2024-09-13T17:24:09.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.827+0000 7fbd2effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b179450e10 0x55b179463280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:09.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.827+0000 7fbd2effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b179450e10 0x55b179463280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40628/0 (socket says 172.21.15.87:40628) 2024-09-13T17:24:09.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.827+0000 7fbd2effd640 1 -- 172.21.15.87:0/3052290003 learned_addr learned my addr 172.21.15.87:0/3052290003 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:09.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.827+0000 7fbd377fe640 1 --2- 172.21.15.87:0/3052290003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b17944d380 0x55b179462d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:09.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.827+0000 7fbd37fff640 1 --2- 172.21.15.87:0/3052290003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b179451730 0x55b1794585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:09.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.827+0000 7fbd2effd640 1 -- 172.21.15.87:0/3052290003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b17944d380 msgr2=0x55b179462d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:09.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.827+0000 7fbd2effd640 1 --2- 172.21.15.87:0/3052290003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b17944d380 0x55b179462d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.827+0000 7fbd2effd640 1 -- 172.21.15.87:0/3052290003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b179451730 msgr2=0x55b1794585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:09.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.827+0000 7fbd2effd640 1 --2- 172.21.15.87:0/3052290003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b179451730 0x55b1794585b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.827+0000 7fbd2effd640 1 -- 172.21.15.87:0/3052290003 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b179355790 con 0x55b179450e10 2024-09-13T17:24:09.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.827+0000 7fbd37fff640 1 --2- 172.21.15.87:0/3052290003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b179451730 0x55b1794585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:09.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.827+0000 7fbd2effd640 1 --2- 172.21.15.87:0/3052290003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b179450e10 0x55b179463280 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fbd20096420 tx=0x7fbd200ca530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f0f26e59b4a0688 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:09.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.827+0000 7fbd2e7fc640 1 -- 172.21.15.87:0/3052290003 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd200b8070 con 0x55b179450e10 2024-09-13T17:24:09.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.827+0000 7fbd2e7fc640 1 -- 172.21.15.87:0/3052290003 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbd20099f20 con 0x55b179450e10 2024-09-13T17:24:09.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.827+0000 7fbd2e7fc640 1 -- 172.21.15.87:0/3052290003 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd200b81d0 con 0x55b179450e10 2024-09-13T17:24:09.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.828+0000 7fbd408b0740 1 -- 172.21.15.87:0/3052290003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b179450e10 msgr2=0x55b179463280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:09.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.828+0000 7fbd408b0740 1 --2- 172.21.15.87:0/3052290003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b179450e10 0x55b179463280 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fbd20096420 tx=0x7fbd200ca530 comp rx=0 tx=0).stop 2024-09-13T17:24:09.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.828+0000 7fbd408b0740 1 -- 172.21.15.87:0/3052290003 shutdown_connections 2024-09-13T17:24:09.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.828+0000 7fbd408b0740 1 --2- 172.21.15.87:0/3052290003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b179451730 0x55b1794585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.828+0000 7fbd408b0740 1 --2- 172.21.15.87:0/3052290003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b179450e10 0x55b179463280 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.828+0000 7fbd408b0740 1 --2- 172.21.15.87:0/3052290003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b17944d380 0x55b179462d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.828+0000 7fbd408b0740 1 -- 172.21.15.87:0/3052290003 >> 172.21.15.87:0/3052290003 conn(0x55b17945bb80 msgr2=0x55b179454090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:09.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.828+0000 7fbd408b0740 1 -- 172.21.15.87:0/3052290003 shutdown_connections 2024-09-13T17:24:09.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.828+0000 7fbd408b0740 1 -- 172.21.15.87:0/3052290003 wait complete. 2024-09-13T17:24:09.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.828+0000 7fbd408b0740 1 -- start start 2024-09-13T17:24:09.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.828+0000 7fbd408b0740 1 Processor -- start 2024-09-13T17:24:09.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.829+0000 7fbd408b0740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b17944d380 0x55b179463090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:09.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.829+0000 7fbd408b0740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b179450e10 0x55b179461550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:09.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.829+0000 7fbd408b0740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b179451730 0x55b179461a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:09.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.829+0000 7fbd408b0740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b179462190 con 0x55b179450e10 2024-09-13T17:24:09.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.829+0000 7fbd408b0740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b179462300 con 0x55b17944d380 2024-09-13T17:24:09.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.829+0000 7fbd408b0740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1794c23e0 con 0x55b179451730 2024-09-13T17:24:09.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.829+0000 7fbd408b0740 10 client.0 _ll_register_callbacks cb 0x7fbd30009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:24:09.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.829+0000 7fbd2effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b179450e10 0x55b179461550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:09.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.829+0000 7fbd2effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b179450e10 0x55b179461550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40638/0 (socket says 172.21.15.87:40638) 2024-09-13T17:24:09.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.829+0000 7fbd2effd640 1 -- 172.21.15.87:0/3905525631 learned_addr learned my addr 172.21.15.87:0/3905525631 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:09.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.829+0000 7fbd37fff640 1 --2- 172.21.15.87:0/3905525631 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b179451730 0x55b179461a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:09.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.829+0000 7fbd377fe640 1 --2- 172.21.15.87:0/3905525631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b17944d380 0x55b179463090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:09.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.829+0000 7fbd2effd640 1 -- 172.21.15.87:0/3905525631 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b179451730 msgr2=0x55b179461a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:09.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.829+0000 7fbd2effd640 1 --2- 172.21.15.87:0/3905525631 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b179451730 0x55b179461a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.829+0000 7fbd2effd640 1 -- 172.21.15.87:0/3905525631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b17944d380 msgr2=0x55b179463090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:09.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.829+0000 7fbd2effd640 1 --2- 172.21.15.87:0/3905525631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b17944d380 0x55b179463090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.829+0000 7fbd2effd640 1 -- 172.21.15.87:0/3905525631 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b17936f840 con 0x55b179450e10 2024-09-13T17:24:09.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.829+0000 7fbd377fe640 1 --2- 172.21.15.87:0/3905525631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b17944d380 0x55b179463090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:09.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.829+0000 7fbd2effd640 1 --2- 172.21.15.87:0/3905525631 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b179450e10 0x55b179461550 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fbd20004770 tx=0x7fbd200cd570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b4143240657121 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:09.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.829+0000 7fbd16ffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:24:09.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.829+0000 7fbd16ffd640 1 -- 172.21.15.87:0/3905525631 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd20063070 con 0x55b179450e10 2024-09-13T17:24:09.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.829+0000 7fbd16ffd640 1 -- 172.21.15.87:0/3905525631 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fbd2009dd50 con 0x55b179450e10 2024-09-13T17:24:09.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.829+0000 7fbd408b0740 1 -- 172.21.15.87:0/3905525631 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbd2009a620 con 0x55b179450e10 2024-09-13T17:24:09.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.829+0000 7fbd16ffd640 1 -- 172.21.15.87:0/3905525631 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd200b8040 con 0x55b179450e10 2024-09-13T17:24:09.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.830+0000 7fbd408b0740 10 client.18177 fetch_fsmap learned FSMap version 36 2024-09-13T17:24:09.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.830+0000 7fbd408b0740 1 -- 172.21.15.87:0/3905525631 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55b17937aea0 con 0x55b179450e10 2024-09-13T17:24:09.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.830+0000 7fbd16ffd640 1 -- 172.21.15.87:0/3905525631 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbd2009a620 con 0x55b179450e10 2024-09-13T17:24:09.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.830+0000 7fbd16ffd640 1 -- 172.21.15.87:0/3905525631 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fbd20016020 con 0x55b179450e10 2024-09-13T17:24:09.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.830+0000 7fbd408b0740 10 client.18177 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:24:09.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.830+0000 7fbd408b0740 10 client.18177 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:24:09.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.830+0000 7fbd408b0740 20 client.18177 populate_metadata read hostname 'smithi087' 2024-09-13T17:24:09.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.830+0000 7fbd408b0740 1 --2- 172.21.15.87:0/3905525631 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b17945bfd0 0x55b1794c5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:09.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.830+0000 7fbd408b0740 4 client.18177 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T17:24:09.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.830+0000 7fbd408b0740 1 -- 172.21.15.87:0/3905525631 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b17910ce30 con 0x55b17945bfd0 2024-09-13T17:24:09.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.830+0000 7fbd377fe640 1 --2- 172.21.15.87:0/3905525631 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b17945bfd0 0x55b1794c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:09.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.830+0000 7fbd16ffd640 10 client.18177 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:24:09.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.830+0000 7fbd377fe640 1 --2- 172.21.15.87:0/3905525631 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b17945bfd0 0x55b1794c5560 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbc088530b6d52e4 server_cookie=36eecad412d1d8ed in_seq=0 out_seq=0 2024-09-13T17:24:09.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.831+0000 7fbd16ffd640 1 -- 172.21.15.87:0/3905525631 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55b17910ce30 con 0x55b17945bfd0 2024-09-13T17:24:09.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.831+0000 7fbd16ffd640 10 client.18177 handle_command_reply: tid=0 2024-09-13T17:24:09.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.831+0000 7fbd408b0740 1 client.18177 shutdown 2024-09-13T17:24:09.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.831+0000 7fbd408b0740 1 -- 172.21.15.87:0/3905525631 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b179450e10 msgr2=0x55b179461550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:09.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.831+0000 7fbd408b0740 1 --2- 172.21.15.87:0/3905525631 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b179450e10 0x55b179461550 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fbd20004770 tx=0x7fbd200cd570 comp rx=0 tx=0).stop 2024-09-13T17:24:09.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.831+0000 7fbd408b0740 1 -- 172.21.15.87:0/3905525631 shutdown_connections 2024-09-13T17:24:09.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.831+0000 7fbd408b0740 1 --2- 172.21.15.87:0/3905525631 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55b17945bfd0 0x55b1794c5560 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.831+0000 7fbd408b0740 1 --2- 172.21.15.87:0/3905525631 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b179451730 0x55b179461a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.831+0000 7fbd408b0740 1 --2- 172.21.15.87:0/3905525631 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b179450e10 0x55b179461550 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.831+0000 7fbd16ffd640 0 client.18177 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:24:09.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.831+0000 7fbd408b0740 1 --2- 172.21.15.87:0/3905525631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b17944d380 0x55b179463090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.831+0000 7fbd408b0740 1 -- 172.21.15.87:0/3905525631 >> 172.21.15.87:0/3905525631 conn(0x55b17945bb80 msgr2=0x55b179452870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:09.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.831+0000 7fbd408b0740 1 -- 172.21.15.87:0/3905525631 shutdown_connections 2024-09-13T17:24:09.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.831+0000 7fbd408b0740 1 -- 172.21.15.87:0/3905525631 wait complete. 2024-09-13T17:24:09.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.831+0000 7fbd408b0740 20 client.18177 trim_cache size 0 max 16384 2024-09-13T17:24:09.839 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:24:09.839 INFO:teuthology.orchestra.run.smithi087.stdout: "status": "no active scrubs running", 2024-09-13T17:24:09.840 INFO:teuthology.orchestra.run.smithi087.stdout: "scrubs": {} 2024-09-13T17:24:09.840 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:24:09.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.831+0000 7fbd3db8a640 1 -- 172.21.15.87:0/3669825788 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fbd240a1200 msgr2=0x7fbd240a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:09.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.831+0000 7fbd3db8a640 1 --2- 172.21.15.87:0/3669825788 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fbd240a1200 0x7fbd240a36c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbd3002ae00 tx=0x7fbd300095c0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.831+0000 7fbd3db8a640 1 -- 172.21.15.87:0/3669825788 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd381050a0 msgr2=0x7fbd381966e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:09.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.831+0000 7fbd3db8a640 1 --2- 172.21.15.87:0/3669825788 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd381050a0 0x7fbd381966e0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000c970 tx=0x7fbd2000ce30 comp rx=0 tx=0).stop 2024-09-13T17:24:09.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.832+0000 7fbd3db8a640 1 -- 172.21.15.87:0/3669825788 shutdown_connections 2024-09-13T17:24:09.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.832+0000 7fbd3db8a640 1 --2- 172.21.15.87:0/3669825788 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd3819aad0 0x7fbd3819af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.832+0000 7fbd3db8a640 1 --2- 172.21.15.87:0/3669825788 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fbd240a1200 0x7fbd240a36c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.832+0000 7fbd3db8a640 1 --2- 172.21.15.87:0/3669825788 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd381050a0 0x7fbd381966e0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.832+0000 7fbd3db8a640 1 --2- 172.21.15.87:0/3669825788 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd380fff50 0x7fbd381961a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.832+0000 7fbd3db8a640 1 -- 172.21.15.87:0/3669825788 >> 172.21.15.87:0/3669825788 conn(0x7fbd380fb9e0 msgr2=0x7fbd380fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:09.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.832+0000 7fbd3db8a640 1 -- 172.21.15.87:0/3669825788 shutdown_connections 2024-09-13T17:24:09.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.832+0000 7fbd3db8a640 1 -- 172.21.15.87:0/3669825788 wait complete. 2024-09-13T17:24:09.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:09 smithi149 ceph-mon[35496]: pgmap v320: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-13T17:24:09.843 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T17:24:09.844 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:24:09.862 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:09 smithi118 ceph-mon[34374]: pgmap v320: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-13T17:24:09.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.981+0000 7f3a8bb5e640 1 -- 172.21.15.87:0/3356885877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a840ff830 msgr2=0x7f3a84103870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:09.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.981+0000 7f3a8bb5e640 1 --2- 172.21.15.87:0/3356885877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a840ff830 0x7f3a84103870 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f3a80009930 tx=0x7f3a8002a420 comp rx=0 tx=0).stop 2024-09-13T17:24:09.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.981+0000 7f3a8bb5e640 1 -- 172.21.15.87:0/3356885877 shutdown_connections 2024-09-13T17:24:09.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.981+0000 7f3a8bb5e640 1 --2- 172.21.15.87:0/3356885877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a84103fd0 0x7f3a8410bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.981+0000 7f3a8bb5e640 1 --2- 172.21.15.87:0/3356885877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a840ff830 0x7f3a84103870 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.981+0000 7f3a8bb5e640 1 --2- 172.21.15.87:0/3356885877 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a840fee80 0x7f3a840ff260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.981+0000 7f3a8bb5e640 1 -- 172.21.15.87:0/3356885877 >> 172.21.15.87:0/3356885877 conn(0x7f3a84075c60 msgr2=0x7f3a840fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:09.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.981+0000 7f3a8bb5e640 1 -- 172.21.15.87:0/3356885877 shutdown_connections 2024-09-13T17:24:09.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.981+0000 7f3a8bb5e640 1 -- 172.21.15.87:0/3356885877 wait complete. 2024-09-13T17:24:09.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.981+0000 7f3a8bb5e640 1 Processor -- start 2024-09-13T17:24:09.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.981+0000 7f3a8bb5e640 1 -- start start 2024-09-13T17:24:09.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.982+0000 7f3a8bb5e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a840fee80 0x7f3a841962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:09.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.982+0000 7f3a8bb5e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a84103fd0 0x7f3a841967e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:09.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.982+0000 7f3a8bb5e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a8419abd0 0x7f3a8419b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:09.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.982+0000 7f3a8bb5e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8419b5c0 con 0x7f3a84103fd0 2024-09-13T17:24:09.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.982+0000 7f3a8bb5e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8419b730 con 0x7f3a8419abd0 2024-09-13T17:24:09.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.982+0000 7f3a8bb5e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8419b8a0 con 0x7f3a840fee80 2024-09-13T17:24:09.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.982+0000 7f3a890f9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a84103fd0 0x7f3a841967e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:09.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.982+0000 7f3a890f9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a84103fd0 0x7f3a841967e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40658/0 (socket says 172.21.15.87:40658) 2024-09-13T17:24:09.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.982+0000 7f3a890f9640 1 -- 172.21.15.87:0/849814499 learned_addr learned my addr 172.21.15.87:0/849814499 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:09.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.982+0000 7f3a898fa640 1 --2- 172.21.15.87:0/849814499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a840fee80 0x7f3a841962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:09.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.982+0000 7f3a8a0fb640 1 --2- 172.21.15.87:0/849814499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a8419abd0 0x7f3a8419b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:09.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.982+0000 7f3a890f9640 1 -- 172.21.15.87:0/849814499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a840fee80 msgr2=0x7f3a841962a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:09.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.982+0000 7f3a890f9640 1 --2- 172.21.15.87:0/849814499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a840fee80 0x7f3a841962a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.982+0000 7f3a890f9640 1 -- 172.21.15.87:0/849814499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a8419abd0 msgr2=0x7f3a8419b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:09.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.982+0000 7f3a890f9640 1 --2- 172.21.15.87:0/849814499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a8419abd0 0x7f3a8419b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:09.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.982+0000 7f3a890f9640 1 -- 172.21.15.87:0/849814499 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a80009560 con 0x7f3a84103fd0 2024-09-13T17:24:09.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.982+0000 7f3a890f9640 1 --2- 172.21.15.87:0/849814499 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a84103fd0 0x7f3a841967e0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f3a80009900 tx=0x7f3a800040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:09.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.982+0000 7f3a76ffd640 1 -- 172.21.15.87:0/849814499 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a800037f0 con 0x7f3a84103fd0 2024-09-13T17:24:09.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.982+0000 7f3a76ffd640 1 -- 172.21.15.87:0/849814499 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3a800044c0 con 0x7f3a84103fd0 2024-09-13T17:24:09.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.982+0000 7f3a8bb5e640 1 -- 172.21.15.87:0/849814499 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a841a2e80 con 0x7f3a84103fd0 2024-09-13T17:24:09.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.982+0000 7f3a76ffd640 1 -- 172.21.15.87:0/849814499 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8003bdd0 con 0x7f3a84103fd0 2024-09-13T17:24:09.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.982+0000 7f3a8bb5e640 1 -- 172.21.15.87:0/849814499 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a841a31f0 con 0x7f3a84103fd0 2024-09-13T17:24:09.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.983+0000 7f3a8bb5e640 1 -- 172.21.15.87:0/849814499 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a84100350 con 0x7f3a84103fd0 2024-09-13T17:24:09.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.985+0000 7f3a76ffd640 1 -- 172.21.15.87:0/849814499 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f3a8003b560 con 0x7f3a84103fd0 2024-09-13T17:24:09.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.986+0000 7f3a76ffd640 1 --2- 172.21.15.87:0/849814499 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f3a700a1200 0x7f3a700a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:09.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.986+0000 7f3a898fa640 1 --2- 172.21.15.87:0/849814499 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f3a700a1200 0x7f3a700a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:09.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.986+0000 7f3a76ffd640 1 -- 172.21.15.87:0/849814499 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f3a800ee090 con 0x7f3a84103fd0 2024-09-13T17:24:09.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.986+0000 7f3a898fa640 1 --2- 172.21.15.87:0/849814499 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f3a700a1200 0x7f3a700a36c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3a78009bd0 tx=0x7f3a78005f90 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:09.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:09.989+0000 7f3a76ffd640 1 -- 172.21.15.87:0/849814499 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3a800b71f0 con 0x7f3a84103fd0 2024-09-13T17:24:10.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.181+0000 7f3a8bb5e640 1 -- 172.21.15.87:0/849814499 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a840ff260 con 0x7f3a84103fd0 2024-09-13T17:24:10.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.182+0000 7f3a76ffd640 1 -- 172.21.15.87:0/849814499 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+10877 (secure 0 0 0) 0x7f3a80041090 con 0x7f3a84103fd0 2024-09-13T17:24:10.184 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:24:10.184 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/3674545180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":3674545180},{"type":"v1","addr":"172.21.15.87:6841","nonce":3674545180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:11:23.313609+0000","modified":"2024-09-13T17:19:40.570296+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24484,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6839/3052680456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3052680456},{"type":"v1","addr":"172.21.15.118:6839","nonce":3052680456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:24:10.184 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 36 2024-09-13T17:24:10.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.184+0000 7f3a8bb5e640 1 -- 172.21.15.87:0/849814499 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f3a700a1200 msgr2=0x7f3a700a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:10.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.184+0000 7f3a8bb5e640 1 --2- 172.21.15.87:0/849814499 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f3a700a1200 0x7f3a700a36c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3a78009bd0 tx=0x7f3a78005f90 comp rx=0 tx=0).stop 2024-09-13T17:24:10.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.184+0000 7f3a8bb5e640 1 -- 172.21.15.87:0/849814499 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a84103fd0 msgr2=0x7f3a841967e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:10.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.184+0000 7f3a8bb5e640 1 --2- 172.21.15.87:0/849814499 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a84103fd0 0x7f3a841967e0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f3a80009900 tx=0x7f3a800040c0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.184+0000 7f3a8bb5e640 1 -- 172.21.15.87:0/849814499 shutdown_connections 2024-09-13T17:24:10.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.184+0000 7f3a8bb5e640 1 --2- 172.21.15.87:0/849814499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a8419abd0 0x7f3a8419b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.184+0000 7f3a8bb5e640 1 --2- 172.21.15.87:0/849814499 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f3a700a1200 0x7f3a700a36c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.184+0000 7f3a8bb5e640 1 --2- 172.21.15.87:0/849814499 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a84103fd0 0x7f3a841967e0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.184+0000 7f3a8bb5e640 1 --2- 172.21.15.87:0/849814499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a840fee80 0x7f3a841962a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.184+0000 7f3a8bb5e640 1 -- 172.21.15.87:0/849814499 >> 172.21.15.87:0/849814499 conn(0x7f3a84075c60 msgr2=0x7f3a84067ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:10.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.184+0000 7f3a8bb5e640 1 -- 172.21.15.87:0/849814499 shutdown_connections 2024-09-13T17:24:10.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.184+0000 7f3a8bb5e640 1 -- 172.21.15.87:0/849814499 wait complete. 2024-09-13T17:24:10.196 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-09-13T17:24:10.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.295+0000 7f6a0cd11640 1 -- 172.21.15.87:0/3199157306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a08104070 msgr2=0x7f6a0810bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:10.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.295+0000 7f6a0cd11640 1 --2- 172.21.15.87:0/3199157306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a08104070 0x7f6a0810bbc0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009cd0 tx=0x7f6a0002a8e0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.295+0000 7f6a0cd11640 1 -- 172.21.15.87:0/3199157306 shutdown_connections 2024-09-13T17:24:10.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.295+0000 7f6a0cd11640 1 --2- 172.21.15.87:0/3199157306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a08104070 0x7f6a0810bbc0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.295+0000 7f6a0cd11640 1 --2- 172.21.15.87:0/3199157306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a080ff8d0 0x7f6a08103910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.295+0000 7f6a0cd11640 1 --2- 172.21.15.87:0/3199157306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a080fef20 0x7f6a080ff300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.295+0000 7f6a0cd11640 1 -- 172.21.15.87:0/3199157306 >> 172.21.15.87:0/3199157306 conn(0x7f6a080fa970 msgr2=0x7f6a080fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:10.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.295+0000 7f6a0cd11640 1 -- 172.21.15.87:0/3199157306 shutdown_connections 2024-09-13T17:24:10.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.295+0000 7f6a0cd11640 1 -- 172.21.15.87:0/3199157306 wait complete. 2024-09-13T17:24:10.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.296+0000 7f6a0cd11640 1 Processor -- start 2024-09-13T17:24:10.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.296+0000 7f6a0cd11640 1 -- start start 2024-09-13T17:24:10.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.296+0000 7f6a0cd11640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a080fef20 0x7f6a081954e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.296+0000 7f6a0cd11640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a08104070 0x7f6a08195a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.296+0000 7f6a0cd11640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a08199e10 0x7f6a0819a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.296+0000 7f6a0cd11640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0819a800 con 0x7f6a08104070 2024-09-13T17:24:10.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.296+0000 7f6a0cd11640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0819a970 con 0x7f6a080fef20 2024-09-13T17:24:10.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.296+0000 7f6a0cd11640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0819aae0 con 0x7f6a08199e10 2024-09-13T17:24:10.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.296+0000 7f6a05d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a08104070 0x7f6a08195a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.296+0000 7f6a05d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a08104070 0x7f6a08195a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40668/0 (socket says 172.21.15.87:40668) 2024-09-13T17:24:10.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.296+0000 7f6a05d9b640 1 -- 172.21.15.87:0/2652586908 learned_addr learned my addr 172.21.15.87:0/2652586908 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:10.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.296+0000 7f6a0659c640 1 --2- 172.21.15.87:0/2652586908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a080fef20 0x7f6a081954e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.296+0000 7f6a05d9b640 1 -- 172.21.15.87:0/2652586908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a08199e10 msgr2=0x7f6a0819a2c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T17:24:10.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.296+0000 7f6a05d9b640 1 --2- 172.21.15.87:0/2652586908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a08199e10 0x7f6a0819a2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.296+0000 7f6a05d9b640 1 -- 172.21.15.87:0/2652586908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a080fef20 msgr2=0x7f6a081954e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:10.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.297+0000 7f6a05d9b640 1 --2- 172.21.15.87:0/2652586908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a080fef20 0x7f6a081954e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.297+0000 7f6a05d9b640 1 -- 172.21.15.87:0/2652586908 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a00009900 con 0x7f6a08104070 2024-09-13T17:24:10.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.297+0000 7f6a0659c640 1 --2- 172.21.15.87:0/2652586908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a080fef20 0x7f6a081954e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:10.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.297+0000 7f6a05d9b640 1 --2- 172.21.15.87:0/2652586908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a08104070 0x7f6a08195a20 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f69f000c970 tx=0x7f69f000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:10.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.297+0000 7f69ff7fe640 1 -- 172.21.15.87:0/2652586908 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f0004440 con 0x7f6a08104070 2024-09-13T17:24:10.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.297+0000 7f69ff7fe640 1 -- 172.21.15.87:0/2652586908 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f69f0007d10 con 0x7f6a08104070 2024-09-13T17:24:10.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.297+0000 7f6a0cd11640 1 -- 172.21.15.87:0/2652586908 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a081a20c0 con 0x7f6a08104070 2024-09-13T17:24:10.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.297+0000 7f69ff7fe640 1 -- 172.21.15.87:0/2652586908 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f000f450 con 0x7f6a08104070 2024-09-13T17:24:10.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.297+0000 7f6a0cd11640 1 -- 172.21.15.87:0/2652586908 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a081a2570 con 0x7f6a08104070 2024-09-13T17:24:10.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.299+0000 7f69ff7fe640 1 -- 172.21.15.87:0/2652586908 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f69f00036f0 con 0x7f6a08104070 2024-09-13T17:24:10.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.299+0000 7f6a0fa34740 1 Processor -- start 2024-09-13T17:24:10.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.300+0000 7f6a0fa34740 1 -- start start 2024-09-13T17:24:10.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.300+0000 7f6a0fa34740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629b65b6630 0x5629b65b6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.300+0000 7f6a0fa34740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629b65b6f50 0x5629b65c3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.300+0000 7f6a0fa34740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5629b65c3b60 0x5629b65c5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.300+0000 7f6a0fa34740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629b6520cc0 con 0x5629b65b6630 2024-09-13T17:24:10.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.300+0000 7f6a0fa34740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629b651e450 con 0x5629b65c3b60 2024-09-13T17:24:10.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.300+0000 7f6a0fa34740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629b6519d40 con 0x5629b65b6f50 2024-09-13T17:24:10.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.300+0000 7f6a06d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629b65b6630 0x5629b65b6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.300+0000 7f6a06d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629b65b6630 0x5629b65b6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40684/0 (socket says 172.21.15.87:40684) 2024-09-13T17:24:10.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.300+0000 7f6a06d9d640 1 -- 172.21.15.87:0/3979730560 learned_addr learned my addr 172.21.15.87:0/3979730560 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:10.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.300+0000 7f69ff7fe640 1 --2- 172.21.15.87:0/2652586908 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f69f40a1200 0x7f69f40a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.300+0000 7f6a0659c640 1 --2- 172.21.15.87:0/3979730560 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629b65b6f50 0x5629b65c3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.300+0000 7f6a06d9d640 1 -- 172.21.15.87:0/3979730560 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629b65b6f50 msgr2=0x5629b65c3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:10.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.300+0000 7f6a05d9b640 1 --2- 172.21.15.87:0/3979730560 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5629b65c3b60 0x5629b65c5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.300+0000 7f6a06d9d640 1 --2- 172.21.15.87:0/3979730560 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629b65b6f50 0x5629b65c3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.300+0000 7f6a06d9d640 1 -- 172.21.15.87:0/3979730560 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5629b65c3b60 msgr2=0x5629b65c5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:10.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.300+0000 7f6a06d9d640 1 --2- 172.21.15.87:0/3979730560 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5629b65c3b60 0x5629b65c5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.300+0000 7f6a06d9d640 1 -- 172.21.15.87:0/3979730560 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629b64e1620 con 0x5629b65b6630 2024-09-13T17:24:10.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.300+0000 7f6a0659c640 1 --2- 172.21.15.87:0/3979730560 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629b65b6f50 0x5629b65c3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:10.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.300+0000 7f6a05d9b640 1 --2- 172.21.15.87:0/3979730560 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5629b65c3b60 0x5629b65c5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:10.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.300+0000 7f69ff7fe640 1 -- 172.21.15.87:0/2652586908 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f69f00cd370 con 0x7f6a08104070 2024-09-13T17:24:10.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.301+0000 7f6a06d9d640 1 --2- 172.21.15.87:0/2652586908 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f69f40a1200 0x7f69f40a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.301+0000 7f6a06d9d640 1 --2- 172.21.15.87:0/3979730560 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629b65b6630 0x5629b65b6a10 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009ca0 tx=0x7f6a00031500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b73352543809faf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:10.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.301+0000 7f69fcff9640 1 -- 172.21.15.87:0/3979730560 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a00003b70 con 0x5629b65b6630 2024-09-13T17:24:10.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.301+0000 7f69fcff9640 1 -- 172.21.15.87:0/3979730560 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6a00030e80 con 0x5629b65b6630 2024-09-13T17:24:10.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.301+0000 7f69fcff9640 1 -- 172.21.15.87:0/3979730560 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a000486b0 con 0x5629b65b6630 2024-09-13T17:24:10.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.301+0000 7f6a06d9d640 1 --2- 172.21.15.87:0/2652586908 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f69f40a1200 0x7f69f40a36c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6a0004a000 tx=0x7f6a0004b000 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:10.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.302+0000 7f6a0fa34740 1 -- 172.21.15.87:0/3979730560 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629b65b6630 msgr2=0x5629b65b6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:10.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.302+0000 7f6a0fa34740 1 --2- 172.21.15.87:0/3979730560 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629b65b6630 0x5629b65b6a10 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009ca0 tx=0x7f6a00031500 comp rx=0 tx=0).stop 2024-09-13T17:24:10.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.302+0000 7f6a0fa34740 1 -- 172.21.15.87:0/3979730560 shutdown_connections 2024-09-13T17:24:10.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.302+0000 7f6a0fa34740 1 --2- 172.21.15.87:0/3979730560 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5629b65c3b60 0x5629b65c5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.302+0000 7f6a0fa34740 1 --2- 172.21.15.87:0/3979730560 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629b65b6f50 0x5629b65c3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.302+0000 7f6a0fa34740 1 --2- 172.21.15.87:0/3979730560 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629b65b6630 0x5629b65b6a10 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.302+0000 7f6a0fa34740 1 -- 172.21.15.87:0/3979730560 >> 172.21.15.87:0/3979730560 conn(0x5629b65b2d00 msgr2=0x5629b65b30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:10.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.302+0000 7f6a0fa34740 1 -- 172.21.15.87:0/3979730560 shutdown_connections 2024-09-13T17:24:10.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.302+0000 7f6a0fa34740 1 -- 172.21.15.87:0/3979730560 wait complete. 2024-09-13T17:24:10.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.302+0000 7f6a0fa34740 1 -- start start 2024-09-13T17:24:10.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.302+0000 7f6a0fa34740 1 Processor -- start 2024-09-13T17:24:10.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.302+0000 7f6a0fa34740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629b65b6630 0x5629b65c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.302+0000 7f6a0fa34740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5629b65b6f50 0x5629b65c04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.302+0000 7f6a0fa34740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629b65c3b60 0x5629b65c09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.302+0000 7f6a0fa34740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629b64d8180 con 0x5629b65c3b60 2024-09-13T17:24:10.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.302+0000 7f6a0fa34740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629b61f2430 con 0x5629b65b6f50 2024-09-13T17:24:10.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.302+0000 7f6a0fa34740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629b649d5e0 con 0x5629b65b6630 2024-09-13T17:24:10.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.302+0000 7f6a0fa34740 10 client.0 _ll_register_callbacks cb 0x5629b6509aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:24:10.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.302+0000 7f6a06d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629b65c3b60 0x5629b65c09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.302+0000 7f6a06d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629b65c3b60 0x5629b65c09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40694/0 (socket says 172.21.15.87:40694) 2024-09-13T17:24:10.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.303+0000 7f6a06d9d640 1 -- 172.21.15.87:0/33927507 learned_addr learned my addr 172.21.15.87:0/33927507 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:10.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.303+0000 7f6a0659c640 1 --2- 172.21.15.87:0/33927507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629b65b6630 0x5629b65c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.303+0000 7f6a06d9d640 1 -- 172.21.15.87:0/33927507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629b65b6630 msgr2=0x5629b65c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:10.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.303+0000 7f6a06d9d640 1 --2- 172.21.15.87:0/33927507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629b65b6630 0x5629b65c3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.303+0000 7f6a06d9d640 1 -- 172.21.15.87:0/33927507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5629b65b6f50 msgr2=0x5629b65c04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:10.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.303+0000 7f6a06d9d640 1 --2- 172.21.15.87:0/33927507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5629b65b6f50 0x5629b65c04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.303+0000 7f6a06d9d640 1 -- 172.21.15.87:0/33927507 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a0810c400 con 0x5629b65c3b60 2024-09-13T17:24:10.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.303+0000 7f6a0659c640 1 --2- 172.21.15.87:0/33927507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629b65b6630 0x5629b65c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:10.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.303+0000 7f6a06d9d640 1 --2- 172.21.15.87:0/33927507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629b65c3b60 0x5629b65c09f0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009600 tx=0x7f6a00048680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b3fa700d306668 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:10.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.303+0000 7f69edffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:24:10.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.303+0000 7f69edffb640 1 -- 172.21.15.87:0/33927507 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a00048d40 con 0x5629b65c3b60 2024-09-13T17:24:10.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.303+0000 7f69edffb640 1 -- 172.21.15.87:0/33927507 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f6a00004810 con 0x5629b65c3b60 2024-09-13T17:24:10.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.303+0000 7f6a0fa34740 1 -- 172.21.15.87:0/33927507 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5629b6543b80 con 0x5629b65c3b60 2024-09-13T17:24:10.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.303+0000 7f69edffb640 1 -- 172.21.15.87:0/33927507 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a00048ea0 con 0x5629b65c3b60 2024-09-13T17:24:10.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.303+0000 7f6a0fa34740 10 client.18195 fetch_fsmap learned FSMap version 36 2024-09-13T17:24:10.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.303+0000 7f6a0fa34740 1 -- 172.21.15.87:0/33927507 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5629b65183c0 con 0x5629b65c3b60 2024-09-13T17:24:10.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.303+0000 7f69edffb640 1 -- 172.21.15.87:0/33927507 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x5629b6543b80 con 0x5629b65c3b60 2024-09-13T17:24:10.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.304+0000 7f69edffb640 1 -- 172.21.15.87:0/33927507 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f6a0004f070 con 0x5629b65c3b60 2024-09-13T17:24:10.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.304+0000 7f6a0fa34740 10 client.18195 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:24:10.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.304+0000 7f6a0fa34740 10 client.18195 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:24:10.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.304+0000 7f6a0fa34740 20 client.18195 populate_metadata read hostname 'smithi087' 2024-09-13T17:24:10.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.304+0000 7f6a0fa34740 1 --2- 172.21.15.87:0/33927507 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x5629b65d31b0 0x5629b65d55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.304+0000 7f6a0fa34740 4 client.18195 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:24:10.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.304+0000 7f6a0fa34740 1 -- 172.21.15.87:0/33927507 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5629b650c1f0 con 0x5629b65d31b0 2024-09-13T17:24:10.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.304+0000 7f6a0659c640 1 --2- 172.21.15.87:0/33927507 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x5629b65d31b0 0x5629b65d55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.304+0000 7f6a0659c640 1 --2- 172.21.15.87:0/33927507 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x5629b65d31b0 0x5629b65d55a0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d3fe30c8da745f0b server_cookie=1869ad26a2275cf8 in_seq=0 out_seq=0 2024-09-13T17:24:10.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.304+0000 7f69edffb640 10 client.18195 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:24:10.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.305+0000 7f69edffb640 1 -- 172.21.15.87:0/33927507 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5629b650c1f0 con 0x5629b65d31b0 2024-09-13T17:24:10.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.305+0000 7f69edffb640 10 client.18195 handle_command_reply: tid=0 2024-09-13T17:24:10.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.305+0000 7f6a0fa34740 1 client.18195 shutdown 2024-09-13T17:24:10.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.305+0000 7f6a0fa34740 1 -- 172.21.15.87:0/33927507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629b65c3b60 msgr2=0x5629b65c09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:10.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.305+0000 7f6a0fa34740 1 --2- 172.21.15.87:0/33927507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629b65c3b60 0x5629b65c09f0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009600 tx=0x7f6a00048680 comp rx=0 tx=0).stop 2024-09-13T17:24:10.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.305+0000 7f6a0fa34740 1 -- 172.21.15.87:0/33927507 shutdown_connections 2024-09-13T17:24:10.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.305+0000 7f6a0fa34740 1 --2- 172.21.15.87:0/33927507 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x5629b65d31b0 0x5629b65d55a0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.305+0000 7f6a0fa34740 1 --2- 172.21.15.87:0/33927507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629b65c3b60 0x5629b65c09f0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.305+0000 7f6a0fa34740 1 --2- 172.21.15.87:0/33927507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5629b65b6f50 0x5629b65c04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.305+0000 7f69edffb640 0 client.18195 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:24:10.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.305+0000 7f6a0fa34740 1 --2- 172.21.15.87:0/33927507 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629b65b6630 0x5629b65c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.305+0000 7f6a0fa34740 1 -- 172.21.15.87:0/33927507 >> 172.21.15.87:0/33927507 conn(0x5629b65b2d00 msgr2=0x5629b65b8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:10.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.305+0000 7f6a0fa34740 1 -- 172.21.15.87:0/33927507 shutdown_connections 2024-09-13T17:24:10.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.305+0000 7f6a0fa34740 1 -- 172.21.15.87:0/33927507 wait complete. 2024-09-13T17:24:10.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.305+0000 7f6a0fa34740 20 client.18195 trim_cache size 0 max 16384 2024-09-13T17:24:10.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.316+0000 7f6a0fa34740 1 Processor -- start 2024-09-13T17:24:10.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.316+0000 7f6a0fa34740 1 -- start start 2024-09-13T17:24:10.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.316+0000 7f6a0fa34740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5629b65b6630 0x5629b65b26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.316+0000 7f6a0fa34740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629b65b6f50 0x5629b65ca840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.316+0000 7f6a0fa34740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629b65c3b60 0x5629b65cad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.316+0000 7f6a0fa34740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629b65b75c0 con 0x5629b65b6f50 2024-09-13T17:24:10.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.316+0000 7f6a0fa34740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629b65ad3d0 con 0x5629b65b6630 2024-09-13T17:24:10.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.316+0000 7f6a0fa34740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629b65c0d60 con 0x5629b65c3b60 2024-09-13T17:24:10.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.316+0000 7f6a05d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629b65b6f50 0x5629b65ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.316+0000 7f6a05d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629b65b6f50 0x5629b65ca840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40710/0 (socket says 172.21.15.87:40710) 2024-09-13T17:24:10.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.316+0000 7f6a05d9b640 1 -- 172.21.15.87:0/2892227973 learned_addr learned my addr 172.21.15.87:0/2892227973 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:10.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.316+0000 7f6a05d9b640 1 -- 172.21.15.87:0/2892227973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629b65c3b60 msgr2=0x5629b65cad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:10.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.316+0000 7f6a05d9b640 1 --2- 172.21.15.87:0/2892227973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629b65c3b60 0x5629b65cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.316+0000 7f6a05d9b640 1 -- 172.21.15.87:0/2892227973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5629b65b6630 msgr2=0x5629b65b26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:10.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.316+0000 7f6a05d9b640 1 --2- 172.21.15.87:0/2892227973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5629b65b6630 0x5629b65b26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.316+0000 7f6a05d9b640 1 -- 172.21.15.87:0/2892227973 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629b64ba770 con 0x5629b65b6f50 2024-09-13T17:24:10.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.317+0000 7f6a05d9b640 1 --2- 172.21.15.87:0/2892227973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629b65b6f50 0x5629b65ca840 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f69f0099d70 tx=0x7f69f0069ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f335093a71323a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:10.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.317+0000 7f69fd7fa640 1 -- 172.21.15.87:0/2892227973 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f00cd1b0 con 0x5629b65b6f50 2024-09-13T17:24:10.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.317+0000 7f69fd7fa640 1 -- 172.21.15.87:0/2892227973 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f69f0065a10 con 0x5629b65b6f50 2024-09-13T17:24:10.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.317+0000 7f69fd7fa640 1 -- 172.21.15.87:0/2892227973 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f00ca930 con 0x5629b65b6f50 2024-09-13T17:24:10.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.317+0000 7f6a0fa34740 1 -- 172.21.15.87:0/2892227973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629b65b6f50 msgr2=0x5629b65ca840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:10.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.317+0000 7f6a0fa34740 1 --2- 172.21.15.87:0/2892227973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629b65b6f50 0x5629b65ca840 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f69f0099d70 tx=0x7f69f0069ff0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.317+0000 7f6a0fa34740 1 -- 172.21.15.87:0/2892227973 shutdown_connections 2024-09-13T17:24:10.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.317+0000 7f6a0fa34740 1 --2- 172.21.15.87:0/2892227973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629b65c3b60 0x5629b65cad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.317+0000 7f6a0fa34740 1 --2- 172.21.15.87:0/2892227973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629b65b6f50 0x5629b65ca840 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.317+0000 7f6a0fa34740 1 --2- 172.21.15.87:0/2892227973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5629b65b6630 0x5629b65b26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.317+0000 7f6a0fa34740 1 -- 172.21.15.87:0/2892227973 >> 172.21.15.87:0/2892227973 conn(0x5629b65b2d00 msgr2=0x5629b65cf300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:10.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.317+0000 7f6a0fa34740 1 -- 172.21.15.87:0/2892227973 shutdown_connections 2024-09-13T17:24:10.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.317+0000 7f6a0fa34740 1 -- 172.21.15.87:0/2892227973 wait complete. 2024-09-13T17:24:10.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.318+0000 7f6a0fa34740 1 -- start start 2024-09-13T17:24:10.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.318+0000 7f6a0fa34740 1 Processor -- start 2024-09-13T17:24:10.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.318+0000 7f6a0fa34740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629b65b6630 0x5629b65c6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.318+0000 7f6a0fa34740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5629b65b6f50 0x5629b65c7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.318+0000 7f6a0fa34740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629b65c3b60 0x5629b65ca200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.318+0000 7f6a0fa34740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629b65ca7c0 con 0x5629b65b6630 2024-09-13T17:24:10.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.318+0000 7f6a0fa34740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629b65ca930 con 0x5629b65b6f50 2024-09-13T17:24:10.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.318+0000 7f6a0fa34740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629b65caaf0 con 0x5629b65c3b60 2024-09-13T17:24:10.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.318+0000 7f6a0fa34740 10 client.0 _ll_register_callbacks cb 0x7f6a00009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:24:10.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.318+0000 7f6a0659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629b65b6630 0x5629b65c6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.318+0000 7f6a0659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629b65b6630 0x5629b65c6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40716/0 (socket says 172.21.15.87:40716) 2024-09-13T17:24:10.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.318+0000 7f6a0659c640 1 -- 172.21.15.87:0/1908988888 learned_addr learned my addr 172.21.15.87:0/1908988888 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:10.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.318+0000 7f6a06d9d640 1 --2- 172.21.15.87:0/1908988888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629b65c3b60 0x5629b65ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.318+0000 7f6a05d9b640 1 --2- 172.21.15.87:0/1908988888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5629b65b6f50 0x5629b65c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.318+0000 7f6a0659c640 1 -- 172.21.15.87:0/1908988888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629b65c3b60 msgr2=0x5629b65ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:10.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.318+0000 7f6a0659c640 1 --2- 172.21.15.87:0/1908988888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629b65c3b60 0x5629b65ca200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.318+0000 7f6a0659c640 1 -- 172.21.15.87:0/1908988888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5629b65b6f50 msgr2=0x5629b65c7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:10.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.318+0000 7f6a0659c640 1 --2- 172.21.15.87:0/1908988888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5629b65b6f50 0x5629b65c7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.318+0000 7f6a0659c640 1 -- 172.21.15.87:0/1908988888 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a081a2570 con 0x5629b65b6630 2024-09-13T17:24:10.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.318+0000 7f6a06d9d640 1 --2- 172.21.15.87:0/1908988888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629b65c3b60 0x5629b65ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:10.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.318+0000 7f6a05d9b640 1 --2- 172.21.15.87:0/1908988888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5629b65b6f50 0x5629b65c7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:10.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.318+0000 7f6a0659c640 1 --2- 172.21.15.87:0/1908988888 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629b65b6630 0x5629b65c6bf0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f69f8000c00 tx=0x7f69f80137d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af6481daa18319c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:10.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.318+0000 7f69edffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:24:10.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.318+0000 7f69edffb640 1 -- 172.21.15.87:0/1908988888 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f8020630 con 0x5629b65b6630 2024-09-13T17:24:10.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.319+0000 7f69edffb640 1 -- 172.21.15.87:0/1908988888 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f69f800b050 con 0x5629b65b6630 2024-09-13T17:24:10.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.319+0000 7f6a0fa34740 1 -- 172.21.15.87:0/1908988888 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6a00030e80 con 0x5629b65b6630 2024-09-13T17:24:10.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.319+0000 7f69edffb640 1 -- 172.21.15.87:0/1908988888 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69f8020790 con 0x5629b65b6630 2024-09-13T17:24:10.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.319+0000 7f6a0fa34740 10 client.18201 fetch_fsmap learned FSMap version 36 2024-09-13T17:24:10.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.319+0000 7f6a0fa34740 1 -- 172.21.15.87:0/1908988888 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5629b64dfe80 con 0x5629b65b6630 2024-09-13T17:24:10.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.319+0000 7f69edffb640 1 -- 172.21.15.87:0/1908988888 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6a00030e80 con 0x5629b65b6630 2024-09-13T17:24:10.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.319+0000 7f69edffb640 1 -- 172.21.15.87:0/1908988888 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f69f801fa50 con 0x5629b65b6630 2024-09-13T17:24:10.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.319+0000 7f6a0fa34740 10 client.18201 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:24:10.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.319+0000 7f6a0fa34740 10 client.18201 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-09-13T17:24:10.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.319+0000 7f6a0fa34740 20 client.18201 populate_metadata read hostname 'smithi087' 2024-09-13T17:24:10.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.319+0000 7f6a0fa34740 1 --2- 172.21.15.87:0/1908988888 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x5629b662a8e0 0x5629b662cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.319+0000 7f6a0fa34740 4 client.18201 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:24:10.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.319+0000 7f6a0fa34740 1 -- 172.21.15.87:0/1908988888 --> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5629b620d4e0 con 0x5629b662a8e0 2024-09-13T17:24:10.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.319+0000 7f6a05d9b640 1 --2- 172.21.15.87:0/1908988888 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x5629b662a8e0 0x5629b662cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.320+0000 7f69edffb640 10 client.18201 ms_handle_connect on v2:172.21.15.149:6834/3814444081 2024-09-13T17:24:10.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.320+0000 7f6a05d9b640 1 --2- 172.21.15.87:0/1908988888 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x5629b662a8e0 0x5629b662cd00 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f04c9bcba9e1f3f2 server_cookie=db991a5f52c3efd9 in_seq=0 out_seq=0 2024-09-13T17:24:10.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.320+0000 7f69edffb640 1 -- 172.21.15.87:0/1908988888 <== mds.2 v2:172.21.15.149:6834/3814444081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5629b620d4e0 con 0x5629b662a8e0 2024-09-13T17:24:10.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.320+0000 7f69edffb640 10 client.18201 handle_command_reply: tid=0 2024-09-13T17:24:10.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.320+0000 7f6a0fa34740 1 client.18201 shutdown 2024-09-13T17:24:10.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.320+0000 7f6a0fa34740 1 -- 172.21.15.87:0/1908988888 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629b65b6630 msgr2=0x5629b65c6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:10.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.320+0000 7f6a0fa34740 1 --2- 172.21.15.87:0/1908988888 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629b65b6630 0x5629b65c6bf0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f69f8000c00 tx=0x7f69f80137d0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.320+0000 7f6a0fa34740 1 -- 172.21.15.87:0/1908988888 shutdown_connections 2024-09-13T17:24:10.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.320+0000 7f6a0fa34740 1 --2- 172.21.15.87:0/1908988888 >> [v2:172.21.15.149:6834/3814444081,v1:172.21.15.149:6835/3814444081] conn(0x5629b662a8e0 0x5629b662cd00 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.320+0000 7f6a0fa34740 1 --2- 172.21.15.87:0/1908988888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629b65c3b60 0x5629b65ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.320+0000 7f69edffb640 0 client.18201 ms_handle_reset on v2:172.21.15.149:6834/3814444081 2024-09-13T17:24:10.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.320+0000 7f6a0fa34740 1 --2- 172.21.15.87:0/1908988888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5629b65b6f50 0x5629b65c7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.320+0000 7f6a0fa34740 1 --2- 172.21.15.87:0/1908988888 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629b65b6630 0x5629b65c6bf0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.320+0000 7f6a0fa34740 1 -- 172.21.15.87:0/1908988888 >> 172.21.15.87:0/1908988888 conn(0x5629b65b2d00 msgr2=0x5629b65bece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:10.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.320+0000 7f6a0fa34740 1 -- 172.21.15.87:0/1908988888 shutdown_connections 2024-09-13T17:24:10.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.320+0000 7f6a0fa34740 1 -- 172.21.15.87:0/1908988888 wait complete. 2024-09-13T17:24:10.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.320+0000 7f6a0fa34740 20 client.18201 trim_cache size 0 max 16384 2024-09-13T17:24:10.328 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:24:10.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.321+0000 7f6a0cd11640 1 -- 172.21.15.87:0/2652586908 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f69f40a1200 msgr2=0x7f69f40a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:10.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.321+0000 7f6a0cd11640 1 --2- 172.21.15.87:0/2652586908 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f69f40a1200 0x7f69f40a36c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6a0004a000 tx=0x7f6a0004b000 comp rx=0 tx=0).stop 2024-09-13T17:24:10.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.321+0000 7f6a0cd11640 1 -- 172.21.15.87:0/2652586908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a08104070 msgr2=0x7f6a08195a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:10.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.321+0000 7f6a0cd11640 1 --2- 172.21.15.87:0/2652586908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a08104070 0x7f6a08195a20 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f69f000c970 tx=0x7f69f000ce30 comp rx=0 tx=0).stop 2024-09-13T17:24:10.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.321+0000 7f6a0cd11640 1 -- 172.21.15.87:0/2652586908 shutdown_connections 2024-09-13T17:24:10.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.321+0000 7f6a0cd11640 1 --2- 172.21.15.87:0/2652586908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a08199e10 0x7f6a0819a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.321+0000 7f6a0cd11640 1 --2- 172.21.15.87:0/2652586908 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f69f40a1200 0x7f69f40a36c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.321+0000 7f6a0cd11640 1 --2- 172.21.15.87:0/2652586908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a08104070 0x7f6a08195a20 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.321+0000 7f6a0cd11640 1 --2- 172.21.15.87:0/2652586908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a080fef20 0x7f6a081954e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.321+0000 7f6a0cd11640 1 -- 172.21.15.87:0/2652586908 >> 172.21.15.87:0/2652586908 conn(0x7f6a080fa970 msgr2=0x7f6a080fbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:10.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.321+0000 7f6a0cd11640 1 -- 172.21.15.87:0/2652586908 shutdown_connections 2024-09-13T17:24:10.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.321+0000 7f6a0cd11640 1 -- 172.21.15.87:0/2652586908 wait complete. 2024-09-13T17:24:10.332 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-09-13T17:24:10.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.431+0000 7f5321c5a640 1 -- 172.21.15.87:0/2492058011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f531c0ff810 msgr2=0x7f531c103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:10.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.431+0000 7f5321c5a640 1 --2- 172.21.15.87:0/2492058011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f531c0ff810 0x7f531c103850 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f5310009930 tx=0x7f531002a420 comp rx=0 tx=0).stop 2024-09-13T17:24:10.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.431+0000 7f5321c5a640 1 -- 172.21.15.87:0/2492058011 shutdown_connections 2024-09-13T17:24:10.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.431+0000 7f5321c5a640 1 --2- 172.21.15.87:0/2492058011 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f531c103fb0 0x7f531c10bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.431+0000 7f5321c5a640 1 --2- 172.21.15.87:0/2492058011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f531c0ff810 0x7f531c103850 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.431+0000 7f5321c5a640 1 --2- 172.21.15.87:0/2492058011 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f531c0fee60 0x7f531c0ff240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.431+0000 7f5321c5a640 1 -- 172.21.15.87:0/2492058011 >> 172.21.15.87:0/2492058011 conn(0x7f531c075c60 msgr2=0x7f531c0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:10.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.431+0000 7f5321c5a640 1 -- 172.21.15.87:0/2492058011 shutdown_connections 2024-09-13T17:24:10.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.431+0000 7f5321c5a640 1 -- 172.21.15.87:0/2492058011 wait complete. 2024-09-13T17:24:10.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.431+0000 7f5321c5a640 1 Processor -- start 2024-09-13T17:24:10.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.431+0000 7f5321c5a640 1 -- start start 2024-09-13T17:24:10.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.432+0000 7f5321c5a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f531c0fee60 0x7f531c1952d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.432+0000 7f5321c5a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f531c103fb0 0x7f531c195810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.432+0000 7f5321c5a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f531c199c00 0x7f531c19a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.432+0000 7f5321c5a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531c19a5f0 con 0x7f531c199c00 2024-09-13T17:24:10.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.432+0000 7f5321c5a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531c19a760 con 0x7f531c103fb0 2024-09-13T17:24:10.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.432+0000 7f5321c5a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531c19a8d0 con 0x7f531c0fee60 2024-09-13T17:24:10.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.432+0000 7f531bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f531c199c00 0x7f531c19a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.432+0000 7f531bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f531c199c00 0x7f531c19a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40726/0 (socket says 172.21.15.87:40726) 2024-09-13T17:24:10.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.432+0000 7f531bfff640 1 -- 172.21.15.87:0/1225347298 learned_addr learned my addr 172.21.15.87:0/1225347298 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:10.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.432+0000 7f531affd640 1 --2- 172.21.15.87:0/1225347298 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f531c103fb0 0x7f531c195810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.432+0000 7f531b7fe640 1 --2- 172.21.15.87:0/1225347298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f531c0fee60 0x7f531c1952d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.432+0000 7f531bfff640 1 -- 172.21.15.87:0/1225347298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f531c0fee60 msgr2=0x7f531c1952d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:10.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.432+0000 7f531bfff640 1 --2- 172.21.15.87:0/1225347298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f531c0fee60 0x7f531c1952d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.432+0000 7f531bfff640 1 -- 172.21.15.87:0/1225347298 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f531c103fb0 msgr2=0x7f531c195810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:10.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.432+0000 7f531bfff640 1 --2- 172.21.15.87:0/1225347298 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f531c103fb0 0x7f531c195810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.432+0000 7f531bfff640 1 -- 172.21.15.87:0/1225347298 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5310009560 con 0x7f531c199c00 2024-09-13T17:24:10.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.432+0000 7f531affd640 1 --2- 172.21.15.87:0/1225347298 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f531c103fb0 0x7f531c195810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:10.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.432+0000 7f531bfff640 1 --2- 172.21.15.87:0/1225347298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f531c199c00 0x7f531c19a0b0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f531400b9e0 tx=0x7f531400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:10.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.432+0000 7f5318ff9640 1 -- 172.21.15.87:0/1225347298 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531400caa0 con 0x7f531c199c00 2024-09-13T17:24:10.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.432+0000 7f5321c5a640 1 -- 172.21.15.87:0/1225347298 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f531c1a1eb0 con 0x7f531c199c00 2024-09-13T17:24:10.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.432+0000 7f5318ff9640 1 -- 172.21.15.87:0/1225347298 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f531400cc00 con 0x7f531c199c00 2024-09-13T17:24:10.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.432+0000 7f5318ff9640 1 -- 172.21.15.87:0/1225347298 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53140075d0 con 0x7f531c199c00 2024-09-13T17:24:10.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.432+0000 7f5321c5a640 1 -- 172.21.15.87:0/1225347298 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f531c1a2280 con 0x7f531c199c00 2024-09-13T17:24:10.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.435+0000 7f5318ff9640 1 -- 172.21.15.87:0/1225347298 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f5314014440 con 0x7f531c199c00 2024-09-13T17:24:10.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.435+0000 7f5324a5c740 1 Processor -- start 2024-09-13T17:24:10.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.435+0000 7f5324a5c740 1 -- start start 2024-09-13T17:24:10.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.435+0000 7f5324a5c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f827f1d000 0x55f827f1b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.435+0000 7f5324a5c740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f827f1be50 0x55f827f1c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.435+0000 7f5324a5c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f827f28a10 0x55f827f2ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.435+0000 7f5324a5c740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f827e83cc0 con 0x55f827f1d000 2024-09-13T17:24:10.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.435+0000 7f5324a5c740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f827e81450 con 0x55f827f1be50 2024-09-13T17:24:10.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.435+0000 7f5324a5c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f827e7cd40 con 0x55f827f28a10 2024-09-13T17:24:10.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.435+0000 7f531affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f827f1d000 0x55f827f1b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.435+0000 7f531affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f827f1d000 0x55f827f1b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40742/0 (socket says 172.21.15.87:40742) 2024-09-13T17:24:10.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.435+0000 7f531affd640 1 -- 172.21.15.87:0/3156959486 learned_addr learned my addr 172.21.15.87:0/3156959486 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:10.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.435+0000 7f5318ff9640 1 --2- 172.21.15.87:0/1225347298 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f53040a1200 0x7f53040a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.436+0000 7f531affd640 1 --2- 172.21.15.87:0/3156959486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f827f28a10 0x55f827f2ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.436+0000 7f531b7fe640 1 --2- 172.21.15.87:0/3156959486 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f827f1be50 0x55f827f1c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.436+0000 7f531bfff640 1 --2- 172.21.15.87:0/1225347298 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f53040a1200 0x7f53040a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.436+0000 7f531affd640 1 -- 172.21.15.87:0/3156959486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f827f28a10 msgr2=0x55f827f2ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:10.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.436+0000 7f531affd640 1 --2- 172.21.15.87:0/3156959486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f827f28a10 0x55f827f2ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.436+0000 7f531affd640 1 -- 172.21.15.87:0/3156959486 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f827f1be50 msgr2=0x55f827f1c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:10.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.436+0000 7f531affd640 1 --2- 172.21.15.87:0/3156959486 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f827f1be50 0x55f827f1c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.436+0000 7f531affd640 1 -- 172.21.15.87:0/3156959486 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f827e44620 con 0x55f827f1d000 2024-09-13T17:24:10.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.436+0000 7f5318ff9640 1 -- 172.21.15.87:0/1225347298 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f53140cc960 con 0x7f531c199c00 2024-09-13T17:24:10.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.436+0000 7f531affd640 1 --2- 172.21.15.87:0/3156959486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f827f1d000 0x55f827f1b880 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f5310000c00 tx=0x7f5310032a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceaab424978a2487 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:10.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.436+0000 7f5301ffb640 1 -- 172.21.15.87:0/3156959486 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5310004030 con 0x55f827f1d000 2024-09-13T17:24:10.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.436+0000 7f531bfff640 1 --2- 172.21.15.87:0/1225347298 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f53040a1200 0x7f53040a36c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f53140ca2a0 tx=0x7f53140b9040 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:10.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.436+0000 7f5301ffb640 1 -- 172.21.15.87:0/3156959486 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5310005040 con 0x55f827f1d000 2024-09-13T17:24:10.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.436+0000 7f5301ffb640 1 -- 172.21.15.87:0/3156959486 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5310004a70 con 0x55f827f1d000 2024-09-13T17:24:10.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.437+0000 7f5324a5c740 1 -- 172.21.15.87:0/3156959486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f827f1d000 msgr2=0x55f827f1b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:10.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.437+0000 7f5324a5c740 1 --2- 172.21.15.87:0/3156959486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f827f1d000 0x55f827f1b880 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f5310000c00 tx=0x7f5310032a40 comp rx=0 tx=0).stop 2024-09-13T17:24:10.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.437+0000 7f5324a5c740 1 -- 172.21.15.87:0/3156959486 shutdown_connections 2024-09-13T17:24:10.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.437+0000 7f5324a5c740 1 --2- 172.21.15.87:0/3156959486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f827f28a10 0x55f827f2ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.437+0000 7f5324a5c740 1 --2- 172.21.15.87:0/3156959486 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f827f1be50 0x55f827f1c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.437+0000 7f5324a5c740 1 --2- 172.21.15.87:0/3156959486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f827f1d000 0x55f827f1b880 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.437+0000 7f5324a5c740 1 -- 172.21.15.87:0/3156959486 >> 172.21.15.87:0/3156959486 conn(0x55f827f17f10 msgr2=0x55f827f182f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:10.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.437+0000 7f5324a5c740 1 -- 172.21.15.87:0/3156959486 shutdown_connections 2024-09-13T17:24:10.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.437+0000 7f5324a5c740 1 -- 172.21.15.87:0/3156959486 wait complete. 2024-09-13T17:24:10.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.437+0000 7f5324a5c740 1 -- start start 2024-09-13T17:24:10.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.438+0000 7f5324a5c740 1 Processor -- start 2024-09-13T17:24:10.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.438+0000 7f5324a5c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f827f1be50 0x55f827f280b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.438+0000 7f5324a5c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f827f1d000 0x55f827f25510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.438+0000 7f5324a5c740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f827f28a10 0x55f827f25a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.438+0000 7f5324a5c740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f827e3b180 con 0x55f827f1d000 2024-09-13T17:24:10.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.438+0000 7f5324a5c740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f827b55430 con 0x55f827f28a10 2024-09-13T17:24:10.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.438+0000 7f5324a5c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f827e005e0 con 0x55f827f1be50 2024-09-13T17:24:10.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.438+0000 7f5324a5c740 10 client.0 _ll_register_callbacks cb 0x55f827e6caa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:24:10.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.438+0000 7f531b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f827f1d000 0x55f827f25510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.438+0000 7f531b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f827f1d000 0x55f827f25510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40754/0 (socket says 172.21.15.87:40754) 2024-09-13T17:24:10.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.438+0000 7f531b7fe640 1 -- 172.21.15.87:0/138482302 learned_addr learned my addr 172.21.15.87:0/138482302 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:10.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.438+0000 7f531affd640 1 --2- 172.21.15.87:0/138482302 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f827f1be50 0x55f827f280b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.438+0000 7f531affd640 1 --2- 172.21.15.87:0/138482302 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f827f28a10 0x55f827f25a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.438+0000 7f531b7fe640 1 -- 172.21.15.87:0/138482302 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f827f1be50 msgr2=0x55f827f280b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:10.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.438+0000 7f531b7fe640 1 --2- 172.21.15.87:0/138482302 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f827f1be50 0x55f827f280b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.438+0000 7f531b7fe640 1 -- 172.21.15.87:0/138482302 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f827f28a10 msgr2=0x55f827f25a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:10.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.438+0000 7f531b7fe640 1 --2- 172.21.15.87:0/138482302 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f827f28a10 0x55f827f25a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.438+0000 7f531b7fe640 1 -- 172.21.15.87:0/138482302 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f531c10c340 con 0x55f827f1d000 2024-09-13T17:24:10.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.438+0000 7f531b7fe640 1 --2- 172.21.15.87:0/138482302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f827f1d000 0x55f827f25510 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f530c00f210 tx=0x7f530c00f6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ad5715adaed901 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:10.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.438+0000 7f52faffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:24:10.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.439+0000 7f52faffd640 1 -- 172.21.15.87:0/138482302 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c014870 con 0x55f827f1d000 2024-09-13T17:24:10.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.439+0000 7f52faffd640 1 -- 172.21.15.87:0/138482302 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f530c00fe80 con 0x55f827f1d000 2024-09-13T17:24:10.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.439+0000 7f5324a5c740 1 -- 172.21.15.87:0/138482302 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f827ea6b80 con 0x55f827f1d000 2024-09-13T17:24:10.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.439+0000 7f52faffd640 1 -- 172.21.15.87:0/138482302 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f530c0149d0 con 0x55f827f1d000 2024-09-13T17:24:10.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.439+0000 7f5324a5c740 10 client.18213 fetch_fsmap learned FSMap version 36 2024-09-13T17:24:10.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.439+0000 7f5324a5c740 1 -- 172.21.15.87:0/138482302 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55f827e7b3c0 con 0x55f827f1d000 2024-09-13T17:24:10.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.439+0000 7f52faffd640 1 -- 172.21.15.87:0/138482302 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55f827ea6b80 con 0x55f827f1d000 2024-09-13T17:24:10.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.440+0000 7f52faffd640 1 -- 172.21.15.87:0/138482302 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f530c013c40 con 0x55f827f1d000 2024-09-13T17:24:10.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.440+0000 7f5324a5c740 10 client.18213 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:24:10.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.440+0000 7f5324a5c740 10 client.18213 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:24:10.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.440+0000 7f5324a5c740 20 client.18213 populate_metadata read hostname 'smithi087' 2024-09-13T17:24:10.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.440+0000 7f5324a5c740 1 --2- 172.21.15.87:0/138482302 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55f827f388c0 0x55f827f3ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.440+0000 7f5324a5c740 4 client.18213 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:24:10.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.440+0000 7f5324a5c740 1 -- 172.21.15.87:0/138482302 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f827e6f1f0 con 0x55f827f388c0 2024-09-13T17:24:10.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.440+0000 7f531affd640 1 --2- 172.21.15.87:0/138482302 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55f827f388c0 0x55f827f3ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.440+0000 7f52faffd640 10 client.18213 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:24:10.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.440+0000 7f531affd640 1 --2- 172.21.15.87:0/138482302 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55f827f388c0 0x55f827f3ace0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ca67152d41a899f server_cookie=3711a79573dcad80 in_seq=0 out_seq=0 2024-09-13T17:24:10.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.441+0000 7f52faffd640 1 -- 172.21.15.87:0/138482302 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55f827e6f1f0 con 0x55f827f388c0 2024-09-13T17:24:10.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.441+0000 7f52faffd640 10 client.18213 handle_command_reply: tid=0 2024-09-13T17:24:10.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.441+0000 7f5324a5c740 1 client.18213 shutdown 2024-09-13T17:24:10.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.441+0000 7f5324a5c740 1 -- 172.21.15.87:0/138482302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f827f1d000 msgr2=0x55f827f25510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:10.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.441+0000 7f5324a5c740 1 --2- 172.21.15.87:0/138482302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f827f1d000 0x55f827f25510 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f530c00f210 tx=0x7f530c00f6d0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.441+0000 7f5324a5c740 1 -- 172.21.15.87:0/138482302 shutdown_connections 2024-09-13T17:24:10.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.441+0000 7f5324a5c740 1 --2- 172.21.15.87:0/138482302 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55f827f388c0 0x55f827f3ace0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.441+0000 7f5324a5c740 1 --2- 172.21.15.87:0/138482302 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f827f28a10 0x55f827f25a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.441+0000 7f5324a5c740 1 --2- 172.21.15.87:0/138482302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f827f1d000 0x55f827f25510 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.441+0000 7f5324a5c740 1 --2- 172.21.15.87:0/138482302 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f827f1be50 0x55f827f280b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.441+0000 7f5324a5c740 1 -- 172.21.15.87:0/138482302 >> 172.21.15.87:0/138482302 conn(0x55f827f17f10 msgr2=0x55f827f1dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:10.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.441+0000 7f52faffd640 0 client.18213 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:24:10.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.441+0000 7f5324a5c740 1 -- 172.21.15.87:0/138482302 shutdown_connections 2024-09-13T17:24:10.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.441+0000 7f5324a5c740 1 -- 172.21.15.87:0/138482302 wait complete. 2024-09-13T17:24:10.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.442+0000 7f5324a5c740 20 client.18213 trim_cache size 0 max 16384 2024-09-13T17:24:10.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.458+0000 7f5324a5c740 1 Processor -- start 2024-09-13T17:24:10.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.458+0000 7f5324a5c740 1 -- start start 2024-09-13T17:24:10.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.458+0000 7f5324a5c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f827f17f10 0x55f827f156a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.458+0000 7f5324a5c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f827f1be50 0x55f827f2fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.458+0000 7f5324a5c740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f827f1d000 0x55f827f2ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.458+0000 7f5324a5c740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f827f244b0 con 0x55f827f1be50 2024-09-13T17:24:10.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.458+0000 7f5324a5c740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f827f190a0 con 0x55f827f1d000 2024-09-13T17:24:10.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.458+0000 7f5324a5c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f827f3fef0 con 0x55f827f17f10 2024-09-13T17:24:10.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.458+0000 7f531b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f827f1be50 0x55f827f2fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.458+0000 7f531b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f827f1be50 0x55f827f2fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40764/0 (socket says 172.21.15.87:40764) 2024-09-13T17:24:10.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.458+0000 7f531b7fe640 1 -- 172.21.15.87:0/1905651136 learned_addr learned my addr 172.21.15.87:0/1905651136 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:10.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.458+0000 7f531affd640 1 --2- 172.21.15.87:0/1905651136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f827f1d000 0x55f827f2ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.458+0000 7f531affd640 1 --2- 172.21.15.87:0/1905651136 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f827f17f10 0x55f827f156a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.458+0000 7f531b7fe640 1 -- 172.21.15.87:0/1905651136 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f827f17f10 msgr2=0x55f827f156a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:10.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.458+0000 7f531b7fe640 1 --2- 172.21.15.87:0/1905651136 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f827f17f10 0x55f827f156a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.458+0000 7f531b7fe640 1 -- 172.21.15.87:0/1905651136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f827f1d000 msgr2=0x55f827f2ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:10.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.459+0000 7f531b7fe640 1 --2- 172.21.15.87:0/1905651136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f827f1d000 0x55f827f2ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.459+0000 7f531b7fe640 1 -- 172.21.15.87:0/1905651136 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f827e1d770 con 0x55f827f1be50 2024-09-13T17:24:10.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.459+0000 7f531b7fe640 1 --2- 172.21.15.87:0/1905651136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f827f1be50 0x55f827f2fa40 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f530c004810 tx=0x7f530c00bb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0cc59c2ad0442db server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:10.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.459+0000 7f53027fc640 1 -- 172.21.15.87:0/1905651136 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c00b500 con 0x55f827f1be50 2024-09-13T17:24:10.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.459+0000 7f53027fc640 1 -- 172.21.15.87:0/1905651136 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f530c00fe80 con 0x55f827f1be50 2024-09-13T17:24:10.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.459+0000 7f53027fc640 1 -- 172.21.15.87:0/1905651136 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c014bd0 con 0x55f827f1be50 2024-09-13T17:24:10.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.460+0000 7f5324a5c740 1 -- 172.21.15.87:0/1905651136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f827f1be50 msgr2=0x55f827f2fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:10.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.460+0000 7f5324a5c740 1 --2- 172.21.15.87:0/1905651136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f827f1be50 0x55f827f2fa40 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f530c004810 tx=0x7f530c00bb60 comp rx=0 tx=0).stop 2024-09-13T17:24:10.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.460+0000 7f5324a5c740 1 -- 172.21.15.87:0/1905651136 shutdown_connections 2024-09-13T17:24:10.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.460+0000 7f5324a5c740 1 --2- 172.21.15.87:0/1905651136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f827f1d000 0x55f827f2ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.460+0000 7f5324a5c740 1 --2- 172.21.15.87:0/1905651136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f827f1be50 0x55f827f2fa40 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.460+0000 7f5324a5c740 1 --2- 172.21.15.87:0/1905651136 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f827f17f10 0x55f827f156a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.460+0000 7f5324a5c740 1 -- 172.21.15.87:0/1905651136 >> 172.21.15.87:0/1905651136 conn(0x55f827f28210 msgr2=0x55f827f23da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:10.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.460+0000 7f5324a5c740 1 -- 172.21.15.87:0/1905651136 shutdown_connections 2024-09-13T17:24:10.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.460+0000 7f5324a5c740 1 -- 172.21.15.87:0/1905651136 wait complete. 2024-09-13T17:24:10.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.460+0000 7f5324a5c740 1 -- start start 2024-09-13T17:24:10.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.460+0000 7f5324a5c740 1 Processor -- start 2024-09-13T17:24:10.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.460+0000 7f5324a5c740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f827f17f10 0x55f827f2eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.460+0000 7f5324a5c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f827f1be50 0x55f827f2f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.460+0000 7f5324a5c740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f827f1d000 0x55f827f8edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.460+0000 7f5324a5c740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f827f2f830 con 0x55f827f17f10 2024-09-13T17:24:10.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.460+0000 7f5324a5c740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f827f8f310 con 0x55f827f1d000 2024-09-13T17:24:10.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.460+0000 7f5324a5c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f827f8f4d0 con 0x55f827f1be50 2024-09-13T17:24:10.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.461+0000 7f5324a5c740 10 client.0 _ll_register_callbacks cb 0x7f5310009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:24:10.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.461+0000 7f531affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f827f17f10 0x55f827f2eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.461+0000 7f531affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f827f17f10 0x55f827f2eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40780/0 (socket says 172.21.15.87:40780) 2024-09-13T17:24:10.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.461+0000 7f531affd640 1 -- 172.21.15.87:0/3979299577 learned_addr learned my addr 172.21.15.87:0/3979299577 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:10.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.461+0000 7f531affd640 1 --2- 172.21.15.87:0/3979299577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f827f1d000 0x55f827f8edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.461+0000 7f531affd640 1 -- 172.21.15.87:0/3979299577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f827f1be50 msgr2=0x55f827f2f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:10.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.461+0000 7f531affd640 1 --2- 172.21.15.87:0/3979299577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f827f1be50 0x55f827f2f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.461+0000 7f531affd640 1 -- 172.21.15.87:0/3979299577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f827f1d000 msgr2=0x55f827f8edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:10.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.461+0000 7f531affd640 1 --2- 172.21.15.87:0/3979299577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f827f1d000 0x55f827f8edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.461+0000 7f531affd640 1 -- 172.21.15.87:0/3979299577 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f827e7b3c0 con 0x55f827f17f10 2024-09-13T17:24:10.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.461+0000 7f531affd640 1 --2- 172.21.15.87:0/3979299577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f827f17f10 0x55f827f2eb90 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f5310033000 tx=0x7f5310031480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b43ba6fa9fca900 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:10.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.461+0000 7f52faffd640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:24:10.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.461+0000 7f52faffd640 1 -- 172.21.15.87:0/3979299577 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53100042c0 con 0x55f827f17f10 2024-09-13T17:24:10.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.461+0000 7f52faffd640 1 -- 172.21.15.87:0/3979299577 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 9644+0+0 (secure 0 0 0) 0x7f5310004420 con 0x55f827f17f10 2024-09-13T17:24:10.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.462+0000 7f5324a5c740 1 -- 172.21.15.87:0/3979299577 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5310005040 con 0x55f827f17f10 2024-09-13T17:24:10.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.462+0000 7f52faffd640 1 -- 172.21.15.87:0/3979299577 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5310059340 con 0x55f827f17f10 2024-09-13T17:24:10.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.462+0000 7f5324a5c740 10 client.18219 fetch_fsmap learned FSMap version 36 2024-09-13T17:24:10.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.462+0000 7f5324a5c740 1 -- 172.21.15.87:0/3979299577 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55f827e42e80 con 0x55f827f17f10 2024-09-13T17:24:10.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.463+0000 7f52faffd640 1 -- 172.21.15.87:0/3979299577 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f531005f070 con 0x55f827f17f10 2024-09-13T17:24:10.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.463+0000 7f52faffd640 1 -- 172.21.15.87:0/3979299577 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f5310032020 con 0x55f827f17f10 2024-09-13T17:24:10.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.463+0000 7f5324a5c740 10 client.18219 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:24:10.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.463+0000 7f5324a5c740 10 client.18219 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2024-09-13T17:24:10.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.463+0000 7f5324a5c740 20 client.18219 populate_metadata read hostname 'smithi087' 2024-09-13T17:24:10.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.463+0000 7f5324a5c740 1 --2- 172.21.15.87:0/3979299577 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55f827f28a10 0x55f827f928f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.463+0000 7f5324a5c740 4 client.18219 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:24:10.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.463+0000 7f5324a5c740 1 -- 172.21.15.87:0/3979299577 --> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7f5310005040 con 0x55f827f28a10 2024-09-13T17:24:10.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.463+0000 7f531b7fe640 1 --2- 172.21.15.87:0/3979299577 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55f827f28a10 0x55f827f928f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.464+0000 7f52faffd640 10 client.18219 ms_handle_connect on v2:172.21.15.149:6836/3893430053 2024-09-13T17:24:10.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.464+0000 7f531b7fe640 1 --2- 172.21.15.87:0/3979299577 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55f827f28a10 0x55f827f928f0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cd75472be75579f5 server_cookie=b0c1efd8d5ce223a in_seq=0 out_seq=0 2024-09-13T17:24:10.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.464+0000 7f52faffd640 1 -- 172.21.15.87:0/3979299577 <== mds.1 v2:172.21.15.149:6836/3893430053 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7f5310005040 con 0x55f827f28a10 2024-09-13T17:24:10.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.464+0000 7f52faffd640 10 client.18219 handle_command_reply: tid=0 2024-09-13T17:24:10.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.464+0000 7f5324a5c740 1 client.18219 shutdown 2024-09-13T17:24:10.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.464+0000 7f5324a5c740 1 -- 172.21.15.87:0/3979299577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f827f17f10 msgr2=0x55f827f2eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:10.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.464+0000 7f5324a5c740 1 --2- 172.21.15.87:0/3979299577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f827f17f10 0x55f827f2eb90 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f5310033000 tx=0x7f5310031480 comp rx=0 tx=0).stop 2024-09-13T17:24:10.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.464+0000 7f5324a5c740 1 -- 172.21.15.87:0/3979299577 shutdown_connections 2024-09-13T17:24:10.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.464+0000 7f5324a5c740 1 --2- 172.21.15.87:0/3979299577 >> [v2:172.21.15.149:6836/3893430053,v1:172.21.15.149:6837/3893430053] conn(0x55f827f28a10 0x55f827f928f0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.464+0000 7f5324a5c740 1 --2- 172.21.15.87:0/3979299577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f827f1d000 0x55f827f8edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.464+0000 7f5324a5c740 1 --2- 172.21.15.87:0/3979299577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f827f1be50 0x55f827f2f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.464+0000 7f5324a5c740 1 --2- 172.21.15.87:0/3979299577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f827f17f10 0x55f827f2eb90 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.464+0000 7f5324a5c740 1 -- 172.21.15.87:0/3979299577 >> 172.21.15.87:0/3979299577 conn(0x55f827f28210 msgr2=0x55f827f254f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:10.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.464+0000 7f52faffd640 0 client.18219 ms_handle_reset on v2:172.21.15.149:6836/3893430053 2024-09-13T17:24:10.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.464+0000 7f5324a5c740 1 -- 172.21.15.87:0/3979299577 shutdown_connections 2024-09-13T17:24:10.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.464+0000 7f5324a5c740 1 -- 172.21.15.87:0/3979299577 wait complete. 2024-09-13T17:24:10.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.465+0000 7f5324a5c740 20 client.18219 trim_cache size 0 max 16384 2024-09-13T17:24:10.472 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:24:10.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.465+0000 7f5321c5a640 1 -- 172.21.15.87:0/1225347298 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f53040a1200 msgr2=0x7f53040a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:10.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.465+0000 7f5321c5a640 1 --2- 172.21.15.87:0/1225347298 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f53040a1200 0x7f53040a36c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f53140ca2a0 tx=0x7f53140b9040 comp rx=0 tx=0).stop 2024-09-13T17:24:10.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.465+0000 7f5321c5a640 1 -- 172.21.15.87:0/1225347298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f531c199c00 msgr2=0x7f531c19a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:10.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.465+0000 7f5321c5a640 1 --2- 172.21.15.87:0/1225347298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f531c199c00 0x7f531c19a0b0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f531400b9e0 tx=0x7f531400bea0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.465+0000 7f5321c5a640 1 -- 172.21.15.87:0/1225347298 shutdown_connections 2024-09-13T17:24:10.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.465+0000 7f5321c5a640 1 --2- 172.21.15.87:0/1225347298 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f53040a1200 0x7f53040a36c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.465+0000 7f5321c5a640 1 --2- 172.21.15.87:0/1225347298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f531c199c00 0x7f531c19a0b0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.465+0000 7f5321c5a640 1 --2- 172.21.15.87:0/1225347298 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f531c103fb0 0x7f531c195810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.465+0000 7f5321c5a640 1 --2- 172.21.15.87:0/1225347298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f531c0fee60 0x7f531c1952d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.465+0000 7f5321c5a640 1 -- 172.21.15.87:0/1225347298 >> 172.21.15.87:0/1225347298 conn(0x7f531c075c60 msgr2=0x7f531c102300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:10.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.465+0000 7f5321c5a640 1 -- 172.21.15.87:0/1225347298 shutdown_connections 2024-09-13T17:24:10.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.465+0000 7f5321c5a640 1 -- 172.21.15.87:0/1225347298 wait complete. 2024-09-13T17:24:10.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:10 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/849814499' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:24:10.480 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-09-13T17:24:10.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.580+0000 7f24d4c9c640 1 -- 172.21.15.87:0/3706648846 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24d0103fb0 msgr2=0x7f24d010bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:10.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.580+0000 7f24d4c9c640 1 --2- 172.21.15.87:0/3706648846 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24d0103fb0 0x7f24d010bb00 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f24c8009cd0 tx=0x7f24c802a8e0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.581+0000 7f24d4c9c640 1 -- 172.21.15.87:0/3706648846 shutdown_connections 2024-09-13T17:24:10.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.581+0000 7f24d4c9c640 1 --2- 172.21.15.87:0/3706648846 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24d0103fb0 0x7f24d010bb00 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.581+0000 7f24d4c9c640 1 --2- 172.21.15.87:0/3706648846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24d00ff810 0x7f24d0103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.581+0000 7f24d4c9c640 1 --2- 172.21.15.87:0/3706648846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24d00fee60 0x7f24d00ff240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.581+0000 7f24d4c9c640 1 -- 172.21.15.87:0/3706648846 >> 172.21.15.87:0/3706648846 conn(0x7f24d0075c60 msgr2=0x7f24d00fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:10.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.581+0000 7f24d4c9c640 1 -- 172.21.15.87:0/3706648846 shutdown_connections 2024-09-13T17:24:10.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.581+0000 7f24d4c9c640 1 -- 172.21.15.87:0/3706648846 wait complete. 2024-09-13T17:24:10.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.581+0000 7f24d4c9c640 1 Processor -- start 2024-09-13T17:24:10.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.581+0000 7f24d4c9c640 1 -- start start 2024-09-13T17:24:10.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.582+0000 7f24d4c9c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24d00fee60 0x7f24d01962f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.582+0000 7f24d4c9c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24d0103fb0 0x7f24d0196830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.582+0000 7f24d4c9c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24d019ac20 0x7f24d019b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.582+0000 7f24d4c9c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d019b610 con 0x7f24d019ac20 2024-09-13T17:24:10.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.582+0000 7f24d4c9c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d019b780 con 0x7f24d00fee60 2024-09-13T17:24:10.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.582+0000 7f24d4c9c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d019b8f0 con 0x7f24d0103fb0 2024-09-13T17:24:10.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.582+0000 7f24ced9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24d019ac20 0x7f24d019b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.582+0000 7f24ced9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24d019ac20 0x7f24d019b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40804/0 (socket says 172.21.15.87:40804) 2024-09-13T17:24:10.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.582+0000 7f24ced9d640 1 -- 172.21.15.87:0/598851882 learned_addr learned my addr 172.21.15.87:0/598851882 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:10.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.582+0000 7f24cdd9b640 1 --2- 172.21.15.87:0/598851882 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24d0103fb0 0x7f24d0196830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.582+0000 7f24ce59c640 1 --2- 172.21.15.87:0/598851882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24d00fee60 0x7f24d01962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.582+0000 7f24ced9d640 1 -- 172.21.15.87:0/598851882 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24d0103fb0 msgr2=0x7f24d0196830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:10.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.582+0000 7f24ced9d640 1 --2- 172.21.15.87:0/598851882 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24d0103fb0 0x7f24d0196830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.582+0000 7f24ced9d640 1 -- 172.21.15.87:0/598851882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24d00fee60 msgr2=0x7f24d01962f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:10.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.582+0000 7f24ced9d640 1 --2- 172.21.15.87:0/598851882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24d00fee60 0x7f24d01962f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.582+0000 7f24ced9d640 1 -- 172.21.15.87:0/598851882 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c8009900 con 0x7f24d019ac20 2024-09-13T17:24:10.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.582+0000 7f24ced9d640 1 --2- 172.21.15.87:0/598851882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24d019ac20 0x7f24d019b0d0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f24c8005cc0 tx=0x7f24c8030850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:10.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.582+0000 7f24bf7fe640 1 -- 172.21.15.87:0/598851882 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c8031c80 con 0x7f24d019ac20 2024-09-13T17:24:10.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.582+0000 7f24d4c9c640 1 -- 172.21.15.87:0/598851882 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d01a2ed0 con 0x7f24d019ac20 2024-09-13T17:24:10.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.582+0000 7f24bf7fe640 1 -- 172.21.15.87:0/598851882 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f24c8003e20 con 0x7f24d019ac20 2024-09-13T17:24:10.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.582+0000 7f24bf7fe640 1 -- 172.21.15.87:0/598851882 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c8045410 con 0x7f24d019ac20 2024-09-13T17:24:10.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.582+0000 7f24d4c9c640 1 -- 172.21.15.87:0/598851882 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d01a3350 con 0x7f24d019ac20 2024-09-13T17:24:10.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.584+0000 7f24bf7fe640 1 -- 172.21.15.87:0/598851882 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f24c800a040 con 0x7f24d019ac20 2024-09-13T17:24:10.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.585+0000 7f24d79c3740 1 Processor -- start 2024-09-13T17:24:10.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.585+0000 7f24d79c3740 1 -- start start 2024-09-13T17:24:10.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.585+0000 7f24bf7fe640 1 --2- 172.21.15.87:0/598851882 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f24b80a1200 0x7f24b80a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.585+0000 7f24d79c3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c5d881f790 0x55c5d881fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.585+0000 7f24d79c3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c5d88200b0 0x55c5d882a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.585+0000 7f24d79c3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5d882a950 0x55c5d882cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.585+0000 7f24d79c3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5d8789cc0 con 0x55c5d88200b0 2024-09-13T17:24:10.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.585+0000 7f24d79c3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5d8787450 con 0x55c5d881f790 2024-09-13T17:24:10.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.585+0000 7f24d79c3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5d8782d40 con 0x55c5d882a950 2024-09-13T17:24:10.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.585+0000 7f24cdd9b640 1 --2- 172.21.15.87:0/598851882 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f24b80a1200 0x7f24b80a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.585+0000 7f24bf7fe640 1 -- 172.21.15.87:0/598851882 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 9644+0+0 (secure 0 0 0) 0x7f24c80ee8a0 con 0x7f24d019ac20 2024-09-13T17:24:10.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.585+0000 7f24cdd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c5d88200b0 0x55c5d882a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.585+0000 7f24ce59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c5d881f790 0x55c5d881fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.585+0000 7f24cdd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c5d88200b0 0x55c5d882a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40820/0 (socket says 172.21.15.87:40820) 2024-09-13T17:24:10.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.585+0000 7f24ce59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c5d881f790 0x55c5d881fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.87:41042/0 (socket says 172.21.15.87:41042) 2024-09-13T17:24:10.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.585+0000 7f24cdd9b640 1 -- 172.21.15.87:0/4251432110 learned_addr learned my addr 172.21.15.87:0/4251432110 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:10.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.586+0000 7f24ced9d640 1 --2- 172.21.15.87:0/4251432110 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5d882a950 0x55c5d882cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.586+0000 7f24cdd9b640 1 -- 172.21.15.87:0/4251432110 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5d882a950 msgr2=0x55c5d882cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:10.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.586+0000 7f24cdd9b640 1 --2- 172.21.15.87:0/4251432110 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5d882a950 0x55c5d882cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.586+0000 7f24cdd9b640 1 -- 172.21.15.87:0/4251432110 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c5d881f790 msgr2=0x55c5d881fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:10.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.586+0000 7f24cdd9b640 1 --2- 172.21.15.87:0/4251432110 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c5d881f790 0x55c5d881fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.586+0000 7f24cdd9b640 1 -- 172.21.15.87:0/4251432110 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c5d874a620 con 0x55c5d88200b0 2024-09-13T17:24:10.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.586+0000 7f24cdd9b640 1 --2- 172.21.15.87:0/598851882 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f24b80a1200 0x7f24b80a36c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f24c4012940 tx=0x7f24c400bb50 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:10.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.586+0000 7f24cdd9b640 1 --2- 172.21.15.87:0/4251432110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c5d88200b0 0x55c5d882a410 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f24c4012fd0 tx=0x7f24c401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c9d6e8ff551938 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:10.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.586+0000 7f24bcff9640 1 -- 172.21.15.87:0/4251432110 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c400bea0 con 0x55c5d88200b0 2024-09-13T17:24:10.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.586+0000 7f24bcff9640 1 -- 172.21.15.87:0/4251432110 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f24c4010e00 con 0x55c5d88200b0 2024-09-13T17:24:10.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.586+0000 7f24bcff9640 1 -- 172.21.15.87:0/4251432110 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c4004e00 con 0x55c5d88200b0 2024-09-13T17:24:10.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.587+0000 7f24d79c3740 1 -- 172.21.15.87:0/4251432110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c5d88200b0 msgr2=0x55c5d882a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:10.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.587+0000 7f24d79c3740 1 --2- 172.21.15.87:0/4251432110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c5d88200b0 0x55c5d882a410 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f24c4012fd0 tx=0x7f24c401c000 comp rx=0 tx=0).stop 2024-09-13T17:24:10.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.587+0000 7f24d79c3740 1 -- 172.21.15.87:0/4251432110 shutdown_connections 2024-09-13T17:24:10.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.587+0000 7f24d79c3740 1 --2- 172.21.15.87:0/4251432110 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5d882a950 0x55c5d882cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.587+0000 7f24d79c3740 1 --2- 172.21.15.87:0/4251432110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c5d88200b0 0x55c5d882a410 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.587+0000 7f24d79c3740 1 --2- 172.21.15.87:0/4251432110 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c5d881f790 0x55c5d881fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.587+0000 7f24d79c3740 1 -- 172.21.15.87:0/4251432110 >> 172.21.15.87:0/4251432110 conn(0x55c5d881bd00 msgr2=0x55c5d881c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:10.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.587+0000 7f24d79c3740 1 -- 172.21.15.87:0/4251432110 shutdown_connections 2024-09-13T17:24:10.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.587+0000 7f24d79c3740 1 -- 172.21.15.87:0/4251432110 wait complete. 2024-09-13T17:24:10.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.587+0000 7f24d79c3740 1 -- start start 2024-09-13T17:24:10.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.587+0000 7f24d79c3740 1 Processor -- start 2024-09-13T17:24:10.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.588+0000 7f24d79c3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5d881f790 0x55c5d8829f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.588+0000 7f24d79c3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c5d88200b0 0x55c5d8827220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.588+0000 7f24d79c3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c5d882a950 0x55c5d8827760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.588+0000 7f24d79c3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5d8741180 con 0x55c5d882a950 2024-09-13T17:24:10.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.588+0000 7f24d79c3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5d845b430 con 0x55c5d88200b0 2024-09-13T17:24:10.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.588+0000 7f24d79c3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5d87065e0 con 0x55c5d881f790 2024-09-13T17:24:10.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.588+0000 7f24d79c3740 10 client.0 _ll_register_callbacks cb 0x55c5d8772aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:24:10.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.588+0000 7f24ced9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c5d882a950 0x55c5d8827760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.588+0000 7f24ced9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c5d882a950 0x55c5d8827760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40834/0 (socket says 172.21.15.87:40834) 2024-09-13T17:24:10.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.588+0000 7f24ced9d640 1 -- 172.21.15.87:0/1204134599 learned_addr learned my addr 172.21.15.87:0/1204134599 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:10.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.588+0000 7f24cdd9b640 1 --2- 172.21.15.87:0/1204134599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c5d88200b0 0x55c5d8827220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.588+0000 7f24ce59c640 1 --2- 172.21.15.87:0/1204134599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5d881f790 0x55c5d8829f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.588+0000 7f24ced9d640 1 -- 172.21.15.87:0/1204134599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5d881f790 msgr2=0x55c5d8829f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:10.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.588+0000 7f24ced9d640 1 --2- 172.21.15.87:0/1204134599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5d881f790 0x55c5d8829f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.588+0000 7f24ced9d640 1 -- 172.21.15.87:0/1204134599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c5d88200b0 msgr2=0x55c5d8827220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:10.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.588+0000 7f24ced9d640 1 --2- 172.21.15.87:0/1204134599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c5d88200b0 0x55c5d8827220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.588+0000 7f24ced9d640 1 -- 172.21.15.87:0/1204134599 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c401a040 con 0x55c5d882a950 2024-09-13T17:24:10.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.588+0000 7f24ced9d640 1 --2- 172.21.15.87:0/1204134599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c5d882a950 0x55c5d8827760 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f24c8006010 tx=0x7f24c8004990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=506859e5242b8445 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:10.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.588+0000 7f24b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:24:10.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.588+0000 7f24b5ffb640 1 -- 172.21.15.87:0/1204134599 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c804d390 con 0x55c5d882a950 2024-09-13T17:24:10.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.588+0000 7f24b5ffb640 1 -- 172.21.15.87:0/1204134599 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 9644+0+0 (secure 0 0 0) 0x7f24c80bbce0 con 0x55c5d882a950 2024-09-13T17:24:10.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.588+0000 7f24d79c3740 1 -- 172.21.15.87:0/1204134599 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c5d87acb80 con 0x55c5d882a950 2024-09-13T17:24:10.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.588+0000 7f24b5ffb640 1 -- 172.21.15.87:0/1204134599 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24c80bb5e0 con 0x55c5d882a950 2024-09-13T17:24:10.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.588+0000 7f24d79c3740 10 client.18231 fetch_fsmap learned FSMap version 36 2024-09-13T17:24:10.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.588+0000 7f24d79c3740 1 -- 172.21.15.87:0/1204134599 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55c5d87813c0 con 0x55c5d882a950 2024-09-13T17:24:10.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.589+0000 7f24b5ffb640 1 -- 172.21.15.87:0/1204134599 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x55c5d87acb80 con 0x55c5d882a950 2024-09-13T17:24:10.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.589+0000 7f24b5ffb640 1 -- 172.21.15.87:0/1204134599 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f24c803a390 con 0x55c5d882a950 2024-09-13T17:24:10.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.589+0000 7f24d79c3740 10 client.18231 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:24:10.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.589+0000 7f24d79c3740 10 client.18231 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:24:10.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.589+0000 7f24d79c3740 20 client.18231 populate_metadata read hostname 'smithi087' 2024-09-13T17:24:10.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.589+0000 7f24d79c3740 1 --2- 172.21.15.87:0/1204134599 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55c5d8839ff0 0x55c5d883c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.589+0000 7f24d79c3740 4 client.18231 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:24:10.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.589+0000 7f24d79c3740 1 -- 172.21.15.87:0/1204134599 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c5d87751f0 con 0x55c5d8839ff0 2024-09-13T17:24:10.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.589+0000 7f24ce59c640 1 --2- 172.21.15.87:0/1204134599 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55c5d8839ff0 0x55c5d883c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.590+0000 7f24ce59c640 1 --2- 172.21.15.87:0/1204134599 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55c5d8839ff0 0x55c5d883c3e0 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef855d7afb66be61 server_cookie=84bbddd700d578d8 in_seq=0 out_seq=0 2024-09-13T17:24:10.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.590+0000 7f24b5ffb640 10 client.18231 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:24:10.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.590+0000 7f24b5ffb640 1 -- 172.21.15.87:0/1204134599 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55c5d87751f0 con 0x55c5d8839ff0 2024-09-13T17:24:10.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.590+0000 7f24b5ffb640 10 client.18231 handle_command_reply: tid=0 2024-09-13T17:24:10.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.590+0000 7f24d79c3740 1 client.18231 shutdown 2024-09-13T17:24:10.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.590+0000 7f24d79c3740 1 -- 172.21.15.87:0/1204134599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c5d882a950 msgr2=0x55c5d8827760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:10.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.590+0000 7f24d79c3740 1 --2- 172.21.15.87:0/1204134599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c5d882a950 0x55c5d8827760 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f24c8006010 tx=0x7f24c8004990 comp rx=0 tx=0).stop 2024-09-13T17:24:10.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.591+0000 7f24d79c3740 1 -- 172.21.15.87:0/1204134599 shutdown_connections 2024-09-13T17:24:10.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.591+0000 7f24d79c3740 1 --2- 172.21.15.87:0/1204134599 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55c5d8839ff0 0x55c5d883c3e0 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.591+0000 7f24d79c3740 1 --2- 172.21.15.87:0/1204134599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c5d882a950 0x55c5d8827760 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.591+0000 7f24d79c3740 1 --2- 172.21.15.87:0/1204134599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c5d88200b0 0x55c5d8827220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.591+0000 7f24d79c3740 1 --2- 172.21.15.87:0/1204134599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5d881f790 0x55c5d8829f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.591+0000 7f24b5ffb640 0 client.18231 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:24:10.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.591+0000 7f24d79c3740 1 -- 172.21.15.87:0/1204134599 >> 172.21.15.87:0/1204134599 conn(0x55c5d881bd00 msgr2=0x55c5d881aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:10.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.591+0000 7f24d79c3740 1 -- 172.21.15.87:0/1204134599 shutdown_connections 2024-09-13T17:24:10.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.591+0000 7f24d79c3740 1 -- 172.21.15.87:0/1204134599 wait complete. 2024-09-13T17:24:10.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.591+0000 7f24d79c3740 20 client.18231 trim_cache size 0 max 16384 2024-09-13T17:24:10.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.601+0000 7f24d79c3740 1 Processor -- start 2024-09-13T17:24:10.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.601+0000 7f24d79c3740 1 -- start start 2024-09-13T17:24:10.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.602+0000 7f24d79c3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c5d881f790 0x55c5d881b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.602+0000 7f24d79c3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c5d88200b0 0x55c5d8831a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.602+0000 7f24d79c3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5d882a950 0x55c5d88271e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.602+0000 7f24d79c3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5d88206d0 con 0x55c5d88200b0 2024-09-13T17:24:10.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.602+0000 7f24d79c3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5d8831f90 con 0x55c5d881f790 2024-09-13T17:24:10.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.602+0000 7f24d79c3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5d8839e20 con 0x55c5d882a950 2024-09-13T17:24:10.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.602+0000 7f24cdd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c5d88200b0 0x55c5d8831a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.602+0000 7f24cdd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c5d88200b0 0x55c5d8831a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40844/0 (socket says 172.21.15.87:40844) 2024-09-13T17:24:10.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.602+0000 7f24cdd9b640 1 -- 172.21.15.87:0/2219412611 learned_addr learned my addr 172.21.15.87:0/2219412611 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:10.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.602+0000 7f24ce59c640 1 --2- 172.21.15.87:0/2219412611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c5d881f790 0x55c5d881b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.602+0000 7f24cdd9b640 1 -- 172.21.15.87:0/2219412611 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5d882a950 msgr2=0x55c5d88271e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:10.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.602+0000 7f24cdd9b640 1 --2- 172.21.15.87:0/2219412611 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5d882a950 0x55c5d88271e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.602+0000 7f24cdd9b640 1 -- 172.21.15.87:0/2219412611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c5d881f790 msgr2=0x55c5d881b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:10.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.602+0000 7f24cdd9b640 1 --2- 172.21.15.87:0/2219412611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c5d881f790 0x55c5d881b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.602+0000 7f24cdd9b640 1 -- 172.21.15.87:0/2219412611 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c5d8723770 con 0x55c5d88200b0 2024-09-13T17:24:10.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.602+0000 7f24cdd9b640 1 --2- 172.21.15.87:0/2219412611 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c5d88200b0 0x55c5d8831a50 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x55c5d881cb60 tx=0x7f24c4014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ac2e75b98bc68b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:10.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.602+0000 7f24bd7fa640 1 -- 172.21.15.87:0/2219412611 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c4005e50 con 0x55c5d88200b0 2024-09-13T17:24:10.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.602+0000 7f24bd7fa640 1 -- 172.21.15.87:0/2219412611 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f24c4004680 con 0x55c5d88200b0 2024-09-13T17:24:10.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.602+0000 7f24bd7fa640 1 -- 172.21.15.87:0/2219412611 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c4020520 con 0x55c5d88200b0 2024-09-13T17:24:10.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.603+0000 7f24d79c3740 1 -- 172.21.15.87:0/2219412611 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c5d88200b0 msgr2=0x55c5d8831a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:10.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.603+0000 7f24d79c3740 1 --2- 172.21.15.87:0/2219412611 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c5d88200b0 0x55c5d8831a50 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x55c5d881cb60 tx=0x7f24c4014040 comp rx=0 tx=0).stop 2024-09-13T17:24:10.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.603+0000 7f24d79c3740 1 -- 172.21.15.87:0/2219412611 shutdown_connections 2024-09-13T17:24:10.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.603+0000 7f24d79c3740 1 --2- 172.21.15.87:0/2219412611 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5d882a950 0x55c5d88271e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.603+0000 7f24d79c3740 1 --2- 172.21.15.87:0/2219412611 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c5d88200b0 0x55c5d8831a50 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.603+0000 7f24d79c3740 1 --2- 172.21.15.87:0/2219412611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c5d881f790 0x55c5d881b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.603+0000 7f24d79c3740 1 -- 172.21.15.87:0/2219412611 >> 172.21.15.87:0/2219412611 conn(0x55c5d881bd00 msgr2=0x55c5d8840d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:10.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.603+0000 7f24d79c3740 1 -- 172.21.15.87:0/2219412611 shutdown_connections 2024-09-13T17:24:10.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.603+0000 7f24d79c3740 1 -- 172.21.15.87:0/2219412611 wait complete. 2024-09-13T17:24:10.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.603+0000 7f24d79c3740 1 -- start start 2024-09-13T17:24:10.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.603+0000 7f24d79c3740 1 Processor -- start 2024-09-13T17:24:10.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.604+0000 7f24d79c3740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c5d881f790 0x55c5d888e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.604+0000 7f24d79c3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5d88200b0 0x55c5d888e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.604+0000 7f24d79c3740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c5d882a950 0x55c5d8888440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.604+0000 7f24d79c3740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5d8888b40 con 0x55c5d881f790 2024-09-13T17:24:10.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.604+0000 7f24d79c3740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5d8888cb0 con 0x55c5d882a950 2024-09-13T17:24:10.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.604+0000 7f24d79c3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5d8888e70 con 0x55c5d88200b0 2024-09-13T17:24:10.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.604+0000 7f24d79c3740 10 client.0 _ll_register_callbacks cb 0x7f24c4012490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:24:10.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.604+0000 7f24ce59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c5d881f790 0x55c5d888e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.604+0000 7f24ce59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c5d881f790 0x55c5d888e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40858/0 (socket says 172.21.15.87:40858) 2024-09-13T17:24:10.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.604+0000 7f24ce59c640 1 -- 172.21.15.87:0/1089127059 learned_addr learned my addr 172.21.15.87:0/1089127059 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:10.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.604+0000 7f24cdd9b640 1 --2- 172.21.15.87:0/1089127059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5d88200b0 0x55c5d888e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.604+0000 7f24ce59c640 1 -- 172.21.15.87:0/1089127059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5d88200b0 msgr2=0x55c5d888e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:10.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.604+0000 7f24ce59c640 1 --2- 172.21.15.87:0/1089127059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5d88200b0 0x55c5d888e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.604+0000 7f24ce59c640 1 -- 172.21.15.87:0/1089127059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c5d882a950 msgr2=0x55c5d8888440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:24:10.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.604+0000 7f24ce59c640 1 --2- 172.21.15.87:0/1089127059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c5d882a950 0x55c5d8888440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.604+0000 7f24ce59c640 1 -- 172.21.15.87:0/1089127059 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c5d874a620 con 0x55c5d881f790 2024-09-13T17:24:10.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.604+0000 7f24ce59c640 1 --2- 172.21.15.87:0/1089127059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c5d881f790 0x55c5d888e000 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x55c5d883cc90 tx=0x7f24c001bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0d967f45f0cecc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:10.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.604+0000 7f24b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-09-13T17:24:10.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.604+0000 7f24b5ffb640 1 -- 172.21.15.87:0/1089127059 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c001b850 con 0x55c5d881f790 2024-09-13T17:24:10.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.604+0000 7f24b5ffb640 1 -- 172.21.15.87:0/1089127059 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 9644+0+0 (secure 0 0 0) 0x7f24c0015420 con 0x55c5d881f790 2024-09-13T17:24:10.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.604+0000 7f24d79c3740 1 -- 172.21.15.87:0/1089127059 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f24c4010e00 con 0x55c5d881f790 2024-09-13T17:24:10.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.604+0000 7f24b5ffb640 1 -- 172.21.15.87:0/1089127059 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24c00155e0 con 0x55c5d881f790 2024-09-13T17:24:10.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.604+0000 7f24d79c3740 10 client.18237 fetch_fsmap learned FSMap version 36 2024-09-13T17:24:10.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.604+0000 7f24d79c3740 1 -- 172.21.15.87:0/1089127059 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55c5d8748e80 con 0x55c5d881f790 2024-09-13T17:24:10.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.605+0000 7f24b5ffb640 1 -- 172.21.15.87:0/1089127059 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f24c4010e00 con 0x55c5d881f790 2024-09-13T17:24:10.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.605+0000 7f24b5ffb640 1 -- 172.21.15.87:0/1089127059 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 36) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f24c0025790 con 0x55c5d881f790 2024-09-13T17:24:10.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.605+0000 7f24d79c3740 10 client.18237 fetch_fsmap finished waiting for FSMap version 36 2024-09-13T17:24:10.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.605+0000 7f24d79c3740 10 client.18237 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-13T17:24:10.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.605+0000 7f24d79c3740 20 client.18237 populate_metadata read hostname 'smithi087' 2024-09-13T17:24:10.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.605+0000 7f24d79c3740 1 --2- 172.21.15.87:0/1089127059 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55c5d8895ee0 0x55c5d8898300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:10.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.605+0000 7f24d79c3740 4 client.18237 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T17:24:10.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.605+0000 7f24d79c3740 1 -- 172.21.15.87:0/1089127059 --> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c5d84764e0 con 0x55c5d8895ee0 2024-09-13T17:24:10.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.605+0000 7f24cdd9b640 1 --2- 172.21.15.87:0/1089127059 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55c5d8895ee0 0x55c5d8898300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:10.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.605+0000 7f24b5ffb640 10 client.18237 ms_handle_connect on v2:172.21.15.149:6838/2938961956 2024-09-13T17:24:10.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.605+0000 7f24cdd9b640 1 --2- 172.21.15.87:0/1089127059 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55c5d8895ee0 0x55c5d8898300 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2786a705d464c3ee server_cookie=fa87b6805da255c3 in_seq=0 out_seq=0 2024-09-13T17:24:10.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.605+0000 7f24b5ffb640 1 -- 172.21.15.87:0/1089127059 <== mds.0 v2:172.21.15.149:6838/2938961956 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c5d84764e0 con 0x55c5d8895ee0 2024-09-13T17:24:10.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.605+0000 7f24b5ffb640 10 client.18237 handle_command_reply: tid=0 2024-09-13T17:24:10.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.605+0000 7f24d79c3740 1 client.18237 shutdown 2024-09-13T17:24:10.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.606+0000 7f24d79c3740 1 -- 172.21.15.87:0/1089127059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c5d881f790 msgr2=0x55c5d888e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:10.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.606+0000 7f24d79c3740 1 --2- 172.21.15.87:0/1089127059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c5d881f790 0x55c5d888e000 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x55c5d883cc90 tx=0x7f24c001bed0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.606+0000 7f24d79c3740 1 -- 172.21.15.87:0/1089127059 shutdown_connections 2024-09-13T17:24:10.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.606+0000 7f24d79c3740 1 --2- 172.21.15.87:0/1089127059 >> [v2:172.21.15.149:6838/2938961956,v1:172.21.15.149:6839/2938961956] conn(0x55c5d8895ee0 0x55c5d8898300 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.606+0000 7f24d79c3740 1 --2- 172.21.15.87:0/1089127059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c5d882a950 0x55c5d8888440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.606+0000 7f24d79c3740 1 --2- 172.21.15.87:0/1089127059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5d88200b0 0x55c5d888e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.606+0000 7f24b5ffb640 0 client.18237 ms_handle_reset on v2:172.21.15.149:6838/2938961956 2024-09-13T17:24:10.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.606+0000 7f24d79c3740 1 --2- 172.21.15.87:0/1089127059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c5d881f790 0x55c5d888e000 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.606+0000 7f24d79c3740 1 -- 172.21.15.87:0/1089127059 >> 172.21.15.87:0/1089127059 conn(0x55c5d881bd00 msgr2=0x55c5d8836120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:10.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.606+0000 7f24d79c3740 1 -- 172.21.15.87:0/1089127059 shutdown_connections 2024-09-13T17:24:10.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.606+0000 7f24d79c3740 1 -- 172.21.15.87:0/1089127059 wait complete. 2024-09-13T17:24:10.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.606+0000 7f24d79c3740 20 client.18237 trim_cache size 0 max 16384 2024-09-13T17:24:10.615 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2024-09-13T17:24:10.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.606+0000 7f24d4c9c640 1 -- 172.21.15.87:0/598851882 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f24b80a1200 msgr2=0x7f24b80a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:10.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.606+0000 7f24d4c9c640 1 --2- 172.21.15.87:0/598851882 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f24b80a1200 0x7f24b80a36c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f24c4012940 tx=0x7f24c400bb50 comp rx=0 tx=0).stop 2024-09-13T17:24:10.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.606+0000 7f24d4c9c640 1 -- 172.21.15.87:0/598851882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24d019ac20 msgr2=0x7f24d019b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:10.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.606+0000 7f24d4c9c640 1 --2- 172.21.15.87:0/598851882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24d019ac20 0x7f24d019b0d0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f24c8005cc0 tx=0x7f24c8030850 comp rx=0 tx=0).stop 2024-09-13T17:24:10.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.606+0000 7f24d4c9c640 1 -- 172.21.15.87:0/598851882 shutdown_connections 2024-09-13T17:24:10.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.606+0000 7f24d4c9c640 1 --2- 172.21.15.87:0/598851882 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f24b80a1200 0x7f24b80a36c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.606+0000 7f24d4c9c640 1 --2- 172.21.15.87:0/598851882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24d019ac20 0x7f24d019b0d0 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.606+0000 7f24d4c9c640 1 --2- 172.21.15.87:0/598851882 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24d0103fb0 0x7f24d0196830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.606+0000 7f24d4c9c640 1 --2- 172.21.15.87:0/598851882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24d00fee60 0x7f24d01962f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:10.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.606+0000 7f24d4c9c640 1 -- 172.21.15.87:0/598851882 >> 172.21.15.87:0/598851882 conn(0x7f24d0075c60 msgr2=0x7f24d00fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:10.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.606+0000 7f24d4c9c640 1 -- 172.21.15.87:0/598851882 shutdown_connections 2024-09-13T17:24:10.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:10.606+0000 7f24d4c9c640 1 -- 172.21.15.87:0/598851882 wait complete. 2024-09-13T17:24:10.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:10 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/849814499' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:24:10.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:10 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/849814499' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:24:11.618 INFO:tasks.fwd_scrub.fs.[cephfs]:end scrubbing fs: cephfs 2024-09-13T17:24:11.619 INFO:tasks.fwd_scrub:done joining 2024-09-13T17:24:11.619 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-13T17:24:11.630 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:24:11.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:11 smithi087 ceph-mon[30934]: pgmap v321: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-13T17:24:11.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:11 smithi087 ceph-mon[30934]: osdmap e103: 12 total, 12 up, 12 in 2024-09-13T17:24:11.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.733+0000 7f9949553640 1 -- 172.21.15.87:0/4057135709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99440ff830 msgr2=0x7f9944103870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:11.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.734+0000 7f9949553640 1 --2- 172.21.15.87:0/4057135709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99440ff830 0x7f9944103870 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f992c009930 tx=0x7f992c02a420 comp rx=0 tx=0).stop 2024-09-13T17:24:11.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.734+0000 7f9949553640 1 -- 172.21.15.87:0/4057135709 shutdown_connections 2024-09-13T17:24:11.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.734+0000 7f9949553640 1 --2- 172.21.15.87:0/4057135709 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9944103fd0 0x7f994410bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:11.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.734+0000 7f9949553640 1 --2- 172.21.15.87:0/4057135709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99440ff830 0x7f9944103870 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:11.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.734+0000 7f9949553640 1 --2- 172.21.15.87:0/4057135709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99440fee80 0x7f99440ff260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:11.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.734+0000 7f9949553640 1 -- 172.21.15.87:0/4057135709 >> 172.21.15.87:0/4057135709 conn(0x7f9944075c60 msgr2=0x7f99440fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:11.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.734+0000 7f9949553640 1 -- 172.21.15.87:0/4057135709 shutdown_connections 2024-09-13T17:24:11.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.734+0000 7f9949553640 1 -- 172.21.15.87:0/4057135709 wait complete. 2024-09-13T17:24:11.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.734+0000 7f9949553640 1 Processor -- start 2024-09-13T17:24:11.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.734+0000 7f9949553640 1 -- start start 2024-09-13T17:24:11.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.734+0000 7f9949553640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99440fee80 0x7f9944197070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:11.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.734+0000 7f9949553640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9944103fd0 0x7f99441975b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:11.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.735+0000 7f9949553640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9944197b90 0x7f99441a20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:11.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.735+0000 7f9949553640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99441a2830 con 0x7f99440fee80 2024-09-13T17:24:11.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.735+0000 7f9949553640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99441a29a0 con 0x7f9944197b90 2024-09-13T17:24:11.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.735+0000 7f9949553640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99441a2b60 con 0x7f9944103fd0 2024-09-13T17:24:11.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.735+0000 7f9942ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99440fee80 0x7f9944197070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:11.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.735+0000 7f9942ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99440fee80 0x7f9944197070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40866/0 (socket says 172.21.15.87:40866) 2024-09-13T17:24:11.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.735+0000 7f9942ffd640 1 -- 172.21.15.87:0/1915320884 learned_addr learned my addr 172.21.15.87:0/1915320884 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:11.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.735+0000 7f993a7fc640 1 --2- 172.21.15.87:0/1915320884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9944103fd0 0x7f99441975b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:11.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.735+0000 7f99437fe640 1 --2- 172.21.15.87:0/1915320884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9944197b90 0x7f99441a20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:11.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.735+0000 7f9942ffd640 1 -- 172.21.15.87:0/1915320884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9944103fd0 msgr2=0x7f99441975b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:11.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.735+0000 7f9942ffd640 1 --2- 172.21.15.87:0/1915320884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9944103fd0 0x7f99441975b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:11.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.735+0000 7f9942ffd640 1 -- 172.21.15.87:0/1915320884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9944197b90 msgr2=0x7f99441a20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:11.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.735+0000 7f9942ffd640 1 --2- 172.21.15.87:0/1915320884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9944197b90 0x7f99441a20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:11.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.735+0000 7f9942ffd640 1 -- 172.21.15.87:0/1915320884 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992c009560 con 0x7f99440fee80 2024-09-13T17:24:11.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.735+0000 7f99437fe640 1 --2- 172.21.15.87:0/1915320884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9944197b90 0x7f99441a20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:11.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.735+0000 7f9942ffd640 1 --2- 172.21.15.87:0/1915320884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99440fee80 0x7f9944197070 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f993400c920 tx=0x7f993400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:11.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.735+0000 7f9940ff9640 1 -- 172.21.15.87:0/1915320884 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9934007c70 con 0x7f99440fee80 2024-09-13T17:24:11.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.735+0000 7f9940ff9640 1 -- 172.21.15.87:0/1915320884 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9934007dd0 con 0x7f99440fee80 2024-09-13T17:24:11.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.735+0000 7f9949553640 1 -- 172.21.15.87:0/1915320884 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99441a2e40 con 0x7f99440fee80 2024-09-13T17:24:11.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.735+0000 7f9940ff9640 1 -- 172.21.15.87:0/1915320884 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99340187c0 con 0x7f99440fee80 2024-09-13T17:24:11.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.735+0000 7f9949553640 1 -- 172.21.15.87:0/1915320884 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99441a3260 con 0x7f99440fee80 2024-09-13T17:24:11.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.736+0000 7f9949553640 1 -- 172.21.15.87:0/1915320884 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9944100350 con 0x7f99440fee80 2024-09-13T17:24:11.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.737+0000 7f9940ff9640 1 -- 172.21.15.87:0/1915320884 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f993400f450 con 0x7f99440fee80 2024-09-13T17:24:11.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.738+0000 7f9940ff9640 1 --2- 172.21.15.87:0/1915320884 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f99300a1280 0x7f99300a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:11.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.739+0000 7f993a7fc640 1 --2- 172.21.15.87:0/1915320884 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f99300a1280 0x7f99300a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:11.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.739+0000 7f9940ff9640 1 -- 172.21.15.87:0/1915320884 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 9644+0+0 (secure 0 0 0) 0x7f99340cd250 con 0x7f99440fee80 2024-09-13T17:24:11.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.739+0000 7f993a7fc640 1 --2- 172.21.15.87:0/1915320884 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f99300a1280 0x7f99300a3740 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f992c009900 tx=0x7f992c005a20 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:11.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.742+0000 7f9940ff9640 1 -- 172.21.15.87:0/1915320884 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9934096240 con 0x7f99440fee80 2024-09-13T17:24:11.764 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:11 smithi118 ceph-mon[34374]: pgmap v321: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-13T17:24:11.764 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:11 smithi118 ceph-mon[34374]: osdmap e103: 12 total, 12 up, 12 in 2024-09-13T17:24:11.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:11 smithi149 ceph-mon[35496]: pgmap v321: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-13T17:24:11.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:11 smithi149 ceph-mon[35496]: osdmap e103: 12 total, 12 up, 12 in 2024-09-13T17:24:11.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.904+0000 7f9949553640 1 -- 172.21.15.87:0/1915320884 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99440ff260 con 0x7f99440fee80 2024-09-13T17:24:11.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.905+0000 7f9940ff9640 1 -- 172.21.15.87:0/1915320884 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+25513 (secure 0 0 0) 0x7f9934099860 con 0x7f99440fee80 2024-09-13T17:24:11.907 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:24:11.907 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":103,"fsid":"043d5bae-71f2-11ef-bceb-c7b262605968","created":"2024-09-13T17:03:57.852010+0000","modified":"2024-09-13T17:24:10.436205+0000","last_up_change":"2024-09-13T17:10:34.423548+0000","last_in_change":"2024-09-13T17:10:14.228123+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:07:02.286400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:11:21.965141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:11:22.504345+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":103,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:11:25.565163+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":103,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58250283-85c0-416e-abdd-1fc5a7ff0c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6803","nonce":1316956138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6805","nonce":1316956138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6809","nonce":1316956138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6807","nonce":1316956138}]},"public_addr":"172.21.15.87:6803/1316956138","cluster_addr":"172.21.15.87:6805/1316956138","heartbeat_back_addr":"172.21.15.87:6809/1316956138","heartbeat_front_addr":"172.21.15.87:6807/1316956138","state":["exists","up"]},{"osd":1,"uuid":"b9d49969-94b1-4262-b4ff-db0a8e3331af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6801","nonce":3352566727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6803","nonce":3352566727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6807","nonce":3352566727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6805","nonce":3352566727}]},"public_addr":"172.21.15.118:6801/3352566727","cluster_addr":"172.21.15.118:6803/3352566727","heartbeat_back_addr":"172.21.15.118:6807/3352566727","heartbeat_front_addr":"172.21.15.118:6805/3352566727","state":["exists","up"]},{"osd":2,"uuid":"ba64549e-d736-426f-b466-f569af5f16d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6801","nonce":2774581686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6803","nonce":2774581686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6807","nonce":2774581686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6805","nonce":2774581686}]},"public_addr":"172.21.15.149:6801/2774581686","cluster_addr":"172.21.15.149:6803/2774581686","heartbeat_back_addr":"172.21.15.149:6807/2774581686","heartbeat_front_addr":"172.21.15.149:6805/2774581686","state":["exists","up"]},{"osd":3,"uuid":"3d5553e5-371b-49fd-976b-9e72a97a2f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6811","nonce":3306119066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6813","nonce":3306119066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6817","nonce":3306119066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6815","nonce":3306119066}]},"public_addr":"172.21.15.87:6811/3306119066","cluster_addr":"172.21.15.87:6813/3306119066","heartbeat_back_addr":"172.21.15.87:6817/3306119066","heartbeat_front_addr":"172.21.15.87:6815/3306119066","state":["exists","up"]},{"osd":4,"uuid":"2fbe0e27-34ec-42a6-9962-f1d8202b3159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6809","nonce":3342349890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6811","nonce":3342349890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6815","nonce":3342349890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6813","nonce":3342349890}]},"public_addr":"172.21.15.118:6809/3342349890","cluster_addr":"172.21.15.118:6811/3342349890","heartbeat_back_addr":"172.21.15.118:6815/3342349890","heartbeat_front_addr":"172.21.15.118:6813/3342349890","state":["exists","up"]},{"osd":5,"uuid":"53c14519-6170-4b5a-a79d-4835882d7bec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6809","nonce":3468867124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6811","nonce":3468867124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6815","nonce":3468867124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6813","nonce":3468867124}]},"public_addr":"172.21.15.149:6809/3468867124","cluster_addr":"172.21.15.149:6811/3468867124","heartbeat_back_addr":"172.21.15.149:6815/3468867124","heartbeat_front_addr":"172.21.15.149:6813/3468867124","state":["exists","up"]},{"osd":6,"uuid":"d3951b32-db77-4b8b-9de0-f05e03d13f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6819","nonce":326563617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6821","nonce":326563617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6825","nonce":326563617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6823","nonce":326563617}]},"public_addr":"172.21.15.87:6819/326563617","cluster_addr":"172.21.15.87:6821/326563617","heartbeat_back_addr":"172.21.15.87:6825/326563617","heartbeat_front_addr":"172.21.15.87:6823/326563617","state":["exists","up"]},{"osd":7,"uuid":"4d46dab7-a8bf-4e3e-b5c0-43860d336bdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6817","nonce":1690268990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6819","nonce":1690268990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6823","nonce":1690268990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6821","nonce":1690268990}]},"public_addr":"172.21.15.118:6817/1690268990","cluster_addr":"172.21.15.118:6819/1690268990","heartbeat_back_addr":"172.21.15.118:6823/1690268990","heartbeat_front_addr":"172.21.15.118:6821/1690268990","state":["exists","up"]},{"osd":8,"uuid":"5a015a7d-60a3-4412-96af-1b61d2ad51f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6817","nonce":1558675380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6819","nonce":1558675380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6823","nonce":1558675380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6821","nonce":1558675380}]},"public_addr":"172.21.15.149:6817/1558675380","cluster_addr":"172.21.15.149:6819/1558675380","heartbeat_back_addr":"172.21.15.149:6823/1558675380","heartbeat_front_addr":"172.21.15.149:6821/1558675380","state":["exists","up"]},{"osd":9,"uuid":"248c0b6e-4c4e-4c63-a0dd-e4cdf3b997a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6827","nonce":1453934262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6829","nonce":1453934262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6833","nonce":1453934262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6831","nonce":1453934262}]},"public_addr":"172.21.15.87:6827/1453934262","cluster_addr":"172.21.15.87:6829/1453934262","heartbeat_back_addr":"172.21.15.87:6833/1453934262","heartbeat_front_addr":"172.21.15.87:6831/1453934262","state":["exists","up"]},{"osd":10,"uuid":"24238714-e737-4371-b5d5-0cd3395f09bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6825","nonce":1034318850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6827","nonce":1034318850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6831","nonce":1034318850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6829","nonce":1034318850}]},"public_addr":"172.21.15.118:6825/1034318850","cluster_addr":"172.21.15.118:6827/1034318850","heartbeat_back_addr":"172.21.15.118:6831/1034318850","heartbeat_front_addr":"172.21.15.118:6829/1034318850","state":["exists","up"]},{"osd":11,"uuid":"409dd3bf-5154-4dea-8708-7de7f9e2e793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6825","nonce":271000465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6827","nonce":271000465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6831","nonce":271000465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6829","nonce":271000465}]},"public_addr":"172.21.15.149:6825/271000465","cluster_addr":"172.21.15.149:6827/271000465","heartbeat_back_addr":"172.21.15.149:6831/271000465","heartbeat_front_addr":"172.21.15.149:6829/271000465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:16.382664+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:37.914250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:00.425876+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:23.960183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:47.004088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:10.214345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:33.719221+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:57.099599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:20.971881+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:44.827167+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:08.135516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:32.085853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.d","mappings":[{"from":1,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8},{"from":5,"to":7}]},{"pgid":"3.28","mappings":[{"from":3,"to":6},{"from":5,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/718653925":"2024-09-14T17:13:49.377087+0000","172.21.15.87:0/3081317043":"2024-09-14T17:13:49.377087+0000","172.21.15.87:0/1633498542":"2024-09-14T17:13:49.377087+0000","172.21.15.87:6801/1587363880":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/3403361612":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/553289143":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/1475107314":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/515676743":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/3270371628":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6800/1587363880":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6800/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6801/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/2612130442":"2024-09-14T17:13:49.377087+0000","172.21.15.87:0/586423689":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6800/701043027":"2024-09-14T17:13:49.377087+0000","172.21.15.87:6801/701043027":"2024-09-14T17:13:49.377087+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]},{"pool":4,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]},{"pool":4,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:24:11.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.907+0000 7f9949553640 1 -- 172.21.15.87:0/1915320884 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f99300a1280 msgr2=0x7f99300a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:11.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.907+0000 7f9949553640 1 --2- 172.21.15.87:0/1915320884 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f99300a1280 0x7f99300a3740 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f992c009900 tx=0x7f992c005a20 comp rx=0 tx=0).stop 2024-09-13T17:24:11.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.907+0000 7f9949553640 1 -- 172.21.15.87:0/1915320884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99440fee80 msgr2=0x7f9944197070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:11.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.907+0000 7f9949553640 1 --2- 172.21.15.87:0/1915320884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99440fee80 0x7f9944197070 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f993400c920 tx=0x7f993400cde0 comp rx=0 tx=0).stop 2024-09-13T17:24:11.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.907+0000 7f9949553640 1 -- 172.21.15.87:0/1915320884 shutdown_connections 2024-09-13T17:24:11.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.907+0000 7f9949553640 1 --2- 172.21.15.87:0/1915320884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9944197b90 0x7f99441a20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:11.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.907+0000 7f9949553640 1 --2- 172.21.15.87:0/1915320884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9944103fd0 0x7f99441975b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:11.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.907+0000 7f9949553640 1 --2- 172.21.15.87:0/1915320884 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f99300a1280 0x7f99300a3740 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:11.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.907+0000 7f9949553640 1 --2- 172.21.15.87:0/1915320884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99440fee80 0x7f9944197070 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:11.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.907+0000 7f9949553640 1 -- 172.21.15.87:0/1915320884 >> 172.21.15.87:0/1915320884 conn(0x7f9944075c60 msgr2=0x7f99440fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:11.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.907+0000 7f9949553640 1 -- 172.21.15.87:0/1915320884 shutdown_connections 2024-09-13T17:24:11.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:11.907+0000 7f9949553640 1 -- 172.21.15.87:0/1915320884 wait complete. 2024-09-13T17:24:11.919 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:07:02.286400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:11:21.965141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:11:22.504345+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 103, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:11:25.565163+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 103, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:24:11.920 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:24:12.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.020+0000 7fd283487640 1 -- 172.21.15.87:0/1138761289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd27c103fa0 msgr2=0x7fd27c10baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:12.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.020+0000 7fd283487640 1 --2- 172.21.15.87:0/1138761289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd27c103fa0 0x7fd27c10baf0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fd274009cd0 tx=0x7fd27402a8e0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.020+0000 7fd283487640 1 -- 172.21.15.87:0/1138761289 shutdown_connections 2024-09-13T17:24:12.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.020+0000 7fd283487640 1 --2- 172.21.15.87:0/1138761289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd27c103fa0 0x7fd27c10baf0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.020+0000 7fd283487640 1 --2- 172.21.15.87:0/1138761289 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd27c0ff800 0x7fd27c103840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.020+0000 7fd283487640 1 --2- 172.21.15.87:0/1138761289 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd27c0fee50 0x7fd27c0ff230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.020+0000 7fd283487640 1 -- 172.21.15.87:0/1138761289 >> 172.21.15.87:0/1138761289 conn(0x7fd27c0fa8c0 msgr2=0x7fd27c0fcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:12.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.020+0000 7fd283487640 1 -- 172.21.15.87:0/1138761289 shutdown_connections 2024-09-13T17:24:12.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.020+0000 7fd283487640 1 -- 172.21.15.87:0/1138761289 wait complete. 2024-09-13T17:24:12.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.021+0000 7fd283487640 1 Processor -- start 2024-09-13T17:24:12.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.021+0000 7fd283487640 1 -- start start 2024-09-13T17:24:12.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.021+0000 7fd283487640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd27c0fee50 0x7fd27c196270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:12.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.021+0000 7fd283487640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd27c103fa0 0x7fd27c1967b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:12.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.021+0000 7fd283487640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd27c19aba0 0x7fd27c19b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:12.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.021+0000 7fd283487640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c19b590 con 0x7fd27c0fee50 2024-09-13T17:24:12.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.021+0000 7fd283487640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c19b700 con 0x7fd27c19aba0 2024-09-13T17:24:12.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.021+0000 7fd283487640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c19b870 con 0x7fd27c103fa0 2024-09-13T17:24:12.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.021+0000 7fd281223640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd27c0fee50 0x7fd27c196270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:12.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.021+0000 7fd281223640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd27c0fee50 0x7fd27c196270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40876/0 (socket says 172.21.15.87:40876) 2024-09-13T17:24:12.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.021+0000 7fd281223640 1 -- 172.21.15.87:0/213893324 learned_addr learned my addr 172.21.15.87:0/213893324 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:12.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.021+0000 7fd281a24640 1 --2- 172.21.15.87:0/213893324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd27c19aba0 0x7fd27c19b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:12.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.021+0000 7fd280a22640 1 --2- 172.21.15.87:0/213893324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd27c103fa0 0x7fd27c1967b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:12.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.021+0000 7fd281223640 1 -- 172.21.15.87:0/213893324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd27c103fa0 msgr2=0x7fd27c1967b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:12.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.021+0000 7fd281223640 1 --2- 172.21.15.87:0/213893324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd27c103fa0 0x7fd27c1967b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.021+0000 7fd281223640 1 -- 172.21.15.87:0/213893324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd27c19aba0 msgr2=0x7fd27c19b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:12.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.021+0000 7fd281223640 1 --2- 172.21.15.87:0/213893324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd27c19aba0 0x7fd27c19b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.021+0000 7fd281223640 1 -- 172.21.15.87:0/213893324 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd274009900 con 0x7fd27c0fee50 2024-09-13T17:24:12.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.021+0000 7fd280a22640 1 --2- 172.21.15.87:0/213893324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd27c103fa0 0x7fd27c1967b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:12.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.021+0000 7fd281223640 1 --2- 172.21.15.87:0/213893324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd27c0fee50 0x7fd27c196270 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fd27800c970 tx=0x7fd27800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:12.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.022+0000 7fd2727fc640 1 -- 172.21.15.87:0/213893324 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd278007bb0 con 0x7fd27c0fee50 2024-09-13T17:24:12.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.022+0000 7fd2727fc640 1 -- 172.21.15.87:0/213893324 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd278007d10 con 0x7fd27c0fee50 2024-09-13T17:24:12.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.022+0000 7fd283487640 1 -- 172.21.15.87:0/213893324 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd27c1a2e50 con 0x7fd27c0fee50 2024-09-13T17:24:12.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.022+0000 7fd2727fc640 1 -- 172.21.15.87:0/213893324 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd278004e80 con 0x7fd27c0fee50 2024-09-13T17:24:12.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.022+0000 7fd283487640 1 -- 172.21.15.87:0/213893324 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd27c1a3220 con 0x7fd27c0fee50 2024-09-13T17:24:12.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.023+0000 7fd283487640 1 -- 172.21.15.87:0/213893324 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd27c100320 con 0x7fd27c0fee50 2024-09-13T17:24:12.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.024+0000 7fd2727fc640 1 -- 172.21.15.87:0/213893324 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fd278005020 con 0x7fd27c0fee50 2024-09-13T17:24:12.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.024+0000 7fd2727fc640 1 --2- 172.21.15.87:0/213893324 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd2680a1200 0x7fd2680a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:12.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.024+0000 7fd280a22640 1 --2- 172.21.15.87:0/213893324 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd2680a1200 0x7fd2680a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:12.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.024+0000 7fd2727fc640 1 -- 172.21.15.87:0/213893324 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 9644+0+0 (secure 0 0 0) 0x7fd2780ccf20 con 0x7fd27c0fee50 2024-09-13T17:24:12.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.025+0000 7fd280a22640 1 --2- 172.21.15.87:0/213893324 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd2680a1200 0x7fd2680a36c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd27c197810 tx=0x7fd26c0094b0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:12.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.028+0000 7fd2727fc640 1 -- 172.21.15.87:0/213893324 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd278095f10 con 0x7fd27c0fee50 2024-09-13T17:24:12.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.189+0000 7fd283487640 1 -- 172.21.15.87:0/213893324 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd27c1975c0 con 0x7fd27c0fee50 2024-09-13T17:24:12.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.190+0000 7fd2727fc640 1 -- 172.21.15.87:0/213893324 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v103) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd27801d0a0 con 0x7fd27c0fee50 2024-09-13T17:24:12.191 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-09-13T17:24:12.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.191+0000 7fd283487640 1 -- 172.21.15.87:0/213893324 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd2680a1200 msgr2=0x7fd2680a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:12.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.191+0000 7fd283487640 1 --2- 172.21.15.87:0/213893324 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd2680a1200 0x7fd2680a36c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd27c197810 tx=0x7fd26c0094b0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.191+0000 7fd283487640 1 -- 172.21.15.87:0/213893324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd27c0fee50 msgr2=0x7fd27c196270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:12.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.191+0000 7fd283487640 1 --2- 172.21.15.87:0/213893324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd27c0fee50 0x7fd27c196270 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fd27800c970 tx=0x7fd27800ce30 comp rx=0 tx=0).stop 2024-09-13T17:24:12.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.192+0000 7fd283487640 1 -- 172.21.15.87:0/213893324 shutdown_connections 2024-09-13T17:24:12.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.192+0000 7fd283487640 1 --2- 172.21.15.87:0/213893324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd27c19aba0 0x7fd27c19b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.192+0000 7fd283487640 1 --2- 172.21.15.87:0/213893324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd27c103fa0 0x7fd27c1967b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.192+0000 7fd283487640 1 --2- 172.21.15.87:0/213893324 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fd2680a1200 0x7fd2680a36c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.192+0000 7fd283487640 1 --2- 172.21.15.87:0/213893324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd27c0fee50 0x7fd27c196270 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.192+0000 7fd283487640 1 -- 172.21.15.87:0/213893324 >> 172.21.15.87:0/213893324 conn(0x7fd27c0fa8c0 msgr2=0x7fd27c0688b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:12.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.192+0000 7fd283487640 1 -- 172.21.15.87:0/213893324 shutdown_connections 2024-09-13T17:24:12.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.192+0000 7fd283487640 1 -- 172.21.15.87:0/213893324 wait complete. 2024-09-13T17:24:12.203 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:24:12.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.304+0000 7efbfc8e5640 1 -- 172.21.15.87:0/3749834580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efbf80feb80 msgr2=0x7efbf80fef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:12.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.304+0000 7efbfc8e5640 1 --2- 172.21.15.87:0/3749834580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efbf80feb80 0x7efbf80fef60 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7efbe8009900 tx=0x7efbe802a400 comp rx=0 tx=0).stop 2024-09-13T17:24:12.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.304+0000 7efbfc8e5640 1 -- 172.21.15.87:0/3749834580 shutdown_connections 2024-09-13T17:24:12.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.304+0000 7efbfc8e5640 1 --2- 172.21.15.87:0/3749834580 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efbf8103840 0x7efbf810b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.304+0000 7efbfc8e5640 1 --2- 172.21.15.87:0/3749834580 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efbf80ff530 0x7efbf8103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.304+0000 7efbfc8e5640 1 --2- 172.21.15.87:0/3749834580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efbf80feb80 0x7efbf80fef60 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.304+0000 7efbfc8e5640 1 -- 172.21.15.87:0/3749834580 >> 172.21.15.87:0/3749834580 conn(0x7efbf8074110 msgr2=0x7efbf8074520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:12.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.304+0000 7efbfc8e5640 1 -- 172.21.15.87:0/3749834580 shutdown_connections 2024-09-13T17:24:12.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.304+0000 7efbfc8e5640 1 -- 172.21.15.87:0/3749834580 wait complete. 2024-09-13T17:24:12.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.304+0000 7efbfc8e5640 1 Processor -- start 2024-09-13T17:24:12.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.304+0000 7efbfc8e5640 1 -- start start 2024-09-13T17:24:12.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.305+0000 7efbfc8e5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efbf80feb80 0x7efbf8197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:12.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.305+0000 7efbfc8e5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efbf8103840 0x7efbf81977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:12.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.305+0000 7efbfc8e5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efbf8197d00 0x7efbf81a2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:12.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.305+0000 7efbfc8e5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf81a29a0 con 0x7efbf80feb80 2024-09-13T17:24:12.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.305+0000 7efbfc8e5640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf81a2b10 con 0x7efbf8103840 2024-09-13T17:24:12.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.305+0000 7efbfc8e5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf81a2cd0 con 0x7efbf8197d00 2024-09-13T17:24:12.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.305+0000 7efbf659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efbf80feb80 0x7efbf8197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:12.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.305+0000 7efbf659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efbf80feb80 0x7efbf8197280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40904/0 (socket says 172.21.15.87:40904) 2024-09-13T17:24:12.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.305+0000 7efbf659c640 1 -- 172.21.15.87:0/2879604091 learned_addr learned my addr 172.21.15.87:0/2879604091 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:12.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.305+0000 7efbeffff640 1 --2- 172.21.15.87:0/2879604091 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efbf8103840 0x7efbf81977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:12.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.305+0000 7efbf659c640 1 -- 172.21.15.87:0/2879604091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efbf8197d00 msgr2=0x7efbf81a2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:12.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.305+0000 7efbf6d9d640 1 --2- 172.21.15.87:0/2879604091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efbf8197d00 0x7efbf81a2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:12.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.305+0000 7efbf659c640 1 --2- 172.21.15.87:0/2879604091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efbf8197d00 0x7efbf81a2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.305+0000 7efbf659c640 1 -- 172.21.15.87:0/2879604091 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efbf8103840 msgr2=0x7efbf81977c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:12.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.305+0000 7efbf659c640 1 --2- 172.21.15.87:0/2879604091 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efbf8103840 0x7efbf81977c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.305+0000 7efbf659c640 1 -- 172.21.15.87:0/2879604091 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbe8009560 con 0x7efbf80feb80 2024-09-13T17:24:12.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.305+0000 7efbf6d9d640 1 --2- 172.21.15.87:0/2879604091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efbf8197d00 0x7efbf81a2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:12.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.305+0000 7efbeffff640 1 --2- 172.21.15.87:0/2879604091 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efbf8103840 0x7efbf81977c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:12.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.305+0000 7efbf659c640 1 --2- 172.21.15.87:0/2879604091 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efbf80feb80 0x7efbf8197280 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7efbe802a9f0 tx=0x7efbe80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:12.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.305+0000 7efbef7fe640 1 -- 172.21.15.87:0/2879604091 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe8003a00 con 0x7efbf80feb80 2024-09-13T17:24:12.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.305+0000 7efbef7fe640 1 -- 172.21.15.87:0/2879604091 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efbe80044e0 con 0x7efbf80feb80 2024-09-13T17:24:12.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.305+0000 7efbef7fe640 1 -- 172.21.15.87:0/2879604091 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe803a3c0 con 0x7efbf80feb80 2024-09-13T17:24:12.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.305+0000 7efbfc8e5640 1 -- 172.21.15.87:0/2879604091 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbf81a2f50 con 0x7efbf80feb80 2024-09-13T17:24:12.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.305+0000 7efbfc8e5640 1 -- 172.21.15.87:0/2879604091 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbf81a3310 con 0x7efbf80feb80 2024-09-13T17:24:12.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.306+0000 7efbfc8e5640 1 -- 172.21.15.87:0/2879604091 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbf80ffbf0 con 0x7efbf80feb80 2024-09-13T17:24:12.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.307+0000 7efbef7fe640 1 -- 172.21.15.87:0/2879604091 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7efbe803b460 con 0x7efbf80feb80 2024-09-13T17:24:12.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.308+0000 7efbef7fe640 1 --2- 172.21.15.87:0/2879604091 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7efbe40a1200 0x7efbe40a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:12.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.308+0000 7efbeffff640 1 --2- 172.21.15.87:0/2879604091 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7efbe40a1200 0x7efbe40a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:12.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.308+0000 7efbef7fe640 1 -- 172.21.15.87:0/2879604091 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 9644+0+0 (secure 0 0 0) 0x7efbe80ee270 con 0x7efbf80feb80 2024-09-13T17:24:12.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.309+0000 7efbeffff640 1 --2- 172.21.15.87:0/2879604091 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7efbe40a1200 0x7efbe40a36c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efbe00058c0 tx=0x7efbe0005850 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:12.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.313+0000 7efbef7fe640 1 -- 172.21.15.87:0/2879604091 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7efbe80b7200 con 0x7efbf80feb80 2024-09-13T17:24:12.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.474+0000 7efbfc8e5640 1 -- 172.21.15.87:0/2879604091 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efbf80ff530 con 0x7efbf80feb80 2024-09-13T17:24:12.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.474+0000 7efbef7fe640 1 -- 172.21.15.87:0/2879604091 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v103) v1 ==== 104+0+11 (secure 0 0 0) 0x7efbe803b710 con 0x7efbf80feb80 2024-09-13T17:24:12.476 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-09-13T17:24:12.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.476+0000 7efbfc8e5640 1 -- 172.21.15.87:0/2879604091 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7efbe40a1200 msgr2=0x7efbe40a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:12.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.476+0000 7efbfc8e5640 1 --2- 172.21.15.87:0/2879604091 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7efbe40a1200 0x7efbe40a36c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efbe00058c0 tx=0x7efbe0005850 comp rx=0 tx=0).stop 2024-09-13T17:24:12.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.476+0000 7efbfc8e5640 1 -- 172.21.15.87:0/2879604091 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efbf80feb80 msgr2=0x7efbf8197280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:12.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.476+0000 7efbfc8e5640 1 --2- 172.21.15.87:0/2879604091 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efbf80feb80 0x7efbf8197280 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7efbe802a9f0 tx=0x7efbe80042f0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.476+0000 7efbfc8e5640 1 -- 172.21.15.87:0/2879604091 shutdown_connections 2024-09-13T17:24:12.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.476+0000 7efbfc8e5640 1 --2- 172.21.15.87:0/2879604091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efbf8197d00 0x7efbf81a2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.476+0000 7efbfc8e5640 1 --2- 172.21.15.87:0/2879604091 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efbf8103840 0x7efbf81977c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.476+0000 7efbfc8e5640 1 --2- 172.21.15.87:0/2879604091 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7efbe40a1200 0x7efbe40a36c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.477+0000 7efbfc8e5640 1 --2- 172.21.15.87:0/2879604091 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efbf80feb80 0x7efbf8197280 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.477+0000 7efbfc8e5640 1 -- 172.21.15.87:0/2879604091 >> 172.21.15.87:0/2879604091 conn(0x7efbf8074110 msgr2=0x7efbf8102080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:12.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.477+0000 7efbfc8e5640 1 -- 172.21.15.87:0/2879604091 shutdown_connections 2024-09-13T17:24:12.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.477+0000 7efbfc8e5640 1 -- 172.21.15.87:0/2879604091 wait complete. 2024-09-13T17:24:12.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:12 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1915320884' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:24:12.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:12 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/213893324' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:24:12.489 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:24:12.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.589+0000 7f5f03e12640 1 -- 172.21.15.87:0/121784596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5efc1051d0 msgr2=0x7f5efc10bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:12.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.589+0000 7f5f03e12640 1 --2- 172.21.15.87:0/121784596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5efc1051d0 0x7f5efc10bc40 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4009cd0 tx=0x7f5ef402a8e0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.589+0000 7f5f03e12640 1 -- 172.21.15.87:0/121784596 shutdown_connections 2024-09-13T17:24:12.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.589+0000 7f5f03e12640 1 --2- 172.21.15.87:0/121784596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5efc1051d0 0x7f5efc10bc40 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.589+0000 7f5f03e12640 1 --2- 172.21.15.87:0/121784596 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5efc100640 0x7f5efc104a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.589+0000 7f5f03e12640 1 --2- 172.21.15.87:0/121784596 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5efc0ffc90 0x7f5efc100070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.589+0000 7f5f03e12640 1 -- 172.21.15.87:0/121784596 >> 172.21.15.87:0/121784596 conn(0x7f5efc074110 msgr2=0x7f5efc074520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:12.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.589+0000 7f5f03e12640 1 -- 172.21.15.87:0/121784596 shutdown_connections 2024-09-13T17:24:12.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.589+0000 7f5f03e12640 1 -- 172.21.15.87:0/121784596 wait complete. 2024-09-13T17:24:12.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.590+0000 7f5f03e12640 1 Processor -- start 2024-09-13T17:24:12.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.590+0000 7f5f03e12640 1 -- start start 2024-09-13T17:24:12.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.590+0000 7f5f03e12640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5efc0ffc90 0x7f5efc1971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:12.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.590+0000 7f5f03e12640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5efc1051d0 0x7f5efc197730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:12.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.590+0000 7f5f03e12640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5efc197c70 0x7f5efc1a2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:12.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.590+0000 7f5f03e12640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc1a28e0 con 0x7f5efc1051d0 2024-09-13T17:24:12.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.590+0000 7f5f03e12640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc1a2a50 con 0x7f5efc0ffc90 2024-09-13T17:24:12.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.590+0000 7f5f03e12640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc1a2c10 con 0x7f5efc197c70 2024-09-13T17:24:12.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.590+0000 7f5f013ad640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5efc1051d0 0x7f5efc197730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:12.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.590+0000 7f5f013ad640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5efc1051d0 0x7f5efc197730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40920/0 (socket says 172.21.15.87:40920) 2024-09-13T17:24:12.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.590+0000 7f5f013ad640 1 -- 172.21.15.87:0/2376063801 learned_addr learned my addr 172.21.15.87:0/2376063801 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:12.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.590+0000 7f5f01bae640 1 --2- 172.21.15.87:0/2376063801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5efc0ffc90 0x7f5efc1971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:12.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.590+0000 7f5f013ad640 1 -- 172.21.15.87:0/2376063801 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5efc197c70 msgr2=0x7f5efc1a2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:12.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.590+0000 7f5f023af640 1 --2- 172.21.15.87:0/2376063801 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5efc197c70 0x7f5efc1a2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:12.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.590+0000 7f5f013ad640 1 --2- 172.21.15.87:0/2376063801 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5efc197c70 0x7f5efc1a2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.590+0000 7f5f013ad640 1 -- 172.21.15.87:0/2376063801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5efc0ffc90 msgr2=0x7f5efc1971f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:12.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.590+0000 7f5f013ad640 1 --2- 172.21.15.87:0/2376063801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5efc0ffc90 0x7f5efc1971f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.590+0000 7f5f013ad640 1 -- 172.21.15.87:0/2376063801 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef4009900 con 0x7f5efc1051d0 2024-09-13T17:24:12.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.590+0000 7f5f01bae640 1 --2- 172.21.15.87:0/2376063801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5efc0ffc90 0x7f5efc1971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:12.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.590+0000 7f5f023af640 1 --2- 172.21.15.87:0/2376063801 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5efc197c70 0x7f5efc1a2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:12.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.590+0000 7f5f013ad640 1 --2- 172.21.15.87:0/2376063801 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5efc1051d0 0x7f5efc197730 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f5ef800d770 tx=0x7f5ef800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:12.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.591+0000 7f5eeeffd640 1 -- 172.21.15.87:0/2376063801 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef8009c30 con 0x7f5efc1051d0 2024-09-13T17:24:12.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.591+0000 7f5eeeffd640 1 -- 172.21.15.87:0/2376063801 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5ef800de80 con 0x7f5efc1051d0 2024-09-13T17:24:12.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.591+0000 7f5eeeffd640 1 -- 172.21.15.87:0/2376063801 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef800f600 con 0x7f5efc1051d0 2024-09-13T17:24:12.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.591+0000 7f5f03e12640 1 -- 172.21.15.87:0/2376063801 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5efc1a2ef0 con 0x7f5efc1051d0 2024-09-13T17:24:12.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.591+0000 7f5f03e12640 1 -- 172.21.15.87:0/2376063801 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5efc1a3320 con 0x7f5efc1051d0 2024-09-13T17:24:12.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.592+0000 7f5f03e12640 1 -- 172.21.15.87:0/2376063801 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5efc068030 con 0x7f5efc1051d0 2024-09-13T17:24:12.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.593+0000 7f5eeeffd640 1 -- 172.21.15.87:0/2376063801 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f5ef8010460 con 0x7f5efc1051d0 2024-09-13T17:24:12.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.593+0000 7f5eeeffd640 1 --2- 172.21.15.87:0/2376063801 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5ee80a1230 0x7f5ee80a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:12.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.593+0000 7f5f01bae640 1 --2- 172.21.15.87:0/2376063801 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5ee80a1230 0x7f5ee80a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:12.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.593+0000 7f5eeeffd640 1 -- 172.21.15.87:0/2376063801 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 9644+0+0 (secure 0 0 0) 0x7f5ef80ccee0 con 0x7f5efc1051d0 2024-09-13T17:24:12.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.594+0000 7f5f01bae640 1 --2- 172.21.15.87:0/2376063801 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5ee80a1230 0x7f5ee80a36f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0005fd0 tx=0x7f5ef0005ea0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:12.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.597+0000 7f5eeeffd640 1 -- 172.21.15.87:0/2376063801 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5ef8095ed0 con 0x7f5efc1051d0 2024-09-13T17:24:12.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.760+0000 7f5f03e12640 1 -- 172.21.15.87:0/2376063801 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5efc100070 con 0x7f5efc1051d0 2024-09-13T17:24:12.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.760+0000 7f5eeeffd640 1 -- 172.21.15.87:0/2376063801 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v103) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5ef80170a0 con 0x7f5efc1051d0 2024-09-13T17:24:12.761 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-09-13T17:24:12.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.762+0000 7f5f03e12640 1 -- 172.21.15.87:0/2376063801 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5ee80a1230 msgr2=0x7f5ee80a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:12.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.762+0000 7f5f03e12640 1 --2- 172.21.15.87:0/2376063801 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5ee80a1230 0x7f5ee80a36f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0005fd0 tx=0x7f5ef0005ea0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.762+0000 7f5f03e12640 1 -- 172.21.15.87:0/2376063801 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5efc1051d0 msgr2=0x7f5efc197730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:12.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.762+0000 7f5f03e12640 1 --2- 172.21.15.87:0/2376063801 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5efc1051d0 0x7f5efc197730 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f5ef800d770 tx=0x7f5ef800dc30 comp rx=0 tx=0).stop 2024-09-13T17:24:12.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.762+0000 7f5f03e12640 1 -- 172.21.15.87:0/2376063801 shutdown_connections 2024-09-13T17:24:12.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.762+0000 7f5f03e12640 1 --2- 172.21.15.87:0/2376063801 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5efc197c70 0x7f5efc1a2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.762+0000 7f5f03e12640 1 --2- 172.21.15.87:0/2376063801 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5ee80a1230 0x7f5ee80a36f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.762+0000 7f5f03e12640 1 --2- 172.21.15.87:0/2376063801 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5efc1051d0 0x7f5efc197730 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.762+0000 7f5f03e12640 1 --2- 172.21.15.87:0/2376063801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5efc0ffc90 0x7f5efc1971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.762+0000 7f5f03e12640 1 -- 172.21.15.87:0/2376063801 >> 172.21.15.87:0/2376063801 conn(0x7f5efc074110 msgr2=0x7f5efc102cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:12.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.762+0000 7f5f03e12640 1 -- 172.21.15.87:0/2376063801 shutdown_connections 2024-09-13T17:24:12.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.762+0000 7f5f03e12640 1 -- 172.21.15.87:0/2376063801 wait complete. 2024-09-13T17:24:12.774 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:24:12.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:12 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1915320884' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:24:12.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:12 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/213893324' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:24:12.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:12 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1915320884' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:24:12.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:12 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/213893324' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:24:12.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.873+0000 7f89aaf7d640 1 -- 172.21.15.87:0/536782793 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89a4103fb0 msgr2=0x7f89a410bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:12.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.873+0000 7f89aaf7d640 1 --2- 172.21.15.87:0/536782793 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89a4103fb0 0x7f89a410bb00 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f899c009cd0 tx=0x7f899c02a8e0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.874+0000 7f89aaf7d640 1 -- 172.21.15.87:0/536782793 shutdown_connections 2024-09-13T17:24:12.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.874+0000 7f89aaf7d640 1 --2- 172.21.15.87:0/536782793 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89a4103fb0 0x7f89a410bb00 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.874+0000 7f89aaf7d640 1 --2- 172.21.15.87:0/536782793 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89a40ff810 0x7f89a4103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.874+0000 7f89aaf7d640 1 --2- 172.21.15.87:0/536782793 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89a40fee60 0x7f89a40ff240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.874+0000 7f89aaf7d640 1 -- 172.21.15.87:0/536782793 >> 172.21.15.87:0/536782793 conn(0x7f89a4075c60 msgr2=0x7f89a40fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:12.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.874+0000 7f89aaf7d640 1 -- 172.21.15.87:0/536782793 shutdown_connections 2024-09-13T17:24:12.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.874+0000 7f89aaf7d640 1 -- 172.21.15.87:0/536782793 wait complete. 2024-09-13T17:24:12.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.874+0000 7f89aaf7d640 1 Processor -- start 2024-09-13T17:24:12.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.874+0000 7f89aaf7d640 1 -- start start 2024-09-13T17:24:12.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.874+0000 7f89aaf7d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89a40fee60 0x7f89a4196220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:12.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.874+0000 7f89aaf7d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89a4103fb0 0x7f89a4196760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:12.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.874+0000 7f89aaf7d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89a419ab50 0x7f89a419b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:12.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.874+0000 7f89aaf7d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a419b540 con 0x7f89a40fee60 2024-09-13T17:24:12.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.874+0000 7f89aaf7d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a419b6b0 con 0x7f89a419ab50 2024-09-13T17:24:12.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.874+0000 7f89aaf7d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a419b820 con 0x7f89a4103fb0 2024-09-13T17:24:12.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.874+0000 7f89a8d19640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89a40fee60 0x7f89a4196220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:12.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.874+0000 7f89a8d19640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89a40fee60 0x7f89a4196220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40930/0 (socket says 172.21.15.87:40930) 2024-09-13T17:24:12.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.874+0000 7f89a8d19640 1 -- 172.21.15.87:0/3693420394 learned_addr learned my addr 172.21.15.87:0/3693420394 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:12.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.875+0000 7f89a3fff640 1 --2- 172.21.15.87:0/3693420394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89a4103fb0 0x7f89a4196760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:12.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.875+0000 7f89a951a640 1 --2- 172.21.15.87:0/3693420394 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89a419ab50 0x7f89a419b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:12.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.875+0000 7f89a8d19640 1 -- 172.21.15.87:0/3693420394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89a4103fb0 msgr2=0x7f89a4196760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:12.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.875+0000 7f89a8d19640 1 --2- 172.21.15.87:0/3693420394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89a4103fb0 0x7f89a4196760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.875+0000 7f89a8d19640 1 -- 172.21.15.87:0/3693420394 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89a419ab50 msgr2=0x7f89a419b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:12.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.875+0000 7f89a8d19640 1 --2- 172.21.15.87:0/3693420394 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89a419ab50 0x7f89a419b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:12.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.875+0000 7f89a8d19640 1 -- 172.21.15.87:0/3693420394 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899c009900 con 0x7f89a40fee60 2024-09-13T17:24:12.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.875+0000 7f89a951a640 1 --2- 172.21.15.87:0/3693420394 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89a419ab50 0x7f89a419b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:12.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.875+0000 7f89a8d19640 1 --2- 172.21.15.87:0/3693420394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89a40fee60 0x7f89a4196220 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f899400d950 tx=0x7f899400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:12.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.875+0000 7f89a1ffb640 1 -- 172.21.15.87:0/3693420394 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8994009c30 con 0x7f89a40fee60 2024-09-13T17:24:12.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.875+0000 7f89a1ffb640 1 -- 172.21.15.87:0/3693420394 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8994009d90 con 0x7f89a40fee60 2024-09-13T17:24:12.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.875+0000 7f89aaf7d640 1 -- 172.21.15.87:0/3693420394 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a41a2e00 con 0x7f89a40fee60 2024-09-13T17:24:12.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.875+0000 7f89a1ffb640 1 -- 172.21.15.87:0/3693420394 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899400f6b0 con 0x7f89a40fee60 2024-09-13T17:24:12.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.875+0000 7f89aaf7d640 1 -- 172.21.15.87:0/3693420394 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a41a3270 con 0x7f89a40fee60 2024-09-13T17:24:12.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.876+0000 7f89aaf7d640 1 -- 172.21.15.87:0/3693420394 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89a4100330 con 0x7f89a40fee60 2024-09-13T17:24:12.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.877+0000 7f89a1ffb640 1 -- 172.21.15.87:0/3693420394 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f8994010aa0 con 0x7f89a40fee60 2024-09-13T17:24:12.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.878+0000 7f89a1ffb640 1 --2- 172.21.15.87:0/3693420394 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f898c0a1280 0x7f898c0a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:12.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.878+0000 7f89a3fff640 1 --2- 172.21.15.87:0/3693420394 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f898c0a1280 0x7f898c0a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:12.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.878+0000 7f89a1ffb640 1 -- 172.21.15.87:0/3693420394 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 9644+0+0 (secure 0 0 0) 0x7f89940cce30 con 0x7f89a40fee60 2024-09-13T17:24:12.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.878+0000 7f89a3fff640 1 --2- 172.21.15.87:0/3693420394 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f898c0a1280 0x7f898c0a3740 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8998005fd0 tx=0x7f8998005850 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:12.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:12.882+0000 7f89a1ffb640 1 -- 172.21.15.87:0/3693420394 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8994095e20 con 0x7f89a40fee60 2024-09-13T17:24:13.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.045+0000 7f89aaf7d640 1 -- 172.21.15.87:0/3693420394 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f89a40ff810 con 0x7f89a40fee60 2024-09-13T17:24:13.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.045+0000 7f89a1ffb640 1 -- 172.21.15.87:0/3693420394 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v103) v1 ==== 103+0+11 (secure 0 0 0) 0x7f89940200a0 con 0x7f89a40fee60 2024-09-13T17:24:13.047 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-09-13T17:24:13.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.047+0000 7f89aaf7d640 1 -- 172.21.15.87:0/3693420394 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f898c0a1280 msgr2=0x7f898c0a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:13.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.047+0000 7f89aaf7d640 1 --2- 172.21.15.87:0/3693420394 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f898c0a1280 0x7f898c0a3740 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8998005fd0 tx=0x7f8998005850 comp rx=0 tx=0).stop 2024-09-13T17:24:13.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.047+0000 7f89aaf7d640 1 -- 172.21.15.87:0/3693420394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89a40fee60 msgr2=0x7f89a4196220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:13.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.047+0000 7f89aaf7d640 1 --2- 172.21.15.87:0/3693420394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89a40fee60 0x7f89a4196220 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f899400d950 tx=0x7f899400de10 comp rx=0 tx=0).stop 2024-09-13T17:24:13.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.047+0000 7f89aaf7d640 1 -- 172.21.15.87:0/3693420394 shutdown_connections 2024-09-13T17:24:13.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.047+0000 7f89aaf7d640 1 --2- 172.21.15.87:0/3693420394 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89a419ab50 0x7f89a419b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:13.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.047+0000 7f89aaf7d640 1 --2- 172.21.15.87:0/3693420394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89a4103fb0 0x7f89a4196760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:13.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.047+0000 7f89aaf7d640 1 --2- 172.21.15.87:0/3693420394 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f898c0a1280 0x7f898c0a3740 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:13.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.047+0000 7f89aaf7d640 1 --2- 172.21.15.87:0/3693420394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89a40fee60 0x7f89a4196220 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:13.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.047+0000 7f89aaf7d640 1 -- 172.21.15.87:0/3693420394 >> 172.21.15.87:0/3693420394 conn(0x7f89a4075c60 msgr2=0x7f89a41027f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:13.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.047+0000 7f89aaf7d640 1 -- 172.21.15.87:0/3693420394 shutdown_connections 2024-09-13T17:24:13.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.047+0000 7f89aaf7d640 1 -- 172.21.15.87:0/3693420394 wait complete. 2024-09-13T17:24:13.060 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-13T17:24:13.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.171+0000 7f4319d3e640 1 -- 172.21.15.87:0/778404252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43140fee90 msgr2=0x7f43140ff270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:13.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.171+0000 7f4319d3e640 1 --2- 172.21.15.87:0/778404252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43140fee90 0x7f43140ff270 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f4304009930 tx=0x7f430402a420 comp rx=0 tx=0).stop 2024-09-13T17:24:13.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.171+0000 7f4319d3e640 1 -- 172.21.15.87:0/778404252 shutdown_connections 2024-09-13T17:24:13.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.171+0000 7f4319d3e640 1 --2- 172.21.15.87:0/778404252 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4314103fe0 0x7f431410bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:13.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.171+0000 7f4319d3e640 1 --2- 172.21.15.87:0/778404252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43140ff840 0x7f4314103880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:13.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.171+0000 7f4319d3e640 1 --2- 172.21.15.87:0/778404252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43140fee90 0x7f43140ff270 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:13.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.171+0000 7f4319d3e640 1 -- 172.21.15.87:0/778404252 >> 172.21.15.87:0/778404252 conn(0x7f43140fa900 msgr2=0x7f43140fcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:13.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.171+0000 7f4319d3e640 1 -- 172.21.15.87:0/778404252 shutdown_connections 2024-09-13T17:24:13.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.171+0000 7f4319d3e640 1 -- 172.21.15.87:0/778404252 wait complete. 2024-09-13T17:24:13.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.171+0000 7f4319d3e640 1 Processor -- start 2024-09-13T17:24:13.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.172+0000 7f4319d3e640 1 -- start start 2024-09-13T17:24:13.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.172+0000 7f4319d3e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43140fee90 0x7f4314197140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:13.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.172+0000 7f4319d3e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4314103fe0 0x7f4314197680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:13.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.172+0000 7f4319d3e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4314197c10 0x7f43141a21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:13.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.172+0000 7f4319d3e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43141a2890 con 0x7f4314103fe0 2024-09-13T17:24:13.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.172+0000 7f4319d3e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43141a2a00 con 0x7f4314197c10 2024-09-13T17:24:13.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.172+0000 7f4319d3e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43141a2bc0 con 0x7f43140fee90 2024-09-13T17:24:13.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.172+0000 7f430bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4314103fe0 0x7f4314197680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:13.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.172+0000 7f430bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4314103fe0 0x7f4314197680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40944/0 (socket says 172.21.15.87:40944) 2024-09-13T17:24:13.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.172+0000 7f430bfff640 1 -- 172.21.15.87:0/732735568 learned_addr learned my addr 172.21.15.87:0/732735568 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:13.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.172+0000 7f4313fff640 1 --2- 172.21.15.87:0/732735568 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4314197c10 0x7f43141a21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:13.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.172+0000 7f43137fe640 1 --2- 172.21.15.87:0/732735568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43140fee90 0x7f4314197140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:13.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.172+0000 7f430bfff640 1 -- 172.21.15.87:0/732735568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43140fee90 msgr2=0x7f4314197140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:13.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.172+0000 7f430bfff640 1 --2- 172.21.15.87:0/732735568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43140fee90 0x7f4314197140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:13.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.172+0000 7f430bfff640 1 -- 172.21.15.87:0/732735568 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4314197c10 msgr2=0x7f43141a21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:13.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.172+0000 7f430bfff640 1 --2- 172.21.15.87:0/732735568 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4314197c10 0x7f43141a21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:13.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.172+0000 7f430bfff640 1 -- 172.21.15.87:0/732735568 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4304009560 con 0x7f4314103fe0 2024-09-13T17:24:13.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.172+0000 7f430bfff640 1 --2- 172.21.15.87:0/732735568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4314103fe0 0x7f4314197680 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f42fc00d770 tx=0x7f42fc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:13.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.172+0000 7f43117fa640 1 -- 172.21.15.87:0/732735568 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42fc009c30 con 0x7f4314103fe0 2024-09-13T17:24:13.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.172+0000 7f43117fa640 1 -- 172.21.15.87:0/732735568 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f42fc00de80 con 0x7f4314103fe0 2024-09-13T17:24:13.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.172+0000 7f4319d3e640 1 -- 172.21.15.87:0/732735568 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43141a2ea0 con 0x7f4314103fe0 2024-09-13T17:24:13.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.172+0000 7f43117fa640 1 -- 172.21.15.87:0/732735568 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42fc00f600 con 0x7f4314103fe0 2024-09-13T17:24:13.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.173+0000 7f4319d3e640 1 -- 172.21.15.87:0/732735568 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43141a3320 con 0x7f4314103fe0 2024-09-13T17:24:13.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.173+0000 7f4319d3e640 1 -- 172.21.15.87:0/732735568 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4314100360 con 0x7f4314103fe0 2024-09-13T17:24:13.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.175+0000 7f43117fa640 1 -- 172.21.15.87:0/732735568 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f42fc010460 con 0x7f4314103fe0 2024-09-13T17:24:13.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.175+0000 7f43117fa640 1 --2- 172.21.15.87:0/732735568 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f43000a1200 0x7f43000a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:13.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.175+0000 7f43137fe640 1 --2- 172.21.15.87:0/732735568 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f43000a1200 0x7f43000a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:13.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.175+0000 7f43117fa640 1 -- 172.21.15.87:0/732735568 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 9644+0+0 (secure 0 0 0) 0x7f42fc0ccf70 con 0x7f4314103fe0 2024-09-13T17:24:13.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.176+0000 7f43137fe640 1 --2- 172.21.15.87:0/732735568 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f43000a1200 0x7f43000a36c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f43040057c0 tx=0x7f4304005a20 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:13.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.178+0000 7f43117fa640 1 -- 172.21.15.87:0/732735568 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f42fc095f60 con 0x7f4314103fe0 2024-09-13T17:24:13.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.387+0000 7f4319d3e640 1 -- 172.21.15.87:0/732735568 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7f43140ff270 con 0x7f4314103fe0 2024-09-13T17:24:13.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.394+0000 7f43117fa640 1 -- 172.21.15.87:0/732735568 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v26) v1 ==== 81+0+733938 (secure 0 0 0) 0x7f42fc021090 con 0x7f4314103fe0 2024-09-13T17:24:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:24:13.405 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:24:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: "epoch": 26, 2024-09-13T17:24:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: "active_gid": 15507, 2024-09-13T17:24:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: "active_name": "x", 2024-09-13T17:24:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: "active_addrs": { 2024-09-13T17:24:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-13T17:24:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-13T17:24:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6800", 2024-09-13T17:24:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 157129242 2024-09-13T17:24:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-13T17:24:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6801", 2024-09-13T17:24:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 157129242 2024-09-13T17:24:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-13T17:24:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: "active_addr": "172.21.15.87:6801/157129242", 2024-09-13T17:24:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: "active_change": "2024-09-13T17:13:49.377435+0000", 2024-09-13T17:24:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: "active_mgr_features": 4540138322906710015, 2024-09-13T17:24:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: "available": true, 2024-09-13T17:24:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: "standbys": [ 2024-09-13T17:24:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: "gid": 24974, 2024-09-13T17:24:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "y", 2024-09-13T17:24:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_features": 4540138322906710015, 2024-09-13T17:24:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: "available_modules": [ 2024-09-13T17:24:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "alerts", 2024-09-13T17:24:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-09-13T17:24:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-09-13T17:24:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-09-13T17:24:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "How frequently to reexamine health status", 2024-09-13T17:24:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_destination": { 2024-09-13T17:24:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_destination", 2024-09-13T17:24:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Email address to send alerts to", 2024-09-13T17:24:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_from_name": { 2024-09-13T17:24:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_from_name", 2024-09-13T17:24:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "Ceph", 2024-09-13T17:24:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Email From: name", 2024-09-13T17:24:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_host": { 2024-09-13T17:24:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_host", 2024-09-13T17:24:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "SMTP server", 2024-09-13T17:24:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_password": { 2024-09-13T17:24:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_password", 2024-09-13T17:24:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Password to authenticate with", 2024-09-13T17:24:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_port": { 2024-09-13T17:24:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_port", 2024-09-13T17:24:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "465", 2024-09-13T17:24:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "SMTP port", 2024-09-13T17:24:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_sender": { 2024-09-13T17:24:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_sender", 2024-09-13T17:24:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "SMTP envelope sender", 2024-09-13T17:24:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_ssl": { 2024-09-13T17:24:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_ssl", 2024-09-13T17:24:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-13T17:24:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_user": { 2024-09-13T17:24:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_user", 2024-09-13T17:24:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "User to authenticate as", 2024-09-13T17:24:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "balancer", 2024-09-13T17:24:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "active": { 2024-09-13T17:24:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "active", 2024-09-13T17:24:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "automatically balance PGs across cluster", 2024-09-13T17:24:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: "begin_time": { 2024-09-13T17:24:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "begin_time", 2024-09-13T17:24:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0000", 2024-09-13T17:24:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "beginning time of day to automatically balance", 2024-09-13T17:24:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T17:24:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: "begin_weekday": { 2024-09-13T17:24:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "begin_weekday", 2024-09-13T17:24:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-09-13T17:24:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-09-13T17:24:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "0", 2024-09-13T17:24:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "6", 2024-09-13T17:24:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-13T17:24:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T17:24:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_compat_max_iterations": { 2024-09-13T17:24:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crush_compat_max_iterations", 2024-09-13T17:24:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-09-13T17:24:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "25", 2024-09-13T17:24:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1", 2024-09-13T17:24:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "250", 2024-09-13T17:24:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-13T17:24:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_compat_metrics": { 2024-09-13T17:24:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crush_compat_metrics", 2024-09-13T17:24:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "pgs,objects,bytes", 2024-09-13T17:24:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-13T17:24:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-13T17:24:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_compat_step": { 2024-09-13T17:24:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crush_compat_step", 2024-09-13T17:24:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-09-13T17:24:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0.5", 2024-09-13T17:24:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "0.001", 2024-09-13T17:24:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "0.999", 2024-09-13T17:24:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "aggressiveness of optimization", 2024-09-13T17:24:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-13T17:24:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: "end_time": { 2024-09-13T17:24:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "end_time", 2024-09-13T17:24:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "2359", 2024-09-13T17:24:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "ending time of day to automatically balance", 2024-09-13T17:24:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T17:24:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: "end_weekday": { 2024-09-13T17:24:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "end_weekday", 2024-09-13T17:24:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-09-13T17:24:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-09-13T17:24:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "0", 2024-09-13T17:24:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "6", 2024-09-13T17:24:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-13T17:24:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T17:24:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: "min_score": { 2024-09-13T17:24:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "min_score", 2024-09-13T17:24:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-09-13T17:24:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-09-13T17:24:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-13T17:24:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": { 2024-09-13T17:24:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mode", 2024-09-13T17:24:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "upmap", 2024-09-13T17:24:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: "crush-compat", 2024-09-13T17:24:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: "none", 2024-09-13T17:24:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: "upmap" 2024-09-13T17:24:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Balancer mode", 2024-09-13T17:24:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: "pool_ids": { 2024-09-13T17:24:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "pool_ids", 2024-09-13T17:24:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-13T17:24:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-09-13T17:24:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-09-13T17:24:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-09-13T17:24:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-13T17:24:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: "upmap_max_deviation": { 2024-09-13T17:24:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "upmap_max_deviation", 2024-09-13T17:24:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5", 2024-09-13T17:24:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1", 2024-09-13T17:24:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-13T17:24:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-13T17:24:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: "upmap_max_optimizations": { 2024-09-13T17:24:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "upmap_max_optimizations", 2024-09-13T17:24:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-09-13T17:24:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-09-13T17:24:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-13T17:24:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cephadm", 2024-09-13T17:24:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: "agent_down_multiplier": { 2024-09-13T17:24:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "agent_down_multiplier", 2024-09-13T17:24:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-09-13T17:24:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "3.0", 2024-09-13T17:24:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-13T17:24:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: "agent_refresh_rate": { 2024-09-13T17:24:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "agent_refresh_rate", 2024-09-13T17:24:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "20", 2024-09-13T17:24:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-13T17:24:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: "agent_starting_port": { 2024-09-13T17:24:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "agent_starting_port", 2024-09-13T17:24:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "4721", 2024-09-13T17:24:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-13T17:24:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: "allow_ptrace": { 2024-09-13T17:24:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "allow_ptrace", 2024-09-13T17:24:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-13T17:24:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-13T17:24:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: "autotune_interval": { 2024-09-13T17:24:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "autotune_interval", 2024-09-13T17:24:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-09-13T17:24:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-13T17:24:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: "autotune_memory_target_ratio": { 2024-09-13T17:24:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "autotune_memory_target_ratio", 2024-09-13T17:24:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-09-13T17:24:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0.7", 2024-09-13T17:24:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-13T17:24:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: "cgroups_split": { 2024-09-13T17:24:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cgroups_split", 2024-09-13T17:24:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-13T17:24:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: "config_checks_enabled": { 2024-09-13T17:24:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "config_checks_enabled", 2024-09-13T17:24:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-13T17:24:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "config_dashboard": { 2024-09-13T17:24:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "config_dashboard", 2024-09-13T17:24:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-13T17:24:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_alertmanager": { 2024-09-13T17:24:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_alertmanager", 2024-09-13T17:24:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-13T17:24:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Prometheus container image", 2024-09-13T17:24:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_base": { 2024-09-13T17:24:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_base", 2024-09-13T17:24:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-13T17:24:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Container image name, without the tag", 2024-09-13T17:24:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_elasticsearch": { 2024-09-13T17:24:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_elasticsearch", 2024-09-13T17:24:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-13T17:24:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "elasticsearch container image", 2024-09-13T17:24:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_grafana": { 2024-09-13T17:24:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_grafana", 2024-09-13T17:24:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-09-13T17:24:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Prometheus container image", 2024-09-13T17:24:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_haproxy": { 2024-09-13T17:24:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_haproxy", 2024-09-13T17:24:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-13T17:24:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "HAproxy container image", 2024-09-13T17:24:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_jaeger_agent": { 2024-09-13T17:24:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_jaeger_agent", 2024-09-13T17:24:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-13T17:24:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Jaeger agent container image", 2024-09-13T17:24:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_jaeger_collector": { 2024-09-13T17:24:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_jaeger_collector", 2024-09-13T17:24:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-13T17:24:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Jaeger collector container image", 2024-09-13T17:24:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_jaeger_query": { 2024-09-13T17:24:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_jaeger_query", 2024-09-13T17:24:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-13T17:24:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Jaeger query container image", 2024-09-13T17:24:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_keepalived": { 2024-09-13T17:24:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_keepalived", 2024-09-13T17:24:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-13T17:24:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Keepalived container image", 2024-09-13T17:24:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_loki": { 2024-09-13T17:24:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_loki", 2024-09-13T17:24:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-13T17:24:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Loki container image", 2024-09-13T17:24:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_node_exporter": { 2024-09-13T17:24:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_node_exporter", 2024-09-13T17:24:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-13T17:24:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Prometheus container image", 2024-09-13T17:24:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_nvmeof": { 2024-09-13T17:24:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_nvmeof", 2024-09-13T17:24:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-09-13T17:24:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Nvme-of container image", 2024-09-13T17:24:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_prometheus": { 2024-09-13T17:24:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_prometheus", 2024-09-13T17:24:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-13T17:24:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Prometheus container image", 2024-09-13T17:24:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_promtail": { 2024-09-13T17:24:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_promtail", 2024-09-13T17:24:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-13T17:24:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Promtail container image", 2024-09-13T17:24:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_snmp_gateway": { 2024-09-13T17:24:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_snmp_gateway", 2024-09-13T17:24:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-13T17:24:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "SNMP Gateway container image", 2024-09-13T17:24:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: "container_init": { 2024-09-13T17:24:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_init", 2024-09-13T17:24:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Run podman/docker with `--init`", 2024-09-13T17:24:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: "daemon_cache_timeout": { 2024-09-13T17:24:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "daemon_cache_timeout", 2024-09-13T17:24:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-09-13T17:24:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-13T17:24:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: "default_cephadm_command_timeout": { 2024-09-13T17:24:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "default_cephadm_command_timeout", 2024-09-13T17:24:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "900", 2024-09-13T17:24:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-13T17:24:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: "default_registry": { 2024-09-13T17:24:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "default_registry", 2024-09-13T17:24:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "docker.io", 2024-09-13T17:24:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-13T17:24:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: "device_cache_timeout": { 2024-09-13T17:24:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "device_cache_timeout", 2024-09-13T17:24:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "1800", 2024-09-13T17:24:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "seconds to cache device inventory", 2024-09-13T17:24:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: "device_enhanced_scan": { 2024-09-13T17:24:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "device_enhanced_scan", 2024-09-13T17:24:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-13T17:24:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: "facts_cache_timeout": { 2024-09-13T17:24:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "facts_cache_timeout", 2024-09-13T17:24:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-09-13T17:24:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "seconds to cache host facts data", 2024-09-13T17:24:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: "host_check_interval": { 2024-09-13T17:24:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "host_check_interval", 2024-09-13T17:24:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-09-13T17:24:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to perform a host check", 2024-09-13T17:24:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: "hw_monitoring": { 2024-09-13T17:24:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "hw_monitoring", 2024-09-13T17:24:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-13T17:24:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: "inventory_list_all": { 2024-09-13T17:24:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "inventory_list_all", 2024-09-13T17:24:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-13T17:24:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: "log_refresh_metadata": { 2024-09-13T17:24:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_refresh_metadata", 2024-09-13T17:24:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-13T17:24:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-13T17:24:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-13T17:24:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-13T17:24:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-13T17:24:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-13T17:24:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-13T17:24:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "*", 2024-09-13T17:24:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-13T17:24:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: "max_count_per_host": { 2024-09-13T17:24:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_count_per_host", 2024-09-13T17:24:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-09-13T17:24:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "max number of daemons per service per host", 2024-09-13T17:24:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: "max_osd_draining_count": { 2024-09-13T17:24:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_osd_draining_count", 2024-09-13T17:24:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-09-13T17:24:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-13T17:24:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: "migration_current": { 2024-09-13T17:24:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "migration_current", 2024-09-13T17:24:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "internal - do not modify", 2024-09-13T17:24:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": { 2024-09-13T17:24:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mode", 2024-09-13T17:24:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "root", 2024-09-13T17:24:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: "cephadm-package", 2024-09-13T17:24:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: "root" 2024-09-13T17:24:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "mode for remote execution of cephadm", 2024-09-13T17:24:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: "oob_default_addr": { 2024-09-13T17:24:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "oob_default_addr", 2024-09-13T17:24:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "169.254.1.1", 2024-09-13T17:24:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-13T17:24:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: "prometheus_alerts_path": { 2024-09-13T17:24:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "prometheus_alerts_path", 2024-09-13T17:24:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-13T17:24:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-13T17:24:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "registry_insecure": { 2024-09-13T17:24:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "registry_insecure", 2024-09-13T17:24:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-13T17:24:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: "registry_password": { 2024-09-13T17:24:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "registry_password", 2024-09-13T17:24:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-13T17:24:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: "registry_url": { 2024-09-13T17:24:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "registry_url", 2024-09-13T17:24:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-13T17:24:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: "registry_username": { 2024-09-13T17:24:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "registry_username", 2024-09-13T17:24:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-13T17:24:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: "secure_monitoring_stack": { 2024-09-13T17:24:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "secure_monitoring_stack", 2024-09-13T17:24:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-13T17:24:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: "service_discovery_port": { 2024-09-13T17:24:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "service_discovery_port", 2024-09-13T17:24:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8765", 2024-09-13T17:24:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "cephadm service discovery port", 2024-09-13T17:24:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: "ssh_config_file": { 2024-09-13T17:24:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ssh_config_file", 2024-09-13T17:24:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-13T17:24:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "use_agent": { 2024-09-13T17:24:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "use_agent", 2024-09-13T17:24:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-13T17:24:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: "use_repo_digest": { 2024-09-13T17:24:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "use_repo_digest", 2024-09-13T17:24:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-13T17:24:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_on_failed_host_check": { 2024-09-13T17:24:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_on_failed_host_check", 2024-09-13T17:24:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "raise a health warning if the host check fails", 2024-09-13T17:24:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_on_stray_daemons": { 2024-09-13T17:24:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_on_stray_daemons", 2024-09-13T17:24:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-13T17:24:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_on_stray_hosts": { 2024-09-13T17:24:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_on_stray_hosts", 2024-09-13T17:24:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-13T17:24:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crash", 2024-09-13T17:24:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.509 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.509 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.509 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.509 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.509 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.509 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.509 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.509 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.509 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.509 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.509 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.509 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.509 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.510 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.510 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.510 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.510 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.510 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.510 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.510 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.510 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.510 INFO:teuthology.orchestra.run.smithi087.stdout: "retain_interval": { 2024-09-13T17:24:13.510 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "retain_interval", 2024-09-13T17:24:13.510 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:13.510 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.510 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.511 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "31536000", 2024-09-13T17:24:13.511 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.511 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.511 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.511 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-13T17:24:13.511 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.511 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.511 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.511 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.511 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_recent_interval": { 2024-09-13T17:24:13.511 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_recent_interval", 2024-09-13T17:24:13.511 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:13.511 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.511 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.511 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "1209600", 2024-09-13T17:24:13.512 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.512 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.512 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.512 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-13T17:24:13.512 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.512 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.512 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.512 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.512 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.512 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.512 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.512 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "dashboard", 2024-09-13T17:24:13.512 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-13T17:24:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-13T17:24:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-09-13T17:24:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "ALERTMANAGER_API_HOST": { 2024-09-13T17:24:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-13T17:24:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-13T17:24:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-13T17:24:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: "AUDIT_API_ENABLED": { 2024-09-13T17:24:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "AUDIT_API_ENABLED", 2024-09-13T17:24:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-13T17:24:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-13T17:24:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.518 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.518 INFO:teuthology.orchestra.run.smithi087.stdout: "ENABLE_BROWSABLE_API": { 2024-09-13T17:24:13.518 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-13T17:24:13.518 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.518 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.518 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.518 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.518 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.518 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.518 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.518 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.518 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.518 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.518 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.519 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.519 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-13T17:24:13.519 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-13T17:24:13.519 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.519 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.519 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.519 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.519 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.519 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.519 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.519 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.519 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.519 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.519 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.520 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.520 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-13T17:24:13.520 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-13T17:24:13.520 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.520 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.520 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.520 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.520 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.520 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.520 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.520 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.520 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.520 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.521 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.521 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.521 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-13T17:24:13.521 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-13T17:24:13.521 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.521 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.521 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.521 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.521 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.521 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.521 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.521 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.521 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.521 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.522 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.522 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.522 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-13T17:24:13.522 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-13T17:24:13.522 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.522 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.522 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.522 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.522 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.522 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.522 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.522 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.522 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.523 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.523 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.523 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.523 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-13T17:24:13.523 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-13T17:24:13.523 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.523 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.523 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.523 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.523 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.523 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.523 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.523 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.523 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.524 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.524 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.524 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.524 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-13T17:24:13.524 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-13T17:24:13.524 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.524 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.524 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.524 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.524 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.524 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.524 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.524 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.524 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.525 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.525 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.525 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.525 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-13T17:24:13.525 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-13T17:24:13.525 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.525 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.525 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.525 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.525 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.525 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.525 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.525 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.525 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.526 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.526 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.526 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.526 INFO:teuthology.orchestra.run.smithi087.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-13T17:24:13.526 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-13T17:24:13.526 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.526 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.526 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.526 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.526 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.526 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.526 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.526 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.526 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.527 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.527 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.527 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.527 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_API_PASSWORD": { 2024-09-13T17:24:13.527 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-13T17:24:13.527 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.527 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.527 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.527 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "admin", 2024-09-13T17:24:13.527 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.527 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.527 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.527 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.527 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.528 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.528 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.528 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.528 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-13T17:24:13.528 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-13T17:24:13.528 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.528 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.528 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.528 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.528 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.528 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.528 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.528 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.528 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.529 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.529 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.529 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.529 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_API_URL": { 2024-09-13T17:24:13.529 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_API_URL", 2024-09-13T17:24:13.529 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.529 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.529 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.529 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.529 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.529 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.529 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.529 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.529 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.530 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.530 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.530 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.530 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_API_USERNAME": { 2024-09-13T17:24:13.530 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-13T17:24:13.530 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.530 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.530 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.530 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "admin", 2024-09-13T17:24:13.530 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.530 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.530 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.530 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.530 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.530 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.531 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.531 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.531 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-13T17:24:13.531 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-13T17:24:13.531 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.531 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.531 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.531 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.531 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.532 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.532 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.532 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.532 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.532 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.532 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.532 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.532 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-13T17:24:13.532 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-13T17:24:13.532 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.532 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.532 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.532 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.532 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.533 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.533 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.533 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.533 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.533 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.533 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.533 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.537 INFO:teuthology.orchestra.run.smithi087.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-13T17:24:13.537 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-13T17:24:13.537 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.537 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.537 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.537 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.537 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.537 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.537 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.537 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.537 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.537 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.537 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.538 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.538 INFO:teuthology.orchestra.run.smithi087.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-13T17:24:13.538 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-13T17:24:13.538 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.538 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.538 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.538 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.538 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.538 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.538 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.538 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.538 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.538 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.538 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.539 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.539 INFO:teuthology.orchestra.run.smithi087.stdout: "PROMETHEUS_API_HOST": { 2024-09-13T17:24:13.539 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-13T17:24:13.539 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.539 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.539 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.539 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.539 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.539 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.539 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.539 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.539 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.540 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.540 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.540 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.540 INFO:teuthology.orchestra.run.smithi087.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-13T17:24:13.540 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-13T17:24:13.540 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.540 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.540 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.540 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.540 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.540 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.540 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.540 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.540 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.541 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.541 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.541 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.541 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-13T17:24:13.541 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-13T17:24:13.541 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.541 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.541 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.541 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.541 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.541 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.541 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.541 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.541 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.542 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.542 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.542 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.542 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-13T17:24:13.542 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-13T17:24:13.542 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.542 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.542 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.542 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.542 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.542 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.542 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.542 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.543 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.543 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.543 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.543 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-13T17:24:13.543 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-13T17:24:13.543 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.543 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.543 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.543 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.543 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.543 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.543 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.543 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.543 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.544 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.544 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.544 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.544 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-13T17:24:13.544 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-13T17:24:13.544 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.544 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.544 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.544 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.544 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.544 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.544 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.544 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.545 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.545 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.545 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.545 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.545 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-13T17:24:13.545 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-13T17:24:13.545 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.545 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.545 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.545 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.545 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.545 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.545 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.545 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.546 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.546 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.546 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.546 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.546 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-13T17:24:13.546 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-13T17:24:13.546 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.546 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.546 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.546 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.546 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.546 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.546 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.546 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.547 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.547 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.547 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.547 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-13T17:24:13.547 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-13T17:24:13.547 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.547 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.547 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.547 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.547 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.547 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.547 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.547 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.548 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.548 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.548 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.548 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_ENABLED": { 2024-09-13T17:24:13.548 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-13T17:24:13.548 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.548 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.548 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.548 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.548 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.548 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.548 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.548 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.549 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.549 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.549 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.549 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.549 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-13T17:24:13.549 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-13T17:24:13.549 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.549 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.549 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.549 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-13T17:24:13.549 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.549 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.549 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.549 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.550 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.550 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.550 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.550 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-13T17:24:13.550 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-13T17:24:13.550 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.550 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.550 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.550 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-09-13T17:24:13.550 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.550 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.550 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.550 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.551 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.551 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.551 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.551 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-13T17:24:13.551 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-13T17:24:13.551 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.551 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.551 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.551 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8", 2024-09-13T17:24:13.551 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.551 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.551 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.551 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.551 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.552 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.552 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.552 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.552 INFO:teuthology.orchestra.run.smithi087.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-13T17:24:13.552 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-13T17:24:13.552 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.552 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.552 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.552 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "45", 2024-09-13T17:24:13.552 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.552 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.552 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.553 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.553 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.553 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.553 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.553 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.553 INFO:teuthology.orchestra.run.smithi087.stdout: "RGW_API_ACCESS_KEY": { 2024-09-13T17:24:13.553 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-13T17:24:13.553 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.553 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.553 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.553 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.553 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.553 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.553 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.554 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.554 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.554 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.554 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.554 INFO:teuthology.orchestra.run.smithi087.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-13T17:24:13.554 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-13T17:24:13.554 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.554 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.554 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.554 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "admin", 2024-09-13T17:24:13.554 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.554 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.554 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.554 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.555 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.555 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.555 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.555 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.555 INFO:teuthology.orchestra.run.smithi087.stdout: "RGW_API_SECRET_KEY": { 2024-09-13T17:24:13.555 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-13T17:24:13.555 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.555 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.555 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.555 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.555 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.555 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.555 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.556 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.556 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.556 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.556 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.556 INFO:teuthology.orchestra.run.smithi087.stdout: "RGW_API_SSL_VERIFY": { 2024-09-13T17:24:13.556 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-13T17:24:13.556 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.556 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.556 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.556 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.556 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.556 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.556 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.557 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.557 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.557 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.557 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.557 INFO:teuthology.orchestra.run.smithi087.stdout: "UNSAFE_TLS_v1_2": { 2024-09-13T17:24:13.557 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-13T17:24:13.557 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.557 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.557 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.557 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.557 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.557 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.557 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.557 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.558 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.558 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.558 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.558 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.558 INFO:teuthology.orchestra.run.smithi087.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-13T17:24:13.558 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-13T17:24:13.558 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.558 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.558 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.558 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-09-13T17:24:13.558 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.558 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.558 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.558 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.559 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.559 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.559 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.559 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.559 INFO:teuthology.orchestra.run.smithi087.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-13T17:24:13.559 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-13T17:24:13.559 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.559 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.559 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.559 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-09-13T17:24:13.559 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.559 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.559 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.559 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.560 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.560 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.560 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.560 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.560 INFO:teuthology.orchestra.run.smithi087.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-13T17:24:13.560 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-13T17:24:13.560 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.560 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.560 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.560 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5", 2024-09-13T17:24:13.560 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.560 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.560 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.561 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.561 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.561 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.561 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.561 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.561 INFO:teuthology.orchestra.run.smithi087.stdout: "cross_origin_url": { 2024-09-13T17:24:13.561 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cross_origin_url", 2024-09-13T17:24:13.561 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.561 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.561 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.561 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.561 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.561 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.561 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.562 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.562 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.562 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.562 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.562 INFO:teuthology.orchestra.run.smithi087.stdout: "crt_file": { 2024-09-13T17:24:13.562 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crt_file", 2024-09-13T17:24:13.562 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.562 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.562 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.562 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.562 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.562 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.562 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.562 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.563 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.563 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.563 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.563 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.563 INFO:teuthology.orchestra.run.smithi087.stdout: "debug": { 2024-09-13T17:24:13.563 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "debug", 2024-09-13T17:24:13.563 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.563 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.563 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.563 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.563 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.563 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.563 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.563 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Enable/disable debug options", 2024-09-13T17:24:13.564 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.564 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.564 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.564 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.564 INFO:teuthology.orchestra.run.smithi087.stdout: "jwt_token_ttl": { 2024-09-13T17:24:13.564 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "jwt_token_ttl", 2024-09-13T17:24:13.564 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.564 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.564 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.564 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "28800", 2024-09-13T17:24:13.564 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.564 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.564 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.564 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.565 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.565 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.565 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.565 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.565 INFO:teuthology.orchestra.run.smithi087.stdout: "key_file": { 2024-09-13T17:24:13.565 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "key_file", 2024-09-13T17:24:13.565 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.565 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.565 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.565 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.565 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.565 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.565 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.565 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.566 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.566 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.566 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.566 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.566 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.566 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.566 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.566 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.566 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.566 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.566 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.566 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.566 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.567 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.567 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.567 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.567 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.567 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.567 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.567 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.567 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.567 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.567 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.567 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.567 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.567 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.567 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.568 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.568 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.568 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.568 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.568 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.568 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.568 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.568 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.568 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.568 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.568 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.568 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.568 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.568 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.569 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.569 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.569 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.569 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.569 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.569 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.569 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.569 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.569 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.569 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.569 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.569 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.569 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.570 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.570 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.570 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.570 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.570 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.570 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.570 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.570 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.570 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.570 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.570 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.570 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.570 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.571 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.571 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.571 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.571 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.571 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.571 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.571 INFO:teuthology.orchestra.run.smithi087.stdout: "motd": { 2024-09-13T17:24:13.571 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "motd", 2024-09-13T17:24:13.571 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.571 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.571 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.571 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.571 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.571 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.572 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.572 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "The message of the day", 2024-09-13T17:24:13.572 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.572 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.572 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.572 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.572 INFO:teuthology.orchestra.run.smithi087.stdout: "redirect_resolve_ip_addr": { 2024-09-13T17:24:13.572 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "redirect_resolve_ip_addr", 2024-09-13T17:24:13.572 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.572 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.572 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.572 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.572 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.572 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.573 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.573 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.573 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.573 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.573 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.573 INFO:teuthology.orchestra.run.smithi087.stdout: "server_addr": { 2024-09-13T17:24:13.573 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_addr", 2024-09-13T17:24:13.573 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.573 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.573 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.573 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "::", 2024-09-13T17:24:13.573 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.573 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.573 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.574 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.574 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.574 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.574 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.574 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.574 INFO:teuthology.orchestra.run.smithi087.stdout: "server_port": { 2024-09-13T17:24:13.574 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_port", 2024-09-13T17:24:13.574 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.574 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.574 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.574 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8080", 2024-09-13T17:24:13.574 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.574 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.574 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.575 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.575 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.575 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.575 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.575 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.575 INFO:teuthology.orchestra.run.smithi087.stdout: "ssl": { 2024-09-13T17:24:13.575 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ssl", 2024-09-13T17:24:13.575 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.575 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.575 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.575 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.575 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.575 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.575 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.576 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.576 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.576 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.576 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.576 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.576 INFO:teuthology.orchestra.run.smithi087.stdout: "ssl_server_port": { 2024-09-13T17:24:13.576 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ssl_server_port", 2024-09-13T17:24:13.576 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.576 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.576 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.576 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8443", 2024-09-13T17:24:13.576 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.576 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.576 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.576 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.577 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.577 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.577 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.577 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.577 INFO:teuthology.orchestra.run.smithi087.stdout: "standby_behaviour": { 2024-09-13T17:24:13.577 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "standby_behaviour", 2024-09-13T17:24:13.577 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.577 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.577 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.577 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "redirect", 2024-09-13T17:24:13.577 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.577 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.577 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.577 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.578 INFO:teuthology.orchestra.run.smithi087.stdout: "redirect" 2024-09-13T17:24:13.578 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.578 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.578 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.578 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.578 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.578 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.578 INFO:teuthology.orchestra.run.smithi087.stdout: "standby_error_status_code": { 2024-09-13T17:24:13.578 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "standby_error_status_code", 2024-09-13T17:24:13.578 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.578 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.578 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.578 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "500", 2024-09-13T17:24:13.578 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "400", 2024-09-13T17:24:13.579 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "599", 2024-09-13T17:24:13.579 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.579 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.579 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.579 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.579 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.579 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.579 INFO:teuthology.orchestra.run.smithi087.stdout: "url_prefix": { 2024-09-13T17:24:13.579 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "url_prefix", 2024-09-13T17:24:13.579 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.579 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.579 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.579 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.580 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.580 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.580 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.580 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.580 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.580 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.580 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.580 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.580 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.580 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.580 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.580 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "devicehealth", 2024-09-13T17:24:13.580 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.581 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.581 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.581 INFO:teuthology.orchestra.run.smithi087.stdout: "enable_monitoring": { 2024-09-13T17:24:13.581 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "enable_monitoring", 2024-09-13T17:24:13.581 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.581 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.581 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.581 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.581 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.582 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.582 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.582 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "monitor device health metrics", 2024-09-13T17:24:13.582 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.582 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.582 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.582 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.582 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.582 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.582 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.582 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.582 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.582 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.582 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.583 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.583 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.583 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.583 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.583 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.583 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.583 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.583 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.583 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.583 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.583 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.583 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.583 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.583 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.584 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.584 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.584 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.584 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.584 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.584 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.584 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.584 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.584 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.584 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.584 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.584 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.584 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.584 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.585 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.585 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.585 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.585 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.585 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.585 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.585 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.585 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.585 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.585 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.585 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.585 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.585 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.585 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.586 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.586 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.586 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.586 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.586 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.586 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.586 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.586 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.586 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.586 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.586 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.586 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.586 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.586 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.587 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.587 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.587 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.587 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.587 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.587 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.587 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.587 INFO:teuthology.orchestra.run.smithi087.stdout: "mark_out_threshold": { 2024-09-13T17:24:13.587 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mark_out_threshold", 2024-09-13T17:24:13.587 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:13.587 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.587 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.587 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "2419200", 2024-09-13T17:24:13.587 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.588 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.588 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.588 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-13T17:24:13.588 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.588 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.588 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.588 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.588 INFO:teuthology.orchestra.run.smithi087.stdout: "pool_name": { 2024-09-13T17:24:13.588 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "pool_name", 2024-09-13T17:24:13.588 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.588 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.588 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.588 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "device_health_metrics", 2024-09-13T17:24:13.588 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.588 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.589 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.589 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-13T17:24:13.589 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.589 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.589 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.589 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.589 INFO:teuthology.orchestra.run.smithi087.stdout: "retention_period": { 2024-09-13T17:24:13.589 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "retention_period", 2024-09-13T17:24:13.589 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:13.589 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.589 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.589 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "15552000", 2024-09-13T17:24:13.589 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.589 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.590 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.590 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how long to retain device health metrics", 2024-09-13T17:24:13.590 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.590 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.590 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.590 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.590 INFO:teuthology.orchestra.run.smithi087.stdout: "scrape_frequency": { 2024-09-13T17:24:13.590 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "scrape_frequency", 2024-09-13T17:24:13.590 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:13.590 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.590 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.590 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "86400", 2024-09-13T17:24:13.590 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.590 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.590 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.591 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-13T17:24:13.591 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.591 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.591 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.591 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.591 INFO:teuthology.orchestra.run.smithi087.stdout: "self_heal": { 2024-09-13T17:24:13.591 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "self_heal", 2024-09-13T17:24:13.591 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.591 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.591 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.591 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.591 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.591 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.591 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.592 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-13T17:24:13.592 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.592 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.592 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.592 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.592 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-09-13T17:24:13.592 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-09-13T17:24:13.592 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:13.592 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.592 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.592 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-09-13T17:24:13.592 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.592 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.592 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.593 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to wake up and check device health", 2024-09-13T17:24:13.593 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.593 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.593 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.593 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.593 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_threshold": { 2024-09-13T17:24:13.593 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_threshold", 2024-09-13T17:24:13.593 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:13.593 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.593 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.593 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "7257600", 2024-09-13T17:24:13.594 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.594 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.594 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.594 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-13T17:24:13.594 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.594 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.594 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.594 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.594 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.594 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.594 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.594 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "diskprediction_local", 2024-09-13T17:24:13.594 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.594 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.595 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.595 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.595 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.595 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.595 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.595 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.595 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.595 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.595 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.595 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.595 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.595 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.595 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.595 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.596 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.596 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.596 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.596 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.596 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.596 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.596 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.596 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.596 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.596 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.596 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.596 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.596 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.596 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.597 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.597 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.597 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.597 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.597 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.597 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.597 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.597 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.597 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.597 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.597 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.597 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.597 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.597 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.598 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.598 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.598 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.598 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.598 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.598 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.598 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.598 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.598 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.598 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.598 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.598 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.598 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.598 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.599 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.599 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.599 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.599 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.599 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.599 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.599 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.599 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.599 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.599 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.599 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.599 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.599 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.599 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.600 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.600 INFO:teuthology.orchestra.run.smithi087.stdout: "predict_interval": { 2024-09-13T17:24:13.600 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "predict_interval", 2024-09-13T17:24:13.600 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.600 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.600 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.600 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "86400", 2024-09-13T17:24:13.600 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.600 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.600 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.600 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.600 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.600 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.600 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.601 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.601 INFO:teuthology.orchestra.run.smithi087.stdout: "predictor_model": { 2024-09-13T17:24:13.601 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "predictor_model", 2024-09-13T17:24:13.601 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.601 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.601 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.601 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "prophetstor", 2024-09-13T17:24:13.601 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.601 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.601 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.601 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.601 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.601 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.601 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.602 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-09-13T17:24:13.602 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-09-13T17:24:13.602 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.602 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.602 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.602 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-09-13T17:24:13.602 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.602 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.602 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.602 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.602 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.602 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.602 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.602 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.603 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.603 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.603 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.603 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "influx", 2024-09-13T17:24:13.603 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": false, 2024-09-13T17:24:13.603 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "influxdb python module not found", 2024-09-13T17:24:13.603 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.603 INFO:teuthology.orchestra.run.smithi087.stdout: "batch_size": { 2024-09-13T17:24:13.603 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "batch_size", 2024-09-13T17:24:13.603 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.603 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.603 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.603 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5000", 2024-09-13T17:24:13.603 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.604 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.604 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.604 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-13T17:24:13.604 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.604 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.604 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.604 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.604 INFO:teuthology.orchestra.run.smithi087.stdout: "database": { 2024-09-13T17:24:13.604 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "database", 2024-09-13T17:24:13.604 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.604 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.604 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.604 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "ceph", 2024-09-13T17:24:13.604 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.605 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.605 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.605 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-13T17:24:13.605 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.605 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.605 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.605 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": { 2024-09-13T17:24:13.605 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "hostname", 2024-09-13T17:24:13.605 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.605 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.605 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.605 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.605 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.606 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.606 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.606 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "InfluxDB server hostname", 2024-09-13T17:24:13.606 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.606 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.606 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.606 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-09-13T17:24:13.606 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-09-13T17:24:13.606 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:13.606 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.606 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.606 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "30", 2024-09-13T17:24:13.606 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "5", 2024-09-13T17:24:13.607 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.607 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.607 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-13T17:24:13.607 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.607 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.607 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.607 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.607 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.607 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.607 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.607 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.607 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.607 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.608 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.608 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.608 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.608 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.608 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.608 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.608 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.608 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.608 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.608 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.608 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.608 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.608 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.608 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.609 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.609 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.609 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.609 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.609 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.609 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.609 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.609 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.609 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.609 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.609 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.609 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.609 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.610 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.610 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.610 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.610 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.610 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.610 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.610 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.610 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.610 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.610 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.610 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.610 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.610 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.611 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.611 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.611 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.611 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.611 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.611 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.611 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.611 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.611 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.611 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.611 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.611 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.611 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.611 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.611 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.612 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.612 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.612 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.612 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.612 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.612 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.612 INFO:teuthology.orchestra.run.smithi087.stdout: "password": { 2024-09-13T17:24:13.612 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "password", 2024-09-13T17:24:13.612 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.612 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.612 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.612 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.613 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.613 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.613 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.613 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "password of InfluxDB server user", 2024-09-13T17:24:13.613 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.613 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.613 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.613 INFO:teuthology.orchestra.run.smithi087.stdout: "port": { 2024-09-13T17:24:13.613 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "port", 2024-09-13T17:24:13.613 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.613 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.613 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.613 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8086", 2024-09-13T17:24:13.614 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.614 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.614 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.614 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "InfluxDB server port", 2024-09-13T17:24:13.614 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.614 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.614 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.614 INFO:teuthology.orchestra.run.smithi087.stdout: "ssl": { 2024-09-13T17:24:13.614 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ssl", 2024-09-13T17:24:13.614 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.614 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.614 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.614 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "false", 2024-09-13T17:24:13.614 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.615 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.615 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.615 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T17:24:13.615 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.615 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.615 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.615 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.615 INFO:teuthology.orchestra.run.smithi087.stdout: "threads": { 2024-09-13T17:24:13.615 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "threads", 2024-09-13T17:24:13.615 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.615 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.615 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.615 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5", 2024-09-13T17:24:13.615 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1", 2024-09-13T17:24:13.616 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "32", 2024-09-13T17:24:13.616 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.616 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-13T17:24:13.616 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.616 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.616 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.616 INFO:teuthology.orchestra.run.smithi087.stdout: "username": { 2024-09-13T17:24:13.616 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "username", 2024-09-13T17:24:13.616 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.616 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.616 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.616 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.616 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.617 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.617 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.617 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "username of InfluxDB server user", 2024-09-13T17:24:13.617 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.617 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.617 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.617 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.617 INFO:teuthology.orchestra.run.smithi087.stdout: "verify_ssl": { 2024-09-13T17:24:13.617 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "verify_ssl", 2024-09-13T17:24:13.617 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.617 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.617 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.617 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "true", 2024-09-13T17:24:13.617 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.617 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.618 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.618 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T17:24:13.618 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.618 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.618 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.618 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.618 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.618 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.618 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "insights", 2024-09-13T17:24:13.618 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.618 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.618 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.618 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.619 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.619 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.619 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.619 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.619 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.619 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.619 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.619 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.619 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.619 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.619 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.619 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.619 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.619 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.620 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.620 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.620 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.620 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.620 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.620 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.620 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.620 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.620 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.620 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.620 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.620 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.621 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.621 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.621 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.621 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.621 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.621 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.621 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.621 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.621 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.621 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.621 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.621 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.621 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.621 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.622 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.622 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.622 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.622 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.622 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.622 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.622 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.622 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.622 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.622 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.622 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.622 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.622 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.622 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.623 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.623 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.623 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.623 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.623 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.623 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.623 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.623 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.623 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.623 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.623 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.623 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.623 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.623 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.624 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.624 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.624 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.624 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.624 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "iostat", 2024-09-13T17:24:13.624 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.624 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.624 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.624 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.624 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.624 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.624 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.624 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.625 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.625 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.625 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.625 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.625 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.625 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.625 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.625 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.625 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.625 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.625 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.625 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.625 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.625 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.626 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.626 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.626 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.626 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.626 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.626 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.626 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.626 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.626 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.626 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.626 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.626 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.626 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.626 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.627 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.627 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.627 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.627 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.627 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.627 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.627 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.627 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.627 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.627 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.627 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.627 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.627 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.627 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.627 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.628 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.628 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.628 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.628 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.628 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.628 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.628 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.628 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.628 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.628 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.628 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.628 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.628 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.629 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.629 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.629 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.629 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.629 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.629 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.629 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.629 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.629 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.629 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.629 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.629 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "k8sevents", 2024-09-13T17:24:13.629 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.629 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.630 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.630 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_event_retention_days": { 2024-09-13T17:24:13.630 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ceph_event_retention_days", 2024-09-13T17:24:13.630 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.630 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.630 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.630 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "7", 2024-09-13T17:24:13.630 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.630 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.630 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.630 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-13T17:24:13.630 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.630 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.630 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.631 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.631 INFO:teuthology.orchestra.run.smithi087.stdout: "config_check_secs": { 2024-09-13T17:24:13.631 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "config_check_secs", 2024-09-13T17:24:13.631 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.631 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.631 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.631 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-09-13T17:24:13.631 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "10", 2024-09-13T17:24:13.631 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.632 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.632 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-13T17:24:13.632 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.632 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.632 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.632 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.632 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.632 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.632 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.632 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.632 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.632 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.632 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.632 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.633 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.633 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.633 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.633 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.633 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.633 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.633 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.633 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.633 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.633 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.633 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.633 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.633 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.633 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.634 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.634 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.634 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.634 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.634 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.634 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.634 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.634 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.634 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.634 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.634 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.634 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.635 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.635 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.635 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.635 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.635 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.635 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.635 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.635 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.635 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.635 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.635 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.635 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.635 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.635 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.636 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.636 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.636 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.636 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.636 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.636 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.636 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.636 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.636 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.636 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.636 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.636 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.637 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.637 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.637 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.637 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.637 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.637 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.637 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.637 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.637 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.637 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "localpool", 2024-09-13T17:24:13.637 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.637 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.637 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.638 INFO:teuthology.orchestra.run.smithi087.stdout: "failure_domain": { 2024-09-13T17:24:13.638 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "failure_domain", 2024-09-13T17:24:13.638 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.638 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.638 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.638 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "host", 2024-09-13T17:24:13.638 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.638 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.638 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.638 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "failure domain for any created local pool", 2024-09-13T17:24:13.638 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-13T17:24:13.638 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.638 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.639 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.639 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.639 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.639 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.639 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.639 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.639 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.639 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.639 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.639 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.639 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.639 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.639 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.639 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.640 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.640 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.640 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.640 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.640 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.640 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.640 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.640 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.640 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.640 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.640 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.640 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.641 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.641 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.641 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.641 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.641 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.641 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.641 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.641 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.641 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.641 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.641 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.641 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.641 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.642 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.642 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.642 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.642 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.642 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.642 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.642 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.642 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.642 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.642 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.642 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.642 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.642 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.642 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.643 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.643 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.643 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.643 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.643 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.643 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.643 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.643 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.643 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.643 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.643 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.643 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.643 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.644 INFO:teuthology.orchestra.run.smithi087.stdout: "min_size": { 2024-09-13T17:24:13.644 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "min_size", 2024-09-13T17:24:13.644 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.644 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.644 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.644 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.644 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.644 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.644 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.644 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "default min_size for any created local pool", 2024-09-13T17:24:13.644 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-13T17:24:13.644 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.644 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.645 INFO:teuthology.orchestra.run.smithi087.stdout: "num_rep": { 2024-09-13T17:24:13.645 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "num_rep", 2024-09-13T17:24:13.645 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.645 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.645 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.645 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "3", 2024-09-13T17:24:13.645 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.645 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.645 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.645 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "default replica count for any created local pool", 2024-09-13T17:24:13.645 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.645 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.645 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.646 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_num": { 2024-09-13T17:24:13.646 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "pg_num", 2024-09-13T17:24:13.646 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.646 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.646 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.646 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "128", 2024-09-13T17:24:13.646 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.646 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.646 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.646 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "default pg_num for any created local pool", 2024-09-13T17:24:13.646 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.646 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.646 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.647 INFO:teuthology.orchestra.run.smithi087.stdout: "prefix": { 2024-09-13T17:24:13.647 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "prefix", 2024-09-13T17:24:13.647 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.647 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.647 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.647 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.647 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.647 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.647 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.647 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "name prefix for any created local pool", 2024-09-13T17:24:13.647 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.647 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.647 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.647 INFO:teuthology.orchestra.run.smithi087.stdout: "subtree": { 2024-09-13T17:24:13.648 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "subtree", 2024-09-13T17:24:13.648 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.648 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.648 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.648 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "rack", 2024-09-13T17:24:13.648 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.648 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.648 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.648 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-13T17:24:13.648 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-13T17:24:13.648 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.648 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.649 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.649 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.649 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mds_autoscaler", 2024-09-13T17:24:13.649 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.649 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.649 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.649 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.649 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.649 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.649 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.649 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.650 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.650 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.650 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.650 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.650 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.650 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.650 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.650 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.650 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.650 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.650 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.650 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.650 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.650 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.651 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.651 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.651 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.651 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.651 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.651 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.651 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.651 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.651 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.651 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.651 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.651 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.651 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.651 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.651 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.652 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.652 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.652 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.652 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.652 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.652 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.652 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.652 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.652 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.652 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.652 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.652 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.652 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.652 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.653 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.653 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.653 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.653 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.653 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.653 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.653 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.653 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.653 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.653 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.653 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.653 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.653 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.654 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.654 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.654 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.654 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.654 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.654 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.654 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.654 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.654 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.654 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mirroring", 2024-09-13T17:24:13.654 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.654 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.655 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.655 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.655 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.655 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.655 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.655 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.655 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.655 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.655 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.655 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.655 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.655 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.655 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.655 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.655 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.656 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.656 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.656 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.656 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.656 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.656 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.656 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.656 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.656 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.656 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.656 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.656 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.656 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.657 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.657 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.657 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.657 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.657 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.657 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.657 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.657 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.657 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.657 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.657 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.657 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.657 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.657 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.658 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.658 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.658 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.658 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.658 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.658 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.658 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.658 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.658 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.658 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.658 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.658 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.658 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.659 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.659 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.659 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.659 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.659 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.659 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.659 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.659 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.659 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.659 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.659 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.659 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.659 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.659 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.660 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.660 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "nfs", 2024-09-13T17:24:13.660 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.660 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.660 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.660 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.660 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.660 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.660 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.660 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.660 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.660 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.661 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.661 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.661 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.661 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.661 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.661 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.661 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.661 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.661 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.661 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.661 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.661 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.661 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.661 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.662 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.662 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.662 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.662 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.662 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.662 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.662 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.662 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.662 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.662 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.662 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.662 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.663 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.663 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.663 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.663 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.663 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.663 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.663 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.663 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.663 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.663 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.663 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.663 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.663 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.663 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.664 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.664 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.664 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.664 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.664 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.664 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.664 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.664 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.664 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.664 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.664 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.664 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.664 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.665 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.665 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.665 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.665 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.665 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.665 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.665 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.665 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.665 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.665 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "orchestrator", 2024-09-13T17:24:13.665 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.665 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.666 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.666 INFO:teuthology.orchestra.run.smithi087.stdout: "fail_fs": { 2024-09-13T17:24:13.666 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "fail_fs", 2024-09-13T17:24:13.666 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.666 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.666 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.666 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.666 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.666 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.666 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.666 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-13T17:24:13.666 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.666 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.666 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.667 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.667 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.667 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.667 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.667 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.667 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.667 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.667 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.667 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.667 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.667 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.667 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.667 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.667 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.668 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.668 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.668 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.668 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.668 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.668 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.668 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.668 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.668 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.668 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.668 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.668 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.668 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.669 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.669 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.669 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.669 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.669 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.669 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.669 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.669 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.669 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.669 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.669 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.669 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.669 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.670 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.670 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.670 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.670 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.670 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.670 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.670 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.670 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.670 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.670 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.670 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.670 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.670 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.670 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.671 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.671 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.671 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.671 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.671 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.671 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.671 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.671 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.671 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.671 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.671 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.671 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.671 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.671 INFO:teuthology.orchestra.run.smithi087.stdout: "orchestrator": { 2024-09-13T17:24:13.672 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "orchestrator", 2024-09-13T17:24:13.672 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.672 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.672 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.672 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.672 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.672 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.672 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.672 INFO:teuthology.orchestra.run.smithi087.stdout: "cephadm", 2024-09-13T17:24:13.672 INFO:teuthology.orchestra.run.smithi087.stdout: "rook", 2024-09-13T17:24:13.672 INFO:teuthology.orchestra.run.smithi087.stdout: "test_orchestrator" 2024-09-13T17:24:13.672 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.672 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Orchestrator backend", 2024-09-13T17:24:13.672 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.673 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.673 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.673 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.673 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.673 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "osd_perf_query", 2024-09-13T17:24:13.673 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.673 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.673 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.673 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.673 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.673 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.673 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.673 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.674 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.674 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.674 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.674 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.674 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.674 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.674 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.674 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.674 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.674 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.674 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.674 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.674 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.674 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.675 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.675 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.675 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.675 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.675 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.675 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.675 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.675 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.675 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.675 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.675 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.675 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.675 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.675 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.676 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.676 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.676 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.676 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.676 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.676 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.676 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.676 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.676 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.676 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.676 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.677 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.677 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.677 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.677 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.677 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.677 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.677 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.677 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.677 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.677 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.677 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.677 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.677 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.677 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.678 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.678 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.678 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.678 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.678 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.678 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.678 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.678 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.678 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.678 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.678 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.678 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "osd_support", 2024-09-13T17:24:13.678 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.679 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.679 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.679 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.679 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.679 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.679 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.679 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.679 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.679 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.679 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.679 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.680 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.680 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.680 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.680 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.680 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.680 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.680 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.680 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.680 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.680 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.680 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.680 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.681 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.681 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.681 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.681 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.681 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.681 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.681 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.681 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.682 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.682 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.682 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.682 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.682 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.682 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.682 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.682 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.682 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.682 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.682 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.683 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.683 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.683 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.683 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.683 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.683 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.683 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.683 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.683 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.683 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.683 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.683 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.683 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.684 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.684 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.684 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.684 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.684 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.684 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.684 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.684 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.684 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.684 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.684 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.684 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.685 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.685 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.685 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.685 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "pg_autoscaler", 2024-09-13T17:24:13.685 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.685 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.685 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.685 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.685 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.685 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.685 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.685 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.686 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.686 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.686 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.686 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.686 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.686 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.686 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.686 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.686 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.686 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.686 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.686 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.686 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.687 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.687 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.687 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.687 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.687 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.687 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.687 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.687 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.687 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.687 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.687 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.687 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.687 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.688 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.688 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.688 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.688 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.688 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.688 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.688 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.688 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.688 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.688 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.688 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.688 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.688 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.689 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.689 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.689 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.689 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.689 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.689 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.689 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.689 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.689 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.689 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.689 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.689 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.690 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.690 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.690 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.690 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.690 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.690 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.690 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.690 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.690 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.690 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.690 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-09-13T17:24:13.690 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-09-13T17:24:13.690 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:13.691 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.691 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.691 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-09-13T17:24:13.691 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.691 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.691 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.691 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.691 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.691 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.691 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.691 INFO:teuthology.orchestra.run.smithi087.stdout: "threshold": { 2024-09-13T17:24:13.692 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "threshold", 2024-09-13T17:24:13.692 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-09-13T17:24:13.692 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.692 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.692 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "3.0", 2024-09-13T17:24:13.692 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1.0", 2024-09-13T17:24:13.692 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.692 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.692 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "scaling threshold", 2024-09-13T17:24:13.692 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-13T17:24:13.692 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.692 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.692 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.693 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.693 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "progress", 2024-09-13T17:24:13.693 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.693 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.693 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.693 INFO:teuthology.orchestra.run.smithi087.stdout: "allow_pg_recovery_event": { 2024-09-13T17:24:13.693 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "allow_pg_recovery_event", 2024-09-13T17:24:13.693 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.693 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.693 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.693 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.694 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.694 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.694 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.694 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-13T17:24:13.694 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.694 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.694 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.694 INFO:teuthology.orchestra.run.smithi087.stdout: "enabled": { 2024-09-13T17:24:13.694 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "enabled", 2024-09-13T17:24:13.694 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.694 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.694 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.694 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.695 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.695 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.695 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.695 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.695 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.695 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.695 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.695 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.695 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.695 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.695 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.695 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.695 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.696 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.696 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.696 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.696 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.696 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.696 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.696 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.696 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.696 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.696 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.696 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.696 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.696 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.697 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.697 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.697 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.697 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.697 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.697 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.697 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.697 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.697 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.697 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.697 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.697 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.697 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.698 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.698 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.698 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.698 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.698 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.698 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.698 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.698 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.698 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.698 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.698 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.698 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.698 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.699 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.699 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.699 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.699 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.699 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.699 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.699 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.699 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.699 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.699 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.699 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.699 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.699 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.700 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.700 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.700 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.700 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.700 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.700 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.700 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.700 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.700 INFO:teuthology.orchestra.run.smithi087.stdout: "max_completed_events": { 2024-09-13T17:24:13.700 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_completed_events", 2024-09-13T17:24:13.700 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.700 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.701 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.701 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "50", 2024-09-13T17:24:13.701 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.701 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.701 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.701 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "number of past completed events to remember", 2024-09-13T17:24:13.701 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.701 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.701 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.701 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-09-13T17:24:13.701 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-09-13T17:24:13.701 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:13.701 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.702 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.702 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5", 2024-09-13T17:24:13.702 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.702 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.702 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.702 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how long the module is going to sleep", 2024-09-13T17:24:13.702 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.702 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.702 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.702 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.702 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.702 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "prometheus", 2024-09-13T17:24:13.703 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.703 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.703 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.703 INFO:teuthology.orchestra.run.smithi087.stdout: "cache": { 2024-09-13T17:24:13.703 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cache", 2024-09-13T17:24:13.703 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.703 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.703 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.703 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.703 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.703 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.703 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.703 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.703 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.704 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.704 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.704 INFO:teuthology.orchestra.run.smithi087.stdout: "exclude_perf_counters": { 2024-09-13T17:24:13.704 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "exclude_perf_counters", 2024-09-13T17:24:13.704 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.704 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.704 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.704 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.704 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.704 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.704 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.704 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-13T17:24:13.705 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-13T17:24:13.705 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.705 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.705 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.705 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.705 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.705 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.705 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.705 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.705 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.705 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.705 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.705 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.705 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.706 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.706 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.706 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.706 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.706 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.706 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.706 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.706 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.706 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.706 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.706 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.706 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.706 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.707 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.707 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.707 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.707 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.707 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.707 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.707 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.707 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.707 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.707 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.707 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.707 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.707 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.707 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.708 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.708 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.708 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.708 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.708 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.708 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.708 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.708 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.708 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.708 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.708 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.708 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.708 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.708 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.708 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.709 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.709 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.709 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.709 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.709 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.709 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.709 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.709 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.709 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.709 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.709 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.709 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.710 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.710 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.710 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_stats_pools": { 2024-09-13T17:24:13.710 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rbd_stats_pools", 2024-09-13T17:24:13.710 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.710 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.710 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.710 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.710 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.710 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.710 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.710 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.710 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.711 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.711 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.711 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-13T17:24:13.711 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-13T17:24:13.711 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.711 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.711 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.711 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "300", 2024-09-13T17:24:13.711 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.711 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.711 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.711 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.711 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.711 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.712 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.712 INFO:teuthology.orchestra.run.smithi087.stdout: "scrape_interval": { 2024-09-13T17:24:13.712 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "scrape_interval", 2024-09-13T17:24:13.712 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-09-13T17:24:13.712 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.712 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.712 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "15.0", 2024-09-13T17:24:13.712 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.712 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.712 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.712 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.712 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.713 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.713 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.713 INFO:teuthology.orchestra.run.smithi087.stdout: "server_addr": { 2024-09-13T17:24:13.713 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_addr", 2024-09-13T17:24:13.713 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.713 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.713 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.713 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "::", 2024-09-13T17:24:13.713 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.713 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.713 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.713 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-13T17:24:13.714 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.714 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.714 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.714 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.714 INFO:teuthology.orchestra.run.smithi087.stdout: "server_port": { 2024-09-13T17:24:13.714 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_port", 2024-09-13T17:24:13.714 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.714 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.714 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.714 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "9283", 2024-09-13T17:24:13.714 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.714 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.714 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.714 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-13T17:24:13.715 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.715 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.715 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.715 INFO:teuthology.orchestra.run.smithi087.stdout: "stale_cache_strategy": { 2024-09-13T17:24:13.715 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "stale_cache_strategy", 2024-09-13T17:24:13.715 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.715 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.715 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.715 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "log", 2024-09-13T17:24:13.715 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.715 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.715 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.715 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.716 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.716 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.716 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.716 INFO:teuthology.orchestra.run.smithi087.stdout: "standby_behaviour": { 2024-09-13T17:24:13.716 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "standby_behaviour", 2024-09-13T17:24:13.716 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.716 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.716 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.716 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "default", 2024-09-13T17:24:13.716 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.716 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.716 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.717 INFO:teuthology.orchestra.run.smithi087.stdout: "default", 2024-09-13T17:24:13.717 INFO:teuthology.orchestra.run.smithi087.stdout: "error" 2024-09-13T17:24:13.717 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.717 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.717 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.717 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.717 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.717 INFO:teuthology.orchestra.run.smithi087.stdout: "standby_error_status_code": { 2024-09-13T17:24:13.717 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "standby_error_status_code", 2024-09-13T17:24:13.717 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.717 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.717 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.717 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "500", 2024-09-13T17:24:13.718 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "400", 2024-09-13T17:24:13.718 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "599", 2024-09-13T17:24:13.718 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.718 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.718 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.718 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.718 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.718 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.718 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.718 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rbd_support", 2024-09-13T17:24:13.718 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.719 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.719 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.719 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.719 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.719 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.719 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.719 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.719 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.719 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.719 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.719 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.719 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.719 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.719 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.720 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.720 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.720 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.720 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.720 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.720 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.720 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.720 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.720 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.720 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.720 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.720 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.721 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.721 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.721 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.721 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.721 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.721 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.721 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.721 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.721 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.721 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.721 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.721 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.721 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.722 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.722 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.722 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.722 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.722 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.722 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.722 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.722 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.722 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.722 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.722 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.722 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.722 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.723 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.723 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.723 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.723 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.723 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.723 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.723 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.723 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.723 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.723 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.723 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.723 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.723 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.724 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.724 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.724 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.724 INFO:teuthology.orchestra.run.smithi087.stdout: "max_concurrent_snap_create": { 2024-09-13T17:24:13.724 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_concurrent_snap_create", 2024-09-13T17:24:13.724 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.724 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.724 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.724 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-09-13T17:24:13.724 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.724 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.724 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.725 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.725 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.725 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.725 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.725 INFO:teuthology.orchestra.run.smithi087.stdout: "mirror_snapshot_schedule": { 2024-09-13T17:24:13.725 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mirror_snapshot_schedule", 2024-09-13T17:24:13.725 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.725 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.725 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.725 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.725 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.725 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.726 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.726 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.726 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.726 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.726 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.726 INFO:teuthology.orchestra.run.smithi087.stdout: "trash_purge_schedule": { 2024-09-13T17:24:13.726 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "trash_purge_schedule", 2024-09-13T17:24:13.726 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.726 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.726 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.726 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.726 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.726 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.727 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.727 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.727 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.727 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.727 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.727 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.727 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.727 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "restful", 2024-09-13T17:24:13.727 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.727 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.727 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.728 INFO:teuthology.orchestra.run.smithi087.stdout: "enable_auth": { 2024-09-13T17:24:13.728 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "enable_auth", 2024-09-13T17:24:13.728 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.728 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.728 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.728 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.728 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.728 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.728 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.728 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.728 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.728 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.728 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.729 INFO:teuthology.orchestra.run.smithi087.stdout: "key_file": { 2024-09-13T17:24:13.729 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "key_file", 2024-09-13T17:24:13.729 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.729 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.729 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.729 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.729 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.729 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.729 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.729 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.729 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.729 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.729 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.730 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.730 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.730 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.730 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.730 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.730 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.730 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.730 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.730 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.730 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.730 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.730 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.730 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.731 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.731 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.731 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.731 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.731 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.731 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.731 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.731 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.731 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.731 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.731 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.731 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.731 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.732 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.732 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.732 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.732 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.732 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.732 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.732 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.732 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.732 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.733 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.733 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.733 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.733 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.733 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.733 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.733 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.733 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.734 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.734 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.734 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.734 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.734 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.734 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.734 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.734 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.734 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.734 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.734 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.734 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.734 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.735 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.735 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.735 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.735 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.735 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.735 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.735 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.735 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.735 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.735 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.735 INFO:teuthology.orchestra.run.smithi087.stdout: "server_addr": { 2024-09-13T17:24:13.735 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_addr", 2024-09-13T17:24:13.736 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.736 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.736 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.736 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.736 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.736 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.736 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.736 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.736 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.736 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.736 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.736 INFO:teuthology.orchestra.run.smithi087.stdout: "server_port": { 2024-09-13T17:24:13.737 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_port", 2024-09-13T17:24:13.737 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.740 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.740 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.741 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.741 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.741 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.741 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.741 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.741 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.741 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.741 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.741 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.741 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.741 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rgw", 2024-09-13T17:24:13.742 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.742 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.742 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.742 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.742 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.742 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.742 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.742 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.742 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.742 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.742 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.742 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.742 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.743 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.743 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.743 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.743 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.743 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.743 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.743 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.743 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.743 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.743 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.743 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.743 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.744 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.744 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.744 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.744 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.744 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.744 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.744 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.744 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.744 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.744 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.744 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.744 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.745 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.745 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.745 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.745 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.745 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.745 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.745 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.745 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.745 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.745 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.745 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.745 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.745 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.745 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.746 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.746 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.746 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.746 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.746 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.746 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.746 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.746 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.746 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.746 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.746 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.746 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.746 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.747 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.747 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.747 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.747 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.747 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.747 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.747 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.747 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rook", 2024-09-13T17:24:13.747 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.747 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.747 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.747 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.748 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.748 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.748 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.748 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.748 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.748 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.748 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.748 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.748 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.748 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.748 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.748 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.748 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.748 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.749 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.749 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.749 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.749 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.749 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.749 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.749 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.749 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.749 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.749 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.749 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.749 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.749 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.750 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.750 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.750 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.750 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.750 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.750 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.750 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.750 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.750 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.750 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.750 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.750 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.750 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.750 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.751 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.751 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.751 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.751 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.751 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.751 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.751 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.751 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.751 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.751 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.751 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.752 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.752 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.752 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.752 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.752 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.752 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.752 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.752 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.752 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.752 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.752 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.752 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.753 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.753 INFO:teuthology.orchestra.run.smithi087.stdout: "storage_class": { 2024-09-13T17:24:13.753 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "storage_class", 2024-09-13T17:24:13.753 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.753 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.753 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.753 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "local", 2024-09-13T17:24:13.753 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.753 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.753 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.753 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-13T17:24:13.753 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.753 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.754 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.754 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.754 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.754 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "selftest", 2024-09-13T17:24:13.754 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.754 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.754 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.754 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.754 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.754 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.754 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.754 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.755 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.755 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.755 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.755 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.755 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.755 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.755 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.755 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.755 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.755 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.755 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.755 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.755 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.756 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.756 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.756 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.756 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.756 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.756 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.756 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.756 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.756 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.756 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.756 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.756 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.757 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.757 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.757 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.757 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.757 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.757 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.757 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.757 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.757 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.757 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.757 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.757 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.757 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.758 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.758 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.758 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.758 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.758 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.758 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.758 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.758 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.758 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.758 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.758 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.759 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.759 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.759 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.759 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.759 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.759 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.759 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.759 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.759 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.759 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.759 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.759 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.759 INFO:teuthology.orchestra.run.smithi087.stdout: "roption1": { 2024-09-13T17:24:13.759 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "roption1", 2024-09-13T17:24:13.760 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.760 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.760 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.760 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.760 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.760 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.760 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.760 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.760 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.760 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.760 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.760 INFO:teuthology.orchestra.run.smithi087.stdout: "roption2": { 2024-09-13T17:24:13.760 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "roption2", 2024-09-13T17:24:13.760 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.761 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.761 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.761 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "xyz", 2024-09-13T17:24:13.761 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.761 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.761 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.761 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.761 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.761 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.761 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.761 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption1": { 2024-09-13T17:24:13.761 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption1", 2024-09-13T17:24:13.762 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.762 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.762 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.762 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.762 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.762 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.762 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.762 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.762 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.762 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.762 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.762 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption2": { 2024-09-13T17:24:13.762 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption2", 2024-09-13T17:24:13.763 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.763 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.763 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.763 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.763 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.763 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.763 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.763 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.763 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.763 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.763 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.763 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption3": { 2024-09-13T17:24:13.763 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption3", 2024-09-13T17:24:13.764 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-09-13T17:24:13.764 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.764 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.764 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.764 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.764 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.764 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.764 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.764 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.764 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.764 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.764 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption4": { 2024-09-13T17:24:13.764 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption4", 2024-09-13T17:24:13.765 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.765 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.765 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.765 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.765 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.765 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.765 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.765 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.765 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.765 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.765 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.765 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption5": { 2024-09-13T17:24:13.765 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption5", 2024-09-13T17:24:13.766 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.766 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.766 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.766 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.766 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.766 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.766 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.766 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.766 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.766 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.766 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption6": { 2024-09-13T17:24:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption6", 2024-09-13T17:24:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.768 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption7": { 2024-09-13T17:24:13.768 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption7", 2024-09-13T17:24:13.768 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.768 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.768 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.768 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.768 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1", 2024-09-13T17:24:13.768 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "42", 2024-09-13T17:24:13.768 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.768 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.768 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.768 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.768 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.769 INFO:teuthology.orchestra.run.smithi087.stdout: "testkey": { 2024-09-13T17:24:13.769 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "testkey", 2024-09-13T17:24:13.769 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.769 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.769 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.769 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.769 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.769 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.769 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.769 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.769 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.769 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.769 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.770 INFO:teuthology.orchestra.run.smithi087.stdout: "testlkey": { 2024-09-13T17:24:13.770 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "testlkey", 2024-09-13T17:24:13.770 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.770 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.770 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.770 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.770 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.770 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.770 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.770 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.770 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.770 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.770 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.771 INFO:teuthology.orchestra.run.smithi087.stdout: "testnewline": { 2024-09-13T17:24:13.771 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "testnewline", 2024-09-13T17:24:13.771 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.771 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.771 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.771 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.771 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.771 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.771 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.771 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.771 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.771 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.771 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.772 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.772 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.772 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "snap_schedule", 2024-09-13T17:24:13.772 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.772 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.772 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.772 INFO:teuthology.orchestra.run.smithi087.stdout: "allow_m_granularity": { 2024-09-13T17:24:13.772 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "allow_m_granularity", 2024-09-13T17:24:13.772 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.772 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.772 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.772 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.773 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.773 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.773 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.773 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "allow minute scheduled snapshots", 2024-09-13T17:24:13.773 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.773 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.773 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.773 INFO:teuthology.orchestra.run.smithi087.stdout: "dump_on_update": { 2024-09-13T17:24:13.773 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "dump_on_update", 2024-09-13T17:24:13.773 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.773 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.773 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.773 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.774 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.774 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.774 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.774 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "dump database to debug log on update", 2024-09-13T17:24:13.774 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.774 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.774 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.774 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.774 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.774 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.774 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.774 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.775 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.775 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.775 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.775 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.775 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.775 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.775 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.775 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.775 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.775 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.775 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.775 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.775 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.775 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.776 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.776 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.776 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.776 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.776 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.776 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.776 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.776 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.776 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.776 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.776 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.776 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.776 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.777 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.777 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.777 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.777 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.777 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.777 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.777 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.777 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.777 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.777 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.777 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.777 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.778 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.778 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.778 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.778 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.778 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.778 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.778 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.778 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.778 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.778 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.778 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.778 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.778 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.779 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.779 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.779 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.779 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.779 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.779 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.779 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.779 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.779 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.779 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.779 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.779 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "stats", 2024-09-13T17:24:13.779 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.780 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.780 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.780 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.780 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.780 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.780 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.780 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.780 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.780 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.780 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.780 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.780 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.781 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.781 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.781 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.781 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.781 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.781 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.781 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.781 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.781 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.781 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.781 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.781 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.781 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.782 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.782 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.782 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.782 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.782 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.782 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.782 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.782 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.783 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.783 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.783 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.783 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.783 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.783 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.783 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.783 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.783 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.783 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.783 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.783 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.783 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.784 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.784 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.784 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.784 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.784 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.784 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.784 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.784 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.784 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.784 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.784 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.784 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.785 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.785 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.785 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.785 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.785 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.785 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.785 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.785 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.785 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.785 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.785 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.785 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.786 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "status", 2024-09-13T17:24:13.786 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.786 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.786 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.786 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.786 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.786 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.786 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.786 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.786 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.786 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.786 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.787 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.787 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.787 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.787 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.787 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.787 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.787 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.787 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.787 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.787 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.787 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.787 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.787 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.788 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.788 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.788 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.788 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.788 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.788 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.788 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.788 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.788 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.788 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.788 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.788 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.789 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.789 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.789 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.789 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.789 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.789 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.789 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.789 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.789 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.789 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.789 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.789 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.789 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.789 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.790 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.790 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.790 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.790 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.790 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.790 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.790 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.790 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.790 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.790 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.790 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.790 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.790 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.791 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.791 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.791 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.791 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.791 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.791 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.791 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.791 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.791 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "telegraf", 2024-09-13T17:24:13.791 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.791 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.792 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.792 INFO:teuthology.orchestra.run.smithi087.stdout: "address": { 2024-09-13T17:24:13.792 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "address", 2024-09-13T17:24:13.792 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.792 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.792 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.792 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-13T17:24:13.792 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.792 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.792 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.792 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.792 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.792 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.793 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.793 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-09-13T17:24:13.793 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-09-13T17:24:13.793 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:13.793 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.793 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.793 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "15", 2024-09-13T17:24:13.793 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.793 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.793 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.793 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.793 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.793 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.794 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.794 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.794 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.794 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.794 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.794 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.794 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.794 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.794 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.794 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.794 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.794 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.795 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.795 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.795 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.795 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.795 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.795 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.795 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.795 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.795 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.795 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.795 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.795 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.796 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.796 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.796 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.796 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.796 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.796 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.796 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.796 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.796 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.796 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.796 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.796 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.797 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.797 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.797 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.797 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.797 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.797 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.797 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.797 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.797 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.797 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.797 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.797 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.797 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.798 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.798 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.798 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.798 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.798 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.798 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.798 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.798 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.798 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.798 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.798 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.798 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.799 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.799 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.799 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.799 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.799 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.799 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.799 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.799 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.799 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "telemetry", 2024-09-13T17:24:13.799 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.799 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.799 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.800 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_basic": { 2024-09-13T17:24:13.800 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_basic", 2024-09-13T17:24:13.800 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.800 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.800 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.800 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.800 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.800 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.800 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.800 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-13T17:24:13.800 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.800 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.800 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_crash": { 2024-09-13T17:24:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_crash", 2024-09-13T17:24:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-13T17:24:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.801 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_device": { 2024-09-13T17:24:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_device", 2024-09-13T17:24:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-13T17:24:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.802 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.803 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.803 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_ident": { 2024-09-13T17:24:13.803 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_ident", 2024-09-13T17:24:13.803 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.803 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.803 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.803 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.803 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.803 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.803 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.803 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-13T17:24:13.803 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.803 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_perf": { 2024-09-13T17:24:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_perf", 2024-09-13T17:24:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-13T17:24:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.805 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.805 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.805 INFO:teuthology.orchestra.run.smithi087.stdout: "contact": { 2024-09-13T17:24:13.805 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "contact", 2024-09-13T17:24:13.805 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.805 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.805 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.805 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.805 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.805 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.805 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.805 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.805 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: "description": { 2024-09-13T17:24:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "description", 2024-09-13T17:24:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.806 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.807 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.807 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.807 INFO:teuthology.orchestra.run.smithi087.stdout: "device_url": { 2024-09-13T17:24:13.807 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "device_url", 2024-09-13T17:24:13.807 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.807 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.807 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.807 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-13T17:24:13.807 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.807 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.807 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.807 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.807 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: "enabled": { 2024-09-13T17:24:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "enabled", 2024-09-13T17:24:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.808 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-09-13T17:24:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-09-13T17:24:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "24", 2024-09-13T17:24:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "8", 2024-09-13T17:24:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.809 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: "last_opt_revision": { 2024-09-13T17:24:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "last_opt_revision", 2024-09-13T17:24:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "1", 2024-09-13T17:24:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.810 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: "leaderboard": { 2024-09-13T17:24:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "leaderboard", 2024-09-13T17:24:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.811 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: "leaderboard_description": { 2024-09-13T17:24:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "leaderboard_description", 2024-09-13T17:24:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.812 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.813 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.814 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.815 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.816 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.817 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: "organization": { 2024-09-13T17:24:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "organization", 2024-09-13T17:24:13.818 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: "proxy": { 2024-09-13T17:24:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "proxy", 2024-09-13T17:24:13.819 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: "url": { 2024-09-13T17:24:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "url", 2024-09-13T17:24:13.820 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-13T17:24:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "test_orchestrator", 2024-09-13T17:24:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.822 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.825 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.826 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "volumes", 2024-09-13T17:24:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.828 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.829 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.830 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.831 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.832 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.832 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.832 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.832 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.832 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.832 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.832 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: "max_concurrent_clones": { 2024-09-13T17:24:13.833 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_concurrent_clones", 2024-09-13T17:24:13.834 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.834 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.834 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.834 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "4", 2024-09-13T17:24:13.834 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.834 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.834 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.834 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-13T17:24:13.834 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.834 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.834 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.834 INFO:teuthology.orchestra.run.smithi087.stdout: "snapshot_clone_delay": { 2024-09-13T17:24:13.834 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "snapshot_clone_delay", 2024-09-13T17:24:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-09-13T17:24:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-13T17:24:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: "snapshot_clone_no_wait": { 2024-09-13T17:24:13.835 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "snapshot_clone_no_wait", 2024-09-13T17:24:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-13T17:24:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.836 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "zabbix", 2024-09-13T17:24:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: "discovery_interval": { 2024-09-13T17:24:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "discovery_interval", 2024-09-13T17:24:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-09-13T17:24:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "100", 2024-09-13T17:24:13.837 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: "identifier": { 2024-09-13T17:24:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "identifier", 2024-09-13T17:24:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.838 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-09-13T17:24:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-09-13T17:24:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.839 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-09-13T17:24:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.840 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.841 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.842 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.843 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.844 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.845 INFO:teuthology.orchestra.run.smithi087.stdout: "zabbix_host": { 2024-09-13T17:24:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "zabbix_host", 2024-09-13T17:24:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: "zabbix_port": { 2024-09-13T17:24:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "zabbix_port", 2024-09-13T17:24:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10051", 2024-09-13T17:24:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: "zabbix_sender": { 2024-09-13T17:24:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "zabbix_sender", 2024-09-13T17:24:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-13T17:24:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.848 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-13T17:24:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: "gid": 25030, 2024-09-13T17:24:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "z", 2024-09-13T17:24:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_features": 4540138322906710015, 2024-09-13T17:24:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: "available_modules": [ 2024-09-13T17:24:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "alerts", 2024-09-13T17:24:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.849 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-09-13T17:24:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-09-13T17:24:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-09-13T17:24:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "How frequently to reexamine health status", 2024-09-13T17:24:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.850 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.851 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.852 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.853 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.854 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.854 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.854 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.854 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.854 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.854 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.854 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.854 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.854 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.854 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.854 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.854 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.854 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.855 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.855 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.855 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.855 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.855 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.855 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.855 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.855 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.855 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.855 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.855 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.855 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.855 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_destination": { 2024-09-13T17:24:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_destination", 2024-09-13T17:24:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.856 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Email address to send alerts to", 2024-09-13T17:24:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_from_name": { 2024-09-13T17:24:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_from_name", 2024-09-13T17:24:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.857 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "Ceph", 2024-09-13T17:24:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Email From: name", 2024-09-13T17:24:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_host": { 2024-09-13T17:24:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_host", 2024-09-13T17:24:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.858 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "SMTP server", 2024-09-13T17:24:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_password": { 2024-09-13T17:24:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_password", 2024-09-13T17:24:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.859 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Password to authenticate with", 2024-09-13T17:24:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_port": { 2024-09-13T17:24:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_port", 2024-09-13T17:24:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "465", 2024-09-13T17:24:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "SMTP port", 2024-09-13T17:24:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_sender": { 2024-09-13T17:24:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_sender", 2024-09-13T17:24:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.861 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "SMTP envelope sender", 2024-09-13T17:24:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_ssl": { 2024-09-13T17:24:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_ssl", 2024-09-13T17:24:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.862 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-13T17:24:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_user": { 2024-09-13T17:24:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_user", 2024-09-13T17:24:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.863 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "User to authenticate as", 2024-09-13T17:24:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.864 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "balancer", 2024-09-13T17:24:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: "active": { 2024-09-13T17:24:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "active", 2024-09-13T17:24:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "automatically balance PGs across cluster", 2024-09-13T17:24:13.865 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: "begin_time": { 2024-09-13T17:24:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "begin_time", 2024-09-13T17:24:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0000", 2024-09-13T17:24:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.866 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "beginning time of day to automatically balance", 2024-09-13T17:24:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T17:24:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: "begin_weekday": { 2024-09-13T17:24:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "begin_weekday", 2024-09-13T17:24:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-09-13T17:24:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-09-13T17:24:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "0", 2024-09-13T17:24:13.867 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "6", 2024-09-13T17:24:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-13T17:24:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T17:24:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_compat_max_iterations": { 2024-09-13T17:24:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crush_compat_max_iterations", 2024-09-13T17:24:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-09-13T17:24:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "25", 2024-09-13T17:24:13.868 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1", 2024-09-13T17:24:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "250", 2024-09-13T17:24:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-13T17:24:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_compat_metrics": { 2024-09-13T17:24:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crush_compat_metrics", 2024-09-13T17:24:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.869 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "pgs,objects,bytes", 2024-09-13T17:24:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-13T17:24:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-13T17:24:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_compat_step": { 2024-09-13T17:24:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crush_compat_step", 2024-09-13T17:24:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-09-13T17:24:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.870 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0.5", 2024-09-13T17:24:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "0.001", 2024-09-13T17:24:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "0.999", 2024-09-13T17:24:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "aggressiveness of optimization", 2024-09-13T17:24:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-13T17:24:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: "end_time": { 2024-09-13T17:24:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "end_time", 2024-09-13T17:24:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.871 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "2359", 2024-09-13T17:24:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "ending time of day to automatically balance", 2024-09-13T17:24:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T17:24:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: "end_weekday": { 2024-09-13T17:24:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "end_weekday", 2024-09-13T17:24:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-09-13T17:24:13.872 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-09-13T17:24:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "0", 2024-09-13T17:24:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "6", 2024-09-13T17:24:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-13T17:24:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T17:24:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.873 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.874 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.875 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.876 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.877 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: "min_score": { 2024-09-13T17:24:13.878 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "min_score", 2024-09-13T17:24:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-09-13T17:24:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-09-13T17:24:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-13T17:24:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": { 2024-09-13T17:24:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mode", 2024-09-13T17:24:13.879 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "upmap", 2024-09-13T17:24:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: "crush-compat", 2024-09-13T17:24:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: "none", 2024-09-13T17:24:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: "upmap" 2024-09-13T17:24:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Balancer mode", 2024-09-13T17:24:13.880 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: "pool_ids": { 2024-09-13T17:24:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "pool_ids", 2024-09-13T17:24:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-13T17:24:13.881 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.882 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.882 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.882 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-09-13T17:24:13.882 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-09-13T17:24:13.882 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:13.882 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.882 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.882 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-09-13T17:24:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-13T17:24:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: "upmap_max_deviation": { 2024-09-13T17:24:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "upmap_max_deviation", 2024-09-13T17:24:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.883 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5", 2024-09-13T17:24:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1", 2024-09-13T17:24:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-13T17:24:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-13T17:24:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: "upmap_max_optimizations": { 2024-09-13T17:24:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "upmap_max_optimizations", 2024-09-13T17:24:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-09-13T17:24:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.884 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-09-13T17:24:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-13T17:24:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cephadm", 2024-09-13T17:24:13.885 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.886 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.886 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.886 INFO:teuthology.orchestra.run.smithi087.stdout: "agent_down_multiplier": { 2024-09-13T17:24:13.886 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "agent_down_multiplier", 2024-09-13T17:24:13.886 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-09-13T17:24:13.886 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.886 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.886 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "3.0", 2024-09-13T17:24:13.886 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.886 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.886 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.886 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-13T17:24:13.886 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.887 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.887 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.887 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.887 INFO:teuthology.orchestra.run.smithi087.stdout: "agent_refresh_rate": { 2024-09-13T17:24:13.887 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "agent_refresh_rate", 2024-09-13T17:24:13.887 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:13.887 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.887 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.887 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "20", 2024-09-13T17:24:13.887 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.887 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.887 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.887 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-13T17:24:13.887 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.888 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.888 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.888 INFO:teuthology.orchestra.run.smithi087.stdout: "agent_starting_port": { 2024-09-13T17:24:13.888 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "agent_starting_port", 2024-09-13T17:24:13.888 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.888 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.888 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.888 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "4721", 2024-09-13T17:24:13.888 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.888 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.888 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.888 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-13T17:24:13.889 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.889 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.889 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.889 INFO:teuthology.orchestra.run.smithi087.stdout: "allow_ptrace": { 2024-09-13T17:24:13.889 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "allow_ptrace", 2024-09-13T17:24:13.889 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.889 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.889 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.889 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.889 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.889 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.889 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.889 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-13T17:24:13.890 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-13T17:24:13.890 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.890 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.890 INFO:teuthology.orchestra.run.smithi087.stdout: "autotune_interval": { 2024-09-13T17:24:13.890 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "autotune_interval", 2024-09-13T17:24:13.890 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:13.890 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.890 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.890 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-09-13T17:24:13.890 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.890 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.890 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.891 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-13T17:24:13.891 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.891 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.891 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.891 INFO:teuthology.orchestra.run.smithi087.stdout: "autotune_memory_target_ratio": { 2024-09-13T17:24:13.891 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "autotune_memory_target_ratio", 2024-09-13T17:24:13.891 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-09-13T17:24:13.891 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.891 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.891 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0.7", 2024-09-13T17:24:13.891 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.891 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.891 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.892 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-13T17:24:13.892 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.892 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.892 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.892 INFO:teuthology.orchestra.run.smithi087.stdout: "cgroups_split": { 2024-09-13T17:24:13.892 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cgroups_split", 2024-09-13T17:24:13.892 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.892 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.892 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.892 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.892 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.892 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.892 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.893 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-13T17:24:13.893 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.893 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.893 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.893 INFO:teuthology.orchestra.run.smithi087.stdout: "config_checks_enabled": { 2024-09-13T17:24:13.893 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "config_checks_enabled", 2024-09-13T17:24:13.893 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.893 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.893 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.893 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.893 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.894 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.894 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.894 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-13T17:24:13.894 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.894 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.894 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.894 INFO:teuthology.orchestra.run.smithi087.stdout: "config_dashboard": { 2024-09-13T17:24:13.894 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "config_dashboard", 2024-09-13T17:24:13.894 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.894 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.894 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.894 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.894 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.895 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.895 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.895 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-13T17:24:13.895 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.895 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.895 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.895 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.895 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_alertmanager": { 2024-09-13T17:24:13.895 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_alertmanager", 2024-09-13T17:24:13.895 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.895 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.895 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.895 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-13T17:24:13.896 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.896 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.896 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.896 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Prometheus container image", 2024-09-13T17:24:13.896 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.896 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.896 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.896 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.896 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_base": { 2024-09-13T17:24:13.896 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_base", 2024-09-13T17:24:13.896 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.896 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.896 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.897 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-13T17:24:13.897 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.897 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.897 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.897 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Container image name, without the tag", 2024-09-13T17:24:13.897 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.897 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.897 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.897 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_elasticsearch": { 2024-09-13T17:24:13.897 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_elasticsearch", 2024-09-13T17:24:13.897 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.897 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.897 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.898 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-13T17:24:13.898 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.898 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.898 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.898 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "elasticsearch container image", 2024-09-13T17:24:13.898 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.898 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.898 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.898 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_grafana": { 2024-09-13T17:24:13.898 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_grafana", 2024-09-13T17:24:13.898 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.898 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.899 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.899 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-09-13T17:24:13.899 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.899 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.899 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.899 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Prometheus container image", 2024-09-13T17:24:13.899 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.899 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.899 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.899 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.899 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_haproxy": { 2024-09-13T17:24:13.899 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_haproxy", 2024-09-13T17:24:13.899 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.899 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.900 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.900 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-13T17:24:13.900 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.900 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.900 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.900 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "HAproxy container image", 2024-09-13T17:24:13.900 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.900 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.900 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.900 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_jaeger_agent": { 2024-09-13T17:24:13.900 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_jaeger_agent", 2024-09-13T17:24:13.901 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.901 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.901 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.901 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-13T17:24:13.901 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.901 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.901 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.901 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Jaeger agent container image", 2024-09-13T17:24:13.901 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.901 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.901 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.901 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_jaeger_collector": { 2024-09-13T17:24:13.901 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_jaeger_collector", 2024-09-13T17:24:13.902 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.902 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.902 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.902 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-13T17:24:13.902 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.902 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.902 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.902 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Jaeger collector container image", 2024-09-13T17:24:13.902 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.902 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.902 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.902 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.902 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_jaeger_query": { 2024-09-13T17:24:13.902 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_jaeger_query", 2024-09-13T17:24:13.903 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.903 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.903 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.903 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-13T17:24:13.903 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.903 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.903 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.903 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Jaeger query container image", 2024-09-13T17:24:13.903 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.903 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.903 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.903 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.903 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_keepalived": { 2024-09-13T17:24:13.903 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_keepalived", 2024-09-13T17:24:13.904 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.904 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.904 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.904 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-13T17:24:13.904 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.904 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.904 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.904 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Keepalived container image", 2024-09-13T17:24:13.904 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.904 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.904 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.904 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.904 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_loki": { 2024-09-13T17:24:13.905 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_loki", 2024-09-13T17:24:13.905 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.905 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.905 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.905 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-13T17:24:13.905 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.905 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.905 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.905 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Loki container image", 2024-09-13T17:24:13.905 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.905 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.905 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.905 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.906 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_node_exporter": { 2024-09-13T17:24:13.906 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_node_exporter", 2024-09-13T17:24:13.906 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.906 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.906 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.906 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-13T17:24:13.906 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.906 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.906 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.906 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Prometheus container image", 2024-09-13T17:24:13.906 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.906 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.906 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.907 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_nvmeof": { 2024-09-13T17:24:13.907 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_nvmeof", 2024-09-13T17:24:13.907 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.907 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.907 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.907 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-09-13T17:24:13.907 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.907 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.907 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.907 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Nvme-of container image", 2024-09-13T17:24:13.907 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.907 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.907 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.907 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.908 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_prometheus": { 2024-09-13T17:24:13.908 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_prometheus", 2024-09-13T17:24:13.908 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.908 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.908 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.908 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-13T17:24:13.908 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.908 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.908 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.908 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Prometheus container image", 2024-09-13T17:24:13.908 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.908 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.909 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.909 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_promtail": { 2024-09-13T17:24:13.909 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_promtail", 2024-09-13T17:24:13.909 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.909 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.909 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.909 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-13T17:24:13.909 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.909 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.909 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.909 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Promtail container image", 2024-09-13T17:24:13.909 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.909 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.910 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.910 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.910 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_snmp_gateway": { 2024-09-13T17:24:13.910 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_snmp_gateway", 2024-09-13T17:24:13.910 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.910 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.910 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.910 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-13T17:24:13.910 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.910 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.910 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.910 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "SNMP Gateway container image", 2024-09-13T17:24:13.910 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.911 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.911 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.911 INFO:teuthology.orchestra.run.smithi087.stdout: "container_init": { 2024-09-13T17:24:13.911 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_init", 2024-09-13T17:24:13.911 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.911 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.911 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.911 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.911 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.911 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.911 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.911 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Run podman/docker with `--init`", 2024-09-13T17:24:13.912 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.912 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.912 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.912 INFO:teuthology.orchestra.run.smithi087.stdout: "daemon_cache_timeout": { 2024-09-13T17:24:13.912 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "daemon_cache_timeout", 2024-09-13T17:24:13.912 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:13.912 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.912 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.912 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-09-13T17:24:13.912 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.912 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.912 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.912 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-13T17:24:13.913 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.913 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.913 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.913 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.913 INFO:teuthology.orchestra.run.smithi087.stdout: "default_cephadm_command_timeout": { 2024-09-13T17:24:13.913 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "default_cephadm_command_timeout", 2024-09-13T17:24:13.913 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.913 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.913 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.913 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "900", 2024-09-13T17:24:13.913 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.913 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.913 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.914 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-13T17:24:13.914 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.914 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.914 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.914 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.914 INFO:teuthology.orchestra.run.smithi087.stdout: "default_registry": { 2024-09-13T17:24:13.914 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "default_registry", 2024-09-13T17:24:13.914 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.914 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.914 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.914 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "docker.io", 2024-09-13T17:24:13.914 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.914 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.915 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.915 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-13T17:24:13.915 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.915 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.915 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.915 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.915 INFO:teuthology.orchestra.run.smithi087.stdout: "device_cache_timeout": { 2024-09-13T17:24:13.915 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "device_cache_timeout", 2024-09-13T17:24:13.915 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:13.915 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.915 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.915 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "1800", 2024-09-13T17:24:13.915 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.915 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.916 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.916 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "seconds to cache device inventory", 2024-09-13T17:24:13.916 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.916 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.916 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.916 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.916 INFO:teuthology.orchestra.run.smithi087.stdout: "device_enhanced_scan": { 2024-09-13T17:24:13.916 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "device_enhanced_scan", 2024-09-13T17:24:13.916 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.916 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.916 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.916 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.916 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.917 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.917 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.917 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-13T17:24:13.917 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.917 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.917 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.917 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.917 INFO:teuthology.orchestra.run.smithi087.stdout: "facts_cache_timeout": { 2024-09-13T17:24:13.917 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "facts_cache_timeout", 2024-09-13T17:24:13.917 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:13.917 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.917 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.917 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-09-13T17:24:13.917 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.918 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.918 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.918 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "seconds to cache host facts data", 2024-09-13T17:24:13.918 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.918 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.918 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.918 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.918 INFO:teuthology.orchestra.run.smithi087.stdout: "host_check_interval": { 2024-09-13T17:24:13.918 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "host_check_interval", 2024-09-13T17:24:13.918 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:13.918 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.919 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.919 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-09-13T17:24:13.919 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.919 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.919 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.919 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to perform a host check", 2024-09-13T17:24:13.919 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.919 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.919 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.919 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.919 INFO:teuthology.orchestra.run.smithi087.stdout: "hw_monitoring": { 2024-09-13T17:24:13.919 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "hw_monitoring", 2024-09-13T17:24:13.919 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.919 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.920 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.920 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.920 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.920 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.920 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.920 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-13T17:24:13.920 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.920 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.920 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.920 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.920 INFO:teuthology.orchestra.run.smithi087.stdout: "inventory_list_all": { 2024-09-13T17:24:13.920 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "inventory_list_all", 2024-09-13T17:24:13.921 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.921 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.921 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.921 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.921 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.921 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.921 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.921 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-13T17:24:13.921 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.921 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.921 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.921 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.921 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.922 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.922 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.922 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.922 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.922 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.922 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.922 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.922 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.922 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.922 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.922 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.922 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.922 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.922 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.923 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.923 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.923 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.923 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.923 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.923 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.923 INFO:teuthology.orchestra.run.smithi087.stdout: "log_refresh_metadata": { 2024-09-13T17:24:13.923 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_refresh_metadata", 2024-09-13T17:24:13.923 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.923 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.923 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.923 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.923 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.924 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.924 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.924 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-13T17:24:13.924 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.924 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.924 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.924 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.924 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.924 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.924 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.924 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.924 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.924 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.925 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.925 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.925 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.925 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-13T17:24:13.925 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.925 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.925 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.925 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.925 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.925 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.925 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.925 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.925 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.925 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.926 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.926 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.926 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.926 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.926 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.926 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.926 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.926 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.926 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.926 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.926 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.926 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.927 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.927 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.927 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.927 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.927 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.927 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.927 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.927 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.927 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.927 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.927 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.927 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.927 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.927 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.928 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.928 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.928 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.928 INFO:teuthology.orchestra.run.smithi087.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-13T17:24:13.928 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-13T17:24:13.928 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.928 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.928 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.928 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.928 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.928 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.928 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.928 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-13T17:24:13.929 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.929 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.929 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.929 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.929 INFO:teuthology.orchestra.run.smithi087.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-13T17:24:13.929 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-13T17:24:13.929 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.929 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.929 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.929 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "*", 2024-09-13T17:24:13.929 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.929 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.929 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.929 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-13T17:24:13.930 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.930 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.930 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.930 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.930 INFO:teuthology.orchestra.run.smithi087.stdout: "max_count_per_host": { 2024-09-13T17:24:13.930 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_count_per_host", 2024-09-13T17:24:13.930 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.930 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.930 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.930 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-09-13T17:24:13.930 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.930 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.930 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.931 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "max number of daemons per service per host", 2024-09-13T17:24:13.931 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.931 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.931 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.931 INFO:teuthology.orchestra.run.smithi087.stdout: "max_osd_draining_count": { 2024-09-13T17:24:13.931 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_osd_draining_count", 2024-09-13T17:24:13.931 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.931 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.931 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.931 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-09-13T17:24:13.931 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.931 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.932 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.932 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-13T17:24:13.932 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.932 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.932 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.932 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.932 INFO:teuthology.orchestra.run.smithi087.stdout: "migration_current": { 2024-09-13T17:24:13.932 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "migration_current", 2024-09-13T17:24:13.932 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.933 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.933 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.933 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.933 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.933 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.933 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.933 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "internal - do not modify", 2024-09-13T17:24:13.933 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.933 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.933 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.933 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.933 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": { 2024-09-13T17:24:13.933 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mode", 2024-09-13T17:24:13.933 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.934 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.934 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.934 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "root", 2024-09-13T17:24:13.934 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.934 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.934 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.934 INFO:teuthology.orchestra.run.smithi087.stdout: "cephadm-package", 2024-09-13T17:24:13.934 INFO:teuthology.orchestra.run.smithi087.stdout: "root" 2024-09-13T17:24:13.934 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.934 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "mode for remote execution of cephadm", 2024-09-13T17:24:13.934 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.934 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.934 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.935 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.935 INFO:teuthology.orchestra.run.smithi087.stdout: "oob_default_addr": { 2024-09-13T17:24:13.935 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "oob_default_addr", 2024-09-13T17:24:13.935 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.935 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.935 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.935 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "169.254.1.1", 2024-09-13T17:24:13.935 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.935 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.935 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.935 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-13T17:24:13.935 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.935 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.936 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.936 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.936 INFO:teuthology.orchestra.run.smithi087.stdout: "prometheus_alerts_path": { 2024-09-13T17:24:13.936 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "prometheus_alerts_path", 2024-09-13T17:24:13.936 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.936 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.936 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.936 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-13T17:24:13.936 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.936 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.936 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.936 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-13T17:24:13.936 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.937 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.937 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.937 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.937 INFO:teuthology.orchestra.run.smithi087.stdout: "registry_insecure": { 2024-09-13T17:24:13.937 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "registry_insecure", 2024-09-13T17:24:13.937 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.937 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.937 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.937 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.937 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.937 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.937 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.937 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-13T17:24:13.938 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.938 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.938 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.938 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.938 INFO:teuthology.orchestra.run.smithi087.stdout: "registry_password": { 2024-09-13T17:24:13.938 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "registry_password", 2024-09-13T17:24:13.938 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.938 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.938 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.938 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.938 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.938 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.938 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.938 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-13T17:24:13.939 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.939 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.939 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.939 INFO:teuthology.orchestra.run.smithi087.stdout: "registry_url": { 2024-09-13T17:24:13.939 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "registry_url", 2024-09-13T17:24:13.939 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.939 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.939 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.939 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.939 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.939 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.939 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.940 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-13T17:24:13.940 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.940 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.940 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.940 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.940 INFO:teuthology.orchestra.run.smithi087.stdout: "registry_username": { 2024-09-13T17:24:13.940 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "registry_username", 2024-09-13T17:24:13.940 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.940 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.940 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.940 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.940 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.940 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.940 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.941 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-13T17:24:13.941 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.941 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.941 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.941 INFO:teuthology.orchestra.run.smithi087.stdout: "secure_monitoring_stack": { 2024-09-13T17:24:13.941 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "secure_monitoring_stack", 2024-09-13T17:24:13.941 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.941 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.941 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.941 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.945 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.945 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.945 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.945 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-13T17:24:13.945 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.945 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.945 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.945 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.945 INFO:teuthology.orchestra.run.smithi087.stdout: "service_discovery_port": { 2024-09-13T17:24:13.945 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "service_discovery_port", 2024-09-13T17:24:13.946 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.946 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.946 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.946 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8765", 2024-09-13T17:24:13.946 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.946 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.946 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.946 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "cephadm service discovery port", 2024-09-13T17:24:13.946 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.946 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.946 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.946 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.946 INFO:teuthology.orchestra.run.smithi087.stdout: "ssh_config_file": { 2024-09-13T17:24:13.946 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ssh_config_file", 2024-09-13T17:24:13.947 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.947 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.947 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.947 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.947 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.947 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.947 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.947 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-13T17:24:13.947 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.947 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.947 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.947 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.947 INFO:teuthology.orchestra.run.smithi087.stdout: "use_agent": { 2024-09-13T17:24:13.947 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "use_agent", 2024-09-13T17:24:13.948 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.948 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.948 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.948 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.948 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.948 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.948 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.948 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-13T17:24:13.948 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.948 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.948 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.948 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.949 INFO:teuthology.orchestra.run.smithi087.stdout: "use_repo_digest": { 2024-09-13T17:24:13.949 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "use_repo_digest", 2024-09-13T17:24:13.949 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.949 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.949 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.949 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.949 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.949 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.949 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.949 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-13T17:24:13.949 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.949 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.949 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.950 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_on_failed_host_check": { 2024-09-13T17:24:13.950 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_on_failed_host_check", 2024-09-13T17:24:13.950 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.950 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.950 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.950 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.950 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.950 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.950 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.950 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "raise a health warning if the host check fails", 2024-09-13T17:24:13.950 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.950 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.950 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.950 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.951 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_on_stray_daemons": { 2024-09-13T17:24:13.951 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_on_stray_daemons", 2024-09-13T17:24:13.951 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.951 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.951 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.951 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.951 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.951 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.951 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.951 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-13T17:24:13.951 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.951 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.951 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.952 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.952 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_on_stray_hosts": { 2024-09-13T17:24:13.952 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_on_stray_hosts", 2024-09-13T17:24:13.952 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.952 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.952 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.952 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.952 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.952 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.952 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.952 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-13T17:24:13.952 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.952 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.952 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.953 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.953 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.953 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.953 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.953 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crash", 2024-09-13T17:24:13.953 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.953 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.953 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.953 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:13.953 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:13.953 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.953 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.953 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.954 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.954 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.954 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.954 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.954 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.954 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.954 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.954 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.954 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.954 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.954 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.954 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.954 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.954 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.955 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.955 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.955 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:13.955 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:13.955 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.955 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.955 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.955 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.955 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.955 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.955 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.955 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.955 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.955 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.955 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.956 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.956 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:13.956 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:13.956 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.956 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.956 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.956 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:13.956 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.956 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.956 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:13.956 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:13.956 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:13.956 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:13.957 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:13.957 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:13.957 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:13.957 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:13.957 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.957 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.957 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.957 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.957 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.957 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:13.957 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:13.957 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.957 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.957 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.958 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.958 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.958 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.958 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.958 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.958 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.958 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.958 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.958 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.958 INFO:teuthology.orchestra.run.smithi087.stdout: "retain_interval": { 2024-09-13T17:24:13.958 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "retain_interval", 2024-09-13T17:24:13.958 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:13.958 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.958 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.958 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "31536000", 2024-09-13T17:24:13.959 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.959 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.959 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.959 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-13T17:24:13.959 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.959 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.959 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.959 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.959 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_recent_interval": { 2024-09-13T17:24:13.959 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_recent_interval", 2024-09-13T17:24:13.959 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:13.959 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.959 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:13.959 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "1209600", 2024-09-13T17:24:13.960 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.960 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.960 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.960 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-13T17:24:13.960 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.960 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.960 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.960 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.960 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:13.960 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.960 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:13.960 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "dashboard", 2024-09-13T17:24:13.960 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:13.960 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:13.961 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:13.961 INFO:teuthology.orchestra.run.smithi087.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-13T17:24:13.961 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-13T17:24:13.961 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.961 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.961 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.961 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-09-13T17:24:13.961 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.961 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.961 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.961 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.961 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.961 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.962 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.962 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.962 INFO:teuthology.orchestra.run.smithi087.stdout: "ALERTMANAGER_API_HOST": { 2024-09-13T17:24:13.962 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-13T17:24:13.962 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.962 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.962 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.962 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.962 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.962 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.962 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.962 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.962 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.963 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.963 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.963 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.963 INFO:teuthology.orchestra.run.smithi087.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-13T17:24:13.963 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-13T17:24:13.963 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.963 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.963 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.963 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.963 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.963 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.963 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.963 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.963 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.964 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.964 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.964 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.964 INFO:teuthology.orchestra.run.smithi087.stdout: "AUDIT_API_ENABLED": { 2024-09-13T17:24:13.964 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "AUDIT_API_ENABLED", 2024-09-13T17:24:13.964 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.964 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.964 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.964 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.964 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.964 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.964 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.964 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.965 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.965 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.965 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.965 INFO:teuthology.orchestra.run.smithi087.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-13T17:24:13.965 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-13T17:24:13.965 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.965 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.965 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.965 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.965 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.965 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.965 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.965 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.966 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.966 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.966 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.966 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.966 INFO:teuthology.orchestra.run.smithi087.stdout: "ENABLE_BROWSABLE_API": { 2024-09-13T17:24:13.966 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-13T17:24:13.966 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.966 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.966 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.966 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.966 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.966 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.966 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.966 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.967 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.967 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.967 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.967 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.967 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-13T17:24:13.967 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-13T17:24:13.967 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.967 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.967 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.967 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.967 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.967 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.967 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.967 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.968 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.968 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.968 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.968 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.968 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-13T17:24:13.968 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-13T17:24:13.968 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.968 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.968 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.968 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.968 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.968 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.968 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.969 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.969 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.969 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.969 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.969 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.969 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-13T17:24:13.969 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-13T17:24:13.969 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.969 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.969 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.969 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.969 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.969 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.969 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.969 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.970 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.970 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.970 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.970 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.970 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-13T17:24:13.970 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-13T17:24:13.970 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.970 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.970 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.970 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.970 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.970 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.970 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.970 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.971 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.971 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.971 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.971 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.971 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-13T17:24:13.971 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-13T17:24:13.971 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.971 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.971 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.971 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.971 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.971 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.971 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.971 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.972 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.972 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.972 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.972 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.972 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-13T17:24:13.972 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-13T17:24:13.972 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.972 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.972 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.972 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.972 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.972 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.972 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.973 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.973 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.973 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.973 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.973 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.973 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-13T17:24:13.973 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-13T17:24:13.973 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.973 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.973 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.973 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.973 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.973 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.973 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.974 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.974 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.974 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.974 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.974 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.974 INFO:teuthology.orchestra.run.smithi087.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-13T17:24:13.974 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-13T17:24:13.974 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.974 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.974 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.974 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.974 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.974 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.974 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.975 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.975 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.975 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.975 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.975 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.975 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_API_PASSWORD": { 2024-09-13T17:24:13.975 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-13T17:24:13.975 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.975 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.975 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.975 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "admin", 2024-09-13T17:24:13.975 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.975 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.976 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.976 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.976 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.976 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.976 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.976 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.976 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-13T17:24:13.976 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-13T17:24:13.976 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.976 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.976 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.976 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.976 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.976 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.977 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.977 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.977 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.977 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.977 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.977 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.977 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_API_URL": { 2024-09-13T17:24:13.977 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_API_URL", 2024-09-13T17:24:13.977 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.977 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.977 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.977 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.977 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.978 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.978 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.978 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.978 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.978 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.978 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.978 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.978 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_API_USERNAME": { 2024-09-13T17:24:13.978 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-13T17:24:13.978 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.978 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.978 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.978 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "admin", 2024-09-13T17:24:13.978 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.979 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.979 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.979 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.979 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.979 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.979 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.979 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.979 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-13T17:24:13.979 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-13T17:24:13.979 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.979 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.979 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.979 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.979 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.980 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.980 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.980 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.980 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.980 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.980 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.980 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.980 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-13T17:24:13.980 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-13T17:24:13.980 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.980 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.980 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.980 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.980 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.981 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.981 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.981 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.981 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.981 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.981 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.981 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.981 INFO:teuthology.orchestra.run.smithi087.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-13T17:24:13.981 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-13T17:24:13.981 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.981 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.981 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.981 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.982 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.982 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.982 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.982 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.982 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.982 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.982 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.982 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.982 INFO:teuthology.orchestra.run.smithi087.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-13T17:24:13.982 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-13T17:24:13.983 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.983 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.983 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.983 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.983 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.983 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.983 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.983 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.983 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.983 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.983 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.983 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.983 INFO:teuthology.orchestra.run.smithi087.stdout: "PROMETHEUS_API_HOST": { 2024-09-13T17:24:13.984 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-13T17:24:13.984 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.984 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.984 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.984 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.984 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.984 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.984 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.984 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.984 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.984 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.984 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.984 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.985 INFO:teuthology.orchestra.run.smithi087.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-13T17:24:13.985 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-13T17:24:13.985 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.985 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.985 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.985 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.985 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.985 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.985 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.985 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.985 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.985 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.985 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.985 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.985 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-13T17:24:13.986 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-13T17:24:13.986 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.986 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.986 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.986 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.986 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.986 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.986 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.986 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.986 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.986 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.986 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.986 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.986 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-13T17:24:13.987 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-13T17:24:13.987 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.987 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.987 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.987 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.987 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.987 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.987 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.987 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.987 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.987 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.987 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.987 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.987 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-13T17:24:13.988 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-13T17:24:13.988 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.988 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.988 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.988 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.988 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.988 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.988 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.988 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.988 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.988 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.988 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.988 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.988 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-13T17:24:13.989 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-13T17:24:13.989 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.989 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.989 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.989 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.989 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.989 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.989 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.989 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.989 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.989 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.989 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.990 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.990 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-13T17:24:13.990 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-13T17:24:13.990 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.990 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.990 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.990 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.990 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.990 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.990 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.990 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.990 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.990 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.990 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.991 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.991 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-13T17:24:13.991 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-13T17:24:13.991 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.991 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.991 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.991 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.991 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.991 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.991 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.991 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.991 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.991 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.991 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.992 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.992 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-13T17:24:13.992 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-13T17:24:13.992 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.992 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.992 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.992 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:13.992 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.992 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.992 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.992 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.992 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.992 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.993 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.993 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_ENABLED": { 2024-09-13T17:24:13.993 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-13T17:24:13.993 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:13.993 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.993 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.993 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:13.993 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.993 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.993 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.993 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.993 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.993 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.994 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.994 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-13T17:24:13.994 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-13T17:24:13.994 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.994 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.994 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.994 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-13T17:24:13.994 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.994 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.994 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.994 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.994 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.994 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.995 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.995 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-13T17:24:13.995 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-13T17:24:13.995 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.995 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.995 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.995 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-09-13T17:24:13.995 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.995 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.995 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.995 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.995 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.995 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.996 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.996 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.996 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-13T17:24:13.996 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-13T17:24:13.996 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.996 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.996 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.996 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8", 2024-09-13T17:24:13.996 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.996 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.996 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.996 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.996 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.996 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.997 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.997 INFO:teuthology.orchestra.run.smithi087.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-13T17:24:13.997 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-13T17:24:13.997 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:13.997 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.997 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.997 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "45", 2024-09-13T17:24:13.997 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.997 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.997 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.997 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.997 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.997 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.998 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.998 INFO:teuthology.orchestra.run.smithi087.stdout: "RGW_API_ACCESS_KEY": { 2024-09-13T17:24:13.998 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-13T17:24:13.998 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.998 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.998 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.998 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:13.998 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.998 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.998 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.998 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.998 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.998 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:13.999 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:13.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:13.999 INFO:teuthology.orchestra.run.smithi087.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-13T17:24:13.999 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-13T17:24:13.999 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:13.999 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:13.999 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:13.999 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "admin", 2024-09-13T17:24:13.999 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:13.999 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:13.999 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:13.999 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:13.999 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:13.999 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.000 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.000 INFO:teuthology.orchestra.run.smithi087.stdout: "RGW_API_SECRET_KEY": { 2024-09-13T17:24:14.000 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-13T17:24:14.000 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.000 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.000 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.000 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.000 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.000 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.000 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.000 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.001 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.001 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.001 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.001 INFO:teuthology.orchestra.run.smithi087.stdout: "RGW_API_SSL_VERIFY": { 2024-09-13T17:24:14.001 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-13T17:24:14.001 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.001 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.001 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.001 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.001 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.001 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.001 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.001 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.002 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.002 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.002 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.002 INFO:teuthology.orchestra.run.smithi087.stdout: "UNSAFE_TLS_v1_2": { 2024-09-13T17:24:14.002 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-13T17:24:14.002 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.002 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.002 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.002 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.002 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.002 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.003 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.003 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.003 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.003 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.003 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.003 INFO:teuthology.orchestra.run.smithi087.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-13T17:24:14.003 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-13T17:24:14.003 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.003 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.003 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.003 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-09-13T17:24:14.004 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.004 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.004 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.004 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.004 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.004 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.004 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.004 INFO:teuthology.orchestra.run.smithi087.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-13T17:24:14.004 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-13T17:24:14.004 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.004 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.004 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.004 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-09-13T17:24:14.005 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.005 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.005 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.005 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.005 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.005 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.005 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.005 INFO:teuthology.orchestra.run.smithi087.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-13T17:24:14.005 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-13T17:24:14.005 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.005 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.005 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.005 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5", 2024-09-13T17:24:14.006 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.006 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.006 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.006 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.006 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.006 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.006 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.006 INFO:teuthology.orchestra.run.smithi087.stdout: "cross_origin_url": { 2024-09-13T17:24:14.006 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cross_origin_url", 2024-09-13T17:24:14.006 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.006 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.006 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.006 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.007 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.007 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.007 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.007 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.007 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.007 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.007 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.007 INFO:teuthology.orchestra.run.smithi087.stdout: "crt_file": { 2024-09-13T17:24:14.007 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crt_file", 2024-09-13T17:24:14.007 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.007 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.007 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.008 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.008 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.008 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.008 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.008 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.008 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.008 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.008 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.008 INFO:teuthology.orchestra.run.smithi087.stdout: "debug": { 2024-09-13T17:24:14.008 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "debug", 2024-09-13T17:24:14.008 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.008 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.008 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.009 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.009 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.009 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.009 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.009 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Enable/disable debug options", 2024-09-13T17:24:14.009 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.009 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.009 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.009 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.009 INFO:teuthology.orchestra.run.smithi087.stdout: "jwt_token_ttl": { 2024-09-13T17:24:14.009 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "jwt_token_ttl", 2024-09-13T17:24:14.009 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.009 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.009 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.010 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "28800", 2024-09-13T17:24:14.010 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.010 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.010 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.010 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.010 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.010 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.010 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.010 INFO:teuthology.orchestra.run.smithi087.stdout: "key_file": { 2024-09-13T17:24:14.010 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "key_file", 2024-09-13T17:24:14.010 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.010 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.010 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.011 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.011 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.011 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.011 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.011 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.011 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.011 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.011 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.011 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.011 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.011 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.011 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.011 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.012 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.012 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.012 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.012 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.012 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.012 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.012 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.012 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.012 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.012 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.012 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.012 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.012 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.012 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.013 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.013 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.013 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.013 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.013 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.013 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.013 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.013 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.013 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.013 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.013 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.013 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.013 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.014 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.014 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.014 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.014 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.014 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.014 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.014 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.014 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.014 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.014 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.014 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.014 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.014 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.014 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.015 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.015 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.015 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.015 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.015 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.015 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.015 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.015 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.015 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.015 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.015 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.015 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.016 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.016 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.016 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.016 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.016 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.016 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.016 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.016 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.016 INFO:teuthology.orchestra.run.smithi087.stdout: "motd": { 2024-09-13T17:24:14.016 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "motd", 2024-09-13T17:24:14.016 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.016 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.017 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.017 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.017 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.017 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.017 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.017 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "The message of the day", 2024-09-13T17:24:14.017 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.017 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.017 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.017 INFO:teuthology.orchestra.run.smithi087.stdout: "redirect_resolve_ip_addr": { 2024-09-13T17:24:14.017 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "redirect_resolve_ip_addr", 2024-09-13T17:24:14.017 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.017 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.018 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.018 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.018 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.018 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.018 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.018 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.018 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.018 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.018 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.018 INFO:teuthology.orchestra.run.smithi087.stdout: "server_addr": { 2024-09-13T17:24:14.018 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_addr", 2024-09-13T17:24:14.018 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.019 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.019 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.019 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "::", 2024-09-13T17:24:14.019 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.019 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.019 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.019 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.019 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.019 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.019 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.019 INFO:teuthology.orchestra.run.smithi087.stdout: "server_port": { 2024-09-13T17:24:14.019 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_port", 2024-09-13T17:24:14.020 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.020 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.020 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.020 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8080", 2024-09-13T17:24:14.020 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.020 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.020 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.020 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.020 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.020 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.020 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.021 INFO:teuthology.orchestra.run.smithi087.stdout: "ssl": { 2024-09-13T17:24:14.021 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ssl", 2024-09-13T17:24:14.021 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.021 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.021 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.021 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.021 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.021 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.021 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.021 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.021 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.021 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.021 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.022 INFO:teuthology.orchestra.run.smithi087.stdout: "ssl_server_port": { 2024-09-13T17:24:14.022 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ssl_server_port", 2024-09-13T17:24:14.022 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.022 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.022 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.022 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8443", 2024-09-13T17:24:14.022 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.022 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.022 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.022 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.022 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.022 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.023 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.023 INFO:teuthology.orchestra.run.smithi087.stdout: "standby_behaviour": { 2024-09-13T17:24:14.023 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "standby_behaviour", 2024-09-13T17:24:14.023 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.023 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.023 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.023 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "redirect", 2024-09-13T17:24:14.023 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.023 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.023 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.023 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.023 INFO:teuthology.orchestra.run.smithi087.stdout: "redirect" 2024-09-13T17:24:14.023 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.023 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.024 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.024 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.024 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.024 INFO:teuthology.orchestra.run.smithi087.stdout: "standby_error_status_code": { 2024-09-13T17:24:14.024 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "standby_error_status_code", 2024-09-13T17:24:14.024 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.024 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.024 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.024 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "500", 2024-09-13T17:24:14.024 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "400", 2024-09-13T17:24:14.024 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "599", 2024-09-13T17:24:14.024 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.025 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.025 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.025 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.025 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.025 INFO:teuthology.orchestra.run.smithi087.stdout: "url_prefix": { 2024-09-13T17:24:14.025 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "url_prefix", 2024-09-13T17:24:14.025 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.025 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.025 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.025 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.025 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.025 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.025 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.026 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.026 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.026 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.026 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.026 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.026 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.026 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "devicehealth", 2024-09-13T17:24:14.026 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.026 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.026 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.026 INFO:teuthology.orchestra.run.smithi087.stdout: "enable_monitoring": { 2024-09-13T17:24:14.026 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "enable_monitoring", 2024-09-13T17:24:14.027 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.027 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.027 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.027 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.027 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.027 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.027 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.027 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "monitor device health metrics", 2024-09-13T17:24:14.027 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.027 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.027 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.027 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.027 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.028 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.028 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.028 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.028 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.028 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.028 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.028 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.028 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.028 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.028 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.028 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.028 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.028 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.029 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.029 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.029 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.029 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.029 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.029 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.029 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.029 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.029 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.029 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.029 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.029 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.029 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.030 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.030 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.030 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.030 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.030 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.030 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.030 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.030 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.030 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.030 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.030 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.030 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.030 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.031 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.031 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.031 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.031 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.031 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.031 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.031 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.031 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.031 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.031 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.031 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.031 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.031 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.031 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.032 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.032 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.032 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.032 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.032 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.032 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.032 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.032 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.032 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.032 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.032 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.032 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.033 INFO:teuthology.orchestra.run.smithi087.stdout: "mark_out_threshold": { 2024-09-13T17:24:14.033 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mark_out_threshold", 2024-09-13T17:24:14.033 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:14.033 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.033 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.033 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "2419200", 2024-09-13T17:24:14.033 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.033 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.033 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.033 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-13T17:24:14.033 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.033 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.033 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.034 INFO:teuthology.orchestra.run.smithi087.stdout: "pool_name": { 2024-09-13T17:24:14.034 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "pool_name", 2024-09-13T17:24:14.034 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.034 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.034 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.034 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "device_health_metrics", 2024-09-13T17:24:14.034 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.034 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.034 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.034 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-13T17:24:14.034 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.034 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.035 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.035 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.035 INFO:teuthology.orchestra.run.smithi087.stdout: "retention_period": { 2024-09-13T17:24:14.035 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "retention_period", 2024-09-13T17:24:14.035 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:14.035 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.035 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.035 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "15552000", 2024-09-13T17:24:14.035 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.035 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.035 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.035 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how long to retain device health metrics", 2024-09-13T17:24:14.035 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.035 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.036 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.036 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.036 INFO:teuthology.orchestra.run.smithi087.stdout: "scrape_frequency": { 2024-09-13T17:24:14.036 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "scrape_frequency", 2024-09-13T17:24:14.036 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:14.036 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.036 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.036 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "86400", 2024-09-13T17:24:14.036 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.036 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.036 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.036 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-13T17:24:14.036 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.036 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.037 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.037 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.037 INFO:teuthology.orchestra.run.smithi087.stdout: "self_heal": { 2024-09-13T17:24:14.037 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "self_heal", 2024-09-13T17:24:14.037 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.037 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.037 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.037 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.037 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.037 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.037 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.037 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-13T17:24:14.037 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.038 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.038 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.038 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.038 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-09-13T17:24:14.038 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-09-13T17:24:14.038 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:14.038 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.038 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.038 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-09-13T17:24:14.038 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.038 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.038 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.038 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to wake up and check device health", 2024-09-13T17:24:14.038 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.039 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.039 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.039 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_threshold": { 2024-09-13T17:24:14.039 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_threshold", 2024-09-13T17:24:14.039 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:14.039 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.039 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.039 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "7257600", 2024-09-13T17:24:14.039 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.039 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.039 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.039 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-13T17:24:14.039 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.039 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.040 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.040 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.040 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.040 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.040 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.040 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "diskprediction_local", 2024-09-13T17:24:14.040 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.040 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.040 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.040 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.040 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.040 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.040 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.041 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.041 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.041 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.041 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.041 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.041 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.041 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.041 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.041 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.041 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.041 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.041 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.041 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.041 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.041 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.042 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.042 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.042 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.042 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.042 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.042 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.042 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.042 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.042 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.042 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.042 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.042 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.042 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.042 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.043 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.043 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.043 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.043 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.043 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.043 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.043 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.043 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.043 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.043 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.043 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.043 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.043 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.043 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.044 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.044 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.044 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.044 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.044 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.044 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.044 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.044 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.044 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.044 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.044 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.044 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.045 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.045 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.045 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.045 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.045 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.045 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.045 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.045 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.045 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.045 INFO:teuthology.orchestra.run.smithi087.stdout: "predict_interval": { 2024-09-13T17:24:14.045 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "predict_interval", 2024-09-13T17:24:14.045 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.045 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.046 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.046 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "86400", 2024-09-13T17:24:14.046 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.046 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.046 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.046 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.046 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.046 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.046 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.046 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.046 INFO:teuthology.orchestra.run.smithi087.stdout: "predictor_model": { 2024-09-13T17:24:14.046 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "predictor_model", 2024-09-13T17:24:14.046 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.046 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.046 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.047 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "prophetstor", 2024-09-13T17:24:14.047 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.047 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.047 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.047 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.047 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.047 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.047 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.047 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-09-13T17:24:14.047 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-09-13T17:24:14.047 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.047 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.047 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.048 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-09-13T17:24:14.048 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.048 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.048 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.048 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.048 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.048 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.048 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.048 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.048 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.048 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.048 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.048 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "influx", 2024-09-13T17:24:14.049 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": false, 2024-09-13T17:24:14.049 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "influxdb python module not found", 2024-09-13T17:24:14.049 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.049 INFO:teuthology.orchestra.run.smithi087.stdout: "batch_size": { 2024-09-13T17:24:14.049 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "batch_size", 2024-09-13T17:24:14.049 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.049 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.049 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.049 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5000", 2024-09-13T17:24:14.049 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.049 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.049 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.049 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-13T17:24:14.049 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.050 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.050 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.050 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.050 INFO:teuthology.orchestra.run.smithi087.stdout: "database": { 2024-09-13T17:24:14.050 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "database", 2024-09-13T17:24:14.050 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.050 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.050 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.050 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "ceph", 2024-09-13T17:24:14.050 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.050 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.050 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.050 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-13T17:24:14.050 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.051 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.051 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.051 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.051 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": { 2024-09-13T17:24:14.051 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "hostname", 2024-09-13T17:24:14.051 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.051 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.051 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.051 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.051 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.051 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.051 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.051 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "InfluxDB server hostname", 2024-09-13T17:24:14.051 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.051 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.052 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.052 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-09-13T17:24:14.052 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-09-13T17:24:14.052 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:14.052 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.052 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.052 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "30", 2024-09-13T17:24:14.052 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "5", 2024-09-13T17:24:14.052 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.052 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.052 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-13T17:24:14.052 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.052 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.053 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.053 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.053 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.053 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.053 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.053 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.053 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.053 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.053 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.053 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.053 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.053 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.053 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.053 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.054 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.054 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.054 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.054 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.054 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.054 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.054 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.054 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.054 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.054 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.054 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.054 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.054 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.054 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.055 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.055 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.055 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.055 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.055 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.055 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.055 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.055 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.055 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.055 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.055 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.055 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.055 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.055 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.056 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.056 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.056 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.056 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.056 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.056 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.056 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.056 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.056 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.056 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.056 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.056 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.056 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.056 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.057 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.057 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.057 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.057 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.057 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.057 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.057 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.057 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.057 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.057 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.057 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.057 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.058 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.058 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.058 INFO:teuthology.orchestra.run.smithi087.stdout: "password": { 2024-09-13T17:24:14.058 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "password", 2024-09-13T17:24:14.058 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.058 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.058 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.058 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.058 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.058 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.058 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.058 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "password of InfluxDB server user", 2024-09-13T17:24:14.058 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.059 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.059 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.059 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.059 INFO:teuthology.orchestra.run.smithi087.stdout: "port": { 2024-09-13T17:24:14.059 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "port", 2024-09-13T17:24:14.059 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.059 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.059 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.059 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8086", 2024-09-13T17:24:14.059 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.059 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.059 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.059 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "InfluxDB server port", 2024-09-13T17:24:14.059 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.060 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.060 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.060 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.060 INFO:teuthology.orchestra.run.smithi087.stdout: "ssl": { 2024-09-13T17:24:14.060 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ssl", 2024-09-13T17:24:14.060 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.060 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.060 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.060 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "false", 2024-09-13T17:24:14.060 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.060 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.060 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.060 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T17:24:14.060 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.061 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.061 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.061 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.061 INFO:teuthology.orchestra.run.smithi087.stdout: "threads": { 2024-09-13T17:24:14.061 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "threads", 2024-09-13T17:24:14.061 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.061 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.061 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.061 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5", 2024-09-13T17:24:14.061 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1", 2024-09-13T17:24:14.061 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "32", 2024-09-13T17:24:14.061 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.061 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-13T17:24:14.062 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.062 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.062 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.062 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.062 INFO:teuthology.orchestra.run.smithi087.stdout: "username": { 2024-09-13T17:24:14.062 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "username", 2024-09-13T17:24:14.062 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.062 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.062 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.062 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.062 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.062 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.062 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.062 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "username of InfluxDB server user", 2024-09-13T17:24:14.063 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.063 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.063 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.063 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.063 INFO:teuthology.orchestra.run.smithi087.stdout: "verify_ssl": { 2024-09-13T17:24:14.063 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "verify_ssl", 2024-09-13T17:24:14.063 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.063 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.063 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.063 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "true", 2024-09-13T17:24:14.063 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.063 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.063 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.063 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T17:24:14.064 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.064 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.064 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.064 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.064 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.064 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.064 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.064 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "insights", 2024-09-13T17:24:14.064 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.064 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.064 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.064 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.064 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.064 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.065 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.065 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.065 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.065 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.065 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.065 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.065 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.065 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.065 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.065 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.065 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.065 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.065 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.065 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.066 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.066 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.066 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.066 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.066 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.066 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.066 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.066 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.066 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.066 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.066 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.066 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.066 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.067 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.067 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.067 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.067 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.067 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.067 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.067 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.067 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.067 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.067 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.067 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.067 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.067 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.067 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.067 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.068 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.068 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.068 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.068 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.068 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.068 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.068 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.068 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.068 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.068 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.068 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.068 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.069 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.069 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.069 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.069 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.069 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.069 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.069 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.069 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.069 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.069 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.069 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.069 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.070 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "iostat", 2024-09-13T17:24:14.070 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.070 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.070 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.070 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.070 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.070 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.070 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.070 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.070 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.070 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.070 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.070 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.070 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.071 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.071 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.071 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.071 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.071 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.071 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.071 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.071 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.071 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.071 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.071 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.071 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.071 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.071 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.072 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.072 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.072 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.072 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.072 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.072 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.072 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.072 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.072 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.072 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.072 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.072 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.072 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.073 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.073 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.073 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.073 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.073 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.073 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.073 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.073 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.073 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.073 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.073 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.073 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.073 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.073 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.074 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.074 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.074 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.074 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.074 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.074 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.074 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.074 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.074 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.074 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.074 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.074 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.074 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.075 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.075 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.075 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.075 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.075 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.075 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.075 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "k8sevents", 2024-09-13T17:24:14.075 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.075 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.075 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.075 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_event_retention_days": { 2024-09-13T17:24:14.075 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ceph_event_retention_days", 2024-09-13T17:24:14.076 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.076 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.076 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.076 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "7", 2024-09-13T17:24:14.076 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.076 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.076 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.076 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-13T17:24:14.076 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.076 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.076 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.076 INFO:teuthology.orchestra.run.smithi087.stdout: "config_check_secs": { 2024-09-13T17:24:14.076 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "config_check_secs", 2024-09-13T17:24:14.077 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.077 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.077 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.077 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-09-13T17:24:14.077 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "10", 2024-09-13T17:24:14.077 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.077 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.077 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-13T17:24:14.077 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.077 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.077 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.077 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.078 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.078 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.078 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.078 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.078 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.078 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.078 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.078 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.078 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.078 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.078 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.078 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.078 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.078 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.079 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.079 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.079 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.079 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.079 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.079 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.079 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.079 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.079 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.079 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.079 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.079 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.079 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.079 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.080 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.080 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.080 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.080 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.080 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.080 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.080 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.080 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.080 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.080 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.080 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.080 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.080 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.081 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.081 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.081 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.081 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.081 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.081 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.081 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.081 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.081 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.081 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.081 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.081 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.081 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.081 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.082 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.082 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.082 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.082 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.082 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.082 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.082 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.082 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.082 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.082 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.082 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.082 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.082 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.083 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "localpool", 2024-09-13T17:24:14.083 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.083 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.083 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.083 INFO:teuthology.orchestra.run.smithi087.stdout: "failure_domain": { 2024-09-13T17:24:14.083 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "failure_domain", 2024-09-13T17:24:14.083 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.083 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.084 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.084 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "host", 2024-09-13T17:24:14.084 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.084 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.084 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.084 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "failure domain for any created local pool", 2024-09-13T17:24:14.084 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-13T17:24:14.084 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.084 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.084 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.084 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.084 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.084 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.085 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.085 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.085 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.085 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.085 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.085 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.085 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.085 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.085 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.085 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.085 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.085 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.085 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.086 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.086 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.086 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.086 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.086 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.086 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.086 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.086 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.086 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.086 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.086 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.086 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.086 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.087 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.087 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.087 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.087 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.087 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.087 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.087 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.087 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.087 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.087 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.087 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.087 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.087 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.088 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.088 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.088 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.088 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.088 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.088 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.088 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.088 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.088 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.088 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.088 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.088 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.088 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.089 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.089 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.089 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.089 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.089 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.089 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.089 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.089 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.089 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.089 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.089 INFO:teuthology.orchestra.run.smithi087.stdout: "min_size": { 2024-09-13T17:24:14.089 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "min_size", 2024-09-13T17:24:14.090 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.090 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.090 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.090 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.090 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.090 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.090 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.090 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "default min_size for any created local pool", 2024-09-13T17:24:14.090 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-13T17:24:14.090 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.090 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.090 INFO:teuthology.orchestra.run.smithi087.stdout: "num_rep": { 2024-09-13T17:24:14.090 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "num_rep", 2024-09-13T17:24:14.090 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.091 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.091 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.091 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "3", 2024-09-13T17:24:14.091 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.091 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.091 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.091 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "default replica count for any created local pool", 2024-09-13T17:24:14.091 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.091 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.091 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.091 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.091 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_num": { 2024-09-13T17:24:14.091 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "pg_num", 2024-09-13T17:24:14.091 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.092 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.092 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.092 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "128", 2024-09-13T17:24:14.092 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.092 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.092 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.092 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "default pg_num for any created local pool", 2024-09-13T17:24:14.092 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.092 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.092 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.092 INFO:teuthology.orchestra.run.smithi087.stdout: "prefix": { 2024-09-13T17:24:14.092 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "prefix", 2024-09-13T17:24:14.093 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.093 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.093 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.093 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.093 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.093 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.093 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.093 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "name prefix for any created local pool", 2024-09-13T17:24:14.093 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.093 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.093 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.093 INFO:teuthology.orchestra.run.smithi087.stdout: "subtree": { 2024-09-13T17:24:14.093 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "subtree", 2024-09-13T17:24:14.093 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.094 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.094 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.094 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "rack", 2024-09-13T17:24:14.094 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.094 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.094 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.094 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-13T17:24:14.094 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-13T17:24:14.094 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.094 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.094 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.094 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.095 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mds_autoscaler", 2024-09-13T17:24:14.095 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.095 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.095 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.095 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.095 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.095 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.095 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.095 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.095 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.095 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.095 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.095 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.095 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.096 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.096 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.096 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.096 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.096 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.096 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.096 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.096 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.096 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.096 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.096 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.096 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.096 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.097 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.097 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.097 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.097 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.097 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.097 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.097 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.097 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.097 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.097 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.097 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.097 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.097 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.098 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.098 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.098 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.098 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.098 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.098 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.098 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.098 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.098 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.098 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.098 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.099 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.099 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.099 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.099 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.099 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.099 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.099 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.099 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.099 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.099 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.099 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.099 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.100 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.100 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.100 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.100 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.100 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.100 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.100 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.100 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.100 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.100 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mirroring", 2024-09-13T17:24:14.100 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.100 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.101 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.101 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.101 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.101 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.101 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.101 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.101 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.101 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.101 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.101 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.101 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.101 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.101 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.101 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.102 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.102 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.102 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.102 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.102 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.102 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.102 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.102 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.102 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.102 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.102 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.102 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.102 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.103 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.103 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.103 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.103 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.103 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.103 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.103 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.103 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.103 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.103 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.103 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.103 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.103 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.104 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.104 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.104 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.104 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.104 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.104 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.104 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.104 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.104 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.104 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.104 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.104 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.104 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.104 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.105 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.105 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.105 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.105 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.105 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.105 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.105 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.105 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.105 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.105 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.105 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.105 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.105 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.106 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.106 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.106 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "nfs", 2024-09-13T17:24:14.106 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.106 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.106 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.106 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.106 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.106 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.106 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.106 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.106 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.107 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.107 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.107 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.107 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.107 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.107 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.107 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.107 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.107 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.107 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.107 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.107 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.107 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.107 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.107 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.108 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.108 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.108 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.108 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.108 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.108 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.108 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.108 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.108 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.108 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.108 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.108 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.108 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.108 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.109 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.109 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.109 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.109 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.109 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.109 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.109 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.109 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.109 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.109 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.109 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.109 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.109 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.109 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.110 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.110 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.110 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.110 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.110 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.110 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.110 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.110 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.110 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.110 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.110 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.110 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.110 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.110 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.111 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.111 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.111 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.111 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.111 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.111 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.111 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.111 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.111 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.111 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "orchestrator", 2024-09-13T17:24:14.111 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.111 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.111 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.111 INFO:teuthology.orchestra.run.smithi087.stdout: "fail_fs": { 2024-09-13T17:24:14.112 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "fail_fs", 2024-09-13T17:24:14.112 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.112 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.112 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.112 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.112 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.112 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.112 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.112 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-13T17:24:14.112 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.112 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.112 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.112 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.112 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.113 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.113 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.113 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.113 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.113 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.113 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.113 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.113 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.113 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.113 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.113 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.113 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.113 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.113 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.114 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.114 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.114 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.114 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.114 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.114 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.114 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.114 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.114 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.114 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.114 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.114 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.115 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.115 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.115 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.115 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.115 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.115 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.115 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.115 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.115 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.115 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.115 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.115 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.115 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.115 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.116 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.116 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.116 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.116 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.116 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.116 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.116 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.116 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.116 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.116 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.116 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.116 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.116 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.116 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.117 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.117 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.117 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.117 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.117 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.117 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.117 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.117 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.117 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.117 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.117 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.117 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.117 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.117 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.118 INFO:teuthology.orchestra.run.smithi087.stdout: "orchestrator": { 2024-09-13T17:24:14.118 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "orchestrator", 2024-09-13T17:24:14.118 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.118 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.118 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.118 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.118 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.118 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.118 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.118 INFO:teuthology.orchestra.run.smithi087.stdout: "cephadm", 2024-09-13T17:24:14.118 INFO:teuthology.orchestra.run.smithi087.stdout: "rook", 2024-09-13T17:24:14.118 INFO:teuthology.orchestra.run.smithi087.stdout: "test_orchestrator" 2024-09-13T17:24:14.118 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.118 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Orchestrator backend", 2024-09-13T17:24:14.119 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.119 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.119 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.119 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.119 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.119 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.119 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.119 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "osd_perf_query", 2024-09-13T17:24:14.119 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.119 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.119 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.119 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.119 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.119 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.120 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.120 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.120 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.120 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.120 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.120 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.120 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.120 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.120 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.120 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.120 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.120 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.120 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.120 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.121 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.121 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.121 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.121 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.121 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.121 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.121 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.121 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.121 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.121 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.121 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.121 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.121 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.121 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.122 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.122 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.122 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.122 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.122 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.122 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.122 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.122 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.122 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.122 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.122 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.122 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.122 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.122 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.123 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.123 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.123 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.123 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.123 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.123 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.123 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.123 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.123 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.123 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.123 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.123 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.124 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.124 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.124 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.124 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.124 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.124 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.124 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.124 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.124 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.124 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.124 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.124 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.125 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "osd_support", 2024-09-13T17:24:14.125 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.125 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.125 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.125 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.125 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.125 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.125 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.125 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.125 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.125 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.125 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.125 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.125 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.125 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.126 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.126 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.126 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.126 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.126 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.126 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.126 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.126 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.126 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.126 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.126 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.126 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.126 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.126 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.127 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.127 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.127 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.127 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.127 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.127 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.127 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.127 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.127 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.127 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.127 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.127 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.128 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.128 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.128 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.128 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.128 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.128 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.128 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.128 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.128 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.128 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.128 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.128 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.128 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.128 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.129 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.129 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.129 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.129 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.129 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.129 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.129 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.129 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.129 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.129 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.129 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.129 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.129 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.130 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.130 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.130 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.130 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.130 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.130 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "pg_autoscaler", 2024-09-13T17:24:14.130 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.130 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.130 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.130 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.130 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.130 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.131 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.131 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.131 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.131 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.131 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.131 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.131 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.131 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.131 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.131 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.131 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.131 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.131 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.131 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.132 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.132 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.132 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.132 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.132 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.132 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.132 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.132 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.132 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.132 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.132 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.132 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.133 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.133 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.133 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.133 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.133 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.133 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.133 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.133 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.133 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.133 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.133 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.133 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.133 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.134 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.134 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.134 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.134 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.134 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.134 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.134 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.134 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.134 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.134 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.134 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.134 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.134 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.134 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.135 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.135 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.135 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.135 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.135 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.135 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.135 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.135 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.135 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.135 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.135 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-09-13T17:24:14.135 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-09-13T17:24:14.135 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:14.136 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.136 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.136 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-09-13T17:24:14.136 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.136 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.136 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.136 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.136 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.136 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.136 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.136 INFO:teuthology.orchestra.run.smithi087.stdout: "threshold": { 2024-09-13T17:24:14.136 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "threshold", 2024-09-13T17:24:14.136 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-09-13T17:24:14.137 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.137 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.137 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "3.0", 2024-09-13T17:24:14.137 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1.0", 2024-09-13T17:24:14.137 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.137 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.137 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "scaling threshold", 2024-09-13T17:24:14.137 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-13T17:24:14.137 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.137 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.137 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.137 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.137 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "progress", 2024-09-13T17:24:14.138 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.138 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.138 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.138 INFO:teuthology.orchestra.run.smithi087.stdout: "allow_pg_recovery_event": { 2024-09-13T17:24:14.138 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "allow_pg_recovery_event", 2024-09-13T17:24:14.138 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.138 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.138 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.138 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.138 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.138 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.138 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.138 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-13T17:24:14.138 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.139 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.139 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.139 INFO:teuthology.orchestra.run.smithi087.stdout: "enabled": { 2024-09-13T17:24:14.139 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "enabled", 2024-09-13T17:24:14.139 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.139 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.139 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.139 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.139 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.139 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.139 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.139 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.139 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.139 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.140 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.140 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.140 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.140 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.140 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.140 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.140 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.140 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.140 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.140 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.140 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.140 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.141 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.141 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.141 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.141 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.141 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.141 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.141 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.141 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.141 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.141 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.141 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.141 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.141 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.142 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.142 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.142 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.142 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.142 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.142 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.142 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.142 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.142 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.142 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.142 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.142 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.142 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.143 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.143 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.143 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.143 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.143 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.143 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.143 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.143 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.143 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.143 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.143 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.143 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.143 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.143 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.144 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.144 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.144 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.144 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.144 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.144 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.144 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.144 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.144 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.144 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.144 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.144 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.144 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.145 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.145 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.145 INFO:teuthology.orchestra.run.smithi087.stdout: "max_completed_events": { 2024-09-13T17:24:14.145 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_completed_events", 2024-09-13T17:24:14.145 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.145 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.145 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.145 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "50", 2024-09-13T17:24:14.145 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.145 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.145 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.145 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "number of past completed events to remember", 2024-09-13T17:24:14.149 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.149 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.149 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.149 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-09-13T17:24:14.149 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-09-13T17:24:14.149 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:14.149 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.149 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.149 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5", 2024-09-13T17:24:14.149 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.149 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.150 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.150 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how long the module is going to sleep", 2024-09-13T17:24:14.150 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.150 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.150 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.150 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.150 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.150 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "prometheus", 2024-09-13T17:24:14.150 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.150 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.150 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.150 INFO:teuthology.orchestra.run.smithi087.stdout: "cache": { 2024-09-13T17:24:14.150 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cache", 2024-09-13T17:24:14.151 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.151 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.151 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.151 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.151 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.151 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.151 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.151 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.151 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.151 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.151 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.151 INFO:teuthology.orchestra.run.smithi087.stdout: "exclude_perf_counters": { 2024-09-13T17:24:14.151 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "exclude_perf_counters", 2024-09-13T17:24:14.152 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.152 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.152 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.152 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.152 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.152 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.152 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.152 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-13T17:24:14.152 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-13T17:24:14.152 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.152 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.152 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.152 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.153 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.153 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.153 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.153 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.153 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.153 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.153 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.153 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.153 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.153 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.153 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.153 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.153 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.153 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.153 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.154 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.154 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.154 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.154 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.154 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.154 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.154 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.154 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.154 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.154 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.154 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.154 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.155 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.155 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.155 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.155 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.155 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.155 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.155 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.155 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.155 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.155 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.155 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.155 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.155 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.155 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.156 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.156 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.156 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.156 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.156 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.156 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.156 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.156 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.156 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.156 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.156 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.156 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.156 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.157 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.157 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.157 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.157 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.157 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.157 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.157 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.157 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.157 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.157 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.157 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_stats_pools": { 2024-09-13T17:24:14.157 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rbd_stats_pools", 2024-09-13T17:24:14.158 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.158 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.158 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.158 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.158 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.158 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.158 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.158 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.158 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.158 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.158 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.158 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-13T17:24:14.158 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-13T17:24:14.159 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.159 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.159 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.159 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "300", 2024-09-13T17:24:14.159 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.159 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.159 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.159 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.159 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.159 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.159 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.159 INFO:teuthology.orchestra.run.smithi087.stdout: "scrape_interval": { 2024-09-13T17:24:14.160 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "scrape_interval", 2024-09-13T17:24:14.160 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-09-13T17:24:14.160 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.160 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.160 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "15.0", 2024-09-13T17:24:14.160 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.160 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.160 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.160 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.160 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.160 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.160 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.160 INFO:teuthology.orchestra.run.smithi087.stdout: "server_addr": { 2024-09-13T17:24:14.161 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_addr", 2024-09-13T17:24:14.161 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.161 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.161 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.161 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "::", 2024-09-13T17:24:14.161 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.161 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.161 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.161 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-13T17:24:14.161 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.161 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.161 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.161 INFO:teuthology.orchestra.run.smithi087.stdout: "server_port": { 2024-09-13T17:24:14.162 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_port", 2024-09-13T17:24:14.162 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.162 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.162 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.162 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "9283", 2024-09-13T17:24:14.162 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.162 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.162 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.162 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-13T17:24:14.162 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.162 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.162 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.162 INFO:teuthology.orchestra.run.smithi087.stdout: "stale_cache_strategy": { 2024-09-13T17:24:14.163 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "stale_cache_strategy", 2024-09-13T17:24:14.163 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.163 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.163 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.163 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "log", 2024-09-13T17:24:14.163 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.163 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.163 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.163 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.163 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.163 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.163 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.163 INFO:teuthology.orchestra.run.smithi087.stdout: "standby_behaviour": { 2024-09-13T17:24:14.163 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "standby_behaviour", 2024-09-13T17:24:14.164 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.164 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.164 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.164 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "default", 2024-09-13T17:24:14.164 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.164 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.164 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.164 INFO:teuthology.orchestra.run.smithi087.stdout: "default", 2024-09-13T17:24:14.164 INFO:teuthology.orchestra.run.smithi087.stdout: "error" 2024-09-13T17:24:14.164 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.164 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.164 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.164 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.164 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.165 INFO:teuthology.orchestra.run.smithi087.stdout: "standby_error_status_code": { 2024-09-13T17:24:14.165 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "standby_error_status_code", 2024-09-13T17:24:14.165 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.165 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.165 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.165 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "500", 2024-09-13T17:24:14.165 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "400", 2024-09-13T17:24:14.165 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "599", 2024-09-13T17:24:14.165 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.165 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.165 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.165 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.165 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.166 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.166 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.166 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rbd_support", 2024-09-13T17:24:14.166 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.166 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.166 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.166 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.166 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.166 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.166 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.166 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.166 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.166 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.167 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.167 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.167 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.167 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.167 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.167 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.167 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.167 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.167 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.167 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.167 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.167 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.167 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.168 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.168 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.168 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.168 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.168 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.168 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.168 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.168 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.168 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.168 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.168 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.168 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.168 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.169 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.169 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.169 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.169 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.169 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.169 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.169 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.169 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.169 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.169 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.169 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.169 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.169 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.169 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.170 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.170 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.170 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.170 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.170 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.170 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.170 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.170 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.170 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.170 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.170 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.170 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.170 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.171 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.171 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.171 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.171 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.171 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.171 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.171 INFO:teuthology.orchestra.run.smithi087.stdout: "max_concurrent_snap_create": { 2024-09-13T17:24:14.171 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_concurrent_snap_create", 2024-09-13T17:24:14.171 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.171 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.171 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.171 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-09-13T17:24:14.171 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.172 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.172 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.172 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.172 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.172 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.172 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.172 INFO:teuthology.orchestra.run.smithi087.stdout: "mirror_snapshot_schedule": { 2024-09-13T17:24:14.172 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mirror_snapshot_schedule", 2024-09-13T17:24:14.172 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.172 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.172 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.172 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.172 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.173 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.173 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.173 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.173 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.173 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.173 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.173 INFO:teuthology.orchestra.run.smithi087.stdout: "trash_purge_schedule": { 2024-09-13T17:24:14.173 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "trash_purge_schedule", 2024-09-13T17:24:14.173 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.173 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.173 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.173 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.173 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.174 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.174 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.174 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.174 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.174 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.174 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.174 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.174 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.174 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "restful", 2024-09-13T17:24:14.174 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.174 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.174 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.175 INFO:teuthology.orchestra.run.smithi087.stdout: "enable_auth": { 2024-09-13T17:24:14.175 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "enable_auth", 2024-09-13T17:24:14.175 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.175 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.175 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.175 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.175 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.175 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.175 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.175 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.175 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.175 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.175 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.176 INFO:teuthology.orchestra.run.smithi087.stdout: "key_file": { 2024-09-13T17:24:14.176 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "key_file", 2024-09-13T17:24:14.176 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.176 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.176 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.176 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.176 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.176 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.176 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.176 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.176 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.176 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.176 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.177 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.177 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.177 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.177 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.177 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.177 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.177 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.177 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.177 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.177 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.177 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.177 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.177 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.178 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.178 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.178 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.178 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.178 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.178 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.178 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.178 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.178 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.178 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.178 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.178 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.178 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.178 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.179 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.179 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.179 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.179 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.179 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.179 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.179 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.179 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.179 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.179 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.179 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.179 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.179 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.180 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.180 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.180 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.180 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.180 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.180 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.180 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.180 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.180 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.180 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.180 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.180 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.180 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.181 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.181 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.181 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.181 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.181 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.181 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.181 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.181 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.181 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.181 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.181 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.181 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.181 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.182 INFO:teuthology.orchestra.run.smithi087.stdout: "server_addr": { 2024-09-13T17:24:14.182 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_addr", 2024-09-13T17:24:14.182 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.182 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.182 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.182 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.182 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.182 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.182 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.182 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.182 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.182 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.182 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.183 INFO:teuthology.orchestra.run.smithi087.stdout: "server_port": { 2024-09-13T17:24:14.183 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_port", 2024-09-13T17:24:14.183 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.183 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.183 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.183 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.183 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.183 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.183 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.184 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.184 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.184 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.184 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.184 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.184 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.184 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rgw", 2024-09-13T17:24:14.184 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.184 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.184 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.184 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.184 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.185 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.185 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.185 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.185 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.185 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.185 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.185 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.185 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.185 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.185 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.185 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.185 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.185 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.186 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.186 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.186 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.186 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.186 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.186 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.186 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.186 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.186 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.186 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.186 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.186 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.186 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.187 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.187 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.187 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.187 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.187 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.187 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.187 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.187 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.187 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.187 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.187 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.187 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.187 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.188 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.188 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.188 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.188 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.188 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.188 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.188 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.188 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.188 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.188 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.188 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.188 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.188 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.189 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.189 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.189 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.189 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.189 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.189 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.189 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.189 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.189 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.189 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.189 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.189 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.189 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.189 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.190 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rook", 2024-09-13T17:24:14.190 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.190 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.190 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.190 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.190 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.190 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.190 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.190 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.190 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.190 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.190 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.191 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.191 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.191 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.191 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.191 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.191 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.191 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.191 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.191 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.191 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.191 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.191 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.191 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.192 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.192 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.192 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.192 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.192 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.192 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.192 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.192 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.192 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.192 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.192 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.192 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.192 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.193 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.193 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.193 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.193 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.193 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.193 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.193 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.193 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.193 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.193 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.193 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.193 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.193 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.193 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.194 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.194 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.194 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.194 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.194 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.194 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.194 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.194 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.194 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.194 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.194 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.194 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.194 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.195 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.195 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.195 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.195 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.195 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.195 INFO:teuthology.orchestra.run.smithi087.stdout: "storage_class": { 2024-09-13T17:24:14.195 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "storage_class", 2024-09-13T17:24:14.195 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.195 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.195 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.195 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "local", 2024-09-13T17:24:14.195 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.195 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.195 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.196 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-13T17:24:14.196 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.196 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.196 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.196 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.196 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.196 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "selftest", 2024-09-13T17:24:14.196 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.196 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.196 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.196 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.197 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.197 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.197 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.197 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.197 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.197 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.197 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.197 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.197 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.197 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.197 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.197 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.197 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.197 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.198 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.198 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.198 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.198 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.198 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.198 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.198 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.198 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.198 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.198 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.198 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.198 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.198 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.199 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.199 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.199 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.199 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.199 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.199 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.199 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.199 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.199 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.199 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.199 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.199 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.199 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.200 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.200 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.200 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.200 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.200 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.200 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.200 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.200 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.200 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.200 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.200 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.200 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.201 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.201 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.201 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.201 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.201 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.201 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.201 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.201 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.201 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.201 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.201 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.201 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.201 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.202 INFO:teuthology.orchestra.run.smithi087.stdout: "roption1": { 2024-09-13T17:24:14.202 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "roption1", 2024-09-13T17:24:14.202 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.202 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.202 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.202 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.202 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.202 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.202 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.202 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.202 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.202 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.202 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.203 INFO:teuthology.orchestra.run.smithi087.stdout: "roption2": { 2024-09-13T17:24:14.203 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "roption2", 2024-09-13T17:24:14.203 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.203 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.203 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.203 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "xyz", 2024-09-13T17:24:14.203 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.203 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.203 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.203 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.203 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.203 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.203 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.204 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption1": { 2024-09-13T17:24:14.204 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption1", 2024-09-13T17:24:14.204 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.204 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.204 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.204 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.204 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.204 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.204 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.204 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.204 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.204 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.204 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.205 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption2": { 2024-09-13T17:24:14.205 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption2", 2024-09-13T17:24:14.205 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.205 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.205 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.205 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.205 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.205 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.205 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.205 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.205 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.205 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.205 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.206 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption3": { 2024-09-13T17:24:14.206 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption3", 2024-09-13T17:24:14.206 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-09-13T17:24:14.206 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.206 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.206 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.206 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.206 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.206 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.206 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.206 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.206 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.206 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.207 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption4": { 2024-09-13T17:24:14.207 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption4", 2024-09-13T17:24:14.207 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.207 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.207 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.207 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.207 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.207 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.207 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.207 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.207 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.207 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.207 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.208 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption5": { 2024-09-13T17:24:14.208 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption5", 2024-09-13T17:24:14.208 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.208 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.208 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.208 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.208 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.208 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.208 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.208 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.208 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.208 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.208 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.209 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption6": { 2024-09-13T17:24:14.209 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption6", 2024-09-13T17:24:14.209 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.209 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.209 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.209 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.209 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.209 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.209 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.209 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.209 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.209 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.209 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.210 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption7": { 2024-09-13T17:24:14.210 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption7", 2024-09-13T17:24:14.210 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.210 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.210 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.210 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.210 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1", 2024-09-13T17:24:14.210 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "42", 2024-09-13T17:24:14.210 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.210 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.210 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.210 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.210 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.210 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.211 INFO:teuthology.orchestra.run.smithi087.stdout: "testkey": { 2024-09-13T17:24:14.211 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "testkey", 2024-09-13T17:24:14.211 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.211 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.211 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.211 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.211 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.211 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.211 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.211 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.211 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.211 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.211 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.211 INFO:teuthology.orchestra.run.smithi087.stdout: "testlkey": { 2024-09-13T17:24:14.212 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "testlkey", 2024-09-13T17:24:14.212 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.212 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.212 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.212 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.212 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.212 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.212 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.212 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.212 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.212 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.212 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.212 INFO:teuthology.orchestra.run.smithi087.stdout: "testnewline": { 2024-09-13T17:24:14.213 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "testnewline", 2024-09-13T17:24:14.213 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.213 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.213 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.213 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.213 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.213 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.213 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.213 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.213 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.213 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.213 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.213 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.214 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.214 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "snap_schedule", 2024-09-13T17:24:14.214 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.214 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.214 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.214 INFO:teuthology.orchestra.run.smithi087.stdout: "allow_m_granularity": { 2024-09-13T17:24:14.214 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "allow_m_granularity", 2024-09-13T17:24:14.214 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.214 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.214 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.214 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.214 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.215 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.215 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.215 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "allow minute scheduled snapshots", 2024-09-13T17:24:14.215 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.215 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.215 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.215 INFO:teuthology.orchestra.run.smithi087.stdout: "dump_on_update": { 2024-09-13T17:24:14.215 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "dump_on_update", 2024-09-13T17:24:14.215 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.215 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.215 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.215 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.216 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.216 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.216 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.216 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "dump database to debug log on update", 2024-09-13T17:24:14.216 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.216 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.216 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.216 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.216 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.216 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.216 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.216 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.216 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.217 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.217 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.217 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.217 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.217 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.217 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.217 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.217 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.217 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.217 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.217 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.217 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.217 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.217 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.218 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.218 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.218 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.218 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.218 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.218 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.218 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.218 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.218 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.218 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.218 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.218 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.218 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.219 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.219 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.219 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.219 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.219 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.219 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.219 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.219 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.219 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.219 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.219 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.219 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.219 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.220 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.220 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.220 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.220 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.220 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.220 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.220 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.220 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.220 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.220 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.220 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.220 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.220 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.221 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.221 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.221 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.221 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.221 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.221 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.221 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.221 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.221 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.221 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "stats", 2024-09-13T17:24:14.221 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.222 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.222 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.222 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.222 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.222 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.222 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.222 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.222 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.222 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.222 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.222 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.222 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.222 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.222 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.223 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.223 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.223 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.223 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.223 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.223 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.223 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.223 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.223 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.223 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.223 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.223 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.223 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.223 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.224 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.224 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.224 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.224 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.224 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.224 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.224 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.224 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.224 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.224 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.224 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.224 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.224 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.225 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.225 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.225 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.225 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.225 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.225 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.225 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.225 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.225 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.225 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.225 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.225 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.225 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.225 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.226 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.226 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.226 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.226 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.226 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.226 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.226 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.226 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.226 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.226 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.226 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.226 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.226 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.226 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.227 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.227 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.227 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.227 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.227 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "status", 2024-09-13T17:24:14.227 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.227 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.227 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.227 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.227 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.227 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.227 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.227 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.227 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.228 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.228 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.228 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.228 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.228 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.228 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.228 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.228 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.228 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.228 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.228 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.228 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.228 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.229 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.229 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.229 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.229 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.229 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.229 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.229 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.229 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.229 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.229 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.229 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.229 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.229 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.229 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.229 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.230 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.230 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.230 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.230 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.230 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.230 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.230 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.230 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.230 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.230 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.230 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.230 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.230 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.231 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.231 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.231 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.231 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.231 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.231 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.231 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.231 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.231 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.231 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.231 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.231 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.231 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.231 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.231 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.232 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.232 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.232 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.232 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.232 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.232 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.232 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.232 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.232 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.232 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.232 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.232 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "telegraf", 2024-09-13T17:24:14.232 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.233 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.233 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.233 INFO:teuthology.orchestra.run.smithi087.stdout: "address": { 2024-09-13T17:24:14.233 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "address", 2024-09-13T17:24:14.233 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.233 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.233 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.233 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-13T17:24:14.233 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.233 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.233 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.233 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.234 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.234 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.234 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.234 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.234 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-09-13T17:24:14.234 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-09-13T17:24:14.234 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:14.234 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.234 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.234 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "15", 2024-09-13T17:24:14.234 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.234 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.234 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.234 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.235 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.235 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.235 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.235 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.235 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.235 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.235 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.235 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.235 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.235 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.235 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.235 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.235 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.235 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.236 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.236 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.236 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.236 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.236 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.236 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.236 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.236 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.236 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.236 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.236 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.236 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.236 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.236 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.236 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.237 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.237 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.237 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.237 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.237 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.237 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.237 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.237 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.237 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.237 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.237 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.237 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.237 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.237 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.238 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.238 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.238 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.238 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.238 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.238 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.238 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.238 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.238 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.238 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.238 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.238 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.238 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.238 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.239 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.239 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.239 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.239 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.239 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.239 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.239 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.239 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.239 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.239 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.239 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.239 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.239 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.239 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.240 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.240 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.240 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.240 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.240 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.240 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.240 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "telemetry", 2024-09-13T17:24:14.240 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.240 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.240 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.240 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_basic": { 2024-09-13T17:24:14.240 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_basic", 2024-09-13T17:24:14.240 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.240 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.241 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.241 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.241 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.241 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.241 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.241 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-13T17:24:14.241 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.241 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.241 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.241 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.241 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_crash": { 2024-09-13T17:24:14.241 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_crash", 2024-09-13T17:24:14.241 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.241 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.242 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.242 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.242 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.242 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.242 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.242 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-13T17:24:14.242 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.242 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.242 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.242 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.242 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_device": { 2024-09-13T17:24:14.242 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_device", 2024-09-13T17:24:14.242 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.242 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.243 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.243 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.243 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.243 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.243 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.243 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-13T17:24:14.243 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.243 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.243 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.243 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.243 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_ident": { 2024-09-13T17:24:14.243 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_ident", 2024-09-13T17:24:14.243 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.243 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.244 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.244 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.244 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.244 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.244 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.244 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-13T17:24:14.244 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.244 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.244 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.244 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.244 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_perf": { 2024-09-13T17:24:14.244 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_perf", 2024-09-13T17:24:14.244 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.245 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.245 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.245 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.245 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.245 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.245 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.245 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-13T17:24:14.245 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.245 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.245 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.245 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.245 INFO:teuthology.orchestra.run.smithi087.stdout: "contact": { 2024-09-13T17:24:14.245 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "contact", 2024-09-13T17:24:14.246 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.246 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.246 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.246 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.246 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.246 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.246 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.246 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.246 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.246 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.246 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.246 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.246 INFO:teuthology.orchestra.run.smithi087.stdout: "description": { 2024-09-13T17:24:14.246 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "description", 2024-09-13T17:24:14.247 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.247 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.247 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.247 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.247 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.247 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.247 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.247 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.247 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.247 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.247 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.247 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.247 INFO:teuthology.orchestra.run.smithi087.stdout: "device_url": { 2024-09-13T17:24:14.248 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "device_url", 2024-09-13T17:24:14.248 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.248 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.248 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.248 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-13T17:24:14.248 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.248 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.248 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.248 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.248 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.249 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.249 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.249 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.249 INFO:teuthology.orchestra.run.smithi087.stdout: "enabled": { 2024-09-13T17:24:14.249 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "enabled", 2024-09-13T17:24:14.249 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.249 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.249 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.249 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.249 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.249 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.249 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.249 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.250 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.250 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.250 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.250 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.250 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-09-13T17:24:14.250 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-09-13T17:24:14.250 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.250 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.250 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.250 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "24", 2024-09-13T17:24:14.251 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "8", 2024-09-13T17:24:14.251 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.251 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.251 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.251 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.251 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.251 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.251 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.251 INFO:teuthology.orchestra.run.smithi087.stdout: "last_opt_revision": { 2024-09-13T17:24:14.251 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "last_opt_revision", 2024-09-13T17:24:14.251 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.251 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.251 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.252 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "1", 2024-09-13T17:24:14.252 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.252 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.252 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.252 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.252 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.252 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.252 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.252 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.252 INFO:teuthology.orchestra.run.smithi087.stdout: "leaderboard": { 2024-09-13T17:24:14.252 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "leaderboard", 2024-09-13T17:24:14.253 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.253 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.253 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.253 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.253 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.253 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.253 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.253 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.253 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.253 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.253 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.253 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.254 INFO:teuthology.orchestra.run.smithi087.stdout: "leaderboard_description": { 2024-09-13T17:24:14.254 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "leaderboard_description", 2024-09-13T17:24:14.254 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.254 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.254 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.254 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.254 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.254 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.254 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.254 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.254 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.255 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.255 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.255 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.255 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.255 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.255 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.255 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.255 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.255 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.255 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.255 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.255 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.256 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.256 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.256 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.256 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.256 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.256 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.256 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.256 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.257 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.257 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.257 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.257 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.257 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.257 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.257 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.257 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.257 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.257 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.257 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.258 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.258 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.258 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.258 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.258 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.258 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.258 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.258 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.258 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.258 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.259 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.259 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.259 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.259 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.259 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.259 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.259 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.259 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.259 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.259 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.259 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.259 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.259 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.259 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.260 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.260 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.260 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.260 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.260 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.260 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.260 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.260 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.260 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.260 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.260 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.260 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.260 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.260 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.261 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.261 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.261 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.261 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.261 INFO:teuthology.orchestra.run.smithi087.stdout: "organization": { 2024-09-13T17:24:14.261 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "organization", 2024-09-13T17:24:14.261 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.261 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.261 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.261 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.261 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.262 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.262 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.262 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.262 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.262 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.262 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.262 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.262 INFO:teuthology.orchestra.run.smithi087.stdout: "proxy": { 2024-09-13T17:24:14.262 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "proxy", 2024-09-13T17:24:14.262 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.262 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.262 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.262 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.262 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.263 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.263 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.263 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.263 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.263 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.263 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.263 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.263 INFO:teuthology.orchestra.run.smithi087.stdout: "url": { 2024-09-13T17:24:14.263 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "url", 2024-09-13T17:24:14.263 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.263 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.263 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.263 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-13T17:24:14.264 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.264 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.264 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.264 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.264 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.264 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.264 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.264 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.264 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.264 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.264 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "test_orchestrator", 2024-09-13T17:24:14.264 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.264 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.265 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.265 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.265 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.265 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.265 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.265 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.265 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.265 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.265 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.265 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.265 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.265 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.265 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.265 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.266 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.266 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.266 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.266 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.266 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.266 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.266 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.266 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.266 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.266 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.266 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.266 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.266 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.266 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.267 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.267 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.267 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.267 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.267 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.267 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.267 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.267 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.267 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.267 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.267 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.267 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.267 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.267 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.267 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.268 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.268 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.268 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.268 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.268 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.268 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.268 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.268 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.268 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.268 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.268 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.268 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.268 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.268 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.269 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.269 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.269 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.269 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.269 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.269 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.269 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.269 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.269 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.269 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.269 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.269 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.269 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.269 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.270 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.270 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.270 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.270 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "volumes", 2024-09-13T17:24:14.270 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.270 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.270 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.270 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.270 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.270 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.270 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.270 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.270 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.270 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.271 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.271 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.271 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.271 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.271 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.271 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.271 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.271 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.271 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.271 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.271 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.271 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.271 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.272 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.272 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.272 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.272 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.272 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.272 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.272 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.272 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.272 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.272 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.272 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.272 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.272 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.272 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.273 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.273 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.273 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.273 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.273 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.273 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.273 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.273 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.273 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.273 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.273 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.273 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.273 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.273 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.274 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.274 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.274 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.274 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.274 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.274 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.274 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.274 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.274 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.274 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.274 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.274 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.274 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.274 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.275 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.275 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.275 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.275 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.275 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.275 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.275 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.275 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.275 INFO:teuthology.orchestra.run.smithi087.stdout: "max_concurrent_clones": { 2024-09-13T17:24:14.275 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_concurrent_clones", 2024-09-13T17:24:14.275 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.275 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.275 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.275 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "4", 2024-09-13T17:24:14.276 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.276 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.276 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.276 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-13T17:24:14.276 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.276 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.276 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.276 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.276 INFO:teuthology.orchestra.run.smithi087.stdout: "snapshot_clone_delay": { 2024-09-13T17:24:14.276 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "snapshot_clone_delay", 2024-09-13T17:24:14.276 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.276 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.276 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.276 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-09-13T17:24:14.277 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.277 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.277 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.277 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-13T17:24:14.277 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.277 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.277 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.277 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.277 INFO:teuthology.orchestra.run.smithi087.stdout: "snapshot_clone_no_wait": { 2024-09-13T17:24:14.277 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "snapshot_clone_no_wait", 2024-09-13T17:24:14.277 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.277 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.277 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.277 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.278 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.278 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.278 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.278 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-13T17:24:14.278 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.278 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.278 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.278 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.278 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.278 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.278 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.278 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "zabbix", 2024-09-13T17:24:14.278 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.278 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.279 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.279 INFO:teuthology.orchestra.run.smithi087.stdout: "discovery_interval": { 2024-09-13T17:24:14.279 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "discovery_interval", 2024-09-13T17:24:14.279 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-09-13T17:24:14.279 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.279 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.279 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "100", 2024-09-13T17:24:14.279 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.279 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.279 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.279 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.279 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.279 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.279 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.280 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.280 INFO:teuthology.orchestra.run.smithi087.stdout: "identifier": { 2024-09-13T17:24:14.280 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "identifier", 2024-09-13T17:24:14.280 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.280 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.280 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.280 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.280 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.280 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.280 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.280 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.280 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.280 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.280 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.281 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.281 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-09-13T17:24:14.281 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-09-13T17:24:14.281 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:14.281 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.281 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.281 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-09-13T17:24:14.281 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.281 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.281 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.281 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.281 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.281 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.281 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.281 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.282 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.282 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.282 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.282 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.282 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.282 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.282 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.282 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.282 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.282 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.282 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.282 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.282 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.282 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.283 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.283 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.283 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.283 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.283 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.283 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.283 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.283 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.283 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.283 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.283 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.283 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.284 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.284 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.284 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.284 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.284 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.284 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.284 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.284 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.284 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.284 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.284 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.285 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.285 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.285 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.285 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.285 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.285 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.285 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.285 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.285 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.285 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.285 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.285 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.285 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.286 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.286 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.286 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.286 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.286 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.286 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.286 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.286 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.286 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.286 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.286 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.286 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.286 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.286 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.287 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.287 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.287 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.287 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.287 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.287 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.287 INFO:teuthology.orchestra.run.smithi087.stdout: "zabbix_host": { 2024-09-13T17:24:14.287 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "zabbix_host", 2024-09-13T17:24:14.287 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.287 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.287 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.287 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.287 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.287 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.288 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.288 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.288 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.288 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.288 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.288 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.288 INFO:teuthology.orchestra.run.smithi087.stdout: "zabbix_port": { 2024-09-13T17:24:14.288 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "zabbix_port", 2024-09-13T17:24:14.288 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.288 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.288 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.288 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10051", 2024-09-13T17:24:14.288 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.288 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.289 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.289 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.289 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.289 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.289 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.289 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.289 INFO:teuthology.orchestra.run.smithi087.stdout: "zabbix_sender": { 2024-09-13T17:24:14.289 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "zabbix_sender", 2024-09-13T17:24:14.289 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.289 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.289 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.289 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-13T17:24:14.289 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.289 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.290 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.290 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.290 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.290 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.290 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.290 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.290 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.290 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.290 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-13T17:24:14.290 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.290 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.290 INFO:teuthology.orchestra.run.smithi087.stdout: "modules": [ 2024-09-13T17:24:14.290 INFO:teuthology.orchestra.run.smithi087.stdout: "cephadm", 2024-09-13T17:24:14.290 INFO:teuthology.orchestra.run.smithi087.stdout: "dashboard", 2024-09-13T17:24:14.291 INFO:teuthology.orchestra.run.smithi087.stdout: "iostat", 2024-09-13T17:24:14.291 INFO:teuthology.orchestra.run.smithi087.stdout: "nfs", 2024-09-13T17:24:14.291 INFO:teuthology.orchestra.run.smithi087.stdout: "restful", 2024-09-13T17:24:14.291 INFO:teuthology.orchestra.run.smithi087.stdout: "snap_schedule" 2024-09-13T17:24:14.291 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.291 INFO:teuthology.orchestra.run.smithi087.stdout: "available_modules": [ 2024-09-13T17:24:14.291 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.291 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "alerts", 2024-09-13T17:24:14.291 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.291 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.291 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.291 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-09-13T17:24:14.291 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-09-13T17:24:14.291 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:14.292 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.292 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.292 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-09-13T17:24:14.292 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.292 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.292 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.292 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "How frequently to reexamine health status", 2024-09-13T17:24:14.292 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.292 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.292 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.292 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.292 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.292 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.292 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.293 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.293 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.293 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.293 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.293 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.293 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.293 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.293 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.293 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.293 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.293 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.293 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.293 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.293 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.294 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.294 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.294 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.294 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.294 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.294 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.294 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.294 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.294 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.294 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.294 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.294 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.294 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.294 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.295 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.295 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.295 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.295 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.295 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.295 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.295 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.295 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.295 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.295 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.295 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.295 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.295 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.295 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.295 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.296 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.296 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.296 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.296 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.296 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.296 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.296 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.296 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.296 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.296 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.296 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.296 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.296 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.296 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.297 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.297 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.297 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.297 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.297 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.297 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.297 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.297 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.297 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.297 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.297 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_destination": { 2024-09-13T17:24:14.297 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_destination", 2024-09-13T17:24:14.297 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.297 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.298 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.298 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.298 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.298 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.298 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.298 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Email address to send alerts to", 2024-09-13T17:24:14.298 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.298 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.298 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.298 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.298 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_from_name": { 2024-09-13T17:24:14.298 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_from_name", 2024-09-13T17:24:14.298 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.299 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.299 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.299 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "Ceph", 2024-09-13T17:24:14.299 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.299 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.299 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.299 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Email From: name", 2024-09-13T17:24:14.299 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.299 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.299 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.299 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.299 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_host": { 2024-09-13T17:24:14.299 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_host", 2024-09-13T17:24:14.299 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.300 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.300 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.300 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.300 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.300 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.300 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.300 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "SMTP server", 2024-09-13T17:24:14.300 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.300 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.300 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.300 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.300 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_password": { 2024-09-13T17:24:14.300 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_password", 2024-09-13T17:24:14.300 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.301 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.301 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.301 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.301 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.301 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.301 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.301 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Password to authenticate with", 2024-09-13T17:24:14.301 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.301 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.301 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.301 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.301 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_port": { 2024-09-13T17:24:14.301 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_port", 2024-09-13T17:24:14.302 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.302 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.302 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.302 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "465", 2024-09-13T17:24:14.302 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.302 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.302 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.302 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "SMTP port", 2024-09-13T17:24:14.302 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.302 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.302 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.302 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.302 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_sender": { 2024-09-13T17:24:14.302 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_sender", 2024-09-13T17:24:14.303 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.303 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.303 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.303 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.303 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.303 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.303 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.303 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "SMTP envelope sender", 2024-09-13T17:24:14.303 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.303 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.303 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.303 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.303 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_ssl": { 2024-09-13T17:24:14.303 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_ssl", 2024-09-13T17:24:14.304 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.304 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.304 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.304 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.304 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.304 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.304 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.304 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-13T17:24:14.304 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.304 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.304 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.304 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.304 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_user": { 2024-09-13T17:24:14.304 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_user", 2024-09-13T17:24:14.305 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.305 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.305 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.305 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.305 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.305 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.305 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.305 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "User to authenticate as", 2024-09-13T17:24:14.305 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.305 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.305 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.305 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.305 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.305 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.306 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.306 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "balancer", 2024-09-13T17:24:14.306 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.306 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.306 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.306 INFO:teuthology.orchestra.run.smithi087.stdout: "active": { 2024-09-13T17:24:14.306 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "active", 2024-09-13T17:24:14.306 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.306 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.306 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.306 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.306 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.306 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.306 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.307 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "automatically balance PGs across cluster", 2024-09-13T17:24:14.307 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.307 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.307 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.307 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.307 INFO:teuthology.orchestra.run.smithi087.stdout: "begin_time": { 2024-09-13T17:24:14.307 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "begin_time", 2024-09-13T17:24:14.307 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.307 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.307 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.307 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0000", 2024-09-13T17:24:14.307 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.307 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.307 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.308 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "beginning time of day to automatically balance", 2024-09-13T17:24:14.308 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T17:24:14.308 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.308 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.308 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.308 INFO:teuthology.orchestra.run.smithi087.stdout: "begin_weekday": { 2024-09-13T17:24:14.308 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "begin_weekday", 2024-09-13T17:24:14.308 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-09-13T17:24:14.308 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.308 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.308 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-09-13T17:24:14.308 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "0", 2024-09-13T17:24:14.308 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "6", 2024-09-13T17:24:14.308 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.309 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-13T17:24:14.309 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T17:24:14.309 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.309 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.309 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.309 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_compat_max_iterations": { 2024-09-13T17:24:14.309 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crush_compat_max_iterations", 2024-09-13T17:24:14.309 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-09-13T17:24:14.309 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.309 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.309 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "25", 2024-09-13T17:24:14.309 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1", 2024-09-13T17:24:14.309 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "250", 2024-09-13T17:24:14.309 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.310 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-13T17:24:14.310 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.310 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.310 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.310 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.310 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_compat_metrics": { 2024-09-13T17:24:14.310 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crush_compat_metrics", 2024-09-13T17:24:14.310 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.310 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.310 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.310 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "pgs,objects,bytes", 2024-09-13T17:24:14.310 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.310 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.310 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.311 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-13T17:24:14.311 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-13T17:24:14.311 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.311 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.311 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.311 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_compat_step": { 2024-09-13T17:24:14.311 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crush_compat_step", 2024-09-13T17:24:14.311 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-09-13T17:24:14.311 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.311 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.311 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0.5", 2024-09-13T17:24:14.311 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "0.001", 2024-09-13T17:24:14.311 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "0.999", 2024-09-13T17:24:14.311 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.312 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "aggressiveness of optimization", 2024-09-13T17:24:14.312 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-13T17:24:14.312 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.312 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.312 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.312 INFO:teuthology.orchestra.run.smithi087.stdout: "end_time": { 2024-09-13T17:24:14.312 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "end_time", 2024-09-13T17:24:14.312 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.312 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.312 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.312 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "2359", 2024-09-13T17:24:14.312 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.312 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.312 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.313 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "ending time of day to automatically balance", 2024-09-13T17:24:14.313 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T17:24:14.313 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.313 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.313 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.313 INFO:teuthology.orchestra.run.smithi087.stdout: "end_weekday": { 2024-09-13T17:24:14.313 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "end_weekday", 2024-09-13T17:24:14.313 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-09-13T17:24:14.313 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.313 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.313 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-09-13T17:24:14.313 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "0", 2024-09-13T17:24:14.313 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "6", 2024-09-13T17:24:14.313 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.314 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-13T17:24:14.314 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T17:24:14.314 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.314 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.314 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.314 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.314 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.314 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.314 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.314 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.314 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.314 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.314 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.314 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.314 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.315 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.315 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.315 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.315 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.315 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.315 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.315 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.315 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.315 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.315 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.315 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.315 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.315 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.315 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.316 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.316 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.316 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.316 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.316 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.316 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.316 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.316 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.316 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.316 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.316 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.316 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.316 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.317 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.317 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.317 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.317 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.317 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.317 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.317 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.317 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.317 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.317 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.317 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.317 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.317 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.317 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.318 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.318 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.318 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.318 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.318 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.318 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.318 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.318 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.318 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.318 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.318 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.318 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.318 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.318 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.319 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.319 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.319 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.319 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.319 INFO:teuthology.orchestra.run.smithi087.stdout: "min_score": { 2024-09-13T17:24:14.319 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "min_score", 2024-09-13T17:24:14.319 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-09-13T17:24:14.319 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.319 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.319 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-09-13T17:24:14.319 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.319 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.319 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.320 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-13T17:24:14.320 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.320 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.320 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.320 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.320 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": { 2024-09-13T17:24:14.320 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mode", 2024-09-13T17:24:14.320 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.320 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.320 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.320 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "upmap", 2024-09-13T17:24:14.320 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.320 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.320 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.321 INFO:teuthology.orchestra.run.smithi087.stdout: "crush-compat", 2024-09-13T17:24:14.321 INFO:teuthology.orchestra.run.smithi087.stdout: "none", 2024-09-13T17:24:14.321 INFO:teuthology.orchestra.run.smithi087.stdout: "upmap" 2024-09-13T17:24:14.321 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.321 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Balancer mode", 2024-09-13T17:24:14.321 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.321 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.321 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.321 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.321 INFO:teuthology.orchestra.run.smithi087.stdout: "pool_ids": { 2024-09-13T17:24:14.321 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "pool_ids", 2024-09-13T17:24:14.321 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.321 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.321 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.322 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.322 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.322 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.322 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.322 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-13T17:24:14.322 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.322 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.322 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.322 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-09-13T17:24:14.322 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-09-13T17:24:14.322 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:14.322 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.322 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.323 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-09-13T17:24:14.323 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.323 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.323 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.323 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-13T17:24:14.323 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.323 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.323 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.323 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.323 INFO:teuthology.orchestra.run.smithi087.stdout: "upmap_max_deviation": { 2024-09-13T17:24:14.323 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "upmap_max_deviation", 2024-09-13T17:24:14.323 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.323 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.323 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.324 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5", 2024-09-13T17:24:14.324 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1", 2024-09-13T17:24:14.324 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.324 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.324 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-13T17:24:14.324 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-13T17:24:14.324 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.324 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.324 INFO:teuthology.orchestra.run.smithi087.stdout: "upmap_max_optimizations": { 2024-09-13T17:24:14.324 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "upmap_max_optimizations", 2024-09-13T17:24:14.324 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-09-13T17:24:14.324 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.324 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.325 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-09-13T17:24:14.325 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.325 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.325 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.325 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-13T17:24:14.325 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.325 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.325 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.325 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.325 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.325 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.325 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.325 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cephadm", 2024-09-13T17:24:14.325 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.326 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.326 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.326 INFO:teuthology.orchestra.run.smithi087.stdout: "agent_down_multiplier": { 2024-09-13T17:24:14.326 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "agent_down_multiplier", 2024-09-13T17:24:14.326 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-09-13T17:24:14.326 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.326 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.326 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "3.0", 2024-09-13T17:24:14.326 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.326 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.326 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.326 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-13T17:24:14.326 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.326 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.327 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.327 INFO:teuthology.orchestra.run.smithi087.stdout: "agent_refresh_rate": { 2024-09-13T17:24:14.327 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "agent_refresh_rate", 2024-09-13T17:24:14.327 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:14.327 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.327 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.327 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "20", 2024-09-13T17:24:14.327 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.327 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.327 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.327 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-13T17:24:14.327 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.327 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.327 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.328 INFO:teuthology.orchestra.run.smithi087.stdout: "agent_starting_port": { 2024-09-13T17:24:14.328 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "agent_starting_port", 2024-09-13T17:24:14.328 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.328 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.328 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.328 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "4721", 2024-09-13T17:24:14.328 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.328 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.328 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.328 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-13T17:24:14.328 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.328 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.328 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.329 INFO:teuthology.orchestra.run.smithi087.stdout: "allow_ptrace": { 2024-09-13T17:24:14.329 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "allow_ptrace", 2024-09-13T17:24:14.329 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.329 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.329 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.329 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.329 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.329 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.329 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.329 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-13T17:24:14.329 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-13T17:24:14.329 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.329 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.330 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.330 INFO:teuthology.orchestra.run.smithi087.stdout: "autotune_interval": { 2024-09-13T17:24:14.330 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "autotune_interval", 2024-09-13T17:24:14.330 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:14.330 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.330 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.330 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-09-13T17:24:14.330 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.330 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.330 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.330 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-13T17:24:14.330 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.330 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.330 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.331 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.331 INFO:teuthology.orchestra.run.smithi087.stdout: "autotune_memory_target_ratio": { 2024-09-13T17:24:14.331 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "autotune_memory_target_ratio", 2024-09-13T17:24:14.331 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-09-13T17:24:14.331 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.331 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.331 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0.7", 2024-09-13T17:24:14.331 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.331 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.331 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.331 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-13T17:24:14.331 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.331 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.332 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.332 INFO:teuthology.orchestra.run.smithi087.stdout: "cgroups_split": { 2024-09-13T17:24:14.332 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cgroups_split", 2024-09-13T17:24:14.332 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.332 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.332 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.332 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.332 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.332 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.332 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.332 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-13T17:24:14.332 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.332 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.333 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.333 INFO:teuthology.orchestra.run.smithi087.stdout: "config_checks_enabled": { 2024-09-13T17:24:14.333 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "config_checks_enabled", 2024-09-13T17:24:14.333 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.333 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.333 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.333 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.333 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.333 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.333 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.333 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-13T17:24:14.333 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.333 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.334 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.334 INFO:teuthology.orchestra.run.smithi087.stdout: "config_dashboard": { 2024-09-13T17:24:14.334 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "config_dashboard", 2024-09-13T17:24:14.334 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.334 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.334 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.334 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.334 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.334 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.334 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.334 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-13T17:24:14.334 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.334 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.335 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.335 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_alertmanager": { 2024-09-13T17:24:14.335 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_alertmanager", 2024-09-13T17:24:14.335 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.335 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.335 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.335 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-13T17:24:14.335 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.335 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.335 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.335 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Prometheus container image", 2024-09-13T17:24:14.335 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.336 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.336 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.336 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_base": { 2024-09-13T17:24:14.336 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_base", 2024-09-13T17:24:14.336 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.336 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.336 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.336 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-13T17:24:14.336 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.336 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.336 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.336 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Container image name, without the tag", 2024-09-13T17:24:14.336 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.337 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.337 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.337 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_elasticsearch": { 2024-09-13T17:24:14.337 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_elasticsearch", 2024-09-13T17:24:14.337 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.337 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.337 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.337 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-13T17:24:14.337 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.337 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.337 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.337 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "elasticsearch container image", 2024-09-13T17:24:14.337 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.338 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.338 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.338 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_grafana": { 2024-09-13T17:24:14.338 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_grafana", 2024-09-13T17:24:14.338 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.338 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.338 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.338 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-09-13T17:24:14.338 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.338 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.338 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.338 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Prometheus container image", 2024-09-13T17:24:14.338 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.339 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.339 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.339 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_haproxy": { 2024-09-13T17:24:14.339 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_haproxy", 2024-09-13T17:24:14.339 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.339 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.339 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.339 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-13T17:24:14.339 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.339 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.339 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.339 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "HAproxy container image", 2024-09-13T17:24:14.339 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.340 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.340 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.340 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_jaeger_agent": { 2024-09-13T17:24:14.340 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_jaeger_agent", 2024-09-13T17:24:14.340 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.340 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.340 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.340 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-13T17:24:14.340 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.340 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.340 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.340 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Jaeger agent container image", 2024-09-13T17:24:14.340 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.341 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.341 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.341 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_jaeger_collector": { 2024-09-13T17:24:14.341 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_jaeger_collector", 2024-09-13T17:24:14.341 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.341 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.341 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.341 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-13T17:24:14.341 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.341 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.341 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.341 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Jaeger collector container image", 2024-09-13T17:24:14.341 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.342 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.342 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.342 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_jaeger_query": { 2024-09-13T17:24:14.342 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_jaeger_query", 2024-09-13T17:24:14.342 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.342 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.342 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.342 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-13T17:24:14.342 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.342 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.342 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.342 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Jaeger query container image", 2024-09-13T17:24:14.342 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.342 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.343 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.343 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.343 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_keepalived": { 2024-09-13T17:24:14.343 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_keepalived", 2024-09-13T17:24:14.343 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.343 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.343 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.343 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-13T17:24:14.343 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.343 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.343 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.343 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Keepalived container image", 2024-09-13T17:24:14.343 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.343 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.343 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.344 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_loki": { 2024-09-13T17:24:14.344 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_loki", 2024-09-13T17:24:14.344 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.344 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.344 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.344 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-13T17:24:14.344 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.344 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.344 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.344 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Loki container image", 2024-09-13T17:24:14.344 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.344 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.344 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.345 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_node_exporter": { 2024-09-13T17:24:14.345 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_node_exporter", 2024-09-13T17:24:14.345 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.345 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.345 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.345 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-13T17:24:14.345 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.345 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.345 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.345 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Prometheus container image", 2024-09-13T17:24:14.345 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.345 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.345 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.346 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_nvmeof": { 2024-09-13T17:24:14.346 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_nvmeof", 2024-09-13T17:24:14.346 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.346 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.346 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.346 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-09-13T17:24:14.346 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.346 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.346 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.346 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Nvme-of container image", 2024-09-13T17:24:14.346 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.346 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.346 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.347 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_prometheus": { 2024-09-13T17:24:14.347 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_prometheus", 2024-09-13T17:24:14.347 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.347 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.347 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.347 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-13T17:24:14.347 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.347 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.347 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.347 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Prometheus container image", 2024-09-13T17:24:14.347 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.347 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.347 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.348 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.348 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_promtail": { 2024-09-13T17:24:14.348 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_promtail", 2024-09-13T17:24:14.348 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.348 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.348 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.348 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-13T17:24:14.348 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.348 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.348 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.348 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Promtail container image", 2024-09-13T17:24:14.348 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.348 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.348 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.349 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.349 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_snmp_gateway": { 2024-09-13T17:24:14.349 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_snmp_gateway", 2024-09-13T17:24:14.349 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.349 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.349 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.349 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-13T17:24:14.349 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.349 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.349 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.349 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "SNMP Gateway container image", 2024-09-13T17:24:14.349 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.349 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.349 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.350 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.350 INFO:teuthology.orchestra.run.smithi087.stdout: "container_init": { 2024-09-13T17:24:14.350 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_init", 2024-09-13T17:24:14.350 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.350 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.350 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.350 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.350 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.350 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.350 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.350 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Run podman/docker with `--init`", 2024-09-13T17:24:14.350 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.350 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.350 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.351 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.351 INFO:teuthology.orchestra.run.smithi087.stdout: "daemon_cache_timeout": { 2024-09-13T17:24:14.351 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "daemon_cache_timeout", 2024-09-13T17:24:14.351 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:14.351 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.351 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.351 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-09-13T17:24:14.351 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.351 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.351 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.351 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-13T17:24:14.351 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.351 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.351 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.352 INFO:teuthology.orchestra.run.smithi087.stdout: "default_cephadm_command_timeout": { 2024-09-13T17:24:14.352 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "default_cephadm_command_timeout", 2024-09-13T17:24:14.352 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.352 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.352 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.352 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "900", 2024-09-13T17:24:14.352 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.352 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.352 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.352 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-13T17:24:14.352 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.352 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.352 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.353 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.353 INFO:teuthology.orchestra.run.smithi087.stdout: "default_registry": { 2024-09-13T17:24:14.353 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "default_registry", 2024-09-13T17:24:14.353 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.353 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.353 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.353 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "docker.io", 2024-09-13T17:24:14.353 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.353 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.353 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.353 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-13T17:24:14.353 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.354 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.354 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.354 INFO:teuthology.orchestra.run.smithi087.stdout: "device_cache_timeout": { 2024-09-13T17:24:14.354 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "device_cache_timeout", 2024-09-13T17:24:14.354 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:14.354 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.354 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.354 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "1800", 2024-09-13T17:24:14.354 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.354 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.354 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.354 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "seconds to cache device inventory", 2024-09-13T17:24:14.354 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.355 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.355 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.355 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.355 INFO:teuthology.orchestra.run.smithi087.stdout: "device_enhanced_scan": { 2024-09-13T17:24:14.355 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "device_enhanced_scan", 2024-09-13T17:24:14.355 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.355 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.355 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.355 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.355 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.355 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.355 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.355 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-13T17:24:14.355 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.356 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.356 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.356 INFO:teuthology.orchestra.run.smithi087.stdout: "facts_cache_timeout": { 2024-09-13T17:24:14.356 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "facts_cache_timeout", 2024-09-13T17:24:14.356 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:14.356 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.356 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.356 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-09-13T17:24:14.356 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.356 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.356 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.356 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "seconds to cache host facts data", 2024-09-13T17:24:14.356 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.357 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.357 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.357 INFO:teuthology.orchestra.run.smithi087.stdout: "host_check_interval": { 2024-09-13T17:24:14.357 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "host_check_interval", 2024-09-13T17:24:14.357 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:14.357 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.357 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.357 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-09-13T17:24:14.357 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.357 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.357 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.357 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to perform a host check", 2024-09-13T17:24:14.357 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.357 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.358 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.358 INFO:teuthology.orchestra.run.smithi087.stdout: "hw_monitoring": { 2024-09-13T17:24:14.358 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "hw_monitoring", 2024-09-13T17:24:14.358 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.358 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.358 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.358 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.358 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.358 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.358 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.358 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-13T17:24:14.358 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.358 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.359 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.359 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.359 INFO:teuthology.orchestra.run.smithi087.stdout: "inventory_list_all": { 2024-09-13T17:24:14.359 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "inventory_list_all", 2024-09-13T17:24:14.359 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.359 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.359 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.359 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.359 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.359 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.359 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.359 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-13T17:24:14.359 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.359 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.360 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.360 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.360 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.360 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.360 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.360 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.360 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.360 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.360 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.360 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.360 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.360 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.360 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.360 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.360 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.361 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.361 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.361 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.361 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.361 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.361 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.361 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.361 INFO:teuthology.orchestra.run.smithi087.stdout: "log_refresh_metadata": { 2024-09-13T17:24:14.361 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_refresh_metadata", 2024-09-13T17:24:14.361 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.361 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.361 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.362 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.362 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.362 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.362 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.362 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-13T17:24:14.362 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.362 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.362 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.362 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.362 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.362 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.362 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.362 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.362 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.363 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.363 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.363 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.363 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.363 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-13T17:24:14.363 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.363 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.363 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.363 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.363 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.363 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.363 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.363 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.364 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.364 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.364 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.364 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.364 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.364 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.364 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.364 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.364 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.364 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.364 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.364 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.364 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.364 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.365 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.365 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.365 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.365 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.365 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.365 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.365 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.365 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.365 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.365 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.365 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.365 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.365 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.365 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.366 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.366 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.366 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.366 INFO:teuthology.orchestra.run.smithi087.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-13T17:24:14.366 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-13T17:24:14.366 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.366 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.366 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.366 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.366 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.366 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.366 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.366 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-13T17:24:14.366 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.367 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.367 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.367 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.367 INFO:teuthology.orchestra.run.smithi087.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-13T17:24:14.367 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-13T17:24:14.367 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.367 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.367 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.367 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "*", 2024-09-13T17:24:14.367 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.367 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.367 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.367 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-13T17:24:14.367 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.368 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.368 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.368 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.368 INFO:teuthology.orchestra.run.smithi087.stdout: "max_count_per_host": { 2024-09-13T17:24:14.368 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_count_per_host", 2024-09-13T17:24:14.368 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.368 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.368 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.368 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-09-13T17:24:14.368 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.368 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.368 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.368 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "max number of daemons per service per host", 2024-09-13T17:24:14.368 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.369 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.369 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.369 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.369 INFO:teuthology.orchestra.run.smithi087.stdout: "max_osd_draining_count": { 2024-09-13T17:24:14.369 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_osd_draining_count", 2024-09-13T17:24:14.369 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.369 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.369 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.369 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-09-13T17:24:14.369 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.369 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.369 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.369 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-13T17:24:14.370 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.370 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.370 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.370 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.370 INFO:teuthology.orchestra.run.smithi087.stdout: "migration_current": { 2024-09-13T17:24:14.370 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "migration_current", 2024-09-13T17:24:14.370 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.370 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.370 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.370 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.370 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.370 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.370 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.370 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "internal - do not modify", 2024-09-13T17:24:14.370 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.371 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.371 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.371 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.371 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": { 2024-09-13T17:24:14.371 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mode", 2024-09-13T17:24:14.371 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.371 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.371 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.371 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "root", 2024-09-13T17:24:14.371 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.371 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.371 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.371 INFO:teuthology.orchestra.run.smithi087.stdout: "cephadm-package", 2024-09-13T17:24:14.371 INFO:teuthology.orchestra.run.smithi087.stdout: "root" 2024-09-13T17:24:14.372 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.372 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "mode for remote execution of cephadm", 2024-09-13T17:24:14.372 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.372 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.372 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.372 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.372 INFO:teuthology.orchestra.run.smithi087.stdout: "oob_default_addr": { 2024-09-13T17:24:14.372 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "oob_default_addr", 2024-09-13T17:24:14.372 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.372 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.372 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.372 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "169.254.1.1", 2024-09-13T17:24:14.372 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.372 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.373 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.373 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-13T17:24:14.373 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.373 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.373 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.373 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.373 INFO:teuthology.orchestra.run.smithi087.stdout: "prometheus_alerts_path": { 2024-09-13T17:24:14.373 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "prometheus_alerts_path", 2024-09-13T17:24:14.373 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.373 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.373 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.373 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-13T17:24:14.373 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.373 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.374 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.374 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-13T17:24:14.374 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.374 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.374 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.374 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.374 INFO:teuthology.orchestra.run.smithi087.stdout: "registry_insecure": { 2024-09-13T17:24:14.374 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "registry_insecure", 2024-09-13T17:24:14.374 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.374 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.374 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.374 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.374 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.374 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.375 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.375 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-13T17:24:14.375 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.375 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.375 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.375 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.375 INFO:teuthology.orchestra.run.smithi087.stdout: "registry_password": { 2024-09-13T17:24:14.375 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "registry_password", 2024-09-13T17:24:14.375 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.375 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.375 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.375 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.375 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.375 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.376 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.376 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-13T17:24:14.376 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.376 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.376 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.376 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.376 INFO:teuthology.orchestra.run.smithi087.stdout: "registry_url": { 2024-09-13T17:24:14.376 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "registry_url", 2024-09-13T17:24:14.376 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.376 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.376 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.376 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.376 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.377 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.377 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.377 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-13T17:24:14.377 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.377 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.377 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.377 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.377 INFO:teuthology.orchestra.run.smithi087.stdout: "registry_username": { 2024-09-13T17:24:14.377 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "registry_username", 2024-09-13T17:24:14.377 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.377 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.377 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.377 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.377 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.377 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.378 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.378 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-13T17:24:14.378 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.378 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.378 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.378 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.378 INFO:teuthology.orchestra.run.smithi087.stdout: "secure_monitoring_stack": { 2024-09-13T17:24:14.378 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "secure_monitoring_stack", 2024-09-13T17:24:14.378 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.378 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.378 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.378 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.378 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.378 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.379 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.379 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-13T17:24:14.379 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.379 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.379 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.379 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.379 INFO:teuthology.orchestra.run.smithi087.stdout: "service_discovery_port": { 2024-09-13T17:24:14.379 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "service_discovery_port", 2024-09-13T17:24:14.379 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.379 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.379 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.379 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8765", 2024-09-13T17:24:14.379 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.379 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.380 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.380 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "cephadm service discovery port", 2024-09-13T17:24:14.380 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.380 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.380 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.380 INFO:teuthology.orchestra.run.smithi087.stdout: "ssh_config_file": { 2024-09-13T17:24:14.380 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ssh_config_file", 2024-09-13T17:24:14.380 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.380 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.380 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.380 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.380 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.380 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.381 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.381 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-13T17:24:14.381 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.381 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.381 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.381 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.381 INFO:teuthology.orchestra.run.smithi087.stdout: "use_agent": { 2024-09-13T17:24:14.381 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "use_agent", 2024-09-13T17:24:14.381 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.381 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.381 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.381 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.381 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.382 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.382 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.382 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-13T17:24:14.382 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.382 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.382 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.382 INFO:teuthology.orchestra.run.smithi087.stdout: "use_repo_digest": { 2024-09-13T17:24:14.382 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "use_repo_digest", 2024-09-13T17:24:14.382 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.382 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.382 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.382 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.382 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.383 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.383 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.383 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-13T17:24:14.383 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.383 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.383 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.383 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.383 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_on_failed_host_check": { 2024-09-13T17:24:14.383 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_on_failed_host_check", 2024-09-13T17:24:14.383 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.383 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.383 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.383 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.383 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.384 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.384 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.384 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "raise a health warning if the host check fails", 2024-09-13T17:24:14.384 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.384 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.384 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.384 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.384 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_on_stray_daemons": { 2024-09-13T17:24:14.385 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_on_stray_daemons", 2024-09-13T17:24:14.385 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.385 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.385 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.385 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.385 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.385 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.385 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.385 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-13T17:24:14.385 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.385 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.385 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.385 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_on_stray_hosts": { 2024-09-13T17:24:14.386 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_on_stray_hosts", 2024-09-13T17:24:14.386 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.386 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.386 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.386 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.386 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.386 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.386 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.386 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-13T17:24:14.386 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.386 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.386 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.386 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.386 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.387 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.387 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.387 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crash", 2024-09-13T17:24:14.387 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.387 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.387 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.387 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.387 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.387 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.387 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.387 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.387 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.387 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.387 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.387 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.388 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.388 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.388 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.388 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.388 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.388 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.388 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.388 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.388 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.388 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.388 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.388 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.388 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.389 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.389 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.389 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.389 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.389 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.389 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.389 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.389 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.389 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.389 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.389 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.389 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.389 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.390 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.390 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.390 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.390 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.390 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.390 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.390 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.390 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.390 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.390 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.390 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.390 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.390 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.390 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.391 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.391 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.391 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.391 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.391 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.391 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.391 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.391 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.391 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.391 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.391 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.391 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.391 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.391 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.392 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.392 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.392 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.392 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.392 INFO:teuthology.orchestra.run.smithi087.stdout: "retain_interval": { 2024-09-13T17:24:14.392 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "retain_interval", 2024-09-13T17:24:14.392 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:14.392 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.392 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.392 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "31536000", 2024-09-13T17:24:14.392 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.393 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.393 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.393 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-13T17:24:14.393 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.393 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.393 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.393 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_recent_interval": { 2024-09-13T17:24:14.393 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_recent_interval", 2024-09-13T17:24:14.393 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:14.393 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.393 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.393 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "1209600", 2024-09-13T17:24:14.393 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.394 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.394 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.394 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-13T17:24:14.394 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.394 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.394 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.394 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.394 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.394 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.394 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.394 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "dashboard", 2024-09-13T17:24:14.394 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.394 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.394 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.394 INFO:teuthology.orchestra.run.smithi087.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-13T17:24:14.395 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-13T17:24:14.395 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.395 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.395 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.395 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-09-13T17:24:14.395 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.395 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.395 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.395 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.395 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.395 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.395 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.395 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.396 INFO:teuthology.orchestra.run.smithi087.stdout: "ALERTMANAGER_API_HOST": { 2024-09-13T17:24:14.396 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-13T17:24:14.396 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.396 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.396 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.396 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.396 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.396 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.396 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.396 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.396 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.396 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.396 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.397 INFO:teuthology.orchestra.run.smithi087.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-13T17:24:14.397 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-13T17:24:14.397 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.397 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.397 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.397 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.397 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.397 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.397 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.397 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.397 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.397 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.397 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.398 INFO:teuthology.orchestra.run.smithi087.stdout: "AUDIT_API_ENABLED": { 2024-09-13T17:24:14.398 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "AUDIT_API_ENABLED", 2024-09-13T17:24:14.398 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.398 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.398 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.398 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.398 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.398 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.398 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.398 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.398 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.398 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.398 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.399 INFO:teuthology.orchestra.run.smithi087.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-13T17:24:14.399 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-13T17:24:14.399 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.399 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.399 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.399 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.399 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.399 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.399 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.399 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.399 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.399 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.399 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.400 INFO:teuthology.orchestra.run.smithi087.stdout: "ENABLE_BROWSABLE_API": { 2024-09-13T17:24:14.400 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-13T17:24:14.400 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.400 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.400 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.400 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.400 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.400 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.400 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.400 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.400 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.400 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.400 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.401 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-13T17:24:14.401 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-13T17:24:14.401 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.401 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.401 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.401 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.401 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.401 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.401 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.401 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.401 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.401 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.401 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.402 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-13T17:24:14.402 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-13T17:24:14.402 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.402 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.402 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.402 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.402 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.402 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.402 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.402 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.402 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.402 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.402 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.403 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-13T17:24:14.403 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-13T17:24:14.403 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.403 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.403 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.403 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.403 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.403 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.403 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.403 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.403 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.403 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.403 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.404 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-13T17:24:14.404 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-13T17:24:14.404 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.404 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.404 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.404 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.404 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.404 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.404 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.404 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.404 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.404 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.404 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.405 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-13T17:24:14.405 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-13T17:24:14.405 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.405 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.405 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.405 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.405 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.405 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.405 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.405 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.405 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.405 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.405 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.406 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-13T17:24:14.406 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-13T17:24:14.406 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.406 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.406 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.406 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.406 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.406 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.406 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.406 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.406 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.406 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.406 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.407 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-13T17:24:14.407 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-13T17:24:14.407 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.407 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.407 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.407 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.407 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.407 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.407 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.407 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.407 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.407 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.407 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.408 INFO:teuthology.orchestra.run.smithi087.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-13T17:24:14.408 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-13T17:24:14.408 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.408 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.408 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.408 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.408 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.408 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.408 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.408 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.408 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.408 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.408 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.409 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_API_PASSWORD": { 2024-09-13T17:24:14.409 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-13T17:24:14.409 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.409 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.409 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.409 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "admin", 2024-09-13T17:24:14.409 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.409 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.409 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.409 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.409 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.409 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.409 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.410 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-13T17:24:14.410 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-13T17:24:14.410 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.410 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.410 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.410 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.410 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.410 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.410 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.410 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.410 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.410 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.410 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.411 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_API_URL": { 2024-09-13T17:24:14.411 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_API_URL", 2024-09-13T17:24:14.411 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.411 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.411 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.411 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.411 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.411 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.411 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.411 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.411 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.411 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.411 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.412 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_API_USERNAME": { 2024-09-13T17:24:14.412 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-13T17:24:14.412 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.412 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.412 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.412 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "admin", 2024-09-13T17:24:14.412 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.412 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.412 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.412 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.412 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.412 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.412 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.413 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-13T17:24:14.413 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-13T17:24:14.413 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.413 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.413 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.413 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.413 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.413 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.413 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.413 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.413 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.413 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.413 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.414 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-13T17:24:14.414 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-13T17:24:14.414 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.414 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.414 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.414 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.414 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.414 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.414 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.414 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.414 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.414 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.414 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.415 INFO:teuthology.orchestra.run.smithi087.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-13T17:24:14.415 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-13T17:24:14.415 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.415 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.415 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.415 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.415 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.415 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.415 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.415 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.415 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.415 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.415 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.416 INFO:teuthology.orchestra.run.smithi087.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-13T17:24:14.416 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-13T17:24:14.416 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.416 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.416 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.416 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.416 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.416 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.416 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.416 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.416 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.416 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.416 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.417 INFO:teuthology.orchestra.run.smithi087.stdout: "PROMETHEUS_API_HOST": { 2024-09-13T17:24:14.417 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-13T17:24:14.417 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.417 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.417 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.417 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.417 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.417 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.417 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.417 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.417 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.417 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.417 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.418 INFO:teuthology.orchestra.run.smithi087.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-13T17:24:14.418 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-13T17:24:14.418 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.418 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.418 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.418 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.418 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.418 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.418 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.418 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.418 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.418 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.418 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.419 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-13T17:24:14.419 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-13T17:24:14.419 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.419 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.419 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.419 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.419 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.419 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.419 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.419 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.419 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.419 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.419 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.420 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-13T17:24:14.420 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-13T17:24:14.420 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.420 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.420 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.420 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.420 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.420 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.420 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.420 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.420 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.420 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.420 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.421 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-13T17:24:14.421 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-13T17:24:14.421 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.421 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.421 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.421 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.421 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.421 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.421 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.421 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.421 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.421 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.421 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.422 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-13T17:24:14.422 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-13T17:24:14.422 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.422 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.422 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.422 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.422 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.422 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.422 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.422 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.422 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.422 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.422 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.423 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-13T17:24:14.423 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-13T17:24:14.423 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.423 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.423 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.423 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.423 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.423 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.423 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.423 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.423 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.423 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.423 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.424 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-13T17:24:14.424 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-13T17:24:14.424 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.424 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.424 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.424 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.424 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.424 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.424 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.424 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.424 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.424 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.424 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.425 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-13T17:24:14.425 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-13T17:24:14.425 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.425 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.425 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.425 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.425 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.425 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.425 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.425 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.425 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.425 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.426 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.426 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_ENABLED": { 2024-09-13T17:24:14.426 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-13T17:24:14.426 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.426 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.426 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.426 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.426 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.426 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.426 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.426 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.426 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.426 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.426 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.427 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-13T17:24:14.427 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-13T17:24:14.427 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.427 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.427 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.427 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-13T17:24:14.427 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.427 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.427 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.427 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.427 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.427 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.428 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.428 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-13T17:24:14.428 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-13T17:24:14.428 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.428 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.428 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.428 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-09-13T17:24:14.428 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.428 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.428 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.428 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.428 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.428 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.429 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.429 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-13T17:24:14.429 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-13T17:24:14.429 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.429 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.429 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.429 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8", 2024-09-13T17:24:14.429 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.429 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.429 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.429 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.429 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.429 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.430 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.430 INFO:teuthology.orchestra.run.smithi087.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-13T17:24:14.430 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-13T17:24:14.430 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.430 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.430 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.430 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "45", 2024-09-13T17:24:14.430 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.430 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.430 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.430 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.430 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.430 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.431 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.431 INFO:teuthology.orchestra.run.smithi087.stdout: "RGW_API_ACCESS_KEY": { 2024-09-13T17:24:14.431 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-13T17:24:14.431 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.431 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.431 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.431 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.431 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.431 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.431 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.431 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.431 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.431 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.432 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.432 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.432 INFO:teuthology.orchestra.run.smithi087.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-13T17:24:14.432 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-13T17:24:14.432 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.432 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.432 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.432 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "admin", 2024-09-13T17:24:14.432 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.432 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.432 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.432 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.432 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.433 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.433 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.433 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.433 INFO:teuthology.orchestra.run.smithi087.stdout: "RGW_API_SECRET_KEY": { 2024-09-13T17:24:14.433 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-13T17:24:14.433 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.433 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.433 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.433 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.433 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.433 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.434 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.434 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.434 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.434 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.434 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.434 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.434 INFO:teuthology.orchestra.run.smithi087.stdout: "RGW_API_SSL_VERIFY": { 2024-09-13T17:24:14.434 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-13T17:24:14.434 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.434 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.434 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.434 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.434 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.434 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.435 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.435 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.435 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.435 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.435 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.435 INFO:teuthology.orchestra.run.smithi087.stdout: "UNSAFE_TLS_v1_2": { 2024-09-13T17:24:14.435 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-13T17:24:14.435 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.435 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.435 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.435 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.435 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.436 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.436 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.436 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.436 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.436 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.436 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.436 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.436 INFO:teuthology.orchestra.run.smithi087.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-13T17:24:14.436 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-13T17:24:14.436 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.436 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.436 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.437 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-09-13T17:24:14.437 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.437 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.437 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.437 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.437 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.437 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.437 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.437 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.437 INFO:teuthology.orchestra.run.smithi087.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-13T17:24:14.437 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-13T17:24:14.437 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.437 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.437 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.438 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-09-13T17:24:14.438 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.438 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.438 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.438 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.438 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.438 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.438 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.438 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.438 INFO:teuthology.orchestra.run.smithi087.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-13T17:24:14.438 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-13T17:24:14.438 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.438 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.438 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.439 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5", 2024-09-13T17:24:14.439 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.439 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.439 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.439 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.439 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.439 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.439 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.439 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.439 INFO:teuthology.orchestra.run.smithi087.stdout: "cross_origin_url": { 2024-09-13T17:24:14.439 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cross_origin_url", 2024-09-13T17:24:14.439 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.439 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.439 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.440 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.440 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.440 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.440 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.440 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.440 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.440 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.440 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.440 INFO:teuthology.orchestra.run.smithi087.stdout: "crt_file": { 2024-09-13T17:24:14.440 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crt_file", 2024-09-13T17:24:14.440 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.440 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.441 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.441 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.441 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.441 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.441 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.441 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.441 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.441 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.441 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.441 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.441 INFO:teuthology.orchestra.run.smithi087.stdout: "debug": { 2024-09-13T17:24:14.441 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "debug", 2024-09-13T17:24:14.441 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.441 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.442 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.442 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.442 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.442 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.442 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.442 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Enable/disable debug options", 2024-09-13T17:24:14.442 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.442 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.442 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.442 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.442 INFO:teuthology.orchestra.run.smithi087.stdout: "jwt_token_ttl": { 2024-09-13T17:24:14.442 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "jwt_token_ttl", 2024-09-13T17:24:14.442 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.443 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.443 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.443 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "28800", 2024-09-13T17:24:14.443 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.443 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.443 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.443 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.443 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.443 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.443 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.443 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.443 INFO:teuthology.orchestra.run.smithi087.stdout: "key_file": { 2024-09-13T17:24:14.443 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "key_file", 2024-09-13T17:24:14.443 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.444 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.444 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.444 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.444 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.444 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.444 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.444 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.444 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.444 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.444 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.444 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.444 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.444 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.444 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.445 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.445 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.445 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.445 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.445 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.445 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.445 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.445 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.445 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.445 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.445 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.445 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.445 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.446 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.446 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.446 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.446 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.446 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.446 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.446 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.446 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.446 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.446 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.446 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.446 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.446 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.446 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.446 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.447 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.447 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.447 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.447 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.447 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.447 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.447 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.447 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.447 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.447 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.447 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.447 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.447 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.447 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.448 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.448 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.448 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.448 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.448 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.448 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.448 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.448 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.448 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.448 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.448 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.448 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.448 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.448 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.449 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.449 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.449 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.449 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.449 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.449 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.449 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.449 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.449 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.449 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.449 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.449 INFO:teuthology.orchestra.run.smithi087.stdout: "motd": { 2024-09-13T17:24:14.450 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "motd", 2024-09-13T17:24:14.450 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.450 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.450 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.450 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.450 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.450 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.450 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.450 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "The message of the day", 2024-09-13T17:24:14.450 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.451 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.451 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.451 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.451 INFO:teuthology.orchestra.run.smithi087.stdout: "redirect_resolve_ip_addr": { 2024-09-13T17:24:14.451 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "redirect_resolve_ip_addr", 2024-09-13T17:24:14.451 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.451 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.451 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.451 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.451 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.451 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.451 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.451 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.452 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.452 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.452 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.452 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.452 INFO:teuthology.orchestra.run.smithi087.stdout: "server_addr": { 2024-09-13T17:24:14.452 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_addr", 2024-09-13T17:24:14.452 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.452 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.452 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.452 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "::", 2024-09-13T17:24:14.453 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.453 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.453 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.453 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.453 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.453 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.453 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.453 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.453 INFO:teuthology.orchestra.run.smithi087.stdout: "server_port": { 2024-09-13T17:24:14.453 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_port", 2024-09-13T17:24:14.453 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.453 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.453 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.454 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8080", 2024-09-13T17:24:14.454 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.454 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.454 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.454 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.454 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.454 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.454 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.454 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.455 INFO:teuthology.orchestra.run.smithi087.stdout: "ssl": { 2024-09-13T17:24:14.455 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ssl", 2024-09-13T17:24:14.455 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.455 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.455 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.455 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.455 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.455 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.455 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.455 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.455 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.455 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.455 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.456 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.456 INFO:teuthology.orchestra.run.smithi087.stdout: "ssl_server_port": { 2024-09-13T17:24:14.456 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ssl_server_port", 2024-09-13T17:24:14.456 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.456 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.456 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.456 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8443", 2024-09-13T17:24:14.456 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.456 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.456 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.456 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.457 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.457 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.457 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.457 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.457 INFO:teuthology.orchestra.run.smithi087.stdout: "standby_behaviour": { 2024-09-13T17:24:14.457 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "standby_behaviour", 2024-09-13T17:24:14.457 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.457 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.457 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.458 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "redirect", 2024-09-13T17:24:14.458 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.458 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.458 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.458 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.458 INFO:teuthology.orchestra.run.smithi087.stdout: "redirect" 2024-09-13T17:24:14.458 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.458 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.458 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.458 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.458 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.458 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.459 INFO:teuthology.orchestra.run.smithi087.stdout: "standby_error_status_code": { 2024-09-13T17:24:14.459 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "standby_error_status_code", 2024-09-13T17:24:14.459 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.459 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.459 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.459 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "500", 2024-09-13T17:24:14.459 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "400", 2024-09-13T17:24:14.459 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "599", 2024-09-13T17:24:14.459 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.459 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.459 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.460 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.460 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.460 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.460 INFO:teuthology.orchestra.run.smithi087.stdout: "url_prefix": { 2024-09-13T17:24:14.460 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "url_prefix", 2024-09-13T17:24:14.460 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.460 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.460 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.460 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.460 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.460 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.461 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.461 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.464 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.465 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.465 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.465 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.465 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.465 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.465 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.465 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "devicehealth", 2024-09-13T17:24:14.465 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.465 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.465 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.465 INFO:teuthology.orchestra.run.smithi087.stdout: "enable_monitoring": { 2024-09-13T17:24:14.465 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "enable_monitoring", 2024-09-13T17:24:14.465 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.465 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.466 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.466 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.466 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.466 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.466 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.466 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "monitor device health metrics", 2024-09-13T17:24:14.466 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.466 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.466 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.466 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.466 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.467 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.467 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.467 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.467 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.467 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.467 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.467 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.467 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.467 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.467 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.467 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.467 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.467 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.468 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.468 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.468 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.468 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.468 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.468 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.468 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.468 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.468 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.468 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.468 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.469 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.469 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.469 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.469 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.469 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.469 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.469 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.469 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.469 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.469 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.470 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.470 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.470 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.470 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.470 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.470 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.470 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.470 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.470 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.470 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.470 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.470 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.470 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.471 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.471 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.471 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.471 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.471 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.471 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.471 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.471 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.471 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.471 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.471 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.471 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.472 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.472 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.472 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.472 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.472 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.472 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.472 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.472 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.472 INFO:teuthology.orchestra.run.smithi087.stdout: "mark_out_threshold": { 2024-09-13T17:24:14.472 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mark_out_threshold", 2024-09-13T17:24:14.472 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:14.472 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.472 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.473 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "2419200", 2024-09-13T17:24:14.473 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.473 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.473 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.473 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-13T17:24:14.473 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.473 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.473 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.473 INFO:teuthology.orchestra.run.smithi087.stdout: "pool_name": { 2024-09-13T17:24:14.473 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "pool_name", 2024-09-13T17:24:14.473 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.473 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.473 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.474 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "device_health_metrics", 2024-09-13T17:24:14.474 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.474 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.474 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.474 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-13T17:24:14.474 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.474 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.474 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.474 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.474 INFO:teuthology.orchestra.run.smithi087.stdout: "retention_period": { 2024-09-13T17:24:14.474 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "retention_period", 2024-09-13T17:24:14.474 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:14.474 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.474 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.475 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "15552000", 2024-09-13T17:24:14.475 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.475 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.475 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.475 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how long to retain device health metrics", 2024-09-13T17:24:14.475 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.475 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.475 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.475 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.475 INFO:teuthology.orchestra.run.smithi087.stdout: "scrape_frequency": { 2024-09-13T17:24:14.475 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "scrape_frequency", 2024-09-13T17:24:14.475 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:14.475 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.475 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.476 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "86400", 2024-09-13T17:24:14.476 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.476 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.476 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.476 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-13T17:24:14.476 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.476 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.476 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.476 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.476 INFO:teuthology.orchestra.run.smithi087.stdout: "self_heal": { 2024-09-13T17:24:14.476 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "self_heal", 2024-09-13T17:24:14.476 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.476 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.477 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.477 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.477 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.477 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.477 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.477 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-13T17:24:14.477 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.477 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.477 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.477 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.477 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-09-13T17:24:14.477 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-09-13T17:24:14.477 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:14.477 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.478 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.478 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-09-13T17:24:14.478 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.478 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.478 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.478 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to wake up and check device health", 2024-09-13T17:24:14.478 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.478 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.478 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.478 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_threshold": { 2024-09-13T17:24:14.478 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_threshold", 2024-09-13T17:24:14.478 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:14.478 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.479 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.479 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "7257600", 2024-09-13T17:24:14.479 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.479 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.479 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.479 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-13T17:24:14.479 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.479 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.479 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.479 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.479 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.479 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.479 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.479 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "diskprediction_local", 2024-09-13T17:24:14.480 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.480 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.480 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.480 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.480 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.480 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.480 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.480 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.480 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.480 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.480 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.480 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.480 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.481 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.481 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.481 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.481 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.481 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.481 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.481 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.481 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.481 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.481 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.481 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.481 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.481 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.481 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.482 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.482 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.482 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.482 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.482 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.482 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.482 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.482 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.482 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.482 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.482 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.482 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.482 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.482 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.483 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.483 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.483 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.483 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.483 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.483 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.483 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.483 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.483 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.483 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.483 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.483 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.483 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.484 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.484 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.484 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.484 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.484 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.484 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.484 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.484 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.484 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.485 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.485 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.485 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.485 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.485 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.485 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.485 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.485 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.485 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.485 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.485 INFO:teuthology.orchestra.run.smithi087.stdout: "predict_interval": { 2024-09-13T17:24:14.485 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "predict_interval", 2024-09-13T17:24:14.485 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.486 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.486 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.486 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "86400", 2024-09-13T17:24:14.486 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.486 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.486 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.486 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.486 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.486 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.487 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.487 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.487 INFO:teuthology.orchestra.run.smithi087.stdout: "predictor_model": { 2024-09-13T17:24:14.487 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "predictor_model", 2024-09-13T17:24:14.487 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.487 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.487 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.487 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "prophetstor", 2024-09-13T17:24:14.487 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.487 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.487 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.487 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.487 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.488 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.488 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.488 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.488 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-09-13T17:24:14.488 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-09-13T17:24:14.488 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.488 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.488 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.488 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-09-13T17:24:14.488 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.489 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.489 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.489 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.489 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.489 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.489 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.489 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.489 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.489 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.489 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.489 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "influx", 2024-09-13T17:24:14.489 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": false, 2024-09-13T17:24:14.490 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "influxdb python module not found", 2024-09-13T17:24:14.490 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.490 INFO:teuthology.orchestra.run.smithi087.stdout: "batch_size": { 2024-09-13T17:24:14.490 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "batch_size", 2024-09-13T17:24:14.490 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.490 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.490 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.490 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5000", 2024-09-13T17:24:14.490 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.490 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.491 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.491 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-13T17:24:14.491 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.491 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.491 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.491 INFO:teuthology.orchestra.run.smithi087.stdout: "database": { 2024-09-13T17:24:14.491 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "database", 2024-09-13T17:24:14.491 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.491 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.491 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.491 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "ceph", 2024-09-13T17:24:14.491 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.492 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.492 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.492 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-13T17:24:14.492 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.492 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.492 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.492 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.492 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": { 2024-09-13T17:24:14.492 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "hostname", 2024-09-13T17:24:14.492 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.493 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.493 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.493 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.493 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.493 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.493 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.493 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "InfluxDB server hostname", 2024-09-13T17:24:14.493 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.493 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.493 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.493 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.493 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-09-13T17:24:14.494 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-09-13T17:24:14.494 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:14.494 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.494 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.494 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "30", 2024-09-13T17:24:14.494 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "5", 2024-09-13T17:24:14.494 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.494 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.494 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-13T17:24:14.494 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.494 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.495 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.495 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.495 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.495 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.495 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.495 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.495 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.495 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.495 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.495 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.495 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.495 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.495 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.495 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.496 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.496 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.496 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.496 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.496 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.496 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.496 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.496 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.496 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.496 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.496 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.496 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.496 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.496 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.497 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.497 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.497 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.497 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.497 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.497 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.497 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.497 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.497 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.497 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.498 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.498 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.498 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.498 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.498 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.498 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.498 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.498 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.498 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.498 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.498 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.498 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.499 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.499 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.499 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.499 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.499 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.499 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.499 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.499 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.499 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.499 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.499 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.499 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.499 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.500 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.500 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.500 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.500 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.500 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.500 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.500 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.500 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.500 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.500 INFO:teuthology.orchestra.run.smithi087.stdout: "password": { 2024-09-13T17:24:14.501 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "password", 2024-09-13T17:24:14.501 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.501 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.501 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.501 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.501 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.501 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.501 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.501 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "password of InfluxDB server user", 2024-09-13T17:24:14.501 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.501 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.501 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.502 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.502 INFO:teuthology.orchestra.run.smithi087.stdout: "port": { 2024-09-13T17:24:14.502 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "port", 2024-09-13T17:24:14.502 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.502 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.502 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.502 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8086", 2024-09-13T17:24:14.502 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.502 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.502 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.502 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "InfluxDB server port", 2024-09-13T17:24:14.502 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.503 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.503 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.503 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.503 INFO:teuthology.orchestra.run.smithi087.stdout: "ssl": { 2024-09-13T17:24:14.503 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ssl", 2024-09-13T17:24:14.503 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.503 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.503 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.503 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "false", 2024-09-13T17:24:14.503 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.503 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.503 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.503 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T17:24:14.504 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.504 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.504 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.504 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.504 INFO:teuthology.orchestra.run.smithi087.stdout: "threads": { 2024-09-13T17:24:14.504 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "threads", 2024-09-13T17:24:14.504 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.504 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.504 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.504 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5", 2024-09-13T17:24:14.504 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1", 2024-09-13T17:24:14.505 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "32", 2024-09-13T17:24:14.505 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.505 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-13T17:24:14.505 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.505 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.505 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.505 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.505 INFO:teuthology.orchestra.run.smithi087.stdout: "username": { 2024-09-13T17:24:14.505 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "username", 2024-09-13T17:24:14.505 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.505 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.505 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.506 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.506 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.506 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.506 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.506 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "username of InfluxDB server user", 2024-09-13T17:24:14.506 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.506 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.506 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.506 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.506 INFO:teuthology.orchestra.run.smithi087.stdout: "verify_ssl": { 2024-09-13T17:24:14.506 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "verify_ssl", 2024-09-13T17:24:14.506 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.506 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.507 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.507 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "true", 2024-09-13T17:24:14.507 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.507 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.507 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.507 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T17:24:14.507 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.507 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.507 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.507 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.507 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.507 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.507 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.507 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "insights", 2024-09-13T17:24:14.508 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.508 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.508 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.508 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.508 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.508 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.508 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.508 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.508 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.508 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.508 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.508 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.508 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.509 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.509 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.509 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.509 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.509 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.509 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.509 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.509 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.509 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.509 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.509 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.509 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.509 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.509 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.510 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.510 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.510 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.510 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.510 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.510 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.510 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.510 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.510 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.510 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.510 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.510 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.510 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.510 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.510 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.511 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.511 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.511 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.511 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.511 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.511 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.511 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.511 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.511 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.511 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.511 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.511 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.511 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.511 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.512 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.512 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.512 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.512 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.512 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.512 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.512 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.512 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.512 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.512 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.512 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.512 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.512 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.512 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.513 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.513 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.513 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.513 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.513 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.513 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.513 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "iostat", 2024-09-13T17:24:14.513 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.513 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.513 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.513 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.513 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.513 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.513 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.514 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.514 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.514 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.514 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.514 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.514 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.514 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.514 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.514 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.514 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.514 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.514 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.514 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.514 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.514 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.515 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.515 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.515 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.515 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.515 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.515 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.515 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.515 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.515 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.515 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.515 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.515 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.515 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.516 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.516 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.516 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.516 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.516 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.516 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.516 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.516 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.516 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.516 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.516 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.516 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.516 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.516 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.517 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.517 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.517 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.517 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.517 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.517 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.517 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.517 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.517 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.517 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.517 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.517 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.517 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.517 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.518 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.518 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.518 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.518 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.518 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.518 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.518 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.518 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.518 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.518 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.518 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.518 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.518 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "k8sevents", 2024-09-13T17:24:14.518 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.519 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.519 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.519 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_event_retention_days": { 2024-09-13T17:24:14.519 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ceph_event_retention_days", 2024-09-13T17:24:14.519 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.519 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.519 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.519 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "7", 2024-09-13T17:24:14.519 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.519 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.519 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.519 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-13T17:24:14.519 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.519 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.520 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.520 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.520 INFO:teuthology.orchestra.run.smithi087.stdout: "config_check_secs": { 2024-09-13T17:24:14.520 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "config_check_secs", 2024-09-13T17:24:14.520 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.520 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.520 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.520 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-09-13T17:24:14.520 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "10", 2024-09-13T17:24:14.520 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.520 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.520 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-13T17:24:14.521 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.521 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.521 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.521 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.521 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.521 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.521 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.521 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.521 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.521 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.521 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.521 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.522 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.522 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.522 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.522 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.522 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.522 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.522 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.522 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.522 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.522 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.522 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.522 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.523 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.523 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.523 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.523 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.523 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.523 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.523 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.523 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.523 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.523 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.524 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.524 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.524 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.524 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.524 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.524 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.524 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.524 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.524 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.524 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.524 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.524 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.524 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.524 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.525 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.525 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.525 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.525 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.525 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.525 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.525 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.525 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.525 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.525 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.525 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.526 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.526 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.526 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.526 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.526 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.526 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.526 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.526 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.526 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.526 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.526 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.526 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.527 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.527 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.527 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.527 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.527 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.527 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.527 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "localpool", 2024-09-13T17:24:14.527 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.527 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.527 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.527 INFO:teuthology.orchestra.run.smithi087.stdout: "failure_domain": { 2024-09-13T17:24:14.528 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "failure_domain", 2024-09-13T17:24:14.528 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.528 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.528 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.528 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "host", 2024-09-13T17:24:14.528 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.528 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.528 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.528 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "failure domain for any created local pool", 2024-09-13T17:24:14.528 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-13T17:24:14.529 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.529 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.529 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.529 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.529 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.529 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.529 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.529 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.529 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.529 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.530 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.530 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.530 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.530 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.530 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.530 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.530 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.530 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.530 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.530 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.530 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.530 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.531 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.531 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.531 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.531 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.531 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.531 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.531 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.531 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.531 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.531 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.531 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.531 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.531 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.531 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.532 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.532 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.532 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.532 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.532 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.532 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.532 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.532 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.532 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.532 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.532 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.532 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.532 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.533 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.533 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.533 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.533 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.533 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.533 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.533 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.533 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.533 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.533 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.533 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.533 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.534 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.534 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.534 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.534 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.534 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.534 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.534 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.534 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.534 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.534 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.534 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.534 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.534 INFO:teuthology.orchestra.run.smithi087.stdout: "min_size": { 2024-09-13T17:24:14.535 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "min_size", 2024-09-13T17:24:14.535 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.535 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.535 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.535 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.535 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.535 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.535 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.535 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "default min_size for any created local pool", 2024-09-13T17:24:14.535 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-13T17:24:14.535 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.535 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.536 INFO:teuthology.orchestra.run.smithi087.stdout: "num_rep": { 2024-09-13T17:24:14.536 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "num_rep", 2024-09-13T17:24:14.536 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.536 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.536 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.536 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "3", 2024-09-13T17:24:14.536 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.536 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.536 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.536 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "default replica count for any created local pool", 2024-09-13T17:24:14.536 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.537 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.537 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.537 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.537 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_num": { 2024-09-13T17:24:14.537 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "pg_num", 2024-09-13T17:24:14.537 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.537 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.537 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.537 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "128", 2024-09-13T17:24:14.537 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.537 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.538 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.538 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "default pg_num for any created local pool", 2024-09-13T17:24:14.538 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.538 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.538 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.538 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.538 INFO:teuthology.orchestra.run.smithi087.stdout: "prefix": { 2024-09-13T17:24:14.538 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "prefix", 2024-09-13T17:24:14.538 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.538 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.538 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.538 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.538 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.538 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.539 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.539 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "name prefix for any created local pool", 2024-09-13T17:24:14.539 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.539 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.539 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.539 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.539 INFO:teuthology.orchestra.run.smithi087.stdout: "subtree": { 2024-09-13T17:24:14.539 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "subtree", 2024-09-13T17:24:14.539 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.539 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.539 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.539 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "rack", 2024-09-13T17:24:14.539 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.539 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.540 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.540 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-13T17:24:14.540 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-13T17:24:14.540 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.540 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.540 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.540 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.540 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.540 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.540 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mds_autoscaler", 2024-09-13T17:24:14.540 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.540 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.540 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.540 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.541 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.541 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.541 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.541 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.541 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.541 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.541 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.541 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.541 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.541 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.541 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.541 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.541 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.541 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.542 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.542 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.542 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.542 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.542 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.542 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.542 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.542 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.542 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.542 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.542 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.542 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.542 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.543 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.543 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.543 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.543 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.543 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.543 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.543 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.543 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.543 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.543 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.543 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.543 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.543 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.544 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.544 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.544 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.544 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.544 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.544 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.544 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.544 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.544 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.544 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.544 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.544 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.544 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.544 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.545 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.545 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.545 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.545 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.545 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.545 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.545 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.545 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.545 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.545 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.545 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.545 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.545 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.545 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.546 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.546 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.546 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mirroring", 2024-09-13T17:24:14.546 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.546 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.546 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.546 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.546 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.546 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.546 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.546 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.546 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.546 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.547 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.547 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.547 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.547 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.547 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.547 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.547 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.547 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.547 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.547 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.547 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.547 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.547 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.548 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.548 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.548 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.548 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.548 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.548 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.548 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.548 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.548 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.548 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.548 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.548 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.548 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.549 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.549 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.549 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.549 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.549 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.549 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.549 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.549 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.549 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.549 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.549 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.549 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.549 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.549 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.550 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.550 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.550 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.550 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.550 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.550 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.550 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.550 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.550 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.550 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.550 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.550 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.550 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.550 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.551 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.551 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.551 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.551 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.551 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.551 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.551 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.551 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "nfs", 2024-09-13T17:24:14.551 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.551 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.551 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.551 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.552 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.552 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.552 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.552 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.552 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.552 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.552 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.552 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.552 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.552 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.552 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.553 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.553 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.553 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.553 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.553 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.553 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.553 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.553 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.553 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.553 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.553 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.553 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.553 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.554 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.554 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.554 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.554 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.554 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.554 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.554 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.554 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.554 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.554 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.554 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.554 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.554 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.555 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.555 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.555 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.555 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.555 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.555 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.555 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.555 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.555 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.555 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.555 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.555 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.555 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.555 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.556 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.556 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.556 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.556 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.556 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.556 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.556 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.556 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.556 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.556 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.556 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.556 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.556 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.557 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.557 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.557 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.557 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.557 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.557 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "orchestrator", 2024-09-13T17:24:14.557 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.557 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.557 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.557 INFO:teuthology.orchestra.run.smithi087.stdout: "fail_fs": { 2024-09-13T17:24:14.557 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "fail_fs", 2024-09-13T17:24:14.557 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.557 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.558 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.558 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.558 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.558 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.558 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.558 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-13T17:24:14.558 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.558 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.558 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.558 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.558 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.558 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.558 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.558 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.559 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.559 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.559 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.559 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.559 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.559 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.559 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.559 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.559 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.559 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.559 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.559 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.559 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.559 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.560 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.560 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.560 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.560 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.560 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.560 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.560 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.560 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.560 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.560 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.560 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.560 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.560 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.561 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.561 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.561 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.561 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.561 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.561 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.561 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.561 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.561 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.561 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.561 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.561 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.561 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.561 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.562 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.562 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.562 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.562 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.562 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.562 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.562 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.562 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.562 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.562 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.562 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.562 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.562 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.562 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.563 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.563 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.563 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.563 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.563 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.563 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.563 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.563 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.563 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.563 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.563 INFO:teuthology.orchestra.run.smithi087.stdout: "orchestrator": { 2024-09-13T17:24:14.563 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "orchestrator", 2024-09-13T17:24:14.563 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.563 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.564 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.564 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.564 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.564 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.564 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.564 INFO:teuthology.orchestra.run.smithi087.stdout: "cephadm", 2024-09-13T17:24:14.564 INFO:teuthology.orchestra.run.smithi087.stdout: "rook", 2024-09-13T17:24:14.564 INFO:teuthology.orchestra.run.smithi087.stdout: "test_orchestrator" 2024-09-13T17:24:14.564 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.564 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Orchestrator backend", 2024-09-13T17:24:14.564 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.564 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.564 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.564 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.565 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.565 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.565 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.565 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "osd_perf_query", 2024-09-13T17:24:14.565 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.565 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.565 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.565 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.565 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.565 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.565 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.565 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.565 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.565 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.566 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.566 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.566 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.566 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.566 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.566 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.566 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.566 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.566 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.566 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.566 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.566 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.566 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.566 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.567 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.567 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.567 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.567 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.567 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.567 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.567 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.567 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.567 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.567 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.567 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.567 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.567 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.567 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.567 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.568 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.568 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.568 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.568 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.568 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.568 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.568 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.568 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.568 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.568 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.568 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.568 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.568 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.568 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.569 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.569 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.569 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.569 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.569 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.569 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.569 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.569 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.569 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.569 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.569 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.569 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.569 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.570 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.570 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.570 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.570 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.570 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.570 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.570 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.570 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.570 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "osd_support", 2024-09-13T17:24:14.570 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.570 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.570 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.570 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.570 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.571 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.571 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.571 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.571 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.571 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.571 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.571 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.571 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.571 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.571 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.571 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.571 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.571 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.571 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.572 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.572 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.572 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.572 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.572 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.572 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.572 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.572 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.572 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.572 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.572 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.572 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.573 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.573 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.573 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.573 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.573 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.573 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.573 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.573 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.573 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.573 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.573 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.573 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.573 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.574 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.574 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.574 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.574 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.574 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.574 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.574 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.574 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.574 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.574 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.574 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.574 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.574 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.574 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.575 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.575 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.575 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.575 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.575 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.575 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.575 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.575 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.575 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.575 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.575 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.575 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.575 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.575 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.576 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.576 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.576 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.576 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "pg_autoscaler", 2024-09-13T17:24:14.576 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.576 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.576 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.576 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.576 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.576 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.576 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.576 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.576 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.577 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.577 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.577 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.577 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.577 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.577 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.577 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.577 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.577 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.577 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.577 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.577 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.577 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.577 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.578 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.578 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.578 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.578 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.578 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.578 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.578 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.578 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.578 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.578 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.578 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.578 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.578 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.578 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.579 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.579 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.579 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.579 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.579 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.579 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.579 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.579 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.579 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.579 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.579 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.579 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.579 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.579 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.579 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.580 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.580 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.580 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.580 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.580 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.580 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.580 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.580 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.580 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.580 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.580 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.580 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.580 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.581 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.581 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.581 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.581 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.581 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.581 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.581 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.581 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.581 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-09-13T17:24:14.581 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-09-13T17:24:14.581 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:14.581 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.581 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.581 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-09-13T17:24:14.581 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.582 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.582 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.582 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.582 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.582 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.582 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.582 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.582 INFO:teuthology.orchestra.run.smithi087.stdout: "threshold": { 2024-09-13T17:24:14.582 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "threshold", 2024-09-13T17:24:14.582 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-09-13T17:24:14.582 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.582 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.582 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "3.0", 2024-09-13T17:24:14.582 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1.0", 2024-09-13T17:24:14.583 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.583 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.583 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "scaling threshold", 2024-09-13T17:24:14.583 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-13T17:24:14.583 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.583 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.583 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.583 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.583 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.583 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.583 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "progress", 2024-09-13T17:24:14.583 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.583 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.583 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.584 INFO:teuthology.orchestra.run.smithi087.stdout: "allow_pg_recovery_event": { 2024-09-13T17:24:14.584 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "allow_pg_recovery_event", 2024-09-13T17:24:14.584 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.584 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.584 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.584 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.584 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.584 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.584 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.584 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-13T17:24:14.584 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.584 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.584 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.585 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.585 INFO:teuthology.orchestra.run.smithi087.stdout: "enabled": { 2024-09-13T17:24:14.585 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "enabled", 2024-09-13T17:24:14.585 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.585 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.585 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.585 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.585 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.585 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.585 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.585 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.586 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.586 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.586 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.586 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.586 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.586 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.586 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.586 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.586 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.586 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.586 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.586 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.586 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.586 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.587 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.587 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.587 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.587 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.587 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.587 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.587 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.587 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.587 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.587 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.587 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.587 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.587 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.587 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.588 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.588 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.588 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.588 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.588 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.588 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.588 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.588 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.588 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.588 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.588 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.588 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.588 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.588 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.589 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.589 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.589 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.589 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.589 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.589 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.589 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.589 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.589 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.589 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.589 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.589 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.589 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.589 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.590 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.590 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.590 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.590 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.590 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.590 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.590 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.590 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.590 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.590 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.590 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.590 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.590 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.590 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.591 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.591 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.591 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.591 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.591 INFO:teuthology.orchestra.run.smithi087.stdout: "max_completed_events": { 2024-09-13T17:24:14.591 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_completed_events", 2024-09-13T17:24:14.591 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.591 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.591 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.591 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "50", 2024-09-13T17:24:14.591 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.591 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.591 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.591 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "number of past completed events to remember", 2024-09-13T17:24:14.592 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.592 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.592 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.592 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.592 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-09-13T17:24:14.592 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-09-13T17:24:14.592 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:14.592 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.592 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.592 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5", 2024-09-13T17:24:14.592 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.592 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.592 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.592 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how long the module is going to sleep", 2024-09-13T17:24:14.593 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.593 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.593 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.593 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.593 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.593 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.593 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.593 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "prometheus", 2024-09-13T17:24:14.593 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.593 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.593 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.593 INFO:teuthology.orchestra.run.smithi087.stdout: "cache": { 2024-09-13T17:24:14.593 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cache", 2024-09-13T17:24:14.593 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.594 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.594 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.594 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.594 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.594 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.594 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.594 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.594 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.594 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.594 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.594 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.594 INFO:teuthology.orchestra.run.smithi087.stdout: "exclude_perf_counters": { 2024-09-13T17:24:14.594 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "exclude_perf_counters", 2024-09-13T17:24:14.595 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.595 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.595 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.595 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.595 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.595 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.595 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.595 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-13T17:24:14.595 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-13T17:24:14.595 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.595 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.595 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.595 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.595 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.596 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.596 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.596 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.596 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.596 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.596 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.596 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.596 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.596 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.596 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.596 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.596 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.596 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.596 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.597 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.597 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.597 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.597 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.597 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.597 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.597 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.597 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.597 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.597 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.597 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.597 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.597 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.597 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.598 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.598 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.598 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.598 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.598 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.598 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.598 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.598 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.598 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.598 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.598 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.598 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.598 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.599 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.599 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.599 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.599 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.599 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.599 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.599 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.599 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.599 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.599 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.599 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.599 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.599 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.599 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.600 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.600 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.600 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.600 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.600 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.600 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.600 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.600 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.600 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.600 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.600 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.600 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.600 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_stats_pools": { 2024-09-13T17:24:14.600 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rbd_stats_pools", 2024-09-13T17:24:14.601 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.601 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.601 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.601 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.601 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.601 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.601 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.601 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.601 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.601 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.601 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.601 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.601 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-13T17:24:14.601 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-13T17:24:14.602 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.602 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.602 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.602 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "300", 2024-09-13T17:24:14.602 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.602 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.602 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.602 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.602 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.602 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.602 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.602 INFO:teuthology.orchestra.run.smithi087.stdout: "scrape_interval": { 2024-09-13T17:24:14.602 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "scrape_interval", 2024-09-13T17:24:14.603 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-09-13T17:24:14.603 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.603 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.603 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "15.0", 2024-09-13T17:24:14.603 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.603 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.603 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.603 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.603 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.603 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.603 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.603 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.603 INFO:teuthology.orchestra.run.smithi087.stdout: "server_addr": { 2024-09-13T17:24:14.603 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_addr", 2024-09-13T17:24:14.604 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.604 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.604 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.604 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "::", 2024-09-13T17:24:14.604 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.604 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.604 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.604 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-13T17:24:14.604 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.604 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.604 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.604 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.604 INFO:teuthology.orchestra.run.smithi087.stdout: "server_port": { 2024-09-13T17:24:14.604 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_port", 2024-09-13T17:24:14.605 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.605 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.605 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.605 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "9283", 2024-09-13T17:24:14.605 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.605 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.605 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.605 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-13T17:24:14.605 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.605 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.605 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.605 INFO:teuthology.orchestra.run.smithi087.stdout: "stale_cache_strategy": { 2024-09-13T17:24:14.606 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "stale_cache_strategy", 2024-09-13T17:24:14.606 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.606 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.606 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.606 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "log", 2024-09-13T17:24:14.606 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.606 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.606 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.606 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.606 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.606 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.606 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.606 INFO:teuthology.orchestra.run.smithi087.stdout: "standby_behaviour": { 2024-09-13T17:24:14.607 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "standby_behaviour", 2024-09-13T17:24:14.607 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.607 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.607 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.607 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "default", 2024-09-13T17:24:14.607 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.607 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.607 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.607 INFO:teuthology.orchestra.run.smithi087.stdout: "default", 2024-09-13T17:24:14.607 INFO:teuthology.orchestra.run.smithi087.stdout: "error" 2024-09-13T17:24:14.607 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.607 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.607 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.608 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.608 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.608 INFO:teuthology.orchestra.run.smithi087.stdout: "standby_error_status_code": { 2024-09-13T17:24:14.608 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "standby_error_status_code", 2024-09-13T17:24:14.608 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.608 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.608 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.608 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "500", 2024-09-13T17:24:14.608 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "400", 2024-09-13T17:24:14.608 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "599", 2024-09-13T17:24:14.608 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.608 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.608 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.609 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.609 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.609 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.609 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.609 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rbd_support", 2024-09-13T17:24:14.609 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.609 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.609 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.609 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.609 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.609 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.610 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.610 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.610 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.610 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.610 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.610 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.610 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.610 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.610 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.610 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.610 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.610 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.610 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.610 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.611 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.611 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.611 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.611 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.611 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.611 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.611 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.611 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.611 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.611 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.611 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.611 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.611 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.611 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.612 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.612 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.612 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.612 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.612 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.612 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.612 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.612 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.612 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.612 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.612 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.612 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.613 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.613 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.613 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.613 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.613 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.613 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.613 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.613 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.613 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.613 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.613 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.613 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.613 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.614 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.614 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.614 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.614 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.614 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.614 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.614 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.614 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.614 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.614 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.614 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.614 INFO:teuthology.orchestra.run.smithi087.stdout: "max_concurrent_snap_create": { 2024-09-13T17:24:14.614 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_concurrent_snap_create", 2024-09-13T17:24:14.615 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.615 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.615 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.615 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-09-13T17:24:14.615 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.615 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.615 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.615 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.615 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.615 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.615 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.615 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.615 INFO:teuthology.orchestra.run.smithi087.stdout: "mirror_snapshot_schedule": { 2024-09-13T17:24:14.615 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mirror_snapshot_schedule", 2024-09-13T17:24:14.616 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.616 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.616 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.616 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.616 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.616 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.616 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.616 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.616 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.616 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.616 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.616 INFO:teuthology.orchestra.run.smithi087.stdout: "trash_purge_schedule": { 2024-09-13T17:24:14.616 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "trash_purge_schedule", 2024-09-13T17:24:14.617 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.617 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.617 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.617 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.617 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.617 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.617 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.617 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.617 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.617 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.617 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.617 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.617 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.617 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.618 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.618 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "restful", 2024-09-13T17:24:14.618 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.618 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.618 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.618 INFO:teuthology.orchestra.run.smithi087.stdout: "enable_auth": { 2024-09-13T17:24:14.618 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "enable_auth", 2024-09-13T17:24:14.618 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.618 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.618 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.618 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.618 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.618 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.618 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.619 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.619 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.619 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.619 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.619 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.619 INFO:teuthology.orchestra.run.smithi087.stdout: "key_file": { 2024-09-13T17:24:14.619 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "key_file", 2024-09-13T17:24:14.619 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.619 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.619 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.619 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.619 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.619 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.619 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.620 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.620 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.620 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.620 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.620 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.620 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.620 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.620 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.620 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.620 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.620 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.620 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.620 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.620 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.620 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.621 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.621 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.621 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.621 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.621 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.621 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.621 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.621 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.621 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.621 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.621 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.621 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.621 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.621 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.622 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.622 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.622 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.622 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.622 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.622 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.622 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.622 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.622 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.622 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.622 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.622 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.622 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.622 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.623 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.623 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.623 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.623 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.623 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.623 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.623 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.623 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.623 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.623 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.623 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.623 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.623 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.623 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.624 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.624 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.624 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.624 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.624 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.624 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.624 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.624 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.624 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.624 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.624 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.624 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.624 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.625 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.625 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.625 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.625 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.625 INFO:teuthology.orchestra.run.smithi087.stdout: "server_addr": { 2024-09-13T17:24:14.625 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_addr", 2024-09-13T17:24:14.625 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.625 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.625 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.625 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.625 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.625 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.625 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.626 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.626 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.626 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.626 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.626 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.626 INFO:teuthology.orchestra.run.smithi087.stdout: "server_port": { 2024-09-13T17:24:14.626 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_port", 2024-09-13T17:24:14.626 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.626 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.626 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.626 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.626 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.626 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.626 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.626 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.627 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.627 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.627 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.627 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.627 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.627 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.627 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rgw", 2024-09-13T17:24:14.627 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.627 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.627 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.627 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.627 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.627 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.628 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.628 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.628 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.628 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.628 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.628 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.628 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.628 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.628 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.628 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.628 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.628 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.628 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.628 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.629 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.629 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.629 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.629 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.629 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.629 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.629 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.629 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.629 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.629 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.629 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.629 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.629 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.629 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.630 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.630 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.630 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.630 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.630 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.630 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.630 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.630 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.630 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.630 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.630 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.630 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.631 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.631 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.631 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.631 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.631 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.631 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.631 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.631 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.631 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.631 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.631 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.631 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.631 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.631 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.631 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.632 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.632 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.632 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.632 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.632 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.632 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.632 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.632 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.632 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.632 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.632 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.632 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.632 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.632 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.633 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rook", 2024-09-13T17:24:14.633 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.633 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.633 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.633 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.633 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.633 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.633 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.633 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.633 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.633 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.633 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.633 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.633 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.633 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.634 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.634 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.634 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.634 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.634 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.634 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.634 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.634 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.634 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.634 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.634 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.634 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.634 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.635 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.635 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.635 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.635 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.635 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.635 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.635 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.635 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.635 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.635 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.635 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.635 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.635 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.635 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.636 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.636 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.636 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.636 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.636 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.636 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.636 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.636 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.636 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.636 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.636 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.636 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.636 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.637 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.637 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.637 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.637 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.637 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.637 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.637 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.637 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.637 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.637 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.637 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.637 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.637 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.638 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.638 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.638 INFO:teuthology.orchestra.run.smithi087.stdout: "storage_class": { 2024-09-13T17:24:14.638 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "storage_class", 2024-09-13T17:24:14.638 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.638 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.638 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.638 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "local", 2024-09-13T17:24:14.638 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.638 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.638 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.638 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-13T17:24:14.638 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.638 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.639 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.639 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.639 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.639 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "selftest", 2024-09-13T17:24:14.639 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.639 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.639 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.639 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.639 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.639 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.639 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.639 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.640 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.640 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.640 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.640 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.640 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.640 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.640 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.640 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.640 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.640 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.640 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.640 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.640 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.640 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.641 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.641 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.641 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.641 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.641 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.641 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.641 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.641 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.641 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.641 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.641 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.641 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.641 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.642 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.642 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.642 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.642 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.642 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.642 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.642 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.642 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.642 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.642 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.642 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.642 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.642 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.643 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.643 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.643 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.643 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.643 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.643 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.643 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.643 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.643 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.643 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.643 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.643 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.644 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.644 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.644 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.644 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.644 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.644 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.644 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.644 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.644 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.644 INFO:teuthology.orchestra.run.smithi087.stdout: "roption1": { 2024-09-13T17:24:14.644 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "roption1", 2024-09-13T17:24:14.644 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.644 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.645 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.645 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.645 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.645 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.645 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.645 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.645 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.645 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.645 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.645 INFO:teuthology.orchestra.run.smithi087.stdout: "roption2": { 2024-09-13T17:24:14.645 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "roption2", 2024-09-13T17:24:14.645 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.646 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.646 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.646 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "xyz", 2024-09-13T17:24:14.646 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.646 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.646 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.646 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.646 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.646 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.646 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.646 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption1": { 2024-09-13T17:24:14.646 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption1", 2024-09-13T17:24:14.646 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.646 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.647 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.647 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.647 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.647 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.647 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.647 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.647 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.647 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.647 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.647 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption2": { 2024-09-13T17:24:14.647 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption2", 2024-09-13T17:24:14.647 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.648 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.648 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.648 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.648 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.648 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.648 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.648 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.648 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.648 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.648 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.648 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption3": { 2024-09-13T17:24:14.648 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption3", 2024-09-13T17:24:14.649 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-09-13T17:24:14.649 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.649 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.649 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.649 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.649 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.649 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.649 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.649 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.649 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.649 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.649 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption4": { 2024-09-13T17:24:14.649 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption4", 2024-09-13T17:24:14.650 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.650 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.650 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.650 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.650 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.650 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.650 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.650 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.650 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.650 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.650 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.650 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption5": { 2024-09-13T17:24:14.650 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption5", 2024-09-13T17:24:14.651 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.651 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.651 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.651 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.651 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.651 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.651 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.651 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.651 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.651 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.651 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.651 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.651 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption6": { 2024-09-13T17:24:14.651 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption6", 2024-09-13T17:24:14.652 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.652 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.652 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.652 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.652 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.652 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.652 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.652 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.652 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.652 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.652 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.652 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.652 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption7": { 2024-09-13T17:24:14.652 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption7", 2024-09-13T17:24:14.652 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.653 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.653 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.653 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.653 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1", 2024-09-13T17:24:14.653 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "42", 2024-09-13T17:24:14.653 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.653 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.653 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.653 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.653 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.653 INFO:teuthology.orchestra.run.smithi087.stdout: "testkey": { 2024-09-13T17:24:14.653 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "testkey", 2024-09-13T17:24:14.653 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.654 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.654 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.654 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.654 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.654 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.654 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.654 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.654 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.654 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.654 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.654 INFO:teuthology.orchestra.run.smithi087.stdout: "testlkey": { 2024-09-13T17:24:14.654 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "testlkey", 2024-09-13T17:24:14.654 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.655 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.655 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.655 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.655 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.655 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.655 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.655 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.655 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.655 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.655 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.655 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.655 INFO:teuthology.orchestra.run.smithi087.stdout: "testnewline": { 2024-09-13T17:24:14.655 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "testnewline", 2024-09-13T17:24:14.655 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.656 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.656 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.656 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.656 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.656 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.656 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.656 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.656 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.656 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.656 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.656 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.656 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.657 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "snap_schedule", 2024-09-13T17:24:14.657 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.657 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.657 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.657 INFO:teuthology.orchestra.run.smithi087.stdout: "allow_m_granularity": { 2024-09-13T17:24:14.657 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "allow_m_granularity", 2024-09-13T17:24:14.657 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.657 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.657 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.657 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.657 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.657 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.657 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.657 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "allow minute scheduled snapshots", 2024-09-13T17:24:14.658 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.658 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.658 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.658 INFO:teuthology.orchestra.run.smithi087.stdout: "dump_on_update": { 2024-09-13T17:24:14.658 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "dump_on_update", 2024-09-13T17:24:14.658 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.658 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.658 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.658 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.658 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.658 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.658 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.658 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "dump database to debug log on update", 2024-09-13T17:24:14.659 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.659 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.659 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.659 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.659 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.659 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.659 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.659 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.659 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.659 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.659 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.659 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.659 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.660 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.660 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.660 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.660 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.660 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.660 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.660 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.660 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.660 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.660 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.660 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.660 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.660 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.661 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.661 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.661 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.661 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.661 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.661 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.661 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.661 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.661 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.661 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.661 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.661 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.661 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.662 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.662 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.662 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.662 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.662 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.662 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.662 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.662 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.662 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.662 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.662 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.662 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.662 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.662 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.663 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.663 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.663 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.663 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.663 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.663 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.663 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.663 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.663 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.663 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.663 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.663 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.663 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.664 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.664 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.664 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.664 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.664 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.664 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.664 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.664 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "stats", 2024-09-13T17:24:14.664 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.664 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.664 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.664 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.664 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.664 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.665 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.665 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.665 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.665 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.665 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.665 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.665 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.665 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.665 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.665 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.665 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.665 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.665 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.665 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.666 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.666 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.666 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.666 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.666 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.666 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.666 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.666 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.666 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.666 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.666 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.666 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.666 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.666 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.667 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.667 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.667 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.667 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.667 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.667 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.667 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.667 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.667 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.667 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.667 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.667 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.667 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.667 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.668 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.668 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.668 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.668 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.668 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.668 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.668 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.668 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.668 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.668 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.668 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.668 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.668 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.669 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.669 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.669 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.669 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.669 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.669 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.669 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.669 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.669 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.669 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.669 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.669 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.669 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "status", 2024-09-13T17:24:14.670 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.670 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.670 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.670 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.670 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.670 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.670 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.670 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.670 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.670 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.670 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.670 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.670 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.670 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.671 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.671 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.671 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.671 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.671 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.671 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.671 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.671 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.671 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.671 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.671 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.671 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.671 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.672 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.672 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.672 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.672 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.672 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.672 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.672 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.672 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.672 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.672 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.672 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.672 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.672 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.673 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.673 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.673 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.673 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.673 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.673 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.673 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.673 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.673 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.673 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.673 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.673 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.673 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.673 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.674 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.674 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.674 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.674 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.674 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.674 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.674 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.674 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.674 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.674 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.674 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.674 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.674 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.675 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.675 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.675 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.675 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.675 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.675 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "telegraf", 2024-09-13T17:24:14.675 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.675 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.675 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.675 INFO:teuthology.orchestra.run.smithi087.stdout: "address": { 2024-09-13T17:24:14.676 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "address", 2024-09-13T17:24:14.676 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.676 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.676 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.676 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-13T17:24:14.676 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.676 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.676 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.676 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.676 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.676 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.676 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.676 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-09-13T17:24:14.677 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-09-13T17:24:14.677 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:14.677 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.677 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.677 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "15", 2024-09-13T17:24:14.677 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.677 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.677 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.677 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.677 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.677 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.677 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.677 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.678 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.678 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.678 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.678 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.678 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.678 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.678 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.678 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.678 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.678 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.678 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.678 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.678 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.678 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.679 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.679 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.679 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.679 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.679 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.679 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.679 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.679 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.679 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.679 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.679 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.679 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.680 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.680 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.680 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.680 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.680 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.680 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.680 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.680 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.680 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.680 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.680 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.680 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.680 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.681 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.681 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.681 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.681 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.681 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.681 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.681 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.681 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.681 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.681 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.681 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.681 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.681 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.682 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.682 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.682 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.682 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.682 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.682 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.682 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.682 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.682 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.682 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.682 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.682 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.682 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.683 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.683 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.683 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "telemetry", 2024-09-13T17:24:14.683 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.683 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.683 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.683 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_basic": { 2024-09-13T17:24:14.683 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_basic", 2024-09-13T17:24:14.683 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.683 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.683 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.683 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.684 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.684 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.684 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.684 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-13T17:24:14.684 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.684 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.684 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.684 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_crash": { 2024-09-13T17:24:14.684 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_crash", 2024-09-13T17:24:14.684 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.684 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.684 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.684 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.685 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.685 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.685 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.685 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-13T17:24:14.685 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.685 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.685 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.685 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_device": { 2024-09-13T17:24:14.685 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_device", 2024-09-13T17:24:14.685 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.685 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.685 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.686 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.686 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.686 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.686 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.686 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-13T17:24:14.686 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.686 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.686 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.686 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_ident": { 2024-09-13T17:24:14.686 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_ident", 2024-09-13T17:24:14.686 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.686 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.686 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.687 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.687 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.687 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.687 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.687 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-13T17:24:14.687 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.687 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.687 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.687 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_perf": { 2024-09-13T17:24:14.687 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_perf", 2024-09-13T17:24:14.687 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.687 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.687 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.688 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.688 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.688 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.688 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.688 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-13T17:24:14.688 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.688 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.688 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.688 INFO:teuthology.orchestra.run.smithi087.stdout: "contact": { 2024-09-13T17:24:14.688 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "contact", 2024-09-13T17:24:14.688 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.688 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.688 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.689 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.689 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.689 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.689 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.689 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.689 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.689 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.689 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.689 INFO:teuthology.orchestra.run.smithi087.stdout: "description": { 2024-09-13T17:24:14.689 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "description", 2024-09-13T17:24:14.689 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.689 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.689 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.690 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.690 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.690 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.690 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.690 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.690 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.690 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.690 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.690 INFO:teuthology.orchestra.run.smithi087.stdout: "device_url": { 2024-09-13T17:24:14.690 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "device_url", 2024-09-13T17:24:14.690 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.690 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.690 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.691 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-13T17:24:14.691 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.691 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.691 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.691 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.691 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.691 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.691 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.691 INFO:teuthology.orchestra.run.smithi087.stdout: "enabled": { 2024-09-13T17:24:14.691 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "enabled", 2024-09-13T17:24:14.691 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.691 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.691 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.691 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.692 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.692 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.692 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.692 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.692 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.692 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.692 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.692 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-09-13T17:24:14.692 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-09-13T17:24:14.692 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.692 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.692 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.693 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "24", 2024-09-13T17:24:14.693 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "8", 2024-09-13T17:24:14.693 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.693 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.693 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.693 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.693 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.693 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.693 INFO:teuthology.orchestra.run.smithi087.stdout: "last_opt_revision": { 2024-09-13T17:24:14.693 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "last_opt_revision", 2024-09-13T17:24:14.693 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.693 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.693 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.694 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "1", 2024-09-13T17:24:14.694 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.694 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.694 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.694 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.694 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.694 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.694 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.694 INFO:teuthology.orchestra.run.smithi087.stdout: "leaderboard": { 2024-09-13T17:24:14.694 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "leaderboard", 2024-09-13T17:24:14.694 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.694 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.694 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.695 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.695 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.695 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.695 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.695 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.695 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.695 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.695 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.695 INFO:teuthology.orchestra.run.smithi087.stdout: "leaderboard_description": { 2024-09-13T17:24:14.695 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "leaderboard_description", 2024-09-13T17:24:14.695 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.695 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.695 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.696 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.696 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.696 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.696 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.696 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.696 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.696 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.696 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.696 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.696 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.696 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.696 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.696 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.697 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.697 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.697 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.697 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.697 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.697 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.697 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.697 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.697 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.697 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.697 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.697 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.697 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.697 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.698 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.698 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.698 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.698 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.698 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.698 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.698 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.698 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.698 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.698 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.698 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.698 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.698 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.699 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.699 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.699 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.699 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.699 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.699 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.699 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.699 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.699 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.699 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.699 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.699 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.699 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.700 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.700 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.700 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.700 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.700 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.700 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.700 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.700 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.700 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.700 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.700 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.700 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.700 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.701 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.701 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.701 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.701 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.701 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.701 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.701 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.701 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.701 INFO:teuthology.orchestra.run.smithi087.stdout: "organization": { 2024-09-13T17:24:14.701 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "organization", 2024-09-13T17:24:14.701 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.701 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.701 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.702 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.702 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.702 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.702 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.702 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.702 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.702 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.702 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.702 INFO:teuthology.orchestra.run.smithi087.stdout: "proxy": { 2024-09-13T17:24:14.702 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "proxy", 2024-09-13T17:24:14.702 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.702 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.702 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.702 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.703 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.703 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.703 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.703 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.703 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.703 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.703 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.703 INFO:teuthology.orchestra.run.smithi087.stdout: "url": { 2024-09-13T17:24:14.703 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "url", 2024-09-13T17:24:14.703 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.703 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.703 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.703 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-13T17:24:14.704 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.704 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.704 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.704 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.704 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.704 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.704 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.704 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.704 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.704 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "test_orchestrator", 2024-09-13T17:24:14.704 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.704 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.705 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.705 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.705 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.705 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.705 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.705 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.705 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.705 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.705 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.705 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.705 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.705 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.705 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.705 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.706 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.706 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.706 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.706 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.706 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.706 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.706 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.706 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.706 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.706 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.706 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.706 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.706 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.706 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.707 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.707 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.707 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.707 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.707 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.707 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.707 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.707 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.707 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.707 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.707 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.707 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.707 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.708 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.708 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.708 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.708 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.708 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.708 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.708 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.708 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.708 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.708 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.708 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.708 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.708 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.709 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.709 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.709 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.709 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.709 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.709 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.709 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.709 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.709 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.709 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.709 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.709 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.709 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.710 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.710 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.710 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "volumes", 2024-09-13T17:24:14.710 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.710 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.710 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.710 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.710 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.710 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.710 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.710 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.710 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.710 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.711 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.711 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.711 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.711 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.711 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.711 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.711 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.711 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.711 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.711 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.711 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.711 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.711 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.712 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.712 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.712 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.712 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.712 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.712 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.712 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.712 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.712 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.712 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.712 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.712 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.712 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.713 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.713 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.713 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.713 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.713 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.713 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.713 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.713 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.713 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.713 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.713 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.713 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.713 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.714 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.714 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.714 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.714 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.714 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.714 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.714 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.714 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.714 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.714 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.714 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.714 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.714 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.714 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.715 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.715 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.715 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.715 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.715 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.715 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.715 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.715 INFO:teuthology.orchestra.run.smithi087.stdout: "max_concurrent_clones": { 2024-09-13T17:24:14.715 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_concurrent_clones", 2024-09-13T17:24:14.715 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.715 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.715 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.715 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "4", 2024-09-13T17:24:14.716 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.716 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.716 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.716 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-13T17:24:14.716 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.716 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.716 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.716 INFO:teuthology.orchestra.run.smithi087.stdout: "snapshot_clone_delay": { 2024-09-13T17:24:14.716 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "snapshot_clone_delay", 2024-09-13T17:24:14.716 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.716 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.716 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.716 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-09-13T17:24:14.717 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.717 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.717 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.717 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-13T17:24:14.717 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.717 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.717 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.717 INFO:teuthology.orchestra.run.smithi087.stdout: "snapshot_clone_no_wait": { 2024-09-13T17:24:14.717 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "snapshot_clone_no_wait", 2024-09-13T17:24:14.717 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.717 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.717 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.717 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-09-13T17:24:14.718 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.718 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.718 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.718 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-13T17:24:14.718 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.718 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.718 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.718 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.718 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.718 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "zabbix", 2024-09-13T17:24:14.718 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-09-13T17:24:14.718 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-09-13T17:24:14.718 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-09-13T17:24:14.719 INFO:teuthology.orchestra.run.smithi087.stdout: "discovery_interval": { 2024-09-13T17:24:14.719 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "discovery_interval", 2024-09-13T17:24:14.719 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-09-13T17:24:14.719 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.719 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.719 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "100", 2024-09-13T17:24:14.719 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.719 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.719 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.719 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.719 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.719 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.719 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.720 INFO:teuthology.orchestra.run.smithi087.stdout: "identifier": { 2024-09-13T17:24:14.720 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "identifier", 2024-09-13T17:24:14.720 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.720 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.720 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.720 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.720 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.720 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.720 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.720 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.720 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.720 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.720 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.721 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-09-13T17:24:14.721 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-09-13T17:24:14.721 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-09-13T17:24:14.721 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.721 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.721 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-09-13T17:24:14.721 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.721 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.721 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.721 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.721 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.721 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.721 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.722 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-09-13T17:24:14.722 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-09-13T17:24:14.722 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.722 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.722 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.722 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.722 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.722 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.722 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.722 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.722 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.722 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.722 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.722 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.722 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.723 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.723 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.723 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.723 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.723 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.723 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-09-13T17:24:14.723 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-09-13T17:24:14.723 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.723 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.723 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.723 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.723 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.723 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.724 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.724 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.724 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.724 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.724 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.724 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-09-13T17:24:14.724 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-09-13T17:24:14.724 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.724 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.724 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.724 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-09-13T17:24:14.724 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.724 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.724 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-09-13T17:24:14.725 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-09-13T17:24:14.725 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-09-13T17:24:14.725 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-09-13T17:24:14.725 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-09-13T17:24:14.725 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-09-13T17:24:14.725 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-09-13T17:24:14.725 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.725 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.725 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.725 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.725 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.725 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-09-13T17:24:14.726 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-09-13T17:24:14.726 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-09-13T17:24:14.726 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.726 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-09-13T17:24:14.726 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-09-13T17:24:14.726 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.726 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.726 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.726 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.726 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.726 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.726 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.726 INFO:teuthology.orchestra.run.smithi087.stdout: "zabbix_host": { 2024-09-13T17:24:14.727 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "zabbix_host", 2024-09-13T17:24:14.727 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.727 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.727 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.727 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-09-13T17:24:14.727 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.727 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.727 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.727 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.727 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.727 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.727 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.727 INFO:teuthology.orchestra.run.smithi087.stdout: "zabbix_port": { 2024-09-13T17:24:14.728 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "zabbix_port", 2024-09-13T17:24:14.728 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-09-13T17:24:14.728 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.728 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.728 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10051", 2024-09-13T17:24:14.728 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.728 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.728 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.728 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.728 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.728 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.728 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.728 INFO:teuthology.orchestra.run.smithi087.stdout: "zabbix_sender": { 2024-09-13T17:24:14.729 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "zabbix_sender", 2024-09-13T17:24:14.729 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-09-13T17:24:14.729 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-09-13T17:24:14.729 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-09-13T17:24:14.729 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-13T17:24:14.729 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-09-13T17:24:14.729 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-09-13T17:24:14.729 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-09-13T17:24:14.729 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-09-13T17:24:14.729 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-09-13T17:24:14.729 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-09-13T17:24:14.729 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-09-13T17:24:14.729 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.729 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.730 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.730 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.730 INFO:teuthology.orchestra.run.smithi087.stdout: "services": { 2024-09-13T17:24:14.730 INFO:teuthology.orchestra.run.smithi087.stdout: "dashboard": "https://172.21.15.87:8443/" 2024-09-13T17:24:14.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.730 INFO:teuthology.orchestra.run.smithi087.stdout: "always_on_modules": { 2024-09-13T17:24:14.730 INFO:teuthology.orchestra.run.smithi087.stdout: "octopus": [ 2024-09-13T17:24:14.730 INFO:teuthology.orchestra.run.smithi087.stdout: "balancer", 2024-09-13T17:24:14.730 INFO:teuthology.orchestra.run.smithi087.stdout: "crash", 2024-09-13T17:24:14.730 INFO:teuthology.orchestra.run.smithi087.stdout: "devicehealth", 2024-09-13T17:24:14.730 INFO:teuthology.orchestra.run.smithi087.stdout: "orchestrator", 2024-09-13T17:24:14.730 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_autoscaler", 2024-09-13T17:24:14.730 INFO:teuthology.orchestra.run.smithi087.stdout: "progress", 2024-09-13T17:24:14.730 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_support", 2024-09-13T17:24:14.730 INFO:teuthology.orchestra.run.smithi087.stdout: "status", 2024-09-13T17:24:14.731 INFO:teuthology.orchestra.run.smithi087.stdout: "telemetry", 2024-09-13T17:24:14.731 INFO:teuthology.orchestra.run.smithi087.stdout: "volumes" 2024-09-13T17:24:14.731 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.731 INFO:teuthology.orchestra.run.smithi087.stdout: "pacific": [ 2024-09-13T17:24:14.731 INFO:teuthology.orchestra.run.smithi087.stdout: "balancer", 2024-09-13T17:24:14.731 INFO:teuthology.orchestra.run.smithi087.stdout: "crash", 2024-09-13T17:24:14.731 INFO:teuthology.orchestra.run.smithi087.stdout: "devicehealth", 2024-09-13T17:24:14.731 INFO:teuthology.orchestra.run.smithi087.stdout: "orchestrator", 2024-09-13T17:24:14.731 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_autoscaler", 2024-09-13T17:24:14.731 INFO:teuthology.orchestra.run.smithi087.stdout: "progress", 2024-09-13T17:24:14.731 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_support", 2024-09-13T17:24:14.731 INFO:teuthology.orchestra.run.smithi087.stdout: "status", 2024-09-13T17:24:14.731 INFO:teuthology.orchestra.run.smithi087.stdout: "telemetry", 2024-09-13T17:24:14.731 INFO:teuthology.orchestra.run.smithi087.stdout: "volumes" 2024-09-13T17:24:14.732 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.732 INFO:teuthology.orchestra.run.smithi087.stdout: "quincy": [ 2024-09-13T17:24:14.732 INFO:teuthology.orchestra.run.smithi087.stdout: "balancer", 2024-09-13T17:24:14.732 INFO:teuthology.orchestra.run.smithi087.stdout: "crash", 2024-09-13T17:24:14.732 INFO:teuthology.orchestra.run.smithi087.stdout: "devicehealth", 2024-09-13T17:24:14.732 INFO:teuthology.orchestra.run.smithi087.stdout: "orchestrator", 2024-09-13T17:24:14.732 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_autoscaler", 2024-09-13T17:24:14.732 INFO:teuthology.orchestra.run.smithi087.stdout: "progress", 2024-09-13T17:24:14.732 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_support", 2024-09-13T17:24:14.732 INFO:teuthology.orchestra.run.smithi087.stdout: "status", 2024-09-13T17:24:14.732 INFO:teuthology.orchestra.run.smithi087.stdout: "telemetry", 2024-09-13T17:24:14.732 INFO:teuthology.orchestra.run.smithi087.stdout: "volumes" 2024-09-13T17:24:14.732 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-13T17:24:14.732 INFO:teuthology.orchestra.run.smithi087.stdout: "reef": [ 2024-09-13T17:24:14.733 INFO:teuthology.orchestra.run.smithi087.stdout: "balancer", 2024-09-13T17:24:14.733 INFO:teuthology.orchestra.run.smithi087.stdout: "crash", 2024-09-13T17:24:14.733 INFO:teuthology.orchestra.run.smithi087.stdout: "devicehealth", 2024-09-13T17:24:14.733 INFO:teuthology.orchestra.run.smithi087.stdout: "orchestrator", 2024-09-13T17:24:14.733 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_autoscaler", 2024-09-13T17:24:14.733 INFO:teuthology.orchestra.run.smithi087.stdout: "progress", 2024-09-13T17:24:14.733 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_support", 2024-09-13T17:24:14.733 INFO:teuthology.orchestra.run.smithi087.stdout: "status", 2024-09-13T17:24:14.733 INFO:teuthology.orchestra.run.smithi087.stdout: "telemetry", 2024-09-13T17:24:14.733 INFO:teuthology.orchestra.run.smithi087.stdout: "volumes" 2024-09-13T17:24:14.733 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-13T17:24:14.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.733 INFO:teuthology.orchestra.run.smithi087.stdout: "last_failure_osd_epoch": 94, 2024-09-13T17:24:14.733 INFO:teuthology.orchestra.run.smithi087.stdout: "active_clients": [ 2024-09-13T17:24:14.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.734 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "devicehealth", 2024-09-13T17:24:14.734 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-13T17:24:14.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.734 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-13T17:24:14.734 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:0", 2024-09-13T17:24:14.734 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1715238493 2024-09-13T17:24:14.734 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.734 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-13T17:24:14.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.734 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "libcephsqlite", 2024-09-13T17:24:14.734 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-13T17:24:14.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.734 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-13T17:24:14.735 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:0", 2024-09-13T17:24:14.735 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 4268639122 2024-09-13T17:24:14.735 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.735 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-13T17:24:14.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.735 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rbd_support", 2024-09-13T17:24:14.735 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-13T17:24:14.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.735 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-13T17:24:14.735 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:0", 2024-09-13T17:24:14.735 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 748740972 2024-09-13T17:24:14.735 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.735 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-13T17:24:14.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.736 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "snap_schedule", 2024-09-13T17:24:14.736 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-13T17:24:14.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.736 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-13T17:24:14.736 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:0", 2024-09-13T17:24:14.736 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1676463812 2024-09-13T17:24:14.736 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.736 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-13T17:24:14.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.736 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "snap_schedule", 2024-09-13T17:24:14.736 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-13T17:24:14.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.737 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-13T17:24:14.737 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:0", 2024-09-13T17:24:14.737 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1034996769 2024-09-13T17:24:14.737 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.737 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-13T17:24:14.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:14.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.737 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "volumes", 2024-09-13T17:24:14.737 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-09-13T17:24:14.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-09-13T17:24:14.737 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-09-13T17:24:14.737 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:0", 2024-09-13T17:24:14.737 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3448538359 2024-09-13T17:24:14.738 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.738 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-13T17:24:14.738 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:14.738 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-13T17:24:14.738 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:24:14.739 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:13 smithi118 ceph-mon[34374]: pgmap v323: 129 pgs: 1 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 124 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:24:14.739 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:13 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2879604091' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:24:14.739 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:13 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2376063801' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:24:14.740 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:13 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3693420394' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:24:14.740 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:13 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/732735568' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-13T17:24:14.740 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:13 smithi149 ceph-mon[35496]: pgmap v323: 129 pgs: 1 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 124 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:24:14.740 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:13 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2879604091' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:24:14.740 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:13 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2376063801' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:24:14.740 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:13 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3693420394' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:24:14.740 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:13 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/732735568' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-13T17:24:14.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.400+0000 7f4319d3e640 1 -- 172.21.15.87:0/732735568 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f43000a1200 msgr2=0x7f43000a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:14.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.400+0000 7f4319d3e640 1 --2- 172.21.15.87:0/732735568 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f43000a1200 0x7f43000a36c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f43040057c0 tx=0x7f4304005a20 comp rx=0 tx=0).stop 2024-09-13T17:24:14.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.400+0000 7f4319d3e640 1 -- 172.21.15.87:0/732735568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4314103fe0 msgr2=0x7f4314197680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:14.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.400+0000 7f4319d3e640 1 --2- 172.21.15.87:0/732735568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4314103fe0 0x7f4314197680 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f42fc00d770 tx=0x7f42fc00dc30 comp rx=0 tx=0).stop 2024-09-13T17:24:14.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.400+0000 7f4319d3e640 1 -- 172.21.15.87:0/732735568 shutdown_connections 2024-09-13T17:24:14.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.400+0000 7f4319d3e640 1 --2- 172.21.15.87:0/732735568 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4314197c10 0x7f43141a21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:14.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.400+0000 7f4319d3e640 1 --2- 172.21.15.87:0/732735568 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f43000a1200 0x7f43000a36c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:14.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.400+0000 7f4319d3e640 1 --2- 172.21.15.87:0/732735568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4314103fe0 0x7f4314197680 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:14.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.400+0000 7f4319d3e640 1 --2- 172.21.15.87:0/732735568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43140fee90 0x7f4314197140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:14.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.400+0000 7f4319d3e640 1 -- 172.21.15.87:0/732735568 >> 172.21.15.87:0/732735568 conn(0x7f43140fa900 msgr2=0x7f43140fbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:14.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.400+0000 7f4319d3e640 1 -- 172.21.15.87:0/732735568 shutdown_connections 2024-09-13T17:24:14.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:13.400+0000 7f4319d3e640 1 -- 172.21.15.87:0/732735568 wait complete. 2024-09-13T17:24:14.747 DEBUG:tasks.check_counter:Getting stats from a 2024-09-13T17:24:14.748 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-13T17:24:14.748 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:13 smithi087 ceph-mon[30934]: pgmap v323: 129 pgs: 1 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 124 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:24:14.748 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:13 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2879604091' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:24:14.748 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:13 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2376063801' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:24:14.749 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:13 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3693420394' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:24:14.749 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:13 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/732735568' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-13T17:24:14.955 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:24:15.729 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:15 smithi087 ceph-mon[30934]: pgmap v324: 129 pgs: 1 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 124 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:24:15.843 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:15 smithi149 ceph-mon[35496]: pgmap v324: 129 pgs: 1 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 124 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:24:16.128 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:15 smithi118 ceph-mon[34374]: pgmap v324: 129 pgs: 1 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 124 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:24:16.783 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:24:16.784 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T17:24:16.784 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 225, 2024-09-13T17:24:16.784 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 212, 2024-09-13T17:24:16.784 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 1561824, 2024-09-13T17:24:16.784 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 120208, 2024-09-13T17:24:16.784 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 4, 2024-09-13T17:24:16.784 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 0, 2024-09-13T17:24:16.784 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 0.042307358, 2024-09-13T17:24:16.784 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 0.014795198, 2024-09-13T17:24:16.784 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 0.039825171, 2024-09-13T17:24:16.785 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:24:16.785 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:16.785 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 212, 2024-09-13T17:24:16.785 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.015255789, 2024-09-13T17:24:16.785 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000071961 2024-09-13T17:24:16.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:16.785 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:16.785 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-13T17:24:16.785 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-13T17:24:16.785 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-13T17:24:16.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:16.785 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 1561824, 2024-09-13T17:24:16.786 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 120208 2024-09-13T17:24:16.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:16.786 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T17:24:16.786 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 2, 2024-09-13T17:24:16.786 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 161, 2024-09-13T17:24:16.786 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 320, 2024-09-13T17:24:16.786 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 180672, 2024-09-13T17:24:16.786 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 5, 2024-09-13T17:24:16.786 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 3, 2024-09-13T17:24:16.786 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 0.013043501, 2024-09-13T17:24:16.786 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 0.009102281, 2024-09-13T17:24:16.786 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 0.001849614, 2024-09-13T17:24:16.787 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:24:16.787 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:16.787 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 158, 2024-09-13T17:24:16.787 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.018239130, 2024-09-13T17:24:16.787 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000115437 2024-09-13T17:24:16.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:16.787 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:16.787 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-13T17:24:16.787 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-13T17:24:16.787 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-13T17:24:16.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:16.787 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-13T17:24:16.787 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 180672 2024-09-13T17:24:16.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:16.787 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T17:24:16.788 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 0, 2024-09-13T17:24:16.788 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 2, 2024-09-13T17:24:16.788 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 0, 2024-09-13T17:24:16.788 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 0, 2024-09-13T17:24:16.788 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 2, 2024-09-13T17:24:16.788 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 1, 2024-09-13T17:24:16.788 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 0.000159514, 2024-09-13T17:24:16.788 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 0.000000000, 2024-09-13T17:24:16.788 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 0.000100142, 2024-09-13T17:24:16.788 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:24:16.788 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:16.788 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-13T17:24:16.788 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-13T17:24:16.789 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-13T17:24:16.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:16.789 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:16.789 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-13T17:24:16.789 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-13T17:24:16.789 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-13T17:24:16.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:16.789 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T17:24:16.789 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T17:24:16.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:16.789 INFO:teuthology.orchestra.run.smithi087.stdout: "cct": { 2024-09-13T17:24:16.789 INFO:teuthology.orchestra.run.smithi087.stdout: "total_workers": 0, 2024-09-13T17:24:16.789 INFO:teuthology.orchestra.run.smithi087.stdout: "unhealthy_workers": 0 2024-09-13T17:24:16.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:16.790 INFO:teuthology.orchestra.run.smithi087.stdout: "mempool": { 2024-09-13T17:24:16.790 INFO:teuthology.orchestra.run.smithi087.stdout: "bloom_filter_bytes": 0, 2024-09-13T17:24:16.790 INFO:teuthology.orchestra.run.smithi087.stdout: "bloom_filter_items": 0, 2024-09-13T17:24:16.790 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T17:24:16.790 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_alloc_items": 0, 2024-09-13T17:24:16.790 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T17:24:16.790 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_data_items": 0, 2024-09-13T17:24:16.790 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T17:24:16.790 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T17:24:16.790 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T17:24:16.790 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T17:24:16.790 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T17:24:16.790 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_other_items": 0, 2024-09-13T17:24:16.790 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T17:24:16.791 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T17:24:16.791 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_extent_bytes": 0, 2024-09-13T17:24:16.791 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_extent_items": 0, 2024-09-13T17:24:16.791 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_blob_bytes": 0, 2024-09-13T17:24:16.791 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_blob_items": 0, 2024-09-13T17:24:16.791 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T17:24:16.791 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T17:24:16.791 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T17:24:16.791 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T17:24:16.791 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T17:24:16.791 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_items": 0, 2024-09-13T17:24:16.791 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_txc_bytes": 0, 2024-09-13T17:24:16.791 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_txc_items": 0, 2024-09-13T17:24:16.791 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T17:24:16.792 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T17:24:16.792 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_bytes": 0, 2024-09-13T17:24:16.792 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_items": 0, 2024-09-13T17:24:16.792 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_bytes": 0, 2024-09-13T17:24:16.792 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_items": 0, 2024-09-13T17:24:16.792 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T17:24:16.792 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_reader_items": 0, 2024-09-13T17:24:16.792 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T17:24:16.792 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_writer_items": 0, 2024-09-13T17:24:16.792 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_anon_bytes": 148955, 2024-09-13T17:24:16.792 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_anon_items": 30, 2024-09-13T17:24:16.792 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_meta_bytes": 0, 2024-09-13T17:24:16.792 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_meta_items": 0, 2024-09-13T17:24:16.792 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_bytes": 0, 2024-09-13T17:24:16.793 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_items": 0, 2024-09-13T17:24:16.793 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mapbl_bytes": 0, 2024-09-13T17:24:16.793 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mapbl_items": 0, 2024-09-13T17:24:16.793 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pglog_bytes": 0, 2024-09-13T17:24:16.793 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pglog_items": 0, 2024-09-13T17:24:16.793 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_bytes": 0, 2024-09-13T17:24:16.793 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_items": 0, 2024-09-13T17:24:16.793 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T17:24:16.793 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_mapping_items": 0, 2024-09-13T17:24:16.793 INFO:teuthology.orchestra.run.smithi087.stdout: "pgmap_bytes": 0, 2024-09-13T17:24:16.793 INFO:teuthology.orchestra.run.smithi087.stdout: "pgmap_items": 0, 2024-09-13T17:24:16.793 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_co_bytes": 928, 2024-09-13T17:24:16.793 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_co_items": 2, 2024-09-13T17:24:16.793 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_1_bytes": 0, 2024-09-13T17:24:16.794 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_1_items": 0, 2024-09-13T17:24:16.794 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_2_bytes": 0, 2024-09-13T17:24:16.794 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_2_items": 0 2024-09-13T17:24:16.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:16.794 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T17:24:16.794 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-09-13T17:24:16.794 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 104857600, 2024-09-13T17:24:16.794 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-09-13T17:24:16.794 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 223, 2024-09-13T17:24:16.795 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 1527652, 2024-09-13T17:24:16.795 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:16.795 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 223, 2024-09-13T17:24:16.795 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 0, 2024-09-13T17:24:16.795 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 0, 2024-09-13T17:24:16.795 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 223, 2024-09-13T17:24:16.795 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 1527652, 2024-09-13T17:24:16.795 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-09-13T17:24:16.795 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-13T17:24:16.795 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-13T17:24:16.795 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-13T17:24:16.795 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:16.795 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:16.795 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:24:17.442 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-13T17:24:17.442 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-13T17:24:17.442 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-09-13T17:24:17.442 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-09-13T17:24:17.442 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-09-13T17:24:17.442 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-09-13T17:24:17.442 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-09-13T17:24:17.442 DEBUG:tasks.check_counter:Getting stats from d 2024-09-13T17:24:17.443 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-13T17:24:17.643 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:24:17.711 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:17 smithi087 ceph-mon[30934]: pgmap v325: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:24:17.842 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:17 smithi149 ceph-mon[35496]: pgmap v325: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:24:17.863 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:17 smithi118 ceph-mon[34374]: pgmap v325: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:24:19.088 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:18 smithi087 ceph-mon[30934]: pgmap v326: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:24:19.088 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:18 smithi087 ceph-mon[30934]: osdmap e104: 12 total, 12 up, 12 in 2024-09-13T17:24:19.323 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:24:19.324 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T17:24:19.324 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 0, 2024-09-13T17:24:19.324 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 2, 2024-09-13T17:24:19.324 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 0, 2024-09-13T17:24:19.324 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 0, 2024-09-13T17:24:19.324 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 4, 2024-09-13T17:24:19.324 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 0, 2024-09-13T17:24:19.324 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 0.001108886, 2024-09-13T17:24:19.324 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 0.000000000, 2024-09-13T17:24:19.324 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 0.000230254, 2024-09-13T17:24:19.324 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:24:19.324 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:19.324 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-13T17:24:19.325 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-13T17:24:19.325 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-13T17:24:19.325 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:19.325 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:19.325 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-13T17:24:19.325 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-13T17:24:19.325 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-13T17:24:19.325 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:19.325 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T17:24:19.325 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T17:24:19.325 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:19.325 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T17:24:19.325 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 6, 2024-09-13T17:24:19.325 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 167, 2024-09-13T17:24:19.326 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 3280, 2024-09-13T17:24:19.326 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 181824, 2024-09-13T17:24:19.326 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 5, 2024-09-13T17:24:19.326 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 3, 2024-09-13T17:24:19.326 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 0.014753955, 2024-09-13T17:24:19.326 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 0.009227054, 2024-09-13T17:24:19.326 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 0.003577439, 2024-09-13T17:24:19.326 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:24:19.326 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:19.326 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 165, 2024-09-13T17:24:19.326 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.015502993, 2024-09-13T17:24:19.326 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000093957 2024-09-13T17:24:19.326 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:19.326 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:19.327 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-13T17:24:19.327 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-13T17:24:19.327 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-13T17:24:19.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:19.327 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 3280, 2024-09-13T17:24:19.327 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 181824 2024-09-13T17:24:19.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:19.327 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T17:24:19.327 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 226, 2024-09-13T17:24:19.327 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 215, 2024-09-13T17:24:19.327 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 1560224, 2024-09-13T17:24:19.327 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 122720, 2024-09-13T17:24:19.327 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 2, 2024-09-13T17:24:19.327 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 1, 2024-09-13T17:24:19.328 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 0.042482780, 2024-09-13T17:24:19.328 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 0.015154527, 2024-09-13T17:24:19.328 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 0.041406953, 2024-09-13T17:24:19.328 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:24:19.328 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:19.328 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 214, 2024-09-13T17:24:19.328 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.012219151, 2024-09-13T17:24:19.328 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000057098 2024-09-13T17:24:19.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:19.328 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:19.328 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-13T17:24:19.328 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-13T17:24:19.328 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-13T17:24:19.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:19.329 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 1560224, 2024-09-13T17:24:19.329 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 122720 2024-09-13T17:24:19.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:19.329 INFO:teuthology.orchestra.run.smithi087.stdout: "cct": { 2024-09-13T17:24:19.329 INFO:teuthology.orchestra.run.smithi087.stdout: "total_workers": 0, 2024-09-13T17:24:19.329 INFO:teuthology.orchestra.run.smithi087.stdout: "unhealthy_workers": 0 2024-09-13T17:24:19.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:19.329 INFO:teuthology.orchestra.run.smithi087.stdout: "mempool": { 2024-09-13T17:24:19.329 INFO:teuthology.orchestra.run.smithi087.stdout: "bloom_filter_bytes": 0, 2024-09-13T17:24:19.329 INFO:teuthology.orchestra.run.smithi087.stdout: "bloom_filter_items": 0, 2024-09-13T17:24:19.329 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T17:24:19.329 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_alloc_items": 0, 2024-09-13T17:24:19.329 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T17:24:19.329 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_data_items": 0, 2024-09-13T17:24:19.330 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T17:24:19.330 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T17:24:19.330 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T17:24:19.330 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T17:24:19.330 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T17:24:19.330 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_other_items": 0, 2024-09-13T17:24:19.330 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T17:24:19.330 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T17:24:19.330 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_extent_bytes": 0, 2024-09-13T17:24:19.330 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_extent_items": 0, 2024-09-13T17:24:19.330 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_blob_bytes": 0, 2024-09-13T17:24:19.330 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_blob_items": 0, 2024-09-13T17:24:19.330 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T17:24:19.330 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T17:24:19.331 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T17:24:19.331 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T17:24:19.331 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T17:24:19.331 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_items": 0, 2024-09-13T17:24:19.331 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_txc_bytes": 0, 2024-09-13T17:24:19.331 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_txc_items": 0, 2024-09-13T17:24:19.331 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T17:24:19.331 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T17:24:19.331 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_bytes": 0, 2024-09-13T17:24:19.331 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_items": 0, 2024-09-13T17:24:19.331 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_bytes": 0, 2024-09-13T17:24:19.331 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_items": 0, 2024-09-13T17:24:19.331 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T17:24:19.331 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_reader_items": 0, 2024-09-13T17:24:19.332 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T17:24:19.332 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_writer_items": 0, 2024-09-13T17:24:19.332 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_anon_bytes": 149034, 2024-09-13T17:24:19.332 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_anon_items": 32, 2024-09-13T17:24:19.332 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_meta_bytes": 0, 2024-09-13T17:24:19.332 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_meta_items": 0, 2024-09-13T17:24:19.332 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_bytes": 0, 2024-09-13T17:24:19.332 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_items": 0, 2024-09-13T17:24:19.332 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mapbl_bytes": 0, 2024-09-13T17:24:19.332 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mapbl_items": 0, 2024-09-13T17:24:19.332 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pglog_bytes": 0, 2024-09-13T17:24:19.332 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pglog_items": 0, 2024-09-13T17:24:19.332 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_bytes": 0, 2024-09-13T17:24:19.332 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_items": 0, 2024-09-13T17:24:19.333 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T17:24:19.333 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_mapping_items": 0, 2024-09-13T17:24:19.333 INFO:teuthology.orchestra.run.smithi087.stdout: "pgmap_bytes": 0, 2024-09-13T17:24:19.333 INFO:teuthology.orchestra.run.smithi087.stdout: "pgmap_items": 0, 2024-09-13T17:24:19.333 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_co_bytes": 928, 2024-09-13T17:24:19.333 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_co_items": 2, 2024-09-13T17:24:19.333 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_1_bytes": 0, 2024-09-13T17:24:19.333 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_1_items": 0, 2024-09-13T17:24:19.333 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_2_bytes": 0, 2024-09-13T17:24:19.333 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_2_items": 0 2024-09-13T17:24:19.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:19.333 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T17:24:19.333 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-09-13T17:24:19.333 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 104857600, 2024-09-13T17:24:19.334 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-09-13T17:24:19.334 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 228, 2024-09-13T17:24:19.334 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 1528302, 2024-09-13T17:24:19.334 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:19.334 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 228, 2024-09-13T17:24:19.334 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 0, 2024-09-13T17:24:19.334 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 0, 2024-09-13T17:24:19.334 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 228, 2024-09-13T17:24:19.334 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 1528302, 2024-09-13T17:24:19.334 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-09-13T17:24:19.335 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-13T17:24:19.335 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-13T17:24:19.335 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-13T17:24:19.335 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:19.335 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:19.335 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:24:19.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:18 smithi149 ceph-mon[35496]: pgmap v326: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:24:19.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:18 smithi149 ceph-mon[35496]: osdmap e104: 12 total, 12 up, 12 in 2024-09-13T17:24:19.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:18 smithi118 ceph-mon[34374]: pgmap v326: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-13T17:24:19.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:18 smithi118 ceph-mon[34374]: osdmap e104: 12 total, 12 up, 12 in 2024-09-13T17:24:20.017 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-13T17:24:20.017 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-13T17:24:20.017 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-13T17:24:20.017 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-13T17:24:20.017 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-13T17:24:20.017 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-13T17:24:20.017 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-13T17:24:20.017 DEBUG:tasks.check_counter:Getting stats from g 2024-09-13T17:24:20.017 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-13T17:24:20.225 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:24:21.228 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:20 smithi087 ceph-mon[30934]: pgmap v328: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 224 B/s wr, 8 op/s 2024-09-13T17:24:21.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:20 smithi149 ceph-mon[35496]: pgmap v328: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 224 B/s wr, 8 op/s 2024-09-13T17:24:21.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:20 smithi118 ceph-mon[34374]: pgmap v328: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 224 B/s wr, 8 op/s 2024-09-13T17:24:22.072 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:24:22.072 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T17:24:22.072 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 0, 2024-09-13T17:24:22.072 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 2, 2024-09-13T17:24:22.072 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 0, 2024-09-13T17:24:22.072 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 0, 2024-09-13T17:24:22.073 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 4, 2024-09-13T17:24:22.073 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 0, 2024-09-13T17:24:22.073 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 0.001064303, 2024-09-13T17:24:22.073 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 0.000000000, 2024-09-13T17:24:22.073 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 0.000168898, 2024-09-13T17:24:22.074 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:24:22.074 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:22.074 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-13T17:24:22.074 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-13T17:24:22.074 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-13T17:24:22.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:22.074 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:22.074 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-13T17:24:22.074 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-13T17:24:22.074 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-13T17:24:22.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:22.074 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T17:24:22.075 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T17:24:22.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:22.075 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T17:24:22.075 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 227, 2024-09-13T17:24:22.075 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 214, 2024-09-13T17:24:22.075 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 1562368, 2024-09-13T17:24:22.075 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 121392, 2024-09-13T17:24:22.075 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 2, 2024-09-13T17:24:22.075 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 1, 2024-09-13T17:24:22.075 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 0.048785801, 2024-09-13T17:24:22.075 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 0.015053304, 2024-09-13T17:24:22.075 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 0.042649464, 2024-09-13T17:24:22.075 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:24:22.075 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:22.076 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 214, 2024-09-13T17:24:22.076 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.019865422, 2024-09-13T17:24:22.076 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000092829 2024-09-13T17:24:22.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:22.076 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:22.076 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-13T17:24:22.076 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-13T17:24:22.076 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-13T17:24:22.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:22.076 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 1562368, 2024-09-13T17:24:22.076 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 121392 2024-09-13T17:24:22.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:22.076 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T17:24:22.076 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 2, 2024-09-13T17:24:22.077 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 163, 2024-09-13T17:24:22.077 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 320, 2024-09-13T17:24:22.077 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 181024, 2024-09-13T17:24:22.077 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 5, 2024-09-13T17:24:22.077 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 3, 2024-09-13T17:24:22.077 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 0.013759384, 2024-09-13T17:24:22.077 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 0.009832735, 2024-09-13T17:24:22.077 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 0.001765450, 2024-09-13T17:24:22.077 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:24:22.077 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:22.077 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 160, 2024-09-13T17:24:22.077 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.012451966, 2024-09-13T17:24:22.077 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000077824 2024-09-13T17:24:22.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:22.078 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:22.078 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-13T17:24:22.078 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-13T17:24:22.078 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-13T17:24:22.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:22.078 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-13T17:24:22.078 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 181024 2024-09-13T17:24:22.079 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:22.079 INFO:teuthology.orchestra.run.smithi087.stdout: "cct": { 2024-09-13T17:24:22.079 INFO:teuthology.orchestra.run.smithi087.stdout: "total_workers": 0, 2024-09-13T17:24:22.079 INFO:teuthology.orchestra.run.smithi087.stdout: "unhealthy_workers": 0 2024-09-13T17:24:22.079 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:22.079 INFO:teuthology.orchestra.run.smithi087.stdout: "mempool": { 2024-09-13T17:24:22.080 INFO:teuthology.orchestra.run.smithi087.stdout: "bloom_filter_bytes": 0, 2024-09-13T17:24:22.080 INFO:teuthology.orchestra.run.smithi087.stdout: "bloom_filter_items": 0, 2024-09-13T17:24:22.080 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T17:24:22.080 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_alloc_items": 0, 2024-09-13T17:24:22.080 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T17:24:22.080 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_data_items": 0, 2024-09-13T17:24:22.080 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T17:24:22.080 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T17:24:22.080 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T17:24:22.080 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T17:24:22.080 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T17:24:22.080 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_other_items": 0, 2024-09-13T17:24:22.080 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T17:24:22.081 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T17:24:22.081 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_extent_bytes": 0, 2024-09-13T17:24:22.081 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_extent_items": 0, 2024-09-13T17:24:22.081 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_blob_bytes": 0, 2024-09-13T17:24:22.081 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_blob_items": 0, 2024-09-13T17:24:22.081 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T17:24:22.081 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T17:24:22.081 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T17:24:22.081 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T17:24:22.081 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T17:24:22.081 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_items": 0, 2024-09-13T17:24:22.081 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_txc_bytes": 0, 2024-09-13T17:24:22.081 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_txc_items": 0, 2024-09-13T17:24:22.082 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T17:24:22.082 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T17:24:22.082 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_bytes": 0, 2024-09-13T17:24:22.082 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_items": 0, 2024-09-13T17:24:22.082 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_bytes": 0, 2024-09-13T17:24:22.082 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_items": 0, 2024-09-13T17:24:22.082 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T17:24:22.082 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_reader_items": 0, 2024-09-13T17:24:22.082 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T17:24:22.082 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_writer_items": 0, 2024-09-13T17:24:22.082 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_anon_bytes": 149034, 2024-09-13T17:24:22.083 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_anon_items": 32, 2024-09-13T17:24:22.083 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_meta_bytes": 0, 2024-09-13T17:24:22.083 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_meta_items": 0, 2024-09-13T17:24:22.083 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_bytes": 0, 2024-09-13T17:24:22.083 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_items": 0, 2024-09-13T17:24:22.083 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mapbl_bytes": 0, 2024-09-13T17:24:22.083 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mapbl_items": 0, 2024-09-13T17:24:22.083 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pglog_bytes": 0, 2024-09-13T17:24:22.083 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pglog_items": 0, 2024-09-13T17:24:22.083 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_bytes": 0, 2024-09-13T17:24:22.083 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_items": 0, 2024-09-13T17:24:22.083 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T17:24:22.083 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_mapping_items": 0, 2024-09-13T17:24:22.083 INFO:teuthology.orchestra.run.smithi087.stdout: "pgmap_bytes": 0, 2024-09-13T17:24:22.084 INFO:teuthology.orchestra.run.smithi087.stdout: "pgmap_items": 0, 2024-09-13T17:24:22.084 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_co_bytes": 928, 2024-09-13T17:24:22.084 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_co_items": 2, 2024-09-13T17:24:22.084 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_1_bytes": 0, 2024-09-13T17:24:22.084 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_1_items": 0, 2024-09-13T17:24:22.084 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_2_bytes": 0, 2024-09-13T17:24:22.084 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_2_items": 0 2024-09-13T17:24:22.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:22.084 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T17:24:22.084 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-09-13T17:24:22.084 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 104857600, 2024-09-13T17:24:22.085 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-09-13T17:24:22.085 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 225, 2024-09-13T17:24:22.085 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 1527912, 2024-09-13T17:24:22.085 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:22.085 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 225, 2024-09-13T17:24:22.085 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 0, 2024-09-13T17:24:22.085 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 0, 2024-09-13T17:24:22.085 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 225, 2024-09-13T17:24:22.085 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 1527912, 2024-09-13T17:24:22.085 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-09-13T17:24:22.085 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-13T17:24:22.085 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-13T17:24:22.085 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-13T17:24:22.085 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:22.085 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:22.086 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:24:22.723 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-13T17:24:22.723 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-13T17:24:22.724 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-09-13T17:24:22.724 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-09-13T17:24:22.724 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-13T17:24:22.724 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-13T17:24:22.724 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-13T17:24:22.724 DEBUG:tasks.check_counter:Getting stats from j 2024-09-13T17:24:22.724 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-13T17:24:22.921 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:24:23.204 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:22 smithi087 ceph-mon[30934]: pgmap v329: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-13T17:24:23.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:22 smithi149 ceph-mon[35496]: pgmap v329: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-13T17:24:23.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:22 smithi118 ceph-mon[34374]: pgmap v329: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-13T17:24:24.609 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T17:24:24.610 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T17:24:24.610 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 228, 2024-09-13T17:24:24.610 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 217, 2024-09-13T17:24:24.610 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 1560768, 2024-09-13T17:24:24.610 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 123904, 2024-09-13T17:24:24.610 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 4, 2024-09-13T17:24:24.610 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 0, 2024-09-13T17:24:24.610 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 0.041386143, 2024-09-13T17:24:24.610 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 0.015160294, 2024-09-13T17:24:24.610 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 0.037248493, 2024-09-13T17:24:24.610 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:24:24.610 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:24.611 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 216, 2024-09-13T17:24:24.611 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.011914530, 2024-09-13T17:24:24.611 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000055159 2024-09-13T17:24:24.611 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:24.611 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:24.611 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-13T17:24:24.611 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-13T17:24:24.611 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-13T17:24:24.611 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:24.611 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 1560768, 2024-09-13T17:24:24.611 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 123904 2024-09-13T17:24:24.611 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:24.611 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T17:24:24.611 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 6, 2024-09-13T17:24:24.612 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 168, 2024-09-13T17:24:24.612 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 3280, 2024-09-13T17:24:24.612 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 182000, 2024-09-13T17:24:24.612 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 5, 2024-09-13T17:24:24.612 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 3, 2024-09-13T17:24:24.612 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 0.015673520, 2024-09-13T17:24:24.612 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 0.009858711, 2024-09-13T17:24:24.612 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 0.003653084, 2024-09-13T17:24:24.612 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:24:24.612 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:24.612 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 166, 2024-09-13T17:24:24.612 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.017399601, 2024-09-13T17:24:24.613 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000104816 2024-09-13T17:24:24.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:24.613 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:24.613 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-13T17:24:24.613 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-13T17:24:24.613 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-13T17:24:24.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:24.613 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 3280, 2024-09-13T17:24:24.613 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 182000 2024-09-13T17:24:24.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:24.613 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T17:24:24.613 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 0, 2024-09-13T17:24:24.613 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 2, 2024-09-13T17:24:24.613 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 0, 2024-09-13T17:24:24.614 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 0, 2024-09-13T17:24:24.614 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 2, 2024-09-13T17:24:24.614 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 1, 2024-09-13T17:24:24.614 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 0.000350689, 2024-09-13T17:24:24.614 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 0.000000000, 2024-09-13T17:24:24.614 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 0.000269726, 2024-09-13T17:24:24.614 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:24:24.614 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:24.614 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-13T17:24:24.614 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-13T17:24:24.614 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-13T17:24:24.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:24.614 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:24.614 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-13T17:24:24.614 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-13T17:24:24.615 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-13T17:24:24.615 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:24.615 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T17:24:24.615 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T17:24:24.615 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:24.615 INFO:teuthology.orchestra.run.smithi087.stdout: "cct": { 2024-09-13T17:24:24.615 INFO:teuthology.orchestra.run.smithi087.stdout: "total_workers": 0, 2024-09-13T17:24:24.615 INFO:teuthology.orchestra.run.smithi087.stdout: "unhealthy_workers": 0 2024-09-13T17:24:24.615 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:24.615 INFO:teuthology.orchestra.run.smithi087.stdout: "mempool": { 2024-09-13T17:24:24.615 INFO:teuthology.orchestra.run.smithi087.stdout: "bloom_filter_bytes": 0, 2024-09-13T17:24:24.615 INFO:teuthology.orchestra.run.smithi087.stdout: "bloom_filter_items": 0, 2024-09-13T17:24:24.615 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T17:24:24.615 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_alloc_items": 0, 2024-09-13T17:24:24.616 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T17:24:24.616 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_data_items": 0, 2024-09-13T17:24:24.616 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T17:24:24.616 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T17:24:24.616 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T17:24:24.616 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T17:24:24.616 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T17:24:24.616 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_other_items": 0, 2024-09-13T17:24:24.616 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T17:24:24.616 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T17:24:24.616 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_extent_bytes": 0, 2024-09-13T17:24:24.616 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_extent_items": 0, 2024-09-13T17:24:24.616 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_blob_bytes": 0, 2024-09-13T17:24:24.616 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_blob_items": 0, 2024-09-13T17:24:24.617 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T17:24:24.617 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T17:24:24.617 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T17:24:24.617 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T17:24:24.617 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T17:24:24.617 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_items": 0, 2024-09-13T17:24:24.617 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_txc_bytes": 0, 2024-09-13T17:24:24.617 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_txc_items": 0, 2024-09-13T17:24:24.617 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T17:24:24.617 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T17:24:24.617 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_bytes": 0, 2024-09-13T17:24:24.617 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_items": 0, 2024-09-13T17:24:24.617 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_bytes": 0, 2024-09-13T17:24:24.617 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_items": 0, 2024-09-13T17:24:24.617 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T17:24:24.618 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_reader_items": 0, 2024-09-13T17:24:24.618 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T17:24:24.618 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_writer_items": 0, 2024-09-13T17:24:24.618 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_anon_bytes": 148977, 2024-09-13T17:24:24.618 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_anon_items": 30, 2024-09-13T17:24:24.618 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_meta_bytes": 0, 2024-09-13T17:24:24.618 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_meta_items": 0, 2024-09-13T17:24:24.618 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_bytes": 0, 2024-09-13T17:24:24.618 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_items": 0, 2024-09-13T17:24:24.618 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mapbl_bytes": 0, 2024-09-13T17:24:24.618 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mapbl_items": 0, 2024-09-13T17:24:24.618 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pglog_bytes": 0, 2024-09-13T17:24:24.618 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pglog_items": 0, 2024-09-13T17:24:24.618 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_bytes": 0, 2024-09-13T17:24:24.618 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_items": 0, 2024-09-13T17:24:24.619 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T17:24:24.619 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_mapping_items": 0, 2024-09-13T17:24:24.619 INFO:teuthology.orchestra.run.smithi087.stdout: "pgmap_bytes": 0, 2024-09-13T17:24:24.619 INFO:teuthology.orchestra.run.smithi087.stdout: "pgmap_items": 0, 2024-09-13T17:24:24.619 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_co_bytes": 928, 2024-09-13T17:24:24.619 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_co_items": 2, 2024-09-13T17:24:24.619 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_1_bytes": 0, 2024-09-13T17:24:24.619 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_1_items": 0, 2024-09-13T17:24:24.619 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_2_bytes": 0, 2024-09-13T17:24:24.619 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_2_items": 0 2024-09-13T17:24:24.619 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T17:24:24.619 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T17:24:24.619 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-09-13T17:24:24.619 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 104857600, 2024-09-13T17:24:24.620 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-09-13T17:24:24.620 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 230, 2024-09-13T17:24:24.620 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 1528562, 2024-09-13T17:24:24.620 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:24.620 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 230, 2024-09-13T17:24:24.620 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 0, 2024-09-13T17:24:24.620 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 0, 2024-09-13T17:24:24.620 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 230, 2024-09-13T17:24:24.620 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 1528562, 2024-09-13T17:24:24.620 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-09-13T17:24:24.620 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-09-13T17:24:24.620 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-09-13T17:24:24.620 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-09-13T17:24:24.620 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:24.620 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T17:24:24.621 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T17:24:25.228 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:24 smithi087 ceph-mon[30934]: pgmap v330: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-13T17:24:25.313 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-13T17:24:25.313 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-13T17:24:25.313 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-13T17:24:25.313 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-13T17:24:25.313 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-13T17:24:25.313 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-13T17:24:25.313 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-13T17:24:25.313 DEBUG:tasks.check_counter:Getting stats from b 2024-09-13T17:24:25.314 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-13T17:24:25.342 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:24 smithi118 ceph-mon[34374]: pgmap v330: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-13T17:24:25.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:24 smithi149 ceph-mon[35496]: pgmap v330: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-13T17:24:25.522 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T17:24:27.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:26 smithi087 ceph-mon[30934]: pgmap v331: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s 2024-09-13T17:24:27.277 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:26 smithi118 ceph-mon[34374]: pgmap v331: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s 2024-09-13T17:24:27.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:26 smithi149 ceph-mon[35496]: pgmap v331: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s 2024-09-13T17:24:27.519 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-13T17:24:27.519 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T17:24:27.519 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 1330, 2024-09-13T17:24:27.519 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 1306, 2024-09-13T17:24:27.519 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 22950495, 2024-09-13T17:24:27.519 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 458283, 2024-09-13T17:24:27.519 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 6, 2024-09-13T17:24:27.520 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 2, 2024-09-13T17:24:27.520 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 0.151764471, 2024-09-13T17:24:27.520 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 0.056494419, 2024-09-13T17:24:27.520 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 0.070856916, 2024-09-13T17:24:27.520 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.027318307, 2024-09-13T17:24:27.520 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:27.520 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 1305, 2024-09-13T17:24:27.520 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.058854230, 2024-09-13T17:24:27.520 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000045099 2024-09-13T17:24:27.520 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.520 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:27.521 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.521 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.521 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.521 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.521 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 1635728, 2024-09-13T17:24:27.521 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 124576 2024-09-13T17:24:27.521 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.521 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T17:24:27.521 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 594, 2024-09-13T17:24:27.521 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 755, 2024-09-13T17:24:27.521 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 16924960, 2024-09-13T17:24:27.521 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 623986, 2024-09-13T17:24:27.521 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 8, 2024-09-13T17:24:27.521 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 6, 2024-09-13T17:24:27.522 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 0.067980316, 2024-09-13T17:24:27.522 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 0.020780531, 2024-09-13T17:24:27.522 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 0.024392325, 2024-09-13T17:24:27.522 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.017210817, 2024-09-13T17:24:27.522 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:27.522 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 752, 2024-09-13T17:24:27.522 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.036236047, 2024-09-13T17:24:27.522 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000048186 2024-09-13T17:24:27.522 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.522 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:27.522 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.522 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.522 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.523 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.523 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-13T17:24:27.523 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 439808 2024-09-13T17:24:27.523 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.523 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T17:24:27.523 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 799, 2024-09-13T17:24:27.523 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 799, 2024-09-13T17:24:27.523 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 19674165, 2024-09-13T17:24:27.523 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 247700, 2024-09-13T17:24:27.523 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 5, 2024-09-13T17:24:27.523 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 4, 2024-09-13T17:24:27.523 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 0.075543575, 2024-09-13T17:24:27.523 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 0.018511284, 2024-09-13T17:24:27.523 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 0.030709197, 2024-09-13T17:24:27.524 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.020698740, 2024-09-13T17:24:27.524 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:27.524 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 798, 2024-09-13T17:24:27.524 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.027691044, 2024-09-13T17:24:27.524 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000034700 2024-09-13T17:24:27.524 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.524 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:27.524 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.524 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.524 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.524 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.524 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 2960, 2024-09-13T17:24:27.524 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 448 2024-09-13T17:24:27.525 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.525 INFO:teuthology.orchestra.run.smithi118.stdout: "cct": { 2024-09-13T17:24:27.525 INFO:teuthology.orchestra.run.smithi118.stdout: "total_workers": 1, 2024-09-13T17:24:27.525 INFO:teuthology.orchestra.run.smithi118.stdout: "unhealthy_workers": 0 2024-09-13T17:24:27.525 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.525 INFO:teuthology.orchestra.run.smithi118.stdout: "finisher-MDSRank": { 2024-09-13T17:24:27.525 INFO:teuthology.orchestra.run.smithi118.stdout: "queue_len": 0, 2024-09-13T17:24:27.525 INFO:teuthology.orchestra.run.smithi118.stdout: "complete_latency": { 2024-09-13T17:24:27.525 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 4107, 2024-09-13T17:24:27.525 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.176729184, 2024-09-13T17:24:27.525 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000043031 2024-09-13T17:24:27.525 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-13T17:24:27.525 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.526 INFO:teuthology.orchestra.run.smithi118.stdout: "finisher-PurgeQueue": { 2024-09-13T17:24:27.526 INFO:teuthology.orchestra.run.smithi118.stdout: "queue_len": 0, 2024-09-13T17:24:27.526 INFO:teuthology.orchestra.run.smithi118.stdout: "complete_latency": { 2024-09-13T17:24:27.526 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.526 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.526 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.526 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-13T17:24:27.526 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.526 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-13T17:24:27.526 INFO:teuthology.orchestra.run.smithi118.stdout: "request": 0, 2024-09-13T17:24:27.526 INFO:teuthology.orchestra.run.smithi118.stdout: "reply": 0, 2024-09-13T17:24:27.526 INFO:teuthology.orchestra.run.smithi118.stdout: "reply_latency": { 2024-09-13T17:24:27.526 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.527 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.527 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.527 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.527 INFO:teuthology.orchestra.run.smithi118.stdout: "slow_reply": 0, 2024-09-13T17:24:27.527 INFO:teuthology.orchestra.run.smithi118.stdout: "forward": 0, 2024-09-13T17:24:27.527 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_fetch_complete": 0, 2024-09-13T17:24:27.527 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_fetch_keys": 0, 2024-09-13T17:24:27.527 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_commit": 0, 2024-09-13T17:24:27.527 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_split": 0, 2024-09-13T17:24:27.527 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_merge": 0, 2024-09-13T17:24:27.527 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes": 8230, 2024-09-13T17:24:27.527 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_top": 5231, 2024-09-13T17:24:27.528 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_bottom": 2999, 2024-09-13T17:24:27.528 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_pin_tail": 0, 2024-09-13T17:24:27.528 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_pinned": 758, 2024-09-13T17:24:27.528 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_expired": 0, 2024-09-13T17:24:27.528 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_with_caps": 0, 2024-09-13T17:24:27.528 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": 0, 2024-09-13T17:24:27.528 INFO:teuthology.orchestra.run.smithi118.stdout: "subtrees": 2, 2024-09-13T17:24:27.528 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse": 0, 2024-09-13T17:24:27.528 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_hit": 0, 2024-09-13T17:24:27.528 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_forward": 0, 2024-09-13T17:24:27.528 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_discover": 0, 2024-09-13T17:24:27.528 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_dir_fetch": 0, 2024-09-13T17:24:27.528 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_remote_ino": 0, 2024-09-13T17:24:27.528 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_lock": 0, 2024-09-13T17:24:27.528 INFO:teuthology.orchestra.run.smithi118.stdout: "load_cent": 0, 2024-09-13T17:24:27.529 INFO:teuthology.orchestra.run.smithi118.stdout: "q": 0, 2024-09-13T17:24:27.529 INFO:teuthology.orchestra.run.smithi118.stdout: "exported": 0, 2024-09-13T17:24:27.529 INFO:teuthology.orchestra.run.smithi118.stdout: "exported_inodes": 0, 2024-09-13T17:24:27.529 INFO:teuthology.orchestra.run.smithi118.stdout: "imported": 0, 2024-09-13T17:24:27.529 INFO:teuthology.orchestra.run.smithi118.stdout: "imported_inodes": 0, 2024-09-13T17:24:27.529 INFO:teuthology.orchestra.run.smithi118.stdout: "openino_dir_fetch": 0, 2024-09-13T17:24:27.529 INFO:teuthology.orchestra.run.smithi118.stdout: "openino_backtrace_fetch": 0, 2024-09-13T17:24:27.529 INFO:teuthology.orchestra.run.smithi118.stdout: "openino_peer_discover": 0, 2024-09-13T17:24:27.529 INFO:teuthology.orchestra.run.smithi118.stdout: "root_rfiles": 4, 2024-09-13T17:24:27.529 INFO:teuthology.orchestra.run.smithi118.stdout: "root_rbytes": 234, 2024-09-13T17:24:27.529 INFO:teuthology.orchestra.run.smithi118.stdout: "root_rsnaps": 6, 2024-09-13T17:24:27.529 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T17:24:27.529 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_set_tag": 0, 2024-09-13T17:24:27.530 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T17:24:27.530 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_inotable_repaired": 0, 2024-09-13T17:24:27.530 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_dir_inodes": 0, 2024-09-13T17:24:27.530 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T17:24:27.530 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T17:24:27.530 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_file_inodes": 0, 2024-09-13T17:24:27.530 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_inode_file_caps": 0, 2024-09-13T17:24:27.530 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_revoke": 0, 2024-09-13T17:24:27.530 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_grant": 0, 2024-09-13T17:24:27.530 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T17:24:27.530 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T17:24:27.530 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T17:24:27.530 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_caps": 0, 2024-09-13T17:24:27.531 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_caps_dirty": 0, 2024-09-13T17:24:27.531 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_cap_release": 0, 2024-09-13T17:24:27.531 INFO:teuthology.orchestra.run.smithi118.stdout: "process_request_cap_release": 0 2024-09-13T17:24:27.531 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.531 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_cache": { 2024-09-13T17:24:27.531 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_update": 0, 2024-09-13T17:24:27.531 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_update_receipt": 0, 2024-09-13T17:24:27.531 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_try_discover": 0, 2024-09-13T17:24:27.531 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_send_discover": 0, 2024-09-13T17:24:27.531 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_handle_discover": 0, 2024-09-13T17:24:27.531 INFO:teuthology.orchestra.run.smithi118.stdout: "num_strays": 0, 2024-09-13T17:24:27.531 INFO:teuthology.orchestra.run.smithi118.stdout: "num_strays_delayed": 0, 2024-09-13T17:24:27.531 INFO:teuthology.orchestra.run.smithi118.stdout: "num_strays_enqueuing": 0, 2024-09-13T17:24:27.532 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_created": 0, 2024-09-13T17:24:27.532 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_enqueued": 0, 2024-09-13T17:24:27.532 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_reintegrated": 0, 2024-09-13T17:24:27.532 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_migrated": 0, 2024-09-13T17:24:27.532 INFO:teuthology.orchestra.run.smithi118.stdout: "num_recovering_processing": 0, 2024-09-13T17:24:27.532 INFO:teuthology.orchestra.run.smithi118.stdout: "num_recovering_enqueued": 0, 2024-09-13T17:24:27.532 INFO:teuthology.orchestra.run.smithi118.stdout: "num_recovering_prioritized": 0, 2024-09-13T17:24:27.532 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_started": 0, 2024-09-13T17:24:27.532 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_completed": 0, 2024-09-13T17:24:27.532 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T17:24:27.532 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_exportdir": 0, 2024-09-13T17:24:27.532 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_flush": 0, 2024-09-13T17:24:27.532 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_fragmentdir": 0, 2024-09-13T17:24:27.532 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_fragstats": 0, 2024-09-13T17:24:27.533 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_inodestats": 0 2024-09-13T17:24:27.533 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.533 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_log": { 2024-09-13T17:24:27.533 INFO:teuthology.orchestra.run.smithi118.stdout: "evadd": 0, 2024-09-13T17:24:27.533 INFO:teuthology.orchestra.run.smithi118.stdout: "evex": 0, 2024-09-13T17:24:27.533 INFO:teuthology.orchestra.run.smithi118.stdout: "evtrm": 0, 2024-09-13T17:24:27.533 INFO:teuthology.orchestra.run.smithi118.stdout: "ev": 26202, 2024-09-13T17:24:27.533 INFO:teuthology.orchestra.run.smithi118.stdout: "evexg": 0, 2024-09-13T17:24:27.533 INFO:teuthology.orchestra.run.smithi118.stdout: "evexd": 0, 2024-09-13T17:24:27.533 INFO:teuthology.orchestra.run.smithi118.stdout: "segadd": 0, 2024-09-13T17:24:27.533 INFO:teuthology.orchestra.run.smithi118.stdout: "segex": 0, 2024-09-13T17:24:27.533 INFO:teuthology.orchestra.run.smithi118.stdout: "segtrm": 0, 2024-09-13T17:24:27.533 INFO:teuthology.orchestra.run.smithi118.stdout: "seg": 2, 2024-09-13T17:24:27.534 INFO:teuthology.orchestra.run.smithi118.stdout: "segexg": 0, 2024-09-13T17:24:27.534 INFO:teuthology.orchestra.run.smithi118.stdout: "segexd": 0, 2024-09-13T17:24:27.534 INFO:teuthology.orchestra.run.smithi118.stdout: "expos": 60876582, 2024-09-13T17:24:27.534 INFO:teuthology.orchestra.run.smithi118.stdout: "wrpos": 61405988, 2024-09-13T17:24:27.534 INFO:teuthology.orchestra.run.smithi118.stdout: "rdpos": 61405852, 2024-09-13T17:24:27.534 INFO:teuthology.orchestra.run.smithi118.stdout: "jlat": { 2024-09-13T17:24:27.534 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.534 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.534 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.534 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.534 INFO:teuthology.orchestra.run.smithi118.stdout: "replayed": 26202 2024-09-13T17:24:27.534 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.534 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_mem": { 2024-09-13T17:24:27.534 INFO:teuthology.orchestra.run.smithi118.stdout: "ino": 2351, 2024-09-13T17:24:27.535 INFO:teuthology.orchestra.run.smithi118.stdout: "ino+": 11772, 2024-09-13T17:24:27.535 INFO:teuthology.orchestra.run.smithi118.stdout: "ino-": 9421, 2024-09-13T17:24:27.535 INFO:teuthology.orchestra.run.smithi118.stdout: "dir": 217, 2024-09-13T17:24:27.535 INFO:teuthology.orchestra.run.smithi118.stdout: "dir+": 797, 2024-09-13T17:24:27.535 INFO:teuthology.orchestra.run.smithi118.stdout: "dir-": 580, 2024-09-13T17:24:27.535 INFO:teuthology.orchestra.run.smithi118.stdout: "dn": 8230, 2024-09-13T17:24:27.535 INFO:teuthology.orchestra.run.smithi118.stdout: "dn+": 15514, 2024-09-13T17:24:27.535 INFO:teuthology.orchestra.run.smithi118.stdout: "dn-": 7284, 2024-09-13T17:24:27.535 INFO:teuthology.orchestra.run.smithi118.stdout: "cap": 0, 2024-09-13T17:24:27.535 INFO:teuthology.orchestra.run.smithi118.stdout: "cap+": 0, 2024-09-13T17:24:27.535 INFO:teuthology.orchestra.run.smithi118.stdout: "cap-": 0, 2024-09-13T17:24:27.535 INFO:teuthology.orchestra.run.smithi118.stdout: "rss": 67092, 2024-09-13T17:24:27.535 INFO:teuthology.orchestra.run.smithi118.stdout: "heap": 207124 2024-09-13T17:24:27.535 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.535 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_server": { 2024-09-13T17:24:27.536 INFO:teuthology.orchestra.run.smithi118.stdout: "dispatch_client_request": 0, 2024-09-13T17:24:27.536 INFO:teuthology.orchestra.run.smithi118.stdout: "dispatch_server_request": 0, 2024-09-13T17:24:27.536 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_request": 0, 2024-09-13T17:24:27.536 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_session": 0, 2024-09-13T17:24:27.536 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_peer_request": 0, 2024-09-13T17:24:27.536 INFO:teuthology.orchestra.run.smithi118.stdout: "req_create_latency": { 2024-09-13T17:24:27.536 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.536 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.536 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.536 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.536 INFO:teuthology.orchestra.run.smithi118.stdout: "req_getattr_latency": { 2024-09-13T17:24:27.536 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.536 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.537 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.537 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.537 INFO:teuthology.orchestra.run.smithi118.stdout: "req_getfilelock_latency": { 2024-09-13T17:24:27.537 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.537 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.537 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.537 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.537 INFO:teuthology.orchestra.run.smithi118.stdout: "req_link_latency": { 2024-09-13T17:24:27.537 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.537 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.537 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.537 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.537 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookup_latency": { 2024-09-13T17:24:27.537 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.538 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.538 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.538 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.538 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookuphash_latency": { 2024-09-13T17:24:27.538 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.538 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.538 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.538 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.538 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupino_latency": { 2024-09-13T17:24:27.538 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.538 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.538 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.538 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.539 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupname_latency": { 2024-09-13T17:24:27.539 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.539 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.539 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.539 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.539 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupparent_latency": { 2024-09-13T17:24:27.539 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.539 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.539 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.539 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.539 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupsnap_latency": { 2024-09-13T17:24:27.539 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.539 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.539 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.540 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.540 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lssnap_latency": { 2024-09-13T17:24:27.540 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.540 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.540 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.540 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.540 INFO:teuthology.orchestra.run.smithi118.stdout: "req_mkdir_latency": { 2024-09-13T17:24:27.540 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.540 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.541 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.541 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.541 INFO:teuthology.orchestra.run.smithi118.stdout: "req_mknod_latency": { 2024-09-13T17:24:27.541 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.541 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.541 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.541 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.541 INFO:teuthology.orchestra.run.smithi118.stdout: "req_mksnap_latency": { 2024-09-13T17:24:27.541 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.541 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.542 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.542 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.542 INFO:teuthology.orchestra.run.smithi118.stdout: "req_open_latency": { 2024-09-13T17:24:27.542 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.542 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.542 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.542 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.542 INFO:teuthology.orchestra.run.smithi118.stdout: "req_readdir_latency": { 2024-09-13T17:24:27.542 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.542 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.542 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.542 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.542 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rename_latency": { 2024-09-13T17:24:27.542 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.543 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.543 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.543 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.543 INFO:teuthology.orchestra.run.smithi118.stdout: "req_renamesnap_latency": { 2024-09-13T17:24:27.543 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.543 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.543 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.543 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.543 INFO:teuthology.orchestra.run.smithi118.stdout: "req_snapdiff_latency": { 2024-09-13T17:24:27.543 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.543 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.543 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.543 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.543 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rmdir_latency": { 2024-09-13T17:24:27.544 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.544 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.544 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.544 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.544 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rmsnap_latency": { 2024-09-13T17:24:27.544 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.544 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.544 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.544 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.544 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rmxattr_latency": { 2024-09-13T17:24:27.544 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.544 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.544 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.544 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.545 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setattr_latency": { 2024-09-13T17:24:27.545 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.545 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.545 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.545 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.545 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setdirlayout_latency": { 2024-09-13T17:24:27.545 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.545 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.545 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.545 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.545 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setfilelock_latency": { 2024-09-13T17:24:27.545 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.545 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.545 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.546 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.546 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setlayout_latency": { 2024-09-13T17:24:27.546 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.546 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.546 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.546 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.546 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setxattr_latency": { 2024-09-13T17:24:27.546 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.546 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.546 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.546 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.546 INFO:teuthology.orchestra.run.smithi118.stdout: "req_symlink_latency": { 2024-09-13T17:24:27.546 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.547 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.547 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.547 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.547 INFO:teuthology.orchestra.run.smithi118.stdout: "req_unlink_latency": { 2024-09-13T17:24:27.547 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.547 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.547 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.547 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.547 INFO:teuthology.orchestra.run.smithi118.stdout: "cap_revoke_eviction": 0, 2024-09-13T17:24:27.547 INFO:teuthology.orchestra.run.smithi118.stdout: "cap_acquisition_throttle": 0, 2024-09-13T17:24:27.547 INFO:teuthology.orchestra.run.smithi118.stdout: "req_getvxattr_latency": { 2024-09-13T17:24:27.547 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.547 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.548 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.548 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-13T17:24:27.548 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.548 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_sessions": { 2024-09-13T17:24:27.548 INFO:teuthology.orchestra.run.smithi118.stdout: "session_count": 2, 2024-09-13T17:24:27.548 INFO:teuthology.orchestra.run.smithi118.stdout: "session_add": 6, 2024-09-13T17:24:27.548 INFO:teuthology.orchestra.run.smithi118.stdout: "session_remove": 4, 2024-09-13T17:24:27.548 INFO:teuthology.orchestra.run.smithi118.stdout: "sessions_open": 4, 2024-09-13T17:24:27.548 INFO:teuthology.orchestra.run.smithi118.stdout: "sessions_stale": 0, 2024-09-13T17:24:27.548 INFO:teuthology.orchestra.run.smithi118.stdout: "total_load": 0, 2024-09-13T17:24:27.548 INFO:teuthology.orchestra.run.smithi118.stdout: "average_load": 0, 2024-09-13T17:24:27.548 INFO:teuthology.orchestra.run.smithi118.stdout: "avg_session_uptime": 2744, 2024-09-13T17:24:27.548 INFO:teuthology.orchestra.run.smithi118.stdout: "mdthresh_evicted": 0 2024-09-13T17:24:27.548 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.549 INFO:teuthology.orchestra.run.smithi118.stdout: "mempool": { 2024-09-13T17:24:27.549 INFO:teuthology.orchestra.run.smithi118.stdout: "bloom_filter_bytes": 0, 2024-09-13T17:24:27.549 INFO:teuthology.orchestra.run.smithi118.stdout: "bloom_filter_items": 0, 2024-09-13T17:24:27.549 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T17:24:27.549 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_alloc_items": 0, 2024-09-13T17:24:27.549 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T17:24:27.549 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_data_items": 0, 2024-09-13T17:24:27.549 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T17:24:27.549 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T17:24:27.549 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T17:24:27.549 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T17:24:27.549 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T17:24:27.549 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_other_items": 0, 2024-09-13T17:24:27.550 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T17:24:27.550 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T17:24:27.550 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_extent_bytes": 0, 2024-09-13T17:24:27.550 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_extent_items": 0, 2024-09-13T17:24:27.550 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_blob_bytes": 0, 2024-09-13T17:24:27.550 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_blob_items": 0, 2024-09-13T17:24:27.550 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T17:24:27.550 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T17:24:27.550 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T17:24:27.550 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T17:24:27.550 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T17:24:27.550 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_fsck_items": 0, 2024-09-13T17:24:27.550 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_txc_bytes": 0, 2024-09-13T17:24:27.550 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_txc_items": 0, 2024-09-13T17:24:27.551 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T17:24:27.551 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T17:24:27.551 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_bytes": 0, 2024-09-13T17:24:27.551 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_items": 0, 2024-09-13T17:24:27.551 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_bytes": 0, 2024-09-13T17:24:27.551 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_items": 0, 2024-09-13T17:24:27.551 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T17:24:27.551 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_reader_items": 0, 2024-09-13T17:24:27.551 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T17:24:27.551 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_writer_items": 0, 2024-09-13T17:24:27.551 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_anon_bytes": 214457, 2024-09-13T17:24:27.551 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_anon_items": 66, 2024-09-13T17:24:27.551 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_meta_bytes": 0, 2024-09-13T17:24:27.551 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_meta_items": 0, 2024-09-13T17:24:27.552 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_bytes": 0, 2024-09-13T17:24:27.552 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_items": 0, 2024-09-13T17:24:27.552 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_mapbl_bytes": 0, 2024-09-13T17:24:27.552 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_mapbl_items": 0, 2024-09-13T17:24:27.552 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_pglog_bytes": 0, 2024-09-13T17:24:27.552 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_pglog_items": 0, 2024-09-13T17:24:27.552 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_bytes": 10008, 2024-09-13T17:24:27.552 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_items": 204, 2024-09-13T17:24:27.552 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T17:24:27.552 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_mapping_items": 0, 2024-09-13T17:24:27.552 INFO:teuthology.orchestra.run.smithi118.stdout: "pgmap_bytes": 0, 2024-09-13T17:24:27.552 INFO:teuthology.orchestra.run.smithi118.stdout: "pgmap_items": 0, 2024-09-13T17:24:27.552 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_co_bytes": 11139685, 2024-09-13T17:24:27.552 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_co_items": 99344, 2024-09-13T17:24:27.553 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_1_bytes": 0, 2024-09-13T17:24:27.553 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_1_items": 0, 2024-09-13T17:24:27.553 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_2_bytes": 0, 2024-09-13T17:24:27.553 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_2_items": 0 2024-09-13T17:24:27.553 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.553 INFO:teuthology.orchestra.run.smithi118.stdout: "objecter": { 2024-09-13T17:24:27.553 INFO:teuthology.orchestra.run.smithi118.stdout: "op_active": 0, 2024-09-13T17:24:27.553 INFO:teuthology.orchestra.run.smithi118.stdout: "op_laggy": 0, 2024-09-13T17:24:27.553 INFO:teuthology.orchestra.run.smithi118.stdout: "op_send": 2460, 2024-09-13T17:24:27.553 INFO:teuthology.orchestra.run.smithi118.stdout: "op_send_bytes": 26, 2024-09-13T17:24:27.553 INFO:teuthology.orchestra.run.smithi118.stdout: "op_resend": 4, 2024-09-13T17:24:27.553 INFO:teuthology.orchestra.run.smithi118.stdout: "op_reply": 2460, 2024-09-13T17:24:27.553 INFO:teuthology.orchestra.run.smithi118.stdout: "op_latency": { 2024-09-13T17:24:27.553 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 2460, 2024-09-13T17:24:27.554 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 1.664960656, 2024-09-13T17:24:27.554 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000676813 2024-09-13T17:24:27.554 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.554 INFO:teuthology.orchestra.run.smithi118.stdout: "op_inflight": 0, 2024-09-13T17:24:27.554 INFO:teuthology.orchestra.run.smithi118.stdout: "oplen_avg": { 2024-09-13T17:24:27.554 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 2460, 2024-09-13T17:24:27.554 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 2461 2024-09-13T17:24:27.554 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.554 INFO:teuthology.orchestra.run.smithi118.stdout: "op": 2460, 2024-09-13T17:24:27.554 INFO:teuthology.orchestra.run.smithi118.stdout: "op_r": 2460, 2024-09-13T17:24:27.554 INFO:teuthology.orchestra.run.smithi118.stdout: "op_w": 0, 2024-09-13T17:24:27.554 INFO:teuthology.orchestra.run.smithi118.stdout: "op_rmw": 0, 2024-09-13T17:24:27.554 INFO:teuthology.orchestra.run.smithi118.stdout: "op_pg": 0, 2024-09-13T17:24:27.554 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_stat": 1537, 2024-09-13T17:24:27.555 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_create": 0, 2024-09-13T17:24:27.555 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_read": 920, 2024-09-13T17:24:27.555 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_write": 0, 2024-09-13T17:24:27.555 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_writefull": 0, 2024-09-13T17:24:27.555 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_writesame": 0, 2024-09-13T17:24:27.555 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_append": 0, 2024-09-13T17:24:27.555 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_zero": 0, 2024-09-13T17:24:27.555 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_truncate": 0, 2024-09-13T17:24:27.555 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_delete": 0, 2024-09-13T17:24:27.555 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_mapext": 0, 2024-09-13T17:24:27.555 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_sparse_read": 0, 2024-09-13T17:24:27.555 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_clonerange": 0, 2024-09-13T17:24:27.555 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_getxattr": 2, 2024-09-13T17:24:27.555 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_setxattr": 0, 2024-09-13T17:24:27.556 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_cmpxattr": 0, 2024-09-13T17:24:27.556 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_rmxattr": 0, 2024-09-13T17:24:27.556 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_resetxattrs": 0, 2024-09-13T17:24:27.556 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_call": 0, 2024-09-13T17:24:27.556 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_watch": 0, 2024-09-13T17:24:27.556 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_notify": 0, 2024-09-13T17:24:27.556 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T17:24:27.556 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_pgls": 0, 2024-09-13T17:24:27.556 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_pgls_filter": 0, 2024-09-13T17:24:27.556 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_other": 0, 2024-09-13T17:24:27.556 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_active": 0, 2024-09-13T17:24:27.556 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_send": 0, 2024-09-13T17:24:27.556 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_resend": 0, 2024-09-13T17:24:27.557 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_ping": 0, 2024-09-13T17:24:27.557 INFO:teuthology.orchestra.run.smithi118.stdout: "poolop_active": 0, 2024-09-13T17:24:27.557 INFO:teuthology.orchestra.run.smithi118.stdout: "poolop_send": 0, 2024-09-13T17:24:27.557 INFO:teuthology.orchestra.run.smithi118.stdout: "poolop_resend": 0, 2024-09-13T17:24:27.557 INFO:teuthology.orchestra.run.smithi118.stdout: "poolstat_active": 0, 2024-09-13T17:24:27.557 INFO:teuthology.orchestra.run.smithi118.stdout: "poolstat_send": 0, 2024-09-13T17:24:27.557 INFO:teuthology.orchestra.run.smithi118.stdout: "poolstat_resend": 0, 2024-09-13T17:24:27.557 INFO:teuthology.orchestra.run.smithi118.stdout: "statfs_active": 0, 2024-09-13T17:24:27.557 INFO:teuthology.orchestra.run.smithi118.stdout: "statfs_send": 0, 2024-09-13T17:24:27.557 INFO:teuthology.orchestra.run.smithi118.stdout: "statfs_resend": 0, 2024-09-13T17:24:27.557 INFO:teuthology.orchestra.run.smithi118.stdout: "command_active": 0, 2024-09-13T17:24:27.557 INFO:teuthology.orchestra.run.smithi118.stdout: "command_send": 0, 2024-09-13T17:24:27.558 INFO:teuthology.orchestra.run.smithi118.stdout: "command_resend": 0, 2024-09-13T17:24:27.558 INFO:teuthology.orchestra.run.smithi118.stdout: "map_epoch": 104, 2024-09-13T17:24:27.558 INFO:teuthology.orchestra.run.smithi118.stdout: "map_full": 0, 2024-09-13T17:24:27.558 INFO:teuthology.orchestra.run.smithi118.stdout: "map_inc": 15, 2024-09-13T17:24:27.558 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_sessions": 8, 2024-09-13T17:24:27.558 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_session_open": 8, 2024-09-13T17:24:27.558 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_session_close": 0, 2024-09-13T17:24:27.558 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_laggy": 0, 2024-09-13T17:24:27.558 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_wr": 0, 2024-09-13T17:24:27.558 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_rd": 2, 2024-09-13T17:24:27.558 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_del": 0 2024-09-13T17:24:27.558 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.558 INFO:teuthology.orchestra.run.smithi118.stdout: "oft": { 2024-09-13T17:24:27.558 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_objs": 0, 2024-09-13T17:24:27.559 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_kv_pairs": 0, 2024-09-13T17:24:27.559 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_updates": 0, 2024-09-13T17:24:27.559 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_removes": 0 2024-09-13T17:24:27.559 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.559 INFO:teuthology.orchestra.run.smithi118.stdout: "osd-slow-ops": { 2024-09-13T17:24:27.559 INFO:teuthology.orchestra.run.smithi118.stdout: "slow_ops_count": 0 2024-09-13T17:24:27.559 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.559 INFO:teuthology.orchestra.run.smithi118.stdout: "purge_queue": { 2024-09-13T17:24:27.559 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing_ops": 0, 2024-09-13T17:24:27.559 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing_ops_high_water": 0, 2024-09-13T17:24:27.559 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing": 0, 2024-09-13T17:24:27.559 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing_high_water": 0, 2024-09-13T17:24:27.559 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executed_ops": 0, 2024-09-13T17:24:27.559 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executed": 0, 2024-09-13T17:24:27.560 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_item_in_journal": 0 2024-09-13T17:24:27.560 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.560 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T17:24:27.560 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2024-09-13T17:24:27.560 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 104857600, 2024-09-13T17:24:27.560 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2024-09-13T17:24:27.560 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 2719, 2024-09-13T17:24:27.560 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 59288762, 2024-09-13T17:24:27.560 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:27.560 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 2719, 2024-09-13T17:24:27.560 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 0, 2024-09-13T17:24:27.560 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 0, 2024-09-13T17:24:27.560 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 2719, 2024-09-13T17:24:27.560 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 59288762, 2024-09-13T17:24:27.561 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2024-09-13T17:24:27.561 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.561 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.561 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.561 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-13T17:24:27.561 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.561 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-objecter_bytes": { 2024-09-13T17:24:27.561 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2024-09-13T17:24:27.561 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 104857600, 2024-09-13T17:24:27.561 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2024-09-13T17:24:27.562 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 0, 2024-09-13T17:24:27.562 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 0, 2024-09-13T17:24:27.562 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:27.562 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 0, 2024-09-13T17:24:27.562 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 2460, 2024-09-13T17:24:27.562 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 57222906, 2024-09-13T17:24:27.562 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 2460, 2024-09-13T17:24:27.562 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 57222906, 2024-09-13T17:24:27.562 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2024-09-13T17:24:27.562 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.562 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.562 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.563 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-13T17:24:27.563 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.563 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-objecter_ops": { 2024-09-13T17:24:27.563 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2024-09-13T17:24:27.563 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 1024, 2024-09-13T17:24:27.563 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2024-09-13T17:24:27.563 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 0, 2024-09-13T17:24:27.563 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 0, 2024-09-13T17:24:27.563 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:27.563 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 0, 2024-09-13T17:24:27.563 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 2460, 2024-09-13T17:24:27.563 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 2460, 2024-09-13T17:24:27.563 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 2460, 2024-09-13T17:24:27.564 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 2460, 2024-09-13T17:24:27.564 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2024-09-13T17:24:27.564 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.564 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.564 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.564 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-13T17:24:27.564 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.564 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-write_buf_throttle": { 2024-09-13T17:24:27.564 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2024-09-13T17:24:27.564 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 3758096384, 2024-09-13T17:24:27.564 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2024-09-13T17:24:27.564 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 0, 2024-09-13T17:24:27.564 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 0, 2024-09-13T17:24:27.565 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:27.565 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 0, 2024-09-13T17:24:27.565 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 0, 2024-09-13T17:24:27.565 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 0, 2024-09-13T17:24:27.565 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 0, 2024-09-13T17:24:27.565 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 0, 2024-09-13T17:24:27.565 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2024-09-13T17:24:27.565 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.565 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.565 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.565 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-13T17:24:27.565 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:27.565 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-write_buf_throttle-0x5644d94dc8c0": { 2024-09-13T17:24:27.565 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2024-09-13T17:24:27.566 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 3758096384, 2024-09-13T17:24:27.566 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2024-09-13T17:24:27.566 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 0, 2024-09-13T17:24:27.566 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 0, 2024-09-13T17:24:27.566 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:27.566 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 0, 2024-09-13T17:24:27.566 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 0, 2024-09-13T17:24:27.566 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 0, 2024-09-13T17:24:27.566 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 0, 2024-09-13T17:24:27.567 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 0, 2024-09-13T17:24:27.567 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2024-09-13T17:24:27.567 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:27.567 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:27.567 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:27.567 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-13T17:24:27.567 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-13T17:24:27.567 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-13T17:24:28.297 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-09-13T17:24:28.297 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-09-13T17:24:28.297 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=0 2024-09-13T17:24:28.297 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2024-09-13T17:24:28.297 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-13T17:24:28.297 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=0 2024-09-13T17:24:28.297 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=0 2024-09-13T17:24:28.297 DEBUG:tasks.check_counter:Getting stats from e 2024-09-13T17:24:28.297 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-13T17:24:28.538 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T17:24:29.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:28 smithi118 ceph-mon[34374]: pgmap v332: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s 2024-09-13T17:24:29.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:28 smithi087 ceph-mon[30934]: pgmap v332: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s 2024-09-13T17:24:29.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:28 smithi149 ceph-mon[35496]: pgmap v332: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s 2024-09-13T17:24:30.339 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-13T17:24:30.340 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T17:24:30.340 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 0, 2024-09-13T17:24:30.340 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 2, 2024-09-13T17:24:30.340 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 0, 2024-09-13T17:24:30.340 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 0, 2024-09-13T17:24:30.340 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 4, 2024-09-13T17:24:30.340 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 0, 2024-09-13T17:24:30.340 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 0.001093717, 2024-09-13T17:24:30.340 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 0.000000000, 2024-09-13T17:24:30.340 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 0.000247244, 2024-09-13T17:24:30.340 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:24:30.340 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:30.341 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:30.341 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:30.341 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:30.341 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:30.341 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:30.341 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:30.341 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:30.341 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:30.341 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:30.341 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T17:24:30.341 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T17:24:30.341 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:30.341 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T17:24:30.342 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 6, 2024-09-13T17:24:30.342 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 168, 2024-09-13T17:24:30.342 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 3280, 2024-09-13T17:24:30.342 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 182000, 2024-09-13T17:24:30.342 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 5, 2024-09-13T17:24:30.342 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 3, 2024-09-13T17:24:30.342 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 0.013269068, 2024-09-13T17:24:30.342 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 0.007530719, 2024-09-13T17:24:30.342 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 0.003585306, 2024-09-13T17:24:30.342 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:24:30.342 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:30.342 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 166, 2024-09-13T17:24:30.342 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.027748008, 2024-09-13T17:24:30.343 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000167156 2024-09-13T17:24:30.343 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:30.343 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:30.343 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:30.343 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:30.343 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:30.343 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:30.343 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 3280, 2024-09-13T17:24:30.343 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 182000 2024-09-13T17:24:30.343 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:30.343 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T17:24:30.343 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 228, 2024-09-13T17:24:30.343 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 217, 2024-09-13T17:24:30.344 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 1560768, 2024-09-13T17:24:30.344 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 123904, 2024-09-13T17:24:30.344 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 2, 2024-09-13T17:24:30.344 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 1, 2024-09-13T17:24:30.344 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 0.042632504, 2024-09-13T17:24:30.344 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 0.015608628, 2024-09-13T17:24:30.344 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 0.040096052, 2024-09-13T17:24:30.344 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:24:30.344 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:30.344 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 216, 2024-09-13T17:24:30.344 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.013503214, 2024-09-13T17:24:30.344 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000062514 2024-09-13T17:24:30.345 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:30.345 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:30.345 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:30.345 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:30.345 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:30.345 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:30.345 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 1560768, 2024-09-13T17:24:30.345 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 123904 2024-09-13T17:24:30.345 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:30.346 INFO:teuthology.orchestra.run.smithi118.stdout: "cct": { 2024-09-13T17:24:30.346 INFO:teuthology.orchestra.run.smithi118.stdout: "total_workers": 0, 2024-09-13T17:24:30.346 INFO:teuthology.orchestra.run.smithi118.stdout: "unhealthy_workers": 0 2024-09-13T17:24:30.346 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:30.346 INFO:teuthology.orchestra.run.smithi118.stdout: "mempool": { 2024-09-13T17:24:30.346 INFO:teuthology.orchestra.run.smithi118.stdout: "bloom_filter_bytes": 0, 2024-09-13T17:24:30.346 INFO:teuthology.orchestra.run.smithi118.stdout: "bloom_filter_items": 0, 2024-09-13T17:24:30.346 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T17:24:30.346 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_alloc_items": 0, 2024-09-13T17:24:30.346 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T17:24:30.346 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_data_items": 0, 2024-09-13T17:24:30.346 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T17:24:30.346 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T17:24:30.346 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T17:24:30.346 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T17:24:30.347 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T17:24:30.347 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_other_items": 0, 2024-09-13T17:24:30.347 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T17:24:30.347 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T17:24:30.347 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_extent_bytes": 0, 2024-09-13T17:24:30.347 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_extent_items": 0, 2024-09-13T17:24:30.347 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_blob_bytes": 0, 2024-09-13T17:24:30.347 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_blob_items": 0, 2024-09-13T17:24:30.347 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T17:24:30.347 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T17:24:30.347 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T17:24:30.348 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T17:24:30.348 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T17:24:30.348 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_fsck_items": 0, 2024-09-13T17:24:30.348 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_txc_bytes": 0, 2024-09-13T17:24:30.348 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_txc_items": 0, 2024-09-13T17:24:30.348 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T17:24:30.348 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T17:24:30.348 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_bytes": 0, 2024-09-13T17:24:30.348 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_items": 0, 2024-09-13T17:24:30.348 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_bytes": 0, 2024-09-13T17:24:30.348 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_items": 0, 2024-09-13T17:24:30.348 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T17:24:30.349 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_reader_items": 0, 2024-09-13T17:24:30.349 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T17:24:30.349 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_writer_items": 0, 2024-09-13T17:24:30.349 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_anon_bytes": 149017, 2024-09-13T17:24:30.349 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_anon_items": 31, 2024-09-13T17:24:30.349 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_meta_bytes": 0, 2024-09-13T17:24:30.349 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_meta_items": 0, 2024-09-13T17:24:30.349 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_bytes": 0, 2024-09-13T17:24:30.349 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_items": 0, 2024-09-13T17:24:30.349 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_mapbl_bytes": 0, 2024-09-13T17:24:30.349 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_mapbl_items": 0, 2024-09-13T17:24:30.350 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_pglog_bytes": 0, 2024-09-13T17:24:30.350 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_pglog_items": 0, 2024-09-13T17:24:30.350 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_bytes": 0, 2024-09-13T17:24:30.350 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_items": 0, 2024-09-13T17:24:30.350 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T17:24:30.350 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_mapping_items": 0, 2024-09-13T17:24:30.350 INFO:teuthology.orchestra.run.smithi118.stdout: "pgmap_bytes": 0, 2024-09-13T17:24:30.350 INFO:teuthology.orchestra.run.smithi118.stdout: "pgmap_items": 0, 2024-09-13T17:24:30.350 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_co_bytes": 928, 2024-09-13T17:24:30.350 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_co_items": 2, 2024-09-13T17:24:30.350 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_1_bytes": 0, 2024-09-13T17:24:30.351 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_1_items": 0, 2024-09-13T17:24:30.351 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_2_bytes": 0, 2024-09-13T17:24:30.351 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_2_items": 0 2024-09-13T17:24:30.351 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:30.351 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T17:24:30.351 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2024-09-13T17:24:30.351 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 104857600, 2024-09-13T17:24:30.351 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2024-09-13T17:24:30.351 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 230, 2024-09-13T17:24:30.351 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 1528562, 2024-09-13T17:24:30.351 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:30.352 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 230, 2024-09-13T17:24:30.352 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 0, 2024-09-13T17:24:30.352 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 0, 2024-09-13T17:24:30.352 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 230, 2024-09-13T17:24:30.352 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 1528562, 2024-09-13T17:24:30.352 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2024-09-13T17:24:30.352 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:30.352 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:30.352 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:30.352 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-13T17:24:30.352 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-13T17:24:30.352 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-13T17:24:31.001 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.e 2024-09-13T17:24:31.001 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.e 2024-09-13T17:24:31.001 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.e 2024-09-13T17:24:31.001 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.e 2024-09-13T17:24:31.001 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.e 2024-09-13T17:24:31.001 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.e 2024-09-13T17:24:31.001 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.e 2024-09-13T17:24:31.002 DEBUG:tasks.check_counter:Getting stats from h 2024-09-13T17:24:31.002 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-13T17:24:31.201 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T17:24:31.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:30 smithi087 ceph-mon[30934]: pgmap v333: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 6 op/s 2024-09-13T17:24:31.321 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:30 smithi118 ceph-mon[34374]: pgmap v333: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 6 op/s 2024-09-13T17:24:31.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:30 smithi149 ceph-mon[35496]: pgmap v333: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 6 op/s 2024-09-13T17:24:32.933 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-13T17:24:32.934 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T17:24:32.934 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 1730, 2024-09-13T17:24:32.934 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 1732, 2024-09-13T17:24:32.934 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 25674887, 2024-09-13T17:24:32.934 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 538037, 2024-09-13T17:24:32.934 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 7, 2024-09-13T17:24:32.934 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 3, 2024-09-13T17:24:32.934 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 0.157359456, 2024-09-13T17:24:32.934 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 0.052815812, 2024-09-13T17:24:32.934 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 0.048909159, 2024-09-13T17:24:32.934 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.042356896, 2024-09-13T17:24:32.934 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:32.934 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 1730, 2024-09-13T17:24:32.935 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.059984337, 2024-09-13T17:24:32.935 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000034673 2024-09-13T17:24:32.935 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.935 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:32.935 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.935 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.935 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.935 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.935 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T17:24:32.935 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T17:24:32.935 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.935 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T17:24:32.935 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 775, 2024-09-13T17:24:32.935 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 751, 2024-09-13T17:24:32.936 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 11289517, 2024-09-13T17:24:32.936 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 287011, 2024-09-13T17:24:32.936 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 4, 2024-09-13T17:24:32.936 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 3, 2024-09-13T17:24:32.936 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 0.088392546, 2024-09-13T17:24:32.936 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 0.030203305, 2024-09-13T17:24:32.936 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 0.057668199, 2024-09-13T17:24:32.936 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.011420481, 2024-09-13T17:24:32.936 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:32.936 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 750, 2024-09-13T17:24:32.936 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.029382727, 2024-09-13T17:24:32.936 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000039176 2024-09-13T17:24:32.936 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.936 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:32.937 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.937 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.937 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.937 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.937 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 1636656, 2024-09-13T17:24:32.937 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 126784 2024-09-13T17:24:32.937 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.937 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T17:24:32.937 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 48, 2024-09-13T17:24:32.937 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 210, 2024-09-13T17:24:32.937 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 4208386, 2024-09-13T17:24:32.937 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 453846, 2024-09-13T17:24:32.937 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 7, 2024-09-13T17:24:32.938 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 5, 2024-09-13T17:24:32.938 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 0.017387824, 2024-09-13T17:24:32.938 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 0.007734158, 2024-09-13T17:24:32.938 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 0.006845826, 2024-09-13T17:24:32.938 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.000804670, 2024-09-13T17:24:32.938 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:32.938 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 208, 2024-09-13T17:24:32.938 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.023595515, 2024-09-13T17:24:32.938 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000113439 2024-09-13T17:24:32.938 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.938 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:32.938 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.938 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.938 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.938 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.939 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 3280, 2024-09-13T17:24:32.939 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 440784 2024-09-13T17:24:32.939 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.939 INFO:teuthology.orchestra.run.smithi118.stdout: "cct": { 2024-09-13T17:24:32.939 INFO:teuthology.orchestra.run.smithi118.stdout: "total_workers": 1, 2024-09-13T17:24:32.939 INFO:teuthology.orchestra.run.smithi118.stdout: "unhealthy_workers": 0 2024-09-13T17:24:32.939 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.939 INFO:teuthology.orchestra.run.smithi118.stdout: "finisher-MDSRank": { 2024-09-13T17:24:32.939 INFO:teuthology.orchestra.run.smithi118.stdout: "queue_len": 0, 2024-09-13T17:24:32.939 INFO:teuthology.orchestra.run.smithi118.stdout: "complete_latency": { 2024-09-13T17:24:32.939 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 3855, 2024-09-13T17:24:32.939 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.086230147, 2024-09-13T17:24:32.939 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000022368 2024-09-13T17:24:32.939 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-13T17:24:32.940 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.940 INFO:teuthology.orchestra.run.smithi118.stdout: "finisher-PurgeQueue": { 2024-09-13T17:24:32.940 INFO:teuthology.orchestra.run.smithi118.stdout: "queue_len": 0, 2024-09-13T17:24:32.940 INFO:teuthology.orchestra.run.smithi118.stdout: "complete_latency": { 2024-09-13T17:24:32.940 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.940 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.940 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.940 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-13T17:24:32.940 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.940 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2024-09-13T17:24:32.940 INFO:teuthology.orchestra.run.smithi118.stdout: "request": 0, 2024-09-13T17:24:32.940 INFO:teuthology.orchestra.run.smithi118.stdout: "reply": 0, 2024-09-13T17:24:32.940 INFO:teuthology.orchestra.run.smithi118.stdout: "reply_latency": { 2024-09-13T17:24:32.940 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.941 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.941 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.941 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.941 INFO:teuthology.orchestra.run.smithi118.stdout: "slow_reply": 0, 2024-09-13T17:24:32.941 INFO:teuthology.orchestra.run.smithi118.stdout: "forward": 0, 2024-09-13T17:24:32.941 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_fetch_complete": 0, 2024-09-13T17:24:32.941 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_fetch_keys": 0, 2024-09-13T17:24:32.941 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_commit": 0, 2024-09-13T17:24:32.941 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_split": 0, 2024-09-13T17:24:32.941 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_merge": 0, 2024-09-13T17:24:32.941 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes": 7147, 2024-09-13T17:24:32.941 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_top": 71, 2024-09-13T17:24:32.941 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_bottom": 7076, 2024-09-13T17:24:32.941 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_pin_tail": 0, 2024-09-13T17:24:32.942 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_pinned": 7045, 2024-09-13T17:24:32.942 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_expired": 0, 2024-09-13T17:24:32.942 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_with_caps": 0, 2024-09-13T17:24:32.942 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": 0, 2024-09-13T17:24:32.942 INFO:teuthology.orchestra.run.smithi118.stdout: "subtrees": 1, 2024-09-13T17:24:32.942 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse": 0, 2024-09-13T17:24:32.942 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_hit": 0, 2024-09-13T17:24:32.942 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_forward": 0, 2024-09-13T17:24:32.942 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_discover": 0, 2024-09-13T17:24:32.942 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_dir_fetch": 0, 2024-09-13T17:24:32.942 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_remote_ino": 0, 2024-09-13T17:24:32.942 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_lock": 0, 2024-09-13T17:24:32.942 INFO:teuthology.orchestra.run.smithi118.stdout: "load_cent": 0, 2024-09-13T17:24:32.942 INFO:teuthology.orchestra.run.smithi118.stdout: "q": 0, 2024-09-13T17:24:32.943 INFO:teuthology.orchestra.run.smithi118.stdout: "exported": 0, 2024-09-13T17:24:32.943 INFO:teuthology.orchestra.run.smithi118.stdout: "exported_inodes": 0, 2024-09-13T17:24:32.943 INFO:teuthology.orchestra.run.smithi118.stdout: "imported": 0, 2024-09-13T17:24:32.943 INFO:teuthology.orchestra.run.smithi118.stdout: "imported_inodes": 0, 2024-09-13T17:24:32.943 INFO:teuthology.orchestra.run.smithi118.stdout: "openino_dir_fetch": 0, 2024-09-13T17:24:32.943 INFO:teuthology.orchestra.run.smithi118.stdout: "openino_backtrace_fetch": 0, 2024-09-13T17:24:32.943 INFO:teuthology.orchestra.run.smithi118.stdout: "openino_peer_discover": 0, 2024-09-13T17:24:32.943 INFO:teuthology.orchestra.run.smithi118.stdout: "root_rfiles": 0, 2024-09-13T17:24:32.943 INFO:teuthology.orchestra.run.smithi118.stdout: "root_rbytes": 0, 2024-09-13T17:24:32.943 INFO:teuthology.orchestra.run.smithi118.stdout: "root_rsnaps": 0, 2024-09-13T17:24:32.943 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T17:24:32.943 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_set_tag": 0, 2024-09-13T17:24:32.943 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T17:24:32.943 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_inotable_repaired": 0, 2024-09-13T17:24:32.944 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_dir_inodes": 0, 2024-09-13T17:24:32.944 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T17:24:32.944 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T17:24:32.944 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_file_inodes": 0, 2024-09-13T17:24:32.944 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_inode_file_caps": 0, 2024-09-13T17:24:32.944 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_revoke": 0, 2024-09-13T17:24:32.944 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_grant": 0, 2024-09-13T17:24:32.944 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T17:24:32.944 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T17:24:32.944 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T17:24:32.944 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_caps": 0, 2024-09-13T17:24:32.944 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_caps_dirty": 0, 2024-09-13T17:24:32.944 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_cap_release": 0, 2024-09-13T17:24:32.944 INFO:teuthology.orchestra.run.smithi118.stdout: "process_request_cap_release": 0 2024-09-13T17:24:32.945 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.945 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_cache": { 2024-09-13T17:24:32.945 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_update": 0, 2024-09-13T17:24:32.945 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_update_receipt": 0, 2024-09-13T17:24:32.945 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_try_discover": 0, 2024-09-13T17:24:32.945 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_send_discover": 0, 2024-09-13T17:24:32.945 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_handle_discover": 0, 2024-09-13T17:24:32.945 INFO:teuthology.orchestra.run.smithi118.stdout: "num_strays": 0, 2024-09-13T17:24:32.945 INFO:teuthology.orchestra.run.smithi118.stdout: "num_strays_delayed": 0, 2024-09-13T17:24:32.945 INFO:teuthology.orchestra.run.smithi118.stdout: "num_strays_enqueuing": 0, 2024-09-13T17:24:32.945 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_created": 0, 2024-09-13T17:24:32.945 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_enqueued": 0, 2024-09-13T17:24:32.945 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_reintegrated": 0, 2024-09-13T17:24:32.945 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_migrated": 0, 2024-09-13T17:24:32.946 INFO:teuthology.orchestra.run.smithi118.stdout: "num_recovering_processing": 0, 2024-09-13T17:24:32.946 INFO:teuthology.orchestra.run.smithi118.stdout: "num_recovering_enqueued": 0, 2024-09-13T17:24:32.946 INFO:teuthology.orchestra.run.smithi118.stdout: "num_recovering_prioritized": 0, 2024-09-13T17:24:32.946 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_started": 0, 2024-09-13T17:24:32.946 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_completed": 0, 2024-09-13T17:24:32.946 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T17:24:32.946 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_exportdir": 0, 2024-09-13T17:24:32.946 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_flush": 0, 2024-09-13T17:24:32.946 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_fragmentdir": 0, 2024-09-13T17:24:32.946 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_fragstats": 0, 2024-09-13T17:24:32.946 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_inodestats": 0 2024-09-13T17:24:32.946 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.946 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_log": { 2024-09-13T17:24:32.946 INFO:teuthology.orchestra.run.smithi118.stdout: "evadd": 0, 2024-09-13T17:24:32.947 INFO:teuthology.orchestra.run.smithi118.stdout: "evex": 0, 2024-09-13T17:24:32.947 INFO:teuthology.orchestra.run.smithi118.stdout: "evtrm": 0, 2024-09-13T17:24:32.947 INFO:teuthology.orchestra.run.smithi118.stdout: "ev": 16512, 2024-09-13T17:24:32.947 INFO:teuthology.orchestra.run.smithi118.stdout: "evexg": 0, 2024-09-13T17:24:32.947 INFO:teuthology.orchestra.run.smithi118.stdout: "evexd": 0, 2024-09-13T17:24:32.947 INFO:teuthology.orchestra.run.smithi118.stdout: "segadd": 0, 2024-09-13T17:24:32.947 INFO:teuthology.orchestra.run.smithi118.stdout: "segex": 0, 2024-09-13T17:24:32.947 INFO:teuthology.orchestra.run.smithi118.stdout: "segtrm": 0, 2024-09-13T17:24:32.947 INFO:teuthology.orchestra.run.smithi118.stdout: "seg": 24, 2024-09-13T17:24:32.947 INFO:teuthology.orchestra.run.smithi118.stdout: "segexg": 0, 2024-09-13T17:24:32.947 INFO:teuthology.orchestra.run.smithi118.stdout: "segexd": 0, 2024-09-13T17:24:32.947 INFO:teuthology.orchestra.run.smithi118.stdout: "expos": 4194304, 2024-09-13T17:24:32.947 INFO:teuthology.orchestra.run.smithi118.stdout: "wrpos": 43072667, 2024-09-13T17:24:32.947 INFO:teuthology.orchestra.run.smithi118.stdout: "rdpos": 43069935, 2024-09-13T17:24:32.947 INFO:teuthology.orchestra.run.smithi118.stdout: "jlat": { 2024-09-13T17:24:32.948 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.948 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.948 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.948 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.948 INFO:teuthology.orchestra.run.smithi118.stdout: "replayed": 16512 2024-09-13T17:24:32.948 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.948 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_mem": { 2024-09-13T17:24:32.948 INFO:teuthology.orchestra.run.smithi118.stdout: "ino": 964, 2024-09-13T17:24:32.948 INFO:teuthology.orchestra.run.smithi118.stdout: "ino+": 7309, 2024-09-13T17:24:32.948 INFO:teuthology.orchestra.run.smithi118.stdout: "ino-": 6345, 2024-09-13T17:24:32.948 INFO:teuthology.orchestra.run.smithi118.stdout: "dir": 168, 2024-09-13T17:24:32.948 INFO:teuthology.orchestra.run.smithi118.stdout: "dir+": 428, 2024-09-13T17:24:32.948 INFO:teuthology.orchestra.run.smithi118.stdout: "dir-": 260, 2024-09-13T17:24:32.948 INFO:teuthology.orchestra.run.smithi118.stdout: "dn": 7147, 2024-09-13T17:24:32.949 INFO:teuthology.orchestra.run.smithi118.stdout: "dn+": 10454, 2024-09-13T17:24:32.949 INFO:teuthology.orchestra.run.smithi118.stdout: "dn-": 3307, 2024-09-13T17:24:32.949 INFO:teuthology.orchestra.run.smithi118.stdout: "cap": 0, 2024-09-13T17:24:32.949 INFO:teuthology.orchestra.run.smithi118.stdout: "cap+": 0, 2024-09-13T17:24:32.949 INFO:teuthology.orchestra.run.smithi118.stdout: "cap-": 0, 2024-09-13T17:24:32.949 INFO:teuthology.orchestra.run.smithi118.stdout: "rss": 62796, 2024-09-13T17:24:32.949 INFO:teuthology.orchestra.run.smithi118.stdout: "heap": 207124 2024-09-13T17:24:32.949 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.953 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_server": { 2024-09-13T17:24:32.953 INFO:teuthology.orchestra.run.smithi118.stdout: "dispatch_client_request": 0, 2024-09-13T17:24:32.953 INFO:teuthology.orchestra.run.smithi118.stdout: "dispatch_server_request": 0, 2024-09-13T17:24:32.953 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_request": 0, 2024-09-13T17:24:32.953 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_session": 0, 2024-09-13T17:24:32.953 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_peer_request": 0, 2024-09-13T17:24:32.953 INFO:teuthology.orchestra.run.smithi118.stdout: "req_create_latency": { 2024-09-13T17:24:32.953 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.953 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.953 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.954 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.954 INFO:teuthology.orchestra.run.smithi118.stdout: "req_getattr_latency": { 2024-09-13T17:24:32.954 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.954 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.954 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.954 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.954 INFO:teuthology.orchestra.run.smithi118.stdout: "req_getfilelock_latency": { 2024-09-13T17:24:32.954 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.954 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.954 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.954 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.954 INFO:teuthology.orchestra.run.smithi118.stdout: "req_link_latency": { 2024-09-13T17:24:32.954 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.954 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.955 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.955 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.955 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookup_latency": { 2024-09-13T17:24:32.955 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.955 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.955 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.955 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.955 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookuphash_latency": { 2024-09-13T17:24:32.955 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.955 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.955 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.956 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.956 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupino_latency": { 2024-09-13T17:24:32.956 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.956 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.956 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.956 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.956 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupname_latency": { 2024-09-13T17:24:32.956 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.956 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.956 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.956 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.956 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupparent_latency": { 2024-09-13T17:24:32.956 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.956 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.957 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.957 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.957 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupsnap_latency": { 2024-09-13T17:24:32.957 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.957 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.957 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.957 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.957 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lssnap_latency": { 2024-09-13T17:24:32.957 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.957 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.957 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.957 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.957 INFO:teuthology.orchestra.run.smithi118.stdout: "req_mkdir_latency": { 2024-09-13T17:24:32.958 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.958 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.958 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.959 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.959 INFO:teuthology.orchestra.run.smithi118.stdout: "req_mknod_latency": { 2024-09-13T17:24:32.959 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.959 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.959 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.959 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.959 INFO:teuthology.orchestra.run.smithi118.stdout: "req_mksnap_latency": { 2024-09-13T17:24:32.959 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.959 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.959 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.959 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.959 INFO:teuthology.orchestra.run.smithi118.stdout: "req_open_latency": { 2024-09-13T17:24:32.959 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.960 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.960 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.960 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.960 INFO:teuthology.orchestra.run.smithi118.stdout: "req_readdir_latency": { 2024-09-13T17:24:32.960 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.960 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.960 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.960 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.960 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rename_latency": { 2024-09-13T17:24:32.960 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.960 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.960 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.961 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.961 INFO:teuthology.orchestra.run.smithi118.stdout: "req_renamesnap_latency": { 2024-09-13T17:24:32.961 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.961 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.961 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.961 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.961 INFO:teuthology.orchestra.run.smithi118.stdout: "req_snapdiff_latency": { 2024-09-13T17:24:32.961 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.961 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.961 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.961 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.961 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rmdir_latency": { 2024-09-13T17:24:32.961 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.962 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.962 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.962 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.962 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rmsnap_latency": { 2024-09-13T17:24:32.962 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.962 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.962 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.962 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.962 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rmxattr_latency": { 2024-09-13T17:24:32.962 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.962 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.962 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.962 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.962 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setattr_latency": { 2024-09-13T17:24:32.963 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.963 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.963 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.963 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.963 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setdirlayout_latency": { 2024-09-13T17:24:32.963 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.963 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.963 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.963 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.963 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setfilelock_latency": { 2024-09-13T17:24:32.963 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.963 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.963 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.964 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.964 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setlayout_latency": { 2024-09-13T17:24:32.964 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.964 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.964 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.964 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.964 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setxattr_latency": { 2024-09-13T17:24:32.964 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.964 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.964 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.964 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.964 INFO:teuthology.orchestra.run.smithi118.stdout: "req_symlink_latency": { 2024-09-13T17:24:32.964 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.964 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.965 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.965 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.965 INFO:teuthology.orchestra.run.smithi118.stdout: "req_unlink_latency": { 2024-09-13T17:24:32.965 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.965 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.965 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.965 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.965 INFO:teuthology.orchestra.run.smithi118.stdout: "cap_revoke_eviction": 0, 2024-09-13T17:24:32.965 INFO:teuthology.orchestra.run.smithi118.stdout: "cap_acquisition_throttle": 0, 2024-09-13T17:24:32.965 INFO:teuthology.orchestra.run.smithi118.stdout: "req_getvxattr_latency": { 2024-09-13T17:24:32.965 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.965 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.965 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.965 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-13T17:24:32.966 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.966 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_sessions": { 2024-09-13T17:24:32.966 INFO:teuthology.orchestra.run.smithi118.stdout: "session_count": 1, 2024-09-13T17:24:32.966 INFO:teuthology.orchestra.run.smithi118.stdout: "session_add": 4, 2024-09-13T17:24:32.966 INFO:teuthology.orchestra.run.smithi118.stdout: "session_remove": 3, 2024-09-13T17:24:32.966 INFO:teuthology.orchestra.run.smithi118.stdout: "sessions_open": 3, 2024-09-13T17:24:32.966 INFO:teuthology.orchestra.run.smithi118.stdout: "sessions_stale": 0, 2024-09-13T17:24:32.966 INFO:teuthology.orchestra.run.smithi118.stdout: "total_load": 0, 2024-09-13T17:24:32.966 INFO:teuthology.orchestra.run.smithi118.stdout: "average_load": 0, 2024-09-13T17:24:32.966 INFO:teuthology.orchestra.run.smithi118.stdout: "avg_session_uptime": 3802, 2024-09-13T17:24:32.966 INFO:teuthology.orchestra.run.smithi118.stdout: "mdthresh_evicted": 0 2024-09-13T17:24:32.966 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.966 INFO:teuthology.orchestra.run.smithi118.stdout: "mempool": { 2024-09-13T17:24:32.966 INFO:teuthology.orchestra.run.smithi118.stdout: "bloom_filter_bytes": 0, 2024-09-13T17:24:32.967 INFO:teuthology.orchestra.run.smithi118.stdout: "bloom_filter_items": 0, 2024-09-13T17:24:32.967 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T17:24:32.967 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_alloc_items": 0, 2024-09-13T17:24:32.967 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T17:24:32.967 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_data_items": 0, 2024-09-13T17:24:32.967 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T17:24:32.967 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T17:24:32.967 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T17:24:32.967 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T17:24:32.967 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T17:24:32.967 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_other_items": 0, 2024-09-13T17:24:32.967 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T17:24:32.967 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T17:24:32.967 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_extent_bytes": 0, 2024-09-13T17:24:32.968 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_extent_items": 0, 2024-09-13T17:24:32.968 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_blob_bytes": 0, 2024-09-13T17:24:32.968 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_blob_items": 0, 2024-09-13T17:24:32.968 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T17:24:32.968 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T17:24:32.968 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T17:24:32.968 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T17:24:32.968 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T17:24:32.968 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_fsck_items": 0, 2024-09-13T17:24:32.968 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_txc_bytes": 0, 2024-09-13T17:24:32.968 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_txc_items": 0, 2024-09-13T17:24:32.968 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T17:24:32.968 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T17:24:32.969 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_bytes": 0, 2024-09-13T17:24:32.969 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_items": 0, 2024-09-13T17:24:32.969 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_bytes": 0, 2024-09-13T17:24:32.969 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_items": 0, 2024-09-13T17:24:32.969 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T17:24:32.969 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_reader_items": 0, 2024-09-13T17:24:32.969 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T17:24:32.969 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_writer_items": 0, 2024-09-13T17:24:32.969 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_anon_bytes": 206354, 2024-09-13T17:24:32.969 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_anon_items": 62, 2024-09-13T17:24:32.969 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_meta_bytes": 0, 2024-09-13T17:24:32.969 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_meta_items": 0, 2024-09-13T17:24:32.969 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_bytes": 0, 2024-09-13T17:24:32.969 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_items": 0, 2024-09-13T17:24:32.970 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_mapbl_bytes": 0, 2024-09-13T17:24:32.970 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_mapbl_items": 0, 2024-09-13T17:24:32.970 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_pglog_bytes": 0, 2024-09-13T17:24:32.970 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_pglog_items": 0, 2024-09-13T17:24:32.970 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_bytes": 10008, 2024-09-13T17:24:32.970 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_items": 204, 2024-09-13T17:24:32.970 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T17:24:32.970 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_mapping_items": 0, 2024-09-13T17:24:32.970 INFO:teuthology.orchestra.run.smithi118.stdout: "pgmap_bytes": 0, 2024-09-13T17:24:32.970 INFO:teuthology.orchestra.run.smithi118.stdout: "pgmap_items": 0, 2024-09-13T17:24:32.970 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_co_bytes": 7353773, 2024-09-13T17:24:32.970 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_co_items": 65179, 2024-09-13T17:24:32.970 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_1_bytes": 0, 2024-09-13T17:24:32.970 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_1_items": 0, 2024-09-13T17:24:32.971 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_2_bytes": 0, 2024-09-13T17:24:32.971 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_2_items": 0 2024-09-13T17:24:32.971 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.971 INFO:teuthology.orchestra.run.smithi118.stdout: "objecter": { 2024-09-13T17:24:32.971 INFO:teuthology.orchestra.run.smithi118.stdout: "op_active": 0, 2024-09-13T17:24:32.971 INFO:teuthology.orchestra.run.smithi118.stdout: "op_laggy": 0, 2024-09-13T17:24:32.971 INFO:teuthology.orchestra.run.smithi118.stdout: "op_send": 2287, 2024-09-13T17:24:32.971 INFO:teuthology.orchestra.run.smithi118.stdout: "op_send_bytes": 21, 2024-09-13T17:24:32.971 INFO:teuthology.orchestra.run.smithi118.stdout: "op_resend": 3, 2024-09-13T17:24:32.971 INFO:teuthology.orchestra.run.smithi118.stdout: "op_reply": 2287, 2024-09-13T17:24:32.971 INFO:teuthology.orchestra.run.smithi118.stdout: "op_latency": { 2024-09-13T17:24:32.971 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 2287, 2024-09-13T17:24:32.971 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 1.283969668, 2024-09-13T17:24:32.971 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000561420 2024-09-13T17:24:32.971 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.972 INFO:teuthology.orchestra.run.smithi118.stdout: "op_inflight": 0, 2024-09-13T17:24:32.972 INFO:teuthology.orchestra.run.smithi118.stdout: "oplen_avg": { 2024-09-13T17:24:32.972 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 2287, 2024-09-13T17:24:32.972 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 2288 2024-09-13T17:24:32.972 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.972 INFO:teuthology.orchestra.run.smithi118.stdout: "op": 2287, 2024-09-13T17:24:32.972 INFO:teuthology.orchestra.run.smithi118.stdout: "op_r": 2287, 2024-09-13T17:24:32.972 INFO:teuthology.orchestra.run.smithi118.stdout: "op_w": 0, 2024-09-13T17:24:32.972 INFO:teuthology.orchestra.run.smithi118.stdout: "op_rmw": 0, 2024-09-13T17:24:32.972 INFO:teuthology.orchestra.run.smithi118.stdout: "op_pg": 0, 2024-09-13T17:24:32.972 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_stat": 1450, 2024-09-13T17:24:32.972 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_create": 0, 2024-09-13T17:24:32.972 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_read": 835, 2024-09-13T17:24:32.972 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_write": 0, 2024-09-13T17:24:32.973 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_writefull": 0, 2024-09-13T17:24:32.973 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_writesame": 0, 2024-09-13T17:24:32.973 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_append": 0, 2024-09-13T17:24:32.973 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_zero": 0, 2024-09-13T17:24:32.973 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_truncate": 0, 2024-09-13T17:24:32.973 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_delete": 0, 2024-09-13T17:24:32.973 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_mapext": 0, 2024-09-13T17:24:32.973 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_sparse_read": 0, 2024-09-13T17:24:32.973 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_clonerange": 0, 2024-09-13T17:24:32.973 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_getxattr": 1, 2024-09-13T17:24:32.973 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_setxattr": 0, 2024-09-13T17:24:32.973 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_cmpxattr": 0, 2024-09-13T17:24:32.973 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_rmxattr": 0, 2024-09-13T17:24:32.973 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_resetxattrs": 0, 2024-09-13T17:24:32.974 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_call": 0, 2024-09-13T17:24:32.974 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_watch": 0, 2024-09-13T17:24:32.974 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_notify": 0, 2024-09-13T17:24:32.974 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T17:24:32.974 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_pgls": 0, 2024-09-13T17:24:32.974 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_pgls_filter": 0, 2024-09-13T17:24:32.974 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_other": 0, 2024-09-13T17:24:32.974 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_active": 0, 2024-09-13T17:24:32.974 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_send": 0, 2024-09-13T17:24:32.974 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_resend": 0, 2024-09-13T17:24:32.974 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_ping": 0, 2024-09-13T17:24:32.974 INFO:teuthology.orchestra.run.smithi118.stdout: "poolop_active": 0, 2024-09-13T17:24:32.974 INFO:teuthology.orchestra.run.smithi118.stdout: "poolop_send": 0, 2024-09-13T17:24:32.974 INFO:teuthology.orchestra.run.smithi118.stdout: "poolop_resend": 0, 2024-09-13T17:24:32.975 INFO:teuthology.orchestra.run.smithi118.stdout: "poolstat_active": 0, 2024-09-13T17:24:32.975 INFO:teuthology.orchestra.run.smithi118.stdout: "poolstat_send": 0, 2024-09-13T17:24:32.975 INFO:teuthology.orchestra.run.smithi118.stdout: "poolstat_resend": 0, 2024-09-13T17:24:32.975 INFO:teuthology.orchestra.run.smithi118.stdout: "statfs_active": 0, 2024-09-13T17:24:32.975 INFO:teuthology.orchestra.run.smithi118.stdout: "statfs_send": 0, 2024-09-13T17:24:32.975 INFO:teuthology.orchestra.run.smithi118.stdout: "statfs_resend": 0, 2024-09-13T17:24:32.975 INFO:teuthology.orchestra.run.smithi118.stdout: "command_active": 0, 2024-09-13T17:24:32.975 INFO:teuthology.orchestra.run.smithi118.stdout: "command_send": 0, 2024-09-13T17:24:32.975 INFO:teuthology.orchestra.run.smithi118.stdout: "command_resend": 0, 2024-09-13T17:24:32.975 INFO:teuthology.orchestra.run.smithi118.stdout: "map_epoch": 104, 2024-09-13T17:24:32.975 INFO:teuthology.orchestra.run.smithi118.stdout: "map_full": 0, 2024-09-13T17:24:32.975 INFO:teuthology.orchestra.run.smithi118.stdout: "map_inc": 15, 2024-09-13T17:24:32.975 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_sessions": 7, 2024-09-13T17:24:32.975 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_session_open": 7, 2024-09-13T17:24:32.976 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_session_close": 0, 2024-09-13T17:24:32.976 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_laggy": 0, 2024-09-13T17:24:32.976 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_wr": 0, 2024-09-13T17:24:32.976 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_rd": 2, 2024-09-13T17:24:32.976 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_del": 0 2024-09-13T17:24:32.976 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.976 INFO:teuthology.orchestra.run.smithi118.stdout: "oft": { 2024-09-13T17:24:32.976 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_objs": 0, 2024-09-13T17:24:32.976 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_kv_pairs": 0, 2024-09-13T17:24:32.976 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_updates": 0, 2024-09-13T17:24:32.976 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_removes": 0 2024-09-13T17:24:32.976 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.976 INFO:teuthology.orchestra.run.smithi118.stdout: "osd-slow-ops": { 2024-09-13T17:24:32.976 INFO:teuthology.orchestra.run.smithi118.stdout: "slow_ops_count": 0 2024-09-13T17:24:32.977 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.977 INFO:teuthology.orchestra.run.smithi118.stdout: "purge_queue": { 2024-09-13T17:24:32.977 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing_ops": 0, 2024-09-13T17:24:32.977 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing_ops_high_water": 0, 2024-09-13T17:24:32.977 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing": 0, 2024-09-13T17:24:32.977 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing_high_water": 0, 2024-09-13T17:24:32.977 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executed_ops": 0, 2024-09-13T17:24:32.977 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executed": 0, 2024-09-13T17:24:32.977 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_item_in_journal": 0 2024-09-13T17:24:32.977 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.977 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T17:24:32.977 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2024-09-13T17:24:32.977 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 104857600, 2024-09-13T17:24:32.977 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2024-09-13T17:24:32.978 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 2549, 2024-09-13T17:24:32.978 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 40927070, 2024-09-13T17:24:32.978 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:32.978 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 2549, 2024-09-13T17:24:32.978 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 0, 2024-09-13T17:24:32.978 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 0, 2024-09-13T17:24:32.978 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 2549, 2024-09-13T17:24:32.978 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 40927070, 2024-09-13T17:24:32.978 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2024-09-13T17:24:32.978 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.978 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.978 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.978 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-13T17:24:32.978 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.978 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-objecter_bytes": { 2024-09-13T17:24:32.979 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2024-09-13T17:24:32.979 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 104857600, 2024-09-13T17:24:32.979 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2024-09-13T17:24:32.979 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 0, 2024-09-13T17:24:32.979 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 0, 2024-09-13T17:24:32.979 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:32.979 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 0, 2024-09-13T17:24:32.979 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 2287, 2024-09-13T17:24:32.979 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 38880286, 2024-09-13T17:24:32.979 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 2287, 2024-09-13T17:24:32.979 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 38880286, 2024-09-13T17:24:32.979 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2024-09-13T17:24:32.979 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.979 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.980 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.980 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-13T17:24:32.980 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.980 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-objecter_ops": { 2024-09-13T17:24:32.980 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2024-09-13T17:24:32.980 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 1024, 2024-09-13T17:24:32.980 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2024-09-13T17:24:32.980 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 0, 2024-09-13T17:24:32.980 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 0, 2024-09-13T17:24:32.980 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:32.980 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 0, 2024-09-13T17:24:32.980 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 2287, 2024-09-13T17:24:32.980 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 2287, 2024-09-13T17:24:32.981 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 2287, 2024-09-13T17:24:32.981 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 2287, 2024-09-13T17:24:32.981 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2024-09-13T17:24:32.981 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.981 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.981 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.981 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-13T17:24:32.981 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.981 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-write_buf_throttle": { 2024-09-13T17:24:32.981 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2024-09-13T17:24:32.981 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 3758096384, 2024-09-13T17:24:32.981 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2024-09-13T17:24:32.981 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 0, 2024-09-13T17:24:32.981 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 0, 2024-09-13T17:24:32.982 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:32.982 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 0, 2024-09-13T17:24:32.982 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 0, 2024-09-13T17:24:32.982 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 0, 2024-09-13T17:24:32.982 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 0, 2024-09-13T17:24:32.982 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 0, 2024-09-13T17:24:32.982 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2024-09-13T17:24:32.982 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.982 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.982 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.982 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-13T17:24:32.982 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:32.982 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-write_buf_throttle-0x55b859aba820": { 2024-09-13T17:24:32.982 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2024-09-13T17:24:32.983 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 3758096384, 2024-09-13T17:24:32.983 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2024-09-13T17:24:32.983 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 0, 2024-09-13T17:24:32.983 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 0, 2024-09-13T17:24:32.983 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:32.983 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 0, 2024-09-13T17:24:32.983 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 0, 2024-09-13T17:24:32.983 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 0, 2024-09-13T17:24:32.983 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 0, 2024-09-13T17:24:32.983 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 0, 2024-09-13T17:24:32.983 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2024-09-13T17:24:32.983 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:32.983 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:32.983 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:32.984 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-13T17:24:32.984 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-13T17:24:32.984 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-13T17:24:33.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:32 smithi087 ceph-mon[30934]: pgmap v334: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:24:33.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:32 smithi149 ceph-mon[35496]: pgmap v334: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:24:33.362 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:32 smithi118 ceph-mon[34374]: pgmap v334: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:24:33.739 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-13T17:24:33.740 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-13T17:24:33.740 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-09-13T17:24:33.740 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2024-09-13T17:24:33.740 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=0 2024-09-13T17:24:33.740 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-13T17:24:33.740 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-13T17:24:33.740 DEBUG:tasks.check_counter:Getting stats from k 2024-09-13T17:24:33.740 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-13T17:24:33.941 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T17:24:35.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:34 smithi118 ceph-mon[34374]: pgmap v335: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:24:35.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:34 smithi087 ceph-mon[30934]: pgmap v335: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:24:35.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:34 smithi149 ceph-mon[35496]: pgmap v335: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:24:35.781 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-09-13T17:24:35.781 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T17:24:35.781 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 237, 2024-09-13T17:24:35.781 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 224, 2024-09-13T17:24:35.781 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 1565152, 2024-09-13T17:24:35.782 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 126880, 2024-09-13T17:24:35.782 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 4, 2024-09-13T17:24:35.782 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 0, 2024-09-13T17:24:35.782 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 0.046853329, 2024-09-13T17:24:35.782 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 0.014762981, 2024-09-13T17:24:35.782 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 0.045351464, 2024-09-13T17:24:35.782 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:24:35.782 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:35.782 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 224, 2024-09-13T17:24:35.782 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.018229235, 2024-09-13T17:24:35.783 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000081380 2024-09-13T17:24:35.783 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:35.783 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:35.783 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:35.783 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:35.783 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:35.783 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:35.783 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 1565152, 2024-09-13T17:24:35.783 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 126880 2024-09-13T17:24:35.783 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:35.783 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T17:24:35.783 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 2, 2024-09-13T17:24:35.783 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 170, 2024-09-13T17:24:35.783 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 320, 2024-09-13T17:24:35.784 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 182256, 2024-09-13T17:24:35.784 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 5, 2024-09-13T17:24:35.784 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 3, 2024-09-13T17:24:35.784 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 0.012090002, 2024-09-13T17:24:35.784 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 0.008250843, 2024-09-13T17:24:35.784 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 0.001608880, 2024-09-13T17:24:35.784 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:24:35.784 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:35.784 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 167, 2024-09-13T17:24:35.784 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.014888545, 2024-09-13T17:24:35.784 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000089152 2024-09-13T17:24:35.784 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:35.784 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:35.785 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:35.785 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:35.785 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:35.785 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:35.785 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-13T17:24:35.785 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 182256 2024-09-13T17:24:35.785 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:35.785 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T17:24:35.785 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 0, 2024-09-13T17:24:35.785 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 2, 2024-09-13T17:24:35.785 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 0, 2024-09-13T17:24:35.785 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 0, 2024-09-13T17:24:35.785 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 2, 2024-09-13T17:24:35.786 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 1, 2024-09-13T17:24:35.786 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 0.000379184, 2024-09-13T17:24:35.786 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 0.000000000, 2024-09-13T17:24:35.786 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 0.000306620, 2024-09-13T17:24:35.786 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T17:24:35.786 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:35.786 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:35.786 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:35.786 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:35.786 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:35.786 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:35.786 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:35.786 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:35.786 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:35.787 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:35.787 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T17:24:35.787 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T17:24:35.787 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:35.787 INFO:teuthology.orchestra.run.smithi118.stdout: "cct": { 2024-09-13T17:24:35.787 INFO:teuthology.orchestra.run.smithi118.stdout: "total_workers": 0, 2024-09-13T17:24:35.787 INFO:teuthology.orchestra.run.smithi118.stdout: "unhealthy_workers": 0 2024-09-13T17:24:35.787 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:35.787 INFO:teuthology.orchestra.run.smithi118.stdout: "mempool": { 2024-09-13T17:24:35.787 INFO:teuthology.orchestra.run.smithi118.stdout: "bloom_filter_bytes": 0, 2024-09-13T17:24:35.787 INFO:teuthology.orchestra.run.smithi118.stdout: "bloom_filter_items": 0, 2024-09-13T17:24:35.787 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T17:24:35.787 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_alloc_items": 0, 2024-09-13T17:24:35.787 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T17:24:35.788 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_data_items": 0, 2024-09-13T17:24:35.788 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T17:24:35.788 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T17:24:35.788 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T17:24:35.788 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T17:24:35.788 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T17:24:35.788 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_other_items": 0, 2024-09-13T17:24:35.788 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T17:24:35.788 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T17:24:35.789 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_extent_bytes": 0, 2024-09-13T17:24:35.789 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_extent_items": 0, 2024-09-13T17:24:35.789 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_blob_bytes": 0, 2024-09-13T17:24:35.789 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_blob_items": 0, 2024-09-13T17:24:35.789 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T17:24:35.789 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T17:24:35.789 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T17:24:35.789 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T17:24:35.789 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T17:24:35.789 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_fsck_items": 0, 2024-09-13T17:24:35.789 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_txc_bytes": 0, 2024-09-13T17:24:35.789 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_txc_items": 0, 2024-09-13T17:24:35.790 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T17:24:35.790 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T17:24:35.790 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_bytes": 0, 2024-09-13T17:24:35.790 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_items": 0, 2024-09-13T17:24:35.790 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_bytes": 0, 2024-09-13T17:24:35.790 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_items": 0, 2024-09-13T17:24:35.790 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T17:24:35.790 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_reader_items": 0, 2024-09-13T17:24:35.790 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T17:24:35.790 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_writer_items": 0, 2024-09-13T17:24:35.790 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_anon_bytes": 148977, 2024-09-13T17:24:35.790 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_anon_items": 30, 2024-09-13T17:24:35.790 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_meta_bytes": 0, 2024-09-13T17:24:35.790 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_meta_items": 0, 2024-09-13T17:24:35.790 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_bytes": 0, 2024-09-13T17:24:35.791 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_items": 0, 2024-09-13T17:24:35.791 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_mapbl_bytes": 0, 2024-09-13T17:24:35.791 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_mapbl_items": 0, 2024-09-13T17:24:35.791 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_pglog_bytes": 0, 2024-09-13T17:24:35.791 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_pglog_items": 0, 2024-09-13T17:24:35.791 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_bytes": 0, 2024-09-13T17:24:35.791 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_items": 0, 2024-09-13T17:24:35.791 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T17:24:35.791 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_mapping_items": 0, 2024-09-13T17:24:35.791 INFO:teuthology.orchestra.run.smithi118.stdout: "pgmap_bytes": 0, 2024-09-13T17:24:35.791 INFO:teuthology.orchestra.run.smithi118.stdout: "pgmap_items": 0, 2024-09-13T17:24:35.791 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_co_bytes": 928, 2024-09-13T17:24:35.791 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_co_items": 2, 2024-09-13T17:24:35.791 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_1_bytes": 0, 2024-09-13T17:24:35.792 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_1_items": 0, 2024-09-13T17:24:35.792 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_2_bytes": 0, 2024-09-13T17:24:35.792 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_2_items": 0 2024-09-13T17:24:35.792 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-09-13T17:24:35.792 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T17:24:35.792 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2024-09-13T17:24:35.792 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 104857600, 2024-09-13T17:24:35.792 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2024-09-13T17:24:35.792 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 235, 2024-09-13T17:24:35.792 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 1529276, 2024-09-13T17:24:35.792 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:35.792 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 235, 2024-09-13T17:24:35.792 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 0, 2024-09-13T17:24:35.793 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 0, 2024-09-13T17:24:35.793 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 235, 2024-09-13T17:24:35.793 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 1529276, 2024-09-13T17:24:35.793 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2024-09-13T17:24:35.793 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2024-09-13T17:24:35.793 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2024-09-13T17:24:35.793 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2024-09-13T17:24:35.793 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-13T17:24:35.793 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-09-13T17:24:35.793 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-09-13T17:24:36.606 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-13T17:24:36.606 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-13T17:24:36.607 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-09-13T17:24:36.607 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-09-13T17:24:36.607 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-09-13T17:24:36.607 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-09-13T17:24:36.607 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-09-13T17:24:36.607 DEBUG:tasks.check_counter:Getting stats from c 2024-09-13T17:24:36.607 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-13T17:24:36.818 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T17:24:37.198 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:36 smithi149 ceph-mon[35496]: pgmap v336: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:24:37.228 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:36 smithi087 ceph-mon[30934]: pgmap v336: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:24:37.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:36 smithi118 ceph-mon[34374]: pgmap v336: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:24:38.614 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-13T17:24:38.614 INFO:teuthology.orchestra.run.smithi149.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T17:24:38.614 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_messages": 4843, 2024-09-13T17:24:38.614 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages": 4980, 2024-09-13T17:24:38.614 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_bytes": 1406750, 2024-09-13T17:24:38.614 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_bytes": 27341220, 2024-09-13T17:24:38.614 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_created_connections": 51, 2024-09-13T17:24:38.615 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_active_connections": 6, 2024-09-13T17:24:38.615 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_total_time": 0.435170669, 2024-09-13T17:24:38.615 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_send_time": 0.167718165, 2024-09-13T17:24:38.615 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_recv_time": 0.097743603, 2024-09-13T17:24:38.615 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_fast_dispatch_time": 0.128478940, 2024-09-13T17:24:38.615 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:38.615 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 4975, 2024-09-13T17:24:38.615 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.477890227, 2024-09-13T17:24:38.615 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000096058 2024-09-13T17:24:38.615 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.615 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:38.615 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 58, 2024-09-13T17:24:38.615 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000005390, 2024-09-13T17:24:38.616 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000092 2024-09-13T17:24:38.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.616 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_encrypted_bytes": 2672, 2024-09-13T17:24:38.616 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_encrypted_bytes": 317264 2024-09-13T17:24:38.616 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.616 INFO:teuthology.orchestra.run.smithi149.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T17:24:38.616 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_messages": 49492, 2024-09-13T17:24:38.616 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages": 67512, 2024-09-13T17:24:38.616 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_bytes": 20622146, 2024-09-13T17:24:38.616 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_bytes": 35593612, 2024-09-13T17:24:38.616 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_created_connections": 9, 2024-09-13T17:24:38.616 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_active_connections": 5, 2024-09-13T17:24:38.616 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_total_time": 2.894757111, 2024-09-13T17:24:38.617 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_send_time": 1.329019107, 2024-09-13T17:24:38.617 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_recv_time": 1.836168055, 2024-09-13T17:24:38.617 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_fast_dispatch_time": 0.091512324, 2024-09-13T17:24:38.617 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:38.617 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 67512, 2024-09-13T17:24:38.617 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 5.600007450, 2024-09-13T17:24:38.617 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000082948 2024-09-13T17:24:38.617 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.617 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:38.617 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 103069, 2024-09-13T17:24:38.617 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.015570771, 2024-09-13T17:24:38.617 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000151 2024-09-13T17:24:38.617 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.617 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-13T17:24:38.618 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_encrypted_bytes": 127680 2024-09-13T17:24:38.618 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.618 INFO:teuthology.orchestra.run.smithi149.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T17:24:38.618 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_messages": 7365, 2024-09-13T17:24:38.618 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages": 7344, 2024-09-13T17:24:38.618 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_bytes": 4348230, 2024-09-13T17:24:38.618 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_bytes": 10399206, 2024-09-13T17:24:38.618 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_created_connections": 15, 2024-09-13T17:24:38.618 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_active_connections": 5, 2024-09-13T17:24:38.618 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_total_time": 0.609732062, 2024-09-13T17:24:38.618 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_send_time": 0.235634039, 2024-09-13T17:24:38.619 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_recv_time": 0.168317528, 2024-09-13T17:24:38.619 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_fast_dispatch_time": 0.175610594, 2024-09-13T17:24:38.619 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:38.619 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 7344, 2024-09-13T17:24:38.619 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.675539016, 2024-09-13T17:24:38.619 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000091985 2024-09-13T17:24:38.619 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.619 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:38.619 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 23, 2024-09-13T17:24:38.619 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000003146, 2024-09-13T17:24:38.620 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000136 2024-09-13T17:24:38.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.620 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_encrypted_bytes": 1653504, 2024-09-13T17:24:38.620 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_encrypted_bytes": 140032 2024-09-13T17:24:38.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.620 INFO:teuthology.orchestra.run.smithi149.stdout: "cct": { 2024-09-13T17:24:38.620 INFO:teuthology.orchestra.run.smithi149.stdout: "total_workers": 1, 2024-09-13T17:24:38.620 INFO:teuthology.orchestra.run.smithi149.stdout: "unhealthy_workers": 0 2024-09-13T17:24:38.620 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.620 INFO:teuthology.orchestra.run.smithi149.stdout: "finisher-MDSRank": { 2024-09-13T17:24:38.620 INFO:teuthology.orchestra.run.smithi149.stdout: "queue_len": 0, 2024-09-13T17:24:38.620 INFO:teuthology.orchestra.run.smithi149.stdout: "complete_latency": { 2024-09-13T17:24:38.620 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 4846, 2024-09-13T17:24:38.621 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 5.849147659, 2024-09-13T17:24:38.621 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.001207005 2024-09-13T17:24:38.621 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:38.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.621 INFO:teuthology.orchestra.run.smithi149.stdout: "finisher-PurgeQueue": { 2024-09-13T17:24:38.621 INFO:teuthology.orchestra.run.smithi149.stdout: "queue_len": 0, 2024-09-13T17:24:38.621 INFO:teuthology.orchestra.run.smithi149.stdout: "complete_latency": { 2024-09-13T17:24:38.621 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 7416, 2024-09-13T17:24:38.621 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 1.003494520, 2024-09-13T17:24:38.621 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000135314 2024-09-13T17:24:38.621 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:38.621 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.621 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": { 2024-09-13T17:24:38.621 INFO:teuthology.orchestra.run.smithi149.stdout: "request": 9433, 2024-09-13T17:24:38.622 INFO:teuthology.orchestra.run.smithi149.stdout: "reply": 8552, 2024-09-13T17:24:38.622 INFO:teuthology.orchestra.run.smithi149.stdout: "reply_latency": { 2024-09-13T17:24:38.622 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 8552, 2024-09-13T17:24:38.622 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 14.733165844, 2024-09-13T17:24:38.622 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.001722774 2024-09-13T17:24:38.622 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.622 INFO:teuthology.orchestra.run.smithi149.stdout: "slow_reply": 0, 2024-09-13T17:24:38.622 INFO:teuthology.orchestra.run.smithi149.stdout: "forward": 881, 2024-09-13T17:24:38.622 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_fetch_complete": 0, 2024-09-13T17:24:38.622 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_fetch_keys": 0, 2024-09-13T17:24:38.622 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_commit": 27, 2024-09-13T17:24:38.622 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_split": 2, 2024-09-13T17:24:38.622 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_merge": 0, 2024-09-13T17:24:38.622 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes": 1954, 2024-09-13T17:24:38.623 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_top": 199, 2024-09-13T17:24:38.623 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_bottom": 156, 2024-09-13T17:24:38.623 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_pin_tail": 1599, 2024-09-13T17:24:38.623 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_pinned": 1667, 2024-09-13T17:24:38.623 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_expired": 2959, 2024-09-13T17:24:38.623 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_with_caps": 3, 2024-09-13T17:24:38.623 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": 3, 2024-09-13T17:24:38.623 INFO:teuthology.orchestra.run.smithi149.stdout: "subtrees": 4, 2024-09-13T17:24:38.623 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse": 14152, 2024-09-13T17:24:38.623 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_hit": 10538, 2024-09-13T17:24:38.623 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_forward": 862, 2024-09-13T17:24:38.623 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_discover": 411, 2024-09-13T17:24:38.624 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_dir_fetch": 0, 2024-09-13T17:24:38.624 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_remote_ino": 0, 2024-09-13T17:24:38.624 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_lock": 0, 2024-09-13T17:24:38.624 INFO:teuthology.orchestra.run.smithi149.stdout: "load_cent": 0, 2024-09-13T17:24:38.624 INFO:teuthology.orchestra.run.smithi149.stdout: "q": 0, 2024-09-13T17:24:38.624 INFO:teuthology.orchestra.run.smithi149.stdout: "exported": 24, 2024-09-13T17:24:38.624 INFO:teuthology.orchestra.run.smithi149.stdout: "exported_inodes": 1970, 2024-09-13T17:24:38.624 INFO:teuthology.orchestra.run.smithi149.stdout: "imported": 27, 2024-09-13T17:24:38.624 INFO:teuthology.orchestra.run.smithi149.stdout: "imported_inodes": 4097, 2024-09-13T17:24:38.624 INFO:teuthology.orchestra.run.smithi149.stdout: "openino_dir_fetch": 0, 2024-09-13T17:24:38.624 INFO:teuthology.orchestra.run.smithi149.stdout: "openino_backtrace_fetch": 3797, 2024-09-13T17:24:38.624 INFO:teuthology.orchestra.run.smithi149.stdout: "openino_peer_discover": 0, 2024-09-13T17:24:38.624 INFO:teuthology.orchestra.run.smithi149.stdout: "root_rfiles": 4, 2024-09-13T17:24:38.625 INFO:teuthology.orchestra.run.smithi149.stdout: "root_rbytes": 234, 2024-09-13T17:24:38.625 INFO:teuthology.orchestra.run.smithi149.stdout: "root_rsnaps": 6, 2024-09-13T17:24:38.625 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_backtrace_fetch": 3797, 2024-09-13T17:24:38.625 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_set_tag": 0, 2024-09-13T17:24:38.625 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T17:24:38.625 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_inotable_repaired": 0, 2024-09-13T17:24:38.625 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_dir_inodes": 235, 2024-09-13T17:24:38.625 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T17:24:38.625 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_dirfrag_rstats": 235, 2024-09-13T17:24:38.625 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_file_inodes": 3562, 2024-09-13T17:24:38.625 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_inode_file_caps": 46, 2024-09-13T17:24:38.625 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_cap_op_revoke": 1055, 2024-09-13T17:24:38.625 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_cap_op_grant": 7266, 2024-09-13T17:24:38.625 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T17:24:38.626 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T17:24:38.626 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T17:24:38.626 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_client_caps": 6622, 2024-09-13T17:24:38.626 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_client_caps_dirty": 3268, 2024-09-13T17:24:38.626 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_client_cap_release": 81, 2024-09-13T17:24:38.626 INFO:teuthology.orchestra.run.smithi149.stdout: "process_request_cap_release": 11357 2024-09-13T17:24:38.626 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.626 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_cache": { 2024-09-13T17:24:38.626 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_update": 485, 2024-09-13T17:24:38.626 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_update_receipt": 1355, 2024-09-13T17:24:38.626 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_try_discover": 879, 2024-09-13T17:24:38.626 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_send_discover": 940, 2024-09-13T17:24:38.626 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_handle_discover": 889, 2024-09-13T17:24:38.626 INFO:teuthology.orchestra.run.smithi149.stdout: "num_strays": 136, 2024-09-13T17:24:38.627 INFO:teuthology.orchestra.run.smithi149.stdout: "num_strays_delayed": 0, 2024-09-13T17:24:38.627 INFO:teuthology.orchestra.run.smithi149.stdout: "num_strays_enqueuing": 0, 2024-09-13T17:24:38.627 INFO:teuthology.orchestra.run.smithi149.stdout: "strays_created": 4784, 2024-09-13T17:24:38.627 INFO:teuthology.orchestra.run.smithi149.stdout: "strays_enqueued": 4648, 2024-09-13T17:24:38.627 INFO:teuthology.orchestra.run.smithi149.stdout: "strays_reintegrated": 0, 2024-09-13T17:24:38.627 INFO:teuthology.orchestra.run.smithi149.stdout: "strays_migrated": 0, 2024-09-13T17:24:38.627 INFO:teuthology.orchestra.run.smithi149.stdout: "num_recovering_processing": 0, 2024-09-13T17:24:38.627 INFO:teuthology.orchestra.run.smithi149.stdout: "num_recovering_enqueued": 0, 2024-09-13T17:24:38.627 INFO:teuthology.orchestra.run.smithi149.stdout: "num_recovering_prioritized": 0, 2024-09-13T17:24:38.627 INFO:teuthology.orchestra.run.smithi149.stdout: "recovery_started": 0, 2024-09-13T17:24:38.627 INFO:teuthology.orchestra.run.smithi149.stdout: "recovery_completed": 0, 2024-09-13T17:24:38.627 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T17:24:38.627 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_exportdir": 26, 2024-09-13T17:24:38.627 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_flush": 0, 2024-09-13T17:24:38.628 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_fragmentdir": 2, 2024-09-13T17:24:38.628 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_fragstats": 0, 2024-09-13T17:24:38.628 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_inodestats": 0 2024-09-13T17:24:38.628 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.628 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_log": { 2024-09-13T17:24:38.628 INFO:teuthology.orchestra.run.smithi149.stdout: "evadd": 16512, 2024-09-13T17:24:38.628 INFO:teuthology.orchestra.run.smithi149.stdout: "evex": 0, 2024-09-13T17:24:38.628 INFO:teuthology.orchestra.run.smithi149.stdout: "evtrm": 0, 2024-09-13T17:24:38.628 INFO:teuthology.orchestra.run.smithi149.stdout: "ev": 16512, 2024-09-13T17:24:38.628 INFO:teuthology.orchestra.run.smithi149.stdout: "evexg": 0, 2024-09-13T17:24:38.628 INFO:teuthology.orchestra.run.smithi149.stdout: "evexd": 0, 2024-09-13T17:24:38.628 INFO:teuthology.orchestra.run.smithi149.stdout: "segadd": 24, 2024-09-13T17:24:38.628 INFO:teuthology.orchestra.run.smithi149.stdout: "segex": 0, 2024-09-13T17:24:38.628 INFO:teuthology.orchestra.run.smithi149.stdout: "segtrm": 0, 2024-09-13T17:24:38.629 INFO:teuthology.orchestra.run.smithi149.stdout: "seg": 24, 2024-09-13T17:24:38.629 INFO:teuthology.orchestra.run.smithi149.stdout: "segexg": 0, 2024-09-13T17:24:38.629 INFO:teuthology.orchestra.run.smithi149.stdout: "segexd": 0, 2024-09-13T17:24:38.629 INFO:teuthology.orchestra.run.smithi149.stdout: "expos": 4194304, 2024-09-13T17:24:38.629 INFO:teuthology.orchestra.run.smithi149.stdout: "wrpos": 43072667, 2024-09-13T17:24:38.629 INFO:teuthology.orchestra.run.smithi149.stdout: "rdpos": 0, 2024-09-13T17:24:38.629 INFO:teuthology.orchestra.run.smithi149.stdout: "jlat": { 2024-09-13T17:24:38.629 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 1390, 2024-09-13T17:24:38.629 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 5.584827146, 2024-09-13T17:24:38.629 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.004017861 2024-09-13T17:24:38.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.629 INFO:teuthology.orchestra.run.smithi149.stdout: "replayed": 0 2024-09-13T17:24:38.629 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.629 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_mem": { 2024-09-13T17:24:38.629 INFO:teuthology.orchestra.run.smithi149.stdout: "ino": 891, 2024-09-13T17:24:38.630 INFO:teuthology.orchestra.run.smithi149.stdout: "ino+": 7644, 2024-09-13T17:24:38.630 INFO:teuthology.orchestra.run.smithi149.stdout: "ino-": 6753, 2024-09-13T17:24:38.630 INFO:teuthology.orchestra.run.smithi149.stdout: "dir": 184, 2024-09-13T17:24:38.630 INFO:teuthology.orchestra.run.smithi149.stdout: "dir+": 829, 2024-09-13T17:24:38.630 INFO:teuthology.orchestra.run.smithi149.stdout: "dir-": 645, 2024-09-13T17:24:38.630 INFO:teuthology.orchestra.run.smithi149.stdout: "dn": 1954, 2024-09-13T17:24:38.630 INFO:teuthology.orchestra.run.smithi149.stdout: "dn+": 11315, 2024-09-13T17:24:38.630 INFO:teuthology.orchestra.run.smithi149.stdout: "dn-": 9361, 2024-09-13T17:24:38.630 INFO:teuthology.orchestra.run.smithi149.stdout: "cap": 3, 2024-09-13T17:24:38.630 INFO:teuthology.orchestra.run.smithi149.stdout: "cap+": 5833, 2024-09-13T17:24:38.630 INFO:teuthology.orchestra.run.smithi149.stdout: "cap-": 5830, 2024-09-13T17:24:38.630 INFO:teuthology.orchestra.run.smithi149.stdout: "rss": 81408, 2024-09-13T17:24:38.630 INFO:teuthology.orchestra.run.smithi149.stdout: "heap": 198932 2024-09-13T17:24:38.630 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.631 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_server": { 2024-09-13T17:24:38.631 INFO:teuthology.orchestra.run.smithi149.stdout: "dispatch_client_request": 14495, 2024-09-13T17:24:38.631 INFO:teuthology.orchestra.run.smithi149.stdout: "dispatch_server_request": 536, 2024-09-13T17:24:38.631 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_client_request": 9433, 2024-09-13T17:24:38.631 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_client_session": 33, 2024-09-13T17:24:38.631 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_peer_request": 1621, 2024-09-13T17:24:38.631 INFO:teuthology.orchestra.run.smithi149.stdout: "req_create_latency": { 2024-09-13T17:24:38.631 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 1776, 2024-09-13T17:24:38.631 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 1.817562346, 2024-09-13T17:24:38.631 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.001023402 2024-09-13T17:24:38.631 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.631 INFO:teuthology.orchestra.run.smithi149.stdout: "req_getattr_latency": { 2024-09-13T17:24:38.631 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 6, 2024-09-13T17:24:38.631 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.002656648, 2024-09-13T17:24:38.631 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000442774 2024-09-13T17:24:38.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.632 INFO:teuthology.orchestra.run.smithi149.stdout: "req_getfilelock_latency": { 2024-09-13T17:24:38.632 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:38.632 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:38.632 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:38.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.632 INFO:teuthology.orchestra.run.smithi149.stdout: "req_link_latency": { 2024-09-13T17:24:38.632 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:38.632 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:38.632 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:38.632 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.632 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookup_latency": { 2024-09-13T17:24:38.632 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 1481, 2024-09-13T17:24:38.632 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.909318447, 2024-09-13T17:24:38.633 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000613989 2024-09-13T17:24:38.633 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.633 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookuphash_latency": { 2024-09-13T17:24:38.633 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:38.633 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:38.633 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:38.633 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.633 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookupino_latency": { 2024-09-13T17:24:38.633 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:38.633 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:38.633 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:38.633 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.633 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookupname_latency": { 2024-09-13T17:24:38.633 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:38.634 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:38.634 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:38.634 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.634 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookupparent_latency": { 2024-09-13T17:24:38.634 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:38.634 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:38.634 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:38.634 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.634 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookupsnap_latency": { 2024-09-13T17:24:38.634 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:38.634 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:38.634 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:38.634 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.634 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lssnap_latency": { 2024-09-13T17:24:38.634 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:38.635 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:38.635 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:38.635 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.635 INFO:teuthology.orchestra.run.smithi149.stdout: "req_mkdir_latency": { 2024-09-13T17:24:38.635 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:38.635 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:38.635 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:38.635 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.636 INFO:teuthology.orchestra.run.smithi149.stdout: "req_mknod_latency": { 2024-09-13T17:24:38.636 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:38.636 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:38.636 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:38.636 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.636 INFO:teuthology.orchestra.run.smithi149.stdout: "req_mksnap_latency": { 2024-09-13T17:24:38.636 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:38.636 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:38.636 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:38.636 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.636 INFO:teuthology.orchestra.run.smithi149.stdout: "req_open_latency": { 2024-09-13T17:24:38.636 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:38.637 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:38.637 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:38.637 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.637 INFO:teuthology.orchestra.run.smithi149.stdout: "req_readdir_latency": { 2024-09-13T17:24:38.637 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 504, 2024-09-13T17:24:38.637 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 2.564518535, 2024-09-13T17:24:38.637 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.005088330 2024-09-13T17:24:38.637 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.637 INFO:teuthology.orchestra.run.smithi149.stdout: "req_rename_latency": { 2024-09-13T17:24:38.637 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:38.637 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:38.637 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:38.637 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.637 INFO:teuthology.orchestra.run.smithi149.stdout: "req_renamesnap_latency": { 2024-09-13T17:24:38.637 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:38.638 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:38.638 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:38.638 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.638 INFO:teuthology.orchestra.run.smithi149.stdout: "req_snapdiff_latency": { 2024-09-13T17:24:38.638 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:38.638 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:38.638 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:38.638 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.638 INFO:teuthology.orchestra.run.smithi149.stdout: "req_rmdir_latency": { 2024-09-13T17:24:38.638 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 245, 2024-09-13T17:24:38.638 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 3.567734972, 2024-09-13T17:24:38.638 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.014562183 2024-09-13T17:24:38.638 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.638 INFO:teuthology.orchestra.run.smithi149.stdout: "req_rmsnap_latency": { 2024-09-13T17:24:38.638 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:38.639 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:38.639 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:38.639 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.639 INFO:teuthology.orchestra.run.smithi149.stdout: "req_rmxattr_latency": { 2024-09-13T17:24:38.639 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:38.639 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:38.639 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:38.639 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.639 INFO:teuthology.orchestra.run.smithi149.stdout: "req_setattr_latency": { 2024-09-13T17:24:38.639 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 1, 2024-09-13T17:24:38.639 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.001077678, 2024-09-13T17:24:38.639 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.001077678 2024-09-13T17:24:38.639 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.639 INFO:teuthology.orchestra.run.smithi149.stdout: "req_setdirlayout_latency": { 2024-09-13T17:24:38.639 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:38.640 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:38.640 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:38.640 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.640 INFO:teuthology.orchestra.run.smithi149.stdout: "req_setfilelock_latency": { 2024-09-13T17:24:38.640 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:38.640 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:38.640 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:38.640 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.640 INFO:teuthology.orchestra.run.smithi149.stdout: "req_setlayout_latency": { 2024-09-13T17:24:38.640 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:38.640 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:38.640 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:38.640 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.640 INFO:teuthology.orchestra.run.smithi149.stdout: "req_setxattr_latency": { 2024-09-13T17:24:38.640 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:38.641 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:38.641 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:38.641 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.641 INFO:teuthology.orchestra.run.smithi149.stdout: "req_symlink_latency": { 2024-09-13T17:24:38.641 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:38.641 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:38.641 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:38.641 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.641 INFO:teuthology.orchestra.run.smithi149.stdout: "req_unlink_latency": { 2024-09-13T17:24:38.641 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 4539, 2024-09-13T17:24:38.641 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 5.870297218, 2024-09-13T17:24:38.641 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.001293301 2024-09-13T17:24:38.641 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.641 INFO:teuthology.orchestra.run.smithi149.stdout: "cap_revoke_eviction": 0, 2024-09-13T17:24:38.642 INFO:teuthology.orchestra.run.smithi149.stdout: "cap_acquisition_throttle": 0, 2024-09-13T17:24:38.642 INFO:teuthology.orchestra.run.smithi149.stdout: "req_getvxattr_latency": { 2024-09-13T17:24:38.642 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:38.642 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:38.642 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:38.642 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:38.642 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.642 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_sessions": { 2024-09-13T17:24:38.642 INFO:teuthology.orchestra.run.smithi149.stdout: "session_count": 1, 2024-09-13T17:24:38.642 INFO:teuthology.orchestra.run.smithi149.stdout: "session_add": 4, 2024-09-13T17:24:38.642 INFO:teuthology.orchestra.run.smithi149.stdout: "session_remove": 3, 2024-09-13T17:24:38.643 INFO:teuthology.orchestra.run.smithi149.stdout: "sessions_open": 1, 2024-09-13T17:24:38.643 INFO:teuthology.orchestra.run.smithi149.stdout: "sessions_stale": 0, 2024-09-13T17:24:38.643 INFO:teuthology.orchestra.run.smithi149.stdout: "total_load": 5381, 2024-09-13T17:24:38.643 INFO:teuthology.orchestra.run.smithi149.stdout: "average_load": 5381, 2024-09-13T17:24:38.643 INFO:teuthology.orchestra.run.smithi149.stdout: "avg_session_uptime": 646, 2024-09-13T17:24:38.643 INFO:teuthology.orchestra.run.smithi149.stdout: "mdthresh_evicted": 0 2024-09-13T17:24:38.643 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.643 INFO:teuthology.orchestra.run.smithi149.stdout: "mempool": { 2024-09-13T17:24:38.643 INFO:teuthology.orchestra.run.smithi149.stdout: "bloom_filter_bytes": 0, 2024-09-13T17:24:38.643 INFO:teuthology.orchestra.run.smithi149.stdout: "bloom_filter_items": 0, 2024-09-13T17:24:38.643 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T17:24:38.643 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_alloc_items": 0, 2024-09-13T17:24:38.643 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T17:24:38.643 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_data_items": 0, 2024-09-13T17:24:38.643 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T17:24:38.644 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T17:24:38.644 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T17:24:38.644 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T17:24:38.644 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T17:24:38.644 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_other_items": 0, 2024-09-13T17:24:38.644 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T17:24:38.644 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T17:24:38.644 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_extent_bytes": 0, 2024-09-13T17:24:38.644 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_extent_items": 0, 2024-09-13T17:24:38.644 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_blob_bytes": 0, 2024-09-13T17:24:38.644 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_blob_items": 0, 2024-09-13T17:24:38.644 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T17:24:38.644 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T17:24:38.644 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T17:24:38.644 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T17:24:38.645 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T17:24:38.645 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_fsck_items": 0, 2024-09-13T17:24:38.645 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_txc_bytes": 0, 2024-09-13T17:24:38.645 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_txc_items": 0, 2024-09-13T17:24:38.645 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T17:24:38.645 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T17:24:38.645 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_writing_bytes": 0, 2024-09-13T17:24:38.645 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_writing_items": 0, 2024-09-13T17:24:38.646 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_bytes": 0, 2024-09-13T17:24:38.646 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_items": 0, 2024-09-13T17:24:38.646 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T17:24:38.646 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_file_reader_items": 0, 2024-09-13T17:24:38.646 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T17:24:38.647 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_file_writer_items": 0, 2024-09-13T17:24:38.647 INFO:teuthology.orchestra.run.smithi149.stdout: "buffer_anon_bytes": 867553, 2024-09-13T17:24:38.647 INFO:teuthology.orchestra.run.smithi149.stdout: "buffer_anon_items": 253, 2024-09-13T17:24:38.647 INFO:teuthology.orchestra.run.smithi149.stdout: "buffer_meta_bytes": 0, 2024-09-13T17:24:38.647 INFO:teuthology.orchestra.run.smithi149.stdout: "buffer_meta_items": 0, 2024-09-13T17:24:38.647 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_bytes": 0, 2024-09-13T17:24:38.647 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_items": 0, 2024-09-13T17:24:38.647 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_mapbl_bytes": 0, 2024-09-13T17:24:38.647 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_mapbl_items": 0, 2024-09-13T17:24:38.647 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_pglog_bytes": 0, 2024-09-13T17:24:38.647 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_pglog_items": 0, 2024-09-13T17:24:38.647 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_bytes": 10008, 2024-09-13T17:24:38.647 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_items": 204, 2024-09-13T17:24:38.647 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T17:24:38.647 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_mapping_items": 0, 2024-09-13T17:24:38.648 INFO:teuthology.orchestra.run.smithi149.stdout: "pgmap_bytes": 0, 2024-09-13T17:24:38.648 INFO:teuthology.orchestra.run.smithi149.stdout: "pgmap_items": 0, 2024-09-13T17:24:38.648 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_co_bytes": 3665396, 2024-09-13T17:24:38.648 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_co_items": 49632, 2024-09-13T17:24:38.648 INFO:teuthology.orchestra.run.smithi149.stdout: "unittest_1_bytes": 0, 2024-09-13T17:24:38.648 INFO:teuthology.orchestra.run.smithi149.stdout: "unittest_1_items": 0, 2024-09-13T17:24:38.648 INFO:teuthology.orchestra.run.smithi149.stdout: "unittest_2_bytes": 0, 2024-09-13T17:24:38.648 INFO:teuthology.orchestra.run.smithi149.stdout: "unittest_2_items": 0 2024-09-13T17:24:38.648 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.648 INFO:teuthology.orchestra.run.smithi149.stdout: "objecter": { 2024-09-13T17:24:38.648 INFO:teuthology.orchestra.run.smithi149.stdout: "op_active": 0, 2024-09-13T17:24:38.648 INFO:teuthology.orchestra.run.smithi149.stdout: "op_laggy": 0, 2024-09-13T17:24:38.648 INFO:teuthology.orchestra.run.smithi149.stdout: "op_send": 14714, 2024-09-13T17:24:38.649 INFO:teuthology.orchestra.run.smithi149.stdout: "op_send_bytes": 39745700, 2024-09-13T17:24:38.649 INFO:teuthology.orchestra.run.smithi149.stdout: "op_resend": 27, 2024-09-13T17:24:38.649 INFO:teuthology.orchestra.run.smithi149.stdout: "op_reply": 14714, 2024-09-13T17:24:38.649 INFO:teuthology.orchestra.run.smithi149.stdout: "op_latency": { 2024-09-13T17:24:38.649 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 14714, 2024-09-13T17:24:38.649 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 52.722994894, 2024-09-13T17:24:38.649 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.003583185 2024-09-13T17:24:38.649 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.649 INFO:teuthology.orchestra.run.smithi149.stdout: "op_inflight": 0, 2024-09-13T17:24:38.649 INFO:teuthology.orchestra.run.smithi149.stdout: "oplen_avg": { 2024-09-13T17:24:38.649 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 14714, 2024-09-13T17:24:38.649 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 14784 2024-09-13T17:24:38.649 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.649 INFO:teuthology.orchestra.run.smithi149.stdout: "op": 14714, 2024-09-13T17:24:38.650 INFO:teuthology.orchestra.run.smithi149.stdout: "op_r": 3895, 2024-09-13T17:24:38.650 INFO:teuthology.orchestra.run.smithi149.stdout: "op_w": 10819, 2024-09-13T17:24:38.650 INFO:teuthology.orchestra.run.smithi149.stdout: "op_rmw": 0, 2024-09-13T17:24:38.650 INFO:teuthology.orchestra.run.smithi149.stdout: "op_pg": 0, 2024-09-13T17:24:38.650 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_stat": 0, 2024-09-13T17:24:38.650 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_create": 10, 2024-09-13T17:24:38.650 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_read": 98, 2024-09-13T17:24:38.650 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_write": 1488, 2024-09-13T17:24:38.650 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_writefull": 55, 2024-09-13T17:24:38.650 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_writesame": 0, 2024-09-13T17:24:38.650 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_append": 0, 2024-09-13T17:24:38.650 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_zero": 0, 2024-09-13T17:24:38.650 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_truncate": 2, 2024-09-13T17:24:38.650 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_delete": 9216, 2024-09-13T17:24:38.650 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_mapext": 0, 2024-09-13T17:24:38.651 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_sparse_read": 0, 2024-09-13T17:24:38.651 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_clonerange": 0, 2024-09-13T17:24:38.651 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_getxattr": 3797, 2024-09-13T17:24:38.651 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_setxattr": 20, 2024-09-13T17:24:38.651 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_cmpxattr": 0, 2024-09-13T17:24:38.651 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_rmxattr": 0, 2024-09-13T17:24:38.651 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_resetxattrs": 0, 2024-09-13T17:24:38.651 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_call": 0, 2024-09-13T17:24:38.651 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_watch": 0, 2024-09-13T17:24:38.651 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_notify": 0, 2024-09-13T17:24:38.651 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T17:24:38.651 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_pgls": 0, 2024-09-13T17:24:38.651 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_pgls_filter": 0, 2024-09-13T17:24:38.651 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_other": 0, 2024-09-13T17:24:38.652 INFO:teuthology.orchestra.run.smithi149.stdout: "linger_active": 0, 2024-09-13T17:24:38.652 INFO:teuthology.orchestra.run.smithi149.stdout: "linger_send": 0, 2024-09-13T17:24:38.652 INFO:teuthology.orchestra.run.smithi149.stdout: "linger_resend": 0, 2024-09-13T17:24:38.652 INFO:teuthology.orchestra.run.smithi149.stdout: "linger_ping": 0, 2024-09-13T17:24:38.652 INFO:teuthology.orchestra.run.smithi149.stdout: "poolop_active": 0, 2024-09-13T17:24:38.652 INFO:teuthology.orchestra.run.smithi149.stdout: "poolop_send": 0, 2024-09-13T17:24:38.652 INFO:teuthology.orchestra.run.smithi149.stdout: "poolop_resend": 0, 2024-09-13T17:24:38.652 INFO:teuthology.orchestra.run.smithi149.stdout: "poolstat_active": 0, 2024-09-13T17:24:38.652 INFO:teuthology.orchestra.run.smithi149.stdout: "poolstat_send": 0, 2024-09-13T17:24:38.652 INFO:teuthology.orchestra.run.smithi149.stdout: "poolstat_resend": 0, 2024-09-13T17:24:38.652 INFO:teuthology.orchestra.run.smithi149.stdout: "statfs_active": 0, 2024-09-13T17:24:38.652 INFO:teuthology.orchestra.run.smithi149.stdout: "statfs_send": 0, 2024-09-13T17:24:38.652 INFO:teuthology.orchestra.run.smithi149.stdout: "statfs_resend": 0, 2024-09-13T17:24:38.652 INFO:teuthology.orchestra.run.smithi149.stdout: "command_active": 0, 2024-09-13T17:24:38.653 INFO:teuthology.orchestra.run.smithi149.stdout: "command_send": 0, 2024-09-13T17:24:38.653 INFO:teuthology.orchestra.run.smithi149.stdout: "command_resend": 0, 2024-09-13T17:24:38.653 INFO:teuthology.orchestra.run.smithi149.stdout: "map_epoch": 104, 2024-09-13T17:24:38.653 INFO:teuthology.orchestra.run.smithi149.stdout: "map_full": 0, 2024-09-13T17:24:38.653 INFO:teuthology.orchestra.run.smithi149.stdout: "map_inc": 15, 2024-09-13T17:24:38.653 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_sessions": 12, 2024-09-13T17:24:38.653 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_session_open": 12, 2024-09-13T17:24:38.653 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_session_close": 0, 2024-09-13T17:24:38.653 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_laggy": 0, 2024-09-13T17:24:38.653 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_wr": 82, 2024-09-13T17:24:38.653 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_rd": 0, 2024-09-13T17:24:38.653 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_del": 16 2024-09-13T17:24:38.653 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.653 INFO:teuthology.orchestra.run.smithi149.stdout: "oft": { 2024-09-13T17:24:38.654 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_total_objs": 1, 2024-09-13T17:24:38.654 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_total_kv_pairs": 0, 2024-09-13T17:24:38.654 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_total_updates": 0, 2024-09-13T17:24:38.654 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_total_removes": 0 2024-09-13T17:24:38.654 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.654 INFO:teuthology.orchestra.run.smithi149.stdout: "osd-slow-ops": { 2024-09-13T17:24:38.654 INFO:teuthology.orchestra.run.smithi149.stdout: "slow_ops_count": 0 2024-09-13T17:24:38.654 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.654 INFO:teuthology.orchestra.run.smithi149.stdout: "purge_queue": { 2024-09-13T17:24:38.654 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executing_ops": 0, 2024-09-13T17:24:38.654 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executing_ops_high_water": 23, 2024-09-13T17:24:38.654 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executing": 0, 2024-09-13T17:24:38.654 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executing_high_water": 10, 2024-09-13T17:24:38.654 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executed_ops": 9195, 2024-09-13T17:24:38.655 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executed": 4648, 2024-09-13T17:24:38.655 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_item_in_journal": 0 2024-09-13T17:24:38.655 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.655 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T17:24:38.655 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-09-13T17:24:38.655 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 104857600, 2024-09-13T17:24:38.655 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-09-13T17:24:38.655 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 61696, 2024-09-13T17:24:38.655 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 20805684, 2024-09-13T17:24:38.655 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:38.655 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 61696, 2024-09-13T17:24:38.655 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 0, 2024-09-13T17:24:38.655 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 0, 2024-09-13T17:24:38.655 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 61696, 2024-09-13T17:24:38.656 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 20805684, 2024-09-13T17:24:38.656 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-09-13T17:24:38.656 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:38.656 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:38.656 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:38.656 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:38.656 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.656 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-objecter_bytes": { 2024-09-13T17:24:38.656 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-09-13T17:24:38.656 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 104857600, 2024-09-13T17:24:38.656 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-09-13T17:24:38.656 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 0, 2024-09-13T17:24:38.656 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 0, 2024-09-13T17:24:38.656 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:38.657 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 0, 2024-09-13T17:24:38.657 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 14714, 2024-09-13T17:24:38.657 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 40260692, 2024-09-13T17:24:38.657 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 14714, 2024-09-13T17:24:38.657 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 40260692, 2024-09-13T17:24:38.657 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-09-13T17:24:38.657 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:38.657 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:38.657 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:38.657 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:38.657 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.657 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-objecter_ops": { 2024-09-13T17:24:38.657 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-09-13T17:24:38.658 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 1024, 2024-09-13T17:24:38.658 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-09-13T17:24:38.658 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 0, 2024-09-13T17:24:38.658 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 0, 2024-09-13T17:24:38.661 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:38.661 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 0, 2024-09-13T17:24:38.662 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 14714, 2024-09-13T17:24:38.662 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 14714, 2024-09-13T17:24:38.662 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 14714, 2024-09-13T17:24:38.662 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 14714, 2024-09-13T17:24:38.662 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-09-13T17:24:38.662 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:38.662 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:38.662 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:38.662 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:38.662 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.662 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-write_buf_throttle": { 2024-09-13T17:24:38.662 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-09-13T17:24:38.662 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 3758096384, 2024-09-13T17:24:38.662 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-09-13T17:24:38.663 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 4648, 2024-09-13T17:24:38.663 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 514992, 2024-09-13T17:24:38.663 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:38.663 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 4648, 2024-09-13T17:24:38.663 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 0, 2024-09-13T17:24:38.663 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 0, 2024-09-13T17:24:38.663 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 98, 2024-09-13T17:24:38.663 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 514992, 2024-09-13T17:24:38.663 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-09-13T17:24:38.663 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:38.663 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:38.663 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:38.663 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:38.663 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:38.664 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-write_buf_throttle-0x55d3192a4500": { 2024-09-13T17:24:38.664 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-09-13T17:24:38.664 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 3758096384, 2024-09-13T17:24:38.664 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-09-13T17:24:38.664 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 16512, 2024-09-13T17:24:38.664 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 38878363, 2024-09-13T17:24:38.664 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:38.664 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 16512, 2024-09-13T17:24:38.664 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 0, 2024-09-13T17:24:38.664 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 0, 2024-09-13T17:24:38.664 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 1390, 2024-09-13T17:24:38.664 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 38878363, 2024-09-13T17:24:38.664 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-09-13T17:24:38.665 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:38.665 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:38.665 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:38.665 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:38.665 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:38.665 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-13T17:24:39.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:38 smithi087 ceph-mon[30934]: pgmap v337: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:24:39.232 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:38 smithi149 ceph-mon[35496]: pgmap v337: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:24:39.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:38 smithi118 ceph-mon[34374]: pgmap v337: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:24:39.411 INFO:tasks.check_counter:Daemon mds.c mds.exported=24 2024-09-13T17:24:39.411 INFO:tasks.check_counter:Daemon mds.c mds.imported=27 2024-09-13T17:24:39.411 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=485 2024-09-13T17:24:39.411 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=1355 2024-09-13T17:24:39.411 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-09-13T17:24:39.411 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-13T17:24:39.412 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-13T17:24:39.412 DEBUG:tasks.check_counter:Getting stats from f 2024-09-13T17:24:39.412 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-13T17:24:39.621 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T17:24:41.182 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:40 smithi149 ceph-mon[35496]: pgmap v338: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:24:41.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:40 smithi087 ceph-mon[30934]: pgmap v338: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:24:41.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:40 smithi118 ceph-mon[34374]: pgmap v338: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:24:41.410 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-13T17:24:41.410 INFO:teuthology.orchestra.run.smithi149.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T17:24:41.410 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_messages": 22310, 2024-09-13T17:24:41.410 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages": 22133, 2024-09-13T17:24:41.410 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_bytes": 9522864, 2024-09-13T17:24:41.410 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_bytes": 16112905, 2024-09-13T17:24:41.410 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_created_connections": 11, 2024-09-13T17:24:41.410 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_active_connections": 5, 2024-09-13T17:24:41.410 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_total_time": 1.392968973, 2024-09-13T17:24:41.411 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_send_time": 0.595601969, 2024-09-13T17:24:41.411 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_recv_time": 0.769373174, 2024-09-13T17:24:41.411 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_fast_dispatch_time": 0.145346851, 2024-09-13T17:24:41.411 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:41.411 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 22132, 2024-09-13T17:24:41.411 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.937275704, 2024-09-13T17:24:41.411 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000042349 2024-09-13T17:24:41.411 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.411 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:41.411 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 34143, 2024-09-13T17:24:41.411 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.005129475, 2024-09-13T17:24:41.411 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000150 2024-09-13T17:24:41.411 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.412 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_encrypted_bytes": 6256, 2024-09-13T17:24:41.412 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_encrypted_bytes": 12640 2024-09-13T17:24:41.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.412 INFO:teuthology.orchestra.run.smithi149.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T17:24:41.412 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_messages": 14999, 2024-09-13T17:24:41.412 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages": 13928, 2024-09-13T17:24:41.412 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_bytes": 6171224, 2024-09-13T17:24:41.412 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_bytes": 18067591, 2024-09-13T17:24:41.412 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_created_connections": 48, 2024-09-13T17:24:41.412 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_active_connections": 6, 2024-09-13T17:24:41.412 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_total_time": 1.055309221, 2024-09-13T17:24:41.412 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_send_time": 0.506510494, 2024-09-13T17:24:41.412 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_recv_time": 0.456052929, 2024-09-13T17:24:41.413 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_fast_dispatch_time": 0.135129469, 2024-09-13T17:24:41.413 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:41.413 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 13927, 2024-09-13T17:24:41.413 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.742791258, 2024-09-13T17:24:41.413 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000053334 2024-09-13T17:24:41.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.413 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:41.413 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 18153, 2024-09-13T17:24:41.413 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.002536508, 2024-09-13T17:24:41.413 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000139 2024-09-13T17:24:41.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.413 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_encrypted_bytes": 2928, 2024-09-13T17:24:41.413 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_encrypted_bytes": 134000 2024-09-13T17:24:41.414 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.414 INFO:teuthology.orchestra.run.smithi149.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T17:24:41.414 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_messages": 15160, 2024-09-13T17:24:41.414 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages": 26649, 2024-09-13T17:24:41.414 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_bytes": 7221579, 2024-09-13T17:24:41.414 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_bytes": 18286594, 2024-09-13T17:24:41.414 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_created_connections": 16, 2024-09-13T17:24:41.414 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_active_connections": 7, 2024-09-13T17:24:41.414 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_total_time": 1.003270540, 2024-09-13T17:24:41.414 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_send_time": 0.423177048, 2024-09-13T17:24:41.414 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_recv_time": 0.574917883, 2024-09-13T17:24:41.414 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_fast_dispatch_time": 0.075741191, 2024-09-13T17:24:41.414 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:41.414 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 26646, 2024-09-13T17:24:41.415 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 1.444329078, 2024-09-13T17:24:41.415 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000054204 2024-09-13T17:24:41.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.415 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:41.415 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 31960, 2024-09-13T17:24:41.415 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.004804242, 2024-09-13T17:24:41.415 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000150 2024-09-13T17:24:41.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.415 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_encrypted_bytes": 1646496, 2024-09-13T17:24:41.415 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_encrypted_bytes": 471440 2024-09-13T17:24:41.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.415 INFO:teuthology.orchestra.run.smithi149.stdout: "cct": { 2024-09-13T17:24:41.415 INFO:teuthology.orchestra.run.smithi149.stdout: "total_workers": 1, 2024-09-13T17:24:41.416 INFO:teuthology.orchestra.run.smithi149.stdout: "unhealthy_workers": 0 2024-09-13T17:24:41.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.416 INFO:teuthology.orchestra.run.smithi149.stdout: "finisher-MDSRank": { 2024-09-13T17:24:41.416 INFO:teuthology.orchestra.run.smithi149.stdout: "queue_len": 0, 2024-09-13T17:24:41.416 INFO:teuthology.orchestra.run.smithi149.stdout: "complete_latency": { 2024-09-13T17:24:41.416 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 5269, 2024-09-13T17:24:41.416 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 4.420302710, 2024-09-13T17:24:41.416 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000838926 2024-09-13T17:24:41.416 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:41.416 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.416 INFO:teuthology.orchestra.run.smithi149.stdout: "finisher-PurgeQueue": { 2024-09-13T17:24:41.417 INFO:teuthology.orchestra.run.smithi149.stdout: "queue_len": 0, 2024-09-13T17:24:41.417 INFO:teuthology.orchestra.run.smithi149.stdout: "complete_latency": { 2024-09-13T17:24:41.417 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 6178, 2024-09-13T17:24:41.417 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.786263811, 2024-09-13T17:24:41.417 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000127268 2024-09-13T17:24:41.417 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:41.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.417 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": { 2024-09-13T17:24:41.417 INFO:teuthology.orchestra.run.smithi149.stdout: "request": 7849, 2024-09-13T17:24:41.417 INFO:teuthology.orchestra.run.smithi149.stdout: "reply": 7666, 2024-09-13T17:24:41.417 INFO:teuthology.orchestra.run.smithi149.stdout: "reply_latency": { 2024-09-13T17:24:41.417 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 7666, 2024-09-13T17:24:41.417 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 10.277526865, 2024-09-13T17:24:41.418 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.001340663 2024-09-13T17:24:41.418 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.418 INFO:teuthology.orchestra.run.smithi149.stdout: "slow_reply": 0, 2024-09-13T17:24:41.418 INFO:teuthology.orchestra.run.smithi149.stdout: "forward": 183, 2024-09-13T17:24:41.418 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_fetch_complete": 0, 2024-09-13T17:24:41.418 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_fetch_keys": 0, 2024-09-13T17:24:41.418 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_commit": 11, 2024-09-13T17:24:41.418 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_split": 0, 2024-09-13T17:24:41.418 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_merge": 0, 2024-09-13T17:24:41.418 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes": 1627, 2024-09-13T17:24:41.418 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_top": 15, 2024-09-13T17:24:41.419 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_bottom": 8, 2024-09-13T17:24:41.419 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_pin_tail": 1604, 2024-09-13T17:24:41.419 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_pinned": 1604, 2024-09-13T17:24:41.419 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_expired": 2464, 2024-09-13T17:24:41.419 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_with_caps": 1, 2024-09-13T17:24:41.419 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": 1, 2024-09-13T17:24:41.419 INFO:teuthology.orchestra.run.smithi149.stdout: "subtrees": 3, 2024-09-13T17:24:41.419 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse": 16246, 2024-09-13T17:24:41.419 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_hit": 10624, 2024-09-13T17:24:41.419 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_forward": 181, 2024-09-13T17:24:41.419 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_discover": 547, 2024-09-13T17:24:41.419 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_dir_fetch": 0, 2024-09-13T17:24:41.419 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_remote_ino": 0, 2024-09-13T17:24:41.420 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_lock": 0, 2024-09-13T17:24:41.420 INFO:teuthology.orchestra.run.smithi149.stdout: "load_cent": 0, 2024-09-13T17:24:41.420 INFO:teuthology.orchestra.run.smithi149.stdout: "q": 0, 2024-09-13T17:24:41.420 INFO:teuthology.orchestra.run.smithi149.stdout: "exported": 22, 2024-09-13T17:24:41.420 INFO:teuthology.orchestra.run.smithi149.stdout: "exported_inodes": 1498, 2024-09-13T17:24:41.420 INFO:teuthology.orchestra.run.smithi149.stdout: "imported": 24, 2024-09-13T17:24:41.420 INFO:teuthology.orchestra.run.smithi149.stdout: "imported_inodes": 2796, 2024-09-13T17:24:41.420 INFO:teuthology.orchestra.run.smithi149.stdout: "openino_dir_fetch": 0, 2024-09-13T17:24:41.420 INFO:teuthology.orchestra.run.smithi149.stdout: "openino_backtrace_fetch": 2692, 2024-09-13T17:24:41.420 INFO:teuthology.orchestra.run.smithi149.stdout: "openino_peer_discover": 0, 2024-09-13T17:24:41.420 INFO:teuthology.orchestra.run.smithi149.stdout: "root_rfiles": 4, 2024-09-13T17:24:41.420 INFO:teuthology.orchestra.run.smithi149.stdout: "root_rbytes": 234, 2024-09-13T17:24:41.420 INFO:teuthology.orchestra.run.smithi149.stdout: "root_rsnaps": 6, 2024-09-13T17:24:41.420 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_backtrace_fetch": 2692, 2024-09-13T17:24:41.421 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_set_tag": 0, 2024-09-13T17:24:41.421 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T17:24:41.421 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_inotable_repaired": 0, 2024-09-13T17:24:41.421 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_dir_inodes": 130, 2024-09-13T17:24:41.421 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T17:24:41.421 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_dirfrag_rstats": 130, 2024-09-13T17:24:41.421 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_file_inodes": 2562, 2024-09-13T17:24:41.421 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_inode_file_caps": 30, 2024-09-13T17:24:41.421 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_cap_op_revoke": 603, 2024-09-13T17:24:41.421 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_cap_op_grant": 5395, 2024-09-13T17:24:41.421 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T17:24:41.421 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T17:24:41.421 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T17:24:41.421 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_client_caps": 4563, 2024-09-13T17:24:41.422 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_client_caps_dirty": 2269, 2024-09-13T17:24:41.422 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_client_cap_release": 73, 2024-09-13T17:24:41.422 INFO:teuthology.orchestra.run.smithi149.stdout: "process_request_cap_release": 8867 2024-09-13T17:24:41.422 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.422 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_cache": { 2024-09-13T17:24:41.422 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_update": 304, 2024-09-13T17:24:41.422 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_update_receipt": 1745, 2024-09-13T17:24:41.422 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_try_discover": 1136, 2024-09-13T17:24:41.422 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_send_discover": 1174, 2024-09-13T17:24:41.422 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_handle_discover": 530, 2024-09-13T17:24:41.423 INFO:teuthology.orchestra.run.smithi149.stdout: "num_strays": 81, 2024-09-13T17:24:41.423 INFO:teuthology.orchestra.run.smithi149.stdout: "num_strays_delayed": 0, 2024-09-13T17:24:41.423 INFO:teuthology.orchestra.run.smithi149.stdout: "num_strays_enqueuing": 0, 2024-09-13T17:24:41.423 INFO:teuthology.orchestra.run.smithi149.stdout: "strays_created": 3823, 2024-09-13T17:24:41.423 INFO:teuthology.orchestra.run.smithi149.stdout: "strays_enqueued": 3742, 2024-09-13T17:24:41.423 INFO:teuthology.orchestra.run.smithi149.stdout: "strays_reintegrated": 0, 2024-09-13T17:24:41.423 INFO:teuthology.orchestra.run.smithi149.stdout: "strays_migrated": 0, 2024-09-13T17:24:41.423 INFO:teuthology.orchestra.run.smithi149.stdout: "num_recovering_processing": 0, 2024-09-13T17:24:41.423 INFO:teuthology.orchestra.run.smithi149.stdout: "num_recovering_enqueued": 0, 2024-09-13T17:24:41.423 INFO:teuthology.orchestra.run.smithi149.stdout: "num_recovering_prioritized": 0, 2024-09-13T17:24:41.423 INFO:teuthology.orchestra.run.smithi149.stdout: "recovery_started": 0, 2024-09-13T17:24:41.423 INFO:teuthology.orchestra.run.smithi149.stdout: "recovery_completed": 0, 2024-09-13T17:24:41.424 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T17:24:41.424 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_exportdir": 22, 2024-09-13T17:24:41.424 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_flush": 0, 2024-09-13T17:24:41.424 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_fragmentdir": 0, 2024-09-13T17:24:41.424 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_fragstats": 0, 2024-09-13T17:24:41.424 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_inodestats": 0 2024-09-13T17:24:41.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.424 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_log": { 2024-09-13T17:24:41.424 INFO:teuthology.orchestra.run.smithi149.stdout: "evadd": 13390, 2024-09-13T17:24:41.424 INFO:teuthology.orchestra.run.smithi149.stdout: "evex": 0, 2024-09-13T17:24:41.424 INFO:teuthology.orchestra.run.smithi149.stdout: "evtrm": 0, 2024-09-13T17:24:41.424 INFO:teuthology.orchestra.run.smithi149.stdout: "ev": 13390, 2024-09-13T17:24:41.424 INFO:teuthology.orchestra.run.smithi149.stdout: "evexg": 0, 2024-09-13T17:24:41.425 INFO:teuthology.orchestra.run.smithi149.stdout: "evexd": 0, 2024-09-13T17:24:41.425 INFO:teuthology.orchestra.run.smithi149.stdout: "segadd": 16, 2024-09-13T17:24:41.425 INFO:teuthology.orchestra.run.smithi149.stdout: "segex": 0, 2024-09-13T17:24:41.425 INFO:teuthology.orchestra.run.smithi149.stdout: "segtrm": 0, 2024-09-13T17:24:41.425 INFO:teuthology.orchestra.run.smithi149.stdout: "seg": 16, 2024-09-13T17:24:41.425 INFO:teuthology.orchestra.run.smithi149.stdout: "segexg": 0, 2024-09-13T17:24:41.425 INFO:teuthology.orchestra.run.smithi149.stdout: "segexd": 0, 2024-09-13T17:24:41.425 INFO:teuthology.orchestra.run.smithi149.stdout: "expos": 4194304, 2024-09-13T17:24:41.425 INFO:teuthology.orchestra.run.smithi149.stdout: "wrpos": 30888867, 2024-09-13T17:24:41.425 INFO:teuthology.orchestra.run.smithi149.stdout: "rdpos": 0, 2024-09-13T17:24:41.425 INFO:teuthology.orchestra.run.smithi149.stdout: "jlat": { 2024-09-13T17:24:41.425 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 1867, 2024-09-13T17:24:41.425 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 4.465111876, 2024-09-13T17:24:41.425 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.002391597 2024-09-13T17:24:41.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.426 INFO:teuthology.orchestra.run.smithi149.stdout: "replayed": 0 2024-09-13T17:24:41.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.426 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_mem": { 2024-09-13T17:24:41.426 INFO:teuthology.orchestra.run.smithi149.stdout: "ino": 841, 2024-09-13T17:24:41.426 INFO:teuthology.orchestra.run.smithi149.stdout: "ino+": 5797, 2024-09-13T17:24:41.426 INFO:teuthology.orchestra.run.smithi149.stdout: "ino-": 4956, 2024-09-13T17:24:41.426 INFO:teuthology.orchestra.run.smithi149.stdout: "dir": 102, 2024-09-13T17:24:41.426 INFO:teuthology.orchestra.run.smithi149.stdout: "dir+": 803, 2024-09-13T17:24:41.426 INFO:teuthology.orchestra.run.smithi149.stdout: "dir-": 701, 2024-09-13T17:24:41.426 INFO:teuthology.orchestra.run.smithi149.stdout: "dn": 1627, 2024-09-13T17:24:41.426 INFO:teuthology.orchestra.run.smithi149.stdout: "dn+": 8860, 2024-09-13T17:24:41.426 INFO:teuthology.orchestra.run.smithi149.stdout: "dn-": 7233, 2024-09-13T17:24:41.426 INFO:teuthology.orchestra.run.smithi149.stdout: "cap": 1, 2024-09-13T17:24:41.427 INFO:teuthology.orchestra.run.smithi149.stdout: "cap+": 3883, 2024-09-13T17:24:41.427 INFO:teuthology.orchestra.run.smithi149.stdout: "cap-": 3882, 2024-09-13T17:24:41.427 INFO:teuthology.orchestra.run.smithi149.stdout: "rss": 74860, 2024-09-13T17:24:41.427 INFO:teuthology.orchestra.run.smithi149.stdout: "heap": 198932 2024-09-13T17:24:41.427 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.427 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_server": { 2024-09-13T17:24:41.427 INFO:teuthology.orchestra.run.smithi149.stdout: "dispatch_client_request": 14346, 2024-09-13T17:24:41.427 INFO:teuthology.orchestra.run.smithi149.stdout: "dispatch_server_request": 105, 2024-09-13T17:24:41.427 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_client_request": 7849, 2024-09-13T17:24:41.427 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_client_session": 26, 2024-09-13T17:24:41.427 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_peer_request": 1738, 2024-09-13T17:24:41.428 INFO:teuthology.orchestra.run.smithi149.stdout: "req_create_latency": { 2024-09-13T17:24:41.428 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 1221, 2024-09-13T17:24:41.428 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 1.764308926, 2024-09-13T17:24:41.428 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.001444970 2024-09-13T17:24:41.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.428 INFO:teuthology.orchestra.run.smithi149.stdout: "req_getattr_latency": { 2024-09-13T17:24:41.428 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 4, 2024-09-13T17:24:41.428 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000720924, 2024-09-13T17:24:41.428 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000180231 2024-09-13T17:24:41.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.428 INFO:teuthology.orchestra.run.smithi149.stdout: "req_getfilelock_latency": { 2024-09-13T17:24:41.428 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:41.428 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:41.429 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:41.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.429 INFO:teuthology.orchestra.run.smithi149.stdout: "req_link_latency": { 2024-09-13T17:24:41.429 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:41.429 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:41.429 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:41.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.429 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookup_latency": { 2024-09-13T17:24:41.429 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 2316, 2024-09-13T17:24:41.429 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.884647381, 2024-09-13T17:24:41.429 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000381972 2024-09-13T17:24:41.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.429 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookuphash_latency": { 2024-09-13T17:24:41.429 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:41.430 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:41.430 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:41.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.430 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookupino_latency": { 2024-09-13T17:24:41.430 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:41.430 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:41.430 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:41.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.430 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookupname_latency": { 2024-09-13T17:24:41.430 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:41.430 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:41.430 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:41.430 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.430 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookupparent_latency": { 2024-09-13T17:24:41.431 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:41.431 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:41.431 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:41.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.431 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookupsnap_latency": { 2024-09-13T17:24:41.431 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:41.431 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:41.431 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:41.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.431 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lssnap_latency": { 2024-09-13T17:24:41.431 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:41.431 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:41.432 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:41.432 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.432 INFO:teuthology.orchestra.run.smithi149.stdout: "req_mkdir_latency": { 2024-09-13T17:24:41.432 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:41.432 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:41.433 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:41.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.433 INFO:teuthology.orchestra.run.smithi149.stdout: "req_mknod_latency": { 2024-09-13T17:24:41.433 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:41.433 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:41.433 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:41.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.433 INFO:teuthology.orchestra.run.smithi149.stdout: "req_mksnap_latency": { 2024-09-13T17:24:41.433 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:41.433 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:41.433 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:41.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.433 INFO:teuthology.orchestra.run.smithi149.stdout: "req_open_latency": { 2024-09-13T17:24:41.433 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:41.434 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:41.434 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:41.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.434 INFO:teuthology.orchestra.run.smithi149.stdout: "req_readdir_latency": { 2024-09-13T17:24:41.434 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 302, 2024-09-13T17:24:41.434 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.369305773, 2024-09-13T17:24:41.434 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.001222866 2024-09-13T17:24:41.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.434 INFO:teuthology.orchestra.run.smithi149.stdout: "req_rename_latency": { 2024-09-13T17:24:41.434 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:41.434 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:41.434 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:41.434 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.435 INFO:teuthology.orchestra.run.smithi149.stdout: "req_renamesnap_latency": { 2024-09-13T17:24:41.435 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:41.435 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:41.435 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:41.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.435 INFO:teuthology.orchestra.run.smithi149.stdout: "req_snapdiff_latency": { 2024-09-13T17:24:41.435 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:41.435 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:41.435 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:41.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.435 INFO:teuthology.orchestra.run.smithi149.stdout: "req_rmdir_latency": { 2024-09-13T17:24:41.435 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 126, 2024-09-13T17:24:41.436 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 2.236611246, 2024-09-13T17:24:41.436 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.017750882 2024-09-13T17:24:41.436 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.436 INFO:teuthology.orchestra.run.smithi149.stdout: "req_rmsnap_latency": { 2024-09-13T17:24:41.436 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:41.437 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:41.437 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:41.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.437 INFO:teuthology.orchestra.run.smithi149.stdout: "req_rmxattr_latency": { 2024-09-13T17:24:41.437 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:41.437 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:41.437 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:41.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.437 INFO:teuthology.orchestra.run.smithi149.stdout: "req_setattr_latency": { 2024-09-13T17:24:41.437 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:41.437 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:41.437 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:41.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.438 INFO:teuthology.orchestra.run.smithi149.stdout: "req_setdirlayout_latency": { 2024-09-13T17:24:41.438 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:41.438 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:41.438 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:41.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.438 INFO:teuthology.orchestra.run.smithi149.stdout: "req_setfilelock_latency": { 2024-09-13T17:24:41.438 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:41.438 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:41.438 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:41.438 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.438 INFO:teuthology.orchestra.run.smithi149.stdout: "req_setlayout_latency": { 2024-09-13T17:24:41.438 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:41.438 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:41.439 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:41.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.439 INFO:teuthology.orchestra.run.smithi149.stdout: "req_setxattr_latency": { 2024-09-13T17:24:41.439 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:41.439 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:41.439 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:41.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.439 INFO:teuthology.orchestra.run.smithi149.stdout: "req_symlink_latency": { 2024-09-13T17:24:41.439 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:41.439 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:41.439 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:41.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.439 INFO:teuthology.orchestra.run.smithi149.stdout: "req_unlink_latency": { 2024-09-13T17:24:41.439 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 3697, 2024-09-13T17:24:41.440 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 5.021932615, 2024-09-13T17:24:41.440 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.001358380 2024-09-13T17:24:41.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.440 INFO:teuthology.orchestra.run.smithi149.stdout: "cap_revoke_eviction": 0, 2024-09-13T17:24:41.440 INFO:teuthology.orchestra.run.smithi149.stdout: "cap_acquisition_throttle": 0, 2024-09-13T17:24:41.440 INFO:teuthology.orchestra.run.smithi149.stdout: "req_getvxattr_latency": { 2024-09-13T17:24:41.440 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:41.440 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:41.440 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:41.440 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:41.440 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.440 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_sessions": { 2024-09-13T17:24:41.440 INFO:teuthology.orchestra.run.smithi149.stdout: "session_count": 2, 2024-09-13T17:24:41.441 INFO:teuthology.orchestra.run.smithi149.stdout: "session_add": 4, 2024-09-13T17:24:41.441 INFO:teuthology.orchestra.run.smithi149.stdout: "session_remove": 2, 2024-09-13T17:24:41.441 INFO:teuthology.orchestra.run.smithi149.stdout: "sessions_open": 2, 2024-09-13T17:24:41.441 INFO:teuthology.orchestra.run.smithi149.stdout: "sessions_stale": 0, 2024-09-13T17:24:41.441 INFO:teuthology.orchestra.run.smithi149.stdout: "total_load": 4859, 2024-09-13T17:24:41.441 INFO:teuthology.orchestra.run.smithi149.stdout: "average_load": 2429, 2024-09-13T17:24:41.441 INFO:teuthology.orchestra.run.smithi149.stdout: "avg_session_uptime": 642, 2024-09-13T17:24:41.441 INFO:teuthology.orchestra.run.smithi149.stdout: "mdthresh_evicted": 0 2024-09-13T17:24:41.441 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.441 INFO:teuthology.orchestra.run.smithi149.stdout: "mempool": { 2024-09-13T17:24:41.441 INFO:teuthology.orchestra.run.smithi149.stdout: "bloom_filter_bytes": 0, 2024-09-13T17:24:41.441 INFO:teuthology.orchestra.run.smithi149.stdout: "bloom_filter_items": 0, 2024-09-13T17:24:41.441 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T17:24:41.441 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_alloc_items": 0, 2024-09-13T17:24:41.442 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T17:24:41.442 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_data_items": 0, 2024-09-13T17:24:41.442 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T17:24:41.442 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T17:24:41.442 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T17:24:41.442 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T17:24:41.442 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T17:24:41.442 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_other_items": 0, 2024-09-13T17:24:41.442 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T17:24:41.442 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T17:24:41.442 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_extent_bytes": 0, 2024-09-13T17:24:41.442 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_extent_items": 0, 2024-09-13T17:24:41.442 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_blob_bytes": 0, 2024-09-13T17:24:41.443 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_blob_items": 0, 2024-09-13T17:24:41.443 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T17:24:41.443 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T17:24:41.443 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T17:24:41.443 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T17:24:41.443 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T17:24:41.443 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_fsck_items": 0, 2024-09-13T17:24:41.443 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_txc_bytes": 0, 2024-09-13T17:24:41.443 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_txc_items": 0, 2024-09-13T17:24:41.443 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T17:24:41.443 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T17:24:41.443 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_writing_bytes": 0, 2024-09-13T17:24:41.443 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_writing_items": 0, 2024-09-13T17:24:41.443 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_bytes": 0, 2024-09-13T17:24:41.444 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_items": 0, 2024-09-13T17:24:41.444 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T17:24:41.444 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_file_reader_items": 0, 2024-09-13T17:24:41.444 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T17:24:41.444 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_file_writer_items": 0, 2024-09-13T17:24:41.444 INFO:teuthology.orchestra.run.smithi149.stdout: "buffer_anon_bytes": 828399, 2024-09-13T17:24:41.444 INFO:teuthology.orchestra.run.smithi149.stdout: "buffer_anon_items": 246, 2024-09-13T17:24:41.444 INFO:teuthology.orchestra.run.smithi149.stdout: "buffer_meta_bytes": 0, 2024-09-13T17:24:41.444 INFO:teuthology.orchestra.run.smithi149.stdout: "buffer_meta_items": 0, 2024-09-13T17:24:41.444 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_bytes": 0, 2024-09-13T17:24:41.444 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_items": 0, 2024-09-13T17:24:41.444 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_mapbl_bytes": 0, 2024-09-13T17:24:41.444 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_mapbl_items": 0, 2024-09-13T17:24:41.445 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_pglog_bytes": 0, 2024-09-13T17:24:41.445 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_pglog_items": 0, 2024-09-13T17:24:41.445 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_bytes": 10008, 2024-09-13T17:24:41.445 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_items": 204, 2024-09-13T17:24:41.445 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T17:24:41.445 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_mapping_items": 0, 2024-09-13T17:24:41.445 INFO:teuthology.orchestra.run.smithi149.stdout: "pgmap_bytes": 0, 2024-09-13T17:24:41.445 INFO:teuthology.orchestra.run.smithi149.stdout: "pgmap_items": 0, 2024-09-13T17:24:41.445 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_co_bytes": 3176196, 2024-09-13T17:24:41.445 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_co_items": 42084, 2024-09-13T17:24:41.445 INFO:teuthology.orchestra.run.smithi149.stdout: "unittest_1_bytes": 0, 2024-09-13T17:24:41.445 INFO:teuthology.orchestra.run.smithi149.stdout: "unittest_1_items": 0, 2024-09-13T17:24:41.445 INFO:teuthology.orchestra.run.smithi149.stdout: "unittest_2_bytes": 0, 2024-09-13T17:24:41.445 INFO:teuthology.orchestra.run.smithi149.stdout: "unittest_2_items": 0 2024-09-13T17:24:41.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.446 INFO:teuthology.orchestra.run.smithi149.stdout: "objecter": { 2024-09-13T17:24:41.446 INFO:teuthology.orchestra.run.smithi149.stdout: "op_active": 0, 2024-09-13T17:24:41.446 INFO:teuthology.orchestra.run.smithi149.stdout: "op_laggy": 0, 2024-09-13T17:24:41.446 INFO:teuthology.orchestra.run.smithi149.stdout: "op_send": 12353, 2024-09-13T17:24:41.446 INFO:teuthology.orchestra.run.smithi149.stdout: "op_send_bytes": 27299684, 2024-09-13T17:24:41.446 INFO:teuthology.orchestra.run.smithi149.stdout: "op_resend": 33, 2024-09-13T17:24:41.446 INFO:teuthology.orchestra.run.smithi149.stdout: "op_reply": 12353, 2024-09-13T17:24:41.446 INFO:teuthology.orchestra.run.smithi149.stdout: "op_latency": { 2024-09-13T17:24:41.446 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 12353, 2024-09-13T17:24:41.446 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 44.033160446, 2024-09-13T17:24:41.446 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.003564572 2024-09-13T17:24:41.446 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.446 INFO:teuthology.orchestra.run.smithi149.stdout: "op_inflight": 0, 2024-09-13T17:24:41.446 INFO:teuthology.orchestra.run.smithi149.stdout: "oplen_avg": { 2024-09-13T17:24:41.447 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 12353, 2024-09-13T17:24:41.447 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 12406 2024-09-13T17:24:41.447 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.447 INFO:teuthology.orchestra.run.smithi149.stdout: "op": 12353, 2024-09-13T17:24:41.447 INFO:teuthology.orchestra.run.smithi149.stdout: "op_r": 2800, 2024-09-13T17:24:41.447 INFO:teuthology.orchestra.run.smithi149.stdout: "op_w": 9553, 2024-09-13T17:24:41.447 INFO:teuthology.orchestra.run.smithi149.stdout: "op_rmw": 0, 2024-09-13T17:24:41.447 INFO:teuthology.orchestra.run.smithi149.stdout: "op_pg": 0, 2024-09-13T17:24:41.447 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_stat": 0, 2024-09-13T17:24:41.447 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_create": 10, 2024-09-13T17:24:41.447 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_read": 108, 2024-09-13T17:24:41.447 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_write": 1975, 2024-09-13T17:24:41.447 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_writefull": 54, 2024-09-13T17:24:41.447 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_writesame": 0, 2024-09-13T17:24:41.448 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_append": 0, 2024-09-13T17:24:41.448 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_zero": 0, 2024-09-13T17:24:41.448 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_truncate": 0, 2024-09-13T17:24:41.448 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_delete": 7481, 2024-09-13T17:24:41.448 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_mapext": 0, 2024-09-13T17:24:41.448 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_sparse_read": 0, 2024-09-13T17:24:41.448 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_clonerange": 0, 2024-09-13T17:24:41.448 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_getxattr": 2692, 2024-09-13T17:24:41.448 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_setxattr": 20, 2024-09-13T17:24:41.448 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_cmpxattr": 0, 2024-09-13T17:24:41.448 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_rmxattr": 0, 2024-09-13T17:24:41.448 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_resetxattrs": 0, 2024-09-13T17:24:41.448 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_call": 0, 2024-09-13T17:24:41.448 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_watch": 0, 2024-09-13T17:24:41.449 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_notify": 0, 2024-09-13T17:24:41.449 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T17:24:41.449 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_pgls": 0, 2024-09-13T17:24:41.449 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_pgls_filter": 0, 2024-09-13T17:24:41.449 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_other": 0, 2024-09-13T17:24:41.449 INFO:teuthology.orchestra.run.smithi149.stdout: "linger_active": 0, 2024-09-13T17:24:41.449 INFO:teuthology.orchestra.run.smithi149.stdout: "linger_send": 0, 2024-09-13T17:24:41.449 INFO:teuthology.orchestra.run.smithi149.stdout: "linger_resend": 0, 2024-09-13T17:24:41.449 INFO:teuthology.orchestra.run.smithi149.stdout: "linger_ping": 0, 2024-09-13T17:24:41.449 INFO:teuthology.orchestra.run.smithi149.stdout: "poolop_active": 0, 2024-09-13T17:24:41.449 INFO:teuthology.orchestra.run.smithi149.stdout: "poolop_send": 0, 2024-09-13T17:24:41.449 INFO:teuthology.orchestra.run.smithi149.stdout: "poolop_resend": 0, 2024-09-13T17:24:41.449 INFO:teuthology.orchestra.run.smithi149.stdout: "poolstat_active": 0, 2024-09-13T17:24:41.449 INFO:teuthology.orchestra.run.smithi149.stdout: "poolstat_send": 0, 2024-09-13T17:24:41.450 INFO:teuthology.orchestra.run.smithi149.stdout: "poolstat_resend": 0, 2024-09-13T17:24:41.450 INFO:teuthology.orchestra.run.smithi149.stdout: "statfs_active": 0, 2024-09-13T17:24:41.450 INFO:teuthology.orchestra.run.smithi149.stdout: "statfs_send": 0, 2024-09-13T17:24:41.450 INFO:teuthology.orchestra.run.smithi149.stdout: "statfs_resend": 0, 2024-09-13T17:24:41.450 INFO:teuthology.orchestra.run.smithi149.stdout: "command_active": 0, 2024-09-13T17:24:41.450 INFO:teuthology.orchestra.run.smithi149.stdout: "command_send": 0, 2024-09-13T17:24:41.450 INFO:teuthology.orchestra.run.smithi149.stdout: "command_resend": 0, 2024-09-13T17:24:41.450 INFO:teuthology.orchestra.run.smithi149.stdout: "map_epoch": 104, 2024-09-13T17:24:41.450 INFO:teuthology.orchestra.run.smithi149.stdout: "map_full": 0, 2024-09-13T17:24:41.450 INFO:teuthology.orchestra.run.smithi149.stdout: "map_inc": 15, 2024-09-13T17:24:41.450 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_sessions": 12, 2024-09-13T17:24:41.450 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_session_open": 12, 2024-09-13T17:24:41.450 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_session_close": 0, 2024-09-13T17:24:41.450 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_laggy": 0, 2024-09-13T17:24:41.451 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_wr": 51, 2024-09-13T17:24:41.451 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_rd": 0, 2024-09-13T17:24:41.451 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_del": 15 2024-09-13T17:24:41.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.451 INFO:teuthology.orchestra.run.smithi149.stdout: "oft": { 2024-09-13T17:24:41.451 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_total_objs": 1, 2024-09-13T17:24:41.451 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_total_kv_pairs": 0, 2024-09-13T17:24:41.451 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_total_updates": 0, 2024-09-13T17:24:41.451 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_total_removes": 0 2024-09-13T17:24:41.451 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.451 INFO:teuthology.orchestra.run.smithi149.stdout: "osd-slow-ops": { 2024-09-13T17:24:41.451 INFO:teuthology.orchestra.run.smithi149.stdout: "slow_ops_count": 0 2024-09-13T17:24:41.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.452 INFO:teuthology.orchestra.run.smithi149.stdout: "purge_queue": { 2024-09-13T17:24:41.452 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executing_ops": 0, 2024-09-13T17:24:41.452 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executing_ops_high_water": 23, 2024-09-13T17:24:41.452 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executing": 0, 2024-09-13T17:24:41.452 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executing_high_water": 14, 2024-09-13T17:24:41.452 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executed_ops": 7463, 2024-09-13T17:24:41.452 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executed": 3742, 2024-09-13T17:24:41.452 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_item_in_journal": 0 2024-09-13T17:24:41.452 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.452 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T17:24:41.452 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-09-13T17:24:41.452 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 104857600, 2024-09-13T17:24:41.453 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-09-13T17:24:41.453 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 52465, 2024-09-13T17:24:41.453 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 18174443, 2024-09-13T17:24:41.453 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:41.453 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 52465, 2024-09-13T17:24:41.453 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 0, 2024-09-13T17:24:41.453 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 0, 2024-09-13T17:24:41.453 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 52465, 2024-09-13T17:24:41.453 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 18174443, 2024-09-13T17:24:41.453 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-09-13T17:24:41.453 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:41.453 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:41.453 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:41.453 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:41.454 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.454 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-objecter_bytes": { 2024-09-13T17:24:41.454 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-09-13T17:24:41.454 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 104857600, 2024-09-13T17:24:41.454 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-09-13T17:24:41.454 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 0, 2024-09-13T17:24:41.454 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 0, 2024-09-13T17:24:41.454 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:41.454 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 0, 2024-09-13T17:24:41.454 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 12353, 2024-09-13T17:24:41.454 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 27717722, 2024-09-13T17:24:41.454 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 12353, 2024-09-13T17:24:41.454 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 27717722, 2024-09-13T17:24:41.454 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-09-13T17:24:41.455 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:41.455 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:41.455 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:41.455 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:41.455 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.455 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-objecter_ops": { 2024-09-13T17:24:41.455 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-09-13T17:24:41.455 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 1024, 2024-09-13T17:24:41.455 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-09-13T17:24:41.455 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 0, 2024-09-13T17:24:41.455 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 0, 2024-09-13T17:24:41.455 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:41.455 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 0, 2024-09-13T17:24:41.456 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 12353, 2024-09-13T17:24:41.456 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 12353, 2024-09-13T17:24:41.456 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 12353, 2024-09-13T17:24:41.456 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 12353, 2024-09-13T17:24:41.456 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-09-13T17:24:41.456 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:41.456 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:41.456 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:41.456 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:41.456 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.456 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-write_buf_throttle": { 2024-09-13T17:24:41.456 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-09-13T17:24:41.456 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 3758096384, 2024-09-13T17:24:41.456 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-09-13T17:24:41.457 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 3742, 2024-09-13T17:24:41.457 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 418038, 2024-09-13T17:24:41.457 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:41.457 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 3742, 2024-09-13T17:24:41.457 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 0, 2024-09-13T17:24:41.457 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 0, 2024-09-13T17:24:41.457 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 108, 2024-09-13T17:24:41.457 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 418038, 2024-09-13T17:24:41.457 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-09-13T17:24:41.457 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:41.457 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:41.457 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:41.457 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:41.457 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:41.458 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-write_buf_throttle-0x5635f7e08500": { 2024-09-13T17:24:41.458 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-09-13T17:24:41.458 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 3758096384, 2024-09-13T17:24:41.458 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-09-13T17:24:41.458 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 13390, 2024-09-13T17:24:41.458 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 26694563, 2024-09-13T17:24:41.458 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:41.458 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 13390, 2024-09-13T17:24:41.458 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 0, 2024-09-13T17:24:41.458 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 0, 2024-09-13T17:24:41.458 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 1867, 2024-09-13T17:24:41.458 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 26694563, 2024-09-13T17:24:41.458 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-09-13T17:24:41.458 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:41.459 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:41.459 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:41.459 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:41.459 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:41.459 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-13T17:24:42.146 INFO:tasks.check_counter:Daemon mds.f mds.exported=22 2024-09-13T17:24:42.146 INFO:tasks.check_counter:Daemon mds.f mds.imported=24 2024-09-13T17:24:42.146 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=304 2024-09-13T17:24:42.147 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=1745 2024-09-13T17:24:42.147 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=6 2024-09-13T17:24:42.147 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-09-13T17:24:42.147 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-09-13T17:24:42.147 DEBUG:tasks.check_counter:Getting stats from i 2024-09-13T17:24:42.148 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-13T17:24:42.348 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T17:24:43.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:42 smithi149 ceph-mon[35496]: pgmap v339: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:24:43.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:42 smithi087 ceph-mon[30934]: pgmap v339: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:24:43.233 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:42 smithi118 ceph-mon[34374]: pgmap v339: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:24:44.046 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-13T17:24:44.046 INFO:teuthology.orchestra.run.smithi149.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T17:24:44.046 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_messages": 26242, 2024-09-13T17:24:44.046 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages": 26362, 2024-09-13T17:24:44.046 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_bytes": 8980356, 2024-09-13T17:24:44.046 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_bytes": 49054207, 2024-09-13T17:24:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_created_connections": 191, 2024-09-13T17:24:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_active_connections": 7, 2024-09-13T17:24:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_total_time": 1.800225072, 2024-09-13T17:24:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_send_time": 0.782406216, 2024-09-13T17:24:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_recv_time": 0.876433183, 2024-09-13T17:24:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_fast_dispatch_time": 0.238093680, 2024-09-13T17:24:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 26361, 2024-09-13T17:24:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 7.586540509, 2024-09-13T17:24:44.047 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000287794 2024-09-13T17:24:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 34655, 2024-09-13T17:24:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.007556829, 2024-09-13T17:24:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000218 2024-09-13T17:24:44.048 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.049 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_encrypted_bytes": 45504, 2024-09-13T17:24:44.049 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_encrypted_bytes": 1824 2024-09-13T17:24:44.049 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.049 INFO:teuthology.orchestra.run.smithi149.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T17:24:44.049 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_messages": 11271, 2024-09-13T17:24:44.049 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages": 11216, 2024-09-13T17:24:44.049 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_bytes": 5396145, 2024-09-13T17:24:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_bytes": 25887597, 2024-09-13T17:24:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_created_connections": 15, 2024-09-13T17:24:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_active_connections": 5, 2024-09-13T17:24:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_total_time": 0.765287629, 2024-09-13T17:24:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_send_time": 0.272643983, 2024-09-13T17:24:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_recv_time": 0.199025350, 2024-09-13T17:24:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_fast_dispatch_time": 0.270787924, 2024-09-13T17:24:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 11214, 2024-09-13T17:24:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 8.694905138, 2024-09-13T17:24:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000775361 2024-09-13T17:24:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:44.050 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 296, 2024-09-13T17:24:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000055313, 2024-09-13T17:24:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000186 2024-09-13T17:24:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_encrypted_bytes": 1767456, 2024-09-13T17:24:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_encrypted_bytes": 516384 2024-09-13T17:24:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T17:24:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_messages": 64420, 2024-09-13T17:24:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages": 90304, 2024-09-13T17:24:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_bytes": 24180780, 2024-09-13T17:24:44.051 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_bytes": 50757556, 2024-09-13T17:24:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_created_connections": 17, 2024-09-13T17:24:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_active_connections": 7, 2024-09-13T17:24:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_total_time": 3.811233062, 2024-09-13T17:24:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_send_time": 1.618888165, 2024-09-13T17:24:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_recv_time": 2.324013612, 2024-09-13T17:24:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_fast_dispatch_time": 0.310774723, 2024-09-13T17:24:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 90302, 2024-09-13T17:24:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 19.273689116, 2024-09-13T17:24:44.052 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000213435 2024-09-13T17:24:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 129897, 2024-09-13T17:24:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.019811716, 2024-09-13T17:24:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000152 2024-09-13T17:24:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_encrypted_bytes": 338544, 2024-09-13T17:24:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_encrypted_bytes": 233168 2024-09-13T17:24:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: "cct": { 2024-09-13T17:24:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: "total_workers": 1, 2024-09-13T17:24:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: "unhealthy_workers": 0 2024-09-13T17:24:44.053 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "finisher-MDSRank": { 2024-09-13T17:24:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "queue_len": 0, 2024-09-13T17:24:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "complete_latency": { 2024-09-13T17:24:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 8884, 2024-09-13T17:24:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 11.886262709, 2024-09-13T17:24:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.001337940 2024-09-13T17:24:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "finisher-PurgeQueue": { 2024-09-13T17:24:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "queue_len": 0, 2024-09-13T17:24:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "complete_latency": { 2024-09-13T17:24:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 5009, 2024-09-13T17:24:44.054 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.549364278, 2024-09-13T17:24:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000109675 2024-09-13T17:24:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": { 2024-09-13T17:24:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: "request": 17401, 2024-09-13T17:24:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: "reply": 15743, 2024-09-13T17:24:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: "reply_latency": { 2024-09-13T17:24:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 15743, 2024-09-13T17:24:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 36.465983982, 2024-09-13T17:24:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.002316330 2024-09-13T17:24:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.055 INFO:teuthology.orchestra.run.smithi149.stdout: "slow_reply": 0, 2024-09-13T17:24:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: "forward": 1658, 2024-09-13T17:24:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_fetch_complete": 6, 2024-09-13T17:24:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_fetch_keys": 1, 2024-09-13T17:24:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_commit": 1028, 2024-09-13T17:24:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_split": 11, 2024-09-13T17:24:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_merge": 1, 2024-09-13T17:24:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes": 5074, 2024-09-13T17:24:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_top": 3033, 2024-09-13T17:24:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_bottom": 1875, 2024-09-13T17:24:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_pin_tail": 166, 2024-09-13T17:24:44.056 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_pinned": 714, 2024-09-13T17:24:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_expired": 7913, 2024-09-13T17:24:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_with_caps": 3, 2024-09-13T17:24:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": 3, 2024-09-13T17:24:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: "subtrees": 4, 2024-09-13T17:24:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse": 22213, 2024-09-13T17:24:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_hit": 19369, 2024-09-13T17:24:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_forward": 1571, 2024-09-13T17:24:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_discover": 245, 2024-09-13T17:24:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_dir_fetch": 0, 2024-09-13T17:24:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_remote_ino": 0, 2024-09-13T17:24:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_lock": 0, 2024-09-13T17:24:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: "load_cent": 0, 2024-09-13T17:24:44.057 INFO:teuthology.orchestra.run.smithi149.stdout: "q": 0, 2024-09-13T17:24:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: "exported": 49, 2024-09-13T17:24:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: "exported_inodes": 6490, 2024-09-13T17:24:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: "imported": 44, 2024-09-13T17:24:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: "imported_inodes": 3065, 2024-09-13T17:24:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: "openino_dir_fetch": 0, 2024-09-13T17:24:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: "openino_backtrace_fetch": 5465, 2024-09-13T17:24:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: "openino_peer_discover": 0, 2024-09-13T17:24:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: "root_rfiles": 4, 2024-09-13T17:24:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: "root_rbytes": 234, 2024-09-13T17:24:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: "root_rsnaps": 6, 2024-09-13T17:24:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_backtrace_fetch": 5465, 2024-09-13T17:24:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_set_tag": 0, 2024-09-13T17:24:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T17:24:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_inotable_repaired": 0, 2024-09-13T17:24:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_dir_inodes": 683, 2024-09-13T17:24:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_dir_base_inodes": 20, 2024-09-13T17:24:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_dirfrag_rstats": 663, 2024-09-13T17:24:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_file_inodes": 4782, 2024-09-13T17:24:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_inode_file_caps": 2, 2024-09-13T17:24:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_cap_op_revoke": 3845, 2024-09-13T17:24:44.059 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_cap_op_grant": 12002, 2024-09-13T17:24:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T17:24:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T17:24:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T17:24:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_client_caps": 14900, 2024-09-13T17:24:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_client_caps_dirty": 7547, 2024-09-13T17:24:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_client_cap_release": 125, 2024-09-13T17:24:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: "process_request_cap_release": 15140 2024-09-13T17:24:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_cache": { 2024-09-13T17:24:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_update": 588, 2024-09-13T17:24:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_update_receipt": 827, 2024-09-13T17:24:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_try_discover": 535, 2024-09-13T17:24:44.060 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_send_discover": 541, 2024-09-13T17:24:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_handle_discover": 1236, 2024-09-13T17:24:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: "num_strays": 172, 2024-09-13T17:24:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: "num_strays_delayed": 0, 2024-09-13T17:24:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: "num_strays_enqueuing": 0, 2024-09-13T17:24:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: "strays_created": 3154, 2024-09-13T17:24:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: "strays_enqueued": 2982, 2024-09-13T17:24:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: "strays_reintegrated": 0, 2024-09-13T17:24:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: "strays_migrated": 0, 2024-09-13T17:24:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: "num_recovering_processing": 0, 2024-09-13T17:24:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: "num_recovering_enqueued": 0, 2024-09-13T17:24:44.061 INFO:teuthology.orchestra.run.smithi149.stdout: "num_recovering_prioritized": 0, 2024-09-13T17:24:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: "recovery_started": 0, 2024-09-13T17:24:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: "recovery_completed": 0, 2024-09-13T17:24:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_enqueue_scrub": 20, 2024-09-13T17:24:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_exportdir": 49, 2024-09-13T17:24:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_flush": 0, 2024-09-13T17:24:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_fragmentdir": 12, 2024-09-13T17:24:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_fragstats": 0, 2024-09-13T17:24:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_inodestats": 0 2024-09-13T17:24:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_log": { 2024-09-13T17:24:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: "evadd": 26202, 2024-09-13T17:24:44.062 INFO:teuthology.orchestra.run.smithi149.stdout: "evex": 25574, 2024-09-13T17:24:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: "evtrm": 25574, 2024-09-13T17:24:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: "ev": 628, 2024-09-13T17:24:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: "evexg": 0, 2024-09-13T17:24:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: "evexd": 1378, 2024-09-13T17:24:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: "segadd": 44, 2024-09-13T17:24:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: "segex": 43, 2024-09-13T17:24:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: "segtrm": 43, 2024-09-13T17:24:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: "seg": 3, 2024-09-13T17:24:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: "segexg": 0, 2024-09-13T17:24:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: "segexd": 2, 2024-09-13T17:24:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: "expos": 60876582, 2024-09-13T17:24:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: "wrpos": 61405988, 2024-09-13T17:24:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: "rdpos": 0, 2024-09-13T17:24:44.063 INFO:teuthology.orchestra.run.smithi149.stdout: "jlat": { 2024-09-13T17:24:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 2923, 2024-09-13T17:24:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 40.535684017, 2024-09-13T17:24:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.013867835 2024-09-13T17:24:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: "replayed": 0 2024-09-13T17:24:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_mem": { 2024-09-13T17:24:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: "ino": 1994, 2024-09-13T17:24:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: "ino+": 11997, 2024-09-13T17:24:44.064 INFO:teuthology.orchestra.run.smithi149.stdout: "ino-": 10003, 2024-09-13T17:24:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: "dir": 221, 2024-09-13T17:24:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: "dir+": 1047, 2024-09-13T17:24:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: "dir-": 826, 2024-09-13T17:24:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: "dn": 5074, 2024-09-13T17:24:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: "dn+": 16392, 2024-09-13T17:24:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: "dn-": 11318, 2024-09-13T17:24:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: "cap": 3, 2024-09-13T17:24:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: "cap+": 9646, 2024-09-13T17:24:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: "cap-": 9643, 2024-09-13T17:24:44.065 INFO:teuthology.orchestra.run.smithi149.stdout: "rss": 106220, 2024-09-13T17:24:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: "heap": 207124 2024-09-13T17:24:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_server": { 2024-09-13T17:24:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: "dispatch_client_request": 23493, 2024-09-13T17:24:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: "dispatch_server_request": 1884, 2024-09-13T17:24:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_client_request": 17401, 2024-09-13T17:24:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_client_session": 83, 2024-09-13T17:24:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_peer_request": 4274, 2024-09-13T17:24:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: "req_create_latency": { 2024-09-13T17:24:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 8151, 2024-09-13T17:24:44.066 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 13.969483914, 2024-09-13T17:24:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.001713836 2024-09-13T17:24:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: "req_getattr_latency": { 2024-09-13T17:24:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 130, 2024-09-13T17:24:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.034288258, 2024-09-13T17:24:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000263755 2024-09-13T17:24:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: "req_getfilelock_latency": { 2024-09-13T17:24:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: "req_link_latency": { 2024-09-13T17:24:44.067 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookup_latency": { 2024-09-13T17:24:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 3205, 2024-09-13T17:24:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 14.421867763, 2024-09-13T17:24:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.004499802 2024-09-13T17:24:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookuphash_latency": { 2024-09-13T17:24:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:44.068 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookupino_latency": { 2024-09-13T17:24:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.069 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookupname_latency": { 2024-09-13T17:24:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookupparent_latency": { 2024-09-13T17:24:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.070 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookupsnap_latency": { 2024-09-13T17:24:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lssnap_latency": { 2024-09-13T17:24:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 11, 2024-09-13T17:24:44.071 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.001422796, 2024-09-13T17:24:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000129345 2024-09-13T17:24:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: "req_mkdir_latency": { 2024-09-13T17:24:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 623, 2024-09-13T17:24:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.646572485, 2024-09-13T17:24:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.001037837 2024-09-13T17:24:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: "req_mknod_latency": { 2024-09-13T17:24:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:44.072 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: "req_mksnap_latency": { 2024-09-13T17:24:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 11, 2024-09-13T17:24:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.097262944, 2024-09-13T17:24:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.008842085 2024-09-13T17:24:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: "req_open_latency": { 2024-09-13T17:24:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 1, 2024-09-13T17:24:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000468382, 2024-09-13T17:24:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000468382 2024-09-13T17:24:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.073 INFO:teuthology.orchestra.run.smithi149.stdout: "req_readdir_latency": { 2024-09-13T17:24:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 415, 2024-09-13T17:24:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.424462510, 2024-09-13T17:24:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.001022801 2024-09-13T17:24:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: "req_rename_latency": { 2024-09-13T17:24:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 2, 2024-09-13T17:24:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.002016439, 2024-09-13T17:24:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.001008219 2024-09-13T17:24:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: "req_renamesnap_latency": { 2024-09-13T17:24:44.074 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: "req_snapdiff_latency": { 2024-09-13T17:24:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: "req_rmdir_latency": { 2024-09-13T17:24:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 246, 2024-09-13T17:24:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 3.241908566, 2024-09-13T17:24:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.013178490 2024-09-13T17:24:44.075 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: "req_rmsnap_latency": { 2024-09-13T17:24:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 5, 2024-09-13T17:24:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.019877851, 2024-09-13T17:24:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.003975570 2024-09-13T17:24:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: "req_rmxattr_latency": { 2024-09-13T17:24:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: "req_setattr_latency": { 2024-09-13T17:24:44.076 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 27, 2024-09-13T17:24:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.025569881, 2024-09-13T17:24:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000947032 2024-09-13T17:24:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: "req_setdirlayout_latency": { 2024-09-13T17:24:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: "req_setfilelock_latency": { 2024-09-13T17:24:44.077 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: "req_setlayout_latency": { 2024-09-13T17:24:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: "req_setxattr_latency": { 2024-09-13T17:24:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 8, 2024-09-13T17:24:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.019721723, 2024-09-13T17:24:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.002465215 2024-09-13T17:24:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.078 INFO:teuthology.orchestra.run.smithi149.stdout: "req_symlink_latency": { 2024-09-13T17:24:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: "req_unlink_latency": { 2024-09-13T17:24:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 2908, 2024-09-13T17:24:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 3.561060470, 2024-09-13T17:24:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.001224573 2024-09-13T17:24:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: "cap_revoke_eviction": 0, 2024-09-13T17:24:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: "cap_acquisition_throttle": 0, 2024-09-13T17:24:44.079 INFO:teuthology.orchestra.run.smithi149.stdout: "req_getvxattr_latency": { 2024-09-13T17:24:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_sessions": { 2024-09-13T17:24:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: "session_count": 2, 2024-09-13T17:24:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: "session_add": 6, 2024-09-13T17:24:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: "session_remove": 4, 2024-09-13T17:24:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: "sessions_open": 2, 2024-09-13T17:24:44.080 INFO:teuthology.orchestra.run.smithi149.stdout: "sessions_stale": 0, 2024-09-13T17:24:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: "total_load": 91, 2024-09-13T17:24:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: "average_load": 45, 2024-09-13T17:24:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: "avg_session_uptime": 645, 2024-09-13T17:24:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: "mdthresh_evicted": 0 2024-09-13T17:24:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: "mempool": { 2024-09-13T17:24:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: "bloom_filter_bytes": 360, 2024-09-13T17:24:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: "bloom_filter_items": 360, 2024-09-13T17:24:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T17:24:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_alloc_items": 0, 2024-09-13T17:24:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T17:24:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_data_items": 0, 2024-09-13T17:24:44.081 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T17:24:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T17:24:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T17:24:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T17:24:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T17:24:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_other_items": 0, 2024-09-13T17:24:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T17:24:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T17:24:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_extent_bytes": 0, 2024-09-13T17:24:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_extent_items": 0, 2024-09-13T17:24:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_blob_bytes": 0, 2024-09-13T17:24:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_blob_items": 0, 2024-09-13T17:24:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T17:24:44.082 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T17:24:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T17:24:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T17:24:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T17:24:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_fsck_items": 0, 2024-09-13T17:24:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_txc_bytes": 0, 2024-09-13T17:24:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_txc_items": 0, 2024-09-13T17:24:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T17:24:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T17:24:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_writing_bytes": 0, 2024-09-13T17:24:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_writing_items": 0, 2024-09-13T17:24:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_bytes": 0, 2024-09-13T17:24:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_items": 0, 2024-09-13T17:24:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T17:24:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_file_reader_items": 0, 2024-09-13T17:24:44.083 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T17:24:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_file_writer_items": 0, 2024-09-13T17:24:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: "buffer_anon_bytes": 1589667, 2024-09-13T17:24:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: "buffer_anon_items": 444, 2024-09-13T17:24:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: "buffer_meta_bytes": 0, 2024-09-13T17:24:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: "buffer_meta_items": 0, 2024-09-13T17:24:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_bytes": 0, 2024-09-13T17:24:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_items": 0, 2024-09-13T17:24:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_mapbl_bytes": 0, 2024-09-13T17:24:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_mapbl_items": 0, 2024-09-13T17:24:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_pglog_bytes": 0, 2024-09-13T17:24:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_pglog_items": 0, 2024-09-13T17:24:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_bytes": 10008, 2024-09-13T17:24:44.084 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_items": 204, 2024-09-13T17:24:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T17:24:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_mapping_items": 0, 2024-09-13T17:24:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: "pgmap_bytes": 0, 2024-09-13T17:24:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: "pgmap_items": 0, 2024-09-13T17:24:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_co_bytes": 8329829, 2024-09-13T17:24:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_co_items": 95464, 2024-09-13T17:24:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: "unittest_1_bytes": 0, 2024-09-13T17:24:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: "unittest_1_items": 0, 2024-09-13T17:24:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: "unittest_2_bytes": 0, 2024-09-13T17:24:44.085 INFO:teuthology.orchestra.run.smithi149.stdout: "unittest_2_items": 0 2024-09-13T17:24:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: "objecter": { 2024-09-13T17:24:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: "op_active": 0, 2024-09-13T17:24:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: "op_laggy": 0, 2024-09-13T17:24:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: "op_send": 28188, 2024-09-13T17:24:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: "op_send_bytes": 71078881, 2024-09-13T17:24:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: "op_resend": 37, 2024-09-13T17:24:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: "op_reply": 28188, 2024-09-13T17:24:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: "op_latency": { 2024-09-13T17:24:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 28188, 2024-09-13T17:24:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 3791.372577567, 2024-09-13T17:24:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.134503071 2024-09-13T17:24:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: "op_inflight": 0, 2024-09-13T17:24:44.086 INFO:teuthology.orchestra.run.smithi149.stdout: "oplen_avg": { 2024-09-13T17:24:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 28188, 2024-09-13T17:24:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 48524 2024-09-13T17:24:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: "op": 28188, 2024-09-13T17:24:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: "op_r": 5600, 2024-09-13T17:24:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: "op_w": 22588, 2024-09-13T17:24:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: "op_rmw": 0, 2024-09-13T17:24:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: "op_pg": 0, 2024-09-13T17:24:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_stat": 531, 2024-09-13T17:24:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_create": 11908, 2024-09-13T17:24:44.087 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_read": 108, 2024-09-13T17:24:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_write": 3011, 2024-09-13T17:24:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_writefull": 111, 2024-09-13T17:24:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_writesame": 0, 2024-09-13T17:24:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_append": 0, 2024-09-13T17:24:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_zero": 0, 2024-09-13T17:24:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_truncate": 11, 2024-09-13T17:24:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_delete": 6462, 2024-09-13T17:24:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_mapext": 0, 2024-09-13T17:24:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_sparse_read": 0, 2024-09-13T17:24:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_clonerange": 0, 2024-09-13T17:24:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_getxattr": 5492, 2024-09-13T17:24:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_setxattr": 18529, 2024-09-13T17:24:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_cmpxattr": 0, 2024-09-13T17:24:44.088 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_rmxattr": 0, 2024-09-13T17:24:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_resetxattrs": 0, 2024-09-13T17:24:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_call": 0, 2024-09-13T17:24:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_watch": 0, 2024-09-13T17:24:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_notify": 0, 2024-09-13T17:24:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T17:24:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_pgls": 0, 2024-09-13T17:24:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_pgls_filter": 0, 2024-09-13T17:24:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_other": 0, 2024-09-13T17:24:44.089 INFO:teuthology.orchestra.run.smithi149.stdout: "linger_active": 0, 2024-09-13T17:24:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: "linger_send": 0, 2024-09-13T17:24:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: "linger_resend": 0, 2024-09-13T17:24:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: "linger_ping": 0, 2024-09-13T17:24:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: "poolop_active": 0, 2024-09-13T17:24:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: "poolop_send": 0, 2024-09-13T17:24:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: "poolop_resend": 0, 2024-09-13T17:24:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: "poolstat_active": 0, 2024-09-13T17:24:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: "poolstat_send": 0, 2024-09-13T17:24:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: "poolstat_resend": 0, 2024-09-13T17:24:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: "statfs_active": 0, 2024-09-13T17:24:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: "statfs_send": 0, 2024-09-13T17:24:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: "statfs_resend": 0, 2024-09-13T17:24:44.090 INFO:teuthology.orchestra.run.smithi149.stdout: "command_active": 0, 2024-09-13T17:24:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "command_send": 0, 2024-09-13T17:24:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "command_resend": 0, 2024-09-13T17:24:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "map_epoch": 104, 2024-09-13T17:24:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "map_full": 0, 2024-09-13T17:24:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "map_inc": 20, 2024-09-13T17:24:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_sessions": 12, 2024-09-13T17:24:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_session_open": 12, 2024-09-13T17:24:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_session_close": 0, 2024-09-13T17:24:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_laggy": 0, 2024-09-13T17:24:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_wr": 2098, 2024-09-13T17:24:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_rd": 14, 2024-09-13T17:24:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_del": 249 2024-09-13T17:24:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "oft": { 2024-09-13T17:24:44.091 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_total_objs": 1, 2024-09-13T17:24:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_total_kv_pairs": 0, 2024-09-13T17:24:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_total_updates": 0, 2024-09-13T17:24:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_total_removes": 0 2024-09-13T17:24:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: "osd-slow-ops": { 2024-09-13T17:24:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: "slow_ops_count": 0 2024-09-13T17:24:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: "purge_queue": { 2024-09-13T17:24:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executing_ops": 0, 2024-09-13T17:24:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executing_ops_high_water": 23, 2024-09-13T17:24:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executing": 0, 2024-09-13T17:24:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executing_high_water": 16, 2024-09-13T17:24:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executed_ops": 5922, 2024-09-13T17:24:44.092 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executed": 2982, 2024-09-13T17:24:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_item_in_journal": 0 2024-09-13T17:24:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T17:24:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-09-13T17:24:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 104857600, 2024-09-13T17:24:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-09-13T17:24:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 101929, 2024-09-13T17:24:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 29312774, 2024-09-13T17:24:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 101929, 2024-09-13T17:24:44.093 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 0, 2024-09-13T17:24:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 0, 2024-09-13T17:24:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 101929, 2024-09-13T17:24:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 29312774, 2024-09-13T17:24:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-09-13T17:24:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-objecter_bytes": { 2024-09-13T17:24:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-09-13T17:24:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 104857600, 2024-09-13T17:24:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-09-13T17:24:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 0, 2024-09-13T17:24:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 0, 2024-09-13T17:24:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 0, 2024-09-13T17:24:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 28188, 2024-09-13T17:24:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 71413235, 2024-09-13T17:24:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 28188, 2024-09-13T17:24:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 71413235, 2024-09-13T17:24:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-09-13T17:24:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:44.095 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-objecter_ops": { 2024-09-13T17:24:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-09-13T17:24:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 1024, 2024-09-13T17:24:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-09-13T17:24:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 0, 2024-09-13T17:24:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 0, 2024-09-13T17:24:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 0, 2024-09-13T17:24:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 28188, 2024-09-13T17:24:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 28188, 2024-09-13T17:24:44.096 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 28188, 2024-09-13T17:24:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 28188, 2024-09-13T17:24:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-09-13T17:24:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-write_buf_throttle": { 2024-09-13T17:24:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-09-13T17:24:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 3758096384, 2024-09-13T17:24:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-09-13T17:24:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 2982, 2024-09-13T17:24:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 334454, 2024-09-13T17:24:44.097 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 2982, 2024-09-13T17:24:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 0, 2024-09-13T17:24:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 0, 2024-09-13T17:24:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 88, 2024-09-13T17:24:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 334454, 2024-09-13T17:24:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-09-13T17:24:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-write_buf_throttle-0x5622b01d2500": { 2024-09-13T17:24:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-09-13T17:24:44.098 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 3758096384, 2024-09-13T17:24:44.099 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-09-13T17:24:44.099 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 26202, 2024-09-13T17:24:44.099 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 57211684, 2024-09-13T17:24:44.099 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:44.099 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 26202, 2024-09-13T17:24:44.099 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 0, 2024-09-13T17:24:44.099 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 0, 2024-09-13T17:24:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 2923, 2024-09-13T17:24:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 57211684, 2024-09-13T17:24:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-09-13T17:24:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:44.100 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:44.101 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:44.101 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-13T17:24:44.764 INFO:tasks.check_counter:Daemon mds.i mds.exported=49 2024-09-13T17:24:44.764 INFO:tasks.check_counter:Daemon mds.i mds.imported=44 2024-09-13T17:24:44.765 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=588 2024-09-13T17:24:44.765 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=827 2024-09-13T17:24:44.765 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-13T17:24:44.765 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=11 2024-09-13T17:24:44.765 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=5 2024-09-13T17:24:44.765 DEBUG:tasks.check_counter:Getting stats from l 2024-09-13T17:24:44.765 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-13T17:24:44.966 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T17:24:45.087 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:44 smithi149 ceph-mon[35496]: pgmap v340: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:24:45.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:44 smithi087 ceph-mon[30934]: pgmap v340: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:24:45.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:44 smithi118 ceph-mon[34374]: pgmap v340: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:24:46.704 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-13T17:24:46.704 INFO:teuthology.orchestra.run.smithi149.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T17:24:46.704 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_messages": 781, 2024-09-13T17:24:46.704 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages": 783, 2024-09-13T17:24:46.704 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_bytes": 10125404, 2024-09-13T17:24:46.704 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_bytes": 242955, 2024-09-13T17:24:46.704 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_created_connections": 7, 2024-09-13T17:24:46.704 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_active_connections": 3, 2024-09-13T17:24:46.704 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_total_time": 0.072953215, 2024-09-13T17:24:46.704 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_send_time": 0.021255843, 2024-09-13T17:24:46.704 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_recv_time": 0.023919365, 2024-09-13T17:24:46.705 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_fast_dispatch_time": 0.020130537, 2024-09-13T17:24:46.705 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:46.705 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 781, 2024-09-13T17:24:46.705 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.034663140, 2024-09-13T17:24:46.705 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000044383 2024-09-13T17:24:46.705 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.705 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:46.705 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.705 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.705 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.705 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.705 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T17:24:46.705 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T17:24:46.706 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.706 INFO:teuthology.orchestra.run.smithi149.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T17:24:46.706 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_messages": 688, 2024-09-13T17:24:46.706 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages": 857, 2024-09-13T17:24:46.706 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_bytes": 12763400, 2024-09-13T17:24:46.706 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_bytes": 660459, 2024-09-13T17:24:46.706 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_created_connections": 7, 2024-09-13T17:24:46.706 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_active_connections": 5, 2024-09-13T17:24:46.706 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_total_time": 0.079476397, 2024-09-13T17:24:46.706 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_send_time": 0.031305290, 2024-09-13T17:24:46.706 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_recv_time": 0.023633630, 2024-09-13T17:24:46.706 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_fast_dispatch_time": 0.016926552, 2024-09-13T17:24:46.706 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:46.707 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 855, 2024-09-13T17:24:46.707 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.045476730, 2024-09-13T17:24:46.707 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000053189 2024-09-13T17:24:46.707 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.707 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:46.707 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.707 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.707 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.707 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.707 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_encrypted_bytes": 3280, 2024-09-13T17:24:46.707 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_encrypted_bytes": 448352 2024-09-13T17:24:46.707 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.707 INFO:teuthology.orchestra.run.smithi149.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T17:24:46.708 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_messages": 1090, 2024-09-13T17:24:46.708 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages": 1066, 2024-09-13T17:24:46.708 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_bytes": 6105816, 2024-09-13T17:24:46.708 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_bytes": 387011, 2024-09-13T17:24:46.708 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_created_connections": 4, 2024-09-13T17:24:46.708 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_active_connections": 3, 2024-09-13T17:24:46.708 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_total_time": 0.144355650, 2024-09-13T17:24:46.708 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_send_time": 0.045192307, 2024-09-13T17:24:46.708 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_recv_time": 0.075152207, 2024-09-13T17:24:46.708 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_fast_dispatch_time": 0.030921685, 2024-09-13T17:24:46.708 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T17:24:46.708 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 1065, 2024-09-13T17:24:46.708 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.056839453, 2024-09-13T17:24:46.709 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000053370 2024-09-13T17:24:46.709 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.709 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_handle_ack_lat": { 2024-09-13T17:24:46.709 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.709 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.709 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.709 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.709 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_encrypted_bytes": 1639168, 2024-09-13T17:24:46.709 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_encrypted_bytes": 131680 2024-09-13T17:24:46.709 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.709 INFO:teuthology.orchestra.run.smithi149.stdout: "cct": { 2024-09-13T17:24:46.709 INFO:teuthology.orchestra.run.smithi149.stdout: "total_workers": 1, 2024-09-13T17:24:46.709 INFO:teuthology.orchestra.run.smithi149.stdout: "unhealthy_workers": 0 2024-09-13T17:24:46.710 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.710 INFO:teuthology.orchestra.run.smithi149.stdout: "finisher-MDSRank": { 2024-09-13T17:24:46.710 INFO:teuthology.orchestra.run.smithi149.stdout: "queue_len": 0, 2024-09-13T17:24:46.710 INFO:teuthology.orchestra.run.smithi149.stdout: "complete_latency": { 2024-09-13T17:24:46.710 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 3875, 2024-09-13T17:24:46.710 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.111645913, 2024-09-13T17:24:46.710 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000028811 2024-09-13T17:24:46.710 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:46.710 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.710 INFO:teuthology.orchestra.run.smithi149.stdout: "finisher-PurgeQueue": { 2024-09-13T17:24:46.710 INFO:teuthology.orchestra.run.smithi149.stdout: "queue_len": 0, 2024-09-13T17:24:46.710 INFO:teuthology.orchestra.run.smithi149.stdout: "complete_latency": { 2024-09-13T17:24:46.710 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.710 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.711 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.711 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:46.711 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.711 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": { 2024-09-13T17:24:46.711 INFO:teuthology.orchestra.run.smithi149.stdout: "request": 0, 2024-09-13T17:24:46.711 INFO:teuthology.orchestra.run.smithi149.stdout: "reply": 0, 2024-09-13T17:24:46.711 INFO:teuthology.orchestra.run.smithi149.stdout: "reply_latency": { 2024-09-13T17:24:46.711 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.711 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.711 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.711 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.711 INFO:teuthology.orchestra.run.smithi149.stdout: "slow_reply": 0, 2024-09-13T17:24:46.711 INFO:teuthology.orchestra.run.smithi149.stdout: "forward": 0, 2024-09-13T17:24:46.712 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_fetch_complete": 0, 2024-09-13T17:24:46.712 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_fetch_keys": 0, 2024-09-13T17:24:46.712 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_commit": 0, 2024-09-13T17:24:46.712 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_split": 0, 2024-09-13T17:24:46.712 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_merge": 0, 2024-09-13T17:24:46.712 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes": 5576, 2024-09-13T17:24:46.712 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_top": 0, 2024-09-13T17:24:46.712 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_bottom": 5576, 2024-09-13T17:24:46.712 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_pin_tail": 0, 2024-09-13T17:24:46.712 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_pinned": 5576, 2024-09-13T17:24:46.712 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_expired": 0, 2024-09-13T17:24:46.712 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_with_caps": 0, 2024-09-13T17:24:46.712 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": 0, 2024-09-13T17:24:46.713 INFO:teuthology.orchestra.run.smithi149.stdout: "subtrees": 1, 2024-09-13T17:24:46.713 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse": 0, 2024-09-13T17:24:46.713 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_hit": 0, 2024-09-13T17:24:46.713 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_forward": 0, 2024-09-13T17:24:46.713 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_discover": 0, 2024-09-13T17:24:46.713 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_dir_fetch": 0, 2024-09-13T17:24:46.713 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_remote_ino": 0, 2024-09-13T17:24:46.713 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_lock": 0, 2024-09-13T17:24:46.713 INFO:teuthology.orchestra.run.smithi149.stdout: "load_cent": 0, 2024-09-13T17:24:46.713 INFO:teuthology.orchestra.run.smithi149.stdout: "q": 0, 2024-09-13T17:24:46.713 INFO:teuthology.orchestra.run.smithi149.stdout: "exported": 0, 2024-09-13T17:24:46.713 INFO:teuthology.orchestra.run.smithi149.stdout: "exported_inodes": 0, 2024-09-13T17:24:46.714 INFO:teuthology.orchestra.run.smithi149.stdout: "imported": 0, 2024-09-13T17:24:46.714 INFO:teuthology.orchestra.run.smithi149.stdout: "imported_inodes": 0, 2024-09-13T17:24:46.714 INFO:teuthology.orchestra.run.smithi149.stdout: "openino_dir_fetch": 0, 2024-09-13T17:24:46.714 INFO:teuthology.orchestra.run.smithi149.stdout: "openino_backtrace_fetch": 0, 2024-09-13T17:24:46.714 INFO:teuthology.orchestra.run.smithi149.stdout: "openino_peer_discover": 0, 2024-09-13T17:24:46.714 INFO:teuthology.orchestra.run.smithi149.stdout: "root_rfiles": 0, 2024-09-13T17:24:46.714 INFO:teuthology.orchestra.run.smithi149.stdout: "root_rbytes": 0, 2024-09-13T17:24:46.714 INFO:teuthology.orchestra.run.smithi149.stdout: "root_rsnaps": 0, 2024-09-13T17:24:46.714 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T17:24:46.714 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_set_tag": 0, 2024-09-13T17:24:46.714 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T17:24:46.714 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_inotable_repaired": 0, 2024-09-13T17:24:46.714 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_dir_inodes": 0, 2024-09-13T17:24:46.715 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T17:24:46.715 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T17:24:46.715 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_file_inodes": 0, 2024-09-13T17:24:46.715 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_inode_file_caps": 0, 2024-09-13T17:24:46.715 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_cap_op_revoke": 0, 2024-09-13T17:24:46.715 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_cap_op_grant": 0, 2024-09-13T17:24:46.715 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T17:24:46.715 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T17:24:46.715 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T17:24:46.715 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_client_caps": 0, 2024-09-13T17:24:46.715 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_client_caps_dirty": 0, 2024-09-13T17:24:46.715 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_client_cap_release": 0, 2024-09-13T17:24:46.715 INFO:teuthology.orchestra.run.smithi149.stdout: "process_request_cap_release": 0 2024-09-13T17:24:46.716 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.716 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_cache": { 2024-09-13T17:24:46.716 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_update": 0, 2024-09-13T17:24:46.716 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_update_receipt": 0, 2024-09-13T17:24:46.716 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_try_discover": 0, 2024-09-13T17:24:46.716 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_send_discover": 0, 2024-09-13T17:24:46.716 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_handle_discover": 0, 2024-09-13T17:24:46.716 INFO:teuthology.orchestra.run.smithi149.stdout: "num_strays": 0, 2024-09-13T17:24:46.716 INFO:teuthology.orchestra.run.smithi149.stdout: "num_strays_delayed": 0, 2024-09-13T17:24:46.716 INFO:teuthology.orchestra.run.smithi149.stdout: "num_strays_enqueuing": 0, 2024-09-13T17:24:46.716 INFO:teuthology.orchestra.run.smithi149.stdout: "strays_created": 0, 2024-09-13T17:24:46.716 INFO:teuthology.orchestra.run.smithi149.stdout: "strays_enqueued": 0, 2024-09-13T17:24:46.716 INFO:teuthology.orchestra.run.smithi149.stdout: "strays_reintegrated": 0, 2024-09-13T17:24:46.716 INFO:teuthology.orchestra.run.smithi149.stdout: "strays_migrated": 0, 2024-09-13T17:24:46.717 INFO:teuthology.orchestra.run.smithi149.stdout: "num_recovering_processing": 0, 2024-09-13T17:24:46.717 INFO:teuthology.orchestra.run.smithi149.stdout: "num_recovering_enqueued": 0, 2024-09-13T17:24:46.717 INFO:teuthology.orchestra.run.smithi149.stdout: "num_recovering_prioritized": 0, 2024-09-13T17:24:46.717 INFO:teuthology.orchestra.run.smithi149.stdout: "recovery_started": 0, 2024-09-13T17:24:46.717 INFO:teuthology.orchestra.run.smithi149.stdout: "recovery_completed": 0, 2024-09-13T17:24:46.717 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T17:24:46.717 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_exportdir": 0, 2024-09-13T17:24:46.717 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_flush": 0, 2024-09-13T17:24:46.717 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_fragmentdir": 0, 2024-09-13T17:24:46.717 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_fragstats": 0, 2024-09-13T17:24:46.717 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_inodestats": 0 2024-09-13T17:24:46.717 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.717 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_log": { 2024-09-13T17:24:46.718 INFO:teuthology.orchestra.run.smithi149.stdout: "evadd": 0, 2024-09-13T17:24:46.718 INFO:teuthology.orchestra.run.smithi149.stdout: "evex": 0, 2024-09-13T17:24:46.718 INFO:teuthology.orchestra.run.smithi149.stdout: "evtrm": 0, 2024-09-13T17:24:46.718 INFO:teuthology.orchestra.run.smithi149.stdout: "ev": 13390, 2024-09-13T17:24:46.718 INFO:teuthology.orchestra.run.smithi149.stdout: "evexg": 0, 2024-09-13T17:24:46.718 INFO:teuthology.orchestra.run.smithi149.stdout: "evexd": 0, 2024-09-13T17:24:46.718 INFO:teuthology.orchestra.run.smithi149.stdout: "segadd": 0, 2024-09-13T17:24:46.718 INFO:teuthology.orchestra.run.smithi149.stdout: "segex": 0, 2024-09-13T17:24:46.718 INFO:teuthology.orchestra.run.smithi149.stdout: "segtrm": 0, 2024-09-13T17:24:46.718 INFO:teuthology.orchestra.run.smithi149.stdout: "seg": 16, 2024-09-13T17:24:46.718 INFO:teuthology.orchestra.run.smithi149.stdout: "segexg": 0, 2024-09-13T17:24:46.718 INFO:teuthology.orchestra.run.smithi149.stdout: "segexd": 0, 2024-09-13T17:24:46.718 INFO:teuthology.orchestra.run.smithi149.stdout: "expos": 4194304, 2024-09-13T17:24:46.718 INFO:teuthology.orchestra.run.smithi149.stdout: "wrpos": 30888867, 2024-09-13T17:24:46.719 INFO:teuthology.orchestra.run.smithi149.stdout: "rdpos": 30886306, 2024-09-13T17:24:46.719 INFO:teuthology.orchestra.run.smithi149.stdout: "jlat": { 2024-09-13T17:24:46.719 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.719 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.719 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.719 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.719 INFO:teuthology.orchestra.run.smithi149.stdout: "replayed": 13390 2024-09-13T17:24:46.719 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.719 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_mem": { 2024-09-13T17:24:46.719 INFO:teuthology.orchestra.run.smithi149.stdout: "ino": 838, 2024-09-13T17:24:46.719 INFO:teuthology.orchestra.run.smithi149.stdout: "ino+": 5302, 2024-09-13T17:24:46.719 INFO:teuthology.orchestra.run.smithi149.stdout: "ino-": 4464, 2024-09-13T17:24:46.719 INFO:teuthology.orchestra.run.smithi149.stdout: "dir": 99, 2024-09-13T17:24:46.720 INFO:teuthology.orchestra.run.smithi149.stdout: "dir+": 222, 2024-09-13T17:24:46.720 INFO:teuthology.orchestra.run.smithi149.stdout: "dir-": 123, 2024-09-13T17:24:46.720 INFO:teuthology.orchestra.run.smithi149.stdout: "dn": 5576, 2024-09-13T17:24:46.720 INFO:teuthology.orchestra.run.smithi149.stdout: "dn+": 7983, 2024-09-13T17:24:46.720 INFO:teuthology.orchestra.run.smithi149.stdout: "dn-": 2407, 2024-09-13T17:24:46.720 INFO:teuthology.orchestra.run.smithi149.stdout: "cap": 0, 2024-09-13T17:24:46.720 INFO:teuthology.orchestra.run.smithi149.stdout: "cap+": 0, 2024-09-13T17:24:46.720 INFO:teuthology.orchestra.run.smithi149.stdout: "cap-": 0, 2024-09-13T17:24:46.720 INFO:teuthology.orchestra.run.smithi149.stdout: "rss": 58832, 2024-09-13T17:24:46.720 INFO:teuthology.orchestra.run.smithi149.stdout: "heap": 207124 2024-09-13T17:24:46.720 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.720 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_server": { 2024-09-13T17:24:46.720 INFO:teuthology.orchestra.run.smithi149.stdout: "dispatch_client_request": 0, 2024-09-13T17:24:46.721 INFO:teuthology.orchestra.run.smithi149.stdout: "dispatch_server_request": 0, 2024-09-13T17:24:46.721 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_client_request": 0, 2024-09-13T17:24:46.721 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_client_session": 0, 2024-09-13T17:24:46.721 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_peer_request": 0, 2024-09-13T17:24:46.721 INFO:teuthology.orchestra.run.smithi149.stdout: "req_create_latency": { 2024-09-13T17:24:46.721 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.721 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.721 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.721 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.721 INFO:teuthology.orchestra.run.smithi149.stdout: "req_getattr_latency": { 2024-09-13T17:24:46.721 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.721 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.721 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.722 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.722 INFO:teuthology.orchestra.run.smithi149.stdout: "req_getfilelock_latency": { 2024-09-13T17:24:46.722 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.722 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.722 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.722 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.722 INFO:teuthology.orchestra.run.smithi149.stdout: "req_link_latency": { 2024-09-13T17:24:46.722 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.722 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.722 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.722 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.722 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookup_latency": { 2024-09-13T17:24:46.722 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.722 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.723 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.723 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.723 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookuphash_latency": { 2024-09-13T17:24:46.723 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.723 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.723 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.723 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.723 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookupino_latency": { 2024-09-13T17:24:46.723 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.723 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.724 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.724 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.724 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookupname_latency": { 2024-09-13T17:24:46.724 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.724 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.724 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.724 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.724 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookupparent_latency": { 2024-09-13T17:24:46.724 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.724 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.724 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.724 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.724 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookupsnap_latency": { 2024-09-13T17:24:46.725 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.725 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.725 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.725 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.725 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lssnap_latency": { 2024-09-13T17:24:46.725 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.725 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.725 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.725 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.725 INFO:teuthology.orchestra.run.smithi149.stdout: "req_mkdir_latency": { 2024-09-13T17:24:46.725 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.725 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.726 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.726 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.726 INFO:teuthology.orchestra.run.smithi149.stdout: "req_mknod_latency": { 2024-09-13T17:24:46.726 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.726 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.726 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.726 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.726 INFO:teuthology.orchestra.run.smithi149.stdout: "req_mksnap_latency": { 2024-09-13T17:24:46.726 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.726 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.726 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.726 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.726 INFO:teuthology.orchestra.run.smithi149.stdout: "req_open_latency": { 2024-09-13T17:24:46.726 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.727 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.727 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.727 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.727 INFO:teuthology.orchestra.run.smithi149.stdout: "req_readdir_latency": { 2024-09-13T17:24:46.727 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.727 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.727 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.727 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.727 INFO:teuthology.orchestra.run.smithi149.stdout: "req_rename_latency": { 2024-09-13T17:24:46.727 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.727 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.727 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.727 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.728 INFO:teuthology.orchestra.run.smithi149.stdout: "req_renamesnap_latency": { 2024-09-13T17:24:46.728 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.728 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.728 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.728 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.728 INFO:teuthology.orchestra.run.smithi149.stdout: "req_snapdiff_latency": { 2024-09-13T17:24:46.728 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.728 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.728 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.728 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.728 INFO:teuthology.orchestra.run.smithi149.stdout: "req_rmdir_latency": { 2024-09-13T17:24:46.728 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.728 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.728 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.729 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.729 INFO:teuthology.orchestra.run.smithi149.stdout: "req_rmsnap_latency": { 2024-09-13T17:24:46.729 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.729 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.729 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.729 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.729 INFO:teuthology.orchestra.run.smithi149.stdout: "req_rmxattr_latency": { 2024-09-13T17:24:46.729 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.729 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.729 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.729 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.729 INFO:teuthology.orchestra.run.smithi149.stdout: "req_setattr_latency": { 2024-09-13T17:24:46.729 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.729 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.730 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.730 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.730 INFO:teuthology.orchestra.run.smithi149.stdout: "req_setdirlayout_latency": { 2024-09-13T17:24:46.730 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.730 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.730 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.730 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.730 INFO:teuthology.orchestra.run.smithi149.stdout: "req_setfilelock_latency": { 2024-09-13T17:24:46.730 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.730 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.730 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.730 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.730 INFO:teuthology.orchestra.run.smithi149.stdout: "req_setlayout_latency": { 2024-09-13T17:24:46.731 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.731 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.731 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.731 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.731 INFO:teuthology.orchestra.run.smithi149.stdout: "req_setxattr_latency": { 2024-09-13T17:24:46.731 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.731 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.731 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.731 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.731 INFO:teuthology.orchestra.run.smithi149.stdout: "req_symlink_latency": { 2024-09-13T17:24:46.731 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.731 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.731 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.731 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.732 INFO:teuthology.orchestra.run.smithi149.stdout: "req_unlink_latency": { 2024-09-13T17:24:46.732 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.732 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.732 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.732 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.732 INFO:teuthology.orchestra.run.smithi149.stdout: "cap_revoke_eviction": 0, 2024-09-13T17:24:46.732 INFO:teuthology.orchestra.run.smithi149.stdout: "cap_acquisition_throttle": 0, 2024-09-13T17:24:46.732 INFO:teuthology.orchestra.run.smithi149.stdout: "req_getvxattr_latency": { 2024-09-13T17:24:46.732 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.732 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.732 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.732 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:46.732 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.732 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_sessions": { 2024-09-13T17:24:46.733 INFO:teuthology.orchestra.run.smithi149.stdout: "session_count": 2, 2024-09-13T17:24:46.733 INFO:teuthology.orchestra.run.smithi149.stdout: "session_add": 4, 2024-09-13T17:24:46.733 INFO:teuthology.orchestra.run.smithi149.stdout: "session_remove": 2, 2024-09-13T17:24:46.733 INFO:teuthology.orchestra.run.smithi149.stdout: "sessions_open": 4, 2024-09-13T17:24:46.733 INFO:teuthology.orchestra.run.smithi149.stdout: "sessions_stale": 0, 2024-09-13T17:24:46.733 INFO:teuthology.orchestra.run.smithi149.stdout: "total_load": 0, 2024-09-13T17:24:46.733 INFO:teuthology.orchestra.run.smithi149.stdout: "average_load": 0, 2024-09-13T17:24:46.733 INFO:teuthology.orchestra.run.smithi149.stdout: "avg_session_uptime": 2773, 2024-09-13T17:24:46.733 INFO:teuthology.orchestra.run.smithi149.stdout: "mdthresh_evicted": 0 2024-09-13T17:24:46.733 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.733 INFO:teuthology.orchestra.run.smithi149.stdout: "mempool": { 2024-09-13T17:24:46.733 INFO:teuthology.orchestra.run.smithi149.stdout: "bloom_filter_bytes": 0, 2024-09-13T17:24:46.733 INFO:teuthology.orchestra.run.smithi149.stdout: "bloom_filter_items": 0, 2024-09-13T17:24:46.733 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T17:24:46.734 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_alloc_items": 0, 2024-09-13T17:24:46.734 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T17:24:46.734 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_data_items": 0, 2024-09-13T17:24:46.734 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T17:24:46.734 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T17:24:46.734 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T17:24:46.734 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T17:24:46.734 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T17:24:46.734 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_other_items": 0, 2024-09-13T17:24:46.734 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T17:24:46.734 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T17:24:46.734 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_extent_bytes": 0, 2024-09-13T17:24:46.734 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_extent_items": 0, 2024-09-13T17:24:46.734 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_blob_bytes": 0, 2024-09-13T17:24:46.735 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_blob_items": 0, 2024-09-13T17:24:46.735 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T17:24:46.735 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T17:24:46.735 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T17:24:46.735 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T17:24:46.735 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T17:24:46.735 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_fsck_items": 0, 2024-09-13T17:24:46.735 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_txc_bytes": 0, 2024-09-13T17:24:46.735 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_txc_items": 0, 2024-09-13T17:24:46.735 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T17:24:46.735 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T17:24:46.735 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_writing_bytes": 0, 2024-09-13T17:24:46.735 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_writing_items": 0, 2024-09-13T17:24:46.735 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_bytes": 0, 2024-09-13T17:24:46.735 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_items": 0, 2024-09-13T17:24:46.736 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T17:24:46.736 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_file_reader_items": 0, 2024-09-13T17:24:46.736 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T17:24:46.736 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_file_writer_items": 0, 2024-09-13T17:24:46.736 INFO:teuthology.orchestra.run.smithi149.stdout: "buffer_anon_bytes": 206377, 2024-09-13T17:24:46.736 INFO:teuthology.orchestra.run.smithi149.stdout: "buffer_anon_items": 62, 2024-09-13T17:24:46.736 INFO:teuthology.orchestra.run.smithi149.stdout: "buffer_meta_bytes": 0, 2024-09-13T17:24:46.736 INFO:teuthology.orchestra.run.smithi149.stdout: "buffer_meta_items": 0, 2024-09-13T17:24:46.736 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_bytes": 0, 2024-09-13T17:24:46.736 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_items": 0, 2024-09-13T17:24:46.736 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_mapbl_bytes": 0, 2024-09-13T17:24:46.736 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_mapbl_items": 0, 2024-09-13T17:24:46.736 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_pglog_bytes": 0, 2024-09-13T17:24:46.736 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_pglog_items": 0, 2024-09-13T17:24:46.737 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_bytes": 10008, 2024-09-13T17:24:46.737 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_items": 204, 2024-09-13T17:24:46.737 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T17:24:46.737 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_mapping_items": 0, 2024-09-13T17:24:46.737 INFO:teuthology.orchestra.run.smithi149.stdout: "pgmap_bytes": 0, 2024-09-13T17:24:46.737 INFO:teuthology.orchestra.run.smithi149.stdout: "pgmap_items": 0, 2024-09-13T17:24:46.737 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_co_bytes": 5884959, 2024-09-13T17:24:46.737 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_co_items": 51810, 2024-09-13T17:24:46.737 INFO:teuthology.orchestra.run.smithi149.stdout: "unittest_1_bytes": 0, 2024-09-13T17:24:46.737 INFO:teuthology.orchestra.run.smithi149.stdout: "unittest_1_items": 0, 2024-09-13T17:24:46.737 INFO:teuthology.orchestra.run.smithi149.stdout: "unittest_2_bytes": 0, 2024-09-13T17:24:46.737 INFO:teuthology.orchestra.run.smithi149.stdout: "unittest_2_items": 0 2024-09-13T17:24:46.737 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.737 INFO:teuthology.orchestra.run.smithi149.stdout: "objecter": { 2024-09-13T17:24:46.738 INFO:teuthology.orchestra.run.smithi149.stdout: "op_active": 0, 2024-09-13T17:24:46.738 INFO:teuthology.orchestra.run.smithi149.stdout: "op_laggy": 0, 2024-09-13T17:24:46.738 INFO:teuthology.orchestra.run.smithi149.stdout: "op_send": 2284, 2024-09-13T17:24:46.738 INFO:teuthology.orchestra.run.smithi149.stdout: "op_send_bytes": 21, 2024-09-13T17:24:46.738 INFO:teuthology.orchestra.run.smithi149.stdout: "op_resend": 3, 2024-09-13T17:24:46.738 INFO:teuthology.orchestra.run.smithi149.stdout: "op_reply": 2284, 2024-09-13T17:24:46.738 INFO:teuthology.orchestra.run.smithi149.stdout: "op_latency": { 2024-09-13T17:24:46.738 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 2284, 2024-09-13T17:24:46.738 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 1.295975355, 2024-09-13T17:24:46.738 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000567414 2024-09-13T17:24:46.738 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.738 INFO:teuthology.orchestra.run.smithi149.stdout: "op_inflight": 0, 2024-09-13T17:24:46.738 INFO:teuthology.orchestra.run.smithi149.stdout: "oplen_avg": { 2024-09-13T17:24:46.738 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 2284, 2024-09-13T17:24:46.738 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 2285 2024-09-13T17:24:46.739 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.739 INFO:teuthology.orchestra.run.smithi149.stdout: "op": 2284, 2024-09-13T17:24:46.739 INFO:teuthology.orchestra.run.smithi149.stdout: "op_r": 2284, 2024-09-13T17:24:46.739 INFO:teuthology.orchestra.run.smithi149.stdout: "op_w": 0, 2024-09-13T17:24:46.739 INFO:teuthology.orchestra.run.smithi149.stdout: "op_rmw": 0, 2024-09-13T17:24:46.739 INFO:teuthology.orchestra.run.smithi149.stdout: "op_pg": 0, 2024-09-13T17:24:46.739 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_stat": 1434, 2024-09-13T17:24:46.739 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_create": 0, 2024-09-13T17:24:46.739 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_read": 848, 2024-09-13T17:24:46.739 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_write": 0, 2024-09-13T17:24:46.739 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_writefull": 0, 2024-09-13T17:24:46.739 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_writesame": 0, 2024-09-13T17:24:46.739 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_append": 0, 2024-09-13T17:24:46.739 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_zero": 0, 2024-09-13T17:24:46.739 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_truncate": 0, 2024-09-13T17:24:46.740 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_delete": 0, 2024-09-13T17:24:46.740 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_mapext": 0, 2024-09-13T17:24:46.740 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_sparse_read": 0, 2024-09-13T17:24:46.740 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_clonerange": 0, 2024-09-13T17:24:46.740 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_getxattr": 1, 2024-09-13T17:24:46.740 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_setxattr": 0, 2024-09-13T17:24:46.740 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_cmpxattr": 0, 2024-09-13T17:24:46.740 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_rmxattr": 0, 2024-09-13T17:24:46.740 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_resetxattrs": 0, 2024-09-13T17:24:46.740 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_call": 0, 2024-09-13T17:24:46.740 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_watch": 0, 2024-09-13T17:24:46.740 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_notify": 0, 2024-09-13T17:24:46.740 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T17:24:46.740 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_pgls": 0, 2024-09-13T17:24:46.741 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_pgls_filter": 0, 2024-09-13T17:24:46.741 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_other": 0, 2024-09-13T17:24:46.741 INFO:teuthology.orchestra.run.smithi149.stdout: "linger_active": 0, 2024-09-13T17:24:46.741 INFO:teuthology.orchestra.run.smithi149.stdout: "linger_send": 0, 2024-09-13T17:24:46.741 INFO:teuthology.orchestra.run.smithi149.stdout: "linger_resend": 0, 2024-09-13T17:24:46.741 INFO:teuthology.orchestra.run.smithi149.stdout: "linger_ping": 0, 2024-09-13T17:24:46.741 INFO:teuthology.orchestra.run.smithi149.stdout: "poolop_active": 0, 2024-09-13T17:24:46.741 INFO:teuthology.orchestra.run.smithi149.stdout: "poolop_send": 0, 2024-09-13T17:24:46.741 INFO:teuthology.orchestra.run.smithi149.stdout: "poolop_resend": 0, 2024-09-13T17:24:46.741 INFO:teuthology.orchestra.run.smithi149.stdout: "poolstat_active": 0, 2024-09-13T17:24:46.741 INFO:teuthology.orchestra.run.smithi149.stdout: "poolstat_send": 0, 2024-09-13T17:24:46.741 INFO:teuthology.orchestra.run.smithi149.stdout: "poolstat_resend": 0, 2024-09-13T17:24:46.741 INFO:teuthology.orchestra.run.smithi149.stdout: "statfs_active": 0, 2024-09-13T17:24:46.741 INFO:teuthology.orchestra.run.smithi149.stdout: "statfs_send": 0, 2024-09-13T17:24:46.741 INFO:teuthology.orchestra.run.smithi149.stdout: "statfs_resend": 0, 2024-09-13T17:24:46.742 INFO:teuthology.orchestra.run.smithi149.stdout: "command_active": 0, 2024-09-13T17:24:46.742 INFO:teuthology.orchestra.run.smithi149.stdout: "command_send": 0, 2024-09-13T17:24:46.742 INFO:teuthology.orchestra.run.smithi149.stdout: "command_resend": 0, 2024-09-13T17:24:46.742 INFO:teuthology.orchestra.run.smithi149.stdout: "map_epoch": 104, 2024-09-13T17:24:46.742 INFO:teuthology.orchestra.run.smithi149.stdout: "map_full": 0, 2024-09-13T17:24:46.742 INFO:teuthology.orchestra.run.smithi149.stdout: "map_inc": 15, 2024-09-13T17:24:46.742 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_sessions": 7, 2024-09-13T17:24:46.742 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_session_open": 7, 2024-09-13T17:24:46.742 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_session_close": 0, 2024-09-13T17:24:46.742 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_laggy": 0, 2024-09-13T17:24:46.742 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_wr": 0, 2024-09-13T17:24:46.742 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_rd": 2, 2024-09-13T17:24:46.742 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_del": 0 2024-09-13T17:24:46.742 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.743 INFO:teuthology.orchestra.run.smithi149.stdout: "oft": { 2024-09-13T17:24:46.743 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_total_objs": 0, 2024-09-13T17:24:46.743 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_total_kv_pairs": 0, 2024-09-13T17:24:46.743 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_total_updates": 0, 2024-09-13T17:24:46.743 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_total_removes": 0 2024-09-13T17:24:46.743 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.743 INFO:teuthology.orchestra.run.smithi149.stdout: "osd-slow-ops": { 2024-09-13T17:24:46.743 INFO:teuthology.orchestra.run.smithi149.stdout: "slow_ops_count": 0 2024-09-13T17:24:46.743 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.743 INFO:teuthology.orchestra.run.smithi149.stdout: "purge_queue": { 2024-09-13T17:24:46.743 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executing_ops": 0, 2024-09-13T17:24:46.743 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executing_ops_high_water": 0, 2024-09-13T17:24:46.743 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executing": 0, 2024-09-13T17:24:46.743 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executing_high_water": 0, 2024-09-13T17:24:46.743 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executed_ops": 0, 2024-09-13T17:24:46.744 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executed": 0, 2024-09-13T17:24:46.744 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_item_in_journal": 0 2024-09-13T17:24:46.744 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.744 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T17:24:46.744 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-09-13T17:24:46.744 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 104857600, 2024-09-13T17:24:46.744 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-09-13T17:24:46.744 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 2555, 2024-09-13T17:24:46.744 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 28747892, 2024-09-13T17:24:46.744 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:46.744 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 2555, 2024-09-13T17:24:46.744 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 0, 2024-09-13T17:24:46.744 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 0, 2024-09-13T17:24:46.744 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 2555, 2024-09-13T17:24:46.745 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 28747892, 2024-09-13T17:24:46.745 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-09-13T17:24:46.745 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.745 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.745 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.745 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:46.745 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.745 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-objecter_bytes": { 2024-09-13T17:24:46.745 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-09-13T17:24:46.745 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 104857600, 2024-09-13T17:24:46.745 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-09-13T17:24:46.745 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 0, 2024-09-13T17:24:46.745 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 0, 2024-09-13T17:24:46.745 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:46.745 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 0, 2024-09-13T17:24:46.746 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 2284, 2024-09-13T17:24:46.746 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 26699178, 2024-09-13T17:24:46.746 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 2284, 2024-09-13T17:24:46.746 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 26699178, 2024-09-13T17:24:46.746 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-09-13T17:24:46.746 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.746 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.746 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.746 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:46.746 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.746 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-objecter_ops": { 2024-09-13T17:24:46.746 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-09-13T17:24:46.746 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 1024, 2024-09-13T17:24:46.746 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-09-13T17:24:46.747 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 0, 2024-09-13T17:24:46.747 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 0, 2024-09-13T17:24:46.747 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:46.747 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 0, 2024-09-13T17:24:46.747 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 2284, 2024-09-13T17:24:46.747 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 2284, 2024-09-13T17:24:46.747 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 2284, 2024-09-13T17:24:46.747 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 2284, 2024-09-13T17:24:46.747 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-09-13T17:24:46.747 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.747 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.747 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.747 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:46.747 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.747 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-write_buf_throttle": { 2024-09-13T17:24:46.748 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-09-13T17:24:46.748 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 3758096384, 2024-09-13T17:24:46.748 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-09-13T17:24:46.748 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 0, 2024-09-13T17:24:46.748 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 0, 2024-09-13T17:24:46.748 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:46.748 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 0, 2024-09-13T17:24:46.748 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 0, 2024-09-13T17:24:46.748 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 0, 2024-09-13T17:24:46.748 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 0, 2024-09-13T17:24:46.748 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 0, 2024-09-13T17:24:46.748 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-09-13T17:24:46.748 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.748 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.749 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.749 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:46.749 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-09-13T17:24:46.749 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-write_buf_throttle-0x55bfb10a8820": { 2024-09-13T17:24:46.749 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-09-13T17:24:46.749 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 3758096384, 2024-09-13T17:24:46.749 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-09-13T17:24:46.749 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 0, 2024-09-13T17:24:46.749 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 0, 2024-09-13T17:24:46.749 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-09-13T17:24:46.749 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 0, 2024-09-13T17:24:46.749 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 0, 2024-09-13T17:24:46.749 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 0, 2024-09-13T17:24:46.749 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 0, 2024-09-13T17:24:46.750 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 0, 2024-09-13T17:24:46.750 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-09-13T17:24:46.750 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-09-13T17:24:46.750 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-09-13T17:24:46.750 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-09-13T17:24:46.750 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:46.750 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-09-13T17:24:46.750 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-13T17:24:47.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:46 smithi149 ceph-mon[35496]: pgmap v341: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:24:47.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:46 smithi118 ceph-mon[34374]: pgmap v341: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:24:47.482 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:46 smithi087 ceph-mon[30934]: pgmap v341: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:24:47.483 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-13T17:24:47.483 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-13T17:24:47.483 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-09-13T17:24:47.483 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-09-13T17:24:47.484 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2024-09-13T17:24:47.484 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-09-13T17:24:47.484 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-09-13T17:24:47.484 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-13T17:24:47.495 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-13T17:24:47.495 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T17:24:47.495 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:24:47.518 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T17:24:47.518 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:24:47.577 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:24:47.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.728+0000 7fa0fc019640 1 -- 172.21.15.87:0/2236731987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0f40ff860 msgr2=0x7fa0f41038a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:47.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.728+0000 7fa0fc019640 1 --2- 172.21.15.87:0/2236731987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0f40ff860 0x7fa0f41038a0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8009930 tx=0x7fa0e802a420 comp rx=0 tx=0).stop 2024-09-13T17:24:47.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.728+0000 7fa0fc019640 1 -- 172.21.15.87:0/2236731987 shutdown_connections 2024-09-13T17:24:47.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.728+0000 7fa0fc019640 1 --2- 172.21.15.87:0/2236731987 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0f4104000 0x7fa0f410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.728+0000 7fa0fc019640 1 --2- 172.21.15.87:0/2236731987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0f40ff860 0x7fa0f41038a0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.728+0000 7fa0fc019640 1 --2- 172.21.15.87:0/2236731987 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0f40feeb0 0x7fa0f40ff290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.728+0000 7fa0fc019640 1 -- 172.21.15.87:0/2236731987 >> 172.21.15.87:0/2236731987 conn(0x7fa0f40fa900 msgr2=0x7fa0f40fcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:47.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.728+0000 7fa0fc019640 1 -- 172.21.15.87:0/2236731987 shutdown_connections 2024-09-13T17:24:47.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.728+0000 7fa0fc019640 1 -- 172.21.15.87:0/2236731987 wait complete. 2024-09-13T17:24:47.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.729+0000 7fa0fc019640 1 Processor -- start 2024-09-13T17:24:47.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.729+0000 7fa0fc019640 1 -- start start 2024-09-13T17:24:47.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.729+0000 7fa0fc019640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0f40feeb0 0x7fa0f41971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:47.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.729+0000 7fa0fc019640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0f4104000 0x7fa0f41976e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:47.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.729+0000 7fa0fc019640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0f4197cc0 0x7fa0f41a2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:47.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.729+0000 7fa0fc019640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f41a2960 con 0x7fa0f40feeb0 2024-09-13T17:24:47.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.729+0000 7fa0fc019640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f41a2ad0 con 0x7fa0f4104000 2024-09-13T17:24:47.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.729+0000 7fa0fc019640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f41a2c90 con 0x7fa0f4197cc0 2024-09-13T17:24:47.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.729+0000 7fa0f9db5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0f40feeb0 0x7fa0f41971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:47.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.729+0000 7fa0f9db5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0f40feeb0 0x7fa0f41971a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43654/0 (socket says 172.21.15.87:43654) 2024-09-13T17:24:47.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.729+0000 7fa0f9db5640 1 -- 172.21.15.87:0/884408118 learned_addr learned my addr 172.21.15.87:0/884408118 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:47.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.729+0000 7fa0fa5b6640 1 --2- 172.21.15.87:0/884408118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0f4197cc0 0x7fa0f41a2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:47.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.729+0000 7fa0f95b4640 1 --2- 172.21.15.87:0/884408118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0f4104000 0x7fa0f41976e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:47.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.729+0000 7fa0f9db5640 1 -- 172.21.15.87:0/884408118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0f4197cc0 msgr2=0x7fa0f41a2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:47.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.729+0000 7fa0f9db5640 1 --2- 172.21.15.87:0/884408118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0f4197cc0 0x7fa0f41a2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.729+0000 7fa0f9db5640 1 -- 172.21.15.87:0/884408118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0f4104000 msgr2=0x7fa0f41976e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:47.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.729+0000 7fa0f9db5640 1 --2- 172.21.15.87:0/884408118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0f4104000 0x7fa0f41976e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.729+0000 7fa0f9db5640 1 -- 172.21.15.87:0/884408118 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e8009560 con 0x7fa0f40feeb0 2024-09-13T17:24:47.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.729+0000 7fa0fa5b6640 1 --2- 172.21.15.87:0/884408118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0f4197cc0 0x7fa0f41a2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:47.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.730+0000 7fa0f9db5640 1 --2- 172.21.15.87:0/884408118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0f40feeb0 0x7fa0f41971a0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fa0f000c920 tx=0x7fa0f000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:47.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.730+0000 7fa0e6ffd640 1 -- 172.21.15.87:0/884408118 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0007c70 con 0x7fa0f40feeb0 2024-09-13T17:24:47.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.730+0000 7fa0e6ffd640 1 -- 172.21.15.87:0/884408118 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa0f0007dd0 con 0x7fa0f40feeb0 2024-09-13T17:24:47.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.730+0000 7fa0fc019640 1 -- 172.21.15.87:0/884408118 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0f41a2f70 con 0x7fa0f40feeb0 2024-09-13T17:24:47.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.730+0000 7fa0e6ffd640 1 -- 172.21.15.87:0/884408118 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f00187c0 con 0x7fa0f40feeb0 2024-09-13T17:24:47.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.730+0000 7fa0fc019640 1 -- 172.21.15.87:0/884408118 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f41a3340 con 0x7fa0f40feeb0 2024-09-13T17:24:47.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.731+0000 7fa0fc019640 1 -- 172.21.15.87:0/884408118 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f4100380 con 0x7fa0f40feeb0 2024-09-13T17:24:47.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.732+0000 7fa0e6ffd640 1 -- 172.21.15.87:0/884408118 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fa0f000f450 con 0x7fa0f40feeb0 2024-09-13T17:24:47.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.733+0000 7fa0e6ffd640 1 --2- 172.21.15.87:0/884408118 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa0e00a1200 0x7fa0e00a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:47.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.733+0000 7fa0f95b4640 1 --2- 172.21.15.87:0/884408118 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa0e00a1200 0x7fa0e00a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:47.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.733+0000 7fa0e6ffd640 1 -- 172.21.15.87:0/884408118 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fa0f00cd290 con 0x7fa0f40feeb0 2024-09-13T17:24:47.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.733+0000 7fa0f95b4640 1 --2- 172.21.15.87:0/884408118 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa0e00a1200 0x7fa0e00a36c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8009900 tx=0x7fa0e8005a20 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:47.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.737+0000 7fa0e6ffd640 1 -- 172.21.15.87:0/884408118 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa0f00962d0 con 0x7fa0f40feeb0 2024-09-13T17:24:47.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.899+0000 7fa0fc019640 1 -- 172.21.15.87:0/884408118 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0f40ff290 con 0x7fa0f40feeb0 2024-09-13T17:24:47.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.901+0000 7fa0e6ffd640 1 -- 172.21.15.87:0/884408118 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) v1 ==== 74+0+25378 (secure 0 0 0) 0x7fa0f00998f0 con 0x7fa0f40feeb0 2024-09-13T17:24:47.903 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:24:47.903 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":104,"fsid":"043d5bae-71f2-11ef-bceb-c7b262605968","created":"2024-09-13T17:03:57.852010+0000","modified":"2024-09-13T17:24:17.935790+0000","last_up_change":"2024-09-13T17:10:34.423548+0000","last_in_change":"2024-09-13T17:10:14.228123+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:07:02.286400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:11:21.965141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:11:22.504345+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":103,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:11:25.565163+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":103,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58250283-85c0-416e-abdd-1fc5a7ff0c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6803","nonce":1316956138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6805","nonce":1316956138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6809","nonce":1316956138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6807","nonce":1316956138}]},"public_addr":"172.21.15.87:6803/1316956138","cluster_addr":"172.21.15.87:6805/1316956138","heartbeat_back_addr":"172.21.15.87:6809/1316956138","heartbeat_front_addr":"172.21.15.87:6807/1316956138","state":["exists","up"]},{"osd":1,"uuid":"b9d49969-94b1-4262-b4ff-db0a8e3331af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6801","nonce":3352566727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6803","nonce":3352566727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6807","nonce":3352566727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6805","nonce":3352566727}]},"public_addr":"172.21.15.118:6801/3352566727","cluster_addr":"172.21.15.118:6803/3352566727","heartbeat_back_addr":"172.21.15.118:6807/3352566727","heartbeat_front_addr":"172.21.15.118:6805/3352566727","state":["exists","up"]},{"osd":2,"uuid":"ba64549e-d736-426f-b466-f569af5f16d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6801","nonce":2774581686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6803","nonce":2774581686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6807","nonce":2774581686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6805","nonce":2774581686}]},"public_addr":"172.21.15.149:6801/2774581686","cluster_addr":"172.21.15.149:6803/2774581686","heartbeat_back_addr":"172.21.15.149:6807/2774581686","heartbeat_front_addr":"172.21.15.149:6805/2774581686","state":["exists","up"]},{"osd":3,"uuid":"3d5553e5-371b-49fd-976b-9e72a97a2f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6811","nonce":3306119066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6813","nonce":3306119066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6817","nonce":3306119066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6815","nonce":3306119066}]},"public_addr":"172.21.15.87:6811/3306119066","cluster_addr":"172.21.15.87:6813/3306119066","heartbeat_back_addr":"172.21.15.87:6817/3306119066","heartbeat_front_addr":"172.21.15.87:6815/3306119066","state":["exists","up"]},{"osd":4,"uuid":"2fbe0e27-34ec-42a6-9962-f1d8202b3159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6809","nonce":3342349890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6811","nonce":3342349890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6815","nonce":3342349890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6813","nonce":3342349890}]},"public_addr":"172.21.15.118:6809/3342349890","cluster_addr":"172.21.15.118:6811/3342349890","heartbeat_back_addr":"172.21.15.118:6815/3342349890","heartbeat_front_addr":"172.21.15.118:6813/3342349890","state":["exists","up"]},{"osd":5,"uuid":"53c14519-6170-4b5a-a79d-4835882d7bec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6809","nonce":3468867124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6811","nonce":3468867124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6815","nonce":3468867124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6813","nonce":3468867124}]},"public_addr":"172.21.15.149:6809/3468867124","cluster_addr":"172.21.15.149:6811/3468867124","heartbeat_back_addr":"172.21.15.149:6815/3468867124","heartbeat_front_addr":"172.21.15.149:6813/3468867124","state":["exists","up"]},{"osd":6,"uuid":"d3951b32-db77-4b8b-9de0-f05e03d13f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6819","nonce":326563617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6821","nonce":326563617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6825","nonce":326563617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6823","nonce":326563617}]},"public_addr":"172.21.15.87:6819/326563617","cluster_addr":"172.21.15.87:6821/326563617","heartbeat_back_addr":"172.21.15.87:6825/326563617","heartbeat_front_addr":"172.21.15.87:6823/326563617","state":["exists","up"]},{"osd":7,"uuid":"4d46dab7-a8bf-4e3e-b5c0-43860d336bdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6817","nonce":1690268990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6819","nonce":1690268990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6823","nonce":1690268990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6821","nonce":1690268990}]},"public_addr":"172.21.15.118:6817/1690268990","cluster_addr":"172.21.15.118:6819/1690268990","heartbeat_back_addr":"172.21.15.118:6823/1690268990","heartbeat_front_addr":"172.21.15.118:6821/1690268990","state":["exists","up"]},{"osd":8,"uuid":"5a015a7d-60a3-4412-96af-1b61d2ad51f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6817","nonce":1558675380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6819","nonce":1558675380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6823","nonce":1558675380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6821","nonce":1558675380}]},"public_addr":"172.21.15.149:6817/1558675380","cluster_addr":"172.21.15.149:6819/1558675380","heartbeat_back_addr":"172.21.15.149:6823/1558675380","heartbeat_front_addr":"172.21.15.149:6821/1558675380","state":["exists","up"]},{"osd":9,"uuid":"248c0b6e-4c4e-4c63-a0dd-e4cdf3b997a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6827","nonce":1453934262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6829","nonce":1453934262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6833","nonce":1453934262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6831","nonce":1453934262}]},"public_addr":"172.21.15.87:6827/1453934262","cluster_addr":"172.21.15.87:6829/1453934262","heartbeat_back_addr":"172.21.15.87:6833/1453934262","heartbeat_front_addr":"172.21.15.87:6831/1453934262","state":["exists","up"]},{"osd":10,"uuid":"24238714-e737-4371-b5d5-0cd3395f09bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6825","nonce":1034318850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6827","nonce":1034318850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6831","nonce":1034318850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6829","nonce":1034318850}]},"public_addr":"172.21.15.118:6825/1034318850","cluster_addr":"172.21.15.118:6827/1034318850","heartbeat_back_addr":"172.21.15.118:6831/1034318850","heartbeat_front_addr":"172.21.15.118:6829/1034318850","state":["exists","up"]},{"osd":11,"uuid":"409dd3bf-5154-4dea-8708-7de7f9e2e793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6825","nonce":271000465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6827","nonce":271000465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6831","nonce":271000465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6829","nonce":271000465}]},"public_addr":"172.21.15.149:6825/271000465","cluster_addr":"172.21.15.149:6827/271000465","heartbeat_back_addr":"172.21.15.149:6831/271000465","heartbeat_front_addr":"172.21.15.149:6829/271000465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:16.382664+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:37.914250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:00.425876+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:23.960183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:47.004088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:10.214345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:33.719221+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:57.099599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:20.971881+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:44.827167+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:08.135516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:32.085853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.d","mappings":[{"from":1,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8},{"from":5,"to":7}]},{"pgid":"3.28","mappings":[{"from":3,"to":6},{"from":5,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/718653925":"2024-09-14T17:13:49.377087+0000","172.21.15.87:0/3081317043":"2024-09-14T17:13:49.377087+0000","172.21.15.87:0/1633498542":"2024-09-14T17:13:49.377087+0000","172.21.15.87:6801/1587363880":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/3403361612":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/553289143":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/1475107314":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/515676743":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/3270371628":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6800/1587363880":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6800/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6801/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/2612130442":"2024-09-14T17:13:49.377087+0000","172.21.15.87:0/586423689":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6800/701043027":"2024-09-14T17:13:49.377087+0000","172.21.15.87:6801/701043027":"2024-09-14T17:13:49.377087+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]},{"pool":4,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:24:47.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.902+0000 7fa0fc019640 1 -- 172.21.15.87:0/884408118 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa0e00a1200 msgr2=0x7fa0e00a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:47.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.902+0000 7fa0fc019640 1 --2- 172.21.15.87:0/884408118 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa0e00a1200 0x7fa0e00a36c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8009900 tx=0x7fa0e8005a20 comp rx=0 tx=0).stop 2024-09-13T17:24:47.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.902+0000 7fa0fc019640 1 -- 172.21.15.87:0/884408118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0f40feeb0 msgr2=0x7fa0f41971a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:47.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.902+0000 7fa0fc019640 1 --2- 172.21.15.87:0/884408118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0f40feeb0 0x7fa0f41971a0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fa0f000c920 tx=0x7fa0f000cde0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.902+0000 7fa0fc019640 1 -- 172.21.15.87:0/884408118 shutdown_connections 2024-09-13T17:24:47.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.903+0000 7fa0fc019640 1 --2- 172.21.15.87:0/884408118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0f4197cc0 0x7fa0f41a2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.903+0000 7fa0fc019640 1 --2- 172.21.15.87:0/884408118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0f4104000 0x7fa0f41976e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.903+0000 7fa0fc019640 1 --2- 172.21.15.87:0/884408118 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fa0e00a1200 0x7fa0e00a36c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.903+0000 7fa0fc019640 1 --2- 172.21.15.87:0/884408118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0f40feeb0 0x7fa0f41971a0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:47.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.903+0000 7fa0fc019640 1 -- 172.21.15.87:0/884408118 >> 172.21.15.87:0/884408118 conn(0x7fa0f40fa900 msgr2=0x7fa0f40fbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:47.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.903+0000 7fa0fc019640 1 -- 172.21.15.87:0/884408118 shutdown_connections 2024-09-13T17:24:47.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:47.903+0000 7fa0fc019640 1 -- 172.21.15.87:0/884408118 wait complete. 2024-09-13T17:24:47.917 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:07:02.286400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:11:21.965141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:11:22.504345+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 103, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:11:25.565163+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 103, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:24:47.917 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:24:48.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.018+0000 7fdf273bc640 1 -- 172.21.15.87:0/1623158303 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf201018a0 msgr2=0x7fdf20109d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:48.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.018+0000 7fdf273bc640 1 --2- 172.21.15.87:0/1623158303 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf201018a0 0x7fdf20109d80 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009900 tx=0x7fdf1002a410 comp rx=0 tx=0).stop 2024-09-13T17:24:48.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.018+0000 7fdf273bc640 1 -- 172.21.15.87:0/1623158303 shutdown_connections 2024-09-13T17:24:48.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.018+0000 7fdf273bc640 1 --2- 172.21.15.87:0/1623158303 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf2010a350 0x7fdf2010c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.018+0000 7fdf273bc640 1 --2- 172.21.15.87:0/1623158303 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf201018a0 0x7fdf20109d80 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.018+0000 7fdf273bc640 1 --2- 172.21.15.87:0/1623158303 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf20100f80 0x7fdf20101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.018+0000 7fdf273bc640 1 -- 172.21.15.87:0/1623158303 >> 172.21.15.87:0/1623158303 conn(0x7fdf200fa930 msgr2=0x7fdf200fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:48.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.018+0000 7fdf273bc640 1 -- 172.21.15.87:0/1623158303 shutdown_connections 2024-09-13T17:24:48.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.018+0000 7fdf273bc640 1 -- 172.21.15.87:0/1623158303 wait complete. 2024-09-13T17:24:48.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.018+0000 7fdf273bc640 1 Processor -- start 2024-09-13T17:24:48.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.019+0000 7fdf273bc640 1 -- start start 2024-09-13T17:24:48.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.019+0000 7fdf273bc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf20100f80 0x7fdf20196270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:48.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.019+0000 7fdf273bc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf201018a0 0x7fdf201967b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:48.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.019+0000 7fdf273bc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf2010a350 0x7fdf2019aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:48.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.019+0000 7fdf273bc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2019b1a0 con 0x7fdf2010a350 2024-09-13T17:24:48.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.019+0000 7fdf273bc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2019b310 con 0x7fdf20100f80 2024-09-13T17:24:48.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.019+0000 7fdf273bc640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2019b4d0 con 0x7fdf201018a0 2024-09-13T17:24:48.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.019+0000 7fdf25959640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf2010a350 0x7fdf2019aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:48.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.019+0000 7fdf25959640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf2010a350 0x7fdf2019aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43672/0 (socket says 172.21.15.87:43672) 2024-09-13T17:24:48.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.019+0000 7fdf25959640 1 -- 172.21.15.87:0/3627076646 learned_addr learned my addr 172.21.15.87:0/3627076646 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:48.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.019+0000 7fdf25158640 1 --2- 172.21.15.87:0/3627076646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf20100f80 0x7fdf20196270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:48.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.019+0000 7fdf24957640 1 --2- 172.21.15.87:0/3627076646 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf201018a0 0x7fdf201967b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:48.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.019+0000 7fdf25959640 1 -- 172.21.15.87:0/3627076646 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf201018a0 msgr2=0x7fdf201967b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:48.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.019+0000 7fdf25959640 1 --2- 172.21.15.87:0/3627076646 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf201018a0 0x7fdf201967b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.019+0000 7fdf25959640 1 -- 172.21.15.87:0/3627076646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf20100f80 msgr2=0x7fdf20196270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:48.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.019+0000 7fdf25959640 1 --2- 172.21.15.87:0/3627076646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf20100f80 0x7fdf20196270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.019+0000 7fdf25959640 1 -- 172.21.15.87:0/3627076646 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf10009560 con 0x7fdf2010a350 2024-09-13T17:24:48.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.019+0000 7fdf25158640 1 --2- 172.21.15.87:0/3627076646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf20100f80 0x7fdf20196270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:48.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.019+0000 7fdf25959640 1 --2- 172.21.15.87:0/3627076646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf2010a350 0x7fdf2019aba0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fdf1800cad0 tx=0x7fdf1800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:48.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.019+0000 7fdf167fc640 1 -- 172.21.15.87:0/3627076646 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1800ae20 con 0x7fdf2010a350 2024-09-13T17:24:48.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.019+0000 7fdf167fc640 1 -- 172.21.15.87:0/3627076646 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdf18005020 con 0x7fdf2010a350 2024-09-13T17:24:48.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.019+0000 7fdf273bc640 1 -- 172.21.15.87:0/3627076646 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf2019b7b0 con 0x7fdf2010a350 2024-09-13T17:24:48.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.019+0000 7fdf167fc640 1 -- 172.21.15.87:0/3627076646 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1800f690 con 0x7fdf2010a350 2024-09-13T17:24:48.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.020+0000 7fdf273bc640 1 -- 172.21.15.87:0/3627076646 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf201a3030 con 0x7fdf2010a350 2024-09-13T17:24:48.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.021+0000 7fdf273bc640 1 -- 172.21.15.87:0/3627076646 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf20068db0 con 0x7fdf2010a350 2024-09-13T17:24:48.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.021+0000 7fdf167fc640 1 -- 172.21.15.87:0/3627076646 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fdf18005190 con 0x7fdf2010a350 2024-09-13T17:24:48.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.022+0000 7fdf167fc640 1 --2- 172.21.15.87:0/3627076646 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdf0c0a1200 0x7fdf0c0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:48.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.022+0000 7fdf25158640 1 --2- 172.21.15.87:0/3627076646 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdf0c0a1200 0x7fdf0c0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:48.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.022+0000 7fdf167fc640 1 -- 172.21.15.87:0/3627076646 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fdf180cd150 con 0x7fdf2010a350 2024-09-13T17:24:48.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.023+0000 7fdf25158640 1 --2- 172.21.15.87:0/3627076646 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdf0c0a1200 0x7fdf0c0a36c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c0058c0 tx=0x7fdf1c005850 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:48.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.026+0000 7fdf167fc640 1 -- 172.21.15.87:0/3627076646 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdf18096190 con 0x7fdf2010a350 2024-09-13T17:24:48.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.187+0000 7fdf273bc640 1 -- 172.21.15.87:0/3627076646 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdf201053d0 con 0x7fdf2010a350 2024-09-13T17:24:48.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.187+0000 7fdf167fc640 1 -- 172.21.15.87:0/3627076646 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v104) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdf1801d0a0 con 0x7fdf2010a350 2024-09-13T17:24:48.189 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-09-13T17:24:48.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.189+0000 7fdf273bc640 1 -- 172.21.15.87:0/3627076646 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdf0c0a1200 msgr2=0x7fdf0c0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:48.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.189+0000 7fdf273bc640 1 --2- 172.21.15.87:0/3627076646 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdf0c0a1200 0x7fdf0c0a36c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c0058c0 tx=0x7fdf1c005850 comp rx=0 tx=0).stop 2024-09-13T17:24:48.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.189+0000 7fdf273bc640 1 -- 172.21.15.87:0/3627076646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf2010a350 msgr2=0x7fdf2019aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:48.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.189+0000 7fdf273bc640 1 --2- 172.21.15.87:0/3627076646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf2010a350 0x7fdf2019aba0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fdf1800cad0 tx=0x7fdf1800cf90 comp rx=0 tx=0).stop 2024-09-13T17:24:48.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.189+0000 7fdf273bc640 1 -- 172.21.15.87:0/3627076646 shutdown_connections 2024-09-13T17:24:48.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.189+0000 7fdf273bc640 1 --2- 172.21.15.87:0/3627076646 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdf0c0a1200 0x7fdf0c0a36c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.189+0000 7fdf273bc640 1 --2- 172.21.15.87:0/3627076646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf2010a350 0x7fdf2019aba0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.189+0000 7fdf273bc640 1 --2- 172.21.15.87:0/3627076646 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf201018a0 0x7fdf201967b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.189+0000 7fdf273bc640 1 --2- 172.21.15.87:0/3627076646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf20100f80 0x7fdf20196270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.189+0000 7fdf273bc640 1 -- 172.21.15.87:0/3627076646 >> 172.21.15.87:0/3627076646 conn(0x7fdf200fa930 msgr2=0x7fdf200fc290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:48.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.189+0000 7fdf273bc640 1 -- 172.21.15.87:0/3627076646 shutdown_connections 2024-09-13T17:24:48.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.189+0000 7fdf273bc640 1 -- 172.21.15.87:0/3627076646 wait complete. 2024-09-13T17:24:48.201 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:47 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/884408118' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:24:48.202 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:24:48.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.301+0000 7f8a84791640 1 -- 172.21.15.87:0/1811850389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a7c103fb0 msgr2=0x7f8a7c10bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:48.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.301+0000 7f8a84791640 1 --2- 172.21.15.87:0/1811850389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a7c103fb0 0x7f8a7c10bb00 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f8a74009cd0 tx=0x7f8a7402a8e0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.301+0000 7f8a84791640 1 -- 172.21.15.87:0/1811850389 shutdown_connections 2024-09-13T17:24:48.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.301+0000 7f8a84791640 1 --2- 172.21.15.87:0/1811850389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a7c103fb0 0x7f8a7c10bb00 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.301+0000 7f8a84791640 1 --2- 172.21.15.87:0/1811850389 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8a7c0ff810 0x7f8a7c103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.301+0000 7f8a84791640 1 --2- 172.21.15.87:0/1811850389 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a7c0fee60 0x7f8a7c0ff240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.301+0000 7f8a84791640 1 -- 172.21.15.87:0/1811850389 >> 172.21.15.87:0/1811850389 conn(0x7f8a7c075c60 msgr2=0x7f8a7c0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:48.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.301+0000 7f8a84791640 1 -- 172.21.15.87:0/1811850389 shutdown_connections 2024-09-13T17:24:48.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.301+0000 7f8a84791640 1 -- 172.21.15.87:0/1811850389 wait complete. 2024-09-13T17:24:48.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.301+0000 7f8a84791640 1 Processor -- start 2024-09-13T17:24:48.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.301+0000 7f8a84791640 1 -- start start 2024-09-13T17:24:48.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.301+0000 7f8a84791640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a7c0fee60 0x7f8a7c196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:48.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.301+0000 7f8a84791640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8a7c103fb0 0x7f8a7c196840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:48.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.301+0000 7f8a84791640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a7c19abc0 0x7f8a7c19b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:48.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.301+0000 7f8a84791640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7c19b5b0 con 0x7f8a7c0fee60 2024-09-13T17:24:48.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.301+0000 7f8a84791640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7c19b720 con 0x7f8a7c103fb0 2024-09-13T17:24:48.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.301+0000 7f8a84791640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7c19b890 con 0x7f8a7c19abc0 2024-09-13T17:24:48.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.302+0000 7f8a8252d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a7c0fee60 0x7f8a7c196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:48.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.302+0000 7f8a8252d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a7c0fee60 0x7f8a7c196300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43702/0 (socket says 172.21.15.87:43702) 2024-09-13T17:24:48.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.302+0000 7f8a8252d640 1 -- 172.21.15.87:0/1466141462 learned_addr learned my addr 172.21.15.87:0/1466141462 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:48.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.302+0000 7f8a82d2e640 1 --2- 172.21.15.87:0/1466141462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a7c19abc0 0x7f8a7c19b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:48.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.302+0000 7f8a8252d640 1 -- 172.21.15.87:0/1466141462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a7c19abc0 msgr2=0x7f8a7c19b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:48.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.302+0000 7f8a8252d640 1 --2- 172.21.15.87:0/1466141462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a7c19abc0 0x7f8a7c19b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.302+0000 7f8a8252d640 1 -- 172.21.15.87:0/1466141462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8a7c103fb0 msgr2=0x7f8a7c196840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:48.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.302+0000 7f8a8252d640 1 --2- 172.21.15.87:0/1466141462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8a7c103fb0 0x7f8a7c196840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.302+0000 7f8a8252d640 1 -- 172.21.15.87:0/1466141462 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a74009900 con 0x7f8a7c0fee60 2024-09-13T17:24:48.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.302+0000 7f8a8252d640 1 --2- 172.21.15.87:0/1466141462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a7c0fee60 0x7f8a7c196300 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f8a7800b4a0 tx=0x7f8a7800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:48.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.302+0000 7f8a6f7fe640 1 -- 172.21.15.87:0/1466141462 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a78010610 con 0x7f8a7c0fee60 2024-09-13T17:24:48.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.302+0000 7f8a6f7fe640 1 -- 172.21.15.87:0/1466141462 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8a78010c20 con 0x7f8a7c0fee60 2024-09-13T17:24:48.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.302+0000 7f8a84791640 1 -- 172.21.15.87:0/1466141462 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a7c1a2e70 con 0x7f8a7c0fee60 2024-09-13T17:24:48.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.302+0000 7f8a6f7fe640 1 -- 172.21.15.87:0/1466141462 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a78017d50 con 0x7f8a7c0fee60 2024-09-13T17:24:48.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.302+0000 7f8a84791640 1 -- 172.21.15.87:0/1466141462 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a7c1a3240 con 0x7f8a7c0fee60 2024-09-13T17:24:48.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.303+0000 7f8a84791640 1 -- 172.21.15.87:0/1466141462 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a7c100330 con 0x7f8a7c0fee60 2024-09-13T17:24:48.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.304+0000 7f8a6f7fe640 1 -- 172.21.15.87:0/1466141462 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f8a78010770 con 0x7f8a7c0fee60 2024-09-13T17:24:48.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.305+0000 7f8a6f7fe640 1 --2- 172.21.15.87:0/1466141462 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8a680a1200 0x7f8a680a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:48.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.305+0000 7f8a81d2c640 1 --2- 172.21.15.87:0/1466141462 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8a680a1200 0x7f8a680a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:48.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.305+0000 7f8a6f7fe640 1 -- 172.21.15.87:0/1466141462 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f8a780ccdb0 con 0x7f8a7c0fee60 2024-09-13T17:24:48.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.306+0000 7f8a81d2c640 1 --2- 172.21.15.87:0/1466141462 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8a680a1200 0x7f8a680a36c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c0fe1c0 tx=0x7f8a70006c90 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:48.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.308+0000 7f8a6f7fe640 1 -- 172.21.15.87:0/1466141462 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8a78095f00 con 0x7f8a7c0fee60 2024-09-13T17:24:48.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:47 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/884408118' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:24:48.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:47 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/884408118' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:24:48.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.468+0000 7f8a84791640 1 -- 172.21.15.87:0/1466141462 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8a7c0ff240 con 0x7f8a7c0fee60 2024-09-13T17:24:48.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.469+0000 7f8a6f7fe640 1 -- 172.21.15.87:0/1466141462 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v104) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8a78099520 con 0x7f8a7c0fee60 2024-09-13T17:24:48.471 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-09-13T17:24:48.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.471+0000 7f8a84791640 1 -- 172.21.15.87:0/1466141462 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8a680a1200 msgr2=0x7f8a680a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:48.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.471+0000 7f8a84791640 1 --2- 172.21.15.87:0/1466141462 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8a680a1200 0x7f8a680a36c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c0fe1c0 tx=0x7f8a70006c90 comp rx=0 tx=0).stop 2024-09-13T17:24:48.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.471+0000 7f8a84791640 1 -- 172.21.15.87:0/1466141462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a7c0fee60 msgr2=0x7f8a7c196300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:48.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.471+0000 7f8a84791640 1 --2- 172.21.15.87:0/1466141462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a7c0fee60 0x7f8a7c196300 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f8a7800b4a0 tx=0x7f8a7800b960 comp rx=0 tx=0).stop 2024-09-13T17:24:48.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.471+0000 7f8a84791640 1 -- 172.21.15.87:0/1466141462 shutdown_connections 2024-09-13T17:24:48.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.471+0000 7f8a84791640 1 --2- 172.21.15.87:0/1466141462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a7c19abc0 0x7f8a7c19b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.471+0000 7f8a84791640 1 --2- 172.21.15.87:0/1466141462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8a7c103fb0 0x7f8a7c196840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.471+0000 7f8a84791640 1 --2- 172.21.15.87:0/1466141462 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8a680a1200 0x7f8a680a36c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.471+0000 7f8a84791640 1 --2- 172.21.15.87:0/1466141462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a7c0fee60 0x7f8a7c196300 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.471+0000 7f8a84791640 1 -- 172.21.15.87:0/1466141462 >> 172.21.15.87:0/1466141462 conn(0x7f8a7c075c60 msgr2=0x7f8a7c067760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:48.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.471+0000 7f8a84791640 1 -- 172.21.15.87:0/1466141462 shutdown_connections 2024-09-13T17:24:48.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.471+0000 7f8a84791640 1 -- 172.21.15.87:0/1466141462 wait complete. 2024-09-13T17:24:48.484 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:24:48.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.583+0000 7f8b194a3640 1 -- 172.21.15.87:0/1598645281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b140fee60 msgr2=0x7f8b140ff240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:48.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.583+0000 7f8b194a3640 1 --2- 172.21.15.87:0/1598645281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b140fee60 0x7f8b140ff240 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f8b04009930 tx=0x7f8b0402a420 comp rx=0 tx=0).stop 2024-09-13T17:24:48.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.583+0000 7f8b194a3640 1 -- 172.21.15.87:0/1598645281 shutdown_connections 2024-09-13T17:24:48.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.583+0000 7f8b194a3640 1 --2- 172.21.15.87:0/1598645281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b14103fb0 0x7f8b1410bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.583+0000 7f8b194a3640 1 --2- 172.21.15.87:0/1598645281 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b140ff810 0x7f8b14103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.583+0000 7f8b194a3640 1 --2- 172.21.15.87:0/1598645281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b140fee60 0x7f8b140ff240 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.583+0000 7f8b194a3640 1 -- 172.21.15.87:0/1598645281 >> 172.21.15.87:0/1598645281 conn(0x7f8b14075c60 msgr2=0x7f8b140fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:48.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.583+0000 7f8b194a3640 1 -- 172.21.15.87:0/1598645281 shutdown_connections 2024-09-13T17:24:48.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.583+0000 7f8b194a3640 1 -- 172.21.15.87:0/1598645281 wait complete. 2024-09-13T17:24:48.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.584+0000 7f8b194a3640 1 Processor -- start 2024-09-13T17:24:48.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.584+0000 7f8b194a3640 1 -- start start 2024-09-13T17:24:48.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.584+0000 7f8b194a3640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b140fee60 0x7f8b141962b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:48.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.584+0000 7f8b194a3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b14103fb0 0x7f8b141967f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:48.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.584+0000 7f8b194a3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b1419abe0 0x7f8b1419b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:48.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.584+0000 7f8b194a3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1419b5d0 con 0x7f8b14103fb0 2024-09-13T17:24:48.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.584+0000 7f8b194a3640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1419b740 con 0x7f8b1419abe0 2024-09-13T17:24:48.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.584+0000 7f8b194a3640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1419b8b0 con 0x7f8b140fee60 2024-09-13T17:24:48.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.584+0000 7f8b0a7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b14103fb0 0x7f8b141967f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:48.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.584+0000 7f8b0a7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b14103fb0 0x7f8b141967f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43728/0 (socket says 172.21.15.87:43728) 2024-09-13T17:24:48.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.584+0000 7f8b0a7fc640 1 -- 172.21.15.87:0/2344928671 learned_addr learned my addr 172.21.15.87:0/2344928671 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:48.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.585+0000 7f8b12ffd640 1 --2- 172.21.15.87:0/2344928671 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b140fee60 0x7f8b141962b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:48.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.585+0000 7f8b137fe640 1 --2- 172.21.15.87:0/2344928671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b1419abe0 0x7f8b1419b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:48.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.585+0000 7f8b0a7fc640 1 -- 172.21.15.87:0/2344928671 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b140fee60 msgr2=0x7f8b141962b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:48.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.585+0000 7f8b0a7fc640 1 --2- 172.21.15.87:0/2344928671 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b140fee60 0x7f8b141962b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.585+0000 7f8b0a7fc640 1 -- 172.21.15.87:0/2344928671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b1419abe0 msgr2=0x7f8b1419b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:48.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.585+0000 7f8b0a7fc640 1 --2- 172.21.15.87:0/2344928671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b1419abe0 0x7f8b1419b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.585+0000 7f8b0a7fc640 1 -- 172.21.15.87:0/2344928671 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b04009560 con 0x7f8b14103fb0 2024-09-13T17:24:48.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.585+0000 7f8b0a7fc640 1 --2- 172.21.15.87:0/2344928671 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b14103fb0 0x7f8b141967f0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f8afc00d740 tx=0x7f8afc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:48.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.585+0000 7f8b10ff9640 1 -- 172.21.15.87:0/2344928671 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc009c30 con 0x7f8b14103fb0 2024-09-13T17:24:48.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.585+0000 7f8b194a3640 1 -- 172.21.15.87:0/2344928671 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b141a2e90 con 0x7f8b14103fb0 2024-09-13T17:24:48.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.585+0000 7f8b10ff9640 1 -- 172.21.15.87:0/2344928671 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8afc00de50 con 0x7f8b14103fb0 2024-09-13T17:24:48.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.585+0000 7f8b10ff9640 1 -- 172.21.15.87:0/2344928671 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc004e40 con 0x7f8b14103fb0 2024-09-13T17:24:48.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.585+0000 7f8b194a3640 1 -- 172.21.15.87:0/2344928671 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b141a32b0 con 0x7f8b14103fb0 2024-09-13T17:24:48.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.586+0000 7f8b194a3640 1 -- 172.21.15.87:0/2344928671 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b14100330 con 0x7f8b14103fb0 2024-09-13T17:24:48.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.587+0000 7f8b10ff9640 1 -- 172.21.15.87:0/2344928671 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f8afc004fa0 con 0x7f8b14103fb0 2024-09-13T17:24:48.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.588+0000 7f8b10ff9640 1 --2- 172.21.15.87:0/2344928671 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8b000a1200 0x7f8b000a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:48.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.588+0000 7f8b12ffd640 1 --2- 172.21.15.87:0/2344928671 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8b000a1200 0x7f8b000a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:48.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.588+0000 7f8b10ff9640 1 -- 172.21.15.87:0/2344928671 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f8afc0ccea0 con 0x7f8b14103fb0 2024-09-13T17:24:48.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.589+0000 7f8b12ffd640 1 --2- 172.21.15.87:0/2344928671 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8b000a1200 0x7f8b000a36c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8b04005ab0 tx=0x7f8b04005a20 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:48.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.591+0000 7f8b10ff9640 1 -- 172.21.15.87:0/2344928671 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8afc095ee0 con 0x7f8b14103fb0 2024-09-13T17:24:48.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.751+0000 7f8b194a3640 1 -- 172.21.15.87:0/2344928671 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8b14107190 con 0x7f8b14103fb0 2024-09-13T17:24:48.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.752+0000 7f8b10ff9640 1 -- 172.21.15.87:0/2344928671 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v104) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8afc020020 con 0x7f8b14103fb0 2024-09-13T17:24:48.754 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-09-13T17:24:48.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.754+0000 7f8b194a3640 1 -- 172.21.15.87:0/2344928671 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8b000a1200 msgr2=0x7f8b000a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:48.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.754+0000 7f8b194a3640 1 --2- 172.21.15.87:0/2344928671 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8b000a1200 0x7f8b000a36c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8b04005ab0 tx=0x7f8b04005a20 comp rx=0 tx=0).stop 2024-09-13T17:24:48.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.754+0000 7f8b194a3640 1 -- 172.21.15.87:0/2344928671 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b14103fb0 msgr2=0x7f8b141967f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:48.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.754+0000 7f8b194a3640 1 --2- 172.21.15.87:0/2344928671 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b14103fb0 0x7f8b141967f0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f8afc00d740 tx=0x7f8afc00dc00 comp rx=0 tx=0).stop 2024-09-13T17:24:48.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.754+0000 7f8b194a3640 1 -- 172.21.15.87:0/2344928671 shutdown_connections 2024-09-13T17:24:48.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.754+0000 7f8b194a3640 1 --2- 172.21.15.87:0/2344928671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b1419abe0 0x7f8b1419b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.754+0000 7f8b194a3640 1 --2- 172.21.15.87:0/2344928671 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f8b000a1200 0x7f8b000a36c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.754+0000 7f8b194a3640 1 --2- 172.21.15.87:0/2344928671 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b14103fb0 0x7f8b141967f0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.754+0000 7f8b194a3640 1 --2- 172.21.15.87:0/2344928671 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8b140fee60 0x7f8b141962b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.754+0000 7f8b194a3640 1 -- 172.21.15.87:0/2344928671 >> 172.21.15.87:0/2344928671 conn(0x7f8b14075c60 msgr2=0x7f8b14102300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:48.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.754+0000 7f8b194a3640 1 -- 172.21.15.87:0/2344928671 shutdown_connections 2024-09-13T17:24:48.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.754+0000 7f8b194a3640 1 -- 172.21.15.87:0/2344928671 wait complete. 2024-09-13T17:24:48.767 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:24:48.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.865+0000 7f792cac9640 1 -- 172.21.15.87:0/145639439 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79280feb80 msgr2=0x7f79280fef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:48.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.865+0000 7f792cac9640 1 --2- 172.21.15.87:0/145639439 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79280feb80 0x7f79280fef60 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f7920009930 tx=0x7f792002a420 comp rx=0 tx=0).stop 2024-09-13T17:24:48.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.865+0000 7f792cac9640 1 -- 172.21.15.87:0/145639439 shutdown_connections 2024-09-13T17:24:48.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.865+0000 7f792cac9640 1 --2- 172.21.15.87:0/145639439 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7928106440 0x7f792810cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.865+0000 7f792cac9640 1 --2- 172.21.15.87:0/145639439 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79280ff530 0x7f7928105ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.865+0000 7f792cac9640 1 --2- 172.21.15.87:0/145639439 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79280feb80 0x7f79280fef60 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.865+0000 7f792cac9640 1 -- 172.21.15.87:0/145639439 >> 172.21.15.87:0/145639439 conn(0x7f7928074110 msgr2=0x7f7928074520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:48.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.865+0000 7f792cac9640 1 -- 172.21.15.87:0/145639439 shutdown_connections 2024-09-13T17:24:48.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.865+0000 7f792cac9640 1 -- 172.21.15.87:0/145639439 wait complete. 2024-09-13T17:24:48.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.865+0000 7f792cac9640 1 Processor -- start 2024-09-13T17:24:48.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.865+0000 7f792cac9640 1 -- start start 2024-09-13T17:24:48.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.866+0000 7f792cac9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79280feb80 0x7f7928196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:48.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.866+0000 7f792cac9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7928106440 0x7f79281968d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:48.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.866+0000 7f792cac9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f792819acc0 0x7f792819b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:48.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.866+0000 7f792cac9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792819b6b0 con 0x7f7928106440 2024-09-13T17:24:48.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.866+0000 7f792cac9640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792819b820 con 0x7f79280feb80 2024-09-13T17:24:48.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.866+0000 7f792cac9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792819b990 con 0x7f792819acc0 2024-09-13T17:24:48.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.866+0000 7f7925d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7928106440 0x7f79281968d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:48.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.866+0000 7f7925d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7928106440 0x7f79281968d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43734/0 (socket says 172.21.15.87:43734) 2024-09-13T17:24:48.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.866+0000 7f7925d9b640 1 -- 172.21.15.87:0/970388326 learned_addr learned my addr 172.21.15.87:0/970388326 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:48.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.866+0000 7f792659c640 1 --2- 172.21.15.87:0/970388326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79280feb80 0x7f7928196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:48.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.866+0000 7f7926d9d640 1 --2- 172.21.15.87:0/970388326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f792819acc0 0x7f792819b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:48.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.866+0000 7f7925d9b640 1 -- 172.21.15.87:0/970388326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f792819acc0 msgr2=0x7f792819b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:48.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.866+0000 7f7925d9b640 1 --2- 172.21.15.87:0/970388326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f792819acc0 0x7f792819b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.866+0000 7f7925d9b640 1 -- 172.21.15.87:0/970388326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79280feb80 msgr2=0x7f7928196390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:48.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.866+0000 7f7925d9b640 1 --2- 172.21.15.87:0/970388326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79280feb80 0x7f7928196390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:48.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.866+0000 7f7925d9b640 1 -- 172.21.15.87:0/970388326 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7920009560 con 0x7f7928106440 2024-09-13T17:24:48.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.866+0000 7f7926d9d640 1 --2- 172.21.15.87:0/970388326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f792819acc0 0x7f792819b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:48.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.866+0000 7f7925d9b640 1 --2- 172.21.15.87:0/970388326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7928106440 0x7f79281968d0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f791c00cce0 tx=0x7f791c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:48.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.866+0000 7f79177fe640 1 -- 172.21.15.87:0/970388326 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c00f650 con 0x7f7928106440 2024-09-13T17:24:48.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.866+0000 7f79177fe640 1 -- 172.21.15.87:0/970388326 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f791c00ce90 con 0x7f7928106440 2024-09-13T17:24:48.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.866+0000 7f792cac9640 1 -- 172.21.15.87:0/970388326 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79281a2f70 con 0x7f7928106440 2024-09-13T17:24:48.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.866+0000 7f79177fe640 1 -- 172.21.15.87:0/970388326 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c018b10 con 0x7f7928106440 2024-09-13T17:24:48.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.866+0000 7f792cac9640 1 -- 172.21.15.87:0/970388326 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79281a3390 con 0x7f7928106440 2024-09-13T17:24:48.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.867+0000 7f792cac9640 1 -- 172.21.15.87:0/970388326 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7928067f70 con 0x7f7928106440 2024-09-13T17:24:48.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.869+0000 7f79177fe640 1 -- 172.21.15.87:0/970388326 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f791c018c70 con 0x7f7928106440 2024-09-13T17:24:48.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.869+0000 7f79177fe640 1 --2- 172.21.15.87:0/970388326 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f79100a1200 0x7f79100a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:48.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.869+0000 7f79177fe640 1 -- 172.21.15.87:0/970388326 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f791c0cd8d0 con 0x7f7928106440 2024-09-13T17:24:48.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.869+0000 7f792659c640 1 --2- 172.21.15.87:0/970388326 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f79100a1200 0x7f79100a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:48.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.870+0000 7f792659c640 1 --2- 172.21.15.87:0/970388326 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f79100a1200 0x7f79100a36c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7920005ab0 tx=0x7f7920005a20 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:48.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:48.872+0000 7f79177fe640 1 -- 172.21.15.87:0/970388326 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f791c0969a0 con 0x7f7928106440 2024-09-13T17:24:49.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.035+0000 7f792cac9640 1 -- 172.21.15.87:0/970388326 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7928108400 con 0x7f7928106440 2024-09-13T17:24:49.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.035+0000 7f79177fe640 1 -- 172.21.15.87:0/970388326 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v104) v1 ==== 103+0+11 (secure 0 0 0) 0x7f791c099fc0 con 0x7f7928106440 2024-09-13T17:24:49.037 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-09-13T17:24:49.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.037+0000 7f792cac9640 1 -- 172.21.15.87:0/970388326 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f79100a1200 msgr2=0x7f79100a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:49.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.037+0000 7f792cac9640 1 --2- 172.21.15.87:0/970388326 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f79100a1200 0x7f79100a36c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7920005ab0 tx=0x7f7920005a20 comp rx=0 tx=0).stop 2024-09-13T17:24:49.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.037+0000 7f792cac9640 1 -- 172.21.15.87:0/970388326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7928106440 msgr2=0x7f79281968d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:49.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.037+0000 7f792cac9640 1 --2- 172.21.15.87:0/970388326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7928106440 0x7f79281968d0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f791c00cce0 tx=0x7f791c00a620 comp rx=0 tx=0).stop 2024-09-13T17:24:49.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.037+0000 7f792cac9640 1 -- 172.21.15.87:0/970388326 shutdown_connections 2024-09-13T17:24:49.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.037+0000 7f792cac9640 1 --2- 172.21.15.87:0/970388326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f792819acc0 0x7f792819b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.037+0000 7f792cac9640 1 --2- 172.21.15.87:0/970388326 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f79100a1200 0x7f79100a36c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.037+0000 7f792cac9640 1 --2- 172.21.15.87:0/970388326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7928106440 0x7f79281968d0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.037+0000 7f792cac9640 1 --2- 172.21.15.87:0/970388326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79280feb80 0x7f7928196390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.037+0000 7f792cac9640 1 -- 172.21.15.87:0/970388326 >> 172.21.15.87:0/970388326 conn(0x7f7928074110 msgr2=0x7f7928103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:49.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.037+0000 7f792cac9640 1 -- 172.21.15.87:0/970388326 shutdown_connections 2024-09-13T17:24:49.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.037+0000 7f792cac9640 1 -- 172.21.15.87:0/970388326 wait complete. 2024-09-13T17:24:49.049 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:48 smithi087 ceph-mon[30934]: pgmap v342: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:24:49.049 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:48 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3627076646' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:24:49.049 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:48 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1466141462' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:24:49.049 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:48 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2344928671' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:24:49.050 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:24:49.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.148+0000 7f5abb765640 1 -- 172.21.15.87:0/399578131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ab40feea0 msgr2=0x7f5ab40ff280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:49.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.148+0000 7f5abb765640 1 --2- 172.21.15.87:0/399578131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ab40feea0 0x7f5ab40ff280 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0009930 tx=0x7f5ab002a420 comp rx=0 tx=0).stop 2024-09-13T17:24:49.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.148+0000 7f5abb765640 1 -- 172.21.15.87:0/399578131 shutdown_connections 2024-09-13T17:24:49.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.148+0000 7f5abb765640 1 --2- 172.21.15.87:0/399578131 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ab4103fa0 0x7f5ab410baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.148+0000 7f5abb765640 1 --2- 172.21.15.87:0/399578131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ab40ff850 0x7f5ab4103840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.148+0000 7f5abb765640 1 --2- 172.21.15.87:0/399578131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ab40feea0 0x7f5ab40ff280 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.148+0000 7f5abb765640 1 -- 172.21.15.87:0/399578131 >> 172.21.15.87:0/399578131 conn(0x7f5ab4075c60 msgr2=0x7f5ab40fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:49.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.148+0000 7f5abb765640 1 -- 172.21.15.87:0/399578131 shutdown_connections 2024-09-13T17:24:49.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.148+0000 7f5abb765640 1 -- 172.21.15.87:0/399578131 wait complete. 2024-09-13T17:24:49.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.148+0000 7f5abb765640 1 Processor -- start 2024-09-13T17:24:49.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.148+0000 7f5abb765640 1 -- start start 2024-09-13T17:24:49.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.148+0000 7f5abb765640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ab40feea0 0x7f5ab4196280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:49.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.148+0000 7f5abb765640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ab4103fa0 0x7f5ab41967c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:49.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.148+0000 7f5abb765640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ab419abb0 0x7f5ab419b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:49.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.149+0000 7f5abb765640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab419b5a0 con 0x7f5ab4103fa0 2024-09-13T17:24:49.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.149+0000 7f5abb765640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab419b710 con 0x7f5ab419abb0 2024-09-13T17:24:49.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.149+0000 7f5abb765640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab419b880 con 0x7f5ab40feea0 2024-09-13T17:24:49.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.149+0000 7f5ab8d00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ab4103fa0 0x7f5ab41967c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:49.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.149+0000 7f5ab8d00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ab4103fa0 0x7f5ab41967c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47204/0 (socket says 172.21.15.87:47204) 2024-09-13T17:24:49.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.149+0000 7f5ab8d00640 1 -- 172.21.15.87:0/1407708779 learned_addr learned my addr 172.21.15.87:0/1407708779 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:49.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.149+0000 7f5ab9501640 1 --2- 172.21.15.87:0/1407708779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ab40feea0 0x7f5ab4196280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:49.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.149+0000 7f5ab9d02640 1 --2- 172.21.15.87:0/1407708779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ab419abb0 0x7f5ab419b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:49.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.149+0000 7f5ab8d00640 1 -- 172.21.15.87:0/1407708779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ab40feea0 msgr2=0x7f5ab4196280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:49.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.149+0000 7f5ab8d00640 1 --2- 172.21.15.87:0/1407708779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ab40feea0 0x7f5ab4196280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.149+0000 7f5ab8d00640 1 -- 172.21.15.87:0/1407708779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ab419abb0 msgr2=0x7f5ab419b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:49.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.149+0000 7f5ab8d00640 1 --2- 172.21.15.87:0/1407708779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ab419abb0 0x7f5ab419b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.149+0000 7f5ab8d00640 1 -- 172.21.15.87:0/1407708779 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab0009560 con 0x7f5ab4103fa0 2024-09-13T17:24:49.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.149+0000 7f5ab9d02640 1 --2- 172.21.15.87:0/1407708779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ab419abb0 0x7f5ab419b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:49.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.149+0000 7f5ab8d00640 1 --2- 172.21.15.87:0/1407708779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ab4103fa0 0x7f5ab41967c0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f5aa800c970 tx=0x7f5aa800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:49.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.149+0000 7f5aa67fc640 1 -- 172.21.15.87:0/1407708779 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa8007bb0 con 0x7f5ab4103fa0 2024-09-13T17:24:49.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.149+0000 7f5aa67fc640 1 -- 172.21.15.87:0/1407708779 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5aa8007d10 con 0x7f5ab4103fa0 2024-09-13T17:24:49.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.149+0000 7f5aa67fc640 1 -- 172.21.15.87:0/1407708779 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa800f450 con 0x7f5ab4103fa0 2024-09-13T17:24:49.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.149+0000 7f5abb765640 1 -- 172.21.15.87:0/1407708779 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab41a2e60 con 0x7f5ab4103fa0 2024-09-13T17:24:49.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.149+0000 7f5abb765640 1 -- 172.21.15.87:0/1407708779 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab41a3280 con 0x7f5ab4103fa0 2024-09-13T17:24:49.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.150+0000 7f5abb765640 1 -- 172.21.15.87:0/1407708779 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab4100320 con 0x7f5ab4103fa0 2024-09-13T17:24:49.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.151+0000 7f5aa67fc640 1 -- 172.21.15.87:0/1407708779 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f5aa8004eb0 con 0x7f5ab4103fa0 2024-09-13T17:24:49.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.152+0000 7f5aa67fc640 1 --2- 172.21.15.87:0/1407708779 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5aa00a1280 0x7f5aa00a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:49.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.152+0000 7f5ab9501640 1 --2- 172.21.15.87:0/1407708779 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5aa00a1280 0x7f5aa00a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:49.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.152+0000 7f5aa67fc640 1 -- 172.21.15.87:0/1407708779 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f5aa80cd210 con 0x7f5ab4103fa0 2024-09-13T17:24:49.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.152+0000 7f5ab9501640 1 --2- 172.21.15.87:0/1407708779 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5aa00a1280 0x7f5aa00a3740 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0005ab0 tx=0x7f5ab0005a20 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:49.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.155+0000 7f5aa67fc640 1 -- 172.21.15.87:0/1407708779 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5aa8096270 con 0x7f5ab4103fa0 2024-09-13T17:24:49.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.327+0000 7f5abb765640 1 -- 172.21.15.87:0/1407708779 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5ab40ff280 con 0x7f5ab4103fa0 2024-09-13T17:24:49.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.328+0000 7f5aa67fc640 1 -- 172.21.15.87:0/1407708779 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v104) v1 ==== 81+0+940 (secure 0 0 0) 0x7f5aa801d070 con 0x7f5ab4103fa0 2024-09-13T17:24:49.330 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/718653925 2024-09-14T17:13:49.377087+0000 2024-09-13T17:24:49.330 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/3081317043 2024-09-14T17:13:49.377087+0000 2024-09-13T17:24:49.330 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/1633498542 2024-09-14T17:13:49.377087+0000 2024-09-13T17:24:49.330 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6801/1587363880 2024-09-14T17:04:24.083789+0000 2024-09-13T17:24:49.330 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/3403361612 2024-09-14T17:04:24.083789+0000 2024-09-13T17:24:49.330 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/553289143 2024-09-14T17:04:24.083789+0000 2024-09-13T17:24:49.330 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/1475107314 2024-09-14T17:04:24.083789+0000 2024-09-13T17:24:49.330 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/515676743 2024-09-14T17:04:47.990078+0000 2024-09-13T17:24:49.330 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/3270371628 2024-09-14T17:04:47.990078+0000 2024-09-13T17:24:49.331 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6800/1587363880 2024-09-14T17:04:24.083789+0000 2024-09-13T17:24:49.331 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6800/4144176457 2024-09-14T17:04:47.990078+0000 2024-09-13T17:24:49.331 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6801/4144176457 2024-09-14T17:04:47.990078+0000 2024-09-13T17:24:49.331 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/2612130442 2024-09-14T17:13:49.377087+0000 2024-09-13T17:24:49.331 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/586423689 2024-09-14T17:04:47.990078+0000 2024-09-13T17:24:49.331 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6800/701043027 2024-09-14T17:13:49.377087+0000 2024-09-13T17:24:49.331 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6801/701043027 2024-09-14T17:13:49.377087+0000 2024-09-13T17:24:49.331 INFO:teuthology.orchestra.run.smithi087.stderr:listed 16 entries 2024-09-13T17:24:49.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.330+0000 7f5abb765640 1 -- 172.21.15.87:0/1407708779 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5aa00a1280 msgr2=0x7f5aa00a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:49.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.330+0000 7f5abb765640 1 --2- 172.21.15.87:0/1407708779 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5aa00a1280 0x7f5aa00a3740 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0005ab0 tx=0x7f5ab0005a20 comp rx=0 tx=0).stop 2024-09-13T17:24:49.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.330+0000 7f5abb765640 1 -- 172.21.15.87:0/1407708779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ab4103fa0 msgr2=0x7f5ab41967c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:49.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.330+0000 7f5abb765640 1 --2- 172.21.15.87:0/1407708779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ab4103fa0 0x7f5ab41967c0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f5aa800c970 tx=0x7f5aa800ce30 comp rx=0 tx=0).stop 2024-09-13T17:24:49.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.330+0000 7f5abb765640 1 -- 172.21.15.87:0/1407708779 shutdown_connections 2024-09-13T17:24:49.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.330+0000 7f5abb765640 1 --2- 172.21.15.87:0/1407708779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ab419abb0 0x7f5ab419b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.330+0000 7f5abb765640 1 --2- 172.21.15.87:0/1407708779 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f5aa00a1280 0x7f5aa00a3740 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.330+0000 7f5abb765640 1 --2- 172.21.15.87:0/1407708779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ab4103fa0 0x7f5ab41967c0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.330+0000 7f5abb765640 1 --2- 172.21.15.87:0/1407708779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ab40feea0 0x7f5ab4196280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.330+0000 7f5abb765640 1 -- 172.21.15.87:0/1407708779 >> 172.21.15.87:0/1407708779 conn(0x7f5ab4075c60 msgr2=0x7f5ab4102310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:49.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.330+0000 7f5abb765640 1 -- 172.21.15.87:0/1407708779 shutdown_connections 2024-09-13T17:24:49.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.330+0000 7f5abb765640 1 -- 172.21.15.87:0/1407708779 wait complete. 2024-09-13T17:24:49.342 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T17:24:49.343 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:24:49.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:48 smithi149 ceph-mon[35496]: pgmap v342: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:24:49.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:48 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3627076646' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:24:49.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:48 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1466141462' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:24:49.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:48 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2344928671' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:24:49.360 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:24:49.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:48 smithi118 ceph-mon[34374]: pgmap v342: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:24:49.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:48 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3627076646' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:24:49.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:48 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1466141462' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:24:49.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:48 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2344928671' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:24:49.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.496+0000 7fc4ab26c640 1 -- 172.21.15.87:0/1764850282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4a4104000 msgr2=0x7fc4a410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:49.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.496+0000 7fc4ab26c640 1 --2- 172.21.15.87:0/1764850282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4a4104000 0x7fc4a410bb50 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fc494009930 tx=0x7fc49402a420 comp rx=0 tx=0).stop 2024-09-13T17:24:49.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.496+0000 7fc4ab26c640 1 -- 172.21.15.87:0/1764850282 shutdown_connections 2024-09-13T17:24:49.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.496+0000 7fc4ab26c640 1 --2- 172.21.15.87:0/1764850282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4a4104000 0x7fc4a410bb50 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.496+0000 7fc4ab26c640 1 --2- 172.21.15.87:0/1764850282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4a40ff860 0x7fc4a41038a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.496+0000 7fc4ab26c640 1 --2- 172.21.15.87:0/1764850282 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4a40feeb0 0x7fc4a40ff290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.496+0000 7fc4ab26c640 1 -- 172.21.15.87:0/1764850282 >> 172.21.15.87:0/1764850282 conn(0x7fc4a40fa900 msgr2=0x7fc4a40fcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:49.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.496+0000 7fc4ab26c640 1 -- 172.21.15.87:0/1764850282 shutdown_connections 2024-09-13T17:24:49.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.496+0000 7fc4ab26c640 1 -- 172.21.15.87:0/1764850282 wait complete. 2024-09-13T17:24:49.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.496+0000 7fc4ab26c640 1 Processor -- start 2024-09-13T17:24:49.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.496+0000 7fc4ab26c640 1 -- start start 2024-09-13T17:24:49.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.497+0000 7fc4ab26c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4a40feeb0 0x7fc4a41970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:49.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.497+0000 7fc4ab26c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4a4104000 0x7fc4a4197600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:49.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.497+0000 7fc4ab26c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4a4197b40 0x7fc4a41a2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:49.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.497+0000 7fc4ab26c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a41a27e0 con 0x7fc4a40feeb0 2024-09-13T17:24:49.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.497+0000 7fc4ab26c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a41a2950 con 0x7fc4a4104000 2024-09-13T17:24:49.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.497+0000 7fc4ab26c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a41a2b10 con 0x7fc4a4197b40 2024-09-13T17:24:49.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.497+0000 7fc4a9008640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4a40feeb0 0x7fc4a41970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:49.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.497+0000 7fc4a9008640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4a40feeb0 0x7fc4a41970c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47224/0 (socket says 172.21.15.87:47224) 2024-09-13T17:24:49.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.497+0000 7fc4a9008640 1 -- 172.21.15.87:0/908328291 learned_addr learned my addr 172.21.15.87:0/908328291 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:49.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.497+0000 7fc4a8807640 1 --2- 172.21.15.87:0/908328291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4a4104000 0x7fc4a4197600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:49.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.497+0000 7fc4a9809640 1 --2- 172.21.15.87:0/908328291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4a4197b40 0x7fc4a41a2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:49.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.497+0000 7fc4a9008640 1 -- 172.21.15.87:0/908328291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4a4197b40 msgr2=0x7fc4a41a2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:49.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.497+0000 7fc4a9008640 1 --2- 172.21.15.87:0/908328291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4a4197b40 0x7fc4a41a2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.497+0000 7fc4a9008640 1 -- 172.21.15.87:0/908328291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4a4104000 msgr2=0x7fc4a4197600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:49.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.497+0000 7fc4a9008640 1 --2- 172.21.15.87:0/908328291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4a4104000 0x7fc4a4197600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.497+0000 7fc4a9008640 1 -- 172.21.15.87:0/908328291 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc494009560 con 0x7fc4a40feeb0 2024-09-13T17:24:49.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.497+0000 7fc4a8807640 1 --2- 172.21.15.87:0/908328291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4a4104000 0x7fc4a4197600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:49.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.497+0000 7fc4a9008640 1 --2- 172.21.15.87:0/908328291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4a40feeb0 0x7fc4a41970c0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fc49c00d950 tx=0x7fc49c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:49.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.497+0000 7fc4a27fc640 1 -- 172.21.15.87:0/908328291 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49c009c30 con 0x7fc4a40feeb0 2024-09-13T17:24:49.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.497+0000 7fc4a27fc640 1 -- 172.21.15.87:0/908328291 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc49c009d90 con 0x7fc4a40feeb0 2024-09-13T17:24:49.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.497+0000 7fc4ab26c640 1 -- 172.21.15.87:0/908328291 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a41a2df0 con 0x7fc4a40feeb0 2024-09-13T17:24:49.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.497+0000 7fc4a27fc640 1 -- 172.21.15.87:0/908328291 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49c00f6b0 con 0x7fc4a40feeb0 2024-09-13T17:24:49.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.497+0000 7fc4ab26c640 1 -- 172.21.15.87:0/908328291 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a41a3270 con 0x7fc4a40feeb0 2024-09-13T17:24:49.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.498+0000 7fc4ab26c640 1 -- 172.21.15.87:0/908328291 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a4100380 con 0x7fc4a40feeb0 2024-09-13T17:24:49.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.499+0000 7fc4a27fc640 1 -- 172.21.15.87:0/908328291 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fc49c010aa0 con 0x7fc4a40feeb0 2024-09-13T17:24:49.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.500+0000 7fc4a27fc640 1 --2- 172.21.15.87:0/908328291 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc48c0a1200 0x7fc48c0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:49.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.500+0000 7fc4a8807640 1 --2- 172.21.15.87:0/908328291 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc48c0a1200 0x7fc48c0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:49.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.500+0000 7fc4a27fc640 1 -- 172.21.15.87:0/908328291 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 9556+0+0 (secure 0 0 0) 0x7fc49c0cce40 con 0x7fc4a40feeb0 2024-09-13T17:24:49.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.500+0000 7fc4a8807640 1 --2- 172.21.15.87:0/908328291 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc48c0a1200 0x7fc48c0a36c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc498005c40 tx=0x7fc498005bd0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:49.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.503+0000 7fc4a27fc640 1 -- 172.21.15.87:0/908328291 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc49c095e80 con 0x7fc4a40feeb0 2024-09-13T17:24:49.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.669+0000 7fc4ab26c640 1 -- 172.21.15.87:0/908328291 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4a41071e0 con 0x7fc4a40feeb0 2024-09-13T17:24:49.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.671+0000 7fc4a27fc640 1 -- 172.21.15.87:0/908328291 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) v1 ==== 74+0+25378 (secure 0 0 0) 0x7fc49c020090 con 0x7fc4a40feeb0 2024-09-13T17:24:49.673 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:24:49.674 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":104,"fsid":"043d5bae-71f2-11ef-bceb-c7b262605968","created":"2024-09-13T17:03:57.852010+0000","modified":"2024-09-13T17:24:17.935790+0000","last_up_change":"2024-09-13T17:10:34.423548+0000","last_in_change":"2024-09-13T17:10:14.228123+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:07:02.286400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:11:21.965141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:11:22.504345+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":103,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:11:25.565163+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":103,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58250283-85c0-416e-abdd-1fc5a7ff0c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6803","nonce":1316956138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6805","nonce":1316956138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6809","nonce":1316956138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6807","nonce":1316956138}]},"public_addr":"172.21.15.87:6803/1316956138","cluster_addr":"172.21.15.87:6805/1316956138","heartbeat_back_addr":"172.21.15.87:6809/1316956138","heartbeat_front_addr":"172.21.15.87:6807/1316956138","state":["exists","up"]},{"osd":1,"uuid":"b9d49969-94b1-4262-b4ff-db0a8e3331af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6801","nonce":3352566727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6803","nonce":3352566727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6807","nonce":3352566727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6805","nonce":3352566727}]},"public_addr":"172.21.15.118:6801/3352566727","cluster_addr":"172.21.15.118:6803/3352566727","heartbeat_back_addr":"172.21.15.118:6807/3352566727","heartbeat_front_addr":"172.21.15.118:6805/3352566727","state":["exists","up"]},{"osd":2,"uuid":"ba64549e-d736-426f-b466-f569af5f16d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6801","nonce":2774581686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6803","nonce":2774581686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6807","nonce":2774581686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6805","nonce":2774581686}]},"public_addr":"172.21.15.149:6801/2774581686","cluster_addr":"172.21.15.149:6803/2774581686","heartbeat_back_addr":"172.21.15.149:6807/2774581686","heartbeat_front_addr":"172.21.15.149:6805/2774581686","state":["exists","up"]},{"osd":3,"uuid":"3d5553e5-371b-49fd-976b-9e72a97a2f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6811","nonce":3306119066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6813","nonce":3306119066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6817","nonce":3306119066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6815","nonce":3306119066}]},"public_addr":"172.21.15.87:6811/3306119066","cluster_addr":"172.21.15.87:6813/3306119066","heartbeat_back_addr":"172.21.15.87:6817/3306119066","heartbeat_front_addr":"172.21.15.87:6815/3306119066","state":["exists","up"]},{"osd":4,"uuid":"2fbe0e27-34ec-42a6-9962-f1d8202b3159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6809","nonce":3342349890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6811","nonce":3342349890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6815","nonce":3342349890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6813","nonce":3342349890}]},"public_addr":"172.21.15.118:6809/3342349890","cluster_addr":"172.21.15.118:6811/3342349890","heartbeat_back_addr":"172.21.15.118:6815/3342349890","heartbeat_front_addr":"172.21.15.118:6813/3342349890","state":["exists","up"]},{"osd":5,"uuid":"53c14519-6170-4b5a-a79d-4835882d7bec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6809","nonce":3468867124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6811","nonce":3468867124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6815","nonce":3468867124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6813","nonce":3468867124}]},"public_addr":"172.21.15.149:6809/3468867124","cluster_addr":"172.21.15.149:6811/3468867124","heartbeat_back_addr":"172.21.15.149:6815/3468867124","heartbeat_front_addr":"172.21.15.149:6813/3468867124","state":["exists","up"]},{"osd":6,"uuid":"d3951b32-db77-4b8b-9de0-f05e03d13f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6819","nonce":326563617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6821","nonce":326563617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6825","nonce":326563617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6823","nonce":326563617}]},"public_addr":"172.21.15.87:6819/326563617","cluster_addr":"172.21.15.87:6821/326563617","heartbeat_back_addr":"172.21.15.87:6825/326563617","heartbeat_front_addr":"172.21.15.87:6823/326563617","state":["exists","up"]},{"osd":7,"uuid":"4d46dab7-a8bf-4e3e-b5c0-43860d336bdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6817","nonce":1690268990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6819","nonce":1690268990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6823","nonce":1690268990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6821","nonce":1690268990}]},"public_addr":"172.21.15.118:6817/1690268990","cluster_addr":"172.21.15.118:6819/1690268990","heartbeat_back_addr":"172.21.15.118:6823/1690268990","heartbeat_front_addr":"172.21.15.118:6821/1690268990","state":["exists","up"]},{"osd":8,"uuid":"5a015a7d-60a3-4412-96af-1b61d2ad51f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6817","nonce":1558675380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6819","nonce":1558675380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6823","nonce":1558675380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6821","nonce":1558675380}]},"public_addr":"172.21.15.149:6817/1558675380","cluster_addr":"172.21.15.149:6819/1558675380","heartbeat_back_addr":"172.21.15.149:6823/1558675380","heartbeat_front_addr":"172.21.15.149:6821/1558675380","state":["exists","up"]},{"osd":9,"uuid":"248c0b6e-4c4e-4c63-a0dd-e4cdf3b997a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6827","nonce":1453934262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6829","nonce":1453934262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6833","nonce":1453934262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6831","nonce":1453934262}]},"public_addr":"172.21.15.87:6827/1453934262","cluster_addr":"172.21.15.87:6829/1453934262","heartbeat_back_addr":"172.21.15.87:6833/1453934262","heartbeat_front_addr":"172.21.15.87:6831/1453934262","state":["exists","up"]},{"osd":10,"uuid":"24238714-e737-4371-b5d5-0cd3395f09bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6825","nonce":1034318850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6827","nonce":1034318850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6831","nonce":1034318850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6829","nonce":1034318850}]},"public_addr":"172.21.15.118:6825/1034318850","cluster_addr":"172.21.15.118:6827/1034318850","heartbeat_back_addr":"172.21.15.118:6831/1034318850","heartbeat_front_addr":"172.21.15.118:6829/1034318850","state":["exists","up"]},{"osd":11,"uuid":"409dd3bf-5154-4dea-8708-7de7f9e2e793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6825","nonce":271000465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6827","nonce":271000465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6831","nonce":271000465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6829","nonce":271000465}]},"public_addr":"172.21.15.149:6825/271000465","cluster_addr":"172.21.15.149:6827/271000465","heartbeat_back_addr":"172.21.15.149:6831/271000465","heartbeat_front_addr":"172.21.15.149:6829/271000465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:16.382664+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:37.914250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:00.425876+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:23.960183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:47.004088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:10.214345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:33.719221+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:57.099599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:20.971881+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:44.827167+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:08.135516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:32.085853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.d","mappings":[{"from":1,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8},{"from":5,"to":7}]},{"pgid":"3.28","mappings":[{"from":3,"to":6},{"from":5,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/718653925":"2024-09-14T17:13:49.377087+0000","172.21.15.87:0/3081317043":"2024-09-14T17:13:49.377087+0000","172.21.15.87:0/1633498542":"2024-09-14T17:13:49.377087+0000","172.21.15.87:6801/1587363880":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/3403361612":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/553289143":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/1475107314":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/515676743":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/3270371628":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6800/1587363880":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6800/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6801/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/2612130442":"2024-09-14T17:13:49.377087+0000","172.21.15.87:0/586423689":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6800/701043027":"2024-09-14T17:13:49.377087+0000","172.21.15.87:6801/701043027":"2024-09-14T17:13:49.377087+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]},{"pool":4,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:24:49.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.674+0000 7fc4ab26c640 1 -- 172.21.15.87:0/908328291 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc48c0a1200 msgr2=0x7fc48c0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:49.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.674+0000 7fc4ab26c640 1 --2- 172.21.15.87:0/908328291 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc48c0a1200 0x7fc48c0a36c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc498005c40 tx=0x7fc498005bd0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.674+0000 7fc4ab26c640 1 -- 172.21.15.87:0/908328291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4a40feeb0 msgr2=0x7fc4a41970c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:49.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.674+0000 7fc4ab26c640 1 --2- 172.21.15.87:0/908328291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4a40feeb0 0x7fc4a41970c0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fc49c00d950 tx=0x7fc49c00de10 comp rx=0 tx=0).stop 2024-09-13T17:24:49.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.674+0000 7fc4ab26c640 1 -- 172.21.15.87:0/908328291 shutdown_connections 2024-09-13T17:24:49.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.674+0000 7fc4ab26c640 1 --2- 172.21.15.87:0/908328291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4a4197b40 0x7fc4a41a2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.674+0000 7fc4ab26c640 1 --2- 172.21.15.87:0/908328291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4a4104000 0x7fc4a4197600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.674+0000 7fc4ab26c640 1 --2- 172.21.15.87:0/908328291 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fc48c0a1200 0x7fc48c0a36c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.674+0000 7fc4ab26c640 1 --2- 172.21.15.87:0/908328291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4a40feeb0 0x7fc4a41970c0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.674+0000 7fc4ab26c640 1 -- 172.21.15.87:0/908328291 >> 172.21.15.87:0/908328291 conn(0x7fc4a40fa900 msgr2=0x7fc4a40fbc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:49.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.674+0000 7fc4ab26c640 1 -- 172.21.15.87:0/908328291 shutdown_connections 2024-09-13T17:24:49.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.674+0000 7fc4ab26c640 1 -- 172.21.15.87:0/908328291 wait complete. 2024-09-13T17:24:49.686 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:07:02.286400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:11:21.965141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:11:22.504345+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 103, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:11:25.565163+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 103, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:24:49.687 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:24:49.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.786+0000 7ff566af7640 1 -- 172.21.15.87:0/400326115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff560103fd0 msgr2=0x7ff56010bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:49.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.786+0000 7ff566af7640 1 --2- 172.21.15.87:0/400326115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff560103fd0 0x7ff56010bb20 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7ff558009cd0 tx=0x7ff55802a8e0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.786+0000 7ff566af7640 1 -- 172.21.15.87:0/400326115 shutdown_connections 2024-09-13T17:24:49.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.786+0000 7ff566af7640 1 --2- 172.21.15.87:0/400326115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff560103fd0 0x7ff56010bb20 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.786+0000 7ff566af7640 1 --2- 172.21.15.87:0/400326115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5600ff830 0x7ff560103870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.786+0000 7ff566af7640 1 --2- 172.21.15.87:0/400326115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5600fee80 0x7ff5600ff260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.786+0000 7ff566af7640 1 -- 172.21.15.87:0/400326115 >> 172.21.15.87:0/400326115 conn(0x7ff5600fa930 msgr2=0x7ff5600fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:49.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.786+0000 7ff566af7640 1 -- 172.21.15.87:0/400326115 shutdown_connections 2024-09-13T17:24:49.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.786+0000 7ff566af7640 1 -- 172.21.15.87:0/400326115 wait complete. 2024-09-13T17:24:49.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.787+0000 7ff566af7640 1 Processor -- start 2024-09-13T17:24:49.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.787+0000 7ff566af7640 1 -- start start 2024-09-13T17:24:49.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.787+0000 7ff566af7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5600fee80 0x7ff5601962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:49.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.787+0000 7ff566af7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff560103fd0 0x7ff560196800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:49.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.787+0000 7ff566af7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff56019abf0 0x7ff56019b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:49.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.787+0000 7ff566af7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56019b5e0 con 0x7ff560103fd0 2024-09-13T17:24:49.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.787+0000 7ff566af7640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56019b750 con 0x7ff5600fee80 2024-09-13T17:24:49.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.787+0000 7ff566af7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56019b8c0 con 0x7ff56019abf0 2024-09-13T17:24:49.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.787+0000 7ff557fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff560103fd0 0x7ff560196800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:49.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.787+0000 7ff557fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff560103fd0 0x7ff560196800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47242/0 (socket says 172.21.15.87:47242) 2024-09-13T17:24:49.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.787+0000 7ff557fff640 1 -- 172.21.15.87:0/2759069254 learned_addr learned my addr 172.21.15.87:0/2759069254 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:49.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.787+0000 7ff564893640 1 --2- 172.21.15.87:0/2759069254 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5600fee80 0x7ff5601962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:49.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.788+0000 7ff557fff640 1 -- 172.21.15.87:0/2759069254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff56019abf0 msgr2=0x7ff56019b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:49.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.788+0000 7ff557fff640 1 --2- 172.21.15.87:0/2759069254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff56019abf0 0x7ff56019b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.788+0000 7ff557fff640 1 -- 172.21.15.87:0/2759069254 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5600fee80 msgr2=0x7ff5601962c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:49.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.788+0000 7ff557fff640 1 --2- 172.21.15.87:0/2759069254 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5600fee80 0x7ff5601962c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.788+0000 7ff557fff640 1 -- 172.21.15.87:0/2759069254 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff558009900 con 0x7ff560103fd0 2024-09-13T17:24:49.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.788+0000 7ff557fff640 1 --2- 172.21.15.87:0/2759069254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff560103fd0 0x7ff560196800 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7ff55000b450 tx=0x7ff55000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:49.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.788+0000 7ff555ffb640 1 -- 172.21.15.87:0/2759069254 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff550011890 con 0x7ff560103fd0 2024-09-13T17:24:49.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.788+0000 7ff555ffb640 1 -- 172.21.15.87:0/2759069254 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff5500103e0 con 0x7ff560103fd0 2024-09-13T17:24:49.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.788+0000 7ff566af7640 1 -- 172.21.15.87:0/2759069254 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5601a2ea0 con 0x7ff560103fd0 2024-09-13T17:24:49.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.788+0000 7ff555ffb640 1 -- 172.21.15.87:0/2759069254 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff550011ea0 con 0x7ff560103fd0 2024-09-13T17:24:49.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.788+0000 7ff566af7640 1 -- 172.21.15.87:0/2759069254 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5601a32c0 con 0x7ff560103fd0 2024-09-13T17:24:49.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.789+0000 7ff566af7640 1 -- 172.21.15.87:0/2759069254 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff560100350 con 0x7ff560103fd0 2024-09-13T17:24:49.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.790+0000 7ff555ffb640 1 -- 172.21.15.87:0/2759069254 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7ff550010550 con 0x7ff560103fd0 2024-09-13T17:24:49.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.791+0000 7ff555ffb640 1 --2- 172.21.15.87:0/2759069254 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff5480a1200 0x7ff5480a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:49.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.791+0000 7ff564893640 1 --2- 172.21.15.87:0/2759069254 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff5480a1200 0x7ff5480a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:49.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.791+0000 7ff555ffb640 1 -- 172.21.15.87:0/2759069254 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 9556+0+0 (secure 0 0 0) 0x7ff5500cce90 con 0x7ff560103fd0 2024-09-13T17:24:49.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.791+0000 7ff564893640 1 --2- 172.21.15.87:0/2759069254 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff5480a1200 0x7ff5480a36c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff55c0058c0 tx=0x7ff55c00a4c0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:49.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.795+0000 7ff555ffb640 1 -- 172.21.15.87:0/2759069254 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff550095fe0 con 0x7ff560103fd0 2024-09-13T17:24:49.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.955+0000 7ff566af7640 1 -- 172.21.15.87:0/2759069254 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff5600ff260 con 0x7ff560103fd0 2024-09-13T17:24:49.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.956+0000 7ff555ffb640 1 -- 172.21.15.87:0/2759069254 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v104) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff5500150a0 con 0x7ff560103fd0 2024-09-13T17:24:49.958 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-09-13T17:24:49.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.958+0000 7ff566af7640 1 -- 172.21.15.87:0/2759069254 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff5480a1200 msgr2=0x7ff5480a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:49.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.958+0000 7ff566af7640 1 --2- 172.21.15.87:0/2759069254 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff5480a1200 0x7ff5480a36c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff55c0058c0 tx=0x7ff55c00a4c0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.958+0000 7ff566af7640 1 -- 172.21.15.87:0/2759069254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff560103fd0 msgr2=0x7ff560196800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:49.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.958+0000 7ff566af7640 1 --2- 172.21.15.87:0/2759069254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff560103fd0 0x7ff560196800 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7ff55000b450 tx=0x7ff55000b910 comp rx=0 tx=0).stop 2024-09-13T17:24:49.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.958+0000 7ff566af7640 1 -- 172.21.15.87:0/2759069254 shutdown_connections 2024-09-13T17:24:49.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.958+0000 7ff566af7640 1 --2- 172.21.15.87:0/2759069254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff56019abf0 0x7ff56019b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.958+0000 7ff566af7640 1 --2- 172.21.15.87:0/2759069254 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff5480a1200 0x7ff5480a36c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.958+0000 7ff566af7640 1 --2- 172.21.15.87:0/2759069254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff560103fd0 0x7ff560196800 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.958+0000 7ff566af7640 1 --2- 172.21.15.87:0/2759069254 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5600fee80 0x7ff5601962c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:49.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.958+0000 7ff566af7640 1 -- 172.21.15.87:0/2759069254 >> 172.21.15.87:0/2759069254 conn(0x7ff5600fa930 msgr2=0x7ff560068990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:49.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.958+0000 7ff566af7640 1 -- 172.21.15.87:0/2759069254 shutdown_connections 2024-09-13T17:24:49.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:49.958+0000 7ff566af7640 1 -- 172.21.15.87:0/2759069254 wait complete. 2024-09-13T17:24:49.971 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:24:50.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.071+0000 7f57627c7640 1 -- 172.21.15.87:0/3326350050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f575c0ff480 msgr2=0x7f575c105cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:50.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.071+0000 7f57627c7640 1 --2- 172.21.15.87:0/3326350050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f575c0ff480 0x7f575c105cc0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f5744009960 tx=0x7f574402a4f0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.071+0000 7f57627c7640 1 -- 172.21.15.87:0/3326350050 shutdown_connections 2024-09-13T17:24:50.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.071+0000 7f57627c7640 1 --2- 172.21.15.87:0/3326350050 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f575c106420 0x7f575c10cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.071+0000 7f57627c7640 1 --2- 172.21.15.87:0/3326350050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f575c0ff480 0x7f575c105cc0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.071+0000 7f57627c7640 1 --2- 172.21.15.87:0/3326350050 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f575c0feb60 0x7f575c0fef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.071+0000 7f57627c7640 1 -- 172.21.15.87:0/3326350050 >> 172.21.15.87:0/3326350050 conn(0x7f575c0741b0 msgr2=0x7f575c0745c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:50.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.071+0000 7f57627c7640 1 -- 172.21.15.87:0/3326350050 shutdown_connections 2024-09-13T17:24:50.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.072+0000 7f57627c7640 1 -- 172.21.15.87:0/3326350050 wait complete. 2024-09-13T17:24:50.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.072+0000 7f57627c7640 1 Processor -- start 2024-09-13T17:24:50.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.072+0000 7f57627c7640 1 -- start start 2024-09-13T17:24:50.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.072+0000 7f57627c7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f575c0feb60 0x7f575c1962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:50.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.072+0000 7f57627c7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f575c0ff480 0x7f575c196810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:50.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.072+0000 7f57627c7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f575c106420 0x7f575c19ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:50.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.072+0000 7f57627c7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575c19b200 con 0x7f575c106420 2024-09-13T17:24:50.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.072+0000 7f57627c7640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575c19b370 con 0x7f575c0feb60 2024-09-13T17:24:50.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.072+0000 7f57627c7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575c19b530 con 0x7f575c0ff480 2024-09-13T17:24:50.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.072+0000 7f5760d64640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f575c106420 0x7f575c19ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:50.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.072+0000 7f5760d64640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f575c106420 0x7f575c19ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47252/0 (socket says 172.21.15.87:47252) 2024-09-13T17:24:50.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.072+0000 7f5760d64640 1 -- 172.21.15.87:0/421875355 learned_addr learned my addr 172.21.15.87:0/421875355 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:50.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.073+0000 7f575bfff640 1 --2- 172.21.15.87:0/421875355 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f575c0feb60 0x7f575c1962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:50.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.073+0000 7f5760d64640 1 -- 172.21.15.87:0/421875355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f575c0ff480 msgr2=0x7f575c196810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:50.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.073+0000 7f5753fff640 1 --2- 172.21.15.87:0/421875355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f575c0ff480 0x7f575c196810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:50.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.073+0000 7f5760d64640 1 --2- 172.21.15.87:0/421875355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f575c0ff480 0x7f575c196810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.073+0000 7f5760d64640 1 -- 172.21.15.87:0/421875355 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f575c0feb60 msgr2=0x7f575c1962d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:50.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.073+0000 7f5760d64640 1 --2- 172.21.15.87:0/421875355 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f575c0feb60 0x7f575c1962d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.073+0000 7f5760d64640 1 -- 172.21.15.87:0/421875355 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5744009560 con 0x7f575c106420 2024-09-13T17:24:50.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.073+0000 7f575bfff640 1 --2- 172.21.15.87:0/421875355 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f575c0feb60 0x7f575c1962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:50.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.073+0000 7f5760d64640 1 --2- 172.21.15.87:0/421875355 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f575c106420 0x7f575c19ac00 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f575400cce0 tx=0x7f575400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:50.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.073+0000 7f5759ffb640 1 -- 172.21.15.87:0/421875355 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575400f450 con 0x7f575c106420 2024-09-13T17:24:50.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.073+0000 7f5759ffb640 1 -- 172.21.15.87:0/421875355 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f575400fa60 con 0x7f575c106420 2024-09-13T17:24:50.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.073+0000 7f57627c7640 1 -- 172.21.15.87:0/421875355 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f575c19b810 con 0x7f575c106420 2024-09-13T17:24:50.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.073+0000 7f5759ffb640 1 -- 172.21.15.87:0/421875355 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5754018b10 con 0x7f575c106420 2024-09-13T17:24:50.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.073+0000 7f57627c7640 1 -- 172.21.15.87:0/421875355 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f575c1a3090 con 0x7f575c106420 2024-09-13T17:24:50.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.074+0000 7f57627c7640 1 -- 172.21.15.87:0/421875355 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f575c067f30 con 0x7f575c106420 2024-09-13T17:24:50.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.075+0000 7f5759ffb640 1 -- 172.21.15.87:0/421875355 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f575400fbd0 con 0x7f575c106420 2024-09-13T17:24:50.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.076+0000 7f5759ffb640 1 --2- 172.21.15.87:0/421875355 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f57480a1200 0x7f57480a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:50.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.076+0000 7f575bfff640 1 --2- 172.21.15.87:0/421875355 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f57480a1200 0x7f57480a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:50.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.076+0000 7f5759ffb640 1 -- 172.21.15.87:0/421875355 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f57540cd560 con 0x7f575c106420 2024-09-13T17:24:50.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.076+0000 7f575bfff640 1 --2- 172.21.15.87:0/421875355 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f57480a1200 0x7f57480a36c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f574c00baa0 tx=0x7f574c005d90 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:50.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.080+0000 7f5759ffb640 1 -- 172.21.15.87:0/421875355 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f57540965a0 con 0x7f575c106420 2024-09-13T17:24:50.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:49 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/970388326' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:24:50.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:49 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1407708779' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T17:24:50.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:49 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/908328291' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:24:50.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:49 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2759069254' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:24:50.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.243+0000 7f57627c7640 1 -- 172.21.15.87:0/421875355 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f575c0fef40 con 0x7f575c106420 2024-09-13T17:24:50.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.244+0000 7f5759ffb640 1 -- 172.21.15.87:0/421875355 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v104) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5754099bc0 con 0x7f575c106420 2024-09-13T17:24:50.245 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-09-13T17:24:50.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.246+0000 7f57627c7640 1 -- 172.21.15.87:0/421875355 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f57480a1200 msgr2=0x7f57480a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:50.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.246+0000 7f57627c7640 1 --2- 172.21.15.87:0/421875355 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f57480a1200 0x7f57480a36c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f574c00baa0 tx=0x7f574c005d90 comp rx=0 tx=0).stop 2024-09-13T17:24:50.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.246+0000 7f57627c7640 1 -- 172.21.15.87:0/421875355 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f575c106420 msgr2=0x7f575c19ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:50.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.246+0000 7f57627c7640 1 --2- 172.21.15.87:0/421875355 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f575c106420 0x7f575c19ac00 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f575400cce0 tx=0x7f575400a620 comp rx=0 tx=0).stop 2024-09-13T17:24:50.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.246+0000 7f57627c7640 1 -- 172.21.15.87:0/421875355 shutdown_connections 2024-09-13T17:24:50.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.246+0000 7f57627c7640 1 --2- 172.21.15.87:0/421875355 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f57480a1200 0x7f57480a36c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.246+0000 7f57627c7640 1 --2- 172.21.15.87:0/421875355 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f575c106420 0x7f575c19ac00 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.246+0000 7f57627c7640 1 --2- 172.21.15.87:0/421875355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f575c0ff480 0x7f575c196810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.246+0000 7f57627c7640 1 --2- 172.21.15.87:0/421875355 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f575c0feb60 0x7f575c1962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.246+0000 7f57627c7640 1 -- 172.21.15.87:0/421875355 >> 172.21.15.87:0/421875355 conn(0x7f575c0741b0 msgr2=0x7f575c103e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:50.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.246+0000 7f57627c7640 1 -- 172.21.15.87:0/421875355 shutdown_connections 2024-09-13T17:24:50.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.246+0000 7f57627c7640 1 -- 172.21.15.87:0/421875355 wait complete. 2024-09-13T17:24:50.258 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:24:50.346 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:49 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/970388326' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:24:50.346 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:49 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1407708779' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T17:24:50.346 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:49 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/908328291' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:24:50.346 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:49 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2759069254' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:24:50.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.358+0000 7f3141fb5640 1 -- 172.21.15.87:0/2586947332 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f313c0fee60 msgr2=0x7f313c0ff240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:50.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.358+0000 7f3141fb5640 1 --2- 172.21.15.87:0/2586947332 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f313c0fee60 0x7f313c0ff240 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f312c009930 tx=0x7f312c02a420 comp rx=0 tx=0).stop 2024-09-13T17:24:50.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.359+0000 7f3141fb5640 1 -- 172.21.15.87:0/2586947332 shutdown_connections 2024-09-13T17:24:50.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.359+0000 7f3141fb5640 1 --2- 172.21.15.87:0/2586947332 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f313c103fb0 0x7f313c10bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.359+0000 7f3141fb5640 1 --2- 172.21.15.87:0/2586947332 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f313c0ff810 0x7f313c103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.359+0000 7f3141fb5640 1 --2- 172.21.15.87:0/2586947332 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f313c0fee60 0x7f313c0ff240 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.359+0000 7f3141fb5640 1 -- 172.21.15.87:0/2586947332 >> 172.21.15.87:0/2586947332 conn(0x7f313c075c60 msgr2=0x7f313c0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:50.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.359+0000 7f3141fb5640 1 -- 172.21.15.87:0/2586947332 shutdown_connections 2024-09-13T17:24:50.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.359+0000 7f3141fb5640 1 -- 172.21.15.87:0/2586947332 wait complete. 2024-09-13T17:24:50.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.359+0000 7f3141fb5640 1 Processor -- start 2024-09-13T17:24:50.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.359+0000 7f3141fb5640 1 -- start start 2024-09-13T17:24:50.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.359+0000 7f3141fb5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f313c0fee60 0x7f313c195130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:50.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.359+0000 7f3141fb5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f313c103fb0 0x7f313c195670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:50.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.359+0000 7f3141fb5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f313c199a60 0x7f313c199f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:50.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.360+0000 7f3141fb5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f313c19a450 con 0x7f313c0fee60 2024-09-13T17:24:50.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.360+0000 7f3141fb5640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f313c19a5c0 con 0x7f313c199a60 2024-09-13T17:24:50.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.360+0000 7f3141fb5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f313c19a730 con 0x7f313c103fb0 2024-09-13T17:24:50.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.360+0000 7f313b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f313c0fee60 0x7f313c195130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:50.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.360+0000 7f313b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f313c0fee60 0x7f313c195130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47268/0 (socket says 172.21.15.87:47268) 2024-09-13T17:24:50.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.360+0000 7f313b7fe640 1 -- 172.21.15.87:0/2068803632 learned_addr learned my addr 172.21.15.87:0/2068803632 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:50.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.360+0000 7f313affd640 1 --2- 172.21.15.87:0/2068803632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f313c103fb0 0x7f313c195670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:50.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.360+0000 7f313b7fe640 1 -- 172.21.15.87:0/2068803632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f313c103fb0 msgr2=0x7f313c195670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:50.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.360+0000 7f313b7fe640 1 --2- 172.21.15.87:0/2068803632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f313c103fb0 0x7f313c195670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.360+0000 7f313b7fe640 1 -- 172.21.15.87:0/2068803632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f313c199a60 msgr2=0x7f313c199f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:50.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.360+0000 7f313b7fe640 1 --2- 172.21.15.87:0/2068803632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f313c199a60 0x7f313c199f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.360+0000 7f313b7fe640 1 -- 172.21.15.87:0/2068803632 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f312c009560 con 0x7f313c0fee60 2024-09-13T17:24:50.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.360+0000 7f313b7fe640 1 --2- 172.21.15.87:0/2068803632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f313c0fee60 0x7f313c195130 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f312c005760 tx=0x7f312c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:50.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.360+0000 7f3138ff9640 1 -- 172.21.15.87:0/2068803632 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312c004520 con 0x7f313c0fee60 2024-09-13T17:24:50.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.360+0000 7f3141fb5640 1 -- 172.21.15.87:0/2068803632 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f313c1a1d10 con 0x7f313c0fee60 2024-09-13T17:24:50.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.360+0000 7f3138ff9640 1 -- 172.21.15.87:0/2068803632 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f312c031c40 con 0x7f313c0fee60 2024-09-13T17:24:50.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.360+0000 7f3138ff9640 1 -- 172.21.15.87:0/2068803632 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312c032440 con 0x7f313c0fee60 2024-09-13T17:24:50.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.360+0000 7f3141fb5640 1 -- 172.21.15.87:0/2068803632 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f313c1a2190 con 0x7f313c0fee60 2024-09-13T17:24:50.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.361+0000 7f3141fb5640 1 -- 172.21.15.87:0/2068803632 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f313c100330 con 0x7f313c0fee60 2024-09-13T17:24:50.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.362+0000 7f3138ff9640 1 -- 172.21.15.87:0/2068803632 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f312c003ba0 con 0x7f313c0fee60 2024-09-13T17:24:50.365 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:49 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/970388326' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:24:50.365 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:49 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1407708779' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T17:24:50.365 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:49 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/908328291' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:24:50.366 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:49 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2759069254' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T17:24:50.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.363+0000 7f3138ff9640 1 --2- 172.21.15.87:0/2068803632 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f31240a1200 0x7f31240a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:50.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.363+0000 7f3138ff9640 1 -- 172.21.15.87:0/2068803632 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f312c0edba0 con 0x7f313c0fee60 2024-09-13T17:24:50.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.363+0000 7f313affd640 1 --2- 172.21.15.87:0/2068803632 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f31240a1200 0x7f31240a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:50.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.363+0000 7f313affd640 1 --2- 172.21.15.87:0/2068803632 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f31240a1200 0x7f31240a36c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f313c1966d0 tx=0x7f3130005c60 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:50.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.367+0000 7f3138ff9640 1 -- 172.21.15.87:0/2068803632 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f312c0b6be0 con 0x7f313c0fee60 2024-09-13T17:24:50.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.530+0000 7f3141fb5640 1 -- 172.21.15.87:0/2068803632 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f313c1964b0 con 0x7f313c0fee60 2024-09-13T17:24:50.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.531+0000 7f3138ff9640 1 -- 172.21.15.87:0/2068803632 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v104) v1 ==== 100+0+11 (secure 0 0 0) 0x7f312c035020 con 0x7f313c0fee60 2024-09-13T17:24:50.533 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-09-13T17:24:50.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.533+0000 7f3141fb5640 1 -- 172.21.15.87:0/2068803632 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f31240a1200 msgr2=0x7f31240a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:50.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.533+0000 7f3141fb5640 1 --2- 172.21.15.87:0/2068803632 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f31240a1200 0x7f31240a36c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f313c1966d0 tx=0x7f3130005c60 comp rx=0 tx=0).stop 2024-09-13T17:24:50.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.533+0000 7f3141fb5640 1 -- 172.21.15.87:0/2068803632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f313c0fee60 msgr2=0x7f313c195130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:50.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.533+0000 7f3141fb5640 1 --2- 172.21.15.87:0/2068803632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f313c0fee60 0x7f313c195130 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f312c005760 tx=0x7f312c004270 comp rx=0 tx=0).stop 2024-09-13T17:24:50.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.533+0000 7f3141fb5640 1 -- 172.21.15.87:0/2068803632 shutdown_connections 2024-09-13T17:24:50.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.533+0000 7f3141fb5640 1 --2- 172.21.15.87:0/2068803632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f313c199a60 0x7f313c199f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.533+0000 7f3141fb5640 1 --2- 172.21.15.87:0/2068803632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f313c103fb0 0x7f313c195670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.533+0000 7f3141fb5640 1 --2- 172.21.15.87:0/2068803632 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f31240a1200 0x7f31240a36c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.533+0000 7f3141fb5640 1 --2- 172.21.15.87:0/2068803632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f313c0fee60 0x7f313c195130 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.533+0000 7f3141fb5640 1 -- 172.21.15.87:0/2068803632 >> 172.21.15.87:0/2068803632 conn(0x7f313c075c60 msgr2=0x7f313c102280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:50.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.533+0000 7f3141fb5640 1 -- 172.21.15.87:0/2068803632 shutdown_connections 2024-09-13T17:24:50.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.533+0000 7f3141fb5640 1 -- 172.21.15.87:0/2068803632 wait complete. 2024-09-13T17:24:50.549 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:24:50.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.650+0000 7f1044d9d640 1 -- 172.21.15.87:0/2352580092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10400ffec0 msgr2=0x7f10401002a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:50.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.650+0000 7f1044d9d640 1 --2- 172.21.15.87:0/2352580092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10400ffec0 0x7f10401002a0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f1030009930 tx=0x7f103002a420 comp rx=0 tx=0).stop 2024-09-13T17:24:50.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.650+0000 7f1044d9d640 1 -- 172.21.15.87:0/2352580092 shutdown_connections 2024-09-13T17:24:50.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.650+0000 7f1044d9d640 1 --2- 172.21.15.87:0/2352580092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1040105010 0x7f104010cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.650+0000 7f1044d9d640 1 --2- 172.21.15.87:0/2352580092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1040100870 0x7f10401048b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.650+0000 7f1044d9d640 1 --2- 172.21.15.87:0/2352580092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10400ffec0 0x7f10401002a0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.650+0000 7f1044d9d640 1 -- 172.21.15.87:0/2352580092 >> 172.21.15.87:0/2352580092 conn(0x7f10400fb970 msgr2=0x7f10400fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:50.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.651+0000 7f1044d9d640 1 -- 172.21.15.87:0/2352580092 shutdown_connections 2024-09-13T17:24:50.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.651+0000 7f1044d9d640 1 -- 172.21.15.87:0/2352580092 wait complete. 2024-09-13T17:24:50.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.651+0000 7f1044d9d640 1 Processor -- start 2024-09-13T17:24:50.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.651+0000 7f1044d9d640 1 -- start start 2024-09-13T17:24:50.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.651+0000 7f1044d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10400ffec0 0x7f10400727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:50.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.651+0000 7f1044d9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1040105010 0x7f1040072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:50.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.651+0000 7f1044d9d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1040073230 0x7f10401a4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:50.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.652+0000 7f1044d9d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10401a4a50 con 0x7f10400ffec0 2024-09-13T17:24:50.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.652+0000 7f1044d9d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10401a4bc0 con 0x7f1040105010 2024-09-13T17:24:50.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.652+0000 7f1044d9d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10401a4d80 con 0x7f1040073230 2024-09-13T17:24:50.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.652+0000 7f103f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10400ffec0 0x7f10400727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:50.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.652+0000 7f103f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10400ffec0 0x7f10400727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47286/0 (socket says 172.21.15.87:47286) 2024-09-13T17:24:50.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.652+0000 7f103f7fe640 1 -- 172.21.15.87:0/677736729 learned_addr learned my addr 172.21.15.87:0/677736729 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:50.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.652+0000 7f1036ffd640 1 --2- 172.21.15.87:0/677736729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1040105010 0x7f1040072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:50.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.652+0000 7f103ffff640 1 --2- 172.21.15.87:0/677736729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1040073230 0x7f10401a4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:50.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.652+0000 7f103f7fe640 1 -- 172.21.15.87:0/677736729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1040073230 msgr2=0x7f10401a4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:50.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.652+0000 7f103f7fe640 1 --2- 172.21.15.87:0/677736729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1040073230 0x7f10401a4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.652+0000 7f103f7fe640 1 -- 172.21.15.87:0/677736729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1040105010 msgr2=0x7f1040072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:50.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.652+0000 7f103f7fe640 1 --2- 172.21.15.87:0/677736729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1040105010 0x7f1040072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.652+0000 7f103f7fe640 1 -- 172.21.15.87:0/677736729 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1030009560 con 0x7f10400ffec0 2024-09-13T17:24:50.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.652+0000 7f1036ffd640 1 --2- 172.21.15.87:0/677736729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1040105010 0x7f1040072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:50.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.652+0000 7f103f7fe640 1 --2- 172.21.15.87:0/677736729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10400ffec0 0x7f10400727b0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f1030009900 tx=0x7f10300042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:50.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.652+0000 7f103d7fa640 1 -- 172.21.15.87:0/677736729 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1030003a00 con 0x7f10400ffec0 2024-09-13T17:24:50.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.652+0000 7f103d7fa640 1 -- 172.21.15.87:0/677736729 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f10300044e0 con 0x7f10400ffec0 2024-09-13T17:24:50.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.652+0000 7f1044d9d640 1 -- 172.21.15.87:0/677736729 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10401a5000 con 0x7f10400ffec0 2024-09-13T17:24:50.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.652+0000 7f103d7fa640 1 -- 172.21.15.87:0/677736729 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103003a3c0 con 0x7f10400ffec0 2024-09-13T17:24:50.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.652+0000 7f1044d9d640 1 -- 172.21.15.87:0/677736729 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10401a54b0 con 0x7f10400ffec0 2024-09-13T17:24:50.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.653+0000 7f1044d9d640 1 -- 172.21.15.87:0/677736729 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1040101390 con 0x7f10400ffec0 2024-09-13T17:24:50.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.654+0000 7f103d7fa640 1 -- 172.21.15.87:0/677736729 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f103003b460 con 0x7f10400ffec0 2024-09-13T17:24:50.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.655+0000 7f103d7fa640 1 --2- 172.21.15.87:0/677736729 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f102c0a1200 0x7f102c0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:50.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.655+0000 7f1036ffd640 1 --2- 172.21.15.87:0/677736729 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f102c0a1200 0x7f102c0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:50.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.655+0000 7f103d7fa640 1 -- 172.21.15.87:0/677736729 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f10300ee330 con 0x7f10400ffec0 2024-09-13T17:24:50.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.655+0000 7f1036ffd640 1 --2- 172.21.15.87:0/677736729 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f102c0a1200 0x7f102c0a36c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f10280058c0 tx=0x7f1028005850 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:50.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.658+0000 7f103d7fa640 1 -- 172.21.15.87:0/677736729 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f10300b7370 con 0x7f10400ffec0 2024-09-13T17:24:50.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.822+0000 7f1044d9d640 1 -- 172.21.15.87:0/677736729 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f10401081c0 con 0x7f10400ffec0 2024-09-13T17:24:50.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.823+0000 7f103d7fa640 1 -- 172.21.15.87:0/677736729 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v104) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1030035020 con 0x7f10400ffec0 2024-09-13T17:24:50.824 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-09-13T17:24:50.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.825+0000 7f1044d9d640 1 -- 172.21.15.87:0/677736729 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f102c0a1200 msgr2=0x7f102c0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:50.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.825+0000 7f1044d9d640 1 --2- 172.21.15.87:0/677736729 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f102c0a1200 0x7f102c0a36c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f10280058c0 tx=0x7f1028005850 comp rx=0 tx=0).stop 2024-09-13T17:24:50.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.825+0000 7f1044d9d640 1 -- 172.21.15.87:0/677736729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10400ffec0 msgr2=0x7f10400727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:50.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.825+0000 7f1044d9d640 1 --2- 172.21.15.87:0/677736729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10400ffec0 0x7f10400727b0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f1030009900 tx=0x7f10300042f0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.825+0000 7f1044d9d640 1 -- 172.21.15.87:0/677736729 shutdown_connections 2024-09-13T17:24:50.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.825+0000 7f1044d9d640 1 --2- 172.21.15.87:0/677736729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1040073230 0x7f10401a4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.825+0000 7f1044d9d640 1 --2- 172.21.15.87:0/677736729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1040105010 0x7f1040072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.825+0000 7f1044d9d640 1 --2- 172.21.15.87:0/677736729 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f102c0a1200 0x7f102c0a36c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.825+0000 7f1044d9d640 1 --2- 172.21.15.87:0/677736729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10400ffec0 0x7f10400727b0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.825+0000 7f1044d9d640 1 -- 172.21.15.87:0/677736729 >> 172.21.15.87:0/677736729 conn(0x7f10400fb970 msgr2=0x7f10400fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:50.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.825+0000 7f1044d9d640 1 -- 172.21.15.87:0/677736729 shutdown_connections 2024-09-13T17:24:50.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.825+0000 7f1044d9d640 1 -- 172.21.15.87:0/677736729 wait complete. 2024-09-13T17:24:50.837 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:24:50.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.935+0000 7f460843a640 1 -- 172.21.15.87:0/3365253420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f460010a3a0 msgr2=0x7f460010c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:50.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.935+0000 7f460843a640 1 --2- 172.21.15.87:0/3365253420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f460010a3a0 0x7f460010c820 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f45f8009ca0 tx=0x7f45f802a950 comp rx=0 tx=0).stop 2024-09-13T17:24:50.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.935+0000 7f460843a640 1 -- 172.21.15.87:0/3365253420 shutdown_connections 2024-09-13T17:24:50.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.935+0000 7f460843a640 1 --2- 172.21.15.87:0/3365253420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f460010a3a0 0x7f460010c820 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.935+0000 7f460843a640 1 --2- 172.21.15.87:0/3365253420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4600101870 0x7f4600109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.935+0000 7f460843a640 1 --2- 172.21.15.87:0/3365253420 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4600100f50 0x7f4600101330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.936+0000 7f460843a640 1 -- 172.21.15.87:0/3365253420 >> 172.21.15.87:0/3365253420 conn(0x7f46000fa940 msgr2=0x7f46000fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:50.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.936+0000 7f460843a640 1 -- 172.21.15.87:0/3365253420 shutdown_connections 2024-09-13T17:24:50.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.936+0000 7f460843a640 1 -- 172.21.15.87:0/3365253420 wait complete. 2024-09-13T17:24:50.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.936+0000 7f460843a640 1 Processor -- start 2024-09-13T17:24:50.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.936+0000 7f460843a640 1 -- start start 2024-09-13T17:24:50.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.936+0000 7f460843a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4600100f50 0x7f46001962b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:50.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.936+0000 7f460843a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4600101870 0x7f46001967f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:50.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.936+0000 7f460843a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f460010a3a0 0x7f460019abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:50.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.936+0000 7f460843a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460019b1e0 con 0x7f460010a3a0 2024-09-13T17:24:50.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.936+0000 7f460843a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460019b350 con 0x7f4600101870 2024-09-13T17:24:50.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.936+0000 7f460843a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460019b510 con 0x7f4600100f50 2024-09-13T17:24:50.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.936+0000 7f46069d7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f460010a3a0 0x7f460019abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:50.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.936+0000 7f46069d7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f460010a3a0 0x7f460019abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47304/0 (socket says 172.21.15.87:47304) 2024-09-13T17:24:50.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.936+0000 7f46069d7640 1 -- 172.21.15.87:0/3830703271 learned_addr learned my addr 172.21.15.87:0/3830703271 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:50.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.936+0000 7f46061d6640 1 --2- 172.21.15.87:0/3830703271 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4600100f50 0x7f46001962b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:50.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.937+0000 7f46059d5640 1 --2- 172.21.15.87:0/3830703271 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4600101870 0x7f46001967f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:50.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.937+0000 7f46069d7640 1 -- 172.21.15.87:0/3830703271 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4600100f50 msgr2=0x7f46001962b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:50.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.937+0000 7f46069d7640 1 --2- 172.21.15.87:0/3830703271 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4600100f50 0x7f46001962b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.937+0000 7f46069d7640 1 -- 172.21.15.87:0/3830703271 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4600101870 msgr2=0x7f46001967f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:50.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.937+0000 7f46069d7640 1 --2- 172.21.15.87:0/3830703271 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4600101870 0x7f46001967f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:50.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.937+0000 7f46069d7640 1 -- 172.21.15.87:0/3830703271 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f8009900 con 0x7f460010a3a0 2024-09-13T17:24:50.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.937+0000 7f46069d7640 1 --2- 172.21.15.87:0/3830703271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f460010a3a0 0x7f460019abe0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f45f802af40 tx=0x7f45f802fd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:50.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.937+0000 7f45f77fe640 1 -- 172.21.15.87:0/3830703271 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f8003d80 con 0x7f460010a3a0 2024-09-13T17:24:50.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.937+0000 7f45f77fe640 1 -- 172.21.15.87:0/3830703271 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f45f80308f0 con 0x7f460010a3a0 2024-09-13T17:24:50.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.937+0000 7f460843a640 1 -- 172.21.15.87:0/3830703271 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f460019b790 con 0x7f460010a3a0 2024-09-13T17:24:50.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.937+0000 7f45f77fe640 1 -- 172.21.15.87:0/3830703271 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f8004820 con 0x7f460010a3a0 2024-09-13T17:24:50.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.937+0000 7f460843a640 1 -- 172.21.15.87:0/3830703271 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f460019ba60 con 0x7f460010a3a0 2024-09-13T17:24:50.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.938+0000 7f460843a640 1 -- 172.21.15.87:0/3830703271 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4600068f10 con 0x7f460010a3a0 2024-09-13T17:24:50.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.939+0000 7f45f77fe640 1 -- 172.21.15.87:0/3830703271 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f45f802e050 con 0x7f460010a3a0 2024-09-13T17:24:50.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.940+0000 7f45f77fe640 1 --2- 172.21.15.87:0/3830703271 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f45ec0a1200 0x7f45ec0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:50.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.940+0000 7f46061d6640 1 --2- 172.21.15.87:0/3830703271 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f45ec0a1200 0x7f45ec0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:50.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.940+0000 7f45f77fe640 1 -- 172.21.15.87:0/3830703271 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f45f80ede90 con 0x7f460010a3a0 2024-09-13T17:24:50.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.940+0000 7f46061d6640 1 --2- 172.21.15.87:0/3830703271 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f45ec0a1200 0x7f45ec0a36c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f45fc005d00 tx=0x7f45fc00b410 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:50.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:50.944+0000 7f45f77fe640 1 -- 172.21.15.87:0/3830703271 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f45f80b6ed0 con 0x7f460010a3a0 2024-09-13T17:24:51.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:51.120+0000 7f460843a640 1 -- 172.21.15.87:0/3830703271 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4600101330 con 0x7f460010a3a0 2024-09-13T17:24:51.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:51.120+0000 7f45f77fe640 1 -- 172.21.15.87:0/3830703271 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v104) v1 ==== 81+0+940 (secure 0 0 0) 0x7f45f802c020 con 0x7f460010a3a0 2024-09-13T17:24:51.122 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/718653925 2024-09-14T17:13:49.377087+0000 2024-09-13T17:24:51.122 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/3081317043 2024-09-14T17:13:49.377087+0000 2024-09-13T17:24:51.122 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/1633498542 2024-09-14T17:13:49.377087+0000 2024-09-13T17:24:51.122 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6801/1587363880 2024-09-14T17:04:24.083789+0000 2024-09-13T17:24:51.122 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/3403361612 2024-09-14T17:04:24.083789+0000 2024-09-13T17:24:51.122 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/553289143 2024-09-14T17:04:24.083789+0000 2024-09-13T17:24:51.123 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/1475107314 2024-09-14T17:04:24.083789+0000 2024-09-13T17:24:51.123 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/515676743 2024-09-14T17:04:47.990078+0000 2024-09-13T17:24:51.123 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/3270371628 2024-09-14T17:04:47.990078+0000 2024-09-13T17:24:51.123 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6800/1587363880 2024-09-14T17:04:24.083789+0000 2024-09-13T17:24:51.123 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6800/4144176457 2024-09-14T17:04:47.990078+0000 2024-09-13T17:24:51.123 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6801/4144176457 2024-09-14T17:04:47.990078+0000 2024-09-13T17:24:51.123 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/2612130442 2024-09-14T17:13:49.377087+0000 2024-09-13T17:24:51.123 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/586423689 2024-09-14T17:04:47.990078+0000 2024-09-13T17:24:51.123 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6800/701043027 2024-09-14T17:13:49.377087+0000 2024-09-13T17:24:51.123 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6801/701043027 2024-09-14T17:13:49.377087+0000 2024-09-13T17:24:51.124 INFO:teuthology.orchestra.run.smithi087.stderr:listed 16 entries 2024-09-13T17:24:51.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:51.122+0000 7f460843a640 1 -- 172.21.15.87:0/3830703271 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f45ec0a1200 msgr2=0x7f45ec0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:51.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:51.122+0000 7f460843a640 1 --2- 172.21.15.87:0/3830703271 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f45ec0a1200 0x7f45ec0a36c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f45fc005d00 tx=0x7f45fc00b410 comp rx=0 tx=0).stop 2024-09-13T17:24:51.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:51.122+0000 7f460843a640 1 -- 172.21.15.87:0/3830703271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f460010a3a0 msgr2=0x7f460019abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:51.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:51.122+0000 7f460843a640 1 --2- 172.21.15.87:0/3830703271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f460010a3a0 0x7f460019abe0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f45f802af40 tx=0x7f45f802fd80 comp rx=0 tx=0).stop 2024-09-13T17:24:51.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:51.122+0000 7f460843a640 1 -- 172.21.15.87:0/3830703271 shutdown_connections 2024-09-13T17:24:51.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:51.122+0000 7f460843a640 1 --2- 172.21.15.87:0/3830703271 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f45ec0a1200 0x7f45ec0a36c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:51.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:51.122+0000 7f460843a640 1 --2- 172.21.15.87:0/3830703271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f460010a3a0 0x7f460019abe0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:51.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:51.122+0000 7f460843a640 1 --2- 172.21.15.87:0/3830703271 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4600101870 0x7f46001967f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:51.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:51.122+0000 7f460843a640 1 --2- 172.21.15.87:0/3830703271 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4600100f50 0x7f46001962b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:51.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:51.122+0000 7f460843a640 1 -- 172.21.15.87:0/3830703271 >> 172.21.15.87:0/3830703271 conn(0x7f46000fa940 msgr2=0x7f46000fc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:51.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:51.122+0000 7f460843a640 1 -- 172.21.15.87:0/3830703271 shutdown_connections 2024-09-13T17:24:51.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:51.122+0000 7f460843a640 1 -- 172.21.15.87:0/3830703271 wait complete. 2024-09-13T17:24:51.133 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:50 smithi087 ceph-mon[30934]: pgmap v343: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:24:51.133 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:50 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/421875355' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:24:51.133 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:50 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2068803632' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:24:51.133 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:50 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/677736729' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:24:51.134 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi087.front.sepia.ceph.com... 2024-09-13T17:24:51.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:51.134 DEBUG:teuthology.orchestra.run.smithi087:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T17:24:51.161 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[84714]: fuse finished with error 0 and tester_r 0 2024-09-13T17:24:51.162 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:24:51.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:50 smithi149 ceph-mon[35496]: pgmap v343: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:24:51.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:50 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/421875355' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:24:51.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:50 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2068803632' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:24:51.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:50 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/677736729' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:24:51.365 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:50 smithi118 ceph-mon[34374]: pgmap v343: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:24:51.365 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:50 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/421875355' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T17:24:51.365 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:50 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2068803632' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T17:24:51.365 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:50 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/677736729' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-13T17:24:52.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:52 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3830703271' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T17:24:52.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:52 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3830703271' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T17:24:52.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:52 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3830703271' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T17:24:53.305 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:53 smithi118 ceph-mon[34374]: pgmap v344: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:24:53.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:53 smithi149 ceph-mon[35496]: pgmap v344: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:24:53.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:53 smithi087 ceph-mon[30934]: pgmap v344: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-13T17:24:55.281 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:55 smithi087 ceph-mon[30934]: pgmap v345: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:24:55.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:55 smithi149 ceph-mon[35496]: pgmap v345: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:24:55.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:55 smithi118 ceph-mon[34374]: pgmap v345: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-13T17:24:57.264 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T17:24:57.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:57.264 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T17:24:57.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:57.284 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-09-13T17:24:57.342 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T17:24:57.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:57.342 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:24:57.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:57 smithi149 ceph-mon[35496]: pgmap v346: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-13T17:24:57.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:57 smithi118 ceph-mon[34374]: pgmap v346: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-13T17:24:57.408 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:57 smithi087 ceph-mon[30934]: pgmap v346: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-13T17:24:57.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:24:57.412 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link delete ceph-brx 2024-09-13T17:24:57.503 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-13T17:24:57.515 INFO:tasks.cephadm:Teardown begin 2024-09-13T17:24:57.515 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T17:24:57.516 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:24:57.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.616+0000 7ff5a1f01640 1 -- 172.21.15.87:0/3327191519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff59c101810 msgr2=0x7ff59c109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:57.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.616+0000 7ff5a1f01640 1 --2- 172.21.15.87:0/3327191519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff59c101810 0x7ff59c109cf0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7ff590009ca0 tx=0x7ff59002a950 comp rx=0 tx=0).stop 2024-09-13T17:24:57.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.616+0000 7ff5a1f01640 1 -- 172.21.15.87:0/3327191519 shutdown_connections 2024-09-13T17:24:57.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.616+0000 7ff5a1f01640 1 --2- 172.21.15.87:0/3327191519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff59c10a310 0x7ff59c10c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:57.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.616+0000 7ff5a1f01640 1 --2- 172.21.15.87:0/3327191519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff59c101810 0x7ff59c109cf0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:57.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.616+0000 7ff5a1f01640 1 --2- 172.21.15.87:0/3327191519 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff59c100ef0 0x7ff59c1012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:57.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.616+0000 7ff5a1f01640 1 -- 172.21.15.87:0/3327191519 >> 172.21.15.87:0/3327191519 conn(0x7ff59c0fa900 msgr2=0x7ff59c0fcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:57.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.616+0000 7ff5a1f01640 1 -- 172.21.15.87:0/3327191519 shutdown_connections 2024-09-13T17:24:57.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.616+0000 7ff5a1f01640 1 -- 172.21.15.87:0/3327191519 wait complete. 2024-09-13T17:24:57.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.617+0000 7ff5a1f01640 1 Processor -- start 2024-09-13T17:24:57.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.617+0000 7ff5a1f01640 1 -- start start 2024-09-13T17:24:57.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.617+0000 7ff5a1f01640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff59c100ef0 0x7ff59c0feb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:57.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.617+0000 7ff5a1f01640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff59c101810 0x7ff59c0ff080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:57.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.617+0000 7ff5a1f01640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff59c10a310 0x7ff59c0ff5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:57.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.617+0000 7ff5a1f01640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c1a4670 con 0x7ff59c100ef0 2024-09-13T17:24:57.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.617+0000 7ff5a1f01640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c1a47e0 con 0x7ff59c10a310 2024-09-13T17:24:57.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.617+0000 7ff5a1f01640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c1a49a0 con 0x7ff59c101810 2024-09-13T17:24:57.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.617+0000 7ff59b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff59c100ef0 0x7ff59c0feb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:57.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.618+0000 7ff59b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff59c100ef0 0x7ff59c0feb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47320/0 (socket says 172.21.15.87:47320) 2024-09-13T17:24:57.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.618+0000 7ff59b7fe640 1 -- 172.21.15.87:0/3594317342 learned_addr learned my addr 172.21.15.87:0/3594317342 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:57.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.618+0000 7ff59affd640 1 --2- 172.21.15.87:0/3594317342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff59c101810 0x7ff59c0ff080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:57.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.618+0000 7ff59bfff640 1 --2- 172.21.15.87:0/3594317342 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff59c10a310 0x7ff59c0ff5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:57.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.618+0000 7ff59b7fe640 1 -- 172.21.15.87:0/3594317342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff59c101810 msgr2=0x7ff59c0ff080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:57.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.618+0000 7ff59b7fe640 1 --2- 172.21.15.87:0/3594317342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff59c101810 0x7ff59c0ff080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:57.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.618+0000 7ff59b7fe640 1 -- 172.21.15.87:0/3594317342 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff59c10a310 msgr2=0x7ff59c0ff5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:57.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.618+0000 7ff59b7fe640 1 --2- 172.21.15.87:0/3594317342 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff59c10a310 0x7ff59c0ff5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:57.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.618+0000 7ff59b7fe640 1 -- 172.21.15.87:0/3594317342 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff590009900 con 0x7ff59c100ef0 2024-09-13T17:24:57.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.618+0000 7ff59affd640 1 --2- 172.21.15.87:0/3594317342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff59c101810 0x7ff59c0ff080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:57.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.618+0000 7ff59bfff640 1 --2- 172.21.15.87:0/3594317342 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff59c10a310 0x7ff59c0ff5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:57.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.618+0000 7ff59b7fe640 1 --2- 172.21.15.87:0/3594317342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff59c100ef0 0x7ff59c0feb40 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7ff58c00b4a0 tx=0x7ff58c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:57.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.618+0000 7ff598ff9640 1 -- 172.21.15.87:0/3594317342 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c010610 con 0x7ff59c100ef0 2024-09-13T17:24:57.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.618+0000 7ff598ff9640 1 -- 172.21.15.87:0/3594317342 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff58c010c20 con 0x7ff59c100ef0 2024-09-13T17:24:57.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.618+0000 7ff5a1f01640 1 -- 172.21.15.87:0/3594317342 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff59c1a4c80 con 0x7ff59c100ef0 2024-09-13T17:24:57.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.618+0000 7ff598ff9640 1 -- 172.21.15.87:0/3594317342 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c017d50 con 0x7ff59c100ef0 2024-09-13T17:24:57.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.618+0000 7ff5a1f01640 1 -- 172.21.15.87:0/3594317342 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff59c1a5140 con 0x7ff59c100ef0 2024-09-13T17:24:57.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.619+0000 7ff5a1f01640 1 -- 172.21.15.87:0/3594317342 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff59c068ed0 con 0x7ff59c100ef0 2024-09-13T17:24:57.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.620+0000 7ff598ff9640 1 -- 172.21.15.87:0/3594317342 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7ff58c010770 con 0x7ff59c100ef0 2024-09-13T17:24:57.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.621+0000 7ff598ff9640 1 --2- 172.21.15.87:0/3594317342 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff5840a1200 0x7ff5840a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:57.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.621+0000 7ff59affd640 1 --2- 172.21.15.87:0/3594317342 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff5840a1200 0x7ff5840a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:57.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.621+0000 7ff598ff9640 1 -- 172.21.15.87:0/3594317342 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 9556+0+0 (secure 0 0 0) 0x7ff58c0cc7c0 con 0x7ff59c100ef0 2024-09-13T17:24:57.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.621+0000 7ff59affd640 1 --2- 172.21.15.87:0/3594317342 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff5840a1200 0x7ff5840a36c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff59c1002c0 tx=0x7ff590005c50 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:57.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.625+0000 7ff598ff9640 1 -- 172.21.15.87:0/3594317342 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff58c0958b0 con 0x7ff59c100ef0 2024-09-13T17:24:57.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.823+0000 7ff5a1f01640 1 -- 172.21.15.87:0/3594317342 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff59c1012d0 con 0x7ff59c100ef0 2024-09-13T17:24:57.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.823+0000 7ff598ff9640 1 -- 172.21.15.87:0/3594317342 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+10877 (secure 0 0 0) 0x7ff58c098ed0 con 0x7ff59c100ef0 2024-09-13T17:24:57.824 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:24:57.825 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/3674545180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":3674545180},{"type":"v1","addr":"172.21.15.87:6841","nonce":3674545180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:11:23.313609+0000","modified":"2024-09-13T17:19:40.570296+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24484,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6839/3052680456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3052680456},{"type":"v1","addr":"172.21.15.118:6839","nonce":3052680456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:24:57.825 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 36 2024-09-13T17:24:57.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.825+0000 7ff5a1f01640 1 -- 172.21.15.87:0/3594317342 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff5840a1200 msgr2=0x7ff5840a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:57.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.825+0000 7ff5a1f01640 1 --2- 172.21.15.87:0/3594317342 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff5840a1200 0x7ff5840a36c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff59c1002c0 tx=0x7ff590005c50 comp rx=0 tx=0).stop 2024-09-13T17:24:57.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.825+0000 7ff5a1f01640 1 -- 172.21.15.87:0/3594317342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff59c100ef0 msgr2=0x7ff59c0feb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:57.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.825+0000 7ff5a1f01640 1 --2- 172.21.15.87:0/3594317342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff59c100ef0 0x7ff59c0feb40 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7ff58c00b4a0 tx=0x7ff58c00b960 comp rx=0 tx=0).stop 2024-09-13T17:24:57.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.825+0000 7ff5a1f01640 1 -- 172.21.15.87:0/3594317342 shutdown_connections 2024-09-13T17:24:57.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.825+0000 7ff5a1f01640 1 --2- 172.21.15.87:0/3594317342 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff59c10a310 0x7ff59c0ff5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:57.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.825+0000 7ff5a1f01640 1 --2- 172.21.15.87:0/3594317342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff59c101810 0x7ff59c0ff080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:57.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.825+0000 7ff5a1f01640 1 --2- 172.21.15.87:0/3594317342 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7ff5840a1200 0x7ff5840a36c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:57.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.825+0000 7ff5a1f01640 1 --2- 172.21.15.87:0/3594317342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff59c100ef0 0x7ff59c0feb40 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:57.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.825+0000 7ff5a1f01640 1 -- 172.21.15.87:0/3594317342 >> 172.21.15.87:0/3594317342 conn(0x7ff59c0fa900 msgr2=0x7ff59c0fc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:57.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.825+0000 7ff5a1f01640 1 -- 172.21.15.87:0/3594317342 shutdown_connections 2024-09-13T17:24:57.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.825+0000 7ff5a1f01640 1 -- 172.21.15.87:0/3594317342 wait complete. 2024-09-13T17:24:57.838 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:24:57.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.935+0000 7f2d2f480640 1 -- 172.21.15.87:0/3046779574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d280feeb0 msgr2=0x7f2d280ff290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:57.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.935+0000 7f2d2f480640 1 --2- 172.21.15.87:0/3046779574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d280feeb0 0x7f2d280ff290 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f2d24009930 tx=0x7f2d2402a420 comp rx=0 tx=0).stop 2024-09-13T17:24:57.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.935+0000 7f2d2f480640 1 -- 172.21.15.87:0/3046779574 shutdown_connections 2024-09-13T17:24:57.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.935+0000 7f2d2f480640 1 --2- 172.21.15.87:0/3046779574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d28104000 0x7f2d2810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:57.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.935+0000 7f2d2f480640 1 --2- 172.21.15.87:0/3046779574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d280ff860 0x7f2d281038a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:57.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.935+0000 7f2d2f480640 1 --2- 172.21.15.87:0/3046779574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d280feeb0 0x7f2d280ff290 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:57.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.935+0000 7f2d2f480640 1 -- 172.21.15.87:0/3046779574 >> 172.21.15.87:0/3046779574 conn(0x7f2d280fa900 msgr2=0x7f2d280fcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:57.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.935+0000 7f2d2f480640 1 -- 172.21.15.87:0/3046779574 shutdown_connections 2024-09-13T17:24:57.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.935+0000 7f2d2f480640 1 -- 172.21.15.87:0/3046779574 wait complete. 2024-09-13T17:24:57.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.936+0000 7f2d2f480640 1 Processor -- start 2024-09-13T17:24:57.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.936+0000 7f2d2f480640 1 -- start start 2024-09-13T17:24:57.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.936+0000 7f2d2f480640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d280feeb0 0x7f2d28197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:57.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.936+0000 7f2d2f480640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d28104000 0x7f2d281976a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:57.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.936+0000 7f2d2f480640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d28197be0 0x7f2d281a21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:57.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.936+0000 7f2d2f480640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d281a2880 con 0x7f2d28104000 2024-09-13T17:24:57.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.936+0000 7f2d2f480640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d281a29f0 con 0x7f2d280feeb0 2024-09-13T17:24:57.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.936+0000 7f2d2f480640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d281a2bb0 con 0x7f2d28197be0 2024-09-13T17:24:57.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.936+0000 7f2d2ca1b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d28104000 0x7f2d281976a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:57.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.936+0000 7f2d2ca1b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d28104000 0x7f2d281976a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47330/0 (socket says 172.21.15.87:47330) 2024-09-13T17:24:57.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.936+0000 7f2d2ca1b640 1 -- 172.21.15.87:0/1341476144 learned_addr learned my addr 172.21.15.87:0/1341476144 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:57.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.936+0000 7f2d2d21c640 1 --2- 172.21.15.87:0/1341476144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d280feeb0 0x7f2d28197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:57.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.936+0000 7f2d2da1d640 1 --2- 172.21.15.87:0/1341476144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d28197be0 0x7f2d281a21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:57.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.936+0000 7f2d2ca1b640 1 -- 172.21.15.87:0/1341476144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d28197be0 msgr2=0x7f2d281a21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:57.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.936+0000 7f2d2ca1b640 1 --2- 172.21.15.87:0/1341476144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d28197be0 0x7f2d281a21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:57.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.936+0000 7f2d2ca1b640 1 -- 172.21.15.87:0/1341476144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d280feeb0 msgr2=0x7f2d28197160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:57.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.936+0000 7f2d2ca1b640 1 --2- 172.21.15.87:0/1341476144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d280feeb0 0x7f2d28197160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:57.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.936+0000 7f2d2ca1b640 1 -- 172.21.15.87:0/1341476144 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d24009560 con 0x7f2d28104000 2024-09-13T17:24:57.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.936+0000 7f2d2d21c640 1 --2- 172.21.15.87:0/1341476144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d280feeb0 0x7f2d28197160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:24:57.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.937+0000 7f2d2ca1b640 1 --2- 172.21.15.87:0/1341476144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d28104000 0x7f2d281976a0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f2d1800c970 tx=0x7f2d1800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:57.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.937+0000 7f2d1e7fc640 1 -- 172.21.15.87:0/1341476144 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d18007bb0 con 0x7f2d28104000 2024-09-13T17:24:57.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.937+0000 7f2d1e7fc640 1 -- 172.21.15.87:0/1341476144 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2d18007d10 con 0x7f2d28104000 2024-09-13T17:24:57.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.937+0000 7f2d1e7fc640 1 -- 172.21.15.87:0/1341476144 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1800f450 con 0x7f2d28104000 2024-09-13T17:24:57.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.937+0000 7f2d2f480640 1 -- 172.21.15.87:0/1341476144 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d281a2e90 con 0x7f2d28104000 2024-09-13T17:24:57.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.937+0000 7f2d2f480640 1 -- 172.21.15.87:0/1341476144 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d281a3260 con 0x7f2d28104000 2024-09-13T17:24:57.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.938+0000 7f2d2f480640 1 -- 172.21.15.87:0/1341476144 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d28100380 con 0x7f2d28104000 2024-09-13T17:24:57.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.939+0000 7f2d1e7fc640 1 -- 172.21.15.87:0/1341476144 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f2d18004eb0 con 0x7f2d28104000 2024-09-13T17:24:57.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.940+0000 7f2d1e7fc640 1 --2- 172.21.15.87:0/1341476144 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f2d140a1200 0x7f2d140a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:57.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.940+0000 7f2d2d21c640 1 --2- 172.21.15.87:0/1341476144 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f2d140a1200 0x7f2d140a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:57.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.940+0000 7f2d1e7fc640 1 -- 172.21.15.87:0/1341476144 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f2d180cd210 con 0x7f2d28104000 2024-09-13T17:24:57.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.940+0000 7f2d2d21c640 1 --2- 172.21.15.87:0/1341476144 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f2d140a1200 0x7f2d140a36c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2d24006010 tx=0x7f2d24000bc0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:57.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:57.943+0000 7f2d1e7fc640 1 -- 172.21.15.87:0/1341476144 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2d18096250 con 0x7f2d28104000 2024-09-13T17:24:58.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.142+0000 7f2d2f480640 1 -- 172.21.15.87:0/1341476144 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d280ff290 con 0x7f2d28104000 2024-09-13T17:24:58.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.142+0000 7f2d1e7fc640 1 -- 172.21.15.87:0/1341476144 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+10877 (secure 0 0 0) 0x7f2d1801d020 con 0x7f2d28104000 2024-09-13T17:24:58.144 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:24:58.144 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3554185199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3554185199},{"type":"v1","addr":"172.21.15.87:6835","nonce":3554185199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/321170197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":321170197},{"type":"v1","addr":"172.21.15.87:6837","nonce":321170197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6839/1687006028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6838","nonce":1687006028},{"type":"v1","addr":"172.21.15.87:6839","nonce":1687006028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6841/3674545180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6840","nonce":3674545180},{"type":"v1","addr":"172.21.15.87:6841","nonce":3674545180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/1988216966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1988216966},{"type":"v1","addr":"172.21.15.118:6833","nonce":1988216966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/4187230685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":4187230685},{"type":"v1","addr":"172.21.15.118:6835","nonce":4187230685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T17:11:23.313609+0000","modified":"2024-09-13T17:19:40.570296+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24499,"mds_1":24484,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24427":{"gid":24427,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6833/3204144514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":3204144514},{"type":"v1","addr":"172.21.15.149:6833","nonce":3204144514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6837/923553321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":923553321},{"type":"v1","addr":"172.21.15.118:6837","nonce":923553321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6839/3052680456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3052680456},{"type":"v1","addr":"172.21.15.118:6839","nonce":3052680456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"f","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.149:6835/3814444081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3814444081},{"type":"v1","addr":"172.21.15.149:6835","nonce":3814444081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24484":{"gid":24484,"name":"c","rank":1,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.149:6837/3893430053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":3893430053},{"type":"v1","addr":"172.21.15.149:6837","nonce":3893430053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.149:6839/2938961956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":2938961956},{"type":"v1","addr":"172.21.15.149:6839","nonce":2938961956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:24:58.144 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 36 2024-09-13T17:24:58.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.144+0000 7f2d2f480640 1 -- 172.21.15.87:0/1341476144 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f2d140a1200 msgr2=0x7f2d140a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:58.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.144+0000 7f2d2f480640 1 --2- 172.21.15.87:0/1341476144 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f2d140a1200 0x7f2d140a36c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2d24006010 tx=0x7f2d24000bc0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.144+0000 7f2d2f480640 1 -- 172.21.15.87:0/1341476144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d28104000 msgr2=0x7f2d281976a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:58.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.144+0000 7f2d2f480640 1 --2- 172.21.15.87:0/1341476144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d28104000 0x7f2d281976a0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f2d1800c970 tx=0x7f2d1800ce30 comp rx=0 tx=0).stop 2024-09-13T17:24:58.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.144+0000 7f2d2f480640 1 -- 172.21.15.87:0/1341476144 shutdown_connections 2024-09-13T17:24:58.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.144+0000 7f2d2f480640 1 --2- 172.21.15.87:0/1341476144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d28197be0 0x7f2d281a21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.144+0000 7f2d2f480640 1 --2- 172.21.15.87:0/1341476144 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f2d140a1200 0x7f2d140a36c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.144+0000 7f2d2f480640 1 --2- 172.21.15.87:0/1341476144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d28104000 0x7f2d281976a0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.144+0000 7f2d2f480640 1 --2- 172.21.15.87:0/1341476144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d280feeb0 0x7f2d28197160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.144+0000 7f2d2f480640 1 -- 172.21.15.87:0/1341476144 >> 172.21.15.87:0/1341476144 conn(0x7f2d280fa900 msgr2=0x7f2d280fbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:58.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.144+0000 7f2d2f480640 1 -- 172.21.15.87:0/1341476144 shutdown_connections 2024-09-13T17:24:58.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.144+0000 7f2d2f480640 1 -- 172.21.15.87:0/1341476144 wait complete. 2024-09-13T17:24:58.157 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:24:58.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.255+0000 7f7dff4e5640 1 -- 172.21.15.87:0/3865721868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7df8104000 msgr2=0x7f7df810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:58.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.255+0000 7f7dff4e5640 1 --2- 172.21.15.87:0/3865721868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7df8104000 0x7f7df810bb50 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f7df0009cd0 tx=0x7f7df002a8e0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.255+0000 7f7dff4e5640 1 -- 172.21.15.87:0/3865721868 shutdown_connections 2024-09-13T17:24:58.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.255+0000 7f7dff4e5640 1 --2- 172.21.15.87:0/3865721868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7df8104000 0x7f7df810bb50 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.255+0000 7f7dff4e5640 1 --2- 172.21.15.87:0/3865721868 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7df80ff860 0x7f7df81038a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.255+0000 7f7dff4e5640 1 --2- 172.21.15.87:0/3865721868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7df80feeb0 0x7f7df80ff290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.255+0000 7f7dff4e5640 1 -- 172.21.15.87:0/3865721868 >> 172.21.15.87:0/3865721868 conn(0x7f7df80fa900 msgr2=0x7f7df80fcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:58.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.255+0000 7f7dff4e5640 1 -- 172.21.15.87:0/3865721868 shutdown_connections 2024-09-13T17:24:58.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.255+0000 7f7dff4e5640 1 -- 172.21.15.87:0/3865721868 wait complete. 2024-09-13T17:24:58.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.255+0000 7f7dff4e5640 1 Processor -- start 2024-09-13T17:24:58.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.255+0000 7f7dff4e5640 1 -- start start 2024-09-13T17:24:58.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.255+0000 7f7dff4e5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7df80feeb0 0x7f7df81970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:58.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.255+0000 7f7dff4e5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7df8104000 0x7f7df8197600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:58.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.255+0000 7f7dff4e5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7df8197b40 0x7f7df81a2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:58.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.255+0000 7f7dff4e5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df81a27e0 con 0x7f7df8104000 2024-09-13T17:24:58.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.255+0000 7f7dff4e5640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df81a2950 con 0x7f7df8197b40 2024-09-13T17:24:58.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.255+0000 7f7dff4e5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df81a2b10 con 0x7f7df80feeb0 2024-09-13T17:24:58.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.256+0000 7f7dfca80640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7df8104000 0x7f7df8197600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:58.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.256+0000 7f7dfca80640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7df8104000 0x7f7df8197600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47350/0 (socket says 172.21.15.87:47350) 2024-09-13T17:24:58.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.256+0000 7f7dfca80640 1 -- 172.21.15.87:0/3197172851 learned_addr learned my addr 172.21.15.87:0/3197172851 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:58.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.256+0000 7f7dfda82640 1 --2- 172.21.15.87:0/3197172851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7df8197b40 0x7f7df81a2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:58.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.256+0000 7f7dfd281640 1 --2- 172.21.15.87:0/3197172851 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7df80feeb0 0x7f7df81970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:58.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.256+0000 7f7dfca80640 1 -- 172.21.15.87:0/3197172851 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7df80feeb0 msgr2=0x7f7df81970c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:58.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.256+0000 7f7dfca80640 1 --2- 172.21.15.87:0/3197172851 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7df80feeb0 0x7f7df81970c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.256+0000 7f7dfca80640 1 -- 172.21.15.87:0/3197172851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7df8197b40 msgr2=0x7f7df81a2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:58.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.256+0000 7f7dfca80640 1 --2- 172.21.15.87:0/3197172851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7df8197b40 0x7f7df81a2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.256+0000 7f7dfca80640 1 -- 172.21.15.87:0/3197172851 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df0009900 con 0x7f7df8104000 2024-09-13T17:24:58.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.256+0000 7f7dfca80640 1 --2- 172.21.15.87:0/3197172851 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7df8104000 0x7f7df8197600 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f7de800c970 tx=0x7f7de800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:58.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.256+0000 7f7dee7fc640 1 -- 172.21.15.87:0/3197172851 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de8004440 con 0x7f7df8104000 2024-09-13T17:24:58.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.256+0000 7f7dee7fc640 1 -- 172.21.15.87:0/3197172851 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7de8007d10 con 0x7f7df8104000 2024-09-13T17:24:58.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.256+0000 7f7dff4e5640 1 -- 172.21.15.87:0/3197172851 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7df81a2df0 con 0x7f7df8104000 2024-09-13T17:24:58.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.256+0000 7f7dee7fc640 1 -- 172.21.15.87:0/3197172851 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de800f450 con 0x7f7df8104000 2024-09-13T17:24:58.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.256+0000 7f7dff4e5640 1 -- 172.21.15.87:0/3197172851 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df81a32d0 con 0x7f7df8104000 2024-09-13T17:24:58.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.257+0000 7f7dff4e5640 1 -- 172.21.15.87:0/3197172851 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7df8100380 con 0x7f7df8104000 2024-09-13T17:24:58.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.258+0000 7f7dee7fc640 1 -- 172.21.15.87:0/3197172851 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f7de80036f0 con 0x7f7df8104000 2024-09-13T17:24:58.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.259+0000 7f7dee7fc640 1 --2- 172.21.15.87:0/3197172851 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7de40a1280 0x7f7de40a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:58.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.259+0000 7f7dfd281640 1 --2- 172.21.15.87:0/3197172851 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7de40a1280 0x7f7de40a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:58.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.259+0000 7f7dee7fc640 1 -- 172.21.15.87:0/3197172851 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f7de80cd5d0 con 0x7f7df8104000 2024-09-13T17:24:58.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.259+0000 7f7dfd281640 1 --2- 172.21.15.87:0/3197172851 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7de40a1280 0x7f7de40a3740 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7df4009890 tx=0x7f7df4008040 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:58.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.262+0000 7f7dee7fc640 1 -- 172.21.15.87:0/3197172851 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7de8096690 con 0x7f7df8104000 2024-09-13T17:24:58.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:58 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3594317342' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:24:58.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:58 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3594317342' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:24:58.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.425+0000 7f7dff4e5640 1 -- 172.21.15.87:0/3197172851 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7df80ff290 con 0x7f7df8104000 2024-09-13T17:24:58.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.426+0000 7f7dee7fc640 1 -- 172.21.15.87:0/3197172851 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) v1 ==== 74+0+25378 (secure 0 0 0) 0x7f7de8014090 con 0x7f7df8104000 2024-09-13T17:24:58.428 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T17:24:58.428 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":104,"fsid":"043d5bae-71f2-11ef-bceb-c7b262605968","created":"2024-09-13T17:03:57.852010+0000","modified":"2024-09-13T17:24:17.935790+0000","last_up_change":"2024-09-13T17:10:34.423548+0000","last_in_change":"2024-09-13T17:10:14.228123+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:07:02.286400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:11:21.965141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:11:22.504345+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":103,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:11:25.565163+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":103,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58250283-85c0-416e-abdd-1fc5a7ff0c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6803","nonce":1316956138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6805","nonce":1316956138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6809","nonce":1316956138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1316956138},{"type":"v1","addr":"172.21.15.87:6807","nonce":1316956138}]},"public_addr":"172.21.15.87:6803/1316956138","cluster_addr":"172.21.15.87:6805/1316956138","heartbeat_back_addr":"172.21.15.87:6809/1316956138","heartbeat_front_addr":"172.21.15.87:6807/1316956138","state":["exists","up"]},{"osd":1,"uuid":"b9d49969-94b1-4262-b4ff-db0a8e3331af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6801","nonce":3352566727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6803","nonce":3352566727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6807","nonce":3352566727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":3352566727},{"type":"v1","addr":"172.21.15.118:6805","nonce":3352566727}]},"public_addr":"172.21.15.118:6801/3352566727","cluster_addr":"172.21.15.118:6803/3352566727","heartbeat_back_addr":"172.21.15.118:6807/3352566727","heartbeat_front_addr":"172.21.15.118:6805/3352566727","state":["exists","up"]},{"osd":2,"uuid":"ba64549e-d736-426f-b466-f569af5f16d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6801","nonce":2774581686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6803","nonce":2774581686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6807","nonce":2774581686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2774581686},{"type":"v1","addr":"172.21.15.149:6805","nonce":2774581686}]},"public_addr":"172.21.15.149:6801/2774581686","cluster_addr":"172.21.15.149:6803/2774581686","heartbeat_back_addr":"172.21.15.149:6807/2774581686","heartbeat_front_addr":"172.21.15.149:6805/2774581686","state":["exists","up"]},{"osd":3,"uuid":"3d5553e5-371b-49fd-976b-9e72a97a2f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6811","nonce":3306119066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6813","nonce":3306119066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6817","nonce":3306119066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3306119066},{"type":"v1","addr":"172.21.15.87:6815","nonce":3306119066}]},"public_addr":"172.21.15.87:6811/3306119066","cluster_addr":"172.21.15.87:6813/3306119066","heartbeat_back_addr":"172.21.15.87:6817/3306119066","heartbeat_front_addr":"172.21.15.87:6815/3306119066","state":["exists","up"]},{"osd":4,"uuid":"2fbe0e27-34ec-42a6-9962-f1d8202b3159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6809","nonce":3342349890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6811","nonce":3342349890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6815","nonce":3342349890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3342349890},{"type":"v1","addr":"172.21.15.118:6813","nonce":3342349890}]},"public_addr":"172.21.15.118:6809/3342349890","cluster_addr":"172.21.15.118:6811/3342349890","heartbeat_back_addr":"172.21.15.118:6815/3342349890","heartbeat_front_addr":"172.21.15.118:6813/3342349890","state":["exists","up"]},{"osd":5,"uuid":"53c14519-6170-4b5a-a79d-4835882d7bec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6809","nonce":3468867124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6811","nonce":3468867124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6815","nonce":3468867124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":3468867124},{"type":"v1","addr":"172.21.15.149:6813","nonce":3468867124}]},"public_addr":"172.21.15.149:6809/3468867124","cluster_addr":"172.21.15.149:6811/3468867124","heartbeat_back_addr":"172.21.15.149:6815/3468867124","heartbeat_front_addr":"172.21.15.149:6813/3468867124","state":["exists","up"]},{"osd":6,"uuid":"d3951b32-db77-4b8b-9de0-f05e03d13f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6819","nonce":326563617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6821","nonce":326563617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6825","nonce":326563617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":326563617},{"type":"v1","addr":"172.21.15.87:6823","nonce":326563617}]},"public_addr":"172.21.15.87:6819/326563617","cluster_addr":"172.21.15.87:6821/326563617","heartbeat_back_addr":"172.21.15.87:6825/326563617","heartbeat_front_addr":"172.21.15.87:6823/326563617","state":["exists","up"]},{"osd":7,"uuid":"4d46dab7-a8bf-4e3e-b5c0-43860d336bdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6817","nonce":1690268990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6819","nonce":1690268990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6823","nonce":1690268990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1690268990},{"type":"v1","addr":"172.21.15.118:6821","nonce":1690268990}]},"public_addr":"172.21.15.118:6817/1690268990","cluster_addr":"172.21.15.118:6819/1690268990","heartbeat_back_addr":"172.21.15.118:6823/1690268990","heartbeat_front_addr":"172.21.15.118:6821/1690268990","state":["exists","up"]},{"osd":8,"uuid":"5a015a7d-60a3-4412-96af-1b61d2ad51f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6817","nonce":1558675380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6819","nonce":1558675380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6823","nonce":1558675380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":1558675380},{"type":"v1","addr":"172.21.15.149:6821","nonce":1558675380}]},"public_addr":"172.21.15.149:6817/1558675380","cluster_addr":"172.21.15.149:6819/1558675380","heartbeat_back_addr":"172.21.15.149:6823/1558675380","heartbeat_front_addr":"172.21.15.149:6821/1558675380","state":["exists","up"]},{"osd":9,"uuid":"248c0b6e-4c4e-4c63-a0dd-e4cdf3b997a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6827","nonce":1453934262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6829","nonce":1453934262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6833","nonce":1453934262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1453934262},{"type":"v1","addr":"172.21.15.87:6831","nonce":1453934262}]},"public_addr":"172.21.15.87:6827/1453934262","cluster_addr":"172.21.15.87:6829/1453934262","heartbeat_back_addr":"172.21.15.87:6833/1453934262","heartbeat_front_addr":"172.21.15.87:6831/1453934262","state":["exists","up"]},{"osd":10,"uuid":"24238714-e737-4371-b5d5-0cd3395f09bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6825","nonce":1034318850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6827","nonce":1034318850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6831","nonce":1034318850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1034318850},{"type":"v1","addr":"172.21.15.118:6829","nonce":1034318850}]},"public_addr":"172.21.15.118:6825/1034318850","cluster_addr":"172.21.15.118:6827/1034318850","heartbeat_back_addr":"172.21.15.118:6831/1034318850","heartbeat_front_addr":"172.21.15.118:6829/1034318850","state":["exists","up"]},{"osd":11,"uuid":"409dd3bf-5154-4dea-8708-7de7f9e2e793","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6825","nonce":271000465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6827","nonce":271000465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6831","nonce":271000465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":271000465},{"type":"v1","addr":"172.21.15.149:6829","nonce":271000465}]},"public_addr":"172.21.15.149:6825/271000465","cluster_addr":"172.21.15.149:6827/271000465","heartbeat_back_addr":"172.21.15.149:6831/271000465","heartbeat_front_addr":"172.21.15.149:6829/271000465","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:16.382664+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:06:37.914250+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:00.425876+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:23.960183+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:07:47.004088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:10.214345+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:33.719221+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:08:57.099599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:20.971881+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:09:44.827167+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:08.135516+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:10:32.085853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.d","mappings":[{"from":1,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8},{"from":5,"to":7}]},{"pgid":"3.28","mappings":[{"from":3,"to":6},{"from":5,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/718653925":"2024-09-14T17:13:49.377087+0000","172.21.15.87:0/3081317043":"2024-09-14T17:13:49.377087+0000","172.21.15.87:0/1633498542":"2024-09-14T17:13:49.377087+0000","172.21.15.87:6801/1587363880":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/3403361612":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/553289143":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/1475107314":"2024-09-14T17:04:24.083789+0000","172.21.15.87:0/515676743":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/3270371628":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6800/1587363880":"2024-09-14T17:04:24.083789+0000","172.21.15.87:6800/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6801/4144176457":"2024-09-14T17:04:47.990078+0000","172.21.15.87:0/2612130442":"2024-09-14T17:13:49.377087+0000","172.21.15.87:0/586423689":"2024-09-14T17:04:47.990078+0000","172.21.15.87:6800/701043027":"2024-09-14T17:13:49.377087+0000","172.21.15.87:6801/701043027":"2024-09-14T17:13:49.377087+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]},{"pool":4,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:24:58.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.428+0000 7f7dff4e5640 1 -- 172.21.15.87:0/3197172851 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7de40a1280 msgr2=0x7f7de40a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:58.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.428+0000 7f7dff4e5640 1 --2- 172.21.15.87:0/3197172851 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7de40a1280 0x7f7de40a3740 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7df4009890 tx=0x7f7df4008040 comp rx=0 tx=0).stop 2024-09-13T17:24:58.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.428+0000 7f7dff4e5640 1 -- 172.21.15.87:0/3197172851 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7df8104000 msgr2=0x7f7df8197600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:58.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.428+0000 7f7dff4e5640 1 --2- 172.21.15.87:0/3197172851 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7df8104000 0x7f7df8197600 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f7de800c970 tx=0x7f7de800ce30 comp rx=0 tx=0).stop 2024-09-13T17:24:58.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.428+0000 7f7dff4e5640 1 -- 172.21.15.87:0/3197172851 shutdown_connections 2024-09-13T17:24:58.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.428+0000 7f7dff4e5640 1 --2- 172.21.15.87:0/3197172851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7df8197b40 0x7f7df81a2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.428+0000 7f7dff4e5640 1 --2- 172.21.15.87:0/3197172851 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7de40a1280 0x7f7de40a3740 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.428+0000 7f7dff4e5640 1 --2- 172.21.15.87:0/3197172851 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7df8104000 0x7f7df8197600 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.428+0000 7f7dff4e5640 1 --2- 172.21.15.87:0/3197172851 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7df80feeb0 0x7f7df81970c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.428+0000 7f7dff4e5640 1 -- 172.21.15.87:0/3197172851 >> 172.21.15.87:0/3197172851 conn(0x7f7df80fa900 msgr2=0x7f7df80fbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:58.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.428+0000 7f7dff4e5640 1 -- 172.21.15.87:0/3197172851 shutdown_connections 2024-09-13T17:24:58.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.428+0000 7f7dff4e5640 1 -- 172.21.15.87:0/3197172851 wait complete. 2024-09-13T17:24:58.439 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:58 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3594317342' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:24:58.441 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T17:24:58.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.539+0000 7f4cb6c96640 1 -- 172.21.15.87:0/4232701455 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cb0101750 msgr2=0x7f4cb0109c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:58.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.539+0000 7f4cb6c96640 1 --2- 172.21.15.87:0/4232701455 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cb0101750 0x7f4cb0109c30 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0009900 tx=0x7f4ca002a480 comp rx=0 tx=0).stop 2024-09-13T17:24:58.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.539+0000 7f4cb6c96640 1 -- 172.21.15.87:0/4232701455 shutdown_connections 2024-09-13T17:24:58.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.539+0000 7f4cb6c96640 1 --2- 172.21.15.87:0/4232701455 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4cb010a200 0x7f4cb010c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.539+0000 7f4cb6c96640 1 --2- 172.21.15.87:0/4232701455 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cb0101750 0x7f4cb0109c30 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.539+0000 7f4cb6c96640 1 --2- 172.21.15.87:0/4232701455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cb0100e30 0x7f4cb0101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.539+0000 7f4cb6c96640 1 -- 172.21.15.87:0/4232701455 >> 172.21.15.87:0/4232701455 conn(0x7f4cb0075b50 msgr2=0x7f4cb00fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:58.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.539+0000 7f4cb6c96640 1 -- 172.21.15.87:0/4232701455 shutdown_connections 2024-09-13T17:24:58.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.539+0000 7f4cb6c96640 1 -- 172.21.15.87:0/4232701455 wait complete. 2024-09-13T17:24:58.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.539+0000 7f4cb6c96640 1 Processor -- start 2024-09-13T17:24:58.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.539+0000 7f4cb6c96640 1 -- start start 2024-09-13T17:24:58.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.539+0000 7f4cb6c96640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cb0100e30 0x7f4cb0196130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:58.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.539+0000 7f4cb6c96640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cb0101750 0x7f4cb0196670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:58.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.539+0000 7f4cb6c96640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4cb010a200 0x7f4cb019aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:58.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.539+0000 7f4cb6c96640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb019b010 con 0x7f4cb0101750 2024-09-13T17:24:58.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.539+0000 7f4cb6c96640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb019b180 con 0x7f4cb010a200 2024-09-13T17:24:58.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.539+0000 7f4cb6c96640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb019b340 con 0x7f4cb0100e30 2024-09-13T17:24:58.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.540+0000 7f4ca7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cb0101750 0x7f4cb0196670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:58.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.540+0000 7f4ca7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cb0101750 0x7f4cb0196670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47378/0 (socket says 172.21.15.87:47378) 2024-09-13T17:24:58.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.540+0000 7f4ca7fff640 1 -- 172.21.15.87:0/3373644807 learned_addr learned my addr 172.21.15.87:0/3373644807 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:58.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.540+0000 7f4cb4a32640 1 --2- 172.21.15.87:0/3373644807 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cb0100e30 0x7f4cb0196130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:58.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.540+0000 7f4cb5233640 1 --2- 172.21.15.87:0/3373644807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4cb010a200 0x7f4cb019aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:58.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.540+0000 7f4ca7fff640 1 -- 172.21.15.87:0/3373644807 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cb0100e30 msgr2=0x7f4cb0196130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:58.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.540+0000 7f4ca7fff640 1 --2- 172.21.15.87:0/3373644807 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cb0100e30 0x7f4cb0196130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.540+0000 7f4ca7fff640 1 -- 172.21.15.87:0/3373644807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4cb010a200 msgr2=0x7f4cb019aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:58.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.540+0000 7f4ca7fff640 1 --2- 172.21.15.87:0/3373644807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4cb010a200 0x7f4cb019aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.540+0000 7f4ca7fff640 1 -- 172.21.15.87:0/3373644807 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca0009560 con 0x7f4cb0101750 2024-09-13T17:24:58.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.540+0000 7f4cb5233640 1 --2- 172.21.15.87:0/3373644807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4cb010a200 0x7f4cb019aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:58.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.540+0000 7f4ca7fff640 1 --2- 172.21.15.87:0/3373644807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cb0101750 0x7f4cb0196670 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f4ca002aa70 tx=0x7f4ca00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:58.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.540+0000 7f4ca5ffb640 1 -- 172.21.15.87:0/3373644807 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca0003a00 con 0x7f4cb0101750 2024-09-13T17:24:58.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.540+0000 7f4cb6c96640 1 -- 172.21.15.87:0/3373644807 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cb019b5c0 con 0x7f4cb0101750 2024-09-13T17:24:58.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.540+0000 7f4ca5ffb640 1 -- 172.21.15.87:0/3373644807 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4ca00044e0 con 0x7f4cb0101750 2024-09-13T17:24:58.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.540+0000 7f4ca5ffb640 1 -- 172.21.15.87:0/3373644807 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca003bd70 con 0x7f4cb0101750 2024-09-13T17:24:58.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.540+0000 7f4cb6c96640 1 -- 172.21.15.87:0/3373644807 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cb019b890 con 0x7f4cb0101750 2024-09-13T17:24:58.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.541+0000 7f4cb6c96640 1 -- 172.21.15.87:0/3373644807 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cb0067e40 con 0x7f4cb0101750 2024-09-13T17:24:58.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.543+0000 7f4ca5ffb640 1 -- 172.21.15.87:0/3373644807 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f4ca0003c60 con 0x7f4cb0101750 2024-09-13T17:24:58.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.543+0000 7f4ca5ffb640 1 --2- 172.21.15.87:0/3373644807 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4c980a1200 0x7f4c980a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:58.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.543+0000 7f4ca5ffb640 1 -- 172.21.15.87:0/3373644807 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 9556+0+0 (secure 0 0 0) 0x7f4ca00ee300 con 0x7f4cb0101750 2024-09-13T17:24:58.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.543+0000 7f4cb4a32640 1 --2- 172.21.15.87:0/3373644807 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4c980a1200 0x7f4c980a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:58.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.544+0000 7f4cb4a32640 1 --2- 172.21.15.87:0/3373644807 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4c980a1200 0x7f4c980a36c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4cac00abe0 tx=0x7f4cac00a2d0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:58.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.547+0000 7f4ca5ffb640 1 -- 172.21.15.87:0/3373644807 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4ca00b7340 con 0x7f4cb0101750 2024-09-13T17:24:58.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.744+0000 7f4cb6c96640 1 -- 172.21.15.87:0/3373644807 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4cb0101210 con 0x7f4cb0101750 2024-09-13T17:24:58.754 INFO:teuthology.orchestra.run.smithi087.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T17:24:58.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.753+0000 7f4ca5ffb640 1 -- 172.21.15.87:0/3373644807 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v37) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4ca004b090 con 0x7f4cb0101750 2024-09-13T17:24:58.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.755+0000 7f4cb6c96640 1 -- 172.21.15.87:0/3373644807 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4c980a1200 msgr2=0x7f4c980a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:58.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.755+0000 7f4cb6c96640 1 --2- 172.21.15.87:0/3373644807 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4c980a1200 0x7f4c980a36c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4cac00abe0 tx=0x7f4cac00a2d0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.755+0000 7f4cb6c96640 1 -- 172.21.15.87:0/3373644807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cb0101750 msgr2=0x7f4cb0196670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:58.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.755+0000 7f4cb6c96640 1 --2- 172.21.15.87:0/3373644807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cb0101750 0x7f4cb0196670 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f4ca002aa70 tx=0x7f4ca00042f0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.755+0000 7f4cb6c96640 1 -- 172.21.15.87:0/3373644807 shutdown_connections 2024-09-13T17:24:58.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.755+0000 7f4cb6c96640 1 --2- 172.21.15.87:0/3373644807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4cb010a200 0x7f4cb019aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.755+0000 7f4cb6c96640 1 --2- 172.21.15.87:0/3373644807 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f4c980a1200 0x7f4c980a36c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.755+0000 7f4cb6c96640 1 --2- 172.21.15.87:0/3373644807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cb0101750 0x7f4cb0196670 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.755+0000 7f4cb6c96640 1 --2- 172.21.15.87:0/3373644807 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cb0100e30 0x7f4cb0196130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.755+0000 7f4cb6c96640 1 -- 172.21.15.87:0/3373644807 >> 172.21.15.87:0/3373644807 conn(0x7f4cb0075b50 msgr2=0x7f4cb00fb1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:58.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.755+0000 7f4cb6c96640 1 -- 172.21.15.87:0/3373644807 shutdown_connections 2024-09-13T17:24:58.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.755+0000 7f4cb6c96640 1 -- 172.21.15.87:0/3373644807 wait complete. 2024-09-13T17:24:58.767 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T17:24:58.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.868+0000 7f0f089ce640 1 -- 172.21.15.87:0/1434062018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f04101800 msgr2=0x7f0f04109ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:58.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.868+0000 7f0f089ce640 1 --2- 172.21.15.87:0/1434062018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f04101800 0x7f0f04109ce0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8009900 tx=0x7f0ef802a410 comp rx=0 tx=0).stop 2024-09-13T17:24:58.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.869+0000 7f0f089ce640 1 -- 172.21.15.87:0/1434062018 shutdown_connections 2024-09-13T17:24:58.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.869+0000 7f0f089ce640 1 --2- 172.21.15.87:0/1434062018 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f0410a350 0x7f0f0410c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.869+0000 7f0f089ce640 1 --2- 172.21.15.87:0/1434062018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f04101800 0x7f0f04109ce0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.869+0000 7f0f089ce640 1 --2- 172.21.15.87:0/1434062018 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f04100e50 0x7f0f04101230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.869+0000 7f0f089ce640 1 -- 172.21.15.87:0/1434062018 >> 172.21.15.87:0/1434062018 conn(0x7f0f040fa930 msgr2=0x7f0f040fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:58.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.869+0000 7f0f089ce640 1 -- 172.21.15.87:0/1434062018 shutdown_connections 2024-09-13T17:24:58.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.869+0000 7f0f089ce640 1 -- 172.21.15.87:0/1434062018 wait complete. 2024-09-13T17:24:58.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.869+0000 7f0f089ce640 1 Processor -- start 2024-09-13T17:24:58.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.869+0000 7f0f089ce640 1 -- start start 2024-09-13T17:24:58.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.869+0000 7f0f089ce640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f04100e50 0x7f0f041962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:58.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.869+0000 7f0f089ce640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f04101800 0x7f0f04196810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:58.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.870+0000 7f0f089ce640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f0410a350 0x7f0f0419abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:58.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.870+0000 7f0f089ce640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0419b1b0 con 0x7f0f0410a350 2024-09-13T17:24:58.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.870+0000 7f0f089ce640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0419b320 con 0x7f0f04101800 2024-09-13T17:24:58.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.870+0000 7f0f089ce640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0419b4e0 con 0x7f0f04100e50 2024-09-13T17:24:58.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.870+0000 7f0f02d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f0410a350 0x7f0f0419abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:58.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.870+0000 7f0f0259c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f04100e50 0x7f0f041962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:58.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.870+0000 7f0f0259c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f04100e50 0x7f0f041962d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:40750/0 (socket says 172.21.15.87:40750) 2024-09-13T17:24:58.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.870+0000 7f0f0259c640 1 -- 172.21.15.87:0/3393185287 learned_addr learned my addr 172.21.15.87:0/3393185287 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:58.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.870+0000 7f0f02d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f0410a350 0x7f0f0419abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47400/0 (socket says 172.21.15.87:47400) 2024-09-13T17:24:58.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.870+0000 7f0f01d9b640 1 --2- 172.21.15.87:0/3393185287 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f04101800 0x7f0f04196810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:58.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.870+0000 7f0f0259c640 1 -- 172.21.15.87:0/3393185287 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f04101800 msgr2=0x7f0f04196810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:58.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.870+0000 7f0f0259c640 1 --2- 172.21.15.87:0/3393185287 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f04101800 0x7f0f04196810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.870+0000 7f0f0259c640 1 -- 172.21.15.87:0/3393185287 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f0410a350 msgr2=0x7f0f0419abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:58.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.870+0000 7f0f0259c640 1 --2- 172.21.15.87:0/3393185287 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f0410a350 0x7f0f0419abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:58.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.870+0000 7f0f0259c640 1 -- 172.21.15.87:0/3393185287 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0efc009840 con 0x7f0f04100e50 2024-09-13T17:24:58.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.870+0000 7f0f02d9d640 1 --2- 172.21.15.87:0/3393185287 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f0410a350 0x7f0f0419abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:24:58.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.870+0000 7f0f01d9b640 1 --2- 172.21.15.87:0/3393185287 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f04101800 0x7f0f04196810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:24:58.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.870+0000 7f0f0259c640 1 --2- 172.21.15.87:0/3393185287 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f04100e50 0x7f0f041962d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0ef400e9f0 tx=0x7f0ef400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:58.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.870+0000 7f0ef37fe640 1 -- 172.21.15.87:0/3393185287 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef4009720 con 0x7f0f04100e50 2024-09-13T17:24:58.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.870+0000 7f0ef37fe640 1 -- 172.21.15.87:0/3393185287 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0ef40054d0 con 0x7f0f04100e50 2024-09-13T17:24:58.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.870+0000 7f0f089ce640 1 -- 172.21.15.87:0/3393185287 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef8009560 con 0x7f0f04100e50 2024-09-13T17:24:58.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.870+0000 7f0ef37fe640 1 -- 172.21.15.87:0/3393185287 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef4010430 con 0x7f0f04100e50 2024-09-13T17:24:58.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.870+0000 7f0f089ce640 1 -- 172.21.15.87:0/3393185287 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f041a2e60 con 0x7f0f04100e50 2024-09-13T17:24:58.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.871+0000 7f0f089ce640 1 -- 172.21.15.87:0/3393185287 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f04068e50 con 0x7f0f04100e50 2024-09-13T17:24:58.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.873+0000 7f0ef37fe640 1 -- 172.21.15.87:0/3393185287 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f0ef4004f90 con 0x7f0f04100e50 2024-09-13T17:24:58.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.873+0000 7f0ef37fe640 1 --2- 172.21.15.87:0/3393185287 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0eec0a1200 0x7f0eec0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:58.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.873+0000 7f0f01d9b640 1 --2- 172.21.15.87:0/3393185287 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0eec0a1200 0x7f0eec0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:58.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.873+0000 7f0ef37fe640 1 -- 172.21.15.87:0/3393185287 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 9726+0+0 (secure 0 0 0) 0x7f0ef4014070 con 0x7f0f04100e50 2024-09-13T17:24:58.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.874+0000 7f0f01d9b640 1 --2- 172.21.15.87:0/3393185287 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0eec0a1200 0x7f0eec0a36c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8006010 tx=0x7f0ef8032a40 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:58.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:58.876+0000 7f0ef37fe640 1 -- 172.21.15.87:0/3393185287 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0ef4096730 con 0x7f0f04100e50 2024-09-13T17:24:59.019 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:58 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mon-a[30930]: 2024-09-13T17:24:58.745+0000 7f94189ed640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:24:59.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.077+0000 7f0f089ce640 1 -- 172.21.15.87:0/3393185287 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0f041975d0 con 0x7f0f04100e50 2024-09-13T17:24:59.092 INFO:journalctl@ceph.mds.f.smithi149.stdout:Sep 13 17:24:58 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-f[65590]: ignoring --setuser ceph since I am not root 2024-09-13T17:24:59.092 INFO:journalctl@ceph.mds.f.smithi149.stdout:Sep 13 17:24:58 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-f[65590]: ignoring --setgroup ceph since I am not root 2024-09-13T17:24:59.092 INFO:journalctl@ceph.mds.f.smithi149.stdout:Sep 13 17:24:58 smithi149 ceph-mds[65594]: -- 172.21.15.149:0/2633712625 <== mon.1 v2:172.21.15.149:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560b3ab78d00 con 0x560b3ab4d400 2024-09-13T17:24:59.092 INFO:journalctl@ceph.mds.f.smithi149.stdout:Sep 13 17:24:58 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-f[65590]: starting mds.f at 2024-09-13T17:24:59.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:59 smithi149 ceph-mon[35496]: pgmap v347: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-13T17:24:59.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:59 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/1341476144' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:24:59.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:59 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3197172851' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:24:59.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:59 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3373644807' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-13T17:24:59.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:59 smithi149 ceph-mon[35496]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T17:24:59.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:59 smithi149 ceph-mon[35496]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:24:59.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:59 smithi149 ceph-mon[35496]: osdmap e105: 12 total, 12 up, 12 in 2024-09-13T17:24:59.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:59 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3373644807' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-13T17:24:59.093 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:24:59 smithi149 ceph-mon[35496]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-13T17:24:59.094 INFO:journalctl@ceph.mds.c.smithi149.stdout:Sep 13 17:24:58 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-c[65894]: ignoring --setuser ceph since I am not root 2024-09-13T17:24:59.094 INFO:journalctl@ceph.mds.c.smithi149.stdout:Sep 13 17:24:58 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-c[65894]: ignoring --setgroup ceph since I am not root 2024-09-13T17:24:59.094 INFO:journalctl@ceph.mds.c.smithi149.stdout:Sep 13 17:24:58 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-c[65894]: starting mds.c at 2024-09-13T17:24:59.094 INFO:journalctl@ceph.mds.i.smithi149.stdout:Sep 13 17:24:58 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-i[66198]: ignoring --setuser ceph since I am not root 2024-09-13T17:24:59.094 INFO:journalctl@ceph.mds.i.smithi149.stdout:Sep 13 17:24:58 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-i[66198]: ignoring --setgroup ceph since I am not root 2024-09-13T17:24:59.094 INFO:journalctl@ceph.mds.i.smithi149.stdout:Sep 13 17:24:58 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-i[66198]: starting mds.i at 2024-09-13T17:24:59.094 INFO:journalctl@ceph.mds.l.smithi149.stdout:Sep 13 17:24:58 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-l[65284]: ignoring --setuser ceph since I am not root 2024-09-13T17:24:59.094 INFO:journalctl@ceph.mds.l.smithi149.stdout:Sep 13 17:24:58 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-l[65284]: ignoring --setgroup ceph since I am not root 2024-09-13T17:24:59.095 INFO:journalctl@ceph.mds.l.smithi149.stdout:Sep 13 17:24:58 smithi149 ceph-mds[65288]: -- 172.21.15.149:0/1332742472 <== mon.2 v2:172.21.15.118:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e9c08d6d00 con 0x55e9c08ab000 2024-09-13T17:24:59.095 INFO:journalctl@ceph.mds.l.smithi149.stdout:Sep 13 17:24:58 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-l[65284]: starting mds.l at 2024-09-13T17:24:59.113 INFO:journalctl@ceph.mds.b.smithi118.stdout:Sep 13 17:24:58 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-b[64546]: ignoring --setuser ceph since I am not root 2024-09-13T17:24:59.113 INFO:journalctl@ceph.mds.b.smithi118.stdout:Sep 13 17:24:58 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-b[64546]: ignoring --setgroup ceph since I am not root 2024-09-13T17:24:59.113 INFO:journalctl@ceph.mds.b.smithi118.stdout:Sep 13 17:24:58 smithi118 ceph-mds[64550]: -- 172.21.15.118:0/2829291792 <== mon.2 v2:172.21.15.118:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f669b3ad00 con 0x55f669b0f000 2024-09-13T17:24:59.113 INFO:journalctl@ceph.mds.b.smithi118.stdout:Sep 13 17:24:58 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-b[64546]: starting mds.b at 2024-09-13T17:24:59.114 INFO:journalctl@ceph.mds.h.smithi118.stdout:Sep 13 17:24:58 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-h[64236]: ignoring --setuser ceph since I am not root 2024-09-13T17:24:59.114 INFO:journalctl@ceph.mds.h.smithi118.stdout:Sep 13 17:24:58 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-h[64236]: ignoring --setgroup ceph since I am not root 2024-09-13T17:24:59.114 INFO:journalctl@ceph.mds.h.smithi118.stdout:Sep 13 17:24:58 smithi118 ceph-mds[64240]: -- 172.21.15.118:0/361139889 <== mon.1 v2:172.21.15.149:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559e7b36ad00 con 0x559e7b33e800 2024-09-13T17:24:59.114 INFO:journalctl@ceph.mds.h.smithi118.stdout:Sep 13 17:24:58 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-h[64236]: starting mds.h at 2024-09-13T17:24:59.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:59 smithi118 ceph-mon[34374]: pgmap v347: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-13T17:24:59.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:59 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/1341476144' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:24:59.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:59 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3197172851' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:24:59.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:59 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3373644807' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-13T17:24:59.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:59 smithi118 ceph-mon[34374]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T17:24:59.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:59 smithi118 ceph-mon[34374]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:24:59.114 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:59 smithi118 ceph-mon[34374]: osdmap e105: 12 total, 12 up, 12 in 2024-09-13T17:24:59.115 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:59 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3373644807' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-13T17:24:59.115 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:24:59 smithi118 ceph-mon[34374]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-13T17:24:59.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:59 smithi087 ceph-mon[30934]: pgmap v347: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-13T17:24:59.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:59 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/1341476144' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T17:24:59.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:59 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3197172851' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T17:24:59.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:59 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3373644807' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-13T17:24:59.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:59 smithi087 ceph-mon[30934]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T17:24:59.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:59 smithi087 ceph-mon[30934]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:24:59.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:59 smithi087 ceph-mon[30934]: osdmap e105: 12 total, 12 up, 12 in 2024-09-13T17:24:59.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:59 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3373644807' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-13T17:24:59.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:24:59 smithi087 ceph-mon[30934]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-13T17:24:59.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.756+0000 7f0ef37fe640 1 -- 172.21.15.87:0/3393185287 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v38) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0ef4099d50 con 0x7f0f04100e50 2024-09-13T17:24:59.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.758+0000 7f0f089ce640 1 -- 172.21.15.87:0/3393185287 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0eec0a1200 msgr2=0x7f0eec0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:59.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.758+0000 7f0f089ce640 1 --2- 172.21.15.87:0/3393185287 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0eec0a1200 0x7f0eec0a36c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8006010 tx=0x7f0ef8032a40 comp rx=0 tx=0).stop 2024-09-13T17:24:59.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.758+0000 7f0f089ce640 1 -- 172.21.15.87:0/3393185287 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f04100e50 msgr2=0x7f0f041962d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:59.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.758+0000 7f0f089ce640 1 --2- 172.21.15.87:0/3393185287 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f04100e50 0x7f0f041962d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0ef400e9f0 tx=0x7f0ef400edf0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.758+0000 7f0f089ce640 1 -- 172.21.15.87:0/3393185287 shutdown_connections 2024-09-13T17:24:59.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.758+0000 7f0f089ce640 1 --2- 172.21.15.87:0/3393185287 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f0eec0a1200 0x7f0eec0a36c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.758+0000 7f0f089ce640 1 --2- 172.21.15.87:0/3393185287 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f0410a350 0x7f0f0419abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.758+0000 7f0f089ce640 1 --2- 172.21.15.87:0/3393185287 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f04101800 0x7f0f04196810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.758+0000 7f0f089ce640 1 --2- 172.21.15.87:0/3393185287 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f04100e50 0x7f0f041962d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.758+0000 7f0f089ce640 1 -- 172.21.15.87:0/3393185287 >> 172.21.15.87:0/3393185287 conn(0x7f0f040fa930 msgr2=0x7f0f040fc160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:59.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.758+0000 7f0f089ce640 1 -- 172.21.15.87:0/3393185287 shutdown_connections 2024-09-13T17:24:59.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.758+0000 7f0f089ce640 1 -- 172.21.15.87:0/3393185287 wait complete. 2024-09-13T17:24:59.772 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T17:24:59.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.876+0000 7f7c7d111640 1 -- 172.21.15.87:0/4215416145 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c78101860 msgr2=0x7f7c78109d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:59.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.876+0000 7f7c7d111640 1 --2- 172.21.15.87:0/4215416145 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c78101860 0x7f7c78109d40 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c009900 tx=0x7f7c6c02a480 comp rx=0 tx=0).stop 2024-09-13T17:24:59.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.876+0000 7f7c7d111640 1 -- 172.21.15.87:0/4215416145 shutdown_connections 2024-09-13T17:24:59.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.876+0000 7f7c7d111640 1 --2- 172.21.15.87:0/4215416145 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c7810a310 0x7f7c7810c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.876+0000 7f7c7d111640 1 --2- 172.21.15.87:0/4215416145 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c78101860 0x7f7c78109d40 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.876+0000 7f7c7d111640 1 --2- 172.21.15.87:0/4215416145 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c78100f40 0x7f7c78101320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.876+0000 7f7c7d111640 1 -- 172.21.15.87:0/4215416145 >> 172.21.15.87:0/4215416145 conn(0x7f7c78075c60 msgr2=0x7f7c780fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:24:59.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.876+0000 7f7c7d111640 1 -- 172.21.15.87:0/4215416145 shutdown_connections 2024-09-13T17:24:59.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.876+0000 7f7c7d111640 1 -- 172.21.15.87:0/4215416145 wait complete. 2024-09-13T17:24:59.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.876+0000 7f7c7d111640 1 Processor -- start 2024-09-13T17:24:59.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.877+0000 7f7c7d111640 1 -- start start 2024-09-13T17:24:59.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.877+0000 7f7c7d111640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c78100f40 0x7f7c781962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.877+0000 7f7c7d111640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c78101860 0x7f7c78196800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.877+0000 7f7c7d111640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c7810a310 0x7f7c7819abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.877+0000 7f7c7d111640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7819b1f0 con 0x7f7c78100f40 2024-09-13T17:24:59.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.877+0000 7f7c7d111640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7819b360 con 0x7f7c78101860 2024-09-13T17:24:59.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.877+0000 7f7c7d111640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7819b520 con 0x7f7c7810a310 2024-09-13T17:24:59.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.877+0000 7f7c76d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c78100f40 0x7f7c781962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:59.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.877+0000 7f7c76d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c78100f40 0x7f7c781962c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34886/0 (socket says 172.21.15.87:34886) 2024-09-13T17:24:59.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.877+0000 7f7c76d9d640 1 -- 172.21.15.87:0/2924026717 learned_addr learned my addr 172.21.15.87:0/2924026717 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:24:59.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.877+0000 7f7c7659c640 1 --2- 172.21.15.87:0/2924026717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c78101860 0x7f7c78196800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:59.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.877+0000 7f7c7759e640 1 --2- 172.21.15.87:0/2924026717 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c7810a310 0x7f7c7819abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:59.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.877+0000 7f7c76d9d640 1 -- 172.21.15.87:0/2924026717 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c7810a310 msgr2=0x7f7c7819abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:59.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.877+0000 7f7c76d9d640 1 --2- 172.21.15.87:0/2924026717 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c7810a310 0x7f7c7819abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.877+0000 7f7c76d9d640 1 -- 172.21.15.87:0/2924026717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c78101860 msgr2=0x7f7c78196800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:24:59.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.877+0000 7f7c76d9d640 1 --2- 172.21.15.87:0/2924026717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c78101860 0x7f7c78196800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:24:59.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.877+0000 7f7c76d9d640 1 -- 172.21.15.87:0/2924026717 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6c009560 con 0x7f7c78100f40 2024-09-13T17:24:59.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.877+0000 7f7c76d9d640 1 --2- 172.21.15.87:0/2924026717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c78100f40 0x7f7c781962c0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f7c6800e9f0 tx=0x7f7c6800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:59.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.878+0000 7f7c5ffff640 1 -- 172.21.15.87:0/2924026717 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c68009700 con 0x7f7c78100f40 2024-09-13T17:24:59.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.878+0000 7f7c5ffff640 1 -- 172.21.15.87:0/2924026717 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7c6800cd80 con 0x7f7c78100f40 2024-09-13T17:24:59.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.878+0000 7f7c7d111640 1 -- 172.21.15.87:0/2924026717 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c7819b800 con 0x7f7c78100f40 2024-09-13T17:24:59.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.878+0000 7f7c5ffff640 1 -- 172.21.15.87:0/2924026717 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c68018840 con 0x7f7c78100f40 2024-09-13T17:24:59.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.878+0000 7f7c7d111640 1 -- 172.21.15.87:0/2924026717 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c781a3080 con 0x7f7c78100f40 2024-09-13T17:24:59.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.879+0000 7f7c7d111640 1 -- 172.21.15.87:0/2924026717 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c78067e00 con 0x7f7c78100f40 2024-09-13T17:24:59.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.880+0000 7f7c5ffff640 1 -- 172.21.15.87:0/2924026717 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f7c680189a0 con 0x7f7c78100f40 2024-09-13T17:24:59.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.880+0000 7f7c5ffff640 1 --2- 172.21.15.87:0/2924026717 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7c600a1200 0x7f7c600a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:24:59.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.881+0000 7f7c7659c640 1 --2- 172.21.15.87:0/2924026717 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7c600a1200 0x7f7c600a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:24:59.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.881+0000 7f7c5ffff640 1 -- 172.21.15.87:0/2924026717 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 9726+0+0 (secure 0 0 0) 0x7f7c68014070 con 0x7f7c78100f40 2024-09-13T17:24:59.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.881+0000 7f7c7659c640 1 --2- 172.21.15.87:0/2924026717 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7c600a1200 0x7f7c600a36c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c0057c0 tx=0x7f7c6c005a20 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:24:59.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:24:59.884+0000 7f7c5ffff640 1 -- 172.21.15.87:0/2924026717 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7c680969b0 con 0x7f7c78100f40 2024-09-13T17:25:00.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:00.050+0000 7f7c7d111640 1 -- 172.21.15.87:0/2924026717 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7c781053d0 con 0x7f7c78100f40 2024-09-13T17:25:00.308 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:00 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/3393185287' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T17:25:00.308 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:00 smithi149 ceph-mon[35496]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T17:25:00.308 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:00 smithi149 ceph-mon[35496]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T17:25:00.308 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:00 smithi149 ceph-mon[35496]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T17:25:00.308 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:00 smithi149 ceph-mon[35496]: Cluster is now healthy 2024-09-13T17:25:00.308 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:00 smithi149 ceph-mon[35496]: mds.? [v2:172.21.15.149:6832/56260866,v1:172.21.15.149:6833/56260866] up:boot 2024-09-13T17:25:00.309 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:00 smithi149 ceph-mon[35496]: mds.? [v2:172.21.15.149:6834/291404651,v1:172.21.15.149:6835/291404651] up:boot 2024-09-13T17:25:00.309 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:00 smithi149 ceph-mon[35496]: mds.? [v2:172.21.15.118:6836/1399497065,v1:172.21.15.118:6839/1399497065] up:boot 2024-09-13T17:25:00.309 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:00 smithi149 ceph-mon[35496]: mds.? [v2:172.21.15.118:6837/1693689610,v1:172.21.15.118:6838/1693689610] up:boot 2024-09-13T17:25:00.309 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:00 smithi149 ceph-mon[35496]: mds.? [v2:172.21.15.149:6836/411257130,v1:172.21.15.149:6837/411257130] up:boot 2024-09-13T17:25:00.309 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:00 smithi149 ceph-mon[35496]: mds.? [v2:172.21.15.149:6838/1166779938,v1:172.21.15.149:6839/1166779938] up:boot 2024-09-13T17:25:00.309 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:00 smithi149 ceph-mon[35496]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-13T17:25:00.309 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:00 smithi149 ceph-mon[35496]: fsmap 12 up:standby 2024-09-13T17:25:00.309 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:00 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T17:25:00.309 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:00 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-13T17:25:00.309 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:00 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T17:25:00.309 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:00 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T17:25:00.310 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:00 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T17:25:00.310 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:00 smithi149 ceph-mon[35496]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T17:25:00.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:25:00 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/3393185287' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T17:25:00.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:25:00 smithi118 ceph-mon[34374]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T17:25:00.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:25:00 smithi118 ceph-mon[34374]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T17:25:00.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:25:00 smithi118 ceph-mon[34374]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T17:25:00.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:25:00 smithi118 ceph-mon[34374]: Cluster is now healthy 2024-09-13T17:25:00.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:25:00 smithi118 ceph-mon[34374]: mds.? [v2:172.21.15.149:6832/56260866,v1:172.21.15.149:6833/56260866] up:boot 2024-09-13T17:25:00.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:25:00 smithi118 ceph-mon[34374]: mds.? [v2:172.21.15.149:6834/291404651,v1:172.21.15.149:6835/291404651] up:boot 2024-09-13T17:25:00.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:25:00 smithi118 ceph-mon[34374]: mds.? [v2:172.21.15.118:6836/1399497065,v1:172.21.15.118:6839/1399497065] up:boot 2024-09-13T17:25:00.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:25:00 smithi118 ceph-mon[34374]: mds.? [v2:172.21.15.118:6837/1693689610,v1:172.21.15.118:6838/1693689610] up:boot 2024-09-13T17:25:00.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:25:00 smithi118 ceph-mon[34374]: mds.? [v2:172.21.15.149:6836/411257130,v1:172.21.15.149:6837/411257130] up:boot 2024-09-13T17:25:00.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:25:00 smithi118 ceph-mon[34374]: mds.? [v2:172.21.15.149:6838/1166779938,v1:172.21.15.149:6839/1166779938] up:boot 2024-09-13T17:25:00.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:25:00 smithi118 ceph-mon[34374]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-13T17:25:00.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:25:00 smithi118 ceph-mon[34374]: fsmap 12 up:standby 2024-09-13T17:25:00.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:25:00 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T17:25:00.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:25:00 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-13T17:25:00.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:25:00 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T17:25:00.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:25:00 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T17:25:00.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:25:00 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T17:25:00.364 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:25:00 smithi118 ceph-mon[34374]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T17:25:00.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:25:00 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/3393185287' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T17:25:00.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:25:00 smithi087 ceph-mon[30934]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T17:25:00.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:25:00 smithi087 ceph-mon[30934]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T17:25:00.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:25:00 smithi087 ceph-mon[30934]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T17:25:00.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:25:00 smithi087 ceph-mon[30934]: Cluster is now healthy 2024-09-13T17:25:00.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:25:00 smithi087 ceph-mon[30934]: mds.? [v2:172.21.15.149:6832/56260866,v1:172.21.15.149:6833/56260866] up:boot 2024-09-13T17:25:00.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:25:00 smithi087 ceph-mon[30934]: mds.? [v2:172.21.15.149:6834/291404651,v1:172.21.15.149:6835/291404651] up:boot 2024-09-13T17:25:00.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:25:00 smithi087 ceph-mon[30934]: mds.? [v2:172.21.15.118:6836/1399497065,v1:172.21.15.118:6839/1399497065] up:boot 2024-09-13T17:25:00.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:25:00 smithi087 ceph-mon[30934]: mds.? [v2:172.21.15.118:6837/1693689610,v1:172.21.15.118:6838/1693689610] up:boot 2024-09-13T17:25:00.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:25:00 smithi087 ceph-mon[30934]: mds.? [v2:172.21.15.149:6836/411257130,v1:172.21.15.149:6837/411257130] up:boot 2024-09-13T17:25:00.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:25:00 smithi087 ceph-mon[30934]: mds.? [v2:172.21.15.149:6838/1166779938,v1:172.21.15.149:6839/1166779938] up:boot 2024-09-13T17:25:00.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:25:00 smithi087 ceph-mon[30934]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-13T17:25:00.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:25:00 smithi087 ceph-mon[30934]: fsmap 12 up:standby 2024-09-13T17:25:00.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:25:00 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T17:25:00.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:25:00 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-13T17:25:00.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:25:00 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T17:25:00.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:25:00 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T17:25:00.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:25:00 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T17:25:00.480 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:25:00 smithi087 ceph-mon[30934]: from='mgr.15507 172.21.15.87:0/966774722' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T17:25:01.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.033+0000 7f7c5ffff640 1 -- 172.21.15.87:0/2924026717 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v106) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7c68099fd0 con 0x7f7c78100f40 2024-09-13T17:25:01.034 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_metadata' removed 2024-09-13T17:25:01.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.036+0000 7f7c7d111640 1 -- 172.21.15.87:0/2924026717 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7c600a1200 msgr2=0x7f7c600a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.036+0000 7f7c7d111640 1 --2- 172.21.15.87:0/2924026717 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7c600a1200 0x7f7c600a36c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c0057c0 tx=0x7f7c6c005a20 comp rx=0 tx=0).stop 2024-09-13T17:25:01.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.036+0000 7f7c7d111640 1 -- 172.21.15.87:0/2924026717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c78100f40 msgr2=0x7f7c781962c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.036+0000 7f7c7d111640 1 --2- 172.21.15.87:0/2924026717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c78100f40 0x7f7c781962c0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f7c6800e9f0 tx=0x7f7c6800eeb0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.036+0000 7f7c7d111640 1 -- 172.21.15.87:0/2924026717 shutdown_connections 2024-09-13T17:25:01.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.036+0000 7f7c7d111640 1 --2- 172.21.15.87:0/2924026717 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c7810a310 0x7f7c7819abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.036+0000 7f7c7d111640 1 --2- 172.21.15.87:0/2924026717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c78101860 0x7f7c78196800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.036+0000 7f7c7d111640 1 --2- 172.21.15.87:0/2924026717 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f7c600a1200 0x7f7c600a36c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.036+0000 7f7c7d111640 1 --2- 172.21.15.87:0/2924026717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c78100f40 0x7f7c781962c0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.036+0000 7f7c7d111640 1 -- 172.21.15.87:0/2924026717 >> 172.21.15.87:0/2924026717 conn(0x7f7c78075c60 msgr2=0x7f7c780fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:01.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.036+0000 7f7c7d111640 1 -- 172.21.15.87:0/2924026717 shutdown_connections 2024-09-13T17:25:01.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.036+0000 7f7c7d111640 1 -- 172.21.15.87:0/2924026717 wait complete. 2024-09-13T17:25:01.050 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T17:25:01.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.153+0000 7fdf27d45640 1 -- 172.21.15.87:0/2497668550 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf200ff800 msgr2=0x7fdf20103840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.153+0000 7fdf27d45640 1 --2- 172.21.15.87:0/2497668550 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf200ff800 0x7fdf20103840 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fdf14009930 tx=0x7fdf1402a420 comp rx=0 tx=0).stop 2024-09-13T17:25:01.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.153+0000 7fdf27d45640 1 -- 172.21.15.87:0/2497668550 shutdown_connections 2024-09-13T17:25:01.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.153+0000 7fdf27d45640 1 --2- 172.21.15.87:0/2497668550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf20103fa0 0x7fdf2010baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.153+0000 7fdf27d45640 1 --2- 172.21.15.87:0/2497668550 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf200ff800 0x7fdf20103840 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.153+0000 7fdf27d45640 1 --2- 172.21.15.87:0/2497668550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf200fee50 0x7fdf200ff230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.153+0000 7fdf27d45640 1 -- 172.21.15.87:0/2497668550 >> 172.21.15.87:0/2497668550 conn(0x7fdf200fa8e0 msgr2=0x7fdf200fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:01.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.153+0000 7fdf27d45640 1 -- 172.21.15.87:0/2497668550 shutdown_connections 2024-09-13T17:25:01.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.153+0000 7fdf27d45640 1 -- 172.21.15.87:0/2497668550 wait complete. 2024-09-13T17:25:01.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.154+0000 7fdf27d45640 1 Processor -- start 2024-09-13T17:25:01.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.154+0000 7fdf27d45640 1 -- start start 2024-09-13T17:25:01.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.154+0000 7fdf27d45640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf200fee50 0x7fdf20197140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.154+0000 7fdf27d45640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf20103fa0 0x7fdf20197680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.154+0000 7fdf27d45640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf20197bc0 0x7fdf201a21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.154+0000 7fdf27d45640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf201a2860 con 0x7fdf200fee50 2024-09-13T17:25:01.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.154+0000 7fdf27d45640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf201a29d0 con 0x7fdf20103fa0 2024-09-13T17:25:01.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.154+0000 7fdf27d45640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf201a2b90 con 0x7fdf20197bc0 2024-09-13T17:25:01.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.154+0000 7fdf25ae1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf200fee50 0x7fdf20197140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.154+0000 7fdf25ae1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf200fee50 0x7fdf20197140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34902/0 (socket says 172.21.15.87:34902) 2024-09-13T17:25:01.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.154+0000 7fdf25ae1640 1 -- 172.21.15.87:0/364887976 learned_addr learned my addr 172.21.15.87:0/364887976 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:25:01.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.154+0000 7fdf252e0640 1 --2- 172.21.15.87:0/364887976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf20103fa0 0x7fdf20197680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.154+0000 7fdf25ae1640 1 -- 172.21.15.87:0/364887976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf20197bc0 msgr2=0x7fdf201a21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.154+0000 7fdf262e2640 1 --2- 172.21.15.87:0/364887976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf20197bc0 0x7fdf201a21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.154+0000 7fdf25ae1640 1 --2- 172.21.15.87:0/364887976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf20197bc0 0x7fdf201a21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.154+0000 7fdf25ae1640 1 -- 172.21.15.87:0/364887976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf20103fa0 msgr2=0x7fdf20197680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:01.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.154+0000 7fdf25ae1640 1 --2- 172.21.15.87:0/364887976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf20103fa0 0x7fdf20197680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:01.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.154+0000 7fdf25ae1640 1 -- 172.21.15.87:0/364887976 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf14009560 con 0x7fdf200fee50 2024-09-13T17:25:01.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.154+0000 7fdf262e2640 1 --2- 172.21.15.87:0/364887976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf20197bc0 0x7fdf201a21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:25:01.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.154+0000 7fdf252e0640 1 --2- 172.21.15.87:0/364887976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf20103fa0 0x7fdf20197680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:25:01.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.154+0000 7fdf25ae1640 1 --2- 172.21.15.87:0/364887976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf200fee50 0x7fdf20197140 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00d950 tx=0x7fdf1c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:01.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.155+0000 7fdf12ffd640 1 -- 172.21.15.87:0/364887976 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c009c30 con 0x7fdf200fee50 2024-09-13T17:25:01.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.155+0000 7fdf12ffd640 1 -- 172.21.15.87:0/364887976 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdf1c009d90 con 0x7fdf200fee50 2024-09-13T17:25:01.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.155+0000 7fdf12ffd640 1 -- 172.21.15.87:0/364887976 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c00f6b0 con 0x7fdf200fee50 2024-09-13T17:25:01.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.155+0000 7fdf27d45640 1 -- 172.21.15.87:0/364887976 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf201a2e70 con 0x7fdf200fee50 2024-09-13T17:25:01.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.155+0000 7fdf27d45640 1 -- 172.21.15.87:0/364887976 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf201a32f0 con 0x7fdf200fee50 2024-09-13T17:25:01.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.155+0000 7fdf27d45640 1 -- 172.21.15.87:0/364887976 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf20100320 con 0x7fdf200fee50 2024-09-13T17:25:01.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.157+0000 7fdf12ffd640 1 -- 172.21.15.87:0/364887976 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fdf1c010aa0 con 0x7fdf200fee50 2024-09-13T17:25:01.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.157+0000 7fdf12ffd640 1 --2- 172.21.15.87:0/364887976 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdf0c0a1280 0x7fdf0c0a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:01.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.157+0000 7fdf252e0640 1 --2- 172.21.15.87:0/364887976 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdf0c0a1280 0x7fdf0c0a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:01.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.157+0000 7fdf12ffd640 1 -- 172.21.15.87:0/364887976 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 9143+0+0 (secure 0 0 0) 0x7fdf1c0ccc40 con 0x7fdf200fee50 2024-09-13T17:25:01.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.158+0000 7fdf252e0640 1 --2- 172.21.15.87:0/364887976 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdf0c0a1280 0x7fdf0c0a3740 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdf14006010 tx=0x7fdf14000bc0 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:01.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.160+0000 7fdf12ffd640 1 -- 172.21.15.87:0/364887976 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdf1c095ea0 con 0x7fdf200fee50 2024-09-13T17:25:01.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:01.322+0000 7fdf27d45640 1 -- 172.21.15.87:0/364887976 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdf20107250 con 0x7fdf200fee50 2024-09-13T17:25:01.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:01 smithi149 ceph-mon[35496]: pgmap v349: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 921 B/s wr, 8 op/s 2024-09-13T17:25:01.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:01 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2924026717' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T17:25:01.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:25:01 smithi118 ceph-mon[34374]: pgmap v349: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 921 B/s wr, 8 op/s 2024-09-13T17:25:01.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:25:01 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2924026717' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T17:25:01.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:25:01 smithi087 ceph-mon[30934]: pgmap v349: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 921 B/s wr, 8 op/s 2024-09-13T17:25:01.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:25:01 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2924026717' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T17:25:02.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.039+0000 7fdf12ffd640 1 -- 172.21.15.87:0/364887976 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v107) v1 ==== 169+0+0 (secure 0 0 0) 0x7fdf1c017020 con 0x7fdf200fee50 2024-09-13T17:25:02.040 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_data' removed 2024-09-13T17:25:02.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.042+0000 7fdf27d45640 1 -- 172.21.15.87:0/364887976 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdf0c0a1280 msgr2=0x7fdf0c0a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:02.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.042+0000 7fdf27d45640 1 --2- 172.21.15.87:0/364887976 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdf0c0a1280 0x7fdf0c0a3740 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdf14006010 tx=0x7fdf14000bc0 comp rx=0 tx=0).stop 2024-09-13T17:25:02.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.042+0000 7fdf27d45640 1 -- 172.21.15.87:0/364887976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf200fee50 msgr2=0x7fdf20197140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:02.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.042+0000 7fdf27d45640 1 --2- 172.21.15.87:0/364887976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf200fee50 0x7fdf20197140 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00d950 tx=0x7fdf1c00de10 comp rx=0 tx=0).stop 2024-09-13T17:25:02.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.042+0000 7fdf27d45640 1 -- 172.21.15.87:0/364887976 shutdown_connections 2024-09-13T17:25:02.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.042+0000 7fdf27d45640 1 --2- 172.21.15.87:0/364887976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf20197bc0 0x7fdf201a21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:02.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.042+0000 7fdf27d45640 1 --2- 172.21.15.87:0/364887976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf20103fa0 0x7fdf20197680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:02.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.042+0000 7fdf27d45640 1 --2- 172.21.15.87:0/364887976 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7fdf0c0a1280 0x7fdf0c0a3740 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:02.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.043+0000 7fdf27d45640 1 --2- 172.21.15.87:0/364887976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf200fee50 0x7fdf20197140 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:02.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.043+0000 7fdf27d45640 1 -- 172.21.15.87:0/364887976 >> 172.21.15.87:0/364887976 conn(0x7fdf200fa8e0 msgr2=0x7fdf200fbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:02.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.043+0000 7fdf27d45640 1 -- 172.21.15.87:0/364887976 shutdown_connections 2024-09-13T17:25:02.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.043+0000 7fdf27d45640 1 -- 172.21.15.87:0/364887976 wait complete. 2024-09-13T17:25:02.057 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-13T17:25:02.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.159+0000 7f880c59c640 1 -- 172.21.15.87:0/3554872825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88040fee60 msgr2=0x7f88040ff240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:02.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.159+0000 7f880c59c640 1 --2- 172.21.15.87:0/3554872825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88040fee60 0x7f88040ff240 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f8800009930 tx=0x7f880002a420 comp rx=0 tx=0).stop 2024-09-13T17:25:02.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.160+0000 7f880c59c640 1 -- 172.21.15.87:0/3554872825 shutdown_connections 2024-09-13T17:25:02.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.160+0000 7f880c59c640 1 --2- 172.21.15.87:0/3554872825 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8804103fb0 0x7f880410bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:02.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.160+0000 7f880c59c640 1 --2- 172.21.15.87:0/3554872825 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88040ff810 0x7f8804103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:02.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.160+0000 7f880c59c640 1 --2- 172.21.15.87:0/3554872825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88040fee60 0x7f88040ff240 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:02.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.160+0000 7f880c59c640 1 -- 172.21.15.87:0/3554872825 >> 172.21.15.87:0/3554872825 conn(0x7f8804075c60 msgr2=0x7f88040fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:02.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.160+0000 7f880c59c640 1 -- 172.21.15.87:0/3554872825 shutdown_connections 2024-09-13T17:25:02.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.160+0000 7f880c59c640 1 -- 172.21.15.87:0/3554872825 wait complete. 2024-09-13T17:25:02.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.160+0000 7f880c59c640 1 Processor -- start 2024-09-13T17:25:02.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.160+0000 7f880c59c640 1 -- start start 2024-09-13T17:25:02.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.160+0000 7f880c59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88040fee60 0x7f880410c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:02.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.160+0000 7f880c59c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8804103fb0 0x7f880410c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:02.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.160+0000 7f880c59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f880410ce90 0x7f88041a44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:02.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.160+0000 7f880c59c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88041a4ab0 con 0x7f88040fee60 2024-09-13T17:25:02.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.160+0000 7f880c59c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88041a4c20 con 0x7f880410ce90 2024-09-13T17:25:02.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.160+0000 7f880c59c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88041a4de0 con 0x7f8804103fb0 2024-09-13T17:25:02.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.160+0000 7f880a338640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88040fee60 0x7f880410c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:02.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.160+0000 7f880a338640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88040fee60 0x7f880410c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34914/0 (socket says 172.21.15.87:34914) 2024-09-13T17:25:02.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.160+0000 7f880a338640 1 -- 172.21.15.87:0/2687898762 learned_addr learned my addr 172.21.15.87:0/2687898762 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T17:25:02.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.161+0000 7f8809b37640 1 --2- 172.21.15.87:0/2687898762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8804103fb0 0x7f880410c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:02.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.161+0000 7f880ab39640 1 --2- 172.21.15.87:0/2687898762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f880410ce90 0x7f88041a44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:02.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.161+0000 7f880a338640 1 -- 172.21.15.87:0/2687898762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8804103fb0 msgr2=0x7f880410c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:02.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.161+0000 7f880a338640 1 --2- 172.21.15.87:0/2687898762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8804103fb0 0x7f880410c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:02.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.161+0000 7f880a338640 1 -- 172.21.15.87:0/2687898762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f880410ce90 msgr2=0x7f88041a44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:02.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.161+0000 7f880a338640 1 --2- 172.21.15.87:0/2687898762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f880410ce90 0x7f88041a44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:02.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.161+0000 7f880a338640 1 -- 172.21.15.87:0/2687898762 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8800009560 con 0x7f88040fee60 2024-09-13T17:25:02.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.161+0000 7f880ab39640 1 --2- 172.21.15.87:0/2687898762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f880410ce90 0x7f88041a44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:25:02.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.161+0000 7f880a338640 1 --2- 172.21.15.87:0/2687898762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88040fee60 0x7f880410c410 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f8800009900 tx=0x7f88000042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:02.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.161+0000 7f87fb7fe640 1 -- 172.21.15.87:0/2687898762 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8800003a00 con 0x7f88040fee60 2024-09-13T17:25:02.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.161+0000 7f880c59c640 1 -- 172.21.15.87:0/2687898762 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88041a5060 con 0x7f88040fee60 2024-09-13T17:25:02.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.161+0000 7f87fb7fe640 1 -- 172.21.15.87:0/2687898762 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(26 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f88000044e0 con 0x7f88040fee60 2024-09-13T17:25:02.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.161+0000 7f87fb7fe640 1 -- 172.21.15.87:0/2687898762 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880003a3c0 con 0x7f88040fee60 2024-09-13T17:25:02.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.161+0000 7f880c59c640 1 -- 172.21.15.87:0/2687898762 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88041a5510 con 0x7f88040fee60 2024-09-13T17:25:02.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.162+0000 7f880c59c640 1 -- 172.21.15.87:0/2687898762 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8804100330 con 0x7f88040fee60 2024-09-13T17:25:02.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.163+0000 7f87fb7fe640 1 -- 172.21.15.87:0/2687898762 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 26) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f880003b460 con 0x7f88040fee60 2024-09-13T17:25:02.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.164+0000 7f87fb7fe640 1 --2- 172.21.15.87:0/2687898762 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f87f00a1230 0x7f87f00a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:25:02.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.164+0000 7f8809b37640 1 --2- 172.21.15.87:0/2687898762 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f87f00a1230 0x7f87f00a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:25:02.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.164+0000 7f87fb7fe640 1 -- 172.21.15.87:0/2687898762 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 8510+0+0 (secure 0 0 0) 0x7f88000edec0 con 0x7f88040fee60 2024-09-13T17:25:02.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.164+0000 7f8809b37640 1 --2- 172.21.15.87:0/2687898762 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f87f00a1230 0x7f87f00a36f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f880410db90 tx=0x7f87f4008040 comp rx=0 tx=0).ready entity=mgr.15507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:25:02.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.167+0000 7f87fb7fe640 1 -- 172.21.15.87:0/2687898762 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f88000b7320 con 0x7f88040fee60 2024-09-13T17:25:02.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:02.331+0000 7f880c59c640 1 -- 172.21.15.87:0/2687898762 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f88040ff240 con 0x7f88040fee60 2024-09-13T17:25:02.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:02 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2924026717' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T17:25:02.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:02 smithi149 ceph-mon[35496]: osdmap e106: 12 total, 12 up, 12 in 2024-09-13T17:25:02.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:02 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/364887976' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T17:25:02.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:25:02 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2924026717' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T17:25:02.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:25:02 smithi118 ceph-mon[34374]: osdmap e106: 12 total, 12 up, 12 in 2024-09-13T17:25:02.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:25:02 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/364887976' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T17:25:02.478 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:25:02 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2924026717' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T17:25:02.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:25:02 smithi087 ceph-mon[30934]: osdmap e106: 12 total, 12 up, 12 in 2024-09-13T17:25:02.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:25:02 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/364887976' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T17:25:03.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:03.044+0000 7f87fb7fe640 1 -- 172.21.15.87:0/2687898762 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v108) v1 ==== 178+0+0 (secure 0 0 0) 0x7f880004b0d0 con 0x7f88040fee60 2024-09-13T17:25:03.046 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_data_ec' removed 2024-09-13T17:25:03.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:03.048+0000 7f880c59c640 1 -- 172.21.15.87:0/2687898762 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f87f00a1230 msgr2=0x7f87f00a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:03.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:03.048+0000 7f880c59c640 1 --2- 172.21.15.87:0/2687898762 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f87f00a1230 0x7f87f00a36f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f880410db90 tx=0x7f87f4008040 comp rx=0 tx=0).stop 2024-09-13T17:25:03.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:03.048+0000 7f880c59c640 1 -- 172.21.15.87:0/2687898762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88040fee60 msgr2=0x7f880410c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:25:03.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:03.048+0000 7f880c59c640 1 --2- 172.21.15.87:0/2687898762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88040fee60 0x7f880410c410 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f8800009900 tx=0x7f88000042f0 comp rx=0 tx=0).stop 2024-09-13T17:25:03.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:03.048+0000 7f880c59c640 1 -- 172.21.15.87:0/2687898762 shutdown_connections 2024-09-13T17:25:03.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:03.048+0000 7f880c59c640 1 --2- 172.21.15.87:0/2687898762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f880410ce90 0x7f88041a44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:03.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:03.048+0000 7f880c59c640 1 --2- 172.21.15.87:0/2687898762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8804103fb0 0x7f880410c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:03.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:03.048+0000 7f880c59c640 1 --2- 172.21.15.87:0/2687898762 >> [v2:172.21.15.87:6800/157129242,v1:172.21.15.87:6801/157129242] conn(0x7f87f00a1230 0x7f87f00a36f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:03.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:03.048+0000 7f880c59c640 1 --2- 172.21.15.87:0/2687898762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88040fee60 0x7f880410c410 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:25:03.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:03.048+0000 7f880c59c640 1 -- 172.21.15.87:0/2687898762 >> 172.21.15.87:0/2687898762 conn(0x7f8804075c60 msgr2=0x7f8804102410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:25:03.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:03.048+0000 7f880c59c640 1 -- 172.21.15.87:0/2687898762 shutdown_connections 2024-09-13T17:25:03.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T17:25:03.048+0000 7f880c59c640 1 -- 172.21.15.87:0/2687898762 wait complete. 2024-09-13T17:25:03.066 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T17:25:03.092 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T17:25:03.128 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T17:25:03.159 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-13T17:25:03.159 DEBUG:teuthology.orchestra.run.smithi087:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T17:25:03.175 DEBUG:teuthology.orchestra.run.smithi118:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T17:25:03.193 DEBUG:teuthology.orchestra.run.smithi149:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T17:25:03.216 INFO:tasks.cephadm:Stopping all daemons... 2024-09-13T17:25:03.216 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-13T17:25:03.216 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mon.a 2024-09-13T17:25:03.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:03 smithi149 ceph-mon[35496]: pgmap v351: 97 pgs: 97 active+clean; 577 KiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:25:03.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:03 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/364887976' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T17:25:03.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:03 smithi149 ceph-mon[35496]: osdmap e107: 12 total, 12 up, 12 in 2024-09-13T17:25:03.342 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:03 smithi149 ceph-mon[35496]: from='client.? 172.21.15.87:0/2687898762' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T17:25:03.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:25:03 smithi118 ceph-mon[34374]: pgmap v351: 97 pgs: 97 active+clean; 577 KiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:25:03.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:25:03 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/364887976' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T17:25:03.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:25:03 smithi118 ceph-mon[34374]: osdmap e107: 12 total, 12 up, 12 in 2024-09-13T17:25:03.363 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:25:03 smithi118 ceph-mon[34374]: from='client.? 172.21.15.87:0/2687898762' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T17:25:03.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:25:03 smithi087 ceph-mon[30934]: pgmap v351: 97 pgs: 97 active+clean; 577 KiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T17:25:03.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:25:03 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/364887976' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T17:25:03.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:25:03 smithi087 ceph-mon[30934]: osdmap e107: 12 total, 12 up, 12 in 2024-09-13T17:25:03.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:25:03 smithi087 ceph-mon[30934]: from='client.? 172.21.15.87:0/2687898762' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T17:25:03.479 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:25:03 smithi087 systemd[1]: Stopping Ceph mon.a for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:25:03.871 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:25:03 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mon-a[30930]: 2024-09-13T17:25:03.521+0000 7f941e1f8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:25:03.871 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:25:03 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mon-a[30930]: 2024-09-13T17:25:03.521+0000 7f941e1f8640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-13T17:25:03.871 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:25:03 smithi087 podman[100954]: 2024-09-13 17:25:03.573273857 +0000 UTC m=+0.161884982 container died 054de9f0e33b3baae2fa0339fe4bd245f6837e484c96a3bf1ff372b2e82f0bee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2) 2024-09-13T17:25:04.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:25:03 smithi087 podman[100954]: 2024-09-13 17:25:03.961364744 +0000 UTC m=+0.549975868 container cleanup 054de9f0e33b3baae2fa0339fe4bd245f6837e484c96a3bf1ff372b2e82f0bee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mon-a, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:25:04.229 INFO:journalctl@ceph.mon.a.smithi087.stdout:Sep 13 17:25:03 smithi087 bash[100954]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mon-a 2024-09-13T17:25:04.355 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mon.a.service' 2024-09-13T17:25:04.402 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:25:04.402 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-13T17:25:04.402 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-13T17:25:04.403 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mon.b 2024-09-13T17:25:04.730 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:25:04 smithi118 systemd[1]: Stopping Ceph mon.b for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:25:05.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:25:04 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mon-b[34370]: 2024-09-13T17:25:04.728+0000 7f90d0cc1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:25:05.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:25:04 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mon-b[34370]: 2024-09-13T17:25:04.728+0000 7f90d0cc1640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-13T17:25:05.113 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:25:04 smithi118 podman[70056]: 2024-09-13 17:25:04.954331825 +0000 UTC m=+0.350333003 container died 01f3bc8e7b81b84c48285ca54c8b81e077f160c3906efe2898202528ff5cb196 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mon-b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2) 2024-09-13T17:25:05.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:25:05 smithi118 podman[70056]: 2024-09-13 17:25:05.355044563 +0000 UTC m=+0.751045735 container cleanup 01f3bc8e7b81b84c48285ca54c8b81e077f160c3906efe2898202528ff5cb196 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mon-b, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:25:05.613 INFO:journalctl@ceph.mon.b.smithi118.stdout:Sep 13 17:25:05 smithi118 bash[70056]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mon-b 2024-09-13T17:25:05.749 DEBUG:teuthology.orchestra.run.smithi118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mon.b.service' 2024-09-13T17:25:05.793 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:25:05.793 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-13T17:25:05.793 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-13T17:25:05.794 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mon.c 2024-09-13T17:25:06.092 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:05 smithi149 systemd[1]: Stopping Ceph mon.c for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:25:06.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:06 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mon-c[35492]: 2024-09-13T17:25:06.103+0000 7f2864347640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:25:06.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:06 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mon-c[35492]: 2024-09-13T17:25:06.103+0000 7f2864347640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-13T17:25:06.593 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:06 smithi149 podman[71722]: 2024-09-13 17:25:06.329683705 +0000 UTC m=+0.343125621 container died f9fefcd4622c323a60752030255606df2081fda0addfe004adea3ca0e7415aa4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mon-c, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-13T17:25:06.966 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:06 smithi149 podman[71722]: 2024-09-13 17:25:06.730639829 +0000 UTC m=+0.744081745 container cleanup f9fefcd4622c323a60752030255606df2081fda0addfe004adea3ca0e7415aa4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mon-c, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-13T17:25:06.966 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:06 smithi149 bash[71722]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mon-c 2024-09-13T17:25:07.212 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mon.c.service' 2024-09-13T17:25:07.234 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:06 smithi149 podman[71734]: 2024-09-13 17:25:06.965660155 +0000 UTC m=+0.633925777 container remove f9fefcd4622c323a60752030255606df2081fda0addfe004adea3ca0e7415aa4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mon-c, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:25:07.234 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:07 smithi149 systemd[1]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mon.c.service: Deactivated successfully. 2024-09-13T17:25:07.234 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:07 smithi149 systemd[1]: Stopped Ceph mon.c for 043d5bae-71f2-11ef-bceb-c7b262605968. 2024-09-13T17:25:07.235 INFO:journalctl@ceph.mon.c.smithi149.stdout:Sep 13 17:25:07 smithi149 systemd[1]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mon.c.service: Consumed 13.355s CPU time. 2024-09-13T17:25:07.257 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:25:07.257 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-13T17:25:07.258 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-13T17:25:07.258 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mgr.x 2024-09-13T17:25:07.545 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:25:07 smithi087 systemd[1]: Stopping Ceph mgr.x for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:25:07.926 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:25:07 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x[31158]: 2024-09-13T17:25:07.616+0000 7f654b7d4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:25:07.926 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:25:07 smithi087 podman[101159]: 2024-09-13 17:25:07.647175543 +0000 UTC m=+0.189041086 container died 0002ab02071596fa8d36f83e50cce0868983ca1cbeca35595a4b5635cedc7611 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:25:08.229 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:25:08 smithi087 podman[101159]: 2024-09-13 17:25:08.015953935 +0000 UTC m=+0.557819469 container cleanup 0002ab02071596fa8d36f83e50cce0868983ca1cbeca35595a4b5635cedc7611 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0) 2024-09-13T17:25:08.229 INFO:journalctl@ceph.mgr.x.smithi087.stdout:Sep 13 17:25:08 smithi087 bash[101159]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-x 2024-09-13T17:25:08.446 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-13T17:25:08.483 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:25:08.483 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-13T17:25:08.484 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-13T17:25:08.484 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mgr.y 2024-09-13T17:25:08.839 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:25:08 smithi118 systemd[1]: Stopping Ceph mgr.y for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:25:09.113 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:25:08 smithi118 podman[70275]: 2024-09-13 17:25:08.839056582 +0000 UTC m=+0.162851265 container died fd5d227353d9c915ca4ad60b9a466defe0d46559fbb26c86c6bc8f6faaa0c7c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T17:25:09.497 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:25:09 smithi118 podman[70275]: 2024-09-13 17:25:09.252740535 +0000 UTC m=+0.576535211 container cleanup fd5d227353d9c915ca4ad60b9a466defe0d46559fbb26c86c6bc8f6faaa0c7c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-13T17:25:09.497 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:25:09 smithi118 bash[70275]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y 2024-09-13T17:25:09.748 DEBUG:teuthology.orchestra.run.smithi118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-13T17:25:09.770 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:25:09 smithi118 podman[70288]: 2024-09-13 17:25:09.496244647 +0000 UTC m=+0.648719180 container remove fd5d227353d9c915ca4ad60b9a466defe0d46559fbb26c86c6bc8f6faaa0c7c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-y, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-13T17:25:09.770 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:25:09 smithi118 systemd[1]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-09-13T17:25:09.770 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:25:09 smithi118 systemd[1]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mgr.y.service: Failed with result 'exit-code'. 2024-09-13T17:25:09.770 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:25:09 smithi118 systemd[1]: Stopped Ceph mgr.y for 043d5bae-71f2-11ef-bceb-c7b262605968. 2024-09-13T17:25:09.770 INFO:journalctl@ceph.mgr.y.smithi118.stdout:Sep 13 17:25:09 smithi118 systemd[1]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mgr.y.service: Consumed 11.316s CPU time. 2024-09-13T17:25:09.783 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:25:09.783 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-13T17:25:09.784 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-13T17:25:09.784 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mgr.z 2024-09-13T17:25:10.092 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:25:09 smithi149 systemd[1]: Stopping Ceph mgr.z for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:25:10.374 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:25:10 smithi149 podman[71846]: 2024-09-13 17:25:10.11493942 +0000 UTC m=+0.141363631 container died 5de72e2b7f589d5c5b6ea2f70002a8bf0cf9b71b1464f92c89b6defc5690378f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-13T17:25:10.842 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:25:10 smithi149 podman[71846]: 2024-09-13 17:25:10.519497659 +0000 UTC m=+0.545921871 container cleanup 5de72e2b7f589d5c5b6ea2f70002a8bf0cf9b71b1464f92c89b6defc5690378f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T17:25:10.842 INFO:journalctl@ceph.mgr.z.smithi149.stdout:Sep 13 17:25:10 smithi149 bash[71846]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mgr-z 2024-09-13T17:25:10.993 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-13T17:25:11.027 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:25:11.027 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-13T17:25:11.027 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-13T17:25:11.028 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.0 2024-09-13T17:25:11.330 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 13 17:25:11 smithi087 systemd[1]: Stopping Ceph osd.0 for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:25:11.729 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 13 17:25:11 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-0[45551]: 2024-09-13T17:25:11.328+0000 7f37bb1fe640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:25:11.729 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 13 17:25:11 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-0[45551]: 2024-09-13T17:25:11.328+0000 7f37bb1fe640 -1 osd.0 108 *** Got signal Terminated *** 2024-09-13T17:25:11.729 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 13 17:25:11 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-0[45551]: 2024-09-13T17:25:11.328+0000 7f37bb1fe640 -1 osd.0 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:25:17.215 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 13 17:25:16 smithi087 podman[101282]: 2024-09-13 17:25:16.888328372 +0000 UTC m=+5.666846129 container died fd608c9c07a216b3e45a732b9093cb4c5e9547231f2044117df17cb974d31046 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux ) 2024-09-13T17:25:17.479 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 13 17:25:17 smithi087 podman[101282]: 2024-09-13 17:25:17.296249852 +0000 UTC m=+6.074767599 container cleanup fd608c9c07a216b3e45a732b9093cb4c5e9547231f2044117df17cb974d31046 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-13T17:25:17.479 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 13 17:25:17 smithi087 bash[101282]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-0 2024-09-13T17:25:17.917 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 13 17:25:17 smithi087 podman[101297]: 2024-09-13 17:25:17.575008917 +0000 UTC m=+0.678758910 container remove fd608c9c07a216b3e45a732b9093cb4c5e9547231f2044117df17cb974d31046 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True) 2024-09-13T17:25:18.185 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 13 17:25:17 smithi087 podman[101391]: 2024-09-13 17:25:17.819075294 +0000 UTC m=+0.015858233 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:25:18.185 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 13 17:25:17 smithi087 podman[101391]: 2024-09-13 17:25:17.940653347 +0000 UTC m=+0.137436269 container create 0be623d6101c2540626af0f7f57e50ca2b10ace0d92f744dc447b5b40a28cc14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T17:25:18.479 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 13 17:25:18 smithi087 podman[101391]: 2024-09-13 17:25:18.184241382 +0000 UTC m=+0.381024331 container init 0be623d6101c2540626af0f7f57e50ca2b10ace0d92f744dc447b5b40a28cc14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0) 2024-09-13T17:25:18.479 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 13 17:25:18 smithi087 podman[101391]: 2024-09-13 17:25:18.187906106 +0000 UTC m=+0.384689027 container start 0be623d6101c2540626af0f7f57e50ca2b10ace0d92f744dc447b5b40a28cc14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:25:18.479 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 13 17:25:18 smithi087 podman[101391]: 2024-09-13 17:25:18.293020666 +0000 UTC m=+0.489803596 container attach 0be623d6101c2540626af0f7f57e50ca2b10ace0d92f744dc447b5b40a28cc14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T17:25:18.479 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 13 17:25:18 smithi087 podman[101391]: 2024-09-13 17:25:18.369484407 +0000 UTC m=+0.566267347 container died 0be623d6101c2540626af0f7f57e50ca2b10ace0d92f744dc447b5b40a28cc14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:25:18.997 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.0.service' 2024-09-13T17:25:19.036 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:25:19.036 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-13T17:25:19.036 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-13T17:25:19.037 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.1 2024-09-13T17:25:19.318 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 13 17:25:19 smithi118 systemd[1]: Stopping Ceph osd.1 for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:25:19.613 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 13 17:25:19 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-1[38870]: 2024-09-13T17:25:19.349+0000 7fc91b2b1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:25:19.613 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 13 17:25:19 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-1[38870]: 2024-09-13T17:25:19.349+0000 7fc91b2b1640 -1 osd.1 108 *** Got signal Terminated *** 2024-09-13T17:25:19.613 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 13 17:25:19 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-1[38870]: 2024-09-13T17:25:19.349+0000 7fc91b2b1640 -1 osd.1 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:25:25.113 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 13 17:25:24 smithi118 podman[70399]: 2024-09-13 17:25:24.790650387 +0000 UTC m=+5.552983666 container died 2c6df77dffa1c70c35e66c53fb4b8db0f7fb7ee20bd2bf85cdcce5916c6ba781 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-1, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-13T17:25:25.613 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 13 17:25:25 smithi118 podman[70399]: 2024-09-13 17:25:25.116400091 +0000 UTC m=+5.878733362 container cleanup 2c6df77dffa1c70c35e66c53fb4b8db0f7fb7ee20bd2bf85cdcce5916c6ba781 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-1, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-13T17:25:25.613 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 13 17:25:25 smithi118 bash[70399]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-1 2024-09-13T17:25:25.613 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 13 17:25:25 smithi118 podman[70425]: 2024-09-13 17:25:25.343264599 +0000 UTC m=+0.552633492 container remove 2c6df77dffa1c70c35e66c53fb4b8db0f7fb7ee20bd2bf85cdcce5916c6ba781 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-1, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:25:26.090 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 13 17:25:25 smithi118 podman[70516]: 2024-09-13 17:25:25.646711995 +0000 UTC m=+0.016141329 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:25:26.090 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 13 17:25:25 smithi118 podman[70516]: 2024-09-13 17:25:25.777600713 +0000 UTC m=+0.147030050 container create 3e99a99301689d4704c01579e9429d47e68f9443991769dff80091f9872eea97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-13T17:25:26.090 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 13 17:25:25 smithi118 podman[70516]: 2024-09-13 17:25:25.971941252 +0000 UTC m=+0.341370584 container init 3e99a99301689d4704c01579e9429d47e68f9443991769dff80091f9872eea97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:25:26.090 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 13 17:25:25 smithi118 podman[70516]: 2024-09-13 17:25:25.975418346 +0000 UTC m=+0.344847678 container start 3e99a99301689d4704c01579e9429d47e68f9443991769dff80091f9872eea97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:25:26.090 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 13 17:25:26 smithi118 podman[70516]: 2024-09-13 17:25:26.089608482 +0000 UTC m=+0.459037828 container attach 3e99a99301689d4704c01579e9429d47e68f9443991769dff80091f9872eea97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T17:25:26.363 INFO:journalctl@ceph.osd.1.smithi118.stdout:Sep 13 17:25:26 smithi118 podman[70539]: 2024-09-13 17:25:26.192531478 +0000 UTC m=+0.017030724 container died 3e99a99301689d4704c01579e9429d47e68f9443991769dff80091f9872eea97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:25:26.820 DEBUG:teuthology.orchestra.run.smithi118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.1.service' 2024-09-13T17:25:26.864 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:25:26.864 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-13T17:25:26.864 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-13T17:25:26.864 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.2 2024-09-13T17:25:27.183 INFO:journalctl@ceph.osd.2.smithi149.stdout:Sep 13 17:25:26 smithi149 systemd[1]: Stopping Ceph osd.2 for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:25:27.592 INFO:journalctl@ceph.osd.2.smithi149.stdout:Sep 13 17:25:27 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-2[40664]: 2024-09-13T17:25:27.182+0000 7fe79c331640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:25:27.592 INFO:journalctl@ceph.osd.2.smithi149.stdout:Sep 13 17:25:27 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-2[40664]: 2024-09-13T17:25:27.182+0000 7fe79c331640 -1 osd.2 108 *** Got signal Terminated *** 2024-09-13T17:25:27.592 INFO:journalctl@ceph.osd.2.smithi149.stdout:Sep 13 17:25:27 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-2[40664]: 2024-09-13T17:25:27.182+0000 7fe79c331640 -1 osd.2 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:25:32.825 INFO:journalctl@ceph.osd.2.smithi149.stdout:Sep 13 17:25:32 smithi149 podman[71968]: 2024-09-13 17:25:32.52362137 +0000 UTC m=+5.462201920 container died 752e681bbaa8303b710ea23eac384e55423be922f462141916086bbfc4e89cde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T17:25:33.092 INFO:journalctl@ceph.osd.2.smithi149.stdout:Sep 13 17:25:32 smithi149 podman[71968]: 2024-09-13 17:25:32.9234287 +0000 UTC m=+5.862009249 container cleanup 752e681bbaa8303b710ea23eac384e55423be922f462141916086bbfc4e89cde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-13T17:25:33.092 INFO:journalctl@ceph.osd.2.smithi149.stdout:Sep 13 17:25:32 smithi149 bash[71968]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-2 2024-09-13T17:25:33.542 INFO:journalctl@ceph.osd.2.smithi149.stdout:Sep 13 17:25:33 smithi149 podman[71982]: 2024-09-13 17:25:33.191890405 +0000 UTC m=+0.661786441 container remove 752e681bbaa8303b710ea23eac384e55423be922f462141916086bbfc4e89cde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-2, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS) 2024-09-13T17:25:33.838 INFO:journalctl@ceph.osd.2.smithi149.stdout:Sep 13 17:25:33 smithi149 podman[72069]: 2024-09-13 17:25:33.4447509 +0000 UTC m=+0.016513350 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:25:33.838 INFO:journalctl@ceph.osd.2.smithi149.stdout:Sep 13 17:25:33 smithi149 podman[72069]: 2024-09-13 17:25:33.559620733 +0000 UTC m=+0.131383171 container create 37e8a972abb159ff444f529efab8b2e5a3f60c9949bea8fdb7c214f848423f9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-13T17:25:34.092 INFO:journalctl@ceph.osd.2.smithi149.stdout:Sep 13 17:25:33 smithi149 podman[72069]: 2024-09-13 17:25:33.837430247 +0000 UTC m=+0.409192683 container init 37e8a972abb159ff444f529efab8b2e5a3f60c9949bea8fdb7c214f848423f9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-13T17:25:34.092 INFO:journalctl@ceph.osd.2.smithi149.stdout:Sep 13 17:25:33 smithi149 podman[72069]: 2024-09-13 17:25:33.841391631 +0000 UTC m=+0.413154076 container start 37e8a972abb159ff444f529efab8b2e5a3f60c9949bea8fdb7c214f848423f9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-13T17:25:34.093 INFO:journalctl@ceph.osd.2.smithi149.stdout:Sep 13 17:25:33 smithi149 podman[72069]: 2024-09-13 17:25:33.937367255 +0000 UTC m=+0.509129703 container attach 37e8a972abb159ff444f529efab8b2e5a3f60c9949bea8fdb7c214f848423f9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:25:34.093 INFO:journalctl@ceph.osd.2.smithi149.stdout:Sep 13 17:25:34 smithi149 podman[72069]: 2024-09-13 17:25:34.02992575 +0000 UTC m=+0.601688196 container died 37e8a972abb159ff444f529efab8b2e5a3f60c9949bea8fdb7c214f848423f9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-13T17:25:34.730 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.2.service' 2024-09-13T17:25:34.770 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:25:34.770 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-13T17:25:34.771 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-13T17:25:34.771 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.3 2024-09-13T17:25:35.078 INFO:journalctl@ceph.osd.3.smithi087.stdout:Sep 13 17:25:34 smithi087 systemd[1]: Stopping Ceph osd.3 for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:25:35.331 INFO:journalctl@ceph.osd.3.smithi087.stdout:Sep 13 17:25:35 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-3[52306]: 2024-09-13T17:25:35.077+0000 7f85b9ca8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:25:35.331 INFO:journalctl@ceph.osd.3.smithi087.stdout:Sep 13 17:25:35 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-3[52306]: 2024-09-13T17:25:35.077+0000 7f85b9ca8640 -1 osd.3 108 *** Got signal Terminated *** 2024-09-13T17:25:35.331 INFO:journalctl@ceph.osd.3.smithi087.stdout:Sep 13 17:25:35 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-3[52306]: 2024-09-13T17:25:35.077+0000 7f85b9ca8640 -1 osd.3 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:25:38.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:38 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:38.294+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:25:39.268 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:25:38 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:25:38.940+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:25:39.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:39 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:39.267+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:25:39.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:39 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:39.472+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:25:39.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:39 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:39.673+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:25:40.192 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:25:39 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:25:39.913+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:25:40.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:40 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:40.236+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:25:40.592 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:40 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5[47547]: 2024-09-13T17:25:40.191+0000 7f35162a3640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:13.391190+0000 front 2024-09-13T17:25:13.391149+0000 (oldest deadline 2024-09-13T17:25:39.290997+0000) 2024-09-13T17:25:40.805 INFO:journalctl@ceph.osd.3.smithi087.stdout:Sep 13 17:25:40 smithi087 podman[101494]: 2024-09-13 17:25:40.498379937 +0000 UTC m=+5.525229034 container died c24c7c736d1fac259da214d483ed9c5f8ca3850689dd6f97809ff0f66bba3897 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-3, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-13T17:25:40.805 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:40 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:40.649+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:25:40.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:40 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:40.423+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:25:41.108 INFO:journalctl@ceph.osd.3.smithi087.stdout:Sep 13 17:25:40 smithi087 podman[101494]: 2024-09-13 17:25:40.89472555 +0000 UTC m=+5.921574639 container cleanup c24c7c736d1fac259da214d483ed9c5f8ca3850689dd6f97809ff0f66bba3897 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-13T17:25:41.108 INFO:journalctl@ceph.osd.3.smithi087.stdout:Sep 13 17:25:40 smithi087 bash[101494]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-3 2024-09-13T17:25:41.212 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:41 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5[47547]: 2024-09-13T17:25:41.163+0000 7f35162a3640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:13.391190+0000 front 2024-09-13T17:25:13.391149+0000 (oldest deadline 2024-09-13T17:25:39.290997+0000) 2024-09-13T17:25:41.213 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:25:40 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:25:40.961+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:25:41.412 INFO:journalctl@ceph.osd.3.smithi087.stdout:Sep 13 17:25:41 smithi087 podman[101521]: 2024-09-13 17:25:41.104314013 +0000 UTC m=+0.606854415 container remove c24c7c736d1fac259da214d483ed9c5f8ca3850689dd6f97809ff0f66bba3897 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-13T17:25:41.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:41 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:41.211+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:25:41.724 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:41 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:41.643+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:25:41.725 INFO:journalctl@ceph.osd.3.smithi087.stdout:Sep 13 17:25:41 smithi087 podman[101613]: 2024-09-13 17:25:41.314443274 +0000 UTC m=+0.015631720 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:25:41.725 INFO:journalctl@ceph.osd.3.smithi087.stdout:Sep 13 17:25:41 smithi087 podman[101613]: 2024-09-13 17:25:41.457314777 +0000 UTC m=+0.158503210 container create 921831dd15eaed42fbe99d80b8d42a9a776181fb9cda892442f049a8cccc3163 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True) 2024-09-13T17:25:41.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:41 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:41.408+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:25:41.979 INFO:journalctl@ceph.osd.3.smithi087.stdout:Sep 13 17:25:41 smithi087 podman[101613]: 2024-09-13 17:25:41.724134663 +0000 UTC m=+0.425323106 container init 921831dd15eaed42fbe99d80b8d42a9a776181fb9cda892442f049a8cccc3163 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:25:41.979 INFO:journalctl@ceph.osd.3.smithi087.stdout:Sep 13 17:25:41 smithi087 podman[101613]: 2024-09-13 17:25:41.72760427 +0000 UTC m=+0.428792704 container start 921831dd15eaed42fbe99d80b8d42a9a776181fb9cda892442f049a8cccc3163 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:25:41.979 INFO:journalctl@ceph.osd.3.smithi087.stdout:Sep 13 17:25:41 smithi087 podman[101613]: 2024-09-13 17:25:41.825169576 +0000 UTC m=+0.526358036 container attach 921831dd15eaed42fbe99d80b8d42a9a776181fb9cda892442f049a8cccc3163 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-13T17:25:41.979 INFO:journalctl@ceph.osd.3.smithi087.stdout:Sep 13 17:25:41 smithi087 podman[101613]: 2024-09-13 17:25:41.908155966 +0000 UTC m=+0.609344411 container died 921831dd15eaed42fbe99d80b8d42a9a776181fb9cda892442f049a8cccc3163 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-13T17:25:42.342 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:25:41 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:25:41.970+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:25:42.342 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:42 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5[47547]: 2024-09-13T17:25:42.143+0000 7f35162a3640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:13.391190+0000 front 2024-09-13T17:25:13.391149+0000 (oldest deadline 2024-09-13T17:25:39.290997+0000) 2024-09-13T17:25:42.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:42 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:42.200+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:25:42.594 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.3.service' 2024-09-13T17:25:42.634 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:25:42.634 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-13T17:25:42.634 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-13T17:25:42.634 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.4 2024-09-13T17:25:42.863 INFO:journalctl@ceph.osd.4.smithi118.stdout:Sep 13 17:25:42 smithi118 systemd[1]: Stopping Ceph osd.4 for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:25:42.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:42 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:42.454+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:25:42.978 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:42 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:42.643+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:25:43.342 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:25:42 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:25:42.979+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:25:43.342 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:43 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5[47547]: 2024-09-13T17:25:43.124+0000 7f35162a3640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:13.391190+0000 front 2024-09-13T17:25:13.391149+0000 (oldest deadline 2024-09-13T17:25:39.290997+0000) 2024-09-13T17:25:43.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:43 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:43.203+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:25:43.365 INFO:journalctl@ceph.osd.4.smithi118.stdout:Sep 13 17:25:42 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-4[45770]: 2024-09-13T17:25:42.937+0000 7fde62bd2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:25:43.365 INFO:journalctl@ceph.osd.4.smithi118.stdout:Sep 13 17:25:42 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-4[45770]: 2024-09-13T17:25:42.937+0000 7fde62bd2640 -1 osd.4 108 *** Got signal Terminated *** 2024-09-13T17:25:43.365 INFO:journalctl@ceph.osd.4.smithi118.stdout:Sep 13 17:25:42 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-4[45770]: 2024-09-13T17:25:42.937+0000 7fde62bd2640 -1 osd.4 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:25:43.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:43 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:43.440+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:25:43.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:43 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:43.627+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:25:44.342 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:25:43 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:25:43.947+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:25:44.342 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:44 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5[47547]: 2024-09-13T17:25:44.081+0000 7f35162a3640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:13.391190+0000 front 2024-09-13T17:25:13.391149+0000 (oldest deadline 2024-09-13T17:25:39.290997+0000) 2024-09-13T17:25:44.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:44 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:44.180+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:25:44.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:44 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:44.427+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:25:44.978 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:44 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:44.672+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:25:45.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:25:44 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:25:44.962+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:25:45.592 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:45 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5[47547]: 2024-09-13T17:25:45.130+0000 7f35162a3640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:13.391190+0000 front 2024-09-13T17:25:13.391149+0000 (oldest deadline 2024-09-13T17:25:39.290997+0000) 2024-09-13T17:25:45.592 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:45 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5[47547]: 2024-09-13T17:25:45.130+0000 7f35162a3640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.291391+0000 front 2024-09-13T17:25:19.291434+0000 (oldest deadline 2024-09-13T17:25:45.091856+0000) 2024-09-13T17:25:45.593 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:45 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:45.149+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:25:45.593 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:45 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:45.149+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:25:45.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:45 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:45.426+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:25:45.979 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:25:45 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6[58766]: 2024-09-13T17:25:45.865+0000 7f915ed32640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.823948+0000 front 2024-09-13T17:25:23.823724+0000 (oldest deadline 2024-09-13T17:25:44.923611+0000) 2024-09-13T17:25:45.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:45 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:45.714+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:25:45.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:45 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:45.714+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:25:46.342 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:25:45 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:25:45.995+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:25:46.342 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:46 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5[47547]: 2024-09-13T17:25:46.158+0000 7f35162a3640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:13.391190+0000 front 2024-09-13T17:25:13.391149+0000 (oldest deadline 2024-09-13T17:25:39.290997+0000) 2024-09-13T17:25:46.342 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:46 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5[47547]: 2024-09-13T17:25:46.158+0000 7f35162a3640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.291391+0000 front 2024-09-13T17:25:19.291434+0000 (oldest deadline 2024-09-13T17:25:45.091856+0000) 2024-09-13T17:25:46.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:46 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:46.165+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:25:46.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:46 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:46.165+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:25:46.428 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:25:46 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:25:46.158+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.662524+0000 front 2024-09-13T17:25:19.662583+0000 (oldest deadline 2024-09-13T17:25:45.562601+0000) 2024-09-13T17:25:46.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:46 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:46.426+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:25:46.978 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:25:46 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6[58766]: 2024-09-13T17:25:46.872+0000 7f915ed32640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.823948+0000 front 2024-09-13T17:25:23.823724+0000 (oldest deadline 2024-09-13T17:25:44.923611+0000) 2024-09-13T17:25:46.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:46 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:46.707+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:25:46.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:46 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:46.707+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:25:47.342 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:25:46 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:25:46.953+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:25:47.342 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:47 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5[47547]: 2024-09-13T17:25:47.169+0000 7f35162a3640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:13.391190+0000 front 2024-09-13T17:25:13.391149+0000 (oldest deadline 2024-09-13T17:25:39.290997+0000) 2024-09-13T17:25:47.342 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:47 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5[47547]: 2024-09-13T17:25:47.169+0000 7f35162a3640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.291391+0000 front 2024-09-13T17:25:19.291434+0000 (oldest deadline 2024-09-13T17:25:45.091856+0000) 2024-09-13T17:25:47.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:47 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:47.201+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:25:47.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:47 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:47.201+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:25:47.362 INFO:journalctl@ceph.osd.4.smithi118.stdout:Sep 13 17:25:46 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-4[45770]: 2024-09-13T17:25:46.935+0000 7fde5b1de640 -1 osd.4 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:21.291733+0000 front 2024-09-13T17:25:21.291706+0000 (oldest deadline 2024-09-13T17:25:45.991857+0000) 2024-09-13T17:25:47.363 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:25:47 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:25:47.138+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.662524+0000 front 2024-09-13T17:25:19.662583+0000 (oldest deadline 2024-09-13T17:25:45.562601+0000) 2024-09-13T17:25:47.865 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:47 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:47.443+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:25:48.185 INFO:journalctl@ceph.osd.4.smithi118.stdout:Sep 13 17:25:47 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-4[45770]: 2024-09-13T17:25:47.930+0000 7fde5b1de640 -1 osd.4 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:21.291733+0000 front 2024-09-13T17:25:21.291706+0000 (oldest deadline 2024-09-13T17:25:45.991857+0000) 2024-09-13T17:25:48.187 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:25:47 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:25:47.903+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:25:48.228 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:25:47 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6[58766]: 2024-09-13T17:25:47.912+0000 7f915ed32640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.823948+0000 front 2024-09-13T17:25:23.823724+0000 (oldest deadline 2024-09-13T17:25:44.923611+0000) 2024-09-13T17:25:48.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:47 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:47.732+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:25:48.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:47 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:47.732+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:25:48.448 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:25:48 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:25:48.183+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.662524+0000 front 2024-09-13T17:25:19.662583+0000 (oldest deadline 2024-09-13T17:25:45.562601+0000) 2024-09-13T17:25:48.592 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:48 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5[47547]: 2024-09-13T17:25:48.198+0000 7f35162a3640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:13.391190+0000 front 2024-09-13T17:25:13.391149+0000 (oldest deadline 2024-09-13T17:25:39.290997+0000) 2024-09-13T17:25:48.592 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:48 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5[47547]: 2024-09-13T17:25:48.198+0000 7f35162a3640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.291391+0000 front 2024-09-13T17:25:19.291434+0000 (oldest deadline 2024-09-13T17:25:45.091856+0000) 2024-09-13T17:25:48.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:48 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:48.185+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:25:48.593 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:48 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:48.185+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:25:48.840 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:48 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:48.449+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:25:48.840 INFO:journalctl@ceph.osd.4.smithi118.stdout:Sep 13 17:25:48 smithi118 podman[70618]: 2024-09-13 17:25:48.485689335 +0000 UTC m=+5.655768597 container died 794c2476431fccdc6a251c679e0ef5b719aed2d96635db288f1212144a096ef6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T17:25:48.962 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:48 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:48.701+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:25:48.962 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:48 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:48.701+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:25:49.113 INFO:journalctl@ceph.osd.4.smithi118.stdout:Sep 13 17:25:48 smithi118 podman[70618]: 2024-09-13 17:25:48.937916826 +0000 UTC m=+6.107996087 container cleanup 794c2476431fccdc6a251c679e0ef5b719aed2d96635db288f1212144a096ef6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2) 2024-09-13T17:25:49.113 INFO:journalctl@ceph.osd.4.smithi118.stdout:Sep 13 17:25:48 smithi118 bash[70618]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-4 2024-09-13T17:25:49.177 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:25:48 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:25:48.894+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:25:49.229 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:25:48 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6[58766]: 2024-09-13T17:25:48.961+0000 7f915ed32640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.823948+0000 front 2024-09-13T17:25:23.823724+0000 (oldest deadline 2024-09-13T17:25:44.923611+0000) 2024-09-13T17:25:49.446 INFO:journalctl@ceph.osd.4.smithi118.stdout:Sep 13 17:25:49 smithi118 podman[70636]: 2024-09-13 17:25:49.222843912 +0000 UTC m=+0.734831159 container remove 794c2476431fccdc6a251c679e0ef5b719aed2d96635db288f1212144a096ef6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T17:25:49.447 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:25:49 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:25:49.143+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.662524+0000 front 2024-09-13T17:25:19.662583+0000 (oldest deadline 2024-09-13T17:25:45.562601+0000) 2024-09-13T17:25:49.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:49 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:49.175+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:25:49.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:49 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:49.175+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:25:49.592 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:49 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5[47547]: 2024-09-13T17:25:49.224+0000 7f35162a3640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:13.391190+0000 front 2024-09-13T17:25:13.391149+0000 (oldest deadline 2024-09-13T17:25:39.290997+0000) 2024-09-13T17:25:49.593 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:49 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5[47547]: 2024-09-13T17:25:49.224+0000 7f35162a3640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.291391+0000 front 2024-09-13T17:25:19.291434+0000 (oldest deadline 2024-09-13T17:25:45.091856+0000) 2024-09-13T17:25:49.709 INFO:journalctl@ceph.osd.4.smithi118.stdout:Sep 13 17:25:49 smithi118 podman[70732]: 2024-09-13 17:25:49.44455367 +0000 UTC m=+0.016329261 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:25:49.709 INFO:journalctl@ceph.osd.4.smithi118.stdout:Sep 13 17:25:49 smithi118 podman[70732]: 2024-09-13 17:25:49.56555887 +0000 UTC m=+0.137334463 container create bb202563a6f6cb68280223cc495632756fe9131476ca818b224a38dc1ce79597 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:25:49.710 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:49 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:49.444+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:25:49.710 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:49 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:49.444+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:25:49.941 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:49 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:49.654+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:25:49.941 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:49 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:49.654+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:25:50.113 INFO:journalctl@ceph.osd.4.smithi118.stdout:Sep 13 17:25:49 smithi118 podman[70732]: 2024-09-13 17:25:49.801679179 +0000 UTC m=+0.373454769 container init bb202563a6f6cb68280223cc495632756fe9131476ca818b224a38dc1ce79597 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True) 2024-09-13T17:25:50.113 INFO:journalctl@ceph.osd.4.smithi118.stdout:Sep 13 17:25:49 smithi118 podman[70732]: 2024-09-13 17:25:49.805392381 +0000 UTC m=+0.377167979 container start bb202563a6f6cb68280223cc495632756fe9131476ca818b224a38dc1ce79597 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T17:25:50.113 INFO:journalctl@ceph.osd.4.smithi118.stdout:Sep 13 17:25:49 smithi118 podman[70732]: 2024-09-13 17:25:49.885015715 +0000 UTC m=+0.456791310 container attach bb202563a6f6cb68280223cc495632756fe9131476ca818b224a38dc1ce79597 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T17:25:50.113 INFO:journalctl@ceph.osd.4.smithi118.stdout:Sep 13 17:25:49 smithi118 podman[70732]: 2024-09-13 17:25:49.995617001 +0000 UTC m=+0.567392592 container died bb202563a6f6cb68280223cc495632756fe9131476ca818b224a38dc1ce79597 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-13T17:25:50.193 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:25:49 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:25:49.878+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:25:50.228 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:25:49 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6[58766]: 2024-09-13T17:25:49.940+0000 7f915ed32640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.823948+0000 front 2024-09-13T17:25:23.823724+0000 (oldest deadline 2024-09-13T17:25:44.923611+0000) 2024-09-13T17:25:50.468 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:25:50 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:25:50.172+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.662524+0000 front 2024-09-13T17:25:19.662583+0000 (oldest deadline 2024-09-13T17:25:45.562601+0000) 2024-09-13T17:25:50.592 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:50 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5[47547]: 2024-09-13T17:25:50.236+0000 7f35162a3640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:13.391190+0000 front 2024-09-13T17:25:13.391149+0000 (oldest deadline 2024-09-13T17:25:39.290997+0000) 2024-09-13T17:25:50.592 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:50 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5[47547]: 2024-09-13T17:25:50.236+0000 7f35162a3640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.291391+0000 front 2024-09-13T17:25:19.291434+0000 (oldest deadline 2024-09-13T17:25:45.091856+0000) 2024-09-13T17:25:50.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:50 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:50.191+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:25:50.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:50 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:50.191+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:25:50.713 DEBUG:teuthology.orchestra.run.smithi118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.4.service' 2024-09-13T17:25:50.737 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:50 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:50.467+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:25:50.737 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:50 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:50.467+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:25:50.737 INFO:journalctl@ceph.osd.4.smithi118.stdout:Sep 13 17:25:50 smithi118 podman[70757]: 2024-09-13 17:25:50.689709055 +0000 UTC m=+0.687638560 container remove bb202563a6f6cb68280223cc495632756fe9131476ca818b224a38dc1ce79597 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-13T17:25:50.737 INFO:journalctl@ceph.osd.4.smithi118.stdout:Sep 13 17:25:50 smithi118 systemd[1]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-13T17:25:50.737 INFO:journalctl@ceph.osd.4.smithi118.stdout:Sep 13 17:25:50 smithi118 systemd[1]: Stopped Ceph osd.4 for 043d5bae-71f2-11ef-bceb-c7b262605968. 2024-09-13T17:25:50.737 INFO:journalctl@ceph.osd.4.smithi118.stdout:Sep 13 17:25:50 smithi118 systemd[1]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.4.service: Consumed 46.530s CPU time. 2024-09-13T17:25:50.753 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:25:50.753 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-13T17:25:50.753 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-13T17:25:50.753 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.5 2024-09-13T17:25:50.970 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:50 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:50.659+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:25:50.971 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:50 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:50.659+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:25:51.087 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:50 smithi149 systemd[1]: Stopping Ceph osd.5 for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:25:51.087 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:25:50 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:25:50.839+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:25:51.228 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:25:50 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6[58766]: 2024-09-13T17:25:50.970+0000 7f915ed32640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.823948+0000 front 2024-09-13T17:25:23.823724+0000 (oldest deadline 2024-09-13T17:25:44.923611+0000) 2024-09-13T17:25:51.345 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:51 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:51.172+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:25:51.345 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:51 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:51.172+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:25:51.345 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:51 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5[47547]: 2024-09-13T17:25:51.085+0000 7f351dc97640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:25:51.345 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:51 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5[47547]: 2024-09-13T17:25:51.085+0000 7f351dc97640 -1 osd.5 108 *** Got signal Terminated *** 2024-09-13T17:25:51.345 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:51 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5[47547]: 2024-09-13T17:25:51.085+0000 7f351dc97640 -1 osd.5 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:25:51.345 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:51 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5[47547]: 2024-09-13T17:25:51.194+0000 7f35162a3640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:13.391190+0000 front 2024-09-13T17:25:13.391149+0000 (oldest deadline 2024-09-13T17:25:39.290997+0000) 2024-09-13T17:25:51.345 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:51 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5[47547]: 2024-09-13T17:25:51.194+0000 7f35162a3640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.291391+0000 front 2024-09-13T17:25:19.291434+0000 (oldest deadline 2024-09-13T17:25:45.091856+0000) 2024-09-13T17:25:51.452 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:25:51 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:25:51.136+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.662524+0000 front 2024-09-13T17:25:19.662583+0000 (oldest deadline 2024-09-13T17:25:45.562601+0000) 2024-09-13T17:25:51.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:51 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:51.451+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:25:51.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:51 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:51.451+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:25:51.949 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:51 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:51.637+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:25:51.950 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:51 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:51.637+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:25:52.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:25:51 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:25:51.838+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:25:52.228 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:25:51 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6[58766]: 2024-09-13T17:25:51.949+0000 7f915ed32640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.823948+0000 front 2024-09-13T17:25:23.823724+0000 (oldest deadline 2024-09-13T17:25:44.923611+0000) 2024-09-13T17:25:52.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:52 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:52.123+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:25:52.593 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:52 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:52.123+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:25:52.593 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:52 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5[47547]: 2024-09-13T17:25:52.148+0000 7f35162a3640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:13.391190+0000 front 2024-09-13T17:25:13.391149+0000 (oldest deadline 2024-09-13T17:25:39.290997+0000) 2024-09-13T17:25:52.593 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:52 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5[47547]: 2024-09-13T17:25:52.148+0000 7f35162a3640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.291391+0000 front 2024-09-13T17:25:19.291434+0000 (oldest deadline 2024-09-13T17:25:45.091856+0000) 2024-09-13T17:25:52.613 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:25:52 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:25:52.181+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.662524+0000 front 2024-09-13T17:25:19.662583+0000 (oldest deadline 2024-09-13T17:25:45.562601+0000) 2024-09-13T17:25:52.613 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:52 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:52.404+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:25:52.613 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:52 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:52.404+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:25:52.939 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:52 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:52.648+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:25:52.939 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:52 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:52.648+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:25:53.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:25:52 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:25:52.825+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:25:53.228 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:25:52 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6[58766]: 2024-09-13T17:25:52.939+0000 7f915ed32640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.823948+0000 front 2024-09-13T17:25:23.823724+0000 (oldest deadline 2024-09-13T17:25:44.923611+0000) 2024-09-13T17:25:53.430 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:25:53 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:25:53.173+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.662524+0000 front 2024-09-13T17:25:19.662583+0000 (oldest deadline 2024-09-13T17:25:45.562601+0000) 2024-09-13T17:25:53.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:53 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:53.135+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:25:53.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:53 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:53.135+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:25:53.592 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:53 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5[47547]: 2024-09-13T17:25:53.158+0000 7f35162a3640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:13.391190+0000 front 2024-09-13T17:25:13.391149+0000 (oldest deadline 2024-09-13T17:25:39.290997+0000) 2024-09-13T17:25:53.592 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:53 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5[47547]: 2024-09-13T17:25:53.158+0000 7f35162a3640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.291391+0000 front 2024-09-13T17:25:19.291434+0000 (oldest deadline 2024-09-13T17:25:45.091856+0000) 2024-09-13T17:25:53.592 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:53 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5[47547]: 2024-09-13T17:25:53.158+0000 7f35162a3640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:28.592749+0000 front 2024-09-13T17:25:28.592731+0000 (oldest deadline 2024-09-13T17:25:52.692954+0000) 2024-09-13T17:25:53.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:53 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:53.428+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:25:53.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:53 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:53.428+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:25:53.978 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:25:53 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6[58766]: 2024-09-13T17:25:53.945+0000 7f915ed32640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.823948+0000 front 2024-09-13T17:25:23.823724+0000 (oldest deadline 2024-09-13T17:25:44.923611+0000) 2024-09-13T17:25:53.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:53 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:53.696+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:25:53.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:53 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:53.696+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:25:54.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:25:53 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:25:53.812+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:25:54.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:25:53 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:25:53.812+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:28.149115+0000 front 2024-09-13T17:25:28.149206+0000 (oldest deadline 2024-09-13T17:25:53.449208+0000) 2024-09-13T17:25:54.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:54 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:54.111+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:25:54.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:54 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:54.111+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:25:54.592 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:54 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5[47547]: 2024-09-13T17:25:54.195+0000 7f35162a3640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:13.391190+0000 front 2024-09-13T17:25:13.391149+0000 (oldest deadline 2024-09-13T17:25:39.290997+0000) 2024-09-13T17:25:54.592 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:54 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5[47547]: 2024-09-13T17:25:54.195+0000 7f35162a3640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.291391+0000 front 2024-09-13T17:25:19.291434+0000 (oldest deadline 2024-09-13T17:25:45.091856+0000) 2024-09-13T17:25:54.592 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:54 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5[47547]: 2024-09-13T17:25:54.195+0000 7f35162a3640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:28.592749+0000 front 2024-09-13T17:25:28.592731+0000 (oldest deadline 2024-09-13T17:25:52.692954+0000) 2024-09-13T17:25:54.613 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:25:54 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:25:54.209+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.662524+0000 front 2024-09-13T17:25:19.662583+0000 (oldest deadline 2024-09-13T17:25:45.562601+0000) 2024-09-13T17:25:54.613 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:54 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:54.406+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:25:54.613 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:54 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:54.406+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:25:54.936 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:54 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:54.672+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:25:54.936 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:54 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:54.672+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:25:55.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:25:54 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:25:54.783+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:25:55.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:25:54 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:25:54.783+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:28.149115+0000 front 2024-09-13T17:25:28.149206+0000 (oldest deadline 2024-09-13T17:25:53.449208+0000) 2024-09-13T17:25:55.229 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:25:54 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6[58766]: 2024-09-13T17:25:54.935+0000 7f915ed32640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.823948+0000 front 2024-09-13T17:25:23.823724+0000 (oldest deadline 2024-09-13T17:25:44.923611+0000) 2024-09-13T17:25:55.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:55 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:55.106+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:25:55.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:55 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:55.106+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:25:55.592 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:55 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5[47547]: 2024-09-13T17:25:55.220+0000 7f35162a3640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:13.391190+0000 front 2024-09-13T17:25:13.391149+0000 (oldest deadline 2024-09-13T17:25:39.290997+0000) 2024-09-13T17:25:55.593 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:55 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5[47547]: 2024-09-13T17:25:55.220+0000 7f35162a3640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.291391+0000 front 2024-09-13T17:25:19.291434+0000 (oldest deadline 2024-09-13T17:25:45.091856+0000) 2024-09-13T17:25:55.593 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:55 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5[47547]: 2024-09-13T17:25:55.220+0000 7f35162a3640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:28.592749+0000 front 2024-09-13T17:25:28.592731+0000 (oldest deadline 2024-09-13T17:25:52.692954+0000) 2024-09-13T17:25:55.613 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:25:55 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:25:55.244+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.662524+0000 front 2024-09-13T17:25:19.662583+0000 (oldest deadline 2024-09-13T17:25:45.562601+0000) 2024-09-13T17:25:55.613 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:55 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:55.387+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:25:55.613 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:55 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:55.387+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:25:55.613 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:55 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:55.387+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:25:55.979 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:25:55 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6[58766]: 2024-09-13T17:25:55.940+0000 7f915ed32640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.823948+0000 front 2024-09-13T17:25:23.823724+0000 (oldest deadline 2024-09-13T17:25:44.923611+0000) 2024-09-13T17:25:55.979 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:25:55 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6[58766]: 2024-09-13T17:25:55.940+0000 7f915ed32640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.224883+0000 front 2024-09-13T17:25:30.224769+0000 (oldest deadline 2024-09-13T17:25:55.524740+0000) 2024-09-13T17:25:55.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:55 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:55.717+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:25:55.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:55 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:55.717+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:25:55.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:55 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:55.717+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.603893+0000 front 2024-09-13T17:25:30.604012+0000 (oldest deadline 2024-09-13T17:25:55.303884+0000) 2024-09-13T17:25:56.080 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:25:55 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:25:55.788+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:25:56.080 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:25:55 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:25:55.788+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:28.149115+0000 front 2024-09-13T17:25:28.149206+0000 (oldest deadline 2024-09-13T17:25:53.449208+0000) 2024-09-13T17:25:56.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:56 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:56.078+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:25:56.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:56 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:56.078+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:25:56.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:56 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:56.078+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:25:56.613 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:25:56 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:25:56.244+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.662524+0000 front 2024-09-13T17:25:19.662583+0000 (oldest deadline 2024-09-13T17:25:45.562601+0000) 2024-09-13T17:25:56.613 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:25:56 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:25:56.244+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:31.964336+0000 front 2024-09-13T17:25:31.964397+0000 (oldest deadline 2024-09-13T17:25:56.064269+0000) 2024-09-13T17:25:56.613 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:56 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:56.388+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:25:56.613 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:56 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:56.388+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:25:56.613 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:56 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:56.388+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:25:56.770 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:56 smithi149 podman[72184]: 2024-09-13 17:25:56.495877602 +0000 UTC m=+5.539819175 container died 821f46df966a83542f7301ff03d98b3bf2c587d30d686ac4b638a9bbfd54c02a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-13T17:25:56.979 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:25:56 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6[58766]: 2024-09-13T17:25:56.953+0000 7f915ed32640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.823948+0000 front 2024-09-13T17:25:23.823724+0000 (oldest deadline 2024-09-13T17:25:44.923611+0000) 2024-09-13T17:25:56.979 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:25:56 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6[58766]: 2024-09-13T17:25:56.953+0000 7f915ed32640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.224883+0000 front 2024-09-13T17:25:30.224769+0000 (oldest deadline 2024-09-13T17:25:55.524740+0000) 2024-09-13T17:25:56.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:56 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:56.725+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:25:56.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:56 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:56.725+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:25:56.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:56 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:56.725+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.603893+0000 front 2024-09-13T17:25:30.604012+0000 (oldest deadline 2024-09-13T17:25:55.303884+0000) 2024-09-13T17:25:57.080 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:56 smithi149 podman[72184]: 2024-09-13 17:25:56.894361017 +0000 UTC m=+5.938302580 container cleanup 821f46df966a83542f7301ff03d98b3bf2c587d30d686ac4b638a9bbfd54c02a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-13T17:25:57.080 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:56 smithi149 bash[72184]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5 2024-09-13T17:25:57.081 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:25:56 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:25:56.799+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:25:57.081 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:25:56 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:25:56.799+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:28.149115+0000 front 2024-09-13T17:25:28.149206+0000 (oldest deadline 2024-09-13T17:25:53.449208+0000) 2024-09-13T17:25:57.342 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:57 smithi149 podman[72199]: 2024-09-13 17:25:57.095757094 +0000 UTC m=+0.597897513 container remove 821f46df966a83542f7301ff03d98b3bf2c587d30d686ac4b638a9bbfd54c02a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-13T17:25:57.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:57 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:57.078+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:25:57.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:57 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:57.078+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:25:57.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:57 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:57.078+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:25:57.613 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:25:57 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:25:57.206+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.662524+0000 front 2024-09-13T17:25:19.662583+0000 (oldest deadline 2024-09-13T17:25:45.562601+0000) 2024-09-13T17:25:57.613 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:25:57 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:25:57.206+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:31.964336+0000 front 2024-09-13T17:25:31.964397+0000 (oldest deadline 2024-09-13T17:25:56.064269+0000) 2024-09-13T17:25:57.613 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:57 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:57.436+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:25:57.613 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:57 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:57.436+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:25:57.613 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:57 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:57.436+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:25:57.683 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:57 smithi149 podman[72289]: 2024-09-13 17:25:57.310777949 +0000 UTC m=+0.016158191 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:25:57.683 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:57 smithi149 podman[72289]: 2024-09-13 17:25:57.413280473 +0000 UTC m=+0.118660758 container create d39e763244babb5c20f887f15a87a06e2c5c6ebedbcb2c64307a3c0a13c1c72c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-13T17:25:57.683 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:57 smithi149 podman[72289]: 2024-09-13 17:25:57.682704466 +0000 UTC m=+0.388084706 container init d39e763244babb5c20f887f15a87a06e2c5c6ebedbcb2c64307a3c0a13c1c72c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:25:58.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:25:57 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:25:57.749+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:25:58.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:25:57 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:25:57.749+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:28.149115+0000 front 2024-09-13T17:25:28.149206+0000 (oldest deadline 2024-09-13T17:25:53.449208+0000) 2024-09-13T17:25:58.093 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:57 smithi149 podman[72289]: 2024-09-13 17:25:57.686180521 +0000 UTC m=+0.391560763 container start d39e763244babb5c20f887f15a87a06e2c5c6ebedbcb2c64307a3c0a13c1c72c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2) 2024-09-13T17:25:58.093 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:57 smithi149 podman[72289]: 2024-09-13 17:25:57.782691419 +0000 UTC m=+0.488071667 container attach d39e763244babb5c20f887f15a87a06e2c5c6ebedbcb2c64307a3c0a13c1c72c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-13T17:25:58.093 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 17:25:57 smithi149 podman[72289]: 2024-09-13 17:25:57.878732624 +0000 UTC m=+0.584112863 container died d39e763244babb5c20f887f15a87a06e2c5c6ebedbcb2c64307a3c0a13c1c72c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0) 2024-09-13T17:25:58.229 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:25:57 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6[58766]: 2024-09-13T17:25:57.996+0000 7f915ed32640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.823948+0000 front 2024-09-13T17:25:23.823724+0000 (oldest deadline 2024-09-13T17:25:44.923611+0000) 2024-09-13T17:25:58.229 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:25:57 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6[58766]: 2024-09-13T17:25:57.996+0000 7f915ed32640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.224883+0000 front 2024-09-13T17:25:30.224769+0000 (oldest deadline 2024-09-13T17:25:55.524740+0000) 2024-09-13T17:25:58.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:57 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:57.771+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:25:58.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:57 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:57.771+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:25:58.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:57 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:57.771+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.603893+0000 front 2024-09-13T17:25:30.604012+0000 (oldest deadline 2024-09-13T17:25:55.303884+0000) 2024-09-13T17:25:58.438 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:25:58 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:25:58.186+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.662524+0000 front 2024-09-13T17:25:19.662583+0000 (oldest deadline 2024-09-13T17:25:45.562601+0000) 2024-09-13T17:25:58.438 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:25:58 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:25:58.186+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:31.964336+0000 front 2024-09-13T17:25:31.964397+0000 (oldest deadline 2024-09-13T17:25:56.064269+0000) 2024-09-13T17:25:58.438 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:58 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:58.436+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:25:58.487 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:58 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:58.092+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:25:58.487 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:58 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:58.092+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:25:58.487 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:58 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:58.092+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:25:58.517 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.5.service' 2024-09-13T17:25:58.555 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:25:58.556 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-13T17:25:58.556 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-13T17:25:58.556 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.6 2024-09-13T17:25:58.842 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:25:58 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:25:58.719+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:25:58.842 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:25:58 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:25:58.719+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:28.149115+0000 front 2024-09-13T17:25:28.149206+0000 (oldest deadline 2024-09-13T17:25:53.449208+0000) 2024-09-13T17:25:58.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:58 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:58.436+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:25:58.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:58 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:58.436+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:25:58.870 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:25:58 smithi087 systemd[1]: Stopping Ceph osd.6 for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:25:58.870 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:58 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:58.730+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:25:58.871 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:58 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:58.730+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:25:58.871 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:58 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:58.730+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.603893+0000 front 2024-09-13T17:25:30.604012+0000 (oldest deadline 2024-09-13T17:25:55.303884+0000) 2024-09-13T17:25:59.229 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:25:58 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6[58766]: 2024-09-13T17:25:58.868+0000 7f916271e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:25:59.229 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:25:58 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6[58766]: 2024-09-13T17:25:58.868+0000 7f916271e640 -1 osd.6 108 *** Got signal Terminated *** 2024-09-13T17:25:59.229 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:25:58 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6[58766]: 2024-09-13T17:25:58.868+0000 7f916271e640 -1 osd.6 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:25:59.229 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:25:58 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6[58766]: 2024-09-13T17:25:58.992+0000 7f915ed32640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.823948+0000 front 2024-09-13T17:25:23.823724+0000 (oldest deadline 2024-09-13T17:25:44.923611+0000) 2024-09-13T17:25:59.229 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:25:58 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6[58766]: 2024-09-13T17:25:58.992+0000 7f915ed32640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.224883+0000 front 2024-09-13T17:25:30.224769+0000 (oldest deadline 2024-09-13T17:25:55.524740+0000) 2024-09-13T17:25:59.363 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:25:59 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:25:59.145+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.662524+0000 front 2024-09-13T17:25:19.662583+0000 (oldest deadline 2024-09-13T17:25:45.562601+0000) 2024-09-13T17:25:59.363 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:25:59 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:25:59.145+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:31.964336+0000 front 2024-09-13T17:25:31.964397+0000 (oldest deadline 2024-09-13T17:25:56.064269+0000) 2024-09-13T17:25:59.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:59 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:59.109+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:25:59.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:59 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:59.109+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:25:59.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:25:59 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:25:59.109+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:25:59.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:59 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:59.481+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:25:59.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:59 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:59.481+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:25:59.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:25:59 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:25:59.481+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:25:59.978 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:59 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:59.693+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:25:59.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:59 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:59.693+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:25:59.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:25:59 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:25:59.693+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.603893+0000 front 2024-09-13T17:25:30.604012+0000 (oldest deadline 2024-09-13T17:25:55.303884+0000) 2024-09-13T17:26:00.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:25:59 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:25:59.760+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:26:00.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:25:59 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:25:59.760+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:28.149115+0000 front 2024-09-13T17:25:28.149206+0000 (oldest deadline 2024-09-13T17:25:53.449208+0000) 2024-09-13T17:26:00.479 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:26:00 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6[58766]: 2024-09-13T17:26:00.033+0000 7f915ed32640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.823948+0000 front 2024-09-13T17:25:23.823724+0000 (oldest deadline 2024-09-13T17:25:44.923611+0000) 2024-09-13T17:26:00.479 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:26:00 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6[58766]: 2024-09-13T17:26:00.033+0000 7f915ed32640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.224883+0000 front 2024-09-13T17:25:30.224769+0000 (oldest deadline 2024-09-13T17:25:55.524740+0000) 2024-09-13T17:26:00.524 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:00 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:26:00.169+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.662524+0000 front 2024-09-13T17:25:19.662583+0000 (oldest deadline 2024-09-13T17:25:45.562601+0000) 2024-09-13T17:26:00.525 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:00 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:26:00.169+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:31.964336+0000 front 2024-09-13T17:25:31.964397+0000 (oldest deadline 2024-09-13T17:25:56.064269+0000) 2024-09-13T17:26:00.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:00 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:00.133+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:00.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:00 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:00.133+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:00.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:00 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:00.133+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:00.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:00 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:00.523+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:26:00.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:00 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:00.523+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:26:00.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:00 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:00.523+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:26:00.978 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:00 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:00.671+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:26:00.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:00 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:00.671+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:26:00.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:00 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:00.671+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.603893+0000 front 2024-09-13T17:25:30.604012+0000 (oldest deadline 2024-09-13T17:25:55.303884+0000) 2024-09-13T17:26:01.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:00 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:00.810+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:26:01.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:00 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:00.810+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:28.149115+0000 front 2024-09-13T17:25:28.149206+0000 (oldest deadline 2024-09-13T17:25:53.449208+0000) 2024-09-13T17:26:01.479 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:26:01 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6[58766]: 2024-09-13T17:26:01.001+0000 7f915ed32640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.823948+0000 front 2024-09-13T17:25:23.823724+0000 (oldest deadline 2024-09-13T17:25:44.923611+0000) 2024-09-13T17:26:01.479 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:26:01 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6[58766]: 2024-09-13T17:26:01.001+0000 7f915ed32640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.224883+0000 front 2024-09-13T17:25:30.224769+0000 (oldest deadline 2024-09-13T17:25:55.524740+0000) 2024-09-13T17:26:01.507 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:01 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:26:01.178+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.662524+0000 front 2024-09-13T17:25:19.662583+0000 (oldest deadline 2024-09-13T17:25:45.562601+0000) 2024-09-13T17:26:01.507 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:01 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:26:01.178+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:31.964336+0000 front 2024-09-13T17:25:31.964397+0000 (oldest deadline 2024-09-13T17:25:56.064269+0000) 2024-09-13T17:26:01.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:01 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:01.112+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:01.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:01 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:01.112+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:01.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:01 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:01.112+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:01.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:01 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:01.506+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:26:01.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:01 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:01.506+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:26:01.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:01 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:01.506+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:26:01.978 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:01 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:01.647+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:26:01.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:01 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:01.647+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:26:01.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:01 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:01.647+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.603893+0000 front 2024-09-13T17:25:30.604012+0000 (oldest deadline 2024-09-13T17:25:55.303884+0000) 2024-09-13T17:26:02.119 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:01 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:01.851+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:26:02.119 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:01 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:01.851+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:28.149115+0000 front 2024-09-13T17:25:28.149206+0000 (oldest deadline 2024-09-13T17:25:53.449208+0000) 2024-09-13T17:26:02.401 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:02 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:02.117+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:02.401 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:02 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:02.117+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:02.401 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:02 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:02.117+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:02.463 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:02 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:26:02.203+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.662524+0000 front 2024-09-13T17:25:19.662583+0000 (oldest deadline 2024-09-13T17:25:45.562601+0000) 2024-09-13T17:26:02.463 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:02 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:26:02.203+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:31.964336+0000 front 2024-09-13T17:25:31.964397+0000 (oldest deadline 2024-09-13T17:25:56.064269+0000) 2024-09-13T17:26:02.478 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:26:02 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6[58766]: 2024-09-13T17:26:02.007+0000 7f915ed32640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.823948+0000 front 2024-09-13T17:25:23.823724+0000 (oldest deadline 2024-09-13T17:25:44.923611+0000) 2024-09-13T17:26:02.478 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:26:02 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6[58766]: 2024-09-13T17:26:02.007+0000 7f915ed32640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.224883+0000 front 2024-09-13T17:25:30.224769+0000 (oldest deadline 2024-09-13T17:25:55.524740+0000) 2024-09-13T17:26:02.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:02 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:02.461+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:26:02.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:02 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:02.461+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:26:02.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:02 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:02.461+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:26:02.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:02 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:02.658+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:26:02.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:02 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:02.658+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:26:02.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:02 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:02.658+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.603893+0000 front 2024-09-13T17:25:30.604012+0000 (oldest deadline 2024-09-13T17:25:55.303884+0000) 2024-09-13T17:26:02.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:02 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:02.658+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.204922+0000 front 2024-09-13T17:25:38.204952+0000 (oldest deadline 2024-09-13T17:26:02.305011+0000) 2024-09-13T17:26:03.140 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:02 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:02.861+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:26:03.141 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:02 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:02.861+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:28.149115+0000 front 2024-09-13T17:25:28.149206+0000 (oldest deadline 2024-09-13T17:25:53.449208+0000) 2024-09-13T17:26:03.141 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:02 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:02.861+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.650900+0000 front 2024-09-13T17:25:38.650973+0000 (oldest deadline 2024-09-13T17:26:02.150700+0000) 2024-09-13T17:26:03.460 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:03 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:26:03.198+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.662524+0000 front 2024-09-13T17:25:19.662583+0000 (oldest deadline 2024-09-13T17:25:45.562601+0000) 2024-09-13T17:26:03.460 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:03 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:26:03.198+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:31.964336+0000 front 2024-09-13T17:25:31.964397+0000 (oldest deadline 2024-09-13T17:25:56.064269+0000) 2024-09-13T17:26:03.478 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:26:03 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6[58766]: 2024-09-13T17:26:03.012+0000 7f915ed32640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.823948+0000 front 2024-09-13T17:25:23.823724+0000 (oldest deadline 2024-09-13T17:25:44.923611+0000) 2024-09-13T17:26:03.479 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:26:03 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6[58766]: 2024-09-13T17:26:03.012+0000 7f915ed32640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.224883+0000 front 2024-09-13T17:25:30.224769+0000 (oldest deadline 2024-09-13T17:25:55.524740+0000) 2024-09-13T17:26:03.479 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:26:03 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6[58766]: 2024-09-13T17:26:03.012+0000 7f915ed32640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.325855+0000 front 2024-09-13T17:25:38.325897+0000 (oldest deadline 2024-09-13T17:26:02.426028+0000) 2024-09-13T17:26:03.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:03 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:03.138+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:03.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:03 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:03.138+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:03.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:03 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:03.138+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:03.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:03 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:03.459+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:26:03.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:03 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:03.459+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:26:03.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:03 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:03.459+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:26:03.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:03 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:03.697+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:26:03.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:03 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:03.697+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:26:03.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:03 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:03.697+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.603893+0000 front 2024-09-13T17:25:30.604012+0000 (oldest deadline 2024-09-13T17:25:55.303884+0000) 2024-09-13T17:26:03.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:03 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:03.697+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.204922+0000 front 2024-09-13T17:25:38.204952+0000 (oldest deadline 2024-09-13T17:26:02.305011+0000) 2024-09-13T17:26:04.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:03 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:03.837+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:26:04.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:03 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:03.837+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:28.149115+0000 front 2024-09-13T17:25:28.149206+0000 (oldest deadline 2024-09-13T17:25:53.449208+0000) 2024-09-13T17:26:04.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:03 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:03.837+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.650900+0000 front 2024-09-13T17:25:38.650973+0000 (oldest deadline 2024-09-13T17:26:02.150700+0000) 2024-09-13T17:26:04.464 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:04 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:26:04.204+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.662524+0000 front 2024-09-13T17:25:19.662583+0000 (oldest deadline 2024-09-13T17:25:45.562601+0000) 2024-09-13T17:26:04.464 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:04 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:26:04.204+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:31.964336+0000 front 2024-09-13T17:25:31.964397+0000 (oldest deadline 2024-09-13T17:25:56.064269+0000) 2024-09-13T17:26:04.464 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:04 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:26:04.204+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.865971+0000 front 2024-09-13T17:25:38.865884+0000 (oldest deadline 2024-09-13T17:26:03.565967+0000) 2024-09-13T17:26:04.536 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:26:04 smithi087 podman[101715]: 2024-09-13 17:26:04.270759648 +0000 UTC m=+5.513096317 container died 137720ed49603573de90ec6484e247d163646e6a8eb447afaf48112d26b719b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, ceph=True) 2024-09-13T17:26:04.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:04 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:04.116+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:04.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:04 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:04.116+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:04.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:04 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:04.116+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:04.820 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:26:04 smithi087 podman[101715]: 2024-09-13 17:26:04.535354979 +0000 UTC m=+5.777691648 container cleanup 137720ed49603573de90ec6484e247d163646e6a8eb447afaf48112d26b719b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T17:26:04.820 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:26:04 smithi087 bash[101715]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6 2024-09-13T17:26:04.821 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:04 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:04.735+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:26:04.821 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:04 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:04.735+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:26:04.821 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:04 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:04.735+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.603893+0000 front 2024-09-13T17:25:30.604012+0000 (oldest deadline 2024-09-13T17:25:55.303884+0000) 2024-09-13T17:26:04.821 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:04 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:04.735+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.204922+0000 front 2024-09-13T17:25:38.204952+0000 (oldest deadline 2024-09-13T17:26:02.305011+0000) 2024-09-13T17:26:04.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:04 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:04.463+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:26:04.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:04 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:04.463+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:26:04.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:04 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:04.463+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:26:04.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:04 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:04.463+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:35.124124+0000 front 2024-09-13T17:25:35.124201+0000 (oldest deadline 2024-09-13T17:26:03.924503+0000) 2024-09-13T17:26:05.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:04 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:04.832+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:26:05.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:04 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:04.832+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:28.149115+0000 front 2024-09-13T17:25:28.149206+0000 (oldest deadline 2024-09-13T17:25:53.449208+0000) 2024-09-13T17:26:05.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:04 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:04.832+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.650900+0000 front 2024-09-13T17:25:38.650973+0000 (oldest deadline 2024-09-13T17:26:02.150700+0000) 2024-09-13T17:26:05.146 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:26:04 smithi087 podman[101733]: 2024-09-13 17:26:04.819987594 +0000 UTC m=+0.541316693 container remove 137720ed49603573de90ec6484e247d163646e6a8eb447afaf48112d26b719b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-13T17:26:05.417 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:26:05 smithi087 podman[101822]: 2024-09-13 17:26:05.049028987 +0000 UTC m=+0.015824573 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:26:05.417 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:26:05 smithi087 podman[101822]: 2024-09-13 17:26:05.154196686 +0000 UTC m=+0.120992270 container create d82c28920fe9a837dccb856f260f7334b0d58ddf9eb13f3014fc49ff7772f249 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:26:05.417 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:26:05 smithi087 podman[101822]: 2024-09-13 17:26:05.416078987 +0000 UTC m=+0.382874580 container init d82c28920fe9a837dccb856f260f7334b0d58ddf9eb13f3014fc49ff7772f249 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-13T17:26:05.507 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:05 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:26:05.227+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.662524+0000 front 2024-09-13T17:25:19.662583+0000 (oldest deadline 2024-09-13T17:25:45.562601+0000) 2024-09-13T17:26:05.508 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:05 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:26:05.227+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:31.964336+0000 front 2024-09-13T17:25:31.964397+0000 (oldest deadline 2024-09-13T17:25:56.064269+0000) 2024-09-13T17:26:05.508 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:05 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:26:05.227+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.865971+0000 front 2024-09-13T17:25:38.865884+0000 (oldest deadline 2024-09-13T17:26:03.565967+0000) 2024-09-13T17:26:05.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:05 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:05.148+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:05.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:05 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:05.148+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:05.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:05 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:05.148+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:05.688 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:26:05 smithi087 podman[101822]: 2024-09-13 17:26:05.420010816 +0000 UTC m=+0.386806412 container start d82c28920fe9a837dccb856f260f7334b0d58ddf9eb13f3014fc49ff7772f249 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True) 2024-09-13T17:26:05.688 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:26:05 smithi087 podman[101822]: 2024-09-13 17:26:05.524403583 +0000 UTC m=+0.491199185 container attach d82c28920fe9a837dccb856f260f7334b0d58ddf9eb13f3014fc49ff7772f249 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-13T17:26:05.688 INFO:journalctl@ceph.osd.6.smithi087.stdout:Sep 13 17:26:05 smithi087 podman[101822]: 2024-09-13 17:26:05.607598508 +0000 UTC m=+0.574394096 container died d82c28920fe9a837dccb856f260f7334b0d58ddf9eb13f3014fc49ff7772f249 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-6-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-13T17:26:05.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:05 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:05.506+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:26:05.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:05 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:05.506+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:26:05.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:05 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:05.506+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:26:05.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:05 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:05.506+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:35.124124+0000 front 2024-09-13T17:25:35.124201+0000 (oldest deadline 2024-09-13T17:26:03.924503+0000) 2024-09-13T17:26:05.978 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:05 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:05.686+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:26:05.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:05 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:05.686+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:26:05.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:05 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:05.686+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.603893+0000 front 2024-09-13T17:25:30.604012+0000 (oldest deadline 2024-09-13T17:25:55.303884+0000) 2024-09-13T17:26:05.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:05 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:05.686+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.204922+0000 front 2024-09-13T17:25:38.204952+0000 (oldest deadline 2024-09-13T17:26:02.305011+0000) 2024-09-13T17:26:06.189 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:05 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:05.878+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:26:06.190 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:05 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:05.878+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:28.149115+0000 front 2024-09-13T17:25:28.149206+0000 (oldest deadline 2024-09-13T17:25:53.449208+0000) 2024-09-13T17:26:06.190 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:05 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:05.878+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.650900+0000 front 2024-09-13T17:25:38.650973+0000 (oldest deadline 2024-09-13T17:26:02.150700+0000) 2024-09-13T17:26:06.278 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.6.service' 2024-09-13T17:26:06.318 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:26:06.318 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-13T17:26:06.318 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-13T17:26:06.318 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.7 2024-09-13T17:26:06.549 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:06 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:26:06.262+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.662524+0000 front 2024-09-13T17:25:19.662583+0000 (oldest deadline 2024-09-13T17:25:45.562601+0000) 2024-09-13T17:26:06.549 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:06 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:26:06.262+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:31.964336+0000 front 2024-09-13T17:25:31.964397+0000 (oldest deadline 2024-09-13T17:25:56.064269+0000) 2024-09-13T17:26:06.549 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:06 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:26:06.262+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.865971+0000 front 2024-09-13T17:25:38.865884+0000 (oldest deadline 2024-09-13T17:26:03.565967+0000) 2024-09-13T17:26:06.549 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:06 smithi118 systemd[1]: Stopping Ceph osd.7 for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:26:06.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:06 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:06.188+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:06.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:06 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:06.188+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:06.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:06 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:06.188+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:06.863 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:06 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:26:06.641+0000 7f4783a28640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:26:06.863 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:06 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:26:06.641+0000 7f4783a28640 -1 osd.7 108 *** Got signal Terminated *** 2024-09-13T17:26:06.863 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:06 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:26:06.641+0000 7f4783a28640 -1 osd.7 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:26:06.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:06 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:06.547+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:26:06.864 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:06 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:06.547+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:26:06.864 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:06 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:06.547+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:26:06.864 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:06 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:06.547+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:35.124124+0000 front 2024-09-13T17:25:35.124201+0000 (oldest deadline 2024-09-13T17:26:03.924503+0000) 2024-09-13T17:26:06.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:06 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:06.642+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:26:06.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:06 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:06.642+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:26:06.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:06 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:06.642+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.603893+0000 front 2024-09-13T17:25:30.604012+0000 (oldest deadline 2024-09-13T17:25:55.303884+0000) 2024-09-13T17:26:06.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:06 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:06.642+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.204922+0000 front 2024-09-13T17:25:38.204952+0000 (oldest deadline 2024-09-13T17:26:02.305011+0000) 2024-09-13T17:26:07.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:06 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:06.840+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:26:07.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:06 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:06.840+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:28.149115+0000 front 2024-09-13T17:25:28.149206+0000 (oldest deadline 2024-09-13T17:25:53.449208+0000) 2024-09-13T17:26:07.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:06 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:06.840+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.650900+0000 front 2024-09-13T17:25:38.650973+0000 (oldest deadline 2024-09-13T17:26:02.150700+0000) 2024-09-13T17:26:07.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:07 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:07.176+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:07.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:07 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:07.176+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:07.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:07 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:07.176+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:07.613 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:07 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:26:07.295+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.662524+0000 front 2024-09-13T17:25:19.662583+0000 (oldest deadline 2024-09-13T17:25:45.562601+0000) 2024-09-13T17:26:07.613 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:07 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:26:07.295+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:31.964336+0000 front 2024-09-13T17:25:31.964397+0000 (oldest deadline 2024-09-13T17:25:56.064269+0000) 2024-09-13T17:26:07.613 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:07 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:26:07.295+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.865971+0000 front 2024-09-13T17:25:38.865884+0000 (oldest deadline 2024-09-13T17:26:03.565967+0000) 2024-09-13T17:26:07.613 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:07 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:07.522+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:26:07.613 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:07 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:07.522+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:26:07.613 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:07 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:07.522+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:26:07.613 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:07 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:07.522+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:35.124124+0000 front 2024-09-13T17:25:35.124201+0000 (oldest deadline 2024-09-13T17:26:03.924503+0000) 2024-09-13T17:26:07.728 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:07 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:07.670+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:26:07.729 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:07 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:07.670+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:26:07.729 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:07 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:07.670+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.603893+0000 front 2024-09-13T17:25:30.604012+0000 (oldest deadline 2024-09-13T17:25:55.303884+0000) 2024-09-13T17:26:07.729 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:07 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:07.670+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.204922+0000 front 2024-09-13T17:25:38.204952+0000 (oldest deadline 2024-09-13T17:26:02.305011+0000) 2024-09-13T17:26:08.151 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:07 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:07.863+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:26:08.152 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:07 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:07.863+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:28.149115+0000 front 2024-09-13T17:25:28.149206+0000 (oldest deadline 2024-09-13T17:25:53.449208+0000) 2024-09-13T17:26:08.152 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:07 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:07.863+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.650900+0000 front 2024-09-13T17:25:38.650973+0000 (oldest deadline 2024-09-13T17:26:02.150700+0000) 2024-09-13T17:26:08.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:08 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:08.150+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:08.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:08 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:08.150+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:08.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:08 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:08.150+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:08.613 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:08 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:26:08.276+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.662524+0000 front 2024-09-13T17:25:19.662583+0000 (oldest deadline 2024-09-13T17:25:45.562601+0000) 2024-09-13T17:26:08.613 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:08 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:26:08.276+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:31.964336+0000 front 2024-09-13T17:25:31.964397+0000 (oldest deadline 2024-09-13T17:25:56.064269+0000) 2024-09-13T17:26:08.613 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:08 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:26:08.276+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.865971+0000 front 2024-09-13T17:25:38.865884+0000 (oldest deadline 2024-09-13T17:26:03.565967+0000) 2024-09-13T17:26:08.613 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:08 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:08.518+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:26:08.613 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:08 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:08.518+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:26:08.613 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:08 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:08.518+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:26:08.613 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:08 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:08.518+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:35.124124+0000 front 2024-09-13T17:25:35.124201+0000 (oldest deadline 2024-09-13T17:26:03.924503+0000) 2024-09-13T17:26:08.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:08 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:08.720+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:26:08.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:08 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:08.720+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:26:08.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:08 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:08.720+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.603893+0000 front 2024-09-13T17:25:30.604012+0000 (oldest deadline 2024-09-13T17:25:55.303884+0000) 2024-09-13T17:26:08.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:08 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:08.720+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.204922+0000 front 2024-09-13T17:25:38.204952+0000 (oldest deadline 2024-09-13T17:26:02.305011+0000) 2024-09-13T17:26:08.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:08 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:08.720+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:45.706976+0000 front 2024-09-13T17:25:45.706856+0000 (oldest deadline 2024-09-13T17:26:08.606774+0000) 2024-09-13T17:26:09.120 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:08 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:08.845+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:26:09.120 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:08 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:08.845+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:28.149115+0000 front 2024-09-13T17:25:28.149206+0000 (oldest deadline 2024-09-13T17:25:53.449208+0000) 2024-09-13T17:26:09.120 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:08 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:08.845+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.650900+0000 front 2024-09-13T17:25:38.650973+0000 (oldest deadline 2024-09-13T17:26:02.150700+0000) 2024-09-13T17:26:09.120 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:08 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:08.845+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:45.651805+0000 front 2024-09-13T17:25:45.651796+0000 (oldest deadline 2024-09-13T17:26:08.551756+0000) 2024-09-13T17:26:09.542 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:09 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:26:09.258+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.662524+0000 front 2024-09-13T17:25:19.662583+0000 (oldest deadline 2024-09-13T17:25:45.562601+0000) 2024-09-13T17:26:09.543 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:09 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:26:09.258+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:31.964336+0000 front 2024-09-13T17:25:31.964397+0000 (oldest deadline 2024-09-13T17:25:56.064269+0000) 2024-09-13T17:26:09.543 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:09 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:26:09.258+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.865971+0000 front 2024-09-13T17:25:38.865884+0000 (oldest deadline 2024-09-13T17:26:03.565967+0000) 2024-09-13T17:26:09.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:09 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:09.118+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:09.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:09 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:09.118+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:09.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:09 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:09.118+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:09.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:09 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:09.541+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:26:09.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:09 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:09.541+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:26:09.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:09 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:09.541+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:26:09.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:09 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:09.541+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:35.124124+0000 front 2024-09-13T17:25:35.124201+0000 (oldest deadline 2024-09-13T17:26:03.924503+0000) 2024-09-13T17:26:09.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:09 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:09.541+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:43.924904+0000 front 2024-09-13T17:25:43.924920+0000 (oldest deadline 2024-09-13T17:26:09.224950+0000) 2024-09-13T17:26:09.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:09 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:09.702+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:26:09.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:09 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:09.702+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:26:09.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:09 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:09.702+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.603893+0000 front 2024-09-13T17:25:30.604012+0000 (oldest deadline 2024-09-13T17:25:55.303884+0000) 2024-09-13T17:26:09.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:09 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:09.702+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.204922+0000 front 2024-09-13T17:25:38.204952+0000 (oldest deadline 2024-09-13T17:26:02.305011+0000) 2024-09-13T17:26:09.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:09 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:09.702+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:45.706976+0000 front 2024-09-13T17:25:45.706856+0000 (oldest deadline 2024-09-13T17:26:08.606774+0000) 2024-09-13T17:26:10.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:09 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:09.797+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:26:10.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:09 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:09.797+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:28.149115+0000 front 2024-09-13T17:25:28.149206+0000 (oldest deadline 2024-09-13T17:25:53.449208+0000) 2024-09-13T17:26:10.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:09 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:09.797+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.650900+0000 front 2024-09-13T17:25:38.650973+0000 (oldest deadline 2024-09-13T17:26:02.150700+0000) 2024-09-13T17:26:10.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:09 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:09.797+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:45.651805+0000 front 2024-09-13T17:25:45.651796+0000 (oldest deadline 2024-09-13T17:26:08.551756+0000) 2024-09-13T17:26:10.589 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:10 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:26:10.242+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.662524+0000 front 2024-09-13T17:25:19.662583+0000 (oldest deadline 2024-09-13T17:25:45.562601+0000) 2024-09-13T17:26:10.590 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:10 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:26:10.242+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:31.964336+0000 front 2024-09-13T17:25:31.964397+0000 (oldest deadline 2024-09-13T17:25:56.064269+0000) 2024-09-13T17:26:10.590 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:10 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:26:10.242+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.865971+0000 front 2024-09-13T17:25:38.865884+0000 (oldest deadline 2024-09-13T17:26:03.565967+0000) 2024-09-13T17:26:10.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:10 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:10.116+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:10.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:10 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:10.116+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:10.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:10 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:10.116+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:10.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:10 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:10.588+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:26:10.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:10 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:10.588+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:26:10.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:10 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:10.588+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:26:10.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:10 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:10.588+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:35.124124+0000 front 2024-09-13T17:25:35.124201+0000 (oldest deadline 2024-09-13T17:26:03.924503+0000) 2024-09-13T17:26:10.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:10 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:10.588+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:43.924904+0000 front 2024-09-13T17:25:43.924920+0000 (oldest deadline 2024-09-13T17:26:09.224950+0000) 2024-09-13T17:26:11.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:10 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:10.823+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:26:11.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:10 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:10.823+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:28.149115+0000 front 2024-09-13T17:25:28.149206+0000 (oldest deadline 2024-09-13T17:25:53.449208+0000) 2024-09-13T17:26:11.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:10 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:10.823+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.650900+0000 front 2024-09-13T17:25:38.650973+0000 (oldest deadline 2024-09-13T17:26:02.150700+0000) 2024-09-13T17:26:11.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:10 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:10.824+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:45.651805+0000 front 2024-09-13T17:25:45.651796+0000 (oldest deadline 2024-09-13T17:26:08.551756+0000) 2024-09-13T17:26:11.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:10 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:10.739+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:26:11.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:10 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:10.739+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:26:11.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:10 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:10.739+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.603893+0000 front 2024-09-13T17:25:30.604012+0000 (oldest deadline 2024-09-13T17:25:55.303884+0000) 2024-09-13T17:26:11.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:10 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:10.739+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.204922+0000 front 2024-09-13T17:25:38.204952+0000 (oldest deadline 2024-09-13T17:26:02.305011+0000) 2024-09-13T17:26:11.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:10 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:10.739+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:45.706976+0000 front 2024-09-13T17:25:45.706856+0000 (oldest deadline 2024-09-13T17:26:08.606774+0000) 2024-09-13T17:26:11.589 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:11 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:26:11.275+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.662524+0000 front 2024-09-13T17:25:19.662583+0000 (oldest deadline 2024-09-13T17:25:45.562601+0000) 2024-09-13T17:26:11.589 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:11 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:26:11.275+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:31.964336+0000 front 2024-09-13T17:25:31.964397+0000 (oldest deadline 2024-09-13T17:25:56.064269+0000) 2024-09-13T17:26:11.589 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:11 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7[52547]: 2024-09-13T17:26:11.275+0000 7f478003c640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.865971+0000 front 2024-09-13T17:25:38.865884+0000 (oldest deadline 2024-09-13T17:26:03.565967+0000) 2024-09-13T17:26:11.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:11 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:11.149+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:11.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:11 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:11.149+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:11.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:11 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:11.149+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:11.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:11 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:11.588+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:26:11.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:11 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:11.588+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:26:11.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:11 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:11.588+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:26:11.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:11 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:11.588+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:35.124124+0000 front 2024-09-13T17:25:35.124201+0000 (oldest deadline 2024-09-13T17:26:03.924503+0000) 2024-09-13T17:26:11.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:11 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:11.588+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:43.924904+0000 front 2024-09-13T17:25:43.924920+0000 (oldest deadline 2024-09-13T17:26:09.224950+0000) 2024-09-13T17:26:12.130 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:11 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:11.854+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:26:12.130 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:11 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:11.854+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:28.149115+0000 front 2024-09-13T17:25:28.149206+0000 (oldest deadline 2024-09-13T17:25:53.449208+0000) 2024-09-13T17:26:12.131 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:11 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:11.854+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.650900+0000 front 2024-09-13T17:25:38.650973+0000 (oldest deadline 2024-09-13T17:26:02.150700+0000) 2024-09-13T17:26:12.131 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:11 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:11.854+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:45.651805+0000 front 2024-09-13T17:25:45.651796+0000 (oldest deadline 2024-09-13T17:26:08.551756+0000) 2024-09-13T17:26:12.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:11 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:11.736+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:26:12.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:11 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:11.736+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:26:12.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:11 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:11.736+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.603893+0000 front 2024-09-13T17:25:30.604012+0000 (oldest deadline 2024-09-13T17:25:55.303884+0000) 2024-09-13T17:26:12.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:11 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:11.736+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.204922+0000 front 2024-09-13T17:25:38.204952+0000 (oldest deadline 2024-09-13T17:26:02.305011+0000) 2024-09-13T17:26:12.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:11 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:11.736+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:45.706976+0000 front 2024-09-13T17:25:45.706856+0000 (oldest deadline 2024-09-13T17:26:08.606774+0000) 2024-09-13T17:26:12.486 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:12 smithi118 podman[70837]: 2024-09-13 17:26:12.165231312 +0000 UTC m=+5.652551292 container died b15d51e0ad1da55d4d10ead957a867da438d92e002601dcc04399d26013e0d4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True) 2024-09-13T17:26:12.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:12 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:12.129+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:12.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:12 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:12.129+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:12.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:12 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:12.129+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:12.828 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:12 smithi118 podman[70837]: 2024-09-13 17:26:12.583609882 +0000 UTC m=+6.070929861 container cleanup b15d51e0ad1da55d4d10ead957a867da438d92e002601dcc04399d26013e0d4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2) 2024-09-13T17:26:12.828 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:12 smithi118 bash[70837]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7 2024-09-13T17:26:12.828 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:12 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:12.557+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:26:12.829 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:12 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:12.557+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:26:12.829 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:12 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:12.557+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:26:12.829 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:12 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:12.557+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:35.124124+0000 front 2024-09-13T17:25:35.124201+0000 (oldest deadline 2024-09-13T17:26:03.924503+0000) 2024-09-13T17:26:12.829 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:12 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:12.557+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:43.924904+0000 front 2024-09-13T17:25:43.924920+0000 (oldest deadline 2024-09-13T17:26:09.224950+0000) 2024-09-13T17:26:13.113 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:12 smithi118 podman[70852]: 2024-09-13 17:26:12.826918869 +0000 UTC m=+0.654836407 container remove b15d51e0ad1da55d4d10ead957a867da438d92e002601dcc04399d26013e0d4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-13T17:26:13.153 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:12 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:12.883+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:26:13.153 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:12 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:12.884+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:28.149115+0000 front 2024-09-13T17:25:28.149206+0000 (oldest deadline 2024-09-13T17:25:53.449208+0000) 2024-09-13T17:26:13.153 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:12 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:12.884+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.650900+0000 front 2024-09-13T17:25:38.650973+0000 (oldest deadline 2024-09-13T17:26:02.150700+0000) 2024-09-13T17:26:13.153 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:12 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:12.884+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:45.651805+0000 front 2024-09-13T17:25:45.651796+0000 (oldest deadline 2024-09-13T17:26:08.551756+0000) 2024-09-13T17:26:13.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:12 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:12.765+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:26:13.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:12 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:12.765+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:26:13.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:12 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:12.765+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.603893+0000 front 2024-09-13T17:25:30.604012+0000 (oldest deadline 2024-09-13T17:25:55.303884+0000) 2024-09-13T17:26:13.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:12 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:12.765+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.204922+0000 front 2024-09-13T17:25:38.204952+0000 (oldest deadline 2024-09-13T17:26:02.305011+0000) 2024-09-13T17:26:13.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:12 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:12.765+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:45.706976+0000 front 2024-09-13T17:25:45.706856+0000 (oldest deadline 2024-09-13T17:26:08.606774+0000) 2024-09-13T17:26:13.440 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:13 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:13.152+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:13.441 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:13 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:13.152+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:13.441 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:13 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:13.152+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:13.441 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:13 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:13.152+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:47.159192+0000 front 2024-09-13T17:25:47.159118+0000 (oldest deadline 2024-09-13T17:26:12.359677+0000) 2024-09-13T17:26:13.528 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:13 smithi118 podman[70941]: 2024-09-13 17:26:13.167053743 +0000 UTC m=+0.015617040 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:26:13.528 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:13 smithi118 podman[70941]: 2024-09-13 17:26:13.286115639 +0000 UTC m=+0.134678933 container create 1751df8e22b84c6f1c3c4924afd78559dfa95832d983c96ec486b5c3adf231c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, GIT_CLEAN=True) 2024-09-13T17:26:13.528 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:13 smithi118 podman[70941]: 2024-09-13 17:26:13.522000865 +0000 UTC m=+0.370564159 container init 1751df8e22b84c6f1c3c4924afd78559dfa95832d983c96ec486b5c3adf231c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-13T17:26:13.863 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:13 smithi118 podman[70941]: 2024-09-13 17:26:13.52535449 +0000 UTC m=+0.373917788 container start 1751df8e22b84c6f1c3c4924afd78559dfa95832d983c96ec486b5c3adf231c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T17:26:13.863 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:13 smithi118 podman[70941]: 2024-09-13 17:26:13.622117888 +0000 UTC m=+0.470681190 container attach 1751df8e22b84c6f1c3c4924afd78559dfa95832d983c96ec486b5c3adf231c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:26:13.863 INFO:journalctl@ceph.osd.7.smithi118.stdout:Sep 13 17:26:13 smithi118 podman[70941]: 2024-09-13 17:26:13.706599668 +0000 UTC m=+0.555162977 container died 1751df8e22b84c6f1c3c4924afd78559dfa95832d983c96ec486b5c3adf231c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T17:26:13.864 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:13 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:13.593+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:26:13.864 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:13 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:13.593+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:26:13.864 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:13 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:13.593+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:26:13.864 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:13 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:13.593+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:35.124124+0000 front 2024-09-13T17:25:35.124201+0000 (oldest deadline 2024-09-13T17:26:03.924503+0000) 2024-09-13T17:26:13.864 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:13 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:13.593+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:43.924904+0000 front 2024-09-13T17:25:43.924920+0000 (oldest deadline 2024-09-13T17:26:09.224950+0000) 2024-09-13T17:26:14.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:13 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:13.735+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:26:14.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:13 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:13.735+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:26:14.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:13 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:13.735+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.603893+0000 front 2024-09-13T17:25:30.604012+0000 (oldest deadline 2024-09-13T17:25:55.303884+0000) 2024-09-13T17:26:14.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:13 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:13.735+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.204922+0000 front 2024-09-13T17:25:38.204952+0000 (oldest deadline 2024-09-13T17:26:02.305011+0000) 2024-09-13T17:26:14.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:13 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:13.735+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:45.706976+0000 front 2024-09-13T17:25:45.706856+0000 (oldest deadline 2024-09-13T17:26:08.606774+0000) 2024-09-13T17:26:14.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:14 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:14.139+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:14.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:14 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:14.139+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:14.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:14 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:14.139+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:14.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:14 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:14.139+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:47.159192+0000 front 2024-09-13T17:25:47.159118+0000 (oldest deadline 2024-09-13T17:26:12.359677+0000) 2024-09-13T17:26:14.342 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:13 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:13.926+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:26:14.343 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:13 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:13.926+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:28.149115+0000 front 2024-09-13T17:25:28.149206+0000 (oldest deadline 2024-09-13T17:25:53.449208+0000) 2024-09-13T17:26:14.343 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:13 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:13.926+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.650900+0000 front 2024-09-13T17:25:38.650973+0000 (oldest deadline 2024-09-13T17:26:02.150700+0000) 2024-09-13T17:26:14.343 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:13 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:13.926+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:45.651805+0000 front 2024-09-13T17:25:45.651796+0000 (oldest deadline 2024-09-13T17:26:08.551756+0000) 2024-09-13T17:26:14.407 DEBUG:teuthology.orchestra.run.smithi118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.7.service' 2024-09-13T17:26:14.445 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:26:14.445 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-13T17:26:14.446 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-13T17:26:14.446 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.8 2024-09-13T17:26:14.650 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:14 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:14.597+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:26:14.650 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:14 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:14.597+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:26:14.650 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:14 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:14.597+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:26:14.650 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:14 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:14.597+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:35.124124+0000 front 2024-09-13T17:25:35.124201+0000 (oldest deadline 2024-09-13T17:26:03.924503+0000) 2024-09-13T17:26:14.650 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:14 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:14.597+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:43.924904+0000 front 2024-09-13T17:25:43.924920+0000 (oldest deadline 2024-09-13T17:26:09.224950+0000) 2024-09-13T17:26:14.765 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:14 smithi149 systemd[1]: Stopping Ceph osd.8 for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:26:14.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:14 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:14.717+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:26:14.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:14 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:14.717+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:26:14.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:14 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:14.717+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.603893+0000 front 2024-09-13T17:25:30.604012+0000 (oldest deadline 2024-09-13T17:25:55.303884+0000) 2024-09-13T17:26:14.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:14 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:14.717+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.204922+0000 front 2024-09-13T17:25:38.204952+0000 (oldest deadline 2024-09-13T17:26:02.305011+0000) 2024-09-13T17:26:14.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:14 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:14.717+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:45.706976+0000 front 2024-09-13T17:25:45.706856+0000 (oldest deadline 2024-09-13T17:26:08.606774+0000) 2024-09-13T17:26:15.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:14 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:14.764+0000 7f32f4505640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:26:15.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:14 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:14.764+0000 7f32f4505640 -1 osd.8 108 *** Got signal Terminated *** 2024-09-13T17:26:15.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:14 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:14.764+0000 7f32f4505640 -1 osd.8 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:26:15.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:14 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:14.916+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:26:15.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:14 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:14.916+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:28.149115+0000 front 2024-09-13T17:25:28.149206+0000 (oldest deadline 2024-09-13T17:25:53.449208+0000) 2024-09-13T17:26:15.092 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:14 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:14.916+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.650900+0000 front 2024-09-13T17:25:38.650973+0000 (oldest deadline 2024-09-13T17:26:02.150700+0000) 2024-09-13T17:26:15.093 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:14 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:14.916+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:45.651805+0000 front 2024-09-13T17:25:45.651796+0000 (oldest deadline 2024-09-13T17:26:08.551756+0000) 2024-09-13T17:26:15.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:15 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:15.123+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:15.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:15 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:15.123+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:15.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:15 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:15.123+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:15.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:15 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:15.123+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:47.159192+0000 front 2024-09-13T17:25:47.159118+0000 (oldest deadline 2024-09-13T17:26:12.359677+0000) 2024-09-13T17:26:15.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:15 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:15.595+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:26:15.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:15 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:15.595+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:26:15.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:15 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:15.595+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:26:15.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:15 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:15.595+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:35.124124+0000 front 2024-09-13T17:25:35.124201+0000 (oldest deadline 2024-09-13T17:26:03.924503+0000) 2024-09-13T17:26:15.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:15 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:15.595+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:43.924904+0000 front 2024-09-13T17:25:43.924920+0000 (oldest deadline 2024-09-13T17:26:09.224950+0000) 2024-09-13T17:26:16.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:15 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:15.752+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:26:16.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:15 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:15.752+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:26:16.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:15 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:15.752+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.603893+0000 front 2024-09-13T17:25:30.604012+0000 (oldest deadline 2024-09-13T17:25:55.303884+0000) 2024-09-13T17:26:16.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:15 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:15.752+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.204922+0000 front 2024-09-13T17:25:38.204952+0000 (oldest deadline 2024-09-13T17:26:02.305011+0000) 2024-09-13T17:26:16.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:15 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:15.752+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:45.706976+0000 front 2024-09-13T17:25:45.706856+0000 (oldest deadline 2024-09-13T17:26:08.606774+0000) 2024-09-13T17:26:16.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:16 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:16.133+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:16.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:16 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:16.133+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:16.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:16 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:16.133+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:16.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:16 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:16.133+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:47.159192+0000 front 2024-09-13T17:25:47.159118+0000 (oldest deadline 2024-09-13T17:26:12.359677+0000) 2024-09-13T17:26:16.342 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:15 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:15.946+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:26:16.342 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:15 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:15.946+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:28.149115+0000 front 2024-09-13T17:25:28.149206+0000 (oldest deadline 2024-09-13T17:25:53.449208+0000) 2024-09-13T17:26:16.343 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:15 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:15.946+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.650900+0000 front 2024-09-13T17:25:38.650973+0000 (oldest deadline 2024-09-13T17:26:02.150700+0000) 2024-09-13T17:26:16.343 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:15 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:15.946+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:45.651805+0000 front 2024-09-13T17:25:45.651796+0000 (oldest deadline 2024-09-13T17:26:08.551756+0000) 2024-09-13T17:26:17.113 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:16 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:16.635+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:26:17.113 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:16 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:16.635+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:26:17.113 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:16 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:16.635+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:26:17.113 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:16 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:16.635+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:35.124124+0000 front 2024-09-13T17:25:35.124201+0000 (oldest deadline 2024-09-13T17:26:03.924503+0000) 2024-09-13T17:26:17.113 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:16 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:16.635+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:43.924904+0000 front 2024-09-13T17:25:43.924920+0000 (oldest deadline 2024-09-13T17:26:09.224950+0000) 2024-09-13T17:26:17.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:16 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:16.741+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:26:17.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:16 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:16.741+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:26:17.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:16 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:16.741+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.603893+0000 front 2024-09-13T17:25:30.604012+0000 (oldest deadline 2024-09-13T17:25:55.303884+0000) 2024-09-13T17:26:17.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:16 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:16.741+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.204922+0000 front 2024-09-13T17:25:38.204952+0000 (oldest deadline 2024-09-13T17:26:02.305011+0000) 2024-09-13T17:26:17.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:16 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:16.741+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:45.706976+0000 front 2024-09-13T17:25:45.706856+0000 (oldest deadline 2024-09-13T17:26:08.606774+0000) 2024-09-13T17:26:17.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:17 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:17.158+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:17.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:17 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:17.158+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:17.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:17 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:17.158+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:17.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:17 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:17.158+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:47.159192+0000 front 2024-09-13T17:25:47.159118+0000 (oldest deadline 2024-09-13T17:26:12.359677+0000) 2024-09-13T17:26:17.343 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:16 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:16.958+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:26:17.343 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:16 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:16.958+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:28.149115+0000 front 2024-09-13T17:25:28.149206+0000 (oldest deadline 2024-09-13T17:25:53.449208+0000) 2024-09-13T17:26:17.343 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:16 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:16.958+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.650900+0000 front 2024-09-13T17:25:38.650973+0000 (oldest deadline 2024-09-13T17:26:02.150700+0000) 2024-09-13T17:26:17.343 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:16 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:16.958+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:45.651805+0000 front 2024-09-13T17:25:45.651796+0000 (oldest deadline 2024-09-13T17:26:08.551756+0000) 2024-09-13T17:26:17.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:17 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:17.733+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:26:17.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:17 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:17.733+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:26:17.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:17 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:17.733+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.603893+0000 front 2024-09-13T17:25:30.604012+0000 (oldest deadline 2024-09-13T17:25:55.303884+0000) 2024-09-13T17:26:17.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:17 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:17.733+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.204922+0000 front 2024-09-13T17:25:38.204952+0000 (oldest deadline 2024-09-13T17:26:02.305011+0000) 2024-09-13T17:26:17.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:17 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:17.733+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:45.706976+0000 front 2024-09-13T17:25:45.706856+0000 (oldest deadline 2024-09-13T17:26:08.606774+0000) 2024-09-13T17:26:18.014 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:17 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:17.635+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:26:18.014 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:17 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:17.635+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:26:18.014 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:17 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:17.635+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:26:18.014 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:17 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:17.635+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:35.124124+0000 front 2024-09-13T17:25:35.124201+0000 (oldest deadline 2024-09-13T17:26:03.924503+0000) 2024-09-13T17:26:18.014 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:17 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:17.635+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:43.924904+0000 front 2024-09-13T17:25:43.924920+0000 (oldest deadline 2024-09-13T17:26:09.224950+0000) 2024-09-13T17:26:18.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:18 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:18.109+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:18.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:18 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:18.109+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:18.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:18 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:18.109+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:18.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:18 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:18.109+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:47.159192+0000 front 2024-09-13T17:25:47.159118+0000 (oldest deadline 2024-09-13T17:26:12.359677+0000) 2024-09-13T17:26:18.343 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:17 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:17.954+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:26:18.343 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:17 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:17.954+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:28.149115+0000 front 2024-09-13T17:25:28.149206+0000 (oldest deadline 2024-09-13T17:25:53.449208+0000) 2024-09-13T17:26:18.343 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:17 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:17.954+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.650900+0000 front 2024-09-13T17:25:38.650973+0000 (oldest deadline 2024-09-13T17:26:02.150700+0000) 2024-09-13T17:26:18.343 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:17 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:17.954+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:45.651805+0000 front 2024-09-13T17:25:45.651796+0000 (oldest deadline 2024-09-13T17:26:08.551756+0000) 2024-09-13T17:26:18.343 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:17 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:17.954+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.852645+0000 front 2024-09-13T17:25:53.852666+0000 (oldest deadline 2024-09-13T17:26:17.952671+0000) 2024-09-13T17:26:18.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:18 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:18.596+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:26:18.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:18 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:18.596+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:26:18.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:18 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:18.596+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:26:18.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:18 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:18.596+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:35.124124+0000 front 2024-09-13T17:25:35.124201+0000 (oldest deadline 2024-09-13T17:26:03.924503+0000) 2024-09-13T17:26:18.864 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:18 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:18.596+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:43.924904+0000 front 2024-09-13T17:25:43.924920+0000 (oldest deadline 2024-09-13T17:26:09.224950+0000) 2024-09-13T17:26:19.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:18 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:18.753+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:26:19.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:18 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:18.753+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:26:19.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:18 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:18.753+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.603893+0000 front 2024-09-13T17:25:30.604012+0000 (oldest deadline 2024-09-13T17:25:55.303884+0000) 2024-09-13T17:26:19.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:18 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:18.753+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.204922+0000 front 2024-09-13T17:25:38.204952+0000 (oldest deadline 2024-09-13T17:26:02.305011+0000) 2024-09-13T17:26:19.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:18 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:18.753+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:45.706976+0000 front 2024-09-13T17:25:45.706856+0000 (oldest deadline 2024-09-13T17:26:08.606774+0000) 2024-09-13T17:26:19.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:18 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:18.753+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.708989+0000 front 2024-09-13T17:25:53.709049+0000 (oldest deadline 2024-09-13T17:26:18.409005+0000) 2024-09-13T17:26:19.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:19 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:19.080+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:19.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:19 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:19.080+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:19.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:19 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:19.080+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:19.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:19 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:19.080+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:47.159192+0000 front 2024-09-13T17:25:47.159118+0000 (oldest deadline 2024-09-13T17:26:12.359677+0000) 2024-09-13T17:26:19.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:19 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:19.080+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.460673+0000 front 2024-09-13T17:25:53.460571+0000 (oldest deadline 2024-09-13T17:26:18.160558+0000) 2024-09-13T17:26:19.343 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:18 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:18.974+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.346168+0000 front 2024-09-13T17:25:14.346154+0000 (oldest deadline 2024-09-13T17:25:38.346792+0000) 2024-09-13T17:26:19.343 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:18 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:18.974+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:28.149115+0000 front 2024-09-13T17:25:28.149206+0000 (oldest deadline 2024-09-13T17:25:53.449208+0000) 2024-09-13T17:26:19.343 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:18 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:18.974+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.650900+0000 front 2024-09-13T17:25:38.650973+0000 (oldest deadline 2024-09-13T17:26:02.150700+0000) 2024-09-13T17:26:19.343 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:18 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:18.974+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:45.651805+0000 front 2024-09-13T17:25:45.651796+0000 (oldest deadline 2024-09-13T17:26:08.551756+0000) 2024-09-13T17:26:19.343 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:18 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8[53994]: 2024-09-13T17:26:18.974+0000 7f32f0b19640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.852645+0000 front 2024-09-13T17:25:53.852666+0000 (oldest deadline 2024-09-13T17:26:17.952671+0000) 2024-09-13T17:26:19.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:19 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:19.582+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:26:19.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:19 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:19.582+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:26:19.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:19 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:19.582+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:26:19.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:19 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:19.582+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:35.124124+0000 front 2024-09-13T17:25:35.124201+0000 (oldest deadline 2024-09-13T17:26:03.924503+0000) 2024-09-13T17:26:19.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:19 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:19.582+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:43.924904+0000 front 2024-09-13T17:25:43.924920+0000 (oldest deadline 2024-09-13T17:26:09.224950+0000) 2024-09-13T17:26:20.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:19 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:19.737+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:26:20.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:19 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:19.737+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:26:20.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:19 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:19.737+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.603893+0000 front 2024-09-13T17:25:30.604012+0000 (oldest deadline 2024-09-13T17:25:55.303884+0000) 2024-09-13T17:26:20.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:19 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:19.737+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.204922+0000 front 2024-09-13T17:25:38.204952+0000 (oldest deadline 2024-09-13T17:26:02.305011+0000) 2024-09-13T17:26:20.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:19 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:19.737+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:45.706976+0000 front 2024-09-13T17:25:45.706856+0000 (oldest deadline 2024-09-13T17:26:08.606774+0000) 2024-09-13T17:26:20.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:19 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:19.737+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.708989+0000 front 2024-09-13T17:25:53.709049+0000 (oldest deadline 2024-09-13T17:26:18.409005+0000) 2024-09-13T17:26:20.590 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:20 smithi149 podman[72404]: 2024-09-13 17:26:20.285848173 +0000 UTC m=+5.641526849 container died 8d211e881c5f9883bc870dd25d90f5105d2e5ce720a57a0bd3897deceb71b984 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-13T17:26:20.591 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:20 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:20.116+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:20.591 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:20 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:20.116+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:20.591 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:20 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:20.116+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:20.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:20 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:20.116+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:47.159192+0000 front 2024-09-13T17:25:47.159118+0000 (oldest deadline 2024-09-13T17:26:12.359677+0000) 2024-09-13T17:26:20.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:20 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:20.116+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.460673+0000 front 2024-09-13T17:25:53.460571+0000 (oldest deadline 2024-09-13T17:26:18.160558+0000) 2024-09-13T17:26:20.842 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:20 smithi149 podman[72404]: 2024-09-13 17:26:20.67225545 +0000 UTC m=+6.027934128 container cleanup 8d211e881c5f9883bc870dd25d90f5105d2e5ce720a57a0bd3897deceb71b984 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True) 2024-09-13T17:26:20.842 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:20 smithi149 bash[72404]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8 2024-09-13T17:26:20.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:20 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:20.585+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:26:20.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:20 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:20.585+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:26:20.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:20 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:20.585+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:26:20.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:20 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:20.585+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:35.124124+0000 front 2024-09-13T17:25:35.124201+0000 (oldest deadline 2024-09-13T17:26:03.924503+0000) 2024-09-13T17:26:20.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:20 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:20.585+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:43.924904+0000 front 2024-09-13T17:25:43.924920+0000 (oldest deadline 2024-09-13T17:26:09.224950+0000) 2024-09-13T17:26:20.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:20 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:20.695+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:26:20.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:20 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:20.695+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:26:20.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:20 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:20.695+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.603893+0000 front 2024-09-13T17:25:30.604012+0000 (oldest deadline 2024-09-13T17:25:55.303884+0000) 2024-09-13T17:26:20.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:20 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:20.695+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.204922+0000 front 2024-09-13T17:25:38.204952+0000 (oldest deadline 2024-09-13T17:26:02.305011+0000) 2024-09-13T17:26:20.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:20 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:20.695+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:45.706976+0000 front 2024-09-13T17:25:45.706856+0000 (oldest deadline 2024-09-13T17:26:08.606774+0000) 2024-09-13T17:26:20.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:20 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:20.695+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.708989+0000 front 2024-09-13T17:25:53.709049+0000 (oldest deadline 2024-09-13T17:26:18.409005+0000) 2024-09-13T17:26:21.283 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:20 smithi149 podman[72422]: 2024-09-13 17:26:20.940120676 +0000 UTC m=+0.649546444 container remove 8d211e881c5f9883bc870dd25d90f5105d2e5ce720a57a0bd3897deceb71b984 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-13T17:26:21.283 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:21 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:21.114+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:21.283 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:21 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:21.114+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:21.283 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:21 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:21.114+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:21.283 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:21 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:21.114+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:47.159192+0000 front 2024-09-13T17:25:47.159118+0000 (oldest deadline 2024-09-13T17:26:12.359677+0000) 2024-09-13T17:26:21.283 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:21 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:21.114+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.460673+0000 front 2024-09-13T17:25:53.460571+0000 (oldest deadline 2024-09-13T17:26:18.160558+0000) 2024-09-13T17:26:21.544 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:21 smithi149 podman[72510]: 2024-09-13 17:26:21.282518935 +0000 UTC m=+0.106593247 container create 91e9bed405c94a38d54838f6bd69c9e380570fb6c27ff59a4d08359965e0be47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731) 2024-09-13T17:26:21.544 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:21 smithi149 podman[72510]: 2024-09-13 17:26:21.192111147 +0000 UTC m=+0.016185467 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:26:21.842 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:21 smithi149 podman[72510]: 2024-09-13 17:26:21.543271958 +0000 UTC m=+0.367346273 container init 91e9bed405c94a38d54838f6bd69c9e380570fb6c27ff59a4d08359965e0be47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-13T17:26:21.842 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:21 smithi149 podman[72510]: 2024-09-13 17:26:21.546684949 +0000 UTC m=+0.370759263 container start 91e9bed405c94a38d54838f6bd69c9e380570fb6c27ff59a4d08359965e0be47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-13T17:26:21.842 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:21 smithi149 podman[72510]: 2024-09-13 17:26:21.626676043 +0000 UTC m=+0.450750356 container attach 91e9bed405c94a38d54838f6bd69c9e380570fb6c27ff59a4d08359965e0be47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8-deactivate, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T17:26:21.842 INFO:journalctl@ceph.osd.8.smithi149.stdout:Sep 13 17:26:21 smithi149 podman[72510]: 2024-09-13 17:26:21.728745997 +0000 UTC m=+0.552820315 container died 91e9bed405c94a38d54838f6bd69c9e380570fb6c27ff59a4d08359965e0be47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-13T17:26:21.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:21 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:21.554+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:26:21.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:21 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:21.554+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:26:21.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:21 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:21.554+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:26:21.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:21 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:21.554+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:35.124124+0000 front 2024-09-13T17:25:35.124201+0000 (oldest deadline 2024-09-13T17:26:03.924503+0000) 2024-09-13T17:26:21.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:21 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:21.554+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:43.924904+0000 front 2024-09-13T17:25:43.924920+0000 (oldest deadline 2024-09-13T17:26:09.224950+0000) 2024-09-13T17:26:21.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:21 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:21.694+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:26:21.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:21 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:21.694+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:26:21.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:21 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:21.694+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.603893+0000 front 2024-09-13T17:25:30.604012+0000 (oldest deadline 2024-09-13T17:25:55.303884+0000) 2024-09-13T17:26:21.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:21 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:21.694+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.204922+0000 front 2024-09-13T17:25:38.204952+0000 (oldest deadline 2024-09-13T17:26:02.305011+0000) 2024-09-13T17:26:21.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:21 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:21.694+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:45.706976+0000 front 2024-09-13T17:25:45.706856+0000 (oldest deadline 2024-09-13T17:26:08.606774+0000) 2024-09-13T17:26:21.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:21 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:21.694+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.708989+0000 front 2024-09-13T17:25:53.709049+0000 (oldest deadline 2024-09-13T17:26:18.409005+0000) 2024-09-13T17:26:22.339 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:22 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:22.116+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:22.340 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:22 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:22.116+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:22.340 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:22 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:22.116+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:22.340 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:22 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:22.116+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:47.159192+0000 front 2024-09-13T17:25:47.159118+0000 (oldest deadline 2024-09-13T17:26:12.359677+0000) 2024-09-13T17:26:22.340 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:22 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:22.116+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.460673+0000 front 2024-09-13T17:25:53.460571+0000 (oldest deadline 2024-09-13T17:26:18.160558+0000) 2024-09-13T17:26:22.358 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.8.service' 2024-09-13T17:26:22.396 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:26:22.397 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-13T17:26:22.397 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-13T17:26:22.397 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.9 2024-09-13T17:26:22.682 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:22 smithi087 systemd[1]: Stopping Ceph osd.9 for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:26:22.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:22 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:22.520+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:26:22.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:22 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:22.520+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:26:22.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:22 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:22.520+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:26:22.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:22 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:22.520+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:35.124124+0000 front 2024-09-13T17:25:35.124201+0000 (oldest deadline 2024-09-13T17:26:03.924503+0000) 2024-09-13T17:26:22.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:22 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:22.520+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:43.924904+0000 front 2024-09-13T17:25:43.924920+0000 (oldest deadline 2024-09-13T17:26:09.224950+0000) 2024-09-13T17:26:22.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:22 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:22.520+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:51.525892+0000 front 2024-09-13T17:25:51.525810+0000 (oldest deadline 2024-09-13T17:26:22.126212+0000) 2024-09-13T17:26:22.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:22 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:22.680+0000 7fca73dc4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:26:22.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:22 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:22.680+0000 7fca73dc4640 -1 osd.9 108 *** Got signal Terminated *** 2024-09-13T17:26:22.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:22 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:22.680+0000 7fca73dc4640 -1 osd.9 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:26:22.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:22 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:22.720+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:26:22.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:22 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:22.720+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:26:22.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:22 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:22.720+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.603893+0000 front 2024-09-13T17:25:30.604012+0000 (oldest deadline 2024-09-13T17:25:55.303884+0000) 2024-09-13T17:26:22.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:22 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:22.720+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.204922+0000 front 2024-09-13T17:25:38.204952+0000 (oldest deadline 2024-09-13T17:26:02.305011+0000) 2024-09-13T17:26:22.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:22 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:22.720+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:45.706976+0000 front 2024-09-13T17:25:45.706856+0000 (oldest deadline 2024-09-13T17:26:08.606774+0000) 2024-09-13T17:26:22.979 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:22 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:22.720+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.708989+0000 front 2024-09-13T17:25:53.709049+0000 (oldest deadline 2024-09-13T17:26:18.409005+0000) 2024-09-13T17:26:23.563 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:23 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:23.153+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:23.563 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:23 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:23.153+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:23.563 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:23 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:23.153+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:23.563 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:23 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:23.153+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:47.159192+0000 front 2024-09-13T17:25:47.159118+0000 (oldest deadline 2024-09-13T17:26:12.359677+0000) 2024-09-13T17:26:23.563 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:23 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:23.153+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.460673+0000 front 2024-09-13T17:25:53.460571+0000 (oldest deadline 2024-09-13T17:26:18.160558+0000) 2024-09-13T17:26:23.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:23 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:23.550+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:26:23.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:23 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:23.550+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:26:23.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:23 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:23.550+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:26:23.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:23 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:23.550+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:35.124124+0000 front 2024-09-13T17:25:35.124201+0000 (oldest deadline 2024-09-13T17:26:03.924503+0000) 2024-09-13T17:26:23.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:23 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:23.550+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:43.924904+0000 front 2024-09-13T17:25:43.924920+0000 (oldest deadline 2024-09-13T17:26:09.224950+0000) 2024-09-13T17:26:23.864 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:23 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:23.550+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:51.525892+0000 front 2024-09-13T17:25:51.525810+0000 (oldest deadline 2024-09-13T17:26:22.126212+0000) 2024-09-13T17:26:24.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:23 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:23.748+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:26:24.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:23 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:23.748+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:26:24.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:23 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:23.748+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.603893+0000 front 2024-09-13T17:25:30.604012+0000 (oldest deadline 2024-09-13T17:25:55.303884+0000) 2024-09-13T17:26:24.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:23 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:23.748+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.204922+0000 front 2024-09-13T17:25:38.204952+0000 (oldest deadline 2024-09-13T17:26:02.305011+0000) 2024-09-13T17:26:24.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:23 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:23.748+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:45.706976+0000 front 2024-09-13T17:25:45.706856+0000 (oldest deadline 2024-09-13T17:26:08.606774+0000) 2024-09-13T17:26:24.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:23 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:23.748+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.708989+0000 front 2024-09-13T17:25:53.709049+0000 (oldest deadline 2024-09-13T17:26:18.409005+0000) 2024-09-13T17:26:24.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:24 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:24.127+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:24.593 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:24 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:24.127+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:24.593 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:24 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:24.127+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:24.593 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:24 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:24.127+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:47.159192+0000 front 2024-09-13T17:25:47.159118+0000 (oldest deadline 2024-09-13T17:26:12.359677+0000) 2024-09-13T17:26:24.593 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:24 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:24.127+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.460673+0000 front 2024-09-13T17:25:53.460571+0000 (oldest deadline 2024-09-13T17:26:18.160558+0000) 2024-09-13T17:26:24.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:24 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:24.539+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:26:24.864 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:24 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:24.539+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:26:24.864 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:24 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:24.539+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:26:24.864 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:24 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:24.539+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:35.124124+0000 front 2024-09-13T17:25:35.124201+0000 (oldest deadline 2024-09-13T17:26:03.924503+0000) 2024-09-13T17:26:24.864 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:24 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:24.539+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:43.924904+0000 front 2024-09-13T17:25:43.924920+0000 (oldest deadline 2024-09-13T17:26:09.224950+0000) 2024-09-13T17:26:24.864 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:24 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:24.539+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:51.525892+0000 front 2024-09-13T17:25:51.525810+0000 (oldest deadline 2024-09-13T17:26:22.126212+0000) 2024-09-13T17:26:25.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:24 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:24.787+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:26:25.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:24 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:24.787+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:26:25.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:24 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:24.787+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.603893+0000 front 2024-09-13T17:25:30.604012+0000 (oldest deadline 2024-09-13T17:25:55.303884+0000) 2024-09-13T17:26:25.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:24 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:24.787+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.204922+0000 front 2024-09-13T17:25:38.204952+0000 (oldest deadline 2024-09-13T17:26:02.305011+0000) 2024-09-13T17:26:25.230 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:24 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:24.787+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:45.706976+0000 front 2024-09-13T17:25:45.706856+0000 (oldest deadline 2024-09-13T17:26:08.606774+0000) 2024-09-13T17:26:25.230 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:24 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:24.787+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.708989+0000 front 2024-09-13T17:25:53.709049+0000 (oldest deadline 2024-09-13T17:26:18.409005+0000) 2024-09-13T17:26:25.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:25 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:25.103+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:25.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:25 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:25.103+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:25.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:25 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:25.103+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:25.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:25 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:25.103+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:47.159192+0000 front 2024-09-13T17:25:47.159118+0000 (oldest deadline 2024-09-13T17:26:12.359677+0000) 2024-09-13T17:26:25.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:25 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:25.103+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.460673+0000 front 2024-09-13T17:25:53.460571+0000 (oldest deadline 2024-09-13T17:26:18.160558+0000) 2024-09-13T17:26:25.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:25 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:25.583+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:26:25.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:25 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:25.583+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:26:25.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:25 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:25.583+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:26:25.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:25 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:25.583+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:35.124124+0000 front 2024-09-13T17:25:35.124201+0000 (oldest deadline 2024-09-13T17:26:03.924503+0000) 2024-09-13T17:26:25.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:25 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:25.583+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:43.924904+0000 front 2024-09-13T17:25:43.924920+0000 (oldest deadline 2024-09-13T17:26:09.224950+0000) 2024-09-13T17:26:25.864 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:25 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:25.583+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:51.525892+0000 front 2024-09-13T17:25:51.525810+0000 (oldest deadline 2024-09-13T17:26:22.126212+0000) 2024-09-13T17:26:26.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:25 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:25.769+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:26:26.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:25 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:25.769+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:26:26.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:25 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:25.769+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.603893+0000 front 2024-09-13T17:25:30.604012+0000 (oldest deadline 2024-09-13T17:25:55.303884+0000) 2024-09-13T17:26:26.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:25 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:25.769+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.204922+0000 front 2024-09-13T17:25:38.204952+0000 (oldest deadline 2024-09-13T17:26:02.305011+0000) 2024-09-13T17:26:26.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:25 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:25.769+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:45.706976+0000 front 2024-09-13T17:25:45.706856+0000 (oldest deadline 2024-09-13T17:26:08.606774+0000) 2024-09-13T17:26:26.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:25 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:25.769+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.708989+0000 front 2024-09-13T17:25:53.709049+0000 (oldest deadline 2024-09-13T17:26:18.409005+0000) 2024-09-13T17:26:26.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:26 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:26.108+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:26.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:26 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:26.108+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:26.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:26 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:26.108+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:26.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:26 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:26.108+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:47.159192+0000 front 2024-09-13T17:25:47.159118+0000 (oldest deadline 2024-09-13T17:26:12.359677+0000) 2024-09-13T17:26:26.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:26 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:26.108+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.460673+0000 front 2024-09-13T17:25:53.460571+0000 (oldest deadline 2024-09-13T17:26:18.160558+0000) 2024-09-13T17:26:26.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:26 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:26.108+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-09-13T17:26:03.461656+0000 front 2024-09-13T17:26:03.461593+0000 (oldest deadline 2024-09-13T17:26:25.761408+0000) 2024-09-13T17:26:26.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:26 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:26.564+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:26:26.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:26 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:26.564+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:26:26.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:26 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:26.564+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:26:26.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:26 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:26.564+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:35.124124+0000 front 2024-09-13T17:25:35.124201+0000 (oldest deadline 2024-09-13T17:26:03.924503+0000) 2024-09-13T17:26:26.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:26 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:26.564+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:43.924904+0000 front 2024-09-13T17:25:43.924920+0000 (oldest deadline 2024-09-13T17:26:09.224950+0000) 2024-09-13T17:26:26.864 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:26 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:26.564+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:51.525892+0000 front 2024-09-13T17:25:51.525810+0000 (oldest deadline 2024-09-13T17:26:22.126212+0000) 2024-09-13T17:26:26.864 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:26 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:26.564+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-09-13T17:26:02.126689+0000 front 2024-09-13T17:26:02.126744+0000 (oldest deadline 2024-09-13T17:26:26.226560+0000) 2024-09-13T17:26:27.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:26 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:26.797+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:14.102268+0000 front 2024-09-13T17:25:14.102287+0000 (oldest deadline 2024-09-13T17:25:39.402448+0000) 2024-09-13T17:26:27.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:26 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:26.797+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:19.402814+0000 front 2024-09-13T17:25:19.402840+0000 (oldest deadline 2024-09-13T17:25:45.302865+0000) 2024-09-13T17:26:27.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:26 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:26.797+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.603893+0000 front 2024-09-13T17:25:30.604012+0000 (oldest deadline 2024-09-13T17:25:55.303884+0000) 2024-09-13T17:26:27.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:26 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:26.797+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:38.204922+0000 front 2024-09-13T17:25:38.204952+0000 (oldest deadline 2024-09-13T17:26:02.305011+0000) 2024-09-13T17:26:27.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:26 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:26.797+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:45.706976+0000 front 2024-09-13T17:25:45.706856+0000 (oldest deadline 2024-09-13T17:26:08.606774+0000) 2024-09-13T17:26:27.229 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:26 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9[65718]: 2024-09-13T17:26:26.797+0000 7fca6c3d0640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.708989+0000 front 2024-09-13T17:25:53.709049+0000 (oldest deadline 2024-09-13T17:26:18.409005+0000) 2024-09-13T17:26:27.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:27 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:27.078+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:27.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:27 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:27.078+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:27.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:27 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:27.078+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:27.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:27 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:27.078+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:47.159192+0000 front 2024-09-13T17:25:47.159118+0000 (oldest deadline 2024-09-13T17:26:12.359677+0000) 2024-09-13T17:26:27.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:27 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:27.078+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.460673+0000 front 2024-09-13T17:25:53.460571+0000 (oldest deadline 2024-09-13T17:26:18.160558+0000) 2024-09-13T17:26:27.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:27 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:27.078+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-09-13T17:26:03.461656+0000 front 2024-09-13T17:26:03.461593+0000 (oldest deadline 2024-09-13T17:26:25.761408+0000) 2024-09-13T17:26:27.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:27 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:27.601+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:26:27.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:27 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:27.601+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:26:27.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:27 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:27.601+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:26:27.864 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:27 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:27.601+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:35.124124+0000 front 2024-09-13T17:25:35.124201+0000 (oldest deadline 2024-09-13T17:26:03.924503+0000) 2024-09-13T17:26:27.864 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:27 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:27.601+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:43.924904+0000 front 2024-09-13T17:25:43.924920+0000 (oldest deadline 2024-09-13T17:26:09.224950+0000) 2024-09-13T17:26:27.864 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:27 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:27.601+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:51.525892+0000 front 2024-09-13T17:25:51.525810+0000 (oldest deadline 2024-09-13T17:26:22.126212+0000) 2024-09-13T17:26:27.864 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:27 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:27.601+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-09-13T17:26:02.126689+0000 front 2024-09-13T17:26:02.126744+0000 (oldest deadline 2024-09-13T17:26:26.226560+0000) 2024-09-13T17:26:28.479 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:28 smithi087 podman[101937]: 2024-09-13 17:26:28.217495639 +0000 UTC m=+5.623658679 container died 41a732fcd22c9ed99f8d0056a7b30b08ce2c1acf0e6b9050526ba12fbf5040e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T17:26:28.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:28 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:28.125+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:28.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:28 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:28.125+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:28.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:28 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:28.125+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:28.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:28 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:28.125+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:47.159192+0000 front 2024-09-13T17:25:47.159118+0000 (oldest deadline 2024-09-13T17:26:12.359677+0000) 2024-09-13T17:26:28.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:28 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:28.125+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.460673+0000 front 2024-09-13T17:25:53.460571+0000 (oldest deadline 2024-09-13T17:26:18.160558+0000) 2024-09-13T17:26:28.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:28 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:28.125+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-09-13T17:26:03.461656+0000 front 2024-09-13T17:26:03.461593+0000 (oldest deadline 2024-09-13T17:26:25.761408+0000) 2024-09-13T17:26:28.840 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:28 smithi087 podman[101937]: 2024-09-13 17:26:28.563715249 +0000 UTC m=+5.969878280 container cleanup 41a732fcd22c9ed99f8d0056a7b30b08ce2c1acf0e6b9050526ba12fbf5040e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-13T17:26:28.841 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:28 smithi087 bash[101937]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9 2024-09-13T17:26:28.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:28 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:28.572+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:26:28.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:28 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:28.572+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:26:28.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:28 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:28.572+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:26:28.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:28 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:28.572+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:35.124124+0000 front 2024-09-13T17:25:35.124201+0000 (oldest deadline 2024-09-13T17:26:03.924503+0000) 2024-09-13T17:26:28.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:28 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:28.572+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:43.924904+0000 front 2024-09-13T17:25:43.924920+0000 (oldest deadline 2024-09-13T17:26:09.224950+0000) 2024-09-13T17:26:28.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:28 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:28.572+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:51.525892+0000 front 2024-09-13T17:25:51.525810+0000 (oldest deadline 2024-09-13T17:26:22.126212+0000) 2024-09-13T17:26:28.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:28 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:28.572+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-09-13T17:26:02.126689+0000 front 2024-09-13T17:26:02.126744+0000 (oldest deadline 2024-09-13T17:26:26.226560+0000) 2024-09-13T17:26:29.166 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:28 smithi087 podman[101953]: 2024-09-13 17:26:28.84014426 +0000 UTC m=+0.620001967 container remove 41a732fcd22c9ed99f8d0056a7b30b08ce2c1acf0e6b9050526ba12fbf5040e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:26:29.460 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:29 smithi087 podman[102044]: 2024-09-13 17:26:29.165835571 +0000 UTC m=+0.102485447 container create 8830d09ea6da93c1c5229a6dfc97da7ade53eed72083b3e2e8b9cbbbd18d5d7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-13T17:26:29.460 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:29 smithi087 podman[102044]: 2024-09-13 17:26:29.079513809 +0000 UTC m=+0.016163694 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:26:29.460 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:29 smithi087 podman[102044]: 2024-09-13 17:26:29.376230956 +0000 UTC m=+0.312880836 container init 8830d09ea6da93c1c5229a6dfc97da7ade53eed72083b3e2e8b9cbbbd18d5d7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-13T17:26:29.461 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:29 smithi087 podman[102044]: 2024-09-13 17:26:29.379537146 +0000 UTC m=+0.316187025 container start 8830d09ea6da93c1c5229a6dfc97da7ade53eed72083b3e2e8b9cbbbd18d5d7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2) 2024-09-13T17:26:29.461 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:29 smithi087 podman[102044]: 2024-09-13 17:26:29.459723198 +0000 UTC m=+0.396373076 container attach 8830d09ea6da93c1c5229a6dfc97da7ade53eed72083b3e2e8b9cbbbd18d5d7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-13T17:26:29.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:29 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:29.114+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:29.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:29 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:29.114+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:29.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:29 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:29.114+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:29.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:29 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:29.114+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:47.159192+0000 front 2024-09-13T17:25:47.159118+0000 (oldest deadline 2024-09-13T17:26:12.359677+0000) 2024-09-13T17:26:29.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:29 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:29.114+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.460673+0000 front 2024-09-13T17:25:53.460571+0000 (oldest deadline 2024-09-13T17:26:18.160558+0000) 2024-09-13T17:26:29.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:29 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:29.114+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-09-13T17:26:03.461656+0000 front 2024-09-13T17:26:03.461593+0000 (oldest deadline 2024-09-13T17:26:25.761408+0000) 2024-09-13T17:26:29.729 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:29 smithi087 podman[102044]: 2024-09-13 17:26:29.567895009 +0000 UTC m=+0.504544887 container died 8830d09ea6da93c1c5229a6dfc97da7ade53eed72083b3e2e8b9cbbbd18d5d7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:26:29.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:29 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:29.542+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:26:29.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:29 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:29.542+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:26:29.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:29 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:29.542+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:26:29.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:29 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:29.542+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:35.124124+0000 front 2024-09-13T17:25:35.124201+0000 (oldest deadline 2024-09-13T17:26:03.924503+0000) 2024-09-13T17:26:29.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:29 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:29.542+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:43.924904+0000 front 2024-09-13T17:25:43.924920+0000 (oldest deadline 2024-09-13T17:26:09.224950+0000) 2024-09-13T17:26:29.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:29 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:29.542+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:51.525892+0000 front 2024-09-13T17:25:51.525810+0000 (oldest deadline 2024-09-13T17:26:22.126212+0000) 2024-09-13T17:26:29.864 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:29 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:29.542+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-09-13T17:26:02.126689+0000 front 2024-09-13T17:26:02.126744+0000 (oldest deadline 2024-09-13T17:26:26.226560+0000) 2024-09-13T17:26:30.080 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.9.service' 2024-09-13T17:26:30.103 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:30 smithi087 podman[102068]: 2024-09-13 17:26:30.062852923 +0000 UTC m=+0.485615944 container remove 8830d09ea6da93c1c5229a6dfc97da7ade53eed72083b3e2e8b9cbbbd18d5d7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-13T17:26:30.103 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:30 smithi087 systemd[1]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.9.service: Deactivated successfully. 2024-09-13T17:26:30.103 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:30 smithi087 systemd[1]: Stopped Ceph osd.9 for 043d5bae-71f2-11ef-bceb-c7b262605968. 2024-09-13T17:26:30.103 INFO:journalctl@ceph.osd.9.smithi087.stdout:Sep 13 17:26:30 smithi087 systemd[1]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.9.service: Consumed 41.618s CPU time. 2024-09-13T17:26:30.119 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:26:30.119 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-13T17:26:30.119 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-13T17:26:30.119 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.10 2024-09-13T17:26:30.413 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:30 smithi118 systemd[1]: Stopping Ceph osd.10 for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:26:30.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:30 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:30.113+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:30.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:30 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:30.113+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:30.593 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:30 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:30.113+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:30.593 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:30 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:30.113+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:47.159192+0000 front 2024-09-13T17:25:47.159118+0000 (oldest deadline 2024-09-13T17:26:12.359677+0000) 2024-09-13T17:26:30.593 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:30 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:30.113+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.460673+0000 front 2024-09-13T17:25:53.460571+0000 (oldest deadline 2024-09-13T17:26:18.160558+0000) 2024-09-13T17:26:30.593 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:30 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:30.113+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-09-13T17:26:03.461656+0000 front 2024-09-13T17:26:03.461593+0000 (oldest deadline 2024-09-13T17:26:25.761408+0000) 2024-09-13T17:26:30.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:30 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:30.411+0000 7f466ccdd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:26:30.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:30 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:30.411+0000 7f466ccdd640 -1 osd.10 108 *** Got signal Terminated *** 2024-09-13T17:26:30.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:30 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:30.411+0000 7f466ccdd640 -1 osd.10 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:26:30.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:30 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:30.523+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:26:30.864 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:30 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:30.523+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:26:30.864 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:30 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:30.523+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:26:30.864 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:30 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:30.523+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:35.124124+0000 front 2024-09-13T17:25:35.124201+0000 (oldest deadline 2024-09-13T17:26:03.924503+0000) 2024-09-13T17:26:30.864 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:30 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:30.523+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:43.924904+0000 front 2024-09-13T17:25:43.924920+0000 (oldest deadline 2024-09-13T17:26:09.224950+0000) 2024-09-13T17:26:30.864 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:30 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:30.523+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:51.525892+0000 front 2024-09-13T17:25:51.525810+0000 (oldest deadline 2024-09-13T17:26:22.126212+0000) 2024-09-13T17:26:30.864 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:30 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:30.523+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-09-13T17:26:02.126689+0000 front 2024-09-13T17:26:02.126744+0000 (oldest deadline 2024-09-13T17:26:26.226560+0000) 2024-09-13T17:26:31.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:31 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:31.153+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:31.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:31 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:31.153+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:31.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:31 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:31.153+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:31.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:31 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:31.153+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:47.159192+0000 front 2024-09-13T17:25:47.159118+0000 (oldest deadline 2024-09-13T17:26:12.359677+0000) 2024-09-13T17:26:31.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:31 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:31.153+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.460673+0000 front 2024-09-13T17:25:53.460571+0000 (oldest deadline 2024-09-13T17:26:18.160558+0000) 2024-09-13T17:26:31.593 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:31 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:31.153+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-09-13T17:26:03.461656+0000 front 2024-09-13T17:26:03.461593+0000 (oldest deadline 2024-09-13T17:26:25.761408+0000) 2024-09-13T17:26:31.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:31 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:31.567+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:26:31.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:31 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:31.567+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:26:31.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:31 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:31.567+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:26:31.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:31 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:31.567+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:35.124124+0000 front 2024-09-13T17:25:35.124201+0000 (oldest deadline 2024-09-13T17:26:03.924503+0000) 2024-09-13T17:26:31.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:31 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:31.567+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:43.924904+0000 front 2024-09-13T17:25:43.924920+0000 (oldest deadline 2024-09-13T17:26:09.224950+0000) 2024-09-13T17:26:31.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:31 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:31.567+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:51.525892+0000 front 2024-09-13T17:25:51.525810+0000 (oldest deadline 2024-09-13T17:26:22.126212+0000) 2024-09-13T17:26:31.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:31 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:31.567+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-09-13T17:26:02.126689+0000 front 2024-09-13T17:26:02.126744+0000 (oldest deadline 2024-09-13T17:26:26.226560+0000) 2024-09-13T17:26:32.494 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:32 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:32.153+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:32.494 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:32 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:32.153+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:32.494 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:32 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:32.153+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:32.494 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:32 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:32.153+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:47.159192+0000 front 2024-09-13T17:25:47.159118+0000 (oldest deadline 2024-09-13T17:26:12.359677+0000) 2024-09-13T17:26:32.494 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:32 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:32.153+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.460673+0000 front 2024-09-13T17:25:53.460571+0000 (oldest deadline 2024-09-13T17:26:18.160558+0000) 2024-09-13T17:26:32.494 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:32 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:32.153+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-09-13T17:26:03.461656+0000 front 2024-09-13T17:26:03.461593+0000 (oldest deadline 2024-09-13T17:26:25.761408+0000) 2024-09-13T17:26:32.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:32 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:32.550+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:26:32.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:32 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:32.550+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:26:32.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:32 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:32.550+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:26:32.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:32 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:32.550+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:35.124124+0000 front 2024-09-13T17:25:35.124201+0000 (oldest deadline 2024-09-13T17:26:03.924503+0000) 2024-09-13T17:26:32.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:32 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:32.550+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:43.924904+0000 front 2024-09-13T17:25:43.924920+0000 (oldest deadline 2024-09-13T17:26:09.224950+0000) 2024-09-13T17:26:32.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:32 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:32.550+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:51.525892+0000 front 2024-09-13T17:25:51.525810+0000 (oldest deadline 2024-09-13T17:26:22.126212+0000) 2024-09-13T17:26:32.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:32 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:32.550+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-09-13T17:26:02.126689+0000 front 2024-09-13T17:26:02.126744+0000 (oldest deadline 2024-09-13T17:26:26.226560+0000) 2024-09-13T17:26:33.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:33 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:33.128+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:33.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:33 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:33.128+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:33.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:33 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:33.128+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:33.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:33 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:33.128+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:47.159192+0000 front 2024-09-13T17:25:47.159118+0000 (oldest deadline 2024-09-13T17:26:12.359677+0000) 2024-09-13T17:26:33.593 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:33 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:33.128+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.460673+0000 front 2024-09-13T17:25:53.460571+0000 (oldest deadline 2024-09-13T17:26:18.160558+0000) 2024-09-13T17:26:33.593 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:33 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:33.128+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-09-13T17:26:03.461656+0000 front 2024-09-13T17:26:03.461593+0000 (oldest deadline 2024-09-13T17:26:25.761408+0000) 2024-09-13T17:26:33.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:33 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:33.544+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:26:33.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:33 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:33.544+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:26:33.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:33 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:33.544+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:26:33.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:33 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:33.544+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:35.124124+0000 front 2024-09-13T17:25:35.124201+0000 (oldest deadline 2024-09-13T17:26:03.924503+0000) 2024-09-13T17:26:33.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:33 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:33.544+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:43.924904+0000 front 2024-09-13T17:25:43.924920+0000 (oldest deadline 2024-09-13T17:26:09.224950+0000) 2024-09-13T17:26:33.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:33 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:33.544+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:51.525892+0000 front 2024-09-13T17:25:51.525810+0000 (oldest deadline 2024-09-13T17:26:22.126212+0000) 2024-09-13T17:26:33.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:33 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:33.544+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-09-13T17:26:02.126689+0000 front 2024-09-13T17:26:02.126744+0000 (oldest deadline 2024-09-13T17:26:26.226560+0000) 2024-09-13T17:26:34.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:34 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:34.082+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:34.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:34 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:34.082+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:34.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:34 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:34.082+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:34.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:34 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:34.082+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:47.159192+0000 front 2024-09-13T17:25:47.159118+0000 (oldest deadline 2024-09-13T17:26:12.359677+0000) 2024-09-13T17:26:34.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:34 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:34.082+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.460673+0000 front 2024-09-13T17:25:53.460571+0000 (oldest deadline 2024-09-13T17:26:18.160558+0000) 2024-09-13T17:26:34.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:34 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:34.082+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-09-13T17:26:03.461656+0000 front 2024-09-13T17:26:03.461593+0000 (oldest deadline 2024-09-13T17:26:25.761408+0000) 2024-09-13T17:26:34.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:34 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:34.511+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.820941+0000 front 2024-09-13T17:25:12.821062+0000 (oldest deadline 2024-09-13T17:25:38.721103+0000) 2024-09-13T17:26:34.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:34 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:34.511+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:23.422190+0000 front 2024-09-13T17:25:23.422280+0000 (oldest deadline 2024-09-13T17:25:48.722405+0000) 2024-09-13T17:26:34.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:34 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:34.511+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:30.423612+0000 front 2024-09-13T17:25:30.423596+0000 (oldest deadline 2024-09-13T17:25:55.123553+0000) 2024-09-13T17:26:34.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:34 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:34.511+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6814 osd.3 since back 2024-09-13T17:25:35.124124+0000 front 2024-09-13T17:25:35.124201+0000 (oldest deadline 2024-09-13T17:26:03.924503+0000) 2024-09-13T17:26:34.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:34 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:34.511+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:43.924904+0000 front 2024-09-13T17:25:43.924920+0000 (oldest deadline 2024-09-13T17:26:09.224950+0000) 2024-09-13T17:26:34.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:34 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:34.511+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:51.525892+0000 front 2024-09-13T17:25:51.525810+0000 (oldest deadline 2024-09-13T17:26:22.126212+0000) 2024-09-13T17:26:34.863 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:34 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10[59355]: 2024-09-13T17:26:34.511+0000 7f46652e9640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-09-13T17:26:02.126689+0000 front 2024-09-13T17:26:02.126744+0000 (oldest deadline 2024-09-13T17:26:26.226560+0000) 2024-09-13T17:26:35.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:35 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:35.039+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:35.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:35 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:35.039+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:35.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:35 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:35.039+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:35.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:35 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:35.039+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:47.159192+0000 front 2024-09-13T17:25:47.159118+0000 (oldest deadline 2024-09-13T17:26:12.359677+0000) 2024-09-13T17:26:35.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:35 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:35.039+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.460673+0000 front 2024-09-13T17:25:53.460571+0000 (oldest deadline 2024-09-13T17:26:18.160558+0000) 2024-09-13T17:26:35.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:35 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:35.039+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-09-13T17:26:03.461656+0000 front 2024-09-13T17:26:03.461593+0000 (oldest deadline 2024-09-13T17:26:25.761408+0000) 2024-09-13T17:26:36.030 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:35 smithi118 podman[71057]: 2024-09-13 17:26:35.773205447 +0000 UTC m=+5.448663890 container died 5527996ba27d87b89f8954772b7f709b57b377f969baf1f702e9a212c3ddf43d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T17:26:36.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:36 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:36.073+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:36.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:36 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:36.073+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:36.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:36 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:36.073+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:36.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:36 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:36.073+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:47.159192+0000 front 2024-09-13T17:25:47.159118+0000 (oldest deadline 2024-09-13T17:26:12.359677+0000) 2024-09-13T17:26:36.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:36 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:36.073+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.460673+0000 front 2024-09-13T17:25:53.460571+0000 (oldest deadline 2024-09-13T17:26:18.160558+0000) 2024-09-13T17:26:36.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:36 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:36.073+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-09-13T17:26:03.461656+0000 front 2024-09-13T17:26:03.461593+0000 (oldest deadline 2024-09-13T17:26:25.761408+0000) 2024-09-13T17:26:36.363 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:36 smithi118 podman[71057]: 2024-09-13 17:26:36.128329741 +0000 UTC m=+5.803788184 container cleanup 5527996ba27d87b89f8954772b7f709b57b377f969baf1f702e9a212c3ddf43d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-13T17:26:36.363 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:36 smithi118 bash[71057]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10 2024-09-13T17:26:36.699 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:36 smithi118 podman[71072]: 2024-09-13 17:26:36.379772181 +0000 UTC m=+0.607491186 container remove 5527996ba27d87b89f8954772b7f709b57b377f969baf1f702e9a212c3ddf43d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-13T17:26:36.983 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:36 smithi118 podman[71162]: 2024-09-13 17:26:36.60153622 +0000 UTC m=+0.015550660 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:26:36.984 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:36 smithi118 podman[71162]: 2024-09-13 17:26:36.714009405 +0000 UTC m=+0.128023833 container create bbbf57c0b555b7f9352692c3eceec27dcdf6874c9a991e34c14236023d792f11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux ) 2024-09-13T17:26:36.984 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:36 smithi118 podman[71162]: 2024-09-13 17:26:36.924651297 +0000 UTC m=+0.338665735 container init bbbf57c0b555b7f9352692c3eceec27dcdf6874c9a991e34c14236023d792f11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10-deactivate, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-13T17:26:36.984 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:36 smithi118 podman[71162]: 2024-09-13 17:26:36.92792233 +0000 UTC m=+0.341936759 container start bbbf57c0b555b7f9352692c3eceec27dcdf6874c9a991e34c14236023d792f11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T17:26:36.984 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:36 smithi118 podman[71162]: 2024-09-13 17:26:36.983037705 +0000 UTC m=+0.397052155 container attach bbbf57c0b555b7f9352692c3eceec27dcdf6874c9a991e34c14236023d792f11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731) 2024-09-13T17:26:37.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:37 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:37.038+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:37.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:37 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:37.038+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:37.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:37 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:37.038+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:37.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:37 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:37.038+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:47.159192+0000 front 2024-09-13T17:25:47.159118+0000 (oldest deadline 2024-09-13T17:26:12.359677+0000) 2024-09-13T17:26:37.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:37 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:37.038+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.460673+0000 front 2024-09-13T17:25:53.460571+0000 (oldest deadline 2024-09-13T17:26:18.160558+0000) 2024-09-13T17:26:37.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:37 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:37.038+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-09-13T17:26:03.461656+0000 front 2024-09-13T17:26:03.461593+0000 (oldest deadline 2024-09-13T17:26:25.761408+0000) 2024-09-13T17:26:37.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:37 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:37.038+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6820 osd.7 since back 2024-09-13T17:26:05.762108+0000 front 2024-09-13T17:26:05.762034+0000 (oldest deadline 2024-09-13T17:26:36.362289+0000) 2024-09-13T17:26:37.363 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:37 smithi118 podman[71162]: 2024-09-13 17:26:37.113859438 +0000 UTC m=+0.527873865 container died bbbf57c0b555b7f9352692c3eceec27dcdf6874c9a991e34c14236023d792f11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-13T17:26:37.631 DEBUG:teuthology.orchestra.run.smithi118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.10.service' 2024-09-13T17:26:37.653 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:37 smithi118 podman[71185]: 2024-09-13 17:26:37.611464934 +0000 UTC m=+0.492093773 container remove bbbf57c0b555b7f9352692c3eceec27dcdf6874c9a991e34c14236023d792f11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:26:37.653 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:37 smithi118 systemd[1]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.10.service: Deactivated successfully. 2024-09-13T17:26:37.653 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:37 smithi118 systemd[1]: Stopped Ceph osd.10 for 043d5bae-71f2-11ef-bceb-c7b262605968. 2024-09-13T17:26:37.653 INFO:journalctl@ceph.osd.10.smithi118.stdout:Sep 13 17:26:37 smithi118 systemd[1]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.10.service: Consumed 29.644s CPU time. 2024-09-13T17:26:37.668 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:26:37.668 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-13T17:26:37.668 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-13T17:26:37.669 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.11 2024-09-13T17:26:38.000 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:37 smithi149 systemd[1]: Stopping Ceph osd.11 for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:26:38.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:38 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:37.998+0000 7fe16e5f2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:26:38.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:38 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:37.998+0000 7fe16e5f2640 -1 osd.11 108 *** Got signal Terminated *** 2024-09-13T17:26:38.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:38 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:37.998+0000 7fe16e5f2640 -1 osd.11 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T17:26:38.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:38 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:38.080+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:38.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:38 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:38.080+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:38.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:38 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:38.080+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:38.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:38 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:38.080+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:47.159192+0000 front 2024-09-13T17:25:47.159118+0000 (oldest deadline 2024-09-13T17:26:12.359677+0000) 2024-09-13T17:26:38.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:38 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:38.080+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.460673+0000 front 2024-09-13T17:25:53.460571+0000 (oldest deadline 2024-09-13T17:26:18.160558+0000) 2024-09-13T17:26:38.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:38 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:38.080+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-09-13T17:26:03.461656+0000 front 2024-09-13T17:26:03.461593+0000 (oldest deadline 2024-09-13T17:26:25.761408+0000) 2024-09-13T17:26:38.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:38 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:38.080+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6820 osd.7 since back 2024-09-13T17:26:05.762108+0000 front 2024-09-13T17:26:05.762034+0000 (oldest deadline 2024-09-13T17:26:36.362289+0000) 2024-09-13T17:26:39.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:39 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:39.094+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:39.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:39 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:39.094+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:39.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:39 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:39.094+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:39.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:39 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:39.094+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:47.159192+0000 front 2024-09-13T17:25:47.159118+0000 (oldest deadline 2024-09-13T17:26:12.359677+0000) 2024-09-13T17:26:39.592 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:39 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:39.094+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.460673+0000 front 2024-09-13T17:25:53.460571+0000 (oldest deadline 2024-09-13T17:26:18.160558+0000) 2024-09-13T17:26:39.593 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:39 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:39.094+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-09-13T17:26:03.461656+0000 front 2024-09-13T17:26:03.461593+0000 (oldest deadline 2024-09-13T17:26:25.761408+0000) 2024-09-13T17:26:39.593 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:39 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:39.094+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6820 osd.7 since back 2024-09-13T17:26:05.762108+0000 front 2024-09-13T17:26:05.762034+0000 (oldest deadline 2024-09-13T17:26:36.362289+0000) 2024-09-13T17:26:40.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:40 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:40.049+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:40.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:40 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:40.049+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:40.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:40 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:40.049+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:40.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:40 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:40.049+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:47.159192+0000 front 2024-09-13T17:25:47.159118+0000 (oldest deadline 2024-09-13T17:26:12.359677+0000) 2024-09-13T17:26:40.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:40 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:40.049+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.460673+0000 front 2024-09-13T17:25:53.460571+0000 (oldest deadline 2024-09-13T17:26:18.160558+0000) 2024-09-13T17:26:40.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:40 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:40.049+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-09-13T17:26:03.461656+0000 front 2024-09-13T17:26:03.461593+0000 (oldest deadline 2024-09-13T17:26:25.761408+0000) 2024-09-13T17:26:40.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:40 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:40.049+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6820 osd.7 since back 2024-09-13T17:26:05.762108+0000 front 2024-09-13T17:26:05.762034+0000 (oldest deadline 2024-09-13T17:26:36.362289+0000) 2024-09-13T17:26:41.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:41 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:41.035+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:41.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:41 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:41.035+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:41.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:41 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:41.035+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:41.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:41 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:41.035+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:47.159192+0000 front 2024-09-13T17:25:47.159118+0000 (oldest deadline 2024-09-13T17:26:12.359677+0000) 2024-09-13T17:26:41.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:41 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:41.035+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.460673+0000 front 2024-09-13T17:25:53.460571+0000 (oldest deadline 2024-09-13T17:26:18.160558+0000) 2024-09-13T17:26:41.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:41 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:41.035+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-09-13T17:26:03.461656+0000 front 2024-09-13T17:26:03.461593+0000 (oldest deadline 2024-09-13T17:26:25.761408+0000) 2024-09-13T17:26:41.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:41 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:41.035+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6820 osd.7 since back 2024-09-13T17:26:05.762108+0000 front 2024-09-13T17:26:05.762034+0000 (oldest deadline 2024-09-13T17:26:36.362289+0000) 2024-09-13T17:26:42.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:41 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:41.990+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:42.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:41 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:41.990+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:42.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:41 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:41.990+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:42.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:41 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:41.990+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:47.159192+0000 front 2024-09-13T17:25:47.159118+0000 (oldest deadline 2024-09-13T17:26:12.359677+0000) 2024-09-13T17:26:42.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:41 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:41.990+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.460673+0000 front 2024-09-13T17:25:53.460571+0000 (oldest deadline 2024-09-13T17:26:18.160558+0000) 2024-09-13T17:26:42.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:41 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:41.990+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-09-13T17:26:03.461656+0000 front 2024-09-13T17:26:03.461593+0000 (oldest deadline 2024-09-13T17:26:25.761408+0000) 2024-09-13T17:26:42.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:41 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:41.990+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6820 osd.7 since back 2024-09-13T17:26:05.762108+0000 front 2024-09-13T17:26:05.762034+0000 (oldest deadline 2024-09-13T17:26:36.362289+0000) 2024-09-13T17:26:42.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:41 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:41.990+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6820 osd.8 since back 2024-09-13T17:26:16.362640+0000 front 2024-09-13T17:26:16.362656+0000 (oldest deadline 2024-09-13T17:26:41.062802+0000) 2024-09-13T17:26:43.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:42 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:42.941+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-13T17:25:12.754051+0000 front 2024-09-13T17:25:12.754035+0000 (oldest deadline 2024-09-13T17:25:37.453945+0000) 2024-09-13T17:26:43.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:42 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:42.941+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6804 osd.1 since back 2024-09-13T17:25:20.354835+0000 front 2024-09-13T17:25:20.354938+0000 (oldest deadline 2024-09-13T17:25:45.054876+0000) 2024-09-13T17:26:43.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:42 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:42.941+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6804 osd.2 since back 2024-09-13T17:25:32.056266+0000 front 2024-09-13T17:25:32.056229+0000 (oldest deadline 2024-09-13T17:25:55.556400+0000) 2024-09-13T17:26:43.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:42 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:42.941+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6812 osd.4 since back 2024-09-13T17:25:47.159192+0000 front 2024-09-13T17:25:47.159118+0000 (oldest deadline 2024-09-13T17:26:12.359677+0000) 2024-09-13T17:26:43.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:42 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:42.941+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2024-09-13T17:25:53.460673+0000 front 2024-09-13T17:25:53.460571+0000 (oldest deadline 2024-09-13T17:26:18.160558+0000) 2024-09-13T17:26:43.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:42 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:42.941+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.87:6822 osd.6 since back 2024-09-13T17:26:03.461656+0000 front 2024-09-13T17:26:03.461593+0000 (oldest deadline 2024-09-13T17:26:25.761408+0000) 2024-09-13T17:26:43.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:42 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:42.941+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.118:6820 osd.7 since back 2024-09-13T17:26:05.762108+0000 front 2024-09-13T17:26:05.762034+0000 (oldest deadline 2024-09-13T17:26:36.362289+0000) 2024-09-13T17:26:43.343 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:42 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11[60951]: 2024-09-13T17:26:42.941+0000 7fe166bfe640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.149:6820 osd.8 since back 2024-09-13T17:26:16.362640+0000 front 2024-09-13T17:26:16.362656+0000 (oldest deadline 2024-09-13T17:26:41.062802+0000) 2024-09-13T17:26:43.716 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:43 smithi149 podman[72625]: 2024-09-13 17:26:43.443953397 +0000 UTC m=+5.575322752 container died 9f9231200ae3c505bcf80144d71086e701eb1dee3a7e0fd87b01f60ec26b5c30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:26:44.077 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:43 smithi149 podman[72625]: 2024-09-13 17:26:43.823494497 +0000 UTC m=+5.954863838 container cleanup 9f9231200ae3c505bcf80144d71086e701eb1dee3a7e0fd87b01f60ec26b5c30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:26:44.077 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:43 smithi149 bash[72625]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11 2024-09-13T17:26:44.342 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:44 smithi149 podman[72642]: 2024-09-13 17:26:44.076738041 +0000 UTC m=+0.626131120 container remove 9f9231200ae3c505bcf80144d71086e701eb1dee3a7e0fd87b01f60ec26b5c30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True) 2024-09-13T17:26:44.706 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:44 smithi149 podman[72731]: 2024-09-13 17:26:44.303558691 +0000 UTC m=+0.016210099 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:26:44.706 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:44 smithi149 podman[72731]: 2024-09-13 17:26:44.402767801 +0000 UTC m=+0.115419203 container create 8a8c927373f8da51c8e3e55ec2eaeaf52fc9d087e2dd19665c2822f69c19969e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True) 2024-09-13T17:26:44.706 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:44 smithi149 podman[72731]: 2024-09-13 17:26:44.630550801 +0000 UTC m=+0.343202193 container init 8a8c927373f8da51c8e3e55ec2eaeaf52fc9d087e2dd19665c2822f69c19969e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11-deactivate, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:26:44.706 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:44 smithi149 podman[72731]: 2024-09-13 17:26:44.634058732 +0000 UTC m=+0.346710125 container start 8a8c927373f8da51c8e3e55ec2eaeaf52fc9d087e2dd19665c2822f69c19969e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-13T17:26:44.706 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:44 smithi149 podman[72731]: 2024-09-13 17:26:44.705301365 +0000 UTC m=+0.417952775 container attach 8a8c927373f8da51c8e3e55ec2eaeaf52fc9d087e2dd19665c2822f69c19969e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2) 2024-09-13T17:26:45.092 INFO:journalctl@ceph.osd.11.smithi149.stdout:Sep 13 17:26:44 smithi149 podman[72731]: 2024-09-13 17:26:44.822691656 +0000 UTC m=+0.535343059 container died 8a8c927373f8da51c8e3e55ec2eaeaf52fc9d087e2dd19665c2822f69c19969e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0) 2024-09-13T17:26:45.482 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@osd.11.service' 2024-09-13T17:26:45.521 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:26:45.522 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-13T17:26:45.522 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-13T17:26:45.522 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.a 2024-09-13T17:26:45.841 INFO:journalctl@ceph.mds.a.smithi087.stdout:Sep 13 17:26:45 smithi087 systemd[1]: Stopping Ceph mds.a for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:26:46.229 INFO:journalctl@ceph.mds.a.smithi087.stdout:Sep 13 17:26:45 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-a[72338]: 2024-09-13T17:26:45.839+0000 7f159e424640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:26:46.229 INFO:journalctl@ceph.mds.a.smithi087.stdout:Sep 13 17:26:45 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-a[72338]: 2024-09-13T17:26:45.839+0000 7f159e424640 -1 mds.a *** got signal Terminated *** 2024-09-13T17:26:47.183 INFO:journalctl@ceph.mds.a.smithi087.stdout:Sep 13 17:26:46 smithi087 podman[102163]: 2024-09-13 17:26:46.89222379 +0000 UTC m=+1.165420839 container died 3b4b3dcc0e8702a6956665c9a97dc46b3145c1b91dbd37f007bf012079bb9cc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-a, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:26:47.479 INFO:journalctl@ceph.mds.a.smithi087.stdout:Sep 13 17:26:47 smithi087 podman[102163]: 2024-09-13 17:26:47.248573565 +0000 UTC m=+1.521770611 container cleanup 3b4b3dcc0e8702a6956665c9a97dc46b3145c1b91dbd37f007bf012079bb9cc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS) 2024-09-13T17:26:47.479 INFO:journalctl@ceph.mds.a.smithi087.stdout:Sep 13 17:26:47 smithi087 bash[102163]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-a 2024-09-13T17:26:47.719 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.a.service' 2024-09-13T17:26:47.755 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:26:47.755 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-13T17:26:47.756 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-13T17:26:47.756 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.d 2024-09-13T17:26:48.070 INFO:journalctl@ceph.mds.d.smithi087.stdout:Sep 13 17:26:47 smithi087 systemd[1]: Stopping Ceph mds.d for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:26:48.478 INFO:journalctl@ceph.mds.d.smithi087.stdout:Sep 13 17:26:48 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-d[71390]: 2024-09-13T17:26:48.068+0000 7fba1f968640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:26:48.479 INFO:journalctl@ceph.mds.d.smithi087.stdout:Sep 13 17:26:48 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-d[71390]: 2024-09-13T17:26:48.068+0000 7fba1f968640 -1 mds.d *** got signal Terminated *** 2024-09-13T17:26:52.411 INFO:journalctl@ceph.mds.d.smithi087.stdout:Sep 13 17:26:52 smithi087 podman[102284]: 2024-09-13 17:26:52.073981802 +0000 UTC m=+4.093607582 container died ed1ef8cca1171f1b97e33c63df85db970736c9c96ed1a63f8a5b36851815d51f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:26:52.679 INFO:journalctl@ceph.mds.d.smithi087.stdout:Sep 13 17:26:52 smithi087 podman[102284]: 2024-09-13 17:26:52.493454226 +0000 UTC m=+4.513080001 container cleanup ed1ef8cca1171f1b97e33c63df85db970736c9c96ed1a63f8a5b36851815d51f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-13T17:26:52.679 INFO:journalctl@ceph.mds.d.smithi087.stdout:Sep 13 17:26:52 smithi087 bash[102284]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-d 2024-09-13T17:26:52.920 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.d.service' 2024-09-13T17:26:52.941 INFO:journalctl@ceph.mds.d.smithi087.stdout:Sep 13 17:26:52 smithi087 podman[102298]: 2024-09-13 17:26:52.678290756 +0000 UTC m=+0.595432727 container remove ed1ef8cca1171f1b97e33c63df85db970736c9c96ed1a63f8a5b36851815d51f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-d, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-13T17:26:52.942 INFO:journalctl@ceph.mds.d.smithi087.stdout:Sep 13 17:26:52 smithi087 systemd[1]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.d.service: Deactivated successfully. 2024-09-13T17:26:52.942 INFO:journalctl@ceph.mds.d.smithi087.stdout:Sep 13 17:26:52 smithi087 systemd[1]: Stopped Ceph mds.d for 043d5bae-71f2-11ef-bceb-c7b262605968. 2024-09-13T17:26:52.942 INFO:journalctl@ceph.mds.d.smithi087.stdout:Sep 13 17:26:52 smithi087 systemd[1]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.d.service: Consumed 1.046s CPU time. 2024-09-13T17:26:52.953 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:26:52.953 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-13T17:26:52.953 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-13T17:26:52.953 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.g 2024-09-13T17:26:53.229 INFO:journalctl@ceph.mds.g.smithi087.stdout:Sep 13 17:26:53 smithi087 systemd[1]: Stopping Ceph mds.g for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:26:53.729 INFO:journalctl@ceph.mds.g.smithi087.stdout:Sep 13 17:26:53 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-g[71982]: 2024-09-13T17:26:53.263+0000 7fa4c3554640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:26:53.729 INFO:journalctl@ceph.mds.g.smithi087.stdout:Sep 13 17:26:53 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-g[71982]: 2024-09-13T17:26:53.263+0000 7fa4c3554640 -1 mds.g *** got signal Terminated *** 2024-09-13T17:26:56.557 INFO:journalctl@ceph.mds.g.smithi087.stdout:Sep 13 17:26:56 smithi087 podman[102403]: 2024-09-13 17:26:56.280042285 +0000 UTC m=+3.114542586 container died c72bb8e972b5bc083389d569403429b9f2cc529ec7174a59be70d0978737de68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-13T17:26:56.915 INFO:journalctl@ceph.mds.g.smithi087.stdout:Sep 13 17:26:56 smithi087 podman[102403]: 2024-09-13 17:26:56.630746092 +0000 UTC m=+3.465246382 container cleanup c72bb8e972b5bc083389d569403429b9f2cc529ec7174a59be70d0978737de68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-g, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-13T17:26:56.916 INFO:journalctl@ceph.mds.g.smithi087.stdout:Sep 13 17:26:56 smithi087 bash[102403]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-g 2024-09-13T17:26:57.052 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.g.service' 2024-09-13T17:26:57.084 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:26:57.085 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-13T17:26:57.085 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-13T17:26:57.085 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.j 2024-09-13T17:26:57.228 INFO:journalctl@ceph.mds.j.smithi087.stdout:Sep 13 17:26:57 smithi087 systemd[1]: Stopping Ceph mds.j for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:26:57.728 INFO:journalctl@ceph.mds.j.smithi087.stdout:Sep 13 17:26:57 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-j[71049]: 2024-09-13T17:26:57.425+0000 7f4b4e2c1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:26:57.729 INFO:journalctl@ceph.mds.j.smithi087.stdout:Sep 13 17:26:57 smithi087 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-j[71049]: 2024-09-13T17:26:57.425+0000 7f4b4e2c1640 -1 mds.j *** got signal Terminated *** 2024-09-13T17:27:01.692 INFO:journalctl@ceph.mds.j.smithi087.stdout:Sep 13 17:27:01 smithi087 podman[102522]: 2024-09-13 17:27:01.433011789 +0000 UTC m=+4.137995829 container died 256bdb11cf6fcee006a1659432a96cb6a7c0f8e3706824ff21fc76af605843b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-j, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-13T17:27:01.979 INFO:journalctl@ceph.mds.j.smithi087.stdout:Sep 13 17:27:01 smithi087 podman[102522]: 2024-09-13 17:27:01.809106056 +0000 UTC m=+4.514090086 container cleanup 256bdb11cf6fcee006a1659432a96cb6a7c0f8e3706824ff21fc76af605843b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-j, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-13T17:27:01.979 INFO:journalctl@ceph.mds.j.smithi087.stdout:Sep 13 17:27:01 smithi087 bash[102522]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-j 2024-09-13T17:27:02.171 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.j.service' 2024-09-13T17:27:02.203 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:27:02.203 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-13T17:27:02.204 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-13T17:27:02.204 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.b 2024-09-13T17:27:02.522 INFO:journalctl@ceph.mds.b.smithi118.stdout:Sep 13 17:27:02 smithi118 systemd[1]: Stopping Ceph mds.b for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:27:02.863 INFO:journalctl@ceph.mds.b.smithi118.stdout:Sep 13 17:27:02 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-b[64546]: 2024-09-13T17:27:02.520+0000 7feb2bf9d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:27:02.863 INFO:journalctl@ceph.mds.b.smithi118.stdout:Sep 13 17:27:02 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-b[64546]: 2024-09-13T17:27:02.520+0000 7feb2bf9d640 -1 mds.b *** got signal Terminated *** 2024-09-13T17:27:06.798 INFO:journalctl@ceph.mds.b.smithi118.stdout:Sep 13 17:27:06 smithi118 podman[71264]: 2024-09-13 17:27:06.527188684 +0000 UTC m=+4.130992868 container died ba93741e9051a42f055e926b854db3955bb643824e1379182dfdeae6313291a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-b, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T17:27:07.113 INFO:journalctl@ceph.mds.b.smithi118.stdout:Sep 13 17:27:06 smithi118 podman[71264]: 2024-09-13 17:27:06.895426366 +0000 UTC m=+4.499230552 container cleanup ba93741e9051a42f055e926b854db3955bb643824e1379182dfdeae6313291a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T17:27:07.113 INFO:journalctl@ceph.mds.b.smithi118.stdout:Sep 13 17:27:06 smithi118 bash[71264]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-b 2024-09-13T17:27:07.298 DEBUG:teuthology.orchestra.run.smithi118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.b.service' 2024-09-13T17:27:07.333 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:27:07.334 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-13T17:27:07.334 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-13T17:27:07.334 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.e 2024-09-13T17:27:07.667 INFO:journalctl@ceph.mds.e.smithi118.stdout:Sep 13 17:27:07 smithi118 systemd[1]: Stopping Ceph mds.e for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:27:08.113 INFO:journalctl@ceph.mds.e.smithi118.stdout:Sep 13 17:27:07 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-e[63920]: 2024-09-13T17:27:07.665+0000 7fbbbf4a3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:27:08.113 INFO:journalctl@ceph.mds.e.smithi118.stdout:Sep 13 17:27:07 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-e[63920]: 2024-09-13T17:27:07.665+0000 7fbbbf4a3640 -1 mds.e *** got signal Terminated *** 2024-09-13T17:27:11.784 INFO:journalctl@ceph.mds.e.smithi118.stdout:Sep 13 17:27:11 smithi118 podman[71397]: 2024-09-13 17:27:11.507853829 +0000 UTC m=+3.959165536 container died c5b82dd49f06bc2b2b81be6fe184fb74a68a0bc5fc6e1c606f6219b16bd471c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-e, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-13T17:27:12.043 INFO:journalctl@ceph.mds.e.smithi118.stdout:Sep 13 17:27:11 smithi118 podman[71397]: 2024-09-13 17:27:11.841282696 +0000 UTC m=+4.292594394 container cleanup c5b82dd49f06bc2b2b81be6fe184fb74a68a0bc5fc6e1c606f6219b16bd471c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:27:12.043 INFO:journalctl@ceph.mds.e.smithi118.stdout:Sep 13 17:27:11 smithi118 bash[71397]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-e 2024-09-13T17:27:12.264 DEBUG:teuthology.orchestra.run.smithi118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.e.service' 2024-09-13T17:27:12.298 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:27:12.298 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-13T17:27:12.298 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-13T17:27:12.298 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.h 2024-09-13T17:27:12.612 INFO:journalctl@ceph.mds.h.smithi118.stdout:Sep 13 17:27:12 smithi118 systemd[1]: Stopping Ceph mds.h for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:27:12.863 INFO:journalctl@ceph.mds.h.smithi118.stdout:Sep 13 17:27:12 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-h[64236]: 2024-09-13T17:27:12.610+0000 7f609c4a0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:27:12.863 INFO:journalctl@ceph.mds.h.smithi118.stdout:Sep 13 17:27:12 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-h[64236]: 2024-09-13T17:27:12.610+0000 7f609c4a0640 -1 mds.h *** got signal Terminated *** 2024-09-13T17:27:15.097 INFO:journalctl@ceph.mds.h.smithi118.stdout:Sep 13 17:27:14 smithi118 podman[71519]: 2024-09-13 17:27:14.819986639 +0000 UTC m=+2.306337355 container died 9de8deadcdc3a7dc8da01cad5dacfc276342028f60990c2621586f9587105d99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-h, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-13T17:27:15.363 INFO:journalctl@ceph.mds.h.smithi118.stdout:Sep 13 17:27:15 smithi118 podman[71519]: 2024-09-13 17:27:15.170132578 +0000 UTC m=+2.656483294 container cleanup 9de8deadcdc3a7dc8da01cad5dacfc276342028f60990c2621586f9587105d99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-h, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T17:27:15.363 INFO:journalctl@ceph.mds.h.smithi118.stdout:Sep 13 17:27:15 smithi118 bash[71519]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-h 2024-09-13T17:27:15.585 DEBUG:teuthology.orchestra.run.smithi118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.h.service' 2024-09-13T17:27:15.618 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:27:15.618 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-13T17:27:15.618 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-13T17:27:15.618 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.k 2024-09-13T17:27:16.113 INFO:journalctl@ceph.mds.k.smithi118.stdout:Sep 13 17:27:15 smithi118 systemd[1]: Stopping Ceph mds.k for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:27:16.113 INFO:journalctl@ceph.mds.k.smithi118.stdout:Sep 13 17:27:15 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-k[63602]: 2024-09-13T17:27:15.923+0000 7fde381d2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:27:16.113 INFO:journalctl@ceph.mds.k.smithi118.stdout:Sep 13 17:27:15 smithi118 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-k[63602]: 2024-09-13T17:27:15.923+0000 7fde381d2640 -1 mds.k *** got signal Terminated *** 2024-09-13T17:27:19.863 INFO:journalctl@ceph.mds.k.smithi118.stdout:Sep 13 17:27:19 smithi118 podman[71640]: 2024-09-13 17:27:19.609499876 +0000 UTC m=+3.777931456 container died ddac1b90024b9c86a5c1b349ff9c1b330592fda4ab6d270b09903b0f6a4baca2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-k, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-13T17:27:20.217 INFO:journalctl@ceph.mds.k.smithi118.stdout:Sep 13 17:27:19 smithi118 podman[71640]: 2024-09-13 17:27:19.982464415 +0000 UTC m=+4.150895995 container cleanup ddac1b90024b9c86a5c1b349ff9c1b330592fda4ab6d270b09903b0f6a4baca2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-k, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-13T17:27:20.217 INFO:journalctl@ceph.mds.k.smithi118.stdout:Sep 13 17:27:19 smithi118 bash[71640]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-k 2024-09-13T17:27:20.352 DEBUG:teuthology.orchestra.run.smithi118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.k.service' 2024-09-13T17:27:20.383 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:27:20.384 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-13T17:27:20.384 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-13T17:27:20.384 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.c 2024-09-13T17:27:20.676 INFO:journalctl@ceph.mds.c.smithi149.stdout:Sep 13 17:27:20 smithi149 systemd[1]: Stopping Ceph mds.c for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:27:20.927 INFO:journalctl@ceph.mds.c.smithi149.stdout:Sep 13 17:27:20 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-c[65894]: 2024-09-13T17:27:20.674+0000 7f55214ed640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:27:20.927 INFO:journalctl@ceph.mds.c.smithi149.stdout:Sep 13 17:27:20 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-c[65894]: 2024-09-13T17:27:20.674+0000 7f55214ed640 -1 mds.c *** got signal Terminated *** 2024-09-13T17:27:23.092 INFO:journalctl@ceph.mds.c.smithi149.stdout:Sep 13 17:27:22 smithi149 podman[72835]: 2024-09-13 17:27:22.825314476 +0000 UTC m=+2.251955792 container died 3df041b80a227ad83f9094e397e79ef0afb97d2b929d8f8c3b903bab537963a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-c, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-13T17:27:23.435 INFO:journalctl@ceph.mds.c.smithi149.stdout:Sep 13 17:27:23 smithi149 podman[72835]: 2024-09-13 17:27:23.232636243 +0000 UTC m=+2.659277548 container cleanup 3df041b80a227ad83f9094e397e79ef0afb97d2b929d8f8c3b903bab537963a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-13T17:27:23.435 INFO:journalctl@ceph.mds.c.smithi149.stdout:Sep 13 17:27:23 smithi149 bash[72835]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-c 2024-09-13T17:27:23.571 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.c.service' 2024-09-13T17:27:23.608 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:27:23.608 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-13T17:27:23.609 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-13T17:27:23.609 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.f 2024-09-13T17:27:24.092 INFO:journalctl@ceph.mds.f.smithi149.stdout:Sep 13 17:27:23 smithi149 systemd[1]: Stopping Ceph mds.f for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:27:24.092 INFO:journalctl@ceph.mds.f.smithi149.stdout:Sep 13 17:27:23 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-f[65590]: 2024-09-13T17:27:23.945+0000 7fbc65c81640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:27:24.092 INFO:journalctl@ceph.mds.f.smithi149.stdout:Sep 13 17:27:23 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-f[65590]: 2024-09-13T17:27:23.945+0000 7fbc65c81640 -1 mds.f *** got signal Terminated *** 2024-09-13T17:27:27.092 INFO:journalctl@ceph.mds.f.smithi149.stdout:Sep 13 17:27:26 smithi149 podman[72969]: 2024-09-13 17:27:26.813258333 +0000 UTC m=+2.973824690 container died cd23e64839faf25d0052c40e56808474d9663c53e554b2b59610d311af15c015 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-f, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True) 2024-09-13T17:27:27.455 INFO:journalctl@ceph.mds.f.smithi149.stdout:Sep 13 17:27:27 smithi149 podman[72969]: 2024-09-13 17:27:27.261745721 +0000 UTC m=+3.422312084 container cleanup cd23e64839faf25d0052c40e56808474d9663c53e554b2b59610d311af15c015 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-13T17:27:27.455 INFO:journalctl@ceph.mds.f.smithi149.stdout:Sep 13 17:27:27 smithi149 bash[72969]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-f 2024-09-13T17:27:27.691 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.f.service' 2024-09-13T17:27:27.713 INFO:journalctl@ceph.mds.f.smithi149.stdout:Sep 13 17:27:27 smithi149 podman[72981]: 2024-09-13 17:27:27.454451621 +0000 UTC m=+0.630355855 container remove cd23e64839faf25d0052c40e56808474d9663c53e554b2b59610d311af15c015 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-f, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T17:27:27.713 INFO:journalctl@ceph.mds.f.smithi149.stdout:Sep 13 17:27:27 smithi149 systemd[1]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.f.service: Deactivated successfully. 2024-09-13T17:27:27.713 INFO:journalctl@ceph.mds.f.smithi149.stdout:Sep 13 17:27:27 smithi149 systemd[1]: Stopped Ceph mds.f for 043d5bae-71f2-11ef-bceb-c7b262605968. 2024-09-13T17:27:27.713 INFO:journalctl@ceph.mds.f.smithi149.stdout:Sep 13 17:27:27 smithi149 systemd[1]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.f.service: Consumed 31.227s CPU time. 2024-09-13T17:27:27.725 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:27:27.725 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-13T17:27:27.725 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-13T17:27:27.725 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.i 2024-09-13T17:27:28.058 INFO:journalctl@ceph.mds.i.smithi149.stdout:Sep 13 17:27:27 smithi149 systemd[1]: Stopping Ceph mds.i for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:27:28.342 INFO:journalctl@ceph.mds.i.smithi149.stdout:Sep 13 17:27:28 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-i[66198]: 2024-09-13T17:27:28.057+0000 7f27e9721640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:27:28.342 INFO:journalctl@ceph.mds.i.smithi149.stdout:Sep 13 17:27:28 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-i[66198]: 2024-09-13T17:27:28.057+0000 7f27e9721640 -1 mds.i *** got signal Terminated *** 2024-09-13T17:27:31.092 INFO:journalctl@ceph.mds.i.smithi149.stdout:Sep 13 17:27:30 smithi149 podman[73089]: 2024-09-13 17:27:30.832324354 +0000 UTC m=+2.887017404 container died 364b088f43260f135872ee8755482b43622c33ccd07bf1d55c07eba4da3280e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-i, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True) 2024-09-13T17:27:31.475 INFO:journalctl@ceph.mds.i.smithi149.stdout:Sep 13 17:27:31 smithi149 podman[73089]: 2024-09-13 17:27:31.231837504 +0000 UTC m=+3.286530553 container cleanup 364b088f43260f135872ee8755482b43622c33ccd07bf1d55c07eba4da3280e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-i, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-13T17:27:31.475 INFO:journalctl@ceph.mds.i.smithi149.stdout:Sep 13 17:27:31 smithi149 bash[73089]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-i 2024-09-13T17:27:31.614 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.i.service' 2024-09-13T17:27:31.647 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:27:31.647 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-13T17:27:31.647 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-13T17:27:31.648 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.l 2024-09-13T17:27:31.995 INFO:journalctl@ceph.mds.l.smithi149.stdout:Sep 13 17:27:31 smithi149 systemd[1]: Stopping Ceph mds.l for 043d5bae-71f2-11ef-bceb-c7b262605968... 2024-09-13T17:27:32.342 INFO:journalctl@ceph.mds.l.smithi149.stdout:Sep 13 17:27:31 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-l[65284]: 2024-09-13T17:27:31.993+0000 7f157eb84640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:27:32.342 INFO:journalctl@ceph.mds.l.smithi149.stdout:Sep 13 17:27:31 smithi149 ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-l[65284]: 2024-09-13T17:27:31.993+0000 7f157eb84640 -1 mds.l *** got signal Terminated *** 2024-09-13T17:27:35.092 INFO:journalctl@ceph.mds.l.smithi149.stdout:Sep 13 17:27:34 smithi149 podman[73209]: 2024-09-13 17:27:34.828724434 +0000 UTC m=+2.965989855 container died f4a6ee081929566154f8bf833ef4dce990760ea38b74cca85fd834cf9cdca594 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-l, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T17:27:35.470 INFO:journalctl@ceph.mds.l.smithi149.stdout:Sep 13 17:27:35 smithi149 podman[73209]: 2024-09-13 17:27:35.201900761 +0000 UTC m=+3.339166170 container cleanup f4a6ee081929566154f8bf833ef4dce990760ea38b74cca85fd834cf9cdca594 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-l, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T17:27:35.471 INFO:journalctl@ceph.mds.l.smithi149.stdout:Sep 13 17:27:35 smithi149 bash[73209]: ceph-043d5bae-71f2-11ef-bceb-c7b262605968-mds-l 2024-09-13T17:27:35.618 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-043d5bae-71f2-11ef-bceb-c7b262605968@mds.l.service' 2024-09-13T17:27:35.649 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T17:27:35.649 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-13T17:27:35.650 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T17:27:35.802 INFO:teuthology.orchestra.run.smithi087.stdout:Deleting cluster with fsid: 043d5bae-71f2-11ef-bceb-c7b262605968 2024-09-13T17:27:38.146 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T17:27:38.298 INFO:teuthology.orchestra.run.smithi118.stdout:Deleting cluster with fsid: 043d5bae-71f2-11ef-bceb-c7b262605968 2024-09-13T17:27:40.664 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T17:27:40.818 INFO:teuthology.orchestra.run.smithi149.stdout:Deleting cluster with fsid: 043d5bae-71f2-11ef-bceb-c7b262605968 2024-09-13T17:27:43.016 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T17:27:43.050 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T17:27:43.083 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T17:27:43.109 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-13T17:27:43.111 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903864/remote/smithi087/crash 2024-09-13T17:27:43.112 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/crash -- . 2024-09-13T17:27:43.140 INFO:teuthology.orchestra.run.smithi087.stderr:tar: /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T17:27:43.140 INFO:teuthology.orchestra.run.smithi087.stderr:tar: Error is not recoverable: exiting now 2024-09-13T17:27:43.142 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903864/remote/smithi118/crash 2024-09-13T17:27:43.143 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/crash -- . 2024-09-13T17:27:43.269 INFO:teuthology.orchestra.run.smithi118.stderr:tar: /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T17:27:43.269 INFO:teuthology.orchestra.run.smithi118.stderr:tar: Error is not recoverable: exiting now 2024-09-13T17:27:43.272 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903864/remote/smithi149/crash 2024-09-13T17:27:43.272 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/crash -- . 2024-09-13T17:27:43.307 INFO:teuthology.orchestra.run.smithi149.stderr:tar: /var/lib/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T17:27:43.308 INFO:teuthology.orchestra.run.smithi149.stderr:tar: Error is not recoverable: exiting now 2024-09-13T17:27:43.309 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-13T17:27:43.309 DEBUG:teuthology.orchestra.run.smithi087:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-13T17:27:43.342 INFO:teuthology.orchestra.run.smithi087.stderr:grep: /var/log/ceph/043d5bae-71f2-11ef-bceb-c7b262605968/ceph.log: No such file or directory 2024-09-13T17:27:43.348 INFO:tasks.cephadm:Compressing logs... 2024-09-13T17:27:43.348 DEBUG:teuthology.orchestra.run.smithi087:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:27:43.390 DEBUG:teuthology.orchestra.run.smithi118:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:27:43.393 DEBUG:teuthology.orchestra.run.smithi149:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:27:43.416 INFO:teuthology.orchestra.run.smithi087.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-13T17:27:43.417 INFO:teuthology.orchestra.run.smithi149.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-13T17:27:43.419 INFO:teuthology.orchestra.run.smithi118.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-13T17:29:04.629 INFO:tasks.cephadm:Archiving logs... 2024-09-13T17:29:04.629 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903864/remote/smithi087/log 2024-09-13T17:29:04.787 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T17:29:10.956 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903864/remote/smithi118/log 2024-09-13T17:29:10.957 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T17:29:15.347 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903864/remote/smithi149/log 2024-09-13T17:29:15.348 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T17:29:25.271 INFO:tasks.cephadm:Removing cluster... 2024-09-13T17:29:25.271 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 --force 2024-09-13T17:29:25.423 INFO:teuthology.orchestra.run.smithi087.stdout:Deleting cluster with fsid: 043d5bae-71f2-11ef-bceb-c7b262605968 2024-09-13T17:29:25.790 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 --force 2024-09-13T17:29:25.943 INFO:teuthology.orchestra.run.smithi118.stdout:Deleting cluster with fsid: 043d5bae-71f2-11ef-bceb-c7b262605968 2024-09-13T17:29:26.248 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 043d5bae-71f2-11ef-bceb-c7b262605968 --force 2024-09-13T17:29:26.402 INFO:teuthology.orchestra.run.smithi149.stdout:Deleting cluster with fsid: 043d5bae-71f2-11ef-bceb-c7b262605968 2024-09-13T17:29:26.751 INFO:tasks.cephadm:Removing cephadm ... 2024-09-13T17:29:26.751 DEBUG:teuthology.orchestra.run.smithi087:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T17:29:26.770 DEBUG:teuthology.orchestra.run.smithi118:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T17:29:26.786 DEBUG:teuthology.orchestra.run.smithi149:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T17:29:26.803 INFO:tasks.cephadm:Teardown complete 2024-09-13T17:29:26.803 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T17:29:26.815 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T17:29:26.815 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T17:29:26.818 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T17:29:26.829 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T17:29:26.969 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T17:29:26.979 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T17:29:26.980 DEBUG:teuthology.orchestra.run.smithi087:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T17:29:26.983 DEBUG:teuthology.orchestra.run.smithi118:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T17:29:26.985 DEBUG:teuthology.orchestra.run.smithi149:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T17:29:26.997 INFO:teuthology.orchestra.run.smithi087.stderr:bash: line 1: ntpq: command not found 2024-09-13T17:29:26.997 INFO:teuthology.orchestra.run.smithi118.stderr:bash: line 1: ntpq: command not found 2024-09-13T17:29:26.999 INFO:teuthology.orchestra.run.smithi149.stderr:bash: line 1: ntpq: command not found 2024-09-13T17:29:27.003 INFO:teuthology.orchestra.run.smithi087.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T17:29:27.003 INFO:teuthology.orchestra.run.smithi087.stdout:=============================================================================== 2024-09-13T17:29:27.003 INFO:teuthology.orchestra.run.smithi087.stdout:^* hv01.front.sepia.ceph.com 3 6 377 6 -171us[ -163us] +/- 41ms 2024-09-13T17:29:27.003 INFO:teuthology.orchestra.run.smithi087.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 6 +1104us[+1111us] +/- 75ms 2024-09-13T17:29:27.003 INFO:teuthology.orchestra.run.smithi087.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 -748us[ -740us] +/- 73ms 2024-09-13T17:29:27.003 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:29:27.003 INFO:teuthology.orchestra.run.smithi118.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T17:29:27.004 INFO:teuthology.orchestra.run.smithi118.stdout:=============================================================================== 2024-09-13T17:29:27.004 INFO:teuthology.orchestra.run.smithi118.stdout:^* hv01.front.sepia.ceph.com 3 6 377 8 -182us[ -191us] +/- 41ms 2024-09-13T17:29:27.004 INFO:teuthology.orchestra.run.smithi118.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 4 +1095us[+1095us] +/- 75ms 2024-09-13T17:29:27.004 INFO:teuthology.orchestra.run.smithi118.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 5 -751us[ -751us] +/- 73ms 2024-09-13T17:29:27.004 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:29:27.005 INFO:teuthology.orchestra.run.smithi149.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T17:29:27.005 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================== 2024-09-13T17:29:27.005 INFO:teuthology.orchestra.run.smithi149.stdout:^* hv01.front.sepia.ceph.com 3 6 377 6 -206us[ -201us] +/- 41ms 2024-09-13T17:29:27.005 INFO:teuthology.orchestra.run.smithi149.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 6 +1091us[+1091us] +/- 75ms 2024-09-13T17:29:27.005 INFO:teuthology.orchestra.run.smithi149.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 -757us[ -751us] +/- 73ms 2024-09-13T17:29:27.005 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:29:27.005 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T17:29:27.015 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T17:29:27.016 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T17:29:27.027 DEBUG:teuthology.orchestra.run.smithi087:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T17:29:27.128 DEBUG:teuthology.orchestra.run.smithi118:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T17:29:27.197 DEBUG:teuthology.orchestra.run.smithi149:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T17:29:27.266 DEBUG:teuthology.orchestra.run.smithi087:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T17:29:27.297 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:29:27.298 DEBUG:teuthology.orchestra.run.smithi118:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T17:29:27.325 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:29:27.325 DEBUG:teuthology.orchestra.run.smithi149:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T17:29:27.353 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:29:27.354 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T17:29:27.366 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T17:29:27.376 INFO:teuthology.task.internal:Duration was 1932.222970 seconds 2024-09-13T17:29:27.377 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T17:29:27.388 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T17:29:27.388 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T17:29:27.391 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T17:29:27.393 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T17:29:27.429 INFO:teuthology.orchestra.run.smithi118.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T17:29:27.430 INFO:teuthology.orchestra.run.smithi087.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T17:29:27.433 INFO:teuthology.orchestra.run.smithi149.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T17:29:27.911 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T17:29:27.911 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T17:29:27.912 DEBUG:teuthology.orchestra.run.smithi087:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T17:29:27.934 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi118.front.sepia.ceph.com 2024-09-13T17:29:27.934 DEBUG:teuthology.orchestra.run.smithi118:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T17:29:27.975 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi149.front.sepia.ceph.com 2024-09-13T17:29:27.975 DEBUG:teuthology.orchestra.run.smithi149:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T17:29:27.997 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T17:29:27.997 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:29:28.000 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:29:28.018 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:29:28.064 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T17:29:28.064 DEBUG:teuthology.orchestra.run.smithi087:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T17:29:28.068 DEBUG:teuthology.orchestra.run.smithi118:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T17:29:28.084 DEBUG:teuthology.orchestra.run.smithi149:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T17:29:28.498 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T17:29:28.509 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T17:29:28.509 DEBUG:teuthology.orchestra.run.smithi087:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T17:29:28.534 DEBUG:teuthology.orchestra.run.smithi118:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T17:29:28.559 DEBUG:teuthology.orchestra.run.smithi149:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T17:29:28.584 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T17:29:28.595 DEBUG:teuthology.orchestra.run.smithi087:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:29:28.598 DEBUG:teuthology.orchestra.run.smithi118:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:29:28.601 DEBUG:teuthology.orchestra.run.smithi149:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:29:28.618 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = core 2024-09-13T17:29:28.622 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = core 2024-09-13T17:29:28.650 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = core 2024-09-13T17:29:28.694 DEBUG:teuthology.orchestra.run.smithi087:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:29:28.709 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:29:28.709 DEBUG:teuthology.orchestra.run.smithi118:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:29:28.723 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:29:28.724 DEBUG:teuthology.orchestra.run.smithi149:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:29:28.749 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:29:28.749 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T17:29:28.761 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T17:29:28.763 DEBUG:teuthology.misc:Transferring archived files from smithi087:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903864/remote/smithi087 2024-09-13T17:29:28.763 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T17:29:28.805 DEBUG:teuthology.misc:Transferring archived files from smithi118:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903864/remote/smithi118 2024-09-13T17:29:28.805 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T17:29:28.841 DEBUG:teuthology.misc:Transferring archived files from smithi149:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903864/remote/smithi149 2024-09-13T17:29:28.842 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T17:29:28.878 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T17:29:28.878 DEBUG:teuthology.orchestra.run.smithi087:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T17:29:28.881 DEBUG:teuthology.orchestra.run.smithi118:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T17:29:28.883 DEBUG:teuthology.orchestra.run.smithi149:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T17:29:28.928 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T17:29:28.940 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T17:29:28.940 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T17:29:28.952 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T17:29:28.952 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T17:29:28.955 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T17:29:28.957 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T17:29:28.967 INFO:teuthology.orchestra.run.smithi087.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 17:29 /home/ubuntu/cephtest 2024-09-13T17:29:28.969 INFO:teuthology.orchestra.run.smithi118.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 17:29 /home/ubuntu/cephtest 2024-09-13T17:29:28.983 INFO:teuthology.orchestra.run.smithi149.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 17:29 /home/ubuntu/cephtest 2024-09-13T17:29:28.985 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T17:29:28.996 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T17:29:29.023 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/fs/norstats}} duration: 1932.2229702472687 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-13T17:29:29.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T17:29:29.113 INFO:teuthology.run:pass